The cache for model files in Transformers v4.22.0 has been updated. Migrating your old cache. This is a one-time only operation. You can interrupt this and resume the migration later on by calling `transformers.utils.move_cache()`.

0it [00:00, ?it/s]
0it [00:00, ?it/s]
/opt/conda/lib/python3.10/site-packages/transformers/deepspeed.py:23: FutureWarning: transformers.deepspeed module is deprecated and will be removed in a future version. Please import deepspeed modules directly from transformers.integrations
  warnings.warn(
2024-07-14 08:43:45.068999: E external/local_xla/xla/stream_executor/cuda/cuda_dnn.cc:9261] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered
2024-07-14 08:43:45.069097: E external/local_xla/xla/stream_executor/cuda/cuda_fft.cc:607] Unable to register cuFFT factory: Attempting to register factory for plugin cuFFT when one has already been registered
2024-07-14 08:43:45.179167: E external/local_xla/xla/stream_executor/cuda/cuda_blas.cc:1515] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
/opt/conda/lib/python3.10/site-packages/datasets/load.py:929: FutureWarning: The repository for data contains custom code which must be executed to correctly load the dataset. You can inspect the repository content at /kaggle/working/amr-tst-indo/AMRBART-id/fine-tune/data_interface/data.py
You can avoid this message in future by passing the argument `trust_remote_code=True`.
Passing `trust_remote_code=True` will be mandatory to load this dataset from the next major release of `datasets`.
  warnings.warn(

Generating train split: 0 examples [00:00, ? examples/s]
Generating train split: 900 examples [00:00, 6387.15 examples/s]
Generating train split: 2220 examples [00:00, 9815.64 examples/s]
Generating train split: 4015 examples [00:00, 13212.94 examples/s]
Generating train split: 5861 examples [00:00, 15172.75 examples/s]
Generating train split: 7684 examples [00:00, 16232.50 examples/s]
Generating train split: 9523 examples [00:00, 16948.52 examples/s]
Generating train split: 11410 examples [00:00, 17565.17 examples/s]
Generating train split: 14023 examples [00:00, 17502.61 examples/s]
Generating train split: 15808 examples [00:00, 17346.06 examples/s]
Generating train split: 17592 examples [00:01, 17483.60 examples/s]
Generating train split: 19434 examples [00:01, 17751.28 examples/s]
Generating train split: 21320 examples [00:01, 18070.43 examples/s]
Generating train split: 23204 examples [00:01, 18293.39 examples/s]
Generating train split: 25071 examples [00:01, 18401.97 examples/s]
Generating train split: 27000 examples [00:01, 18435.90 examples/s]
Generating train split: 29000 examples [00:01, 18505.72 examples/s]
Generating train split: 30999 examples [00:01, 18740.92 examples/s]
Generating train split: 33769 examples [00:01, 18628.11 examples/s]
Generating train split: 36539 examples [00:02, 18568.61 examples/s]
Generating train split: 39297 examples [00:02, 18502.83 examples/s]
Generating train split: 41992 examples [00:02, 18312.98 examples/s]
Generating train split: 43846 examples [00:02, 18363.85 examples/s]
Generating train split: 45697 examples [00:02, 18400.24 examples/s]
Generating train split: 47554 examples [00:02, 18442.95 examples/s]
Generating train split: 50298 examples [00:02, 18386.03 examples/s]
Generating train split: 53008 examples [00:03, 18272.99 examples/s]
Generating train split: 54901 examples [00:03, 18431.63 examples/s]
Generating train split: 57582 examples [00:03, 18236.20 examples/s]
Generating train split: 60351 examples [00:03, 18306.67 examples/s]
Generating train split: 62199 examples [00:03, 18345.48 examples/s]
Generating train split: 64067 examples [00:03, 18428.67 examples/s]
Generating train split: 66000 examples [00:03, 18498.50 examples/s]
Generating train split: 67997 examples [00:03, 18702.40 examples/s]
Generating train split: 70791 examples [00:03, 18671.13 examples/s]
Generating train split: 73559 examples [00:04, 18593.01 examples/s]
Generating train split: 76291 examples [00:04, 18464.65 examples/s]
Generating train split: 79060 examples [00:04, 18460.17 examples/s]
Generating train split: 81000 examples [00:04, 18456.65 examples/s]
Generating train split: 82877 examples [00:04, 18532.86 examples/s]
Generating train split: 85620 examples [00:04, 18443.12 examples/s]
Generating train split: 88375 examples [00:04, 18415.40 examples/s]
Generating train split: 91110 examples [00:05, 18353.51 examples/s]
Generating train split: 92867 examples [00:05, 17906.92 examples/s]

Running tokenizer on train dataset:   0%|          | 0/92867 [00:00<?, ? examples/s]/opt/conda/lib/python3.10/site-packages/transformers/tokenization_utils_base.py:3946: UserWarning: `as_target_tokenizer` is deprecated and will be removed in v5 of Transformers. You can tokenize your labels by using the argument `text_target` of the regular `__call__` method (either in the same call as your input texts if you use the same keyword arguments, or in a separate call.
  warnings.warn(

Running tokenizer on train dataset:   1%|          | 1000/92867 [00:01<02:30, 611.12 examples/s]
Running tokenizer on train dataset:   2%|▏         | 2000/92867 [00:02<01:50, 819.34 examples/s]
Running tokenizer on train dataset:   3%|▎         | 3000/92867 [00:04<02:03, 726.09 examples/s]
Running tokenizer on train dataset:   4%|▍         | 4000/92867 [00:06<02:23, 620.53 examples/s]
Running tokenizer on train dataset:   5%|▌         | 5000/92867 [00:07<02:26, 598.86 examples/s]
Running tokenizer on train dataset:   6%|▋         | 6000/92867 [00:09<02:30, 577.38 examples/s]
Running tokenizer on train dataset:   8%|▊         | 7000/92867 [00:11<02:31, 567.77 examples/s]
Running tokenizer on train dataset:   9%|▊         | 8000/92867 [00:13<02:30, 565.59 examples/s]
Running tokenizer on train dataset:  10%|▉         | 9000/92867 [00:14<02:24, 578.53 examples/s]
Running tokenizer on train dataset:  11%|█         | 10000/92867 [00:16<02:08, 645.38 examples/s]
Running tokenizer on train dataset:  12%|█▏        | 11000/92867 [00:17<01:57, 698.21 examples/s]
Running tokenizer on train dataset:  13%|█▎        | 12000/92867 [00:18<01:53, 713.60 examples/s]
Running tokenizer on train dataset:  14%|█▍        | 13000/92867 [00:19<01:49, 731.20 examples/s]
Running tokenizer on train dataset:  15%|█▌        | 14000/92867 [00:20<01:40, 781.34 examples/s]
Running tokenizer on train dataset:  16%|█▌        | 15000/92867 [00:22<01:36, 809.81 examples/s]
Running tokenizer on train dataset:  17%|█▋        | 16000/92867 [00:23<01:31, 841.78 examples/s]
Running tokenizer on train dataset:  18%|█▊        | 17000/92867 [00:24<01:28, 853.27 examples/s]
Running tokenizer on train dataset:  19%|█▉        | 18000/92867 [00:25<01:28, 847.52 examples/s]
Running tokenizer on train dataset:  20%|██        | 19000/92867 [00:26<01:30, 817.60 examples/s]
Running tokenizer on train dataset:  22%|██▏       | 20000/92867 [00:28<01:27, 828.47 examples/s]
Running tokenizer on train dataset:  23%|██▎       | 21000/92867 [00:29<01:25, 845.46 examples/s]
Running tokenizer on train dataset:  24%|██▎       | 22000/92867 [00:30<01:23, 850.45 examples/s]
Running tokenizer on train dataset:  25%|██▍       | 23000/92867 [00:31<01:24, 828.65 examples/s]
Running tokenizer on train dataset:  26%|██▌       | 24000/92867 [00:32<01:25, 807.54 examples/s]
Running tokenizer on train dataset:  27%|██▋       | 25000/92867 [00:34<01:24, 806.56 examples/s]
Running tokenizer on train dataset:  28%|██▊       | 26000/92867 [00:35<01:24, 794.02 examples/s]
Running tokenizer on train dataset:  29%|██▉       | 27000/92867 [00:36<01:23, 790.10 examples/s]
Running tokenizer on train dataset:  30%|███       | 28000/92867 [00:38<01:26, 751.89 examples/s]
Running tokenizer on train dataset:  31%|███       | 29000/92867 [00:39<01:27, 731.19 examples/s]
Running tokenizer on train dataset:  32%|███▏      | 30000/92867 [00:41<01:28, 713.25 examples/s]
Running tokenizer on train dataset:  33%|███▎      | 31000/92867 [00:42<01:28, 702.13 examples/s]
Running tokenizer on train dataset:  34%|███▍      | 32000/92867 [00:44<01:31, 668.55 examples/s]
Running tokenizer on train dataset:  36%|███▌      | 33000/92867 [00:45<01:30, 658.70 examples/s]
Running tokenizer on train dataset:  37%|███▋      | 34000/92867 [00:47<01:30, 650.56 examples/s]
Running tokenizer on train dataset:  38%|███▊      | 35000/92867 [00:48<01:29, 650.09 examples/s]
Running tokenizer on train dataset:  39%|███▉      | 36000/92867 [00:50<01:28, 643.70 examples/s]
Running tokenizer on train dataset:  40%|███▉      | 37000/92867 [00:51<01:24, 659.86 examples/s]
Running tokenizer on train dataset:  41%|████      | 38000/92867 [00:53<01:21, 673.05 examples/s]
Running tokenizer on train dataset:  42%|████▏     | 39000/92867 [00:54<01:20, 669.92 examples/s]
Running tokenizer on train dataset:  43%|████▎     | 40000/92867 [00:56<01:21, 645.80 examples/s]
Running tokenizer on train dataset:  44%|████▍     | 41000/92867 [00:58<01:33, 557.64 examples/s]
Running tokenizer on train dataset:  45%|████▌     | 42000/92867 [01:00<01:30, 564.92 examples/s]
Running tokenizer on train dataset:  46%|████▋     | 43000/92867 [01:02<01:25, 582.64 examples/s]
Running tokenizer on train dataset:  47%|████▋     | 44000/92867 [01:03<01:20, 605.28 examples/s]
Running tokenizer on train dataset:  48%|████▊     | 45000/92867 [01:05<01:19, 599.78 examples/s]
Running tokenizer on train dataset:  50%|████▉     | 46000/92867 [01:07<01:18, 598.61 examples/s]
Running tokenizer on train dataset:  51%|█████     | 47000/92867 [01:08<01:14, 615.58 examples/s]
Running tokenizer on train dataset:  52%|█████▏    | 48000/92867 [01:10<01:15, 595.41 examples/s]
Running tokenizer on train dataset:  53%|█████▎    | 49000/92867 [01:11<01:11, 615.05 examples/s]
Running tokenizer on train dataset:  54%|█████▍    | 50000/92867 [01:13<01:13, 582.67 examples/s]
Running tokenizer on train dataset:  55%|█████▍    | 51000/92867 [01:15<01:15, 551.22 examples/s]
Running tokenizer on train dataset:  56%|█████▌    | 52000/92867 [01:17<01:13, 552.87 examples/s]
Running tokenizer on train dataset:  57%|█████▋    | 53000/92867 [01:19<01:14, 533.09 examples/s]
Running tokenizer on train dataset:  58%|█████▊    | 54000/92867 [01:21<01:10, 548.10 examples/s]
Running tokenizer on train dataset:  59%|█████▉    | 55000/92867 [01:23<01:07, 561.39 examples/s]
Running tokenizer on train dataset:  60%|██████    | 56000/92867 [01:25<01:09, 528.31 examples/s]
Running tokenizer on train dataset:  61%|██████▏   | 57000/92867 [01:27<01:09, 514.25 examples/s]
Running tokenizer on train dataset:  62%|██████▏   | 58000/92867 [01:29<01:08, 508.69 examples/s]
Running tokenizer on train dataset:  64%|██████▎   | 59000/92867 [01:31<01:09, 487.07 examples/s]
Running tokenizer on train dataset:  65%|██████▍   | 60000/92867 [01:32<00:59, 550.70 examples/s]
Running tokenizer on train dataset:  66%|██████▌   | 61000/92867 [01:34<00:53, 593.75 examples/s]
Running tokenizer on train dataset:  67%|██████▋   | 62000/92867 [01:35<00:50, 616.27 examples/s]
Running tokenizer on train dataset:  68%|██████▊   | 63000/92867 [01:37<00:45, 658.77 examples/s]
Running tokenizer on train dataset:  69%|██████▉   | 64000/92867 [01:38<00:41, 702.08 examples/s]
Running tokenizer on train dataset:  70%|██████▉   | 65000/92867 [01:39<00:38, 717.79 examples/s]
Running tokenizer on train dataset:  71%|███████   | 66000/92867 [01:40<00:36, 726.37 examples/s]
Running tokenizer on train dataset:  72%|███████▏  | 67000/92867 [01:42<00:36, 718.24 examples/s]
Running tokenizer on train dataset:  73%|███████▎  | 68000/92867 [01:43<00:34, 721.61 examples/s]
Running tokenizer on train dataset:  74%|███████▍  | 69000/92867 [01:45<00:32, 726.76 examples/s]
Running tokenizer on train dataset:  75%|███████▌  | 70000/92867 [01:46<00:32, 709.52 examples/s]
Running tokenizer on train dataset:  76%|███████▋  | 71000/92867 [01:47<00:30, 705.99 examples/s]
Running tokenizer on train dataset:  78%|███████▊  | 72000/92867 [01:49<00:29, 696.07 examples/s]
Running tokenizer on train dataset:  79%|███████▊  | 73000/92867 [01:51<00:29, 672.80 examples/s]
Running tokenizer on train dataset:  80%|███████▉  | 74000/92867 [01:52<00:28, 653.23 examples/s]
Running tokenizer on train dataset:  81%|████████  | 75000/92867 [01:54<00:27, 645.99 examples/s]
Running tokenizer on train dataset:  82%|████████▏ | 76000/92867 [01:56<00:27, 613.99 examples/s]
Running tokenizer on train dataset:  83%|████████▎ | 77000/92867 [01:57<00:26, 604.69 examples/s]
Running tokenizer on train dataset:  84%|████████▍ | 78000/92867 [01:59<00:25, 591.92 examples/s]
Running tokenizer on train dataset:  85%|████████▌ | 79000/92867 [02:01<00:23, 586.91 examples/s]
Running tokenizer on train dataset:  86%|████████▌ | 80000/92867 [02:03<00:21, 587.38 examples/s]
Running tokenizer on train dataset:  87%|████████▋ | 81000/92867 [02:04<00:19, 596.67 examples/s]
Running tokenizer on train dataset:  88%|████████▊ | 82000/92867 [02:06<00:17, 608.04 examples/s]
Running tokenizer on train dataset:  89%|████████▉ | 83000/92867 [02:08<00:18, 521.68 examples/s]
Running tokenizer on train dataset:  90%|█████████ | 84000/92867 [02:10<00:17, 517.01 examples/s]
Running tokenizer on train dataset:  92%|█████████▏| 85000/92867 [02:12<00:14, 537.94 examples/s]
Running tokenizer on train dataset:  93%|█████████▎| 86000/92867 [02:14<00:12, 558.39 examples/s]
Running tokenizer on train dataset:  94%|█████████▎| 87000/92867 [02:15<00:10, 544.64 examples/s]
Running tokenizer on train dataset:  95%|█████████▍| 88000/92867 [02:17<00:08, 556.14 examples/s]
Running tokenizer on train dataset:  96%|█████████▌| 89000/92867 [02:19<00:07, 546.31 examples/s]
Running tokenizer on train dataset:  97%|█████████▋| 90000/92867 [02:21<00:05, 559.07 examples/s]
Running tokenizer on train dataset:  98%|█████████▊| 91000/92867 [02:23<00:03, 518.73 examples/s]
Running tokenizer on train dataset:  99%|█████████▉| 92000/92867 [02:25<00:01, 512.12 examples/s]
Running tokenizer on train dataset: 100%|██████████| 92867/92867 [02:27<00:00, 502.47 examples/s]
Running tokenizer on train dataset: 100%|██████████| 92867/92867 [02:27<00:00, 630.11 examples/s]
Saving cached train data ...

Saving the dataset (0/1 shards):   0%|          | 0/92867 [00:00<?, ? examples/s]
Saving the dataset (1/1 shards): 100%|██████████| 92867/92867 [00:00<00:00, 963901.09 examples/s]
Saving the dataset (1/1 shards): 100%|██████████| 92867/92867 [00:00<00:00, 961778.08 examples/s]
/kaggle/working/amr-tst-indo/AMRBART-id/fine-tune/main.py:283: FutureWarning: load_metric is deprecated and will be removed in the next major version of datasets. Use 'evaluate.load' instead, from the new library 🤗 Evaluate: https://huggingface.co/docs/evaluate
  metric = load_metric(path="metric/sacrebleu.py") if training_args.task == "amr2text" else None
/opt/conda/lib/python3.10/site-packages/datasets/load.py:855: FutureWarning: The repository for sacrebleu contains custom code which must be executed to correctly load the metric. You can inspect the repository content at metric/sacrebleu.py
You can avoid this message in future by passing the argument `trust_remote_code=True`.
Passing `trust_remote_code=True` will be mandatory to load this metric from the next major release of `datasets`.
  warnings.warn(
/opt/conda/lib/python3.10/site-packages/transformers/optimization.py:588: FutureWarning: This implementation of AdamW is deprecated and will be removed in a future version. Use the PyTorch implementation torch.optim.AdamW instead, or set `no_deprecation_warning=True` to disable this warning
  warnings.warn(
All 371472 steps, warm_up steps: 200
wandb: WARNING The `run_name` is currently set to the same value as `TrainingArguments.output_dir`. If this was not intended, please specify a different run name by setting the `TrainingArguments.run_name` parameter.
wandb: Currently logged in as: abdiharyadi. Use `wandb login --relogin` to force relogin
wandb: wandb version 0.17.4 is available!  To upgrade, please run:
wandb:  $ pip install wandb --upgrade
wandb: Tracking run with wandb version 0.17.0
wandb: Run data is saved locally in /kaggle/working/amr-tst-indo/AMRBART-id/fine-tune/wandb/run-20240714_084631-q205zcu3
wandb: Run `wandb offline` to turn off syncing.
wandb: Syncing run /kaggle/working/amr-tst-indo/AMRBART-id/fine-tune/../outputs/mbart-en-id-smaller-fted
wandb: ⭐️ View project at https://wandb.ai/abdiharyadi/huggingface
wandb: 🚀 View run at https://wandb.ai/abdiharyadi/huggingface/runs/q205zcu3

  0%|          | 0/371472 [00:00<?, ?it/s]/opt/conda/lib/python3.10/multiprocessing/popen_fork.py:66: RuntimeWarning: os.fork() was called. os.fork() is incompatible with multithreaded code, and JAX is multithreaded, so this will likely lead to a deadlock.
  self.pid = os.fork()

  0%|          | 1/371472 [00:00<88:32:04,  1.17it/s]
                                                     
{'loss': 15.3469, 'learning_rate': 5e-09, 'epoch': 0.0}

  0%|          | 1/371472 [00:00<88:32:04,  1.17it/s]
  0%|          | 2/371472 [00:01<56:35:41,  1.82it/s]
  0%|          | 3/371472 [00:01<42:58:01,  2.40it/s]
  0%|          | 4/371472 [00:01<38:13:51,  2.70it/s]
  0%|          | 5/371472 [00:02<33:56:17,  3.04it/s]
  0%|          | 6/371472 [00:02<33:30:47,  3.08it/s]
  0%|          | 7/371472 [00:02<30:54:34,  3.34it/s]
  0%|          | 8/371472 [00:02<29:11:06,  3.54it/s]
  0%|          | 9/371472 [00:03<29:46:04,  3.47it/s]
  0%|          | 10/371472 [00:03<29:25:02,  3.51it/s]
  0%|          | 11/371472 [00:03<29:14:38,  3.53it/s]
  0%|          | 12/371472 [00:03<28:36:42,  3.61it/s]
  0%|          | 13/371472 [00:04<32:09:50,  3.21it/s]
  0%|          | 14/371472 [00:04<31:14:09,  3.30it/s]
  0%|          | 15/371472 [00:04<30:00:55,  3.44it/s]
  0%|          | 16/371472 [00:05<29:03:03,  3.55it/s]
  0%|          | 17/371472 [00:05<30:33:17,  3.38it/s]
  0%|          | 18/371472 [00:05<29:56:36,  3.45it/s]
  0%|          | 19/371472 [00:05<28:36:15,  3.61it/s]
  0%|          | 20/371472 [00:06<27:42:44,  3.72it/s]
                                                      
{'loss': 13.5266, 'learning_rate': 1e-07, 'epoch': 0.0}

  0%|          | 20/371472 [00:06<27:42:44,  3.72it/s]
  0%|          | 21/371472 [00:06<28:28:25,  3.62it/s]
  0%|          | 22/371472 [00:06<29:07:56,  3.54it/s]
  0%|          | 23/371472 [00:07<28:54:49,  3.57it/s]
  0%|          | 24/371472 [00:07<27:59:49,  3.69it/s]
  0%|          | 25/371472 [00:07<28:55:14,  3.57it/s]
  0%|          | 26/371472 [00:07<29:32:41,  3.49it/s]
  0%|          | 27/371472 [00:08<29:36:10,  3.49it/s]
  0%|          | 28/371472 [00:08<29:10:25,  3.54it/s]
  0%|          | 29/371472 [00:08<30:18:49,  3.40it/s]
  0%|          | 30/371472 [00:09<28:38:24,  3.60it/s]
  0%|          | 31/371472 [00:09<27:28:19,  3.76it/s]
  0%|          | 32/371472 [00:09<27:45:58,  3.72it/s]
  0%|          | 33/371472 [00:09<29:37:20,  3.48it/s]
  0%|          | 34/371472 [00:10<29:25:30,  3.51it/s]
  0%|          | 35/371472 [00:10<30:58:24,  3.33it/s]
  0%|          | 36/371472 [00:10<29:58:09,  3.44it/s]
  0%|          | 37/371472 [00:11<29:38:18,  3.48it/s]
  0%|          | 38/371472 [00:11<29:36:46,  3.48it/s]
  0%|          | 39/371472 [00:11<29:41:13,  3.48it/s]
  0%|          | 40/371472 [00:11<28:54:34,  3.57it/s]
                                                      
{'loss': 12.4249, 'learning_rate': 2e-07, 'epoch': 0.0}

  0%|          | 40/371472 [00:11<28:54:34,  3.57it/s]
  0%|          | 41/371472 [00:12<29:05:41,  3.55it/s]
  0%|          | 42/371472 [00:12<28:38:46,  3.60it/s]
  0%|          | 43/371472 [00:12<28:34:41,  3.61it/s]
  0%|          | 44/371472 [00:13<30:37:31,  3.37it/s]
  0%|          | 45/371472 [00:13<31:37:52,  3.26it/s]
  0%|          | 46/371472 [00:13<32:58:57,  3.13it/s]
  0%|          | 47/371472 [00:14<32:47:26,  3.15it/s]
  0%|          | 48/371472 [00:14<32:25:48,  3.18it/s]
  0%|          | 49/371472 [00:14<30:56:18,  3.33it/s]
  0%|          | 50/371472 [00:15<38:07:40,  2.71it/s]
  0%|          | 51/371472 [00:15<35:09:36,  2.93it/s]
  0%|          | 52/371472 [00:15<33:33:13,  3.07it/s]
  0%|          | 53/371472 [00:16<31:42:59,  3.25it/s]
  0%|          | 54/371472 [00:16<30:35:03,  3.37it/s]
  0%|          | 55/371472 [00:16<30:14:09,  3.41it/s]
  0%|          | 56/371472 [00:16<29:55:37,  3.45it/s]
  0%|          | 57/371472 [00:17<29:33:06,  3.49it/s]
  0%|          | 58/371472 [00:17<32:11:19,  3.21it/s]
  0%|          | 59/371472 [00:17<32:32:55,  3.17it/s]
  0%|          | 60/371472 [00:18<30:40:06,  3.36it/s]
                                                      
{'loss': 11.9215, 'learning_rate': 3e-07, 'epoch': 0.0}

  0%|          | 60/371472 [00:18<30:40:06,  3.36it/s]
  0%|          | 61/371472 [00:18<29:52:21,  3.45it/s]
  0%|          | 62/371472 [00:18<28:50:45,  3.58it/s]
  0%|          | 63/371472 [00:18<29:25:48,  3.51it/s]
  0%|          | 64/371472 [00:19<28:13:47,  3.65it/s]
  0%|          | 65/371472 [00:19<28:23:30,  3.63it/s]
  0%|          | 66/371472 [00:19<27:59:08,  3.69it/s]
  0%|          | 67/371472 [00:19<27:37:55,  3.73it/s]
  0%|          | 68/371472 [00:20<28:28:37,  3.62it/s]
  0%|          | 69/371472 [00:20<28:40:16,  3.60it/s]
  0%|          | 70/371472 [00:20<28:10:12,  3.66it/s]
  0%|          | 71/371472 [00:21<28:53:54,  3.57it/s]
  0%|          | 72/371472 [00:21<29:13:00,  3.53it/s]
  0%|          | 73/371472 [00:21<29:40:28,  3.48it/s]
  0%|          | 74/371472 [00:21<28:32:20,  3.61it/s]
  0%|          | 75/371472 [00:22<29:53:03,  3.45it/s]
  0%|          | 76/371472 [00:22<28:46:51,  3.58it/s]
  0%|          | 77/371472 [00:22<29:47:49,  3.46it/s]
  0%|          | 78/371472 [00:23<29:28:12,  3.50it/s]
  0%|          | 79/371472 [00:23<29:25:57,  3.51it/s]
  0%|          | 80/371472 [00:23<28:32:26,  3.61it/s]
                                                      
{'loss': 10.5898, 'learning_rate': 4e-07, 'epoch': 0.0}

  0%|          | 80/371472 [00:23<28:32:26,  3.61it/s]
  0%|          | 81/371472 [00:23<28:44:15,  3.59it/s]
  0%|          | 82/371472 [00:24<30:02:43,  3.43it/s]
  0%|          | 83/371472 [00:24<32:03:11,  3.22it/s]
  0%|          | 84/371472 [00:24<31:55:18,  3.23it/s]
  0%|          | 85/371472 [00:25<30:15:27,  3.41it/s]
  0%|          | 86/371472 [00:25<32:03:44,  3.22it/s]
  0%|          | 87/371472 [00:25<30:10:57,  3.42it/s]
  0%|          | 88/371472 [00:26<31:37:27,  3.26it/s]
  0%|          | 89/371472 [00:26<29:46:10,  3.47it/s]
  0%|          | 90/371472 [00:26<30:59:20,  3.33it/s]
  0%|          | 91/371472 [00:26<28:59:37,  3.56it/s]
  0%|          | 92/371472 [00:27<28:43:47,  3.59it/s]
  0%|          | 93/371472 [00:27<28:56:40,  3.56it/s]
  0%|          | 94/371472 [00:27<27:49:25,  3.71it/s]
  0%|          | 95/371472 [00:28<28:49:27,  3.58it/s]
  0%|          | 96/371472 [00:28<29:23:48,  3.51it/s]
  0%|          | 97/371472 [00:28<28:57:11,  3.56it/s]
  0%|          | 98/371472 [00:28<29:15:40,  3.53it/s]
  0%|          | 99/371472 [00:29<30:05:22,  3.43it/s]
  0%|          | 100/371472 [00:29<29:03:50,  3.55it/s]
                                                       
{'loss': 9.9173, 'learning_rate': 5e-07, 'epoch': 0.0}

  0%|          | 100/371472 [00:29<29:03:50,  3.55it/s]
  0%|          | 101/371472 [00:29<29:21:36,  3.51it/s]
  0%|          | 102/371472 [00:30<30:27:05,  3.39it/s]
  0%|          | 103/371472 [00:30<28:54:45,  3.57it/s]
  0%|          | 104/371472 [00:30<29:32:18,  3.49it/s]
  0%|          | 105/371472 [00:30<28:46:21,  3.59it/s]
  0%|          | 106/371472 [00:31<27:57:29,  3.69it/s]
  0%|          | 107/371472 [00:31<27:03:00,  3.81it/s]
  0%|          | 108/371472 [00:31<28:28:05,  3.62it/s]
  0%|          | 109/371472 [00:32<31:46:27,  3.25it/s]
  0%|          | 110/371472 [00:32<31:02:43,  3.32it/s]
  0%|          | 111/371472 [00:32<30:46:07,  3.35it/s]
  0%|          | 112/371472 [00:32<29:44:00,  3.47it/s]
  0%|          | 113/371472 [00:33<28:21:53,  3.64it/s]
  0%|          | 114/371472 [00:33<27:39:08,  3.73it/s]
  0%|          | 115/371472 [00:33<27:49:22,  3.71it/s]
  0%|          | 116/371472 [00:33<27:14:14,  3.79it/s]
  0%|          | 117/371472 [00:34<27:00:36,  3.82it/s]
  0%|          | 118/371472 [00:34<27:07:59,  3.80it/s]
  0%|          | 119/371472 [00:34<26:48:12,  3.85it/s]
  0%|          | 120/371472 [00:34<28:25:05,  3.63it/s]
                                                       
{'loss': 8.5743, 'learning_rate': 6e-07, 'epoch': 0.01}

  0%|          | 120/371472 [00:35<28:25:05,  3.63it/s]
  0%|          | 121/371472 [00:35<28:01:52,  3.68it/s]
  0%|          | 122/371472 [00:35<28:07:26,  3.67it/s]
  0%|          | 123/371472 [00:35<28:41:18,  3.60it/s]
  0%|          | 124/371472 [00:36<28:42:07,  3.59it/s]
  0%|          | 125/371472 [00:36<28:34:43,  3.61it/s]
  0%|          | 126/371472 [00:36<28:35:47,  3.61it/s]
  0%|          | 127/371472 [00:36<27:13:47,  3.79it/s]
  0%|          | 128/371472 [00:37<28:23:15,  3.63it/s]
  0%|          | 129/371472 [00:37<27:32:29,  3.75it/s]
  0%|          | 130/371472 [00:37<26:59:57,  3.82it/s]
  0%|          | 131/371472 [00:37<27:40:43,  3.73it/s]
  0%|          | 132/371472 [00:38<29:36:28,  3.48it/s]
  0%|          | 133/371472 [00:38<29:11:18,  3.53it/s]
  0%|          | 134/371472 [00:38<28:20:47,  3.64it/s]
  0%|          | 135/371472 [00:39<28:39:27,  3.60it/s]
  0%|          | 136/371472 [00:39<28:10:50,  3.66it/s]
  0%|          | 137/371472 [00:39<28:31:38,  3.62it/s]
  0%|          | 138/371472 [00:39<27:54:00,  3.70it/s]
  0%|          | 139/371472 [00:40<29:44:21,  3.47it/s]
  0%|          | 140/371472 [00:40<30:48:53,  3.35it/s]
                                                       
{'loss': 7.9646, 'learning_rate': 7e-07, 'epoch': 0.01}

  0%|          | 140/371472 [00:40<30:48:53,  3.35it/s]
  0%|          | 141/371472 [00:40<30:49:21,  3.35it/s]
  0%|          | 142/371472 [00:41<29:29:07,  3.50it/s]
  0%|          | 143/371472 [00:41<28:59:49,  3.56it/s]
  0%|          | 144/371472 [00:41<28:22:54,  3.63it/s]
  0%|          | 145/371472 [00:41<29:47:31,  3.46it/s]
  0%|          | 146/371472 [00:42<30:48:55,  3.35it/s]
  0%|          | 147/371472 [00:42<30:34:14,  3.37it/s]
  0%|          | 148/371472 [00:42<30:59:50,  3.33it/s]
  0%|          | 149/371472 [00:43<29:02:20,  3.55it/s]
  0%|          | 150/371472 [00:43<30:33:13,  3.38it/s]
  0%|          | 151/371472 [00:43<29:16:51,  3.52it/s]
  0%|          | 152/371472 [00:43<28:02:05,  3.68it/s]
  0%|          | 153/371472 [00:44<27:11:25,  3.79it/s]
  0%|          | 154/371472 [00:44<28:48:22,  3.58it/s]
  0%|          | 155/371472 [00:44<28:39:22,  3.60it/s]
  0%|          | 156/371472 [00:45<29:06:51,  3.54it/s]
  0%|          | 157/371472 [00:45<28:20:46,  3.64it/s]
  0%|          | 158/371472 [00:45<28:19:48,  3.64it/s]
  0%|          | 159/371472 [00:45<29:11:31,  3.53it/s]
  0%|          | 160/371472 [00:46<27:52:02,  3.70it/s]
                                                       
{'loss': 7.5993, 'learning_rate': 8e-07, 'epoch': 0.01}

  0%|          | 160/371472 [00:46<27:52:02,  3.70it/s]
  0%|          | 161/371472 [00:46<27:00:13,  3.82it/s]
  0%|          | 162/371472 [00:46<29:10:59,  3.53it/s]
  0%|          | 163/371472 [00:47<28:23:14,  3.63it/s]
  0%|          | 164/371472 [00:47<28:32:52,  3.61it/s]
  0%|          | 165/371472 [00:47<27:37:19,  3.73it/s]
  0%|          | 166/371472 [00:47<27:36:12,  3.74it/s]
  0%|          | 167/371472 [00:48<28:10:04,  3.66it/s]
  0%|          | 168/371472 [00:48<27:58:53,  3.69it/s]
  0%|          | 169/371472 [00:48<26:48:23,  3.85it/s]
  0%|          | 170/371472 [00:48<29:44:33,  3.47it/s]
  0%|          | 171/371472 [00:49<29:40:33,  3.48it/s]
  0%|          | 172/371472 [00:49<28:36:53,  3.60it/s]
  0%|          | 173/371472 [00:49<27:59:11,  3.69it/s]
  0%|          | 174/371472 [00:49<27:31:11,  3.75it/s]
  0%|          | 175/371472 [00:50<29:09:03,  3.54it/s]
  0%|          | 176/371472 [00:50<28:02:09,  3.68it/s]
  0%|          | 177/371472 [00:50<27:36:29,  3.74it/s]
  0%|          | 178/371472 [00:51<27:07:18,  3.80it/s]
  0%|          | 179/371472 [00:51<32:45:04,  3.15it/s]
  0%|          | 180/371472 [00:51<32:33:09,  3.17it/s]
                                                       
{'loss': 7.2787, 'learning_rate': 9e-07, 'epoch': 0.01}

  0%|          | 180/371472 [00:51<32:33:09,  3.17it/s]
  0%|          | 181/371472 [00:52<31:20:17,  3.29it/s]
  0%|          | 182/371472 [00:52<30:15:58,  3.41it/s]
  0%|          | 183/371472 [00:52<30:23:40,  3.39it/s]
  0%|          | 184/371472 [00:52<29:06:57,  3.54it/s]
  0%|          | 185/371472 [00:53<28:49:26,  3.58it/s]
  0%|          | 186/371472 [00:53<29:33:33,  3.49it/s]
  0%|          | 187/371472 [00:53<32:21:34,  3.19it/s]
  0%|          | 188/371472 [00:54<37:07:56,  2.78it/s]
  0%|          | 189/371472 [00:54<37:31:31,  2.75it/s]
  0%|          | 190/371472 [00:54<34:05:20,  3.03it/s]
  0%|          | 191/371472 [00:55<31:56:50,  3.23it/s]
  0%|          | 192/371472 [00:55<29:57:57,  3.44it/s]
  0%|          | 193/371472 [00:55<29:57:07,  3.44it/s]
  0%|          | 194/371472 [00:56<29:13:22,  3.53it/s]
  0%|          | 195/371472 [00:56<29:03:31,  3.55it/s]
  0%|          | 196/371472 [00:56<28:36:42,  3.60it/s]
  0%|          | 197/371472 [00:56<28:32:34,  3.61it/s]
  0%|          | 198/371472 [00:57<28:25:48,  3.63it/s]
  0%|          | 199/371472 [00:57<27:23:36,  3.76it/s]
  0%|          | 200/371472 [00:57<27:36:37,  3.74it/s]
                                                       
{'loss': 7.1685, 'learning_rate': 1e-06, 'epoch': 0.01}

  0%|          | 200/371472 [00:57<27:36:37,  3.74it/s]
  0%|          | 201/371472 [00:57<28:37:37,  3.60it/s]
  0%|          | 202/371472 [00:58<30:00:59,  3.44it/s]
  0%|          | 203/371472 [00:58<29:27:59,  3.50it/s]
  0%|          | 204/371472 [00:58<30:03:06,  3.43it/s]
  0%|          | 205/371472 [00:59<30:57:11,  3.33it/s]
  0%|          | 206/371472 [00:59<29:46:14,  3.46it/s]
  0%|          | 207/371472 [00:59<29:33:29,  3.49it/s]
  0%|          | 208/371472 [00:59<28:19:14,  3.64it/s]
  0%|          | 209/371472 [01:00<27:52:29,  3.70it/s]
  0%|          | 210/371472 [01:00<27:04:54,  3.81it/s]
  0%|          | 211/371472 [01:00<30:32:57,  3.38it/s]
  0%|          | 212/371472 [01:01<31:08:56,  3.31it/s]
  0%|          | 213/371472 [01:01<29:26:03,  3.50it/s]
  0%|          | 214/371472 [01:01<28:52:00,  3.57it/s]
  0%|          | 215/371472 [01:01<28:19:46,  3.64it/s]
  0%|          | 216/371472 [01:02<27:40:37,  3.73it/s]
  0%|          | 217/371472 [01:02<27:30:44,  3.75it/s]
  0%|          | 218/371472 [01:02<27:57:41,  3.69it/s]
  0%|          | 219/371472 [01:02<27:33:51,  3.74it/s]
  0%|          | 220/371472 [01:03<27:53:02,  3.70it/s]
                                                       
{'loss': 6.7489, 'learning_rate': 9.99951518024521e-07, 'epoch': 0.01}

  0%|          | 220/371472 [01:03<27:53:02,  3.70it/s]
  0%|          | 221/371472 [01:03<29:03:57,  3.55it/s]
  0%|          | 222/371472 [01:03<28:45:31,  3.59it/s]
  0%|          | 223/371472 [01:04<29:33:31,  3.49it/s]
  0%|          | 224/371472 [01:04<29:23:28,  3.51it/s]
  0%|          | 225/371472 [01:04<31:41:47,  3.25it/s]
  0%|          | 226/371472 [01:05<35:47:51,  2.88it/s]
  0%|          | 227/371472 [01:05<32:52:54,  3.14it/s]
  0%|          | 228/371472 [01:05<30:33:00,  3.38it/s]
  0%|          | 229/371472 [01:06<30:18:22,  3.40it/s]
  0%|          | 230/371472 [01:06<30:20:20,  3.40it/s]
  0%|          | 231/371472 [01:06<28:54:57,  3.57it/s]
  0%|          | 232/371472 [01:06<28:52:21,  3.57it/s]
  0%|          | 233/371472 [01:07<29:38:14,  3.48it/s]
  0%|          | 234/371472 [01:07<28:52:06,  3.57it/s]
  0%|          | 235/371472 [01:07<28:05:16,  3.67it/s]
  0%|          | 236/371472 [01:07<28:01:51,  3.68it/s]
  0%|          | 237/371472 [01:08<27:57:15,  3.69it/s]
  0%|          | 238/371472 [01:08<27:44:47,  3.72it/s]
  0%|          | 239/371472 [01:08<28:30:20,  3.62it/s]
  0%|          | 240/371472 [01:09<28:59:40,  3.56it/s]
                                                       
{'loss': 7.4429, 'learning_rate': 9.999030360490423e-07, 'epoch': 0.01}

  0%|          | 240/371472 [01:09<28:59:40,  3.56it/s]
  0%|          | 241/371472 [01:09<31:37:34,  3.26it/s]
  0%|          | 242/371472 [01:09<30:02:19,  3.43it/s]
  0%|          | 243/371472 [01:09<29:32:40,  3.49it/s]
  0%|          | 244/371472 [01:10<29:08:14,  3.54it/s]
  0%|          | 245/371472 [01:10<28:35:04,  3.61it/s]
  0%|          | 246/371472 [01:10<29:48:02,  3.46it/s]
  0%|          | 247/371472 [01:11<29:54:29,  3.45it/s]
  0%|          | 248/371472 [01:11<28:17:45,  3.64it/s]
  0%|          | 249/371472 [01:11<27:24:12,  3.76it/s]
  0%|          | 250/371472 [01:11<27:14:17,  3.79it/s]
  0%|          | 251/371472 [01:12<26:46:37,  3.85it/s]
  0%|          | 252/371472 [01:12<27:21:18,  3.77it/s]
  0%|          | 253/371472 [01:12<29:39:29,  3.48it/s]
  0%|          | 254/371472 [01:12<29:00:40,  3.55it/s]
  0%|          | 255/371472 [01:13<28:04:23,  3.67it/s]
  0%|          | 256/371472 [01:13<28:25:35,  3.63it/s]
  0%|          | 257/371472 [01:13<27:47:26,  3.71it/s]
  0%|          | 258/371472 [01:14<28:20:45,  3.64it/s]
  0%|          | 259/371472 [01:14<29:06:30,  3.54it/s]
  0%|          | 260/371472 [01:14<28:16:03,  3.65it/s]
                                                       
{'loss': 7.4136, 'learning_rate': 9.998545540735632e-07, 'epoch': 0.01}

  0%|          | 260/371472 [01:14<28:16:03,  3.65it/s]
  0%|          | 261/371472 [01:14<27:33:21,  3.74it/s]
  0%|          | 262/371472 [01:15<28:06:39,  3.67it/s]
  0%|          | 263/371472 [01:15<27:33:00,  3.74it/s]
  0%|          | 264/371472 [01:15<27:07:13,  3.80it/s]
  0%|          | 265/371472 [01:15<28:19:36,  3.64it/s]
  0%|          | 266/371472 [01:16<31:13:51,  3.30it/s]
  0%|          | 267/371472 [01:16<32:17:54,  3.19it/s]
  0%|          | 268/371472 [01:16<31:52:26,  3.23it/s]
  0%|          | 269/371472 [01:17<32:15:24,  3.20it/s]
  0%|          | 270/371472 [01:17<33:22:52,  3.09it/s]
  0%|          | 271/371472 [01:17<32:41:41,  3.15it/s]
  0%|          | 272/371472 [01:18<30:29:10,  3.38it/s]
  0%|          | 273/371472 [01:18<33:02:55,  3.12it/s]
  0%|          | 274/371472 [01:18<31:31:53,  3.27it/s]
  0%|          | 275/371472 [01:19<33:07:29,  3.11it/s]
  0%|          | 276/371472 [01:19<31:19:08,  3.29it/s]
  0%|          | 277/371472 [01:19<30:17:11,  3.40it/s]
  0%|          | 278/371472 [01:19<29:52:54,  3.45it/s]
  0%|          | 279/371472 [01:20<29:01:05,  3.55it/s]
  0%|          | 280/371472 [01:20<28:24:58,  3.63it/s]
                                                       
{'loss': 6.8118, 'learning_rate': 9.998060720980845e-07, 'epoch': 0.01}

  0%|          | 280/371472 [01:20<28:24:58,  3.63it/s]
  0%|          | 281/371472 [01:20<27:51:15,  3.70it/s]
  0%|          | 282/371472 [01:21<28:31:39,  3.61it/s]
  0%|          | 283/371472 [01:21<28:19:44,  3.64it/s]
  0%|          | 284/371472 [01:21<30:17:16,  3.40it/s]
  0%|          | 285/371472 [01:21<29:11:32,  3.53it/s]
  0%|          | 286/371472 [01:22<30:16:55,  3.40it/s]
  0%|          | 287/371472 [01:22<28:53:43,  3.57it/s]
  0%|          | 288/371472 [01:22<28:34:43,  3.61it/s]
  0%|          | 289/371472 [01:22<27:17:15,  3.78it/s]
  0%|          | 290/371472 [01:23<26:57:49,  3.82it/s]
  0%|          | 291/371472 [01:23<27:22:08,  3.77it/s]
  0%|          | 292/371472 [01:23<27:54:49,  3.69it/s]
  0%|          | 293/371472 [01:24<28:16:40,  3.65it/s]
  0%|          | 294/371472 [01:24<28:09:40,  3.66it/s]
  0%|          | 295/371472 [01:24<30:09:40,  3.42it/s]
  0%|          | 296/371472 [01:24<28:53:49,  3.57it/s]
  0%|          | 297/371472 [01:25<28:41:30,  3.59it/s]
  0%|          | 298/371472 [01:25<29:08:47,  3.54it/s]
  0%|          | 299/371472 [01:25<27:33:34,  3.74it/s]
  0%|          | 300/371472 [01:26<30:17:45,  3.40it/s]
                                                       
{'loss': 7.0537, 'learning_rate': 9.997575901226053e-07, 'epoch': 0.01}

  0%|          | 300/371472 [01:26<30:17:45,  3.40it/s]
  0%|          | 301/371472 [01:26<30:00:52,  3.44it/s]
  0%|          | 302/371472 [01:26<28:45:47,  3.58it/s]
  0%|          | 303/371472 [01:26<29:39:43,  3.48it/s]
  0%|          | 304/371472 [01:27<32:22:04,  3.19it/s]
  0%|          | 305/371472 [01:27<30:25:00,  3.39it/s]
  0%|          | 306/371472 [01:27<28:37:17,  3.60it/s]
  0%|          | 307/371472 [01:28<27:42:29,  3.72it/s]
  0%|          | 308/371472 [01:28<27:20:22,  3.77it/s]
  0%|          | 309/371472 [01:28<28:43:27,  3.59it/s]
  0%|          | 310/371472 [01:28<29:19:55,  3.51it/s]
  0%|          | 311/371472 [01:29<29:34:34,  3.49it/s]
  0%|          | 312/371472 [01:29<27:55:49,  3.69it/s]
  0%|          | 313/371472 [01:29<30:31:29,  3.38it/s]
  0%|          | 314/371472 [01:30<31:01:59,  3.32it/s]
  0%|          | 315/371472 [01:30<29:51:58,  3.45it/s]
  0%|          | 316/371472 [01:30<29:53:36,  3.45it/s]
  0%|          | 317/371472 [01:30<30:04:04,  3.43it/s]
  0%|          | 318/371472 [01:31<28:29:23,  3.62it/s]
  0%|          | 319/371472 [01:31<28:16:24,  3.65it/s]
  0%|          | 320/371472 [01:31<29:26:56,  3.50it/s]
                                                       
{'loss': 6.7556, 'learning_rate': 9.997091081471266e-07, 'epoch': 0.01}

  0%|          | 320/371472 [01:31<29:26:56,  3.50it/s]
  0%|          | 321/371472 [01:32<28:46:31,  3.58it/s]
  0%|          | 322/371472 [01:32<27:45:18,  3.71it/s]
  0%|          | 323/371472 [01:32<27:03:12,  3.81it/s]
  0%|          | 324/371472 [01:32<26:17:52,  3.92it/s]
  0%|          | 325/371472 [01:33<26:38:56,  3.87it/s]
  0%|          | 326/371472 [01:33<27:01:16,  3.82it/s]
  0%|          | 327/371472 [01:33<28:40:11,  3.60it/s]
  0%|          | 328/371472 [01:33<29:33:15,  3.49it/s]
  0%|          | 329/371472 [01:34<29:11:50,  3.53it/s]
  0%|          | 330/371472 [01:34<27:59:33,  3.68it/s]
  0%|          | 331/371472 [01:34<29:47:02,  3.46it/s]
  0%|          | 332/371472 [01:35<33:50:59,  3.05it/s]
  0%|          | 333/371472 [01:35<31:50:39,  3.24it/s]
  0%|          | 334/371472 [01:35<31:29:00,  3.27it/s]
  0%|          | 335/371472 [01:36<29:56:45,  3.44it/s]
  0%|          | 336/371472 [01:36<28:44:17,  3.59it/s]
  0%|          | 337/371472 [01:36<27:43:59,  3.72it/s]
  0%|          | 338/371472 [01:36<27:44:27,  3.72it/s]
  0%|          | 339/371472 [01:37<27:21:36,  3.77it/s]
  0%|          | 340/371472 [01:37<28:39:21,  3.60it/s]
                                                       
{'loss': 7.0601, 'learning_rate': 9.996606261716477e-07, 'epoch': 0.01}

  0%|          | 340/371472 [01:37<28:39:21,  3.60it/s]
  0%|          | 341/371472 [01:37<28:07:44,  3.66it/s]
  0%|          | 342/371472 [01:37<29:15:01,  3.52it/s]
  0%|          | 343/371472 [01:38<31:55:09,  3.23it/s]
  0%|          | 344/371472 [01:38<30:12:56,  3.41it/s]
  0%|          | 345/371472 [01:38<29:18:02,  3.52it/s]
  0%|          | 346/371472 [01:39<29:54:12,  3.45it/s]
  0%|          | 347/371472 [01:39<29:19:15,  3.52it/s]
  0%|          | 348/371472 [01:39<29:10:53,  3.53it/s]
  0%|          | 349/371472 [01:39<29:10:03,  3.53it/s]
  0%|          | 350/371472 [01:40<28:39:18,  3.60it/s]
  0%|          | 351/371472 [01:40<28:58:51,  3.56it/s]
  0%|          | 352/371472 [01:40<30:02:10,  3.43it/s]
  0%|          | 353/371472 [01:41<28:57:20,  3.56it/s]
  0%|          | 354/371472 [01:41<29:46:07,  3.46it/s]
  0%|          | 355/371472 [01:41<28:29:26,  3.62it/s]
  0%|          | 356/371472 [01:41<27:55:36,  3.69it/s]
  0%|          | 357/371472 [01:42<28:01:54,  3.68it/s]
  0%|          | 358/371472 [01:42<28:10:42,  3.66it/s]
  0%|          | 359/371472 [01:42<28:11:52,  3.66it/s]
  0%|          | 360/371472 [01:43<29:24:22,  3.51it/s]
                                                       
{'loss': 6.8547, 'learning_rate': 9.996121441961687e-07, 'epoch': 0.02}

  0%|          | 360/371472 [01:43<29:24:22,  3.51it/s]
  0%|          | 361/371472 [01:43<30:19:16,  3.40it/s]
  0%|          | 362/371472 [01:43<32:29:35,  3.17it/s]
  0%|          | 363/371472 [01:43<30:29:03,  3.38it/s]
  0%|          | 364/371472 [01:44<32:37:09,  3.16it/s]
  0%|          | 365/371472 [01:44<30:54:17,  3.34it/s]
  0%|          | 366/371472 [01:44<30:09:50,  3.42it/s]
  0%|          | 367/371472 [01:45<29:44:46,  3.47it/s]
  0%|          | 368/371472 [01:45<28:08:35,  3.66it/s]
  0%|          | 369/371472 [01:45<32:53:18,  3.13it/s]
  0%|          | 370/371472 [01:46<30:56:14,  3.33it/s]
  0%|          | 371/371472 [01:46<29:47:11,  3.46it/s]
  0%|          | 372/371472 [01:46<30:15:49,  3.41it/s]
  0%|          | 373/371472 [01:46<29:22:25,  3.51it/s]
  0%|          | 374/371472 [01:47<28:36:13,  3.60it/s]
  0%|          | 375/371472 [01:47<27:31:49,  3.74it/s]
  0%|          | 376/371472 [01:47<27:52:53,  3.70it/s]
  0%|          | 377/371472 [01:47<28:53:34,  3.57it/s]
  0%|          | 378/371472 [01:48<31:51:50,  3.24it/s]
  0%|          | 379/371472 [01:48<30:15:51,  3.41it/s]
  0%|          | 380/371472 [01:48<29:52:17,  3.45it/s]
                                                       
{'loss': 6.4108, 'learning_rate': 9.9956366222069e-07, 'epoch': 0.02}

  0%|          | 380/371472 [01:48<29:52:17,  3.45it/s]
  0%|          | 381/371472 [01:49<30:36:15,  3.37it/s]
  0%|          | 382/371472 [01:49<29:33:20,  3.49it/s]
  0%|          | 383/371472 [01:49<28:42:46,  3.59it/s]
  0%|          | 384/371472 [01:50<31:59:09,  3.22it/s]
  0%|          | 385/371472 [01:50<31:03:41,  3.32it/s]
  0%|          | 386/371472 [01:50<29:16:29,  3.52it/s]
  0%|          | 387/371472 [01:50<27:58:13,  3.69it/s]
  0%|          | 388/371472 [01:51<27:21:27,  3.77it/s]
  0%|          | 389/371472 [01:51<28:42:19,  3.59it/s]
  0%|          | 390/371472 [01:51<28:58:38,  3.56it/s]
  0%|          | 391/371472 [01:51<27:33:31,  3.74it/s]
  0%|          | 392/371472 [01:52<27:23:05,  3.76it/s]
  0%|          | 393/371472 [01:52<27:53:11,  3.70it/s]
  0%|          | 394/371472 [01:52<28:44:20,  3.59it/s]
  0%|          | 395/371472 [01:53<28:25:24,  3.63it/s]
  0%|          | 396/371472 [01:53<27:48:16,  3.71it/s]
  0%|          | 397/371472 [01:53<27:23:06,  3.76it/s]
  0%|          | 398/371472 [01:53<26:22:45,  3.91it/s]
  0%|          | 399/371472 [01:54<26:56:15,  3.83it/s]
  0%|          | 400/371472 [01:54<26:17:44,  3.92it/s]
                                                       
{'loss': 6.5316, 'learning_rate': 9.995151802452109e-07, 'epoch': 0.02}

  0%|          | 400/371472 [01:54<26:17:44,  3.92it/s]
  0%|          | 401/371472 [01:54<28:11:20,  3.66it/s]
  0%|          | 402/371472 [01:54<28:52:27,  3.57it/s]
  0%|          | 403/371472 [01:55<30:40:43,  3.36it/s]
  0%|          | 404/371472 [01:55<30:52:22,  3.34it/s]
  0%|          | 405/371472 [01:55<29:28:57,  3.50it/s]
  0%|          | 406/371472 [01:56<31:37:02,  3.26it/s]
  0%|          | 407/371472 [01:56<32:04:38,  3.21it/s]
  0%|          | 408/371472 [01:56<30:41:26,  3.36it/s]
  0%|          | 409/371472 [01:57<30:09:57,  3.42it/s]
  0%|          | 410/371472 [01:57<32:41:44,  3.15it/s]
  0%|          | 411/371472 [01:57<33:23:06,  3.09it/s]
  0%|          | 412/371472 [01:58<33:40:03,  3.06it/s]
  0%|          | 413/371472 [01:58<32:25:17,  3.18it/s]
  0%|          | 414/371472 [01:58<31:40:41,  3.25it/s]
  0%|          | 415/371472 [01:58<30:50:35,  3.34it/s]
  0%|          | 416/371472 [01:59<29:43:40,  3.47it/s]
  0%|          | 417/371472 [01:59<28:25:27,  3.63it/s]
  0%|          | 418/371472 [01:59<34:04:14,  3.03it/s]
  0%|          | 419/371472 [02:00<32:06:17,  3.21it/s]
  0%|          | 420/371472 [02:00<32:11:58,  3.20it/s]
                                                       
{'loss': 6.4739, 'learning_rate': 9.994666982697322e-07, 'epoch': 0.02}

  0%|          | 420/371472 [02:00<32:11:58,  3.20it/s]
  0%|          | 421/371472 [02:00<31:35:23,  3.26it/s]
  0%|          | 422/371472 [02:01<34:26:19,  2.99it/s]
  0%|          | 423/371472 [02:01<32:01:18,  3.22it/s]
  0%|          | 424/371472 [02:01<31:52:53,  3.23it/s]
  0%|          | 425/371472 [02:02<31:18:21,  3.29it/s]
  0%|          | 426/371472 [02:02<29:58:21,  3.44it/s]
  0%|          | 427/371472 [02:02<28:48:43,  3.58it/s]
  0%|          | 428/371472 [02:02<31:48:36,  3.24it/s]
  0%|          | 429/371472 [02:03<30:03:32,  3.43it/s]
  0%|          | 430/371472 [02:03<29:35:32,  3.48it/s]
  0%|          | 431/371472 [02:03<29:01:19,  3.55it/s]
  0%|          | 432/371472 [02:04<29:21:41,  3.51it/s]
  0%|          | 433/371472 [02:04<28:32:48,  3.61it/s]
  0%|          | 434/371472 [02:04<28:33:08,  3.61it/s]
  0%|          | 435/371472 [02:05<37:06:59,  2.78it/s]
  0%|          | 436/371472 [02:05<34:22:21,  3.00it/s]
  0%|          | 437/371472 [02:05<33:01:25,  3.12it/s]
  0%|          | 438/371472 [02:05<31:24:14,  3.28it/s]
  0%|          | 439/371472 [02:06<30:38:25,  3.36it/s]
  0%|          | 440/371472 [02:06<29:57:42,  3.44it/s]
                                                       
{'loss': 6.8201, 'learning_rate': 9.994182162942532e-07, 'epoch': 0.02}

  0%|          | 440/371472 [02:06<29:57:42,  3.44it/s]
  0%|          | 441/371472 [02:06<30:48:00,  3.35it/s]
  0%|          | 442/371472 [02:07<28:52:08,  3.57it/s]
  0%|          | 443/371472 [02:07<28:39:06,  3.60it/s]
  0%|          | 444/371472 [02:07<27:54:28,  3.69it/s]
  0%|          | 445/371472 [02:07<29:40:51,  3.47it/s]
  0%|          | 446/371472 [02:08<31:42:15,  3.25it/s]
  0%|          | 447/371472 [02:08<32:51:22,  3.14it/s]
  0%|          | 448/371472 [02:08<31:59:48,  3.22it/s]
  0%|          | 449/371472 [02:09<30:36:58,  3.37it/s]
  0%|          | 450/371472 [02:09<29:22:34,  3.51it/s]
  0%|          | 451/371472 [02:09<33:35:12,  3.07it/s]
  0%|          | 452/371472 [02:10<31:41:47,  3.25it/s]
  0%|          | 453/371472 [02:10<31:06:59,  3.31it/s]
  0%|          | 454/371472 [02:10<29:36:32,  3.48it/s]
  0%|          | 455/371472 [02:10<28:06:03,  3.67it/s]
  0%|          | 456/371472 [02:11<29:05:06,  3.54it/s]
  0%|          | 457/371472 [02:11<28:31:01,  3.61it/s]
  0%|          | 458/371472 [02:11<27:55:52,  3.69it/s]
  0%|          | 459/371472 [02:12<28:02:00,  3.68it/s]
  0%|          | 460/371472 [02:12<29:06:21,  3.54it/s]
                                                       
{'loss': 6.4731, 'learning_rate': 9.993697343187743e-07, 'epoch': 0.02}

  0%|          | 460/371472 [02:12<29:06:21,  3.54it/s]
  0%|          | 461/371472 [02:12<29:48:49,  3.46it/s]
  0%|          | 462/371472 [02:12<28:25:59,  3.62it/s]
  0%|          | 463/371472 [02:13<27:21:33,  3.77it/s]
  0%|          | 464/371472 [02:13<26:51:11,  3.84it/s]
  0%|          | 465/371472 [02:13<26:39:03,  3.87it/s]
  0%|          | 466/371472 [02:13<26:30:01,  3.89it/s]
  0%|          | 467/371472 [02:14<26:32:47,  3.88it/s]
  0%|          | 468/371472 [02:14<27:04:15,  3.81it/s]
  0%|          | 469/371472 [02:14<28:00:44,  3.68it/s]
  0%|          | 470/371472 [02:14<27:24:46,  3.76it/s]
  0%|          | 471/371472 [02:15<27:46:58,  3.71it/s]
  0%|          | 472/371472 [02:15<26:43:40,  3.86it/s]
  0%|          | 473/371472 [02:15<26:54:21,  3.83it/s]
  0%|          | 474/371472 [02:16<28:49:29,  3.58it/s]
  0%|          | 475/371472 [02:16<28:59:04,  3.56it/s]
  0%|          | 476/371472 [02:16<31:08:31,  3.31it/s]
  0%|          | 477/371472 [02:16<31:25:22,  3.28it/s]
  0%|          | 478/371472 [02:17<29:31:59,  3.49it/s]
  0%|          | 479/371472 [02:17<28:40:34,  3.59it/s]
  0%|          | 480/371472 [02:17<30:20:55,  3.40it/s]
                                                       
{'loss': 6.5669, 'learning_rate': 9.993212523432956e-07, 'epoch': 0.02}

  0%|          | 480/371472 [02:17<30:20:55,  3.40it/s]
  0%|          | 481/371472 [02:18<29:59:25,  3.44it/s]
  0%|          | 482/371472 [02:18<29:14:43,  3.52it/s]
  0%|          | 483/371472 [02:18<32:15:57,  3.19it/s]
  0%|          | 484/371472 [02:18<30:00:22,  3.43it/s]
  0%|          | 485/371472 [02:19<29:47:13,  3.46it/s]
  0%|          | 486/371472 [02:19<28:29:19,  3.62it/s]
  0%|          | 487/371472 [02:19<29:07:36,  3.54it/s]
  0%|          | 488/371472 [02:20<28:06:54,  3.67it/s]
  0%|          | 489/371472 [02:20<27:58:10,  3.68it/s]
  0%|          | 490/371472 [02:20<29:07:47,  3.54it/s]
  0%|          | 491/371472 [02:20<28:04:22,  3.67it/s]
  0%|          | 492/371472 [02:21<27:45:45,  3.71it/s]
  0%|          | 493/371472 [02:21<28:06:34,  3.67it/s]
  0%|          | 494/371472 [02:21<30:38:53,  3.36it/s]
  0%|          | 495/371472 [02:22<29:10:43,  3.53it/s]
  0%|          | 496/371472 [02:22<28:54:43,  3.56it/s]
  0%|          | 497/371472 [02:22<28:57:27,  3.56it/s]
  0%|          | 498/371472 [02:22<27:58:21,  3.68it/s]
  0%|          | 499/371472 [02:23<28:09:50,  3.66it/s]
  0%|          | 500/371472 [02:23<27:55:06,  3.69it/s]
                                                       
{'loss': 6.6863, 'learning_rate': 9.992727703678165e-07, 'epoch': 0.02}

  0%|          | 500/371472 [02:23<27:55:06,  3.69it/s]
  0%|          | 501/371472 [02:23<28:20:35,  3.64it/s]
  0%|          | 502/371472 [02:23<28:00:18,  3.68it/s]
  0%|          | 503/371472 [02:24<29:39:30,  3.47it/s]
  0%|          | 504/371472 [02:24<30:12:00,  3.41it/s]
  0%|          | 505/371472 [02:24<30:55:41,  3.33it/s]
  0%|          | 506/371472 [02:25<32:21:46,  3.18it/s]
  0%|          | 507/371472 [02:25<31:10:39,  3.31it/s]
  0%|          | 508/371472 [02:25<31:14:29,  3.30it/s]
  0%|          | 509/371472 [02:26<29:39:23,  3.47it/s]
  0%|          | 510/371472 [02:26<28:30:41,  3.61it/s]
  0%|          | 511/371472 [02:26<28:29:47,  3.62it/s]
  0%|          | 512/371472 [02:26<27:30:34,  3.75it/s]
  0%|          | 513/371472 [02:27<27:10:20,  3.79it/s]
  0%|          | 514/371472 [02:27<27:01:43,  3.81it/s]
  0%|          | 515/371472 [02:27<28:49:14,  3.58it/s]
  0%|          | 516/371472 [02:27<28:54:51,  3.56it/s]
  0%|          | 517/371472 [02:28<29:56:55,  3.44it/s]
  0%|          | 518/371472 [02:28<29:06:53,  3.54it/s]
  0%|          | 519/371472 [02:28<28:51:52,  3.57it/s]
  0%|          | 520/371472 [02:29<29:14:48,  3.52it/s]
                                                       
{'loss': 6.7291, 'learning_rate': 9.992242883923377e-07, 'epoch': 0.02}

  0%|          | 520/371472 [02:29<29:14:48,  3.52it/s]
  0%|          | 521/371472 [02:29<28:28:11,  3.62it/s]
  0%|          | 522/371472 [02:29<29:41:30,  3.47it/s]
  0%|          | 523/371472 [02:29<27:57:41,  3.69it/s]
  0%|          | 524/371472 [02:30<29:35:34,  3.48it/s]
  0%|          | 525/371472 [02:30<28:38:57,  3.60it/s]
  0%|          | 526/371472 [02:30<29:11:35,  3.53it/s]
  0%|          | 527/371472 [02:31<27:54:44,  3.69it/s]
  0%|          | 528/371472 [02:31<27:10:22,  3.79it/s]
  0%|          | 529/371472 [02:31<27:10:17,  3.79it/s]
  0%|          | 530/371472 [02:31<27:27:13,  3.75it/s]
  0%|          | 531/371472 [02:32<26:48:18,  3.84it/s]
  0%|          | 532/371472 [02:32<26:25:43,  3.90it/s]
  0%|          | 533/371472 [02:32<27:36:29,  3.73it/s]
  0%|          | 534/371472 [02:32<29:54:21,  3.45it/s]
  0%|          | 535/371472 [02:33<31:53:42,  3.23it/s]
  0%|          | 536/371472 [02:33<31:17:06,  3.29it/s]
  0%|          | 537/371472 [02:33<30:02:19,  3.43it/s]
  0%|          | 538/371472 [02:34<30:50:17,  3.34it/s]
  0%|          | 539/371472 [02:34<31:29:52,  3.27it/s]
  0%|          | 540/371472 [02:34<30:31:03,  3.38it/s]
                                                       
{'loss': 6.2971, 'learning_rate': 9.991758064168586e-07, 'epoch': 0.02}

  0%|          | 540/371472 [02:34<30:31:03,  3.38it/s]
  0%|          | 541/371472 [02:35<29:04:56,  3.54it/s]
  0%|          | 542/371472 [02:35<28:36:10,  3.60it/s]
  0%|          | 543/371472 [02:35<27:48:30,  3.71it/s]
  0%|          | 544/371472 [02:35<27:14:50,  3.78it/s]
  0%|          | 545/371472 [02:36<27:58:18,  3.68it/s]
  0%|          | 546/371472 [02:36<27:27:01,  3.75it/s]
  0%|          | 547/371472 [02:36<27:24:24,  3.76it/s]
  0%|          | 548/371472 [02:36<27:16:26,  3.78it/s]
  0%|          | 549/371472 [02:37<27:53:26,  3.69it/s]
  0%|          | 550/371472 [02:37<26:58:10,  3.82it/s]
  0%|          | 551/371472 [02:37<28:56:18,  3.56it/s]
  0%|          | 552/371472 [02:38<29:37:39,  3.48it/s]
  0%|          | 553/371472 [02:38<29:16:03,  3.52it/s]
  0%|          | 554/371472 [02:38<29:01:08,  3.55it/s]
  0%|          | 555/371472 [02:38<29:50:49,  3.45it/s]
  0%|          | 556/371472 [02:39<31:31:05,  3.27it/s]
  0%|          | 557/371472 [02:39<30:43:51,  3.35it/s]
  0%|          | 558/371472 [02:39<30:26:42,  3.38it/s]
  0%|          | 559/371472 [02:40<29:20:29,  3.51it/s]
  0%|          | 560/371472 [02:40<30:40:07,  3.36it/s]
                                                       
{'loss': 6.1858, 'learning_rate': 9.991273244413799e-07, 'epoch': 0.02}

  0%|          | 560/371472 [02:40<30:40:07,  3.36it/s]
  0%|          | 561/371472 [02:40<29:14:12,  3.52it/s]
  0%|          | 562/371472 [02:40<27:54:57,  3.69it/s]
  0%|          | 563/371472 [02:41<27:16:39,  3.78it/s]
  0%|          | 564/371472 [02:41<26:29:53,  3.89it/s]
  0%|          | 565/371472 [02:41<27:55:19,  3.69it/s]
  0%|          | 566/371472 [02:41<27:49:03,  3.70it/s]
  0%|          | 567/371472 [02:42<27:33:27,  3.74it/s]
  0%|          | 568/371472 [02:42<27:13:18,  3.78it/s]
  0%|          | 569/371472 [02:42<28:23:05,  3.63it/s]
  0%|          | 570/371472 [02:43<28:05:49,  3.67it/s]
  0%|          | 571/371472 [02:43<27:30:03,  3.75it/s]
  0%|          | 572/371472 [02:43<27:47:19,  3.71it/s]
  0%|          | 573/371472 [02:43<27:27:55,  3.75it/s]
  0%|          | 574/371472 [02:44<30:09:40,  3.42it/s]
  0%|          | 575/371472 [02:44<29:26:15,  3.50it/s]
  0%|          | 576/371472 [02:44<29:45:17,  3.46it/s]
  0%|          | 577/371472 [02:45<33:32:47,  3.07it/s]
  0%|          | 578/371472 [02:45<31:16:33,  3.29it/s]
  0%|          | 579/371472 [02:45<32:23:19,  3.18it/s]
  0%|          | 580/371472 [02:45<30:46:38,  3.35it/s]
                                                       
{'loss': 6.5758, 'learning_rate': 9.99078842465901e-07, 'epoch': 0.02}

  0%|          | 580/371472 [02:45<30:46:38,  3.35it/s]
  0%|          | 581/371472 [02:46<29:49:28,  3.45it/s]
  0%|          | 582/371472 [02:46<29:20:05,  3.51it/s]
  0%|          | 583/371472 [02:46<31:45:36,  3.24it/s]
  0%|          | 584/371472 [02:47<30:10:52,  3.41it/s]
  0%|          | 585/371472 [02:47<30:09:48,  3.42it/s]
  0%|          | 586/371472 [02:47<28:52:43,  3.57it/s]
  0%|          | 587/371472 [02:47<28:30:18,  3.61it/s]
  0%|          | 588/371472 [02:48<27:31:28,  3.74it/s]
  0%|          | 589/371472 [02:48<26:54:00,  3.83it/s]
  0%|          | 590/371472 [02:48<26:38:37,  3.87it/s]
  0%|          | 591/371472 [02:49<28:04:28,  3.67it/s]
  0%|          | 592/371472 [02:49<27:37:20,  3.73it/s]
  0%|          | 593/371472 [02:49<30:12:56,  3.41it/s]
  0%|          | 594/371472 [02:49<29:30:22,  3.49it/s]
  0%|          | 595/371472 [02:50<29:27:42,  3.50it/s]
  0%|          | 596/371472 [02:50<33:27:33,  3.08it/s]
  0%|          | 597/371472 [02:50<31:54:45,  3.23it/s]
  0%|          | 598/371472 [02:51<32:23:40,  3.18it/s]
  0%|          | 599/371472 [02:51<32:01:03,  3.22it/s]
  0%|          | 600/371472 [02:51<31:20:39,  3.29it/s]
                                                       
{'loss': 6.186, 'learning_rate': 9.99030360490422e-07, 'epoch': 0.03}

  0%|          | 600/371472 [02:51<31:20:39,  3.29it/s]
  0%|          | 601/371472 [02:52<29:22:31,  3.51it/s]
  0%|          | 602/371472 [02:52<28:27:40,  3.62it/s]
  0%|          | 603/371472 [02:52<28:16:15,  3.64it/s]
  0%|          | 604/371472 [02:52<30:55:48,  3.33it/s]
  0%|          | 605/371472 [02:53<32:49:01,  3.14it/s]
  0%|          | 606/371472 [02:53<32:06:36,  3.21it/s]
  0%|          | 607/371472 [02:53<30:22:39,  3.39it/s]
  0%|          | 608/371472 [02:54<30:32:01,  3.37it/s]
  0%|          | 609/371472 [02:54<29:45:50,  3.46it/s]
  0%|          | 610/371472 [02:54<28:45:43,  3.58it/s]
  0%|          | 611/371472 [02:54<29:31:59,  3.49it/s]
  0%|          | 612/371472 [02:55<28:36:42,  3.60it/s]
  0%|          | 613/371472 [02:55<28:18:20,  3.64it/s]
  0%|          | 614/371472 [02:55<28:05:14,  3.67it/s]
  0%|          | 615/371472 [02:56<28:14:45,  3.65it/s]
  0%|          | 616/371472 [02:56<27:51:38,  3.70it/s]
  0%|          | 617/371472 [02:56<30:29:40,  3.38it/s]
  0%|          | 618/371472 [02:56<29:59:09,  3.44it/s]
  0%|          | 619/371472 [02:57<29:05:08,  3.54it/s]
  0%|          | 620/371472 [02:57<28:25:32,  3.62it/s]
                                                       
{'loss': 6.4182, 'learning_rate': 9.989818785149433e-07, 'epoch': 0.03}

  0%|          | 620/371472 [02:57<28:25:32,  3.62it/s]
  0%|          | 621/371472 [02:57<28:36:10,  3.60it/s]
  0%|          | 622/371472 [02:57<27:42:00,  3.72it/s]
  0%|          | 623/371472 [02:58<27:52:13,  3.70it/s]
  0%|          | 624/371472 [02:58<28:30:10,  3.61it/s]
  0%|          | 625/371472 [02:58<28:28:51,  3.62it/s]
  0%|          | 626/371472 [02:59<28:00:56,  3.68it/s]
  0%|          | 627/371472 [02:59<29:26:12,  3.50it/s]
  0%|          | 628/371472 [02:59<29:13:49,  3.52it/s]
  0%|          | 629/371472 [02:59<29:13:31,  3.52it/s]
  0%|          | 630/371472 [03:00<27:57:56,  3.68it/s]
  0%|          | 631/371472 [03:00<28:35:15,  3.60it/s]
  0%|          | 632/371472 [03:00<30:32:40,  3.37it/s]
  0%|          | 633/371472 [03:01<29:03:31,  3.54it/s]
  0%|          | 634/371472 [03:01<28:26:45,  3.62it/s]
  0%|          | 635/371472 [03:01<27:39:02,  3.73it/s]
  0%|          | 636/371472 [03:01<29:19:03,  3.51it/s]
  0%|          | 637/371472 [03:02<29:24:05,  3.50it/s]
  0%|          | 638/371472 [03:02<29:37:25,  3.48it/s]
  0%|          | 639/371472 [03:02<30:01:17,  3.43it/s]
  0%|          | 640/371472 [03:03<28:28:30,  3.62it/s]
                                                       
{'loss': 6.263, 'learning_rate': 9.989333965394644e-07, 'epoch': 0.03}

  0%|          | 640/371472 [03:03<28:28:30,  3.62it/s]
  0%|          | 641/371472 [03:03<28:15:15,  3.65it/s]
  0%|          | 642/371472 [03:03<27:48:06,  3.71it/s]
  0%|          | 643/371472 [03:03<29:18:37,  3.51it/s]
  0%|          | 644/371472 [03:04<27:58:16,  3.68it/s]
  0%|          | 645/371472 [03:04<28:20:57,  3.63it/s]
  0%|          | 646/371472 [03:04<27:44:09,  3.71it/s]
  0%|          | 647/371472 [03:04<27:30:57,  3.74it/s]
  0%|          | 648/371472 [03:05<27:56:46,  3.69it/s]
  0%|          | 649/371472 [03:05<27:00:42,  3.81it/s]
  0%|          | 650/371472 [03:05<28:41:35,  3.59it/s]
  0%|          | 651/371472 [03:06<28:59:13,  3.55it/s]
  0%|          | 652/371472 [03:06<31:28:27,  3.27it/s]
  0%|          | 653/371472 [03:06<31:31:24,  3.27it/s]
  0%|          | 654/371472 [03:06<30:11:56,  3.41it/s]
  0%|          | 655/371472 [03:07<29:21:20,  3.51it/s]
  0%|          | 656/371472 [03:07<28:36:54,  3.60it/s]
  0%|          | 657/371472 [03:07<29:46:07,  3.46it/s]
  0%|          | 658/371472 [03:08<29:23:42,  3.50it/s]
  0%|          | 659/371472 [03:08<30:13:40,  3.41it/s]
  0%|          | 660/371472 [03:08<31:35:57,  3.26it/s]
                                                       
{'loss': 6.0137, 'learning_rate': 9.988849145639854e-07, 'epoch': 0.03}

  0%|          | 660/371472 [03:08<31:35:57,  3.26it/s]
  0%|          | 661/371472 [03:09<32:25:44,  3.18it/s]
  0%|          | 662/371472 [03:09<34:38:18,  2.97it/s]
  0%|          | 663/371472 [03:09<34:23:29,  3.00it/s]
  0%|          | 664/371472 [03:10<33:26:18,  3.08it/s]
  0%|          | 665/371472 [03:10<31:21:59,  3.28it/s]
  0%|          | 666/371472 [03:10<30:51:05,  3.34it/s]
  0%|          | 667/371472 [03:10<30:43:30,  3.35it/s]
  0%|          | 668/371472 [03:11<29:24:55,  3.50it/s]
  0%|          | 669/371472 [03:11<28:17:44,  3.64it/s]
  0%|          | 670/371472 [03:11<27:47:06,  3.71it/s]
  0%|          | 671/371472 [03:11<27:42:45,  3.72it/s]
  0%|          | 672/371472 [03:12<28:21:48,  3.63it/s]
  0%|          | 673/371472 [03:12<27:56:53,  3.69it/s]
  0%|          | 674/371472 [03:12<27:23:44,  3.76it/s]
  0%|          | 675/371472 [03:13<27:15:52,  3.78it/s]
  0%|          | 676/371472 [03:13<27:07:19,  3.80it/s]
  0%|          | 677/371472 [03:13<29:59:19,  3.43it/s]
  0%|          | 678/371472 [03:13<29:34:52,  3.48it/s]
  0%|          | 679/371472 [03:14<28:06:31,  3.66it/s]
  0%|          | 680/371472 [03:14<27:42:27,  3.72it/s]
                                                       
{'loss': 6.2632, 'learning_rate': 9.988364325885065e-07, 'epoch': 0.03}

  0%|          | 680/371472 [03:14<27:42:27,  3.72it/s]
  0%|          | 681/371472 [03:14<27:04:01,  3.81it/s]
  0%|          | 682/371472 [03:14<27:04:31,  3.80it/s]
  0%|          | 683/371472 [03:15<28:23:07,  3.63it/s]
  0%|          | 684/371472 [03:15<28:58:31,  3.55it/s]
  0%|          | 685/371472 [03:15<28:48:32,  3.58it/s]
  0%|          | 686/371472 [03:16<30:03:00,  3.43it/s]
  0%|          | 687/371472 [03:16<29:34:31,  3.48it/s]
  0%|          | 688/371472 [03:16<28:40:43,  3.59it/s]
  0%|          | 689/371472 [03:16<28:57:18,  3.56it/s]
  0%|          | 690/371472 [03:17<28:38:12,  3.60it/s]
  0%|          | 691/371472 [03:17<28:40:00,  3.59it/s]
  0%|          | 692/371472 [03:17<28:27:29,  3.62it/s]
  0%|          | 693/371472 [03:18<27:25:24,  3.76it/s]
  0%|          | 694/371472 [03:18<27:37:01,  3.73it/s]
  0%|          | 695/371472 [03:18<27:01:29,  3.81it/s]
  0%|          | 696/371472 [03:18<28:00:53,  3.68it/s]
  0%|          | 697/371472 [03:19<28:15:06,  3.65it/s]
  0%|          | 698/371472 [03:19<30:01:19,  3.43it/s]
  0%|          | 699/371472 [03:19<28:48:22,  3.58it/s]
  0%|          | 700/371472 [03:19<28:09:03,  3.66it/s]
                                                       
{'loss': 6.3874, 'learning_rate': 9.987879506130276e-07, 'epoch': 0.03}

  0%|          | 700/371472 [03:19<28:09:03,  3.66it/s]
  0%|          | 701/371472 [03:20<32:32:35,  3.16it/s]
  0%|          | 702/371472 [03:20<32:08:03,  3.21it/s]
  0%|          | 703/371472 [03:20<31:48:03,  3.24it/s]
  0%|          | 704/371472 [03:21<31:31:05,  3.27it/s]
  0%|          | 705/371472 [03:21<31:22:24,  3.28it/s]
  0%|          | 706/371472 [03:21<30:16:02,  3.40it/s]
  0%|          | 707/371472 [03:22<29:20:26,  3.51it/s]
  0%|          | 708/371472 [03:22<28:51:52,  3.57it/s]
  0%|          | 709/371472 [03:22<29:48:31,  3.46it/s]
  0%|          | 710/371472 [03:22<29:48:07,  3.46it/s]
  0%|          | 711/371472 [03:23<28:39:44,  3.59it/s]
  0%|          | 712/371472 [03:23<28:00:37,  3.68it/s]
  0%|          | 713/371472 [03:23<28:54:36,  3.56it/s]
  0%|          | 714/371472 [03:24<28:11:12,  3.65it/s]
  0%|          | 715/371472 [03:24<28:41:30,  3.59it/s]
  0%|          | 716/371472 [03:24<27:44:46,  3.71it/s]
  0%|          | 717/371472 [03:24<27:57:37,  3.68it/s]
  0%|          | 718/371472 [03:25<27:27:21,  3.75it/s]
  0%|          | 719/371472 [03:25<27:53:15,  3.69it/s]
  0%|          | 720/371472 [03:25<28:21:46,  3.63it/s]
                                                       
{'loss': 6.338, 'learning_rate': 9.987394686375489e-07, 'epoch': 0.03}

  0%|          | 720/371472 [03:25<28:21:46,  3.63it/s]
  0%|          | 721/371472 [03:25<28:34:03,  3.60it/s]
  0%|          | 722/371472 [03:26<28:03:35,  3.67it/s]
  0%|          | 723/371472 [03:26<29:08:46,  3.53it/s]
  0%|          | 724/371472 [03:26<28:39:04,  3.59it/s]
  0%|          | 725/371472 [03:27<28:32:58,  3.61it/s]
  0%|          | 726/371472 [03:27<27:38:09,  3.73it/s]
  0%|          | 727/371472 [03:27<29:33:07,  3.48it/s]
  0%|          | 728/371472 [03:27<28:41:23,  3.59it/s]
  0%|          | 729/371472 [03:28<29:39:28,  3.47it/s]
  0%|          | 730/371472 [03:28<28:34:24,  3.60it/s]
  0%|          | 731/371472 [03:28<29:27:47,  3.50it/s]
  0%|          | 732/371472 [03:29<28:11:55,  3.65it/s]
  0%|          | 733/371472 [03:29<28:04:39,  3.67it/s]
  0%|          | 734/371472 [03:29<27:39:20,  3.72it/s]
  0%|          | 735/371472 [03:29<27:09:12,  3.79it/s]
  0%|          | 736/371472 [03:30<29:10:11,  3.53it/s]
  0%|          | 737/371472 [03:30<30:38:42,  3.36it/s]
  0%|          | 738/371472 [03:30<29:41:33,  3.47it/s]
  0%|          | 739/371472 [03:31<29:52:37,  3.45it/s]
  0%|          | 740/371472 [03:31<32:39:58,  3.15it/s]
                                                       
{'loss': 6.4615, 'learning_rate': 9.986909866620697e-07, 'epoch': 0.03}

  0%|          | 740/371472 [03:31<32:39:58,  3.15it/s]
  0%|          | 741/371472 [03:31<30:52:00,  3.34it/s]
  0%|          | 742/371472 [03:31<31:03:30,  3.32it/s]
  0%|          | 743/371472 [03:32<31:25:30,  3.28it/s]
  0%|          | 744/371472 [03:32<30:36:57,  3.36it/s]
  0%|          | 745/371472 [03:32<30:50:11,  3.34it/s]
  0%|          | 746/371472 [03:33<29:49:40,  3.45it/s]
  0%|          | 747/371472 [03:33<31:30:04,  3.27it/s]
  0%|          | 748/371472 [03:33<30:36:52,  3.36it/s]
  0%|          | 749/371472 [03:34<29:36:02,  3.48it/s]
  0%|          | 750/371472 [03:34<29:07:01,  3.54it/s]
  0%|          | 751/371472 [03:34<29:52:43,  3.45it/s]
  0%|          | 752/371472 [03:34<29:56:21,  3.44it/s]
  0%|          | 753/371472 [03:35<29:42:41,  3.47it/s]
  0%|          | 754/371472 [03:35<28:47:11,  3.58it/s]
  0%|          | 755/371472 [03:35<28:09:38,  3.66it/s]
  0%|          | 756/371472 [03:35<27:04:35,  3.80it/s]
  0%|          | 757/371472 [03:36<27:39:07,  3.72it/s]
  0%|          | 758/371472 [03:36<29:45:06,  3.46it/s]
  0%|          | 759/371472 [03:36<31:50:43,  3.23it/s]
  0%|          | 760/371472 [03:37<31:00:48,  3.32it/s]
                                                       
{'loss': 6.3216, 'learning_rate': 9.98642504686591e-07, 'epoch': 0.03}

  0%|          | 760/371472 [03:37<31:00:48,  3.32it/s]
  0%|          | 761/371472 [03:37<33:38:23,  3.06it/s]
  0%|          | 762/371472 [03:37<31:30:32,  3.27it/s]
  0%|          | 763/371472 [03:38<30:15:40,  3.40it/s]
  0%|          | 764/371472 [03:38<29:17:41,  3.52it/s]
  0%|          | 765/371472 [03:38<29:57:11,  3.44it/s]
  0%|          | 766/371472 [03:38<28:57:42,  3.56it/s]
  0%|          | 767/371472 [03:39<28:55:29,  3.56it/s]
  0%|          | 768/371472 [03:39<28:53:02,  3.57it/s]
  0%|          | 769/371472 [03:39<27:54:31,  3.69it/s]
  0%|          | 770/371472 [03:40<28:30:16,  3.61it/s]
  0%|          | 771/371472 [03:40<30:35:31,  3.37it/s]
  0%|          | 772/371472 [03:40<30:52:55,  3.33it/s]
  0%|          | 773/371472 [03:40<29:35:33,  3.48it/s]
  0%|          | 774/371472 [03:41<30:58:07,  3.33it/s]
  0%|          | 775/371472 [03:41<31:02:39,  3.32it/s]
  0%|          | 776/371472 [03:41<30:46:53,  3.35it/s]
  0%|          | 777/371472 [03:42<29:57:42,  3.44it/s]
  0%|          | 778/371472 [03:42<29:12:43,  3.52it/s]
  0%|          | 779/371472 [03:42<30:34:38,  3.37it/s]
  0%|          | 780/371472 [03:43<30:09:54,  3.41it/s]
                                                       
{'loss': 6.3571, 'learning_rate': 9.985940227111119e-07, 'epoch': 0.03}

  0%|          | 780/371472 [03:43<30:09:54,  3.41it/s]
  0%|          | 781/371472 [03:43<28:50:59,  3.57it/s]
  0%|          | 782/371472 [03:43<29:30:08,  3.49it/s]
  0%|          | 783/371472 [03:43<31:35:52,  3.26it/s]
  0%|          | 784/371472 [03:44<30:41:04,  3.36it/s]
  0%|          | 785/371472 [03:44<31:29:38,  3.27it/s]
  0%|          | 786/371472 [03:44<32:26:14,  3.17it/s]
  0%|          | 787/371472 [03:45<33:31:45,  3.07it/s]
  0%|          | 788/371472 [03:45<31:19:07,  3.29it/s]
  0%|          | 789/371472 [03:45<29:29:54,  3.49it/s]
  0%|          | 790/371472 [03:45<28:49:41,  3.57it/s]
  0%|          | 791/371472 [03:46<28:35:31,  3.60it/s]
  0%|          | 792/371472 [03:46<29:37:32,  3.48it/s]
  0%|          | 793/371472 [03:46<29:46:29,  3.46it/s]
  0%|          | 794/371472 [03:47<29:14:11,  3.52it/s]
  0%|          | 795/371472 [03:47<29:37:31,  3.48it/s]
  0%|          | 796/371472 [03:47<30:53:38,  3.33it/s]
  0%|          | 797/371472 [03:48<30:46:53,  3.35it/s]
  0%|          | 798/371472 [03:48<30:50:14,  3.34it/s]
  0%|          | 799/371472 [03:48<29:05:15,  3.54it/s]
  0%|          | 800/371472 [03:48<30:06:44,  3.42it/s]
                                                       
{'loss': 6.2426, 'learning_rate': 9.985455407356332e-07, 'epoch': 0.03}

  0%|          | 800/371472 [03:48<30:06:44,  3.42it/s]
  0%|          | 801/371472 [03:49<29:41:02,  3.47it/s]
  0%|          | 802/371472 [03:49<29:19:00,  3.51it/s]
  0%|          | 803/371472 [03:49<29:51:04,  3.45it/s]
  0%|          | 804/371472 [03:50<29:02:48,  3.54it/s]
  0%|          | 805/371472 [03:50<30:06:44,  3.42it/s]
  0%|          | 806/371472 [03:50<29:41:44,  3.47it/s]
  0%|          | 807/371472 [03:50<29:40:59,  3.47it/s]
  0%|          | 808/371472 [03:51<29:37:49,  3.47it/s]
  0%|          | 809/371472 [03:51<29:24:23,  3.50it/s]
  0%|          | 810/371472 [03:51<28:37:02,  3.60it/s]
  0%|          | 811/371472 [03:52<29:43:31,  3.46it/s]
  0%|          | 812/371472 [03:52<29:12:58,  3.52it/s]
  0%|          | 813/371472 [03:52<29:16:47,  3.52it/s]
  0%|          | 814/371472 [03:52<28:43:07,  3.59it/s]
  0%|          | 815/371472 [03:53<30:39:56,  3.36it/s]
  0%|          | 816/371472 [03:53<29:01:52,  3.55it/s]
  0%|          | 817/371472 [03:53<31:43:18,  3.25it/s]
  0%|          | 818/371472 [03:54<30:05:29,  3.42it/s]
  0%|          | 819/371472 [03:54<29:20:59,  3.51it/s]
  0%|          | 820/371472 [03:54<28:34:29,  3.60it/s]
                                                       
{'loss': 6.2687, 'learning_rate': 9.984970587601542e-07, 'epoch': 0.04}

  0%|          | 820/371472 [03:54<28:34:29,  3.60it/s]
  0%|          | 821/371472 [03:54<28:08:28,  3.66it/s]
  0%|          | 822/371472 [03:55<27:21:37,  3.76it/s]
  0%|          | 823/371472 [03:55<28:39:09,  3.59it/s]
  0%|          | 824/371472 [03:55<28:49:04,  3.57it/s]
  0%|          | 825/371472 [03:55<28:36:00,  3.60it/s]
  0%|          | 826/371472 [03:56<29:55:51,  3.44it/s]
  0%|          | 827/371472 [03:56<29:30:10,  3.49it/s]
  0%|          | 828/371472 [03:56<29:39:48,  3.47it/s]
  0%|          | 829/371472 [03:57<29:23:23,  3.50it/s]
  0%|          | 830/371472 [03:57<29:17:51,  3.51it/s]
  0%|          | 831/371472 [03:57<31:56:28,  3.22it/s]
  0%|          | 832/371472 [03:58<30:25:34,  3.38it/s]
  0%|          | 833/371472 [03:58<29:58:56,  3.43it/s]
  0%|          | 834/371472 [03:58<29:11:47,  3.53it/s]
  0%|          | 835/371472 [03:59<33:16:50,  3.09it/s]
  0%|          | 836/371472 [03:59<31:43:03,  3.25it/s]
  0%|          | 837/371472 [03:59<29:51:45,  3.45it/s]
  0%|          | 838/371472 [03:59<28:29:50,  3.61it/s]
  0%|          | 839/371472 [04:00<30:07:43,  3.42it/s]
  0%|          | 840/371472 [04:00<28:52:14,  3.57it/s]
                                                       
{'loss': 6.2717, 'learning_rate': 9.984485767846753e-07, 'epoch': 0.04}

  0%|          | 840/371472 [04:00<28:52:14,  3.57it/s]
  0%|          | 841/371472 [04:00<28:46:38,  3.58it/s]
  0%|          | 842/371472 [04:00<28:47:52,  3.57it/s]
  0%|          | 843/371472 [04:01<32:33:55,  3.16it/s]
  0%|          | 844/371472 [04:01<30:57:26,  3.33it/s]
  0%|          | 845/371472 [04:01<29:44:27,  3.46it/s]
  0%|          | 846/371472 [04:02<32:30:36,  3.17it/s]
  0%|          | 847/371472 [04:02<30:42:21,  3.35it/s]
  0%|          | 848/371472 [04:02<30:25:43,  3.38it/s]
  0%|          | 849/371472 [04:03<29:05:50,  3.54it/s]
  0%|          | 850/371472 [04:03<28:02:53,  3.67it/s]
  0%|          | 851/371472 [04:03<27:29:38,  3.74it/s]
  0%|          | 852/371472 [04:03<27:28:21,  3.75it/s]
  0%|          | 853/371472 [04:04<26:56:36,  3.82it/s]
  0%|          | 854/371472 [04:04<28:32:38,  3.61it/s]
  0%|          | 855/371472 [04:04<31:28:22,  3.27it/s]
  0%|          | 856/371472 [04:05<33:04:28,  3.11it/s]
  0%|          | 857/371472 [04:05<31:38:08,  3.25it/s]
  0%|          | 858/371472 [04:05<29:12:57,  3.52it/s]
  0%|          | 859/371472 [04:05<27:55:59,  3.69it/s]
  0%|          | 860/371472 [04:06<27:46:44,  3.71it/s]
                                                       
{'loss': 6.1245, 'learning_rate': 9.984000948091966e-07, 'epoch': 0.04}

  0%|          | 860/371472 [04:06<27:46:44,  3.71it/s]
  0%|          | 861/371472 [04:06<28:01:53,  3.67it/s]
  0%|          | 862/371472 [04:06<27:34:19,  3.73it/s]
  0%|          | 863/371472 [04:06<27:59:05,  3.68it/s]
  0%|          | 864/371472 [04:07<27:11:23,  3.79it/s]
  0%|          | 865/371472 [04:07<28:54:33,  3.56it/s]
  0%|          | 866/371472 [04:07<29:15:10,  3.52it/s]
  0%|          | 867/371472 [04:08<28:53:10,  3.56it/s]
  0%|          | 868/371472 [04:08<29:24:18,  3.50it/s]
  0%|          | 869/371472 [04:08<28:49:56,  3.57it/s]
  0%|          | 870/371472 [04:08<28:23:50,  3.63it/s]
  0%|          | 871/371472 [04:09<30:49:02,  3.34it/s]
  0%|          | 872/371472 [04:09<32:04:17,  3.21it/s]
  0%|          | 873/371472 [04:09<30:10:54,  3.41it/s]
  0%|          | 874/371472 [04:10<33:01:00,  3.12it/s]
  0%|          | 875/371472 [04:10<32:56:47,  3.12it/s]
  0%|          | 876/371472 [04:10<33:41:24,  3.06it/s]
  0%|          | 877/371472 [04:11<35:10:07,  2.93it/s]
  0%|          | 878/371472 [04:11<34:19:56,  3.00it/s]
  0%|          | 879/371472 [04:11<32:37:04,  3.16it/s]
  0%|          | 880/371472 [04:12<30:51:27,  3.34it/s]
                                                       
{'loss': 6.281, 'learning_rate': 9.983516128337174e-07, 'epoch': 0.04}

  0%|          | 880/371472 [04:12<30:51:27,  3.34it/s]
  0%|          | 881/371472 [04:12<28:51:52,  3.57it/s]
  0%|          | 882/371472 [04:12<28:22:58,  3.63it/s]
  0%|          | 883/371472 [04:13<31:31:53,  3.26it/s]
  0%|          | 884/371472 [04:13<30:53:13,  3.33it/s]
  0%|          | 885/371472 [04:13<29:45:06,  3.46it/s]
  0%|          | 886/371472 [04:13<30:13:48,  3.41it/s]
  0%|          | 887/371472 [04:14<30:11:32,  3.41it/s]
  0%|          | 888/371472 [04:14<30:39:59,  3.36it/s]
  0%|          | 889/371472 [04:14<29:26:55,  3.50it/s]
  0%|          | 890/371472 [04:15<29:35:24,  3.48it/s]
  0%|          | 891/371472 [04:15<28:46:12,  3.58it/s]
  0%|          | 892/371472 [04:15<28:28:24,  3.62it/s]
  0%|          | 893/371472 [04:15<29:21:45,  3.51it/s]
  0%|          | 894/371472 [04:16<31:55:36,  3.22it/s]
  0%|          | 895/371472 [04:16<31:37:05,  3.26it/s]
  0%|          | 896/371472 [04:16<34:55:13,  2.95it/s]
  0%|          | 897/371472 [04:17<33:15:38,  3.09it/s]
  0%|          | 898/371472 [04:17<31:37:57,  3.25it/s]
  0%|          | 899/371472 [04:17<31:16:08,  3.29it/s]
  0%|          | 900/371472 [04:18<31:38:04,  3.25it/s]
                                                       
{'loss': 6.3632, 'learning_rate': 9.983031308582387e-07, 'epoch': 0.04}

  0%|          | 900/371472 [04:18<31:38:04,  3.25it/s]
  0%|          | 901/371472 [04:18<31:52:51,  3.23it/s]
  0%|          | 902/371472 [04:18<30:14:47,  3.40it/s]
  0%|          | 903/371472 [04:18<30:53:42,  3.33it/s]
  0%|          | 904/371472 [04:19<29:49:11,  3.45it/s]
  0%|          | 905/371472 [04:19<30:04:06,  3.42it/s]
  0%|          | 906/371472 [04:19<31:01:14,  3.32it/s]
  0%|          | 907/371472 [04:20<29:28:35,  3.49it/s]
  0%|          | 908/371472 [04:20<28:34:54,  3.60it/s]
  0%|          | 909/371472 [04:20<28:16:57,  3.64it/s]
  0%|          | 910/371472 [04:20<30:28:50,  3.38it/s]
  0%|          | 911/371472 [04:21<29:29:27,  3.49it/s]
  0%|          | 912/371472 [04:21<28:38:49,  3.59it/s]
  0%|          | 913/371472 [04:21<27:19:50,  3.77it/s]
  0%|          | 914/371472 [04:22<26:59:30,  3.81it/s]
  0%|          | 915/371472 [04:22<27:53:45,  3.69it/s]
  0%|          | 916/371472 [04:22<27:28:30,  3.75it/s]
  0%|          | 917/371472 [04:22<27:08:40,  3.79it/s]
  0%|          | 918/371472 [04:23<27:56:02,  3.68it/s]
  0%|          | 919/371472 [04:23<27:33:14,  3.74it/s]
  0%|          | 920/371472 [04:23<30:11:05,  3.41it/s]
                                                       
{'loss': 6.3535, 'learning_rate': 9.982546488827596e-07, 'epoch': 0.04}

  0%|          | 920/371472 [04:23<30:11:05,  3.41it/s]
  0%|          | 921/371472 [04:24<33:05:32,  3.11it/s]
  0%|          | 922/371472 [04:24<31:16:10,  3.29it/s]
  0%|          | 923/371472 [04:24<30:13:21,  3.41it/s]
  0%|          | 924/371472 [04:24<30:14:53,  3.40it/s]
  0%|          | 925/371472 [04:25<29:32:21,  3.48it/s]
  0%|          | 926/371472 [04:25<29:32:40,  3.48it/s]
  0%|          | 927/371472 [04:25<31:08:54,  3.30it/s]
  0%|          | 928/371472 [04:26<32:38:28,  3.15it/s]
  0%|          | 929/371472 [04:26<32:05:37,  3.21it/s]
  0%|          | 930/371472 [04:26<30:32:39,  3.37it/s]
  0%|          | 931/371472 [04:27<31:18:13,  3.29it/s]
  0%|          | 932/371472 [04:27<29:31:29,  3.49it/s]
  0%|          | 933/371472 [04:27<29:17:21,  3.51it/s]
  0%|          | 934/371472 [04:27<28:19:29,  3.63it/s]
  0%|          | 935/371472 [04:28<28:10:04,  3.65it/s]
  0%|          | 936/371472 [04:28<28:11:04,  3.65it/s]
  0%|          | 937/371472 [04:28<30:59:04,  3.32it/s]
  0%|          | 938/371472 [04:28<29:29:40,  3.49it/s]
  0%|          | 939/371472 [04:29<32:01:42,  3.21it/s]
  0%|          | 940/371472 [04:29<30:35:17,  3.36it/s]
                                                       
{'loss': 6.0799, 'learning_rate': 9.982061669072809e-07, 'epoch': 0.04}

  0%|          | 940/371472 [04:29<30:35:17,  3.36it/s]
  0%|          | 941/371472 [04:29<28:59:09,  3.55it/s]
  0%|          | 942/371472 [04:30<30:35:16,  3.36it/s]
  0%|          | 943/371472 [04:30<29:24:40,  3.50it/s]
  0%|          | 944/371472 [04:30<28:10:49,  3.65it/s]
  0%|          | 945/371472 [04:30<28:02:40,  3.67it/s]
  0%|          | 946/371472 [04:31<28:05:57,  3.66it/s]
  0%|          | 947/371472 [04:31<29:02:45,  3.54it/s]
  0%|          | 948/371472 [04:31<28:23:37,  3.62it/s]
  0%|          | 949/371472 [04:32<29:04:32,  3.54it/s]
  0%|          | 950/371472 [04:32<29:54:38,  3.44it/s]
  0%|          | 951/371472 [04:32<28:57:17,  3.55it/s]
  0%|          | 952/371472 [04:33<31:24:27,  3.28it/s]
  0%|          | 953/371472 [04:33<30:40:34,  3.36it/s]
  0%|          | 954/371472 [04:33<29:37:52,  3.47it/s]
  0%|          | 955/371472 [04:33<29:58:03,  3.43it/s]
  0%|          | 956/371472 [04:34<28:57:29,  3.55it/s]
  0%|          | 957/371472 [04:34<28:08:47,  3.66it/s]
  0%|          | 958/371472 [04:34<27:44:42,  3.71it/s]
  0%|          | 959/371472 [04:34<26:53:18,  3.83it/s]
  0%|          | 960/371472 [04:35<27:31:12,  3.74it/s]
                                                       
{'loss': 6.4344, 'learning_rate': 9.98157684931802e-07, 'epoch': 0.04}

  0%|          | 960/371472 [04:35<27:31:12,  3.74it/s]
  0%|          | 961/371472 [04:35<28:25:11,  3.62it/s]
  0%|          | 962/371472 [04:35<31:17:29,  3.29it/s]
  0%|          | 963/371472 [04:36<29:55:02,  3.44it/s]
  0%|          | 964/371472 [04:36<29:23:59,  3.50it/s]
  0%|          | 965/371472 [04:36<29:32:54,  3.48it/s]
  0%|          | 966/371472 [04:36<28:31:32,  3.61it/s]
  0%|          | 967/371472 [04:37<29:14:27,  3.52it/s]
  0%|          | 968/371472 [04:37<30:36:21,  3.36it/s]
  0%|          | 969/371472 [04:37<31:35:25,  3.26it/s]
  0%|          | 970/371472 [04:38<32:21:19,  3.18it/s]
  0%|          | 971/371472 [04:38<30:48:07,  3.34it/s]
  0%|          | 972/371472 [04:38<33:59:09,  3.03it/s]
  0%|          | 973/371472 [04:39<32:01:01,  3.21it/s]
  0%|          | 974/371472 [04:39<29:59:56,  3.43it/s]
  0%|          | 975/371472 [04:39<29:48:12,  3.45it/s]
  0%|          | 976/371472 [04:39<28:36:27,  3.60it/s]
  0%|          | 977/371472 [04:40<27:53:27,  3.69it/s]
  0%|          | 978/371472 [04:40<29:44:45,  3.46it/s]
  0%|          | 979/371472 [04:40<29:18:39,  3.51it/s]
  0%|          | 980/371472 [04:41<29:00:25,  3.55it/s]
                                                       
{'loss': 6.2517, 'learning_rate': 9.98109202956323e-07, 'epoch': 0.04}

  0%|          | 980/371472 [04:41<29:00:25,  3.55it/s]
  0%|          | 981/371472 [04:41<28:55:41,  3.56it/s]
  0%|          | 982/371472 [04:41<31:14:13,  3.29it/s]
  0%|          | 983/371472 [04:41<29:53:46,  3.44it/s]
  0%|          | 984/371472 [04:42<32:01:07,  3.21it/s]
  0%|          | 985/371472 [04:42<31:32:41,  3.26it/s]
  0%|          | 986/371472 [04:42<30:18:56,  3.39it/s]
  0%|          | 987/371472 [04:43<28:58:14,  3.55it/s]
  0%|          | 988/371472 [04:43<28:07:35,  3.66it/s]
  0%|          | 989/371472 [04:43<29:03:09,  3.54it/s]
  0%|          | 990/371472 [04:43<29:06:19,  3.54it/s]
  0%|          | 991/371472 [04:44<29:01:32,  3.55it/s]
  0%|          | 992/371472 [04:44<30:10:57,  3.41it/s]
  0%|          | 993/371472 [04:44<30:22:36,  3.39it/s]
  0%|          | 994/371472 [04:45<29:44:40,  3.46it/s]
  0%|          | 995/371472 [04:45<31:10:44,  3.30it/s]
  0%|          | 996/371472 [04:45<30:16:07,  3.40it/s]
  0%|          | 997/371472 [04:46<28:56:48,  3.56it/s]
  0%|          | 998/371472 [04:46<29:06:18,  3.54it/s]
  0%|          | 999/371472 [04:46<30:09:51,  3.41it/s]
  0%|          | 1000/371472 [04:46<30:19:25,  3.39it/s]
                                                        
{'loss': 5.9678, 'learning_rate': 9.980607209808443e-07, 'epoch': 0.04}

  0%|          | 1000/371472 [04:46<30:19:25,  3.39it/s]
  0%|          | 1001/371472 [04:47<30:52:23,  3.33it/s]
  0%|          | 1002/371472 [04:47<30:40:55,  3.35it/s]
  0%|          | 1003/371472 [04:47<30:05:25,  3.42it/s]
  0%|          | 1004/371472 [04:48<31:07:02,  3.31it/s]
  0%|          | 1005/371472 [04:48<31:56:42,  3.22it/s]
  0%|          | 1006/371472 [04:48<30:58:50,  3.32it/s]
  0%|          | 1007/371472 [04:48<29:34:25,  3.48it/s]
  0%|          | 1008/371472 [04:49<28:51:23,  3.57it/s]
  0%|          | 1009/371472 [04:49<29:22:29,  3.50it/s]
  0%|          | 1010/371472 [04:49<28:55:24,  3.56it/s]
  0%|          | 1011/371472 [04:50<29:49:51,  3.45it/s]
  0%|          | 1012/371472 [04:50<29:13:03,  3.52it/s]
  0%|          | 1013/371472 [04:50<29:48:05,  3.45it/s]
  0%|          | 1014/371472 [04:50<28:59:14,  3.55it/s]
  0%|          | 1015/371472 [04:51<29:06:17,  3.54it/s]
  0%|          | 1016/371472 [04:51<28:22:45,  3.63it/s]
  0%|          | 1017/371472 [04:51<27:53:20,  3.69it/s]
  0%|          | 1018/371472 [04:52<27:23:34,  3.76it/s]
  0%|          | 1019/371472 [04:52<27:19:06,  3.77it/s]
  0%|          | 1020/371472 [04:52<27:49:06,  3.70it/s]
                                                        
{'loss': 6.0589, 'learning_rate': 9.980122390053654e-07, 'epoch': 0.04}

  0%|          | 1020/371472 [04:52<27:49:06,  3.70it/s]
  0%|          | 1021/371472 [04:52<27:21:07,  3.76it/s]
  0%|          | 1022/371472 [04:53<28:56:21,  3.56it/s]
  0%|          | 1023/371472 [04:53<30:17:50,  3.40it/s]
  0%|          | 1024/371472 [04:53<29:28:01,  3.49it/s]
  0%|          | 1025/371472 [04:54<28:32:32,  3.61it/s]
  0%|          | 1026/371472 [04:54<27:34:12,  3.73it/s]
  0%|          | 1027/371472 [04:54<26:40:40,  3.86it/s]
  0%|          | 1028/371472 [04:54<28:32:46,  3.60it/s]
  0%|          | 1029/371472 [04:55<28:47:25,  3.57it/s]
  0%|          | 1030/371472 [04:55<31:08:58,  3.30it/s]
  0%|          | 1031/371472 [04:55<29:54:39,  3.44it/s]
  0%|          | 1032/371472 [04:55<28:31:51,  3.61it/s]
  0%|          | 1033/371472 [04:56<28:08:51,  3.66it/s]
  0%|          | 1034/371472 [04:56<29:02:15,  3.54it/s]
  0%|          | 1035/371472 [04:56<28:56:01,  3.56it/s]
  0%|          | 1036/371472 [04:57<27:45:43,  3.71it/s]
  0%|          | 1037/371472 [04:57<27:40:42,  3.72it/s]
  0%|          | 1038/371472 [04:57<27:16:13,  3.77it/s]
  0%|          | 1039/371472 [04:57<27:58:08,  3.68it/s]
  0%|          | 1040/371472 [04:58<29:18:56,  3.51it/s]
                                                        
{'loss': 6.3632, 'learning_rate': 9.979637570298864e-07, 'epoch': 0.04}

  0%|          | 1040/371472 [04:58<29:18:56,  3.51it/s]
  0%|          | 1041/371472 [04:58<33:01:24,  3.12it/s]
  0%|          | 1042/371472 [04:58<32:26:19,  3.17it/s]
  0%|          | 1043/371472 [04:59<32:42:54,  3.15it/s]
  0%|          | 1044/371472 [04:59<31:04:51,  3.31it/s]
  0%|          | 1045/371472 [04:59<30:33:49,  3.37it/s]
  0%|          | 1046/371472 [05:00<30:19:40,  3.39it/s]
  0%|          | 1047/371472 [05:00<29:28:52,  3.49it/s]
  0%|          | 1048/371472 [05:00<28:32:16,  3.61it/s]
  0%|          | 1049/371472 [05:00<28:06:52,  3.66it/s]
  0%|          | 1050/371472 [05:01<27:30:23,  3.74it/s]
  0%|          | 1051/371472 [05:01<27:24:31,  3.75it/s]
  0%|          | 1052/371472 [05:01<27:26:17,  3.75it/s]
  0%|          | 1053/371472 [05:01<27:42:40,  3.71it/s]
  0%|          | 1054/371472 [05:02<27:50:49,  3.69it/s]
  0%|          | 1055/371472 [05:02<27:36:11,  3.73it/s]
  0%|          | 1056/371472 [05:02<27:07:28,  3.79it/s]
  0%|          | 1057/371472 [05:02<27:42:16,  3.71it/s]
  0%|          | 1058/371472 [05:03<29:27:14,  3.49it/s]
  0%|          | 1059/371472 [05:03<28:45:29,  3.58it/s]
  0%|          | 1060/371472 [05:03<29:07:34,  3.53it/s]
                                                        
{'loss': 6.265, 'learning_rate': 9.979152750544075e-07, 'epoch': 0.05}

  0%|          | 1060/371472 [05:03<29:07:34,  3.53it/s]
  0%|          | 1061/371472 [05:04<28:26:28,  3.62it/s]
  0%|          | 1062/371472 [05:04<31:17:14,  3.29it/s]
  0%|          | 1063/371472 [05:04<30:00:12,  3.43it/s]
  0%|          | 1064/371472 [05:04<28:28:44,  3.61it/s]
  0%|          | 1065/371472 [05:05<31:38:06,  3.25it/s]
  0%|          | 1066/371472 [05:05<30:48:03,  3.34it/s]
  0%|          | 1067/371472 [05:05<29:47:11,  3.45it/s]
  0%|          | 1068/371472 [05:06<29:08:31,  3.53it/s]
  0%|          | 1069/371472 [05:06<30:05:55,  3.42it/s]
  0%|          | 1070/371472 [05:06<29:26:56,  3.49it/s]
  0%|          | 1071/371472 [05:07<28:53:00,  3.56it/s]
  0%|          | 1072/371472 [05:07<29:42:22,  3.46it/s]
  0%|          | 1073/371472 [05:07<29:24:47,  3.50it/s]
  0%|          | 1074/371472 [05:07<29:26:13,  3.50it/s]
  0%|          | 1075/371472 [05:08<29:50:07,  3.45it/s]
  0%|          | 1076/371472 [05:08<30:26:39,  3.38it/s]
  0%|          | 1077/371472 [05:08<29:46:24,  3.46it/s]
  0%|          | 1078/371472 [05:09<29:02:09,  3.54it/s]
  0%|          | 1079/371472 [05:09<28:50:28,  3.57it/s]
  0%|          | 1080/371472 [05:09<30:25:37,  3.38it/s]
                                                        
{'loss': 6.0993, 'learning_rate': 9.978667930789286e-07, 'epoch': 0.05}

  0%|          | 1080/371472 [05:09<30:25:37,  3.38it/s]
  0%|          | 1081/371472 [05:10<35:24:52,  2.91it/s]
  0%|          | 1082/371472 [05:10<33:21:46,  3.08it/s]
  0%|          | 1083/371472 [05:10<34:37:38,  2.97it/s]
  0%|          | 1084/371472 [05:11<32:35:56,  3.16it/s]
  0%|          | 1085/371472 [05:11<31:26:39,  3.27it/s]
  0%|          | 1086/371472 [05:11<30:00:14,  3.43it/s]
  0%|          | 1087/371472 [05:11<29:03:58,  3.54it/s]
  0%|          | 1088/371472 [05:12<29:04:19,  3.54it/s]
  0%|          | 1089/371472 [05:12<30:02:08,  3.43it/s]
  0%|          | 1090/371472 [05:12<30:13:25,  3.40it/s]
  0%|          | 1091/371472 [05:12<29:14:47,  3.52it/s]
  0%|          | 1092/371472 [05:13<28:40:37,  3.59it/s]
  0%|          | 1093/371472 [05:13<29:51:40,  3.45it/s]
  0%|          | 1094/371472 [05:13<30:51:44,  3.33it/s]
  0%|          | 1095/371472 [05:14<30:09:05,  3.41it/s]
  0%|          | 1096/371472 [05:14<30:17:24,  3.40it/s]
  0%|          | 1097/371472 [05:14<29:10:14,  3.53it/s]
  0%|          | 1098/371472 [05:15<29:09:53,  3.53it/s]
  0%|          | 1099/371472 [05:15<28:30:59,  3.61it/s]
  0%|          | 1100/371472 [05:15<28:43:37,  3.58it/s]
                                                        
{'loss': 6.1147, 'learning_rate': 9.978183111034499e-07, 'epoch': 0.05}

  0%|          | 1100/371472 [05:15<28:43:37,  3.58it/s]
  0%|          | 1101/371472 [05:15<28:39:20,  3.59it/s]
  0%|          | 1102/371472 [05:16<29:40:57,  3.47it/s]
  0%|          | 1103/371472 [05:16<29:30:01,  3.49it/s]
  0%|          | 1104/371472 [05:16<32:34:44,  3.16it/s]
  0%|          | 1105/371472 [05:17<31:57:11,  3.22it/s]
  0%|          | 1106/371472 [05:17<30:08:42,  3.41it/s]
  0%|          | 1107/371472 [05:17<31:46:31,  3.24it/s]
  0%|          | 1108/371472 [05:17<30:03:44,  3.42it/s]
  0%|          | 1109/371472 [05:18<29:19:27,  3.51it/s]
  0%|          | 1110/371472 [05:18<28:27:40,  3.61it/s]
  0%|          | 1111/371472 [05:18<29:39:35,  3.47it/s]
  0%|          | 1112/371472 [05:19<28:47:38,  3.57it/s]
  0%|          | 1113/371472 [05:19<28:33:38,  3.60it/s]
  0%|          | 1114/371472 [05:19<28:52:20,  3.56it/s]
  0%|          | 1115/371472 [05:19<29:18:03,  3.51it/s]
  0%|          | 1116/371472 [05:20<30:20:43,  3.39it/s]
  0%|          | 1117/371472 [05:20<29:29:11,  3.49it/s]
  0%|          | 1118/371472 [05:20<28:40:07,  3.59it/s]
  0%|          | 1119/371472 [05:21<28:16:22,  3.64it/s]
  0%|          | 1120/371472 [05:21<28:36:40,  3.60it/s]
                                                        
{'loss': 6.1485, 'learning_rate': 9.977698291279707e-07, 'epoch': 0.05}

  0%|          | 1120/371472 [05:21<28:36:40,  3.60it/s]
  0%|          | 1121/371472 [05:21<28:38:57,  3.59it/s]
  0%|          | 1122/371472 [05:21<28:39:23,  3.59it/s]
  0%|          | 1123/371472 [05:22<28:47:37,  3.57it/s]
  0%|          | 1124/371472 [05:22<28:09:19,  3.65it/s]
  0%|          | 1125/371472 [05:22<27:44:20,  3.71it/s]
  0%|          | 1126/371472 [05:23<30:14:40,  3.40it/s]
  0%|          | 1127/371472 [05:23<28:57:04,  3.55it/s]
  0%|          | 1128/371472 [05:23<28:24:23,  3.62it/s]
  0%|          | 1129/371472 [05:23<28:58:59,  3.55it/s]
  0%|          | 1130/371472 [05:24<30:50:15,  3.34it/s]
  0%|          | 1131/371472 [05:24<30:07:27,  3.41it/s]
  0%|          | 1132/371472 [05:24<29:09:34,  3.53it/s]
  0%|          | 1133/371472 [05:24<27:54:55,  3.69it/s]
  0%|          | 1134/371472 [05:25<28:09:30,  3.65it/s]
  0%|          | 1135/371472 [05:25<27:35:23,  3.73it/s]
  0%|          | 1136/371472 [05:25<29:44:55,  3.46it/s]
  0%|          | 1137/371472 [05:26<29:31:32,  3.48it/s]
  0%|          | 1138/371472 [05:26<29:13:55,  3.52it/s]
  0%|          | 1139/371472 [05:26<28:32:47,  3.60it/s]
  0%|          | 1140/371472 [05:26<28:01:10,  3.67it/s]
                                                        
{'loss': 5.9857, 'learning_rate': 9.97721347152492e-07, 'epoch': 0.05}

  0%|          | 1140/371472 [05:26<28:01:10,  3.67it/s]
  0%|          | 1141/371472 [05:27<27:15:44,  3.77it/s]
  0%|          | 1142/371472 [05:27<27:40:48,  3.72it/s]
  0%|          | 1143/371472 [05:27<34:05:48,  3.02it/s]
  0%|          | 1144/371472 [05:28<32:15:58,  3.19it/s]
  0%|          | 1145/371472 [05:28<31:37:14,  3.25it/s]
  0%|          | 1146/371472 [05:28<31:10:18,  3.30it/s]
  0%|          | 1147/371472 [05:29<30:44:23,  3.35it/s]
  0%|          | 1148/371472 [05:29<29:54:59,  3.44it/s]
  0%|          | 1149/371472 [05:29<29:30:25,  3.49it/s]
  0%|          | 1150/371472 [05:29<30:05:20,  3.42it/s]
  0%|          | 1151/371472 [05:30<29:14:02,  3.52it/s]
  0%|          | 1152/371472 [05:30<28:48:47,  3.57it/s]
  0%|          | 1153/371472 [05:30<28:31:04,  3.61it/s]
  0%|          | 1154/371472 [05:31<31:17:35,  3.29it/s]
  0%|          | 1155/371472 [05:31<33:17:21,  3.09it/s]
  0%|          | 1156/371472 [05:31<30:47:57,  3.34it/s]
  0%|          | 1157/371472 [05:31<29:21:49,  3.50it/s]
  0%|          | 1158/371472 [05:32<29:23:39,  3.50it/s]
  0%|          | 1159/371472 [05:32<29:00:16,  3.55it/s]
  0%|          | 1160/371472 [05:32<30:07:41,  3.41it/s]
                                                        
{'loss': 6.0165, 'learning_rate': 9.976728651770129e-07, 'epoch': 0.05}

  0%|          | 1160/371472 [05:32<30:07:41,  3.41it/s]
  0%|          | 1161/371472 [05:33<29:08:55,  3.53it/s]
  0%|          | 1162/371472 [05:33<30:12:06,  3.41it/s]
  0%|          | 1163/371472 [05:33<29:17:06,  3.51it/s]
  0%|          | 1164/371472 [05:33<28:43:28,  3.58it/s]
  0%|          | 1165/371472 [05:34<29:06:23,  3.53it/s]
  0%|          | 1166/371472 [05:34<28:47:40,  3.57it/s]
  0%|          | 1167/371472 [05:34<28:34:18,  3.60it/s]
  0%|          | 1168/371472 [05:35<28:31:05,  3.61it/s]
  0%|          | 1169/371472 [05:35<29:15:43,  3.52it/s]
  0%|          | 1170/371472 [05:35<29:06:58,  3.53it/s]
  0%|          | 1171/371472 [05:35<29:53:24,  3.44it/s]
  0%|          | 1172/371472 [05:36<29:15:40,  3.52it/s]
  0%|          | 1173/371472 [05:36<28:56:52,  3.55it/s]
  0%|          | 1174/371472 [05:36<29:22:29,  3.50it/s]
  0%|          | 1175/371472 [05:37<29:09:21,  3.53it/s]
  0%|          | 1176/371472 [05:37<28:00:50,  3.67it/s]
  0%|          | 1177/371472 [05:37<28:40:40,  3.59it/s]
  0%|          | 1178/371472 [05:37<28:24:21,  3.62it/s]
  0%|          | 1179/371472 [05:38<28:17:18,  3.64it/s]
  0%|          | 1180/371472 [05:38<31:49:14,  3.23it/s]
                                                        
{'loss': 6.176, 'learning_rate': 9.976243832015342e-07, 'epoch': 0.05}

  0%|          | 1180/371472 [05:38<31:49:14,  3.23it/s]
  0%|          | 1181/371472 [05:38<31:20:46,  3.28it/s]
  0%|          | 1182/371472 [05:39<30:40:28,  3.35it/s]
  0%|          | 1183/371472 [05:39<31:50:24,  3.23it/s]
  0%|          | 1184/371472 [05:39<31:14:44,  3.29it/s]
  0%|          | 1185/371472 [05:40<30:38:45,  3.36it/s]
  0%|          | 1186/371472 [05:40<30:23:37,  3.38it/s]
  0%|          | 1187/371472 [05:40<30:03:05,  3.42it/s]
  0%|          | 1188/371472 [05:40<30:53:36,  3.33it/s]
  0%|          | 1189/371472 [05:41<29:39:45,  3.47it/s]
  0%|          | 1190/371472 [05:41<30:02:40,  3.42it/s]
  0%|          | 1191/371472 [05:41<28:30:48,  3.61it/s]
  0%|          | 1192/371472 [05:41<28:01:24,  3.67it/s]
  0%|          | 1193/371472 [05:42<28:45:24,  3.58it/s]
  0%|          | 1194/371472 [05:42<28:13:03,  3.65it/s]
  0%|          | 1195/371472 [05:42<28:40:05,  3.59it/s]
  0%|          | 1196/371472 [05:43<28:53:44,  3.56it/s]
  0%|          | 1197/371472 [05:43<28:14:53,  3.64it/s]
  0%|          | 1198/371472 [05:43<30:22:02,  3.39it/s]
  0%|          | 1199/371472 [05:44<30:36:10,  3.36it/s]
  0%|          | 1200/371472 [05:44<30:21:03,  3.39it/s]
                                                        
{'loss': 6.2797, 'learning_rate': 9.975759012260552e-07, 'epoch': 0.05}

  0%|          | 1200/371472 [05:44<30:21:03,  3.39it/s]
  0%|          | 1201/371472 [05:44<30:08:48,  3.41it/s]
  0%|          | 1202/371472 [05:44<29:26:45,  3.49it/s]
  0%|          | 1203/371472 [05:45<30:46:13,  3.34it/s]
  0%|          | 1204/371472 [05:45<29:52:51,  3.44it/s]
  0%|          | 1205/371472 [05:45<31:03:36,  3.31it/s]
  0%|          | 1206/371472 [05:46<30:01:38,  3.43it/s]
  0%|          | 1207/371472 [05:46<29:50:35,  3.45it/s]
  0%|          | 1208/371472 [05:46<29:23:59,  3.50it/s]
  0%|          | 1209/371472 [05:46<29:59:08,  3.43it/s]
  0%|          | 1210/371472 [05:47<29:11:36,  3.52it/s]
  0%|          | 1211/371472 [05:47<29:24:58,  3.50it/s]
  0%|          | 1212/371472 [05:47<31:54:50,  3.22it/s]
  0%|          | 1213/371472 [05:48<30:46:51,  3.34it/s]
  0%|          | 1214/371472 [05:48<29:43:55,  3.46it/s]
  0%|          | 1215/371472 [05:48<29:21:35,  3.50it/s]
  0%|          | 1216/371472 [05:48<29:23:40,  3.50it/s]
  0%|          | 1217/371472 [05:49<28:37:10,  3.59it/s]
  0%|          | 1218/371472 [05:49<28:43:13,  3.58it/s]
  0%|          | 1219/371472 [05:49<27:38:47,  3.72it/s]
  0%|          | 1220/371472 [05:49<27:06:16,  3.79it/s]
                                                        
{'loss': 6.1033, 'learning_rate': 9.975274192505763e-07, 'epoch': 0.05}

  0%|          | 1220/371472 [05:49<27:06:16,  3.79it/s]
  0%|          | 1221/371472 [05:50<27:33:07,  3.73it/s]
  0%|          | 1222/371472 [05:50<29:29:52,  3.49it/s]
  0%|          | 1223/371472 [05:50<29:09:04,  3.53it/s]
  0%|          | 1224/371472 [05:51<29:52:13,  3.44it/s]
  0%|          | 1225/371472 [05:51<30:02:36,  3.42it/s]
  0%|          | 1226/371472 [05:51<29:11:13,  3.52it/s]
  0%|          | 1227/371472 [05:52<28:47:06,  3.57it/s]
  0%|          | 1228/371472 [05:52<29:39:52,  3.47it/s]
  0%|          | 1229/371472 [05:52<29:28:00,  3.49it/s]
  0%|          | 1230/371472 [05:52<29:49:16,  3.45it/s]
  0%|          | 1231/371472 [05:53<28:59:20,  3.55it/s]
  0%|          | 1232/371472 [05:53<28:13:45,  3.64it/s]
  0%|          | 1233/371472 [05:53<29:04:25,  3.54it/s]
  0%|          | 1234/371472 [05:54<30:26:08,  3.38it/s]
  0%|          | 1235/371472 [05:54<29:34:56,  3.48it/s]
  0%|          | 1236/371472 [05:54<32:47:12,  3.14it/s]
  0%|          | 1237/371472 [05:54<31:21:24,  3.28it/s]
  0%|          | 1238/371472 [05:55<32:15:05,  3.19it/s]
  0%|          | 1239/371472 [05:55<30:26:55,  3.38it/s]
  0%|          | 1240/371472 [05:55<29:05:56,  3.53it/s]
                                                        
{'loss': 5.9836, 'learning_rate': 9.974789372750976e-07, 'epoch': 0.05}

  0%|          | 1240/371472 [05:55<29:05:56,  3.53it/s]
  0%|          | 1241/371472 [05:56<30:34:49,  3.36it/s]
  0%|          | 1242/371472 [05:56<32:12:38,  3.19it/s]
  0%|          | 1243/371472 [05:56<30:45:23,  3.34it/s]
  0%|          | 1244/371472 [05:57<31:25:38,  3.27it/s]
  0%|          | 1245/371472 [05:57<29:54:07,  3.44it/s]
  0%|          | 1246/371472 [05:57<31:00:03,  3.32it/s]
  0%|          | 1247/371472 [05:57<29:21:59,  3.50it/s]
  0%|          | 1248/371472 [05:58<28:58:57,  3.55it/s]
  0%|          | 1249/371472 [05:58<29:27:42,  3.49it/s]
  0%|          | 1250/371472 [05:58<30:34:46,  3.36it/s]
  0%|          | 1251/371472 [05:59<30:21:33,  3.39it/s]
  0%|          | 1252/371472 [05:59<29:09:21,  3.53it/s]
  0%|          | 1253/371472 [05:59<28:21:37,  3.63it/s]
  0%|          | 1254/371472 [05:59<28:23:13,  3.62it/s]
  0%|          | 1255/371472 [06:00<30:45:07,  3.34it/s]
  0%|          | 1256/371472 [06:00<29:10:03,  3.53it/s]
  0%|          | 1257/371472 [06:00<31:34:20,  3.26it/s]
  0%|          | 1258/371472 [06:01<30:19:12,  3.39it/s]
  0%|          | 1259/371472 [06:01<29:30:41,  3.48it/s]
  0%|          | 1260/371472 [06:01<28:56:02,  3.55it/s]
                                                        
{'loss': 6.2921, 'learning_rate': 9.974304552996186e-07, 'epoch': 0.05}

  0%|          | 1260/371472 [06:01<28:56:02,  3.55it/s]
  0%|          | 1261/371472 [06:01<28:28:16,  3.61it/s]
  0%|          | 1262/371472 [06:02<28:27:40,  3.61it/s]
  0%|          | 1263/371472 [06:02<30:37:37,  3.36it/s]
  0%|          | 1264/371472 [06:02<28:46:52,  3.57it/s]
  0%|          | 1265/371472 [06:03<29:05:21,  3.54it/s]
  0%|          | 1266/371472 [06:03<28:33:20,  3.60it/s]
  0%|          | 1267/371472 [06:03<30:05:28,  3.42it/s]
  0%|          | 1268/371472 [06:03<29:06:51,  3.53it/s]
  0%|          | 1269/371472 [06:04<29:01:57,  3.54it/s]
  0%|          | 1270/371472 [06:04<28:01:21,  3.67it/s]
  0%|          | 1271/371472 [06:04<29:22:44,  3.50it/s]
  0%|          | 1272/371472 [06:05<32:06:54,  3.20it/s]
  0%|          | 1273/371472 [06:05<30:54:51,  3.33it/s]
  0%|          | 1274/371472 [06:05<29:13:19,  3.52it/s]
  0%|          | 1275/371472 [06:05<28:37:24,  3.59it/s]
  0%|          | 1276/371472 [06:06<29:31:33,  3.48it/s]
  0%|          | 1277/371472 [06:06<28:34:23,  3.60it/s]
  0%|          | 1278/371472 [06:06<28:26:18,  3.62it/s]
  0%|          | 1279/371472 [06:07<30:24:23,  3.38it/s]
  0%|          | 1280/371472 [06:07<28:55:35,  3.55it/s]
                                                        
{'loss': 6.3446, 'learning_rate': 9.973819733241397e-07, 'epoch': 0.06}

  0%|          | 1280/371472 [06:07<28:55:35,  3.55it/s]
  0%|          | 1281/371472 [06:07<28:13:37,  3.64it/s]
  0%|          | 1282/371472 [06:07<27:53:31,  3.69it/s]
  0%|          | 1283/371472 [06:08<28:07:57,  3.66it/s]
  0%|          | 1284/371472 [06:08<27:37:18,  3.72it/s]
  0%|          | 1285/371472 [06:08<27:39:00,  3.72it/s]
  0%|          | 1286/371472 [06:08<27:07:31,  3.79it/s]
  0%|          | 1287/371472 [06:09<29:43:39,  3.46it/s]
  0%|          | 1288/371472 [06:09<29:15:56,  3.51it/s]
  0%|          | 1289/371472 [06:09<28:45:59,  3.57it/s]
  0%|          | 1290/371472 [06:10<28:55:13,  3.56it/s]
  0%|          | 1291/371472 [06:10<28:53:14,  3.56it/s]
  0%|          | 1292/371472 [06:10<29:21:23,  3.50it/s]
  0%|          | 1293/371472 [06:10<28:21:16,  3.63it/s]
  0%|          | 1294/371472 [06:11<28:51:24,  3.56it/s]
  0%|          | 1295/371472 [06:11<31:31:22,  3.26it/s]
  0%|          | 1296/371472 [06:11<30:35:24,  3.36it/s]
  0%|          | 1297/371472 [06:12<29:31:39,  3.48it/s]
  0%|          | 1298/371472 [06:12<30:20:29,  3.39it/s]
  0%|          | 1299/371472 [06:12<29:56:29,  3.43it/s]
  0%|          | 1300/371472 [06:13<29:18:24,  3.51it/s]
                                                        
{'loss': 6.1988, 'learning_rate': 9.973334913486606e-07, 'epoch': 0.06}

  0%|          | 1300/371472 [06:13<29:18:24,  3.51it/s]
  0%|          | 1301/371472 [06:13<29:24:58,  3.50it/s]
  0%|          | 1302/371472 [06:13<29:07:43,  3.53it/s]
  0%|          | 1303/371472 [06:13<28:42:10,  3.58it/s]
  0%|          | 1304/371472 [06:14<27:24:25,  3.75it/s]
  0%|          | 1305/371472 [06:14<27:30:28,  3.74it/s]
  0%|          | 1306/371472 [06:14<27:55:05,  3.68it/s]
  0%|          | 1307/371472 [06:14<28:21:33,  3.63it/s]
  0%|          | 1308/371472 [06:15<28:47:48,  3.57it/s]
  0%|          | 1309/371472 [06:15<34:07:13,  3.01it/s]
  0%|          | 1310/371472 [06:15<31:47:35,  3.23it/s]
  0%|          | 1311/371472 [06:16<33:00:14,  3.12it/s]
  0%|          | 1312/371472 [06:16<30:39:03,  3.35it/s]
  0%|          | 1313/371472 [06:16<31:18:48,  3.28it/s]
  0%|          | 1314/371472 [06:17<30:41:52,  3.35it/s]
  0%|          | 1315/371472 [06:17<30:02:39,  3.42it/s]
  0%|          | 1316/371472 [06:17<31:03:24,  3.31it/s]
  0%|          | 1317/371472 [06:17<29:14:49,  3.52it/s]
  0%|          | 1318/371472 [06:18<28:19:31,  3.63it/s]
  0%|          | 1319/371472 [06:18<29:04:17,  3.54it/s]
  0%|          | 1320/371472 [06:18<30:38:28,  3.36it/s]
                                                        
{'loss': 6.1577, 'learning_rate': 9.972850093731819e-07, 'epoch': 0.06}

  0%|          | 1320/371472 [06:18<30:38:28,  3.36it/s]
  0%|          | 1321/371472 [06:19<29:29:05,  3.49it/s]
  0%|          | 1322/371472 [06:19<29:38:43,  3.47it/s]
  0%|          | 1323/371472 [06:19<29:11:15,  3.52it/s]
  0%|          | 1324/371472 [06:19<28:53:51,  3.56it/s]
  0%|          | 1325/371472 [06:20<28:04:42,  3.66it/s]
  0%|          | 1326/371472 [06:20<31:47:18,  3.23it/s]
  0%|          | 1327/371472 [06:20<30:26:14,  3.38it/s]
  0%|          | 1328/371472 [06:21<29:57:34,  3.43it/s]
  0%|          | 1329/371472 [06:21<31:05:54,  3.31it/s]
  0%|          | 1330/371472 [06:21<30:52:56,  3.33it/s]
  0%|          | 1331/371472 [06:22<32:46:13,  3.14it/s]
  0%|          | 1332/371472 [06:22<32:21:26,  3.18it/s]
  0%|          | 1333/371472 [06:22<31:48:38,  3.23it/s]
  0%|          | 1334/371472 [06:23<31:52:54,  3.22it/s]
  0%|          | 1335/371472 [06:23<30:53:42,  3.33it/s]
  0%|          | 1336/371472 [06:23<31:18:45,  3.28it/s]
  0%|          | 1337/371472 [06:23<30:59:14,  3.32it/s]
  0%|          | 1338/371472 [06:24<29:21:57,  3.50it/s]
  0%|          | 1339/371472 [06:24<30:18:19,  3.39it/s]
  0%|          | 1340/371472 [06:24<30:11:07,  3.41it/s]
                                                        
{'loss': 5.9894, 'learning_rate': 9.97236527397703e-07, 'epoch': 0.06}

  0%|          | 1340/371472 [06:24<30:11:07,  3.41it/s]
  0%|          | 1341/371472 [06:25<29:43:57,  3.46it/s]
  0%|          | 1342/371472 [06:25<29:15:02,  3.51it/s]
  0%|          | 1343/371472 [06:25<28:56:07,  3.55it/s]
  0%|          | 1344/371472 [06:25<28:56:14,  3.55it/s]
  0%|          | 1345/371472 [06:26<29:31:55,  3.48it/s]
  0%|          | 1346/371472 [06:26<27:54:09,  3.68it/s]
  0%|          | 1347/371472 [06:26<27:37:17,  3.72it/s]
  0%|          | 1348/371472 [06:26<28:17:18,  3.63it/s]
  0%|          | 1349/371472 [06:27<30:17:06,  3.39it/s]
  0%|          | 1350/371472 [06:27<29:47:16,  3.45it/s]
  0%|          | 1351/371472 [06:27<30:50:12,  3.33it/s]
  0%|          | 1352/371472 [06:28<29:00:58,  3.54it/s]
  0%|          | 1353/371472 [06:28<27:41:44,  3.71it/s]
  0%|          | 1354/371472 [06:28<27:33:16,  3.73it/s]
  0%|          | 1355/371472 [06:28<28:32:55,  3.60it/s]
  0%|          | 1356/371472 [06:29<28:54:26,  3.56it/s]
  0%|          | 1357/371472 [06:29<29:47:24,  3.45it/s]
  0%|          | 1358/371472 [06:29<30:48:01,  3.34it/s]
  0%|          | 1359/371472 [06:30<30:48:39,  3.34it/s]
  0%|          | 1360/371472 [06:30<30:15:52,  3.40it/s]
                                                        
{'loss': 6.2019, 'learning_rate': 9.97188045422224e-07, 'epoch': 0.06}

  0%|          | 1360/371472 [06:30<30:15:52,  3.40it/s]
  0%|          | 1361/371472 [06:30<31:27:38,  3.27it/s]
  0%|          | 1362/371472 [06:31<30:28:12,  3.37it/s]
  0%|          | 1363/371472 [06:31<30:39:05,  3.35it/s]
  0%|          | 1364/371472 [06:31<31:05:15,  3.31it/s]
  0%|          | 1365/371472 [06:32<31:48:18,  3.23it/s]
  0%|          | 1366/371472 [06:32<30:58:09,  3.32it/s]
  0%|          | 1367/371472 [06:32<29:47:19,  3.45it/s]
  0%|          | 1368/371472 [06:32<30:22:30,  3.38it/s]
  0%|          | 1369/371472 [06:33<29:01:43,  3.54it/s]
  0%|          | 1370/371472 [06:33<27:54:08,  3.68it/s]
  0%|          | 1371/371472 [06:33<28:24:55,  3.62it/s]
  0%|          | 1372/371472 [06:34<30:22:30,  3.38it/s]
  0%|          | 1373/371472 [06:34<29:47:27,  3.45it/s]
  0%|          | 1374/371472 [06:34<30:39:22,  3.35it/s]
  0%|          | 1375/371472 [06:34<30:30:38,  3.37it/s]
  0%|          | 1376/371472 [06:35<29:06:39,  3.53it/s]
  0%|          | 1377/371472 [06:35<31:02:59,  3.31it/s]
  0%|          | 1378/371472 [06:35<31:15:26,  3.29it/s]
  0%|          | 1379/371472 [06:36<30:10:16,  3.41it/s]
  0%|          | 1380/371472 [06:36<29:45:53,  3.45it/s]
                                                        
{'loss': 5.8516, 'learning_rate': 9.971395634467453e-07, 'epoch': 0.06}

  0%|          | 1380/371472 [06:36<29:45:53,  3.45it/s]
  0%|          | 1381/371472 [06:36<29:21:56,  3.50it/s]
  0%|          | 1382/371472 [06:36<29:22:01,  3.50it/s]
  0%|          | 1383/371472 [06:37<30:31:28,  3.37it/s]
  0%|          | 1384/371472 [06:37<30:50:18,  3.33it/s]
  0%|          | 1385/371472 [06:37<29:20:50,  3.50it/s]
  0%|          | 1386/371472 [06:38<29:48:52,  3.45it/s]
  0%|          | 1387/371472 [06:38<30:14:11,  3.40it/s]
  0%|          | 1388/371472 [06:38<30:17:45,  3.39it/s]
  0%|          | 1389/371472 [06:38<29:52:08,  3.44it/s]
  0%|          | 1390/371472 [06:39<29:22:05,  3.50it/s]
  0%|          | 1391/371472 [06:39<29:01:42,  3.54it/s]
  0%|          | 1392/371472 [06:39<29:24:37,  3.50it/s]
  0%|          | 1393/371472 [06:40<30:44:53,  3.34it/s]
  0%|          | 1394/371472 [06:40<28:57:49,  3.55it/s]
  0%|          | 1395/371472 [06:40<28:26:09,  3.62it/s]
  0%|          | 1396/371472 [06:40<29:12:21,  3.52it/s]
  0%|          | 1397/371472 [06:41<27:51:10,  3.69it/s]
  0%|          | 1398/371472 [06:41<28:03:13,  3.66it/s]
  0%|          | 1399/371472 [06:41<27:47:50,  3.70it/s]
  0%|          | 1400/371472 [06:42<28:03:33,  3.66it/s]
                                                        
{'loss': 6.0954, 'learning_rate': 9.970910814712664e-07, 'epoch': 0.06}

  0%|          | 1400/371472 [06:42<28:03:33,  3.66it/s]
  0%|          | 1401/371472 [06:42<28:43:35,  3.58it/s]
  0%|          | 1402/371472 [06:42<27:25:46,  3.75it/s]
  0%|          | 1403/371472 [06:42<27:50:16,  3.69it/s]
  0%|          | 1404/371472 [06:43<32:45:20,  3.14it/s]
  0%|          | 1405/371472 [06:43<30:59:18,  3.32it/s]
  0%|          | 1406/371472 [06:43<30:56:21,  3.32it/s]
  0%|          | 1407/371472 [06:44<30:35:43,  3.36it/s]
  0%|          | 1408/371472 [06:44<29:18:46,  3.51it/s]
  0%|          | 1409/371472 [06:44<30:59:59,  3.32it/s]
  0%|          | 1410/371472 [06:45<32:58:57,  3.12it/s]
  0%|          | 1411/371472 [06:45<32:08:30,  3.20it/s]
  0%|          | 1412/371472 [06:45<35:17:48,  2.91it/s]
  0%|          | 1413/371472 [06:46<32:33:56,  3.16it/s]
  0%|          | 1414/371472 [06:46<37:05:07,  2.77it/s]
  0%|          | 1415/371472 [06:46<35:39:20,  2.88it/s]
  0%|          | 1416/371472 [06:47<33:05:42,  3.11it/s]
  0%|          | 1417/371472 [06:47<31:10:00,  3.30it/s]
  0%|          | 1418/371472 [06:47<31:29:17,  3.26it/s]
  0%|          | 1419/371472 [06:47<31:05:23,  3.31it/s]
  0%|          | 1420/371472 [06:48<30:36:40,  3.36it/s]
                                                        
{'loss': 6.0892, 'learning_rate': 9.970425994957874e-07, 'epoch': 0.06}

  0%|          | 1420/371472 [06:48<30:36:40,  3.36it/s]
  0%|          | 1421/371472 [06:48<28:52:23,  3.56it/s]
  0%|          | 1422/371472 [06:48<29:15:51,  3.51it/s]
  0%|          | 1423/371472 [06:49<28:52:13,  3.56it/s]
  0%|          | 1424/371472 [06:49<30:41:33,  3.35it/s]
  0%|          | 1425/371472 [06:49<30:16:00,  3.40it/s]
  0%|          | 1426/371472 [06:49<30:05:16,  3.42it/s]
  0%|          | 1427/371472 [06:50<29:12:21,  3.52it/s]
  0%|          | 1428/371472 [06:50<28:16:17,  3.64it/s]
  0%|          | 1429/371472 [06:50<27:20:02,  3.76it/s]
  0%|          | 1430/371472 [06:51<28:04:54,  3.66it/s]
  0%|          | 1431/371472 [06:51<28:25:51,  3.62it/s]
  0%|          | 1432/371472 [06:51<27:47:46,  3.70it/s]
  0%|          | 1433/371472 [06:51<30:39:26,  3.35it/s]
  0%|          | 1434/371472 [06:52<29:25:33,  3.49it/s]
  0%|          | 1435/371472 [06:52<28:36:46,  3.59it/s]
  0%|          | 1436/371472 [06:52<27:58:10,  3.67it/s]
  0%|          | 1437/371472 [06:52<27:51:42,  3.69it/s]
  0%|          | 1438/371472 [06:53<30:46:46,  3.34it/s]
  0%|          | 1439/371472 [06:53<33:40:09,  3.05it/s]
  0%|          | 1440/371472 [06:54<32:41:34,  3.14it/s]
                                                        
{'loss': 5.8398, 'learning_rate': 9.969941175203085e-07, 'epoch': 0.06}

  0%|          | 1440/371472 [06:54<32:41:34,  3.14it/s]
  0%|          | 1441/371472 [06:54<33:52:54,  3.03it/s]
  0%|          | 1442/371472 [06:54<33:18:42,  3.09it/s]
  0%|          | 1443/371472 [06:54<31:59:30,  3.21it/s]
  0%|          | 1444/371472 [06:55<30:14:32,  3.40it/s]
  0%|          | 1445/371472 [06:55<30:06:58,  3.41it/s]
  0%|          | 1446/371472 [06:55<29:56:19,  3.43it/s]
  0%|          | 1447/371472 [06:56<29:52:31,  3.44it/s]
  0%|          | 1448/371472 [06:56<31:39:41,  3.25it/s]
  0%|          | 1449/371472 [06:56<31:37:28,  3.25it/s]
  0%|          | 1450/371472 [06:56<30:18:32,  3.39it/s]
  0%|          | 1451/371472 [06:57<29:43:23,  3.46it/s]
  0%|          | 1452/371472 [06:57<31:10:07,  3.30it/s]
  0%|          | 1453/371472 [06:57<30:31:29,  3.37it/s]
  0%|          | 1454/371472 [06:58<30:06:26,  3.41it/s]
  0%|          | 1455/371472 [06:58<30:24:46,  3.38it/s]
  0%|          | 1456/371472 [06:58<30:54:39,  3.33it/s]
  0%|          | 1457/371472 [06:59<31:06:12,  3.30it/s]
  0%|          | 1458/371472 [06:59<31:22:45,  3.28it/s]
  0%|          | 1459/371472 [06:59<30:25:42,  3.38it/s]
  0%|          | 1460/371472 [06:59<29:16:05,  3.51it/s]
                                                        
{'loss': 6.0239, 'learning_rate': 9.969456355448296e-07, 'epoch': 0.06}

  0%|          | 1460/371472 [06:59<29:16:05,  3.51it/s]
  0%|          | 1461/371472 [07:00<29:13:11,  3.52it/s]
  0%|          | 1462/371472 [07:00<28:13:44,  3.64it/s]
  0%|          | 1463/371472 [07:00<28:26:00,  3.61it/s]
  0%|          | 1464/371472 [07:01<27:39:41,  3.72it/s]
  0%|          | 1465/371472 [07:01<28:50:40,  3.56it/s]
  0%|          | 1466/371472 [07:01<28:26:08,  3.61it/s]
  0%|          | 1467/371472 [07:01<28:12:27,  3.64it/s]
  0%|          | 1468/371472 [07:02<29:45:47,  3.45it/s]
  0%|          | 1469/371472 [07:02<28:50:02,  3.56it/s]
  0%|          | 1470/371472 [07:02<28:12:54,  3.64it/s]
  0%|          | 1471/371472 [07:03<29:43:52,  3.46it/s]
  0%|          | 1472/371472 [07:03<29:43:19,  3.46it/s]
  0%|          | 1473/371472 [07:03<29:46:26,  3.45it/s]
  0%|          | 1474/371472 [07:03<28:31:05,  3.60it/s]
  0%|          | 1475/371472 [07:04<27:42:47,  3.71it/s]
  0%|          | 1476/371472 [07:04<27:31:56,  3.73it/s]
  0%|          | 1477/371472 [07:04<27:48:12,  3.70it/s]
  0%|          | 1478/371472 [07:04<29:29:22,  3.49it/s]
  0%|          | 1479/371472 [07:05<30:10:47,  3.41it/s]
  0%|          | 1480/371472 [07:05<29:57:35,  3.43it/s]
                                                        
{'loss': 6.0563, 'learning_rate': 9.968971535693509e-07, 'epoch': 0.06}

  0%|          | 1480/371472 [07:05<29:57:35,  3.43it/s]
  0%|          | 1481/371472 [07:05<31:33:15,  3.26it/s]
  0%|          | 1482/371472 [07:06<29:50:21,  3.44it/s]
  0%|          | 1483/371472 [07:06<29:02:25,  3.54it/s]
  0%|          | 1484/371472 [07:06<28:45:49,  3.57it/s]
  0%|          | 1485/371472 [07:06<27:23:27,  3.75it/s]
  0%|          | 1486/371472 [07:07<28:00:54,  3.67it/s]
  0%|          | 1487/371472 [07:07<28:05:29,  3.66it/s]
  0%|          | 1488/371472 [07:07<30:52:58,  3.33it/s]
  0%|          | 1489/371472 [07:08<29:46:57,  3.45it/s]
  0%|          | 1490/371472 [07:08<29:06:55,  3.53it/s]
  0%|          | 1491/371472 [07:08<28:43:47,  3.58it/s]
  0%|          | 1492/371472 [07:08<28:10:30,  3.65it/s]
  0%|          | 1493/371472 [07:09<28:56:59,  3.55it/s]
  0%|          | 1494/371472 [07:09<27:59:48,  3.67it/s]
  0%|          | 1495/371472 [07:09<28:02:24,  3.67it/s]
  0%|          | 1496/371472 [07:10<27:58:36,  3.67it/s]
  0%|          | 1497/371472 [07:10<27:35:17,  3.73it/s]
  0%|          | 1498/371472 [07:10<28:32:23,  3.60it/s]
  0%|          | 1499/371472 [07:10<28:01:51,  3.67it/s]
  0%|          | 1500/371472 [07:11<27:29:14,  3.74it/s]
                                                        
{'loss': 6.1168, 'learning_rate': 9.968486715938717e-07, 'epoch': 0.06}

  0%|          | 1500/371472 [07:11<27:29:14,  3.74it/s]
  0%|          | 1501/371472 [07:11<27:50:27,  3.69it/s]
  0%|          | 1502/371472 [07:11<28:47:21,  3.57it/s]
  0%|          | 1503/371472 [07:11<28:32:30,  3.60it/s]
  0%|          | 1504/371472 [07:12<30:01:41,  3.42it/s]
  0%|          | 1505/371472 [07:12<30:30:16,  3.37it/s]
  0%|          | 1506/371472 [07:12<29:07:19,  3.53it/s]
  0%|          | 1507/371472 [07:13<28:11:19,  3.65it/s]
  0%|          | 1508/371472 [07:13<29:35:47,  3.47it/s]
  0%|          | 1509/371472 [07:13<29:09:54,  3.52it/s]
  0%|          | 1510/371472 [07:13<29:47:03,  3.45it/s]
  0%|          | 1511/371472 [07:14<30:54:25,  3.33it/s]
  0%|          | 1512/371472 [07:14<31:14:21,  3.29it/s]
  0%|          | 1513/371472 [07:14<29:08:28,  3.53it/s]
  0%|          | 1514/371472 [07:15<31:18:34,  3.28it/s]
  0%|          | 1515/371472 [07:15<30:52:42,  3.33it/s]
  0%|          | 1516/371472 [07:15<29:50:36,  3.44it/s]
  0%|          | 1517/371472 [07:16<31:42:22,  3.24it/s]
  0%|          | 1518/371472 [07:16<30:15:10,  3.40it/s]
  0%|          | 1519/371472 [07:16<28:46:01,  3.57it/s]
  0%|          | 1520/371472 [07:16<27:58:14,  3.67it/s]
                                                        
{'loss': 5.8443, 'learning_rate': 9.96800189618393e-07, 'epoch': 0.07}

  0%|          | 1520/371472 [07:16<27:58:14,  3.67it/s]
  0%|          | 1521/371472 [07:17<28:40:52,  3.58it/s]
  0%|          | 1522/371472 [07:17<27:30:12,  3.74it/s]
  0%|          | 1523/371472 [07:17<27:51:56,  3.69it/s]
  0%|          | 1524/371472 [07:17<28:29:34,  3.61it/s]
  0%|          | 1525/371472 [07:18<29:22:10,  3.50it/s]
  0%|          | 1526/371472 [07:18<29:54:02,  3.44it/s]
  0%|          | 1527/371472 [07:18<29:50:59,  3.44it/s]
  0%|          | 1528/371472 [07:19<30:07:30,  3.41it/s]
  0%|          | 1529/371472 [07:19<28:54:02,  3.56it/s]
  0%|          | 1530/371472 [07:19<31:36:24,  3.25it/s]
  0%|          | 1531/371472 [07:20<32:14:46,  3.19it/s]
  0%|          | 1532/371472 [07:20<33:49:19,  3.04it/s]
  0%|          | 1533/371472 [07:20<31:47:52,  3.23it/s]
  0%|          | 1534/371472 [07:21<31:04:12,  3.31it/s]
  0%|          | 1535/371472 [07:21<31:34:06,  3.26it/s]
  0%|          | 1536/371472 [07:21<33:09:09,  3.10it/s]
  0%|          | 1537/371472 [07:22<33:29:05,  3.07it/s]
  0%|          | 1538/371472 [07:22<32:46:47,  3.13it/s]
  0%|          | 1539/371472 [07:22<33:06:48,  3.10it/s]
  0%|          | 1540/371472 [07:22<31:37:04,  3.25it/s]
                                                        
{'loss': 5.8785, 'learning_rate': 9.967517076429139e-07, 'epoch': 0.07}

  0%|          | 1540/371472 [07:22<31:37:04,  3.25it/s]
  0%|          | 1541/371472 [07:23<36:03:18,  2.85it/s]
  0%|          | 1542/371472 [07:23<33:41:42,  3.05it/s]
  0%|          | 1543/371472 [07:23<31:30:17,  3.26it/s]
  0%|          | 1544/371472 [07:24<32:01:04,  3.21it/s]
  0%|          | 1545/371472 [07:24<29:51:44,  3.44it/s]
  0%|          | 1546/371472 [07:24<32:50:14,  3.13it/s]
  0%|          | 1547/371472 [07:25<32:02:11,  3.21it/s]
  0%|          | 1548/371472 [07:25<30:11:54,  3.40it/s]
  0%|          | 1549/371472 [07:25<28:53:30,  3.56it/s]
  0%|          | 1550/371472 [07:25<29:10:30,  3.52it/s]
  0%|          | 1551/371472 [07:26<28:06:56,  3.65it/s]
  0%|          | 1552/371472 [07:26<29:17:35,  3.51it/s]
  0%|          | 1553/371472 [07:26<28:58:08,  3.55it/s]
  0%|          | 1554/371472 [07:27<30:03:14,  3.42it/s]
  0%|          | 1555/371472 [07:27<29:45:53,  3.45it/s]
  0%|          | 1556/371472 [07:27<28:21:31,  3.62it/s]
  0%|          | 1557/371472 [07:27<28:33:17,  3.60it/s]
  0%|          | 1558/371472 [07:28<28:15:19,  3.64it/s]
  0%|          | 1559/371472 [07:28<29:18:36,  3.51it/s]
  0%|          | 1560/371472 [07:28<29:14:16,  3.51it/s]
                                                        
{'loss': 6.0316, 'learning_rate': 9.967032256674351e-07, 'epoch': 0.07}

  0%|          | 1560/371472 [07:28<29:14:16,  3.51it/s]
  0%|          | 1561/371472 [07:29<29:46:30,  3.45it/s]
  0%|          | 1562/371472 [07:29<31:41:44,  3.24it/s]
  0%|          | 1563/371472 [07:29<34:08:32,  3.01it/s]
  0%|          | 1564/371472 [07:30<33:15:12,  3.09it/s]
  0%|          | 1565/371472 [07:30<31:14:56,  3.29it/s]
  0%|          | 1566/371472 [07:30<29:58:08,  3.43it/s]
  0%|          | 1567/371472 [07:30<28:43:03,  3.58it/s]
  0%|          | 1568/371472 [07:31<28:12:19,  3.64it/s]
  0%|          | 1569/371472 [07:31<30:43:51,  3.34it/s]
  0%|          | 1570/371472 [07:31<30:18:20,  3.39it/s]
  0%|          | 1571/371472 [07:32<28:49:43,  3.56it/s]
  0%|          | 1572/371472 [07:32<29:13:47,  3.52it/s]
  0%|          | 1573/371472 [07:32<28:08:19,  3.65it/s]
  0%|          | 1574/371472 [07:32<29:50:46,  3.44it/s]
  0%|          | 1575/371472 [07:33<28:44:35,  3.57it/s]
  0%|          | 1576/371472 [07:33<28:07:26,  3.65it/s]
  0%|          | 1577/371472 [07:33<29:37:52,  3.47it/s]
  0%|          | 1578/371472 [07:34<31:44:33,  3.24it/s]
  0%|          | 1579/371472 [07:34<30:38:00,  3.35it/s]
  0%|          | 1580/371472 [07:34<29:28:24,  3.49it/s]
                                                        
{'loss': 5.9318, 'learning_rate': 9.966547436919562e-07, 'epoch': 0.07}

  0%|          | 1580/371472 [07:34<29:28:24,  3.49it/s]
  0%|          | 1581/371472 [07:34<28:49:42,  3.56it/s]
  0%|          | 1582/371472 [07:35<28:12:39,  3.64it/s]
  0%|          | 1583/371472 [07:35<27:26:34,  3.74it/s]
  0%|          | 1584/371472 [07:35<29:36:29,  3.47it/s]
  0%|          | 1585/371472 [07:36<29:25:30,  3.49it/s]
  0%|          | 1586/371472 [07:36<29:01:28,  3.54it/s]
  0%|          | 1587/371472 [07:36<30:34:42,  3.36it/s]
  0%|          | 1588/371472 [07:36<29:35:01,  3.47it/s]
  0%|          | 1589/371472 [07:37<29:07:31,  3.53it/s]
  0%|          | 1590/371472 [07:37<31:07:48,  3.30it/s]
  0%|          | 1591/371472 [07:37<29:59:24,  3.43it/s]
  0%|          | 1592/371472 [07:38<28:57:07,  3.55it/s]
  0%|          | 1593/371472 [07:38<27:51:01,  3.69it/s]
  0%|          | 1594/371472 [07:38<29:36:08,  3.47it/s]
  0%|          | 1595/371472 [07:38<28:46:42,  3.57it/s]
  0%|          | 1596/371472 [07:39<27:47:22,  3.70it/s]
  0%|          | 1597/371472 [07:39<29:45:46,  3.45it/s]
  0%|          | 1598/371472 [07:39<30:40:23,  3.35it/s]
  0%|          | 1599/371472 [07:40<29:22:42,  3.50it/s]
  0%|          | 1600/371472 [07:40<28:44:47,  3.57it/s]
                                                        
{'loss': 6.1837, 'learning_rate': 9.966062617164773e-07, 'epoch': 0.07}

  0%|          | 1600/371472 [07:40<28:44:47,  3.57it/s]
  0%|          | 1601/371472 [07:40<29:05:38,  3.53it/s]
  0%|          | 1602/371472 [07:40<27:54:30,  3.68it/s]
  0%|          | 1603/371472 [07:41<27:08:20,  3.79it/s]
  0%|          | 1604/371472 [07:41<28:36:09,  3.59it/s]
  0%|          | 1605/371472 [07:41<29:43:32,  3.46it/s]
  0%|          | 1606/371472 [07:42<28:23:06,  3.62it/s]
  0%|          | 1607/371472 [07:42<28:48:44,  3.57it/s]
  0%|          | 1608/371472 [07:42<28:44:37,  3.57it/s]
  0%|          | 1609/371472 [07:42<29:25:58,  3.49it/s]
  0%|          | 1610/371472 [07:43<28:18:39,  3.63it/s]
  0%|          | 1611/371472 [07:43<28:06:32,  3.66it/s]
  0%|          | 1612/371472 [07:43<28:09:46,  3.65it/s]
  0%|          | 1613/371472 [07:43<28:30:17,  3.60it/s]
  0%|          | 1614/371472 [07:44<29:03:50,  3.53it/s]
  0%|          | 1615/371472 [07:44<28:53:33,  3.56it/s]
  0%|          | 1616/371472 [07:44<28:39:28,  3.58it/s]
  0%|          | 1617/371472 [07:45<29:35:50,  3.47it/s]
  0%|          | 1618/371472 [07:45<29:06:25,  3.53it/s]
  0%|          | 1619/371472 [07:45<28:28:06,  3.61it/s]
  0%|          | 1620/371472 [07:45<28:27:10,  3.61it/s]
                                                        
{'loss': 6.0558, 'learning_rate': 9.965577797409986e-07, 'epoch': 0.07}

  0%|          | 1620/371472 [07:45<28:27:10,  3.61it/s]
  0%|          | 1621/371472 [07:46<30:42:49,  3.34it/s]
  0%|          | 1622/371472 [07:46<30:50:01,  3.33it/s]
  0%|          | 1623/371472 [07:46<29:32:02,  3.48it/s]
  0%|          | 1624/371472 [07:47<28:29:41,  3.61it/s]
  0%|          | 1625/371472 [07:47<28:47:24,  3.57it/s]
  0%|          | 1626/371472 [07:47<28:11:53,  3.64it/s]
  0%|          | 1627/371472 [07:47<28:01:08,  3.67it/s]
  0%|          | 1628/371472 [07:48<27:19:25,  3.76it/s]
  0%|          | 1629/371472 [07:48<27:04:17,  3.79it/s]
  0%|          | 1630/371472 [07:48<29:08:10,  3.53it/s]
  0%|          | 1631/371472 [07:49<28:36:27,  3.59it/s]
  0%|          | 1632/371472 [07:49<29:19:49,  3.50it/s]
  0%|          | 1633/371472 [07:49<28:04:43,  3.66it/s]
  0%|          | 1634/371472 [07:49<28:41:39,  3.58it/s]
  0%|          | 1635/371472 [07:50<28:43:48,  3.58it/s]
  0%|          | 1636/371472 [07:50<28:21:16,  3.62it/s]
  0%|          | 1637/371472 [07:50<27:39:36,  3.71it/s]
  0%|          | 1638/371472 [07:50<28:26:40,  3.61it/s]
  0%|          | 1639/371472 [07:51<27:45:14,  3.70it/s]
  0%|          | 1640/371472 [07:51<27:55:32,  3.68it/s]
                                                        
{'loss': 5.9914, 'learning_rate': 9.965092977655196e-07, 'epoch': 0.07}

  0%|          | 1640/371472 [07:51<27:55:32,  3.68it/s]
  0%|          | 1641/371472 [07:51<27:57:30,  3.67it/s]
  0%|          | 1642/371472 [07:52<29:19:24,  3.50it/s]
  0%|          | 1643/371472 [07:52<28:53:25,  3.56it/s]
  0%|          | 1644/371472 [07:52<29:03:04,  3.54it/s]
  0%|          | 1645/371472 [07:52<28:32:16,  3.60it/s]
  0%|          | 1646/371472 [07:53<28:01:26,  3.67it/s]
  0%|          | 1647/371472 [07:53<27:38:08,  3.72it/s]
  0%|          | 1648/371472 [07:53<27:19:38,  3.76it/s]
  0%|          | 1649/371472 [07:53<28:28:03,  3.61it/s]
  0%|          | 1650/371472 [07:54<28:15:09,  3.64it/s]
  0%|          | 1651/371472 [07:54<28:36:58,  3.59it/s]
  0%|          | 1652/371472 [07:54<27:51:59,  3.69it/s]
  0%|          | 1653/371472 [07:55<27:48:59,  3.69it/s]
  0%|          | 1654/371472 [07:55<29:31:38,  3.48it/s]
  0%|          | 1655/371472 [07:55<28:34:11,  3.60it/s]
  0%|          | 1656/371472 [07:55<28:21:28,  3.62it/s]
  0%|          | 1657/371472 [07:56<27:35:37,  3.72it/s]
  0%|          | 1658/371472 [07:56<28:05:26,  3.66it/s]
  0%|          | 1659/371472 [07:56<28:17:31,  3.63it/s]
  0%|          | 1660/371472 [07:57<28:29:54,  3.60it/s]
                                                        
{'loss': 6.1015, 'learning_rate': 9.964608157900407e-07, 'epoch': 0.07}

  0%|          | 1660/371472 [07:57<28:29:54,  3.60it/s]
  0%|          | 1661/371472 [07:57<28:46:48,  3.57it/s]
  0%|          | 1662/371472 [07:57<30:06:06,  3.41it/s]
  0%|          | 1663/371472 [07:57<29:48:39,  3.45it/s]
  0%|          | 1664/371472 [07:58<29:05:37,  3.53it/s]
  0%|          | 1665/371472 [07:58<30:48:20,  3.33it/s]
  0%|          | 1666/371472 [07:58<31:38:54,  3.25it/s]
  0%|          | 1667/371472 [07:59<30:36:56,  3.36it/s]
  0%|          | 1668/371472 [07:59<30:34:06,  3.36it/s]
  0%|          | 1669/371472 [07:59<30:08:15,  3.41it/s]
  0%|          | 1670/371472 [07:59<29:27:41,  3.49it/s]
  0%|          | 1671/371472 [08:00<28:26:04,  3.61it/s]
  0%|          | 1672/371472 [08:00<28:11:26,  3.64it/s]
  0%|          | 1673/371472 [08:00<28:50:18,  3.56it/s]
  0%|          | 1674/371472 [08:01<29:10:14,  3.52it/s]
  0%|          | 1675/371472 [08:01<28:15:53,  3.63it/s]
  0%|          | 1676/371472 [08:01<28:55:04,  3.55it/s]
  0%|          | 1677/371472 [08:01<28:16:37,  3.63it/s]
  0%|          | 1678/371472 [08:02<29:41:54,  3.46it/s]
  0%|          | 1679/371472 [08:02<30:33:05,  3.36it/s]
  0%|          | 1680/371472 [08:02<29:48:01,  3.45it/s]
                                                        
{'loss': 5.948, 'learning_rate': 9.964123338145618e-07, 'epoch': 0.07}

  0%|          | 1680/371472 [08:02<29:48:01,  3.45it/s]
  0%|          | 1681/371472 [08:03<29:08:24,  3.53it/s]
  0%|          | 1682/371472 [08:03<28:10:57,  3.64it/s]
  0%|          | 1683/371472 [08:03<28:04:22,  3.66it/s]
  0%|          | 1684/371472 [08:03<27:11:52,  3.78it/s]
  0%|          | 1685/371472 [08:04<27:23:26,  3.75it/s]
  0%|          | 1686/371472 [08:04<27:30:03,  3.74it/s]
  0%|          | 1687/371472 [08:04<30:32:11,  3.36it/s]
  0%|          | 1688/371472 [08:04<29:06:54,  3.53it/s]
  0%|          | 1689/371472 [08:05<31:49:32,  3.23it/s]
  0%|          | 1690/371472 [08:05<31:34:15,  3.25it/s]
  0%|          | 1691/371472 [08:05<30:32:21,  3.36it/s]
  0%|          | 1692/371472 [08:06<30:03:19,  3.42it/s]
  0%|          | 1693/371472 [08:06<29:02:26,  3.54it/s]
  0%|          | 1694/371472 [08:06<29:27:25,  3.49it/s]
  0%|          | 1695/371472 [08:07<28:28:02,  3.61it/s]
  0%|          | 1696/371472 [08:07<27:31:35,  3.73it/s]
  0%|          | 1697/371472 [08:07<28:04:26,  3.66it/s]
  0%|          | 1698/371472 [08:07<27:41:57,  3.71it/s]
  0%|          | 1699/371472 [08:08<30:46:09,  3.34it/s]
  0%|          | 1700/371472 [08:08<30:46:06,  3.34it/s]
                                                        
{'loss': 5.8682, 'learning_rate': 9.963638518390829e-07, 'epoch': 0.07}

  0%|          | 1700/371472 [08:08<30:46:06,  3.34it/s]
  0%|          | 1701/371472 [08:08<29:58:48,  3.43it/s]
  0%|          | 1702/371472 [08:09<28:34:00,  3.60it/s]
  0%|          | 1703/371472 [08:09<29:50:31,  3.44it/s]
  0%|          | 1704/371472 [08:09<29:06:16,  3.53it/s]
  0%|          | 1705/371472 [08:09<28:27:05,  3.61it/s]
  0%|          | 1706/371472 [08:10<27:08:51,  3.78it/s]
  0%|          | 1707/371472 [08:10<26:40:12,  3.85it/s]
  0%|          | 1708/371472 [08:10<27:03:21,  3.80it/s]
  0%|          | 1709/371472 [08:10<27:39:23,  3.71it/s]
  0%|          | 1710/371472 [08:11<27:14:22,  3.77it/s]
  0%|          | 1711/371472 [08:11<26:56:00,  3.81it/s]
  0%|          | 1712/371472 [08:11<26:37:32,  3.86it/s]
  0%|          | 1713/371472 [08:11<28:24:40,  3.62it/s]
  0%|          | 1714/371472 [08:12<28:06:29,  3.65it/s]
  0%|          | 1715/371472 [08:12<27:52:50,  3.68it/s]
  0%|          | 1716/371472 [08:12<27:04:51,  3.79it/s]
  0%|          | 1717/371472 [08:12<26:18:50,  3.90it/s]
  0%|          | 1718/371472 [08:13<26:48:59,  3.83it/s]
  0%|          | 1719/371472 [08:13<27:01:28,  3.80it/s]
  0%|          | 1720/371472 [08:13<26:34:01,  3.87it/s]
                                                        
{'loss': 6.0684, 'learning_rate': 9.963153698636041e-07, 'epoch': 0.07}

  0%|          | 1720/371472 [08:13<26:34:01,  3.87it/s]
  0%|          | 1721/371472 [08:14<27:33:36,  3.73it/s]
  0%|          | 1722/371472 [08:14<27:16:37,  3.77it/s]
  0%|          | 1723/371472 [08:14<27:50:40,  3.69it/s]
  0%|          | 1724/371472 [08:14<28:10:00,  3.65it/s]
  0%|          | 1725/371472 [08:15<30:37:42,  3.35it/s]
  0%|          | 1726/371472 [08:15<31:44:40,  3.24it/s]
  0%|          | 1727/371472 [08:15<30:41:09,  3.35it/s]
  0%|          | 1728/371472 [08:16<30:39:12,  3.35it/s]
  0%|          | 1729/371472 [08:16<30:29:27,  3.37it/s]
  0%|          | 1730/371472 [08:16<31:48:11,  3.23it/s]
  0%|          | 1731/371472 [08:17<34:05:13,  3.01it/s]
  0%|          | 1732/371472 [08:17<31:59:27,  3.21it/s]
  0%|          | 1733/371472 [08:17<29:57:08,  3.43it/s]
  0%|          | 1734/371472 [08:17<29:30:42,  3.48it/s]
  0%|          | 1735/371472 [08:18<29:25:36,  3.49it/s]
  0%|          | 1736/371472 [08:18<29:31:36,  3.48it/s]
  0%|          | 1737/371472 [08:18<28:53:54,  3.55it/s]
  0%|          | 1738/371472 [08:19<28:42:09,  3.58it/s]
  0%|          | 1739/371472 [08:19<29:55:35,  3.43it/s]
  0%|          | 1740/371472 [08:19<31:02:21,  3.31it/s]
                                                        
{'loss': 5.7916, 'learning_rate': 9.96266887888125e-07, 'epoch': 0.07}

  0%|          | 1740/371472 [08:19<31:02:21,  3.31it/s]
  0%|          | 1741/371472 [08:19<30:12:37,  3.40it/s]
  0%|          | 1742/371472 [08:20<30:17:06,  3.39it/s]
  0%|          | 1743/371472 [08:20<28:54:25,  3.55it/s]
  0%|          | 1744/371472 [08:20<31:00:25,  3.31it/s]
  0%|          | 1745/371472 [08:21<30:32:37,  3.36it/s]
  0%|          | 1746/371472 [08:21<30:19:49,  3.39it/s]
  0%|          | 1747/371472 [08:21<30:13:28,  3.40it/s]
  0%|          | 1748/371472 [08:22<30:32:41,  3.36it/s]
  0%|          | 1749/371472 [08:22<29:49:55,  3.44it/s]
  0%|          | 1750/371472 [08:22<29:53:45,  3.44it/s]
  0%|          | 1751/371472 [08:22<28:35:14,  3.59it/s]
  0%|          | 1752/371472 [08:23<30:18:28,  3.39it/s]
  0%|          | 1753/371472 [08:23<30:33:55,  3.36it/s]
  0%|          | 1754/371472 [08:23<32:41:45,  3.14it/s]
  0%|          | 1755/371472 [08:24<32:10:40,  3.19it/s]
  0%|          | 1756/371472 [08:24<33:40:43,  3.05it/s]
  0%|          | 1757/371472 [08:24<31:38:49,  3.25it/s]
  0%|          | 1758/371472 [08:25<31:07:28,  3.30it/s]
  0%|          | 1759/371472 [08:25<32:32:21,  3.16it/s]
  0%|          | 1760/371472 [08:25<31:29:48,  3.26it/s]
                                                        
{'loss': 6.0412, 'learning_rate': 9.962184059126463e-07, 'epoch': 0.08}

  0%|          | 1760/371472 [08:25<31:29:48,  3.26it/s]
  0%|          | 1761/371472 [08:26<31:36:53,  3.25it/s]
  0%|          | 1762/371472 [08:26<31:56:34,  3.22it/s]
  0%|          | 1763/371472 [08:26<32:35:02,  3.15it/s]
  0%|          | 1764/371472 [08:27<34:38:14,  2.96it/s]
  0%|          | 1765/371472 [08:27<34:08:51,  3.01it/s]
  0%|          | 1766/371472 [08:27<32:46:21,  3.13it/s]
  0%|          | 1767/371472 [08:27<31:35:19,  3.25it/s]
  0%|          | 1768/371472 [08:28<29:43:49,  3.45it/s]
  0%|          | 1769/371472 [08:28<29:02:49,  3.54it/s]
  0%|          | 1770/371472 [08:28<28:38:52,  3.58it/s]
  0%|          | 1771/371472 [08:29<31:56:00,  3.22it/s]
  0%|          | 1772/371472 [08:29<31:32:16,  3.26it/s]
  0%|          | 1773/371472 [08:29<30:11:36,  3.40it/s]
  0%|          | 1774/371472 [08:29<29:27:17,  3.49it/s]
  0%|          | 1775/371472 [08:30<28:05:23,  3.66it/s]
  0%|          | 1776/371472 [08:30<28:10:20,  3.65it/s]
  0%|          | 1777/371472 [08:30<28:11:38,  3.64it/s]
  0%|          | 1778/371472 [08:31<27:10:53,  3.78it/s]
  0%|          | 1779/371472 [08:31<28:32:36,  3.60it/s]
  0%|          | 1780/371472 [08:31<28:59:36,  3.54it/s]
                                                        
{'loss': 6.0506, 'learning_rate': 9.961699239371674e-07, 'epoch': 0.08}

  0%|          | 1780/371472 [08:31<28:59:36,  3.54it/s]
  0%|          | 1781/371472 [08:31<28:34:55,  3.59it/s]
  0%|          | 1782/371472 [08:32<30:34:00,  3.36it/s]
  0%|          | 1783/371472 [08:32<29:05:21,  3.53it/s]
  0%|          | 1784/371472 [08:32<29:28:14,  3.48it/s]
  0%|          | 1785/371472 [08:33<29:13:21,  3.51it/s]
  0%|          | 1786/371472 [08:33<28:31:29,  3.60it/s]
  0%|          | 1787/371472 [08:33<28:27:27,  3.61it/s]
  0%|          | 1788/371472 [08:33<28:01:31,  3.66it/s]
  0%|          | 1789/371472 [08:34<28:32:11,  3.60it/s]
  0%|          | 1790/371472 [08:34<29:23:17,  3.49it/s]
  0%|          | 1791/371472 [08:34<28:39:38,  3.58it/s]
  0%|          | 1792/371472 [08:34<28:02:09,  3.66it/s]
  0%|          | 1793/371472 [08:35<27:40:33,  3.71it/s]
  0%|          | 1794/371472 [08:35<27:54:35,  3.68it/s]
  0%|          | 1795/371472 [08:35<28:57:16,  3.55it/s]
  0%|          | 1796/371472 [08:36<29:02:43,  3.54it/s]
  0%|          | 1797/371472 [08:36<29:11:29,  3.52it/s]
  0%|          | 1798/371472 [08:36<31:33:43,  3.25it/s]
  0%|          | 1799/371472 [08:36<29:59:49,  3.42it/s]
  0%|          | 1800/371472 [08:37<31:13:00,  3.29it/s]
                                                        
{'loss': 5.8769, 'learning_rate': 9.961214419616884e-07, 'epoch': 0.08}

  0%|          | 1800/371472 [08:37<31:13:00,  3.29it/s]
  0%|          | 1801/371472 [08:37<31:04:47,  3.30it/s]
  0%|          | 1802/371472 [08:37<30:42:15,  3.34it/s]
  0%|          | 1803/371472 [08:38<30:03:59,  3.42it/s]
  0%|          | 1804/371472 [08:38<28:25:03,  3.61it/s]
  0%|          | 1805/371472 [08:38<28:59:12,  3.54it/s]
  0%|          | 1806/371472 [08:39<28:37:32,  3.59it/s]
  0%|          | 1807/371472 [08:39<28:31:41,  3.60it/s]
  0%|          | 1808/371472 [08:39<28:22:16,  3.62it/s]
  0%|          | 1809/371472 [08:39<28:32:59,  3.60it/s]
  0%|          | 1810/371472 [08:40<27:57:39,  3.67it/s]
  0%|          | 1811/371472 [08:40<27:51:02,  3.69it/s]
  0%|          | 1812/371472 [08:40<30:49:37,  3.33it/s]
  0%|          | 1813/371472 [08:40<29:26:42,  3.49it/s]
  0%|          | 1814/371472 [08:41<29:11:36,  3.52it/s]
  0%|          | 1815/371472 [08:41<28:49:58,  3.56it/s]
  0%|          | 1816/371472 [08:41<31:29:17,  3.26it/s]
  0%|          | 1817/371472 [08:42<30:02:48,  3.42it/s]
  0%|          | 1818/371472 [08:42<31:38:38,  3.24it/s]
  0%|          | 1819/371472 [08:42<30:44:42,  3.34it/s]
  0%|          | 1820/371472 [08:43<31:23:40,  3.27it/s]
                                                        
{'loss': 5.7286, 'learning_rate': 9.960729599862095e-07, 'epoch': 0.08}

  0%|          | 1820/371472 [08:43<31:23:40,  3.27it/s]
  0%|          | 1821/371472 [08:43<30:29:31,  3.37it/s]
  0%|          | 1822/371472 [08:43<33:01:23,  3.11it/s]
  0%|          | 1823/371472 [08:44<31:36:09,  3.25it/s]
  0%|          | 1824/371472 [08:44<31:01:20,  3.31it/s]
  0%|          | 1825/371472 [08:44<30:06:40,  3.41it/s]
  0%|          | 1826/371472 [08:44<29:16:36,  3.51it/s]
  0%|          | 1827/371472 [08:45<28:18:52,  3.63it/s]
  0%|          | 1828/371472 [08:45<29:18:11,  3.50it/s]
  0%|          | 1829/371472 [08:45<29:46:31,  3.45it/s]
  0%|          | 1830/371472 [08:45<28:56:39,  3.55it/s]
  0%|          | 1831/371472 [08:46<28:26:55,  3.61it/s]
  0%|          | 1832/371472 [08:46<28:30:07,  3.60it/s]
  0%|          | 1833/371472 [08:46<28:51:43,  3.56it/s]
  0%|          | 1834/371472 [08:47<28:48:20,  3.56it/s]
  0%|          | 1835/371472 [08:47<28:33:30,  3.60it/s]
  0%|          | 1836/371472 [08:47<29:01:13,  3.54it/s]
  0%|          | 1837/371472 [08:47<28:44:19,  3.57it/s]
  0%|          | 1838/371472 [08:48<28:55:06,  3.55it/s]
  0%|          | 1839/371472 [08:48<29:12:47,  3.51it/s]
  0%|          | 1840/371472 [08:48<29:41:56,  3.46it/s]
                                                        
{'loss': 5.8717, 'learning_rate': 9.960244780107306e-07, 'epoch': 0.08}

  0%|          | 1840/371472 [08:48<29:41:56,  3.46it/s]
  0%|          | 1841/371472 [08:49<29:00:55,  3.54it/s]
  0%|          | 1842/371472 [08:49<28:52:24,  3.56it/s]
  0%|          | 1843/371472 [08:49<28:49:31,  3.56it/s]
  0%|          | 1844/371472 [08:49<28:45:20,  3.57it/s]
  0%|          | 1845/371472 [08:50<30:14:28,  3.40it/s]
  0%|          | 1846/371472 [08:50<30:24:28,  3.38it/s]
  0%|          | 1847/371472 [08:50<29:41:35,  3.46it/s]
  0%|          | 1848/371472 [08:51<29:01:37,  3.54it/s]
  0%|          | 1849/371472 [08:51<29:13:31,  3.51it/s]
  0%|          | 1850/371472 [08:51<31:10:37,  3.29it/s]
  0%|          | 1851/371472 [08:52<33:17:30,  3.08it/s]
  0%|          | 1852/371472 [08:52<32:59:56,  3.11it/s]
  0%|          | 1853/371472 [08:52<31:35:53,  3.25it/s]
  0%|          | 1854/371472 [08:52<31:27:37,  3.26it/s]
  0%|          | 1855/371472 [08:53<32:31:38,  3.16it/s]
  0%|          | 1856/371472 [08:53<33:21:44,  3.08it/s]
  0%|          | 1857/371472 [08:53<31:29:37,  3.26it/s]
  1%|          | 1858/371472 [08:54<30:30:49,  3.36it/s]
  1%|          | 1859/371472 [08:54<31:06:34,  3.30it/s]
  1%|          | 1860/371472 [08:54<31:56:44,  3.21it/s]
                                                        
{'loss': 5.7639, 'learning_rate': 9.959759960352519e-07, 'epoch': 0.08}

  1%|          | 1860/371472 [08:54<31:56:44,  3.21it/s]
  1%|          | 1861/371472 [08:55<30:34:34,  3.36it/s]
  1%|          | 1862/371472 [08:55<30:26:35,  3.37it/s]
  1%|          | 1863/371472 [08:55<29:24:13,  3.49it/s]
  1%|          | 1864/371472 [08:56<31:46:50,  3.23it/s]
  1%|          | 1865/371472 [08:56<30:37:05,  3.35it/s]
  1%|          | 1866/371472 [08:56<32:43:04,  3.14it/s]
  1%|          | 1867/371472 [08:56<31:50:18,  3.22it/s]
  1%|          | 1868/371472 [08:57<32:41:36,  3.14it/s]
  1%|          | 1869/371472 [08:57<32:02:33,  3.20it/s]
  1%|          | 1870/371472 [08:57<31:46:39,  3.23it/s]
  1%|          | 1871/371472 [08:58<30:56:13,  3.32it/s]
  1%|          | 1872/371472 [08:58<30:58:07,  3.32it/s]
  1%|          | 1873/371472 [08:58<30:41:11,  3.35it/s]
  1%|          | 1874/371472 [08:59<29:17:51,  3.50it/s]
  1%|          | 1875/371472 [08:59<31:22:25,  3.27it/s]
  1%|          | 1876/371472 [08:59<29:41:23,  3.46it/s]
  1%|          | 1877/371472 [08:59<28:15:23,  3.63it/s]
  1%|          | 1878/371472 [09:00<27:28:15,  3.74it/s]
  1%|          | 1879/371472 [09:00<27:28:09,  3.74it/s]
  1%|          | 1880/371472 [09:00<27:54:51,  3.68it/s]
                                                        
{'loss': 6.1518, 'learning_rate': 9.959275140597727e-07, 'epoch': 0.08}

  1%|          | 1880/371472 [09:00<27:54:51,  3.68it/s]
  1%|          | 1881/371472 [09:00<27:54:35,  3.68it/s]
  1%|          | 1882/371472 [09:01<27:33:01,  3.73it/s]
  1%|          | 1883/371472 [09:01<28:08:50,  3.65it/s]
  1%|          | 1884/371472 [09:01<28:17:31,  3.63it/s]
  1%|          | 1885/371472 [09:02<27:58:49,  3.67it/s]
  1%|          | 1886/371472 [09:02<27:53:09,  3.68it/s]
  1%|          | 1887/371472 [09:02<27:34:12,  3.72it/s]
  1%|          | 1888/371472 [09:02<28:01:53,  3.66it/s]
  1%|          | 1889/371472 [09:03<27:45:59,  3.70it/s]
  1%|          | 1890/371472 [09:03<27:39:53,  3.71it/s]
  1%|          | 1891/371472 [09:03<27:24:02,  3.75it/s]
  1%|          | 1892/371472 [09:03<27:38:54,  3.71it/s]
  1%|          | 1893/371472 [09:04<28:15:17,  3.63it/s]
  1%|          | 1894/371472 [09:04<28:32:20,  3.60it/s]
  1%|          | 1895/371472 [09:04<28:23:54,  3.61it/s]
  1%|          | 1896/371472 [09:05<29:49:50,  3.44it/s]
  1%|          | 1897/371472 [09:05<29:25:47,  3.49it/s]
  1%|          | 1898/371472 [09:05<30:53:48,  3.32it/s]
  1%|          | 1899/371472 [09:05<29:54:16,  3.43it/s]
  1%|          | 1900/371472 [09:06<28:39:35,  3.58it/s]
                                                        
{'loss': 5.8542, 'learning_rate': 9.95879032084294e-07, 'epoch': 0.08}

  1%|          | 1900/371472 [09:06<28:39:35,  3.58it/s]
  1%|          | 1901/371472 [09:06<29:21:35,  3.50it/s]
  1%|          | 1902/371472 [09:06<28:43:11,  3.57it/s]
  1%|          | 1903/371472 [09:07<34:41:09,  2.96it/s]
  1%|          | 1904/371472 [09:07<32:52:53,  3.12it/s]
  1%|          | 1905/371472 [09:07<32:51:27,  3.12it/s]
  1%|          | 1906/371472 [09:08<30:46:29,  3.34it/s]
  1%|          | 1907/371472 [09:08<29:11:30,  3.52it/s]
  1%|          | 1908/371472 [09:08<29:00:00,  3.54it/s]
  1%|          | 1909/371472 [09:08<28:22:05,  3.62it/s]
  1%|          | 1910/371472 [09:09<28:15:47,  3.63it/s]
  1%|          | 1911/371472 [09:09<27:57:02,  3.67it/s]
  1%|          | 1912/371472 [09:09<28:02:01,  3.66it/s]
  1%|          | 1913/371472 [09:10<28:36:16,  3.59it/s]
  1%|          | 1914/371472 [09:10<28:00:25,  3.67it/s]
  1%|          | 1915/371472 [09:10<27:20:05,  3.76it/s]
  1%|          | 1916/371472 [09:10<26:49:47,  3.83it/s]
  1%|          | 1917/371472 [09:11<27:26:43,  3.74it/s]
  1%|          | 1918/371472 [09:11<27:03:26,  3.79it/s]
  1%|          | 1919/371472 [09:11<26:52:41,  3.82it/s]
  1%|          | 1920/371472 [09:11<27:13:37,  3.77it/s]
                                                        
{'loss': 5.8854, 'learning_rate': 9.95830550108815e-07, 'epoch': 0.08}

  1%|          | 1920/371472 [09:11<27:13:37,  3.77it/s]
  1%|          | 1921/371472 [09:12<27:52:12,  3.68it/s]
  1%|          | 1922/371472 [09:12<35:08:55,  2.92it/s]
  1%|          | 1923/371472 [09:12<32:22:36,  3.17it/s]
  1%|          | 1924/371472 [09:13<31:23:44,  3.27it/s]
  1%|          | 1925/371472 [09:13<31:10:35,  3.29it/s]
  1%|          | 1926/371472 [09:13<30:09:18,  3.40it/s]
  1%|          | 1927/371472 [09:14<30:02:58,  3.42it/s]
  1%|          | 1928/371472 [09:14<29:06:15,  3.53it/s]
  1%|          | 1929/371472 [09:14<29:26:13,  3.49it/s]
  1%|          | 1930/371472 [09:14<28:25:14,  3.61it/s]
  1%|          | 1931/371472 [09:15<30:41:41,  3.34it/s]
  1%|          | 1932/371472 [09:15<30:06:47,  3.41it/s]
  1%|          | 1933/371472 [09:15<29:34:22,  3.47it/s]
  1%|          | 1934/371472 [09:16<28:25:33,  3.61it/s]
  1%|          | 1935/371472 [09:16<27:20:02,  3.76it/s]
  1%|          | 1936/371472 [09:16<29:31:49,  3.48it/s]
  1%|          | 1937/371472 [09:16<31:37:13,  3.25it/s]
  1%|          | 1938/371472 [09:17<30:51:47,  3.33it/s]
  1%|          | 1939/371472 [09:17<33:25:03,  3.07it/s]
  1%|          | 1940/371472 [09:17<32:12:06,  3.19it/s]
                                                        
{'loss': 5.6142, 'learning_rate': 9.957820681333361e-07, 'epoch': 0.08}

  1%|          | 1940/371472 [09:17<32:12:06,  3.19it/s]
  1%|          | 1941/371472 [09:18<30:13:44,  3.40it/s]
  1%|          | 1942/371472 [09:18<28:44:10,  3.57it/s]
  1%|          | 1943/371472 [09:18<28:36:36,  3.59it/s]
  1%|          | 1944/371472 [09:18<28:22:57,  3.62it/s]
  1%|          | 1945/371472 [09:19<29:58:56,  3.42it/s]
  1%|          | 1946/371472 [09:19<29:15:05,  3.51it/s]
  1%|          | 1947/371472 [09:19<28:07:12,  3.65it/s]
  1%|          | 1948/371472 [09:20<27:40:15,  3.71it/s]
  1%|          | 1949/371472 [09:20<28:06:54,  3.65it/s]
  1%|          | 1950/371472 [09:20<27:51:52,  3.68it/s]
  1%|          | 1951/371472 [09:20<29:05:40,  3.53it/s]
  1%|          | 1952/371472 [09:21<28:40:18,  3.58it/s]
  1%|          | 1953/371472 [09:21<28:37:25,  3.59it/s]
  1%|          | 1954/371472 [09:21<28:52:31,  3.55it/s]
  1%|          | 1955/371472 [09:22<28:21:27,  3.62it/s]
  1%|          | 1956/371472 [09:22<28:52:53,  3.55it/s]
  1%|          | 1957/371472 [09:22<28:04:29,  3.66it/s]
  1%|          | 1958/371472 [09:22<27:31:11,  3.73it/s]
  1%|          | 1959/371472 [09:23<27:06:31,  3.79it/s]
  1%|          | 1960/371472 [09:23<27:01:53,  3.80it/s]
                                                        
{'loss': 5.9447, 'learning_rate': 9.957335861578572e-07, 'epoch': 0.08}

  1%|          | 1960/371472 [09:23<27:01:53,  3.80it/s]
  1%|          | 1961/371472 [09:23<27:02:50,  3.79it/s]
  1%|          | 1962/371472 [09:23<28:36:40,  3.59it/s]
  1%|          | 1963/371472 [09:24<29:51:27,  3.44it/s]
  1%|          | 1964/371472 [09:24<29:36:54,  3.47it/s]
  1%|          | 1965/371472 [09:24<32:16:08,  3.18it/s]
  1%|          | 1966/371472 [09:25<30:28:44,  3.37it/s]
  1%|          | 1967/371472 [09:25<29:36:33,  3.47it/s]
  1%|          | 1968/371472 [09:25<30:01:11,  3.42it/s]
  1%|          | 1969/371472 [09:25<29:01:20,  3.54it/s]
  1%|          | 1970/371472 [09:26<28:30:12,  3.60it/s]
  1%|          | 1971/371472 [09:26<28:04:25,  3.66it/s]
  1%|          | 1972/371472 [09:26<28:17:40,  3.63it/s]
  1%|          | 1973/371472 [09:27<29:29:22,  3.48it/s]
  1%|          | 1974/371472 [09:27<29:03:37,  3.53it/s]
  1%|          | 1975/371472 [09:27<29:28:23,  3.48it/s]
  1%|          | 1976/371472 [09:28<31:39:44,  3.24it/s]
  1%|          | 1977/371472 [09:28<31:01:51,  3.31it/s]
  1%|          | 1978/371472 [09:28<29:39:30,  3.46it/s]
  1%|          | 1979/371472 [09:28<30:02:24,  3.42it/s]
  1%|          | 1980/371472 [09:29<30:44:08,  3.34it/s]
                                                        
{'loss': 5.7814, 'learning_rate': 9.956851041823783e-07, 'epoch': 0.09}

  1%|          | 1980/371472 [09:29<30:44:08,  3.34it/s]
  1%|          | 1981/371472 [09:29<29:42:51,  3.45it/s]
  1%|          | 1982/371472 [09:29<31:33:58,  3.25it/s]
  1%|          | 1983/371472 [09:30<30:35:19,  3.36it/s]
  1%|          | 1984/371472 [09:30<29:29:09,  3.48it/s]
  1%|          | 1985/371472 [09:30<30:05:45,  3.41it/s]
  1%|          | 1986/371472 [09:30<28:49:59,  3.56it/s]
  1%|          | 1987/371472 [09:31<28:37:49,  3.58it/s]
  1%|          | 1988/371472 [09:31<27:16:20,  3.76it/s]
  1%|          | 1989/371472 [09:31<28:03:37,  3.66it/s]
  1%|          | 1990/371472 [09:31<27:15:37,  3.76it/s]
  1%|          | 1991/371472 [09:32<27:21:42,  3.75it/s]
  1%|          | 1992/371472 [09:32<30:56:07,  3.32it/s]
  1%|          | 1993/371472 [09:33<35:50:42,  2.86it/s]
  1%|          | 1994/371472 [09:33<33:59:54,  3.02it/s]
  1%|          | 1995/371472 [09:33<31:32:36,  3.25it/s]
  1%|          | 1996/371472 [09:33<30:33:52,  3.36it/s]
  1%|          | 1997/371472 [09:34<29:58:19,  3.42it/s]
  1%|          | 1998/371472 [09:34<29:01:29,  3.54it/s]
  1%|          | 1999/371472 [09:34<28:33:01,  3.59it/s]
  1%|          | 2000/371472 [09:34<28:16:37,  3.63it/s]
                                                        
{'loss': 5.7888, 'learning_rate': 9.956366222068996e-07, 'epoch': 0.09}

  1%|          | 2000/371472 [09:34<28:16:37,  3.63it/s]
  1%|          | 2001/371472 [09:35<28:17:20,  3.63it/s]
  1%|          | 2002/371472 [09:35<30:02:51,  3.42it/s]
  1%|          | 2003/371472 [09:35<28:58:52,  3.54it/s]
  1%|          | 2004/371472 [09:36<28:39:51,  3.58it/s]
  1%|          | 2005/371472 [09:36<28:05:26,  3.65it/s]
  1%|          | 2006/371472 [09:36<27:38:38,  3.71it/s]
  1%|          | 2007/371472 [09:36<27:38:30,  3.71it/s]
  1%|          | 2008/371472 [09:37<27:10:31,  3.78it/s]
  1%|          | 2009/371472 [09:37<27:54:26,  3.68it/s]
  1%|          | 2010/371472 [09:37<27:30:34,  3.73it/s]
  1%|          | 2011/371472 [09:37<28:32:54,  3.59it/s]
  1%|          | 2012/371472 [09:38<29:56:54,  3.43it/s]
  1%|          | 2013/371472 [09:38<29:36:33,  3.47it/s]
  1%|          | 2014/371472 [09:38<29:10:08,  3.52it/s]
  1%|          | 2015/371472 [09:39<33:26:18,  3.07it/s]
  1%|          | 2016/371472 [09:39<31:42:51,  3.24it/s]
  1%|          | 2017/371472 [09:39<30:59:31,  3.31it/s]
  1%|          | 2018/371472 [09:40<30:12:36,  3.40it/s]
  1%|          | 2019/371472 [09:40<29:54:59,  3.43it/s]
  1%|          | 2020/371472 [09:40<29:03:32,  3.53it/s]
                                                        
{'loss': 5.6126, 'learning_rate': 9.955881402314206e-07, 'epoch': 0.09}

  1%|          | 2020/371472 [09:40<29:03:32,  3.53it/s]
  1%|          | 2021/371472 [09:40<27:50:22,  3.69it/s]
  1%|          | 2022/371472 [09:41<28:23:19,  3.61it/s]
  1%|          | 2023/371472 [09:41<27:37:03,  3.72it/s]
  1%|          | 2024/371472 [09:41<27:28:19,  3.74it/s]
  1%|          | 2025/371472 [09:41<26:57:58,  3.81it/s]
  1%|          | 2026/371472 [09:42<27:27:29,  3.74it/s]
  1%|          | 2027/371472 [09:42<27:54:41,  3.68it/s]
  1%|          | 2028/371472 [09:42<28:19:22,  3.62it/s]
  1%|          | 2029/371472 [09:43<28:26:10,  3.61it/s]
  1%|          | 2030/371472 [09:43<30:32:10,  3.36it/s]
  1%|          | 2031/371472 [09:43<29:58:06,  3.42it/s]
  1%|          | 2032/371472 [09:43<28:37:14,  3.59it/s]
  1%|          | 2033/371472 [09:44<28:13:02,  3.64it/s]
  1%|          | 2034/371472 [09:44<27:57:23,  3.67it/s]
  1%|          | 2035/371472 [09:44<28:22:53,  3.62it/s]
  1%|          | 2036/371472 [09:45<27:41:40,  3.71it/s]
  1%|          | 2037/371472 [09:45<27:10:43,  3.78it/s]
  1%|          | 2038/371472 [09:45<27:28:04,  3.74it/s]
  1%|          | 2039/371472 [09:45<28:17:49,  3.63it/s]
  1%|          | 2040/371472 [09:46<27:48:36,  3.69it/s]
                                                        
{'loss': 5.6853, 'learning_rate': 9.955396582559417e-07, 'epoch': 0.09}

  1%|          | 2040/371472 [09:46<27:48:36,  3.69it/s]
  1%|          | 2041/371472 [09:46<28:42:17,  3.57it/s]
  1%|          | 2042/371472 [09:46<31:54:08,  3.22it/s]
  1%|          | 2043/371472 [09:47<29:56:58,  3.43it/s]
  1%|          | 2044/371472 [09:47<29:50:24,  3.44it/s]
  1%|          | 2045/371472 [09:47<30:52:15,  3.32it/s]
  1%|          | 2046/371472 [09:47<31:43:13,  3.24it/s]
  1%|          | 2047/371472 [09:48<30:50:53,  3.33it/s]
  1%|          | 2048/371472 [09:48<29:39:09,  3.46it/s]
  1%|          | 2049/371472 [09:48<29:19:29,  3.50it/s]
  1%|          | 2050/371472 [09:49<28:25:05,  3.61it/s]
  1%|          | 2051/371472 [09:49<28:22:23,  3.62it/s]
  1%|          | 2052/371472 [09:49<29:19:49,  3.50it/s]
  1%|          | 2053/371472 [09:50<33:06:57,  3.10it/s]
  1%|          | 2054/371472 [09:50<32:25:54,  3.16it/s]
  1%|          | 2055/371472 [09:50<31:13:53,  3.29it/s]
  1%|          | 2056/371472 [09:50<30:54:45,  3.32it/s]
  1%|          | 2057/371472 [09:51<29:25:09,  3.49it/s]
  1%|          | 2058/371472 [09:51<28:57:30,  3.54it/s]
  1%|          | 2059/371472 [09:51<30:06:48,  3.41it/s]
  1%|          | 2060/371472 [09:52<29:20:28,  3.50it/s]
                                                        
{'loss': 5.7188, 'learning_rate': 9.954911762804628e-07, 'epoch': 0.09}

  1%|          | 2060/371472 [09:52<29:20:28,  3.50it/s]
  1%|          | 2061/371472 [09:52<29:23:40,  3.49it/s]
  1%|          | 2062/371472 [09:52<29:23:07,  3.49it/s]
  1%|          | 2063/371472 [09:52<28:42:34,  3.57it/s]
  1%|          | 2064/371472 [09:53<28:44:23,  3.57it/s]
  1%|          | 2065/371472 [09:53<28:11:42,  3.64it/s]
  1%|          | 2066/371472 [09:53<30:26:41,  3.37it/s]
  1%|          | 2067/371472 [09:54<30:02:08,  3.42it/s]
  1%|          | 2068/371472 [09:54<28:50:03,  3.56it/s]
  1%|          | 2069/371472 [09:54<28:58:33,  3.54it/s]
  1%|          | 2070/371472 [09:54<29:21:57,  3.49it/s]
  1%|          | 2071/371472 [09:55<28:54:28,  3.55it/s]
  1%|          | 2072/371472 [09:55<28:29:22,  3.60it/s]
  1%|          | 2073/371472 [09:55<27:53:28,  3.68it/s]
  1%|          | 2074/371472 [09:55<27:26:51,  3.74it/s]
  1%|          | 2075/371472 [09:56<27:11:37,  3.77it/s]
  1%|          | 2076/371472 [09:56<27:13:07,  3.77it/s]
  1%|          | 2077/371472 [09:56<27:55:22,  3.67it/s]
  1%|          | 2078/371472 [09:57<27:52:15,  3.68it/s]
  1%|          | 2079/371472 [09:57<27:24:11,  3.74it/s]
  1%|          | 2080/371472 [09:57<26:48:15,  3.83it/s]
                                                        
{'loss': 5.8168, 'learning_rate': 9.954426943049839e-07, 'epoch': 0.09}

  1%|          | 2080/371472 [09:57<26:48:15,  3.83it/s]
  1%|          | 2081/371472 [09:57<28:02:26,  3.66it/s]
  1%|          | 2082/371472 [09:58<29:43:08,  3.45it/s]
  1%|          | 2083/371472 [09:58<30:08:25,  3.40it/s]
  1%|          | 2084/371472 [09:58<29:27:25,  3.48it/s]
  1%|          | 2085/371472 [09:59<30:27:49,  3.37it/s]
  1%|          | 2086/371472 [09:59<29:53:03,  3.43it/s]
  1%|          | 2087/371472 [09:59<28:36:37,  3.59it/s]
  1%|          | 2088/371472 [09:59<27:39:37,  3.71it/s]
  1%|          | 2089/371472 [10:00<28:34:42,  3.59it/s]
  1%|          | 2090/371472 [10:00<29:31:31,  3.48it/s]
  1%|          | 2091/371472 [10:00<29:30:08,  3.48it/s]
  1%|          | 2092/371472 [10:01<31:17:26,  3.28it/s]
  1%|          | 2093/371472 [10:01<30:40:11,  3.35it/s]
  1%|          | 2094/371472 [10:01<29:13:08,  3.51it/s]
  1%|          | 2095/371472 [10:01<27:54:04,  3.68it/s]
  1%|          | 2096/371472 [10:02<28:34:55,  3.59it/s]
  1%|          | 2097/371472 [10:02<29:17:23,  3.50it/s]
  1%|          | 2098/371472 [10:02<29:09:55,  3.52it/s]
  1%|          | 2099/371472 [10:03<32:16:06,  3.18it/s]
  1%|          | 2100/371472 [10:03<31:32:22,  3.25it/s]
                                                        
{'loss': 5.5472, 'learning_rate': 9.953942123295051e-07, 'epoch': 0.09}

  1%|          | 2100/371472 [10:03<31:32:22,  3.25it/s]
  1%|          | 2101/371472 [10:03<32:00:33,  3.21it/s]
  1%|          | 2102/371472 [10:04<32:31:08,  3.16it/s]
  1%|          | 2103/371472 [10:04<33:51:46,  3.03it/s]
  1%|          | 2104/371472 [10:04<32:45:07,  3.13it/s]
  1%|          | 2105/371472 [10:04<30:48:05,  3.33it/s]
  1%|          | 2106/371472 [10:05<34:04:41,  3.01it/s]
  1%|          | 2107/371472 [10:05<32:12:54,  3.18it/s]
  1%|          | 2108/371472 [10:05<31:25:42,  3.26it/s]
  1%|          | 2109/371472 [10:06<30:08:06,  3.40it/s]
  1%|          | 2110/371472 [10:06<29:24:53,  3.49it/s]
  1%|          | 2111/371472 [10:06<28:43:16,  3.57it/s]
  1%|          | 2112/371472 [10:07<30:36:58,  3.35it/s]
  1%|          | 2113/371472 [10:07<30:35:56,  3.35it/s]
  1%|          | 2114/371472 [10:07<32:17:15,  3.18it/s]
  1%|          | 2115/371472 [10:08<31:14:03,  3.28it/s]
  1%|          | 2116/371472 [10:08<29:39:39,  3.46it/s]
  1%|          | 2117/371472 [10:08<30:38:28,  3.35it/s]
  1%|          | 2118/371472 [10:08<33:30:58,  3.06it/s]
  1%|          | 2119/371472 [10:09<31:11:29,  3.29it/s]
  1%|          | 2120/371472 [10:09<30:39:11,  3.35it/s]
                                                        
{'loss': 5.5835, 'learning_rate': 9.95345730354026e-07, 'epoch': 0.09}

  1%|          | 2120/371472 [10:09<30:39:11,  3.35it/s]
  1%|          | 2121/371472 [10:09<29:18:47,  3.50it/s]
  1%|          | 2122/371472 [10:10<29:28:20,  3.48it/s]
  1%|          | 2123/371472 [10:10<30:03:10,  3.41it/s]
  1%|          | 2124/371472 [10:10<28:43:51,  3.57it/s]
  1%|          | 2125/371472 [10:10<28:49:55,  3.56it/s]
  1%|          | 2126/371472 [10:11<28:45:48,  3.57it/s]
  1%|          | 2127/371472 [10:11<31:08:20,  3.29it/s]
  1%|          | 2128/371472 [10:11<31:08:27,  3.29it/s]
  1%|          | 2129/371472 [10:12<29:46:13,  3.45it/s]
  1%|          | 2130/371472 [10:12<33:43:59,  3.04it/s]
  1%|          | 2131/371472 [10:12<31:49:48,  3.22it/s]
  1%|          | 2132/371472 [10:13<30:17:24,  3.39it/s]
  1%|          | 2133/371472 [10:13<29:24:01,  3.49it/s]
  1%|          | 2134/371472 [10:13<28:46:11,  3.57it/s]
  1%|          | 2135/371472 [10:13<28:18:24,  3.62it/s]
  1%|          | 2136/371472 [10:14<28:09:34,  3.64it/s]
  1%|          | 2137/371472 [10:14<28:17:30,  3.63it/s]
  1%|          | 2138/371472 [10:14<27:57:38,  3.67it/s]
  1%|          | 2139/371472 [10:14<27:47:22,  3.69it/s]
  1%|          | 2140/371472 [10:15<27:50:22,  3.69it/s]
                                                        
{'loss': 5.9346, 'learning_rate': 9.952972483785473e-07, 'epoch': 0.09}

  1%|          | 2140/371472 [10:15<27:50:22,  3.69it/s]
  1%|          | 2141/371472 [10:15<28:02:37,  3.66it/s]
  1%|          | 2142/371472 [10:15<27:29:51,  3.73it/s]
  1%|          | 2143/371472 [10:15<26:50:43,  3.82it/s]
  1%|          | 2144/371472 [10:16<28:11:25,  3.64it/s]
  1%|          | 2145/371472 [10:16<28:55:32,  3.55it/s]
  1%|          | 2146/371472 [10:16<28:37:05,  3.58it/s]
  1%|          | 2147/371472 [10:17<28:56:16,  3.55it/s]
  1%|          | 2148/371472 [10:17<28:00:06,  3.66it/s]
  1%|          | 2149/371472 [10:17<27:51:17,  3.68it/s]
  1%|          | 2150/371472 [10:17<27:18:26,  3.76it/s]
  1%|          | 2151/371472 [10:18<27:21:29,  3.75it/s]
  1%|          | 2152/371472 [10:18<29:00:24,  3.54it/s]
  1%|          | 2153/371472 [10:18<29:05:46,  3.53it/s]
  1%|          | 2154/371472 [10:19<29:05:40,  3.53it/s]
  1%|          | 2155/371472 [10:19<29:28:07,  3.48it/s]
  1%|          | 2156/371472 [10:19<28:41:36,  3.58it/s]
  1%|          | 2157/371472 [10:19<27:39:24,  3.71it/s]
  1%|          | 2158/371472 [10:20<27:49:06,  3.69it/s]
  1%|          | 2159/371472 [10:20<28:30:54,  3.60it/s]
  1%|          | 2160/371472 [10:20<28:02:35,  3.66it/s]
                                                        
{'loss': 5.9372, 'learning_rate': 9.952487664030683e-07, 'epoch': 0.09}

  1%|          | 2160/371472 [10:20<28:02:35,  3.66it/s]
  1%|          | 2161/371472 [10:20<27:22:09,  3.75it/s]
  1%|          | 2162/371472 [10:21<28:07:17,  3.65it/s]
  1%|          | 2163/371472 [10:21<28:09:05,  3.64it/s]
  1%|          | 2164/371472 [10:21<29:26:33,  3.48it/s]
  1%|          | 2165/371472 [10:22<33:53:23,  3.03it/s]
  1%|          | 2166/371472 [10:22<32:38:47,  3.14it/s]
  1%|          | 2167/371472 [10:22<31:20:23,  3.27it/s]
  1%|          | 2168/371472 [10:23<30:07:01,  3.41it/s]
  1%|          | 2169/371472 [10:23<28:58:58,  3.54it/s]
  1%|          | 2170/371472 [10:23<29:13:58,  3.51it/s]
  1%|          | 2171/371472 [10:23<30:20:30,  3.38it/s]
  1%|          | 2172/371472 [10:24<30:23:31,  3.38it/s]
  1%|          | 2173/371472 [10:24<30:38:44,  3.35it/s]
  1%|          | 2174/371472 [10:24<29:31:55,  3.47it/s]
  1%|          | 2175/371472 [10:25<31:40:01,  3.24it/s]
  1%|          | 2176/371472 [10:25<30:48:45,  3.33it/s]
  1%|          | 2177/371472 [10:25<30:50:56,  3.33it/s]
  1%|          | 2178/371472 [10:26<29:25:14,  3.49it/s]
  1%|          | 2179/371472 [10:26<29:29:44,  3.48it/s]
  1%|          | 2180/371472 [10:26<28:45:31,  3.57it/s]
                                                        
{'loss': 6.0861, 'learning_rate': 9.952002844275894e-07, 'epoch': 0.09}

  1%|          | 2180/371472 [10:26<28:45:31,  3.57it/s]
  1%|          | 2181/371472 [10:26<28:47:17,  3.56it/s]
  1%|          | 2182/371472 [10:27<28:44:03,  3.57it/s]
  1%|          | 2183/371472 [10:27<28:52:17,  3.55it/s]
  1%|          | 2184/371472 [10:27<28:02:28,  3.66it/s]
  1%|          | 2185/371472 [10:27<27:58:38,  3.67it/s]
  1%|          | 2186/371472 [10:28<27:26:03,  3.74it/s]
  1%|          | 2187/371472 [10:28<28:33:10,  3.59it/s]
  1%|          | 2188/371472 [10:28<30:25:43,  3.37it/s]
  1%|          | 2189/371472 [10:29<31:10:50,  3.29it/s]
  1%|          | 2190/371472 [10:29<29:35:31,  3.47it/s]
  1%|          | 2191/371472 [10:29<29:28:12,  3.48it/s]
  1%|          | 2192/371472 [10:29<28:59:20,  3.54it/s]
  1%|          | 2193/371472 [10:30<29:15:17,  3.51it/s]
  1%|          | 2194/371472 [10:30<28:19:01,  3.62it/s]
  1%|          | 2195/371472 [10:30<27:55:25,  3.67it/s]
  1%|          | 2196/371472 [10:31<27:37:50,  3.71it/s]
  1%|          | 2197/371472 [10:31<30:00:37,  3.42it/s]
  1%|          | 2198/371472 [10:31<29:43:39,  3.45it/s]
  1%|          | 2199/371472 [10:31<29:58:49,  3.42it/s]
  1%|          | 2200/371472 [10:32<29:38:04,  3.46it/s]
                                                        
{'loss': 5.7357, 'learning_rate': 9.951518024521105e-07, 'epoch': 0.09}

  1%|          | 2200/371472 [10:32<29:38:04,  3.46it/s]
  1%|          | 2201/371472 [10:32<29:02:12,  3.53it/s]
  1%|          | 2202/371472 [10:32<28:42:58,  3.57it/s]
  1%|          | 2203/371472 [10:33<28:10:26,  3.64it/s]
  1%|          | 2204/371472 [10:33<28:51:14,  3.55it/s]
  1%|          | 2205/371472 [10:33<28:09:49,  3.64it/s]
  1%|          | 2206/371472 [10:33<29:05:51,  3.53it/s]
  1%|          | 2207/371472 [10:34<27:49:36,  3.69it/s]
  1%|          | 2208/371472 [10:34<27:33:19,  3.72it/s]
  1%|          | 2209/371472 [10:34<28:07:23,  3.65it/s]
  1%|          | 2210/371472 [10:34<27:32:03,  3.73it/s]
  1%|          | 2211/371472 [10:35<27:55:16,  3.67it/s]
  1%|          | 2212/371472 [10:35<27:39:18,  3.71it/s]
  1%|          | 2213/371472 [10:35<27:17:43,  3.76it/s]
  1%|          | 2214/371472 [10:36<27:33:42,  3.72it/s]
  1%|          | 2215/371472 [10:36<27:16:39,  3.76it/s]
  1%|          | 2216/371472 [10:36<27:08:03,  3.78it/s]
  1%|          | 2217/371472 [10:36<26:33:33,  3.86it/s]
  1%|          | 2218/371472 [10:37<26:54:16,  3.81it/s]
  1%|          | 2219/371472 [10:37<26:53:26,  3.81it/s]
  1%|          | 2220/371472 [10:37<29:10:35,  3.52it/s]
                                                        
{'loss': 5.9574, 'learning_rate': 9.951033204766316e-07, 'epoch': 0.1}

  1%|          | 2220/371472 [10:37<29:10:35,  3.52it/s]
  1%|          | 2221/371472 [10:37<28:33:46,  3.59it/s]
  1%|          | 2222/371472 [10:38<27:47:50,  3.69it/s]
  1%|          | 2223/371472 [10:38<27:10:44,  3.77it/s]
  1%|          | 2224/371472 [10:38<27:26:50,  3.74it/s]
  1%|          | 2225/371472 [10:38<26:51:16,  3.82it/s]
  1%|          | 2226/371472 [10:39<27:35:28,  3.72it/s]
  1%|          | 2227/371472 [10:39<27:25:39,  3.74it/s]
  1%|          | 2228/371472 [10:39<28:30:08,  3.60it/s]
  1%|          | 2229/371472 [10:40<27:43:51,  3.70it/s]
  1%|          | 2230/371472 [10:40<30:31:08,  3.36it/s]
  1%|          | 2231/371472 [10:40<29:19:43,  3.50it/s]
  1%|          | 2232/371472 [10:40<29:04:53,  3.53it/s]
  1%|          | 2233/371472 [10:41<30:44:22,  3.34it/s]
  1%|          | 2234/371472 [10:41<31:54:25,  3.21it/s]
  1%|          | 2235/371472 [10:42<34:06:57,  3.01it/s]
  1%|          | 2236/371472 [10:42<32:53:14,  3.12it/s]
  1%|          | 2237/371472 [10:42<30:40:36,  3.34it/s]
  1%|          | 2238/371472 [10:42<30:30:59,  3.36it/s]
  1%|          | 2239/371472 [10:43<29:27:21,  3.48it/s]
  1%|          | 2240/371472 [10:43<29:26:54,  3.48it/s]
                                                        
{'loss': 5.6279, 'learning_rate': 9.950548385011528e-07, 'epoch': 0.1}

  1%|          | 2240/371472 [10:43<29:26:54,  3.48it/s]
  1%|          | 2241/371472 [10:43<29:30:59,  3.47it/s]
  1%|          | 2242/371472 [10:44<31:05:32,  3.30it/s]
  1%|          | 2243/371472 [10:44<30:30:15,  3.36it/s]
  1%|          | 2244/371472 [10:44<28:43:31,  3.57it/s]
  1%|          | 2245/371472 [10:44<27:51:18,  3.68it/s]
  1%|          | 2246/371472 [10:45<27:59:21,  3.66it/s]
  1%|          | 2247/371472 [10:45<28:04:20,  3.65it/s]
  1%|          | 2248/371472 [10:45<29:20:17,  3.50it/s]
  1%|          | 2249/371472 [10:45<29:51:17,  3.44it/s]
  1%|          | 2250/371472 [10:46<28:39:55,  3.58it/s]
  1%|          | 2251/371472 [10:46<27:39:39,  3.71it/s]
  1%|          | 2252/371472 [10:46<27:16:29,  3.76it/s]
  1%|          | 2253/371472 [10:47<27:25:44,  3.74it/s]
  1%|          | 2254/371472 [10:47<27:39:40,  3.71it/s]
  1%|          | 2255/371472 [10:47<28:45:34,  3.57it/s]
  1%|          | 2256/371472 [10:47<28:08:00,  3.65it/s]
  1%|          | 2257/371472 [10:48<27:34:36,  3.72it/s]
  1%|          | 2258/371472 [10:48<27:18:39,  3.76it/s]
  1%|          | 2259/371472 [10:48<27:32:29,  3.72it/s]
  1%|          | 2260/371472 [10:48<27:44:08,  3.70it/s]
                                                        
{'loss': 5.8369, 'learning_rate': 9.95006356525674e-07, 'epoch': 0.1}

  1%|          | 2260/371472 [10:48<27:44:08,  3.70it/s]
  1%|          | 2261/371472 [10:49<27:49:53,  3.68it/s]
  1%|          | 2262/371472 [10:49<26:59:45,  3.80it/s]
  1%|          | 2263/371472 [10:49<27:15:39,  3.76it/s]
  1%|          | 2264/371472 [10:49<27:28:03,  3.73it/s]
  1%|          | 2265/371472 [10:50<29:13:47,  3.51it/s]
  1%|          | 2266/371472 [10:50<30:05:40,  3.41it/s]
  1%|          | 2267/371472 [10:50<29:49:44,  3.44it/s]
  1%|          | 2268/371472 [10:51<30:58:07,  3.31it/s]
  1%|          | 2269/371472 [10:51<31:05:39,  3.30it/s]
  1%|          | 2270/371472 [10:51<30:11:11,  3.40it/s]
  1%|          | 2271/371472 [10:52<30:22:23,  3.38it/s]
  1%|          | 2272/371472 [10:52<31:20:52,  3.27it/s]
  1%|          | 2273/371472 [10:52<29:49:10,  3.44it/s]
  1%|          | 2274/371472 [10:53<30:59:39,  3.31it/s]
  1%|          | 2275/371472 [10:53<30:47:26,  3.33it/s]
  1%|          | 2276/371472 [10:53<30:33:57,  3.36it/s]
  1%|          | 2277/371472 [10:53<31:23:45,  3.27it/s]
  1%|          | 2278/371472 [10:54<30:56:48,  3.31it/s]
  1%|          | 2279/371472 [10:54<29:11:24,  3.51it/s]
  1%|          | 2280/371472 [10:54<29:23:50,  3.49it/s]
                                                        
{'loss': 5.7718, 'learning_rate': 9.94957874550195e-07, 'epoch': 0.1}

  1%|          | 2280/371472 [10:54<29:23:50,  3.49it/s]
  1%|          | 2281/371472 [10:55<29:08:56,  3.52it/s]
  1%|          | 2282/371472 [10:55<28:34:36,  3.59it/s]
  1%|          | 2283/371472 [10:55<27:55:45,  3.67it/s]
  1%|          | 2284/371472 [10:55<30:02:02,  3.41it/s]
  1%|          | 2285/371472 [10:56<32:59:21,  3.11it/s]
  1%|          | 2286/371472 [10:56<31:03:00,  3.30it/s]
  1%|          | 2287/371472 [10:56<34:13:35,  3.00it/s]
  1%|          | 2288/371472 [10:57<31:30:48,  3.25it/s]
  1%|          | 2289/371472 [10:57<30:28:25,  3.37it/s]
  1%|          | 2290/371472 [10:57<29:43:58,  3.45it/s]
  1%|          | 2291/371472 [10:58<29:48:43,  3.44it/s]
  1%|          | 2292/371472 [10:58<29:36:20,  3.46it/s]
  1%|          | 2293/371472 [10:58<30:17:47,  3.38it/s]
  1%|          | 2294/371472 [10:58<28:55:36,  3.55it/s]
  1%|          | 2295/371472 [10:59<27:47:55,  3.69it/s]
  1%|          | 2296/371472 [10:59<28:10:04,  3.64it/s]
  1%|          | 2297/371472 [10:59<29:27:04,  3.48it/s]
  1%|          | 2298/371472 [11:00<28:44:12,  3.57it/s]
  1%|          | 2299/371472 [11:00<27:38:03,  3.71it/s]
  1%|          | 2300/371472 [11:00<26:49:32,  3.82it/s]
                                                        
{'loss': 5.8574, 'learning_rate': 9.94909392574716e-07, 'epoch': 0.1}

  1%|          | 2300/371472 [11:00<26:49:32,  3.82it/s]
  1%|          | 2301/371472 [11:00<28:31:08,  3.60it/s]
  1%|          | 2302/371472 [11:01<28:58:13,  3.54it/s]
  1%|          | 2303/371472 [11:01<29:30:13,  3.48it/s]
  1%|          | 2304/371472 [11:01<30:51:55,  3.32it/s]
  1%|          | 2305/371472 [11:01<29:13:04,  3.51it/s]
  1%|          | 2306/371472 [11:02<29:08:15,  3.52it/s]
  1%|          | 2307/371472 [11:02<28:47:41,  3.56it/s]
  1%|          | 2308/371472 [11:02<28:40:59,  3.58it/s]
  1%|          | 2309/371472 [11:03<30:20:29,  3.38it/s]
  1%|          | 2310/371472 [11:03<29:41:49,  3.45it/s]
  1%|          | 2311/371472 [11:03<29:15:14,  3.51it/s]
  1%|          | 2312/371472 [11:04<30:27:27,  3.37it/s]
  1%|          | 2313/371472 [11:04<31:28:59,  3.26it/s]
  1%|          | 2314/371472 [11:04<30:28:22,  3.37it/s]
  1%|          | 2315/371472 [11:04<30:10:58,  3.40it/s]
  1%|          | 2316/371472 [11:05<29:41:36,  3.45it/s]
  1%|          | 2317/371472 [11:05<29:32:37,  3.47it/s]
  1%|          | 2318/371472 [11:05<29:02:30,  3.53it/s]
  1%|          | 2319/371472 [11:06<28:09:00,  3.64it/s]
  1%|          | 2320/371472 [11:06<28:08:01,  3.64it/s]
                                                        
{'loss': 5.5917, 'learning_rate': 9.948609105992371e-07, 'epoch': 0.1}

  1%|          | 2320/371472 [11:06<28:08:01,  3.64it/s]
  1%|          | 2321/371472 [11:06<28:45:18,  3.57it/s]
  1%|          | 2322/371472 [11:06<28:14:07,  3.63it/s]
  1%|          | 2323/371472 [11:07<31:12:33,  3.29it/s]
  1%|          | 2324/371472 [11:07<29:33:42,  3.47it/s]
  1%|          | 2325/371472 [11:07<28:00:08,  3.66it/s]
  1%|          | 2326/371472 [11:07<27:42:24,  3.70it/s]
  1%|          | 2327/371472 [11:08<28:05:13,  3.65it/s]
  1%|          | 2328/371472 [11:08<28:01:11,  3.66it/s]
  1%|          | 2329/371472 [11:08<29:06:11,  3.52it/s]
  1%|          | 2330/371472 [11:09<30:26:37,  3.37it/s]
  1%|          | 2331/371472 [11:09<29:18:54,  3.50it/s]
  1%|          | 2332/371472 [11:09<29:43:03,  3.45it/s]
  1%|          | 2333/371472 [11:10<31:35:04,  3.25it/s]
  1%|          | 2334/371472 [11:10<30:06:22,  3.41it/s]
  1%|          | 2335/371472 [11:10<29:08:24,  3.52it/s]
  1%|          | 2336/371472 [11:10<28:06:04,  3.65it/s]
  1%|          | 2337/371472 [11:11<29:01:01,  3.53it/s]
  1%|          | 2338/371472 [11:11<29:49:49,  3.44it/s]
  1%|          | 2339/371472 [11:11<30:38:48,  3.35it/s]
  1%|          | 2340/371472 [11:12<29:57:27,  3.42it/s]
                                                        
{'loss': 5.573, 'learning_rate': 9.948124286237584e-07, 'epoch': 0.1}

  1%|          | 2340/371472 [11:12<29:57:27,  3.42it/s]
  1%|          | 2341/371472 [11:12<30:10:50,  3.40it/s]
  1%|          | 2342/371472 [11:12<29:44:31,  3.45it/s]
  1%|          | 2343/371472 [11:12<30:55:02,  3.32it/s]
  1%|          | 2344/371472 [11:13<30:11:19,  3.40it/s]
  1%|          | 2345/371472 [11:13<30:20:05,  3.38it/s]
  1%|          | 2346/371472 [11:13<30:11:38,  3.40it/s]
  1%|          | 2347/371472 [11:14<29:29:35,  3.48it/s]
  1%|          | 2348/371472 [11:14<32:22:36,  3.17it/s]
  1%|          | 2349/371472 [11:14<32:12:01,  3.18it/s]
  1%|          | 2350/371472 [11:15<31:56:21,  3.21it/s]
  1%|          | 2351/371472 [11:15<33:19:55,  3.08it/s]
  1%|          | 2352/371472 [11:15<31:41:10,  3.24it/s]
  1%|          | 2353/371472 [11:15<30:19:03,  3.38it/s]
  1%|          | 2354/371472 [11:16<32:46:19,  3.13it/s]
  1%|          | 2355/371472 [11:16<31:42:37,  3.23it/s]
  1%|          | 2356/371472 [11:16<30:49:58,  3.33it/s]
  1%|          | 2357/371472 [11:17<29:11:33,  3.51it/s]
  1%|          | 2358/371472 [11:17<29:00:42,  3.53it/s]
  1%|          | 2359/371472 [11:17<28:36:05,  3.58it/s]
  1%|          | 2360/371472 [11:18<30:01:25,  3.42it/s]
                                                        
{'loss': 5.5742, 'learning_rate': 9.947639466482793e-07, 'epoch': 0.1}

  1%|          | 2360/371472 [11:18<30:01:25,  3.42it/s]
  1%|          | 2361/371472 [11:18<29:21:29,  3.49it/s]
  1%|          | 2362/371472 [11:18<28:07:09,  3.65it/s]
  1%|          | 2363/371472 [11:18<28:22:48,  3.61it/s]
  1%|          | 2364/371472 [11:19<27:53:34,  3.68it/s]
  1%|          | 2365/371472 [11:19<28:26:52,  3.60it/s]
  1%|          | 2366/371472 [11:19<29:54:34,  3.43it/s]
  1%|          | 2367/371472 [11:20<29:53:26,  3.43it/s]
  1%|          | 2368/371472 [11:20<31:24:46,  3.26it/s]
  1%|          | 2369/371472 [11:20<31:49:10,  3.22it/s]
  1%|          | 2370/371472 [11:20<30:55:58,  3.31it/s]
  1%|          | 2371/371472 [11:21<31:53:02,  3.22it/s]
  1%|          | 2372/371472 [11:21<30:59:52,  3.31it/s]
  1%|          | 2373/371472 [11:21<29:55:45,  3.43it/s]
  1%|          | 2374/371472 [11:22<28:46:45,  3.56it/s]
  1%|          | 2375/371472 [11:22<28:54:17,  3.55it/s]
  1%|          | 2376/371472 [11:22<29:27:58,  3.48it/s]
  1%|          | 2377/371472 [11:22<29:21:36,  3.49it/s]
  1%|          | 2378/371472 [11:23<28:57:12,  3.54it/s]
  1%|          | 2379/371472 [11:23<28:47:40,  3.56it/s]
  1%|          | 2380/371472 [11:23<29:40:48,  3.45it/s]
                                                        
{'loss': 5.8785, 'learning_rate': 9.947154646728006e-07, 'epoch': 0.1}

  1%|          | 2380/371472 [11:23<29:40:48,  3.45it/s]
  1%|          | 2381/371472 [11:24<28:39:38,  3.58it/s]
  1%|          | 2382/371472 [11:24<28:57:18,  3.54it/s]
  1%|          | 2383/371472 [11:24<28:27:18,  3.60it/s]
  1%|          | 2384/371472 [11:24<28:04:17,  3.65it/s]
  1%|          | 2385/371472 [11:25<27:17:56,  3.76it/s]
  1%|          | 2386/371472 [11:25<28:01:47,  3.66it/s]
  1%|          | 2387/371472 [11:25<29:25:43,  3.48it/s]
  1%|          | 2388/371472 [11:26<28:54:24,  3.55it/s]
  1%|          | 2389/371472 [11:26<29:25:00,  3.49it/s]
  1%|          | 2390/371472 [11:26<30:35:52,  3.35it/s]
  1%|          | 2391/371472 [11:26<29:25:06,  3.48it/s]
  1%|          | 2392/371472 [11:27<30:50:21,  3.32it/s]
  1%|          | 2393/371472 [11:27<30:49:52,  3.33it/s]
  1%|          | 2394/371472 [11:27<31:08:30,  3.29it/s]
  1%|          | 2395/371472 [11:28<29:52:06,  3.43it/s]
  1%|          | 2396/371472 [11:28<29:41:52,  3.45it/s]
  1%|          | 2397/371472 [11:28<29:20:06,  3.49it/s]
  1%|          | 2398/371472 [11:29<31:46:21,  3.23it/s]
  1%|          | 2399/371472 [11:29<30:19:17,  3.38it/s]
  1%|          | 2400/371472 [11:29<29:52:07,  3.43it/s]
                                                        
{'loss': 5.9297, 'learning_rate': 9.946669826973216e-07, 'epoch': 0.1}

  1%|          | 2400/371472 [11:29<29:52:07,  3.43it/s]
  1%|          | 2401/371472 [11:29<30:13:07,  3.39it/s]
  1%|          | 2402/371472 [11:30<32:45:37,  3.13it/s]
  1%|          | 2403/371472 [11:30<31:03:18,  3.30it/s]
  1%|          | 2404/371472 [11:30<29:54:12,  3.43it/s]
  1%|          | 2405/371472 [11:31<28:40:59,  3.57it/s]
  1%|          | 2406/371472 [11:31<28:22:28,  3.61it/s]
  1%|          | 2407/371472 [11:31<31:15:33,  3.28it/s]
  1%|          | 2408/371472 [11:32<32:30:11,  3.15it/s]
  1%|          | 2409/371472 [11:32<31:18:51,  3.27it/s]
  1%|          | 2410/371472 [11:32<36:34:50,  2.80it/s]
  1%|          | 2411/371472 [11:33<34:58:44,  2.93it/s]
  1%|          | 2412/371472 [11:33<32:24:14,  3.16it/s]
  1%|          | 2413/371472 [11:33<31:02:07,  3.30it/s]
  1%|          | 2414/371472 [11:33<29:22:49,  3.49it/s]
  1%|          | 2415/371472 [11:34<29:58:02,  3.42it/s]
  1%|          | 2416/371472 [11:34<30:48:13,  3.33it/s]
  1%|          | 2417/371472 [11:34<29:28:49,  3.48it/s]
  1%|          | 2418/371472 [11:35<31:53:45,  3.21it/s]
  1%|          | 2419/371472 [11:35<31:21:19,  3.27it/s]
  1%|          | 2420/371472 [11:35<30:06:49,  3.40it/s]
                                                        
{'loss': 5.5759, 'learning_rate': 9.946185007218427e-07, 'epoch': 0.1}

  1%|          | 2420/371472 [11:35<30:06:49,  3.40it/s]
  1%|          | 2421/371472 [11:35<29:18:16,  3.50it/s]
  1%|          | 2422/371472 [11:36<30:45:47,  3.33it/s]
  1%|          | 2423/371472 [11:36<31:43:57,  3.23it/s]
  1%|          | 2424/371472 [11:36<32:44:11,  3.13it/s]
  1%|          | 2425/371472 [11:37<32:01:44,  3.20it/s]
  1%|          | 2426/371472 [11:37<31:00:05,  3.31it/s]
  1%|          | 2427/371472 [11:37<29:37:43,  3.46it/s]
  1%|          | 2428/371472 [11:38<29:25:18,  3.48it/s]
  1%|          | 2429/371472 [11:38<28:21:45,  3.61it/s]
  1%|          | 2430/371472 [11:38<28:17:18,  3.62it/s]
  1%|          | 2431/371472 [11:38<28:08:04,  3.64it/s]
  1%|          | 2432/371472 [11:39<29:52:04,  3.43it/s]
  1%|          | 2433/371472 [11:39<29:10:03,  3.51it/s]
  1%|          | 2434/371472 [11:39<28:07:07,  3.65it/s]
  1%|          | 2435/371472 [11:39<27:52:44,  3.68it/s]
  1%|          | 2436/371472 [11:40<27:43:47,  3.70it/s]
  1%|          | 2437/371472 [11:40<31:44:42,  3.23it/s]
  1%|          | 2438/371472 [11:40<30:16:14,  3.39it/s]
  1%|          | 2439/371472 [11:41<31:21:25,  3.27it/s]
  1%|          | 2440/371472 [11:41<29:26:09,  3.48it/s]
                                                        
{'loss': 5.3543, 'learning_rate': 9.945700187463638e-07, 'epoch': 0.11}

  1%|          | 2440/371472 [11:41<29:26:09,  3.48it/s]
  1%|          | 2441/371472 [11:41<28:10:50,  3.64it/s]
  1%|          | 2442/371472 [11:41<27:36:22,  3.71it/s]
  1%|          | 2443/371472 [11:42<30:20:45,  3.38it/s]
  1%|          | 2444/371472 [11:42<29:35:03,  3.46it/s]
  1%|          | 2445/371472 [11:42<28:44:18,  3.57it/s]
  1%|          | 2446/371472 [11:43<28:18:08,  3.62it/s]
  1%|          | 2447/371472 [11:43<27:22:50,  3.74it/s]
  1%|          | 2448/371472 [11:43<26:54:49,  3.81it/s]
  1%|          | 2449/371472 [11:43<26:49:08,  3.82it/s]
  1%|          | 2450/371472 [11:44<32:49:35,  3.12it/s]
  1%|          | 2451/371472 [11:44<31:34:16,  3.25it/s]
  1%|          | 2452/371472 [11:44<30:10:41,  3.40it/s]
  1%|          | 2453/371472 [11:45<29:33:05,  3.47it/s]
  1%|          | 2454/371472 [11:45<31:38:21,  3.24it/s]
  1%|          | 2455/371472 [11:45<30:45:19,  3.33it/s]
  1%|          | 2456/371472 [11:46<30:11:01,  3.40it/s]
  1%|          | 2457/371472 [11:46<33:42:52,  3.04it/s]
  1%|          | 2458/371472 [11:46<31:35:31,  3.24it/s]
  1%|          | 2459/371472 [11:47<29:14:10,  3.51it/s]
  1%|          | 2460/371472 [11:47<28:40:54,  3.57it/s]
                                                        
{'loss': 5.8447, 'learning_rate': 9.945215367708848e-07, 'epoch': 0.11}

  1%|          | 2460/371472 [11:47<28:40:54,  3.57it/s]
  1%|          | 2461/371472 [11:47<29:24:48,  3.48it/s]
  1%|          | 2462/371472 [11:48<39:16:50,  2.61it/s]
  1%|          | 2463/371472 [11:48<35:14:26,  2.91it/s]
  1%|          | 2464/371472 [11:48<33:59:46,  3.02it/s]
  1%|          | 2465/371472 [11:49<32:32:38,  3.15it/s]
  1%|          | 2466/371472 [11:49<32:26:30,  3.16it/s]
  1%|          | 2467/371472 [11:49<31:30:40,  3.25it/s]
  1%|          | 2468/371472 [11:49<31:11:41,  3.29it/s]
  1%|          | 2469/371472 [11:50<31:26:13,  3.26it/s]
  1%|          | 2470/371472 [11:50<30:15:41,  3.39it/s]
  1%|          | 2471/371472 [11:50<31:57:16,  3.21it/s]
  1%|          | 2472/371472 [11:51<30:22:20,  3.37it/s]
  1%|          | 2473/371472 [11:51<29:14:44,  3.50it/s]
  1%|          | 2474/371472 [11:51<28:00:21,  3.66it/s]
  1%|          | 2475/371472 [11:51<27:52:30,  3.68it/s]
  1%|          | 2476/371472 [11:52<27:22:37,  3.74it/s]
  1%|          | 2477/371472 [11:52<27:23:23,  3.74it/s]
  1%|          | 2478/371472 [11:52<27:37:37,  3.71it/s]
  1%|          | 2479/371472 [11:52<27:21:09,  3.75it/s]
  1%|          | 2480/371472 [11:53<27:28:08,  3.73it/s]
                                                        
{'loss': 5.7428, 'learning_rate': 9.944730547954061e-07, 'epoch': 0.11}

  1%|          | 2480/371472 [11:53<27:28:08,  3.73it/s]
  1%|          | 2481/371472 [11:53<28:13:09,  3.63it/s]
  1%|          | 2482/371472 [11:53<29:02:19,  3.53it/s]
  1%|          | 2483/371472 [11:54<35:54:29,  2.85it/s]
  1%|          | 2484/371472 [11:54<33:43:20,  3.04it/s]
  1%|          | 2485/371472 [11:54<33:00:11,  3.11it/s]
  1%|          | 2486/371472 [11:55<31:26:36,  3.26it/s]
  1%|          | 2487/371472 [11:55<33:13:36,  3.08it/s]
  1%|          | 2488/371472 [11:55<31:51:40,  3.22it/s]
  1%|          | 2489/371472 [11:56<30:39:19,  3.34it/s]
  1%|          | 2490/371472 [11:56<29:42:44,  3.45it/s]
  1%|          | 2491/371472 [11:56<30:37:40,  3.35it/s]
  1%|          | 2492/371472 [11:56<30:01:51,  3.41it/s]
  1%|          | 2493/371472 [11:57<30:50:53,  3.32it/s]
  1%|          | 2494/371472 [11:57<29:13:45,  3.51it/s]
  1%|          | 2495/371472 [11:57<31:21:29,  3.27it/s]
  1%|          | 2496/371472 [11:58<31:39:22,  3.24it/s]
  1%|          | 2497/371472 [11:58<30:06:45,  3.40it/s]
  1%|          | 2498/371472 [11:58<29:46:43,  3.44it/s]
  1%|          | 2499/371472 [11:58<28:52:17,  3.55it/s]
  1%|          | 2500/371472 [11:59<28:37:23,  3.58it/s]
                                                        
{'loss': 5.4967, 'learning_rate': 9.94424572819927e-07, 'epoch': 0.11}

  1%|          | 2500/371472 [11:59<28:37:23,  3.58it/s]
  1%|          | 2501/371472 [11:59<28:09:03,  3.64it/s]
  1%|          | 2502/371472 [11:59<27:11:24,  3.77it/s]
  1%|          | 2503/371472 [12:00<28:46:29,  3.56it/s]
  1%|          | 2504/371472 [12:00<28:24:46,  3.61it/s]
  1%|          | 2505/371472 [12:00<31:32:29,  3.25it/s]
  1%|          | 2506/371472 [12:01<30:49:42,  3.32it/s]
  1%|          | 2507/371472 [12:01<32:30:52,  3.15it/s]
  1%|          | 2508/371472 [12:01<32:46:54,  3.13it/s]
  1%|          | 2509/371472 [12:02<32:43:29,  3.13it/s]
  1%|          | 2510/371472 [12:02<33:21:48,  3.07it/s]
  1%|          | 2511/371472 [12:02<34:04:18,  3.01it/s]
  1%|          | 2512/371472 [12:02<32:01:31,  3.20it/s]
  1%|          | 2513/371472 [12:03<29:52:11,  3.43it/s]
  1%|          | 2514/371472 [12:03<29:18:58,  3.50it/s]
  1%|          | 2515/371472 [12:03<30:28:48,  3.36it/s]
  1%|          | 2516/371472 [12:04<29:53:35,  3.43it/s]
  1%|          | 2517/371472 [12:04<30:00:56,  3.41it/s]
  1%|          | 2518/371472 [12:04<30:33:36,  3.35it/s]
  1%|          | 2519/371472 [12:04<29:41:50,  3.45it/s]
  1%|          | 2520/371472 [12:05<30:15:48,  3.39it/s]
                                                        
{'loss': 5.567, 'learning_rate': 9.943760908444483e-07, 'epoch': 0.11}

  1%|          | 2520/371472 [12:05<30:15:48,  3.39it/s]
  1%|          | 2521/371472 [12:05<29:20:30,  3.49it/s]
  1%|          | 2522/371472 [12:05<29:13:59,  3.51it/s]
  1%|          | 2523/371472 [12:06<29:18:53,  3.50it/s]
  1%|          | 2524/371472 [12:06<29:13:27,  3.51it/s]
  1%|          | 2525/371472 [12:06<29:51:27,  3.43it/s]
  1%|          | 2526/371472 [12:06<29:32:22,  3.47it/s]
  1%|          | 2527/371472 [12:07<29:20:27,  3.49it/s]
  1%|          | 2528/371472 [12:07<29:18:17,  3.50it/s]
  1%|          | 2529/371472 [12:07<28:57:01,  3.54it/s]
  1%|          | 2530/371472 [12:08<27:48:40,  3.68it/s]
  1%|          | 2531/371472 [12:08<27:56:28,  3.67it/s]
  1%|          | 2532/371472 [12:08<28:54:43,  3.54it/s]
  1%|          | 2533/371472 [12:08<28:20:58,  3.61it/s]
  1%|          | 2534/371472 [12:09<28:07:13,  3.64it/s]
  1%|          | 2535/371472 [12:09<31:03:40,  3.30it/s]
  1%|          | 2536/371472 [12:09<29:56:56,  3.42it/s]
  1%|          | 2537/371472 [12:10<31:46:13,  3.23it/s]
  1%|          | 2538/371472 [12:10<32:29:07,  3.15it/s]
  1%|          | 2539/371472 [12:10<33:15:12,  3.08it/s]
  1%|          | 2540/371472 [12:11<31:20:26,  3.27it/s]
                                                        
{'loss': 5.8644, 'learning_rate': 9.943276088689693e-07, 'epoch': 0.11}

  1%|          | 2540/371472 [12:11<31:20:26,  3.27it/s]
  1%|          | 2541/371472 [12:11<30:07:16,  3.40it/s]
  1%|          | 2542/371472 [12:11<30:04:43,  3.41it/s]
  1%|          | 2543/371472 [12:12<31:44:00,  3.23it/s]
  1%|          | 2544/371472 [12:12<30:24:57,  3.37it/s]
  1%|          | 2545/371472 [12:12<29:41:08,  3.45it/s]
  1%|          | 2546/371472 [12:12<29:29:06,  3.48it/s]
  1%|          | 2547/371472 [12:13<29:07:25,  3.52it/s]
  1%|          | 2548/371472 [12:13<29:46:23,  3.44it/s]
  1%|          | 2549/371472 [12:13<29:15:10,  3.50it/s]
  1%|          | 2550/371472 [12:13<28:53:58,  3.55it/s]
  1%|          | 2551/371472 [12:14<29:05:29,  3.52it/s]
  1%|          | 2552/371472 [12:14<28:31:16,  3.59it/s]
  1%|          | 2553/371472 [12:14<28:57:05,  3.54it/s]
  1%|          | 2554/371472 [12:15<28:30:15,  3.60it/s]
  1%|          | 2555/371472 [12:15<30:09:14,  3.40it/s]
  1%|          | 2556/371472 [12:15<29:28:40,  3.48it/s]
  1%|          | 2557/371472 [12:16<30:24:55,  3.37it/s]
  1%|          | 2558/371472 [12:16<30:06:49,  3.40it/s]
  1%|          | 2559/371472 [12:16<29:47:59,  3.44it/s]
  1%|          | 2560/371472 [12:16<28:35:53,  3.58it/s]
                                                        
{'loss': 5.4059, 'learning_rate': 9.942791268934904e-07, 'epoch': 0.11}

  1%|          | 2560/371472 [12:16<28:35:53,  3.58it/s]
  1%|          | 2561/371472 [12:17<29:40:10,  3.45it/s]
  1%|          | 2562/371472 [12:17<28:53:06,  3.55it/s]
  1%|          | 2563/371472 [12:17<27:58:13,  3.66it/s]
  1%|          | 2564/371472 [12:17<27:14:28,  3.76it/s]
  1%|          | 2565/371472 [12:18<29:22:29,  3.49it/s]
  1%|          | 2566/371472 [12:18<31:02:27,  3.30it/s]
  1%|          | 2567/371472 [12:18<32:10:04,  3.19it/s]
  1%|          | 2568/371472 [12:19<29:59:20,  3.42it/s]
  1%|          | 2569/371472 [12:19<28:35:06,  3.58it/s]
  1%|          | 2570/371472 [12:19<28:37:58,  3.58it/s]
  1%|          | 2571/371472 [12:20<30:16:55,  3.38it/s]
  1%|          | 2572/371472 [12:20<29:48:07,  3.44it/s]
  1%|          | 2573/371472 [12:20<30:18:15,  3.38it/s]
  1%|          | 2574/371472 [12:20<31:02:38,  3.30it/s]
  1%|          | 2575/371472 [12:21<30:19:28,  3.38it/s]
  1%|          | 2576/371472 [12:21<29:27:37,  3.48it/s]
  1%|          | 2577/371472 [12:21<28:44:19,  3.57it/s]
  1%|          | 2578/371472 [12:22<30:38:46,  3.34it/s]
  1%|          | 2579/371472 [12:22<29:30:04,  3.47it/s]
  1%|          | 2580/371472 [12:22<28:42:17,  3.57it/s]
                                                        
{'loss': 5.6175, 'learning_rate': 9.942306449180115e-07, 'epoch': 0.11}

  1%|          | 2580/371472 [12:22<28:42:17,  3.57it/s]
  1%|          | 2581/371472 [12:22<31:17:18,  3.28it/s]
  1%|          | 2582/371472 [12:23<30:37:53,  3.35it/s]
  1%|          | 2583/371472 [12:23<29:54:44,  3.43it/s]
  1%|          | 2584/371472 [12:23<28:12:31,  3.63it/s]
  1%|          | 2585/371472 [12:24<27:43:54,  3.69it/s]
  1%|          | 2586/371472 [12:24<27:11:48,  3.77it/s]
  1%|          | 2587/371472 [12:24<27:35:29,  3.71it/s]
  1%|          | 2588/371472 [12:24<28:16:36,  3.62it/s]
  1%|          | 2589/371472 [12:25<27:30:06,  3.73it/s]
  1%|          | 2590/371472 [12:25<27:42:06,  3.70it/s]
  1%|          | 2591/371472 [12:25<27:31:46,  3.72it/s]
  1%|          | 2592/371472 [12:25<27:51:04,  3.68it/s]
  1%|          | 2593/371472 [12:26<28:44:26,  3.57it/s]
  1%|          | 2594/371472 [12:26<29:39:29,  3.45it/s]
  1%|          | 2595/371472 [12:26<31:03:09,  3.30it/s]
  1%|          | 2596/371472 [12:27<31:00:51,  3.30it/s]
  1%|          | 2597/371472 [12:27<31:50:47,  3.22it/s]
  1%|          | 2598/371472 [12:27<30:10:07,  3.40it/s]
  1%|          | 2599/371472 [12:28<28:57:25,  3.54it/s]
  1%|          | 2600/371472 [12:28<28:37:44,  3.58it/s]
                                                        
{'loss': 5.5652, 'learning_rate': 9.941821629425326e-07, 'epoch': 0.11}

  1%|          | 2600/371472 [12:28<28:37:44,  3.58it/s]
  1%|          | 2601/371472 [12:28<27:52:51,  3.68it/s]
  1%|          | 2602/371472 [12:28<28:02:05,  3.65it/s]
  1%|          | 2603/371472 [12:29<28:27:44,  3.60it/s]
  1%|          | 2604/371472 [12:29<28:24:41,  3.61it/s]
  1%|          | 2605/371472 [12:29<28:16:11,  3.62it/s]
  1%|          | 2606/371472 [12:29<27:34:38,  3.72it/s]
  1%|          | 2607/371472 [12:30<27:24:06,  3.74it/s]
  1%|          | 2608/371472 [12:30<27:02:51,  3.79it/s]
  1%|          | 2609/371472 [12:30<26:37:27,  3.85it/s]
  1%|          | 2610/371472 [12:30<26:39:55,  3.84it/s]
  1%|          | 2611/371472 [12:31<27:07:23,  3.78it/s]
  1%|          | 2612/371472 [12:31<28:17:22,  3.62it/s]
  1%|          | 2613/371472 [12:31<27:04:40,  3.78it/s]
  1%|          | 2614/371472 [12:32<27:48:44,  3.68it/s]
  1%|          | 2615/371472 [12:32<27:29:55,  3.73it/s]
  1%|          | 2616/371472 [12:32<30:27:42,  3.36it/s]
  1%|          | 2617/371472 [12:32<30:09:48,  3.40it/s]
  1%|          | 2618/371472 [12:33<29:58:18,  3.42it/s]
  1%|          | 2619/371472 [12:33<30:17:24,  3.38it/s]
  1%|          | 2620/371472 [12:33<29:15:56,  3.50it/s]
                                                        
{'loss': 5.5506, 'learning_rate': 9.941336809670538e-07, 'epoch': 0.11}

  1%|          | 2620/371472 [12:33<29:15:56,  3.50it/s]
  1%|          | 2621/371472 [12:34<30:08:42,  3.40it/s]
  1%|          | 2622/371472 [12:34<29:41:36,  3.45it/s]
  1%|          | 2623/371472 [12:34<29:15:15,  3.50it/s]
  1%|          | 2624/371472 [12:34<28:09:21,  3.64it/s]
  1%|          | 2625/371472 [12:35<27:47:27,  3.69it/s]
  1%|          | 2626/371472 [12:35<27:41:49,  3.70it/s]
  1%|          | 2627/371472 [12:35<27:54:14,  3.67it/s]
  1%|          | 2628/371472 [12:35<27:29:06,  3.73it/s]
  1%|          | 2629/371472 [12:36<27:27:42,  3.73it/s]
  1%|          | 2630/371472 [12:36<26:50:55,  3.82it/s]
  1%|          | 2631/371472 [12:36<26:53:47,  3.81it/s]
  1%|          | 2632/371472 [12:37<26:12:28,  3.91it/s]
  1%|          | 2633/371472 [12:37<25:26:56,  4.03it/s]
  1%|          | 2634/371472 [12:37<26:28:29,  3.87it/s]
  1%|          | 2635/371472 [12:37<27:38:48,  3.71it/s]
  1%|          | 2636/371472 [12:38<27:09:26,  3.77it/s]
  1%|          | 2637/371472 [12:38<29:41:24,  3.45it/s]
  1%|          | 2638/371472 [12:38<30:10:40,  3.39it/s]
  1%|          | 2639/371472 [12:38<28:39:24,  3.58it/s]
  1%|          | 2640/371472 [12:39<28:12:40,  3.63it/s]
                                                        
{'loss': 5.5353, 'learning_rate': 9.94085198991575e-07, 'epoch': 0.11}

  1%|          | 2640/371472 [12:39<28:12:40,  3.63it/s]
  1%|          | 2641/371472 [12:39<28:23:30,  3.61it/s]
  1%|          | 2642/371472 [12:39<28:44:05,  3.57it/s]
  1%|          | 2643/371472 [12:40<28:37:36,  3.58it/s]
  1%|          | 2644/371472 [12:40<28:37:05,  3.58it/s]
  1%|          | 2645/371472 [12:40<28:30:26,  3.59it/s]
  1%|          | 2646/371472 [12:40<27:36:16,  3.71it/s]
  1%|          | 2647/371472 [12:41<27:46:40,  3.69it/s]
  1%|          | 2648/371472 [12:41<29:16:40,  3.50it/s]
  1%|          | 2649/371472 [12:41<28:47:11,  3.56it/s]
  1%|          | 2650/371472 [12:42<29:28:29,  3.48it/s]
  1%|          | 2651/371472 [12:42<30:47:59,  3.33it/s]
  1%|          | 2652/371472 [12:42<30:09:50,  3.40it/s]
  1%|          | 2653/371472 [12:42<29:07:49,  3.52it/s]
  1%|          | 2654/371472 [12:43<31:23:29,  3.26it/s]
  1%|          | 2655/371472 [12:43<30:42:27,  3.34it/s]
  1%|          | 2656/371472 [12:43<29:38:30,  3.46it/s]
  1%|          | 2657/371472 [12:44<29:54:44,  3.42it/s]
  1%|          | 2658/371472 [12:44<28:48:13,  3.56it/s]
  1%|          | 2659/371472 [12:44<29:07:13,  3.52it/s]
  1%|          | 2660/371472 [12:45<30:12:55,  3.39it/s]
                                                        
{'loss': 5.678, 'learning_rate': 9.94036717016096e-07, 'epoch': 0.11}

  1%|          | 2660/371472 [12:45<30:12:55,  3.39it/s]
  1%|          | 2661/371472 [12:45<33:15:09,  3.08it/s]
  1%|          | 2662/371472 [12:45<31:11:42,  3.28it/s]
  1%|          | 2663/371472 [12:45<30:13:06,  3.39it/s]
  1%|          | 2664/371472 [12:46<29:23:05,  3.49it/s]
  1%|          | 2665/371472 [12:46<30:01:18,  3.41it/s]
  1%|          | 2666/371472 [12:46<29:41:42,  3.45it/s]
  1%|          | 2667/371472 [12:47<28:21:16,  3.61it/s]
  1%|          | 2668/371472 [12:47<29:08:46,  3.51it/s]
  1%|          | 2669/371472 [12:47<29:23:52,  3.48it/s]
  1%|          | 2670/371472 [12:47<30:52:56,  3.32it/s]
  1%|          | 2671/371472 [12:48<29:37:10,  3.46it/s]
  1%|          | 2672/371472 [12:48<28:42:15,  3.57it/s]
  1%|          | 2673/371472 [12:48<30:36:39,  3.35it/s]
  1%|          | 2674/371472 [12:49<30:16:19,  3.38it/s]
  1%|          | 2675/371472 [12:49<31:51:09,  3.22it/s]
  1%|          | 2676/371472 [12:49<30:05:33,  3.40it/s]
  1%|          | 2677/371472 [12:49<29:38:20,  3.46it/s]
  1%|          | 2678/371472 [12:50<29:22:48,  3.49it/s]
  1%|          | 2679/371472 [12:50<29:17:06,  3.50it/s]
  1%|          | 2680/371472 [12:50<29:11:54,  3.51it/s]
                                                        
{'loss': 5.5166, 'learning_rate': 9.93988235040617e-07, 'epoch': 0.12}

  1%|          | 2680/371472 [12:50<29:11:54,  3.51it/s]
  1%|          | 2681/371472 [12:51<29:28:51,  3.47it/s]
  1%|          | 2682/371472 [12:51<30:08:54,  3.40it/s]
  1%|          | 2683/371472 [12:51<28:56:44,  3.54it/s]
  1%|          | 2684/371472 [12:51<29:32:02,  3.47it/s]
  1%|          | 2685/371472 [12:52<30:58:36,  3.31it/s]
  1%|          | 2686/371472 [12:52<30:01:06,  3.41it/s]
  1%|          | 2687/371472 [12:52<31:18:04,  3.27it/s]
  1%|          | 2688/371472 [12:53<30:38:53,  3.34it/s]
  1%|          | 2689/371472 [12:53<30:37:46,  3.34it/s]
  1%|          | 2690/371472 [12:53<30:14:50,  3.39it/s]
  1%|          | 2691/371472 [12:54<30:06:31,  3.40it/s]
  1%|          | 2692/371472 [12:54<30:20:14,  3.38it/s]
  1%|          | 2693/371472 [12:54<28:37:27,  3.58it/s]
  1%|          | 2694/371472 [12:54<28:15:44,  3.62it/s]
  1%|          | 2695/371472 [12:55<28:54:40,  3.54it/s]
  1%|          | 2696/371472 [12:55<27:59:24,  3.66it/s]
  1%|          | 2697/371472 [12:55<26:29:43,  3.87it/s]
  1%|          | 2698/371472 [12:55<27:24:59,  3.74it/s]
  1%|          | 2699/371472 [12:56<26:42:24,  3.84it/s]
  1%|          | 2700/371472 [12:56<26:27:06,  3.87it/s]
                                                        
{'loss': 5.5444, 'learning_rate': 9.939397530651381e-07, 'epoch': 0.12}

  1%|          | 2700/371472 [12:56<26:27:06,  3.87it/s]
  1%|          | 2701/371472 [12:56<26:27:57,  3.87it/s]
  1%|          | 2702/371472 [12:56<26:47:37,  3.82it/s]
  1%|          | 2703/371472 [12:57<28:10:21,  3.64it/s]
  1%|          | 2704/371472 [12:57<27:32:17,  3.72it/s]
  1%|          | 2705/371472 [12:57<28:09:42,  3.64it/s]
  1%|          | 2706/371472 [12:58<29:22:40,  3.49it/s]
  1%|          | 2707/371472 [12:58<28:21:38,  3.61it/s]
  1%|          | 2708/371472 [12:58<28:50:13,  3.55it/s]
  1%|          | 2709/371472 [12:58<28:36:48,  3.58it/s]
  1%|          | 2710/371472 [12:59<27:59:59,  3.66it/s]
  1%|          | 2711/371472 [12:59<30:49:12,  3.32it/s]
  1%|          | 2712/371472 [12:59<29:49:32,  3.43it/s]
  1%|          | 2713/371472 [13:00<28:38:07,  3.58it/s]
  1%|          | 2714/371472 [13:00<30:33:54,  3.35it/s]
  1%|          | 2715/371472 [13:00<30:47:24,  3.33it/s]
  1%|          | 2716/371472 [13:01<29:14:10,  3.50it/s]
  1%|          | 2717/371472 [13:01<29:50:52,  3.43it/s]
  1%|          | 2718/371472 [13:01<28:25:50,  3.60it/s]
  1%|          | 2719/371472 [13:01<28:51:34,  3.55it/s]
  1%|          | 2720/371472 [13:02<29:17:27,  3.50it/s]
                                                        
{'loss': 5.395, 'learning_rate': 9.938912710896594e-07, 'epoch': 0.12}

  1%|          | 2720/371472 [13:02<29:17:27,  3.50it/s]
  1%|          | 2721/371472 [13:02<29:07:43,  3.52it/s]
  1%|          | 2722/371472 [13:02<28:08:32,  3.64it/s]
  1%|          | 2723/371472 [13:02<28:19:55,  3.62it/s]
  1%|          | 2724/371472 [13:03<27:29:33,  3.73it/s]
  1%|          | 2725/371472 [13:03<27:56:49,  3.67it/s]
  1%|          | 2726/371472 [13:03<26:41:19,  3.84it/s]
  1%|          | 2727/371472 [13:04<27:36:08,  3.71it/s]
  1%|          | 2728/371472 [13:04<27:10:42,  3.77it/s]
  1%|          | 2729/371472 [13:04<27:55:05,  3.67it/s]
  1%|          | 2730/371472 [13:04<28:57:20,  3.54it/s]
  1%|          | 2731/371472 [13:05<27:25:50,  3.73it/s]
  1%|          | 2732/371472 [13:05<26:46:48,  3.82it/s]
  1%|          | 2733/371472 [13:05<27:36:16,  3.71it/s]
  1%|          | 2734/371472 [13:05<27:20:39,  3.75it/s]
  1%|          | 2735/371472 [13:06<27:02:10,  3.79it/s]
  1%|          | 2736/371472 [13:06<29:16:05,  3.50it/s]
  1%|          | 2737/371472 [13:06<27:53:16,  3.67it/s]
  1%|          | 2738/371472 [13:07<27:57:20,  3.66it/s]
  1%|          | 2739/371472 [13:07<27:29:53,  3.72it/s]
  1%|          | 2740/371472 [13:07<29:46:40,  3.44it/s]
                                                        
{'loss': 5.7822, 'learning_rate': 9.938427891141803e-07, 'epoch': 0.12}

  1%|          | 2740/371472 [13:07<29:46:40,  3.44it/s]
  1%|          | 2741/371472 [13:07<29:37:53,  3.46it/s]
  1%|          | 2742/371472 [13:08<28:44:37,  3.56it/s]
  1%|          | 2743/371472 [13:08<30:12:24,  3.39it/s]
  1%|          | 2744/371472 [13:08<29:21:15,  3.49it/s]
  1%|          | 2745/371472 [13:09<29:21:22,  3.49it/s]
  1%|          | 2746/371472 [13:09<28:35:12,  3.58it/s]
  1%|          | 2747/371472 [13:09<28:18:38,  3.62it/s]
  1%|          | 2748/371472 [13:09<28:00:12,  3.66it/s]
  1%|          | 2749/371472 [13:10<28:53:04,  3.55it/s]
  1%|          | 2750/371472 [13:10<28:46:46,  3.56it/s]
  1%|          | 2751/371472 [13:10<28:00:00,  3.66it/s]
  1%|          | 2752/371472 [13:10<28:31:13,  3.59it/s]
  1%|          | 2753/371472 [13:11<28:12:55,  3.63it/s]
  1%|          | 2754/371472 [13:11<28:22:55,  3.61it/s]
  1%|          | 2755/371472 [13:11<27:32:03,  3.72it/s]
  1%|          | 2756/371472 [13:12<27:23:30,  3.74it/s]
  1%|          | 2757/371472 [13:12<28:22:18,  3.61it/s]
  1%|          | 2758/371472 [13:12<30:13:34,  3.39it/s]
  1%|          | 2759/371472 [13:12<30:03:26,  3.41it/s]
  1%|          | 2760/371472 [13:13<28:16:20,  3.62it/s]
                                                        
{'loss': 5.5044, 'learning_rate': 9.937943071387016e-07, 'epoch': 0.12}

  1%|          | 2760/371472 [13:13<28:16:20,  3.62it/s]
  1%|          | 2761/371472 [13:13<30:57:29,  3.31it/s]
  1%|          | 2762/371472 [13:13<30:46:51,  3.33it/s]
  1%|          | 2763/371472 [13:14<30:25:33,  3.37it/s]
  1%|          | 2764/371472 [13:14<30:27:25,  3.36it/s]
  1%|          | 2765/371472 [13:14<29:30:14,  3.47it/s]
  1%|          | 2766/371472 [13:15<29:49:14,  3.43it/s]
  1%|          | 2767/371472 [13:15<28:56:10,  3.54it/s]
  1%|          | 2768/371472 [13:15<27:42:57,  3.70it/s]
  1%|          | 2769/371472 [13:15<27:15:10,  3.76it/s]
  1%|          | 2770/371472 [13:16<27:01:26,  3.79it/s]
  1%|          | 2771/371472 [13:16<27:25:52,  3.73it/s]
  1%|          | 2772/371472 [13:16<27:20:48,  3.75it/s]
  1%|          | 2773/371472 [13:16<27:55:26,  3.67it/s]
  1%|          | 2774/371472 [13:17<28:24:09,  3.61it/s]
  1%|          | 2775/371472 [13:17<28:43:46,  3.56it/s]
  1%|          | 2776/371472 [13:17<28:17:54,  3.62it/s]
  1%|          | 2777/371472 [13:17<28:17:24,  3.62it/s]
  1%|          | 2778/371472 [13:18<29:04:26,  3.52it/s]
  1%|          | 2779/371472 [13:18<28:05:26,  3.65it/s]
  1%|          | 2780/371472 [13:18<28:56:42,  3.54it/s]
                                                        
{'loss': 5.309, 'learning_rate': 9.937458251632226e-07, 'epoch': 0.12}

  1%|          | 2780/371472 [13:18<28:56:42,  3.54it/s]
  1%|          | 2781/371472 [13:19<28:22:45,  3.61it/s]
  1%|          | 2782/371472 [13:19<26:57:21,  3.80it/s]
  1%|          | 2783/371472 [13:19<26:39:14,  3.84it/s]
  1%|          | 2784/371472 [13:19<26:13:15,  3.91it/s]
  1%|          | 2785/371472 [13:20<27:33:12,  3.72it/s]
  1%|          | 2786/371472 [13:20<28:34:10,  3.58it/s]
  1%|          | 2787/371472 [13:20<27:55:09,  3.67it/s]
  1%|          | 2788/371472 [13:20<28:34:11,  3.58it/s]
  1%|          | 2789/371472 [13:21<31:05:58,  3.29it/s]
  1%|          | 2790/371472 [13:21<31:03:58,  3.30it/s]
  1%|          | 2791/371472 [13:21<32:03:11,  3.20it/s]
  1%|          | 2792/371472 [13:22<30:23:07,  3.37it/s]
  1%|          | 2793/371472 [13:22<29:06:31,  3.52it/s]
  1%|          | 2794/371472 [13:22<28:03:29,  3.65it/s]
  1%|          | 2795/371472 [13:22<26:53:44,  3.81it/s]
  1%|          | 2796/371472 [13:23<28:39:30,  3.57it/s]
  1%|          | 2797/371472 [13:23<30:36:05,  3.35it/s]
  1%|          | 2798/371472 [13:23<30:13:11,  3.39it/s]
  1%|          | 2799/371472 [13:24<30:32:40,  3.35it/s]
  1%|          | 2800/371472 [13:24<30:14:17,  3.39it/s]
                                                        
{'loss': 5.4511, 'learning_rate': 9.936973431877437e-07, 'epoch': 0.12}

  1%|          | 2800/371472 [13:24<30:14:17,  3.39it/s]
  1%|          | 2801/371472 [13:24<30:54:51,  3.31it/s]
  1%|          | 2802/371472 [13:25<30:07:15,  3.40it/s]
  1%|          | 2803/371472 [13:25<30:29:21,  3.36it/s]
  1%|          | 2804/371472 [13:25<30:07:54,  3.40it/s]
  1%|          | 2805/371472 [13:25<28:55:50,  3.54it/s]
  1%|          | 2806/371472 [13:26<30:39:51,  3.34it/s]
  1%|          | 2807/371472 [13:26<30:44:30,  3.33it/s]
  1%|          | 2808/371472 [13:26<29:21:27,  3.49it/s]
  1%|          | 2809/371472 [13:27<30:06:32,  3.40it/s]
  1%|          | 2810/371472 [13:27<29:57:22,  3.42it/s]
  1%|          | 2811/371472 [13:27<29:29:18,  3.47it/s]
  1%|          | 2812/371472 [13:28<29:58:48,  3.42it/s]
  1%|          | 2813/371472 [13:28<29:24:42,  3.48it/s]
  1%|          | 2814/371472 [13:28<28:13:17,  3.63it/s]
  1%|          | 2815/371472 [13:28<29:38:35,  3.45it/s]
  1%|          | 2816/371472 [13:29<28:47:06,  3.56it/s]
  1%|          | 2817/371472 [13:29<28:19:44,  3.61it/s]
  1%|          | 2818/371472 [13:29<27:12:01,  3.76it/s]
  1%|          | 2819/371472 [13:29<26:47:32,  3.82it/s]
  1%|          | 2820/371472 [13:30<26:17:42,  3.89it/s]
                                                        
{'loss': 5.6822, 'learning_rate': 9.936488612122648e-07, 'epoch': 0.12}

  1%|          | 2820/371472 [13:30<26:17:42,  3.89it/s]
  1%|          | 2821/371472 [13:30<25:35:58,  4.00it/s]
  1%|          | 2822/371472 [13:30<25:22:13,  4.04it/s]
  1%|          | 2823/371472 [13:30<25:49:23,  3.97it/s]
  1%|          | 2824/371472 [13:31<26:27:23,  3.87it/s]
  1%|          | 2825/371472 [13:31<26:29:05,  3.87it/s]
  1%|          | 2826/371472 [13:31<26:23:41,  3.88it/s]
  1%|          | 2827/371472 [13:31<26:24:25,  3.88it/s]
  1%|          | 2828/371472 [13:32<30:09:37,  3.40it/s]
  1%|          | 2829/371472 [13:32<32:26:22,  3.16it/s]
  1%|          | 2830/371472 [13:32<30:45:51,  3.33it/s]
  1%|          | 2831/371472 [13:33<30:07:29,  3.40it/s]
  1%|          | 2832/371472 [13:33<29:03:18,  3.52it/s]
  1%|          | 2833/371472 [13:33<29:23:17,  3.48it/s]
  1%|          | 2834/371472 [13:34<27:58:06,  3.66it/s]
  1%|          | 2835/371472 [13:34<28:45:49,  3.56it/s]
  1%|          | 2836/371472 [13:34<28:29:38,  3.59it/s]
  1%|          | 2837/371472 [13:34<27:39:49,  3.70it/s]
  1%|          | 2838/371472 [13:35<27:22:43,  3.74it/s]
  1%|          | 2839/371472 [13:35<30:00:22,  3.41it/s]
  1%|          | 2840/371472 [13:35<29:51:03,  3.43it/s]
                                                        
{'loss': 5.7788, 'learning_rate': 9.936003792367858e-07, 'epoch': 0.12}

  1%|          | 2840/371472 [13:35<29:51:03,  3.43it/s]
  1%|          | 2841/371472 [13:36<29:25:26,  3.48it/s]
  1%|          | 2842/371472 [13:36<29:40:25,  3.45it/s]
  1%|          | 2843/371472 [13:36<30:34:09,  3.35it/s]
  1%|          | 2844/371472 [13:36<29:05:49,  3.52it/s]
  1%|          | 2845/371472 [13:37<28:02:36,  3.65it/s]
  1%|          | 2846/371472 [13:37<28:59:08,  3.53it/s]
  1%|          | 2847/371472 [13:37<28:59:34,  3.53it/s]
  1%|          | 2848/371472 [13:37<28:21:29,  3.61it/s]
  1%|          | 2849/371472 [13:38<28:42:42,  3.57it/s]
  1%|          | 2850/371472 [13:38<28:31:09,  3.59it/s]
  1%|          | 2851/371472 [13:38<29:23:26,  3.48it/s]
  1%|          | 2852/371472 [13:39<31:23:59,  3.26it/s]
  1%|          | 2853/371472 [13:39<29:57:55,  3.42it/s]
  1%|          | 2854/371472 [13:39<28:42:42,  3.57it/s]
  1%|          | 2855/371472 [13:39<28:03:38,  3.65it/s]
  1%|          | 2856/371472 [13:40<28:02:30,  3.65it/s]
  1%|          | 2857/371472 [13:40<27:55:58,  3.67it/s]
  1%|          | 2858/371472 [13:40<27:30:45,  3.72it/s]
  1%|          | 2859/371472 [13:41<27:07:04,  3.78it/s]
  1%|          | 2860/371472 [13:41<27:45:31,  3.69it/s]
                                                        
{'loss': 5.3378, 'learning_rate': 9.935518972613071e-07, 'epoch': 0.12}

  1%|          | 2860/371472 [13:41<27:45:31,  3.69it/s]
  1%|          | 2861/371472 [13:41<27:59:06,  3.66it/s]
  1%|          | 2862/371472 [13:41<29:33:17,  3.46it/s]
  1%|          | 2863/371472 [13:42<28:53:24,  3.54it/s]
  1%|          | 2864/371472 [13:42<27:47:19,  3.68it/s]
  1%|          | 2865/371472 [13:42<27:50:33,  3.68it/s]
  1%|          | 2866/371472 [13:43<29:04:16,  3.52it/s]
  1%|          | 2867/371472 [13:43<27:58:33,  3.66it/s]
  1%|          | 2868/371472 [13:43<27:47:53,  3.68it/s]
  1%|          | 2869/371472 [13:43<27:28:06,  3.73it/s]
  1%|          | 2870/371472 [13:44<28:57:05,  3.54it/s]
  1%|          | 2871/371472 [13:44<29:36:33,  3.46it/s]
  1%|          | 2872/371472 [13:44<28:50:16,  3.55it/s]
  1%|          | 2873/371472 [13:44<27:50:28,  3.68it/s]
  1%|          | 2874/371472 [13:45<29:48:37,  3.43it/s]
  1%|          | 2875/371472 [13:45<32:42:41,  3.13it/s]
  1%|          | 2876/371472 [13:45<31:48:16,  3.22it/s]
  1%|          | 2877/371472 [13:46<32:25:35,  3.16it/s]
  1%|          | 2878/371472 [13:46<31:39:05,  3.23it/s]
  1%|          | 2879/371472 [13:46<30:19:22,  3.38it/s]
  1%|          | 2880/371472 [13:47<29:25:46,  3.48it/s]
                                                        
{'loss': 5.6238, 'learning_rate': 9.935034152858282e-07, 'epoch': 0.12}

  1%|          | 2880/371472 [13:47<29:25:46,  3.48it/s]
  1%|          | 2881/371472 [13:47<30:49:15,  3.32it/s]
  1%|          | 2882/371472 [13:47<31:14:25,  3.28it/s]
  1%|          | 2883/371472 [13:48<30:33:03,  3.35it/s]
  1%|          | 2884/371472 [13:48<29:32:21,  3.47it/s]
  1%|          | 2885/371472 [13:48<28:32:56,  3.59it/s]
  1%|          | 2886/371472 [13:48<28:23:08,  3.61it/s]
  1%|          | 2887/371472 [13:49<29:38:02,  3.45it/s]
  1%|          | 2888/371472 [13:49<30:40:16,  3.34it/s]
  1%|          | 2889/371472 [13:49<30:13:01,  3.39it/s]
  1%|          | 2890/371472 [13:50<30:06:07,  3.40it/s]
  1%|          | 2891/371472 [13:50<30:20:39,  3.37it/s]
  1%|          | 2892/371472 [13:50<29:32:06,  3.47it/s]
  1%|          | 2893/371472 [13:50<28:45:48,  3.56it/s]
  1%|          | 2894/371472 [13:51<27:57:15,  3.66it/s]
  1%|          | 2895/371472 [13:51<29:01:55,  3.53it/s]
  1%|          | 2896/371472 [13:51<28:29:11,  3.59it/s]
  1%|          | 2897/371472 [13:51<28:34:14,  3.58it/s]
  1%|          | 2898/371472 [13:52<27:34:13,  3.71it/s]
  1%|          | 2899/371472 [13:52<28:52:02,  3.55it/s]
  1%|          | 2900/371472 [13:52<31:14:46,  3.28it/s]
                                                        
{'loss': 5.3651, 'learning_rate': 9.934549333103493e-07, 'epoch': 0.12}

  1%|          | 2900/371472 [13:52<31:14:46,  3.28it/s]
  1%|          | 2901/371472 [13:53<30:28:59,  3.36it/s]
  1%|          | 2902/371472 [13:53<29:31:01,  3.47it/s]
  1%|          | 2903/371472 [13:53<29:03:12,  3.52it/s]
  1%|          | 2904/371472 [13:54<28:43:34,  3.56it/s]
  1%|          | 2905/371472 [13:54<29:33:04,  3.46it/s]
  1%|          | 2906/371472 [13:54<28:36:02,  3.58it/s]
  1%|          | 2907/371472 [13:54<28:10:28,  3.63it/s]
  1%|          | 2908/371472 [13:55<27:56:28,  3.66it/s]
  1%|          | 2909/371472 [13:55<27:06:43,  3.78it/s]
  1%|          | 2910/371472 [13:55<28:22:01,  3.61it/s]
  1%|          | 2911/371472 [13:55<29:13:55,  3.50it/s]
  1%|          | 2912/371472 [13:56<28:17:22,  3.62it/s]
  1%|          | 2913/371472 [13:56<28:00:45,  3.65it/s]
  1%|          | 2914/371472 [13:56<28:01:30,  3.65it/s]
  1%|          | 2915/371472 [13:57<30:12:32,  3.39it/s]
  1%|          | 2916/371472 [13:57<28:52:05,  3.55it/s]
  1%|          | 2917/371472 [13:57<29:31:53,  3.47it/s]
  1%|          | 2918/371472 [13:57<30:39:10,  3.34it/s]
  1%|          | 2919/371472 [13:58<29:22:50,  3.48it/s]
  1%|          | 2920/371472 [13:58<28:19:57,  3.61it/s]
                                                        
{'loss': 5.6061, 'learning_rate': 9.934064513348703e-07, 'epoch': 0.13}

  1%|          | 2920/371472 [13:58<28:19:57,  3.61it/s]
  1%|          | 2921/371472 [13:58<28:51:06,  3.55it/s]
  1%|          | 2922/371472 [13:59<27:20:50,  3.74it/s]
  1%|          | 2923/371472 [13:59<26:27:07,  3.87it/s]
  1%|          | 2924/371472 [13:59<29:12:50,  3.50it/s]
  1%|          | 2925/371472 [14:00<34:59:59,  2.92it/s]
  1%|          | 2926/371472 [14:00<33:06:29,  3.09it/s]
  1%|          | 2927/371472 [14:00<33:17:57,  3.07it/s]
  1%|          | 2928/371472 [14:00<31:21:01,  3.27it/s]
  1%|          | 2929/371472 [14:01<32:16:28,  3.17it/s]
  1%|          | 2930/371472 [14:01<30:35:17,  3.35it/s]
  1%|          | 2931/371472 [14:01<29:42:56,  3.45it/s]
  1%|          | 2932/371472 [14:02<29:45:35,  3.44it/s]
  1%|          | 2933/371472 [14:02<28:27:00,  3.60it/s]
  1%|          | 2934/371472 [14:02<31:38:44,  3.23it/s]
  1%|          | 2935/371472 [14:03<30:33:14,  3.35it/s]
  1%|          | 2936/371472 [14:03<29:52:04,  3.43it/s]
  1%|          | 2937/371472 [14:03<28:59:33,  3.53it/s]
  1%|          | 2938/371472 [14:03<27:54:43,  3.67it/s]
  1%|          | 2939/371472 [14:04<28:04:17,  3.65it/s]
  1%|          | 2940/371472 [14:04<28:01:19,  3.65it/s]
                                                        
{'loss': 5.6688, 'learning_rate': 9.933579693593914e-07, 'epoch': 0.13}

  1%|          | 2940/371472 [14:04<28:01:19,  3.65it/s]
  1%|          | 2941/371472 [14:04<27:31:08,  3.72it/s]
  1%|          | 2942/371472 [14:04<27:14:39,  3.76it/s]
  1%|          | 2943/371472 [14:05<29:14:22,  3.50it/s]
  1%|          | 2944/371472 [14:05<27:37:21,  3.71it/s]
  1%|          | 2945/371472 [14:05<27:03:43,  3.78it/s]
  1%|          | 2946/371472 [14:05<28:27:02,  3.60it/s]
  1%|          | 2947/371472 [14:06<27:34:40,  3.71it/s]
  1%|          | 2948/371472 [14:06<27:39:21,  3.70it/s]
  1%|          | 2949/371472 [14:06<27:54:39,  3.67it/s]
  1%|          | 2950/371472 [14:07<29:12:06,  3.51it/s]
  1%|          | 2951/371472 [14:07<28:38:22,  3.57it/s]
  1%|          | 2952/371472 [14:07<28:20:27,  3.61it/s]
  1%|          | 2953/371472 [14:07<28:42:11,  3.57it/s]
  1%|          | 2954/371472 [14:08<28:02:06,  3.65it/s]
  1%|          | 2955/371472 [14:08<27:19:11,  3.75it/s]
  1%|          | 2956/371472 [14:08<26:55:01,  3.80it/s]
  1%|          | 2957/371472 [14:09<29:04:36,  3.52it/s]
  1%|          | 2958/371472 [14:09<32:20:29,  3.17it/s]
  1%|          | 2959/371472 [14:09<32:05:13,  3.19it/s]
  1%|          | 2960/371472 [14:10<31:23:36,  3.26it/s]
                                                        
{'loss': 5.5402, 'learning_rate': 9.933094873839125e-07, 'epoch': 0.13}

  1%|          | 2960/371472 [14:10<31:23:36,  3.26it/s]
  1%|          | 2961/371472 [14:10<30:08:03,  3.40it/s]
  1%|          | 2962/371472 [14:10<30:09:16,  3.39it/s]
  1%|          | 2963/371472 [14:10<29:05:40,  3.52it/s]
  1%|          | 2964/371472 [14:11<30:41:10,  3.34it/s]
  1%|          | 2965/371472 [14:11<31:55:39,  3.21it/s]
  1%|          | 2966/371472 [14:11<30:58:54,  3.30it/s]
  1%|          | 2967/371472 [14:12<32:04:09,  3.19it/s]
  1%|          | 2968/371472 [14:12<32:20:05,  3.17it/s]
  1%|          | 2969/371472 [14:12<33:05:18,  3.09it/s]
  1%|          | 2970/371472 [14:13<30:44:59,  3.33it/s]
  1%|          | 2971/371472 [14:13<29:37:08,  3.46it/s]
  1%|          | 2972/371472 [14:13<30:15:32,  3.38it/s]
  1%|          | 2973/371472 [14:13<30:25:11,  3.36it/s]
  1%|          | 2974/371472 [14:14<30:18:34,  3.38it/s]
  1%|          | 2975/371472 [14:14<29:20:03,  3.49it/s]
  1%|          | 2976/371472 [14:14<28:17:16,  3.62it/s]
  1%|          | 2977/371472 [14:14<27:16:42,  3.75it/s]
  1%|          | 2978/371472 [14:15<27:33:07,  3.72it/s]
  1%|          | 2979/371472 [14:15<29:16:10,  3.50it/s]
  1%|          | 2980/371472 [14:15<30:11:51,  3.39it/s]
                                                        
{'loss': 5.3776, 'learning_rate': 9.932610054084336e-07, 'epoch': 0.13}

  1%|          | 2980/371472 [14:15<30:11:51,  3.39it/s]
  1%|          | 2981/371472 [14:16<28:42:58,  3.56it/s]
  1%|          | 2982/371472 [14:16<28:41:58,  3.57it/s]
  1%|          | 2983/371472 [14:16<27:06:14,  3.78it/s]
  1%|          | 2984/371472 [14:16<26:30:56,  3.86it/s]
  1%|          | 2985/371472 [14:17<27:35:26,  3.71it/s]
  1%|          | 2986/371472 [14:17<27:40:17,  3.70it/s]
  1%|          | 2987/371472 [14:17<27:00:03,  3.79it/s]
  1%|          | 2988/371472 [14:17<27:57:48,  3.66it/s]
  1%|          | 2989/371472 [14:18<28:26:16,  3.60it/s]
  1%|          | 2990/371472 [14:18<27:58:54,  3.66it/s]
  1%|          | 2991/371472 [14:18<28:14:13,  3.62it/s]
  1%|          | 2992/371472 [14:19<28:24:59,  3.60it/s]
  1%|          | 2993/371472 [14:19<28:04:06,  3.65it/s]
  1%|          | 2994/371472 [14:19<28:32:14,  3.59it/s]
  1%|          | 2995/371472 [14:19<27:11:54,  3.76it/s]
  1%|          | 2996/371472 [14:20<31:24:19,  3.26it/s]
  1%|          | 2997/371472 [14:20<31:33:24,  3.24it/s]
  1%|          | 2998/371472 [14:20<29:24:02,  3.48it/s]
  1%|          | 2999/371472 [14:21<28:24:01,  3.60it/s]
  1%|          | 3000/371472 [14:21<28:05:13,  3.64it/s]
                                                        
{'loss': 5.4292, 'learning_rate': 9.932125234329548e-07, 'epoch': 0.13}

  1%|          | 3000/371472 [14:21<28:05:13,  3.64it/s]
  1%|          | 3001/371472 [14:21<27:13:46,  3.76it/s]
  1%|          | 3002/371472 [14:21<28:05:54,  3.64it/s]
  1%|          | 3003/371472 [14:22<29:26:28,  3.48it/s]
  1%|          | 3004/371472 [14:22<28:33:50,  3.58it/s]
  1%|          | 3005/371472 [14:22<28:58:52,  3.53it/s]
  1%|          | 3006/371472 [14:23<29:00:59,  3.53it/s]
  1%|          | 3007/371472 [14:23<29:34:44,  3.46it/s]
  1%|          | 3008/371472 [14:23<29:55:37,  3.42it/s]
  1%|          | 3009/371472 [14:23<29:50:12,  3.43it/s]
  1%|          | 3010/371472 [14:24<30:29:02,  3.36it/s]
  1%|          | 3011/371472 [14:24<30:07:37,  3.40it/s]
  1%|          | 3012/371472 [14:24<29:02:04,  3.53it/s]
  1%|          | 3013/371472 [14:25<28:41:52,  3.57it/s]
  1%|          | 3014/371472 [14:25<27:57:59,  3.66it/s]
  1%|          | 3015/371472 [14:25<27:06:59,  3.77it/s]
  1%|          | 3016/371472 [14:25<29:11:34,  3.51it/s]
  1%|          | 3017/371472 [14:26<29:05:52,  3.52it/s]
  1%|          | 3018/371472 [14:26<27:52:26,  3.67it/s]
  1%|          | 3019/371472 [14:26<26:53:40,  3.81it/s]
  1%|          | 3020/371472 [14:26<26:49:51,  3.81it/s]
                                                        
{'loss': 5.614, 'learning_rate': 9.93164041457476e-07, 'epoch': 0.13}

  1%|          | 3020/371472 [14:26<26:49:51,  3.81it/s]
  1%|          | 3021/371472 [14:27<27:21:42,  3.74it/s]
  1%|          | 3022/371472 [14:27<28:06:07,  3.64it/s]
  1%|          | 3023/371472 [14:27<28:41:57,  3.57it/s]
  1%|          | 3024/371472 [14:28<30:01:03,  3.41it/s]
  1%|          | 3025/371472 [14:28<29:03:47,  3.52it/s]
  1%|          | 3026/371472 [14:28<29:45:20,  3.44it/s]
  1%|          | 3027/371472 [14:29<33:14:33,  3.08it/s]
  1%|          | 3028/371472 [14:29<30:59:12,  3.30it/s]
  1%|          | 3029/371472 [14:29<30:28:25,  3.36it/s]
  1%|          | 3030/371472 [14:29<30:13:26,  3.39it/s]
  1%|          | 3031/371472 [14:30<29:46:36,  3.44it/s]
  1%|          | 3032/371472 [14:30<32:42:49,  3.13it/s]
  1%|          | 3033/371472 [14:30<31:18:51,  3.27it/s]
  1%|          | 3034/371472 [14:31<29:44:34,  3.44it/s]
  1%|          | 3035/371472 [14:31<29:48:11,  3.43it/s]
  1%|          | 3036/371472 [14:31<30:01:22,  3.41it/s]
  1%|          | 3037/371472 [14:31<28:47:21,  3.55it/s]
  1%|          | 3038/371472 [14:32<27:48:50,  3.68it/s]
  1%|          | 3039/371472 [14:32<28:12:07,  3.63it/s]
  1%|          | 3040/371472 [14:32<29:15:29,  3.50it/s]
                                                        
{'loss': 5.5546, 'learning_rate': 9.93115559481997e-07, 'epoch': 0.13}

  1%|          | 3040/371472 [14:32<29:15:29,  3.50it/s]
  1%|          | 3041/371472 [14:33<27:51:04,  3.67it/s]
  1%|          | 3042/371472 [14:33<27:27:51,  3.73it/s]
  1%|          | 3043/371472 [14:33<26:23:38,  3.88it/s]
  1%|          | 3044/371472 [14:33<27:46:14,  3.69it/s]
  1%|          | 3045/371472 [14:34<28:30:08,  3.59it/s]
  1%|          | 3046/371472 [14:34<28:39:55,  3.57it/s]
  1%|          | 3047/371472 [14:34<29:05:12,  3.52it/s]
  1%|          | 3048/371472 [14:35<28:36:19,  3.58it/s]
  1%|          | 3049/371472 [14:35<28:26:45,  3.60it/s]
  1%|          | 3050/371472 [14:35<27:17:35,  3.75it/s]
  1%|          | 3051/371472 [14:35<28:23:29,  3.60it/s]
  1%|          | 3052/371472 [14:36<29:55:34,  3.42it/s]
  1%|          | 3053/371472 [14:36<29:42:18,  3.45it/s]
  1%|          | 3054/371472 [14:36<28:42:12,  3.57it/s]
  1%|          | 3055/371472 [14:36<28:09:51,  3.63it/s]
  1%|          | 3056/371472 [14:37<28:49:11,  3.55it/s]
  1%|          | 3057/371472 [14:37<29:06:41,  3.52it/s]
  1%|          | 3058/371472 [14:37<29:18:48,  3.49it/s]
  1%|          | 3059/371472 [14:38<29:45:30,  3.44it/s]
  1%|          | 3060/371472 [14:38<29:54:43,  3.42it/s]
                                                        
{'loss': 5.5784, 'learning_rate': 9.930670775065183e-07, 'epoch': 0.13}

  1%|          | 3060/371472 [14:38<29:54:43,  3.42it/s]
  1%|          | 3061/371472 [14:38<32:00:11,  3.20it/s]
  1%|          | 3062/371472 [14:39<31:19:42,  3.27it/s]
  1%|          | 3063/371472 [14:39<31:03:43,  3.29it/s]
  1%|          | 3064/371472 [14:39<31:05:17,  3.29it/s]
  1%|          | 3065/371472 [14:39<29:39:18,  3.45it/s]
  1%|          | 3066/371472 [14:40<28:57:02,  3.53it/s]
  1%|          | 3067/371472 [14:40<28:05:27,  3.64it/s]
  1%|          | 3068/371472 [14:40<28:03:29,  3.65it/s]
  1%|          | 3069/371472 [14:41<28:20:06,  3.61it/s]
  1%|          | 3070/371472 [14:41<28:22:07,  3.61it/s]
  1%|          | 3071/371472 [14:41<27:38:23,  3.70it/s]
  1%|          | 3072/371472 [14:41<27:50:17,  3.68it/s]
  1%|          | 3073/371472 [14:42<29:27:28,  3.47it/s]
  1%|          | 3074/371472 [14:42<30:41:50,  3.33it/s]
  1%|          | 3075/371472 [14:42<32:08:04,  3.18it/s]
  1%|          | 3076/371472 [14:43<33:17:12,  3.07it/s]
  1%|          | 3077/371472 [14:43<30:47:10,  3.32it/s]
  1%|          | 3078/371472 [14:43<30:53:30,  3.31it/s]
  1%|          | 3079/371472 [14:44<30:58:09,  3.30it/s]
  1%|          | 3080/371472 [14:44<30:28:59,  3.36it/s]
                                                        
{'loss': 4.989, 'learning_rate': 9.930185955310391e-07, 'epoch': 0.13}

  1%|          | 3080/371472 [14:44<30:28:59,  3.36it/s]
  1%|          | 3081/371472 [14:44<30:09:22,  3.39it/s]
  1%|          | 3082/371472 [14:44<30:41:34,  3.33it/s]
  1%|          | 3083/371472 [14:45<31:18:49,  3.27it/s]
  1%|          | 3084/371472 [14:45<30:03:03,  3.41it/s]
  1%|          | 3085/371472 [14:45<29:20:44,  3.49it/s]
  1%|          | 3086/371472 [14:46<29:19:33,  3.49it/s]
  1%|          | 3087/371472 [14:46<28:47:15,  3.55it/s]
  1%|          | 3088/371472 [14:46<27:50:59,  3.67it/s]
  1%|          | 3089/371472 [14:46<28:33:35,  3.58it/s]
  1%|          | 3090/371472 [14:47<31:22:21,  3.26it/s]
  1%|          | 3091/371472 [14:47<29:52:52,  3.42it/s]
  1%|          | 3092/371472 [14:47<29:36:11,  3.46it/s]
  1%|          | 3093/371472 [14:48<30:13:52,  3.38it/s]
  1%|          | 3094/371472 [14:48<30:12:24,  3.39it/s]
  1%|          | 3095/371472 [14:48<30:09:31,  3.39it/s]
  1%|          | 3096/371472 [14:48<29:46:13,  3.44it/s]
  1%|          | 3097/371472 [14:49<29:58:41,  3.41it/s]
  1%|          | 3098/371472 [14:49<31:17:35,  3.27it/s]
  1%|          | 3099/371472 [14:49<29:56:05,  3.42it/s]
  1%|          | 3100/371472 [14:50<28:18:15,  3.62it/s]
                                                        
{'loss': 5.5975, 'learning_rate': 9.929701135555604e-07, 'epoch': 0.13}

  1%|          | 3100/371472 [14:50<28:18:15,  3.62it/s]
  1%|          | 3101/371472 [14:50<31:14:17,  3.28it/s]
  1%|          | 3102/371472 [14:50<30:05:41,  3.40it/s]
  1%|          | 3103/371472 [14:51<30:47:06,  3.32it/s]
  1%|          | 3104/371472 [14:51<30:36:27,  3.34it/s]
  1%|          | 3105/371472 [14:51<28:48:09,  3.55it/s]
  1%|          | 3106/371472 [14:51<30:36:15,  3.34it/s]
  1%|          | 3107/371472 [14:52<28:38:53,  3.57it/s]
  1%|          | 3108/371472 [14:52<28:19:50,  3.61it/s]
  1%|          | 3109/371472 [14:52<27:22:17,  3.74it/s]
  1%|          | 3110/371472 [14:52<27:23:39,  3.74it/s]
  1%|          | 3111/371472 [14:53<27:18:39,  3.75it/s]
  1%|          | 3112/371472 [14:53<26:34:15,  3.85it/s]
  1%|          | 3113/371472 [14:53<26:10:59,  3.91it/s]
  1%|          | 3114/371472 [14:54<28:01:29,  3.65it/s]
  1%|          | 3115/371472 [14:54<28:30:46,  3.59it/s]
  1%|          | 3116/371472 [14:54<28:10:48,  3.63it/s]
  1%|          | 3117/371472 [14:54<28:39:09,  3.57it/s]
  1%|          | 3118/371472 [14:55<27:29:49,  3.72it/s]
  1%|          | 3119/371472 [14:55<28:29:03,  3.59it/s]
  1%|          | 3120/371472 [14:55<28:58:09,  3.53it/s]
                                                        
{'loss': 5.2873, 'learning_rate': 9.929216315800813e-07, 'epoch': 0.13}

  1%|          | 3120/371472 [14:55<28:58:09,  3.53it/s]
  1%|          | 3121/371472 [14:56<29:18:54,  3.49it/s]
  1%|          | 3122/371472 [14:56<28:44:39,  3.56it/s]
  1%|          | 3123/371472 [14:56<27:46:53,  3.68it/s]
  1%|          | 3124/371472 [14:56<28:02:49,  3.65it/s]
  1%|          | 3125/371472 [14:57<26:50:29,  3.81it/s]
  1%|          | 3126/371472 [14:57<28:08:51,  3.64it/s]
  1%|          | 3127/371472 [14:57<28:50:18,  3.55it/s]
  1%|          | 3128/371472 [14:57<27:38:43,  3.70it/s]
  1%|          | 3129/371472 [14:58<27:43:16,  3.69it/s]
  1%|          | 3130/371472 [14:58<27:19:26,  3.74it/s]
  1%|          | 3131/371472 [14:58<27:15:47,  3.75it/s]
  1%|          | 3132/371472 [14:58<28:10:57,  3.63it/s]
  1%|          | 3133/371472 [14:59<29:56:48,  3.42it/s]
  1%|          | 3134/371472 [14:59<31:22:25,  3.26it/s]
  1%|          | 3135/371472 [14:59<30:23:04,  3.37it/s]
  1%|          | 3136/371472 [15:00<29:27:24,  3.47it/s]
  1%|          | 3137/371472 [15:00<29:13:16,  3.50it/s]
  1%|          | 3138/371472 [15:00<31:42:37,  3.23it/s]
  1%|          | 3139/371472 [15:01<35:05:59,  2.91it/s]
  1%|          | 3140/371472 [15:01<32:52:52,  3.11it/s]
                                                        
{'loss': 5.4276, 'learning_rate': 9.928731496046025e-07, 'epoch': 0.14}

  1%|          | 3140/371472 [15:01<32:52:52,  3.11it/s]
  1%|          | 3141/371472 [15:01<31:23:58,  3.26it/s]
  1%|          | 3142/371472 [15:02<29:53:07,  3.42it/s]
  1%|          | 3143/371472 [15:02<29:16:40,  3.49it/s]
  1%|          | 3144/371472 [15:02<28:13:59,  3.62it/s]
  1%|          | 3145/371472 [15:02<30:48:15,  3.32it/s]
  1%|          | 3146/371472 [15:03<29:27:38,  3.47it/s]
  1%|          | 3147/371472 [15:03<28:18:02,  3.62it/s]
  1%|          | 3148/371472 [15:03<28:13:03,  3.63it/s]
  1%|          | 3149/371472 [15:04<28:28:51,  3.59it/s]
  1%|          | 3150/371472 [15:04<27:55:38,  3.66it/s]
  1%|          | 3151/371472 [15:04<28:23:27,  3.60it/s]
  1%|          | 3152/371472 [15:04<28:53:43,  3.54it/s]
  1%|          | 3153/371472 [15:05<29:21:32,  3.48it/s]
  1%|          | 3154/371472 [15:05<28:01:46,  3.65it/s]
  1%|          | 3155/371472 [15:05<27:32:14,  3.72it/s]
  1%|          | 3156/371472 [15:05<28:32:20,  3.58it/s]
  1%|          | 3157/371472 [15:06<28:43:36,  3.56it/s]
  1%|          | 3158/371472 [15:06<28:26:59,  3.60it/s]
  1%|          | 3159/371472 [15:06<28:24:43,  3.60it/s]
  1%|          | 3160/371472 [15:07<27:40:01,  3.70it/s]
                                                        
{'loss': 5.4971, 'learning_rate': 9.928246676291236e-07, 'epoch': 0.14}

  1%|          | 3160/371472 [15:07<27:40:01,  3.70it/s]
  1%|          | 3161/371472 [15:07<28:29:29,  3.59it/s]
  1%|          | 3162/371472 [15:07<31:18:08,  3.27it/s]
  1%|          | 3163/371472 [15:08<31:13:58,  3.28it/s]
  1%|          | 3164/371472 [15:08<29:15:52,  3.50it/s]
  1%|          | 3165/371472 [15:08<32:49:05,  3.12it/s]
  1%|          | 3166/371472 [15:08<31:16:43,  3.27it/s]
  1%|          | 3167/371472 [15:09<29:47:04,  3.43it/s]
  1%|          | 3168/371472 [15:09<29:00:58,  3.53it/s]
  1%|          | 3169/371472 [15:09<29:46:52,  3.44it/s]
  1%|          | 3170/371472 [15:10<29:01:41,  3.52it/s]
  1%|          | 3171/371472 [15:10<30:29:11,  3.36it/s]
  1%|          | 3172/371472 [15:10<30:40:02,  3.34it/s]
  1%|          | 3173/371472 [15:10<29:25:30,  3.48it/s]
  1%|          | 3174/371472 [15:11<28:26:55,  3.60it/s]
  1%|          | 3175/371472 [15:11<28:39:54,  3.57it/s]
  1%|          | 3176/371472 [15:11<28:17:13,  3.62it/s]
  1%|          | 3177/371472 [15:12<28:55:45,  3.54it/s]
  1%|          | 3178/371472 [15:12<30:01:07,  3.41it/s]
  1%|          | 3179/371472 [15:12<33:00:11,  3.10it/s]
  1%|          | 3180/371472 [15:12<31:00:11,  3.30it/s]
                                                        
{'loss': 5.6698, 'learning_rate': 9.927761856536447e-07, 'epoch': 0.14}

  1%|          | 3180/371472 [15:12<31:00:11,  3.30it/s]
  1%|          | 3181/371472 [15:13<29:54:03,  3.42it/s]
  1%|          | 3182/371472 [15:13<28:53:36,  3.54it/s]
  1%|          | 3183/371472 [15:13<29:23:21,  3.48it/s]
  1%|          | 3184/371472 [15:14<28:08:31,  3.64it/s]
  1%|          | 3185/371472 [15:14<27:16:58,  3.75it/s]
  1%|          | 3186/371472 [15:14<27:19:44,  3.74it/s]
  1%|          | 3187/371472 [15:14<29:50:33,  3.43it/s]
  1%|          | 3188/371472 [15:15<29:55:52,  3.42it/s]
  1%|          | 3189/371472 [15:15<29:47:07,  3.43it/s]
  1%|          | 3190/371472 [15:15<28:16:36,  3.62it/s]
  1%|          | 3191/371472 [15:16<27:50:31,  3.67it/s]
  1%|          | 3192/371472 [15:16<28:10:00,  3.63it/s]
  1%|          | 3193/371472 [15:16<28:38:04,  3.57it/s]
  1%|          | 3194/371472 [15:16<28:02:11,  3.65it/s]
  1%|          | 3195/371472 [15:17<28:06:53,  3.64it/s]
  1%|          | 3196/371472 [15:17<28:51:43,  3.54it/s]
  1%|          | 3197/371472 [15:17<29:43:07,  3.44it/s]
  1%|          | 3198/371472 [15:17<28:52:32,  3.54it/s]
  1%|          | 3199/371472 [15:18<28:26:27,  3.60it/s]
  1%|          | 3200/371472 [15:18<30:11:44,  3.39it/s]
                                                        
{'loss': 5.7259, 'learning_rate': 9.927277036781658e-07, 'epoch': 0.14}

  1%|          | 3200/371472 [15:18<30:11:44,  3.39it/s]
  1%|          | 3201/371472 [15:18<30:05:25,  3.40it/s]
  1%|          | 3202/371472 [15:19<31:24:00,  3.26it/s]
  1%|          | 3203/371472 [15:19<31:14:25,  3.27it/s]
  1%|          | 3204/371472 [15:19<30:22:35,  3.37it/s]
  1%|          | 3205/371472 [15:20<31:02:39,  3.30it/s]
  1%|          | 3206/371472 [15:20<29:21:04,  3.49it/s]
  1%|          | 3207/371472 [15:20<29:16:06,  3.50it/s]
  1%|          | 3208/371472 [15:20<28:20:34,  3.61it/s]
  1%|          | 3209/371472 [15:21<27:39:23,  3.70it/s]
  1%|          | 3210/371472 [15:21<27:19:53,  3.74it/s]
  1%|          | 3211/371472 [15:21<29:01:46,  3.52it/s]
  1%|          | 3212/371472 [15:22<28:34:39,  3.58it/s]
  1%|          | 3213/371472 [15:22<28:12:30,  3.63it/s]
  1%|          | 3214/371472 [15:22<29:18:33,  3.49it/s]
  1%|          | 3215/371472 [15:22<28:05:19,  3.64it/s]
  1%|          | 3216/371472 [15:23<27:52:54,  3.67it/s]
  1%|          | 3217/371472 [15:23<28:12:08,  3.63it/s]
  1%|          | 3218/371472 [15:23<27:24:09,  3.73it/s]
  1%|          | 3219/371472 [15:23<28:21:06,  3.61it/s]
  1%|          | 3220/371472 [15:24<28:03:59,  3.64it/s]
                                                        
{'loss': 5.5365, 'learning_rate': 9.926792217026868e-07, 'epoch': 0.14}

  1%|          | 3220/371472 [15:24<28:03:59,  3.64it/s]
  1%|          | 3221/371472 [15:24<27:13:53,  3.76it/s]
  1%|          | 3222/371472 [15:24<29:15:18,  3.50it/s]
  1%|          | 3223/371472 [15:25<28:39:20,  3.57it/s]
  1%|          | 3224/371472 [15:25<28:38:53,  3.57it/s]
  1%|          | 3225/371472 [15:25<29:55:14,  3.42it/s]
  1%|          | 3226/371472 [15:25<28:50:56,  3.55it/s]
  1%|          | 3227/371472 [15:26<28:22:50,  3.60it/s]
  1%|          | 3228/371472 [15:26<29:26:51,  3.47it/s]
  1%|          | 3229/371472 [15:26<28:09:42,  3.63it/s]
  1%|          | 3230/371472 [15:27<28:51:25,  3.54it/s]
  1%|          | 3231/371472 [15:27<30:07:01,  3.40it/s]
  1%|          | 3232/371472 [15:27<28:23:54,  3.60it/s]
  1%|          | 3233/371472 [15:27<28:23:59,  3.60it/s]
  1%|          | 3234/371472 [15:28<27:44:01,  3.69it/s]
  1%|          | 3235/371472 [15:28<28:30:00,  3.59it/s]
  1%|          | 3236/371472 [15:28<29:38:44,  3.45it/s]
  1%|          | 3237/371472 [15:28<28:27:02,  3.60it/s]
  1%|          | 3238/371472 [15:29<27:45:28,  3.68it/s]
  1%|          | 3239/371472 [15:29<27:29:44,  3.72it/s]
  1%|          | 3240/371472 [15:29<26:52:24,  3.81it/s]
                                                        
{'loss': 5.5269, 'learning_rate': 9.926307397272081e-07, 'epoch': 0.14}

  1%|          | 3240/371472 [15:29<26:52:24,  3.81it/s]
  1%|          | 3241/371472 [15:30<26:50:00,  3.81it/s]
  1%|          | 3242/371472 [15:30<29:10:36,  3.51it/s]
  1%|          | 3243/371472 [15:30<27:52:43,  3.67it/s]
  1%|          | 3244/371472 [15:30<28:11:51,  3.63it/s]
  1%|          | 3245/371472 [15:31<27:34:58,  3.71it/s]
  1%|          | 3246/371472 [15:31<28:06:50,  3.64it/s]
  1%|          | 3247/371472 [15:31<27:50:16,  3.67it/s]
  1%|          | 3248/371472 [15:31<27:50:32,  3.67it/s]
  1%|          | 3249/371472 [15:32<26:59:25,  3.79it/s]
  1%|          | 3250/371472 [15:32<26:50:24,  3.81it/s]
  1%|          | 3251/371472 [15:32<26:16:50,  3.89it/s]
  1%|          | 3252/371472 [15:32<25:45:52,  3.97it/s]
  1%|          | 3253/371472 [15:33<28:18:01,  3.61it/s]
  1%|          | 3254/371472 [15:33<31:30:59,  3.25it/s]
  1%|          | 3255/371472 [15:33<31:13:43,  3.28it/s]
  1%|          | 3256/371472 [15:34<30:53:43,  3.31it/s]
  1%|          | 3257/371472 [15:34<29:38:29,  3.45it/s]
  1%|          | 3258/371472 [15:34<28:18:58,  3.61it/s]
  1%|          | 3259/371472 [15:35<27:38:44,  3.70it/s]
  1%|          | 3260/371472 [15:35<27:07:38,  3.77it/s]
                                                        
{'loss': 5.4957, 'learning_rate': 9.925822577517292e-07, 'epoch': 0.14}

  1%|          | 3260/371472 [15:35<27:07:38,  3.77it/s]
  1%|          | 3261/371472 [15:35<28:41:41,  3.56it/s]
  1%|          | 3262/371472 [15:35<29:05:41,  3.52it/s]
  1%|          | 3263/371472 [15:36<27:46:44,  3.68it/s]
  1%|          | 3264/371472 [15:36<27:27:09,  3.73it/s]
  1%|          | 3265/371472 [15:36<27:48:59,  3.68it/s]
  1%|          | 3266/371472 [15:37<30:30:36,  3.35it/s]
  1%|          | 3267/371472 [15:37<29:20:27,  3.49it/s]
  1%|          | 3268/371472 [15:37<29:00:38,  3.53it/s]
  1%|          | 3269/371472 [15:37<31:18:22,  3.27it/s]
  1%|          | 3270/371472 [15:38<29:37:21,  3.45it/s]
  1%|          | 3271/371472 [15:38<29:34:51,  3.46it/s]
  1%|          | 3272/371472 [15:38<30:32:58,  3.35it/s]
  1%|          | 3273/371472 [15:39<29:51:42,  3.43it/s]
  1%|          | 3274/371472 [15:39<30:41:47,  3.33it/s]
  1%|          | 3275/371472 [15:39<31:07:19,  3.29it/s]
  1%|          | 3276/371472 [15:39<29:38:25,  3.45it/s]
  1%|          | 3277/371472 [15:40<29:52:33,  3.42it/s]
  1%|          | 3278/371472 [15:40<29:35:09,  3.46it/s]
  1%|          | 3279/371472 [15:40<27:48:26,  3.68it/s]
  1%|          | 3280/371472 [15:41<28:17:19,  3.62it/s]
                                                        
{'loss': 5.15, 'learning_rate': 9.925337757762503e-07, 'epoch': 0.14}

  1%|          | 3280/371472 [15:41<28:17:19,  3.62it/s]
  1%|          | 3281/371472 [15:41<28:27:04,  3.59it/s]
  1%|          | 3282/371472 [15:41<28:47:48,  3.55it/s]
  1%|          | 3283/371472 [15:41<28:29:50,  3.59it/s]
  1%|          | 3284/371472 [15:42<27:17:54,  3.75it/s]
  1%|          | 3285/371472 [15:42<27:30:40,  3.72it/s]
  1%|          | 3286/371472 [15:42<28:30:17,  3.59it/s]
  1%|          | 3287/371472 [15:42<27:21:55,  3.74it/s]
  1%|          | 3288/371472 [15:43<26:59:27,  3.79it/s]
  1%|          | 3289/371472 [15:43<26:35:04,  3.85it/s]
  1%|          | 3290/371472 [15:43<26:37:33,  3.84it/s]
  1%|          | 3291/371472 [15:43<26:56:20,  3.80it/s]
  1%|          | 3292/371472 [15:44<27:45:18,  3.68it/s]
  1%|          | 3293/371472 [15:44<28:24:30,  3.60it/s]
  1%|          | 3294/371472 [15:44<28:18:34,  3.61it/s]
  1%|          | 3295/371472 [15:45<27:54:14,  3.67it/s]
  1%|          | 3296/371472 [15:45<27:31:41,  3.72it/s]
  1%|          | 3297/371472 [15:45<29:48:36,  3.43it/s]
  1%|          | 3298/371472 [15:45<28:25:11,  3.60it/s]
  1%|          | 3299/371472 [15:46<29:39:31,  3.45it/s]
  1%|          | 3300/371472 [15:46<28:48:25,  3.55it/s]
                                                        
{'loss': 5.3415, 'learning_rate': 9.924852938007715e-07, 'epoch': 0.14}

  1%|          | 3300/371472 [15:46<28:48:25,  3.55it/s]
  1%|          | 3301/371472 [15:46<28:53:43,  3.54it/s]
  1%|          | 3302/371472 [15:47<28:32:27,  3.58it/s]
  1%|          | 3303/371472 [15:47<28:09:10,  3.63it/s]
  1%|          | 3304/371472 [15:47<28:23:55,  3.60it/s]
  1%|          | 3305/371472 [15:47<28:48:48,  3.55it/s]
  1%|          | 3306/371472 [15:48<28:41:27,  3.56it/s]
  1%|          | 3307/371472 [15:48<31:44:21,  3.22it/s]
  1%|          | 3308/371472 [15:48<32:25:48,  3.15it/s]
  1%|          | 3309/371472 [15:49<30:34:36,  3.34it/s]
  1%|          | 3310/371472 [15:49<29:06:49,  3.51it/s]
  1%|          | 3311/371472 [15:49<28:38:45,  3.57it/s]
  1%|          | 3312/371472 [15:49<27:59:28,  3.65it/s]
  1%|          | 3313/371472 [15:50<27:03:29,  3.78it/s]
  1%|          | 3314/371472 [15:50<30:02:09,  3.40it/s]
  1%|          | 3315/371472 [15:50<28:45:37,  3.56it/s]
  1%|          | 3316/371472 [15:51<29:32:55,  3.46it/s]
  1%|          | 3317/371472 [15:51<29:16:55,  3.49it/s]
  1%|          | 3318/371472 [15:51<28:27:29,  3.59it/s]
  1%|          | 3319/371472 [15:51<29:06:42,  3.51it/s]
  1%|          | 3320/371472 [15:52<28:26:54,  3.59it/s]
                                                        
{'loss': 5.446, 'learning_rate': 9.924368118252924e-07, 'epoch': 0.14}

  1%|          | 3320/371472 [15:52<28:26:54,  3.59it/s]
  1%|          | 3321/371472 [15:52<30:32:07,  3.35it/s]
  1%|          | 3322/371472 [15:52<29:37:50,  3.45it/s]
  1%|          | 3323/371472 [15:53<28:20:44,  3.61it/s]
  1%|          | 3324/371472 [15:53<29:17:24,  3.49it/s]
  1%|          | 3325/371472 [15:53<30:14:29,  3.38it/s]
  1%|          | 3326/371472 [15:54<30:30:22,  3.35it/s]
  1%|          | 3327/371472 [15:54<30:13:14,  3.38it/s]
  1%|          | 3328/371472 [15:54<32:05:39,  3.19it/s]
  1%|          | 3329/371472 [15:54<29:41:59,  3.44it/s]
  1%|          | 3330/371472 [15:55<28:36:20,  3.57it/s]
  1%|          | 3331/371472 [15:55<31:31:32,  3.24it/s]
  1%|          | 3332/371472 [15:55<29:38:51,  3.45it/s]
  1%|          | 3333/371472 [15:56<29:43:29,  3.44it/s]
  1%|          | 3334/371472 [15:56<29:13:55,  3.50it/s]
  1%|          | 3335/371472 [15:56<27:57:22,  3.66it/s]
  1%|          | 3336/371472 [15:56<27:11:04,  3.76it/s]
  1%|          | 3337/371472 [15:57<27:22:01,  3.74it/s]
  1%|          | 3338/371472 [15:57<27:06:52,  3.77it/s]
  1%|          | 3339/371472 [15:57<26:49:42,  3.81it/s]
  1%|          | 3340/371472 [15:57<28:22:39,  3.60it/s]
                                                        
{'loss': 5.4782, 'learning_rate': 9.923883298498137e-07, 'epoch': 0.14}

  1%|          | 3340/371472 [15:57<28:22:39,  3.60it/s]
  1%|          | 3341/371472 [15:58<26:57:07,  3.79it/s]
  1%|          | 3342/371472 [15:58<28:11:03,  3.63it/s]
  1%|          | 3343/371472 [15:58<29:15:54,  3.49it/s]
  1%|          | 3344/371472 [15:59<28:44:24,  3.56it/s]
  1%|          | 3345/371472 [15:59<28:52:06,  3.54it/s]
  1%|          | 3346/371472 [15:59<28:41:28,  3.56it/s]
  1%|          | 3347/371472 [15:59<27:20:51,  3.74it/s]
  1%|          | 3348/371472 [16:00<28:14:15,  3.62it/s]
  1%|          | 3349/371472 [16:00<26:53:25,  3.80it/s]
  1%|          | 3350/371472 [16:00<26:58:06,  3.79it/s]
  1%|          | 3351/371472 [16:00<28:47:23,  3.55it/s]
  1%|          | 3352/371472 [16:01<28:09:04,  3.63it/s]
  1%|          | 3353/371472 [16:01<27:48:45,  3.68it/s]
  1%|          | 3354/371472 [16:01<27:13:37,  3.76it/s]
  1%|          | 3355/371472 [16:02<28:46:20,  3.55it/s]
  1%|          | 3356/371472 [16:02<28:09:32,  3.63it/s]
  1%|          | 3357/371472 [16:02<27:45:18,  3.68it/s]
  1%|          | 3358/371472 [16:02<27:47:05,  3.68it/s]
  1%|          | 3359/371472 [16:03<28:27:21,  3.59it/s]
  1%|          | 3360/371472 [16:03<29:03:49,  3.52it/s]
                                                        
{'loss': 5.7166, 'learning_rate': 9.923398478743345e-07, 'epoch': 0.14}

  1%|          | 3360/371472 [16:03<29:03:49,  3.52it/s]
  1%|          | 3361/371472 [16:03<30:00:45,  3.41it/s]
  1%|          | 3362/371472 [16:04<28:39:53,  3.57it/s]
  1%|          | 3363/371472 [16:04<27:49:22,  3.68it/s]
  1%|          | 3364/371472 [16:04<28:38:34,  3.57it/s]
  1%|          | 3365/371472 [16:04<27:35:20,  3.71it/s]
  1%|          | 3366/371472 [16:05<26:46:04,  3.82it/s]
  1%|          | 3367/371472 [16:05<27:14:28,  3.75it/s]
  1%|          | 3368/371472 [16:05<28:12:11,  3.63it/s]
  1%|          | 3369/371472 [16:05<27:02:39,  3.78it/s]
  1%|          | 3370/371472 [16:06<27:12:45,  3.76it/s]
  1%|          | 3371/371472 [16:06<27:57:59,  3.66it/s]
  1%|          | 3372/371472 [16:06<27:38:49,  3.70it/s]
  1%|          | 3373/371472 [16:06<27:50:47,  3.67it/s]
  1%|          | 3374/371472 [16:07<28:06:19,  3.64it/s]
  1%|          | 3375/371472 [16:07<28:12:11,  3.63it/s]
  1%|          | 3376/371472 [16:07<27:11:55,  3.76it/s]
  1%|          | 3377/371472 [16:08<26:19:12,  3.88it/s]
  1%|          | 3378/371472 [16:08<26:14:42,  3.90it/s]
  1%|          | 3379/371472 [16:08<26:16:23,  3.89it/s]
  1%|          | 3380/371472 [16:08<27:36:02,  3.70it/s]
                                                        
{'loss': 5.2477, 'learning_rate': 9.922913658988558e-07, 'epoch': 0.15}

  1%|          | 3380/371472 [16:08<27:36:02,  3.70it/s]
  1%|          | 3381/371472 [16:09<28:30:17,  3.59it/s]
  1%|          | 3382/371472 [16:09<28:14:19,  3.62it/s]
  1%|          | 3383/371472 [16:09<27:59:58,  3.65it/s]
  1%|          | 3384/371472 [16:10<30:51:30,  3.31it/s]
  1%|          | 3385/371472 [16:10<32:11:18,  3.18it/s]
  1%|          | 3386/371472 [16:10<32:10:40,  3.18it/s]
  1%|          | 3387/371472 [16:10<30:19:47,  3.37it/s]
  1%|          | 3388/371472 [16:11<29:11:35,  3.50it/s]
  1%|          | 3389/371472 [16:11<30:52:54,  3.31it/s]
  1%|          | 3390/371472 [16:11<30:17:42,  3.37it/s]
  1%|          | 3391/371472 [16:12<29:28:37,  3.47it/s]
  1%|          | 3392/371472 [16:12<29:13:41,  3.50it/s]
  1%|          | 3393/371472 [16:12<29:14:24,  3.50it/s]
  1%|          | 3394/371472 [16:12<28:20:48,  3.61it/s]
  1%|          | 3395/371472 [16:13<28:59:08,  3.53it/s]
  1%|          | 3396/371472 [16:13<29:02:50,  3.52it/s]
  1%|          | 3397/371472 [16:13<28:47:54,  3.55it/s]
  1%|          | 3398/371472 [16:14<29:50:37,  3.43it/s]
  1%|          | 3399/371472 [16:14<29:52:44,  3.42it/s]
  1%|          | 3400/371472 [16:14<28:46:09,  3.55it/s]
                                                        
{'loss': 5.5064, 'learning_rate': 9.92242883923377e-07, 'epoch': 0.15}

  1%|          | 3400/371472 [16:14<28:46:09,  3.55it/s]
  1%|          | 3401/371472 [16:14<28:04:56,  3.64it/s]
  1%|          | 3402/371472 [16:15<28:08:13,  3.63it/s]
  1%|          | 3403/371472 [16:15<29:31:33,  3.46it/s]
  1%|          | 3404/371472 [16:15<28:20:37,  3.61it/s]
  1%|          | 3405/371472 [16:16<27:57:29,  3.66it/s]
  1%|          | 3406/371472 [16:16<29:03:22,  3.52it/s]
  1%|          | 3407/371472 [16:16<29:51:56,  3.42it/s]
  1%|          | 3408/371472 [16:16<28:38:48,  3.57it/s]
  1%|          | 3409/371472 [16:17<27:20:18,  3.74it/s]
  1%|          | 3410/371472 [16:17<29:36:17,  3.45it/s]
  1%|          | 3411/371472 [16:17<29:14:17,  3.50it/s]
  1%|          | 3412/371472 [16:17<27:49:29,  3.67it/s]
  1%|          | 3413/371472 [16:18<27:55:52,  3.66it/s]
  1%|          | 3414/371472 [16:18<28:46:10,  3.55it/s]
  1%|          | 3415/371472 [16:18<28:22:46,  3.60it/s]
  1%|          | 3416/371472 [16:19<29:45:06,  3.44it/s]
  1%|          | 3417/371472 [16:19<28:06:32,  3.64it/s]
  1%|          | 3418/371472 [16:19<28:44:03,  3.56it/s]
  1%|          | 3419/371472 [16:19<29:26:27,  3.47it/s]
  1%|          | 3420/371472 [16:20<31:09:29,  3.28it/s]
                                                        
{'loss': 5.1118, 'learning_rate': 9.92194401947898e-07, 'epoch': 0.15}

  1%|          | 3420/371472 [16:20<31:09:29,  3.28it/s]
  1%|          | 3421/371472 [16:20<29:39:30,  3.45it/s]
  1%|          | 3422/371472 [16:20<29:22:23,  3.48it/s]
  1%|          | 3423/371472 [16:21<27:53:09,  3.67it/s]
  1%|          | 3424/371472 [16:21<27:04:15,  3.78it/s]
  1%|          | 3425/371472 [16:21<26:47:21,  3.82it/s]
  1%|          | 3426/371472 [16:21<27:09:50,  3.76it/s]
  1%|          | 3427/371472 [16:22<26:42:20,  3.83it/s]
  1%|          | 3428/371472 [16:22<26:26:57,  3.87it/s]
  1%|          | 3429/371472 [16:22<25:53:35,  3.95it/s]
  1%|          | 3430/371472 [16:22<27:04:49,  3.78it/s]
  1%|          | 3431/371472 [16:23<26:46:14,  3.82it/s]
  1%|          | 3432/371472 [16:23<29:06:22,  3.51it/s]
  1%|          | 3433/371472 [16:23<28:15:35,  3.62it/s]
  1%|          | 3434/371472 [16:24<27:51:45,  3.67it/s]
  1%|          | 3435/371472 [16:24<27:28:45,  3.72it/s]
  1%|          | 3436/371472 [16:24<27:07:54,  3.77it/s]
  1%|          | 3437/371472 [16:24<26:53:09,  3.80it/s]
  1%|          | 3438/371472 [16:25<26:40:16,  3.83it/s]
  1%|          | 3439/371472 [16:25<27:35:22,  3.71it/s]
  1%|          | 3440/371472 [16:25<28:02:51,  3.64it/s]
                                                        
{'loss': 5.6227, 'learning_rate': 9.921459199724193e-07, 'epoch': 0.15}

  1%|          | 3440/371472 [16:25<28:02:51,  3.64it/s]
  1%|          | 3441/371472 [16:25<27:29:49,  3.72it/s]
  1%|          | 3442/371472 [16:26<27:00:42,  3.78it/s]
  1%|          | 3443/371472 [16:26<26:37:08,  3.84it/s]
  1%|          | 3444/371472 [16:26<27:04:14,  3.78it/s]
  1%|          | 3445/371472 [16:26<28:11:14,  3.63it/s]
  1%|          | 3446/371472 [16:27<28:26:10,  3.60it/s]
  1%|          | 3447/371472 [16:27<27:57:40,  3.66it/s]
  1%|          | 3448/371472 [16:27<27:33:27,  3.71it/s]
  1%|          | 3449/371472 [16:28<27:27:13,  3.72it/s]
  1%|          | 3450/371472 [16:28<28:39:17,  3.57it/s]
  1%|          | 3451/371472 [16:28<27:35:08,  3.71it/s]
  1%|          | 3452/371472 [16:28<28:28:10,  3.59it/s]
  1%|          | 3453/371472 [16:29<28:26:18,  3.59it/s]
  1%|          | 3454/371472 [16:29<28:26:41,  3.59it/s]
  1%|          | 3455/371472 [16:29<28:27:43,  3.59it/s]
  1%|          | 3456/371472 [16:30<28:26:51,  3.59it/s]
  1%|          | 3457/371472 [16:30<28:49:31,  3.55it/s]
  1%|          | 3458/371472 [16:30<28:11:25,  3.63it/s]
  1%|          | 3459/371472 [16:30<27:39:17,  3.70it/s]
  1%|          | 3460/371472 [16:31<27:16:37,  3.75it/s]
                                                        
{'loss': 5.2942, 'learning_rate': 9.920974379969401e-07, 'epoch': 0.15}

  1%|          | 3460/371472 [16:31<27:16:37,  3.75it/s]
  1%|          | 3461/371472 [16:31<27:30:13,  3.72it/s]
  1%|          | 3462/371472 [16:31<27:58:59,  3.65it/s]
  1%|          | 3463/371472 [16:31<27:28:02,  3.72it/s]
  1%|          | 3464/371472 [16:32<26:53:10,  3.80it/s]
  1%|          | 3465/371472 [16:32<27:08:43,  3.77it/s]
  1%|          | 3466/371472 [16:32<26:58:36,  3.79it/s]
  1%|          | 3467/371472 [16:32<27:11:52,  3.76it/s]
  1%|          | 3468/371472 [16:33<27:12:25,  3.76it/s]
  1%|          | 3469/371472 [16:33<27:31:28,  3.71it/s]
  1%|          | 3470/371472 [16:33<27:42:29,  3.69it/s]
  1%|          | 3471/371472 [16:34<26:56:38,  3.79it/s]
  1%|          | 3472/371472 [16:34<27:47:49,  3.68it/s]
  1%|          | 3473/371472 [16:34<30:22:16,  3.37it/s]
  1%|          | 3474/371472 [16:34<29:34:31,  3.46it/s]
  1%|          | 3475/371472 [16:35<29:25:32,  3.47it/s]
  1%|          | 3476/371472 [16:35<28:36:47,  3.57it/s]
  1%|          | 3477/371472 [16:35<28:06:43,  3.64it/s]
  1%|          | 3478/371472 [16:36<28:13:36,  3.62it/s]
  1%|          | 3479/371472 [16:36<27:41:23,  3.69it/s]
  1%|          | 3480/371472 [16:36<28:38:44,  3.57it/s]
                                                        
{'loss': 5.5577, 'learning_rate': 9.920489560214614e-07, 'epoch': 0.15}

  1%|          | 3480/371472 [16:36<28:38:44,  3.57it/s]
  1%|          | 3481/371472 [16:36<28:09:26,  3.63it/s]
  1%|          | 3482/371472 [16:37<27:12:51,  3.76it/s]
  1%|          | 3483/371472 [16:37<27:29:24,  3.72it/s]
  1%|          | 3484/371472 [16:37<26:33:07,  3.85it/s]
  1%|          | 3485/371472 [16:37<27:33:50,  3.71it/s]
  1%|          | 3486/371472 [16:38<26:55:20,  3.80it/s]
  1%|          | 3487/371472 [16:38<27:05:10,  3.77it/s]
  1%|          | 3488/371472 [16:38<26:15:06,  3.89it/s]
  1%|          | 3489/371472 [16:38<27:08:11,  3.77it/s]
  1%|          | 3490/371472 [16:39<27:25:46,  3.73it/s]
  1%|          | 3491/371472 [16:39<26:31:00,  3.85it/s]
  1%|          | 3492/371472 [16:39<27:12:08,  3.76it/s]
  1%|          | 3493/371472 [16:40<28:20:48,  3.61it/s]
  1%|          | 3494/371472 [16:40<28:05:49,  3.64it/s]
  1%|          | 3495/371472 [16:40<28:17:07,  3.61it/s]
  1%|          | 3496/371472 [16:40<28:23:16,  3.60it/s]
  1%|          | 3497/371472 [16:41<27:32:24,  3.71it/s]
  1%|          | 3498/371472 [16:41<28:14:03,  3.62it/s]
  1%|          | 3499/371472 [16:41<28:26:24,  3.59it/s]
  1%|          | 3500/371472 [16:41<28:37:12,  3.57it/s]
                                                        
{'loss': 5.2978, 'learning_rate': 9.920004740459823e-07, 'epoch': 0.15}

  1%|          | 3500/371472 [16:41<28:37:12,  3.57it/s]
  1%|          | 3501/371472 [16:42<28:09:22,  3.63it/s]
  1%|          | 3502/371472 [16:42<27:22:31,  3.73it/s]
  1%|          | 3503/371472 [16:42<27:34:39,  3.71it/s]
  1%|          | 3504/371472 [16:43<27:18:35,  3.74it/s]
  1%|          | 3505/371472 [16:43<27:53:04,  3.67it/s]
  1%|          | 3506/371472 [16:43<27:36:37,  3.70it/s]
  1%|          | 3507/371472 [16:43<29:42:01,  3.44it/s]
  1%|          | 3508/371472 [16:44<29:40:15,  3.44it/s]
  1%|          | 3509/371472 [16:44<28:57:56,  3.53it/s]
  1%|          | 3510/371472 [16:44<29:12:42,  3.50it/s]
  1%|          | 3511/371472 [16:45<29:08:54,  3.51it/s]
  1%|          | 3512/371472 [16:45<28:00:51,  3.65it/s]
  1%|          | 3513/371472 [16:45<27:50:54,  3.67it/s]
  1%|          | 3514/371472 [16:45<27:41:44,  3.69it/s]
  1%|          | 3515/371472 [16:46<29:07:27,  3.51it/s]
  1%|          | 3516/371472 [16:46<27:37:07,  3.70it/s]
  1%|          | 3517/371472 [16:46<27:44:07,  3.69it/s]
  1%|          | 3518/371472 [16:46<27:38:01,  3.70it/s]
  1%|          | 3519/371472 [16:47<27:49:58,  3.67it/s]
  1%|          | 3520/371472 [16:47<27:46:33,  3.68it/s]
                                                        
{'loss': 5.4462, 'learning_rate': 9.919519920705035e-07, 'epoch': 0.15}

  1%|          | 3520/371472 [16:47<27:46:33,  3.68it/s]
  1%|          | 3521/371472 [16:47<29:43:25,  3.44it/s]
  1%|          | 3522/371472 [16:48<28:36:51,  3.57it/s]
  1%|          | 3523/371472 [16:48<27:42:01,  3.69it/s]
  1%|          | 3524/371472 [16:48<27:05:11,  3.77it/s]
  1%|          | 3525/371472 [16:48<28:39:51,  3.57it/s]
  1%|          | 3526/371472 [16:49<29:09:18,  3.51it/s]
  1%|          | 3527/371472 [16:49<29:10:45,  3.50it/s]
  1%|          | 3528/371472 [16:49<29:42:44,  3.44it/s]
  1%|          | 3529/371472 [16:50<29:08:14,  3.51it/s]
  1%|          | 3530/371472 [16:50<29:34:27,  3.46it/s]
  1%|          | 3531/371472 [16:50<29:53:55,  3.42it/s]
  1%|          | 3532/371472 [16:50<29:24:11,  3.48it/s]
  1%|          | 3533/371472 [16:51<28:29:42,  3.59it/s]
  1%|          | 3534/371472 [16:51<28:20:41,  3.61it/s]
  1%|          | 3535/371472 [16:51<28:38:49,  3.57it/s]
  1%|          | 3536/371472 [16:52<31:10:00,  3.28it/s]
  1%|          | 3537/371472 [16:52<31:05:56,  3.29it/s]
  1%|          | 3538/371472 [16:52<34:30:14,  2.96it/s]
  1%|          | 3539/371472 [16:53<32:44:59,  3.12it/s]
  1%|          | 3540/371472 [16:53<32:19:40,  3.16it/s]
                                                        
{'loss': 5.322, 'learning_rate': 9.919035100950246e-07, 'epoch': 0.15}

  1%|          | 3540/371472 [16:53<32:19:40,  3.16it/s]
  1%|          | 3541/371472 [16:53<31:01:59,  3.29it/s]
  1%|          | 3542/371472 [16:53<30:04:54,  3.40it/s]
  1%|          | 3543/371472 [16:54<29:31:34,  3.46it/s]
  1%|          | 3544/371472 [16:54<28:38:25,  3.57it/s]
  1%|          | 3545/371472 [16:54<27:44:11,  3.68it/s]
  1%|          | 3546/371472 [16:55<28:25:05,  3.60it/s]
  1%|          | 3547/371472 [16:55<27:29:37,  3.72it/s]
  1%|          | 3548/371472 [16:55<31:50:26,  3.21it/s]
  1%|          | 3549/371472 [16:55<30:00:10,  3.41it/s]
  1%|          | 3550/371472 [16:56<29:30:26,  3.46it/s]
  1%|          | 3551/371472 [16:56<28:40:58,  3.56it/s]
  1%|          | 3552/371472 [16:56<27:44:38,  3.68it/s]
  1%|          | 3553/371472 [16:57<29:11:02,  3.50it/s]
  1%|          | 3554/371472 [16:57<28:51:28,  3.54it/s]
  1%|          | 3555/371472 [16:57<27:55:53,  3.66it/s]
  1%|          | 3556/371472 [16:57<27:38:00,  3.70it/s]
  1%|          | 3557/371472 [16:58<28:14:19,  3.62it/s]
  1%|          | 3558/371472 [16:58<27:07:23,  3.77it/s]
  1%|          | 3559/371472 [16:58<26:48:56,  3.81it/s]
  1%|          | 3560/371472 [16:58<27:55:10,  3.66it/s]
                                                        
{'loss': 5.1661, 'learning_rate': 9.918550281195457e-07, 'epoch': 0.15}

  1%|          | 3560/371472 [16:58<27:55:10,  3.66it/s]
  1%|          | 3561/371472 [16:59<28:11:49,  3.62it/s]
  1%|          | 3562/371472 [16:59<30:02:24,  3.40it/s]
  1%|          | 3563/371472 [16:59<29:19:56,  3.48it/s]
  1%|          | 3564/371472 [17:00<29:45:43,  3.43it/s]
  1%|          | 3565/371472 [17:00<29:55:55,  3.41it/s]
  1%|          | 3566/371472 [17:00<32:53:21,  3.11it/s]
  1%|          | 3567/371472 [17:01<30:56:25,  3.30it/s]
  1%|          | 3568/371472 [17:01<30:32:32,  3.35it/s]
  1%|          | 3569/371472 [17:01<29:06:14,  3.51it/s]
  1%|          | 3570/371472 [17:01<29:11:55,  3.50it/s]
  1%|          | 3571/371472 [17:02<28:40:06,  3.56it/s]
  1%|          | 3572/371472 [17:02<28:54:30,  3.54it/s]
  1%|          | 3573/371472 [17:02<28:06:57,  3.63it/s]
  1%|          | 3574/371472 [17:02<27:46:16,  3.68it/s]
  1%|          | 3575/371472 [17:03<27:40:43,  3.69it/s]
  1%|          | 3576/371472 [17:03<26:24:10,  3.87it/s]
  1%|          | 3577/371472 [17:03<26:13:28,  3.90it/s]
  1%|          | 3578/371472 [17:04<28:02:25,  3.64it/s]
  1%|          | 3579/371472 [17:04<27:37:04,  3.70it/s]
  1%|          | 3580/371472 [17:04<27:41:26,  3.69it/s]
                                                        
{'loss': 5.4463, 'learning_rate': 9.918065461440668e-07, 'epoch': 0.15}

  1%|          | 3580/371472 [17:04<27:41:26,  3.69it/s]
  1%|          | 3581/371472 [17:04<29:49:15,  3.43it/s]
  1%|          | 3582/371472 [17:05<28:20:03,  3.61it/s]
  1%|          | 3583/371472 [17:05<27:52:11,  3.67it/s]
  1%|          | 3584/371472 [17:05<29:27:22,  3.47it/s]
  1%|          | 3585/371472 [17:06<28:55:47,  3.53it/s]
  1%|          | 3586/371472 [17:06<31:34:45,  3.24it/s]
  1%|          | 3587/371472 [17:06<29:55:30,  3.41it/s]
  1%|          | 3588/371472 [17:06<29:51:07,  3.42it/s]
  1%|          | 3589/371472 [17:07<30:12:48,  3.38it/s]
  1%|          | 3590/371472 [17:07<33:05:48,  3.09it/s]
  1%|          | 3591/371472 [17:07<33:27:30,  3.05it/s]
  1%|          | 3592/371472 [17:08<31:30:24,  3.24it/s]
  1%|          | 3593/371472 [17:08<29:36:38,  3.45it/s]
  1%|          | 3594/371472 [17:08<29:09:30,  3.50it/s]
  1%|          | 3595/371472 [17:09<36:19:39,  2.81it/s]
  1%|          | 3596/371472 [17:09<33:31:58,  3.05it/s]
  1%|          | 3597/371472 [17:09<30:56:44,  3.30it/s]
  1%|          | 3598/371472 [17:10<31:48:07,  3.21it/s]
  1%|          | 3599/371472 [17:10<30:18:53,  3.37it/s]
  1%|          | 3600/371472 [17:10<29:31:18,  3.46it/s]
                                                        
{'loss': 5.2187, 'learning_rate': 9.917580641685878e-07, 'epoch': 0.16}

  1%|          | 3600/371472 [17:10<29:31:18,  3.46it/s]
  1%|          | 3601/371472 [17:10<30:21:49,  3.37it/s]
  1%|          | 3602/371472 [17:11<29:45:44,  3.43it/s]
  1%|          | 3603/371472 [17:11<30:42:35,  3.33it/s]
  1%|          | 3604/371472 [17:11<29:41:12,  3.44it/s]
  1%|          | 3605/371472 [17:12<29:43:15,  3.44it/s]
  1%|          | 3606/371472 [17:12<28:12:22,  3.62it/s]
  1%|          | 3607/371472 [17:12<28:23:14,  3.60it/s]
  1%|          | 3608/371472 [17:12<27:27:15,  3.72it/s]
  1%|          | 3609/371472 [17:13<26:39:11,  3.83it/s]
  1%|          | 3610/371472 [17:13<26:51:41,  3.80it/s]
  1%|          | 3611/371472 [17:13<28:19:08,  3.61it/s]
  1%|          | 3612/371472 [17:13<27:36:14,  3.70it/s]
  1%|          | 3613/371472 [17:14<27:51:21,  3.67it/s]
  1%|          | 3614/371472 [17:14<29:01:41,  3.52it/s]
  1%|          | 3615/371472 [17:14<28:38:09,  3.57it/s]
  1%|          | 3616/371472 [17:15<29:07:09,  3.51it/s]
  1%|          | 3617/371472 [17:15<28:15:59,  3.61it/s]
  1%|          | 3618/371472 [17:15<27:27:46,  3.72it/s]
  1%|          | 3619/371472 [17:15<28:29:24,  3.59it/s]
  1%|          | 3620/371472 [17:16<28:31:33,  3.58it/s]
                                                        
{'loss': 5.4907, 'learning_rate': 9.917095821931091e-07, 'epoch': 0.16}

  1%|          | 3620/371472 [17:16<28:31:33,  3.58it/s]
  1%|          | 3621/371472 [17:16<27:56:59,  3.66it/s]
  1%|          | 3622/371472 [17:16<27:54:12,  3.66it/s]
  1%|          | 3623/371472 [17:16<27:15:20,  3.75it/s]
  1%|          | 3624/371472 [17:17<26:51:46,  3.80it/s]
  1%|          | 3625/371472 [17:17<27:00:12,  3.78it/s]
  1%|          | 3626/371472 [17:17<26:44:01,  3.82it/s]
  1%|          | 3627/371472 [17:18<26:08:28,  3.91it/s]
  1%|          | 3628/371472 [17:18<28:11:44,  3.62it/s]
  1%|          | 3629/371472 [17:18<28:02:07,  3.64it/s]
  1%|          | 3630/371472 [17:18<28:10:50,  3.63it/s]
  1%|          | 3631/371472 [17:19<27:16:54,  3.75it/s]
  1%|          | 3632/371472 [17:19<28:27:52,  3.59it/s]
  1%|          | 3633/371472 [17:19<27:01:48,  3.78it/s]
  1%|          | 3634/371472 [17:19<28:14:06,  3.62it/s]
  1%|          | 3635/371472 [17:20<27:41:28,  3.69it/s]
  1%|          | 3636/371472 [17:20<28:34:43,  3.58it/s]
  1%|          | 3637/371472 [17:20<27:38:17,  3.70it/s]
  1%|          | 3638/371472 [17:21<27:20:05,  3.74it/s]
  1%|          | 3639/371472 [17:21<27:41:23,  3.69it/s]
  1%|          | 3640/371472 [17:21<26:34:31,  3.84it/s]
                                                        
{'loss': 5.5288, 'learning_rate': 9.916611002176302e-07, 'epoch': 0.16}

  1%|          | 3640/371472 [17:21<26:34:31,  3.84it/s]
  1%|          | 3641/371472 [17:21<28:23:59,  3.60it/s]
  1%|          | 3642/371472 [17:22<28:25:25,  3.59it/s]
  1%|          | 3643/371472 [17:22<28:04:40,  3.64it/s]
  1%|          | 3644/371472 [17:22<27:25:38,  3.73it/s]
  1%|          | 3645/371472 [17:22<28:38:29,  3.57it/s]
  1%|          | 3646/371472 [17:23<28:33:44,  3.58it/s]
  1%|          | 3647/371472 [17:23<29:50:45,  3.42it/s]
  1%|          | 3648/371472 [17:23<28:53:46,  3.54it/s]
  1%|          | 3649/371472 [17:24<28:54:01,  3.54it/s]
  1%|          | 3650/371472 [17:24<28:36:40,  3.57it/s]
  1%|          | 3651/371472 [17:24<27:53:00,  3.66it/s]
  1%|          | 3652/371472 [17:24<29:09:27,  3.50it/s]
  1%|          | 3653/371472 [17:25<27:48:28,  3.67it/s]
  1%|          | 3654/371472 [17:25<27:33:33,  3.71it/s]
  1%|          | 3655/371472 [17:25<28:34:31,  3.58it/s]
  1%|          | 3656/371472 [17:26<29:30:32,  3.46it/s]
  1%|          | 3657/371472 [17:26<30:58:35,  3.30it/s]
  1%|          | 3658/371472 [17:26<30:08:56,  3.39it/s]
  1%|          | 3659/371472 [17:26<28:44:39,  3.55it/s]
  1%|          | 3660/371472 [17:27<29:13:47,  3.50it/s]
                                                        
{'loss': 5.4536, 'learning_rate': 9.916126182421513e-07, 'epoch': 0.16}

  1%|          | 3660/371472 [17:27<29:13:47,  3.50it/s]
  1%|          | 3661/371472 [17:27<27:57:53,  3.65it/s]
  1%|          | 3662/371472 [17:27<28:25:28,  3.59it/s]
  1%|          | 3663/371472 [17:28<27:17:34,  3.74it/s]
  1%|          | 3664/371472 [17:28<30:01:46,  3.40it/s]
  1%|          | 3665/371472 [17:28<28:54:16,  3.53it/s]
  1%|          | 3666/371472 [17:28<28:53:47,  3.54it/s]
  1%|          | 3667/371472 [17:29<28:10:34,  3.63it/s]
  1%|          | 3668/371472 [17:29<27:44:01,  3.68it/s]
  1%|          | 3669/371472 [17:29<27:34:41,  3.70it/s]
  1%|          | 3670/371472 [17:30<30:06:22,  3.39it/s]
  1%|          | 3671/371472 [17:30<29:38:04,  3.45it/s]
  1%|          | 3672/371472 [17:30<29:49:43,  3.43it/s]
  1%|          | 3673/371472 [17:30<28:49:21,  3.54it/s]
  1%|          | 3674/371472 [17:31<27:53:28,  3.66it/s]
  1%|          | 3675/371472 [17:31<26:53:00,  3.80it/s]
  1%|          | 3676/371472 [17:31<26:25:27,  3.87it/s]
  1%|          | 3677/371472 [17:31<26:13:53,  3.89it/s]
  1%|          | 3678/371472 [17:32<26:29:46,  3.86it/s]
  1%|          | 3679/371472 [17:32<26:16:03,  3.89it/s]
  1%|          | 3680/371472 [17:32<28:29:50,  3.59it/s]
                                                        
{'loss': 5.481, 'learning_rate': 9.915641362666725e-07, 'epoch': 0.16}

  1%|          | 3680/371472 [17:32<28:29:50,  3.59it/s]
  1%|          | 3681/371472 [17:33<30:03:37,  3.40it/s]
  1%|          | 3682/371472 [17:33<29:53:45,  3.42it/s]
  1%|          | 3683/371472 [17:33<30:11:24,  3.38it/s]
  1%|          | 3684/371472 [17:33<29:25:06,  3.47it/s]
  1%|          | 3685/371472 [17:34<28:16:01,  3.61it/s]
  1%|          | 3686/371472 [17:34<28:20:08,  3.61it/s]
  1%|          | 3687/371472 [17:34<29:38:48,  3.45it/s]
  1%|          | 3688/371472 [17:35<29:07:55,  3.51it/s]
  1%|          | 3689/371472 [17:35<28:17:07,  3.61it/s]
  1%|          | 3690/371472 [17:35<28:26:12,  3.59it/s]
  1%|          | 3691/371472 [17:35<28:53:32,  3.54it/s]
  1%|          | 3692/371472 [17:36<28:33:02,  3.58it/s]
  1%|          | 3693/371472 [17:36<28:12:34,  3.62it/s]
  1%|          | 3694/371472 [17:36<32:05:58,  3.18it/s]
  1%|          | 3695/371472 [17:37<32:02:04,  3.19it/s]
  1%|          | 3696/371472 [17:37<31:22:27,  3.26it/s]
  1%|          | 3697/371472 [17:37<29:47:49,  3.43it/s]
  1%|          | 3698/371472 [17:37<28:51:09,  3.54it/s]
  1%|          | 3699/371472 [17:38<27:29:06,  3.72it/s]
  1%|          | 3700/371472 [17:38<27:00:33,  3.78it/s]
                                                        
{'loss': 5.3777, 'learning_rate': 9.915156542911934e-07, 'epoch': 0.16}

  1%|          | 3700/371472 [17:38<27:00:33,  3.78it/s]
  1%|          | 3701/371472 [17:38<27:00:55,  3.78it/s]
  1%|          | 3702/371472 [17:38<28:10:29,  3.63it/s]
  1%|          | 3703/371472 [17:39<27:36:50,  3.70it/s]
  1%|          | 3704/371472 [17:39<27:38:21,  3.70it/s]
  1%|          | 3705/371472 [17:39<27:10:04,  3.76it/s]
  1%|          | 3706/371472 [17:40<26:27:32,  3.86it/s]
  1%|          | 3707/371472 [17:40<26:35:19,  3.84it/s]
  1%|          | 3708/371472 [17:40<26:59:38,  3.78it/s]
  1%|          | 3709/371472 [17:40<27:54:32,  3.66it/s]
  1%|          | 3710/371472 [17:41<27:39:12,  3.69it/s]
  1%|          | 3711/371472 [17:41<28:03:10,  3.64it/s]
  1%|          | 3712/371472 [17:41<27:19:01,  3.74it/s]
  1%|          | 3713/371472 [17:41<28:22:59,  3.60it/s]
  1%|          | 3714/371472 [17:42<28:50:27,  3.54it/s]
  1%|          | 3715/371472 [17:42<28:31:28,  3.58it/s]
  1%|          | 3716/371472 [17:42<27:48:15,  3.67it/s]
  1%|          | 3717/371472 [17:43<27:34:41,  3.70it/s]
  1%|          | 3718/371472 [17:43<26:37:31,  3.84it/s]
  1%|          | 3719/371472 [17:43<26:49:00,  3.81it/s]
  1%|          | 3720/371472 [17:43<26:24:28,  3.87it/s]
                                                        
{'loss': 5.61, 'learning_rate': 9.914671723157147e-07, 'epoch': 0.16}

  1%|          | 3720/371472 [17:43<26:24:28,  3.87it/s]
  1%|          | 3721/371472 [17:44<27:47:03,  3.68it/s]
  1%|          | 3722/371472 [17:44<26:51:27,  3.80it/s]
  1%|          | 3723/371472 [17:44<26:36:50,  3.84it/s]
  1%|          | 3724/371472 [17:44<28:13:14,  3.62it/s]
  1%|          | 3725/371472 [17:45<30:07:43,  3.39it/s]
  1%|          | 3726/371472 [17:45<29:39:44,  3.44it/s]
  1%|          | 3727/371472 [17:45<28:29:27,  3.59it/s]
  1%|          | 3728/371472 [17:46<29:23:46,  3.47it/s]
  1%|          | 3729/371472 [17:46<28:44:02,  3.56it/s]
  1%|          | 3730/371472 [17:46<27:59:46,  3.65it/s]
  1%|          | 3731/371472 [17:46<28:16:32,  3.61it/s]
  1%|          | 3732/371472 [17:47<27:56:55,  3.65it/s]
  1%|          | 3733/371472 [17:47<27:36:03,  3.70it/s]
  1%|          | 3734/371472 [17:47<26:55:33,  3.79it/s]
  1%|          | 3735/371472 [17:47<27:26:51,  3.72it/s]
  1%|          | 3736/371472 [17:48<27:05:16,  3.77it/s]
  1%|          | 3737/371472 [17:48<28:58:37,  3.53it/s]
  1%|          | 3738/371472 [17:48<28:32:17,  3.58it/s]
  1%|          | 3739/371472 [17:49<30:17:27,  3.37it/s]
  1%|          | 3740/371472 [17:49<29:13:50,  3.49it/s]
                                                        
{'loss': 5.4264, 'learning_rate': 9.914186903402355e-07, 'epoch': 0.16}

  1%|          | 3740/371472 [17:49<29:13:50,  3.49it/s]
  1%|          | 3741/371472 [17:49<28:02:34,  3.64it/s]
  1%|          | 3742/371472 [17:49<28:23:53,  3.60it/s]
  1%|          | 3743/371472 [17:50<27:57:17,  3.65it/s]
  1%|          | 3744/371472 [17:50<27:07:36,  3.77it/s]
  1%|          | 3745/371472 [17:50<27:01:05,  3.78it/s]
  1%|          | 3746/371472 [17:51<29:26:05,  3.47it/s]
  1%|          | 3747/371472 [17:51<29:52:23,  3.42it/s]
  1%|          | 3748/371472 [17:51<29:46:52,  3.43it/s]
  1%|          | 3749/371472 [17:51<28:33:57,  3.58it/s]
  1%|          | 3750/371472 [17:52<28:52:36,  3.54it/s]
  1%|          | 3751/371472 [17:52<28:54:46,  3.53it/s]
  1%|          | 3752/371472 [17:52<28:50:16,  3.54it/s]
  1%|          | 3753/371472 [17:53<28:12:48,  3.62it/s]
  1%|          | 3754/371472 [17:53<30:18:55,  3.37it/s]
  1%|          | 3755/371472 [17:53<30:40:27,  3.33it/s]
  1%|          | 3756/371472 [17:53<29:08:20,  3.51it/s]
  1%|          | 3757/371472 [17:54<32:09:04,  3.18it/s]
  1%|          | 3758/371472 [17:54<31:30:29,  3.24it/s]
  1%|          | 3759/371472 [17:54<30:53:01,  3.31it/s]
  1%|          | 3760/371472 [17:55<29:26:32,  3.47it/s]
                                                        
{'loss': 5.4003, 'learning_rate': 9.913702083647568e-07, 'epoch': 0.16}

  1%|          | 3760/371472 [17:55<29:26:32,  3.47it/s]
  1%|          | 3761/371472 [17:55<29:58:03,  3.41it/s]
  1%|          | 3762/371472 [17:55<30:46:29,  3.32it/s]
  1%|          | 3763/371472 [17:56<30:40:45,  3.33it/s]
  1%|          | 3764/371472 [17:56<30:11:23,  3.38it/s]
  1%|          | 3765/371472 [17:56<29:03:42,  3.51it/s]
  1%|          | 3766/371472 [17:56<28:30:33,  3.58it/s]
  1%|          | 3767/371472 [17:57<27:43:54,  3.68it/s]
  1%|          | 3768/371472 [17:57<27:27:27,  3.72it/s]
  1%|          | 3769/371472 [17:57<27:46:46,  3.68it/s]
  1%|          | 3770/371472 [17:57<29:32:49,  3.46it/s]
  1%|          | 3771/371472 [17:58<31:55:43,  3.20it/s]
  1%|          | 3772/371472 [17:58<30:14:50,  3.38it/s]
  1%|          | 3773/371472 [17:58<30:00:08,  3.40it/s]
  1%|          | 3774/371472 [17:59<28:22:12,  3.60it/s]
  1%|          | 3775/371472 [17:59<29:56:25,  3.41it/s]
  1%|          | 3776/371472 [17:59<30:03:10,  3.40it/s]
  1%|          | 3777/371472 [18:00<28:50:57,  3.54it/s]
  1%|          | 3778/371472 [18:00<28:04:31,  3.64it/s]
  1%|          | 3779/371472 [18:00<27:47:47,  3.67it/s]
  1%|          | 3780/371472 [18:00<27:37:50,  3.70it/s]
                                                        
{'loss': 5.2343, 'learning_rate': 9.913217263892779e-07, 'epoch': 0.16}

  1%|          | 3780/371472 [18:00<27:37:50,  3.70it/s]
  1%|          | 3781/371472 [18:01<27:51:33,  3.67it/s]
  1%|          | 3782/371472 [18:01<28:27:43,  3.59it/s]
  1%|          | 3783/371472 [18:01<27:52:53,  3.66it/s]
  1%|          | 3784/371472 [18:01<28:15:38,  3.61it/s]
  1%|          | 3785/371472 [18:02<27:10:16,  3.76it/s]
  1%|          | 3786/371472 [18:02<26:29:16,  3.86it/s]
  1%|          | 3787/371472 [18:02<26:32:10,  3.85it/s]
  1%|          | 3788/371472 [18:02<27:16:14,  3.75it/s]
  1%|          | 3789/371472 [18:03<27:56:07,  3.66it/s]
  1%|          | 3790/371472 [18:03<28:02:17,  3.64it/s]
  1%|          | 3791/371472 [18:03<28:18:02,  3.61it/s]
  1%|          | 3792/371472 [18:04<28:07:56,  3.63it/s]
  1%|          | 3793/371472 [18:04<28:27:16,  3.59it/s]
  1%|          | 3794/371472 [18:04<27:53:11,  3.66it/s]
  1%|          | 3795/371472 [18:04<27:20:36,  3.74it/s]
  1%|          | 3796/371472 [18:05<27:24:17,  3.73it/s]
  1%|          | 3797/371472 [18:05<27:33:44,  3.71it/s]
  1%|          | 3798/371472 [18:05<26:12:02,  3.90it/s]
  1%|          | 3799/371472 [18:05<26:27:28,  3.86it/s]
  1%|          | 3800/371472 [18:06<27:44:07,  3.68it/s]
                                                        
{'loss': 5.3609, 'learning_rate': 9.91273244413799e-07, 'epoch': 0.16}

  1%|          | 3800/371472 [18:06<27:44:07,  3.68it/s]
  1%|          | 3801/371472 [18:06<28:03:52,  3.64it/s]
  1%|          | 3802/371472 [18:06<28:39:27,  3.56it/s]
  1%|          | 3803/371472 [18:07<30:01:11,  3.40it/s]
  1%|          | 3804/371472 [18:07<28:29:21,  3.58it/s]
  1%|          | 3805/371472 [18:07<28:16:44,  3.61it/s]
  1%|          | 3806/371472 [18:07<27:28:54,  3.72it/s]
  1%|          | 3807/371472 [18:08<26:38:23,  3.83it/s]
  1%|          | 3808/371472 [18:08<28:28:00,  3.59it/s]
  1%|          | 3809/371472 [18:08<29:31:18,  3.46it/s]
  1%|          | 3810/371472 [18:08<27:56:41,  3.65it/s]
  1%|          | 3811/371472 [18:09<27:16:49,  3.74it/s]
  1%|          | 3812/371472 [18:09<31:03:52,  3.29it/s]
  1%|          | 3813/371472 [18:09<31:21:57,  3.26it/s]
  1%|          | 3814/371472 [18:10<29:44:29,  3.43it/s]
  1%|          | 3815/371472 [18:10<28:53:06,  3.54it/s]
  1%|          | 3816/371472 [18:10<29:59:56,  3.40it/s]
  1%|          | 3817/371472 [18:11<30:37:15,  3.34it/s]
  1%|          | 3818/371472 [18:11<28:44:07,  3.55it/s]
  1%|          | 3819/371472 [18:11<27:29:09,  3.72it/s]
  1%|          | 3820/371472 [18:11<26:58:50,  3.79it/s]
                                                        
{'loss': 5.4076, 'learning_rate': 9.912247624383202e-07, 'epoch': 0.16}

  1%|          | 3820/371472 [18:11<26:58:50,  3.79it/s]
  1%|          | 3821/371472 [18:12<30:16:23,  3.37it/s]
  1%|          | 3822/371472 [18:12<32:21:19,  3.16it/s]
  1%|          | 3823/371472 [18:12<29:49:45,  3.42it/s]
  1%|          | 3824/371472 [18:13<28:40:18,  3.56it/s]
  1%|          | 3825/371472 [18:13<27:32:32,  3.71it/s]
  1%|          | 3826/371472 [18:13<27:59:56,  3.65it/s]
  1%|          | 3827/371472 [18:13<30:19:01,  3.37it/s]
  1%|          | 3828/371472 [18:14<29:59:46,  3.40it/s]
  1%|          | 3829/371472 [18:14<29:06:08,  3.51it/s]
  1%|          | 3830/371472 [18:14<29:28:32,  3.46it/s]
  1%|          | 3831/371472 [18:15<28:11:00,  3.62it/s]
  1%|          | 3832/371472 [18:15<27:51:55,  3.66it/s]
  1%|          | 3833/371472 [18:15<27:12:44,  3.75it/s]
  1%|          | 3834/371472 [18:15<27:23:46,  3.73it/s]
  1%|          | 3835/371472 [18:16<27:27:00,  3.72it/s]
  1%|          | 3836/371472 [18:16<27:36:57,  3.70it/s]
  1%|          | 3837/371472 [18:16<28:28:54,  3.59it/s]
  1%|          | 3838/371472 [18:16<27:54:10,  3.66it/s]
  1%|          | 3839/371472 [18:17<28:24:14,  3.60it/s]
  1%|          | 3840/371472 [18:17<29:04:52,  3.51it/s]
                                                        
{'loss': 5.2988, 'learning_rate': 9.911762804628411e-07, 'epoch': 0.17}

  1%|          | 3840/371472 [18:17<29:04:52,  3.51it/s]
  1%|          | 3841/371472 [18:17<28:58:02,  3.53it/s]
  1%|          | 3842/371472 [18:18<27:51:13,  3.67it/s]
  1%|          | 3843/371472 [18:18<28:30:20,  3.58it/s]
  1%|          | 3844/371472 [18:18<27:13:27,  3.75it/s]
  1%|          | 3845/371472 [18:18<29:21:42,  3.48it/s]
  1%|          | 3846/371472 [18:19<29:01:15,  3.52it/s]
  1%|          | 3847/371472 [18:19<29:53:03,  3.42it/s]
  1%|          | 3848/371472 [18:19<29:45:05,  3.43it/s]
  1%|          | 3849/371472 [18:20<29:01:01,  3.52it/s]
  1%|          | 3850/371472 [18:20<30:43:39,  3.32it/s]
  1%|          | 3851/371472 [18:20<29:46:38,  3.43it/s]
  1%|          | 3852/371472 [18:21<32:04:34,  3.18it/s]
  1%|          | 3853/371472 [18:21<32:13:56,  3.17it/s]
  1%|          | 3854/371472 [18:21<31:51:26,  3.21it/s]
  1%|          | 3855/371472 [18:21<29:46:03,  3.43it/s]
  1%|          | 3856/371472 [18:22<29:18:03,  3.49it/s]
  1%|          | 3857/371472 [18:22<28:00:41,  3.65it/s]
  1%|          | 3858/371472 [18:22<30:53:27,  3.31it/s]
  1%|          | 3859/371472 [18:23<30:08:13,  3.39it/s]
  1%|          | 3860/371472 [18:23<29:12:01,  3.50it/s]
                                                        
{'loss': 5.334, 'learning_rate': 9.911277984873624e-07, 'epoch': 0.17}

  1%|          | 3860/371472 [18:23<29:12:01,  3.50it/s]
  1%|          | 3861/371472 [18:23<28:22:52,  3.60it/s]
  1%|          | 3862/371472 [18:23<27:45:42,  3.68it/s]
  1%|          | 3863/371472 [18:24<28:12:54,  3.62it/s]
  1%|          | 3864/371472 [18:24<28:44:33,  3.55it/s]
  1%|          | 3865/371472 [18:24<30:41:08,  3.33it/s]
  1%|          | 3866/371472 [18:25<29:14:05,  3.49it/s]
  1%|          | 3867/371472 [18:25<30:15:05,  3.38it/s]
  1%|          | 3868/371472 [18:25<28:23:39,  3.60it/s]
  1%|          | 3869/371472 [18:25<28:37:53,  3.57it/s]
  1%|          | 3870/371472 [18:26<29:49:25,  3.42it/s]
  1%|          | 3871/371472 [18:26<29:14:43,  3.49it/s]
  1%|          | 3872/371472 [18:26<28:02:33,  3.64it/s]
  1%|          | 3873/371472 [18:27<32:24:44,  3.15it/s]
  1%|          | 3874/371472 [18:27<32:26:39,  3.15it/s]
  1%|          | 3875/371472 [18:27<32:35:00,  3.13it/s]
  1%|          | 3876/371472 [18:28<31:38:08,  3.23it/s]
  1%|          | 3877/371472 [18:28<30:11:11,  3.38it/s]
  1%|          | 3878/371472 [18:28<31:18:08,  3.26it/s]
  1%|          | 3879/371472 [18:28<29:22:29,  3.48it/s]
  1%|          | 3880/371472 [18:29<29:29:36,  3.46it/s]
                                                        
{'loss': 5.5399, 'learning_rate': 9.910793165118835e-07, 'epoch': 0.17}

  1%|          | 3880/371472 [18:29<29:29:36,  3.46it/s]
  1%|          | 3881/371472 [18:29<28:19:27,  3.60it/s]
  1%|          | 3882/371472 [18:29<28:35:15,  3.57it/s]
  1%|          | 3883/371472 [18:29<28:08:06,  3.63it/s]
  1%|          | 3884/371472 [18:30<29:29:28,  3.46it/s]
  1%|          | 3885/371472 [18:30<30:47:37,  3.32it/s]
  1%|          | 3886/371472 [18:30<30:04:36,  3.39it/s]
  1%|          | 3887/371472 [18:31<29:27:14,  3.47it/s]
  1%|          | 3888/371472 [18:31<27:59:23,  3.65it/s]
  1%|          | 3889/371472 [18:31<30:09:45,  3.39it/s]
  1%|          | 3890/371472 [18:32<29:00:04,  3.52it/s]
  1%|          | 3891/371472 [18:32<30:03:07,  3.40it/s]
  1%|          | 3892/371472 [18:32<30:42:28,  3.33it/s]
  1%|          | 3893/371472 [18:32<30:12:02,  3.38it/s]
  1%|          | 3894/371472 [18:33<29:06:47,  3.51it/s]
  1%|          | 3895/371472 [18:33<27:50:48,  3.67it/s]
  1%|          | 3896/371472 [18:33<27:26:36,  3.72it/s]
  1%|          | 3897/371472 [18:33<27:14:35,  3.75it/s]
  1%|          | 3898/371472 [18:34<27:22:25,  3.73it/s]
  1%|          | 3899/371472 [18:34<27:35:51,  3.70it/s]
  1%|          | 3900/371472 [18:34<28:04:23,  3.64it/s]
                                                        
{'loss': 5.1626, 'learning_rate': 9.910308345364045e-07, 'epoch': 0.17}

  1%|          | 3900/371472 [18:34<28:04:23,  3.64it/s]
  1%|          | 3901/371472 [18:35<27:39:31,  3.69it/s]
  1%|          | 3902/371472 [18:35<27:37:25,  3.70it/s]
  1%|          | 3903/371472 [18:35<30:40:14,  3.33it/s]
  1%|          | 3904/371472 [18:35<29:12:07,  3.50it/s]
  1%|          | 3905/371472 [18:36<29:48:54,  3.42it/s]
  1%|          | 3906/371472 [18:36<29:28:24,  3.46it/s]
  1%|          | 3907/371472 [18:36<28:39:02,  3.56it/s]
  1%|          | 3908/371472 [18:37<29:55:54,  3.41it/s]
  1%|          | 3909/371472 [18:37<28:05:36,  3.63it/s]
  1%|          | 3910/371472 [18:37<28:26:40,  3.59it/s]
  1%|          | 3911/371472 [18:37<28:57:27,  3.53it/s]
  1%|          | 3912/371472 [18:38<28:48:48,  3.54it/s]
  1%|          | 3913/371472 [18:38<27:38:45,  3.69it/s]
  1%|          | 3914/371472 [18:38<29:19:47,  3.48it/s]
  1%|          | 3915/371472 [18:39<29:11:47,  3.50it/s]
  1%|          | 3916/371472 [18:39<28:08:41,  3.63it/s]
  1%|          | 3917/371472 [18:39<28:03:16,  3.64it/s]
  1%|          | 3918/371472 [18:39<28:33:18,  3.58it/s]
  1%|          | 3919/371472 [18:40<29:22:37,  3.48it/s]
  1%|          | 3920/371472 [18:40<29:44:31,  3.43it/s]
                                                        
{'loss': 5.3731, 'learning_rate': 9.909823525609258e-07, 'epoch': 0.17}

  1%|          | 3920/371472 [18:40<29:44:31,  3.43it/s]
  1%|          | 3921/371472 [18:40<29:01:27,  3.52it/s]
  1%|          | 3922/371472 [18:41<27:33:01,  3.71it/s]
  1%|          | 3923/371472 [18:41<27:58:19,  3.65it/s]
  1%|          | 3924/371472 [18:41<29:06:58,  3.51it/s]
  1%|          | 3925/371472 [18:41<28:03:19,  3.64it/s]
  1%|          | 3926/371472 [18:42<27:55:53,  3.66it/s]
  1%|          | 3927/371472 [18:42<30:37:20,  3.33it/s]
  1%|          | 3928/371472 [18:42<31:17:22,  3.26it/s]
  1%|          | 3929/371472 [18:43<30:06:15,  3.39it/s]
  1%|          | 3930/371472 [18:43<29:36:43,  3.45it/s]
  1%|          | 3931/371472 [18:43<28:32:27,  3.58it/s]
  1%|          | 3932/371472 [18:43<27:04:57,  3.77it/s]
  1%|          | 3933/371472 [18:44<27:36:34,  3.70it/s]
  1%|          | 3934/371472 [18:44<26:36:43,  3.84it/s]
  1%|          | 3935/371472 [18:44<27:08:34,  3.76it/s]
  1%|          | 3936/371472 [18:44<27:14:22,  3.75it/s]
  1%|          | 3937/371472 [18:45<26:58:59,  3.78it/s]
  1%|          | 3938/371472 [18:45<27:55:06,  3.66it/s]
  1%|          | 3939/371472 [18:45<27:29:24,  3.71it/s]
  1%|          | 3940/371472 [18:45<27:21:20,  3.73it/s]
                                                        
{'loss': 5.2582, 'learning_rate': 9.909338705854467e-07, 'epoch': 0.17}

  1%|          | 3940/371472 [18:45<27:21:20,  3.73it/s]
  1%|          | 3941/371472 [18:46<28:00:43,  3.64it/s]
  1%|          | 3942/371472 [18:46<28:08:34,  3.63it/s]
  1%|          | 3943/371472 [18:46<27:35:33,  3.70it/s]
  1%|          | 3944/371472 [18:47<28:57:46,  3.52it/s]
  1%|          | 3945/371472 [18:47<29:39:51,  3.44it/s]
  1%|          | 3946/371472 [18:47<29:49:28,  3.42it/s]
  1%|          | 3947/371472 [18:48<30:06:05,  3.39it/s]
  1%|          | 3948/371472 [18:48<29:14:46,  3.49it/s]
  1%|          | 3949/371472 [18:48<28:05:58,  3.63it/s]
  1%|          | 3950/371472 [18:48<27:54:53,  3.66it/s]
  1%|          | 3951/371472 [18:49<28:02:40,  3.64it/s]
  1%|          | 3952/371472 [18:49<27:42:49,  3.68it/s]
  1%|          | 3953/371472 [18:49<27:29:50,  3.71it/s]
  1%|          | 3954/371472 [18:49<28:15:30,  3.61it/s]
  1%|          | 3955/371472 [18:50<28:41:46,  3.56it/s]
  1%|          | 3956/371472 [18:50<28:05:49,  3.63it/s]
  1%|          | 3957/371472 [18:50<27:01:19,  3.78it/s]
  1%|          | 3958/371472 [18:50<26:56:24,  3.79it/s]
  1%|          | 3959/371472 [18:51<27:09:34,  3.76it/s]
  1%|          | 3960/371472 [18:51<27:20:32,  3.73it/s]
                                                        
{'loss': 5.3624, 'learning_rate': 9.90885388609968e-07, 'epoch': 0.17}

  1%|          | 3960/371472 [18:51<27:20:32,  3.73it/s]
  1%|          | 3961/371472 [18:51<27:51:13,  3.67it/s]
  1%|          | 3962/371472 [18:52<27:09:07,  3.76it/s]
  1%|          | 3963/371472 [18:52<28:42:31,  3.56it/s]
  1%|          | 3964/371472 [18:52<27:16:03,  3.74it/s]
  1%|          | 3965/371472 [18:52<27:53:57,  3.66it/s]
  1%|          | 3966/371472 [18:53<27:53:25,  3.66it/s]
  1%|          | 3967/371472 [18:53<28:22:57,  3.60it/s]
  1%|          | 3968/371472 [18:53<27:46:24,  3.68it/s]
  1%|          | 3969/371472 [18:53<27:13:41,  3.75it/s]
  1%|          | 3970/371472 [18:54<27:27:47,  3.72it/s]
  1%|          | 3971/371472 [18:54<27:00:12,  3.78it/s]
  1%|          | 3972/371472 [18:54<27:02:48,  3.77it/s]
  1%|          | 3973/371472 [18:55<26:59:43,  3.78it/s]
  1%|          | 3974/371472 [18:55<27:17:47,  3.74it/s]
  1%|          | 3975/371472 [18:55<29:19:53,  3.48it/s]
  1%|          | 3976/371472 [18:55<29:29:25,  3.46it/s]
  1%|          | 3977/371472 [18:56<30:05:43,  3.39it/s]
  1%|          | 3978/371472 [18:56<29:05:52,  3.51it/s]
  1%|          | 3979/371472 [18:56<27:33:26,  3.70it/s]
  1%|          | 3980/371472 [18:56<26:48:20,  3.81it/s]
                                                        
{'loss': 5.2776, 'learning_rate': 9.908369066344888e-07, 'epoch': 0.17}

  1%|          | 3980/371472 [18:56<26:48:20,  3.81it/s]
  1%|          | 3981/371472 [18:57<26:36:05,  3.84it/s]
  1%|          | 3982/371472 [18:57<27:44:48,  3.68it/s]
  1%|          | 3983/371472 [18:57<27:48:15,  3.67it/s]
  1%|          | 3984/371472 [18:58<29:33:15,  3.45it/s]
  1%|          | 3985/371472 [18:58<29:38:41,  3.44it/s]
  1%|          | 3986/371472 [18:58<28:56:54,  3.53it/s]
  1%|          | 3987/371472 [18:58<29:29:29,  3.46it/s]
  1%|          | 3988/371472 [18:59<28:43:05,  3.55it/s]
  1%|          | 3989/371472 [18:59<30:36:58,  3.33it/s]
  1%|          | 3990/371472 [18:59<29:43:55,  3.43it/s]
  1%|          | 3991/371472 [19:00<32:25:01,  3.15it/s]
  1%|          | 3992/371472 [19:00<30:18:21,  3.37it/s]
  1%|          | 3993/371472 [19:00<30:33:59,  3.34it/s]
  1%|          | 3994/371472 [19:01<29:01:56,  3.52it/s]
  1%|          | 3995/371472 [19:01<28:01:50,  3.64it/s]
  1%|          | 3996/371472 [19:01<28:18:44,  3.61it/s]
  1%|          | 3997/371472 [19:01<29:25:18,  3.47it/s]
  1%|          | 3998/371472 [19:02<27:56:56,  3.65it/s]
  1%|          | 3999/371472 [19:02<27:45:51,  3.68it/s]
  1%|          | 4000/371472 [19:02<27:11:42,  3.75it/s]
                                                        
{'loss': 5.4069, 'learning_rate': 9.9078842465901e-07, 'epoch': 0.17}

  1%|          | 4000/371472 [19:02<27:11:42,  3.75it/s]
  1%|          | 4001/371472 [19:03<29:44:54,  3.43it/s]
  1%|          | 4002/371472 [19:03<28:46:36,  3.55it/s]
  1%|          | 4003/371472 [19:03<30:07:42,  3.39it/s]
  1%|          | 4004/371472 [19:03<29:37:13,  3.45it/s]
  1%|          | 4005/371472 [19:04<28:15:14,  3.61it/s]
  1%|          | 4006/371472 [19:04<28:03:34,  3.64it/s]
  1%|          | 4007/371472 [19:04<27:33:32,  3.70it/s]
  1%|          | 4008/371472 [19:04<27:35:43,  3.70it/s]
  1%|          | 4009/371472 [19:05<28:42:20,  3.56it/s]
  1%|          | 4010/371472 [19:05<30:36:16,  3.34it/s]
  1%|          | 4011/371472 [19:05<29:01:27,  3.52it/s]
  1%|          | 4012/371472 [19:06<28:07:25,  3.63it/s]
  1%|          | 4013/371472 [19:06<27:39:14,  3.69it/s]
  1%|          | 4014/371472 [19:06<27:48:38,  3.67it/s]
  1%|          | 4015/371472 [19:06<28:06:15,  3.63it/s]
  1%|          | 4016/371472 [19:07<27:14:12,  3.75it/s]
  1%|          | 4017/371472 [19:07<26:39:45,  3.83it/s]
  1%|          | 4018/371472 [19:07<26:45:23,  3.81it/s]
  1%|          | 4019/371472 [19:07<27:55:15,  3.66it/s]
  1%|          | 4020/371472 [19:08<28:34:14,  3.57it/s]
                                                        
{'loss': 5.336, 'learning_rate': 9.907399426835312e-07, 'epoch': 0.17}

  1%|          | 4020/371472 [19:08<28:34:14,  3.57it/s]
  1%|          | 4021/371472 [19:08<28:26:45,  3.59it/s]
  1%|          | 4022/371472 [19:08<28:57:02,  3.53it/s]
  1%|          | 4023/371472 [19:09<30:24:10,  3.36it/s]
  1%|          | 4024/371472 [19:09<29:31:32,  3.46it/s]
  1%|          | 4025/371472 [19:09<28:28:17,  3.58it/s]
  1%|          | 4026/371472 [19:09<28:16:54,  3.61it/s]
  1%|          | 4027/371472 [19:10<30:16:54,  3.37it/s]
  1%|          | 4028/371472 [19:10<29:11:43,  3.50it/s]
  1%|          | 4029/371472 [19:10<28:57:06,  3.53it/s]
  1%|          | 4030/371472 [19:11<29:17:52,  3.48it/s]
  1%|          | 4031/371472 [19:11<31:47:33,  3.21it/s]
  1%|          | 4032/371472 [19:11<30:30:00,  3.35it/s]
  1%|          | 4033/371472 [19:12<29:05:39,  3.51it/s]
  1%|          | 4034/371472 [19:12<29:36:32,  3.45it/s]
  1%|          | 4035/371472 [19:12<28:09:05,  3.63it/s]
  1%|          | 4036/371472 [19:12<29:28:56,  3.46it/s]
  1%|          | 4037/371472 [19:13<30:18:47,  3.37it/s]
  1%|          | 4038/371472 [19:13<29:18:04,  3.48it/s]
  1%|          | 4039/371472 [19:13<31:22:22,  3.25it/s]
  1%|          | 4040/371472 [19:14<30:50:37,  3.31it/s]
                                                        
{'loss': 5.1774, 'learning_rate': 9.906914607080522e-07, 'epoch': 0.17}

  1%|          | 4040/371472 [19:14<30:50:37,  3.31it/s]
  1%|          | 4041/371472 [19:14<30:27:50,  3.35it/s]
  1%|          | 4042/371472 [19:14<30:06:47,  3.39it/s]
  1%|          | 4043/371472 [19:14<29:38:27,  3.44it/s]
  1%|          | 4044/371472 [19:15<29:02:04,  3.52it/s]
  1%|          | 4045/371472 [19:15<30:18:18,  3.37it/s]
  1%|          | 4046/371472 [19:15<31:02:54,  3.29it/s]
  1%|          | 4047/371472 [19:16<29:28:57,  3.46it/s]
  1%|          | 4048/371472 [19:16<30:22:42,  3.36it/s]
  1%|          | 4049/371472 [19:16<29:17:04,  3.49it/s]
  1%|          | 4050/371472 [19:16<29:02:16,  3.51it/s]
  1%|          | 4051/371472 [19:17<28:37:32,  3.57it/s]
  1%|          | 4052/371472 [19:17<27:10:36,  3.76it/s]
  1%|          | 4053/371472 [19:17<27:23:29,  3.73it/s]
  1%|          | 4054/371472 [19:18<28:13:22,  3.62it/s]
  1%|          | 4055/371472 [19:18<29:24:15,  3.47it/s]
  1%|          | 4056/371472 [19:18<27:45:50,  3.68it/s]
  1%|          | 4057/371472 [19:18<28:33:39,  3.57it/s]
  1%|          | 4058/371472 [19:19<28:37:20,  3.57it/s]
  1%|          | 4059/371472 [19:19<29:03:52,  3.51it/s]
  1%|          | 4060/371472 [19:19<27:42:28,  3.68it/s]
                                                        
{'loss': 5.2318, 'learning_rate': 9.906429787325735e-07, 'epoch': 0.17}

  1%|          | 4060/371472 [19:19<27:42:28,  3.68it/s]
  1%|          | 4061/371472 [19:19<27:18:59,  3.74it/s]
  1%|          | 4062/371472 [19:20<26:52:32,  3.80it/s]
  1%|          | 4063/371472 [19:20<26:31:06,  3.85it/s]
  1%|          | 4064/371472 [19:20<27:27:28,  3.72it/s]
  1%|          | 4065/371472 [19:21<27:20:42,  3.73it/s]
  1%|          | 4066/371472 [19:21<27:59:00,  3.65it/s]
  1%|          | 4067/371472 [19:21<27:48:51,  3.67it/s]
  1%|          | 4068/371472 [19:21<27:38:18,  3.69it/s]
  1%|          | 4069/371472 [19:22<28:25:16,  3.59it/s]
  1%|          | 4070/371472 [19:22<28:09:14,  3.62it/s]
  1%|          | 4071/371472 [19:22<26:50:42,  3.80it/s]
  1%|          | 4072/371472 [19:22<27:40:06,  3.69it/s]
  1%|          | 4073/371472 [19:23<27:20:52,  3.73it/s]
  1%|          | 4074/371472 [19:23<27:53:37,  3.66it/s]
  1%|          | 4075/371472 [19:23<27:56:19,  3.65it/s]
  1%|          | 4076/371472 [19:24<27:37:32,  3.69it/s]
  1%|          | 4077/371472 [19:24<27:08:41,  3.76it/s]
  1%|          | 4078/371472 [19:24<26:46:23,  3.81it/s]
  1%|          | 4079/371472 [19:24<26:47:04,  3.81it/s]
  1%|          | 4080/371472 [19:25<26:52:04,  3.80it/s]
                                                        
{'loss': 5.2908, 'learning_rate': 9.905944967570944e-07, 'epoch': 0.18}

  1%|          | 4080/371472 [19:25<26:52:04,  3.80it/s]
  1%|          | 4081/371472 [19:25<27:05:28,  3.77it/s]
  1%|          | 4082/371472 [19:25<26:24:00,  3.87it/s]
  1%|          | 4083/371472 [19:25<26:29:39,  3.85it/s]
  1%|          | 4084/371472 [19:26<27:51:52,  3.66it/s]
  1%|          | 4085/371472 [19:26<28:07:33,  3.63it/s]
  1%|          | 4086/371472 [19:26<28:09:31,  3.62it/s]
  1%|          | 4087/371472 [19:26<28:16:13,  3.61it/s]
  1%|          | 4088/371472 [19:27<28:35:31,  3.57it/s]
  1%|          | 4089/371472 [19:27<28:37:20,  3.57it/s]
  1%|          | 4090/371472 [19:27<28:16:29,  3.61it/s]
  1%|          | 4091/371472 [19:28<28:39:30,  3.56it/s]
  1%|          | 4092/371472 [19:28<28:06:49,  3.63it/s]
  1%|          | 4093/371472 [19:28<30:15:29,  3.37it/s]
  1%|          | 4094/371472 [19:29<30:16:48,  3.37it/s]
  1%|          | 4095/371472 [19:29<29:17:28,  3.48it/s]
  1%|          | 4096/371472 [19:29<28:54:13,  3.53it/s]
  1%|          | 4097/371472 [19:29<29:17:23,  3.48it/s]
  1%|          | 4098/371472 [19:30<29:06:24,  3.51it/s]
  1%|          | 4099/371472 [19:30<28:04:43,  3.63it/s]
  1%|          | 4100/371472 [19:30<27:53:24,  3.66it/s]
                                                        
{'loss': 5.3843, 'learning_rate': 9.905460147816157e-07, 'epoch': 0.18}

  1%|          | 4100/371472 [19:30<27:53:24,  3.66it/s]
  1%|          | 4101/371472 [19:30<27:15:28,  3.74it/s]
  1%|          | 4102/371472 [19:31<26:50:06,  3.80it/s]
  1%|          | 4103/371472 [19:31<28:50:00,  3.54it/s]
  1%|          | 4104/371472 [19:31<28:35:54,  3.57it/s]
  1%|          | 4105/371472 [19:32<27:58:45,  3.65it/s]
  1%|          | 4106/371472 [19:32<29:07:10,  3.50it/s]
  1%|          | 4107/371472 [19:32<28:55:40,  3.53it/s]
  1%|          | 4108/371472 [19:32<30:47:21,  3.31it/s]
  1%|          | 4109/371472 [19:33<29:22:34,  3.47it/s]
  1%|          | 4110/371472 [19:33<28:37:44,  3.56it/s]
  1%|          | 4111/371472 [19:33<28:17:44,  3.61it/s]
  1%|          | 4112/371472 [19:33<27:12:24,  3.75it/s]
  1%|          | 4113/371472 [19:34<28:41:26,  3.56it/s]
  1%|          | 4114/371472 [19:34<27:57:35,  3.65it/s]
  1%|          | 4115/371472 [19:34<28:05:56,  3.63it/s]
  1%|          | 4116/371472 [19:35<28:05:32,  3.63it/s]
  1%|          | 4117/371472 [19:35<28:34:30,  3.57it/s]
  1%|          | 4118/371472 [19:35<27:48:24,  3.67it/s]
  1%|          | 4119/371472 [19:35<28:36:32,  3.57it/s]
  1%|          | 4120/371472 [19:36<30:24:13,  3.36it/s]
                                                        
{'loss': 5.3274, 'learning_rate': 9.904975328061365e-07, 'epoch': 0.18}

  1%|          | 4120/371472 [19:36<30:24:13,  3.36it/s]
  1%|          | 4121/371472 [19:36<29:43:35,  3.43it/s]
  1%|          | 4122/371472 [19:36<29:00:50,  3.52it/s]
  1%|          | 4123/371472 [19:37<28:00:54,  3.64it/s]
  1%|          | 4124/371472 [19:37<27:50:44,  3.66it/s]
  1%|          | 4125/371472 [19:37<27:48:05,  3.67it/s]
  1%|          | 4126/371472 [19:37<27:22:12,  3.73it/s]
  1%|          | 4127/371472 [19:38<28:12:42,  3.62it/s]
  1%|          | 4128/371472 [19:38<28:26:21,  3.59it/s]
  1%|          | 4129/371472 [19:38<27:54:37,  3.66it/s]
  1%|          | 4130/371472 [19:39<28:09:39,  3.62it/s]
  1%|          | 4131/371472 [19:39<27:59:50,  3.64it/s]
  1%|          | 4132/371472 [19:39<29:22:51,  3.47it/s]
  1%|          | 4133/371472 [19:39<28:04:04,  3.64it/s]
  1%|          | 4134/371472 [19:40<27:14:03,  3.75it/s]
  1%|          | 4135/371472 [19:40<26:26:01,  3.86it/s]
  1%|          | 4136/371472 [19:40<27:29:14,  3.71it/s]
  1%|          | 4137/371472 [19:40<27:02:46,  3.77it/s]
  1%|          | 4138/371472 [19:41<26:30:34,  3.85it/s]
  1%|          | 4139/371472 [19:41<28:38:09,  3.56it/s]
  1%|          | 4140/371472 [19:41<29:34:57,  3.45it/s]
                                                        
{'loss': 5.2516, 'learning_rate': 9.904490508306578e-07, 'epoch': 0.18}

  1%|          | 4140/371472 [19:41<29:34:57,  3.45it/s]
  1%|          | 4141/371472 [19:42<28:42:07,  3.56it/s]
  1%|          | 4142/371472 [19:42<28:37:29,  3.56it/s]
  1%|          | 4143/371472 [19:42<28:37:50,  3.56it/s]
  1%|          | 4144/371472 [19:42<28:01:34,  3.64it/s]
  1%|          | 4145/371472 [19:43<32:00:28,  3.19it/s]
  1%|          | 4146/371472 [19:43<29:58:53,  3.40it/s]
  1%|          | 4147/371472 [19:43<30:14:09,  3.37it/s]
  1%|          | 4148/371472 [19:44<33:11:31,  3.07it/s]
  1%|          | 4149/371472 [19:44<32:26:33,  3.15it/s]
  1%|          | 4150/371472 [19:44<29:55:31,  3.41it/s]
  1%|          | 4151/371472 [19:45<29:24:18,  3.47it/s]
  1%|          | 4152/371472 [19:45<27:50:57,  3.66it/s]
  1%|          | 4153/371472 [19:45<26:59:34,  3.78it/s]
  1%|          | 4154/371472 [19:45<26:20:20,  3.87it/s]
  1%|          | 4155/371472 [19:46<26:40:57,  3.82it/s]
  1%|          | 4156/371472 [19:46<28:26:41,  3.59it/s]
  1%|          | 4157/371472 [19:46<28:23:42,  3.59it/s]
  1%|          | 4158/371472 [19:46<27:55:38,  3.65it/s]
  1%|          | 4159/371472 [19:47<27:47:49,  3.67it/s]
  1%|          | 4160/371472 [19:47<27:27:11,  3.72it/s]
                                                        
{'loss': 5.4997, 'learning_rate': 9.904005688551789e-07, 'epoch': 0.18}

  1%|          | 4160/371472 [19:47<27:27:11,  3.72it/s]
  1%|          | 4161/371472 [19:47<27:29:22,  3.71it/s]
  1%|          | 4162/371472 [19:47<27:29:15,  3.71it/s]
  1%|          | 4163/371472 [19:48<27:00:16,  3.78it/s]
  1%|          | 4164/371472 [19:48<26:55:17,  3.79it/s]
  1%|          | 4165/371472 [19:48<27:33:21,  3.70it/s]
  1%|          | 4166/371472 [19:49<27:03:11,  3.77it/s]
  1%|          | 4167/371472 [19:49<27:33:16,  3.70it/s]
  1%|          | 4168/371472 [19:49<26:45:56,  3.81it/s]
  1%|          | 4169/371472 [19:49<26:25:43,  3.86it/s]
  1%|          | 4170/371472 [19:50<27:35:25,  3.70it/s]
  1%|          | 4171/371472 [19:50<27:19:35,  3.73it/s]
  1%|          | 4172/371472 [19:50<29:17:53,  3.48it/s]
  1%|          | 4173/371472 [19:50<30:21:11,  3.36it/s]
  1%|          | 4174/371472 [19:51<28:46:57,  3.54it/s]
  1%|          | 4175/371472 [19:51<27:27:02,  3.72it/s]
  1%|          | 4176/371472 [19:51<26:55:11,  3.79it/s]
  1%|          | 4177/371472 [19:51<27:05:19,  3.77it/s]
  1%|          | 4178/371472 [19:52<27:01:48,  3.77it/s]
  1%|          | 4179/371472 [19:52<26:18:22,  3.88it/s]
  1%|          | 4180/371472 [19:52<26:20:54,  3.87it/s]
                                                        
{'loss': 5.2678, 'learning_rate': 9.903520868797e-07, 'epoch': 0.18}

  1%|          | 4180/371472 [19:52<26:20:54,  3.87it/s]
  1%|          | 4181/371472 [19:53<27:08:26,  3.76it/s]
  1%|          | 4182/371472 [19:53<26:16:47,  3.88it/s]
  1%|          | 4183/371472 [19:53<26:26:30,  3.86it/s]
  1%|          | 4184/371472 [19:53<27:52:45,  3.66it/s]
  1%|          | 4185/371472 [19:54<27:37:23,  3.69it/s]
  1%|          | 4186/371472 [19:54<27:53:46,  3.66it/s]
  1%|          | 4187/371472 [19:54<27:16:37,  3.74it/s]
  1%|          | 4188/371472 [19:54<27:00:27,  3.78it/s]
  1%|          | 4189/371472 [19:55<26:26:58,  3.86it/s]
  1%|          | 4190/371472 [19:55<26:41:31,  3.82it/s]
  1%|          | 4191/371472 [19:55<26:53:22,  3.79it/s]
  1%|          | 4192/371472 [19:55<26:38:50,  3.83it/s]
  1%|          | 4193/371472 [19:56<27:07:01,  3.76it/s]
  1%|          | 4194/371472 [19:56<26:10:49,  3.90it/s]
  1%|          | 4195/371472 [19:56<27:09:57,  3.76it/s]
  1%|          | 4196/371472 [19:56<26:32:46,  3.84it/s]
  1%|          | 4197/371472 [19:57<27:06:51,  3.76it/s]
  1%|          | 4198/371472 [19:57<26:37:11,  3.83it/s]
  1%|          | 4199/371472 [19:57<25:51:14,  3.95it/s]
  1%|          | 4200/371472 [19:58<26:52:32,  3.80it/s]
                                                        
{'loss': 5.5379, 'learning_rate': 9.903036049042212e-07, 'epoch': 0.18}

  1%|          | 4200/371472 [19:58<26:52:32,  3.80it/s]
  1%|          | 4201/371472 [19:58<27:13:23,  3.75it/s]
  1%|          | 4202/371472 [19:58<27:39:09,  3.69it/s]
  1%|          | 4203/371472 [19:58<29:11:37,  3.49it/s]
  1%|          | 4204/371472 [19:59<27:43:17,  3.68it/s]
  1%|          | 4205/371472 [19:59<28:55:31,  3.53it/s]
  1%|          | 4206/371472 [19:59<28:42:23,  3.55it/s]
  1%|          | 4207/371472 [20:00<28:38:23,  3.56it/s]
  1%|          | 4208/371472 [20:00<30:49:21,  3.31it/s]
  1%|          | 4209/371472 [20:00<30:20:49,  3.36it/s]
  1%|          | 4210/371472 [20:00<29:50:43,  3.42it/s]
  1%|          | 4211/371472 [20:01<29:24:40,  3.47it/s]
  1%|          | 4212/371472 [20:01<30:42:24,  3.32it/s]
  1%|          | 4213/371472 [20:01<30:26:19,  3.35it/s]
  1%|          | 4214/371472 [20:02<31:16:13,  3.26it/s]
  1%|          | 4215/371472 [20:02<29:36:14,  3.45it/s]
  1%|          | 4216/371472 [20:02<30:00:10,  3.40it/s]
  1%|          | 4217/371472 [20:03<32:51:37,  3.10it/s]
  1%|          | 4218/371472 [20:03<31:20:30,  3.25it/s]
  1%|          | 4219/371472 [20:03<29:24:48,  3.47it/s]
  1%|          | 4220/371472 [20:03<28:15:49,  3.61it/s]
                                                        
{'loss': 5.2914, 'learning_rate': 9.90255122928742e-07, 'epoch': 0.18}

  1%|          | 4220/371472 [20:03<28:15:49,  3.61it/s]
  1%|          | 4221/371472 [20:04<32:05:42,  3.18it/s]
  1%|          | 4222/371472 [20:04<31:16:52,  3.26it/s]
  1%|          | 4223/371472 [20:04<29:19:53,  3.48it/s]
  1%|          | 4224/371472 [20:05<28:05:10,  3.63it/s]
  1%|          | 4225/371472 [20:05<27:36:28,  3.70it/s]
  1%|          | 4226/371472 [20:05<27:56:01,  3.65it/s]
  1%|          | 4227/371472 [20:05<26:53:58,  3.79it/s]
  1%|          | 4228/371472 [20:06<27:22:05,  3.73it/s]
  1%|          | 4229/371472 [20:06<28:31:45,  3.58it/s]
  1%|          | 4230/371472 [20:06<29:58:50,  3.40it/s]
  1%|          | 4231/371472 [20:07<29:31:16,  3.46it/s]
  1%|          | 4232/371472 [20:07<28:37:28,  3.56it/s]
  1%|          | 4233/371472 [20:07<30:10:25,  3.38it/s]
  1%|          | 4234/371472 [20:07<30:11:24,  3.38it/s]
  1%|          | 4235/371472 [20:08<29:51:07,  3.42it/s]
  1%|          | 4236/371472 [20:08<29:53:27,  3.41it/s]
  1%|          | 4237/371472 [20:08<29:16:48,  3.48it/s]
  1%|          | 4238/371472 [20:09<28:35:44,  3.57it/s]
  1%|          | 4239/371472 [20:09<29:23:33,  3.47it/s]
  1%|          | 4240/371472 [20:09<29:20:00,  3.48it/s]
                                                        
{'loss': 5.2059, 'learning_rate': 9.902066409532634e-07, 'epoch': 0.18}

  1%|          | 4240/371472 [20:09<29:20:00,  3.48it/s]
  1%|          | 4241/371472 [20:09<28:59:36,  3.52it/s]
  1%|          | 4242/371472 [20:10<27:52:51,  3.66it/s]
  1%|          | 4243/371472 [20:10<27:24:08,  3.72it/s]
  1%|          | 4244/371472 [20:10<27:47:14,  3.67it/s]
  1%|          | 4245/371472 [20:10<26:54:32,  3.79it/s]
  1%|          | 4246/371472 [20:11<27:40:55,  3.68it/s]
  1%|          | 4247/371472 [20:11<28:00:27,  3.64it/s]
  1%|          | 4248/371472 [20:11<26:47:16,  3.81it/s]
  1%|          | 4249/371472 [20:12<27:02:29,  3.77it/s]
  1%|          | 4250/371472 [20:12<26:43:25,  3.82it/s]
  1%|          | 4251/371472 [20:12<27:16:09,  3.74it/s]
  1%|          | 4252/371472 [20:12<30:01:54,  3.40it/s]
  1%|          | 4253/371472 [20:13<28:26:46,  3.59it/s]
  1%|          | 4254/371472 [20:13<27:19:34,  3.73it/s]
  1%|          | 4255/371472 [20:13<27:40:57,  3.68it/s]
  1%|          | 4256/371472 [20:13<27:58:07,  3.65it/s]
  1%|          | 4257/371472 [20:14<27:42:44,  3.68it/s]
  1%|          | 4258/371472 [20:14<28:07:32,  3.63it/s]
  1%|          | 4259/371472 [20:14<27:30:46,  3.71it/s]
  1%|          | 4260/371472 [20:15<27:07:00,  3.76it/s]
                                                        
{'loss': 5.1896, 'learning_rate': 9.901581589777845e-07, 'epoch': 0.18}

  1%|          | 4260/371472 [20:15<27:07:00,  3.76it/s]
  1%|          | 4261/371472 [20:15<27:57:47,  3.65it/s]
  1%|          | 4262/371472 [20:15<27:05:18,  3.77it/s]
  1%|          | 4263/371472 [20:15<26:52:48,  3.79it/s]
  1%|          | 4264/371472 [20:16<27:48:18,  3.67it/s]
  1%|          | 4265/371472 [20:16<26:49:21,  3.80it/s]
  1%|          | 4266/371472 [20:16<27:14:44,  3.74it/s]
  1%|          | 4267/371472 [20:16<27:10:11,  3.75it/s]
  1%|          | 4268/371472 [20:17<27:46:22,  3.67it/s]
  1%|          | 4269/371472 [20:17<29:31:42,  3.45it/s]
  1%|          | 4270/371472 [20:17<28:50:07,  3.54it/s]
  1%|          | 4271/371472 [20:18<28:31:34,  3.58it/s]
  1%|          | 4272/371472 [20:18<28:37:33,  3.56it/s]
  1%|          | 4273/371472 [20:18<28:19:48,  3.60it/s]
  1%|          | 4274/371472 [20:18<27:47:21,  3.67it/s]
  1%|          | 4275/371472 [20:19<28:17:01,  3.61it/s]
  1%|          | 4276/371472 [20:19<27:39:07,  3.69it/s]
  1%|          | 4277/371472 [20:19<27:27:17,  3.72it/s]
  1%|          | 4278/371472 [20:19<27:35:32,  3.70it/s]
  1%|          | 4279/371472 [20:20<29:12:14,  3.49it/s]
  1%|          | 4280/371472 [20:20<28:57:30,  3.52it/s]
                                                        
{'loss': 5.256, 'learning_rate': 9.901096770023055e-07, 'epoch': 0.18}

  1%|          | 4280/371472 [20:20<28:57:30,  3.52it/s]
  1%|          | 4281/371472 [20:20<29:05:57,  3.51it/s]
  1%|          | 4282/371472 [20:21<28:23:47,  3.59it/s]
  1%|          | 4283/371472 [20:21<27:19:04,  3.73it/s]
  1%|          | 4284/371472 [20:21<26:50:25,  3.80it/s]
  1%|          | 4285/371472 [20:21<27:45:06,  3.68it/s]
  1%|          | 4286/371472 [20:22<29:43:00,  3.43it/s]
  1%|          | 4287/371472 [20:22<28:05:56,  3.63it/s]
  1%|          | 4288/371472 [20:22<32:12:58,  3.17it/s]
  1%|          | 4289/371472 [20:23<30:34:10,  3.34it/s]
  1%|          | 4290/371472 [20:23<28:51:26,  3.53it/s]
  1%|          | 4291/371472 [20:23<27:51:18,  3.66it/s]
  1%|          | 4292/371472 [20:23<27:54:39,  3.65it/s]
  1%|          | 4293/371472 [20:24<27:30:15,  3.71it/s]
  1%|          | 4294/371472 [20:24<27:37:45,  3.69it/s]
  1%|          | 4295/371472 [20:24<28:59:16,  3.52it/s]
  1%|          | 4296/371472 [20:25<30:52:17,  3.30it/s]
  1%|          | 4297/371472 [20:25<28:53:11,  3.53it/s]
  1%|          | 4298/371472 [20:25<27:36:28,  3.69it/s]
  1%|          | 4299/371472 [20:25<27:40:02,  3.69it/s]
  1%|          | 4300/371472 [20:26<27:00:19,  3.78it/s]
                                                        
{'loss': 5.3677, 'learning_rate': 9.900611950268268e-07, 'epoch': 0.19}

  1%|          | 4300/371472 [20:26<27:00:19,  3.78it/s]
  1%|          | 4301/371472 [20:26<26:53:07,  3.79it/s]
  1%|          | 4302/371472 [20:26<29:07:26,  3.50it/s]
  1%|          | 4303/371472 [20:26<28:05:20,  3.63it/s]
  1%|          | 4304/371472 [20:27<28:22:52,  3.59it/s]
  1%|          | 4305/371472 [20:27<28:11:04,  3.62it/s]
  1%|          | 4306/371472 [20:27<27:54:47,  3.65it/s]
  1%|          | 4307/371472 [20:28<28:34:47,  3.57it/s]
  1%|          | 4308/371472 [20:28<30:17:48,  3.37it/s]
  1%|          | 4309/371472 [20:28<31:58:15,  3.19it/s]
  1%|          | 4310/371472 [20:29<32:54:20,  3.10it/s]
  1%|          | 4311/371472 [20:29<32:03:12,  3.18it/s]
  1%|          | 4312/371472 [20:29<31:04:26,  3.28it/s]
  1%|          | 4313/371472 [20:29<30:11:57,  3.38it/s]
  1%|          | 4314/371472 [20:30<29:07:21,  3.50it/s]
  1%|          | 4315/371472 [20:30<28:11:50,  3.62it/s]
  1%|          | 4316/371472 [20:30<29:20:50,  3.48it/s]
  1%|          | 4317/371472 [20:31<28:37:56,  3.56it/s]
  1%|          | 4318/371472 [20:31<27:37:44,  3.69it/s]
  1%|          | 4319/371472 [20:31<27:26:56,  3.72it/s]
  1%|          | 4320/371472 [20:31<26:58:47,  3.78it/s]
                                                        
{'loss': 5.1496, 'learning_rate': 9.900127130513477e-07, 'epoch': 0.19}

  1%|          | 4320/371472 [20:31<26:58:47,  3.78it/s]
  1%|          | 4321/371472 [20:32<27:34:35,  3.70it/s]
  1%|          | 4322/371472 [20:32<27:52:19,  3.66it/s]
  1%|          | 4323/371472 [20:32<28:14:21,  3.61it/s]
  1%|          | 4324/371472 [20:32<28:47:55,  3.54it/s]
  1%|          | 4325/371472 [20:33<28:34:11,  3.57it/s]
  1%|          | 4326/371472 [20:33<28:14:26,  3.61it/s]
  1%|          | 4327/371472 [20:33<27:30:42,  3.71it/s]
  1%|          | 4328/371472 [20:34<28:06:51,  3.63it/s]
  1%|          | 4329/371472 [20:34<28:20:43,  3.60it/s]
  1%|          | 4330/371472 [20:34<28:12:23,  3.62it/s]
  1%|          | 4331/371472 [20:34<29:12:55,  3.49it/s]
  1%|          | 4332/371472 [20:35<28:19:43,  3.60it/s]
  1%|          | 4333/371472 [20:35<30:24:37,  3.35it/s]
  1%|          | 4334/371472 [20:35<29:50:13,  3.42it/s]
  1%|          | 4335/371472 [20:36<29:17:54,  3.48it/s]
  1%|          | 4336/371472 [20:36<28:22:38,  3.59it/s]
  1%|          | 4337/371472 [20:36<28:20:46,  3.60it/s]
  1%|          | 4338/371472 [20:36<28:31:24,  3.58it/s]
  1%|          | 4339/371472 [20:37<28:12:10,  3.62it/s]
  1%|          | 4340/371472 [20:37<27:05:51,  3.76it/s]
                                                        
{'loss': 5.2171, 'learning_rate': 9.89964231075869e-07, 'epoch': 0.19}

  1%|          | 4340/371472 [20:37<27:05:51,  3.76it/s]
  1%|          | 4341/371472 [20:37<28:23:39,  3.59it/s]
  1%|          | 4342/371472 [20:37<27:48:58,  3.67it/s]
  1%|          | 4343/371472 [20:38<27:12:27,  3.75it/s]
  1%|          | 4344/371472 [20:38<26:29:32,  3.85it/s]
  1%|          | 4345/371472 [20:38<29:16:59,  3.48it/s]
  1%|          | 4346/371472 [20:39<31:17:33,  3.26it/s]
  1%|          | 4347/371472 [20:39<31:17:16,  3.26it/s]
  1%|          | 4348/371472 [20:39<29:08:27,  3.50it/s]
  1%|          | 4349/371472 [20:39<28:41:24,  3.55it/s]
  1%|          | 4350/371472 [20:40<27:50:59,  3.66it/s]
  1%|          | 4351/371472 [20:40<27:13:25,  3.75it/s]
  1%|          | 4352/371472 [20:40<26:23:48,  3.86it/s]
  1%|          | 4353/371472 [20:41<27:33:07,  3.70it/s]
  1%|          | 4354/371472 [20:41<28:00:54,  3.64it/s]
  1%|          | 4355/371472 [20:41<27:11:43,  3.75it/s]
  1%|          | 4356/371472 [20:41<27:09:30,  3.75it/s]
  1%|          | 4357/371472 [20:42<30:08:16,  3.38it/s]
  1%|          | 4358/371472 [20:42<29:08:01,  3.50it/s]
  1%|          | 4359/371472 [20:42<28:14:07,  3.61it/s]
  1%|          | 4360/371472 [20:42<27:53:27,  3.66it/s]
                                                        
{'loss': 5.1794, 'learning_rate': 9.899157491003898e-07, 'epoch': 0.19}

  1%|          | 4360/371472 [20:42<27:53:27,  3.66it/s]
  1%|          | 4361/371472 [20:43<28:53:18,  3.53it/s]
  1%|          | 4362/371472 [20:43<31:08:31,  3.27it/s]
  1%|          | 4363/371472 [20:43<29:54:36,  3.41it/s]
  1%|          | 4364/371472 [20:44<28:53:36,  3.53it/s]
  1%|          | 4365/371472 [20:44<29:53:44,  3.41it/s]
  1%|          | 4366/371472 [20:44<32:48:42,  3.11it/s]
  1%|          | 4367/371472 [20:45<30:15:51,  3.37it/s]
  1%|          | 4368/371472 [20:45<30:36:13,  3.33it/s]
  1%|          | 4369/371472 [20:45<29:08:39,  3.50it/s]
  1%|          | 4370/371472 [20:45<27:28:45,  3.71it/s]
  1%|          | 4371/371472 [20:46<31:15:05,  3.26it/s]
  1%|          | 4372/371472 [20:46<29:26:06,  3.46it/s]
  1%|          | 4373/371472 [20:46<30:15:58,  3.37it/s]
  1%|          | 4374/371472 [20:47<29:21:40,  3.47it/s]
  1%|          | 4375/371472 [20:47<30:00:41,  3.40it/s]
  1%|          | 4376/371472 [20:47<30:51:36,  3.30it/s]
  1%|          | 4377/371472 [20:48<31:57:13,  3.19it/s]
  1%|          | 4378/371472 [20:48<31:53:45,  3.20it/s]
  1%|          | 4379/371472 [20:48<32:54:18,  3.10it/s]
  1%|          | 4380/371472 [20:48<30:56:11,  3.30it/s]
                                                        
{'loss': 5.149, 'learning_rate': 9.89867267124911e-07, 'epoch': 0.19}

  1%|          | 4380/371472 [20:49<30:56:11,  3.30it/s]
  1%|          | 4381/371472 [20:49<29:57:01,  3.40it/s]
  1%|          | 4382/371472 [20:49<29:18:19,  3.48it/s]
  1%|          | 4383/371472 [20:49<27:58:27,  3.65it/s]
  1%|          | 4384/371472 [20:50<28:41:43,  3.55it/s]
  1%|          | 4385/371472 [20:50<29:44:03,  3.43it/s]
  1%|          | 4386/371472 [20:50<30:31:40,  3.34it/s]
  1%|          | 4387/371472 [20:51<30:22:53,  3.36it/s]
  1%|          | 4388/371472 [20:51<29:59:34,  3.40it/s]
  1%|          | 4389/371472 [20:51<29:21:44,  3.47it/s]
  1%|          | 4390/371472 [20:51<28:38:09,  3.56it/s]
  1%|          | 4391/371472 [20:52<28:01:43,  3.64it/s]
  1%|          | 4392/371472 [20:52<29:24:32,  3.47it/s]
  1%|          | 4393/371472 [20:52<27:59:11,  3.64it/s]
  1%|          | 4394/371472 [20:52<27:39:05,  3.69it/s]
  1%|          | 4395/371472 [20:53<28:40:28,  3.56it/s]
  1%|          | 4396/371472 [20:53<28:01:44,  3.64it/s]
  1%|          | 4397/371472 [20:53<27:10:56,  3.75it/s]
  1%|          | 4398/371472 [20:54<28:56:08,  3.52it/s]
  1%|          | 4399/371472 [20:54<27:43:55,  3.68it/s]
  1%|          | 4400/371472 [20:54<27:03:34,  3.77it/s]
                                                        
{'loss': 5.3623, 'learning_rate': 9.898187851494322e-07, 'epoch': 0.19}

  1%|          | 4400/371472 [20:54<27:03:34,  3.77it/s]
  1%|          | 4401/371472 [20:54<28:52:07,  3.53it/s]
  1%|          | 4402/371472 [20:55<28:32:47,  3.57it/s]
  1%|          | 4403/371472 [20:55<27:51:18,  3.66it/s]
  1%|          | 4404/371472 [20:55<28:11:40,  3.62it/s]
  1%|          | 4405/371472 [20:55<29:00:18,  3.52it/s]
  1%|          | 4406/371472 [20:56<29:10:37,  3.49it/s]
  1%|          | 4407/371472 [20:56<28:51:03,  3.53it/s]
  1%|          | 4408/371472 [20:56<27:48:18,  3.67it/s]
  1%|          | 4409/371472 [20:57<27:39:49,  3.69it/s]
  1%|          | 4410/371472 [20:57<26:38:23,  3.83it/s]
  1%|          | 4411/371472 [20:57<25:55:41,  3.93it/s]
  1%|          | 4412/371472 [20:57<26:11:36,  3.89it/s]
  1%|          | 4413/371472 [20:58<27:22:15,  3.73it/s]
  1%|          | 4414/371472 [20:58<27:30:28,  3.71it/s]
  1%|          | 4415/371472 [20:58<27:19:33,  3.73it/s]
  1%|          | 4416/371472 [20:58<27:39:28,  3.69it/s]
  1%|          | 4417/371472 [20:59<26:37:04,  3.83it/s]
  1%|          | 4418/371472 [20:59<29:18:40,  3.48it/s]
  1%|          | 4419/371472 [20:59<28:10:32,  3.62it/s]
  1%|          | 4420/371472 [21:00<28:05:56,  3.63it/s]
                                                        
{'loss': 5.12, 'learning_rate': 9.897703031739532e-07, 'epoch': 0.19}

  1%|          | 4420/371472 [21:00<28:05:56,  3.63it/s]
  1%|          | 4421/371472 [21:00<32:44:54,  3.11it/s]
  1%|          | 4422/371472 [21:00<31:30:12,  3.24it/s]
  1%|          | 4423/371472 [21:01<31:42:29,  3.22it/s]
  1%|          | 4424/371472 [21:01<29:39:17,  3.44it/s]
  1%|          | 4425/371472 [21:01<29:07:43,  3.50it/s]
  1%|          | 4426/371472 [21:01<31:28:54,  3.24it/s]
  1%|          | 4427/371472 [21:02<30:29:12,  3.34it/s]
  1%|          | 4428/371472 [21:02<29:38:36,  3.44it/s]
  1%|          | 4429/371472 [21:02<28:25:42,  3.59it/s]
  1%|          | 4430/371472 [21:03<28:39:13,  3.56it/s]
  1%|          | 4431/371472 [21:03<28:10:46,  3.62it/s]
  1%|          | 4432/371472 [21:03<27:44:44,  3.67it/s]
  1%|          | 4433/371472 [21:03<27:52:56,  3.66it/s]
  1%|          | 4434/371472 [21:04<28:16:57,  3.60it/s]
  1%|          | 4435/371472 [21:04<28:04:44,  3.63it/s]
  1%|          | 4436/371472 [21:04<28:19:22,  3.60it/s]
  1%|          | 4437/371472 [21:04<28:18:38,  3.60it/s]
  1%|          | 4438/371472 [21:05<28:36:50,  3.56it/s]
  1%|          | 4439/371472 [21:05<28:32:42,  3.57it/s]
  1%|          | 4440/371472 [21:05<27:57:40,  3.65it/s]
                                                        
{'loss': 5.1459, 'learning_rate': 9.897218211984745e-07, 'epoch': 0.19}

  1%|          | 4440/371472 [21:05<27:57:40,  3.65it/s]
  1%|          | 4441/371472 [21:06<28:23:37,  3.59it/s]
  1%|          | 4442/371472 [21:06<29:27:03,  3.46it/s]
  1%|          | 4443/371472 [21:06<31:14:31,  3.26it/s]
  1%|          | 4444/371472 [21:06<29:54:19,  3.41it/s]
  1%|          | 4445/371472 [21:07<29:10:20,  3.49it/s]
  1%|          | 4446/371472 [21:07<28:22:11,  3.59it/s]
  1%|          | 4447/371472 [21:07<30:24:52,  3.35it/s]
  1%|          | 4448/371472 [21:08<29:21:57,  3.47it/s]
  1%|          | 4449/371472 [21:08<29:37:11,  3.44it/s]
  1%|          | 4450/371472 [21:08<29:11:31,  3.49it/s]
  1%|          | 4451/371472 [21:08<28:54:11,  3.53it/s]
  1%|          | 4452/371472 [21:09<28:01:51,  3.64it/s]
  1%|          | 4453/371472 [21:09<27:11:09,  3.75it/s]
  1%|          | 4454/371472 [21:09<26:32:00,  3.84it/s]
  1%|          | 4455/371472 [21:10<27:23:31,  3.72it/s]
  1%|          | 4456/371472 [21:10<28:00:16,  3.64it/s]
  1%|          | 4457/371472 [21:10<28:44:40,  3.55it/s]
  1%|          | 4458/371472 [21:10<29:04:01,  3.51it/s]
  1%|          | 4459/371472 [21:11<28:35:42,  3.57it/s]
  1%|          | 4460/371472 [21:11<30:40:30,  3.32it/s]
                                                        
{'loss': 5.1605, 'learning_rate': 9.896733392229954e-07, 'epoch': 0.19}

  1%|          | 4460/371472 [21:11<30:40:30,  3.32it/s]
  1%|          | 4461/371472 [21:11<28:48:45,  3.54it/s]
  1%|          | 4462/371472 [21:12<29:07:11,  3.50it/s]
  1%|          | 4463/371472 [21:12<29:53:41,  3.41it/s]
  1%|          | 4464/371472 [21:12<29:06:05,  3.50it/s]
  1%|          | 4465/371472 [21:12<30:53:49,  3.30it/s]
  1%|          | 4466/371472 [21:13<37:36:39,  2.71it/s]
  1%|          | 4467/371472 [21:13<34:45:35,  2.93it/s]
  1%|          | 4468/371472 [21:14<33:04:36,  3.08it/s]
  1%|          | 4469/371472 [21:14<31:04:05,  3.28it/s]
  1%|          | 4470/371472 [21:14<30:16:10,  3.37it/s]
  1%|          | 4471/371472 [21:14<31:23:07,  3.25it/s]
  1%|          | 4472/371472 [21:15<30:13:13,  3.37it/s]
  1%|          | 4473/371472 [21:15<30:06:59,  3.38it/s]
  1%|          | 4474/371472 [21:15<30:56:59,  3.29it/s]
  1%|          | 4475/371472 [21:16<29:13:14,  3.49it/s]
  1%|          | 4476/371472 [21:16<28:07:09,  3.63it/s]
  1%|          | 4477/371472 [21:16<29:15:38,  3.48it/s]
  1%|          | 4478/371472 [21:16<30:35:53,  3.33it/s]
  1%|          | 4479/371472 [21:17<31:04:03,  3.28it/s]
  1%|          | 4480/371472 [21:17<31:55:50,  3.19it/s]
                                                        
{'loss': 5.3126, 'learning_rate': 9.896248572475167e-07, 'epoch': 0.19}

  1%|          | 4480/371472 [21:17<31:55:50,  3.19it/s]
  1%|          | 4481/371472 [21:17<33:52:26,  3.01it/s]
  1%|          | 4482/371472 [21:18<31:36:29,  3.23it/s]
  1%|          | 4483/371472 [21:18<30:17:09,  3.37it/s]
  1%|          | 4484/371472 [21:18<32:09:12,  3.17it/s]
  1%|          | 4485/371472 [21:19<30:10:36,  3.38it/s]
  1%|          | 4486/371472 [21:19<30:40:07,  3.32it/s]
  1%|          | 4487/371472 [21:19<29:57:13,  3.40it/s]
  1%|          | 4488/371472 [21:19<29:20:50,  3.47it/s]
  1%|          | 4489/371472 [21:20<31:03:26,  3.28it/s]
  1%|          | 4490/371472 [21:20<29:47:23,  3.42it/s]
  1%|          | 4491/371472 [21:20<32:14:45,  3.16it/s]
  1%|          | 4492/371472 [21:21<31:31:36,  3.23it/s]
  1%|          | 4493/371472 [21:21<30:49:58,  3.31it/s]
  1%|          | 4494/371472 [21:21<29:27:27,  3.46it/s]
  1%|          | 4495/371472 [21:22<30:25:59,  3.35it/s]
  1%|          | 4496/371472 [21:22<29:48:02,  3.42it/s]
  1%|          | 4497/371472 [21:22<28:50:30,  3.53it/s]
  1%|          | 4498/371472 [21:22<29:04:41,  3.51it/s]
  1%|          | 4499/371472 [21:23<29:26:30,  3.46it/s]
  1%|          | 4500/371472 [21:23<28:41:27,  3.55it/s]
                                                        
{'loss': 5.3019, 'learning_rate': 9.895763752720377e-07, 'epoch': 0.19}

  1%|          | 4500/371472 [21:23<28:41:27,  3.55it/s]
  1%|          | 4501/371472 [21:23<27:43:45,  3.68it/s]
  1%|          | 4502/371472 [21:23<26:30:44,  3.84it/s]
  1%|          | 4503/371472 [21:24<26:58:49,  3.78it/s]
  1%|          | 4504/371472 [21:24<26:11:58,  3.89it/s]
  1%|          | 4505/371472 [21:24<28:47:04,  3.54it/s]
  1%|          | 4506/371472 [21:25<28:46:21,  3.54it/s]
  1%|          | 4507/371472 [21:25<27:34:05,  3.70it/s]
  1%|          | 4508/371472 [21:25<26:30:39,  3.84it/s]
  1%|          | 4509/371472 [21:25<26:54:21,  3.79it/s]
  1%|          | 4510/371472 [21:26<27:39:41,  3.69it/s]
  1%|          | 4511/371472 [21:26<28:27:22,  3.58it/s]
  1%|          | 4512/371472 [21:26<27:50:39,  3.66it/s]
  1%|          | 4513/371472 [21:26<27:11:43,  3.75it/s]
  1%|          | 4514/371472 [21:27<27:01:58,  3.77it/s]
  1%|          | 4515/371472 [21:27<26:29:38,  3.85it/s]
  1%|          | 4516/371472 [21:27<29:58:02,  3.40it/s]
  1%|          | 4517/371472 [21:28<28:22:50,  3.59it/s]
  1%|          | 4518/371472 [21:28<27:45:00,  3.67it/s]
  1%|          | 4519/371472 [21:28<28:57:17,  3.52it/s]
  1%|          | 4520/371472 [21:28<30:37:37,  3.33it/s]
                                                        
{'loss': 5.165, 'learning_rate': 9.895278932965588e-07, 'epoch': 0.19}

  1%|          | 4520/371472 [21:29<30:37:37,  3.33it/s]
  1%|          | 4521/371472 [21:29<29:07:05,  3.50it/s]
  1%|          | 4522/371472 [21:29<28:22:01,  3.59it/s]
  1%|          | 4523/371472 [21:29<29:03:45,  3.51it/s]
  1%|          | 4524/371472 [21:30<29:03:47,  3.51it/s]
  1%|          | 4525/371472 [21:30<28:41:27,  3.55it/s]
  1%|          | 4526/371472 [21:30<29:07:11,  3.50it/s]
  1%|          | 4527/371472 [21:31<31:33:12,  3.23it/s]
  1%|          | 4528/371472 [21:31<30:37:05,  3.33it/s]
  1%|          | 4529/371472 [21:31<29:03:21,  3.51it/s]
  1%|          | 4530/371472 [21:31<30:18:52,  3.36it/s]
  1%|          | 4531/371472 [21:32<32:36:39,  3.13it/s]
  1%|          | 4532/371472 [21:32<32:17:54,  3.16it/s]
  1%|          | 4533/371472 [21:32<29:59:50,  3.40it/s]
  1%|          | 4534/371472 [21:33<28:47:49,  3.54it/s]
  1%|          | 4535/371472 [21:33<27:45:48,  3.67it/s]
  1%|          | 4536/371472 [21:33<28:00:17,  3.64it/s]
  1%|          | 4537/371472 [21:33<26:52:20,  3.79it/s]
  1%|          | 4538/371472 [21:34<27:38:50,  3.69it/s]
  1%|          | 4539/371472 [21:34<39:10:46,  2.60it/s]
  1%|          | 4540/371472 [21:35<35:44:09,  2.85it/s]
                                                        
{'loss': 5.2627, 'learning_rate': 9.894794113210799e-07, 'epoch': 0.2}

  1%|          | 4540/371472 [21:35<35:44:09,  2.85it/s]
  1%|          | 4541/371472 [21:35<37:08:33,  2.74it/s]
  1%|          | 4542/371472 [21:35<34:49:42,  2.93it/s]
  1%|          | 4543/371472 [21:35<31:34:54,  3.23it/s]
  1%|          | 4544/371472 [21:36<29:25:55,  3.46it/s]
  1%|          | 4545/371472 [21:36<29:50:12,  3.42it/s]
  1%|          | 4546/371472 [21:36<28:36:41,  3.56it/s]
  1%|          | 4547/371472 [21:37<28:43:03,  3.55it/s]
  1%|          | 4548/371472 [21:37<28:56:49,  3.52it/s]
  1%|          | 4549/371472 [21:37<28:29:48,  3.58it/s]
  1%|          | 4550/371472 [21:37<28:57:10,  3.52it/s]
  1%|          | 4551/371472 [21:38<28:27:01,  3.58it/s]
  1%|          | 4552/371472 [21:38<28:02:27,  3.63it/s]
  1%|          | 4553/371472 [21:38<29:43:43,  3.43it/s]
  1%|          | 4554/371472 [21:39<29:44:16,  3.43it/s]
  1%|          | 4555/371472 [21:39<28:41:52,  3.55it/s]
  1%|          | 4556/371472 [21:39<27:53:12,  3.65it/s]
  1%|          | 4557/371472 [21:39<29:33:39,  3.45it/s]
  1%|          | 4558/371472 [21:40<28:12:07,  3.61it/s]
  1%|          | 4559/371472 [21:40<28:05:49,  3.63it/s]
  1%|          | 4560/371472 [21:40<27:55:56,  3.65it/s]
                                                        
{'loss': 5.2599, 'learning_rate': 9.89430929345601e-07, 'epoch': 0.2}

  1%|          | 4560/371472 [21:40<27:55:56,  3.65it/s]
  1%|          | 4561/371472 [21:40<27:09:55,  3.75it/s]
  1%|          | 4562/371472 [21:41<30:07:44,  3.38it/s]
  1%|          | 4563/371472 [21:41<28:54:26,  3.53it/s]
  1%|          | 4564/371472 [21:41<29:46:38,  3.42it/s]
  1%|          | 4565/371472 [21:42<30:00:48,  3.40it/s]
  1%|          | 4566/371472 [21:42<29:11:25,  3.49it/s]
  1%|          | 4567/371472 [21:42<29:08:53,  3.50it/s]
  1%|          | 4568/371472 [21:42<28:37:41,  3.56it/s]
  1%|          | 4569/371472 [21:43<28:26:02,  3.58it/s]
  1%|          | 4570/371472 [21:43<28:59:43,  3.51it/s]
  1%|          | 4571/371472 [21:43<28:15:19,  3.61it/s]
  1%|          | 4572/371472 [21:44<28:13:26,  3.61it/s]
  1%|          | 4573/371472 [21:44<27:39:44,  3.68it/s]
  1%|          | 4574/371472 [21:44<26:37:40,  3.83it/s]
  1%|          | 4575/371472 [21:44<27:34:26,  3.70it/s]
  1%|          | 4576/371472 [21:45<32:10:02,  3.17it/s]
  1%|          | 4577/371472 [21:45<31:13:26,  3.26it/s]
  1%|          | 4578/371472 [21:45<30:22:18,  3.36it/s]
  1%|          | 4579/371472 [21:46<28:57:49,  3.52it/s]
  1%|          | 4580/371472 [21:46<30:48:19,  3.31it/s]
                                                        
{'loss': 5.1008, 'learning_rate': 9.893824473701222e-07, 'epoch': 0.2}

  1%|          | 4580/371472 [21:46<30:48:19,  3.31it/s]
  1%|          | 4581/371472 [21:46<29:55:42,  3.41it/s]
  1%|          | 4582/371472 [21:46<28:18:57,  3.60it/s]
  1%|          | 4583/371472 [21:47<28:49:25,  3.54it/s]
  1%|          | 4584/371472 [21:47<27:58:34,  3.64it/s]
  1%|          | 4585/371472 [21:47<28:06:00,  3.63it/s]
  1%|          | 4586/371472 [21:48<27:56:03,  3.65it/s]
  1%|          | 4587/371472 [21:48<28:22:00,  3.59it/s]
  1%|          | 4588/371472 [21:48<28:22:14,  3.59it/s]
  1%|          | 4589/371472 [21:48<29:23:48,  3.47it/s]
  1%|          | 4590/371472 [21:49<31:24:18,  3.25it/s]
  1%|          | 4591/371472 [21:49<29:51:15,  3.41it/s]
  1%|          | 4592/371472 [21:49<32:09:51,  3.17it/s]
  1%|          | 4593/371472 [21:50<30:28:59,  3.34it/s]
  1%|          | 4594/371472 [21:50<28:38:22,  3.56it/s]
  1%|          | 4595/371472 [21:50<29:58:01,  3.40it/s]
  1%|          | 4596/371472 [21:50<28:21:10,  3.59it/s]
  1%|          | 4597/371472 [21:51<28:16:57,  3.60it/s]
  1%|          | 4598/371472 [21:51<29:24:48,  3.46it/s]
  1%|          | 4599/371472 [21:51<29:22:51,  3.47it/s]
  1%|          | 4600/371472 [21:52<29:34:54,  3.44it/s]
                                                        
{'loss': 5.1498, 'learning_rate': 9.89333965394643e-07, 'epoch': 0.2}

  1%|          | 4600/371472 [21:52<29:34:54,  3.44it/s]
  1%|          | 4601/371472 [21:52<28:34:39,  3.57it/s]
  1%|          | 4602/371472 [21:52<27:32:38,  3.70it/s]
  1%|          | 4603/371472 [21:52<29:12:09,  3.49it/s]
  1%|          | 4604/371472 [21:53<28:03:35,  3.63it/s]
  1%|          | 4605/371472 [21:53<27:59:55,  3.64it/s]
  1%|          | 4606/371472 [21:53<27:01:00,  3.77it/s]
  1%|          | 4607/371472 [21:54<27:28:22,  3.71it/s]
  1%|          | 4608/371472 [21:54<28:34:01,  3.57it/s]
  1%|          | 4609/371472 [21:54<31:08:05,  3.27it/s]
  1%|          | 4610/371472 [21:54<29:14:37,  3.48it/s]
  1%|          | 4611/371472 [21:55<27:33:06,  3.70it/s]
  1%|          | 4612/371472 [21:55<28:13:08,  3.61it/s]
  1%|          | 4613/371472 [21:55<27:29:55,  3.71it/s]
  1%|          | 4614/371472 [21:56<28:12:10,  3.61it/s]
  1%|          | 4615/371472 [21:56<29:17:26,  3.48it/s]
  1%|          | 4616/371472 [21:56<28:44:55,  3.54it/s]
  1%|          | 4617/371472 [21:56<29:09:36,  3.49it/s]
  1%|          | 4618/371472 [21:57<28:56:46,  3.52it/s]
  1%|          | 4619/371472 [21:57<28:50:39,  3.53it/s]
  1%|          | 4620/371472 [21:57<30:46:29,  3.31it/s]
                                                        
{'loss': 5.177, 'learning_rate': 9.892854834191644e-07, 'epoch': 0.2}

  1%|          | 4620/371472 [21:57<30:46:29,  3.31it/s]
  1%|          | 4621/371472 [21:58<33:10:14,  3.07it/s]
  1%|          | 4622/371472 [21:58<30:34:57,  3.33it/s]
  1%|          | 4623/371472 [21:58<29:55:52,  3.40it/s]
  1%|          | 4624/371472 [21:59<30:37:18,  3.33it/s]
  1%|          | 4625/371472 [21:59<28:57:37,  3.52it/s]
  1%|          | 4626/371472 [21:59<29:40:28,  3.43it/s]
  1%|          | 4627/371472 [21:59<29:05:59,  3.50it/s]
  1%|          | 4628/371472 [22:00<28:31:29,  3.57it/s]
  1%|          | 4629/371472 [22:00<27:15:52,  3.74it/s]
  1%|          | 4630/371472 [22:00<26:28:45,  3.85it/s]
  1%|          | 4631/371472 [22:00<26:37:57,  3.83it/s]
  1%|          | 4632/371472 [22:01<27:07:05,  3.76it/s]
  1%|          | 4633/371472 [22:01<26:34:00,  3.84it/s]
  1%|          | 4634/371472 [22:01<25:58:50,  3.92it/s]
  1%|          | 4635/371472 [22:01<25:48:37,  3.95it/s]
  1%|          | 4636/371472 [22:02<26:28:24,  3.85it/s]
  1%|          | 4637/371472 [22:02<26:44:23,  3.81it/s]
  1%|          | 4638/371472 [22:02<28:02:57,  3.63it/s]
  1%|          | 4639/371472 [22:03<28:12:45,  3.61it/s]
  1%|          | 4640/371472 [22:03<27:34:30,  3.70it/s]
                                                        
{'loss': 5.4382, 'learning_rate': 9.892370014436854e-07, 'epoch': 0.2}

  1%|          | 4640/371472 [22:03<27:34:30,  3.70it/s]
  1%|          | 4641/371472 [22:03<26:50:48,  3.80it/s]
  1%|          | 4642/371472 [22:03<27:49:08,  3.66it/s]
  1%|          | 4643/371472 [22:04<26:58:13,  3.78it/s]
  1%|▏         | 4644/371472 [22:04<26:33:49,  3.84it/s]
  1%|▏         | 4645/371472 [22:04<27:06:51,  3.76it/s]
  1%|▏         | 4646/371472 [22:04<26:45:26,  3.81it/s]
  1%|▏         | 4647/371472 [22:05<27:38:36,  3.69it/s]
  1%|▏         | 4648/371472 [22:05<29:34:18,  3.45it/s]
  1%|▏         | 4649/371472 [22:05<28:39:11,  3.56it/s]
  1%|▏         | 4650/371472 [22:06<29:17:37,  3.48it/s]
  1%|▏         | 4651/371472 [22:06<28:00:24,  3.64it/s]
  1%|▏         | 4652/371472 [22:06<27:33:33,  3.70it/s]
  1%|▏         | 4653/371472 [22:06<27:30:26,  3.70it/s]
  1%|▏         | 4654/371472 [22:07<27:54:13,  3.65it/s]
  1%|▏         | 4655/371472 [22:07<29:38:36,  3.44it/s]
  1%|▏         | 4656/371472 [22:07<28:23:37,  3.59it/s]
  1%|▏         | 4657/371472 [22:07<27:30:21,  3.70it/s]
  1%|▏         | 4658/371472 [22:08<28:00:22,  3.64it/s]
  1%|▏         | 4659/371472 [22:08<27:25:02,  3.72it/s]
  1%|▏         | 4660/371472 [22:08<29:36:30,  3.44it/s]
                                                        
{'loss': 5.2083, 'learning_rate': 9.891885194682065e-07, 'epoch': 0.2}

  1%|▏         | 4660/371472 [22:08<29:36:30,  3.44it/s]
  1%|▏         | 4661/371472 [22:09<29:01:53,  3.51it/s]
  1%|▏         | 4662/371472 [22:09<27:55:20,  3.65it/s]
  1%|▏         | 4663/371472 [22:09<30:41:51,  3.32it/s]
  1%|▏         | 4664/371472 [22:09<29:38:53,  3.44it/s]
  1%|▏         | 4665/371472 [22:10<30:17:32,  3.36it/s]
  1%|▏         | 4666/371472 [22:10<31:43:20,  3.21it/s]
  1%|▏         | 4667/371472 [22:10<29:50:18,  3.41it/s]
  1%|▏         | 4668/371472 [22:11<29:31:31,  3.45it/s]
  1%|▏         | 4669/371472 [22:11<28:28:47,  3.58it/s]
  1%|▏         | 4670/371472 [22:11<27:47:52,  3.67it/s]
  1%|▏         | 4671/371472 [22:11<28:33:04,  3.57it/s]
  1%|▏         | 4672/371472 [22:12<27:41:12,  3.68it/s]
  1%|▏         | 4673/371472 [22:12<27:05:59,  3.76it/s]
  1%|▏         | 4674/371472 [22:12<26:29:52,  3.85it/s]
  1%|▏         | 4675/371472 [22:13<27:53:09,  3.65it/s]
  1%|▏         | 4676/371472 [22:13<27:45:30,  3.67it/s]
  1%|▏         | 4677/371472 [22:13<27:42:16,  3.68it/s]
  1%|▏         | 4678/371472 [22:13<28:36:10,  3.56it/s]
  1%|▏         | 4679/371472 [22:14<29:51:16,  3.41it/s]
  1%|▏         | 4680/371472 [22:14<29:28:51,  3.46it/s]
                                                        
{'loss': 5.1972, 'learning_rate': 9.891400374927278e-07, 'epoch': 0.2}

  1%|▏         | 4680/371472 [22:14<29:28:51,  3.46it/s]
  1%|▏         | 4681/371472 [22:14<29:05:33,  3.50it/s]
  1%|▏         | 4682/371472 [22:14<27:19:19,  3.73it/s]
  1%|▏         | 4683/371472 [22:15<26:59:09,  3.78it/s]
  1%|▏         | 4684/371472 [22:15<27:17:21,  3.73it/s]
  1%|▏         | 4685/371472 [22:15<28:38:03,  3.56it/s]
  1%|▏         | 4686/371472 [22:16<29:58:51,  3.40it/s]
  1%|▏         | 4687/371472 [22:16<28:41:58,  3.55it/s]
  1%|▏         | 4688/371472 [22:16<28:06:12,  3.63it/s]
  1%|▏         | 4689/371472 [22:16<30:01:33,  3.39it/s]
  1%|▏         | 4690/371472 [22:17<28:54:56,  3.52it/s]
  1%|▏         | 4691/371472 [22:17<30:02:45,  3.39it/s]
  1%|▏         | 4692/371472 [22:18<34:45:21,  2.93it/s]
  1%|▏         | 4693/371472 [22:18<32:27:34,  3.14it/s]
  1%|▏         | 4694/371472 [22:18<31:33:47,  3.23it/s]
  1%|▏         | 4695/371472 [22:18<31:31:20,  3.23it/s]
  1%|▏         | 4696/371472 [22:19<30:12:32,  3.37it/s]
  1%|▏         | 4697/371472 [22:19<29:42:09,  3.43it/s]
  1%|▏         | 4698/371472 [22:19<30:12:34,  3.37it/s]
  1%|▏         | 4699/371472 [22:20<31:00:11,  3.29it/s]
  1%|▏         | 4700/371472 [22:20<30:35:41,  3.33it/s]
                                                        
{'loss': 5.2555, 'learning_rate': 9.890915555172487e-07, 'epoch': 0.2}

  1%|▏         | 4700/371472 [22:20<30:35:41,  3.33it/s]
  1%|▏         | 4701/371472 [22:20<31:41:48,  3.21it/s]
  1%|▏         | 4702/371472 [22:20<29:40:58,  3.43it/s]
  1%|▏         | 4703/371472 [22:21<28:31:58,  3.57it/s]
  1%|▏         | 4704/371472 [22:21<27:06:19,  3.76it/s]
  1%|▏         | 4705/371472 [22:21<28:18:36,  3.60it/s]
  1%|▏         | 4706/371472 [22:21<27:35:53,  3.69it/s]
  1%|▏         | 4707/371472 [22:22<27:22:57,  3.72it/s]
  1%|▏         | 4708/371472 [22:22<27:01:41,  3.77it/s]
  1%|▏         | 4709/371472 [22:22<29:15:42,  3.48it/s]
  1%|▏         | 4710/371472 [22:23<30:12:54,  3.37it/s]
  1%|▏         | 4711/371472 [22:23<30:13:48,  3.37it/s]
  1%|▏         | 4712/371472 [22:23<30:27:49,  3.34it/s]
  1%|▏         | 4713/371472 [22:24<30:06:47,  3.38it/s]
  1%|▏         | 4714/371472 [22:24<32:17:59,  3.15it/s]
  1%|▏         | 4715/371472 [22:24<31:38:54,  3.22it/s]
  1%|▏         | 4716/371472 [22:24<30:28:55,  3.34it/s]
  1%|▏         | 4717/371472 [22:25<30:00:59,  3.39it/s]
  1%|▏         | 4718/371472 [22:25<29:08:01,  3.50it/s]
  1%|▏         | 4719/371472 [22:25<27:59:09,  3.64it/s]
  1%|▏         | 4720/371472 [22:26<28:22:10,  3.59it/s]
                                                        
{'loss': 5.3427, 'learning_rate': 9.8904307354177e-07, 'epoch': 0.2}

  1%|▏         | 4720/371472 [22:26<28:22:10,  3.59it/s]
  1%|▏         | 4721/371472 [22:26<27:55:35,  3.65it/s]
  1%|▏         | 4722/371472 [22:26<27:06:46,  3.76it/s]
  1%|▏         | 4723/371472 [22:26<27:19:50,  3.73it/s]
  1%|▏         | 4724/371472 [22:27<30:52:05,  3.30it/s]
  1%|▏         | 4725/371472 [22:27<29:39:50,  3.43it/s]
  1%|▏         | 4726/371472 [22:27<28:52:48,  3.53it/s]
  1%|▏         | 4727/371472 [22:28<28:52:11,  3.53it/s]
  1%|▏         | 4728/371472 [22:28<28:00:45,  3.64it/s]
  1%|▏         | 4729/371472 [22:28<27:22:33,  3.72it/s]
  1%|▏         | 4730/371472 [22:28<29:10:00,  3.49it/s]
  1%|▏         | 4731/371472 [22:29<28:49:00,  3.54it/s]
  1%|▏         | 4732/371472 [22:29<27:54:45,  3.65it/s]
  1%|▏         | 4733/371472 [22:29<27:05:25,  3.76it/s]
  1%|▏         | 4734/371472 [22:29<26:53:21,  3.79it/s]
  1%|▏         | 4735/371472 [22:30<30:45:01,  3.31it/s]
  1%|▏         | 4736/371472 [22:30<30:47:20,  3.31it/s]
  1%|▏         | 4737/371472 [22:30<28:58:50,  3.52it/s]
  1%|▏         | 4738/371472 [22:31<28:54:43,  3.52it/s]
  1%|▏         | 4739/371472 [22:31<28:20:03,  3.60it/s]
  1%|▏         | 4740/371472 [22:31<27:44:29,  3.67it/s]
                                                        
{'loss': 5.1514, 'learning_rate': 9.889945915662908e-07, 'epoch': 0.2}

  1%|▏         | 4740/371472 [22:31<27:44:29,  3.67it/s]
  1%|▏         | 4741/371472 [22:31<27:21:05,  3.72it/s]
  1%|▏         | 4742/371472 [22:32<26:36:11,  3.83it/s]
  1%|▏         | 4743/371472 [22:32<27:47:14,  3.67it/s]
  1%|▏         | 4744/371472 [22:32<28:16:17,  3.60it/s]
  1%|▏         | 4745/371472 [22:33<28:16:15,  3.60it/s]
  1%|▏         | 4746/371472 [22:33<28:28:41,  3.58it/s]
  1%|▏         | 4747/371472 [22:33<28:07:33,  3.62it/s]
  1%|▏         | 4748/371472 [22:33<27:20:54,  3.72it/s]
  1%|▏         | 4749/371472 [22:34<27:41:04,  3.68it/s]
  1%|▏         | 4750/371472 [22:34<27:06:13,  3.76it/s]
  1%|▏         | 4751/371472 [22:34<28:41:43,  3.55it/s]
  1%|▏         | 4752/371472 [22:34<28:04:27,  3.63it/s]
  1%|▏         | 4753/371472 [22:35<27:28:49,  3.71it/s]
  1%|▏         | 4754/371472 [22:35<27:36:10,  3.69it/s]
  1%|▏         | 4755/371472 [22:35<26:40:36,  3.82it/s]
  1%|▏         | 4756/371472 [22:35<26:34:52,  3.83it/s]
  1%|▏         | 4757/371472 [22:36<27:07:20,  3.76it/s]
  1%|▏         | 4758/371472 [22:36<28:20:35,  3.59it/s]
  1%|▏         | 4759/371472 [22:36<28:58:51,  3.51it/s]
  1%|▏         | 4760/371472 [22:37<28:07:34,  3.62it/s]
                                                        
{'loss': 5.4223, 'learning_rate': 9.88946109590812e-07, 'epoch': 0.21}

  1%|▏         | 4760/371472 [22:37<28:07:34,  3.62it/s]
  1%|▏         | 4761/371472 [22:37<28:27:41,  3.58it/s]
  1%|▏         | 4762/371472 [22:37<28:27:33,  3.58it/s]
  1%|▏         | 4763/371472 [22:37<28:05:59,  3.63it/s]
  1%|▏         | 4764/371472 [22:38<27:09:30,  3.75it/s]
  1%|▏         | 4765/371472 [22:38<27:03:52,  3.76it/s]
  1%|▏         | 4766/371472 [22:38<29:42:08,  3.43it/s]
  1%|▏         | 4767/371472 [22:39<28:43:31,  3.55it/s]
  1%|▏         | 4768/371472 [22:39<29:31:25,  3.45it/s]
  1%|▏         | 4769/371472 [22:39<29:34:20,  3.44it/s]
  1%|▏         | 4770/371472 [22:39<29:46:11,  3.42it/s]
  1%|▏         | 4771/371472 [22:40<29:01:25,  3.51it/s]
  1%|▏         | 4772/371472 [22:40<29:07:07,  3.50it/s]
  1%|▏         | 4773/371472 [22:40<27:59:08,  3.64it/s]
  1%|▏         | 4774/371472 [22:41<27:30:25,  3.70it/s]
  1%|▏         | 4775/371472 [22:41<26:27:14,  3.85it/s]
  1%|▏         | 4776/371472 [22:41<26:06:33,  3.90it/s]
  1%|▏         | 4777/371472 [22:41<27:22:39,  3.72it/s]
  1%|▏         | 4778/371472 [22:42<27:30:03,  3.70it/s]
  1%|▏         | 4779/371472 [22:42<27:06:43,  3.76it/s]
  1%|▏         | 4780/371472 [22:42<27:07:12,  3.76it/s]
                                                        
{'loss': 5.2675, 'learning_rate': 9.888976276153332e-07, 'epoch': 0.21}

  1%|▏         | 4780/371472 [22:42<27:07:12,  3.76it/s]
  1%|▏         | 4781/371472 [22:42<28:21:59,  3.59it/s]
  1%|▏         | 4782/371472 [22:43<27:30:57,  3.70it/s]
  1%|▏         | 4783/371472 [22:43<26:52:35,  3.79it/s]
  1%|▏         | 4784/371472 [22:43<26:38:23,  3.82it/s]
  1%|▏         | 4785/371472 [22:43<25:53:34,  3.93it/s]
  1%|▏         | 4786/371472 [22:44<25:47:50,  3.95it/s]
  1%|▏         | 4787/371472 [22:44<28:21:46,  3.59it/s]
  1%|▏         | 4788/371472 [22:44<29:11:45,  3.49it/s]
  1%|▏         | 4789/371472 [22:45<27:57:08,  3.64it/s]
  1%|▏         | 4790/371472 [22:45<27:01:17,  3.77it/s]
  1%|▏         | 4791/371472 [22:45<26:37:30,  3.83it/s]
  1%|▏         | 4792/371472 [22:45<28:18:43,  3.60it/s]
  1%|▏         | 4793/371472 [22:46<27:37:49,  3.69it/s]
  1%|▏         | 4794/371472 [22:46<28:05:03,  3.63it/s]
  1%|▏         | 4795/371472 [22:46<29:08:37,  3.49it/s]
  1%|▏         | 4796/371472 [22:46<28:19:07,  3.60it/s]
  1%|▏         | 4797/371472 [22:47<27:04:25,  3.76it/s]
  1%|▏         | 4798/371472 [22:47<27:01:27,  3.77it/s]
  1%|▏         | 4799/371472 [22:47<26:39:02,  3.82it/s]
  1%|▏         | 4800/371472 [22:47<26:09:37,  3.89it/s]
                                                        
{'loss': 5.2755, 'learning_rate': 9.888491456398542e-07, 'epoch': 0.21}

  1%|▏         | 4800/371472 [22:47<26:09:37,  3.89it/s]
  1%|▏         | 4801/371472 [22:48<25:57:45,  3.92it/s]
  1%|▏         | 4802/371472 [22:48<26:20:24,  3.87it/s]
  1%|▏         | 4803/371472 [22:48<26:13:57,  3.88it/s]
  1%|▏         | 4804/371472 [22:49<27:07:11,  3.76it/s]
  1%|▏         | 4805/371472 [22:49<30:14:37,  3.37it/s]
  1%|▏         | 4806/371472 [22:49<29:42:30,  3.43it/s]
  1%|▏         | 4807/371472 [22:49<29:34:53,  3.44it/s]
  1%|▏         | 4808/371472 [22:50<29:48:21,  3.42it/s]
  1%|▏         | 4809/371472 [22:50<29:37:32,  3.44it/s]
  1%|▏         | 4810/371472 [22:50<30:34:24,  3.33it/s]
  1%|▏         | 4811/371472 [22:51<30:00:04,  3.39it/s]
  1%|▏         | 4812/371472 [22:51<33:16:07,  3.06it/s]
  1%|▏         | 4813/371472 [22:51<31:35:11,  3.22it/s]
  1%|▏         | 4814/371472 [22:52<29:29:36,  3.45it/s]
  1%|▏         | 4815/371472 [22:52<28:31:33,  3.57it/s]
  1%|▏         | 4816/371472 [22:52<27:05:33,  3.76it/s]
  1%|▏         | 4817/371472 [22:52<28:40:26,  3.55it/s]
  1%|▏         | 4818/371472 [22:53<28:47:02,  3.54it/s]
  1%|▏         | 4819/371472 [22:53<29:04:42,  3.50it/s]
  1%|▏         | 4820/371472 [22:53<28:21:03,  3.59it/s]
                                                        
{'loss': 5.0806, 'learning_rate': 9.888006636643755e-07, 'epoch': 0.21}

  1%|▏         | 4820/371472 [22:53<28:21:03,  3.59it/s]
  1%|▏         | 4821/371472 [22:53<27:35:12,  3.69it/s]
  1%|▏         | 4822/371472 [22:54<27:47:49,  3.66it/s]
  1%|▏         | 4823/371472 [22:54<30:38:20,  3.32it/s]
  1%|▏         | 4824/371472 [22:54<29:55:25,  3.40it/s]
  1%|▏         | 4825/371472 [22:55<30:14:07,  3.37it/s]
  1%|▏         | 4826/371472 [22:55<29:55:57,  3.40it/s]
  1%|▏         | 4827/371472 [22:55<29:09:52,  3.49it/s]
  1%|▏         | 4828/371472 [22:56<28:51:16,  3.53it/s]
  1%|▏         | 4829/371472 [22:56<28:12:59,  3.61it/s]
  1%|▏         | 4830/371472 [22:56<31:25:01,  3.24it/s]
  1%|▏         | 4831/371472 [22:56<29:59:42,  3.40it/s]
  1%|▏         | 4832/371472 [22:57<28:08:39,  3.62it/s]
  1%|▏         | 4833/371472 [22:57<26:42:58,  3.81it/s]
  1%|▏         | 4834/371472 [22:57<26:23:34,  3.86it/s]
  1%|▏         | 4835/371472 [22:57<26:41:56,  3.81it/s]
  1%|▏         | 4836/371472 [22:58<27:36:14,  3.69it/s]
  1%|▏         | 4837/371472 [22:58<29:28:43,  3.45it/s]
  1%|▏         | 4838/371472 [22:58<30:18:55,  3.36it/s]
  1%|▏         | 4839/371472 [22:59<30:53:38,  3.30it/s]
  1%|▏         | 4840/371472 [22:59<28:54:22,  3.52it/s]
                                                        
{'loss': 4.9737, 'learning_rate': 9.887521816888966e-07, 'epoch': 0.21}

  1%|▏         | 4840/371472 [22:59<28:54:22,  3.52it/s]
  1%|▏         | 4841/371472 [22:59<27:37:07,  3.69it/s]
  1%|▏         | 4842/371472 [23:00<31:44:12,  3.21it/s]
  1%|▏         | 4843/371472 [23:00<31:51:09,  3.20it/s]
  1%|▏         | 4844/371472 [23:00<32:21:24,  3.15it/s]
  1%|▏         | 4845/371472 [23:00<30:14:51,  3.37it/s]
  1%|▏         | 4846/371472 [23:01<32:54:33,  3.09it/s]
  1%|▏         | 4847/371472 [23:01<30:37:13,  3.33it/s]
  1%|▏         | 4848/371472 [23:01<30:34:33,  3.33it/s]
  1%|▏         | 4849/371472 [23:02<29:08:27,  3.49it/s]
  1%|▏         | 4850/371472 [23:02<30:59:35,  3.29it/s]
  1%|▏         | 4851/371472 [23:02<29:34:35,  3.44it/s]
  1%|▏         | 4852/371472 [23:03<31:43:54,  3.21it/s]
  1%|▏         | 4853/371472 [23:03<29:53:04,  3.41it/s]
  1%|▏         | 4854/371472 [23:03<28:33:20,  3.57it/s]
  1%|▏         | 4855/371472 [23:03<27:43:22,  3.67it/s]
  1%|▏         | 4856/371472 [23:04<26:48:00,  3.80it/s]
  1%|▏         | 4857/371472 [23:04<26:38:11,  3.82it/s]
  1%|▏         | 4858/371472 [23:04<26:58:09,  3.78it/s]
  1%|▏         | 4859/371472 [23:04<26:16:52,  3.87it/s]
  1%|▏         | 4860/371472 [23:05<29:39:06,  3.43it/s]
                                                        
{'loss': 5.186, 'learning_rate': 9.887036997134177e-07, 'epoch': 0.21}

  1%|▏         | 4860/371472 [23:05<29:39:06,  3.43it/s]
  1%|▏         | 4861/371472 [23:05<29:20:53,  3.47it/s]
  1%|▏         | 4862/371472 [23:05<27:43:05,  3.67it/s]
  1%|▏         | 4863/371472 [23:05<27:11:33,  3.74it/s]
  1%|▏         | 4864/371472 [23:06<27:35:01,  3.69it/s]
  1%|▏         | 4865/371472 [23:06<31:04:20,  3.28it/s]
  1%|▏         | 4866/371472 [23:06<29:50:16,  3.41it/s]
  1%|▏         | 4867/371472 [23:07<29:03:45,  3.50it/s]
  1%|▏         | 4868/371472 [23:07<28:36:17,  3.56it/s]
  1%|▏         | 4869/371472 [23:07<29:40:51,  3.43it/s]
  1%|▏         | 4870/371472 [23:08<28:37:44,  3.56it/s]
  1%|▏         | 4871/371472 [23:08<28:35:36,  3.56it/s]
  1%|▏         | 4872/371472 [23:08<28:41:08,  3.55it/s]
  1%|▏         | 4873/371472 [23:08<30:45:00,  3.31it/s]
  1%|▏         | 4874/371472 [23:09<30:26:16,  3.35it/s]
  1%|▏         | 4875/371472 [23:09<29:07:03,  3.50it/s]
  1%|▏         | 4876/371472 [23:09<28:11:24,  3.61it/s]
  1%|▏         | 4877/371472 [23:10<28:16:24,  3.60it/s]
  1%|▏         | 4878/371472 [23:10<28:36:27,  3.56it/s]
  1%|▏         | 4879/371472 [23:10<28:18:43,  3.60it/s]
  1%|▏         | 4880/371472 [23:10<27:13:17,  3.74it/s]
                                                        
{'loss': 5.2746, 'learning_rate': 9.886552177379387e-07, 'epoch': 0.21}

  1%|▏         | 4880/371472 [23:10<27:13:17,  3.74it/s]
  1%|▏         | 4881/371472 [23:11<27:22:41,  3.72it/s]
  1%|▏         | 4882/371472 [23:11<29:06:47,  3.50it/s]
  1%|▏         | 4883/371472 [23:11<29:57:55,  3.40it/s]
  1%|▏         | 4884/371472 [23:11<28:16:26,  3.60it/s]
  1%|▏         | 4885/371472 [23:12<28:34:11,  3.56it/s]
  1%|▏         | 4886/371472 [23:12<31:41:14,  3.21it/s]
  1%|▏         | 4887/371472 [23:12<31:07:15,  3.27it/s]
  1%|▏         | 4888/371472 [23:13<28:57:19,  3.52it/s]
  1%|▏         | 4889/371472 [23:13<29:05:30,  3.50it/s]
  1%|▏         | 4890/371472 [23:13<28:27:08,  3.58it/s]
  1%|▏         | 4891/371472 [23:14<28:14:07,  3.61it/s]
  1%|▏         | 4892/371472 [23:14<31:57:14,  3.19it/s]
  1%|▏         | 4893/371472 [23:14<30:17:15,  3.36it/s]
  1%|▏         | 4894/371472 [23:14<29:07:57,  3.50it/s]
  1%|▏         | 4895/371472 [23:15<27:41:59,  3.68it/s]
  1%|▏         | 4896/371472 [23:15<28:04:49,  3.63it/s]
  1%|▏         | 4897/371472 [23:15<27:58:52,  3.64it/s]
  1%|▏         | 4898/371472 [23:15<27:26:58,  3.71it/s]
  1%|▏         | 4899/371472 [23:16<28:24:30,  3.58it/s]
  1%|▏         | 4900/371472 [23:16<27:30:30,  3.70it/s]
                                                        
{'loss': 5.359, 'learning_rate': 9.886067357624598e-07, 'epoch': 0.21}

  1%|▏         | 4900/371472 [23:16<27:30:30,  3.70it/s]
  1%|▏         | 4901/371472 [23:16<26:26:56,  3.85it/s]
  1%|▏         | 4902/371472 [23:17<27:15:58,  3.73it/s]
  1%|▏         | 4903/371472 [23:17<26:50:11,  3.79it/s]
  1%|▏         | 4904/371472 [23:17<26:28:55,  3.85it/s]
  1%|▏         | 4905/371472 [23:17<26:10:58,  3.89it/s]
  1%|▏         | 4906/371472 [23:18<28:10:08,  3.61it/s]
  1%|▏         | 4907/371472 [23:18<28:20:44,  3.59it/s]
  1%|▏         | 4908/371472 [23:18<28:12:49,  3.61it/s]
  1%|▏         | 4909/371472 [23:18<27:13:18,  3.74it/s]
  1%|▏         | 4910/371472 [23:19<27:52:06,  3.65it/s]
  1%|▏         | 4911/371472 [23:19<28:41:43,  3.55it/s]
  1%|▏         | 4912/371472 [23:19<28:28:22,  3.58it/s]
  1%|▏         | 4913/371472 [23:20<28:50:18,  3.53it/s]
  1%|▏         | 4914/371472 [23:20<27:40:25,  3.68it/s]
  1%|▏         | 4915/371472 [23:20<27:20:39,  3.72it/s]
  1%|▏         | 4916/371472 [23:20<27:47:02,  3.66it/s]
  1%|▏         | 4917/371472 [23:21<27:39:21,  3.68it/s]
  1%|▏         | 4918/371472 [23:21<29:44:26,  3.42it/s]
  1%|▏         | 4919/371472 [23:21<29:58:35,  3.40it/s]
  1%|▏         | 4920/371472 [23:22<31:02:29,  3.28it/s]
                                                        
{'loss': 5.1738, 'learning_rate': 9.88558253786981e-07, 'epoch': 0.21}

  1%|▏         | 4920/371472 [23:22<31:02:29,  3.28it/s]
  1%|▏         | 4921/371472 [23:22<30:08:14,  3.38it/s]
  1%|▏         | 4922/371472 [23:22<30:19:51,  3.36it/s]
  1%|▏         | 4923/371472 [23:22<30:09:33,  3.38it/s]
  1%|▏         | 4924/371472 [23:23<29:19:28,  3.47it/s]
  1%|▏         | 4925/371472 [23:23<29:01:56,  3.51it/s]
  1%|▏         | 4926/371472 [23:23<28:35:52,  3.56it/s]
  1%|▏         | 4927/371472 [23:24<28:18:37,  3.60it/s]
  1%|▏         | 4928/371472 [23:24<28:57:27,  3.52it/s]
  1%|▏         | 4929/371472 [23:24<28:18:24,  3.60it/s]
  1%|▏         | 4930/371472 [23:24<29:20:06,  3.47it/s]
  1%|▏         | 4931/371472 [23:25<28:32:39,  3.57it/s]
  1%|▏         | 4932/371472 [23:25<27:58:57,  3.64it/s]
  1%|▏         | 4933/371472 [23:25<28:52:12,  3.53it/s]
  1%|▏         | 4934/371472 [23:26<27:58:59,  3.64it/s]
  1%|▏         | 4935/371472 [23:26<29:36:02,  3.44it/s]
  1%|▏         | 4936/371472 [23:26<29:12:38,  3.49it/s]
  1%|▏         | 4937/371472 [23:26<29:06:22,  3.50it/s]
  1%|▏         | 4938/371472 [23:27<28:25:45,  3.58it/s]
  1%|▏         | 4939/371472 [23:27<28:42:19,  3.55it/s]
  1%|▏         | 4940/371472 [23:27<28:04:28,  3.63it/s]
                                                        
{'loss': 5.1438, 'learning_rate': 9.88509771811502e-07, 'epoch': 0.21}

  1%|▏         | 4940/371472 [23:27<28:04:28,  3.63it/s]
  1%|▏         | 4941/371472 [23:28<29:04:42,  3.50it/s]
  1%|▏         | 4942/371472 [23:28<28:46:08,  3.54it/s]
  1%|▏         | 4943/371472 [23:28<27:36:36,  3.69it/s]
  1%|▏         | 4944/371472 [23:28<28:11:39,  3.61it/s]
  1%|▏         | 4945/371472 [23:29<28:33:04,  3.57it/s]
  1%|▏         | 4946/371472 [23:29<27:59:24,  3.64it/s]
  1%|▏         | 4947/371472 [23:29<27:50:22,  3.66it/s]
  1%|▏         | 4948/371472 [23:30<32:38:05,  3.12it/s]
  1%|▏         | 4949/371472 [23:30<30:18:32,  3.36it/s]
  1%|▏         | 4950/371472 [23:30<29:18:54,  3.47it/s]
  1%|▏         | 4951/371472 [23:31<32:27:16,  3.14it/s]
  1%|▏         | 4952/371472 [23:31<30:47:50,  3.31it/s]
  1%|▏         | 4953/371472 [23:31<29:48:48,  3.41it/s]
  1%|▏         | 4954/371472 [23:31<28:49:53,  3.53it/s]
  1%|▏         | 4955/371472 [23:32<28:11:17,  3.61it/s]
  1%|▏         | 4956/371472 [23:32<27:23:19,  3.72it/s]
  1%|▏         | 4957/371472 [23:32<30:54:20,  3.29it/s]
  1%|▏         | 4958/371472 [23:32<30:44:46,  3.31it/s]
  1%|▏         | 4959/371472 [23:33<30:17:37,  3.36it/s]
  1%|▏         | 4960/371472 [23:33<30:00:16,  3.39it/s]
                                                        
{'loss': 4.9935, 'learning_rate': 9.884612898360232e-07, 'epoch': 0.21}

  1%|▏         | 4960/371472 [23:33<30:00:16,  3.39it/s]
  1%|▏         | 4961/371472 [23:33<31:10:55,  3.26it/s]
  1%|▏         | 4962/371472 [23:34<29:21:17,  3.47it/s]
  1%|▏         | 4963/371472 [23:34<28:50:56,  3.53it/s]
  1%|▏         | 4964/371472 [23:34<29:08:57,  3.49it/s]
  1%|▏         | 4965/371472 [23:34<28:20:05,  3.59it/s]
  1%|▏         | 4966/371472 [23:35<28:17:22,  3.60it/s]
  1%|▏         | 4967/371472 [23:35<27:55:07,  3.65it/s]
  1%|▏         | 4968/371472 [23:35<28:59:58,  3.51it/s]
  1%|▏         | 4969/371472 [23:36<28:15:14,  3.60it/s]
  1%|▏         | 4970/371472 [23:36<27:55:05,  3.65it/s]
  1%|▏         | 4971/371472 [23:36<30:23:17,  3.35it/s]
  1%|▏         | 4972/371472 [23:37<30:07:26,  3.38it/s]
  1%|▏         | 4973/371472 [23:37<30:29:43,  3.34it/s]
  1%|▏         | 4974/371472 [23:37<29:20:59,  3.47it/s]
  1%|▏         | 4975/371472 [23:37<29:07:12,  3.50it/s]
  1%|▏         | 4976/371472 [23:38<27:52:33,  3.65it/s]
  1%|▏         | 4977/371472 [23:38<27:08:31,  3.75it/s]
  1%|▏         | 4978/371472 [23:38<27:55:00,  3.65it/s]
  1%|▏         | 4979/371472 [23:38<27:20:13,  3.72it/s]
  1%|▏         | 4980/371472 [23:39<28:09:53,  3.61it/s]
                                                        
{'loss': 5.2627, 'learning_rate': 9.88412807860544e-07, 'epoch': 0.21}

  1%|▏         | 4980/371472 [23:39<28:09:53,  3.61it/s]
  1%|▏         | 4981/371472 [23:39<28:50:28,  3.53it/s]
  1%|▏         | 4982/371472 [23:39<28:58:45,  3.51it/s]
  1%|▏         | 4983/371472 [23:40<28:17:59,  3.60it/s]
  1%|▏         | 4984/371472 [23:40<29:28:53,  3.45it/s]
  1%|▏         | 4985/371472 [23:40<28:13:37,  3.61it/s]
  1%|▏         | 4986/371472 [23:40<28:33:10,  3.57it/s]
  1%|▏         | 4987/371472 [23:41<28:00:45,  3.63it/s]
  1%|▏         | 4988/371472 [23:41<28:33:18,  3.57it/s]
  1%|▏         | 4989/371472 [23:41<28:01:00,  3.63it/s]
  1%|▏         | 4990/371472 [23:42<32:09:42,  3.17it/s]
  1%|▏         | 4991/371472 [23:42<33:45:20,  3.02it/s]
  1%|▏         | 4992/371472 [23:42<31:04:37,  3.28it/s]
  1%|▏         | 4993/371472 [23:43<31:45:00,  3.21it/s]
  1%|▏         | 4994/371472 [23:43<30:52:45,  3.30it/s]
  1%|▏         | 4995/371472 [23:43<33:06:45,  3.07it/s]
  1%|▏         | 4996/371472 [23:44<33:08:40,  3.07it/s]
  1%|▏         | 4997/371472 [23:44<33:02:49,  3.08it/s]
  1%|▏         | 4998/371472 [23:44<33:12:36,  3.07it/s]
  1%|▏         | 4999/371472 [23:45<32:27:52,  3.14it/s]
  1%|▏         | 5000/371472 [23:45<31:21:58,  3.25it/s]
                                                        
{'loss': 4.8987, 'learning_rate': 9.883643258850654e-07, 'epoch': 0.22}

  1%|▏         | 5000/371472 [23:45<31:21:58,  3.25it/s]
  1%|▏         | 5001/371472 [23:45<30:19:18,  3.36it/s]
  1%|▏         | 5002/371472 [23:45<30:59:21,  3.28it/s]
  1%|▏         | 5003/371472 [23:46<30:38:41,  3.32it/s]
  1%|▏         | 5004/371472 [23:46<29:12:23,  3.49it/s]
  1%|▏         | 5005/371472 [23:46<31:25:10,  3.24it/s]
  1%|▏         | 5006/371472 [23:47<31:40:54,  3.21it/s]
  1%|▏         | 5007/371472 [23:47<31:23:50,  3.24it/s]
  1%|▏         | 5008/371472 [23:47<30:53:21,  3.30it/s]
  1%|▏         | 5009/371472 [23:48<31:14:22,  3.26it/s]
  1%|▏         | 5010/371472 [23:48<31:36:23,  3.22it/s]
  1%|▏         | 5011/371472 [23:48<34:41:12,  2.93it/s]
  1%|▏         | 5012/371472 [23:49<32:30:35,  3.13it/s]
  1%|▏         | 5013/371472 [23:49<30:44:38,  3.31it/s]
  1%|▏         | 5014/371472 [23:49<29:42:37,  3.43it/s]
  1%|▏         | 5015/371472 [23:49<28:40:44,  3.55it/s]
  1%|▏         | 5016/371472 [23:50<28:17:24,  3.60it/s]
  1%|▏         | 5017/371472 [23:50<29:14:00,  3.48it/s]
  1%|▏         | 5018/371472 [23:50<30:53:40,  3.29it/s]
  1%|▏         | 5019/371472 [23:51<30:23:44,  3.35it/s]
  1%|▏         | 5020/371472 [23:51<29:27:20,  3.46it/s]
                                                        
{'loss': 5.1943, 'learning_rate': 9.883158439095864e-07, 'epoch': 0.22}

  1%|▏         | 5020/371472 [23:51<29:27:20,  3.46it/s]
  1%|▏         | 5021/371472 [23:51<31:20:58,  3.25it/s]
  1%|▏         | 5022/371472 [23:51<29:50:35,  3.41it/s]
  1%|▏         | 5023/371472 [23:52<30:41:55,  3.32it/s]
  1%|▏         | 5024/371472 [23:52<29:29:37,  3.45it/s]
  1%|▏         | 5025/371472 [23:52<28:19:31,  3.59it/s]
  1%|▏         | 5026/371472 [23:52<27:17:15,  3.73it/s]
  1%|▏         | 5027/371472 [23:53<26:48:12,  3.80it/s]
  1%|▏         | 5028/371472 [23:53<26:13:35,  3.88it/s]
  1%|▏         | 5029/371472 [23:53<27:26:21,  3.71it/s]
  1%|▏         | 5030/371472 [23:53<26:27:47,  3.85it/s]
  1%|▏         | 5031/371472 [23:54<26:39:29,  3.82it/s]
  1%|▏         | 5032/371472 [23:54<27:47:14,  3.66it/s]
  1%|▏         | 5033/371472 [23:54<28:47:33,  3.54it/s]
  1%|▏         | 5034/371472 [23:55<28:19:05,  3.59it/s]
  1%|▏         | 5035/371472 [23:55<29:41:29,  3.43it/s]
  1%|▏         | 5036/371472 [23:55<30:07:39,  3.38it/s]
  1%|▏         | 5037/371472 [23:56<31:44:43,  3.21it/s]
  1%|▏         | 5038/371472 [23:56<30:25:44,  3.35it/s]
  1%|▏         | 5039/371472 [23:56<31:03:37,  3.28it/s]
  1%|▏         | 5040/371472 [23:57<32:49:22,  3.10it/s]
                                                        
{'loss': 5.1257, 'learning_rate': 9.882673619341075e-07, 'epoch': 0.22}

  1%|▏         | 5040/371472 [23:57<32:49:22,  3.10it/s]
  1%|▏         | 5041/371472 [23:57<31:25:47,  3.24it/s]
  1%|▏         | 5042/371472 [23:57<29:32:30,  3.45it/s]
  1%|▏         | 5043/371472 [23:57<31:26:32,  3.24it/s]
  1%|▏         | 5044/371472 [23:58<30:37:28,  3.32it/s]
  1%|▏         | 5045/371472 [23:58<28:56:10,  3.52it/s]
  1%|▏         | 5046/371472 [23:58<29:09:22,  3.49it/s]
  1%|▏         | 5047/371472 [23:59<29:53:13,  3.41it/s]
  1%|▏         | 5048/371472 [23:59<29:31:53,  3.45it/s]
  1%|▏         | 5049/371472 [23:59<29:11:44,  3.49it/s]
  1%|▏         | 5050/371472 [23:59<29:12:18,  3.49it/s]
  1%|▏         | 5051/371472 [24:00<30:21:46,  3.35it/s]
  1%|▏         | 5052/371472 [24:00<28:50:05,  3.53it/s]
  1%|▏         | 5053/371472 [24:00<27:27:22,  3.71it/s]
  1%|▏         | 5054/371472 [24:01<27:42:37,  3.67it/s]
  1%|▏         | 5055/371472 [24:01<28:00:39,  3.63it/s]
  1%|▏         | 5056/371472 [24:01<28:25:32,  3.58it/s]
  1%|▏         | 5057/371472 [24:01<27:43:39,  3.67it/s]
  1%|▏         | 5058/371472 [24:02<27:40:45,  3.68it/s]
  1%|▏         | 5059/371472 [24:02<29:12:13,  3.49it/s]
  1%|▏         | 5060/371472 [24:02<30:08:30,  3.38it/s]
                                                        
{'loss': 5.2447, 'learning_rate': 9.882188799586288e-07, 'epoch': 0.22}

  1%|▏         | 5060/371472 [24:02<30:08:30,  3.38it/s]
  1%|▏         | 5061/371472 [24:03<29:04:41,  3.50it/s]
  1%|▏         | 5062/371472 [24:03<30:04:32,  3.38it/s]
  1%|▏         | 5063/371472 [24:03<29:04:25,  3.50it/s]
  1%|▏         | 5064/371472 [24:03<28:56:36,  3.52it/s]
  1%|▏         | 5065/371472 [24:04<30:46:37,  3.31it/s]
  1%|▏         | 5066/371472 [24:04<29:01:13,  3.51it/s]
  1%|▏         | 5067/371472 [24:04<27:47:39,  3.66it/s]
  1%|▏         | 5068/371472 [24:04<27:12:44,  3.74it/s]
  1%|▏         | 5069/371472 [24:05<29:44:39,  3.42it/s]
  1%|▏         | 5070/371472 [24:05<29:56:33,  3.40it/s]
  1%|▏         | 5071/371472 [24:05<29:56:38,  3.40it/s]
  1%|▏         | 5072/371472 [24:06<28:46:03,  3.54it/s]
  1%|▏         | 5073/371472 [24:06<30:32:44,  3.33it/s]
  1%|▏         | 5074/371472 [24:06<28:59:06,  3.51it/s]
  1%|▏         | 5075/371472 [24:06<27:42:56,  3.67it/s]
  1%|▏         | 5076/371472 [24:07<27:48:03,  3.66it/s]
  1%|▏         | 5077/371472 [24:07<27:56:00,  3.64it/s]
  1%|▏         | 5078/371472 [24:07<27:28:58,  3.70it/s]
  1%|▏         | 5079/371472 [24:08<27:12:14,  3.74it/s]
  1%|▏         | 5080/371472 [24:08<26:24:39,  3.85it/s]
                                                        
{'loss': 5.0602, 'learning_rate': 9.881703979831497e-07, 'epoch': 0.22}

  1%|▏         | 5080/371472 [24:08<26:24:39,  3.85it/s]
  1%|▏         | 5081/371472 [24:08<27:10:39,  3.74it/s]
  1%|▏         | 5082/371472 [24:08<27:26:47,  3.71it/s]
  1%|▏         | 5083/371472 [24:09<28:10:23,  3.61it/s]
  1%|▏         | 5084/371472 [24:09<28:41:43,  3.55it/s]
  1%|▏         | 5085/371472 [24:09<28:27:42,  3.58it/s]
  1%|▏         | 5086/371472 [24:10<28:38:21,  3.55it/s]
  1%|▏         | 5087/371472 [24:10<28:58:45,  3.51it/s]
  1%|▏         | 5088/371472 [24:10<29:33:14,  3.44it/s]
  1%|▏         | 5089/371472 [24:10<28:24:39,  3.58it/s]
  1%|▏         | 5090/371472 [24:11<27:47:10,  3.66it/s]
  1%|▏         | 5091/371472 [24:11<27:01:43,  3.77it/s]
  1%|▏         | 5092/371472 [24:11<28:08:56,  3.62it/s]
  1%|▏         | 5093/371472 [24:11<28:31:50,  3.57it/s]
  1%|▏         | 5094/371472 [24:12<27:45:23,  3.67it/s]
  1%|▏         | 5095/371472 [24:12<27:10:19,  3.75it/s]
  1%|▏         | 5096/371472 [24:12<26:58:31,  3.77it/s]
  1%|▏         | 5097/371472 [24:13<27:54:53,  3.65it/s]
  1%|▏         | 5098/371472 [24:13<27:41:02,  3.68it/s]
  1%|▏         | 5099/371472 [24:13<27:28:43,  3.70it/s]
  1%|▏         | 5100/371472 [24:13<28:09:20,  3.61it/s]
                                                        
{'loss': 5.1273, 'learning_rate': 9.88121916007671e-07, 'epoch': 0.22}

  1%|▏         | 5100/371472 [24:13<28:09:20,  3.61it/s]
  1%|▏         | 5101/371472 [24:14<29:10:05,  3.49it/s]
  1%|▏         | 5102/371472 [24:14<28:27:41,  3.58it/s]
  1%|▏         | 5103/371472 [24:14<33:02:02,  3.08it/s]
  1%|▏         | 5104/371472 [24:15<32:01:06,  3.18it/s]
  1%|▏         | 5105/371472 [24:15<31:45:16,  3.20it/s]
  1%|▏         | 5106/371472 [24:15<29:48:07,  3.41it/s]
  1%|▏         | 5107/371472 [24:15<28:37:36,  3.55it/s]
  1%|▏         | 5108/371472 [24:16<29:09:24,  3.49it/s]
  1%|▏         | 5109/371472 [24:16<29:21:57,  3.47it/s]
  1%|▏         | 5110/371472 [24:16<29:24:43,  3.46it/s]
  1%|▏         | 5111/371472 [24:17<28:36:21,  3.56it/s]
  1%|▏         | 5112/371472 [24:17<28:12:43,  3.61it/s]
  1%|▏         | 5113/371472 [24:17<28:12:38,  3.61it/s]
  1%|▏         | 5114/371472 [24:17<27:51:16,  3.65it/s]
  1%|▏         | 5115/371472 [24:18<27:04:43,  3.76it/s]
  1%|▏         | 5116/371472 [24:18<26:32:12,  3.83it/s]
  1%|▏         | 5117/371472 [24:18<27:23:41,  3.71it/s]
  1%|▏         | 5118/371472 [24:18<26:54:02,  3.78it/s]
  1%|▏         | 5119/371472 [24:19<29:02:55,  3.50it/s]
  1%|▏         | 5120/371472 [24:19<28:54:32,  3.52it/s]
                                                        
{'loss': 5.2593, 'learning_rate': 9.880734340321918e-07, 'epoch': 0.22}

  1%|▏         | 5120/371472 [24:19<28:54:32,  3.52it/s]
  1%|▏         | 5121/371472 [24:19<28:04:34,  3.62it/s]
  1%|▏         | 5122/371472 [24:20<28:45:51,  3.54it/s]
  1%|▏         | 5123/371472 [24:20<28:36:38,  3.56it/s]
  1%|▏         | 5124/371472 [24:20<28:52:51,  3.52it/s]
  1%|▏         | 5125/371472 [24:20<28:14:06,  3.60it/s]
  1%|▏         | 5126/371472 [24:21<28:59:35,  3.51it/s]
  1%|▏         | 5127/371472 [24:21<28:33:48,  3.56it/s]
  1%|▏         | 5128/371472 [24:21<27:50:30,  3.66it/s]
  1%|▏         | 5129/371472 [24:22<27:01:36,  3.77it/s]
  1%|▏         | 5130/371472 [24:22<27:56:12,  3.64it/s]
  1%|▏         | 5131/371472 [24:22<27:32:02,  3.70it/s]
  1%|▏         | 5132/371472 [24:22<27:56:04,  3.64it/s]
  1%|▏         | 5133/371472 [24:23<27:19:50,  3.72it/s]
  1%|▏         | 5134/371472 [24:23<28:29:54,  3.57it/s]
  1%|▏         | 5135/371472 [24:23<30:44:03,  3.31it/s]
  1%|▏         | 5136/371472 [24:24<30:39:22,  3.32it/s]
  1%|▏         | 5137/371472 [24:24<29:30:09,  3.45it/s]
  1%|▏         | 5138/371472 [24:24<29:29:33,  3.45it/s]
  1%|▏         | 5139/371472 [24:24<28:37:47,  3.55it/s]
  1%|▏         | 5140/371472 [24:25<28:32:02,  3.57it/s]
                                                        
{'loss': 5.2149, 'learning_rate': 9.88024952056713e-07, 'epoch': 0.22}

  1%|▏         | 5140/371472 [24:25<28:32:02,  3.57it/s]
  1%|▏         | 5141/371472 [24:25<30:36:59,  3.32it/s]
  1%|▏         | 5142/371472 [24:25<28:47:07,  3.54it/s]
  1%|▏         | 5143/371472 [24:26<28:10:47,  3.61it/s]
  1%|▏         | 5144/371472 [24:26<27:45:54,  3.66it/s]
  1%|▏         | 5145/371472 [24:26<27:35:51,  3.69it/s]
  1%|▏         | 5146/371472 [24:26<27:03:46,  3.76it/s]
  1%|▏         | 5147/371472 [24:27<27:41:43,  3.67it/s]
  1%|▏         | 5148/371472 [24:27<29:22:35,  3.46it/s]
  1%|▏         | 5149/371472 [24:27<28:39:44,  3.55it/s]
  1%|▏         | 5150/371472 [24:27<28:31:30,  3.57it/s]
  1%|▏         | 5151/371472 [24:28<28:40:43,  3.55it/s]
  1%|▏         | 5152/371472 [24:28<29:30:53,  3.45it/s]
  1%|▏         | 5153/371472 [24:28<29:37:38,  3.43it/s]
  1%|▏         | 5154/371472 [24:29<28:48:18,  3.53it/s]
  1%|▏         | 5155/371472 [24:29<28:25:54,  3.58it/s]
  1%|▏         | 5156/371472 [24:29<28:35:58,  3.56it/s]
  1%|▏         | 5157/371472 [24:29<28:59:28,  3.51it/s]
  1%|▏         | 5158/371472 [24:30<28:00:50,  3.63it/s]
  1%|▏         | 5159/371472 [24:30<27:39:41,  3.68it/s]
  1%|▏         | 5160/371472 [24:30<29:26:48,  3.46it/s]
                                                        
{'loss': 5.1093, 'learning_rate': 9.879764700812342e-07, 'epoch': 0.22}

  1%|▏         | 5160/371472 [24:30<29:26:48,  3.46it/s]
  1%|▏         | 5161/371472 [24:31<29:57:37,  3.40it/s]
  1%|▏         | 5162/371472 [24:31<30:28:02,  3.34it/s]
  1%|▏         | 5163/371472 [24:31<29:49:29,  3.41it/s]
  1%|▏         | 5164/371472 [24:32<30:39:57,  3.32it/s]
  1%|▏         | 5165/371472 [24:32<30:15:52,  3.36it/s]
  1%|▏         | 5166/371472 [24:32<28:56:52,  3.51it/s]
  1%|▏         | 5167/371472 [24:32<29:39:42,  3.43it/s]
  1%|▏         | 5168/371472 [24:33<28:17:05,  3.60it/s]
  1%|▏         | 5169/371472 [24:33<28:57:41,  3.51it/s]
  1%|▏         | 5170/371472 [24:33<28:08:08,  3.62it/s]
  1%|▏         | 5171/371472 [24:33<28:24:24,  3.58it/s]
  1%|▏         | 5172/371472 [24:34<28:42:07,  3.55it/s]
  1%|▏         | 5173/371472 [24:34<28:39:53,  3.55it/s]
  1%|▏         | 5174/371472 [24:34<27:25:32,  3.71it/s]
  1%|▏         | 5175/371472 [24:35<30:17:49,  3.36it/s]
  1%|▏         | 5176/371472 [24:35<28:59:13,  3.51it/s]
  1%|▏         | 5177/371472 [24:35<29:11:54,  3.48it/s]
  1%|▏         | 5178/371472 [24:35<28:33:19,  3.56it/s]
  1%|▏         | 5179/371472 [24:36<29:02:02,  3.50it/s]
  1%|▏         | 5180/371472 [24:36<27:32:41,  3.69it/s]
                                                        
{'loss': 5.1914, 'learning_rate': 9.879279881057552e-07, 'epoch': 0.22}

  1%|▏         | 5180/371472 [24:36<27:32:41,  3.69it/s]
  1%|▏         | 5181/371472 [24:36<27:19:12,  3.72it/s]
  1%|▏         | 5182/371472 [24:37<27:19:39,  3.72it/s]
  1%|▏         | 5183/371472 [24:37<26:33:00,  3.83it/s]
  1%|▏         | 5184/371472 [24:37<26:03:02,  3.91it/s]
  1%|▏         | 5185/371472 [24:37<25:54:22,  3.93it/s]
  1%|▏         | 5186/371472 [24:38<26:16:00,  3.87it/s]
  1%|▏         | 5187/371472 [24:38<27:17:18,  3.73it/s]
  1%|▏         | 5188/371472 [24:38<30:17:30,  3.36it/s]
  1%|▏         | 5189/371472 [24:39<31:31:38,  3.23it/s]
  1%|▏         | 5190/371472 [24:39<30:30:32,  3.33it/s]
  1%|▏         | 5191/371472 [24:39<30:57:34,  3.29it/s]
  1%|▏         | 5192/371472 [24:40<33:40:53,  3.02it/s]
  1%|▏         | 5193/371472 [24:40<32:20:22,  3.15it/s]
  1%|▏         | 5194/371472 [24:40<31:05:19,  3.27it/s]
  1%|▏         | 5195/371472 [24:40<29:52:18,  3.41it/s]
  1%|▏         | 5196/371472 [24:41<28:30:03,  3.57it/s]
  1%|▏         | 5197/371472 [24:41<29:10:02,  3.49it/s]
  1%|▏         | 5198/371472 [24:41<32:13:48,  3.16it/s]
  1%|▏         | 5199/371472 [24:42<31:04:40,  3.27it/s]
  1%|▏         | 5200/371472 [24:42<29:29:14,  3.45it/s]
                                                        
{'loss': 5.1855, 'learning_rate': 9.878795061302765e-07, 'epoch': 0.22}

  1%|▏         | 5200/371472 [24:42<29:29:14,  3.45it/s]
  1%|▏         | 5201/371472 [24:42<28:18:04,  3.59it/s]
  1%|▏         | 5202/371472 [24:42<27:49:05,  3.66it/s]
  1%|▏         | 5203/371472 [24:43<27:01:25,  3.76it/s]
  1%|▏         | 5204/371472 [24:43<26:42:44,  3.81it/s]
  1%|▏         | 5205/371472 [24:43<26:44:35,  3.80it/s]
  1%|▏         | 5206/371472 [24:43<26:31:36,  3.84it/s]
  1%|▏         | 5207/371472 [24:44<26:16:39,  3.87it/s]
  1%|▏         | 5208/371472 [24:44<29:09:12,  3.49it/s]
  1%|▏         | 5209/371472 [24:44<31:54:41,  3.19it/s]
  1%|▏         | 5210/371472 [24:45<31:04:10,  3.27it/s]
  1%|▏         | 5211/371472 [24:45<30:28:49,  3.34it/s]
  1%|▏         | 5212/371472 [24:45<30:20:45,  3.35it/s]
  1%|▏         | 5213/371472 [24:45<29:47:54,  3.41it/s]
  1%|▏         | 5214/371472 [24:46<29:04:49,  3.50it/s]
  1%|▏         | 5215/371472 [24:46<28:12:02,  3.61it/s]
  1%|▏         | 5216/371472 [24:46<29:47:22,  3.42it/s]
  1%|▏         | 5217/371472 [24:47<29:40:51,  3.43it/s]
  1%|▏         | 5218/371472 [24:47<29:03:44,  3.50it/s]
  1%|▏         | 5219/371472 [24:47<28:12:57,  3.61it/s]
  1%|▏         | 5220/371472 [24:47<27:21:49,  3.72it/s]
                                                        
{'loss': 5.1667, 'learning_rate': 9.878310241547976e-07, 'epoch': 0.22}

  1%|▏         | 5220/371472 [24:47<27:21:49,  3.72it/s]
  1%|▏         | 5221/371472 [24:48<28:04:54,  3.62it/s]
  1%|▏         | 5222/371472 [24:48<28:17:10,  3.60it/s]
  1%|▏         | 5223/371472 [24:48<28:39:36,  3.55it/s]
  1%|▏         | 5224/371472 [24:49<29:12:48,  3.48it/s]
  1%|▏         | 5225/371472 [24:49<29:00:21,  3.51it/s]
  1%|▏         | 5226/371472 [24:49<29:13:08,  3.48it/s]
  1%|▏         | 5227/371472 [24:49<30:46:31,  3.31it/s]
  1%|▏         | 5228/371472 [24:50<29:38:43,  3.43it/s]
  1%|▏         | 5229/371472 [24:50<30:49:44,  3.30it/s]
  1%|▏         | 5230/371472 [24:50<30:22:52,  3.35it/s]
  1%|▏         | 5231/371472 [24:51<29:47:12,  3.42it/s]
  1%|▏         | 5232/371472 [24:51<30:02:39,  3.39it/s]
  1%|▏         | 5233/371472 [24:51<30:05:08,  3.38it/s]
  1%|▏         | 5234/371472 [24:51<28:41:48,  3.55it/s]
  1%|▏         | 5235/371472 [24:52<28:39:44,  3.55it/s]
  1%|▏         | 5236/371472 [24:52<27:43:59,  3.67it/s]
  1%|▏         | 5237/371472 [24:52<27:48:08,  3.66it/s]
  1%|▏         | 5238/371472 [24:53<28:20:04,  3.59it/s]
  1%|▏         | 5239/371472 [24:53<28:01:33,  3.63it/s]
  1%|▏         | 5240/371472 [24:53<27:38:23,  3.68it/s]
                                                        
{'loss': 5.1006, 'learning_rate': 9.877825421793187e-07, 'epoch': 0.23}

  1%|▏         | 5240/371472 [24:53<27:38:23,  3.68it/s]
  1%|▏         | 5241/371472 [24:53<29:22:26,  3.46it/s]
  1%|▏         | 5242/371472 [24:54<29:05:12,  3.50it/s]
  1%|▏         | 5243/371472 [24:54<27:35:05,  3.69it/s]
  1%|▏         | 5244/371472 [24:54<28:18:25,  3.59it/s]
  1%|▏         | 5245/371472 [24:55<29:51:38,  3.41it/s]
  1%|▏         | 5246/371472 [24:55<29:18:29,  3.47it/s]
  1%|▏         | 5247/371472 [24:55<30:57:04,  3.29it/s]
  1%|▏         | 5248/371472 [24:56<32:24:34,  3.14it/s]
  1%|▏         | 5249/371472 [24:56<29:55:28,  3.40it/s]
  1%|▏         | 5250/371472 [24:56<33:47:55,  3.01it/s]
  1%|▏         | 5251/371472 [24:57<34:09:15,  2.98it/s]
  1%|▏         | 5252/371472 [24:57<31:51:35,  3.19it/s]
  1%|▏         | 5253/371472 [24:57<31:08:27,  3.27it/s]
  1%|▏         | 5254/371472 [24:57<29:55:11,  3.40it/s]
  1%|▏         | 5255/371472 [24:58<28:29:49,  3.57it/s]
  1%|▏         | 5256/371472 [24:58<28:51:29,  3.53it/s]
  1%|▏         | 5257/371472 [24:58<29:04:27,  3.50it/s]
  1%|▏         | 5258/371472 [24:58<28:17:55,  3.59it/s]
  1%|▏         | 5259/371472 [24:59<28:25:08,  3.58it/s]
  1%|▏         | 5260/371472 [24:59<31:58:43,  3.18it/s]
                                                        
{'loss': 5.4394, 'learning_rate': 9.877340602038397e-07, 'epoch': 0.23}

  1%|▏         | 5260/371472 [24:59<31:58:43,  3.18it/s]
  1%|▏         | 5261/371472 [24:59<30:24:29,  3.35it/s]
  1%|▏         | 5262/371472 [25:00<29:24:14,  3.46it/s]
  1%|▏         | 5263/371472 [25:00<28:20:22,  3.59it/s]
  1%|▏         | 5264/371472 [25:00<28:45:08,  3.54it/s]
  1%|▏         | 5265/371472 [25:00<27:24:46,  3.71it/s]
  1%|▏         | 5266/371472 [25:01<26:38:54,  3.82it/s]
  1%|▏         | 5267/371472 [25:01<29:11:48,  3.48it/s]
  1%|▏         | 5268/371472 [25:01<27:52:31,  3.65it/s]
  1%|▏         | 5269/371472 [25:02<28:34:10,  3.56it/s]
  1%|▏         | 5270/371472 [25:02<30:07:45,  3.38it/s]
  1%|▏         | 5271/371472 [25:02<28:58:18,  3.51it/s]
  1%|▏         | 5272/371472 [25:02<27:26:39,  3.71it/s]
  1%|▏         | 5273/371472 [25:03<28:02:41,  3.63it/s]
  1%|▏         | 5274/371472 [25:03<28:21:30,  3.59it/s]
  1%|▏         | 5275/371472 [25:03<27:42:33,  3.67it/s]
  1%|▏         | 5276/371472 [25:03<27:23:07,  3.71it/s]
  1%|▏         | 5277/371472 [25:04<27:35:06,  3.69it/s]
  1%|▏         | 5278/371472 [25:04<28:17:53,  3.59it/s]
  1%|▏         | 5279/371472 [25:04<30:05:59,  3.38it/s]
  1%|▏         | 5280/371472 [25:05<32:07:51,  3.17it/s]
                                                        
{'loss': 5.2247, 'learning_rate': 9.876855782283608e-07, 'epoch': 0.23}

  1%|▏         | 5280/371472 [25:05<32:07:51,  3.17it/s]
  1%|▏         | 5281/371472 [25:05<30:56:46,  3.29it/s]
  1%|▏         | 5282/371472 [25:05<32:26:01,  3.14it/s]
  1%|▏         | 5283/371472 [25:06<30:15:49,  3.36it/s]
  1%|▏         | 5284/371472 [25:06<29:38:25,  3.43it/s]
  1%|▏         | 5285/371472 [25:06<28:24:44,  3.58it/s]
  1%|▏         | 5286/371472 [25:06<27:49:57,  3.65it/s]
  1%|▏         | 5287/371472 [25:07<29:28:48,  3.45it/s]
  1%|▏         | 5288/371472 [25:07<29:18:35,  3.47it/s]
  1%|▏         | 5289/371472 [25:07<29:21:09,  3.47it/s]
  1%|▏         | 5290/371472 [25:08<30:41:58,  3.31it/s]
  1%|▏         | 5291/371472 [25:08<29:24:28,  3.46it/s]
  1%|▏         | 5292/371472 [25:08<29:54:37,  3.40it/s]
  1%|▏         | 5293/371472 [25:09<29:52:28,  3.40it/s]
  1%|▏         | 5294/371472 [25:09<30:54:34,  3.29it/s]
  1%|▏         | 5295/371472 [25:09<30:47:26,  3.30it/s]
  1%|▏         | 5296/371472 [25:09<30:32:43,  3.33it/s]
  1%|▏         | 5297/371472 [25:10<30:59:21,  3.28it/s]
  1%|▏         | 5298/371472 [25:10<29:06:20,  3.49it/s]
  1%|▏         | 5299/371472 [25:10<27:36:16,  3.68it/s]
  1%|▏         | 5300/371472 [25:11<28:10:26,  3.61it/s]
                                                        
{'loss': 5.2253, 'learning_rate': 9.87637096252882e-07, 'epoch': 0.23}

  1%|▏         | 5300/371472 [25:11<28:10:26,  3.61it/s]
  1%|▏         | 5301/371472 [25:11<27:56:53,  3.64it/s]
  1%|▏         | 5302/371472 [25:11<27:17:00,  3.73it/s]
  1%|▏         | 5303/371472 [25:11<27:10:42,  3.74it/s]
  1%|▏         | 5304/371472 [25:12<27:10:25,  3.74it/s]
  1%|▏         | 5305/371472 [25:12<26:33:50,  3.83it/s]
  1%|▏         | 5306/371472 [25:12<28:30:40,  3.57it/s]
  1%|▏         | 5307/371472 [25:12<29:27:29,  3.45it/s]
  1%|▏         | 5308/371472 [25:13<28:20:23,  3.59it/s]
  1%|▏         | 5309/371472 [25:13<28:11:15,  3.61it/s]
  1%|▏         | 5310/371472 [25:13<28:15:09,  3.60it/s]
  1%|▏         | 5311/371472 [25:14<27:48:43,  3.66it/s]
  1%|▏         | 5312/371472 [25:14<28:08:05,  3.62it/s]
  1%|▏         | 5313/371472 [25:14<27:23:48,  3.71it/s]
  1%|▏         | 5314/371472 [25:14<27:12:17,  3.74it/s]
  1%|▏         | 5315/371472 [25:15<28:09:58,  3.61it/s]
  1%|▏         | 5316/371472 [25:15<27:37:58,  3.68it/s]
  1%|▏         | 5317/371472 [25:15<27:34:03,  3.69it/s]
  1%|▏         | 5318/371472 [25:15<28:03:54,  3.62it/s]
  1%|▏         | 5319/371472 [25:16<27:00:49,  3.77it/s]
  1%|▏         | 5320/371472 [25:16<27:42:59,  3.67it/s]
                                                        
{'loss': 5.0591, 'learning_rate': 9.87588614277403e-07, 'epoch': 0.23}

  1%|▏         | 5320/371472 [25:16<27:42:59,  3.67it/s]
  1%|▏         | 5321/371472 [25:16<29:05:38,  3.50it/s]
  1%|▏         | 5322/371472 [25:17<31:31:23,  3.23it/s]
  1%|▏         | 5323/371472 [25:17<30:58:37,  3.28it/s]
  1%|▏         | 5324/371472 [25:17<30:03:33,  3.38it/s]
  1%|▏         | 5325/371472 [25:18<29:08:16,  3.49it/s]
  1%|▏         | 5326/371472 [25:18<29:40:36,  3.43it/s]
  1%|▏         | 5327/371472 [25:18<28:43:56,  3.54it/s]
  1%|▏         | 5328/371472 [25:18<28:04:56,  3.62it/s]
  1%|▏         | 5329/371472 [25:19<26:50:28,  3.79it/s]
  1%|▏         | 5330/371472 [25:19<29:18:25,  3.47it/s]
  1%|▏         | 5331/371472 [25:19<29:26:46,  3.45it/s]
  1%|▏         | 5332/371472 [25:19<27:58:21,  3.64it/s]
  1%|▏         | 5333/371472 [25:20<26:33:33,  3.83it/s]
  1%|▏         | 5334/371472 [25:20<27:16:41,  3.73it/s]
  1%|▏         | 5335/371472 [25:20<28:12:03,  3.61it/s]
  1%|▏         | 5336/371472 [25:21<27:36:03,  3.68it/s]
  1%|▏         | 5337/371472 [25:21<26:45:25,  3.80it/s]
  1%|▏         | 5338/371472 [25:21<26:09:36,  3.89it/s]
  1%|▏         | 5339/371472 [25:21<26:39:34,  3.81it/s]
  1%|▏         | 5340/371472 [25:22<26:39:24,  3.82it/s]
                                                        
{'loss': 5.368, 'learning_rate': 9.875401323019242e-07, 'epoch': 0.23}

  1%|▏         | 5340/371472 [25:22<26:39:24,  3.82it/s]
  1%|▏         | 5341/371472 [25:22<26:21:13,  3.86it/s]
  1%|▏         | 5342/371472 [25:22<27:34:08,  3.69it/s]
  1%|▏         | 5343/371472 [25:22<28:50:53,  3.53it/s]
  1%|▏         | 5344/371472 [25:23<29:19:00,  3.47it/s]
  1%|▏         | 5345/371472 [25:23<27:54:59,  3.64it/s]
  1%|▏         | 5346/371472 [25:23<28:19:14,  3.59it/s]
  1%|▏         | 5347/371472 [25:23<27:32:41,  3.69it/s]
  1%|▏         | 5348/371472 [25:24<27:54:30,  3.64it/s]
  1%|▏         | 5349/371472 [25:24<27:15:02,  3.73it/s]
  1%|▏         | 5350/371472 [25:24<28:38:27,  3.55it/s]
  1%|▏         | 5351/371472 [25:25<28:45:23,  3.54it/s]
  1%|▏         | 5352/371472 [25:25<29:41:02,  3.43it/s]
  1%|▏         | 5353/371472 [25:25<28:41:30,  3.54it/s]
  1%|▏         | 5354/371472 [25:25<29:06:08,  3.49it/s]
  1%|▏         | 5355/371472 [25:26<28:18:28,  3.59it/s]
  1%|▏         | 5356/371472 [25:26<29:57:59,  3.39it/s]
  1%|▏         | 5357/371472 [25:26<28:24:59,  3.58it/s]
  1%|▏         | 5358/371472 [25:27<29:35:51,  3.44it/s]
  1%|▏         | 5359/371472 [25:27<27:44:59,  3.66it/s]
  1%|▏         | 5360/371472 [25:27<28:02:13,  3.63it/s]
                                                        
{'loss': 5.1635, 'learning_rate': 9.87491650326445e-07, 'epoch': 0.23}

  1%|▏         | 5360/371472 [25:27<28:02:13,  3.63it/s]
  1%|▏         | 5361/371472 [25:27<29:11:19,  3.48it/s]
  1%|▏         | 5362/371472 [25:28<29:31:26,  3.44it/s]
  1%|▏         | 5363/371472 [25:28<30:52:46,  3.29it/s]
  1%|▏         | 5364/371472 [25:28<30:11:56,  3.37it/s]
  1%|▏         | 5365/371472 [25:29<30:25:09,  3.34it/s]
  1%|▏         | 5366/371472 [25:29<33:03:33,  3.08it/s]
  1%|▏         | 5367/371472 [25:29<30:39:48,  3.32it/s]
  1%|▏         | 5368/371472 [25:30<29:20:30,  3.47it/s]
  1%|▏         | 5369/371472 [25:30<29:17:24,  3.47it/s]
  1%|▏         | 5370/371472 [25:30<31:02:46,  3.28it/s]
  1%|▏         | 5371/371472 [25:30<29:27:34,  3.45it/s]
  1%|▏         | 5372/371472 [25:31<28:31:47,  3.56it/s]
  1%|▏         | 5373/371472 [25:31<27:57:48,  3.64it/s]
  1%|▏         | 5374/371472 [25:31<27:16:15,  3.73it/s]
  1%|▏         | 5375/371472 [25:32<27:27:24,  3.70it/s]
  1%|▏         | 5376/371472 [25:32<26:30:54,  3.84it/s]
  1%|▏         | 5377/371472 [25:32<25:56:05,  3.92it/s]
  1%|▏         | 5378/371472 [25:32<27:13:43,  3.73it/s]
  1%|▏         | 5379/371472 [25:33<27:52:21,  3.65it/s]
  1%|▏         | 5380/371472 [25:33<28:15:59,  3.60it/s]
                                                        
{'loss': 5.0713, 'learning_rate': 9.874431683509664e-07, 'epoch': 0.23}

  1%|▏         | 5380/371472 [25:33<28:15:59,  3.60it/s]
  1%|▏         | 5381/371472 [25:33<28:44:18,  3.54it/s]
  1%|▏         | 5382/371472 [25:33<28:46:25,  3.53it/s]
  1%|▏         | 5383/371472 [25:34<27:49:46,  3.65it/s]
  1%|▏         | 5384/371472 [25:34<27:57:55,  3.64it/s]
  1%|▏         | 5385/371472 [25:34<29:06:19,  3.49it/s]
  1%|▏         | 5386/371472 [25:35<27:40:10,  3.68it/s]
  1%|▏         | 5387/371472 [25:35<27:31:37,  3.69it/s]
  1%|▏         | 5388/371472 [25:35<27:23:44,  3.71it/s]
  1%|▏         | 5389/371472 [25:35<30:01:47,  3.39it/s]
  1%|▏         | 5390/371472 [25:36<29:57:07,  3.40it/s]
  1%|▏         | 5391/371472 [25:36<30:05:50,  3.38it/s]
  1%|▏         | 5392/371472 [25:36<28:23:14,  3.58it/s]
  1%|▏         | 5393/371472 [25:36<27:23:34,  3.71it/s]
  1%|▏         | 5394/371472 [25:37<27:12:04,  3.74it/s]
  1%|▏         | 5395/371472 [25:37<26:51:45,  3.79it/s]
  1%|▏         | 5396/371472 [25:37<30:23:58,  3.35it/s]
  1%|▏         | 5397/371472 [25:38<28:54:41,  3.52it/s]
  1%|▏         | 5398/371472 [25:38<29:06:15,  3.49it/s]
  1%|▏         | 5399/371472 [25:38<28:17:12,  3.59it/s]
  1%|▏         | 5400/371472 [25:38<28:05:50,  3.62it/s]
                                                        
{'loss': 5.1414, 'learning_rate': 9.873946863754874e-07, 'epoch': 0.23}

  1%|▏         | 5400/371472 [25:38<28:05:50,  3.62it/s]
  1%|▏         | 5401/371472 [25:39<29:15:50,  3.47it/s]
  1%|▏         | 5402/371472 [25:39<29:58:11,  3.39it/s]
  1%|▏         | 5403/371472 [25:39<29:32:24,  3.44it/s]
  1%|▏         | 5404/371472 [25:40<28:31:13,  3.57it/s]
  1%|▏         | 5405/371472 [25:40<28:21:46,  3.59it/s]
  1%|▏         | 5406/371472 [25:40<27:38:51,  3.68it/s]
  1%|▏         | 5407/371472 [25:40<27:42:39,  3.67it/s]
  1%|▏         | 5408/371472 [25:41<27:58:21,  3.64it/s]
  1%|▏         | 5409/371472 [25:41<28:51:09,  3.52it/s]
  1%|▏         | 5410/371472 [25:41<33:21:54,  3.05it/s]
  1%|▏         | 5411/371472 [25:42<30:43:38,  3.31it/s]
  1%|▏         | 5412/371472 [25:42<29:03:47,  3.50it/s]
  1%|▏         | 5413/371472 [25:42<29:40:21,  3.43it/s]
  1%|▏         | 5414/371472 [25:43<29:07:49,  3.49it/s]
  1%|▏         | 5415/371472 [25:43<28:15:35,  3.60it/s]
  1%|▏         | 5416/371472 [25:43<27:48:24,  3.66it/s]
  1%|▏         | 5417/371472 [25:43<27:41:21,  3.67it/s]
  1%|▏         | 5418/371472 [25:44<28:24:18,  3.58it/s]
  1%|▏         | 5419/371472 [25:44<28:52:00,  3.52it/s]
  1%|▏         | 5420/371472 [25:44<27:46:27,  3.66it/s]
                                                        
{'loss': 5.0667, 'learning_rate': 9.873462044000085e-07, 'epoch': 0.23}

  1%|▏         | 5420/371472 [25:44<27:46:27,  3.66it/s]
  1%|▏         | 5421/371472 [25:44<27:53:48,  3.64it/s]
  1%|▏         | 5422/371472 [25:45<27:18:33,  3.72it/s]
  1%|▏         | 5423/371472 [25:45<27:28:19,  3.70it/s]
  1%|▏         | 5424/371472 [25:45<28:18:24,  3.59it/s]
  1%|▏         | 5425/371472 [25:46<29:50:20,  3.41it/s]
  1%|▏         | 5426/371472 [25:46<28:29:03,  3.57it/s]
  1%|▏         | 5427/371472 [25:46<30:31:00,  3.33it/s]
  1%|▏         | 5428/371472 [25:46<29:50:04,  3.41it/s]
  1%|▏         | 5429/371472 [25:47<32:02:08,  3.17it/s]
  1%|▏         | 5430/371472 [25:47<31:54:05,  3.19it/s]
  1%|▏         | 5431/371472 [25:47<30:23:45,  3.35it/s]
  1%|▏         | 5432/371472 [25:48<30:06:15,  3.38it/s]
  1%|▏         | 5433/371472 [25:48<30:02:00,  3.39it/s]
  1%|▏         | 5434/371472 [25:48<32:33:23,  3.12it/s]
  1%|▏         | 5435/371472 [25:49<31:41:38,  3.21it/s]
  1%|▏         | 5436/371472 [25:49<32:31:40,  3.13it/s]
  1%|▏         | 5437/371472 [25:49<30:14:52,  3.36it/s]
  1%|▏         | 5438/371472 [25:50<31:27:05,  3.23it/s]
  1%|▏         | 5439/371472 [25:50<29:06:10,  3.49it/s]
  1%|▏         | 5440/371472 [25:50<28:55:00,  3.52it/s]
                                                        
{'loss': 4.9844, 'learning_rate': 9.872977224245298e-07, 'epoch': 0.23}

  1%|▏         | 5440/371472 [25:50<28:55:00,  3.52it/s]
  1%|▏         | 5441/371472 [25:50<29:16:24,  3.47it/s]
  1%|▏         | 5442/371472 [25:51<32:00:05,  3.18it/s]
  1%|▏         | 5443/371472 [25:51<30:19:20,  3.35it/s]
  1%|▏         | 5444/371472 [25:51<28:52:41,  3.52it/s]
  1%|▏         | 5445/371472 [25:52<27:36:20,  3.68it/s]
  1%|▏         | 5446/371472 [25:52<28:14:46,  3.60it/s]
  1%|▏         | 5447/371472 [25:52<26:51:15,  3.79it/s]
  1%|▏         | 5448/371472 [25:52<26:28:30,  3.84it/s]
  1%|▏         | 5449/371472 [25:53<27:27:20,  3.70it/s]
  1%|▏         | 5450/371472 [25:53<28:18:06,  3.59it/s]
  1%|▏         | 5451/371472 [25:53<28:51:15,  3.52it/s]
  1%|▏         | 5452/371472 [25:53<29:02:35,  3.50it/s]
  1%|▏         | 5453/371472 [25:54<29:50:18,  3.41it/s]
  1%|▏         | 5454/371472 [25:54<31:06:47,  3.27it/s]
  1%|▏         | 5455/371472 [25:54<30:53:56,  3.29it/s]
  1%|▏         | 5456/371472 [25:55<31:33:04,  3.22it/s]
  1%|▏         | 5457/371472 [25:55<29:30:47,  3.44it/s]
  1%|▏         | 5458/371472 [25:55<29:31:25,  3.44it/s]
  1%|▏         | 5459/371472 [25:56<28:47:11,  3.53it/s]
  1%|▏         | 5460/371472 [25:56<28:54:30,  3.52it/s]
                                                        
{'loss': 5.0536, 'learning_rate': 9.872492404490509e-07, 'epoch': 0.24}

  1%|▏         | 5460/371472 [25:56<28:54:30,  3.52it/s]
  1%|▏         | 5461/371472 [25:56<34:05:10,  2.98it/s]
  1%|▏         | 5462/371472 [25:57<31:25:05,  3.24it/s]
  1%|▏         | 5463/371472 [25:57<29:41:56,  3.42it/s]
  1%|▏         | 5464/371472 [25:57<29:02:56,  3.50it/s]
  1%|▏         | 5465/371472 [25:57<29:45:21,  3.42it/s]
  1%|▏         | 5466/371472 [25:58<27:54:47,  3.64it/s]
  1%|▏         | 5467/371472 [25:58<27:07:21,  3.75it/s]
  1%|▏         | 5468/371472 [25:58<28:21:47,  3.58it/s]
  1%|▏         | 5469/371472 [25:58<29:17:52,  3.47it/s]
  1%|▏         | 5470/371472 [25:59<28:08:31,  3.61it/s]
  1%|▏         | 5471/371472 [25:59<28:15:34,  3.60it/s]
  1%|▏         | 5472/371472 [25:59<27:14:18,  3.73it/s]
  1%|▏         | 5473/371472 [25:59<26:39:25,  3.81it/s]
  1%|▏         | 5474/371472 [26:00<26:39:12,  3.81it/s]
  1%|▏         | 5475/371472 [26:00<27:42:29,  3.67it/s]
  1%|▏         | 5476/371472 [26:00<27:23:30,  3.71it/s]
  1%|▏         | 5477/371472 [26:01<26:40:43,  3.81it/s]
  1%|▏         | 5478/371472 [26:01<27:55:27,  3.64it/s]
  1%|▏         | 5479/371472 [26:01<27:33:41,  3.69it/s]
  1%|▏         | 5480/371472 [26:01<27:50:52,  3.65it/s]
                                                        
{'loss': 5.0188, 'learning_rate': 9.87200758473572e-07, 'epoch': 0.24}

  1%|▏         | 5480/371472 [26:01<27:50:52,  3.65it/s]
  1%|▏         | 5481/371472 [26:02<31:20:44,  3.24it/s]
  1%|▏         | 5482/371472 [26:02<30:11:43,  3.37it/s]
  1%|▏         | 5483/371472 [26:02<29:27:02,  3.45it/s]
  1%|▏         | 5484/371472 [26:03<29:38:28,  3.43it/s]
  1%|▏         | 5485/371472 [26:03<28:53:52,  3.52it/s]
  1%|▏         | 5486/371472 [26:03<30:14:09,  3.36it/s]
  1%|▏         | 5487/371472 [26:04<30:36:14,  3.32it/s]
  1%|▏         | 5488/371472 [26:04<30:01:09,  3.39it/s]
  1%|▏         | 5489/371472 [26:04<31:07:53,  3.27it/s]
  1%|▏         | 5490/371472 [26:04<30:17:58,  3.36it/s]
  1%|▏         | 5491/371472 [26:05<29:35:14,  3.44it/s]
  1%|▏         | 5492/371472 [26:05<29:12:58,  3.48it/s]
  1%|▏         | 5493/371472 [26:05<29:06:07,  3.49it/s]
  1%|▏         | 5494/371472 [26:06<30:04:51,  3.38it/s]
  1%|▏         | 5495/371472 [26:06<29:25:12,  3.46it/s]
  1%|▏         | 5496/371472 [26:06<29:18:03,  3.47it/s]
  1%|▏         | 5497/371472 [26:06<28:09:47,  3.61it/s]
  1%|▏         | 5498/371472 [26:07<28:18:19,  3.59it/s]
  1%|▏         | 5499/371472 [26:07<27:51:02,  3.65it/s]
  1%|▏         | 5500/371472 [26:07<27:23:04,  3.71it/s]
                                                        
{'loss': 4.9918, 'learning_rate': 9.87152276498093e-07, 'epoch': 0.24}

  1%|▏         | 5500/371472 [26:07<27:23:04,  3.71it/s]
  1%|▏         | 5501/371472 [26:07<28:14:38,  3.60it/s]
  1%|▏         | 5502/371472 [26:08<27:49:16,  3.65it/s]
  1%|▏         | 5503/371472 [26:08<27:51:35,  3.65it/s]
  1%|▏         | 5504/371472 [26:08<30:45:28,  3.31it/s]
  1%|▏         | 5505/371472 [26:09<29:33:14,  3.44it/s]
  1%|▏         | 5506/371472 [26:09<28:31:00,  3.56it/s]
  1%|▏         | 5507/371472 [26:09<27:41:02,  3.67it/s]
  1%|▏         | 5508/371472 [26:09<28:19:37,  3.59it/s]
  1%|▏         | 5509/371472 [26:10<27:46:33,  3.66it/s]
  1%|▏         | 5510/371472 [26:10<27:59:40,  3.63it/s]
  1%|▏         | 5511/371472 [26:10<27:42:15,  3.67it/s]
  1%|▏         | 5512/371472 [26:11<29:10:46,  3.48it/s]
  1%|▏         | 5513/371472 [26:11<27:59:38,  3.63it/s]
  1%|▏         | 5514/371472 [26:11<34:10:23,  2.97it/s]
  1%|▏         | 5515/371472 [26:12<31:40:26,  3.21it/s]
  1%|▏         | 5516/371472 [26:12<30:25:45,  3.34it/s]
  1%|▏         | 5517/371472 [26:12<30:27:01,  3.34it/s]
  1%|▏         | 5518/371472 [26:12<30:06:39,  3.38it/s]
  1%|▏         | 5519/371472 [26:13<29:11:38,  3.48it/s]
  1%|▏         | 5520/371472 [26:13<28:53:50,  3.52it/s]
                                                        
{'loss': 5.1782, 'learning_rate': 9.87103794522614e-07, 'epoch': 0.24}

  1%|▏         | 5520/371472 [26:13<28:53:50,  3.52it/s]
  1%|▏         | 5521/371472 [26:13<27:41:19,  3.67it/s]
  1%|▏         | 5522/371472 [26:13<27:00:27,  3.76it/s]
  1%|▏         | 5523/371472 [26:14<27:11:07,  3.74it/s]
  1%|▏         | 5524/371472 [26:14<28:42:51,  3.54it/s]
  1%|▏         | 5525/371472 [26:14<27:30:46,  3.69it/s]
  1%|▏         | 5526/371472 [26:15<26:46:31,  3.80it/s]
  1%|▏         | 5527/371472 [26:15<26:08:54,  3.89it/s]
  1%|▏         | 5528/371472 [26:15<26:24:45,  3.85it/s]
  1%|▏         | 5529/371472 [26:15<27:15:12,  3.73it/s]
  1%|▏         | 5530/371472 [26:16<29:22:44,  3.46it/s]
  1%|▏         | 5531/371472 [26:16<29:11:53,  3.48it/s]
  1%|▏         | 5532/371472 [26:16<29:16:11,  3.47it/s]
  1%|▏         | 5533/371472 [26:16<28:19:50,  3.59it/s]
  1%|▏         | 5534/371472 [26:17<27:19:22,  3.72it/s]
  1%|▏         | 5535/371472 [26:17<27:33:05,  3.69it/s]
  1%|▏         | 5536/371472 [26:17<28:14:02,  3.60it/s]
  1%|▏         | 5537/371472 [26:18<28:00:37,  3.63it/s]
  1%|▏         | 5538/371472 [26:18<26:50:58,  3.79it/s]
  1%|▏         | 5539/371472 [26:18<27:15:45,  3.73it/s]
  1%|▏         | 5540/371472 [26:18<27:54:40,  3.64it/s]
                                                        
{'loss': 5.0001, 'learning_rate': 9.870553125471354e-07, 'epoch': 0.24}

  1%|▏         | 5540/371472 [26:18<27:54:40,  3.64it/s]
  1%|▏         | 5541/371472 [26:19<27:56:21,  3.64it/s]
  1%|▏         | 5542/371472 [26:19<29:43:44,  3.42it/s]
  1%|▏         | 5543/371472 [26:19<30:07:17,  3.37it/s]
  1%|▏         | 5544/371472 [26:20<29:59:31,  3.39it/s]
  1%|▏         | 5545/371472 [26:20<28:53:24,  3.52it/s]
  1%|▏         | 5546/371472 [26:20<28:52:50,  3.52it/s]
  1%|▏         | 5547/371472 [26:20<27:23:29,  3.71it/s]
  1%|▏         | 5548/371472 [26:21<27:01:33,  3.76it/s]
  1%|▏         | 5549/371472 [26:21<27:07:17,  3.75it/s]
  1%|▏         | 5550/371472 [26:21<27:01:56,  3.76it/s]
  1%|▏         | 5551/371472 [26:21<26:38:15,  3.82it/s]
  1%|▏         | 5552/371472 [26:22<27:28:18,  3.70it/s]
  1%|▏         | 5553/371472 [26:22<26:47:26,  3.79it/s]
  1%|▏         | 5554/371472 [26:22<27:20:47,  3.72it/s]
  1%|▏         | 5555/371472 [26:23<29:15:31,  3.47it/s]
  1%|▏         | 5556/371472 [26:23<31:14:57,  3.25it/s]
  1%|▏         | 5557/371472 [26:23<29:25:35,  3.45it/s]
  1%|▏         | 5558/371472 [26:24<31:04:55,  3.27it/s]
  1%|▏         | 5559/371472 [26:24<30:52:59,  3.29it/s]
  1%|▏         | 5560/371472 [26:24<29:31:19,  3.44it/s]
                                                        
{'loss': 4.9272, 'learning_rate': 9.870068305716562e-07, 'epoch': 0.24}

  1%|▏         | 5560/371472 [26:24<29:31:19,  3.44it/s]
  1%|▏         | 5561/371472 [26:24<28:09:47,  3.61it/s]
  1%|▏         | 5562/371472 [26:25<27:27:33,  3.70it/s]
  1%|▏         | 5563/371472 [26:25<26:39:46,  3.81it/s]
  1%|▏         | 5564/371472 [26:25<26:57:27,  3.77it/s]
  1%|▏         | 5565/371472 [26:25<26:02:24,  3.90it/s]
  1%|▏         | 5566/371472 [26:26<26:33:58,  3.83it/s]
  1%|▏         | 5567/371472 [26:26<26:01:11,  3.91it/s]
  1%|▏         | 5568/371472 [26:26<26:03:29,  3.90it/s]
  1%|▏         | 5569/371472 [26:26<27:12:19,  3.74it/s]
  1%|▏         | 5570/371472 [26:27<27:54:02,  3.64it/s]
  1%|▏         | 5571/371472 [26:27<27:02:45,  3.76it/s]
  1%|▏         | 5572/371472 [26:27<27:41:43,  3.67it/s]
  2%|▏         | 5573/371472 [26:27<26:31:09,  3.83it/s]
  2%|▏         | 5574/371472 [26:28<27:02:17,  3.76it/s]
  2%|▏         | 5575/371472 [26:28<28:11:19,  3.61it/s]
  2%|▏         | 5576/371472 [26:28<28:16:58,  3.59it/s]
  2%|▏         | 5577/371472 [26:29<28:03:12,  3.62it/s]
  2%|▏         | 5578/371472 [26:29<27:41:42,  3.67it/s]
  2%|▏         | 5579/371472 [26:29<27:49:13,  3.65it/s]
  2%|▏         | 5580/371472 [26:29<27:07:04,  3.75it/s]
                                                        
{'loss': 5.3893, 'learning_rate': 9.869583485961775e-07, 'epoch': 0.24}

  2%|▏         | 5580/371472 [26:29<27:07:04,  3.75it/s]
  2%|▏         | 5581/371472 [26:30<28:39:10,  3.55it/s]
  2%|▏         | 5582/371472 [26:30<27:56:27,  3.64it/s]
  2%|▏         | 5583/371472 [26:30<28:25:06,  3.58it/s]
  2%|▏         | 5584/371472 [26:31<28:47:28,  3.53it/s]
  2%|▏         | 5585/371472 [26:31<28:04:01,  3.62it/s]
  2%|▏         | 5586/371472 [26:31<26:39:07,  3.81it/s]
  2%|▏         | 5587/371472 [26:31<27:55:14,  3.64it/s]
  2%|▏         | 5588/371472 [26:32<26:59:57,  3.76it/s]
  2%|▏         | 5589/371472 [26:32<26:57:44,  3.77it/s]
  2%|▏         | 5590/371472 [26:32<26:52:35,  3.78it/s]
  2%|▏         | 5591/371472 [26:32<26:44:33,  3.80it/s]
  2%|▏         | 5592/371472 [26:33<27:01:33,  3.76it/s]
  2%|▏         | 5593/371472 [26:33<26:41:02,  3.81it/s]
  2%|▏         | 5594/371472 [26:33<28:09:27,  3.61it/s]
  2%|▏         | 5595/371472 [26:33<28:10:06,  3.61it/s]
  2%|▏         | 5596/371472 [26:34<27:01:43,  3.76it/s]
  2%|▏         | 5597/371472 [26:34<26:49:48,  3.79it/s]
  2%|▏         | 5598/371472 [26:34<31:01:14,  3.28it/s]
  2%|▏         | 5599/371472 [26:35<29:23:58,  3.46it/s]
  2%|▏         | 5600/371472 [26:35<28:57:35,  3.51it/s]
                                                        
{'loss': 5.3314, 'learning_rate': 9.869098666206986e-07, 'epoch': 0.24}

  2%|▏         | 5600/371472 [26:35<28:57:35,  3.51it/s]
  2%|▏         | 5601/371472 [26:35<27:43:34,  3.67it/s]
  2%|▏         | 5602/371472 [26:35<27:40:56,  3.67it/s]
  2%|▏         | 5603/371472 [26:36<26:33:24,  3.83it/s]
  2%|▏         | 5604/371472 [26:36<25:44:25,  3.95it/s]
  2%|▏         | 5605/371472 [26:36<25:56:30,  3.92it/s]
  2%|▏         | 5606/371472 [26:36<26:03:26,  3.90it/s]
  2%|▏         | 5607/371472 [26:37<27:24:47,  3.71it/s]
  2%|▏         | 5608/371472 [26:37<26:59:40,  3.76it/s]
  2%|▏         | 5609/371472 [26:37<27:45:57,  3.66it/s]
  2%|▏         | 5610/371472 [26:38<27:07:26,  3.75it/s]
  2%|▏         | 5611/371472 [26:38<26:48:22,  3.79it/s]
  2%|▏         | 5612/371472 [26:38<27:11:11,  3.74it/s]
  2%|▏         | 5613/371472 [26:38<31:53:11,  3.19it/s]
  2%|▏         | 5614/371472 [26:39<29:43:08,  3.42it/s]
  2%|▏         | 5615/371472 [26:39<28:03:32,  3.62it/s]
  2%|▏         | 5616/371472 [26:39<27:30:20,  3.69it/s]
  2%|▏         | 5617/371472 [26:40<30:03:29,  3.38it/s]
  2%|▏         | 5618/371472 [26:40<30:25:48,  3.34it/s]
  2%|▏         | 5619/371472 [26:40<29:19:30,  3.47it/s]
  2%|▏         | 5620/371472 [26:40<29:29:18,  3.45it/s]
                                                        
{'loss': 5.4649, 'learning_rate': 9.868613846452196e-07, 'epoch': 0.24}

  2%|▏         | 5620/371472 [26:40<29:29:18,  3.45it/s]
  2%|▏         | 5621/371472 [26:41<28:09:31,  3.61it/s]
  2%|▏         | 5622/371472 [26:41<27:36:00,  3.68it/s]
  2%|▏         | 5623/371472 [26:41<26:58:08,  3.77it/s]
  2%|▏         | 5624/371472 [26:41<27:36:46,  3.68it/s]
  2%|▏         | 5625/371472 [26:42<27:44:00,  3.66it/s]
  2%|▏         | 5626/371472 [26:42<27:49:41,  3.65it/s]
  2%|▏         | 5627/371472 [26:42<28:53:50,  3.52it/s]
  2%|▏         | 5628/371472 [26:43<29:06:03,  3.49it/s]
  2%|▏         | 5629/371472 [26:43<28:49:45,  3.52it/s]
  2%|▏         | 5630/371472 [26:43<27:54:15,  3.64it/s]
  2%|▏         | 5631/371472 [26:43<26:52:30,  3.78it/s]
  2%|▏         | 5632/371472 [26:44<26:42:22,  3.81it/s]
  2%|▏         | 5633/371472 [26:44<28:32:08,  3.56it/s]
  2%|▏         | 5634/371472 [26:44<28:12:41,  3.60it/s]
  2%|▏         | 5635/371472 [26:45<28:26:44,  3.57it/s]
  2%|▏         | 5636/371472 [26:45<27:15:44,  3.73it/s]
  2%|▏         | 5637/371472 [26:45<27:05:33,  3.75it/s]
  2%|▏         | 5638/371472 [26:45<26:31:20,  3.83it/s]
  2%|▏         | 5639/371472 [26:46<26:58:31,  3.77it/s]
  2%|▏         | 5640/371472 [26:46<26:32:18,  3.83it/s]
                                                        
{'loss': 5.2219, 'learning_rate': 9.868129026697407e-07, 'epoch': 0.24}

  2%|▏         | 5640/371472 [26:46<26:32:18,  3.83it/s]
  2%|▏         | 5641/371472 [26:46<26:26:46,  3.84it/s]
  2%|▏         | 5642/371472 [26:46<25:32:27,  3.98it/s]
  2%|▏         | 5643/371472 [26:47<26:25:20,  3.85it/s]
  2%|▏         | 5644/371472 [26:47<26:25:36,  3.85it/s]
  2%|▏         | 5645/371472 [26:47<27:21:53,  3.71it/s]
  2%|▏         | 5646/371472 [26:47<26:52:42,  3.78it/s]
  2%|▏         | 5647/371472 [26:48<26:55:03,  3.78it/s]
  2%|▏         | 5648/371472 [26:48<26:59:04,  3.77it/s]
  2%|▏         | 5649/371472 [26:48<27:36:11,  3.68it/s]
  2%|▏         | 5650/371472 [26:48<27:50:46,  3.65it/s]
  2%|▏         | 5651/371472 [26:49<28:25:06,  3.58it/s]
  2%|▏         | 5652/371472 [26:49<27:50:22,  3.65it/s]
  2%|▏         | 5653/371472 [26:49<27:34:59,  3.68it/s]
  2%|▏         | 5654/371472 [26:50<27:53:25,  3.64it/s]
  2%|▏         | 5655/371472 [26:50<27:31:44,  3.69it/s]
  2%|▏         | 5656/371472 [26:50<26:37:18,  3.82it/s]
  2%|▏         | 5657/371472 [26:50<26:47:26,  3.79it/s]
  2%|▏         | 5658/371472 [26:51<26:06:11,  3.89it/s]
  2%|▏         | 5659/371472 [26:51<27:37:47,  3.68it/s]
  2%|▏         | 5660/371472 [26:51<27:50:00,  3.65it/s]
                                                        
{'loss': 5.3536, 'learning_rate': 9.867644206942618e-07, 'epoch': 0.24}

  2%|▏         | 5660/371472 [26:51<27:50:00,  3.65it/s]
  2%|▏         | 5661/371472 [26:51<28:16:02,  3.59it/s]
  2%|▏         | 5662/371472 [26:52<27:37:38,  3.68it/s]
  2%|▏         | 5663/371472 [26:52<27:31:44,  3.69it/s]
  2%|▏         | 5664/371472 [26:52<27:23:38,  3.71it/s]
  2%|▏         | 5665/371472 [26:53<27:59:41,  3.63it/s]
  2%|▏         | 5666/371472 [26:53<26:41:18,  3.81it/s]
  2%|▏         | 5667/371472 [26:53<29:02:45,  3.50it/s]
  2%|▏         | 5668/371472 [26:53<28:46:39,  3.53it/s]
  2%|▏         | 5669/371472 [26:54<28:30:44,  3.56it/s]
  2%|▏         | 5670/371472 [26:54<28:56:51,  3.51it/s]
  2%|▏         | 5671/371472 [26:54<29:16:31,  3.47it/s]
  2%|▏         | 5672/371472 [26:55<29:31:39,  3.44it/s]
  2%|▏         | 5673/371472 [26:55<30:21:45,  3.35it/s]
  2%|▏         | 5674/371472 [26:55<28:46:41,  3.53it/s]
  2%|▏         | 5675/371472 [26:55<27:48:47,  3.65it/s]
  2%|▏         | 5676/371472 [26:56<29:12:10,  3.48it/s]
  2%|▏         | 5677/371472 [26:56<28:26:39,  3.57it/s]
  2%|▏         | 5678/371472 [26:56<28:54:08,  3.52it/s]
  2%|▏         | 5679/371472 [26:56<27:37:15,  3.68it/s]
  2%|▏         | 5680/371472 [26:57<29:12:08,  3.48it/s]
                                                        
{'loss': 5.0812, 'learning_rate': 9.86715938718783e-07, 'epoch': 0.24}

  2%|▏         | 5680/371472 [26:57<29:12:08,  3.48it/s]
  2%|▏         | 5681/371472 [26:57<28:09:40,  3.61it/s]
  2%|▏         | 5682/371472 [26:57<27:13:52,  3.73it/s]
  2%|▏         | 5683/371472 [26:58<26:29:29,  3.84it/s]
  2%|▏         | 5684/371472 [26:58<27:01:26,  3.76it/s]
  2%|▏         | 5685/371472 [26:58<27:12:43,  3.73it/s]
  2%|▏         | 5686/371472 [26:58<27:29:11,  3.70it/s]
  2%|▏         | 5687/371472 [26:59<29:53:07,  3.40it/s]
  2%|▏         | 5688/371472 [26:59<28:55:01,  3.51it/s]
  2%|▏         | 5689/371472 [26:59<29:35:30,  3.43it/s]
  2%|▏         | 5690/371472 [27:00<28:36:34,  3.55it/s]
  2%|▏         | 5691/371472 [27:00<29:28:16,  3.45it/s]
  2%|▏         | 5692/371472 [27:00<28:23:23,  3.58it/s]
  2%|▏         | 5693/371472 [27:00<27:55:02,  3.64it/s]
  2%|▏         | 5694/371472 [27:01<27:20:45,  3.72it/s]
  2%|▏         | 5695/371472 [27:01<28:13:11,  3.60it/s]
  2%|▏         | 5696/371472 [27:01<31:42:31,  3.20it/s]
  2%|▏         | 5697/371472 [27:02<32:11:13,  3.16it/s]
  2%|▏         | 5698/371472 [27:02<35:54:34,  2.83it/s]
  2%|▏         | 5699/371472 [27:02<33:57:30,  2.99it/s]
  2%|▏         | 5700/371472 [27:03<32:05:22,  3.17it/s]
                                                        
{'loss': 5.0065, 'learning_rate': 9.86667456743304e-07, 'epoch': 0.25}

  2%|▏         | 5700/371472 [27:03<32:05:22,  3.17it/s]
  2%|▏         | 5701/371472 [27:03<30:44:17,  3.31it/s]
  2%|▏         | 5702/371472 [27:03<32:12:42,  3.15it/s]
  2%|▏         | 5703/371472 [27:04<31:27:50,  3.23it/s]
  2%|▏         | 5704/371472 [27:04<30:33:15,  3.33it/s]
  2%|▏         | 5705/371472 [27:04<30:02:01,  3.38it/s]
  2%|▏         | 5706/371472 [27:04<30:47:09,  3.30it/s]
  2%|▏         | 5707/371472 [27:05<29:24:18,  3.46it/s]
  2%|▏         | 5708/371472 [27:05<28:26:35,  3.57it/s]
  2%|▏         | 5709/371472 [27:05<27:52:23,  3.65it/s]
  2%|▏         | 5710/371472 [27:06<27:47:40,  3.66it/s]
  2%|▏         | 5711/371472 [27:06<29:31:36,  3.44it/s]
  2%|▏         | 5712/371472 [27:06<28:29:36,  3.57it/s]
  2%|▏         | 5713/371472 [27:07<32:55:12,  3.09it/s]
  2%|▏         | 5714/371472 [27:07<32:46:33,  3.10it/s]
  2%|▏         | 5715/371472 [27:07<31:07:59,  3.26it/s]
  2%|▏         | 5716/371472 [27:07<30:51:22,  3.29it/s]
  2%|▏         | 5717/371472 [27:08<30:02:46,  3.38it/s]
  2%|▏         | 5718/371472 [27:08<29:49:20,  3.41it/s]
  2%|▏         | 5719/371472 [27:08<31:11:47,  3.26it/s]
  2%|▏         | 5720/371472 [27:09<33:28:51,  3.03it/s]
                                                        
{'loss': 4.8052, 'learning_rate': 9.866189747678252e-07, 'epoch': 0.25}

  2%|▏         | 5720/371472 [27:09<33:28:51,  3.03it/s]
  2%|▏         | 5721/371472 [27:09<31:20:10,  3.24it/s]
  2%|▏         | 5722/371472 [27:09<29:48:41,  3.41it/s]
  2%|▏         | 5723/371472 [27:09<28:34:26,  3.56it/s]
  2%|▏         | 5724/371472 [27:10<30:03:28,  3.38it/s]
  2%|▏         | 5725/371472 [27:10<29:02:07,  3.50it/s]
  2%|▏         | 5726/371472 [27:10<29:45:42,  3.41it/s]
  2%|▏         | 5727/371472 [27:11<28:25:43,  3.57it/s]
  2%|▏         | 5728/371472 [27:11<28:08:53,  3.61it/s]
  2%|▏         | 5729/371472 [27:11<28:42:04,  3.54it/s]
  2%|▏         | 5730/371472 [27:11<28:04:43,  3.62it/s]
  2%|▏         | 5731/371472 [27:12<27:44:20,  3.66it/s]
  2%|▏         | 5732/371472 [27:12<27:47:09,  3.66it/s]
  2%|▏         | 5733/371472 [27:12<27:09:24,  3.74it/s]
  2%|▏         | 5734/371472 [27:12<26:54:35,  3.78it/s]
  2%|▏         | 5735/371472 [27:13<27:04:15,  3.75it/s]
  2%|▏         | 5736/371472 [27:13<27:38:23,  3.68it/s]
  2%|▏         | 5737/371472 [27:13<27:11:58,  3.74it/s]
  2%|▏         | 5738/371472 [27:14<30:20:07,  3.35it/s]
  2%|▏         | 5739/371472 [27:14<29:02:40,  3.50it/s]
  2%|▏         | 5740/371472 [27:14<27:57:44,  3.63it/s]
                                                        
{'loss': 5.1683, 'learning_rate': 9.86570492792346e-07, 'epoch': 0.25}

  2%|▏         | 5740/371472 [27:14<27:57:44,  3.63it/s]
  2%|▏         | 5741/371472 [27:14<28:54:49,  3.51it/s]
  2%|▏         | 5742/371472 [27:15<30:47:01,  3.30it/s]
  2%|▏         | 5743/371472 [27:15<29:16:01,  3.47it/s]
  2%|▏         | 5744/371472 [27:15<28:45:43,  3.53it/s]
  2%|▏         | 5745/371472 [27:16<30:38:43,  3.32it/s]
  2%|▏         | 5746/371472 [27:16<30:09:35,  3.37it/s]
  2%|▏         | 5747/371472 [27:16<28:52:42,  3.52it/s]
  2%|▏         | 5748/371472 [27:17<30:51:33,  3.29it/s]
  2%|▏         | 5749/371472 [27:17<29:08:06,  3.49it/s]
  2%|▏         | 5750/371472 [27:17<28:21:03,  3.58it/s]
  2%|▏         | 5751/371472 [27:17<27:49:59,  3.65it/s]
  2%|▏         | 5752/371472 [27:18<28:25:26,  3.57it/s]
  2%|▏         | 5753/371472 [27:18<27:37:17,  3.68it/s]
  2%|▏         | 5754/371472 [27:18<35:57:59,  2.82it/s]
  2%|▏         | 5755/371472 [27:19<35:04:04,  2.90it/s]
  2%|▏         | 5756/371472 [27:19<33:42:28,  3.01it/s]
  2%|▏         | 5757/371472 [27:19<32:51:07,  3.09it/s]
  2%|▏         | 5758/371472 [27:20<30:58:04,  3.28it/s]
  2%|▏         | 5759/371472 [27:20<31:01:47,  3.27it/s]
  2%|▏         | 5760/371472 [27:20<29:36:35,  3.43it/s]
                                                        
{'loss': 5.0243, 'learning_rate': 9.865220108168674e-07, 'epoch': 0.25}

  2%|▏         | 5760/371472 [27:20<29:36:35,  3.43it/s]
  2%|▏         | 5761/371472 [27:20<28:15:55,  3.59it/s]
  2%|▏         | 5762/371472 [27:21<27:56:34,  3.64it/s]
  2%|▏         | 5763/371472 [27:21<29:21:06,  3.46it/s]
  2%|▏         | 5764/371472 [27:21<29:35:59,  3.43it/s]
  2%|▏         | 5765/371472 [27:22<29:29:21,  3.44it/s]
  2%|▏         | 5766/371472 [27:22<28:37:57,  3.55it/s]
  2%|▏         | 5767/371472 [27:22<28:26:06,  3.57it/s]
  2%|▏         | 5768/371472 [27:22<29:07:06,  3.49it/s]
  2%|▏         | 5769/371472 [27:23<29:15:15,  3.47it/s]
  2%|▏         | 5770/371472 [27:23<28:23:00,  3.58it/s]
  2%|▏         | 5771/371472 [27:23<29:23:13,  3.46it/s]
  2%|▏         | 5772/371472 [27:24<30:46:47,  3.30it/s]
  2%|▏         | 5773/371472 [27:24<31:39:24,  3.21it/s]
  2%|▏         | 5774/371472 [27:24<30:39:24,  3.31it/s]
  2%|▏         | 5775/371472 [27:25<29:40:51,  3.42it/s]
  2%|▏         | 5776/371472 [27:25<28:21:22,  3.58it/s]
  2%|▏         | 5777/371472 [27:25<27:29:21,  3.70it/s]
  2%|▏         | 5778/371472 [27:25<28:52:17,  3.52it/s]
  2%|▏         | 5779/371472 [27:26<28:23:51,  3.58it/s]
  2%|▏         | 5780/371472 [27:26<27:51:50,  3.65it/s]
                                                        
{'loss': 5.1228, 'learning_rate': 9.864735288413884e-07, 'epoch': 0.25}

  2%|▏         | 5780/371472 [27:26<27:51:50,  3.65it/s]
  2%|▏         | 5781/371472 [27:26<27:27:05,  3.70it/s]
  2%|▏         | 5782/371472 [27:26<27:06:14,  3.75it/s]
  2%|▏         | 5783/371472 [27:27<28:15:28,  3.59it/s]
  2%|▏         | 5784/371472 [27:27<28:50:14,  3.52it/s]
  2%|▏         | 5785/371472 [27:27<28:30:15,  3.56it/s]
  2%|▏         | 5786/371472 [27:28<27:56:35,  3.64it/s]
  2%|▏         | 5787/371472 [27:28<27:30:52,  3.69it/s]
  2%|▏         | 5788/371472 [27:28<27:06:52,  3.75it/s]
  2%|▏         | 5789/371472 [27:28<27:10:30,  3.74it/s]
  2%|▏         | 5790/371472 [27:29<26:44:20,  3.80it/s]
  2%|▏         | 5791/371472 [27:29<26:39:01,  3.81it/s]
  2%|▏         | 5792/371472 [27:29<26:45:31,  3.80it/s]
  2%|▏         | 5793/371472 [27:29<26:32:47,  3.83it/s]
  2%|▏         | 5794/371472 [27:30<28:14:09,  3.60it/s]
  2%|▏         | 5795/371472 [27:30<27:30:26,  3.69it/s]
  2%|▏         | 5796/371472 [27:30<28:28:39,  3.57it/s]
  2%|▏         | 5797/371472 [27:31<27:28:07,  3.70it/s]
  2%|▏         | 5798/371472 [27:31<27:40:51,  3.67it/s]
  2%|▏         | 5799/371472 [27:31<26:52:19,  3.78it/s]
  2%|▏         | 5800/371472 [27:31<28:17:34,  3.59it/s]
                                                        
{'loss': 5.0573, 'learning_rate': 9.864250468659095e-07, 'epoch': 0.25}

  2%|▏         | 5800/371472 [27:31<28:17:34,  3.59it/s]
  2%|▏         | 5801/371472 [27:32<28:25:43,  3.57it/s]
  2%|▏         | 5802/371472 [27:32<27:33:57,  3.68it/s]
  2%|▏         | 5803/371472 [27:32<28:54:38,  3.51it/s]
  2%|▏         | 5804/371472 [27:32<28:04:53,  3.62it/s]
  2%|▏         | 5805/371472 [27:33<28:53:19,  3.52it/s]
  2%|▏         | 5806/371472 [27:33<29:04:08,  3.49it/s]
  2%|▏         | 5807/371472 [27:33<27:56:32,  3.64it/s]
  2%|▏         | 5808/371472 [27:34<26:52:33,  3.78it/s]
  2%|▏         | 5809/371472 [27:34<29:08:52,  3.48it/s]
  2%|▏         | 5810/371472 [27:34<28:59:36,  3.50it/s]
  2%|▏         | 5811/371472 [27:34<28:15:12,  3.60it/s]
  2%|▏         | 5812/371472 [27:35<28:51:17,  3.52it/s]
  2%|▏         | 5813/371472 [27:35<29:34:12,  3.43it/s]
  2%|▏         | 5814/371472 [27:35<29:08:08,  3.49it/s]
  2%|▏         | 5815/371472 [27:36<29:15:01,  3.47it/s]
  2%|▏         | 5816/371472 [27:36<29:44:44,  3.41it/s]
  2%|▏         | 5817/371472 [27:36<29:21:40,  3.46it/s]
  2%|▏         | 5818/371472 [27:36<28:57:46,  3.51it/s]
  2%|▏         | 5819/371472 [27:37<29:33:38,  3.44it/s]
  2%|▏         | 5820/371472 [27:37<28:26:13,  3.57it/s]
                                                        
{'loss': 5.2251, 'learning_rate': 9.863765648904308e-07, 'epoch': 0.25}

  2%|▏         | 5820/371472 [27:37<28:26:13,  3.57it/s]
  2%|▏         | 5821/371472 [27:37<27:44:08,  3.66it/s]
  2%|▏         | 5822/371472 [27:38<27:41:41,  3.67it/s]
  2%|▏         | 5823/371472 [27:38<29:17:34,  3.47it/s]
  2%|▏         | 5824/371472 [27:38<29:28:41,  3.45it/s]
  2%|▏         | 5825/371472 [27:38<29:16:23,  3.47it/s]
  2%|▏         | 5826/371472 [27:39<28:38:33,  3.55it/s]
  2%|▏         | 5827/371472 [27:39<28:08:46,  3.61it/s]
  2%|▏         | 5828/371472 [27:39<28:39:06,  3.54it/s]
  2%|▏         | 5829/371472 [27:39<27:06:45,  3.75it/s]
  2%|▏         | 5830/371472 [27:40<28:56:38,  3.51it/s]
  2%|▏         | 5831/371472 [27:40<28:03:04,  3.62it/s]
  2%|▏         | 5832/371472 [27:40<29:15:43,  3.47it/s]
  2%|▏         | 5833/371472 [27:41<28:20:58,  3.58it/s]
  2%|▏         | 5834/371472 [27:41<27:31:44,  3.69it/s]
  2%|▏         | 5835/371472 [27:41<28:54:24,  3.51it/s]
  2%|▏         | 5836/371472 [27:42<29:02:33,  3.50it/s]
  2%|▏         | 5837/371472 [27:42<28:34:46,  3.55it/s]
  2%|▏         | 5838/371472 [27:42<28:23:12,  3.58it/s]
  2%|▏         | 5839/371472 [27:42<29:09:48,  3.48it/s]
  2%|▏         | 5840/371472 [27:43<30:42:51,  3.31it/s]
                                                        
{'loss': 5.1655, 'learning_rate': 9.863280829149519e-07, 'epoch': 0.25}

  2%|▏         | 5840/371472 [27:43<30:42:51,  3.31it/s]
  2%|▏         | 5841/371472 [27:43<29:55:28,  3.39it/s]
  2%|▏         | 5842/371472 [27:43<28:31:35,  3.56it/s]
  2%|▏         | 5843/371472 [27:43<27:19:52,  3.72it/s]
  2%|▏         | 5844/371472 [27:44<26:56:28,  3.77it/s]
  2%|▏         | 5845/371472 [27:44<26:44:38,  3.80it/s]
  2%|▏         | 5846/371472 [27:44<28:33:46,  3.56it/s]
  2%|▏         | 5847/371472 [27:45<28:33:00,  3.56it/s]
  2%|▏         | 5848/371472 [27:45<27:39:12,  3.67it/s]
  2%|▏         | 5849/371472 [27:45<27:38:21,  3.67it/s]
  2%|▏         | 5850/371472 [27:45<28:01:36,  3.62it/s]
  2%|▏         | 5851/371472 [27:46<28:23:22,  3.58it/s]
  2%|▏         | 5852/371472 [27:46<28:27:00,  3.57it/s]
  2%|▏         | 5853/371472 [27:46<27:43:16,  3.66it/s]
  2%|▏         | 5854/371472 [27:47<28:09:51,  3.61it/s]
  2%|▏         | 5855/371472 [27:47<27:24:24,  3.71it/s]
  2%|▏         | 5856/371472 [27:47<29:06:28,  3.49it/s]
  2%|▏         | 5857/371472 [27:47<28:39:50,  3.54it/s]
  2%|▏         | 5858/371472 [27:48<31:24:03,  3.23it/s]
  2%|▏         | 5859/371472 [27:48<29:39:52,  3.42it/s]
  2%|▏         | 5860/371472 [27:48<29:25:37,  3.45it/s]
                                                        
{'loss': 5.0808, 'learning_rate': 9.86279600939473e-07, 'epoch': 0.25}

  2%|▏         | 5860/371472 [27:48<29:25:37,  3.45it/s]
  2%|▏         | 5861/371472 [27:49<27:57:30,  3.63it/s]
  2%|▏         | 5862/371472 [27:49<26:55:54,  3.77it/s]
  2%|▏         | 5863/371472 [27:49<27:02:06,  3.76it/s]
  2%|▏         | 5864/371472 [27:49<26:32:31,  3.83it/s]
  2%|▏         | 5865/371472 [27:50<26:59:18,  3.76it/s]
  2%|▏         | 5866/371472 [27:50<28:05:56,  3.61it/s]
  2%|▏         | 5867/371472 [27:50<27:40:31,  3.67it/s]
  2%|▏         | 5868/371472 [27:50<30:28:13,  3.33it/s]
  2%|▏         | 5869/371472 [27:51<29:26:58,  3.45it/s]
  2%|▏         | 5870/371472 [27:51<28:28:55,  3.57it/s]
  2%|▏         | 5871/371472 [27:51<28:43:43,  3.54it/s]
  2%|▏         | 5872/371472 [27:52<27:22:17,  3.71it/s]
  2%|▏         | 5873/371472 [27:52<27:35:28,  3.68it/s]
  2%|▏         | 5874/371472 [27:52<27:36:56,  3.68it/s]
  2%|▏         | 5875/371472 [27:52<27:31:05,  3.69it/s]
  2%|▏         | 5876/371472 [27:53<28:12:09,  3.60it/s]
  2%|▏         | 5877/371472 [27:53<28:39:02,  3.54it/s]
  2%|▏         | 5878/371472 [27:53<28:17:30,  3.59it/s]
  2%|▏         | 5879/371472 [27:53<27:27:10,  3.70it/s]
  2%|▏         | 5880/371472 [27:54<30:07:52,  3.37it/s]
                                                        
{'loss': 5.0284, 'learning_rate': 9.86231118963994e-07, 'epoch': 0.25}

  2%|▏         | 5880/371472 [27:54<30:07:52,  3.37it/s]
  2%|▏         | 5881/371472 [27:54<30:18:54,  3.35it/s]
  2%|▏         | 5882/371472 [27:54<29:09:18,  3.48it/s]
  2%|▏         | 5883/371472 [27:55<29:10:37,  3.48it/s]
  2%|▏         | 5884/371472 [27:55<29:02:00,  3.50it/s]
  2%|▏         | 5885/371472 [27:55<28:20:19,  3.58it/s]
  2%|▏         | 5886/371472 [27:55<28:29:20,  3.56it/s]
  2%|▏         | 5887/371472 [27:56<27:28:21,  3.70it/s]
  2%|▏         | 5888/371472 [27:56<27:21:42,  3.71it/s]
  2%|▏         | 5889/371472 [27:56<27:01:20,  3.76it/s]
  2%|▏         | 5890/371472 [27:57<27:19:17,  3.72it/s]
  2%|▏         | 5891/371472 [27:57<27:38:48,  3.67it/s]
  2%|▏         | 5892/371472 [27:57<27:40:16,  3.67it/s]
  2%|▏         | 5893/371472 [27:57<27:10:55,  3.74it/s]
  2%|▏         | 5894/371472 [27:58<26:37:57,  3.81it/s]
  2%|▏         | 5895/371472 [27:58<27:44:01,  3.66it/s]
  2%|▏         | 5896/371472 [27:58<30:08:13,  3.37it/s]
  2%|▏         | 5897/371472 [27:59<29:47:11,  3.41it/s]
  2%|▏         | 5898/371472 [27:59<28:33:30,  3.56it/s]
  2%|▏         | 5899/371472 [27:59<28:56:59,  3.51it/s]
  2%|▏         | 5900/371472 [27:59<27:55:06,  3.64it/s]
                                                        
{'loss': 5.1345, 'learning_rate': 9.86182636988515e-07, 'epoch': 0.25}

  2%|▏         | 5900/371472 [27:59<27:55:06,  3.64it/s]
  2%|▏         | 5901/371472 [28:00<27:43:14,  3.66it/s]
  2%|▏         | 5902/371472 [28:00<28:35:15,  3.55it/s]
  2%|▏         | 5903/371472 [28:00<28:16:29,  3.59it/s]
  2%|▏         | 5904/371472 [28:00<27:42:59,  3.66it/s]
  2%|▏         | 5905/371472 [28:01<27:16:30,  3.72it/s]
  2%|▏         | 5906/371472 [28:01<27:15:52,  3.72it/s]
  2%|▏         | 5907/371472 [28:01<27:38:24,  3.67it/s]
  2%|▏         | 5908/371472 [28:02<27:55:50,  3.64it/s]
  2%|▏         | 5909/371472 [28:02<28:41:49,  3.54it/s]
  2%|▏         | 5910/371472 [28:02<28:19:51,  3.58it/s]
  2%|▏         | 5911/371472 [28:02<28:25:50,  3.57it/s]
  2%|▏         | 5912/371472 [28:03<27:18:51,  3.72it/s]
  2%|▏         | 5913/371472 [28:03<27:00:05,  3.76it/s]
  2%|▏         | 5914/371472 [28:03<30:08:23,  3.37it/s]
  2%|▏         | 5915/371472 [28:04<30:06:25,  3.37it/s]
  2%|▏         | 5916/371472 [28:04<33:11:55,  3.06it/s]
  2%|▏         | 5917/371472 [28:04<31:03:14,  3.27it/s]
  2%|▏         | 5918/371472 [28:04<29:41:40,  3.42it/s]
  2%|▏         | 5919/371472 [28:05<28:40:33,  3.54it/s]
  2%|▏         | 5920/371472 [28:05<28:01:03,  3.62it/s]
                                                        
{'loss': 4.7051, 'learning_rate': 9.861341550130364e-07, 'epoch': 0.25}

  2%|▏         | 5920/371472 [28:05<28:01:03,  3.62it/s]
  2%|▏         | 5921/371472 [28:05<28:20:44,  3.58it/s]
  2%|▏         | 5922/371472 [28:06<27:28:47,  3.70it/s]
  2%|▏         | 5923/371472 [28:06<27:22:09,  3.71it/s]
  2%|▏         | 5924/371472 [28:06<29:03:03,  3.50it/s]
  2%|▏         | 5925/371472 [28:06<28:00:17,  3.63it/s]
  2%|▏         | 5926/371472 [28:07<28:50:54,  3.52it/s]
  2%|▏         | 5927/371472 [28:07<27:49:09,  3.65it/s]
  2%|▏         | 5928/371472 [28:07<27:09:36,  3.74it/s]
  2%|▏         | 5929/371472 [28:07<27:37:01,  3.68it/s]
  2%|▏         | 5930/371472 [28:08<27:43:40,  3.66it/s]
  2%|▏         | 5931/371472 [28:08<27:28:58,  3.69it/s]
  2%|▏         | 5932/371472 [28:08<26:48:45,  3.79it/s]
  2%|▏         | 5933/371472 [28:08<26:59:51,  3.76it/s]
  2%|▏         | 5934/371472 [28:09<26:10:02,  3.88it/s]
  2%|▏         | 5935/371472 [28:09<28:10:02,  3.60it/s]
  2%|▏         | 5936/371472 [28:09<29:04:23,  3.49it/s]
  2%|▏         | 5937/371472 [28:10<29:18:25,  3.46it/s]
  2%|▏         | 5938/371472 [28:10<28:56:11,  3.51it/s]
  2%|▏         | 5939/371472 [28:10<30:56:54,  3.28it/s]
  2%|▏         | 5940/371472 [28:11<29:36:00,  3.43it/s]
                                                        
{'loss': 4.9449, 'learning_rate': 9.860856730375572e-07, 'epoch': 0.26}

  2%|▏         | 5940/371472 [28:11<29:36:00,  3.43it/s]
  2%|▏         | 5941/371472 [28:11<28:07:57,  3.61it/s]
  2%|▏         | 5942/371472 [28:11<28:15:31,  3.59it/s]
  2%|▏         | 5943/371472 [28:11<27:34:15,  3.68it/s]
  2%|▏         | 5944/371472 [28:12<26:51:02,  3.78it/s]
  2%|▏         | 5945/371472 [28:12<27:01:21,  3.76it/s]
  2%|▏         | 5946/371472 [28:12<26:52:02,  3.78it/s]
  2%|▏         | 5947/371472 [28:12<26:31:51,  3.83it/s]
  2%|▏         | 5948/371472 [28:13<26:27:31,  3.84it/s]
  2%|▏         | 5949/371472 [28:13<26:24:22,  3.85it/s]
  2%|▏         | 5950/371472 [28:13<26:41:58,  3.80it/s]
  2%|▏         | 5951/371472 [28:13<26:40:22,  3.81it/s]
  2%|▏         | 5952/371472 [28:14<27:56:17,  3.63it/s]
  2%|▏         | 5953/371472 [28:14<27:20:52,  3.71it/s]
  2%|▏         | 5954/371472 [28:14<27:00:15,  3.76it/s]
  2%|▏         | 5955/371472 [28:14<26:51:13,  3.78it/s]
  2%|▏         | 5956/371472 [28:15<30:25:11,  3.34it/s]
  2%|▏         | 5957/371472 [28:15<31:49:58,  3.19it/s]
  2%|▏         | 5958/371472 [28:15<30:09:59,  3.37it/s]
  2%|▏         | 5959/371472 [28:16<29:47:54,  3.41it/s]
  2%|▏         | 5960/371472 [28:16<29:41:24,  3.42it/s]
                                                        
{'loss': 5.1681, 'learning_rate': 9.860371910620785e-07, 'epoch': 0.26}

  2%|▏         | 5960/371472 [28:16<29:41:24,  3.42it/s]
  2%|▏         | 5961/371472 [28:16<29:10:32,  3.48it/s]
  2%|▏         | 5962/371472 [28:17<29:49:21,  3.40it/s]
  2%|▏         | 5963/371472 [28:17<28:52:53,  3.52it/s]
  2%|▏         | 5964/371472 [28:17<28:14:52,  3.59it/s]
  2%|▏         | 5965/371472 [28:17<27:57:48,  3.63it/s]
  2%|▏         | 5966/371472 [28:18<27:22:44,  3.71it/s]
  2%|▏         | 5967/371472 [28:18<28:43:11,  3.54it/s]
  2%|▏         | 5968/371472 [28:18<28:48:36,  3.52it/s]
  2%|▏         | 5969/371472 [28:19<28:55:33,  3.51it/s]
  2%|▏         | 5970/371472 [28:19<28:31:08,  3.56it/s]
  2%|▏         | 5971/371472 [28:19<27:19:55,  3.71it/s]
  2%|▏         | 5972/371472 [28:19<27:29:02,  3.69it/s]
  2%|▏         | 5973/371472 [28:20<33:59:32,  2.99it/s]
  2%|▏         | 5974/371472 [28:20<31:13:26,  3.25it/s]
  2%|▏         | 5975/371472 [28:20<29:46:42,  3.41it/s]
  2%|▏         | 5976/371472 [28:21<29:52:13,  3.40it/s]
  2%|▏         | 5977/371472 [28:21<30:49:51,  3.29it/s]
  2%|▏         | 5978/371472 [28:21<30:09:21,  3.37it/s]
  2%|▏         | 5979/371472 [28:22<29:28:56,  3.44it/s]
  2%|▏         | 5980/371472 [28:22<29:05:34,  3.49it/s]
                                                        
{'loss': 4.9312, 'learning_rate': 9.859887090865996e-07, 'epoch': 0.26}

  2%|▏         | 5980/371472 [28:22<29:05:34,  3.49it/s]
  2%|▏         | 5981/371472 [28:22<29:13:03,  3.47it/s]
  2%|▏         | 5982/371472 [28:22<28:11:06,  3.60it/s]
  2%|▏         | 5983/371472 [28:23<28:09:07,  3.61it/s]
  2%|▏         | 5984/371472 [28:23<27:27:22,  3.70it/s]
  2%|▏         | 5985/371472 [28:23<28:33:37,  3.55it/s]
  2%|▏         | 5986/371472 [28:23<29:17:48,  3.47it/s]
  2%|▏         | 5987/371472 [28:24<29:41:23,  3.42it/s]
  2%|▏         | 5988/371472 [28:24<29:37:10,  3.43it/s]
  2%|▏         | 5989/371472 [28:24<29:28:54,  3.44it/s]
  2%|▏         | 5990/371472 [28:25<29:12:15,  3.48it/s]
  2%|▏         | 5991/371472 [28:25<27:45:58,  3.66it/s]
  2%|▏         | 5992/371472 [28:25<26:49:02,  3.79it/s]
  2%|▏         | 5993/371472 [28:25<27:16:36,  3.72it/s]
  2%|▏         | 5994/371472 [28:26<35:03:33,  2.90it/s]
  2%|▏         | 5995/371472 [28:26<34:00:49,  2.98it/s]
  2%|▏         | 5996/371472 [28:27<31:50:53,  3.19it/s]
  2%|▏         | 5997/371472 [28:27<30:37:02,  3.32it/s]
  2%|▏         | 5998/371472 [28:27<30:46:36,  3.30it/s]
  2%|▏         | 5999/371472 [28:27<30:44:22,  3.30it/s]
  2%|▏         | 6000/371472 [28:28<29:44:42,  3.41it/s]
                                                        
{'loss': 5.3096, 'learning_rate': 9.859402271111206e-07, 'epoch': 0.26}

  2%|▏         | 6000/371472 [28:28<29:44:42,  3.41it/s]
  2%|▏         | 6001/371472 [28:28<29:20:31,  3.46it/s]
  2%|▏         | 6002/371472 [28:28<29:46:01,  3.41it/s]
  2%|▏         | 6003/371472 [28:29<28:27:16,  3.57it/s]
  2%|▏         | 6004/371472 [28:29<28:49:37,  3.52it/s]
  2%|▏         | 6005/371472 [28:29<28:29:30,  3.56it/s]
  2%|▏         | 6006/371472 [28:29<28:42:20,  3.54it/s]
  2%|▏         | 6007/371472 [28:30<28:12:03,  3.60it/s]
  2%|▏         | 6008/371472 [28:30<31:12:19,  3.25it/s]
  2%|▏         | 6009/371472 [28:30<30:06:47,  3.37it/s]
  2%|▏         | 6010/371472 [28:31<30:41:00,  3.31it/s]
  2%|▏         | 6011/371472 [28:31<29:53:23,  3.40it/s]
  2%|▏         | 6012/371472 [28:31<29:25:19,  3.45it/s]
  2%|▏         | 6013/371472 [28:31<28:55:48,  3.51it/s]
  2%|▏         | 6014/371472 [28:32<27:58:20,  3.63it/s]
  2%|▏         | 6015/371472 [28:32<36:37:17,  2.77it/s]
  2%|▏         | 6016/371472 [28:33<35:05:43,  2.89it/s]
  2%|▏         | 6017/371472 [28:33<32:05:23,  3.16it/s]
  2%|▏         | 6018/371472 [28:33<36:37:18,  2.77it/s]
  2%|▏         | 6019/371472 [28:34<34:28:35,  2.94it/s]
  2%|▏         | 6020/371472 [28:34<32:09:11,  3.16it/s]
                                                        
{'loss': 4.9742, 'learning_rate': 9.858917451356417e-07, 'epoch': 0.26}

  2%|▏         | 6020/371472 [28:34<32:09:11,  3.16it/s]
  2%|▏         | 6021/371472 [28:34<32:00:41,  3.17it/s]
  2%|▏         | 6022/371472 [28:34<31:13:49,  3.25it/s]
  2%|▏         | 6023/371472 [28:35<30:01:22,  3.38it/s]
  2%|▏         | 6024/371472 [28:35<30:14:04,  3.36it/s]
  2%|▏         | 6025/371472 [28:35<29:01:57,  3.50it/s]
  2%|▏         | 6026/371472 [28:36<28:37:46,  3.55it/s]
  2%|▏         | 6027/371472 [28:36<28:35:28,  3.55it/s]
  2%|▏         | 6028/371472 [28:36<28:36:58,  3.55it/s]
  2%|▏         | 6029/371472 [28:36<29:09:05,  3.48it/s]
  2%|▏         | 6030/371472 [28:37<30:09:27,  3.37it/s]
  2%|▏         | 6031/371472 [28:37<29:32:35,  3.44it/s]
  2%|▏         | 6032/371472 [28:37<28:08:36,  3.61it/s]
  2%|▏         | 6033/371472 [28:38<29:00:15,  3.50it/s]
  2%|▏         | 6034/371472 [28:38<28:58:21,  3.50it/s]
  2%|▏         | 6035/371472 [28:38<28:40:47,  3.54it/s]
  2%|▏         | 6036/371472 [28:38<30:43:03,  3.30it/s]
  2%|▏         | 6037/371472 [28:39<29:33:02,  3.44it/s]
  2%|▏         | 6038/371472 [28:39<29:22:03,  3.46it/s]
  2%|▏         | 6039/371472 [28:39<28:24:08,  3.57it/s]
  2%|▏         | 6040/371472 [28:40<28:38:48,  3.54it/s]
                                                        
{'loss': 5.1821, 'learning_rate': 9.858432631601628e-07, 'epoch': 0.26}

  2%|▏         | 6040/371472 [28:40<28:38:48,  3.54it/s]
  2%|▏         | 6041/371472 [28:40<28:07:02,  3.61it/s]
  2%|▏         | 6042/371472 [28:40<29:25:36,  3.45it/s]
  2%|▏         | 6043/371472 [28:40<28:42:52,  3.54it/s]
  2%|▏         | 6044/371472 [28:41<29:16:57,  3.47it/s]
  2%|▏         | 6045/371472 [28:41<27:59:34,  3.63it/s]
  2%|▏         | 6046/371472 [28:41<31:05:57,  3.26it/s]
  2%|▏         | 6047/371472 [28:42<30:13:02,  3.36it/s]
  2%|▏         | 6048/371472 [28:42<29:07:02,  3.49it/s]
  2%|▏         | 6049/371472 [28:42<31:26:54,  3.23it/s]
  2%|▏         | 6050/371472 [28:43<31:09:58,  3.26it/s]
  2%|▏         | 6051/371472 [28:43<31:50:28,  3.19it/s]
  2%|▏         | 6052/371472 [28:43<30:59:54,  3.27it/s]
  2%|▏         | 6053/371472 [28:43<28:56:41,  3.51it/s]
  2%|▏         | 6054/371472 [28:44<28:22:14,  3.58it/s]
  2%|▏         | 6055/371472 [28:44<28:50:28,  3.52it/s]
  2%|▏         | 6056/371472 [28:44<28:11:12,  3.60it/s]
  2%|▏         | 6057/371472 [28:44<28:14:07,  3.59it/s]
  2%|▏         | 6058/371472 [28:45<27:43:31,  3.66it/s]
  2%|▏         | 6059/371472 [28:45<29:51:06,  3.40it/s]
  2%|▏         | 6060/371472 [28:45<29:07:17,  3.49it/s]
                                                        
{'loss': 5.1821, 'learning_rate': 9.85794781184684e-07, 'epoch': 0.26}

  2%|▏         | 6060/371472 [28:45<29:07:17,  3.49it/s]
  2%|▏         | 6061/371472 [28:46<28:32:48,  3.56it/s]
  2%|▏         | 6062/371472 [28:46<27:26:02,  3.70it/s]
  2%|▏         | 6063/371472 [28:46<28:01:47,  3.62it/s]
  2%|▏         | 6064/371472 [28:46<26:48:14,  3.79it/s]
  2%|▏         | 6065/371472 [28:47<28:42:20,  3.54it/s]
  2%|▏         | 6066/371472 [28:47<28:00:28,  3.62it/s]
  2%|▏         | 6067/371472 [28:47<28:03:49,  3.62it/s]
  2%|▏         | 6068/371472 [28:47<27:11:49,  3.73it/s]
  2%|▏         | 6069/371472 [28:48<26:41:41,  3.80it/s]
  2%|▏         | 6070/371472 [28:48<26:51:31,  3.78it/s]
  2%|▏         | 6071/371472 [28:48<27:40:36,  3.67it/s]
  2%|▏         | 6072/371472 [28:49<28:40:59,  3.54it/s]
  2%|▏         | 6073/371472 [28:49<28:42:05,  3.54it/s]
  2%|▏         | 6074/371472 [28:49<27:35:50,  3.68it/s]
  2%|▏         | 6075/371472 [28:49<30:06:20,  3.37it/s]
  2%|▏         | 6076/371472 [28:50<28:29:48,  3.56it/s]
  2%|▏         | 6077/371472 [28:50<27:46:12,  3.65it/s]
  2%|▏         | 6078/371472 [28:50<27:07:21,  3.74it/s]
  2%|▏         | 6079/371472 [28:51<27:06:14,  3.74it/s]
  2%|▏         | 6080/371472 [28:51<26:01:47,  3.90it/s]
                                                        
{'loss': 5.083, 'learning_rate': 9.857462992092051e-07, 'epoch': 0.26}

  2%|▏         | 6080/371472 [28:51<26:01:47,  3.90it/s]
  2%|▏         | 6081/371472 [28:51<26:58:01,  3.76it/s]
  2%|▏         | 6082/371472 [28:51<28:45:59,  3.53it/s]
  2%|▏         | 6083/371472 [28:52<32:30:29,  3.12it/s]
  2%|▏         | 6084/371472 [28:52<31:00:27,  3.27it/s]
  2%|▏         | 6085/371472 [28:52<29:56:38,  3.39it/s]
  2%|▏         | 6086/371472 [28:53<29:53:17,  3.40it/s]
  2%|▏         | 6087/371472 [28:53<29:11:46,  3.48it/s]
  2%|▏         | 6088/371472 [28:53<29:00:57,  3.50it/s]
  2%|▏         | 6089/371472 [28:53<28:27:58,  3.57it/s]
  2%|▏         | 6090/371472 [28:54<28:20:25,  3.58it/s]
  2%|▏         | 6091/371472 [28:54<28:20:19,  3.58it/s]
  2%|▏         | 6092/371472 [28:54<27:30:17,  3.69it/s]
  2%|▏         | 6093/371472 [28:54<26:55:52,  3.77it/s]
  2%|▏         | 6094/371472 [28:55<27:13:32,  3.73it/s]
  2%|▏         | 6095/371472 [28:55<27:42:02,  3.66it/s]
  2%|▏         | 6096/371472 [28:55<28:24:27,  3.57it/s]
  2%|▏         | 6097/371472 [28:56<28:40:23,  3.54it/s]
  2%|▏         | 6098/371472 [28:56<28:35:09,  3.55it/s]
  2%|▏         | 6099/371472 [28:56<28:52:26,  3.51it/s]
  2%|▏         | 6100/371472 [28:56<27:46:36,  3.65it/s]
                                                        
{'loss': 5.1987, 'learning_rate': 9.856978172337262e-07, 'epoch': 0.26}

  2%|▏         | 6100/371472 [28:56<27:46:36,  3.65it/s]
  2%|▏         | 6101/371472 [28:57<30:05:04,  3.37it/s]
  2%|▏         | 6102/371472 [28:57<30:15:27,  3.35it/s]
  2%|▏         | 6103/371472 [28:57<29:50:25,  3.40it/s]
  2%|▏         | 6104/371472 [28:58<28:58:51,  3.50it/s]
  2%|▏         | 6105/371472 [28:58<30:36:49,  3.32it/s]
  2%|▏         | 6106/371472 [28:58<30:41:45,  3.31it/s]
  2%|▏         | 6107/371472 [28:59<29:09:41,  3.48it/s]
  2%|▏         | 6108/371472 [28:59<29:42:41,  3.42it/s]
  2%|▏         | 6109/371472 [28:59<28:51:07,  3.52it/s]
  2%|▏         | 6110/371472 [28:59<28:53:22,  3.51it/s]
  2%|▏         | 6111/371472 [29:00<27:58:42,  3.63it/s]
  2%|▏         | 6112/371472 [29:00<27:55:41,  3.63it/s]
  2%|▏         | 6113/371472 [29:00<27:29:08,  3.69it/s]
  2%|▏         | 6114/371472 [29:00<27:01:34,  3.76it/s]
  2%|▏         | 6115/371472 [29:01<29:38:00,  3.42it/s]
  2%|▏         | 6116/371472 [29:01<29:49:09,  3.40it/s]
  2%|▏         | 6117/371472 [29:01<30:22:50,  3.34it/s]
  2%|▏         | 6118/371472 [29:02<30:22:18,  3.34it/s]
  2%|▏         | 6119/371472 [29:02<30:14:20,  3.36it/s]
  2%|▏         | 6120/371472 [29:02<28:56:30,  3.51it/s]
                                                        
{'loss': 5.0137, 'learning_rate': 9.85649335258247e-07, 'epoch': 0.26}

  2%|▏         | 6120/371472 [29:02<28:56:30,  3.51it/s]
  2%|▏         | 6121/371472 [29:03<28:30:56,  3.56it/s]
  2%|▏         | 6122/371472 [29:03<28:26:39,  3.57it/s]
  2%|▏         | 6123/371472 [29:03<28:55:09,  3.51it/s]
  2%|▏         | 6124/371472 [29:03<28:15:04,  3.59it/s]
  2%|▏         | 6125/371472 [29:04<28:53:40,  3.51it/s]
  2%|▏         | 6126/371472 [29:04<29:39:27,  3.42it/s]
  2%|▏         | 6127/371472 [29:04<29:17:17,  3.47it/s]
  2%|▏         | 6128/371472 [29:05<30:18:03,  3.35it/s]
  2%|▏         | 6129/371472 [29:05<29:06:03,  3.49it/s]
  2%|▏         | 6130/371472 [29:05<29:09:01,  3.48it/s]
  2%|▏         | 6131/371472 [29:05<29:04:45,  3.49it/s]
  2%|▏         | 6132/371472 [29:06<30:10:44,  3.36it/s]
  2%|▏         | 6133/371472 [29:06<29:25:25,  3.45it/s]
  2%|▏         | 6134/371472 [29:06<29:00:58,  3.50it/s]
  2%|▏         | 6135/371472 [29:07<29:56:35,  3.39it/s]
  2%|▏         | 6136/371472 [29:07<28:35:53,  3.55it/s]
  2%|▏         | 6137/371472 [29:07<28:26:01,  3.57it/s]
  2%|▏         | 6138/371472 [29:07<28:12:36,  3.60it/s]
  2%|▏         | 6139/371472 [29:08<28:04:43,  3.61it/s]
  2%|▏         | 6140/371472 [29:08<28:48:50,  3.52it/s]
                                                        
{'loss': 4.8114, 'learning_rate': 9.856008532827684e-07, 'epoch': 0.26}

  2%|▏         | 6140/371472 [29:08<28:48:50,  3.52it/s]
  2%|▏         | 6141/371472 [29:08<30:07:02,  3.37it/s]
  2%|▏         | 6142/371472 [29:09<29:07:50,  3.48it/s]
  2%|▏         | 6143/371472 [29:09<29:03:29,  3.49it/s]
  2%|▏         | 6144/371472 [29:09<29:17:00,  3.47it/s]
  2%|▏         | 6145/371472 [29:09<28:54:44,  3.51it/s]
  2%|▏         | 6146/371472 [29:10<28:09:11,  3.60it/s]
  2%|▏         | 6147/371472 [29:10<26:55:19,  3.77it/s]
  2%|▏         | 6148/371472 [29:10<28:51:21,  3.52it/s]
  2%|▏         | 6149/371472 [29:11<29:59:45,  3.38it/s]
  2%|▏         | 6150/371472 [29:11<29:11:11,  3.48it/s]
  2%|▏         | 6151/371472 [29:11<30:30:45,  3.33it/s]
  2%|▏         | 6152/371472 [29:11<29:39:39,  3.42it/s]
  2%|▏         | 6153/371472 [29:12<29:02:48,  3.49it/s]
  2%|▏         | 6154/371472 [29:12<28:04:00,  3.62it/s]
  2%|▏         | 6155/371472 [29:12<28:48:32,  3.52it/s]
  2%|▏         | 6156/371472 [29:13<29:01:16,  3.50it/s]
  2%|▏         | 6157/371472 [29:13<28:17:14,  3.59it/s]
  2%|▏         | 6158/371472 [29:13<27:38:25,  3.67it/s]
  2%|▏         | 6159/371472 [29:13<27:06:06,  3.74it/s]
  2%|▏         | 6160/371472 [29:14<28:47:42,  3.52it/s]
                                                        
{'loss': 5.1205, 'learning_rate': 9.855523713072894e-07, 'epoch': 0.27}

  2%|▏         | 6160/371472 [29:14<28:47:42,  3.52it/s]
  2%|▏         | 6161/371472 [29:14<27:53:56,  3.64it/s]
  2%|▏         | 6162/371472 [29:14<28:10:33,  3.60it/s]
  2%|▏         | 6163/371472 [29:15<29:45:00,  3.41it/s]
  2%|▏         | 6164/371472 [29:15<30:23:30,  3.34it/s]
  2%|▏         | 6165/371472 [29:15<30:40:31,  3.31it/s]
  2%|▏         | 6166/371472 [29:15<29:40:23,  3.42it/s]
  2%|▏         | 6167/371472 [29:16<29:50:09,  3.40it/s]
  2%|▏         | 6168/371472 [29:16<30:23:47,  3.34it/s]
  2%|▏         | 6169/371472 [29:16<30:30:02,  3.33it/s]
  2%|▏         | 6170/371472 [29:17<28:37:27,  3.54it/s]
  2%|▏         | 6171/371472 [29:17<27:59:38,  3.62it/s]
  2%|▏         | 6172/371472 [29:17<29:02:11,  3.49it/s]
  2%|▏         | 6173/371472 [29:17<30:39:51,  3.31it/s]
  2%|▏         | 6174/371472 [29:18<29:02:47,  3.49it/s]
  2%|▏         | 6175/371472 [29:18<28:04:55,  3.61it/s]
  2%|▏         | 6176/371472 [29:18<28:35:43,  3.55it/s]
  2%|▏         | 6177/371472 [29:19<27:42:48,  3.66it/s]
  2%|▏         | 6178/371472 [29:19<27:41:52,  3.66it/s]
  2%|▏         | 6179/371472 [29:19<27:16:47,  3.72it/s]
  2%|▏         | 6180/371472 [29:19<27:25:17,  3.70it/s]
                                                        
{'loss': 4.9281, 'learning_rate': 9.855038893318105e-07, 'epoch': 0.27}

  2%|▏         | 6180/371472 [29:19<27:25:17,  3.70it/s]
  2%|▏         | 6181/371472 [29:20<27:27:39,  3.70it/s]
  2%|▏         | 6182/371472 [29:20<27:34:52,  3.68it/s]
  2%|▏         | 6183/371472 [29:20<27:34:10,  3.68it/s]
  2%|▏         | 6184/371472 [29:20<28:08:16,  3.61it/s]
  2%|▏         | 6185/371472 [29:21<27:19:01,  3.71it/s]
  2%|▏         | 6186/371472 [29:21<27:22:02,  3.71it/s]
  2%|▏         | 6187/371472 [29:21<27:47:22,  3.65it/s]
  2%|▏         | 6188/371472 [29:22<29:03:01,  3.49it/s]
  2%|▏         | 6189/371472 [29:22<28:25:48,  3.57it/s]
  2%|▏         | 6190/371472 [29:22<27:31:48,  3.69it/s]
  2%|▏         | 6191/371472 [29:22<29:15:39,  3.47it/s]
  2%|▏         | 6192/371472 [29:23<27:43:32,  3.66it/s]
  2%|▏         | 6193/371472 [29:23<27:13:15,  3.73it/s]
  2%|▏         | 6194/371472 [29:23<27:04:53,  3.75it/s]
  2%|▏         | 6195/371472 [29:23<27:19:46,  3.71it/s]
  2%|▏         | 6196/371472 [29:24<27:25:56,  3.70it/s]
  2%|▏         | 6197/371472 [29:24<29:12:37,  3.47it/s]
  2%|▏         | 6198/371472 [29:24<29:30:16,  3.44it/s]
  2%|▏         | 6199/371472 [29:25<28:36:22,  3.55it/s]
  2%|▏         | 6200/371472 [29:25<29:43:23,  3.41it/s]
                                                        
{'loss': 5.0873, 'learning_rate': 9.854554073563318e-07, 'epoch': 0.27}

  2%|▏         | 6200/371472 [29:25<29:43:23,  3.41it/s]
  2%|▏         | 6201/371472 [29:25<31:10:10,  3.26it/s]
  2%|▏         | 6202/371472 [29:26<31:48:36,  3.19it/s]
  2%|▏         | 6203/371472 [29:26<30:27:28,  3.33it/s]
  2%|▏         | 6204/371472 [29:26<28:32:36,  3.55it/s]
  2%|▏         | 6205/371472 [29:26<27:28:29,  3.69it/s]
  2%|▏         | 6206/371472 [29:27<27:04:25,  3.75it/s]
  2%|▏         | 6207/371472 [29:27<28:01:42,  3.62it/s]
  2%|▏         | 6208/371472 [29:27<28:28:07,  3.56it/s]
  2%|▏         | 6209/371472 [29:27<28:26:23,  3.57it/s]
  2%|▏         | 6210/371472 [29:28<29:37:37,  3.42it/s]
  2%|▏         | 6211/371472 [29:28<29:37:59,  3.42it/s]
  2%|▏         | 6212/371472 [29:28<29:06:18,  3.49it/s]
  2%|▏         | 6213/371472 [29:29<29:09:57,  3.48it/s]
  2%|▏         | 6214/371472 [29:29<29:17:01,  3.46it/s]
  2%|▏         | 6215/371472 [29:29<30:23:14,  3.34it/s]
  2%|▏         | 6216/371472 [29:30<29:23:49,  3.45it/s]
  2%|▏         | 6217/371472 [29:30<28:12:15,  3.60it/s]
  2%|▏         | 6218/371472 [29:30<28:26:47,  3.57it/s]
  2%|▏         | 6219/371472 [29:30<28:21:20,  3.58it/s]
  2%|▏         | 6220/371472 [29:31<28:28:40,  3.56it/s]
                                                        
{'loss': 5.0967, 'learning_rate': 9.854069253808529e-07, 'epoch': 0.27}

  2%|▏         | 6220/371472 [29:31<28:28:40,  3.56it/s]
  2%|▏         | 6221/371472 [29:31<28:24:03,  3.57it/s]
  2%|▏         | 6222/371472 [29:31<29:58:22,  3.38it/s]
  2%|▏         | 6223/371472 [29:31<29:21:53,  3.46it/s]
  2%|▏         | 6224/371472 [29:32<32:00:30,  3.17it/s]
  2%|▏         | 6225/371472 [29:32<31:43:26,  3.20it/s]
  2%|▏         | 6226/371472 [29:32<30:38:14,  3.31it/s]
  2%|▏         | 6227/371472 [29:33<31:39:09,  3.21it/s]
  2%|▏         | 6228/371472 [29:33<29:53:46,  3.39it/s]
  2%|▏         | 6229/371472 [29:33<29:29:32,  3.44it/s]
  2%|▏         | 6230/371472 [29:34<29:13:20,  3.47it/s]
  2%|▏         | 6231/371472 [29:34<29:51:47,  3.40it/s]
  2%|▏         | 6232/371472 [29:34<29:02:41,  3.49it/s]
  2%|▏         | 6233/371472 [29:35<31:42:28,  3.20it/s]
  2%|▏         | 6234/371472 [29:35<30:28:15,  3.33it/s]
  2%|▏         | 6235/371472 [29:35<30:44:20,  3.30it/s]
  2%|▏         | 6236/371472 [29:35<29:58:37,  3.38it/s]
  2%|▏         | 6237/371472 [29:36<28:51:11,  3.52it/s]
  2%|▏         | 6238/371472 [29:36<28:13:55,  3.59it/s]
  2%|▏         | 6239/371472 [29:36<28:26:13,  3.57it/s]
  2%|▏         | 6240/371472 [29:37<28:26:10,  3.57it/s]
                                                        
{'loss': 5.2425, 'learning_rate': 9.85358443405374e-07, 'epoch': 0.27}

  2%|▏         | 6240/371472 [29:37<28:26:10,  3.57it/s]
  2%|▏         | 6241/371472 [29:37<30:50:00,  3.29it/s]
  2%|▏         | 6242/371472 [29:37<29:40:47,  3.42it/s]
  2%|▏         | 6243/371472 [29:37<28:53:19,  3.51it/s]
  2%|▏         | 6244/371472 [29:38<28:06:16,  3.61it/s]
  2%|▏         | 6245/371472 [29:38<27:51:47,  3.64it/s]
  2%|▏         | 6246/371472 [29:38<27:17:16,  3.72it/s]
  2%|▏         | 6247/371472 [29:38<27:48:07,  3.65it/s]
  2%|▏         | 6248/371472 [29:39<27:26:51,  3.70it/s]
  2%|▏         | 6249/371472 [29:39<27:27:49,  3.69it/s]
  2%|▏         | 6250/371472 [29:39<26:57:29,  3.76it/s]
  2%|▏         | 6251/371472 [29:40<29:40:53,  3.42it/s]
  2%|▏         | 6252/371472 [29:40<29:26:38,  3.45it/s]
  2%|▏         | 6253/371472 [29:40<28:15:50,  3.59it/s]
  2%|▏         | 6254/371472 [29:40<27:37:08,  3.67it/s]
  2%|▏         | 6255/371472 [29:41<27:31:16,  3.69it/s]
  2%|▏         | 6256/371472 [29:41<31:39:45,  3.20it/s]
  2%|▏         | 6257/371472 [29:41<30:20:46,  3.34it/s]
  2%|▏         | 6258/371472 [29:42<29:28:47,  3.44it/s]
  2%|▏         | 6259/371472 [29:42<28:42:57,  3.53it/s]
  2%|▏         | 6260/371472 [29:42<29:31:31,  3.44it/s]
                                                        
{'loss': 5.1937, 'learning_rate': 9.85309961429895e-07, 'epoch': 0.27}

  2%|▏         | 6260/371472 [29:42<29:31:31,  3.44it/s]
  2%|▏         | 6261/371472 [29:42<29:01:55,  3.49it/s]
  2%|▏         | 6262/371472 [29:43<29:30:07,  3.44it/s]
  2%|▏         | 6263/371472 [29:43<30:49:53,  3.29it/s]
  2%|▏         | 6264/371472 [29:43<28:45:54,  3.53it/s]
  2%|▏         | 6265/371472 [29:44<28:10:53,  3.60it/s]
  2%|▏         | 6266/371472 [29:44<27:29:30,  3.69it/s]
  2%|▏         | 6267/371472 [29:44<27:51:53,  3.64it/s]
  2%|▏         | 6268/371472 [29:44<27:51:44,  3.64it/s]
  2%|▏         | 6269/371472 [29:45<31:06:27,  3.26it/s]
  2%|▏         | 6270/371472 [29:45<31:32:54,  3.22it/s]
  2%|▏         | 6271/371472 [29:45<31:48:16,  3.19it/s]
  2%|▏         | 6272/371472 [29:46<32:03:24,  3.16it/s]
  2%|▏         | 6273/371472 [29:46<32:03:08,  3.16it/s]
  2%|▏         | 6274/371472 [29:46<31:40:02,  3.20it/s]
  2%|▏         | 6275/371472 [29:47<31:09:55,  3.26it/s]
  2%|▏         | 6276/371472 [29:47<29:35:32,  3.43it/s]
  2%|▏         | 6277/371472 [29:47<28:55:24,  3.51it/s]
  2%|▏         | 6278/371472 [29:48<31:08:32,  3.26it/s]
  2%|▏         | 6279/371472 [29:48<30:19:30,  3.35it/s]
  2%|▏         | 6280/371472 [29:48<29:56:41,  3.39it/s]
                                                        
{'loss': 4.8241, 'learning_rate': 9.85261479454416e-07, 'epoch': 0.27}

  2%|▏         | 6280/371472 [29:48<29:56:41,  3.39it/s]
  2%|▏         | 6281/371472 [29:48<29:02:36,  3.49it/s]
  2%|▏         | 6282/371472 [29:49<28:27:48,  3.56it/s]
  2%|▏         | 6283/371472 [29:49<29:30:59,  3.44it/s]
  2%|▏         | 6284/371472 [29:49<30:46:24,  3.30it/s]
  2%|▏         | 6285/371472 [29:50<30:05:40,  3.37it/s]
  2%|▏         | 6286/371472 [29:50<28:21:54,  3.58it/s]
  2%|▏         | 6287/371472 [29:50<27:54:28,  3.63it/s]
  2%|▏         | 6288/371472 [29:50<26:49:13,  3.78it/s]
  2%|▏         | 6289/371472 [29:51<27:02:13,  3.75it/s]
  2%|▏         | 6290/371472 [29:51<26:34:18,  3.82it/s]
  2%|▏         | 6291/371472 [29:51<28:38:15,  3.54it/s]
  2%|▏         | 6292/371472 [29:51<27:56:04,  3.63it/s]
  2%|▏         | 6293/371472 [29:52<27:10:00,  3.73it/s]
  2%|▏         | 6294/371472 [29:52<27:18:28,  3.71it/s]
  2%|▏         | 6295/371472 [29:52<26:38:03,  3.81it/s]
  2%|▏         | 6296/371472 [29:52<26:17:51,  3.86it/s]
  2%|▏         | 6297/371472 [29:53<26:33:05,  3.82it/s]
  2%|▏         | 6298/371472 [29:53<26:29:14,  3.83it/s]
  2%|▏         | 6299/371472 [29:53<26:40:26,  3.80it/s]
  2%|▏         | 6300/371472 [29:54<26:13:58,  3.87it/s]
                                                        
{'loss': 5.0539, 'learning_rate': 9.852129974789373e-07, 'epoch': 0.27}

  2%|▏         | 6300/371472 [29:54<26:13:58,  3.87it/s]
  2%|▏         | 6301/371472 [29:54<26:54:32,  3.77it/s]
  2%|▏         | 6302/371472 [29:54<26:20:41,  3.85it/s]
  2%|▏         | 6303/371472 [29:54<27:30:35,  3.69it/s]
  2%|▏         | 6304/371472 [29:55<27:10:51,  3.73it/s]
  2%|▏         | 6305/371472 [29:55<29:58:15,  3.38it/s]
  2%|▏         | 6306/371472 [29:55<30:14:16,  3.35it/s]
  2%|▏         | 6307/371472 [29:56<30:51:11,  3.29it/s]
  2%|▏         | 6308/371472 [29:56<30:53:59,  3.28it/s]
  2%|▏         | 6309/371472 [29:56<31:02:05,  3.27it/s]
  2%|▏         | 6310/371472 [29:56<29:45:51,  3.41it/s]
  2%|▏         | 6311/371472 [29:57<30:36:22,  3.31it/s]
  2%|▏         | 6312/371472 [29:57<29:10:21,  3.48it/s]
  2%|▏         | 6313/371472 [29:57<30:09:33,  3.36it/s]
  2%|▏         | 6314/371472 [29:58<29:34:32,  3.43it/s]
  2%|▏         | 6315/371472 [29:58<28:58:26,  3.50it/s]
  2%|▏         | 6316/371472 [29:58<28:33:44,  3.55it/s]
  2%|▏         | 6317/371472 [29:58<29:04:58,  3.49it/s]
  2%|▏         | 6318/371472 [29:59<28:17:03,  3.59it/s]
  2%|▏         | 6319/371472 [29:59<27:28:08,  3.69it/s]
  2%|▏         | 6320/371472 [29:59<28:54:59,  3.51it/s]
                                                        
{'loss': 5.1938, 'learning_rate': 9.851645155034582e-07, 'epoch': 0.27}

  2%|▏         | 6320/371472 [29:59<28:54:59,  3.51it/s]
  2%|▏         | 6321/371472 [30:00<28:32:54,  3.55it/s]
  2%|▏         | 6322/371472 [30:00<27:48:56,  3.65it/s]
  2%|▏         | 6323/371472 [30:00<27:09:50,  3.73it/s]
  2%|▏         | 6324/371472 [30:00<28:59:01,  3.50it/s]
  2%|▏         | 6325/371472 [30:01<29:32:16,  3.43it/s]
  2%|▏         | 6326/371472 [30:01<29:15:54,  3.47it/s]
  2%|▏         | 6327/371472 [30:01<28:41:07,  3.54it/s]
  2%|▏         | 6328/371472 [30:02<28:50:04,  3.52it/s]
  2%|▏         | 6329/371472 [30:02<30:25:27,  3.33it/s]
  2%|▏         | 6330/371472 [30:02<29:08:06,  3.48it/s]
  2%|▏         | 6331/371472 [30:02<28:23:22,  3.57it/s]
  2%|▏         | 6332/371472 [30:03<27:39:06,  3.67it/s]
  2%|▏         | 6333/371472 [30:03<28:07:07,  3.61it/s]
  2%|▏         | 6334/371472 [30:03<27:13:51,  3.72it/s]
  2%|▏         | 6335/371472 [30:04<28:13:01,  3.59it/s]
  2%|▏         | 6336/371472 [30:04<28:59:36,  3.50it/s]
  2%|▏         | 6337/371472 [30:04<28:04:37,  3.61it/s]
  2%|▏         | 6338/371472 [30:04<27:35:46,  3.68it/s]
  2%|▏         | 6339/371472 [30:05<28:04:35,  3.61it/s]
  2%|▏         | 6340/371472 [30:05<27:11:02,  3.73it/s]
                                                        
{'loss': 5.0296, 'learning_rate': 9.851160335279795e-07, 'epoch': 0.27}

  2%|▏         | 6340/371472 [30:05<27:11:02,  3.73it/s]
  2%|▏         | 6341/371472 [30:05<30:49:39,  3.29it/s]
  2%|▏         | 6342/371472 [30:05<29:17:37,  3.46it/s]
  2%|▏         | 6343/371472 [30:06<29:11:35,  3.47it/s]
  2%|▏         | 6344/371472 [30:06<29:34:00,  3.43it/s]
  2%|▏         | 6345/371472 [30:06<29:26:23,  3.45it/s]
  2%|▏         | 6346/371472 [30:07<27:45:58,  3.65it/s]
  2%|▏         | 6347/371472 [30:07<28:58:21,  3.50it/s]
  2%|▏         | 6348/371472 [30:07<30:05:50,  3.37it/s]
  2%|▏         | 6349/371472 [30:08<30:30:20,  3.32it/s]
  2%|▏         | 6350/371472 [30:08<29:40:11,  3.42it/s]
  2%|▏         | 6351/371472 [30:08<31:13:41,  3.25it/s]
  2%|▏         | 6352/371472 [30:08<29:22:09,  3.45it/s]
  2%|▏         | 6353/371472 [30:09<29:16:11,  3.47it/s]
  2%|▏         | 6354/371472 [30:09<29:35:33,  3.43it/s]
  2%|▏         | 6355/371472 [30:09<30:02:44,  3.38it/s]
  2%|▏         | 6356/371472 [30:10<29:15:11,  3.47it/s]
  2%|▏         | 6357/371472 [30:10<30:12:03,  3.36it/s]
  2%|▏         | 6358/371472 [30:10<30:24:25,  3.34it/s]
  2%|▏         | 6359/371472 [30:11<30:45:52,  3.30it/s]
  2%|▏         | 6360/371472 [30:11<29:29:03,  3.44it/s]
                                                        
{'loss': 4.9956, 'learning_rate': 9.850675515525006e-07, 'epoch': 0.27}

  2%|▏         | 6360/371472 [30:11<29:29:03,  3.44it/s]
  2%|▏         | 6361/371472 [30:11<28:39:19,  3.54it/s]
  2%|▏         | 6362/371472 [30:11<30:01:19,  3.38it/s]
  2%|▏         | 6363/371472 [30:12<29:20:22,  3.46it/s]
  2%|▏         | 6364/371472 [30:12<29:43:51,  3.41it/s]
  2%|▏         | 6365/371472 [30:12<29:30:33,  3.44it/s]
  2%|▏         | 6366/371472 [30:13<28:52:56,  3.51it/s]
  2%|▏         | 6367/371472 [30:13<28:27:26,  3.56it/s]
  2%|▏         | 6368/371472 [30:13<28:36:09,  3.55it/s]
  2%|▏         | 6369/371472 [30:13<29:32:51,  3.43it/s]
  2%|▏         | 6370/371472 [30:14<27:41:52,  3.66it/s]
  2%|▏         | 6371/371472 [30:14<28:10:28,  3.60it/s]
  2%|▏         | 6372/371472 [30:14<27:25:17,  3.70it/s]
  2%|▏         | 6373/371472 [30:14<29:09:06,  3.48it/s]
  2%|▏         | 6374/371472 [30:15<31:40:58,  3.20it/s]
  2%|▏         | 6375/371472 [30:15<30:37:02,  3.31it/s]
  2%|▏         | 6376/371472 [30:15<29:18:44,  3.46it/s]
  2%|▏         | 6377/371472 [30:16<29:31:55,  3.43it/s]
  2%|▏         | 6378/371472 [30:16<29:03:12,  3.49it/s]
  2%|▏         | 6379/371472 [30:16<27:48:18,  3.65it/s]
  2%|▏         | 6380/371472 [30:16<27:38:22,  3.67it/s]
                                                        
{'loss': 5.1587, 'learning_rate': 9.850190695770216e-07, 'epoch': 0.27}

  2%|▏         | 6380/371472 [30:16<27:38:22,  3.67it/s]
  2%|▏         | 6381/371472 [30:17<28:18:30,  3.58it/s]
  2%|▏         | 6382/371472 [30:17<27:17:13,  3.72it/s]
  2%|▏         | 6383/371472 [30:17<27:20:15,  3.71it/s]
  2%|▏         | 6384/371472 [30:18<27:22:54,  3.70it/s]
  2%|▏         | 6385/371472 [30:18<27:43:42,  3.66it/s]
  2%|▏         | 6386/371472 [30:18<27:02:55,  3.75it/s]
  2%|▏         | 6387/371472 [30:18<27:22:53,  3.70it/s]
  2%|▏         | 6388/371472 [30:19<28:15:29,  3.59it/s]
  2%|▏         | 6389/371472 [30:19<28:06:27,  3.61it/s]
  2%|▏         | 6390/371472 [30:19<28:34:58,  3.55it/s]
  2%|▏         | 6391/371472 [30:19<27:55:59,  3.63it/s]
  2%|▏         | 6392/371472 [30:20<28:47:43,  3.52it/s]
  2%|▏         | 6393/371472 [30:20<29:10:20,  3.48it/s]
  2%|▏         | 6394/371472 [30:20<28:50:23,  3.52it/s]
  2%|▏         | 6395/371472 [30:21<28:14:30,  3.59it/s]
  2%|▏         | 6396/371472 [30:21<30:10:27,  3.36it/s]
  2%|▏         | 6397/371472 [30:21<29:09:23,  3.48it/s]
  2%|▏         | 6398/371472 [30:21<27:53:04,  3.64it/s]
  2%|▏         | 6399/371472 [30:22<27:15:04,  3.72it/s]
  2%|▏         | 6400/371472 [30:22<27:27:26,  3.69it/s]
                                                        
{'loss': 5.0578, 'learning_rate': 9.849705876015427e-07, 'epoch': 0.28}

  2%|▏         | 6400/371472 [30:22<27:27:26,  3.69it/s]
  2%|▏         | 6401/371472 [30:22<28:14:34,  3.59it/s]
  2%|▏         | 6402/371472 [30:23<27:11:31,  3.73it/s]
  2%|▏         | 6403/371472 [30:23<28:21:19,  3.58it/s]
  2%|▏         | 6404/371472 [30:23<29:02:16,  3.49it/s]
  2%|▏         | 6405/371472 [30:23<28:49:23,  3.52it/s]
  2%|▏         | 6406/371472 [30:24<29:08:26,  3.48it/s]
  2%|▏         | 6407/371472 [30:24<28:18:48,  3.58it/s]
  2%|▏         | 6408/371472 [30:24<31:16:30,  3.24it/s]
  2%|▏         | 6409/371472 [30:25<29:45:47,  3.41it/s]
  2%|▏         | 6410/371472 [30:25<29:15:09,  3.47it/s]
  2%|▏         | 6411/371472 [30:25<30:02:40,  3.38it/s]
  2%|▏         | 6412/371472 [30:26<30:59:57,  3.27it/s]
  2%|▏         | 6413/371472 [30:26<30:34:22,  3.32it/s]
  2%|▏         | 6414/371472 [30:26<29:15:09,  3.47it/s]
  2%|▏         | 6415/371472 [30:26<28:41:34,  3.53it/s]
  2%|▏         | 6416/371472 [30:27<27:49:40,  3.64it/s]
  2%|▏         | 6417/371472 [30:27<27:38:48,  3.67it/s]
  2%|▏         | 6418/371472 [30:27<28:04:26,  3.61it/s]
  2%|▏         | 6419/371472 [30:27<28:07:26,  3.61it/s]
  2%|▏         | 6420/371472 [30:28<29:58:46,  3.38it/s]
                                                        
{'loss': 4.6687, 'learning_rate': 9.849221056260638e-07, 'epoch': 0.28}

  2%|▏         | 6420/371472 [30:28<29:58:46,  3.38it/s]
  2%|▏         | 6421/371472 [30:28<30:43:48,  3.30it/s]
  2%|▏         | 6422/371472 [30:28<29:37:52,  3.42it/s]
  2%|▏         | 6423/371472 [30:29<29:04:41,  3.49it/s]
  2%|▏         | 6424/371472 [30:29<28:49:08,  3.52it/s]
  2%|▏         | 6425/371472 [30:29<30:56:51,  3.28it/s]
  2%|▏         | 6426/371472 [30:30<35:38:31,  2.84it/s]
  2%|▏         | 6427/371472 [30:30<33:03:04,  3.07it/s]
  2%|▏         | 6428/371472 [30:30<31:04:33,  3.26it/s]
  2%|▏         | 6429/371472 [30:31<29:35:52,  3.43it/s]
  2%|▏         | 6430/371472 [30:31<28:11:15,  3.60it/s]
  2%|▏         | 6431/371472 [30:31<27:55:36,  3.63it/s]
  2%|▏         | 6432/371472 [30:31<28:29:59,  3.56it/s]
  2%|▏         | 6433/371472 [30:32<28:39:18,  3.54it/s]
  2%|▏         | 6434/371472 [30:32<29:59:17,  3.38it/s]
  2%|▏         | 6435/371472 [30:32<30:58:23,  3.27it/s]
  2%|▏         | 6436/371472 [30:33<30:24:18,  3.33it/s]
  2%|▏         | 6437/371472 [30:33<29:54:19,  3.39it/s]
  2%|▏         | 6438/371472 [30:33<29:45:00,  3.41it/s]
  2%|▏         | 6439/371472 [30:33<29:40:19,  3.42it/s]
  2%|▏         | 6440/371472 [30:34<29:09:09,  3.48it/s]
                                                        
{'loss': 5.0046, 'learning_rate': 9.84873623650585e-07, 'epoch': 0.28}

  2%|▏         | 6440/371472 [30:34<29:09:09,  3.48it/s]
  2%|▏         | 6441/371472 [30:34<30:43:09,  3.30it/s]
  2%|▏         | 6442/371472 [30:34<29:46:12,  3.41it/s]
  2%|▏         | 6443/371472 [30:35<31:31:24,  3.22it/s]
  2%|▏         | 6444/371472 [30:35<32:25:27,  3.13it/s]
  2%|▏         | 6445/371472 [30:35<31:33:38,  3.21it/s]
  2%|▏         | 6446/371472 [30:36<31:43:29,  3.20it/s]
  2%|▏         | 6447/371472 [30:36<29:42:50,  3.41it/s]
  2%|▏         | 6448/371472 [30:36<28:48:28,  3.52it/s]
  2%|▏         | 6449/371472 [30:36<28:22:32,  3.57it/s]
  2%|▏         | 6450/371472 [30:37<27:28:52,  3.69it/s]
  2%|▏         | 6451/371472 [30:37<27:30:10,  3.69it/s]
  2%|▏         | 6452/371472 [30:37<28:24:01,  3.57it/s]
  2%|▏         | 6453/371472 [30:38<28:35:45,  3.55it/s]
  2%|▏         | 6454/371472 [30:38<27:31:03,  3.68it/s]
  2%|▏         | 6455/371472 [30:38<27:19:28,  3.71it/s]
  2%|▏         | 6456/371472 [30:38<28:43:38,  3.53it/s]
  2%|▏         | 6457/371472 [30:39<28:02:38,  3.62it/s]
  2%|▏         | 6458/371472 [30:39<28:42:25,  3.53it/s]
  2%|▏         | 6459/371472 [30:39<29:08:32,  3.48it/s]
  2%|▏         | 6460/371472 [30:40<31:33:59,  3.21it/s]
                                                        
{'loss': 4.9388, 'learning_rate': 9.848251416751061e-07, 'epoch': 0.28}

  2%|▏         | 6460/371472 [30:40<31:33:59,  3.21it/s]
  2%|▏         | 6461/371472 [30:40<29:46:47,  3.40it/s]
  2%|▏         | 6462/371472 [30:40<29:25:57,  3.44it/s]
  2%|▏         | 6463/371472 [30:40<28:38:08,  3.54it/s]
  2%|▏         | 6464/371472 [30:41<28:59:47,  3.50it/s]
  2%|▏         | 6465/371472 [30:41<27:55:59,  3.63it/s]
  2%|▏         | 6466/371472 [30:41<28:35:36,  3.55it/s]
  2%|▏         | 6467/371472 [30:41<27:49:06,  3.64it/s]
  2%|▏         | 6468/371472 [30:42<26:41:17,  3.80it/s]
  2%|▏         | 6469/371472 [30:42<28:46:59,  3.52it/s]
  2%|▏         | 6470/371472 [30:42<28:14:33,  3.59it/s]
  2%|▏         | 6471/371472 [30:43<27:00:47,  3.75it/s]
  2%|▏         | 6472/371472 [30:43<27:27:05,  3.69it/s]
  2%|▏         | 6473/371472 [30:43<29:39:01,  3.42it/s]
  2%|▏         | 6474/371472 [30:43<28:46:48,  3.52it/s]
  2%|▏         | 6475/371472 [30:44<29:10:10,  3.48it/s]
  2%|▏         | 6476/371472 [30:44<28:43:56,  3.53it/s]
  2%|▏         | 6477/371472 [30:44<28:12:14,  3.59it/s]
  2%|▏         | 6478/371472 [30:45<27:29:47,  3.69it/s]
  2%|▏         | 6479/371472 [30:45<27:29:03,  3.69it/s]
  2%|▏         | 6480/371472 [30:45<27:49:12,  3.64it/s]
                                                        
{'loss': 5.1524, 'learning_rate': 9.847766596996272e-07, 'epoch': 0.28}

  2%|▏         | 6480/371472 [30:45<27:49:12,  3.64it/s]
  2%|▏         | 6481/371472 [30:45<32:24:38,  3.13it/s]
  2%|▏         | 6482/371472 [30:46<30:41:17,  3.30it/s]
  2%|▏         | 6483/371472 [30:46<30:01:00,  3.38it/s]
  2%|▏         | 6484/371472 [30:46<28:37:23,  3.54it/s]
  2%|▏         | 6485/371472 [30:47<28:59:02,  3.50it/s]
  2%|▏         | 6486/371472 [30:47<28:11:43,  3.60it/s]
  2%|▏         | 6487/371472 [30:47<29:36:49,  3.42it/s]
  2%|▏         | 6488/371472 [30:47<29:22:48,  3.45it/s]
  2%|▏         | 6489/371472 [30:48<27:56:58,  3.63it/s]
  2%|▏         | 6490/371472 [30:48<28:09:52,  3.60it/s]
  2%|▏         | 6491/371472 [30:48<28:08:33,  3.60it/s]
  2%|▏         | 6492/371472 [30:49<28:35:30,  3.55it/s]
  2%|▏         | 6493/371472 [30:49<30:02:20,  3.38it/s]
  2%|▏         | 6494/371472 [30:49<28:13:43,  3.59it/s]
  2%|▏         | 6495/371472 [30:49<27:33:03,  3.68it/s]
  2%|▏         | 6496/371472 [30:50<27:56:36,  3.63it/s]
  2%|▏         | 6497/371472 [30:50<26:52:42,  3.77it/s]
  2%|▏         | 6498/371472 [30:50<28:01:48,  3.62it/s]
  2%|▏         | 6499/371472 [30:50<28:24:27,  3.57it/s]
  2%|▏         | 6500/371472 [30:51<27:40:31,  3.66it/s]
                                                        
{'loss': 5.0729, 'learning_rate': 9.847281777241483e-07, 'epoch': 0.28}

  2%|▏         | 6500/371472 [30:51<27:40:31,  3.66it/s]
  2%|▏         | 6501/371472 [30:51<26:55:37,  3.77it/s]
  2%|▏         | 6502/371472 [30:51<27:01:38,  3.75it/s]
  2%|▏         | 6503/371472 [30:52<26:44:30,  3.79it/s]
  2%|▏         | 6504/371472 [30:52<27:05:43,  3.74it/s]
  2%|▏         | 6505/371472 [30:52<29:07:29,  3.48it/s]
  2%|▏         | 6506/371472 [30:52<27:41:24,  3.66it/s]
  2%|▏         | 6507/371472 [30:53<28:37:13,  3.54it/s]
  2%|▏         | 6508/371472 [30:53<28:16:11,  3.59it/s]
  2%|▏         | 6509/371472 [30:53<29:35:51,  3.43it/s]
  2%|▏         | 6510/371472 [30:53<28:04:22,  3.61it/s]
  2%|▏         | 6511/371472 [30:54<27:54:28,  3.63it/s]
  2%|▏         | 6512/371472 [30:54<27:21:56,  3.70it/s]
  2%|▏         | 6513/371472 [30:54<27:05:42,  3.74it/s]
  2%|▏         | 6514/371472 [30:55<27:49:25,  3.64it/s]
  2%|▏         | 6515/371472 [30:55<27:38:50,  3.67it/s]
  2%|▏         | 6516/371472 [30:55<27:21:25,  3.71it/s]
  2%|▏         | 6517/371472 [30:55<26:18:05,  3.85it/s]
  2%|▏         | 6518/371472 [30:56<26:22:36,  3.84it/s]
  2%|▏         | 6519/371472 [30:56<25:58:50,  3.90it/s]
  2%|▏         | 6520/371472 [30:56<29:37:03,  3.42it/s]
                                                        
{'loss': 5.1614, 'learning_rate': 9.846796957486693e-07, 'epoch': 0.28}

  2%|▏         | 6520/371472 [30:56<29:37:03,  3.42it/s]
  2%|▏         | 6521/371472 [30:56<27:48:57,  3.64it/s]
  2%|▏         | 6522/371472 [30:57<27:46:11,  3.65it/s]
  2%|▏         | 6523/371472 [30:57<27:49:22,  3.64it/s]
  2%|▏         | 6524/371472 [30:57<27:00:15,  3.75it/s]
  2%|▏         | 6525/371472 [30:58<28:22:04,  3.57it/s]
  2%|▏         | 6526/371472 [30:58<28:27:48,  3.56it/s]
  2%|▏         | 6527/371472 [30:58<28:35:26,  3.55it/s]
  2%|▏         | 6528/371472 [30:58<29:31:56,  3.43it/s]
  2%|▏         | 6529/371472 [30:59<28:04:53,  3.61it/s]
  2%|▏         | 6530/371472 [30:59<27:41:08,  3.66it/s]
  2%|▏         | 6531/371472 [30:59<27:27:57,  3.69it/s]
  2%|▏         | 6532/371472 [30:59<27:25:25,  3.70it/s]
  2%|▏         | 6533/371472 [31:00<27:43:25,  3.66it/s]
  2%|▏         | 6534/371472 [31:00<27:37:19,  3.67it/s]
  2%|▏         | 6535/371472 [31:00<27:20:51,  3.71it/s]
  2%|▏         | 6536/371472 [31:01<27:04:43,  3.74it/s]
  2%|▏         | 6537/371472 [31:01<26:42:44,  3.79it/s]
  2%|▏         | 6538/371472 [31:01<27:03:07,  3.75it/s]
  2%|▏         | 6539/371472 [31:01<28:44:50,  3.53it/s]
  2%|▏         | 6540/371472 [31:02<31:36:05,  3.21it/s]
                                                        
{'loss': 5.0912, 'learning_rate': 9.846312137731906e-07, 'epoch': 0.28}

  2%|▏         | 6540/371472 [31:02<31:36:05,  3.21it/s]
  2%|▏         | 6541/371472 [31:02<30:27:08,  3.33it/s]
  2%|▏         | 6542/371472 [31:02<29:51:22,  3.40it/s]
  2%|▏         | 6543/371472 [31:03<28:35:24,  3.55it/s]
  2%|▏         | 6544/371472 [31:03<28:23:33,  3.57it/s]
  2%|▏         | 6545/371472 [31:03<29:11:39,  3.47it/s]
  2%|▏         | 6546/371472 [31:03<28:45:50,  3.52it/s]
  2%|▏         | 6547/371472 [31:04<29:45:58,  3.41it/s]
  2%|▏         | 6548/371472 [31:04<30:49:22,  3.29it/s]
  2%|▏         | 6549/371472 [31:04<32:21:56,  3.13it/s]
  2%|▏         | 6550/371472 [31:05<30:13:32,  3.35it/s]
  2%|▏         | 6551/371472 [31:05<28:58:10,  3.50it/s]
  2%|▏         | 6552/371472 [31:05<28:32:06,  3.55it/s]
  2%|▏         | 6553/371472 [31:05<27:30:58,  3.68it/s]
  2%|▏         | 6554/371472 [31:06<28:52:40,  3.51it/s]
  2%|▏         | 6555/371472 [31:06<27:28:51,  3.69it/s]
  2%|▏         | 6556/371472 [31:06<26:56:30,  3.76it/s]
  2%|▏         | 6557/371472 [31:07<26:28:26,  3.83it/s]
  2%|▏         | 6558/371472 [31:07<26:16:32,  3.86it/s]
  2%|▏         | 6559/371472 [31:07<26:04:30,  3.89it/s]
  2%|▏         | 6560/371472 [31:07<25:57:04,  3.91it/s]
                                                        
{'loss': 4.8363, 'learning_rate': 9.845827317977115e-07, 'epoch': 0.28}

  2%|▏         | 6560/371472 [31:07<25:57:04,  3.91it/s]
  2%|▏         | 6561/371472 [31:08<27:42:21,  3.66it/s]
  2%|▏         | 6562/371472 [31:08<26:54:02,  3.77it/s]
  2%|▏         | 6563/371472 [31:08<27:51:34,  3.64it/s]
  2%|▏         | 6564/371472 [31:09<31:09:50,  3.25it/s]
  2%|▏         | 6565/371472 [31:09<29:54:06,  3.39it/s]
  2%|▏         | 6566/371472 [31:09<29:15:42,  3.46it/s]
  2%|▏         | 6567/371472 [31:09<29:41:50,  3.41it/s]
  2%|▏         | 6568/371472 [31:10<30:36:49,  3.31it/s]
  2%|▏         | 6569/371472 [31:10<29:09:45,  3.48it/s]
  2%|▏         | 6570/371472 [31:10<28:46:17,  3.52it/s]
  2%|▏         | 6571/371472 [31:11<28:17:12,  3.58it/s]
  2%|▏         | 6572/371472 [31:11<28:42:15,  3.53it/s]
  2%|▏         | 6573/371472 [31:11<29:20:46,  3.45it/s]
  2%|▏         | 6574/371472 [31:11<28:10:45,  3.60it/s]
  2%|▏         | 6575/371472 [31:12<27:50:26,  3.64it/s]
  2%|▏         | 6576/371472 [31:12<28:45:25,  3.52it/s]
  2%|▏         | 6577/371472 [31:12<28:33:46,  3.55it/s]
  2%|▏         | 6578/371472 [31:12<28:11:05,  3.60it/s]
  2%|▏         | 6579/371472 [31:13<27:05:41,  3.74it/s]
  2%|▏         | 6580/371472 [31:13<28:04:50,  3.61it/s]
                                                        
{'loss': 5.1497, 'learning_rate': 9.845342498222328e-07, 'epoch': 0.28}

  2%|▏         | 6580/371472 [31:13<28:04:50,  3.61it/s]
  2%|▏         | 6581/371472 [31:13<27:06:56,  3.74it/s]
  2%|▏         | 6582/371472 [31:14<27:21:34,  3.70it/s]
  2%|▏         | 6583/371472 [31:14<27:25:17,  3.70it/s]
  2%|▏         | 6584/371472 [31:14<28:05:01,  3.61it/s]
  2%|▏         | 6585/371472 [31:14<27:21:44,  3.70it/s]
  2%|▏         | 6586/371472 [31:15<27:13:22,  3.72it/s]
  2%|▏         | 6587/371472 [31:15<27:47:40,  3.65it/s]
  2%|▏         | 6588/371472 [31:15<29:44:13,  3.41it/s]
  2%|▏         | 6589/371472 [31:16<29:30:27,  3.43it/s]
  2%|▏         | 6590/371472 [31:16<33:17:09,  3.05it/s]
  2%|▏         | 6591/371472 [31:16<31:11:46,  3.25it/s]
  2%|▏         | 6592/371472 [31:16<30:07:43,  3.36it/s]
  2%|▏         | 6593/371472 [31:17<30:49:24,  3.29it/s]
  2%|▏         | 6594/371472 [31:17<29:26:59,  3.44it/s]
  2%|▏         | 6595/371472 [31:17<28:34:22,  3.55it/s]
  2%|▏         | 6596/371472 [31:18<28:46:22,  3.52it/s]
  2%|▏         | 6597/371472 [31:18<27:55:38,  3.63it/s]
  2%|▏         | 6598/371472 [31:18<27:23:29,  3.70it/s]
  2%|▏         | 6599/371472 [31:18<30:00:59,  3.38it/s]
  2%|▏         | 6600/371472 [31:19<28:57:26,  3.50it/s]
                                                        
{'loss': 5.1407, 'learning_rate': 9.844857678467538e-07, 'epoch': 0.28}

  2%|▏         | 6600/371472 [31:19<28:57:26,  3.50it/s]
  2%|▏         | 6601/371472 [31:19<31:38:17,  3.20it/s]
  2%|▏         | 6602/371472 [31:19<30:03:27,  3.37it/s]
  2%|▏         | 6603/371472 [31:20<30:37:54,  3.31it/s]
  2%|▏         | 6604/371472 [31:20<29:49:49,  3.40it/s]
  2%|▏         | 6605/371472 [31:20<28:17:58,  3.58it/s]
  2%|▏         | 6606/371472 [31:20<27:55:24,  3.63it/s]
  2%|▏         | 6607/371472 [31:21<27:49:28,  3.64it/s]
  2%|▏         | 6608/371472 [31:21<28:09:00,  3.60it/s]
  2%|▏         | 6609/371472 [31:21<28:07:42,  3.60it/s]
  2%|▏         | 6610/371472 [31:22<28:59:03,  3.50it/s]
  2%|▏         | 6611/371472 [31:22<28:21:19,  3.57it/s]
  2%|▏         | 6612/371472 [31:22<27:18:34,  3.71it/s]
  2%|▏         | 6613/371472 [31:22<27:22:26,  3.70it/s]
  2%|▏         | 6614/371472 [31:23<26:11:54,  3.87it/s]
  2%|▏         | 6615/371472 [31:23<26:16:24,  3.86it/s]
  2%|▏         | 6616/371472 [31:23<26:24:16,  3.84it/s]
  2%|▏         | 6617/371472 [31:23<26:11:13,  3.87it/s]
  2%|▏         | 6618/371472 [31:24<26:18:25,  3.85it/s]
  2%|▏         | 6619/371472 [31:24<26:55:56,  3.76it/s]
  2%|▏         | 6620/371472 [31:24<26:48:56,  3.78it/s]
                                                        
{'loss': 5.1137, 'learning_rate': 9.84437285871275e-07, 'epoch': 0.29}

  2%|▏         | 6620/371472 [31:24<26:48:56,  3.78it/s]
  2%|▏         | 6621/371472 [31:24<26:39:42,  3.80it/s]
  2%|▏         | 6622/371472 [31:25<27:13:05,  3.72it/s]
  2%|▏         | 6623/371472 [31:25<26:45:45,  3.79it/s]
  2%|▏         | 6624/371472 [31:25<26:05:11,  3.89it/s]
  2%|▏         | 6625/371472 [31:26<26:01:23,  3.89it/s]
  2%|▏         | 6626/371472 [31:26<26:07:35,  3.88it/s]
  2%|▏         | 6627/371472 [31:26<27:31:22,  3.68it/s]
  2%|▏         | 6628/371472 [31:26<27:46:01,  3.65it/s]
  2%|▏         | 6629/371472 [31:27<28:27:43,  3.56it/s]
  2%|▏         | 6630/371472 [31:27<28:26:17,  3.56it/s]
  2%|▏         | 6631/371472 [31:27<29:14:15,  3.47it/s]
  2%|▏         | 6632/371472 [31:28<30:18:20,  3.34it/s]
  2%|▏         | 6633/371472 [31:28<30:50:43,  3.29it/s]
  2%|▏         | 6634/371472 [31:28<28:57:59,  3.50it/s]
  2%|▏         | 6635/371472 [31:28<30:09:14,  3.36it/s]
  2%|▏         | 6636/371472 [31:29<29:23:57,  3.45it/s]
  2%|▏         | 6637/371472 [31:29<31:24:44,  3.23it/s]
  2%|▏         | 6638/371472 [31:29<30:21:31,  3.34it/s]
  2%|▏         | 6639/371472 [31:30<29:21:25,  3.45it/s]
  2%|▏         | 6640/371472 [31:30<30:13:32,  3.35it/s]
                                                        
{'loss': 4.9547, 'learning_rate': 9.84388803895796e-07, 'epoch': 0.29}

  2%|▏         | 6640/371472 [31:30<30:13:32,  3.35it/s]
  2%|▏         | 6641/371472 [31:30<30:55:32,  3.28it/s]
  2%|▏         | 6642/371472 [31:30<29:11:24,  3.47it/s]
  2%|▏         | 6643/371472 [31:31<28:15:07,  3.59it/s]
  2%|▏         | 6644/371472 [31:31<27:10:52,  3.73it/s]
  2%|▏         | 6645/371472 [31:31<27:00:48,  3.75it/s]
  2%|▏         | 6646/371472 [31:32<29:47:13,  3.40it/s]
  2%|▏         | 6647/371472 [31:32<29:39:25,  3.42it/s]
  2%|▏         | 6648/371472 [31:32<28:17:18,  3.58it/s]
  2%|▏         | 6649/371472 [31:32<27:45:43,  3.65it/s]
  2%|▏         | 6650/371472 [31:33<27:45:59,  3.65it/s]
  2%|▏         | 6651/371472 [31:33<27:06:11,  3.74it/s]
  2%|▏         | 6652/371472 [31:33<27:11:17,  3.73it/s]
  2%|▏         | 6653/371472 [31:33<27:37:03,  3.67it/s]
  2%|▏         | 6654/371472 [31:34<28:13:23,  3.59it/s]
  2%|▏         | 6655/371472 [31:34<27:37:39,  3.67it/s]
  2%|▏         | 6656/371472 [31:34<27:49:07,  3.64it/s]
  2%|▏         | 6657/371472 [31:35<26:56:03,  3.76it/s]
  2%|▏         | 6658/371472 [31:35<26:30:40,  3.82it/s]
  2%|▏         | 6659/371472 [31:35<27:39:26,  3.66it/s]
  2%|▏         | 6660/371472 [31:35<28:56:10,  3.50it/s]
                                                        
{'loss': 5.0116, 'learning_rate': 9.84340321920317e-07, 'epoch': 0.29}

  2%|▏         | 6660/371472 [31:35<28:56:10,  3.50it/s]
  2%|▏         | 6661/371472 [31:36<30:10:15,  3.36it/s]
  2%|▏         | 6662/371472 [31:36<28:41:31,  3.53it/s]
  2%|▏         | 6663/371472 [31:36<28:59:35,  3.50it/s]
  2%|▏         | 6664/371472 [31:37<28:22:58,  3.57it/s]
  2%|▏         | 6665/371472 [31:37<31:45:16,  3.19it/s]
  2%|▏         | 6666/371472 [31:37<29:57:23,  3.38it/s]
  2%|▏         | 6667/371472 [31:37<28:58:15,  3.50it/s]
  2%|▏         | 6668/371472 [31:38<27:46:10,  3.65it/s]
  2%|▏         | 6669/371472 [31:38<27:40:57,  3.66it/s]
  2%|▏         | 6670/371472 [31:38<28:03:29,  3.61it/s]
  2%|▏         | 6671/371472 [31:39<28:27:47,  3.56it/s]
  2%|▏         | 6672/371472 [31:39<29:25:42,  3.44it/s]
  2%|▏         | 6673/371472 [31:39<28:55:52,  3.50it/s]
  2%|▏         | 6674/371472 [31:39<29:01:35,  3.49it/s]
  2%|▏         | 6675/371472 [31:40<28:02:50,  3.61it/s]
  2%|▏         | 6676/371472 [31:40<27:47:32,  3.65it/s]
  2%|▏         | 6677/371472 [31:40<27:34:15,  3.68it/s]
  2%|▏         | 6678/371472 [31:40<26:46:31,  3.78it/s]
  2%|▏         | 6679/371472 [31:41<28:16:56,  3.58it/s]
  2%|▏         | 6680/371472 [31:41<27:46:16,  3.65it/s]
                                                        
{'loss': 5.0545, 'learning_rate': 9.842918399448383e-07, 'epoch': 0.29}

  2%|▏         | 6680/371472 [31:41<27:46:16,  3.65it/s]
  2%|▏         | 6681/371472 [31:41<27:51:33,  3.64it/s]
  2%|▏         | 6682/371472 [31:42<30:03:05,  3.37it/s]
  2%|▏         | 6683/371472 [31:42<29:12:20,  3.47it/s]
  2%|▏         | 6684/371472 [31:42<28:47:24,  3.52it/s]
  2%|▏         | 6685/371472 [31:43<28:45:17,  3.52it/s]
  2%|▏         | 6686/371472 [31:43<27:30:05,  3.68it/s]
  2%|▏         | 6687/371472 [31:43<27:20:21,  3.71it/s]
  2%|▏         | 6688/371472 [31:43<29:46:45,  3.40it/s]
  2%|▏         | 6689/371472 [31:44<30:50:55,  3.28it/s]
  2%|▏         | 6690/371472 [31:44<34:22:23,  2.95it/s]
  2%|▏         | 6691/371472 [31:44<34:01:19,  2.98it/s]
  2%|▏         | 6692/371472 [31:45<32:02:24,  3.16it/s]
  2%|▏         | 6693/371472 [31:45<30:55:45,  3.28it/s]
  2%|▏         | 6694/371472 [31:45<30:55:20,  3.28it/s]
  2%|▏         | 6695/371472 [31:46<29:12:43,  3.47it/s]
  2%|▏         | 6696/371472 [31:46<28:33:32,  3.55it/s]
  2%|▏         | 6697/371472 [31:46<29:32:32,  3.43it/s]
  2%|▏         | 6698/371472 [31:46<30:15:06,  3.35it/s]
  2%|▏         | 6699/371472 [31:47<28:31:22,  3.55it/s]
  2%|▏         | 6700/371472 [31:47<28:37:12,  3.54it/s]
                                                        
{'loss': 4.8564, 'learning_rate': 9.842433579693592e-07, 'epoch': 0.29}

  2%|▏         | 6700/371472 [31:47<28:37:12,  3.54it/s]
  2%|▏         | 6701/371472 [31:47<27:25:31,  3.69it/s]
  2%|▏         | 6702/371472 [31:47<27:26:43,  3.69it/s]
  2%|▏         | 6703/371472 [31:48<27:41:54,  3.66it/s]
  2%|▏         | 6704/371472 [31:48<27:00:02,  3.75it/s]
  2%|▏         | 6705/371472 [31:48<27:18:51,  3.71it/s]
  2%|▏         | 6706/371472 [31:49<26:34:38,  3.81it/s]
  2%|▏         | 6707/371472 [31:49<26:32:22,  3.82it/s]
  2%|▏         | 6708/371472 [31:49<29:15:31,  3.46it/s]
  2%|▏         | 6709/371472 [31:49<29:05:44,  3.48it/s]
  2%|▏         | 6710/371472 [31:50<29:30:52,  3.43it/s]
  2%|▏         | 6711/371472 [31:50<29:38:09,  3.42it/s]
  2%|▏         | 6712/371472 [31:50<28:54:04,  3.51it/s]
  2%|▏         | 6713/371472 [31:51<29:25:09,  3.44it/s]
  2%|▏         | 6714/371472 [31:51<28:23:57,  3.57it/s]
  2%|▏         | 6715/371472 [31:51<31:07:39,  3.26it/s]
  2%|▏         | 6716/371472 [31:51<29:36:55,  3.42it/s]
  2%|▏         | 6717/371472 [31:52<28:49:22,  3.52it/s]
  2%|▏         | 6718/371472 [31:52<28:08:04,  3.60it/s]
  2%|▏         | 6719/371472 [31:52<28:07:31,  3.60it/s]
  2%|▏         | 6720/371472 [31:53<29:12:53,  3.47it/s]
                                                        
{'loss': 4.7905, 'learning_rate': 9.841948759938805e-07, 'epoch': 0.29}

  2%|▏         | 6720/371472 [31:53<29:12:53,  3.47it/s]
  2%|▏         | 6721/371472 [31:53<29:24:16,  3.45it/s]
  2%|▏         | 6722/371472 [31:53<27:59:31,  3.62it/s]
  2%|▏         | 6723/371472 [31:53<27:35:38,  3.67it/s]
  2%|▏         | 6724/371472 [31:54<26:37:39,  3.81it/s]
  2%|▏         | 6725/371472 [31:54<26:18:27,  3.85it/s]
  2%|▏         | 6726/371472 [31:54<26:15:31,  3.86it/s]
  2%|▏         | 6727/371472 [31:54<26:48:45,  3.78it/s]
  2%|▏         | 6728/371472 [31:55<26:59:50,  3.75it/s]
  2%|▏         | 6729/371472 [31:55<29:32:43,  3.43it/s]
  2%|▏         | 6730/371472 [31:55<31:37:22,  3.20it/s]
  2%|▏         | 6731/371472 [31:56<30:06:04,  3.37it/s]
  2%|▏         | 6732/371472 [31:56<31:27:15,  3.22it/s]
  2%|▏         | 6733/371472 [31:56<30:31:31,  3.32it/s]
  2%|▏         | 6734/371472 [31:57<30:51:58,  3.28it/s]
  2%|▏         | 6735/371472 [31:57<30:08:39,  3.36it/s]
  2%|▏         | 6736/371472 [31:57<30:07:29,  3.36it/s]
  2%|▏         | 6737/371472 [31:57<30:14:50,  3.35it/s]
  2%|▏         | 6738/371472 [31:58<28:52:18,  3.51it/s]
  2%|▏         | 6739/371472 [31:58<31:29:36,  3.22it/s]
  2%|▏         | 6740/371472 [31:58<30:33:21,  3.32it/s]
                                                        
{'loss': 5.0053, 'learning_rate': 9.841463940184016e-07, 'epoch': 0.29}

  2%|▏         | 6740/371472 [31:58<30:33:21,  3.32it/s]
  2%|▏         | 6741/371472 [31:59<30:39:07,  3.31it/s]
  2%|▏         | 6742/371472 [31:59<30:32:01,  3.32it/s]
  2%|▏         | 6743/371472 [31:59<28:35:57,  3.54it/s]
  2%|▏         | 6744/371472 [31:59<27:41:08,  3.66it/s]
  2%|▏         | 6745/371472 [32:00<27:23:19,  3.70it/s]
  2%|▏         | 6746/371472 [32:00<26:47:14,  3.78it/s]
  2%|▏         | 6747/371472 [32:00<27:48:59,  3.64it/s]
  2%|▏         | 6748/371472 [32:01<31:57:11,  3.17it/s]
  2%|▏         | 6749/371472 [32:01<31:59:39,  3.17it/s]
  2%|▏         | 6750/371472 [32:01<30:24:52,  3.33it/s]
  2%|▏         | 6751/371472 [32:02<29:11:57,  3.47it/s]
  2%|▏         | 6752/371472 [32:02<28:25:49,  3.56it/s]
  2%|▏         | 6753/371472 [32:02<27:57:49,  3.62it/s]
  2%|▏         | 6754/371472 [32:02<27:47:50,  3.64it/s]
  2%|▏         | 6755/371472 [32:03<28:07:56,  3.60it/s]
  2%|▏         | 6756/371472 [32:03<30:04:16,  3.37it/s]
  2%|▏         | 6757/371472 [32:03<28:30:26,  3.55it/s]
  2%|▏         | 6758/371472 [32:04<28:27:28,  3.56it/s]
  2%|▏         | 6759/371472 [32:04<28:52:20,  3.51it/s]
  2%|▏         | 6760/371472 [32:04<27:47:06,  3.65it/s]
                                                        
{'loss': 4.9103, 'learning_rate': 9.840979120429226e-07, 'epoch': 0.29}

  2%|▏         | 6760/371472 [32:04<27:47:06,  3.65it/s]
  2%|▏         | 6761/371472 [32:04<27:26:28,  3.69it/s]
  2%|▏         | 6762/371472 [32:05<27:22:11,  3.70it/s]
  2%|▏         | 6763/371472 [32:05<26:44:50,  3.79it/s]
  2%|▏         | 6764/371472 [32:05<29:37:35,  3.42it/s]
  2%|▏         | 6765/371472 [32:05<27:56:31,  3.63it/s]
  2%|▏         | 6766/371472 [32:06<28:58:44,  3.50it/s]
  2%|▏         | 6767/371472 [32:06<28:01:54,  3.61it/s]
  2%|▏         | 6768/371472 [32:06<27:49:19,  3.64it/s]
  2%|▏         | 6769/371472 [32:07<27:46:03,  3.65it/s]
  2%|▏         | 6770/371472 [32:07<27:44:16,  3.65it/s]
  2%|▏         | 6771/371472 [32:07<29:22:43,  3.45it/s]
  2%|▏         | 6772/371472 [32:08<31:57:37,  3.17it/s]
  2%|▏         | 6773/371472 [32:08<32:35:09,  3.11it/s]
  2%|▏         | 6774/371472 [32:08<30:17:33,  3.34it/s]
  2%|▏         | 6775/371472 [32:08<30:23:01,  3.33it/s]
  2%|▏         | 6776/371472 [32:09<30:14:53,  3.35it/s]
  2%|▏         | 6777/371472 [32:09<30:57:16,  3.27it/s]
  2%|▏         | 6778/371472 [32:09<30:14:55,  3.35it/s]
  2%|▏         | 6779/371472 [32:10<30:08:02,  3.36it/s]
  2%|▏         | 6780/371472 [32:10<29:14:45,  3.46it/s]
                                                        
{'loss': 4.9392, 'learning_rate': 9.840494300674437e-07, 'epoch': 0.29}

  2%|▏         | 6780/371472 [32:10<29:14:45,  3.46it/s]
  2%|▏         | 6781/371472 [32:10<28:58:52,  3.50it/s]
  2%|▏         | 6782/371472 [32:10<29:14:27,  3.46it/s]
  2%|▏         | 6783/371472 [32:11<29:29:28,  3.44it/s]
  2%|▏         | 6784/371472 [32:11<28:23:45,  3.57it/s]
  2%|▏         | 6785/371472 [32:11<29:21:42,  3.45it/s]
  2%|▏         | 6786/371472 [32:12<28:23:43,  3.57it/s]
  2%|▏         | 6787/371472 [32:12<30:12:03,  3.35it/s]
  2%|▏         | 6788/371472 [32:12<28:28:15,  3.56it/s]
  2%|▏         | 6789/371472 [32:12<27:24:32,  3.70it/s]
  2%|▏         | 6790/371472 [32:13<30:17:55,  3.34it/s]
  2%|▏         | 6791/371472 [32:13<28:49:54,  3.51it/s]
  2%|▏         | 6792/371472 [32:13<28:44:40,  3.52it/s]
  2%|▏         | 6793/371472 [32:14<27:47:31,  3.64it/s]
  2%|▏         | 6794/371472 [32:14<28:09:02,  3.60it/s]
  2%|▏         | 6795/371472 [32:14<28:11:05,  3.59it/s]
  2%|▏         | 6796/371472 [32:14<27:25:55,  3.69it/s]
  2%|▏         | 6797/371472 [32:15<27:31:26,  3.68it/s]
  2%|▏         | 6798/371472 [32:15<28:32:50,  3.55it/s]
  2%|▏         | 6799/371472 [32:15<27:14:30,  3.72it/s]
  2%|▏         | 6800/371472 [32:15<26:55:40,  3.76it/s]
                                                        
{'loss': 4.9946, 'learning_rate': 9.840009480919648e-07, 'epoch': 0.29}

  2%|▏         | 6800/371472 [32:15<26:55:40,  3.76it/s]
  2%|▏         | 6801/371472 [32:16<27:39:11,  3.66it/s]
  2%|▏         | 6802/371472 [32:16<27:46:26,  3.65it/s]
  2%|▏         | 6803/371472 [32:16<29:12:26,  3.47it/s]
  2%|▏         | 6804/371472 [32:17<28:23:33,  3.57it/s]
  2%|▏         | 6805/371472 [32:17<28:21:22,  3.57it/s]
  2%|▏         | 6806/371472 [32:17<29:13:38,  3.47it/s]
  2%|▏         | 6807/371472 [32:17<28:23:28,  3.57it/s]
  2%|▏         | 6808/371472 [32:18<27:00:21,  3.75it/s]
  2%|▏         | 6809/371472 [32:18<26:27:30,  3.83it/s]
  2%|▏         | 6810/371472 [32:18<26:52:02,  3.77it/s]
  2%|▏         | 6811/371472 [32:19<28:28:45,  3.56it/s]
  2%|▏         | 6812/371472 [32:19<27:20:02,  3.71it/s]
  2%|▏         | 6813/371472 [32:19<27:07:48,  3.73it/s]
  2%|▏         | 6814/371472 [32:19<27:08:20,  3.73it/s]
  2%|▏         | 6815/371472 [32:20<25:54:06,  3.91it/s]
  2%|▏         | 6816/371472 [32:20<25:48:02,  3.93it/s]
  2%|▏         | 6817/371472 [32:20<26:48:47,  3.78it/s]
  2%|▏         | 6818/371472 [32:20<27:21:19,  3.70it/s]
  2%|▏         | 6819/371472 [32:21<26:57:18,  3.76it/s]
  2%|▏         | 6820/371472 [32:21<26:36:27,  3.81it/s]
                                                        
{'loss': 5.123, 'learning_rate': 9.83952466116486e-07, 'epoch': 0.29}

  2%|▏         | 6820/371472 [32:21<26:36:27,  3.81it/s]
  2%|▏         | 6821/371472 [32:21<27:35:19,  3.67it/s]
  2%|▏         | 6822/371472 [32:21<26:40:09,  3.80it/s]
  2%|▏         | 6823/371472 [32:22<28:06:36,  3.60it/s]
  2%|▏         | 6824/371472 [32:22<26:50:56,  3.77it/s]
  2%|▏         | 6825/371472 [32:22<27:07:31,  3.73it/s]
  2%|▏         | 6826/371472 [32:23<30:15:09,  3.35it/s]
  2%|▏         | 6827/371472 [32:23<29:09:11,  3.47it/s]
  2%|▏         | 6828/371472 [32:23<28:29:34,  3.55it/s]
  2%|▏         | 6829/371472 [32:23<27:41:21,  3.66it/s]
  2%|▏         | 6830/371472 [32:24<27:45:24,  3.65it/s]
  2%|▏         | 6831/371472 [32:24<26:40:28,  3.80it/s]
  2%|▏         | 6832/371472 [32:24<27:22:50,  3.70it/s]
  2%|▏         | 6833/371472 [32:24<27:34:47,  3.67it/s]
  2%|▏         | 6834/371472 [32:25<28:28:47,  3.56it/s]
  2%|▏         | 6835/371472 [32:25<28:23:24,  3.57it/s]
  2%|▏         | 6836/371472 [32:25<29:17:59,  3.46it/s]
  2%|▏         | 6837/371472 [32:26<28:42:36,  3.53it/s]
  2%|▏         | 6838/371472 [32:26<28:22:53,  3.57it/s]
  2%|▏         | 6839/371472 [32:26<28:21:05,  3.57it/s]
  2%|▏         | 6840/371472 [32:26<27:32:03,  3.68it/s]
                                                        
{'loss': 5.0541, 'learning_rate': 9.839039841410071e-07, 'epoch': 0.29}

  2%|▏         | 6840/371472 [32:26<27:32:03,  3.68it/s]
  2%|▏         | 6841/371472 [32:27<27:51:17,  3.64it/s]
  2%|▏         | 6842/371472 [32:27<28:09:01,  3.60it/s]
  2%|▏         | 6843/371472 [32:27<27:35:51,  3.67it/s]
  2%|▏         | 6844/371472 [32:27<27:18:40,  3.71it/s]
  2%|▏         | 6845/371472 [32:28<27:08:11,  3.73it/s]
  2%|▏         | 6846/371472 [32:28<26:58:31,  3.75it/s]
  2%|▏         | 6847/371472 [32:28<29:16:24,  3.46it/s]
  2%|▏         | 6848/371472 [32:29<27:50:35,  3.64it/s]
  2%|▏         | 6849/371472 [32:29<27:19:41,  3.71it/s]
  2%|▏         | 6850/371472 [32:29<27:36:23,  3.67it/s]
  2%|▏         | 6851/371472 [32:29<27:40:07,  3.66it/s]
  2%|▏         | 6852/371472 [32:30<27:47:18,  3.64it/s]
  2%|▏         | 6853/371472 [32:30<27:27:28,  3.69it/s]
  2%|▏         | 6854/371472 [32:30<27:50:47,  3.64it/s]
  2%|▏         | 6855/371472 [32:31<28:28:46,  3.56it/s]
  2%|▏         | 6856/371472 [32:31<27:09:06,  3.73it/s]
  2%|▏         | 6857/371472 [32:31<27:29:18,  3.68it/s]
  2%|▏         | 6858/371472 [32:31<26:33:36,  3.81it/s]
  2%|▏         | 6859/371472 [32:32<25:40:30,  3.94it/s]
  2%|▏         | 6860/371472 [32:32<26:20:58,  3.84it/s]
                                                        
{'loss': 5.2848, 'learning_rate': 9.838555021655282e-07, 'epoch': 0.3}

  2%|▏         | 6860/371472 [32:32<26:20:58,  3.84it/s]
  2%|▏         | 6861/371472 [32:32<27:07:15,  3.73it/s]
  2%|▏         | 6862/371472 [32:32<28:50:07,  3.51it/s]
  2%|▏         | 6863/371472 [32:33<28:46:56,  3.52it/s]
  2%|▏         | 6864/371472 [32:33<28:14:25,  3.59it/s]
  2%|▏         | 6865/371472 [32:33<27:25:34,  3.69it/s]
  2%|▏         | 6866/371472 [32:33<27:55:09,  3.63it/s]
  2%|▏         | 6867/371472 [32:34<29:34:55,  3.42it/s]
  2%|▏         | 6868/371472 [32:34<29:03:07,  3.49it/s]
  2%|▏         | 6869/371472 [32:34<30:38:40,  3.30it/s]
  2%|▏         | 6870/371472 [32:35<29:49:10,  3.40it/s]
  2%|▏         | 6871/371472 [32:35<30:00:14,  3.38it/s]
  2%|▏         | 6872/371472 [32:35<28:51:57,  3.51it/s]
  2%|▏         | 6873/371472 [32:36<29:57:12,  3.38it/s]
  2%|▏         | 6874/371472 [32:36<28:51:11,  3.51it/s]
  2%|▏         | 6875/371472 [32:36<28:18:34,  3.58it/s]
  2%|▏         | 6876/371472 [32:36<27:08:30,  3.73it/s]
  2%|▏         | 6877/371472 [32:37<27:46:15,  3.65it/s]
  2%|▏         | 6878/371472 [32:37<27:22:31,  3.70it/s]
  2%|▏         | 6879/371472 [32:37<28:43:36,  3.53it/s]
  2%|▏         | 6880/371472 [32:38<30:23:27,  3.33it/s]
                                                        
{'loss': 5.1143, 'learning_rate': 9.838070201900493e-07, 'epoch': 0.3}

  2%|▏         | 6880/371472 [32:38<30:23:27,  3.33it/s]
  2%|▏         | 6881/371472 [32:38<28:55:04,  3.50it/s]
  2%|▏         | 6882/371472 [32:38<27:58:33,  3.62it/s]
  2%|▏         | 6883/371472 [32:38<27:57:47,  3.62it/s]
  2%|▏         | 6884/371472 [32:39<28:02:22,  3.61it/s]
  2%|▏         | 6885/371472 [32:39<28:31:43,  3.55it/s]
  2%|▏         | 6886/371472 [32:39<28:03:27,  3.61it/s]
  2%|▏         | 6887/371472 [32:39<27:34:37,  3.67it/s]
  2%|▏         | 6888/371472 [32:40<26:55:49,  3.76it/s]
  2%|▏         | 6889/371472 [32:40<27:49:40,  3.64it/s]
  2%|▏         | 6890/371472 [32:40<26:58:40,  3.75it/s]
  2%|▏         | 6891/371472 [32:41<30:26:17,  3.33it/s]
  2%|▏         | 6892/371472 [32:41<29:13:23,  3.47it/s]
  2%|▏         | 6893/371472 [32:41<28:30:29,  3.55it/s]
  2%|▏         | 6894/371472 [32:41<27:44:59,  3.65it/s]
  2%|▏         | 6895/371472 [32:42<28:03:54,  3.61it/s]
  2%|▏         | 6896/371472 [32:42<27:13:51,  3.72it/s]
  2%|▏         | 6897/371472 [32:42<27:20:53,  3.70it/s]
  2%|▏         | 6898/371472 [32:43<28:59:08,  3.49it/s]
  2%|▏         | 6899/371472 [32:43<28:14:09,  3.59it/s]
  2%|▏         | 6900/371472 [32:43<28:13:51,  3.59it/s]
                                                        
{'loss': 5.0813, 'learning_rate': 9.837585382145703e-07, 'epoch': 0.3}

  2%|▏         | 6900/371472 [32:43<28:13:51,  3.59it/s]
  2%|▏         | 6901/371472 [32:43<27:20:42,  3.70it/s]
  2%|▏         | 6902/371472 [32:44<26:28:24,  3.83it/s]
  2%|▏         | 6903/371472 [32:44<26:11:03,  3.87it/s]
  2%|▏         | 6904/371472 [32:44<27:39:21,  3.66it/s]
  2%|▏         | 6905/371472 [32:44<28:02:08,  3.61it/s]
  2%|▏         | 6906/371472 [32:45<28:20:42,  3.57it/s]
  2%|▏         | 6907/371472 [32:45<28:22:08,  3.57it/s]
  2%|▏         | 6908/371472 [32:45<29:00:55,  3.49it/s]
  2%|▏         | 6909/371472 [32:46<28:47:56,  3.52it/s]
  2%|▏         | 6910/371472 [32:46<28:47:19,  3.52it/s]
  2%|▏         | 6911/371472 [32:46<27:27:19,  3.69it/s]
  2%|▏         | 6912/371472 [32:46<28:53:41,  3.50it/s]
  2%|▏         | 6913/371472 [32:47<27:46:53,  3.65it/s]
  2%|▏         | 6914/371472 [32:47<27:35:31,  3.67it/s]
  2%|▏         | 6915/371472 [32:47<27:33:41,  3.67it/s]
  2%|▏         | 6916/371472 [32:47<28:21:33,  3.57it/s]
  2%|▏         | 6917/371472 [32:48<28:25:59,  3.56it/s]
  2%|▏         | 6918/371472 [32:48<27:42:50,  3.65it/s]
  2%|▏         | 6919/371472 [32:48<29:19:08,  3.45it/s]
  2%|▏         | 6920/371472 [32:49<29:14:53,  3.46it/s]
                                                        
{'loss': 4.902, 'learning_rate': 9.837100562390916e-07, 'epoch': 0.3}

  2%|▏         | 6920/371472 [32:49<29:14:53,  3.46it/s]
  2%|▏         | 6921/371472 [32:49<28:10:41,  3.59it/s]
  2%|▏         | 6922/371472 [32:49<27:27:54,  3.69it/s]
  2%|▏         | 6923/371472 [32:49<26:48:16,  3.78it/s]
  2%|▏         | 6924/371472 [32:50<26:01:11,  3.89it/s]
  2%|▏         | 6925/371472 [32:50<26:44:47,  3.79it/s]
  2%|▏         | 6926/371472 [32:50<28:18:58,  3.58it/s]
  2%|▏         | 6927/371472 [32:50<27:46:00,  3.65it/s]
  2%|▏         | 6928/371472 [32:51<27:51:04,  3.64it/s]
  2%|▏         | 6929/371472 [32:51<27:47:20,  3.64it/s]
  2%|▏         | 6930/371472 [32:51<27:42:59,  3.65it/s]
  2%|▏         | 6931/371472 [32:52<29:16:40,  3.46it/s]
  2%|▏         | 6932/371472 [32:52<29:03:29,  3.48it/s]
  2%|▏         | 6933/371472 [32:52<27:42:07,  3.66it/s]
  2%|▏         | 6934/371472 [32:52<26:55:41,  3.76it/s]
  2%|▏         | 6935/371472 [32:53<26:29:11,  3.82it/s]
  2%|▏         | 6936/371472 [32:53<26:11:14,  3.87it/s]
  2%|▏         | 6937/371472 [32:53<26:12:36,  3.86it/s]
  2%|▏         | 6938/371472 [32:54<28:41:28,  3.53it/s]
  2%|▏         | 6939/371472 [32:54<27:47:18,  3.64it/s]
  2%|▏         | 6940/371472 [32:54<27:15:45,  3.71it/s]
                                                        
{'loss': 5.4337, 'learning_rate': 9.836615742636125e-07, 'epoch': 0.3}

  2%|▏         | 6940/371472 [32:54<27:15:45,  3.71it/s]
  2%|▏         | 6941/371472 [32:54<27:51:35,  3.63it/s]
  2%|▏         | 6942/371472 [32:55<29:51:42,  3.39it/s]
  2%|▏         | 6943/371472 [32:55<29:16:05,  3.46it/s]
  2%|▏         | 6944/371472 [32:55<28:30:34,  3.55it/s]
  2%|▏         | 6945/371472 [32:55<27:32:32,  3.68it/s]
  2%|▏         | 6946/371472 [32:56<28:05:54,  3.60it/s]
  2%|▏         | 6947/371472 [32:56<29:23:50,  3.44it/s]
  2%|▏         | 6948/371472 [32:56<30:59:30,  3.27it/s]
  2%|▏         | 6949/371472 [32:57<29:57:16,  3.38it/s]
  2%|▏         | 6950/371472 [32:57<31:16:48,  3.24it/s]
  2%|▏         | 6951/371472 [32:57<30:15:15,  3.35it/s]
  2%|▏         | 6952/371472 [32:58<31:20:35,  3.23it/s]
  2%|▏         | 6953/371472 [32:58<29:29:19,  3.43it/s]
  2%|▏         | 6954/371472 [32:58<29:11:19,  3.47it/s]
  2%|▏         | 6955/371472 [32:58<28:45:22,  3.52it/s]
  2%|▏         | 6956/371472 [32:59<27:43:39,  3.65it/s]
  2%|▏         | 6957/371472 [32:59<29:12:13,  3.47it/s]
  2%|▏         | 6958/371472 [32:59<28:11:54,  3.59it/s]
  2%|▏         | 6959/371472 [32:59<27:14:07,  3.72it/s]
  2%|▏         | 6960/371472 [33:00<27:18:39,  3.71it/s]
                                                        
{'loss': 4.8747, 'learning_rate': 9.836130922881338e-07, 'epoch': 0.3}

  2%|▏         | 6960/371472 [33:00<27:18:39,  3.71it/s]
  2%|▏         | 6961/371472 [33:00<27:21:23,  3.70it/s]
  2%|▏         | 6962/371472 [33:00<31:42:18,  3.19it/s]
  2%|▏         | 6963/371472 [33:01<35:36:28,  2.84it/s]
  2%|▏         | 6964/371472 [33:01<33:03:51,  3.06it/s]
  2%|▏         | 6965/371472 [33:02<33:30:28,  3.02it/s]
  2%|▏         | 6966/371472 [33:02<33:40:33,  3.01it/s]
  2%|▏         | 6967/371472 [33:02<31:10:21,  3.25it/s]
  2%|▏         | 6968/371472 [33:02<29:25:35,  3.44it/s]
  2%|▏         | 6969/371472 [33:03<28:15:29,  3.58it/s]
  2%|▏         | 6970/371472 [33:03<31:27:35,  3.22it/s]
  2%|▏         | 6971/371472 [33:03<31:07:14,  3.25it/s]
  2%|▏         | 6972/371472 [33:04<30:59:09,  3.27it/s]
  2%|▏         | 6973/371472 [33:04<30:52:52,  3.28it/s]
  2%|▏         | 6974/371472 [33:04<29:09:45,  3.47it/s]
  2%|▏         | 6975/371472 [33:04<28:42:34,  3.53it/s]
  2%|▏         | 6976/371472 [33:05<28:11:01,  3.59it/s]
  2%|▏         | 6977/371472 [33:05<27:53:38,  3.63it/s]
  2%|▏         | 6978/371472 [33:05<27:26:15,  3.69it/s]
  2%|▏         | 6979/371472 [33:05<27:48:14,  3.64it/s]
  2%|▏         | 6980/371472 [33:06<27:33:07,  3.67it/s]
                                                        
{'loss': 4.8659, 'learning_rate': 9.835646103126548e-07, 'epoch': 0.3}

  2%|▏         | 6980/371472 [33:06<27:33:07,  3.67it/s]
  2%|▏         | 6981/371472 [33:06<27:48:32,  3.64it/s]
  2%|▏         | 6982/371472 [33:06<28:14:07,  3.59it/s]
  2%|▏         | 6983/371472 [33:07<27:49:39,  3.64it/s]
  2%|▏         | 6984/371472 [33:07<29:13:46,  3.46it/s]
  2%|▏         | 6985/371472 [33:07<28:14:05,  3.59it/s]
  2%|▏         | 6986/371472 [33:07<29:39:54,  3.41it/s]
  2%|▏         | 6987/371472 [33:08<28:19:45,  3.57it/s]
  2%|▏         | 6988/371472 [33:08<28:36:38,  3.54it/s]
  2%|▏         | 6989/371472 [33:08<28:48:29,  3.51it/s]
  2%|▏         | 6990/371472 [33:09<29:08:46,  3.47it/s]
  2%|▏         | 6991/371472 [33:09<30:16:12,  3.34it/s]
  2%|▏         | 6992/371472 [33:09<29:47:37,  3.40it/s]
  2%|▏         | 6993/371472 [33:10<30:12:45,  3.35it/s]
  2%|▏         | 6994/371472 [33:10<31:23:49,  3.22it/s]
  2%|▏         | 6995/371472 [33:10<30:56:46,  3.27it/s]
  2%|▏         | 6996/371472 [33:10<29:49:51,  3.39it/s]
  2%|▏         | 6997/371472 [33:11<29:23:59,  3.44it/s]
  2%|▏         | 6998/371472 [33:11<29:00:58,  3.49it/s]
  2%|▏         | 6999/371472 [33:11<28:27:22,  3.56it/s]
  2%|▏         | 7000/371472 [33:12<27:38:52,  3.66it/s]
                                                        
{'loss': 4.9519, 'learning_rate': 9.83516128337176e-07, 'epoch': 0.3}

  2%|▏         | 7000/371472 [33:12<27:38:52,  3.66it/s]
  2%|▏         | 7001/371472 [33:12<27:01:57,  3.75it/s]
  2%|▏         | 7002/371472 [33:12<26:35:10,  3.81it/s]
  2%|▏         | 7003/371472 [33:12<27:23:06,  3.70it/s]
  2%|▏         | 7004/371472 [33:13<28:07:46,  3.60it/s]
  2%|▏         | 7005/371472 [33:13<27:51:48,  3.63it/s]
  2%|▏         | 7006/371472 [33:13<27:59:07,  3.62it/s]
  2%|▏         | 7007/371472 [33:13<26:58:38,  3.75it/s]
  2%|▏         | 7008/371472 [33:14<26:58:38,  3.75it/s]
  2%|▏         | 7009/371472 [33:14<27:55:50,  3.62it/s]
  2%|▏         | 7010/371472 [33:14<27:16:57,  3.71it/s]
  2%|▏         | 7011/371472 [33:15<28:30:10,  3.55it/s]
  2%|▏         | 7012/371472 [33:15<28:14:00,  3.59it/s]
  2%|▏         | 7013/371472 [33:15<28:24:29,  3.56it/s]
  2%|▏         | 7014/371472 [33:15<28:59:15,  3.49it/s]
  2%|▏         | 7015/371472 [33:16<27:54:11,  3.63it/s]
  2%|▏         | 7016/371472 [33:16<27:24:01,  3.69it/s]
  2%|▏         | 7017/371472 [33:16<27:25:36,  3.69it/s]
  2%|▏         | 7018/371472 [33:16<29:02:16,  3.49it/s]
  2%|▏         | 7019/371472 [33:17<28:05:40,  3.60it/s]
  2%|▏         | 7020/371472 [33:17<27:50:02,  3.64it/s]
                                                        
{'loss': 4.9942, 'learning_rate': 9.83467646361697e-07, 'epoch': 0.3}

  2%|▏         | 7020/371472 [33:17<27:50:02,  3.64it/s]
  2%|▏         | 7021/371472 [33:17<28:18:37,  3.58it/s]
  2%|▏         | 7022/371472 [33:18<28:59:32,  3.49it/s]
  2%|▏         | 7023/371472 [33:18<33:52:53,  2.99it/s]
  2%|▏         | 7024/371472 [33:18<32:42:10,  3.10it/s]
  2%|▏         | 7025/371472 [33:19<31:50:19,  3.18it/s]
  2%|▏         | 7026/371472 [33:19<29:41:24,  3.41it/s]
  2%|▏         | 7027/371472 [33:19<32:22:17,  3.13it/s]
  2%|▏         | 7028/371472 [33:20<30:34:09,  3.31it/s]
  2%|▏         | 7029/371472 [33:20<29:35:46,  3.42it/s]
  2%|▏         | 7030/371472 [33:20<28:10:08,  3.59it/s]
  2%|▏         | 7031/371472 [33:20<27:52:50,  3.63it/s]
  2%|▏         | 7032/371472 [33:21<27:04:05,  3.74it/s]
  2%|▏         | 7033/371472 [33:21<27:12:58,  3.72it/s]
  2%|▏         | 7034/371472 [33:21<26:42:26,  3.79it/s]
  2%|▏         | 7035/371472 [33:21<29:56:53,  3.38it/s]
  2%|▏         | 7036/371472 [33:22<28:43:14,  3.52it/s]
  2%|▏         | 7037/371472 [33:22<27:58:38,  3.62it/s]
  2%|▏         | 7038/371472 [33:22<27:24:29,  3.69it/s]
  2%|▏         | 7039/371472 [33:22<27:24:04,  3.69it/s]
  2%|▏         | 7040/371472 [33:23<26:57:28,  3.76it/s]
                                                        
{'loss': 5.0863, 'learning_rate': 9.83419164386218e-07, 'epoch': 0.3}

  2%|▏         | 7040/371472 [33:23<26:57:28,  3.76it/s]
  2%|▏         | 7041/371472 [33:23<26:01:27,  3.89it/s]
  2%|▏         | 7042/371472 [33:23<28:00:33,  3.61it/s]
  2%|▏         | 7043/371472 [33:24<30:31:03,  3.32it/s]
  2%|▏         | 7044/371472 [33:24<29:46:43,  3.40it/s]
  2%|▏         | 7045/371472 [33:24<29:14:53,  3.46it/s]
  2%|▏         | 7046/371472 [33:24<28:21:55,  3.57it/s]
  2%|▏         | 7047/371472 [33:25<28:02:32,  3.61it/s]
  2%|▏         | 7048/371472 [33:25<29:06:08,  3.48it/s]
  2%|▏         | 7049/371472 [33:25<28:54:18,  3.50it/s]
  2%|▏         | 7050/371472 [33:26<28:38:42,  3.53it/s]
  2%|▏         | 7051/371472 [33:26<27:57:35,  3.62it/s]
  2%|▏         | 7052/371472 [33:26<26:58:00,  3.75it/s]
  2%|▏         | 7053/371472 [33:27<36:35:19,  2.77it/s]
  2%|▏         | 7054/371472 [33:27<33:13:24,  3.05it/s]
  2%|▏         | 7055/371472 [33:27<31:22:10,  3.23it/s]
  2%|▏         | 7056/371472 [33:27<30:18:16,  3.34it/s]
  2%|▏         | 7057/371472 [33:28<29:16:33,  3.46it/s]
  2%|▏         | 7058/371472 [33:28<27:58:44,  3.62it/s]
  2%|▏         | 7059/371472 [33:28<28:02:31,  3.61it/s]
  2%|▏         | 7060/371472 [33:29<29:00:53,  3.49it/s]
                                                        
{'loss': 4.7905, 'learning_rate': 9.833706824107393e-07, 'epoch': 0.3}

  2%|▏         | 7060/371472 [33:29<29:00:53,  3.49it/s]
  2%|▏         | 7061/371472 [33:29<28:17:28,  3.58it/s]
  2%|▏         | 7062/371472 [33:29<27:32:40,  3.67it/s]
  2%|▏         | 7063/371472 [33:29<28:19:11,  3.57it/s]
  2%|▏         | 7064/371472 [33:30<26:54:16,  3.76it/s]
  2%|▏         | 7065/371472 [33:30<27:48:47,  3.64it/s]
  2%|▏         | 7066/371472 [33:30<28:17:17,  3.58it/s]
  2%|▏         | 7067/371472 [33:31<29:17:18,  3.46it/s]
  2%|▏         | 7068/371472 [33:31<28:59:01,  3.49it/s]
  2%|▏         | 7069/371472 [33:31<28:59:23,  3.49it/s]
  2%|▏         | 7070/371472 [33:31<28:36:28,  3.54it/s]
  2%|▏         | 7071/371472 [33:32<28:01:29,  3.61it/s]
  2%|▏         | 7072/371472 [33:32<28:28:49,  3.55it/s]
  2%|▏         | 7073/371472 [33:32<28:32:12,  3.55it/s]
  2%|▏         | 7074/371472 [33:32<28:19:56,  3.57it/s]
  2%|▏         | 7075/371472 [33:33<27:18:51,  3.71it/s]
  2%|▏         | 7076/371472 [33:33<26:35:56,  3.81it/s]
  2%|▏         | 7077/371472 [33:33<28:34:52,  3.54it/s]
  2%|▏         | 7078/371472 [33:34<28:50:56,  3.51it/s]
  2%|▏         | 7079/371472 [33:34<28:13:35,  3.59it/s]
  2%|▏         | 7080/371472 [33:34<34:14:03,  2.96it/s]
                                                        
{'loss': 4.9519, 'learning_rate': 9.833222004352604e-07, 'epoch': 0.3}

  2%|▏         | 7080/371472 [33:34<34:14:03,  2.96it/s]
  2%|▏         | 7081/371472 [33:35<32:14:18,  3.14it/s]
  2%|▏         | 7082/371472 [33:35<31:44:33,  3.19it/s]
  2%|▏         | 7083/371472 [33:35<30:12:21,  3.35it/s]
  2%|▏         | 7084/371472 [33:35<30:01:29,  3.37it/s]
  2%|▏         | 7085/371472 [33:36<29:22:49,  3.45it/s]
  2%|▏         | 7086/371472 [33:36<29:48:20,  3.40it/s]
  2%|▏         | 7087/371472 [33:36<29:15:26,  3.46it/s]
  2%|▏         | 7088/371472 [33:37<28:01:05,  3.61it/s]
  2%|▏         | 7089/371472 [33:37<27:32:05,  3.68it/s]
  2%|▏         | 7090/371472 [33:37<26:47:38,  3.78it/s]
  2%|▏         | 7091/371472 [33:37<26:45:04,  3.78it/s]
  2%|▏         | 7092/371472 [33:38<27:17:03,  3.71it/s]
  2%|▏         | 7093/371472 [33:38<26:22:32,  3.84it/s]
  2%|▏         | 7094/371472 [33:38<26:37:39,  3.80it/s]
  2%|▏         | 7095/371472 [33:38<26:26:18,  3.83it/s]
  2%|▏         | 7096/371472 [33:39<27:45:06,  3.65it/s]
  2%|▏         | 7097/371472 [33:39<26:44:20,  3.79it/s]
  2%|▏         | 7098/371472 [33:39<28:32:56,  3.55it/s]
  2%|▏         | 7099/371472 [33:40<27:55:41,  3.62it/s]
  2%|▏         | 7100/371472 [33:40<27:45:45,  3.65it/s]
                                                        
{'loss': 5.0442, 'learning_rate': 9.832737184597815e-07, 'epoch': 0.31}

  2%|▏         | 7100/371472 [33:40<27:45:45,  3.65it/s]
  2%|▏         | 7101/371472 [33:40<28:23:28,  3.56it/s]
  2%|▏         | 7102/371472 [33:40<29:09:55,  3.47it/s]
  2%|▏         | 7103/371472 [33:41<33:29:50,  3.02it/s]
  2%|▏         | 7104/371472 [33:41<33:45:47,  3.00it/s]
  2%|▏         | 7105/371472 [33:41<32:03:07,  3.16it/s]
  2%|▏         | 7106/371472 [33:42<31:32:21,  3.21it/s]
  2%|▏         | 7107/371472 [33:42<30:09:27,  3.36it/s]
  2%|▏         | 7108/371472 [33:42<28:43:58,  3.52it/s]
  2%|▏         | 7109/371472 [33:43<30:26:23,  3.32it/s]
  2%|▏         | 7110/371472 [33:43<32:01:04,  3.16it/s]
  2%|▏         | 7111/371472 [33:43<30:24:59,  3.33it/s]
  2%|▏         | 7112/371472 [33:44<30:10:47,  3.35it/s]
  2%|▏         | 7113/371472 [33:44<28:26:09,  3.56it/s]
  2%|▏         | 7114/371472 [33:44<27:23:48,  3.69it/s]
  2%|▏         | 7115/371472 [33:44<26:37:00,  3.80it/s]
  2%|▏         | 7116/371472 [33:45<26:23:01,  3.84it/s]
  2%|▏         | 7117/371472 [33:45<26:43:25,  3.79it/s]
  2%|▏         | 7118/371472 [33:45<26:30:22,  3.82it/s]
  2%|▏         | 7119/371472 [33:45<26:50:45,  3.77it/s]
  2%|▏         | 7120/371472 [33:46<26:39:39,  3.80it/s]
                                                        
{'loss': 4.9433, 'learning_rate': 9.832252364843028e-07, 'epoch': 0.31}

  2%|▏         | 7120/371472 [33:46<26:39:39,  3.80it/s]
  2%|▏         | 7121/371472 [33:46<25:49:02,  3.92it/s]
  2%|▏         | 7122/371472 [33:46<27:27:50,  3.69it/s]
  2%|▏         | 7123/371472 [33:46<26:45:17,  3.78it/s]
  2%|▏         | 7124/371472 [33:47<27:01:38,  3.74it/s]
  2%|▏         | 7125/371472 [33:47<27:57:44,  3.62it/s]
  2%|▏         | 7126/371472 [33:47<27:07:25,  3.73it/s]
  2%|▏         | 7127/371472 [33:47<26:51:28,  3.77it/s]
  2%|▏         | 7128/371472 [33:48<26:47:13,  3.78it/s]
  2%|▏         | 7129/371472 [33:48<26:15:44,  3.85it/s]
  2%|▏         | 7130/371472 [33:48<25:54:18,  3.91it/s]
  2%|▏         | 7131/371472 [33:49<27:54:16,  3.63it/s]
  2%|▏         | 7132/371472 [33:49<31:13:34,  3.24it/s]
  2%|▏         | 7133/371472 [33:49<30:39:59,  3.30it/s]
  2%|▏         | 7134/371472 [33:49<29:02:48,  3.48it/s]
  2%|▏         | 7135/371472 [33:50<28:00:50,  3.61it/s]
  2%|▏         | 7136/371472 [33:50<28:46:16,  3.52it/s]
  2%|▏         | 7137/371472 [33:50<29:44:20,  3.40it/s]
  2%|▏         | 7138/371472 [33:51<29:35:12,  3.42it/s]
  2%|▏         | 7139/371472 [33:51<28:58:55,  3.49it/s]
  2%|▏         | 7140/371472 [33:51<27:51:50,  3.63it/s]
                                                        
{'loss': 4.9803, 'learning_rate': 9.831767545088236e-07, 'epoch': 0.31}

  2%|▏         | 7140/371472 [33:51<27:51:50,  3.63it/s]
  2%|▏         | 7141/371472 [33:51<28:47:34,  3.51it/s]
  2%|▏         | 7142/371472 [33:52<29:08:07,  3.47it/s]
  2%|▏         | 7143/371472 [33:52<28:40:13,  3.53it/s]
  2%|▏         | 7144/371472 [33:52<28:40:24,  3.53it/s]
  2%|▏         | 7145/371472 [33:53<29:23:27,  3.44it/s]
  2%|▏         | 7146/371472 [33:53<30:34:35,  3.31it/s]
  2%|▏         | 7147/371472 [33:53<34:53:05,  2.90it/s]
  2%|▏         | 7148/371472 [33:54<32:39:05,  3.10it/s]
  2%|▏         | 7149/371472 [33:54<31:57:19,  3.17it/s]
  2%|▏         | 7150/371472 [33:54<31:05:02,  3.26it/s]
  2%|▏         | 7151/371472 [33:54<29:56:59,  3.38it/s]
  2%|▏         | 7152/371472 [33:55<30:29:04,  3.32it/s]
  2%|▏         | 7153/371472 [33:55<29:56:42,  3.38it/s]
  2%|▏         | 7154/371472 [33:55<29:03:38,  3.48it/s]
  2%|▏         | 7155/371472 [33:56<28:07:46,  3.60it/s]
  2%|▏         | 7156/371472 [33:56<29:24:10,  3.44it/s]
  2%|▏         | 7157/371472 [33:56<28:35:38,  3.54it/s]
  2%|▏         | 7158/371472 [33:56<28:13:46,  3.58it/s]
  2%|▏         | 7159/371472 [33:57<29:30:21,  3.43it/s]
  2%|▏         | 7160/371472 [33:57<28:30:52,  3.55it/s]
                                                        
{'loss': 4.9704, 'learning_rate': 9.83128272533345e-07, 'epoch': 0.31}

  2%|▏         | 7160/371472 [33:57<28:30:52,  3.55it/s]
  2%|▏         | 7161/371472 [33:57<28:13:41,  3.58it/s]
  2%|▏         | 7162/371472 [33:58<29:40:38,  3.41it/s]
  2%|▏         | 7163/371472 [33:58<28:16:13,  3.58it/s]
  2%|▏         | 7164/371472 [33:58<28:29:22,  3.55it/s]
  2%|▏         | 7165/371472 [33:58<28:05:29,  3.60it/s]
  2%|▏         | 7166/371472 [33:59<27:43:21,  3.65it/s]
  2%|▏         | 7167/371472 [33:59<27:03:17,  3.74it/s]
  2%|▏         | 7168/371472 [33:59<26:40:26,  3.79it/s]
  2%|▏         | 7169/371472 [33:59<26:58:49,  3.75it/s]
  2%|▏         | 7170/371472 [34:00<27:48:29,  3.64it/s]
  2%|▏         | 7171/371472 [34:00<27:34:33,  3.67it/s]
  2%|▏         | 7172/371472 [34:00<27:48:04,  3.64it/s]
  2%|▏         | 7173/371472 [34:01<28:00:19,  3.61it/s]
  2%|▏         | 7174/371472 [34:01<27:31:36,  3.68it/s]
  2%|▏         | 7175/371472 [34:01<28:41:32,  3.53it/s]
  2%|▏         | 7176/371472 [34:01<28:01:20,  3.61it/s]
  2%|▏         | 7177/371472 [34:02<27:20:05,  3.70it/s]
  2%|▏         | 7178/371472 [34:02<26:54:32,  3.76it/s]
  2%|▏         | 7179/371472 [34:02<28:41:54,  3.53it/s]
  2%|▏         | 7180/371472 [34:03<28:22:32,  3.57it/s]
                                                        
{'loss': 4.922, 'learning_rate': 9.830797905578658e-07, 'epoch': 0.31}

  2%|▏         | 7180/371472 [34:03<28:22:32,  3.57it/s]
  2%|▏         | 7181/371472 [34:03<29:41:11,  3.41it/s]
  2%|▏         | 7182/371472 [34:03<29:59:49,  3.37it/s]
  2%|▏         | 7183/371472 [34:03<29:01:33,  3.49it/s]
  2%|▏         | 7184/371472 [34:04<28:29:46,  3.55it/s]
  2%|▏         | 7185/371472 [34:04<28:21:24,  3.57it/s]
  2%|▏         | 7186/371472 [34:04<29:20:17,  3.45it/s]
  2%|▏         | 7187/371472 [34:05<29:37:07,  3.42it/s]
  2%|▏         | 7188/371472 [34:05<29:32:47,  3.42it/s]
  2%|▏         | 7189/371472 [34:05<29:01:45,  3.49it/s]
  2%|▏         | 7190/371472 [34:05<28:16:32,  3.58it/s]
  2%|▏         | 7191/371472 [34:06<28:06:42,  3.60it/s]
  2%|▏         | 7192/371472 [34:06<27:55:54,  3.62it/s]
  2%|▏         | 7193/371472 [34:06<28:31:35,  3.55it/s]
  2%|▏         | 7194/371472 [34:07<28:28:59,  3.55it/s]
  2%|▏         | 7195/371472 [34:07<28:25:48,  3.56it/s]
  2%|▏         | 7196/371472 [34:07<29:36:33,  3.42it/s]
  2%|▏         | 7197/371472 [34:07<28:32:42,  3.54it/s]
  2%|▏         | 7198/371472 [34:08<27:35:26,  3.67it/s]
  2%|▏         | 7199/371472 [34:08<35:01:33,  2.89it/s]
  2%|▏         | 7200/371472 [34:08<33:25:21,  3.03it/s]
                                                        
{'loss': 5.1661, 'learning_rate': 9.83031308582387e-07, 'epoch': 0.31}

  2%|▏         | 7200/371472 [34:08<33:25:21,  3.03it/s]
  2%|▏         | 7201/371472 [34:09<30:51:52,  3.28it/s]
  2%|▏         | 7202/371472 [34:09<30:22:45,  3.33it/s]
  2%|▏         | 7203/371472 [34:09<29:53:26,  3.39it/s]
  2%|▏         | 7204/371472 [34:10<29:22:48,  3.44it/s]
  2%|▏         | 7205/371472 [34:10<29:58:31,  3.38it/s]
  2%|▏         | 7206/371472 [34:10<29:25:20,  3.44it/s]
  2%|▏         | 7207/371472 [34:10<28:41:26,  3.53it/s]
  2%|▏         | 7208/371472 [34:11<27:40:48,  3.66it/s]
  2%|▏         | 7209/371472 [34:11<28:24:18,  3.56it/s]
  2%|▏         | 7210/371472 [34:11<28:15:18,  3.58it/s]
  2%|▏         | 7211/371472 [34:12<27:31:17,  3.68it/s]
  2%|▏         | 7212/371472 [34:12<27:24:32,  3.69it/s]
  2%|▏         | 7213/371472 [34:12<27:15:13,  3.71it/s]
  2%|▏         | 7214/371472 [34:12<27:05:10,  3.74it/s]
  2%|▏         | 7215/371472 [34:13<26:41:37,  3.79it/s]
  2%|▏         | 7216/371472 [34:13<29:35:04,  3.42it/s]
  2%|▏         | 7217/371472 [34:13<29:28:33,  3.43it/s]
  2%|▏         | 7218/371472 [34:14<32:33:32,  3.11it/s]
  2%|▏         | 7219/371472 [34:14<31:39:34,  3.20it/s]
  2%|▏         | 7220/371472 [34:14<30:21:18,  3.33it/s]
                                                        
{'loss': 4.9994, 'learning_rate': 9.829828266069081e-07, 'epoch': 0.31}

  2%|▏         | 7220/371472 [34:14<30:21:18,  3.33it/s]
  2%|▏         | 7221/371472 [34:14<28:47:45,  3.51it/s]
  2%|▏         | 7222/371472 [34:15<28:52:48,  3.50it/s]
  2%|▏         | 7223/371472 [34:15<28:32:06,  3.55it/s]
  2%|▏         | 7224/371472 [34:15<27:39:35,  3.66it/s]
  2%|▏         | 7225/371472 [34:15<27:15:48,  3.71it/s]
  2%|▏         | 7226/371472 [34:16<26:48:24,  3.77it/s]
  2%|▏         | 7227/371472 [34:16<27:00:41,  3.75it/s]
  2%|▏         | 7228/371472 [34:16<26:00:07,  3.89it/s]
  2%|▏         | 7229/371472 [34:17<26:09:50,  3.87it/s]
  2%|▏         | 7230/371472 [34:17<26:33:31,  3.81it/s]
  2%|▏         | 7231/371472 [34:17<27:04:51,  3.74it/s]
  2%|▏         | 7232/371472 [34:17<28:40:45,  3.53it/s]
  2%|▏         | 7233/371472 [34:18<29:05:42,  3.48it/s]
  2%|▏         | 7234/371472 [34:18<28:18:32,  3.57it/s]
  2%|▏         | 7235/371472 [34:18<28:17:55,  3.58it/s]
  2%|▏         | 7236/371472 [34:18<27:33:01,  3.67it/s]
  2%|▏         | 7237/371472 [34:19<26:58:48,  3.75it/s]
  2%|▏         | 7238/371472 [34:19<26:32:03,  3.81it/s]
  2%|▏         | 7239/371472 [34:19<26:47:33,  3.78it/s]
  2%|▏         | 7240/371472 [34:20<26:41:31,  3.79it/s]
                                                        
{'loss': 5.1306, 'learning_rate': 9.829343446314292e-07, 'epoch': 0.31}

  2%|▏         | 7240/371472 [34:20<26:41:31,  3.79it/s]
  2%|▏         | 7241/371472 [34:20<27:02:08,  3.74it/s]
  2%|▏         | 7242/371472 [34:20<27:53:06,  3.63it/s]
  2%|▏         | 7243/371472 [34:20<28:09:34,  3.59it/s]
  2%|▏         | 7244/371472 [34:21<27:51:33,  3.63it/s]
  2%|▏         | 7245/371472 [34:21<33:22:31,  3.03it/s]
  2%|▏         | 7246/371472 [34:21<34:54:18,  2.90it/s]
  2%|▏         | 7247/371472 [34:22<32:05:35,  3.15it/s]
  2%|▏         | 7248/371472 [34:22<30:45:35,  3.29it/s]
  2%|▏         | 7249/371472 [34:22<29:34:35,  3.42it/s]
  2%|▏         | 7250/371472 [34:23<28:40:09,  3.53it/s]
  2%|▏         | 7251/371472 [34:23<27:51:54,  3.63it/s]
  2%|▏         | 7252/371472 [34:23<27:30:10,  3.68it/s]
  2%|▏         | 7253/371472 [34:23<28:27:53,  3.55it/s]
  2%|▏         | 7254/371472 [34:24<28:13:17,  3.58it/s]
  2%|▏         | 7255/371472 [34:24<27:25:37,  3.69it/s]
  2%|▏         | 7256/371472 [34:24<29:47:35,  3.40it/s]
  2%|▏         | 7257/371472 [34:25<29:20:38,  3.45it/s]
  2%|▏         | 7258/371472 [34:25<27:59:28,  3.61it/s]
  2%|▏         | 7259/371472 [34:25<27:31:02,  3.68it/s]
  2%|▏         | 7260/371472 [34:25<27:29:07,  3.68it/s]
                                                        
{'loss': 5.1203, 'learning_rate': 9.828858626559505e-07, 'epoch': 0.31}

  2%|▏         | 7260/371472 [34:25<27:29:07,  3.68it/s]
  2%|▏         | 7261/371472 [34:26<26:39:26,  3.80it/s]
  2%|▏         | 7262/371472 [34:26<27:31:20,  3.68it/s]
  2%|▏         | 7263/371472 [34:26<27:38:51,  3.66it/s]
  2%|▏         | 7264/371472 [34:26<28:10:50,  3.59it/s]
  2%|▏         | 7265/371472 [34:27<28:16:46,  3.58it/s]
  2%|▏         | 7266/371472 [34:27<29:04:33,  3.48it/s]
  2%|▏         | 7267/371472 [34:27<29:30:50,  3.43it/s]
  2%|▏         | 7268/371472 [34:28<28:07:17,  3.60it/s]
  2%|▏         | 7269/371472 [34:28<27:39:01,  3.66it/s]
  2%|▏         | 7270/371472 [34:28<27:24:18,  3.69it/s]
  2%|▏         | 7271/371472 [34:28<27:24:14,  3.69it/s]
  2%|▏         | 7272/371472 [34:29<27:05:34,  3.73it/s]
  2%|▏         | 7273/371472 [34:29<27:35:41,  3.67it/s]
  2%|▏         | 7274/371472 [34:29<26:26:57,  3.82it/s]
  2%|▏         | 7275/371472 [34:29<25:53:26,  3.91it/s]
  2%|▏         | 7276/371472 [34:30<25:28:06,  3.97it/s]
  2%|▏         | 7277/371472 [34:30<25:56:34,  3.90it/s]
  2%|▏         | 7278/371472 [34:30<26:29:39,  3.82it/s]
  2%|▏         | 7279/371472 [34:30<26:43:07,  3.79it/s]
  2%|▏         | 7280/371472 [34:31<26:56:43,  3.75it/s]
                                                        
{'loss': 4.9512, 'learning_rate': 9.828373806804713e-07, 'epoch': 0.31}

  2%|▏         | 7280/371472 [34:31<26:56:43,  3.75it/s]
  2%|▏         | 7281/371472 [34:31<28:00:43,  3.61it/s]
  2%|▏         | 7282/371472 [34:31<30:11:43,  3.35it/s]
  2%|▏         | 7283/371472 [34:32<30:21:07,  3.33it/s]
  2%|▏         | 7284/371472 [34:32<30:17:49,  3.34it/s]
  2%|▏         | 7285/371472 [34:32<29:16:26,  3.46it/s]
  2%|▏         | 7286/371472 [34:32<28:00:28,  3.61it/s]
  2%|▏         | 7287/371472 [34:33<27:29:52,  3.68it/s]
  2%|▏         | 7288/371472 [34:33<28:33:19,  3.54it/s]
  2%|▏         | 7289/371472 [34:33<28:20:30,  3.57it/s]
  2%|▏         | 7290/371472 [34:34<28:49:31,  3.51it/s]
  2%|▏         | 7291/371472 [34:34<28:03:30,  3.61it/s]
  2%|▏         | 7292/371472 [34:34<28:42:10,  3.52it/s]
  2%|▏         | 7293/371472 [34:34<27:36:07,  3.66it/s]
  2%|▏         | 7294/371472 [34:35<27:17:36,  3.71it/s]
  2%|▏         | 7295/371472 [34:35<29:31:13,  3.43it/s]
  2%|▏         | 7296/371472 [34:35<29:34:47,  3.42it/s]
  2%|▏         | 7297/371472 [34:36<29:35:29,  3.42it/s]
  2%|▏         | 7298/371472 [34:36<33:11:00,  3.05it/s]
  2%|▏         | 7299/371472 [34:36<33:01:32,  3.06it/s]
  2%|▏         | 7300/371472 [34:37<31:59:46,  3.16it/s]
                                                        
{'loss': 4.9913, 'learning_rate': 9.827888987049926e-07, 'epoch': 0.31}

  2%|▏         | 7300/371472 [34:37<31:59:46,  3.16it/s]
  2%|▏         | 7301/371472 [34:37<32:53:43,  3.08it/s]
  2%|▏         | 7302/371472 [34:37<31:41:25,  3.19it/s]
  2%|▏         | 7303/371472 [34:37<30:15:16,  3.34it/s]
  2%|▏         | 7304/371472 [34:38<32:27:32,  3.12it/s]
  2%|▏         | 7305/371472 [34:38<31:55:14,  3.17it/s]
  2%|▏         | 7306/371472 [34:38<30:00:24,  3.37it/s]
  2%|▏         | 7307/371472 [34:39<31:04:20,  3.26it/s]
  2%|▏         | 7308/371472 [34:39<30:46:28,  3.29it/s]
  2%|▏         | 7309/371472 [34:39<30:25:21,  3.33it/s]
  2%|▏         | 7310/371472 [34:40<29:03:05,  3.48it/s]
  2%|▏         | 7311/371472 [34:40<27:59:41,  3.61it/s]
  2%|▏         | 7312/371472 [34:40<27:53:56,  3.63it/s]
  2%|▏         | 7313/371472 [34:40<27:02:31,  3.74it/s]
  2%|▏         | 7314/371472 [34:41<28:47:25,  3.51it/s]
  2%|▏         | 7315/371472 [34:41<29:51:30,  3.39it/s]
  2%|▏         | 7316/371472 [34:41<29:40:06,  3.41it/s]
  2%|▏         | 7317/371472 [34:42<28:30:35,  3.55it/s]
  2%|▏         | 7318/371472 [34:42<27:33:51,  3.67it/s]
  2%|▏         | 7319/371472 [34:42<27:16:14,  3.71it/s]
  2%|▏         | 7320/371472 [34:42<26:51:53,  3.77it/s]
                                                        
{'loss': 4.8699, 'learning_rate': 9.827404167295135e-07, 'epoch': 0.32}

  2%|▏         | 7320/371472 [34:42<26:51:53,  3.77it/s]
  2%|▏         | 7321/371472 [34:43<26:27:57,  3.82it/s]
  2%|▏         | 7322/371472 [34:43<26:18:26,  3.85it/s]
  2%|▏         | 7323/371472 [34:43<27:16:47,  3.71it/s]
  2%|▏         | 7324/371472 [34:43<27:10:00,  3.72it/s]
  2%|▏         | 7325/371472 [34:44<27:14:17,  3.71it/s]
  2%|▏         | 7326/371472 [34:44<26:44:32,  3.78it/s]
  2%|▏         | 7327/371472 [34:44<26:47:51,  3.77it/s]
  2%|▏         | 7328/371472 [34:44<26:19:42,  3.84it/s]
  2%|▏         | 7329/371472 [34:45<28:48:03,  3.51it/s]
  2%|▏         | 7330/371472 [34:45<29:02:40,  3.48it/s]
  2%|▏         | 7331/371472 [34:45<29:01:57,  3.48it/s]
  2%|▏         | 7332/371472 [34:46<29:21:33,  3.45it/s]
  2%|▏         | 7333/371472 [34:46<28:51:38,  3.50it/s]
  2%|▏         | 7334/371472 [34:46<28:48:39,  3.51it/s]
  2%|▏         | 7335/371472 [34:46<27:44:56,  3.65it/s]
  2%|▏         | 7336/371472 [34:47<28:27:46,  3.55it/s]
  2%|▏         | 7337/371472 [34:47<28:31:52,  3.55it/s]
  2%|▏         | 7338/371472 [34:47<28:51:13,  3.51it/s]
  2%|▏         | 7339/371472 [34:48<29:41:03,  3.41it/s]
  2%|▏         | 7340/371472 [34:48<28:24:08,  3.56it/s]
                                                        
{'loss': 5.0095, 'learning_rate': 9.826919347540348e-07, 'epoch': 0.32}

  2%|▏         | 7340/371472 [34:48<28:24:08,  3.56it/s]
  2%|▏         | 7341/371472 [34:48<27:58:54,  3.61it/s]
  2%|▏         | 7342/371472 [34:48<28:29:19,  3.55it/s]
  2%|▏         | 7343/371472 [34:49<31:11:41,  3.24it/s]
  2%|▏         | 7344/371472 [34:49<29:52:56,  3.38it/s]
  2%|▏         | 7345/371472 [34:49<28:34:11,  3.54it/s]
  2%|▏         | 7346/371472 [34:50<28:21:11,  3.57it/s]
  2%|▏         | 7347/371472 [34:50<27:36:34,  3.66it/s]
  2%|▏         | 7348/371472 [34:50<28:16:56,  3.58it/s]
  2%|▏         | 7349/371472 [34:50<28:56:18,  3.50it/s]
  2%|▏         | 7350/371472 [34:51<29:30:09,  3.43it/s]
  2%|▏         | 7351/371472 [34:51<29:46:12,  3.40it/s]
  2%|▏         | 7352/371472 [34:51<28:23:57,  3.56it/s]
  2%|▏         | 7353/371472 [34:52<29:09:23,  3.47it/s]
  2%|▏         | 7354/371472 [34:52<28:34:30,  3.54it/s]
  2%|▏         | 7355/371472 [34:52<28:18:39,  3.57it/s]
  2%|▏         | 7356/371472 [34:52<28:12:35,  3.59it/s]
  2%|▏         | 7357/371472 [34:53<27:45:07,  3.64it/s]
  2%|▏         | 7358/371472 [34:53<27:36:01,  3.66it/s]
  2%|▏         | 7359/371472 [34:53<30:43:40,  3.29it/s]
  2%|▏         | 7360/371472 [34:54<30:59:16,  3.26it/s]
                                                        
{'loss': 4.8065, 'learning_rate': 9.826434527785558e-07, 'epoch': 0.32}

  2%|▏         | 7360/371472 [34:54<30:59:16,  3.26it/s]
  2%|▏         | 7361/371472 [34:54<29:27:29,  3.43it/s]
  2%|▏         | 7362/371472 [34:54<28:13:19,  3.58it/s]
  2%|▏         | 7363/371472 [34:54<28:57:53,  3.49it/s]
  2%|▏         | 7364/371472 [34:55<28:13:14,  3.58it/s]
  2%|▏         | 7365/371472 [34:55<27:13:23,  3.72it/s]
  2%|▏         | 7366/371472 [34:55<28:25:37,  3.56it/s]
  2%|▏         | 7367/371472 [34:56<29:46:45,  3.40it/s]
  2%|▏         | 7368/371472 [34:56<28:55:41,  3.50it/s]
  2%|▏         | 7369/371472 [34:56<28:45:50,  3.52it/s]
  2%|▏         | 7370/371472 [34:56<29:14:39,  3.46it/s]
  2%|▏         | 7371/371472 [34:57<29:00:14,  3.49it/s]
  2%|▏         | 7372/371472 [34:57<27:51:54,  3.63it/s]
  2%|▏         | 7373/371472 [34:57<27:18:53,  3.70it/s]
  2%|▏         | 7374/371472 [34:58<28:05:54,  3.60it/s]
  2%|▏         | 7375/371472 [34:58<27:05:18,  3.73it/s]
  2%|▏         | 7376/371472 [34:58<26:16:35,  3.85it/s]
  2%|▏         | 7377/371472 [34:58<26:27:43,  3.82it/s]
  2%|▏         | 7378/371472 [34:59<26:47:13,  3.78it/s]
  2%|▏         | 7379/371472 [34:59<26:54:03,  3.76it/s]
  2%|▏         | 7380/371472 [34:59<26:12:03,  3.86it/s]
                                                        
{'loss': 5.2293, 'learning_rate': 9.82594970803077e-07, 'epoch': 0.32}

  2%|▏         | 7380/371472 [34:59<26:12:03,  3.86it/s]
  2%|▏         | 7381/371472 [34:59<27:42:07,  3.65it/s]
  2%|▏         | 7382/371472 [35:00<27:07:59,  3.73it/s]
  2%|▏         | 7383/371472 [35:00<27:20:36,  3.70it/s]
  2%|▏         | 7384/371472 [35:00<28:14:36,  3.58it/s]
  2%|▏         | 7385/371472 [35:01<29:21:35,  3.44it/s]
  2%|▏         | 7386/371472 [35:01<28:17:50,  3.57it/s]
  2%|▏         | 7387/371472 [35:01<29:45:31,  3.40it/s]
  2%|▏         | 7388/371472 [35:01<28:33:24,  3.54it/s]
  2%|▏         | 7389/371472 [35:02<27:47:32,  3.64it/s]
  2%|▏         | 7390/371472 [35:02<27:13:22,  3.72it/s]
  2%|▏         | 7391/371472 [35:02<27:59:03,  3.61it/s]
  2%|▏         | 7392/371472 [35:02<27:42:29,  3.65it/s]
  2%|▏         | 7393/371472 [35:03<28:25:27,  3.56it/s]
  2%|▏         | 7394/371472 [35:03<27:57:45,  3.62it/s]
  2%|▏         | 7395/371472 [35:03<28:19:47,  3.57it/s]
  2%|▏         | 7396/371472 [35:04<28:14:14,  3.58it/s]
  2%|▏         | 7397/371472 [35:04<28:51:09,  3.51it/s]
  2%|▏         | 7398/371472 [35:04<27:45:19,  3.64it/s]
  2%|▏         | 7399/371472 [35:04<28:15:39,  3.58it/s]
  2%|▏         | 7400/371472 [35:05<28:59:18,  3.49it/s]
                                                        
{'loss': 5.0196, 'learning_rate': 9.82546488827598e-07, 'epoch': 0.32}

  2%|▏         | 7400/371472 [35:05<28:59:18,  3.49it/s]
  2%|▏         | 7401/371472 [35:05<28:10:38,  3.59it/s]
  2%|▏         | 7402/371472 [35:05<27:08:49,  3.73it/s]
  2%|▏         | 7403/371472 [35:05<26:31:27,  3.81it/s]
  2%|▏         | 7404/371472 [35:06<29:20:51,  3.45it/s]
  2%|▏         | 7405/371472 [35:06<29:43:53,  3.40it/s]
  2%|▏         | 7406/371472 [35:06<29:14:16,  3.46it/s]
  2%|▏         | 7407/371472 [35:07<29:04:17,  3.48it/s]
  2%|▏         | 7408/371472 [35:07<29:33:51,  3.42it/s]
  2%|▏         | 7409/371472 [35:07<28:40:49,  3.53it/s]
  2%|▏         | 7410/371472 [35:08<28:20:34,  3.57it/s]
  2%|▏         | 7411/371472 [35:08<29:25:36,  3.44it/s]
  2%|▏         | 7412/371472 [35:08<29:11:00,  3.47it/s]
  2%|▏         | 7413/371472 [35:08<29:31:46,  3.42it/s]
  2%|▏         | 7414/371472 [35:09<29:50:00,  3.39it/s]
  2%|▏         | 7415/371472 [35:09<28:46:04,  3.52it/s]
  2%|▏         | 7416/371472 [35:09<27:50:04,  3.63it/s]
  2%|▏         | 7417/371472 [35:10<29:02:00,  3.48it/s]
  2%|▏         | 7418/371472 [35:10<29:06:53,  3.47it/s]
  2%|▏         | 7419/371472 [35:10<31:09:25,  3.25it/s]
  2%|▏         | 7420/371472 [35:11<31:32:00,  3.21it/s]
                                                        
{'loss': 4.9105, 'learning_rate': 9.82498006852119e-07, 'epoch': 0.32}

  2%|▏         | 7420/371472 [35:11<31:32:00,  3.21it/s]
  2%|▏         | 7421/371472 [35:11<30:27:53,  3.32it/s]
  2%|▏         | 7422/371472 [35:11<28:41:48,  3.52it/s]
  2%|▏         | 7423/371472 [35:11<28:07:27,  3.60it/s]
  2%|▏         | 7424/371472 [35:12<28:10:17,  3.59it/s]
  2%|▏         | 7425/371472 [35:12<27:48:24,  3.64it/s]
  2%|▏         | 7426/371472 [35:12<28:55:19,  3.50it/s]
  2%|▏         | 7427/371472 [35:12<28:38:30,  3.53it/s]
  2%|▏         | 7428/371472 [35:13<28:03:16,  3.60it/s]
  2%|▏         | 7429/371472 [35:13<29:04:01,  3.48it/s]
  2%|▏         | 7430/371472 [35:13<30:22:04,  3.33it/s]
  2%|▏         | 7431/371472 [35:14<33:34:35,  3.01it/s]
  2%|▏         | 7432/371472 [35:14<31:51:40,  3.17it/s]
  2%|▏         | 7433/371472 [35:14<30:58:13,  3.27it/s]
  2%|▏         | 7434/371472 [35:15<31:13:33,  3.24it/s]
  2%|▏         | 7435/371472 [35:15<32:13:27,  3.14it/s]
  2%|▏         | 7436/371472 [35:15<30:06:25,  3.36it/s]
  2%|▏         | 7437/371472 [35:16<30:12:13,  3.35it/s]
  2%|▏         | 7438/371472 [35:16<29:09:48,  3.47it/s]
  2%|▏         | 7439/371472 [35:16<28:23:13,  3.56it/s]
  2%|▏         | 7440/371472 [35:16<27:58:49,  3.61it/s]
                                                        
{'loss': 4.8088, 'learning_rate': 9.824495248766403e-07, 'epoch': 0.32}

  2%|▏         | 7440/371472 [35:16<27:58:49,  3.61it/s]
  2%|▏         | 7441/371472 [35:17<28:00:00,  3.61it/s]
  2%|▏         | 7442/371472 [35:17<28:11:25,  3.59it/s]
  2%|▏         | 7443/371472 [35:17<27:24:41,  3.69it/s]
  2%|▏         | 7444/371472 [35:17<26:46:50,  3.78it/s]
  2%|▏         | 7445/371472 [35:18<27:06:43,  3.73it/s]
  2%|▏         | 7446/371472 [35:18<27:02:28,  3.74it/s]
  2%|▏         | 7447/371472 [35:18<26:46:38,  3.78it/s]
  2%|▏         | 7448/371472 [35:18<27:27:21,  3.68it/s]
  2%|▏         | 7449/371472 [35:19<27:28:50,  3.68it/s]
  2%|▏         | 7450/371472 [35:19<28:52:40,  3.50it/s]
  2%|▏         | 7451/371472 [35:19<31:41:41,  3.19it/s]
  2%|▏         | 7452/371472 [35:20<30:24:16,  3.33it/s]
  2%|▏         | 7453/371472 [35:20<29:29:30,  3.43it/s]
  2%|▏         | 7454/371472 [35:20<33:48:01,  2.99it/s]
  2%|▏         | 7455/371472 [35:21<34:24:41,  2.94it/s]
  2%|▏         | 7456/371472 [35:21<32:41:53,  3.09it/s]
  2%|▏         | 7457/371472 [35:22<37:25:43,  2.70it/s]
  2%|▏         | 7458/371472 [35:22<33:53:04,  2.98it/s]
  2%|▏         | 7459/371472 [35:22<31:44:08,  3.19it/s]
  2%|▏         | 7460/371472 [35:22<29:23:49,  3.44it/s]
                                                        
{'loss': 4.8067, 'learning_rate': 9.824010429011614e-07, 'epoch': 0.32}

  2%|▏         | 7460/371472 [35:22<29:23:49,  3.44it/s]
  2%|▏         | 7461/371472 [35:23<29:08:31,  3.47it/s]
  2%|▏         | 7462/371472 [35:23<29:36:38,  3.41it/s]
  2%|▏         | 7463/371472 [35:23<27:59:54,  3.61it/s]
  2%|▏         | 7464/371472 [35:23<27:51:12,  3.63it/s]
  2%|▏         | 7465/371472 [35:24<27:05:48,  3.73it/s]
  2%|▏         | 7466/371472 [35:24<27:27:42,  3.68it/s]
  2%|▏         | 7467/371472 [35:24<26:45:59,  3.78it/s]
  2%|▏         | 7468/371472 [35:24<26:14:10,  3.85it/s]
  2%|▏         | 7469/371472 [35:25<27:03:17,  3.74it/s]
  2%|▏         | 7470/371472 [35:25<29:01:38,  3.48it/s]
  2%|▏         | 7471/371472 [35:25<28:17:47,  3.57it/s]
  2%|▏         | 7472/371472 [35:26<29:35:14,  3.42it/s]
  2%|▏         | 7473/371472 [35:26<29:15:34,  3.46it/s]
  2%|▏         | 7474/371472 [35:26<29:32:14,  3.42it/s]
  2%|▏         | 7475/371472 [35:26<27:46:59,  3.64it/s]
  2%|▏         | 7476/371472 [35:27<27:12:11,  3.72it/s]
  2%|▏         | 7477/371472 [35:27<38:21:21,  2.64it/s]
  2%|▏         | 7478/371472 [35:28<34:17:54,  2.95it/s]
  2%|▏         | 7479/371472 [35:28<33:48:55,  2.99it/s]
  2%|▏         | 7480/371472 [35:28<32:13:11,  3.14it/s]
                                                        
{'loss': 4.775, 'learning_rate': 9.823525609256825e-07, 'epoch': 0.32}

  2%|▏         | 7480/371472 [35:28<32:13:11,  3.14it/s]
  2%|▏         | 7481/371472 [35:28<31:51:24,  3.17it/s]
  2%|▏         | 7482/371472 [35:29<30:09:06,  3.35it/s]
  2%|▏         | 7483/371472 [35:29<29:50:30,  3.39it/s]
  2%|▏         | 7484/371472 [35:29<28:22:45,  3.56it/s]
  2%|▏         | 7485/371472 [35:30<28:35:46,  3.54it/s]
  2%|▏         | 7486/371472 [35:30<28:30:57,  3.55it/s]
  2%|▏         | 7487/371472 [35:30<29:20:53,  3.45it/s]
  2%|▏         | 7488/371472 [35:30<28:03:43,  3.60it/s]
  2%|▏         | 7489/371472 [35:31<27:45:12,  3.64it/s]
  2%|▏         | 7490/371472 [35:31<27:02:26,  3.74it/s]
  2%|▏         | 7491/371472 [35:31<28:01:24,  3.61it/s]
  2%|▏         | 7492/371472 [35:32<28:52:40,  3.50it/s]
  2%|▏         | 7493/371472 [35:32<28:24:49,  3.56it/s]
  2%|▏         | 7494/371472 [35:32<28:57:41,  3.49it/s]
  2%|▏         | 7495/371472 [35:32<28:33:59,  3.54it/s]
  2%|▏         | 7496/371472 [35:33<28:37:44,  3.53it/s]
  2%|▏         | 7497/371472 [35:33<27:21:50,  3.69it/s]
  2%|▏         | 7498/371472 [35:33<26:51:04,  3.77it/s]
  2%|▏         | 7499/371472 [35:34<30:11:50,  3.35it/s]
  2%|▏         | 7500/371472 [35:34<29:09:08,  3.47it/s]
                                                        
{'loss': 4.8729, 'learning_rate': 9.823040789502038e-07, 'epoch': 0.32}

  2%|▏         | 7500/371472 [35:34<29:09:08,  3.47it/s]
  2%|▏         | 7501/371472 [35:34<30:17:39,  3.34it/s]
  2%|▏         | 7502/371472 [35:34<29:39:51,  3.41it/s]
  2%|▏         | 7503/371472 [35:35<29:02:35,  3.48it/s]
  2%|▏         | 7504/371472 [35:35<28:28:44,  3.55it/s]
  2%|▏         | 7505/371472 [35:35<27:49:21,  3.63it/s]
  2%|▏         | 7506/371472 [35:36<30:45:46,  3.29it/s]
  2%|▏         | 7507/371472 [35:36<29:20:24,  3.45it/s]
  2%|▏         | 7508/371472 [35:36<28:53:32,  3.50it/s]
  2%|▏         | 7509/371472 [35:36<28:36:28,  3.53it/s]
  2%|▏         | 7510/371472 [35:37<28:39:48,  3.53it/s]
  2%|▏         | 7511/371472 [35:37<28:52:59,  3.50it/s]
  2%|▏         | 7512/371472 [35:37<28:03:04,  3.60it/s]
  2%|▏         | 7513/371472 [35:37<27:37:08,  3.66it/s]
  2%|▏         | 7514/371472 [35:38<30:53:51,  3.27it/s]
  2%|▏         | 7515/371472 [35:38<29:59:13,  3.37it/s]
  2%|▏         | 7516/371472 [35:38<28:58:29,  3.49it/s]
  2%|▏         | 7517/371472 [35:39<27:46:53,  3.64it/s]
  2%|▏         | 7518/371472 [35:39<30:09:32,  3.35it/s]
  2%|▏         | 7519/371472 [35:39<31:21:21,  3.22it/s]
  2%|▏         | 7520/371472 [35:40<30:28:04,  3.32it/s]
                                                        
{'loss': 4.8439, 'learning_rate': 9.822555969747246e-07, 'epoch': 0.32}

  2%|▏         | 7520/371472 [35:40<30:28:04,  3.32it/s]
  2%|▏         | 7521/371472 [35:40<30:05:13,  3.36it/s]
  2%|▏         | 7522/371472 [35:40<31:03:02,  3.26it/s]
  2%|▏         | 7523/371472 [35:41<29:39:56,  3.41it/s]
  2%|▏         | 7524/371472 [35:41<28:18:52,  3.57it/s]
  2%|▏         | 7525/371472 [35:41<27:14:19,  3.71it/s]
  2%|▏         | 7526/371472 [35:41<27:08:54,  3.72it/s]
  2%|▏         | 7527/371472 [35:42<28:27:39,  3.55it/s]
  2%|▏         | 7528/371472 [35:42<27:55:36,  3.62it/s]
  2%|▏         | 7529/371472 [35:42<28:23:19,  3.56it/s]
  2%|▏         | 7530/371472 [35:42<27:55:55,  3.62it/s]
  2%|▏         | 7531/371472 [35:43<28:00:22,  3.61it/s]
  2%|▏         | 7532/371472 [35:43<27:22:14,  3.69it/s]
  2%|▏         | 7533/371472 [35:43<27:37:54,  3.66it/s]
  2%|▏         | 7534/371472 [35:44<31:06:19,  3.25it/s]
  2%|▏         | 7535/371472 [35:44<30:14:59,  3.34it/s]
  2%|▏         | 7536/371472 [35:44<30:11:14,  3.35it/s]
  2%|▏         | 7537/371472 [35:44<29:04:09,  3.48it/s]
  2%|▏         | 7538/371472 [35:45<29:15:11,  3.46it/s]
  2%|▏         | 7539/371472 [35:45<30:05:58,  3.36it/s]
  2%|▏         | 7540/371472 [35:45<29:07:27,  3.47it/s]
                                                        
{'loss': 4.936, 'learning_rate': 9.82207114999246e-07, 'epoch': 0.32}

  2%|▏         | 7540/371472 [35:45<29:07:27,  3.47it/s]
  2%|▏         | 7541/371472 [35:46<29:17:02,  3.45it/s]
  2%|▏         | 7542/371472 [35:46<28:50:59,  3.50it/s]
  2%|▏         | 7543/371472 [35:46<28:11:26,  3.59it/s]
  2%|▏         | 7544/371472 [35:46<27:20:54,  3.70it/s]
  2%|▏         | 7545/371472 [35:47<29:13:14,  3.46it/s]
  2%|▏         | 7546/371472 [35:47<29:12:27,  3.46it/s]
  2%|▏         | 7547/371472 [35:47<30:38:19,  3.30it/s]
  2%|▏         | 7548/371472 [35:48<28:50:55,  3.50it/s]
  2%|▏         | 7549/371472 [35:48<28:36:34,  3.53it/s]
  2%|▏         | 7550/371472 [35:48<28:55:31,  3.49it/s]
  2%|▏         | 7551/371472 [35:48<28:50:10,  3.51it/s]
  2%|▏         | 7552/371472 [35:49<28:17:21,  3.57it/s]
  2%|▏         | 7553/371472 [35:49<29:00:16,  3.49it/s]
  2%|▏         | 7554/371472 [35:49<28:01:25,  3.61it/s]
  2%|▏         | 7555/371472 [35:50<27:29:00,  3.68it/s]
  2%|▏         | 7556/371472 [35:50<27:57:28,  3.62it/s]
  2%|▏         | 7557/371472 [35:50<29:21:43,  3.44it/s]
  2%|▏         | 7558/371472 [35:50<29:22:35,  3.44it/s]
  2%|▏         | 7559/371472 [35:51<30:40:38,  3.30it/s]
  2%|▏         | 7560/371472 [35:51<29:20:59,  3.44it/s]
                                                        
{'loss': 4.6856, 'learning_rate': 9.821586330237668e-07, 'epoch': 0.33}

  2%|▏         | 7560/371472 [35:51<29:20:59,  3.44it/s]
  2%|▏         | 7561/371472 [35:51<30:58:41,  3.26it/s]
  2%|▏         | 7562/371472 [35:52<30:02:07,  3.37it/s]
  2%|▏         | 7563/371472 [35:52<28:35:36,  3.54it/s]
  2%|▏         | 7564/371472 [35:52<28:04:16,  3.60it/s]
  2%|▏         | 7565/371472 [35:52<28:09:35,  3.59it/s]
  2%|▏         | 7566/371472 [35:53<27:40:04,  3.65it/s]
  2%|▏         | 7567/371472 [35:53<29:00:59,  3.48it/s]
  2%|▏         | 7568/371472 [35:53<30:59:20,  3.26it/s]
  2%|▏         | 7569/371472 [35:54<30:28:52,  3.32it/s]
  2%|▏         | 7570/371472 [35:54<29:20:16,  3.45it/s]
  2%|▏         | 7571/371472 [35:54<28:43:42,  3.52it/s]
  2%|▏         | 7572/371472 [35:54<27:53:38,  3.62it/s]
  2%|▏         | 7573/371472 [35:55<28:31:09,  3.54it/s]
  2%|▏         | 7574/371472 [35:55<28:19:57,  3.57it/s]
  2%|▏         | 7575/371472 [35:55<27:30:17,  3.68it/s]
  2%|▏         | 7576/371472 [35:56<26:45:26,  3.78it/s]
  2%|▏         | 7577/371472 [35:56<26:14:21,  3.85it/s]
  2%|▏         | 7578/371472 [35:56<26:18:36,  3.84it/s]
  2%|▏         | 7579/371472 [35:56<26:26:41,  3.82it/s]
  2%|▏         | 7580/371472 [35:57<26:02:43,  3.88it/s]
                                                        
{'loss': 5.3348, 'learning_rate': 9.82110151048288e-07, 'epoch': 0.33}

  2%|▏         | 7580/371472 [35:57<26:02:43,  3.88it/s]
  2%|▏         | 7581/371472 [35:57<26:54:36,  3.76it/s]
  2%|▏         | 7582/371472 [35:57<28:04:54,  3.60it/s]
  2%|▏         | 7583/371472 [35:57<29:02:17,  3.48it/s]
  2%|▏         | 7584/371472 [35:58<29:49:06,  3.39it/s]
  2%|▏         | 7585/371472 [35:58<30:51:38,  3.28it/s]
  2%|▏         | 7586/371472 [35:58<29:27:34,  3.43it/s]
  2%|▏         | 7587/371472 [35:59<28:52:53,  3.50it/s]
  2%|▏         | 7588/371472 [35:59<29:43:54,  3.40it/s]
  2%|▏         | 7589/371472 [35:59<28:34:42,  3.54it/s]
  2%|▏         | 7590/371472 [35:59<27:34:38,  3.67it/s]
  2%|▏         | 7591/371472 [36:00<27:08:07,  3.72it/s]
  2%|▏         | 7592/371472 [36:00<27:16:04,  3.71it/s]
  2%|▏         | 7593/371472 [36:00<27:00:29,  3.74it/s]
  2%|▏         | 7594/371472 [36:01<27:05:45,  3.73it/s]
  2%|▏         | 7595/371472 [36:01<27:11:09,  3.72it/s]
  2%|▏         | 7596/371472 [36:01<27:44:40,  3.64it/s]
  2%|▏         | 7597/371472 [36:01<27:20:28,  3.70it/s]
  2%|▏         | 7598/371472 [36:02<27:05:19,  3.73it/s]
  2%|▏         | 7599/371472 [36:02<28:40:18,  3.53it/s]
  2%|▏         | 7600/371472 [36:02<28:10:14,  3.59it/s]
                                                        
{'loss': 5.0314, 'learning_rate': 9.820616690728091e-07, 'epoch': 0.33}

  2%|▏         | 7600/371472 [36:02<28:10:14,  3.59it/s]
  2%|▏         | 7601/371472 [36:02<28:29:02,  3.55it/s]
  2%|▏         | 7602/371472 [36:03<28:01:34,  3.61it/s]
  2%|▏         | 7603/371472 [36:03<29:16:21,  3.45it/s]
  2%|▏         | 7604/371472 [36:03<28:53:33,  3.50it/s]
  2%|▏         | 7605/371472 [36:04<28:58:40,  3.49it/s]
  2%|▏         | 7606/371472 [36:04<28:48:46,  3.51it/s]
  2%|▏         | 7607/371472 [36:04<29:09:51,  3.47it/s]
  2%|▏         | 7608/371472 [36:04<27:59:08,  3.61it/s]
  2%|▏         | 7609/371472 [36:05<28:13:10,  3.58it/s]
  2%|▏         | 7610/371472 [36:05<27:45:55,  3.64it/s]
  2%|▏         | 7611/371472 [36:05<28:55:30,  3.49it/s]
  2%|▏         | 7612/371472 [36:06<29:44:41,  3.40it/s]
  2%|▏         | 7613/371472 [36:06<29:38:50,  3.41it/s]
  2%|▏         | 7614/371472 [36:06<30:10:40,  3.35it/s]
  2%|▏         | 7615/371472 [36:06<29:27:00,  3.43it/s]
  2%|▏         | 7616/371472 [36:07<27:55:50,  3.62it/s]
  2%|▏         | 7617/371472 [36:07<27:27:23,  3.68it/s]
  2%|▏         | 7618/371472 [36:07<27:11:22,  3.72it/s]
  2%|▏         | 7619/371472 [36:08<27:34:08,  3.67it/s]
  2%|▏         | 7620/371472 [36:08<26:10:04,  3.86it/s]
                                                        
{'loss': 4.9376, 'learning_rate': 9.820131870973302e-07, 'epoch': 0.33}

  2%|▏         | 7620/371472 [36:08<26:10:04,  3.86it/s]
  2%|▏         | 7621/371472 [36:08<26:25:10,  3.83it/s]
  2%|▏         | 7622/371472 [36:08<27:04:39,  3.73it/s]
  2%|▏         | 7623/371472 [36:09<26:15:31,  3.85it/s]
  2%|▏         | 7624/371472 [36:09<27:52:08,  3.63it/s]
  2%|▏         | 7625/371472 [36:09<27:35:10,  3.66it/s]
  2%|▏         | 7626/371472 [36:09<27:02:11,  3.74it/s]
  2%|▏         | 7627/371472 [36:10<27:09:17,  3.72it/s]
  2%|▏         | 7628/371472 [36:10<28:21:51,  3.56it/s]
  2%|▏         | 7629/371472 [36:10<27:58:51,  3.61it/s]
  2%|▏         | 7630/371472 [36:11<28:22:48,  3.56it/s]
  2%|▏         | 7631/371472 [36:11<28:02:44,  3.60it/s]
  2%|▏         | 7632/371472 [36:11<29:56:34,  3.38it/s]
  2%|▏         | 7633/371472 [36:11<28:23:32,  3.56it/s]
  2%|▏         | 7634/371472 [36:12<28:32:54,  3.54it/s]
  2%|▏         | 7635/371472 [36:12<30:17:41,  3.34it/s]
  2%|▏         | 7636/371472 [36:12<30:48:28,  3.28it/s]
  2%|▏         | 7637/371472 [36:13<30:41:58,  3.29it/s]
  2%|▏         | 7638/371472 [36:13<29:11:28,  3.46it/s]
  2%|▏         | 7639/371472 [36:13<32:44:03,  3.09it/s]
  2%|▏         | 7640/371472 [36:14<30:41:44,  3.29it/s]
                                                        
{'loss': 4.9632, 'learning_rate': 9.819647051218515e-07, 'epoch': 0.33}

  2%|▏         | 7640/371472 [36:14<30:41:44,  3.29it/s]
  2%|▏         | 7641/371472 [36:14<30:34:54,  3.30it/s]
  2%|▏         | 7642/371472 [36:14<29:08:04,  3.47it/s]
  2%|▏         | 7643/371472 [36:14<30:07:30,  3.35it/s]
  2%|▏         | 7644/371472 [36:15<28:55:52,  3.49it/s]
  2%|▏         | 7645/371472 [36:15<29:42:22,  3.40it/s]
  2%|▏         | 7646/371472 [36:15<29:11:14,  3.46it/s]
  2%|▏         | 7647/371472 [36:16<28:19:06,  3.57it/s]
  2%|▏         | 7648/371472 [36:16<29:07:38,  3.47it/s]
  2%|▏         | 7649/371472 [36:16<28:11:50,  3.58it/s]
  2%|▏         | 7650/371472 [36:16<28:07:14,  3.59it/s]
  2%|▏         | 7651/371472 [36:17<28:59:54,  3.49it/s]
  2%|▏         | 7652/371472 [36:17<27:34:13,  3.67it/s]
  2%|▏         | 7653/371472 [36:17<28:32:11,  3.54it/s]
  2%|▏         | 7654/371472 [36:18<30:05:54,  3.36it/s]
  2%|▏         | 7655/371472 [36:18<32:26:05,  3.12it/s]
  2%|▏         | 7656/371472 [36:18<32:49:06,  3.08it/s]
  2%|▏         | 7657/371472 [36:19<33:25:26,  3.02it/s]
  2%|▏         | 7658/371472 [36:19<32:42:03,  3.09it/s]
  2%|▏         | 7659/371472 [36:19<30:59:04,  3.26it/s]
  2%|▏         | 7660/371472 [36:20<32:08:51,  3.14it/s]
                                                        
{'loss': 4.8058, 'learning_rate': 9.819162231463723e-07, 'epoch': 0.33}

  2%|▏         | 7660/371472 [36:20<32:08:51,  3.14it/s]
  2%|▏         | 7661/371472 [36:20<30:48:18,  3.28it/s]
  2%|▏         | 7662/371472 [36:20<29:30:55,  3.42it/s]
  2%|▏         | 7663/371472 [36:20<27:53:22,  3.62it/s]
  2%|▏         | 7664/371472 [36:21<28:43:30,  3.52it/s]
  2%|▏         | 7665/371472 [36:21<29:02:47,  3.48it/s]
  2%|▏         | 7666/371472 [36:21<28:50:10,  3.50it/s]
  2%|▏         | 7667/371472 [36:21<28:34:40,  3.54it/s]
  2%|▏         | 7668/371472 [36:22<27:27:17,  3.68it/s]
  2%|▏         | 7669/371472 [36:22<27:42:57,  3.65it/s]
  2%|▏         | 7670/371472 [36:22<28:22:57,  3.56it/s]
  2%|▏         | 7671/371472 [36:23<27:32:52,  3.67it/s]
  2%|▏         | 7672/371472 [36:23<27:30:06,  3.67it/s]
  2%|▏         | 7673/371472 [36:23<27:23:12,  3.69it/s]
  2%|▏         | 7674/371472 [36:23<27:11:02,  3.72it/s]
  2%|▏         | 7675/371472 [36:24<30:22:47,  3.33it/s]
  2%|▏         | 7676/371472 [36:24<28:22:38,  3.56it/s]
  2%|▏         | 7677/371472 [36:24<28:43:55,  3.52it/s]
  2%|▏         | 7678/371472 [36:25<28:47:36,  3.51it/s]
  2%|▏         | 7679/371472 [36:25<28:43:20,  3.52it/s]
  2%|▏         | 7680/371472 [36:25<28:07:29,  3.59it/s]
                                                        
{'loss': 5.0257, 'learning_rate': 9.818677411708936e-07, 'epoch': 0.33}

  2%|▏         | 7680/371472 [36:25<28:07:29,  3.59it/s]
  2%|▏         | 7681/371472 [36:25<28:16:51,  3.57it/s]
  2%|▏         | 7682/371472 [36:26<27:26:44,  3.68it/s]
  2%|▏         | 7683/371472 [36:26<27:46:49,  3.64it/s]
  2%|▏         | 7684/371472 [36:26<28:12:45,  3.58it/s]
  2%|▏         | 7685/371472 [36:26<28:18:10,  3.57it/s]
  2%|▏         | 7686/371472 [36:27<31:02:43,  3.25it/s]
  2%|▏         | 7687/371472 [36:27<29:44:42,  3.40it/s]
  2%|▏         | 7688/371472 [36:27<28:44:35,  3.52it/s]
  2%|▏         | 7689/371472 [36:28<29:08:18,  3.47it/s]
  2%|▏         | 7690/371472 [36:28<27:31:11,  3.67it/s]
  2%|▏         | 7691/371472 [36:28<27:14:27,  3.71it/s]
  2%|▏         | 7692/371472 [36:28<26:56:31,  3.75it/s]
  2%|▏         | 7693/371472 [36:29<30:11:48,  3.35it/s]
  2%|▏         | 7694/371472 [36:29<29:05:51,  3.47it/s]
  2%|▏         | 7695/371472 [36:29<28:26:13,  3.55it/s]
  2%|▏         | 7696/371472 [36:30<27:31:31,  3.67it/s]
  2%|▏         | 7697/371472 [36:30<27:39:07,  3.65it/s]
  2%|▏         | 7698/371472 [36:30<28:07:34,  3.59it/s]
  2%|▏         | 7699/371472 [36:30<28:36:24,  3.53it/s]
  2%|▏         | 7700/371472 [36:31<28:09:42,  3.59it/s]
                                                        
{'loss': 4.8374, 'learning_rate': 9.818192591954147e-07, 'epoch': 0.33}

  2%|▏         | 7700/371472 [36:31<28:09:42,  3.59it/s]
  2%|▏         | 7701/371472 [36:31<27:25:33,  3.68it/s]
  2%|▏         | 7702/371472 [36:31<26:57:25,  3.75it/s]
  2%|▏         | 7703/371472 [36:31<26:54:03,  3.76it/s]
  2%|▏         | 7704/371472 [36:32<27:18:05,  3.70it/s]
  2%|▏         | 7705/371472 [36:32<28:07:46,  3.59it/s]
  2%|▏         | 7706/371472 [36:32<28:34:00,  3.54it/s]
  2%|▏         | 7707/371472 [36:33<27:42:02,  3.65it/s]
  2%|▏         | 7708/371472 [36:33<27:15:19,  3.71it/s]
  2%|▏         | 7709/371472 [36:33<27:57:48,  3.61it/s]
  2%|▏         | 7710/371472 [36:33<27:21:25,  3.69it/s]
  2%|▏         | 7711/371472 [36:34<27:39:27,  3.65it/s]
  2%|▏         | 7712/371472 [36:34<28:16:27,  3.57it/s]
  2%|▏         | 7713/371472 [36:34<28:39:25,  3.53it/s]
  2%|▏         | 7714/371472 [36:35<27:40:51,  3.65it/s]
  2%|▏         | 7715/371472 [36:35<26:54:27,  3.76it/s]
  2%|▏         | 7716/371472 [36:35<26:09:54,  3.86it/s]
  2%|▏         | 7717/371472 [36:35<27:29:06,  3.68it/s]
  2%|▏         | 7718/371472 [36:36<27:05:29,  3.73it/s]
  2%|▏         | 7719/371472 [36:36<26:43:56,  3.78it/s]
  2%|▏         | 7720/371472 [36:36<27:20:58,  3.69it/s]
                                                        
{'loss': 5.0226, 'learning_rate': 9.817707772199358e-07, 'epoch': 0.33}

  2%|▏         | 7720/371472 [36:36<27:20:58,  3.69it/s]
  2%|▏         | 7721/371472 [36:36<27:36:19,  3.66it/s]
  2%|▏         | 7722/371472 [36:37<26:41:01,  3.79it/s]
  2%|▏         | 7723/371472 [36:37<29:22:10,  3.44it/s]
  2%|▏         | 7724/371472 [36:37<28:18:39,  3.57it/s]
  2%|▏         | 7725/371472 [36:37<27:18:48,  3.70it/s]
  2%|▏         | 7726/371472 [36:38<26:56:21,  3.75it/s]
  2%|▏         | 7727/371472 [36:38<26:49:24,  3.77it/s]
  2%|▏         | 7728/371472 [36:38<27:01:42,  3.74it/s]
  2%|▏         | 7729/371472 [36:39<26:43:42,  3.78it/s]
  2%|▏         | 7730/371472 [36:39<27:18:43,  3.70it/s]
  2%|▏         | 7731/371472 [36:39<26:41:22,  3.79it/s]
  2%|▏         | 7732/371472 [36:39<26:45:29,  3.78it/s]
  2%|▏         | 7733/371472 [36:40<27:04:23,  3.73it/s]
  2%|▏         | 7734/371472 [36:40<30:00:52,  3.37it/s]
  2%|▏         | 7735/371472 [36:40<28:49:21,  3.51it/s]
  2%|▏         | 7736/371472 [36:41<28:43:54,  3.52it/s]
  2%|▏         | 7737/371472 [36:41<28:34:43,  3.54it/s]
  2%|▏         | 7738/371472 [36:41<30:56:18,  3.27it/s]
  2%|▏         | 7739/371472 [36:41<29:45:38,  3.39it/s]
  2%|▏         | 7740/371472 [36:42<29:32:38,  3.42it/s]
                                                        
{'loss': 5.1709, 'learning_rate': 9.817222952444568e-07, 'epoch': 0.33}

  2%|▏         | 7740/371472 [36:42<29:32:38,  3.42it/s]
  2%|▏         | 7741/371472 [36:42<31:12:29,  3.24it/s]
  2%|▏         | 7742/371472 [36:42<29:37:16,  3.41it/s]
  2%|▏         | 7743/371472 [36:43<31:02:53,  3.25it/s]
  2%|▏         | 7744/371472 [36:43<29:50:13,  3.39it/s]
  2%|▏         | 7745/371472 [36:43<28:27:12,  3.55it/s]
  2%|▏         | 7746/371472 [36:43<27:52:26,  3.62it/s]
  2%|▏         | 7747/371472 [36:44<26:40:34,  3.79it/s]
  2%|▏         | 7748/371472 [36:44<27:33:54,  3.67it/s]
  2%|▏         | 7749/371472 [36:44<28:06:27,  3.59it/s]
  2%|▏         | 7750/371472 [36:45<27:39:27,  3.65it/s]
  2%|▏         | 7751/371472 [36:45<27:15:51,  3.71it/s]
  2%|▏         | 7752/371472 [36:45<27:35:32,  3.66it/s]
  2%|▏         | 7753/371472 [36:45<28:29:11,  3.55it/s]
  2%|▏         | 7754/371472 [36:46<30:06:15,  3.36it/s]
  2%|▏         | 7755/371472 [36:46<29:32:21,  3.42it/s]
  2%|▏         | 7756/371472 [36:46<28:21:54,  3.56it/s]
  2%|▏         | 7757/371472 [36:46<27:28:13,  3.68it/s]
  2%|▏         | 7758/371472 [36:47<29:14:01,  3.46it/s]
  2%|▏         | 7759/371472 [36:47<28:09:06,  3.59it/s]
  2%|▏         | 7760/371472 [36:47<28:44:26,  3.52it/s]
                                                        
{'loss': 5.0315, 'learning_rate': 9.81673813268978e-07, 'epoch': 0.33}

  2%|▏         | 7760/371472 [36:47<28:44:26,  3.52it/s]
  2%|▏         | 7761/371472 [36:48<29:32:55,  3.42it/s]
  2%|▏         | 7762/371472 [36:48<28:46:08,  3.51it/s]
  2%|▏         | 7763/371472 [36:48<28:33:28,  3.54it/s]
  2%|▏         | 7764/371472 [36:48<27:59:34,  3.61it/s]
  2%|▏         | 7765/371472 [36:49<28:01:22,  3.61it/s]
  2%|▏         | 7766/371472 [36:49<27:52:05,  3.63it/s]
  2%|▏         | 7767/371472 [36:49<26:58:18,  3.75it/s]
  2%|▏         | 7768/371472 [36:50<26:55:45,  3.75it/s]
  2%|▏         | 7769/371472 [36:50<30:29:10,  3.31it/s]
  2%|▏         | 7770/371472 [36:50<29:09:09,  3.47it/s]
  2%|▏         | 7771/371472 [36:51<29:55:30,  3.38it/s]
  2%|▏         | 7772/371472 [36:51<31:03:28,  3.25it/s]
  2%|▏         | 7773/371472 [36:51<31:09:43,  3.24it/s]
  2%|▏         | 7774/371472 [36:51<30:48:06,  3.28it/s]
  2%|▏         | 7775/371472 [36:52<31:20:38,  3.22it/s]
  2%|▏         | 7776/371472 [36:52<32:04:30,  3.15it/s]
  2%|▏         | 7777/371472 [36:52<30:09:10,  3.35it/s]
  2%|▏         | 7778/371472 [36:53<30:54:57,  3.27it/s]
  2%|▏         | 7779/371472 [36:53<28:54:17,  3.50it/s]
  2%|▏         | 7780/371472 [36:53<28:25:21,  3.55it/s]
                                                        
{'loss': 4.8475, 'learning_rate': 9.81625331293499e-07, 'epoch': 0.34}

  2%|▏         | 7780/371472 [36:53<28:25:21,  3.55it/s]
  2%|▏         | 7781/371472 [36:54<32:00:03,  3.16it/s]
  2%|▏         | 7782/371472 [36:54<33:00:12,  3.06it/s]
  2%|▏         | 7783/371472 [36:54<31:54:11,  3.17it/s]
  2%|▏         | 7784/371472 [36:55<30:58:13,  3.26it/s]
  2%|▏         | 7785/371472 [36:55<30:25:19,  3.32it/s]
  2%|▏         | 7786/371472 [36:55<28:55:18,  3.49it/s]
  2%|▏         | 7787/371472 [36:55<29:08:57,  3.47it/s]
  2%|▏         | 7788/371472 [36:56<27:49:18,  3.63it/s]
  2%|▏         | 7789/371472 [36:56<27:47:22,  3.64it/s]
  2%|▏         | 7790/371472 [36:56<27:14:57,  3.71it/s]
  2%|▏         | 7791/371472 [36:56<28:28:25,  3.55it/s]
  2%|▏         | 7792/371472 [36:57<27:37:13,  3.66it/s]
  2%|▏         | 7793/371472 [36:57<27:36:37,  3.66it/s]
  2%|▏         | 7794/371472 [36:57<26:50:50,  3.76it/s]
  2%|▏         | 7795/371472 [36:58<28:04:15,  3.60it/s]
  2%|▏         | 7796/371472 [36:58<27:31:36,  3.67it/s]
  2%|▏         | 7797/371472 [36:58<29:48:53,  3.39it/s]
  2%|▏         | 7798/371472 [36:58<30:33:51,  3.31it/s]
  2%|▏         | 7799/371472 [36:59<30:43:48,  3.29it/s]
  2%|▏         | 7800/371472 [36:59<29:49:00,  3.39it/s]
                                                        
{'loss': 4.7601, 'learning_rate': 9.8157684931802e-07, 'epoch': 0.34}

  2%|▏         | 7800/371472 [36:59<29:49:00,  3.39it/s]
  2%|▏         | 7801/371472 [36:59<29:50:44,  3.38it/s]
  2%|▏         | 7802/371472 [37:00<28:25:39,  3.55it/s]
  2%|▏         | 7803/371472 [37:00<27:12:58,  3.71it/s]
  2%|▏         | 7804/371472 [37:00<27:07:31,  3.72it/s]
  2%|▏         | 7805/371472 [37:00<26:25:38,  3.82it/s]
  2%|▏         | 7806/371472 [37:01<26:46:59,  3.77it/s]
  2%|▏         | 7807/371472 [37:01<28:21:10,  3.56it/s]
  2%|▏         | 7808/371472 [37:01<28:12:21,  3.58it/s]
  2%|▏         | 7809/371472 [37:01<27:41:36,  3.65it/s]
  2%|▏         | 7810/371472 [37:02<27:11:10,  3.72it/s]
  2%|▏         | 7811/371472 [37:02<27:33:43,  3.67it/s]
  2%|▏         | 7812/371472 [37:02<26:41:30,  3.78it/s]
  2%|▏         | 7813/371472 [37:03<27:50:15,  3.63it/s]
  2%|▏         | 7814/371472 [37:03<26:53:48,  3.76it/s]
  2%|▏         | 7815/371472 [37:03<26:40:41,  3.79it/s]
  2%|▏         | 7816/371472 [37:03<28:04:23,  3.60it/s]
  2%|▏         | 7817/371472 [37:04<28:25:32,  3.55it/s]
  2%|▏         | 7818/371472 [37:04<28:03:28,  3.60it/s]
  2%|▏         | 7819/371472 [37:04<29:08:00,  3.47it/s]
  2%|▏         | 7820/371472 [37:05<29:09:53,  3.46it/s]
                                                        
{'loss': 4.9091, 'learning_rate': 9.815283673425413e-07, 'epoch': 0.34}

  2%|▏         | 7820/371472 [37:05<29:09:53,  3.46it/s]
  2%|▏         | 7821/371472 [37:05<29:41:39,  3.40it/s]
  2%|▏         | 7822/371472 [37:05<30:41:50,  3.29it/s]
  2%|▏         | 7823/371472 [37:05<29:23:04,  3.44it/s]
  2%|▏         | 7824/371472 [37:06<29:14:29,  3.45it/s]
  2%|▏         | 7825/371472 [37:06<28:10:39,  3.58it/s]
  2%|▏         | 7826/371472 [37:06<29:56:36,  3.37it/s]
  2%|▏         | 7827/371472 [37:07<30:05:19,  3.36it/s]
  2%|▏         | 7828/371472 [37:07<30:38:41,  3.30it/s]
  2%|▏         | 7829/371472 [37:07<29:09:25,  3.46it/s]
  2%|▏         | 7830/371472 [37:07<27:56:14,  3.62it/s]
  2%|▏         | 7831/371472 [37:08<27:27:44,  3.68it/s]
  2%|▏         | 7832/371472 [37:08<28:22:51,  3.56it/s]
  2%|▏         | 7833/371472 [37:08<28:21:54,  3.56it/s]
  2%|▏         | 7834/371472 [37:09<27:56:53,  3.61it/s]
  2%|▏         | 7835/371472 [37:09<28:09:11,  3.59it/s]
  2%|▏         | 7836/371472 [37:09<27:34:49,  3.66it/s]
  2%|▏         | 7837/371472 [37:09<26:49:56,  3.76it/s]
  2%|▏         | 7838/371472 [37:10<26:25:53,  3.82it/s]
  2%|▏         | 7839/371472 [37:10<26:35:43,  3.80it/s]
  2%|▏         | 7840/371472 [37:10<28:57:58,  3.49it/s]
                                                        
{'loss': 4.7602, 'learning_rate': 9.814798853670624e-07, 'epoch': 0.34}

  2%|▏         | 7840/371472 [37:10<28:57:58,  3.49it/s]
  2%|▏         | 7841/371472 [37:10<29:53:17,  3.38it/s]
  2%|▏         | 7842/371472 [37:11<29:40:51,  3.40it/s]
  2%|▏         | 7843/371472 [37:11<28:41:06,  3.52it/s]
  2%|▏         | 7844/371472 [37:11<30:22:54,  3.32it/s]
  2%|▏         | 7845/371472 [37:12<29:43:07,  3.40it/s]
  2%|▏         | 7846/371472 [37:12<29:53:53,  3.38it/s]
  2%|▏         | 7847/371472 [37:12<29:21:01,  3.44it/s]
  2%|▏         | 7848/371472 [37:13<31:49:14,  3.17it/s]
  2%|▏         | 7849/371472 [37:13<30:41:56,  3.29it/s]
  2%|▏         | 7850/371472 [37:13<29:23:00,  3.44it/s]
  2%|▏         | 7851/371472 [37:13<28:16:45,  3.57it/s]
  2%|▏         | 7852/371472 [37:14<27:36:36,  3.66it/s]
  2%|▏         | 7853/371472 [37:14<27:28:50,  3.68it/s]
  2%|▏         | 7854/371472 [37:14<28:02:47,  3.60it/s]
  2%|▏         | 7855/371472 [37:15<29:12:10,  3.46it/s]
  2%|▏         | 7856/371472 [37:15<31:37:30,  3.19it/s]
  2%|▏         | 7857/371472 [37:15<31:27:46,  3.21it/s]
  2%|▏         | 7858/371472 [37:16<30:44:57,  3.28it/s]
  2%|▏         | 7859/371472 [37:16<29:23:35,  3.44it/s]
  2%|▏         | 7860/371472 [37:16<29:10:04,  3.46it/s]
                                                        
{'loss': 4.9096, 'learning_rate': 9.814314033915835e-07, 'epoch': 0.34}

  2%|▏         | 7860/371472 [37:16<29:10:04,  3.46it/s]
  2%|▏         | 7861/371472 [37:16<30:27:37,  3.32it/s]
  2%|▏         | 7862/371472 [37:17<29:44:16,  3.40it/s]
  2%|▏         | 7863/371472 [37:17<29:31:56,  3.42it/s]
  2%|▏         | 7864/371472 [37:17<28:27:45,  3.55it/s]
  2%|▏         | 7865/371472 [37:17<27:31:31,  3.67it/s]
  2%|▏         | 7866/371472 [37:18<27:50:48,  3.63it/s]
  2%|▏         | 7867/371472 [37:18<27:34:22,  3.66it/s]
  2%|▏         | 7868/371472 [37:18<27:19:11,  3.70it/s]
  2%|▏         | 7869/371472 [37:19<27:01:51,  3.74it/s]
  2%|▏         | 7870/371472 [37:19<26:37:30,  3.79it/s]
  2%|▏         | 7871/371472 [37:19<25:59:14,  3.89it/s]
  2%|▏         | 7872/371472 [37:19<28:06:18,  3.59it/s]
  2%|▏         | 7873/371472 [37:20<28:42:06,  3.52it/s]
  2%|▏         | 7874/371472 [37:20<27:46:43,  3.64it/s]
  2%|▏         | 7875/371472 [37:20<27:45:28,  3.64it/s]
  2%|▏         | 7876/371472 [37:21<29:43:12,  3.40it/s]
  2%|▏         | 7877/371472 [37:21<28:31:51,  3.54it/s]
  2%|▏         | 7878/371472 [37:21<28:30:12,  3.54it/s]
  2%|▏         | 7879/371472 [37:21<28:39:05,  3.53it/s]
  2%|▏         | 7880/371472 [37:22<28:03:44,  3.60it/s]
                                                        
{'loss': 5.0443, 'learning_rate': 9.813829214161047e-07, 'epoch': 0.34}

  2%|▏         | 7880/371472 [37:22<28:03:44,  3.60it/s]
  2%|▏         | 7881/371472 [37:22<28:16:01,  3.57it/s]
  2%|▏         | 7882/371472 [37:22<27:46:37,  3.64it/s]
  2%|▏         | 7883/371472 [37:23<32:32:48,  3.10it/s]
  2%|▏         | 7884/371472 [37:23<31:21:54,  3.22it/s]
  2%|▏         | 7885/371472 [37:23<29:48:02,  3.39it/s]
  2%|▏         | 7886/371472 [37:23<28:24:00,  3.56it/s]
  2%|▏         | 7887/371472 [37:24<29:34:47,  3.41it/s]
  2%|▏         | 7888/371472 [37:24<29:24:41,  3.43it/s]
  2%|▏         | 7889/371472 [37:24<28:52:49,  3.50it/s]
  2%|▏         | 7890/371472 [37:25<29:14:04,  3.45it/s]
  2%|▏         | 7891/371472 [37:25<27:47:06,  3.63it/s]
  2%|▏         | 7892/371472 [37:25<27:36:39,  3.66it/s]
  2%|▏         | 7893/371472 [37:25<27:46:55,  3.64it/s]
  2%|▏         | 7894/371472 [37:26<27:31:13,  3.67it/s]
  2%|▏         | 7895/371472 [37:26<27:34:22,  3.66it/s]
  2%|▏         | 7896/371472 [37:26<26:50:30,  3.76it/s]
  2%|▏         | 7897/371472 [37:26<26:01:43,  3.88it/s]
  2%|▏         | 7898/371472 [37:27<26:29:51,  3.81it/s]
  2%|▏         | 7899/371472 [37:27<26:51:58,  3.76it/s]
  2%|▏         | 7900/371472 [37:27<28:10:53,  3.58it/s]
                                                        
{'loss': 4.9772, 'learning_rate': 9.813344394406256e-07, 'epoch': 0.34}

  2%|▏         | 7900/371472 [37:27<28:10:53,  3.58it/s]
  2%|▏         | 7901/371472 [37:28<28:32:14,  3.54it/s]
  2%|▏         | 7902/371472 [37:28<29:16:11,  3.45it/s]
  2%|▏         | 7903/371472 [37:28<30:33:47,  3.30it/s]
  2%|▏         | 7904/371472 [37:29<32:51:36,  3.07it/s]
  2%|▏         | 7905/371472 [37:29<30:18:12,  3.33it/s]
  2%|▏         | 7906/371472 [37:29<30:48:31,  3.28it/s]
  2%|▏         | 7907/371472 [37:29<30:35:53,  3.30it/s]
  2%|▏         | 7908/371472 [37:30<29:41:10,  3.40it/s]
  2%|▏         | 7909/371472 [37:30<29:07:09,  3.47it/s]
  2%|▏         | 7910/371472 [37:30<28:07:04,  3.59it/s]
  2%|▏         | 7911/371472 [37:30<27:19:40,  3.70it/s]
  2%|▏         | 7912/371472 [37:31<26:51:29,  3.76it/s]
  2%|▏         | 7913/371472 [37:31<28:41:22,  3.52it/s]
  2%|▏         | 7914/371472 [37:31<28:13:01,  3.58it/s]
  2%|▏         | 7915/371472 [37:32<28:11:22,  3.58it/s]
  2%|▏         | 7916/371472 [37:32<31:58:37,  3.16it/s]
  2%|▏         | 7917/371472 [37:32<30:39:07,  3.29it/s]
  2%|▏         | 7918/371472 [37:33<29:03:12,  3.48it/s]
  2%|▏         | 7919/371472 [37:33<27:57:24,  3.61it/s]
  2%|▏         | 7920/371472 [37:33<28:39:13,  3.52it/s]
                                                        
{'loss': 4.8295, 'learning_rate': 9.812859574651469e-07, 'epoch': 0.34}

  2%|▏         | 7920/371472 [37:33<28:39:13,  3.52it/s]
  2%|▏         | 7921/371472 [37:33<28:45:32,  3.51it/s]
  2%|▏         | 7922/371472 [37:34<29:43:53,  3.40it/s]
  2%|▏         | 7923/371472 [37:34<29:09:03,  3.46it/s]
  2%|▏         | 7924/371472 [37:34<27:45:39,  3.64it/s]
  2%|▏         | 7925/371472 [37:35<29:10:03,  3.46it/s]
  2%|▏         | 7926/371472 [37:35<28:05:50,  3.59it/s]
  2%|▏         | 7927/371472 [37:35<28:15:57,  3.57it/s]
  2%|▏         | 7928/371472 [37:35<28:40:37,  3.52it/s]
  2%|▏         | 7929/371472 [37:36<31:59:26,  3.16it/s]
  2%|▏         | 7930/371472 [37:36<30:34:47,  3.30it/s]
  2%|▏         | 7931/371472 [37:36<29:25:48,  3.43it/s]
  2%|▏         | 7932/371472 [37:37<28:08:47,  3.59it/s]
  2%|▏         | 7933/371472 [37:37<27:14:58,  3.71it/s]
  2%|▏         | 7934/371472 [37:37<27:25:11,  3.68it/s]
  2%|▏         | 7935/371472 [37:37<27:02:59,  3.73it/s]
  2%|▏         | 7936/371472 [37:38<27:25:06,  3.68it/s]
  2%|▏         | 7937/371472 [37:38<26:59:58,  3.74it/s]
  2%|▏         | 7938/371472 [37:38<29:07:07,  3.47it/s]
  2%|▏         | 7939/371472 [37:38<29:26:23,  3.43it/s]
  2%|▏         | 7940/371472 [37:39<29:34:43,  3.41it/s]
                                                        
{'loss': 5.0334, 'learning_rate': 9.812374754896678e-07, 'epoch': 0.34}

  2%|▏         | 7940/371472 [37:39<29:34:43,  3.41it/s]
  2%|▏         | 7941/371472 [37:39<28:13:25,  3.58it/s]
  2%|▏         | 7942/371472 [37:39<28:05:56,  3.59it/s]
  2%|▏         | 7943/371472 [37:40<28:42:48,  3.52it/s]
  2%|▏         | 7944/371472 [37:40<27:53:51,  3.62it/s]
  2%|▏         | 7945/371472 [37:40<26:53:16,  3.76it/s]
  2%|▏         | 7946/371472 [37:40<30:05:39,  3.36it/s]
  2%|▏         | 7947/371472 [37:41<28:47:19,  3.51it/s]
  2%|▏         | 7948/371472 [37:41<28:59:08,  3.48it/s]
  2%|▏         | 7949/371472 [37:41<27:50:47,  3.63it/s]
  2%|▏         | 7950/371472 [37:42<28:50:19,  3.50it/s]
  2%|▏         | 7951/371472 [37:42<28:57:21,  3.49it/s]
  2%|▏         | 7952/371472 [37:42<27:35:47,  3.66it/s]
  2%|▏         | 7953/371472 [37:42<26:58:18,  3.74it/s]
  2%|▏         | 7954/371472 [37:43<26:31:29,  3.81it/s]
  2%|▏         | 7955/371472 [37:43<26:21:16,  3.83it/s]
  2%|▏         | 7956/371472 [37:43<28:08:14,  3.59it/s]
  2%|▏         | 7957/371472 [37:43<27:56:54,  3.61it/s]
  2%|▏         | 7958/371472 [37:44<28:52:53,  3.50it/s]
  2%|▏         | 7959/371472 [37:44<30:09:53,  3.35it/s]
  2%|▏         | 7960/371472 [37:44<30:38:00,  3.30it/s]
                                                        
{'loss': 4.8409, 'learning_rate': 9.81188993514189e-07, 'epoch': 0.34}

  2%|▏         | 7960/371472 [37:44<30:38:00,  3.30it/s]
  2%|▏         | 7961/371472 [37:45<29:02:47,  3.48it/s]
  2%|▏         | 7962/371472 [37:45<27:45:25,  3.64it/s]
  2%|▏         | 7963/371472 [37:45<27:09:01,  3.72it/s]
  2%|▏         | 7964/371472 [37:45<28:07:35,  3.59it/s]
  2%|▏         | 7965/371472 [37:46<28:20:55,  3.56it/s]
  2%|▏         | 7966/371472 [37:46<28:58:03,  3.49it/s]
  2%|▏         | 7967/371472 [37:46<28:42:03,  3.52it/s]
  2%|▏         | 7968/371472 [37:47<28:50:21,  3.50it/s]
  2%|▏         | 7969/371472 [37:47<27:39:48,  3.65it/s]
  2%|▏         | 7970/371472 [37:47<27:55:26,  3.62it/s]
  2%|▏         | 7971/371472 [37:47<29:17:37,  3.45it/s]
  2%|▏         | 7972/371472 [37:48<27:45:29,  3.64it/s]
  2%|▏         | 7973/371472 [37:48<26:49:56,  3.76it/s]
  2%|▏         | 7974/371472 [37:48<27:31:06,  3.67it/s]
  2%|▏         | 7975/371472 [37:49<28:08:12,  3.59it/s]
  2%|▏         | 7976/371472 [37:49<26:49:32,  3.76it/s]
  2%|▏         | 7977/371472 [37:49<27:05:03,  3.73it/s]
  2%|▏         | 7978/371472 [37:49<26:46:50,  3.77it/s]
  2%|▏         | 7979/371472 [37:50<26:20:43,  3.83it/s]
  2%|▏         | 7980/371472 [37:50<26:30:01,  3.81it/s]
                                                        
{'loss': 4.7826, 'learning_rate': 9.811405115387101e-07, 'epoch': 0.34}

  2%|▏         | 7980/371472 [37:50<26:30:01,  3.81it/s]
  2%|▏         | 7981/371472 [37:50<27:04:06,  3.73it/s]
  2%|▏         | 7982/371472 [37:50<26:48:49,  3.77it/s]
  2%|▏         | 7983/371472 [37:51<26:54:04,  3.75it/s]
  2%|▏         | 7984/371472 [37:51<28:30:18,  3.54it/s]
  2%|▏         | 7985/371472 [37:51<28:52:23,  3.50it/s]
  2%|▏         | 7986/371472 [37:51<27:50:33,  3.63it/s]
  2%|▏         | 7987/371472 [37:52<29:05:32,  3.47it/s]
  2%|▏         | 7988/371472 [37:52<29:47:50,  3.39it/s]
  2%|▏         | 7989/371472 [37:52<29:40:23,  3.40it/s]
  2%|▏         | 7990/371472 [37:53<28:04:47,  3.60it/s]
  2%|▏         | 7991/371472 [37:53<27:50:33,  3.63it/s]
  2%|▏         | 7992/371472 [37:53<28:35:44,  3.53it/s]
  2%|▏         | 7993/371472 [37:53<28:32:01,  3.54it/s]
  2%|▏         | 7994/371472 [37:54<30:40:29,  3.29it/s]
  2%|▏         | 7995/371472 [37:54<37:07:55,  2.72it/s]
  2%|▏         | 7996/371472 [37:55<34:52:47,  2.89it/s]
  2%|▏         | 7997/371472 [37:55<32:21:15,  3.12it/s]
  2%|▏         | 7998/371472 [37:55<33:19:08,  3.03it/s]
  2%|▏         | 7999/371472 [37:56<31:16:36,  3.23it/s]
  2%|▏         | 8000/371472 [37:56<29:31:37,  3.42it/s]
                                                        
{'loss': 4.8348, 'learning_rate': 9.810920295632312e-07, 'epoch': 0.34}

  2%|▏         | 8000/371472 [37:56<29:31:37,  3.42it/s]
  2%|▏         | 8001/371472 [37:56<29:03:58,  3.47it/s]
  2%|▏         | 8002/371472 [37:56<29:03:11,  3.48it/s]
  2%|▏         | 8003/371472 [37:57<28:35:44,  3.53it/s]
  2%|▏         | 8004/371472 [37:57<29:38:33,  3.41it/s]
  2%|▏         | 8005/371472 [37:57<29:14:44,  3.45it/s]
  2%|▏         | 8006/371472 [37:57<28:14:12,  3.58it/s]
  2%|▏         | 8007/371472 [37:58<28:47:42,  3.51it/s]
  2%|▏         | 8008/371472 [37:58<28:31:09,  3.54it/s]
  2%|▏         | 8009/371472 [37:58<27:57:48,  3.61it/s]
  2%|▏         | 8010/371472 [37:59<28:12:49,  3.58it/s]
  2%|▏         | 8011/371472 [37:59<28:28:37,  3.55it/s]
  2%|▏         | 8012/371472 [37:59<29:06:15,  3.47it/s]
  2%|▏         | 8013/371472 [37:59<28:57:13,  3.49it/s]
  2%|▏         | 8014/371472 [38:00<29:10:34,  3.46it/s]
  2%|▏         | 8015/371472 [38:00<28:04:36,  3.60it/s]
  2%|▏         | 8016/371472 [38:00<27:13:17,  3.71it/s]
  2%|▏         | 8017/371472 [38:01<27:36:00,  3.66it/s]
  2%|▏         | 8018/371472 [38:01<27:45:42,  3.64it/s]
  2%|▏         | 8019/371472 [38:01<28:13:20,  3.58it/s]
  2%|▏         | 8020/371472 [38:01<28:07:27,  3.59it/s]
                                                        
{'loss': 4.8643, 'learning_rate': 9.810435475877525e-07, 'epoch': 0.35}

  2%|▏         | 8020/371472 [38:01<28:07:27,  3.59it/s]
  2%|▏         | 8021/371472 [38:02<28:34:14,  3.53it/s]
  2%|▏         | 8022/371472 [38:02<28:45:23,  3.51it/s]
  2%|▏         | 8023/371472 [38:02<27:12:12,  3.71it/s]
  2%|▏         | 8024/371472 [38:03<28:01:30,  3.60it/s]
  2%|▏         | 8025/371472 [38:03<27:42:39,  3.64it/s]
  2%|▏         | 8026/371472 [38:03<26:44:40,  3.77it/s]
  2%|▏         | 8027/371472 [38:03<27:26:22,  3.68it/s]
  2%|▏         | 8028/371472 [38:04<27:14:20,  3.71it/s]
  2%|▏         | 8029/371472 [38:04<26:52:10,  3.76it/s]
  2%|▏         | 8030/371472 [38:04<27:17:31,  3.70it/s]
  2%|▏         | 8031/371472 [38:04<29:03:58,  3.47it/s]
  2%|▏         | 8032/371472 [38:05<28:10:59,  3.58it/s]
  2%|▏         | 8033/371472 [38:05<27:43:21,  3.64it/s]
  2%|▏         | 8034/371472 [38:05<28:05:14,  3.59it/s]
  2%|▏         | 8035/371472 [38:06<32:09:13,  3.14it/s]
  2%|▏         | 8036/371472 [38:06<31:49:26,  3.17it/s]
  2%|▏         | 8037/371472 [38:06<31:27:20,  3.21it/s]
  2%|▏         | 8038/371472 [38:07<29:43:34,  3.40it/s]
  2%|▏         | 8039/371472 [38:07<28:00:58,  3.60it/s]
  2%|▏         | 8040/371472 [38:07<28:11:03,  3.58it/s]
                                                        
{'loss': 5.0973, 'learning_rate': 9.809950656122733e-07, 'epoch': 0.35}

  2%|▏         | 8040/371472 [38:07<28:11:03,  3.58it/s]
  2%|▏         | 8041/371472 [38:07<27:44:51,  3.64it/s]
  2%|▏         | 8042/371472 [38:08<27:25:11,  3.68it/s]
  2%|▏         | 8043/371472 [38:08<27:41:23,  3.65it/s]
  2%|▏         | 8044/371472 [38:08<28:14:50,  3.57it/s]
  2%|▏         | 8045/371472 [38:08<28:30:27,  3.54it/s]
  2%|▏         | 8046/371472 [38:09<28:29:53,  3.54it/s]
  2%|▏         | 8047/371472 [38:09<30:38:37,  3.29it/s]
  2%|▏         | 8048/371472 [38:09<29:41:32,  3.40it/s]
  2%|▏         | 8049/371472 [38:10<31:28:39,  3.21it/s]
  2%|▏         | 8050/371472 [38:10<29:55:29,  3.37it/s]
  2%|▏         | 8051/371472 [38:10<29:11:45,  3.46it/s]
  2%|▏         | 8052/371472 [38:11<31:34:04,  3.20it/s]
  2%|▏         | 8053/371472 [38:11<31:46:21,  3.18it/s]
  2%|▏         | 8054/371472 [38:11<29:32:14,  3.42it/s]
  2%|▏         | 8055/371472 [38:12<31:12:30,  3.23it/s]
  2%|▏         | 8056/371472 [38:12<32:33:14,  3.10it/s]
  2%|▏         | 8057/371472 [38:12<29:48:06,  3.39it/s]
  2%|▏         | 8058/371472 [38:12<29:49:10,  3.39it/s]
  2%|▏         | 8059/371472 [38:13<29:13:02,  3.46it/s]
  2%|▏         | 8060/371472 [38:13<28:46:27,  3.51it/s]
                                                        
{'loss': 4.9742, 'learning_rate': 9.809465836367946e-07, 'epoch': 0.35}

  2%|▏         | 8060/371472 [38:13<28:46:27,  3.51it/s]
  2%|▏         | 8061/371472 [38:13<29:58:12,  3.37it/s]
  2%|▏         | 8062/371472 [38:14<29:56:12,  3.37it/s]
  2%|▏         | 8063/371472 [38:14<29:37:53,  3.41it/s]
  2%|▏         | 8064/371472 [38:14<30:51:44,  3.27it/s]
  2%|▏         | 8065/371472 [38:14<30:20:07,  3.33it/s]
  2%|▏         | 8066/371472 [38:15<30:23:44,  3.32it/s]
  2%|▏         | 8067/371472 [38:15<29:52:13,  3.38it/s]
  2%|▏         | 8068/371472 [38:15<28:15:08,  3.57it/s]
  2%|▏         | 8069/371472 [38:16<27:21:47,  3.69it/s]
  2%|▏         | 8070/371472 [38:16<26:52:20,  3.76it/s]
  2%|▏         | 8071/371472 [38:16<27:17:02,  3.70it/s]
  2%|▏         | 8072/371472 [38:16<27:03:05,  3.73it/s]
  2%|▏         | 8073/371472 [38:17<29:30:43,  3.42it/s]
  2%|▏         | 8074/371472 [38:17<31:20:25,  3.22it/s]
  2%|▏         | 8075/371472 [38:17<32:46:24,  3.08it/s]
  2%|▏         | 8076/371472 [38:18<31:20:35,  3.22it/s]
  2%|▏         | 8077/371472 [38:18<29:24:06,  3.43it/s]
  2%|▏         | 8078/371472 [38:18<29:16:43,  3.45it/s]
  2%|▏         | 8079/371472 [38:18<28:35:53,  3.53it/s]
  2%|▏         | 8080/371472 [38:19<30:01:17,  3.36it/s]
                                                        
{'loss': 4.8906, 'learning_rate': 9.808981016613157e-07, 'epoch': 0.35}

  2%|▏         | 8080/371472 [38:19<30:01:17,  3.36it/s]
  2%|▏         | 8081/371472 [38:19<30:44:19,  3.28it/s]
  2%|▏         | 8082/371472 [38:19<29:05:07,  3.47it/s]
  2%|▏         | 8083/371472 [38:20<28:42:32,  3.52it/s]
  2%|▏         | 8084/371472 [38:20<30:09:36,  3.35it/s]
  2%|▏         | 8085/371472 [38:20<30:29:18,  3.31it/s]
  2%|▏         | 8086/371472 [38:21<30:48:43,  3.28it/s]
  2%|▏         | 8087/371472 [38:21<29:35:02,  3.41it/s]
  2%|▏         | 8088/371472 [38:21<28:58:04,  3.48it/s]
  2%|▏         | 8089/371472 [38:22<30:48:18,  3.28it/s]
  2%|▏         | 8090/371472 [38:22<29:34:45,  3.41it/s]
  2%|▏         | 8091/371472 [38:22<32:13:49,  3.13it/s]
  2%|▏         | 8092/371472 [38:22<31:50:01,  3.17it/s]
  2%|▏         | 8093/371472 [38:23<29:32:03,  3.42it/s]
  2%|▏         | 8094/371472 [38:23<29:29:28,  3.42it/s]
  2%|▏         | 8095/371472 [38:23<30:32:10,  3.31it/s]
  2%|▏         | 8096/371472 [38:24<28:51:46,  3.50it/s]
  2%|▏         | 8097/371472 [38:24<32:16:01,  3.13it/s]
  2%|▏         | 8098/371472 [38:24<32:34:47,  3.10it/s]
  2%|▏         | 8099/371472 [38:25<31:36:06,  3.19it/s]
  2%|▏         | 8100/371472 [38:25<30:17:55,  3.33it/s]
                                                        
{'loss': 4.6369, 'learning_rate': 9.808496196858367e-07, 'epoch': 0.35}

  2%|▏         | 8100/371472 [38:25<30:17:55,  3.33it/s]
  2%|▏         | 8101/371472 [38:25<29:52:13,  3.38it/s]
  2%|▏         | 8102/371472 [38:25<29:31:38,  3.42it/s]
  2%|▏         | 8103/371472 [38:26<28:45:19,  3.51it/s]
  2%|▏         | 8104/371472 [38:26<29:26:48,  3.43it/s]
  2%|▏         | 8105/371472 [38:26<28:49:06,  3.50it/s]
  2%|▏         | 8106/371472 [38:27<27:19:07,  3.69it/s]
  2%|▏         | 8107/371472 [38:27<28:08:06,  3.59it/s]
  2%|▏         | 8108/371472 [38:27<27:43:24,  3.64it/s]
  2%|▏         | 8109/371472 [38:27<27:31:23,  3.67it/s]
  2%|▏         | 8110/371472 [38:28<27:17:19,  3.70it/s]
  2%|▏         | 8111/371472 [38:28<27:29:33,  3.67it/s]
  2%|▏         | 8112/371472 [38:28<27:03:50,  3.73it/s]
  2%|▏         | 8113/371472 [38:28<27:11:15,  3.71it/s]
  2%|▏         | 8114/371472 [38:29<26:39:53,  3.79it/s]
  2%|▏         | 8115/371472 [38:29<26:31:23,  3.81it/s]
  2%|▏         | 8116/371472 [38:29<26:13:01,  3.85it/s]
  2%|▏         | 8117/371472 [38:29<27:11:17,  3.71it/s]
  2%|▏         | 8118/371472 [38:30<26:41:07,  3.78it/s]
  2%|▏         | 8119/371472 [38:30<26:51:32,  3.76it/s]
  2%|▏         | 8120/371472 [38:30<28:30:24,  3.54it/s]
                                                        
{'loss': 4.9755, 'learning_rate': 9.80801137710358e-07, 'epoch': 0.35}

  2%|▏         | 8120/371472 [38:30<28:30:24,  3.54it/s]
  2%|▏         | 8121/371472 [38:31<27:20:54,  3.69it/s]
  2%|▏         | 8122/371472 [38:31<28:01:16,  3.60it/s]
  2%|▏         | 8123/371472 [38:31<28:00:09,  3.60it/s]
  2%|▏         | 8124/371472 [38:31<26:53:34,  3.75it/s]
  2%|▏         | 8125/371472 [38:32<25:54:19,  3.90it/s]
  2%|▏         | 8126/371472 [38:32<26:40:00,  3.78it/s]
  2%|▏         | 8127/371472 [38:32<26:28:12,  3.81it/s]
  2%|▏         | 8128/371472 [38:32<27:03:51,  3.73it/s]
  2%|▏         | 8129/371472 [38:33<27:03:41,  3.73it/s]
  2%|▏         | 8130/371472 [38:33<31:21:31,  3.22it/s]
  2%|▏         | 8131/371472 [38:33<30:29:44,  3.31it/s]
  2%|▏         | 8132/371472 [38:34<29:02:43,  3.47it/s]
  2%|▏         | 8133/371472 [38:34<30:03:59,  3.36it/s]
  2%|▏         | 8134/371472 [38:34<30:29:08,  3.31it/s]
  2%|▏         | 8135/371472 [38:35<31:20:04,  3.22it/s]
  2%|▏         | 8136/371472 [38:35<31:05:24,  3.25it/s]
  2%|▏         | 8137/371472 [38:35<30:18:52,  3.33it/s]
  2%|▏         | 8138/371472 [38:36<30:56:41,  3.26it/s]
  2%|▏         | 8139/371472 [38:36<29:11:34,  3.46it/s]
  2%|▏         | 8140/371472 [38:36<31:32:50,  3.20it/s]
                                                        
{'loss': 4.7116, 'learning_rate': 9.807526557348789e-07, 'epoch': 0.35}

  2%|▏         | 8140/371472 [38:36<31:32:50,  3.20it/s]
  2%|▏         | 8141/371472 [38:36<30:21:10,  3.33it/s]
  2%|▏         | 8142/371472 [38:37<30:06:04,  3.35it/s]
  2%|▏         | 8143/371472 [38:37<31:21:02,  3.22it/s]
  2%|▏         | 8144/371472 [38:37<30:38:25,  3.29it/s]
  2%|▏         | 8145/371472 [38:38<29:31:36,  3.42it/s]
  2%|▏         | 8146/371472 [38:38<27:50:59,  3.62it/s]
  2%|▏         | 8147/371472 [38:38<27:27:43,  3.68it/s]
  2%|▏         | 8148/371472 [38:38<29:41:50,  3.40it/s]
  2%|▏         | 8149/371472 [38:39<28:51:38,  3.50it/s]
  2%|▏         | 8150/371472 [38:39<27:53:04,  3.62it/s]
  2%|▏         | 8151/371472 [38:39<27:24:11,  3.68it/s]
  2%|▏         | 8152/371472 [38:39<28:04:00,  3.60it/s]
  2%|▏         | 8153/371472 [38:40<27:51:39,  3.62it/s]
  2%|▏         | 8154/371472 [38:40<27:03:21,  3.73it/s]
  2%|▏         | 8155/371472 [38:40<28:15:28,  3.57it/s]
  2%|▏         | 8156/371472 [38:41<29:07:12,  3.47it/s]
  2%|▏         | 8157/371472 [38:41<28:01:55,  3.60it/s]
  2%|▏         | 8158/371472 [38:41<27:25:47,  3.68it/s]
  2%|▏         | 8159/371472 [38:41<27:24:10,  3.68it/s]
  2%|▏         | 8160/371472 [38:42<34:35:11,  2.92it/s]
                                                        
{'loss': 4.7687, 'learning_rate': 9.807041737594002e-07, 'epoch': 0.35}

  2%|▏         | 8160/371472 [38:42<34:35:11,  2.92it/s]
  2%|▏         | 8161/371472 [38:42<33:01:40,  3.06it/s]
  2%|▏         | 8162/371472 [38:43<35:11:50,  2.87it/s]
  2%|▏         | 8163/371472 [38:43<33:26:58,  3.02it/s]
  2%|▏         | 8164/371472 [38:43<31:13:21,  3.23it/s]
  2%|▏         | 8165/371472 [38:43<30:05:14,  3.35it/s]
  2%|▏         | 8166/371472 [38:44<29:05:12,  3.47it/s]
  2%|▏         | 8167/371472 [38:44<27:27:41,  3.67it/s]
  2%|▏         | 8168/371472 [38:44<27:28:33,  3.67it/s]
  2%|▏         | 8169/371472 [38:44<28:01:00,  3.60it/s]
  2%|▏         | 8170/371472 [38:45<27:41:20,  3.64it/s]
  2%|▏         | 8171/371472 [38:45<26:54:04,  3.75it/s]
  2%|▏         | 8172/371472 [38:45<27:51:56,  3.62it/s]
  2%|▏         | 8173/371472 [38:46<28:54:20,  3.49it/s]
  2%|▏         | 8174/371472 [38:46<28:01:50,  3.60it/s]
  2%|▏         | 8175/371472 [38:46<29:02:57,  3.47it/s]
  2%|▏         | 8176/371472 [38:46<28:24:19,  3.55it/s]
  2%|▏         | 8177/371472 [38:47<30:04:39,  3.36it/s]
  2%|▏         | 8178/371472 [38:47<29:03:06,  3.47it/s]
  2%|▏         | 8179/371472 [38:47<28:14:58,  3.57it/s]
  2%|▏         | 8180/371472 [38:48<28:39:09,  3.52it/s]
                                                        
{'loss': 4.9314, 'learning_rate': 9.80655691783921e-07, 'epoch': 0.35}

  2%|▏         | 8180/371472 [38:48<28:39:09,  3.52it/s]
  2%|▏         | 8181/371472 [38:48<29:12:00,  3.46it/s]
  2%|▏         | 8182/371472 [38:48<28:38:56,  3.52it/s]
  2%|▏         | 8183/371472 [38:48<27:37:36,  3.65it/s]
  2%|▏         | 8184/371472 [38:49<27:33:36,  3.66it/s]
  2%|▏         | 8185/371472 [38:49<28:32:40,  3.54it/s]
  2%|▏         | 8186/371472 [38:49<29:15:57,  3.45it/s]
  2%|▏         | 8187/371472 [38:50<28:17:14,  3.57it/s]
  2%|▏         | 8188/371472 [38:50<31:11:34,  3.24it/s]
  2%|▏         | 8189/371472 [38:50<29:13:59,  3.45it/s]
  2%|▏         | 8190/371472 [38:50<29:03:04,  3.47it/s]
  2%|▏         | 8191/371472 [38:51<28:32:51,  3.53it/s]
  2%|▏         | 8192/371472 [38:51<29:04:49,  3.47it/s]
  2%|▏         | 8193/371472 [38:51<28:19:43,  3.56it/s]
  2%|▏         | 8194/371472 [38:52<28:01:42,  3.60it/s]
  2%|▏         | 8195/371472 [38:52<29:50:59,  3.38it/s]
  2%|▏         | 8196/371472 [38:52<29:32:50,  3.42it/s]
  2%|▏         | 8197/371472 [38:52<27:43:06,  3.64it/s]
  2%|▏         | 8198/371472 [38:53<27:21:48,  3.69it/s]
  2%|▏         | 8199/371472 [38:53<28:05:36,  3.59it/s]
  2%|▏         | 8200/371472 [38:53<26:45:09,  3.77it/s]
                                                        
{'loss': 5.0838, 'learning_rate': 9.806072098084423e-07, 'epoch': 0.35}

  2%|▏         | 8200/371472 [38:53<26:45:09,  3.77it/s]
  2%|▏         | 8201/371472 [38:54<27:25:46,  3.68it/s]
  2%|▏         | 8202/371472 [38:54<28:04:15,  3.59it/s]
  2%|▏         | 8203/371472 [38:54<29:44:32,  3.39it/s]
  2%|▏         | 8204/371472 [38:55<32:10:21,  3.14it/s]
  2%|▏         | 8205/371472 [38:55<30:58:03,  3.26it/s]
  2%|▏         | 8206/371472 [38:55<31:09:22,  3.24it/s]
  2%|▏         | 8207/371472 [38:55<32:26:13,  3.11it/s]
  2%|▏         | 8208/371472 [38:56<29:52:09,  3.38it/s]
  2%|▏         | 8209/371472 [38:56<28:05:22,  3.59it/s]
  2%|▏         | 8210/371472 [38:56<26:47:46,  3.77it/s]
  2%|▏         | 8211/371472 [38:56<28:24:03,  3.55it/s]
  2%|▏         | 8212/371472 [38:57<28:09:23,  3.58it/s]
  2%|▏         | 8213/371472 [38:57<30:45:18,  3.28it/s]
  2%|▏         | 8214/371472 [38:57<30:19:46,  3.33it/s]
  2%|▏         | 8215/371472 [38:58<29:58:09,  3.37it/s]
  2%|▏         | 8216/371472 [38:58<28:38:00,  3.52it/s]
  2%|▏         | 8217/371472 [38:58<28:44:04,  3.51it/s]
  2%|▏         | 8218/371472 [38:59<28:15:26,  3.57it/s]
  2%|▏         | 8219/371472 [38:59<30:04:38,  3.35it/s]
  2%|▏         | 8220/371472 [38:59<30:32:33,  3.30it/s]
                                                        
{'loss': 5.0102, 'learning_rate': 9.805587278329634e-07, 'epoch': 0.35}

  2%|▏         | 8220/371472 [38:59<30:32:33,  3.30it/s]
  2%|▏         | 8221/371472 [38:59<30:29:10,  3.31it/s]
  2%|▏         | 8222/371472 [39:00<29:25:01,  3.43it/s]
  2%|▏         | 8223/371472 [39:00<28:11:25,  3.58it/s]
  2%|▏         | 8224/371472 [39:00<29:57:41,  3.37it/s]
  2%|▏         | 8225/371472 [39:01<29:23:47,  3.43it/s]
  2%|▏         | 8226/371472 [39:01<28:00:03,  3.60it/s]
  2%|▏         | 8227/371472 [39:01<28:01:04,  3.60it/s]
  2%|▏         | 8228/371472 [39:01<27:05:50,  3.72it/s]
  2%|▏         | 8229/371472 [39:02<28:26:26,  3.55it/s]
  2%|▏         | 8230/371472 [39:02<28:12:15,  3.58it/s]
  2%|▏         | 8231/371472 [39:02<28:34:22,  3.53it/s]
  2%|▏         | 8232/371472 [39:03<28:16:54,  3.57it/s]
  2%|▏         | 8233/371472 [39:03<30:22:56,  3.32it/s]
  2%|▏         | 8234/371472 [39:03<29:40:33,  3.40it/s]
  2%|▏         | 8235/371472 [39:03<30:56:59,  3.26it/s]
  2%|▏         | 8236/371472 [39:04<29:35:41,  3.41it/s]
  2%|▏         | 8237/371472 [39:04<28:58:21,  3.48it/s]
  2%|▏         | 8238/371472 [39:04<28:28:53,  3.54it/s]
  2%|▏         | 8239/371472 [39:05<27:20:35,  3.69it/s]
  2%|▏         | 8240/371472 [39:05<30:02:41,  3.36it/s]
                                                        
{'loss': 5.0401, 'learning_rate': 9.805102458574845e-07, 'epoch': 0.35}

  2%|▏         | 8240/371472 [39:05<30:02:41,  3.36it/s]
  2%|▏         | 8241/371472 [39:05<29:51:33,  3.38it/s]
  2%|▏         | 8242/371472 [39:05<28:31:22,  3.54it/s]
  2%|▏         | 8243/371472 [39:06<29:31:21,  3.42it/s]
  2%|▏         | 8244/371472 [39:06<30:15:31,  3.33it/s]
  2%|▏         | 8245/371472 [39:06<30:47:34,  3.28it/s]
  2%|▏         | 8246/371472 [39:07<29:42:14,  3.40it/s]
  2%|▏         | 8247/371472 [39:07<30:07:10,  3.35it/s]
  2%|▏         | 8248/371472 [39:07<29:01:46,  3.48it/s]
  2%|▏         | 8249/371472 [39:08<28:19:42,  3.56it/s]
  2%|▏         | 8250/371472 [39:08<27:42:26,  3.64it/s]
  2%|▏         | 8251/371472 [39:08<27:54:59,  3.61it/s]
  2%|▏         | 8252/371472 [39:08<28:20:49,  3.56it/s]
  2%|▏         | 8253/371472 [39:09<27:32:07,  3.66it/s]
  2%|▏         | 8254/371472 [39:09<27:45:09,  3.64it/s]
  2%|▏         | 8255/371472 [39:09<27:06:16,  3.72it/s]
  2%|▏         | 8256/371472 [39:09<27:36:09,  3.66it/s]
  2%|▏         | 8257/371472 [39:10<29:01:48,  3.48it/s]
  2%|▏         | 8258/371472 [39:10<27:51:05,  3.62it/s]
  2%|▏         | 8259/371472 [39:10<27:40:58,  3.64it/s]
  2%|▏         | 8260/371472 [39:11<27:00:59,  3.73it/s]
                                                        
{'loss': 4.9059, 'learning_rate': 9.804617638820057e-07, 'epoch': 0.36}

  2%|▏         | 8260/371472 [39:11<27:00:59,  3.73it/s]
  2%|▏         | 8261/371472 [39:11<27:01:00,  3.73it/s]
  2%|▏         | 8262/371472 [39:11<27:25:48,  3.68it/s]
  2%|▏         | 8263/371472 [39:11<29:59:29,  3.36it/s]
  2%|▏         | 8264/371472 [39:12<29:02:47,  3.47it/s]
  2%|▏         | 8265/371472 [39:12<28:53:01,  3.49it/s]
  2%|▏         | 8266/371472 [39:12<27:47:34,  3.63it/s]
  2%|▏         | 8267/371472 [39:12<27:29:30,  3.67it/s]
  2%|▏         | 8268/371472 [39:13<27:37:12,  3.65it/s]
  2%|▏         | 8269/371472 [39:13<29:34:45,  3.41it/s]
  2%|▏         | 8270/371472 [39:13<29:38:26,  3.40it/s]
  2%|▏         | 8271/371472 [39:14<29:17:52,  3.44it/s]
  2%|▏         | 8272/371472 [39:14<27:44:17,  3.64it/s]
  2%|▏         | 8273/371472 [39:14<27:09:27,  3.71it/s]
  2%|▏         | 8274/371472 [39:15<30:15:03,  3.34it/s]
  2%|▏         | 8275/371472 [39:15<28:35:38,  3.53it/s]
  2%|▏         | 8276/371472 [39:15<27:51:06,  3.62it/s]
  2%|▏         | 8277/371472 [39:15<26:59:47,  3.74it/s]
  2%|▏         | 8278/371472 [39:16<26:50:03,  3.76it/s]
  2%|▏         | 8279/371472 [39:16<27:45:08,  3.64it/s]
  2%|▏         | 8280/371472 [39:16<31:32:15,  3.20it/s]
                                                        
{'loss': 4.6473, 'learning_rate': 9.804132819065266e-07, 'epoch': 0.36}

  2%|▏         | 8280/371472 [39:16<31:32:15,  3.20it/s]
  2%|▏         | 8281/371472 [39:17<30:35:03,  3.30it/s]
  2%|▏         | 8282/371472 [39:17<31:16:24,  3.23it/s]
  2%|▏         | 8283/371472 [39:17<30:56:57,  3.26it/s]
  2%|▏         | 8284/371472 [39:17<31:57:34,  3.16it/s]
  2%|▏         | 8285/371472 [39:18<32:39:39,  3.09it/s]
  2%|▏         | 8286/371472 [39:18<30:58:50,  3.26it/s]
  2%|▏         | 8287/371472 [39:18<29:50:20,  3.38it/s]
  2%|▏         | 8288/371472 [39:19<29:18:39,  3.44it/s]
  2%|▏         | 8289/371472 [39:19<29:00:59,  3.48it/s]
  2%|▏         | 8290/371472 [39:19<27:58:58,  3.61it/s]
  2%|▏         | 8291/371472 [39:19<29:13:41,  3.45it/s]
  2%|▏         | 8292/371472 [39:20<29:08:26,  3.46it/s]
  2%|▏         | 8293/371472 [39:20<28:01:58,  3.60it/s]
  2%|▏         | 8294/371472 [39:20<28:26:03,  3.55it/s]
  2%|▏         | 8295/371472 [39:21<27:25:29,  3.68it/s]
  2%|▏         | 8296/371472 [39:21<28:44:37,  3.51it/s]
  2%|▏         | 8297/371472 [39:21<27:07:23,  3.72it/s]
  2%|▏         | 8298/371472 [39:21<29:26:13,  3.43it/s]
  2%|▏         | 8299/371472 [39:22<28:19:51,  3.56it/s]
  2%|▏         | 8300/371472 [39:22<28:06:13,  3.59it/s]
                                                        
{'loss': 4.7138, 'learning_rate': 9.803647999310479e-07, 'epoch': 0.36}

  2%|▏         | 8300/371472 [39:22<28:06:13,  3.59it/s]
  2%|▏         | 8301/371472 [39:22<29:21:00,  3.44it/s]
  2%|▏         | 8302/371472 [39:23<27:52:25,  3.62it/s]
  2%|▏         | 8303/371472 [39:23<28:43:36,  3.51it/s]
  2%|▏         | 8304/371472 [39:23<27:29:01,  3.67it/s]
  2%|▏         | 8305/371472 [39:23<27:24:44,  3.68it/s]
  2%|▏         | 8306/371472 [39:24<30:26:21,  3.31it/s]
  2%|▏         | 8307/371472 [39:24<29:13:46,  3.45it/s]
  2%|▏         | 8308/371472 [39:24<28:35:18,  3.53it/s]
  2%|▏         | 8309/371472 [39:25<27:47:34,  3.63it/s]
  2%|▏         | 8310/371472 [39:25<28:41:49,  3.52it/s]
  2%|▏         | 8311/371472 [39:25<28:41:38,  3.52it/s]
  2%|▏         | 8312/371472 [39:25<27:46:41,  3.63it/s]
  2%|▏         | 8313/371472 [39:26<29:11:03,  3.46it/s]
  2%|▏         | 8314/371472 [39:26<28:30:30,  3.54it/s]
  2%|▏         | 8315/371472 [39:26<28:36:30,  3.53it/s]
  2%|▏         | 8316/371472 [39:27<28:44:10,  3.51it/s]
  2%|▏         | 8317/371472 [39:27<31:13:29,  3.23it/s]
  2%|▏         | 8318/371472 [39:27<32:41:26,  3.09it/s]
  2%|▏         | 8319/371472 [39:28<30:46:04,  3.28it/s]
  2%|▏         | 8320/371472 [39:28<28:56:52,  3.48it/s]
                                                        
{'loss': 4.8867, 'learning_rate': 9.803163179555687e-07, 'epoch': 0.36}

  2%|▏         | 8320/371472 [39:28<28:56:52,  3.48it/s]
  2%|▏         | 8321/371472 [39:28<29:59:25,  3.36it/s]
  2%|▏         | 8322/371472 [39:28<29:31:09,  3.42it/s]
  2%|▏         | 8323/371472 [39:29<29:13:38,  3.45it/s]
  2%|▏         | 8324/371472 [39:29<30:46:58,  3.28it/s]
  2%|▏         | 8325/371472 [39:29<30:14:48,  3.34it/s]
  2%|▏         | 8326/371472 [39:30<29:03:31,  3.47it/s]
  2%|▏         | 8327/371472 [39:30<28:47:03,  3.50it/s]
  2%|▏         | 8328/371472 [39:30<29:22:22,  3.43it/s]
  2%|▏         | 8329/371472 [39:30<28:54:36,  3.49it/s]
  2%|▏         | 8330/371472 [39:31<28:12:21,  3.58it/s]
  2%|▏         | 8331/371472 [39:31<28:14:47,  3.57it/s]
  2%|▏         | 8332/371472 [39:31<27:15:03,  3.70it/s]
  2%|▏         | 8333/371472 [39:31<27:44:31,  3.64it/s]
  2%|▏         | 8334/371472 [39:32<27:12:43,  3.71it/s]
  2%|▏         | 8335/371472 [39:32<26:52:26,  3.75it/s]
  2%|▏         | 8336/371472 [39:32<28:43:23,  3.51it/s]
  2%|▏         | 8337/371472 [39:33<29:38:52,  3.40it/s]
  2%|▏         | 8338/371472 [39:33<28:44:21,  3.51it/s]
  2%|▏         | 8339/371472 [39:33<27:55:47,  3.61it/s]
  2%|▏         | 8340/371472 [39:33<27:22:21,  3.69it/s]
                                                        
{'loss': 4.8516, 'learning_rate': 9.8026783598009e-07, 'epoch': 0.36}

  2%|▏         | 8340/371472 [39:33<27:22:21,  3.69it/s]
  2%|▏         | 8341/371472 [39:34<27:14:49,  3.70it/s]
  2%|▏         | 8342/371472 [39:34<27:08:31,  3.72it/s]
  2%|▏         | 8343/371472 [39:34<26:49:36,  3.76it/s]
  2%|▏         | 8344/371472 [39:35<27:36:16,  3.65it/s]
  2%|▏         | 8345/371472 [39:35<26:38:41,  3.79it/s]
  2%|▏         | 8346/371472 [39:35<26:43:31,  3.77it/s]
  2%|▏         | 8347/371472 [39:35<27:54:25,  3.61it/s]
  2%|▏         | 8348/371472 [39:36<27:27:57,  3.67it/s]
  2%|▏         | 8349/371472 [39:36<27:09:25,  3.71it/s]
  2%|▏         | 8350/371472 [39:36<26:32:24,  3.80it/s]
  2%|▏         | 8351/371472 [39:36<27:47:40,  3.63it/s]
  2%|▏         | 8352/371472 [39:37<28:04:46,  3.59it/s]
  2%|▏         | 8353/371472 [39:37<30:40:41,  3.29it/s]
  2%|▏         | 8354/371472 [39:37<31:02:45,  3.25it/s]
  2%|▏         | 8355/371472 [39:38<29:10:12,  3.46it/s]
  2%|▏         | 8356/371472 [39:38<30:41:08,  3.29it/s]
  2%|▏         | 8357/371472 [39:38<31:17:51,  3.22it/s]
  2%|▏         | 8358/371472 [39:39<29:37:06,  3.41it/s]
  2%|▏         | 8359/371472 [39:39<29:17:26,  3.44it/s]
  2%|▏         | 8360/371472 [39:39<31:20:12,  3.22it/s]
                                                        
{'loss': 4.5803, 'learning_rate': 9.80219354004611e-07, 'epoch': 0.36}

  2%|▏         | 8360/371472 [39:39<31:20:12,  3.22it/s]
  2%|▏         | 8361/371472 [39:40<32:11:21,  3.13it/s]
  2%|▏         | 8362/371472 [39:40<30:57:23,  3.26it/s]
  2%|▏         | 8363/371472 [39:40<29:35:22,  3.41it/s]
  2%|▏         | 8364/371472 [39:40<28:52:19,  3.49it/s]
  2%|▏         | 8365/371472 [39:41<28:23:05,  3.55it/s]
  2%|▏         | 8366/371472 [39:41<27:54:15,  3.61it/s]
  2%|▏         | 8367/371472 [39:41<29:35:24,  3.41it/s]
  2%|▏         | 8368/371472 [39:41<29:09:02,  3.46it/s]
  2%|▏         | 8369/371472 [39:42<29:00:00,  3.48it/s]
  2%|▏         | 8370/371472 [39:42<28:20:29,  3.56it/s]
  2%|▏         | 8371/371472 [39:42<29:40:22,  3.40it/s]
  2%|▏         | 8372/371472 [39:43<32:00:48,  3.15it/s]
  2%|▏         | 8373/371472 [39:43<30:04:39,  3.35it/s]
  2%|▏         | 8374/371472 [39:43<28:41:49,  3.51it/s]
  2%|▏         | 8375/371472 [39:44<28:56:09,  3.49it/s]
  2%|▏         | 8376/371472 [39:44<29:04:47,  3.47it/s]
  2%|▏         | 8377/371472 [39:44<28:21:13,  3.56it/s]
  2%|▏         | 8378/371472 [39:44<27:40:44,  3.64it/s]
  2%|▏         | 8379/371472 [39:45<28:00:18,  3.60it/s]
  2%|▏         | 8380/371472 [39:45<27:04:58,  3.72it/s]
                                                        
{'loss': 4.9113, 'learning_rate': 9.801708720291322e-07, 'epoch': 0.36}

  2%|▏         | 8380/371472 [39:45<27:04:58,  3.72it/s]
  2%|▏         | 8381/371472 [39:45<29:06:03,  3.47it/s]
  2%|▏         | 8382/371472 [39:45<28:01:43,  3.60it/s]
  2%|▏         | 8383/371472 [39:46<28:17:25,  3.57it/s]
  2%|▏         | 8384/371472 [39:46<28:18:24,  3.56it/s]
  2%|▏         | 8385/371472 [39:46<29:47:14,  3.39it/s]
  2%|▏         | 8386/371472 [39:47<28:35:22,  3.53it/s]
  2%|▏         | 8387/371472 [39:47<27:27:15,  3.67it/s]
  2%|▏         | 8388/371472 [39:47<27:17:30,  3.70it/s]
  2%|▏         | 8389/371472 [39:47<27:09:23,  3.71it/s]
  2%|▏         | 8390/371472 [39:48<27:13:02,  3.71it/s]
  2%|▏         | 8391/371472 [39:48<26:35:04,  3.79it/s]
  2%|▏         | 8392/371472 [39:48<26:35:37,  3.79it/s]
  2%|▏         | 8393/371472 [39:48<27:42:54,  3.64it/s]
  2%|▏         | 8394/371472 [39:49<27:14:46,  3.70it/s]
  2%|▏         | 8395/371472 [39:49<26:58:40,  3.74it/s]
  2%|▏         | 8396/371472 [39:49<27:02:25,  3.73it/s]
  2%|▏         | 8397/371472 [39:50<28:46:45,  3.50it/s]
  2%|▏         | 8398/371472 [39:50<29:10:39,  3.46it/s]
  2%|▏         | 8399/371472 [39:50<29:34:42,  3.41it/s]
  2%|▏         | 8400/371472 [39:50<28:46:08,  3.51it/s]
                                                        
{'loss': 4.7101, 'learning_rate': 9.801223900536535e-07, 'epoch': 0.36}

  2%|▏         | 8400/371472 [39:50<28:46:08,  3.51it/s]
  2%|▏         | 8401/371472 [39:51<30:46:56,  3.28it/s]
  2%|▏         | 8402/371472 [39:51<30:15:16,  3.33it/s]
  2%|▏         | 8403/371472 [39:51<30:33:57,  3.30it/s]
  2%|▏         | 8404/371472 [39:52<29:21:23,  3.44it/s]
  2%|▏         | 8405/371472 [39:52<27:45:16,  3.63it/s]
  2%|▏         | 8406/371472 [39:52<28:43:51,  3.51it/s]
  2%|▏         | 8407/371472 [39:52<28:19:22,  3.56it/s]
  2%|▏         | 8408/371472 [39:53<30:39:37,  3.29it/s]
  2%|▏         | 8409/371472 [39:53<30:34:10,  3.30it/s]
  2%|▏         | 8410/371472 [39:53<29:17:50,  3.44it/s]
  2%|▏         | 8411/371472 [39:54<29:33:22,  3.41it/s]
  2%|▏         | 8412/371472 [39:54<29:18:05,  3.44it/s]
  2%|▏         | 8413/371472 [39:54<29:43:36,  3.39it/s]
  2%|▏         | 8414/371472 [39:55<28:35:33,  3.53it/s]
  2%|▏         | 8415/371472 [39:55<29:43:40,  3.39it/s]
  2%|▏         | 8416/371472 [39:55<31:28:14,  3.20it/s]
  2%|▏         | 8417/371472 [39:56<32:03:08,  3.15it/s]
  2%|▏         | 8418/371472 [39:56<30:44:48,  3.28it/s]
  2%|▏         | 8419/371472 [39:56<31:14:09,  3.23it/s]
  2%|▏         | 8420/371472 [39:56<29:20:16,  3.44it/s]
                                                        
{'loss': 4.673, 'learning_rate': 9.800739080781743e-07, 'epoch': 0.36}

  2%|▏         | 8420/371472 [39:56<29:20:16,  3.44it/s]
  2%|▏         | 8421/371472 [39:57<28:50:29,  3.50it/s]
  2%|▏         | 8422/371472 [39:57<28:02:57,  3.60it/s]
  2%|▏         | 8423/371472 [39:57<27:41:42,  3.64it/s]
  2%|▏         | 8424/371472 [39:57<27:04:46,  3.72it/s]
  2%|▏         | 8425/371472 [39:58<28:11:58,  3.58it/s]
  2%|▏         | 8426/371472 [39:58<31:14:04,  3.23it/s]
  2%|▏         | 8427/371472 [39:58<30:14:17,  3.34it/s]
  2%|▏         | 8428/371472 [39:59<29:07:26,  3.46it/s]
  2%|▏         | 8429/371472 [39:59<30:18:04,  3.33it/s]
  2%|▏         | 8430/371472 [39:59<30:16:53,  3.33it/s]
  2%|▏         | 8431/371472 [40:00<28:57:08,  3.48it/s]
  2%|▏         | 8432/371472 [40:00<28:16:19,  3.57it/s]
  2%|▏         | 8433/371472 [40:00<28:59:39,  3.48it/s]
  2%|▏         | 8434/371472 [40:00<28:32:11,  3.53it/s]
  2%|▏         | 8435/371472 [40:01<28:55:03,  3.49it/s]
  2%|▏         | 8436/371472 [40:01<28:35:10,  3.53it/s]
  2%|▏         | 8437/371472 [40:01<28:01:32,  3.60it/s]
  2%|▏         | 8438/371472 [40:02<28:59:28,  3.48it/s]
  2%|▏         | 8439/371472 [40:02<29:39:44,  3.40it/s]
  2%|▏         | 8440/371472 [40:02<33:37:25,  3.00it/s]
                                                        
{'loss': 4.6649, 'learning_rate': 9.800254261026956e-07, 'epoch': 0.36}

  2%|▏         | 8440/371472 [40:02<33:37:25,  3.00it/s]
  2%|▏         | 8441/371472 [40:03<31:36:37,  3.19it/s]
  2%|▏         | 8442/371472 [40:03<30:18:18,  3.33it/s]
  2%|▏         | 8443/371472 [40:03<30:58:51,  3.25it/s]
  2%|▏         | 8444/371472 [40:03<30:15:15,  3.33it/s]
  2%|▏         | 8445/371472 [40:04<29:01:09,  3.47it/s]
  2%|▏         | 8446/371472 [40:04<28:07:46,  3.58it/s]
  2%|▏         | 8447/371472 [40:04<26:59:57,  3.73it/s]
  2%|▏         | 8448/371472 [40:04<28:31:45,  3.53it/s]
  2%|▏         | 8449/371472 [40:05<28:51:17,  3.49it/s]
  2%|▏         | 8450/371472 [40:05<28:46:23,  3.50it/s]
  2%|▏         | 8451/371472 [40:05<27:47:26,  3.63it/s]
  2%|▏         | 8452/371472 [40:06<27:43:56,  3.64it/s]
  2%|▏         | 8453/371472 [40:06<28:09:25,  3.58it/s]
  2%|▏         | 8454/371472 [40:06<27:04:57,  3.72it/s]
  2%|▏         | 8455/371472 [40:06<27:56:45,  3.61it/s]
  2%|▏         | 8456/371472 [40:07<27:00:57,  3.73it/s]
  2%|▏         | 8457/371472 [40:07<28:00:10,  3.60it/s]
  2%|▏         | 8458/371472 [40:07<28:07:19,  3.59it/s]
  2%|▏         | 8459/371472 [40:08<27:34:07,  3.66it/s]
  2%|▏         | 8460/371472 [40:08<26:59:28,  3.74it/s]
                                                        
{'loss': 4.8451, 'learning_rate': 9.799769441272167e-07, 'epoch': 0.36}

  2%|▏         | 8460/371472 [40:08<26:59:28,  3.74it/s]
  2%|▏         | 8461/371472 [40:08<28:32:57,  3.53it/s]
  2%|▏         | 8462/371472 [40:08<28:33:03,  3.53it/s]
  2%|▏         | 8463/371472 [40:09<34:41:38,  2.91it/s]
  2%|▏         | 8464/371472 [40:09<32:41:34,  3.08it/s]
  2%|▏         | 8465/371472 [40:09<30:28:52,  3.31it/s]
  2%|▏         | 8466/371472 [40:10<32:18:48,  3.12it/s]
  2%|▏         | 8467/371472 [40:10<31:15:23,  3.23it/s]
  2%|▏         | 8468/371472 [40:10<29:35:16,  3.41it/s]
  2%|▏         | 8469/371472 [40:11<28:45:47,  3.51it/s]
  2%|▏         | 8470/371472 [40:11<28:36:50,  3.52it/s]
  2%|▏         | 8471/371472 [40:11<29:03:23,  3.47it/s]
  2%|▏         | 8472/371472 [40:11<29:49:17,  3.38it/s]
  2%|▏         | 8473/371472 [40:12<29:12:51,  3.45it/s]
  2%|▏         | 8474/371472 [40:12<27:37:17,  3.65it/s]
  2%|▏         | 8475/371472 [40:12<27:32:00,  3.66it/s]
  2%|▏         | 8476/371472 [40:12<26:34:08,  3.80it/s]
  2%|▏         | 8477/371472 [40:13<26:44:34,  3.77it/s]
  2%|▏         | 8478/371472 [40:13<26:49:21,  3.76it/s]
  2%|▏         | 8479/371472 [40:13<26:06:25,  3.86it/s]
  2%|▏         | 8480/371472 [40:14<26:39:23,  3.78it/s]
                                                        
{'loss': 4.9897, 'learning_rate': 9.799284621517377e-07, 'epoch': 0.37}

  2%|▏         | 8480/371472 [40:14<26:39:23,  3.78it/s]
  2%|▏         | 8481/371472 [40:14<26:38:42,  3.78it/s]
  2%|▏         | 8482/371472 [40:14<26:09:19,  3.86it/s]
  2%|▏         | 8483/371472 [40:14<26:28:19,  3.81it/s]
  2%|▏         | 8484/371472 [40:15<26:57:54,  3.74it/s]
  2%|▏         | 8485/371472 [40:15<28:40:36,  3.52it/s]
  2%|▏         | 8486/371472 [40:15<29:07:32,  3.46it/s]
  2%|▏         | 8487/371472 [40:15<27:55:36,  3.61it/s]
  2%|▏         | 8488/371472 [40:16<26:37:55,  3.79it/s]
  2%|▏         | 8489/371472 [40:16<26:23:35,  3.82it/s]
  2%|▏         | 8490/371472 [40:16<26:37:38,  3.79it/s]
  2%|▏         | 8491/371472 [40:17<27:23:35,  3.68it/s]
  2%|▏         | 8492/371472 [40:17<28:32:21,  3.53it/s]
  2%|▏         | 8493/371472 [40:17<28:16:46,  3.57it/s]
  2%|▏         | 8494/371472 [40:17<30:23:43,  3.32it/s]
  2%|▏         | 8495/371472 [40:18<29:06:09,  3.46it/s]
  2%|▏         | 8496/371472 [40:18<29:16:41,  3.44it/s]
  2%|▏         | 8497/371472 [40:18<29:57:28,  3.37it/s]
  2%|▏         | 8498/371472 [40:19<28:13:46,  3.57it/s]
  2%|▏         | 8499/371472 [40:19<29:28:10,  3.42it/s]
  2%|▏         | 8500/371472 [40:19<29:10:24,  3.46it/s]
                                                        
{'loss': 4.9975, 'learning_rate': 9.79879980176259e-07, 'epoch': 0.37}

  2%|▏         | 8500/371472 [40:19<29:10:24,  3.46it/s]
  2%|▏         | 8501/371472 [40:19<28:23:34,  3.55it/s]
  2%|▏         | 8502/371472 [40:20<27:15:18,  3.70it/s]
  2%|▏         | 8503/371472 [40:20<27:14:24,  3.70it/s]
  2%|▏         | 8504/371472 [40:20<31:01:04,  3.25it/s]
  2%|▏         | 8505/371472 [40:21<29:11:55,  3.45it/s]
  2%|▏         | 8506/371472 [40:21<29:24:24,  3.43it/s]
  2%|▏         | 8507/371472 [40:21<28:33:09,  3.53it/s]
  2%|▏         | 8508/371472 [40:21<30:10:05,  3.34it/s]
  2%|▏         | 8509/371472 [40:22<29:21:26,  3.43it/s]
  2%|▏         | 8510/371472 [40:22<29:33:40,  3.41it/s]
  2%|▏         | 8511/371472 [40:22<28:29:14,  3.54it/s]
  2%|▏         | 8512/371472 [40:23<28:42:02,  3.51it/s]
  2%|▏         | 8513/371472 [40:23<29:55:04,  3.37it/s]
  2%|▏         | 8514/371472 [40:23<28:36:14,  3.52it/s]
  2%|▏         | 8515/371472 [40:23<29:01:16,  3.47it/s]
  2%|▏         | 8516/371472 [40:24<28:11:21,  3.58it/s]
  2%|▏         | 8517/371472 [40:24<31:17:53,  3.22it/s]
  2%|▏         | 8518/371472 [40:24<29:20:08,  3.44it/s]
  2%|▏         | 8519/371472 [40:25<29:11:00,  3.45it/s]
  2%|▏         | 8520/371472 [40:25<28:52:55,  3.49it/s]
                                                        
{'loss': 4.9695, 'learning_rate': 9.798314982007799e-07, 'epoch': 0.37}

  2%|▏         | 8520/371472 [40:25<28:52:55,  3.49it/s]
  2%|▏         | 8521/371472 [40:25<28:03:14,  3.59it/s]
  2%|▏         | 8522/371472 [40:25<27:33:36,  3.66it/s]
  2%|▏         | 8523/371472 [40:26<28:52:09,  3.49it/s]
  2%|▏         | 8524/371472 [40:26<27:37:24,  3.65it/s]
  2%|▏         | 8525/371472 [40:26<27:12:31,  3.71it/s]
  2%|▏         | 8526/371472 [40:27<26:30:00,  3.80it/s]
  2%|▏         | 8527/371472 [40:27<27:29:21,  3.67it/s]
  2%|▏         | 8528/371472 [40:27<27:23:10,  3.68it/s]
  2%|▏         | 8529/371472 [40:27<27:10:41,  3.71it/s]
  2%|▏         | 8530/371472 [40:28<29:50:51,  3.38it/s]
  2%|▏         | 8531/371472 [40:28<30:08:27,  3.34it/s]
  2%|▏         | 8532/371472 [40:28<29:17:40,  3.44it/s]
  2%|▏         | 8533/371472 [40:29<27:38:31,  3.65it/s]
  2%|▏         | 8534/371472 [40:29<26:58:51,  3.74it/s]
  2%|▏         | 8535/371472 [40:29<27:03:40,  3.73it/s]
  2%|▏         | 8536/371472 [40:29<27:40:39,  3.64it/s]
  2%|▏         | 8537/371472 [40:30<28:49:06,  3.50it/s]
  2%|▏         | 8538/371472 [40:30<28:47:42,  3.50it/s]
  2%|▏         | 8539/371472 [40:30<30:21:24,  3.32it/s]
  2%|▏         | 8540/371472 [40:31<31:31:55,  3.20it/s]
                                                        
{'loss': 4.7713, 'learning_rate': 9.797830162253012e-07, 'epoch': 0.37}

  2%|▏         | 8540/371472 [40:31<31:31:55,  3.20it/s]
  2%|▏         | 8541/371472 [40:31<30:00:33,  3.36it/s]
  2%|▏         | 8542/371472 [40:31<29:57:18,  3.37it/s]
  2%|▏         | 8543/371472 [40:31<29:51:50,  3.38it/s]
  2%|▏         | 8544/371472 [40:32<29:46:19,  3.39it/s]
  2%|▏         | 8545/371472 [40:32<28:22:24,  3.55it/s]
  2%|▏         | 8546/371472 [40:32<28:17:20,  3.56it/s]
  2%|▏         | 8547/371472 [40:33<28:12:08,  3.57it/s]
  2%|▏         | 8548/371472 [40:33<27:28:09,  3.67it/s]
  2%|▏         | 8549/371472 [40:33<28:17:37,  3.56it/s]
  2%|▏         | 8550/371472 [40:33<30:08:18,  3.34it/s]
  2%|▏         | 8551/371472 [40:34<29:55:47,  3.37it/s]
  2%|▏         | 8552/371472 [40:34<30:01:58,  3.36it/s]
  2%|▏         | 8553/371472 [40:34<30:44:55,  3.28it/s]
  2%|▏         | 8554/371472 [40:35<29:16:54,  3.44it/s]
  2%|▏         | 8555/371472 [40:35<27:38:14,  3.65it/s]
  2%|▏         | 8556/371472 [40:35<27:20:42,  3.69it/s]
  2%|▏         | 8557/371472 [40:35<28:44:40,  3.51it/s]
  2%|▏         | 8558/371472 [40:36<27:26:44,  3.67it/s]
  2%|▏         | 8559/371472 [40:36<27:29:14,  3.67it/s]
  2%|▏         | 8560/371472 [40:36<28:41:11,  3.51it/s]
                                                        
{'loss': 4.8941, 'learning_rate': 9.79734534249822e-07, 'epoch': 0.37}

  2%|▏         | 8560/371472 [40:36<28:41:11,  3.51it/s]
  2%|▏         | 8561/371472 [40:37<29:43:20,  3.39it/s]
  2%|▏         | 8562/371472 [40:37<32:38:07,  3.09it/s]
  2%|▏         | 8563/371472 [40:37<32:22:57,  3.11it/s]
  2%|▏         | 8564/371472 [40:38<30:33:06,  3.30it/s]
  2%|▏         | 8565/371472 [40:38<28:36:40,  3.52it/s]
  2%|▏         | 8566/371472 [40:38<27:41:24,  3.64it/s]
  2%|▏         | 8567/371472 [40:38<27:41:49,  3.64it/s]
  2%|▏         | 8568/371472 [40:39<28:08:05,  3.58it/s]
  2%|▏         | 8569/371472 [40:39<29:05:37,  3.46it/s]
  2%|▏         | 8570/371472 [40:39<29:31:31,  3.41it/s]
  2%|▏         | 8571/371472 [40:39<28:48:22,  3.50it/s]
  2%|▏         | 8572/371472 [40:40<28:35:01,  3.53it/s]
  2%|▏         | 8573/371472 [40:40<28:18:41,  3.56it/s]
  2%|▏         | 8574/371472 [40:40<26:51:08,  3.75it/s]
  2%|▏         | 8575/371472 [40:41<27:08:03,  3.72it/s]
  2%|▏         | 8576/371472 [40:41<27:29:11,  3.67it/s]
  2%|▏         | 8577/371472 [40:41<29:35:28,  3.41it/s]
  2%|▏         | 8578/371472 [40:41<29:02:31,  3.47it/s]
  2%|▏         | 8579/371472 [40:42<31:16:25,  3.22it/s]
  2%|▏         | 8580/371472 [40:42<30:54:53,  3.26it/s]
                                                        
{'loss': 4.6747, 'learning_rate': 9.796860522743433e-07, 'epoch': 0.37}

  2%|▏         | 8580/371472 [40:42<30:54:53,  3.26it/s]
  2%|▏         | 8581/371472 [40:42<31:26:58,  3.21it/s]
  2%|▏         | 8582/371472 [40:43<29:15:26,  3.45it/s]
  2%|▏         | 8583/371472 [40:43<29:44:59,  3.39it/s]
  2%|▏         | 8584/371472 [40:43<29:47:35,  3.38it/s]
  2%|▏         | 8585/371472 [40:44<30:39:02,  3.29it/s]
  2%|▏         | 8586/371472 [40:44<29:10:49,  3.45it/s]
  2%|▏         | 8587/371472 [40:44<28:05:34,  3.59it/s]
  2%|▏         | 8588/371472 [40:44<28:20:09,  3.56it/s]
  2%|▏         | 8589/371472 [40:45<27:40:55,  3.64it/s]
  2%|▏         | 8590/371472 [40:45<27:07:39,  3.72it/s]
  2%|▏         | 8591/371472 [40:45<28:30:25,  3.54it/s]
  2%|▏         | 8592/371472 [40:46<29:20:11,  3.44it/s]
  2%|▏         | 8593/371472 [40:46<28:45:14,  3.51it/s]
  2%|▏         | 8594/371472 [40:46<27:48:43,  3.62it/s]
  2%|▏         | 8595/371472 [40:46<27:29:48,  3.67it/s]
  2%|▏         | 8596/371472 [40:47<27:45:20,  3.63it/s]
  2%|▏         | 8597/371472 [40:47<28:20:57,  3.56it/s]
  2%|▏         | 8598/371472 [40:47<27:36:54,  3.65it/s]
  2%|▏         | 8599/371472 [40:48<29:42:05,  3.39it/s]
  2%|▏         | 8600/371472 [40:48<28:32:05,  3.53it/s]
                                                        
{'loss': 4.7685, 'learning_rate': 9.796375702988644e-07, 'epoch': 0.37}

  2%|▏         | 8600/371472 [40:48<28:32:05,  3.53it/s]
  2%|▏         | 8601/371472 [40:48<29:23:04,  3.43it/s]
  2%|▏         | 8602/371472 [40:48<28:50:49,  3.49it/s]
  2%|▏         | 8603/371472 [40:49<27:44:05,  3.63it/s]
  2%|▏         | 8604/371472 [40:49<27:13:25,  3.70it/s]
  2%|▏         | 8605/371472 [40:49<27:33:04,  3.66it/s]
  2%|▏         | 8606/371472 [40:49<27:50:29,  3.62it/s]
  2%|▏         | 8607/371472 [40:50<27:48:18,  3.63it/s]
  2%|▏         | 8608/371472 [40:50<29:21:02,  3.43it/s]
  2%|▏         | 8609/371472 [40:50<28:58:27,  3.48it/s]
  2%|▏         | 8610/371472 [40:51<29:56:07,  3.37it/s]
  2%|▏         | 8611/371472 [40:51<28:26:57,  3.54it/s]
  2%|▏         | 8612/371472 [40:51<27:55:36,  3.61it/s]
  2%|▏         | 8613/371472 [40:51<27:39:46,  3.64it/s]
  2%|▏         | 8614/371472 [40:52<28:22:50,  3.55it/s]
  2%|▏         | 8615/371472 [40:52<28:11:35,  3.58it/s]
  2%|▏         | 8616/371472 [40:52<27:20:39,  3.69it/s]
  2%|▏         | 8617/371472 [40:53<28:56:36,  3.48it/s]
  2%|▏         | 8618/371472 [40:53<28:04:03,  3.59it/s]
  2%|▏         | 8619/371472 [40:53<29:55:49,  3.37it/s]
  2%|▏         | 8620/371472 [40:53<28:21:01,  3.56it/s]
                                                        
{'loss': 4.9399, 'learning_rate': 9.795890883233855e-07, 'epoch': 0.37}

  2%|▏         | 8620/371472 [40:53<28:21:01,  3.56it/s]
  2%|▏         | 8621/371472 [40:54<27:34:57,  3.65it/s]
  2%|▏         | 8622/371472 [40:54<27:28:14,  3.67it/s]
  2%|▏         | 8623/371472 [40:54<27:06:54,  3.72it/s]
  2%|▏         | 8624/371472 [40:54<26:51:37,  3.75it/s]
  2%|▏         | 8625/371472 [40:55<27:05:26,  3.72it/s]
  2%|▏         | 8626/371472 [40:55<27:03:37,  3.72it/s]
  2%|▏         | 8627/371472 [40:55<26:33:38,  3.79it/s]
  2%|▏         | 8628/371472 [40:56<26:58:32,  3.74it/s]
  2%|▏         | 8629/371472 [40:56<26:27:58,  3.81it/s]
  2%|▏         | 8630/371472 [40:56<26:45:30,  3.77it/s]
  2%|▏         | 8631/371472 [40:56<26:40:27,  3.78it/s]
  2%|▏         | 8632/371472 [40:57<25:33:39,  3.94it/s]
  2%|▏         | 8633/371472 [40:57<25:14:11,  3.99it/s]
  2%|▏         | 8634/371472 [40:57<26:02:17,  3.87it/s]
  2%|▏         | 8635/371472 [40:57<25:38:27,  3.93it/s]
  2%|▏         | 8636/371472 [40:58<26:33:24,  3.80it/s]
  2%|▏         | 8637/371472 [40:58<26:08:27,  3.86it/s]
  2%|▏         | 8638/371472 [40:58<26:26:21,  3.81it/s]
  2%|▏         | 8639/371472 [40:58<28:11:29,  3.58it/s]
  2%|▏         | 8640/371472 [40:59<26:48:21,  3.76it/s]
                                                        
{'loss': 4.9424, 'learning_rate': 9.795406063479067e-07, 'epoch': 0.37}

  2%|▏         | 8640/371472 [40:59<26:48:21,  3.76it/s]
  2%|▏         | 8641/371472 [40:59<27:39:04,  3.64it/s]
  2%|▏         | 8642/371472 [40:59<28:19:47,  3.56it/s]
  2%|▏         | 8643/371472 [41:00<28:27:45,  3.54it/s]
  2%|▏         | 8644/371472 [41:00<27:57:22,  3.61it/s]
  2%|▏         | 8645/371472 [41:00<27:14:28,  3.70it/s]
  2%|▏         | 8646/371472 [41:00<29:13:34,  3.45it/s]
  2%|▏         | 8647/371472 [41:01<29:52:28,  3.37it/s]
  2%|▏         | 8648/371472 [41:01<28:47:03,  3.50it/s]
  2%|▏         | 8649/371472 [41:01<28:14:50,  3.57it/s]
  2%|▏         | 8650/371472 [41:01<26:43:53,  3.77it/s]
  2%|▏         | 8651/371472 [41:02<27:52:50,  3.61it/s]
  2%|▏         | 8652/371472 [41:02<27:14:51,  3.70it/s]
  2%|▏         | 8653/371472 [41:02<27:21:02,  3.68it/s]
  2%|▏         | 8654/371472 [41:03<26:51:18,  3.75it/s]
  2%|▏         | 8655/371472 [41:03<25:53:03,  3.89it/s]
  2%|▏         | 8656/371472 [41:03<26:12:16,  3.85it/s]
  2%|▏         | 8657/371472 [41:03<30:22:59,  3.32it/s]
  2%|▏         | 8658/371472 [41:04<29:53:13,  3.37it/s]
  2%|▏         | 8659/371472 [41:04<29:48:22,  3.38it/s]
  2%|▏         | 8660/371472 [41:04<28:54:38,  3.49it/s]
                                                        
{'loss': 4.8493, 'learning_rate': 9.794921243724276e-07, 'epoch': 0.37}

  2%|▏         | 8660/371472 [41:04<28:54:38,  3.49it/s]
  2%|▏         | 8661/371472 [41:05<27:57:37,  3.60it/s]
  2%|▏         | 8662/371472 [41:05<28:02:12,  3.59it/s]
  2%|▏         | 8663/371472 [41:05<27:21:03,  3.68it/s]
  2%|▏         | 8664/371472 [41:05<26:54:10,  3.75it/s]
  2%|▏         | 8665/371472 [41:06<25:54:36,  3.89it/s]
  2%|▏         | 8666/371472 [41:06<26:27:47,  3.81it/s]
  2%|▏         | 8667/371472 [41:06<26:24:33,  3.82it/s]
  2%|▏         | 8668/371472 [41:06<27:16:47,  3.69it/s]
  2%|▏         | 8669/371472 [41:07<27:31:02,  3.66it/s]
  2%|▏         | 8670/371472 [41:07<26:54:45,  3.74it/s]
  2%|▏         | 8671/371472 [41:07<26:28:00,  3.81it/s]
  2%|▏         | 8672/371472 [41:07<26:34:24,  3.79it/s]
  2%|▏         | 8673/371472 [41:08<27:01:10,  3.73it/s]
  2%|▏         | 8674/371472 [41:08<27:13:28,  3.70it/s]
  2%|▏         | 8675/371472 [41:08<30:31:05,  3.30it/s]
  2%|▏         | 8676/371472 [41:09<30:51:46,  3.27it/s]
  2%|▏         | 8677/371472 [41:09<31:10:34,  3.23it/s]
  2%|▏         | 8678/371472 [41:09<30:05:01,  3.35it/s]
  2%|▏         | 8679/371472 [41:10<28:56:31,  3.48it/s]
  2%|▏         | 8680/371472 [41:10<29:25:01,  3.43it/s]
                                                        
{'loss': 4.974, 'learning_rate': 9.794436423969489e-07, 'epoch': 0.37}

  2%|▏         | 8680/371472 [41:10<29:25:01,  3.43it/s]
  2%|▏         | 8681/371472 [41:10<30:28:38,  3.31it/s]
  2%|▏         | 8682/371472 [41:10<29:13:11,  3.45it/s]
  2%|▏         | 8683/371472 [41:11<31:00:36,  3.25it/s]
  2%|▏         | 8684/371472 [41:11<29:21:14,  3.43it/s]
  2%|▏         | 8685/371472 [41:11<30:36:01,  3.29it/s]
  2%|▏         | 8686/371472 [41:12<30:07:19,  3.35it/s]
  2%|▏         | 8687/371472 [41:12<29:25:21,  3.43it/s]
  2%|▏         | 8688/371472 [41:12<33:01:05,  3.05it/s]
  2%|▏         | 8689/371472 [41:13<31:25:21,  3.21it/s]
  2%|▏         | 8690/371472 [41:13<30:10:41,  3.34it/s]
  2%|▏         | 8691/371472 [41:13<30:42:08,  3.28it/s]
  2%|▏         | 8692/371472 [41:14<32:08:33,  3.14it/s]
  2%|▏         | 8693/371472 [41:14<30:42:05,  3.28it/s]
  2%|▏         | 8694/371472 [41:14<30:27:34,  3.31it/s]
  2%|▏         | 8695/371472 [41:14<30:16:45,  3.33it/s]
  2%|▏         | 8696/371472 [41:15<29:16:58,  3.44it/s]
  2%|▏         | 8697/371472 [41:15<29:24:10,  3.43it/s]
  2%|▏         | 8698/371472 [41:15<28:59:58,  3.47it/s]
  2%|▏         | 8699/371472 [41:16<28:44:44,  3.51it/s]
  2%|▏         | 8700/371472 [41:16<29:04:27,  3.47it/s]
                                                        
{'loss': 4.6983, 'learning_rate': 9.7939516042147e-07, 'epoch': 0.37}

  2%|▏         | 8700/371472 [41:16<29:04:27,  3.47it/s]
  2%|▏         | 8701/371472 [41:16<29:31:26,  3.41it/s]
  2%|▏         | 8702/371472 [41:16<28:12:42,  3.57it/s]
  2%|▏         | 8703/371472 [41:17<28:08:54,  3.58it/s]
  2%|▏         | 8704/371472 [41:17<28:18:17,  3.56it/s]
  2%|▏         | 8705/371472 [41:17<28:17:14,  3.56it/s]
  2%|▏         | 8706/371472 [41:17<27:51:50,  3.62it/s]
  2%|▏         | 8707/371472 [41:18<27:31:19,  3.66it/s]
  2%|▏         | 8708/371472 [41:18<27:26:09,  3.67it/s]
  2%|▏         | 8709/371472 [41:18<27:44:53,  3.63it/s]
  2%|▏         | 8710/371472 [41:19<29:36:53,  3.40it/s]
  2%|▏         | 8711/371472 [41:19<28:04:04,  3.59it/s]
  2%|▏         | 8712/371472 [41:19<29:04:39,  3.47it/s]
  2%|▏         | 8713/371472 [41:20<29:22:09,  3.43it/s]
  2%|▏         | 8714/371472 [41:20<28:52:17,  3.49it/s]
  2%|▏         | 8715/371472 [41:20<28:55:15,  3.48it/s]
  2%|▏         | 8716/371472 [41:20<28:38:10,  3.52it/s]
  2%|▏         | 8717/371472 [41:21<28:27:11,  3.54it/s]
  2%|▏         | 8718/371472 [41:21<28:08:19,  3.58it/s]
  2%|▏         | 8719/371472 [41:21<27:34:47,  3.65it/s]
  2%|▏         | 8720/371472 [41:21<27:58:52,  3.60it/s]
                                                        
{'loss': 4.7911, 'learning_rate': 9.79346678445991e-07, 'epoch': 0.38}

  2%|▏         | 8720/371472 [41:21<27:58:52,  3.60it/s]
  2%|▏         | 8721/371472 [41:22<29:28:09,  3.42it/s]
  2%|▏         | 8722/371472 [41:22<32:24:33,  3.11it/s]
  2%|▏         | 8723/371472 [41:23<33:52:03,  2.98it/s]
  2%|▏         | 8724/371472 [41:23<32:13:02,  3.13it/s]
  2%|▏         | 8725/371472 [41:23<30:01:58,  3.36it/s]
  2%|▏         | 8726/371472 [41:23<29:42:08,  3.39it/s]
  2%|▏         | 8727/371472 [41:24<29:21:01,  3.43it/s]
  2%|▏         | 8728/371472 [41:24<28:02:24,  3.59it/s]
  2%|▏         | 8729/371472 [41:24<27:50:35,  3.62it/s]
  2%|▏         | 8730/371472 [41:24<28:05:06,  3.59it/s]
  2%|▏         | 8731/371472 [41:25<27:06:02,  3.72it/s]
  2%|▏         | 8732/371472 [41:25<29:18:35,  3.44it/s]
  2%|▏         | 8733/371472 [41:25<28:50:32,  3.49it/s]
  2%|▏         | 8734/371472 [41:26<28:41:24,  3.51it/s]
  2%|▏         | 8735/371472 [41:26<28:31:27,  3.53it/s]
  2%|▏         | 8736/371472 [41:26<28:17:38,  3.56it/s]
  2%|▏         | 8737/371472 [41:26<28:14:32,  3.57it/s]
  2%|▏         | 8738/371472 [41:27<27:45:25,  3.63it/s]
  2%|▏         | 8739/371472 [41:27<27:12:46,  3.70it/s]
  2%|▏         | 8740/371472 [41:27<28:34:29,  3.53it/s]
                                                        
{'loss': 4.7347, 'learning_rate': 9.792981964705123e-07, 'epoch': 0.38}

  2%|▏         | 8740/371472 [41:27<28:34:29,  3.53it/s]
  2%|▏         | 8741/371472 [41:28<30:06:35,  3.35it/s]
  2%|▏         | 8742/371472 [41:28<29:58:16,  3.36it/s]
  2%|▏         | 8743/371472 [41:28<31:18:32,  3.22it/s]
  2%|▏         | 8744/371472 [41:29<30:47:43,  3.27it/s]
  2%|▏         | 8745/371472 [41:29<29:13:37,  3.45it/s]
  2%|▏         | 8746/371472 [41:29<28:02:23,  3.59it/s]
  2%|▏         | 8747/371472 [41:29<29:45:30,  3.39it/s]
  2%|▏         | 8748/371472 [41:30<29:00:55,  3.47it/s]
  2%|▏         | 8749/371472 [41:30<28:20:32,  3.55it/s]
  2%|▏         | 8750/371472 [41:30<29:27:06,  3.42it/s]
  2%|▏         | 8751/371472 [41:30<29:23:00,  3.43it/s]
  2%|▏         | 8752/371472 [41:31<28:48:58,  3.50it/s]
  2%|▏         | 8753/371472 [41:31<28:56:28,  3.48it/s]
  2%|▏         | 8754/371472 [41:31<28:53:45,  3.49it/s]
  2%|▏         | 8755/371472 [41:32<28:36:03,  3.52it/s]
  2%|▏         | 8756/371472 [41:32<28:04:04,  3.59it/s]
  2%|▏         | 8757/371472 [41:32<26:59:02,  3.73it/s]
  2%|▏         | 8758/371472 [41:32<27:44:35,  3.63it/s]
  2%|▏         | 8759/371472 [41:33<27:52:40,  3.61it/s]
  2%|▏         | 8760/371472 [41:33<28:58:01,  3.48it/s]
                                                        
{'loss': 4.8341, 'learning_rate': 9.792497144950332e-07, 'epoch': 0.38}

  2%|▏         | 8760/371472 [41:33<28:58:01,  3.48it/s]
  2%|▏         | 8761/371472 [41:33<29:32:51,  3.41it/s]
  2%|▏         | 8762/371472 [41:34<28:53:27,  3.49it/s]
  2%|▏         | 8763/371472 [41:34<27:19:13,  3.69it/s]
  2%|▏         | 8764/371472 [41:34<26:59:57,  3.73it/s]
  2%|▏         | 8765/371472 [41:34<26:42:29,  3.77it/s]
  2%|▏         | 8766/371472 [41:35<28:04:34,  3.59it/s]
  2%|▏         | 8767/371472 [41:35<29:18:16,  3.44it/s]
  2%|▏         | 8768/371472 [41:35<29:17:24,  3.44it/s]
  2%|▏         | 8769/371472 [41:36<29:01:53,  3.47it/s]
  2%|▏         | 8770/371472 [41:36<28:51:39,  3.49it/s]
  2%|▏         | 8771/371472 [41:36<28:48:33,  3.50it/s]
  2%|▏         | 8772/371472 [41:36<30:21:17,  3.32it/s]
  2%|▏         | 8773/371472 [41:37<30:04:31,  3.35it/s]
  2%|▏         | 8774/371472 [41:37<30:09:41,  3.34it/s]
  2%|▏         | 8775/371472 [41:37<28:36:36,  3.52it/s]
  2%|▏         | 8776/371472 [41:38<29:23:05,  3.43it/s]
  2%|▏         | 8777/371472 [41:38<28:27:24,  3.54it/s]
  2%|▏         | 8778/371472 [41:38<30:35:31,  3.29it/s]
  2%|▏         | 8779/371472 [41:38<29:04:00,  3.47it/s]
  2%|▏         | 8780/371472 [41:39<28:00:43,  3.60it/s]
                                                        
{'loss': 5.0537, 'learning_rate': 9.792012325195544e-07, 'epoch': 0.38}

  2%|▏         | 8780/371472 [41:39<28:00:43,  3.60it/s]
  2%|▏         | 8781/371472 [41:39<27:08:29,  3.71it/s]
  2%|▏         | 8782/371472 [41:39<27:40:59,  3.64it/s]
  2%|▏         | 8783/371472 [41:40<27:15:01,  3.70it/s]
  2%|▏         | 8784/371472 [41:40<27:09:58,  3.71it/s]
  2%|▏         | 8785/371472 [41:40<28:38:24,  3.52it/s]
  2%|▏         | 8786/371472 [41:40<28:25:54,  3.54it/s]
  2%|▏         | 8787/371472 [41:41<31:44:51,  3.17it/s]
  2%|▏         | 8788/371472 [41:41<30:54:22,  3.26it/s]
  2%|▏         | 8789/371472 [41:41<29:44:27,  3.39it/s]
  2%|▏         | 8790/371472 [41:42<28:37:39,  3.52it/s]
  2%|▏         | 8791/371472 [41:42<29:28:22,  3.42it/s]
  2%|▏         | 8792/371472 [41:42<28:00:10,  3.60it/s]
  2%|▏         | 8793/371472 [41:42<27:48:13,  3.62it/s]
  2%|▏         | 8794/371472 [41:43<29:58:15,  3.36it/s]
  2%|▏         | 8795/371472 [41:43<28:53:15,  3.49it/s]
  2%|▏         | 8796/371472 [41:43<27:14:40,  3.70it/s]
  2%|▏         | 8797/371472 [41:44<28:29:21,  3.54it/s]
  2%|▏         | 8798/371472 [41:44<29:55:38,  3.37it/s]
  2%|▏         | 8799/371472 [41:44<29:49:01,  3.38it/s]
  2%|▏         | 8800/371472 [41:44<28:12:36,  3.57it/s]
                                                        
{'loss': 4.8714, 'learning_rate': 9.791527505440753e-07, 'epoch': 0.38}

  2%|▏         | 8800/371472 [41:44<28:12:36,  3.57it/s]
  2%|▏         | 8801/371472 [41:45<29:55:34,  3.37it/s]
  2%|▏         | 8802/371472 [41:45<30:07:45,  3.34it/s]
  2%|▏         | 8803/371472 [41:45<29:28:49,  3.42it/s]
  2%|▏         | 8804/371472 [41:46<28:28:39,  3.54it/s]
  2%|▏         | 8805/371472 [41:46<27:57:48,  3.60it/s]
  2%|▏         | 8806/371472 [41:46<29:04:39,  3.46it/s]
  2%|▏         | 8807/371472 [41:46<27:33:15,  3.66it/s]
  2%|▏         | 8808/371472 [41:47<29:07:47,  3.46it/s]
  2%|▏         | 8809/371472 [41:47<29:56:21,  3.36it/s]
  2%|▏         | 8810/371472 [41:47<30:19:49,  3.32it/s]
  2%|▏         | 8811/371472 [41:48<30:06:42,  3.35it/s]
  2%|▏         | 8812/371472 [41:48<30:29:14,  3.30it/s]
  2%|▏         | 8813/371472 [41:48<30:25:46,  3.31it/s]
  2%|▏         | 8814/371472 [41:49<29:17:01,  3.44it/s]
  2%|▏         | 8815/371472 [41:49<28:37:18,  3.52it/s]
  2%|▏         | 8816/371472 [41:49<28:05:28,  3.59it/s]
  2%|▏         | 8817/371472 [41:49<28:30:58,  3.53it/s]
  2%|▏         | 8818/371472 [41:50<27:21:18,  3.68it/s]
  2%|▏         | 8819/371472 [41:50<33:13:23,  3.03it/s]
  2%|▏         | 8820/371472 [41:50<30:59:08,  3.25it/s]
                                                        
{'loss': 5.0039, 'learning_rate': 9.791042685685966e-07, 'epoch': 0.38}

  2%|▏         | 8820/371472 [41:50<30:59:08,  3.25it/s]
  2%|▏         | 8821/371472 [41:51<29:32:21,  3.41it/s]
  2%|▏         | 8822/371472 [41:51<29:32:08,  3.41it/s]
  2%|▏         | 8823/371472 [41:51<29:13:45,  3.45it/s]
  2%|▏         | 8824/371472 [41:51<28:12:52,  3.57it/s]
  2%|▏         | 8825/371472 [41:52<30:09:15,  3.34it/s]
  2%|▏         | 8826/371472 [41:52<28:49:02,  3.50it/s]
  2%|▏         | 8827/371472 [41:52<27:29:41,  3.66it/s]
  2%|▏         | 8828/371472 [41:53<26:42:04,  3.77it/s]
  2%|▏         | 8829/371472 [41:53<26:19:24,  3.83it/s]
  2%|▏         | 8830/371472 [41:53<28:30:08,  3.53it/s]
  2%|▏         | 8831/371472 [41:53<27:36:25,  3.65it/s]
  2%|▏         | 8832/371472 [41:54<29:36:56,  3.40it/s]
  2%|▏         | 8833/371472 [41:54<30:30:32,  3.30it/s]
  2%|▏         | 8834/371472 [41:54<29:03:46,  3.47it/s]
  2%|▏         | 8835/371472 [41:55<28:59:04,  3.48it/s]
  2%|▏         | 8836/371472 [41:55<28:55:11,  3.48it/s]
  2%|▏         | 8837/371472 [41:55<28:23:18,  3.55it/s]
  2%|▏         | 8838/371472 [41:55<28:02:54,  3.59it/s]
  2%|▏         | 8839/371472 [41:56<31:59:21,  3.15it/s]
  2%|▏         | 8840/371472 [41:56<30:18:31,  3.32it/s]
                                                        
{'loss': 4.9384, 'learning_rate': 9.790557865931177e-07, 'epoch': 0.38}

  2%|▏         | 8840/371472 [41:56<30:18:31,  3.32it/s]
  2%|▏         | 8841/371472 [41:56<28:34:20,  3.53it/s]
  2%|▏         | 8842/371472 [41:57<27:15:07,  3.70it/s]
  2%|▏         | 8843/371472 [41:57<26:37:09,  3.78it/s]
  2%|▏         | 8844/371472 [41:57<26:19:50,  3.83it/s]
  2%|▏         | 8845/371472 [41:57<27:53:03,  3.61it/s]
  2%|▏         | 8846/371472 [41:58<26:53:35,  3.75it/s]
  2%|▏         | 8847/371472 [41:58<28:47:55,  3.50it/s]
  2%|▏         | 8848/371472 [41:58<28:38:23,  3.52it/s]
  2%|▏         | 8849/371472 [41:58<27:31:26,  3.66it/s]
  2%|▏         | 8850/371472 [41:59<26:12:52,  3.84it/s]
  2%|▏         | 8851/371472 [41:59<26:26:37,  3.81it/s]
  2%|▏         | 8852/371472 [41:59<28:29:11,  3.54it/s]
  2%|▏         | 8853/371472 [42:00<31:07:13,  3.24it/s]
  2%|▏         | 8854/371472 [42:00<30:46:45,  3.27it/s]
  2%|▏         | 8855/371472 [42:00<36:15:58,  2.78it/s]
  2%|▏         | 8856/371472 [42:01<34:24:33,  2.93it/s]
  2%|▏         | 8857/371472 [42:01<32:00:55,  3.15it/s]
  2%|▏         | 8858/371472 [42:01<30:35:49,  3.29it/s]
  2%|▏         | 8859/371472 [42:02<30:12:27,  3.33it/s]
  2%|▏         | 8860/371472 [42:02<29:37:16,  3.40it/s]
                                                        
{'loss': 4.9291, 'learning_rate': 9.790073046176387e-07, 'epoch': 0.38}

  2%|▏         | 8860/371472 [42:02<29:37:16,  3.40it/s]
  2%|▏         | 8861/371472 [42:02<31:18:46,  3.22it/s]
  2%|▏         | 8862/371472 [42:02<29:19:50,  3.43it/s]
  2%|▏         | 8863/371472 [42:03<30:07:58,  3.34it/s]
  2%|▏         | 8864/371472 [42:03<29:32:51,  3.41it/s]
  2%|▏         | 8865/371472 [42:03<29:03:00,  3.47it/s]
  2%|▏         | 8866/371472 [42:04<27:55:28,  3.61it/s]
  2%|▏         | 8867/371472 [42:04<28:50:43,  3.49it/s]
  2%|▏         | 8868/371472 [42:04<28:20:22,  3.55it/s]
  2%|▏         | 8869/371472 [42:04<28:10:20,  3.58it/s]
  2%|▏         | 8870/371472 [42:05<29:06:30,  3.46it/s]
  2%|▏         | 8871/371472 [42:05<27:49:19,  3.62it/s]
  2%|▏         | 8872/371472 [42:05<27:41:29,  3.64it/s]
  2%|▏         | 8873/371472 [42:06<27:49:44,  3.62it/s]
  2%|▏         | 8874/371472 [42:06<26:37:29,  3.78it/s]
  2%|▏         | 8875/371472 [42:06<27:16:28,  3.69it/s]
  2%|▏         | 8876/371472 [42:06<30:05:28,  3.35it/s]
  2%|▏         | 8877/371472 [42:07<30:40:44,  3.28it/s]
  2%|▏         | 8878/371472 [42:07<29:18:48,  3.44it/s]
  2%|▏         | 8879/371472 [42:07<29:32:29,  3.41it/s]
  2%|▏         | 8880/371472 [42:08<29:14:31,  3.44it/s]
                                                        
{'loss': 4.7098, 'learning_rate': 9.7895882264216e-07, 'epoch': 0.38}

  2%|▏         | 8880/371472 [42:08<29:14:31,  3.44it/s]
  2%|▏         | 8881/371472 [42:08<30:12:05,  3.33it/s]
  2%|▏         | 8882/371472 [42:08<29:35:32,  3.40it/s]
  2%|▏         | 8883/371472 [42:08<29:54:12,  3.37it/s]
  2%|▏         | 8884/371472 [42:09<32:14:29,  3.12it/s]
  2%|▏         | 8885/371472 [42:09<29:54:09,  3.37it/s]
  2%|▏         | 8886/371472 [42:09<30:37:55,  3.29it/s]
  2%|▏         | 8887/371472 [42:10<29:52:26,  3.37it/s]
  2%|▏         | 8888/371472 [42:10<28:17:35,  3.56it/s]
  2%|▏         | 8889/371472 [42:10<28:44:19,  3.50it/s]
  2%|▏         | 8890/371472 [42:11<29:12:49,  3.45it/s]
  2%|▏         | 8891/371472 [42:11<28:16:27,  3.56it/s]
  2%|▏         | 8892/371472 [42:11<35:11:40,  2.86it/s]
  2%|▏         | 8893/371472 [42:12<32:34:39,  3.09it/s]
  2%|▏         | 8894/371472 [42:12<31:27:20,  3.20it/s]
  2%|▏         | 8895/371472 [42:12<30:26:41,  3.31it/s]
  2%|▏         | 8896/371472 [42:12<29:35:30,  3.40it/s]
  2%|▏         | 8897/371472 [42:13<29:05:34,  3.46it/s]
  2%|▏         | 8898/371472 [42:13<30:18:59,  3.32it/s]
  2%|▏         | 8899/371472 [42:13<30:10:50,  3.34it/s]
  2%|▏         | 8900/371472 [42:14<29:31:32,  3.41it/s]
                                                        
{'loss': 4.8243, 'learning_rate': 9.789103406666809e-07, 'epoch': 0.38}

  2%|▏         | 8900/371472 [42:14<29:31:32,  3.41it/s]
  2%|▏         | 8901/371472 [42:14<28:27:00,  3.54it/s]
  2%|▏         | 8902/371472 [42:14<29:20:11,  3.43it/s]
  2%|▏         | 8903/371472 [42:14<29:52:58,  3.37it/s]
  2%|▏         | 8904/371472 [42:15<29:32:17,  3.41it/s]
  2%|▏         | 8905/371472 [42:15<29:12:39,  3.45it/s]
  2%|▏         | 8906/371472 [42:15<28:49:06,  3.49it/s]
  2%|▏         | 8907/371472 [42:16<28:18:10,  3.56it/s]
  2%|▏         | 8908/371472 [42:16<31:12:03,  3.23it/s]
  2%|▏         | 8909/371472 [42:16<30:00:31,  3.36it/s]
  2%|▏         | 8910/371472 [42:17<29:28:10,  3.42it/s]
  2%|▏         | 8911/371472 [42:17<28:34:11,  3.53it/s]
  2%|▏         | 8912/371472 [42:17<27:13:34,  3.70it/s]
  2%|▏         | 8913/371472 [42:17<27:26:40,  3.67it/s]
  2%|▏         | 8914/371472 [42:18<27:19:36,  3.69it/s]
  2%|▏         | 8915/371472 [42:18<27:58:52,  3.60it/s]
  2%|▏         | 8916/371472 [42:18<27:59:08,  3.60it/s]
  2%|▏         | 8917/371472 [42:18<27:38:17,  3.64it/s]
  2%|▏         | 8918/371472 [42:19<28:07:38,  3.58it/s]
  2%|▏         | 8919/371472 [42:19<30:24:43,  3.31it/s]
  2%|▏         | 8920/371472 [42:19<29:40:50,  3.39it/s]
                                                        
{'loss': 4.7814, 'learning_rate': 9.788618586912022e-07, 'epoch': 0.38}

  2%|▏         | 8920/371472 [42:19<29:40:50,  3.39it/s]
  2%|▏         | 8921/371472 [42:20<28:48:15,  3.50it/s]
  2%|▏         | 8922/371472 [42:20<29:10:02,  3.45it/s]
  2%|▏         | 8923/371472 [42:20<28:25:51,  3.54it/s]
  2%|▏         | 8924/371472 [42:20<29:29:14,  3.42it/s]
  2%|▏         | 8925/371472 [42:21<29:04:00,  3.46it/s]
  2%|▏         | 8926/371472 [42:21<28:55:54,  3.48it/s]
  2%|▏         | 8927/371472 [42:21<27:23:33,  3.68it/s]
  2%|▏         | 8928/371472 [42:22<26:50:59,  3.75it/s]
  2%|▏         | 8929/371472 [42:22<30:14:09,  3.33it/s]
  2%|▏         | 8930/371472 [42:22<31:08:12,  3.23it/s]
  2%|▏         | 8931/371472 [42:23<29:46:17,  3.38it/s]
  2%|▏         | 8932/371472 [42:23<28:55:48,  3.48it/s]
  2%|▏         | 8933/371472 [42:23<28:01:27,  3.59it/s]
  2%|▏         | 8934/371472 [42:23<27:47:57,  3.62it/s]
  2%|▏         | 8935/371472 [42:24<27:44:48,  3.63it/s]
  2%|▏         | 8936/371472 [42:24<27:36:03,  3.65it/s]
  2%|▏         | 8937/371472 [42:24<28:36:06,  3.52it/s]
  2%|▏         | 8938/371472 [42:24<27:42:40,  3.63it/s]
  2%|▏         | 8939/371472 [42:25<27:58:53,  3.60it/s]
  2%|▏         | 8940/371472 [42:25<27:55:17,  3.61it/s]
                                                        
{'loss': 5.0305, 'learning_rate': 9.78813376715723e-07, 'epoch': 0.39}

  2%|▏         | 8940/371472 [42:25<27:55:17,  3.61it/s]
  2%|▏         | 8941/371472 [42:25<30:02:07,  3.35it/s]
  2%|▏         | 8942/371472 [42:26<28:51:17,  3.49it/s]
  2%|▏         | 8943/371472 [42:26<27:39:17,  3.64it/s]
  2%|▏         | 8944/371472 [42:26<27:41:59,  3.64it/s]
  2%|▏         | 8945/371472 [42:26<28:18:11,  3.56it/s]
  2%|▏         | 8946/371472 [42:27<28:40:39,  3.51it/s]
  2%|▏         | 8947/371472 [42:27<29:27:47,  3.42it/s]
  2%|▏         | 8948/371472 [42:27<28:29:00,  3.54it/s]
  2%|▏         | 8949/371472 [42:28<28:43:27,  3.51it/s]
  2%|▏         | 8950/371472 [42:28<28:48:03,  3.50it/s]
  2%|▏         | 8951/371472 [42:28<27:45:23,  3.63it/s]
  2%|▏         | 8952/371472 [42:28<27:55:46,  3.61it/s]
  2%|▏         | 8953/371472 [42:29<28:17:10,  3.56it/s]
  2%|▏         | 8954/371472 [42:29<28:38:01,  3.52it/s]
  2%|▏         | 8955/371472 [42:29<27:36:04,  3.65it/s]
  2%|▏         | 8956/371472 [42:29<26:57:20,  3.74it/s]
  2%|▏         | 8957/371472 [42:30<27:02:04,  3.72it/s]
  2%|▏         | 8958/371472 [42:30<28:53:34,  3.49it/s]
  2%|▏         | 8959/371472 [42:30<28:02:05,  3.59it/s]
  2%|▏         | 8960/371472 [42:31<28:11:34,  3.57it/s]
                                                        
{'loss': 5.0014, 'learning_rate': 9.787648947402443e-07, 'epoch': 0.39}

  2%|▏         | 8960/371472 [42:31<28:11:34,  3.57it/s]
  2%|▏         | 8961/371472 [42:31<28:38:33,  3.52it/s]
  2%|▏         | 8962/371472 [42:31<29:39:21,  3.40it/s]
  2%|▏         | 8963/371472 [42:31<28:21:42,  3.55it/s]
  2%|▏         | 8964/371472 [42:32<27:58:34,  3.60it/s]
  2%|▏         | 8965/371472 [42:32<27:13:54,  3.70it/s]
  2%|▏         | 8966/371472 [42:32<27:06:30,  3.71it/s]
  2%|▏         | 8967/371472 [42:33<27:15:04,  3.70it/s]
  2%|▏         | 8968/371472 [42:33<27:17:09,  3.69it/s]
  2%|▏         | 8969/371472 [42:33<28:03:27,  3.59it/s]
  2%|▏         | 8970/371472 [42:33<27:31:09,  3.66it/s]
  2%|▏         | 8971/371472 [42:34<28:09:46,  3.58it/s]
  2%|▏         | 8972/371472 [42:34<28:24:39,  3.54it/s]
  2%|▏         | 8973/371472 [42:34<32:21:01,  3.11it/s]
  2%|▏         | 8974/371472 [42:35<31:18:42,  3.22it/s]
  2%|▏         | 8975/371472 [42:35<31:11:57,  3.23it/s]
  2%|▏         | 8976/371472 [42:35<29:34:33,  3.40it/s]
  2%|▏         | 8977/371472 [42:36<30:16:44,  3.33it/s]
  2%|▏         | 8978/371472 [42:36<28:20:47,  3.55it/s]
  2%|▏         | 8979/371472 [42:36<28:53:23,  3.49it/s]
  2%|▏         | 8980/371472 [42:36<28:00:52,  3.59it/s]
                                                        
{'loss': 5.014, 'learning_rate': 9.787164127647654e-07, 'epoch': 0.39}

  2%|▏         | 8980/371472 [42:36<28:00:52,  3.59it/s]
  2%|▏         | 8981/371472 [42:37<28:35:50,  3.52it/s]
  2%|▏         | 8982/371472 [42:37<28:17:59,  3.56it/s]
  2%|▏         | 8983/371472 [42:37<28:04:05,  3.59it/s]
  2%|▏         | 8984/371472 [42:37<28:55:57,  3.48it/s]
  2%|▏         | 8985/371472 [42:38<28:11:38,  3.57it/s]
  2%|▏         | 8986/371472 [42:38<27:15:39,  3.69it/s]
  2%|▏         | 8987/371472 [42:38<28:09:20,  3.58it/s]
  2%|▏         | 8988/371472 [42:39<29:59:35,  3.36it/s]
  2%|▏         | 8989/371472 [42:39<29:07:12,  3.46it/s]
  2%|▏         | 8990/371472 [42:39<28:39:57,  3.51it/s]
  2%|▏         | 8991/371472 [42:39<28:45:03,  3.50it/s]
  2%|▏         | 8992/371472 [42:40<29:14:34,  3.44it/s]
  2%|▏         | 8993/371472 [42:40<27:53:28,  3.61it/s]
  2%|▏         | 8994/371472 [42:40<29:12:38,  3.45it/s]
  2%|▏         | 8995/371472 [42:41<28:49:18,  3.49it/s]
  2%|▏         | 8996/371472 [42:41<29:00:24,  3.47it/s]
  2%|▏         | 8997/371472 [42:41<27:53:14,  3.61it/s]
  2%|▏         | 8998/371472 [42:41<29:15:50,  3.44it/s]
  2%|▏         | 8999/371472 [42:42<28:16:00,  3.56it/s]
  2%|▏         | 9000/371472 [42:42<27:33:39,  3.65it/s]
                                                        
{'loss': 4.8992, 'learning_rate': 9.786679307892864e-07, 'epoch': 0.39}

  2%|▏         | 9000/371472 [42:42<27:33:39,  3.65it/s]
  2%|▏         | 9001/371472 [42:42<27:01:39,  3.73it/s]
  2%|▏         | 9002/371472 [42:43<27:37:04,  3.65it/s]
  2%|▏         | 9003/371472 [42:43<27:42:32,  3.63it/s]
  2%|▏         | 9004/371472 [42:43<28:04:55,  3.59it/s]
  2%|▏         | 9005/371472 [42:43<27:40:28,  3.64it/s]
  2%|▏         | 9006/371472 [42:44<27:30:42,  3.66it/s]
  2%|▏         | 9007/371472 [42:44<27:42:26,  3.63it/s]
  2%|▏         | 9008/371472 [42:44<28:32:47,  3.53it/s]
  2%|▏         | 9009/371472 [42:44<27:38:30,  3.64it/s]
  2%|▏         | 9010/371472 [42:45<27:57:09,  3.60it/s]
  2%|▏         | 9011/371472 [42:45<27:51:41,  3.61it/s]
  2%|▏         | 9012/371472 [42:45<27:33:11,  3.65it/s]
  2%|▏         | 9013/371472 [42:46<29:06:13,  3.46it/s]
  2%|▏         | 9014/371472 [42:46<29:13:16,  3.45it/s]
  2%|▏         | 9015/371472 [42:46<29:18:27,  3.44it/s]
  2%|▏         | 9016/371472 [42:46<29:11:28,  3.45it/s]
  2%|▏         | 9017/371472 [42:47<28:00:21,  3.60it/s]
  2%|▏         | 9018/371472 [42:47<28:45:26,  3.50it/s]
  2%|▏         | 9019/371472 [42:47<28:45:28,  3.50it/s]
  2%|▏         | 9020/371472 [42:48<27:50:19,  3.62it/s]
                                                        
{'loss': 4.4712, 'learning_rate': 9.786194488138077e-07, 'epoch': 0.39}

  2%|▏         | 9020/371472 [42:48<27:50:19,  3.62it/s]
  2%|▏         | 9021/371472 [42:48<29:29:20,  3.41it/s]
  2%|▏         | 9022/371472 [42:48<30:01:27,  3.35it/s]
  2%|▏         | 9023/371472 [42:48<29:26:51,  3.42it/s]
  2%|▏         | 9024/371472 [42:49<28:28:39,  3.54it/s]
  2%|▏         | 9025/371472 [42:49<28:15:57,  3.56it/s]
  2%|▏         | 9026/371472 [42:49<27:36:42,  3.65it/s]
  2%|▏         | 9027/371472 [42:50<29:31:26,  3.41it/s]
  2%|▏         | 9028/371472 [42:50<29:02:15,  3.47it/s]
  2%|▏         | 9029/371472 [42:50<27:51:01,  3.61it/s]
  2%|▏         | 9030/371472 [42:50<27:25:22,  3.67it/s]
  2%|▏         | 9031/371472 [42:51<29:25:56,  3.42it/s]
  2%|▏         | 9032/371472 [42:51<28:57:01,  3.48it/s]
  2%|▏         | 9033/371472 [42:51<28:04:03,  3.59it/s]
  2%|▏         | 9034/371472 [42:52<29:01:46,  3.47it/s]
  2%|▏         | 9035/371472 [42:52<28:32:09,  3.53it/s]
  2%|▏         | 9036/371472 [42:52<27:33:33,  3.65it/s]
  2%|▏         | 9037/371472 [42:52<27:00:22,  3.73it/s]
  2%|▏         | 9038/371472 [42:53<27:47:49,  3.62it/s]
  2%|▏         | 9039/371472 [42:53<28:02:49,  3.59it/s]
  2%|▏         | 9040/371472 [42:53<30:54:33,  3.26it/s]
                                                        
{'loss': 4.9685, 'learning_rate': 9.785709668383288e-07, 'epoch': 0.39}

  2%|▏         | 9040/371472 [42:53<30:54:33,  3.26it/s]
  2%|▏         | 9041/371472 [42:54<31:36:58,  3.18it/s]
  2%|▏         | 9042/371472 [42:54<30:55:24,  3.26it/s]
  2%|▏         | 9043/371472 [42:54<30:32:10,  3.30it/s]
  2%|▏         | 9044/371472 [42:55<31:05:14,  3.24it/s]
  2%|▏         | 9045/371472 [42:55<30:12:11,  3.33it/s]
  2%|▏         | 9046/371472 [42:55<30:02:01,  3.35it/s]
  2%|▏         | 9047/371472 [42:55<30:19:15,  3.32it/s]
  2%|▏         | 9048/371472 [42:56<29:52:27,  3.37it/s]
  2%|▏         | 9049/371472 [42:56<28:33:43,  3.52it/s]
  2%|▏         | 9050/371472 [42:56<28:44:42,  3.50it/s]
  2%|▏         | 9051/371472 [42:57<29:00:10,  3.47it/s]
  2%|▏         | 9052/371472 [42:57<30:09:25,  3.34it/s]
  2%|▏         | 9053/371472 [42:57<29:42:51,  3.39it/s]
  2%|▏         | 9054/371472 [42:57<29:31:33,  3.41it/s]
  2%|▏         | 9055/371472 [42:58<27:48:04,  3.62it/s]
  2%|▏         | 9056/371472 [42:58<27:47:38,  3.62it/s]
  2%|▏         | 9057/371472 [42:58<28:17:56,  3.56it/s]
  2%|▏         | 9058/371472 [42:59<28:33:20,  3.53it/s]
  2%|▏         | 9059/371472 [42:59<30:24:49,  3.31it/s]
  2%|▏         | 9060/371472 [42:59<31:10:32,  3.23it/s]
                                                        
{'loss': 4.4798, 'learning_rate': 9.785224848628499e-07, 'epoch': 0.39}

  2%|▏         | 9060/371472 [42:59<31:10:32,  3.23it/s]
  2%|▏         | 9061/371472 [42:59<29:27:04,  3.42it/s]
  2%|▏         | 9062/371472 [43:00<29:02:04,  3.47it/s]
  2%|▏         | 9063/371472 [43:00<28:51:33,  3.49it/s]
  2%|▏         | 9064/371472 [43:00<27:39:53,  3.64it/s]
  2%|▏         | 9065/371472 [43:01<26:35:20,  3.79it/s]
  2%|▏         | 9066/371472 [43:01<26:26:50,  3.81it/s]
  2%|▏         | 9067/371472 [43:01<28:19:48,  3.55it/s]
  2%|▏         | 9068/371472 [43:01<27:37:35,  3.64it/s]
  2%|▏         | 9069/371472 [43:02<27:32:44,  3.65it/s]
  2%|▏         | 9070/371472 [43:02<27:27:23,  3.67it/s]
  2%|▏         | 9071/371472 [43:02<28:23:27,  3.55it/s]
  2%|▏         | 9072/371472 [43:03<28:49:23,  3.49it/s]
  2%|▏         | 9073/371472 [43:03<28:15:09,  3.56it/s]
  2%|▏         | 9074/371472 [43:03<28:20:04,  3.55it/s]
  2%|▏         | 9075/371472 [43:03<28:11:06,  3.57it/s]
  2%|▏         | 9076/371472 [43:04<27:34:30,  3.65it/s]
  2%|▏         | 9077/371472 [43:04<28:34:09,  3.52it/s]
  2%|▏         | 9078/371472 [43:04<27:10:09,  3.71it/s]
  2%|▏         | 9079/371472 [43:04<28:42:42,  3.51it/s]
  2%|▏         | 9080/371472 [43:05<27:33:23,  3.65it/s]
                                                        
{'loss': 5.0365, 'learning_rate': 9.78474002887371e-07, 'epoch': 0.39}

  2%|▏         | 9080/371472 [43:05<27:33:23,  3.65it/s]
  2%|▏         | 9081/371472 [43:05<27:23:44,  3.67it/s]
  2%|▏         | 9082/371472 [43:05<27:33:25,  3.65it/s]
  2%|▏         | 9083/371472 [43:06<27:48:33,  3.62it/s]
  2%|▏         | 9084/371472 [43:06<27:09:49,  3.71it/s]
  2%|▏         | 9085/371472 [43:06<27:11:47,  3.70it/s]
  2%|▏         | 9086/371472 [43:06<27:58:57,  3.60it/s]
  2%|▏         | 9087/371472 [43:07<27:38:37,  3.64it/s]
  2%|▏         | 9088/371472 [43:07<27:29:38,  3.66it/s]
  2%|▏         | 9089/371472 [43:07<26:44:53,  3.76it/s]
  2%|▏         | 9090/371472 [43:07<26:30:45,  3.80it/s]
  2%|▏         | 9091/371472 [43:08<26:37:23,  3.78it/s]
  2%|▏         | 9092/371472 [43:08<27:54:58,  3.61it/s]
  2%|▏         | 9093/371472 [43:08<29:08:54,  3.45it/s]
  2%|▏         | 9094/371472 [43:09<28:32:47,  3.53it/s]
  2%|▏         | 9095/371472 [43:09<28:43:09,  3.50it/s]
  2%|▏         | 9096/371472 [43:09<28:27:28,  3.54it/s]
  2%|▏         | 9097/371472 [43:09<27:55:59,  3.60it/s]
  2%|▏         | 9098/371472 [43:10<26:51:59,  3.75it/s]
  2%|▏         | 9099/371472 [43:10<29:16:26,  3.44it/s]
  2%|▏         | 9100/371472 [43:10<28:26:10,  3.54it/s]
                                                        
{'loss': 4.8627, 'learning_rate': 9.78425520911892e-07, 'epoch': 0.39}

  2%|▏         | 9100/371472 [43:10<28:26:10,  3.54it/s]
  2%|▏         | 9101/371472 [43:11<27:45:33,  3.63it/s]
  2%|▏         | 9102/371472 [43:11<28:26:45,  3.54it/s]
  2%|▏         | 9103/371472 [43:11<29:10:20,  3.45it/s]
  2%|▏         | 9104/371472 [43:11<28:29:51,  3.53it/s]
  2%|▏         | 9105/371472 [43:12<29:38:48,  3.40it/s]
  2%|▏         | 9106/371472 [43:12<29:56:14,  3.36it/s]
  2%|▏         | 9107/371472 [43:12<29:03:55,  3.46it/s]
  2%|▏         | 9108/371472 [43:13<28:17:07,  3.56it/s]
  2%|▏         | 9109/371472 [43:13<27:23:35,  3.67it/s]
  2%|▏         | 9110/371472 [43:13<27:39:41,  3.64it/s]
  2%|▏         | 9111/371472 [43:13<27:49:17,  3.62it/s]
  2%|▏         | 9112/371472 [43:14<27:40:59,  3.64it/s]
  2%|▏         | 9113/371472 [43:14<26:41:18,  3.77it/s]
  2%|▏         | 9114/371472 [43:14<27:02:41,  3.72it/s]
  2%|▏         | 9115/371472 [43:14<26:23:57,  3.81it/s]
  2%|▏         | 9116/371472 [43:15<27:00:43,  3.73it/s]
  2%|▏         | 9117/371472 [43:15<27:07:16,  3.71it/s]
  2%|▏         | 9118/371472 [43:15<26:36:49,  3.78it/s]
  2%|▏         | 9119/371472 [43:16<27:48:54,  3.62it/s]
  2%|▏         | 9120/371472 [43:16<29:27:39,  3.42it/s]
                                                        
{'loss': 4.8344, 'learning_rate': 9.783770389364133e-07, 'epoch': 0.39}

  2%|▏         | 9120/371472 [43:16<29:27:39,  3.42it/s]
  2%|▏         | 9121/371472 [43:16<28:57:45,  3.48it/s]
  2%|▏         | 9122/371472 [43:16<29:10:57,  3.45it/s]
  2%|▏         | 9123/371472 [43:17<29:20:21,  3.43it/s]
  2%|▏         | 9124/371472 [43:17<30:15:59,  3.33it/s]
  2%|▏         | 9125/371472 [43:17<31:49:55,  3.16it/s]
  2%|▏         | 9126/371472 [43:18<30:52:38,  3.26it/s]
  2%|▏         | 9127/371472 [43:18<29:52:14,  3.37it/s]
  2%|▏         | 9128/371472 [43:18<30:15:47,  3.33it/s]
  2%|▏         | 9129/371472 [43:19<29:51:23,  3.37it/s]
  2%|▏         | 9130/371472 [43:19<29:51:59,  3.37it/s]
  2%|▏         | 9131/371472 [43:19<30:24:37,  3.31it/s]
  2%|▏         | 9132/371472 [43:19<29:57:32,  3.36it/s]
  2%|▏         | 9133/371472 [43:20<29:14:01,  3.44it/s]
  2%|▏         | 9134/371472 [43:20<28:29:52,  3.53it/s]
  2%|▏         | 9135/371472 [43:20<28:50:48,  3.49it/s]
  2%|▏         | 9136/371472 [43:21<28:52:40,  3.49it/s]
  2%|▏         | 9137/371472 [43:21<29:20:11,  3.43it/s]
  2%|▏         | 9138/371472 [43:21<29:05:28,  3.46it/s]
  2%|▏         | 9139/371472 [43:21<28:53:18,  3.48it/s]
  2%|▏         | 9140/371472 [43:22<28:12:41,  3.57it/s]
                                                        
{'loss': 4.8208, 'learning_rate': 9.783285569609342e-07, 'epoch': 0.39}

  2%|▏         | 9140/371472 [43:22<28:12:41,  3.57it/s]
  2%|▏         | 9141/371472 [43:22<31:43:03,  3.17it/s]
  2%|▏         | 9142/371472 [43:22<31:38:15,  3.18it/s]
  2%|▏         | 9143/371472 [43:23<31:01:33,  3.24it/s]
  2%|▏         | 9144/371472 [43:23<30:12:42,  3.33it/s]
  2%|▏         | 9145/371472 [43:23<31:07:33,  3.23it/s]
  2%|▏         | 9146/371472 [43:24<31:36:30,  3.18it/s]
  2%|▏         | 9147/371472 [43:24<30:57:55,  3.25it/s]
  2%|▏         | 9148/371472 [43:24<30:10:09,  3.34it/s]
  2%|▏         | 9149/371472 [43:25<31:48:04,  3.16it/s]
  2%|▏         | 9150/371472 [43:25<31:05:29,  3.24it/s]
  2%|▏         | 9151/371472 [43:25<30:05:03,  3.35it/s]
  2%|▏         | 9152/371472 [43:25<30:23:31,  3.31it/s]
  2%|▏         | 9153/371472 [43:26<29:35:11,  3.40it/s]
  2%|▏         | 9154/371472 [43:26<31:03:09,  3.24it/s]
  2%|▏         | 9155/371472 [43:26<30:44:38,  3.27it/s]
  2%|▏         | 9156/371472 [43:27<29:25:00,  3.42it/s]
  2%|▏         | 9157/371472 [43:27<29:23:00,  3.43it/s]
  2%|▏         | 9158/371472 [43:27<28:02:51,  3.59it/s]
  2%|▏         | 9159/371472 [43:27<27:00:25,  3.73it/s]
  2%|▏         | 9160/371472 [43:28<28:03:33,  3.59it/s]
                                                        
{'loss': 4.7272, 'learning_rate': 9.782800749854554e-07, 'epoch': 0.39}

  2%|▏         | 9160/371472 [43:28<28:03:33,  3.59it/s]
  2%|▏         | 9161/371472 [43:28<27:32:19,  3.65it/s]
  2%|▏         | 9162/371472 [43:28<28:26:31,  3.54it/s]
  2%|▏         | 9163/371472 [43:29<28:08:26,  3.58it/s]
  2%|▏         | 9164/371472 [43:29<29:24:51,  3.42it/s]
  2%|▏         | 9165/371472 [43:29<28:29:22,  3.53it/s]
  2%|▏         | 9166/371472 [43:29<29:00:56,  3.47it/s]
  2%|▏         | 9167/371472 [43:30<28:35:01,  3.52it/s]
  2%|▏         | 9168/371472 [43:30<30:11:08,  3.33it/s]
  2%|▏         | 9169/371472 [43:30<29:47:35,  3.38it/s]
  2%|▏         | 9170/371472 [43:31<28:57:38,  3.48it/s]
  2%|▏         | 9171/371472 [43:31<29:18:20,  3.43it/s]
  2%|▏         | 9172/371472 [43:31<28:32:51,  3.53it/s]
  2%|▏         | 9173/371472 [43:31<27:26:48,  3.67it/s]
  2%|▏         | 9174/371472 [43:32<26:43:21,  3.77it/s]
  2%|▏         | 9175/371472 [43:32<29:43:08,  3.39it/s]
  2%|▏         | 9176/371472 [43:32<29:45:43,  3.38it/s]
  2%|▏         | 9177/371472 [43:33<28:30:57,  3.53it/s]
  2%|▏         | 9178/371472 [43:33<28:31:29,  3.53it/s]
  2%|▏         | 9179/371472 [43:33<28:01:09,  3.59it/s]
  2%|▏         | 9180/371472 [43:33<27:07:25,  3.71it/s]
                                                        
{'loss': 4.6802, 'learning_rate': 9.782315930099763e-07, 'epoch': 0.4}

  2%|▏         | 9180/371472 [43:33<27:07:25,  3.71it/s]
  2%|▏         | 9181/371472 [43:34<28:01:47,  3.59it/s]
  2%|▏         | 9182/371472 [43:34<28:27:10,  3.54it/s]
  2%|▏         | 9183/371472 [43:34<27:19:56,  3.68it/s]
  2%|▏         | 9184/371472 [43:35<29:07:41,  3.45it/s]
  2%|▏         | 9185/371472 [43:35<29:12:26,  3.45it/s]
  2%|▏         | 9186/371472 [43:35<28:10:34,  3.57it/s]
  2%|▏         | 9187/371472 [43:35<27:29:56,  3.66it/s]
  2%|▏         | 9188/371472 [43:36<27:11:57,  3.70it/s]
  2%|▏         | 9189/371472 [43:36<26:37:45,  3.78it/s]
  2%|▏         | 9190/371472 [43:36<26:29:52,  3.80it/s]
  2%|▏         | 9191/371472 [43:36<26:14:56,  3.83it/s]
  2%|▏         | 9192/371472 [43:37<26:42:51,  3.77it/s]
  2%|▏         | 9193/371472 [43:37<28:58:50,  3.47it/s]
  2%|▏         | 9194/371472 [43:37<27:54:43,  3.61it/s]
  2%|▏         | 9195/371472 [43:38<28:39:07,  3.51it/s]
  2%|▏         | 9196/371472 [43:38<28:06:15,  3.58it/s]
  2%|▏         | 9197/371472 [43:38<27:47:43,  3.62it/s]
  2%|▏         | 9198/371472 [43:38<28:18:41,  3.55it/s]
  2%|▏         | 9199/371472 [43:39<27:30:13,  3.66it/s]
  2%|▏         | 9200/371472 [43:39<29:27:05,  3.42it/s]
                                                        
{'loss': 4.9891, 'learning_rate': 9.781831110344976e-07, 'epoch': 0.4}

  2%|▏         | 9200/371472 [43:39<29:27:05,  3.42it/s]
  2%|▏         | 9201/371472 [43:39<29:28:33,  3.41it/s]
  2%|▏         | 9202/371472 [43:40<28:56:52,  3.48it/s]
  2%|▏         | 9203/371472 [43:40<28:24:51,  3.54it/s]
  2%|▏         | 9204/371472 [43:40<28:48:02,  3.49it/s]
  2%|▏         | 9205/371472 [43:40<29:08:35,  3.45it/s]
  2%|▏         | 9206/371472 [43:41<30:41:15,  3.28it/s]
  2%|▏         | 9207/371472 [43:41<32:19:55,  3.11it/s]
  2%|▏         | 9208/371472 [43:41<30:43:40,  3.27it/s]
  2%|▏         | 9209/371472 [43:42<31:11:53,  3.23it/s]
  2%|▏         | 9210/371472 [43:42<30:12:57,  3.33it/s]
  2%|▏         | 9211/371472 [43:42<30:45:43,  3.27it/s]
  2%|▏         | 9212/371472 [43:43<29:04:23,  3.46it/s]
  2%|▏         | 9213/371472 [43:43<27:59:41,  3.59it/s]
  2%|▏         | 9214/371472 [43:43<26:43:19,  3.77it/s]
  2%|▏         | 9215/371472 [43:43<26:41:12,  3.77it/s]
  2%|▏         | 9216/371472 [43:44<25:56:16,  3.88it/s]
  2%|▏         | 9217/371472 [43:44<27:55:38,  3.60it/s]
  2%|▏         | 9218/371472 [43:44<29:32:44,  3.41it/s]
  2%|▏         | 9219/371472 [43:45<34:41:57,  2.90it/s]
  2%|▏         | 9220/371472 [43:45<31:56:05,  3.15it/s]
                                                        
{'loss': 5.038, 'learning_rate': 9.781346290590187e-07, 'epoch': 0.4}

  2%|▏         | 9220/371472 [43:45<31:56:05,  3.15it/s]
  2%|▏         | 9221/371472 [43:45<30:06:14,  3.34it/s]
  2%|▏         | 9222/371472 [43:45<30:53:15,  3.26it/s]
  2%|▏         | 9223/371472 [43:46<29:28:36,  3.41it/s]
  2%|▏         | 9224/371472 [43:46<31:10:31,  3.23it/s]
  2%|▏         | 9225/371472 [43:46<29:25:15,  3.42it/s]
  2%|▏         | 9226/371472 [43:47<29:45:03,  3.38it/s]
  2%|▏         | 9227/371472 [43:47<28:55:45,  3.48it/s]
  2%|▏         | 9228/371472 [43:47<29:45:36,  3.38it/s]
  2%|▏         | 9229/371472 [43:48<31:27:02,  3.20it/s]
  2%|▏         | 9230/371472 [43:48<30:51:19,  3.26it/s]
  2%|▏         | 9231/371472 [43:48<34:08:51,  2.95it/s]
  2%|▏         | 9232/371472 [43:49<31:20:04,  3.21it/s]
  2%|▏         | 9233/371472 [43:49<31:00:38,  3.24it/s]
  2%|▏         | 9234/371472 [43:49<31:48:41,  3.16it/s]
  2%|▏         | 9235/371472 [43:49<30:59:04,  3.25it/s]
  2%|▏         | 9236/371472 [43:50<29:35:20,  3.40it/s]
  2%|▏         | 9237/371472 [43:50<28:17:58,  3.56it/s]
  2%|▏         | 9238/371472 [43:50<29:13:50,  3.44it/s]
  2%|▏         | 9239/371472 [43:51<28:40:46,  3.51it/s]
  2%|▏         | 9240/371472 [43:51<27:54:37,  3.61it/s]
                                                        
{'loss': 4.8407, 'learning_rate': 9.780861470835397e-07, 'epoch': 0.4}

  2%|▏         | 9240/371472 [43:51<27:54:37,  3.61it/s]
  2%|▏         | 9241/371472 [43:51<26:57:28,  3.73it/s]
  2%|▏         | 9242/371472 [43:51<26:39:49,  3.77it/s]
  2%|▏         | 9243/371472 [43:52<29:34:00,  3.40it/s]
  2%|▏         | 9244/371472 [43:52<29:59:30,  3.35it/s]
  2%|▏         | 9245/371472 [43:52<30:09:47,  3.34it/s]
  2%|▏         | 9246/371472 [43:53<29:49:41,  3.37it/s]
  2%|▏         | 9247/371472 [43:53<28:42:30,  3.50it/s]
  2%|▏         | 9248/371472 [43:53<29:18:14,  3.43it/s]
  2%|▏         | 9249/371472 [43:53<28:55:28,  3.48it/s]
  2%|▏         | 9250/371472 [43:54<28:46:48,  3.50it/s]
  2%|▏         | 9251/371472 [43:54<28:00:27,  3.59it/s]
  2%|▏         | 9252/371472 [43:54<27:24:13,  3.67it/s]
  2%|▏         | 9253/371472 [43:55<27:23:16,  3.67it/s]
  2%|▏         | 9254/371472 [43:55<29:06:51,  3.46it/s]
  2%|▏         | 9255/371472 [43:55<29:25:57,  3.42it/s]
  2%|▏         | 9256/371472 [43:55<31:10:59,  3.23it/s]
  2%|▏         | 9257/371472 [43:56<30:23:54,  3.31it/s]
  2%|▏         | 9258/371472 [43:56<29:56:38,  3.36it/s]
  2%|▏         | 9259/371472 [43:56<28:38:44,  3.51it/s]
  2%|▏         | 9260/371472 [43:57<28:59:35,  3.47it/s]
                                                        
{'loss': 4.9967, 'learning_rate': 9.78037665108061e-07, 'epoch': 0.4}

  2%|▏         | 9260/371472 [43:57<28:59:35,  3.47it/s]
  2%|▏         | 9261/371472 [43:57<29:03:17,  3.46it/s]
  2%|▏         | 9262/371472 [43:57<30:23:02,  3.31it/s]
  2%|▏         | 9263/371472 [43:58<31:06:16,  3.23it/s]
  2%|▏         | 9264/371472 [43:58<29:38:55,  3.39it/s]
  2%|▏         | 9265/371472 [43:58<29:17:15,  3.44it/s]
  2%|▏         | 9266/371472 [43:58<29:56:36,  3.36it/s]
  2%|▏         | 9267/371472 [43:59<30:51:06,  3.26it/s]
  2%|▏         | 9268/371472 [43:59<29:43:40,  3.38it/s]
  2%|▏         | 9269/371472 [43:59<31:49:08,  3.16it/s]
  2%|▏         | 9270/371472 [44:00<30:57:29,  3.25it/s]
  2%|▏         | 9271/371472 [44:00<30:42:03,  3.28it/s]
  2%|▏         | 9272/371472 [44:00<29:22:49,  3.42it/s]
  2%|▏         | 9273/371472 [44:00<28:58:55,  3.47it/s]
  2%|▏         | 9274/371472 [44:01<28:16:04,  3.56it/s]
  2%|▏         | 9275/371472 [44:01<27:16:11,  3.69it/s]
  2%|▏         | 9276/371472 [44:01<26:34:00,  3.79it/s]
  2%|▏         | 9277/371472 [44:02<27:04:00,  3.72it/s]
  2%|▏         | 9278/371472 [44:02<26:29:48,  3.80it/s]
  2%|▏         | 9279/371472 [44:02<27:08:21,  3.71it/s]
  2%|▏         | 9280/371472 [44:02<27:41:23,  3.63it/s]
                                                        
{'loss': 4.871, 'learning_rate': 9.77989183132582e-07, 'epoch': 0.4}

  2%|▏         | 9280/371472 [44:02<27:41:23,  3.63it/s]
  2%|▏         | 9281/371472 [44:03<28:07:32,  3.58it/s]
  2%|▏         | 9282/371472 [44:03<28:57:36,  3.47it/s]
  2%|▏         | 9283/371472 [44:03<28:03:13,  3.59it/s]
  2%|▏         | 9284/371472 [44:03<27:06:16,  3.71it/s]
  2%|▏         | 9285/371472 [44:04<29:06:05,  3.46it/s]
  2%|▏         | 9286/371472 [44:04<29:06:34,  3.46it/s]
  3%|▎         | 9287/371472 [44:04<28:30:35,  3.53it/s]
  3%|▎         | 9288/371472 [44:05<29:14:17,  3.44it/s]
  3%|▎         | 9289/371472 [44:05<28:43:20,  3.50it/s]
  3%|▎         | 9290/371472 [44:05<28:36:51,  3.52it/s]
  3%|▎         | 9291/371472 [44:06<28:44:05,  3.50it/s]
  3%|▎         | 9292/371472 [44:06<28:28:43,  3.53it/s]
  3%|▎         | 9293/371472 [44:06<29:50:28,  3.37it/s]
  3%|▎         | 9294/371472 [44:06<31:35:30,  3.18it/s]
  3%|▎         | 9295/371472 [44:07<30:27:21,  3.30it/s]
  3%|▎         | 9296/371472 [44:07<29:23:01,  3.42it/s]
  3%|▎         | 9297/371472 [44:07<28:27:05,  3.54it/s]
  3%|▎         | 9298/371472 [44:08<28:02:21,  3.59it/s]
  3%|▎         | 9299/371472 [44:08<27:37:50,  3.64it/s]
  3%|▎         | 9300/371472 [44:08<27:16:24,  3.69it/s]
                                                        
{'loss': 4.9019, 'learning_rate': 9.779407011571032e-07, 'epoch': 0.4}

  3%|▎         | 9300/371472 [44:08<27:16:24,  3.69it/s]
  3%|▎         | 9301/371472 [44:08<28:22:43,  3.55it/s]
  3%|▎         | 9302/371472 [44:09<29:10:16,  3.45it/s]
  3%|▎         | 9303/371472 [44:09<28:45:45,  3.50it/s]
  3%|▎         | 9304/371472 [44:09<28:46:31,  3.50it/s]
  3%|▎         | 9305/371472 [44:10<29:01:18,  3.47it/s]
  3%|▎         | 9306/371472 [44:10<30:05:00,  3.34it/s]
  3%|▎         | 9307/371472 [44:10<29:20:17,  3.43it/s]
  3%|▎         | 9308/371472 [44:10<30:07:28,  3.34it/s]
  3%|▎         | 9309/371472 [44:11<29:30:43,  3.41it/s]
  3%|▎         | 9310/371472 [44:11<29:24:10,  3.42it/s]
  3%|▎         | 9311/371472 [44:11<28:15:15,  3.56it/s]
  3%|▎         | 9312/371472 [44:12<27:32:32,  3.65it/s]
  3%|▎         | 9313/371472 [44:12<27:36:09,  3.64it/s]
  3%|▎         | 9314/371472 [44:12<29:40:56,  3.39it/s]
  3%|▎         | 9315/371472 [44:12<28:20:25,  3.55it/s]
  3%|▎         | 9316/371472 [44:13<28:06:22,  3.58it/s]
  3%|▎         | 9317/371472 [44:13<31:44:40,  3.17it/s]
  3%|▎         | 9318/371472 [44:13<30:51:24,  3.26it/s]
  3%|▎         | 9319/371472 [44:14<31:59:33,  3.14it/s]
  3%|▎         | 9320/371472 [44:14<31:56:27,  3.15it/s]
                                                        
{'loss': 4.4204, 'learning_rate': 9.778922191816242e-07, 'epoch': 0.4}

  3%|▎         | 9320/371472 [44:14<31:56:27,  3.15it/s]
  3%|▎         | 9321/371472 [44:14<31:03:31,  3.24it/s]
  3%|▎         | 9322/371472 [44:15<29:49:40,  3.37it/s]
  3%|▎         | 9323/371472 [44:15<31:32:31,  3.19it/s]
  3%|▎         | 9324/371472 [44:15<32:02:45,  3.14it/s]
  3%|▎         | 9325/371472 [44:16<33:10:26,  3.03it/s]
  3%|▎         | 9326/371472 [44:16<31:28:10,  3.20it/s]
  3%|▎         | 9327/371472 [44:16<30:34:28,  3.29it/s]
  3%|▎         | 9328/371472 [44:16<28:53:34,  3.48it/s]
  3%|▎         | 9329/371472 [44:17<30:45:31,  3.27it/s]
  3%|▎         | 9330/371472 [44:17<30:29:22,  3.30it/s]
  3%|▎         | 9331/371472 [44:17<28:57:25,  3.47it/s]
  3%|▎         | 9332/371472 [44:18<29:11:52,  3.45it/s]
  3%|▎         | 9333/371472 [44:18<29:56:58,  3.36it/s]
  3%|▎         | 9334/371472 [44:18<30:02:36,  3.35it/s]
  3%|▎         | 9335/371472 [44:18<28:35:19,  3.52it/s]
  3%|▎         | 9336/371472 [44:19<28:21:15,  3.55it/s]
  3%|▎         | 9337/371472 [44:19<27:44:00,  3.63it/s]
  3%|▎         | 9338/371472 [44:19<27:23:00,  3.67it/s]
  3%|▎         | 9339/371472 [44:20<26:36:01,  3.78it/s]
  3%|▎         | 9340/371472 [44:20<26:04:01,  3.86it/s]
                                                        
{'loss': 4.6821, 'learning_rate': 9.778437372061453e-07, 'epoch': 0.4}

  3%|▎         | 9340/371472 [44:20<26:04:01,  3.86it/s]
  3%|▎         | 9341/371472 [44:20<26:00:08,  3.87it/s]
  3%|▎         | 9342/371472 [44:20<26:51:12,  3.75it/s]
  3%|▎         | 9343/371472 [44:21<29:27:30,  3.41it/s]
  3%|▎         | 9344/371472 [44:21<29:14:10,  3.44it/s]
  3%|▎         | 9345/371472 [44:21<30:22:11,  3.31it/s]
  3%|▎         | 9346/371472 [44:22<28:48:56,  3.49it/s]
  3%|▎         | 9347/371472 [44:22<28:13:10,  3.56it/s]
  3%|▎         | 9348/371472 [44:22<27:57:42,  3.60it/s]
  3%|▎         | 9349/371472 [44:22<28:15:27,  3.56it/s]
  3%|▎         | 9350/371472 [44:23<27:29:02,  3.66it/s]
  3%|▎         | 9351/371472 [44:23<26:24:50,  3.81it/s]
  3%|▎         | 9352/371472 [44:23<25:43:20,  3.91it/s]
  3%|▎         | 9353/371472 [44:23<25:31:21,  3.94it/s]
  3%|▎         | 9354/371472 [44:24<25:06:12,  4.01it/s]
  3%|▎         | 9355/371472 [44:24<26:26:04,  3.81it/s]
  3%|▎         | 9356/371472 [44:24<25:59:49,  3.87it/s]
  3%|▎         | 9357/371472 [44:24<26:40:15,  3.77it/s]
  3%|▎         | 9358/371472 [44:25<26:59:21,  3.73it/s]
  3%|▎         | 9359/371472 [44:25<28:56:40,  3.48it/s]
  3%|▎         | 9360/371472 [44:25<27:44:42,  3.63it/s]
                                                        
{'loss': 4.8691, 'learning_rate': 9.777952552306664e-07, 'epoch': 0.4}

  3%|▎         | 9360/371472 [44:25<27:44:42,  3.63it/s]
  3%|▎         | 9361/371472 [44:26<28:45:52,  3.50it/s]
  3%|▎         | 9362/371472 [44:26<30:24:09,  3.31it/s]
  3%|▎         | 9363/371472 [44:26<29:22:26,  3.42it/s]
  3%|▎         | 9364/371472 [44:26<27:50:55,  3.61it/s]
  3%|▎         | 9365/371472 [44:27<29:38:16,  3.39it/s]
  3%|▎         | 9366/371472 [44:27<28:58:16,  3.47it/s]
  3%|▎         | 9367/371472 [44:27<27:52:32,  3.61it/s]
  3%|▎         | 9368/371472 [44:28<28:07:12,  3.58it/s]
  3%|▎         | 9369/371472 [44:28<29:57:39,  3.36it/s]
  3%|▎         | 9370/371472 [44:28<29:58:03,  3.36it/s]
  3%|▎         | 9371/371472 [44:28<27:59:33,  3.59it/s]
  3%|▎         | 9372/371472 [44:29<29:08:20,  3.45it/s]
  3%|▎         | 9373/371472 [44:29<27:53:13,  3.61it/s]
  3%|▎         | 9374/371472 [44:29<27:04:04,  3.72it/s]
  3%|▎         | 9375/371472 [44:30<27:12:27,  3.70it/s]
  3%|▎         | 9376/371472 [44:30<30:02:10,  3.35it/s]
  3%|▎         | 9377/371472 [44:30<29:50:24,  3.37it/s]
  3%|▎         | 9378/371472 [44:30<28:35:17,  3.52it/s]
  3%|▎         | 9379/371472 [44:31<30:32:08,  3.29it/s]
  3%|▎         | 9380/371472 [44:31<29:16:00,  3.44it/s]
                                                        
{'loss': 5.0331, 'learning_rate': 9.777467732551874e-07, 'epoch': 0.4}

  3%|▎         | 9380/371472 [44:31<29:16:00,  3.44it/s]
  3%|▎         | 9381/371472 [44:31<28:34:02,  3.52it/s]
  3%|▎         | 9382/371472 [44:32<27:27:06,  3.66it/s]
  3%|▎         | 9383/371472 [44:32<27:24:08,  3.67it/s]
  3%|▎         | 9384/371472 [44:32<29:39:42,  3.39it/s]
  3%|▎         | 9385/371472 [44:32<28:27:01,  3.54it/s]
  3%|▎         | 9386/371472 [44:33<27:46:08,  3.62it/s]
  3%|▎         | 9387/371472 [44:33<29:26:01,  3.42it/s]
  3%|▎         | 9388/371472 [44:33<28:34:27,  3.52it/s]
  3%|▎         | 9389/371472 [44:34<28:30:05,  3.53it/s]
  3%|▎         | 9390/371472 [44:34<27:58:17,  3.60it/s]
  3%|▎         | 9391/371472 [44:34<27:33:08,  3.65it/s]
  3%|▎         | 9392/371472 [44:34<26:58:45,  3.73it/s]
  3%|▎         | 9393/371472 [44:35<26:34:34,  3.78it/s]
  3%|▎         | 9394/371472 [44:35<27:09:26,  3.70it/s]
  3%|▎         | 9395/371472 [44:35<26:38:14,  3.78it/s]
  3%|▎         | 9396/371472 [44:35<26:43:09,  3.76it/s]
  3%|▎         | 9397/371472 [44:36<26:12:53,  3.84it/s]
  3%|▎         | 9398/371472 [44:36<26:02:38,  3.86it/s]
  3%|▎         | 9399/371472 [44:36<26:30:48,  3.79it/s]
  3%|▎         | 9400/371472 [44:37<28:28:44,  3.53it/s]
                                                        
{'loss': 4.992, 'learning_rate': 9.776982912797087e-07, 'epoch': 0.4}

  3%|▎         | 9400/371472 [44:37<28:28:44,  3.53it/s]
  3%|▎         | 9401/371472 [44:37<28:03:55,  3.58it/s]
  3%|▎         | 9402/371472 [44:37<27:17:13,  3.69it/s]
  3%|▎         | 9403/371472 [44:37<28:38:12,  3.51it/s]
  3%|▎         | 9404/371472 [44:38<28:49:49,  3.49it/s]
  3%|▎         | 9405/371472 [44:38<28:14:56,  3.56it/s]
  3%|▎         | 9406/371472 [44:38<28:20:55,  3.55it/s]
  3%|▎         | 9407/371472 [44:39<29:43:56,  3.38it/s]
  3%|▎         | 9408/371472 [44:39<28:32:24,  3.52it/s]
  3%|▎         | 9409/371472 [44:39<28:19:19,  3.55it/s]
  3%|▎         | 9410/371472 [44:39<28:04:29,  3.58it/s]
  3%|▎         | 9411/371472 [44:40<29:38:48,  3.39it/s]
  3%|▎         | 9412/371472 [44:40<28:53:12,  3.48it/s]
  3%|▎         | 9413/371472 [44:40<30:06:10,  3.34it/s]
  3%|▎         | 9414/371472 [44:41<28:46:46,  3.49it/s]
  3%|▎         | 9415/371472 [44:41<29:31:56,  3.41it/s]
  3%|▎         | 9416/371472 [44:41<28:30:59,  3.53it/s]
  3%|▎         | 9417/371472 [44:41<29:33:08,  3.40it/s]
  3%|▎         | 9418/371472 [44:42<27:50:37,  3.61it/s]
  3%|▎         | 9419/371472 [44:42<26:29:45,  3.80it/s]
  3%|▎         | 9420/371472 [44:42<26:38:40,  3.77it/s]
                                                        
{'loss': 4.8098, 'learning_rate': 9.776498093042298e-07, 'epoch': 0.41}

  3%|▎         | 9420/371472 [44:42<26:38:40,  3.77it/s]
  3%|▎         | 9421/371472 [44:42<26:17:24,  3.83it/s]
  3%|▎         | 9422/371472 [44:43<26:02:07,  3.86it/s]
  3%|▎         | 9423/371472 [44:43<26:17:24,  3.83it/s]
  3%|▎         | 9424/371472 [44:43<25:46:40,  3.90it/s]
  3%|▎         | 9425/371472 [44:43<25:09:41,  4.00it/s]
  3%|▎         | 9426/371472 [44:44<25:43:52,  3.91it/s]
  3%|▎         | 9427/371472 [44:44<26:07:00,  3.85it/s]
  3%|▎         | 9428/371472 [44:44<25:53:11,  3.88it/s]
  3%|▎         | 9429/371472 [44:44<26:54:05,  3.74it/s]
  3%|▎         | 9430/371472 [44:45<28:32:30,  3.52it/s]
  3%|▎         | 9431/371472 [44:45<28:27:31,  3.53it/s]
  3%|▎         | 9432/371472 [44:45<28:20:39,  3.55it/s]
  3%|▎         | 9433/371472 [44:46<27:42:56,  3.63it/s]
  3%|▎         | 9434/371472 [44:46<27:51:29,  3.61it/s]
  3%|▎         | 9435/371472 [44:46<28:42:13,  3.50it/s]
  3%|▎         | 9436/371472 [44:46<28:06:42,  3.58it/s]
  3%|▎         | 9437/371472 [44:47<28:51:57,  3.48it/s]
  3%|▎         | 9438/371472 [44:47<29:02:28,  3.46it/s]
  3%|▎         | 9439/371472 [44:47<29:33:42,  3.40it/s]
  3%|▎         | 9440/371472 [44:48<30:54:32,  3.25it/s]
                                                        
{'loss': 4.9163, 'learning_rate': 9.776013273287509e-07, 'epoch': 0.41}

  3%|▎         | 9440/371472 [44:48<30:54:32,  3.25it/s]
  3%|▎         | 9441/371472 [44:48<30:01:58,  3.35it/s]
  3%|▎         | 9442/371472 [44:48<29:35:25,  3.40it/s]
  3%|▎         | 9443/371472 [44:49<28:15:34,  3.56it/s]
  3%|▎         | 9444/371472 [44:49<27:57:36,  3.60it/s]
  3%|▎         | 9445/371472 [44:49<28:30:32,  3.53it/s]
  3%|▎         | 9446/371472 [44:49<29:00:01,  3.47it/s]
  3%|▎         | 9447/371472 [44:50<28:45:48,  3.50it/s]
  3%|▎         | 9448/371472 [44:50<27:37:01,  3.64it/s]
  3%|▎         | 9449/371472 [44:50<28:17:28,  3.55it/s]
  3%|▎         | 9450/371472 [44:51<28:06:45,  3.58it/s]
  3%|▎         | 9451/371472 [44:51<28:11:35,  3.57it/s]
  3%|▎         | 9452/371472 [44:51<29:20:10,  3.43it/s]
  3%|▎         | 9453/371472 [44:51<29:17:59,  3.43it/s]
  3%|▎         | 9454/371472 [44:52<32:21:38,  3.11it/s]
  3%|▎         | 9455/371472 [44:52<30:39:04,  3.28it/s]
  3%|▎         | 9456/371472 [44:52<31:14:59,  3.22it/s]
  3%|▎         | 9457/371472 [44:53<30:00:23,  3.35it/s]
  3%|▎         | 9458/371472 [44:53<28:39:48,  3.51it/s]
  3%|▎         | 9459/371472 [44:53<31:20:54,  3.21it/s]
  3%|▎         | 9460/371472 [44:54<29:23:07,  3.42it/s]
                                                        
{'loss': 4.9387, 'learning_rate': 9.77552845353272e-07, 'epoch': 0.41}

  3%|▎         | 9460/371472 [44:54<29:23:07,  3.42it/s]
  3%|▎         | 9461/371472 [44:54<28:26:31,  3.54it/s]
  3%|▎         | 9462/371472 [44:54<28:28:43,  3.53it/s]
  3%|▎         | 9463/371472 [44:54<27:49:51,  3.61it/s]
  3%|▎         | 9464/371472 [44:55<28:08:27,  3.57it/s]
  3%|▎         | 9465/371472 [44:55<28:06:08,  3.58it/s]
  3%|▎         | 9466/371472 [44:55<28:39:41,  3.51it/s]
  3%|▎         | 9467/371472 [44:55<28:18:19,  3.55it/s]
  3%|▎         | 9468/371472 [44:56<30:46:31,  3.27it/s]
  3%|▎         | 9469/371472 [44:56<32:03:00,  3.14it/s]
  3%|▎         | 9470/371472 [44:56<30:43:51,  3.27it/s]
  3%|▎         | 9471/371472 [44:57<28:50:48,  3.49it/s]
  3%|▎         | 9472/371472 [44:57<27:31:44,  3.65it/s]
  3%|▎         | 9473/371472 [44:57<30:26:14,  3.30it/s]
  3%|▎         | 9474/371472 [44:58<29:21:20,  3.43it/s]
  3%|▎         | 9475/371472 [44:58<29:36:18,  3.40it/s]
  3%|▎         | 9476/371472 [44:58<29:37:45,  3.39it/s]
  3%|▎         | 9477/371472 [44:59<30:22:24,  3.31it/s]
  3%|▎         | 9478/371472 [44:59<28:53:28,  3.48it/s]
  3%|▎         | 9479/371472 [44:59<27:42:43,  3.63it/s]
  3%|▎         | 9480/371472 [44:59<27:25:33,  3.67it/s]
                                                        
{'loss': 4.879, 'learning_rate': 9.77504363377793e-07, 'epoch': 0.41}

  3%|▎         | 9480/371472 [44:59<27:25:33,  3.67it/s]
  3%|▎         | 9481/371472 [45:00<26:48:36,  3.75it/s]
  3%|▎         | 9482/371472 [45:00<27:52:24,  3.61it/s]
  3%|▎         | 9483/371472 [45:00<26:58:43,  3.73it/s]
  3%|▎         | 9484/371472 [45:00<26:30:24,  3.79it/s]
  3%|▎         | 9485/371472 [45:01<30:22:04,  3.31it/s]
  3%|▎         | 9486/371472 [45:01<29:54:16,  3.36it/s]
  3%|▎         | 9487/371472 [45:01<28:49:03,  3.49it/s]
  3%|▎         | 9488/371472 [45:02<27:43:54,  3.63it/s]
  3%|▎         | 9489/371472 [45:02<27:24:11,  3.67it/s]
  3%|▎         | 9490/371472 [45:02<27:06:03,  3.71it/s]
  3%|▎         | 9491/371472 [45:02<27:01:24,  3.72it/s]
  3%|▎         | 9492/371472 [45:03<27:41:41,  3.63it/s]
  3%|▎         | 9493/371472 [45:03<27:31:39,  3.65it/s]
  3%|▎         | 9494/371472 [45:03<30:32:29,  3.29it/s]
  3%|▎         | 9495/371472 [45:04<29:45:54,  3.38it/s]
  3%|▎         | 9496/371472 [45:04<30:05:01,  3.34it/s]
  3%|▎         | 9497/371472 [45:04<29:16:28,  3.43it/s]
  3%|▎         | 9498/371472 [45:04<28:13:27,  3.56it/s]
  3%|▎         | 9499/371472 [45:05<28:38:55,  3.51it/s]
  3%|▎         | 9500/371472 [45:05<28:54:06,  3.48it/s]
                                                        
{'loss': 4.65, 'learning_rate': 9.774558814023143e-07, 'epoch': 0.41}

  3%|▎         | 9500/371472 [45:05<28:54:06,  3.48it/s]
  3%|▎         | 9501/371472 [45:05<29:09:49,  3.45it/s]
  3%|▎         | 9502/371472 [45:06<30:40:40,  3.28it/s]
  3%|▎         | 9503/371472 [45:06<30:24:16,  3.31it/s]
  3%|▎         | 9504/371472 [45:06<29:14:16,  3.44it/s]
  3%|▎         | 9505/371472 [45:07<31:34:06,  3.19it/s]
  3%|▎         | 9506/371472 [45:07<29:52:44,  3.37it/s]
  3%|▎         | 9507/371472 [45:07<28:50:12,  3.49it/s]
  3%|▎         | 9508/371472 [45:07<28:51:19,  3.48it/s]
  3%|▎         | 9509/371472 [45:08<28:42:01,  3.50it/s]
  3%|▎         | 9510/371472 [45:08<29:21:19,  3.43it/s]
  3%|▎         | 9511/371472 [45:08<28:55:30,  3.48it/s]
  3%|▎         | 9512/371472 [45:08<28:59:23,  3.47it/s]
  3%|▎         | 9513/371472 [45:09<28:19:50,  3.55it/s]
  3%|▎         | 9514/371472 [45:09<27:29:18,  3.66it/s]
  3%|▎         | 9515/371472 [45:09<27:12:39,  3.69it/s]
  3%|▎         | 9516/371472 [45:10<27:37:43,  3.64it/s]
  3%|▎         | 9517/371472 [45:10<26:48:45,  3.75it/s]
  3%|▎         | 9518/371472 [45:10<27:58:54,  3.59it/s]
  3%|▎         | 9519/371472 [45:10<27:14:24,  3.69it/s]
  3%|▎         | 9520/371472 [45:11<27:28:27,  3.66it/s]
                                                        
{'loss': 4.5392, 'learning_rate': 9.774073994268352e-07, 'epoch': 0.41}

  3%|▎         | 9520/371472 [45:11<27:28:27,  3.66it/s]
  3%|▎         | 9521/371472 [45:11<26:56:44,  3.73it/s]
  3%|▎         | 9522/371472 [45:11<29:37:59,  3.39it/s]
  3%|▎         | 9523/371472 [45:12<29:58:44,  3.35it/s]
  3%|▎         | 9524/371472 [45:12<28:51:42,  3.48it/s]
  3%|▎         | 9525/371472 [45:12<29:34:59,  3.40it/s]
  3%|▎         | 9526/371472 [45:12<29:07:44,  3.45it/s]
  3%|▎         | 9527/371472 [45:13<29:55:58,  3.36it/s]
  3%|▎         | 9528/371472 [45:13<28:32:57,  3.52it/s]
  3%|▎         | 9529/371472 [45:13<27:55:43,  3.60it/s]
  3%|▎         | 9530/371472 [45:13<27:08:49,  3.70it/s]
  3%|▎         | 9531/371472 [45:14<26:30:51,  3.79it/s]
  3%|▎         | 9532/371472 [45:14<26:42:03,  3.77it/s]
  3%|▎         | 9533/371472 [45:14<28:05:23,  3.58it/s]
  3%|▎         | 9534/371472 [45:15<28:11:58,  3.57it/s]
  3%|▎         | 9535/371472 [45:15<28:30:51,  3.53it/s]
  3%|▎         | 9536/371472 [45:15<28:56:52,  3.47it/s]
  3%|▎         | 9537/371472 [45:15<29:03:27,  3.46it/s]
  3%|▎         | 9538/371472 [45:16<28:43:14,  3.50it/s]
  3%|▎         | 9539/371472 [45:16<29:58:22,  3.35it/s]
  3%|▎         | 9540/371472 [45:16<28:58:00,  3.47it/s]
                                                        
{'loss': 4.9185, 'learning_rate': 9.773589174513564e-07, 'epoch': 0.41}

  3%|▎         | 9540/371472 [45:16<28:58:00,  3.47it/s]
  3%|▎         | 9541/371472 [45:17<28:21:04,  3.55it/s]
  3%|▎         | 9542/371472 [45:17<27:27:23,  3.66it/s]
  3%|▎         | 9543/371472 [45:17<28:33:14,  3.52it/s]
  3%|▎         | 9544/371472 [45:17<27:44:31,  3.62it/s]
  3%|▎         | 9545/371472 [45:18<26:32:59,  3.79it/s]
  3%|▎         | 9546/371472 [45:18<26:48:13,  3.75it/s]
  3%|▎         | 9547/371472 [45:18<27:39:46,  3.63it/s]
  3%|▎         | 9548/371472 [45:19<27:36:53,  3.64it/s]
  3%|▎         | 9549/371472 [45:19<26:55:53,  3.73it/s]
  3%|▎         | 9550/371472 [45:19<28:17:31,  3.55it/s]
  3%|▎         | 9551/371472 [45:19<29:59:00,  3.35it/s]
  3%|▎         | 9552/371472 [45:20<30:00:04,  3.35it/s]
  3%|▎         | 9553/371472 [45:20<28:45:14,  3.50it/s]
  3%|▎         | 9554/371472 [45:20<27:35:41,  3.64it/s]
  3%|▎         | 9555/371472 [45:21<28:19:34,  3.55it/s]
  3%|▎         | 9556/371472 [45:21<28:59:21,  3.47it/s]
  3%|▎         | 9557/371472 [45:21<28:54:44,  3.48it/s]
  3%|▎         | 9558/371472 [45:21<28:08:59,  3.57it/s]
  3%|▎         | 9559/371472 [45:22<27:34:57,  3.64it/s]
  3%|▎         | 9560/371472 [45:22<29:45:08,  3.38it/s]
                                                        
{'loss': 4.8353, 'learning_rate': 9.773104354758773e-07, 'epoch': 0.41}

  3%|▎         | 9560/371472 [45:22<29:45:08,  3.38it/s]
  3%|▎         | 9561/371472 [45:22<32:05:04,  3.13it/s]
  3%|▎         | 9562/371472 [45:23<31:47:16,  3.16it/s]
  3%|▎         | 9563/371472 [45:23<29:58:05,  3.35it/s]
  3%|▎         | 9564/371472 [45:23<29:18:16,  3.43it/s]
  3%|▎         | 9565/371472 [45:23<28:27:51,  3.53it/s]
  3%|▎         | 9566/371472 [45:24<29:27:22,  3.41it/s]
  3%|▎         | 9567/371472 [45:24<29:22:07,  3.42it/s]
  3%|▎         | 9568/371472 [45:24<29:03:34,  3.46it/s]
  3%|▎         | 9569/371472 [45:25<28:11:43,  3.57it/s]
  3%|▎         | 9570/371472 [45:25<26:59:37,  3.72it/s]
  3%|▎         | 9571/371472 [45:25<26:39:40,  3.77it/s]
  3%|▎         | 9572/371472 [45:25<27:05:02,  3.71it/s]
  3%|▎         | 9573/371472 [45:26<26:47:03,  3.75it/s]
  3%|▎         | 9574/371472 [45:26<26:35:53,  3.78it/s]
  3%|▎         | 9575/371472 [45:26<26:40:20,  3.77it/s]
  3%|▎         | 9576/371472 [45:26<26:18:53,  3.82it/s]
  3%|▎         | 9577/371472 [45:27<27:48:12,  3.62it/s]
  3%|▎         | 9578/371472 [45:27<28:35:42,  3.52it/s]
  3%|▎         | 9579/371472 [45:27<28:52:30,  3.48it/s]
  3%|▎         | 9580/371472 [45:28<27:38:18,  3.64it/s]
                                                        
{'loss': 4.9165, 'learning_rate': 9.772619535003986e-07, 'epoch': 0.41}

  3%|▎         | 9580/371472 [45:28<27:38:18,  3.64it/s]
  3%|▎         | 9581/371472 [45:28<26:49:07,  3.75it/s]
  3%|▎         | 9582/371472 [45:28<26:50:42,  3.74it/s]
  3%|▎         | 9583/371472 [45:28<27:02:42,  3.72it/s]
  3%|▎         | 9584/371472 [45:29<27:00:39,  3.72it/s]
  3%|▎         | 9585/371472 [45:29<27:18:47,  3.68it/s]
  3%|▎         | 9586/371472 [45:29<27:31:26,  3.65it/s]
  3%|▎         | 9587/371472 [45:30<29:28:05,  3.41it/s]
  3%|▎         | 9588/371472 [45:30<30:22:28,  3.31it/s]
  3%|▎         | 9589/371472 [45:30<29:41:10,  3.39it/s]
  3%|▎         | 9590/371472 [45:30<29:22:27,  3.42it/s]
  3%|▎         | 9591/371472 [45:31<29:52:28,  3.36it/s]
  3%|▎         | 9592/371472 [45:31<30:08:14,  3.34it/s]
  3%|▎         | 9593/371472 [45:31<28:21:29,  3.54it/s]
  3%|▎         | 9594/371472 [45:32<28:56:50,  3.47it/s]
  3%|▎         | 9595/371472 [45:32<28:06:28,  3.58it/s]
  3%|▎         | 9596/371472 [45:32<27:59:29,  3.59it/s]
  3%|▎         | 9597/371472 [45:32<27:04:16,  3.71it/s]
  3%|▎         | 9598/371472 [45:33<26:41:51,  3.77it/s]
  3%|▎         | 9599/371472 [45:33<26:17:28,  3.82it/s]
  3%|▎         | 9600/371472 [45:33<27:41:57,  3.63it/s]
                                                        
{'loss': 4.9327, 'learning_rate': 9.772134715249196e-07, 'epoch': 0.41}

  3%|▎         | 9600/371472 [45:33<27:41:57,  3.63it/s]
  3%|▎         | 9601/371472 [45:33<26:40:37,  3.77it/s]
  3%|▎         | 9602/371472 [45:34<26:38:19,  3.77it/s]
  3%|▎         | 9603/371472 [45:34<26:50:38,  3.74it/s]
  3%|▎         | 9604/371472 [45:34<27:38:08,  3.64it/s]
  3%|▎         | 9605/371472 [45:35<27:36:11,  3.64it/s]
  3%|▎         | 9606/371472 [45:35<30:14:19,  3.32it/s]
  3%|▎         | 9607/371472 [45:35<29:26:02,  3.42it/s]
  3%|▎         | 9608/371472 [45:36<31:11:33,  3.22it/s]
  3%|▎         | 9609/371472 [45:36<30:39:43,  3.28it/s]
  3%|▎         | 9610/371472 [45:36<30:55:38,  3.25it/s]
  3%|▎         | 9611/371472 [45:36<29:40:53,  3.39it/s]
  3%|▎         | 9612/371472 [45:37<29:06:48,  3.45it/s]
  3%|▎         | 9613/371472 [45:37<28:04:02,  3.58it/s]
  3%|▎         | 9614/371472 [45:37<27:39:14,  3.63it/s]
  3%|▎         | 9615/371472 [45:37<26:44:45,  3.76it/s]
  3%|▎         | 9616/371472 [45:38<26:11:39,  3.84it/s]
  3%|▎         | 9617/371472 [45:38<26:37:02,  3.78it/s]
  3%|▎         | 9618/371472 [45:38<27:02:38,  3.72it/s]
  3%|▎         | 9619/371472 [45:38<26:35:57,  3.78it/s]
  3%|▎         | 9620/371472 [45:39<27:06:33,  3.71it/s]
                                                        
{'loss': 4.4741, 'learning_rate': 9.771649895494407e-07, 'epoch': 0.41}

  3%|▎         | 9620/371472 [45:39<27:06:33,  3.71it/s]
  3%|▎         | 9621/371472 [45:39<26:09:35,  3.84it/s]
  3%|▎         | 9622/371472 [45:39<26:07:01,  3.85it/s]
  3%|▎         | 9623/371472 [45:40<26:06:29,  3.85it/s]
  3%|▎         | 9624/371472 [45:40<25:58:57,  3.87it/s]
  3%|▎         | 9625/371472 [45:40<27:43:51,  3.62it/s]
  3%|▎         | 9626/371472 [45:40<28:01:01,  3.59it/s]
  3%|▎         | 9627/371472 [45:41<26:52:53,  3.74it/s]
  3%|▎         | 9628/371472 [45:41<29:00:50,  3.46it/s]
  3%|▎         | 9629/371472 [45:41<29:24:03,  3.42it/s]
  3%|▎         | 9630/371472 [45:42<30:54:03,  3.25it/s]
  3%|▎         | 9631/371472 [45:42<29:06:48,  3.45it/s]
  3%|▎         | 9632/371472 [45:42<28:42:19,  3.50it/s]
  3%|▎         | 9633/371472 [45:42<29:06:27,  3.45it/s]
  3%|▎         | 9634/371472 [45:43<28:56:18,  3.47it/s]
  3%|▎         | 9635/371472 [45:43<28:58:20,  3.47it/s]
  3%|▎         | 9636/371472 [45:43<30:25:19,  3.30it/s]
  3%|▎         | 9637/371472 [45:44<28:53:47,  3.48it/s]
  3%|▎         | 9638/371472 [45:44<28:04:45,  3.58it/s]
  3%|▎         | 9639/371472 [45:44<27:16:51,  3.68it/s]
  3%|▎         | 9640/371472 [45:44<29:53:04,  3.36it/s]
                                                        
{'loss': 5.0317, 'learning_rate': 9.77116507573962e-07, 'epoch': 0.42}

  3%|▎         | 9640/371472 [45:44<29:53:04,  3.36it/s]
  3%|▎         | 9641/371472 [45:45<29:51:02,  3.37it/s]
  3%|▎         | 9642/371472 [45:45<28:38:25,  3.51it/s]
  3%|▎         | 9643/371472 [45:45<27:31:19,  3.65it/s]
  3%|▎         | 9644/371472 [45:45<26:51:00,  3.74it/s]
  3%|▎         | 9645/371472 [45:46<28:27:26,  3.53it/s]
  3%|▎         | 9646/371472 [45:46<28:58:32,  3.47it/s]
  3%|▎         | 9647/371472 [45:46<29:33:11,  3.40it/s]
  3%|▎         | 9648/371472 [45:47<31:08:50,  3.23it/s]
  3%|▎         | 9649/371472 [45:47<30:14:05,  3.32it/s]
  3%|▎         | 9650/371472 [45:47<29:53:12,  3.36it/s]
  3%|▎         | 9651/371472 [45:48<28:03:00,  3.58it/s]
  3%|▎         | 9652/371472 [45:48<27:59:31,  3.59it/s]
  3%|▎         | 9653/371472 [45:48<29:07:22,  3.45it/s]
  3%|▎         | 9654/371472 [45:48<29:34:01,  3.40it/s]
  3%|▎         | 9655/371472 [45:49<28:32:42,  3.52it/s]
  3%|▎         | 9656/371472 [45:49<28:31:09,  3.52it/s]
  3%|▎         | 9657/371472 [45:49<27:43:21,  3.63it/s]
  3%|▎         | 9658/371472 [45:50<26:50:56,  3.74it/s]
  3%|▎         | 9659/371472 [45:50<26:15:19,  3.83it/s]
  3%|▎         | 9660/371472 [45:50<26:07:12,  3.85it/s]
                                                        
{'loss': 5.118, 'learning_rate': 9.77068025598483e-07, 'epoch': 0.42}

  3%|▎         | 9660/371472 [45:50<26:07:12,  3.85it/s]
  3%|▎         | 9661/371472 [45:50<27:16:25,  3.68it/s]
  3%|▎         | 9662/371472 [45:51<26:52:44,  3.74it/s]
  3%|▎         | 9663/371472 [45:51<27:55:50,  3.60it/s]
  3%|▎         | 9664/371472 [45:51<27:19:30,  3.68it/s]
  3%|▎         | 9665/371472 [45:51<26:31:31,  3.79it/s]
  3%|▎         | 9666/371472 [45:52<31:17:19,  3.21it/s]
  3%|▎         | 9667/371472 [45:52<29:04:15,  3.46it/s]
  3%|▎         | 9668/371472 [45:52<28:17:07,  3.55it/s]
  3%|▎         | 9669/371472 [45:53<29:14:19,  3.44it/s]
  3%|▎         | 9670/371472 [45:53<29:05:51,  3.45it/s]
  3%|▎         | 9671/371472 [45:53<30:58:45,  3.24it/s]
  3%|▎         | 9672/371472 [45:54<30:24:46,  3.30it/s]
  3%|▎         | 9673/371472 [45:54<28:43:36,  3.50it/s]
  3%|▎         | 9674/371472 [45:54<28:20:21,  3.55it/s]
  3%|▎         | 9675/371472 [45:54<28:21:46,  3.54it/s]
  3%|▎         | 9676/371472 [45:55<28:46:02,  3.49it/s]
  3%|▎         | 9677/371472 [45:55<29:24:11,  3.42it/s]
  3%|▎         | 9678/371472 [45:55<28:34:52,  3.52it/s]
  3%|▎         | 9679/371472 [45:56<28:18:59,  3.55it/s]
  3%|▎         | 9680/371472 [45:56<27:38:18,  3.64it/s]
                                                        
{'loss': 4.7494, 'learning_rate': 9.770195436230041e-07, 'epoch': 0.42}

  3%|▎         | 9680/371472 [45:56<27:38:18,  3.64it/s]
  3%|▎         | 9681/371472 [45:56<26:58:49,  3.72it/s]
  3%|▎         | 9682/371472 [45:56<26:21:46,  3.81it/s]
  3%|▎         | 9683/371472 [45:57<25:48:04,  3.90it/s]
  3%|▎         | 9684/371472 [45:57<26:50:39,  3.74it/s]
  3%|▎         | 9685/371472 [45:57<27:42:14,  3.63it/s]
  3%|▎         | 9686/371472 [45:57<27:41:57,  3.63it/s]
  3%|▎         | 9687/371472 [45:58<26:42:20,  3.76it/s]
  3%|▎         | 9688/371472 [45:58<26:26:05,  3.80it/s]
  3%|▎         | 9689/371472 [45:58<26:31:45,  3.79it/s]
  3%|▎         | 9690/371472 [45:58<26:58:19,  3.73it/s]
  3%|▎         | 9691/371472 [45:59<26:27:04,  3.80it/s]
  3%|▎         | 9692/371472 [45:59<27:12:02,  3.69it/s]
  3%|▎         | 9693/371472 [45:59<26:48:47,  3.75it/s]
  3%|▎         | 9694/371472 [45:59<26:49:37,  3.75it/s]
  3%|▎         | 9695/371472 [46:00<27:09:42,  3.70it/s]
  3%|▎         | 9696/371472 [46:00<27:35:58,  3.64it/s]
  3%|▎         | 9697/371472 [46:00<32:03:21,  3.13it/s]
  3%|▎         | 9698/371472 [46:01<30:00:49,  3.35it/s]
  3%|▎         | 9699/371472 [46:01<30:14:06,  3.32it/s]
  3%|▎         | 9700/371472 [46:01<28:57:15,  3.47it/s]
                                                        
{'loss': 4.9464, 'learning_rate': 9.769710616475252e-07, 'epoch': 0.42}

  3%|▎         | 9700/371472 [46:01<28:57:15,  3.47it/s]
  3%|▎         | 9701/371472 [46:02<27:53:17,  3.60it/s]
  3%|▎         | 9702/371472 [46:02<27:00:31,  3.72it/s]
  3%|▎         | 9703/371472 [46:02<26:32:16,  3.79it/s]
  3%|▎         | 9704/371472 [46:02<26:40:12,  3.77it/s]
  3%|▎         | 9705/371472 [46:03<28:03:20,  3.58it/s]
  3%|▎         | 9706/371472 [46:03<27:25:39,  3.66it/s]
  3%|▎         | 9707/371472 [46:03<26:52:02,  3.74it/s]
  3%|▎         | 9708/371472 [46:03<29:17:48,  3.43it/s]
  3%|▎         | 9709/371472 [46:04<28:25:24,  3.54it/s]
  3%|▎         | 9710/371472 [46:04<27:37:53,  3.64it/s]
  3%|▎         | 9711/371472 [46:04<28:59:12,  3.47it/s]
  3%|▎         | 9712/371472 [46:05<28:20:02,  3.55it/s]
  3%|▎         | 9713/371472 [46:05<28:18:26,  3.55it/s]
  3%|▎         | 9714/371472 [46:05<28:54:00,  3.48it/s]
  3%|▎         | 9715/371472 [46:05<28:53:34,  3.48it/s]
  3%|▎         | 9716/371472 [46:06<28:18:01,  3.55it/s]
  3%|▎         | 9717/371472 [46:06<28:15:08,  3.56it/s]
  3%|▎         | 9718/371472 [46:06<28:06:52,  3.57it/s]
  3%|▎         | 9719/371472 [46:07<27:05:25,  3.71it/s]
  3%|▎         | 9720/371472 [46:07<26:39:49,  3.77it/s]
                                                        
{'loss': 4.9494, 'learning_rate': 9.769225796720463e-07, 'epoch': 0.42}

  3%|▎         | 9720/371472 [46:07<26:39:49,  3.77it/s]
  3%|▎         | 9721/371472 [46:07<26:18:03,  3.82it/s]
  3%|▎         | 9722/371472 [46:07<25:49:59,  3.89it/s]
  3%|▎         | 9723/371472 [46:08<25:56:15,  3.87it/s]
  3%|▎         | 9724/371472 [46:08<29:46:45,  3.37it/s]
  3%|▎         | 9725/371472 [46:08<30:11:23,  3.33it/s]
  3%|▎         | 9726/371472 [46:09<32:53:23,  3.06it/s]
  3%|▎         | 9727/371472 [46:09<32:14:22,  3.12it/s]
  3%|▎         | 9728/371472 [46:09<30:25:24,  3.30it/s]
  3%|▎         | 9729/371472 [46:09<29:47:46,  3.37it/s]
  3%|▎         | 9730/371472 [46:10<28:57:38,  3.47it/s]
  3%|▎         | 9731/371472 [46:10<32:33:10,  3.09it/s]
  3%|▎         | 9732/371472 [46:10<31:11:00,  3.22it/s]
  3%|▎         | 9733/371472 [46:11<29:16:35,  3.43it/s]
  3%|▎         | 9734/371472 [46:11<28:05:47,  3.58it/s]
  3%|▎         | 9735/371472 [46:11<28:52:20,  3.48it/s]
  3%|▎         | 9736/371472 [46:11<28:26:04,  3.53it/s]
  3%|▎         | 9737/371472 [46:12<30:37:53,  3.28it/s]
  3%|▎         | 9738/371472 [46:12<30:47:30,  3.26it/s]
  3%|▎         | 9739/371472 [46:12<30:29:25,  3.30it/s]
  3%|▎         | 9740/371472 [46:13<29:33:02,  3.40it/s]
                                                        
{'loss': 4.841, 'learning_rate': 9.768740976965676e-07, 'epoch': 0.42}

  3%|▎         | 9740/371472 [46:13<29:33:02,  3.40it/s]
  3%|▎         | 9741/371472 [46:13<28:34:39,  3.52it/s]
  3%|▎         | 9742/371472 [46:13<28:11:53,  3.56it/s]
  3%|▎         | 9743/371472 [46:14<28:11:43,  3.56it/s]
  3%|▎         | 9744/371472 [46:14<27:10:00,  3.70it/s]
  3%|▎         | 9745/371472 [46:14<28:04:22,  3.58it/s]
  3%|▎         | 9746/371472 [46:14<26:38:02,  3.77it/s]
  3%|▎         | 9747/371472 [46:15<28:43:51,  3.50it/s]
  3%|▎         | 9748/371472 [46:15<28:24:16,  3.54it/s]
  3%|▎         | 9749/371472 [46:15<27:39:51,  3.63it/s]
  3%|▎         | 9750/371472 [46:15<28:00:42,  3.59it/s]
  3%|▎         | 9751/371472 [46:16<27:54:14,  3.60it/s]
  3%|▎         | 9752/371472 [46:16<27:53:18,  3.60it/s]
  3%|▎         | 9753/371472 [46:16<27:14:29,  3.69it/s]
  3%|▎         | 9754/371472 [46:17<26:49:33,  3.75it/s]
  3%|▎         | 9755/371472 [46:17<25:53:38,  3.88it/s]
  3%|▎         | 9756/371472 [46:17<26:55:36,  3.73it/s]
  3%|▎         | 9757/371472 [46:17<28:35:08,  3.51it/s]
  3%|▎         | 9758/371472 [46:18<27:58:02,  3.59it/s]
  3%|▎         | 9759/371472 [46:18<28:37:17,  3.51it/s]
  3%|▎         | 9760/371472 [46:18<29:03:01,  3.46it/s]
                                                        
{'loss': 4.6014, 'learning_rate': 9.768256157210884e-07, 'epoch': 0.42}

  3%|▎         | 9760/371472 [46:18<29:03:01,  3.46it/s]
  3%|▎         | 9761/371472 [46:19<32:39:16,  3.08it/s]
  3%|▎         | 9762/371472 [46:19<30:12:51,  3.33it/s]
  3%|▎         | 9763/371472 [46:19<29:19:26,  3.43it/s]
  3%|▎         | 9764/371472 [46:19<29:15:34,  3.43it/s]
  3%|▎         | 9765/371472 [46:20<30:32:54,  3.29it/s]
  3%|▎         | 9766/371472 [46:20<29:00:24,  3.46it/s]
  3%|▎         | 9767/371472 [46:20<27:29:16,  3.66it/s]
  3%|▎         | 9768/371472 [46:21<27:03:27,  3.71it/s]
  3%|▎         | 9769/371472 [46:21<30:08:12,  3.33it/s]
  3%|▎         | 9770/371472 [46:21<28:43:55,  3.50it/s]
  3%|▎         | 9771/371472 [46:21<28:01:59,  3.58it/s]
  3%|▎         | 9772/371472 [46:22<27:05:34,  3.71it/s]
  3%|▎         | 9773/371472 [46:22<27:27:46,  3.66it/s]
  3%|▎         | 9774/371472 [46:22<28:48:39,  3.49it/s]
  3%|▎         | 9775/371472 [46:23<28:03:56,  3.58it/s]
  3%|▎         | 9776/371472 [46:23<27:54:39,  3.60it/s]
  3%|▎         | 9777/371472 [46:23<28:02:50,  3.58it/s]
  3%|▎         | 9778/371472 [46:23<26:36:33,  3.78it/s]
  3%|▎         | 9779/371472 [46:24<26:53:26,  3.74it/s]
  3%|▎         | 9780/371472 [46:24<29:25:40,  3.41it/s]
                                                        
{'loss': 4.9624, 'learning_rate': 9.767771337456097e-07, 'epoch': 0.42}

  3%|▎         | 9780/371472 [46:24<29:25:40,  3.41it/s]
  3%|▎         | 9781/371472 [46:24<28:14:56,  3.56it/s]
  3%|▎         | 9782/371472 [46:25<30:28:47,  3.30it/s]
  3%|▎         | 9783/371472 [46:25<32:04:13,  3.13it/s]
  3%|▎         | 9784/371472 [46:25<32:10:15,  3.12it/s]
  3%|▎         | 9785/371472 [46:26<29:48:10,  3.37it/s]
  3%|▎         | 9786/371472 [46:26<28:25:22,  3.53it/s]
  3%|▎         | 9787/371472 [46:26<28:42:39,  3.50it/s]
  3%|▎         | 9788/371472 [46:26<28:26:21,  3.53it/s]
  3%|▎         | 9789/371472 [46:27<27:20:41,  3.67it/s]
  3%|▎         | 9790/371472 [46:27<27:28:04,  3.66it/s]
  3%|▎         | 9791/371472 [46:27<28:06:59,  3.57it/s]
  3%|▎         | 9792/371472 [46:27<29:21:02,  3.42it/s]
  3%|▎         | 9793/371472 [46:28<31:06:36,  3.23it/s]
  3%|▎         | 9794/371472 [46:28<29:26:20,  3.41it/s]
  3%|▎         | 9795/371472 [46:28<28:19:32,  3.55it/s]
  3%|▎         | 9796/371472 [46:29<27:36:38,  3.64it/s]
  3%|▎         | 9797/371472 [46:29<27:59:26,  3.59it/s]
  3%|▎         | 9798/371472 [46:29<28:05:26,  3.58it/s]
  3%|▎         | 9799/371472 [46:29<28:08:14,  3.57it/s]
  3%|▎         | 9800/371472 [46:30<29:33:54,  3.40it/s]
                                                        
{'loss': 4.9065, 'learning_rate': 9.767286517701308e-07, 'epoch': 0.42}

  3%|▎         | 9800/371472 [46:30<29:33:54,  3.40it/s]
  3%|▎         | 9801/371472 [46:30<29:13:39,  3.44it/s]
  3%|▎         | 9802/371472 [46:30<27:51:54,  3.61it/s]
  3%|▎         | 9803/371472 [46:31<27:34:57,  3.64it/s]
  3%|▎         | 9804/371472 [46:31<28:49:45,  3.48it/s]
  3%|▎         | 9805/371472 [46:31<28:23:22,  3.54it/s]
  3%|▎         | 9806/371472 [46:31<28:31:14,  3.52it/s]
  3%|▎         | 9807/371472 [46:32<28:36:50,  3.51it/s]
  3%|▎         | 9808/371472 [46:32<28:29:41,  3.53it/s]
  3%|▎         | 9809/371472 [46:32<27:51:31,  3.61it/s]
  3%|▎         | 9810/371472 [46:33<27:31:55,  3.65it/s]
  3%|▎         | 9811/371472 [46:33<28:37:23,  3.51it/s]
  3%|▎         | 9812/371472 [46:33<29:27:01,  3.41it/s]
  3%|▎         | 9813/371472 [46:33<28:45:35,  3.49it/s]
  3%|▎         | 9814/371472 [46:34<28:38:41,  3.51it/s]
  3%|▎         | 9815/371472 [46:34<28:13:05,  3.56it/s]
  3%|▎         | 9816/371472 [46:34<27:28:36,  3.66it/s]
  3%|▎         | 9817/371472 [46:35<28:41:15,  3.50it/s]
  3%|▎         | 9818/371472 [46:35<27:30:47,  3.65it/s]
  3%|▎         | 9819/371472 [46:35<27:27:58,  3.66it/s]
  3%|▎         | 9820/371472 [46:35<27:39:37,  3.63it/s]
                                                        
{'loss': 5.0393, 'learning_rate': 9.766801697946519e-07, 'epoch': 0.42}

  3%|▎         | 9820/371472 [46:35<27:39:37,  3.63it/s]
  3%|▎         | 9821/371472 [46:36<28:30:57,  3.52it/s]
  3%|▎         | 9822/371472 [46:36<27:42:06,  3.63it/s]
  3%|▎         | 9823/371472 [46:36<27:23:18,  3.67it/s]
  3%|▎         | 9824/371472 [46:36<28:28:54,  3.53it/s]
  3%|▎         | 9825/371472 [46:37<27:48:47,  3.61it/s]
  3%|▎         | 9826/371472 [46:37<31:08:06,  3.23it/s]
  3%|▎         | 9827/371472 [46:37<30:38:53,  3.28it/s]
  3%|▎         | 9828/371472 [46:38<30:19:59,  3.31it/s]
  3%|▎         | 9829/371472 [46:38<30:08:48,  3.33it/s]
  3%|▎         | 9830/371472 [46:38<29:31:35,  3.40it/s]
  3%|▎         | 9831/371472 [46:39<28:42:20,  3.50it/s]
  3%|▎         | 9832/371472 [46:39<28:42:41,  3.50it/s]
  3%|▎         | 9833/371472 [46:39<28:44:21,  3.50it/s]
  3%|▎         | 9834/371472 [46:39<27:45:33,  3.62it/s]
  3%|▎         | 9835/371472 [46:40<27:41:32,  3.63it/s]
  3%|▎         | 9836/371472 [46:40<28:30:56,  3.52it/s]
  3%|▎         | 9837/371472 [46:40<27:52:12,  3.60it/s]
  3%|▎         | 9838/371472 [46:40<26:55:14,  3.73it/s]
  3%|▎         | 9839/371472 [46:41<26:27:30,  3.80it/s]
  3%|▎         | 9840/371472 [46:41<26:28:22,  3.79it/s]
                                                        
{'loss': 4.761, 'learning_rate': 9.76631687819173e-07, 'epoch': 0.42}

  3%|▎         | 9840/371472 [46:41<26:28:22,  3.79it/s]
  3%|▎         | 9841/371472 [46:41<27:07:10,  3.70it/s]
  3%|▎         | 9842/371472 [46:42<26:29:05,  3.79it/s]
  3%|▎         | 9843/371472 [46:42<29:49:56,  3.37it/s]
  3%|▎         | 9844/371472 [46:42<29:14:47,  3.43it/s]
  3%|▎         | 9845/371472 [46:42<27:42:50,  3.62it/s]
  3%|▎         | 9846/371472 [46:43<29:35:22,  3.39it/s]
  3%|▎         | 9847/371472 [46:43<28:54:48,  3.47it/s]
  3%|▎         | 9848/371472 [46:43<28:46:27,  3.49it/s]
  3%|▎         | 9849/371472 [46:44<28:55:57,  3.47it/s]
  3%|▎         | 9850/371472 [46:44<28:06:56,  3.57it/s]
  3%|▎         | 9851/371472 [46:44<27:56:27,  3.60it/s]
  3%|▎         | 9852/371472 [46:44<28:31:19,  3.52it/s]
  3%|▎         | 9853/371472 [46:45<27:44:24,  3.62it/s]
  3%|▎         | 9854/371472 [46:45<27:27:14,  3.66it/s]
  3%|▎         | 9855/371472 [46:45<27:34:52,  3.64it/s]
  3%|▎         | 9856/371472 [46:45<27:21:29,  3.67it/s]
  3%|▎         | 9857/371472 [46:46<27:29:29,  3.65it/s]
  3%|▎         | 9858/371472 [46:46<26:37:11,  3.77it/s]
  3%|▎         | 9859/371472 [46:46<26:46:56,  3.75it/s]
  3%|▎         | 9860/371472 [46:47<26:38:05,  3.77it/s]
                                                        
{'loss': 4.7322, 'learning_rate': 9.76583205843694e-07, 'epoch': 0.42}

  3%|▎         | 9860/371472 [46:47<26:38:05,  3.77it/s]
  3%|▎         | 9861/371472 [46:47<26:43:12,  3.76it/s]
  3%|▎         | 9862/371472 [46:47<27:31:56,  3.65it/s]
  3%|▎         | 9863/371472 [46:47<27:11:01,  3.70it/s]
  3%|▎         | 9864/371472 [46:48<26:52:45,  3.74it/s]
  3%|▎         | 9865/371472 [46:48<26:38:35,  3.77it/s]
  3%|▎         | 9866/371472 [46:48<27:25:35,  3.66it/s]
  3%|▎         | 9867/371472 [46:48<26:44:31,  3.76it/s]
  3%|▎         | 9868/371472 [46:49<26:31:56,  3.79it/s]
  3%|▎         | 9869/371472 [46:49<27:51:19,  3.61it/s]
  3%|▎         | 9870/371472 [46:49<27:49:01,  3.61it/s]
  3%|▎         | 9871/371472 [46:50<27:34:20,  3.64it/s]
  3%|▎         | 9872/371472 [46:50<27:23:18,  3.67it/s]
  3%|▎         | 9873/371472 [46:50<26:50:06,  3.74it/s]
  3%|▎         | 9874/371472 [46:50<26:15:28,  3.83it/s]
  3%|▎         | 9875/371472 [46:51<27:03:08,  3.71it/s]
  3%|▎         | 9876/371472 [46:51<27:38:41,  3.63it/s]
  3%|▎         | 9877/371472 [46:51<28:38:37,  3.51it/s]
  3%|▎         | 9878/371472 [46:51<28:13:31,  3.56it/s]
  3%|▎         | 9879/371472 [46:52<28:43:26,  3.50it/s]
  3%|▎         | 9880/371472 [46:52<28:29:20,  3.53it/s]
                                                        
{'loss': 4.7106, 'learning_rate': 9.765347238682153e-07, 'epoch': 0.43}

  3%|▎         | 9880/371472 [46:52<28:29:20,  3.53it/s]
  3%|▎         | 9881/371472 [46:52<27:59:55,  3.59it/s]
  3%|▎         | 9882/371472 [46:53<29:58:39,  3.35it/s]
  3%|▎         | 9883/371472 [46:53<29:31:59,  3.40it/s]
  3%|▎         | 9884/371472 [46:53<29:38:54,  3.39it/s]
  3%|▎         | 9885/371472 [46:54<31:26:43,  3.19it/s]
  3%|▎         | 9886/371472 [46:54<29:24:28,  3.42it/s]
  3%|▎         | 9887/371472 [46:54<29:15:12,  3.43it/s]
  3%|▎         | 9888/371472 [46:54<28:33:12,  3.52it/s]
  3%|▎         | 9889/371472 [46:55<27:40:46,  3.63it/s]
  3%|▎         | 9890/371472 [46:55<28:28:17,  3.53it/s]
  3%|▎         | 9891/371472 [46:55<27:57:24,  3.59it/s]
  3%|▎         | 9892/371472 [46:56<28:17:02,  3.55it/s]
  3%|▎         | 9893/371472 [46:56<27:26:20,  3.66it/s]
  3%|▎         | 9894/371472 [46:56<28:44:50,  3.49it/s]
  3%|▎         | 9895/371472 [46:56<27:42:52,  3.62it/s]
  3%|▎         | 9896/371472 [46:57<28:49:37,  3.48it/s]
  3%|▎         | 9897/371472 [46:57<28:29:06,  3.53it/s]
  3%|▎         | 9898/371472 [46:57<27:33:18,  3.64it/s]
  3%|▎         | 9899/371472 [46:57<27:00:24,  3.72it/s]
  3%|▎         | 9900/371472 [46:58<27:12:10,  3.69it/s]
                                                        
{'loss': 4.8356, 'learning_rate': 9.764862418927361e-07, 'epoch': 0.43}

  3%|▎         | 9900/371472 [46:58<27:12:10,  3.69it/s]
  3%|▎         | 9901/371472 [46:58<29:02:01,  3.46it/s]
  3%|▎         | 9902/371472 [46:58<28:29:17,  3.53it/s]
  3%|▎         | 9903/371472 [46:59<27:42:51,  3.62it/s]
  3%|▎         | 9904/371472 [46:59<27:59:25,  3.59it/s]
  3%|▎         | 9905/371472 [46:59<29:29:18,  3.41it/s]
  3%|▎         | 9906/371472 [46:59<28:37:02,  3.51it/s]
  3%|▎         | 9907/371472 [47:00<29:13:33,  3.44it/s]
  3%|▎         | 9908/371472 [47:00<31:15:16,  3.21it/s]
  3%|▎         | 9909/371472 [47:00<31:24:13,  3.20it/s]
  3%|▎         | 9910/371472 [47:01<31:17:53,  3.21it/s]
  3%|▎         | 9911/371472 [47:01<30:57:46,  3.24it/s]
  3%|▎         | 9912/371472 [47:01<31:27:51,  3.19it/s]
  3%|▎         | 9913/371472 [47:02<29:40:34,  3.38it/s]
  3%|▎         | 9914/371472 [47:02<28:06:59,  3.57it/s]
  3%|▎         | 9915/371472 [47:02<30:48:37,  3.26it/s]
  3%|▎         | 9916/371472 [47:03<34:17:57,  2.93it/s]
  3%|▎         | 9917/371472 [47:03<32:46:35,  3.06it/s]
  3%|▎         | 9918/371472 [47:03<30:44:51,  3.27it/s]
  3%|▎         | 9919/371472 [47:04<30:51:18,  3.25it/s]
  3%|▎         | 9920/371472 [47:04<29:11:09,  3.44it/s]
                                                        
{'loss': 4.6066, 'learning_rate': 9.764377599172574e-07, 'epoch': 0.43}

  3%|▎         | 9920/371472 [47:04<29:11:09,  3.44it/s]
  3%|▎         | 9921/371472 [47:04<28:24:57,  3.53it/s]
  3%|▎         | 9922/371472 [47:04<28:07:45,  3.57it/s]
  3%|▎         | 9923/371472 [47:05<27:45:43,  3.62it/s]
  3%|▎         | 9924/371472 [47:05<27:42:52,  3.62it/s]
  3%|▎         | 9925/371472 [47:05<27:08:44,  3.70it/s]
  3%|▎         | 9926/371472 [47:05<28:24:37,  3.53it/s]
  3%|▎         | 9927/371472 [47:06<27:40:48,  3.63it/s]
  3%|▎         | 9928/371472 [47:06<27:59:20,  3.59it/s]
  3%|▎         | 9929/371472 [47:06<28:18:18,  3.55it/s]
  3%|▎         | 9930/371472 [47:07<28:14:29,  3.56it/s]
  3%|▎         | 9931/371472 [47:07<31:55:12,  3.15it/s]
  3%|▎         | 9932/371472 [47:07<33:06:47,  3.03it/s]
  3%|▎         | 9933/371472 [47:08<31:29:43,  3.19it/s]
  3%|▎         | 9934/371472 [47:08<29:19:57,  3.42it/s]
  3%|▎         | 9935/371472 [47:08<29:17:53,  3.43it/s]
  3%|▎         | 9936/371472 [47:08<29:28:16,  3.41it/s]
  3%|▎         | 9937/371472 [47:09<29:33:06,  3.40it/s]
  3%|▎         | 9938/371472 [47:09<29:42:42,  3.38it/s]
  3%|▎         | 9939/371472 [47:09<29:54:38,  3.36it/s]
  3%|▎         | 9940/371472 [47:10<30:47:57,  3.26it/s]
                                                        
{'loss': 4.7757, 'learning_rate': 9.763892779417783e-07, 'epoch': 0.43}

  3%|▎         | 9940/371472 [47:10<30:47:57,  3.26it/s]
  3%|▎         | 9941/371472 [47:10<29:56:28,  3.35it/s]
  3%|▎         | 9942/371472 [47:10<28:42:34,  3.50it/s]
  3%|▎         | 9943/371472 [47:10<29:49:03,  3.37it/s]
  3%|▎         | 9944/371472 [47:11<29:52:06,  3.36it/s]
  3%|▎         | 9945/371472 [47:11<28:29:58,  3.52it/s]
  3%|▎         | 9946/371472 [47:11<29:26:38,  3.41it/s]
  3%|▎         | 9947/371472 [47:12<28:15:45,  3.55it/s]
  3%|▎         | 9948/371472 [47:12<28:43:57,  3.50it/s]
  3%|▎         | 9949/371472 [47:12<28:57:22,  3.47it/s]
  3%|▎         | 9950/371472 [47:13<30:33:57,  3.29it/s]
  3%|▎         | 9951/371472 [47:13<28:51:11,  3.48it/s]
  3%|▎         | 9952/371472 [47:13<27:42:03,  3.63it/s]
  3%|▎         | 9953/371472 [47:13<28:22:15,  3.54it/s]
  3%|▎         | 9954/371472 [47:14<28:26:44,  3.53it/s]
  3%|▎         | 9955/371472 [47:14<27:33:29,  3.64it/s]
  3%|▎         | 9956/371472 [47:14<28:56:35,  3.47it/s]
  3%|▎         | 9957/371472 [47:14<28:46:15,  3.49it/s]
  3%|▎         | 9958/371472 [47:15<27:14:54,  3.69it/s]
  3%|▎         | 9959/371472 [47:15<26:24:03,  3.80it/s]
  3%|▎         | 9960/371472 [47:15<26:18:30,  3.82it/s]
                                                        
{'loss': 4.8173, 'learning_rate': 9.763407959662996e-07, 'epoch': 0.43}

  3%|▎         | 9960/371472 [47:15<26:18:30,  3.82it/s]
  3%|▎         | 9961/371472 [47:15<26:29:24,  3.79it/s]
  3%|▎         | 9962/371472 [47:16<26:46:28,  3.75it/s]
  3%|▎         | 9963/371472 [47:16<25:57:36,  3.87it/s]
  3%|▎         | 9964/371472 [47:16<27:43:13,  3.62it/s]
  3%|▎         | 9965/371472 [47:17<27:12:02,  3.69it/s]
  3%|▎         | 9966/371472 [47:17<26:37:09,  3.77it/s]
  3%|▎         | 9967/371472 [47:17<26:40:50,  3.76it/s]
  3%|▎         | 9968/371472 [47:17<29:20:32,  3.42it/s]
  3%|▎         | 9969/371472 [47:18<29:09:00,  3.44it/s]
  3%|▎         | 9970/371472 [47:18<27:43:40,  3.62it/s]
  3%|▎         | 9971/371472 [47:18<27:22:48,  3.67it/s]
  3%|▎         | 9972/371472 [47:19<27:34:12,  3.64it/s]
  3%|▎         | 9973/371472 [47:19<27:09:17,  3.70it/s]
  3%|▎         | 9974/371472 [47:19<28:11:06,  3.56it/s]
  3%|▎         | 9975/371472 [47:19<29:08:13,  3.45it/s]
  3%|▎         | 9976/371472 [47:20<27:50:30,  3.61it/s]
  3%|▎         | 9977/371472 [47:20<28:43:20,  3.50it/s]
  3%|▎         | 9978/371472 [47:20<28:07:53,  3.57it/s]
  3%|▎         | 9979/371472 [47:21<28:58:26,  3.47it/s]
  3%|▎         | 9980/371472 [47:21<29:04:44,  3.45it/s]
                                                        
{'loss': 4.6468, 'learning_rate': 9.762923139908206e-07, 'epoch': 0.43}

  3%|▎         | 9980/371472 [47:21<29:04:44,  3.45it/s]
  3%|▎         | 9981/371472 [47:21<30:25:34,  3.30it/s]
  3%|▎         | 9982/371472 [47:21<29:44:26,  3.38it/s]
  3%|▎         | 9983/371472 [47:22<30:26:03,  3.30it/s]
  3%|▎         | 9984/371472 [47:22<28:58:38,  3.47it/s]
  3%|▎         | 9985/371472 [47:22<32:32:16,  3.09it/s]
  3%|▎         | 9986/371472 [47:23<30:59:30,  3.24it/s]
  3%|▎         | 9987/371472 [47:23<29:27:35,  3.41it/s]
  3%|▎         | 9988/371472 [47:23<29:29:33,  3.40it/s]
  3%|▎         | 9989/371472 [47:24<31:39:20,  3.17it/s]
  3%|▎         | 9990/371472 [47:24<30:49:37,  3.26it/s]
  3%|▎         | 9991/371472 [47:24<29:35:48,  3.39it/s]
  3%|▎         | 9992/371472 [47:25<31:33:06,  3.18it/s]
  3%|▎         | 9993/371472 [47:25<30:53:30,  3.25it/s]
  3%|▎         | 9994/371472 [47:25<30:50:20,  3.26it/s]
  3%|▎         | 9995/371472 [47:25<29:15:44,  3.43it/s]
  3%|▎         | 9996/371472 [47:26<30:28:58,  3.29it/s]
  3%|▎         | 9997/371472 [47:26<28:47:44,  3.49it/s]
  3%|▎         | 9998/371472 [47:26<29:21:40,  3.42it/s]
  3%|▎         | 9999/371472 [47:27<29:45:28,  3.37it/s]
  3%|▎         | 10000/371472 [47:27<29:08:02,  3.45it/s]
                                                         
{'loss': 4.8561, 'learning_rate': 9.762438320153417e-07, 'epoch': 0.43}

  3%|▎         | 10000/371472 [47:27<29:08:02,  3.45it/s]
  3%|▎         | 10001/371472 [47:27<28:22:26,  3.54it/s]
  3%|▎         | 10002/371472 [47:27<29:57:51,  3.35it/s]
  3%|▎         | 10003/371472 [47:28<29:20:14,  3.42it/s]
  3%|▎         | 10004/371472 [47:28<29:29:41,  3.40it/s]
  3%|▎         | 10005/371472 [47:28<29:50:09,  3.37it/s]
  3%|▎         | 10006/371472 [47:29<28:58:17,  3.47it/s]
  3%|▎         | 10007/371472 [47:29<27:44:38,  3.62it/s]
  3%|▎         | 10008/371472 [47:29<28:52:39,  3.48it/s]
  3%|▎         | 10009/371472 [47:29<27:46:48,  3.61it/s]
  3%|▎         | 10010/371472 [47:30<28:49:23,  3.48it/s]
  3%|▎         | 10011/371472 [47:30<28:11:12,  3.56it/s]
  3%|▎         | 10012/371472 [47:30<28:09:00,  3.57it/s]
  3%|▎         | 10013/371472 [47:30<27:11:24,  3.69it/s]
  3%|▎         | 10014/371472 [47:31<26:43:52,  3.76it/s]
  3%|▎         | 10015/371472 [47:31<27:32:38,  3.65it/s]
  3%|▎         | 10016/371472 [47:31<29:45:23,  3.37it/s]
  3%|▎         | 10017/371472 [47:32<28:27:06,  3.53it/s]
  3%|▎         | 10018/371472 [47:32<27:20:33,  3.67it/s]
  3%|▎         | 10019/371472 [47:32<27:41:08,  3.63it/s]
  3%|▎         | 10020/371472 [47:32<26:46:55,  3.75it/s]
                                                         
{'loss': 4.769, 'learning_rate': 9.76195350039863e-07, 'epoch': 0.43}

  3%|▎         | 10020/371472 [47:32<26:46:55,  3.75it/s]
  3%|▎         | 10021/371472 [47:33<30:35:55,  3.28it/s]
  3%|▎         | 10022/371472 [47:33<28:54:56,  3.47it/s]
  3%|▎         | 10023/371472 [47:33<28:42:50,  3.50it/s]
  3%|▎         | 10024/371472 [47:34<28:18:57,  3.55it/s]
  3%|▎         | 10025/371472 [47:34<31:34:04,  3.18it/s]
  3%|▎         | 10026/371472 [47:34<30:42:21,  3.27it/s]
  3%|▎         | 10027/371472 [47:35<28:59:59,  3.46it/s]
  3%|▎         | 10028/371472 [47:35<30:01:59,  3.34it/s]
  3%|▎         | 10029/371472 [47:35<29:53:32,  3.36it/s]
  3%|▎         | 10030/371472 [47:35<29:33:08,  3.40it/s]
  3%|▎         | 10031/371472 [47:36<28:37:36,  3.51it/s]
  3%|▎         | 10032/371472 [47:36<27:48:47,  3.61it/s]
  3%|▎         | 10033/371472 [47:36<28:44:20,  3.49it/s]
  3%|▎         | 10034/371472 [47:37<28:11:36,  3.56it/s]
  3%|▎         | 10035/371472 [47:37<29:57:36,  3.35it/s]
  3%|▎         | 10036/371472 [47:37<31:48:36,  3.16it/s]
  3%|▎         | 10037/371472 [47:38<30:27:05,  3.30it/s]
  3%|▎         | 10038/371472 [47:38<29:41:55,  3.38it/s]
  3%|▎         | 10039/371472 [47:38<30:33:48,  3.28it/s]
  3%|▎         | 10040/371472 [47:38<31:02:33,  3.23it/s]
                                                         
{'loss': 4.8013, 'learning_rate': 9.76146868064384e-07, 'epoch': 0.43}

  3%|▎         | 10040/371472 [47:38<31:02:33,  3.23it/s]
  3%|▎         | 10041/371472 [47:39<30:26:52,  3.30it/s]
  3%|▎         | 10042/371472 [47:39<30:13:26,  3.32it/s]
  3%|▎         | 10043/371472 [47:39<29:00:48,  3.46it/s]
  3%|▎         | 10044/371472 [47:40<28:41:53,  3.50it/s]
  3%|▎         | 10045/371472 [47:40<28:36:30,  3.51it/s]
  3%|▎         | 10046/371472 [47:40<30:30:41,  3.29it/s]
  3%|▎         | 10047/371472 [47:40<28:52:06,  3.48it/s]
  3%|▎         | 10048/371472 [47:41<27:58:28,  3.59it/s]
  3%|▎         | 10049/371472 [47:41<28:14:19,  3.56it/s]
  3%|▎         | 10050/371472 [47:41<27:58:56,  3.59it/s]
  3%|▎         | 10051/371472 [47:42<28:01:48,  3.58it/s]
  3%|▎         | 10052/371472 [47:42<29:24:14,  3.41it/s]
  3%|▎         | 10053/371472 [47:42<28:10:33,  3.56it/s]
  3%|▎         | 10054/371472 [47:42<27:26:03,  3.66it/s]
  3%|▎         | 10055/371472 [47:43<27:00:51,  3.72it/s]
  3%|▎         | 10056/371472 [47:43<27:19:52,  3.67it/s]
  3%|▎         | 10057/371472 [47:43<27:01:54,  3.71it/s]
  3%|▎         | 10058/371472 [47:43<28:27:35,  3.53it/s]
  3%|▎         | 10059/371472 [47:44<30:42:39,  3.27it/s]
  3%|▎         | 10060/371472 [47:44<29:12:43,  3.44it/s]
                                                         
{'loss': 4.8112, 'learning_rate': 9.760983860889051e-07, 'epoch': 0.43}

  3%|▎         | 10060/371472 [47:44<29:12:43,  3.44it/s]
  3%|▎         | 10061/371472 [47:44<28:24:45,  3.53it/s]
  3%|▎         | 10062/371472 [47:45<27:48:48,  3.61it/s]
  3%|▎         | 10063/371472 [47:45<27:15:02,  3.68it/s]
  3%|▎         | 10064/371472 [47:45<27:04:18,  3.71it/s]
  3%|▎         | 10065/371472 [47:45<27:11:06,  3.69it/s]
  3%|▎         | 10066/371472 [47:46<26:32:55,  3.78it/s]
  3%|▎         | 10067/371472 [47:46<26:47:13,  3.75it/s]
  3%|▎         | 10068/371472 [47:46<27:54:23,  3.60it/s]
  3%|▎         | 10069/371472 [47:47<29:29:53,  3.40it/s]
  3%|▎         | 10070/371472 [47:47<32:08:20,  3.12it/s]
  3%|▎         | 10071/371472 [47:47<30:42:34,  3.27it/s]
  3%|▎         | 10072/371472 [47:47<28:51:19,  3.48it/s]
  3%|▎         | 10073/371472 [47:48<32:04:48,  3.13it/s]
  3%|▎         | 10074/371472 [47:48<36:56:54,  2.72it/s]
  3%|▎         | 10075/371472 [47:49<34:36:17,  2.90it/s]
  3%|▎         | 10076/371472 [47:49<34:03:11,  2.95it/s]
  3%|▎         | 10077/371472 [47:49<34:52:29,  2.88it/s]
  3%|▎         | 10078/371472 [47:50<32:35:40,  3.08it/s]
  3%|▎         | 10079/371472 [47:50<31:58:14,  3.14it/s]
  3%|▎         | 10080/371472 [47:50<31:48:05,  3.16it/s]
                                                         
{'loss': 4.6127, 'learning_rate': 9.760499041134262e-07, 'epoch': 0.43}

  3%|▎         | 10080/371472 [47:50<31:48:05,  3.16it/s]
  3%|▎         | 10081/371472 [47:50<30:11:12,  3.33it/s]
  3%|▎         | 10082/371472 [47:51<30:18:18,  3.31it/s]
  3%|▎         | 10083/371472 [47:51<30:47:04,  3.26it/s]
  3%|▎         | 10084/371472 [47:51<30:09:38,  3.33it/s]
  3%|▎         | 10085/371472 [47:52<29:34:05,  3.40it/s]
  3%|▎         | 10086/371472 [47:52<28:57:51,  3.47it/s]
  3%|▎         | 10087/371472 [47:52<27:54:54,  3.60it/s]
  3%|▎         | 10088/371472 [47:52<26:43:12,  3.76it/s]
  3%|▎         | 10089/371472 [47:53<26:14:05,  3.83it/s]
  3%|▎         | 10090/371472 [47:53<26:26:02,  3.80it/s]
  3%|▎         | 10091/371472 [47:53<27:17:09,  3.68it/s]
  3%|▎         | 10092/371472 [47:54<27:06:06,  3.70it/s]
  3%|▎         | 10093/371472 [47:54<26:43:24,  3.76it/s]
  3%|▎         | 10094/371472 [47:54<28:10:50,  3.56it/s]
  3%|▎         | 10095/371472 [47:54<28:42:39,  3.50it/s]
  3%|▎         | 10096/371472 [47:55<28:17:20,  3.55it/s]
  3%|▎         | 10097/371472 [47:55<28:46:27,  3.49it/s]
  3%|▎         | 10098/371472 [47:55<28:00:12,  3.58it/s]
  3%|▎         | 10099/371472 [47:56<28:04:59,  3.57it/s]
  3%|▎         | 10100/371472 [47:56<31:45:42,  3.16it/s]
                                                         
{'loss': 4.808, 'learning_rate': 9.760014221379473e-07, 'epoch': 0.44}

  3%|▎         | 10100/371472 [47:56<31:45:42,  3.16it/s]
  3%|▎         | 10101/371472 [47:56<30:41:10,  3.27it/s]
  3%|▎         | 10102/371472 [47:56<29:15:39,  3.43it/s]
  3%|▎         | 10103/371472 [47:57<34:30:40,  2.91it/s]
  3%|▎         | 10104/371472 [47:57<32:52:00,  3.05it/s]
  3%|▎         | 10105/371472 [47:58<32:07:12,  3.13it/s]
  3%|▎         | 10106/371472 [47:58<30:07:04,  3.33it/s]
  3%|▎         | 10107/371472 [47:58<30:08:46,  3.33it/s]
  3%|▎         | 10108/371472 [47:58<30:02:17,  3.34it/s]
  3%|▎         | 10109/371472 [47:59<29:00:12,  3.46it/s]
  3%|▎         | 10110/371472 [47:59<28:12:11,  3.56it/s]
  3%|▎         | 10111/371472 [47:59<30:06:03,  3.33it/s]
  3%|▎         | 10112/371472 [48:00<31:37:57,  3.17it/s]
  3%|▎         | 10113/371472 [48:00<30:40:16,  3.27it/s]
  3%|▎         | 10114/371472 [48:00<29:28:26,  3.41it/s]
  3%|▎         | 10115/371472 [48:00<30:22:05,  3.31it/s]
  3%|▎         | 10116/371472 [48:01<28:44:54,  3.49it/s]
  3%|▎         | 10117/371472 [48:01<28:39:59,  3.50it/s]
  3%|▎         | 10118/371472 [48:01<29:02:51,  3.46it/s]
  3%|▎         | 10119/371472 [48:02<28:23:48,  3.53it/s]
  3%|▎         | 10120/371472 [48:02<27:36:26,  3.64it/s]
                                                         
{'loss': 4.7345, 'learning_rate': 9.759529401624686e-07, 'epoch': 0.44}

  3%|▎         | 10120/371472 [48:02<27:36:26,  3.64it/s]
  3%|▎         | 10121/371472 [48:02<26:54:49,  3.73it/s]
  3%|▎         | 10122/371472 [48:02<26:48:45,  3.74it/s]
  3%|▎         | 10123/371472 [48:03<27:48:13,  3.61it/s]
  3%|▎         | 10124/371472 [48:03<28:22:27,  3.54it/s]
  3%|▎         | 10125/371472 [48:03<28:47:06,  3.49it/s]
  3%|▎         | 10126/371472 [48:04<29:33:14,  3.40it/s]
  3%|▎         | 10127/371472 [48:04<28:42:39,  3.50it/s]
  3%|▎         | 10128/371472 [48:04<31:49:00,  3.15it/s]
  3%|▎         | 10129/371472 [48:04<30:18:15,  3.31it/s]
  3%|▎         | 10130/371472 [48:05<30:38:51,  3.28it/s]
  3%|▎         | 10131/371472 [48:05<29:40:46,  3.38it/s]
  3%|▎         | 10132/371472 [48:05<29:19:33,  3.42it/s]
  3%|▎         | 10133/371472 [48:06<30:26:06,  3.30it/s]
  3%|▎         | 10134/371472 [48:06<31:19:56,  3.20it/s]
  3%|▎         | 10135/371472 [48:06<30:13:59,  3.32it/s]
  3%|▎         | 10136/371472 [48:07<28:43:46,  3.49it/s]
  3%|▎         | 10137/371472 [48:07<33:43:28,  2.98it/s]
  3%|▎         | 10138/371472 [48:07<34:49:42,  2.88it/s]
  3%|▎         | 10139/371472 [48:08<33:38:43,  2.98it/s]
  3%|▎         | 10140/371472 [48:08<32:32:50,  3.08it/s]
                                                         
{'loss': 4.6163, 'learning_rate': 9.759044581869894e-07, 'epoch': 0.44}

  3%|▎         | 10140/371472 [48:08<32:32:50,  3.08it/s]
  3%|▎         | 10141/371472 [48:08<30:55:55,  3.24it/s]
  3%|▎         | 10142/371472 [48:08<29:29:23,  3.40it/s]
  3%|▎         | 10143/371472 [48:09<28:48:10,  3.48it/s]
  3%|▎         | 10144/371472 [48:09<30:41:49,  3.27it/s]
  3%|▎         | 10145/371472 [48:09<29:54:01,  3.36it/s]
  3%|▎         | 10146/371472 [48:10<28:17:40,  3.55it/s]
  3%|▎         | 10147/371472 [48:10<28:13:22,  3.56it/s]
  3%|▎         | 10148/371472 [48:10<27:32:37,  3.64it/s]
  3%|▎         | 10149/371472 [48:10<26:46:24,  3.75it/s]
  3%|▎         | 10150/371472 [48:11<26:56:07,  3.73it/s]
  3%|▎         | 10151/371472 [48:11<28:08:46,  3.57it/s]
  3%|▎         | 10152/371472 [48:11<28:23:53,  3.53it/s]
  3%|▎         | 10153/371472 [48:12<29:00:49,  3.46it/s]
  3%|▎         | 10154/371472 [48:12<29:19:17,  3.42it/s]
  3%|▎         | 10155/371472 [48:12<28:50:14,  3.48it/s]
  3%|▎         | 10156/371472 [48:12<28:55:06,  3.47it/s]
  3%|▎         | 10157/371472 [48:13<28:03:42,  3.58it/s]
  3%|▎         | 10158/371472 [48:13<29:22:02,  3.42it/s]
  3%|▎         | 10159/371472 [48:13<28:42:14,  3.50it/s]
  3%|▎         | 10160/371472 [48:14<30:40:54,  3.27it/s]
                                                         
{'loss': 4.785, 'learning_rate': 9.758559762115107e-07, 'epoch': 0.44}

  3%|▎         | 10160/371472 [48:14<30:40:54,  3.27it/s]
  3%|▎         | 10161/371472 [48:14<29:19:10,  3.42it/s]
  3%|▎         | 10162/371472 [48:14<28:27:48,  3.53it/s]
  3%|▎         | 10163/371472 [48:14<27:10:05,  3.69it/s]
  3%|▎         | 10164/371472 [48:15<27:14:44,  3.68it/s]
  3%|▎         | 10165/371472 [48:15<26:23:36,  3.80it/s]
  3%|▎         | 10166/371472 [48:15<27:35:10,  3.64it/s]
  3%|▎         | 10167/371472 [48:15<27:14:07,  3.69it/s]
  3%|▎         | 10168/371472 [48:16<28:10:13,  3.56it/s]
  3%|▎         | 10169/371472 [48:16<28:27:13,  3.53it/s]
  3%|▎         | 10170/371472 [48:16<28:47:25,  3.49it/s]
  3%|▎         | 10171/371472 [48:17<27:13:28,  3.69it/s]
  3%|▎         | 10172/371472 [48:17<30:58:10,  3.24it/s]
  3%|▎         | 10173/371472 [48:17<28:51:37,  3.48it/s]
  3%|▎         | 10174/371472 [48:18<27:49:56,  3.61it/s]
  3%|▎         | 10175/371472 [48:18<27:29:35,  3.65it/s]
  3%|▎         | 10176/371472 [48:18<27:03:54,  3.71it/s]
  3%|▎         | 10177/371472 [48:18<28:10:09,  3.56it/s]
  3%|▎         | 10178/371472 [48:19<28:25:51,  3.53it/s]
  3%|▎         | 10179/371472 [48:19<27:41:03,  3.63it/s]
  3%|▎         | 10180/371472 [48:19<27:41:32,  3.62it/s]
                                                         
{'loss': 5.0965, 'learning_rate': 9.758074942360318e-07, 'epoch': 0.44}

  3%|▎         | 10180/371472 [48:19<27:41:32,  3.62it/s]
  3%|▎         | 10181/371472 [48:19<26:45:09,  3.75it/s]
  3%|▎         | 10182/371472 [48:20<27:29:34,  3.65it/s]
  3%|▎         | 10183/371472 [48:20<27:09:18,  3.70it/s]
  3%|▎         | 10184/371472 [48:20<28:11:21,  3.56it/s]
  3%|▎         | 10185/371472 [48:21<27:19:14,  3.67it/s]
  3%|▎         | 10186/371472 [48:21<27:32:08,  3.64it/s]
  3%|▎         | 10187/371472 [48:21<28:21:22,  3.54it/s]
  3%|▎         | 10188/371472 [48:21<27:53:26,  3.60it/s]
  3%|▎         | 10189/371472 [48:22<27:18:06,  3.68it/s]
  3%|▎         | 10190/371472 [48:22<29:33:53,  3.39it/s]
  3%|▎         | 10191/371472 [48:22<29:12:07,  3.44it/s]
  3%|▎         | 10192/371472 [48:22<27:32:47,  3.64it/s]
  3%|▎         | 10193/371472 [48:23<27:17:09,  3.68it/s]
  3%|▎         | 10194/371472 [48:23<28:36:32,  3.51it/s]
  3%|▎         | 10195/371472 [48:23<29:23:01,  3.42it/s]
  3%|▎         | 10196/371472 [48:24<28:06:37,  3.57it/s]
  3%|▎         | 10197/371472 [48:24<27:44:28,  3.62it/s]
  3%|▎         | 10198/371472 [48:24<27:02:10,  3.71it/s]
  3%|▎         | 10199/371472 [48:24<26:54:19,  3.73it/s]
  3%|▎         | 10200/371472 [48:25<27:23:13,  3.66it/s]
                                                         
{'loss': 4.7546, 'learning_rate': 9.757590122605529e-07, 'epoch': 0.44}

  3%|▎         | 10200/371472 [48:25<27:23:13,  3.66it/s]
  3%|▎         | 10201/371472 [48:25<27:13:08,  3.69it/s]
  3%|▎         | 10202/371472 [48:25<27:08:09,  3.70it/s]
  3%|▎         | 10203/371472 [48:26<28:15:00,  3.55it/s]
  3%|▎         | 10204/371472 [48:26<28:05:39,  3.57it/s]
  3%|▎         | 10205/371472 [48:26<29:12:04,  3.44it/s]
  3%|▎         | 10206/371472 [48:26<28:34:09,  3.51it/s]
  3%|▎         | 10207/371472 [48:27<27:55:23,  3.59it/s]
  3%|▎         | 10208/371472 [48:27<30:18:05,  3.31it/s]
  3%|▎         | 10209/371472 [48:27<29:14:46,  3.43it/s]
  3%|▎         | 10210/371472 [48:28<28:11:05,  3.56it/s]
  3%|▎         | 10211/371472 [48:28<27:11:57,  3.69it/s]
  3%|▎         | 10212/371472 [48:28<26:41:15,  3.76it/s]
  3%|▎         | 10213/371472 [48:28<27:39:59,  3.63it/s]
  3%|▎         | 10214/371472 [48:29<26:45:30,  3.75it/s]
  3%|▎         | 10215/371472 [48:29<30:00:44,  3.34it/s]
  3%|▎         | 10216/371472 [48:29<29:41:44,  3.38it/s]
  3%|▎         | 10217/371472 [48:30<29:17:23,  3.43it/s]
  3%|▎         | 10218/371472 [48:30<29:56:13,  3.35it/s]
  3%|▎         | 10219/371472 [48:30<28:41:22,  3.50it/s]
  3%|▎         | 10220/371472 [48:30<29:38:29,  3.39it/s]
                                                         
{'loss': 4.7411, 'learning_rate': 9.75710530285074e-07, 'epoch': 0.44}

  3%|▎         | 10220/371472 [48:30<29:38:29,  3.39it/s]
  3%|▎         | 10221/371472 [48:31<28:29:45,  3.52it/s]
  3%|▎         | 10222/371472 [48:31<29:16:41,  3.43it/s]
  3%|▎         | 10223/371472 [48:31<28:22:19,  3.54it/s]
  3%|▎         | 10224/371472 [48:32<29:15:56,  3.43it/s]
  3%|▎         | 10225/371472 [48:32<28:34:20,  3.51it/s]
  3%|▎         | 10226/371472 [48:32<28:23:41,  3.53it/s]
  3%|▎         | 10227/371472 [48:32<27:02:55,  3.71it/s]
  3%|▎         | 10228/371472 [48:33<27:19:14,  3.67it/s]
  3%|▎         | 10229/371472 [48:33<28:16:36,  3.55it/s]
  3%|▎         | 10230/371472 [48:33<27:41:05,  3.62it/s]
  3%|▎         | 10231/371472 [48:33<27:45:08,  3.62it/s]
  3%|▎         | 10232/371472 [48:34<32:36:07,  3.08it/s]
  3%|▎         | 10233/371472 [48:34<31:10:06,  3.22it/s]
  3%|▎         | 10234/371472 [48:34<30:46:13,  3.26it/s]
  3%|▎         | 10235/371472 [48:35<29:43:58,  3.37it/s]
  3%|▎         | 10236/371472 [48:35<29:20:17,  3.42it/s]
  3%|▎         | 10237/371472 [48:35<30:35:01,  3.28it/s]
  3%|▎         | 10238/371472 [48:36<29:14:58,  3.43it/s]
  3%|▎         | 10239/371472 [48:36<29:36:48,  3.39it/s]
  3%|▎         | 10240/371472 [48:36<28:14:43,  3.55it/s]
                                                         
{'loss': 4.7157, 'learning_rate': 9.75662048309595e-07, 'epoch': 0.44}

  3%|▎         | 10240/371472 [48:36<28:14:43,  3.55it/s]
  3%|▎         | 10241/371472 [48:37<30:17:42,  3.31it/s]
  3%|▎         | 10242/371472 [48:37<29:14:59,  3.43it/s]
  3%|▎         | 10243/371472 [48:37<29:35:05,  3.39it/s]
  3%|▎         | 10244/371472 [48:37<29:53:02,  3.36it/s]
  3%|▎         | 10245/371472 [48:38<30:16:25,  3.31it/s]
  3%|▎         | 10246/371472 [48:38<28:45:11,  3.49it/s]
  3%|▎         | 10247/371472 [48:38<29:41:13,  3.38it/s]
  3%|▎         | 10248/371472 [48:39<28:45:24,  3.49it/s]
  3%|▎         | 10249/371472 [48:39<27:29:14,  3.65it/s]
  3%|▎         | 10250/371472 [48:39<28:02:15,  3.58it/s]
  3%|▎         | 10251/371472 [48:39<27:55:35,  3.59it/s]
  3%|▎         | 10252/371472 [48:40<27:51:03,  3.60it/s]
  3%|▎         | 10253/371472 [48:40<27:34:38,  3.64it/s]
  3%|▎         | 10254/371472 [48:40<29:34:29,  3.39it/s]
  3%|▎         | 10255/371472 [48:41<28:40:25,  3.50it/s]
  3%|▎         | 10256/371472 [48:41<28:53:07,  3.47it/s]
  3%|▎         | 10257/371472 [48:41<27:38:12,  3.63it/s]
  3%|▎         | 10258/371472 [48:41<28:19:54,  3.54it/s]
  3%|▎         | 10259/371472 [48:42<27:37:14,  3.63it/s]
  3%|▎         | 10260/371472 [48:42<27:10:35,  3.69it/s]
                                                         
{'loss': 4.7451, 'learning_rate': 9.756135663341163e-07, 'epoch': 0.44}

  3%|▎         | 10260/371472 [48:42<27:10:35,  3.69it/s]
  3%|▎         | 10261/371472 [48:42<28:35:58,  3.51it/s]
  3%|▎         | 10262/371472 [48:43<30:04:50,  3.34it/s]
  3%|▎         | 10263/371472 [48:43<29:50:45,  3.36it/s]
  3%|▎         | 10264/371472 [48:43<28:31:32,  3.52it/s]
  3%|▎         | 10265/371472 [48:43<27:02:23,  3.71it/s]
  3%|▎         | 10266/371472 [48:44<28:53:08,  3.47it/s]
  3%|▎         | 10267/371472 [48:44<27:55:08,  3.59it/s]
  3%|▎         | 10268/371472 [48:44<27:44:20,  3.62it/s]
  3%|▎         | 10269/371472 [48:44<27:05:34,  3.70it/s]
  3%|▎         | 10270/371472 [48:45<27:24:55,  3.66it/s]
  3%|▎         | 10271/371472 [48:45<28:59:37,  3.46it/s]
  3%|▎         | 10272/371472 [48:45<28:25:08,  3.53it/s]
  3%|▎         | 10273/371472 [48:46<28:40:16,  3.50it/s]
  3%|▎         | 10274/371472 [48:46<29:00:40,  3.46it/s]
  3%|▎         | 10275/371472 [48:46<28:25:33,  3.53it/s]
  3%|▎         | 10276/371472 [48:46<27:34:52,  3.64it/s]
  3%|▎         | 10277/371472 [48:47<29:37:32,  3.39it/s]
  3%|▎         | 10278/371472 [48:47<30:04:47,  3.34it/s]
  3%|▎         | 10279/371472 [48:47<29:59:57,  3.34it/s]
  3%|▎         | 10280/371472 [48:48<28:18:23,  3.54it/s]
                                                         
{'loss': 4.9128, 'learning_rate': 9.755650843586374e-07, 'epoch': 0.44}

  3%|▎         | 10280/371472 [48:48<28:18:23,  3.54it/s]
  3%|▎         | 10281/371472 [48:48<28:30:10,  3.52it/s]
  3%|▎         | 10282/371472 [48:48<28:04:07,  3.57it/s]
  3%|▎         | 10283/371472 [48:48<27:55:25,  3.59it/s]
  3%|▎         | 10284/371472 [48:49<29:47:56,  3.37it/s]
  3%|▎         | 10285/371472 [48:49<29:44:06,  3.37it/s]
  3%|▎         | 10286/371472 [48:49<28:32:59,  3.51it/s]
  3%|▎         | 10287/371472 [48:50<31:52:41,  3.15it/s]
  3%|▎         | 10288/371472 [48:50<30:48:11,  3.26it/s]
  3%|▎         | 10289/371472 [48:50<31:11:39,  3.22it/s]
  3%|▎         | 10290/371472 [48:51<31:07:25,  3.22it/s]
  3%|▎         | 10291/371472 [48:51<29:59:35,  3.35it/s]
  3%|▎         | 10292/371472 [48:51<29:09:46,  3.44it/s]
  3%|▎         | 10293/371472 [48:51<28:29:09,  3.52it/s]
  3%|▎         | 10294/371472 [48:52<27:54:42,  3.59it/s]
  3%|▎         | 10295/371472 [48:52<27:21:12,  3.67it/s]
  3%|▎         | 10296/371472 [48:52<28:49:49,  3.48it/s]
  3%|▎         | 10297/371472 [48:53<28:55:39,  3.47it/s]
  3%|▎         | 10298/371472 [48:53<28:35:32,  3.51it/s]
  3%|▎         | 10299/371472 [48:53<29:40:38,  3.38it/s]
  3%|▎         | 10300/371472 [48:53<28:16:33,  3.55it/s]
                                                         
{'loss': 4.9461, 'learning_rate': 9.755166023831584e-07, 'epoch': 0.44}

  3%|▎         | 10300/371472 [48:53<28:16:33,  3.55it/s]
  3%|▎         | 10301/371472 [48:54<27:22:14,  3.67it/s]
  3%|▎         | 10302/371472 [48:54<26:38:32,  3.77it/s]
  3%|▎         | 10303/371472 [48:54<26:44:59,  3.75it/s]
  3%|▎         | 10304/371472 [48:54<26:32:13,  3.78it/s]
  3%|▎         | 10305/371472 [48:55<25:34:43,  3.92it/s]
  3%|▎         | 10306/371472 [48:55<25:45:37,  3.89it/s]
  3%|▎         | 10307/371472 [48:55<30:17:56,  3.31it/s]
  3%|▎         | 10308/371472 [48:56<29:44:53,  3.37it/s]
  3%|▎         | 10309/371472 [48:56<29:14:19,  3.43it/s]
  3%|▎         | 10310/371472 [48:56<33:54:28,  2.96it/s]
  3%|▎         | 10311/371472 [48:57<32:31:34,  3.08it/s]
  3%|▎         | 10312/371472 [48:57<32:16:59,  3.11it/s]
  3%|▎         | 10313/371472 [48:57<31:50:01,  3.15it/s]
  3%|▎         | 10314/371472 [48:58<30:40:15,  3.27it/s]
  3%|▎         | 10315/371472 [48:58<30:53:53,  3.25it/s]
  3%|▎         | 10316/371472 [48:58<30:06:48,  3.33it/s]
  3%|▎         | 10317/371472 [48:58<30:29:22,  3.29it/s]
  3%|▎         | 10318/371472 [48:59<29:00:08,  3.46it/s]
  3%|▎         | 10319/371472 [48:59<29:31:38,  3.40it/s]
  3%|▎         | 10320/371472 [48:59<28:48:20,  3.48it/s]
                                                         
{'loss': 4.902, 'learning_rate': 9.754681204076795e-07, 'epoch': 0.44}

  3%|▎         | 10320/371472 [48:59<28:48:20,  3.48it/s]
  3%|▎         | 10321/371472 [49:00<29:03:41,  3.45it/s]
  3%|▎         | 10322/371472 [49:00<28:56:41,  3.47it/s]
  3%|▎         | 10323/371472 [49:00<29:06:12,  3.45it/s]
  3%|▎         | 10324/371472 [49:01<29:49:43,  3.36it/s]
  3%|▎         | 10325/371472 [49:01<29:32:54,  3.40it/s]
  3%|▎         | 10326/371472 [49:01<28:37:37,  3.50it/s]
  3%|▎         | 10327/371472 [49:01<27:41:14,  3.62it/s]
  3%|▎         | 10328/371472 [49:02<27:43:48,  3.62it/s]
  3%|▎         | 10329/371472 [49:02<30:38:20,  3.27it/s]
  3%|▎         | 10330/371472 [49:02<30:32:09,  3.29it/s]
  3%|▎         | 10331/371472 [49:03<35:07:08,  2.86it/s]
  3%|▎         | 10332/371472 [49:03<34:23:57,  2.92it/s]
  3%|▎         | 10333/371472 [49:03<31:48:47,  3.15it/s]
  3%|▎         | 10334/371472 [49:04<30:07:27,  3.33it/s]
  3%|▎         | 10335/371472 [49:04<29:31:45,  3.40it/s]
  3%|▎         | 10336/371472 [49:04<29:30:53,  3.40it/s]
  3%|▎         | 10337/371472 [49:04<28:56:32,  3.47it/s]
  3%|▎         | 10338/371472 [49:05<27:52:44,  3.60it/s]
  3%|▎         | 10339/371472 [49:05<28:11:14,  3.56it/s]
  3%|▎         | 10340/371472 [49:05<28:15:47,  3.55it/s]
                                                         
{'loss': 4.9179, 'learning_rate': 9.754196384322006e-07, 'epoch': 0.45}

  3%|▎         | 10340/371472 [49:05<28:15:47,  3.55it/s]
  3%|▎         | 10341/371472 [49:06<28:55:57,  3.47it/s]
  3%|▎         | 10342/371472 [49:06<29:17:11,  3.43it/s]
  3%|▎         | 10343/371472 [49:06<28:44:33,  3.49it/s]
  3%|▎         | 10344/371472 [49:06<27:29:13,  3.65it/s]
  3%|▎         | 10345/371472 [49:07<26:55:56,  3.72it/s]
  3%|▎         | 10346/371472 [49:07<26:27:22,  3.79it/s]
  3%|▎         | 10347/371472 [49:07<27:39:26,  3.63it/s]
  3%|▎         | 10348/371472 [49:08<32:06:30,  3.12it/s]
  3%|▎         | 10349/371472 [49:08<32:27:28,  3.09it/s]
  3%|▎         | 10350/371472 [49:08<30:41:14,  3.27it/s]
  3%|▎         | 10351/371472 [49:08<30:27:22,  3.29it/s]
  3%|▎         | 10352/371472 [49:09<29:04:35,  3.45it/s]
  3%|▎         | 10353/371472 [49:09<28:34:11,  3.51it/s]
  3%|▎         | 10354/371472 [49:09<27:56:46,  3.59it/s]
  3%|▎         | 10355/371472 [49:10<27:08:16,  3.70it/s]
  3%|▎         | 10356/371472 [49:10<28:05:36,  3.57it/s]
  3%|▎         | 10357/371472 [49:10<27:16:54,  3.68it/s]
  3%|▎         | 10358/371472 [49:10<27:03:34,  3.71it/s]
  3%|▎         | 10359/371472 [49:11<27:11:38,  3.69it/s]
  3%|▎         | 10360/371472 [49:11<29:09:36,  3.44it/s]
                                                         
{'loss': 4.7129, 'learning_rate': 9.753711564567218e-07, 'epoch': 0.45}

  3%|▎         | 10360/371472 [49:11<29:09:36,  3.44it/s]
  3%|▎         | 10361/371472 [49:11<28:55:04,  3.47it/s]
  3%|▎         | 10362/371472 [49:12<28:12:26,  3.56it/s]
  3%|▎         | 10363/371472 [49:12<27:55:10,  3.59it/s]
  3%|▎         | 10364/371472 [49:12<28:01:51,  3.58it/s]
  3%|▎         | 10365/371472 [49:12<27:35:59,  3.63it/s]
  3%|▎         | 10366/371472 [49:13<28:15:43,  3.55it/s]
  3%|▎         | 10367/371472 [49:13<28:56:51,  3.47it/s]
  3%|▎         | 10368/371472 [49:13<28:35:11,  3.51it/s]
  3%|▎         | 10369/371472 [49:13<28:18:16,  3.54it/s]
  3%|▎         | 10370/371472 [49:14<28:44:24,  3.49it/s]
  3%|▎         | 10371/371472 [49:14<29:02:50,  3.45it/s]
  3%|▎         | 10372/371472 [49:14<28:16:40,  3.55it/s]
  3%|▎         | 10373/371472 [49:15<28:00:38,  3.58it/s]
  3%|▎         | 10374/371472 [49:15<28:36:38,  3.51it/s]
  3%|▎         | 10375/371472 [49:15<27:43:24,  3.62it/s]
  3%|▎         | 10376/371472 [49:15<29:00:37,  3.46it/s]
  3%|▎         | 10377/371472 [49:16<29:29:11,  3.40it/s]
  3%|▎         | 10378/371472 [49:16<29:32:56,  3.39it/s]
  3%|▎         | 10379/371472 [49:16<28:53:53,  3.47it/s]
  3%|▎         | 10380/371472 [49:17<28:54:01,  3.47it/s]
                                                         
{'loss': 4.8344, 'learning_rate': 9.753226744812427e-07, 'epoch': 0.45}

  3%|▎         | 10380/371472 [49:17<28:54:01,  3.47it/s]
  3%|▎         | 10381/371472 [49:17<31:10:45,  3.22it/s]
  3%|▎         | 10382/371472 [49:17<30:55:42,  3.24it/s]
  3%|▎         | 10383/371472 [49:18<29:42:55,  3.38it/s]
  3%|▎         | 10384/371472 [49:18<29:23:26,  3.41it/s]
  3%|▎         | 10385/371472 [49:18<29:23:43,  3.41it/s]
  3%|▎         | 10386/371472 [49:19<30:35:05,  3.28it/s]
  3%|▎         | 10387/371472 [49:19<30:39:08,  3.27it/s]
  3%|▎         | 10388/371472 [49:19<29:17:20,  3.42it/s]
  3%|▎         | 10389/371472 [49:19<28:35:01,  3.51it/s]
  3%|▎         | 10390/371472 [49:20<28:46:15,  3.49it/s]
  3%|▎         | 10391/371472 [49:20<29:00:38,  3.46it/s]
  3%|▎         | 10392/371472 [49:20<31:42:30,  3.16it/s]
  3%|▎         | 10393/371472 [49:21<29:42:26,  3.38it/s]
  3%|▎         | 10394/371472 [49:21<30:24:33,  3.30it/s]
  3%|▎         | 10395/371472 [49:21<29:46:14,  3.37it/s]
  3%|▎         | 10396/371472 [49:21<28:32:06,  3.51it/s]
  3%|▎         | 10397/371472 [49:22<28:22:45,  3.53it/s]
  3%|▎         | 10398/371472 [49:22<27:43:59,  3.62it/s]
  3%|▎         | 10399/371472 [49:22<29:14:37,  3.43it/s]
  3%|▎         | 10400/371472 [49:23<27:56:32,  3.59it/s]
                                                         
{'loss': 4.8156, 'learning_rate': 9.75274192505764e-07, 'epoch': 0.45}

  3%|▎         | 10400/371472 [49:23<27:56:32,  3.59it/s]
  3%|▎         | 10401/371472 [49:23<29:59:27,  3.34it/s]
  3%|▎         | 10402/371472 [49:23<29:27:09,  3.41it/s]
  3%|▎         | 10403/371472 [49:23<29:33:32,  3.39it/s]
  3%|▎         | 10404/371472 [49:24<28:58:06,  3.46it/s]
  3%|▎         | 10405/371472 [49:24<28:35:42,  3.51it/s]
  3%|▎         | 10406/371472 [49:24<27:48:56,  3.61it/s]
  3%|▎         | 10407/371472 [49:25<27:16:32,  3.68it/s]
  3%|▎         | 10408/371472 [49:25<26:19:19,  3.81it/s]
  3%|▎         | 10409/371472 [49:25<27:09:55,  3.69it/s]
  3%|▎         | 10410/371472 [49:25<26:35:31,  3.77it/s]
  3%|▎         | 10411/371472 [49:26<28:07:26,  3.57it/s]
  3%|▎         | 10412/371472 [49:26<28:08:47,  3.56it/s]
  3%|▎         | 10413/371472 [49:26<27:42:41,  3.62it/s]
  3%|▎         | 10414/371472 [49:26<27:04:59,  3.70it/s]
  3%|▎         | 10415/371472 [49:27<28:34:59,  3.51it/s]
  3%|▎         | 10416/371472 [49:27<28:55:19,  3.47it/s]
  3%|▎         | 10417/371472 [49:27<28:20:31,  3.54it/s]
  3%|▎         | 10418/371472 [49:28<27:26:20,  3.66it/s]
  3%|▎         | 10419/371472 [49:28<26:59:46,  3.72it/s]
  3%|▎         | 10420/371472 [49:28<28:56:17,  3.47it/s]
                                                         
{'loss': 4.8929, 'learning_rate': 9.75225710530285e-07, 'epoch': 0.45}

  3%|▎         | 10420/371472 [49:28<28:56:17,  3.47it/s]
  3%|▎         | 10421/371472 [49:28<28:59:01,  3.46it/s]
  3%|▎         | 10422/371472 [49:29<29:31:33,  3.40it/s]
  3%|▎         | 10423/371472 [49:29<29:20:57,  3.42it/s]
  3%|▎         | 10424/371472 [49:29<29:01:28,  3.46it/s]
  3%|▎         | 10425/371472 [49:30<28:56:12,  3.47it/s]
  3%|▎         | 10426/371472 [49:30<30:36:59,  3.28it/s]
  3%|▎         | 10427/371472 [49:30<29:17:43,  3.42it/s]
  3%|▎         | 10428/371472 [49:31<29:34:13,  3.39it/s]
  3%|▎         | 10429/371472 [49:31<29:49:14,  3.36it/s]
  3%|▎         | 10430/371472 [49:31<30:50:47,  3.25it/s]
  3%|▎         | 10431/371472 [49:31<29:33:35,  3.39it/s]
  3%|▎         | 10432/371472 [49:32<28:51:23,  3.48it/s]
  3%|▎         | 10433/371472 [49:32<28:26:40,  3.53it/s]
  3%|▎         | 10434/371472 [49:32<27:31:49,  3.64it/s]
  3%|▎         | 10435/371472 [49:32<27:17:59,  3.67it/s]
  3%|▎         | 10436/371472 [49:33<27:31:20,  3.64it/s]
  3%|▎         | 10437/371472 [49:33<27:23:37,  3.66it/s]
  3%|▎         | 10438/371472 [49:33<27:47:43,  3.61it/s]
  3%|▎         | 10439/371472 [49:34<27:45:59,  3.61it/s]
  3%|▎         | 10440/371472 [49:34<29:24:13,  3.41it/s]
                                                         
{'loss': 4.7655, 'learning_rate': 9.751772285548061e-07, 'epoch': 0.45}

  3%|▎         | 10440/371472 [49:34<29:24:13,  3.41it/s]
  3%|▎         | 10441/371472 [49:34<27:55:41,  3.59it/s]
  3%|▎         | 10442/371472 [49:34<27:43:25,  3.62it/s]
  3%|▎         | 10443/371472 [49:35<26:28:35,  3.79it/s]
  3%|▎         | 10444/371472 [49:35<27:28:25,  3.65it/s]
  3%|▎         | 10445/371472 [49:35<28:29:22,  3.52it/s]
  3%|▎         | 10446/371472 [49:36<30:02:03,  3.34it/s]
  3%|▎         | 10447/371472 [49:36<29:04:05,  3.45it/s]
  3%|▎         | 10448/371472 [49:36<27:59:02,  3.58it/s]
  3%|▎         | 10449/371472 [49:36<29:00:11,  3.46it/s]
  3%|▎         | 10450/371472 [49:37<28:03:42,  3.57it/s]
  3%|▎         | 10451/371472 [49:37<28:44:46,  3.49it/s]
  3%|▎         | 10452/371472 [49:37<27:44:08,  3.62it/s]
  3%|▎         | 10453/371472 [49:38<28:16:08,  3.55it/s]
  3%|▎         | 10454/371472 [49:38<28:31:19,  3.52it/s]
  3%|▎         | 10455/371472 [49:38<27:35:00,  3.64it/s]
  3%|▎         | 10456/371472 [49:38<28:24:08,  3.53it/s]
  3%|▎         | 10457/371472 [49:39<27:48:36,  3.61it/s]
  3%|▎         | 10458/371472 [49:39<29:53:05,  3.36it/s]
  3%|▎         | 10459/371472 [49:39<30:16:18,  3.31it/s]
  3%|▎         | 10460/371472 [49:40<31:01:51,  3.23it/s]
                                                         
{'loss': 4.8392, 'learning_rate': 9.751287465793272e-07, 'epoch': 0.45}

  3%|▎         | 10460/371472 [49:40<31:01:51,  3.23it/s]
  3%|▎         | 10461/371472 [49:40<29:41:57,  3.38it/s]
  3%|▎         | 10462/371472 [49:40<28:36:07,  3.51it/s]
  3%|▎         | 10463/371472 [49:40<27:15:38,  3.68it/s]
  3%|▎         | 10464/371472 [49:41<26:24:43,  3.80it/s]
  3%|▎         | 10465/371472 [49:41<28:23:42,  3.53it/s]
  3%|▎         | 10466/371472 [49:41<29:01:53,  3.45it/s]
  3%|▎         | 10467/371472 [49:42<29:12:04,  3.43it/s]
  3%|▎         | 10468/371472 [49:42<28:58:46,  3.46it/s]
  3%|▎         | 10469/371472 [49:42<28:38:18,  3.50it/s]
  3%|▎         | 10470/371472 [49:42<27:50:33,  3.60it/s]
  3%|▎         | 10471/371472 [49:43<28:35:28,  3.51it/s]
  3%|▎         | 10472/371472 [49:43<28:25:41,  3.53it/s]
  3%|▎         | 10473/371472 [49:43<27:45:51,  3.61it/s]
  3%|▎         | 10474/371472 [49:44<27:26:43,  3.65it/s]
  3%|▎         | 10475/371472 [49:44<26:43:05,  3.75it/s]
  3%|▎         | 10476/371472 [49:44<27:27:10,  3.65it/s]
  3%|▎         | 10477/371472 [49:44<28:53:16,  3.47it/s]
  3%|▎         | 10478/371472 [49:45<28:21:56,  3.54it/s]
  3%|▎         | 10479/371472 [49:45<27:37:02,  3.63it/s]
  3%|▎         | 10480/371472 [49:45<27:30:26,  3.65it/s]
                                                         
{'loss': 4.6094, 'learning_rate': 9.750802646038483e-07, 'epoch': 0.45}

  3%|▎         | 10480/371472 [49:45<27:30:26,  3.65it/s]
  3%|▎         | 10481/371472 [49:45<27:53:25,  3.60it/s]
  3%|▎         | 10482/371472 [49:46<28:58:29,  3.46it/s]
  3%|▎         | 10483/371472 [49:46<29:15:08,  3.43it/s]
  3%|▎         | 10484/371472 [49:46<27:57:23,  3.59it/s]
  3%|▎         | 10485/371472 [49:47<28:23:03,  3.53it/s]
  3%|▎         | 10486/371472 [49:47<28:33:31,  3.51it/s]
  3%|▎         | 10487/371472 [49:47<27:25:22,  3.66it/s]
  3%|▎         | 10488/371472 [49:47<27:29:03,  3.65it/s]
  3%|▎         | 10489/371472 [49:48<28:33:14,  3.51it/s]
  3%|▎         | 10490/371472 [49:48<28:28:44,  3.52it/s]
  3%|▎         | 10491/371472 [49:48<28:33:13,  3.51it/s]
  3%|▎         | 10492/371472 [49:49<30:00:50,  3.34it/s]
  3%|▎         | 10493/371472 [49:49<29:33:29,  3.39it/s]
  3%|▎         | 10494/371472 [49:49<29:14:54,  3.43it/s]
  3%|▎         | 10495/371472 [49:49<29:03:06,  3.45it/s]
  3%|▎         | 10496/371472 [49:50<28:05:46,  3.57it/s]
  3%|▎         | 10497/371472 [49:50<28:45:50,  3.49it/s]
  3%|▎         | 10498/371472 [49:50<29:38:28,  3.38it/s]
  3%|▎         | 10499/371472 [49:51<30:02:52,  3.34it/s]
  3%|▎         | 10500/371472 [49:51<29:22:30,  3.41it/s]
                                                         
{'loss': 4.7745, 'learning_rate': 9.750317826283696e-07, 'epoch': 0.45}

  3%|▎         | 10500/371472 [49:51<29:22:30,  3.41it/s]
  3%|▎         | 10501/371472 [49:51<28:39:52,  3.50it/s]
  3%|▎         | 10502/371472 [49:51<28:11:45,  3.56it/s]
  3%|▎         | 10503/371472 [49:52<28:25:05,  3.53it/s]
  3%|▎         | 10504/371472 [49:52<28:17:58,  3.54it/s]
  3%|▎         | 10505/371472 [49:52<27:55:36,  3.59it/s]
  3%|▎         | 10506/371472 [49:53<27:33:10,  3.64it/s]
  3%|▎         | 10507/371472 [49:53<27:48:22,  3.61it/s]
  3%|▎         | 10508/371472 [49:53<28:06:38,  3.57it/s]
  3%|▎         | 10509/371472 [49:53<27:38:54,  3.63it/s]
  3%|▎         | 10510/371472 [49:54<27:34:53,  3.64it/s]
  3%|▎         | 10511/371472 [49:54<29:43:12,  3.37it/s]
  3%|▎         | 10512/371472 [49:54<29:36:27,  3.39it/s]
  3%|▎         | 10513/371472 [49:55<28:37:12,  3.50it/s]
  3%|▎         | 10514/371472 [49:55<28:33:35,  3.51it/s]
  3%|▎         | 10515/371472 [49:55<28:20:58,  3.54it/s]
  3%|▎         | 10516/371472 [49:55<29:12:04,  3.43it/s]
  3%|▎         | 10517/371472 [49:56<30:09:33,  3.32it/s]
  3%|▎         | 10518/371472 [49:56<29:05:17,  3.45it/s]
  3%|▎         | 10519/371472 [49:56<29:59:32,  3.34it/s]
  3%|▎         | 10520/371472 [49:57<29:04:46,  3.45it/s]
                                                         
{'loss': 4.7868, 'learning_rate': 9.749833006528904e-07, 'epoch': 0.45}

  3%|▎         | 10520/371472 [49:57<29:04:46,  3.45it/s]
  3%|▎         | 10521/371472 [49:57<27:58:12,  3.58it/s]
  3%|▎         | 10522/371472 [49:57<30:43:38,  3.26it/s]
  3%|▎         | 10523/371472 [49:58<29:21:42,  3.41it/s]
  3%|▎         | 10524/371472 [49:58<28:41:26,  3.49it/s]
  3%|▎         | 10525/371472 [49:58<28:08:48,  3.56it/s]
  3%|▎         | 10526/371472 [49:58<28:27:31,  3.52it/s]
  3%|▎         | 10527/371472 [49:59<27:37:15,  3.63it/s]
  3%|▎         | 10528/371472 [49:59<28:04:08,  3.57it/s]
  3%|▎         | 10529/371472 [49:59<27:20:44,  3.67it/s]
  3%|▎         | 10530/371472 [49:59<28:32:43,  3.51it/s]
  3%|▎         | 10531/371472 [50:00<29:19:54,  3.42it/s]
  3%|▎         | 10532/371472 [50:00<34:02:11,  2.95it/s]
  3%|▎         | 10533/371472 [50:01<35:41:07,  2.81it/s]
  3%|▎         | 10534/371472 [50:01<34:02:58,  2.94it/s]
  3%|▎         | 10535/371472 [50:01<33:09:41,  3.02it/s]
  3%|▎         | 10536/371472 [50:02<31:41:02,  3.16it/s]
  3%|▎         | 10537/371472 [50:02<30:39:46,  3.27it/s]
  3%|▎         | 10538/371472 [50:02<30:24:05,  3.30it/s]
  3%|▎         | 10539/371472 [50:02<31:12:43,  3.21it/s]
  3%|▎         | 10540/371472 [50:03<29:45:38,  3.37it/s]
                                                         
{'loss': 4.6695, 'learning_rate': 9.749348186774117e-07, 'epoch': 0.45}

  3%|▎         | 10540/371472 [50:03<29:45:38,  3.37it/s]
  3%|▎         | 10541/371472 [50:03<29:36:48,  3.39it/s]
  3%|▎         | 10542/371472 [50:03<28:35:08,  3.51it/s]
  3%|▎         | 10543/371472 [50:04<28:58:06,  3.46it/s]
  3%|▎         | 10544/371472 [50:04<28:10:17,  3.56it/s]
  3%|▎         | 10545/371472 [50:04<28:35:53,  3.51it/s]
  3%|▎         | 10546/371472 [50:04<28:05:59,  3.57it/s]
  3%|▎         | 10547/371472 [50:05<27:21:07,  3.67it/s]
  3%|▎         | 10548/371472 [50:05<26:42:07,  3.75it/s]
  3%|▎         | 10549/371472 [50:05<26:44:15,  3.75it/s]
  3%|▎         | 10550/371472 [50:05<26:35:08,  3.77it/s]
  3%|▎         | 10551/371472 [50:06<26:18:43,  3.81it/s]
  3%|▎         | 10552/371472 [50:06<29:58:26,  3.34it/s]
  3%|▎         | 10553/371472 [50:06<28:17:45,  3.54it/s]
  3%|▎         | 10554/371472 [50:07<28:01:41,  3.58it/s]
  3%|▎         | 10555/371472 [50:07<27:33:15,  3.64it/s]
  3%|▎         | 10556/371472 [50:07<27:57:45,  3.59it/s]
  3%|▎         | 10557/371472 [50:07<27:37:39,  3.63it/s]
  3%|▎         | 10558/371472 [50:08<27:24:45,  3.66it/s]
  3%|▎         | 10559/371472 [50:08<28:16:04,  3.55it/s]
  3%|▎         | 10560/371472 [50:08<28:42:53,  3.49it/s]
                                                         
{'loss': 4.9459, 'learning_rate': 9.748863367019328e-07, 'epoch': 0.45}

  3%|▎         | 10560/371472 [50:08<28:42:53,  3.49it/s]
  3%|▎         | 10561/371472 [50:09<27:32:22,  3.64it/s]
  3%|▎         | 10562/371472 [50:09<28:30:28,  3.52it/s]
  3%|▎         | 10563/371472 [50:09<28:31:01,  3.52it/s]
  3%|▎         | 10564/371472 [50:09<27:44:11,  3.61it/s]
  3%|▎         | 10565/371472 [50:10<28:02:06,  3.58it/s]
  3%|▎         | 10566/371472 [50:10<28:07:49,  3.56it/s]
  3%|▎         | 10567/371472 [50:10<30:37:44,  3.27it/s]
  3%|▎         | 10568/371472 [50:11<28:27:51,  3.52it/s]
  3%|▎         | 10569/371472 [50:11<28:39:08,  3.50it/s]
  3%|▎         | 10570/371472 [50:11<28:25:59,  3.53it/s]
  3%|▎         | 10571/371472 [50:11<29:00:41,  3.46it/s]
  3%|▎         | 10572/371472 [50:12<28:53:39,  3.47it/s]
  3%|▎         | 10573/371472 [50:12<27:56:17,  3.59it/s]
  3%|▎         | 10574/371472 [50:12<28:23:35,  3.53it/s]
  3%|▎         | 10575/371472 [50:13<28:29:12,  3.52it/s]
  3%|▎         | 10576/371472 [50:13<27:45:26,  3.61it/s]
  3%|▎         | 10577/371472 [50:13<28:03:48,  3.57it/s]
  3%|▎         | 10578/371472 [50:13<27:28:48,  3.65it/s]
  3%|▎         | 10579/371472 [50:14<27:29:10,  3.65it/s]
  3%|▎         | 10580/371472 [50:14<27:23:48,  3.66it/s]
                                                         
{'loss': 4.856, 'learning_rate': 9.748378547264538e-07, 'epoch': 0.46}

  3%|▎         | 10580/371472 [50:14<27:23:48,  3.66it/s]
  3%|▎         | 10581/371472 [50:14<27:13:38,  3.68it/s]
  3%|▎         | 10582/371472 [50:14<26:13:28,  3.82it/s]
  3%|▎         | 10583/371472 [50:15<27:20:40,  3.67it/s]
  3%|▎         | 10584/371472 [50:15<27:01:29,  3.71it/s]
  3%|▎         | 10585/371472 [50:15<27:58:00,  3.58it/s]
  3%|▎         | 10586/371472 [50:16<28:24:04,  3.53it/s]
  3%|▎         | 10587/371472 [50:16<29:03:48,  3.45it/s]
  3%|▎         | 10588/371472 [50:16<28:18:18,  3.54it/s]
  3%|▎         | 10589/371472 [50:16<28:10:04,  3.56it/s]
  3%|▎         | 10590/371472 [50:17<29:10:00,  3.44it/s]
  3%|▎         | 10591/371472 [50:17<28:30:05,  3.52it/s]
  3%|▎         | 10592/371472 [50:17<27:58:34,  3.58it/s]
  3%|▎         | 10593/371472 [50:18<27:38:19,  3.63it/s]
  3%|▎         | 10594/371472 [50:18<27:57:40,  3.59it/s]
  3%|▎         | 10595/371472 [50:18<28:41:55,  3.49it/s]
  3%|▎         | 10596/371472 [50:19<32:22:08,  3.10it/s]
  3%|▎         | 10597/371472 [50:19<31:40:00,  3.17it/s]
  3%|▎         | 10598/371472 [50:19<30:02:40,  3.34it/s]
  3%|▎         | 10599/371472 [50:19<29:02:00,  3.45it/s]
  3%|▎         | 10600/371472 [50:20<30:26:33,  3.29it/s]
                                                         
{'loss': 4.6656, 'learning_rate': 9.74789372750975e-07, 'epoch': 0.46}

  3%|▎         | 10600/371472 [50:20<30:26:33,  3.29it/s]
  3%|▎         | 10601/371472 [50:20<31:12:25,  3.21it/s]
  3%|▎         | 10602/371472 [50:20<29:45:38,  3.37it/s]
  3%|▎         | 10603/371472 [50:21<31:13:32,  3.21it/s]
  3%|▎         | 10604/371472 [50:21<29:12:37,  3.43it/s]
  3%|▎         | 10605/371472 [50:21<30:34:14,  3.28it/s]
  3%|▎         | 10606/371472 [50:21<29:06:08,  3.44it/s]
  3%|▎         | 10607/371472 [50:22<28:57:42,  3.46it/s]
  3%|▎         | 10608/371472 [50:22<28:11:36,  3.56it/s]
  3%|▎         | 10609/371472 [50:22<29:48:58,  3.36it/s]
  3%|▎         | 10610/371472 [50:23<29:37:34,  3.38it/s]
  3%|▎         | 10611/371472 [50:23<34:36:23,  2.90it/s]
  3%|▎         | 10612/371472 [50:23<32:50:47,  3.05it/s]
  3%|▎         | 10613/371472 [50:24<31:00:01,  3.23it/s]
  3%|▎         | 10614/371472 [50:24<30:01:18,  3.34it/s]
  3%|▎         | 10615/371472 [50:24<30:50:51,  3.25it/s]
  3%|▎         | 10616/371472 [50:25<33:22:35,  3.00it/s]
  3%|▎         | 10617/371472 [50:25<31:04:27,  3.23it/s]
  3%|▎         | 10618/371472 [50:25<30:48:03,  3.25it/s]
  3%|▎         | 10619/371472 [50:25<28:54:56,  3.47it/s]
  3%|▎         | 10620/371472 [50:26<28:10:08,  3.56it/s]
                                                         
{'loss': 4.7138, 'learning_rate': 9.74740890775496e-07, 'epoch': 0.46}

  3%|▎         | 10620/371472 [50:26<28:10:08,  3.56it/s]
  3%|▎         | 10621/371472 [50:26<28:09:50,  3.56it/s]
  3%|▎         | 10622/371472 [50:26<27:46:50,  3.61it/s]
  3%|▎         | 10623/371472 [50:27<28:08:41,  3.56it/s]
  3%|▎         | 10624/371472 [50:27<30:34:41,  3.28it/s]
  3%|▎         | 10625/371472 [50:27<30:03:48,  3.33it/s]
  3%|▎         | 10626/371472 [50:27<28:24:51,  3.53it/s]
  3%|▎         | 10627/371472 [50:28<27:34:52,  3.63it/s]
  3%|▎         | 10628/371472 [50:28<28:16:10,  3.55it/s]
  3%|▎         | 10629/371472 [50:28<28:14:09,  3.55it/s]
  3%|▎         | 10630/371472 [50:29<27:51:43,  3.60it/s]
  3%|▎         | 10631/371472 [50:29<28:40:24,  3.50it/s]
  3%|▎         | 10632/371472 [50:29<27:53:36,  3.59it/s]
  3%|▎         | 10633/371472 [50:29<27:43:36,  3.62it/s]
  3%|▎         | 10634/371472 [50:30<27:32:04,  3.64it/s]
  3%|▎         | 10635/371472 [50:30<27:56:11,  3.59it/s]
  3%|▎         | 10636/371472 [50:30<33:41:18,  2.98it/s]
  3%|▎         | 10637/371472 [50:31<31:48:36,  3.15it/s]
  3%|▎         | 10638/371472 [50:31<33:27:30,  3.00it/s]
  3%|▎         | 10639/371472 [50:31<32:21:21,  3.10it/s]
  3%|▎         | 10640/371472 [50:32<31:29:06,  3.18it/s]
                                                         
{'loss': 4.7696, 'learning_rate': 9.746924088000173e-07, 'epoch': 0.46}

  3%|▎         | 10640/371472 [50:32<31:29:06,  3.18it/s]
  3%|▎         | 10641/371472 [50:32<31:43:17,  3.16it/s]
  3%|▎         | 10642/371472 [50:32<31:14:48,  3.21it/s]
  3%|▎         | 10643/371472 [50:32<28:58:31,  3.46it/s]
  3%|▎         | 10644/371472 [50:33<28:39:53,  3.50it/s]
  3%|▎         | 10645/371472 [50:33<28:25:43,  3.53it/s]
  3%|▎         | 10646/371472 [50:33<28:18:45,  3.54it/s]
  3%|▎         | 10647/371472 [50:34<28:11:48,  3.55it/s]
  3%|▎         | 10648/371472 [50:34<28:34:47,  3.51it/s]
  3%|▎         | 10649/371472 [50:34<28:46:12,  3.48it/s]
  3%|▎         | 10650/371472 [50:34<28:49:14,  3.48it/s]
  3%|▎         | 10651/371472 [50:35<28:10:27,  3.56it/s]
  3%|▎         | 10652/371472 [50:35<28:48:02,  3.48it/s]
  3%|▎         | 10653/371472 [50:35<29:09:10,  3.44it/s]
  3%|▎         | 10654/371472 [50:36<27:29:00,  3.65it/s]
  3%|▎         | 10655/371472 [50:36<30:45:38,  3.26it/s]
  3%|▎         | 10656/371472 [50:36<28:43:06,  3.49it/s]
  3%|▎         | 10657/371472 [50:36<28:13:16,  3.55it/s]
  3%|▎         | 10658/371472 [50:37<28:58:19,  3.46it/s]
  3%|▎         | 10659/371472 [50:37<28:42:21,  3.49it/s]
  3%|▎         | 10660/371472 [50:37<27:31:43,  3.64it/s]
                                                         
{'loss': 4.7906, 'learning_rate': 9.746439268245383e-07, 'epoch': 0.46}

  3%|▎         | 10660/371472 [50:37<27:31:43,  3.64it/s]
  3%|▎         | 10661/371472 [50:38<27:33:32,  3.64it/s]
  3%|▎         | 10662/371472 [50:38<29:40:04,  3.38it/s]
  3%|▎         | 10663/371472 [50:38<29:14:57,  3.43it/s]
  3%|▎         | 10664/371472 [50:38<28:31:47,  3.51it/s]
  3%|▎         | 10665/371472 [50:39<27:54:31,  3.59it/s]
  3%|▎         | 10666/371472 [50:39<27:16:39,  3.67it/s]
  3%|▎         | 10667/371472 [50:39<27:45:33,  3.61it/s]
  3%|▎         | 10668/371472 [50:40<27:57:26,  3.58it/s]
  3%|▎         | 10669/371472 [50:40<30:38:23,  3.27it/s]
  3%|▎         | 10670/371472 [50:40<30:34:28,  3.28it/s]
  3%|▎         | 10671/371472 [50:41<30:08:36,  3.32it/s]
  3%|▎         | 10672/371472 [50:41<31:17:51,  3.20it/s]
  3%|▎         | 10673/371472 [50:41<31:16:58,  3.20it/s]
  3%|▎         | 10674/371472 [50:41<29:50:02,  3.36it/s]
  3%|▎         | 10675/371472 [50:42<28:27:48,  3.52it/s]
  3%|▎         | 10676/371472 [50:42<27:49:48,  3.60it/s]
  3%|▎         | 10677/371472 [50:42<27:47:27,  3.61it/s]
  3%|▎         | 10678/371472 [50:43<28:38:19,  3.50it/s]
  3%|▎         | 10679/371472 [50:43<27:49:03,  3.60it/s]
  3%|▎         | 10680/371472 [50:43<26:54:08,  3.73it/s]
                                                         
{'loss': 4.7629, 'learning_rate': 9.745954448490594e-07, 'epoch': 0.46}

  3%|▎         | 10680/371472 [50:43<26:54:08,  3.73it/s]
  3%|▎         | 10681/371472 [50:43<27:00:23,  3.71it/s]
  3%|▎         | 10682/371472 [50:44<27:55:24,  3.59it/s]
  3%|▎         | 10683/371472 [50:44<27:09:30,  3.69it/s]
  3%|▎         | 10684/371472 [50:44<26:48:16,  3.74it/s]
  3%|▎         | 10685/371472 [50:44<28:02:07,  3.57it/s]
  3%|▎         | 10686/371472 [50:45<28:19:29,  3.54it/s]
  3%|▎         | 10687/371472 [50:45<27:51:06,  3.60it/s]
  3%|▎         | 10688/371472 [50:45<28:22:20,  3.53it/s]
  3%|▎         | 10689/371472 [50:46<28:47:29,  3.48it/s]
  3%|▎         | 10690/371472 [50:46<29:20:42,  3.42it/s]
  3%|▎         | 10691/371472 [50:46<28:30:53,  3.51it/s]
  3%|▎         | 10692/371472 [50:46<28:13:22,  3.55it/s]
  3%|▎         | 10693/371472 [50:47<29:05:07,  3.45it/s]
  3%|▎         | 10694/371472 [50:47<28:09:52,  3.56it/s]
  3%|▎         | 10695/371472 [50:47<30:32:39,  3.28it/s]
  3%|▎         | 10696/371472 [50:48<29:06:31,  3.44it/s]
  3%|▎         | 10697/371472 [50:48<27:34:57,  3.63it/s]
  3%|▎         | 10698/371472 [50:48<31:18:24,  3.20it/s]
  3%|▎         | 10699/371472 [50:49<31:15:12,  3.21it/s]
  3%|▎         | 10700/371472 [50:49<29:34:11,  3.39it/s]
                                                         
{'loss': 4.9862, 'learning_rate': 9.745469628735805e-07, 'epoch': 0.46}

  3%|▎         | 10700/371472 [50:49<29:34:11,  3.39it/s]
  3%|▎         | 10701/371472 [50:49<27:57:09,  3.59it/s]
  3%|▎         | 10702/371472 [50:49<26:45:27,  3.75it/s]
  3%|▎         | 10703/371472 [50:50<26:37:38,  3.76it/s]
  3%|▎         | 10704/371472 [50:50<26:41:18,  3.75it/s]
  3%|▎         | 10705/371472 [50:50<26:15:21,  3.82it/s]
  3%|▎         | 10706/371472 [50:50<25:59:08,  3.86it/s]
  3%|▎         | 10707/371472 [50:51<27:12:00,  3.68it/s]
  3%|▎         | 10708/371472 [50:51<27:04:18,  3.70it/s]
  3%|▎         | 10709/371472 [50:51<28:01:52,  3.57it/s]
  3%|▎         | 10710/371472 [50:51<27:07:28,  3.69it/s]
  3%|▎         | 10711/371472 [50:52<26:36:33,  3.77it/s]
  3%|▎         | 10712/371472 [50:52<26:17:33,  3.81it/s]
  3%|▎         | 10713/371472 [50:52<29:45:41,  3.37it/s]
  3%|▎         | 10714/371472 [50:53<28:45:02,  3.49it/s]
  3%|▎         | 10715/371472 [50:53<28:39:09,  3.50it/s]
  3%|▎         | 10716/371472 [50:53<28:19:13,  3.54it/s]
  3%|▎         | 10717/371472 [50:53<28:39:10,  3.50it/s]
  3%|▎         | 10718/371472 [50:54<27:54:23,  3.59it/s]
  3%|▎         | 10719/371472 [50:54<27:26:30,  3.65it/s]
  3%|▎         | 10720/371472 [50:54<26:29:24,  3.78it/s]
                                                         
{'loss': 4.9942, 'learning_rate': 9.744984808981016e-07, 'epoch': 0.46}

  3%|▎         | 10720/371472 [50:54<26:29:24,  3.78it/s]
  3%|▎         | 10721/371472 [50:55<26:50:48,  3.73it/s]
  3%|▎         | 10722/371472 [50:55<26:39:22,  3.76it/s]
  3%|▎         | 10723/371472 [50:55<26:38:01,  3.76it/s]
  3%|▎         | 10724/371472 [50:55<26:37:44,  3.76it/s]
  3%|▎         | 10725/371472 [50:56<27:31:24,  3.64it/s]
  3%|▎         | 10726/371472 [50:56<28:03:23,  3.57it/s]
  3%|▎         | 10727/371472 [50:56<29:22:39,  3.41it/s]
  3%|▎         | 10728/371472 [50:57<29:15:57,  3.42it/s]
  3%|▎         | 10729/371472 [50:57<30:47:56,  3.25it/s]
  3%|▎         | 10730/371472 [50:57<32:54:16,  3.05it/s]
  3%|▎         | 10731/371472 [50:58<31:26:21,  3.19it/s]
  3%|▎         | 10732/371472 [50:58<30:27:11,  3.29it/s]
  3%|▎         | 10733/371472 [50:58<28:36:47,  3.50it/s]
  3%|▎         | 10734/371472 [50:58<30:48:28,  3.25it/s]
  3%|▎         | 10735/371472 [50:59<29:29:26,  3.40it/s]
  3%|▎         | 10736/371472 [50:59<28:30:59,  3.51it/s]
  3%|▎         | 10737/371472 [50:59<28:28:06,  3.52it/s]
  3%|▎         | 10738/371472 [50:59<27:11:22,  3.69it/s]
  3%|▎         | 10739/371472 [51:00<26:47:18,  3.74it/s]
  3%|▎         | 10740/371472 [51:00<26:47:13,  3.74it/s]
                                                         
{'loss': 5.1121, 'learning_rate': 9.744499989226228e-07, 'epoch': 0.46}

  3%|▎         | 10740/371472 [51:00<26:47:13,  3.74it/s]
  3%|▎         | 10741/371472 [51:00<28:34:21,  3.51it/s]
  3%|▎         | 10742/371472 [51:01<28:57:11,  3.46it/s]
  3%|▎         | 10743/371472 [51:01<29:50:09,  3.36it/s]
  3%|▎         | 10744/371472 [51:01<28:03:31,  3.57it/s]
  3%|▎         | 10745/371472 [51:01<28:23:59,  3.53it/s]
  3%|▎         | 10746/371472 [51:02<29:41:47,  3.37it/s]
  3%|▎         | 10747/371472 [51:02<30:02:21,  3.34it/s]
  3%|▎         | 10748/371472 [51:02<29:40:28,  3.38it/s]
  3%|▎         | 10749/371472 [51:03<29:49:47,  3.36it/s]
  3%|▎         | 10750/371472 [51:03<29:52:59,  3.35it/s]
  3%|▎         | 10751/371472 [51:03<28:50:18,  3.47it/s]
  3%|▎         | 10752/371472 [51:04<28:50:53,  3.47it/s]
  3%|▎         | 10753/371472 [51:04<30:05:32,  3.33it/s]
  3%|▎         | 10754/371472 [51:04<29:46:11,  3.37it/s]
  3%|▎         | 10755/371472 [51:04<31:48:21,  3.15it/s]
  3%|▎         | 10756/371472 [51:05<30:57:01,  3.24it/s]
  3%|▎         | 10757/371472 [51:05<28:56:22,  3.46it/s]
  3%|▎         | 10758/371472 [51:05<28:45:04,  3.48it/s]
  3%|▎         | 10759/371472 [51:06<28:31:40,  3.51it/s]
  3%|▎         | 10760/371472 [51:06<28:59:44,  3.46it/s]
                                                         
{'loss': 4.7407, 'learning_rate': 9.744015169471437e-07, 'epoch': 0.46}

  3%|▎         | 10760/371472 [51:06<28:59:44,  3.46it/s]
  3%|▎         | 10761/371472 [51:06<29:15:14,  3.43it/s]
  3%|▎         | 10762/371472 [51:07<29:53:27,  3.35it/s]
  3%|▎         | 10763/371472 [51:07<30:29:49,  3.29it/s]
  3%|▎         | 10764/371472 [51:07<29:04:34,  3.45it/s]
  3%|▎         | 10765/371472 [51:07<27:23:05,  3.66it/s]
  3%|▎         | 10766/371472 [51:08<27:00:33,  3.71it/s]
  3%|▎         | 10767/371472 [51:08<27:35:41,  3.63it/s]
  3%|▎         | 10768/371472 [51:08<28:27:46,  3.52it/s]
  3%|▎         | 10769/371472 [51:09<30:04:37,  3.33it/s]
  3%|▎         | 10770/371472 [51:09<30:31:15,  3.28it/s]
  3%|▎         | 10771/371472 [51:09<30:13:27,  3.32it/s]
  3%|▎         | 10772/371472 [51:09<29:43:31,  3.37it/s]
  3%|▎         | 10773/371472 [51:10<28:30:42,  3.51it/s]
  3%|▎         | 10774/371472 [51:10<27:17:45,  3.67it/s]
  3%|▎         | 10775/371472 [51:10<30:15:20,  3.31it/s]
  3%|▎         | 10776/371472 [51:11<29:19:39,  3.42it/s]
  3%|▎         | 10777/371472 [51:11<28:21:58,  3.53it/s]
  3%|▎         | 10778/371472 [51:11<27:45:30,  3.61it/s]
  3%|▎         | 10779/371472 [51:11<27:02:42,  3.70it/s]
  3%|▎         | 10780/371472 [51:12<27:10:54,  3.69it/s]
                                                         
{'loss': 4.5919, 'learning_rate': 9.74353034971665e-07, 'epoch': 0.46}

  3%|▎         | 10780/371472 [51:12<27:10:54,  3.69it/s]
  3%|▎         | 10781/371472 [51:12<27:41:50,  3.62it/s]
  3%|▎         | 10782/371472 [51:12<27:37:38,  3.63it/s]
  3%|▎         | 10783/371472 [51:12<28:14:56,  3.55it/s]
  3%|▎         | 10784/371472 [51:13<28:03:33,  3.57it/s]
  3%|▎         | 10785/371472 [51:13<27:12:48,  3.68it/s]
  3%|▎         | 10786/371472 [51:13<26:13:28,  3.82it/s]
  3%|▎         | 10787/371472 [51:14<26:58:23,  3.71it/s]
  3%|▎         | 10788/371472 [51:14<27:47:30,  3.61it/s]
  3%|▎         | 10789/371472 [51:14<27:05:42,  3.70it/s]
  3%|▎         | 10790/371472 [51:14<26:53:12,  3.73it/s]
  3%|▎         | 10791/371472 [51:15<26:53:51,  3.72it/s]
  3%|▎         | 10792/371472 [51:15<27:41:32,  3.62it/s]
  3%|▎         | 10793/371472 [51:15<27:39:12,  3.62it/s]
  3%|▎         | 10794/371472 [51:15<27:45:44,  3.61it/s]
  3%|▎         | 10795/371472 [51:16<26:39:02,  3.76it/s]
  3%|▎         | 10796/371472 [51:16<27:03:37,  3.70it/s]
  3%|▎         | 10797/371472 [51:16<28:29:38,  3.52it/s]
  3%|▎         | 10798/371472 [51:17<28:36:47,  3.50it/s]
  3%|▎         | 10799/371472 [51:17<30:24:08,  3.30it/s]
  3%|▎         | 10800/371472 [51:17<29:40:03,  3.38it/s]
                                                         
{'loss': 4.8487, 'learning_rate': 9.74304552996186e-07, 'epoch': 0.47}

  3%|▎         | 10800/371472 [51:17<29:40:03,  3.38it/s]
  3%|▎         | 10801/371472 [51:18<30:24:59,  3.29it/s]
  3%|▎         | 10802/371472 [51:18<29:02:48,  3.45it/s]
  3%|▎         | 10803/371472 [51:18<30:18:17,  3.31it/s]
  3%|▎         | 10804/371472 [51:18<30:37:23,  3.27it/s]
  3%|▎         | 10805/371472 [51:19<28:58:51,  3.46it/s]
  3%|▎         | 10806/371472 [51:19<29:06:54,  3.44it/s]
  3%|▎         | 10807/371472 [51:19<28:50:38,  3.47it/s]
  3%|▎         | 10808/371472 [51:20<29:29:01,  3.40it/s]
  3%|▎         | 10809/371472 [51:20<29:13:58,  3.43it/s]
  3%|▎         | 10810/371472 [51:20<27:34:09,  3.63it/s]
  3%|▎         | 10811/371472 [51:20<27:16:18,  3.67it/s]
  3%|▎         | 10812/371472 [51:21<26:19:15,  3.81it/s]
  3%|▎         | 10813/371472 [51:21<28:59:32,  3.46it/s]
  3%|▎         | 10814/371472 [51:21<27:52:40,  3.59it/s]
  3%|▎         | 10815/371472 [51:21<29:07:00,  3.44it/s]
  3%|▎         | 10816/371472 [51:22<29:39:23,  3.38it/s]
  3%|▎         | 10817/371472 [51:22<28:52:07,  3.47it/s]
  3%|▎         | 10818/371472 [51:22<27:59:38,  3.58it/s]
  3%|▎         | 10819/371472 [51:23<27:06:05,  3.70it/s]
  3%|▎         | 10820/371472 [51:23<27:06:16,  3.70it/s]
                                                         
{'loss': 4.4517, 'learning_rate': 9.742560710207071e-07, 'epoch': 0.47}

  3%|▎         | 10820/371472 [51:23<27:06:16,  3.70it/s]
  3%|▎         | 10821/371472 [51:23<26:31:29,  3.78it/s]
  3%|▎         | 10822/371472 [51:23<26:18:41,  3.81it/s]
  3%|▎         | 10823/371472 [51:24<26:02:50,  3.85it/s]
  3%|▎         | 10824/371472 [51:24<25:42:21,  3.90it/s]
  3%|▎         | 10825/371472 [51:24<26:19:51,  3.80it/s]
  3%|▎         | 10826/371472 [51:24<25:53:39,  3.87it/s]
  3%|▎         | 10827/371472 [51:25<25:42:46,  3.90it/s]
  3%|▎         | 10828/371472 [51:25<26:49:16,  3.74it/s]
  3%|▎         | 10829/371472 [51:25<27:35:47,  3.63it/s]
  3%|▎         | 10830/371472 [51:25<26:50:56,  3.73it/s]
  3%|▎         | 10831/371472 [51:26<26:01:02,  3.85it/s]
  3%|▎         | 10832/371472 [51:26<26:15:51,  3.81it/s]
  3%|▎         | 10833/371472 [51:26<27:12:10,  3.68it/s]
  3%|▎         | 10834/371472 [51:27<30:51:46,  3.25it/s]
  3%|▎         | 10835/371472 [51:27<30:18:51,  3.30it/s]
  3%|▎         | 10836/371472 [51:27<30:31:49,  3.28it/s]
  3%|▎         | 10837/371472 [51:28<29:36:54,  3.38it/s]
  3%|▎         | 10838/371472 [51:28<28:53:38,  3.47it/s]
  3%|▎         | 10839/371472 [51:28<27:27:28,  3.65it/s]
  3%|▎         | 10840/371472 [51:28<28:58:15,  3.46it/s]
                                                         
{'loss': 4.8589, 'learning_rate': 9.742075890452282e-07, 'epoch': 0.47}

  3%|▎         | 10840/371472 [51:28<28:58:15,  3.46it/s]
  3%|▎         | 10841/371472 [51:29<27:52:32,  3.59it/s]
  3%|▎         | 10842/371472 [51:29<26:39:55,  3.76it/s]
  3%|▎         | 10843/371472 [51:29<27:09:52,  3.69it/s]
  3%|▎         | 10844/371472 [51:29<27:23:21,  3.66it/s]
  3%|▎         | 10845/371472 [51:30<27:22:21,  3.66it/s]
  3%|▎         | 10846/371472 [51:30<27:58:21,  3.58it/s]
  3%|▎         | 10847/371472 [51:30<28:05:23,  3.57it/s]
  3%|▎         | 10848/371472 [51:31<28:26:25,  3.52it/s]
  3%|▎         | 10849/371472 [51:31<27:48:33,  3.60it/s]
  3%|▎         | 10850/371472 [51:31<27:19:06,  3.67it/s]
  3%|▎         | 10851/371472 [51:31<26:47:05,  3.74it/s]
  3%|▎         | 10852/371472 [51:32<28:19:16,  3.54it/s]
  3%|▎         | 10853/371472 [51:32<27:21:39,  3.66it/s]
  3%|▎         | 10854/371472 [51:32<28:24:04,  3.53it/s]
  3%|▎         | 10855/371472 [51:33<28:17:39,  3.54it/s]
  3%|▎         | 10856/371472 [51:33<28:06:55,  3.56it/s]
  3%|▎         | 10857/371472 [51:33<27:32:58,  3.64it/s]
  3%|▎         | 10858/371472 [51:33<26:49:28,  3.73it/s]
  3%|▎         | 10859/371472 [51:34<28:33:05,  3.51it/s]
  3%|▎         | 10860/371472 [51:34<29:12:04,  3.43it/s]
                                                         
{'loss': 4.6649, 'learning_rate': 9.741591070697493e-07, 'epoch': 0.47}

  3%|▎         | 10860/371472 [51:34<29:12:04,  3.43it/s]
  3%|▎         | 10861/371472 [51:34<29:10:05,  3.43it/s]
  3%|▎         | 10862/371472 [51:34<28:22:25,  3.53it/s]
  3%|▎         | 10863/371472 [51:35<28:51:54,  3.47it/s]
  3%|▎         | 10864/371472 [51:35<28:55:27,  3.46it/s]
  3%|▎         | 10865/371472 [51:35<28:56:56,  3.46it/s]
  3%|▎         | 10866/371472 [51:36<28:09:06,  3.56it/s]
  3%|▎         | 10867/371472 [51:36<27:42:14,  3.62it/s]
  3%|▎         | 10868/371472 [51:36<28:46:41,  3.48it/s]
  3%|▎         | 10869/371472 [51:36<28:32:19,  3.51it/s]
  3%|▎         | 10870/371472 [51:37<28:08:37,  3.56it/s]
  3%|▎         | 10871/371472 [51:37<31:16:16,  3.20it/s]
  3%|▎         | 10872/371472 [51:37<29:33:26,  3.39it/s]
  3%|▎         | 10873/371472 [51:38<30:20:07,  3.30it/s]
  3%|▎         | 10874/371472 [51:38<29:27:23,  3.40it/s]
  3%|▎         | 10875/371472 [51:38<29:49:59,  3.36it/s]
  3%|▎         | 10876/371472 [51:39<28:14:40,  3.55it/s]
  3%|▎         | 10877/371472 [51:39<28:12:14,  3.55it/s]
  3%|▎         | 10878/371472 [51:39<29:40:38,  3.38it/s]
  3%|▎         | 10879/371472 [51:39<30:09:41,  3.32it/s]
  3%|▎         | 10880/371472 [51:40<29:24:01,  3.41it/s]
                                                         
{'loss': 4.7476, 'learning_rate': 9.741106250942706e-07, 'epoch': 0.47}

  3%|▎         | 10880/371472 [51:40<29:24:01,  3.41it/s]
  3%|▎         | 10881/371472 [51:40<29:37:37,  3.38it/s]
  3%|▎         | 10882/371472 [51:40<28:20:19,  3.53it/s]
  3%|▎         | 10883/371472 [51:41<27:45:09,  3.61it/s]
  3%|▎         | 10884/371472 [51:41<28:07:58,  3.56it/s]
  3%|▎         | 10885/371472 [51:41<27:44:24,  3.61it/s]
  3%|▎         | 10886/371472 [51:41<27:53:30,  3.59it/s]
  3%|▎         | 10887/371472 [51:42<27:36:31,  3.63it/s]
  3%|▎         | 10888/371472 [51:42<27:32:08,  3.64it/s]
  3%|▎         | 10889/371472 [51:42<27:59:49,  3.58it/s]
  3%|▎         | 10890/371472 [51:43<27:51:47,  3.59it/s]
  3%|▎         | 10891/371472 [51:43<28:12:48,  3.55it/s]
  3%|▎         | 10892/371472 [51:43<27:31:27,  3.64it/s]
  3%|▎         | 10893/371472 [51:43<26:50:44,  3.73it/s]
  3%|▎         | 10894/371472 [51:44<27:03:22,  3.70it/s]
  3%|▎         | 10895/371472 [51:44<27:44:02,  3.61it/s]
  3%|▎         | 10896/371472 [51:44<27:19:50,  3.66it/s]
  3%|▎         | 10897/371472 [51:44<27:01:48,  3.71it/s]
  3%|▎         | 10898/371472 [51:45<26:23:07,  3.80it/s]
  3%|▎         | 10899/371472 [51:45<26:18:36,  3.81it/s]
  3%|▎         | 10900/371472 [51:45<26:37:50,  3.76it/s]
                                                         
{'loss': 5.019, 'learning_rate': 9.740621431187916e-07, 'epoch': 0.47}

  3%|▎         | 10900/371472 [51:45<26:37:50,  3.76it/s]
  3%|▎         | 10901/371472 [51:45<26:19:04,  3.81it/s]
  3%|▎         | 10902/371472 [51:46<26:38:13,  3.76it/s]
  3%|▎         | 10903/371472 [51:46<27:09:09,  3.69it/s]
  3%|▎         | 10904/371472 [51:46<28:16:32,  3.54it/s]
  3%|▎         | 10905/371472 [51:47<28:33:48,  3.51it/s]
  3%|▎         | 10906/371472 [51:47<28:05:26,  3.57it/s]
  3%|▎         | 10907/371472 [51:47<28:22:07,  3.53it/s]
  3%|▎         | 10908/371472 [51:47<29:18:32,  3.42it/s]
  3%|▎         | 10909/371472 [51:48<28:14:59,  3.55it/s]
  3%|▎         | 10910/371472 [51:48<27:33:11,  3.64it/s]
  3%|▎         | 10911/371472 [51:48<28:44:21,  3.48it/s]
  3%|▎         | 10912/371472 [51:49<27:34:46,  3.63it/s]
  3%|▎         | 10913/371472 [51:49<28:55:12,  3.46it/s]
  3%|▎         | 10914/371472 [51:49<32:35:40,  3.07it/s]
  3%|▎         | 10915/371472 [51:50<31:04:34,  3.22it/s]
  3%|▎         | 10916/371472 [51:50<30:07:16,  3.33it/s]
  3%|▎         | 10917/371472 [51:50<31:01:58,  3.23it/s]
  3%|▎         | 10918/371472 [51:50<29:09:14,  3.44it/s]
  3%|▎         | 10919/371472 [51:51<28:44:24,  3.48it/s]
  3%|▎         | 10920/371472 [51:51<30:52:04,  3.24it/s]
                                                         
{'loss': 4.7025, 'learning_rate': 9.740136611433127e-07, 'epoch': 0.47}

  3%|▎         | 10920/371472 [51:51<30:52:04,  3.24it/s]
  3%|▎         | 10921/371472 [51:51<30:10:08,  3.32it/s]
  3%|▎         | 10922/371472 [51:52<29:36:02,  3.38it/s]
  3%|▎         | 10923/371472 [51:52<28:39:02,  3.50it/s]
  3%|▎         | 10924/371472 [51:52<31:28:02,  3.18it/s]
  3%|▎         | 10925/371472 [51:53<29:21:33,  3.41it/s]
  3%|▎         | 10926/371472 [51:53<28:43:46,  3.49it/s]
  3%|▎         | 10927/371472 [51:53<27:30:04,  3.64it/s]
  3%|▎         | 10928/371472 [51:53<27:02:15,  3.70it/s]
  3%|▎         | 10929/371472 [51:54<26:33:25,  3.77it/s]
  3%|▎         | 10930/371472 [51:54<25:38:46,  3.91it/s]
  3%|▎         | 10931/371472 [51:54<27:35:42,  3.63it/s]
  3%|▎         | 10932/371472 [51:54<26:58:57,  3.71it/s]
  3%|▎         | 10933/371472 [51:55<26:03:51,  3.84it/s]
  3%|▎         | 10934/371472 [51:55<26:03:00,  3.84it/s]
  3%|▎         | 10935/371472 [51:55<26:47:07,  3.74it/s]
  3%|▎         | 10936/371472 [51:55<26:34:03,  3.77it/s]
  3%|▎         | 10937/371472 [51:56<28:48:37,  3.48it/s]
  3%|▎         | 10938/371472 [51:56<29:38:22,  3.38it/s]
  3%|▎         | 10939/371472 [51:56<29:00:53,  3.45it/s]
  3%|▎         | 10940/371472 [51:57<29:18:41,  3.42it/s]
                                                         
{'loss': 4.8888, 'learning_rate': 9.73965179167834e-07, 'epoch': 0.47}

  3%|▎         | 10940/371472 [51:57<29:18:41,  3.42it/s]
  3%|▎         | 10941/371472 [51:57<30:26:54,  3.29it/s]
  3%|▎         | 10942/371472 [51:57<28:15:35,  3.54it/s]
  3%|▎         | 10943/371472 [51:57<28:39:54,  3.49it/s]
  3%|▎         | 10944/371472 [51:58<28:26:43,  3.52it/s]
  3%|▎         | 10945/371472 [51:58<26:55:59,  3.72it/s]
  3%|▎         | 10946/371472 [51:58<28:12:30,  3.55it/s]
  3%|▎         | 10947/371472 [51:59<27:48:48,  3.60it/s]
  3%|▎         | 10948/371472 [51:59<27:14:35,  3.68it/s]
  3%|▎         | 10949/371472 [51:59<27:43:54,  3.61it/s]
  3%|▎         | 10950/371472 [51:59<29:16:38,  3.42it/s]
  3%|▎         | 10951/371472 [52:00<30:15:48,  3.31it/s]
  3%|▎         | 10952/371472 [52:00<29:01:18,  3.45it/s]
  3%|▎         | 10953/371472 [52:00<29:45:28,  3.37it/s]
  3%|▎         | 10954/371472 [52:01<29:24:13,  3.41it/s]
  3%|▎         | 10955/371472 [52:01<29:50:55,  3.36it/s]
  3%|▎         | 10956/371472 [52:01<29:16:10,  3.42it/s]
  3%|▎         | 10957/371472 [52:01<28:30:31,  3.51it/s]
  3%|▎         | 10958/371472 [52:02<29:16:52,  3.42it/s]
  3%|▎         | 10959/371472 [52:02<27:56:17,  3.58it/s]
  3%|▎         | 10960/371472 [52:02<28:43:19,  3.49it/s]
                                                         
{'loss': 4.9776, 'learning_rate': 9.739166971923548e-07, 'epoch': 0.47}

  3%|▎         | 10960/371472 [52:02<28:43:19,  3.49it/s]
  3%|▎         | 10961/371472 [52:03<28:45:39,  3.48it/s]
  3%|▎         | 10962/371472 [52:03<28:33:10,  3.51it/s]
  3%|▎         | 10963/371472 [52:03<28:38:01,  3.50it/s]
  3%|▎         | 10964/371472 [52:03<28:01:10,  3.57it/s]
  3%|▎         | 10965/371472 [52:04<26:42:13,  3.75it/s]
  3%|▎         | 10966/371472 [52:04<27:00:16,  3.71it/s]
  3%|▎         | 10967/371472 [52:04<27:46:34,  3.61it/s]
  3%|▎         | 10968/371472 [52:05<27:31:16,  3.64it/s]
  3%|▎         | 10969/371472 [52:05<27:06:45,  3.69it/s]
  3%|▎         | 10970/371472 [52:05<27:34:46,  3.63it/s]
  3%|▎         | 10971/371472 [52:05<27:25:42,  3.65it/s]
  3%|▎         | 10972/371472 [52:06<27:22:20,  3.66it/s]
  3%|▎         | 10973/371472 [52:06<27:21:24,  3.66it/s]
  3%|▎         | 10974/371472 [52:06<27:33:55,  3.63it/s]
  3%|▎         | 10975/371472 [52:06<26:38:14,  3.76it/s]
  3%|▎         | 10976/371472 [52:07<28:26:46,  3.52it/s]
  3%|▎         | 10977/371472 [52:07<27:55:29,  3.59it/s]
  3%|▎         | 10978/371472 [52:07<27:46:56,  3.60it/s]
  3%|▎         | 10979/371472 [52:08<28:47:54,  3.48it/s]
  3%|▎         | 10980/371472 [52:08<28:39:36,  3.49it/s]
                                                         
{'loss': 4.5894, 'learning_rate': 9.73868215216876e-07, 'epoch': 0.47}

  3%|▎         | 10980/371472 [52:08<28:39:36,  3.49it/s]
  3%|▎         | 10981/371472 [52:08<29:07:48,  3.44it/s]
  3%|▎         | 10982/371472 [52:09<30:23:47,  3.29it/s]
  3%|▎         | 10983/371472 [52:09<28:56:00,  3.46it/s]
  3%|▎         | 10984/371472 [52:09<28:09:19,  3.56it/s]
  3%|▎         | 10985/371472 [52:09<27:39:09,  3.62it/s]
  3%|▎         | 10986/371472 [52:10<27:53:14,  3.59it/s]
  3%|▎         | 10987/371472 [52:10<27:42:49,  3.61it/s]
  3%|▎         | 10988/371472 [52:10<28:34:14,  3.50it/s]
  3%|▎         | 10989/371472 [52:10<28:00:30,  3.58it/s]
  3%|▎         | 10990/371472 [52:11<28:07:29,  3.56it/s]
  3%|▎         | 10991/371472 [52:11<27:15:16,  3.67it/s]
  3%|▎         | 10992/371472 [52:11<27:54:00,  3.59it/s]
  3%|▎         | 10993/371472 [52:12<27:51:25,  3.59it/s]
  3%|▎         | 10994/371472 [52:12<28:01:34,  3.57it/s]
  3%|▎         | 10995/371472 [52:12<27:59:32,  3.58it/s]
  3%|▎         | 10996/371472 [52:12<27:10:29,  3.68it/s]
  3%|▎         | 10997/371472 [52:13<28:13:40,  3.55it/s]
  3%|▎         | 10998/371472 [52:13<27:57:41,  3.58it/s]
  3%|▎         | 10999/371472 [52:13<27:04:32,  3.70it/s]
  3%|▎         | 11000/371472 [52:13<27:43:15,  3.61it/s]
                                                         
{'loss': 4.925, 'learning_rate': 9.73819733241397e-07, 'epoch': 0.47}

  3%|▎         | 11000/371472 [52:13<27:43:15,  3.61it/s]
  3%|▎         | 11001/371472 [52:14<28:08:12,  3.56it/s]
  3%|▎         | 11002/371472 [52:14<29:51:27,  3.35it/s]
  3%|▎         | 11003/371472 [52:14<28:48:24,  3.48it/s]
  3%|▎         | 11004/371472 [52:15<28:10:40,  3.55it/s]
  3%|▎         | 11005/371472 [52:15<28:55:25,  3.46it/s]
  3%|▎         | 11006/371472 [52:15<28:14:57,  3.54it/s]
  3%|▎         | 11007/371472 [52:15<26:54:23,  3.72it/s]
  3%|▎         | 11008/371472 [52:16<26:52:41,  3.73it/s]
  3%|▎         | 11009/371472 [52:16<27:42:41,  3.61it/s]
  3%|▎         | 11010/371472 [52:16<27:34:37,  3.63it/s]
  3%|▎         | 11011/371472 [52:17<29:54:18,  3.35it/s]
  3%|▎         | 11012/371472 [52:17<29:09:11,  3.43it/s]
  3%|▎         | 11013/371472 [52:17<29:07:33,  3.44it/s]
  3%|▎         | 11014/371472 [52:17<27:45:05,  3.61it/s]
  3%|▎         | 11015/371472 [52:18<28:06:59,  3.56it/s]
  3%|▎         | 11016/371472 [52:18<29:48:38,  3.36it/s]
  3%|▎         | 11017/371472 [52:18<29:59:02,  3.34it/s]
  3%|▎         | 11018/371472 [52:19<29:33:54,  3.39it/s]
  3%|▎         | 11019/371472 [52:19<29:35:00,  3.38it/s]
  3%|▎         | 11020/371472 [52:19<29:13:04,  3.43it/s]
                                                         
{'loss': 4.7209, 'learning_rate': 9.737712512659183e-07, 'epoch': 0.47}

  3%|▎         | 11020/371472 [52:19<29:13:04,  3.43it/s]
  3%|▎         | 11021/371472 [52:20<29:20:27,  3.41it/s]
  3%|▎         | 11022/371472 [52:20<31:37:41,  3.17it/s]
  3%|▎         | 11023/371472 [52:20<30:22:14,  3.30it/s]
  3%|▎         | 11024/371472 [52:20<28:59:30,  3.45it/s]
  3%|▎         | 11025/371472 [52:21<32:32:09,  3.08it/s]
  3%|▎         | 11026/371472 [52:21<34:01:43,  2.94it/s]
  3%|▎         | 11027/371472 [52:22<32:41:40,  3.06it/s]
  3%|▎         | 11028/371472 [52:22<30:14:15,  3.31it/s]
  3%|▎         | 11029/371472 [52:22<33:24:25,  3.00it/s]
  3%|▎         | 11030/371472 [52:22<32:10:24,  3.11it/s]
  3%|▎         | 11031/371472 [52:23<31:08:20,  3.22it/s]
  3%|▎         | 11032/371472 [52:23<30:16:34,  3.31it/s]
  3%|▎         | 11033/371472 [52:23<29:13:12,  3.43it/s]
  3%|▎         | 11034/371472 [52:24<29:29:48,  3.39it/s]
  3%|▎         | 11035/371472 [52:24<28:41:46,  3.49it/s]
  3%|▎         | 11036/371472 [52:24<28:00:49,  3.57it/s]
  3%|▎         | 11037/371472 [52:25<30:41:59,  3.26it/s]
  3%|▎         | 11038/371472 [52:25<28:44:57,  3.48it/s]
  3%|▎         | 11039/371472 [52:25<28:20:01,  3.53it/s]
  3%|▎         | 11040/371472 [52:25<27:36:54,  3.63it/s]
                                                         
{'loss': 4.6565, 'learning_rate': 9.737227692904393e-07, 'epoch': 0.48}

  3%|▎         | 11040/371472 [52:25<27:36:54,  3.63it/s]
  3%|▎         | 11041/371472 [52:26<27:58:22,  3.58it/s]
  3%|▎         | 11042/371472 [52:26<29:19:43,  3.41it/s]
  3%|▎         | 11043/371472 [52:26<28:57:14,  3.46it/s]
  3%|▎         | 11044/371472 [52:26<27:52:51,  3.59it/s]
  3%|▎         | 11045/371472 [52:27<28:00:07,  3.58it/s]
  3%|▎         | 11046/371472 [52:27<30:20:12,  3.30it/s]
  3%|▎         | 11047/371472 [52:27<29:21:26,  3.41it/s]
  3%|▎         | 11048/371472 [52:28<29:16:04,  3.42it/s]
  3%|▎         | 11049/371472 [52:28<29:57:21,  3.34it/s]
  3%|▎         | 11050/371472 [52:28<29:53:41,  3.35it/s]
  3%|▎         | 11051/371472 [52:29<28:50:20,  3.47it/s]
  3%|▎         | 11052/371472 [52:29<28:33:16,  3.51it/s]
  3%|▎         | 11053/371472 [52:29<27:14:15,  3.68it/s]
  3%|▎         | 11054/371472 [52:29<26:57:11,  3.71it/s]
  3%|▎         | 11055/371472 [52:30<28:42:17,  3.49it/s]
  3%|▎         | 11056/371472 [52:30<28:03:29,  3.57it/s]
  3%|▎         | 11057/371472 [52:30<29:18:05,  3.42it/s]
  3%|▎         | 11058/371472 [52:30<28:36:37,  3.50it/s]
  3%|▎         | 11059/371472 [52:31<27:51:47,  3.59it/s]
  3%|▎         | 11060/371472 [52:31<27:34:32,  3.63it/s]
                                                         
{'loss': 4.6889, 'learning_rate': 9.736742873149604e-07, 'epoch': 0.48}

  3%|▎         | 11060/371472 [52:31<27:34:32,  3.63it/s]
  3%|▎         | 11061/371472 [52:31<30:13:53,  3.31it/s]
  3%|▎         | 11062/371472 [52:32<31:22:57,  3.19it/s]
  3%|▎         | 11063/371472 [52:32<30:09:30,  3.32it/s]
  3%|▎         | 11064/371472 [52:32<28:57:00,  3.46it/s]
  3%|▎         | 11065/371472 [52:32<27:28:58,  3.64it/s]
  3%|▎         | 11066/371472 [52:33<28:00:15,  3.57it/s]
  3%|▎         | 11067/371472 [52:33<28:26:33,  3.52it/s]
  3%|▎         | 11068/371472 [52:33<28:14:40,  3.54it/s]
  3%|▎         | 11069/371472 [52:34<29:39:06,  3.38it/s]
  3%|▎         | 11070/371472 [52:34<29:32:42,  3.39it/s]
  3%|▎         | 11071/371472 [52:34<29:00:45,  3.45it/s]
  3%|▎         | 11072/371472 [52:35<28:16:10,  3.54it/s]
  3%|▎         | 11073/371472 [52:35<37:06:02,  2.70it/s]
  3%|▎         | 11074/371472 [52:35<35:18:03,  2.84it/s]
  3%|▎         | 11075/371472 [52:36<32:46:45,  3.05it/s]
  3%|▎         | 11076/371472 [52:36<32:04:53,  3.12it/s]
  3%|▎         | 11077/371472 [52:36<30:34:48,  3.27it/s]
  3%|▎         | 11078/371472 [52:37<29:21:13,  3.41it/s]
  3%|▎         | 11079/371472 [52:37<29:42:07,  3.37it/s]
  3%|▎         | 11080/371472 [52:37<29:35:49,  3.38it/s]
                                                         
{'loss': 4.462, 'learning_rate': 9.736258053394815e-07, 'epoch': 0.48}

  3%|▎         | 11080/371472 [52:37<29:35:49,  3.38it/s]
  3%|▎         | 11081/371472 [52:37<30:29:29,  3.28it/s]
  3%|▎         | 11082/371472 [52:38<28:33:50,  3.50it/s]
  3%|▎         | 11083/371472 [52:38<27:25:43,  3.65it/s]
  3%|▎         | 11084/371472 [52:38<27:54:21,  3.59it/s]
  3%|▎         | 11085/371472 [52:38<28:06:42,  3.56it/s]
  3%|▎         | 11086/371472 [52:39<27:44:40,  3.61it/s]
  3%|▎         | 11087/371472 [52:39<28:40:04,  3.49it/s]
  3%|▎         | 11088/371472 [52:39<28:24:32,  3.52it/s]
  3%|▎         | 11089/371472 [52:40<28:01:52,  3.57it/s]
  3%|▎         | 11090/371472 [52:40<27:53:25,  3.59it/s]
  3%|▎         | 11091/371472 [52:40<27:18:07,  3.67it/s]
  3%|▎         | 11092/371472 [52:40<28:26:10,  3.52it/s]
  3%|▎         | 11093/371472 [52:41<32:05:02,  3.12it/s]
  3%|▎         | 11094/371472 [52:41<30:11:09,  3.32it/s]
  3%|▎         | 11095/371472 [52:41<29:11:56,  3.43it/s]
  3%|▎         | 11096/371472 [52:42<28:16:03,  3.54it/s]
  3%|▎         | 11097/371472 [52:42<27:41:11,  3.62it/s]
  3%|▎         | 11098/371472 [52:42<27:10:52,  3.68it/s]
  3%|▎         | 11099/371472 [52:42<27:05:50,  3.69it/s]
  3%|▎         | 11100/371472 [52:43<25:57:13,  3.86it/s]
                                                         
{'loss': 4.6663, 'learning_rate': 9.735773233640026e-07, 'epoch': 0.48}

  3%|▎         | 11100/371472 [52:43<25:57:13,  3.86it/s]
  3%|▎         | 11101/371472 [52:43<25:21:10,  3.95it/s]
  3%|▎         | 11102/371472 [52:43<26:55:47,  3.72it/s]
  3%|▎         | 11103/371472 [52:43<26:07:58,  3.83it/s]
  3%|▎         | 11104/371472 [52:44<26:04:35,  3.84it/s]
  3%|▎         | 11105/371472 [52:44<26:26:16,  3.79it/s]
  3%|▎         | 11106/371472 [52:44<26:12:04,  3.82it/s]
  3%|▎         | 11107/371472 [52:45<25:54:05,  3.86it/s]
  3%|▎         | 11108/371472 [52:45<25:13:24,  3.97it/s]
  3%|▎         | 11109/371472 [52:45<26:21:13,  3.80it/s]
  3%|▎         | 11110/371472 [52:45<27:52:50,  3.59it/s]
  3%|▎         | 11111/371472 [52:46<27:58:21,  3.58it/s]
  3%|▎         | 11112/371472 [52:46<27:30:45,  3.64it/s]
  3%|▎         | 11113/371472 [52:46<27:50:07,  3.60it/s]
  3%|▎         | 11114/371472 [52:46<28:42:41,  3.49it/s]
  3%|▎         | 11115/371472 [52:47<29:13:23,  3.43it/s]
  3%|▎         | 11116/371472 [52:47<27:49:25,  3.60it/s]
  3%|▎         | 11117/371472 [52:47<26:31:05,  3.77it/s]
  3%|▎         | 11118/371472 [52:48<26:53:44,  3.72it/s]
  3%|▎         | 11119/371472 [52:48<26:06:30,  3.83it/s]
  3%|▎         | 11120/371472 [52:48<25:56:06,  3.86it/s]
                                                         
{'loss': 4.8906, 'learning_rate': 9.735288413885238e-07, 'epoch': 0.48}

  3%|▎         | 11120/371472 [52:48<25:56:06,  3.86it/s]
  3%|▎         | 11121/371472 [52:48<26:08:20,  3.83it/s]
  3%|▎         | 11122/371472 [52:49<25:32:14,  3.92it/s]
  3%|▎         | 11123/371472 [52:49<27:19:43,  3.66it/s]
  3%|▎         | 11124/371472 [52:49<29:10:12,  3.43it/s]
  3%|▎         | 11125/371472 [52:49<27:32:45,  3.63it/s]
  3%|▎         | 11126/371472 [52:50<27:14:55,  3.67it/s]
  3%|▎         | 11127/371472 [52:50<26:04:51,  3.84it/s]
  3%|▎         | 11128/371472 [52:50<27:38:50,  3.62it/s]
  3%|▎         | 11129/371472 [52:51<28:45:54,  3.48it/s]
  3%|▎         | 11130/371472 [52:51<29:27:39,  3.40it/s]
  3%|▎         | 11131/371472 [52:51<27:48:47,  3.60it/s]
  3%|▎         | 11132/371472 [52:51<26:41:04,  3.75it/s]
  3%|▎         | 11133/371472 [52:52<25:54:40,  3.86it/s]
  3%|▎         | 11134/371472 [52:52<25:27:57,  3.93it/s]
  3%|▎         | 11135/371472 [52:52<26:08:58,  3.83it/s]
  3%|▎         | 11136/371472 [52:52<26:35:25,  3.76it/s]
  3%|▎         | 11137/371472 [52:53<26:20:47,  3.80it/s]
  3%|▎         | 11138/371472 [52:53<26:15:57,  3.81it/s]
  3%|▎         | 11139/371472 [52:53<27:34:17,  3.63it/s]
  3%|▎         | 11140/371472 [52:54<28:57:58,  3.46it/s]
                                                         
{'loss': 5.0451, 'learning_rate': 9.734803594130447e-07, 'epoch': 0.48}

  3%|▎         | 11140/371472 [52:54<28:57:58,  3.46it/s]
  3%|▎         | 11141/371472 [52:54<29:09:36,  3.43it/s]
  3%|▎         | 11142/371472 [52:54<28:39:32,  3.49it/s]
  3%|▎         | 11143/371472 [52:54<28:55:53,  3.46it/s]
  3%|▎         | 11144/371472 [52:55<27:32:13,  3.63it/s]
  3%|▎         | 11145/371472 [52:55<28:44:34,  3.48it/s]
  3%|▎         | 11146/371472 [52:55<28:11:43,  3.55it/s]
  3%|▎         | 11147/371472 [52:55<27:05:42,  3.69it/s]
  3%|▎         | 11148/371472 [52:56<26:16:54,  3.81it/s]
  3%|▎         | 11149/371472 [52:56<28:14:09,  3.54it/s]
  3%|▎         | 11150/371472 [52:56<27:33:22,  3.63it/s]
  3%|▎         | 11151/371472 [52:57<26:42:06,  3.75it/s]
  3%|▎         | 11152/371472 [52:57<26:05:43,  3.84it/s]
  3%|▎         | 11153/371472 [52:57<25:28:57,  3.93it/s]
  3%|▎         | 11154/371472 [52:57<27:27:17,  3.65it/s]
  3%|▎         | 11155/371472 [52:58<26:43:24,  3.75it/s]
  3%|▎         | 11156/371472 [52:58<27:16:26,  3.67it/s]
  3%|▎         | 11157/371472 [52:58<27:35:17,  3.63it/s]
  3%|▎         | 11158/371472 [52:58<26:28:30,  3.78it/s]
  3%|▎         | 11159/371472 [52:59<25:52:21,  3.87it/s]
  3%|▎         | 11160/371472 [52:59<26:19:34,  3.80it/s]
                                                         
{'loss': 4.7728, 'learning_rate': 9.73431877437566e-07, 'epoch': 0.48}

  3%|▎         | 11160/371472 [52:59<26:19:34,  3.80it/s]
  3%|▎         | 11161/371472 [52:59<25:48:39,  3.88it/s]
  3%|▎         | 11162/371472 [52:59<25:37:38,  3.91it/s]
  3%|▎         | 11163/371472 [53:00<25:21:28,  3.95it/s]
  3%|▎         | 11164/371472 [53:00<26:03:57,  3.84it/s]
  3%|▎         | 11165/371472 [53:00<25:41:46,  3.89it/s]
  3%|▎         | 11166/371472 [53:01<27:10:11,  3.68it/s]
  3%|▎         | 11167/371472 [53:01<29:33:23,  3.39it/s]
  3%|▎         | 11168/371472 [53:01<28:47:57,  3.48it/s]
  3%|▎         | 11169/371472 [53:01<28:37:30,  3.50it/s]
  3%|▎         | 11170/371472 [53:02<27:45:59,  3.60it/s]
  3%|▎         | 11171/371472 [53:02<26:47:09,  3.74it/s]
  3%|▎         | 11172/371472 [53:02<28:42:41,  3.49it/s]
  3%|▎         | 11173/371472 [53:03<29:13:46,  3.42it/s]
  3%|▎         | 11174/371472 [53:03<27:59:14,  3.58it/s]
  3%|▎         | 11175/371472 [53:03<27:55:37,  3.58it/s]
  3%|▎         | 11176/371472 [53:03<28:33:17,  3.50it/s]
  3%|▎         | 11177/371472 [53:04<29:20:42,  3.41it/s]
  3%|▎         | 11178/371472 [53:04<29:18:25,  3.41it/s]
  3%|▎         | 11179/371472 [53:04<28:24:40,  3.52it/s]
  3%|▎         | 11180/371472 [53:05<28:02:12,  3.57it/s]
                                                         
{'loss': 4.6112, 'learning_rate': 9.73383395462087e-07, 'epoch': 0.48}

  3%|▎         | 11180/371472 [53:05<28:02:12,  3.57it/s]
  3%|▎         | 11181/371472 [53:05<26:29:27,  3.78it/s]
  3%|▎         | 11182/371472 [53:05<26:41:01,  3.75it/s]
  3%|▎         | 11183/371472 [53:05<28:21:57,  3.53it/s]
  3%|▎         | 11184/371472 [53:06<27:39:28,  3.62it/s]
  3%|▎         | 11185/371472 [53:06<29:21:48,  3.41it/s]
  3%|▎         | 11186/371472 [53:06<28:50:20,  3.47it/s]
  3%|▎         | 11187/371472 [53:06<27:19:15,  3.66it/s]
  3%|▎         | 11188/371472 [53:07<29:30:17,  3.39it/s]
  3%|▎         | 11189/371472 [53:07<30:53:13,  3.24it/s]
  3%|▎         | 11190/371472 [53:07<30:05:26,  3.33it/s]
  3%|▎         | 11191/371472 [53:08<31:13:34,  3.20it/s]
  3%|▎         | 11192/371472 [53:08<30:39:44,  3.26it/s]
  3%|▎         | 11193/371472 [53:08<29:53:18,  3.35it/s]
  3%|▎         | 11194/371472 [53:09<30:45:38,  3.25it/s]
  3%|▎         | 11195/371472 [53:09<29:05:09,  3.44it/s]
  3%|▎         | 11196/371472 [53:09<31:28:39,  3.18it/s]
  3%|▎         | 11197/371472 [53:10<29:46:34,  3.36it/s]
  3%|▎         | 11198/371472 [53:10<31:34:35,  3.17it/s]
  3%|▎         | 11199/371472 [53:10<30:27:35,  3.29it/s]
  3%|▎         | 11200/371472 [53:10<30:02:04,  3.33it/s]
                                                         
{'loss': 4.7198, 'learning_rate': 9.733349134866081e-07, 'epoch': 0.48}

  3%|▎         | 11200/371472 [53:10<30:02:04,  3.33it/s]
  3%|▎         | 11201/371472 [53:11<28:38:34,  3.49it/s]
  3%|▎         | 11202/371472 [53:11<28:43:04,  3.48it/s]
  3%|▎         | 11203/371472 [53:11<28:35:57,  3.50it/s]
  3%|▎         | 11204/371472 [53:12<27:48:57,  3.60it/s]
  3%|▎         | 11205/371472 [53:12<28:41:03,  3.49it/s]
  3%|▎         | 11206/371472 [53:12<27:25:06,  3.65it/s]
  3%|▎         | 11207/371472 [53:12<26:55:40,  3.72it/s]
  3%|▎         | 11208/371472 [53:13<26:38:34,  3.76it/s]
  3%|▎         | 11209/371472 [53:13<26:46:38,  3.74it/s]
  3%|▎         | 11210/371472 [53:13<26:30:14,  3.78it/s]
  3%|▎         | 11211/371472 [53:13<28:29:12,  3.51it/s]
  3%|▎         | 11212/371472 [53:14<27:14:05,  3.67it/s]
  3%|▎         | 11213/371472 [53:14<28:16:37,  3.54it/s]
  3%|▎         | 11214/371472 [53:14<28:00:52,  3.57it/s]
  3%|▎         | 11215/371472 [53:15<27:02:07,  3.70it/s]
  3%|▎         | 11216/371472 [53:15<26:50:44,  3.73it/s]
  3%|▎         | 11217/371472 [53:15<27:17:10,  3.67it/s]
  3%|▎         | 11218/371472 [53:15<28:05:51,  3.56it/s]
  3%|▎         | 11219/371472 [53:16<26:46:28,  3.74it/s]
  3%|▎         | 11220/371472 [53:16<28:46:45,  3.48it/s]
                                                         
{'loss': 4.5283, 'learning_rate': 9.732864315111292e-07, 'epoch': 0.48}

  3%|▎         | 11220/371472 [53:16<28:46:45,  3.48it/s]
  3%|▎         | 11221/371472 [53:16<29:10:25,  3.43it/s]
  3%|▎         | 11222/371472 [53:17<29:00:44,  3.45it/s]
  3%|▎         | 11223/371472 [53:17<27:30:03,  3.64it/s]
  3%|▎         | 11224/371472 [53:17<27:11:06,  3.68it/s]
  3%|▎         | 11225/371472 [53:17<26:50:02,  3.73it/s]
  3%|▎         | 11226/371472 [53:18<27:33:37,  3.63it/s]
  3%|▎         | 11227/371472 [53:18<27:15:40,  3.67it/s]
  3%|▎         | 11228/371472 [53:18<28:14:25,  3.54it/s]
  3%|▎         | 11229/371472 [53:18<27:33:17,  3.63it/s]
  3%|▎         | 11230/371472 [53:19<27:47:10,  3.60it/s]
  3%|▎         | 11231/371472 [53:19<28:14:38,  3.54it/s]
  3%|▎         | 11232/371472 [53:19<28:21:13,  3.53it/s]
  3%|▎         | 11233/371472 [53:20<28:57:37,  3.46it/s]
  3%|▎         | 11234/371472 [53:20<29:57:19,  3.34it/s]
  3%|▎         | 11235/371472 [53:20<29:46:21,  3.36it/s]
  3%|▎         | 11236/371472 [53:20<28:58:38,  3.45it/s]
  3%|▎         | 11237/371472 [53:21<28:37:51,  3.49it/s]
  3%|▎         | 11238/371472 [53:21<28:32:17,  3.51it/s]
  3%|▎         | 11239/371472 [53:21<27:19:38,  3.66it/s]
  3%|▎         | 11240/371472 [53:22<26:44:38,  3.74it/s]
                                                         
{'loss': 4.6935, 'learning_rate': 9.732379495356503e-07, 'epoch': 0.48}

  3%|▎         | 11240/371472 [53:22<26:44:38,  3.74it/s]
  3%|▎         | 11241/371472 [53:22<26:39:17,  3.75it/s]
  3%|▎         | 11242/371472 [53:22<27:15:49,  3.67it/s]
  3%|▎         | 11243/371472 [53:22<26:44:21,  3.74it/s]
  3%|▎         | 11244/371472 [53:23<26:29:51,  3.78it/s]
  3%|▎         | 11245/371472 [53:23<26:01:40,  3.84it/s]
  3%|▎         | 11246/371472 [53:23<26:30:41,  3.77it/s]
  3%|▎         | 11247/371472 [53:23<26:25:59,  3.79it/s]
  3%|▎         | 11248/371472 [53:24<26:48:51,  3.73it/s]
  3%|▎         | 11249/371472 [53:24<26:36:07,  3.76it/s]
  3%|▎         | 11250/371472 [53:24<26:27:55,  3.78it/s]
  3%|▎         | 11251/371472 [53:24<25:51:43,  3.87it/s]
  3%|▎         | 11252/371472 [53:25<26:29:46,  3.78it/s]
  3%|▎         | 11253/371472 [53:25<26:07:16,  3.83it/s]
  3%|▎         | 11254/371472 [53:25<25:51:35,  3.87it/s]
  3%|▎         | 11255/371472 [53:26<27:10:44,  3.68it/s]
  3%|▎         | 11256/371472 [53:26<27:24:13,  3.65it/s]
  3%|▎         | 11257/371472 [53:26<26:54:40,  3.72it/s]
  3%|▎         | 11258/371472 [53:26<27:14:42,  3.67it/s]
  3%|▎         | 11259/371472 [53:27<28:27:42,  3.52it/s]
  3%|▎         | 11260/371472 [53:27<29:48:55,  3.36it/s]
                                                         
{'loss': 4.8756, 'learning_rate': 9.731894675601715e-07, 'epoch': 0.48}

  3%|▎         | 11260/371472 [53:27<29:48:55,  3.36it/s]
  3%|▎         | 11261/371472 [53:27<28:17:57,  3.54it/s]
  3%|▎         | 11262/371472 [53:28<28:55:01,  3.46it/s]
  3%|▎         | 11263/371472 [53:28<27:40:25,  3.62it/s]
  3%|▎         | 11264/371472 [53:28<27:39:57,  3.62it/s]
  3%|▎         | 11265/371472 [53:28<27:02:54,  3.70it/s]
  3%|▎         | 11266/371472 [53:29<28:29:47,  3.51it/s]
  3%|▎         | 11267/371472 [53:29<28:20:16,  3.53it/s]
  3%|▎         | 11268/371472 [53:29<27:25:30,  3.65it/s]
  3%|▎         | 11269/371472 [53:29<28:39:58,  3.49it/s]
  3%|▎         | 11270/371472 [53:30<27:06:11,  3.69it/s]
  3%|▎         | 11271/371472 [53:30<27:11:48,  3.68it/s]
  3%|▎         | 11272/371472 [53:30<25:46:24,  3.88it/s]
  3%|▎         | 11273/371472 [53:31<27:25:16,  3.65it/s]
  3%|▎         | 11274/371472 [53:31<26:28:02,  3.78it/s]
  3%|▎         | 11275/371472 [53:31<27:22:34,  3.65it/s]
  3%|▎         | 11276/371472 [53:31<27:01:29,  3.70it/s]
  3%|▎         | 11277/371472 [53:32<26:52:35,  3.72it/s]
  3%|▎         | 11278/371472 [53:32<26:12:40,  3.82it/s]
  3%|▎         | 11279/371472 [53:32<26:11:37,  3.82it/s]
  3%|▎         | 11280/371472 [53:32<26:55:52,  3.72it/s]
                                                         
{'loss': 4.7816, 'learning_rate': 9.731409855846926e-07, 'epoch': 0.49}

  3%|▎         | 11280/371472 [53:32<26:55:52,  3.72it/s]
  3%|▎         | 11281/371472 [53:33<26:32:24,  3.77it/s]
  3%|▎         | 11282/371472 [53:33<27:19:24,  3.66it/s]
  3%|▎         | 11283/371472 [53:33<26:24:08,  3.79it/s]
  3%|▎         | 11284/371472 [53:33<26:38:50,  3.75it/s]
  3%|▎         | 11285/371472 [53:34<26:51:17,  3.73it/s]
  3%|▎         | 11286/371472 [53:34<26:04:43,  3.84it/s]
  3%|▎         | 11287/371472 [53:34<28:57:41,  3.45it/s]
  3%|▎         | 11288/371472 [53:35<29:35:20,  3.38it/s]
  3%|▎         | 11289/371472 [53:35<32:01:15,  3.12it/s]
  3%|▎         | 11290/371472 [53:35<31:14:03,  3.20it/s]
  3%|▎         | 11291/371472 [53:36<31:28:04,  3.18it/s]
  3%|▎         | 11292/371472 [53:36<30:00:01,  3.33it/s]
  3%|▎         | 11293/371472 [53:36<28:34:18,  3.50it/s]
  3%|▎         | 11294/371472 [53:36<28:18:46,  3.53it/s]
  3%|▎         | 11295/371472 [53:37<28:53:09,  3.46it/s]
  3%|▎         | 11296/371472 [53:37<29:09:01,  3.43it/s]
  3%|▎         | 11297/371472 [53:37<27:07:05,  3.69it/s]
  3%|▎         | 11298/371472 [53:38<27:22:59,  3.65it/s]
  3%|▎         | 11299/371472 [53:38<26:19:56,  3.80it/s]
  3%|▎         | 11300/371472 [53:38<26:11:13,  3.82it/s]
                                                         
{'loss': 4.6481, 'learning_rate': 9.730925036092137e-07, 'epoch': 0.49}

  3%|▎         | 11300/371472 [53:38<26:11:13,  3.82it/s]
  3%|▎         | 11301/371472 [53:38<27:59:24,  3.57it/s]
  3%|▎         | 11302/371472 [53:39<27:27:46,  3.64it/s]
  3%|▎         | 11303/371472 [53:39<28:15:14,  3.54it/s]
  3%|▎         | 11304/371472 [53:39<27:44:10,  3.61it/s]
  3%|▎         | 11305/371472 [53:39<27:46:05,  3.60it/s]
  3%|▎         | 11306/371472 [53:40<28:11:10,  3.55it/s]
  3%|▎         | 11307/371472 [53:40<27:36:30,  3.62it/s]
  3%|▎         | 11308/371472 [53:40<30:02:25,  3.33it/s]
  3%|▎         | 11309/371472 [53:41<31:01:00,  3.23it/s]
  3%|▎         | 11310/371472 [53:41<28:52:46,  3.46it/s]
  3%|▎         | 11311/371472 [53:41<28:26:07,  3.52it/s]
  3%|▎         | 11312/371472 [53:41<28:09:31,  3.55it/s]
  3%|▎         | 11313/371472 [53:42<29:19:10,  3.41it/s]
  3%|▎         | 11314/371472 [53:42<28:23:20,  3.52it/s]
  3%|▎         | 11315/371472 [53:42<27:32:52,  3.63it/s]
  3%|▎         | 11316/371472 [53:43<29:02:28,  3.44it/s]
  3%|▎         | 11317/371472 [53:43<28:07:03,  3.56it/s]
  3%|▎         | 11318/371472 [53:43<27:16:59,  3.67it/s]
  3%|▎         | 11319/371472 [53:43<27:20:40,  3.66it/s]
  3%|▎         | 11320/371472 [53:44<27:24:36,  3.65it/s]
                                                         
{'loss': 4.7033, 'learning_rate': 9.73044021633735e-07, 'epoch': 0.49}

  3%|▎         | 11320/371472 [53:44<27:24:36,  3.65it/s]
  3%|▎         | 11321/371472 [53:44<31:03:18,  3.22it/s]
  3%|▎         | 11322/371472 [53:44<29:46:45,  3.36it/s]
  3%|▎         | 11323/371472 [53:45<28:51:24,  3.47it/s]
  3%|▎         | 11324/371472 [53:45<27:52:14,  3.59it/s]
  3%|▎         | 11325/371472 [53:45<26:54:00,  3.72it/s]
  3%|▎         | 11326/371472 [53:45<26:52:44,  3.72it/s]
  3%|▎         | 11327/371472 [53:46<26:53:36,  3.72it/s]
  3%|▎         | 11328/371472 [53:46<26:44:00,  3.74it/s]
  3%|▎         | 11329/371472 [53:46<25:39:16,  3.90it/s]
  3%|▎         | 11330/371472 [53:46<25:55:16,  3.86it/s]
  3%|▎         | 11331/371472 [53:47<26:20:30,  3.80it/s]
  3%|▎         | 11332/371472 [53:47<26:48:09,  3.73it/s]
  3%|▎         | 11333/371472 [53:47<27:03:54,  3.70it/s]
  3%|▎         | 11334/371472 [53:48<27:47:22,  3.60it/s]
  3%|▎         | 11335/371472 [53:48<28:59:14,  3.45it/s]
  3%|▎         | 11336/371472 [53:48<30:09:38,  3.32it/s]
  3%|▎         | 11337/371472 [53:49<30:06:01,  3.32it/s]
  3%|▎         | 11338/371472 [53:49<28:15:41,  3.54it/s]
  3%|▎         | 11339/371472 [53:49<27:30:18,  3.64it/s]
  3%|▎         | 11340/371472 [53:49<27:33:54,  3.63it/s]
                                                         
{'loss': 4.6986, 'learning_rate': 9.729955396582558e-07, 'epoch': 0.49}

  3%|▎         | 11340/371472 [53:49<27:33:54,  3.63it/s]
  3%|▎         | 11341/371472 [53:50<28:33:27,  3.50it/s]
  3%|▎         | 11342/371472 [53:50<27:54:35,  3.58it/s]
  3%|▎         | 11343/371472 [53:50<28:22:29,  3.53it/s]
  3%|▎         | 11344/371472 [53:50<27:15:52,  3.67it/s]
  3%|▎         | 11345/371472 [53:51<28:54:26,  3.46it/s]
  3%|▎         | 11346/371472 [53:51<27:54:20,  3.58it/s]
  3%|▎         | 11347/371472 [53:51<26:48:08,  3.73it/s]
  3%|▎         | 11348/371472 [53:51<26:34:07,  3.77it/s]
  3%|▎         | 11349/371472 [53:52<27:05:44,  3.69it/s]
  3%|▎         | 11350/371472 [53:52<26:28:59,  3.78it/s]
  3%|▎         | 11351/371472 [53:52<25:52:35,  3.87it/s]
  3%|▎         | 11352/371472 [53:53<25:23:22,  3.94it/s]
  3%|▎         | 11353/371472 [53:53<26:36:54,  3.76it/s]
  3%|▎         | 11354/371472 [53:53<25:46:22,  3.88it/s]
  3%|▎         | 11355/371472 [53:53<25:41:13,  3.89it/s]
  3%|▎         | 11356/371472 [53:54<26:58:41,  3.71it/s]
  3%|▎         | 11357/371472 [53:54<26:55:05,  3.72it/s]
  3%|▎         | 11358/371472 [53:54<26:49:41,  3.73it/s]
  3%|▎         | 11359/371472 [53:54<27:22:07,  3.65it/s]
  3%|▎         | 11360/371472 [53:55<26:51:54,  3.72it/s]
                                                         
{'loss': 4.7492, 'learning_rate': 9.729470576827771e-07, 'epoch': 0.49}

  3%|▎         | 11360/371472 [53:55<26:51:54,  3.72it/s]
  3%|▎         | 11361/371472 [53:55<26:28:56,  3.78it/s]
  3%|▎         | 11362/371472 [53:55<27:52:38,  3.59it/s]
  3%|▎         | 11363/371472 [53:56<28:24:02,  3.52it/s]
  3%|▎         | 11364/371472 [53:56<28:18:20,  3.53it/s]
  3%|▎         | 11365/371472 [53:56<27:56:51,  3.58it/s]
  3%|▎         | 11366/371472 [53:56<28:29:57,  3.51it/s]
  3%|▎         | 11367/371472 [53:57<27:38:43,  3.62it/s]
  3%|▎         | 11368/371472 [53:57<27:44:08,  3.61it/s]
  3%|▎         | 11369/371472 [53:57<27:18:33,  3.66it/s]
  3%|▎         | 11370/371472 [53:57<27:07:05,  3.69it/s]
  3%|▎         | 11371/371472 [53:58<26:43:07,  3.74it/s]
  3%|▎         | 11372/371472 [53:58<28:17:17,  3.54it/s]
  3%|▎         | 11373/371472 [53:58<28:34:38,  3.50it/s]
  3%|▎         | 11374/371472 [53:59<27:41:37,  3.61it/s]
  3%|▎         | 11375/371472 [53:59<27:49:37,  3.59it/s]
  3%|▎         | 11376/371472 [53:59<26:29:08,  3.78it/s]
  3%|▎         | 11377/371472 [53:59<27:48:28,  3.60it/s]
  3%|▎         | 11378/371472 [54:00<28:10:04,  3.55it/s]
  3%|▎         | 11379/371472 [54:00<27:13:24,  3.67it/s]
  3%|▎         | 11380/371472 [54:00<26:43:40,  3.74it/s]
                                                         
{'loss': 4.7513, 'learning_rate': 9.72898575707298e-07, 'epoch': 0.49}

  3%|▎         | 11380/371472 [54:00<26:43:40,  3.74it/s]
  3%|▎         | 11381/371472 [54:00<27:27:58,  3.64it/s]
  3%|▎         | 11382/371472 [54:01<28:22:01,  3.53it/s]
  3%|▎         | 11383/371472 [54:01<28:08:29,  3.55it/s]
  3%|▎         | 11384/371472 [54:01<28:59:31,  3.45it/s]
  3%|▎         | 11385/371472 [54:02<28:31:42,  3.51it/s]
  3%|▎         | 11386/371472 [54:02<29:05:15,  3.44it/s]
  3%|▎         | 11387/371472 [54:02<28:10:46,  3.55it/s]
  3%|▎         | 11388/371472 [54:02<27:29:12,  3.64it/s]
  3%|▎         | 11389/371472 [54:03<26:56:09,  3.71it/s]
  3%|▎         | 11390/371472 [54:03<28:29:58,  3.51it/s]
  3%|▎         | 11391/371472 [54:03<27:54:39,  3.58it/s]
  3%|▎         | 11392/371472 [54:04<27:37:52,  3.62it/s]
  3%|▎         | 11393/371472 [54:04<26:59:10,  3.71it/s]
  3%|▎         | 11394/371472 [54:04<26:22:25,  3.79it/s]
  3%|▎         | 11395/371472 [54:04<26:47:32,  3.73it/s]
  3%|▎         | 11396/371472 [54:05<26:02:53,  3.84it/s]
  3%|▎         | 11397/371472 [54:05<26:57:01,  3.71it/s]
  3%|▎         | 11398/371472 [54:05<27:08:19,  3.69it/s]
  3%|▎         | 11399/371472 [54:05<26:19:40,  3.80it/s]
  3%|▎         | 11400/371472 [54:06<30:41:04,  3.26it/s]
                                                         
{'loss': 4.7428, 'learning_rate': 9.728500937318193e-07, 'epoch': 0.49}

  3%|▎         | 11400/371472 [54:06<30:41:04,  3.26it/s]
  3%|▎         | 11401/371472 [54:06<30:02:22,  3.33it/s]
  3%|▎         | 11402/371472 [54:06<28:45:33,  3.48it/s]
  3%|▎         | 11403/371472 [54:07<27:25:34,  3.65it/s]
  3%|▎         | 11404/371472 [54:07<28:58:48,  3.45it/s]
  3%|▎         | 11405/371472 [54:07<28:21:00,  3.53it/s]
  3%|▎         | 11406/371472 [54:07<27:54:09,  3.58it/s]
  3%|▎         | 11407/371472 [54:08<28:26:32,  3.52it/s]
  3%|▎         | 11408/371472 [54:08<28:42:23,  3.48it/s]
  3%|▎         | 11409/371472 [54:08<27:55:25,  3.58it/s]
  3%|▎         | 11410/371472 [54:09<27:59:36,  3.57it/s]
  3%|▎         | 11411/371472 [54:09<30:29:28,  3.28it/s]
  3%|▎         | 11412/371472 [54:09<30:02:45,  3.33it/s]
  3%|▎         | 11413/371472 [54:10<29:59:00,  3.34it/s]
  3%|▎         | 11414/371472 [54:10<28:33:46,  3.50it/s]
  3%|▎         | 11415/371472 [54:10<28:24:39,  3.52it/s]
  3%|▎         | 11416/371472 [54:10<27:58:00,  3.58it/s]
  3%|▎         | 11417/371472 [54:11<26:57:24,  3.71it/s]
  3%|▎         | 11418/371472 [54:11<26:49:56,  3.73it/s]
  3%|▎         | 11419/371472 [54:11<27:19:19,  3.66it/s]
  3%|▎         | 11420/371472 [54:11<26:29:50,  3.77it/s]
                                                         
{'loss': 4.6812, 'learning_rate': 9.728016117563403e-07, 'epoch': 0.49}

  3%|▎         | 11420/371472 [54:11<26:29:50,  3.77it/s]
  3%|▎         | 11421/371472 [54:12<26:59:17,  3.71it/s]
  3%|▎         | 11422/371472 [54:12<26:31:21,  3.77it/s]
  3%|▎         | 11423/371472 [54:12<26:28:42,  3.78it/s]
  3%|▎         | 11424/371472 [54:12<26:25:47,  3.78it/s]
  3%|▎         | 11425/371472 [54:13<26:48:52,  3.73it/s]
  3%|▎         | 11426/371472 [54:13<26:41:26,  3.75it/s]
  3%|▎         | 11427/371472 [54:13<27:08:48,  3.68it/s]
  3%|▎         | 11428/371472 [54:14<27:19:27,  3.66it/s]
  3%|▎         | 11429/371472 [54:14<27:04:59,  3.69it/s]
  3%|▎         | 11430/371472 [54:14<28:13:00,  3.54it/s]
  3%|▎         | 11431/371472 [54:14<27:37:18,  3.62it/s]
  3%|▎         | 11432/371472 [54:15<27:34:07,  3.63it/s]
  3%|▎         | 11433/371472 [54:15<27:28:25,  3.64it/s]
  3%|▎         | 11434/371472 [54:15<26:37:03,  3.76it/s]
  3%|▎         | 11435/371472 [54:15<26:28:41,  3.78it/s]
  3%|▎         | 11436/371472 [54:16<25:53:52,  3.86it/s]
  3%|▎         | 11437/371472 [54:16<25:29:29,  3.92it/s]
  3%|▎         | 11438/371472 [54:16<25:31:43,  3.92it/s]
  3%|▎         | 11439/371472 [54:16<25:45:38,  3.88it/s]
  3%|▎         | 11440/371472 [54:17<26:09:27,  3.82it/s]
                                                         
{'loss': 4.9698, 'learning_rate': 9.727531297808614e-07, 'epoch': 0.49}

  3%|▎         | 11440/371472 [54:17<26:09:27,  3.82it/s]
  3%|▎         | 11441/371472 [54:17<26:38:02,  3.75it/s]
  3%|▎         | 11442/371472 [54:17<26:27:18,  3.78it/s]
  3%|▎         | 11443/371472 [54:18<28:05:44,  3.56it/s]
  3%|▎         | 11444/371472 [54:18<28:44:10,  3.48it/s]
  3%|▎         | 11445/371472 [54:18<27:32:21,  3.63it/s]
  3%|▎         | 11446/371472 [54:18<28:16:53,  3.54it/s]
  3%|▎         | 11447/371472 [54:19<27:31:22,  3.63it/s]
  3%|▎         | 11448/371472 [54:19<28:43:45,  3.48it/s]
  3%|▎         | 11449/371472 [54:19<27:11:21,  3.68it/s]
  3%|▎         | 11450/371472 [54:20<28:21:51,  3.53it/s]
  3%|▎         | 11451/371472 [54:20<28:05:17,  3.56it/s]
  3%|▎         | 11452/371472 [54:20<28:58:47,  3.45it/s]
  3%|▎         | 11453/371472 [54:20<28:25:28,  3.52it/s]
  3%|▎         | 11454/371472 [54:21<27:33:31,  3.63it/s]
  3%|▎         | 11455/371472 [54:21<27:32:02,  3.63it/s]
  3%|▎         | 11456/371472 [54:21<28:04:55,  3.56it/s]
  3%|▎         | 11457/371472 [54:21<26:31:47,  3.77it/s]
  3%|▎         | 11458/371472 [54:22<27:23:37,  3.65it/s]
  3%|▎         | 11459/371472 [54:22<28:57:07,  3.45it/s]
  3%|▎         | 11460/371472 [54:22<28:04:34,  3.56it/s]
                                                         
{'loss': 4.6955, 'learning_rate': 9.727046478053825e-07, 'epoch': 0.49}

  3%|▎         | 11460/371472 [54:22<28:04:34,  3.56it/s]
  3%|▎         | 11461/371472 [54:23<26:58:09,  3.71it/s]
  3%|▎         | 11462/371472 [54:23<27:35:07,  3.63it/s]
  3%|▎         | 11463/371472 [54:23<27:48:05,  3.60it/s]
  3%|▎         | 11464/371472 [54:23<28:31:22,  3.51it/s]
  3%|▎         | 11465/371472 [54:24<30:17:29,  3.30it/s]
  3%|▎         | 11466/371472 [54:24<29:26:11,  3.40it/s]
  3%|▎         | 11467/371472 [54:24<32:14:16,  3.10it/s]
  3%|▎         | 11468/371472 [54:25<32:31:34,  3.07it/s]
  3%|▎         | 11469/371472 [54:25<30:21:44,  3.29it/s]
  3%|▎         | 11470/371472 [54:25<29:46:06,  3.36it/s]
  3%|▎         | 11471/371472 [54:26<28:48:14,  3.47it/s]
  3%|▎         | 11472/371472 [54:26<27:45:19,  3.60it/s]
  3%|▎         | 11473/371472 [54:26<27:40:40,  3.61it/s]
  3%|▎         | 11474/371472 [54:26<27:05:01,  3.69it/s]
  3%|▎         | 11475/371472 [54:27<26:50:57,  3.72it/s]
  3%|▎         | 11476/371472 [54:27<26:00:31,  3.84it/s]
  3%|▎         | 11477/371472 [54:27<25:45:56,  3.88it/s]
  3%|▎         | 11478/371472 [54:27<26:23:17,  3.79it/s]
  3%|▎         | 11479/371472 [54:28<26:36:03,  3.76it/s]
  3%|▎         | 11480/371472 [54:28<28:54:52,  3.46it/s]
                                                         
{'loss': 4.7071, 'learning_rate': 9.726561658299035e-07, 'epoch': 0.49}

  3%|▎         | 11480/371472 [54:28<28:54:52,  3.46it/s]
  3%|▎         | 11481/371472 [54:28<28:08:22,  3.55it/s]
  3%|▎         | 11482/371472 [54:29<28:47:16,  3.47it/s]
  3%|▎         | 11483/371472 [54:29<28:30:15,  3.51it/s]
  3%|▎         | 11484/371472 [54:29<29:08:05,  3.43it/s]
  3%|▎         | 11485/371472 [54:29<28:50:11,  3.47it/s]
  3%|▎         | 11486/371472 [54:30<28:09:30,  3.55it/s]
  3%|▎         | 11487/371472 [54:30<29:10:20,  3.43it/s]
  3%|▎         | 11488/371472 [54:30<28:13:15,  3.54it/s]
  3%|▎         | 11489/371472 [54:31<29:08:54,  3.43it/s]
  3%|▎         | 11490/371472 [54:31<29:13:12,  3.42it/s]
  3%|▎         | 11491/371472 [54:31<31:17:11,  3.20it/s]
  3%|▎         | 11492/371472 [54:32<29:24:51,  3.40it/s]
  3%|▎         | 11493/371472 [54:32<28:50:31,  3.47it/s]
  3%|▎         | 11494/371472 [54:32<29:06:46,  3.43it/s]
  3%|▎         | 11495/371472 [54:32<28:19:34,  3.53it/s]
  3%|▎         | 11496/371472 [54:33<29:00:51,  3.45it/s]
  3%|▎         | 11497/371472 [54:33<28:43:07,  3.48it/s]
  3%|▎         | 11498/371472 [54:33<29:13:51,  3.42it/s]
  3%|▎         | 11499/371472 [54:34<29:41:38,  3.37it/s]
  3%|▎         | 11500/371472 [54:34<28:51:58,  3.46it/s]
                                                         
{'loss': 4.477, 'learning_rate': 9.726076838544248e-07, 'epoch': 0.5}

  3%|▎         | 11500/371472 [54:34<28:51:58,  3.46it/s]
  3%|▎         | 11501/371472 [54:34<28:10:21,  3.55it/s]
  3%|▎         | 11502/371472 [54:34<27:57:43,  3.58it/s]
  3%|▎         | 11503/371472 [54:35<29:45:47,  3.36it/s]
  3%|▎         | 11504/371472 [54:35<28:46:04,  3.48it/s]
  3%|▎         | 11505/371472 [54:35<27:17:28,  3.66it/s]
  3%|▎         | 11506/371472 [54:36<27:32:44,  3.63it/s]
  3%|▎         | 11507/371472 [54:36<27:04:11,  3.69it/s]
  3%|▎         | 11508/371472 [54:36<27:32:45,  3.63it/s]
  3%|▎         | 11509/371472 [54:36<29:10:25,  3.43it/s]
  3%|▎         | 11510/371472 [54:37<29:24:02,  3.40it/s]
  3%|▎         | 11511/371472 [54:37<30:55:45,  3.23it/s]
  3%|▎         | 11512/371472 [54:37<29:55:37,  3.34it/s]
  3%|▎         | 11513/371472 [54:38<28:33:31,  3.50it/s]
  3%|▎         | 11514/371472 [54:38<29:20:46,  3.41it/s]
  3%|▎         | 11515/371472 [54:38<29:47:32,  3.36it/s]
  3%|▎         | 11516/371472 [54:38<29:17:55,  3.41it/s]
  3%|▎         | 11517/371472 [54:39<28:15:49,  3.54it/s]
  3%|▎         | 11518/371472 [54:39<29:00:41,  3.45it/s]
  3%|▎         | 11519/371472 [54:39<28:26:22,  3.52it/s]
  3%|▎         | 11520/371472 [54:40<28:07:40,  3.55it/s]
                                                         
{'loss': 4.5629, 'learning_rate': 9.725592018789457e-07, 'epoch': 0.5}

  3%|▎         | 11520/371472 [54:40<28:07:40,  3.55it/s]
  3%|▎         | 11521/371472 [54:40<27:39:52,  3.61it/s]
  3%|▎         | 11522/371472 [54:40<28:28:25,  3.51it/s]
  3%|▎         | 11523/371472 [54:41<31:52:45,  3.14it/s]
  3%|▎         | 11524/371472 [54:41<29:38:55,  3.37it/s]
  3%|▎         | 11525/371472 [54:41<28:57:28,  3.45it/s]
  3%|▎         | 11526/371472 [54:41<28:14:08,  3.54it/s]
  3%|▎         | 11527/371472 [54:42<27:30:45,  3.63it/s]
  3%|▎         | 11528/371472 [54:42<27:24:18,  3.65it/s]
  3%|▎         | 11529/371472 [54:42<26:51:19,  3.72it/s]
  3%|▎         | 11530/371472 [54:42<26:30:39,  3.77it/s]
  3%|▎         | 11531/371472 [54:43<27:04:48,  3.69it/s]
  3%|▎         | 11532/371472 [54:43<28:19:15,  3.53it/s]
  3%|▎         | 11533/371472 [54:43<28:24:10,  3.52it/s]
  3%|▎         | 11534/371472 [54:44<29:06:58,  3.43it/s]
  3%|▎         | 11535/371472 [54:44<36:13:11,  2.76it/s]
  3%|▎         | 11536/371472 [54:44<34:58:47,  2.86it/s]
  3%|▎         | 11537/371472 [54:45<33:30:26,  2.98it/s]
  3%|▎         | 11538/371472 [54:45<32:38:55,  3.06it/s]
  3%|▎         | 11539/371472 [54:45<31:29:57,  3.17it/s]
  3%|▎         | 11540/371472 [54:46<30:39:09,  3.26it/s]
                                                         
{'loss': 4.2942, 'learning_rate': 9.72510719903467e-07, 'epoch': 0.5}

  3%|▎         | 11540/371472 [54:46<30:39:09,  3.26it/s]
  3%|▎         | 11541/371472 [54:46<29:30:55,  3.39it/s]
  3%|▎         | 11542/371472 [54:46<28:14:12,  3.54it/s]
  3%|▎         | 11543/371472 [54:46<27:51:46,  3.59it/s]
  3%|▎         | 11544/371472 [54:47<28:07:20,  3.56it/s]
  3%|▎         | 11545/371472 [54:47<27:30:03,  3.64it/s]
  3%|▎         | 11546/371472 [54:47<27:46:30,  3.60it/s]
  3%|▎         | 11547/371472 [54:47<27:38:27,  3.62it/s]
  3%|▎         | 11548/371472 [54:48<31:29:15,  3.18it/s]
  3%|▎         | 11549/371472 [54:48<31:04:11,  3.22it/s]
  3%|▎         | 11550/371472 [54:48<28:56:35,  3.45it/s]
  3%|▎         | 11551/371472 [54:49<27:34:22,  3.63it/s]
  3%|▎         | 11552/371472 [54:49<27:29:03,  3.64it/s]
  3%|▎         | 11553/371472 [54:49<28:26:32,  3.52it/s]
  3%|▎         | 11554/371472 [54:50<28:32:48,  3.50it/s]
  3%|▎         | 11555/371472 [54:50<29:00:52,  3.45it/s]
  3%|▎         | 11556/371472 [54:50<29:56:48,  3.34it/s]
  3%|▎         | 11557/371472 [54:50<29:56:01,  3.34it/s]
  3%|▎         | 11558/371472 [54:51<31:42:12,  3.15it/s]
  3%|▎         | 11559/371472 [54:51<31:30:39,  3.17it/s]
  3%|▎         | 11560/371472 [54:51<29:31:39,  3.39it/s]
                                                         
{'loss': 4.763, 'learning_rate': 9.72462237927988e-07, 'epoch': 0.5}

  3%|▎         | 11560/371472 [54:51<29:31:39,  3.39it/s]
  3%|▎         | 11561/371472 [54:52<35:15:21,  2.84it/s]
  3%|▎         | 11562/371472 [54:52<32:51:21,  3.04it/s]
  3%|▎         | 11563/371472 [54:52<31:05:38,  3.22it/s]
  3%|▎         | 11564/371472 [54:53<31:07:08,  3.21it/s]
  3%|▎         | 11565/371472 [54:53<29:22:13,  3.40it/s]
  3%|▎         | 11566/371472 [54:53<29:10:12,  3.43it/s]
  3%|▎         | 11567/371472 [54:54<27:45:27,  3.60it/s]
  3%|▎         | 11568/371472 [54:54<27:20:12,  3.66it/s]
  3%|▎         | 11569/371472 [54:54<28:10:16,  3.55it/s]
  3%|▎         | 11570/371472 [54:54<27:35:49,  3.62it/s]
  3%|▎         | 11571/371472 [54:55<26:40:17,  3.75it/s]
  3%|▎         | 11572/371472 [54:55<26:17:50,  3.80it/s]
  3%|▎         | 11573/371472 [54:55<27:48:17,  3.60it/s]
  3%|▎         | 11574/371472 [54:55<27:20:59,  3.66it/s]
  3%|▎         | 11575/371472 [54:56<26:27:49,  3.78it/s]
  3%|▎         | 11576/371472 [54:56<26:24:41,  3.79it/s]
  3%|▎         | 11577/371472 [54:56<26:45:35,  3.74it/s]
  3%|▎         | 11578/371472 [54:56<27:58:15,  3.57it/s]
  3%|▎         | 11579/371472 [54:57<29:43:18,  3.36it/s]
  3%|▎         | 11580/371472 [54:57<30:50:24,  3.24it/s]
                                                         
{'loss': 4.7874, 'learning_rate': 9.724137559525091e-07, 'epoch': 0.5}

  3%|▎         | 11580/371472 [54:57<30:50:24,  3.24it/s]
  3%|▎         | 11581/371472 [54:57<30:54:32,  3.23it/s]
  3%|▎         | 11582/371472 [54:58<29:19:10,  3.41it/s]
  3%|▎         | 11583/371472 [54:58<30:20:50,  3.29it/s]
  3%|▎         | 11584/371472 [54:58<29:31:01,  3.39it/s]
  3%|▎         | 11585/371472 [54:59<28:23:43,  3.52it/s]
  3%|▎         | 11586/371472 [54:59<28:14:01,  3.54it/s]
  3%|▎         | 11587/371472 [54:59<27:46:02,  3.60it/s]
  3%|▎         | 11588/371472 [54:59<27:42:15,  3.61it/s]
  3%|▎         | 11589/371472 [55:00<28:59:00,  3.45it/s]
  3%|▎         | 11590/371472 [55:00<29:39:26,  3.37it/s]
  3%|▎         | 11591/371472 [55:00<29:04:16,  3.44it/s]
  3%|▎         | 11592/371472 [55:01<29:05:41,  3.44it/s]
  3%|▎         | 11593/371472 [55:01<30:25:07,  3.29it/s]
  3%|▎         | 11594/371472 [55:01<29:18:48,  3.41it/s]
  3%|▎         | 11595/371472 [55:02<32:53:13,  3.04it/s]
  3%|▎         | 11596/371472 [55:02<30:45:51,  3.25it/s]
  3%|▎         | 11597/371472 [55:02<28:46:07,  3.47it/s]
  3%|▎         | 11598/371472 [55:02<28:04:37,  3.56it/s]
  3%|▎         | 11599/371472 [55:03<28:38:19,  3.49it/s]
  3%|▎         | 11600/371472 [55:03<30:17:47,  3.30it/s]
                                                         
{'loss': 4.8124, 'learning_rate': 9.723652739770302e-07, 'epoch': 0.5}

  3%|▎         | 11600/371472 [55:03<30:17:47,  3.30it/s]
  3%|▎         | 11601/371472 [55:03<29:14:03,  3.42it/s]
  3%|▎         | 11602/371472 [55:04<28:44:58,  3.48it/s]
  3%|▎         | 11603/371472 [55:04<28:23:32,  3.52it/s]
  3%|▎         | 11604/371472 [55:04<27:48:20,  3.60it/s]
  3%|▎         | 11605/371472 [55:04<28:20:34,  3.53it/s]
  3%|▎         | 11606/371472 [55:05<29:19:56,  3.41it/s]
  3%|▎         | 11607/371472 [55:05<28:12:18,  3.54it/s]
  3%|▎         | 11608/371472 [55:05<28:03:04,  3.56it/s]
  3%|▎         | 11609/371472 [55:06<26:55:21,  3.71it/s]
  3%|▎         | 11610/371472 [55:06<26:36:00,  3.76it/s]
  3%|▎         | 11611/371472 [55:06<25:50:51,  3.87it/s]
  3%|▎         | 11612/371472 [55:06<25:22:55,  3.94it/s]
  3%|▎         | 11613/371472 [55:07<26:48:25,  3.73it/s]
  3%|▎         | 11614/371472 [55:07<28:20:00,  3.53it/s]
  3%|▎         | 11615/371472 [55:07<27:58:24,  3.57it/s]
  3%|▎         | 11616/371472 [55:07<27:31:22,  3.63it/s]
  3%|▎         | 11617/371472 [55:08<27:45:45,  3.60it/s]
  3%|▎         | 11618/371472 [55:08<27:12:48,  3.67it/s]
  3%|▎         | 11619/371472 [55:08<28:01:30,  3.57it/s]
  3%|▎         | 11620/371472 [55:09<28:42:49,  3.48it/s]
                                                         
{'loss': 4.9469, 'learning_rate': 9.723167920015513e-07, 'epoch': 0.5}

  3%|▎         | 11620/371472 [55:09<28:42:49,  3.48it/s]
  3%|▎         | 11621/371472 [55:09<27:47:14,  3.60it/s]
  3%|▎         | 11622/371472 [55:09<26:36:18,  3.76it/s]
  3%|▎         | 11623/371472 [55:09<27:40:22,  3.61it/s]
  3%|▎         | 11624/371472 [55:10<27:40:34,  3.61it/s]
  3%|▎         | 11625/371472 [55:10<27:14:30,  3.67it/s]
  3%|▎         | 11626/371472 [55:10<27:45:51,  3.60it/s]
  3%|▎         | 11627/371472 [55:10<27:56:23,  3.58it/s]
  3%|▎         | 11628/371472 [55:11<27:17:30,  3.66it/s]
  3%|▎         | 11629/371472 [55:11<26:30:26,  3.77it/s]
  3%|▎         | 11630/371472 [55:11<26:49:20,  3.73it/s]
  3%|▎         | 11631/371472 [55:12<27:40:14,  3.61it/s]
  3%|▎         | 11632/371472 [55:12<27:00:00,  3.70it/s]
  3%|▎         | 11633/371472 [55:12<27:42:51,  3.61it/s]
  3%|▎         | 11634/371472 [55:12<27:03:10,  3.69it/s]
  3%|▎         | 11635/371472 [55:13<26:33:30,  3.76it/s]
  3%|▎         | 11636/371472 [55:13<26:58:06,  3.71it/s]
  3%|▎         | 11637/371472 [55:13<26:12:17,  3.81it/s]
  3%|▎         | 11638/371472 [55:13<26:47:34,  3.73it/s]
  3%|▎         | 11639/371472 [55:14<26:14:33,  3.81it/s]
  3%|▎         | 11640/371472 [55:14<26:56:41,  3.71it/s]
                                                         
{'loss': 4.8652, 'learning_rate': 9.722683100260725e-07, 'epoch': 0.5}

  3%|▎         | 11640/371472 [55:14<26:56:41,  3.71it/s]
  3%|▎         | 11641/371472 [55:14<27:38:52,  3.62it/s]
  3%|▎         | 11642/371472 [55:15<28:49:18,  3.47it/s]
  3%|▎         | 11643/371472 [55:15<28:35:07,  3.50it/s]
  3%|▎         | 11644/371472 [55:15<28:26:55,  3.51it/s]
  3%|▎         | 11645/371472 [55:15<29:16:10,  3.41it/s]
  3%|▎         | 11646/371472 [55:16<28:14:09,  3.54it/s]
  3%|▎         | 11647/371472 [55:16<27:55:37,  3.58it/s]
  3%|▎         | 11648/371472 [55:16<27:52:57,  3.58it/s]
  3%|▎         | 11649/371472 [55:17<27:31:48,  3.63it/s]
  3%|▎         | 11650/371472 [55:17<28:09:23,  3.55it/s]
  3%|▎         | 11651/371472 [55:17<27:11:14,  3.68it/s]
  3%|▎         | 11652/371472 [55:17<26:22:22,  3.79it/s]
  3%|▎         | 11653/371472 [55:18<26:53:12,  3.72it/s]
  3%|▎         | 11654/371472 [55:18<28:07:17,  3.55it/s]
  3%|▎         | 11655/371472 [55:18<28:01:32,  3.57it/s]
  3%|▎         | 11656/371472 [55:18<28:01:46,  3.57it/s]
  3%|▎         | 11657/371472 [55:19<27:38:51,  3.62it/s]
  3%|▎         | 11658/371472 [55:19<33:14:47,  3.01it/s]
  3%|▎         | 11659/371472 [55:20<33:31:34,  2.98it/s]
  3%|▎         | 11660/371472 [55:20<31:14:07,  3.20it/s]
                                                         
{'loss': 4.7594, 'learning_rate': 9.722198280505936e-07, 'epoch': 0.5}

  3%|▎         | 11660/371472 [55:20<31:14:07,  3.20it/s]
  3%|▎         | 11661/371472 [55:20<29:27:35,  3.39it/s]
  3%|▎         | 11662/371472 [55:20<28:16:11,  3.54it/s]
  3%|▎         | 11663/371472 [55:21<27:37:47,  3.62it/s]
  3%|▎         | 11664/371472 [55:21<27:34:36,  3.62it/s]
  3%|▎         | 11665/371472 [55:21<27:10:04,  3.68it/s]
  3%|▎         | 11666/371472 [55:21<26:56:24,  3.71it/s]
  3%|▎         | 11667/371472 [55:22<27:27:54,  3.64it/s]
  3%|▎         | 11668/371472 [55:22<26:51:58,  3.72it/s]
  3%|▎         | 11669/371472 [55:22<31:03:31,  3.22it/s]
  3%|▎         | 11670/371472 [55:23<29:48:19,  3.35it/s]
  3%|▎         | 11671/371472 [55:23<33:40:53,  2.97it/s]
  3%|▎         | 11672/371472 [55:23<31:55:30,  3.13it/s]
  3%|▎         | 11673/371472 [55:24<31:25:02,  3.18it/s]
  3%|▎         | 11674/371472 [55:24<31:22:12,  3.19it/s]
  3%|▎         | 11675/371472 [55:24<30:15:06,  3.30it/s]
  3%|▎         | 11676/371472 [55:24<29:25:16,  3.40it/s]
  3%|▎         | 11677/371472 [55:25<30:21:07,  3.29it/s]
  3%|▎         | 11678/371472 [55:25<29:15:05,  3.42it/s]
  3%|▎         | 11679/371472 [55:25<28:04:33,  3.56it/s]
  3%|▎         | 11680/371472 [55:26<28:03:45,  3.56it/s]
                                                         
{'loss': 4.4601, 'learning_rate': 9.721713460751147e-07, 'epoch': 0.5}

  3%|▎         | 11680/371472 [55:26<28:03:45,  3.56it/s]
  3%|▎         | 11681/371472 [55:26<27:27:33,  3.64it/s]
  3%|▎         | 11682/371472 [55:26<27:04:25,  3.69it/s]
  3%|▎         | 11683/371472 [55:26<27:13:44,  3.67it/s]
  3%|▎         | 11684/371472 [55:27<26:38:31,  3.75it/s]
  3%|▎         | 11685/371472 [55:27<26:57:25,  3.71it/s]
  3%|▎         | 11686/371472 [55:27<29:28:17,  3.39it/s]
  3%|▎         | 11687/371472 [55:28<28:49:27,  3.47it/s]
  3%|▎         | 11688/371472 [55:28<27:54:02,  3.58it/s]
  3%|▎         | 11689/371472 [55:28<27:41:22,  3.61it/s]
  3%|▎         | 11690/371472 [55:28<27:52:38,  3.58it/s]
  3%|▎         | 11691/371472 [55:29<28:24:26,  3.52it/s]
  3%|▎         | 11692/371472 [55:29<27:40:37,  3.61it/s]
  3%|▎         | 11693/371472 [55:29<28:10:18,  3.55it/s]
  3%|▎         | 11694/371472 [55:29<27:30:54,  3.63it/s]
  3%|▎         | 11695/371472 [55:30<27:50:15,  3.59it/s]
  3%|▎         | 11696/371472 [55:30<27:56:06,  3.58it/s]
  3%|▎         | 11697/371472 [55:30<27:55:43,  3.58it/s]
  3%|▎         | 11698/371472 [55:31<29:15:23,  3.42it/s]
  3%|▎         | 11699/371472 [55:31<29:15:14,  3.42it/s]
  3%|▎         | 11700/371472 [55:31<29:02:33,  3.44it/s]
                                                         
{'loss': 4.7384, 'learning_rate': 9.72122864099636e-07, 'epoch': 0.5}

  3%|▎         | 11700/371472 [55:31<29:02:33,  3.44it/s]
  3%|▎         | 11701/371472 [55:31<29:06:12,  3.43it/s]
  3%|▎         | 11702/371472 [55:32<27:57:13,  3.58it/s]
  3%|▎         | 11703/371472 [55:32<28:03:33,  3.56it/s]
  3%|▎         | 11704/371472 [55:32<29:57:30,  3.34it/s]
  3%|▎         | 11705/371472 [55:33<29:57:47,  3.34it/s]
  3%|▎         | 11706/371472 [55:33<30:50:53,  3.24it/s]
  3%|▎         | 11707/371472 [55:33<29:52:45,  3.34it/s]
  3%|▎         | 11708/371472 [55:34<30:49:13,  3.24it/s]
  3%|▎         | 11709/371472 [55:34<30:04:08,  3.32it/s]
  3%|▎         | 11710/371472 [55:34<28:41:46,  3.48it/s]
  3%|▎         | 11711/371472 [55:34<29:18:36,  3.41it/s]
  3%|▎         | 11712/371472 [55:35<29:36:03,  3.38it/s]
  3%|▎         | 11713/371472 [55:35<28:03:24,  3.56it/s]
  3%|▎         | 11714/371472 [55:35<27:39:22,  3.61it/s]
  3%|▎         | 11715/371472 [55:36<27:17:22,  3.66it/s]
  3%|▎         | 11716/371472 [55:36<27:05:09,  3.69it/s]
  3%|▎         | 11717/371472 [55:36<28:26:22,  3.51it/s]
  3%|▎         | 11718/371472 [55:36<28:07:33,  3.55it/s]
  3%|▎         | 11719/371472 [55:37<31:11:41,  3.20it/s]
  3%|▎         | 11720/371472 [55:37<29:59:58,  3.33it/s]
                                                         
{'loss': 4.7338, 'learning_rate': 9.720743821241568e-07, 'epoch': 0.5}

  3%|▎         | 11720/371472 [55:37<29:59:58,  3.33it/s]
  3%|▎         | 11721/371472 [55:37<29:27:32,  3.39it/s]
  3%|▎         | 11722/371472 [55:38<28:34:35,  3.50it/s]
  3%|▎         | 11723/371472 [55:38<28:46:43,  3.47it/s]
  3%|▎         | 11724/371472 [55:38<30:03:11,  3.33it/s]
  3%|▎         | 11725/371472 [55:39<30:35:46,  3.27it/s]
  3%|▎         | 11726/371472 [55:39<29:38:41,  3.37it/s]
  3%|▎         | 11727/371472 [55:39<29:01:39,  3.44it/s]
  3%|▎         | 11728/371472 [55:39<28:08:02,  3.55it/s]
  3%|▎         | 11729/371472 [55:40<28:55:24,  3.45it/s]
  3%|▎         | 11730/371472 [55:40<29:13:35,  3.42it/s]
  3%|▎         | 11731/371472 [55:40<27:45:56,  3.60it/s]
  3%|▎         | 11732/371472 [55:40<27:46:24,  3.60it/s]
  3%|▎         | 11733/371472 [55:41<29:12:41,  3.42it/s]
  3%|▎         | 11734/371472 [55:41<29:05:09,  3.44it/s]
  3%|▎         | 11735/371472 [55:41<28:11:10,  3.55it/s]
  3%|▎         | 11736/371472 [55:42<28:09:00,  3.55it/s]
  3%|▎         | 11737/371472 [55:42<27:52:17,  3.59it/s]
  3%|▎         | 11738/371472 [55:42<27:01:40,  3.70it/s]
  3%|▎         | 11739/371472 [55:42<27:50:57,  3.59it/s]
  3%|▎         | 11740/371472 [55:43<27:16:06,  3.66it/s]
                                                         
{'loss': 4.7798, 'learning_rate': 9.720259001486781e-07, 'epoch': 0.51}

  3%|▎         | 11740/371472 [55:43<27:16:06,  3.66it/s]
  3%|▎         | 11741/371472 [55:43<26:44:02,  3.74it/s]
  3%|▎         | 11742/371472 [55:43<26:41:00,  3.74it/s]
  3%|▎         | 11743/371472 [55:43<26:39:12,  3.75it/s]
  3%|▎         | 11744/371472 [55:44<27:05:45,  3.69it/s]
  3%|▎         | 11745/371472 [55:44<29:05:17,  3.44it/s]
  3%|▎         | 11746/371472 [55:44<28:22:46,  3.52it/s]
  3%|▎         | 11747/371472 [55:45<27:18:53,  3.66it/s]
  3%|▎         | 11748/371472 [55:45<29:40:35,  3.37it/s]
  3%|▎         | 11749/371472 [55:45<28:44:25,  3.48it/s]
  3%|▎         | 11750/371472 [55:46<30:42:53,  3.25it/s]
  3%|▎         | 11751/371472 [55:46<29:56:35,  3.34it/s]
  3%|▎         | 11752/371472 [55:46<29:21:02,  3.40it/s]
  3%|▎         | 11753/371472 [55:47<33:23:23,  2.99it/s]
  3%|▎         | 11754/371472 [55:47<30:59:28,  3.22it/s]
  3%|▎         | 11755/371472 [55:47<29:24:58,  3.40it/s]
  3%|▎         | 11756/371472 [55:47<28:36:53,  3.49it/s]
  3%|▎         | 11757/371472 [55:48<28:59:11,  3.45it/s]
  3%|▎         | 11758/371472 [55:48<29:36:08,  3.38it/s]
  3%|▎         | 11759/371472 [55:48<31:04:01,  3.22it/s]
  3%|▎         | 11760/371472 [55:49<29:53:12,  3.34it/s]
                                                         
{'loss': 4.988, 'learning_rate': 9.71977418173199e-07, 'epoch': 0.51}

  3%|▎         | 11760/371472 [55:49<29:53:12,  3.34it/s]
  3%|▎         | 11761/371472 [55:49<29:07:55,  3.43it/s]
  3%|▎         | 11762/371472 [55:49<28:13:21,  3.54it/s]
  3%|▎         | 11763/371472 [55:49<27:13:13,  3.67it/s]
  3%|▎         | 11764/371472 [55:50<27:32:38,  3.63it/s]
  3%|▎         | 11765/371472 [55:50<27:15:57,  3.66it/s]
  3%|▎         | 11766/371472 [55:50<27:28:26,  3.64it/s]
  3%|▎         | 11767/371472 [55:50<27:06:34,  3.69it/s]
  3%|▎         | 11768/371472 [55:51<27:02:27,  3.70it/s]
  3%|▎         | 11769/371472 [55:51<26:46:46,  3.73it/s]
  3%|▎         | 11770/371472 [55:51<28:12:59,  3.54it/s]
  3%|▎         | 11771/371472 [55:52<27:19:31,  3.66it/s]
  3%|▎         | 11772/371472 [55:52<29:04:32,  3.44it/s]
  3%|▎         | 11773/371472 [55:52<28:38:19,  3.49it/s]
  3%|▎         | 11774/371472 [55:52<28:49:13,  3.47it/s]
  3%|▎         | 11775/371472 [55:53<28:47:21,  3.47it/s]
  3%|▎         | 11776/371472 [55:53<28:16:23,  3.53it/s]
  3%|▎         | 11777/371472 [55:53<28:21:27,  3.52it/s]
  3%|▎         | 11778/371472 [55:54<29:58:16,  3.33it/s]
  3%|▎         | 11779/371472 [55:54<29:03:39,  3.44it/s]
  3%|▎         | 11780/371472 [55:54<27:44:03,  3.60it/s]
                                                         
{'loss': 4.7253, 'learning_rate': 9.719289361977203e-07, 'epoch': 0.51}

  3%|▎         | 11780/371472 [55:54<27:44:03,  3.60it/s]
  3%|▎         | 11781/371472 [55:54<28:08:20,  3.55it/s]
  3%|▎         | 11782/371472 [55:55<28:41:59,  3.48it/s]
  3%|▎         | 11783/371472 [55:55<27:35:02,  3.62it/s]
  3%|▎         | 11784/371472 [55:55<28:27:32,  3.51it/s]
  3%|▎         | 11785/371472 [55:56<27:08:32,  3.68it/s]
  3%|▎         | 11786/371472 [55:56<28:17:32,  3.53it/s]
  3%|▎         | 11787/371472 [55:56<28:07:19,  3.55it/s]
  3%|▎         | 11788/371472 [55:56<26:50:29,  3.72it/s]
  3%|▎         | 11789/371472 [55:57<27:13:09,  3.67it/s]
  3%|▎         | 11790/371472 [55:57<26:49:45,  3.72it/s]
  3%|▎         | 11791/371472 [55:57<26:22:31,  3.79it/s]
  3%|▎         | 11792/371472 [55:57<27:35:36,  3.62it/s]
  3%|▎         | 11793/371472 [55:58<27:39:17,  3.61it/s]
  3%|▎         | 11794/371472 [55:58<27:34:55,  3.62it/s]
  3%|▎         | 11795/371472 [55:58<27:41:22,  3.61it/s]
  3%|▎         | 11796/371472 [55:59<29:35:45,  3.38it/s]
  3%|▎         | 11797/371472 [55:59<28:37:39,  3.49it/s]
  3%|▎         | 11798/371472 [55:59<27:13:11,  3.67it/s]
  3%|▎         | 11799/371472 [55:59<27:27:40,  3.64it/s]
  3%|▎         | 11800/371472 [56:00<27:43:50,  3.60it/s]
                                                         
{'loss': 4.8133, 'learning_rate': 9.718804542222413e-07, 'epoch': 0.51}

  3%|▎         | 11800/371472 [56:00<27:43:50,  3.60it/s]
  3%|▎         | 11801/371472 [56:00<27:03:43,  3.69it/s]
  3%|▎         | 11802/371472 [56:00<26:40:16,  3.75it/s]
  3%|▎         | 11803/371472 [56:01<26:30:14,  3.77it/s]
  3%|▎         | 11804/371472 [56:01<27:33:49,  3.62it/s]
  3%|▎         | 11805/371472 [56:01<27:43:52,  3.60it/s]
  3%|▎         | 11806/371472 [56:01<27:45:48,  3.60it/s]
  3%|▎         | 11807/371472 [56:02<26:56:44,  3.71it/s]
  3%|▎         | 11808/371472 [56:02<27:02:55,  3.69it/s]
  3%|▎         | 11809/371472 [56:02<26:14:37,  3.81it/s]
  3%|▎         | 11810/371472 [56:02<25:39:53,  3.89it/s]
  3%|▎         | 11811/371472 [56:03<25:21:27,  3.94it/s]
  3%|▎         | 11812/371472 [56:03<25:15:28,  3.96it/s]
  3%|▎         | 11813/371472 [56:03<25:03:29,  3.99it/s]
  3%|▎         | 11814/371472 [56:03<25:17:32,  3.95it/s]
  3%|▎         | 11815/371472 [56:04<24:52:41,  4.02it/s]
  3%|▎         | 11816/371472 [56:04<27:44:41,  3.60it/s]
  3%|▎         | 11817/371472 [56:04<27:15:01,  3.67it/s]
  3%|▎         | 11818/371472 [56:04<26:46:58,  3.73it/s]
  3%|▎         | 11819/371472 [56:05<26:30:33,  3.77it/s]
  3%|▎         | 11820/371472 [56:05<28:50:23,  3.46it/s]
                                                         
{'loss': 4.8508, 'learning_rate': 9.718319722467624e-07, 'epoch': 0.51}

  3%|▎         | 11820/371472 [56:05<28:50:23,  3.46it/s]
  3%|▎         | 11821/371472 [56:05<28:20:34,  3.52it/s]
  3%|▎         | 11822/371472 [56:06<28:12:40,  3.54it/s]
  3%|▎         | 11823/371472 [56:06<28:25:20,  3.51it/s]
  3%|▎         | 11824/371472 [56:06<29:28:04,  3.39it/s]
  3%|▎         | 11825/371472 [56:06<28:10:07,  3.55it/s]
  3%|▎         | 11826/371472 [56:07<27:40:06,  3.61it/s]
  3%|▎         | 11827/371472 [56:07<27:34:26,  3.62it/s]
  3%|▎         | 11828/371472 [56:07<29:40:04,  3.37it/s]
  3%|▎         | 11829/371472 [56:08<28:48:27,  3.47it/s]
  3%|▎         | 11830/371472 [56:08<29:16:15,  3.41it/s]
  3%|▎         | 11831/371472 [56:08<28:21:21,  3.52it/s]
  3%|▎         | 11832/371472 [56:09<29:02:14,  3.44it/s]
  3%|▎         | 11833/371472 [56:09<28:11:37,  3.54it/s]
  3%|▎         | 11834/371472 [56:09<28:33:19,  3.50it/s]
  3%|▎         | 11835/371472 [56:09<27:57:13,  3.57it/s]
  3%|▎         | 11836/371472 [56:10<27:29:20,  3.63it/s]
  3%|▎         | 11837/371472 [56:10<26:12:53,  3.81it/s]
  3%|▎         | 11838/371472 [56:10<26:30:12,  3.77it/s]
  3%|▎         | 11839/371472 [56:11<30:42:32,  3.25it/s]
  3%|▎         | 11840/371472 [56:11<28:52:28,  3.46it/s]
                                                         
{'loss': 4.6992, 'learning_rate': 9.717834902712837e-07, 'epoch': 0.51}

  3%|▎         | 11840/371472 [56:11<28:52:28,  3.46it/s]
  3%|▎         | 11841/371472 [56:11<28:57:50,  3.45it/s]
  3%|▎         | 11842/371472 [56:11<28:13:09,  3.54it/s]
  3%|▎         | 11843/371472 [56:12<29:14:49,  3.42it/s]
  3%|▎         | 11844/371472 [56:12<28:34:57,  3.50it/s]
  3%|▎         | 11845/371472 [56:12<27:48:17,  3.59it/s]
  3%|▎         | 11846/371472 [56:12<27:56:06,  3.58it/s]
  3%|▎         | 11847/371472 [56:13<27:46:50,  3.60it/s]
  3%|▎         | 11848/371472 [56:13<28:00:33,  3.57it/s]
  3%|▎         | 11849/371472 [56:13<27:27:30,  3.64it/s]
  3%|▎         | 11850/371472 [56:14<27:25:19,  3.64it/s]
  3%|▎         | 11851/371472 [56:14<27:00:09,  3.70it/s]
  3%|▎         | 11852/371472 [56:14<26:38:25,  3.75it/s]
  3%|▎         | 11853/371472 [56:14<26:18:17,  3.80it/s]
  3%|▎         | 11854/371472 [56:15<27:15:59,  3.66it/s]
  3%|▎         | 11855/371472 [56:15<27:38:41,  3.61it/s]
  3%|▎         | 11856/371472 [56:15<27:04:22,  3.69it/s]
  3%|▎         | 11857/371472 [56:15<28:19:47,  3.53it/s]
  3%|▎         | 11858/371472 [56:16<27:16:42,  3.66it/s]
  3%|▎         | 11859/371472 [56:16<27:04:06,  3.69it/s]
  3%|▎         | 11860/371472 [56:16<27:08:57,  3.68it/s]
                                                         
{'loss': 4.7687, 'learning_rate': 9.717350082958045e-07, 'epoch': 0.51}

  3%|▎         | 11860/371472 [56:16<27:08:57,  3.68it/s]
  3%|▎         | 11861/371472 [56:17<28:25:32,  3.51it/s]
  3%|▎         | 11862/371472 [56:17<29:05:33,  3.43it/s]
  3%|▎         | 11863/371472 [56:17<28:00:26,  3.57it/s]
  3%|▎         | 11864/371472 [56:17<26:42:03,  3.74it/s]
  3%|▎         | 11865/371472 [56:18<26:16:30,  3.80it/s]
  3%|▎         | 11866/371472 [56:18<25:55:14,  3.85it/s]
  3%|▎         | 11867/371472 [56:18<25:59:58,  3.84it/s]
  3%|▎         | 11868/371472 [56:18<26:09:59,  3.82it/s]
  3%|▎         | 11869/371472 [56:19<26:27:36,  3.78it/s]
  3%|▎         | 11870/371472 [56:19<26:07:16,  3.82it/s]
  3%|▎         | 11871/371472 [56:19<26:48:41,  3.73it/s]
  3%|▎         | 11872/371472 [56:20<28:52:21,  3.46it/s]
  3%|▎         | 11873/371472 [56:20<28:31:12,  3.50it/s]
  3%|▎         | 11874/371472 [56:20<28:07:10,  3.55it/s]
  3%|▎         | 11875/371472 [56:20<28:26:49,  3.51it/s]
  3%|▎         | 11876/371472 [56:21<29:32:59,  3.38it/s]
  3%|▎         | 11877/371472 [56:21<29:26:07,  3.39it/s]
  3%|▎         | 11878/371472 [56:21<32:11:09,  3.10it/s]
  3%|▎         | 11879/371472 [56:22<29:57:35,  3.33it/s]
  3%|▎         | 11880/371472 [56:22<30:06:56,  3.32it/s]
                                                         
{'loss': 4.5679, 'learning_rate': 9.716865263203258e-07, 'epoch': 0.51}

  3%|▎         | 11880/371472 [56:22<30:06:56,  3.32it/s]
  3%|▎         | 11881/371472 [56:22<28:25:12,  3.51it/s]
  3%|▎         | 11882/371472 [56:22<26:52:21,  3.72it/s]
  3%|▎         | 11883/371472 [56:23<27:59:34,  3.57it/s]
  3%|▎         | 11884/371472 [56:23<27:31:16,  3.63it/s]
  3%|▎         | 11885/371472 [56:23<27:33:54,  3.62it/s]
  3%|▎         | 11886/371472 [56:24<27:12:30,  3.67it/s]
  3%|▎         | 11887/371472 [56:24<28:27:37,  3.51it/s]
  3%|▎         | 11888/371472 [56:24<28:44:28,  3.48it/s]
  3%|▎         | 11889/371472 [56:24<27:57:18,  3.57it/s]
  3%|▎         | 11890/371472 [56:25<27:54:04,  3.58it/s]
  3%|▎         | 11891/371472 [56:25<27:31:27,  3.63it/s]
  3%|▎         | 11892/371472 [56:25<27:40:33,  3.61it/s]
  3%|▎         | 11893/371472 [56:25<27:21:20,  3.65it/s]
  3%|▎         | 11894/371472 [56:26<26:47:02,  3.73it/s]
  3%|▎         | 11895/371472 [56:26<28:02:45,  3.56it/s]
  3%|▎         | 11896/371472 [56:26<27:07:45,  3.68it/s]
  3%|▎         | 11897/371472 [56:27<28:21:07,  3.52it/s]
  3%|▎         | 11898/371472 [56:27<28:40:07,  3.48it/s]
  3%|▎         | 11899/371472 [56:27<28:11:03,  3.54it/s]
  3%|▎         | 11900/371472 [56:27<27:54:53,  3.58it/s]
                                                         
{'loss': 4.7933, 'learning_rate': 9.71638044344847e-07, 'epoch': 0.51}

  3%|▎         | 11900/371472 [56:27<27:54:53,  3.58it/s]
  3%|▎         | 11901/371472 [56:28<29:56:32,  3.34it/s]
  3%|▎         | 11902/371472 [56:28<29:33:47,  3.38it/s]
  3%|▎         | 11903/371472 [56:28<29:41:12,  3.36it/s]
  3%|▎         | 11904/371472 [56:29<28:35:10,  3.49it/s]
  3%|▎         | 11905/371472 [56:29<27:28:26,  3.64it/s]
  3%|▎         | 11906/371472 [56:29<27:08:19,  3.68it/s]
  3%|▎         | 11907/371472 [56:29<27:24:59,  3.64it/s]
  3%|▎         | 11908/371472 [56:30<26:22:39,  3.79it/s]
  3%|▎         | 11909/371472 [56:30<29:44:27,  3.36it/s]
  3%|▎         | 11910/371472 [56:30<32:51:01,  3.04it/s]
  3%|▎         | 11911/371472 [56:31<31:24:42,  3.18it/s]
  3%|▎         | 11912/371472 [56:31<29:33:21,  3.38it/s]
  3%|▎         | 11913/371472 [56:31<31:04:11,  3.21it/s]
  3%|▎         | 11914/371472 [56:32<29:55:50,  3.34it/s]
  3%|▎         | 11915/371472 [56:32<28:50:00,  3.46it/s]
  3%|▎         | 11916/371472 [56:32<28:09:47,  3.55it/s]
  3%|▎         | 11917/371472 [56:32<27:59:36,  3.57it/s]
  3%|▎         | 11918/371472 [56:33<27:32:52,  3.63it/s]
  3%|▎         | 11919/371472 [56:33<29:40:57,  3.36it/s]
  3%|▎         | 11920/371472 [56:33<30:54:57,  3.23it/s]
                                                         
{'loss': 4.6264, 'learning_rate': 9.71589562369368e-07, 'epoch': 0.51}

  3%|▎         | 11920/371472 [56:33<30:54:57,  3.23it/s]
  3%|▎         | 11921/371472 [56:34<32:14:58,  3.10it/s]
  3%|▎         | 11922/371472 [56:34<31:19:47,  3.19it/s]
  3%|▎         | 11923/371472 [56:34<30:41:59,  3.25it/s]
  3%|▎         | 11924/371472 [56:35<28:20:22,  3.52it/s]
  3%|▎         | 11925/371472 [56:35<32:33:02,  3.07it/s]
  3%|▎         | 11926/371472 [56:35<36:02:10,  2.77it/s]
  3%|▎         | 11927/371472 [56:36<35:04:32,  2.85it/s]
  3%|▎         | 11928/371472 [56:36<31:52:50,  3.13it/s]
  3%|▎         | 11929/371472 [56:36<29:37:18,  3.37it/s]
  3%|▎         | 11930/371472 [56:36<28:16:44,  3.53it/s]
  3%|▎         | 11931/371472 [56:37<27:04:22,  3.69it/s]
  3%|▎         | 11932/371472 [56:37<28:58:40,  3.45it/s]
  3%|▎         | 11933/371472 [56:37<29:36:11,  3.37it/s]
  3%|▎         | 11934/371472 [56:38<30:23:18,  3.29it/s]
  3%|▎         | 11935/371472 [56:38<29:03:46,  3.44it/s]
  3%|▎         | 11936/371472 [56:38<30:16:30,  3.30it/s]
  3%|▎         | 11937/371472 [56:39<30:02:35,  3.32it/s]
  3%|▎         | 11938/371472 [56:39<29:08:27,  3.43it/s]
  3%|▎         | 11939/371472 [56:39<28:12:23,  3.54it/s]
  3%|▎         | 11940/371472 [56:39<27:18:29,  3.66it/s]
                                                         
{'loss': 4.6911, 'learning_rate': 9.715410803938892e-07, 'epoch': 0.51}

  3%|▎         | 11940/371472 [56:39<27:18:29,  3.66it/s]
  3%|▎         | 11941/371472 [56:40<28:45:48,  3.47it/s]
  3%|▎         | 11942/371472 [56:40<28:31:22,  3.50it/s]
  3%|▎         | 11943/371472 [56:40<29:44:16,  3.36it/s]
  3%|▎         | 11944/371472 [56:41<28:22:40,  3.52it/s]
  3%|▎         | 11945/371472 [56:41<27:40:46,  3.61it/s]
  3%|▎         | 11946/371472 [56:41<27:03:20,  3.69it/s]
  3%|▎         | 11947/371472 [56:41<26:12:28,  3.81it/s]
  3%|▎         | 11948/371472 [56:42<26:12:49,  3.81it/s]
  3%|▎         | 11949/371472 [56:42<26:05:02,  3.83it/s]
  3%|▎         | 11950/371472 [56:42<26:56:33,  3.71it/s]
  3%|▎         | 11951/371472 [56:42<26:12:37,  3.81it/s]
  3%|▎         | 11952/371472 [56:43<26:26:50,  3.78it/s]
  3%|▎         | 11953/371472 [56:43<28:31:59,  3.50it/s]
  3%|▎         | 11954/371472 [56:43<29:23:10,  3.40it/s]
  3%|▎         | 11955/371472 [56:44<29:23:51,  3.40it/s]
  3%|▎         | 11956/371472 [56:44<27:32:11,  3.63it/s]
  3%|▎         | 11957/371472 [56:44<27:25:17,  3.64it/s]
  3%|▎         | 11958/371472 [56:44<28:17:52,  3.53it/s]
  3%|▎         | 11959/371472 [56:45<28:21:59,  3.52it/s]
  3%|▎         | 11960/371472 [56:45<29:00:38,  3.44it/s]
                                                         
{'loss': 4.6685, 'learning_rate': 9.714925984184101e-07, 'epoch': 0.52}

  3%|▎         | 11960/371472 [56:45<29:00:38,  3.44it/s]
  3%|▎         | 11961/371472 [56:45<28:52:26,  3.46it/s]
  3%|▎         | 11962/371472 [56:46<28:53:46,  3.46it/s]
  3%|▎         | 11963/371472 [56:46<31:03:01,  3.22it/s]
  3%|▎         | 11964/371472 [56:46<33:13:02,  3.01it/s]
  3%|▎         | 11965/371472 [56:47<30:34:51,  3.27it/s]
  3%|▎         | 11966/371472 [56:47<29:32:33,  3.38it/s]
  3%|▎         | 11967/371472 [56:47<28:19:37,  3.53it/s]
  3%|▎         | 11968/371472 [56:47<28:19:42,  3.53it/s]
  3%|▎         | 11969/371472 [56:48<27:17:23,  3.66it/s]
  3%|▎         | 11970/371472 [56:48<27:10:16,  3.68it/s]
  3%|▎         | 11971/371472 [56:48<28:52:02,  3.46it/s]
  3%|▎         | 11972/371472 [56:48<29:16:47,  3.41it/s]
  3%|▎         | 11973/371472 [56:49<29:06:56,  3.43it/s]
  3%|▎         | 11974/371472 [56:49<27:50:25,  3.59it/s]
  3%|▎         | 11975/371472 [56:49<27:48:51,  3.59it/s]
  3%|▎         | 11976/371472 [56:50<27:43:56,  3.60it/s]
  3%|▎         | 11977/371472 [56:50<26:59:10,  3.70it/s]
  3%|▎         | 11978/371472 [56:50<26:02:25,  3.83it/s]
  3%|▎         | 11979/371472 [56:50<26:38:58,  3.75it/s]
  3%|▎         | 11980/371472 [56:51<26:41:23,  3.74it/s]
                                                         
{'loss': 4.938, 'learning_rate': 9.714441164429314e-07, 'epoch': 0.52}

  3%|▎         | 11980/371472 [56:51<26:41:23,  3.74it/s]
  3%|▎         | 11981/371472 [56:51<26:15:42,  3.80it/s]
  3%|▎         | 11982/371472 [56:51<27:00:04,  3.70it/s]
  3%|▎         | 11983/371472 [56:51<28:07:19,  3.55it/s]
  3%|▎         | 11984/371472 [56:52<27:14:11,  3.67it/s]
  3%|▎         | 11985/371472 [56:52<30:29:34,  3.27it/s]
  3%|▎         | 11986/371472 [56:52<29:33:55,  3.38it/s]
  3%|▎         | 11987/371472 [56:53<32:28:03,  3.08it/s]
  3%|▎         | 11988/371472 [56:53<30:22:57,  3.29it/s]
  3%|▎         | 11989/371472 [56:53<29:22:27,  3.40it/s]
  3%|▎         | 11990/371472 [56:54<28:34:47,  3.49it/s]
  3%|▎         | 11991/371472 [56:54<28:34:44,  3.49it/s]
  3%|▎         | 11992/371472 [56:54<27:16:40,  3.66it/s]
  3%|▎         | 11993/371472 [56:54<28:02:14,  3.56it/s]
  3%|▎         | 11994/371472 [56:55<28:06:36,  3.55it/s]
  3%|▎         | 11995/371472 [56:55<27:41:25,  3.61it/s]
  3%|▎         | 11996/371472 [56:55<27:43:56,  3.60it/s]
  3%|▎         | 11997/371472 [56:56<29:17:44,  3.41it/s]
  3%|▎         | 11998/371472 [56:56<29:24:19,  3.40it/s]
  3%|▎         | 11999/371472 [56:56<30:58:29,  3.22it/s]
  3%|▎         | 12000/371472 [56:56<30:05:56,  3.32it/s]
                                                         
{'loss': 4.6868, 'learning_rate': 9.713956344674523e-07, 'epoch': 0.52}

  3%|▎         | 12000/371472 [56:56<30:05:56,  3.32it/s]
  3%|▎         | 12001/371472 [56:57<30:16:50,  3.30it/s]
  3%|▎         | 12002/371472 [56:57<29:01:35,  3.44it/s]
  3%|▎         | 12003/371472 [56:57<28:13:01,  3.54it/s]
  3%|▎         | 12004/371472 [56:58<26:50:41,  3.72it/s]
  3%|▎         | 12005/371472 [56:58<28:06:28,  3.55it/s]
  3%|▎         | 12006/371472 [56:58<29:41:03,  3.36it/s]
  3%|▎         | 12007/371472 [56:58<29:42:10,  3.36it/s]
  3%|▎         | 12008/371472 [56:59<29:07:21,  3.43it/s]
  3%|▎         | 12009/371472 [56:59<29:31:41,  3.38it/s]
  3%|▎         | 12010/371472 [56:59<30:02:48,  3.32it/s]
  3%|▎         | 12011/371472 [57:00<29:19:12,  3.41it/s]
  3%|▎         | 12012/371472 [57:00<28:21:19,  3.52it/s]
  3%|▎         | 12013/371472 [57:00<27:41:34,  3.61it/s]
  3%|▎         | 12014/371472 [57:00<27:54:53,  3.58it/s]
  3%|▎         | 12015/371472 [57:01<27:44:45,  3.60it/s]
  3%|▎         | 12016/371472 [57:01<29:29:06,  3.39it/s]
  3%|▎         | 12017/371472 [57:01<28:07:15,  3.55it/s]
  3%|▎         | 12018/371472 [57:02<27:52:04,  3.58it/s]
  3%|▎         | 12019/371472 [57:02<28:07:18,  3.55it/s]
  3%|▎         | 12020/371472 [57:02<27:23:54,  3.64it/s]
                                                         
{'loss': 4.7499, 'learning_rate': 9.713471524919735e-07, 'epoch': 0.52}

  3%|▎         | 12020/371472 [57:02<27:23:54,  3.64it/s]
  3%|▎         | 12021/371472 [57:02<27:11:47,  3.67it/s]
  3%|▎         | 12022/371472 [57:03<26:27:12,  3.77it/s]
  3%|▎         | 12023/371472 [57:03<26:25:45,  3.78it/s]
  3%|▎         | 12024/371472 [57:03<26:56:09,  3.71it/s]
  3%|▎         | 12025/371472 [57:04<27:49:23,  3.59it/s]
  3%|▎         | 12026/371472 [57:04<27:17:23,  3.66it/s]
  3%|▎         | 12027/371472 [57:04<28:52:21,  3.46it/s]
  3%|▎         | 12028/371472 [57:04<27:57:14,  3.57it/s]
  3%|▎         | 12029/371472 [57:05<30:12:12,  3.31it/s]
  3%|▎         | 12030/371472 [57:05<29:21:59,  3.40it/s]
  3%|▎         | 12031/371472 [57:05<29:34:49,  3.38it/s]
  3%|▎         | 12032/371472 [57:06<28:16:35,  3.53it/s]
  3%|▎         | 12033/371472 [57:06<27:19:40,  3.65it/s]
  3%|▎         | 12034/371472 [57:06<26:45:31,  3.73it/s]
  3%|▎         | 12035/371472 [57:06<26:27:32,  3.77it/s]
  3%|▎         | 12036/371472 [57:07<26:16:18,  3.80it/s]
  3%|▎         | 12037/371472 [57:07<26:24:17,  3.78it/s]
  3%|▎         | 12038/371472 [57:07<27:34:32,  3.62it/s]
  3%|▎         | 12039/371472 [57:07<28:16:58,  3.53it/s]
  3%|▎         | 12040/371472 [57:08<28:03:08,  3.56it/s]
                                                         
{'loss': 4.5444, 'learning_rate': 9.712986705164946e-07, 'epoch': 0.52}

  3%|▎         | 12040/371472 [57:08<28:03:08,  3.56it/s]
  3%|▎         | 12041/371472 [57:08<30:14:03,  3.30it/s]
  3%|▎         | 12042/371472 [57:08<29:36:29,  3.37it/s]
  3%|▎         | 12043/371472 [57:09<29:20:35,  3.40it/s]
  3%|▎         | 12044/371472 [57:09<28:04:44,  3.56it/s]
  3%|▎         | 12045/371472 [57:09<28:15:26,  3.53it/s]
  3%|▎         | 12046/371472 [57:10<29:36:37,  3.37it/s]
  3%|▎         | 12047/371472 [57:10<28:20:10,  3.52it/s]
  3%|▎         | 12048/371472 [57:10<28:12:10,  3.54it/s]
  3%|▎         | 12049/371472 [57:10<27:11:15,  3.67it/s]
  3%|▎         | 12050/371472 [57:11<26:48:14,  3.72it/s]
  3%|▎         | 12051/371472 [57:11<28:28:21,  3.51it/s]
  3%|▎         | 12052/371472 [57:11<27:41:42,  3.60it/s]
  3%|▎         | 12053/371472 [57:11<26:41:44,  3.74it/s]
  3%|▎         | 12054/371472 [57:12<26:16:38,  3.80it/s]
  3%|▎         | 12055/371472 [57:12<27:30:34,  3.63it/s]
  3%|▎         | 12056/371472 [57:12<26:49:34,  3.72it/s]
  3%|▎         | 12057/371472 [57:12<27:34:58,  3.62it/s]
  3%|▎         | 12058/371472 [57:13<27:09:51,  3.68it/s]
  3%|▎         | 12059/371472 [57:13<27:18:16,  3.66it/s]
  3%|▎         | 12060/371472 [57:13<27:15:50,  3.66it/s]
                                                         
{'loss': 4.7128, 'learning_rate': 9.712501885410157e-07, 'epoch': 0.52}

  3%|▎         | 12060/371472 [57:13<27:15:50,  3.66it/s]
  3%|▎         | 12061/371472 [57:14<26:31:44,  3.76it/s]
  3%|▎         | 12062/371472 [57:14<28:44:15,  3.47it/s]
  3%|▎         | 12063/371472 [57:14<29:46:03,  3.35it/s]
  3%|▎         | 12064/371472 [57:14<29:04:06,  3.43it/s]
  3%|▎         | 12065/371472 [57:15<28:35:16,  3.49it/s]
  3%|▎         | 12066/371472 [57:15<29:00:17,  3.44it/s]
  3%|▎         | 12067/371472 [57:15<27:34:15,  3.62it/s]
  3%|▎         | 12068/371472 [57:16<27:02:29,  3.69it/s]
  3%|▎         | 12069/371472 [57:16<26:22:16,  3.79it/s]
  3%|▎         | 12070/371472 [57:16<27:23:47,  3.64it/s]
  3%|▎         | 12071/371472 [57:16<26:57:33,  3.70it/s]
  3%|▎         | 12072/371472 [57:17<26:02:45,  3.83it/s]
  3%|▎         | 12073/371472 [57:17<28:06:56,  3.55it/s]
  3%|▎         | 12074/371472 [57:17<29:49:53,  3.35it/s]
  3%|▎         | 12075/371472 [57:18<28:49:19,  3.46it/s]
  3%|▎         | 12076/371472 [57:18<28:18:18,  3.53it/s]
  3%|▎         | 12077/371472 [57:18<28:19:49,  3.52it/s]
  3%|▎         | 12078/371472 [57:18<27:51:47,  3.58it/s]
  3%|▎         | 12079/371472 [57:19<27:45:55,  3.60it/s]
  3%|▎         | 12080/371472 [57:19<28:28:12,  3.51it/s]
                                                         
{'loss': 4.6333, 'learning_rate': 9.71201706565537e-07, 'epoch': 0.52}

  3%|▎         | 12080/371472 [57:19<28:28:12,  3.51it/s]
  3%|▎         | 12081/371472 [57:19<28:06:00,  3.55it/s]
  3%|▎         | 12082/371472 [57:19<28:14:17,  3.54it/s]
  3%|▎         | 12083/371472 [57:20<27:36:34,  3.62it/s]
  3%|▎         | 12084/371472 [57:20<28:47:52,  3.47it/s]
  3%|▎         | 12085/371472 [57:20<28:22:47,  3.52it/s]
  3%|▎         | 12086/371472 [57:21<28:06:52,  3.55it/s]
  3%|▎         | 12087/371472 [57:21<27:11:13,  3.67it/s]
  3%|▎         | 12088/371472 [57:21<26:38:35,  3.75it/s]
  3%|▎         | 12089/371472 [57:21<28:06:48,  3.55it/s]
  3%|▎         | 12090/371472 [57:22<27:16:09,  3.66it/s]
  3%|▎         | 12091/371472 [57:22<27:45:53,  3.60it/s]
  3%|▎         | 12092/371472 [57:22<28:22:30,  3.52it/s]
  3%|▎         | 12093/371472 [57:23<28:34:03,  3.49it/s]
  3%|▎         | 12094/371472 [57:23<28:12:52,  3.54it/s]
  3%|▎         | 12095/371472 [57:23<28:31:57,  3.50it/s]
  3%|▎         | 12096/371472 [57:23<28:37:13,  3.49it/s]
  3%|▎         | 12097/371472 [57:24<28:33:06,  3.50it/s]
  3%|▎         | 12098/371472 [57:24<31:39:39,  3.15it/s]
  3%|▎         | 12099/371472 [57:24<32:02:09,  3.12it/s]
  3%|▎         | 12100/371472 [57:25<31:17:51,  3.19it/s]
                                                         
{'loss': 4.7689, 'learning_rate': 9.711532245900578e-07, 'epoch': 0.52}

  3%|▎         | 12100/371472 [57:25<31:17:51,  3.19it/s]
  3%|▎         | 12101/371472 [57:25<30:50:26,  3.24it/s]
  3%|▎         | 12102/371472 [57:25<28:37:31,  3.49it/s]
  3%|▎         | 12103/371472 [57:26<28:03:54,  3.56it/s]
  3%|▎         | 12104/371472 [57:26<27:18:00,  3.66it/s]
  3%|▎         | 12105/371472 [57:26<28:53:49,  3.45it/s]
  3%|▎         | 12106/371472 [57:26<29:43:10,  3.36it/s]
  3%|▎         | 12107/371472 [57:27<28:47:54,  3.47it/s]
  3%|▎         | 12108/371472 [57:27<27:21:52,  3.65it/s]
  3%|▎         | 12109/371472 [57:27<27:32:44,  3.62it/s]
  3%|▎         | 12110/371472 [57:28<28:40:35,  3.48it/s]
  3%|▎         | 12111/371472 [57:28<28:01:47,  3.56it/s]
  3%|▎         | 12112/371472 [57:28<27:26:52,  3.64it/s]
  3%|▎         | 12113/371472 [57:28<28:12:05,  3.54it/s]
  3%|▎         | 12114/371472 [57:29<27:31:18,  3.63it/s]
  3%|▎         | 12115/371472 [57:29<28:47:36,  3.47it/s]
  3%|▎         | 12116/371472 [57:29<27:58:39,  3.57it/s]
  3%|▎         | 12117/371472 [57:29<26:51:52,  3.72it/s]
  3%|▎         | 12118/371472 [57:30<27:58:14,  3.57it/s]
  3%|▎         | 12119/371472 [57:30<27:34:13,  3.62it/s]
  3%|▎         | 12120/371472 [57:30<28:23:27,  3.52it/s]
                                                         
{'loss': 4.417, 'learning_rate': 9.71104742614579e-07, 'epoch': 0.52}

  3%|▎         | 12120/371472 [57:30<28:23:27,  3.52it/s]
  3%|▎         | 12121/371472 [57:31<28:02:07,  3.56it/s]
  3%|▎         | 12122/371472 [57:31<30:14:20,  3.30it/s]
  3%|▎         | 12123/371472 [57:31<29:16:52,  3.41it/s]
  3%|▎         | 12124/371472 [57:31<28:45:44,  3.47it/s]
  3%|▎         | 12125/371472 [57:32<31:00:40,  3.22it/s]
  3%|▎         | 12126/371472 [57:32<30:33:12,  3.27it/s]
  3%|▎         | 12127/371472 [57:32<29:34:47,  3.37it/s]
  3%|▎         | 12128/371472 [57:33<28:58:13,  3.45it/s]
  3%|▎         | 12129/371472 [57:33<28:11:34,  3.54it/s]
  3%|▎         | 12130/371472 [57:33<27:34:42,  3.62it/s]
  3%|▎         | 12131/371472 [57:33<26:53:57,  3.71it/s]
  3%|▎         | 12132/371472 [57:34<25:56:53,  3.85it/s]
  3%|▎         | 12133/371472 [57:34<26:54:18,  3.71it/s]
  3%|▎         | 12134/371472 [57:34<27:02:51,  3.69it/s]
  3%|▎         | 12135/371472 [57:35<30:08:50,  3.31it/s]
  3%|▎         | 12136/371472 [57:35<28:23:08,  3.52it/s]
  3%|▎         | 12137/371472 [57:35<27:43:40,  3.60it/s]
  3%|▎         | 12138/371472 [57:35<27:28:18,  3.63it/s]
  3%|▎         | 12139/371472 [57:36<27:40:14,  3.61it/s]
  3%|▎         | 12140/371472 [57:36<27:01:56,  3.69it/s]
                                                         
{'loss': 4.6453, 'learning_rate': 9.710562606391e-07, 'epoch': 0.52}

  3%|▎         | 12140/371472 [57:36<27:01:56,  3.69it/s]
  3%|▎         | 12141/371472 [57:36<28:07:06,  3.55it/s]
  3%|▎         | 12142/371472 [57:37<27:52:58,  3.58it/s]
  3%|▎         | 12143/371472 [57:37<28:36:46,  3.49it/s]
  3%|▎         | 12144/371472 [57:37<28:54:00,  3.45it/s]
  3%|▎         | 12145/371472 [57:37<29:31:02,  3.38it/s]
  3%|▎         | 12146/371472 [57:38<32:10:36,  3.10it/s]
  3%|▎         | 12147/371472 [57:38<30:58:23,  3.22it/s]
  3%|▎         | 12148/371472 [57:38<30:14:01,  3.30it/s]
  3%|▎         | 12149/371472 [57:39<29:05:29,  3.43it/s]
  3%|▎         | 12150/371472 [57:39<28:44:07,  3.47it/s]
  3%|▎         | 12151/371472 [57:39<29:04:22,  3.43it/s]
  3%|▎         | 12152/371472 [57:40<27:58:54,  3.57it/s]
  3%|▎         | 12153/371472 [57:40<26:50:31,  3.72it/s]
  3%|▎         | 12154/371472 [57:40<26:06:05,  3.82it/s]
  3%|▎         | 12155/371472 [57:40<27:37:11,  3.61it/s]
  3%|▎         | 12156/371472 [57:41<26:58:46,  3.70it/s]
  3%|▎         | 12157/371472 [57:41<26:18:58,  3.79it/s]
  3%|▎         | 12158/371472 [57:41<25:58:47,  3.84it/s]
  3%|▎         | 12159/371472 [57:41<25:29:36,  3.92it/s]
  3%|▎         | 12160/371472 [57:42<29:27:39,  3.39it/s]
                                                         
{'loss': 4.7497, 'learning_rate': 9.710077786636212e-07, 'epoch': 0.52}

  3%|▎         | 12160/371472 [57:42<29:27:39,  3.39it/s]
  3%|▎         | 12161/371472 [57:42<28:07:34,  3.55it/s]
  3%|▎         | 12162/371472 [57:42<28:00:57,  3.56it/s]
  3%|▎         | 12163/371472 [57:42<27:22:11,  3.65it/s]
  3%|▎         | 12164/371472 [57:43<28:20:23,  3.52it/s]
  3%|▎         | 12165/371472 [57:43<27:29:21,  3.63it/s]
  3%|▎         | 12166/371472 [57:43<26:35:05,  3.75it/s]
  3%|▎         | 12167/371472 [57:44<26:10:49,  3.81it/s]
  3%|▎         | 12168/371472 [57:44<26:43:16,  3.74it/s]
  3%|▎         | 12169/371472 [57:44<26:44:04,  3.73it/s]
  3%|▎         | 12170/371472 [57:44<28:48:55,  3.46it/s]
  3%|▎         | 12171/371472 [57:45<28:01:29,  3.56it/s]
  3%|▎         | 12172/371472 [57:45<26:59:38,  3.70it/s]
  3%|▎         | 12173/371472 [57:45<26:53:06,  3.71it/s]
  3%|▎         | 12174/371472 [57:45<26:07:59,  3.82it/s]
  3%|▎         | 12175/371472 [57:46<26:26:38,  3.77it/s]
  3%|▎         | 12176/371472 [57:46<26:39:57,  3.74it/s]
  3%|▎         | 12177/371472 [57:46<25:59:59,  3.84it/s]
  3%|▎         | 12178/371472 [57:47<26:43:09,  3.74it/s]
  3%|▎         | 12179/371472 [57:47<26:33:09,  3.76it/s]
  3%|▎         | 12180/371472 [57:47<26:46:32,  3.73it/s]
                                                         
{'loss': 4.6708, 'learning_rate': 9.709592966881423e-07, 'epoch': 0.52}

  3%|▎         | 12180/371472 [57:47<26:46:32,  3.73it/s]
  3%|▎         | 12181/371472 [57:47<27:19:17,  3.65it/s]
  3%|▎         | 12182/371472 [57:48<26:39:26,  3.74it/s]
  3%|▎         | 12183/371472 [57:48<25:48:33,  3.87it/s]
  3%|▎         | 12184/371472 [57:48<27:23:20,  3.64it/s]
  3%|▎         | 12185/371472 [57:48<28:11:37,  3.54it/s]
  3%|▎         | 12186/371472 [57:49<29:14:12,  3.41it/s]
  3%|▎         | 12187/371472 [57:49<30:36:53,  3.26it/s]
  3%|▎         | 12188/371472 [57:49<29:06:41,  3.43it/s]
  3%|▎         | 12189/371472 [57:50<29:18:18,  3.41it/s]
  3%|▎         | 12190/371472 [57:50<29:41:32,  3.36it/s]
  3%|▎         | 12191/371472 [57:50<29:59:02,  3.33it/s]
  3%|▎         | 12192/371472 [57:51<28:43:45,  3.47it/s]
  3%|▎         | 12193/371472 [57:51<27:43:47,  3.60it/s]
  3%|▎         | 12194/371472 [57:51<27:37:34,  3.61it/s]
  3%|▎         | 12195/371472 [57:51<28:09:57,  3.54it/s]
  3%|▎         | 12196/371472 [57:52<29:18:37,  3.40it/s]
  3%|▎         | 12197/371472 [57:52<29:47:03,  3.35it/s]
  3%|▎         | 12198/371472 [57:52<29:51:12,  3.34it/s]
  3%|▎         | 12199/371472 [57:53<29:24:33,  3.39it/s]
  3%|▎         | 12200/371472 [57:53<28:29:11,  3.50it/s]
                                                         
{'loss': 4.6749, 'learning_rate': 9.709108147126634e-07, 'epoch': 0.53}

  3%|▎         | 12200/371472 [57:53<28:29:11,  3.50it/s]
  3%|▎         | 12201/371472 [57:53<27:32:04,  3.62it/s]
  3%|▎         | 12202/371472 [57:53<29:33:41,  3.38it/s]
  3%|▎         | 12203/371472 [57:54<29:04:51,  3.43it/s]
  3%|▎         | 12204/371472 [57:54<32:19:39,  3.09it/s]
  3%|▎         | 12205/371472 [57:54<33:03:17,  3.02it/s]
  3%|▎         | 12206/371472 [57:55<31:34:23,  3.16it/s]
  3%|▎         | 12207/371472 [57:55<32:43:50,  3.05it/s]
  3%|▎         | 12208/371472 [57:55<32:18:28,  3.09it/s]
  3%|▎         | 12209/371472 [57:56<30:10:01,  3.31it/s]
  3%|▎         | 12210/371472 [57:56<31:21:17,  3.18it/s]
  3%|▎         | 12211/371472 [57:56<31:18:58,  3.19it/s]
  3%|▎         | 12212/371472 [57:57<29:38:21,  3.37it/s]
  3%|▎         | 12213/371472 [57:57<28:37:40,  3.49it/s]
  3%|▎         | 12214/371472 [57:57<30:46:13,  3.24it/s]
  3%|▎         | 12215/371472 [57:57<29:53:25,  3.34it/s]
  3%|▎         | 12216/371472 [57:58<29:37:36,  3.37it/s]
  3%|▎         | 12217/371472 [57:58<29:26:17,  3.39it/s]
  3%|▎         | 12218/371472 [57:58<28:54:44,  3.45it/s]
  3%|▎         | 12219/371472 [57:59<28:36:53,  3.49it/s]
  3%|▎         | 12220/371472 [57:59<29:13:13,  3.42it/s]
                                                         
{'loss': 4.5748, 'learning_rate': 9.708623327371847e-07, 'epoch': 0.53}

  3%|▎         | 12220/371472 [57:59<29:13:13,  3.42it/s]
  3%|▎         | 12221/371472 [57:59<29:04:21,  3.43it/s]
  3%|▎         | 12222/371472 [58:00<30:20:27,  3.29it/s]
  3%|▎         | 12223/371472 [58:00<29:02:08,  3.44it/s]
  3%|▎         | 12224/371472 [58:00<28:19:06,  3.52it/s]
  3%|▎         | 12225/371472 [58:00<28:01:04,  3.56it/s]
  3%|▎         | 12226/371472 [58:01<26:54:31,  3.71it/s]
  3%|▎         | 12227/371472 [58:01<26:11:05,  3.81it/s]
  3%|▎         | 12228/371472 [58:01<27:06:15,  3.68it/s]
  3%|▎         | 12229/371472 [58:01<28:57:41,  3.45it/s]
  3%|▎         | 12230/371472 [58:02<31:38:43,  3.15it/s]
  3%|▎         | 12231/371472 [58:02<34:02:03,  2.93it/s]
  3%|▎         | 12232/371472 [58:03<32:13:10,  3.10it/s]
  3%|▎         | 12233/371472 [58:03<30:16:59,  3.30it/s]
  3%|▎         | 12234/371472 [58:03<30:02:14,  3.32it/s]
  3%|▎         | 12235/371472 [58:03<28:23:23,  3.51it/s]
  3%|▎         | 12236/371472 [58:04<28:12:21,  3.54it/s]
  3%|▎         | 12237/371472 [58:04<28:19:48,  3.52it/s]
  3%|▎         | 12238/371472 [58:04<28:41:06,  3.48it/s]
  3%|▎         | 12239/371472 [58:04<28:27:33,  3.51it/s]
  3%|▎         | 12240/371472 [58:05<27:12:31,  3.67it/s]
                                                         
{'loss': 4.4467, 'learning_rate': 9.708138507617055e-07, 'epoch': 0.53}

  3%|▎         | 12240/371472 [58:05<27:12:31,  3.67it/s]
  3%|▎         | 12241/371472 [58:05<27:39:58,  3.61it/s]
  3%|▎         | 12242/371472 [58:05<28:15:33,  3.53it/s]
  3%|▎         | 12243/371472 [58:06<30:18:44,  3.29it/s]
  3%|▎         | 12244/371472 [58:06<31:32:12,  3.16it/s]
  3%|▎         | 12245/371472 [58:06<30:38:44,  3.26it/s]
  3%|▎         | 12246/371472 [58:07<29:27:27,  3.39it/s]
  3%|▎         | 12247/371472 [58:07<29:22:54,  3.40it/s]
  3%|▎         | 12248/371472 [58:07<29:48:52,  3.35it/s]
  3%|▎         | 12249/371472 [58:07<28:30:30,  3.50it/s]
  3%|▎         | 12250/371472 [58:08<27:55:35,  3.57it/s]
  3%|▎         | 12251/371472 [58:08<27:30:14,  3.63it/s]
  3%|▎         | 12252/371472 [58:08<27:44:24,  3.60it/s]
  3%|▎         | 12253/371472 [58:08<27:56:40,  3.57it/s]
  3%|▎         | 12254/371472 [58:09<27:10:12,  3.67it/s]
  3%|▎         | 12255/371472 [58:09<27:35:42,  3.62it/s]
  3%|▎         | 12256/371472 [58:09<27:32:37,  3.62it/s]
  3%|▎         | 12257/371472 [58:10<27:19:58,  3.65it/s]
  3%|▎         | 12258/371472 [58:10<27:10:08,  3.67it/s]
  3%|▎         | 12259/371472 [58:10<27:08:09,  3.68it/s]
  3%|▎         | 12260/371472 [58:10<27:31:16,  3.63it/s]
                                                         
{'loss': 4.5542, 'learning_rate': 9.707653687862268e-07, 'epoch': 0.53}

  3%|▎         | 12260/371472 [58:10<27:31:16,  3.63it/s]
  3%|▎         | 12261/371472 [58:11<27:47:53,  3.59it/s]
  3%|▎         | 12262/371472 [58:11<27:16:47,  3.66it/s]
  3%|▎         | 12263/371472 [58:11<30:08:36,  3.31it/s]
  3%|▎         | 12264/371472 [58:12<28:51:58,  3.46it/s]
  3%|▎         | 12265/371472 [58:12<29:28:36,  3.39it/s]
  3%|▎         | 12266/371472 [58:12<29:11:50,  3.42it/s]
  3%|▎         | 12267/371472 [58:13<30:06:55,  3.31it/s]
  3%|▎         | 12268/371472 [58:13<30:43:55,  3.25it/s]
  3%|▎         | 12269/371472 [58:13<29:21:24,  3.40it/s]
  3%|▎         | 12270/371472 [58:13<28:16:17,  3.53it/s]
  3%|▎         | 12271/371472 [58:14<27:30:45,  3.63it/s]
  3%|▎         | 12272/371472 [58:14<29:26:00,  3.39it/s]
  3%|▎         | 12273/371472 [58:14<29:07:10,  3.43it/s]
  3%|▎         | 12274/371472 [58:14<28:13:43,  3.53it/s]
  3%|▎         | 12275/371472 [58:15<28:04:43,  3.55it/s]
  3%|▎         | 12276/371472 [58:15<27:50:54,  3.58it/s]
  3%|▎         | 12277/371472 [58:15<28:25:13,  3.51it/s]
  3%|▎         | 12278/371472 [58:16<27:00:31,  3.69it/s]
  3%|▎         | 12279/371472 [58:16<29:19:45,  3.40it/s]
  3%|▎         | 12280/371472 [58:16<27:45:44,  3.59it/s]
                                                         
{'loss': 4.7008, 'learning_rate': 9.707168868107479e-07, 'epoch': 0.53}

  3%|▎         | 12280/371472 [58:16<27:45:44,  3.59it/s]
  3%|▎         | 12281/371472 [58:16<29:19:20,  3.40it/s]
  3%|▎         | 12282/371472 [58:17<27:20:08,  3.65it/s]
  3%|▎         | 12283/371472 [58:17<26:57:55,  3.70it/s]
  3%|▎         | 12284/371472 [58:17<27:16:52,  3.66it/s]
  3%|▎         | 12285/371472 [58:18<28:02:05,  3.56it/s]
  3%|▎         | 12286/371472 [58:18<28:07:47,  3.55it/s]
  3%|▎         | 12287/371472 [58:18<27:08:33,  3.68it/s]
  3%|▎         | 12288/371472 [58:18<27:04:45,  3.68it/s]
  3%|▎         | 12289/371472 [58:19<28:33:34,  3.49it/s]
  3%|▎         | 12290/371472 [58:19<28:20:50,  3.52it/s]
  3%|▎         | 12291/371472 [58:19<27:09:59,  3.67it/s]
  3%|▎         | 12292/371472 [58:20<28:33:05,  3.49it/s]
  3%|▎         | 12293/371472 [58:20<27:48:35,  3.59it/s]
  3%|▎         | 12294/371472 [58:20<27:07:55,  3.68it/s]
  3%|▎         | 12295/371472 [58:20<28:19:46,  3.52it/s]
  3%|▎         | 12296/371472 [58:21<27:22:32,  3.64it/s]
  3%|▎         | 12297/371472 [58:21<26:54:03,  3.71it/s]
  3%|▎         | 12298/371472 [58:21<27:49:36,  3.59it/s]
  3%|▎         | 12299/371472 [58:22<30:15:53,  3.30it/s]
  3%|▎         | 12300/371472 [58:22<29:19:02,  3.40it/s]
                                                         
{'loss': 4.4736, 'learning_rate': 9.70668404835269e-07, 'epoch': 0.53}

  3%|▎         | 12300/371472 [58:22<29:19:02,  3.40it/s]
  3%|▎         | 12301/371472 [58:22<29:20:43,  3.40it/s]
  3%|▎         | 12302/371472 [58:23<32:50:45,  3.04it/s]
  3%|▎         | 12303/371472 [58:23<30:23:15,  3.28it/s]
  3%|▎         | 12304/371472 [58:23<30:30:44,  3.27it/s]
  3%|▎         | 12305/371472 [58:23<29:05:02,  3.43it/s]
  3%|▎         | 12306/371472 [58:24<27:45:22,  3.59it/s]
  3%|▎         | 12307/371472 [58:24<31:42:33,  3.15it/s]
  3%|▎         | 12308/371472 [58:24<29:57:23,  3.33it/s]
  3%|▎         | 12309/371472 [58:25<30:30:44,  3.27it/s]
  3%|▎         | 12310/371472 [58:25<30:07:00,  3.31it/s]
  3%|▎         | 12311/371472 [58:25<28:33:24,  3.49it/s]
  3%|▎         | 12312/371472 [58:25<30:22:55,  3.28it/s]
  3%|▎         | 12313/371472 [58:26<29:54:57,  3.33it/s]
  3%|▎         | 12314/371472 [58:26<29:11:22,  3.42it/s]
  3%|▎         | 12315/371472 [58:26<29:26:00,  3.39it/s]
  3%|▎         | 12316/371472 [58:27<29:23:39,  3.39it/s]
  3%|▎         | 12317/371472 [58:27<28:15:33,  3.53it/s]
  3%|▎         | 12318/371472 [58:27<28:17:17,  3.53it/s]
  3%|▎         | 12319/371472 [58:27<30:09:19,  3.31it/s]
  3%|▎         | 12320/371472 [58:28<31:02:53,  3.21it/s]
                                                         
{'loss': 4.5476, 'learning_rate': 9.706199228597902e-07, 'epoch': 0.53}

  3%|▎         | 12320/371472 [58:28<31:02:53,  3.21it/s]
  3%|▎         | 12321/371472 [58:28<28:55:02,  3.45it/s]
  3%|▎         | 12322/371472 [58:28<28:56:47,  3.45it/s]
  3%|▎         | 12323/371472 [58:29<28:41:06,  3.48it/s]
  3%|▎         | 12324/371472 [58:29<29:09:46,  3.42it/s]
  3%|▎         | 12325/371472 [58:29<28:48:51,  3.46it/s]
  3%|▎         | 12326/371472 [58:30<28:37:47,  3.48it/s]
  3%|▎         | 12327/371472 [58:30<30:30:16,  3.27it/s]
  3%|▎         | 12328/371472 [58:30<29:33:08,  3.38it/s]
  3%|▎         | 12329/371472 [58:30<29:07:15,  3.43it/s]
  3%|▎         | 12330/371472 [58:31<28:33:57,  3.49it/s]
  3%|▎         | 12331/371472 [58:31<27:43:14,  3.60it/s]
  3%|▎         | 12332/371472 [58:31<28:15:37,  3.53it/s]
  3%|▎         | 12333/371472 [58:32<27:54:06,  3.58it/s]
  3%|▎         | 12334/371472 [58:32<28:43:56,  3.47it/s]
  3%|▎         | 12335/371472 [58:32<28:16:53,  3.53it/s]
  3%|▎         | 12336/371472 [58:32<27:45:05,  3.59it/s]
  3%|▎         | 12337/371472 [58:33<26:39:28,  3.74it/s]
  3%|▎         | 12338/371472 [58:33<26:48:04,  3.72it/s]
  3%|▎         | 12339/371472 [58:33<27:06:14,  3.68it/s]
  3%|▎         | 12340/371472 [58:33<26:12:15,  3.81it/s]
                                                         
{'loss': 4.8016, 'learning_rate': 9.70571440884311e-07, 'epoch': 0.53}

  3%|▎         | 12340/371472 [58:33<26:12:15,  3.81it/s]
  3%|▎         | 12341/371472 [58:34<25:38:03,  3.89it/s]
  3%|▎         | 12342/371472 [58:34<29:05:26,  3.43it/s]
  3%|▎         | 12343/371472 [58:34<28:20:16,  3.52it/s]
  3%|▎         | 12344/371472 [58:35<29:50:51,  3.34it/s]
  3%|▎         | 12345/371472 [58:35<27:55:21,  3.57it/s]
  3%|▎         | 12346/371472 [58:35<26:42:00,  3.74it/s]
  3%|▎         | 12347/371472 [58:35<29:53:42,  3.34it/s]
  3%|▎         | 12348/371472 [58:36<31:55:45,  3.12it/s]
  3%|▎         | 12349/371472 [58:36<30:12:42,  3.30it/s]
  3%|▎         | 12350/371472 [58:36<29:18:10,  3.40it/s]
  3%|▎         | 12351/371472 [58:37<28:06:26,  3.55it/s]
  3%|▎         | 12352/371472 [58:37<28:45:44,  3.47it/s]
  3%|▎         | 12353/371472 [58:37<27:45:02,  3.59it/s]
  3%|▎         | 12354/371472 [58:37<27:07:55,  3.68it/s]
  3%|▎         | 12355/371472 [58:38<26:21:04,  3.79it/s]
  3%|▎         | 12356/371472 [58:38<25:45:30,  3.87it/s]
  3%|▎         | 12357/371472 [58:38<25:59:13,  3.84it/s]
  3%|▎         | 12358/371472 [58:38<26:58:00,  3.70it/s]
  3%|▎         | 12359/371472 [58:39<29:42:04,  3.36it/s]
  3%|▎         | 12360/371472 [58:39<28:59:52,  3.44it/s]
                                                         
{'loss': 4.8178, 'learning_rate': 9.705229589088324e-07, 'epoch': 0.53}

  3%|▎         | 12360/371472 [58:39<28:59:52,  3.44it/s]
  3%|▎         | 12361/371472 [58:39<28:11:34,  3.54it/s]
  3%|▎         | 12362/371472 [58:40<29:52:31,  3.34it/s]
  3%|▎         | 12363/371472 [58:40<29:39:46,  3.36it/s]
  3%|▎         | 12364/371472 [58:40<29:43:56,  3.36it/s]
  3%|▎         | 12365/371472 [58:41<29:06:00,  3.43it/s]
  3%|▎         | 12366/371472 [58:41<27:52:42,  3.58it/s]
  3%|▎         | 12367/371472 [58:41<27:03:45,  3.69it/s]
  3%|▎         | 12368/371472 [58:41<26:38:16,  3.74it/s]
  3%|▎         | 12369/371472 [58:42<27:34:43,  3.62it/s]
  3%|▎         | 12370/371472 [58:42<28:00:28,  3.56it/s]
  3%|▎         | 12371/371472 [58:42<28:18:36,  3.52it/s]
  3%|▎         | 12372/371472 [58:42<27:49:03,  3.59it/s]
  3%|▎         | 12373/371472 [58:43<28:38:23,  3.48it/s]
  3%|▎         | 12374/371472 [58:43<29:36:25,  3.37it/s]
  3%|▎         | 12375/371472 [58:43<29:07:46,  3.42it/s]
  3%|▎         | 12376/371472 [58:44<31:35:41,  3.16it/s]
  3%|▎         | 12377/371472 [58:44<30:07:10,  3.31it/s]
  3%|▎         | 12378/371472 [58:44<29:01:38,  3.44it/s]
  3%|▎         | 12379/371472 [58:45<29:37:54,  3.37it/s]
  3%|▎         | 12380/371472 [58:45<30:04:28,  3.32it/s]
                                                         
{'loss': 4.6261, 'learning_rate': 9.704744769333532e-07, 'epoch': 0.53}

  3%|▎         | 12380/371472 [58:45<30:04:28,  3.32it/s]
  3%|▎         | 12381/371472 [58:45<28:17:58,  3.52it/s]
  3%|▎         | 12382/371472 [58:46<30:26:44,  3.28it/s]
  3%|▎         | 12383/371472 [58:46<29:52:28,  3.34it/s]
  3%|▎         | 12384/371472 [58:46<30:23:13,  3.28it/s]
  3%|▎         | 12385/371472 [58:46<30:45:59,  3.24it/s]
  3%|▎         | 12386/371472 [58:47<30:10:34,  3.31it/s]
  3%|▎         | 12387/371472 [58:47<28:36:39,  3.49it/s]
  3%|▎         | 12388/371472 [58:47<29:23:45,  3.39it/s]
  3%|▎         | 12389/371472 [58:48<29:11:29,  3.42it/s]
  3%|▎         | 12390/371472 [58:48<29:45:00,  3.35it/s]
  3%|▎         | 12391/371472 [58:48<30:01:35,  3.32it/s]
  3%|▎         | 12392/371472 [58:49<30:21:17,  3.29it/s]
  3%|▎         | 12393/371472 [58:49<28:41:29,  3.48it/s]
  3%|▎         | 12394/371472 [58:49<29:38:49,  3.36it/s]
  3%|▎         | 12395/371472 [58:49<29:02:39,  3.43it/s]
  3%|▎         | 12396/371472 [58:50<29:48:33,  3.35it/s]
  3%|▎         | 12397/371472 [58:50<28:12:11,  3.54it/s]
  3%|▎         | 12398/371472 [58:50<27:27:56,  3.63it/s]
  3%|▎         | 12399/371472 [58:50<27:56:01,  3.57it/s]
  3%|▎         | 12400/371472 [58:51<28:28:22,  3.50it/s]
                                                         
{'loss': 4.5225, 'learning_rate': 9.704259949578745e-07, 'epoch': 0.53}

  3%|▎         | 12400/371472 [58:51<28:28:22,  3.50it/s]
  3%|▎         | 12401/371472 [58:51<28:19:50,  3.52it/s]
  3%|▎         | 12402/371472 [58:51<28:07:49,  3.55it/s]
  3%|▎         | 12403/371472 [58:52<27:46:58,  3.59it/s]
  3%|▎         | 12404/371472 [58:52<27:32:51,  3.62it/s]
  3%|▎         | 12405/371472 [58:52<28:01:51,  3.56it/s]
  3%|▎         | 12406/371472 [58:52<27:37:17,  3.61it/s]
  3%|▎         | 12407/371472 [58:53<27:50:13,  3.58it/s]
  3%|▎         | 12408/371472 [58:53<26:40:43,  3.74it/s]
  3%|▎         | 12409/371472 [58:53<26:38:32,  3.74it/s]
  3%|▎         | 12410/371472 [58:53<26:05:18,  3.82it/s]
  3%|▎         | 12411/371472 [58:54<27:02:16,  3.69it/s]
  3%|▎         | 12412/371472 [58:54<26:43:42,  3.73it/s]
  3%|▎         | 12413/371472 [58:54<27:22:26,  3.64it/s]
  3%|▎         | 12414/371472 [58:55<27:05:10,  3.68it/s]
  3%|▎         | 12415/371472 [58:55<26:57:22,  3.70it/s]
  3%|▎         | 12416/371472 [58:55<27:28:09,  3.63it/s]
  3%|▎         | 12417/371472 [58:55<27:43:16,  3.60it/s]
  3%|▎         | 12418/371472 [58:56<29:15:10,  3.41it/s]
  3%|▎         | 12419/371472 [58:56<29:20:39,  3.40it/s]
  3%|▎         | 12420/371472 [58:56<30:17:56,  3.29it/s]
                                                         
{'loss': 4.5948, 'learning_rate': 9.703775129823956e-07, 'epoch': 0.53}

  3%|▎         | 12420/371472 [58:56<30:17:56,  3.29it/s]
  3%|▎         | 12421/371472 [58:57<28:32:40,  3.49it/s]
  3%|▎         | 12422/371472 [58:57<27:37:34,  3.61it/s]
  3%|▎         | 12423/371472 [58:57<27:15:32,  3.66it/s]
  3%|▎         | 12424/371472 [58:57<27:11:37,  3.67it/s]
  3%|▎         | 12425/371472 [58:58<27:23:11,  3.64it/s]
  3%|▎         | 12426/371472 [58:58<27:09:40,  3.67it/s]
  3%|▎         | 12427/371472 [58:58<27:33:46,  3.62it/s]
  3%|▎         | 12428/371472 [58:59<27:13:18,  3.66it/s]
  3%|▎         | 12429/371472 [58:59<27:28:56,  3.63it/s]
  3%|▎         | 12430/371472 [58:59<30:03:51,  3.32it/s]
  3%|▎         | 12431/371472 [58:59<28:49:08,  3.46it/s]
  3%|▎         | 12432/371472 [59:00<27:16:05,  3.66it/s]
  3%|▎         | 12433/371472 [59:00<26:47:28,  3.72it/s]
  3%|▎         | 12434/371472 [59:00<26:10:22,  3.81it/s]
  3%|▎         | 12435/371472 [59:00<25:41:04,  3.88it/s]
  3%|▎         | 12436/371472 [59:01<26:29:03,  3.77it/s]
  3%|▎         | 12437/371472 [59:01<26:41:24,  3.74it/s]
  3%|▎         | 12438/371472 [59:01<26:54:40,  3.71it/s]
  3%|▎         | 12439/371472 [59:02<27:18:57,  3.65it/s]
  3%|▎         | 12440/371472 [59:02<32:42:34,  3.05it/s]
                                                         
{'loss': 4.6267, 'learning_rate': 9.703290310069167e-07, 'epoch': 0.54}

  3%|▎         | 12440/371472 [59:02<32:42:34,  3.05it/s]
  3%|▎         | 12441/371472 [59:02<30:21:35,  3.28it/s]
  3%|▎         | 12442/371472 [59:02<29:05:12,  3.43it/s]
  3%|▎         | 12443/371472 [59:03<28:50:22,  3.46it/s]
  3%|▎         | 12444/371472 [59:03<28:31:58,  3.50it/s]
  3%|▎         | 12445/371472 [59:03<30:21:54,  3.28it/s]
  3%|▎         | 12446/371472 [59:04<31:04:49,  3.21it/s]
  3%|▎         | 12447/371472 [59:04<32:38:47,  3.05it/s]
  3%|▎         | 12448/371472 [59:04<30:08:34,  3.31it/s]
  3%|▎         | 12449/371472 [59:05<29:20:21,  3.40it/s]
  3%|▎         | 12450/371472 [59:05<28:34:21,  3.49it/s]
  3%|▎         | 12451/371472 [59:05<30:23:48,  3.28it/s]
  3%|▎         | 12452/371472 [59:05<28:21:50,  3.52it/s]
  3%|▎         | 12453/371472 [59:06<28:13:14,  3.53it/s]
  3%|▎         | 12454/371472 [59:06<28:46:29,  3.47it/s]
  3%|▎         | 12455/371472 [59:06<27:21:11,  3.65it/s]
  3%|▎         | 12456/371472 [59:07<27:58:12,  3.57it/s]
  3%|▎         | 12457/371472 [59:07<28:21:49,  3.52it/s]
  3%|▎         | 12458/371472 [59:07<27:54:41,  3.57it/s]
  3%|▎         | 12459/371472 [59:07<26:50:54,  3.71it/s]
  3%|▎         | 12460/371472 [59:08<26:45:05,  3.73it/s]
                                                         
{'loss': 4.8665, 'learning_rate': 9.70280549031438e-07, 'epoch': 0.54}

  3%|▎         | 12460/371472 [59:08<26:45:05,  3.73it/s]
  3%|▎         | 12461/371472 [59:08<26:48:04,  3.72it/s]
  3%|▎         | 12462/371472 [59:08<26:45:14,  3.73it/s]
  3%|▎         | 12463/371472 [59:08<26:21:26,  3.78it/s]
  3%|▎         | 12464/371472 [59:09<26:35:32,  3.75it/s]
  3%|▎         | 12465/371472 [59:09<26:01:03,  3.83it/s]
  3%|▎         | 12466/371472 [59:09<25:19:59,  3.94it/s]
  3%|▎         | 12467/371472 [59:10<28:36:43,  3.49it/s]
  3%|▎         | 12468/371472 [59:10<27:26:14,  3.63it/s]
  3%|▎         | 12469/371472 [59:10<28:10:03,  3.54it/s]
  3%|▎         | 12470/371472 [59:10<27:28:33,  3.63it/s]
  3%|▎         | 12471/371472 [59:11<27:45:48,  3.59it/s]
  3%|▎         | 12472/371472 [59:11<27:56:27,  3.57it/s]
  3%|▎         | 12473/371472 [59:11<27:42:29,  3.60it/s]
  3%|▎         | 12474/371472 [59:12<28:37:45,  3.48it/s]
  3%|▎         | 12475/371472 [59:12<27:50:24,  3.58it/s]
  3%|▎         | 12476/371472 [59:12<28:36:10,  3.49it/s]
  3%|▎         | 12477/371472 [59:12<27:53:38,  3.57it/s]
  3%|▎         | 12478/371472 [59:13<28:19:55,  3.52it/s]
  3%|▎         | 12479/371472 [59:13<27:21:46,  3.64it/s]
  3%|▎         | 12480/371472 [59:13<26:37:46,  3.74it/s]
                                                         
{'loss': 4.6497, 'learning_rate': 9.702320670559588e-07, 'epoch': 0.54}

  3%|▎         | 12480/371472 [59:13<26:37:46,  3.74it/s]
  3%|▎         | 12481/371472 [59:13<26:47:35,  3.72it/s]
  3%|▎         | 12482/371472 [59:14<26:03:09,  3.83it/s]
  3%|▎         | 12483/371472 [59:14<28:10:26,  3.54it/s]
  3%|▎         | 12484/371472 [59:14<28:34:42,  3.49it/s]
  3%|▎         | 12485/371472 [59:15<27:38:16,  3.61it/s]
  3%|▎         | 12486/371472 [59:15<27:44:22,  3.59it/s]
  3%|▎         | 12487/371472 [59:15<27:15:21,  3.66it/s]
  3%|▎         | 12488/371472 [59:15<27:02:46,  3.69it/s]
  3%|▎         | 12489/371472 [59:16<27:27:10,  3.63it/s]
  3%|▎         | 12490/371472 [59:16<27:26:54,  3.63it/s]
  3%|▎         | 12491/371472 [59:16<26:31:40,  3.76it/s]
  3%|▎         | 12492/371472 [59:16<26:48:45,  3.72it/s]
  3%|▎         | 12493/371472 [59:17<28:24:13,  3.51it/s]
  3%|▎         | 12494/371472 [59:17<29:10:32,  3.42it/s]
  3%|▎         | 12495/371472 [59:17<28:20:18,  3.52it/s]
  3%|▎         | 12496/371472 [59:18<27:55:57,  3.57it/s]
  3%|▎         | 12497/371472 [59:18<27:54:03,  3.57it/s]
  3%|▎         | 12498/371472 [59:18<28:56:14,  3.45it/s]
  3%|▎         | 12499/371472 [59:18<29:22:52,  3.39it/s]
  3%|▎         | 12500/371472 [59:19<29:08:35,  3.42it/s]
                                                         
{'loss': 4.6235, 'learning_rate': 9.7018358508048e-07, 'epoch': 0.54}

  3%|▎         | 12500/371472 [59:19<29:08:35,  3.42it/s]
  3%|▎         | 12501/371472 [59:19<27:50:43,  3.58it/s]
  3%|▎         | 12502/371472 [59:19<28:02:21,  3.56it/s]
  3%|▎         | 12503/371472 [59:20<28:32:47,  3.49it/s]
  3%|▎         | 12504/371472 [59:20<28:15:08,  3.53it/s]
  3%|▎         | 12505/371472 [59:20<27:19:04,  3.65it/s]
  3%|▎         | 12506/371472 [59:20<27:43:20,  3.60it/s]
  3%|▎         | 12507/371472 [59:21<26:47:18,  3.72it/s]
  3%|▎         | 12508/371472 [59:21<26:51:52,  3.71it/s]
  3%|▎         | 12509/371472 [59:21<27:13:19,  3.66it/s]
  3%|▎         | 12510/371472 [59:22<28:09:09,  3.54it/s]
  3%|▎         | 12511/371472 [59:22<27:50:44,  3.58it/s]
  3%|▎         | 12512/371472 [59:22<28:12:24,  3.53it/s]
  3%|▎         | 12513/371472 [59:22<28:55:32,  3.45it/s]
  3%|▎         | 12514/371472 [59:23<28:06:16,  3.55it/s]
  3%|▎         | 12515/371472 [59:23<27:24:42,  3.64it/s]
  3%|▎         | 12516/371472 [59:23<27:25:07,  3.64it/s]
  3%|▎         | 12517/371472 [59:23<27:43:17,  3.60it/s]
  3%|▎         | 12518/371472 [59:24<29:08:37,  3.42it/s]
  3%|▎         | 12519/371472 [59:24<27:51:09,  3.58it/s]
  3%|▎         | 12520/371472 [59:24<27:29:46,  3.63it/s]
                                                         
{'loss': 4.5948, 'learning_rate': 9.701351031050012e-07, 'epoch': 0.54}

  3%|▎         | 12520/371472 [59:24<27:29:46,  3.63it/s]
  3%|▎         | 12521/371472 [59:25<26:54:37,  3.71it/s]
  3%|▎         | 12522/371472 [59:25<25:43:30,  3.88it/s]
  3%|▎         | 12523/371472 [59:25<26:56:21,  3.70it/s]
  3%|▎         | 12524/371472 [59:25<27:51:00,  3.58it/s]
  3%|▎         | 12525/371472 [59:26<27:01:30,  3.69it/s]
  3%|▎         | 12526/371472 [59:26<28:25:55,  3.51it/s]
  3%|▎         | 12527/371472 [59:26<27:16:37,  3.66it/s]
  3%|▎         | 12528/371472 [59:26<26:57:34,  3.70it/s]
  3%|▎         | 12529/371472 [59:27<26:30:37,  3.76it/s]
  3%|▎         | 12530/371472 [59:27<25:55:46,  3.85it/s]
  3%|▎         | 12531/371472 [59:27<27:13:37,  3.66it/s]
  3%|▎         | 12532/371472 [59:28<26:58:58,  3.70it/s]
  3%|▎         | 12533/371472 [59:28<27:35:13,  3.61it/s]
  3%|▎         | 12534/371472 [59:28<28:33:58,  3.49it/s]
  3%|▎         | 12535/371472 [59:28<28:37:30,  3.48it/s]
  3%|▎         | 12536/371472 [59:29<28:58:38,  3.44it/s]
  3%|▎         | 12537/371472 [59:29<29:51:39,  3.34it/s]
  3%|▎         | 12538/371472 [59:29<30:05:48,  3.31it/s]
  3%|▎         | 12539/371472 [59:30<29:58:05,  3.33it/s]
  3%|▎         | 12540/371472 [59:30<28:39:15,  3.48it/s]
                                                         
{'loss': 4.586, 'learning_rate': 9.700866211295222e-07, 'epoch': 0.54}

  3%|▎         | 12540/371472 [59:30<28:39:15,  3.48it/s]
  3%|▎         | 12541/371472 [59:30<28:02:37,  3.56it/s]
  3%|▎         | 12542/371472 [59:30<27:51:48,  3.58it/s]
  3%|▎         | 12543/371472 [59:31<28:38:21,  3.48it/s]
  3%|▎         | 12544/371472 [59:31<28:45:01,  3.47it/s]
  3%|▎         | 12545/371472 [59:31<27:37:18,  3.61it/s]
  3%|▎         | 12546/371472 [59:32<27:05:10,  3.68it/s]
  3%|▎         | 12547/371472 [59:32<27:20:00,  3.65it/s]
  3%|▎         | 12548/371472 [59:32<27:18:40,  3.65it/s]
  3%|▎         | 12549/371472 [59:32<28:22:47,  3.51it/s]
  3%|▎         | 12550/371472 [59:33<26:58:55,  3.70it/s]
  3%|▎         | 12551/371472 [59:33<26:35:14,  3.75it/s]
  3%|▎         | 12552/371472 [59:33<25:59:52,  3.83it/s]
  3%|▎         | 12553/371472 [59:33<25:41:34,  3.88it/s]
  3%|▎         | 12554/371472 [59:34<26:24:03,  3.78it/s]
  3%|▎         | 12555/371472 [59:34<25:52:59,  3.85it/s]
  3%|▎         | 12556/371472 [59:34<27:58:28,  3.56it/s]
  3%|▎         | 12557/371472 [59:35<28:04:47,  3.55it/s]
  3%|▎         | 12558/371472 [59:35<27:33:30,  3.62it/s]
  3%|▎         | 12559/371472 [59:35<27:56:44,  3.57it/s]
  3%|▎         | 12560/371472 [59:35<30:07:14,  3.31it/s]
                                                         
{'loss': 4.5366, 'learning_rate': 9.700381391540435e-07, 'epoch': 0.54}

  3%|▎         | 12560/371472 [59:35<30:07:14,  3.31it/s]
  3%|▎         | 12561/371472 [59:36<29:14:10,  3.41it/s]
  3%|▎         | 12562/371472 [59:36<28:51:07,  3.46it/s]
  3%|▎         | 12563/371472 [59:36<30:59:45,  3.22it/s]
  3%|▎         | 12564/371472 [59:37<30:06:08,  3.31it/s]
  3%|▎         | 12565/371472 [59:37<29:26:31,  3.39it/s]
  3%|▎         | 12566/371472 [59:37<28:05:00,  3.55it/s]
  3%|▎         | 12567/371472 [59:37<27:10:19,  3.67it/s]
  3%|▎         | 12568/371472 [59:38<26:37:37,  3.74it/s]
  3%|▎         | 12569/371472 [59:38<26:24:39,  3.77it/s]
  3%|▎         | 12570/371472 [59:38<27:11:55,  3.67it/s]
  3%|▎         | 12571/371472 [59:39<29:22:04,  3.39it/s]
  3%|▎         | 12572/371472 [59:39<33:45:40,  2.95it/s]
  3%|▎         | 12573/371472 [59:39<31:21:48,  3.18it/s]
  3%|▎         | 12574/371472 [59:40<29:42:33,  3.36it/s]
  3%|▎         | 12575/371472 [59:40<30:23:13,  3.28it/s]
  3%|▎         | 12576/371472 [59:40<32:07:53,  3.10it/s]
  3%|▎         | 12577/371472 [59:41<30:20:31,  3.29it/s]
  3%|▎         | 12578/371472 [59:41<30:09:02,  3.31it/s]
  3%|▎         | 12579/371472 [59:41<29:24:36,  3.39it/s]
  3%|▎         | 12580/371472 [59:41<28:29:48,  3.50it/s]
                                                         
{'loss': 4.4859, 'learning_rate': 9.699896571785644e-07, 'epoch': 0.54}

  3%|▎         | 12580/371472 [59:41<28:29:48,  3.50it/s]
  3%|▎         | 12581/371472 [59:42<29:08:10,  3.42it/s]
  3%|▎         | 12582/371472 [59:42<30:51:57,  3.23it/s]
  3%|▎         | 12583/371472 [59:42<29:04:43,  3.43it/s]
  3%|▎         | 12584/371472 [59:43<28:13:32,  3.53it/s]
  3%|▎         | 12585/371472 [59:43<28:09:38,  3.54it/s]
  3%|▎         | 12586/371472 [59:43<29:27:44,  3.38it/s]
  3%|▎         | 12587/371472 [59:43<28:24:13,  3.51it/s]
  3%|▎         | 12588/371472 [59:44<30:45:10,  3.24it/s]
  3%|▎         | 12589/371472 [59:44<28:43:48,  3.47it/s]
  3%|▎         | 12590/371472 [59:44<29:20:28,  3.40it/s]
  3%|▎         | 12591/371472 [59:45<28:27:39,  3.50it/s]
  3%|▎         | 12592/371472 [59:45<28:49:15,  3.46it/s]
  3%|▎         | 12593/371472 [59:45<28:56:33,  3.44it/s]
  3%|▎         | 12594/371472 [59:45<27:48:08,  3.59it/s]
  3%|▎         | 12595/371472 [59:46<28:33:43,  3.49it/s]
  3%|▎         | 12596/371472 [59:46<27:50:48,  3.58it/s]
  3%|▎         | 12597/371472 [59:46<29:27:37,  3.38it/s]
  3%|▎         | 12598/371472 [59:47<28:57:42,  3.44it/s]
  3%|▎         | 12599/371472 [59:47<28:05:46,  3.55it/s]
  3%|▎         | 12600/371472 [59:47<29:23:55,  3.39it/s]
                                                         
{'loss': 4.5417, 'learning_rate': 9.699411752030857e-07, 'epoch': 0.54}

  3%|▎         | 12600/371472 [59:47<29:23:55,  3.39it/s]
  3%|▎         | 12601/371472 [59:47<28:35:54,  3.49it/s]
  3%|▎         | 12602/371472 [59:48<29:07:55,  3.42it/s]
  3%|▎         | 12603/371472 [59:48<29:05:03,  3.43it/s]
  3%|▎         | 12604/371472 [59:48<29:05:54,  3.43it/s]
  3%|▎         | 12605/371472 [59:49<27:40:27,  3.60it/s]
  3%|▎         | 12606/371472 [59:49<29:53:27,  3.33it/s]
  3%|▎         | 12607/371472 [59:49<29:26:18,  3.39it/s]
  3%|▎         | 12608/371472 [59:49<27:59:25,  3.56it/s]
  3%|▎         | 12609/371472 [59:50<27:40:15,  3.60it/s]
  3%|▎         | 12610/371472 [59:50<28:09:38,  3.54it/s]
  3%|▎         | 12611/371472 [59:51<34:08:55,  2.92it/s]
  3%|▎         | 12612/371472 [59:51<34:07:47,  2.92it/s]
  3%|▎         | 12613/371472 [59:51<33:05:54,  3.01it/s]
  3%|▎         | 12614/371472 [59:51<30:20:21,  3.29it/s]
  3%|▎         | 12615/371472 [59:52<29:05:21,  3.43it/s]
  3%|▎         | 12616/371472 [59:52<27:53:43,  3.57it/s]
  3%|▎         | 12617/371472 [59:52<28:01:24,  3.56it/s]
  3%|▎         | 12618/371472 [59:52<27:46:41,  3.59it/s]
  3%|▎         | 12619/371472 [59:53<27:32:02,  3.62it/s]
  3%|▎         | 12620/371472 [59:53<29:57:39,  3.33it/s]
                                                         
{'loss': 4.6418, 'learning_rate': 9.698926932276065e-07, 'epoch': 0.54}

  3%|▎         | 12620/371472 [59:53<29:57:39,  3.33it/s]
  3%|▎         | 12621/371472 [59:53<30:34:58,  3.26it/s]
  3%|▎         | 12622/371472 [59:54<30:31:09,  3.27it/s]
  3%|▎         | 12623/371472 [59:54<29:42:03,  3.36it/s]
  3%|▎         | 12624/371472 [59:54<29:26:57,  3.38it/s]
  3%|▎         | 12625/371472 [59:55<29:00:24,  3.44it/s]
  3%|▎         | 12626/371472 [59:55<28:26:22,  3.50it/s]
  3%|▎         | 12627/371472 [59:55<27:01:48,  3.69it/s]
  3%|▎         | 12628/371472 [59:55<26:48:52,  3.72it/s]
  3%|▎         | 12629/371472 [59:56<29:47:53,  3.35it/s]
  3%|▎         | 12630/371472 [59:56<28:19:13,  3.52it/s]
  3%|▎         | 12631/371472 [59:56<28:23:26,  3.51it/s]
  3%|▎         | 12632/371472 [59:57<30:42:19,  3.25it/s]
  3%|▎         | 12633/371472 [59:57<29:30:31,  3.38it/s]
  3%|▎         | 12634/371472 [59:57<29:44:25,  3.35it/s]
  3%|▎         | 12635/371472 [59:58<30:51:01,  3.23it/s]
  3%|▎         | 12636/371472 [59:58<31:22:20,  3.18it/s]
  3%|▎         | 12637/371472 [59:58<31:27:33,  3.17it/s]
  3%|▎         | 12638/371472 [59:58<30:09:35,  3.30it/s]
  3%|▎         | 12639/371472 [59:59<29:08:11,  3.42it/s]
  3%|▎         | 12640/371472 [59:59<31:00:03,  3.22it/s]
                                                         
{'loss': 4.6774, 'learning_rate': 9.698442112521278e-07, 'epoch': 0.54}

  3%|▎         | 12640/371472 [59:59<31:00:03,  3.22it/s]
  3%|▎         | 12641/371472 [59:59<30:33:56,  3.26it/s]
  3%|▎         | 12642/371472 [1:00:00<31:19:05,  3.18it/s]
  3%|▎         | 12643/371472 [1:00:00<29:51:04,  3.34it/s]
  3%|▎         | 12644/371472 [1:00:00<29:22:15,  3.39it/s]
  3%|▎         | 12645/371472 [1:00:01<28:55:52,  3.45it/s]
  3%|▎         | 12646/371472 [1:00:01<28:44:02,  3.47it/s]
  3%|▎         | 12647/371472 [1:00:01<28:48:04,  3.46it/s]
  3%|▎         | 12648/371472 [1:00:01<28:20:35,  3.52it/s]
  3%|▎         | 12649/371472 [1:00:02<29:02:14,  3.43it/s]
  3%|▎         | 12650/371472 [1:00:02<27:54:06,  3.57it/s]
  3%|▎         | 12651/371472 [1:00:02<27:03:14,  3.68it/s]
  3%|▎         | 12652/371472 [1:00:03<28:54:01,  3.45it/s]
  3%|▎         | 12653/371472 [1:00:03<27:51:59,  3.58it/s]
  3%|▎         | 12654/371472 [1:00:03<28:50:48,  3.46it/s]
  3%|▎         | 12655/371472 [1:00:03<30:26:54,  3.27it/s]
  3%|▎         | 12656/371472 [1:00:04<34:18:53,  2.90it/s]
  3%|▎         | 12657/371472 [1:00:04<31:35:28,  3.16it/s]
  3%|▎         | 12658/371472 [1:00:04<30:49:08,  3.23it/s]
  3%|▎         | 12659/371472 [1:00:05<29:35:26,  3.37it/s]
  3%|▎         | 12660/371472 [1:00:05<29:06:43,  3.42it/s]
                                                           
{'loss': 4.4528, 'learning_rate': 9.697957292766489e-07, 'epoch': 0.55}

  3%|▎         | 12660/371472 [1:00:05<29:06:43,  3.42it/s]
  3%|▎         | 12661/371472 [1:00:05<29:44:55,  3.35it/s]
  3%|▎         | 12662/371472 [1:00:06<28:37:49,  3.48it/s]
  3%|▎         | 12663/371472 [1:00:06<28:14:40,  3.53it/s]
  3%|▎         | 12664/371472 [1:00:06<27:23:04,  3.64it/s]
  3%|▎         | 12665/371472 [1:00:06<26:22:48,  3.78it/s]
  3%|▎         | 12666/371472 [1:00:07<26:02:52,  3.83it/s]
  3%|▎         | 12667/371472 [1:00:07<26:12:54,  3.80it/s]
  3%|▎         | 12668/371472 [1:00:07<25:47:13,  3.87it/s]
  3%|▎         | 12669/371472 [1:00:07<27:18:09,  3.65it/s]
  3%|▎         | 12670/371472 [1:00:08<26:55:13,  3.70it/s]
  3%|▎         | 12671/371472 [1:00:08<27:45:58,  3.59it/s]
  3%|▎         | 12672/371472 [1:00:08<27:08:54,  3.67it/s]
  3%|▎         | 12673/371472 [1:00:08<27:18:02,  3.65it/s]
  3%|▎         | 12674/371472 [1:00:09<30:35:17,  3.26it/s]
  3%|▎         | 12675/371472 [1:00:09<29:46:56,  3.35it/s]
  3%|▎         | 12676/371472 [1:00:09<28:55:22,  3.45it/s]
  3%|▎         | 12677/371472 [1:00:10<30:52:57,  3.23it/s]
  3%|▎         | 12678/371472 [1:00:10<29:48:37,  3.34it/s]
  3%|▎         | 12679/371472 [1:00:10<29:17:35,  3.40it/s]
  3%|▎         | 12680/371472 [1:00:11<28:46:47,  3.46it/s]
                                                           
{'loss': 4.8846, 'learning_rate': 9.6974724730117e-07, 'epoch': 0.55}

  3%|▎         | 12680/371472 [1:00:11<28:46:47,  3.46it/s]
  3%|▎         | 12681/371472 [1:00:11<28:08:23,  3.54it/s]
  3%|▎         | 12682/371472 [1:00:11<27:59:01,  3.56it/s]
  3%|▎         | 12683/371472 [1:00:11<28:19:40,  3.52it/s]
  3%|▎         | 12684/371472 [1:00:12<27:49:26,  3.58it/s]
  3%|▎         | 12685/371472 [1:00:12<26:26:37,  3.77it/s]
  3%|▎         | 12686/371472 [1:00:12<28:01:04,  3.56it/s]
  3%|▎         | 12687/371472 [1:00:13<28:53:12,  3.45it/s]
  3%|▎         | 12688/371472 [1:00:13<28:40:55,  3.47it/s]
  3%|▎         | 12689/371472 [1:00:13<27:58:33,  3.56it/s]
  3%|▎         | 12690/371472 [1:00:13<28:19:25,  3.52it/s]
  3%|▎         | 12691/371472 [1:00:14<28:23:22,  3.51it/s]
  3%|▎         | 12692/371472 [1:00:14<28:10:53,  3.54it/s]
  3%|▎         | 12693/371472 [1:00:14<28:20:31,  3.52it/s]
  3%|▎         | 12694/371472 [1:00:15<29:32:06,  3.37it/s]
  3%|▎         | 12695/371472 [1:00:15<29:46:24,  3.35it/s]
  3%|▎         | 12696/371472 [1:00:15<29:04:43,  3.43it/s]
  3%|▎         | 12697/371472 [1:00:15<28:30:03,  3.50it/s]
  3%|▎         | 12698/371472 [1:00:16<27:36:40,  3.61it/s]
  3%|▎         | 12699/371472 [1:00:16<26:25:59,  3.77it/s]
  3%|▎         | 12700/371472 [1:00:16<26:50:32,  3.71it/s]
                                                           
{'loss': 4.6795, 'learning_rate': 9.696987653256912e-07, 'epoch': 0.55}

  3%|▎         | 12700/371472 [1:00:16<26:50:32,  3.71it/s]
  3%|▎         | 12701/371472 [1:00:16<27:20:59,  3.64it/s]
  3%|▎         | 12702/371472 [1:00:17<26:54:33,  3.70it/s]
  3%|▎         | 12703/371472 [1:00:17<29:00:10,  3.44it/s]
  3%|▎         | 12704/371472 [1:00:17<28:29:10,  3.50it/s]
  3%|▎         | 12705/371472 [1:00:18<27:29:38,  3.62it/s]
  3%|▎         | 12706/371472 [1:00:18<28:18:28,  3.52it/s]
  3%|▎         | 12707/371472 [1:00:18<28:05:33,  3.55it/s]
  3%|▎         | 12708/371472 [1:00:18<27:46:47,  3.59it/s]
  3%|▎         | 12709/371472 [1:00:19<28:12:25,  3.53it/s]
  3%|▎         | 12710/371472 [1:00:19<27:46:37,  3.59it/s]
  3%|▎         | 12711/371472 [1:00:19<28:49:32,  3.46it/s]
  3%|▎         | 12712/371472 [1:00:20<29:54:45,  3.33it/s]
  3%|▎         | 12713/371472 [1:00:20<30:20:47,  3.28it/s]
  3%|▎         | 12714/371472 [1:00:20<29:06:06,  3.42it/s]
  3%|▎         | 12715/371472 [1:00:21<28:32:04,  3.49it/s]
  3%|▎         | 12716/371472 [1:00:21<28:00:50,  3.56it/s]
  3%|▎         | 12717/371472 [1:00:21<27:50:52,  3.58it/s]
  3%|▎         | 12718/371472 [1:00:21<29:03:15,  3.43it/s]
  3%|▎         | 12719/371472 [1:00:22<28:00:08,  3.56it/s]
  3%|▎         | 12720/371472 [1:00:22<27:50:51,  3.58it/s]
                                                           
{'loss': 4.6705, 'learning_rate': 9.69650283350212e-07, 'epoch': 0.55}

  3%|▎         | 12720/371472 [1:00:22<27:50:51,  3.58it/s]
  3%|▎         | 12721/371472 [1:00:22<27:42:50,  3.60it/s]
  3%|▎         | 12722/371472 [1:00:23<30:05:44,  3.31it/s]
  3%|▎         | 12723/371472 [1:00:23<28:32:03,  3.49it/s]
  3%|▎         | 12724/371472 [1:00:23<27:03:50,  3.68it/s]
  3%|▎         | 12725/371472 [1:00:23<28:27:35,  3.50it/s]
  3%|▎         | 12726/371472 [1:00:24<27:38:52,  3.60it/s]
  3%|▎         | 12727/371472 [1:00:24<27:36:10,  3.61it/s]
  3%|▎         | 12728/371472 [1:00:24<27:12:49,  3.66it/s]
  3%|▎         | 12729/371472 [1:00:24<27:31:21,  3.62it/s]
  3%|▎         | 12730/371472 [1:00:25<27:31:21,  3.62it/s]
  3%|▎         | 12731/371472 [1:00:25<28:15:27,  3.53it/s]
  3%|▎         | 12732/371472 [1:00:25<31:44:12,  3.14it/s]
  3%|▎         | 12733/371472 [1:00:26<30:36:08,  3.26it/s]
  3%|▎         | 12734/371472 [1:00:26<31:54:56,  3.12it/s]
  3%|▎         | 12735/371472 [1:00:26<31:25:52,  3.17it/s]
  3%|▎         | 12736/371472 [1:00:27<30:06:57,  3.31it/s]
  3%|▎         | 12737/371472 [1:00:27<29:04:15,  3.43it/s]
  3%|▎         | 12738/371472 [1:00:27<29:43:13,  3.35it/s]
  3%|▎         | 12739/371472 [1:00:28<30:15:30,  3.29it/s]
  3%|▎         | 12740/371472 [1:00:28<28:41:18,  3.47it/s]
                                                           
{'loss': 4.7057, 'learning_rate': 9.696018013747334e-07, 'epoch': 0.55}

  3%|▎         | 12740/371472 [1:00:28<28:41:18,  3.47it/s]
  3%|▎         | 12741/371472 [1:00:28<28:30:21,  3.50it/s]
  3%|▎         | 12742/371472 [1:00:28<28:52:58,  3.45it/s]
  3%|▎         | 12743/371472 [1:00:29<28:10:50,  3.54it/s]
  3%|▎         | 12744/371472 [1:00:29<28:02:19,  3.55it/s]
  3%|▎         | 12745/371472 [1:00:29<27:53:22,  3.57it/s]
  3%|▎         | 12746/371472 [1:00:29<27:36:07,  3.61it/s]
  3%|▎         | 12747/371472 [1:00:30<27:52:39,  3.57it/s]
  3%|▎         | 12748/371472 [1:00:30<26:59:35,  3.69it/s]
  3%|▎         | 12749/371472 [1:00:30<28:08:08,  3.54it/s]
  3%|▎         | 12750/371472 [1:00:31<28:25:14,  3.51it/s]
  3%|▎         | 12751/371472 [1:00:31<27:24:30,  3.64it/s]
  3%|▎         | 12752/371472 [1:00:31<29:16:34,  3.40it/s]
  3%|▎         | 12753/371472 [1:00:31<28:01:09,  3.56it/s]
  3%|▎         | 12754/371472 [1:00:32<27:51:12,  3.58it/s]
  3%|▎         | 12755/371472 [1:00:32<28:04:20,  3.55it/s]
  3%|▎         | 12756/371472 [1:00:32<29:01:29,  3.43it/s]
  3%|▎         | 12757/371472 [1:00:33<28:25:57,  3.50it/s]
  3%|▎         | 12758/371472 [1:00:33<28:16:33,  3.52it/s]
  3%|▎         | 12759/371472 [1:00:33<27:26:39,  3.63it/s]
  3%|▎         | 12760/371472 [1:00:33<27:28:34,  3.63it/s]
                                                           
{'loss': 4.8444, 'learning_rate': 9.695533193992542e-07, 'epoch': 0.55}

  3%|▎         | 12760/371472 [1:00:33<27:28:34,  3.63it/s]
  3%|▎         | 12761/371472 [1:00:34<27:56:56,  3.57it/s]
  3%|▎         | 12762/371472 [1:00:34<30:35:17,  3.26it/s]
  3%|▎         | 12763/371472 [1:00:34<29:38:26,  3.36it/s]
  3%|▎         | 12764/371472 [1:00:35<29:51:14,  3.34it/s]
  3%|▎         | 12765/371472 [1:00:35<29:02:02,  3.43it/s]
  3%|▎         | 12766/371472 [1:00:35<28:48:04,  3.46it/s]
  3%|▎         | 12767/371472 [1:00:35<29:05:12,  3.43it/s]
  3%|▎         | 12768/371472 [1:00:36<29:02:35,  3.43it/s]
  3%|▎         | 12769/371472 [1:00:36<28:49:19,  3.46it/s]
  3%|▎         | 12770/371472 [1:00:36<28:38:01,  3.48it/s]
  3%|▎         | 12771/371472 [1:00:37<27:47:50,  3.58it/s]
  3%|▎         | 12772/371472 [1:00:37<29:30:53,  3.38it/s]
  3%|▎         | 12773/371472 [1:00:37<28:10:50,  3.54it/s]
  3%|▎         | 12774/371472 [1:00:38<29:36:04,  3.37it/s]
  3%|▎         | 12775/371472 [1:00:38<28:57:10,  3.44it/s]
  3%|▎         | 12776/371472 [1:00:38<29:56:19,  3.33it/s]
  3%|▎         | 12777/371472 [1:00:38<30:33:40,  3.26it/s]
  3%|▎         | 12778/371472 [1:00:39<29:25:10,  3.39it/s]
  3%|▎         | 12779/371472 [1:00:39<27:51:46,  3.58it/s]
  3%|▎         | 12780/371472 [1:00:39<27:02:38,  3.68it/s]
                                                           
{'loss': 4.598, 'learning_rate': 9.695048374237755e-07, 'epoch': 0.55}

  3%|▎         | 12780/371472 [1:00:39<27:02:38,  3.68it/s]
  3%|▎         | 12781/371472 [1:00:39<26:21:06,  3.78it/s]
  3%|▎         | 12782/371472 [1:00:40<28:33:55,  3.49it/s]
  3%|▎         | 12783/371472 [1:00:40<27:44:35,  3.59it/s]
  3%|▎         | 12784/371472 [1:00:40<27:29:14,  3.62it/s]
  3%|▎         | 12785/371472 [1:00:41<27:40:22,  3.60it/s]
  3%|▎         | 12786/371472 [1:00:41<26:32:33,  3.75it/s]
  3%|▎         | 12787/371472 [1:00:41<26:52:29,  3.71it/s]
  3%|▎         | 12788/371472 [1:00:41<27:37:53,  3.61it/s]
  3%|▎         | 12789/371472 [1:00:42<27:09:54,  3.67it/s]
  3%|▎         | 12790/371472 [1:00:42<28:13:23,  3.53it/s]
  3%|▎         | 12791/371472 [1:00:42<27:21:07,  3.64it/s]
  3%|▎         | 12792/371472 [1:00:42<27:03:54,  3.68it/s]
  3%|▎         | 12793/371472 [1:00:43<27:44:05,  3.59it/s]
  3%|▎         | 12794/371472 [1:00:43<26:29:56,  3.76it/s]
  3%|▎         | 12795/371472 [1:00:43<27:47:55,  3.58it/s]
  3%|▎         | 12796/371472 [1:00:44<28:07:02,  3.54it/s]
  3%|▎         | 12797/371472 [1:00:44<28:03:53,  3.55it/s]
  3%|▎         | 12798/371472 [1:00:44<29:36:11,  3.37it/s]
  3%|▎         | 12799/371472 [1:00:45<30:33:44,  3.26it/s]
  3%|▎         | 12800/371472 [1:00:45<29:17:38,  3.40it/s]
                                                           
{'loss': 4.622, 'learning_rate': 9.694563554482966e-07, 'epoch': 0.55}

  3%|▎         | 12800/371472 [1:00:45<29:17:38,  3.40it/s]
  3%|▎         | 12801/371472 [1:00:45<28:43:26,  3.47it/s]
  3%|▎         | 12802/371472 [1:00:45<29:14:30,  3.41it/s]
  3%|▎         | 12803/371472 [1:00:46<28:29:04,  3.50it/s]
  3%|▎         | 12804/371472 [1:00:46<27:54:06,  3.57it/s]
  3%|▎         | 12805/371472 [1:00:46<30:53:28,  3.23it/s]
  3%|▎         | 12806/371472 [1:00:47<29:18:20,  3.40it/s]
  3%|▎         | 12807/371472 [1:00:47<30:51:04,  3.23it/s]
  3%|▎         | 12808/371472 [1:00:47<30:29:50,  3.27it/s]
  3%|▎         | 12809/371472 [1:00:47<28:58:54,  3.44it/s]
  3%|▎         | 12810/371472 [1:00:48<28:10:02,  3.54it/s]
  3%|▎         | 12811/371472 [1:00:48<27:48:14,  3.58it/s]
  3%|▎         | 12812/371472 [1:00:48<28:52:11,  3.45it/s]
  3%|▎         | 12813/371472 [1:00:49<27:31:34,  3.62it/s]
  3%|▎         | 12814/371472 [1:00:49<26:51:11,  3.71it/s]
  3%|▎         | 12815/371472 [1:00:49<26:41:53,  3.73it/s]
  3%|▎         | 12816/371472 [1:00:49<26:50:08,  3.71it/s]
  3%|▎         | 12817/371472 [1:00:50<27:44:09,  3.59it/s]
  3%|▎         | 12818/371472 [1:00:50<27:57:23,  3.56it/s]
  3%|▎         | 12819/371472 [1:00:50<27:35:53,  3.61it/s]
  3%|▎         | 12820/371472 [1:00:51<29:00:47,  3.43it/s]
                                                           
{'loss': 4.971, 'learning_rate': 9.694078734728177e-07, 'epoch': 0.55}

  3%|▎         | 12820/371472 [1:00:51<29:00:47,  3.43it/s]
  3%|▎         | 12821/371472 [1:00:51<28:01:47,  3.55it/s]
  3%|▎         | 12822/371472 [1:00:51<28:05:43,  3.55it/s]
  3%|▎         | 12823/371472 [1:00:51<27:40:10,  3.60it/s]
  3%|▎         | 12824/371472 [1:00:52<28:00:15,  3.56it/s]
  3%|▎         | 12825/371472 [1:00:52<31:35:26,  3.15it/s]
  3%|▎         | 12826/371472 [1:00:52<30:29:57,  3.27it/s]
  3%|▎         | 12827/371472 [1:00:53<29:02:47,  3.43it/s]
  3%|▎         | 12828/371472 [1:00:53<29:32:50,  3.37it/s]
  3%|▎         | 12829/371472 [1:00:53<27:49:15,  3.58it/s]
  3%|▎         | 12830/371472 [1:00:53<26:46:21,  3.72it/s]
  3%|▎         | 12831/371472 [1:00:54<27:45:44,  3.59it/s]
  3%|▎         | 12832/371472 [1:00:54<29:49:16,  3.34it/s]
  3%|▎         | 12833/371472 [1:00:54<28:26:52,  3.50it/s]
  3%|▎         | 12834/371472 [1:00:55<30:31:52,  3.26it/s]
  3%|▎         | 12835/371472 [1:00:55<31:15:10,  3.19it/s]
  3%|▎         | 12836/371472 [1:00:55<29:05:55,  3.42it/s]
  3%|▎         | 12837/371472 [1:00:55<29:26:42,  3.38it/s]
  3%|▎         | 12838/371472 [1:00:56<28:55:38,  3.44it/s]
  3%|▎         | 12839/371472 [1:00:56<27:48:51,  3.58it/s]
  3%|▎         | 12840/371472 [1:00:56<26:48:04,  3.72it/s]
                                                           
{'loss': 4.5947, 'learning_rate': 9.69359391497339e-07, 'epoch': 0.55}

  3%|▎         | 12840/371472 [1:00:56<26:48:04,  3.72it/s]
  3%|▎         | 12841/371472 [1:00:57<26:59:19,  3.69it/s]
  3%|▎         | 12842/371472 [1:00:57<26:08:18,  3.81it/s]
  3%|▎         | 12843/371472 [1:00:57<27:21:16,  3.64it/s]
  3%|▎         | 12844/371472 [1:00:57<27:39:38,  3.60it/s]
  3%|▎         | 12845/371472 [1:00:58<27:15:34,  3.65it/s]
  3%|▎         | 12846/371472 [1:00:58<27:50:25,  3.58it/s]
  3%|▎         | 12847/371472 [1:00:58<28:08:19,  3.54it/s]
  3%|▎         | 12848/371472 [1:00:58<27:35:25,  3.61it/s]
  3%|▎         | 12849/371472 [1:00:59<29:00:55,  3.43it/s]
  3%|▎         | 12850/371472 [1:00:59<27:57:24,  3.56it/s]
  3%|▎         | 12851/371472 [1:00:59<27:45:04,  3.59it/s]
  3%|▎         | 12852/371472 [1:01:00<28:13:55,  3.53it/s]
  3%|▎         | 12853/371472 [1:01:00<27:46:19,  3.59it/s]
  3%|▎         | 12854/371472 [1:01:00<29:29:54,  3.38it/s]
  3%|▎         | 12855/371472 [1:01:01<28:45:42,  3.46it/s]
  3%|▎         | 12856/371472 [1:01:01<28:36:21,  3.48it/s]
  3%|▎         | 12857/371472 [1:01:01<29:33:44,  3.37it/s]
  3%|▎         | 12858/371472 [1:01:01<28:42:41,  3.47it/s]
  3%|▎         | 12859/371472 [1:01:02<28:10:44,  3.54it/s]
  3%|▎         | 12860/371472 [1:01:02<28:00:48,  3.56it/s]
                                                           
{'loss': 4.2249, 'learning_rate': 9.693109095218598e-07, 'epoch': 0.55}

  3%|▎         | 12860/371472 [1:01:02<28:00:48,  3.56it/s]
  3%|▎         | 12861/371472 [1:01:02<28:04:01,  3.55it/s]
  3%|▎         | 12862/371472 [1:01:03<29:25:41,  3.38it/s]
  3%|▎         | 12863/371472 [1:01:03<30:18:36,  3.29it/s]
  3%|▎         | 12864/371472 [1:01:03<32:37:05,  3.05it/s]
  3%|▎         | 12865/371472 [1:01:04<31:17:33,  3.18it/s]
  3%|▎         | 12866/371472 [1:01:04<30:06:07,  3.31it/s]
  3%|▎         | 12867/371472 [1:01:04<29:49:47,  3.34it/s]
  3%|▎         | 12868/371472 [1:01:04<30:45:21,  3.24it/s]
  3%|▎         | 12869/371472 [1:01:05<30:01:18,  3.32it/s]
  3%|▎         | 12870/371472 [1:01:05<31:09:26,  3.20it/s]
  3%|▎         | 12871/371472 [1:01:05<29:56:02,  3.33it/s]
  3%|▎         | 12872/371472 [1:01:06<31:11:29,  3.19it/s]
  3%|▎         | 12873/371472 [1:01:06<29:55:30,  3.33it/s]
  3%|▎         | 12874/371472 [1:01:06<31:17:58,  3.18it/s]
  3%|▎         | 12875/371472 [1:01:07<32:48:02,  3.04it/s]
  3%|▎         | 12876/371472 [1:01:07<30:39:05,  3.25it/s]
  3%|▎         | 12877/371472 [1:01:07<30:32:02,  3.26it/s]
  3%|▎         | 12878/371472 [1:01:07<28:24:54,  3.51it/s]
  3%|▎         | 12879/371472 [1:01:08<27:56:52,  3.56it/s]
  3%|▎         | 12880/371472 [1:01:08<26:50:27,  3.71it/s]
                                                           
{'loss': 4.5096, 'learning_rate': 9.69262427546381e-07, 'epoch': 0.55}

  3%|▎         | 12880/371472 [1:01:08<26:50:27,  3.71it/s]
  3%|▎         | 12881/371472 [1:01:08<29:03:01,  3.43it/s]
  3%|▎         | 12882/371472 [1:01:09<28:35:53,  3.48it/s]
  3%|▎         | 12883/371472 [1:01:09<27:24:55,  3.63it/s]
  3%|▎         | 12884/371472 [1:01:09<26:50:02,  3.71it/s]
  3%|▎         | 12885/371472 [1:01:09<26:50:18,  3.71it/s]
  3%|▎         | 12886/371472 [1:01:10<28:23:22,  3.51it/s]
  3%|▎         | 12887/371472 [1:01:10<27:29:53,  3.62it/s]
  3%|▎         | 12888/371472 [1:01:10<27:51:00,  3.58it/s]
  3%|▎         | 12889/371472 [1:01:11<28:11:17,  3.53it/s]
  3%|▎         | 12890/371472 [1:01:11<30:31:38,  3.26it/s]
  3%|▎         | 12891/371472 [1:01:11<29:04:26,  3.43it/s]
  3%|▎         | 12892/371472 [1:01:11<28:01:17,  3.55it/s]
  3%|▎         | 12893/371472 [1:01:12<27:11:01,  3.66it/s]
  3%|▎         | 12894/371472 [1:01:12<26:40:52,  3.73it/s]
  3%|▎         | 12895/371472 [1:01:12<26:38:32,  3.74it/s]
  3%|▎         | 12896/371472 [1:01:13<30:01:30,  3.32it/s]
  3%|▎         | 12897/371472 [1:01:13<28:34:17,  3.49it/s]
  3%|▎         | 12898/371472 [1:01:13<28:35:12,  3.48it/s]
  3%|▎         | 12899/371472 [1:01:13<30:28:49,  3.27it/s]
  3%|▎         | 12900/371472 [1:01:14<28:53:52,  3.45it/s]
                                                           
{'loss': 4.6678, 'learning_rate': 9.692139455709022e-07, 'epoch': 0.56}

  3%|▎         | 12900/371472 [1:01:14<28:53:52,  3.45it/s]
  3%|▎         | 12901/371472 [1:01:14<27:34:31,  3.61it/s]
  3%|▎         | 12902/371472 [1:01:14<27:18:06,  3.65it/s]
  3%|▎         | 12903/371472 [1:01:14<27:04:13,  3.68it/s]
  3%|▎         | 12904/371472 [1:01:15<26:21:44,  3.78it/s]
  3%|▎         | 12905/371472 [1:01:15<25:40:22,  3.88it/s]
  3%|▎         | 12906/371472 [1:01:15<26:00:50,  3.83it/s]
  3%|▎         | 12907/371472 [1:01:16<26:26:53,  3.77it/s]
  3%|▎         | 12908/371472 [1:01:16<26:27:02,  3.77it/s]
  3%|▎         | 12909/371472 [1:01:16<26:45:26,  3.72it/s]
  3%|▎         | 12910/371472 [1:01:16<26:33:32,  3.75it/s]
  3%|▎         | 12911/371472 [1:01:17<31:14:09,  3.19it/s]
  3%|▎         | 12912/371472 [1:01:17<29:59:39,  3.32it/s]
  3%|▎         | 12913/371472 [1:01:17<30:32:11,  3.26it/s]
  3%|▎         | 12914/371472 [1:01:18<29:11:01,  3.41it/s]
  3%|▎         | 12915/371472 [1:01:18<30:12:33,  3.30it/s]
  3%|▎         | 12916/371472 [1:01:18<28:51:49,  3.45it/s]
  3%|▎         | 12917/371472 [1:01:19<31:05:03,  3.20it/s]
  3%|▎         | 12918/371472 [1:01:19<30:34:58,  3.26it/s]
  3%|▎         | 12919/371472 [1:01:19<29:53:25,  3.33it/s]
  3%|▎         | 12920/371472 [1:01:19<29:03:55,  3.43it/s]
                                                           
{'loss': 4.6959, 'learning_rate': 9.691654635954232e-07, 'epoch': 0.56}

  3%|▎         | 12920/371472 [1:01:19<29:03:55,  3.43it/s]
  3%|▎         | 12921/371472 [1:01:20<29:19:46,  3.40it/s]
  3%|▎         | 12922/371472 [1:01:20<29:58:30,  3.32it/s]
  3%|▎         | 12923/371472 [1:01:20<32:20:47,  3.08it/s]
  3%|▎         | 12924/371472 [1:01:21<30:57:26,  3.22it/s]
  3%|▎         | 12925/371472 [1:01:21<30:55:19,  3.22it/s]
  3%|▎         | 12926/371472 [1:01:21<29:39:13,  3.36it/s]
  3%|▎         | 12927/371472 [1:01:22<28:57:56,  3.44it/s]
  3%|▎         | 12928/371472 [1:01:22<29:26:45,  3.38it/s]
  3%|▎         | 12929/371472 [1:01:22<30:10:18,  3.30it/s]
  3%|▎         | 12930/371472 [1:01:22<29:26:09,  3.38it/s]
  3%|▎         | 12931/371472 [1:01:23<28:26:14,  3.50it/s]
  3%|▎         | 12932/371472 [1:01:23<28:14:12,  3.53it/s]
  3%|▎         | 12933/371472 [1:01:23<27:33:30,  3.61it/s]
  3%|▎         | 12934/371472 [1:01:24<30:03:48,  3.31it/s]
  3%|▎         | 12935/371472 [1:01:24<28:49:41,  3.45it/s]
  3%|▎         | 12936/371472 [1:01:24<29:09:12,  3.42it/s]
  3%|▎         | 12937/371472 [1:01:24<28:25:40,  3.50it/s]
  3%|▎         | 12938/371472 [1:01:25<28:05:04,  3.55it/s]
  3%|▎         | 12939/371472 [1:01:25<28:40:48,  3.47it/s]
  3%|▎         | 12940/371472 [1:01:25<29:08:35,  3.42it/s]
                                                           
{'loss': 4.5744, 'learning_rate': 9.691169816199445e-07, 'epoch': 0.56}

  3%|▎         | 12940/371472 [1:01:25<29:08:35,  3.42it/s]
  3%|▎         | 12941/371472 [1:01:26<29:20:31,  3.39it/s]
  3%|▎         | 12942/371472 [1:01:26<30:49:30,  3.23it/s]
  3%|▎         | 12943/371472 [1:01:26<30:07:57,  3.31it/s]
  3%|▎         | 12944/371472 [1:01:26<29:10:48,  3.41it/s]
  3%|▎         | 12945/371472 [1:01:27<31:59:39,  3.11it/s]
  3%|▎         | 12946/371472 [1:01:27<30:06:52,  3.31it/s]
  3%|▎         | 12947/371472 [1:01:27<29:58:38,  3.32it/s]
  3%|▎         | 12948/371472 [1:01:28<28:01:19,  3.55it/s]
  3%|▎         | 12949/371472 [1:01:28<27:07:12,  3.67it/s]
  3%|▎         | 12950/371472 [1:01:28<28:11:19,  3.53it/s]
  3%|▎         | 12951/371472 [1:01:29<31:43:04,  3.14it/s]
  3%|▎         | 12952/371472 [1:01:29<31:35:13,  3.15it/s]
  3%|▎         | 12953/371472 [1:01:29<31:16:05,  3.18it/s]
  3%|▎         | 12954/371472 [1:01:30<31:02:31,  3.21it/s]
  3%|▎         | 12955/371472 [1:01:30<29:14:20,  3.41it/s]
  3%|▎         | 12956/371472 [1:01:30<28:28:49,  3.50it/s]
  3%|▎         | 12957/371472 [1:01:30<27:24:00,  3.63it/s]
  3%|▎         | 12958/371472 [1:01:31<26:58:09,  3.69it/s]
  3%|▎         | 12959/371472 [1:01:31<26:47:39,  3.72it/s]
  3%|▎         | 12960/371472 [1:01:31<28:04:21,  3.55it/s]
                                                           
{'loss': 4.8221, 'learning_rate': 9.690684996444654e-07, 'epoch': 0.56}

  3%|▎         | 12960/371472 [1:01:31<28:04:21,  3.55it/s]
  3%|▎         | 12961/371472 [1:01:31<27:56:40,  3.56it/s]
  3%|▎         | 12962/371472 [1:01:32<27:01:41,  3.68it/s]
  3%|▎         | 12963/371472 [1:01:32<28:55:26,  3.44it/s]
  3%|▎         | 12964/371472 [1:01:32<28:03:53,  3.55it/s]
  3%|▎         | 12965/371472 [1:01:33<29:38:13,  3.36it/s]
  3%|▎         | 12966/371472 [1:01:33<30:01:04,  3.32it/s]
  3%|▎         | 12967/371472 [1:01:33<28:57:48,  3.44it/s]
  3%|▎         | 12968/371472 [1:01:33<28:17:35,  3.52it/s]
  3%|▎         | 12969/371472 [1:01:34<27:20:37,  3.64it/s]
  3%|▎         | 12970/371472 [1:01:34<26:30:43,  3.76it/s]
  3%|▎         | 12971/371472 [1:01:34<27:04:13,  3.68it/s]
  3%|▎         | 12972/371472 [1:01:35<28:21:30,  3.51it/s]
  3%|▎         | 12973/371472 [1:01:35<27:36:02,  3.61it/s]
  3%|▎         | 12974/371472 [1:01:35<28:33:02,  3.49it/s]
  3%|▎         | 12975/371472 [1:01:35<28:42:28,  3.47it/s]
  3%|▎         | 12976/371472 [1:01:36<28:48:26,  3.46it/s]
  3%|▎         | 12977/371472 [1:01:36<29:39:16,  3.36it/s]
  3%|▎         | 12978/371472 [1:01:36<29:36:20,  3.36it/s]
  3%|▎         | 12979/371472 [1:01:37<29:30:26,  3.37it/s]
  3%|▎         | 12980/371472 [1:01:37<29:59:58,  3.32it/s]
                                                           
{'loss': 4.6241, 'learning_rate': 9.690200176689867e-07, 'epoch': 0.56}

  3%|▎         | 12980/371472 [1:01:37<29:59:58,  3.32it/s]
  3%|▎         | 12981/371472 [1:01:37<29:09:45,  3.41it/s]
  3%|▎         | 12982/371472 [1:01:38<29:06:10,  3.42it/s]
  3%|▎         | 12983/371472 [1:01:38<28:31:47,  3.49it/s]
  3%|▎         | 12984/371472 [1:01:38<27:58:50,  3.56it/s]
  3%|▎         | 12985/371472 [1:01:38<28:07:55,  3.54it/s]
  3%|▎         | 12986/371472 [1:01:39<27:53:07,  3.57it/s]
  3%|▎         | 12987/371472 [1:01:39<27:41:23,  3.60it/s]
  3%|▎         | 12988/371472 [1:01:39<28:26:59,  3.50it/s]
  3%|▎         | 12989/371472 [1:01:39<27:10:41,  3.66it/s]
  3%|▎         | 12990/371472 [1:01:40<26:44:53,  3.72it/s]
  3%|▎         | 12991/371472 [1:01:40<25:54:36,  3.84it/s]
  3%|▎         | 12992/371472 [1:01:40<25:13:11,  3.95it/s]
  3%|▎         | 12993/371472 [1:01:40<24:43:38,  4.03it/s]
  3%|▎         | 12994/371472 [1:01:41<26:01:30,  3.83it/s]
  3%|▎         | 12995/371472 [1:01:41<28:10:01,  3.54it/s]
  3%|▎         | 12996/371472 [1:01:41<28:22:26,  3.51it/s]
  3%|▎         | 12997/371472 [1:01:42<27:40:55,  3.60it/s]
  3%|▎         | 12998/371472 [1:01:42<28:01:59,  3.55it/s]
  3%|▎         | 12999/371472 [1:01:42<31:26:50,  3.17it/s]
  3%|▎         | 13000/371472 [1:01:43<31:28:53,  3.16it/s]
                                                           
{'loss': 4.6407, 'learning_rate': 9.689715356935075e-07, 'epoch': 0.56}

  3%|▎         | 13000/371472 [1:01:43<31:28:53,  3.16it/s]
  3%|▎         | 13001/371472 [1:01:43<30:31:29,  3.26it/s]
  4%|▎         | 13002/371472 [1:01:43<29:09:11,  3.42it/s]
  4%|▎         | 13003/371472 [1:01:43<29:26:34,  3.38it/s]
  4%|▎         | 13004/371472 [1:01:44<29:48:05,  3.34it/s]
  4%|▎         | 13005/371472 [1:01:44<29:08:54,  3.42it/s]
  4%|▎         | 13006/371472 [1:01:44<28:56:48,  3.44it/s]
  4%|▎         | 13007/371472 [1:01:45<29:23:15,  3.39it/s]
  4%|▎         | 13008/371472 [1:01:45<28:12:54,  3.53it/s]
  4%|▎         | 13009/371472 [1:01:45<29:35:20,  3.37it/s]
  4%|▎         | 13010/371472 [1:01:45<28:35:33,  3.48it/s]
  4%|▎         | 13011/371472 [1:01:46<28:08:07,  3.54it/s]
  4%|▎         | 13012/371472 [1:01:46<28:49:25,  3.45it/s]
  4%|▎         | 13013/371472 [1:01:46<28:34:35,  3.48it/s]
  4%|▎         | 13014/371472 [1:01:47<28:47:24,  3.46it/s]
  4%|▎         | 13015/371472 [1:01:47<28:37:35,  3.48it/s]
  4%|▎         | 13016/371472 [1:01:47<28:23:19,  3.51it/s]
  4%|▎         | 13017/371472 [1:01:47<27:26:22,  3.63it/s]
  4%|▎         | 13018/371472 [1:01:48<28:04:14,  3.55it/s]
  4%|▎         | 13019/371472 [1:01:48<29:03:51,  3.43it/s]
  4%|▎         | 13020/371472 [1:01:48<29:33:45,  3.37it/s]
                                                           
{'loss': 4.5464, 'learning_rate': 9.689230537180288e-07, 'epoch': 0.56}

  4%|▎         | 13020/371472 [1:01:48<29:33:45,  3.37it/s]
  4%|▎         | 13021/371472 [1:01:49<28:57:43,  3.44it/s]
  4%|▎         | 13022/371472 [1:01:49<27:50:41,  3.58it/s]
  4%|▎         | 13023/371472 [1:01:49<28:05:01,  3.55it/s]
  4%|▎         | 13024/371472 [1:01:50<30:35:15,  3.26it/s]
  4%|▎         | 13025/371472 [1:01:50<31:15:19,  3.19it/s]
  4%|▎         | 13026/371472 [1:01:50<30:32:53,  3.26it/s]
  4%|▎         | 13027/371472 [1:01:50<29:56:18,  3.33it/s]
  4%|▎         | 13028/371472 [1:01:51<29:27:20,  3.38it/s]
  4%|▎         | 13029/371472 [1:01:51<28:02:46,  3.55it/s]
  4%|▎         | 13030/371472 [1:01:51<27:51:20,  3.57it/s]
  4%|▎         | 13031/371472 [1:01:52<29:21:38,  3.39it/s]
  4%|▎         | 13032/371472 [1:01:52<28:22:20,  3.51it/s]
  4%|▎         | 13033/371472 [1:01:52<27:59:57,  3.56it/s]
  4%|▎         | 13034/371472 [1:01:52<28:09:56,  3.54it/s]
  4%|▎         | 13035/371472 [1:01:53<27:39:18,  3.60it/s]
  4%|▎         | 13036/371472 [1:01:53<27:04:35,  3.68it/s]
  4%|▎         | 13037/371472 [1:01:53<28:18:19,  3.52it/s]
  4%|▎         | 13038/371472 [1:01:53<27:31:56,  3.62it/s]
  4%|▎         | 13039/371472 [1:01:54<27:37:12,  3.60it/s]
  4%|▎         | 13040/371472 [1:01:54<27:53:02,  3.57it/s]
                                                           
{'loss': 4.6636, 'learning_rate': 9.688745717425499e-07, 'epoch': 0.56}

  4%|▎         | 13040/371472 [1:01:54<27:53:02,  3.57it/s]
  4%|▎         | 13041/371472 [1:01:54<27:12:26,  3.66it/s]
  4%|▎         | 13042/371472 [1:01:55<29:50:55,  3.34it/s]
  4%|▎         | 13043/371472 [1:01:55<34:13:27,  2.91it/s]
  4%|▎         | 13044/371472 [1:01:55<31:34:48,  3.15it/s]
  4%|▎         | 13045/371472 [1:01:56<28:59:18,  3.43it/s]
  4%|▎         | 13046/371472 [1:01:56<27:54:35,  3.57it/s]
  4%|▎         | 13047/371472 [1:01:56<27:03:29,  3.68it/s]
  4%|▎         | 13048/371472 [1:01:56<26:57:52,  3.69it/s]
  4%|▎         | 13049/371472 [1:01:57<26:44:20,  3.72it/s]
  4%|▎         | 13050/371472 [1:01:57<25:52:21,  3.85it/s]
  4%|▎         | 13051/371472 [1:01:57<28:05:19,  3.54it/s]
  4%|▎         | 13052/371472 [1:01:57<27:31:12,  3.62it/s]
  4%|▎         | 13053/371472 [1:01:58<27:24:02,  3.63it/s]
  4%|▎         | 13054/371472 [1:01:58<28:55:19,  3.44it/s]
  4%|▎         | 13055/371472 [1:01:58<28:28:09,  3.50it/s]
  4%|▎         | 13056/371472 [1:01:59<32:18:34,  3.08it/s]
  4%|▎         | 13057/371472 [1:01:59<32:49:08,  3.03it/s]
  4%|▎         | 13058/371472 [1:01:59<30:56:03,  3.22it/s]
  4%|▎         | 13059/371472 [1:02:00<29:08:53,  3.42it/s]
  4%|▎         | 13060/371472 [1:02:00<27:50:50,  3.58it/s]
                                                           
{'loss': 4.5332, 'learning_rate': 9.68826089767071e-07, 'epoch': 0.56}

  4%|▎         | 13060/371472 [1:02:00<27:50:50,  3.58it/s]
  4%|▎         | 13061/371472 [1:02:00<28:25:56,  3.50it/s]
  4%|▎         | 13062/371472 [1:02:00<29:01:52,  3.43it/s]
  4%|▎         | 13063/371472 [1:02:01<28:42:39,  3.47it/s]
  4%|▎         | 13064/371472 [1:02:01<28:40:28,  3.47it/s]
  4%|▎         | 13065/371472 [1:02:01<27:46:46,  3.58it/s]
  4%|▎         | 13066/371472 [1:02:02<27:29:41,  3.62it/s]
  4%|▎         | 13067/371472 [1:02:02<28:42:45,  3.47it/s]
  4%|▎         | 13068/371472 [1:02:02<28:26:25,  3.50it/s]
  4%|▎         | 13069/371472 [1:02:02<28:32:15,  3.49it/s]
  4%|▎         | 13070/371472 [1:02:03<27:58:13,  3.56it/s]
  4%|▎         | 13071/371472 [1:02:03<27:25:18,  3.63it/s]
  4%|▎         | 13072/371472 [1:02:03<27:30:27,  3.62it/s]
  4%|▎         | 13073/371472 [1:02:04<27:24:37,  3.63it/s]
  4%|▎         | 13074/371472 [1:02:04<27:21:27,  3.64it/s]
  4%|▎         | 13075/371472 [1:02:04<26:21:31,  3.78it/s]
  4%|▎         | 13076/371472 [1:02:04<29:22:56,  3.39it/s]
  4%|▎         | 13077/371472 [1:02:05<31:14:26,  3.19it/s]
  4%|▎         | 13078/371472 [1:02:05<34:47:27,  2.86it/s]
  4%|▎         | 13079/371472 [1:02:05<31:50:40,  3.13it/s]
  4%|▎         | 13080/371472 [1:02:06<31:17:15,  3.18it/s]
                                                           
{'loss': 4.5259, 'learning_rate': 9.687776077915922e-07, 'epoch': 0.56}

  4%|▎         | 13080/371472 [1:02:06<31:17:15,  3.18it/s]
  4%|▎         | 13081/371472 [1:02:06<30:33:16,  3.26it/s]
  4%|▎         | 13082/371472 [1:02:06<29:01:59,  3.43it/s]
  4%|▎         | 13083/371472 [1:02:07<28:05:40,  3.54it/s]
  4%|▎         | 13084/371472 [1:02:07<29:00:50,  3.43it/s]
  4%|▎         | 13085/371472 [1:02:07<28:58:09,  3.44it/s]
  4%|▎         | 13086/371472 [1:02:07<27:58:58,  3.56it/s]
  4%|▎         | 13087/371472 [1:02:08<28:50:51,  3.45it/s]
  4%|▎         | 13088/371472 [1:02:08<27:35:10,  3.61it/s]
  4%|▎         | 13089/371472 [1:02:08<28:45:03,  3.46it/s]
  4%|▎         | 13090/371472 [1:02:09<28:12:25,  3.53it/s]
  4%|▎         | 13091/371472 [1:02:09<28:01:49,  3.55it/s]
  4%|▎         | 13092/371472 [1:02:09<28:10:40,  3.53it/s]
  4%|▎         | 13093/371472 [1:02:09<28:12:38,  3.53it/s]
  4%|▎         | 13094/371472 [1:02:10<28:13:39,  3.53it/s]
  4%|▎         | 13095/371472 [1:02:10<27:47:43,  3.58it/s]
  4%|▎         | 13096/371472 [1:02:10<27:23:05,  3.64it/s]
  4%|▎         | 13097/371472 [1:02:10<26:17:56,  3.79it/s]
  4%|▎         | 13098/371472 [1:02:11<26:40:22,  3.73it/s]
  4%|▎         | 13099/371472 [1:02:11<27:07:03,  3.67it/s]
  4%|▎         | 13100/371472 [1:02:11<26:39:24,  3.73it/s]
                                                           
{'loss': 4.7069, 'learning_rate': 9.687291258161133e-07, 'epoch': 0.56}

  4%|▎         | 13100/371472 [1:02:11<26:39:24,  3.73it/s]
  4%|▎         | 13101/371472 [1:02:12<26:12:42,  3.80it/s]
  4%|▎         | 13102/371472 [1:02:12<25:55:29,  3.84it/s]
  4%|▎         | 13103/371472 [1:02:12<26:34:13,  3.75it/s]
  4%|▎         | 13104/371472 [1:02:12<26:30:11,  3.76it/s]
  4%|▎         | 13105/371472 [1:02:13<26:22:51,  3.77it/s]
  4%|▎         | 13106/371472 [1:02:13<27:00:16,  3.69it/s]
  4%|▎         | 13107/371472 [1:02:13<28:12:01,  3.53it/s]
  4%|▎         | 13108/371472 [1:02:13<27:40:17,  3.60it/s]
  4%|▎         | 13109/371472 [1:02:14<29:18:03,  3.40it/s]
  4%|▎         | 13110/371472 [1:02:14<30:05:20,  3.31it/s]
  4%|▎         | 13111/371472 [1:02:14<29:27:25,  3.38it/s]
  4%|▎         | 13112/371472 [1:02:15<27:52:01,  3.57it/s]
  4%|▎         | 13113/371472 [1:02:15<27:32:55,  3.61it/s]
  4%|▎         | 13114/371472 [1:02:15<28:00:37,  3.55it/s]
  4%|▎         | 13115/371472 [1:02:16<29:43:55,  3.35it/s]
  4%|▎         | 13116/371472 [1:02:16<29:32:01,  3.37it/s]
  4%|▎         | 13117/371472 [1:02:16<29:42:42,  3.35it/s]
  4%|▎         | 13118/371472 [1:02:16<28:45:34,  3.46it/s]
  4%|▎         | 13119/371472 [1:02:17<28:11:17,  3.53it/s]
  4%|▎         | 13120/371472 [1:02:17<29:28:24,  3.38it/s]
                                                           
{'loss': 4.5002, 'learning_rate': 9.686806438406344e-07, 'epoch': 0.57}

  4%|▎         | 13120/371472 [1:02:17<29:28:24,  3.38it/s]
  4%|▎         | 13121/371472 [1:02:17<31:14:28,  3.19it/s]
  4%|▎         | 13122/371472 [1:02:18<30:27:18,  3.27it/s]
  4%|▎         | 13123/371472 [1:02:18<29:09:31,  3.41it/s]
  4%|▎         | 13124/371472 [1:02:18<28:16:56,  3.52it/s]
  4%|▎         | 13125/371472 [1:02:19<30:06:50,  3.31it/s]
  4%|▎         | 13126/371472 [1:02:19<29:13:55,  3.41it/s]
  4%|▎         | 13127/371472 [1:02:19<29:37:28,  3.36it/s]
  4%|▎         | 13128/371472 [1:02:19<27:54:47,  3.57it/s]
  4%|▎         | 13129/371472 [1:02:20<28:02:45,  3.55it/s]
  4%|▎         | 13130/371472 [1:02:20<29:04:53,  3.42it/s]
  4%|▎         | 13131/371472 [1:02:20<28:11:49,  3.53it/s]
  4%|▎         | 13132/371472 [1:02:20<27:25:39,  3.63it/s]
  4%|▎         | 13133/371472 [1:02:21<28:41:06,  3.47it/s]
  4%|▎         | 13134/371472 [1:02:21<28:27:17,  3.50it/s]
  4%|▎         | 13135/371472 [1:02:21<27:33:54,  3.61it/s]
  4%|▎         | 13136/371472 [1:02:22<27:52:51,  3.57it/s]
  4%|▎         | 13137/371472 [1:02:22<26:55:03,  3.70it/s]
  4%|▎         | 13138/371472 [1:02:22<28:05:51,  3.54it/s]
  4%|▎         | 13139/371472 [1:02:22<27:45:32,  3.59it/s]
  4%|▎         | 13140/371472 [1:02:23<28:39:51,  3.47it/s]
                                                           
{'loss': 4.802, 'learning_rate': 9.686321618651552e-07, 'epoch': 0.57}

  4%|▎         | 13140/371472 [1:02:23<28:39:51,  3.47it/s]
  4%|▎         | 13141/371472 [1:02:23<28:41:10,  3.47it/s]
  4%|▎         | 13142/371472 [1:02:23<28:19:32,  3.51it/s]
  4%|▎         | 13143/371472 [1:02:24<31:07:47,  3.20it/s]
  4%|▎         | 13144/371472 [1:02:24<29:42:28,  3.35it/s]
  4%|▎         | 13145/371472 [1:02:24<28:20:42,  3.51it/s]
  4%|▎         | 13146/371472 [1:02:24<28:37:28,  3.48it/s]
  4%|▎         | 13147/371472 [1:02:25<29:28:14,  3.38it/s]
  4%|▎         | 13148/371472 [1:02:25<28:13:10,  3.53it/s]
  4%|▎         | 13149/371472 [1:02:25<29:11:43,  3.41it/s]
  4%|▎         | 13150/371472 [1:02:26<31:35:55,  3.15it/s]
  4%|▎         | 13151/371472 [1:02:26<30:05:57,  3.31it/s]
  4%|▎         | 13152/371472 [1:02:26<28:24:28,  3.50it/s]
  4%|▎         | 13153/371472 [1:02:27<28:25:32,  3.50it/s]
  4%|▎         | 13154/371472 [1:02:27<28:10:16,  3.53it/s]
  4%|▎         | 13155/371472 [1:02:27<27:30:22,  3.62it/s]
  4%|▎         | 13156/371472 [1:02:27<28:28:57,  3.49it/s]
  4%|▎         | 13157/371472 [1:02:28<31:06:59,  3.20it/s]
  4%|▎         | 13158/371472 [1:02:28<29:45:12,  3.35it/s]
  4%|▎         | 13159/371472 [1:02:28<29:35:26,  3.36it/s]
  4%|▎         | 13160/371472 [1:02:29<29:10:58,  3.41it/s]
                                                           
{'loss': 4.4615, 'learning_rate': 9.685836798896765e-07, 'epoch': 0.57}

  4%|▎         | 13160/371472 [1:02:29<29:10:58,  3.41it/s]
  4%|▎         | 13161/371472 [1:02:29<31:27:41,  3.16it/s]
  4%|▎         | 13162/371472 [1:02:29<32:02:54,  3.11it/s]
  4%|▎         | 13163/371472 [1:02:30<29:46:30,  3.34it/s]
  4%|▎         | 13164/371472 [1:02:30<29:23:37,  3.39it/s]
  4%|▎         | 13165/371472 [1:02:30<28:26:45,  3.50it/s]
  4%|▎         | 13166/371472 [1:02:30<29:51:40,  3.33it/s]
  4%|▎         | 13167/371472 [1:02:31<28:19:58,  3.51it/s]
  4%|▎         | 13168/371472 [1:02:31<29:44:58,  3.35it/s]
  4%|▎         | 13169/371472 [1:02:31<30:49:03,  3.23it/s]
  4%|▎         | 13170/371472 [1:02:32<29:40:42,  3.35it/s]
  4%|▎         | 13171/371472 [1:02:32<29:31:38,  3.37it/s]
  4%|▎         | 13172/371472 [1:02:32<29:09:00,  3.41it/s]
  4%|▎         | 13173/371472 [1:02:32<27:48:53,  3.58it/s]
  4%|▎         | 13174/371472 [1:02:33<27:13:12,  3.66it/s]
  4%|▎         | 13175/371472 [1:02:33<27:39:40,  3.60it/s]
  4%|▎         | 13176/371472 [1:02:33<29:35:00,  3.36it/s]
  4%|▎         | 13177/371472 [1:02:34<28:35:37,  3.48it/s]
  4%|▎         | 13178/371472 [1:02:34<27:38:34,  3.60it/s]
  4%|▎         | 13179/371472 [1:02:34<27:03:03,  3.68it/s]
  4%|▎         | 13180/371472 [1:02:34<26:58:07,  3.69it/s]
                                                           
{'loss': 4.6674, 'learning_rate': 9.685351979141976e-07, 'epoch': 0.57}

  4%|▎         | 13180/371472 [1:02:34<26:58:07,  3.69it/s]
  4%|▎         | 13181/371472 [1:02:35<28:14:43,  3.52it/s]
  4%|▎         | 13182/371472 [1:02:35<29:10:09,  3.41it/s]
  4%|▎         | 13183/371472 [1:02:35<28:40:36,  3.47it/s]
  4%|▎         | 13184/371472 [1:02:36<27:35:51,  3.61it/s]
  4%|▎         | 13185/371472 [1:02:36<26:19:37,  3.78it/s]
  4%|▎         | 13186/371472 [1:02:36<26:32:24,  3.75it/s]
  4%|▎         | 13187/371472 [1:02:36<27:49:56,  3.58it/s]
  4%|▎         | 13188/371472 [1:02:37<26:54:22,  3.70it/s]
  4%|▎         | 13189/371472 [1:02:37<26:11:10,  3.80it/s]
  4%|▎         | 13190/371472 [1:02:37<26:50:06,  3.71it/s]
  4%|▎         | 13191/371472 [1:02:37<26:45:34,  3.72it/s]
  4%|▎         | 13192/371472 [1:02:38<26:39:16,  3.73it/s]
  4%|▎         | 13193/371472 [1:02:38<26:24:43,  3.77it/s]
  4%|▎         | 13194/371472 [1:02:38<26:40:08,  3.73it/s]
  4%|▎         | 13195/371472 [1:02:39<28:03:09,  3.55it/s]
  4%|▎         | 13196/371472 [1:02:39<27:37:09,  3.60it/s]
  4%|▎         | 13197/371472 [1:02:39<30:03:39,  3.31it/s]
  4%|▎         | 13198/371472 [1:02:39<29:55:18,  3.33it/s]
  4%|▎         | 13199/371472 [1:02:40<29:06:26,  3.42it/s]
  4%|▎         | 13200/371472 [1:02:40<27:53:36,  3.57it/s]
                                                           
{'loss': 4.5308, 'learning_rate': 9.684867159387187e-07, 'epoch': 0.57}

  4%|▎         | 13200/371472 [1:02:40<27:53:36,  3.57it/s]
  4%|▎         | 13201/371472 [1:02:40<28:25:53,  3.50it/s]
  4%|▎         | 13202/371472 [1:02:41<28:06:01,  3.54it/s]
  4%|▎         | 13203/371472 [1:02:41<31:31:21,  3.16it/s]
  4%|▎         | 13204/371472 [1:02:41<30:10:05,  3.30it/s]
  4%|▎         | 13205/371472 [1:02:41<28:07:54,  3.54it/s]
  4%|▎         | 13206/371472 [1:02:42<28:29:09,  3.49it/s]
  4%|▎         | 13207/371472 [1:02:42<28:51:43,  3.45it/s]
  4%|▎         | 13208/371472 [1:02:42<27:44:23,  3.59it/s]
  4%|▎         | 13209/371472 [1:02:43<27:40:40,  3.60it/s]
  4%|▎         | 13210/371472 [1:02:43<27:40:38,  3.60it/s]
  4%|▎         | 13211/371472 [1:02:43<27:43:16,  3.59it/s]
  4%|▎         | 13212/371472 [1:02:43<26:53:39,  3.70it/s]
  4%|▎         | 13213/371472 [1:02:44<27:01:45,  3.68it/s]
  4%|▎         | 13214/371472 [1:02:44<27:27:54,  3.62it/s]
  4%|▎         | 13215/371472 [1:02:44<26:20:11,  3.78it/s]
  4%|▎         | 13216/371472 [1:02:45<28:13:24,  3.53it/s]
  4%|▎         | 13217/371472 [1:02:45<27:22:43,  3.63it/s]
  4%|▎         | 13218/371472 [1:02:45<26:25:32,  3.77it/s]
  4%|▎         | 13219/371472 [1:02:45<27:03:23,  3.68it/s]
  4%|▎         | 13220/371472 [1:02:46<26:44:23,  3.72it/s]
                                                           
{'loss': 4.6764, 'learning_rate': 9.6843823396324e-07, 'epoch': 0.57}

  4%|▎         | 13220/371472 [1:02:46<26:44:23,  3.72it/s]
  4%|▎         | 13221/371472 [1:02:46<26:25:28,  3.77it/s]
  4%|▎         | 13222/371472 [1:02:46<26:34:05,  3.75it/s]
  4%|▎         | 13223/371472 [1:02:46<26:00:36,  3.83it/s]
  4%|▎         | 13224/371472 [1:02:47<25:30:15,  3.90it/s]
  4%|▎         | 13225/371472 [1:02:47<25:53:29,  3.84it/s]
  4%|▎         | 13226/371472 [1:02:47<27:18:21,  3.64it/s]
  4%|▎         | 13227/371472 [1:02:47<28:28:07,  3.50it/s]
  4%|▎         | 13228/371472 [1:02:48<27:50:32,  3.57it/s]
  4%|▎         | 13229/371472 [1:02:48<27:21:08,  3.64it/s]
  4%|▎         | 13230/371472 [1:02:48<28:40:31,  3.47it/s]
  4%|▎         | 13231/371472 [1:02:49<28:33:19,  3.48it/s]
  4%|▎         | 13232/371472 [1:02:49<27:37:59,  3.60it/s]
  4%|▎         | 13233/371472 [1:02:49<28:39:18,  3.47it/s]
  4%|▎         | 13234/371472 [1:02:49<27:36:34,  3.60it/s]
  4%|▎         | 13235/371472 [1:02:50<27:37:34,  3.60it/s]
  4%|▎         | 13236/371472 [1:02:50<27:43:01,  3.59it/s]
  4%|▎         | 13237/371472 [1:02:50<26:57:30,  3.69it/s]
  4%|▎         | 13238/371472 [1:02:51<27:12:07,  3.66it/s]
  4%|▎         | 13239/371472 [1:02:51<27:27:19,  3.62it/s]
  4%|▎         | 13240/371472 [1:02:51<29:04:42,  3.42it/s]
                                                           
{'loss': 4.7747, 'learning_rate': 9.683897519877608e-07, 'epoch': 0.57}

  4%|▎         | 13240/371472 [1:02:51<29:04:42,  3.42it/s]
  4%|▎         | 13241/371472 [1:02:51<28:04:18,  3.54it/s]
  4%|▎         | 13242/371472 [1:02:52<26:59:57,  3.69it/s]
  4%|▎         | 13243/371472 [1:02:52<26:37:31,  3.74it/s]
  4%|▎         | 13244/371472 [1:02:52<26:32:26,  3.75it/s]
  4%|▎         | 13245/371472 [1:02:52<26:40:13,  3.73it/s]
  4%|▎         | 13246/371472 [1:02:53<31:55:17,  3.12it/s]
  4%|▎         | 13247/371472 [1:02:53<30:34:15,  3.25it/s]
  4%|▎         | 13248/371472 [1:02:53<28:56:16,  3.44it/s]
  4%|▎         | 13249/371472 [1:02:54<27:41:50,  3.59it/s]
  4%|▎         | 13250/371472 [1:02:54<27:25:32,  3.63it/s]
  4%|▎         | 13251/371472 [1:02:54<26:45:54,  3.72it/s]
  4%|▎         | 13252/371472 [1:02:54<27:01:25,  3.68it/s]
  4%|▎         | 13253/371472 [1:02:55<26:53:35,  3.70it/s]
  4%|▎         | 13254/371472 [1:02:55<26:33:13,  3.75it/s]
  4%|▎         | 13255/371472 [1:02:55<26:01:30,  3.82it/s]
  4%|▎         | 13256/371472 [1:02:56<26:38:50,  3.73it/s]
  4%|▎         | 13257/371472 [1:02:56<27:25:02,  3.63it/s]
  4%|▎         | 13258/371472 [1:02:56<27:34:53,  3.61it/s]
  4%|▎         | 13259/371472 [1:02:56<27:32:36,  3.61it/s]
  4%|▎         | 13260/371472 [1:02:57<26:36:56,  3.74it/s]
                                                           
{'loss': 5.0853, 'learning_rate': 9.68341270012282e-07, 'epoch': 0.57}

  4%|▎         | 13260/371472 [1:02:57<26:36:56,  3.74it/s]
  4%|▎         | 13261/371472 [1:02:57<26:45:37,  3.72it/s]
  4%|▎         | 13262/371472 [1:02:57<26:50:04,  3.71it/s]
  4%|▎         | 13263/371472 [1:02:57<28:40:55,  3.47it/s]
  4%|▎         | 13264/371472 [1:02:58<27:31:03,  3.62it/s]
  4%|▎         | 13265/371472 [1:02:58<28:57:00,  3.44it/s]
  4%|▎         | 13266/371472 [1:02:58<29:22:26,  3.39it/s]
  4%|▎         | 13267/371472 [1:02:59<29:24:44,  3.38it/s]
  4%|▎         | 13268/371472 [1:02:59<28:34:14,  3.48it/s]
  4%|▎         | 13269/371472 [1:02:59<27:29:56,  3.62it/s]
  4%|▎         | 13270/371472 [1:02:59<27:53:14,  3.57it/s]
  4%|▎         | 13271/371472 [1:03:00<27:05:41,  3.67it/s]
  4%|▎         | 13272/371472 [1:03:00<27:24:18,  3.63it/s]
  4%|▎         | 13273/371472 [1:03:00<28:43:53,  3.46it/s]
  4%|▎         | 13274/371472 [1:03:01<28:11:15,  3.53it/s]
  4%|▎         | 13275/371472 [1:03:01<27:06:20,  3.67it/s]
  4%|▎         | 13276/371472 [1:03:01<27:40:40,  3.59it/s]
  4%|▎         | 13277/371472 [1:03:01<26:43:03,  3.72it/s]
  4%|▎         | 13278/371472 [1:03:02<26:42:31,  3.73it/s]
  4%|▎         | 13279/371472 [1:03:02<26:46:48,  3.72it/s]
  4%|▎         | 13280/371472 [1:03:02<26:24:15,  3.77it/s]
                                                           
{'loss': 4.6953, 'learning_rate': 9.682927880368032e-07, 'epoch': 0.57}

  4%|▎         | 13280/371472 [1:03:02<26:24:15,  3.77it/s]
  4%|▎         | 13281/371472 [1:03:02<25:58:53,  3.83it/s]
  4%|▎         | 13282/371472 [1:03:03<27:32:08,  3.61it/s]
  4%|▎         | 13283/371472 [1:03:03<28:08:43,  3.54it/s]
  4%|▎         | 13284/371472 [1:03:03<27:14:11,  3.65it/s]
  4%|▎         | 13285/371472 [1:03:04<28:29:26,  3.49it/s]
  4%|▎         | 13286/371472 [1:03:04<27:56:55,  3.56it/s]
  4%|▎         | 13287/371472 [1:03:04<31:11:57,  3.19it/s]
  4%|▎         | 13288/371472 [1:03:05<29:14:45,  3.40it/s]
  4%|▎         | 13289/371472 [1:03:05<28:25:44,  3.50it/s]
  4%|▎         | 13290/371472 [1:03:05<27:40:37,  3.59it/s]
  4%|▎         | 13291/371472 [1:03:05<26:44:48,  3.72it/s]
  4%|▎         | 13292/371472 [1:03:06<26:36:22,  3.74it/s]
  4%|▎         | 13293/371472 [1:03:06<26:42:17,  3.73it/s]
  4%|▎         | 13294/371472 [1:03:06<34:42:06,  2.87it/s]
  4%|▎         | 13295/371472 [1:03:07<33:35:34,  2.96it/s]
  4%|▎         | 13296/371472 [1:03:07<31:19:08,  3.18it/s]
  4%|▎         | 13297/371472 [1:03:07<31:41:31,  3.14it/s]
  4%|▎         | 13298/371472 [1:03:07<29:16:55,  3.40it/s]
  4%|▎         | 13299/371472 [1:03:08<29:09:52,  3.41it/s]
  4%|▎         | 13300/371472 [1:03:08<31:40:51,  3.14it/s]
                                                           
{'loss': 4.7413, 'learning_rate': 9.682443060613242e-07, 'epoch': 0.57}

  4%|▎         | 13300/371472 [1:03:08<31:40:51,  3.14it/s]
  4%|▎         | 13301/371472 [1:03:08<29:56:49,  3.32it/s]
  4%|▎         | 13302/371472 [1:03:09<29:51:28,  3.33it/s]
  4%|▎         | 13303/371472 [1:03:09<30:27:29,  3.27it/s]
  4%|▎         | 13304/371472 [1:03:09<29:40:08,  3.35it/s]
  4%|▎         | 13305/371472 [1:03:10<29:19:59,  3.39it/s]
  4%|▎         | 13306/371472 [1:03:10<28:16:42,  3.52it/s]
  4%|▎         | 13307/371472 [1:03:10<28:00:35,  3.55it/s]
  4%|▎         | 13308/371472 [1:03:10<28:13:57,  3.52it/s]
  4%|▎         | 13309/371472 [1:03:11<29:16:21,  3.40it/s]
  4%|▎         | 13310/371472 [1:03:11<29:14:42,  3.40it/s]
  4%|▎         | 13311/371472 [1:03:11<28:31:20,  3.49it/s]
  4%|▎         | 13312/371472 [1:03:12<28:04:42,  3.54it/s]
  4%|▎         | 13313/371472 [1:03:12<27:39:45,  3.60it/s]
  4%|▎         | 13314/371472 [1:03:12<27:08:34,  3.67it/s]
  4%|▎         | 13315/371472 [1:03:12<28:18:15,  3.51it/s]
  4%|▎         | 13316/371472 [1:03:13<31:09:39,  3.19it/s]
  4%|▎         | 13317/371472 [1:03:13<30:48:15,  3.23it/s]
  4%|▎         | 13318/371472 [1:03:13<30:59:12,  3.21it/s]
  4%|▎         | 13319/371472 [1:03:14<29:48:33,  3.34it/s]
  4%|▎         | 13320/371472 [1:03:14<29:49:39,  3.34it/s]
                                                           
{'loss': 4.5876, 'learning_rate': 9.681958240858455e-07, 'epoch': 0.57}

  4%|▎         | 13320/371472 [1:03:14<29:49:39,  3.34it/s]
  4%|▎         | 13321/371472 [1:03:14<29:35:36,  3.36it/s]
  4%|▎         | 13322/371472 [1:03:15<28:34:42,  3.48it/s]
  4%|▎         | 13323/371472 [1:03:15<29:19:37,  3.39it/s]
  4%|▎         | 13324/371472 [1:03:15<28:03:10,  3.55it/s]
  4%|▎         | 13325/371472 [1:03:15<27:17:54,  3.64it/s]
  4%|▎         | 13326/371472 [1:03:16<28:17:41,  3.52it/s]
  4%|▎         | 13327/371472 [1:03:16<29:46:52,  3.34it/s]
  4%|▎         | 13328/371472 [1:03:16<29:22:34,  3.39it/s]
  4%|▎         | 13329/371472 [1:03:17<28:00:36,  3.55it/s]
  4%|▎         | 13330/371472 [1:03:17<29:00:17,  3.43it/s]
  4%|▎         | 13331/371472 [1:03:17<27:49:23,  3.58it/s]
  4%|▎         | 13332/371472 [1:03:17<27:26:06,  3.63it/s]
  4%|▎         | 13333/371472 [1:03:18<26:56:10,  3.69it/s]
  4%|▎         | 13334/371472 [1:03:18<26:55:59,  3.69it/s]
  4%|▎         | 13335/371472 [1:03:18<27:30:42,  3.62it/s]
  4%|▎         | 13336/371472 [1:03:18<27:45:45,  3.58it/s]
  4%|▎         | 13337/371472 [1:03:19<27:30:55,  3.62it/s]
  4%|▎         | 13338/371472 [1:03:19<27:17:34,  3.64it/s]
  4%|▎         | 13339/371472 [1:03:19<27:27:13,  3.62it/s]
  4%|▎         | 13340/371472 [1:03:20<26:48:05,  3.71it/s]
                                                           
{'loss': 4.7571, 'learning_rate': 9.681473421103664e-07, 'epoch': 0.57}

  4%|▎         | 13340/371472 [1:03:20<26:48:05,  3.71it/s]
  4%|▎         | 13341/371472 [1:03:20<27:35:10,  3.61it/s]
  4%|▎         | 13342/371472 [1:03:20<28:04:24,  3.54it/s]
  4%|▎         | 13343/371472 [1:03:20<28:08:05,  3.54it/s]
  4%|▎         | 13344/371472 [1:03:21<26:56:41,  3.69it/s]
  4%|▎         | 13345/371472 [1:03:21<27:29:47,  3.62it/s]
  4%|▎         | 13346/371472 [1:03:21<26:24:41,  3.77it/s]
  4%|▎         | 13347/371472 [1:03:21<26:08:55,  3.80it/s]
  4%|▎         | 13348/371472 [1:03:22<25:51:21,  3.85it/s]
  4%|▎         | 13349/371472 [1:03:22<27:02:28,  3.68it/s]
  4%|▎         | 13350/371472 [1:03:22<28:07:00,  3.54it/s]
  4%|▎         | 13351/371472 [1:03:23<27:30:16,  3.62it/s]
  4%|▎         | 13352/371472 [1:03:23<26:58:38,  3.69it/s]
  4%|▎         | 13353/371472 [1:03:23<26:16:50,  3.79it/s]
  4%|▎         | 13354/371472 [1:03:23<28:30:37,  3.49it/s]
  4%|▎         | 13355/371472 [1:03:24<31:19:24,  3.18it/s]
  4%|▎         | 13356/371472 [1:03:24<30:51:24,  3.22it/s]
  4%|▎         | 13357/371472 [1:03:25<33:56:22,  2.93it/s]
  4%|▎         | 13358/371472 [1:03:25<34:03:08,  2.92it/s]
  4%|▎         | 13359/371472 [1:03:25<35:25:52,  2.81it/s]
  4%|▎         | 13360/371472 [1:03:26<32:39:39,  3.05it/s]
                                                           
{'loss': 4.837, 'learning_rate': 9.680988601348877e-07, 'epoch': 0.58}

  4%|▎         | 13360/371472 [1:03:26<32:39:39,  3.05it/s]
  4%|▎         | 13361/371472 [1:03:26<30:57:17,  3.21it/s]
  4%|▎         | 13362/371472 [1:03:26<30:20:08,  3.28it/s]
  4%|▎         | 13363/371472 [1:03:26<30:22:40,  3.27it/s]
  4%|▎         | 13364/371472 [1:03:27<30:42:47,  3.24it/s]
  4%|▎         | 13365/371472 [1:03:27<28:49:59,  3.45it/s]
  4%|▎         | 13366/371472 [1:03:27<29:21:17,  3.39it/s]
  4%|▎         | 13367/371472 [1:03:28<28:09:25,  3.53it/s]
  4%|▎         | 13368/371472 [1:03:28<26:57:50,  3.69it/s]
  4%|▎         | 13369/371472 [1:03:28<29:30:29,  3.37it/s]
  4%|▎         | 13370/371472 [1:03:28<28:57:58,  3.43it/s]
  4%|▎         | 13371/371472 [1:03:29<29:02:05,  3.43it/s]
  4%|▎         | 13372/371472 [1:03:29<28:30:59,  3.49it/s]
  4%|▎         | 13373/371472 [1:03:29<28:18:46,  3.51it/s]
  4%|▎         | 13374/371472 [1:03:30<27:51:08,  3.57it/s]
  4%|▎         | 13375/371472 [1:03:30<27:28:50,  3.62it/s]
  4%|▎         | 13376/371472 [1:03:30<27:03:13,  3.68it/s]
  4%|▎         | 13377/371472 [1:03:30<27:34:52,  3.61it/s]
  4%|▎         | 13378/371472 [1:03:31<27:21:20,  3.64it/s]
  4%|▎         | 13379/371472 [1:03:31<26:18:59,  3.78it/s]
  4%|▎         | 13380/371472 [1:03:31<27:35:30,  3.61it/s]
                                                           
{'loss': 4.5773, 'learning_rate': 9.680503781594085e-07, 'epoch': 0.58}

  4%|▎         | 13380/371472 [1:03:31<27:35:30,  3.61it/s]
  4%|▎         | 13381/371472 [1:03:31<26:47:05,  3.71it/s]
  4%|▎         | 13382/371472 [1:03:32<27:51:13,  3.57it/s]
  4%|▎         | 13383/371472 [1:03:32<26:32:09,  3.75it/s]
  4%|▎         | 13384/371472 [1:03:32<26:05:39,  3.81it/s]
  4%|▎         | 13385/371472 [1:03:32<25:50:21,  3.85it/s]
  4%|▎         | 13386/371472 [1:03:33<25:17:08,  3.93it/s]
  4%|▎         | 13387/371472 [1:03:33<25:20:39,  3.92it/s]
  4%|▎         | 13388/371472 [1:03:33<24:52:53,  4.00it/s]
  4%|▎         | 13389/371472 [1:03:33<25:19:06,  3.93it/s]
  4%|▎         | 13390/371472 [1:03:34<24:51:16,  4.00it/s]
  4%|▎         | 13391/371472 [1:03:34<28:25:51,  3.50it/s]
  4%|▎         | 13392/371472 [1:03:34<29:39:37,  3.35it/s]
  4%|▎         | 13393/371472 [1:03:35<29:04:04,  3.42it/s]
  4%|▎         | 13394/371472 [1:03:35<28:30:09,  3.49it/s]
  4%|▎         | 13395/371472 [1:03:35<28:54:41,  3.44it/s]
  4%|▎         | 13396/371472 [1:03:35<27:45:42,  3.58it/s]
  4%|▎         | 13397/371472 [1:03:36<29:55:12,  3.32it/s]
  4%|▎         | 13398/371472 [1:03:36<30:53:37,  3.22it/s]
  4%|▎         | 13399/371472 [1:03:36<29:47:57,  3.34it/s]
  4%|▎         | 13400/371472 [1:03:37<29:52:16,  3.33it/s]
                                                           
{'loss': 4.7744, 'learning_rate': 9.680018961839298e-07, 'epoch': 0.58}

  4%|▎         | 13400/371472 [1:03:37<29:52:16,  3.33it/s]
  4%|▎         | 13401/371472 [1:03:37<30:28:53,  3.26it/s]
  4%|▎         | 13402/371472 [1:03:37<29:29:44,  3.37it/s]
  4%|▎         | 13403/371472 [1:03:38<29:33:02,  3.37it/s]
  4%|▎         | 13404/371472 [1:03:38<29:09:56,  3.41it/s]
  4%|▎         | 13405/371472 [1:03:38<28:23:10,  3.50it/s]
  4%|▎         | 13406/371472 [1:03:38<28:11:35,  3.53it/s]
  4%|▎         | 13407/371472 [1:03:39<28:30:47,  3.49it/s]
  4%|▎         | 13408/371472 [1:03:39<28:11:39,  3.53it/s]
  4%|▎         | 13409/371472 [1:03:39<28:21:13,  3.51it/s]
  4%|▎         | 13410/371472 [1:03:40<27:35:13,  3.61it/s]
  4%|▎         | 13411/371472 [1:03:40<27:15:19,  3.65it/s]
  4%|▎         | 13412/371472 [1:03:40<27:15:28,  3.65it/s]
  4%|▎         | 13413/371472 [1:03:40<28:10:15,  3.53it/s]
  4%|▎         | 13414/371472 [1:03:41<28:57:34,  3.43it/s]
  4%|▎         | 13415/371472 [1:03:41<29:01:37,  3.43it/s]
  4%|▎         | 13416/371472 [1:03:41<27:55:03,  3.56it/s]
  4%|▎         | 13417/371472 [1:03:42<28:17:21,  3.52it/s]
  4%|▎         | 13418/371472 [1:03:42<28:47:21,  3.45it/s]
  4%|▎         | 13419/371472 [1:03:42<30:21:49,  3.28it/s]
  4%|▎         | 13420/371472 [1:03:42<28:56:40,  3.44it/s]
                                                           
{'loss': 4.7419, 'learning_rate': 9.679534142084509e-07, 'epoch': 0.58}

  4%|▎         | 13420/371472 [1:03:42<28:56:40,  3.44it/s]
  4%|▎         | 13421/371472 [1:03:43<28:07:12,  3.54it/s]
  4%|▎         | 13422/371472 [1:03:43<29:06:59,  3.42it/s]
  4%|▎         | 13423/371472 [1:03:43<28:14:06,  3.52it/s]
  4%|▎         | 13424/371472 [1:03:44<27:13:49,  3.65it/s]
  4%|▎         | 13425/371472 [1:03:44<29:23:31,  3.38it/s]
  4%|▎         | 13426/371472 [1:03:44<28:36:33,  3.48it/s]
  4%|▎         | 13427/371472 [1:03:44<27:37:46,  3.60it/s]
  4%|▎         | 13428/371472 [1:03:45<27:46:56,  3.58it/s]
  4%|▎         | 13429/371472 [1:03:45<28:09:37,  3.53it/s]
  4%|▎         | 13430/371472 [1:03:45<27:30:35,  3.62it/s]
  4%|▎         | 13431/371472 [1:03:46<27:32:13,  3.61it/s]
  4%|▎         | 13432/371472 [1:03:46<26:43:44,  3.72it/s]
  4%|▎         | 13433/371472 [1:03:46<28:26:02,  3.50it/s]
  4%|▎         | 13434/371472 [1:03:46<29:30:18,  3.37it/s]
  4%|▎         | 13435/371472 [1:03:47<28:27:06,  3.50it/s]
  4%|▎         | 13436/371472 [1:03:47<27:12:06,  3.66it/s]
  4%|▎         | 13437/371472 [1:03:47<29:40:21,  3.35it/s]
  4%|▎         | 13438/371472 [1:03:48<29:12:37,  3.40it/s]
  4%|▎         | 13439/371472 [1:03:48<30:40:44,  3.24it/s]
  4%|▎         | 13440/371472 [1:03:48<29:17:07,  3.40it/s]
                                                           
{'loss': 4.8362, 'learning_rate': 9.67904932232972e-07, 'epoch': 0.58}

  4%|▎         | 13440/371472 [1:03:48<29:17:07,  3.40it/s]
  4%|▎         | 13441/371472 [1:03:49<29:54:06,  3.33it/s]
  4%|▎         | 13442/371472 [1:03:49<33:47:11,  2.94it/s]
  4%|▎         | 13443/371472 [1:03:49<31:42:09,  3.14it/s]
  4%|▎         | 13444/371472 [1:03:50<32:12:01,  3.09it/s]
  4%|▎         | 13445/371472 [1:03:50<29:44:43,  3.34it/s]
  4%|▎         | 13446/371472 [1:03:50<29:34:22,  3.36it/s]
  4%|▎         | 13447/371472 [1:03:50<28:46:46,  3.46it/s]
  4%|▎         | 13448/371472 [1:03:51<28:25:37,  3.50it/s]
  4%|▎         | 13449/371472 [1:03:51<30:07:19,  3.30it/s]
  4%|▎         | 13450/371472 [1:03:51<31:10:40,  3.19it/s]
  4%|▎         | 13451/371472 [1:03:52<30:07:50,  3.30it/s]
  4%|▎         | 13452/371472 [1:03:52<33:37:44,  2.96it/s]
  4%|▎         | 13453/371472 [1:03:52<31:45:50,  3.13it/s]
  4%|▎         | 13454/371472 [1:03:53<32:51:11,  3.03it/s]
  4%|▎         | 13455/371472 [1:03:53<30:21:03,  3.28it/s]
  4%|▎         | 13456/371472 [1:03:53<29:19:08,  3.39it/s]
  4%|▎         | 13457/371472 [1:03:53<27:45:27,  3.58it/s]
  4%|▎         | 13458/371472 [1:03:54<26:52:52,  3.70it/s]
  4%|▎         | 13459/371472 [1:03:54<26:53:48,  3.70it/s]
  4%|▎         | 13460/371472 [1:03:54<26:30:13,  3.75it/s]
                                                           
{'loss': 4.7081, 'learning_rate': 9.678564502574932e-07, 'epoch': 0.58}

  4%|▎         | 13460/371472 [1:03:54<26:30:13,  3.75it/s]
  4%|▎         | 13461/371472 [1:03:54<26:58:41,  3.69it/s]
  4%|▎         | 13462/371472 [1:03:55<27:17:30,  3.64it/s]
  4%|▎         | 13463/371472 [1:03:55<27:36:01,  3.60it/s]
  4%|▎         | 13464/371472 [1:03:55<28:51:37,  3.45it/s]
  4%|▎         | 13465/371472 [1:03:56<30:00:00,  3.31it/s]
  4%|▎         | 13466/371472 [1:03:56<29:30:11,  3.37it/s]
  4%|▎         | 13467/371472 [1:03:56<28:13:14,  3.52it/s]
  4%|▎         | 13468/371472 [1:03:57<30:14:02,  3.29it/s]
  4%|▎         | 13469/371472 [1:03:57<28:27:53,  3.49it/s]
  4%|▎         | 13470/371472 [1:03:57<28:37:12,  3.47it/s]
  4%|▎         | 13471/371472 [1:03:57<27:40:32,  3.59it/s]
  4%|▎         | 13472/371472 [1:03:58<27:53:16,  3.57it/s]
  4%|▎         | 13473/371472 [1:03:58<27:43:50,  3.59it/s]
  4%|▎         | 13474/371472 [1:03:58<28:01:49,  3.55it/s]
  4%|▎         | 13475/371472 [1:03:58<27:03:28,  3.68it/s]
  4%|▎         | 13476/371472 [1:03:59<28:10:32,  3.53it/s]
  4%|▎         | 13477/371472 [1:03:59<28:04:00,  3.54it/s]
  4%|▎         | 13478/371472 [1:03:59<28:10:30,  3.53it/s]
  4%|▎         | 13479/371472 [1:04:00<27:40:31,  3.59it/s]
  4%|▎         | 13480/371472 [1:04:00<26:55:04,  3.69it/s]
                                                           
{'loss': 4.7993, 'learning_rate': 9.678079682820143e-07, 'epoch': 0.58}

  4%|▎         | 13480/371472 [1:04:00<26:55:04,  3.69it/s]
  4%|▎         | 13481/371472 [1:04:00<29:05:48,  3.42it/s]
  4%|▎         | 13482/371472 [1:04:00<28:02:00,  3.55it/s]
  4%|▎         | 13483/371472 [1:04:01<30:35:40,  3.25it/s]
  4%|▎         | 13484/371472 [1:04:01<29:32:06,  3.37it/s]
  4%|▎         | 13485/371472 [1:04:01<27:58:36,  3.55it/s]
  4%|▎         | 13486/371472 [1:04:02<27:36:23,  3.60it/s]
  4%|▎         | 13487/371472 [1:04:02<27:18:32,  3.64it/s]
  4%|▎         | 13488/371472 [1:04:02<26:50:17,  3.71it/s]
  4%|▎         | 13489/371472 [1:04:02<26:57:22,  3.69it/s]
  4%|▎         | 13490/371472 [1:04:03<27:07:13,  3.67it/s]
  4%|▎         | 13491/371472 [1:04:03<26:14:51,  3.79it/s]
  4%|▎         | 13492/371472 [1:04:03<27:11:43,  3.66it/s]
  4%|▎         | 13493/371472 [1:04:04<27:58:13,  3.56it/s]
  4%|▎         | 13494/371472 [1:04:04<27:11:34,  3.66it/s]
  4%|▎         | 13495/371472 [1:04:04<27:15:09,  3.65it/s]
  4%|▎         | 13496/371472 [1:04:04<27:35:00,  3.60it/s]
  4%|▎         | 13497/371472 [1:04:05<26:10:37,  3.80it/s]
  4%|▎         | 13498/371472 [1:04:05<26:19:36,  3.78it/s]
  4%|▎         | 13499/371472 [1:04:05<26:46:58,  3.71it/s]
  4%|▎         | 13500/371472 [1:04:05<27:14:29,  3.65it/s]
                                                           
{'loss': 4.495, 'learning_rate': 9.677594863065354e-07, 'epoch': 0.58}

  4%|▎         | 13500/371472 [1:04:05<27:14:29,  3.65it/s]
  4%|▎         | 13501/371472 [1:04:06<29:28:35,  3.37it/s]
  4%|▎         | 13502/371472 [1:04:06<28:11:51,  3.53it/s]
  4%|▎         | 13503/371472 [1:04:06<29:22:19,  3.39it/s]
  4%|▎         | 13504/371472 [1:04:07<29:26:34,  3.38it/s]
  4%|▎         | 13505/371472 [1:04:07<29:11:50,  3.41it/s]
  4%|▎         | 13506/371472 [1:04:07<29:28:41,  3.37it/s]
  4%|▎         | 13507/371472 [1:04:07<28:26:56,  3.50it/s]
  4%|▎         | 13508/371472 [1:04:08<29:12:07,  3.41it/s]
  4%|▎         | 13509/371472 [1:04:08<28:03:20,  3.54it/s]
  4%|▎         | 13510/371472 [1:04:08<29:30:00,  3.37it/s]
  4%|▎         | 13511/371472 [1:04:09<30:45:19,  3.23it/s]
  4%|▎         | 13512/371472 [1:04:09<30:06:47,  3.30it/s]
  4%|▎         | 13513/371472 [1:04:09<29:56:14,  3.32it/s]
  4%|▎         | 13514/371472 [1:04:10<28:35:58,  3.48it/s]
  4%|▎         | 13515/371472 [1:04:10<27:48:50,  3.57it/s]
  4%|▎         | 13516/371472 [1:04:10<29:13:45,  3.40it/s]
  4%|▎         | 13517/371472 [1:04:11<30:45:19,  3.23it/s]
  4%|▎         | 13518/371472 [1:04:11<31:24:30,  3.17it/s]
  4%|▎         | 13519/371472 [1:04:11<30:16:23,  3.28it/s]
  4%|▎         | 13520/371472 [1:04:11<28:59:22,  3.43it/s]
                                                           
{'loss': 4.5018, 'learning_rate': 9.677110043310564e-07, 'epoch': 0.58}

  4%|▎         | 13520/371472 [1:04:11<28:59:22,  3.43it/s]
  4%|▎         | 13521/371472 [1:04:12<27:42:18,  3.59it/s]
  4%|▎         | 13522/371472 [1:04:12<26:53:39,  3.70it/s]
  4%|▎         | 13523/371472 [1:04:12<27:22:30,  3.63it/s]
  4%|▎         | 13524/371472 [1:04:12<28:41:49,  3.46it/s]
  4%|▎         | 13525/371472 [1:04:13<30:23:39,  3.27it/s]
  4%|▎         | 13526/371472 [1:04:13<31:12:24,  3.19it/s]
  4%|▎         | 13527/371472 [1:04:13<31:07:38,  3.19it/s]
  4%|▎         | 13528/371472 [1:04:14<30:11:50,  3.29it/s]
  4%|▎         | 13529/371472 [1:04:14<29:32:16,  3.37it/s]
  4%|▎         | 13530/371472 [1:04:14<34:30:10,  2.88it/s]
  4%|▎         | 13531/371472 [1:04:15<35:04:59,  2.83it/s]
  4%|▎         | 13532/371472 [1:04:15<34:39:12,  2.87it/s]
  4%|▎         | 13533/371472 [1:04:15<31:40:42,  3.14it/s]
  4%|▎         | 13534/371472 [1:04:16<30:13:54,  3.29it/s]
  4%|▎         | 13535/371472 [1:04:16<29:48:18,  3.34it/s]
  4%|▎         | 13536/371472 [1:04:16<28:53:57,  3.44it/s]
  4%|▎         | 13537/371472 [1:04:17<28:16:28,  3.52it/s]
  4%|▎         | 13538/371472 [1:04:17<27:15:28,  3.65it/s]
  4%|▎         | 13539/371472 [1:04:17<28:38:03,  3.47it/s]
  4%|▎         | 13540/371472 [1:04:17<27:34:46,  3.61it/s]
                                                           
{'loss': 4.7964, 'learning_rate': 9.676625223555775e-07, 'epoch': 0.58}

  4%|▎         | 13540/371472 [1:04:17<27:34:46,  3.61it/s]
  4%|▎         | 13541/371472 [1:04:18<26:43:15,  3.72it/s]
  4%|▎         | 13542/371472 [1:04:18<26:21:20,  3.77it/s]
  4%|▎         | 13543/371472 [1:04:18<26:50:41,  3.70it/s]
  4%|▎         | 13544/371472 [1:04:18<26:56:25,  3.69it/s]
  4%|▎         | 13545/371472 [1:04:19<27:18:47,  3.64it/s]
  4%|▎         | 13546/371472 [1:04:19<30:50:48,  3.22it/s]
  4%|▎         | 13547/371472 [1:04:19<30:09:31,  3.30it/s]
  4%|▎         | 13548/371472 [1:04:20<29:02:24,  3.42it/s]
  4%|▎         | 13549/371472 [1:04:20<29:38:10,  3.35it/s]
  4%|▎         | 13550/371472 [1:04:20<31:18:02,  3.18it/s]
  4%|▎         | 13551/371472 [1:04:21<29:20:51,  3.39it/s]
  4%|▎         | 13552/371472 [1:04:21<28:13:24,  3.52it/s]
  4%|▎         | 13553/371472 [1:04:21<27:17:58,  3.64it/s]
  4%|▎         | 13554/371472 [1:04:21<27:42:42,  3.59it/s]
  4%|▎         | 13555/371472 [1:04:22<28:55:10,  3.44it/s]
  4%|▎         | 13556/371472 [1:04:22<27:47:10,  3.58it/s]
  4%|▎         | 13557/371472 [1:04:22<28:55:26,  3.44it/s]
  4%|▎         | 13558/371472 [1:04:23<27:53:50,  3.56it/s]
  4%|▎         | 13559/371472 [1:04:23<27:21:37,  3.63it/s]
  4%|▎         | 13560/371472 [1:04:23<26:57:56,  3.69it/s]
                                                           
{'loss': 4.538, 'learning_rate': 9.676140403800988e-07, 'epoch': 0.58}

  4%|▎         | 13560/371472 [1:04:23<26:57:56,  3.69it/s]
  4%|▎         | 13561/371472 [1:04:23<26:00:11,  3.82it/s]
  4%|▎         | 13562/371472 [1:04:24<26:10:28,  3.80it/s]
  4%|▎         | 13563/371472 [1:04:24<27:13:31,  3.65it/s]
  4%|▎         | 13564/371472 [1:04:24<26:46:44,  3.71it/s]
  4%|▎         | 13565/371472 [1:04:24<26:51:32,  3.70it/s]
  4%|▎         | 13566/371472 [1:04:25<26:24:48,  3.76it/s]
  4%|▎         | 13567/371472 [1:04:25<27:11:39,  3.66it/s]
  4%|▎         | 13568/371472 [1:04:25<27:52:10,  3.57it/s]
  4%|▎         | 13569/371472 [1:04:25<27:20:18,  3.64it/s]
  4%|▎         | 13570/371472 [1:04:26<27:27:12,  3.62it/s]
  4%|▎         | 13571/371472 [1:04:26<27:44:54,  3.58it/s]
  4%|▎         | 13572/371472 [1:04:26<26:55:46,  3.69it/s]
  4%|▎         | 13573/371472 [1:04:27<27:08:33,  3.66it/s]
  4%|▎         | 13574/371472 [1:04:27<27:29:23,  3.62it/s]
  4%|▎         | 13575/371472 [1:04:27<27:42:22,  3.59it/s]
  4%|▎         | 13576/371472 [1:04:27<27:43:27,  3.59it/s]
  4%|▎         | 13577/371472 [1:04:28<27:18:45,  3.64it/s]
  4%|▎         | 13578/371472 [1:04:28<26:52:13,  3.70it/s]
  4%|▎         | 13579/371472 [1:04:28<27:16:59,  3.64it/s]
  4%|▎         | 13580/371472 [1:04:29<27:28:11,  3.62it/s]
                                                           
{'loss': 4.6586, 'learning_rate': 9.675655584046197e-07, 'epoch': 0.58}

  4%|▎         | 13580/371472 [1:04:29<27:28:11,  3.62it/s]
  4%|▎         | 13581/371472 [1:04:29<28:17:04,  3.51it/s]
  4%|▎         | 13582/371472 [1:04:29<28:21:11,  3.51it/s]
  4%|▎         | 13583/371472 [1:04:29<28:22:47,  3.50it/s]
  4%|▎         | 13584/371472 [1:04:30<28:48:53,  3.45it/s]
  4%|▎         | 13585/371472 [1:04:30<29:54:58,  3.32it/s]
  4%|▎         | 13586/371472 [1:04:30<29:19:58,  3.39it/s]
  4%|▎         | 13587/371472 [1:04:31<28:38:18,  3.47it/s]
  4%|▎         | 13588/371472 [1:04:31<27:52:08,  3.57it/s]
  4%|▎         | 13589/371472 [1:04:31<27:05:12,  3.67it/s]
  4%|▎         | 13590/371472 [1:04:31<27:18:57,  3.64it/s]
  4%|▎         | 13591/371472 [1:04:32<26:31:56,  3.75it/s]
  4%|▎         | 13592/371472 [1:04:32<27:31:55,  3.61it/s]
  4%|▎         | 13593/371472 [1:04:32<26:51:25,  3.70it/s]
  4%|▎         | 13594/371472 [1:04:32<28:08:11,  3.53it/s]
  4%|▎         | 13595/371472 [1:04:33<28:09:36,  3.53it/s]
  4%|▎         | 13596/371472 [1:04:33<28:22:26,  3.50it/s]
  4%|▎         | 13597/371472 [1:04:33<27:29:21,  3.62it/s]
  4%|▎         | 13598/371472 [1:04:34<28:34:20,  3.48it/s]
  4%|▎         | 13599/371472 [1:04:34<29:21:30,  3.39it/s]
  4%|▎         | 13600/371472 [1:04:34<30:17:37,  3.28it/s]
                                                           
{'loss': 4.4211, 'learning_rate': 9.67517076429141e-07, 'epoch': 0.59}

  4%|▎         | 13600/371472 [1:04:34<30:17:37,  3.28it/s]
  4%|▎         | 13601/371472 [1:04:35<29:08:12,  3.41it/s]
  4%|▎         | 13602/371472 [1:04:35<28:48:32,  3.45it/s]
  4%|▎         | 13603/371472 [1:04:35<28:25:02,  3.50it/s]
  4%|▎         | 13604/371472 [1:04:35<29:51:58,  3.33it/s]
  4%|▎         | 13605/371472 [1:04:36<29:06:04,  3.42it/s]
  4%|▎         | 13606/371472 [1:04:36<28:02:10,  3.55it/s]
  4%|▎         | 13607/371472 [1:04:36<27:08:48,  3.66it/s]
  4%|▎         | 13608/371472 [1:04:37<27:33:42,  3.61it/s]
  4%|▎         | 13609/371472 [1:04:37<27:35:54,  3.60it/s]
  4%|▎         | 13610/371472 [1:04:37<27:38:45,  3.60it/s]
  4%|▎         | 13611/371472 [1:04:37<27:09:03,  3.66it/s]
  4%|▎         | 13612/371472 [1:04:38<26:02:34,  3.82it/s]
  4%|▎         | 13613/371472 [1:04:38<27:35:09,  3.60it/s]
  4%|▎         | 13614/371472 [1:04:38<27:09:40,  3.66it/s]
  4%|▎         | 13615/371472 [1:04:38<26:49:05,  3.71it/s]
  4%|▎         | 13616/371472 [1:04:39<26:35:42,  3.74it/s]
  4%|▎         | 13617/371472 [1:04:39<26:44:26,  3.72it/s]
  4%|▎         | 13618/371472 [1:04:39<27:33:15,  3.61it/s]
  4%|▎         | 13619/371472 [1:04:40<30:03:24,  3.31it/s]
  4%|▎         | 13620/371472 [1:04:40<30:33:30,  3.25it/s]
                                                           
{'loss': 4.7492, 'learning_rate': 9.67468594453662e-07, 'epoch': 0.59}

  4%|▎         | 13620/371472 [1:04:40<30:33:30,  3.25it/s]
  4%|▎         | 13621/371472 [1:04:40<29:32:13,  3.37it/s]
  4%|▎         | 13622/371472 [1:04:40<28:33:16,  3.48it/s]
  4%|▎         | 13623/371472 [1:04:41<29:42:39,  3.35it/s]
  4%|▎         | 13624/371472 [1:04:41<29:24:52,  3.38it/s]
  4%|▎         | 13625/371472 [1:04:41<28:46:34,  3.45it/s]
  4%|▎         | 13626/371472 [1:04:42<27:43:04,  3.59it/s]
  4%|▎         | 13627/371472 [1:04:42<27:16:29,  3.64it/s]
  4%|▎         | 13628/371472 [1:04:42<26:57:46,  3.69it/s]
  4%|▎         | 13629/371472 [1:04:42<28:01:38,  3.55it/s]
  4%|▎         | 13630/371472 [1:04:43<27:44:35,  3.58it/s]
  4%|▎         | 13631/371472 [1:04:43<27:08:55,  3.66it/s]
  4%|▎         | 13632/371472 [1:04:43<27:10:23,  3.66it/s]
  4%|▎         | 13633/371472 [1:04:43<26:46:27,  3.71it/s]
  4%|▎         | 13634/371472 [1:04:44<27:12:01,  3.65it/s]
  4%|▎         | 13635/371472 [1:04:44<26:32:36,  3.74it/s]
  4%|▎         | 13636/371472 [1:04:44<26:07:09,  3.81it/s]
  4%|▎         | 13637/371472 [1:04:45<25:40:36,  3.87it/s]
  4%|▎         | 13638/371472 [1:04:45<26:38:49,  3.73it/s]
  4%|▎         | 13639/371472 [1:04:45<28:35:21,  3.48it/s]
  4%|▎         | 13640/371472 [1:04:45<27:49:07,  3.57it/s]
                                                           
{'loss': 4.5692, 'learning_rate': 9.67420112478183e-07, 'epoch': 0.59}

  4%|▎         | 13640/371472 [1:04:45<27:49:07,  3.57it/s]
  4%|▎         | 13641/371472 [1:04:46<28:11:01,  3.53it/s]
  4%|▎         | 13642/371472 [1:04:46<28:43:12,  3.46it/s]
  4%|▎         | 13643/371472 [1:04:46<28:31:54,  3.48it/s]
  4%|▎         | 13644/371472 [1:04:47<28:10:05,  3.53it/s]
  4%|▎         | 13645/371472 [1:04:47<28:13:58,  3.52it/s]
  4%|▎         | 13646/371472 [1:04:47<27:46:06,  3.58it/s]
  4%|▎         | 13647/371472 [1:04:47<27:58:27,  3.55it/s]
  4%|▎         | 13648/371472 [1:04:48<27:25:06,  3.63it/s]
  4%|▎         | 13649/371472 [1:04:48<29:08:27,  3.41it/s]
  4%|▎         | 13650/371472 [1:04:48<29:59:54,  3.31it/s]
  4%|▎         | 13651/371472 [1:04:49<28:44:48,  3.46it/s]
  4%|▎         | 13652/371472 [1:04:49<29:01:37,  3.42it/s]
  4%|▎         | 13653/371472 [1:04:49<30:24:26,  3.27it/s]
  4%|▎         | 13654/371472 [1:04:50<30:21:07,  3.27it/s]
  4%|▎         | 13655/371472 [1:04:50<29:33:54,  3.36it/s]
  4%|▎         | 13656/371472 [1:04:50<28:45:15,  3.46it/s]
  4%|▎         | 13657/371472 [1:04:50<27:45:04,  3.58it/s]
  4%|▎         | 13658/371472 [1:04:51<28:42:41,  3.46it/s]
  4%|▎         | 13659/371472 [1:04:51<27:32:01,  3.61it/s]
  4%|▎         | 13660/371472 [1:04:51<26:30:09,  3.75it/s]
                                                           
{'loss': 4.4928, 'learning_rate': 9.673716305027042e-07, 'epoch': 0.59}

  4%|▎         | 13660/371472 [1:04:51<26:30:09,  3.75it/s]
  4%|▎         | 13661/371472 [1:04:51<25:49:05,  3.85it/s]
  4%|▎         | 13662/371472 [1:04:52<26:56:36,  3.69it/s]
  4%|▎         | 13663/371472 [1:04:52<27:40:16,  3.59it/s]
  4%|▎         | 13664/371472 [1:04:52<26:24:04,  3.76it/s]
  4%|▎         | 13665/371472 [1:04:53<27:31:57,  3.61it/s]
  4%|▎         | 13666/371472 [1:04:53<27:19:08,  3.64it/s]
  4%|▎         | 13667/371472 [1:04:53<28:38:46,  3.47it/s]
  4%|▎         | 13668/371472 [1:04:53<28:29:38,  3.49it/s]
  4%|▎         | 13669/371472 [1:04:54<29:01:30,  3.42it/s]
  4%|▎         | 13670/371472 [1:04:54<27:38:07,  3.60it/s]
  4%|▎         | 13671/371472 [1:04:54<27:24:44,  3.63it/s]
  4%|▎         | 13672/371472 [1:04:54<27:22:05,  3.63it/s]
  4%|▎         | 13673/371472 [1:04:55<26:46:50,  3.71it/s]
  4%|▎         | 13674/371472 [1:04:55<28:27:04,  3.49it/s]
  4%|▎         | 13675/371472 [1:04:55<28:02:49,  3.54it/s]
  4%|▎         | 13676/371472 [1:04:56<28:19:17,  3.51it/s]
  4%|▎         | 13677/371472 [1:04:56<27:12:01,  3.65it/s]
  4%|▎         | 13678/371472 [1:04:56<28:30:28,  3.49it/s]
  4%|▎         | 13679/371472 [1:04:56<27:19:41,  3.64it/s]
  4%|▎         | 13680/371472 [1:04:57<26:31:25,  3.75it/s]
                                                           
{'loss': 4.5794, 'learning_rate': 9.673231485272252e-07, 'epoch': 0.59}

  4%|▎         | 13680/371472 [1:04:57<26:31:25,  3.75it/s]
  4%|▎         | 13681/371472 [1:04:57<25:45:39,  3.86it/s]
  4%|▎         | 13682/371472 [1:04:57<27:09:21,  3.66it/s]
  4%|▎         | 13683/371472 [1:04:58<27:12:13,  3.65it/s]
  4%|▎         | 13684/371472 [1:04:58<28:17:22,  3.51it/s]
  4%|▎         | 13685/371472 [1:04:58<28:13:54,  3.52it/s]
  4%|▎         | 13686/371472 [1:04:58<28:20:45,  3.51it/s]
  4%|▎         | 13687/371472 [1:04:59<29:44:30,  3.34it/s]
  4%|▎         | 13688/371472 [1:04:59<29:05:41,  3.42it/s]
  4%|▎         | 13689/371472 [1:04:59<30:40:28,  3.24it/s]
  4%|▎         | 13690/371472 [1:05:00<30:37:57,  3.24it/s]
  4%|▎         | 13691/371472 [1:05:00<30:29:55,  3.26it/s]
  4%|▎         | 13692/371472 [1:05:00<29:58:53,  3.31it/s]
  4%|▎         | 13693/371472 [1:05:01<29:10:15,  3.41it/s]
  4%|▎         | 13694/371472 [1:05:01<28:50:12,  3.45it/s]
  4%|▎         | 13695/371472 [1:05:01<28:14:06,  3.52it/s]
  4%|▎         | 13696/371472 [1:05:01<27:06:45,  3.67it/s]
  4%|▎         | 13697/371472 [1:05:02<26:35:35,  3.74it/s]
  4%|▎         | 13698/371472 [1:05:02<27:45:27,  3.58it/s]
  4%|▎         | 13699/371472 [1:05:02<26:51:27,  3.70it/s]
  4%|▎         | 13700/371472 [1:05:02<27:47:00,  3.58it/s]
                                                           
{'loss': 4.658, 'learning_rate': 9.672746665517465e-07, 'epoch': 0.59}

  4%|▎         | 13700/371472 [1:05:02<27:47:00,  3.58it/s]
  4%|▎         | 13701/371472 [1:05:03<27:55:09,  3.56it/s]
  4%|▎         | 13702/371472 [1:05:03<26:55:53,  3.69it/s]
  4%|▎         | 13703/371472 [1:05:03<27:42:37,  3.59it/s]
  4%|▎         | 13704/371472 [1:05:04<29:01:42,  3.42it/s]
  4%|▎         | 13705/371472 [1:05:04<27:40:17,  3.59it/s]
  4%|▎         | 13706/371472 [1:05:04<30:16:56,  3.28it/s]
  4%|▎         | 13707/371472 [1:05:04<29:06:39,  3.41it/s]
  4%|▎         | 13708/371472 [1:05:05<29:26:51,  3.37it/s]
  4%|▎         | 13709/371472 [1:05:05<29:52:51,  3.33it/s]
  4%|▎         | 13710/371472 [1:05:05<28:12:28,  3.52it/s]
  4%|▎         | 13711/371472 [1:05:06<27:10:19,  3.66it/s]
  4%|▎         | 13712/371472 [1:05:06<26:31:33,  3.75it/s]
  4%|▎         | 13713/371472 [1:05:06<26:19:56,  3.77it/s]
  4%|▎         | 13714/371472 [1:05:06<29:10:48,  3.41it/s]
  4%|▎         | 13715/371472 [1:05:07<28:21:13,  3.50it/s]
  4%|▎         | 13716/371472 [1:05:07<27:40:18,  3.59it/s]
  4%|▎         | 13717/371472 [1:05:07<29:00:03,  3.43it/s]
  4%|▎         | 13718/371472 [1:05:08<27:57:16,  3.55it/s]
  4%|▎         | 13719/371472 [1:05:08<28:36:09,  3.47it/s]
  4%|▎         | 13720/371472 [1:05:08<28:01:00,  3.55it/s]
                                                           
{'loss': 4.4166, 'learning_rate': 9.672261845762674e-07, 'epoch': 0.59}

  4%|▎         | 13720/371472 [1:05:08<28:01:00,  3.55it/s]
  4%|▎         | 13721/371472 [1:05:08<28:07:29,  3.53it/s]
  4%|▎         | 13722/371472 [1:05:09<27:31:51,  3.61it/s]
  4%|▎         | 13723/371472 [1:05:09<27:02:37,  3.67it/s]
  4%|▎         | 13724/371472 [1:05:09<26:32:57,  3.74it/s]
  4%|▎         | 13725/371472 [1:05:10<30:02:02,  3.31it/s]
  4%|▎         | 13726/371472 [1:05:10<29:07:14,  3.41it/s]
  4%|▎         | 13727/371472 [1:05:10<28:57:18,  3.43it/s]
  4%|▎         | 13728/371472 [1:05:10<28:14:54,  3.52it/s]
  4%|▎         | 13729/371472 [1:05:11<27:34:22,  3.60it/s]
  4%|▎         | 13730/371472 [1:05:11<27:14:47,  3.65it/s]
  4%|▎         | 13731/371472 [1:05:11<27:02:39,  3.67it/s]
  4%|▎         | 13732/371472 [1:05:11<27:41:13,  3.59it/s]
  4%|▎         | 13733/371472 [1:05:12<27:38:00,  3.60it/s]
  4%|▎         | 13734/371472 [1:05:12<27:27:40,  3.62it/s]
  4%|▎         | 13735/371472 [1:05:12<29:08:57,  3.41it/s]
  4%|▎         | 13736/371472 [1:05:13<30:53:24,  3.22it/s]
  4%|▎         | 13737/371472 [1:05:13<30:33:54,  3.25it/s]
  4%|▎         | 13738/371472 [1:05:13<28:51:37,  3.44it/s]
  4%|▎         | 13739/371472 [1:05:14<28:57:47,  3.43it/s]
  4%|▎         | 13740/371472 [1:05:14<27:43:44,  3.58it/s]
                                                           
{'loss': 4.7738, 'learning_rate': 9.671777026007886e-07, 'epoch': 0.59}

  4%|▎         | 13740/371472 [1:05:14<27:43:44,  3.58it/s]
  4%|▎         | 13741/371472 [1:05:14<28:11:38,  3.52it/s]
  4%|▎         | 13742/371472 [1:05:14<28:32:31,  3.48it/s]
  4%|▎         | 13743/371472 [1:05:15<27:37:04,  3.60it/s]
  4%|▎         | 13744/371472 [1:05:15<26:58:23,  3.68it/s]
  4%|▎         | 13745/371472 [1:05:15<26:34:35,  3.74it/s]
  4%|▎         | 13746/371472 [1:05:15<27:49:41,  3.57it/s]
  4%|▎         | 13747/371472 [1:05:16<30:22:16,  3.27it/s]
  4%|▎         | 13748/371472 [1:05:16<29:07:20,  3.41it/s]
  4%|▎         | 13749/371472 [1:05:16<30:51:10,  3.22it/s]
  4%|▎         | 13750/371472 [1:05:17<31:07:00,  3.19it/s]
  4%|▎         | 13751/371472 [1:05:17<31:10:14,  3.19it/s]
  4%|▎         | 13752/371472 [1:05:17<30:54:42,  3.21it/s]
  4%|▎         | 13753/371472 [1:05:18<30:43:06,  3.23it/s]
  4%|▎         | 13754/371472 [1:05:18<29:41:57,  3.35it/s]
  4%|▎         | 13755/371472 [1:05:18<30:01:36,  3.31it/s]
  4%|▎         | 13756/371472 [1:05:19<31:13:49,  3.18it/s]
  4%|▎         | 13757/371472 [1:05:19<29:28:01,  3.37it/s]
  4%|▎         | 13758/371472 [1:05:19<31:27:12,  3.16it/s]
  4%|▎         | 13759/371472 [1:05:20<30:25:50,  3.27it/s]
  4%|▎         | 13760/371472 [1:05:20<29:40:51,  3.35it/s]
                                                           
{'loss': 4.6694, 'learning_rate': 9.671292206253095e-07, 'epoch': 0.59}

  4%|▎         | 13760/371472 [1:05:20<29:40:51,  3.35it/s]
  4%|▎         | 13761/371472 [1:05:20<29:24:23,  3.38it/s]
  4%|▎         | 13762/371472 [1:05:20<28:37:01,  3.47it/s]
  4%|▎         | 13763/371472 [1:05:21<28:08:49,  3.53it/s]
  4%|▎         | 13764/371472 [1:05:21<28:19:10,  3.51it/s]
  4%|▎         | 13765/371472 [1:05:21<28:05:05,  3.54it/s]
  4%|▎         | 13766/371472 [1:05:22<28:25:53,  3.49it/s]
  4%|▎         | 13767/371472 [1:05:22<27:09:07,  3.66it/s]
  4%|▎         | 13768/371472 [1:05:22<27:04:03,  3.67it/s]
  4%|▎         | 13769/371472 [1:05:22<27:26:19,  3.62it/s]
  4%|▎         | 13770/371472 [1:05:23<27:24:06,  3.63it/s]
  4%|▎         | 13771/371472 [1:05:23<26:55:39,  3.69it/s]
  4%|▎         | 13772/371472 [1:05:23<27:27:02,  3.62it/s]
  4%|▎         | 13773/371472 [1:05:23<26:39:13,  3.73it/s]
  4%|▎         | 13774/371472 [1:05:24<26:16:05,  3.78it/s]
  4%|▎         | 13775/371472 [1:05:24<26:27:16,  3.76it/s]
  4%|▎         | 13776/371472 [1:05:24<26:22:09,  3.77it/s]
  4%|▎         | 13777/371472 [1:05:24<27:23:15,  3.63it/s]
  4%|▎         | 13778/371472 [1:05:25<27:38:48,  3.59it/s]
  4%|▎         | 13779/371472 [1:05:25<26:44:57,  3.71it/s]
  4%|▎         | 13780/371472 [1:05:25<26:23:53,  3.76it/s]
                                                           
{'loss': 4.796, 'learning_rate': 9.670807386498308e-07, 'epoch': 0.59}

  4%|▎         | 13780/371472 [1:05:25<26:23:53,  3.76it/s]
  4%|▎         | 13781/371472 [1:05:26<26:00:01,  3.82it/s]
  4%|▎         | 13782/371472 [1:05:26<26:56:50,  3.69it/s]
  4%|▎         | 13783/371472 [1:05:26<30:28:11,  3.26it/s]
  4%|▎         | 13784/371472 [1:05:26<30:00:45,  3.31it/s]
  4%|▎         | 13785/371472 [1:05:27<30:56:32,  3.21it/s]
  4%|▎         | 13786/371472 [1:05:27<30:37:33,  3.24it/s]
  4%|▎         | 13787/371472 [1:05:27<29:27:28,  3.37it/s]
  4%|▎         | 13788/371472 [1:05:28<28:54:16,  3.44it/s]
  4%|▎         | 13789/371472 [1:05:28<27:56:05,  3.56it/s]
  4%|▎         | 13790/371472 [1:05:28<27:45:56,  3.58it/s]
  4%|▎         | 13791/371472 [1:05:29<29:09:48,  3.41it/s]
  4%|▎         | 13792/371472 [1:05:29<28:09:39,  3.53it/s]
  4%|▎         | 13793/371472 [1:05:29<27:48:30,  3.57it/s]
  4%|▎         | 13794/371472 [1:05:29<30:20:46,  3.27it/s]
  4%|▎         | 13795/371472 [1:05:30<29:15:47,  3.40it/s]
  4%|▎         | 13796/371472 [1:05:30<29:56:48,  3.32it/s]
  4%|▎         | 13797/371472 [1:05:30<29:14:48,  3.40it/s]
  4%|▎         | 13798/371472 [1:05:31<28:58:10,  3.43it/s]
  4%|▎         | 13799/371472 [1:05:31<28:06:37,  3.53it/s]
  4%|▎         | 13800/371472 [1:05:31<27:54:27,  3.56it/s]
                                                           
{'loss': 4.506, 'learning_rate': 9.670322566743519e-07, 'epoch': 0.59}

  4%|▎         | 13800/371472 [1:05:31<27:54:27,  3.56it/s]
  4%|▎         | 13801/371472 [1:05:31<29:13:24,  3.40it/s]
  4%|▎         | 13802/371472 [1:05:32<28:16:54,  3.51it/s]
  4%|▎         | 13803/371472 [1:05:32<27:31:04,  3.61it/s]
  4%|▎         | 13804/371472 [1:05:32<27:59:43,  3.55it/s]
  4%|▎         | 13805/371472 [1:05:32<27:03:20,  3.67it/s]
  4%|▎         | 13806/371472 [1:05:33<26:31:58,  3.74it/s]
  4%|▎         | 13807/371472 [1:05:33<27:52:34,  3.56it/s]
  4%|▎         | 13808/371472 [1:05:33<30:05:49,  3.30it/s]
  4%|▎         | 13809/371472 [1:05:34<31:47:16,  3.13it/s]
  4%|▎         | 13810/371472 [1:05:34<31:05:21,  3.20it/s]
  4%|▎         | 13811/371472 [1:05:34<28:53:54,  3.44it/s]
  4%|▎         | 13812/371472 [1:05:35<28:17:36,  3.51it/s]
  4%|▎         | 13813/371472 [1:05:35<30:15:16,  3.28it/s]
  4%|▎         | 13814/371472 [1:05:35<30:15:57,  3.28it/s]
  4%|▎         | 13815/371472 [1:05:36<29:18:51,  3.39it/s]
  4%|▎         | 13816/371472 [1:05:36<28:43:57,  3.46it/s]
  4%|▎         | 13817/371472 [1:05:36<28:24:09,  3.50it/s]
  4%|▎         | 13818/371472 [1:05:36<27:58:40,  3.55it/s]
  4%|▎         | 13819/371472 [1:05:37<27:55:22,  3.56it/s]
  4%|▎         | 13820/371472 [1:05:37<29:59:37,  3.31it/s]
                                                           
{'loss': 4.4972, 'learning_rate': 9.66983774698873e-07, 'epoch': 0.6}

  4%|▎         | 13820/371472 [1:05:37<29:59:37,  3.31it/s]
  4%|▎         | 13821/371472 [1:05:37<29:11:33,  3.40it/s]
  4%|▎         | 13822/371472 [1:05:38<31:56:06,  3.11it/s]
  4%|▎         | 13823/371472 [1:05:38<30:49:07,  3.22it/s]
  4%|▎         | 13824/371472 [1:05:38<29:22:16,  3.38it/s]
  4%|▎         | 13825/371472 [1:05:38<28:14:50,  3.52it/s]
  4%|▎         | 13826/371472 [1:05:39<28:19:37,  3.51it/s]
  4%|▎         | 13827/371472 [1:05:39<28:52:25,  3.44it/s]
  4%|▎         | 13828/371472 [1:05:39<27:55:20,  3.56it/s]
  4%|▎         | 13829/371472 [1:05:40<26:59:51,  3.68it/s]
  4%|▎         | 13830/371472 [1:05:40<28:59:09,  3.43it/s]
  4%|▎         | 13831/371472 [1:05:40<31:41:08,  3.14it/s]
  4%|▎         | 13832/371472 [1:05:41<29:46:46,  3.34it/s]
  4%|▎         | 13833/371472 [1:05:41<28:17:10,  3.51it/s]
  4%|▎         | 13834/371472 [1:05:41<27:40:23,  3.59it/s]
  4%|▎         | 13835/371472 [1:05:41<28:35:52,  3.47it/s]
  4%|▎         | 13836/371472 [1:05:42<28:52:12,  3.44it/s]
  4%|▎         | 13837/371472 [1:05:42<27:40:22,  3.59it/s]
  4%|▎         | 13838/371472 [1:05:42<26:56:57,  3.69it/s]
  4%|▎         | 13839/371472 [1:05:42<26:27:54,  3.75it/s]
  4%|▎         | 13840/371472 [1:05:43<26:12:34,  3.79it/s]
                                                           
{'loss': 4.7098, 'learning_rate': 9.669352927233942e-07, 'epoch': 0.6}

  4%|▎         | 13840/371472 [1:05:43<26:12:34,  3.79it/s]
  4%|▎         | 13841/371472 [1:05:43<26:37:33,  3.73it/s]
  4%|▎         | 13842/371472 [1:05:43<27:29:37,  3.61it/s]
  4%|▎         | 13843/371472 [1:05:43<27:33:15,  3.61it/s]
  4%|▎         | 13844/371472 [1:05:44<27:53:48,  3.56it/s]
  4%|▎         | 13845/371472 [1:05:44<29:19:50,  3.39it/s]
  4%|▎         | 13846/371472 [1:05:44<28:06:40,  3.53it/s]
  4%|▎         | 13847/371472 [1:05:45<28:47:22,  3.45it/s]
  4%|▎         | 13848/371472 [1:05:45<27:59:21,  3.55it/s]
  4%|▎         | 13849/371472 [1:05:45<27:35:05,  3.60it/s]
  4%|▎         | 13850/371472 [1:05:45<27:47:44,  3.57it/s]
  4%|▎         | 13851/371472 [1:05:46<29:10:37,  3.40it/s]
  4%|▎         | 13852/371472 [1:05:46<30:09:03,  3.29it/s]
  4%|▎         | 13853/371472 [1:05:46<29:15:13,  3.40it/s]
  4%|▎         | 13854/371472 [1:05:47<28:00:50,  3.55it/s]
  4%|▎         | 13855/371472 [1:05:47<26:56:20,  3.69it/s]
  4%|▎         | 13856/371472 [1:05:47<28:21:31,  3.50it/s]
  4%|▎         | 13857/371472 [1:05:47<27:22:42,  3.63it/s]
  4%|▎         | 13858/371472 [1:05:48<29:34:45,  3.36it/s]
  4%|▎         | 13859/371472 [1:05:48<31:33:48,  3.15it/s]
  4%|▎         | 13860/371472 [1:05:48<30:33:06,  3.25it/s]
                                                           
{'loss': 4.3856, 'learning_rate': 9.668868107479153e-07, 'epoch': 0.6}

  4%|▎         | 13860/371472 [1:05:48<30:33:06,  3.25it/s]
  4%|▎         | 13861/371472 [1:05:49<30:26:18,  3.26it/s]
  4%|▎         | 13862/371472 [1:05:49<31:08:45,  3.19it/s]
  4%|▎         | 13863/371472 [1:05:49<31:08:10,  3.19it/s]
  4%|▎         | 13864/371472 [1:05:50<30:06:13,  3.30it/s]
  4%|▎         | 13865/371472 [1:05:50<28:30:26,  3.48it/s]
  4%|▎         | 13866/371472 [1:05:50<27:32:10,  3.61it/s]
  4%|▎         | 13867/371472 [1:05:51<27:55:08,  3.56it/s]
  4%|▎         | 13868/371472 [1:05:51<27:41:58,  3.59it/s]
  4%|▎         | 13869/371472 [1:05:51<26:50:52,  3.70it/s]
  4%|▎         | 13870/371472 [1:05:51<27:38:35,  3.59it/s]
  4%|▎         | 13871/371472 [1:05:52<29:18:54,  3.39it/s]
  4%|▎         | 13872/371472 [1:05:52<28:56:54,  3.43it/s]
  4%|▎         | 13873/371472 [1:05:52<27:50:14,  3.57it/s]
  4%|▎         | 13874/371472 [1:05:52<27:18:51,  3.64it/s]
  4%|▎         | 13875/371472 [1:05:53<27:47:01,  3.58it/s]
  4%|▎         | 13876/371472 [1:05:53<28:15:07,  3.52it/s]
  4%|▎         | 13877/371472 [1:05:53<27:20:10,  3.63it/s]
  4%|▎         | 13878/371472 [1:05:54<27:07:57,  3.66it/s]
  4%|▎         | 13879/371472 [1:05:54<27:17:48,  3.64it/s]
  4%|▎         | 13880/371472 [1:05:54<27:27:43,  3.62it/s]
                                                           
{'loss': 4.6158, 'learning_rate': 9.668383287724364e-07, 'epoch': 0.6}

  4%|▎         | 13880/371472 [1:05:54<27:27:43,  3.62it/s]
  4%|▎         | 13881/371472 [1:05:54<27:32:29,  3.61it/s]
  4%|▎         | 13882/371472 [1:05:55<26:54:41,  3.69it/s]
  4%|▎         | 13883/371472 [1:05:55<26:12:54,  3.79it/s]
  4%|▎         | 13884/371472 [1:05:55<26:28:30,  3.75it/s]
  4%|▎         | 13885/371472 [1:05:55<26:54:05,  3.69it/s]
  4%|▎         | 13886/371472 [1:05:56<26:43:12,  3.72it/s]
  4%|▎         | 13887/371472 [1:05:56<26:18:59,  3.77it/s]
  4%|▎         | 13888/371472 [1:05:56<27:12:41,  3.65it/s]
  4%|▎         | 13889/371472 [1:05:57<27:15:49,  3.64it/s]
  4%|▎         | 13890/371472 [1:05:57<27:03:57,  3.67it/s]
  4%|▎         | 13891/371472 [1:05:57<26:15:56,  3.78it/s]
  4%|▎         | 13892/371472 [1:05:57<28:03:42,  3.54it/s]
  4%|▎         | 13893/371472 [1:05:58<27:07:28,  3.66it/s]
  4%|▎         | 13894/371472 [1:05:58<26:37:32,  3.73it/s]
  4%|▎         | 13895/371472 [1:05:58<27:17:10,  3.64it/s]
  4%|▎         | 13896/371472 [1:05:59<28:52:32,  3.44it/s]
  4%|▎         | 13897/371472 [1:05:59<28:57:38,  3.43it/s]
  4%|▎         | 13898/371472 [1:05:59<28:28:00,  3.49it/s]
  4%|▎         | 13899/371472 [1:05:59<29:04:21,  3.42it/s]
  4%|▎         | 13900/371472 [1:06:00<28:25:17,  3.49it/s]
                                                           
{'loss': 4.5539, 'learning_rate': 9.667898467969574e-07, 'epoch': 0.6}

  4%|▎         | 13900/371472 [1:06:00<28:25:17,  3.49it/s]
  4%|▎         | 13901/371472 [1:06:00<27:58:52,  3.55it/s]
  4%|▎         | 13902/371472 [1:06:00<28:28:27,  3.49it/s]
  4%|▎         | 13903/371472 [1:06:01<27:59:45,  3.55it/s]
  4%|▎         | 13904/371472 [1:06:01<27:38:41,  3.59it/s]
  4%|▎         | 13905/371472 [1:06:01<26:21:18,  3.77it/s]
  4%|▎         | 13906/371472 [1:06:01<28:34:31,  3.48it/s]
  4%|▎         | 13907/371472 [1:06:02<27:46:54,  3.58it/s]
  4%|▎         | 13908/371472 [1:06:02<27:24:11,  3.62it/s]
  4%|▎         | 13909/371472 [1:06:02<27:20:18,  3.63it/s]
  4%|▎         | 13910/371472 [1:06:02<27:56:16,  3.56it/s]
  4%|▎         | 13911/371472 [1:06:03<26:49:22,  3.70it/s]
  4%|▎         | 13912/371472 [1:06:03<27:04:14,  3.67it/s]
  4%|▎         | 13913/371472 [1:06:03<27:20:22,  3.63it/s]
  4%|▎         | 13914/371472 [1:06:04<27:56:10,  3.56it/s]
  4%|▎         | 13915/371472 [1:06:04<27:00:16,  3.68it/s]
  4%|▎         | 13916/371472 [1:06:04<30:58:42,  3.21it/s]
  4%|▎         | 13917/371472 [1:06:04<30:24:57,  3.27it/s]
  4%|▎         | 13918/371472 [1:06:05<31:11:39,  3.18it/s]
  4%|▎         | 13919/371472 [1:06:05<31:19:54,  3.17it/s]
  4%|▎         | 13920/371472 [1:06:05<29:34:22,  3.36it/s]
                                                           
{'loss': 4.6079, 'learning_rate': 9.667413648214785e-07, 'epoch': 0.6}

  4%|▎         | 13920/371472 [1:06:05<29:34:22,  3.36it/s]
  4%|▎         | 13921/371472 [1:06:06<28:35:53,  3.47it/s]
  4%|▎         | 13922/371472 [1:06:06<28:16:43,  3.51it/s]
  4%|▎         | 13923/371472 [1:06:06<27:38:04,  3.59it/s]
  4%|▎         | 13924/371472 [1:06:07<33:38:48,  2.95it/s]
  4%|▎         | 13925/371472 [1:06:07<31:27:40,  3.16it/s]
  4%|▎         | 13926/371472 [1:06:07<31:02:37,  3.20it/s]
  4%|▎         | 13927/371472 [1:06:08<29:01:57,  3.42it/s]
  4%|▎         | 13928/371472 [1:06:08<27:52:47,  3.56it/s]
  4%|▎         | 13929/371472 [1:06:08<27:05:44,  3.67it/s]
  4%|▎         | 13930/371472 [1:06:08<30:27:18,  3.26it/s]
  4%|▍         | 13931/371472 [1:06:09<28:44:55,  3.45it/s]
  4%|▍         | 13932/371472 [1:06:09<31:04:48,  3.20it/s]
  4%|▍         | 13933/371472 [1:06:09<29:32:22,  3.36it/s]
  4%|▍         | 13934/371472 [1:06:10<29:45:42,  3.34it/s]
  4%|▍         | 13935/371472 [1:06:10<28:35:29,  3.47it/s]
  4%|▍         | 13936/371472 [1:06:10<30:15:35,  3.28it/s]
  4%|▍         | 13937/371472 [1:06:10<29:54:37,  3.32it/s]
  4%|▍         | 13938/371472 [1:06:11<28:36:57,  3.47it/s]
  4%|▍         | 13939/371472 [1:06:11<28:17:26,  3.51it/s]
  4%|▍         | 13940/371472 [1:06:11<29:37:31,  3.35it/s]
                                                           
{'loss': 4.7394, 'learning_rate': 9.666928828459998e-07, 'epoch': 0.6}

  4%|▍         | 13940/371472 [1:06:11<29:37:31,  3.35it/s]
  4%|▍         | 13941/371472 [1:06:12<30:29:36,  3.26it/s]
  4%|▍         | 13942/371472 [1:06:12<28:59:18,  3.43it/s]
  4%|▍         | 13943/371472 [1:06:12<28:23:20,  3.50it/s]
  4%|▍         | 13944/371472 [1:06:13<29:26:29,  3.37it/s]
  4%|▍         | 13945/371472 [1:06:13<28:04:35,  3.54it/s]
  4%|▍         | 13946/371472 [1:06:13<28:42:53,  3.46it/s]
  4%|▍         | 13947/371472 [1:06:13<29:05:47,  3.41it/s]
  4%|▍         | 13948/371472 [1:06:14<28:14:34,  3.52it/s]
  4%|▍         | 13949/371472 [1:06:14<27:35:37,  3.60it/s]
  4%|▍         | 13950/371472 [1:06:14<28:31:10,  3.48it/s]
  4%|▍         | 13951/371472 [1:06:15<30:59:28,  3.20it/s]
  4%|▍         | 13952/371472 [1:06:15<29:21:12,  3.38it/s]
  4%|▍         | 13953/371472 [1:06:15<28:35:09,  3.47it/s]
  4%|▍         | 13954/371472 [1:06:15<27:47:43,  3.57it/s]
  4%|▍         | 13955/371472 [1:06:16<29:43:17,  3.34it/s]
  4%|▍         | 13956/371472 [1:06:16<31:15:45,  3.18it/s]
  4%|▍         | 13957/371472 [1:06:16<30:40:04,  3.24it/s]
  4%|▍         | 13958/371472 [1:06:17<32:33:12,  3.05it/s]
  4%|▍         | 13959/371472 [1:06:17<31:34:43,  3.14it/s]
  4%|▍         | 13960/371472 [1:06:17<31:34:20,  3.15it/s]
                                                           
{'loss': 4.6476, 'learning_rate': 9.666444008705206e-07, 'epoch': 0.6}

  4%|▍         | 13960/371472 [1:06:17<31:34:20,  3.15it/s]
  4%|▍         | 13961/371472 [1:06:18<31:50:51,  3.12it/s]
  4%|▍         | 13962/371472 [1:06:18<30:02:44,  3.31it/s]
  4%|▍         | 13963/371472 [1:06:18<30:59:59,  3.20it/s]
  4%|▍         | 13964/371472 [1:06:19<30:43:08,  3.23it/s]
  4%|▍         | 13965/371472 [1:06:19<28:40:09,  3.46it/s]
  4%|▍         | 13966/371472 [1:06:19<27:59:48,  3.55it/s]
  4%|▍         | 13967/371472 [1:06:19<29:16:28,  3.39it/s]
  4%|▍         | 13968/371472 [1:06:20<29:56:06,  3.32it/s]
  4%|▍         | 13969/371472 [1:06:20<29:49:40,  3.33it/s]
  4%|▍         | 13970/371472 [1:06:20<29:36:05,  3.35it/s]
  4%|▍         | 13971/371472 [1:06:21<30:04:03,  3.30it/s]
  4%|▍         | 13972/371472 [1:06:21<32:13:41,  3.08it/s]
  4%|▍         | 13973/371472 [1:06:21<31:43:07,  3.13it/s]
  4%|▍         | 13974/371472 [1:06:22<30:41:06,  3.24it/s]
  4%|▍         | 13975/371472 [1:06:22<29:46:06,  3.34it/s]
  4%|▍         | 13976/371472 [1:06:22<29:21:55,  3.38it/s]
  4%|▍         | 13977/371472 [1:06:22<29:13:35,  3.40it/s]
  4%|▍         | 13978/371472 [1:06:23<29:39:43,  3.35it/s]
  4%|▍         | 13979/371472 [1:06:23<28:09:58,  3.53it/s]
  4%|▍         | 13980/371472 [1:06:23<27:38:08,  3.59it/s]
                                                           
{'loss': 4.5925, 'learning_rate': 9.66595918895042e-07, 'epoch': 0.6}

  4%|▍         | 13980/371472 [1:06:23<27:38:08,  3.59it/s]
  4%|▍         | 13981/371472 [1:06:24<28:42:15,  3.46it/s]
  4%|▍         | 13982/371472 [1:06:24<29:44:20,  3.34it/s]
  4%|▍         | 13983/371472 [1:06:24<27:54:16,  3.56it/s]
  4%|▍         | 13984/371472 [1:06:24<29:08:51,  3.41it/s]
  4%|▍         | 13985/371472 [1:06:25<28:03:50,  3.54it/s]
  4%|▍         | 13986/371472 [1:06:25<28:24:47,  3.49it/s]
  4%|▍         | 13987/371472 [1:06:25<28:33:26,  3.48it/s]
  4%|▍         | 13988/371472 [1:06:26<27:29:17,  3.61it/s]
  4%|▍         | 13989/371472 [1:06:26<28:05:16,  3.54it/s]
  4%|▍         | 13990/371472 [1:06:26<28:50:54,  3.44it/s]
  4%|▍         | 13991/371472 [1:06:27<31:04:51,  3.19it/s]
  4%|▍         | 13992/371472 [1:06:27<29:48:27,  3.33it/s]
  4%|▍         | 13993/371472 [1:06:27<28:58:26,  3.43it/s]
  4%|▍         | 13994/371472 [1:06:27<29:31:19,  3.36it/s]
  4%|▍         | 13995/371472 [1:06:28<30:14:46,  3.28it/s]
  4%|▍         | 13996/371472 [1:06:28<30:39:27,  3.24it/s]
  4%|▍         | 13997/371472 [1:06:28<30:02:56,  3.30it/s]
  4%|▍         | 13998/371472 [1:06:29<29:08:15,  3.41it/s]
  4%|▍         | 13999/371472 [1:06:29<28:23:44,  3.50it/s]
  4%|▍         | 14000/371472 [1:06:29<27:59:52,  3.55it/s]
                                                           
{'loss': 4.4916, 'learning_rate': 9.66547436919563e-07, 'epoch': 0.6}

  4%|▍         | 14000/371472 [1:06:29<27:59:52,  3.55it/s]
  4%|▍         | 14001/371472 [1:06:29<28:40:32,  3.46it/s]
  4%|▍         | 14002/371472 [1:06:30<27:25:50,  3.62it/s]
  4%|▍         | 14003/371472 [1:06:30<27:05:11,  3.67it/s]
  4%|▍         | 14004/371472 [1:06:30<29:04:10,  3.42it/s]
  4%|▍         | 14005/371472 [1:06:31<29:15:50,  3.39it/s]
  4%|▍         | 14006/371472 [1:06:31<28:14:45,  3.52it/s]
  4%|▍         | 14007/371472 [1:06:31<28:00:21,  3.55it/s]
  4%|▍         | 14008/371472 [1:06:31<27:09:58,  3.66it/s]
  4%|▍         | 14009/371472 [1:06:32<26:56:04,  3.69it/s]
  4%|▍         | 14010/371472 [1:06:32<27:00:14,  3.68it/s]
  4%|▍         | 14011/371472 [1:06:32<26:56:43,  3.69it/s]
  4%|▍         | 14012/371472 [1:06:32<26:45:40,  3.71it/s]
  4%|▍         | 14013/371472 [1:06:33<27:09:27,  3.66it/s]
  4%|▍         | 14014/371472 [1:06:33<27:04:41,  3.67it/s]
  4%|▍         | 14015/371472 [1:06:33<27:11:08,  3.65it/s]
  4%|▍         | 14016/371472 [1:06:34<27:26:47,  3.62it/s]
  4%|▍         | 14017/371472 [1:06:34<27:44:26,  3.58it/s]
  4%|▍         | 14018/371472 [1:06:34<26:32:28,  3.74it/s]
  4%|▍         | 14019/371472 [1:06:34<26:55:27,  3.69it/s]
  4%|▍         | 14020/371472 [1:06:35<27:29:34,  3.61it/s]
                                                           
{'loss': 4.584, 'learning_rate': 9.66498954944084e-07, 'epoch': 0.6}

  4%|▍         | 14020/371472 [1:06:35<27:29:34,  3.61it/s]
  4%|▍         | 14021/371472 [1:06:35<27:56:42,  3.55it/s]
  4%|▍         | 14022/371472 [1:06:35<28:10:28,  3.52it/s]
  4%|▍         | 14023/371472 [1:06:35<27:09:23,  3.66it/s]
  4%|▍         | 14024/371472 [1:06:36<27:20:56,  3.63it/s]
  4%|▍         | 14025/371472 [1:06:36<29:12:00,  3.40it/s]
  4%|▍         | 14026/371472 [1:06:36<30:39:17,  3.24it/s]
  4%|▍         | 14027/371472 [1:06:37<29:56:33,  3.32it/s]
  4%|▍         | 14028/371472 [1:06:37<29:18:20,  3.39it/s]
  4%|▍         | 14029/371472 [1:06:37<28:18:26,  3.51it/s]
  4%|▍         | 14030/371472 [1:06:38<27:15:47,  3.64it/s]
  4%|▍         | 14031/371472 [1:06:38<30:21:55,  3.27it/s]
  4%|▍         | 14032/371472 [1:06:38<29:16:27,  3.39it/s]
  4%|▍         | 14033/371472 [1:06:38<28:11:03,  3.52it/s]
  4%|▍         | 14034/371472 [1:06:39<29:00:41,  3.42it/s]
  4%|▍         | 14035/371472 [1:06:39<28:34:05,  3.48it/s]
  4%|▍         | 14036/371472 [1:06:39<28:29:22,  3.49it/s]
  4%|▍         | 14037/371472 [1:06:40<27:13:41,  3.65it/s]
  4%|▍         | 14038/371472 [1:06:40<26:23:47,  3.76it/s]
  4%|▍         | 14039/371472 [1:06:40<27:05:50,  3.66it/s]
  4%|▍         | 14040/371472 [1:06:40<27:50:33,  3.57it/s]
                                                           
{'loss': 4.926, 'learning_rate': 9.664504729686051e-07, 'epoch': 0.6}

  4%|▍         | 14040/371472 [1:06:40<27:50:33,  3.57it/s]
  4%|▍         | 14041/371472 [1:06:41<28:11:21,  3.52it/s]
  4%|▍         | 14042/371472 [1:06:41<27:57:02,  3.55it/s]
  4%|▍         | 14043/371472 [1:06:41<28:05:02,  3.54it/s]
  4%|▍         | 14044/371472 [1:06:42<27:32:10,  3.61it/s]
  4%|▍         | 14045/371472 [1:06:42<27:11:21,  3.65it/s]
  4%|▍         | 14046/371472 [1:06:42<25:58:31,  3.82it/s]
  4%|▍         | 14047/371472 [1:06:42<25:13:36,  3.94it/s]
  4%|▍         | 14048/371472 [1:06:43<27:11:21,  3.65it/s]
  4%|▍         | 14049/371472 [1:06:43<27:08:08,  3.66it/s]
  4%|▍         | 14050/371472 [1:06:43<26:41:59,  3.72it/s]
  4%|▍         | 14051/371472 [1:06:43<26:02:08,  3.81it/s]
  4%|▍         | 14052/371472 [1:06:44<26:47:35,  3.71it/s]
  4%|▍         | 14053/371472 [1:06:44<26:19:28,  3.77it/s]
  4%|▍         | 14054/371472 [1:06:44<25:30:16,  3.89it/s]
  4%|▍         | 14055/371472 [1:06:44<25:01:07,  3.97it/s]
  4%|▍         | 14056/371472 [1:06:45<25:05:09,  3.96it/s]
  4%|▍         | 14057/371472 [1:06:45<25:44:33,  3.86it/s]
  4%|▍         | 14058/371472 [1:06:45<25:39:32,  3.87it/s]
  4%|▍         | 14059/371472 [1:06:45<25:31:30,  3.89it/s]
  4%|▍         | 14060/371472 [1:06:46<25:22:46,  3.91it/s]
                                                           
{'loss': 4.7048, 'learning_rate': 9.664019909931262e-07, 'epoch': 0.61}

  4%|▍         | 14060/371472 [1:06:46<25:22:46,  3.91it/s]
  4%|▍         | 14061/371472 [1:06:46<26:02:38,  3.81it/s]
  4%|▍         | 14062/371472 [1:06:46<26:40:25,  3.72it/s]
  4%|▍         | 14063/371472 [1:06:46<26:17:45,  3.78it/s]
  4%|▍         | 14064/371472 [1:06:47<27:10:28,  3.65it/s]
  4%|▍         | 14065/371472 [1:06:47<26:46:09,  3.71it/s]
  4%|▍         | 14066/371472 [1:06:47<26:07:51,  3.80it/s]
  4%|▍         | 14067/371472 [1:06:48<26:18:44,  3.77it/s]
  4%|▍         | 14068/371472 [1:06:48<28:33:55,  3.48it/s]
  4%|▍         | 14069/371472 [1:06:48<28:54:08,  3.43it/s]
  4%|▍         | 14070/371472 [1:06:48<27:53:45,  3.56it/s]
  4%|▍         | 14071/371472 [1:06:49<27:01:23,  3.67it/s]
  4%|▍         | 14072/371472 [1:06:49<30:46:46,  3.23it/s]
  4%|▍         | 14073/371472 [1:06:50<34:15:17,  2.90it/s]
  4%|▍         | 14074/371472 [1:06:50<31:40:25,  3.13it/s]
  4%|▍         | 14075/371472 [1:06:50<29:34:54,  3.36it/s]
  4%|▍         | 14076/371472 [1:06:50<28:01:55,  3.54it/s]
  4%|▍         | 14077/371472 [1:06:51<27:05:29,  3.66it/s]
  4%|▍         | 14078/371472 [1:06:51<26:58:24,  3.68it/s]
  4%|▍         | 14079/371472 [1:06:51<26:12:47,  3.79it/s]
  4%|▍         | 14080/371472 [1:06:51<27:40:42,  3.59it/s]
                                                           
{'loss': 4.8114, 'learning_rate': 9.663535090176475e-07, 'epoch': 0.61}

  4%|▍         | 14080/371472 [1:06:51<27:40:42,  3.59it/s]
  4%|▍         | 14081/371472 [1:06:52<28:48:41,  3.45it/s]
  4%|▍         | 14082/371472 [1:06:52<31:06:18,  3.19it/s]
  4%|▍         | 14083/371472 [1:06:52<31:50:51,  3.12it/s]
  4%|▍         | 14084/371472 [1:06:53<31:59:45,  3.10it/s]
  4%|▍         | 14085/371472 [1:06:53<29:58:41,  3.31it/s]
  4%|▍         | 14086/371472 [1:06:53<29:21:51,  3.38it/s]
  4%|▍         | 14087/371472 [1:06:54<29:01:08,  3.42it/s]
  4%|▍         | 14088/371472 [1:06:54<29:31:39,  3.36it/s]
  4%|▍         | 14089/371472 [1:06:54<27:42:54,  3.58it/s]
  4%|▍         | 14090/371472 [1:06:54<28:57:29,  3.43it/s]
  4%|▍         | 14091/371472 [1:06:55<30:12:30,  3.29it/s]
  4%|▍         | 14092/371472 [1:06:55<29:21:43,  3.38it/s]
  4%|▍         | 14093/371472 [1:06:55<27:45:17,  3.58it/s]
  4%|▍         | 14094/371472 [1:06:56<28:57:51,  3.43it/s]
  4%|▍         | 14095/371472 [1:06:56<28:16:48,  3.51it/s]
  4%|▍         | 14096/371472 [1:06:56<29:17:27,  3.39it/s]
  4%|▍         | 14097/371472 [1:06:56<28:22:52,  3.50it/s]
  4%|▍         | 14098/371472 [1:06:57<26:59:35,  3.68it/s]
  4%|▍         | 14099/371472 [1:06:57<29:43:08,  3.34it/s]
  4%|▍         | 14100/371472 [1:06:57<29:23:05,  3.38it/s]
                                                           
{'loss': 4.6444, 'learning_rate': 9.663050270421686e-07, 'epoch': 0.61}

  4%|▍         | 14100/371472 [1:06:57<29:23:05,  3.38it/s]
  4%|▍         | 14101/371472 [1:06:58<28:56:42,  3.43it/s]
  4%|▍         | 14102/371472 [1:06:58<28:05:35,  3.53it/s]
  4%|▍         | 14103/371472 [1:06:58<28:19:24,  3.50it/s]
  4%|▍         | 14104/371472 [1:06:58<28:09:54,  3.52it/s]
  4%|▍         | 14105/371472 [1:06:59<29:35:22,  3.35it/s]
  4%|▍         | 14106/371472 [1:06:59<27:59:50,  3.55it/s]
  4%|▍         | 14107/371472 [1:06:59<28:08:37,  3.53it/s]
  4%|▍         | 14108/371472 [1:07:00<28:29:08,  3.48it/s]
  4%|▍         | 14109/371472 [1:07:00<27:19:12,  3.63it/s]
  4%|▍         | 14110/371472 [1:07:00<27:47:57,  3.57it/s]
  4%|▍         | 14111/371472 [1:07:00<27:55:20,  3.56it/s]
  4%|▍         | 14112/371472 [1:07:01<27:13:49,  3.65it/s]
  4%|▍         | 14113/371472 [1:07:01<26:36:29,  3.73it/s]
  4%|▍         | 14114/371472 [1:07:01<26:26:41,  3.75it/s]
  4%|▍         | 14115/371472 [1:07:01<28:20:26,  3.50it/s]
  4%|▍         | 14116/371472 [1:07:02<27:27:23,  3.62it/s]
  4%|▍         | 14117/371472 [1:07:02<27:06:28,  3.66it/s]
  4%|▍         | 14118/371472 [1:07:02<26:52:33,  3.69it/s]
  4%|▍         | 14119/371472 [1:07:03<30:00:25,  3.31it/s]
  4%|▍         | 14120/371472 [1:07:03<28:40:40,  3.46it/s]
                                                           
{'loss': 4.7975, 'learning_rate': 9.662565450666896e-07, 'epoch': 0.61}

  4%|▍         | 14120/371472 [1:07:03<28:40:40,  3.46it/s]
  4%|▍         | 14121/371472 [1:07:03<28:38:59,  3.46it/s]
  4%|▍         | 14122/371472 [1:07:04<33:16:56,  2.98it/s]
  4%|▍         | 14123/371472 [1:07:04<31:01:10,  3.20it/s]
  4%|▍         | 14124/371472 [1:07:04<30:42:54,  3.23it/s]
  4%|▍         | 14125/371472 [1:07:04<29:56:54,  3.31it/s]
  4%|▍         | 14126/371472 [1:07:05<29:37:11,  3.35it/s]
  4%|▍         | 14127/371472 [1:07:05<28:25:39,  3.49it/s]
  4%|▍         | 14128/371472 [1:07:05<28:38:57,  3.46it/s]
  4%|▍         | 14129/371472 [1:07:06<27:56:25,  3.55it/s]
  4%|▍         | 14130/371472 [1:07:06<27:09:54,  3.65it/s]
  4%|▍         | 14131/371472 [1:07:06<27:32:26,  3.60it/s]
  4%|▍         | 14132/371472 [1:07:06<26:40:37,  3.72it/s]
  4%|▍         | 14133/371472 [1:07:07<26:55:12,  3.69it/s]
  4%|▍         | 14134/371472 [1:07:07<28:37:43,  3.47it/s]
  4%|▍         | 14135/371472 [1:07:07<27:30:28,  3.61it/s]
  4%|▍         | 14136/371472 [1:07:08<27:25:12,  3.62it/s]
  4%|▍         | 14137/371472 [1:07:08<26:30:15,  3.75it/s]
  4%|▍         | 14138/371472 [1:07:08<26:42:32,  3.72it/s]
  4%|▍         | 14139/371472 [1:07:08<27:07:30,  3.66it/s]
  4%|▍         | 14140/371472 [1:07:09<27:40:35,  3.59it/s]
                                                           
{'loss': 4.7108, 'learning_rate': 9.662080630912107e-07, 'epoch': 0.61}

  4%|▍         | 14140/371472 [1:07:09<27:40:35,  3.59it/s]
  4%|▍         | 14141/371472 [1:07:09<27:13:55,  3.64it/s]
  4%|▍         | 14142/371472 [1:07:09<28:21:05,  3.50it/s]
  4%|▍         | 14143/371472 [1:07:09<27:55:32,  3.55it/s]
  4%|▍         | 14144/371472 [1:07:10<28:15:36,  3.51it/s]
  4%|▍         | 14145/371472 [1:07:10<28:34:00,  3.47it/s]
  4%|▍         | 14146/371472 [1:07:10<28:54:59,  3.43it/s]
  4%|▍         | 14147/371472 [1:07:11<28:12:56,  3.52it/s]
  4%|▍         | 14148/371472 [1:07:11<28:22:29,  3.50it/s]
  4%|▍         | 14149/371472 [1:07:11<27:29:49,  3.61it/s]
  4%|▍         | 14150/371472 [1:07:11<27:29:24,  3.61it/s]
  4%|▍         | 14151/371472 [1:07:12<26:33:32,  3.74it/s]
  4%|▍         | 14152/371472 [1:07:12<28:46:53,  3.45it/s]
  4%|▍         | 14153/371472 [1:07:12<28:49:22,  3.44it/s]
  4%|▍         | 14154/371472 [1:07:13<28:03:16,  3.54it/s]
  4%|▍         | 14155/371472 [1:07:13<27:53:10,  3.56it/s]
  4%|▍         | 14156/371472 [1:07:13<29:53:14,  3.32it/s]
  4%|▍         | 14157/371472 [1:07:13<28:53:09,  3.44it/s]
  4%|▍         | 14158/371472 [1:07:14<29:54:53,  3.32it/s]
  4%|▍         | 14159/371472 [1:07:14<28:40:31,  3.46it/s]
  4%|▍         | 14160/371472 [1:07:14<29:35:59,  3.35it/s]
                                                           
{'loss': 4.5902, 'learning_rate': 9.661595811157318e-07, 'epoch': 0.61}

  4%|▍         | 14160/371472 [1:07:14<29:35:59,  3.35it/s]
  4%|▍         | 14161/371472 [1:07:15<29:30:49,  3.36it/s]
  4%|▍         | 14162/371472 [1:07:15<30:13:44,  3.28it/s]
  4%|▍         | 14163/371472 [1:07:15<28:36:10,  3.47it/s]
  4%|▍         | 14164/371472 [1:07:16<28:06:32,  3.53it/s]
  4%|▍         | 14165/371472 [1:07:16<29:52:09,  3.32it/s]
  4%|▍         | 14166/371472 [1:07:16<28:15:44,  3.51it/s]
  4%|▍         | 14167/371472 [1:07:16<26:56:36,  3.68it/s]
  4%|▍         | 14168/371472 [1:07:17<26:08:38,  3.80it/s]
  4%|▍         | 14169/371472 [1:07:17<26:03:58,  3.81it/s]
  4%|▍         | 14170/371472 [1:07:17<25:51:40,  3.84it/s]
  4%|▍         | 14171/371472 [1:07:17<25:38:15,  3.87it/s]
  4%|▍         | 14172/371472 [1:07:18<29:30:50,  3.36it/s]
  4%|▍         | 14173/371472 [1:07:18<28:45:26,  3.45it/s]
  4%|▍         | 14174/371472 [1:07:18<28:14:12,  3.51it/s]
  4%|▍         | 14175/371472 [1:07:19<28:03:16,  3.54it/s]
  4%|▍         | 14176/371472 [1:07:19<28:12:20,  3.52it/s]
  4%|▍         | 14177/371472 [1:07:19<30:08:18,  3.29it/s]
  4%|▍         | 14178/371472 [1:07:20<30:39:22,  3.24it/s]
  4%|▍         | 14179/371472 [1:07:20<31:04:11,  3.19it/s]
  4%|▍         | 14180/371472 [1:07:20<29:27:06,  3.37it/s]
                                                           
{'loss': 4.4984, 'learning_rate': 9.66111099140253e-07, 'epoch': 0.61}

  4%|▍         | 14180/371472 [1:07:20<29:27:06,  3.37it/s]
  4%|▍         | 14181/371472 [1:07:20<28:36:40,  3.47it/s]
  4%|▍         | 14182/371472 [1:07:21<27:48:47,  3.57it/s]
  4%|▍         | 14183/371472 [1:07:21<29:58:50,  3.31it/s]
  4%|▍         | 14184/371472 [1:07:21<29:14:19,  3.39it/s]
  4%|▍         | 14185/371472 [1:07:22<27:25:26,  3.62it/s]
  4%|▍         | 14186/371472 [1:07:22<27:45:52,  3.57it/s]
  4%|▍         | 14187/371472 [1:07:22<28:43:37,  3.45it/s]
  4%|▍         | 14188/371472 [1:07:22<29:17:08,  3.39it/s]
  4%|▍         | 14189/371472 [1:07:23<28:42:48,  3.46it/s]
  4%|▍         | 14190/371472 [1:07:23<27:46:06,  3.57it/s]
  4%|▍         | 14191/371472 [1:07:23<28:12:29,  3.52it/s]
  4%|▍         | 14192/371472 [1:07:24<29:30:41,  3.36it/s]
  4%|▍         | 14193/371472 [1:07:24<29:09:56,  3.40it/s]
  4%|▍         | 14194/371472 [1:07:24<30:50:27,  3.22it/s]
  4%|▍         | 14195/371472 [1:07:25<30:43:19,  3.23it/s]
  4%|▍         | 14196/371472 [1:07:25<30:00:39,  3.31it/s]
  4%|▍         | 14197/371472 [1:07:25<29:17:21,  3.39it/s]
  4%|▍         | 14198/371472 [1:07:25<29:57:47,  3.31it/s]
  4%|▍         | 14199/371472 [1:07:26<29:13:36,  3.40it/s]
  4%|▍         | 14200/371472 [1:07:26<29:33:20,  3.36it/s]
                                                           
{'loss': 4.8832, 'learning_rate': 9.66062617164774e-07, 'epoch': 0.61}

  4%|▍         | 14200/371472 [1:07:26<29:33:20,  3.36it/s]
  4%|▍         | 14201/371472 [1:07:26<28:02:35,  3.54it/s]
  4%|▍         | 14202/371472 [1:07:27<28:13:50,  3.52it/s]
  4%|▍         | 14203/371472 [1:07:27<28:30:57,  3.48it/s]
  4%|▍         | 14204/371472 [1:07:27<27:28:45,  3.61it/s]
  4%|▍         | 14205/371472 [1:07:27<26:41:47,  3.72it/s]
  4%|▍         | 14206/371472 [1:07:28<26:18:50,  3.77it/s]
  4%|▍         | 14207/371472 [1:07:28<28:04:09,  3.54it/s]
  4%|▍         | 14208/371472 [1:07:28<28:04:07,  3.54it/s]
  4%|▍         | 14209/371472 [1:07:28<27:07:29,  3.66it/s]
  4%|▍         | 14210/371472 [1:07:29<26:41:08,  3.72it/s]
  4%|▍         | 14211/371472 [1:07:29<27:07:47,  3.66it/s]
  4%|▍         | 14212/371472 [1:07:29<26:50:37,  3.70it/s]
  4%|▍         | 14213/371472 [1:07:29<26:17:34,  3.77it/s]
  4%|▍         | 14214/371472 [1:07:30<27:31:58,  3.60it/s]
  4%|▍         | 14215/371472 [1:07:30<27:11:52,  3.65it/s]
  4%|▍         | 14216/371472 [1:07:30<27:58:28,  3.55it/s]
  4%|▍         | 14217/371472 [1:07:31<28:04:41,  3.53it/s]
  4%|▍         | 14218/371472 [1:07:31<29:44:25,  3.34it/s]
  4%|▍         | 14219/371472 [1:07:31<28:19:36,  3.50it/s]
  4%|▍         | 14220/371472 [1:07:32<28:21:35,  3.50it/s]
                                                           
{'loss': 4.7217, 'learning_rate': 9.660141351892952e-07, 'epoch': 0.61}

  4%|▍         | 14220/371472 [1:07:32<28:21:35,  3.50it/s]
  4%|▍         | 14221/371472 [1:07:32<28:05:15,  3.53it/s]
  4%|▍         | 14222/371472 [1:07:32<27:15:14,  3.64it/s]
  4%|▍         | 14223/371472 [1:07:32<28:54:52,  3.43it/s]
  4%|▍         | 14224/371472 [1:07:33<28:34:50,  3.47it/s]
  4%|▍         | 14225/371472 [1:07:33<28:29:44,  3.48it/s]
  4%|▍         | 14226/371472 [1:07:33<28:06:06,  3.53it/s]
  4%|▍         | 14227/371472 [1:07:33<27:30:30,  3.61it/s]
  4%|▍         | 14228/371472 [1:07:34<28:11:42,  3.52it/s]
  4%|▍         | 14229/371472 [1:07:34<27:26:15,  3.62it/s]
  4%|▍         | 14230/371472 [1:07:34<27:08:14,  3.66it/s]
  4%|▍         | 14231/371472 [1:07:35<26:56:32,  3.68it/s]
  4%|▍         | 14232/371472 [1:07:35<27:37:35,  3.59it/s]
  4%|▍         | 14233/371472 [1:07:35<29:16:17,  3.39it/s]
  4%|▍         | 14234/371472 [1:07:35<28:13:20,  3.52it/s]
  4%|▍         | 14235/371472 [1:07:36<28:52:41,  3.44it/s]
  4%|▍         | 14236/371472 [1:07:36<28:43:59,  3.45it/s]
  4%|▍         | 14237/371472 [1:07:36<27:11:41,  3.65it/s]
  4%|▍         | 14238/371472 [1:07:37<29:31:57,  3.36it/s]
  4%|▍         | 14239/371472 [1:07:37<29:57:10,  3.31it/s]
  4%|▍         | 14240/371472 [1:07:37<29:58:58,  3.31it/s]
                                                           
{'loss': 4.6702, 'learning_rate': 9.659656532138163e-07, 'epoch': 0.61}

  4%|▍         | 14240/371472 [1:07:37<29:58:58,  3.31it/s]
  4%|▍         | 14241/371472 [1:07:38<29:24:04,  3.38it/s]
  4%|▍         | 14242/371472 [1:07:38<30:17:22,  3.28it/s]
  4%|▍         | 14243/371472 [1:07:38<30:34:45,  3.25it/s]
  4%|▍         | 14244/371472 [1:07:38<28:56:20,  3.43it/s]
  4%|▍         | 14245/371472 [1:07:39<27:33:07,  3.60it/s]
  4%|▍         | 14246/371472 [1:07:39<29:38:09,  3.35it/s]
  4%|▍         | 14247/371472 [1:07:39<31:33:29,  3.14it/s]
  4%|▍         | 14248/371472 [1:07:40<30:05:01,  3.30it/s]
  4%|▍         | 14249/371472 [1:07:40<29:00:04,  3.42it/s]
  4%|▍         | 14250/371472 [1:07:40<28:20:08,  3.50it/s]
  4%|▍         | 14251/371472 [1:07:40<28:30:49,  3.48it/s]
  4%|▍         | 14252/371472 [1:07:41<27:15:54,  3.64it/s]
  4%|▍         | 14253/371472 [1:07:41<27:16:16,  3.64it/s]
  4%|▍         | 14254/371472 [1:07:41<27:29:55,  3.61it/s]
  4%|▍         | 14255/371472 [1:07:42<33:15:31,  2.98it/s]
  4%|▍         | 14256/371472 [1:07:42<31:26:07,  3.16it/s]
  4%|▍         | 14257/371472 [1:07:42<31:47:25,  3.12it/s]
  4%|▍         | 14258/371472 [1:07:43<31:12:48,  3.18it/s]
  4%|▍         | 14259/371472 [1:07:43<29:35:02,  3.35it/s]
  4%|▍         | 14260/371472 [1:07:43<29:18:26,  3.39it/s]
                                                           
{'loss': 4.6737, 'learning_rate': 9.659171712383374e-07, 'epoch': 0.61}

  4%|▍         | 14260/371472 [1:07:43<29:18:26,  3.39it/s]
  4%|▍         | 14261/371472 [1:07:44<29:05:34,  3.41it/s]
  4%|▍         | 14262/371472 [1:07:44<30:08:42,  3.29it/s]
  4%|▍         | 14263/371472 [1:07:44<30:09:05,  3.29it/s]
  4%|▍         | 14264/371472 [1:07:44<28:47:07,  3.45it/s]
  4%|▍         | 14265/371472 [1:07:45<28:15:43,  3.51it/s]
  4%|▍         | 14266/371472 [1:07:45<27:20:15,  3.63it/s]
  4%|▍         | 14267/371472 [1:07:45<27:13:52,  3.64it/s]
  4%|▍         | 14268/371472 [1:07:45<26:32:41,  3.74it/s]
  4%|▍         | 14269/371472 [1:07:46<27:01:46,  3.67it/s]
  4%|▍         | 14270/371472 [1:07:46<27:50:10,  3.56it/s]
  4%|▍         | 14271/371472 [1:07:46<28:24:33,  3.49it/s]
  4%|▍         | 14272/371472 [1:07:47<29:18:19,  3.39it/s]
  4%|▍         | 14273/371472 [1:07:47<28:48:54,  3.44it/s]
  4%|▍         | 14274/371472 [1:07:47<27:59:10,  3.55it/s]
  4%|▍         | 14275/371472 [1:07:47<27:30:38,  3.61it/s]
  4%|▍         | 14276/371472 [1:07:48<27:04:26,  3.66it/s]
  4%|▍         | 14277/371472 [1:07:48<27:58:50,  3.55it/s]
  4%|▍         | 14278/371472 [1:07:48<31:12:06,  3.18it/s]
  4%|▍         | 14279/371472 [1:07:49<30:42:40,  3.23it/s]
  4%|▍         | 14280/371472 [1:07:49<31:11:38,  3.18it/s]
                                                           
{'loss': 4.5198, 'learning_rate': 9.658686892628584e-07, 'epoch': 0.62}

  4%|▍         | 14280/371472 [1:07:49<31:11:38,  3.18it/s]
  4%|▍         | 14281/371472 [1:07:49<30:05:02,  3.30it/s]
  4%|▍         | 14282/371472 [1:07:50<28:32:59,  3.48it/s]
  4%|▍         | 14283/371472 [1:07:50<28:45:33,  3.45it/s]
  4%|▍         | 14284/371472 [1:07:50<28:21:11,  3.50it/s]
  4%|▍         | 14285/371472 [1:07:50<30:06:06,  3.30it/s]
  4%|▍         | 14286/371472 [1:07:51<30:04:47,  3.30it/s]
  4%|▍         | 14287/371472 [1:07:51<29:21:42,  3.38it/s]
  4%|▍         | 14288/371472 [1:07:51<28:54:16,  3.43it/s]
  4%|▍         | 14289/371472 [1:07:52<29:05:31,  3.41it/s]
  4%|▍         | 14290/371472 [1:07:52<28:27:29,  3.49it/s]
  4%|▍         | 14291/371472 [1:07:52<27:09:18,  3.65it/s]
  4%|▍         | 14292/371472 [1:07:52<26:41:51,  3.72it/s]
  4%|▍         | 14293/371472 [1:07:53<27:04:55,  3.66it/s]
  4%|▍         | 14294/371472 [1:07:53<26:21:31,  3.76it/s]
  4%|▍         | 14295/371472 [1:07:53<27:51:33,  3.56it/s]
  4%|▍         | 14296/371472 [1:07:54<27:29:34,  3.61it/s]
  4%|▍         | 14297/371472 [1:07:54<27:43:42,  3.58it/s]
  4%|▍         | 14298/371472 [1:07:54<27:21:06,  3.63it/s]
  4%|▍         | 14299/371472 [1:07:54<26:42:12,  3.72it/s]
  4%|▍         | 14300/371472 [1:07:55<26:38:33,  3.72it/s]
                                                           
{'loss': 4.619, 'learning_rate': 9.658202072873795e-07, 'epoch': 0.62}

  4%|▍         | 14300/371472 [1:07:55<26:38:33,  3.72it/s]
  4%|▍         | 14301/371472 [1:07:55<26:34:09,  3.73it/s]
  4%|▍         | 14302/371472 [1:07:55<28:51:53,  3.44it/s]
  4%|▍         | 14303/371472 [1:07:56<29:19:47,  3.38it/s]
  4%|▍         | 14304/371472 [1:07:56<30:35:22,  3.24it/s]
  4%|▍         | 14305/371472 [1:07:56<32:00:39,  3.10it/s]
  4%|▍         | 14306/371472 [1:07:57<32:01:57,  3.10it/s]
  4%|▍         | 14307/371472 [1:07:57<30:24:28,  3.26it/s]
  4%|▍         | 14308/371472 [1:07:57<29:51:18,  3.32it/s]
  4%|▍         | 14309/371472 [1:07:57<28:49:25,  3.44it/s]
  4%|▍         | 14310/371472 [1:07:58<28:34:10,  3.47it/s]
  4%|▍         | 14311/371472 [1:07:58<28:46:47,  3.45it/s]
  4%|▍         | 14312/371472 [1:07:58<28:01:09,  3.54it/s]
  4%|▍         | 14313/371472 [1:07:58<27:36:36,  3.59it/s]
  4%|▍         | 14314/371472 [1:07:59<27:28:34,  3.61it/s]
  4%|▍         | 14315/371472 [1:07:59<26:30:52,  3.74it/s]
  4%|▍         | 14316/371472 [1:07:59<26:52:06,  3.69it/s]
  4%|▍         | 14317/371472 [1:08:00<27:58:56,  3.55it/s]
  4%|▍         | 14318/371472 [1:08:00<28:07:16,  3.53it/s]
  4%|▍         | 14319/371472 [1:08:00<28:17:22,  3.51it/s]
  4%|▍         | 14320/371472 [1:08:00<28:18:20,  3.50it/s]
                                                           
{'loss': 4.4772, 'learning_rate': 9.657717253119008e-07, 'epoch': 0.62}

  4%|▍         | 14320/371472 [1:08:00<28:18:20,  3.50it/s]
  4%|▍         | 14321/371472 [1:08:01<27:47:56,  3.57it/s]
  4%|▍         | 14322/371472 [1:08:01<28:17:30,  3.51it/s]
  4%|▍         | 14323/371472 [1:08:01<29:07:34,  3.41it/s]
  4%|▍         | 14324/371472 [1:08:02<29:22:47,  3.38it/s]
  4%|▍         | 14325/371472 [1:08:02<28:49:09,  3.44it/s]
  4%|▍         | 14326/371472 [1:08:02<28:29:38,  3.48it/s]
  4%|▍         | 14327/371472 [1:08:02<27:49:50,  3.56it/s]
  4%|▍         | 14328/371472 [1:08:03<27:25:23,  3.62it/s]
  4%|▍         | 14329/371472 [1:08:03<28:05:46,  3.53it/s]
  4%|▍         | 14330/371472 [1:08:03<27:51:37,  3.56it/s]
  4%|▍         | 14331/371472 [1:08:04<27:41:03,  3.58it/s]
  4%|▍         | 14332/371472 [1:08:04<28:16:05,  3.51it/s]
  4%|▍         | 14333/371472 [1:08:04<29:42:51,  3.34it/s]
  4%|▍         | 14334/371472 [1:08:04<28:07:19,  3.53it/s]
  4%|▍         | 14335/371472 [1:08:05<27:49:02,  3.57it/s]
  4%|▍         | 14336/371472 [1:08:05<30:32:19,  3.25it/s]
  4%|▍         | 14337/371472 [1:08:05<29:10:27,  3.40it/s]
  4%|▍         | 14338/371472 [1:08:06<28:16:18,  3.51it/s]
  4%|▍         | 14339/371472 [1:08:06<27:55:54,  3.55it/s]
  4%|▍         | 14340/371472 [1:08:06<28:05:28,  3.53it/s]
                                                           
{'loss': 4.6145, 'learning_rate': 9.657232433364216e-07, 'epoch': 0.62}

  4%|▍         | 14340/371472 [1:08:06<28:05:28,  3.53it/s]
  4%|▍         | 14341/371472 [1:08:06<27:41:59,  3.58it/s]
  4%|▍         | 14342/371472 [1:08:07<28:56:07,  3.43it/s]
  4%|▍         | 14343/371472 [1:08:07<27:37:48,  3.59it/s]
  4%|▍         | 14344/371472 [1:08:07<27:37:32,  3.59it/s]
  4%|▍         | 14345/371472 [1:08:08<27:18:55,  3.63it/s]
  4%|▍         | 14346/371472 [1:08:08<27:40:44,  3.58it/s]
  4%|▍         | 14347/371472 [1:08:08<27:09:35,  3.65it/s]
  4%|▍         | 14348/371472 [1:08:08<27:43:00,  3.58it/s]
  4%|▍         | 14349/371472 [1:08:09<27:04:03,  3.66it/s]
  4%|▍         | 14350/371472 [1:08:09<27:13:49,  3.64it/s]
  4%|▍         | 14351/371472 [1:08:09<26:49:39,  3.70it/s]
  4%|▍         | 14352/371472 [1:08:09<26:16:13,  3.78it/s]
  4%|▍         | 14353/371472 [1:08:10<25:43:03,  3.86it/s]
  4%|▍         | 14354/371472 [1:08:10<26:12:45,  3.78it/s]
  4%|▍         | 14355/371472 [1:08:10<26:01:04,  3.81it/s]
  4%|▍         | 14356/371472 [1:08:10<25:30:02,  3.89it/s]
  4%|▍         | 14357/371472 [1:08:11<24:58:40,  3.97it/s]
  4%|▍         | 14358/371472 [1:08:11<25:34:27,  3.88it/s]
  4%|▍         | 14359/371472 [1:08:11<28:14:49,  3.51it/s]
  4%|▍         | 14360/371472 [1:08:12<27:57:59,  3.55it/s]
                                                           
{'loss': 4.9091, 'learning_rate': 9.65674761360943e-07, 'epoch': 0.62}

  4%|▍         | 14360/371472 [1:08:12<27:57:59,  3.55it/s]
  4%|▍         | 14361/371472 [1:08:12<27:00:23,  3.67it/s]
  4%|▍         | 14362/371472 [1:08:12<28:18:38,  3.50it/s]
  4%|▍         | 14363/371472 [1:08:12<28:21:27,  3.50it/s]
  4%|▍         | 14364/371472 [1:08:13<29:29:23,  3.36it/s]
  4%|▍         | 14365/371472 [1:08:13<29:34:04,  3.35it/s]
  4%|▍         | 14366/371472 [1:08:13<27:47:20,  3.57it/s]
  4%|▍         | 14367/371472 [1:08:14<27:04:57,  3.66it/s]
  4%|▍         | 14368/371472 [1:08:14<27:54:36,  3.55it/s]
  4%|▍         | 14369/371472 [1:08:14<29:23:57,  3.37it/s]
  4%|▍         | 14370/371472 [1:08:14<27:55:26,  3.55it/s]
  4%|▍         | 14371/371472 [1:08:15<28:16:12,  3.51it/s]
  4%|▍         | 14372/371472 [1:08:15<29:53:02,  3.32it/s]
  4%|▍         | 14373/371472 [1:08:15<28:27:19,  3.49it/s]
  4%|▍         | 14374/371472 [1:08:16<28:49:02,  3.44it/s]
  4%|▍         | 14375/371472 [1:08:16<28:16:40,  3.51it/s]
  4%|▍         | 14376/371472 [1:08:16<27:31:43,  3.60it/s]
  4%|▍         | 14377/371472 [1:08:16<27:38:55,  3.59it/s]
  4%|▍         | 14378/371472 [1:08:17<27:44:34,  3.58it/s]
  4%|▍         | 14379/371472 [1:08:17<29:09:27,  3.40it/s]
  4%|▍         | 14380/371472 [1:08:17<28:51:27,  3.44it/s]
                                                           
{'loss': 4.5172, 'learning_rate': 9.65626279385464e-07, 'epoch': 0.62}

  4%|▍         | 14380/371472 [1:08:17<28:51:27,  3.44it/s]
  4%|▍         | 14381/371472 [1:08:18<28:05:45,  3.53it/s]
  4%|▍         | 14382/371472 [1:08:18<27:42:55,  3.58it/s]
  4%|▍         | 14383/371472 [1:08:18<27:47:08,  3.57it/s]
  4%|▍         | 14384/371472 [1:08:18<28:39:49,  3.46it/s]
  4%|▍         | 14385/371472 [1:08:19<28:03:44,  3.53it/s]
  4%|▍         | 14386/371472 [1:08:19<28:11:07,  3.52it/s]
  4%|▍         | 14387/371472 [1:08:19<28:24:18,  3.49it/s]
  4%|▍         | 14388/371472 [1:08:20<31:21:58,  3.16it/s]
  4%|▍         | 14389/371472 [1:08:20<30:30:19,  3.25it/s]
  4%|▍         | 14390/371472 [1:08:20<30:42:40,  3.23it/s]
  4%|▍         | 14391/371472 [1:08:21<31:28:33,  3.15it/s]
  4%|▍         | 14392/371472 [1:08:21<30:56:59,  3.20it/s]
  4%|▍         | 14393/371472 [1:08:21<31:25:15,  3.16it/s]
  4%|▍         | 14394/371472 [1:08:22<30:19:09,  3.27it/s]
  4%|▍         | 14395/371472 [1:08:22<30:14:39,  3.28it/s]
  4%|▍         | 14396/371472 [1:08:22<28:16:57,  3.51it/s]
  4%|▍         | 14397/371472 [1:08:22<28:04:34,  3.53it/s]
  4%|▍         | 14398/371472 [1:08:23<27:37:02,  3.59it/s]
  4%|▍         | 14399/371472 [1:08:23<26:20:25,  3.77it/s]
  4%|▍         | 14400/371472 [1:08:23<26:45:26,  3.71it/s]
                                                           
{'loss': 4.6175, 'learning_rate': 9.65577797409985e-07, 'epoch': 0.62}

  4%|▍         | 14400/371472 [1:08:23<26:45:26,  3.71it/s]
  4%|▍         | 14401/371472 [1:08:23<25:51:38,  3.84it/s]
  4%|▍         | 14402/371472 [1:08:24<25:24:17,  3.90it/s]
  4%|▍         | 14403/371472 [1:08:24<24:55:58,  3.98it/s]
  4%|▍         | 14404/371472 [1:08:24<25:00:23,  3.97it/s]
  4%|▍         | 14405/371472 [1:08:24<25:07:04,  3.95it/s]
  4%|▍         | 14406/371472 [1:08:25<27:09:31,  3.65it/s]
  4%|▍         | 14407/371472 [1:08:25<28:16:04,  3.51it/s]
  4%|▍         | 14408/371472 [1:08:25<28:10:48,  3.52it/s]
  4%|▍         | 14409/371472 [1:08:26<27:35:28,  3.59it/s]
  4%|▍         | 14410/371472 [1:08:26<28:16:15,  3.51it/s]
  4%|▍         | 14411/371472 [1:08:26<27:44:15,  3.58it/s]
  4%|▍         | 14412/371472 [1:08:26<27:38:08,  3.59it/s]
  4%|▍         | 14413/371472 [1:08:27<27:36:44,  3.59it/s]
  4%|▍         | 14414/371472 [1:08:27<29:25:09,  3.37it/s]
  4%|▍         | 14415/371472 [1:08:27<30:00:27,  3.31it/s]
  4%|▍         | 14416/371472 [1:08:28<31:17:10,  3.17it/s]
  4%|▍         | 14417/371472 [1:08:28<31:40:49,  3.13it/s]
  4%|▍         | 14418/371472 [1:08:28<31:51:36,  3.11it/s]
  4%|▍         | 14419/371472 [1:08:29<31:02:56,  3.19it/s]
  4%|▍         | 14420/371472 [1:08:29<30:06:13,  3.29it/s]
                                                           
{'loss': 4.7035, 'learning_rate': 9.655293154345061e-07, 'epoch': 0.62}

  4%|▍         | 14420/371472 [1:08:29<30:06:13,  3.29it/s]
  4%|▍         | 14421/371472 [1:08:29<29:23:17,  3.37it/s]
  4%|▍         | 14422/371472 [1:08:29<29:47:01,  3.33it/s]
  4%|▍         | 14423/371472 [1:08:30<29:02:26,  3.42it/s]
  4%|▍         | 14424/371472 [1:08:30<27:24:59,  3.62it/s]
  4%|▍         | 14425/371472 [1:08:30<27:05:20,  3.66it/s]
  4%|▍         | 14426/371472 [1:08:31<26:34:25,  3.73it/s]
  4%|▍         | 14427/371472 [1:08:31<26:08:01,  3.80it/s]
  4%|▍         | 14428/371472 [1:08:31<27:54:36,  3.55it/s]
  4%|▍         | 14429/371472 [1:08:31<28:49:14,  3.44it/s]
  4%|▍         | 14430/371472 [1:08:32<27:33:01,  3.60it/s]
  4%|▍         | 14431/371472 [1:08:32<26:57:36,  3.68it/s]
  4%|▍         | 14432/371472 [1:08:32<28:47:37,  3.44it/s]
  4%|▍         | 14433/371472 [1:08:33<27:37:44,  3.59it/s]
  4%|▍         | 14434/371472 [1:08:33<27:05:30,  3.66it/s]
  4%|▍         | 14435/371472 [1:08:33<27:32:15,  3.60it/s]
  4%|▍         | 14436/371472 [1:08:33<27:28:39,  3.61it/s]
  4%|▍         | 14437/371472 [1:08:34<27:26:53,  3.61it/s]
  4%|▍         | 14438/371472 [1:08:34<27:53:09,  3.56it/s]
  4%|▍         | 14439/371472 [1:08:34<29:09:46,  3.40it/s]
  4%|▍         | 14440/371472 [1:08:34<28:11:34,  3.52it/s]
                                                           
{'loss': 4.8991, 'learning_rate': 9.654808334590272e-07, 'epoch': 0.62}

  4%|▍         | 14440/371472 [1:08:34<28:11:34,  3.52it/s]
  4%|▍         | 14441/371472 [1:08:35<27:58:25,  3.55it/s]
  4%|▍         | 14442/371472 [1:08:35<29:32:15,  3.36it/s]
  4%|▍         | 14443/371472 [1:08:35<29:52:03,  3.32it/s]
  4%|▍         | 14444/371472 [1:08:36<28:38:36,  3.46it/s]
  4%|▍         | 14445/371472 [1:08:36<28:15:45,  3.51it/s]
  4%|▍         | 14446/371472 [1:08:36<27:07:03,  3.66it/s]
  4%|▍         | 14447/371472 [1:08:37<28:20:29,  3.50it/s]
  4%|▍         | 14448/371472 [1:08:37<27:15:23,  3.64it/s]
  4%|▍         | 14449/371472 [1:08:37<26:44:52,  3.71it/s]
  4%|▍         | 14450/371472 [1:08:37<27:19:42,  3.63it/s]
  4%|▍         | 14451/371472 [1:08:38<27:57:53,  3.55it/s]
  4%|▍         | 14452/371472 [1:08:38<26:55:36,  3.68it/s]
  4%|▍         | 14453/371472 [1:08:38<28:41:31,  3.46it/s]
  4%|▍         | 14454/371472 [1:08:38<28:59:38,  3.42it/s]
  4%|▍         | 14455/371472 [1:08:39<29:45:05,  3.33it/s]
  4%|▍         | 14456/371472 [1:08:39<29:04:20,  3.41it/s]
  4%|▍         | 14457/371472 [1:08:39<28:42:57,  3.45it/s]
  4%|▍         | 14458/371472 [1:08:40<29:26:54,  3.37it/s]
  4%|▍         | 14459/371472 [1:08:40<28:07:53,  3.53it/s]
  4%|▍         | 14460/371472 [1:08:40<27:02:46,  3.67it/s]
                                                           
{'loss': 4.5864, 'learning_rate': 9.654323514835485e-07, 'epoch': 0.62}

  4%|▍         | 14460/371472 [1:08:40<27:02:46,  3.67it/s]
  4%|▍         | 14461/371472 [1:08:40<26:44:27,  3.71it/s]
  4%|▍         | 14462/371472 [1:08:41<26:50:06,  3.70it/s]
  4%|▍         | 14463/371472 [1:08:41<26:10:16,  3.79it/s]
  4%|▍         | 14464/371472 [1:08:41<27:18:38,  3.63it/s]
  4%|▍         | 14465/371472 [1:08:42<27:13:01,  3.64it/s]
  4%|▍         | 14466/371472 [1:08:42<26:44:28,  3.71it/s]
  4%|▍         | 14467/371472 [1:08:42<26:53:34,  3.69it/s]
  4%|▍         | 14468/371472 [1:08:42<26:52:07,  3.69it/s]
  4%|▍         | 14469/371472 [1:08:43<27:35:08,  3.59it/s]
  4%|▍         | 14470/371472 [1:08:43<27:43:35,  3.58it/s]
  4%|▍         | 14471/371472 [1:08:43<27:28:22,  3.61it/s]
  4%|▍         | 14472/371472 [1:08:43<26:56:08,  3.68it/s]
  4%|▍         | 14473/371472 [1:08:44<27:30:08,  3.61it/s]
  4%|▍         | 14474/371472 [1:08:44<27:05:48,  3.66it/s]
  4%|▍         | 14475/371472 [1:08:44<26:54:10,  3.69it/s]
  4%|▍         | 14476/371472 [1:08:45<27:09:24,  3.65it/s]
  4%|▍         | 14477/371472 [1:08:45<27:37:02,  3.59it/s]
  4%|▍         | 14478/371472 [1:08:45<26:54:29,  3.69it/s]
  4%|▍         | 14479/371472 [1:08:45<27:26:52,  3.61it/s]
  4%|▍         | 14480/371472 [1:08:46<28:09:46,  3.52it/s]
                                                           
{'loss': 4.9811, 'learning_rate': 9.653838695080696e-07, 'epoch': 0.62}

  4%|▍         | 14480/371472 [1:08:46<28:09:46,  3.52it/s]
  4%|▍         | 14481/371472 [1:08:46<29:25:57,  3.37it/s]
  4%|▍         | 14482/371472 [1:08:46<28:09:09,  3.52it/s]
  4%|▍         | 14483/371472 [1:08:47<28:13:39,  3.51it/s]
  4%|▍         | 14484/371472 [1:08:47<27:52:35,  3.56it/s]
  4%|▍         | 14485/371472 [1:08:47<28:01:04,  3.54it/s]
  4%|▍         | 14486/371472 [1:08:47<28:00:47,  3.54it/s]
  4%|▍         | 14487/371472 [1:08:48<29:54:01,  3.32it/s]
  4%|▍         | 14488/371472 [1:08:48<28:21:35,  3.50it/s]
  4%|▍         | 14489/371472 [1:08:48<28:12:30,  3.52it/s]
  4%|▍         | 14490/371472 [1:08:49<30:47:15,  3.22it/s]
  4%|▍         | 14491/371472 [1:08:49<29:31:07,  3.36it/s]
  4%|▍         | 14492/371472 [1:08:49<30:07:59,  3.29it/s]
  4%|▍         | 14493/371472 [1:08:49<29:22:57,  3.37it/s]
  4%|▍         | 14494/371472 [1:08:50<28:02:43,  3.54it/s]
  4%|▍         | 14495/371472 [1:08:50<27:03:31,  3.66it/s]
  4%|▍         | 14496/371472 [1:08:50<27:43:06,  3.58it/s]
  4%|▍         | 14497/371472 [1:08:51<27:07:48,  3.65it/s]
  4%|▍         | 14498/371472 [1:08:51<27:09:00,  3.65it/s]
  4%|▍         | 14499/371472 [1:08:51<26:54:49,  3.68it/s]
  4%|▍         | 14500/371472 [1:08:51<28:24:03,  3.49it/s]
                                                           
{'loss': 4.5354, 'learning_rate': 9.653353875325906e-07, 'epoch': 0.62}

  4%|▍         | 14500/371472 [1:08:51<28:24:03,  3.49it/s]
  4%|▍         | 14501/371472 [1:08:52<28:47:26,  3.44it/s]
  4%|▍         | 14502/371472 [1:08:52<28:00:14,  3.54it/s]
  4%|▍         | 14503/371472 [1:08:52<27:35:13,  3.59it/s]
  4%|▍         | 14504/371472 [1:08:53<30:08:49,  3.29it/s]
  4%|▍         | 14505/371472 [1:08:53<30:05:45,  3.29it/s]
  4%|▍         | 14506/371472 [1:08:53<29:06:18,  3.41it/s]
  4%|▍         | 14507/371472 [1:08:53<28:25:35,  3.49it/s]
  4%|▍         | 14508/371472 [1:08:54<28:04:11,  3.53it/s]
  4%|▍         | 14509/371472 [1:08:54<27:12:22,  3.64it/s]
  4%|▍         | 14510/371472 [1:08:54<27:27:24,  3.61it/s]
  4%|▍         | 14511/371472 [1:08:55<29:01:07,  3.42it/s]
  4%|▍         | 14512/371472 [1:08:55<28:33:03,  3.47it/s]
  4%|▍         | 14513/371472 [1:08:55<30:33:33,  3.24it/s]
  4%|▍         | 14514/371472 [1:08:55<29:32:45,  3.36it/s]
  4%|▍         | 14515/371472 [1:08:56<27:55:58,  3.55it/s]
  4%|▍         | 14516/371472 [1:08:56<26:53:49,  3.69it/s]
  4%|▍         | 14517/371472 [1:08:56<28:08:47,  3.52it/s]
  4%|▍         | 14518/371472 [1:08:57<28:22:14,  3.49it/s]
  4%|▍         | 14519/371472 [1:08:57<26:59:00,  3.67it/s]
  4%|▍         | 14520/371472 [1:08:57<27:11:49,  3.65it/s]
                                                           
{'loss': 4.8074, 'learning_rate': 9.652869055571117e-07, 'epoch': 0.63}

  4%|▍         | 14520/371472 [1:08:57<27:11:49,  3.65it/s]
  4%|▍         | 14521/371472 [1:08:57<26:38:39,  3.72it/s]
  4%|▍         | 14522/371472 [1:08:58<26:46:15,  3.70it/s]
  4%|▍         | 14523/371472 [1:08:58<26:30:58,  3.74it/s]
  4%|▍         | 14524/371472 [1:08:58<27:49:40,  3.56it/s]
  4%|▍         | 14525/371472 [1:08:59<28:44:06,  3.45it/s]
  4%|▍         | 14526/371472 [1:08:59<29:54:08,  3.32it/s]
  4%|▍         | 14527/371472 [1:08:59<31:35:46,  3.14it/s]
  4%|▍         | 14528/371472 [1:09:00<31:04:16,  3.19it/s]
  4%|▍         | 14529/371472 [1:09:00<30:50:45,  3.21it/s]
  4%|▍         | 14530/371472 [1:09:00<30:48:47,  3.22it/s]
  4%|▍         | 14531/371472 [1:09:00<30:32:37,  3.25it/s]
  4%|▍         | 14532/371472 [1:09:01<31:48:44,  3.12it/s]
  4%|▍         | 14533/371472 [1:09:01<33:21:41,  2.97it/s]
  4%|▍         | 14534/371472 [1:09:01<31:16:32,  3.17it/s]
  4%|▍         | 14535/371472 [1:09:02<32:37:13,  3.04it/s]
  4%|▍         | 14536/371472 [1:09:02<30:49:51,  3.22it/s]
  4%|▍         | 14537/371472 [1:09:02<30:31:17,  3.25it/s]
  4%|▍         | 14538/371472 [1:09:03<28:49:18,  3.44it/s]
  4%|▍         | 14539/371472 [1:09:03<27:59:49,  3.54it/s]
  4%|▍         | 14540/371472 [1:09:03<28:28:48,  3.48it/s]
                                                           
{'loss': 4.7193, 'learning_rate': 9.652384235816328e-07, 'epoch': 0.63}

  4%|▍         | 14540/371472 [1:09:03<28:28:48,  3.48it/s]
  4%|▍         | 14541/371472 [1:09:03<28:18:35,  3.50it/s]
  4%|▍         | 14542/371472 [1:09:04<27:02:09,  3.67it/s]
  4%|▍         | 14543/371472 [1:09:04<27:17:30,  3.63it/s]
  4%|▍         | 14544/371472 [1:09:04<26:27:09,  3.75it/s]
  4%|▍         | 14545/371472 [1:09:04<26:54:18,  3.69it/s]
  4%|▍         | 14546/371472 [1:09:05<31:23:58,  3.16it/s]
  4%|▍         | 14547/371472 [1:09:05<29:40:37,  3.34it/s]
  4%|▍         | 14548/371472 [1:09:06<32:03:59,  3.09it/s]
  4%|▍         | 14549/371472 [1:09:06<30:06:42,  3.29it/s]
  4%|▍         | 14550/371472 [1:09:06<30:10:09,  3.29it/s]
  4%|▍         | 14551/371472 [1:09:06<29:38:25,  3.34it/s]
  4%|▍         | 14552/371472 [1:09:07<28:43:04,  3.45it/s]
  4%|▍         | 14553/371472 [1:09:07<28:05:31,  3.53it/s]
  4%|▍         | 14554/371472 [1:09:07<29:18:58,  3.38it/s]
  4%|▍         | 14555/371472 [1:09:08<28:01:32,  3.54it/s]
  4%|▍         | 14556/371472 [1:09:08<28:27:23,  3.48it/s]
  4%|▍         | 14557/371472 [1:09:08<29:07:54,  3.40it/s]
  4%|▍         | 14558/371472 [1:09:08<29:52:38,  3.32it/s]
  4%|▍         | 14559/371472 [1:09:09<28:19:49,  3.50it/s]
  4%|▍         | 14560/371472 [1:09:09<27:02:21,  3.67it/s]
                                                           
{'loss': 4.7722, 'learning_rate': 9.65189941606154e-07, 'epoch': 0.63}

  4%|▍         | 14560/371472 [1:09:09<27:02:21,  3.67it/s]
  4%|▍         | 14561/371472 [1:09:09<28:47:52,  3.44it/s]
  4%|▍         | 14562/371472 [1:09:10<28:13:47,  3.51it/s]
  4%|▍         | 14563/371472 [1:09:10<28:00:49,  3.54it/s]
  4%|▍         | 14564/371472 [1:09:10<28:45:07,  3.45it/s]
  4%|▍         | 14565/371472 [1:09:10<28:50:22,  3.44it/s]
  4%|▍         | 14566/371472 [1:09:11<33:10:44,  2.99it/s]
  4%|▍         | 14567/371472 [1:09:11<33:12:05,  2.99it/s]
  4%|▍         | 14568/371472 [1:09:11<31:22:54,  3.16it/s]
  4%|▍         | 14569/371472 [1:09:12<29:44:17,  3.33it/s]
  4%|▍         | 14570/371472 [1:09:12<29:03:42,  3.41it/s]
  4%|▍         | 14571/371472 [1:09:12<28:17:46,  3.50it/s]
  4%|▍         | 14572/371472 [1:09:13<27:01:44,  3.67it/s]
  4%|▍         | 14573/371472 [1:09:13<28:31:44,  3.47it/s]
  4%|▍         | 14574/371472 [1:09:13<30:40:43,  3.23it/s]
  4%|▍         | 14575/371472 [1:09:13<30:06:45,  3.29it/s]
  4%|▍         | 14576/371472 [1:09:14<28:48:09,  3.44it/s]
  4%|▍         | 14577/371472 [1:09:14<29:41:58,  3.34it/s]
  4%|▍         | 14578/371472 [1:09:14<30:09:22,  3.29it/s]
  4%|▍         | 14579/371472 [1:09:15<29:10:30,  3.40it/s]
  4%|▍         | 14580/371472 [1:09:15<27:37:15,  3.59it/s]
                                                           
{'loss': 4.6782, 'learning_rate': 9.65141459630675e-07, 'epoch': 0.63}

  4%|▍         | 14580/371472 [1:09:15<27:37:15,  3.59it/s]
  4%|▍         | 14581/371472 [1:09:15<29:07:12,  3.40it/s]
  4%|▍         | 14582/371472 [1:09:16<29:11:11,  3.40it/s]
  4%|▍         | 14583/371472 [1:09:16<27:52:06,  3.56it/s]
  4%|▍         | 14584/371472 [1:09:16<26:35:19,  3.73it/s]
  4%|▍         | 14585/371472 [1:09:16<29:18:14,  3.38it/s]
  4%|▍         | 14586/371472 [1:09:17<28:31:32,  3.48it/s]
  4%|▍         | 14587/371472 [1:09:17<27:42:44,  3.58it/s]
  4%|▍         | 14588/371472 [1:09:17<26:43:40,  3.71it/s]
  4%|▍         | 14589/371472 [1:09:17<26:34:48,  3.73it/s]
  4%|▍         | 14590/371472 [1:09:18<26:47:54,  3.70it/s]
  4%|▍         | 14591/371472 [1:09:18<27:57:13,  3.55it/s]
  4%|▍         | 14592/371472 [1:09:18<29:58:01,  3.31it/s]
  4%|▍         | 14593/371472 [1:09:19<28:59:57,  3.42it/s]
  4%|▍         | 14594/371472 [1:09:19<29:08:01,  3.40it/s]
  4%|▍         | 14595/371472 [1:09:19<28:05:18,  3.53it/s]
  4%|▍         | 14596/371472 [1:09:19<27:44:19,  3.57it/s]
  4%|▍         | 14597/371472 [1:09:20<27:04:19,  3.66it/s]
  4%|▍         | 14598/371472 [1:09:20<27:15:03,  3.64it/s]
  4%|▍         | 14599/371472 [1:09:20<28:08:07,  3.52it/s]
  4%|▍         | 14600/371472 [1:09:21<28:14:16,  3.51it/s]
                                                           
{'loss': 4.5165, 'learning_rate': 9.650929776551962e-07, 'epoch': 0.63}

  4%|▍         | 14600/371472 [1:09:21<28:14:16,  3.51it/s]
  4%|▍         | 14601/371472 [1:09:21<29:18:13,  3.38it/s]
  4%|▍         | 14602/371472 [1:09:21<30:31:14,  3.25it/s]
  4%|▍         | 14603/371472 [1:09:21<28:54:46,  3.43it/s]
  4%|▍         | 14604/371472 [1:09:22<29:20:15,  3.38it/s]
  4%|▍         | 14605/371472 [1:09:22<29:58:12,  3.31it/s]
  4%|▍         | 14606/371472 [1:09:22<28:28:51,  3.48it/s]
  4%|▍         | 14607/371472 [1:09:23<27:29:54,  3.60it/s]
  4%|▍         | 14608/371472 [1:09:23<29:09:03,  3.40it/s]
  4%|▍         | 14609/371472 [1:09:23<31:14:26,  3.17it/s]
  4%|▍         | 14610/371472 [1:09:24<29:41:29,  3.34it/s]
  4%|▍         | 14611/371472 [1:09:24<28:29:58,  3.48it/s]
  4%|▍         | 14612/371472 [1:09:24<27:54:32,  3.55it/s]
  4%|▍         | 14613/371472 [1:09:24<28:04:53,  3.53it/s]
  4%|▍         | 14614/371472 [1:09:25<26:56:58,  3.68it/s]
  4%|▍         | 14615/371472 [1:09:25<26:56:08,  3.68it/s]
  4%|▍         | 14616/371472 [1:09:25<28:44:05,  3.45it/s]
  4%|▍         | 14617/371472 [1:09:26<28:38:00,  3.46it/s]
  4%|▍         | 14618/371472 [1:09:26<27:05:42,  3.66it/s]
  4%|▍         | 14619/371472 [1:09:26<28:04:09,  3.53it/s]
  4%|▍         | 14620/371472 [1:09:26<27:40:56,  3.58it/s]
                                                           
{'loss': 4.682, 'learning_rate': 9.650444956797173e-07, 'epoch': 0.63}

  4%|▍         | 14620/371472 [1:09:26<27:40:56,  3.58it/s]
  4%|▍         | 14621/371472 [1:09:27<26:52:33,  3.69it/s]
  4%|▍         | 14622/371472 [1:09:27<28:08:08,  3.52it/s]
  4%|▍         | 14623/371472 [1:09:27<27:35:42,  3.59it/s]
  4%|▍         | 14624/371472 [1:09:27<28:09:30,  3.52it/s]
  4%|▍         | 14625/371472 [1:09:28<30:04:17,  3.30it/s]
  4%|▍         | 14626/371472 [1:09:28<29:05:54,  3.41it/s]
  4%|▍         | 14627/371472 [1:09:28<28:53:58,  3.43it/s]
  4%|▍         | 14628/371472 [1:09:29<28:50:17,  3.44it/s]
  4%|▍         | 14629/371472 [1:09:29<28:23:36,  3.49it/s]
  4%|▍         | 14630/371472 [1:09:29<27:27:12,  3.61it/s]
  4%|▍         | 14631/371472 [1:09:29<26:36:29,  3.73it/s]
  4%|▍         | 14632/371472 [1:09:30<27:10:30,  3.65it/s]
  4%|▍         | 14633/371472 [1:09:30<26:54:45,  3.68it/s]
  4%|▍         | 14634/371472 [1:09:30<29:30:29,  3.36it/s]
  4%|▍         | 14635/371472 [1:09:31<32:22:44,  3.06it/s]
  4%|▍         | 14636/371472 [1:09:31<33:34:56,  2.95it/s]
  4%|▍         | 14637/371472 [1:09:31<34:00:14,  2.91it/s]
  4%|▍         | 14638/371472 [1:09:32<34:28:42,  2.87it/s]
  4%|▍         | 14639/371472 [1:09:32<33:07:45,  2.99it/s]
  4%|▍         | 14640/371472 [1:09:32<31:14:14,  3.17it/s]
                                                           
{'loss': 4.7696, 'learning_rate': 9.649960137042383e-07, 'epoch': 0.63}

  4%|▍         | 14640/371472 [1:09:32<31:14:14,  3.17it/s]
  4%|▍         | 14641/371472 [1:09:33<29:57:51,  3.31it/s]
  4%|▍         | 14642/371472 [1:09:33<29:04:34,  3.41it/s]
  4%|▍         | 14643/371472 [1:09:33<28:44:03,  3.45it/s]
  4%|▍         | 14644/371472 [1:09:34<28:24:11,  3.49it/s]
  4%|▍         | 14645/371472 [1:09:34<27:56:06,  3.55it/s]
  4%|▍         | 14646/371472 [1:09:34<27:30:20,  3.60it/s]
  4%|▍         | 14647/371472 [1:09:34<27:47:23,  3.57it/s]
  4%|▍         | 14648/371472 [1:09:35<27:10:16,  3.65it/s]
  4%|▍         | 14649/371472 [1:09:35<28:18:27,  3.50it/s]
  4%|▍         | 14650/371472 [1:09:35<28:43:10,  3.45it/s]
  4%|▍         | 14651/371472 [1:09:35<28:49:06,  3.44it/s]
  4%|▍         | 14652/371472 [1:09:36<30:41:17,  3.23it/s]
  4%|▍         | 14653/371472 [1:09:36<31:02:00,  3.19it/s]
  4%|▍         | 14654/371472 [1:09:36<30:07:23,  3.29it/s]
  4%|▍         | 14655/371472 [1:09:37<28:56:08,  3.43it/s]
  4%|▍         | 14656/371472 [1:09:37<27:57:54,  3.54it/s]
  4%|▍         | 14657/371472 [1:09:37<27:24:11,  3.62it/s]
  4%|▍         | 14658/371472 [1:09:38<27:05:50,  3.66it/s]
  4%|▍         | 14659/371472 [1:09:38<26:28:59,  3.74it/s]
  4%|▍         | 14660/371472 [1:09:38<26:41:47,  3.71it/s]
                                                           
{'loss': 4.44, 'learning_rate': 9.649475317287594e-07, 'epoch': 0.63}

  4%|▍         | 14660/371472 [1:09:38<26:41:47,  3.71it/s]
  4%|▍         | 14661/371472 [1:09:38<27:07:19,  3.65it/s]
  4%|▍         | 14662/371472 [1:09:39<27:06:48,  3.66it/s]
  4%|▍         | 14663/371472 [1:09:39<28:40:58,  3.46it/s]
  4%|▍         | 14664/371472 [1:09:39<28:18:58,  3.50it/s]
  4%|▍         | 14665/371472 [1:09:39<27:43:57,  3.57it/s]
  4%|▍         | 14666/371472 [1:09:40<27:35:08,  3.59it/s]
  4%|▍         | 14667/371472 [1:09:40<26:50:18,  3.69it/s]
  4%|▍         | 14668/371472 [1:09:40<26:30:18,  3.74it/s]
  4%|▍         | 14669/371472 [1:09:40<26:05:08,  3.80it/s]
  4%|▍         | 14670/371472 [1:09:41<26:32:32,  3.73it/s]
  4%|▍         | 14671/371472 [1:09:41<26:46:01,  3.70it/s]
  4%|▍         | 14672/371472 [1:09:41<27:47:51,  3.57it/s]
  4%|▍         | 14673/371472 [1:09:42<29:54:44,  3.31it/s]
  4%|▍         | 14674/371472 [1:09:42<30:08:23,  3.29it/s]
  4%|▍         | 14675/371472 [1:09:42<29:59:27,  3.30it/s]
  4%|▍         | 14676/371472 [1:09:43<28:33:55,  3.47it/s]
  4%|▍         | 14677/371472 [1:09:43<27:54:34,  3.55it/s]
  4%|▍         | 14678/371472 [1:09:43<27:17:39,  3.63it/s]
  4%|▍         | 14679/371472 [1:09:43<27:00:39,  3.67it/s]
  4%|▍         | 14680/371472 [1:09:44<26:23:55,  3.75it/s]
                                                           
{'loss': 4.9536, 'learning_rate': 9.648990497532805e-07, 'epoch': 0.63}

  4%|▍         | 14680/371472 [1:09:44<26:23:55,  3.75it/s]
  4%|▍         | 14681/371472 [1:09:44<27:23:15,  3.62it/s]
  4%|▍         | 14682/371472 [1:09:44<27:42:11,  3.58it/s]
  4%|▍         | 14683/371472 [1:09:45<29:02:30,  3.41it/s]
  4%|▍         | 14684/371472 [1:09:45<29:47:54,  3.33it/s]
  4%|▍         | 14685/371472 [1:09:45<29:30:04,  3.36it/s]
  4%|▍         | 14686/371472 [1:09:45<28:12:44,  3.51it/s]
  4%|▍         | 14687/371472 [1:09:46<29:11:43,  3.39it/s]
  4%|▍         | 14688/371472 [1:09:46<29:00:56,  3.42it/s]
  4%|▍         | 14689/371472 [1:09:46<28:50:46,  3.44it/s]
  4%|▍         | 14690/371472 [1:09:47<29:00:15,  3.42it/s]
  4%|▍         | 14691/371472 [1:09:47<28:38:42,  3.46it/s]
  4%|▍         | 14692/371472 [1:09:47<27:43:05,  3.58it/s]
  4%|▍         | 14693/371472 [1:09:47<28:55:00,  3.43it/s]
  4%|▍         | 14694/371472 [1:09:48<28:42:37,  3.45it/s]
  4%|▍         | 14695/371472 [1:09:48<27:57:18,  3.55it/s]
  4%|▍         | 14696/371472 [1:09:48<28:03:18,  3.53it/s]
  4%|▍         | 14697/371472 [1:09:49<28:18:31,  3.50it/s]
  4%|▍         | 14698/371472 [1:09:49<28:34:26,  3.47it/s]
  4%|▍         | 14699/371472 [1:09:49<29:17:00,  3.38it/s]
  4%|▍         | 14700/371472 [1:09:49<28:13:59,  3.51it/s]
                                                           
{'loss': 4.4343, 'learning_rate': 9.648505677778018e-07, 'epoch': 0.63}

  4%|▍         | 14700/371472 [1:09:49<28:13:59,  3.51it/s]
  4%|▍         | 14701/371472 [1:09:50<29:26:15,  3.37it/s]
  4%|▍         | 14702/371472 [1:09:50<29:47:52,  3.33it/s]
  4%|▍         | 14703/371472 [1:09:50<29:36:59,  3.35it/s]
  4%|▍         | 14704/371472 [1:09:51<27:52:23,  3.56it/s]
  4%|▍         | 14705/371472 [1:09:51<26:54:25,  3.68it/s]
  4%|▍         | 14706/371472 [1:09:51<27:42:33,  3.58it/s]
  4%|▍         | 14707/371472 [1:09:51<27:54:28,  3.55it/s]
  4%|▍         | 14708/371472 [1:09:52<27:15:05,  3.64it/s]
  4%|▍         | 14709/371472 [1:09:52<28:25:41,  3.49it/s]
  4%|▍         | 14710/371472 [1:09:52<28:17:22,  3.50it/s]
  4%|▍         | 14711/371472 [1:09:53<27:46:13,  3.57it/s]
  4%|▍         | 14712/371472 [1:09:53<27:05:42,  3.66it/s]
  4%|▍         | 14713/371472 [1:09:53<28:24:37,  3.49it/s]
  4%|▍         | 14714/371472 [1:09:53<27:34:26,  3.59it/s]
  4%|▍         | 14715/371472 [1:09:54<26:55:26,  3.68it/s]
  4%|▍         | 14716/371472 [1:09:54<26:10:57,  3.78it/s]
  4%|▍         | 14717/371472 [1:09:54<28:37:00,  3.46it/s]
  4%|▍         | 14718/371472 [1:09:55<30:00:56,  3.30it/s]
  4%|▍         | 14719/371472 [1:09:55<30:02:44,  3.30it/s]
  4%|▍         | 14720/371472 [1:09:55<28:22:45,  3.49it/s]
                                                           
{'loss': 4.7066, 'learning_rate': 9.648020858023228e-07, 'epoch': 0.63}

  4%|▍         | 14720/371472 [1:09:55<28:22:45,  3.49it/s]
  4%|▍         | 14721/371472 [1:09:55<28:04:46,  3.53it/s]
  4%|▍         | 14722/371472 [1:09:56<27:27:06,  3.61it/s]
  4%|▍         | 14723/371472 [1:09:56<26:56:00,  3.68it/s]
  4%|▍         | 14724/371472 [1:09:56<28:55:52,  3.43it/s]
  4%|▍         | 14725/371472 [1:09:57<28:32:20,  3.47it/s]
  4%|▍         | 14726/371472 [1:09:57<29:31:30,  3.36it/s]
  4%|▍         | 14727/371472 [1:09:57<30:28:23,  3.25it/s]
  4%|▍         | 14728/371472 [1:09:57<29:17:18,  3.38it/s]
  4%|▍         | 14729/371472 [1:09:58<28:13:27,  3.51it/s]
  4%|▍         | 14730/371472 [1:09:58<28:10:36,  3.52it/s]
  4%|▍         | 14731/371472 [1:09:58<28:29:22,  3.48it/s]
  4%|▍         | 14732/371472 [1:09:59<27:43:25,  3.57it/s]
  4%|▍         | 14733/371472 [1:09:59<26:55:50,  3.68it/s]
  4%|▍         | 14734/371472 [1:09:59<28:08:29,  3.52it/s]
  4%|▍         | 14735/371472 [1:09:59<28:30:40,  3.48it/s]
  4%|▍         | 14736/371472 [1:10:00<28:03:09,  3.53it/s]
  4%|▍         | 14737/371472 [1:10:00<27:27:52,  3.61it/s]
  4%|▍         | 14738/371472 [1:10:00<27:25:52,  3.61it/s]
  4%|▍         | 14739/371472 [1:10:01<27:15:33,  3.64it/s]
  4%|▍         | 14740/371472 [1:10:01<32:44:34,  3.03it/s]
                                                           
{'loss': 4.737, 'learning_rate': 9.64753603826844e-07, 'epoch': 0.63}

  4%|▍         | 14740/371472 [1:10:01<32:44:34,  3.03it/s]
  4%|▍         | 14741/371472 [1:10:01<31:12:14,  3.18it/s]
  4%|▍         | 14742/371472 [1:10:02<30:46:48,  3.22it/s]
  4%|▍         | 14743/371472 [1:10:02<29:14:05,  3.39it/s]
  4%|▍         | 14744/371472 [1:10:02<32:18:39,  3.07it/s]
  4%|▍         | 14745/371472 [1:10:03<32:39:44,  3.03it/s]
  4%|▍         | 14746/371472 [1:10:03<32:29:18,  3.05it/s]
  4%|▍         | 14747/371472 [1:10:03<31:02:12,  3.19it/s]
  4%|▍         | 14748/371472 [1:10:03<29:48:05,  3.32it/s]
  4%|▍         | 14749/371472 [1:10:04<28:42:53,  3.45it/s]
  4%|▍         | 14750/371472 [1:10:04<27:21:55,  3.62it/s]
  4%|▍         | 14751/371472 [1:10:04<26:56:32,  3.68it/s]
  4%|▍         | 14752/371472 [1:10:05<29:19:55,  3.38it/s]
  4%|▍         | 14753/371472 [1:10:05<29:42:23,  3.34it/s]
  4%|▍         | 14754/371472 [1:10:05<29:22:09,  3.37it/s]
  4%|▍         | 14755/371472 [1:10:06<31:37:05,  3.13it/s]
  4%|▍         | 14756/371472 [1:10:06<29:45:51,  3.33it/s]
  4%|▍         | 14757/371472 [1:10:06<28:27:56,  3.48it/s]
  4%|▍         | 14758/371472 [1:10:06<29:15:55,  3.39it/s]
  4%|▍         | 14759/371472 [1:10:07<28:07:30,  3.52it/s]
  4%|▍         | 14760/371472 [1:10:07<29:16:19,  3.39it/s]
                                                           
{'loss': 4.5779, 'learning_rate': 9.64705121851365e-07, 'epoch': 0.64}

  4%|▍         | 14760/371472 [1:10:07<29:16:19,  3.39it/s]
  4%|▍         | 14761/371472 [1:10:07<29:55:25,  3.31it/s]
  4%|▍         | 14762/371472 [1:10:08<29:18:28,  3.38it/s]
  4%|▍         | 14763/371472 [1:10:08<28:33:38,  3.47it/s]
  4%|▍         | 14764/371472 [1:10:08<30:18:42,  3.27it/s]
  4%|▍         | 14765/371472 [1:10:08<29:53:52,  3.31it/s]
  4%|▍         | 14766/371472 [1:10:09<29:29:32,  3.36it/s]
  4%|▍         | 14767/371472 [1:10:09<28:28:57,  3.48it/s]
  4%|▍         | 14768/371472 [1:10:09<29:15:04,  3.39it/s]
  4%|▍         | 14769/371472 [1:10:10<29:14:50,  3.39it/s]
  4%|▍         | 14770/371472 [1:10:10<29:33:31,  3.35it/s]
  4%|▍         | 14771/371472 [1:10:10<28:35:01,  3.47it/s]
  4%|▍         | 14772/371472 [1:10:10<28:43:55,  3.45it/s]
  4%|▍         | 14773/371472 [1:10:11<28:37:18,  3.46it/s]
  4%|▍         | 14774/371472 [1:10:11<30:51:33,  3.21it/s]
  4%|▍         | 14775/371472 [1:10:11<32:28:34,  3.05it/s]
  4%|▍         | 14776/371472 [1:10:12<29:43:21,  3.33it/s]
  4%|▍         | 14777/371472 [1:10:12<29:08:46,  3.40it/s]
  4%|▍         | 14778/371472 [1:10:12<27:26:56,  3.61it/s]
  4%|▍         | 14779/371472 [1:10:12<26:40:30,  3.71it/s]
  4%|▍         | 14780/371472 [1:10:13<28:14:15,  3.51it/s]
                                                           
{'loss': 4.6775, 'learning_rate': 9.64656639875886e-07, 'epoch': 0.64}

  4%|▍         | 14780/371472 [1:10:13<28:14:15,  3.51it/s]
  4%|▍         | 14781/371472 [1:10:13<28:29:37,  3.48it/s]
  4%|▍         | 14782/371472 [1:10:13<28:52:22,  3.43it/s]
  4%|▍         | 14783/371472 [1:10:14<29:22:12,  3.37it/s]
  4%|▍         | 14784/371472 [1:10:14<29:59:30,  3.30it/s]
  4%|▍         | 14785/371472 [1:10:14<28:31:33,  3.47it/s]
  4%|▍         | 14786/371472 [1:10:15<27:51:06,  3.56it/s]
  4%|▍         | 14787/371472 [1:10:15<30:11:46,  3.28it/s]
  4%|▍         | 14788/371472 [1:10:15<28:50:10,  3.44it/s]
  4%|▍         | 14789/371472 [1:10:15<28:21:32,  3.49it/s]
  4%|▍         | 14790/371472 [1:10:16<27:30:35,  3.60it/s]
  4%|▍         | 14791/371472 [1:10:16<26:49:53,  3.69it/s]
  4%|▍         | 14792/371472 [1:10:16<26:23:08,  3.75it/s]
  4%|▍         | 14793/371472 [1:10:16<27:08:02,  3.65it/s]
  4%|▍         | 14794/371472 [1:10:17<26:58:48,  3.67it/s]
  4%|▍         | 14795/371472 [1:10:17<27:50:09,  3.56it/s]
  4%|▍         | 14796/371472 [1:10:17<26:59:40,  3.67it/s]
  4%|▍         | 14797/371472 [1:10:18<26:26:34,  3.75it/s]
  4%|▍         | 14798/371472 [1:10:18<28:57:29,  3.42it/s]
  4%|▍         | 14799/371472 [1:10:18<29:59:48,  3.30it/s]
  4%|▍         | 14800/371472 [1:10:19<30:23:26,  3.26it/s]
                                                           
{'loss': 4.6419, 'learning_rate': 9.646081579004071e-07, 'epoch': 0.64}

  4%|▍         | 14800/371472 [1:10:19<30:23:26,  3.26it/s]
  4%|▍         | 14801/371472 [1:10:19<29:44:09,  3.33it/s]
  4%|▍         | 14802/371472 [1:10:19<29:05:45,  3.41it/s]
  4%|▍         | 14803/371472 [1:10:19<31:32:48,  3.14it/s]
  4%|▍         | 14804/371472 [1:10:20<34:31:05,  2.87it/s]
  4%|▍         | 14805/371472 [1:10:20<33:04:12,  3.00it/s]
  4%|▍         | 14806/371472 [1:10:20<31:36:46,  3.13it/s]
  4%|▍         | 14807/371472 [1:10:21<31:49:56,  3.11it/s]
  4%|▍         | 14808/371472 [1:10:21<31:46:40,  3.12it/s]
  4%|▍         | 14809/371472 [1:10:21<29:54:27,  3.31it/s]
  4%|▍         | 14810/371472 [1:10:22<29:27:58,  3.36it/s]
  4%|▍         | 14811/371472 [1:10:22<28:06:52,  3.52it/s]
  4%|▍         | 14812/371472 [1:10:22<29:13:05,  3.39it/s]
  4%|▍         | 14813/371472 [1:10:23<27:51:44,  3.56it/s]
  4%|▍         | 14814/371472 [1:10:23<27:58:51,  3.54it/s]
  4%|▍         | 14815/371472 [1:10:23<27:05:16,  3.66it/s]
  4%|▍         | 14816/371472 [1:10:23<26:38:14,  3.72it/s]
  4%|▍         | 14817/371472 [1:10:24<26:37:50,  3.72it/s]
  4%|▍         | 14818/371472 [1:10:24<26:54:18,  3.68it/s]
  4%|▍         | 14819/371472 [1:10:24<27:45:41,  3.57it/s]
  4%|▍         | 14820/371472 [1:10:24<27:04:27,  3.66it/s]
                                                           
{'loss': 4.793, 'learning_rate': 9.645596759249282e-07, 'epoch': 0.64}

  4%|▍         | 14820/371472 [1:10:24<27:04:27,  3.66it/s]
  4%|▍         | 14821/371472 [1:10:25<27:32:09,  3.60it/s]
  4%|▍         | 14822/371472 [1:10:25<27:29:47,  3.60it/s]
  4%|▍         | 14823/371472 [1:10:25<29:18:34,  3.38it/s]
  4%|▍         | 14824/371472 [1:10:26<28:28:58,  3.48it/s]
  4%|▍         | 14825/371472 [1:10:26<28:13:29,  3.51it/s]
  4%|▍         | 14826/371472 [1:10:26<27:39:43,  3.58it/s]
  4%|▍         | 14827/371472 [1:10:26<26:59:55,  3.67it/s]
  4%|▍         | 14828/371472 [1:10:27<29:33:41,  3.35it/s]
  4%|▍         | 14829/371472 [1:10:27<28:21:52,  3.49it/s]
  4%|▍         | 14830/371472 [1:10:27<27:36:09,  3.59it/s]
  4%|▍         | 14831/371472 [1:10:28<27:14:41,  3.64it/s]
  4%|▍         | 14832/371472 [1:10:28<27:02:07,  3.66it/s]
  4%|▍         | 14833/371472 [1:10:28<26:37:21,  3.72it/s]
  4%|▍         | 14834/371472 [1:10:28<28:02:28,  3.53it/s]
  4%|▍         | 14835/371472 [1:10:29<28:53:08,  3.43it/s]
  4%|▍         | 14836/371472 [1:10:29<30:17:45,  3.27it/s]
  4%|▍         | 14837/371472 [1:10:29<29:22:36,  3.37it/s]
  4%|▍         | 14838/371472 [1:10:30<30:51:04,  3.21it/s]
  4%|▍         | 14839/371472 [1:10:30<29:17:56,  3.38it/s]
  4%|▍         | 14840/371472 [1:10:30<29:23:36,  3.37it/s]
                                                           
{'loss': 4.6022, 'learning_rate': 9.645111939494495e-07, 'epoch': 0.64}

  4%|▍         | 14840/371472 [1:10:30<29:23:36,  3.37it/s]
  4%|▍         | 14841/371472 [1:10:30<28:11:24,  3.51it/s]
  4%|▍         | 14842/371472 [1:10:31<26:38:45,  3.72it/s]
  4%|▍         | 14843/371472 [1:10:31<27:31:07,  3.60it/s]
  4%|▍         | 14844/371472 [1:10:31<27:50:57,  3.56it/s]
  4%|▍         | 14845/371472 [1:10:32<27:55:08,  3.55it/s]
  4%|▍         | 14846/371472 [1:10:32<27:15:27,  3.63it/s]
  4%|▍         | 14847/371472 [1:10:32<27:06:28,  3.65it/s]
  4%|▍         | 14848/371472 [1:10:32<30:50:43,  3.21it/s]
  4%|▍         | 14849/371472 [1:10:33<28:51:59,  3.43it/s]
  4%|▍         | 14850/371472 [1:10:33<28:48:47,  3.44it/s]
  4%|▍         | 14851/371472 [1:10:33<27:39:58,  3.58it/s]
  4%|▍         | 14852/371472 [1:10:34<26:57:25,  3.67it/s]
  4%|▍         | 14853/371472 [1:10:34<26:36:46,  3.72it/s]
  4%|▍         | 14854/371472 [1:10:34<26:01:20,  3.81it/s]
  4%|▍         | 14855/371472 [1:10:34<27:22:33,  3.62it/s]
  4%|▍         | 14856/371472 [1:10:35<28:47:10,  3.44it/s]
  4%|▍         | 14857/371472 [1:10:35<29:01:14,  3.41it/s]
  4%|▍         | 14858/371472 [1:10:35<28:07:40,  3.52it/s]
  4%|▍         | 14859/371472 [1:10:36<27:51:30,  3.56it/s]
  4%|▍         | 14860/371472 [1:10:36<27:29:34,  3.60it/s]
                                                           
{'loss': 4.7609, 'learning_rate': 9.644627119739706e-07, 'epoch': 0.64}

  4%|▍         | 14860/371472 [1:10:36<27:29:34,  3.60it/s]
  4%|▍         | 14861/371472 [1:10:36<27:48:42,  3.56it/s]
  4%|▍         | 14862/371472 [1:10:36<27:09:33,  3.65it/s]
  4%|▍         | 14863/371472 [1:10:37<28:01:29,  3.53it/s]
  4%|▍         | 14864/371472 [1:10:37<27:05:48,  3.66it/s]
  4%|▍         | 14865/371472 [1:10:37<29:04:06,  3.41it/s]
  4%|▍         | 14866/371472 [1:10:37<27:28:15,  3.61it/s]
  4%|▍         | 14867/371472 [1:10:38<28:25:49,  3.48it/s]
  4%|▍         | 14868/371472 [1:10:38<27:59:40,  3.54it/s]
  4%|▍         | 14869/371472 [1:10:38<28:01:24,  3.53it/s]
  4%|▍         | 14870/371472 [1:10:39<27:42:39,  3.57it/s]
  4%|▍         | 14871/371472 [1:10:39<27:28:19,  3.61it/s]
  4%|▍         | 14872/371472 [1:10:39<27:06:15,  3.65it/s]
  4%|▍         | 14873/371472 [1:10:39<26:21:43,  3.76it/s]
  4%|▍         | 14874/371472 [1:10:40<26:21:14,  3.76it/s]
  4%|▍         | 14875/371472 [1:10:40<27:17:31,  3.63it/s]
  4%|▍         | 14876/371472 [1:10:40<26:53:16,  3.68it/s]
  4%|▍         | 14877/371472 [1:10:40<26:28:31,  3.74it/s]
  4%|▍         | 14878/371472 [1:10:41<27:07:25,  3.65it/s]
  4%|▍         | 14879/371472 [1:10:41<28:30:11,  3.48it/s]
  4%|▍         | 14880/371472 [1:10:41<27:49:45,  3.56it/s]
                                                           
{'loss': 4.664, 'learning_rate': 9.644142299984916e-07, 'epoch': 0.64}

  4%|▍         | 14880/371472 [1:10:41<27:49:45,  3.56it/s]
  4%|▍         | 14881/371472 [1:10:42<27:40:10,  3.58it/s]
  4%|▍         | 14882/371472 [1:10:42<27:49:14,  3.56it/s]
  4%|▍         | 14883/371472 [1:10:42<27:57:46,  3.54it/s]
  4%|▍         | 14884/371472 [1:10:42<27:01:39,  3.66it/s]
  4%|▍         | 14885/371472 [1:10:43<27:14:05,  3.64it/s]
  4%|▍         | 14886/371472 [1:10:43<26:36:37,  3.72it/s]
  4%|▍         | 14887/371472 [1:10:43<29:16:54,  3.38it/s]
  4%|▍         | 14888/371472 [1:10:44<28:54:35,  3.43it/s]
  4%|▍         | 14889/371472 [1:10:44<28:28:53,  3.48it/s]
  4%|▍         | 14890/371472 [1:10:44<27:36:57,  3.59it/s]
  4%|▍         | 14891/371472 [1:10:44<27:41:32,  3.58it/s]
  4%|▍         | 14892/371472 [1:10:45<27:47:54,  3.56it/s]
  4%|▍         | 14893/371472 [1:10:45<28:14:49,  3.51it/s]
  4%|▍         | 14894/371472 [1:10:45<28:03:44,  3.53it/s]
  4%|▍         | 14895/371472 [1:10:46<29:03:56,  3.41it/s]
  4%|▍         | 14896/371472 [1:10:46<29:12:06,  3.39it/s]
  4%|▍         | 14897/371472 [1:10:46<30:24:00,  3.26it/s]
  4%|▍         | 14898/371472 [1:10:47<30:05:05,  3.29it/s]
  4%|▍         | 14899/371472 [1:10:47<30:08:45,  3.29it/s]
  4%|▍         | 14900/371472 [1:10:47<29:17:16,  3.38it/s]
                                                           
{'loss': 4.6633, 'learning_rate': 9.643657480230127e-07, 'epoch': 0.64}

  4%|▍         | 14900/371472 [1:10:47<29:17:16,  3.38it/s]
  4%|▍         | 14901/371472 [1:10:47<27:35:48,  3.59it/s]
  4%|▍         | 14902/371472 [1:10:48<27:32:05,  3.60it/s]
  4%|▍         | 14903/371472 [1:10:48<26:45:53,  3.70it/s]
  4%|▍         | 14904/371472 [1:10:48<27:26:53,  3.61it/s]
  4%|▍         | 14905/371472 [1:10:48<27:45:15,  3.57it/s]
  4%|▍         | 14906/371472 [1:10:49<26:36:41,  3.72it/s]
  4%|▍         | 14907/371472 [1:10:49<27:20:36,  3.62it/s]
  4%|▍         | 14908/371472 [1:10:49<27:03:53,  3.66it/s]
  4%|▍         | 14909/371472 [1:10:50<26:45:30,  3.70it/s]
  4%|▍         | 14910/371472 [1:10:50<26:30:19,  3.74it/s]
  4%|▍         | 14911/371472 [1:10:50<26:08:46,  3.79it/s]
  4%|▍         | 14912/371472 [1:10:50<26:44:07,  3.70it/s]
  4%|▍         | 14913/371472 [1:10:51<27:17:35,  3.63it/s]
  4%|▍         | 14914/371472 [1:10:51<29:47:05,  3.33it/s]
  4%|▍         | 14915/371472 [1:10:51<30:43:30,  3.22it/s]
  4%|▍         | 14916/371472 [1:10:52<28:57:20,  3.42it/s]
  4%|▍         | 14917/371472 [1:10:52<27:39:58,  3.58it/s]
  4%|▍         | 14918/371472 [1:10:52<27:01:07,  3.67it/s]
  4%|▍         | 14919/371472 [1:10:52<26:39:25,  3.72it/s]
  4%|▍         | 14920/371472 [1:10:53<26:39:50,  3.71it/s]
                                                           
{'loss': 4.7861, 'learning_rate': 9.643172660475338e-07, 'epoch': 0.64}

  4%|▍         | 14920/371472 [1:10:53<26:39:50,  3.71it/s]
  4%|▍         | 14921/371472 [1:10:53<26:20:42,  3.76it/s]
  4%|▍         | 14922/371472 [1:10:53<27:37:02,  3.59it/s]
  4%|▍         | 14923/371472 [1:10:53<27:01:58,  3.66it/s]
  4%|▍         | 14924/371472 [1:10:54<27:19:36,  3.62it/s]
  4%|▍         | 14925/371472 [1:10:54<26:42:35,  3.71it/s]
  4%|▍         | 14926/371472 [1:10:54<26:08:56,  3.79it/s]
  4%|▍         | 14927/371472 [1:10:55<28:22:52,  3.49it/s]
  4%|▍         | 14928/371472 [1:10:55<28:32:12,  3.47it/s]
  4%|▍         | 14929/371472 [1:10:55<29:16:50,  3.38it/s]
  4%|▍         | 14930/371472 [1:10:55<29:19:02,  3.38it/s]
  4%|▍         | 14931/371472 [1:10:56<29:40:13,  3.34it/s]
  4%|▍         | 14932/371472 [1:10:56<28:27:52,  3.48it/s]
  4%|▍         | 14933/371472 [1:10:56<27:55:46,  3.55it/s]
  4%|▍         | 14934/371472 [1:10:57<27:43:08,  3.57it/s]
  4%|▍         | 14935/371472 [1:10:57<28:32:32,  3.47it/s]
  4%|▍         | 14936/371472 [1:10:57<27:54:35,  3.55it/s]
  4%|▍         | 14937/371472 [1:10:57<27:45:22,  3.57it/s]
  4%|▍         | 14938/371472 [1:10:58<27:17:03,  3.63it/s]
  4%|▍         | 14939/371472 [1:10:58<27:13:55,  3.64it/s]
  4%|▍         | 14940/371472 [1:10:58<28:06:14,  3.52it/s]
                                                           
{'loss': 4.6721, 'learning_rate': 9.64268784072055e-07, 'epoch': 0.64}

  4%|▍         | 14940/371472 [1:10:58<28:06:14,  3.52it/s]
  4%|▍         | 14941/371472 [1:10:59<27:57:47,  3.54it/s]
  4%|▍         | 14942/371472 [1:10:59<27:54:27,  3.55it/s]
  4%|▍         | 14943/371472 [1:10:59<28:29:26,  3.48it/s]
  4%|▍         | 14944/371472 [1:10:59<27:37:24,  3.59it/s]
  4%|▍         | 14945/371472 [1:11:00<27:20:48,  3.62it/s]
  4%|▍         | 14946/371472 [1:11:00<27:30:05,  3.60it/s]
  4%|▍         | 14947/371472 [1:11:00<28:21:10,  3.49it/s]
  4%|▍         | 14948/371472 [1:11:01<29:33:33,  3.35it/s]
  4%|▍         | 14949/371472 [1:11:01<28:07:56,  3.52it/s]
  4%|▍         | 14950/371472 [1:11:01<27:06:46,  3.65it/s]
  4%|▍         | 14951/371472 [1:11:01<26:51:14,  3.69it/s]
  4%|▍         | 14952/371472 [1:11:02<27:49:23,  3.56it/s]
  4%|▍         | 14953/371472 [1:11:02<29:15:36,  3.38it/s]
  4%|▍         | 14954/371472 [1:11:02<28:10:08,  3.52it/s]
  4%|▍         | 14955/371472 [1:11:02<27:35:32,  3.59it/s]
  4%|▍         | 14956/371472 [1:11:03<31:12:46,  3.17it/s]
  4%|▍         | 14957/371472 [1:11:03<29:23:33,  3.37it/s]
  4%|▍         | 14958/371472 [1:11:03<28:57:27,  3.42it/s]
  4%|▍         | 14959/371472 [1:11:04<28:32:32,  3.47it/s]
  4%|▍         | 14960/371472 [1:11:04<28:01:38,  3.53it/s]
                                                           
{'loss': 4.6615, 'learning_rate': 9.64220302096576e-07, 'epoch': 0.64}

  4%|▍         | 14960/371472 [1:11:04<28:01:38,  3.53it/s]
  4%|▍         | 14961/371472 [1:11:04<28:27:55,  3.48it/s]
  4%|▍         | 14962/371472 [1:11:05<29:52:04,  3.32it/s]
  4%|▍         | 14963/371472 [1:11:05<34:39:52,  2.86it/s]
  4%|▍         | 14964/371472 [1:11:05<32:04:24,  3.09it/s]
  4%|▍         | 14965/371472 [1:11:06<29:51:09,  3.32it/s]
  4%|▍         | 14966/371472 [1:11:06<30:28:45,  3.25it/s]
  4%|▍         | 14967/371472 [1:11:06<28:58:32,  3.42it/s]
  4%|▍         | 14968/371472 [1:11:06<29:09:57,  3.40it/s]
  4%|▍         | 14969/371472 [1:11:07<32:17:05,  3.07it/s]
  4%|▍         | 14970/371472 [1:11:07<31:33:30,  3.14it/s]
  4%|▍         | 14971/371472 [1:11:07<31:10:40,  3.18it/s]
  4%|▍         | 14972/371472 [1:11:08<30:37:32,  3.23it/s]
  4%|▍         | 14973/371472 [1:11:08<29:22:47,  3.37it/s]
  4%|▍         | 14974/371472 [1:11:08<29:36:40,  3.34it/s]
  4%|▍         | 14975/371472 [1:11:09<27:57:09,  3.54it/s]
  4%|▍         | 14976/371472 [1:11:09<28:49:12,  3.44it/s]
  4%|▍         | 14977/371472 [1:11:09<28:45:29,  3.44it/s]
  4%|▍         | 14978/371472 [1:11:09<27:59:19,  3.54it/s]
  4%|▍         | 14979/371472 [1:11:10<27:22:35,  3.62it/s]
  4%|▍         | 14980/371472 [1:11:10<28:34:56,  3.46it/s]
                                                           
{'loss': 4.668, 'learning_rate': 9.641718201210972e-07, 'epoch': 0.65}

  4%|▍         | 14980/371472 [1:11:10<28:34:56,  3.46it/s]
  4%|▍         | 14981/371472 [1:11:10<29:04:13,  3.41it/s]
  4%|▍         | 14982/371472 [1:11:11<29:38:50,  3.34it/s]
  4%|▍         | 14983/371472 [1:11:11<28:26:29,  3.48it/s]
  4%|▍         | 14984/371472 [1:11:11<28:05:04,  3.53it/s]
  4%|▍         | 14985/371472 [1:11:12<31:07:22,  3.18it/s]
  4%|▍         | 14986/371472 [1:11:12<29:56:28,  3.31it/s]
  4%|▍         | 14987/371472 [1:11:12<28:37:36,  3.46it/s]
  4%|▍         | 14988/371472 [1:11:12<28:00:28,  3.54it/s]
  4%|▍         | 14989/371472 [1:11:13<29:18:51,  3.38it/s]
  4%|▍         | 14990/371472 [1:11:13<28:14:22,  3.51it/s]
  4%|▍         | 14991/371472 [1:11:13<30:52:37,  3.21it/s]
  4%|▍         | 14992/371472 [1:11:14<31:08:25,  3.18it/s]
  4%|▍         | 14993/371472 [1:11:14<32:32:12,  3.04it/s]
  4%|▍         | 14994/371472 [1:11:14<33:20:56,  2.97it/s]
  4%|▍         | 14995/371472 [1:11:15<31:21:49,  3.16it/s]
  4%|▍         | 14996/371472 [1:11:15<33:51:40,  2.92it/s]
  4%|▍         | 14997/371472 [1:11:15<31:44:59,  3.12it/s]
  4%|▍         | 14998/371472 [1:11:16<30:34:20,  3.24it/s]
  4%|▍         | 14999/371472 [1:11:16<29:28:36,  3.36it/s]
  4%|▍         | 15000/371472 [1:11:16<29:05:40,  3.40it/s]
                                                           
{'loss': 4.6814, 'learning_rate': 9.641233381456183e-07, 'epoch': 0.65}

  4%|▍         | 15000/371472 [1:11:16<29:05:40,  3.40it/s]
  4%|▍         | 15001/371472 [1:11:16<28:56:45,  3.42it/s]
  4%|▍         | 15002/371472 [1:11:17<28:49:47,  3.43it/s]
  4%|▍         | 15003/371472 [1:11:17<30:00:25,  3.30it/s]
  4%|▍         | 15004/371472 [1:11:17<30:36:48,  3.23it/s]
  4%|▍         | 15005/371472 [1:11:18<29:37:51,  3.34it/s]
  4%|▍         | 15006/371472 [1:11:18<29:06:28,  3.40it/s]
  4%|▍         | 15007/371472 [1:11:18<27:39:40,  3.58it/s]
  4%|▍         | 15008/371472 [1:11:18<28:56:25,  3.42it/s]
  4%|▍         | 15009/371472 [1:11:19<27:39:29,  3.58it/s]
  4%|▍         | 15010/371472 [1:11:19<27:04:33,  3.66it/s]
  4%|▍         | 15011/371472 [1:11:19<29:05:59,  3.40it/s]
  4%|▍         | 15012/371472 [1:11:20<27:57:14,  3.54it/s]
  4%|▍         | 15013/371472 [1:11:20<27:23:17,  3.62it/s]
  4%|▍         | 15014/371472 [1:11:20<27:46:05,  3.57it/s]
  4%|▍         | 15015/371472 [1:11:20<27:13:02,  3.64it/s]
  4%|▍         | 15016/371472 [1:11:21<27:18:01,  3.63it/s]
  4%|▍         | 15017/371472 [1:11:21<30:03:36,  3.29it/s]
  4%|▍         | 15018/371472 [1:11:21<29:34:20,  3.35it/s]
  4%|▍         | 15019/371472 [1:11:22<29:02:14,  3.41it/s]
  4%|▍         | 15020/371472 [1:11:22<28:21:06,  3.49it/s]
                                                           
{'loss': 4.6951, 'learning_rate': 9.640748561701393e-07, 'epoch': 0.65}

  4%|▍         | 15020/371472 [1:11:22<28:21:06,  3.49it/s]
  4%|▍         | 15021/371472 [1:11:22<28:46:32,  3.44it/s]
  4%|▍         | 15022/371472 [1:11:23<29:39:48,  3.34it/s]
  4%|▍         | 15023/371472 [1:11:23<29:45:18,  3.33it/s]
  4%|▍         | 15024/371472 [1:11:23<29:21:14,  3.37it/s]
  4%|▍         | 15025/371472 [1:11:23<30:44:12,  3.22it/s]
  4%|▍         | 15026/371472 [1:11:24<28:32:53,  3.47it/s]
  4%|▍         | 15027/371472 [1:11:24<27:53:10,  3.55it/s]
  4%|▍         | 15028/371472 [1:11:24<30:01:00,  3.30it/s]
  4%|▍         | 15029/371472 [1:11:25<29:31:35,  3.35it/s]
  4%|▍         | 15030/371472 [1:11:25<28:30:52,  3.47it/s]
  4%|▍         | 15031/371472 [1:11:25<27:53:41,  3.55it/s]
  4%|▍         | 15032/371472 [1:11:25<27:43:10,  3.57it/s]
  4%|▍         | 15033/371472 [1:11:26<28:52:50,  3.43it/s]
  4%|▍         | 15034/371472 [1:11:26<29:28:10,  3.36it/s]
  4%|▍         | 15035/371472 [1:11:26<30:48:43,  3.21it/s]
  4%|▍         | 15036/371472 [1:11:27<32:10:39,  3.08it/s]
  4%|▍         | 15037/371472 [1:11:27<31:01:55,  3.19it/s]
  4%|▍         | 15038/371472 [1:11:27<29:49:13,  3.32it/s]
  4%|▍         | 15039/371472 [1:11:28<28:39:44,  3.45it/s]
  4%|▍         | 15040/371472 [1:11:28<29:30:26,  3.36it/s]
                                                           
{'loss': 4.4504, 'learning_rate': 9.640263741946604e-07, 'epoch': 0.65}

  4%|▍         | 15040/371472 [1:11:28<29:30:26,  3.36it/s]
  4%|▍         | 15041/371472 [1:11:28<28:29:47,  3.47it/s]
  4%|▍         | 15042/371472 [1:11:28<28:42:10,  3.45it/s]
  4%|▍         | 15043/371472 [1:11:29<28:48:23,  3.44it/s]
  4%|▍         | 15044/371472 [1:11:29<27:43:09,  3.57it/s]
  4%|▍         | 15045/371472 [1:11:29<26:57:13,  3.67it/s]
  4%|▍         | 15046/371472 [1:11:30<27:00:16,  3.67it/s]
  4%|▍         | 15047/371472 [1:11:30<26:44:11,  3.70it/s]
  4%|▍         | 15048/371472 [1:11:30<25:44:24,  3.85it/s]
  4%|▍         | 15049/371472 [1:11:30<27:26:38,  3.61it/s]
  4%|▍         | 15050/371472 [1:11:31<27:29:47,  3.60it/s]
  4%|▍         | 15051/371472 [1:11:31<27:48:51,  3.56it/s]
  4%|▍         | 15052/371472 [1:11:31<28:31:40,  3.47it/s]
  4%|▍         | 15053/371472 [1:11:32<29:59:00,  3.30it/s]
  4%|▍         | 15054/371472 [1:11:32<29:53:14,  3.31it/s]
  4%|▍         | 15055/371472 [1:11:32<29:45:26,  3.33it/s]
  4%|▍         | 15056/371472 [1:11:32<28:07:06,  3.52it/s]
  4%|▍         | 15057/371472 [1:11:33<28:37:27,  3.46it/s]
  4%|▍         | 15058/371472 [1:11:33<27:55:20,  3.55it/s]
  4%|▍         | 15059/371472 [1:11:33<28:05:16,  3.52it/s]
  4%|▍         | 15060/371472 [1:11:34<27:55:53,  3.54it/s]
                                                           
{'loss': 4.6223, 'learning_rate': 9.639778922191815e-07, 'epoch': 0.65}

  4%|▍         | 15060/371472 [1:11:34<27:55:53,  3.54it/s]
  4%|▍         | 15061/371472 [1:11:34<27:30:15,  3.60it/s]
  4%|▍         | 15062/371472 [1:11:34<28:03:37,  3.53it/s]
  4%|▍         | 15063/371472 [1:11:34<28:22:19,  3.49it/s]
  4%|▍         | 15064/371472 [1:11:35<29:37:38,  3.34it/s]
  4%|▍         | 15065/371472 [1:11:35<28:24:34,  3.48it/s]
  4%|▍         | 15066/371472 [1:11:35<30:24:49,  3.26it/s]
  4%|▍         | 15067/371472 [1:11:36<29:54:49,  3.31it/s]
  4%|▍         | 15068/371472 [1:11:36<29:11:34,  3.39it/s]
  4%|▍         | 15069/371472 [1:11:36<29:27:40,  3.36it/s]
  4%|▍         | 15070/371472 [1:11:36<28:43:00,  3.45it/s]
  4%|▍         | 15071/371472 [1:11:37<26:59:29,  3.67it/s]
  4%|▍         | 15072/371472 [1:11:37<26:51:14,  3.69it/s]
  4%|▍         | 15073/371472 [1:11:37<27:45:11,  3.57it/s]
  4%|▍         | 15074/371472 [1:11:38<27:11:52,  3.64it/s]
  4%|▍         | 15075/371472 [1:11:38<26:53:08,  3.68it/s]
  4%|▍         | 15076/371472 [1:11:38<27:07:12,  3.65it/s]
  4%|▍         | 15077/371472 [1:11:38<28:42:39,  3.45it/s]
  4%|▍         | 15078/371472 [1:11:39<30:10:30,  3.28it/s]
  4%|▍         | 15079/371472 [1:11:39<29:35:08,  3.35it/s]
  4%|▍         | 15080/371472 [1:11:39<28:31:48,  3.47it/s]
                                                           
{'loss': 4.5445, 'learning_rate': 9.639294102437028e-07, 'epoch': 0.65}

  4%|▍         | 15080/371472 [1:11:39<28:31:48,  3.47it/s]
  4%|▍         | 15081/371472 [1:11:40<30:08:31,  3.28it/s]
  4%|▍         | 15082/371472 [1:11:40<31:14:23,  3.17it/s]
  4%|▍         | 15083/371472 [1:11:40<30:16:15,  3.27it/s]
  4%|▍         | 15084/371472 [1:11:40<28:55:45,  3.42it/s]
  4%|▍         | 15085/371472 [1:11:41<28:31:15,  3.47it/s]
  4%|▍         | 15086/371472 [1:11:41<28:03:41,  3.53it/s]
  4%|▍         | 15087/371472 [1:11:41<28:34:05,  3.47it/s]
  4%|▍         | 15088/371472 [1:11:42<27:14:59,  3.63it/s]
  4%|▍         | 15089/371472 [1:11:42<26:00:40,  3.81it/s]
  4%|▍         | 15090/371472 [1:11:42<27:29:40,  3.60it/s]
  4%|▍         | 15091/371472 [1:11:43<30:27:49,  3.25it/s]
  4%|▍         | 15092/371472 [1:11:43<28:45:54,  3.44it/s]
  4%|▍         | 15093/371472 [1:11:43<27:36:45,  3.59it/s]
  4%|▍         | 15094/371472 [1:11:43<27:54:57,  3.55it/s]
  4%|▍         | 15095/371472 [1:11:44<27:06:40,  3.65it/s]
  4%|▍         | 15096/371472 [1:11:44<27:53:36,  3.55it/s]
  4%|▍         | 15097/371472 [1:11:44<28:40:18,  3.45it/s]
  4%|▍         | 15098/371472 [1:11:44<28:13:31,  3.51it/s]
  4%|▍         | 15099/371472 [1:11:45<28:33:04,  3.47it/s]
  4%|▍         | 15100/371472 [1:11:45<27:29:57,  3.60it/s]
                                                           
{'loss': 4.714, 'learning_rate': 9.638809282682238e-07, 'epoch': 0.65}

  4%|▍         | 15100/371472 [1:11:45<27:29:57,  3.60it/s]
  4%|▍         | 15101/371472 [1:11:45<27:09:00,  3.65it/s]
  4%|▍         | 15102/371472 [1:11:46<27:31:53,  3.60it/s]
  4%|▍         | 15103/371472 [1:11:46<28:15:26,  3.50it/s]
  4%|▍         | 15104/371472 [1:11:46<27:11:28,  3.64it/s]
  4%|▍         | 15105/371472 [1:11:46<27:39:04,  3.58it/s]
  4%|▍         | 15106/371472 [1:11:47<26:27:11,  3.74it/s]
  4%|▍         | 15107/371472 [1:11:47<26:49:16,  3.69it/s]
  4%|▍         | 15108/371472 [1:11:47<27:03:58,  3.66it/s]
  4%|▍         | 15109/371472 [1:11:47<27:23:29,  3.61it/s]
  4%|▍         | 15110/371472 [1:11:48<28:40:53,  3.45it/s]
  4%|▍         | 15111/371472 [1:11:48<29:11:49,  3.39it/s]
  4%|▍         | 15112/371472 [1:11:48<28:58:14,  3.42it/s]
  4%|▍         | 15113/371472 [1:11:49<28:27:06,  3.48it/s]
  4%|▍         | 15114/371472 [1:11:49<27:23:09,  3.61it/s]
  4%|▍         | 15115/371472 [1:11:49<28:19:24,  3.49it/s]
  4%|▍         | 15116/371472 [1:11:50<28:35:24,  3.46it/s]
  4%|▍         | 15117/371472 [1:11:50<27:29:17,  3.60it/s]
  4%|▍         | 15118/371472 [1:11:50<27:16:16,  3.63it/s]
  4%|▍         | 15119/371472 [1:11:50<27:41:25,  3.57it/s]
  4%|▍         | 15120/371472 [1:11:51<27:33:21,  3.59it/s]
                                                           
{'loss': 4.5464, 'learning_rate': 9.63832446292745e-07, 'epoch': 0.65}

  4%|▍         | 15120/371472 [1:11:51<27:33:21,  3.59it/s]
  4%|▍         | 15121/371472 [1:11:51<27:53:48,  3.55it/s]
  4%|▍         | 15122/371472 [1:11:51<28:54:32,  3.42it/s]
  4%|▍         | 15123/371472 [1:11:51<27:32:42,  3.59it/s]
  4%|▍         | 15124/371472 [1:11:52<30:18:01,  3.27it/s]
  4%|▍         | 15125/371472 [1:11:52<30:19:33,  3.26it/s]
  4%|▍         | 15126/371472 [1:11:53<32:04:34,  3.09it/s]
  4%|▍         | 15127/371472 [1:11:53<30:26:52,  3.25it/s]
  4%|▍         | 15128/371472 [1:11:53<29:18:40,  3.38it/s]
  4%|▍         | 15129/371472 [1:11:53<28:02:43,  3.53it/s]
  4%|▍         | 15130/371472 [1:11:54<26:43:39,  3.70it/s]
  4%|▍         | 15131/371472 [1:11:54<26:30:23,  3.73it/s]
  4%|▍         | 15132/371472 [1:11:54<28:31:52,  3.47it/s]
  4%|▍         | 15133/371472 [1:11:54<28:30:28,  3.47it/s]
  4%|▍         | 15134/371472 [1:11:55<28:47:02,  3.44it/s]
  4%|▍         | 15135/371472 [1:11:55<28:26:03,  3.48it/s]
  4%|▍         | 15136/371472 [1:11:55<29:22:11,  3.37it/s]
  4%|▍         | 15137/371472 [1:11:56<28:11:20,  3.51it/s]
  4%|▍         | 15138/371472 [1:11:56<27:22:48,  3.62it/s]
  4%|▍         | 15139/371472 [1:11:56<34:08:53,  2.90it/s]
  4%|▍         | 15140/371472 [1:11:57<32:28:25,  3.05it/s]
                                                           
{'loss': 4.266, 'learning_rate': 9.637839643172662e-07, 'epoch': 0.65}

  4%|▍         | 15140/371472 [1:11:57<32:28:25,  3.05it/s]
  4%|▍         | 15141/371472 [1:11:57<32:01:00,  3.09it/s]
  4%|▍         | 15142/371472 [1:11:57<30:05:29,  3.29it/s]
  4%|▍         | 15143/371472 [1:11:57<28:15:30,  3.50it/s]
  4%|▍         | 15144/371472 [1:11:58<27:58:30,  3.54it/s]
  4%|▍         | 15145/371472 [1:11:58<28:06:23,  3.52it/s]
  4%|▍         | 15146/371472 [1:11:58<28:59:29,  3.41it/s]
  4%|▍         | 15147/371472 [1:11:59<29:10:48,  3.39it/s]
  4%|▍         | 15148/371472 [1:11:59<28:19:08,  3.50it/s]
  4%|▍         | 15149/371472 [1:11:59<29:55:27,  3.31it/s]
  4%|▍         | 15150/371472 [1:11:59<29:07:22,  3.40it/s]
  4%|▍         | 15151/371472 [1:12:00<28:54:23,  3.42it/s]
  4%|▍         | 15152/371472 [1:12:00<27:42:28,  3.57it/s]
  4%|▍         | 15153/371472 [1:12:00<26:59:41,  3.67it/s]
  4%|▍         | 15154/371472 [1:12:01<28:43:05,  3.45it/s]
  4%|▍         | 15155/371472 [1:12:01<28:24:18,  3.48it/s]
  4%|▍         | 15156/371472 [1:12:01<27:58:55,  3.54it/s]
  4%|▍         | 15157/371472 [1:12:01<27:25:30,  3.61it/s]
  4%|▍         | 15158/371472 [1:12:02<28:14:54,  3.50it/s]
  4%|▍         | 15159/371472 [1:12:02<27:13:38,  3.64it/s]
  4%|▍         | 15160/371472 [1:12:02<29:37:04,  3.34it/s]
                                                           
{'loss': 4.7638, 'learning_rate': 9.63735482341787e-07, 'epoch': 0.65}

  4%|▍         | 15160/371472 [1:12:02<29:37:04,  3.34it/s]
  4%|▍         | 15161/371472 [1:12:03<29:22:32,  3.37it/s]
  4%|▍         | 15162/371472 [1:12:03<28:30:25,  3.47it/s]
  4%|▍         | 15163/371472 [1:12:03<28:30:53,  3.47it/s]
  4%|▍         | 15164/371472 [1:12:03<28:13:37,  3.51it/s]
  4%|▍         | 15165/371472 [1:12:04<28:17:17,  3.50it/s]
  4%|▍         | 15166/371472 [1:12:04<27:32:48,  3.59it/s]
  4%|▍         | 15167/371472 [1:12:04<27:17:08,  3.63it/s]
  4%|▍         | 15168/371472 [1:12:05<28:43:54,  3.44it/s]
  4%|▍         | 15169/371472 [1:12:05<29:40:43,  3.33it/s]
  4%|▍         | 15170/371472 [1:12:05<28:32:34,  3.47it/s]
  4%|▍         | 15171/371472 [1:12:05<27:12:16,  3.64it/s]
  4%|▍         | 15172/371472 [1:12:06<27:20:31,  3.62it/s]
  4%|▍         | 15173/371472 [1:12:06<27:02:15,  3.66it/s]
  4%|▍         | 15174/371472 [1:12:06<27:05:29,  3.65it/s]
  4%|▍         | 15175/371472 [1:12:07<27:07:01,  3.65it/s]
  4%|▍         | 15176/371472 [1:12:07<26:49:58,  3.69it/s]
  4%|▍         | 15177/371472 [1:12:07<27:16:14,  3.63it/s]
  4%|▍         | 15178/371472 [1:12:07<26:22:26,  3.75it/s]
  4%|▍         | 15179/371472 [1:12:08<26:42:05,  3.71it/s]
  4%|▍         | 15180/371472 [1:12:08<26:39:50,  3.71it/s]
                                                           
{'loss': 4.6303, 'learning_rate': 9.636870003663083e-07, 'epoch': 0.65}

  4%|▍         | 15180/371472 [1:12:08<26:39:50,  3.71it/s]
  4%|▍         | 15181/371472 [1:12:08<26:49:33,  3.69it/s]
  4%|▍         | 15182/371472 [1:12:08<26:24:17,  3.75it/s]
  4%|▍         | 15183/371472 [1:12:09<29:21:56,  3.37it/s]
  4%|▍         | 15184/371472 [1:12:09<29:23:47,  3.37it/s]
  4%|▍         | 15185/371472 [1:12:09<29:08:12,  3.40it/s]
  4%|▍         | 15186/371472 [1:12:10<29:20:14,  3.37it/s]
  4%|▍         | 15187/371472 [1:12:10<28:00:53,  3.53it/s]
  4%|▍         | 15188/371472 [1:12:10<28:39:23,  3.45it/s]
  4%|▍         | 15189/371472 [1:12:11<29:19:52,  3.37it/s]
  4%|▍         | 15190/371472 [1:12:11<28:02:28,  3.53it/s]
  4%|▍         | 15191/371472 [1:12:11<29:32:52,  3.35it/s]
  4%|▍         | 15192/371472 [1:12:11<29:38:02,  3.34it/s]
  4%|▍         | 15193/371472 [1:12:12<30:56:35,  3.20it/s]
  4%|▍         | 15194/371472 [1:12:12<30:10:18,  3.28it/s]
  4%|▍         | 15195/371472 [1:12:12<29:39:39,  3.34it/s]
  4%|▍         | 15196/371472 [1:12:13<28:51:38,  3.43it/s]
  4%|▍         | 15197/371472 [1:12:13<27:50:55,  3.55it/s]
  4%|▍         | 15198/371472 [1:12:13<27:04:28,  3.66it/s]
  4%|▍         | 15199/371472 [1:12:13<28:14:48,  3.50it/s]
  4%|▍         | 15200/371472 [1:12:14<28:50:26,  3.43it/s]
                                                           
{'loss': 4.7192, 'learning_rate': 9.636385183908292e-07, 'epoch': 0.65}

  4%|▍         | 15200/371472 [1:12:14<28:50:26,  3.43it/s]
  4%|▍         | 15201/371472 [1:12:14<28:38:38,  3.45it/s]
  4%|▍         | 15202/371472 [1:12:14<28:05:34,  3.52it/s]
  4%|▍         | 15203/371472 [1:12:15<28:14:19,  3.50it/s]
  4%|▍         | 15204/371472 [1:12:15<27:35:13,  3.59it/s]
  4%|▍         | 15205/371472 [1:12:15<30:34:57,  3.24it/s]
  4%|▍         | 15206/371472 [1:12:15<28:55:48,  3.42it/s]
  4%|▍         | 15207/371472 [1:12:16<29:11:17,  3.39it/s]
  4%|▍         | 15208/371472 [1:12:16<29:54:53,  3.31it/s]
  4%|▍         | 15209/371472 [1:12:16<28:53:32,  3.43it/s]
  4%|▍         | 15210/371472 [1:12:17<28:38:31,  3.46it/s]
  4%|▍         | 15211/371472 [1:12:17<28:20:23,  3.49it/s]
  4%|▍         | 15212/371472 [1:12:17<28:08:35,  3.52it/s]
  4%|▍         | 15213/371472 [1:12:18<28:13:01,  3.51it/s]
  4%|▍         | 15214/371472 [1:12:18<27:40:49,  3.58it/s]
  4%|▍         | 15215/371472 [1:12:18<29:03:19,  3.41it/s]
  4%|▍         | 15216/371472 [1:12:18<29:03:13,  3.41it/s]
  4%|▍         | 15217/371472 [1:12:19<28:27:43,  3.48it/s]
  4%|▍         | 15218/371472 [1:12:19<27:49:30,  3.56it/s]
  4%|▍         | 15219/371472 [1:12:19<27:16:08,  3.63it/s]
  4%|▍         | 15220/371472 [1:12:20<29:51:31,  3.31it/s]
                                                           
{'loss': 4.4276, 'learning_rate': 9.635900364153505e-07, 'epoch': 0.66}

  4%|▍         | 15220/371472 [1:12:20<29:51:31,  3.31it/s]
  4%|▍         | 15221/371472 [1:12:20<28:47:19,  3.44it/s]
  4%|▍         | 15222/371472 [1:12:20<27:40:40,  3.58it/s]
  4%|▍         | 15223/371472 [1:12:20<27:22:52,  3.61it/s]
  4%|▍         | 15224/371472 [1:12:21<26:34:28,  3.72it/s]
  4%|▍         | 15225/371472 [1:12:21<26:54:28,  3.68it/s]
  4%|▍         | 15226/371472 [1:12:21<28:06:13,  3.52it/s]
  4%|▍         | 15227/371472 [1:12:21<27:25:18,  3.61it/s]
  4%|▍         | 15228/371472 [1:12:22<27:52:02,  3.55it/s]
  4%|▍         | 15229/371472 [1:12:22<27:45:35,  3.56it/s]
  4%|▍         | 15230/371472 [1:12:22<26:44:58,  3.70it/s]
  4%|▍         | 15231/371472 [1:12:23<26:45:21,  3.70it/s]
  4%|▍         | 15232/371472 [1:12:23<26:26:28,  3.74it/s]
  4%|▍         | 15233/371472 [1:12:23<26:49:25,  3.69it/s]
  4%|▍         | 15234/371472 [1:12:23<27:49:17,  3.56it/s]
  4%|▍         | 15235/371472 [1:12:24<27:53:23,  3.55it/s]
  4%|▍         | 15236/371472 [1:12:24<28:53:55,  3.42it/s]
  4%|▍         | 15237/371472 [1:12:24<27:47:15,  3.56it/s]
  4%|▍         | 15238/371472 [1:12:24<26:51:13,  3.68it/s]
  4%|▍         | 15239/371472 [1:12:25<27:50:30,  3.55it/s]
  4%|▍         | 15240/371472 [1:12:25<27:06:55,  3.65it/s]
                                                           
{'loss': 4.6025, 'learning_rate': 9.635415544398716e-07, 'epoch': 0.66}

  4%|▍         | 15240/371472 [1:12:25<27:06:55,  3.65it/s]
  4%|▍         | 15241/371472 [1:12:25<26:12:54,  3.77it/s]
  4%|▍         | 15242/371472 [1:12:26<27:56:53,  3.54it/s]
  4%|▍         | 15243/371472 [1:12:26<27:18:08,  3.62it/s]
  4%|▍         | 15244/371472 [1:12:26<26:53:18,  3.68it/s]
  4%|▍         | 15245/371472 [1:12:26<27:41:12,  3.57it/s]
  4%|▍         | 15246/371472 [1:12:27<27:29:46,  3.60it/s]
  4%|▍         | 15247/371472 [1:12:27<27:01:02,  3.66it/s]
  4%|▍         | 15248/371472 [1:12:27<28:31:34,  3.47it/s]
  4%|▍         | 15249/371472 [1:12:28<28:34:58,  3.46it/s]
  4%|▍         | 15250/371472 [1:12:28<28:07:03,  3.52it/s]
  4%|▍         | 15251/371472 [1:12:28<28:13:04,  3.51it/s]
  4%|▍         | 15252/371472 [1:12:28<28:51:34,  3.43it/s]
  4%|▍         | 15253/371472 [1:12:29<27:28:39,  3.60it/s]
  4%|▍         | 15254/371472 [1:12:29<27:21:35,  3.62it/s]
  4%|▍         | 15255/371472 [1:12:29<27:18:27,  3.62it/s]
  4%|▍         | 15256/371472 [1:12:30<27:11:03,  3.64it/s]
  4%|▍         | 15257/371472 [1:12:30<28:09:08,  3.51it/s]
  4%|▍         | 15258/371472 [1:12:30<28:48:40,  3.43it/s]
  4%|▍         | 15259/371472 [1:12:30<28:30:04,  3.47it/s]
  4%|▍         | 15260/371472 [1:12:31<30:15:07,  3.27it/s]
                                                           
{'loss': 4.6005, 'learning_rate': 9.634930724643926e-07, 'epoch': 0.66}

  4%|▍         | 15260/371472 [1:12:31<30:15:07,  3.27it/s]
  4%|▍         | 15261/371472 [1:12:31<30:41:45,  3.22it/s]
  4%|▍         | 15262/371472 [1:12:32<34:12:02,  2.89it/s]
  4%|▍         | 15263/371472 [1:12:32<32:04:53,  3.08it/s]
  4%|▍         | 15264/371472 [1:12:32<29:58:28,  3.30it/s]
  4%|▍         | 15265/371472 [1:12:32<31:17:49,  3.16it/s]
  4%|▍         | 15266/371472 [1:12:33<29:56:53,  3.30it/s]
  4%|▍         | 15267/371472 [1:12:33<28:11:19,  3.51it/s]
  4%|▍         | 15268/371472 [1:12:33<27:08:23,  3.65it/s]
  4%|▍         | 15269/371472 [1:12:33<26:32:12,  3.73it/s]
  4%|▍         | 15270/371472 [1:12:34<25:57:26,  3.81it/s]
  4%|▍         | 15271/371472 [1:12:34<25:55:58,  3.82it/s]
  4%|▍         | 15272/371472 [1:12:34<27:41:50,  3.57it/s]
  4%|▍         | 15273/371472 [1:12:35<27:42:21,  3.57it/s]
  4%|▍         | 15274/371472 [1:12:35<27:27:07,  3.60it/s]
  4%|▍         | 15275/371472 [1:12:35<27:07:13,  3.65it/s]
  4%|▍         | 15276/371472 [1:12:35<26:26:00,  3.74it/s]
  4%|▍         | 15277/371472 [1:12:36<26:59:53,  3.66it/s]
  4%|▍         | 15278/371472 [1:12:36<26:55:19,  3.68it/s]
  4%|▍         | 15279/371472 [1:12:36<27:19:38,  3.62it/s]
  4%|▍         | 15280/371472 [1:12:36<27:00:42,  3.66it/s]
                                                           
{'loss': 4.6788, 'learning_rate': 9.634445904889137e-07, 'epoch': 0.66}

  4%|▍         | 15280/371472 [1:12:36<27:00:42,  3.66it/s]
  4%|▍         | 15281/371472 [1:12:37<27:32:40,  3.59it/s]
  4%|▍         | 15282/371472 [1:12:37<28:27:48,  3.48it/s]
  4%|▍         | 15283/371472 [1:12:37<30:10:46,  3.28it/s]
  4%|▍         | 15284/371472 [1:12:38<28:41:28,  3.45it/s]
  4%|▍         | 15285/371472 [1:12:38<28:22:41,  3.49it/s]
  4%|▍         | 15286/371472 [1:12:38<28:11:34,  3.51it/s]
  4%|▍         | 15287/371472 [1:12:38<28:10:42,  3.51it/s]
  4%|▍         | 15288/371472 [1:12:39<29:57:23,  3.30it/s]
  4%|▍         | 15289/371472 [1:12:39<28:34:58,  3.46it/s]
  4%|▍         | 15290/371472 [1:12:39<28:06:34,  3.52it/s]
  4%|▍         | 15291/371472 [1:12:40<26:55:56,  3.67it/s]
  4%|▍         | 15292/371472 [1:12:40<27:21:31,  3.62it/s]
  4%|▍         | 15293/371472 [1:12:40<27:50:35,  3.55it/s]
  4%|▍         | 15294/371472 [1:12:40<28:05:57,  3.52it/s]
  4%|▍         | 15295/371472 [1:12:41<27:23:57,  3.61it/s]
  4%|▍         | 15296/371472 [1:12:41<27:28:55,  3.60it/s]
  4%|▍         | 15297/371472 [1:12:41<27:03:32,  3.66it/s]
  4%|▍         | 15298/371472 [1:12:41<26:15:34,  3.77it/s]
  4%|▍         | 15299/371472 [1:12:42<27:14:12,  3.63it/s]
  4%|▍         | 15300/371472 [1:12:42<26:47:42,  3.69it/s]
                                                           
{'loss': 4.5772, 'learning_rate': 9.633961085134348e-07, 'epoch': 0.66}

  4%|▍         | 15300/371472 [1:12:42<26:47:42,  3.69it/s]
  4%|▍         | 15301/371472 [1:12:42<29:43:38,  3.33it/s]
  4%|▍         | 15302/371472 [1:12:43<31:06:44,  3.18it/s]
  4%|▍         | 15303/371472 [1:12:43<31:30:04,  3.14it/s]
  4%|▍         | 15304/371472 [1:12:43<30:15:09,  3.27it/s]
  4%|▍         | 15305/371472 [1:12:44<29:28:15,  3.36it/s]
  4%|▍         | 15306/371472 [1:12:44<28:20:56,  3.49it/s]
  4%|▍         | 15307/371472 [1:12:44<27:44:26,  3.57it/s]
  4%|▍         | 15308/371472 [1:12:44<28:35:13,  3.46it/s]
  4%|▍         | 15309/371472 [1:12:45<27:13:38,  3.63it/s]
  4%|▍         | 15310/371472 [1:12:45<27:32:58,  3.59it/s]
  4%|▍         | 15311/371472 [1:12:45<27:18:30,  3.62it/s]
  4%|▍         | 15312/371472 [1:12:46<27:41:58,  3.57it/s]
  4%|▍         | 15313/371472 [1:12:46<26:35:26,  3.72it/s]
  4%|▍         | 15314/371472 [1:12:46<26:20:55,  3.75it/s]
  4%|▍         | 15315/371472 [1:12:46<28:22:05,  3.49it/s]
  4%|▍         | 15316/371472 [1:12:47<28:17:59,  3.50it/s]
  4%|▍         | 15317/371472 [1:12:47<32:12:44,  3.07it/s]
  4%|▍         | 15318/371472 [1:12:47<31:14:15,  3.17it/s]
  4%|▍         | 15319/371472 [1:12:48<29:36:43,  3.34it/s]
  4%|▍         | 15320/371472 [1:12:48<28:36:41,  3.46it/s]
                                                           
{'loss': 4.7873, 'learning_rate': 9.63347626537956e-07, 'epoch': 0.66}

  4%|▍         | 15320/371472 [1:12:48<28:36:41,  3.46it/s]
  4%|▍         | 15321/371472 [1:12:48<28:23:00,  3.49it/s]
  4%|▍         | 15322/371472 [1:12:49<28:33:39,  3.46it/s]
  4%|▍         | 15323/371472 [1:12:49<28:56:15,  3.42it/s]
  4%|▍         | 15324/371472 [1:12:49<27:41:50,  3.57it/s]
  4%|▍         | 15325/371472 [1:12:49<27:40:48,  3.57it/s]
  4%|▍         | 15326/371472 [1:12:50<26:57:27,  3.67it/s]
  4%|▍         | 15327/371472 [1:12:50<28:06:17,  3.52it/s]
  4%|▍         | 15328/371472 [1:12:50<26:37:14,  3.72it/s]
  4%|▍         | 15329/371472 [1:12:50<26:15:33,  3.77it/s]
  4%|▍         | 15330/371472 [1:12:51<26:35:27,  3.72it/s]
  4%|▍         | 15331/371472 [1:12:51<26:02:37,  3.80it/s]
  4%|▍         | 15332/371472 [1:12:51<25:58:52,  3.81it/s]
  4%|▍         | 15333/371472 [1:12:51<27:06:11,  3.65it/s]
  4%|▍         | 15334/371472 [1:12:52<26:27:09,  3.74it/s]
  4%|▍         | 15335/371472 [1:12:52<27:58:20,  3.54it/s]
  4%|▍         | 15336/371472 [1:12:52<29:34:22,  3.35it/s]
  4%|▍         | 15337/371472 [1:12:53<28:23:57,  3.48it/s]
  4%|▍         | 15338/371472 [1:12:53<27:49:47,  3.55it/s]
  4%|▍         | 15339/371472 [1:12:53<26:58:40,  3.67it/s]
  4%|▍         | 15340/371472 [1:12:53<27:03:29,  3.66it/s]
                                                           
{'loss': 4.7228, 'learning_rate': 9.63299144562477e-07, 'epoch': 0.66}

  4%|▍         | 15340/371472 [1:12:53<27:03:29,  3.66it/s]
  4%|▍         | 15341/371472 [1:12:54<27:33:51,  3.59it/s]
  4%|▍         | 15342/371472 [1:12:54<30:21:33,  3.26it/s]
  4%|▍         | 15343/371472 [1:12:54<30:01:27,  3.29it/s]
  4%|▍         | 15344/371472 [1:12:55<30:28:50,  3.25it/s]
  4%|▍         | 15345/371472 [1:12:55<29:18:04,  3.38it/s]
  4%|▍         | 15346/371472 [1:12:55<27:59:45,  3.53it/s]
  4%|▍         | 15347/371472 [1:12:55<27:09:22,  3.64it/s]
  4%|▍         | 15348/371472 [1:12:56<27:04:22,  3.65it/s]
  4%|▍         | 15349/371472 [1:12:56<28:54:16,  3.42it/s]
  4%|▍         | 15350/371472 [1:12:56<28:13:45,  3.50it/s]
  4%|▍         | 15351/371472 [1:12:57<29:38:48,  3.34it/s]
  4%|▍         | 15352/371472 [1:12:57<28:19:57,  3.49it/s]
  4%|▍         | 15353/371472 [1:12:57<29:43:31,  3.33it/s]
  4%|▍         | 15354/371472 [1:12:58<30:21:47,  3.26it/s]
  4%|▍         | 15355/371472 [1:12:58<30:51:20,  3.21it/s]
  4%|▍         | 15356/371472 [1:12:58<29:14:27,  3.38it/s]
  4%|▍         | 15357/371472 [1:12:58<29:05:41,  3.40it/s]
  4%|▍         | 15358/371472 [1:12:59<29:43:39,  3.33it/s]
  4%|▍         | 15359/371472 [1:12:59<29:28:41,  3.36it/s]
  4%|▍         | 15360/371472 [1:12:59<29:40:18,  3.33it/s]
                                                           
{'loss': 4.5213, 'learning_rate': 9.632506625869982e-07, 'epoch': 0.66}

  4%|▍         | 15360/371472 [1:12:59<29:40:18,  3.33it/s]
  4%|▍         | 15361/371472 [1:13:00<30:51:13,  3.21it/s]
  4%|▍         | 15362/371472 [1:13:00<29:15:13,  3.38it/s]
  4%|▍         | 15363/371472 [1:13:00<27:49:06,  3.56it/s]
  4%|▍         | 15364/371472 [1:13:01<28:03:26,  3.53it/s]
  4%|▍         | 15365/371472 [1:13:01<27:12:40,  3.64it/s]
  4%|▍         | 15366/371472 [1:13:01<27:07:07,  3.65it/s]
  4%|▍         | 15367/371472 [1:13:01<26:28:48,  3.74it/s]
  4%|▍         | 15368/371472 [1:13:02<26:22:42,  3.75it/s]
  4%|▍         | 15369/371472 [1:13:02<26:29:12,  3.73it/s]
  4%|▍         | 15370/371472 [1:13:02<28:55:51,  3.42it/s]
  4%|▍         | 15371/371472 [1:13:02<28:00:08,  3.53it/s]
  4%|▍         | 15372/371472 [1:13:03<26:54:01,  3.68it/s]
  4%|▍         | 15373/371472 [1:13:03<26:39:55,  3.71it/s]
  4%|▍         | 15374/371472 [1:13:03<27:48:00,  3.56it/s]
  4%|▍         | 15375/371472 [1:13:04<30:01:11,  3.30it/s]
  4%|▍         | 15376/371472 [1:13:04<29:21:59,  3.37it/s]
  4%|▍         | 15377/371472 [1:13:04<30:52:31,  3.20it/s]
  4%|▍         | 15378/371472 [1:13:05<28:48:22,  3.43it/s]
  4%|▍         | 15379/371472 [1:13:05<27:25:11,  3.61it/s]
  4%|▍         | 15380/371472 [1:13:05<27:49:42,  3.55it/s]
                                                           
{'loss': 4.7668, 'learning_rate': 9.632021806115193e-07, 'epoch': 0.66}

  4%|▍         | 15380/371472 [1:13:05<27:49:42,  3.55it/s]
  4%|▍         | 15381/371472 [1:13:05<32:49:19,  3.01it/s]
  4%|▍         | 15382/371472 [1:13:06<31:21:11,  3.15it/s]
  4%|▍         | 15383/371472 [1:13:06<31:02:15,  3.19it/s]
  4%|▍         | 15384/371472 [1:13:06<30:02:05,  3.29it/s]
  4%|▍         | 15385/371472 [1:13:07<30:51:36,  3.21it/s]
  4%|▍         | 15386/371472 [1:13:07<29:07:54,  3.40it/s]
  4%|▍         | 15387/371472 [1:13:07<27:31:42,  3.59it/s]
  4%|▍         | 15388/371472 [1:13:07<27:12:19,  3.64it/s]
  4%|▍         | 15389/371472 [1:13:08<28:27:44,  3.48it/s]
  4%|▍         | 15390/371472 [1:13:08<27:36:52,  3.58it/s]
  4%|▍         | 15391/371472 [1:13:08<27:49:18,  3.56it/s]
  4%|▍         | 15392/371472 [1:13:09<27:48:21,  3.56it/s]
  4%|▍         | 15393/371472 [1:13:09<28:07:54,  3.52it/s]
  4%|▍         | 15394/371472 [1:13:09<27:13:14,  3.63it/s]
  4%|▍         | 15395/371472 [1:13:09<27:57:01,  3.54it/s]
  4%|▍         | 15396/371472 [1:13:10<27:05:23,  3.65it/s]
  4%|▍         | 15397/371472 [1:13:10<27:18:33,  3.62it/s]
  4%|▍         | 15398/371472 [1:13:10<26:46:27,  3.69it/s]
  4%|▍         | 15399/371472 [1:13:11<27:39:55,  3.58it/s]
  4%|▍         | 15400/371472 [1:13:11<26:43:43,  3.70it/s]
                                                           
{'loss': 4.6066, 'learning_rate': 9.631536986360403e-07, 'epoch': 0.66}

  4%|▍         | 15400/371472 [1:13:11<26:43:43,  3.70it/s]
  4%|▍         | 15401/371472 [1:13:11<26:15:15,  3.77it/s]
  4%|▍         | 15402/371472 [1:13:11<26:47:15,  3.69it/s]
  4%|▍         | 15403/371472 [1:13:12<30:34:03,  3.24it/s]
  4%|▍         | 15404/371472 [1:13:12<29:30:49,  3.35it/s]
  4%|▍         | 15405/371472 [1:13:12<29:52:02,  3.31it/s]
  4%|▍         | 15406/371472 [1:13:13<28:55:53,  3.42it/s]
  4%|▍         | 15407/371472 [1:13:13<27:46:15,  3.56it/s]
  4%|▍         | 15408/371472 [1:13:13<29:04:38,  3.40it/s]
  4%|▍         | 15409/371472 [1:13:13<29:59:21,  3.30it/s]
  4%|▍         | 15410/371472 [1:13:14<28:52:46,  3.42it/s]
  4%|▍         | 15411/371472 [1:13:14<30:12:38,  3.27it/s]
  4%|▍         | 15412/371472 [1:13:14<31:18:15,  3.16it/s]
  4%|▍         | 15413/371472 [1:13:15<31:51:28,  3.10it/s]
  4%|▍         | 15414/371472 [1:13:15<31:30:27,  3.14it/s]
  4%|▍         | 15415/371472 [1:13:15<30:15:21,  3.27it/s]
  4%|▍         | 15416/371472 [1:13:16<29:15:27,  3.38it/s]
  4%|▍         | 15417/371472 [1:13:16<28:24:27,  3.48it/s]
  4%|▍         | 15418/371472 [1:13:16<28:25:00,  3.48it/s]
  4%|▍         | 15419/371472 [1:13:16<28:41:56,  3.45it/s]
  4%|▍         | 15420/371472 [1:13:17<28:26:48,  3.48it/s]
                                                           
{'loss': 4.642, 'learning_rate': 9.631052166605614e-07, 'epoch': 0.66}

  4%|▍         | 15420/371472 [1:13:17<28:26:48,  3.48it/s]
  4%|▍         | 15421/371472 [1:13:17<27:30:01,  3.60it/s]
  4%|▍         | 15422/371472 [1:13:17<26:38:35,  3.71it/s]
  4%|▍         | 15423/371472 [1:13:18<27:27:18,  3.60it/s]
  4%|▍         | 15424/371472 [1:13:18<27:13:47,  3.63it/s]
  4%|▍         | 15425/371472 [1:13:18<29:43:39,  3.33it/s]
  4%|▍         | 15426/371472 [1:13:18<28:50:24,  3.43it/s]
  4%|▍         | 15427/371472 [1:13:19<27:38:11,  3.58it/s]
  4%|▍         | 15428/371472 [1:13:19<26:46:15,  3.69it/s]
  4%|▍         | 15429/371472 [1:13:19<30:48:47,  3.21it/s]
  4%|▍         | 15430/371472 [1:13:20<29:54:43,  3.31it/s]
  4%|▍         | 15431/371472 [1:13:20<29:16:11,  3.38it/s]
  4%|▍         | 15432/371472 [1:13:20<30:32:56,  3.24it/s]
  4%|▍         | 15433/371472 [1:13:21<28:42:09,  3.45it/s]
  4%|▍         | 15434/371472 [1:13:21<27:21:10,  3.62it/s]
  4%|▍         | 15435/371472 [1:13:21<26:44:35,  3.70it/s]
  4%|▍         | 15436/371472 [1:13:21<26:03:13,  3.80it/s]
  4%|▍         | 15437/371472 [1:13:22<26:41:12,  3.71it/s]
  4%|▍         | 15438/371472 [1:13:22<27:28:18,  3.60it/s]
  4%|▍         | 15439/371472 [1:13:22<26:49:06,  3.69it/s]
  4%|▍         | 15440/371472 [1:13:22<27:23:49,  3.61it/s]
                                                           
{'loss': 4.5487, 'learning_rate': 9.630567346850825e-07, 'epoch': 0.67}

  4%|▍         | 15440/371472 [1:13:22<27:23:49,  3.61it/s]
  4%|▍         | 15441/371472 [1:13:23<28:01:49,  3.53it/s]
  4%|▍         | 15442/371472 [1:13:23<30:00:56,  3.29it/s]
  4%|▍         | 15443/371472 [1:13:23<28:09:00,  3.51it/s]
  4%|▍         | 15444/371472 [1:13:24<27:25:19,  3.61it/s]
  4%|▍         | 15445/371472 [1:13:24<28:06:42,  3.52it/s]
  4%|▍         | 15446/371472 [1:13:24<28:27:47,  3.47it/s]
  4%|▍         | 15447/371472 [1:13:24<27:21:06,  3.62it/s]
  4%|▍         | 15448/371472 [1:13:25<28:32:38,  3.46it/s]
  4%|▍         | 15449/371472 [1:13:25<28:48:13,  3.43it/s]
  4%|▍         | 15450/371472 [1:13:25<28:37:57,  3.45it/s]
  4%|▍         | 15451/371472 [1:13:26<28:25:37,  3.48it/s]
  4%|▍         | 15452/371472 [1:13:26<27:16:19,  3.63it/s]
  4%|▍         | 15453/371472 [1:13:26<27:29:35,  3.60it/s]
  4%|▍         | 15454/371472 [1:13:26<27:18:58,  3.62it/s]
  4%|▍         | 15455/371472 [1:13:27<27:02:04,  3.66it/s]
  4%|▍         | 15456/371472 [1:13:27<26:07:20,  3.79it/s]
  4%|▍         | 15457/371472 [1:13:27<25:49:49,  3.83it/s]
  4%|▍         | 15458/371472 [1:13:27<27:23:25,  3.61it/s]
  4%|▍         | 15459/371472 [1:13:28<26:36:17,  3.72it/s]
  4%|▍         | 15460/371472 [1:13:28<27:07:49,  3.65it/s]
                                                           
{'loss': 4.5664, 'learning_rate': 9.630082527096038e-07, 'epoch': 0.67}

  4%|▍         | 15460/371472 [1:13:28<27:07:49,  3.65it/s]
  4%|▍         | 15461/371472 [1:13:28<27:36:26,  3.58it/s]
  4%|▍         | 15462/371472 [1:13:29<27:20:43,  3.62it/s]
  4%|▍         | 15463/371472 [1:13:29<28:15:33,  3.50it/s]
  4%|▍         | 15464/371472 [1:13:29<29:37:53,  3.34it/s]
  4%|▍         | 15465/371472 [1:13:29<28:25:51,  3.48it/s]
  4%|▍         | 15466/371472 [1:13:30<28:50:41,  3.43it/s]
  4%|▍         | 15467/371472 [1:13:30<27:22:56,  3.61it/s]
  4%|▍         | 15468/371472 [1:13:30<26:48:23,  3.69it/s]
  4%|▍         | 15469/371472 [1:13:31<26:56:51,  3.67it/s]
  4%|▍         | 15470/371472 [1:13:31<26:16:56,  3.76it/s]
  4%|▍         | 15471/371472 [1:13:31<28:15:53,  3.50it/s]
  4%|▍         | 15472/371472 [1:13:31<27:10:46,  3.64it/s]
  4%|▍         | 15473/371472 [1:13:32<27:21:10,  3.62it/s]
  4%|▍         | 15474/371472 [1:13:32<28:52:57,  3.42it/s]
  4%|▍         | 15475/371472 [1:13:32<29:02:06,  3.41it/s]
  4%|▍         | 15476/371472 [1:13:33<29:10:51,  3.39it/s]
  4%|▍         | 15477/371472 [1:13:33<28:13:01,  3.50it/s]
  4%|▍         | 15478/371472 [1:13:33<27:29:23,  3.60it/s]
  4%|▍         | 15479/371472 [1:13:33<26:43:43,  3.70it/s]
  4%|▍         | 15480/371472 [1:13:34<28:22:47,  3.48it/s]
                                                           
{'loss': 4.5904, 'learning_rate': 9.629597707341248e-07, 'epoch': 0.67}

  4%|▍         | 15480/371472 [1:13:34<28:22:47,  3.48it/s]
  4%|▍         | 15481/371472 [1:13:34<27:42:19,  3.57it/s]
  4%|▍         | 15482/371472 [1:13:34<27:30:04,  3.60it/s]
  4%|▍         | 15483/371472 [1:13:34<28:06:08,  3.52it/s]
  4%|▍         | 15484/371472 [1:13:35<29:10:31,  3.39it/s]
  4%|▍         | 15485/371472 [1:13:35<27:33:26,  3.59it/s]
  4%|▍         | 15486/371472 [1:13:35<26:51:47,  3.68it/s]
  4%|▍         | 15487/371472 [1:13:36<26:20:14,  3.75it/s]
  4%|▍         | 15488/371472 [1:13:36<27:43:35,  3.57it/s]
  4%|▍         | 15489/371472 [1:13:36<28:02:10,  3.53it/s]
  4%|▍         | 15490/371472 [1:13:36<28:58:50,  3.41it/s]
  4%|▍         | 15491/371472 [1:13:37<29:24:48,  3.36it/s]
  4%|▍         | 15492/371472 [1:13:37<29:43:08,  3.33it/s]
  4%|▍         | 15493/371472 [1:13:37<29:39:37,  3.33it/s]
  4%|▍         | 15494/371472 [1:13:38<28:54:42,  3.42it/s]
  4%|▍         | 15495/371472 [1:13:38<28:47:25,  3.43it/s]
  4%|▍         | 15496/371472 [1:13:38<30:14:31,  3.27it/s]
  4%|▍         | 15497/371472 [1:13:39<28:54:50,  3.42it/s]
  4%|▍         | 15498/371472 [1:13:39<28:24:31,  3.48it/s]
  4%|▍         | 15499/371472 [1:13:39<27:24:35,  3.61it/s]
  4%|▍         | 15500/371472 [1:13:39<26:32:47,  3.72it/s]
                                                           
{'loss': 4.5054, 'learning_rate': 9.62911288758646e-07, 'epoch': 0.67}

  4%|▍         | 15500/371472 [1:13:39<26:32:47,  3.72it/s]
  4%|▍         | 15501/371472 [1:13:40<27:42:30,  3.57it/s]
  4%|▍         | 15502/371472 [1:13:40<27:22:52,  3.61it/s]
  4%|▍         | 15503/371472 [1:13:40<27:03:02,  3.66it/s]
  4%|▍         | 15504/371472 [1:13:40<26:57:14,  3.67it/s]
  4%|▍         | 15505/371472 [1:13:41<30:45:47,  3.21it/s]
  4%|▍         | 15506/371472 [1:13:41<29:50:28,  3.31it/s]
  4%|▍         | 15507/371472 [1:13:41<28:55:38,  3.42it/s]
  4%|▍         | 15508/371472 [1:13:42<30:04:19,  3.29it/s]
  4%|▍         | 15509/371472 [1:13:42<29:25:50,  3.36it/s]
  4%|▍         | 15510/371472 [1:13:42<28:57:58,  3.41it/s]
  4%|▍         | 15511/371472 [1:13:43<28:36:13,  3.46it/s]
  4%|▍         | 15512/371472 [1:13:43<28:25:59,  3.48it/s]
  4%|▍         | 15513/371472 [1:13:43<27:48:54,  3.55it/s]
  4%|▍         | 15514/371472 [1:13:43<26:56:55,  3.67it/s]
  4%|▍         | 15515/371472 [1:13:44<26:54:29,  3.67it/s]
  4%|▍         | 15516/371472 [1:13:44<25:54:01,  3.82it/s]
  4%|▍         | 15517/371472 [1:13:44<26:28:43,  3.73it/s]
  4%|▍         | 15518/371472 [1:13:44<27:34:25,  3.59it/s]
  4%|▍         | 15519/371472 [1:13:45<26:45:42,  3.69it/s]
  4%|▍         | 15520/371472 [1:13:45<26:47:53,  3.69it/s]
                                                           
{'loss': 4.6034, 'learning_rate': 9.628628067831672e-07, 'epoch': 0.67}

  4%|▍         | 15520/371472 [1:13:45<26:47:53,  3.69it/s]
  4%|▍         | 15521/371472 [1:13:45<27:36:27,  3.58it/s]
  4%|▍         | 15522/371472 [1:13:46<28:25:19,  3.48it/s]
  4%|▍         | 15523/371472 [1:13:46<30:35:11,  3.23it/s]
  4%|▍         | 15524/371472 [1:13:46<31:41:03,  3.12it/s]
  4%|▍         | 15525/371472 [1:13:47<31:59:05,  3.09it/s]
  4%|▍         | 15526/371472 [1:13:47<31:53:51,  3.10it/s]
  4%|▍         | 15527/371472 [1:13:47<30:06:56,  3.28it/s]
  4%|▍         | 15528/371472 [1:13:48<29:22:02,  3.37it/s]
  4%|▍         | 15529/371472 [1:13:48<29:36:11,  3.34it/s]
  4%|▍         | 15530/371472 [1:13:48<30:59:30,  3.19it/s]
  4%|▍         | 15531/371472 [1:13:48<30:56:46,  3.19it/s]
  4%|▍         | 15532/371472 [1:13:49<30:51:49,  3.20it/s]
  4%|▍         | 15533/371472 [1:13:49<31:18:35,  3.16it/s]
  4%|▍         | 15534/371472 [1:13:49<29:48:35,  3.32it/s]
  4%|▍         | 15535/371472 [1:13:50<28:57:46,  3.41it/s]
  4%|▍         | 15536/371472 [1:13:50<31:28:14,  3.14it/s]
  4%|▍         | 15537/371472 [1:13:50<30:55:01,  3.20it/s]
  4%|▍         | 15538/371472 [1:13:51<30:28:33,  3.24it/s]
  4%|▍         | 15539/371472 [1:13:51<31:04:36,  3.18it/s]
  4%|▍         | 15540/371472 [1:13:51<31:27:21,  3.14it/s]
                                                           
{'loss': 4.6439, 'learning_rate': 9.62814324807688e-07, 'epoch': 0.67}

  4%|▍         | 15540/371472 [1:13:51<31:27:21,  3.14it/s]
  4%|▍         | 15541/371472 [1:13:52<30:12:30,  3.27it/s]
  4%|▍         | 15542/371472 [1:13:52<29:21:11,  3.37it/s]
  4%|▍         | 15543/371472 [1:13:52<28:22:40,  3.48it/s]
  4%|▍         | 15544/371472 [1:13:52<28:33:10,  3.46it/s]
  4%|▍         | 15545/371472 [1:13:53<28:03:26,  3.52it/s]
  4%|▍         | 15546/371472 [1:13:53<27:45:41,  3.56it/s]
  4%|▍         | 15547/371472 [1:13:53<27:47:35,  3.56it/s]
  4%|▍         | 15548/371472 [1:13:53<27:57:42,  3.54it/s]
  4%|▍         | 15549/371472 [1:13:54<27:36:05,  3.58it/s]
  4%|▍         | 15550/371472 [1:13:54<27:06:02,  3.65it/s]
  4%|▍         | 15551/371472 [1:13:54<27:26:47,  3.60it/s]
  4%|▍         | 15552/371472 [1:13:55<28:17:28,  3.49it/s]
  4%|▍         | 15553/371472 [1:13:55<28:17:42,  3.49it/s]
  4%|▍         | 15554/371472 [1:13:55<28:31:32,  3.47it/s]
  4%|▍         | 15555/371472 [1:13:56<30:04:48,  3.29it/s]
  4%|▍         | 15556/371472 [1:13:56<29:40:48,  3.33it/s]
  4%|▍         | 15557/371472 [1:13:56<28:54:08,  3.42it/s]
  4%|▍         | 15558/371472 [1:13:57<31:52:42,  3.10it/s]
  4%|▍         | 15559/371472 [1:13:57<31:52:02,  3.10it/s]
  4%|▍         | 15560/371472 [1:13:57<30:25:03,  3.25it/s]
                                                           
{'loss': 4.3408, 'learning_rate': 9.627658428322093e-07, 'epoch': 0.67}

  4%|▍         | 15560/371472 [1:13:57<30:25:03,  3.25it/s]
  4%|▍         | 15561/371472 [1:13:57<28:41:51,  3.45it/s]
  4%|▍         | 15562/371472 [1:13:58<28:02:36,  3.53it/s]
  4%|▍         | 15563/371472 [1:13:58<28:37:31,  3.45it/s]
  4%|▍         | 15564/371472 [1:13:58<28:25:46,  3.48it/s]
  4%|▍         | 15565/371472 [1:13:58<28:33:37,  3.46it/s]
  4%|▍         | 15566/371472 [1:13:59<28:16:34,  3.50it/s]
  4%|▍         | 15567/371472 [1:13:59<27:33:11,  3.59it/s]
  4%|▍         | 15568/371472 [1:13:59<27:12:25,  3.63it/s]
  4%|▍         | 15569/371472 [1:14:00<28:41:53,  3.44it/s]
  4%|▍         | 15570/371472 [1:14:00<27:20:03,  3.62it/s]
  4%|▍         | 15571/371472 [1:14:00<27:30:45,  3.59it/s]
  4%|▍         | 15572/371472 [1:14:00<26:19:26,  3.76it/s]
  4%|▍         | 15573/371472 [1:14:01<26:25:28,  3.74it/s]
  4%|▍         | 15574/371472 [1:14:01<26:44:18,  3.70it/s]
  4%|▍         | 15575/371472 [1:14:01<29:16:02,  3.38it/s]
  4%|▍         | 15576/371472 [1:14:02<29:30:03,  3.35it/s]
  4%|▍         | 15577/371472 [1:14:02<28:25:28,  3.48it/s]
  4%|▍         | 15578/371472 [1:14:02<27:51:48,  3.55it/s]
  4%|▍         | 15579/371472 [1:14:02<30:01:47,  3.29it/s]
  4%|▍         | 15580/371472 [1:14:03<29:30:28,  3.35it/s]
                                                           
{'loss': 4.8935, 'learning_rate': 9.627173608567302e-07, 'epoch': 0.67}

  4%|▍         | 15580/371472 [1:14:03<29:30:28,  3.35it/s]
  4%|▍         | 15581/371472 [1:14:03<29:11:17,  3.39it/s]
  4%|▍         | 15582/371472 [1:14:03<28:56:26,  3.42it/s]
  4%|▍         | 15583/371472 [1:14:04<28:14:49,  3.50it/s]
  4%|▍         | 15584/371472 [1:14:04<28:25:16,  3.48it/s]
  4%|▍         | 15585/371472 [1:14:04<29:02:01,  3.40it/s]
  4%|▍         | 15586/371472 [1:14:05<30:31:40,  3.24it/s]
  4%|▍         | 15587/371472 [1:14:05<28:40:29,  3.45it/s]
  4%|▍         | 15588/371472 [1:14:05<27:34:28,  3.59it/s]
  4%|▍         | 15589/371472 [1:14:05<28:58:06,  3.41it/s]
  4%|▍         | 15590/371472 [1:14:06<28:01:28,  3.53it/s]
  4%|▍         | 15591/371472 [1:14:06<29:14:56,  3.38it/s]
  4%|▍         | 15592/371472 [1:14:06<32:51:49,  3.01it/s]
  4%|▍         | 15593/371472 [1:14:07<30:41:04,  3.22it/s]
  4%|▍         | 15594/371472 [1:14:07<29:36:59,  3.34it/s]
  4%|▍         | 15595/371472 [1:14:07<29:38:49,  3.33it/s]
  4%|▍         | 15596/371472 [1:14:08<31:49:54,  3.11it/s]
  4%|▍         | 15597/371472 [1:14:08<30:24:11,  3.25it/s]
  4%|▍         | 15598/371472 [1:14:08<28:44:43,  3.44it/s]
  4%|▍         | 15599/371472 [1:14:08<29:20:13,  3.37it/s]
  4%|▍         | 15600/371472 [1:14:09<27:54:50,  3.54it/s]
                                                           
{'loss': 4.569, 'learning_rate': 9.626688788812515e-07, 'epoch': 0.67}

  4%|▍         | 15600/371472 [1:14:09<27:54:50,  3.54it/s]
  4%|▍         | 15601/371472 [1:14:09<26:59:51,  3.66it/s]
  4%|▍         | 15602/371472 [1:14:09<27:16:43,  3.62it/s]
  4%|▍         | 15603/371472 [1:14:09<27:08:59,  3.64it/s]
  4%|▍         | 15604/371472 [1:14:10<27:10:40,  3.64it/s]
  4%|▍         | 15605/371472 [1:14:10<26:28:57,  3.73it/s]
  4%|▍         | 15606/371472 [1:14:10<26:36:07,  3.72it/s]
  4%|▍         | 15607/371472 [1:14:11<26:10:14,  3.78it/s]
  4%|▍         | 15608/371472 [1:14:11<27:00:40,  3.66it/s]
  4%|▍         | 15609/371472 [1:14:11<26:49:44,  3.68it/s]
  4%|▍         | 15610/371472 [1:14:11<27:11:42,  3.63it/s]
  4%|▍         | 15611/371472 [1:14:12<28:28:12,  3.47it/s]
  4%|▍         | 15612/371472 [1:14:12<27:38:13,  3.58it/s]
  4%|▍         | 15613/371472 [1:14:12<26:55:38,  3.67it/s]
  4%|▍         | 15614/371472 [1:14:13<27:17:37,  3.62it/s]
  4%|▍         | 15615/371472 [1:14:13<27:12:23,  3.63it/s]
  4%|▍         | 15616/371472 [1:14:13<28:22:58,  3.48it/s]
  4%|▍         | 15617/371472 [1:14:13<27:37:59,  3.58it/s]
  4%|▍         | 15618/371472 [1:14:14<26:41:09,  3.70it/s]
  4%|▍         | 15619/371472 [1:14:14<27:32:21,  3.59it/s]
  4%|▍         | 15620/371472 [1:14:14<29:05:06,  3.40it/s]
                                                           
{'loss': 4.2996, 'learning_rate': 9.626203969057725e-07, 'epoch': 0.67}

  4%|▍         | 15620/371472 [1:14:14<29:05:06,  3.40it/s]
  4%|▍         | 15621/371472 [1:14:14<28:18:57,  3.49it/s]
  4%|▍         | 15622/371472 [1:14:15<29:17:05,  3.38it/s]
  4%|▍         | 15623/371472 [1:14:15<27:48:03,  3.56it/s]
  4%|▍         | 15624/371472 [1:14:15<28:28:34,  3.47it/s]
  4%|▍         | 15625/371472 [1:14:16<30:30:16,  3.24it/s]
  4%|▍         | 15626/371472 [1:14:16<29:06:34,  3.40it/s]
  4%|▍         | 15627/371472 [1:14:16<30:58:49,  3.19it/s]
  4%|▍         | 15628/371472 [1:14:17<29:05:26,  3.40it/s]
  4%|▍         | 15629/371472 [1:14:17<28:23:17,  3.48it/s]
  4%|▍         | 15630/371472 [1:14:17<27:54:02,  3.54it/s]
  4%|▍         | 15631/371472 [1:14:17<28:09:52,  3.51it/s]
  4%|▍         | 15632/371472 [1:14:18<30:16:49,  3.26it/s]
  4%|▍         | 15633/371472 [1:14:18<30:54:02,  3.20it/s]
  4%|▍         | 15634/371472 [1:14:18<31:32:26,  3.13it/s]
  4%|▍         | 15635/371472 [1:14:19<30:14:23,  3.27it/s]
  4%|▍         | 15636/371472 [1:14:19<28:21:48,  3.48it/s]
  4%|▍         | 15637/371472 [1:14:19<28:35:46,  3.46it/s]
  4%|▍         | 15638/371472 [1:14:20<30:35:18,  3.23it/s]
  4%|▍         | 15639/371472 [1:14:20<29:54:47,  3.30it/s]
  4%|▍         | 15640/371472 [1:14:20<30:35:30,  3.23it/s]
                                                           
{'loss': 4.6604, 'learning_rate': 9.625719149302936e-07, 'epoch': 0.67}

  4%|▍         | 15640/371472 [1:14:20<30:35:30,  3.23it/s]
  4%|▍         | 15641/371472 [1:14:20<29:35:49,  3.34it/s]
  4%|▍         | 15642/371472 [1:14:21<29:05:58,  3.40it/s]
  4%|▍         | 15643/371472 [1:14:21<27:55:51,  3.54it/s]
  4%|▍         | 15644/371472 [1:14:21<28:15:05,  3.50it/s]
  4%|▍         | 15645/371472 [1:14:22<27:27:11,  3.60it/s]
  4%|▍         | 15646/371472 [1:14:22<26:44:35,  3.70it/s]
  4%|▍         | 15647/371472 [1:14:22<27:37:06,  3.58it/s]
  4%|▍         | 15648/371472 [1:14:22<28:33:44,  3.46it/s]
  4%|▍         | 15649/371472 [1:14:23<29:39:07,  3.33it/s]
  4%|▍         | 15650/371472 [1:14:23<28:09:57,  3.51it/s]
  4%|▍         | 15651/371472 [1:14:23<27:03:16,  3.65it/s]
  4%|▍         | 15652/371472 [1:14:24<29:29:07,  3.35it/s]
  4%|▍         | 15653/371472 [1:14:24<29:54:23,  3.30it/s]
  4%|▍         | 15654/371472 [1:14:24<28:44:28,  3.44it/s]
  4%|▍         | 15655/371472 [1:14:25<29:08:58,  3.39it/s]
  4%|▍         | 15656/371472 [1:14:25<27:31:04,  3.59it/s]
  4%|▍         | 15657/371472 [1:14:25<26:56:16,  3.67it/s]
  4%|▍         | 15658/371472 [1:14:25<26:55:28,  3.67it/s]
  4%|▍         | 15659/371472 [1:14:26<27:04:58,  3.65it/s]
  4%|▍         | 15660/371472 [1:14:26<26:48:55,  3.69it/s]
                                                           
{'loss': 4.5706, 'learning_rate': 9.625234329548147e-07, 'epoch': 0.67}

  4%|▍         | 15660/371472 [1:14:26<26:48:55,  3.69it/s]
  4%|▍         | 15661/371472 [1:14:26<26:31:55,  3.73it/s]
  4%|▍         | 15662/371472 [1:14:26<28:04:28,  3.52it/s]
  4%|▍         | 15663/371472 [1:14:27<27:25:29,  3.60it/s]
  4%|▍         | 15664/371472 [1:14:27<27:01:03,  3.66it/s]
  4%|▍         | 15665/371472 [1:14:27<27:01:34,  3.66it/s]
  4%|▍         | 15666/371472 [1:14:28<27:48:46,  3.55it/s]
  4%|▍         | 15667/371472 [1:14:28<28:34:22,  3.46it/s]
  4%|▍         | 15668/371472 [1:14:28<30:35:05,  3.23it/s]
  4%|▍         | 15669/371472 [1:14:28<30:13:46,  3.27it/s]
  4%|▍         | 15670/371472 [1:14:29<28:53:35,  3.42it/s]
  4%|▍         | 15671/371472 [1:14:29<28:48:54,  3.43it/s]
  4%|▍         | 15672/371472 [1:14:29<28:29:00,  3.47it/s]
  4%|▍         | 15673/371472 [1:14:30<28:54:40,  3.42it/s]
  4%|▍         | 15674/371472 [1:14:30<28:49:17,  3.43it/s]
  4%|▍         | 15675/371472 [1:14:30<27:48:13,  3.55it/s]
  4%|▍         | 15676/371472 [1:14:30<27:25:14,  3.60it/s]
  4%|▍         | 15677/371472 [1:14:31<26:47:42,  3.69it/s]
  4%|▍         | 15678/371472 [1:14:31<26:06:35,  3.79it/s]
  4%|▍         | 15679/371472 [1:14:31<29:38:29,  3.33it/s]
  4%|▍         | 15680/371472 [1:14:32<29:04:38,  3.40it/s]
                                                           
{'loss': 4.5631, 'learning_rate': 9.624749509793358e-07, 'epoch': 0.68}

  4%|▍         | 15680/371472 [1:14:32<29:04:38,  3.40it/s]
  4%|▍         | 15681/371472 [1:14:32<28:16:29,  3.50it/s]
  4%|▍         | 15682/371472 [1:14:32<27:46:04,  3.56it/s]
  4%|▍         | 15683/371472 [1:14:32<27:08:36,  3.64it/s]
  4%|▍         | 15684/371472 [1:14:33<28:38:18,  3.45it/s]
  4%|▍         | 15685/371472 [1:14:33<27:39:07,  3.57it/s]
  4%|▍         | 15686/371472 [1:14:33<26:37:13,  3.71it/s]
  4%|▍         | 15687/371472 [1:14:33<26:40:54,  3.70it/s]
  4%|▍         | 15688/371472 [1:14:34<28:03:59,  3.52it/s]
  4%|▍         | 15689/371472 [1:14:34<27:04:07,  3.65it/s]
  4%|▍         | 15690/371472 [1:14:34<27:01:41,  3.66it/s]
  4%|▍         | 15691/371472 [1:14:35<26:40:53,  3.70it/s]
  4%|▍         | 15692/371472 [1:14:35<26:25:22,  3.74it/s]
  4%|▍         | 15693/371472 [1:14:35<25:43:25,  3.84it/s]
  4%|▍         | 15694/371472 [1:14:35<26:16:03,  3.76it/s]
  4%|▍         | 15695/371472 [1:14:36<26:28:17,  3.73it/s]
  4%|▍         | 15696/371472 [1:14:36<26:02:28,  3.80it/s]
  4%|▍         | 15697/371472 [1:14:36<29:07:16,  3.39it/s]
  4%|▍         | 15698/371472 [1:14:37<28:11:30,  3.51it/s]
  4%|▍         | 15699/371472 [1:14:37<31:18:35,  3.16it/s]
  4%|▍         | 15700/371472 [1:14:37<29:50:04,  3.31it/s]
                                                           
{'loss': 4.7159, 'learning_rate': 9.62426469003857e-07, 'epoch': 0.68}

  4%|▍         | 15700/371472 [1:14:37<29:50:04,  3.31it/s]
  4%|▍         | 15701/371472 [1:14:37<28:51:46,  3.42it/s]
  4%|▍         | 15702/371472 [1:14:38<28:08:59,  3.51it/s]
  4%|▍         | 15703/371472 [1:14:38<27:13:58,  3.63it/s]
  4%|▍         | 15704/371472 [1:14:38<27:40:30,  3.57it/s]
  4%|▍         | 15705/371472 [1:14:39<27:41:44,  3.57it/s]
  4%|▍         | 15706/371472 [1:14:39<26:59:30,  3.66it/s]
  4%|▍         | 15707/371472 [1:14:39<26:53:22,  3.68it/s]
  4%|▍         | 15708/371472 [1:14:39<27:31:29,  3.59it/s]
  4%|▍         | 15709/371472 [1:14:40<27:24:19,  3.61it/s]
  4%|▍         | 15710/371472 [1:14:40<26:40:04,  3.71it/s]
  4%|▍         | 15711/371472 [1:14:40<27:37:29,  3.58it/s]
  4%|▍         | 15712/371472 [1:14:40<27:41:22,  3.57it/s]
  4%|▍         | 15713/371472 [1:14:41<26:59:48,  3.66it/s]
  4%|▍         | 15714/371472 [1:14:41<27:21:11,  3.61it/s]
  4%|▍         | 15715/371472 [1:14:41<26:44:54,  3.69it/s]
  4%|▍         | 15716/371472 [1:14:42<26:16:12,  3.76it/s]
  4%|▍         | 15717/371472 [1:14:42<26:19:18,  3.75it/s]
  4%|▍         | 15718/371472 [1:14:42<26:48:35,  3.69it/s]
  4%|▍         | 15719/371472 [1:14:42<26:44:16,  3.70it/s]
  4%|▍         | 15720/371472 [1:14:43<27:02:22,  3.65it/s]
                                                           
{'loss': 4.7933, 'learning_rate': 9.623779870283781e-07, 'epoch': 0.68}

  4%|▍         | 15720/371472 [1:14:43<27:02:22,  3.65it/s]
  4%|▍         | 15721/371472 [1:14:43<28:01:38,  3.53it/s]
  4%|▍         | 15722/371472 [1:14:43<26:55:01,  3.67it/s]
  4%|▍         | 15723/371472 [1:14:43<26:38:59,  3.71it/s]
  4%|▍         | 15724/371472 [1:14:44<26:37:01,  3.71it/s]
  4%|▍         | 15725/371472 [1:14:44<27:31:25,  3.59it/s]
  4%|▍         | 15726/371472 [1:14:44<27:01:34,  3.66it/s]
  4%|▍         | 15727/371472 [1:14:45<27:03:23,  3.65it/s]
  4%|▍         | 15728/371472 [1:14:45<29:55:05,  3.30it/s]
  4%|▍         | 15729/371472 [1:14:45<28:40:05,  3.45it/s]
  4%|▍         | 15730/371472 [1:14:46<30:55:21,  3.20it/s]
  4%|▍         | 15731/371472 [1:14:46<30:30:02,  3.24it/s]
  4%|▍         | 15732/371472 [1:14:46<28:47:42,  3.43it/s]
  4%|▍         | 15733/371472 [1:14:46<28:59:22,  3.41it/s]
  4%|▍         | 15734/371472 [1:14:47<28:05:05,  3.52it/s]
  4%|▍         | 15735/371472 [1:14:47<28:26:54,  3.47it/s]
  4%|▍         | 15736/371472 [1:14:47<29:03:35,  3.40it/s]
  4%|▍         | 15737/371472 [1:14:48<27:59:55,  3.53it/s]
  4%|▍         | 15738/371472 [1:14:48<29:53:41,  3.31it/s]
  4%|▍         | 15739/371472 [1:14:48<31:15:11,  3.16it/s]
  4%|▍         | 15740/371472 [1:14:49<31:22:37,  3.15it/s]
                                                           
{'loss': 4.654, 'learning_rate': 9.623295050528992e-07, 'epoch': 0.68}

  4%|▍         | 15740/371472 [1:14:49<31:22:37,  3.15it/s]
  4%|▍         | 15741/371472 [1:14:49<30:49:23,  3.21it/s]
  4%|▍         | 15742/371472 [1:14:49<29:07:17,  3.39it/s]
  4%|▍         | 15743/371472 [1:14:49<29:46:01,  3.32it/s]
  4%|▍         | 15744/371472 [1:14:50<31:54:18,  3.10it/s]
  4%|▍         | 15745/371472 [1:14:50<31:51:01,  3.10it/s]
  4%|▍         | 15746/371472 [1:14:50<32:02:47,  3.08it/s]
  4%|▍         | 15747/371472 [1:14:51<33:30:19,  2.95it/s]
  4%|▍         | 15748/371472 [1:14:51<30:46:16,  3.21it/s]
  4%|▍         | 15749/371472 [1:14:51<31:18:41,  3.16it/s]
  4%|▍         | 15750/371472 [1:14:52<29:07:39,  3.39it/s]
  4%|▍         | 15751/371472 [1:14:52<28:12:18,  3.50it/s]
  4%|▍         | 15752/371472 [1:14:52<27:16:42,  3.62it/s]
  4%|▍         | 15753/371472 [1:14:52<27:02:30,  3.65it/s]
  4%|▍         | 15754/371472 [1:14:53<26:41:11,  3.70it/s]
  4%|▍         | 15755/371472 [1:14:53<26:24:24,  3.74it/s]
  4%|▍         | 15756/371472 [1:14:53<26:38:51,  3.71it/s]
  4%|▍         | 15757/371472 [1:14:54<27:30:44,  3.59it/s]
  4%|▍         | 15758/371472 [1:14:54<26:47:50,  3.69it/s]
  4%|▍         | 15759/371472 [1:14:54<30:19:16,  3.26it/s]
  4%|▍         | 15760/371472 [1:14:54<30:57:53,  3.19it/s]
                                                           
{'loss': 4.4683, 'learning_rate': 9.622810230774205e-07, 'epoch': 0.68}

  4%|▍         | 15760/371472 [1:14:54<30:57:53,  3.19it/s]
  4%|▍         | 15761/371472 [1:14:55<29:21:01,  3.37it/s]
  4%|▍         | 15762/371472 [1:14:55<28:44:09,  3.44it/s]
  4%|▍         | 15763/371472 [1:14:55<27:37:49,  3.58it/s]
  4%|▍         | 15764/371472 [1:14:56<27:26:06,  3.60it/s]
  4%|▍         | 15765/371472 [1:14:56<26:55:15,  3.67it/s]
  4%|▍         | 15766/371472 [1:14:56<27:52:26,  3.54it/s]
  4%|▍         | 15767/371472 [1:14:56<27:14:33,  3.63it/s]
  4%|▍         | 15768/371472 [1:14:57<27:26:13,  3.60it/s]
  4%|▍         | 15769/371472 [1:14:57<28:31:14,  3.46it/s]
  4%|▍         | 15770/371472 [1:14:57<27:26:02,  3.60it/s]
  4%|▍         | 15771/371472 [1:14:58<28:07:02,  3.51it/s]
  4%|▍         | 15772/371472 [1:14:58<27:31:08,  3.59it/s]
  4%|▍         | 15773/371472 [1:14:58<28:03:46,  3.52it/s]
  4%|▍         | 15774/371472 [1:14:58<27:41:53,  3.57it/s]
  4%|▍         | 15775/371472 [1:14:59<27:32:46,  3.59it/s]
  4%|▍         | 15776/371472 [1:14:59<28:21:01,  3.49it/s]
  4%|▍         | 15777/371472 [1:14:59<28:01:42,  3.53it/s]
  4%|▍         | 15778/371472 [1:15:00<29:22:21,  3.36it/s]
  4%|▍         | 15779/371472 [1:15:00<28:55:02,  3.42it/s]
  4%|▍         | 15780/371472 [1:15:00<30:14:46,  3.27it/s]
                                                           
{'loss': 4.7185, 'learning_rate': 9.622325411019413e-07, 'epoch': 0.68}

  4%|▍         | 15780/371472 [1:15:00<30:14:46,  3.27it/s]
  4%|▍         | 15781/371472 [1:15:01<32:15:54,  3.06it/s]
  4%|▍         | 15782/371472 [1:15:01<30:58:22,  3.19it/s]
  4%|▍         | 15783/371472 [1:15:01<29:16:36,  3.37it/s]
  4%|▍         | 15784/371472 [1:15:01<28:13:50,  3.50it/s]
  4%|▍         | 15785/371472 [1:15:02<29:29:51,  3.35it/s]
  4%|▍         | 15786/371472 [1:15:02<28:23:02,  3.48it/s]
  4%|▍         | 15787/371472 [1:15:02<28:37:08,  3.45it/s]
  4%|▍         | 15788/371472 [1:15:02<28:00:42,  3.53it/s]
  4%|▍         | 15789/371472 [1:15:03<27:51:03,  3.55it/s]
  4%|▍         | 15790/371472 [1:15:03<26:57:39,  3.66it/s]
  4%|▍         | 15791/371472 [1:15:03<27:40:55,  3.57it/s]
  4%|▍         | 15792/371472 [1:15:04<26:43:52,  3.70it/s]
  4%|▍         | 15793/371472 [1:15:04<26:39:44,  3.71it/s]
  4%|▍         | 15794/371472 [1:15:04<26:44:27,  3.69it/s]
  4%|▍         | 15795/371472 [1:15:04<27:55:12,  3.54it/s]
  4%|▍         | 15796/371472 [1:15:05<27:02:19,  3.65it/s]
  4%|▍         | 15797/371472 [1:15:05<27:12:45,  3.63it/s]
  4%|▍         | 15798/371472 [1:15:05<26:42:36,  3.70it/s]
  4%|▍         | 15799/371472 [1:15:05<26:31:00,  3.73it/s]
  4%|▍         | 15800/371472 [1:15:06<27:25:10,  3.60it/s]
                                                           
{'loss': 4.643, 'learning_rate': 9.621840591264626e-07, 'epoch': 0.68}

  4%|▍         | 15800/371472 [1:15:06<27:25:10,  3.60it/s]
  4%|▍         | 15801/371472 [1:15:06<27:05:56,  3.65it/s]
  4%|▍         | 15802/371472 [1:15:07<39:55:36,  2.47it/s]
  4%|▍         | 15803/371472 [1:15:07<36:16:29,  2.72it/s]
  4%|▍         | 15804/371472 [1:15:07<33:27:30,  2.95it/s]
  4%|▍         | 15805/371472 [1:15:08<31:16:15,  3.16it/s]
  4%|▍         | 15806/371472 [1:15:08<30:38:15,  3.22it/s]
  4%|▍         | 15807/371472 [1:15:08<29:47:23,  3.32it/s]
  4%|▍         | 15808/371472 [1:15:08<29:22:39,  3.36it/s]
  4%|▍         | 15809/371472 [1:15:09<29:59:32,  3.29it/s]
  4%|▍         | 15810/371472 [1:15:09<28:52:10,  3.42it/s]
  4%|▍         | 15811/371472 [1:15:09<27:43:28,  3.56it/s]
  4%|▍         | 15812/371472 [1:15:09<26:33:01,  3.72it/s]
  4%|▍         | 15813/371472 [1:15:10<28:58:40,  3.41it/s]
  4%|▍         | 15814/371472 [1:15:10<29:37:49,  3.33it/s]
  4%|▍         | 15815/371472 [1:15:10<29:39:32,  3.33it/s]
  4%|▍         | 15816/371472 [1:15:11<29:23:51,  3.36it/s]
  4%|▍         | 15817/371472 [1:15:11<28:37:14,  3.45it/s]
  4%|▍         | 15818/371472 [1:15:11<27:42:13,  3.57it/s]
  4%|▍         | 15819/371472 [1:15:12<26:58:52,  3.66it/s]
  4%|▍         | 15820/371472 [1:15:12<26:18:25,  3.76it/s]
                                                           
{'loss': 4.367, 'learning_rate': 9.621355771509835e-07, 'epoch': 0.68}

  4%|▍         | 15820/371472 [1:15:12<26:18:25,  3.76it/s]
  4%|▍         | 15821/371472 [1:15:12<25:47:49,  3.83it/s]
  4%|▍         | 15822/371472 [1:15:12<27:41:08,  3.57it/s]
  4%|▍         | 15823/371472 [1:15:13<27:13:06,  3.63it/s]
  4%|▍         | 15824/371472 [1:15:13<28:22:43,  3.48it/s]
  4%|▍         | 15825/371472 [1:15:13<27:47:58,  3.55it/s]
  4%|▍         | 15826/371472 [1:15:13<26:42:39,  3.70it/s]
  4%|▍         | 15827/371472 [1:15:14<25:46:12,  3.83it/s]
  4%|▍         | 15828/371472 [1:15:14<25:52:51,  3.82it/s]
  4%|▍         | 15829/371472 [1:15:14<26:58:41,  3.66it/s]
  4%|▍         | 15830/371472 [1:15:15<28:11:43,  3.50it/s]
  4%|▍         | 15831/371472 [1:15:15<29:15:48,  3.38it/s]
  4%|▍         | 15832/371472 [1:15:15<29:19:00,  3.37it/s]
  4%|▍         | 15833/371472 [1:15:15<28:39:10,  3.45it/s]
  4%|▍         | 15834/371472 [1:15:16<29:08:00,  3.39it/s]
  4%|▍         | 15835/371472 [1:15:16<28:04:36,  3.52it/s]
  4%|▍         | 15836/371472 [1:15:16<28:31:00,  3.46it/s]
  4%|▍         | 15837/371472 [1:15:17<27:43:27,  3.56it/s]
  4%|▍         | 15838/371472 [1:15:17<26:30:38,  3.73it/s]
  4%|▍         | 15839/371472 [1:15:17<27:48:49,  3.55it/s]
  4%|▍         | 15840/371472 [1:15:17<27:35:28,  3.58it/s]
                                                           
{'loss': 4.6144, 'learning_rate': 9.620870951755048e-07, 'epoch': 0.68}

  4%|▍         | 15840/371472 [1:15:17<27:35:28,  3.58it/s]
  4%|▍         | 15841/371472 [1:15:18<27:08:05,  3.64it/s]
  4%|▍         | 15842/371472 [1:15:18<27:51:34,  3.55it/s]
  4%|▍         | 15843/371472 [1:15:18<29:54:07,  3.30it/s]
  4%|▍         | 15844/371472 [1:15:19<29:26:26,  3.36it/s]
  4%|▍         | 15845/371472 [1:15:19<28:24:25,  3.48it/s]
  4%|▍         | 15846/371472 [1:15:19<27:10:40,  3.63it/s]
  4%|▍         | 15847/371472 [1:15:19<26:58:00,  3.66it/s]
  4%|▍         | 15848/371472 [1:15:20<28:02:05,  3.52it/s]
  4%|▍         | 15849/371472 [1:15:20<26:52:36,  3.68it/s]
  4%|▍         | 15850/371472 [1:15:20<26:59:53,  3.66it/s]
  4%|▍         | 15851/371472 [1:15:21<29:35:19,  3.34it/s]
  4%|▍         | 15852/371472 [1:15:21<29:13:44,  3.38it/s]
  4%|▍         | 15853/371472 [1:15:21<29:06:33,  3.39it/s]
  4%|▍         | 15854/371472 [1:15:22<30:43:30,  3.22it/s]
  4%|▍         | 15855/371472 [1:15:22<31:04:47,  3.18it/s]
  4%|▍         | 15856/371472 [1:15:22<33:00:17,  2.99it/s]
  4%|▍         | 15857/371472 [1:15:23<31:52:34,  3.10it/s]
  4%|▍         | 15858/371472 [1:15:23<31:28:32,  3.14it/s]
  4%|▍         | 15859/371472 [1:15:23<30:56:16,  3.19it/s]
  4%|▍         | 15860/371472 [1:15:23<30:47:44,  3.21it/s]
                                                           
{'loss': 4.5154, 'learning_rate': 9.620386132000258e-07, 'epoch': 0.68}

  4%|▍         | 15860/371472 [1:15:23<30:47:44,  3.21it/s]
  4%|▍         | 15861/371472 [1:15:24<29:13:10,  3.38it/s]
  4%|▍         | 15862/371472 [1:15:24<29:14:24,  3.38it/s]
  4%|▍         | 15863/371472 [1:15:24<28:15:48,  3.49it/s]
  4%|▍         | 15864/371472 [1:15:25<30:10:34,  3.27it/s]
  4%|▍         | 15865/371472 [1:15:25<28:32:07,  3.46it/s]
  4%|▍         | 15866/371472 [1:15:25<29:47:36,  3.32it/s]
  4%|▍         | 15867/371472 [1:15:26<31:28:50,  3.14it/s]
  4%|▍         | 15868/371472 [1:15:26<30:24:31,  3.25it/s]
  4%|▍         | 15869/371472 [1:15:26<30:45:36,  3.21it/s]
  4%|▍         | 15870/371472 [1:15:26<30:32:09,  3.23it/s]
  4%|▍         | 15871/371472 [1:15:27<28:45:17,  3.44it/s]
  4%|▍         | 15872/371472 [1:15:27<28:39:08,  3.45it/s]
  4%|▍         | 15873/371472 [1:15:27<28:55:35,  3.41it/s]
  4%|▍         | 15874/371472 [1:15:28<33:19:25,  2.96it/s]
  4%|▍         | 15875/371472 [1:15:28<30:52:57,  3.20it/s]
  4%|▍         | 15876/371472 [1:15:28<28:58:36,  3.41it/s]
  4%|▍         | 15877/371472 [1:15:29<28:34:29,  3.46it/s]
  4%|▍         | 15878/371472 [1:15:29<27:49:42,  3.55it/s]
  4%|▍         | 15879/371472 [1:15:29<28:28:04,  3.47it/s]
  4%|▍         | 15880/371472 [1:15:29<29:10:40,  3.39it/s]
                                                           
{'loss': 4.6272, 'learning_rate': 9.61990131224547e-07, 'epoch': 0.68}

  4%|▍         | 15880/371472 [1:15:29<29:10:40,  3.39it/s]
  4%|▍         | 15881/371472 [1:15:30<28:06:19,  3.51it/s]
  4%|▍         | 15882/371472 [1:15:30<27:09:27,  3.64it/s]
  4%|▍         | 15883/371472 [1:15:30<27:35:06,  3.58it/s]
  4%|▍         | 15884/371472 [1:15:30<28:31:36,  3.46it/s]
  4%|▍         | 15885/371472 [1:15:31<28:54:17,  3.42it/s]
  4%|▍         | 15886/371472 [1:15:31<27:35:07,  3.58it/s]
  4%|▍         | 15887/371472 [1:15:31<26:51:27,  3.68it/s]
  4%|▍         | 15888/371472 [1:15:32<29:16:17,  3.37it/s]
  4%|▍         | 15889/371472 [1:15:32<28:11:08,  3.50it/s]
  4%|▍         | 15890/371472 [1:15:32<27:36:16,  3.58it/s]
  4%|▍         | 15891/371472 [1:15:33<30:14:10,  3.27it/s]
  4%|▍         | 15892/371472 [1:15:33<32:53:20,  3.00it/s]
  4%|▍         | 15893/371472 [1:15:33<30:53:13,  3.20it/s]
  4%|▍         | 15894/371472 [1:15:33<29:24:58,  3.36it/s]
  4%|▍         | 15895/371472 [1:15:34<28:40:13,  3.45it/s]
  4%|▍         | 15896/371472 [1:15:34<27:28:06,  3.60it/s]
  4%|▍         | 15897/371472 [1:15:34<28:03:12,  3.52it/s]
  4%|▍         | 15898/371472 [1:15:35<26:57:13,  3.66it/s]
  4%|▍         | 15899/371472 [1:15:35<26:34:20,  3.72it/s]
  4%|▍         | 15900/371472 [1:15:35<26:27:36,  3.73it/s]
                                                           
{'loss': 4.5658, 'learning_rate': 9.619416492490682e-07, 'epoch': 0.68}

  4%|▍         | 15900/371472 [1:15:35<26:27:36,  3.73it/s]
  4%|▍         | 15901/371472 [1:15:35<30:30:58,  3.24it/s]
  4%|▍         | 15902/371472 [1:15:36<30:12:47,  3.27it/s]
  4%|▍         | 15903/371472 [1:15:36<28:26:58,  3.47it/s]
  4%|▍         | 15904/371472 [1:15:36<28:34:09,  3.46it/s]
  4%|▍         | 15905/371472 [1:15:37<26:59:06,  3.66it/s]
  4%|▍         | 15906/371472 [1:15:37<26:23:32,  3.74it/s]
  4%|▍         | 15907/371472 [1:15:37<26:53:58,  3.67it/s]
  4%|▍         | 15908/371472 [1:15:37<27:11:45,  3.63it/s]
  4%|▍         | 15909/371472 [1:15:38<28:06:28,  3.51it/s]
  4%|▍         | 15910/371472 [1:15:38<28:56:00,  3.41it/s]
  4%|▍         | 15911/371472 [1:15:38<29:02:23,  3.40it/s]
  4%|▍         | 15912/371472 [1:15:39<28:44:43,  3.44it/s]
  4%|▍         | 15913/371472 [1:15:39<30:52:48,  3.20it/s]
  4%|▍         | 15914/371472 [1:15:39<28:54:19,  3.42it/s]
  4%|▍         | 15915/371472 [1:15:39<28:55:35,  3.41it/s]
  4%|▍         | 15916/371472 [1:15:40<28:24:30,  3.48it/s]
  4%|▍         | 15917/371472 [1:15:40<27:13:40,  3.63it/s]
  4%|▍         | 15918/371472 [1:15:40<27:11:21,  3.63it/s]
  4%|▍         | 15919/371472 [1:15:41<26:40:37,  3.70it/s]
  4%|▍         | 15920/371472 [1:15:41<25:50:32,  3.82it/s]
                                                           
{'loss': 4.4771, 'learning_rate': 9.61893167273589e-07, 'epoch': 0.69}

  4%|▍         | 15920/371472 [1:15:41<25:50:32,  3.82it/s]
  4%|▍         | 15921/371472 [1:15:41<27:52:09,  3.54it/s]
  4%|▍         | 15922/371472 [1:15:41<27:06:40,  3.64it/s]
  4%|▍         | 15923/371472 [1:15:42<30:28:24,  3.24it/s]
  4%|▍         | 15924/371472 [1:15:42<30:04:59,  3.28it/s]
  4%|▍         | 15925/371472 [1:15:42<29:38:01,  3.33it/s]
  4%|▍         | 15926/371472 [1:15:43<31:31:54,  3.13it/s]
  4%|▍         | 15927/371472 [1:15:43<34:37:14,  2.85it/s]
  4%|▍         | 15928/371472 [1:15:43<31:20:13,  3.15it/s]
  4%|▍         | 15929/371472 [1:15:44<30:36:13,  3.23it/s]
  4%|▍         | 15930/371472 [1:15:44<29:49:00,  3.31it/s]
  4%|▍         | 15931/371472 [1:15:44<30:00:43,  3.29it/s]
  4%|▍         | 15932/371472 [1:15:45<28:58:10,  3.41it/s]
  4%|▍         | 15933/371472 [1:15:45<29:10:12,  3.39it/s]
  4%|▍         | 15934/371472 [1:15:45<28:05:13,  3.52it/s]
  4%|▍         | 15935/371472 [1:15:45<28:10:32,  3.51it/s]
  4%|▍         | 15936/371472 [1:15:46<27:40:16,  3.57it/s]
  4%|▍         | 15937/371472 [1:15:46<27:49:03,  3.55it/s]
  4%|▍         | 15938/371472 [1:15:46<27:41:38,  3.57it/s]
  4%|▍         | 15939/371472 [1:15:46<27:17:52,  3.62it/s]
  4%|▍         | 15940/371472 [1:15:47<26:43:45,  3.69it/s]
                                                           
{'loss': 4.3724, 'learning_rate': 9.618446852981103e-07, 'epoch': 0.69}

  4%|▍         | 15940/371472 [1:15:47<26:43:45,  3.69it/s]
  4%|▍         | 15941/371472 [1:15:47<26:55:41,  3.67it/s]
  4%|▍         | 15942/371472 [1:15:47<28:43:26,  3.44it/s]
  4%|▍         | 15943/371472 [1:15:48<27:53:58,  3.54it/s]
  4%|▍         | 15944/371472 [1:15:48<27:50:54,  3.55it/s]
  4%|▍         | 15945/371472 [1:15:48<27:46:42,  3.56it/s]
  4%|▍         | 15946/371472 [1:15:48<27:15:50,  3.62it/s]
  4%|▍         | 15947/371472 [1:15:49<28:17:32,  3.49it/s]
  4%|▍         | 15948/371472 [1:15:49<30:09:39,  3.27it/s]
  4%|▍         | 15949/371472 [1:15:49<29:18:11,  3.37it/s]
  4%|▍         | 15950/371472 [1:15:50<28:26:17,  3.47it/s]
  4%|▍         | 15951/371472 [1:15:50<27:35:33,  3.58it/s]
  4%|▍         | 15952/371472 [1:15:50<27:17:20,  3.62it/s]
  4%|▍         | 15953/371472 [1:15:50<27:23:53,  3.60it/s]
  4%|▍         | 15954/371472 [1:15:51<27:06:03,  3.64it/s]
  4%|▍         | 15955/371472 [1:15:51<27:13:27,  3.63it/s]
  4%|▍         | 15956/371472 [1:15:51<27:07:12,  3.64it/s]
  4%|▍         | 15957/371472 [1:15:51<26:48:10,  3.68it/s]
  4%|▍         | 15958/371472 [1:15:52<27:19:43,  3.61it/s]
  4%|▍         | 15959/371472 [1:15:52<30:05:06,  3.28it/s]
  4%|▍         | 15960/371472 [1:15:52<28:44:49,  3.44it/s]
                                                           
{'loss': 4.7635, 'learning_rate': 9.617962033226312e-07, 'epoch': 0.69}

  4%|▍         | 15960/371472 [1:15:52<28:44:49,  3.44it/s]
  4%|▍         | 15961/371472 [1:15:53<29:13:58,  3.38it/s]
  4%|▍         | 15962/371472 [1:15:53<28:14:27,  3.50it/s]
  4%|▍         | 15963/371472 [1:15:53<28:56:30,  3.41it/s]
  4%|▍         | 15964/371472 [1:15:54<28:43:34,  3.44it/s]
  4%|▍         | 15965/371472 [1:15:54<29:33:21,  3.34it/s]
  4%|▍         | 15966/371472 [1:15:54<30:32:40,  3.23it/s]
  4%|▍         | 15967/371472 [1:15:55<31:18:00,  3.15it/s]
  4%|▍         | 15968/371472 [1:15:55<30:11:29,  3.27it/s]
  4%|▍         | 15969/371472 [1:15:55<29:34:09,  3.34it/s]
  4%|▍         | 15970/371472 [1:15:55<29:07:12,  3.39it/s]
  4%|▍         | 15971/371472 [1:15:56<27:59:07,  3.53it/s]
  4%|▍         | 15972/371472 [1:15:56<29:28:13,  3.35it/s]
  4%|▍         | 15973/371472 [1:15:56<28:19:31,  3.49it/s]
  4%|▍         | 15974/371472 [1:15:57<28:56:20,  3.41it/s]
  4%|▍         | 15975/371472 [1:15:57<27:40:53,  3.57it/s]
  4%|▍         | 15976/371472 [1:15:57<26:43:29,  3.70it/s]
  4%|▍         | 15977/371472 [1:15:57<28:17:55,  3.49it/s]
  4%|▍         | 15978/371472 [1:15:58<27:39:03,  3.57it/s]
  4%|▍         | 15979/371472 [1:15:58<30:53:52,  3.20it/s]
  4%|▍         | 15980/371472 [1:15:58<29:53:59,  3.30it/s]
                                                           
{'loss': 4.5284, 'learning_rate': 9.617477213471525e-07, 'epoch': 0.69}

  4%|▍         | 15980/371472 [1:15:58<29:53:59,  3.30it/s]
  4%|▍         | 15981/371472 [1:15:59<30:09:48,  3.27it/s]
  4%|▍         | 15982/371472 [1:15:59<29:17:11,  3.37it/s]
  4%|▍         | 15983/371472 [1:15:59<27:51:08,  3.55it/s]
  4%|▍         | 15984/371472 [1:15:59<28:16:44,  3.49it/s]
  4%|▍         | 15985/371472 [1:16:00<28:06:08,  3.51it/s]
  4%|▍         | 15986/371472 [1:16:00<28:19:39,  3.49it/s]
  4%|▍         | 15987/371472 [1:16:00<28:30:17,  3.46it/s]
  4%|▍         | 15988/371472 [1:16:01<27:41:30,  3.57it/s]
  4%|▍         | 15989/371472 [1:16:01<27:16:14,  3.62it/s]
  4%|▍         | 15990/371472 [1:16:01<27:25:22,  3.60it/s]
  4%|▍         | 15991/371472 [1:16:01<28:00:00,  3.53it/s]
  4%|▍         | 15992/371472 [1:16:02<27:18:46,  3.62it/s]
  4%|▍         | 15993/371472 [1:16:02<26:45:16,  3.69it/s]
  4%|▍         | 15994/371472 [1:16:02<27:05:38,  3.64it/s]
  4%|▍         | 15995/371472 [1:16:03<27:16:26,  3.62it/s]
  4%|▍         | 15996/371472 [1:16:03<27:32:43,  3.58it/s]
  4%|▍         | 15997/371472 [1:16:03<27:34:36,  3.58it/s]
  4%|▍         | 15998/371472 [1:16:03<27:29:04,  3.59it/s]
  4%|▍         | 15999/371472 [1:16:04<27:13:25,  3.63it/s]
  4%|▍         | 16000/371472 [1:16:04<27:05:39,  3.64it/s]
                                                           
{'loss': 4.7441, 'learning_rate': 9.616992393716735e-07, 'epoch': 0.69}

  4%|▍         | 16000/371472 [1:16:04<27:05:39,  3.64it/s]
  4%|▍         | 16001/371472 [1:16:04<26:29:00,  3.73it/s]
  4%|▍         | 16002/371472 [1:16:04<27:18:02,  3.62it/s]
  4%|▍         | 16003/371472 [1:16:05<27:30:14,  3.59it/s]
  4%|▍         | 16004/371472 [1:16:05<26:48:55,  3.68it/s]
  4%|▍         | 16005/371472 [1:16:05<25:55:35,  3.81it/s]
  4%|▍         | 16006/371472 [1:16:05<25:47:56,  3.83it/s]
  4%|▍         | 16007/371472 [1:16:06<26:05:29,  3.78it/s]
  4%|▍         | 16008/371472 [1:16:06<26:33:43,  3.72it/s]
  4%|▍         | 16009/371472 [1:16:06<26:14:10,  3.76it/s]
  4%|▍         | 16010/371472 [1:16:07<25:50:25,  3.82it/s]
  4%|▍         | 16011/371472 [1:16:07<26:43:15,  3.70it/s]
  4%|▍         | 16012/371472 [1:16:07<27:20:43,  3.61it/s]
  4%|▍         | 16013/371472 [1:16:07<27:44:45,  3.56it/s]
  4%|▍         | 16014/371472 [1:16:08<27:34:27,  3.58it/s]
  4%|▍         | 16015/371472 [1:16:08<27:47:23,  3.55it/s]
  4%|▍         | 16016/371472 [1:16:08<28:15:38,  3.49it/s]
  4%|▍         | 16017/371472 [1:16:09<28:13:42,  3.50it/s]
  4%|▍         | 16018/371472 [1:16:09<29:25:49,  3.35it/s]
  4%|▍         | 16019/371472 [1:16:09<28:41:29,  3.44it/s]
  4%|▍         | 16020/371472 [1:16:09<27:54:25,  3.54it/s]
                                                           
{'loss': 4.6897, 'learning_rate': 9.616507573961946e-07, 'epoch': 0.69}

  4%|▍         | 16020/371472 [1:16:09<27:54:25,  3.54it/s]
  4%|▍         | 16021/371472 [1:16:10<29:50:37,  3.31it/s]
  4%|▍         | 16022/371472 [1:16:10<28:50:16,  3.42it/s]
  4%|▍         | 16023/371472 [1:16:10<27:42:45,  3.56it/s]
  4%|▍         | 16024/371472 [1:16:11<30:24:50,  3.25it/s]
  4%|▍         | 16025/371472 [1:16:11<31:04:52,  3.18it/s]
  4%|▍         | 16026/371472 [1:16:11<30:28:34,  3.24it/s]
  4%|▍         | 16027/371472 [1:16:12<29:29:52,  3.35it/s]
  4%|▍         | 16028/371472 [1:16:12<29:23:57,  3.36it/s]
  4%|▍         | 16029/371472 [1:16:12<28:53:01,  3.42it/s]
  4%|▍         | 16030/371472 [1:16:12<28:11:10,  3.50it/s]
  4%|▍         | 16031/371472 [1:16:13<27:46:49,  3.55it/s]
  4%|▍         | 16032/371472 [1:16:13<27:54:30,  3.54it/s]
  4%|▍         | 16033/371472 [1:16:13<27:22:43,  3.61it/s]
  4%|▍         | 16034/371472 [1:16:14<26:57:25,  3.66it/s]
  4%|▍         | 16035/371472 [1:16:14<26:15:00,  3.76it/s]
  4%|▍         | 16036/371472 [1:16:14<26:29:35,  3.73it/s]
  4%|▍         | 16037/371472 [1:16:14<26:18:15,  3.75it/s]
  4%|▍         | 16038/371472 [1:16:15<27:18:41,  3.62it/s]
  4%|▍         | 16039/371472 [1:16:15<27:12:58,  3.63it/s]
  4%|▍         | 16040/371472 [1:16:15<26:28:03,  3.73it/s]
                                                           
{'loss': 4.6016, 'learning_rate': 9.616022754207159e-07, 'epoch': 0.69}

  4%|▍         | 16040/371472 [1:16:15<26:28:03,  3.73it/s]
  4%|▍         | 16041/371472 [1:16:15<26:30:35,  3.72it/s]
  4%|▍         | 16042/371472 [1:16:16<26:31:48,  3.72it/s]
  4%|▍         | 16043/371472 [1:16:16<27:14:43,  3.62it/s]
  4%|▍         | 16044/371472 [1:16:16<27:40:12,  3.57it/s]
  4%|▍         | 16045/371472 [1:16:17<29:05:08,  3.39it/s]
  4%|▍         | 16046/371472 [1:16:17<28:29:02,  3.47it/s]
  4%|▍         | 16047/371472 [1:16:17<28:08:00,  3.51it/s]
  4%|▍         | 16048/371472 [1:16:17<28:52:39,  3.42it/s]
  4%|▍         | 16049/371472 [1:16:18<27:47:41,  3.55it/s]
  4%|▍         | 16050/371472 [1:16:18<27:10:02,  3.63it/s]
  4%|▍         | 16051/371472 [1:16:18<26:33:38,  3.72it/s]
  4%|▍         | 16052/371472 [1:16:18<26:24:33,  3.74it/s]
  4%|▍         | 16053/371472 [1:16:19<26:50:00,  3.68it/s]
  4%|▍         | 16054/371472 [1:16:19<26:29:13,  3.73it/s]
  4%|▍         | 16055/371472 [1:16:19<26:27:15,  3.73it/s]
  4%|▍         | 16056/371472 [1:16:20<25:38:08,  3.85it/s]
  4%|▍         | 16057/371472 [1:16:20<26:28:36,  3.73it/s]
  4%|▍         | 16058/371472 [1:16:20<26:38:19,  3.71it/s]
  4%|▍         | 16059/371472 [1:16:20<26:15:17,  3.76it/s]
  4%|▍         | 16060/371472 [1:16:21<26:39:18,  3.70it/s]
                                                           
{'loss': 4.6313, 'learning_rate': 9.615537934452368e-07, 'epoch': 0.69}

  4%|▍         | 16060/371472 [1:16:21<26:39:18,  3.70it/s]
  4%|▍         | 16061/371472 [1:16:21<27:08:29,  3.64it/s]
  4%|▍         | 16062/371472 [1:16:21<27:36:05,  3.58it/s]
  4%|▍         | 16063/371472 [1:16:21<27:55:13,  3.54it/s]
  4%|▍         | 16064/371472 [1:16:22<27:49:25,  3.55it/s]
  4%|▍         | 16065/371472 [1:16:22<27:06:03,  3.64it/s]
  4%|▍         | 16066/371472 [1:16:22<27:54:24,  3.54it/s]
  4%|▍         | 16067/371472 [1:16:23<27:34:05,  3.58it/s]
  4%|▍         | 16068/371472 [1:16:23<27:02:10,  3.65it/s]
  4%|▍         | 16069/371472 [1:16:23<26:35:56,  3.71it/s]
  4%|▍         | 16070/371472 [1:16:23<25:57:16,  3.80it/s]
  4%|▍         | 16071/371472 [1:16:24<27:01:52,  3.65it/s]
  4%|▍         | 16072/371472 [1:16:24<27:02:26,  3.65it/s]
  4%|▍         | 16073/371472 [1:16:24<27:01:48,  3.65it/s]
  4%|▍         | 16074/371472 [1:16:25<30:00:04,  3.29it/s]
  4%|▍         | 16075/371472 [1:16:25<30:45:23,  3.21it/s]
  4%|▍         | 16076/371472 [1:16:25<32:17:04,  3.06it/s]
  4%|▍         | 16077/371472 [1:16:26<31:30:30,  3.13it/s]
  4%|▍         | 16078/371472 [1:16:26<32:18:38,  3.06it/s]
  4%|▍         | 16079/371472 [1:16:26<32:36:34,  3.03it/s]
  4%|▍         | 16080/371472 [1:16:27<30:41:17,  3.22it/s]
                                                           
{'loss': 4.6305, 'learning_rate': 9.61505311469758e-07, 'epoch': 0.69}

  4%|▍         | 16080/371472 [1:16:27<30:41:17,  3.22it/s]
  4%|▍         | 16081/371472 [1:16:27<29:02:19,  3.40it/s]
  4%|▍         | 16082/371472 [1:16:27<27:18:21,  3.62it/s]
  4%|▍         | 16083/371472 [1:16:27<26:50:59,  3.68it/s]
  4%|▍         | 16084/371472 [1:16:28<29:29:12,  3.35it/s]
  4%|▍         | 16085/371472 [1:16:28<30:42:48,  3.21it/s]
  4%|▍         | 16086/371472 [1:16:28<30:04:22,  3.28it/s]
  4%|▍         | 16087/371472 [1:16:29<29:37:24,  3.33it/s]
  4%|▍         | 16088/371472 [1:16:29<28:35:28,  3.45it/s]
  4%|▍         | 16089/371472 [1:16:29<27:34:42,  3.58it/s]
  4%|▍         | 16090/371472 [1:16:29<27:06:21,  3.64it/s]
  4%|▍         | 16091/371472 [1:16:30<26:19:49,  3.75it/s]
  4%|▍         | 16092/371472 [1:16:30<26:28:54,  3.73it/s]
  4%|▍         | 16093/371472 [1:16:30<27:06:09,  3.64it/s]
  4%|▍         | 16094/371472 [1:16:30<27:09:52,  3.63it/s]
  4%|▍         | 16095/371472 [1:16:31<27:30:44,  3.59it/s]
  4%|▍         | 16096/371472 [1:16:31<27:31:16,  3.59it/s]
  4%|▍         | 16097/371472 [1:16:31<27:21:12,  3.61it/s]
  4%|▍         | 16098/371472 [1:16:32<27:36:39,  3.58it/s]
  4%|▍         | 16099/371472 [1:16:32<31:33:32,  3.13it/s]
  4%|▍         | 16100/371472 [1:16:32<29:24:45,  3.36it/s]
                                                           
{'loss': 4.4422, 'learning_rate': 9.614568294942791e-07, 'epoch': 0.69}

  4%|▍         | 16100/371472 [1:16:32<29:24:45,  3.36it/s]
  4%|▍         | 16101/371472 [1:16:32<29:01:10,  3.40it/s]
  4%|▍         | 16102/371472 [1:16:33<28:08:48,  3.51it/s]
  4%|▍         | 16103/371472 [1:16:33<27:48:15,  3.55it/s]
  4%|▍         | 16104/371472 [1:16:33<27:07:11,  3.64it/s]
  4%|▍         | 16105/371472 [1:16:34<27:31:39,  3.59it/s]
  4%|▍         | 16106/371472 [1:16:34<28:51:20,  3.42it/s]
  4%|▍         | 16107/371472 [1:16:34<28:09:46,  3.51it/s]
  4%|▍         | 16108/371472 [1:16:34<27:15:29,  3.62it/s]
  4%|▍         | 16109/371472 [1:16:35<28:11:47,  3.50it/s]
  4%|▍         | 16110/371472 [1:16:35<29:20:12,  3.36it/s]
  4%|▍         | 16111/371472 [1:16:35<27:41:42,  3.56it/s]
  4%|▍         | 16112/371472 [1:16:36<28:58:40,  3.41it/s]
  4%|▍         | 16113/371472 [1:16:36<28:34:20,  3.45it/s]
  4%|▍         | 16114/371472 [1:16:36<30:02:13,  3.29it/s]
  4%|▍         | 16115/371472 [1:16:36<28:47:02,  3.43it/s]
  4%|▍         | 16116/371472 [1:16:37<28:24:58,  3.47it/s]
  4%|▍         | 16117/371472 [1:16:37<27:05:23,  3.64it/s]
  4%|▍         | 16118/371472 [1:16:37<26:24:09,  3.74it/s]
  4%|▍         | 16119/371472 [1:16:38<27:01:12,  3.65it/s]
  4%|▍         | 16120/371472 [1:16:38<27:09:48,  3.63it/s]
                                                           
{'loss': 4.7132, 'learning_rate': 9.614083475188002e-07, 'epoch': 0.69}

  4%|▍         | 16120/371472 [1:16:38<27:09:48,  3.63it/s]
  4%|▍         | 16121/371472 [1:16:38<26:45:36,  3.69it/s]
  4%|▍         | 16122/371472 [1:16:38<29:10:40,  3.38it/s]
  4%|▍         | 16123/371472 [1:16:39<27:36:11,  3.58it/s]
  4%|▍         | 16124/371472 [1:16:39<26:58:29,  3.66it/s]
  4%|▍         | 16125/371472 [1:16:39<27:41:48,  3.56it/s]
  4%|▍         | 16126/371472 [1:16:40<27:18:55,  3.61it/s]
  4%|▍         | 16127/371472 [1:16:40<29:10:00,  3.38it/s]
  4%|▍         | 16128/371472 [1:16:40<27:53:17,  3.54it/s]
  4%|▍         | 16129/371472 [1:16:40<29:38:23,  3.33it/s]
  4%|▍         | 16130/371472 [1:16:41<29:43:35,  3.32it/s]
  4%|▍         | 16131/371472 [1:16:41<30:09:02,  3.27it/s]
  4%|▍         | 16132/371472 [1:16:41<28:43:58,  3.44it/s]
  4%|▍         | 16133/371472 [1:16:42<27:28:58,  3.59it/s]
  4%|▍         | 16134/371472 [1:16:42<26:44:36,  3.69it/s]
  4%|▍         | 16135/371472 [1:16:42<26:05:08,  3.78it/s]
  4%|▍         | 16136/371472 [1:16:42<25:52:31,  3.81it/s]
  4%|▍         | 16137/371472 [1:16:43<27:49:53,  3.55it/s]
  4%|▍         | 16138/371472 [1:16:43<29:57:20,  3.30it/s]
  4%|▍         | 16139/371472 [1:16:43<29:55:56,  3.30it/s]
  4%|▍         | 16140/371472 [1:16:44<30:42:55,  3.21it/s]
                                                           
{'loss': 4.566, 'learning_rate': 9.613598655433215e-07, 'epoch': 0.7}

  4%|▍         | 16140/371472 [1:16:44<30:42:55,  3.21it/s]
  4%|▍         | 16141/371472 [1:16:44<31:15:36,  3.16it/s]
  4%|▍         | 16142/371472 [1:16:44<29:58:40,  3.29it/s]
  4%|▍         | 16143/371472 [1:16:45<28:56:40,  3.41it/s]
  4%|▍         | 16144/371472 [1:16:45<30:50:33,  3.20it/s]
  4%|▍         | 16145/371472 [1:16:45<29:49:14,  3.31it/s]
  4%|▍         | 16146/371472 [1:16:45<30:05:33,  3.28it/s]
  4%|▍         | 16147/371472 [1:16:46<28:23:02,  3.48it/s]
  4%|▍         | 16148/371472 [1:16:46<27:09:37,  3.63it/s]
  4%|▍         | 16149/371472 [1:16:46<26:20:13,  3.75it/s]
  4%|▍         | 16150/371472 [1:16:47<28:36:34,  3.45it/s]
  4%|▍         | 16151/371472 [1:16:47<28:02:29,  3.52it/s]
  4%|▍         | 16152/371472 [1:16:47<28:20:36,  3.48it/s]
  4%|▍         | 16153/371472 [1:16:47<27:50:47,  3.54it/s]
  4%|▍         | 16154/371472 [1:16:48<28:55:17,  3.41it/s]
  4%|▍         | 16155/371472 [1:16:48<28:38:50,  3.45it/s]
  4%|▍         | 16156/371472 [1:16:48<28:35:38,  3.45it/s]
  4%|▍         | 16157/371472 [1:16:49<27:36:25,  3.58it/s]
  4%|▍         | 16158/371472 [1:16:49<26:58:58,  3.66it/s]
  4%|▍         | 16159/371472 [1:16:49<27:00:52,  3.65it/s]
  4%|▍         | 16160/371472 [1:16:49<27:20:24,  3.61it/s]
                                                           
{'loss': 4.7489, 'learning_rate': 9.613113835678423e-07, 'epoch': 0.7}

  4%|▍         | 16160/371472 [1:16:49<27:20:24,  3.61it/s]
  4%|▍         | 16161/371472 [1:16:50<27:06:46,  3.64it/s]
  4%|▍         | 16162/371472 [1:16:50<26:17:59,  3.75it/s]
  4%|▍         | 16163/371472 [1:16:50<27:53:21,  3.54it/s]
  4%|▍         | 16164/371472 [1:16:50<27:16:37,  3.62it/s]
  4%|▍         | 16165/371472 [1:16:51<26:29:22,  3.73it/s]
  4%|▍         | 16166/371472 [1:16:51<26:17:46,  3.75it/s]
  4%|▍         | 16167/371472 [1:16:51<26:55:17,  3.67it/s]
  4%|▍         | 16168/371472 [1:16:52<26:50:26,  3.68it/s]
  4%|▍         | 16169/371472 [1:16:52<27:34:28,  3.58it/s]
  4%|▍         | 16170/371472 [1:16:52<30:30:49,  3.23it/s]
  4%|▍         | 16171/371472 [1:16:52<29:36:33,  3.33it/s]
  4%|▍         | 16172/371472 [1:16:53<29:24:51,  3.36it/s]
  4%|▍         | 16173/371472 [1:16:53<28:22:53,  3.48it/s]
  4%|▍         | 16174/371472 [1:16:53<28:19:47,  3.48it/s]
  4%|▍         | 16175/371472 [1:16:54<27:36:49,  3.57it/s]
  4%|▍         | 16176/371472 [1:16:54<27:36:08,  3.58it/s]
  4%|▍         | 16177/371472 [1:16:54<27:50:57,  3.54it/s]
  4%|▍         | 16178/371472 [1:16:54<27:38:36,  3.57it/s]
  4%|▍         | 16179/371472 [1:16:55<27:13:41,  3.62it/s]
  4%|▍         | 16180/371472 [1:16:55<27:58:35,  3.53it/s]
                                                           
{'loss': 4.6467, 'learning_rate': 9.612629015923636e-07, 'epoch': 0.7}

  4%|▍         | 16180/371472 [1:16:55<27:58:35,  3.53it/s]
  4%|▍         | 16181/371472 [1:16:55<27:21:59,  3.61it/s]
  4%|▍         | 16182/371472 [1:16:56<26:59:39,  3.66it/s]
  4%|▍         | 16183/371472 [1:16:56<28:58:51,  3.41it/s]
  4%|▍         | 16184/371472 [1:16:56<28:59:46,  3.40it/s]
  4%|▍         | 16185/371472 [1:16:56<28:25:31,  3.47it/s]
  4%|▍         | 16186/371472 [1:16:57<28:08:30,  3.51it/s]
  4%|▍         | 16187/371472 [1:16:57<29:01:58,  3.40it/s]
  4%|▍         | 16188/371472 [1:16:57<29:48:36,  3.31it/s]
  4%|▍         | 16189/371472 [1:16:58<30:32:52,  3.23it/s]
  4%|▍         | 16190/371472 [1:16:58<30:57:14,  3.19it/s]
  4%|▍         | 16191/371472 [1:16:58<31:39:07,  3.12it/s]
  4%|▍         | 16192/371472 [1:16:59<29:48:14,  3.31it/s]
  4%|▍         | 16193/371472 [1:16:59<28:51:57,  3.42it/s]
  4%|▍         | 16194/371472 [1:16:59<28:42:15,  3.44it/s]
  4%|▍         | 16195/371472 [1:16:59<28:44:49,  3.43it/s]
  4%|▍         | 16196/371472 [1:17:00<27:38:15,  3.57it/s]
  4%|▍         | 16197/371472 [1:17:00<28:15:44,  3.49it/s]
  4%|▍         | 16198/371472 [1:17:00<27:40:58,  3.56it/s]
  4%|▍         | 16199/371472 [1:17:01<27:19:13,  3.61it/s]
  4%|▍         | 16200/371472 [1:17:01<27:31:29,  3.59it/s]
                                                           
{'loss': 4.573, 'learning_rate': 9.612144196168845e-07, 'epoch': 0.7}

  4%|▍         | 16200/371472 [1:17:01<27:31:29,  3.59it/s]
  4%|▍         | 16201/371472 [1:17:01<26:58:42,  3.66it/s]
  4%|▍         | 16202/371472 [1:17:01<27:31:03,  3.59it/s]
  4%|▍         | 16203/371472 [1:17:02<26:08:17,  3.78it/s]
  4%|▍         | 16204/371472 [1:17:02<26:22:38,  3.74it/s]
  4%|▍         | 16205/371472 [1:17:02<25:59:50,  3.80it/s]
  4%|▍         | 16206/371472 [1:17:02<26:01:29,  3.79it/s]
  4%|▍         | 16207/371472 [1:17:03<25:49:09,  3.82it/s]
  4%|▍         | 16208/371472 [1:17:03<25:59:26,  3.80it/s]
  4%|▍         | 16209/371472 [1:17:03<26:05:53,  3.78it/s]
  4%|▍         | 16210/371472 [1:17:03<26:01:12,  3.79it/s]
  4%|▍         | 16211/371472 [1:17:04<25:48:42,  3.82it/s]
  4%|▍         | 16212/371472 [1:17:04<26:02:39,  3.79it/s]
  4%|▍         | 16213/371472 [1:17:04<27:42:56,  3.56it/s]
  4%|▍         | 16214/371472 [1:17:05<30:45:52,  3.21it/s]
  4%|▍         | 16215/371472 [1:17:05<30:17:57,  3.26it/s]
  4%|▍         | 16216/371472 [1:17:05<30:02:01,  3.29it/s]
  4%|▍         | 16217/371472 [1:17:06<29:24:39,  3.36it/s]
  4%|▍         | 16218/371472 [1:17:06<29:46:05,  3.32it/s]
  4%|▍         | 16219/371472 [1:17:06<28:10:28,  3.50it/s]
  4%|▍         | 16220/371472 [1:17:06<27:14:32,  3.62it/s]
                                                           
{'loss': 4.778, 'learning_rate': 9.611659376414057e-07, 'epoch': 0.7}

  4%|▍         | 16220/371472 [1:17:06<27:14:32,  3.62it/s]
  4%|▍         | 16221/371472 [1:17:07<28:17:38,  3.49it/s]
  4%|▍         | 16222/371472 [1:17:07<28:01:21,  3.52it/s]
  4%|▍         | 16223/371472 [1:17:07<28:03:22,  3.52it/s]
  4%|▍         | 16224/371472 [1:17:07<27:10:51,  3.63it/s]
  4%|▍         | 16225/371472 [1:17:08<27:29:01,  3.59it/s]
  4%|▍         | 16226/371472 [1:17:08<26:44:41,  3.69it/s]
  4%|▍         | 16227/371472 [1:17:08<26:58:47,  3.66it/s]
  4%|▍         | 16228/371472 [1:17:09<27:07:42,  3.64it/s]
  4%|▍         | 16229/371472 [1:17:09<27:12:39,  3.63it/s]
  4%|▍         | 16230/371472 [1:17:09<30:28:00,  3.24it/s]
  4%|▍         | 16231/371472 [1:17:10<30:17:30,  3.26it/s]
  4%|▍         | 16232/371472 [1:17:10<30:39:05,  3.22it/s]
  4%|▍         | 16233/371472 [1:17:10<29:23:20,  3.36it/s]
  4%|▍         | 16234/371472 [1:17:10<30:35:18,  3.23it/s]
  4%|▍         | 16235/371472 [1:17:11<28:53:58,  3.41it/s]
  4%|▍         | 16236/371472 [1:17:11<33:05:15,  2.98it/s]
  4%|▍         | 16237/371472 [1:17:11<31:49:03,  3.10it/s]
  4%|▍         | 16238/371472 [1:17:12<31:01:29,  3.18it/s]
  4%|▍         | 16239/371472 [1:17:12<30:04:51,  3.28it/s]
  4%|▍         | 16240/371472 [1:17:12<30:33:38,  3.23it/s]
                                                           
{'loss': 4.2616, 'learning_rate': 9.611174556659268e-07, 'epoch': 0.7}

  4%|▍         | 16240/371472 [1:17:12<30:33:38,  3.23it/s]
  4%|▍         | 16241/371472 [1:17:13<29:25:18,  3.35it/s]
  4%|▍         | 16242/371472 [1:17:13<28:35:04,  3.45it/s]
  4%|▍         | 16243/371472 [1:17:13<28:04:09,  3.52it/s]
  4%|▍         | 16244/371472 [1:17:13<27:15:38,  3.62it/s]
  4%|▍         | 16245/371472 [1:17:14<28:14:33,  3.49it/s]
  4%|▍         | 16246/371472 [1:17:14<27:03:18,  3.65it/s]
  4%|▍         | 16247/371472 [1:17:14<27:30:02,  3.59it/s]
  4%|▍         | 16248/371472 [1:17:15<26:59:45,  3.66it/s]
  4%|▍         | 16249/371472 [1:17:15<26:46:45,  3.68it/s]
  4%|▍         | 16250/371472 [1:17:15<26:38:30,  3.70it/s]
  4%|▍         | 16251/371472 [1:17:16<32:33:44,  3.03it/s]
  4%|▍         | 16252/371472 [1:17:16<30:36:49,  3.22it/s]
  4%|▍         | 16253/371472 [1:17:16<29:36:18,  3.33it/s]
  4%|▍         | 16254/371472 [1:17:16<29:04:16,  3.39it/s]
  4%|▍         | 16255/371472 [1:17:17<28:38:36,  3.44it/s]
  4%|▍         | 16256/371472 [1:17:17<28:32:44,  3.46it/s]
  4%|▍         | 16257/371472 [1:17:17<27:50:32,  3.54it/s]
  4%|▍         | 16258/371472 [1:17:17<27:27:15,  3.59it/s]
  4%|▍         | 16259/371472 [1:17:18<28:02:33,  3.52it/s]
  4%|▍         | 16260/371472 [1:17:18<27:54:07,  3.54it/s]
                                                           
{'loss': 4.5403, 'learning_rate': 9.610689736904479e-07, 'epoch': 0.7}

  4%|▍         | 16260/371472 [1:17:18<27:54:07,  3.54it/s]
  4%|▍         | 16261/371472 [1:17:18<29:48:51,  3.31it/s]
  4%|▍         | 16262/371472 [1:17:19<28:50:18,  3.42it/s]
  4%|▍         | 16263/371472 [1:17:19<28:37:22,  3.45it/s]
  4%|▍         | 16264/371472 [1:17:19<27:24:08,  3.60it/s]
  4%|▍         | 16265/371472 [1:17:19<27:28:19,  3.59it/s]
  4%|▍         | 16266/371472 [1:17:20<27:01:25,  3.65it/s]
  4%|▍         | 16267/371472 [1:17:20<26:45:17,  3.69it/s]
  4%|▍         | 16268/371472 [1:17:20<25:47:34,  3.83it/s]
  4%|▍         | 16269/371472 [1:17:21<26:52:42,  3.67it/s]
  4%|▍         | 16270/371472 [1:17:21<26:16:37,  3.75it/s]
  4%|▍         | 16271/371472 [1:17:21<28:26:42,  3.47it/s]
  4%|▍         | 16272/371472 [1:17:21<30:31:31,  3.23it/s]
  4%|▍         | 16273/371472 [1:17:22<33:18:43,  2.96it/s]
  4%|▍         | 16274/371472 [1:17:22<31:30:22,  3.13it/s]
  4%|▍         | 16275/371472 [1:17:22<29:16:39,  3.37it/s]
  4%|▍         | 16276/371472 [1:17:23<29:10:41,  3.38it/s]
  4%|▍         | 16277/371472 [1:17:23<28:45:38,  3.43it/s]
  4%|▍         | 16278/371472 [1:17:23<28:20:07,  3.48it/s]
  4%|▍         | 16279/371472 [1:17:24<27:09:07,  3.63it/s]
  4%|▍         | 16280/371472 [1:17:24<29:25:42,  3.35it/s]
                                                           
{'loss': 4.436, 'learning_rate': 9.610204917149692e-07, 'epoch': 0.7}

  4%|▍         | 16280/371472 [1:17:24<29:25:42,  3.35it/s]
  4%|▍         | 16281/371472 [1:17:24<29:35:33,  3.33it/s]
  4%|▍         | 16282/371472 [1:17:24<28:08:07,  3.51it/s]
  4%|▍         | 16283/371472 [1:17:25<28:09:25,  3.50it/s]
  4%|▍         | 16284/371472 [1:17:25<29:22:24,  3.36it/s]
  4%|▍         | 16285/371472 [1:17:25<28:13:03,  3.50it/s]
  4%|▍         | 16286/371472 [1:17:26<29:12:09,  3.38it/s]
  4%|▍         | 16287/371472 [1:17:26<29:57:23,  3.29it/s]
  4%|▍         | 16288/371472 [1:17:26<28:31:23,  3.46it/s]
  4%|▍         | 16289/371472 [1:17:26<27:35:51,  3.58it/s]
  4%|▍         | 16290/371472 [1:17:27<27:22:43,  3.60it/s]
  4%|▍         | 16291/371472 [1:17:27<30:26:51,  3.24it/s]
  4%|▍         | 16292/371472 [1:17:27<28:57:35,  3.41it/s]
  4%|▍         | 16293/371472 [1:17:28<28:00:06,  3.52it/s]
  4%|▍         | 16294/371472 [1:17:28<30:28:26,  3.24it/s]
  4%|▍         | 16295/371472 [1:17:28<29:37:57,  3.33it/s]
  4%|▍         | 16296/371472 [1:17:29<28:53:07,  3.42it/s]
  4%|▍         | 16297/371472 [1:17:29<29:32:55,  3.34it/s]
  4%|▍         | 16298/371472 [1:17:29<29:18:45,  3.37it/s]
  4%|▍         | 16299/371472 [1:17:29<30:42:59,  3.21it/s]
  4%|▍         | 16300/371472 [1:17:30<29:29:58,  3.34it/s]
                                                           
{'loss': 4.7559, 'learning_rate': 9.6097200973949e-07, 'epoch': 0.7}

  4%|▍         | 16300/371472 [1:17:30<29:29:58,  3.34it/s]
  4%|▍         | 16301/371472 [1:17:30<31:02:11,  3.18it/s]
  4%|▍         | 16302/371472 [1:17:30<30:41:21,  3.21it/s]
  4%|▍         | 16303/371472 [1:17:31<28:47:14,  3.43it/s]
  4%|▍         | 16304/371472 [1:17:31<27:32:20,  3.58it/s]
  4%|▍         | 16305/371472 [1:17:31<29:07:28,  3.39it/s]
  4%|▍         | 16306/371472 [1:17:31<27:56:53,  3.53it/s]
  4%|▍         | 16307/371472 [1:17:32<27:20:56,  3.61it/s]
  4%|▍         | 16308/371472 [1:17:32<28:00:28,  3.52it/s]
  4%|▍         | 16309/371472 [1:17:32<26:44:38,  3.69it/s]
  4%|▍         | 16310/371472 [1:17:33<26:29:20,  3.72it/s]
  4%|▍         | 16311/371472 [1:17:33<26:58:17,  3.66it/s]
  4%|▍         | 16312/371472 [1:17:33<26:58:48,  3.66it/s]
  4%|▍         | 16313/371472 [1:17:33<27:21:39,  3.61it/s]
  4%|▍         | 16314/371472 [1:17:34<27:47:23,  3.55it/s]
  4%|▍         | 16315/371472 [1:17:34<27:05:09,  3.64it/s]
  4%|▍         | 16316/371472 [1:17:34<26:27:35,  3.73it/s]
  4%|▍         | 16317/371472 [1:17:35<28:57:44,  3.41it/s]
  4%|▍         | 16318/371472 [1:17:35<29:45:35,  3.32it/s]
  4%|▍         | 16319/371472 [1:17:35<28:21:36,  3.48it/s]
  4%|▍         | 16320/371472 [1:17:35<29:05:52,  3.39it/s]
                                                           
{'loss': 4.5752, 'learning_rate': 9.609235277640113e-07, 'epoch': 0.7}

  4%|▍         | 16320/371472 [1:17:35<29:05:52,  3.39it/s]
  4%|▍         | 16321/371472 [1:17:36<27:40:32,  3.56it/s]
  4%|▍         | 16322/371472 [1:17:36<27:00:43,  3.65it/s]
  4%|▍         | 16323/371472 [1:17:36<26:47:51,  3.68it/s]
  4%|▍         | 16324/371472 [1:17:36<26:34:02,  3.71it/s]
  4%|▍         | 16325/371472 [1:17:37<26:08:18,  3.77it/s]
  4%|▍         | 16326/371472 [1:17:37<25:26:42,  3.88it/s]
  4%|▍         | 16327/371472 [1:17:37<27:58:32,  3.53it/s]
  4%|▍         | 16328/371472 [1:17:38<29:16:45,  3.37it/s]
  4%|▍         | 16329/371472 [1:17:38<28:06:49,  3.51it/s]
  4%|▍         | 16330/371472 [1:17:38<27:42:13,  3.56it/s]
  4%|▍         | 16331/371472 [1:17:38<27:13:24,  3.62it/s]
  4%|▍         | 16332/371472 [1:17:39<28:07:36,  3.51it/s]
  4%|▍         | 16333/371472 [1:17:39<27:45:48,  3.55it/s]
  4%|▍         | 16334/371472 [1:17:39<26:53:17,  3.67it/s]
  4%|▍         | 16335/371472 [1:17:40<26:17:08,  3.75it/s]
  4%|▍         | 16336/371472 [1:17:40<26:57:53,  3.66it/s]
  4%|▍         | 16337/371472 [1:17:40<27:18:05,  3.61it/s]
  4%|▍         | 16338/371472 [1:17:40<27:26:07,  3.60it/s]
  4%|▍         | 16339/371472 [1:17:41<27:52:24,  3.54it/s]
  4%|▍         | 16340/371472 [1:17:41<27:08:33,  3.63it/s]
                                                           
{'loss': 4.7316, 'learning_rate': 9.608750457885324e-07, 'epoch': 0.7}

  4%|▍         | 16340/371472 [1:17:41<27:08:33,  3.63it/s]
  4%|▍         | 16341/371472 [1:17:41<26:27:18,  3.73it/s]
  4%|▍         | 16342/371472 [1:17:41<27:03:39,  3.65it/s]
  4%|▍         | 16343/371472 [1:17:42<27:30:12,  3.59it/s]
  4%|▍         | 16344/371472 [1:17:42<26:48:02,  3.68it/s]
  4%|▍         | 16345/371472 [1:17:42<27:21:30,  3.61it/s]
  4%|▍         | 16346/371472 [1:17:43<26:31:16,  3.72it/s]
  4%|▍         | 16347/371472 [1:17:43<26:58:59,  3.66it/s]
  4%|▍         | 16348/371472 [1:17:43<27:47:56,  3.55it/s]
  4%|▍         | 16349/371472 [1:17:43<27:37:57,  3.57it/s]
  4%|▍         | 16350/371472 [1:17:44<27:07:58,  3.64it/s]
  4%|▍         | 16351/371472 [1:17:44<27:26:54,  3.59it/s]
  4%|▍         | 16352/371472 [1:17:44<27:39:37,  3.57it/s]
  4%|▍         | 16353/371472 [1:17:45<27:34:24,  3.58it/s]
  4%|▍         | 16354/371472 [1:17:45<27:34:07,  3.58it/s]
  4%|▍         | 16355/371472 [1:17:45<26:49:31,  3.68it/s]
  4%|▍         | 16356/371472 [1:17:45<26:21:58,  3.74it/s]
  4%|▍         | 16357/371472 [1:17:46<26:22:50,  3.74it/s]
  4%|▍         | 16358/371472 [1:17:46<28:10:50,  3.50it/s]
  4%|▍         | 16359/371472 [1:17:46<27:42:52,  3.56it/s]
  4%|▍         | 16360/371472 [1:17:46<26:46:23,  3.68it/s]
                                                           
{'loss': 4.6856, 'learning_rate': 9.608265638130535e-07, 'epoch': 0.7}

  4%|▍         | 16360/371472 [1:17:46<26:46:23,  3.68it/s]
  4%|▍         | 16361/371472 [1:17:47<27:51:53,  3.54it/s]
  4%|▍         | 16362/371472 [1:17:47<27:07:26,  3.64it/s]
  4%|▍         | 16363/371472 [1:17:47<27:31:38,  3.58it/s]
  4%|▍         | 16364/371472 [1:17:48<28:11:15,  3.50it/s]
  4%|▍         | 16365/371472 [1:17:48<27:31:17,  3.58it/s]
  4%|▍         | 16366/371472 [1:17:48<32:35:26,  3.03it/s]
  4%|▍         | 16367/371472 [1:17:49<30:49:59,  3.20it/s]
  4%|▍         | 16368/371472 [1:17:49<32:41:06,  3.02it/s]
  4%|▍         | 16369/371472 [1:17:49<32:37:51,  3.02it/s]
  4%|▍         | 16370/371472 [1:17:50<31:16:40,  3.15it/s]
  4%|▍         | 16371/371472 [1:17:50<29:53:02,  3.30it/s]
  4%|▍         | 16372/371472 [1:17:50<28:46:55,  3.43it/s]
  4%|▍         | 16373/371472 [1:17:50<28:21:27,  3.48it/s]
  4%|▍         | 16374/371472 [1:17:51<27:47:40,  3.55it/s]
  4%|▍         | 16375/371472 [1:17:51<27:20:57,  3.61it/s]
  4%|▍         | 16376/371472 [1:17:51<27:16:06,  3.62it/s]
  4%|▍         | 16377/371472 [1:17:51<27:18:17,  3.61it/s]
  4%|▍         | 16378/371472 [1:17:52<28:59:25,  3.40it/s]
  4%|▍         | 16379/371472 [1:17:52<30:10:29,  3.27it/s]
  4%|▍         | 16380/371472 [1:17:53<32:44:23,  3.01it/s]
                                                           
{'loss': 4.4327, 'learning_rate': 9.607780818375745e-07, 'epoch': 0.71}

  4%|▍         | 16380/371472 [1:17:53<32:44:23,  3.01it/s]
  4%|▍         | 16381/371472 [1:17:53<30:10:43,  3.27it/s]
  4%|▍         | 16382/371472 [1:17:53<29:13:30,  3.38it/s]
  4%|▍         | 16383/371472 [1:17:53<27:37:49,  3.57it/s]
  4%|▍         | 16384/371472 [1:17:54<27:04:12,  3.64it/s]
  4%|▍         | 16385/371472 [1:17:54<27:28:23,  3.59it/s]
  4%|▍         | 16386/371472 [1:17:54<27:15:32,  3.62it/s]
  4%|▍         | 16387/371472 [1:17:54<27:17:45,  3.61it/s]
  4%|▍         | 16388/371472 [1:17:55<27:51:08,  3.54it/s]
  4%|▍         | 16389/371472 [1:17:55<27:52:13,  3.54it/s]
  4%|▍         | 16390/371472 [1:17:55<29:37:48,  3.33it/s]
  4%|▍         | 16391/371472 [1:17:56<29:06:08,  3.39it/s]
  4%|▍         | 16392/371472 [1:17:56<28:17:31,  3.49it/s]
  4%|▍         | 16393/371472 [1:17:56<29:12:31,  3.38it/s]
  4%|▍         | 16394/371472 [1:17:56<29:01:22,  3.40it/s]
  4%|▍         | 16395/371472 [1:17:57<29:52:33,  3.30it/s]
  4%|▍         | 16396/371472 [1:17:57<28:17:46,  3.49it/s]
  4%|▍         | 16397/371472 [1:17:57<28:19:32,  3.48it/s]
  4%|▍         | 16398/371472 [1:17:58<26:44:35,  3.69it/s]
  4%|▍         | 16399/371472 [1:17:58<27:26:46,  3.59it/s]
  4%|▍         | 16400/371472 [1:17:58<28:37:40,  3.45it/s]
                                                           
{'loss': 4.5428, 'learning_rate': 9.607295998620956e-07, 'epoch': 0.71}

  4%|▍         | 16400/371472 [1:17:58<28:37:40,  3.45it/s]
  4%|▍         | 16401/371472 [1:17:59<29:46:44,  3.31it/s]
  4%|▍         | 16402/371472 [1:17:59<28:16:15,  3.49it/s]
  4%|▍         | 16403/371472 [1:17:59<28:57:00,  3.41it/s]
  4%|▍         | 16404/371472 [1:17:59<28:09:34,  3.50it/s]
  4%|▍         | 16405/371472 [1:18:00<28:56:26,  3.41it/s]
  4%|▍         | 16406/371472 [1:18:00<28:18:51,  3.48it/s]
  4%|▍         | 16407/371472 [1:18:00<28:27:21,  3.47it/s]
  4%|▍         | 16408/371472 [1:18:00<28:32:52,  3.45it/s]
  4%|▍         | 16409/371472 [1:18:01<30:11:02,  3.27it/s]
  4%|▍         | 16410/371472 [1:18:01<29:35:43,  3.33it/s]
  4%|▍         | 16411/371472 [1:18:01<29:10:37,  3.38it/s]
  4%|▍         | 16412/371472 [1:18:02<29:26:57,  3.35it/s]
  4%|▍         | 16413/371472 [1:18:02<32:16:32,  3.06it/s]
  4%|▍         | 16414/371472 [1:18:02<31:35:39,  3.12it/s]
  4%|▍         | 16415/371472 [1:18:03<31:28:07,  3.13it/s]
  4%|▍         | 16416/371472 [1:18:03<29:20:11,  3.36it/s]
  4%|▍         | 16417/371472 [1:18:03<27:46:55,  3.55it/s]
  4%|▍         | 16418/371472 [1:18:04<28:04:20,  3.51it/s]
  4%|▍         | 16419/371472 [1:18:04<28:11:27,  3.50it/s]
  4%|▍         | 16420/371472 [1:18:04<28:37:12,  3.45it/s]
                                                           
{'loss': 4.4309, 'learning_rate': 9.606811178866169e-07, 'epoch': 0.71}

  4%|▍         | 16420/371472 [1:18:04<28:37:12,  3.45it/s]
  4%|▍         | 16421/371472 [1:18:04<28:08:54,  3.50it/s]
  4%|▍         | 16422/371472 [1:18:05<28:48:02,  3.42it/s]
  4%|▍         | 16423/371472 [1:18:05<30:21:38,  3.25it/s]
  4%|▍         | 16424/371472 [1:18:05<29:33:25,  3.34it/s]
  4%|▍         | 16425/371472 [1:18:06<28:31:43,  3.46it/s]
  4%|▍         | 16426/371472 [1:18:06<27:40:03,  3.56it/s]
  4%|▍         | 16427/371472 [1:18:06<27:52:34,  3.54it/s]
  4%|▍         | 16428/371472 [1:18:06<28:02:47,  3.52it/s]
  4%|▍         | 16429/371472 [1:18:07<27:10:03,  3.63it/s]
  4%|▍         | 16430/371472 [1:18:07<28:05:11,  3.51it/s]
  4%|▍         | 16431/371472 [1:18:07<29:28:52,  3.35it/s]
  4%|▍         | 16432/371472 [1:18:08<28:26:09,  3.47it/s]
  4%|▍         | 16433/371472 [1:18:08<28:04:18,  3.51it/s]
  4%|▍         | 16434/371472 [1:18:08<28:54:18,  3.41it/s]
  4%|▍         | 16435/371472 [1:18:08<29:19:42,  3.36it/s]
  4%|▍         | 16436/371472 [1:18:09<28:35:22,  3.45it/s]
  4%|▍         | 16437/371472 [1:18:09<28:03:44,  3.51it/s]
  4%|▍         | 16438/371472 [1:18:09<27:46:10,  3.55it/s]
  4%|▍         | 16439/371472 [1:18:10<27:21:07,  3.61it/s]
  4%|▍         | 16440/371472 [1:18:10<27:59:54,  3.52it/s]
                                                           
{'loss': 4.8195, 'learning_rate': 9.606326359111377e-07, 'epoch': 0.71}

  4%|▍         | 16440/371472 [1:18:10<27:59:54,  3.52it/s]
  4%|▍         | 16441/371472 [1:18:10<28:57:26,  3.41it/s]
  4%|▍         | 16442/371472 [1:18:10<28:42:27,  3.44it/s]
  4%|▍         | 16443/371472 [1:18:11<28:21:55,  3.48it/s]
  4%|▍         | 16444/371472 [1:18:11<27:39:46,  3.57it/s]
  4%|▍         | 16445/371472 [1:18:11<27:25:58,  3.59it/s]
  4%|▍         | 16446/371472 [1:18:12<27:07:03,  3.64it/s]
  4%|▍         | 16447/371472 [1:18:12<26:28:45,  3.72it/s]
  4%|▍         | 16448/371472 [1:18:12<26:05:50,  3.78it/s]
  4%|▍         | 16449/371472 [1:18:12<26:03:31,  3.78it/s]
  4%|▍         | 16450/371472 [1:18:13<26:16:24,  3.75it/s]
  4%|▍         | 16451/371472 [1:18:13<25:49:43,  3.82it/s]
  4%|▍         | 16452/371472 [1:18:13<26:27:07,  3.73it/s]
  4%|▍         | 16453/371472 [1:18:13<26:10:54,  3.77it/s]
  4%|▍         | 16454/371472 [1:18:14<25:49:06,  3.82it/s]
  4%|▍         | 16455/371472 [1:18:14<26:34:27,  3.71it/s]
  4%|▍         | 16456/371472 [1:18:14<27:33:53,  3.58it/s]
  4%|▍         | 16457/371472 [1:18:14<27:06:32,  3.64it/s]
  4%|▍         | 16458/371472 [1:18:15<26:51:03,  3.67it/s]
  4%|▍         | 16459/371472 [1:18:15<26:51:27,  3.67it/s]
  4%|▍         | 16460/371472 [1:18:15<25:55:10,  3.80it/s]
                                                           
{'loss': 4.7752, 'learning_rate': 9.60584153935659e-07, 'epoch': 0.71}

  4%|▍         | 16460/371472 [1:18:15<25:55:10,  3.80it/s]
  4%|▍         | 16461/371472 [1:18:16<25:54:57,  3.81it/s]
  4%|▍         | 16462/371472 [1:18:16<26:32:51,  3.71it/s]
  4%|▍         | 16463/371472 [1:18:16<26:05:16,  3.78it/s]
  4%|▍         | 16464/371472 [1:18:16<26:41:47,  3.69it/s]
  4%|▍         | 16465/371472 [1:18:17<27:00:14,  3.65it/s]
  4%|▍         | 16466/371472 [1:18:17<27:08:51,  3.63it/s]
  4%|▍         | 16467/371472 [1:18:17<28:53:52,  3.41it/s]
  4%|▍         | 16468/371472 [1:18:18<29:08:52,  3.38it/s]
  4%|▍         | 16469/371472 [1:18:18<30:29:03,  3.23it/s]
  4%|▍         | 16470/371472 [1:18:18<30:26:31,  3.24it/s]
  4%|▍         | 16471/371472 [1:18:18<29:12:49,  3.38it/s]
  4%|▍         | 16472/371472 [1:18:19<27:59:59,  3.52it/s]
  4%|▍         | 16473/371472 [1:18:19<27:00:47,  3.65it/s]
  4%|▍         | 16474/371472 [1:18:19<26:33:37,  3.71it/s]
  4%|▍         | 16475/371472 [1:18:20<29:32:41,  3.34it/s]
  4%|▍         | 16476/371472 [1:18:20<29:13:25,  3.37it/s]
  4%|▍         | 16477/371472 [1:18:20<27:51:07,  3.54it/s]
  4%|▍         | 16478/371472 [1:18:20<26:58:55,  3.65it/s]
  4%|▍         | 16479/371472 [1:18:21<26:22:16,  3.74it/s]
  4%|▍         | 16480/371472 [1:18:21<26:37:42,  3.70it/s]
                                                           
{'loss': 4.8154, 'learning_rate': 9.6053567196018e-07, 'epoch': 0.71}

  4%|▍         | 16480/371472 [1:18:21<26:37:42,  3.70it/s]
  4%|▍         | 16481/371472 [1:18:21<26:39:25,  3.70it/s]
  4%|▍         | 16482/371472 [1:18:22<28:36:15,  3.45it/s]
  4%|▍         | 16483/371472 [1:18:22<29:13:09,  3.37it/s]
  4%|▍         | 16484/371472 [1:18:22<30:50:46,  3.20it/s]
  4%|▍         | 16485/371472 [1:18:22<29:30:06,  3.34it/s]
  4%|▍         | 16486/371472 [1:18:23<28:26:27,  3.47it/s]
  4%|▍         | 16487/371472 [1:18:23<29:30:28,  3.34it/s]
  4%|▍         | 16488/371472 [1:18:23<28:07:14,  3.51it/s]
  4%|▍         | 16489/371472 [1:18:24<29:21:15,  3.36it/s]
  4%|▍         | 16490/371472 [1:18:24<30:50:49,  3.20it/s]
  4%|▍         | 16491/371472 [1:18:24<29:52:50,  3.30it/s]
  4%|▍         | 16492/371472 [1:18:25<29:09:03,  3.38it/s]
  4%|▍         | 16493/371472 [1:18:25<27:50:26,  3.54it/s]
  4%|▍         | 16494/371472 [1:18:25<27:26:11,  3.59it/s]
  4%|▍         | 16495/371472 [1:18:25<27:22:29,  3.60it/s]
  4%|▍         | 16496/371472 [1:18:26<27:56:28,  3.53it/s]
  4%|▍         | 16497/371472 [1:18:26<29:06:35,  3.39it/s]
  4%|▍         | 16498/371472 [1:18:26<28:59:37,  3.40it/s]
  4%|▍         | 16499/371472 [1:18:27<28:25:22,  3.47it/s]
  4%|▍         | 16500/371472 [1:18:27<27:50:53,  3.54it/s]
                                                           
{'loss': 4.3601, 'learning_rate': 9.604871899847012e-07, 'epoch': 0.71}

  4%|▍         | 16500/371472 [1:18:27<27:50:53,  3.54it/s]
  4%|▍         | 16501/371472 [1:18:27<28:13:01,  3.49it/s]
  4%|▍         | 16502/371472 [1:18:27<28:56:27,  3.41it/s]
  4%|▍         | 16503/371472 [1:18:28<27:39:15,  3.57it/s]
  4%|▍         | 16504/371472 [1:18:28<28:05:30,  3.51it/s]
  4%|▍         | 16505/371472 [1:18:28<28:26:30,  3.47it/s]
  4%|▍         | 16506/371472 [1:18:29<28:10:52,  3.50it/s]
  4%|▍         | 16507/371472 [1:18:29<27:11:49,  3.63it/s]
  4%|▍         | 16508/371472 [1:18:29<27:39:19,  3.57it/s]
  4%|▍         | 16509/371472 [1:18:29<28:59:23,  3.40it/s]
  4%|▍         | 16510/371472 [1:18:30<30:13:33,  3.26it/s]
  4%|▍         | 16511/371472 [1:18:30<29:21:59,  3.36it/s]
  4%|▍         | 16512/371472 [1:18:30<28:13:50,  3.49it/s]
  4%|▍         | 16513/371472 [1:18:31<29:51:18,  3.30it/s]
  4%|▍         | 16514/371472 [1:18:31<29:19:44,  3.36it/s]
  4%|▍         | 16515/371472 [1:18:31<28:01:49,  3.52it/s]
  4%|▍         | 16516/371472 [1:18:31<27:06:20,  3.64it/s]
  4%|▍         | 16517/371472 [1:18:32<27:49:08,  3.54it/s]
  4%|▍         | 16518/371472 [1:18:32<28:31:33,  3.46it/s]
  4%|▍         | 16519/371472 [1:18:32<27:35:46,  3.57it/s]
  4%|▍         | 16520/371472 [1:18:33<27:31:33,  3.58it/s]
                                                           
{'loss': 4.7314, 'learning_rate': 9.604387080092225e-07, 'epoch': 0.71}

  4%|▍         | 16520/371472 [1:18:33<27:31:33,  3.58it/s]
  4%|▍         | 16521/371472 [1:18:33<28:11:20,  3.50it/s]
  4%|▍         | 16522/371472 [1:18:33<29:42:15,  3.32it/s]
  4%|▍         | 16523/371472 [1:18:33<29:34:45,  3.33it/s]
  4%|▍         | 16524/371472 [1:18:34<29:30:23,  3.34it/s]
  4%|▍         | 16525/371472 [1:18:34<27:52:33,  3.54it/s]
  4%|▍         | 16526/371472 [1:18:34<26:58:41,  3.65it/s]
  4%|▍         | 16527/371472 [1:18:35<27:33:22,  3.58it/s]
  4%|▍         | 16528/371472 [1:18:35<27:31:48,  3.58it/s]
  4%|▍         | 16529/371472 [1:18:35<26:53:32,  3.67it/s]
  4%|▍         | 16530/371472 [1:18:35<27:07:23,  3.64it/s]
  4%|▍         | 16531/371472 [1:18:36<28:49:57,  3.42it/s]
  4%|▍         | 16532/371472 [1:18:36<29:45:21,  3.31it/s]
  4%|▍         | 16533/371472 [1:18:36<30:20:32,  3.25it/s]
  4%|▍         | 16534/371472 [1:18:37<31:17:44,  3.15it/s]
  4%|▍         | 16535/371472 [1:18:37<29:43:01,  3.32it/s]
  4%|▍         | 16536/371472 [1:18:37<28:15:43,  3.49it/s]
  4%|▍         | 16537/371472 [1:18:37<27:14:30,  3.62it/s]
  4%|▍         | 16538/371472 [1:18:38<26:32:23,  3.71it/s]
  4%|▍         | 16539/371472 [1:18:38<27:44:52,  3.55it/s]
  4%|▍         | 16540/371472 [1:18:38<29:25:26,  3.35it/s]
                                                           
{'loss': 4.588, 'learning_rate': 9.603902260337433e-07, 'epoch': 0.71}

  4%|▍         | 16540/371472 [1:18:38<29:25:26,  3.35it/s]
  4%|▍         | 16541/371472 [1:18:39<29:33:59,  3.33it/s]
  4%|▍         | 16542/371472 [1:18:39<29:18:10,  3.36it/s]
  4%|▍         | 16543/371472 [1:18:39<30:48:03,  3.20it/s]
  4%|▍         | 16544/371472 [1:18:40<29:15:10,  3.37it/s]
  4%|▍         | 16545/371472 [1:18:40<27:58:57,  3.52it/s]
  4%|▍         | 16546/371472 [1:18:40<28:03:45,  3.51it/s]
  4%|▍         | 16547/371472 [1:18:40<27:51:35,  3.54it/s]
  4%|▍         | 16548/371472 [1:18:41<29:46:03,  3.31it/s]
  4%|▍         | 16549/371472 [1:18:41<28:33:31,  3.45it/s]
  4%|▍         | 16550/371472 [1:18:41<29:38:02,  3.33it/s]
  4%|▍         | 16551/371472 [1:18:42<29:09:28,  3.38it/s]
  4%|▍         | 16552/371472 [1:18:42<27:41:17,  3.56it/s]
  4%|▍         | 16553/371472 [1:18:42<28:09:29,  3.50it/s]
  4%|▍         | 16554/371472 [1:18:42<27:48:49,  3.54it/s]
  4%|▍         | 16555/371472 [1:18:43<29:27:31,  3.35it/s]
  4%|▍         | 16556/371472 [1:18:43<28:16:00,  3.49it/s]
  4%|▍         | 16557/371472 [1:18:43<27:40:32,  3.56it/s]
  4%|▍         | 16558/371472 [1:18:44<27:03:46,  3.64it/s]
  4%|▍         | 16559/371472 [1:18:44<26:36:31,  3.71it/s]
  4%|▍         | 16560/371472 [1:18:44<26:27:03,  3.73it/s]
                                                           
{'loss': 4.7045, 'learning_rate': 9.603417440582646e-07, 'epoch': 0.71}

  4%|▍         | 16560/371472 [1:18:44<26:27:03,  3.73it/s]
  4%|▍         | 16561/371472 [1:18:44<27:17:16,  3.61it/s]
  4%|▍         | 16562/371472 [1:18:45<27:22:46,  3.60it/s]
  4%|▍         | 16563/371472 [1:18:45<26:43:24,  3.69it/s]
  4%|▍         | 16564/371472 [1:18:45<26:56:32,  3.66it/s]
  4%|▍         | 16565/371472 [1:18:45<26:57:31,  3.66it/s]
  4%|▍         | 16566/371472 [1:18:46<27:26:19,  3.59it/s]
  4%|▍         | 16567/371472 [1:18:46<26:40:18,  3.70it/s]
  4%|▍         | 16568/371472 [1:18:46<32:09:12,  3.07it/s]
  4%|▍         | 16569/371472 [1:18:47<31:16:21,  3.15it/s]
  4%|▍         | 16570/371472 [1:18:47<30:22:13,  3.25it/s]
  4%|▍         | 16571/371472 [1:18:47<29:05:56,  3.39it/s]
  4%|▍         | 16572/371472 [1:18:48<29:07:50,  3.38it/s]
  4%|▍         | 16573/371472 [1:18:48<28:49:39,  3.42it/s]
  4%|▍         | 16574/371472 [1:18:48<29:58:37,  3.29it/s]
  4%|▍         | 16575/371472 [1:18:48<28:51:55,  3.42it/s]
  4%|▍         | 16576/371472 [1:18:49<29:17:43,  3.37it/s]
  4%|▍         | 16577/371472 [1:18:49<27:59:39,  3.52it/s]
  4%|▍         | 16578/371472 [1:18:49<27:50:06,  3.54it/s]
  4%|▍         | 16579/371472 [1:18:50<27:41:20,  3.56it/s]
  4%|▍         | 16580/371472 [1:18:50<27:54:05,  3.53it/s]
                                                           
{'loss': 4.5338, 'learning_rate': 9.602932620827855e-07, 'epoch': 0.71}

  4%|▍         | 16580/371472 [1:18:50<27:54:05,  3.53it/s]
  4%|▍         | 16581/371472 [1:18:50<27:02:38,  3.65it/s]
  4%|▍         | 16582/371472 [1:18:50<27:20:48,  3.60it/s]
  4%|▍         | 16583/371472 [1:18:51<26:59:40,  3.65it/s]
  4%|▍         | 16584/371472 [1:18:51<26:55:02,  3.66it/s]
  4%|▍         | 16585/371472 [1:18:51<26:11:31,  3.76it/s]
  4%|▍         | 16586/371472 [1:18:51<26:11:57,  3.76it/s]
  4%|▍         | 16587/371472 [1:18:52<25:56:54,  3.80it/s]
  4%|▍         | 16588/371472 [1:18:52<25:56:57,  3.80it/s]
  4%|▍         | 16589/371472 [1:18:52<26:26:33,  3.73it/s]
  4%|▍         | 16590/371472 [1:18:53<26:24:59,  3.73it/s]
  4%|▍         | 16591/371472 [1:18:53<25:56:42,  3.80it/s]
  4%|▍         | 16592/371472 [1:18:53<26:06:23,  3.78it/s]
  4%|▍         | 16593/371472 [1:18:53<26:41:18,  3.69it/s]
  4%|▍         | 16594/371472 [1:18:54<27:21:16,  3.60it/s]
  4%|▍         | 16595/371472 [1:18:54<26:34:52,  3.71it/s]
  4%|▍         | 16596/371472 [1:18:54<27:12:38,  3.62it/s]
  4%|▍         | 16597/371472 [1:18:54<26:43:44,  3.69it/s]
  4%|▍         | 16598/371472 [1:18:55<27:17:46,  3.61it/s]
  4%|▍         | 16599/371472 [1:18:55<26:44:45,  3.69it/s]
  4%|▍         | 16600/371472 [1:18:55<26:19:19,  3.74it/s]
                                                           
{'loss': 4.9495, 'learning_rate': 9.602447801073067e-07, 'epoch': 0.71}

  4%|▍         | 16600/371472 [1:18:55<26:19:19,  3.74it/s]
  4%|▍         | 16601/371472 [1:18:56<27:33:38,  3.58it/s]
  4%|▍         | 16602/371472 [1:18:56<26:23:09,  3.74it/s]
  4%|▍         | 16603/371472 [1:18:56<26:58:41,  3.65it/s]
  4%|▍         | 16604/371472 [1:18:56<27:54:58,  3.53it/s]
  4%|▍         | 16605/371472 [1:18:57<28:34:25,  3.45it/s]
  4%|▍         | 16606/371472 [1:18:57<28:44:18,  3.43it/s]
  4%|▍         | 16607/371472 [1:18:57<27:53:39,  3.53it/s]
  4%|▍         | 16608/371472 [1:18:58<28:54:21,  3.41it/s]
  4%|▍         | 16609/371472 [1:18:58<28:41:01,  3.44it/s]
  4%|▍         | 16610/371472 [1:18:58<27:47:57,  3.55it/s]
  4%|▍         | 16611/371472 [1:18:58<28:35:53,  3.45it/s]
  4%|▍         | 16612/371472 [1:18:59<27:13:16,  3.62it/s]
  4%|▍         | 16613/371472 [1:18:59<26:47:07,  3.68it/s]
  4%|▍         | 16614/371472 [1:18:59<27:58:35,  3.52it/s]
  4%|▍         | 16615/371472 [1:18:59<27:20:10,  3.61it/s]
  4%|▍         | 16616/371472 [1:19:00<28:12:45,  3.49it/s]
  4%|▍         | 16617/371472 [1:19:00<27:37:28,  3.57it/s]
  4%|▍         | 16618/371472 [1:19:00<27:54:07,  3.53it/s]
  4%|▍         | 16619/371472 [1:19:01<29:22:13,  3.36it/s]
  4%|▍         | 16620/371472 [1:19:01<29:06:24,  3.39it/s]
                                                           
{'loss': 4.5542, 'learning_rate': 9.601962981318278e-07, 'epoch': 0.72}

  4%|▍         | 16620/371472 [1:19:01<29:06:24,  3.39it/s]
  4%|▍         | 16621/371472 [1:19:01<27:49:57,  3.54it/s]
  4%|▍         | 16622/371472 [1:19:02<28:12:28,  3.49it/s]
  4%|▍         | 16623/371472 [1:19:02<26:51:42,  3.67it/s]
  4%|▍         | 16624/371472 [1:19:02<26:54:22,  3.66it/s]
  4%|▍         | 16625/371472 [1:19:02<27:07:33,  3.63it/s]
  4%|▍         | 16626/371472 [1:19:03<26:33:33,  3.71it/s]
  4%|▍         | 16627/371472 [1:19:03<26:56:18,  3.66it/s]
  4%|▍         | 16628/371472 [1:19:03<28:08:15,  3.50it/s]
  4%|▍         | 16629/371472 [1:19:03<28:40:41,  3.44it/s]
  4%|▍         | 16630/371472 [1:19:04<29:12:01,  3.38it/s]
  4%|▍         | 16631/371472 [1:19:04<30:12:19,  3.26it/s]
  4%|▍         | 16632/371472 [1:19:04<29:13:21,  3.37it/s]
  4%|▍         | 16633/371472 [1:19:05<30:10:24,  3.27it/s]
  4%|▍         | 16634/371472 [1:19:05<30:16:07,  3.26it/s]
  4%|▍         | 16635/371472 [1:19:05<31:50:07,  3.10it/s]
  4%|▍         | 16636/371472 [1:19:06<31:50:05,  3.10it/s]
  4%|▍         | 16637/371472 [1:19:06<32:12:46,  3.06it/s]
  4%|▍         | 16638/371472 [1:19:06<30:59:30,  3.18it/s]
  4%|▍         | 16639/371472 [1:19:07<31:41:20,  3.11it/s]
  4%|▍         | 16640/371472 [1:19:07<29:53:49,  3.30it/s]
                                                           
{'loss': 4.4112, 'learning_rate': 9.601478161563489e-07, 'epoch': 0.72}

  4%|▍         | 16640/371472 [1:19:07<29:53:49,  3.30it/s]
  4%|▍         | 16641/371472 [1:19:07<30:12:14,  3.26it/s]
  4%|▍         | 16642/371472 [1:19:08<32:29:43,  3.03it/s]
  4%|▍         | 16643/371472 [1:19:08<32:05:39,  3.07it/s]
  4%|▍         | 16644/371472 [1:19:08<30:21:49,  3.25it/s]
  4%|▍         | 16645/371472 [1:19:08<29:42:48,  3.32it/s]
  4%|▍         | 16646/371472 [1:19:09<30:35:27,  3.22it/s]
  4%|▍         | 16647/371472 [1:19:09<30:45:16,  3.20it/s]
  4%|▍         | 16648/371472 [1:19:10<37:38:00,  2.62it/s]
  4%|▍         | 16649/371472 [1:19:10<35:48:40,  2.75it/s]
  4%|▍         | 16650/371472 [1:19:10<34:11:41,  2.88it/s]
  4%|▍         | 16651/371472 [1:19:11<33:26:18,  2.95it/s]
  4%|▍         | 16652/371472 [1:19:11<31:02:51,  3.17it/s]
  4%|▍         | 16653/371472 [1:19:11<29:00:54,  3.40it/s]
  4%|▍         | 16654/371472 [1:19:11<27:53:27,  3.53it/s]
  4%|▍         | 16655/371472 [1:19:12<28:11:48,  3.50it/s]
  4%|▍         | 16656/371472 [1:19:12<27:45:38,  3.55it/s]
  4%|▍         | 16657/371472 [1:19:12<27:01:58,  3.65it/s]
  4%|▍         | 16658/371472 [1:19:12<26:32:51,  3.71it/s]
  4%|▍         | 16659/371472 [1:19:13<27:18:25,  3.61it/s]
  4%|▍         | 16660/371472 [1:19:13<28:34:32,  3.45it/s]
                                                           
{'loss': 4.5342, 'learning_rate': 9.600993341808702e-07, 'epoch': 0.72}

  4%|▍         | 16660/371472 [1:19:13<28:34:32,  3.45it/s]
  4%|▍         | 16661/371472 [1:19:13<27:36:32,  3.57it/s]
  4%|▍         | 16662/371472 [1:19:14<28:19:30,  3.48it/s]
  4%|▍         | 16663/371472 [1:19:14<31:41:13,  3.11it/s]
  4%|▍         | 16664/371472 [1:19:14<30:41:33,  3.21it/s]
  4%|▍         | 16665/371472 [1:19:15<31:01:33,  3.18it/s]
  4%|▍         | 16666/371472 [1:19:15<30:45:08,  3.20it/s]
  4%|▍         | 16667/371472 [1:19:15<28:52:01,  3.41it/s]
  4%|▍         | 16668/371472 [1:19:15<28:37:06,  3.44it/s]
  4%|▍         | 16669/371472 [1:19:16<31:03:35,  3.17it/s]
  4%|▍         | 16670/371472 [1:19:16<30:40:20,  3.21it/s]
  4%|▍         | 16671/371472 [1:19:16<28:44:06,  3.43it/s]
  4%|▍         | 16672/371472 [1:19:17<30:00:45,  3.28it/s]
  4%|▍         | 16673/371472 [1:19:17<30:41:54,  3.21it/s]
  4%|▍         | 16674/371472 [1:19:17<28:59:52,  3.40it/s]
  4%|▍         | 16675/371472 [1:19:18<27:53:53,  3.53it/s]
  4%|▍         | 16676/371472 [1:19:18<26:54:29,  3.66it/s]
  4%|▍         | 16677/371472 [1:19:18<26:18:35,  3.75it/s]
  4%|▍         | 16678/371472 [1:19:18<26:36:32,  3.70it/s]
  4%|▍         | 16679/371472 [1:19:19<27:14:05,  3.62it/s]
  4%|▍         | 16680/371472 [1:19:19<27:49:14,  3.54it/s]
                                                           
{'loss': 4.4651, 'learning_rate': 9.60050852205391e-07, 'epoch': 0.72}

  4%|▍         | 16680/371472 [1:19:19<27:49:14,  3.54it/s]
  4%|▍         | 16681/371472 [1:19:19<27:30:37,  3.58it/s]
  4%|▍         | 16682/371472 [1:19:20<29:23:17,  3.35it/s]
  4%|▍         | 16683/371472 [1:19:20<27:41:16,  3.56it/s]
  4%|▍         | 16684/371472 [1:19:20<27:19:40,  3.61it/s]
  4%|▍         | 16685/371472 [1:19:20<27:44:11,  3.55it/s]
  4%|▍         | 16686/371472 [1:19:21<27:26:45,  3.59it/s]
  4%|▍         | 16687/371472 [1:19:21<26:57:21,  3.66it/s]
  4%|▍         | 16688/371472 [1:19:21<29:23:38,  3.35it/s]
  4%|▍         | 16689/371472 [1:19:22<28:39:04,  3.44it/s]
  4%|▍         | 16690/371472 [1:19:22<27:26:53,  3.59it/s]
  4%|▍         | 16691/371472 [1:19:22<27:00:32,  3.65it/s]
  4%|▍         | 16692/371472 [1:19:22<26:12:53,  3.76it/s]
  4%|▍         | 16693/371472 [1:19:23<26:16:28,  3.75it/s]
  4%|▍         | 16694/371472 [1:19:23<27:30:09,  3.58it/s]
  4%|▍         | 16695/371472 [1:19:23<28:25:23,  3.47it/s]
  4%|▍         | 16696/371472 [1:19:23<28:08:51,  3.50it/s]
  4%|▍         | 16697/371472 [1:19:24<27:57:08,  3.53it/s]
  4%|▍         | 16698/371472 [1:19:24<27:10:50,  3.63it/s]
  4%|▍         | 16699/371472 [1:19:24<28:22:59,  3.47it/s]
  4%|▍         | 16700/371472 [1:19:25<27:41:39,  3.56it/s]
                                                           
{'loss': 4.7432, 'learning_rate': 9.600023702299123e-07, 'epoch': 0.72}

  4%|▍         | 16700/371472 [1:19:25<27:41:39,  3.56it/s]
  4%|▍         | 16701/371472 [1:19:25<28:55:30,  3.41it/s]
  4%|▍         | 16702/371472 [1:19:25<27:44:13,  3.55it/s]
  4%|▍         | 16703/371472 [1:19:25<27:03:52,  3.64it/s]
  4%|▍         | 16704/371472 [1:19:26<29:19:14,  3.36it/s]
  4%|▍         | 16705/371472 [1:19:26<28:19:39,  3.48it/s]
  4%|▍         | 16706/371472 [1:19:26<27:44:25,  3.55it/s]
  4%|▍         | 16707/371472 [1:19:27<27:19:28,  3.61it/s]
  4%|▍         | 16708/371472 [1:19:27<26:47:38,  3.68it/s]
  4%|▍         | 16709/371472 [1:19:27<27:29:26,  3.58it/s]
  4%|▍         | 16710/371472 [1:19:27<29:58:52,  3.29it/s]
  4%|▍         | 16711/371472 [1:19:28<29:09:37,  3.38it/s]
  4%|▍         | 16712/371472 [1:19:28<27:37:00,  3.57it/s]
  4%|▍         | 16713/371472 [1:19:28<27:46:11,  3.55it/s]
  4%|▍         | 16714/371472 [1:19:29<26:51:01,  3.67it/s]
  4%|▍         | 16715/371472 [1:19:29<27:49:44,  3.54it/s]
  4%|▍         | 16716/371472 [1:19:29<28:01:37,  3.52it/s]
  5%|▍         | 16717/371472 [1:19:29<28:37:30,  3.44it/s]
  5%|▍         | 16718/371472 [1:19:30<28:06:54,  3.50it/s]
  5%|▍         | 16719/371472 [1:19:30<29:00:54,  3.40it/s]
  5%|▍         | 16720/371472 [1:19:30<27:29:09,  3.59it/s]
                                                           
{'loss': 4.6841, 'learning_rate': 9.599538882544334e-07, 'epoch': 0.72}

  5%|▍         | 16720/371472 [1:19:30<27:29:09,  3.59it/s]
  5%|▍         | 16721/371472 [1:19:31<27:31:49,  3.58it/s]
  5%|▍         | 16722/371472 [1:19:31<27:56:53,  3.53it/s]
  5%|▍         | 16723/371472 [1:19:31<27:11:59,  3.62it/s]
  5%|▍         | 16724/371472 [1:19:31<26:48:54,  3.67it/s]
  5%|▍         | 16725/371472 [1:19:32<26:22:10,  3.74it/s]
  5%|▍         | 16726/371472 [1:19:32<25:41:21,  3.84it/s]
  5%|▍         | 16727/371472 [1:19:32<26:01:59,  3.79it/s]
  5%|▍         | 16728/371472 [1:19:33<30:01:08,  3.28it/s]
  5%|▍         | 16729/371472 [1:19:33<29:50:44,  3.30it/s]
  5%|▍         | 16730/371472 [1:19:33<29:34:44,  3.33it/s]
  5%|▍         | 16731/371472 [1:19:33<29:05:29,  3.39it/s]
  5%|▍         | 16732/371472 [1:19:34<30:02:56,  3.28it/s]
  5%|▍         | 16733/371472 [1:19:34<29:09:05,  3.38it/s]
  5%|▍         | 16734/371472 [1:19:34<27:51:28,  3.54it/s]
  5%|▍         | 16735/371472 [1:19:35<27:38:34,  3.56it/s]
  5%|▍         | 16736/371472 [1:19:35<28:37:58,  3.44it/s]
  5%|▍         | 16737/371472 [1:19:35<30:11:32,  3.26it/s]
  5%|▍         | 16738/371472 [1:19:35<29:43:44,  3.31it/s]
  5%|▍         | 16739/371472 [1:19:36<28:39:15,  3.44it/s]
  5%|▍         | 16740/371472 [1:19:36<28:36:37,  3.44it/s]
                                                           
{'loss': 4.4546, 'learning_rate': 9.599054062789545e-07, 'epoch': 0.72}

  5%|▍         | 16740/371472 [1:19:36<28:36:37,  3.44it/s]
  5%|▍         | 16741/371472 [1:19:36<28:42:19,  3.43it/s]
  5%|▍         | 16742/371472 [1:19:37<28:34:39,  3.45it/s]
  5%|▍         | 16743/371472 [1:19:37<29:46:18,  3.31it/s]
  5%|▍         | 16744/371472 [1:19:37<30:24:49,  3.24it/s]
  5%|▍         | 16745/371472 [1:19:38<29:54:25,  3.29it/s]
  5%|▍         | 16746/371472 [1:19:38<28:44:57,  3.43it/s]
  5%|▍         | 16747/371472 [1:19:38<30:38:03,  3.22it/s]
  5%|▍         | 16748/371472 [1:19:39<30:43:59,  3.21it/s]
  5%|▍         | 16749/371472 [1:19:39<30:14:56,  3.26it/s]
  5%|▍         | 16750/371472 [1:19:39<28:40:01,  3.44it/s]
  5%|▍         | 16751/371472 [1:19:39<27:35:02,  3.57it/s]
  5%|▍         | 16752/371472 [1:19:40<27:06:42,  3.63it/s]
  5%|▍         | 16753/371472 [1:19:40<26:41:08,  3.69it/s]
  5%|▍         | 16754/371472 [1:19:40<26:16:44,  3.75it/s]
  5%|▍         | 16755/371472 [1:19:40<25:33:22,  3.86it/s]
  5%|▍         | 16756/371472 [1:19:41<26:40:25,  3.69it/s]
  5%|▍         | 16757/371472 [1:19:41<26:29:03,  3.72it/s]
  5%|▍         | 16758/371472 [1:19:41<26:42:55,  3.69it/s]
  5%|▍         | 16759/371472 [1:19:41<26:07:59,  3.77it/s]
  5%|▍         | 16760/371472 [1:19:42<26:01:56,  3.78it/s]
                                                           
{'loss': 4.7137, 'learning_rate': 9.598569243034757e-07, 'epoch': 0.72}

  5%|▍         | 16760/371472 [1:19:42<26:01:56,  3.78it/s]
  5%|▍         | 16761/371472 [1:19:42<27:08:15,  3.63it/s]
  5%|▍         | 16762/371472 [1:19:42<26:13:49,  3.76it/s]
  5%|▍         | 16763/371472 [1:19:42<26:12:29,  3.76it/s]
  5%|▍         | 16764/371472 [1:19:43<26:08:09,  3.77it/s]
  5%|▍         | 16765/371472 [1:19:43<26:37:06,  3.70it/s]
  5%|▍         | 16766/371472 [1:19:43<26:45:14,  3.68it/s]
  5%|▍         | 16767/371472 [1:19:44<30:06:21,  3.27it/s]
  5%|▍         | 16768/371472 [1:19:44<29:29:25,  3.34it/s]
  5%|▍         | 16769/371472 [1:19:44<29:16:07,  3.37it/s]
  5%|▍         | 16770/371472 [1:19:45<28:05:15,  3.51it/s]
  5%|▍         | 16771/371472 [1:19:45<27:22:27,  3.60it/s]
  5%|▍         | 16772/371472 [1:19:45<28:27:47,  3.46it/s]
  5%|▍         | 16773/371472 [1:19:45<28:07:10,  3.50it/s]
  5%|▍         | 16774/371472 [1:19:46<27:05:37,  3.64it/s]
  5%|▍         | 16775/371472 [1:19:46<27:08:00,  3.63it/s]
  5%|▍         | 16776/371472 [1:19:46<26:54:27,  3.66it/s]
  5%|▍         | 16777/371472 [1:19:46<27:55:44,  3.53it/s]
  5%|▍         | 16778/371472 [1:19:47<28:44:41,  3.43it/s]
  5%|▍         | 16779/371472 [1:19:47<27:39:28,  3.56it/s]
  5%|▍         | 16780/371472 [1:19:47<27:06:28,  3.63it/s]
                                                           
{'loss': 4.5197, 'learning_rate': 9.598084423279966e-07, 'epoch': 0.72}

  5%|▍         | 16780/371472 [1:19:47<27:06:28,  3.63it/s]
  5%|▍         | 16781/371472 [1:19:48<26:41:33,  3.69it/s]
  5%|▍         | 16782/371472 [1:19:48<29:00:28,  3.40it/s]
  5%|▍         | 16783/371472 [1:19:48<29:21:35,  3.36it/s]
  5%|▍         | 16784/371472 [1:19:48<28:03:17,  3.51it/s]
  5%|▍         | 16785/371472 [1:19:49<28:41:45,  3.43it/s]
  5%|▍         | 16786/371472 [1:19:49<29:55:14,  3.29it/s]
  5%|▍         | 16787/371472 [1:19:49<28:59:27,  3.40it/s]
  5%|▍         | 16788/371472 [1:19:50<27:56:51,  3.53it/s]
  5%|▍         | 16789/371472 [1:19:50<30:20:05,  3.25it/s]
  5%|▍         | 16790/371472 [1:19:50<30:24:15,  3.24it/s]
  5%|▍         | 16791/371472 [1:19:51<29:20:18,  3.36it/s]
  5%|▍         | 16792/371472 [1:19:51<29:04:36,  3.39it/s]
  5%|▍         | 16793/371472 [1:19:51<28:22:58,  3.47it/s]
  5%|▍         | 16794/371472 [1:19:51<28:08:25,  3.50it/s]
  5%|▍         | 16795/371472 [1:19:52<27:40:36,  3.56it/s]
  5%|▍         | 16796/371472 [1:19:52<26:18:08,  3.75it/s]
  5%|▍         | 16797/371472 [1:19:52<26:03:07,  3.78it/s]
  5%|▍         | 16798/371472 [1:19:52<26:18:22,  3.75it/s]
  5%|▍         | 16799/371472 [1:19:53<29:15:48,  3.37it/s]
  5%|▍         | 16800/371472 [1:19:53<28:06:56,  3.50it/s]
                                                           
{'loss': 4.6357, 'learning_rate': 9.597599603525179e-07, 'epoch': 0.72}

  5%|▍         | 16800/371472 [1:19:53<28:06:56,  3.50it/s]
  5%|▍         | 16801/371472 [1:19:53<27:45:12,  3.55it/s]
  5%|▍         | 16802/371472 [1:19:54<28:55:44,  3.41it/s]
  5%|▍         | 16803/371472 [1:19:54<30:01:59,  3.28it/s]
  5%|▍         | 16804/371472 [1:19:54<28:34:42,  3.45it/s]
  5%|▍         | 16805/371472 [1:19:55<28:03:17,  3.51it/s]
  5%|▍         | 16806/371472 [1:19:55<26:59:42,  3.65it/s]
  5%|▍         | 16807/371472 [1:19:55<26:32:54,  3.71it/s]
  5%|▍         | 16808/371472 [1:19:55<29:50:14,  3.30it/s]
  5%|▍         | 16809/371472 [1:19:56<29:35:36,  3.33it/s]
  5%|▍         | 16810/371472 [1:19:56<28:47:25,  3.42it/s]
  5%|▍         | 16811/371472 [1:19:56<28:06:11,  3.51it/s]
  5%|▍         | 16812/371472 [1:19:57<27:53:47,  3.53it/s]
  5%|▍         | 16813/371472 [1:19:57<28:09:38,  3.50it/s]
  5%|▍         | 16814/371472 [1:19:57<27:54:15,  3.53it/s]
  5%|▍         | 16815/371472 [1:19:57<27:49:31,  3.54it/s]
  5%|▍         | 16816/371472 [1:19:58<27:12:25,  3.62it/s]
  5%|▍         | 16817/371472 [1:19:58<30:10:49,  3.26it/s]
  5%|▍         | 16818/371472 [1:19:58<29:18:36,  3.36it/s]
  5%|▍         | 16819/371472 [1:19:59<30:16:52,  3.25it/s]
  5%|▍         | 16820/371472 [1:19:59<28:35:40,  3.45it/s]
                                                           
{'loss': 4.4496, 'learning_rate': 9.597114783770387e-07, 'epoch': 0.72}

  5%|▍         | 16820/371472 [1:19:59<28:35:40,  3.45it/s]
  5%|▍         | 16821/371472 [1:19:59<29:11:59,  3.37it/s]
  5%|▍         | 16822/371472 [1:20:00<29:11:47,  3.37it/s]
  5%|▍         | 16823/371472 [1:20:00<30:08:20,  3.27it/s]
  5%|▍         | 16824/371472 [1:20:00<32:03:29,  3.07it/s]
  5%|▍         | 16825/371472 [1:20:01<31:30:39,  3.13it/s]
  5%|▍         | 16826/371472 [1:20:01<32:15:39,  3.05it/s]
  5%|▍         | 16827/371472 [1:20:01<30:48:59,  3.20it/s]
  5%|▍         | 16828/371472 [1:20:01<29:32:59,  3.33it/s]
  5%|▍         | 16829/371472 [1:20:02<28:11:44,  3.49it/s]
  5%|▍         | 16830/371472 [1:20:02<29:27:01,  3.34it/s]
  5%|▍         | 16831/371472 [1:20:02<28:19:55,  3.48it/s]
  5%|▍         | 16832/371472 [1:20:03<27:12:27,  3.62it/s]
  5%|▍         | 16833/371472 [1:20:03<27:01:33,  3.65it/s]
  5%|▍         | 16834/371472 [1:20:03<27:41:25,  3.56it/s]
  5%|▍         | 16835/371472 [1:20:03<27:34:59,  3.57it/s]
  5%|▍         | 16836/371472 [1:20:04<28:37:00,  3.44it/s]
  5%|▍         | 16837/371472 [1:20:04<27:33:21,  3.57it/s]
  5%|▍         | 16838/371472 [1:20:04<27:42:02,  3.56it/s]
  5%|▍         | 16839/371472 [1:20:05<27:51:45,  3.54it/s]
  5%|▍         | 16840/371472 [1:20:05<29:33:36,  3.33it/s]
                                                           
{'loss': 4.5952, 'learning_rate': 9.5966299640156e-07, 'epoch': 0.73}

  5%|▍         | 16840/371472 [1:20:05<29:33:36,  3.33it/s]
  5%|▍         | 16841/371472 [1:20:05<30:46:35,  3.20it/s]
  5%|▍         | 16842/371472 [1:20:05<29:27:51,  3.34it/s]
  5%|▍         | 16843/371472 [1:20:06<28:43:27,  3.43it/s]
  5%|▍         | 16844/371472 [1:20:06<28:27:53,  3.46it/s]
  5%|▍         | 16845/371472 [1:20:06<28:06:13,  3.51it/s]
  5%|▍         | 16846/371472 [1:20:07<29:02:02,  3.39it/s]
  5%|▍         | 16847/371472 [1:20:07<28:32:05,  3.45it/s]
  5%|▍         | 16848/371472 [1:20:07<28:00:27,  3.52it/s]
  5%|▍         | 16849/371472 [1:20:07<27:26:55,  3.59it/s]
  5%|▍         | 16850/371472 [1:20:08<28:06:33,  3.50it/s]
  5%|▍         | 16851/371472 [1:20:08<27:28:50,  3.58it/s]
  5%|▍         | 16852/371472 [1:20:08<28:54:37,  3.41it/s]
  5%|▍         | 16853/371472 [1:20:09<27:33:49,  3.57it/s]
  5%|▍         | 16854/371472 [1:20:09<28:41:23,  3.43it/s]
  5%|▍         | 16855/371472 [1:20:09<30:39:14,  3.21it/s]
  5%|▍         | 16856/371472 [1:20:10<32:40:43,  3.01it/s]
  5%|▍         | 16857/371472 [1:20:10<34:47:02,  2.83it/s]
  5%|▍         | 16858/371472 [1:20:10<32:52:55,  3.00it/s]
  5%|▍         | 16859/371472 [1:20:11<31:44:13,  3.10it/s]
  5%|▍         | 16860/371472 [1:20:11<31:06:08,  3.17it/s]
                                                           
{'loss': 4.3745, 'learning_rate': 9.59614514426081e-07, 'epoch': 0.73}

  5%|▍         | 16860/371472 [1:20:11<31:06:08,  3.17it/s]
  5%|▍         | 16861/371472 [1:20:11<29:16:21,  3.37it/s]
  5%|▍         | 16862/371472 [1:20:12<31:10:17,  3.16it/s]
  5%|▍         | 16863/371472 [1:20:12<31:47:28,  3.10it/s]
  5%|▍         | 16864/371472 [1:20:12<29:50:44,  3.30it/s]
  5%|▍         | 16865/371472 [1:20:12<29:27:15,  3.34it/s]
  5%|▍         | 16866/371472 [1:20:13<31:07:11,  3.17it/s]
  5%|▍         | 16867/371472 [1:20:13<29:08:08,  3.38it/s]
  5%|▍         | 16868/371472 [1:20:13<28:38:47,  3.44it/s]
  5%|▍         | 16869/371472 [1:20:14<27:41:38,  3.56it/s]
  5%|▍         | 16870/371472 [1:20:14<27:14:12,  3.62it/s]
  5%|▍         | 16871/371472 [1:20:14<26:34:41,  3.71it/s]
  5%|▍         | 16872/371472 [1:20:14<29:10:12,  3.38it/s]
  5%|▍         | 16873/371472 [1:20:15<29:05:44,  3.39it/s]
  5%|▍         | 16874/371472 [1:20:15<29:32:33,  3.33it/s]
  5%|▍         | 16875/371472 [1:20:15<29:50:48,  3.30it/s]
  5%|▍         | 16876/371472 [1:20:16<29:33:53,  3.33it/s]
  5%|▍         | 16877/371472 [1:20:16<29:48:46,  3.30it/s]
  5%|▍         | 16878/371472 [1:20:16<29:33:49,  3.33it/s]
  5%|▍         | 16879/371472 [1:20:17<29:28:01,  3.34it/s]
  5%|▍         | 16880/371472 [1:20:17<28:53:53,  3.41it/s]
                                                           
{'loss': 4.5424, 'learning_rate': 9.595660324506022e-07, 'epoch': 0.73}

  5%|▍         | 16880/371472 [1:20:17<28:53:53,  3.41it/s]
  5%|▍         | 16881/371472 [1:20:17<28:41:33,  3.43it/s]
  5%|▍         | 16882/371472 [1:20:17<27:58:35,  3.52it/s]
  5%|▍         | 16883/371472 [1:20:18<28:52:19,  3.41it/s]
  5%|▍         | 16884/371472 [1:20:18<29:25:59,  3.35it/s]
  5%|▍         | 16885/371472 [1:20:18<29:04:01,  3.39it/s]
  5%|▍         | 16886/371472 [1:20:19<28:07:20,  3.50it/s]
  5%|▍         | 16887/371472 [1:20:19<26:37:14,  3.70it/s]
  5%|▍         | 16888/371472 [1:20:19<27:58:41,  3.52it/s]
  5%|▍         | 16889/371472 [1:20:19<27:11:41,  3.62it/s]
  5%|▍         | 16890/371472 [1:20:20<27:21:39,  3.60it/s]
  5%|▍         | 16891/371472 [1:20:20<27:44:31,  3.55it/s]
  5%|▍         | 16892/371472 [1:20:20<27:06:14,  3.63it/s]
  5%|▍         | 16893/371472 [1:20:21<29:49:23,  3.30it/s]
  5%|▍         | 16894/371472 [1:20:21<30:22:55,  3.24it/s]
  5%|▍         | 16895/371472 [1:20:21<31:15:03,  3.15it/s]
  5%|▍         | 16896/371472 [1:20:21<29:57:10,  3.29it/s]
  5%|▍         | 16897/371472 [1:20:22<28:27:03,  3.46it/s]
  5%|▍         | 16898/371472 [1:20:22<27:05:24,  3.64it/s]
  5%|▍         | 16899/371472 [1:20:22<26:22:24,  3.73it/s]
  5%|▍         | 16900/371472 [1:20:22<26:08:45,  3.77it/s]
                                                           
{'loss': 4.5643, 'learning_rate': 9.595175504751234e-07, 'epoch': 0.73}

  5%|▍         | 16900/371472 [1:20:22<26:08:45,  3.77it/s]
  5%|▍         | 16901/371472 [1:20:23<27:05:36,  3.64it/s]
  5%|▍         | 16902/371472 [1:20:23<26:36:45,  3.70it/s]
  5%|▍         | 16903/371472 [1:20:23<26:28:36,  3.72it/s]
  5%|▍         | 16904/371472 [1:20:24<26:36:42,  3.70it/s]
  5%|▍         | 16905/371472 [1:20:24<26:47:41,  3.68it/s]
  5%|▍         | 16906/371472 [1:20:24<27:11:15,  3.62it/s]
  5%|▍         | 16907/371472 [1:20:24<27:51:24,  3.54it/s]
  5%|▍         | 16908/371472 [1:20:25<27:00:46,  3.65it/s]
  5%|▍         | 16909/371472 [1:20:25<26:45:41,  3.68it/s]
  5%|▍         | 16910/371472 [1:20:25<26:59:25,  3.65it/s]
  5%|▍         | 16911/371472 [1:20:26<28:26:08,  3.46it/s]
  5%|▍         | 16912/371472 [1:20:26<28:35:02,  3.45it/s]
  5%|▍         | 16913/371472 [1:20:26<27:18:54,  3.61it/s]
  5%|▍         | 16914/371472 [1:20:26<28:35:05,  3.45it/s]
  5%|▍         | 16915/371472 [1:20:27<28:13:35,  3.49it/s]
  5%|▍         | 16916/371472 [1:20:27<27:36:04,  3.57it/s]
  5%|▍         | 16917/371472 [1:20:27<26:52:16,  3.67it/s]
  5%|▍         | 16918/371472 [1:20:28<27:31:41,  3.58it/s]
  5%|▍         | 16919/371472 [1:20:28<27:17:09,  3.61it/s]
  5%|▍         | 16920/371472 [1:20:28<26:39:26,  3.69it/s]
                                                           
{'loss': 4.5414, 'learning_rate': 9.594690684996443e-07, 'epoch': 0.73}

  5%|▍         | 16920/371472 [1:20:28<26:39:26,  3.69it/s]
  5%|▍         | 16921/371472 [1:20:28<26:27:26,  3.72it/s]
  5%|▍         | 16922/371472 [1:20:29<26:09:47,  3.76it/s]
  5%|▍         | 16923/371472 [1:20:29<26:39:00,  3.70it/s]
  5%|▍         | 16924/371472 [1:20:29<28:38:06,  3.44it/s]
  5%|▍         | 16925/371472 [1:20:29<29:04:02,  3.39it/s]
  5%|▍         | 16926/371472 [1:20:30<29:39:55,  3.32it/s]
  5%|▍         | 16927/371472 [1:20:30<30:20:46,  3.25it/s]
  5%|▍         | 16928/371472 [1:20:30<29:47:50,  3.31it/s]
  5%|▍         | 16929/371472 [1:20:31<29:24:37,  3.35it/s]
  5%|▍         | 16930/371472 [1:20:31<29:10:54,  3.37it/s]
  5%|▍         | 16931/371472 [1:20:31<27:51:03,  3.54it/s]
  5%|▍         | 16932/371472 [1:20:32<28:18:52,  3.48it/s]
  5%|▍         | 16933/371472 [1:20:32<33:12:27,  2.97it/s]
  5%|▍         | 16934/371472 [1:20:32<31:09:17,  3.16it/s]
  5%|▍         | 16935/371472 [1:20:33<29:34:08,  3.33it/s]
  5%|▍         | 16936/371472 [1:20:33<28:36:29,  3.44it/s]
  5%|▍         | 16937/371472 [1:20:33<28:03:47,  3.51it/s]
  5%|▍         | 16938/371472 [1:20:33<27:46:49,  3.55it/s]
  5%|▍         | 16939/371472 [1:20:34<29:04:29,  3.39it/s]
  5%|▍         | 16940/371472 [1:20:34<29:13:40,  3.37it/s]
                                                           
{'loss': 4.4815, 'learning_rate': 9.594205865241656e-07, 'epoch': 0.73}

  5%|▍         | 16940/371472 [1:20:34<29:13:40,  3.37it/s]
  5%|▍         | 16941/371472 [1:20:34<31:25:27,  3.13it/s]
  5%|▍         | 16942/371472 [1:20:35<34:10:04,  2.88it/s]
  5%|▍         | 16943/371472 [1:20:35<31:46:45,  3.10it/s]
  5%|▍         | 16944/371472 [1:20:35<30:31:12,  3.23it/s]
  5%|▍         | 16945/371472 [1:20:36<28:58:44,  3.40it/s]
  5%|▍         | 16946/371472 [1:20:36<27:38:57,  3.56it/s]
  5%|▍         | 16947/371472 [1:20:36<28:07:11,  3.50it/s]
  5%|▍         | 16948/371472 [1:20:36<27:06:53,  3.63it/s]
  5%|▍         | 16949/371472 [1:20:37<26:37:57,  3.70it/s]
  5%|▍         | 16950/371472 [1:20:37<28:36:37,  3.44it/s]
  5%|▍         | 16951/371472 [1:20:37<28:12:30,  3.49it/s]
  5%|▍         | 16952/371472 [1:20:37<27:15:05,  3.61it/s]
  5%|▍         | 16953/371472 [1:20:38<27:09:32,  3.63it/s]
  5%|▍         | 16954/371472 [1:20:38<27:34:16,  3.57it/s]
  5%|▍         | 16955/371472 [1:20:38<27:27:32,  3.59it/s]
  5%|▍         | 16956/371472 [1:20:39<27:55:07,  3.53it/s]
  5%|▍         | 16957/371472 [1:20:39<33:00:48,  2.98it/s]
  5%|▍         | 16958/371472 [1:20:39<34:03:54,  2.89it/s]
  5%|▍         | 16959/371472 [1:20:40<33:38:23,  2.93it/s]
  5%|▍         | 16960/371472 [1:20:40<33:13:37,  2.96it/s]
                                                           
{'loss': 4.371, 'learning_rate': 9.593721045486865e-07, 'epoch': 0.73}

  5%|▍         | 16960/371472 [1:20:40<33:13:37,  2.96it/s]
  5%|▍         | 16961/371472 [1:20:40<32:13:00,  3.06it/s]
  5%|▍         | 16962/371472 [1:20:41<32:05:42,  3.07it/s]
  5%|▍         | 16963/371472 [1:20:41<31:35:17,  3.12it/s]
  5%|▍         | 16964/371472 [1:20:41<32:49:49,  3.00it/s]
  5%|▍         | 16965/371472 [1:20:42<32:23:33,  3.04it/s]
  5%|▍         | 16966/371472 [1:20:42<31:40:59,  3.11it/s]
  5%|▍         | 16967/371472 [1:20:42<29:48:29,  3.30it/s]
  5%|▍         | 16968/371472 [1:20:43<31:11:03,  3.16it/s]
  5%|▍         | 16969/371472 [1:20:43<30:37:06,  3.22it/s]
  5%|▍         | 16970/371472 [1:20:43<29:16:09,  3.36it/s]
  5%|▍         | 16971/371472 [1:20:43<28:21:13,  3.47it/s]
  5%|▍         | 16972/371472 [1:20:44<28:55:04,  3.41it/s]
  5%|▍         | 16973/371472 [1:20:44<29:19:18,  3.36it/s]
  5%|▍         | 16974/371472 [1:20:44<28:10:32,  3.49it/s]
  5%|▍         | 16975/371472 [1:20:45<28:39:52,  3.44it/s]
  5%|▍         | 16976/371472 [1:20:45<29:37:10,  3.32it/s]
  5%|▍         | 16977/371472 [1:20:45<29:39:18,  3.32it/s]
  5%|▍         | 16978/371472 [1:20:46<30:19:00,  3.25it/s]
  5%|▍         | 16979/371472 [1:20:46<30:07:44,  3.27it/s]
  5%|▍         | 16980/371472 [1:20:46<29:33:04,  3.33it/s]
                                                           
{'loss': 4.6894, 'learning_rate': 9.593236225732077e-07, 'epoch': 0.73}

  5%|▍         | 16980/371472 [1:20:46<29:33:04,  3.33it/s]
  5%|▍         | 16981/371472 [1:20:46<28:04:27,  3.51it/s]
  5%|▍         | 16982/371472 [1:20:47<27:21:22,  3.60it/s]
  5%|▍         | 16983/371472 [1:20:47<26:53:22,  3.66it/s]
  5%|▍         | 16984/371472 [1:20:47<27:38:28,  3.56it/s]
  5%|▍         | 16985/371472 [1:20:48<27:25:59,  3.59it/s]
  5%|▍         | 16986/371472 [1:20:48<27:30:25,  3.58it/s]
  5%|▍         | 16987/371472 [1:20:48<29:43:59,  3.31it/s]
  5%|▍         | 16988/371472 [1:20:48<29:40:03,  3.32it/s]
  5%|▍         | 16989/371472 [1:20:49<28:11:25,  3.49it/s]
  5%|▍         | 16990/371472 [1:20:49<27:21:13,  3.60it/s]
  5%|▍         | 16991/371472 [1:20:49<26:57:21,  3.65it/s]
  5%|▍         | 16992/371472 [1:20:49<26:27:03,  3.72it/s]
  5%|▍         | 16993/371472 [1:20:50<26:23:46,  3.73it/s]
  5%|▍         | 16994/371472 [1:20:50<26:31:20,  3.71it/s]
  5%|▍         | 16995/371472 [1:20:50<26:17:19,  3.75it/s]
  5%|▍         | 16996/371472 [1:20:51<27:36:22,  3.57it/s]
  5%|▍         | 16997/371472 [1:20:51<27:22:13,  3.60it/s]
  5%|▍         | 16998/371472 [1:20:51<27:42:46,  3.55it/s]
  5%|▍         | 16999/371472 [1:20:51<27:01:53,  3.64it/s]
  5%|▍         | 17000/371472 [1:20:52<26:33:36,  3.71it/s]
                                                           
{'loss': 4.603, 'learning_rate': 9.592751405977288e-07, 'epoch': 0.73}

  5%|▍         | 17000/371472 [1:20:52<26:33:36,  3.71it/s]
  5%|▍         | 17001/371472 [1:20:52<27:28:43,  3.58it/s]
  5%|▍         | 17002/371472 [1:20:52<26:48:46,  3.67it/s]
  5%|▍         | 17003/371472 [1:20:53<27:39:20,  3.56it/s]
  5%|▍         | 17004/371472 [1:20:53<29:46:12,  3.31it/s]
  5%|▍         | 17005/371472 [1:20:53<28:11:16,  3.49it/s]
  5%|▍         | 17006/371472 [1:20:53<29:25:34,  3.35it/s]
  5%|▍         | 17007/371472 [1:20:54<29:33:25,  3.33it/s]
  5%|▍         | 17008/371472 [1:20:54<28:33:02,  3.45it/s]
  5%|▍         | 17009/371472 [1:20:54<27:20:25,  3.60it/s]
  5%|▍         | 17010/371472 [1:20:55<28:53:31,  3.41it/s]
  5%|▍         | 17011/371472 [1:20:55<27:35:39,  3.57it/s]
  5%|▍         | 17012/371472 [1:20:55<26:39:25,  3.69it/s]
  5%|▍         | 17013/371472 [1:20:55<28:10:49,  3.49it/s]
  5%|▍         | 17014/371472 [1:20:56<29:19:52,  3.36it/s]
  5%|▍         | 17015/371472 [1:20:56<32:45:11,  3.01it/s]
  5%|▍         | 17016/371472 [1:20:56<31:03:07,  3.17it/s]
  5%|▍         | 17017/371472 [1:20:57<28:43:57,  3.43it/s]
  5%|▍         | 17018/371472 [1:20:57<28:04:58,  3.51it/s]
  5%|▍         | 17019/371472 [1:20:57<27:33:52,  3.57it/s]
  5%|▍         | 17020/371472 [1:20:58<28:33:24,  3.45it/s]
                                                           
{'loss': 4.6009, 'learning_rate': 9.592266586222499e-07, 'epoch': 0.73}

  5%|▍         | 17020/371472 [1:20:58<28:33:24,  3.45it/s]
  5%|▍         | 17021/371472 [1:20:58<29:45:24,  3.31it/s]
  5%|▍         | 17022/371472 [1:20:58<30:14:10,  3.26it/s]
  5%|▍         | 17023/371472 [1:20:59<30:45:18,  3.20it/s]
  5%|▍         | 17024/371472 [1:20:59<29:05:17,  3.38it/s]
  5%|▍         | 17025/371472 [1:20:59<29:45:19,  3.31it/s]
  5%|▍         | 17026/371472 [1:20:59<28:37:24,  3.44it/s]
  5%|▍         | 17027/371472 [1:21:00<28:54:01,  3.41it/s]
  5%|▍         | 17028/371472 [1:21:00<27:50:15,  3.54it/s]
  5%|▍         | 17029/371472 [1:21:00<27:03:17,  3.64it/s]
  5%|▍         | 17030/371472 [1:21:00<26:35:54,  3.70it/s]
  5%|▍         | 17031/371472 [1:21:01<27:25:37,  3.59it/s]
  5%|▍         | 17032/371472 [1:21:01<28:59:12,  3.40it/s]
  5%|▍         | 17033/371472 [1:21:01<28:02:12,  3.51it/s]
  5%|▍         | 17034/371472 [1:21:02<28:02:33,  3.51it/s]
  5%|▍         | 17035/371472 [1:21:02<27:27:44,  3.59it/s]
  5%|▍         | 17036/371472 [1:21:02<26:35:50,  3.70it/s]
  5%|▍         | 17037/371472 [1:21:02<25:58:36,  3.79it/s]
  5%|▍         | 17038/371472 [1:21:03<26:04:50,  3.77it/s]
  5%|▍         | 17039/371472 [1:21:03<25:41:11,  3.83it/s]
  5%|▍         | 17040/371472 [1:21:03<26:16:00,  3.75it/s]
                                                           
{'loss': 4.5632, 'learning_rate': 9.591781766467712e-07, 'epoch': 0.73}

  5%|▍         | 17040/371472 [1:21:03<26:16:00,  3.75it/s]
  5%|▍         | 17041/371472 [1:21:03<25:45:09,  3.82it/s]
  5%|▍         | 17042/371472 [1:21:04<26:10:48,  3.76it/s]
  5%|▍         | 17043/371472 [1:21:04<27:24:51,  3.59it/s]
  5%|▍         | 17044/371472 [1:21:04<27:20:37,  3.60it/s]
  5%|▍         | 17045/371472 [1:21:05<26:59:39,  3.65it/s]
  5%|▍         | 17046/371472 [1:21:05<28:26:31,  3.46it/s]
  5%|▍         | 17047/371472 [1:21:05<28:34:06,  3.45it/s]
  5%|▍         | 17048/371472 [1:21:05<29:04:50,  3.39it/s]
  5%|▍         | 17049/371472 [1:21:06<28:37:58,  3.44it/s]
  5%|▍         | 17050/371472 [1:21:06<29:30:08,  3.34it/s]
  5%|▍         | 17051/371472 [1:21:06<29:23:09,  3.35it/s]
  5%|▍         | 17052/371472 [1:21:07<27:58:10,  3.52it/s]
  5%|▍         | 17053/371472 [1:21:07<28:01:44,  3.51it/s]
  5%|▍         | 17054/371472 [1:21:07<27:30:14,  3.58it/s]
  5%|▍         | 17055/371472 [1:21:08<29:39:10,  3.32it/s]
  5%|▍         | 17056/371472 [1:21:08<28:23:12,  3.47it/s]
  5%|▍         | 17057/371472 [1:21:08<27:36:09,  3.57it/s]
  5%|▍         | 17058/371472 [1:21:08<28:20:35,  3.47it/s]
  5%|▍         | 17059/371472 [1:21:09<31:19:54,  3.14it/s]
  5%|▍         | 17060/371472 [1:21:09<29:43:04,  3.31it/s]
                                                           
{'loss': 4.5738, 'learning_rate': 9.59129694671292e-07, 'epoch': 0.73}

  5%|▍         | 17060/371472 [1:21:09<29:43:04,  3.31it/s]
  5%|▍         | 17061/371472 [1:21:09<28:40:56,  3.43it/s]
  5%|▍         | 17062/371472 [1:21:10<29:16:57,  3.36it/s]
  5%|▍         | 17063/371472 [1:21:10<31:02:39,  3.17it/s]
  5%|▍         | 17064/371472 [1:21:10<29:40:01,  3.32it/s]
  5%|▍         | 17065/371472 [1:21:10<29:21:36,  3.35it/s]
  5%|▍         | 17066/371472 [1:21:11<28:41:38,  3.43it/s]
  5%|▍         | 17067/371472 [1:21:11<27:25:49,  3.59it/s]
  5%|▍         | 17068/371472 [1:21:12<34:29:06,  2.85it/s]
  5%|▍         | 17069/371472 [1:21:12<32:24:40,  3.04it/s]
  5%|▍         | 17070/371472 [1:21:12<30:28:44,  3.23it/s]
  5%|▍         | 17071/371472 [1:21:12<29:13:05,  3.37it/s]
  5%|▍         | 17072/371472 [1:21:13<28:12:48,  3.49it/s]
  5%|▍         | 17073/371472 [1:21:13<29:28:04,  3.34it/s]
  5%|▍         | 17074/371472 [1:21:13<31:39:33,  3.11it/s]
  5%|▍         | 17075/371472 [1:21:14<29:46:21,  3.31it/s]
  5%|▍         | 17076/371472 [1:21:14<29:03:35,  3.39it/s]
  5%|▍         | 17077/371472 [1:21:14<28:54:28,  3.41it/s]
  5%|▍         | 17078/371472 [1:21:14<28:02:23,  3.51it/s]
  5%|▍         | 17079/371472 [1:21:15<28:08:03,  3.50it/s]
  5%|▍         | 17080/371472 [1:21:15<28:15:36,  3.48it/s]
                                                           
{'loss': 4.7349, 'learning_rate': 9.590812126958133e-07, 'epoch': 0.74}

  5%|▍         | 17080/371472 [1:21:15<28:15:36,  3.48it/s]
  5%|▍         | 17081/371472 [1:21:15<27:48:16,  3.54it/s]
  5%|▍         | 17082/371472 [1:21:16<28:23:25,  3.47it/s]
  5%|▍         | 17083/371472 [1:21:16<27:19:58,  3.60it/s]
  5%|▍         | 17084/371472 [1:21:16<26:28:28,  3.72it/s]
  5%|▍         | 17085/371472 [1:21:16<27:47:42,  3.54it/s]
  5%|▍         | 17086/371472 [1:21:17<27:43:37,  3.55it/s]
  5%|▍         | 17087/371472 [1:21:17<26:57:16,  3.65it/s]
  5%|▍         | 17088/371472 [1:21:17<26:36:27,  3.70it/s]
  5%|▍         | 17089/371472 [1:21:17<28:26:38,  3.46it/s]
  5%|▍         | 17090/371472 [1:21:18<28:06:50,  3.50it/s]
  5%|▍         | 17091/371472 [1:21:18<28:47:21,  3.42it/s]
  5%|▍         | 17092/371472 [1:21:18<29:19:10,  3.36it/s]
  5%|▍         | 17093/371472 [1:21:19<28:20:54,  3.47it/s]
  5%|▍         | 17094/371472 [1:21:19<28:26:48,  3.46it/s]
  5%|▍         | 17095/371472 [1:21:19<29:14:04,  3.37it/s]
  5%|▍         | 17096/371472 [1:21:20<28:02:20,  3.51it/s]
  5%|▍         | 17097/371472 [1:21:20<28:04:57,  3.51it/s]
  5%|▍         | 17098/371472 [1:21:20<28:51:48,  3.41it/s]
  5%|▍         | 17099/371472 [1:21:20<29:05:29,  3.38it/s]
  5%|▍         | 17100/371472 [1:21:21<28:48:39,  3.42it/s]
                                                           
{'loss': 4.7286, 'learning_rate': 9.590327307203344e-07, 'epoch': 0.74}

  5%|▍         | 17100/371472 [1:21:21<28:48:39,  3.42it/s]
  5%|▍         | 17101/371472 [1:21:21<28:45:17,  3.42it/s]
  5%|▍         | 17102/371472 [1:21:21<29:55:09,  3.29it/s]
  5%|▍         | 17103/371472 [1:21:22<28:26:32,  3.46it/s]
  5%|▍         | 17104/371472 [1:21:22<27:37:11,  3.56it/s]
  5%|▍         | 17105/371472 [1:21:22<28:17:17,  3.48it/s]
  5%|▍         | 17106/371472 [1:21:22<28:36:48,  3.44it/s]
  5%|▍         | 17107/371472 [1:21:23<27:57:14,  3.52it/s]
  5%|▍         | 17108/371472 [1:21:23<27:56:07,  3.52it/s]
  5%|▍         | 17109/371472 [1:21:23<27:22:37,  3.60it/s]
  5%|▍         | 17110/371472 [1:21:24<28:07:31,  3.50it/s]
  5%|▍         | 17111/371472 [1:21:24<27:36:16,  3.57it/s]
  5%|▍         | 17112/371472 [1:21:24<27:44:31,  3.55it/s]
  5%|▍         | 17113/371472 [1:21:24<28:23:12,  3.47it/s]
  5%|▍         | 17114/371472 [1:21:25<27:39:21,  3.56it/s]
  5%|▍         | 17115/371472 [1:21:25<27:04:16,  3.64it/s]
  5%|▍         | 17116/371472 [1:21:25<27:23:27,  3.59it/s]
  5%|▍         | 17117/371472 [1:21:26<27:46:32,  3.54it/s]
  5%|▍         | 17118/371472 [1:21:26<27:30:49,  3.58it/s]
  5%|▍         | 17119/371472 [1:21:26<26:22:34,  3.73it/s]
  5%|▍         | 17120/371472 [1:21:26<26:24:23,  3.73it/s]
                                                           
{'loss': 4.8498, 'learning_rate': 9.589842487448554e-07, 'epoch': 0.74}

  5%|▍         | 17120/371472 [1:21:26<26:24:23,  3.73it/s]
  5%|▍         | 17121/371472 [1:21:27<26:24:30,  3.73it/s]
  5%|▍         | 17122/371472 [1:21:27<26:15:05,  3.75it/s]
  5%|▍         | 17123/371472 [1:21:27<28:58:34,  3.40it/s]
  5%|▍         | 17124/371472 [1:21:27<29:10:15,  3.37it/s]
  5%|▍         | 17125/371472 [1:21:28<29:08:24,  3.38it/s]
  5%|▍         | 17126/371472 [1:21:28<29:12:03,  3.37it/s]
  5%|▍         | 17127/371472 [1:21:28<31:30:36,  3.12it/s]
  5%|▍         | 17128/371472 [1:21:29<30:59:37,  3.18it/s]
  5%|▍         | 17129/371472 [1:21:29<29:46:10,  3.31it/s]
  5%|▍         | 17130/371472 [1:21:29<29:41:47,  3.31it/s]
  5%|▍         | 17131/371472 [1:21:30<29:47:51,  3.30it/s]
  5%|▍         | 17132/371472 [1:21:30<29:57:16,  3.29it/s]
  5%|▍         | 17133/371472 [1:21:30<28:51:34,  3.41it/s]
  5%|▍         | 17134/371472 [1:21:31<31:05:18,  3.17it/s]
  5%|▍         | 17135/371472 [1:21:31<29:09:54,  3.37it/s]
  5%|▍         | 17136/371472 [1:21:31<29:37:46,  3.32it/s]
  5%|▍         | 17137/371472 [1:21:31<28:23:26,  3.47it/s]
  5%|▍         | 17138/371472 [1:21:32<27:05:21,  3.63it/s]
  5%|▍         | 17139/371472 [1:21:32<29:13:11,  3.37it/s]
  5%|▍         | 17140/371472 [1:21:32<28:40:16,  3.43it/s]
                                                           
{'loss': 4.7121, 'learning_rate': 9.589357667693767e-07, 'epoch': 0.74}

  5%|▍         | 17140/371472 [1:21:32<28:40:16,  3.43it/s]
  5%|▍         | 17141/371472 [1:21:33<28:09:45,  3.49it/s]
  5%|▍         | 17142/371472 [1:21:33<28:49:31,  3.41it/s]
  5%|▍         | 17143/371472 [1:21:33<29:32:46,  3.33it/s]
  5%|▍         | 17144/371472 [1:21:33<29:07:12,  3.38it/s]
  5%|▍         | 17145/371472 [1:21:34<29:17:51,  3.36it/s]
  5%|▍         | 17146/371472 [1:21:34<28:49:10,  3.42it/s]
  5%|▍         | 17147/371472 [1:21:34<28:12:19,  3.49it/s]
  5%|▍         | 17148/371472 [1:21:35<29:46:28,  3.31it/s]
  5%|▍         | 17149/371472 [1:21:35<27:44:20,  3.55it/s]
  5%|▍         | 17150/371472 [1:21:35<28:20:34,  3.47it/s]
  5%|▍         | 17151/371472 [1:21:35<28:33:28,  3.45it/s]
  5%|▍         | 17152/371472 [1:21:36<26:58:19,  3.65it/s]
  5%|▍         | 17153/371472 [1:21:36<26:13:00,  3.75it/s]
  5%|▍         | 17154/371472 [1:21:36<26:39:43,  3.69it/s]
  5%|▍         | 17155/371472 [1:21:37<26:39:37,  3.69it/s]
  5%|▍         | 17156/371472 [1:21:37<26:46:53,  3.67it/s]
  5%|▍         | 17157/371472 [1:21:37<26:41:23,  3.69it/s]
  5%|▍         | 17158/371472 [1:21:37<28:24:50,  3.46it/s]
  5%|▍         | 17159/371472 [1:21:38<27:57:14,  3.52it/s]
  5%|▍         | 17160/371472 [1:21:38<27:48:09,  3.54it/s]
                                                           
{'loss': 4.3988, 'learning_rate': 9.588872847938976e-07, 'epoch': 0.74}

  5%|▍         | 17160/371472 [1:21:38<27:48:09,  3.54it/s]
  5%|▍         | 17161/371472 [1:21:38<27:24:58,  3.59it/s]
  5%|▍         | 17162/371472 [1:21:39<29:19:14,  3.36it/s]
  5%|▍         | 17163/371472 [1:21:39<28:48:16,  3.42it/s]
  5%|▍         | 17164/371472 [1:21:39<27:52:47,  3.53it/s]
  5%|▍         | 17165/371472 [1:21:39<28:15:34,  3.48it/s]
  5%|▍         | 17166/371472 [1:21:40<28:46:42,  3.42it/s]
  5%|▍         | 17167/371472 [1:21:40<28:12:46,  3.49it/s]
  5%|▍         | 17168/371472 [1:21:40<28:46:06,  3.42it/s]
  5%|▍         | 17169/371472 [1:21:41<31:09:07,  3.16it/s]
  5%|▍         | 17170/371472 [1:21:41<30:34:20,  3.22it/s]
  5%|▍         | 17171/371472 [1:21:41<29:23:56,  3.35it/s]
  5%|▍         | 17172/371472 [1:21:42<28:34:25,  3.44it/s]
  5%|▍         | 17173/371472 [1:21:42<28:34:52,  3.44it/s]
  5%|▍         | 17174/371472 [1:21:42<31:38:41,  3.11it/s]
  5%|▍         | 17175/371472 [1:21:42<30:14:25,  3.25it/s]
  5%|▍         | 17176/371472 [1:21:43<28:47:08,  3.42it/s]
  5%|▍         | 17177/371472 [1:21:43<28:06:15,  3.50it/s]
  5%|▍         | 17178/371472 [1:21:43<27:09:30,  3.62it/s]
  5%|▍         | 17179/371472 [1:21:44<27:54:18,  3.53it/s]
  5%|▍         | 17180/371472 [1:21:44<27:17:47,  3.61it/s]
                                                           
{'loss': 4.6037, 'learning_rate': 9.588388028184189e-07, 'epoch': 0.74}

  5%|▍         | 17180/371472 [1:21:44<27:17:47,  3.61it/s]
  5%|▍         | 17181/371472 [1:21:44<30:21:46,  3.24it/s]
  5%|▍         | 17182/371472 [1:21:44<29:41:59,  3.31it/s]
  5%|▍         | 17183/371472 [1:21:45<28:31:28,  3.45it/s]
  5%|▍         | 17184/371472 [1:21:45<28:25:03,  3.46it/s]
  5%|▍         | 17185/371472 [1:21:45<29:25:10,  3.35it/s]
  5%|▍         | 17186/371472 [1:21:46<30:08:02,  3.27it/s]
  5%|▍         | 17187/371472 [1:21:46<29:53:37,  3.29it/s]
  5%|▍         | 17188/371472 [1:21:46<29:09:42,  3.37it/s]
  5%|▍         | 17189/371472 [1:21:47<30:41:51,  3.21it/s]
  5%|▍         | 17190/371472 [1:21:47<30:51:41,  3.19it/s]
  5%|▍         | 17191/371472 [1:21:47<29:09:05,  3.38it/s]
  5%|▍         | 17192/371472 [1:21:47<28:15:20,  3.48it/s]
  5%|▍         | 17193/371472 [1:21:48<27:34:03,  3.57it/s]
  5%|▍         | 17194/371472 [1:21:48<29:13:04,  3.37it/s]
  5%|▍         | 17195/371472 [1:21:48<28:45:44,  3.42it/s]
  5%|▍         | 17196/371472 [1:21:49<30:58:43,  3.18it/s]
  5%|▍         | 17197/371472 [1:21:49<29:26:53,  3.34it/s]
  5%|▍         | 17198/371472 [1:21:49<28:16:06,  3.48it/s]
  5%|▍         | 17199/371472 [1:21:50<29:18:13,  3.36it/s]
  5%|▍         | 17200/371472 [1:21:50<30:32:49,  3.22it/s]
                                                           
{'loss': 4.6311, 'learning_rate': 9.587903208429397e-07, 'epoch': 0.74}

  5%|▍         | 17200/371472 [1:21:50<30:32:49,  3.22it/s]
  5%|▍         | 17201/371472 [1:21:50<29:51:28,  3.30it/s]
  5%|▍         | 17202/371472 [1:21:50<28:41:10,  3.43it/s]
  5%|▍         | 17203/371472 [1:21:51<28:09:01,  3.50it/s]
  5%|▍         | 17204/371472 [1:21:51<27:34:57,  3.57it/s]
  5%|▍         | 17205/371472 [1:21:51<26:54:07,  3.66it/s]
  5%|▍         | 17206/371472 [1:21:52<33:32:13,  2.93it/s]
  5%|▍         | 17207/371472 [1:21:52<33:56:58,  2.90it/s]
  5%|▍         | 17208/371472 [1:21:52<31:30:16,  3.12it/s]
  5%|▍         | 17209/371472 [1:21:53<30:30:44,  3.23it/s]
  5%|▍         | 17210/371472 [1:21:53<30:22:17,  3.24it/s]
  5%|▍         | 17211/371472 [1:21:53<31:17:41,  3.14it/s]
  5%|▍         | 17212/371472 [1:21:54<30:33:23,  3.22it/s]
  5%|▍         | 17213/371472 [1:21:54<29:42:29,  3.31it/s]
  5%|▍         | 17214/371472 [1:21:54<28:48:32,  3.42it/s]
  5%|▍         | 17215/371472 [1:21:54<28:29:21,  3.45it/s]
  5%|▍         | 17216/371472 [1:21:55<27:29:42,  3.58it/s]
  5%|▍         | 17217/371472 [1:21:55<29:53:32,  3.29it/s]
  5%|▍         | 17218/371472 [1:21:55<28:23:11,  3.47it/s]
  5%|▍         | 17219/371472 [1:21:56<27:31:16,  3.58it/s]
  5%|▍         | 17220/371472 [1:21:56<27:26:26,  3.59it/s]
                                                           
{'loss': 4.5533, 'learning_rate': 9.58741838867461e-07, 'epoch': 0.74}

  5%|▍         | 17220/371472 [1:21:56<27:26:26,  3.59it/s]
  5%|▍         | 17221/371472 [1:21:56<27:19:09,  3.60it/s]
  5%|▍         | 17222/371472 [1:21:56<27:24:06,  3.59it/s]
  5%|▍         | 17223/371472 [1:21:57<27:35:48,  3.57it/s]
  5%|▍         | 17224/371472 [1:21:57<27:23:19,  3.59it/s]
  5%|▍         | 17225/371472 [1:21:57<26:16:48,  3.74it/s]
  5%|▍         | 17226/371472 [1:21:58<29:03:17,  3.39it/s]
  5%|▍         | 17227/371472 [1:21:58<27:36:15,  3.56it/s]
  5%|▍         | 17228/371472 [1:21:58<27:27:29,  3.58it/s]
  5%|▍         | 17229/371472 [1:21:58<27:31:18,  3.58it/s]
  5%|▍         | 17230/371472 [1:21:59<27:21:44,  3.60it/s]
  5%|▍         | 17231/371472 [1:21:59<26:27:36,  3.72it/s]
  5%|▍         | 17232/371472 [1:21:59<27:26:43,  3.59it/s]
  5%|▍         | 17233/371472 [1:21:59<28:05:16,  3.50it/s]
  5%|▍         | 17234/371472 [1:22:00<27:37:58,  3.56it/s]
  5%|▍         | 17235/371472 [1:22:00<26:25:54,  3.72it/s]
  5%|▍         | 17236/371472 [1:22:00<26:04:06,  3.77it/s]
  5%|▍         | 17237/371472 [1:22:00<25:59:11,  3.79it/s]
  5%|▍         | 17238/371472 [1:22:01<29:50:39,  3.30it/s]
  5%|▍         | 17239/371472 [1:22:01<28:41:51,  3.43it/s]
  5%|▍         | 17240/371472 [1:22:01<27:54:56,  3.52it/s]
                                                           
{'loss': 4.6068, 'learning_rate': 9.58693356891982e-07, 'epoch': 0.74}

  5%|▍         | 17240/371472 [1:22:01<27:54:56,  3.52it/s]
  5%|▍         | 17241/371472 [1:22:02<26:47:56,  3.67it/s]
  5%|▍         | 17242/371472 [1:22:02<28:01:07,  3.51it/s]
  5%|▍         | 17243/371472 [1:22:02<27:58:39,  3.52it/s]
  5%|▍         | 17244/371472 [1:22:03<27:51:05,  3.53it/s]
  5%|▍         | 17245/371472 [1:22:03<27:36:51,  3.56it/s]
  5%|▍         | 17246/371472 [1:22:03<29:01:14,  3.39it/s]
  5%|▍         | 17247/371472 [1:22:03<30:55:02,  3.18it/s]
  5%|▍         | 17248/371472 [1:22:04<28:57:59,  3.40it/s]
  5%|▍         | 17249/371472 [1:22:04<27:21:19,  3.60it/s]
  5%|▍         | 17250/371472 [1:22:04<27:26:51,  3.58it/s]
  5%|▍         | 17251/371472 [1:22:05<26:46:18,  3.68it/s]
  5%|▍         | 17252/371472 [1:22:05<27:01:00,  3.64it/s]
  5%|▍         | 17253/371472 [1:22:05<27:12:17,  3.62it/s]
  5%|▍         | 17254/371472 [1:22:05<29:08:13,  3.38it/s]
  5%|▍         | 17255/371472 [1:22:06<28:39:40,  3.43it/s]
  5%|▍         | 17256/371472 [1:22:06<28:52:14,  3.41it/s]
  5%|▍         | 17257/371472 [1:22:06<27:23:44,  3.59it/s]
  5%|▍         | 17258/371472 [1:22:06<26:46:25,  3.67it/s]
  5%|▍         | 17259/371472 [1:22:07<26:55:40,  3.65it/s]
  5%|▍         | 17260/371472 [1:22:07<27:14:00,  3.61it/s]
                                                           
{'loss': 4.6679, 'learning_rate': 9.586448749165032e-07, 'epoch': 0.74}

  5%|▍         | 17260/371472 [1:22:07<27:14:00,  3.61it/s]
  5%|▍         | 17261/371472 [1:22:07<28:09:10,  3.49it/s]
  5%|▍         | 17262/371472 [1:22:08<27:56:43,  3.52it/s]
  5%|▍         | 17263/371472 [1:22:08<27:23:41,  3.59it/s]
  5%|▍         | 17264/371472 [1:22:08<27:19:35,  3.60it/s]
  5%|▍         | 17265/371472 [1:22:08<26:54:20,  3.66it/s]
  5%|▍         | 17266/371472 [1:22:09<26:09:48,  3.76it/s]
  5%|▍         | 17267/371472 [1:22:09<25:46:51,  3.82it/s]
  5%|▍         | 17268/371472 [1:22:09<25:40:05,  3.83it/s]
  5%|▍         | 17269/371472 [1:22:09<25:49:28,  3.81it/s]
  5%|▍         | 17270/371472 [1:22:10<25:57:07,  3.79it/s]
  5%|▍         | 17271/371472 [1:22:10<26:37:35,  3.70it/s]
  5%|▍         | 17272/371472 [1:22:10<25:36:22,  3.84it/s]
  5%|▍         | 17273/371472 [1:22:11<26:30:16,  3.71it/s]
  5%|▍         | 17274/371472 [1:22:11<26:44:45,  3.68it/s]
  5%|▍         | 17275/371472 [1:22:11<26:04:42,  3.77it/s]
  5%|▍         | 17276/371472 [1:22:11<26:32:22,  3.71it/s]
  5%|▍         | 17277/371472 [1:22:12<28:12:14,  3.49it/s]
  5%|▍         | 17278/371472 [1:22:12<27:40:48,  3.55it/s]
  5%|▍         | 17279/371472 [1:22:12<27:58:47,  3.52it/s]
  5%|▍         | 17280/371472 [1:22:13<28:50:18,  3.41it/s]
                                                           
{'loss': 4.7084, 'learning_rate': 9.585963929410244e-07, 'epoch': 0.74}

  5%|▍         | 17280/371472 [1:22:13<28:50:18,  3.41it/s]
  5%|▍         | 17281/371472 [1:22:13<29:10:34,  3.37it/s]
  5%|▍         | 17282/371472 [1:22:13<28:35:29,  3.44it/s]
  5%|▍         | 17283/371472 [1:22:13<30:01:38,  3.28it/s]
  5%|▍         | 17284/371472 [1:22:14<31:22:09,  3.14it/s]
  5%|▍         | 17285/371472 [1:22:14<30:32:33,  3.22it/s]
  5%|▍         | 17286/371472 [1:22:14<30:13:40,  3.25it/s]
  5%|▍         | 17287/371472 [1:22:15<28:35:57,  3.44it/s]
  5%|▍         | 17288/371472 [1:22:15<27:56:55,  3.52it/s]
  5%|▍         | 17289/371472 [1:22:15<27:17:18,  3.61it/s]
  5%|▍         | 17290/371472 [1:22:15<27:59:39,  3.51it/s]
  5%|▍         | 17291/371472 [1:22:16<28:23:42,  3.46it/s]
  5%|▍         | 17292/371472 [1:22:16<28:18:42,  3.47it/s]
  5%|▍         | 17293/371472 [1:22:16<28:05:49,  3.50it/s]
  5%|▍         | 17294/371472 [1:22:17<29:49:50,  3.30it/s]
  5%|▍         | 17295/371472 [1:22:17<30:39:39,  3.21it/s]
  5%|▍         | 17296/371472 [1:22:17<30:59:05,  3.18it/s]
  5%|▍         | 17297/371472 [1:22:18<31:28:59,  3.12it/s]
  5%|▍         | 17298/371472 [1:22:18<32:11:04,  3.06it/s]
  5%|▍         | 17299/371472 [1:22:18<31:45:35,  3.10it/s]
  5%|▍         | 17300/371472 [1:22:19<29:48:16,  3.30it/s]
                                                           
{'loss': 4.5974, 'learning_rate': 9.585479109655455e-07, 'epoch': 0.75}

  5%|▍         | 17300/371472 [1:22:19<29:48:16,  3.30it/s]
  5%|▍         | 17301/371472 [1:22:19<28:39:26,  3.43it/s]
  5%|▍         | 17302/371472 [1:22:19<27:47:42,  3.54it/s]
  5%|▍         | 17303/371472 [1:22:19<27:33:29,  3.57it/s]
  5%|▍         | 17304/371472 [1:22:20<27:27:32,  3.58it/s]
  5%|▍         | 17305/371472 [1:22:20<27:20:15,  3.60it/s]
  5%|▍         | 17306/371472 [1:22:20<26:30:24,  3.71it/s]
  5%|▍         | 17307/371472 [1:22:20<27:02:38,  3.64it/s]
  5%|▍         | 17308/371472 [1:22:21<26:48:08,  3.67it/s]
  5%|▍         | 17309/371472 [1:22:21<27:00:23,  3.64it/s]
  5%|▍         | 17310/371472 [1:22:21<29:07:04,  3.38it/s]
  5%|▍         | 17311/371472 [1:22:22<28:27:37,  3.46it/s]
  5%|▍         | 17312/371472 [1:22:22<31:42:15,  3.10it/s]
  5%|▍         | 17313/371472 [1:22:22<29:21:28,  3.35it/s]
  5%|▍         | 17314/371472 [1:22:23<28:17:33,  3.48it/s]
  5%|▍         | 17315/371472 [1:22:23<27:11:01,  3.62it/s]
  5%|▍         | 17316/371472 [1:22:23<26:59:04,  3.65it/s]
  5%|▍         | 17317/371472 [1:22:23<26:38:07,  3.69it/s]
  5%|▍         | 17318/371472 [1:22:24<28:47:31,  3.42it/s]
  5%|▍         | 17319/371472 [1:22:24<28:18:32,  3.48it/s]
  5%|▍         | 17320/371472 [1:22:24<28:32:55,  3.45it/s]
                                                           
{'loss': 4.8029, 'learning_rate': 9.584994289900666e-07, 'epoch': 0.75}

  5%|▍         | 17320/371472 [1:22:24<28:32:55,  3.45it/s]
  5%|▍         | 17321/371472 [1:22:25<29:10:15,  3.37it/s]
  5%|▍         | 17322/371472 [1:22:25<30:02:09,  3.28it/s]
  5%|▍         | 17323/371472 [1:22:25<28:53:53,  3.40it/s]
  5%|▍         | 17324/371472 [1:22:25<27:59:48,  3.51it/s]
  5%|▍         | 17325/371472 [1:22:26<28:01:56,  3.51it/s]
  5%|▍         | 17326/371472 [1:22:26<27:24:59,  3.59it/s]
  5%|▍         | 17327/371472 [1:22:26<26:58:37,  3.65it/s]
  5%|▍         | 17328/371472 [1:22:27<26:59:44,  3.64it/s]
  5%|▍         | 17329/371472 [1:22:27<26:20:36,  3.73it/s]
  5%|▍         | 17330/371472 [1:22:27<27:06:44,  3.63it/s]
  5%|▍         | 17331/371472 [1:22:27<27:07:54,  3.63it/s]
  5%|▍         | 17332/371472 [1:22:28<27:28:18,  3.58it/s]
  5%|▍         | 17333/371472 [1:22:28<26:52:33,  3.66it/s]
  5%|▍         | 17334/371472 [1:22:28<26:51:16,  3.66it/s]
  5%|▍         | 17335/371472 [1:22:28<26:34:56,  3.70it/s]
  5%|▍         | 17336/371472 [1:22:29<26:40:27,  3.69it/s]
  5%|▍         | 17337/371472 [1:22:29<27:29:43,  3.58it/s]
  5%|▍         | 17338/371472 [1:22:29<27:06:43,  3.63it/s]
  5%|▍         | 17339/371472 [1:22:30<26:34:58,  3.70it/s]
  5%|▍         | 17340/371472 [1:22:30<26:55:35,  3.65it/s]
                                                           
{'loss': 4.6615, 'learning_rate': 9.584509470145877e-07, 'epoch': 0.75}

  5%|▍         | 17340/371472 [1:22:30<26:55:35,  3.65it/s]
  5%|▍         | 17341/371472 [1:22:30<26:38:13,  3.69it/s]
  5%|▍         | 17342/371472 [1:22:30<27:39:47,  3.56it/s]
  5%|▍         | 17343/371472 [1:22:31<27:14:22,  3.61it/s]
  5%|▍         | 17344/371472 [1:22:31<28:42:51,  3.43it/s]
  5%|▍         | 17345/371472 [1:22:31<30:46:04,  3.20it/s]
  5%|▍         | 17346/371472 [1:22:32<30:10:16,  3.26it/s]
  5%|▍         | 17347/371472 [1:22:32<29:53:46,  3.29it/s]
  5%|▍         | 17348/371472 [1:22:32<30:08:11,  3.26it/s]
  5%|▍         | 17349/371472 [1:22:32<28:10:00,  3.49it/s]
  5%|▍         | 17350/371472 [1:22:33<27:09:38,  3.62it/s]
  5%|▍         | 17351/371472 [1:22:33<28:48:33,  3.41it/s]
  5%|▍         | 17352/371472 [1:22:33<27:42:01,  3.55it/s]
  5%|▍         | 17353/371472 [1:22:34<27:27:43,  3.58it/s]
  5%|▍         | 17354/371472 [1:22:34<27:59:22,  3.51it/s]
  5%|▍         | 17355/371472 [1:22:34<27:15:30,  3.61it/s]
  5%|▍         | 17356/371472 [1:22:34<27:02:28,  3.64it/s]
  5%|▍         | 17357/371472 [1:22:35<26:54:23,  3.66it/s]
  5%|▍         | 17358/371472 [1:22:35<27:44:27,  3.55it/s]
  5%|▍         | 17359/371472 [1:22:35<27:45:50,  3.54it/s]
  5%|▍         | 17360/371472 [1:22:36<27:00:55,  3.64it/s]
                                                           
{'loss': 4.6187, 'learning_rate': 9.584024650391087e-07, 'epoch': 0.75}

  5%|▍         | 17360/371472 [1:22:36<27:00:55,  3.64it/s]
  5%|▍         | 17361/371472 [1:22:36<27:20:52,  3.60it/s]
  5%|▍         | 17362/371472 [1:22:36<26:22:56,  3.73it/s]
  5%|▍         | 17363/371472 [1:22:36<26:56:44,  3.65it/s]
  5%|▍         | 17364/371472 [1:22:37<28:05:04,  3.50it/s]
  5%|▍         | 17365/371472 [1:22:37<27:05:05,  3.63it/s]
  5%|▍         | 17366/371472 [1:22:37<26:44:12,  3.68it/s]
  5%|▍         | 17367/371472 [1:22:37<27:03:54,  3.63it/s]
  5%|▍         | 17368/371472 [1:22:38<26:45:09,  3.68it/s]
  5%|▍         | 17369/371472 [1:22:38<26:35:20,  3.70it/s]
  5%|▍         | 17370/371472 [1:22:38<27:13:11,  3.61it/s]
  5%|▍         | 17371/371472 [1:22:39<26:51:16,  3.66it/s]
  5%|▍         | 17372/371472 [1:22:39<26:55:29,  3.65it/s]
  5%|▍         | 17373/371472 [1:22:39<26:34:04,  3.70it/s]
  5%|▍         | 17374/371472 [1:22:39<29:52:33,  3.29it/s]
  5%|▍         | 17375/371472 [1:22:40<29:21:21,  3.35it/s]
  5%|▍         | 17376/371472 [1:22:40<28:20:32,  3.47it/s]
  5%|▍         | 17377/371472 [1:22:40<27:21:16,  3.60it/s]
  5%|▍         | 17378/371472 [1:22:41<29:05:48,  3.38it/s]
  5%|▍         | 17379/371472 [1:22:41<28:40:37,  3.43it/s]
  5%|▍         | 17380/371472 [1:22:41<27:39:35,  3.56it/s]
                                                           
{'loss': 4.6186, 'learning_rate': 9.5835398306363e-07, 'epoch': 0.75}

  5%|▍         | 17380/371472 [1:22:41<27:39:35,  3.56it/s]
  5%|▍         | 17381/371472 [1:22:41<27:55:38,  3.52it/s]
  5%|▍         | 17382/371472 [1:22:42<27:44:49,  3.54it/s]
  5%|▍         | 17383/371472 [1:22:42<26:59:01,  3.65it/s]
  5%|▍         | 17384/371472 [1:22:42<26:14:43,  3.75it/s]
  5%|▍         | 17385/371472 [1:22:42<26:25:07,  3.72it/s]
  5%|▍         | 17386/371472 [1:22:43<26:31:53,  3.71it/s]
  5%|▍         | 17387/371472 [1:22:43<27:36:38,  3.56it/s]
  5%|▍         | 17388/371472 [1:22:43<26:56:03,  3.65it/s]
  5%|▍         | 17389/371472 [1:22:44<27:24:21,  3.59it/s]
  5%|▍         | 17390/371472 [1:22:44<27:06:19,  3.63it/s]
  5%|▍         | 17391/371472 [1:22:44<30:36:33,  3.21it/s]
  5%|▍         | 17392/371472 [1:22:45<31:03:16,  3.17it/s]
  5%|▍         | 17393/371472 [1:22:45<30:01:42,  3.28it/s]
  5%|▍         | 17394/371472 [1:22:45<28:34:59,  3.44it/s]
  5%|▍         | 17395/371472 [1:22:45<27:27:30,  3.58it/s]
  5%|▍         | 17396/371472 [1:22:46<30:18:30,  3.25it/s]
  5%|▍         | 17397/371472 [1:22:46<29:18:18,  3.36it/s]
  5%|▍         | 17398/371472 [1:22:46<29:07:44,  3.38it/s]
  5%|▍         | 17399/371472 [1:22:47<28:21:56,  3.47it/s]
  5%|▍         | 17400/371472 [1:22:47<28:05:55,  3.50it/s]
                                                           
{'loss': 4.5701, 'learning_rate': 9.583055010881509e-07, 'epoch': 0.75}

  5%|▍         | 17400/371472 [1:22:47<28:05:55,  3.50it/s]
  5%|▍         | 17401/371472 [1:22:47<29:01:16,  3.39it/s]
  5%|▍         | 17402/371472 [1:22:47<28:46:04,  3.42it/s]
  5%|▍         | 17403/371472 [1:22:48<27:31:39,  3.57it/s]
  5%|▍         | 17404/371472 [1:22:48<27:34:11,  3.57it/s]
  5%|▍         | 17405/371472 [1:22:48<28:16:37,  3.48it/s]
  5%|▍         | 17406/371472 [1:22:49<29:50:37,  3.30it/s]
  5%|▍         | 17407/371472 [1:22:49<30:45:21,  3.20it/s]
  5%|▍         | 17408/371472 [1:22:49<30:07:44,  3.26it/s]
  5%|▍         | 17409/371472 [1:22:50<29:39:34,  3.32it/s]
  5%|▍         | 17410/371472 [1:22:50<28:29:15,  3.45it/s]
  5%|▍         | 17411/371472 [1:22:50<28:11:22,  3.49it/s]
  5%|▍         | 17412/371472 [1:22:50<28:08:04,  3.50it/s]
  5%|▍         | 17413/371472 [1:22:51<27:26:42,  3.58it/s]
  5%|▍         | 17414/371472 [1:22:51<26:47:14,  3.67it/s]
  5%|▍         | 17415/371472 [1:22:51<27:43:41,  3.55it/s]
  5%|▍         | 17416/371472 [1:22:52<27:39:10,  3.56it/s]
  5%|▍         | 17417/371472 [1:22:52<27:12:11,  3.62it/s]
  5%|▍         | 17418/371472 [1:22:52<27:02:46,  3.64it/s]
  5%|▍         | 17419/371472 [1:22:52<26:00:12,  3.78it/s]
  5%|▍         | 17420/371472 [1:22:53<25:21:11,  3.88it/s]
                                                           
{'loss': 4.8236, 'learning_rate': 9.582570191126722e-07, 'epoch': 0.75}

  5%|▍         | 17420/371472 [1:22:53<25:21:11,  3.88it/s]
  5%|▍         | 17421/371472 [1:22:53<25:55:01,  3.79it/s]
  5%|▍         | 17422/371472 [1:22:53<25:35:11,  3.84it/s]
  5%|▍         | 17423/371472 [1:22:53<25:41:33,  3.83it/s]
  5%|▍         | 17424/371472 [1:22:54<25:41:17,  3.83it/s]
  5%|▍         | 17425/371472 [1:22:54<25:21:23,  3.88it/s]
  5%|▍         | 17426/371472 [1:22:54<25:44:18,  3.82it/s]
  5%|▍         | 17427/371472 [1:22:54<26:39:58,  3.69it/s]
  5%|▍         | 17428/371472 [1:22:55<28:01:36,  3.51it/s]
  5%|▍         | 17429/371472 [1:22:55<26:54:41,  3.65it/s]
  5%|▍         | 17430/371472 [1:22:55<27:54:32,  3.52it/s]
  5%|▍         | 17431/371472 [1:22:56<27:16:07,  3.61it/s]
  5%|▍         | 17432/371472 [1:22:56<26:18:57,  3.74it/s]
  5%|▍         | 17433/371472 [1:22:56<25:39:52,  3.83it/s]
  5%|▍         | 17434/371472 [1:22:56<26:07:33,  3.76it/s]
  5%|▍         | 17435/371472 [1:22:57<27:55:30,  3.52it/s]
  5%|▍         | 17436/371472 [1:22:57<27:18:44,  3.60it/s]
  5%|▍         | 17437/371472 [1:22:57<26:59:57,  3.64it/s]
  5%|▍         | 17438/371472 [1:22:57<26:31:55,  3.71it/s]
  5%|▍         | 17439/371472 [1:22:58<26:13:03,  3.75it/s]
  5%|▍         | 17440/371472 [1:22:58<25:19:10,  3.88it/s]
                                                           
{'loss': 4.7821, 'learning_rate': 9.58208537137193e-07, 'epoch': 0.75}

  5%|▍         | 17440/371472 [1:22:58<25:19:10,  3.88it/s]
  5%|▍         | 17441/371472 [1:22:58<26:38:29,  3.69it/s]
  5%|▍         | 17442/371472 [1:22:59<28:55:42,  3.40it/s]
  5%|▍         | 17443/371472 [1:22:59<28:45:38,  3.42it/s]
  5%|▍         | 17444/371472 [1:22:59<27:20:00,  3.60it/s]
  5%|▍         | 17445/371472 [1:22:59<27:13:52,  3.61it/s]
  5%|▍         | 17446/371472 [1:23:00<27:42:46,  3.55it/s]
  5%|▍         | 17447/371472 [1:23:00<27:34:11,  3.57it/s]
  5%|▍         | 17448/371472 [1:23:00<26:51:55,  3.66it/s]
  5%|▍         | 17449/371472 [1:23:00<27:17:18,  3.60it/s]
  5%|▍         | 17450/371472 [1:23:01<28:22:49,  3.47it/s]
  5%|▍         | 17451/371472 [1:23:01<29:30:39,  3.33it/s]
  5%|▍         | 17452/371472 [1:23:01<28:29:13,  3.45it/s]
  5%|▍         | 17453/371472 [1:23:02<27:44:28,  3.54it/s]
  5%|▍         | 17454/371472 [1:23:02<27:25:02,  3.59it/s]
  5%|▍         | 17455/371472 [1:23:02<27:56:21,  3.52it/s]
  5%|▍         | 17456/371472 [1:23:02<27:37:26,  3.56it/s]
  5%|▍         | 17457/371472 [1:23:03<29:02:37,  3.39it/s]
  5%|▍         | 17458/371472 [1:23:03<30:53:31,  3.18it/s]
  5%|▍         | 17459/371472 [1:23:03<30:57:35,  3.18it/s]
  5%|▍         | 17460/371472 [1:23:04<30:01:04,  3.28it/s]
                                                           
{'loss': 4.3822, 'learning_rate': 9.581600551617143e-07, 'epoch': 0.75}

  5%|▍         | 17460/371472 [1:23:04<30:01:04,  3.28it/s]
  5%|▍         | 17461/371472 [1:23:04<30:25:32,  3.23it/s]
  5%|▍         | 17462/371472 [1:23:04<32:17:03,  3.05it/s]
  5%|▍         | 17463/371472 [1:23:05<30:32:16,  3.22it/s]
  5%|▍         | 17464/371472 [1:23:05<28:42:54,  3.42it/s]
  5%|▍         | 17465/371472 [1:23:05<27:59:09,  3.51it/s]
  5%|▍         | 17466/371472 [1:23:06<27:08:54,  3.62it/s]
  5%|▍         | 17467/371472 [1:23:06<26:35:00,  3.70it/s]
  5%|▍         | 17468/371472 [1:23:06<27:33:38,  3.57it/s]
  5%|▍         | 17469/371472 [1:23:06<27:14:33,  3.61it/s]
  5%|▍         | 17470/371472 [1:23:07<28:26:12,  3.46it/s]
  5%|▍         | 17471/371472 [1:23:07<27:51:02,  3.53it/s]
  5%|▍         | 17472/371472 [1:23:07<27:01:41,  3.64it/s]
  5%|▍         | 17473/371472 [1:23:07<26:15:03,  3.75it/s]
  5%|▍         | 17474/371472 [1:23:08<26:39:50,  3.69it/s]
  5%|▍         | 17475/371472 [1:23:08<26:17:21,  3.74it/s]
  5%|▍         | 17476/371472 [1:23:08<27:26:41,  3.58it/s]
  5%|▍         | 17477/371472 [1:23:09<28:21:27,  3.47it/s]
  5%|▍         | 17478/371472 [1:23:09<29:35:08,  3.32it/s]
  5%|▍         | 17479/371472 [1:23:09<30:00:14,  3.28it/s]
  5%|▍         | 17480/371472 [1:23:09<29:00:53,  3.39it/s]
                                                           
{'loss': 4.8352, 'learning_rate': 9.581115731862354e-07, 'epoch': 0.75}

  5%|▍         | 17480/371472 [1:23:10<29:00:53,  3.39it/s]
  5%|▍         | 17481/371472 [1:23:10<28:34:42,  3.44it/s]
  5%|▍         | 17482/371472 [1:23:10<27:45:44,  3.54it/s]
  5%|▍         | 17483/371472 [1:23:10<27:38:39,  3.56it/s]
  5%|▍         | 17484/371472 [1:23:11<26:42:05,  3.68it/s]
  5%|▍         | 17485/371472 [1:23:11<28:22:57,  3.46it/s]
  5%|▍         | 17486/371472 [1:23:11<28:19:12,  3.47it/s]
  5%|▍         | 17487/371472 [1:23:11<27:57:36,  3.52it/s]
  5%|▍         | 17488/371472 [1:23:12<28:20:28,  3.47it/s]
  5%|▍         | 17489/371472 [1:23:12<27:57:22,  3.52it/s]
  5%|▍         | 17490/371472 [1:23:12<28:29:07,  3.45it/s]
  5%|▍         | 17491/371472 [1:23:13<30:00:13,  3.28it/s]
  5%|▍         | 17492/371472 [1:23:13<28:30:46,  3.45it/s]
  5%|▍         | 17493/371472 [1:23:13<28:31:17,  3.45it/s]
  5%|▍         | 17494/371472 [1:23:14<28:30:13,  3.45it/s]
  5%|▍         | 17495/371472 [1:23:14<27:39:02,  3.56it/s]
  5%|▍         | 17496/371472 [1:23:14<26:35:58,  3.70it/s]
  5%|▍         | 17497/371472 [1:23:14<26:10:45,  3.76it/s]
  5%|▍         | 17498/371472 [1:23:15<25:44:54,  3.82it/s]
  5%|▍         | 17499/371472 [1:23:15<25:56:47,  3.79it/s]
  5%|▍         | 17500/371472 [1:23:15<26:34:05,  3.70it/s]
                                                           
{'loss': 4.5794, 'learning_rate': 9.580630912107564e-07, 'epoch': 0.75}

  5%|▍         | 17500/371472 [1:23:15<26:34:05,  3.70it/s]
  5%|▍         | 17501/371472 [1:23:15<26:05:35,  3.77it/s]
  5%|▍         | 17502/371472 [1:23:16<26:20:11,  3.73it/s]
  5%|▍         | 17503/371472 [1:23:16<26:29:15,  3.71it/s]
  5%|▍         | 17504/371472 [1:23:16<26:30:58,  3.71it/s]
  5%|▍         | 17505/371472 [1:23:16<27:11:41,  3.62it/s]
  5%|▍         | 17506/371472 [1:23:17<26:33:24,  3.70it/s]
  5%|▍         | 17507/371472 [1:23:17<26:36:47,  3.69it/s]
  5%|▍         | 17508/371472 [1:23:17<27:23:22,  3.59it/s]
  5%|▍         | 17509/371472 [1:23:18<29:41:48,  3.31it/s]
  5%|▍         | 17510/371472 [1:23:18<31:41:17,  3.10it/s]
  5%|▍         | 17511/371472 [1:23:18<32:09:30,  3.06it/s]
  5%|▍         | 17512/371472 [1:23:19<31:51:01,  3.09it/s]
  5%|▍         | 17513/371472 [1:23:19<30:07:50,  3.26it/s]
  5%|▍         | 17514/371472 [1:23:19<28:49:54,  3.41it/s]
  5%|▍         | 17515/371472 [1:23:19<28:25:31,  3.46it/s]
  5%|▍         | 17516/371472 [1:23:20<28:20:57,  3.47it/s]
  5%|▍         | 17517/371472 [1:23:20<27:52:29,  3.53it/s]
  5%|▍         | 17518/371472 [1:23:20<27:07:44,  3.62it/s]
  5%|▍         | 17519/371472 [1:23:21<28:38:06,  3.43it/s]
  5%|▍         | 17520/371472 [1:23:21<28:46:52,  3.42it/s]
                                                           
{'loss': 4.3318, 'learning_rate': 9.580146092352777e-07, 'epoch': 0.75}

  5%|▍         | 17520/371472 [1:23:21<28:46:52,  3.42it/s]
  5%|▍         | 17521/371472 [1:23:21<28:30:07,  3.45it/s]
  5%|▍         | 17522/371472 [1:23:22<31:11:00,  3.15it/s]
  5%|▍         | 17523/371472 [1:23:22<31:58:34,  3.07it/s]
  5%|▍         | 17524/371472 [1:23:22<30:11:22,  3.26it/s]
  5%|▍         | 17525/371472 [1:23:23<32:16:42,  3.05it/s]
  5%|▍         | 17526/371472 [1:23:23<30:36:13,  3.21it/s]
  5%|▍         | 17527/371472 [1:23:23<29:04:43,  3.38it/s]
  5%|▍         | 17528/371472 [1:23:23<28:39:33,  3.43it/s]
  5%|▍         | 17529/371472 [1:23:24<29:15:51,  3.36it/s]
  5%|▍         | 17530/371472 [1:23:24<29:03:23,  3.38it/s]
  5%|▍         | 17531/371472 [1:23:24<29:02:17,  3.39it/s]
  5%|▍         | 17532/371472 [1:23:25<28:38:52,  3.43it/s]
  5%|▍         | 17533/371472 [1:23:25<28:43:31,  3.42it/s]
  5%|▍         | 17534/371472 [1:23:25<29:32:18,  3.33it/s]
  5%|▍         | 17535/371472 [1:23:25<28:20:00,  3.47it/s]
  5%|▍         | 17536/371472 [1:23:26<27:44:28,  3.54it/s]
  5%|▍         | 17537/371472 [1:23:26<27:12:38,  3.61it/s]
  5%|▍         | 17538/371472 [1:23:26<29:02:14,  3.39it/s]
  5%|▍         | 17539/371472 [1:23:27<27:40:57,  3.55it/s]
  5%|▍         | 17540/371472 [1:23:27<26:57:26,  3.65it/s]
                                                           
{'loss': 4.4593, 'learning_rate': 9.579661272597986e-07, 'epoch': 0.76}

  5%|▍         | 17540/371472 [1:23:27<26:57:26,  3.65it/s]
  5%|▍         | 17541/371472 [1:23:27<29:17:44,  3.36it/s]
  5%|▍         | 17542/371472 [1:23:27<29:17:41,  3.36it/s]
  5%|▍         | 17543/371472 [1:23:28<29:10:09,  3.37it/s]
  5%|▍         | 17544/371472 [1:23:28<28:56:29,  3.40it/s]
  5%|▍         | 17545/371472 [1:23:28<28:39:49,  3.43it/s]
  5%|▍         | 17546/371472 [1:23:29<30:21:10,  3.24it/s]
  5%|▍         | 17547/371472 [1:23:29<30:36:33,  3.21it/s]
  5%|▍         | 17548/371472 [1:23:29<29:06:56,  3.38it/s]
  5%|▍         | 17549/371472 [1:23:29<27:47:03,  3.54it/s]
  5%|▍         | 17550/371472 [1:23:30<26:59:16,  3.64it/s]
  5%|▍         | 17551/371472 [1:23:30<27:02:56,  3.63it/s]
  5%|▍         | 17552/371472 [1:23:30<26:10:09,  3.76it/s]
  5%|▍         | 17553/371472 [1:23:31<27:52:42,  3.53it/s]
  5%|▍         | 17554/371472 [1:23:31<28:14:44,  3.48it/s]
  5%|▍         | 17555/371472 [1:23:31<27:15:13,  3.61it/s]
  5%|▍         | 17556/371472 [1:23:31<26:45:37,  3.67it/s]
  5%|▍         | 17557/371472 [1:23:32<27:36:20,  3.56it/s]
  5%|▍         | 17558/371472 [1:23:32<27:55:08,  3.52it/s]
  5%|▍         | 17559/371472 [1:23:32<27:09:22,  3.62it/s]
  5%|▍         | 17560/371472 [1:23:32<26:10:51,  3.75it/s]
                                                           
{'loss': 4.4453, 'learning_rate': 9.579176452843199e-07, 'epoch': 0.76}

  5%|▍         | 17560/371472 [1:23:32<26:10:51,  3.75it/s]
  5%|▍         | 17561/371472 [1:23:33<25:44:34,  3.82it/s]
  5%|▍         | 17562/371472 [1:23:33<26:40:39,  3.69it/s]
  5%|▍         | 17563/371472 [1:23:33<29:46:52,  3.30it/s]
  5%|▍         | 17564/371472 [1:23:34<28:08:33,  3.49it/s]
  5%|▍         | 17565/371472 [1:23:34<29:24:49,  3.34it/s]
  5%|▍         | 17566/371472 [1:23:34<28:33:53,  3.44it/s]
  5%|▍         | 17567/371472 [1:23:35<29:45:37,  3.30it/s]
  5%|▍         | 17568/371472 [1:23:35<29:24:03,  3.34it/s]
  5%|▍         | 17569/371472 [1:23:35<28:19:12,  3.47it/s]
  5%|▍         | 17570/371472 [1:23:35<30:13:50,  3.25it/s]
  5%|▍         | 17571/371472 [1:23:36<29:23:01,  3.35it/s]
  5%|▍         | 17572/371472 [1:23:36<28:41:22,  3.43it/s]
  5%|▍         | 17573/371472 [1:23:36<29:13:27,  3.36it/s]
  5%|▍         | 17574/371472 [1:23:37<28:42:02,  3.43it/s]
  5%|▍         | 17575/371472 [1:23:37<29:13:31,  3.36it/s]
  5%|▍         | 17576/371472 [1:23:37<28:41:33,  3.43it/s]
  5%|▍         | 17577/371472 [1:23:38<32:02:00,  3.07it/s]
  5%|▍         | 17578/371472 [1:23:38<29:58:03,  3.28it/s]
  5%|▍         | 17579/371472 [1:23:38<30:10:24,  3.26it/s]
  5%|▍         | 17580/371472 [1:23:38<28:50:07,  3.41it/s]
                                                           
{'loss': 4.5113, 'learning_rate': 9.578691633088407e-07, 'epoch': 0.76}

  5%|▍         | 17580/371472 [1:23:38<28:50:07,  3.41it/s]
  5%|▍         | 17581/371472 [1:23:39<28:17:32,  3.47it/s]
  5%|▍         | 17582/371472 [1:23:39<31:17:10,  3.14it/s]
  5%|▍         | 17583/371472 [1:23:39<29:22:15,  3.35it/s]
  5%|▍         | 17584/371472 [1:23:40<28:06:57,  3.50it/s]
  5%|▍         | 17585/371472 [1:23:40<28:21:59,  3.47it/s]
  5%|▍         | 17586/371472 [1:23:40<30:15:55,  3.25it/s]
  5%|▍         | 17587/371472 [1:23:41<28:35:15,  3.44it/s]
  5%|▍         | 17588/371472 [1:23:41<29:46:09,  3.30it/s]
  5%|▍         | 17589/371472 [1:23:41<30:08:46,  3.26it/s]
  5%|▍         | 17590/371472 [1:23:41<30:16:43,  3.25it/s]
  5%|▍         | 17591/371472 [1:23:42<28:21:08,  3.47it/s]
  5%|▍         | 17592/371472 [1:23:42<30:59:13,  3.17it/s]
  5%|▍         | 17593/371472 [1:23:42<30:32:28,  3.22it/s]
  5%|▍         | 17594/371472 [1:23:43<29:09:17,  3.37it/s]
  5%|▍         | 17595/371472 [1:23:43<29:37:38,  3.32it/s]
  5%|▍         | 17596/371472 [1:23:43<28:54:36,  3.40it/s]
  5%|▍         | 17597/371472 [1:23:44<27:51:06,  3.53it/s]
  5%|▍         | 17598/371472 [1:23:44<27:38:36,  3.56it/s]
  5%|▍         | 17599/371472 [1:23:44<28:40:58,  3.43it/s]
  5%|▍         | 17600/371472 [1:23:44<28:10:38,  3.49it/s]
                                                           
{'loss': 4.4507, 'learning_rate': 9.57820681333362e-07, 'epoch': 0.76}

  5%|▍         | 17600/371472 [1:23:44<28:10:38,  3.49it/s]
  5%|▍         | 17601/371472 [1:23:45<28:23:47,  3.46it/s]
  5%|▍         | 17602/371472 [1:23:45<28:42:21,  3.42it/s]
  5%|▍         | 17603/371472 [1:23:45<30:46:42,  3.19it/s]
  5%|▍         | 17604/371472 [1:23:46<29:11:28,  3.37it/s]
  5%|▍         | 17605/371472 [1:23:46<31:09:03,  3.16it/s]
  5%|▍         | 17606/371472 [1:23:46<32:26:17,  3.03it/s]
  5%|▍         | 17607/371472 [1:23:47<30:40:35,  3.20it/s]
  5%|▍         | 17608/371472 [1:23:47<29:08:07,  3.37it/s]
  5%|▍         | 17609/371472 [1:23:47<28:23:32,  3.46it/s]
  5%|▍         | 17610/371472 [1:23:47<28:24:37,  3.46it/s]
  5%|▍         | 17611/371472 [1:23:48<27:54:02,  3.52it/s]
  5%|▍         | 17612/371472 [1:23:48<28:02:34,  3.51it/s]
  5%|▍         | 17613/371472 [1:23:48<28:42:31,  3.42it/s]
  5%|▍         | 17614/371472 [1:23:49<28:58:52,  3.39it/s]
  5%|▍         | 17615/371472 [1:23:49<28:07:21,  3.50it/s]
  5%|▍         | 17616/371472 [1:23:49<27:20:04,  3.60it/s]
  5%|▍         | 17617/371472 [1:23:49<26:46:30,  3.67it/s]
  5%|▍         | 17618/371472 [1:23:50<26:09:24,  3.76it/s]
  5%|▍         | 17619/371472 [1:23:50<25:59:58,  3.78it/s]
  5%|▍         | 17620/371472 [1:23:50<29:11:15,  3.37it/s]
                                                           
{'loss': 4.5328, 'learning_rate': 9.57772199357883e-07, 'epoch': 0.76}

  5%|▍         | 17620/371472 [1:23:50<29:11:15,  3.37it/s]
  5%|▍         | 17621/371472 [1:23:51<28:21:14,  3.47it/s]
  5%|▍         | 17622/371472 [1:23:51<28:44:01,  3.42it/s]
  5%|▍         | 17623/371472 [1:23:51<30:36:40,  3.21it/s]
  5%|▍         | 17624/371472 [1:23:51<29:38:47,  3.32it/s]
  5%|▍         | 17625/371472 [1:23:52<29:35:37,  3.32it/s]
  5%|▍         | 17626/371472 [1:23:52<29:51:09,  3.29it/s]
  5%|▍         | 17627/371472 [1:23:52<29:50:17,  3.29it/s]
  5%|▍         | 17628/371472 [1:23:53<29:09:58,  3.37it/s]
  5%|▍         | 17629/371472 [1:23:53<30:14:18,  3.25it/s]
  5%|▍         | 17630/371472 [1:23:53<30:25:08,  3.23it/s]
  5%|▍         | 17631/371472 [1:23:54<30:40:23,  3.20it/s]
  5%|▍         | 17632/371472 [1:23:54<30:19:13,  3.24it/s]
  5%|▍         | 17633/371472 [1:23:54<29:19:48,  3.35it/s]
  5%|▍         | 17634/371472 [1:23:55<30:03:23,  3.27it/s]
  5%|▍         | 17635/371472 [1:23:55<29:35:27,  3.32it/s]
  5%|▍         | 17636/371472 [1:23:55<28:26:34,  3.46it/s]
  5%|▍         | 17637/371472 [1:23:55<28:37:25,  3.43it/s]
  5%|▍         | 17638/371472 [1:23:56<28:56:45,  3.40it/s]
  5%|▍         | 17639/371472 [1:23:56<28:32:22,  3.44it/s]
  5%|▍         | 17640/371472 [1:23:56<31:29:17,  3.12it/s]
                                                           
{'loss': 4.6588, 'learning_rate': 9.577237173824042e-07, 'epoch': 0.76}

  5%|▍         | 17640/371472 [1:23:56<31:29:17,  3.12it/s]
  5%|▍         | 17641/371472 [1:23:57<32:04:06,  3.06it/s]
  5%|▍         | 17642/371472 [1:23:57<30:40:20,  3.20it/s]
  5%|▍         | 17643/371472 [1:23:57<31:01:09,  3.17it/s]
  5%|▍         | 17644/371472 [1:23:58<29:47:04,  3.30it/s]
  5%|▍         | 17645/371472 [1:23:58<28:27:42,  3.45it/s]
  5%|▍         | 17646/371472 [1:23:58<28:11:43,  3.49it/s]
  5%|▍         | 17647/371472 [1:23:58<28:14:14,  3.48it/s]
  5%|▍         | 17648/371472 [1:23:59<27:52:50,  3.53it/s]
  5%|▍         | 17649/371472 [1:23:59<28:00:01,  3.51it/s]
  5%|▍         | 17650/371472 [1:23:59<27:49:29,  3.53it/s]
  5%|▍         | 17651/371472 [1:24:00<27:27:23,  3.58it/s]
  5%|▍         | 17652/371472 [1:24:00<29:49:03,  3.30it/s]
  5%|▍         | 17653/371472 [1:24:00<29:36:44,  3.32it/s]
  5%|▍         | 17654/371472 [1:24:00<28:24:51,  3.46it/s]
  5%|▍         | 17655/371472 [1:24:01<31:54:41,  3.08it/s]
  5%|▍         | 17656/371472 [1:24:01<30:29:01,  3.22it/s]
  5%|▍         | 17657/371472 [1:24:01<31:03:01,  3.17it/s]
  5%|▍         | 17658/371472 [1:24:02<29:40:12,  3.31it/s]
  5%|▍         | 17659/371472 [1:24:02<28:49:41,  3.41it/s]
  5%|▍         | 17660/371472 [1:24:02<29:24:57,  3.34it/s]
                                                           
{'loss': 4.5698, 'learning_rate': 9.576752354069254e-07, 'epoch': 0.76}

  5%|▍         | 17660/371472 [1:24:02<29:24:57,  3.34it/s]
  5%|▍         | 17661/371472 [1:24:03<30:23:01,  3.23it/s]
  5%|▍         | 17662/371472 [1:24:03<30:16:59,  3.25it/s]
  5%|▍         | 17663/371472 [1:24:03<30:23:40,  3.23it/s]
  5%|▍         | 17664/371472 [1:24:04<29:56:49,  3.28it/s]
  5%|▍         | 17665/371472 [1:24:04<30:27:15,  3.23it/s]
  5%|▍         | 17666/371472 [1:24:04<29:38:33,  3.32it/s]
  5%|▍         | 17667/371472 [1:24:04<28:52:47,  3.40it/s]
  5%|▍         | 17668/371472 [1:24:05<28:16:50,  3.48it/s]
  5%|▍         | 17669/371472 [1:24:05<28:38:48,  3.43it/s]
  5%|▍         | 17670/371472 [1:24:05<28:38:06,  3.43it/s]
  5%|▍         | 17671/371472 [1:24:06<32:02:28,  3.07it/s]
  5%|▍         | 17672/371472 [1:24:06<30:07:16,  3.26it/s]
  5%|▍         | 17673/371472 [1:24:06<30:00:55,  3.27it/s]
  5%|▍         | 17674/371472 [1:24:07<29:46:52,  3.30it/s]
  5%|▍         | 17675/371472 [1:24:07<30:21:51,  3.24it/s]
  5%|▍         | 17676/371472 [1:24:07<28:46:39,  3.42it/s]
  5%|▍         | 17677/371472 [1:24:07<28:08:35,  3.49it/s]
  5%|▍         | 17678/371472 [1:24:08<29:59:11,  3.28it/s]
  5%|▍         | 17679/371472 [1:24:08<29:39:50,  3.31it/s]
  5%|▍         | 17680/371472 [1:24:08<28:51:24,  3.41it/s]
                                                           
{'loss': 4.5499, 'learning_rate': 9.576267534314465e-07, 'epoch': 0.76}

  5%|▍         | 17680/371472 [1:24:08<28:51:24,  3.41it/s]
  5%|▍         | 17681/371472 [1:24:09<28:14:40,  3.48it/s]
  5%|▍         | 17682/371472 [1:24:09<30:44:03,  3.20it/s]
  5%|▍         | 17683/371472 [1:24:09<29:55:19,  3.28it/s]
  5%|▍         | 17684/371472 [1:24:10<31:11:51,  3.15it/s]
  5%|▍         | 17685/371472 [1:24:10<29:12:53,  3.36it/s]
  5%|▍         | 17686/371472 [1:24:10<27:51:06,  3.53it/s]
  5%|▍         | 17687/371472 [1:24:10<27:47:31,  3.54it/s]
  5%|▍         | 17688/371472 [1:24:11<29:40:09,  3.31it/s]
  5%|▍         | 17689/371472 [1:24:11<28:07:21,  3.49it/s]
  5%|▍         | 17690/371472 [1:24:11<27:59:58,  3.51it/s]
  5%|▍         | 17691/371472 [1:24:12<27:41:25,  3.55it/s]
  5%|▍         | 17692/371472 [1:24:12<27:41:56,  3.55it/s]
  5%|▍         | 17693/371472 [1:24:12<26:29:00,  3.71it/s]
  5%|▍         | 17694/371472 [1:24:12<26:44:27,  3.67it/s]
  5%|▍         | 17695/371472 [1:24:13<28:43:48,  3.42it/s]
  5%|▍         | 17696/371472 [1:24:13<28:17:57,  3.47it/s]
  5%|▍         | 17697/371472 [1:24:13<29:01:54,  3.38it/s]
  5%|▍         | 17698/371472 [1:24:14<28:31:43,  3.44it/s]
  5%|▍         | 17699/371472 [1:24:14<28:13:03,  3.48it/s]
  5%|▍         | 17700/371472 [1:24:14<27:17:39,  3.60it/s]
                                                           
{'loss': 4.6859, 'learning_rate': 9.575782714559676e-07, 'epoch': 0.76}

  5%|▍         | 17700/371472 [1:24:14<27:17:39,  3.60it/s]
  5%|▍         | 17701/371472 [1:24:14<26:52:22,  3.66it/s]
  5%|▍         | 17702/371472 [1:24:15<27:51:02,  3.53it/s]
  5%|▍         | 17703/371472 [1:24:15<26:59:44,  3.64it/s]
  5%|▍         | 17704/371472 [1:24:15<28:34:52,  3.44it/s]
  5%|▍         | 17705/371472 [1:24:15<27:59:46,  3.51it/s]
  5%|▍         | 17706/371472 [1:24:16<27:14:26,  3.61it/s]
  5%|▍         | 17707/371472 [1:24:16<28:37:03,  3.43it/s]
  5%|▍         | 17708/371472 [1:24:16<28:20:04,  3.47it/s]
  5%|▍         | 17709/371472 [1:24:17<30:08:19,  3.26it/s]
  5%|▍         | 17710/371472 [1:24:17<31:06:37,  3.16it/s]
  5%|▍         | 17711/371472 [1:24:17<29:23:14,  3.34it/s]
  5%|▍         | 17712/371472 [1:24:18<29:35:28,  3.32it/s]
  5%|▍         | 17713/371472 [1:24:18<28:27:53,  3.45it/s]
  5%|▍         | 17714/371472 [1:24:18<28:17:06,  3.47it/s]
  5%|▍         | 17715/371472 [1:24:18<28:25:33,  3.46it/s]
  5%|▍         | 17716/371472 [1:24:19<29:15:00,  3.36it/s]
  5%|▍         | 17717/371472 [1:24:19<30:09:03,  3.26it/s]
  5%|▍         | 17718/371472 [1:24:19<30:28:34,  3.22it/s]
  5%|▍         | 17719/371472 [1:24:20<31:42:48,  3.10it/s]
  5%|▍         | 17720/371472 [1:24:20<29:49:55,  3.29it/s]
                                                           
{'loss': 4.3594, 'learning_rate': 9.575297894804887e-07, 'epoch': 0.76}

  5%|▍         | 17720/371472 [1:24:20<29:49:55,  3.29it/s]
  5%|▍         | 17721/371472 [1:24:20<28:27:59,  3.45it/s]
  5%|▍         | 17722/371472 [1:24:21<28:26:01,  3.46it/s]
  5%|▍         | 17723/371472 [1:24:21<30:27:30,  3.23it/s]
  5%|▍         | 17724/371472 [1:24:21<28:45:43,  3.42it/s]
  5%|▍         | 17725/371472 [1:24:21<28:36:38,  3.43it/s]
  5%|▍         | 17726/371472 [1:24:22<28:50:51,  3.41it/s]
  5%|▍         | 17727/371472 [1:24:22<28:43:08,  3.42it/s]
  5%|▍         | 17728/371472 [1:24:22<28:44:45,  3.42it/s]
  5%|▍         | 17729/371472 [1:24:23<28:22:16,  3.46it/s]
  5%|▍         | 17730/371472 [1:24:23<28:40:42,  3.43it/s]
  5%|▍         | 17731/371472 [1:24:23<28:59:39,  3.39it/s]
  5%|▍         | 17732/371472 [1:24:24<31:01:04,  3.17it/s]
  5%|▍         | 17733/371472 [1:24:24<31:32:25,  3.12it/s]
  5%|▍         | 17734/371472 [1:24:24<30:48:32,  3.19it/s]
  5%|▍         | 17735/371472 [1:24:25<29:40:31,  3.31it/s]
  5%|▍         | 17736/371472 [1:24:25<30:28:42,  3.22it/s]
  5%|▍         | 17737/371472 [1:24:25<30:06:42,  3.26it/s]
  5%|▍         | 17738/371472 [1:24:25<29:39:57,  3.31it/s]
  5%|▍         | 17739/371472 [1:24:26<29:01:27,  3.39it/s]
  5%|▍         | 17740/371472 [1:24:26<27:59:56,  3.51it/s]
                                                           
{'loss': 4.3802, 'learning_rate': 9.574813075050097e-07, 'epoch': 0.76}

  5%|▍         | 17740/371472 [1:24:26<27:59:56,  3.51it/s]
  5%|▍         | 17741/371472 [1:24:26<28:09:58,  3.49it/s]
  5%|▍         | 17742/371472 [1:24:27<28:34:03,  3.44it/s]
  5%|▍         | 17743/371472 [1:24:27<28:15:35,  3.48it/s]
  5%|▍         | 17744/371472 [1:24:27<27:46:26,  3.54it/s]
  5%|▍         | 17745/371472 [1:24:27<26:50:56,  3.66it/s]
  5%|▍         | 17746/371472 [1:24:28<26:56:47,  3.65it/s]
  5%|▍         | 17747/371472 [1:24:28<29:00:08,  3.39it/s]
  5%|▍         | 17748/371472 [1:24:28<30:25:20,  3.23it/s]
  5%|▍         | 17749/371472 [1:24:29<32:19:08,  3.04it/s]
  5%|▍         | 17750/371472 [1:24:29<29:50:58,  3.29it/s]
  5%|▍         | 17751/371472 [1:24:29<29:19:48,  3.35it/s]
  5%|▍         | 17752/371472 [1:24:29<28:23:46,  3.46it/s]
  5%|▍         | 17753/371472 [1:24:30<27:31:31,  3.57it/s]
  5%|▍         | 17754/371472 [1:24:30<27:15:42,  3.60it/s]
  5%|▍         | 17755/371472 [1:24:30<28:00:32,  3.51it/s]
  5%|▍         | 17756/371472 [1:24:31<27:42:39,  3.55it/s]
  5%|▍         | 17757/371472 [1:24:31<26:55:24,  3.65it/s]
  5%|▍         | 17758/371472 [1:24:31<27:34:26,  3.56it/s]
  5%|▍         | 17759/371472 [1:24:32<30:04:15,  3.27it/s]
  5%|▍         | 17760/371472 [1:24:32<29:20:24,  3.35it/s]
                                                           
{'loss': 4.5581, 'learning_rate': 9.57432825529531e-07, 'epoch': 0.76}

  5%|▍         | 17760/371472 [1:24:32<29:20:24,  3.35it/s]
  5%|▍         | 17761/371472 [1:24:32<29:09:33,  3.37it/s]
  5%|▍         | 17762/371472 [1:24:32<27:58:50,  3.51it/s]
  5%|▍         | 17763/371472 [1:24:33<28:28:54,  3.45it/s]
  5%|▍         | 17764/371472 [1:24:33<27:36:05,  3.56it/s]
  5%|▍         | 17765/371472 [1:24:33<26:42:38,  3.68it/s]
  5%|▍         | 17766/371472 [1:24:33<27:29:56,  3.57it/s]
  5%|▍         | 17767/371472 [1:24:34<28:03:31,  3.50it/s]
  5%|▍         | 17768/371472 [1:24:34<27:12:37,  3.61it/s]
  5%|▍         | 17769/371472 [1:24:34<26:53:13,  3.65it/s]
  5%|▍         | 17770/371472 [1:24:35<26:38:12,  3.69it/s]
  5%|▍         | 17771/371472 [1:24:35<26:51:25,  3.66it/s]
  5%|▍         | 17772/371472 [1:24:35<26:21:40,  3.73it/s]
  5%|▍         | 17773/371472 [1:24:35<26:41:39,  3.68it/s]
  5%|▍         | 17774/371472 [1:24:36<26:22:05,  3.73it/s]
  5%|▍         | 17775/371472 [1:24:36<27:03:59,  3.63it/s]
  5%|▍         | 17776/371472 [1:24:36<27:27:52,  3.58it/s]
  5%|▍         | 17777/371472 [1:24:37<28:34:28,  3.44it/s]
  5%|▍         | 17778/371472 [1:24:37<27:52:00,  3.53it/s]
  5%|▍         | 17779/371472 [1:24:37<27:02:47,  3.63it/s]
  5%|▍         | 17780/371472 [1:24:37<28:32:12,  3.44it/s]
                                                           
{'loss': 4.6645, 'learning_rate': 9.573843435540519e-07, 'epoch': 0.77}

  5%|▍         | 17780/371472 [1:24:37<28:32:12,  3.44it/s]
  5%|▍         | 17781/371472 [1:24:38<28:14:16,  3.48it/s]
  5%|▍         | 17782/371472 [1:24:38<27:58:20,  3.51it/s]
  5%|▍         | 17783/371472 [1:24:38<27:20:37,  3.59it/s]
  5%|▍         | 17784/371472 [1:24:38<26:55:27,  3.65it/s]
  5%|▍         | 17785/371472 [1:24:39<26:33:23,  3.70it/s]
  5%|▍         | 17786/371472 [1:24:39<26:26:16,  3.72it/s]
  5%|▍         | 17787/371472 [1:24:39<25:48:25,  3.81it/s]
  5%|▍         | 17788/371472 [1:24:40<28:24:43,  3.46it/s]
  5%|▍         | 17789/371472 [1:24:40<28:04:02,  3.50it/s]
  5%|▍         | 17790/371472 [1:24:40<29:15:30,  3.36it/s]
  5%|▍         | 17791/371472 [1:24:40<28:17:52,  3.47it/s]
  5%|▍         | 17792/371472 [1:24:41<29:22:47,  3.34it/s]
  5%|▍         | 17793/371472 [1:24:41<28:01:04,  3.51it/s]
  5%|▍         | 17794/371472 [1:24:41<27:12:17,  3.61it/s]
  5%|▍         | 17795/371472 [1:24:42<27:38:16,  3.55it/s]
  5%|▍         | 17796/371472 [1:24:42<26:37:49,  3.69it/s]
  5%|▍         | 17797/371472 [1:24:42<35:21:03,  2.78it/s]
  5%|▍         | 17798/371472 [1:24:43<34:19:44,  2.86it/s]
  5%|▍         | 17799/371472 [1:24:43<32:08:38,  3.06it/s]
  5%|▍         | 17800/371472 [1:24:43<29:57:00,  3.28it/s]
                                                           
{'loss': 4.4874, 'learning_rate': 9.573358615785731e-07, 'epoch': 0.77}

  5%|▍         | 17800/371472 [1:24:43<29:57:00,  3.28it/s]
  5%|▍         | 17801/371472 [1:24:44<28:57:38,  3.39it/s]
  5%|▍         | 17802/371472 [1:24:44<28:16:13,  3.48it/s]
  5%|▍         | 17803/371472 [1:24:44<27:26:45,  3.58it/s]
  5%|▍         | 17804/371472 [1:24:44<27:32:39,  3.57it/s]
  5%|▍         | 17805/371472 [1:24:45<26:58:22,  3.64it/s]
  5%|▍         | 17806/371472 [1:24:45<26:04:27,  3.77it/s]
  5%|▍         | 17807/371472 [1:24:45<25:52:56,  3.80it/s]
  5%|▍         | 17808/371472 [1:24:45<26:28:09,  3.71it/s]
  5%|▍         | 17809/371472 [1:24:46<28:26:29,  3.45it/s]
  5%|▍         | 17810/371472 [1:24:46<28:12:33,  3.48it/s]
  5%|▍         | 17811/371472 [1:24:46<29:16:30,  3.36it/s]
  5%|▍         | 17812/371472 [1:24:47<30:32:32,  3.22it/s]
  5%|▍         | 17813/371472 [1:24:47<28:44:43,  3.42it/s]
  5%|▍         | 17814/371472 [1:24:47<27:59:32,  3.51it/s]
  5%|▍         | 17815/371472 [1:24:47<28:12:22,  3.48it/s]
  5%|▍         | 17816/371472 [1:24:48<27:04:51,  3.63it/s]
  5%|▍         | 17817/371472 [1:24:48<26:48:58,  3.66it/s]
  5%|▍         | 17818/371472 [1:24:48<27:03:02,  3.63it/s]
  5%|▍         | 17819/371472 [1:24:49<30:23:58,  3.23it/s]
  5%|▍         | 17820/371472 [1:24:49<28:42:01,  3.42it/s]
                                                           
{'loss': 4.401, 'learning_rate': 9.572873796030942e-07, 'epoch': 0.77}

  5%|▍         | 17820/371472 [1:24:49<28:42:01,  3.42it/s]
  5%|▍         | 17821/371472 [1:24:49<28:04:50,  3.50it/s]
  5%|▍         | 17822/371472 [1:24:49<28:44:11,  3.42it/s]
  5%|▍         | 17823/371472 [1:24:50<29:58:48,  3.28it/s]
  5%|▍         | 17824/371472 [1:24:50<30:52:05,  3.18it/s]
  5%|▍         | 17825/371472 [1:24:50<28:58:43,  3.39it/s]
  5%|▍         | 17826/371472 [1:24:51<28:16:37,  3.47it/s]
  5%|▍         | 17827/371472 [1:24:51<29:04:09,  3.38it/s]
  5%|▍         | 17828/371472 [1:24:51<28:07:08,  3.49it/s]
  5%|▍         | 17829/371472 [1:24:52<30:18:43,  3.24it/s]
  5%|▍         | 17830/371472 [1:24:52<32:30:39,  3.02it/s]
  5%|▍         | 17831/371472 [1:24:52<30:27:06,  3.23it/s]
  5%|▍         | 17832/371472 [1:24:53<28:34:05,  3.44it/s]
  5%|▍         | 17833/371472 [1:24:53<28:06:16,  3.50it/s]
  5%|▍         | 17834/371472 [1:24:53<27:47:00,  3.54it/s]
  5%|▍         | 17835/371472 [1:24:53<28:37:17,  3.43it/s]
  5%|▍         | 17836/371472 [1:24:54<27:28:52,  3.57it/s]
  5%|▍         | 17837/371472 [1:24:54<26:35:39,  3.69it/s]
  5%|▍         | 17838/371472 [1:24:54<26:40:04,  3.68it/s]
  5%|▍         | 17839/371472 [1:24:54<26:09:29,  3.76it/s]
  5%|▍         | 17840/371472 [1:24:55<27:02:32,  3.63it/s]
                                                           
{'loss': 4.5584, 'learning_rate': 9.572388976276153e-07, 'epoch': 0.77}

  5%|▍         | 17840/371472 [1:24:55<27:02:32,  3.63it/s]
  5%|▍         | 17841/371472 [1:24:55<26:56:02,  3.65it/s]
  5%|▍         | 17842/371472 [1:24:55<26:12:01,  3.75it/s]
  5%|▍         | 17843/371472 [1:24:56<28:45:16,  3.42it/s]
  5%|▍         | 17844/371472 [1:24:56<28:45:20,  3.42it/s]
  5%|▍         | 17845/371472 [1:24:56<28:56:25,  3.39it/s]
  5%|▍         | 17846/371472 [1:24:56<29:53:22,  3.29it/s]
  5%|▍         | 17847/371472 [1:24:57<28:41:12,  3.42it/s]
  5%|▍         | 17848/371472 [1:24:57<28:38:28,  3.43it/s]
  5%|▍         | 17849/371472 [1:24:57<27:44:16,  3.54it/s]
  5%|▍         | 17850/371472 [1:24:58<27:24:51,  3.58it/s]
  5%|▍         | 17851/371472 [1:24:58<27:36:03,  3.56it/s]
  5%|▍         | 17852/371472 [1:24:58<28:29:54,  3.45it/s]
  5%|▍         | 17853/371472 [1:24:58<28:23:33,  3.46it/s]
  5%|▍         | 17854/371472 [1:24:59<29:25:42,  3.34it/s]
  5%|▍         | 17855/371472 [1:24:59<27:50:19,  3.53it/s]
  5%|▍         | 17856/371472 [1:24:59<27:35:35,  3.56it/s]
  5%|▍         | 17857/371472 [1:25:00<27:44:21,  3.54it/s]
  5%|▍         | 17858/371472 [1:25:00<27:51:29,  3.53it/s]
  5%|▍         | 17859/371472 [1:25:00<28:10:59,  3.49it/s]
  5%|▍         | 17860/371472 [1:25:00<28:41:56,  3.42it/s]
                                                           
{'loss': 4.3602, 'learning_rate': 9.571904156521364e-07, 'epoch': 0.77}

  5%|▍         | 17860/371472 [1:25:00<28:41:56,  3.42it/s]
  5%|▍         | 17861/371472 [1:25:01<27:45:15,  3.54it/s]
  5%|▍         | 17862/371472 [1:25:01<27:38:27,  3.55it/s]
  5%|▍         | 17863/371472 [1:25:01<27:42:56,  3.54it/s]
  5%|▍         | 17864/371472 [1:25:02<26:56:37,  3.65it/s]
  5%|▍         | 17865/371472 [1:25:02<27:00:34,  3.64it/s]
  5%|▍         | 17866/371472 [1:25:02<26:16:55,  3.74it/s]
  5%|▍         | 17867/371472 [1:25:03<32:11:21,  3.05it/s]
  5%|▍         | 17868/371472 [1:25:03<30:42:17,  3.20it/s]
  5%|▍         | 17869/371472 [1:25:03<29:28:21,  3.33it/s]
  5%|▍         | 17870/371472 [1:25:03<28:47:34,  3.41it/s]
  5%|▍         | 17871/371472 [1:25:04<27:55:27,  3.52it/s]
  5%|▍         | 17872/371472 [1:25:04<28:06:03,  3.50it/s]
  5%|▍         | 17873/371472 [1:25:04<27:21:48,  3.59it/s]
  5%|▍         | 17874/371472 [1:25:04<27:59:33,  3.51it/s]
  5%|▍         | 17875/371472 [1:25:05<27:33:40,  3.56it/s]
  5%|▍         | 17876/371472 [1:25:05<28:19:21,  3.47it/s]
  5%|▍         | 17877/371472 [1:25:05<28:53:46,  3.40it/s]
  5%|▍         | 17878/371472 [1:25:06<28:34:37,  3.44it/s]
  5%|▍         | 17879/371472 [1:25:06<27:47:26,  3.53it/s]
  5%|▍         | 17880/371472 [1:25:06<27:05:22,  3.63it/s]
                                                           
{'loss': 4.5251, 'learning_rate': 9.571419336766574e-07, 'epoch': 0.77}

  5%|▍         | 17880/371472 [1:25:06<27:05:22,  3.63it/s]
  5%|▍         | 17881/371472 [1:25:06<26:55:27,  3.65it/s]
  5%|▍         | 17882/371472 [1:25:07<27:43:30,  3.54it/s]
  5%|▍         | 17883/371472 [1:25:07<26:46:13,  3.67it/s]
  5%|▍         | 17884/371472 [1:25:07<26:34:23,  3.70it/s]
  5%|▍         | 17885/371472 [1:25:08<25:52:56,  3.79it/s]
  5%|▍         | 17886/371472 [1:25:08<25:44:53,  3.81it/s]
  5%|▍         | 17887/371472 [1:25:08<25:39:08,  3.83it/s]
  5%|▍         | 17888/371472 [1:25:08<26:25:43,  3.72it/s]
  5%|▍         | 17889/371472 [1:25:09<28:59:38,  3.39it/s]
  5%|▍         | 17890/371472 [1:25:09<27:31:00,  3.57it/s]
  5%|▍         | 17891/371472 [1:25:09<29:33:09,  3.32it/s]
  5%|▍         | 17892/371472 [1:25:10<28:18:12,  3.47it/s]
  5%|▍         | 17893/371472 [1:25:10<28:06:05,  3.50it/s]
  5%|▍         | 17894/371472 [1:25:10<29:57:56,  3.28it/s]
  5%|▍         | 17895/371472 [1:25:10<30:37:29,  3.21it/s]
  5%|▍         | 17896/371472 [1:25:11<32:52:13,  2.99it/s]
  5%|▍         | 17897/371472 [1:25:11<30:36:55,  3.21it/s]
  5%|▍         | 17898/371472 [1:25:11<29:55:59,  3.28it/s]
  5%|▍         | 17899/371472 [1:25:12<28:43:56,  3.42it/s]
  5%|▍         | 17900/371472 [1:25:12<28:27:22,  3.45it/s]
                                                           
{'loss': 4.51, 'learning_rate': 9.570934517011787e-07, 'epoch': 0.77}

  5%|▍         | 17900/371472 [1:25:12<28:27:22,  3.45it/s]
  5%|▍         | 17901/371472 [1:25:12<30:41:16,  3.20it/s]
  5%|▍         | 17902/371472 [1:25:13<30:47:57,  3.19it/s]
  5%|▍         | 17903/371472 [1:25:13<29:55:23,  3.28it/s]
  5%|▍         | 17904/371472 [1:25:13<31:59:17,  3.07it/s]
  5%|▍         | 17905/371472 [1:25:14<32:35:17,  3.01it/s]
  5%|▍         | 17906/371472 [1:25:14<30:18:58,  3.24it/s]
  5%|▍         | 17907/371472 [1:25:14<28:58:01,  3.39it/s]
  5%|▍         | 17908/371472 [1:25:14<27:13:28,  3.61it/s]
  5%|▍         | 17909/371472 [1:25:15<26:58:58,  3.64it/s]
  5%|▍         | 17910/371472 [1:25:15<27:47:41,  3.53it/s]
  5%|▍         | 17911/371472 [1:25:15<27:35:49,  3.56it/s]
  5%|▍         | 17912/371472 [1:25:16<27:01:31,  3.63it/s]
  5%|▍         | 17913/371472 [1:25:16<27:13:51,  3.61it/s]
  5%|▍         | 17914/371472 [1:25:16<26:36:30,  3.69it/s]
  5%|▍         | 17915/371472 [1:25:16<26:06:43,  3.76it/s]
  5%|▍         | 17916/371472 [1:25:17<27:33:22,  3.56it/s]
  5%|▍         | 17917/371472 [1:25:17<26:20:58,  3.73it/s]
  5%|▍         | 17918/371472 [1:25:17<26:28:53,  3.71it/s]
  5%|▍         | 17919/371472 [1:25:17<25:57:42,  3.78it/s]
  5%|▍         | 17920/371472 [1:25:18<28:45:04,  3.42it/s]
                                                           
{'loss': 4.3659, 'learning_rate': 9.570449697256998e-07, 'epoch': 0.77}

  5%|▍         | 17920/371472 [1:25:18<28:45:04,  3.42it/s]
  5%|▍         | 17921/371472 [1:25:18<29:07:28,  3.37it/s]
  5%|▍         | 17922/371472 [1:25:18<29:55:00,  3.28it/s]
  5%|▍         | 17923/371472 [1:25:19<28:27:16,  3.45it/s]
  5%|▍         | 17924/371472 [1:25:19<27:51:49,  3.52it/s]
  5%|▍         | 17925/371472 [1:25:19<27:52:31,  3.52it/s]
  5%|▍         | 17926/371472 [1:25:19<26:58:52,  3.64it/s]
  5%|▍         | 17927/371472 [1:25:20<26:13:06,  3.75it/s]
  5%|▍         | 17928/371472 [1:25:20<27:38:09,  3.55it/s]
  5%|▍         | 17929/371472 [1:25:20<27:10:17,  3.61it/s]
  5%|▍         | 17930/371472 [1:25:21<28:53:26,  3.40it/s]
  5%|▍         | 17931/371472 [1:25:21<29:02:22,  3.38it/s]
  5%|▍         | 17932/371472 [1:25:21<29:04:22,  3.38it/s]
  5%|▍         | 17933/371472 [1:25:21<28:47:45,  3.41it/s]
  5%|▍         | 17934/371472 [1:25:22<27:51:44,  3.52it/s]
  5%|▍         | 17935/371472 [1:25:22<28:52:33,  3.40it/s]
  5%|▍         | 17936/371472 [1:25:22<28:49:21,  3.41it/s]
  5%|▍         | 17937/371472 [1:25:23<29:05:10,  3.38it/s]
  5%|▍         | 17938/371472 [1:25:23<28:45:38,  3.41it/s]
  5%|▍         | 17939/371472 [1:25:23<28:33:22,  3.44it/s]
  5%|▍         | 17940/371472 [1:25:23<27:51:00,  3.53it/s]
                                                           
{'loss': 4.6877, 'learning_rate': 9.569964877502209e-07, 'epoch': 0.77}

  5%|▍         | 17940/371472 [1:25:23<27:51:00,  3.53it/s]
  5%|▍         | 17941/371472 [1:25:24<27:52:37,  3.52it/s]
  5%|▍         | 17942/371472 [1:25:24<29:00:34,  3.39it/s]
  5%|▍         | 17943/371472 [1:25:24<28:48:03,  3.41it/s]
  5%|▍         | 17944/371472 [1:25:25<28:01:16,  3.50it/s]
  5%|▍         | 17945/371472 [1:25:25<27:24:34,  3.58it/s]
  5%|▍         | 17946/371472 [1:25:25<27:05:37,  3.62it/s]
  5%|▍         | 17947/371472 [1:25:25<26:50:38,  3.66it/s]
  5%|▍         | 17948/371472 [1:25:26<27:21:58,  3.59it/s]
  5%|▍         | 17949/371472 [1:25:26<27:14:40,  3.60it/s]
  5%|▍         | 17950/371472 [1:25:26<28:41:37,  3.42it/s]
  5%|▍         | 17951/371472 [1:25:27<28:04:57,  3.50it/s]
  5%|▍         | 17952/371472 [1:25:27<27:21:23,  3.59it/s]
  5%|▍         | 17953/371472 [1:25:27<27:05:45,  3.62it/s]
  5%|▍         | 17954/371472 [1:25:27<27:42:26,  3.54it/s]
  5%|▍         | 17955/371472 [1:25:28<26:33:43,  3.70it/s]
  5%|▍         | 17956/371472 [1:25:28<26:34:11,  3.70it/s]
  5%|▍         | 17957/371472 [1:25:28<29:55:49,  3.28it/s]
  5%|▍         | 17958/371472 [1:25:29<28:45:48,  3.41it/s]
  5%|▍         | 17959/371472 [1:25:29<28:58:21,  3.39it/s]
  5%|▍         | 17960/371472 [1:25:29<27:34:08,  3.56it/s]
                                                           
{'loss': 4.4384, 'learning_rate': 9.56948005774742e-07, 'epoch': 0.77}

  5%|▍         | 17960/371472 [1:25:29<27:34:08,  3.56it/s]
  5%|▍         | 17961/371472 [1:25:29<27:27:50,  3.58it/s]
  5%|▍         | 17962/371472 [1:25:30<28:15:00,  3.48it/s]
  5%|▍         | 17963/371472 [1:25:30<27:41:23,  3.55it/s]
  5%|▍         | 17964/371472 [1:25:30<27:37:28,  3.55it/s]
  5%|▍         | 17965/371472 [1:25:31<29:35:00,  3.32it/s]
  5%|▍         | 17966/371472 [1:25:31<28:32:56,  3.44it/s]
  5%|▍         | 17967/371472 [1:25:31<34:04:29,  2.88it/s]
  5%|▍         | 17968/371472 [1:25:32<31:51:24,  3.08it/s]
  5%|▍         | 17969/371472 [1:25:32<30:39:27,  3.20it/s]
  5%|▍         | 17970/371472 [1:25:32<29:07:15,  3.37it/s]
  5%|▍         | 17971/371472 [1:25:32<28:56:46,  3.39it/s]
  5%|▍         | 17972/371472 [1:25:33<27:18:43,  3.60it/s]
  5%|▍         | 17973/371472 [1:25:33<28:43:23,  3.42it/s]
  5%|▍         | 17974/371472 [1:25:33<27:50:10,  3.53it/s]
  5%|▍         | 17975/371472 [1:25:34<27:08:21,  3.62it/s]
  5%|▍         | 17976/371472 [1:25:34<26:58:33,  3.64it/s]
  5%|▍         | 17977/371472 [1:25:34<26:25:46,  3.72it/s]
  5%|▍         | 17978/371472 [1:25:34<27:28:05,  3.57it/s]
  5%|▍         | 17979/371472 [1:25:35<27:18:30,  3.60it/s]
  5%|▍         | 17980/371472 [1:25:35<28:48:49,  3.41it/s]
                                                           
{'loss': 4.763, 'learning_rate': 9.56899523799263e-07, 'epoch': 0.77}

  5%|▍         | 17980/371472 [1:25:35<28:48:49,  3.41it/s]
  5%|▍         | 17981/371472 [1:25:35<28:05:41,  3.50it/s]
  5%|▍         | 17982/371472 [1:25:36<27:46:37,  3.53it/s]
  5%|▍         | 17983/371472 [1:25:36<27:45:50,  3.54it/s]
  5%|▍         | 17984/371472 [1:25:36<27:44:19,  3.54it/s]
  5%|▍         | 17985/371472 [1:25:36<27:50:53,  3.53it/s]
  5%|▍         | 17986/371472 [1:25:37<28:09:58,  3.49it/s]
  5%|▍         | 17987/371472 [1:25:37<27:21:53,  3.59it/s]
  5%|▍         | 17988/371472 [1:25:37<27:28:07,  3.57it/s]
  5%|▍         | 17989/371472 [1:25:38<27:35:23,  3.56it/s]
  5%|▍         | 17990/371472 [1:25:38<27:33:10,  3.56it/s]
  5%|▍         | 17991/371472 [1:25:38<26:41:36,  3.68it/s]
  5%|▍         | 17992/371472 [1:25:38<27:27:15,  3.58it/s]
  5%|▍         | 17993/371472 [1:25:39<26:51:03,  3.66it/s]
  5%|▍         | 17994/371472 [1:25:39<26:03:49,  3.77it/s]
  5%|▍         | 17995/371472 [1:25:39<26:39:06,  3.68it/s]
  5%|▍         | 17996/371472 [1:25:39<28:27:03,  3.45it/s]
  5%|▍         | 17997/371472 [1:25:40<29:35:02,  3.32it/s]
  5%|▍         | 17998/371472 [1:25:40<28:50:40,  3.40it/s]
  5%|▍         | 17999/371472 [1:25:40<31:33:10,  3.11it/s]
  5%|▍         | 18000/371472 [1:25:41<29:51:13,  3.29it/s]
                                                           
{'loss': 4.7351, 'learning_rate': 9.56851041823784e-07, 'epoch': 0.78}

  5%|▍         | 18000/371472 [1:25:41<29:51:13,  3.29it/s]
  5%|▍         | 18001/371472 [1:25:41<29:04:46,  3.38it/s]
  5%|▍         | 18002/371472 [1:25:41<30:44:12,  3.19it/s]
  5%|▍         | 18003/371472 [1:25:42<30:24:53,  3.23it/s]
  5%|▍         | 18004/371472 [1:25:42<31:36:15,  3.11it/s]
  5%|▍         | 18005/371472 [1:25:42<29:50:45,  3.29it/s]
  5%|▍         | 18006/371472 [1:25:43<30:31:16,  3.22it/s]
  5%|▍         | 18007/371472 [1:25:43<29:20:33,  3.35it/s]
  5%|▍         | 18008/371472 [1:25:43<27:48:29,  3.53it/s]
  5%|▍         | 18009/371472 [1:25:43<27:19:13,  3.59it/s]
  5%|▍         | 18010/371472 [1:25:44<29:43:51,  3.30it/s]
  5%|▍         | 18011/371472 [1:25:44<28:57:42,  3.39it/s]
  5%|▍         | 18012/371472 [1:25:44<28:37:16,  3.43it/s]
  5%|▍         | 18013/371472 [1:25:45<28:59:34,  3.39it/s]
  5%|▍         | 18014/371472 [1:25:45<28:41:44,  3.42it/s]
  5%|▍         | 18015/371472 [1:25:45<28:34:29,  3.44it/s]
  5%|▍         | 18016/371472 [1:25:45<28:26:45,  3.45it/s]
  5%|▍         | 18017/371472 [1:25:46<29:17:34,  3.35it/s]
  5%|▍         | 18018/371472 [1:25:46<27:49:35,  3.53it/s]
  5%|▍         | 18019/371472 [1:25:46<30:22:23,  3.23it/s]
  5%|▍         | 18020/371472 [1:25:47<29:08:52,  3.37it/s]
                                                           
{'loss': 4.539, 'learning_rate': 9.568025598483051e-07, 'epoch': 0.78}

  5%|▍         | 18020/371472 [1:25:47<29:08:52,  3.37it/s]
  5%|▍         | 18021/371472 [1:25:47<28:24:10,  3.46it/s]
  5%|▍         | 18022/371472 [1:25:47<27:51:40,  3.52it/s]
  5%|▍         | 18023/371472 [1:25:48<29:01:10,  3.38it/s]
  5%|▍         | 18024/371472 [1:25:48<28:06:14,  3.49it/s]
  5%|▍         | 18025/371472 [1:25:48<27:16:56,  3.60it/s]
  5%|▍         | 18026/371472 [1:25:48<26:59:05,  3.64it/s]
  5%|▍         | 18027/371472 [1:25:49<28:58:22,  3.39it/s]
  5%|▍         | 18028/371472 [1:25:49<27:38:59,  3.55it/s]
  5%|▍         | 18029/371472 [1:25:49<27:50:23,  3.53it/s]
  5%|▍         | 18030/371472 [1:25:50<27:56:43,  3.51it/s]
  5%|▍         | 18031/371472 [1:25:50<28:55:38,  3.39it/s]
  5%|▍         | 18032/371472 [1:25:50<29:35:05,  3.32it/s]
  5%|▍         | 18033/371472 [1:25:50<28:29:16,  3.45it/s]
  5%|▍         | 18034/371472 [1:25:51<30:30:46,  3.22it/s]
  5%|▍         | 18035/371472 [1:25:51<30:29:53,  3.22it/s]
  5%|▍         | 18036/371472 [1:25:51<29:03:10,  3.38it/s]
  5%|▍         | 18037/371472 [1:25:52<28:46:08,  3.41it/s]
  5%|▍         | 18038/371472 [1:25:52<27:46:29,  3.53it/s]
  5%|▍         | 18039/371472 [1:25:52<26:55:13,  3.65it/s]
  5%|▍         | 18040/371472 [1:25:52<26:37:24,  3.69it/s]
                                                           
{'loss': 4.359, 'learning_rate': 9.567540778728264e-07, 'epoch': 0.78}

  5%|▍         | 18040/371472 [1:25:52<26:37:24,  3.69it/s]
  5%|▍         | 18041/371472 [1:25:53<26:08:27,  3.76it/s]
  5%|▍         | 18042/371472 [1:25:53<27:27:05,  3.58it/s]
  5%|▍         | 18043/371472 [1:25:53<26:42:23,  3.68it/s]
  5%|▍         | 18044/371472 [1:25:54<27:30:23,  3.57it/s]
  5%|▍         | 18045/371472 [1:25:54<27:04:45,  3.63it/s]
  5%|▍         | 18046/371472 [1:25:54<26:58:47,  3.64it/s]
  5%|▍         | 18047/371472 [1:25:54<26:41:16,  3.68it/s]
  5%|▍         | 18048/371472 [1:25:55<27:11:20,  3.61it/s]
  5%|▍         | 18049/371472 [1:25:55<27:24:20,  3.58it/s]
  5%|▍         | 18050/371472 [1:25:55<29:12:33,  3.36it/s]
  5%|▍         | 18051/371472 [1:25:56<28:40:37,  3.42it/s]
  5%|▍         | 18052/371472 [1:25:56<27:36:11,  3.56it/s]
  5%|▍         | 18053/371472 [1:25:56<27:11:43,  3.61it/s]
  5%|▍         | 18054/371472 [1:25:56<27:48:57,  3.53it/s]
  5%|▍         | 18055/371472 [1:25:57<27:45:32,  3.54it/s]
  5%|▍         | 18056/371472 [1:25:57<28:20:53,  3.46it/s]
  5%|▍         | 18057/371472 [1:25:57<27:35:21,  3.56it/s]
  5%|▍         | 18058/371472 [1:25:57<28:08:49,  3.49it/s]
  5%|▍         | 18059/371472 [1:25:58<27:52:32,  3.52it/s]
  5%|▍         | 18060/371472 [1:25:58<30:02:53,  3.27it/s]
                                                           
{'loss': 4.4866, 'learning_rate': 9.567055958973475e-07, 'epoch': 0.78}

  5%|▍         | 18060/371472 [1:25:58<30:02:53,  3.27it/s]
  5%|▍         | 18061/371472 [1:25:58<29:55:24,  3.28it/s]
  5%|▍         | 18062/371472 [1:25:59<29:48:23,  3.29it/s]
  5%|▍         | 18063/371472 [1:25:59<29:58:12,  3.28it/s]
  5%|▍         | 18064/371472 [1:25:59<28:20:39,  3.46it/s]
  5%|▍         | 18065/371472 [1:26:00<28:45:13,  3.41it/s]
  5%|▍         | 18066/371472 [1:26:00<30:00:09,  3.27it/s]
  5%|▍         | 18067/371472 [1:26:00<29:14:05,  3.36it/s]
  5%|▍         | 18068/371472 [1:26:00<28:35:44,  3.43it/s]
  5%|▍         | 18069/371472 [1:26:01<28:58:32,  3.39it/s]
  5%|▍         | 18070/371472 [1:26:01<29:30:24,  3.33it/s]
  5%|▍         | 18071/371472 [1:26:01<29:13:22,  3.36it/s]
  5%|▍         | 18072/371472 [1:26:02<27:49:52,  3.53it/s]
  5%|▍         | 18073/371472 [1:26:02<28:54:12,  3.40it/s]
  5%|▍         | 18074/371472 [1:26:02<29:21:43,  3.34it/s]
  5%|▍         | 18075/371472 [1:26:03<28:31:11,  3.44it/s]
  5%|▍         | 18076/371472 [1:26:03<28:08:59,  3.49it/s]
  5%|▍         | 18077/371472 [1:26:03<28:14:22,  3.48it/s]
  5%|▍         | 18078/371472 [1:26:03<28:22:03,  3.46it/s]
  5%|▍         | 18079/371472 [1:26:04<27:21:34,  3.59it/s]
  5%|▍         | 18080/371472 [1:26:04<27:14:51,  3.60it/s]
                                                           
{'loss': 4.5832, 'learning_rate': 9.566571139218686e-07, 'epoch': 0.78}

  5%|▍         | 18080/371472 [1:26:04<27:14:51,  3.60it/s]
  5%|▍         | 18081/371472 [1:26:04<26:35:21,  3.69it/s]
  5%|▍         | 18082/371472 [1:26:04<26:13:56,  3.74it/s]
  5%|▍         | 18083/371472 [1:26:05<26:38:04,  3.69it/s]
  5%|▍         | 18084/371472 [1:26:05<26:57:04,  3.64it/s]
  5%|▍         | 18085/371472 [1:26:05<26:16:11,  3.74it/s]
  5%|▍         | 18086/371472 [1:26:06<27:11:05,  3.61it/s]
  5%|▍         | 18087/371472 [1:26:06<26:30:56,  3.70it/s]
  5%|▍         | 18088/371472 [1:26:06<26:06:51,  3.76it/s]
  5%|▍         | 18089/371472 [1:26:06<26:14:34,  3.74it/s]
  5%|▍         | 18090/371472 [1:26:07<26:04:14,  3.77it/s]
  5%|▍         | 18091/371472 [1:26:07<26:35:17,  3.69it/s]
  5%|▍         | 18092/371472 [1:26:07<26:30:52,  3.70it/s]
  5%|▍         | 18093/371472 [1:26:07<26:24:39,  3.72it/s]
  5%|▍         | 18094/371472 [1:26:08<27:37:19,  3.55it/s]
  5%|▍         | 18095/371472 [1:26:08<27:41:34,  3.54it/s]
  5%|▍         | 18096/371472 [1:26:08<29:17:43,  3.35it/s]
  5%|▍         | 18097/371472 [1:26:09<27:58:25,  3.51it/s]
  5%|▍         | 18098/371472 [1:26:09<29:33:19,  3.32it/s]
  5%|▍         | 18099/371472 [1:26:09<28:41:43,  3.42it/s]
  5%|▍         | 18100/371472 [1:26:10<31:49:27,  3.08it/s]
                                                           
{'loss': 4.3959, 'learning_rate': 9.566086319463896e-07, 'epoch': 0.78}

  5%|▍         | 18100/371472 [1:26:10<31:49:27,  3.08it/s]
  5%|▍         | 18101/371472 [1:26:10<30:03:19,  3.27it/s]
  5%|▍         | 18102/371472 [1:26:10<28:25:07,  3.45it/s]
  5%|▍         | 18103/371472 [1:26:10<27:55:25,  3.52it/s]
  5%|▍         | 18104/371472 [1:26:11<28:41:23,  3.42it/s]
  5%|▍         | 18105/371472 [1:26:11<28:34:57,  3.43it/s]
  5%|▍         | 18106/371472 [1:26:11<28:10:43,  3.48it/s]
  5%|▍         | 18107/371472 [1:26:12<28:49:57,  3.40it/s]
  5%|▍         | 18108/371472 [1:26:12<29:08:20,  3.37it/s]
  5%|▍         | 18109/371472 [1:26:12<28:33:04,  3.44it/s]
  5%|▍         | 18110/371472 [1:26:13<32:27:20,  3.02it/s]
  5%|▍         | 18111/371472 [1:26:13<30:32:21,  3.21it/s]
  5%|▍         | 18112/371472 [1:26:13<29:36:53,  3.31it/s]
  5%|▍         | 18113/371472 [1:26:13<28:46:43,  3.41it/s]
  5%|▍         | 18114/371472 [1:26:14<27:57:42,  3.51it/s]
  5%|▍         | 18115/371472 [1:26:14<29:17:55,  3.35it/s]
  5%|▍         | 18116/371472 [1:26:14<29:47:31,  3.29it/s]
  5%|▍         | 18117/371472 [1:26:15<29:29:41,  3.33it/s]
  5%|▍         | 18118/371472 [1:26:15<28:47:09,  3.41it/s]
  5%|▍         | 18119/371472 [1:26:15<27:22:36,  3.59it/s]
  5%|▍         | 18120/371472 [1:26:15<27:48:25,  3.53it/s]
                                                           
{'loss': 4.4185, 'learning_rate': 9.565601499709107e-07, 'epoch': 0.78}

  5%|▍         | 18120/371472 [1:26:15<27:48:25,  3.53it/s]
  5%|▍         | 18121/371472 [1:26:16<27:19:41,  3.59it/s]
  5%|▍         | 18122/371472 [1:26:16<27:33:06,  3.56it/s]
  5%|▍         | 18123/371472 [1:26:16<26:47:18,  3.66it/s]
  5%|▍         | 18124/371472 [1:26:16<26:39:44,  3.68it/s]
  5%|▍         | 18125/371472 [1:26:17<27:10:38,  3.61it/s]
  5%|▍         | 18126/371472 [1:26:17<26:34:15,  3.69it/s]
  5%|▍         | 18127/371472 [1:26:17<26:14:33,  3.74it/s]
  5%|▍         | 18128/371472 [1:26:18<25:58:12,  3.78it/s]
  5%|▍         | 18129/371472 [1:26:18<25:49:04,  3.80it/s]
  5%|▍         | 18130/371472 [1:26:18<26:03:58,  3.77it/s]
  5%|▍         | 18131/371472 [1:26:19<32:01:10,  3.07it/s]
  5%|▍         | 18132/371472 [1:26:19<30:45:59,  3.19it/s]
  5%|▍         | 18133/371472 [1:26:19<29:48:30,  3.29it/s]
  5%|▍         | 18134/371472 [1:26:19<29:42:51,  3.30it/s]
  5%|▍         | 18135/371472 [1:26:20<28:54:21,  3.40it/s]
  5%|▍         | 18136/371472 [1:26:20<30:43:31,  3.19it/s]
  5%|▍         | 18137/371472 [1:26:20<30:29:14,  3.22it/s]
  5%|▍         | 18138/371472 [1:26:21<29:04:33,  3.38it/s]
  5%|▍         | 18139/371472 [1:26:21<28:04:04,  3.50it/s]
  5%|▍         | 18140/371472 [1:26:21<28:02:12,  3.50it/s]
                                                           
{'loss': 4.4384, 'learning_rate': 9.56511667995432e-07, 'epoch': 0.78}

  5%|▍         | 18140/371472 [1:26:21<28:02:12,  3.50it/s]
  5%|▍         | 18141/371472 [1:26:21<28:01:50,  3.50it/s]
  5%|▍         | 18142/371472 [1:26:22<26:42:24,  3.67it/s]
  5%|▍         | 18143/371472 [1:26:22<27:09:10,  3.61it/s]
  5%|▍         | 18144/371472 [1:26:22<27:00:12,  3.63it/s]
  5%|▍         | 18145/371472 [1:26:23<28:54:31,  3.40it/s]
  5%|▍         | 18146/371472 [1:26:23<30:23:11,  3.23it/s]
  5%|▍         | 18147/371472 [1:26:23<31:57:30,  3.07it/s]
  5%|▍         | 18148/371472 [1:26:24<31:30:12,  3.12it/s]
  5%|▍         | 18149/371472 [1:26:24<29:44:28,  3.30it/s]
  5%|▍         | 18150/371472 [1:26:24<28:37:17,  3.43it/s]
  5%|▍         | 18151/371472 [1:26:24<27:41:12,  3.54it/s]
  5%|▍         | 18152/371472 [1:26:25<26:55:39,  3.64it/s]
  5%|▍         | 18153/371472 [1:26:25<26:29:55,  3.70it/s]
  5%|▍         | 18154/371472 [1:26:25<27:53:02,  3.52it/s]
  5%|▍         | 18155/371472 [1:26:25<27:13:34,  3.60it/s]
  5%|▍         | 18156/371472 [1:26:26<26:24:27,  3.72it/s]
  5%|▍         | 18157/371472 [1:26:26<27:09:50,  3.61it/s]
  5%|▍         | 18158/371472 [1:26:26<26:46:09,  3.67it/s]
  5%|▍         | 18159/371472 [1:26:27<28:40:22,  3.42it/s]
  5%|▍         | 18160/371472 [1:26:27<28:04:33,  3.50it/s]
                                                           
{'loss': 4.5399, 'learning_rate': 9.564631860199529e-07, 'epoch': 0.78}

  5%|▍         | 18160/371472 [1:26:27<28:04:33,  3.50it/s]
  5%|▍         | 18161/371472 [1:26:27<29:41:37,  3.31it/s]
  5%|▍         | 18162/371472 [1:26:28<28:36:41,  3.43it/s]
  5%|▍         | 18163/371472 [1:26:28<28:40:59,  3.42it/s]
  5%|▍         | 18164/371472 [1:26:28<28:34:36,  3.43it/s]
  5%|▍         | 18165/371472 [1:26:28<28:54:20,  3.40it/s]
  5%|▍         | 18166/371472 [1:26:29<29:18:16,  3.35it/s]
  5%|▍         | 18167/371472 [1:26:29<29:51:00,  3.29it/s]
  5%|▍         | 18168/371472 [1:26:29<29:40:48,  3.31it/s]
  5%|▍         | 18169/371472 [1:26:30<31:43:30,  3.09it/s]
  5%|▍         | 18170/371472 [1:26:30<31:12:06,  3.15it/s]
  5%|▍         | 18171/371472 [1:26:30<29:44:36,  3.30it/s]
  5%|▍         | 18172/371472 [1:26:31<28:36:26,  3.43it/s]
  5%|▍         | 18173/371472 [1:26:31<27:56:04,  3.51it/s]
  5%|▍         | 18174/371472 [1:26:31<28:13:15,  3.48it/s]
  5%|▍         | 18175/371472 [1:26:31<27:49:05,  3.53it/s]
  5%|▍         | 18176/371472 [1:26:32<27:59:38,  3.51it/s]
  5%|▍         | 18177/371472 [1:26:32<28:00:03,  3.50it/s]
  5%|▍         | 18178/371472 [1:26:32<29:21:57,  3.34it/s]
  5%|▍         | 18179/371472 [1:26:33<29:29:34,  3.33it/s]
  5%|▍         | 18180/371472 [1:26:33<29:59:51,  3.27it/s]
                                                           
{'loss': 4.6471, 'learning_rate': 9.564147040444741e-07, 'epoch': 0.78}

  5%|▍         | 18180/371472 [1:26:33<29:59:51,  3.27it/s]
  5%|▍         | 18181/371472 [1:26:33<29:03:24,  3.38it/s]
  5%|▍         | 18182/371472 [1:26:33<28:36:42,  3.43it/s]
  5%|▍         | 18183/371472 [1:26:34<30:25:04,  3.23it/s]
  5%|▍         | 18184/371472 [1:26:34<28:41:26,  3.42it/s]
  5%|▍         | 18185/371472 [1:26:34<28:34:50,  3.43it/s]
  5%|▍         | 18186/371472 [1:26:35<27:37:03,  3.55it/s]
  5%|▍         | 18187/371472 [1:26:35<26:49:29,  3.66it/s]
  5%|▍         | 18188/371472 [1:26:35<26:42:35,  3.67it/s]
  5%|▍         | 18189/371472 [1:26:35<26:18:28,  3.73it/s]
  5%|▍         | 18190/371472 [1:26:36<27:10:23,  3.61it/s]
  5%|▍         | 18191/371472 [1:26:36<27:27:03,  3.57it/s]
  5%|▍         | 18192/371472 [1:26:36<26:23:38,  3.72it/s]
  5%|▍         | 18193/371472 [1:26:37<29:09:31,  3.37it/s]
  5%|▍         | 18194/371472 [1:26:37<29:00:42,  3.38it/s]
  5%|▍         | 18195/371472 [1:26:37<28:04:32,  3.50it/s]
  5%|▍         | 18196/371472 [1:26:37<27:27:03,  3.57it/s]
  5%|▍         | 18197/371472 [1:26:38<27:23:23,  3.58it/s]
  5%|▍         | 18198/371472 [1:26:38<26:28:33,  3.71it/s]
  5%|▍         | 18199/371472 [1:26:38<26:30:48,  3.70it/s]
  5%|▍         | 18200/371472 [1:26:38<26:51:52,  3.65it/s]
                                                           
{'loss': 4.72, 'learning_rate': 9.563662220689952e-07, 'epoch': 0.78}

  5%|▍         | 18200/371472 [1:26:38<26:51:52,  3.65it/s]
  5%|▍         | 18201/371472 [1:26:39<27:32:10,  3.56it/s]
  5%|▍         | 18202/371472 [1:26:39<26:52:33,  3.65it/s]
  5%|▍         | 18203/371472 [1:26:39<26:19:19,  3.73it/s]
  5%|▍         | 18204/371472 [1:26:40<27:26:55,  3.58it/s]
  5%|▍         | 18205/371472 [1:26:40<26:59:10,  3.64it/s]
  5%|▍         | 18206/371472 [1:26:40<27:20:32,  3.59it/s]
  5%|▍         | 18207/371472 [1:26:40<27:39:37,  3.55it/s]
  5%|▍         | 18208/371472 [1:26:41<27:03:49,  3.63it/s]
  5%|▍         | 18209/371472 [1:26:41<27:09:28,  3.61it/s]
  5%|▍         | 18210/371472 [1:26:41<27:13:38,  3.60it/s]
  5%|▍         | 18211/371472 [1:26:42<27:29:50,  3.57it/s]
  5%|▍         | 18212/371472 [1:26:42<26:40:42,  3.68it/s]
  5%|▍         | 18213/371472 [1:26:42<27:21:23,  3.59it/s]
  5%|▍         | 18214/371472 [1:26:42<26:31:21,  3.70it/s]
  5%|▍         | 18215/371472 [1:26:43<26:53:04,  3.65it/s]
  5%|▍         | 18216/371472 [1:26:43<27:02:20,  3.63it/s]
  5%|▍         | 18217/371472 [1:26:43<27:36:30,  3.55it/s]
  5%|▍         | 18218/371472 [1:26:43<27:24:24,  3.58it/s]
  5%|▍         | 18219/371472 [1:26:44<27:55:50,  3.51it/s]
  5%|▍         | 18220/371472 [1:26:44<27:49:05,  3.53it/s]
                                                           
{'loss': 4.489, 'learning_rate': 9.563177400935163e-07, 'epoch': 0.78}

  5%|▍         | 18220/371472 [1:26:44<27:49:05,  3.53it/s]
  5%|▍         | 18221/371472 [1:26:44<27:39:59,  3.55it/s]
  5%|▍         | 18222/371472 [1:26:45<28:27:19,  3.45it/s]
  5%|▍         | 18223/371472 [1:26:45<27:17:56,  3.59it/s]
  5%|▍         | 18224/371472 [1:26:45<27:14:18,  3.60it/s]
  5%|▍         | 18225/371472 [1:26:45<27:39:25,  3.55it/s]
  5%|▍         | 18226/371472 [1:26:46<26:46:56,  3.66it/s]
  5%|▍         | 18227/371472 [1:26:46<26:19:51,  3.73it/s]
  5%|▍         | 18228/371472 [1:26:46<26:24:45,  3.72it/s]
  5%|▍         | 18229/371472 [1:26:47<26:47:55,  3.66it/s]
  5%|▍         | 18230/371472 [1:26:47<29:14:34,  3.36it/s]
  5%|▍         | 18231/371472 [1:26:47<28:00:46,  3.50it/s]
  5%|▍         | 18232/371472 [1:26:47<30:07:00,  3.26it/s]
  5%|▍         | 18233/371472 [1:26:48<28:18:07,  3.47it/s]
  5%|▍         | 18234/371472 [1:26:48<28:04:50,  3.49it/s]
  5%|▍         | 18235/371472 [1:26:48<28:37:38,  3.43it/s]
  5%|▍         | 18236/371472 [1:26:49<28:14:49,  3.47it/s]
  5%|▍         | 18237/371472 [1:26:49<27:28:20,  3.57it/s]
  5%|▍         | 18238/371472 [1:26:49<26:43:00,  3.67it/s]
  5%|▍         | 18239/371472 [1:26:49<25:48:07,  3.80it/s]
  5%|▍         | 18240/371472 [1:26:50<25:11:57,  3.89it/s]
                                                           
{'loss': 4.5276, 'learning_rate': 9.562692581180374e-07, 'epoch': 0.79}

  5%|▍         | 18240/371472 [1:26:50<25:11:57,  3.89it/s]
  5%|▍         | 18241/371472 [1:26:50<25:34:49,  3.84it/s]
  5%|▍         | 18242/371472 [1:26:50<27:10:36,  3.61it/s]
  5%|▍         | 18243/371472 [1:26:50<26:44:19,  3.67it/s]
  5%|▍         | 18244/371472 [1:26:51<26:33:22,  3.69it/s]
  5%|▍         | 18245/371472 [1:26:51<27:48:07,  3.53it/s]
  5%|▍         | 18246/371472 [1:26:51<27:21:58,  3.59it/s]
  5%|▍         | 18247/371472 [1:26:52<27:15:18,  3.60it/s]
  5%|▍         | 18248/371472 [1:26:52<26:11:24,  3.75it/s]
  5%|▍         | 18249/371472 [1:26:52<28:44:03,  3.41it/s]
  5%|▍         | 18250/371472 [1:26:52<27:36:52,  3.55it/s]
  5%|▍         | 18251/371472 [1:26:53<27:13:15,  3.60it/s]
  5%|▍         | 18252/371472 [1:26:53<30:02:49,  3.27it/s]
  5%|▍         | 18253/371472 [1:26:53<29:26:25,  3.33it/s]
  5%|▍         | 18254/371472 [1:26:54<29:11:24,  3.36it/s]
  5%|▍         | 18255/371472 [1:26:54<28:04:12,  3.50it/s]
  5%|▍         | 18256/371472 [1:26:54<27:26:05,  3.58it/s]
  5%|▍         | 18257/371472 [1:26:54<26:47:31,  3.66it/s]
  5%|▍         | 18258/371472 [1:26:55<26:32:54,  3.70it/s]
  5%|▍         | 18259/371472 [1:26:55<27:05:16,  3.62it/s]
  5%|▍         | 18260/371472 [1:26:55<26:34:09,  3.69it/s]
                                                           
{'loss': 4.5964, 'learning_rate': 9.562207761425584e-07, 'epoch': 0.79}

  5%|▍         | 18260/371472 [1:26:55<26:34:09,  3.69it/s]
  5%|▍         | 18261/371472 [1:26:56<28:16:42,  3.47it/s]
  5%|▍         | 18262/371472 [1:26:56<27:42:30,  3.54it/s]
  5%|▍         | 18263/371472 [1:26:56<26:52:28,  3.65it/s]
  5%|▍         | 18264/371472 [1:26:56<27:17:34,  3.59it/s]
  5%|▍         | 18265/371472 [1:26:57<26:23:13,  3.72it/s]
  5%|▍         | 18266/371472 [1:26:57<28:29:48,  3.44it/s]
  5%|▍         | 18267/371472 [1:26:57<27:20:53,  3.59it/s]
  5%|▍         | 18268/371472 [1:26:57<26:27:09,  3.71it/s]
  5%|▍         | 18269/371472 [1:26:58<26:23:35,  3.72it/s]
  5%|▍         | 18270/371472 [1:26:58<27:20:20,  3.59it/s]
  5%|▍         | 18271/371472 [1:26:58<27:13:45,  3.60it/s]
  5%|▍         | 18272/371472 [1:26:59<27:53:19,  3.52it/s]
  5%|▍         | 18273/371472 [1:26:59<27:58:10,  3.51it/s]
  5%|▍         | 18274/371472 [1:26:59<27:30:10,  3.57it/s]
  5%|▍         | 18275/371472 [1:27:00<31:05:56,  3.15it/s]
  5%|▍         | 18276/371472 [1:27:00<29:05:03,  3.37it/s]
  5%|▍         | 18277/371472 [1:27:00<28:24:09,  3.45it/s]
  5%|▍         | 18278/371472 [1:27:00<29:42:51,  3.30it/s]
  5%|▍         | 18279/371472 [1:27:01<29:27:48,  3.33it/s]
  5%|▍         | 18280/371472 [1:27:01<29:02:40,  3.38it/s]
                                                           
{'loss': 4.5272, 'learning_rate': 9.561722941670797e-07, 'epoch': 0.79}

  5%|▍         | 18280/371472 [1:27:01<29:02:40,  3.38it/s]
  5%|▍         | 18281/371472 [1:27:01<29:38:31,  3.31it/s]
  5%|▍         | 18282/371472 [1:27:02<28:22:35,  3.46it/s]
  5%|▍         | 18283/371472 [1:27:02<27:22:16,  3.58it/s]
  5%|▍         | 18284/371472 [1:27:02<29:03:50,  3.38it/s]
  5%|▍         | 18285/371472 [1:27:02<29:06:59,  3.37it/s]
  5%|▍         | 18286/371472 [1:27:03<27:49:52,  3.53it/s]
  5%|▍         | 18287/371472 [1:27:03<27:43:10,  3.54it/s]
  5%|▍         | 18288/371472 [1:27:03<27:46:03,  3.53it/s]
  5%|▍         | 18289/371472 [1:27:04<28:07:24,  3.49it/s]
  5%|▍         | 18290/371472 [1:27:04<38:27:14,  2.55it/s]
  5%|▍         | 18291/371472 [1:27:05<36:26:05,  2.69it/s]
  5%|▍         | 18292/371472 [1:27:05<33:58:45,  2.89it/s]
  5%|▍         | 18293/371472 [1:27:05<32:40:04,  3.00it/s]
  5%|▍         | 18294/371472 [1:27:05<30:04:03,  3.26it/s]
  5%|▍         | 18295/371472 [1:27:06<28:38:25,  3.43it/s]
  5%|▍         | 18296/371472 [1:27:06<27:49:13,  3.53it/s]
  5%|▍         | 18297/371472 [1:27:06<27:24:11,  3.58it/s]
  5%|▍         | 18298/371472 [1:27:06<28:53:35,  3.40it/s]
  5%|▍         | 18299/371472 [1:27:07<28:03:30,  3.50it/s]
  5%|▍         | 18300/371472 [1:27:07<28:59:43,  3.38it/s]
                                                           
{'loss': 4.5325, 'learning_rate': 9.561238121916008e-07, 'epoch': 0.79}

  5%|▍         | 18300/371472 [1:27:07<28:59:43,  3.38it/s]
  5%|▍         | 18301/371472 [1:27:07<28:24:10,  3.45it/s]
  5%|▍         | 18302/371472 [1:27:08<28:00:17,  3.50it/s]
  5%|▍         | 18303/371472 [1:27:08<27:14:37,  3.60it/s]
  5%|▍         | 18304/371472 [1:27:08<27:49:43,  3.53it/s]
  5%|▍         | 18305/371472 [1:27:08<27:42:43,  3.54it/s]
  5%|▍         | 18306/371472 [1:27:09<27:03:30,  3.63it/s]
  5%|▍         | 18307/371472 [1:27:09<26:33:30,  3.69it/s]
  5%|▍         | 18308/371472 [1:27:09<27:29:07,  3.57it/s]
  5%|▍         | 18309/371472 [1:27:10<27:07:21,  3.62it/s]
  5%|▍         | 18310/371472 [1:27:10<26:27:42,  3.71it/s]
  5%|▍         | 18311/371472 [1:27:10<26:12:37,  3.74it/s]
  5%|▍         | 18312/371472 [1:27:10<26:48:44,  3.66it/s]
  5%|▍         | 18313/371472 [1:27:11<28:00:48,  3.50it/s]
  5%|▍         | 18314/371472 [1:27:11<28:32:37,  3.44it/s]
  5%|▍         | 18315/371472 [1:27:11<27:29:39,  3.57it/s]
  5%|▍         | 18316/371472 [1:27:12<28:17:18,  3.47it/s]
  5%|▍         | 18317/371472 [1:27:12<27:39:35,  3.55it/s]
  5%|▍         | 18318/371472 [1:27:12<28:03:11,  3.50it/s]
  5%|▍         | 18319/371472 [1:27:12<27:40:40,  3.54it/s]
  5%|▍         | 18320/371472 [1:27:13<29:30:21,  3.32it/s]
                                                           
{'loss': 4.6481, 'learning_rate': 9.560753302161219e-07, 'epoch': 0.79}

  5%|▍         | 18320/371472 [1:27:13<29:30:21,  3.32it/s]
  5%|▍         | 18321/371472 [1:27:13<29:03:35,  3.38it/s]
  5%|▍         | 18322/371472 [1:27:13<29:21:37,  3.34it/s]
  5%|▍         | 18323/371472 [1:27:14<29:19:11,  3.35it/s]
  5%|▍         | 18324/371472 [1:27:14<28:13:05,  3.48it/s]
  5%|▍         | 18325/371472 [1:27:14<27:22:10,  3.58it/s]
  5%|▍         | 18326/371472 [1:27:14<26:47:33,  3.66it/s]
  5%|▍         | 18327/371472 [1:27:15<26:41:26,  3.68it/s]
  5%|▍         | 18328/371472 [1:27:15<26:01:32,  3.77it/s]
  5%|▍         | 18329/371472 [1:27:15<26:04:31,  3.76it/s]
  5%|▍         | 18330/371472 [1:27:15<25:25:42,  3.86it/s]
  5%|▍         | 18331/371472 [1:27:16<25:45:34,  3.81it/s]
  5%|▍         | 18332/371472 [1:27:16<25:51:43,  3.79it/s]
  5%|▍         | 18333/371472 [1:27:16<27:09:45,  3.61it/s]
  5%|▍         | 18334/371472 [1:27:17<26:29:52,  3.70it/s]
  5%|▍         | 18335/371472 [1:27:17<25:36:46,  3.83it/s]
  5%|▍         | 18336/371472 [1:27:17<26:31:35,  3.70it/s]
  5%|▍         | 18337/371472 [1:27:17<27:51:12,  3.52it/s]
  5%|▍         | 18338/371472 [1:27:18<27:14:08,  3.60it/s]
  5%|▍         | 18339/371472 [1:27:18<26:23:20,  3.72it/s]
  5%|▍         | 18340/371472 [1:27:18<26:15:15,  3.74it/s]
                                                           
{'loss': 4.6294, 'learning_rate': 9.56026848240643e-07, 'epoch': 0.79}

  5%|▍         | 18340/371472 [1:27:18<26:15:15,  3.74it/s]
  5%|▍         | 18341/371472 [1:27:18<26:26:19,  3.71it/s]
  5%|▍         | 18342/371472 [1:27:19<25:39:13,  3.82it/s]
  5%|▍         | 18343/371472 [1:27:19<26:08:58,  3.75it/s]
  5%|▍         | 18344/371472 [1:27:19<27:01:35,  3.63it/s]
  5%|▍         | 18345/371472 [1:27:20<27:02:24,  3.63it/s]
  5%|▍         | 18346/371472 [1:27:20<28:09:20,  3.48it/s]
  5%|▍         | 18347/371472 [1:27:20<27:23:08,  3.58it/s]
  5%|▍         | 18348/371472 [1:27:20<28:17:36,  3.47it/s]
  5%|▍         | 18349/371472 [1:27:21<28:13:49,  3.47it/s]
  5%|▍         | 18350/371472 [1:27:21<27:06:05,  3.62it/s]
  5%|▍         | 18351/371472 [1:27:21<28:07:23,  3.49it/s]
  5%|▍         | 18352/371472 [1:27:21<27:06:55,  3.62it/s]
  5%|▍         | 18353/371472 [1:27:22<27:55:25,  3.51it/s]
  5%|▍         | 18354/371472 [1:27:22<27:22:36,  3.58it/s]
  5%|▍         | 18355/371472 [1:27:22<27:53:56,  3.52it/s]
  5%|▍         | 18356/371472 [1:27:23<27:52:55,  3.52it/s]
  5%|▍         | 18357/371472 [1:27:23<26:58:24,  3.64it/s]
  5%|▍         | 18358/371472 [1:27:23<28:09:45,  3.48it/s]
  5%|▍         | 18359/371472 [1:27:23<27:46:36,  3.53it/s]
  5%|▍         | 18360/371472 [1:27:24<30:02:27,  3.27it/s]
                                                           
{'loss': 4.5148, 'learning_rate': 9.55978366265164e-07, 'epoch': 0.79}

  5%|▍         | 18360/371472 [1:27:24<30:02:27,  3.27it/s]
  5%|▍         | 18361/371472 [1:27:24<29:24:00,  3.34it/s]
  5%|▍         | 18362/371472 [1:27:24<27:58:42,  3.51it/s]
  5%|▍         | 18363/371472 [1:27:25<28:57:34,  3.39it/s]
  5%|▍         | 18364/371472 [1:27:25<28:23:36,  3.45it/s]
  5%|▍         | 18365/371472 [1:27:25<28:36:02,  3.43it/s]
  5%|▍         | 18366/371472 [1:27:26<27:57:33,  3.51it/s]
  5%|▍         | 18367/371472 [1:27:26<27:10:16,  3.61it/s]
  5%|▍         | 18368/371472 [1:27:26<26:24:51,  3.71it/s]
  5%|▍         | 18369/371472 [1:27:26<26:42:08,  3.67it/s]
  5%|▍         | 18370/371472 [1:27:27<26:33:07,  3.69it/s]
  5%|▍         | 18371/371472 [1:27:27<27:05:28,  3.62it/s]
  5%|▍         | 18372/371472 [1:27:27<27:52:06,  3.52it/s]
  5%|▍         | 18373/371472 [1:27:27<27:14:06,  3.60it/s]
  5%|▍         | 18374/371472 [1:27:28<26:19:01,  3.73it/s]
  5%|▍         | 18375/371472 [1:27:28<25:47:31,  3.80it/s]
  5%|▍         | 18376/371472 [1:27:28<26:47:49,  3.66it/s]
  5%|▍         | 18377/371472 [1:27:29<27:06:32,  3.62it/s]
  5%|▍         | 18378/371472 [1:27:29<27:57:57,  3.51it/s]
  5%|▍         | 18379/371472 [1:27:29<27:08:20,  3.61it/s]
  5%|▍         | 18380/371472 [1:27:29<26:53:29,  3.65it/s]
                                                           
{'loss': 4.4899, 'learning_rate': 9.559298842896853e-07, 'epoch': 0.79}

  5%|▍         | 18380/371472 [1:27:29<26:53:29,  3.65it/s]
  5%|▍         | 18381/371472 [1:27:30<26:41:25,  3.67it/s]
  5%|▍         | 18382/371472 [1:27:30<28:26:12,  3.45it/s]
  5%|▍         | 18383/371472 [1:27:30<27:12:32,  3.60it/s]
  5%|▍         | 18384/371472 [1:27:30<27:25:30,  3.58it/s]
  5%|▍         | 18385/371472 [1:27:31<28:40:23,  3.42it/s]
  5%|▍         | 18386/371472 [1:27:31<28:46:50,  3.41it/s]
  5%|▍         | 18387/371472 [1:27:31<30:05:31,  3.26it/s]
  5%|▍         | 18388/371472 [1:27:32<28:54:31,  3.39it/s]
  5%|▍         | 18389/371472 [1:27:32<29:14:40,  3.35it/s]
  5%|▍         | 18390/371472 [1:27:32<28:13:37,  3.47it/s]
  5%|▍         | 18391/371472 [1:27:33<28:02:33,  3.50it/s]
  5%|▍         | 18392/371472 [1:27:33<30:02:42,  3.26it/s]
  5%|▍         | 18393/371472 [1:27:33<30:11:34,  3.25it/s]
  5%|▍         | 18394/371472 [1:27:34<30:15:48,  3.24it/s]
  5%|▍         | 18395/371472 [1:27:34<28:41:41,  3.42it/s]
  5%|▍         | 18396/371472 [1:27:34<28:22:19,  3.46it/s]
  5%|▍         | 18397/371472 [1:27:34<27:22:52,  3.58it/s]
  5%|▍         | 18398/371472 [1:27:35<27:56:49,  3.51it/s]
  5%|▍         | 18399/371472 [1:27:35<27:54:24,  3.51it/s]
  5%|▍         | 18400/371472 [1:27:35<27:37:48,  3.55it/s]
                                                           
{'loss': 4.5426, 'learning_rate': 9.558814023142061e-07, 'epoch': 0.79}

  5%|▍         | 18400/371472 [1:27:35<27:37:48,  3.55it/s]
  5%|▍         | 18401/371472 [1:27:36<30:21:48,  3.23it/s]
  5%|▍         | 18402/371472 [1:27:36<31:43:17,  3.09it/s]
  5%|▍         | 18403/371472 [1:27:36<32:30:59,  3.02it/s]
  5%|▍         | 18404/371472 [1:27:37<30:45:06,  3.19it/s]
  5%|▍         | 18405/371472 [1:27:37<29:19:23,  3.34it/s]
  5%|▍         | 18406/371472 [1:27:37<28:47:05,  3.41it/s]
  5%|▍         | 18407/371472 [1:27:37<28:54:37,  3.39it/s]
  5%|▍         | 18408/371472 [1:27:38<27:40:43,  3.54it/s]
  5%|▍         | 18409/371472 [1:27:38<29:22:49,  3.34it/s]
  5%|▍         | 18410/371472 [1:27:38<29:12:44,  3.36it/s]
  5%|▍         | 18411/371472 [1:27:39<28:20:50,  3.46it/s]
  5%|▍         | 18412/371472 [1:27:39<27:16:38,  3.60it/s]
  5%|▍         | 18413/371472 [1:27:39<26:22:08,  3.72it/s]
  5%|▍         | 18414/371472 [1:27:39<27:15:19,  3.60it/s]
  5%|▍         | 18415/371472 [1:27:40<26:27:09,  3.71it/s]
  5%|▍         | 18416/371472 [1:27:40<26:14:24,  3.74it/s]
  5%|▍         | 18417/371472 [1:27:40<25:53:39,  3.79it/s]
  5%|▍         | 18418/371472 [1:27:40<28:21:10,  3.46it/s]
  5%|▍         | 18419/371472 [1:27:41<28:51:53,  3.40it/s]
  5%|▍         | 18420/371472 [1:27:41<27:41:18,  3.54it/s]
                                                           
{'loss': 4.4513, 'learning_rate': 9.558329203387274e-07, 'epoch': 0.79}

  5%|▍         | 18420/371472 [1:27:41<27:41:18,  3.54it/s]
  5%|▍         | 18421/371472 [1:27:41<29:59:50,  3.27it/s]
  5%|▍         | 18422/371472 [1:27:42<29:10:38,  3.36it/s]
  5%|▍         | 18423/371472 [1:27:42<28:26:05,  3.45it/s]
  5%|▍         | 18424/371472 [1:27:42<33:27:00,  2.93it/s]
  5%|▍         | 18425/371472 [1:27:43<30:15:42,  3.24it/s]
  5%|▍         | 18426/371472 [1:27:43<29:45:23,  3.30it/s]
  5%|▍         | 18427/371472 [1:27:43<29:45:07,  3.30it/s]
  5%|▍         | 18428/371472 [1:27:43<29:14:20,  3.35it/s]
  5%|▍         | 18429/371472 [1:27:44<30:57:13,  3.17it/s]
  5%|▍         | 18430/371472 [1:27:44<30:22:03,  3.23it/s]
  5%|▍         | 18431/371472 [1:27:44<28:19:15,  3.46it/s]
  5%|▍         | 18432/371472 [1:27:45<27:43:16,  3.54it/s]
  5%|▍         | 18433/371472 [1:27:45<27:42:52,  3.54it/s]
  5%|▍         | 18434/371472 [1:27:45<27:09:42,  3.61it/s]
  5%|▍         | 18435/371472 [1:27:45<27:08:43,  3.61it/s]
  5%|▍         | 18436/371472 [1:27:46<27:25:47,  3.58it/s]
  5%|▍         | 18437/371472 [1:27:46<26:34:00,  3.69it/s]
  5%|▍         | 18438/371472 [1:27:46<27:42:57,  3.54it/s]
  5%|▍         | 18439/371472 [1:27:47<27:20:52,  3.59it/s]
  5%|▍         | 18440/371472 [1:27:47<26:48:55,  3.66it/s]
                                                           
{'loss': 4.4633, 'learning_rate': 9.557844383632485e-07, 'epoch': 0.79}

  5%|▍         | 18440/371472 [1:27:47<26:48:55,  3.66it/s]
  5%|▍         | 18441/371472 [1:27:47<27:19:14,  3.59it/s]
  5%|▍         | 18442/371472 [1:27:47<27:48:23,  3.53it/s]
  5%|▍         | 18443/371472 [1:27:48<27:12:59,  3.60it/s]
  5%|▍         | 18444/371472 [1:27:48<27:45:00,  3.53it/s]
  5%|▍         | 18445/371472 [1:27:48<28:15:36,  3.47it/s]
  5%|▍         | 18446/371472 [1:27:49<28:37:48,  3.43it/s]
  5%|▍         | 18447/371472 [1:27:49<28:37:55,  3.42it/s]
  5%|▍         | 18448/371472 [1:27:49<27:10:38,  3.61it/s]
  5%|▍         | 18449/371472 [1:27:49<27:46:22,  3.53it/s]
  5%|▍         | 18450/371472 [1:27:50<27:34:08,  3.56it/s]
  5%|▍         | 18451/371472 [1:27:50<27:23:01,  3.58it/s]
  5%|▍         | 18452/371472 [1:27:50<27:22:05,  3.58it/s]
  5%|▍         | 18453/371472 [1:27:51<27:25:38,  3.58it/s]
  5%|▍         | 18454/371472 [1:27:51<27:07:02,  3.62it/s]
  5%|▍         | 18455/371472 [1:27:51<27:37:07,  3.55it/s]
  5%|▍         | 18456/371472 [1:27:51<27:37:32,  3.55it/s]
  5%|▍         | 18457/371472 [1:27:52<29:02:30,  3.38it/s]
  5%|▍         | 18458/371472 [1:27:52<27:44:45,  3.53it/s]
  5%|▍         | 18459/371472 [1:27:52<27:18:07,  3.59it/s]
  5%|▍         | 18460/371472 [1:27:52<26:39:05,  3.68it/s]
                                                           
{'loss': 4.44, 'learning_rate': 9.557359563877696e-07, 'epoch': 0.8}

  5%|▍         | 18460/371472 [1:27:53<26:39:05,  3.68it/s]
  5%|▍         | 18461/371472 [1:27:53<26:23:37,  3.72it/s]
  5%|▍         | 18462/371472 [1:27:53<26:29:51,  3.70it/s]
  5%|▍         | 18463/371472 [1:27:53<27:27:13,  3.57it/s]
  5%|▍         | 18464/371472 [1:27:54<30:33:45,  3.21it/s]
  5%|▍         | 18465/371472 [1:27:54<28:39:22,  3.42it/s]
  5%|▍         | 18466/371472 [1:27:54<28:03:54,  3.49it/s]
  5%|▍         | 18467/371472 [1:27:54<27:08:38,  3.61it/s]
  5%|▍         | 18468/371472 [1:27:55<26:58:08,  3.64it/s]
  5%|▍         | 18469/371472 [1:27:55<28:40:26,  3.42it/s]
  5%|▍         | 18470/371472 [1:27:55<30:38:31,  3.20it/s]
  5%|▍         | 18471/371472 [1:27:56<30:52:10,  3.18it/s]
  5%|▍         | 18472/371472 [1:27:56<30:32:58,  3.21it/s]
  5%|▍         | 18473/371472 [1:27:56<29:12:36,  3.36it/s]
  5%|▍         | 18474/371472 [1:27:57<30:58:58,  3.16it/s]
  5%|▍         | 18475/371472 [1:27:57<29:01:07,  3.38it/s]
  5%|▍         | 18476/371472 [1:27:57<27:55:32,  3.51it/s]
  5%|▍         | 18477/371472 [1:27:57<27:25:12,  3.58it/s]
  5%|▍         | 18478/371472 [1:27:58<26:31:13,  3.70it/s]
  5%|▍         | 18479/371472 [1:27:58<26:02:52,  3.76it/s]
  5%|▍         | 18480/371472 [1:27:58<26:37:24,  3.68it/s]
                                                           
{'loss': 4.8242, 'learning_rate': 9.556874744122906e-07, 'epoch': 0.8}

  5%|▍         | 18480/371472 [1:27:58<26:37:24,  3.68it/s]
  5%|▍         | 18481/371472 [1:27:59<28:41:51,  3.42it/s]
  5%|▍         | 18482/371472 [1:27:59<30:04:48,  3.26it/s]
  5%|▍         | 18483/371472 [1:27:59<30:05:46,  3.26it/s]
  5%|▍         | 18484/371472 [1:28:00<29:32:16,  3.32it/s]
  5%|▍         | 18485/371472 [1:28:00<28:49:26,  3.40it/s]
  5%|▍         | 18486/371472 [1:28:00<27:29:12,  3.57it/s]
  5%|▍         | 18487/371472 [1:28:00<26:47:51,  3.66it/s]
  5%|▍         | 18488/371472 [1:28:01<26:10:48,  3.75it/s]
  5%|▍         | 18489/371472 [1:28:01<27:45:16,  3.53it/s]
  5%|▍         | 18490/371472 [1:28:01<27:09:51,  3.61it/s]
  5%|▍         | 18491/371472 [1:28:01<26:53:19,  3.65it/s]
  5%|▍         | 18492/371472 [1:28:02<29:43:01,  3.30it/s]
  5%|▍         | 18493/371472 [1:28:02<29:14:15,  3.35it/s]
  5%|▍         | 18494/371472 [1:28:02<28:18:03,  3.46it/s]
  5%|▍         | 18495/371472 [1:28:03<27:26:07,  3.57it/s]
  5%|▍         | 18496/371472 [1:28:03<27:27:41,  3.57it/s]
  5%|▍         | 18497/371472 [1:28:03<27:40:37,  3.54it/s]
  5%|▍         | 18498/371472 [1:28:04<28:50:27,  3.40it/s]
  5%|▍         | 18499/371472 [1:28:04<28:15:54,  3.47it/s]
  5%|▍         | 18500/371472 [1:28:04<29:04:57,  3.37it/s]
                                                           
{'loss': 4.475, 'learning_rate': 9.556389924368117e-07, 'epoch': 0.8}

  5%|▍         | 18500/371472 [1:28:04<29:04:57,  3.37it/s]
  5%|▍         | 18501/371472 [1:28:04<29:09:42,  3.36it/s]
  5%|▍         | 18502/371472 [1:28:05<30:05:19,  3.26it/s]
  5%|▍         | 18503/371472 [1:28:05<29:00:31,  3.38it/s]
  5%|▍         | 18504/371472 [1:28:05<29:27:06,  3.33it/s]
  5%|▍         | 18505/371472 [1:28:06<31:08:29,  3.15it/s]
  5%|▍         | 18506/371472 [1:28:06<30:52:33,  3.18it/s]
  5%|▍         | 18507/371472 [1:28:06<29:06:01,  3.37it/s]
  5%|▍         | 18508/371472 [1:28:07<29:37:41,  3.31it/s]
  5%|▍         | 18509/371472 [1:28:07<29:12:27,  3.36it/s]
  5%|▍         | 18510/371472 [1:28:07<29:15:48,  3.35it/s]
  5%|▍         | 18511/371472 [1:28:07<29:10:51,  3.36it/s]
  5%|▍         | 18512/371472 [1:28:08<30:27:27,  3.22it/s]
  5%|▍         | 18513/371472 [1:28:08<29:19:15,  3.34it/s]
  5%|▍         | 18514/371472 [1:28:08<30:29:15,  3.22it/s]
  5%|▍         | 18515/371472 [1:28:09<31:08:40,  3.15it/s]
  5%|▍         | 18516/371472 [1:28:09<30:05:53,  3.26it/s]
  5%|▍         | 18517/371472 [1:28:09<29:34:36,  3.31it/s]
  5%|▍         | 18518/371472 [1:28:10<28:59:20,  3.38it/s]
  5%|▍         | 18519/371472 [1:28:10<28:14:35,  3.47it/s]
  5%|▍         | 18520/371472 [1:28:10<27:19:45,  3.59it/s]
                                                           
{'loss': 4.5009, 'learning_rate': 9.55590510461333e-07, 'epoch': 0.8}

  5%|▍         | 18520/371472 [1:28:10<27:19:45,  3.59it/s]
  5%|▍         | 18521/371472 [1:28:10<28:08:05,  3.48it/s]
  5%|▍         | 18522/371472 [1:28:11<27:28:27,  3.57it/s]
  5%|▍         | 18523/371472 [1:28:11<26:39:27,  3.68it/s]
  5%|▍         | 18524/371472 [1:28:11<26:05:22,  3.76it/s]
  5%|▍         | 18525/371472 [1:28:11<26:36:36,  3.68it/s]
  5%|▍         | 18526/371472 [1:28:12<26:15:58,  3.73it/s]
  5%|▍         | 18527/371472 [1:28:12<27:48:53,  3.52it/s]
  5%|▍         | 18528/371472 [1:28:12<27:17:59,  3.59it/s]
  5%|▍         | 18529/371472 [1:28:13<26:32:36,  3.69it/s]
  5%|▍         | 18530/371472 [1:28:13<27:27:22,  3.57it/s]
  5%|▍         | 18531/371472 [1:28:13<26:42:07,  3.67it/s]
  5%|▍         | 18532/371472 [1:28:13<26:43:29,  3.67it/s]
  5%|▍         | 18533/371472 [1:28:14<27:09:16,  3.61it/s]
  5%|▍         | 18534/371472 [1:28:14<27:40:20,  3.54it/s]
  5%|▍         | 18535/371472 [1:28:14<28:18:52,  3.46it/s]
  5%|▍         | 18536/371472 [1:28:15<30:12:07,  3.25it/s]
  5%|▍         | 18537/371472 [1:28:15<29:26:56,  3.33it/s]
  5%|▍         | 18538/371472 [1:28:15<29:31:12,  3.32it/s]
  5%|▍         | 18539/371472 [1:28:15<28:50:49,  3.40it/s]
  5%|▍         | 18540/371472 [1:28:16<28:44:34,  3.41it/s]
                                                           
{'loss': 4.4502, 'learning_rate': 9.555420284858539e-07, 'epoch': 0.8}

  5%|▍         | 18540/371472 [1:28:16<28:44:34,  3.41it/s]
  5%|▍         | 18541/371472 [1:28:16<30:04:59,  3.26it/s]
  5%|▍         | 18542/371472 [1:28:16<29:16:23,  3.35it/s]
  5%|▍         | 18543/371472 [1:28:17<28:26:10,  3.45it/s]
  5%|▍         | 18544/371472 [1:28:17<28:22:30,  3.45it/s]
  5%|▍         | 18545/371472 [1:28:17<28:14:56,  3.47it/s]
  5%|▍         | 18546/371472 [1:28:17<26:57:03,  3.64it/s]
  5%|▍         | 18547/371472 [1:28:18<27:00:11,  3.63it/s]
  5%|▍         | 18548/371472 [1:28:18<28:38:15,  3.42it/s]
  5%|▍         | 18549/371472 [1:28:18<29:55:40,  3.28it/s]
  5%|▍         | 18550/371472 [1:28:19<28:45:47,  3.41it/s]
  5%|▍         | 18551/371472 [1:28:19<28:52:55,  3.39it/s]
  5%|▍         | 18552/371472 [1:28:19<27:51:50,  3.52it/s]
  5%|▍         | 18553/371472 [1:28:20<28:10:43,  3.48it/s]
  5%|▍         | 18554/371472 [1:28:20<27:23:42,  3.58it/s]
  5%|▍         | 18555/371472 [1:28:20<26:47:22,  3.66it/s]
  5%|▍         | 18556/371472 [1:28:20<27:09:40,  3.61it/s]
  5%|▍         | 18557/371472 [1:28:21<27:13:46,  3.60it/s]
  5%|▍         | 18558/371472 [1:28:21<26:42:56,  3.67it/s]
  5%|▍         | 18559/371472 [1:28:21<26:16:57,  3.73it/s]
  5%|▍         | 18560/371472 [1:28:21<26:17:54,  3.73it/s]
                                                           
{'loss': 4.7639, 'learning_rate': 9.554935465103751e-07, 'epoch': 0.8}

  5%|▍         | 18560/371472 [1:28:21<26:17:54,  3.73it/s]
  5%|▍         | 18561/371472 [1:28:22<25:53:25,  3.79it/s]
  5%|▍         | 18562/371472 [1:28:22<26:59:35,  3.63it/s]
  5%|▍         | 18563/371472 [1:28:22<28:53:14,  3.39it/s]
  5%|▍         | 18564/371472 [1:28:23<30:39:04,  3.20it/s]
  5%|▍         | 18565/371472 [1:28:23<29:39:00,  3.31it/s]
  5%|▍         | 18566/371472 [1:28:23<29:03:50,  3.37it/s]
  5%|▍         | 18567/371472 [1:28:23<28:00:49,  3.50it/s]
  5%|▍         | 18568/371472 [1:28:24<28:54:39,  3.39it/s]
  5%|▍         | 18569/371472 [1:28:24<28:56:10,  3.39it/s]
  5%|▍         | 18570/371472 [1:28:24<29:18:46,  3.34it/s]
  5%|▍         | 18571/371472 [1:28:25<27:50:05,  3.52it/s]
  5%|▍         | 18572/371472 [1:28:25<27:10:47,  3.61it/s]
  5%|▍         | 18573/371472 [1:28:25<27:16:43,  3.59it/s]
  5%|▌         | 18574/371472 [1:28:25<26:58:12,  3.63it/s]
  5%|▌         | 18575/371472 [1:28:26<26:58:30,  3.63it/s]
  5%|▌         | 18576/371472 [1:28:26<26:01:52,  3.77it/s]
  5%|▌         | 18577/371472 [1:28:26<25:43:54,  3.81it/s]
  5%|▌         | 18578/371472 [1:28:27<26:42:07,  3.67it/s]
  5%|▌         | 18579/371472 [1:28:27<26:42:36,  3.67it/s]
  5%|▌         | 18580/371472 [1:28:27<26:05:36,  3.76it/s]
                                                           
{'loss': 4.4771, 'learning_rate': 9.554450645348962e-07, 'epoch': 0.8}

  5%|▌         | 18580/371472 [1:28:27<26:05:36,  3.76it/s]
  5%|▌         | 18581/371472 [1:28:27<27:03:24,  3.62it/s]
  5%|▌         | 18582/371472 [1:28:28<27:49:27,  3.52it/s]
  5%|▌         | 18583/371472 [1:28:28<27:17:28,  3.59it/s]
  5%|▌         | 18584/371472 [1:28:28<28:31:40,  3.44it/s]
  5%|▌         | 18585/371472 [1:28:29<28:28:14,  3.44it/s]
  5%|▌         | 18586/371472 [1:28:29<28:28:55,  3.44it/s]
  5%|▌         | 18587/371472 [1:28:29<28:46:20,  3.41it/s]
  5%|▌         | 18588/371472 [1:28:29<30:01:25,  3.26it/s]
  5%|▌         | 18589/371472 [1:28:30<29:19:37,  3.34it/s]
  5%|▌         | 18590/371472 [1:28:30<29:26:09,  3.33it/s]
  5%|▌         | 18591/371472 [1:28:30<31:48:19,  3.08it/s]
  5%|▌         | 18592/371472 [1:28:31<29:56:38,  3.27it/s]
  5%|▌         | 18593/371472 [1:28:31<29:35:56,  3.31it/s]
  5%|▌         | 18594/371472 [1:28:31<28:44:10,  3.41it/s]
  5%|▌         | 18595/371472 [1:28:32<27:31:52,  3.56it/s]
  5%|▌         | 18596/371472 [1:28:32<27:52:01,  3.52it/s]
  5%|▌         | 18597/371472 [1:28:32<27:30:05,  3.56it/s]
  5%|▌         | 18598/371472 [1:28:32<28:18:14,  3.46it/s]
  5%|▌         | 18599/371472 [1:28:33<27:17:34,  3.59it/s]
  5%|▌         | 18600/371472 [1:28:33<27:58:22,  3.50it/s]
                                                           
{'loss': 4.4977, 'learning_rate': 9.553965825594173e-07, 'epoch': 0.8}

  5%|▌         | 18600/371472 [1:28:33<27:58:22,  3.50it/s]
  5%|▌         | 18601/371472 [1:28:33<27:50:46,  3.52it/s]
  5%|▌         | 18602/371472 [1:28:34<29:17:46,  3.35it/s]
  5%|▌         | 18603/371472 [1:28:34<30:11:01,  3.25it/s]
  5%|▌         | 18604/371472 [1:28:34<29:21:13,  3.34it/s]
  5%|▌         | 18605/371472 [1:28:34<29:07:59,  3.36it/s]
  5%|▌         | 18606/371472 [1:28:35<29:11:34,  3.36it/s]
  5%|▌         | 18607/371472 [1:28:35<28:22:01,  3.46it/s]
  5%|▌         | 18608/371472 [1:28:35<28:09:49,  3.48it/s]
  5%|▌         | 18609/371472 [1:28:36<28:03:30,  3.49it/s]
  5%|▌         | 18610/371472 [1:28:36<28:27:20,  3.44it/s]
  5%|▌         | 18611/371472 [1:28:36<29:42:36,  3.30it/s]
  5%|▌         | 18612/371472 [1:28:36<28:43:02,  3.41it/s]
  5%|▌         | 18613/371472 [1:28:37<30:35:32,  3.20it/s]
  5%|▌         | 18614/371472 [1:28:37<29:08:08,  3.36it/s]
  5%|▌         | 18615/371472 [1:28:37<29:03:31,  3.37it/s]
  5%|▌         | 18616/371472 [1:28:38<27:21:51,  3.58it/s]
  5%|▌         | 18617/371472 [1:28:38<28:33:16,  3.43it/s]
  5%|▌         | 18618/371472 [1:28:38<28:35:23,  3.43it/s]
  5%|▌         | 18619/371472 [1:28:39<28:02:42,  3.49it/s]
  5%|▌         | 18620/371472 [1:28:39<28:05:50,  3.49it/s]
                                                           
{'loss': 4.3852, 'learning_rate': 9.553481005839384e-07, 'epoch': 0.8}

  5%|▌         | 18620/371472 [1:28:39<28:05:50,  3.49it/s]
  5%|▌         | 18621/371472 [1:28:39<27:51:23,  3.52it/s]
  5%|▌         | 18622/371472 [1:28:39<27:16:00,  3.59it/s]
  5%|▌         | 18623/371472 [1:28:40<27:19:45,  3.59it/s]
  5%|▌         | 18624/371472 [1:28:40<29:12:56,  3.35it/s]
  5%|▌         | 18625/371472 [1:28:40<29:01:39,  3.38it/s]
  5%|▌         | 18626/371472 [1:28:41<27:55:55,  3.51it/s]
  5%|▌         | 18627/371472 [1:28:41<27:10:58,  3.61it/s]
  5%|▌         | 18628/371472 [1:28:41<27:21:23,  3.58it/s]
  5%|▌         | 18629/371472 [1:28:41<26:52:19,  3.65it/s]
  5%|▌         | 18630/371472 [1:28:42<27:10:54,  3.61it/s]
  5%|▌         | 18631/371472 [1:28:42<27:36:37,  3.55it/s]
  5%|▌         | 18632/371472 [1:28:42<29:36:19,  3.31it/s]
  5%|▌         | 18633/371472 [1:28:43<31:51:01,  3.08it/s]
  5%|▌         | 18634/371472 [1:28:43<29:38:23,  3.31it/s]
  5%|▌         | 18635/371472 [1:28:43<29:31:50,  3.32it/s]
  5%|▌         | 18636/371472 [1:28:43<28:48:38,  3.40it/s]
  5%|▌         | 18637/371472 [1:28:44<28:25:32,  3.45it/s]
  5%|▌         | 18638/371472 [1:28:44<31:07:50,  3.15it/s]
  5%|▌         | 18639/371472 [1:28:44<29:36:06,  3.31it/s]
  5%|▌         | 18640/371472 [1:28:45<28:00:39,  3.50it/s]
                                                           
{'loss': 4.5963, 'learning_rate': 9.552996186084594e-07, 'epoch': 0.8}

  5%|▌         | 18640/371472 [1:28:45<28:00:39,  3.50it/s]
  5%|▌         | 18641/371472 [1:28:45<28:31:19,  3.44it/s]
  5%|▌         | 18642/371472 [1:28:45<28:52:23,  3.39it/s]
  5%|▌         | 18643/371472 [1:28:46<27:54:26,  3.51it/s]
  5%|▌         | 18644/371472 [1:28:46<28:25:05,  3.45it/s]
  5%|▌         | 18645/371472 [1:28:46<28:07:15,  3.49it/s]
  5%|▌         | 18646/371472 [1:28:46<27:51:15,  3.52it/s]
  5%|▌         | 18647/371472 [1:28:47<27:16:28,  3.59it/s]
  5%|▌         | 18648/371472 [1:28:47<26:54:45,  3.64it/s]
  5%|▌         | 18649/371472 [1:28:47<26:30:30,  3.70it/s]
  5%|▌         | 18650/371472 [1:28:47<26:05:50,  3.76it/s]
  5%|▌         | 18651/371472 [1:28:48<26:36:56,  3.68it/s]
  5%|▌         | 18652/371472 [1:28:48<26:25:15,  3.71it/s]
  5%|▌         | 18653/371472 [1:28:48<27:40:15,  3.54it/s]
  5%|▌         | 18654/371472 [1:28:49<28:14:25,  3.47it/s]
  5%|▌         | 18655/371472 [1:28:49<28:58:07,  3.38it/s]
  5%|▌         | 18656/371472 [1:28:49<28:34:31,  3.43it/s]
  5%|▌         | 18657/371472 [1:28:49<27:43:03,  3.54it/s]
  5%|▌         | 18658/371472 [1:28:50<26:42:40,  3.67it/s]
  5%|▌         | 18659/371472 [1:28:50<27:11:03,  3.61it/s]
  5%|▌         | 18660/371472 [1:28:50<26:31:49,  3.69it/s]
                                                           
{'loss': 4.7555, 'learning_rate': 9.552511366329807e-07, 'epoch': 0.8}

  5%|▌         | 18660/371472 [1:28:50<26:31:49,  3.69it/s]
  5%|▌         | 18661/371472 [1:28:51<28:03:02,  3.49it/s]
  5%|▌         | 18662/371472 [1:28:51<26:46:29,  3.66it/s]
  5%|▌         | 18663/371472 [1:28:51<25:48:19,  3.80it/s]
  5%|▌         | 18664/371472 [1:28:51<27:22:00,  3.58it/s]
  5%|▌         | 18665/371472 [1:28:52<29:04:51,  3.37it/s]
  5%|▌         | 18666/371472 [1:28:52<27:37:11,  3.55it/s]
  5%|▌         | 18667/371472 [1:28:52<27:49:01,  3.52it/s]
  5%|▌         | 18668/371472 [1:28:52<27:24:50,  3.57it/s]
  5%|▌         | 18669/371472 [1:28:53<28:20:18,  3.46it/s]
  5%|▌         | 18670/371472 [1:28:53<29:08:04,  3.36it/s]
  5%|▌         | 18671/371472 [1:28:53<28:02:10,  3.50it/s]
  5%|▌         | 18672/371472 [1:28:54<27:59:39,  3.50it/s]
  5%|▌         | 18673/371472 [1:28:54<27:41:02,  3.54it/s]
  5%|▌         | 18674/371472 [1:28:54<27:22:57,  3.58it/s]
  5%|▌         | 18675/371472 [1:28:55<28:45:02,  3.41it/s]
  5%|▌         | 18676/371472 [1:28:55<28:46:23,  3.41it/s]
  5%|▌         | 18677/371472 [1:28:55<27:40:04,  3.54it/s]
  5%|▌         | 18678/371472 [1:28:55<29:11:47,  3.36it/s]
  5%|▌         | 18679/371472 [1:28:56<28:05:32,  3.49it/s]
  5%|▌         | 18680/371472 [1:28:56<28:03:40,  3.49it/s]
                                                           
{'loss': 4.7279, 'learning_rate': 9.552026546575018e-07, 'epoch': 0.8}

  5%|▌         | 18680/371472 [1:28:56<28:03:40,  3.49it/s]
  5%|▌         | 18681/371472 [1:28:56<28:07:27,  3.48it/s]
  5%|▌         | 18682/371472 [1:28:57<27:42:16,  3.54it/s]
  5%|▌         | 18683/371472 [1:28:57<27:13:59,  3.60it/s]
  5%|▌         | 18684/371472 [1:28:57<27:50:40,  3.52it/s]
  5%|▌         | 18685/371472 [1:28:57<27:23:50,  3.58it/s]
  5%|▌         | 18686/371472 [1:28:58<27:17:42,  3.59it/s]
  5%|▌         | 18687/371472 [1:28:58<28:01:32,  3.50it/s]
  5%|▌         | 18688/371472 [1:28:58<29:11:45,  3.36it/s]
  5%|▌         | 18689/371472 [1:28:59<28:35:49,  3.43it/s]
  5%|▌         | 18690/371472 [1:28:59<29:30:17,  3.32it/s]
  5%|▌         | 18691/371472 [1:28:59<28:22:40,  3.45it/s]
  5%|▌         | 18692/371472 [1:28:59<27:20:22,  3.58it/s]
  5%|▌         | 18693/371472 [1:29:00<27:22:34,  3.58it/s]
  5%|▌         | 18694/371472 [1:29:00<26:40:47,  3.67it/s]
  5%|▌         | 18695/371472 [1:29:00<26:33:04,  3.69it/s]
  5%|▌         | 18696/371472 [1:29:00<26:02:55,  3.76it/s]
  5%|▌         | 18697/371472 [1:29:01<25:09:05,  3.90it/s]
  5%|▌         | 18698/371472 [1:29:01<26:11:54,  3.74it/s]
  5%|▌         | 18699/371472 [1:29:01<26:20:44,  3.72it/s]
  5%|▌         | 18700/371472 [1:29:02<26:08:16,  3.75it/s]
                                                           
{'loss': 4.6135, 'learning_rate': 9.551541726820228e-07, 'epoch': 0.81}

  5%|▌         | 18700/371472 [1:29:02<26:08:16,  3.75it/s]
  5%|▌         | 18701/371472 [1:29:02<26:32:26,  3.69it/s]
  5%|▌         | 18702/371472 [1:29:02<27:12:44,  3.60it/s]
  5%|▌         | 18703/371472 [1:29:02<25:57:14,  3.78it/s]
  5%|▌         | 18704/371472 [1:29:03<25:32:46,  3.84it/s]
  5%|▌         | 18705/371472 [1:29:03<25:49:07,  3.80it/s]
  5%|▌         | 18706/371472 [1:29:03<25:43:49,  3.81it/s]
  5%|▌         | 18707/371472 [1:29:03<25:28:34,  3.85it/s]
  5%|▌         | 18708/371472 [1:29:04<25:25:54,  3.85it/s]
  5%|▌         | 18709/371472 [1:29:04<28:10:49,  3.48it/s]
  5%|▌         | 18710/371472 [1:29:04<28:14:26,  3.47it/s]
  5%|▌         | 18711/371472 [1:29:05<28:10:04,  3.48it/s]
  5%|▌         | 18712/371472 [1:29:05<28:44:51,  3.41it/s]
  5%|▌         | 18713/371472 [1:29:05<28:36:08,  3.43it/s]
  5%|▌         | 18714/371472 [1:29:05<30:17:59,  3.23it/s]
  5%|▌         | 18715/371472 [1:29:06<28:37:01,  3.42it/s]
  5%|▌         | 18716/371472 [1:29:06<28:48:56,  3.40it/s]
  5%|▌         | 18717/371472 [1:29:06<28:51:45,  3.39it/s]
  5%|▌         | 18718/371472 [1:29:07<27:37:29,  3.55it/s]
  5%|▌         | 18719/371472 [1:29:07<27:05:06,  3.62it/s]
  5%|▌         | 18720/371472 [1:29:07<27:54:22,  3.51it/s]
                                                           
{'loss': 4.474, 'learning_rate': 9.55105690706544e-07, 'epoch': 0.81}

  5%|▌         | 18720/371472 [1:29:07<27:54:22,  3.51it/s]
  5%|▌         | 18721/371472 [1:29:07<28:06:09,  3.49it/s]
  5%|▌         | 18722/371472 [1:29:08<28:23:44,  3.45it/s]
  5%|▌         | 18723/371472 [1:29:08<28:19:07,  3.46it/s]
  5%|▌         | 18724/371472 [1:29:08<29:00:54,  3.38it/s]
  5%|▌         | 18725/371472 [1:29:09<28:12:46,  3.47it/s]
  5%|▌         | 18726/371472 [1:29:09<28:39:35,  3.42it/s]
  5%|▌         | 18727/371472 [1:29:09<27:30:48,  3.56it/s]
  5%|▌         | 18728/371472 [1:29:09<26:42:19,  3.67it/s]
  5%|▌         | 18729/371472 [1:29:10<28:05:38,  3.49it/s]
  5%|▌         | 18730/371472 [1:29:10<29:09:49,  3.36it/s]
  5%|▌         | 18731/371472 [1:29:10<29:26:24,  3.33it/s]
  5%|▌         | 18732/371472 [1:29:11<28:41:57,  3.41it/s]
  5%|▌         | 18733/371472 [1:29:11<28:00:27,  3.50it/s]
  5%|▌         | 18734/371472 [1:29:11<30:16:04,  3.24it/s]
  5%|▌         | 18735/371472 [1:29:12<31:27:09,  3.12it/s]
  5%|▌         | 18736/371472 [1:29:12<31:32:54,  3.11it/s]
  5%|▌         | 18737/371472 [1:29:12<29:19:56,  3.34it/s]
  5%|▌         | 18738/371472 [1:29:12<29:03:06,  3.37it/s]
  5%|▌         | 18739/371472 [1:29:13<28:09:35,  3.48it/s]
  5%|▌         | 18740/371472 [1:29:13<26:57:16,  3.64it/s]
                                                           
{'loss': 4.5132, 'learning_rate': 9.55057208731065e-07, 'epoch': 0.81}

  5%|▌         | 18740/371472 [1:29:13<26:57:16,  3.64it/s]
  5%|▌         | 18741/371472 [1:29:13<27:24:19,  3.58it/s]
  5%|▌         | 18742/371472 [1:29:14<27:31:48,  3.56it/s]
  5%|▌         | 18743/371472 [1:29:14<26:31:53,  3.69it/s]
  5%|▌         | 18744/371472 [1:29:14<27:21:55,  3.58it/s]
  5%|▌         | 18745/371472 [1:29:14<28:36:24,  3.43it/s]
  5%|▌         | 18746/371472 [1:29:15<27:55:14,  3.51it/s]
  5%|▌         | 18747/371472 [1:29:15<27:36:58,  3.55it/s]
  5%|▌         | 18748/371472 [1:29:15<27:23:24,  3.58it/s]
  5%|▌         | 18749/371472 [1:29:16<27:18:04,  3.59it/s]
  5%|▌         | 18750/371472 [1:29:16<27:04:47,  3.62it/s]
  5%|▌         | 18751/371472 [1:29:16<26:15:59,  3.73it/s]
  5%|▌         | 18752/371472 [1:29:16<27:45:36,  3.53it/s]
  5%|▌         | 18753/371472 [1:29:17<26:52:01,  3.65it/s]
  5%|▌         | 18754/371472 [1:29:17<29:44:34,  3.29it/s]
  5%|▌         | 18755/371472 [1:29:17<31:26:17,  3.12it/s]
  5%|▌         | 18756/371472 [1:29:18<30:05:32,  3.26it/s]
  5%|▌         | 18757/371472 [1:29:18<28:18:27,  3.46it/s]
  5%|▌         | 18758/371472 [1:29:18<28:42:03,  3.41it/s]
  5%|▌         | 18759/371472 [1:29:18<27:53:01,  3.51it/s]
  5%|▌         | 18760/371472 [1:29:19<26:47:06,  3.66it/s]
                                                           
{'loss': 4.3501, 'learning_rate': 9.550087267555863e-07, 'epoch': 0.81}

  5%|▌         | 18760/371472 [1:29:19<26:47:06,  3.66it/s]
  5%|▌         | 18761/371472 [1:29:19<26:13:37,  3.74it/s]
  5%|▌         | 18762/371472 [1:29:19<25:36:10,  3.83it/s]
  5%|▌         | 18763/371472 [1:29:20<30:46:21,  3.18it/s]
  5%|▌         | 18764/371472 [1:29:20<30:32:05,  3.21it/s]
  5%|▌         | 18765/371472 [1:29:20<30:53:39,  3.17it/s]
  5%|▌         | 18766/371472 [1:29:21<30:04:01,  3.26it/s]
  5%|▌         | 18767/371472 [1:29:21<29:53:48,  3.28it/s]
  5%|▌         | 18768/371472 [1:29:21<28:35:38,  3.43it/s]
  5%|▌         | 18769/371472 [1:29:21<27:08:24,  3.61it/s]
  5%|▌         | 18770/371472 [1:29:22<29:46:24,  3.29it/s]
  5%|▌         | 18771/371472 [1:29:22<31:05:47,  3.15it/s]
  5%|▌         | 18772/371472 [1:29:22<31:09:23,  3.14it/s]
  5%|▌         | 18773/371472 [1:29:23<29:07:07,  3.36it/s]
  5%|▌         | 18774/371472 [1:29:23<28:44:39,  3.41it/s]
  5%|▌         | 18775/371472 [1:29:24<39:08:20,  2.50it/s]
  5%|▌         | 18776/371472 [1:29:24<34:48:38,  2.81it/s]
  5%|▌         | 18777/371472 [1:29:24<32:38:20,  3.00it/s]
  5%|▌         | 18778/371472 [1:29:24<32:25:10,  3.02it/s]
  5%|▌         | 18779/371472 [1:29:25<30:15:52,  3.24it/s]
  5%|▌         | 18780/371472 [1:29:25<30:02:53,  3.26it/s]
                                                           
{'loss': 4.4286, 'learning_rate': 9.549602447801071e-07, 'epoch': 0.81}

  5%|▌         | 18780/371472 [1:29:25<30:02:53,  3.26it/s]
  5%|▌         | 18781/371472 [1:29:25<28:32:29,  3.43it/s]
  5%|▌         | 18782/371472 [1:29:26<29:27:17,  3.33it/s]
  5%|▌         | 18783/371472 [1:29:26<32:07:29,  3.05it/s]
  5%|▌         | 18784/371472 [1:29:26<30:20:22,  3.23it/s]
  5%|▌         | 18785/371472 [1:29:26<29:15:41,  3.35it/s]
  5%|▌         | 18786/371472 [1:29:27<28:36:57,  3.42it/s]
  5%|▌         | 18787/371472 [1:29:27<28:10:14,  3.48it/s]
  5%|▌         | 18788/371472 [1:29:27<32:49:26,  2.98it/s]
  5%|▌         | 18789/371472 [1:29:28<30:42:45,  3.19it/s]
  5%|▌         | 18790/371472 [1:29:28<29:08:23,  3.36it/s]
  5%|▌         | 18791/371472 [1:29:28<29:53:46,  3.28it/s]
  5%|▌         | 18792/371472 [1:29:29<28:46:47,  3.40it/s]
  5%|▌         | 18793/371472 [1:29:29<28:07:20,  3.48it/s]
  5%|▌         | 18794/371472 [1:29:29<27:56:41,  3.51it/s]
  5%|▌         | 18795/371472 [1:29:29<27:08:07,  3.61it/s]
  5%|▌         | 18796/371472 [1:29:30<26:42:17,  3.67it/s]
  5%|▌         | 18797/371472 [1:29:30<27:29:23,  3.56it/s]
  5%|▌         | 18798/371472 [1:29:30<29:19:46,  3.34it/s]
  5%|▌         | 18799/371472 [1:29:31<29:31:46,  3.32it/s]
  5%|▌         | 18800/371472 [1:29:31<27:45:43,  3.53it/s]
                                                           
{'loss': 4.5616, 'learning_rate': 9.549117628046284e-07, 'epoch': 0.81}

  5%|▌         | 18800/371472 [1:29:31<27:45:43,  3.53it/s]
  5%|▌         | 18801/371472 [1:29:31<27:10:01,  3.61it/s]
  5%|▌         | 18802/371472 [1:29:31<26:33:31,  3.69it/s]
  5%|▌         | 18803/371472 [1:29:32<25:53:28,  3.78it/s]
  5%|▌         | 18804/371472 [1:29:32<27:57:19,  3.50it/s]
  5%|▌         | 18805/371472 [1:29:32<27:00:03,  3.63it/s]
  5%|▌         | 18806/371472 [1:29:33<28:02:39,  3.49it/s]
  5%|▌         | 18807/371472 [1:29:33<28:21:11,  3.46it/s]
  5%|▌         | 18808/371472 [1:29:33<28:55:21,  3.39it/s]
  5%|▌         | 18809/371472 [1:29:33<28:14:22,  3.47it/s]
  5%|▌         | 18810/371472 [1:29:34<27:59:27,  3.50it/s]
  5%|▌         | 18811/371472 [1:29:34<27:11:16,  3.60it/s]
  5%|▌         | 18812/371472 [1:29:34<26:20:43,  3.72it/s]
  5%|▌         | 18813/371472 [1:29:35<28:06:33,  3.48it/s]
  5%|▌         | 18814/371472 [1:29:35<27:52:04,  3.52it/s]
  5%|▌         | 18815/371472 [1:29:35<27:32:49,  3.56it/s]
  5%|▌         | 18816/371472 [1:29:35<29:21:16,  3.34it/s]
  5%|▌         | 18817/371472 [1:29:36<29:00:47,  3.38it/s]
  5%|▌         | 18818/371472 [1:29:36<28:41:10,  3.41it/s]
  5%|▌         | 18819/371472 [1:29:36<27:48:31,  3.52it/s]
  5%|▌         | 18820/371472 [1:29:37<29:17:22,  3.34it/s]
                                                           
{'loss': 4.4247, 'learning_rate': 9.548632808291495e-07, 'epoch': 0.81}

  5%|▌         | 18820/371472 [1:29:37<29:17:22,  3.34it/s]
  5%|▌         | 18821/371472 [1:29:37<31:08:36,  3.15it/s]
  5%|▌         | 18822/371472 [1:29:37<29:02:03,  3.37it/s]
  5%|▌         | 18823/371472 [1:29:37<28:33:08,  3.43it/s]
  5%|▌         | 18824/371472 [1:29:38<27:44:39,  3.53it/s]
  5%|▌         | 18825/371472 [1:29:38<26:46:22,  3.66it/s]
  5%|▌         | 18826/371472 [1:29:38<27:19:36,  3.58it/s]
  5%|▌         | 18827/371472 [1:29:39<27:01:04,  3.63it/s]
  5%|▌         | 18828/371472 [1:29:39<26:44:10,  3.66it/s]
  5%|▌         | 18829/371472 [1:29:39<27:05:55,  3.61it/s]
  5%|▌         | 18830/371472 [1:29:39<27:24:45,  3.57it/s]
  5%|▌         | 18831/371472 [1:29:40<28:45:02,  3.41it/s]
  5%|▌         | 18832/371472 [1:29:40<28:18:27,  3.46it/s]
  5%|▌         | 18833/371472 [1:29:40<27:46:00,  3.53it/s]
  5%|▌         | 18834/371472 [1:29:41<27:28:40,  3.56it/s]
  5%|▌         | 18835/371472 [1:29:41<27:43:50,  3.53it/s]
  5%|▌         | 18836/371472 [1:29:41<27:21:29,  3.58it/s]
  5%|▌         | 18837/371472 [1:29:41<27:36:38,  3.55it/s]
  5%|▌         | 18838/371472 [1:29:42<26:40:36,  3.67it/s]
  5%|▌         | 18839/371472 [1:29:42<27:24:15,  3.57it/s]
  5%|▌         | 18840/371472 [1:29:42<27:33:11,  3.56it/s]
                                                           
{'loss': 4.5656, 'learning_rate': 9.548147988536706e-07, 'epoch': 0.81}

  5%|▌         | 18840/371472 [1:29:42<27:33:11,  3.56it/s]
  5%|▌         | 18841/371472 [1:29:42<27:08:06,  3.61it/s]
  5%|▌         | 18842/371472 [1:29:43<26:53:22,  3.64it/s]
  5%|▌         | 18843/371472 [1:29:43<27:37:39,  3.55it/s]
  5%|▌         | 18844/371472 [1:29:43<27:21:38,  3.58it/s]
  5%|▌         | 18845/371472 [1:29:44<28:19:05,  3.46it/s]
  5%|▌         | 18846/371472 [1:29:44<28:14:01,  3.47it/s]
  5%|▌         | 18847/371472 [1:29:44<27:13:05,  3.60it/s]
  5%|▌         | 18848/371472 [1:29:44<26:51:41,  3.65it/s]
  5%|▌         | 18849/371472 [1:29:45<26:34:10,  3.69it/s]
  5%|▌         | 18850/371472 [1:29:45<29:10:46,  3.36it/s]
  5%|▌         | 18851/371472 [1:29:45<28:09:17,  3.48it/s]
  5%|▌         | 18852/371472 [1:29:46<28:20:58,  3.46it/s]
  5%|▌         | 18853/371472 [1:29:46<27:57:25,  3.50it/s]
  5%|▌         | 18854/371472 [1:29:46<27:30:26,  3.56it/s]
  5%|▌         | 18855/371472 [1:29:46<26:52:22,  3.64it/s]
  5%|▌         | 18856/371472 [1:29:47<27:02:39,  3.62it/s]
  5%|▌         | 18857/371472 [1:29:47<26:11:54,  3.74it/s]
  5%|▌         | 18858/371472 [1:29:47<28:20:32,  3.46it/s]
  5%|▌         | 18859/371472 [1:29:48<29:14:20,  3.35it/s]
  5%|▌         | 18860/371472 [1:29:48<28:54:47,  3.39it/s]
                                                           
{'loss': 4.2647, 'learning_rate': 9.547663168781916e-07, 'epoch': 0.81}

  5%|▌         | 18860/371472 [1:29:48<28:54:47,  3.39it/s]
  5%|▌         | 18861/371472 [1:29:48<27:31:35,  3.56it/s]
  5%|▌         | 18862/371472 [1:29:49<29:53:10,  3.28it/s]
  5%|▌         | 18863/371472 [1:29:49<28:39:49,  3.42it/s]
  5%|▌         | 18864/371472 [1:29:49<27:57:10,  3.50it/s]
  5%|▌         | 18865/371472 [1:29:49<28:08:33,  3.48it/s]
  5%|▌         | 18866/371472 [1:29:50<27:59:40,  3.50it/s]
  5%|▌         | 18867/371472 [1:29:50<27:57:30,  3.50it/s]
  5%|▌         | 18868/371472 [1:29:50<30:12:37,  3.24it/s]
  5%|▌         | 18869/371472 [1:29:51<29:10:14,  3.36it/s]
  5%|▌         | 18870/371472 [1:29:51<28:47:56,  3.40it/s]
  5%|▌         | 18871/371472 [1:29:51<28:10:45,  3.48it/s]
  5%|▌         | 18872/371472 [1:29:51<27:55:50,  3.51it/s]
  5%|▌         | 18873/371472 [1:29:52<28:31:46,  3.43it/s]
  5%|▌         | 18874/371472 [1:29:52<27:59:04,  3.50it/s]
  5%|▌         | 18875/371472 [1:29:52<27:13:09,  3.60it/s]
  5%|▌         | 18876/371472 [1:29:52<26:19:03,  3.72it/s]
  5%|▌         | 18877/371472 [1:29:53<26:28:15,  3.70it/s]
  5%|▌         | 18878/371472 [1:29:53<28:33:17,  3.43it/s]
  5%|▌         | 18879/371472 [1:29:53<28:49:59,  3.40it/s]
  5%|▌         | 18880/371472 [1:29:54<29:49:14,  3.28it/s]
                                                           
{'loss': 4.3358, 'learning_rate': 9.547178349027127e-07, 'epoch': 0.81}

  5%|▌         | 18880/371472 [1:29:54<29:49:14,  3.28it/s]
  5%|▌         | 18881/371472 [1:29:54<29:22:47,  3.33it/s]
  5%|▌         | 18882/371472 [1:29:54<28:39:37,  3.42it/s]
  5%|▌         | 18883/371472 [1:29:55<28:19:35,  3.46it/s]
  5%|▌         | 18884/371472 [1:29:55<28:29:33,  3.44it/s]
  5%|▌         | 18885/371472 [1:29:55<27:51:43,  3.52it/s]
  5%|▌         | 18886/371472 [1:29:55<28:44:54,  3.41it/s]
  5%|▌         | 18887/371472 [1:29:56<27:15:45,  3.59it/s]
  5%|▌         | 18888/371472 [1:29:56<26:36:19,  3.68it/s]
  5%|▌         | 18889/371472 [1:29:56<28:20:21,  3.46it/s]
  5%|▌         | 18890/371472 [1:29:57<28:05:17,  3.49it/s]
  5%|▌         | 18891/371472 [1:29:57<27:42:49,  3.53it/s]
  5%|▌         | 18892/371472 [1:29:57<26:46:19,  3.66it/s]
  5%|▌         | 18893/371472 [1:29:57<26:29:16,  3.70it/s]
  5%|▌         | 18894/371472 [1:29:58<26:38:54,  3.68it/s]
  5%|▌         | 18895/371472 [1:29:58<26:32:19,  3.69it/s]
  5%|▌         | 18896/371472 [1:29:58<27:25:38,  3.57it/s]
  5%|▌         | 18897/371472 [1:29:58<27:57:40,  3.50it/s]
  5%|▌         | 18898/371472 [1:29:59<26:58:12,  3.63it/s]
  5%|▌         | 18899/371472 [1:29:59<26:28:30,  3.70it/s]
  5%|▌         | 18900/371472 [1:29:59<28:01:10,  3.50it/s]
                                                           
{'loss': 4.2501, 'learning_rate': 9.54669352927234e-07, 'epoch': 0.81}

  5%|▌         | 18900/371472 [1:29:59<28:01:10,  3.50it/s]
  5%|▌         | 18901/371472 [1:30:00<30:41:27,  3.19it/s]
  5%|▌         | 18902/371472 [1:30:00<29:25:29,  3.33it/s]
  5%|▌         | 18903/371472 [1:30:00<28:19:04,  3.46it/s]
  5%|▌         | 18904/371472 [1:30:01<29:05:06,  3.37it/s]
  5%|▌         | 18905/371472 [1:30:01<27:47:36,  3.52it/s]
  5%|▌         | 18906/371472 [1:30:01<27:28:40,  3.56it/s]
  5%|▌         | 18907/371472 [1:30:01<27:26:53,  3.57it/s]
  5%|▌         | 18908/371472 [1:30:02<28:27:00,  3.44it/s]
  5%|▌         | 18909/371472 [1:30:02<30:52:36,  3.17it/s]
  5%|▌         | 18910/371472 [1:30:02<29:16:53,  3.34it/s]
  5%|▌         | 18911/371472 [1:30:03<29:31:25,  3.32it/s]
  5%|▌         | 18912/371472 [1:30:03<29:35:18,  3.31it/s]
  5%|▌         | 18913/371472 [1:30:03<29:26:31,  3.33it/s]
  5%|▌         | 18914/371472 [1:30:03<29:01:02,  3.37it/s]
  5%|▌         | 18915/371472 [1:30:04<28:01:54,  3.49it/s]
  5%|▌         | 18916/371472 [1:30:04<28:11:08,  3.47it/s]
  5%|▌         | 18917/371472 [1:30:04<27:18:02,  3.59it/s]
  5%|▌         | 18918/371472 [1:30:05<28:27:54,  3.44it/s]
  5%|▌         | 18919/371472 [1:30:05<27:58:48,  3.50it/s]
  5%|▌         | 18920/371472 [1:30:05<27:36:07,  3.55it/s]
                                                           
{'loss': 4.6137, 'learning_rate': 9.54620870951755e-07, 'epoch': 0.81}

  5%|▌         | 18920/371472 [1:30:05<27:36:07,  3.55it/s]
  5%|▌         | 18921/371472 [1:30:05<26:40:31,  3.67it/s]
  5%|▌         | 18922/371472 [1:30:06<28:36:32,  3.42it/s]
  5%|▌         | 18923/371472 [1:30:06<29:19:21,  3.34it/s]
  5%|▌         | 18924/371472 [1:30:06<29:08:00,  3.36it/s]
  5%|▌         | 18925/371472 [1:30:07<28:31:03,  3.43it/s]
  5%|▌         | 18926/371472 [1:30:07<27:16:07,  3.59it/s]
  5%|▌         | 18927/371472 [1:30:07<27:14:58,  3.59it/s]
  5%|▌         | 18928/371472 [1:30:07<26:37:29,  3.68it/s]
  5%|▌         | 18929/371472 [1:30:08<26:41:33,  3.67it/s]
  5%|▌         | 18930/371472 [1:30:08<27:20:15,  3.58it/s]
  5%|▌         | 18931/371472 [1:30:08<27:26:34,  3.57it/s]
  5%|▌         | 18932/371472 [1:30:09<27:00:24,  3.63it/s]
  5%|▌         | 18933/371472 [1:30:09<27:24:30,  3.57it/s]
  5%|▌         | 18934/371472 [1:30:09<27:11:52,  3.60it/s]
  5%|▌         | 18935/371472 [1:30:09<26:48:14,  3.65it/s]
  5%|▌         | 18936/371472 [1:30:10<27:40:01,  3.54it/s]
  5%|▌         | 18937/371472 [1:30:10<26:41:39,  3.67it/s]
  5%|▌         | 18938/371472 [1:30:10<26:01:38,  3.76it/s]
  5%|▌         | 18939/371472 [1:30:10<25:48:32,  3.79it/s]
  5%|▌         | 18940/371472 [1:30:11<26:35:32,  3.68it/s]
                                                           
{'loss': 4.5941, 'learning_rate': 9.545723889762761e-07, 'epoch': 0.82}

  5%|▌         | 18940/371472 [1:30:11<26:35:32,  3.68it/s]
  5%|▌         | 18941/371472 [1:30:11<26:41:54,  3.67it/s]
  5%|▌         | 18942/371472 [1:30:11<26:50:15,  3.65it/s]
  5%|▌         | 18943/371472 [1:30:12<26:04:46,  3.75it/s]
  5%|▌         | 18944/371472 [1:30:12<26:28:10,  3.70it/s]
  5%|▌         | 18945/371472 [1:30:12<26:06:28,  3.75it/s]
  5%|▌         | 18946/371472 [1:30:12<29:54:45,  3.27it/s]
  5%|▌         | 18947/371472 [1:30:13<28:47:41,  3.40it/s]
  5%|▌         | 18948/371472 [1:30:13<28:04:34,  3.49it/s]
  5%|▌         | 18949/371472 [1:30:13<27:13:19,  3.60it/s]
  5%|▌         | 18950/371472 [1:30:14<28:30:09,  3.44it/s]
  5%|▌         | 18951/371472 [1:30:14<28:21:47,  3.45it/s]
  5%|▌         | 18952/371472 [1:30:14<27:52:47,  3.51it/s]
  5%|▌         | 18953/371472 [1:30:14<30:09:32,  3.25it/s]
  5%|▌         | 18954/371472 [1:30:15<30:01:51,  3.26it/s]
  5%|▌         | 18955/371472 [1:30:15<29:09:49,  3.36it/s]
  5%|▌         | 18956/371472 [1:30:15<28:32:07,  3.43it/s]
  5%|▌         | 18957/371472 [1:30:16<28:20:27,  3.46it/s]
  5%|▌         | 18958/371472 [1:30:16<29:05:28,  3.37it/s]
  5%|▌         | 18959/371472 [1:30:16<29:25:59,  3.33it/s]
  5%|▌         | 18960/371472 [1:30:17<28:15:50,  3.46it/s]
                                                           
{'loss': 4.464, 'learning_rate': 9.545239070007974e-07, 'epoch': 0.82}

  5%|▌         | 18960/371472 [1:30:17<28:15:50,  3.46it/s]
  5%|▌         | 18961/371472 [1:30:17<27:16:42,  3.59it/s]
  5%|▌         | 18962/371472 [1:30:17<30:36:28,  3.20it/s]
  5%|▌         | 18963/371472 [1:30:17<29:31:28,  3.32it/s]
  5%|▌         | 18964/371472 [1:30:18<29:37:55,  3.30it/s]
  5%|▌         | 18965/371472 [1:30:18<31:46:34,  3.08it/s]
  5%|▌         | 18966/371472 [1:30:18<30:03:21,  3.26it/s]
  5%|▌         | 18967/371472 [1:30:19<28:40:41,  3.41it/s]
  5%|▌         | 18968/371472 [1:30:19<30:19:12,  3.23it/s]
  5%|▌         | 18969/371472 [1:30:19<29:55:23,  3.27it/s]
  5%|▌         | 18970/371472 [1:30:20<27:59:35,  3.50it/s]
  5%|▌         | 18971/371472 [1:30:20<28:08:18,  3.48it/s]
  5%|▌         | 18972/371472 [1:30:20<26:55:26,  3.64it/s]
  5%|▌         | 18973/371472 [1:30:20<26:00:14,  3.77it/s]
  5%|▌         | 18974/371472 [1:30:21<25:58:30,  3.77it/s]
  5%|▌         | 18975/371472 [1:30:21<26:02:12,  3.76it/s]
  5%|▌         | 18976/371472 [1:30:21<26:11:14,  3.74it/s]
  5%|▌         | 18977/371472 [1:30:21<26:08:31,  3.75it/s]
  5%|▌         | 18978/371472 [1:30:22<27:27:29,  3.57it/s]
  5%|▌         | 18979/371472 [1:30:22<27:39:57,  3.54it/s]
  5%|▌         | 18980/371472 [1:30:22<27:35:37,  3.55it/s]
                                                           
{'loss': 4.3827, 'learning_rate': 9.544754250253183e-07, 'epoch': 0.82}

  5%|▌         | 18980/371472 [1:30:22<27:35:37,  3.55it/s]
  5%|▌         | 18981/371472 [1:30:23<27:36:14,  3.55it/s]
  5%|▌         | 18982/371472 [1:30:23<27:18:52,  3.58it/s]
  5%|▌         | 18983/371472 [1:30:23<28:12:37,  3.47it/s]
  5%|▌         | 18984/371472 [1:30:23<26:54:44,  3.64it/s]
  5%|▌         | 18985/371472 [1:30:24<27:47:24,  3.52it/s]
  5%|▌         | 18986/371472 [1:30:24<27:25:42,  3.57it/s]
  5%|▌         | 18987/371472 [1:30:24<29:32:45,  3.31it/s]
  5%|▌         | 18988/371472 [1:30:25<28:44:36,  3.41it/s]
  5%|▌         | 18989/371472 [1:30:25<28:17:40,  3.46it/s]
  5%|▌         | 18990/371472 [1:30:25<27:38:44,  3.54it/s]
  5%|▌         | 18991/371472 [1:30:25<27:37:53,  3.54it/s]
  5%|▌         | 18992/371472 [1:30:26<31:06:31,  3.15it/s]
  5%|▌         | 18993/371472 [1:30:26<29:36:20,  3.31it/s]
  5%|▌         | 18994/371472 [1:30:26<30:17:37,  3.23it/s]
  5%|▌         | 18995/371472 [1:30:27<29:02:57,  3.37it/s]
  5%|▌         | 18996/371472 [1:30:27<28:30:59,  3.43it/s]
  5%|▌         | 18997/371472 [1:30:27<27:45:48,  3.53it/s]
  5%|▌         | 18998/371472 [1:30:27<27:37:28,  3.54it/s]
  5%|▌         | 18999/371472 [1:30:28<26:51:44,  3.64it/s]
  5%|▌         | 19000/371472 [1:30:28<26:08:33,  3.75it/s]
                                                           
{'loss': 4.62, 'learning_rate': 9.544269430498396e-07, 'epoch': 0.82}

  5%|▌         | 19000/371472 [1:30:28<26:08:33,  3.75it/s]
  5%|▌         | 19001/371472 [1:30:28<26:12:47,  3.74it/s]
  5%|▌         | 19002/371472 [1:30:29<25:37:57,  3.82it/s]
  5%|▌         | 19003/371472 [1:30:29<28:01:31,  3.49it/s]
  5%|▌         | 19004/371472 [1:30:29<28:18:35,  3.46it/s]
  5%|▌         | 19005/371472 [1:30:29<27:21:11,  3.58it/s]
  5%|▌         | 19006/371472 [1:30:30<27:10:28,  3.60it/s]
  5%|▌         | 19007/371472 [1:30:30<26:18:34,  3.72it/s]
  5%|▌         | 19008/371472 [1:30:30<28:13:13,  3.47it/s]
  5%|▌         | 19009/371472 [1:30:31<28:14:01,  3.47it/s]
  5%|▌         | 19010/371472 [1:30:31<28:41:20,  3.41it/s]
  5%|▌         | 19011/371472 [1:30:31<30:05:02,  3.25it/s]
  5%|▌         | 19012/371472 [1:30:31<28:59:31,  3.38it/s]
  5%|▌         | 19013/371472 [1:30:32<28:07:37,  3.48it/s]
  5%|▌         | 19014/371472 [1:30:32<27:00:01,  3.63it/s]
  5%|▌         | 19015/371472 [1:30:32<26:54:25,  3.64it/s]
  5%|▌         | 19016/371472 [1:30:33<26:38:51,  3.67it/s]
  5%|▌         | 19017/371472 [1:30:33<27:17:22,  3.59it/s]
  5%|▌         | 19018/371472 [1:30:33<27:35:13,  3.55it/s]
  5%|▌         | 19019/371472 [1:30:33<26:37:56,  3.68it/s]
  5%|▌         | 19020/371472 [1:30:34<26:08:27,  3.75it/s]
                                                           
{'loss': 4.6739, 'learning_rate': 9.543784610743604e-07, 'epoch': 0.82}

  5%|▌         | 19020/371472 [1:30:34<26:08:27,  3.75it/s]
  5%|▌         | 19021/371472 [1:30:34<25:52:34,  3.78it/s]
  5%|▌         | 19022/371472 [1:30:34<25:31:23,  3.84it/s]
  5%|▌         | 19023/371472 [1:30:34<25:12:12,  3.88it/s]
  5%|▌         | 19024/371472 [1:30:35<25:36:59,  3.82it/s]
  5%|▌         | 19025/371472 [1:30:35<26:03:56,  3.76it/s]
  5%|▌         | 19026/371472 [1:30:35<27:11:06,  3.60it/s]
  5%|▌         | 19027/371472 [1:30:36<27:18:57,  3.58it/s]
  5%|▌         | 19028/371472 [1:30:36<27:21:10,  3.58it/s]
  5%|▌         | 19029/371472 [1:30:36<29:39:53,  3.30it/s]
  5%|▌         | 19030/371472 [1:30:36<28:42:40,  3.41it/s]
  5%|▌         | 19031/371472 [1:30:37<27:19:26,  3.58it/s]
  5%|▌         | 19032/371472 [1:30:37<28:43:44,  3.41it/s]
  5%|▌         | 19033/371472 [1:30:37<29:42:30,  3.30it/s]
  5%|▌         | 19034/371472 [1:30:38<28:09:47,  3.48it/s]
  5%|▌         | 19035/371472 [1:30:38<27:38:54,  3.54it/s]
  5%|▌         | 19036/371472 [1:30:38<27:03:08,  3.62it/s]
  5%|▌         | 19037/371472 [1:30:38<27:28:41,  3.56it/s]
  5%|▌         | 19038/371472 [1:30:39<28:19:20,  3.46it/s]
  5%|▌         | 19039/371472 [1:30:39<30:23:48,  3.22it/s]
  5%|▌         | 19040/371472 [1:30:39<28:21:03,  3.45it/s]
                                                           
{'loss': 4.5649, 'learning_rate': 9.543299790988817e-07, 'epoch': 0.82}

  5%|▌         | 19040/371472 [1:30:39<28:21:03,  3.45it/s]
  5%|▌         | 19041/371472 [1:30:40<27:47:56,  3.52it/s]
  5%|▌         | 19042/371472 [1:30:40<27:33:22,  3.55it/s]
  5%|▌         | 19043/371472 [1:30:40<28:52:31,  3.39it/s]
  5%|▌         | 19044/371472 [1:30:40<28:38:41,  3.42it/s]
  5%|▌         | 19045/371472 [1:30:41<28:46:38,  3.40it/s]
  5%|▌         | 19046/371472 [1:30:41<28:32:23,  3.43it/s]
  5%|▌         | 19047/371472 [1:30:41<28:50:40,  3.39it/s]
  5%|▌         | 19048/371472 [1:30:42<28:10:10,  3.48it/s]
  5%|▌         | 19049/371472 [1:30:42<27:24:12,  3.57it/s]
  5%|▌         | 19050/371472 [1:30:42<28:55:47,  3.38it/s]
  5%|▌         | 19051/371472 [1:30:42<28:38:53,  3.42it/s]
  5%|▌         | 19052/371472 [1:30:43<28:58:01,  3.38it/s]
  5%|▌         | 19053/371472 [1:30:43<28:48:56,  3.40it/s]
  5%|▌         | 19054/371472 [1:30:43<30:15:45,  3.23it/s]
  5%|▌         | 19055/371472 [1:30:44<28:34:52,  3.43it/s]
  5%|▌         | 19056/371472 [1:30:44<29:52:01,  3.28it/s]
  5%|▌         | 19057/371472 [1:30:44<28:21:24,  3.45it/s]
  5%|▌         | 19058/371472 [1:30:45<28:06:06,  3.48it/s]
  5%|▌         | 19059/371472 [1:30:45<29:06:42,  3.36it/s]
  5%|▌         | 19060/371472 [1:30:45<28:15:57,  3.46it/s]
                                                           
{'loss': 4.4442, 'learning_rate': 9.542814971234028e-07, 'epoch': 0.82}

  5%|▌         | 19060/371472 [1:30:45<28:15:57,  3.46it/s]
  5%|▌         | 19061/371472 [1:30:45<30:10:56,  3.24it/s]
  5%|▌         | 19062/371472 [1:30:46<29:22:57,  3.33it/s]
  5%|▌         | 19063/371472 [1:30:46<29:37:07,  3.31it/s]
  5%|▌         | 19064/371472 [1:30:46<28:13:37,  3.47it/s]
  5%|▌         | 19065/371472 [1:30:47<28:02:14,  3.49it/s]
  5%|▌         | 19066/371472 [1:30:47<28:47:01,  3.40it/s]
  5%|▌         | 19067/371472 [1:30:47<28:42:27,  3.41it/s]
  5%|▌         | 19068/371472 [1:30:47<27:49:17,  3.52it/s]
  5%|▌         | 19069/371472 [1:30:48<26:44:55,  3.66it/s]
  5%|▌         | 19070/371472 [1:30:48<27:36:02,  3.55it/s]
  5%|▌         | 19071/371472 [1:30:48<27:09:34,  3.60it/s]
  5%|▌         | 19072/371472 [1:30:49<27:00:54,  3.62it/s]
  5%|▌         | 19073/371472 [1:30:49<26:33:34,  3.69it/s]
  5%|▌         | 19074/371472 [1:30:49<27:52:11,  3.51it/s]
  5%|▌         | 19075/371472 [1:30:49<28:00:46,  3.49it/s]
  5%|▌         | 19076/371472 [1:30:50<28:20:10,  3.45it/s]
  5%|▌         | 19077/371472 [1:30:50<28:15:07,  3.46it/s]
  5%|▌         | 19078/371472 [1:30:50<27:15:40,  3.59it/s]
  5%|▌         | 19079/371472 [1:30:51<26:58:01,  3.63it/s]
  5%|▌         | 19080/371472 [1:30:51<27:35:19,  3.55it/s]
                                                           
{'loss': 4.5496, 'learning_rate': 9.542330151479238e-07, 'epoch': 0.82}

  5%|▌         | 19080/371472 [1:30:51<27:35:19,  3.55it/s]
  5%|▌         | 19081/371472 [1:30:51<27:46:57,  3.52it/s]
  5%|▌         | 19082/371472 [1:30:51<27:55:39,  3.51it/s]
  5%|▌         | 19083/371472 [1:30:52<28:54:27,  3.39it/s]
  5%|▌         | 19084/371472 [1:30:52<29:44:12,  3.29it/s]
  5%|▌         | 19085/371472 [1:30:52<30:02:27,  3.26it/s]
  5%|▌         | 19086/371472 [1:30:53<28:43:18,  3.41it/s]
  5%|▌         | 19087/371472 [1:30:53<27:45:51,  3.53it/s]
  5%|▌         | 19088/371472 [1:30:53<27:07:49,  3.61it/s]
  5%|▌         | 19089/371472 [1:30:53<28:41:40,  3.41it/s]
  5%|▌         | 19090/371472 [1:30:54<28:10:42,  3.47it/s]
  5%|▌         | 19091/371472 [1:30:54<27:43:42,  3.53it/s]
  5%|▌         | 19092/371472 [1:30:54<27:01:24,  3.62it/s]
  5%|▌         | 19093/371472 [1:30:55<27:35:47,  3.55it/s]
  5%|▌         | 19094/371472 [1:30:55<27:27:41,  3.56it/s]
  5%|▌         | 19095/371472 [1:30:55<26:29:31,  3.69it/s]
  5%|▌         | 19096/371472 [1:30:55<28:40:07,  3.41it/s]
  5%|▌         | 19097/371472 [1:30:56<28:45:28,  3.40it/s]
  5%|▌         | 19098/371472 [1:30:56<27:16:56,  3.59it/s]
  5%|▌         | 19099/371472 [1:30:56<29:26:22,  3.32it/s]
  5%|▌         | 19100/371472 [1:30:57<29:04:28,  3.37it/s]
                                                           
{'loss': 4.458, 'learning_rate': 9.54184533172445e-07, 'epoch': 0.82}

  5%|▌         | 19100/371472 [1:30:57<29:04:28,  3.37it/s]
  5%|▌         | 19101/371472 [1:30:57<28:12:45,  3.47it/s]
  5%|▌         | 19102/371472 [1:30:57<29:23:08,  3.33it/s]
  5%|▌         | 19103/371472 [1:30:58<29:09:25,  3.36it/s]
  5%|▌         | 19104/371472 [1:30:58<28:31:04,  3.43it/s]
  5%|▌         | 19105/371472 [1:30:58<29:24:44,  3.33it/s]
  5%|▌         | 19106/371472 [1:30:58<30:30:07,  3.21it/s]
  5%|▌         | 19107/371472 [1:30:59<28:48:46,  3.40it/s]
  5%|▌         | 19108/371472 [1:30:59<27:33:01,  3.55it/s]
  5%|▌         | 19109/371472 [1:30:59<28:00:35,  3.49it/s]
  5%|▌         | 19110/371472 [1:31:00<27:32:06,  3.55it/s]
  5%|▌         | 19111/371472 [1:31:00<27:09:12,  3.60it/s]
  5%|▌         | 19112/371472 [1:31:00<26:13:54,  3.73it/s]
  5%|▌         | 19113/371472 [1:31:00<27:06:40,  3.61it/s]
  5%|▌         | 19114/371472 [1:31:01<26:24:48,  3.71it/s]
  5%|▌         | 19115/371472 [1:31:01<28:46:08,  3.40it/s]
  5%|▌         | 19116/371472 [1:31:01<29:38:21,  3.30it/s]
  5%|▌         | 19117/371472 [1:31:02<28:12:53,  3.47it/s]
  5%|▌         | 19118/371472 [1:31:02<27:49:32,  3.52it/s]
  5%|▌         | 19119/371472 [1:31:02<27:32:29,  3.55it/s]
  5%|▌         | 19120/371472 [1:31:02<27:21:17,  3.58it/s]
                                                           
{'loss': 4.536, 'learning_rate': 9.54136051196966e-07, 'epoch': 0.82}

  5%|▌         | 19120/371472 [1:31:02<27:21:17,  3.58it/s]
  5%|▌         | 19121/371472 [1:31:03<27:13:29,  3.60it/s]
  5%|▌         | 19122/371472 [1:31:03<27:08:41,  3.61it/s]
  5%|▌         | 19123/371472 [1:31:03<28:38:31,  3.42it/s]
  5%|▌         | 19124/371472 [1:31:04<28:17:04,  3.46it/s]
  5%|▌         | 19125/371472 [1:31:04<28:12:13,  3.47it/s]
  5%|▌         | 19126/371472 [1:31:04<28:17:36,  3.46it/s]
  5%|▌         | 19127/371472 [1:31:04<27:33:41,  3.55it/s]
  5%|▌         | 19128/371472 [1:31:05<30:10:06,  3.24it/s]
  5%|▌         | 19129/371472 [1:31:05<28:30:48,  3.43it/s]
  5%|▌         | 19130/371472 [1:31:05<28:50:38,  3.39it/s]
  5%|▌         | 19131/371472 [1:31:06<27:46:51,  3.52it/s]
  5%|▌         | 19132/371472 [1:31:06<27:35:38,  3.55it/s]
  5%|▌         | 19133/371472 [1:31:06<29:31:26,  3.31it/s]
  5%|▌         | 19134/371472 [1:31:06<29:58:37,  3.26it/s]
  5%|▌         | 19135/371472 [1:31:07<29:08:03,  3.36it/s]
  5%|▌         | 19136/371472 [1:31:07<27:24:30,  3.57it/s]
  5%|▌         | 19137/371472 [1:31:07<28:34:07,  3.43it/s]
  5%|▌         | 19138/371472 [1:31:08<27:28:05,  3.56it/s]
  5%|▌         | 19139/371472 [1:31:08<28:15:06,  3.46it/s]
  5%|▌         | 19140/371472 [1:31:08<28:06:25,  3.48it/s]
                                                           
{'loss': 4.6454, 'learning_rate': 9.540875692214873e-07, 'epoch': 0.82}

  5%|▌         | 19140/371472 [1:31:08<28:06:25,  3.48it/s]
  5%|▌         | 19141/371472 [1:31:09<29:34:58,  3.31it/s]
  5%|▌         | 19142/371472 [1:31:09<28:20:11,  3.45it/s]
  5%|▌         | 19143/371472 [1:31:09<29:33:12,  3.31it/s]
  5%|▌         | 19144/371472 [1:31:09<29:23:35,  3.33it/s]
  5%|▌         | 19145/371472 [1:31:10<28:56:46,  3.38it/s]
  5%|▌         | 19146/371472 [1:31:10<28:50:02,  3.39it/s]
  5%|▌         | 19147/371472 [1:31:10<28:09:42,  3.48it/s]
  5%|▌         | 19148/371472 [1:31:11<28:29:39,  3.43it/s]
  5%|▌         | 19149/371472 [1:31:11<28:05:57,  3.48it/s]
  5%|▌         | 19150/371472 [1:31:11<27:48:50,  3.52it/s]
  5%|▌         | 19151/371472 [1:31:11<26:44:41,  3.66it/s]
  5%|▌         | 19152/371472 [1:31:12<27:42:59,  3.53it/s]
  5%|▌         | 19153/371472 [1:31:12<28:48:05,  3.40it/s]
  5%|▌         | 19154/371472 [1:31:12<27:55:29,  3.50it/s]
  5%|▌         | 19155/371472 [1:31:12<27:12:56,  3.60it/s]
  5%|▌         | 19156/371472 [1:31:13<26:25:41,  3.70it/s]
  5%|▌         | 19157/371472 [1:31:13<27:49:43,  3.52it/s]
  5%|▌         | 19158/371472 [1:31:13<28:40:07,  3.41it/s]
  5%|▌         | 19159/371472 [1:31:14<28:10:59,  3.47it/s]
  5%|▌         | 19160/371472 [1:31:14<27:49:20,  3.52it/s]
                                                           
{'loss': 4.4801, 'learning_rate': 9.540390872460081e-07, 'epoch': 0.83}

  5%|▌         | 19160/371472 [1:31:14<27:49:20,  3.52it/s]
  5%|▌         | 19161/371472 [1:31:14<28:14:00,  3.47it/s]
  5%|▌         | 19162/371472 [1:31:15<28:28:38,  3.44it/s]
  5%|▌         | 19163/371472 [1:31:15<29:07:19,  3.36it/s]
  5%|▌         | 19164/371472 [1:31:15<28:25:19,  3.44it/s]
  5%|▌         | 19165/371472 [1:31:15<28:08:22,  3.48it/s]
  5%|▌         | 19166/371472 [1:31:16<27:27:41,  3.56it/s]
  5%|▌         | 19167/371472 [1:31:16<27:30:54,  3.56it/s]
  5%|▌         | 19168/371472 [1:31:16<28:40:09,  3.41it/s]
  5%|▌         | 19169/371472 [1:31:17<27:11:59,  3.60it/s]
  5%|▌         | 19170/371472 [1:31:17<27:18:01,  3.58it/s]
  5%|▌         | 19171/371472 [1:31:17<26:31:03,  3.69it/s]
  5%|▌         | 19172/371472 [1:31:17<27:45:28,  3.53it/s]
  5%|▌         | 19173/371472 [1:31:18<27:17:51,  3.58it/s]
  5%|▌         | 19174/371472 [1:31:18<29:33:22,  3.31it/s]
  5%|▌         | 19175/371472 [1:31:18<30:36:26,  3.20it/s]
  5%|▌         | 19176/371472 [1:31:19<30:31:32,  3.21it/s]
  5%|▌         | 19177/371472 [1:31:19<31:02:18,  3.15it/s]
  5%|▌         | 19178/371472 [1:31:19<29:32:22,  3.31it/s]
  5%|▌         | 19179/371472 [1:31:20<29:39:26,  3.30it/s]
  5%|▌         | 19180/371472 [1:31:20<30:44:23,  3.18it/s]
                                                           
{'loss': 4.5506, 'learning_rate': 9.539906052705294e-07, 'epoch': 0.83}

  5%|▌         | 19180/371472 [1:31:20<30:44:23,  3.18it/s]
  5%|▌         | 19181/371472 [1:31:20<29:38:08,  3.30it/s]
  5%|▌         | 19182/371472 [1:31:20<30:05:56,  3.25it/s]
  5%|▌         | 19183/371472 [1:31:21<31:35:34,  3.10it/s]
  5%|▌         | 19184/371472 [1:31:21<33:23:20,  2.93it/s]
  5%|▌         | 19185/371472 [1:31:22<32:11:32,  3.04it/s]
  5%|▌         | 19186/371472 [1:31:22<30:11:06,  3.24it/s]
  5%|▌         | 19187/371472 [1:31:22<28:29:58,  3.43it/s]
  5%|▌         | 19188/371472 [1:31:22<27:48:28,  3.52it/s]
  5%|▌         | 19189/371472 [1:31:23<29:23:30,  3.33it/s]
  5%|▌         | 19190/371472 [1:31:23<28:39:25,  3.41it/s]
  5%|▌         | 19191/371472 [1:31:23<28:28:31,  3.44it/s]
  5%|▌         | 19192/371472 [1:31:23<27:50:26,  3.51it/s]
  5%|▌         | 19193/371472 [1:31:24<27:22:45,  3.57it/s]
  5%|▌         | 19194/371472 [1:31:24<26:48:34,  3.65it/s]
  5%|▌         | 19195/371472 [1:31:24<26:48:14,  3.65it/s]
  5%|▌         | 19196/371472 [1:31:25<28:15:31,  3.46it/s]
  5%|▌         | 19197/371472 [1:31:25<28:27:19,  3.44it/s]
  5%|▌         | 19198/371472 [1:31:25<27:18:04,  3.58it/s]
  5%|▌         | 19199/371472 [1:31:25<26:56:10,  3.63it/s]
  5%|▌         | 19200/371472 [1:31:26<26:19:12,  3.72it/s]
                                                           
{'loss': 4.4797, 'learning_rate': 9.539421232950505e-07, 'epoch': 0.83}

  5%|▌         | 19200/371472 [1:31:26<26:19:12,  3.72it/s]
  5%|▌         | 19201/371472 [1:31:26<26:19:44,  3.72it/s]
  5%|▌         | 19202/371472 [1:31:26<29:14:45,  3.35it/s]
  5%|▌         | 19203/371472 [1:31:27<28:03:36,  3.49it/s]
  5%|▌         | 19204/371472 [1:31:27<26:58:17,  3.63it/s]
  5%|▌         | 19205/371472 [1:31:27<26:17:24,  3.72it/s]
  5%|▌         | 19206/371472 [1:31:27<26:21:14,  3.71it/s]
  5%|▌         | 19207/371472 [1:31:28<27:57:00,  3.50it/s]
  5%|▌         | 19208/371472 [1:31:28<27:44:27,  3.53it/s]
  5%|▌         | 19209/371472 [1:31:28<28:36:08,  3.42it/s]
  5%|▌         | 19210/371472 [1:31:28<27:12:59,  3.60it/s]
  5%|▌         | 19211/371472 [1:31:29<26:48:27,  3.65it/s]
  5%|▌         | 19212/371472 [1:31:29<27:37:04,  3.54it/s]
  5%|▌         | 19213/371472 [1:31:29<27:53:58,  3.51it/s]
  5%|▌         | 19214/371472 [1:31:30<27:26:28,  3.57it/s]
  5%|▌         | 19215/371472 [1:31:30<30:20:44,  3.22it/s]
  5%|▌         | 19216/371472 [1:31:30<31:47:50,  3.08it/s]
  5%|▌         | 19217/371472 [1:31:31<30:25:52,  3.22it/s]
  5%|▌         | 19218/371472 [1:31:31<28:36:37,  3.42it/s]
  5%|▌         | 19219/371472 [1:31:31<27:52:17,  3.51it/s]
  5%|▌         | 19220/371472 [1:31:31<27:02:34,  3.62it/s]
                                                           
{'loss': 4.5092, 'learning_rate': 9.538936413195716e-07, 'epoch': 0.83}

  5%|▌         | 19220/371472 [1:31:31<27:02:34,  3.62it/s]
  5%|▌         | 19221/371472 [1:31:32<27:41:23,  3.53it/s]
  5%|▌         | 19222/371472 [1:31:32<26:29:50,  3.69it/s]
  5%|▌         | 19223/371472 [1:31:32<26:26:43,  3.70it/s]
  5%|▌         | 19224/371472 [1:31:32<26:43:15,  3.66it/s]
  5%|▌         | 19225/371472 [1:31:33<27:07:58,  3.61it/s]
  5%|▌         | 19226/371472 [1:31:33<27:22:27,  3.57it/s]
  5%|▌         | 19227/371472 [1:31:33<27:45:38,  3.52it/s]
  5%|▌         | 19228/371472 [1:31:34<27:33:33,  3.55it/s]
  5%|▌         | 19229/371472 [1:31:34<27:26:09,  3.57it/s]
  5%|▌         | 19230/371472 [1:31:34<27:40:54,  3.53it/s]
  5%|▌         | 19231/371472 [1:31:34<27:04:51,  3.61it/s]
  5%|▌         | 19232/371472 [1:31:35<28:36:19,  3.42it/s]
  5%|▌         | 19233/371472 [1:31:35<30:11:32,  3.24it/s]
  5%|▌         | 19234/371472 [1:31:35<30:02:49,  3.26it/s]
  5%|▌         | 19235/371472 [1:31:36<28:20:49,  3.45it/s]
  5%|▌         | 19236/371472 [1:31:36<31:47:57,  3.08it/s]
  5%|▌         | 19237/371472 [1:31:36<30:19:50,  3.23it/s]
  5%|▌         | 19238/371472 [1:31:37<29:30:20,  3.32it/s]
  5%|▌         | 19239/371472 [1:31:37<29:26:15,  3.32it/s]
  5%|▌         | 19240/371472 [1:31:37<28:06:37,  3.48it/s]
                                                           
{'loss': 4.4169, 'learning_rate': 9.538451593440926e-07, 'epoch': 0.83}

  5%|▌         | 19240/371472 [1:31:37<28:06:37,  3.48it/s]
  5%|▌         | 19241/371472 [1:31:37<27:44:19,  3.53it/s]
  5%|▌         | 19242/371472 [1:31:38<27:58:29,  3.50it/s]
  5%|▌         | 19243/371472 [1:31:38<28:51:25,  3.39it/s]
  5%|▌         | 19244/371472 [1:31:38<29:11:34,  3.35it/s]
  5%|▌         | 19245/371472 [1:31:39<28:10:44,  3.47it/s]
  5%|▌         | 19246/371472 [1:31:39<27:39:10,  3.54it/s]
  5%|▌         | 19247/371472 [1:31:39<28:19:30,  3.45it/s]
  5%|▌         | 19248/371472 [1:31:40<29:13:58,  3.35it/s]
  5%|▌         | 19249/371472 [1:31:40<27:50:09,  3.51it/s]
  5%|▌         | 19250/371472 [1:31:40<27:43:26,  3.53it/s]
  5%|▌         | 19251/371472 [1:31:40<31:05:18,  3.15it/s]
  5%|▌         | 19252/371472 [1:31:41<29:11:22,  3.35it/s]
  5%|▌         | 19253/371472 [1:31:41<30:43:21,  3.18it/s]
  5%|▌         | 19254/371472 [1:31:41<32:03:24,  3.05it/s]
  5%|▌         | 19255/371472 [1:31:42<29:50:47,  3.28it/s]
  5%|▌         | 19256/371472 [1:31:42<28:56:26,  3.38it/s]
  5%|▌         | 19257/371472 [1:31:42<28:41:32,  3.41it/s]
  5%|▌         | 19258/371472 [1:31:43<28:47:36,  3.40it/s]
  5%|▌         | 19259/371472 [1:31:43<29:53:33,  3.27it/s]
  5%|▌         | 19260/371472 [1:31:43<29:59:40,  3.26it/s]
                                                           
{'loss': 4.7532, 'learning_rate': 9.537966773686137e-07, 'epoch': 0.83}

  5%|▌         | 19260/371472 [1:31:43<29:59:40,  3.26it/s]
  5%|▌         | 19261/371472 [1:31:43<28:52:17,  3.39it/s]
  5%|▌         | 19262/371472 [1:31:44<28:40:49,  3.41it/s]
  5%|▌         | 19263/371472 [1:31:44<27:43:09,  3.53it/s]
  5%|▌         | 19264/371472 [1:31:44<27:33:04,  3.55it/s]
  5%|▌         | 19265/371472 [1:31:45<27:06:47,  3.61it/s]
  5%|▌         | 19266/371472 [1:31:45<26:57:01,  3.63it/s]
  5%|▌         | 19267/371472 [1:31:45<27:53:05,  3.51it/s]
  5%|▌         | 19268/371472 [1:31:45<29:01:57,  3.37it/s]
  5%|▌         | 19269/371472 [1:31:46<29:14:30,  3.35it/s]
  5%|▌         | 19270/371472 [1:31:46<28:14:09,  3.46it/s]
  5%|▌         | 19271/371472 [1:31:46<27:53:12,  3.51it/s]
  5%|▌         | 19272/371472 [1:31:47<27:04:11,  3.61it/s]
  5%|▌         | 19273/371472 [1:31:47<26:41:43,  3.66it/s]
  5%|▌         | 19274/371472 [1:31:47<26:11:51,  3.73it/s]
  5%|▌         | 19275/371472 [1:31:47<25:44:04,  3.80it/s]
  5%|▌         | 19276/371472 [1:31:48<26:35:33,  3.68it/s]
  5%|▌         | 19277/371472 [1:31:48<27:03:45,  3.62it/s]
  5%|▌         | 19278/371472 [1:31:48<27:26:52,  3.56it/s]
  5%|▌         | 19279/371472 [1:31:49<28:33:01,  3.43it/s]
  5%|▌         | 19280/371472 [1:31:49<28:43:27,  3.41it/s]
                                                           
{'loss': 4.6437, 'learning_rate': 9.53748195393135e-07, 'epoch': 0.83}

  5%|▌         | 19280/371472 [1:31:49<28:43:27,  3.41it/s]
  5%|▌         | 19281/371472 [1:31:49<27:22:32,  3.57it/s]
  5%|▌         | 19282/371472 [1:31:49<27:09:44,  3.60it/s]
  5%|▌         | 19283/371472 [1:31:50<27:04:22,  3.61it/s]
  5%|▌         | 19284/371472 [1:31:50<26:36:56,  3.68it/s]
  5%|▌         | 19285/371472 [1:31:50<27:01:15,  3.62it/s]
  5%|▌         | 19286/371472 [1:31:50<27:54:08,  3.51it/s]
  5%|▌         | 19287/371472 [1:31:51<26:56:29,  3.63it/s]
  5%|▌         | 19288/371472 [1:31:51<28:37:57,  3.42it/s]
  5%|▌         | 19289/371472 [1:31:51<30:00:11,  3.26it/s]
  5%|▌         | 19290/371472 [1:31:52<29:02:55,  3.37it/s]
  5%|▌         | 19291/371472 [1:31:52<30:05:29,  3.25it/s]
  5%|▌         | 19292/371472 [1:31:52<27:59:58,  3.49it/s]
  5%|▌         | 19293/371472 [1:31:53<27:54:01,  3.51it/s]
  5%|▌         | 19294/371472 [1:31:53<27:38:05,  3.54it/s]
  5%|▌         | 19295/371472 [1:31:53<27:10:23,  3.60it/s]
  5%|▌         | 19296/371472 [1:31:53<28:03:48,  3.49it/s]
  5%|▌         | 19297/371472 [1:31:54<27:46:02,  3.52it/s]
  5%|▌         | 19298/371472 [1:31:54<27:18:04,  3.58it/s]
  5%|▌         | 19299/371472 [1:31:54<26:59:11,  3.62it/s]
  5%|▌         | 19300/371472 [1:31:54<26:39:22,  3.67it/s]
                                                           
{'loss': 4.4116, 'learning_rate': 9.53699713417656e-07, 'epoch': 0.83}

  5%|▌         | 19300/371472 [1:31:54<26:39:22,  3.67it/s]
  5%|▌         | 19301/371472 [1:31:55<29:39:16,  3.30it/s]
  5%|▌         | 19302/371472 [1:31:55<28:20:47,  3.45it/s]
  5%|▌         | 19303/371472 [1:31:55<27:42:42,  3.53it/s]
  5%|▌         | 19304/371472 [1:31:56<27:28:14,  3.56it/s]
  5%|▌         | 19305/371472 [1:31:56<28:59:22,  3.37it/s]
  5%|▌         | 19306/371472 [1:31:56<28:30:58,  3.43it/s]
  5%|▌         | 19307/371472 [1:31:57<28:26:57,  3.44it/s]
  5%|▌         | 19308/371472 [1:31:57<27:54:59,  3.50it/s]
  5%|▌         | 19309/371472 [1:31:57<26:51:46,  3.64it/s]
  5%|▌         | 19310/371472 [1:31:57<26:42:46,  3.66it/s]
  5%|▌         | 19311/371472 [1:31:58<26:31:59,  3.69it/s]
  5%|▌         | 19312/371472 [1:31:58<26:07:52,  3.74it/s]
  5%|▌         | 19313/371472 [1:31:58<26:01:12,  3.76it/s]
  5%|▌         | 19314/371472 [1:31:58<26:54:14,  3.64it/s]
  5%|▌         | 19315/371472 [1:31:59<26:19:21,  3.72it/s]
  5%|▌         | 19316/371472 [1:31:59<27:48:57,  3.52it/s]
  5%|▌         | 19317/371472 [1:31:59<28:15:00,  3.46it/s]
  5%|▌         | 19318/371472 [1:32:00<28:44:27,  3.40it/s]
  5%|▌         | 19319/371472 [1:32:00<29:04:51,  3.36it/s]
  5%|▌         | 19320/371472 [1:32:00<30:12:49,  3.24it/s]
                                                           
{'loss': 4.6395, 'learning_rate': 9.536512314421771e-07, 'epoch': 0.83}

  5%|▌         | 19320/371472 [1:32:00<30:12:49,  3.24it/s]
  5%|▌         | 19321/371472 [1:32:00<28:20:16,  3.45it/s]
  5%|▌         | 19322/371472 [1:32:01<27:23:08,  3.57it/s]
  5%|▌         | 19323/371472 [1:32:01<27:50:38,  3.51it/s]
  5%|▌         | 19324/371472 [1:32:01<26:54:47,  3.63it/s]
  5%|▌         | 19325/371472 [1:32:02<26:41:19,  3.67it/s]
  5%|▌         | 19326/371472 [1:32:02<26:27:05,  3.70it/s]
  5%|▌         | 19327/371472 [1:32:02<27:28:55,  3.56it/s]
  5%|▌         | 19328/371472 [1:32:02<27:06:37,  3.61it/s]
  5%|▌         | 19329/371472 [1:32:03<27:44:13,  3.53it/s]
  5%|▌         | 19330/371472 [1:32:03<27:22:05,  3.57it/s]
  5%|▌         | 19331/371472 [1:32:03<27:42:32,  3.53it/s]
  5%|▌         | 19332/371472 [1:32:04<27:06:05,  3.61it/s]
  5%|▌         | 19333/371472 [1:32:04<26:16:55,  3.72it/s]
  5%|▌         | 19334/371472 [1:32:04<30:39:08,  3.19it/s]
  5%|▌         | 19335/371472 [1:32:04<29:12:05,  3.35it/s]
  5%|▌         | 19336/371472 [1:32:05<30:01:12,  3.26it/s]
  5%|▌         | 19337/371472 [1:32:05<28:22:02,  3.45it/s]
  5%|▌         | 19338/371472 [1:32:05<28:27:35,  3.44it/s]
  5%|▌         | 19339/371472 [1:32:06<28:59:56,  3.37it/s]
  5%|▌         | 19340/371472 [1:32:06<31:13:26,  3.13it/s]
                                                           
{'loss': 4.5763, 'learning_rate': 9.536027494666983e-07, 'epoch': 0.83}

  5%|▌         | 19340/371472 [1:32:06<31:13:26,  3.13it/s]
  5%|▌         | 19341/371472 [1:32:06<29:52:29,  3.27it/s]
  5%|▌         | 19342/371472 [1:32:07<28:44:04,  3.40it/s]
  5%|▌         | 19343/371472 [1:32:07<27:20:17,  3.58it/s]
  5%|▌         | 19344/371472 [1:32:07<27:09:06,  3.60it/s]
  5%|▌         | 19345/371472 [1:32:07<27:02:56,  3.62it/s]
  5%|▌         | 19346/371472 [1:32:08<28:36:40,  3.42it/s]
  5%|▌         | 19347/371472 [1:32:08<27:40:46,  3.53it/s]
  5%|▌         | 19348/371472 [1:32:08<27:05:57,  3.61it/s]
  5%|▌         | 19349/371472 [1:32:08<28:10:43,  3.47it/s]
  5%|▌         | 19350/371472 [1:32:09<27:06:17,  3.61it/s]
  5%|▌         | 19351/371472 [1:32:09<27:16:26,  3.59it/s]
  5%|▌         | 19352/371472 [1:32:09<27:02:50,  3.62it/s]
  5%|▌         | 19353/371472 [1:32:10<27:30:33,  3.56it/s]
  5%|▌         | 19354/371472 [1:32:10<27:35:18,  3.55it/s]
  5%|▌         | 19355/371472 [1:32:10<28:12:42,  3.47it/s]
  5%|▌         | 19356/371472 [1:32:10<27:32:01,  3.55it/s]
  5%|▌         | 19357/371472 [1:32:11<27:54:12,  3.51it/s]
  5%|▌         | 19358/371472 [1:32:11<29:16:36,  3.34it/s]
  5%|▌         | 19359/371472 [1:32:11<28:49:15,  3.39it/s]
  5%|▌         | 19360/371472 [1:32:12<28:06:31,  3.48it/s]
                                                           
{'loss': 4.6412, 'learning_rate': 9.535542674912193e-07, 'epoch': 0.83}

  5%|▌         | 19360/371472 [1:32:12<28:06:31,  3.48it/s]
  5%|▌         | 19361/371472 [1:32:12<27:08:56,  3.60it/s]
  5%|▌         | 19362/371472 [1:32:12<28:21:05,  3.45it/s]
  5%|▌         | 19363/371472 [1:32:12<27:14:37,  3.59it/s]
  5%|▌         | 19364/371472 [1:32:13<27:37:16,  3.54it/s]
  5%|▌         | 19365/371472 [1:32:13<28:39:51,  3.41it/s]
  5%|▌         | 19366/371472 [1:32:13<28:02:17,  3.49it/s]
  5%|▌         | 19367/371472 [1:32:14<28:00:18,  3.49it/s]
  5%|▌         | 19368/371472 [1:32:14<29:03:30,  3.37it/s]
  5%|▌         | 19369/371472 [1:32:14<27:49:05,  3.52it/s]
  5%|▌         | 19370/371472 [1:32:14<27:28:55,  3.56it/s]
  5%|▌         | 19371/371472 [1:32:15<27:04:20,  3.61it/s]
  5%|▌         | 19372/371472 [1:32:15<27:18:59,  3.58it/s]
  5%|▌         | 19373/371472 [1:32:15<28:45:01,  3.40it/s]
  5%|▌         | 19374/371472 [1:32:16<29:32:18,  3.31it/s]
  5%|▌         | 19375/371472 [1:32:16<28:03:28,  3.49it/s]
  5%|▌         | 19376/371472 [1:32:16<28:35:48,  3.42it/s]
  5%|▌         | 19377/371472 [1:32:17<33:33:03,  2.92it/s]
  5%|▌         | 19378/371472 [1:32:17<33:25:24,  2.93it/s]
  5%|▌         | 19379/371472 [1:32:17<32:15:06,  3.03it/s]
  5%|▌         | 19380/371472 [1:32:18<30:45:49,  3.18it/s]
                                                           
{'loss': 4.4227, 'learning_rate': 9.535057855157404e-07, 'epoch': 0.83}

  5%|▌         | 19380/371472 [1:32:18<30:45:49,  3.18it/s]
  5%|▌         | 19381/371472 [1:32:18<30:02:20,  3.26it/s]
  5%|▌         | 19382/371472 [1:32:18<28:53:36,  3.38it/s]
  5%|▌         | 19383/371472 [1:32:18<28:17:33,  3.46it/s]
  5%|▌         | 19384/371472 [1:32:19<27:46:58,  3.52it/s]
  5%|▌         | 19385/371472 [1:32:19<28:26:01,  3.44it/s]
  5%|▌         | 19386/371472 [1:32:19<28:59:07,  3.37it/s]
  5%|▌         | 19387/371472 [1:32:20<30:15:29,  3.23it/s]
  5%|▌         | 19388/371472 [1:32:20<28:47:48,  3.40it/s]
  5%|▌         | 19389/371472 [1:32:20<27:14:02,  3.59it/s]
  5%|▌         | 19390/371472 [1:32:20<26:24:47,  3.70it/s]
  5%|▌         | 19391/371472 [1:32:21<26:32:22,  3.69it/s]
  5%|▌         | 19392/371472 [1:32:21<27:02:45,  3.62it/s]
  5%|▌         | 19393/371472 [1:32:21<28:24:46,  3.44it/s]
  5%|▌         | 19394/371472 [1:32:22<27:49:10,  3.52it/s]
  5%|▌         | 19395/371472 [1:32:22<26:59:15,  3.62it/s]
  5%|▌         | 19396/371472 [1:32:22<26:14:21,  3.73it/s]
  5%|▌         | 19397/371472 [1:32:22<25:53:46,  3.78it/s]
  5%|▌         | 19398/371472 [1:32:23<26:10:14,  3.74it/s]
  5%|▌         | 19399/371472 [1:32:23<25:54:26,  3.77it/s]
  5%|▌         | 19400/371472 [1:32:23<27:35:52,  3.54it/s]
                                                           
{'loss': 4.6791, 'learning_rate': 9.534573035402615e-07, 'epoch': 0.84}

  5%|▌         | 19400/371472 [1:32:23<27:35:52,  3.54it/s]
  5%|▌         | 19401/371472 [1:32:23<27:12:43,  3.59it/s]
  5%|▌         | 19402/371472 [1:32:24<27:37:20,  3.54it/s]
  5%|▌         | 19403/371472 [1:32:24<26:51:43,  3.64it/s]
  5%|▌         | 19404/371472 [1:32:24<27:33:20,  3.55it/s]
  5%|▌         | 19405/371472 [1:32:25<26:59:43,  3.62it/s]
  5%|▌         | 19406/371472 [1:32:25<26:59:24,  3.62it/s]
  5%|▌         | 19407/371472 [1:32:25<27:13:00,  3.59it/s]
  5%|▌         | 19408/371472 [1:32:25<28:09:22,  3.47it/s]
  5%|▌         | 19409/371472 [1:32:26<28:08:47,  3.47it/s]
  5%|▌         | 19410/371472 [1:32:26<28:14:43,  3.46it/s]
  5%|▌         | 19411/371472 [1:32:26<27:44:02,  3.53it/s]
  5%|▌         | 19412/371472 [1:32:27<28:16:13,  3.46it/s]
  5%|▌         | 19413/371472 [1:32:27<27:58:56,  3.49it/s]
  5%|▌         | 19414/371472 [1:32:27<26:59:16,  3.62it/s]
  5%|▌         | 19415/371472 [1:32:27<26:20:28,  3.71it/s]
  5%|▌         | 19416/371472 [1:32:28<26:07:10,  3.74it/s]
  5%|▌         | 19417/371472 [1:32:28<25:38:19,  3.81it/s]
  5%|▌         | 19418/371472 [1:32:28<25:57:17,  3.77it/s]
  5%|▌         | 19419/371472 [1:32:28<26:34:06,  3.68it/s]
  5%|▌         | 19420/371472 [1:32:29<25:55:22,  3.77it/s]
                                                           
{'loss': 4.5265, 'learning_rate': 9.534088215647826e-07, 'epoch': 0.84}

  5%|▌         | 19420/371472 [1:32:29<25:55:22,  3.77it/s]
  5%|▌         | 19421/371472 [1:32:29<27:57:37,  3.50it/s]
  5%|▌         | 19422/371472 [1:32:29<27:15:40,  3.59it/s]
  5%|▌         | 19423/371472 [1:32:30<27:05:20,  3.61it/s]
  5%|▌         | 19424/371472 [1:32:30<27:26:41,  3.56it/s]
  5%|▌         | 19425/371472 [1:32:30<26:46:25,  3.65it/s]
  5%|▌         | 19426/371472 [1:32:30<26:23:23,  3.71it/s]
  5%|▌         | 19427/371472 [1:32:31<26:24:47,  3.70it/s]
  5%|▌         | 19428/371472 [1:32:31<27:26:11,  3.56it/s]
  5%|▌         | 19429/371472 [1:32:31<27:18:43,  3.58it/s]
  5%|▌         | 19430/371472 [1:32:31<26:43:42,  3.66it/s]
  5%|▌         | 19431/371472 [1:32:32<26:45:16,  3.66it/s]
  5%|▌         | 19432/371472 [1:32:32<26:32:34,  3.68it/s]
  5%|▌         | 19433/371472 [1:32:32<26:22:20,  3.71it/s]
  5%|▌         | 19434/371472 [1:32:33<26:14:26,  3.73it/s]
  5%|▌         | 19435/371472 [1:32:33<26:06:16,  3.75it/s]
  5%|▌         | 19436/371472 [1:32:33<26:31:15,  3.69it/s]
  5%|▌         | 19437/371472 [1:32:33<26:47:28,  3.65it/s]
  5%|▌         | 19438/371472 [1:32:34<28:18:29,  3.45it/s]
  5%|▌         | 19439/371472 [1:32:34<29:46:26,  3.28it/s]
  5%|▌         | 19440/371472 [1:32:34<27:53:34,  3.51it/s]
                                                           
{'loss': 4.5809, 'learning_rate': 9.533603395893038e-07, 'epoch': 0.84}

  5%|▌         | 19440/371472 [1:32:34<27:53:34,  3.51it/s]
  5%|▌         | 19441/371472 [1:32:35<28:17:20,  3.46it/s]
  5%|▌         | 19442/371472 [1:32:35<28:15:24,  3.46it/s]
  5%|▌         | 19443/371472 [1:32:35<27:24:51,  3.57it/s]
  5%|▌         | 19444/371472 [1:32:35<26:43:58,  3.66it/s]
  5%|▌         | 19445/371472 [1:32:36<26:21:46,  3.71it/s]
  5%|▌         | 19446/371472 [1:32:36<25:52:03,  3.78it/s]
  5%|▌         | 19447/371472 [1:32:36<26:29:18,  3.69it/s]
  5%|▌         | 19448/371472 [1:32:36<26:12:02,  3.73it/s]
  5%|▌         | 19449/371472 [1:32:37<26:05:50,  3.75it/s]
  5%|▌         | 19450/371472 [1:32:37<26:12:43,  3.73it/s]
  5%|▌         | 19451/371472 [1:32:37<26:13:45,  3.73it/s]
  5%|▌         | 19452/371472 [1:32:38<25:57:33,  3.77it/s]
  5%|▌         | 19453/371472 [1:32:38<26:13:43,  3.73it/s]
  5%|▌         | 19454/371472 [1:32:38<26:15:15,  3.72it/s]
  5%|▌         | 19455/371472 [1:32:38<27:28:58,  3.56it/s]
  5%|▌         | 19456/371472 [1:32:39<27:20:22,  3.58it/s]
  5%|▌         | 19457/371472 [1:32:39<27:20:48,  3.58it/s]
  5%|▌         | 19458/371472 [1:32:39<26:21:46,  3.71it/s]
  5%|▌         | 19459/371472 [1:32:39<27:21:12,  3.57it/s]
  5%|▌         | 19460/371472 [1:32:40<27:08:15,  3.60it/s]
                                                           
{'loss': 4.7335, 'learning_rate': 9.533118576138249e-07, 'epoch': 0.84}

  5%|▌         | 19460/371472 [1:32:40<27:08:15,  3.60it/s]
  5%|▌         | 19461/371472 [1:32:40<27:28:49,  3.56it/s]
  5%|▌         | 19462/371472 [1:32:40<27:01:50,  3.62it/s]
  5%|▌         | 19463/371472 [1:32:41<26:44:29,  3.66it/s]
  5%|▌         | 19464/371472 [1:32:41<28:51:08,  3.39it/s]
  5%|▌         | 19465/371472 [1:32:41<29:51:14,  3.28it/s]
  5%|▌         | 19466/371472 [1:32:41<28:21:45,  3.45it/s]
  5%|▌         | 19467/371472 [1:32:42<28:06:38,  3.48it/s]
  5%|▌         | 19468/371472 [1:32:42<30:01:23,  3.26it/s]
  5%|▌         | 19469/371472 [1:32:42<28:59:18,  3.37it/s]
  5%|▌         | 19470/371472 [1:32:43<28:03:33,  3.48it/s]
  5%|▌         | 19471/371472 [1:32:43<27:52:49,  3.51it/s]
  5%|▌         | 19472/371472 [1:32:43<27:45:26,  3.52it/s]
  5%|▌         | 19473/371472 [1:32:43<27:22:33,  3.57it/s]
  5%|▌         | 19474/371472 [1:32:44<26:54:18,  3.63it/s]
  5%|▌         | 19475/371472 [1:32:44<27:05:30,  3.61it/s]
  5%|▌         | 19476/371472 [1:32:44<27:38:44,  3.54it/s]
  5%|▌         | 19477/371472 [1:32:45<27:16:48,  3.58it/s]
  5%|▌         | 19478/371472 [1:32:45<26:37:41,  3.67it/s]
  5%|▌         | 19479/371472 [1:32:45<26:21:31,  3.71it/s]
  5%|▌         | 19480/371472 [1:32:45<26:45:56,  3.65it/s]
                                                           
{'loss': 4.6606, 'learning_rate': 9.532633756383459e-07, 'epoch': 0.84}

  5%|▌         | 19480/371472 [1:32:45<26:45:56,  3.65it/s]
  5%|▌         | 19481/371472 [1:32:46<26:22:43,  3.71it/s]
  5%|▌         | 19482/371472 [1:32:46<27:57:07,  3.50it/s]
  5%|▌         | 19483/371472 [1:32:46<28:44:09,  3.40it/s]
  5%|▌         | 19484/371472 [1:32:47<27:56:54,  3.50it/s]
  5%|▌         | 19485/371472 [1:32:47<26:59:52,  3.62it/s]
  5%|▌         | 19486/371472 [1:32:47<26:29:02,  3.69it/s]
  5%|▌         | 19487/371472 [1:32:47<25:59:04,  3.76it/s]
  5%|▌         | 19488/371472 [1:32:48<26:29:35,  3.69it/s]
  5%|▌         | 19489/371472 [1:32:48<28:12:58,  3.47it/s]
  5%|▌         | 19490/371472 [1:32:48<27:51:30,  3.51it/s]
  5%|▌         | 19491/371472 [1:32:49<28:34:04,  3.42it/s]
  5%|▌         | 19492/371472 [1:32:49<29:25:01,  3.32it/s]
  5%|▌         | 19493/371472 [1:32:49<28:50:31,  3.39it/s]
  5%|▌         | 19494/371472 [1:32:49<27:53:57,  3.50it/s]
  5%|▌         | 19495/371472 [1:32:50<29:02:33,  3.37it/s]
  5%|▌         | 19496/371472 [1:32:50<28:25:42,  3.44it/s]
  5%|▌         | 19497/371472 [1:32:50<28:23:21,  3.44it/s]
  5%|▌         | 19498/371472 [1:32:51<29:53:23,  3.27it/s]
  5%|▌         | 19499/371472 [1:32:51<31:36:43,  3.09it/s]
  5%|▌         | 19500/371472 [1:32:51<33:44:56,  2.90it/s]
                                                           
{'loss': 4.5205, 'learning_rate': 9.532148936628671e-07, 'epoch': 0.84}

  5%|▌         | 19500/371472 [1:32:51<33:44:56,  2.90it/s]
  5%|▌         | 19501/371472 [1:32:52<32:11:16,  3.04it/s]
  5%|▌         | 19502/371472 [1:32:52<30:15:26,  3.23it/s]
  5%|▌         | 19503/371472 [1:32:52<29:58:47,  3.26it/s]
  5%|▌         | 19504/371472 [1:32:53<30:00:57,  3.26it/s]
  5%|▌         | 19505/371472 [1:32:53<28:58:08,  3.37it/s]
  5%|▌         | 19506/371472 [1:32:53<28:39:31,  3.41it/s]
  5%|▌         | 19507/371472 [1:32:53<29:50:54,  3.28it/s]
  5%|▌         | 19508/371472 [1:32:54<31:05:19,  3.14it/s]
  5%|▌         | 19509/371472 [1:32:54<29:24:01,  3.33it/s]
  5%|▌         | 19510/371472 [1:32:54<29:26:00,  3.32it/s]
  5%|▌         | 19511/371472 [1:32:55<27:58:24,  3.50it/s]
  5%|▌         | 19512/371472 [1:32:55<30:16:48,  3.23it/s]
  5%|▌         | 19513/371472 [1:32:55<28:52:55,  3.39it/s]
  5%|▌         | 19514/371472 [1:32:56<28:06:35,  3.48it/s]
  5%|▌         | 19515/371472 [1:32:56<27:01:36,  3.62it/s]
  5%|▌         | 19516/371472 [1:32:56<26:10:22,  3.74it/s]
  5%|▌         | 19517/371472 [1:32:56<25:57:30,  3.77it/s]
  5%|▌         | 19518/371472 [1:32:57<25:55:45,  3.77it/s]
  5%|▌         | 19519/371472 [1:32:57<26:28:29,  3.69it/s]
  5%|▌         | 19520/371472 [1:32:57<27:22:50,  3.57it/s]
                                                           
{'loss': 4.6531, 'learning_rate': 9.531664116873882e-07, 'epoch': 0.84}

  5%|▌         | 19520/371472 [1:32:57<27:22:50,  3.57it/s]
  5%|▌         | 19521/371472 [1:32:57<27:39:29,  3.53it/s]
  5%|▌         | 19522/371472 [1:32:58<27:41:53,  3.53it/s]
  5%|▌         | 19523/371472 [1:32:58<28:49:52,  3.39it/s]
  5%|▌         | 19524/371472 [1:32:58<28:46:41,  3.40it/s]
  5%|▌         | 19525/371472 [1:32:59<30:16:27,  3.23it/s]
  5%|▌         | 19526/371472 [1:32:59<28:53:20,  3.38it/s]
  5%|▌         | 19527/371472 [1:32:59<28:03:21,  3.48it/s]
  5%|▌         | 19528/371472 [1:32:59<27:27:47,  3.56it/s]
  5%|▌         | 19529/371472 [1:33:00<26:54:29,  3.63it/s]
  5%|▌         | 19530/371472 [1:33:00<26:17:34,  3.72it/s]
  5%|▌         | 19531/371472 [1:33:00<26:09:04,  3.74it/s]
  5%|▌         | 19532/371472 [1:33:01<26:27:27,  3.70it/s]
  5%|▌         | 19533/371472 [1:33:01<25:51:46,  3.78it/s]
  5%|▌         | 19534/371472 [1:33:01<26:01:51,  3.76it/s]
  5%|▌         | 19535/371472 [1:33:01<27:02:05,  3.62it/s]
  5%|▌         | 19536/371472 [1:33:02<26:07:05,  3.74it/s]
  5%|▌         | 19537/371472 [1:33:02<25:51:52,  3.78it/s]
  5%|▌         | 19538/371472 [1:33:02<26:31:17,  3.69it/s]
  5%|▌         | 19539/371472 [1:33:02<26:26:40,  3.70it/s]
  5%|▌         | 19540/371472 [1:33:03<26:33:23,  3.68it/s]
                                                           
{'loss': 4.7872, 'learning_rate': 9.531179297119093e-07, 'epoch': 0.84}

  5%|▌         | 19540/371472 [1:33:03<26:33:23,  3.68it/s]
  5%|▌         | 19541/371472 [1:33:03<27:35:29,  3.54it/s]
  5%|▌         | 19542/371472 [1:33:03<27:05:55,  3.61it/s]
  5%|▌         | 19543/371472 [1:33:03<26:23:17,  3.70it/s]
  5%|▌         | 19544/371472 [1:33:04<25:31:09,  3.83it/s]
  5%|▌         | 19545/371472 [1:33:04<26:06:20,  3.74it/s]
  5%|▌         | 19546/371472 [1:33:04<26:07:28,  3.74it/s]
  5%|▌         | 19547/371472 [1:33:05<26:45:27,  3.65it/s]
  5%|▌         | 19548/371472 [1:33:05<27:08:29,  3.60it/s]
  5%|▌         | 19549/371472 [1:33:05<27:25:44,  3.56it/s]
  5%|▌         | 19550/371472 [1:33:05<27:31:11,  3.55it/s]
  5%|▌         | 19551/371472 [1:33:06<27:38:22,  3.54it/s]
  5%|▌         | 19552/371472 [1:33:06<27:02:23,  3.62it/s]
  5%|▌         | 19553/371472 [1:33:06<27:21:36,  3.57it/s]
  5%|▌         | 19554/371472 [1:33:07<26:56:39,  3.63it/s]
  5%|▌         | 19555/371472 [1:33:07<27:18:54,  3.58it/s]
  5%|▌         | 19556/371472 [1:33:07<26:25:04,  3.70it/s]
  5%|▌         | 19557/371472 [1:33:07<26:10:45,  3.73it/s]
  5%|▌         | 19558/371472 [1:33:08<27:45:16,  3.52it/s]
  5%|▌         | 19559/371472 [1:33:08<27:28:39,  3.56it/s]
  5%|▌         | 19560/371472 [1:33:08<27:38:20,  3.54it/s]
                                                           
{'loss': 4.4518, 'learning_rate': 9.530694477364304e-07, 'epoch': 0.84}

  5%|▌         | 19560/371472 [1:33:08<27:38:20,  3.54it/s]
  5%|▌         | 19561/371472 [1:33:09<28:01:28,  3.49it/s]
  5%|▌         | 19562/371472 [1:33:09<29:42:15,  3.29it/s]
  5%|▌         | 19563/371472 [1:33:09<28:32:04,  3.43it/s]
  5%|▌         | 19564/371472 [1:33:09<27:41:49,  3.53it/s]
  5%|▌         | 19565/371472 [1:33:10<27:20:37,  3.57it/s]
  5%|▌         | 19566/371472 [1:33:10<28:01:50,  3.49it/s]
  5%|▌         | 19567/371472 [1:33:10<27:07:56,  3.60it/s]
  5%|▌         | 19568/371472 [1:33:10<26:20:56,  3.71it/s]
  5%|▌         | 19569/371472 [1:33:11<26:46:19,  3.65it/s]
  5%|▌         | 19570/371472 [1:33:11<27:13:04,  3.59it/s]
  5%|▌         | 19571/371472 [1:33:11<26:37:59,  3.67it/s]
  5%|▌         | 19572/371472 [1:33:12<26:16:44,  3.72it/s]
  5%|▌         | 19573/371472 [1:33:12<28:11:03,  3.47it/s]
  5%|▌         | 19574/371472 [1:33:12<29:13:31,  3.34it/s]
  5%|▌         | 19575/371472 [1:33:13<30:59:52,  3.15it/s]
  5%|▌         | 19576/371472 [1:33:13<30:15:08,  3.23it/s]
  5%|▌         | 19577/371472 [1:33:13<28:59:10,  3.37it/s]
  5%|▌         | 19578/371472 [1:33:13<27:50:12,  3.51it/s]
  5%|▌         | 19579/371472 [1:33:14<30:57:14,  3.16it/s]
  5%|▌         | 19580/371472 [1:33:14<29:25:12,  3.32it/s]
                                                           
{'loss': 4.4122, 'learning_rate': 9.530209657609516e-07, 'epoch': 0.84}

  5%|▌         | 19580/371472 [1:33:14<29:25:12,  3.32it/s]
  5%|▌         | 19581/371472 [1:33:14<30:36:29,  3.19it/s]
  5%|▌         | 19582/371472 [1:33:15<29:56:37,  3.26it/s]
  5%|▌         | 19583/371472 [1:33:15<28:38:11,  3.41it/s]
  5%|▌         | 19584/371472 [1:33:15<27:57:49,  3.50it/s]
  5%|▌         | 19585/371472 [1:33:15<26:51:15,  3.64it/s]
  5%|▌         | 19586/371472 [1:33:16<26:10:05,  3.74it/s]
  5%|▌         | 19587/371472 [1:33:16<25:37:54,  3.81it/s]
  5%|▌         | 19588/371472 [1:33:16<25:14:11,  3.87it/s]
  5%|▌         | 19589/371472 [1:33:17<27:23:44,  3.57it/s]
  5%|▌         | 19590/371472 [1:33:17<27:35:47,  3.54it/s]
  5%|▌         | 19591/371472 [1:33:17<27:51:00,  3.51it/s]
  5%|▌         | 19592/371472 [1:33:17<27:22:50,  3.57it/s]
  5%|▌         | 19593/371472 [1:33:18<27:41:10,  3.53it/s]
  5%|▌         | 19594/371472 [1:33:18<28:00:40,  3.49it/s]
  5%|▌         | 19595/371472 [1:33:18<28:15:03,  3.46it/s]
  5%|▌         | 19596/371472 [1:33:19<28:12:32,  3.46it/s]
  5%|▌         | 19597/371472 [1:33:19<27:45:27,  3.52it/s]
  5%|▌         | 19598/371472 [1:33:19<29:14:55,  3.34it/s]
  5%|▌         | 19599/371472 [1:33:19<28:35:45,  3.42it/s]
  5%|▌         | 19600/371472 [1:33:20<27:28:28,  3.56it/s]
                                                           
{'loss': 4.6403, 'learning_rate': 9.529724837854727e-07, 'epoch': 0.84}

  5%|▌         | 19600/371472 [1:33:20<27:28:28,  3.56it/s]
  5%|▌         | 19601/371472 [1:33:20<28:15:25,  3.46it/s]
  5%|▌         | 19602/371472 [1:33:20<27:38:16,  3.54it/s]
  5%|▌         | 19603/371472 [1:33:21<27:31:00,  3.55it/s]
  5%|▌         | 19604/371472 [1:33:21<27:07:42,  3.60it/s]
  5%|▌         | 19605/371472 [1:33:21<27:47:51,  3.52it/s]
  5%|▌         | 19606/371472 [1:33:21<27:02:59,  3.61it/s]
  5%|▌         | 19607/371472 [1:33:22<26:52:15,  3.64it/s]
  5%|▌         | 19608/371472 [1:33:22<26:15:55,  3.72it/s]
  5%|▌         | 19609/371472 [1:33:22<25:43:29,  3.80it/s]
  5%|▌         | 19610/371472 [1:33:22<26:05:31,  3.75it/s]
  5%|▌         | 19611/371472 [1:33:23<27:40:14,  3.53it/s]
  5%|▌         | 19612/371472 [1:33:23<27:47:05,  3.52it/s]
  5%|▌         | 19613/371472 [1:33:23<26:56:53,  3.63it/s]
  5%|▌         | 19614/371472 [1:33:24<26:36:24,  3.67it/s]
  5%|▌         | 19615/371472 [1:33:24<26:34:28,  3.68it/s]
  5%|▌         | 19616/371472 [1:33:24<26:09:48,  3.74it/s]
  5%|▌         | 19617/371472 [1:33:24<25:59:45,  3.76it/s]
  5%|▌         | 19618/371472 [1:33:25<26:56:13,  3.63it/s]
  5%|▌         | 19619/371472 [1:33:25<25:59:31,  3.76it/s]
  5%|▌         | 19620/371472 [1:33:25<25:55:27,  3.77it/s]
                                                           
{'loss': 4.6208, 'learning_rate': 9.529240018099936e-07, 'epoch': 0.85}

  5%|▌         | 19620/371472 [1:33:25<25:55:27,  3.77it/s]
  5%|▌         | 19621/371472 [1:33:25<25:58:10,  3.76it/s]
  5%|▌         | 19622/371472 [1:33:26<26:23:18,  3.70it/s]
  5%|▌         | 19623/371472 [1:33:26<26:07:05,  3.74it/s]
  5%|▌         | 19624/371472 [1:33:26<26:10:06,  3.73it/s]
  5%|▌         | 19625/371472 [1:33:26<26:02:55,  3.75it/s]
  5%|▌         | 19626/371472 [1:33:27<27:07:19,  3.60it/s]
  5%|▌         | 19627/371472 [1:33:27<27:12:22,  3.59it/s]
  5%|▌         | 19628/371472 [1:33:27<28:08:51,  3.47it/s]
  5%|▌         | 19629/371472 [1:33:28<30:11:46,  3.24it/s]
  5%|▌         | 19630/371472 [1:33:28<30:50:27,  3.17it/s]
  5%|▌         | 19631/371472 [1:33:28<29:23:40,  3.32it/s]
  5%|▌         | 19632/371472 [1:33:29<28:09:37,  3.47it/s]
  5%|▌         | 19633/371472 [1:33:29<28:04:46,  3.48it/s]
  5%|▌         | 19634/371472 [1:33:29<26:54:23,  3.63it/s]
  5%|▌         | 19635/371472 [1:33:29<26:08:00,  3.74it/s]
  5%|▌         | 19636/371472 [1:33:30<26:13:35,  3.73it/s]
  5%|▌         | 19637/371472 [1:33:30<29:15:20,  3.34it/s]
  5%|▌         | 19638/371472 [1:33:30<27:46:47,  3.52it/s]
  5%|▌         | 19639/371472 [1:33:31<27:17:32,  3.58it/s]
  5%|▌         | 19640/371472 [1:33:31<29:06:15,  3.36it/s]
                                                           
{'loss': 4.6772, 'learning_rate': 9.528755198345148e-07, 'epoch': 0.85}

  5%|▌         | 19640/371472 [1:33:31<29:06:15,  3.36it/s]
  5%|▌         | 19641/371472 [1:33:31<29:23:03,  3.33it/s]
  5%|▌         | 19642/371472 [1:33:31<28:41:59,  3.41it/s]
  5%|▌         | 19643/371472 [1:33:32<29:19:16,  3.33it/s]
  5%|▌         | 19644/371472 [1:33:32<28:56:05,  3.38it/s]
  5%|▌         | 19645/371472 [1:33:32<27:46:59,  3.52it/s]
  5%|▌         | 19646/371472 [1:33:33<27:17:09,  3.58it/s]
  5%|▌         | 19647/371472 [1:33:33<26:49:36,  3.64it/s]
  5%|▌         | 19648/371472 [1:33:33<26:46:57,  3.65it/s]
  5%|▌         | 19649/371472 [1:33:33<27:28:34,  3.56it/s]
  5%|▌         | 19650/371472 [1:33:34<28:21:34,  3.45it/s]
  5%|▌         | 19651/371472 [1:33:34<27:14:30,  3.59it/s]
  5%|▌         | 19652/371472 [1:33:34<27:00:45,  3.62it/s]
  5%|▌         | 19653/371472 [1:33:35<27:29:38,  3.55it/s]
  5%|▌         | 19654/371472 [1:33:35<27:34:27,  3.54it/s]
  5%|▌         | 19655/371472 [1:33:35<30:10:38,  3.24it/s]
  5%|▌         | 19656/371472 [1:33:35<28:12:51,  3.46it/s]
  5%|▌         | 19657/371472 [1:33:36<29:58:33,  3.26it/s]
  5%|▌         | 19658/371472 [1:33:36<30:06:07,  3.25it/s]
  5%|▌         | 19659/371472 [1:33:36<30:58:15,  3.16it/s]
  5%|▌         | 19660/371472 [1:33:37<30:39:23,  3.19it/s]
                                                           
{'loss': 4.2239, 'learning_rate': 9.528270378590359e-07, 'epoch': 0.85}

  5%|▌         | 19660/371472 [1:33:37<30:39:23,  3.19it/s]
  5%|▌         | 19661/371472 [1:33:37<33:46:47,  2.89it/s]
  5%|▌         | 19662/371472 [1:33:37<31:22:35,  3.11it/s]
  5%|▌         | 19663/371472 [1:33:38<30:42:54,  3.18it/s]
  5%|▌         | 19664/371472 [1:33:38<29:35:37,  3.30it/s]
  5%|▌         | 19665/371472 [1:33:38<30:44:27,  3.18it/s]
  5%|▌         | 19666/371472 [1:33:39<28:55:39,  3.38it/s]
  5%|▌         | 19667/371472 [1:33:39<27:31:40,  3.55it/s]
  5%|▌         | 19668/371472 [1:33:39<26:57:18,  3.63it/s]
  5%|▌         | 19669/371472 [1:33:39<26:39:07,  3.67it/s]
  5%|▌         | 19670/371472 [1:33:40<26:17:23,  3.72it/s]
  5%|▌         | 19671/371472 [1:33:40<28:05:51,  3.48it/s]
  5%|▌         | 19672/371472 [1:33:40<28:05:23,  3.48it/s]
  5%|▌         | 19673/371472 [1:33:41<27:19:14,  3.58it/s]
  5%|▌         | 19674/371472 [1:33:41<26:16:14,  3.72it/s]
  5%|▌         | 19675/371472 [1:33:41<26:25:02,  3.70it/s]
  5%|▌         | 19676/371472 [1:33:41<28:37:28,  3.41it/s]
  5%|▌         | 19677/371472 [1:33:42<27:25:11,  3.56it/s]
  5%|▌         | 19678/371472 [1:33:42<26:43:33,  3.66it/s]
  5%|▌         | 19679/371472 [1:33:42<26:54:36,  3.63it/s]
  5%|▌         | 19680/371472 [1:33:42<28:25:32,  3.44it/s]
                                                           
{'loss': 4.4615, 'learning_rate': 9.52778555883557e-07, 'epoch': 0.85}

  5%|▌         | 19680/371472 [1:33:42<28:25:32,  3.44it/s]
  5%|▌         | 19681/371472 [1:33:43<28:14:22,  3.46it/s]
  5%|▌         | 19682/371472 [1:33:43<27:57:06,  3.50it/s]
  5%|▌         | 19683/371472 [1:33:43<27:18:56,  3.58it/s]
  5%|▌         | 19684/371472 [1:33:44<27:08:24,  3.60it/s]
  5%|▌         | 19685/371472 [1:33:44<27:15:19,  3.59it/s]
  5%|▌         | 19686/371472 [1:33:44<27:01:34,  3.62it/s]
  5%|▌         | 19687/371472 [1:33:44<27:16:32,  3.58it/s]
  5%|▌         | 19688/371472 [1:33:45<27:24:43,  3.56it/s]
  5%|▌         | 19689/371472 [1:33:45<28:15:44,  3.46it/s]
  5%|▌         | 19690/371472 [1:33:45<28:41:07,  3.41it/s]
  5%|▌         | 19691/371472 [1:33:46<29:37:05,  3.30it/s]
  5%|▌         | 19692/371472 [1:33:46<30:34:33,  3.20it/s]
  5%|▌         | 19693/371472 [1:33:46<30:25:24,  3.21it/s]
  5%|▌         | 19694/371472 [1:33:47<28:58:31,  3.37it/s]
  5%|▌         | 19695/371472 [1:33:47<28:32:52,  3.42it/s]
  5%|▌         | 19696/371472 [1:33:47<29:34:09,  3.30it/s]
  5%|▌         | 19697/371472 [1:33:47<29:57:21,  3.26it/s]
  5%|▌         | 19698/371472 [1:33:48<30:01:23,  3.25it/s]
  5%|▌         | 19699/371472 [1:33:48<29:36:16,  3.30it/s]
  5%|▌         | 19700/371472 [1:33:48<28:50:13,  3.39it/s]
                                                           
{'loss': 4.4219, 'learning_rate': 9.527300739080781e-07, 'epoch': 0.85}

  5%|▌         | 19700/371472 [1:33:48<28:50:13,  3.39it/s]
  5%|▌         | 19701/371472 [1:33:49<30:05:42,  3.25it/s]
  5%|▌         | 19702/371472 [1:33:49<28:05:53,  3.48it/s]
  5%|▌         | 19703/371472 [1:33:49<27:54:17,  3.50it/s]
  5%|▌         | 19704/371472 [1:33:49<27:23:12,  3.57it/s]
  5%|▌         | 19705/371472 [1:33:50<28:14:37,  3.46it/s]
  5%|▌         | 19706/371472 [1:33:50<29:00:53,  3.37it/s]
  5%|▌         | 19707/371472 [1:33:50<29:03:05,  3.36it/s]
  5%|▌         | 19708/371472 [1:33:51<28:34:16,  3.42it/s]
  5%|▌         | 19709/371472 [1:33:51<28:22:47,  3.44it/s]
  5%|▌         | 19710/371472 [1:33:51<27:56:19,  3.50it/s]
  5%|▌         | 19711/371472 [1:33:51<26:47:22,  3.65it/s]
  5%|▌         | 19712/371472 [1:33:52<27:48:37,  3.51it/s]
  5%|▌         | 19713/371472 [1:33:52<27:43:33,  3.52it/s]
  5%|▌         | 19714/371472 [1:33:52<29:10:48,  3.35it/s]
  5%|▌         | 19715/371472 [1:33:53<27:31:22,  3.55it/s]
  5%|▌         | 19716/371472 [1:33:53<27:33:18,  3.55it/s]
  5%|▌         | 19717/371472 [1:33:53<26:28:28,  3.69it/s]
  5%|▌         | 19718/371472 [1:33:53<27:02:03,  3.61it/s]
  5%|▌         | 19719/371472 [1:33:54<26:23:24,  3.70it/s]
  5%|▌         | 19720/371472 [1:33:54<26:21:42,  3.71it/s]
                                                           
{'loss': 4.5251, 'learning_rate': 9.526815919325993e-07, 'epoch': 0.85}

  5%|▌         | 19720/371472 [1:33:54<26:21:42,  3.71it/s]
  5%|▌         | 19721/371472 [1:33:54<29:58:32,  3.26it/s]
  5%|▌         | 19722/371472 [1:33:55<28:15:24,  3.46it/s]
  5%|▌         | 19723/371472 [1:33:55<26:59:18,  3.62it/s]
  5%|▌         | 19724/371472 [1:33:55<27:04:40,  3.61it/s]
  5%|▌         | 19725/371472 [1:33:55<26:41:51,  3.66it/s]
  5%|▌         | 19726/371472 [1:33:56<29:57:28,  3.26it/s]
  5%|▌         | 19727/371472 [1:33:56<29:31:59,  3.31it/s]
  5%|▌         | 19728/371472 [1:33:56<31:57:15,  3.06it/s]
  5%|▌         | 19729/371472 [1:33:57<30:45:53,  3.18it/s]
  5%|▌         | 19730/371472 [1:33:57<28:43:00,  3.40it/s]
  5%|▌         | 19731/371472 [1:33:57<29:38:17,  3.30it/s]
  5%|▌         | 19732/371472 [1:33:58<28:29:16,  3.43it/s]
  5%|▌         | 19733/371472 [1:33:58<28:09:41,  3.47it/s]
  5%|▌         | 19734/371472 [1:33:58<29:11:41,  3.35it/s]
  5%|▌         | 19735/371472 [1:33:59<28:48:50,  3.39it/s]
  5%|▌         | 19736/371472 [1:33:59<28:26:10,  3.44it/s]
  5%|▌         | 19737/371472 [1:33:59<27:43:02,  3.53it/s]
  5%|▌         | 19738/371472 [1:33:59<28:34:25,  3.42it/s]
  5%|▌         | 19739/371472 [1:34:00<27:48:12,  3.51it/s]
  5%|▌         | 19740/371472 [1:34:00<27:28:16,  3.56it/s]
                                                           
{'loss': 4.4332, 'learning_rate': 9.526331099571202e-07, 'epoch': 0.85}

  5%|▌         | 19740/371472 [1:34:00<27:28:16,  3.56it/s]
  5%|▌         | 19741/371472 [1:34:00<27:45:21,  3.52it/s]
  5%|▌         | 19742/371472 [1:34:01<30:03:01,  3.25it/s]
  5%|▌         | 19743/371472 [1:34:01<28:35:04,  3.42it/s]
  5%|▌         | 19744/371472 [1:34:01<27:57:43,  3.49it/s]
  5%|▌         | 19745/371472 [1:34:01<27:39:54,  3.53it/s]
  5%|▌         | 19746/371472 [1:34:02<26:35:53,  3.67it/s]
  5%|▌         | 19747/371472 [1:34:02<26:28:05,  3.69it/s]
  5%|▌         | 19748/371472 [1:34:02<26:35:44,  3.67it/s]
  5%|▌         | 19749/371472 [1:34:02<27:23:47,  3.57it/s]
  5%|▌         | 19750/371472 [1:34:03<28:36:38,  3.41it/s]
  5%|▌         | 19751/371472 [1:34:03<29:33:02,  3.31it/s]
  5%|▌         | 19752/371472 [1:34:03<29:07:32,  3.35it/s]
  5%|▌         | 19753/371472 [1:34:04<27:45:02,  3.52it/s]
  5%|▌         | 19754/371472 [1:34:04<27:30:53,  3.55it/s]
  5%|▌         | 19755/371472 [1:34:04<28:00:24,  3.49it/s]
  5%|▌         | 19756/371472 [1:34:04<27:23:02,  3.57it/s]
  5%|▌         | 19757/371472 [1:34:05<27:38:16,  3.53it/s]
  5%|▌         | 19758/371472 [1:34:05<29:34:14,  3.30it/s]
  5%|▌         | 19759/371472 [1:34:05<28:55:44,  3.38it/s]
  5%|▌         | 19760/371472 [1:34:06<27:41:13,  3.53it/s]
                                                           
{'loss': 4.7348, 'learning_rate': 9.525846279816414e-07, 'epoch': 0.85}

  5%|▌         | 19760/371472 [1:34:06<27:41:13,  3.53it/s]
  5%|▌         | 19761/371472 [1:34:06<27:15:04,  3.59it/s]
  5%|▌         | 19762/371472 [1:34:06<27:08:27,  3.60it/s]
  5%|▌         | 19763/371472 [1:34:07<28:58:07,  3.37it/s]
  5%|▌         | 19764/371472 [1:34:07<28:48:31,  3.39it/s]
  5%|▌         | 19765/371472 [1:34:07<28:47:33,  3.39it/s]
  5%|▌         | 19766/371472 [1:34:07<28:57:31,  3.37it/s]
  5%|▌         | 19767/371472 [1:34:08<27:19:18,  3.58it/s]
  5%|▌         | 19768/371472 [1:34:08<27:54:24,  3.50it/s]
  5%|▌         | 19769/371472 [1:34:08<27:11:29,  3.59it/s]
  5%|▌         | 19770/371472 [1:34:08<27:04:07,  3.61it/s]
  5%|▌         | 19771/371472 [1:34:09<28:37:15,  3.41it/s]
  5%|▌         | 19772/371472 [1:34:09<28:28:53,  3.43it/s]
  5%|▌         | 19773/371472 [1:34:09<28:03:31,  3.48it/s]
  5%|▌         | 19774/371472 [1:34:10<29:26:06,  3.32it/s]
  5%|▌         | 19775/371472 [1:34:10<30:28:17,  3.21it/s]
  5%|▌         | 19776/371472 [1:34:10<30:15:21,  3.23it/s]
  5%|▌         | 19777/371472 [1:34:11<28:53:38,  3.38it/s]
  5%|▌         | 19778/371472 [1:34:11<27:12:47,  3.59it/s]
  5%|▌         | 19779/371472 [1:34:11<27:28:10,  3.56it/s]
  5%|▌         | 19780/371472 [1:34:12<29:42:51,  3.29it/s]
                                                           
{'loss': 4.4744, 'learning_rate': 9.525361460061625e-07, 'epoch': 0.85}

  5%|▌         | 19780/371472 [1:34:12<29:42:51,  3.29it/s]
  5%|▌         | 19781/371472 [1:34:12<29:00:13,  3.37it/s]
  5%|▌         | 19782/371472 [1:34:12<28:08:40,  3.47it/s]
  5%|▌         | 19783/371472 [1:34:12<26:58:35,  3.62it/s]
  5%|▌         | 19784/371472 [1:34:13<26:46:28,  3.65it/s]
  5%|▌         | 19785/371472 [1:34:13<28:23:33,  3.44it/s]
  5%|▌         | 19786/371472 [1:34:13<31:02:49,  3.15it/s]
  5%|▌         | 19787/371472 [1:34:14<30:37:58,  3.19it/s]
  5%|▌         | 19788/371472 [1:34:14<29:16:17,  3.34it/s]
  5%|▌         | 19789/371472 [1:34:14<27:47:02,  3.52it/s]
  5%|▌         | 19790/371472 [1:34:14<26:57:35,  3.62it/s]
  5%|▌         | 19791/371472 [1:34:15<27:50:55,  3.51it/s]
  5%|▌         | 19792/371472 [1:34:15<27:35:32,  3.54it/s]
  5%|▌         | 19793/371472 [1:34:15<28:12:33,  3.46it/s]
  5%|▌         | 19794/371472 [1:34:16<27:35:51,  3.54it/s]
  5%|▌         | 19795/371472 [1:34:16<26:45:37,  3.65it/s]
  5%|▌         | 19796/371472 [1:34:16<26:57:27,  3.62it/s]
  5%|▌         | 19797/371472 [1:34:16<27:03:29,  3.61it/s]
  5%|▌         | 19798/371472 [1:34:17<27:30:55,  3.55it/s]
  5%|▌         | 19799/371472 [1:34:17<26:56:19,  3.63it/s]
  5%|▌         | 19800/371472 [1:34:17<26:43:12,  3.66it/s]
                                                           
{'loss': 4.482, 'learning_rate': 9.524876640306837e-07, 'epoch': 0.85}

  5%|▌         | 19800/371472 [1:34:17<26:43:12,  3.66it/s]
  5%|▌         | 19801/371472 [1:34:17<28:13:01,  3.46it/s]
  5%|▌         | 19802/371472 [1:34:18<27:54:41,  3.50it/s]
  5%|▌         | 19803/371472 [1:34:18<27:11:39,  3.59it/s]
  5%|▌         | 19804/371472 [1:34:18<27:59:48,  3.49it/s]
  5%|▌         | 19805/371472 [1:34:19<28:32:52,  3.42it/s]
  5%|▌         | 19806/371472 [1:34:19<27:47:04,  3.52it/s]
  5%|▌         | 19807/371472 [1:34:19<28:15:30,  3.46it/s]
  5%|▌         | 19808/371472 [1:34:19<27:32:31,  3.55it/s]
  5%|▌         | 19809/371472 [1:34:20<27:26:28,  3.56it/s]
  5%|▌         | 19810/371472 [1:34:20<28:13:52,  3.46it/s]
  5%|▌         | 19811/371472 [1:34:20<30:03:05,  3.25it/s]
  5%|▌         | 19812/371472 [1:34:21<28:30:07,  3.43it/s]
  5%|▌         | 19813/371472 [1:34:21<27:42:06,  3.53it/s]
  5%|▌         | 19814/371472 [1:34:21<27:39:04,  3.53it/s]
  5%|▌         | 19815/371472 [1:34:21<27:07:14,  3.60it/s]
  5%|▌         | 19816/371472 [1:34:22<26:22:05,  3.70it/s]
  5%|▌         | 19817/371472 [1:34:22<26:32:36,  3.68it/s]
  5%|▌         | 19818/371472 [1:34:22<27:51:26,  3.51it/s]
  5%|▌         | 19819/371472 [1:34:23<26:51:27,  3.64it/s]
  5%|▌         | 19820/371472 [1:34:23<27:00:55,  3.62it/s]
                                                           
{'loss': 4.6764, 'learning_rate': 9.524391820552048e-07, 'epoch': 0.85}

  5%|▌         | 19820/371472 [1:34:23<27:00:55,  3.62it/s]
  5%|▌         | 19821/371472 [1:34:23<27:55:54,  3.50it/s]
  5%|▌         | 19822/371472 [1:34:23<28:34:55,  3.42it/s]
  5%|▌         | 19823/371472 [1:34:24<28:41:10,  3.41it/s]
  5%|▌         | 19824/371472 [1:34:24<27:37:08,  3.54it/s]
  5%|▌         | 19825/371472 [1:34:24<28:28:42,  3.43it/s]
  5%|▌         | 19826/371472 [1:34:25<28:02:42,  3.48it/s]
  5%|▌         | 19827/371472 [1:34:25<27:58:47,  3.49it/s]
  5%|▌         | 19828/371472 [1:34:25<27:52:15,  3.50it/s]
  5%|▌         | 19829/371472 [1:34:25<27:48:03,  3.51it/s]
  5%|▌         | 19830/371472 [1:34:26<27:37:06,  3.54it/s]
  5%|▌         | 19831/371472 [1:34:26<27:08:07,  3.60it/s]
  5%|▌         | 19832/371472 [1:34:26<26:40:58,  3.66it/s]
  5%|▌         | 19833/371472 [1:34:27<26:51:54,  3.64it/s]
  5%|▌         | 19834/371472 [1:34:27<25:50:22,  3.78it/s]
  5%|▌         | 19835/371472 [1:34:27<26:06:06,  3.74it/s]
  5%|▌         | 19836/371472 [1:34:27<26:39:22,  3.66it/s]
  5%|▌         | 19837/371472 [1:34:28<27:40:25,  3.53it/s]
  5%|▌         | 19838/371472 [1:34:28<27:29:46,  3.55it/s]
  5%|▌         | 19839/371472 [1:34:28<27:01:48,  3.61it/s]
  5%|▌         | 19840/371472 [1:34:28<25:55:24,  3.77it/s]
                                                           
{'loss': 4.2579, 'learning_rate': 9.523907000797259e-07, 'epoch': 0.85}

  5%|▌         | 19840/371472 [1:34:28<25:55:24,  3.77it/s]
  5%|▌         | 19841/371472 [1:34:29<25:44:09,  3.80it/s]
  5%|▌         | 19842/371472 [1:34:29<25:18:23,  3.86it/s]
  5%|▌         | 19843/371472 [1:34:29<25:59:30,  3.76it/s]
  5%|▌         | 19844/371472 [1:34:29<26:03:00,  3.75it/s]
  5%|▌         | 19845/371472 [1:34:30<25:35:48,  3.82it/s]
  5%|▌         | 19846/371472 [1:34:30<26:06:12,  3.74it/s]
  5%|▌         | 19847/371472 [1:34:30<25:53:26,  3.77it/s]
  5%|▌         | 19848/371472 [1:34:31<26:55:03,  3.63it/s]
  5%|▌         | 19849/371472 [1:34:31<30:49:44,  3.17it/s]
  5%|▌         | 19850/371472 [1:34:31<28:56:13,  3.38it/s]
  5%|▌         | 19851/371472 [1:34:31<27:51:12,  3.51it/s]
  5%|▌         | 19852/371472 [1:34:32<27:55:55,  3.50it/s]
  5%|▌         | 19853/371472 [1:34:32<28:55:33,  3.38it/s]
  5%|▌         | 19854/371472 [1:34:32<28:30:25,  3.43it/s]
  5%|▌         | 19855/371472 [1:34:33<27:23:58,  3.56it/s]
  5%|▌         | 19856/371472 [1:34:33<29:16:29,  3.34it/s]
  5%|▌         | 19857/371472 [1:34:33<30:52:28,  3.16it/s]
  5%|▌         | 19858/371472 [1:34:34<30:15:37,  3.23it/s]
  5%|▌         | 19859/371472 [1:34:34<30:47:17,  3.17it/s]
  5%|▌         | 19860/371472 [1:34:34<29:54:29,  3.27it/s]
                                                           
{'loss': 4.5412, 'learning_rate': 9.523422181042469e-07, 'epoch': 0.86}

  5%|▌         | 19860/371472 [1:34:34<29:54:29,  3.27it/s]
  5%|▌         | 19861/371472 [1:34:35<28:57:42,  3.37it/s]
  5%|▌         | 19862/371472 [1:34:35<27:45:50,  3.52it/s]
  5%|▌         | 19863/371472 [1:34:35<26:36:56,  3.67it/s]
  5%|▌         | 19864/371472 [1:34:35<26:56:19,  3.63it/s]
  5%|▌         | 19865/371472 [1:34:36<26:30:16,  3.68it/s]
  5%|▌         | 19866/371472 [1:34:36<25:53:33,  3.77it/s]
  5%|▌         | 19867/371472 [1:34:36<24:54:58,  3.92it/s]
  5%|▌         | 19868/371472 [1:34:36<24:59:05,  3.91it/s]
  5%|▌         | 19869/371472 [1:34:37<24:30:05,  3.99it/s]
  5%|▌         | 19870/371472 [1:34:37<24:25:35,  4.00it/s]
  5%|▌         | 19871/371472 [1:34:37<24:34:27,  3.97it/s]
  5%|▌         | 19872/371472 [1:34:37<26:03:02,  3.75it/s]
  5%|▌         | 19873/371472 [1:34:38<25:37:43,  3.81it/s]
  5%|▌         | 19874/371472 [1:34:38<25:20:57,  3.85it/s]
  5%|▌         | 19875/371472 [1:34:38<28:57:21,  3.37it/s]
  5%|▌         | 19876/371472 [1:34:39<28:58:47,  3.37it/s]
  5%|▌         | 19877/371472 [1:34:39<27:25:24,  3.56it/s]
  5%|▌         | 19878/371472 [1:34:39<26:51:43,  3.64it/s]
  5%|▌         | 19879/371472 [1:34:39<27:18:20,  3.58it/s]
  5%|▌         | 19880/371472 [1:34:40<28:37:10,  3.41it/s]
                                                           
{'loss': 4.4961, 'learning_rate': 9.522937361287681e-07, 'epoch': 0.86}

  5%|▌         | 19880/371472 [1:34:40<28:37:10,  3.41it/s]
  5%|▌         | 19881/371472 [1:34:40<27:43:14,  3.52it/s]
  5%|▌         | 19882/371472 [1:34:40<27:44:02,  3.52it/s]
  5%|▌         | 19883/371472 [1:34:40<27:12:17,  3.59it/s]
  5%|▌         | 19884/371472 [1:34:41<25:59:14,  3.76it/s]
  5%|▌         | 19885/371472 [1:34:41<25:41:44,  3.80it/s]
  5%|▌         | 19886/371472 [1:34:41<26:56:52,  3.62it/s]
  5%|▌         | 19887/371472 [1:34:42<27:59:29,  3.49it/s]
  5%|▌         | 19888/371472 [1:34:42<27:52:18,  3.50it/s]
  5%|▌         | 19889/371472 [1:34:42<26:59:11,  3.62it/s]
  5%|▌         | 19890/371472 [1:34:42<26:51:28,  3.64it/s]
  5%|▌         | 19891/371472 [1:34:43<26:36:57,  3.67it/s]
  5%|▌         | 19892/371472 [1:34:43<26:11:16,  3.73it/s]
  5%|▌         | 19893/371472 [1:34:43<26:07:49,  3.74it/s]
  5%|▌         | 19894/371472 [1:34:43<26:58:58,  3.62it/s]
  5%|▌         | 19895/371472 [1:34:44<26:26:12,  3.69it/s]
  5%|▌         | 19896/371472 [1:34:44<31:20:51,  3.12it/s]
  5%|▌         | 19897/371472 [1:34:44<30:10:12,  3.24it/s]
  5%|▌         | 19898/371472 [1:34:45<28:47:56,  3.39it/s]
  5%|▌         | 19899/371472 [1:34:45<27:24:17,  3.56it/s]
  5%|▌         | 19900/371472 [1:34:45<27:28:37,  3.55it/s]
                                                           
{'loss': 4.7074, 'learning_rate': 9.522452541532892e-07, 'epoch': 0.86}

  5%|▌         | 19900/371472 [1:34:45<27:28:37,  3.55it/s]
  5%|▌         | 19901/371472 [1:34:46<26:56:12,  3.63it/s]
  5%|▌         | 19902/371472 [1:34:46<26:39:23,  3.66it/s]
  5%|▌         | 19903/371472 [1:34:46<27:49:12,  3.51it/s]
  5%|▌         | 19904/371472 [1:34:46<27:52:10,  3.50it/s]
  5%|▌         | 19905/371472 [1:34:47<28:30:45,  3.43it/s]
  5%|▌         | 19906/371472 [1:34:47<27:53:59,  3.50it/s]
  5%|▌         | 19907/371472 [1:34:47<27:45:13,  3.52it/s]
  5%|▌         | 19908/371472 [1:34:48<27:21:39,  3.57it/s]
  5%|▌         | 19909/371472 [1:34:48<27:13:40,  3.59it/s]
  5%|▌         | 19910/371472 [1:34:48<27:15:30,  3.58it/s]
  5%|▌         | 19911/371472 [1:34:48<28:41:29,  3.40it/s]
  5%|▌         | 19912/371472 [1:34:49<27:46:29,  3.52it/s]
  5%|▌         | 19913/371472 [1:34:49<26:38:14,  3.67it/s]
  5%|▌         | 19914/371472 [1:34:49<26:08:31,  3.74it/s]
  5%|▌         | 19915/371472 [1:34:49<26:05:52,  3.74it/s]
  5%|▌         | 19916/371472 [1:34:50<26:15:47,  3.72it/s]
  5%|▌         | 19917/371472 [1:34:50<26:25:16,  3.70it/s]
  5%|▌         | 19918/371472 [1:34:50<26:06:09,  3.74it/s]
  5%|▌         | 19919/371472 [1:34:51<26:47:03,  3.65it/s]
  5%|▌         | 19920/371472 [1:34:51<26:08:25,  3.74it/s]
                                                           
{'loss': 4.7198, 'learning_rate': 9.521967721778103e-07, 'epoch': 0.86}

  5%|▌         | 19920/371472 [1:34:51<26:08:25,  3.74it/s]
  5%|▌         | 19921/371472 [1:34:51<26:37:23,  3.67it/s]
  5%|▌         | 19922/371472 [1:34:51<26:40:21,  3.66it/s]
  5%|▌         | 19923/371472 [1:34:52<26:09:50,  3.73it/s]
  5%|▌         | 19924/371472 [1:34:52<25:55:46,  3.77it/s]
  5%|▌         | 19925/371472 [1:34:52<26:41:57,  3.66it/s]
  5%|▌         | 19926/371472 [1:34:52<26:10:30,  3.73it/s]
  5%|▌         | 19927/371472 [1:34:53<26:43:05,  3.65it/s]
  5%|▌         | 19928/371472 [1:34:53<27:11:22,  3.59it/s]
  5%|▌         | 19929/371472 [1:34:53<27:05:31,  3.60it/s]
  5%|▌         | 19930/371472 [1:34:54<27:22:13,  3.57it/s]
  5%|▌         | 19931/371472 [1:34:54<27:37:48,  3.53it/s]
  5%|▌         | 19932/371472 [1:34:54<29:26:15,  3.32it/s]
  5%|▌         | 19933/371472 [1:34:54<28:03:44,  3.48it/s]
  5%|▌         | 19934/371472 [1:34:55<27:56:18,  3.50it/s]
  5%|▌         | 19935/371472 [1:34:55<28:08:22,  3.47it/s]
  5%|▌         | 19936/371472 [1:34:55<27:53:43,  3.50it/s]
  5%|▌         | 19937/371472 [1:34:56<28:43:15,  3.40it/s]
  5%|▌         | 19938/371472 [1:34:56<28:35:17,  3.42it/s]
  5%|▌         | 19939/371472 [1:34:56<27:48:25,  3.51it/s]
  5%|▌         | 19940/371472 [1:34:56<27:52:21,  3.50it/s]
                                                           
{'loss': 4.5957, 'learning_rate': 9.521482902023314e-07, 'epoch': 0.86}

  5%|▌         | 19940/371472 [1:34:56<27:52:21,  3.50it/s]
  5%|▌         | 19941/371472 [1:34:57<27:39:34,  3.53it/s]
  5%|▌         | 19942/371472 [1:34:57<26:36:49,  3.67it/s]
  5%|▌         | 19943/371472 [1:34:57<26:44:20,  3.65it/s]
  5%|▌         | 19944/371472 [1:34:58<28:41:43,  3.40it/s]
  5%|▌         | 19945/371472 [1:34:58<28:56:18,  3.37it/s]
  5%|▌         | 19946/371472 [1:34:58<28:23:31,  3.44it/s]
  5%|▌         | 19947/371472 [1:34:58<28:32:11,  3.42it/s]
  5%|▌         | 19948/371472 [1:34:59<28:36:49,  3.41it/s]
  5%|▌         | 19949/371472 [1:34:59<28:58:07,  3.37it/s]
  5%|▌         | 19950/371472 [1:34:59<28:58:48,  3.37it/s]
  5%|▌         | 19951/371472 [1:35:00<29:14:46,  3.34it/s]
  5%|▌         | 19952/371472 [1:35:00<29:14:14,  3.34it/s]
  5%|▌         | 19953/371472 [1:35:00<29:55:57,  3.26it/s]
  5%|▌         | 19954/371472 [1:35:01<30:44:21,  3.18it/s]
  5%|▌         | 19955/371472 [1:35:01<29:37:58,  3.30it/s]
  5%|▌         | 19956/371472 [1:35:01<28:33:55,  3.42it/s]
  5%|▌         | 19957/371472 [1:35:01<27:19:13,  3.57it/s]
  5%|▌         | 19958/371472 [1:35:02<27:03:35,  3.61it/s]
  5%|▌         | 19959/371472 [1:35:02<29:10:35,  3.35it/s]
  5%|▌         | 19960/371472 [1:35:02<28:17:53,  3.45it/s]
                                                           
{'loss': 4.5261, 'learning_rate': 9.520998082268526e-07, 'epoch': 0.86}

  5%|▌         | 19960/371472 [1:35:02<28:17:53,  3.45it/s]
  5%|▌         | 19961/371472 [1:35:03<29:39:17,  3.29it/s]
  5%|▌         | 19962/371472 [1:35:03<29:47:01,  3.28it/s]
  5%|▌         | 19963/371472 [1:35:03<29:34:04,  3.30it/s]
  5%|▌         | 19964/371472 [1:35:04<30:17:38,  3.22it/s]
  5%|▌         | 19965/371472 [1:35:04<30:44:18,  3.18it/s]
  5%|▌         | 19966/371472 [1:35:04<29:04:27,  3.36it/s]
  5%|▌         | 19967/371472 [1:35:04<27:46:42,  3.51it/s]
  5%|▌         | 19968/371472 [1:35:05<28:40:55,  3.40it/s]
  5%|▌         | 19969/371472 [1:35:05<28:54:53,  3.38it/s]
  5%|▌         | 19970/371472 [1:35:05<28:06:22,  3.47it/s]
  5%|▌         | 19971/371472 [1:35:06<27:34:16,  3.54it/s]
  5%|▌         | 19972/371472 [1:35:06<27:26:45,  3.56it/s]
  5%|▌         | 19973/371472 [1:35:06<28:03:35,  3.48it/s]
  5%|▌         | 19974/371472 [1:35:06<28:41:28,  3.40it/s]
  5%|▌         | 19975/371472 [1:35:07<27:23:23,  3.56it/s]
  5%|▌         | 19976/371472 [1:35:07<26:08:29,  3.73it/s]
  5%|▌         | 19977/371472 [1:35:07<27:53:31,  3.50it/s]
  5%|▌         | 19978/371472 [1:35:08<28:41:20,  3.40it/s]
  5%|▌         | 19979/371472 [1:35:08<29:03:03,  3.36it/s]
  5%|▌         | 19980/371472 [1:35:08<28:14:42,  3.46it/s]
                                                           
{'loss': 4.2652, 'learning_rate': 9.520513262513736e-07, 'epoch': 0.86}

  5%|▌         | 19980/371472 [1:35:08<28:14:42,  3.46it/s]
  5%|▌         | 19981/371472 [1:35:08<27:44:54,  3.52it/s]
  5%|▌         | 19982/371472 [1:35:09<27:18:51,  3.57it/s]
  5%|▌         | 19983/371472 [1:35:09<28:12:18,  3.46it/s]
  5%|▌         | 19984/371472 [1:35:09<27:06:41,  3.60it/s]
  5%|▌         | 19985/371472 [1:35:10<27:37:02,  3.54it/s]
  5%|▌         | 19986/371472 [1:35:10<27:23:26,  3.56it/s]
  5%|▌         | 19987/371472 [1:35:10<27:39:31,  3.53it/s]
  5%|▌         | 19988/371472 [1:35:10<26:59:56,  3.62it/s]
  5%|▌         | 19989/371472 [1:35:11<27:37:54,  3.53it/s]
  5%|▌         | 19990/371472 [1:35:11<29:02:19,  3.36it/s]
  5%|▌         | 19991/371472 [1:35:11<27:44:14,  3.52it/s]
  5%|▌         | 19992/371472 [1:35:12<27:17:04,  3.58it/s]
  5%|▌         | 19993/371472 [1:35:12<27:01:16,  3.61it/s]
  5%|▌         | 19994/371472 [1:35:12<27:37:15,  3.53it/s]
  5%|▌         | 19995/371472 [1:35:12<27:12:41,  3.59it/s]
  5%|▌         | 19996/371472 [1:35:13<27:17:19,  3.58it/s]
  5%|▌         | 19997/371472 [1:35:13<27:58:14,  3.49it/s]
  5%|▌         | 19998/371472 [1:35:13<29:52:48,  3.27it/s]
  5%|▌         | 19999/371472 [1:35:14<31:23:51,  3.11it/s]
  5%|▌         | 20000/371472 [1:35:14<31:13:31,  3.13it/s]
                                                           
{'loss': 4.3014, 'learning_rate': 9.520028442758947e-07, 'epoch': 0.86}

  5%|▌         | 20000/371472 [1:35:14<31:13:31,  3.13it/s]
  5%|▌         | 20001/371472 [1:35:14<30:56:49,  3.15it/s]
  5%|▌         | 20002/371472 [1:35:15<30:27:58,  3.20it/s]
  5%|▌         | 20003/371472 [1:35:15<29:13:57,  3.34it/s]
  5%|▌         | 20004/371472 [1:35:15<28:56:18,  3.37it/s]
  5%|▌         | 20005/371472 [1:35:15<28:02:23,  3.48it/s]
  5%|▌         | 20006/371472 [1:35:16<27:57:30,  3.49it/s]
  5%|▌         | 20007/371472 [1:35:16<27:18:19,  3.58it/s]
  5%|▌         | 20008/371472 [1:35:16<28:17:39,  3.45it/s]
  5%|▌         | 20009/371472 [1:35:17<27:31:58,  3.55it/s]
  5%|▌         | 20010/371472 [1:35:17<27:37:43,  3.53it/s]
  5%|▌         | 20011/371472 [1:35:17<27:07:37,  3.60it/s]
  5%|▌         | 20012/371472 [1:35:17<27:00:58,  3.61it/s]
  5%|▌         | 20013/371472 [1:35:18<27:38:42,  3.53it/s]
  5%|▌         | 20014/371472 [1:35:18<28:58:10,  3.37it/s]
  5%|▌         | 20015/371472 [1:35:18<29:45:21,  3.28it/s]
  5%|▌         | 20016/371472 [1:35:19<29:44:28,  3.28it/s]
  5%|▌         | 20017/371472 [1:35:19<28:25:52,  3.43it/s]
  5%|▌         | 20018/371472 [1:35:19<29:36:29,  3.30it/s]
  5%|▌         | 20019/371472 [1:35:19<28:15:23,  3.45it/s]
  5%|▌         | 20020/371472 [1:35:20<27:20:47,  3.57it/s]
                                                           
{'loss': 4.617, 'learning_rate': 9.519543623004158e-07, 'epoch': 0.86}

  5%|▌         | 20020/371472 [1:35:20<27:20:47,  3.57it/s]
  5%|▌         | 20021/371472 [1:35:20<27:26:55,  3.56it/s]
  5%|▌         | 20022/371472 [1:35:20<27:06:09,  3.60it/s]
  5%|▌         | 20023/371472 [1:35:21<28:35:59,  3.41it/s]
  5%|▌         | 20024/371472 [1:35:21<27:29:17,  3.55it/s]
  5%|▌         | 20025/371472 [1:35:21<26:49:15,  3.64it/s]
  5%|▌         | 20026/371472 [1:35:21<26:49:50,  3.64it/s]
  5%|▌         | 20027/371472 [1:35:22<26:14:20,  3.72it/s]
  5%|▌         | 20028/371472 [1:35:22<25:27:21,  3.83it/s]
  5%|▌         | 20029/371472 [1:35:22<28:37:04,  3.41it/s]
  5%|▌         | 20030/371472 [1:35:23<28:21:40,  3.44it/s]
  5%|▌         | 20031/371472 [1:35:23<27:22:16,  3.57it/s]
  5%|▌         | 20032/371472 [1:35:23<26:30:43,  3.68it/s]
  5%|▌         | 20033/371472 [1:35:23<27:04:49,  3.60it/s]
  5%|▌         | 20034/371472 [1:35:24<27:25:36,  3.56it/s]
  5%|▌         | 20035/371472 [1:35:24<26:34:54,  3.67it/s]
  5%|▌         | 20036/371472 [1:35:24<27:46:40,  3.51it/s]
  5%|▌         | 20037/371472 [1:35:24<26:38:40,  3.66it/s]
  5%|▌         | 20038/371472 [1:35:25<28:14:24,  3.46it/s]
  5%|▌         | 20039/371472 [1:35:25<27:12:04,  3.59it/s]
  5%|▌         | 20040/371472 [1:35:25<26:46:47,  3.65it/s]
                                                           
{'loss': 4.5581, 'learning_rate': 9.51905880324937e-07, 'epoch': 0.86}

  5%|▌         | 20040/371472 [1:35:25<26:46:47,  3.65it/s]
  5%|▌         | 20041/371472 [1:35:26<29:19:58,  3.33it/s]
  5%|▌         | 20042/371472 [1:35:26<28:02:20,  3.48it/s]
  5%|▌         | 20043/371472 [1:35:26<27:31:21,  3.55it/s]
  5%|▌         | 20044/371472 [1:35:26<28:36:12,  3.41it/s]
  5%|▌         | 20045/371472 [1:35:27<29:01:02,  3.36it/s]
  5%|▌         | 20046/371472 [1:35:27<30:48:35,  3.17it/s]
  5%|▌         | 20047/371472 [1:35:27<29:31:59,  3.31it/s]
  5%|▌         | 20048/371472 [1:35:28<28:53:18,  3.38it/s]
  5%|▌         | 20049/371472 [1:35:28<28:10:51,  3.46it/s]
  5%|▌         | 20050/371472 [1:35:28<28:08:00,  3.47it/s]
  5%|▌         | 20051/371472 [1:35:29<29:36:00,  3.30it/s]
  5%|▌         | 20052/371472 [1:35:29<41:12:12,  2.37it/s]
  5%|▌         | 20053/371472 [1:35:30<38:35:57,  2.53it/s]
  5%|▌         | 20054/371472 [1:35:30<34:56:52,  2.79it/s]
  5%|▌         | 20055/371472 [1:35:30<32:04:26,  3.04it/s]
  5%|▌         | 20056/371472 [1:35:30<31:40:17,  3.08it/s]
  5%|▌         | 20057/371472 [1:35:31<31:52:14,  3.06it/s]
  5%|▌         | 20058/371472 [1:35:31<32:27:28,  3.01it/s]
  5%|▌         | 20059/371472 [1:35:31<30:56:43,  3.15it/s]
  5%|▌         | 20060/371472 [1:35:32<30:13:26,  3.23it/s]
                                                           
{'loss': 4.3092, 'learning_rate': 9.51857398349458e-07, 'epoch': 0.86}

  5%|▌         | 20060/371472 [1:35:32<30:13:26,  3.23it/s]
  5%|▌         | 20061/371472 [1:35:32<28:04:22,  3.48it/s]
  5%|▌         | 20062/371472 [1:35:32<27:02:30,  3.61it/s]
  5%|▌         | 20063/371472 [1:35:33<27:39:43,  3.53it/s]
  5%|▌         | 20064/371472 [1:35:33<28:42:12,  3.40it/s]
  5%|▌         | 20065/371472 [1:35:33<27:47:04,  3.51it/s]
  5%|▌         | 20066/371472 [1:35:33<27:34:39,  3.54it/s]
  5%|▌         | 20067/371472 [1:35:34<26:58:11,  3.62it/s]
  5%|▌         | 20068/371472 [1:35:34<27:49:12,  3.51it/s]
  5%|▌         | 20069/371472 [1:35:34<27:25:48,  3.56it/s]
  5%|▌         | 20070/371472 [1:35:34<27:25:31,  3.56it/s]
  5%|▌         | 20071/371472 [1:35:35<26:36:33,  3.67it/s]
  5%|▌         | 20072/371472 [1:35:35<27:09:39,  3.59it/s]
  5%|▌         | 20073/371472 [1:35:35<27:30:24,  3.55it/s]
  5%|▌         | 20074/371472 [1:35:36<26:59:35,  3.62it/s]
  5%|▌         | 20075/371472 [1:35:36<26:43:25,  3.65it/s]
  5%|▌         | 20076/371472 [1:35:36<26:18:56,  3.71it/s]
  5%|▌         | 20077/371472 [1:35:36<26:47:11,  3.64it/s]
  5%|▌         | 20078/371472 [1:35:37<25:50:07,  3.78it/s]
  5%|▌         | 20079/371472 [1:35:37<26:09:02,  3.73it/s]
  5%|▌         | 20080/371472 [1:35:37<26:08:44,  3.73it/s]
                                                           
{'loss': 4.4433, 'learning_rate': 9.518089163739792e-07, 'epoch': 0.86}

  5%|▌         | 20080/371472 [1:35:37<26:08:44,  3.73it/s]
  5%|▌         | 20081/371472 [1:35:37<26:16:49,  3.71it/s]
  5%|▌         | 20082/371472 [1:35:38<26:30:16,  3.68it/s]
  5%|▌         | 20083/371472 [1:35:38<26:56:01,  3.62it/s]
  5%|▌         | 20084/371472 [1:35:38<31:06:01,  3.14it/s]
  5%|▌         | 20085/371472 [1:35:39<31:20:56,  3.11it/s]
  5%|▌         | 20086/371472 [1:35:39<29:15:09,  3.34it/s]
  5%|▌         | 20087/371472 [1:35:39<28:15:25,  3.45it/s]
  5%|▌         | 20088/371472 [1:35:40<29:31:10,  3.31it/s]
  5%|▌         | 20089/371472 [1:35:40<28:24:04,  3.44it/s]
  5%|▌         | 20090/371472 [1:35:40<26:51:01,  3.64it/s]
  5%|▌         | 20091/371472 [1:35:40<27:06:08,  3.60it/s]
  5%|▌         | 20092/371472 [1:35:41<28:41:49,  3.40it/s]
  5%|▌         | 20093/371472 [1:35:41<27:52:47,  3.50it/s]
  5%|▌         | 20094/371472 [1:35:41<27:56:22,  3.49it/s]
  5%|▌         | 20095/371472 [1:35:42<27:27:01,  3.56it/s]
  5%|▌         | 20096/371472 [1:35:42<27:25:52,  3.56it/s]
  5%|▌         | 20097/371472 [1:35:42<26:45:51,  3.65it/s]
  5%|▌         | 20098/371472 [1:35:42<26:57:19,  3.62it/s]
  5%|▌         | 20099/371472 [1:35:43<26:20:47,  3.70it/s]
  5%|▌         | 20100/371472 [1:35:43<27:06:54,  3.60it/s]
                                                           
{'loss': 4.3439, 'learning_rate': 9.517604343985003e-07, 'epoch': 0.87}

  5%|▌         | 20100/371472 [1:35:43<27:06:54,  3.60it/s]
  5%|▌         | 20101/371472 [1:35:43<27:08:31,  3.60it/s]
  5%|▌         | 20102/371472 [1:35:43<26:49:25,  3.64it/s]
  5%|▌         | 20103/371472 [1:35:44<28:22:22,  3.44it/s]
  5%|▌         | 20104/371472 [1:35:44<27:27:19,  3.55it/s]
  5%|▌         | 20105/371472 [1:35:44<27:45:58,  3.52it/s]
  5%|▌         | 20106/371472 [1:35:45<26:39:20,  3.66it/s]
  5%|▌         | 20107/371472 [1:35:45<26:23:05,  3.70it/s]
  5%|▌         | 20108/371472 [1:35:45<27:01:59,  3.61it/s]
  5%|▌         | 20109/371472 [1:35:45<27:09:18,  3.59it/s]
  5%|▌         | 20110/371472 [1:35:46<26:39:29,  3.66it/s]
  5%|▌         | 20111/371472 [1:35:46<26:20:16,  3.71it/s]
  5%|▌         | 20112/371472 [1:35:46<26:18:04,  3.71it/s]
  5%|▌         | 20113/371472 [1:35:47<29:21:17,  3.32it/s]
  5%|▌         | 20114/371472 [1:35:47<33:06:08,  2.95it/s]
  5%|▌         | 20115/371472 [1:35:47<32:01:03,  3.05it/s]
  5%|▌         | 20116/371472 [1:35:48<30:58:00,  3.15it/s]
  5%|▌         | 20117/371472 [1:35:48<28:28:54,  3.43it/s]
  5%|▌         | 20118/371472 [1:35:48<28:37:14,  3.41it/s]
  5%|▌         | 20119/371472 [1:35:48<29:35:14,  3.30it/s]
  5%|▌         | 20120/371472 [1:35:49<28:01:22,  3.48it/s]
                                                           
{'loss': 4.4046, 'learning_rate': 9.517119524230214e-07, 'epoch': 0.87}

  5%|▌         | 20120/371472 [1:35:49<28:01:22,  3.48it/s]
  5%|▌         | 20121/371472 [1:35:49<26:41:07,  3.66it/s]
  5%|▌         | 20122/371472 [1:35:49<28:17:28,  3.45it/s]
  5%|▌         | 20123/371472 [1:35:50<27:53:37,  3.50it/s]
  5%|▌         | 20124/371472 [1:35:50<27:30:52,  3.55it/s]
  5%|▌         | 20125/371472 [1:35:50<27:01:44,  3.61it/s]
  5%|▌         | 20126/371472 [1:35:50<29:21:26,  3.32it/s]
  5%|▌         | 20127/371472 [1:35:51<29:24:01,  3.32it/s]
  5%|▌         | 20128/371472 [1:35:51<30:42:42,  3.18it/s]
  5%|▌         | 20129/371472 [1:35:51<28:29:36,  3.43it/s]
  5%|▌         | 20130/371472 [1:35:52<28:18:28,  3.45it/s]
  5%|▌         | 20131/371472 [1:35:52<27:28:56,  3.55it/s]
  5%|▌         | 20132/371472 [1:35:52<29:11:08,  3.34it/s]
  5%|▌         | 20133/371472 [1:35:53<28:08:01,  3.47it/s]
  5%|▌         | 20134/371472 [1:35:53<28:12:36,  3.46it/s]
  5%|▌         | 20135/371472 [1:35:53<28:10:48,  3.46it/s]
  5%|▌         | 20136/371472 [1:35:53<29:23:01,  3.32it/s]
  5%|▌         | 20137/371472 [1:35:54<29:04:00,  3.36it/s]
  5%|▌         | 20138/371472 [1:35:54<28:01:09,  3.48it/s]
  5%|▌         | 20139/371472 [1:35:54<28:49:27,  3.39it/s]
  5%|▌         | 20140/371472 [1:35:55<27:50:23,  3.51it/s]
                                                           
{'loss': 4.4703, 'learning_rate': 9.516634704475424e-07, 'epoch': 0.87}

  5%|▌         | 20140/371472 [1:35:55<27:50:23,  3.51it/s]
  5%|▌         | 20141/371472 [1:35:55<27:18:55,  3.57it/s]
  5%|▌         | 20142/371472 [1:35:55<28:12:54,  3.46it/s]
  5%|▌         | 20143/371472 [1:35:55<27:25:47,  3.56it/s]
  5%|▌         | 20144/371472 [1:35:56<26:25:21,  3.69it/s]
  5%|▌         | 20145/371472 [1:35:56<26:47:57,  3.64it/s]
  5%|▌         | 20146/371472 [1:35:56<26:54:19,  3.63it/s]
  5%|▌         | 20147/371472 [1:35:57<28:17:16,  3.45it/s]
  5%|▌         | 20148/371472 [1:35:57<27:00:08,  3.61it/s]
  5%|▌         | 20149/371472 [1:35:57<26:10:31,  3.73it/s]
  5%|▌         | 20150/371472 [1:35:57<27:07:09,  3.60it/s]
  5%|▌         | 20151/371472 [1:35:58<26:54:48,  3.63it/s]
  5%|▌         | 20152/371472 [1:35:58<28:47:41,  3.39it/s]
  5%|▌         | 20153/371472 [1:35:58<31:04:36,  3.14it/s]
  5%|▌         | 20154/371472 [1:35:59<32:14:35,  3.03it/s]
  5%|▌         | 20155/371472 [1:35:59<30:43:00,  3.18it/s]
  5%|▌         | 20156/371472 [1:35:59<31:24:47,  3.11it/s]
  5%|▌         | 20157/371472 [1:36:00<30:01:50,  3.25it/s]
  5%|▌         | 20158/371472 [1:36:00<32:50:36,  2.97it/s]
  5%|▌         | 20159/371472 [1:36:00<31:27:21,  3.10it/s]
  5%|▌         | 20160/371472 [1:36:01<30:13:42,  3.23it/s]
                                                           
{'loss': 4.0817, 'learning_rate': 9.516149884720635e-07, 'epoch': 0.87}

  5%|▌         | 20160/371472 [1:36:01<30:13:42,  3.23it/s]
  5%|▌         | 20161/371472 [1:36:01<29:25:49,  3.32it/s]
  5%|▌         | 20162/371472 [1:36:01<29:50:24,  3.27it/s]
  5%|▌         | 20163/371472 [1:36:01<29:43:45,  3.28it/s]
  5%|▌         | 20164/371472 [1:36:02<28:06:50,  3.47it/s]
  5%|▌         | 20165/371472 [1:36:02<27:48:58,  3.51it/s]
  5%|▌         | 20166/371472 [1:36:02<27:17:51,  3.57it/s]
  5%|▌         | 20167/371472 [1:36:02<26:23:15,  3.70it/s]
  5%|▌         | 20168/371472 [1:36:03<26:21:56,  3.70it/s]
  5%|▌         | 20169/371472 [1:36:03<26:12:50,  3.72it/s]
  5%|▌         | 20170/371472 [1:36:03<25:31:16,  3.82it/s]
  5%|▌         | 20171/371472 [1:36:04<25:15:12,  3.86it/s]
  5%|▌         | 20172/371472 [1:36:04<26:04:52,  3.74it/s]
  5%|▌         | 20173/371472 [1:36:04<26:47:08,  3.64it/s]
  5%|▌         | 20174/371472 [1:36:04<26:04:08,  3.74it/s]
  5%|▌         | 20175/371472 [1:36:05<26:54:06,  3.63it/s]
  5%|▌         | 20176/371472 [1:36:05<27:48:40,  3.51it/s]
  5%|▌         | 20177/371472 [1:36:05<27:37:29,  3.53it/s]
  5%|▌         | 20178/371472 [1:36:05<27:29:03,  3.55it/s]
  5%|▌         | 20179/371472 [1:36:06<26:51:16,  3.63it/s]
  5%|▌         | 20180/371472 [1:36:06<27:26:01,  3.56it/s]
                                                           
{'loss': 4.6784, 'learning_rate': 9.515665064965847e-07, 'epoch': 0.87}

  5%|▌         | 20180/371472 [1:36:06<27:26:01,  3.56it/s]
  5%|▌         | 20181/371472 [1:36:06<27:55:20,  3.49it/s]
  5%|▌         | 20182/371472 [1:36:07<28:59:31,  3.37it/s]
  5%|▌         | 20183/371472 [1:36:07<28:36:12,  3.41it/s]
  5%|▌         | 20184/371472 [1:36:07<27:43:18,  3.52it/s]
  5%|▌         | 20185/371472 [1:36:07<27:10:19,  3.59it/s]
  5%|▌         | 20186/371472 [1:36:08<27:38:32,  3.53it/s]
  5%|▌         | 20187/371472 [1:36:08<28:54:55,  3.37it/s]
  5%|▌         | 20188/371472 [1:36:08<27:47:47,  3.51it/s]
  5%|▌         | 20189/371472 [1:36:09<26:50:25,  3.64it/s]
  5%|▌         | 20190/371472 [1:36:09<27:12:45,  3.59it/s]
  5%|▌         | 20191/371472 [1:36:09<26:58:08,  3.62it/s]
  5%|▌         | 20192/371472 [1:36:09<27:01:01,  3.61it/s]
  5%|▌         | 20193/371472 [1:36:10<27:20:20,  3.57it/s]
  5%|▌         | 20194/371472 [1:36:10<27:11:52,  3.59it/s]
  5%|▌         | 20195/371472 [1:36:10<28:12:54,  3.46it/s]
  5%|▌         | 20196/371472 [1:36:11<27:12:54,  3.59it/s]
  5%|▌         | 20197/371472 [1:36:11<27:38:11,  3.53it/s]
  5%|▌         | 20198/371472 [1:36:11<27:21:51,  3.57it/s]
  5%|▌         | 20199/371472 [1:36:11<26:47:05,  3.64it/s]
  5%|▌         | 20200/371472 [1:36:12<28:31:10,  3.42it/s]
                                                           
{'loss': 4.3892, 'learning_rate': 9.515180245211058e-07, 'epoch': 0.87}

  5%|▌         | 20200/371472 [1:36:12<28:31:10,  3.42it/s]
  5%|▌         | 20201/371472 [1:36:12<27:11:36,  3.59it/s]
  5%|▌         | 20202/371472 [1:36:12<27:58:15,  3.49it/s]
  5%|▌         | 20203/371472 [1:36:13<31:27:42,  3.10it/s]
  5%|▌         | 20204/371472 [1:36:13<29:54:30,  3.26it/s]
  5%|▌         | 20205/371472 [1:36:13<29:21:19,  3.32it/s]
  5%|▌         | 20206/371472 [1:36:14<27:59:39,  3.49it/s]
  5%|▌         | 20207/371472 [1:36:14<28:36:52,  3.41it/s]
  5%|▌         | 20208/371472 [1:36:14<29:41:43,  3.29it/s]
  5%|▌         | 20209/371472 [1:36:14<29:54:24,  3.26it/s]
  5%|▌         | 20210/371472 [1:36:15<30:48:06,  3.17it/s]
  5%|▌         | 20211/371472 [1:36:15<29:14:02,  3.34it/s]
  5%|▌         | 20212/371472 [1:36:15<29:06:06,  3.35it/s]
  5%|▌         | 20213/371472 [1:36:16<27:56:23,  3.49it/s]
  5%|▌         | 20214/371472 [1:36:16<29:47:20,  3.28it/s]
  5%|▌         | 20215/371472 [1:36:16<28:22:30,  3.44it/s]
  5%|▌         | 20216/371472 [1:36:17<29:29:39,  3.31it/s]
  5%|▌         | 20217/371472 [1:36:17<30:30:29,  3.20it/s]
  5%|▌         | 20218/371472 [1:36:17<30:09:41,  3.23it/s]
  5%|▌         | 20219/371472 [1:36:17<28:45:43,  3.39it/s]
  5%|▌         | 20220/371472 [1:36:18<28:53:15,  3.38it/s]
                                                           
{'loss': 4.5129, 'learning_rate': 9.514695425456269e-07, 'epoch': 0.87}

  5%|▌         | 20220/371472 [1:36:18<28:53:15,  3.38it/s]
  5%|▌         | 20221/371472 [1:36:18<27:50:11,  3.51it/s]
  5%|▌         | 20222/371472 [1:36:18<27:31:19,  3.55it/s]
  5%|▌         | 20223/371472 [1:36:19<26:41:29,  3.66it/s]
  5%|▌         | 20224/371472 [1:36:19<26:57:15,  3.62it/s]
  5%|▌         | 20225/371472 [1:36:19<27:05:30,  3.60it/s]
  5%|▌         | 20226/371472 [1:36:19<27:05:30,  3.60it/s]
  5%|▌         | 20227/371472 [1:36:20<26:47:11,  3.64it/s]
  5%|▌         | 20228/371472 [1:36:20<26:25:53,  3.69it/s]
  5%|▌         | 20229/371472 [1:36:20<27:35:24,  3.54it/s]
  5%|▌         | 20230/371472 [1:36:21<28:23:11,  3.44it/s]
  5%|▌         | 20231/371472 [1:36:21<31:33:43,  3.09it/s]
  5%|▌         | 20232/371472 [1:36:21<29:37:29,  3.29it/s]
  5%|▌         | 20233/371472 [1:36:21<28:07:29,  3.47it/s]
  5%|▌         | 20234/371472 [1:36:22<28:31:26,  3.42it/s]
  5%|▌         | 20235/371472 [1:36:22<27:14:17,  3.58it/s]
  5%|▌         | 20236/371472 [1:36:22<28:19:36,  3.44it/s]
  5%|▌         | 20237/371472 [1:36:23<27:19:15,  3.57it/s]
  5%|▌         | 20238/371472 [1:36:23<27:40:32,  3.53it/s]
  5%|▌         | 20239/371472 [1:36:23<26:43:56,  3.65it/s]
  5%|▌         | 20240/371472 [1:36:23<27:46:23,  3.51it/s]
                                                           
{'loss': 4.4788, 'learning_rate': 9.51421060570148e-07, 'epoch': 0.87}

  5%|▌         | 20240/371472 [1:36:23<27:46:23,  3.51it/s]
  5%|▌         | 20241/371472 [1:36:24<27:26:39,  3.55it/s]
  5%|▌         | 20242/371472 [1:36:24<30:07:58,  3.24it/s]
  5%|▌         | 20243/371472 [1:36:24<29:11:27,  3.34it/s]
  5%|▌         | 20244/371472 [1:36:25<28:31:10,  3.42it/s]
  5%|▌         | 20245/371472 [1:36:25<28:11:20,  3.46it/s]
  5%|▌         | 20246/371472 [1:36:25<27:02:15,  3.61it/s]
  5%|▌         | 20247/371472 [1:36:25<27:05:57,  3.60it/s]
  5%|▌         | 20248/371472 [1:36:26<26:40:18,  3.66it/s]
  5%|▌         | 20249/371472 [1:36:26<26:13:30,  3.72it/s]
  5%|▌         | 20250/371472 [1:36:26<25:54:39,  3.77it/s]
  5%|▌         | 20251/371472 [1:36:27<27:08:00,  3.60it/s]
  5%|▌         | 20252/371472 [1:36:27<28:46:21,  3.39it/s]
  5%|▌         | 20253/371472 [1:36:27<28:26:00,  3.43it/s]
  5%|▌         | 20254/371472 [1:36:27<28:04:32,  3.47it/s]
  5%|▌         | 20255/371472 [1:36:28<28:04:59,  3.47it/s]
  5%|▌         | 20256/371472 [1:36:28<27:16:59,  3.58it/s]
  5%|▌         | 20257/371472 [1:36:28<27:11:11,  3.59it/s]
  5%|▌         | 20258/371472 [1:36:28<26:55:44,  3.62it/s]
  5%|▌         | 20259/371472 [1:36:29<28:15:31,  3.45it/s]
  5%|▌         | 20260/371472 [1:36:29<27:31:39,  3.54it/s]
                                                           
{'loss': 4.3852, 'learning_rate': 9.51372578594669e-07, 'epoch': 0.87}

  5%|▌         | 20260/371472 [1:36:29<27:31:39,  3.54it/s]
  5%|▌         | 20261/371472 [1:36:29<27:48:05,  3.51it/s]
  5%|▌         | 20262/371472 [1:36:30<28:17:37,  3.45it/s]
  5%|▌         | 20263/371472 [1:36:30<30:11:54,  3.23it/s]
  5%|▌         | 20264/371472 [1:36:30<29:39:41,  3.29it/s]
  5%|▌         | 20265/371472 [1:36:31<28:33:51,  3.42it/s]
  5%|▌         | 20266/371472 [1:36:31<28:13:11,  3.46it/s]
  5%|▌         | 20267/371472 [1:36:31<26:58:47,  3.62it/s]
  5%|▌         | 20268/371472 [1:36:31<26:16:54,  3.71it/s]
  5%|▌         | 20269/371472 [1:36:32<27:05:38,  3.60it/s]
  5%|▌         | 20270/371472 [1:36:32<26:52:52,  3.63it/s]
  5%|▌         | 20271/371472 [1:36:32<30:19:15,  3.22it/s]
  5%|▌         | 20272/371472 [1:36:33<29:25:39,  3.32it/s]
  5%|▌         | 20273/371472 [1:36:33<28:21:33,  3.44it/s]
  5%|▌         | 20274/371472 [1:36:33<27:17:32,  3.57it/s]
  5%|▌         | 20275/371472 [1:36:33<26:20:29,  3.70it/s]
  5%|▌         | 20276/371472 [1:36:34<27:41:14,  3.52it/s]
  5%|▌         | 20277/371472 [1:36:34<27:06:59,  3.60it/s]
  5%|▌         | 20278/371472 [1:36:34<27:31:03,  3.55it/s]
  5%|▌         | 20279/371472 [1:36:35<26:47:42,  3.64it/s]
  5%|▌         | 20280/371472 [1:36:35<28:29:24,  3.42it/s]
                                                           
{'loss': 4.3911, 'learning_rate': 9.513240966191901e-07, 'epoch': 0.87}

  5%|▌         | 20280/371472 [1:36:35<28:29:24,  3.42it/s]
  5%|▌         | 20281/371472 [1:36:35<27:19:38,  3.57it/s]
  5%|▌         | 20282/371472 [1:36:35<29:03:38,  3.36it/s]
  5%|▌         | 20283/371472 [1:36:36<27:33:06,  3.54it/s]
  5%|▌         | 20284/371472 [1:36:36<32:26:33,  3.01it/s]
  5%|▌         | 20285/371472 [1:36:36<30:42:39,  3.18it/s]
  5%|▌         | 20286/371472 [1:36:37<29:49:06,  3.27it/s]
  5%|▌         | 20287/371472 [1:36:37<29:25:13,  3.32it/s]
  5%|▌         | 20288/371472 [1:36:37<28:29:16,  3.42it/s]
  5%|▌         | 20289/371472 [1:36:38<29:35:59,  3.30it/s]
  5%|▌         | 20290/371472 [1:36:38<28:15:26,  3.45it/s]
  5%|▌         | 20291/371472 [1:36:38<27:31:22,  3.54it/s]
  5%|▌         | 20292/371472 [1:36:38<28:32:56,  3.42it/s]
  5%|▌         | 20293/371472 [1:36:39<29:05:03,  3.35it/s]
  5%|▌         | 20294/371472 [1:36:39<27:46:18,  3.51it/s]
  5%|▌         | 20295/371472 [1:36:39<27:31:01,  3.55it/s]
  5%|▌         | 20296/371472 [1:36:40<26:38:08,  3.66it/s]
  5%|▌         | 20297/371472 [1:36:40<25:37:56,  3.81it/s]
  5%|▌         | 20298/371472 [1:36:40<26:19:01,  3.71it/s]
  5%|▌         | 20299/371472 [1:36:40<26:40:33,  3.66it/s]
  5%|▌         | 20300/371472 [1:36:41<26:01:29,  3.75it/s]
                                                           
{'loss': 4.4513, 'learning_rate': 9.512756146437113e-07, 'epoch': 0.87}

  5%|▌         | 20300/371472 [1:36:41<26:01:29,  3.75it/s]
  5%|▌         | 20301/371472 [1:36:41<25:30:06,  3.83it/s]
  5%|▌         | 20302/371472 [1:36:41<26:01:55,  3.75it/s]
  5%|▌         | 20303/371472 [1:36:41<27:24:39,  3.56it/s]
  5%|▌         | 20304/371472 [1:36:42<29:25:30,  3.32it/s]
  5%|▌         | 20305/371472 [1:36:42<28:42:20,  3.40it/s]
  5%|▌         | 20306/371472 [1:36:42<27:23:06,  3.56it/s]
  5%|▌         | 20307/371472 [1:36:43<26:54:20,  3.63it/s]
  5%|▌         | 20308/371472 [1:36:43<30:49:24,  3.16it/s]
  5%|▌         | 20309/371472 [1:36:43<30:17:51,  3.22it/s]
  5%|▌         | 20310/371472 [1:36:44<29:55:20,  3.26it/s]
  5%|▌         | 20311/371472 [1:36:44<30:10:20,  3.23it/s]
  5%|▌         | 20312/371472 [1:36:44<29:17:20,  3.33it/s]
  5%|▌         | 20313/371472 [1:36:44<28:15:36,  3.45it/s]
  5%|▌         | 20314/371472 [1:36:45<28:05:23,  3.47it/s]
  5%|▌         | 20315/371472 [1:36:45<26:59:52,  3.61it/s]
  5%|▌         | 20316/371472 [1:36:45<26:37:41,  3.66it/s]
  5%|▌         | 20317/371472 [1:36:46<28:17:46,  3.45it/s]
  5%|▌         | 20318/371472 [1:36:46<27:21:15,  3.57it/s]
  5%|▌         | 20319/371472 [1:36:46<27:10:43,  3.59it/s]
  5%|▌         | 20320/371472 [1:36:46<26:46:00,  3.64it/s]
                                                           
{'loss': 4.5099, 'learning_rate': 9.512271326682324e-07, 'epoch': 0.88}

  5%|▌         | 20320/371472 [1:36:46<26:46:00,  3.64it/s]
  5%|▌         | 20321/371472 [1:36:47<26:34:12,  3.67it/s]
  5%|▌         | 20322/371472 [1:36:47<27:08:28,  3.59it/s]
  5%|▌         | 20323/371472 [1:36:47<26:28:29,  3.68it/s]
  5%|▌         | 20324/371472 [1:36:47<26:34:55,  3.67it/s]
  5%|▌         | 20325/371472 [1:36:48<26:59:34,  3.61it/s]
  5%|▌         | 20326/371472 [1:36:48<26:40:05,  3.66it/s]
  5%|▌         | 20327/371472 [1:36:48<27:17:46,  3.57it/s]
  5%|▌         | 20328/371472 [1:36:49<27:00:17,  3.61it/s]
  5%|▌         | 20329/371472 [1:36:49<26:27:15,  3.69it/s]
  5%|▌         | 20330/371472 [1:36:49<25:58:19,  3.76it/s]
  5%|▌         | 20331/371472 [1:36:49<25:48:39,  3.78it/s]
  5%|▌         | 20332/371472 [1:36:50<26:01:41,  3.75it/s]
  5%|▌         | 20333/371472 [1:36:50<26:12:52,  3.72it/s]
  5%|▌         | 20334/371472 [1:36:50<26:53:46,  3.63it/s]
  5%|▌         | 20335/371472 [1:36:50<26:19:34,  3.70it/s]
  5%|▌         | 20336/371472 [1:36:51<25:58:44,  3.75it/s]
  5%|▌         | 20337/371472 [1:36:51<26:09:45,  3.73it/s]
  5%|▌         | 20338/371472 [1:36:51<26:12:39,  3.72it/s]
  5%|▌         | 20339/371472 [1:36:51<25:57:39,  3.76it/s]
  5%|▌         | 20340/371472 [1:36:52<26:50:06,  3.63it/s]
                                                           
{'loss': 4.4488, 'learning_rate': 9.511786506927536e-07, 'epoch': 0.88}

  5%|▌         | 20340/371472 [1:36:52<26:50:06,  3.63it/s]
  5%|▌         | 20341/371472 [1:36:52<29:13:35,  3.34it/s]
  5%|▌         | 20342/371472 [1:36:52<28:35:09,  3.41it/s]
  5%|▌         | 20343/371472 [1:36:53<27:47:11,  3.51it/s]
  5%|▌         | 20344/371472 [1:36:53<28:30:10,  3.42it/s]
  5%|▌         | 20345/371472 [1:36:53<27:46:46,  3.51it/s]
  5%|▌         | 20346/371472 [1:36:53<26:26:10,  3.69it/s]
  5%|▌         | 20347/371472 [1:36:54<27:18:15,  3.57it/s]
  5%|▌         | 20348/371472 [1:36:54<27:26:55,  3.55it/s]
  5%|▌         | 20349/371472 [1:36:54<28:23:22,  3.44it/s]
  5%|▌         | 20350/371472 [1:36:55<27:11:48,  3.59it/s]
  5%|▌         | 20351/371472 [1:36:55<28:19:34,  3.44it/s]
  5%|▌         | 20352/371472 [1:36:55<27:03:23,  3.60it/s]
  5%|▌         | 20353/371472 [1:36:55<26:35:35,  3.67it/s]
  5%|▌         | 20354/371472 [1:36:56<26:45:05,  3.65it/s]
  5%|▌         | 20355/371472 [1:36:56<30:14:08,  3.23it/s]
  5%|▌         | 20356/371472 [1:36:56<30:03:01,  3.25it/s]
  5%|▌         | 20357/371472 [1:36:57<29:41:40,  3.28it/s]
  5%|▌         | 20358/371472 [1:36:57<29:29:25,  3.31it/s]
  5%|▌         | 20359/371472 [1:36:57<28:47:26,  3.39it/s]
  5%|▌         | 20360/371472 [1:36:58<27:46:10,  3.51it/s]
                                                           
{'loss': 4.4457, 'learning_rate': 9.511301687172747e-07, 'epoch': 0.88}

  5%|▌         | 20360/371472 [1:36:58<27:46:10,  3.51it/s]
  5%|▌         | 20361/371472 [1:36:58<26:48:37,  3.64it/s]
  5%|▌         | 20362/371472 [1:36:58<27:35:33,  3.53it/s]
  5%|▌         | 20363/371472 [1:36:58<28:00:29,  3.48it/s]
  5%|▌         | 20364/371472 [1:36:59<27:19:43,  3.57it/s]
  5%|▌         | 20365/371472 [1:36:59<26:59:59,  3.61it/s]
  5%|▌         | 20366/371472 [1:36:59<26:44:01,  3.65it/s]
  5%|▌         | 20367/371472 [1:36:59<26:31:52,  3.68it/s]
  5%|▌         | 20368/371472 [1:37:00<26:23:25,  3.70it/s]
  5%|▌         | 20369/371472 [1:37:00<26:17:57,  3.71it/s]
  5%|▌         | 20370/371472 [1:37:00<25:58:16,  3.76it/s]
  5%|▌         | 20371/371472 [1:37:01<26:21:26,  3.70it/s]
  5%|▌         | 20372/371472 [1:37:01<26:53:28,  3.63it/s]
  5%|▌         | 20373/371472 [1:37:01<27:59:36,  3.48it/s]
  5%|▌         | 20374/371472 [1:37:01<28:49:47,  3.38it/s]
  5%|▌         | 20375/371472 [1:37:02<27:28:48,  3.55it/s]
  5%|▌         | 20376/371472 [1:37:02<28:22:09,  3.44it/s]
  5%|▌         | 20377/371472 [1:37:02<28:18:20,  3.45it/s]
  5%|▌         | 20378/371472 [1:37:03<28:21:25,  3.44it/s]
  5%|▌         | 20379/371472 [1:37:03<27:15:30,  3.58it/s]
  5%|▌         | 20380/371472 [1:37:03<28:59:45,  3.36it/s]
                                                           
{'loss': 4.4634, 'learning_rate': 9.510816867417957e-07, 'epoch': 0.88}

  5%|▌         | 20380/371472 [1:37:03<28:59:45,  3.36it/s]
  5%|▌         | 20381/371472 [1:37:04<28:44:51,  3.39it/s]
  5%|▌         | 20382/371472 [1:37:04<28:45:44,  3.39it/s]
  5%|▌         | 20383/371472 [1:37:04<27:43:00,  3.52it/s]
  5%|▌         | 20384/371472 [1:37:04<28:14:28,  3.45it/s]
  5%|▌         | 20385/371472 [1:37:05<27:03:59,  3.60it/s]
  5%|▌         | 20386/371472 [1:37:05<27:46:27,  3.51it/s]
  5%|▌         | 20387/371472 [1:37:05<27:33:44,  3.54it/s]
  5%|▌         | 20388/371472 [1:37:05<26:42:34,  3.65it/s]
  5%|▌         | 20389/371472 [1:37:06<27:34:15,  3.54it/s]
  5%|▌         | 20390/371472 [1:37:06<27:36:20,  3.53it/s]
  5%|▌         | 20391/371472 [1:37:06<26:45:48,  3.64it/s]
  5%|▌         | 20392/371472 [1:37:07<26:30:42,  3.68it/s]
  5%|▌         | 20393/371472 [1:37:07<25:53:12,  3.77it/s]
  5%|▌         | 20394/371472 [1:37:07<26:29:35,  3.68it/s]
  5%|▌         | 20395/371472 [1:37:07<25:43:34,  3.79it/s]
  5%|▌         | 20396/371472 [1:37:08<27:48:18,  3.51it/s]
  5%|▌         | 20397/371472 [1:37:08<27:17:23,  3.57it/s]
  5%|▌         | 20398/371472 [1:37:08<28:14:56,  3.45it/s]
  5%|▌         | 20399/371472 [1:37:09<28:02:43,  3.48it/s]
  5%|▌         | 20400/371472 [1:37:09<27:43:02,  3.52it/s]
                                                           
{'loss': 4.4281, 'learning_rate': 9.510332047663168e-07, 'epoch': 0.88}

  5%|▌         | 20400/371472 [1:37:09<27:43:02,  3.52it/s]
  5%|▌         | 20401/371472 [1:37:09<29:58:14,  3.25it/s]
  5%|▌         | 20402/371472 [1:37:09<28:36:01,  3.41it/s]
  5%|▌         | 20403/371472 [1:37:10<26:54:10,  3.62it/s]
  5%|▌         | 20404/371472 [1:37:10<26:42:30,  3.65it/s]
  5%|▌         | 20405/371472 [1:37:10<26:18:15,  3.71it/s]
  5%|▌         | 20406/371472 [1:37:10<27:08:21,  3.59it/s]
  5%|▌         | 20407/371472 [1:37:11<28:07:01,  3.47it/s]
  5%|▌         | 20408/371472 [1:37:11<27:24:25,  3.56it/s]
  5%|▌         | 20409/371472 [1:37:11<30:17:58,  3.22it/s]
  5%|▌         | 20410/371472 [1:37:12<30:20:03,  3.21it/s]
  5%|▌         | 20411/371472 [1:37:12<28:54:35,  3.37it/s]
  5%|▌         | 20412/371472 [1:37:12<27:37:42,  3.53it/s]
  5%|▌         | 20413/371472 [1:37:13<27:35:54,  3.53it/s]
  5%|▌         | 20414/371472 [1:37:13<28:15:49,  3.45it/s]
  5%|▌         | 20415/371472 [1:37:13<28:05:30,  3.47it/s]
  5%|▌         | 20416/371472 [1:37:13<28:42:14,  3.40it/s]
  5%|▌         | 20417/371472 [1:37:14<27:44:53,  3.51it/s]
  5%|▌         | 20418/371472 [1:37:14<26:44:22,  3.65it/s]
  5%|▌         | 20419/371472 [1:37:14<28:52:27,  3.38it/s]
  5%|▌         | 20420/371472 [1:37:15<28:44:34,  3.39it/s]
                                                           
{'loss': 4.7259, 'learning_rate': 9.50984722790838e-07, 'epoch': 0.88}

  5%|▌         | 20420/371472 [1:37:15<28:44:34,  3.39it/s]
  5%|▌         | 20421/371472 [1:37:15<30:01:40,  3.25it/s]
  5%|▌         | 20422/371472 [1:37:15<29:09:02,  3.35it/s]
  5%|▌         | 20423/371472 [1:37:16<28:37:01,  3.41it/s]
  5%|▌         | 20424/371472 [1:37:16<30:06:28,  3.24it/s]
  5%|▌         | 20425/371472 [1:37:16<28:56:28,  3.37it/s]
  5%|▌         | 20426/371472 [1:37:16<29:35:18,  3.30it/s]
  5%|▌         | 20427/371472 [1:37:17<27:52:06,  3.50it/s]
  5%|▌         | 20428/371472 [1:37:17<26:33:43,  3.67it/s]
  5%|▌         | 20429/371472 [1:37:17<25:47:05,  3.78it/s]
  5%|▌         | 20430/371472 [1:37:18<28:01:34,  3.48it/s]
  6%|▌         | 20431/371472 [1:37:18<27:58:33,  3.49it/s]
  6%|▌         | 20432/371472 [1:37:18<28:52:56,  3.38it/s]
  6%|▌         | 20433/371472 [1:37:18<29:20:04,  3.32it/s]
  6%|▌         | 20434/371472 [1:37:19<29:54:03,  3.26it/s]
  6%|▌         | 20435/371472 [1:37:19<29:18:31,  3.33it/s]
  6%|▌         | 20436/371472 [1:37:19<27:57:19,  3.49it/s]
  6%|▌         | 20437/371472 [1:37:20<27:19:20,  3.57it/s]
  6%|▌         | 20438/371472 [1:37:20<27:55:38,  3.49it/s]
  6%|▌         | 20439/371472 [1:37:20<26:55:46,  3.62it/s]
  6%|▌         | 20440/371472 [1:37:20<26:51:58,  3.63it/s]
                                                           
{'loss': 4.4135, 'learning_rate': 9.50936240815359e-07, 'epoch': 0.88}

  6%|▌         | 20440/371472 [1:37:20<26:51:58,  3.63it/s]
  6%|▌         | 20441/371472 [1:37:21<27:09:51,  3.59it/s]
  6%|▌         | 20442/371472 [1:37:21<26:09:49,  3.73it/s]
  6%|▌         | 20443/371472 [1:37:21<25:53:06,  3.77it/s]
  6%|▌         | 20444/371472 [1:37:21<25:53:39,  3.77it/s]
  6%|▌         | 20445/371472 [1:37:22<27:28:20,  3.55it/s]
  6%|▌         | 20446/371472 [1:37:22<26:45:48,  3.64it/s]
  6%|▌         | 20447/371472 [1:37:22<25:59:30,  3.75it/s]
  6%|▌         | 20448/371472 [1:37:23<25:37:18,  3.81it/s]
  6%|▌         | 20449/371472 [1:37:23<25:40:26,  3.80it/s]
  6%|▌         | 20450/371472 [1:37:23<25:19:59,  3.85it/s]
  6%|▌         | 20451/371472 [1:37:23<26:04:08,  3.74it/s]
  6%|▌         | 20452/371472 [1:37:24<26:52:56,  3.63it/s]
  6%|▌         | 20453/371472 [1:37:24<27:16:13,  3.58it/s]
  6%|▌         | 20454/371472 [1:37:24<26:24:36,  3.69it/s]
  6%|▌         | 20455/371472 [1:37:24<26:32:19,  3.67it/s]
  6%|▌         | 20456/371472 [1:37:25<27:02:19,  3.61it/s]
  6%|▌         | 20457/371472 [1:37:25<26:57:58,  3.62it/s]
  6%|▌         | 20458/371472 [1:37:25<27:07:33,  3.59it/s]
  6%|▌         | 20459/371472 [1:37:26<26:16:11,  3.71it/s]
  6%|▌         | 20460/371472 [1:37:26<26:03:30,  3.74it/s]
                                                           
{'loss': 4.6404, 'learning_rate': 9.508877588398802e-07, 'epoch': 0.88}

  6%|▌         | 20460/371472 [1:37:26<26:03:30,  3.74it/s]
  6%|▌         | 20461/371472 [1:37:26<27:43:21,  3.52it/s]
  6%|▌         | 20462/371472 [1:37:26<27:39:39,  3.52it/s]
  6%|▌         | 20463/371472 [1:37:27<27:29:22,  3.55it/s]
  6%|▌         | 20464/371472 [1:37:27<26:31:47,  3.68it/s]
  6%|▌         | 20465/371472 [1:37:27<27:58:52,  3.48it/s]
  6%|▌         | 20466/371472 [1:37:28<27:59:55,  3.48it/s]
  6%|▌         | 20467/371472 [1:37:28<27:59:49,  3.48it/s]
  6%|▌         | 20468/371472 [1:37:28<26:52:10,  3.63it/s]
  6%|▌         | 20469/371472 [1:37:28<27:19:25,  3.57it/s]
  6%|▌         | 20470/371472 [1:37:29<27:13:44,  3.58it/s]
  6%|▌         | 20471/371472 [1:37:29<26:12:02,  3.72it/s]
  6%|▌         | 20472/371472 [1:37:29<26:50:50,  3.63it/s]
  6%|▌         | 20473/371472 [1:37:29<28:00:40,  3.48it/s]
  6%|▌         | 20474/371472 [1:37:30<27:39:21,  3.53it/s]
  6%|▌         | 20475/371472 [1:37:30<27:03:30,  3.60it/s]
  6%|▌         | 20476/371472 [1:37:30<26:35:38,  3.67it/s]
  6%|▌         | 20477/371472 [1:37:31<26:30:23,  3.68it/s]
  6%|▌         | 20478/371472 [1:37:31<26:02:47,  3.74it/s]
  6%|▌         | 20479/371472 [1:37:31<26:31:56,  3.67it/s]
  6%|▌         | 20480/371472 [1:37:31<28:33:34,  3.41it/s]
                                                           
{'loss': 4.4357, 'learning_rate': 9.508392768644013e-07, 'epoch': 0.88}

  6%|▌         | 20480/371472 [1:37:31<28:33:34,  3.41it/s]
  6%|▌         | 20481/371472 [1:37:32<27:28:56,  3.55it/s]
  6%|▌         | 20482/371472 [1:37:32<26:08:06,  3.73it/s]
  6%|▌         | 20483/371472 [1:37:32<26:24:35,  3.69it/s]
  6%|▌         | 20484/371472 [1:37:32<26:25:00,  3.69it/s]
  6%|▌         | 20485/371472 [1:37:33<25:54:11,  3.76it/s]
  6%|▌         | 20486/371472 [1:37:33<27:19:55,  3.57it/s]
  6%|▌         | 20487/371472 [1:37:33<28:55:45,  3.37it/s]
  6%|▌         | 20488/371472 [1:37:34<30:20:19,  3.21it/s]
  6%|▌         | 20489/371472 [1:37:34<28:48:52,  3.38it/s]
  6%|▌         | 20490/371472 [1:37:34<30:33:58,  3.19it/s]
  6%|▌         | 20491/371472 [1:37:35<29:36:42,  3.29it/s]
  6%|▌         | 20492/371472 [1:37:35<29:08:06,  3.35it/s]
  6%|▌         | 20493/371472 [1:37:35<28:23:22,  3.43it/s]
  6%|▌         | 20494/371472 [1:37:35<27:17:16,  3.57it/s]
  6%|▌         | 20495/371472 [1:37:36<27:20:09,  3.57it/s]
  6%|▌         | 20496/371472 [1:37:36<26:06:41,  3.73it/s]
  6%|▌         | 20497/371472 [1:37:36<26:48:59,  3.64it/s]
  6%|▌         | 20498/371472 [1:37:36<26:31:55,  3.67it/s]
  6%|▌         | 20499/371472 [1:37:37<25:53:50,  3.76it/s]
  6%|▌         | 20500/371472 [1:37:37<26:04:26,  3.74it/s]
                                                           
{'loss': 4.4953, 'learning_rate': 9.507907948889224e-07, 'epoch': 0.88}

  6%|▌         | 20500/371472 [1:37:37<26:04:26,  3.74it/s]
  6%|▌         | 20501/371472 [1:37:37<27:10:36,  3.59it/s]
  6%|▌         | 20502/371472 [1:37:38<26:10:49,  3.72it/s]
  6%|▌         | 20503/371472 [1:37:38<26:28:47,  3.68it/s]
  6%|▌         | 20504/371472 [1:37:38<29:15:16,  3.33it/s]
  6%|▌         | 20505/371472 [1:37:38<28:05:46,  3.47it/s]
  6%|▌         | 20506/371472 [1:37:39<27:44:38,  3.51it/s]
  6%|▌         | 20507/371472 [1:37:39<27:21:12,  3.56it/s]
  6%|▌         | 20508/371472 [1:37:39<27:33:55,  3.54it/s]
  6%|▌         | 20509/371472 [1:37:40<27:07:27,  3.59it/s]
  6%|▌         | 20510/371472 [1:37:40<26:53:17,  3.63it/s]
  6%|▌         | 20511/371472 [1:37:40<26:32:03,  3.67it/s]
  6%|▌         | 20512/371472 [1:37:40<26:35:24,  3.67it/s]
  6%|▌         | 20513/371472 [1:37:41<25:48:56,  3.78it/s]
  6%|▌         | 20514/371472 [1:37:41<25:10:43,  3.87it/s]
  6%|▌         | 20515/371472 [1:37:41<25:12:24,  3.87it/s]
  6%|▌         | 20516/371472 [1:37:41<25:27:31,  3.83it/s]
  6%|▌         | 20517/371472 [1:37:42<26:26:19,  3.69it/s]
  6%|▌         | 20518/371472 [1:37:42<27:02:14,  3.61it/s]
  6%|▌         | 20519/371472 [1:37:42<26:25:35,  3.69it/s]
  6%|▌         | 20520/371472 [1:37:43<29:25:00,  3.31it/s]
                                                           
{'loss': 4.3235, 'learning_rate': 9.507423129134434e-07, 'epoch': 0.88}

  6%|▌         | 20520/371472 [1:37:43<29:25:00,  3.31it/s]
  6%|▌         | 20521/371472 [1:37:43<28:58:46,  3.36it/s]
  6%|▌         | 20522/371472 [1:37:43<28:01:00,  3.48it/s]
  6%|▌         | 20523/371472 [1:37:43<27:21:33,  3.56it/s]
  6%|▌         | 20524/371472 [1:37:44<26:53:36,  3.62it/s]
  6%|▌         | 20525/371472 [1:37:44<28:20:36,  3.44it/s]
  6%|▌         | 20526/371472 [1:37:44<27:05:55,  3.60it/s]
  6%|▌         | 20527/371472 [1:37:45<26:29:19,  3.68it/s]
  6%|▌         | 20528/371472 [1:37:45<26:15:34,  3.71it/s]
  6%|▌         | 20529/371472 [1:37:45<27:03:06,  3.60it/s]
  6%|▌         | 20530/371472 [1:37:45<26:08:08,  3.73it/s]
  6%|▌         | 20531/371472 [1:37:46<27:02:43,  3.60it/s]
  6%|▌         | 20532/371472 [1:37:46<26:00:31,  3.75it/s]
  6%|▌         | 20533/371472 [1:37:46<26:05:16,  3.74it/s]
  6%|▌         | 20534/371472 [1:37:46<26:15:47,  3.71it/s]
  6%|▌         | 20535/371472 [1:37:47<27:39:26,  3.52it/s]
  6%|▌         | 20536/371472 [1:37:47<27:20:56,  3.56it/s]
  6%|▌         | 20537/371472 [1:37:47<29:47:16,  3.27it/s]
  6%|▌         | 20538/371472 [1:37:48<28:52:52,  3.38it/s]
  6%|▌         | 20539/371472 [1:37:48<28:03:36,  3.47it/s]
  6%|▌         | 20540/371472 [1:37:48<30:31:04,  3.19it/s]
                                                           
{'loss': 4.5058, 'learning_rate': 9.506938309379646e-07, 'epoch': 0.88}

  6%|▌         | 20540/371472 [1:37:48<30:31:04,  3.19it/s]
  6%|▌         | 20541/371472 [1:37:49<28:44:29,  3.39it/s]
  6%|▌         | 20542/371472 [1:37:49<27:20:13,  3.57it/s]
  6%|▌         | 20543/371472 [1:37:49<26:49:30,  3.63it/s]
  6%|▌         | 20544/371472 [1:37:49<26:42:01,  3.65it/s]
  6%|▌         | 20545/371472 [1:37:50<26:13:17,  3.72it/s]
  6%|▌         | 20546/371472 [1:37:50<28:42:31,  3.40it/s]
  6%|▌         | 20547/371472 [1:37:50<28:26:39,  3.43it/s]
  6%|▌         | 20548/371472 [1:37:51<28:58:10,  3.36it/s]
  6%|▌         | 20549/371472 [1:37:51<27:56:48,  3.49it/s]
  6%|▌         | 20550/371472 [1:37:51<27:57:39,  3.49it/s]
  6%|▌         | 20551/371472 [1:37:51<28:01:34,  3.48it/s]
  6%|▌         | 20552/371472 [1:37:52<28:18:42,  3.44it/s]
  6%|▌         | 20553/371472 [1:37:52<29:06:04,  3.35it/s]
  6%|▌         | 20554/371472 [1:37:52<28:11:32,  3.46it/s]
  6%|▌         | 20555/371472 [1:37:53<27:03:04,  3.60it/s]
  6%|▌         | 20556/371472 [1:37:53<26:26:27,  3.69it/s]
  6%|▌         | 20557/371472 [1:37:53<26:54:47,  3.62it/s]
  6%|▌         | 20558/371472 [1:37:53<27:13:42,  3.58it/s]
  6%|▌         | 20559/371472 [1:37:54<27:06:17,  3.60it/s]
  6%|▌         | 20560/371472 [1:37:54<26:43:09,  3.65it/s]
                                                           
{'loss': 4.6422, 'learning_rate': 9.506453489624857e-07, 'epoch': 0.89}

  6%|▌         | 20560/371472 [1:37:54<26:43:09,  3.65it/s]
  6%|▌         | 20561/371472 [1:37:54<27:35:04,  3.53it/s]
  6%|▌         | 20562/371472 [1:37:54<27:39:42,  3.52it/s]
  6%|▌         | 20563/371472 [1:37:55<27:47:49,  3.51it/s]
  6%|▌         | 20564/371472 [1:37:55<27:06:00,  3.60it/s]
  6%|▌         | 20565/371472 [1:37:55<27:12:42,  3.58it/s]
  6%|▌         | 20566/371472 [1:37:56<26:54:56,  3.62it/s]
  6%|▌         | 20567/371472 [1:37:56<26:03:17,  3.74it/s]
  6%|▌         | 20568/371472 [1:37:56<25:27:22,  3.83it/s]
  6%|▌         | 20569/371472 [1:37:56<26:25:53,  3.69it/s]
  6%|▌         | 20570/371472 [1:37:57<25:58:48,  3.75it/s]
  6%|▌         | 20571/371472 [1:37:57<26:32:03,  3.67it/s]
  6%|▌         | 20572/371472 [1:37:57<26:15:21,  3.71it/s]
  6%|▌         | 20573/371472 [1:37:57<25:57:35,  3.75it/s]
  6%|▌         | 20574/371472 [1:37:58<32:27:34,  3.00it/s]
  6%|▌         | 20575/371472 [1:37:58<33:28:29,  2.91it/s]
  6%|▌         | 20576/371472 [1:37:59<30:42:23,  3.17it/s]
  6%|▌         | 20577/371472 [1:37:59<29:13:12,  3.34it/s]
  6%|▌         | 20578/371472 [1:37:59<29:28:58,  3.31it/s]
  6%|▌         | 20579/371472 [1:37:59<28:00:24,  3.48it/s]
  6%|▌         | 20580/371472 [1:38:00<27:47:05,  3.51it/s]
                                                           
{'loss': 4.5657, 'learning_rate': 9.505968669870069e-07, 'epoch': 0.89}

  6%|▌         | 20580/371472 [1:38:00<27:47:05,  3.51it/s]
  6%|▌         | 20581/371472 [1:38:00<27:22:50,  3.56it/s]
  6%|▌         | 20582/371472 [1:38:00<27:28:38,  3.55it/s]
  6%|▌         | 20583/371472 [1:38:00<27:06:32,  3.60it/s]
  6%|▌         | 20584/371472 [1:38:01<26:34:00,  3.67it/s]
  6%|▌         | 20585/371472 [1:38:01<28:06:40,  3.47it/s]
  6%|▌         | 20586/371472 [1:38:01<30:22:46,  3.21it/s]
  6%|▌         | 20587/371472 [1:38:02<29:18:49,  3.32it/s]
  6%|▌         | 20588/371472 [1:38:02<29:11:37,  3.34it/s]
  6%|▌         | 20589/371472 [1:38:02<28:08:09,  3.46it/s]
  6%|▌         | 20590/371472 [1:38:03<27:45:13,  3.51it/s]
  6%|▌         | 20591/371472 [1:38:03<28:11:44,  3.46it/s]
  6%|▌         | 20592/371472 [1:38:03<27:09:07,  3.59it/s]
  6%|▌         | 20593/371472 [1:38:03<26:54:49,  3.62it/s]
  6%|▌         | 20594/371472 [1:38:04<26:42:39,  3.65it/s]
  6%|▌         | 20595/371472 [1:38:04<29:53:03,  3.26it/s]
  6%|▌         | 20596/371472 [1:38:04<28:56:02,  3.37it/s]
  6%|▌         | 20597/371472 [1:38:05<28:25:08,  3.43it/s]
  6%|▌         | 20598/371472 [1:38:05<27:55:12,  3.49it/s]
  6%|▌         | 20599/371472 [1:38:05<27:49:53,  3.50it/s]
  6%|▌         | 20600/371472 [1:38:05<28:58:02,  3.36it/s]
                                                           
{'loss': 4.1617, 'learning_rate': 9.505483850115279e-07, 'epoch': 0.89}

  6%|▌         | 20600/371472 [1:38:05<28:58:02,  3.36it/s]
  6%|▌         | 20601/371472 [1:38:06<32:09:55,  3.03it/s]
  6%|▌         | 20602/371472 [1:38:06<30:26:59,  3.20it/s]
  6%|▌         | 20603/371472 [1:38:06<28:48:51,  3.38it/s]
  6%|▌         | 20604/371472 [1:38:07<28:39:50,  3.40it/s]
  6%|▌         | 20605/371472 [1:38:07<30:21:31,  3.21it/s]
  6%|▌         | 20606/371472 [1:38:07<28:54:57,  3.37it/s]
  6%|▌         | 20607/371472 [1:38:08<29:35:41,  3.29it/s]
  6%|▌         | 20608/371472 [1:38:08<29:45:13,  3.28it/s]
  6%|▌         | 20609/371472 [1:38:08<30:20:32,  3.21it/s]
  6%|▌         | 20610/371472 [1:38:08<28:52:22,  3.38it/s]
  6%|▌         | 20611/371472 [1:38:09<28:39:11,  3.40it/s]
  6%|▌         | 20612/371472 [1:38:09<28:47:33,  3.38it/s]
  6%|▌         | 20613/371472 [1:38:09<27:53:04,  3.50it/s]
  6%|▌         | 20614/371472 [1:38:10<28:02:45,  3.48it/s]
  6%|▌         | 20615/371472 [1:38:10<27:23:15,  3.56it/s]
  6%|▌         | 20616/371472 [1:38:10<26:46:38,  3.64it/s]
  6%|▌         | 20617/371472 [1:38:10<27:55:32,  3.49it/s]
  6%|▌         | 20618/371472 [1:38:11<27:49:23,  3.50it/s]
  6%|▌         | 20619/371472 [1:38:11<27:35:58,  3.53it/s]
  6%|▌         | 20620/371472 [1:38:11<29:12:07,  3.34it/s]
                                                           
{'loss': 4.4965, 'learning_rate': 9.50499903036049e-07, 'epoch': 0.89}

  6%|▌         | 20620/371472 [1:38:11<29:12:07,  3.34it/s]
  6%|▌         | 20621/371472 [1:38:12<29:11:19,  3.34it/s]
  6%|▌         | 20622/371472 [1:38:12<29:00:43,  3.36it/s]
  6%|▌         | 20623/371472 [1:38:12<30:22:35,  3.21it/s]
  6%|▌         | 20624/371472 [1:38:13<30:00:56,  3.25it/s]
  6%|▌         | 20625/371472 [1:38:13<28:19:16,  3.44it/s]
  6%|▌         | 20626/371472 [1:38:13<28:14:43,  3.45it/s]
  6%|▌         | 20627/371472 [1:38:13<27:25:09,  3.55it/s]
  6%|▌         | 20628/371472 [1:38:14<26:59:38,  3.61it/s]
  6%|▌         | 20629/371472 [1:38:14<27:32:01,  3.54it/s]
  6%|▌         | 20630/371472 [1:38:14<28:38:05,  3.40it/s]
  6%|▌         | 20631/371472 [1:38:15<28:12:53,  3.45it/s]
  6%|▌         | 20632/371472 [1:38:15<28:00:23,  3.48it/s]
  6%|▌         | 20633/371472 [1:38:15<27:35:18,  3.53it/s]
  6%|▌         | 20634/371472 [1:38:15<26:52:34,  3.63it/s]
  6%|▌         | 20635/371472 [1:38:16<27:47:46,  3.51it/s]
  6%|▌         | 20636/371472 [1:38:16<28:39:41,  3.40it/s]
  6%|▌         | 20637/371472 [1:38:16<27:38:29,  3.53it/s]
  6%|▌         | 20638/371472 [1:38:17<27:15:58,  3.57it/s]
  6%|▌         | 20639/371472 [1:38:17<34:23:31,  2.83it/s]
  6%|▌         | 20640/371472 [1:38:17<32:34:21,  2.99it/s]
                                                           
{'loss': 4.512, 'learning_rate': 9.504514210605701e-07, 'epoch': 0.89}

  6%|▌         | 20640/371472 [1:38:17<32:34:21,  2.99it/s]
  6%|▌         | 20641/371472 [1:38:18<31:29:10,  3.10it/s]
  6%|▌         | 20642/371472 [1:38:18<29:39:39,  3.29it/s]
  6%|▌         | 20643/371472 [1:38:18<29:23:35,  3.32it/s]
  6%|▌         | 20644/371472 [1:38:18<29:09:30,  3.34it/s]
  6%|▌         | 20645/371472 [1:38:19<28:15:27,  3.45it/s]
  6%|▌         | 20646/371472 [1:38:19<27:16:24,  3.57it/s]
  6%|▌         | 20647/371472 [1:38:19<26:35:37,  3.66it/s]
  6%|▌         | 20648/371472 [1:38:20<27:16:05,  3.57it/s]
  6%|▌         | 20649/371472 [1:38:20<26:31:47,  3.67it/s]
  6%|▌         | 20650/371472 [1:38:20<27:31:27,  3.54it/s]
  6%|▌         | 20651/371472 [1:38:20<26:52:06,  3.63it/s]
  6%|▌         | 20652/371472 [1:38:21<26:18:47,  3.70it/s]
  6%|▌         | 20653/371472 [1:38:21<26:15:37,  3.71it/s]
  6%|▌         | 20654/371472 [1:38:21<26:45:11,  3.64it/s]
  6%|▌         | 20655/371472 [1:38:21<27:33:16,  3.54it/s]
  6%|▌         | 20656/371472 [1:38:22<28:59:38,  3.36it/s]
  6%|▌         | 20657/371472 [1:38:22<28:30:39,  3.42it/s]
  6%|▌         | 20658/371472 [1:38:22<30:30:20,  3.19it/s]
  6%|▌         | 20659/371472 [1:38:23<28:46:21,  3.39it/s]
  6%|▌         | 20660/371472 [1:38:23<27:59:23,  3.48it/s]
                                                           
{'loss': 4.5665, 'learning_rate': 9.504029390850912e-07, 'epoch': 0.89}

  6%|▌         | 20660/371472 [1:38:23<27:59:23,  3.48it/s]
  6%|▌         | 20661/371472 [1:38:23<27:11:08,  3.58it/s]
  6%|▌         | 20662/371472 [1:38:24<26:27:53,  3.68it/s]
  6%|▌         | 20663/371472 [1:38:24<26:02:52,  3.74it/s]
  6%|▌         | 20664/371472 [1:38:24<26:20:00,  3.70it/s]
  6%|▌         | 20665/371472 [1:38:24<28:37:03,  3.41it/s]
  6%|▌         | 20666/371472 [1:38:25<27:31:40,  3.54it/s]
  6%|▌         | 20667/371472 [1:38:25<28:11:26,  3.46it/s]
  6%|▌         | 20668/371472 [1:38:25<28:11:18,  3.46it/s]
  6%|▌         | 20669/371472 [1:38:25<27:10:55,  3.58it/s]
  6%|▌         | 20670/371472 [1:38:26<27:14:13,  3.58it/s]
  6%|▌         | 20671/371472 [1:38:26<26:21:18,  3.70it/s]
  6%|▌         | 20672/371472 [1:38:26<25:44:25,  3.79it/s]
  6%|▌         | 20673/371472 [1:38:27<27:17:42,  3.57it/s]
  6%|▌         | 20674/371472 [1:38:27<25:53:04,  3.76it/s]
  6%|▌         | 20675/371472 [1:38:27<25:28:30,  3.83it/s]
  6%|▌         | 20676/371472 [1:38:27<25:53:43,  3.76it/s]
  6%|▌         | 20677/371472 [1:38:28<26:58:49,  3.61it/s]
  6%|▌         | 20678/371472 [1:38:28<26:12:36,  3.72it/s]
  6%|▌         | 20679/371472 [1:38:28<25:57:20,  3.75it/s]
  6%|▌         | 20680/371472 [1:38:28<25:45:01,  3.78it/s]
                                                           
{'loss': 4.6343, 'learning_rate': 9.503544571096123e-07, 'epoch': 0.89}

  6%|▌         | 20680/371472 [1:38:28<25:45:01,  3.78it/s]
  6%|▌         | 20681/371472 [1:38:29<27:27:37,  3.55it/s]
  6%|▌         | 20682/371472 [1:38:29<27:32:32,  3.54it/s]
  6%|▌         | 20683/371472 [1:38:29<26:58:13,  3.61it/s]
  6%|▌         | 20684/371472 [1:38:30<25:52:23,  3.77it/s]
  6%|▌         | 20685/371472 [1:38:30<26:14:21,  3.71it/s]
  6%|▌         | 20686/371472 [1:38:30<26:27:05,  3.68it/s]
  6%|▌         | 20687/371472 [1:38:30<27:36:57,  3.53it/s]
  6%|▌         | 20688/371472 [1:38:31<26:42:32,  3.65it/s]
  6%|▌         | 20689/371472 [1:38:31<25:54:29,  3.76it/s]
  6%|▌         | 20690/371472 [1:38:31<25:39:20,  3.80it/s]
  6%|▌         | 20691/371472 [1:38:31<26:27:46,  3.68it/s]
  6%|▌         | 20692/371472 [1:38:32<26:25:29,  3.69it/s]
  6%|▌         | 20693/371472 [1:38:32<25:40:33,  3.79it/s]
  6%|▌         | 20694/371472 [1:38:32<26:07:53,  3.73it/s]
  6%|▌         | 20695/371472 [1:38:32<25:38:24,  3.80it/s]
  6%|▌         | 20696/371472 [1:38:33<26:51:45,  3.63it/s]
  6%|▌         | 20697/371472 [1:38:33<25:50:03,  3.77it/s]
  6%|▌         | 20698/371472 [1:38:33<25:31:29,  3.82it/s]
  6%|▌         | 20699/371472 [1:38:34<26:58:04,  3.61it/s]
  6%|▌         | 20700/371472 [1:38:34<27:33:25,  3.54it/s]
                                                           
{'loss': 4.5786, 'learning_rate': 9.503059751341334e-07, 'epoch': 0.89}

  6%|▌         | 20700/371472 [1:38:34<27:33:25,  3.54it/s]
  6%|▌         | 20701/371472 [1:38:34<26:44:30,  3.64it/s]
  6%|▌         | 20702/371472 [1:38:34<26:36:15,  3.66it/s]
  6%|▌         | 20703/371472 [1:38:35<31:17:27,  3.11it/s]
  6%|▌         | 20704/371472 [1:38:35<31:10:11,  3.13it/s]
  6%|▌         | 20705/371472 [1:38:35<29:54:01,  3.26it/s]
  6%|▌         | 20706/371472 [1:38:36<30:38:10,  3.18it/s]
  6%|▌         | 20707/371472 [1:38:36<29:29:44,  3.30it/s]
  6%|▌         | 20708/371472 [1:38:36<29:02:34,  3.35it/s]
  6%|▌         | 20709/371472 [1:38:37<29:03:16,  3.35it/s]
  6%|▌         | 20710/371472 [1:38:37<30:54:17,  3.15it/s]
  6%|▌         | 20711/371472 [1:38:37<29:35:08,  3.29it/s]
  6%|▌         | 20712/371472 [1:38:38<29:11:12,  3.34it/s]
  6%|▌         | 20713/371472 [1:38:38<28:45:21,  3.39it/s]
  6%|▌         | 20714/371472 [1:38:38<27:32:50,  3.54it/s]
  6%|▌         | 20715/371472 [1:38:38<28:50:51,  3.38it/s]
  6%|▌         | 20716/371472 [1:38:39<28:17:58,  3.44it/s]
  6%|▌         | 20717/371472 [1:38:39<27:49:23,  3.50it/s]
  6%|▌         | 20718/371472 [1:38:39<26:33:04,  3.67it/s]
  6%|▌         | 20719/371472 [1:38:40<26:35:50,  3.66it/s]
  6%|▌         | 20720/371472 [1:38:40<25:49:55,  3.77it/s]
                                                           
{'loss': 4.2518, 'learning_rate': 9.502574931586546e-07, 'epoch': 0.89}

  6%|▌         | 20720/371472 [1:38:40<25:49:55,  3.77it/s]
  6%|▌         | 20721/371472 [1:38:40<29:42:06,  3.28it/s]
  6%|▌         | 20722/371472 [1:38:40<29:23:45,  3.31it/s]
  6%|▌         | 20723/371472 [1:38:41<31:37:08,  3.08it/s]
  6%|▌         | 20724/371472 [1:38:41<29:28:07,  3.31it/s]
  6%|▌         | 20725/371472 [1:38:41<28:12:11,  3.45it/s]
  6%|▌         | 20726/371472 [1:38:42<28:12:53,  3.45it/s]
  6%|▌         | 20727/371472 [1:38:42<27:41:03,  3.52it/s]
  6%|▌         | 20728/371472 [1:38:42<26:56:00,  3.62it/s]
  6%|▌         | 20729/371472 [1:38:42<26:40:09,  3.65it/s]
  6%|▌         | 20730/371472 [1:38:43<25:53:00,  3.76it/s]
  6%|▌         | 20731/371472 [1:38:43<26:03:58,  3.74it/s]
  6%|▌         | 20732/371472 [1:38:43<25:52:33,  3.77it/s]
  6%|▌         | 20733/371472 [1:38:43<26:30:01,  3.68it/s]
  6%|▌         | 20734/371472 [1:38:44<27:56:01,  3.49it/s]
  6%|▌         | 20735/371472 [1:38:44<28:04:56,  3.47it/s]
  6%|▌         | 20736/371472 [1:38:44<27:11:09,  3.58it/s]
  6%|▌         | 20737/371472 [1:38:45<26:33:29,  3.67it/s]
  6%|▌         | 20738/371472 [1:38:45<26:17:35,  3.71it/s]
  6%|▌         | 20739/371472 [1:38:45<26:32:59,  3.67it/s]
  6%|▌         | 20740/371472 [1:38:45<27:44:00,  3.51it/s]
                                                           
{'loss': 4.3461, 'learning_rate': 9.502090111831756e-07, 'epoch': 0.89}

  6%|▌         | 20740/371472 [1:38:45<27:44:00,  3.51it/s]
  6%|▌         | 20741/371472 [1:38:46<27:26:14,  3.55it/s]
  6%|▌         | 20742/371472 [1:38:46<29:07:12,  3.35it/s]
  6%|▌         | 20743/371472 [1:38:46<28:46:27,  3.39it/s]
  6%|▌         | 20744/371472 [1:38:47<28:13:49,  3.45it/s]
  6%|▌         | 20745/371472 [1:38:47<29:49:10,  3.27it/s]
  6%|▌         | 20746/371472 [1:38:47<28:33:38,  3.41it/s]
  6%|▌         | 20747/371472 [1:38:48<28:14:34,  3.45it/s]
  6%|▌         | 20748/371472 [1:38:48<27:08:58,  3.59it/s]
  6%|▌         | 20749/371472 [1:38:48<28:25:02,  3.43it/s]
  6%|▌         | 20750/371472 [1:38:48<28:28:29,  3.42it/s]
  6%|▌         | 20751/371472 [1:38:49<27:00:16,  3.61it/s]
  6%|▌         | 20752/371472 [1:38:49<26:11:03,  3.72it/s]
  6%|▌         | 20753/371472 [1:38:49<26:55:13,  3.62it/s]
  6%|▌         | 20754/371472 [1:38:49<26:10:12,  3.72it/s]
  6%|▌         | 20755/371472 [1:38:50<26:22:21,  3.69it/s]
  6%|▌         | 20756/371472 [1:38:50<31:11:31,  3.12it/s]
  6%|▌         | 20757/371472 [1:38:50<29:39:56,  3.28it/s]
  6%|▌         | 20758/371472 [1:38:51<28:26:59,  3.42it/s]
  6%|▌         | 20759/371472 [1:38:51<27:17:44,  3.57it/s]
  6%|▌         | 20760/371472 [1:38:51<27:10:11,  3.59it/s]
                                                           
{'loss': 4.6709, 'learning_rate': 9.501605292076967e-07, 'epoch': 0.89}

  6%|▌         | 20760/371472 [1:38:51<27:10:11,  3.59it/s]
  6%|▌         | 20761/371472 [1:38:51<26:32:00,  3.67it/s]
  6%|▌         | 20762/371472 [1:38:52<28:05:04,  3.47it/s]
  6%|▌         | 20763/371472 [1:38:52<28:07:44,  3.46it/s]
  6%|▌         | 20764/371472 [1:38:52<28:13:54,  3.45it/s]
  6%|▌         | 20765/371472 [1:38:53<28:04:47,  3.47it/s]
  6%|▌         | 20766/371472 [1:38:53<29:41:54,  3.28it/s]
  6%|▌         | 20767/371472 [1:38:53<28:00:59,  3.48it/s]
  6%|▌         | 20768/371472 [1:38:54<27:48:57,  3.50it/s]
  6%|▌         | 20769/371472 [1:38:54<27:53:54,  3.49it/s]
  6%|▌         | 20770/371472 [1:38:54<28:38:48,  3.40it/s]
  6%|▌         | 20771/371472 [1:38:54<27:56:22,  3.49it/s]
  6%|▌         | 20772/371472 [1:38:55<27:36:17,  3.53it/s]
  6%|▌         | 20773/371472 [1:38:55<27:21:02,  3.56it/s]
  6%|▌         | 20774/371472 [1:38:55<26:59:44,  3.61it/s]
  6%|▌         | 20775/371472 [1:38:56<27:39:12,  3.52it/s]
  6%|▌         | 20776/371472 [1:38:56<30:33:31,  3.19it/s]
  6%|▌         | 20777/371472 [1:38:56<29:56:41,  3.25it/s]
  6%|▌         | 20778/371472 [1:38:56<29:29:38,  3.30it/s]
  6%|▌         | 20779/371472 [1:38:57<29:04:27,  3.35it/s]
  6%|▌         | 20780/371472 [1:38:57<30:10:48,  3.23it/s]
                                                           
{'loss': 4.441, 'learning_rate': 9.501120472322178e-07, 'epoch': 0.9}

  6%|▌         | 20780/371472 [1:38:57<30:10:48,  3.23it/s]
  6%|▌         | 20781/371472 [1:38:57<30:09:42,  3.23it/s]
  6%|▌         | 20782/371472 [1:38:58<28:57:37,  3.36it/s]
  6%|▌         | 20783/371472 [1:38:58<28:33:23,  3.41it/s]
  6%|▌         | 20784/371472 [1:38:58<28:19:25,  3.44it/s]
  6%|▌         | 20785/371472 [1:38:59<29:07:18,  3.35it/s]
  6%|▌         | 20786/371472 [1:38:59<28:03:23,  3.47it/s]
  6%|▌         | 20787/371472 [1:38:59<27:05:38,  3.60it/s]
  6%|▌         | 20788/371472 [1:38:59<27:40:25,  3.52it/s]
  6%|▌         | 20789/371472 [1:39:00<28:54:09,  3.37it/s]
  6%|▌         | 20790/371472 [1:39:00<28:10:03,  3.46it/s]
  6%|▌         | 20791/371472 [1:39:00<30:06:01,  3.24it/s]
  6%|▌         | 20792/371472 [1:39:01<30:21:50,  3.21it/s]
  6%|▌         | 20793/371472 [1:39:01<29:33:35,  3.30it/s]
  6%|▌         | 20794/371472 [1:39:01<28:17:00,  3.44it/s]
  6%|▌         | 20795/371472 [1:39:01<27:20:30,  3.56it/s]
  6%|▌         | 20796/371472 [1:39:02<26:40:24,  3.65it/s]
  6%|▌         | 20797/371472 [1:39:02<27:31:33,  3.54it/s]
  6%|▌         | 20798/371472 [1:39:02<26:58:29,  3.61it/s]
  6%|▌         | 20799/371472 [1:39:03<29:36:43,  3.29it/s]
  6%|▌         | 20800/371472 [1:39:03<29:06:12,  3.35it/s]
                                                           
{'loss': 4.4467, 'learning_rate': 9.50063565256739e-07, 'epoch': 0.9}

  6%|▌         | 20800/371472 [1:39:03<29:06:12,  3.35it/s]
  6%|▌         | 20801/371472 [1:39:03<28:31:44,  3.41it/s]
  6%|▌         | 20802/371472 [1:39:04<28:24:52,  3.43it/s]
  6%|▌         | 20803/371472 [1:39:04<27:26:25,  3.55it/s]
  6%|▌         | 20804/371472 [1:39:04<28:55:36,  3.37it/s]
  6%|▌         | 20805/371472 [1:39:04<30:04:35,  3.24it/s]
  6%|▌         | 20806/371472 [1:39:05<29:47:46,  3.27it/s]
  6%|▌         | 20807/371472 [1:39:05<28:23:03,  3.43it/s]
  6%|▌         | 20808/371472 [1:39:05<27:55:21,  3.49it/s]
  6%|▌         | 20809/371472 [1:39:06<26:36:40,  3.66it/s]
  6%|▌         | 20810/371472 [1:39:06<26:22:01,  3.69it/s]
  6%|▌         | 20811/371472 [1:39:06<28:20:08,  3.44it/s]
  6%|▌         | 20812/371472 [1:39:06<27:06:05,  3.59it/s]
  6%|▌         | 20813/371472 [1:39:07<28:52:08,  3.37it/s]
  6%|▌         | 20814/371472 [1:39:07<27:19:38,  3.56it/s]
  6%|▌         | 20815/371472 [1:39:07<26:16:05,  3.71it/s]
  6%|▌         | 20816/371472 [1:39:07<26:48:25,  3.63it/s]
  6%|▌         | 20817/371472 [1:39:08<30:07:47,  3.23it/s]
  6%|▌         | 20818/371472 [1:39:08<31:16:36,  3.11it/s]
  6%|▌         | 20819/371472 [1:39:09<32:20:11,  3.01it/s]
  6%|▌         | 20820/371472 [1:39:09<31:59:47,  3.04it/s]
                                                           
{'loss': 4.5218, 'learning_rate': 9.5001508328126e-07, 'epoch': 0.9}

  6%|▌         | 20820/371472 [1:39:09<31:59:47,  3.04it/s]
  6%|▌         | 20821/371472 [1:39:09<31:10:41,  3.12it/s]
  6%|▌         | 20822/371472 [1:39:10<31:25:37,  3.10it/s]
  6%|▌         | 20823/371472 [1:39:10<33:06:33,  2.94it/s]
  6%|▌         | 20824/371472 [1:39:10<30:25:08,  3.20it/s]
  6%|▌         | 20825/371472 [1:39:10<30:34:08,  3.19it/s]
  6%|▌         | 20826/371472 [1:39:11<29:44:38,  3.27it/s]
  6%|▌         | 20827/371472 [1:39:11<29:57:52,  3.25it/s]
  6%|▌         | 20828/371472 [1:39:11<29:05:27,  3.35it/s]
  6%|▌         | 20829/371472 [1:39:12<28:28:09,  3.42it/s]
  6%|▌         | 20830/371472 [1:39:12<27:15:30,  3.57it/s]
  6%|▌         | 20831/371472 [1:39:12<30:37:58,  3.18it/s]
  6%|▌         | 20832/371472 [1:39:13<32:28:46,  3.00it/s]
  6%|▌         | 20833/371472 [1:39:13<31:21:49,  3.11it/s]
  6%|▌         | 20834/371472 [1:39:13<30:25:56,  3.20it/s]
  6%|▌         | 20835/371472 [1:39:14<30:12:15,  3.22it/s]
  6%|▌         | 20836/371472 [1:39:14<28:31:38,  3.41it/s]
  6%|▌         | 20837/371472 [1:39:14<27:53:11,  3.49it/s]
  6%|▌         | 20838/371472 [1:39:14<27:56:57,  3.48it/s]
  6%|▌         | 20839/371472 [1:39:15<27:24:26,  3.55it/s]
  6%|▌         | 20840/371472 [1:39:15<26:17:43,  3.70it/s]
                                                           
{'loss': 4.2716, 'learning_rate': 9.499666013057812e-07, 'epoch': 0.9}

  6%|▌         | 20840/371472 [1:39:15<26:17:43,  3.70it/s]
  6%|▌         | 20841/371472 [1:39:15<26:13:48,  3.71it/s]
  6%|▌         | 20842/371472 [1:39:15<26:40:42,  3.65it/s]
  6%|▌         | 20843/371472 [1:39:16<28:05:35,  3.47it/s]
  6%|▌         | 20844/371472 [1:39:16<27:47:42,  3.50it/s]
  6%|▌         | 20845/371472 [1:39:16<27:25:10,  3.55it/s]
  6%|▌         | 20846/371472 [1:39:17<26:52:36,  3.62it/s]
  6%|▌         | 20847/371472 [1:39:17<26:56:20,  3.62it/s]
  6%|▌         | 20848/371472 [1:39:17<26:20:13,  3.70it/s]
  6%|▌         | 20849/371472 [1:39:17<26:20:50,  3.70it/s]
  6%|▌         | 20850/371472 [1:39:18<27:09:13,  3.59it/s]
  6%|▌         | 20851/371472 [1:39:18<26:50:49,  3.63it/s]
  6%|▌         | 20852/371472 [1:39:18<26:49:27,  3.63it/s]
  6%|▌         | 20853/371472 [1:39:19<29:04:29,  3.35it/s]
  6%|▌         | 20854/371472 [1:39:19<27:44:22,  3.51it/s]
  6%|▌         | 20855/371472 [1:39:19<26:57:27,  3.61it/s]
  6%|▌         | 20856/371472 [1:39:19<27:26:57,  3.55it/s]
  6%|▌         | 20857/371472 [1:39:20<28:55:53,  3.37it/s]
  6%|▌         | 20858/371472 [1:39:20<28:54:08,  3.37it/s]
  6%|▌         | 20859/371472 [1:39:20<27:51:07,  3.50it/s]
  6%|▌         | 20860/371472 [1:39:21<29:14:09,  3.33it/s]
                                                           
{'loss': 4.531, 'learning_rate': 9.499181193303023e-07, 'epoch': 0.9}

  6%|▌         | 20860/371472 [1:39:21<29:14:09,  3.33it/s]
  6%|▌         | 20861/371472 [1:39:21<29:06:09,  3.35it/s]
  6%|▌         | 20862/371472 [1:39:21<30:05:09,  3.24it/s]
  6%|▌         | 20863/371472 [1:39:21<29:26:23,  3.31it/s]
  6%|▌         | 20864/371472 [1:39:22<28:31:42,  3.41it/s]
  6%|▌         | 20865/371472 [1:39:22<30:03:47,  3.24it/s]
  6%|▌         | 20866/371472 [1:39:22<31:42:35,  3.07it/s]
  6%|▌         | 20867/371472 [1:39:23<29:56:57,  3.25it/s]
  6%|▌         | 20868/371472 [1:39:23<28:42:29,  3.39it/s]
  6%|▌         | 20869/371472 [1:39:23<27:44:12,  3.51it/s]
  6%|▌         | 20870/371472 [1:39:24<26:55:51,  3.62it/s]
  6%|▌         | 20871/371472 [1:39:24<28:37:35,  3.40it/s]
  6%|▌         | 20872/371472 [1:39:24<27:20:51,  3.56it/s]
  6%|▌         | 20873/371472 [1:39:24<27:20:38,  3.56it/s]
  6%|▌         | 20874/371472 [1:39:25<27:31:11,  3.54it/s]
  6%|▌         | 20875/371472 [1:39:25<26:19:36,  3.70it/s]
  6%|▌         | 20876/371472 [1:39:25<27:13:25,  3.58it/s]
  6%|▌         | 20877/371472 [1:39:26<27:33:26,  3.53it/s]
  6%|▌         | 20878/371472 [1:39:26<27:57:42,  3.48it/s]
  6%|▌         | 20879/371472 [1:39:26<27:30:27,  3.54it/s]
  6%|▌         | 20880/371472 [1:39:26<27:02:11,  3.60it/s]
                                                           
{'loss': 4.4809, 'learning_rate': 9.498696373548233e-07, 'epoch': 0.9}

  6%|▌         | 20880/371472 [1:39:26<27:02:11,  3.60it/s]
  6%|▌         | 20881/371472 [1:39:27<27:50:25,  3.50it/s]
  6%|▌         | 20882/371472 [1:39:27<26:52:17,  3.62it/s]
  6%|▌         | 20883/371472 [1:39:27<26:23:12,  3.69it/s]
  6%|▌         | 20884/371472 [1:39:28<28:38:08,  3.40it/s]
  6%|▌         | 20885/371472 [1:39:28<30:52:43,  3.15it/s]
  6%|▌         | 20886/371472 [1:39:28<29:34:51,  3.29it/s]
  6%|▌         | 20887/371472 [1:39:28<30:19:03,  3.21it/s]
  6%|▌         | 20888/371472 [1:39:29<28:29:02,  3.42it/s]
  6%|▌         | 20889/371472 [1:39:29<28:34:32,  3.41it/s]
  6%|▌         | 20890/371472 [1:39:29<28:57:14,  3.36it/s]
  6%|▌         | 20891/371472 [1:39:30<29:20:27,  3.32it/s]
  6%|▌         | 20892/371472 [1:39:30<28:27:12,  3.42it/s]
  6%|▌         | 20893/371472 [1:39:30<26:41:52,  3.65it/s]
  6%|▌         | 20894/371472 [1:39:30<26:52:03,  3.62it/s]
  6%|▌         | 20895/371472 [1:39:31<26:42:17,  3.65it/s]
  6%|▌         | 20896/371472 [1:39:31<27:00:40,  3.61it/s]
  6%|▌         | 20897/371472 [1:39:31<26:53:44,  3.62it/s]
  6%|▌         | 20898/371472 [1:39:31<25:58:36,  3.75it/s]
  6%|▌         | 20899/371472 [1:39:32<26:16:27,  3.71it/s]
  6%|▌         | 20900/371472 [1:39:32<27:13:54,  3.58it/s]
                                                           
{'loss': 4.5645, 'learning_rate': 9.498211553793444e-07, 'epoch': 0.9}

  6%|▌         | 20900/371472 [1:39:32<27:13:54,  3.58it/s]
  6%|▌         | 20901/371472 [1:39:32<26:18:58,  3.70it/s]
  6%|▌         | 20902/371472 [1:39:33<26:08:05,  3.73it/s]
  6%|▌         | 20903/371472 [1:39:33<25:46:27,  3.78it/s]
  6%|▌         | 20904/371472 [1:39:33<28:33:05,  3.41it/s]
  6%|▌         | 20905/371472 [1:39:33<28:27:31,  3.42it/s]
  6%|▌         | 20906/371472 [1:39:34<29:05:36,  3.35it/s]
  6%|▌         | 20907/371472 [1:39:34<28:44:20,  3.39it/s]
  6%|▌         | 20908/371472 [1:39:34<27:20:55,  3.56it/s]
  6%|▌         | 20909/371472 [1:39:35<27:26:15,  3.55it/s]
  6%|▌         | 20910/371472 [1:39:35<27:35:22,  3.53it/s]
  6%|▌         | 20911/371472 [1:39:35<26:28:22,  3.68it/s]
  6%|▌         | 20912/371472 [1:39:35<26:55:03,  3.62it/s]
  6%|▌         | 20913/371472 [1:39:36<26:49:13,  3.63it/s]
  6%|▌         | 20914/371472 [1:39:36<28:01:41,  3.47it/s]
  6%|▌         | 20915/371472 [1:39:36<29:07:43,  3.34it/s]
  6%|▌         | 20916/371472 [1:39:37<30:20:48,  3.21it/s]
  6%|▌         | 20917/371472 [1:39:37<30:36:03,  3.18it/s]
  6%|▌         | 20918/371472 [1:39:37<28:43:59,  3.39it/s]
  6%|▌         | 20919/371472 [1:39:38<27:25:03,  3.55it/s]
  6%|▌         | 20920/371472 [1:39:38<26:17:27,  3.70it/s]
                                                           
{'loss': 4.3924, 'learning_rate': 9.497726734038656e-07, 'epoch': 0.9}

  6%|▌         | 20920/371472 [1:39:38<26:17:27,  3.70it/s]
  6%|▌         | 20921/371472 [1:39:38<26:48:47,  3.63it/s]
  6%|▌         | 20922/371472 [1:39:38<26:52:47,  3.62it/s]
  6%|▌         | 20923/371472 [1:39:39<27:15:27,  3.57it/s]
  6%|▌         | 20924/371472 [1:39:39<27:15:30,  3.57it/s]
  6%|▌         | 20925/371472 [1:39:39<28:42:35,  3.39it/s]
  6%|▌         | 20926/371472 [1:39:40<28:53:32,  3.37it/s]
  6%|▌         | 20927/371472 [1:39:40<28:19:13,  3.44it/s]
  6%|▌         | 20928/371472 [1:39:40<28:06:58,  3.46it/s]
  6%|▌         | 20929/371472 [1:39:40<27:58:31,  3.48it/s]
  6%|▌         | 20930/371472 [1:39:41<27:09:58,  3.58it/s]
  6%|▌         | 20931/371472 [1:39:41<28:54:09,  3.37it/s]
  6%|▌         | 20932/371472 [1:39:41<28:11:08,  3.45it/s]
  6%|▌         | 20933/371472 [1:39:42<29:05:17,  3.35it/s]
  6%|▌         | 20934/371472 [1:39:42<28:20:57,  3.43it/s]
  6%|▌         | 20935/371472 [1:39:42<27:43:32,  3.51it/s]
  6%|▌         | 20936/371472 [1:39:42<26:50:13,  3.63it/s]
  6%|▌         | 20937/371472 [1:39:43<26:19:27,  3.70it/s]
  6%|▌         | 20938/371472 [1:39:43<27:22:07,  3.56it/s]
  6%|▌         | 20939/371472 [1:39:43<27:58:29,  3.48it/s]
  6%|▌         | 20940/371472 [1:39:43<27:00:55,  3.60it/s]
                                                           
{'loss': 4.5356, 'learning_rate': 9.497241914283867e-07, 'epoch': 0.9}

  6%|▌         | 20940/371472 [1:39:43<27:00:55,  3.60it/s]
  6%|▌         | 20941/371472 [1:39:44<27:55:51,  3.49it/s]
  6%|▌         | 20942/371472 [1:39:44<27:22:15,  3.56it/s]
  6%|▌         | 20943/371472 [1:39:44<27:09:36,  3.58it/s]
  6%|▌         | 20944/371472 [1:39:45<27:13:40,  3.58it/s]
  6%|▌         | 20945/371472 [1:39:45<27:04:47,  3.60it/s]
  6%|▌         | 20946/371472 [1:39:45<26:51:54,  3.62it/s]
  6%|▌         | 20947/371472 [1:39:45<27:53:54,  3.49it/s]
  6%|▌         | 20948/371472 [1:39:46<27:50:43,  3.50it/s]
  6%|▌         | 20949/371472 [1:39:46<26:52:36,  3.62it/s]
  6%|▌         | 20950/371472 [1:39:46<27:35:44,  3.53it/s]
  6%|▌         | 20951/371472 [1:39:47<29:52:47,  3.26it/s]
  6%|▌         | 20952/371472 [1:39:47<28:24:02,  3.43it/s]
  6%|▌         | 20953/371472 [1:39:47<29:14:51,  3.33it/s]
  6%|▌         | 20954/371472 [1:39:48<30:28:16,  3.20it/s]
  6%|▌         | 20955/371472 [1:39:48<30:25:56,  3.20it/s]
  6%|▌         | 20956/371472 [1:39:48<29:34:12,  3.29it/s]
  6%|▌         | 20957/371472 [1:39:49<31:18:40,  3.11it/s]
  6%|▌         | 20958/371472 [1:39:49<29:20:55,  3.32it/s]
  6%|▌         | 20959/371472 [1:39:49<29:38:10,  3.29it/s]
  6%|▌         | 20960/371472 [1:39:49<30:04:05,  3.24it/s]
                                                           
{'loss': 4.1991, 'learning_rate': 9.496757094529078e-07, 'epoch': 0.9}

  6%|▌         | 20960/371472 [1:39:49<30:04:05,  3.24it/s]
  6%|▌         | 20961/371472 [1:39:50<28:28:22,  3.42it/s]
  6%|▌         | 20962/371472 [1:39:50<28:19:23,  3.44it/s]
  6%|▌         | 20963/371472 [1:39:50<27:41:07,  3.52it/s]
  6%|▌         | 20964/371472 [1:39:51<27:54:46,  3.49it/s]
  6%|▌         | 20965/371472 [1:39:51<27:57:37,  3.48it/s]
  6%|▌         | 20966/371472 [1:39:51<26:57:03,  3.61it/s]
  6%|▌         | 20967/371472 [1:39:51<26:04:29,  3.73it/s]
  6%|▌         | 20968/371472 [1:39:52<26:00:10,  3.74it/s]
  6%|▌         | 20969/371472 [1:39:52<26:49:54,  3.63it/s]
  6%|▌         | 20970/371472 [1:39:52<26:13:08,  3.71it/s]
  6%|▌         | 20971/371472 [1:39:52<25:23:57,  3.83it/s]
  6%|▌         | 20972/371472 [1:39:53<25:06:42,  3.88it/s]
  6%|▌         | 20973/371472 [1:39:53<25:29:00,  3.82it/s]
  6%|▌         | 20974/371472 [1:39:53<25:54:27,  3.76it/s]
  6%|▌         | 20975/371472 [1:39:53<26:10:38,  3.72it/s]
  6%|▌         | 20976/371472 [1:39:54<27:18:00,  3.57it/s]
  6%|▌         | 20977/371472 [1:39:54<26:59:17,  3.61it/s]
  6%|▌         | 20978/371472 [1:39:54<27:37:38,  3.52it/s]
  6%|▌         | 20979/371472 [1:39:55<28:28:46,  3.42it/s]
  6%|▌         | 20980/371472 [1:39:55<27:07:02,  3.59it/s]
                                                           
{'loss': 4.4928, 'learning_rate': 9.496272274774289e-07, 'epoch': 0.9}

  6%|▌         | 20980/371472 [1:39:55<27:07:02,  3.59it/s]
  6%|▌         | 20981/371472 [1:39:55<27:05:58,  3.59it/s]
  6%|▌         | 20982/371472 [1:39:55<26:55:36,  3.62it/s]
  6%|▌         | 20983/371472 [1:39:56<26:30:48,  3.67it/s]
  6%|▌         | 20984/371472 [1:39:56<34:37:18,  2.81it/s]
  6%|▌         | 20985/371472 [1:39:56<31:17:05,  3.11it/s]
  6%|▌         | 20986/371472 [1:39:57<30:28:33,  3.19it/s]
  6%|▌         | 20987/371472 [1:39:57<29:10:23,  3.34it/s]
  6%|▌         | 20988/371472 [1:39:57<27:42:32,  3.51it/s]
  6%|▌         | 20989/371472 [1:39:58<27:03:56,  3.60it/s]
  6%|▌         | 20990/371472 [1:39:58<26:34:01,  3.66it/s]
  6%|▌         | 20991/371472 [1:39:58<27:27:59,  3.54it/s]
  6%|▌         | 20992/371472 [1:39:58<27:32:08,  3.54it/s]
  6%|▌         | 20993/371472 [1:39:59<28:23:19,  3.43it/s]
  6%|▌         | 20994/371472 [1:39:59<27:31:06,  3.54it/s]
  6%|▌         | 20995/371472 [1:39:59<27:46:04,  3.51it/s]
  6%|▌         | 20996/371472 [1:40:00<29:32:32,  3.30it/s]
  6%|▌         | 20997/371472 [1:40:00<28:26:40,  3.42it/s]
  6%|▌         | 20998/371472 [1:40:00<27:16:51,  3.57it/s]
  6%|▌         | 20999/371472 [1:40:00<28:19:46,  3.44it/s]
  6%|▌         | 21000/371472 [1:40:01<27:32:13,  3.54it/s]
                                                           
{'loss': 4.6196, 'learning_rate': 9.4957874550195e-07, 'epoch': 0.9}

  6%|▌         | 21000/371472 [1:40:01<27:32:13,  3.54it/s]
  6%|▌         | 21001/371472 [1:40:01<26:12:59,  3.71it/s]
  6%|▌         | 21002/371472 [1:40:01<26:51:46,  3.62it/s]
  6%|▌         | 21003/371472 [1:40:02<27:21:32,  3.56it/s]
  6%|▌         | 21004/371472 [1:40:02<27:11:24,  3.58it/s]
  6%|▌         | 21005/371472 [1:40:02<26:28:34,  3.68it/s]
  6%|▌         | 21006/371472 [1:40:02<26:33:51,  3.66it/s]
  6%|▌         | 21007/371472 [1:40:03<26:25:59,  3.68it/s]
  6%|▌         | 21008/371472 [1:40:03<25:51:39,  3.76it/s]
  6%|▌         | 21009/371472 [1:40:03<25:47:47,  3.77it/s]
  6%|▌         | 21010/371472 [1:40:03<25:58:39,  3.75it/s]
  6%|▌         | 21011/371472 [1:40:04<27:24:41,  3.55it/s]
  6%|▌         | 21012/371472 [1:40:04<26:52:55,  3.62it/s]
  6%|▌         | 21013/371472 [1:40:04<27:41:51,  3.51it/s]
  6%|▌         | 21014/371472 [1:40:05<26:45:00,  3.64it/s]
  6%|▌         | 21015/371472 [1:40:05<29:54:59,  3.25it/s]
  6%|▌         | 21016/371472 [1:40:05<30:21:19,  3.21it/s]
  6%|▌         | 21017/371472 [1:40:06<29:59:18,  3.25it/s]
  6%|▌         | 21018/371472 [1:40:06<30:03:43,  3.24it/s]
  6%|▌         | 21019/371472 [1:40:06<31:42:54,  3.07it/s]
  6%|▌         | 21020/371472 [1:40:07<30:36:23,  3.18it/s]
                                                           
{'loss': 4.2559, 'learning_rate': 9.495302635264711e-07, 'epoch': 0.91}

  6%|▌         | 21020/371472 [1:40:07<30:36:23,  3.18it/s]
  6%|▌         | 21021/371472 [1:40:07<29:16:00,  3.33it/s]
  6%|▌         | 21022/371472 [1:40:07<29:04:28,  3.35it/s]
  6%|▌         | 21023/371472 [1:40:07<28:27:25,  3.42it/s]
  6%|▌         | 21024/371472 [1:40:08<27:12:17,  3.58it/s]
  6%|▌         | 21025/371472 [1:40:08<26:53:16,  3.62it/s]
  6%|▌         | 21026/371472 [1:40:08<27:02:21,  3.60it/s]
  6%|▌         | 21027/371472 [1:40:08<27:06:30,  3.59it/s]
  6%|▌         | 21028/371472 [1:40:09<30:19:24,  3.21it/s]
  6%|▌         | 21029/371472 [1:40:09<29:28:59,  3.30it/s]
  6%|▌         | 21030/371472 [1:40:09<30:35:50,  3.18it/s]
  6%|▌         | 21031/371472 [1:40:10<29:01:28,  3.35it/s]
  6%|▌         | 21032/371472 [1:40:10<27:59:43,  3.48it/s]
  6%|▌         | 21033/371472 [1:40:10<27:46:29,  3.50it/s]
  6%|▌         | 21034/371472 [1:40:10<26:25:14,  3.68it/s]
  6%|▌         | 21035/371472 [1:40:11<25:57:23,  3.75it/s]
  6%|▌         | 21036/371472 [1:40:11<27:56:25,  3.48it/s]
  6%|▌         | 21037/371472 [1:40:11<30:02:42,  3.24it/s]
  6%|▌         | 21038/371472 [1:40:12<30:13:41,  3.22it/s]
  6%|▌         | 21039/371472 [1:40:12<29:28:45,  3.30it/s]
  6%|▌         | 21040/371472 [1:40:12<28:46:45,  3.38it/s]
                                                           
{'loss': 4.6048, 'learning_rate': 9.494817815509922e-07, 'epoch': 0.91}

  6%|▌         | 21040/371472 [1:40:12<28:46:45,  3.38it/s]
  6%|▌         | 21041/371472 [1:40:13<28:31:45,  3.41it/s]
  6%|▌         | 21042/371472 [1:40:13<26:56:50,  3.61it/s]
  6%|▌         | 21043/371472 [1:40:13<27:49:15,  3.50it/s]
  6%|▌         | 21044/371472 [1:40:13<27:22:21,  3.56it/s]
  6%|▌         | 21045/371472 [1:40:14<26:08:05,  3.72it/s]
  6%|▌         | 21046/371472 [1:40:14<25:47:10,  3.77it/s]
  6%|▌         | 21047/371472 [1:40:14<25:25:34,  3.83it/s]
  6%|▌         | 21048/371472 [1:40:14<25:45:24,  3.78it/s]
  6%|▌         | 21049/371472 [1:40:15<27:20:26,  3.56it/s]
  6%|▌         | 21050/371472 [1:40:15<27:42:43,  3.51it/s]
  6%|▌         | 21051/371472 [1:40:15<28:18:41,  3.44it/s]
  6%|▌         | 21052/371472 [1:40:16<31:32:18,  3.09it/s]
  6%|▌         | 21053/371472 [1:40:16<30:02:33,  3.24it/s]
  6%|▌         | 21054/371472 [1:40:16<29:33:34,  3.29it/s]
  6%|▌         | 21055/371472 [1:40:17<28:28:02,  3.42it/s]
  6%|▌         | 21056/371472 [1:40:17<27:55:11,  3.49it/s]
  6%|▌         | 21057/371472 [1:40:17<28:03:53,  3.47it/s]
  6%|▌         | 21058/371472 [1:40:17<26:45:47,  3.64it/s]
  6%|▌         | 21059/371472 [1:40:18<26:20:01,  3.70it/s]
  6%|▌         | 21060/371472 [1:40:18<25:48:42,  3.77it/s]
                                                           
{'loss': 4.6164, 'learning_rate': 9.494332995755133e-07, 'epoch': 0.91}

  6%|▌         | 21060/371472 [1:40:18<25:48:42,  3.77it/s]
  6%|▌         | 21061/371472 [1:40:18<27:12:29,  3.58it/s]
  6%|▌         | 21062/371472 [1:40:18<26:23:27,  3.69it/s]
  6%|▌         | 21063/371472 [1:40:19<28:47:14,  3.38it/s]
  6%|▌         | 21064/371472 [1:40:19<29:51:26,  3.26it/s]
  6%|▌         | 21065/371472 [1:40:19<28:54:06,  3.37it/s]
  6%|▌         | 21066/371472 [1:40:20<29:30:04,  3.30it/s]
  6%|▌         | 21067/371472 [1:40:20<29:49:34,  3.26it/s]
  6%|▌         | 21068/371472 [1:40:20<27:54:37,  3.49it/s]
  6%|▌         | 21069/371472 [1:40:21<27:05:24,  3.59it/s]
  6%|▌         | 21070/371472 [1:40:21<27:08:55,  3.59it/s]
  6%|▌         | 21071/371472 [1:40:21<30:11:35,  3.22it/s]
  6%|▌         | 21072/371472 [1:40:22<30:53:19,  3.15it/s]
  6%|▌         | 21073/371472 [1:40:22<29:09:44,  3.34it/s]
  6%|▌         | 21074/371472 [1:40:22<28:42:21,  3.39it/s]
  6%|▌         | 21075/371472 [1:40:22<29:29:19,  3.30it/s]
  6%|▌         | 21076/371472 [1:40:23<30:36:56,  3.18it/s]
  6%|▌         | 21077/371472 [1:40:23<30:54:24,  3.15it/s]
  6%|▌         | 21078/371472 [1:40:23<30:16:39,  3.21it/s]
  6%|▌         | 21079/371472 [1:40:24<29:11:44,  3.33it/s]
  6%|▌         | 21080/371472 [1:40:24<29:07:41,  3.34it/s]
                                                           
{'loss': 4.4236, 'learning_rate': 9.493848176000345e-07, 'epoch': 0.91}

  6%|▌         | 21080/371472 [1:40:24<29:07:41,  3.34it/s]
  6%|▌         | 21081/371472 [1:40:24<27:21:18,  3.56it/s]
  6%|▌         | 21082/371472 [1:40:24<27:40:05,  3.52it/s]
  6%|▌         | 21083/371472 [1:40:25<26:58:01,  3.61it/s]
  6%|▌         | 21084/371472 [1:40:25<26:13:49,  3.71it/s]
  6%|▌         | 21085/371472 [1:40:25<26:23:18,  3.69it/s]
  6%|▌         | 21086/371472 [1:40:26<29:14:34,  3.33it/s]
  6%|▌         | 21087/371472 [1:40:26<29:14:32,  3.33it/s]
  6%|▌         | 21088/371472 [1:40:26<28:28:49,  3.42it/s]
  6%|▌         | 21089/371472 [1:40:26<27:39:23,  3.52it/s]
  6%|▌         | 21090/371472 [1:40:27<27:16:24,  3.57it/s]
  6%|▌         | 21091/371472 [1:40:27<27:34:45,  3.53it/s]
  6%|▌         | 21092/371472 [1:40:27<28:18:14,  3.44it/s]
  6%|▌         | 21093/371472 [1:40:28<26:43:14,  3.64it/s]
  6%|▌         | 21094/371472 [1:40:28<29:52:29,  3.26it/s]
  6%|▌         | 21095/371472 [1:40:28<30:13:32,  3.22it/s]
  6%|▌         | 21096/371472 [1:40:29<28:35:27,  3.40it/s]
  6%|▌         | 21097/371472 [1:40:29<27:42:06,  3.51it/s]
  6%|▌         | 21098/371472 [1:40:29<28:02:23,  3.47it/s]
  6%|▌         | 21099/371472 [1:40:29<26:47:52,  3.63it/s]
  6%|▌         | 21100/371472 [1:40:30<26:18:17,  3.70it/s]
                                                           
{'loss': 4.4766, 'learning_rate': 9.493363356245556e-07, 'epoch': 0.91}

  6%|▌         | 21100/371472 [1:40:30<26:18:17,  3.70it/s]
  6%|▌         | 21101/371472 [1:40:30<25:42:39,  3.79it/s]
  6%|▌         | 21102/371472 [1:40:30<28:08:28,  3.46it/s]
  6%|▌         | 21103/371472 [1:40:31<28:47:29,  3.38it/s]
  6%|▌         | 21104/371472 [1:40:31<28:39:40,  3.40it/s]
  6%|▌         | 21105/371472 [1:40:31<29:37:23,  3.29it/s]
  6%|▌         | 21106/371472 [1:40:31<28:52:09,  3.37it/s]
  6%|▌         | 21107/371472 [1:40:32<28:53:20,  3.37it/s]
  6%|▌         | 21108/371472 [1:40:32<29:06:27,  3.34it/s]
  6%|▌         | 21109/371472 [1:40:32<29:22:53,  3.31it/s]
  6%|▌         | 21110/371472 [1:40:33<27:56:20,  3.48it/s]
  6%|▌         | 21111/371472 [1:40:33<26:50:18,  3.63it/s]
  6%|▌         | 21112/371472 [1:40:33<25:57:56,  3.75it/s]
  6%|▌         | 21113/371472 [1:40:33<25:24:27,  3.83it/s]
  6%|▌         | 21114/371472 [1:40:34<25:18:45,  3.84it/s]
  6%|▌         | 21115/371472 [1:40:34<24:52:15,  3.91it/s]
  6%|▌         | 21116/371472 [1:40:34<24:50:13,  3.92it/s]
  6%|▌         | 21117/371472 [1:40:34<25:45:54,  3.78it/s]
  6%|▌         | 21118/371472 [1:40:35<26:40:22,  3.65it/s]
  6%|▌         | 21119/371472 [1:40:35<26:26:30,  3.68it/s]
  6%|▌         | 21120/371472 [1:40:35<25:58:25,  3.75it/s]
                                                           
{'loss': 4.457, 'learning_rate': 9.492878536490767e-07, 'epoch': 0.91}

  6%|▌         | 21120/371472 [1:40:35<25:58:25,  3.75it/s]
  6%|▌         | 21121/371472 [1:40:35<25:14:44,  3.85it/s]
  6%|▌         | 21122/371472 [1:40:36<25:40:15,  3.79it/s]
  6%|▌         | 21123/371472 [1:40:36<26:42:45,  3.64it/s]
  6%|▌         | 21124/371472 [1:40:36<27:24:42,  3.55it/s]
  6%|▌         | 21125/371472 [1:40:37<27:05:34,  3.59it/s]
  6%|▌         | 21126/371472 [1:40:37<27:11:31,  3.58it/s]
  6%|▌         | 21127/371472 [1:40:37<26:58:08,  3.61it/s]
  6%|▌         | 21128/371472 [1:40:37<27:44:46,  3.51it/s]
  6%|▌         | 21129/371472 [1:40:38<30:18:05,  3.21it/s]
  6%|▌         | 21130/371472 [1:40:38<29:48:47,  3.26it/s]
  6%|▌         | 21131/371472 [1:40:38<28:58:33,  3.36it/s]
  6%|▌         | 21132/371472 [1:40:39<27:19:02,  3.56it/s]
  6%|▌         | 21133/371472 [1:40:39<27:11:12,  3.58it/s]
  6%|▌         | 21134/371472 [1:40:39<27:21:15,  3.56it/s]
  6%|▌         | 21135/371472 [1:40:39<27:35:19,  3.53it/s]
  6%|▌         | 21136/371472 [1:40:40<27:55:07,  3.49it/s]
  6%|▌         | 21137/371472 [1:40:40<27:48:36,  3.50it/s]
  6%|▌         | 21138/371472 [1:40:40<28:01:10,  3.47it/s]
  6%|▌         | 21139/371472 [1:40:41<26:53:28,  3.62it/s]
  6%|▌         | 21140/371472 [1:40:41<27:14:15,  3.57it/s]
                                                           
{'loss': 4.4613, 'learning_rate': 9.492393716735977e-07, 'epoch': 0.91}

  6%|▌         | 21140/371472 [1:40:41<27:14:15,  3.57it/s]
  6%|▌         | 21141/371472 [1:40:41<26:51:38,  3.62it/s]
  6%|▌         | 21142/371472 [1:40:41<26:47:41,  3.63it/s]
  6%|▌         | 21143/371472 [1:40:42<27:10:29,  3.58it/s]
  6%|▌         | 21144/371472 [1:40:42<27:49:27,  3.50it/s]
  6%|▌         | 21145/371472 [1:40:42<29:25:41,  3.31it/s]
  6%|▌         | 21146/371472 [1:40:43<28:48:27,  3.38it/s]
  6%|▌         | 21147/371472 [1:40:43<29:17:27,  3.32it/s]
  6%|▌         | 21148/371472 [1:40:43<28:35:23,  3.40it/s]
  6%|▌         | 21149/371472 [1:40:44<28:46:24,  3.38it/s]
  6%|▌         | 21150/371472 [1:40:44<28:16:28,  3.44it/s]
  6%|▌         | 21151/371472 [1:40:44<28:02:36,  3.47it/s]
  6%|▌         | 21152/371472 [1:40:44<27:28:51,  3.54it/s]
  6%|▌         | 21153/371472 [1:40:45<27:20:11,  3.56it/s]
  6%|▌         | 21154/371472 [1:40:45<26:50:20,  3.63it/s]
  6%|▌         | 21155/371472 [1:40:45<28:30:47,  3.41it/s]
  6%|▌         | 21156/371472 [1:40:46<28:12:37,  3.45it/s]
  6%|▌         | 21157/371472 [1:40:46<29:48:40,  3.26it/s]
  6%|▌         | 21158/371472 [1:40:46<29:51:35,  3.26it/s]
  6%|▌         | 21159/371472 [1:40:46<28:43:41,  3.39it/s]
  6%|▌         | 21160/371472 [1:40:47<27:13:09,  3.57it/s]
                                                           
{'loss': 4.3311, 'learning_rate': 9.491908896981189e-07, 'epoch': 0.91}

  6%|▌         | 21160/371472 [1:40:47<27:13:09,  3.57it/s]
  6%|▌         | 21161/371472 [1:40:47<27:14:30,  3.57it/s]
  6%|▌         | 21162/371472 [1:40:47<26:58:53,  3.61it/s]
  6%|▌         | 21163/371472 [1:40:48<27:35:17,  3.53it/s]
  6%|▌         | 21164/371472 [1:40:48<27:55:52,  3.48it/s]
  6%|▌         | 21165/371472 [1:40:48<26:57:45,  3.61it/s]
  6%|▌         | 21166/371472 [1:40:48<28:52:37,  3.37it/s]
  6%|▌         | 21167/371472 [1:40:49<29:33:27,  3.29it/s]
  6%|▌         | 21168/371472 [1:40:49<28:41:14,  3.39it/s]
  6%|▌         | 21169/371472 [1:40:49<27:46:37,  3.50it/s]
  6%|▌         | 21170/371472 [1:40:50<27:00:28,  3.60it/s]
  6%|▌         | 21171/371472 [1:40:50<27:32:01,  3.53it/s]
  6%|▌         | 21172/371472 [1:40:50<26:39:46,  3.65it/s]
  6%|▌         | 21173/371472 [1:40:50<27:56:20,  3.48it/s]
  6%|▌         | 21174/371472 [1:40:51<28:14:36,  3.45it/s]
  6%|▌         | 21175/371472 [1:40:51<28:00:24,  3.47it/s]
  6%|▌         | 21176/371472 [1:40:51<27:58:28,  3.48it/s]
  6%|▌         | 21177/371472 [1:40:52<28:53:38,  3.37it/s]
  6%|▌         | 21178/371472 [1:40:52<28:54:20,  3.37it/s]
  6%|▌         | 21179/371472 [1:40:52<27:36:25,  3.52it/s]
  6%|▌         | 21180/371472 [1:40:52<26:42:16,  3.64it/s]
                                                           
{'loss': 4.4791, 'learning_rate': 9.4914240772264e-07, 'epoch': 0.91}

  6%|▌         | 21180/371472 [1:40:52<26:42:16,  3.64it/s]
  6%|▌         | 21181/371472 [1:40:53<25:59:33,  3.74it/s]
  6%|▌         | 21182/371472 [1:40:53<26:38:52,  3.65it/s]
  6%|▌         | 21183/371472 [1:40:53<25:54:39,  3.76it/s]
  6%|▌         | 21184/371472 [1:40:53<25:50:00,  3.77it/s]
  6%|▌         | 21185/371472 [1:40:54<25:38:51,  3.79it/s]
  6%|▌         | 21186/371472 [1:40:54<26:13:43,  3.71it/s]
  6%|▌         | 21187/371472 [1:40:54<27:13:36,  3.57it/s]
  6%|▌         | 21188/371472 [1:40:55<27:32:00,  3.53it/s]
  6%|▌         | 21189/371472 [1:40:55<27:40:44,  3.52it/s]
  6%|▌         | 21190/371472 [1:40:55<31:13:01,  3.12it/s]
  6%|▌         | 21191/371472 [1:40:56<33:16:02,  2.92it/s]
  6%|▌         | 21192/371472 [1:40:56<32:10:56,  3.02it/s]
  6%|▌         | 21193/371472 [1:40:56<30:28:09,  3.19it/s]
  6%|▌         | 21194/371472 [1:40:56<29:01:32,  3.35it/s]
  6%|▌         | 21195/371472 [1:40:57<28:27:47,  3.42it/s]
  6%|▌         | 21196/371472 [1:40:57<27:09:19,  3.58it/s]
  6%|▌         | 21197/371472 [1:40:57<27:13:35,  3.57it/s]
  6%|▌         | 21198/371472 [1:40:58<26:26:26,  3.68it/s]
  6%|▌         | 21199/371472 [1:40:58<27:27:24,  3.54it/s]
  6%|▌         | 21200/371472 [1:40:58<28:46:44,  3.38it/s]
                                                           
{'loss': 4.5871, 'learning_rate': 9.49093925747161e-07, 'epoch': 0.91}

  6%|▌         | 21200/371472 [1:40:58<28:46:44,  3.38it/s]
  6%|▌         | 21201/371472 [1:40:58<28:01:03,  3.47it/s]
  6%|▌         | 21202/371472 [1:40:59<28:05:20,  3.46it/s]
  6%|▌         | 21203/371472 [1:40:59<28:39:50,  3.39it/s]
  6%|▌         | 21204/371472 [1:40:59<27:29:17,  3.54it/s]
  6%|▌         | 21205/371472 [1:41:00<26:32:01,  3.67it/s]
  6%|▌         | 21206/371472 [1:41:00<26:21:17,  3.69it/s]
  6%|▌         | 21207/371472 [1:41:00<26:21:01,  3.69it/s]
  6%|▌         | 21208/371472 [1:41:00<28:07:45,  3.46it/s]
  6%|▌         | 21209/371472 [1:41:01<27:44:37,  3.51it/s]
  6%|▌         | 21210/371472 [1:41:01<26:54:17,  3.62it/s]
  6%|▌         | 21211/371472 [1:41:01<26:12:48,  3.71it/s]
  6%|▌         | 21212/371472 [1:41:01<25:42:08,  3.79it/s]
  6%|▌         | 21213/371472 [1:41:02<26:33:09,  3.66it/s]
  6%|▌         | 21214/371472 [1:41:02<26:05:47,  3.73it/s]
  6%|▌         | 21215/371472 [1:41:02<27:02:11,  3.60it/s]
  6%|▌         | 21216/371472 [1:41:03<26:54:28,  3.62it/s]
  6%|▌         | 21217/371472 [1:41:03<28:46:15,  3.38it/s]
  6%|▌         | 21218/371472 [1:41:03<29:58:12,  3.25it/s]
  6%|▌         | 21219/371472 [1:41:04<29:42:06,  3.28it/s]
  6%|▌         | 21220/371472 [1:41:04<27:54:05,  3.49it/s]
                                                           
{'loss': 4.5684, 'learning_rate': 9.490454437716822e-07, 'epoch': 0.91}

  6%|▌         | 21220/371472 [1:41:04<27:54:05,  3.49it/s]
  6%|▌         | 21221/371472 [1:41:04<28:53:30,  3.37it/s]
  6%|▌         | 21222/371472 [1:41:04<28:27:09,  3.42it/s]
  6%|▌         | 21223/371472 [1:41:05<27:38:33,  3.52it/s]
  6%|▌         | 21224/371472 [1:41:05<29:10:25,  3.33it/s]
  6%|▌         | 21225/371472 [1:41:05<28:21:19,  3.43it/s]
  6%|▌         | 21226/371472 [1:41:06<28:04:29,  3.47it/s]
  6%|▌         | 21227/371472 [1:41:06<28:16:30,  3.44it/s]
  6%|▌         | 21228/371472 [1:41:06<27:39:00,  3.52it/s]
  6%|▌         | 21229/371472 [1:41:06<27:25:31,  3.55it/s]
  6%|▌         | 21230/371472 [1:41:07<27:45:24,  3.51it/s]
  6%|▌         | 21231/371472 [1:41:07<27:14:18,  3.57it/s]
  6%|▌         | 21232/371472 [1:41:07<26:44:50,  3.64it/s]
  6%|▌         | 21233/371472 [1:41:08<29:38:40,  3.28it/s]
  6%|▌         | 21234/371472 [1:41:08<28:12:05,  3.45it/s]
  6%|▌         | 21235/371472 [1:41:08<31:41:51,  3.07it/s]
  6%|▌         | 21236/371472 [1:41:09<30:28:11,  3.19it/s]
  6%|▌         | 21237/371472 [1:41:09<28:32:32,  3.41it/s]
  6%|▌         | 21238/371472 [1:41:09<27:34:44,  3.53it/s]
  6%|▌         | 21239/371472 [1:41:09<27:18:39,  3.56it/s]
  6%|▌         | 21240/371472 [1:41:10<26:40:27,  3.65it/s]
                                                           
{'loss': 4.5018, 'learning_rate': 9.489969617962033e-07, 'epoch': 0.91}

  6%|▌         | 21240/371472 [1:41:10<26:40:27,  3.65it/s]
  6%|▌         | 21241/371472 [1:41:10<26:21:28,  3.69it/s]
  6%|▌         | 21242/371472 [1:41:10<25:51:49,  3.76it/s]
  6%|▌         | 21243/371472 [1:41:10<26:19:19,  3.70it/s]
  6%|▌         | 21244/371472 [1:41:11<27:31:20,  3.53it/s]
  6%|▌         | 21245/371472 [1:41:11<27:07:57,  3.59it/s]
  6%|▌         | 21246/371472 [1:41:11<26:59:51,  3.60it/s]
  6%|▌         | 21247/371472 [1:41:12<26:15:19,  3.71it/s]
  6%|▌         | 21248/371472 [1:41:12<28:10:30,  3.45it/s]
  6%|▌         | 21249/371472 [1:41:12<27:04:01,  3.59it/s]
  6%|▌         | 21250/371472 [1:41:12<26:53:45,  3.62it/s]
  6%|▌         | 21251/371472 [1:41:13<28:01:10,  3.47it/s]
  6%|▌         | 21252/371472 [1:41:13<28:51:12,  3.37it/s]
  6%|▌         | 21253/371472 [1:41:13<29:31:08,  3.30it/s]
  6%|▌         | 21254/371472 [1:41:14<28:41:07,  3.39it/s]
  6%|▌         | 21255/371472 [1:41:14<28:16:59,  3.44it/s]
  6%|▌         | 21256/371472 [1:41:14<27:43:22,  3.51it/s]
  6%|▌         | 21257/371472 [1:41:14<27:39:08,  3.52it/s]
  6%|▌         | 21258/371472 [1:41:15<27:58:56,  3.48it/s]
  6%|▌         | 21259/371472 [1:41:15<27:23:30,  3.55it/s]
  6%|▌         | 21260/371472 [1:41:15<27:07:08,  3.59it/s]
                                                           
{'loss': 4.4402, 'learning_rate': 9.489484798207243e-07, 'epoch': 0.92}

  6%|▌         | 21260/371472 [1:41:15<27:07:08,  3.59it/s]
  6%|▌         | 21261/371472 [1:41:16<26:33:29,  3.66it/s]
  6%|▌         | 21262/371472 [1:41:16<26:06:01,  3.73it/s]
  6%|▌         | 21263/371472 [1:41:16<26:39:48,  3.65it/s]
  6%|▌         | 21264/371472 [1:41:16<27:47:49,  3.50it/s]
  6%|▌         | 21265/371472 [1:41:17<26:34:06,  3.66it/s]
  6%|▌         | 21266/371472 [1:41:17<27:16:33,  3.57it/s]
  6%|▌         | 21267/371472 [1:41:17<29:09:59,  3.34it/s]
  6%|▌         | 21268/371472 [1:41:18<28:59:47,  3.35it/s]
  6%|▌         | 21269/371472 [1:41:18<28:38:09,  3.40it/s]
  6%|▌         | 21270/371472 [1:41:18<27:51:40,  3.49it/s]
  6%|▌         | 21271/371472 [1:41:18<27:34:47,  3.53it/s]
  6%|▌         | 21272/371472 [1:41:19<32:02:55,  3.04it/s]
  6%|▌         | 21273/371472 [1:41:19<30:11:59,  3.22it/s]
  6%|▌         | 21274/371472 [1:41:19<29:05:50,  3.34it/s]
  6%|▌         | 21275/371472 [1:41:20<29:09:24,  3.34it/s]
  6%|▌         | 21276/371472 [1:41:20<27:38:36,  3.52it/s]
  6%|▌         | 21277/371472 [1:41:20<26:54:57,  3.61it/s]
  6%|▌         | 21278/371472 [1:41:20<26:51:09,  3.62it/s]
  6%|▌         | 21279/371472 [1:41:21<26:42:20,  3.64it/s]
  6%|▌         | 21280/371472 [1:41:21<26:53:20,  3.62it/s]
                                                           
{'loss': 4.5509, 'learning_rate': 9.488999978452454e-07, 'epoch': 0.92}

  6%|▌         | 21280/371472 [1:41:21<26:53:20,  3.62it/s]
  6%|▌         | 21281/371472 [1:41:21<26:50:59,  3.62it/s]
  6%|▌         | 21282/371472 [1:41:22<26:18:57,  3.70it/s]
  6%|▌         | 21283/371472 [1:41:22<28:20:37,  3.43it/s]
  6%|▌         | 21284/371472 [1:41:22<30:18:26,  3.21it/s]
  6%|▌         | 21285/371472 [1:41:22<28:53:54,  3.37it/s]
  6%|▌         | 21286/371472 [1:41:23<27:57:33,  3.48it/s]
  6%|▌         | 21287/371472 [1:41:23<27:43:27,  3.51it/s]
  6%|▌         | 21288/371472 [1:41:23<26:59:59,  3.60it/s]
  6%|▌         | 21289/371472 [1:41:24<26:58:20,  3.61it/s]
  6%|▌         | 21290/371472 [1:41:24<27:24:05,  3.55it/s]
  6%|▌         | 21291/371472 [1:41:24<26:20:20,  3.69it/s]
  6%|▌         | 21292/371472 [1:41:24<25:57:36,  3.75it/s]
  6%|▌         | 21293/371472 [1:41:25<26:25:30,  3.68it/s]
  6%|▌         | 21294/371472 [1:41:25<26:11:18,  3.71it/s]
  6%|▌         | 21295/371472 [1:41:25<25:15:18,  3.85it/s]
  6%|▌         | 21296/371472 [1:41:26<30:18:01,  3.21it/s]
  6%|▌         | 21297/371472 [1:41:26<31:17:15,  3.11it/s]
  6%|▌         | 21298/371472 [1:41:26<29:55:34,  3.25it/s]
  6%|▌         | 21299/371472 [1:41:27<30:19:56,  3.21it/s]
  6%|▌         | 21300/371472 [1:41:27<29:04:52,  3.34it/s]
                                                           
{'loss': 4.4623, 'learning_rate': 9.488515158697666e-07, 'epoch': 0.92}

  6%|▌         | 21300/371472 [1:41:27<29:04:52,  3.34it/s]
  6%|▌         | 21301/371472 [1:41:27<29:57:03,  3.25it/s]
  6%|▌         | 21302/371472 [1:41:27<28:57:14,  3.36it/s]
  6%|▌         | 21303/371472 [1:41:28<29:25:47,  3.31it/s]
  6%|▌         | 21304/371472 [1:41:28<28:44:43,  3.38it/s]
  6%|▌         | 21305/371472 [1:41:28<29:41:19,  3.28it/s]
  6%|▌         | 21306/371472 [1:41:29<29:04:57,  3.34it/s]
  6%|▌         | 21307/371472 [1:41:29<27:21:42,  3.55it/s]
  6%|▌         | 21308/371472 [1:41:29<26:35:34,  3.66it/s]
  6%|▌         | 21309/371472 [1:41:29<26:59:04,  3.60it/s]
  6%|▌         | 21310/371472 [1:41:30<25:59:30,  3.74it/s]
  6%|▌         | 21311/371472 [1:41:30<26:12:48,  3.71it/s]
  6%|▌         | 21312/371472 [1:41:30<25:58:04,  3.75it/s]
  6%|▌         | 21313/371472 [1:41:30<26:36:34,  3.66it/s]
  6%|▌         | 21314/371472 [1:41:31<27:09:06,  3.58it/s]
  6%|▌         | 21315/371472 [1:41:31<26:17:08,  3.70it/s]
  6%|▌         | 21316/371472 [1:41:31<27:15:49,  3.57it/s]
  6%|▌         | 21317/371472 [1:41:32<27:00:14,  3.60it/s]
  6%|▌         | 21318/371472 [1:41:32<27:44:39,  3.51it/s]
  6%|▌         | 21319/371472 [1:41:32<27:05:12,  3.59it/s]
  6%|▌         | 21320/371472 [1:41:32<26:56:08,  3.61it/s]
                                                           
{'loss': 4.6452, 'learning_rate': 9.488030338942877e-07, 'epoch': 0.92}

  6%|▌         | 21320/371472 [1:41:32<26:56:08,  3.61it/s]
  6%|▌         | 21321/371472 [1:41:33<27:19:33,  3.56it/s]
  6%|▌         | 21322/371472 [1:41:33<26:48:02,  3.63it/s]
  6%|▌         | 21323/371472 [1:41:33<26:04:27,  3.73it/s]
  6%|▌         | 21324/371472 [1:41:33<26:10:00,  3.72it/s]
  6%|▌         | 21325/371472 [1:41:34<27:18:29,  3.56it/s]
  6%|▌         | 21326/371472 [1:41:34<27:30:06,  3.54it/s]
  6%|▌         | 21327/371472 [1:41:34<29:34:58,  3.29it/s]
  6%|▌         | 21328/371472 [1:41:35<28:45:12,  3.38it/s]
  6%|▌         | 21329/371472 [1:41:35<28:31:16,  3.41it/s]
  6%|▌         | 21330/371472 [1:41:35<30:04:51,  3.23it/s]
  6%|▌         | 21331/371472 [1:41:36<28:26:56,  3.42it/s]
  6%|▌         | 21332/371472 [1:41:36<26:59:18,  3.60it/s]
  6%|▌         | 21333/371472 [1:41:36<26:40:11,  3.65it/s]
  6%|▌         | 21334/371472 [1:41:36<26:25:20,  3.68it/s]
  6%|▌         | 21335/371472 [1:41:37<26:39:18,  3.65it/s]
  6%|▌         | 21336/371472 [1:41:37<26:56:53,  3.61it/s]
  6%|▌         | 21337/371472 [1:41:37<27:20:14,  3.56it/s]
  6%|▌         | 21338/371472 [1:41:38<27:38:11,  3.52it/s]
  6%|▌         | 21339/371472 [1:41:38<30:21:27,  3.20it/s]
  6%|▌         | 21340/371472 [1:41:38<30:34:55,  3.18it/s]
                                                           
{'loss': 4.3545, 'learning_rate': 9.487545519188088e-07, 'epoch': 0.92}

  6%|▌         | 21340/371472 [1:41:38<30:34:55,  3.18it/s]
  6%|▌         | 21341/371472 [1:41:38<29:13:32,  3.33it/s]
  6%|▌         | 21342/371472 [1:41:39<28:35:24,  3.40it/s]
  6%|▌         | 21343/371472 [1:41:39<28:30:51,  3.41it/s]
  6%|▌         | 21344/371472 [1:41:39<27:15:36,  3.57it/s]
  6%|▌         | 21345/371472 [1:41:40<27:49:43,  3.49it/s]
  6%|▌         | 21346/371472 [1:41:40<27:29:09,  3.54it/s]
  6%|▌         | 21347/371472 [1:41:40<27:46:06,  3.50it/s]
  6%|▌         | 21348/371472 [1:41:40<26:38:31,  3.65it/s]
  6%|▌         | 21349/371472 [1:41:41<26:20:20,  3.69it/s]
  6%|▌         | 21350/371472 [1:41:41<25:33:18,  3.81it/s]
  6%|▌         | 21351/371472 [1:41:41<24:50:14,  3.92it/s]
  6%|▌         | 21352/371472 [1:41:41<24:35:34,  3.95it/s]
  6%|▌         | 21353/371472 [1:41:42<24:48:02,  3.92it/s]
  6%|▌         | 21354/371472 [1:41:42<25:06:09,  3.87it/s]
  6%|▌         | 21355/371472 [1:41:42<25:29:57,  3.81it/s]
  6%|▌         | 21356/371472 [1:41:43<26:59:34,  3.60it/s]
  6%|▌         | 21357/371472 [1:41:43<26:41:28,  3.64it/s]
  6%|▌         | 21358/371472 [1:41:43<27:28:18,  3.54it/s]
  6%|▌         | 21359/371472 [1:41:43<27:20:53,  3.56it/s]
  6%|▌         | 21360/371472 [1:41:44<27:52:10,  3.49it/s]
                                                           
{'loss': 4.6088, 'learning_rate': 9.487060699433299e-07, 'epoch': 0.92}

  6%|▌         | 21360/371472 [1:41:44<27:52:10,  3.49it/s]
  6%|▌         | 21361/371472 [1:41:44<26:52:37,  3.62it/s]
  6%|▌         | 21362/371472 [1:41:44<29:12:12,  3.33it/s]
  6%|▌         | 21363/371472 [1:41:45<29:29:45,  3.30it/s]
  6%|▌         | 21364/371472 [1:41:45<28:36:35,  3.40it/s]
  6%|▌         | 21365/371472 [1:41:45<27:33:16,  3.53it/s]
  6%|▌         | 21366/371472 [1:41:45<27:11:21,  3.58it/s]
  6%|▌         | 21367/371472 [1:41:46<27:26:12,  3.54it/s]
  6%|▌         | 21368/371472 [1:41:46<27:03:56,  3.59it/s]
  6%|▌         | 21369/371472 [1:41:46<28:22:44,  3.43it/s]
  6%|▌         | 21370/371472 [1:41:47<30:21:51,  3.20it/s]
  6%|▌         | 21371/371472 [1:41:47<29:41:15,  3.28it/s]
  6%|▌         | 21372/371472 [1:41:47<28:14:51,  3.44it/s]
  6%|▌         | 21373/371472 [1:41:47<28:16:46,  3.44it/s]
  6%|▌         | 21374/371472 [1:41:48<28:05:22,  3.46it/s]
  6%|▌         | 21375/371472 [1:41:48<28:27:40,  3.42it/s]
  6%|▌         | 21376/371472 [1:41:48<30:27:23,  3.19it/s]
  6%|▌         | 21377/371472 [1:41:49<29:24:28,  3.31it/s]
  6%|▌         | 21378/371472 [1:41:49<29:15:29,  3.32it/s]
  6%|▌         | 21379/371472 [1:41:49<28:57:03,  3.36it/s]
  6%|▌         | 21380/371472 [1:41:50<27:53:22,  3.49it/s]
                                                           
{'loss': 4.4155, 'learning_rate': 9.486575879678511e-07, 'epoch': 0.92}

  6%|▌         | 21380/371472 [1:41:50<27:53:22,  3.49it/s]
  6%|▌         | 21381/371472 [1:41:50<26:56:15,  3.61it/s]
  6%|▌         | 21382/371472 [1:41:50<27:24:01,  3.55it/s]
  6%|▌         | 21383/371472 [1:41:50<26:47:17,  3.63it/s]
  6%|▌         | 21384/371472 [1:41:51<26:21:50,  3.69it/s]
  6%|▌         | 21385/371472 [1:41:51<25:53:14,  3.76it/s]
  6%|▌         | 21386/371472 [1:41:51<26:03:44,  3.73it/s]
  6%|▌         | 21387/371472 [1:41:51<26:21:23,  3.69it/s]
  6%|▌         | 21388/371472 [1:41:52<27:55:38,  3.48it/s]
  6%|▌         | 21389/371472 [1:41:52<30:56:18,  3.14it/s]
  6%|▌         | 21390/371472 [1:41:52<30:49:35,  3.15it/s]
  6%|▌         | 21391/371472 [1:41:53<29:20:10,  3.31it/s]
  6%|▌         | 21392/371472 [1:41:53<32:42:50,  2.97it/s]
  6%|▌         | 21393/371472 [1:41:53<31:05:26,  3.13it/s]
  6%|▌         | 21394/371472 [1:41:54<29:07:13,  3.34it/s]
  6%|▌         | 21395/371472 [1:41:54<29:12:56,  3.33it/s]
  6%|▌         | 21396/371472 [1:41:54<28:07:35,  3.46it/s]
  6%|▌         | 21397/371472 [1:41:54<27:22:17,  3.55it/s]
  6%|▌         | 21398/371472 [1:41:55<27:31:04,  3.53it/s]
  6%|▌         | 21399/371472 [1:41:55<28:38:19,  3.40it/s]
  6%|▌         | 21400/371472 [1:41:55<27:53:50,  3.49it/s]
                                                           
{'loss': 4.4004, 'learning_rate': 9.486091059923721e-07, 'epoch': 0.92}

  6%|▌         | 21400/371472 [1:41:55<27:53:50,  3.49it/s]
  6%|▌         | 21401/371472 [1:41:56<27:45:38,  3.50it/s]
  6%|▌         | 21402/371472 [1:41:56<26:28:24,  3.67it/s]
  6%|▌         | 21403/371472 [1:41:56<27:32:55,  3.53it/s]
  6%|▌         | 21404/371472 [1:41:56<27:07:51,  3.58it/s]
  6%|▌         | 21405/371472 [1:41:57<26:17:06,  3.70it/s]
  6%|▌         | 21406/371472 [1:41:57<26:11:55,  3.71it/s]
  6%|▌         | 21407/371472 [1:41:57<26:07:37,  3.72it/s]
  6%|▌         | 21408/371472 [1:41:58<26:36:06,  3.66it/s]
  6%|▌         | 21409/371472 [1:41:58<26:15:25,  3.70it/s]
  6%|▌         | 21410/371472 [1:41:58<26:43:12,  3.64it/s]
  6%|▌         | 21411/371472 [1:41:58<27:26:53,  3.54it/s]
  6%|▌         | 21412/371472 [1:41:59<27:02:39,  3.60it/s]
  6%|▌         | 21413/371472 [1:41:59<27:44:10,  3.51it/s]
  6%|▌         | 21414/371472 [1:41:59<27:10:36,  3.58it/s]
  6%|▌         | 21415/371472 [1:41:59<26:07:00,  3.72it/s]
  6%|▌         | 21416/371472 [1:42:00<28:34:42,  3.40it/s]
  6%|▌         | 21417/371472 [1:42:00<28:39:42,  3.39it/s]
  6%|▌         | 21418/371472 [1:42:00<27:39:54,  3.51it/s]
  6%|▌         | 21419/371472 [1:42:01<28:03:38,  3.47it/s]
  6%|▌         | 21420/371472 [1:42:01<29:48:17,  3.26it/s]
                                                           
{'loss': 4.5805, 'learning_rate': 9.485606240168932e-07, 'epoch': 0.92}

  6%|▌         | 21420/371472 [1:42:01<29:48:17,  3.26it/s]
  6%|▌         | 21421/371472 [1:42:01<29:56:25,  3.25it/s]
  6%|▌         | 21422/371472 [1:42:02<28:54:05,  3.36it/s]
  6%|▌         | 21423/371472 [1:42:02<27:41:52,  3.51it/s]
  6%|▌         | 21424/371472 [1:42:02<26:42:12,  3.64it/s]
  6%|▌         | 21425/371472 [1:42:02<27:03:50,  3.59it/s]
  6%|▌         | 21426/371472 [1:42:03<27:08:06,  3.58it/s]
  6%|▌         | 21427/371472 [1:42:03<28:25:15,  3.42it/s]
  6%|▌         | 21428/371472 [1:42:03<27:28:47,  3.54it/s]
  6%|▌         | 21429/371472 [1:42:04<28:41:23,  3.39it/s]
  6%|▌         | 21430/371472 [1:42:04<28:17:09,  3.44it/s]
  6%|▌         | 21431/371472 [1:42:04<27:37:06,  3.52it/s]
  6%|▌         | 21432/371472 [1:42:04<28:26:27,  3.42it/s]
  6%|▌         | 21433/371472 [1:42:05<29:21:05,  3.31it/s]
  6%|▌         | 21434/371472 [1:42:05<28:00:35,  3.47it/s]
  6%|▌         | 21435/371472 [1:42:05<27:39:30,  3.52it/s]
  6%|▌         | 21436/371472 [1:42:06<27:00:39,  3.60it/s]
  6%|▌         | 21437/371472 [1:42:06<26:14:48,  3.70it/s]
  6%|▌         | 21438/371472 [1:42:06<26:06:11,  3.72it/s]
  6%|▌         | 21439/371472 [1:42:06<28:40:06,  3.39it/s]
  6%|▌         | 21440/371472 [1:42:07<31:16:14,  3.11it/s]
                                                           
{'loss': 4.545, 'learning_rate': 9.485121420414143e-07, 'epoch': 0.92}

  6%|▌         | 21440/371472 [1:42:07<31:16:14,  3.11it/s]
  6%|▌         | 21441/371472 [1:42:07<29:17:52,  3.32it/s]
  6%|▌         | 21442/371472 [1:42:07<27:52:15,  3.49it/s]
  6%|▌         | 21443/371472 [1:42:08<28:30:16,  3.41it/s]
  6%|▌         | 21444/371472 [1:42:08<27:35:25,  3.52it/s]
  6%|▌         | 21445/371472 [1:42:08<27:04:58,  3.59it/s]
  6%|▌         | 21446/371472 [1:42:08<28:24:02,  3.42it/s]
  6%|▌         | 21447/371472 [1:42:09<27:49:38,  3.49it/s]
  6%|▌         | 21448/371472 [1:42:09<29:28:28,  3.30it/s]
  6%|▌         | 21449/371472 [1:42:09<28:30:31,  3.41it/s]
  6%|▌         | 21450/371472 [1:42:10<27:01:37,  3.60it/s]
  6%|▌         | 21451/371472 [1:42:10<27:32:25,  3.53it/s]
  6%|▌         | 21452/371472 [1:42:10<28:07:41,  3.46it/s]
  6%|▌         | 21453/371472 [1:42:10<27:42:38,  3.51it/s]
  6%|▌         | 21454/371472 [1:42:11<26:35:58,  3.66it/s]
  6%|▌         | 21455/371472 [1:42:11<27:09:36,  3.58it/s]
  6%|▌         | 21456/371472 [1:42:11<26:06:44,  3.72it/s]
  6%|▌         | 21457/371472 [1:42:12<27:22:59,  3.55it/s]
  6%|▌         | 21458/371472 [1:42:12<27:33:36,  3.53it/s]
  6%|▌         | 21459/371472 [1:42:12<28:21:43,  3.43it/s]
  6%|▌         | 21460/371472 [1:42:12<27:20:46,  3.56it/s]
                                                           
{'loss': 4.4467, 'learning_rate': 9.484636600659355e-07, 'epoch': 0.92}

  6%|▌         | 21460/371472 [1:42:12<27:20:46,  3.56it/s]
  6%|▌         | 21461/371472 [1:42:13<27:38:20,  3.52it/s]
  6%|▌         | 21462/371472 [1:42:13<27:47:11,  3.50it/s]
  6%|▌         | 21463/371472 [1:42:13<28:19:48,  3.43it/s]
  6%|▌         | 21464/371472 [1:42:14<29:09:54,  3.33it/s]
  6%|▌         | 21465/371472 [1:42:14<27:44:42,  3.50it/s]
  6%|▌         | 21466/371472 [1:42:14<27:32:05,  3.53it/s]
  6%|▌         | 21467/371472 [1:42:14<26:48:28,  3.63it/s]
  6%|▌         | 21468/371472 [1:42:15<27:20:04,  3.56it/s]
  6%|▌         | 21469/371472 [1:42:15<27:55:40,  3.48it/s]
  6%|▌         | 21470/371472 [1:42:15<28:03:44,  3.46it/s]
  6%|▌         | 21471/371472 [1:42:16<27:14:22,  3.57it/s]
  6%|▌         | 21472/371472 [1:42:16<29:23:25,  3.31it/s]
  6%|▌         | 21473/371472 [1:42:16<31:21:45,  3.10it/s]
  6%|▌         | 21474/371472 [1:42:17<29:41:59,  3.27it/s]
  6%|▌         | 21475/371472 [1:42:17<28:16:18,  3.44it/s]
  6%|▌         | 21476/371472 [1:42:17<28:04:12,  3.46it/s]
  6%|▌         | 21477/371472 [1:42:17<28:06:39,  3.46it/s]
  6%|▌         | 21478/371472 [1:42:18<28:19:15,  3.43it/s]
  6%|▌         | 21479/371472 [1:42:18<27:35:57,  3.52it/s]
  6%|▌         | 21480/371472 [1:42:18<28:47:00,  3.38it/s]
                                                           
{'loss': 4.47, 'learning_rate': 9.484151780904566e-07, 'epoch': 0.93}

  6%|▌         | 21480/371472 [1:42:18<28:47:00,  3.38it/s]
  6%|▌         | 21481/371472 [1:42:19<30:31:57,  3.18it/s]
  6%|▌         | 21482/371472 [1:42:19<28:55:43,  3.36it/s]
  6%|▌         | 21483/371472 [1:42:19<28:04:39,  3.46it/s]
  6%|▌         | 21484/371472 [1:42:19<27:18:17,  3.56it/s]
  6%|▌         | 21485/371472 [1:42:20<26:24:24,  3.68it/s]
  6%|▌         | 21486/371472 [1:42:20<26:02:23,  3.73it/s]
  6%|▌         | 21487/371472 [1:42:20<26:17:50,  3.70it/s]
  6%|▌         | 21488/371472 [1:42:20<26:12:18,  3.71it/s]
  6%|▌         | 21489/371472 [1:42:21<26:31:12,  3.67it/s]
  6%|▌         | 21490/371472 [1:42:21<26:27:13,  3.67it/s]
  6%|▌         | 21491/371472 [1:42:21<25:53:31,  3.75it/s]
  6%|▌         | 21492/371472 [1:42:22<26:19:49,  3.69it/s]
  6%|▌         | 21493/371472 [1:42:22<26:42:34,  3.64it/s]
  6%|▌         | 21494/371472 [1:42:22<27:49:29,  3.49it/s]
  6%|▌         | 21495/371472 [1:42:22<26:56:53,  3.61it/s]
  6%|▌         | 21496/371472 [1:42:23<27:12:40,  3.57it/s]
  6%|▌         | 21497/371472 [1:42:23<26:30:57,  3.67it/s]
  6%|▌         | 21498/371472 [1:42:23<26:20:14,  3.69it/s]
  6%|▌         | 21499/371472 [1:42:24<26:58:54,  3.60it/s]
  6%|▌         | 21500/371472 [1:42:24<26:39:31,  3.65it/s]
                                                           
{'loss': 4.7662, 'learning_rate': 9.483666961149777e-07, 'epoch': 0.93}

  6%|▌         | 21500/371472 [1:42:24<26:39:31,  3.65it/s]
  6%|▌         | 21501/371472 [1:42:24<27:33:02,  3.53it/s]
  6%|▌         | 21502/371472 [1:42:24<28:45:19,  3.38it/s]
  6%|▌         | 21503/371472 [1:42:25<27:54:40,  3.48it/s]
  6%|▌         | 21504/371472 [1:42:25<29:13:51,  3.33it/s]
  6%|▌         | 21505/371472 [1:42:25<28:28:41,  3.41it/s]
  6%|▌         | 21506/371472 [1:42:26<27:05:44,  3.59it/s]
  6%|▌         | 21507/371472 [1:42:26<26:51:39,  3.62it/s]
  6%|▌         | 21508/371472 [1:42:26<26:30:36,  3.67it/s]
  6%|▌         | 21509/371472 [1:42:26<26:36:42,  3.65it/s]
  6%|▌         | 21510/371472 [1:42:27<26:54:35,  3.61it/s]
  6%|▌         | 21511/371472 [1:42:27<28:30:32,  3.41it/s]
  6%|▌         | 21512/371472 [1:42:27<28:27:03,  3.42it/s]
  6%|▌         | 21513/371472 [1:42:28<27:37:35,  3.52it/s]
  6%|▌         | 21514/371472 [1:42:28<28:44:58,  3.38it/s]
  6%|▌         | 21515/371472 [1:42:28<27:40:39,  3.51it/s]
  6%|▌         | 21516/371472 [1:42:28<29:05:40,  3.34it/s]
  6%|▌         | 21517/371472 [1:42:29<28:37:51,  3.40it/s]
  6%|▌         | 21518/371472 [1:42:29<30:57:14,  3.14it/s]
  6%|▌         | 21519/371472 [1:42:29<32:01:18,  3.04it/s]
  6%|▌         | 21520/371472 [1:42:30<29:55:46,  3.25it/s]
                                                           
{'loss': 4.3187, 'learning_rate': 9.483182141394986e-07, 'epoch': 0.93}

  6%|▌         | 21520/371472 [1:42:30<29:55:46,  3.25it/s]
  6%|▌         | 21521/371472 [1:42:30<29:13:36,  3.33it/s]
  6%|▌         | 21522/371472 [1:42:30<27:29:53,  3.54it/s]
  6%|▌         | 21523/371472 [1:42:30<26:26:27,  3.68it/s]
  6%|▌         | 21524/371472 [1:42:31<27:17:12,  3.56it/s]
  6%|▌         | 21525/371472 [1:42:31<26:50:13,  3.62it/s]
  6%|▌         | 21526/371472 [1:42:31<27:32:29,  3.53it/s]
  6%|▌         | 21527/371472 [1:42:32<27:00:28,  3.60it/s]
  6%|▌         | 21528/371472 [1:42:32<28:11:41,  3.45it/s]
  6%|▌         | 21529/371472 [1:42:32<28:10:47,  3.45it/s]
  6%|▌         | 21530/371472 [1:42:32<27:27:12,  3.54it/s]
  6%|▌         | 21531/371472 [1:42:33<27:04:28,  3.59it/s]
  6%|▌         | 21532/371472 [1:42:33<26:46:10,  3.63it/s]
  6%|▌         | 21533/371472 [1:42:33<25:40:05,  3.79it/s]
  6%|▌         | 21534/371472 [1:42:34<25:43:28,  3.78it/s]
  6%|▌         | 21535/371472 [1:42:34<26:02:34,  3.73it/s]
  6%|▌         | 21536/371472 [1:42:34<27:52:44,  3.49it/s]
  6%|▌         | 21537/371472 [1:42:34<28:32:25,  3.41it/s]
  6%|▌         | 21538/371472 [1:42:35<27:33:42,  3.53it/s]
  6%|▌         | 21539/371472 [1:42:35<29:24:33,  3.31it/s]
  6%|▌         | 21540/371472 [1:42:35<28:08:51,  3.45it/s]
                                                           
{'loss': 4.8051, 'learning_rate': 9.482697321640199e-07, 'epoch': 0.93}

  6%|▌         | 21540/371472 [1:42:35<28:08:51,  3.45it/s]
  6%|▌         | 21541/371472 [1:42:36<27:17:31,  3.56it/s]
  6%|▌         | 21542/371472 [1:42:36<27:54:00,  3.48it/s]
  6%|▌         | 21543/371472 [1:42:36<27:57:48,  3.48it/s]
  6%|▌         | 21544/371472 [1:42:36<27:24:16,  3.55it/s]
  6%|▌         | 21545/371472 [1:42:37<26:52:12,  3.62it/s]
  6%|▌         | 21546/371472 [1:42:37<27:30:32,  3.53it/s]
  6%|▌         | 21547/371472 [1:42:37<26:57:24,  3.61it/s]
  6%|▌         | 21548/371472 [1:42:38<26:38:59,  3.65it/s]
  6%|▌         | 21549/371472 [1:42:38<27:03:31,  3.59it/s]
  6%|▌         | 21550/371472 [1:42:38<28:46:54,  3.38it/s]
  6%|▌         | 21551/371472 [1:42:38<27:59:19,  3.47it/s]
  6%|▌         | 21552/371472 [1:42:39<27:16:24,  3.56it/s]
  6%|▌         | 21553/371472 [1:42:39<27:49:09,  3.49it/s]
  6%|▌         | 21554/371472 [1:42:39<30:02:05,  3.24it/s]
  6%|▌         | 21555/371472 [1:42:40<30:36:54,  3.17it/s]
  6%|▌         | 21556/371472 [1:42:40<31:29:44,  3.09it/s]
  6%|▌         | 21557/371472 [1:42:40<30:14:37,  3.21it/s]
  6%|▌         | 21558/371472 [1:42:41<33:04:05,  2.94it/s]
  6%|▌         | 21559/371472 [1:42:41<31:24:45,  3.09it/s]
  6%|▌         | 21560/371472 [1:42:41<29:25:53,  3.30it/s]
                                                           
{'loss': 4.5825, 'learning_rate': 9.482212501885409e-07, 'epoch': 0.93}

  6%|▌         | 21560/371472 [1:42:41<29:25:53,  3.30it/s]
  6%|▌         | 21561/371472 [1:42:42<28:31:13,  3.41it/s]
  6%|▌         | 21562/371472 [1:42:42<27:21:39,  3.55it/s]
  6%|▌         | 21563/371472 [1:42:42<26:33:14,  3.66it/s]
  6%|▌         | 21564/371472 [1:42:42<25:57:01,  3.75it/s]
  6%|▌         | 21565/371472 [1:42:43<26:07:31,  3.72it/s]
  6%|▌         | 21566/371472 [1:42:43<25:48:43,  3.77it/s]
  6%|▌         | 21567/371472 [1:42:43<25:08:10,  3.87it/s]
  6%|▌         | 21568/371472 [1:42:43<25:22:39,  3.83it/s]
  6%|▌         | 21569/371472 [1:42:44<28:36:27,  3.40it/s]
  6%|▌         | 21570/371472 [1:42:44<27:44:52,  3.50it/s]
  6%|▌         | 21571/371472 [1:42:44<26:45:55,  3.63it/s]
  6%|▌         | 21572/371472 [1:42:44<26:06:15,  3.72it/s]
  6%|▌         | 21573/371472 [1:42:45<29:55:35,  3.25it/s]
  6%|▌         | 21574/371472 [1:42:45<28:49:15,  3.37it/s]
  6%|▌         | 21575/371472 [1:42:45<28:56:36,  3.36it/s]
  6%|▌         | 21576/371472 [1:42:46<30:55:00,  3.14it/s]
  6%|▌         | 21577/371472 [1:42:46<31:06:27,  3.12it/s]
  6%|▌         | 21578/371472 [1:42:46<29:54:31,  3.25it/s]
  6%|▌         | 21579/371472 [1:42:47<29:04:02,  3.34it/s]
  6%|▌         | 21580/371472 [1:42:47<32:04:57,  3.03it/s]
                                                           
{'loss': 4.3509, 'learning_rate': 9.481727682130621e-07, 'epoch': 0.93}

  6%|▌         | 21580/371472 [1:42:47<32:04:57,  3.03it/s]
  6%|▌         | 21581/371472 [1:42:47<29:29:04,  3.30it/s]
  6%|▌         | 21582/371472 [1:42:48<28:18:59,  3.43it/s]
  6%|▌         | 21583/371472 [1:42:48<27:38:39,  3.52it/s]
  6%|▌         | 21584/371472 [1:42:48<26:44:24,  3.63it/s]
  6%|▌         | 21585/371472 [1:42:48<26:43:16,  3.64it/s]
  6%|▌         | 21586/371472 [1:42:49<28:45:52,  3.38it/s]
  6%|▌         | 21587/371472 [1:42:49<28:53:47,  3.36it/s]
  6%|▌         | 21588/371472 [1:42:49<29:09:10,  3.33it/s]
  6%|▌         | 21589/371472 [1:42:50<28:16:28,  3.44it/s]
  6%|▌         | 21590/371472 [1:42:50<28:07:18,  3.46it/s]
  6%|▌         | 21591/371472 [1:42:50<29:04:10,  3.34it/s]
  6%|▌         | 21592/371472 [1:42:51<29:53:54,  3.25it/s]
  6%|▌         | 21593/371472 [1:42:51<29:27:56,  3.30it/s]
  6%|▌         | 21594/371472 [1:42:51<27:58:06,  3.47it/s]
  6%|▌         | 21595/371472 [1:42:51<27:57:10,  3.48it/s]
  6%|▌         | 21596/371472 [1:42:52<27:08:45,  3.58it/s]
  6%|▌         | 21597/371472 [1:42:52<27:33:06,  3.53it/s]
  6%|▌         | 21598/371472 [1:42:52<27:25:46,  3.54it/s]
  6%|▌         | 21599/371472 [1:42:53<29:20:54,  3.31it/s]
  6%|▌         | 21600/371472 [1:42:53<28:19:28,  3.43it/s]
                                                           
{'loss': 4.3702, 'learning_rate': 9.481242862375832e-07, 'epoch': 0.93}

  6%|▌         | 21600/371472 [1:42:53<28:19:28,  3.43it/s]
  6%|▌         | 21601/371472 [1:42:53<27:50:36,  3.49it/s]
  6%|▌         | 21602/371472 [1:42:53<27:03:26,  3.59it/s]
  6%|▌         | 21603/371472 [1:42:54<27:23:05,  3.55it/s]
  6%|▌         | 21604/371472 [1:42:54<26:53:45,  3.61it/s]
  6%|▌         | 21605/371472 [1:42:54<26:20:06,  3.69it/s]
  6%|▌         | 21606/371472 [1:42:54<26:57:15,  3.61it/s]
  6%|▌         | 21607/371472 [1:42:55<31:27:25,  3.09it/s]
  6%|▌         | 21608/371472 [1:42:55<30:19:20,  3.21it/s]
  6%|▌         | 21609/371472 [1:42:56<31:48:07,  3.06it/s]
  6%|▌         | 21610/371472 [1:42:56<29:26:04,  3.30it/s]
  6%|▌         | 21611/371472 [1:42:56<31:09:54,  3.12it/s]
  6%|▌         | 21612/371472 [1:42:56<29:20:25,  3.31it/s]
  6%|▌         | 21613/371472 [1:42:57<27:47:49,  3.50it/s]
  6%|▌         | 21614/371472 [1:42:57<27:49:32,  3.49it/s]
  6%|▌         | 21615/371472 [1:42:57<26:36:49,  3.65it/s]
  6%|▌         | 21616/371472 [1:42:58<28:34:50,  3.40it/s]
  6%|▌         | 21617/371472 [1:42:58<29:36:32,  3.28it/s]
  6%|▌         | 21618/371472 [1:42:58<28:04:20,  3.46it/s]
  6%|▌         | 21619/371472 [1:42:58<28:29:08,  3.41it/s]
  6%|▌         | 21620/371472 [1:42:59<27:14:27,  3.57it/s]
                                                           
{'loss': 4.6154, 'learning_rate': 9.480758042621044e-07, 'epoch': 0.93}

  6%|▌         | 21620/371472 [1:42:59<27:14:27,  3.57it/s]
  6%|▌         | 21621/371472 [1:42:59<27:53:04,  3.49it/s]
  6%|▌         | 21622/371472 [1:42:59<27:37:03,  3.52it/s]
  6%|▌         | 21623/371472 [1:43:00<27:26:01,  3.54it/s]
  6%|▌         | 21624/371472 [1:43:00<26:07:41,  3.72it/s]
  6%|▌         | 21625/371472 [1:43:00<25:43:58,  3.78it/s]
  6%|▌         | 21626/371472 [1:43:00<29:51:33,  3.25it/s]
  6%|▌         | 21627/371472 [1:43:01<28:10:46,  3.45it/s]
  6%|▌         | 21628/371472 [1:43:01<29:07:14,  3.34it/s]
  6%|▌         | 21629/371472 [1:43:01<29:12:43,  3.33it/s]
  6%|▌         | 21630/371472 [1:43:02<28:47:41,  3.37it/s]
  6%|▌         | 21631/371472 [1:43:02<27:23:25,  3.55it/s]
  6%|▌         | 21632/371472 [1:43:02<26:42:51,  3.64it/s]
  6%|▌         | 21633/371472 [1:43:02<27:05:24,  3.59it/s]
  6%|▌         | 21634/371472 [1:43:03<29:56:40,  3.25it/s]
  6%|▌         | 21635/371472 [1:43:03<28:32:35,  3.40it/s]
  6%|▌         | 21636/371472 [1:43:03<29:13:01,  3.33it/s]
  6%|▌         | 21637/371472 [1:43:04<29:48:11,  3.26it/s]
  6%|▌         | 21638/371472 [1:43:04<28:53:33,  3.36it/s]
  6%|▌         | 21639/371472 [1:43:04<28:49:14,  3.37it/s]
  6%|▌         | 21640/371472 [1:43:05<29:28:18,  3.30it/s]
                                                           
{'loss': 4.7423, 'learning_rate': 9.480273222866253e-07, 'epoch': 0.93}

  6%|▌         | 21640/371472 [1:43:05<29:28:18,  3.30it/s]
  6%|▌         | 21641/371472 [1:43:05<30:34:15,  3.18it/s]
  6%|▌         | 21642/371472 [1:43:05<31:34:14,  3.08it/s]
  6%|▌         | 21643/371472 [1:43:06<33:56:19,  2.86it/s]
  6%|▌         | 21644/371472 [1:43:06<31:59:57,  3.04it/s]
  6%|▌         | 21645/371472 [1:43:06<30:31:59,  3.18it/s]
  6%|▌         | 21646/371472 [1:43:06<29:13:43,  3.32it/s]
  6%|▌         | 21647/371472 [1:43:07<30:54:54,  3.14it/s]
  6%|▌         | 21648/371472 [1:43:07<28:57:00,  3.36it/s]
  6%|▌         | 21649/371472 [1:43:07<27:24:25,  3.55it/s]
  6%|▌         | 21650/371472 [1:43:08<26:38:32,  3.65it/s]
  6%|▌         | 21651/371472 [1:43:08<28:07:50,  3.45it/s]
  6%|▌         | 21652/371472 [1:43:08<27:26:56,  3.54it/s]
  6%|▌         | 21653/371472 [1:43:08<26:41:17,  3.64it/s]
  6%|▌         | 21654/371472 [1:43:09<25:59:44,  3.74it/s]
  6%|▌         | 21655/371472 [1:43:09<25:22:15,  3.83it/s]
  6%|▌         | 21656/371472 [1:43:09<26:21:14,  3.69it/s]
  6%|▌         | 21657/371472 [1:43:09<25:41:49,  3.78it/s]
  6%|▌         | 21658/371472 [1:43:10<25:34:20,  3.80it/s]
  6%|▌         | 21659/371472 [1:43:10<25:11:33,  3.86it/s]
  6%|▌         | 21660/371472 [1:43:10<27:02:27,  3.59it/s]
                                                           
{'loss': 4.494, 'learning_rate': 9.479788403111465e-07, 'epoch': 0.93}

  6%|▌         | 21660/371472 [1:43:10<27:02:27,  3.59it/s]
  6%|▌         | 21661/371472 [1:43:11<26:54:35,  3.61it/s]
  6%|▌         | 21662/371472 [1:43:11<28:08:55,  3.45it/s]
  6%|▌         | 21663/371472 [1:43:11<26:55:29,  3.61it/s]
  6%|▌         | 21664/371472 [1:43:11<27:06:35,  3.58it/s]
  6%|▌         | 21665/371472 [1:43:12<26:29:16,  3.67it/s]
  6%|▌         | 21666/371472 [1:43:12<26:27:00,  3.67it/s]
  6%|▌         | 21667/371472 [1:43:12<26:39:02,  3.65it/s]
  6%|▌         | 21668/371472 [1:43:13<27:25:27,  3.54it/s]
  6%|▌         | 21669/371472 [1:43:13<25:59:29,  3.74it/s]
  6%|▌         | 21670/371472 [1:43:13<29:38:55,  3.28it/s]
  6%|▌         | 21671/371472 [1:43:13<29:18:20,  3.32it/s]
  6%|▌         | 21672/371472 [1:43:14<28:30:36,  3.41it/s]
  6%|▌         | 21673/371472 [1:43:14<29:08:56,  3.33it/s]
  6%|▌         | 21674/371472 [1:43:14<28:20:02,  3.43it/s]
  6%|▌         | 21675/371472 [1:43:15<27:48:01,  3.50it/s]
  6%|▌         | 21676/371472 [1:43:15<28:31:51,  3.41it/s]
  6%|▌         | 21677/371472 [1:43:15<26:59:14,  3.60it/s]
  6%|▌         | 21678/371472 [1:43:16<29:49:57,  3.26it/s]
  6%|▌         | 21679/371472 [1:43:16<27:58:48,  3.47it/s]
  6%|▌         | 21680/371472 [1:43:16<27:35:41,  3.52it/s]
                                                           
{'loss': 4.8994, 'learning_rate': 9.479303583356676e-07, 'epoch': 0.93}

  6%|▌         | 21680/371472 [1:43:16<27:35:41,  3.52it/s]
  6%|▌         | 21681/371472 [1:43:16<27:00:12,  3.60it/s]
  6%|▌         | 21682/371472 [1:43:17<27:08:46,  3.58it/s]
  6%|▌         | 21683/371472 [1:43:17<27:08:40,  3.58it/s]
  6%|▌         | 21684/371472 [1:43:17<26:21:39,  3.69it/s]
  6%|▌         | 21685/371472 [1:43:17<26:52:28,  3.62it/s]
  6%|▌         | 21686/371472 [1:43:18<26:12:00,  3.71it/s]
  6%|▌         | 21687/371472 [1:43:18<27:02:52,  3.59it/s]
  6%|▌         | 21688/371472 [1:43:18<27:05:34,  3.59it/s]
  6%|▌         | 21689/371472 [1:43:18<26:44:28,  3.63it/s]
  6%|▌         | 21690/371472 [1:43:19<26:28:49,  3.67it/s]
  6%|▌         | 21691/371472 [1:43:19<25:55:48,  3.75it/s]
  6%|▌         | 21692/371472 [1:43:19<26:04:58,  3.73it/s]
  6%|▌         | 21693/371472 [1:43:20<26:55:59,  3.61it/s]
  6%|▌         | 21694/371472 [1:43:20<26:50:38,  3.62it/s]
  6%|▌         | 21695/371472 [1:43:20<25:53:38,  3.75it/s]
  6%|▌         | 21696/371472 [1:43:20<27:14:50,  3.57it/s]
  6%|▌         | 21697/371472 [1:43:21<27:18:35,  3.56it/s]
  6%|▌         | 21698/371472 [1:43:21<26:53:30,  3.61it/s]
  6%|▌         | 21699/371472 [1:43:21<26:47:35,  3.63it/s]
  6%|▌         | 21700/371472 [1:43:21<26:34:03,  3.66it/s]
                                                           
{'loss': 4.5079, 'learning_rate': 9.478818763601888e-07, 'epoch': 0.93}

  6%|▌         | 21700/371472 [1:43:22<26:34:03,  3.66it/s]
  6%|▌         | 21701/371472 [1:43:22<27:18:34,  3.56it/s]
  6%|▌         | 21702/371472 [1:43:22<27:28:41,  3.54it/s]
  6%|▌         | 21703/371472 [1:43:22<28:04:04,  3.46it/s]
  6%|▌         | 21704/371472 [1:43:23<27:10:10,  3.58it/s]
  6%|▌         | 21705/371472 [1:43:23<26:38:03,  3.65it/s]
  6%|▌         | 21706/371472 [1:43:23<26:24:23,  3.68it/s]
  6%|▌         | 21707/371472 [1:43:23<26:58:08,  3.60it/s]
  6%|▌         | 21708/371472 [1:43:24<27:18:52,  3.56it/s]
  6%|▌         | 21709/371472 [1:43:24<26:52:39,  3.61it/s]
  6%|▌         | 21710/371472 [1:43:24<26:48:47,  3.62it/s]
  6%|▌         | 21711/371472 [1:43:25<27:30:24,  3.53it/s]
  6%|▌         | 21712/371472 [1:43:25<28:25:03,  3.42it/s]
  6%|▌         | 21713/371472 [1:43:25<31:36:46,  3.07it/s]
  6%|▌         | 21714/371472 [1:43:26<29:35:14,  3.28it/s]
  6%|▌         | 21715/371472 [1:43:26<28:36:39,  3.40it/s]
  6%|▌         | 21716/371472 [1:43:26<28:39:09,  3.39it/s]
  6%|▌         | 21717/371472 [1:43:26<27:38:36,  3.51it/s]
  6%|▌         | 21718/371472 [1:43:27<27:31:59,  3.53it/s]
  6%|▌         | 21719/371472 [1:43:27<30:54:14,  3.14it/s]
  6%|▌         | 21720/371472 [1:43:27<28:46:35,  3.38it/s]
                                                           
{'loss': 4.4827, 'learning_rate': 9.478333943847098e-07, 'epoch': 0.94}

  6%|▌         | 21720/371472 [1:43:27<28:46:35,  3.38it/s]
  6%|▌         | 21721/371472 [1:43:28<28:11:52,  3.45it/s]
  6%|▌         | 21722/371472 [1:43:28<27:31:52,  3.53it/s]
  6%|▌         | 21723/371472 [1:43:28<27:50:46,  3.49it/s]
  6%|▌         | 21724/371472 [1:43:28<27:47:59,  3.49it/s]
  6%|▌         | 21725/371472 [1:43:29<26:56:48,  3.61it/s]
  6%|▌         | 21726/371472 [1:43:29<28:40:46,  3.39it/s]
  6%|▌         | 21727/371472 [1:43:29<27:58:20,  3.47it/s]
  6%|▌         | 21728/371472 [1:43:30<26:32:30,  3.66it/s]
  6%|▌         | 21729/371472 [1:43:30<26:42:22,  3.64it/s]
  6%|▌         | 21730/371472 [1:43:30<28:55:40,  3.36it/s]
  6%|▌         | 21731/371472 [1:43:30<28:05:38,  3.46it/s]
  6%|▌         | 21732/371472 [1:43:31<28:06:12,  3.46it/s]
  6%|▌         | 21733/371472 [1:43:31<27:39:05,  3.51it/s]
  6%|▌         | 21734/371472 [1:43:31<28:07:55,  3.45it/s]
  6%|▌         | 21735/371472 [1:43:32<27:21:52,  3.55it/s]
  6%|▌         | 21736/371472 [1:43:32<27:51:22,  3.49it/s]
  6%|▌         | 21737/371472 [1:43:32<28:47:19,  3.37it/s]
  6%|▌         | 21738/371472 [1:43:32<28:14:48,  3.44it/s]
  6%|▌         | 21739/371472 [1:43:33<27:17:36,  3.56it/s]
  6%|▌         | 21740/371472 [1:43:33<26:45:36,  3.63it/s]
                                                           
{'loss': 4.5921, 'learning_rate': 9.47784912409231e-07, 'epoch': 0.94}

  6%|▌         | 21740/371472 [1:43:33<26:45:36,  3.63it/s]
  6%|▌         | 21741/371472 [1:43:33<29:30:13,  3.29it/s]
  6%|▌         | 21742/371472 [1:43:34<28:16:48,  3.44it/s]
  6%|▌         | 21743/371472 [1:43:34<27:15:16,  3.56it/s]
  6%|▌         | 21744/371472 [1:43:34<26:42:59,  3.64it/s]
  6%|▌         | 21745/371472 [1:43:34<26:22:45,  3.68it/s]
  6%|▌         | 21746/371472 [1:43:35<25:43:19,  3.78it/s]
  6%|▌         | 21747/371472 [1:43:35<25:28:14,  3.81it/s]
  6%|▌         | 21748/371472 [1:43:35<27:54:10,  3.48it/s]
  6%|▌         | 21749/371472 [1:43:36<26:56:58,  3.60it/s]
  6%|▌         | 21750/371472 [1:43:36<27:54:42,  3.48it/s]
  6%|▌         | 21751/371472 [1:43:36<26:55:02,  3.61it/s]
  6%|▌         | 21752/371472 [1:43:36<26:08:08,  3.72it/s]
  6%|▌         | 21753/371472 [1:43:37<26:52:00,  3.62it/s]
  6%|▌         | 21754/371472 [1:43:37<26:14:13,  3.70it/s]
  6%|▌         | 21755/371472 [1:43:37<27:34:05,  3.52it/s]
  6%|▌         | 21756/371472 [1:43:37<26:50:55,  3.62it/s]
  6%|▌         | 21757/371472 [1:43:38<27:28:12,  3.54it/s]
  6%|▌         | 21758/371472 [1:43:38<26:07:57,  3.72it/s]
  6%|▌         | 21759/371472 [1:43:38<26:16:10,  3.70it/s]
  6%|▌         | 21760/371472 [1:43:39<27:00:45,  3.60it/s]
                                                           
{'loss': 4.4418, 'learning_rate': 9.477364304337521e-07, 'epoch': 0.94}

  6%|▌         | 21760/371472 [1:43:39<27:00:45,  3.60it/s]
  6%|▌         | 21761/371472 [1:43:39<26:19:16,  3.69it/s]
  6%|▌         | 21762/371472 [1:43:39<26:08:40,  3.72it/s]
  6%|▌         | 21763/371472 [1:43:39<26:24:44,  3.68it/s]
  6%|▌         | 21764/371472 [1:43:40<26:50:50,  3.62it/s]
  6%|▌         | 21765/371472 [1:43:40<26:56:22,  3.61it/s]
  6%|▌         | 21766/371472 [1:43:40<27:53:21,  3.48it/s]
  6%|▌         | 21767/371472 [1:43:41<29:16:16,  3.32it/s]
  6%|▌         | 21768/371472 [1:43:41<28:01:21,  3.47it/s]
  6%|▌         | 21769/371472 [1:43:41<28:54:13,  3.36it/s]
  6%|▌         | 21770/371472 [1:43:42<33:29:47,  2.90it/s]
  6%|▌         | 21771/371472 [1:43:42<30:54:02,  3.14it/s]
  6%|▌         | 21772/371472 [1:43:42<30:13:37,  3.21it/s]
  6%|▌         | 21773/371472 [1:43:42<29:44:58,  3.27it/s]
  6%|▌         | 21774/371472 [1:43:43<28:19:14,  3.43it/s]
  6%|▌         | 21775/371472 [1:43:43<27:23:47,  3.55it/s]
  6%|▌         | 21776/371472 [1:43:43<27:59:18,  3.47it/s]
  6%|▌         | 21777/371472 [1:43:44<29:00:53,  3.35it/s]
  6%|▌         | 21778/371472 [1:43:44<28:08:06,  3.45it/s]
  6%|▌         | 21779/371472 [1:43:44<28:03:39,  3.46it/s]
  6%|▌         | 21780/371472 [1:43:44<28:43:08,  3.38it/s]
                                                           
{'loss': 4.5204, 'learning_rate': 9.47687948458273e-07, 'epoch': 0.94}

  6%|▌         | 21780/371472 [1:43:44<28:43:08,  3.38it/s]
  6%|▌         | 21781/371472 [1:43:45<28:25:29,  3.42it/s]
  6%|▌         | 21782/371472 [1:43:45<30:04:54,  3.23it/s]
  6%|▌         | 21783/371472 [1:43:45<30:18:29,  3.20it/s]
  6%|▌         | 21784/371472 [1:43:46<30:51:54,  3.15it/s]
  6%|▌         | 21785/371472 [1:43:46<30:45:30,  3.16it/s]
  6%|▌         | 21786/371472 [1:43:46<29:52:42,  3.25it/s]
  6%|▌         | 21787/371472 [1:43:47<28:40:32,  3.39it/s]
  6%|▌         | 21788/371472 [1:43:47<29:44:07,  3.27it/s]
  6%|▌         | 21789/371472 [1:43:47<28:03:34,  3.46it/s]
  6%|▌         | 21790/371472 [1:43:47<28:15:08,  3.44it/s]
  6%|▌         | 21791/371472 [1:43:48<27:54:21,  3.48it/s]
  6%|▌         | 21792/371472 [1:43:48<26:52:05,  3.62it/s]
  6%|▌         | 21793/371472 [1:43:48<28:36:29,  3.40it/s]
  6%|▌         | 21794/371472 [1:43:49<28:17:50,  3.43it/s]
  6%|▌         | 21795/371472 [1:43:49<26:46:39,  3.63it/s]
  6%|▌         | 21796/371472 [1:43:49<28:44:49,  3.38it/s]
  6%|▌         | 21797/371472 [1:43:49<27:48:46,  3.49it/s]
  6%|▌         | 21798/371472 [1:43:50<27:54:20,  3.48it/s]
  6%|▌         | 21799/371472 [1:43:50<27:52:40,  3.48it/s]
  6%|▌         | 21800/371472 [1:43:50<28:15:37,  3.44it/s]
                                                           
{'loss': 4.6105, 'learning_rate': 9.476394664827942e-07, 'epoch': 0.94}

  6%|▌         | 21800/371472 [1:43:50<28:15:37,  3.44it/s]
  6%|▌         | 21801/371472 [1:43:51<27:23:09,  3.55it/s]
  6%|▌         | 21802/371472 [1:43:51<28:06:10,  3.46it/s]
  6%|▌         | 21803/371472 [1:43:51<28:27:08,  3.41it/s]
  6%|▌         | 21804/371472 [1:43:51<28:14:36,  3.44it/s]
  6%|▌         | 21805/371472 [1:43:52<27:06:29,  3.58it/s]
  6%|▌         | 21806/371472 [1:43:52<29:15:25,  3.32it/s]
  6%|▌         | 21807/371472 [1:43:52<28:52:59,  3.36it/s]
  6%|▌         | 21808/371472 [1:43:53<28:49:55,  3.37it/s]
  6%|▌         | 21809/371472 [1:43:53<28:37:10,  3.39it/s]
  6%|▌         | 21810/371472 [1:43:53<28:03:58,  3.46it/s]
  6%|▌         | 21811/371472 [1:43:54<27:56:43,  3.48it/s]
  6%|▌         | 21812/371472 [1:43:54<28:07:59,  3.45it/s]
  6%|▌         | 21813/371472 [1:43:54<27:37:25,  3.52it/s]
  6%|▌         | 21814/371472 [1:43:54<26:19:46,  3.69it/s]
  6%|▌         | 21815/371472 [1:43:55<27:32:00,  3.53it/s]
  6%|▌         | 21816/371472 [1:43:55<26:57:26,  3.60it/s]
  6%|▌         | 21817/371472 [1:43:55<26:35:05,  3.65it/s]
  6%|▌         | 21818/371472 [1:43:56<28:00:22,  3.47it/s]
  6%|▌         | 21819/371472 [1:43:56<27:52:41,  3.48it/s]
  6%|▌         | 21820/371472 [1:43:56<27:47:55,  3.49it/s]
                                                           
{'loss': 4.6572, 'learning_rate': 9.475909845073153e-07, 'epoch': 0.94}

  6%|▌         | 21820/371472 [1:43:56<27:47:55,  3.49it/s]
  6%|▌         | 21821/371472 [1:43:56<27:44:45,  3.50it/s]
  6%|▌         | 21822/371472 [1:43:57<28:21:41,  3.42it/s]
  6%|▌         | 21823/371472 [1:43:57<27:38:43,  3.51it/s]
  6%|▌         | 21824/371472 [1:43:57<31:10:43,  3.12it/s]
  6%|▌         | 21825/371472 [1:43:58<29:00:49,  3.35it/s]
  6%|▌         | 21826/371472 [1:43:58<28:06:31,  3.46it/s]
  6%|▌         | 21827/371472 [1:43:58<27:07:56,  3.58it/s]
  6%|▌         | 21828/371472 [1:43:58<27:58:53,  3.47it/s]
  6%|▌         | 21829/371472 [1:43:59<27:43:44,  3.50it/s]
  6%|▌         | 21830/371472 [1:43:59<29:41:43,  3.27it/s]
  6%|▌         | 21831/371472 [1:43:59<30:09:11,  3.22it/s]
  6%|▌         | 21832/371472 [1:44:00<29:54:16,  3.25it/s]
  6%|▌         | 21833/371472 [1:44:00<28:55:38,  3.36it/s]
  6%|▌         | 21834/371472 [1:44:00<30:55:57,  3.14it/s]
  6%|▌         | 21835/371472 [1:44:01<29:05:11,  3.34it/s]
  6%|▌         | 21836/371472 [1:44:01<28:55:45,  3.36it/s]
  6%|▌         | 21837/371472 [1:44:01<27:39:27,  3.51it/s]
  6%|▌         | 21838/371472 [1:44:01<27:37:13,  3.52it/s]
  6%|▌         | 21839/371472 [1:44:02<28:04:33,  3.46it/s]
  6%|▌         | 21840/371472 [1:44:02<27:20:21,  3.55it/s]
                                                           
{'loss': 4.33, 'learning_rate': 9.475425025318365e-07, 'epoch': 0.94}

  6%|▌         | 21840/371472 [1:44:02<27:20:21,  3.55it/s]
  6%|▌         | 21841/371472 [1:44:02<27:06:53,  3.58it/s]
  6%|▌         | 21842/371472 [1:44:03<27:47:37,  3.49it/s]
  6%|▌         | 21843/371472 [1:44:03<27:42:32,  3.50it/s]
  6%|▌         | 21844/371472 [1:44:03<29:02:10,  3.34it/s]
  6%|▌         | 21845/371472 [1:44:03<29:02:34,  3.34it/s]
  6%|▌         | 21846/371472 [1:44:04<27:42:04,  3.51it/s]
  6%|▌         | 21847/371472 [1:44:04<27:35:00,  3.52it/s]
  6%|▌         | 21848/371472 [1:44:04<27:45:22,  3.50it/s]
  6%|▌         | 21849/371472 [1:44:05<27:39:39,  3.51it/s]
  6%|▌         | 21850/371472 [1:44:05<28:53:15,  3.36it/s]
  6%|▌         | 21851/371472 [1:44:05<27:32:23,  3.53it/s]
  6%|▌         | 21852/371472 [1:44:05<27:04:15,  3.59it/s]
  6%|▌         | 21853/371472 [1:44:06<26:53:21,  3.61it/s]
  6%|▌         | 21854/371472 [1:44:06<26:39:54,  3.64it/s]
  6%|▌         | 21855/371472 [1:44:06<27:06:38,  3.58it/s]
  6%|▌         | 21856/371472 [1:44:07<27:37:12,  3.52it/s]
  6%|▌         | 21857/371472 [1:44:07<28:39:36,  3.39it/s]
  6%|▌         | 21858/371472 [1:44:07<28:03:36,  3.46it/s]
  6%|▌         | 21859/371472 [1:44:07<27:01:13,  3.59it/s]
  6%|▌         | 21860/371472 [1:44:08<27:04:04,  3.59it/s]
                                                           
{'loss': 4.5902, 'learning_rate': 9.474940205563575e-07, 'epoch': 0.94}

  6%|▌         | 21860/371472 [1:44:08<27:04:04,  3.59it/s]
  6%|▌         | 21861/371472 [1:44:08<27:52:59,  3.48it/s]
  6%|▌         | 21862/371472 [1:44:08<29:23:40,  3.30it/s]
  6%|▌         | 21863/371472 [1:44:09<29:02:37,  3.34it/s]
  6%|▌         | 21864/371472 [1:44:09<27:37:43,  3.51it/s]
  6%|▌         | 21865/371472 [1:44:09<33:56:41,  2.86it/s]
  6%|▌         | 21866/371472 [1:44:10<31:10:09,  3.12it/s]
  6%|▌         | 21867/371472 [1:44:10<29:27:13,  3.30it/s]
  6%|▌         | 21868/371472 [1:44:10<28:55:26,  3.36it/s]
  6%|▌         | 21869/371472 [1:44:10<29:07:42,  3.33it/s]
  6%|▌         | 21870/371472 [1:44:11<28:29:28,  3.41it/s]
  6%|▌         | 21871/371472 [1:44:11<27:46:53,  3.50it/s]
  6%|▌         | 21872/371472 [1:44:11<27:14:38,  3.56it/s]
  6%|▌         | 21873/371472 [1:44:12<26:56:03,  3.61it/s]
  6%|▌         | 21874/371472 [1:44:12<26:40:07,  3.64it/s]
  6%|▌         | 21875/371472 [1:44:12<26:40:08,  3.64it/s]
  6%|▌         | 21876/371472 [1:44:12<27:46:59,  3.50it/s]
  6%|▌         | 21877/371472 [1:44:13<27:33:35,  3.52it/s]
  6%|▌         | 21878/371472 [1:44:13<26:53:19,  3.61it/s]
  6%|▌         | 21879/371472 [1:44:13<26:49:41,  3.62it/s]
  6%|▌         | 21880/371472 [1:44:13<25:52:48,  3.75it/s]
                                                           
{'loss': 4.3756, 'learning_rate': 9.474455385808787e-07, 'epoch': 0.94}

  6%|▌         | 21880/371472 [1:44:13<25:52:48,  3.75it/s]
  6%|▌         | 21881/371472 [1:44:14<25:50:21,  3.76it/s]
  6%|▌         | 21882/371472 [1:44:14<27:06:40,  3.58it/s]
  6%|▌         | 21883/371472 [1:44:14<26:37:43,  3.65it/s]
  6%|▌         | 21884/371472 [1:44:15<26:15:40,  3.70it/s]
  6%|▌         | 21885/371472 [1:44:15<26:35:10,  3.65it/s]
  6%|▌         | 21886/371472 [1:44:15<27:03:34,  3.59it/s]
  6%|▌         | 21887/371472 [1:44:15<26:57:48,  3.60it/s]
  6%|▌         | 21888/371472 [1:44:16<25:50:18,  3.76it/s]
  6%|▌         | 21889/371472 [1:44:16<26:06:58,  3.72it/s]
  6%|▌         | 21890/371472 [1:44:16<25:49:46,  3.76it/s]
  6%|▌         | 21891/371472 [1:44:16<26:02:14,  3.73it/s]
  6%|▌         | 21892/371472 [1:44:17<27:24:42,  3.54it/s]
  6%|▌         | 21893/371472 [1:44:17<27:25:19,  3.54it/s]
  6%|▌         | 21894/371472 [1:44:17<27:11:58,  3.57it/s]
  6%|▌         | 21895/371472 [1:44:18<26:46:18,  3.63it/s]
  6%|▌         | 21896/371472 [1:44:18<25:50:38,  3.76it/s]
  6%|▌         | 21897/371472 [1:44:18<26:49:18,  3.62it/s]
  6%|▌         | 21898/371472 [1:44:18<27:33:32,  3.52it/s]
  6%|▌         | 21899/371472 [1:44:19<28:55:55,  3.36it/s]
  6%|▌         | 21900/371472 [1:44:19<27:14:45,  3.56it/s]
                                                           
{'loss': 4.5468, 'learning_rate': 9.473970566053997e-07, 'epoch': 0.94}

  6%|▌         | 21900/371472 [1:44:19<27:14:45,  3.56it/s]
  6%|▌         | 21901/371472 [1:44:19<26:02:43,  3.73it/s]
  6%|▌         | 21902/371472 [1:44:20<27:04:59,  3.59it/s]
  6%|▌         | 21903/371472 [1:44:20<27:37:34,  3.51it/s]
  6%|▌         | 21904/371472 [1:44:20<28:54:28,  3.36it/s]
  6%|▌         | 21905/371472 [1:44:20<27:47:28,  3.49it/s]
  6%|▌         | 21906/371472 [1:44:21<26:36:54,  3.65it/s]
  6%|▌         | 21907/371472 [1:44:21<26:51:06,  3.62it/s]
  6%|▌         | 21908/371472 [1:44:21<25:55:20,  3.75it/s]
  6%|▌         | 21909/371472 [1:44:21<25:14:39,  3.85it/s]
  6%|▌         | 21910/371472 [1:44:22<26:36:12,  3.65it/s]
  6%|▌         | 21911/371472 [1:44:22<26:21:50,  3.68it/s]
  6%|▌         | 21912/371472 [1:44:22<27:45:13,  3.50it/s]
  6%|▌         | 21913/371472 [1:44:23<27:47:12,  3.49it/s]
  6%|▌         | 21914/371472 [1:44:23<30:41:43,  3.16it/s]
  6%|▌         | 21915/371472 [1:44:23<30:01:27,  3.23it/s]
  6%|▌         | 21916/371472 [1:44:24<30:39:08,  3.17it/s]
  6%|▌         | 21917/371472 [1:44:24<29:40:20,  3.27it/s]
  6%|▌         | 21918/371472 [1:44:24<28:58:39,  3.35it/s]
  6%|▌         | 21919/371472 [1:44:24<27:28:27,  3.53it/s]
  6%|▌         | 21920/371472 [1:44:25<27:03:42,  3.59it/s]
                                                           
{'loss': 4.4465, 'learning_rate': 9.473485746299209e-07, 'epoch': 0.94}

  6%|▌         | 21920/371472 [1:44:25<27:03:42,  3.59it/s]
  6%|▌         | 21921/371472 [1:44:25<26:44:18,  3.63it/s]
  6%|▌         | 21922/371472 [1:44:25<26:23:20,  3.68it/s]
  6%|▌         | 21923/371472 [1:44:26<26:17:11,  3.69it/s]
  6%|▌         | 21924/371472 [1:44:26<26:14:49,  3.70it/s]
  6%|▌         | 21925/371472 [1:44:26<25:16:30,  3.84it/s]
  6%|▌         | 21926/371472 [1:44:26<25:40:20,  3.78it/s]
  6%|▌         | 21927/371472 [1:44:27<27:15:52,  3.56it/s]
  6%|▌         | 21928/371472 [1:44:27<27:54:21,  3.48it/s]
  6%|▌         | 21929/371472 [1:44:27<27:47:35,  3.49it/s]
  6%|▌         | 21930/371472 [1:44:27<27:46:03,  3.50it/s]
  6%|▌         | 21931/371472 [1:44:28<28:08:19,  3.45it/s]
  6%|▌         | 21932/371472 [1:44:28<26:57:54,  3.60it/s]
  6%|▌         | 21933/371472 [1:44:28<28:16:02,  3.43it/s]
  6%|▌         | 21934/371472 [1:44:29<28:59:52,  3.35it/s]
  6%|▌         | 21935/371472 [1:44:29<27:54:57,  3.48it/s]
  6%|▌         | 21936/371472 [1:44:29<27:54:59,  3.48it/s]
  6%|▌         | 21937/371472 [1:44:29<27:18:14,  3.56it/s]
  6%|▌         | 21938/371472 [1:44:30<27:07:23,  3.58it/s]
  6%|▌         | 21939/371472 [1:44:30<27:31:23,  3.53it/s]
  6%|▌         | 21940/371472 [1:44:30<27:16:56,  3.56it/s]
                                                           
{'loss': 4.6516, 'learning_rate': 9.473000926544419e-07, 'epoch': 0.94}

  6%|▌         | 21940/371472 [1:44:30<27:16:56,  3.56it/s]
  6%|▌         | 21941/371472 [1:44:31<26:21:46,  3.68it/s]
  6%|▌         | 21942/371472 [1:44:31<26:09:50,  3.71it/s]
  6%|▌         | 21943/371472 [1:44:31<27:58:27,  3.47it/s]
  6%|▌         | 21944/371472 [1:44:31<27:56:35,  3.47it/s]
  6%|▌         | 21945/371472 [1:44:32<28:25:36,  3.42it/s]
  6%|▌         | 21946/371472 [1:44:32<28:47:13,  3.37it/s]
  6%|▌         | 21947/371472 [1:44:32<29:13:23,  3.32it/s]
  6%|▌         | 21948/371472 [1:44:33<28:37:04,  3.39it/s]
  6%|▌         | 21949/371472 [1:44:33<29:34:38,  3.28it/s]
  6%|▌         | 21950/371472 [1:44:33<28:08:36,  3.45it/s]
  6%|▌         | 21951/371472 [1:44:33<26:50:37,  3.62it/s]
  6%|▌         | 21952/371472 [1:44:34<26:29:11,  3.67it/s]
  6%|▌         | 21953/371472 [1:44:34<27:01:48,  3.59it/s]
  6%|▌         | 21954/371472 [1:44:34<27:39:55,  3.51it/s]
  6%|▌         | 21955/371472 [1:44:35<27:46:29,  3.50it/s]
  6%|▌         | 21956/371472 [1:44:35<27:28:46,  3.53it/s]
  6%|▌         | 21957/371472 [1:44:35<27:26:48,  3.54it/s]
  6%|▌         | 21958/371472 [1:44:35<27:16:35,  3.56it/s]
  6%|▌         | 21959/371472 [1:44:36<26:31:24,  3.66it/s]
  6%|▌         | 21960/371472 [1:44:36<26:09:08,  3.71it/s]
                                                           
{'loss': 4.328, 'learning_rate': 9.472516106789631e-07, 'epoch': 0.95}

  6%|▌         | 21960/371472 [1:44:36<26:09:08,  3.71it/s]
  6%|▌         | 21961/371472 [1:44:36<25:33:52,  3.80it/s]
  6%|▌         | 21962/371472 [1:44:37<26:03:25,  3.73it/s]
  6%|▌         | 21963/371472 [1:44:37<25:16:10,  3.84it/s]
  6%|▌         | 21964/371472 [1:44:37<26:09:31,  3.71it/s]
  6%|▌         | 21965/371472 [1:44:37<26:53:17,  3.61it/s]
  6%|▌         | 21966/371472 [1:44:38<27:23:32,  3.54it/s]
  6%|▌         | 21967/371472 [1:44:38<27:24:55,  3.54it/s]
  6%|▌         | 21968/371472 [1:44:38<27:39:13,  3.51it/s]
  6%|▌         | 21969/371472 [1:44:38<27:23:00,  3.55it/s]
  6%|▌         | 21970/371472 [1:44:39<26:09:30,  3.71it/s]
  6%|▌         | 21971/371472 [1:44:39<26:17:10,  3.69it/s]
  6%|▌         | 21972/371472 [1:44:39<27:36:52,  3.52it/s]
  6%|▌         | 21973/371472 [1:44:40<27:47:18,  3.49it/s]
  6%|▌         | 21974/371472 [1:44:40<28:07:24,  3.45it/s]
  6%|▌         | 21975/371472 [1:44:40<27:56:52,  3.47it/s]
  6%|▌         | 21976/371472 [1:44:40<27:46:10,  3.50it/s]
  6%|▌         | 21977/371472 [1:44:41<28:00:31,  3.47it/s]
  6%|▌         | 21978/371472 [1:44:41<27:37:26,  3.51it/s]
  6%|▌         | 21979/371472 [1:44:41<27:12:48,  3.57it/s]
  6%|▌         | 21980/371472 [1:44:42<26:54:09,  3.61it/s]
                                                           
{'loss': 4.6072, 'learning_rate': 9.472031287034842e-07, 'epoch': 0.95}

  6%|▌         | 21980/371472 [1:44:42<26:54:09,  3.61it/s]
  6%|▌         | 21981/371472 [1:44:42<27:08:33,  3.58it/s]
  6%|▌         | 21982/371472 [1:44:42<28:26:22,  3.41it/s]
  6%|▌         | 21983/371472 [1:44:42<27:55:36,  3.48it/s]
  6%|▌         | 21984/371472 [1:44:43<26:59:51,  3.60it/s]
  6%|▌         | 21985/371472 [1:44:43<28:39:32,  3.39it/s]
  6%|▌         | 21986/371472 [1:44:43<28:10:10,  3.45it/s]
  6%|▌         | 21987/371472 [1:44:44<28:17:46,  3.43it/s]
  6%|▌         | 21988/371472 [1:44:44<28:52:29,  3.36it/s]
  6%|▌         | 21989/371472 [1:44:44<27:42:18,  3.50it/s]
  6%|▌         | 21990/371472 [1:44:44<27:41:08,  3.51it/s]
  6%|▌         | 21991/371472 [1:44:45<29:41:12,  3.27it/s]
  6%|▌         | 21992/371472 [1:44:45<30:57:44,  3.14it/s]
  6%|▌         | 21993/371472 [1:44:46<31:31:22,  3.08it/s]
  6%|▌         | 21994/371472 [1:44:46<31:19:28,  3.10it/s]
  6%|▌         | 21995/371472 [1:44:46<31:14:32,  3.11it/s]
  6%|▌         | 21996/371472 [1:44:46<30:45:21,  3.16it/s]
  6%|▌         | 21997/371472 [1:44:47<29:59:14,  3.24it/s]
  6%|▌         | 21998/371472 [1:44:47<28:37:38,  3.39it/s]
  6%|▌         | 21999/371472 [1:44:47<27:20:28,  3.55it/s]
  6%|▌         | 22000/371472 [1:44:48<29:50:18,  3.25it/s]
                                                           
{'loss': 4.2032, 'learning_rate': 9.471546467280054e-07, 'epoch': 0.95}

  6%|▌         | 22000/371472 [1:44:48<29:50:18,  3.25it/s]
  6%|▌         | 22001/371472 [1:44:48<29:13:50,  3.32it/s]
  6%|▌         | 22002/371472 [1:44:48<30:39:33,  3.17it/s]
  6%|▌         | 22003/371472 [1:44:49<29:50:58,  3.25it/s]
  6%|▌         | 22004/371472 [1:44:49<30:27:23,  3.19it/s]
  6%|▌         | 22005/371472 [1:44:49<32:22:02,  3.00it/s]
  6%|▌         | 22006/371472 [1:44:50<31:53:54,  3.04it/s]
  6%|▌         | 22007/371472 [1:44:50<30:32:52,  3.18it/s]
  6%|▌         | 22008/371472 [1:44:50<29:00:47,  3.35it/s]
  6%|▌         | 22009/371472 [1:44:50<27:39:01,  3.51it/s]
  6%|▌         | 22010/371472 [1:44:51<28:15:14,  3.44it/s]
  6%|▌         | 22011/371472 [1:44:51<29:14:18,  3.32it/s]
  6%|▌         | 22012/371472 [1:44:51<27:50:57,  3.49it/s]
  6%|▌         | 22013/371472 [1:44:52<28:04:53,  3.46it/s]
  6%|▌         | 22014/371472 [1:44:52<27:50:35,  3.49it/s]
  6%|▌         | 22015/371472 [1:44:52<27:48:13,  3.49it/s]
  6%|▌         | 22016/371472 [1:44:52<29:01:28,  3.34it/s]
  6%|▌         | 22017/371472 [1:44:53<28:42:26,  3.38it/s]
  6%|▌         | 22018/371472 [1:44:53<27:47:40,  3.49it/s]
  6%|▌         | 22019/371472 [1:44:53<28:40:43,  3.38it/s]
  6%|▌         | 22020/371472 [1:44:54<27:55:07,  3.48it/s]
                                                           
{'loss': 4.3651, 'learning_rate': 9.471061647525264e-07, 'epoch': 0.95}

  6%|▌         | 22020/371472 [1:44:54<27:55:07,  3.48it/s]
  6%|▌         | 22021/371472 [1:44:54<26:48:40,  3.62it/s]
  6%|▌         | 22022/371472 [1:44:54<26:21:08,  3.68it/s]
  6%|▌         | 22023/371472 [1:44:54<27:08:33,  3.58it/s]
  6%|▌         | 22024/371472 [1:44:55<27:18:58,  3.55it/s]
  6%|▌         | 22025/371472 [1:44:55<26:33:28,  3.65it/s]
  6%|▌         | 22026/371472 [1:44:55<28:35:25,  3.40it/s]
  6%|▌         | 22027/371472 [1:44:56<31:12:06,  3.11it/s]
  6%|▌         | 22028/371472 [1:44:56<30:32:17,  3.18it/s]
  6%|▌         | 22029/371472 [1:44:56<31:43:05,  3.06it/s]
  6%|▌         | 22030/371472 [1:44:57<30:51:45,  3.15it/s]
  6%|▌         | 22031/371472 [1:44:57<29:33:04,  3.28it/s]
  6%|▌         | 22032/371472 [1:44:57<29:05:50,  3.34it/s]
  6%|▌         | 22033/371472 [1:44:57<28:13:58,  3.44it/s]
  6%|▌         | 22034/371472 [1:44:58<29:13:22,  3.32it/s]
  6%|▌         | 22035/371472 [1:44:58<29:19:10,  3.31it/s]
  6%|▌         | 22036/371472 [1:44:58<29:30:38,  3.29it/s]
  6%|▌         | 22037/371472 [1:44:59<28:18:22,  3.43it/s]
  6%|▌         | 22038/371472 [1:44:59<28:59:38,  3.35it/s]
  6%|▌         | 22039/371472 [1:44:59<28:48:38,  3.37it/s]
  6%|▌         | 22040/371472 [1:45:00<30:19:11,  3.20it/s]
                                                           
{'loss': 4.263, 'learning_rate': 9.470576827770474e-07, 'epoch': 0.95}

  6%|▌         | 22040/371472 [1:45:00<30:19:11,  3.20it/s]
  6%|▌         | 22041/371472 [1:45:00<28:44:39,  3.38it/s]
  6%|▌         | 22042/371472 [1:45:00<28:37:32,  3.39it/s]
  6%|▌         | 22043/371472 [1:45:00<28:00:41,  3.47it/s]
  6%|▌         | 22044/371472 [1:45:01<27:20:11,  3.55it/s]
  6%|▌         | 22045/371472 [1:45:01<26:18:58,  3.69it/s]
  6%|▌         | 22046/371472 [1:45:01<26:26:02,  3.67it/s]
  6%|▌         | 22047/371472 [1:45:01<26:11:50,  3.71it/s]
  6%|▌         | 22048/371472 [1:45:02<26:05:56,  3.72it/s]
  6%|▌         | 22049/371472 [1:45:02<25:57:33,  3.74it/s]
  6%|▌         | 22050/371472 [1:45:02<25:43:43,  3.77it/s]
  6%|▌         | 22051/371472 [1:45:03<25:18:47,  3.83it/s]
  6%|▌         | 22052/371472 [1:45:03<26:30:35,  3.66it/s]
  6%|▌         | 22053/371472 [1:45:03<25:34:29,  3.80it/s]
  6%|▌         | 22054/371472 [1:45:03<25:21:09,  3.83it/s]
  6%|▌         | 22055/371472 [1:45:04<27:08:24,  3.58it/s]
  6%|▌         | 22056/371472 [1:45:04<28:26:45,  3.41it/s]
  6%|▌         | 22057/371472 [1:45:04<27:08:29,  3.58it/s]
  6%|▌         | 22058/371472 [1:45:04<26:55:16,  3.61it/s]
  6%|▌         | 22059/371472 [1:45:05<26:24:56,  3.67it/s]
  6%|▌         | 22060/371472 [1:45:05<26:06:00,  3.72it/s]
                                                           
{'loss': 4.6553, 'learning_rate': 9.470092008015686e-07, 'epoch': 0.95}

  6%|▌         | 22060/371472 [1:45:05<26:06:00,  3.72it/s]
  6%|▌         | 22061/371472 [1:45:05<26:33:58,  3.65it/s]
  6%|▌         | 22062/371472 [1:45:06<26:30:47,  3.66it/s]
  6%|▌         | 22063/371472 [1:45:06<25:38:51,  3.78it/s]
  6%|▌         | 22064/371472 [1:45:06<25:47:12,  3.76it/s]
  6%|▌         | 22065/371472 [1:45:06<26:29:08,  3.66it/s]
  6%|▌         | 22066/371472 [1:45:07<26:25:35,  3.67it/s]
  6%|▌         | 22067/371472 [1:45:07<26:57:06,  3.60it/s]
  6%|▌         | 22068/371472 [1:45:07<27:31:15,  3.53it/s]
  6%|▌         | 22069/371472 [1:45:07<26:44:14,  3.63it/s]
  6%|▌         | 22070/371472 [1:45:08<26:52:12,  3.61it/s]
  6%|▌         | 22071/371472 [1:45:08<26:58:54,  3.60it/s]
  6%|▌         | 22072/371472 [1:45:08<28:42:20,  3.38it/s]
  6%|▌         | 22073/371472 [1:45:09<28:05:29,  3.45it/s]
  6%|▌         | 22074/371472 [1:45:09<29:08:41,  3.33it/s]
  6%|▌         | 22075/371472 [1:45:09<29:28:31,  3.29it/s]
  6%|▌         | 22076/371472 [1:45:10<28:46:41,  3.37it/s]
  6%|▌         | 22077/371472 [1:45:10<27:08:00,  3.58it/s]
  6%|▌         | 22078/371472 [1:45:10<26:38:19,  3.64it/s]
  6%|▌         | 22079/371472 [1:45:10<25:59:57,  3.73it/s]
  6%|▌         | 22080/371472 [1:45:11<28:29:35,  3.41it/s]
                                                           
{'loss': 4.4842, 'learning_rate': 9.469607188260898e-07, 'epoch': 0.95}

  6%|▌         | 22080/371472 [1:45:11<28:29:35,  3.41it/s]
  6%|▌         | 22081/371472 [1:45:11<27:53:14,  3.48it/s]
  6%|▌         | 22082/371472 [1:45:11<29:13:03,  3.32it/s]
  6%|▌         | 22083/371472 [1:45:12<28:48:36,  3.37it/s]
  6%|▌         | 22084/371472 [1:45:12<28:29:27,  3.41it/s]
  6%|▌         | 22085/371472 [1:45:12<27:22:59,  3.54it/s]
  6%|▌         | 22086/371472 [1:45:12<28:44:16,  3.38it/s]
  6%|▌         | 22087/371472 [1:45:13<28:42:59,  3.38it/s]
  6%|▌         | 22088/371472 [1:45:13<30:49:13,  3.15it/s]
  6%|▌         | 22089/371472 [1:45:13<31:06:44,  3.12it/s]
  6%|▌         | 22090/371472 [1:45:14<31:11:48,  3.11it/s]
  6%|▌         | 22091/371472 [1:45:14<29:48:25,  3.26it/s]
  6%|▌         | 22092/371472 [1:45:14<28:51:45,  3.36it/s]
  6%|▌         | 22093/371472 [1:45:15<29:24:51,  3.30it/s]
  6%|▌         | 22094/371472 [1:45:15<28:06:43,  3.45it/s]
  6%|▌         | 22095/371472 [1:45:15<28:48:05,  3.37it/s]
  6%|▌         | 22096/371472 [1:45:15<27:52:46,  3.48it/s]
  6%|▌         | 22097/371472 [1:45:16<32:42:15,  2.97it/s]
  6%|▌         | 22098/371472 [1:45:16<31:40:02,  3.06it/s]
  6%|▌         | 22099/371472 [1:45:16<29:34:34,  3.28it/s]
  6%|▌         | 22100/371472 [1:45:17<27:46:30,  3.49it/s]
                                                           
{'loss': 4.344, 'learning_rate': 9.469122368506108e-07, 'epoch': 0.95}

  6%|▌         | 22100/371472 [1:45:17<27:46:30,  3.49it/s]
  6%|▌         | 22101/371472 [1:45:17<29:16:21,  3.32it/s]
  6%|▌         | 22102/371472 [1:45:17<30:33:32,  3.18it/s]
  6%|▌         | 22103/371472 [1:45:18<29:06:50,  3.33it/s]
  6%|▌         | 22104/371472 [1:45:18<30:53:31,  3.14it/s]
  6%|▌         | 22105/371472 [1:45:18<30:14:40,  3.21it/s]
  6%|▌         | 22106/371472 [1:45:19<29:30:36,  3.29it/s]
  6%|▌         | 22107/371472 [1:45:19<29:57:11,  3.24it/s]
  6%|▌         | 22108/371472 [1:45:19<28:36:52,  3.39it/s]
  6%|▌         | 22109/371472 [1:45:19<27:51:33,  3.48it/s]
  6%|▌         | 22110/371472 [1:45:20<29:00:36,  3.35it/s]
  6%|▌         | 22111/371472 [1:45:20<29:06:21,  3.33it/s]
  6%|▌         | 22112/371472 [1:45:20<28:09:51,  3.45it/s]
  6%|▌         | 22113/371472 [1:45:21<27:06:44,  3.58it/s]
  6%|▌         | 22114/371472 [1:45:21<27:23:26,  3.54it/s]
  6%|▌         | 22115/371472 [1:45:21<27:39:21,  3.51it/s]
  6%|▌         | 22116/371472 [1:45:21<28:05:26,  3.45it/s]
  6%|▌         | 22117/371472 [1:45:22<27:23:04,  3.54it/s]
  6%|▌         | 22118/371472 [1:45:22<26:34:55,  3.65it/s]
  6%|▌         | 22119/371472 [1:45:22<25:59:32,  3.73it/s]
  6%|▌         | 22120/371472 [1:45:23<26:40:22,  3.64it/s]
                                                           
{'loss': 4.4443, 'learning_rate': 9.46863754875132e-07, 'epoch': 0.95}

  6%|▌         | 22120/371472 [1:45:23<26:40:22,  3.64it/s]
  6%|▌         | 22121/371472 [1:45:23<25:52:29,  3.75it/s]
  6%|▌         | 22122/371472 [1:45:23<27:05:31,  3.58it/s]
  6%|▌         | 22123/371472 [1:45:23<27:53:47,  3.48it/s]
  6%|▌         | 22124/371472 [1:45:24<27:15:17,  3.56it/s]
  6%|▌         | 22125/371472 [1:45:24<28:38:36,  3.39it/s]
  6%|▌         | 22126/371472 [1:45:24<27:12:37,  3.57it/s]
  6%|▌         | 22127/371472 [1:45:25<26:56:38,  3.60it/s]
  6%|▌         | 22128/371472 [1:45:25<26:27:26,  3.67it/s]
  6%|▌         | 22129/371472 [1:45:25<27:03:56,  3.59it/s]
  6%|▌         | 22130/371472 [1:45:25<26:05:28,  3.72it/s]
  6%|▌         | 22131/371472 [1:45:26<27:34:19,  3.52it/s]
  6%|▌         | 22132/371472 [1:45:26<28:00:02,  3.47it/s]
  6%|▌         | 22133/371472 [1:45:26<27:54:10,  3.48it/s]
  6%|▌         | 22134/371472 [1:45:27<27:34:29,  3.52it/s]
  6%|▌         | 22135/371472 [1:45:27<28:13:09,  3.44it/s]
  6%|▌         | 22136/371472 [1:45:27<28:31:06,  3.40it/s]
  6%|▌         | 22137/371472 [1:45:28<30:59:05,  3.13it/s]
  6%|▌         | 22138/371472 [1:45:28<29:45:18,  3.26it/s]
  6%|▌         | 22139/371472 [1:45:28<28:01:05,  3.46it/s]
  6%|▌         | 22140/371472 [1:45:28<29:15:19,  3.32it/s]
                                                           
{'loss': 4.4187, 'learning_rate': 9.468152728996532e-07, 'epoch': 0.95}

  6%|▌         | 22140/371472 [1:45:28<29:15:19,  3.32it/s]
  6%|▌         | 22141/371472 [1:45:29<29:49:50,  3.25it/s]
  6%|▌         | 22142/371472 [1:45:29<28:36:54,  3.39it/s]
  6%|▌         | 22143/371472 [1:45:29<27:36:55,  3.51it/s]
  6%|▌         | 22144/371472 [1:45:29<26:39:38,  3.64it/s]
  6%|▌         | 22145/371472 [1:45:30<26:38:32,  3.64it/s]
  6%|▌         | 22146/371472 [1:45:30<26:12:53,  3.70it/s]
  6%|▌         | 22147/371472 [1:45:30<26:39:34,  3.64it/s]
  6%|▌         | 22148/371472 [1:45:31<27:44:09,  3.50it/s]
  6%|▌         | 22149/371472 [1:45:31<26:58:16,  3.60it/s]
  6%|▌         | 22150/371472 [1:45:31<27:06:55,  3.58it/s]
  6%|▌         | 22151/371472 [1:45:31<26:16:41,  3.69it/s]
  6%|▌         | 22152/371472 [1:45:32<26:32:40,  3.66it/s]
  6%|▌         | 22153/371472 [1:45:32<26:54:58,  3.61it/s]
  6%|▌         | 22154/371472 [1:45:32<27:12:00,  3.57it/s]
  6%|▌         | 22155/371472 [1:45:33<27:59:20,  3.47it/s]
  6%|▌         | 22156/371472 [1:45:33<27:37:42,  3.51it/s]
  6%|▌         | 22157/371472 [1:45:33<27:02:31,  3.59it/s]
  6%|▌         | 22158/371472 [1:45:33<26:07:46,  3.71it/s]
  6%|▌         | 22159/371472 [1:45:34<25:28:54,  3.81it/s]
  6%|▌         | 22160/371472 [1:45:34<25:40:56,  3.78it/s]
                                                           
{'loss': 4.3837, 'learning_rate': 9.467667909241741e-07, 'epoch': 0.95}

  6%|▌         | 22160/371472 [1:45:34<25:40:56,  3.78it/s]
  6%|▌         | 22161/371472 [1:45:34<26:23:15,  3.68it/s]
  6%|▌         | 22162/371472 [1:45:34<27:03:20,  3.59it/s]
  6%|▌         | 22163/371472 [1:45:35<28:38:28,  3.39it/s]
  6%|▌         | 22164/371472 [1:45:35<29:32:50,  3.28it/s]
  6%|▌         | 22165/371472 [1:45:35<29:29:26,  3.29it/s]
  6%|▌         | 22166/371472 [1:45:36<28:47:52,  3.37it/s]
  6%|▌         | 22167/371472 [1:45:36<29:10:37,  3.33it/s]
  6%|▌         | 22168/371472 [1:45:36<28:06:24,  3.45it/s]
  6%|▌         | 22169/371472 [1:45:37<27:17:38,  3.55it/s]
  6%|▌         | 22170/371472 [1:45:37<26:25:32,  3.67it/s]
  6%|▌         | 22171/371472 [1:45:37<26:52:00,  3.61it/s]
  6%|▌         | 22172/371472 [1:45:37<26:46:45,  3.62it/s]
  6%|▌         | 22173/371472 [1:45:38<25:58:43,  3.73it/s]
  6%|▌         | 22174/371472 [1:45:38<26:20:04,  3.68it/s]
  6%|▌         | 22175/371472 [1:45:38<26:04:57,  3.72it/s]
  6%|▌         | 22176/371472 [1:45:38<26:30:05,  3.66it/s]
  6%|▌         | 22177/371472 [1:45:39<26:32:48,  3.65it/s]
  6%|▌         | 22178/371472 [1:45:39<26:26:23,  3.67it/s]
  6%|▌         | 22179/371472 [1:45:39<27:02:12,  3.59it/s]
  6%|▌         | 22180/371472 [1:45:40<31:01:18,  3.13it/s]
                                                           
{'loss': 4.6523, 'learning_rate': 9.467183089486952e-07, 'epoch': 0.96}

  6%|▌         | 22180/371472 [1:45:40<31:01:18,  3.13it/s]
  6%|▌         | 22181/371472 [1:45:40<30:28:26,  3.18it/s]
  6%|▌         | 22182/371472 [1:45:40<29:39:06,  3.27it/s]
  6%|▌         | 22183/371472 [1:45:41<29:13:58,  3.32it/s]
  6%|▌         | 22184/371472 [1:45:41<28:15:31,  3.43it/s]
  6%|▌         | 22185/371472 [1:45:41<28:01:22,  3.46it/s]
  6%|▌         | 22186/371472 [1:45:41<27:16:19,  3.56it/s]
  6%|▌         | 22187/371472 [1:45:42<28:27:56,  3.41it/s]
  6%|▌         | 22188/371472 [1:45:42<26:54:34,  3.61it/s]
  6%|▌         | 22189/371472 [1:45:42<26:26:22,  3.67it/s]
  6%|▌         | 22190/371472 [1:45:42<27:32:01,  3.52it/s]
  6%|▌         | 22191/371472 [1:45:43<27:02:09,  3.59it/s]
  6%|▌         | 22192/371472 [1:45:43<29:13:12,  3.32it/s]
  6%|▌         | 22193/371472 [1:45:43<28:03:25,  3.46it/s]
  6%|▌         | 22194/371472 [1:45:44<31:18:21,  3.10it/s]
  6%|▌         | 22195/371472 [1:45:44<29:34:46,  3.28it/s]
  6%|▌         | 22196/371472 [1:45:44<28:29:33,  3.41it/s]
  6%|▌         | 22197/371472 [1:45:45<32:34:42,  2.98it/s]
  6%|▌         | 22198/371472 [1:45:45<31:56:26,  3.04it/s]
  6%|▌         | 22199/371472 [1:45:45<30:43:14,  3.16it/s]
  6%|▌         | 22200/371472 [1:45:46<29:51:06,  3.25it/s]
                                                           
{'loss': 4.3209, 'learning_rate': 9.466698269732164e-07, 'epoch': 0.96}

  6%|▌         | 22200/371472 [1:45:46<29:51:06,  3.25it/s]
  6%|▌         | 22201/371472 [1:45:46<30:09:55,  3.22it/s]
  6%|▌         | 22202/371472 [1:45:46<29:25:14,  3.30it/s]
  6%|▌         | 22203/371472 [1:45:46<28:41:56,  3.38it/s]
  6%|▌         | 22204/371472 [1:45:47<28:33:34,  3.40it/s]
  6%|▌         | 22205/371472 [1:45:47<27:23:43,  3.54it/s]
  6%|▌         | 22206/371472 [1:45:47<26:54:08,  3.61it/s]
  6%|▌         | 22207/371472 [1:45:48<25:52:16,  3.75it/s]
  6%|▌         | 22208/371472 [1:45:48<26:04:31,  3.72it/s]
  6%|▌         | 22209/371472 [1:45:48<25:43:40,  3.77it/s]
  6%|▌         | 22210/371472 [1:45:48<26:20:52,  3.68it/s]
  6%|▌         | 22211/371472 [1:45:49<27:54:08,  3.48it/s]
  6%|▌         | 22212/371472 [1:45:49<26:35:25,  3.65it/s]
  6%|▌         | 22213/371472 [1:45:49<26:19:23,  3.69it/s]
  6%|▌         | 22214/371472 [1:45:50<27:59:45,  3.47it/s]
  6%|▌         | 22215/371472 [1:45:50<30:30:07,  3.18it/s]
  6%|▌         | 22216/371472 [1:45:50<28:35:46,  3.39it/s]
  6%|▌         | 22217/371472 [1:45:50<28:34:31,  3.40it/s]
  6%|▌         | 22218/371472 [1:45:51<27:37:12,  3.51it/s]
  6%|▌         | 22219/371472 [1:45:51<27:28:49,  3.53it/s]
  6%|▌         | 22220/371472 [1:45:51<26:40:44,  3.64it/s]
                                                           
{'loss': 4.6185, 'learning_rate': 9.466213449977375e-07, 'epoch': 0.96}

  6%|▌         | 22220/371472 [1:45:51<26:40:44,  3.64it/s]
  6%|▌         | 22221/371472 [1:45:52<26:24:09,  3.67it/s]
  6%|▌         | 22222/371472 [1:45:52<25:55:51,  3.74it/s]
  6%|▌         | 22223/371472 [1:45:52<26:00:57,  3.73it/s]
  6%|▌         | 22224/371472 [1:45:52<27:44:20,  3.50it/s]
  6%|▌         | 22225/371472 [1:45:53<27:50:43,  3.48it/s]
  6%|▌         | 22226/371472 [1:45:53<27:37:05,  3.51it/s]
  6%|▌         | 22227/371472 [1:45:53<27:13:43,  3.56it/s]
  6%|▌         | 22228/371472 [1:45:53<26:52:55,  3.61it/s]
  6%|▌         | 22229/371472 [1:45:54<26:04:25,  3.72it/s]
  6%|▌         | 22230/371472 [1:45:54<25:56:23,  3.74it/s]
  6%|▌         | 22231/371472 [1:45:54<25:31:49,  3.80it/s]
  6%|▌         | 22232/371472 [1:45:55<25:53:44,  3.75it/s]
  6%|▌         | 22233/371472 [1:45:55<26:01:40,  3.73it/s]
  6%|▌         | 22234/371472 [1:45:55<26:17:57,  3.69it/s]
  6%|▌         | 22235/371472 [1:45:55<25:41:51,  3.78it/s]
  6%|▌         | 22236/371472 [1:45:56<25:21:16,  3.83it/s]
  6%|▌         | 22237/371472 [1:45:56<28:01:47,  3.46it/s]
  6%|▌         | 22238/371472 [1:45:56<27:50:48,  3.48it/s]
  6%|▌         | 22239/371472 [1:45:56<26:54:12,  3.61it/s]
  6%|▌         | 22240/371472 [1:45:57<26:53:38,  3.61it/s]
                                                           
{'loss': 4.5998, 'learning_rate': 9.465728630222586e-07, 'epoch': 0.96}

  6%|▌         | 22240/371472 [1:45:57<26:53:38,  3.61it/s]
  6%|▌         | 22241/371472 [1:45:57<28:24:26,  3.41it/s]
  6%|▌         | 22242/371472 [1:45:57<29:49:45,  3.25it/s]
  6%|▌         | 22243/371472 [1:45:58<28:31:54,  3.40it/s]
  6%|▌         | 22244/371472 [1:45:58<29:53:33,  3.25it/s]
  6%|▌         | 22245/371472 [1:45:58<30:24:11,  3.19it/s]
  6%|▌         | 22246/371472 [1:45:59<33:32:35,  2.89it/s]
  6%|▌         | 22247/371472 [1:45:59<31:14:50,  3.10it/s]
  6%|▌         | 22248/371472 [1:45:59<33:07:40,  2.93it/s]
  6%|▌         | 22249/371472 [1:46:00<31:17:31,  3.10it/s]
  6%|▌         | 22250/371472 [1:46:00<28:54:06,  3.36it/s]
  6%|▌         | 22251/371472 [1:46:00<30:00:27,  3.23it/s]
  6%|▌         | 22252/371472 [1:46:01<29:17:18,  3.31it/s]
  6%|▌         | 22253/371472 [1:46:01<28:22:12,  3.42it/s]
  6%|▌         | 22254/371472 [1:46:01<30:13:42,  3.21it/s]
  6%|▌         | 22255/371472 [1:46:01<29:37:31,  3.27it/s]
  6%|▌         | 22256/371472 [1:46:02<29:10:15,  3.33it/s]
  6%|▌         | 22257/371472 [1:46:02<27:57:47,  3.47it/s]
  6%|▌         | 22258/371472 [1:46:02<27:49:59,  3.49it/s]
  6%|▌         | 22259/371472 [1:46:03<27:15:25,  3.56it/s]
  6%|▌         | 22260/371472 [1:46:03<28:12:44,  3.44it/s]
                                                           
{'loss': 4.5501, 'learning_rate': 9.465243810467797e-07, 'epoch': 0.96}

  6%|▌         | 22260/371472 [1:46:03<28:12:44,  3.44it/s]
  6%|▌         | 22261/371472 [1:46:03<27:24:39,  3.54it/s]
  6%|▌         | 22262/371472 [1:46:03<26:41:02,  3.64it/s]
  6%|▌         | 22263/371472 [1:46:04<27:58:33,  3.47it/s]
  6%|▌         | 22264/371472 [1:46:04<27:21:22,  3.55it/s]
  6%|▌         | 22265/371472 [1:46:04<26:52:03,  3.61it/s]
  6%|▌         | 22266/371472 [1:46:05<26:13:39,  3.70it/s]
  6%|▌         | 22267/371472 [1:46:05<26:31:16,  3.66it/s]
  6%|▌         | 22268/371472 [1:46:05<26:30:37,  3.66it/s]
  6%|▌         | 22269/371472 [1:46:05<26:21:01,  3.68it/s]
  6%|▌         | 22270/371472 [1:46:06<26:34:38,  3.65it/s]
  6%|▌         | 22271/371472 [1:46:06<26:00:20,  3.73it/s]
  6%|▌         | 22272/371472 [1:46:06<26:07:59,  3.71it/s]
  6%|▌         | 22273/371472 [1:46:06<27:27:02,  3.53it/s]
  6%|▌         | 22274/371472 [1:46:07<29:13:56,  3.32it/s]
  6%|▌         | 22275/371472 [1:46:07<28:42:21,  3.38it/s]
  6%|▌         | 22276/371472 [1:46:07<27:39:36,  3.51it/s]
  6%|▌         | 22277/371472 [1:46:08<26:48:19,  3.62it/s]
  6%|▌         | 22278/371472 [1:46:08<25:50:07,  3.75it/s]
  6%|▌         | 22279/371472 [1:46:08<26:04:13,  3.72it/s]
  6%|▌         | 22280/371472 [1:46:08<28:11:50,  3.44it/s]
                                                           
{'loss': 4.3369, 'learning_rate': 9.464758990713008e-07, 'epoch': 0.96}

  6%|▌         | 22280/371472 [1:46:08<28:11:50,  3.44it/s]
  6%|▌         | 22281/371472 [1:46:09<27:12:46,  3.56it/s]
  6%|▌         | 22282/371472 [1:46:09<28:52:03,  3.36it/s]
  6%|▌         | 22283/371472 [1:46:09<30:09:51,  3.22it/s]
  6%|▌         | 22284/371472 [1:46:10<29:21:13,  3.30it/s]
  6%|▌         | 22285/371472 [1:46:10<29:34:23,  3.28it/s]
  6%|▌         | 22286/371472 [1:46:10<29:28:35,  3.29it/s]
  6%|▌         | 22287/371472 [1:46:11<28:11:56,  3.44it/s]
  6%|▌         | 22288/371472 [1:46:11<27:31:07,  3.52it/s]
  6%|▌         | 22289/371472 [1:46:11<27:07:12,  3.58it/s]
  6%|▌         | 22290/371472 [1:46:11<26:36:54,  3.64it/s]
  6%|▌         | 22291/371472 [1:46:12<26:23:13,  3.68it/s]
  6%|▌         | 22292/371472 [1:46:12<26:38:48,  3.64it/s]
  6%|▌         | 22293/371472 [1:46:12<27:48:59,  3.49it/s]
  6%|▌         | 22294/371472 [1:46:12<26:30:21,  3.66it/s]
  6%|▌         | 22295/371472 [1:46:13<27:33:31,  3.52it/s]
  6%|▌         | 22296/371472 [1:46:13<26:49:17,  3.62it/s]
  6%|▌         | 22297/371472 [1:46:13<28:39:08,  3.39it/s]
  6%|▌         | 22298/371472 [1:46:14<28:05:11,  3.45it/s]
  6%|▌         | 22299/371472 [1:46:14<27:14:03,  3.56it/s]
  6%|▌         | 22300/371472 [1:46:14<26:44:07,  3.63it/s]
                                                           
{'loss': 4.3487, 'learning_rate': 9.464274170958219e-07, 'epoch': 0.96}

  6%|▌         | 22300/371472 [1:46:14<26:44:07,  3.63it/s]
  6%|▌         | 22301/371472 [1:46:15<28:58:03,  3.35it/s]
  6%|▌         | 22302/371472 [1:46:15<28:14:23,  3.43it/s]
  6%|▌         | 22303/371472 [1:46:15<28:21:27,  3.42it/s]
  6%|▌         | 22304/371472 [1:46:15<26:44:12,  3.63it/s]
  6%|▌         | 22305/371472 [1:46:16<26:21:21,  3.68it/s]
  6%|▌         | 22306/371472 [1:46:16<25:52:50,  3.75it/s]
  6%|▌         | 22307/371472 [1:46:16<26:10:02,  3.71it/s]
  6%|▌         | 22308/371472 [1:46:16<26:23:36,  3.67it/s]
  6%|▌         | 22309/371472 [1:46:17<26:11:44,  3.70it/s]
  6%|▌         | 22310/371472 [1:46:17<26:36:11,  3.65it/s]
  6%|▌         | 22311/371472 [1:46:17<28:19:51,  3.42it/s]
  6%|▌         | 22312/371472 [1:46:18<27:20:43,  3.55it/s]
  6%|▌         | 22313/371472 [1:46:18<27:06:51,  3.58it/s]
  6%|▌         | 22314/371472 [1:46:18<27:32:59,  3.52it/s]
  6%|▌         | 22315/371472 [1:46:19<32:25:45,  2.99it/s]
  6%|▌         | 22316/371472 [1:46:19<30:15:00,  3.21it/s]
  6%|▌         | 22317/371472 [1:46:19<29:05:28,  3.33it/s]
  6%|▌         | 22318/371472 [1:46:19<27:43:13,  3.50it/s]
  6%|▌         | 22319/371472 [1:46:20<29:18:05,  3.31it/s]
  6%|▌         | 22320/371472 [1:46:20<27:40:03,  3.51it/s]
                                                           
{'loss': 4.4979, 'learning_rate': 9.463789351203429e-07, 'epoch': 0.96}

  6%|▌         | 22320/371472 [1:46:20<27:40:03,  3.51it/s]
  6%|▌         | 22321/371472 [1:46:20<27:39:26,  3.51it/s]
  6%|▌         | 22322/371472 [1:46:20<27:45:22,  3.49it/s]
  6%|▌         | 22323/371472 [1:46:21<26:53:04,  3.61it/s]
  6%|▌         | 22324/371472 [1:46:21<27:18:27,  3.55it/s]
  6%|▌         | 22325/371472 [1:46:21<28:42:53,  3.38it/s]
  6%|▌         | 22326/371472 [1:46:22<29:54:31,  3.24it/s]
  6%|▌         | 22327/371472 [1:46:22<28:45:20,  3.37it/s]
  6%|▌         | 22328/371472 [1:46:22<30:28:42,  3.18it/s]
  6%|▌         | 22329/371472 [1:46:23<30:35:20,  3.17it/s]
  6%|▌         | 22330/371472 [1:46:23<29:31:45,  3.28it/s]
  6%|▌         | 22331/371472 [1:46:23<28:35:36,  3.39it/s]
  6%|▌         | 22332/371472 [1:46:23<27:47:03,  3.49it/s]
  6%|▌         | 22333/371472 [1:46:24<26:42:11,  3.63it/s]
  6%|▌         | 22334/371472 [1:46:24<26:53:09,  3.61it/s]
  6%|▌         | 22335/371472 [1:46:24<28:43:14,  3.38it/s]
  6%|▌         | 22336/371472 [1:46:25<27:35:08,  3.52it/s]
  6%|▌         | 22337/371472 [1:46:25<26:40:43,  3.64it/s]
  6%|▌         | 22338/371472 [1:46:25<28:36:35,  3.39it/s]
  6%|▌         | 22339/371472 [1:46:25<28:32:40,  3.40it/s]
  6%|▌         | 22340/371472 [1:46:26<27:43:34,  3.50it/s]
                                                           
{'loss': 4.482, 'learning_rate': 9.463304531448641e-07, 'epoch': 0.96}

  6%|▌         | 22340/371472 [1:46:26<27:43:34,  3.50it/s]
  6%|▌         | 22341/371472 [1:46:26<27:18:35,  3.55it/s]
  6%|▌         | 22342/371472 [1:46:26<26:33:36,  3.65it/s]
  6%|▌         | 22343/371472 [1:46:27<26:40:50,  3.63it/s]
  6%|▌         | 22344/371472 [1:46:27<26:29:33,  3.66it/s]
  6%|▌         | 22345/371472 [1:46:27<28:06:00,  3.45it/s]
  6%|▌         | 22346/371472 [1:46:27<28:02:53,  3.46it/s]
  6%|▌         | 22347/371472 [1:46:28<29:22:21,  3.30it/s]
  6%|▌         | 22348/371472 [1:46:28<28:11:42,  3.44it/s]
  6%|▌         | 22349/371472 [1:46:28<28:23:57,  3.41it/s]
  6%|▌         | 22350/371472 [1:46:29<29:10:44,  3.32it/s]
  6%|▌         | 22351/371472 [1:46:29<28:35:39,  3.39it/s]
  6%|▌         | 22352/371472 [1:46:29<27:39:29,  3.51it/s]
  6%|▌         | 22353/371472 [1:46:29<26:36:09,  3.65it/s]
  6%|▌         | 22354/371472 [1:46:30<26:22:42,  3.68it/s]
  6%|▌         | 22355/371472 [1:46:30<28:37:33,  3.39it/s]
  6%|▌         | 22356/371472 [1:46:30<28:47:45,  3.37it/s]
  6%|▌         | 22357/371472 [1:46:31<27:46:19,  3.49it/s]
  6%|▌         | 22358/371472 [1:46:31<27:37:54,  3.51it/s]
  6%|▌         | 22359/371472 [1:46:31<26:57:18,  3.60it/s]
  6%|▌         | 22360/371472 [1:46:31<25:58:52,  3.73it/s]
                                                           
{'loss': 4.5562, 'learning_rate': 9.462819711693852e-07, 'epoch': 0.96}

  6%|▌         | 22360/371472 [1:46:31<25:58:52,  3.73it/s]
  6%|▌         | 22361/371472 [1:46:32<25:52:40,  3.75it/s]
  6%|▌         | 22362/371472 [1:46:32<25:01:56,  3.87it/s]
  6%|▌         | 22363/371472 [1:46:32<26:21:18,  3.68it/s]
  6%|▌         | 22364/371472 [1:46:33<26:52:07,  3.61it/s]
  6%|▌         | 22365/371472 [1:46:33<27:20:26,  3.55it/s]
  6%|▌         | 22366/371472 [1:46:33<26:25:33,  3.67it/s]
  6%|▌         | 22367/371472 [1:46:33<28:17:36,  3.43it/s]
  6%|▌         | 22368/371472 [1:46:34<27:05:51,  3.58it/s]
  6%|▌         | 22369/371472 [1:46:34<26:15:04,  3.69it/s]
  6%|▌         | 22370/371472 [1:46:34<26:29:22,  3.66it/s]
  6%|▌         | 22371/371472 [1:46:34<25:48:23,  3.76it/s]
  6%|▌         | 22372/371472 [1:46:35<25:16:55,  3.84it/s]
  6%|▌         | 22373/371472 [1:46:35<26:27:18,  3.67it/s]
  6%|▌         | 22374/371472 [1:46:35<26:18:32,  3.69it/s]
  6%|▌         | 22375/371472 [1:46:35<26:09:27,  3.71it/s]
  6%|▌         | 22376/371472 [1:46:36<25:44:57,  3.77it/s]
  6%|▌         | 22377/371472 [1:46:36<24:57:13,  3.89it/s]
  6%|▌         | 22378/371472 [1:46:36<26:26:37,  3.67it/s]
  6%|▌         | 22379/371472 [1:46:37<25:57:10,  3.74it/s]
  6%|▌         | 22380/371472 [1:46:37<26:15:03,  3.69it/s]
                                                           
{'loss': 4.6254, 'learning_rate': 9.462334891939064e-07, 'epoch': 0.96}

  6%|▌         | 22380/371472 [1:46:37<26:15:03,  3.69it/s]
  6%|▌         | 22381/371472 [1:46:37<25:50:44,  3.75it/s]
  6%|▌         | 22382/371472 [1:46:37<26:36:45,  3.64it/s]
  6%|▌         | 22383/371472 [1:46:38<26:23:51,  3.67it/s]
  6%|▌         | 22384/371472 [1:46:38<25:58:50,  3.73it/s]
  6%|▌         | 22385/371472 [1:46:38<26:18:25,  3.69it/s]
  6%|▌         | 22386/371472 [1:46:38<26:53:42,  3.61it/s]
  6%|▌         | 22387/371472 [1:46:39<26:04:32,  3.72it/s]
  6%|▌         | 22388/371472 [1:46:39<27:47:07,  3.49it/s]
  6%|▌         | 22389/371472 [1:46:39<30:16:47,  3.20it/s]
  6%|▌         | 22390/371472 [1:46:40<30:07:08,  3.22it/s]
  6%|▌         | 22391/371472 [1:46:40<29:25:42,  3.29it/s]
  6%|▌         | 22392/371472 [1:46:40<28:02:39,  3.46it/s]
  6%|▌         | 22393/371472 [1:46:41<27:17:55,  3.55it/s]
  6%|▌         | 22394/371472 [1:46:41<27:24:49,  3.54it/s]
  6%|▌         | 22395/371472 [1:46:41<28:55:20,  3.35it/s]
  6%|▌         | 22396/371472 [1:46:41<28:01:33,  3.46it/s]
  6%|▌         | 22397/371472 [1:46:42<28:58:42,  3.35it/s]
  6%|▌         | 22398/371472 [1:46:42<29:01:00,  3.34it/s]
  6%|▌         | 22399/371472 [1:46:42<27:49:56,  3.48it/s]
  6%|▌         | 22400/371472 [1:46:43<27:49:55,  3.48it/s]
                                                           
{'loss': 4.442, 'learning_rate': 9.461850072184274e-07, 'epoch': 0.96}

  6%|▌         | 22400/371472 [1:46:43<27:49:55,  3.48it/s]
  6%|▌         | 22401/371472 [1:46:43<27:15:35,  3.56it/s]
  6%|▌         | 22402/371472 [1:46:43<26:54:13,  3.60it/s]
  6%|▌         | 22403/371472 [1:46:43<26:49:20,  3.62it/s]
  6%|▌         | 22404/371472 [1:46:44<28:07:46,  3.45it/s]
  6%|▌         | 22405/371472 [1:46:44<27:24:31,  3.54it/s]
  6%|▌         | 22406/371472 [1:46:44<26:50:10,  3.61it/s]
  6%|▌         | 22407/371472 [1:46:45<26:02:13,  3.72it/s]
  6%|▌         | 22408/371472 [1:46:45<27:14:52,  3.56it/s]
  6%|▌         | 22409/371472 [1:46:45<26:52:23,  3.61it/s]
  6%|▌         | 22410/371472 [1:46:45<26:28:41,  3.66it/s]
  6%|▌         | 22411/371472 [1:46:46<25:55:27,  3.74it/s]
  6%|▌         | 22412/371472 [1:46:46<25:56:28,  3.74it/s]
  6%|▌         | 22413/371472 [1:46:46<26:44:01,  3.63it/s]
  6%|▌         | 22414/371472 [1:46:46<26:48:51,  3.62it/s]
  6%|▌         | 22415/371472 [1:46:47<26:10:56,  3.70it/s]
  6%|▌         | 22416/371472 [1:46:47<29:03:15,  3.34it/s]
  6%|▌         | 22417/371472 [1:46:47<28:21:42,  3.42it/s]
  6%|▌         | 22418/371472 [1:46:48<27:55:06,  3.47it/s]
  6%|▌         | 22419/371472 [1:46:48<27:10:55,  3.57it/s]
  6%|▌         | 22420/371472 [1:46:48<27:59:27,  3.46it/s]
                                                           
{'loss': 4.4808, 'learning_rate': 9.461365252429485e-07, 'epoch': 0.97}

  6%|▌         | 22420/371472 [1:46:48<27:59:27,  3.46it/s]
  6%|▌         | 22421/371472 [1:46:48<27:45:06,  3.49it/s]
  6%|▌         | 22422/371472 [1:46:49<29:23:11,  3.30it/s]
  6%|▌         | 22423/371472 [1:46:49<29:17:41,  3.31it/s]
  6%|▌         | 22424/371472 [1:46:49<28:41:36,  3.38it/s]
  6%|▌         | 22425/371472 [1:46:50<27:57:43,  3.47it/s]
  6%|▌         | 22426/371472 [1:46:50<27:41:05,  3.50it/s]
  6%|▌         | 22427/371472 [1:46:50<28:03:44,  3.46it/s]
  6%|▌         | 22428/371472 [1:46:51<27:43:10,  3.50it/s]
  6%|▌         | 22429/371472 [1:46:51<27:08:47,  3.57it/s]
  6%|▌         | 22430/371472 [1:46:51<26:02:56,  3.72it/s]
  6%|▌         | 22431/371472 [1:46:51<29:34:45,  3.28it/s]
  6%|▌         | 22432/371472 [1:46:52<28:48:21,  3.37it/s]
  6%|▌         | 22433/371472 [1:46:52<29:16:05,  3.31it/s]
  6%|▌         | 22434/371472 [1:46:52<27:36:23,  3.51it/s]
  6%|▌         | 22435/371472 [1:46:53<27:39:57,  3.50it/s]
  6%|▌         | 22436/371472 [1:46:53<27:46:43,  3.49it/s]
  6%|▌         | 22437/371472 [1:46:53<27:08:51,  3.57it/s]
  6%|▌         | 22438/371472 [1:46:53<27:14:32,  3.56it/s]
  6%|▌         | 22439/371472 [1:46:54<26:32:49,  3.65it/s]
  6%|▌         | 22440/371472 [1:46:54<27:20:14,  3.55it/s]
                                                           
{'loss': 4.3537, 'learning_rate': 9.460880432674696e-07, 'epoch': 0.97}

  6%|▌         | 22440/371472 [1:46:54<27:20:14,  3.55it/s]
  6%|▌         | 22441/371472 [1:46:54<27:11:21,  3.57it/s]
  6%|▌         | 22442/371472 [1:46:54<26:45:08,  3.62it/s]
  6%|▌         | 22443/371472 [1:46:55<27:28:05,  3.53it/s]
  6%|▌         | 22444/371472 [1:46:55<27:59:08,  3.46it/s]
  6%|▌         | 22445/371472 [1:46:55<27:59:17,  3.46it/s]
  6%|▌         | 22446/371472 [1:46:56<28:09:39,  3.44it/s]
  6%|▌         | 22447/371472 [1:46:56<28:05:28,  3.45it/s]
  6%|▌         | 22448/371472 [1:46:56<27:27:45,  3.53it/s]
  6%|▌         | 22449/371472 [1:46:57<29:28:22,  3.29it/s]
  6%|▌         | 22450/371472 [1:46:57<27:45:54,  3.49it/s]
  6%|▌         | 22451/371472 [1:46:57<26:43:14,  3.63it/s]
  6%|▌         | 22452/371472 [1:46:57<28:21:16,  3.42it/s]
  6%|▌         | 22453/371472 [1:46:58<28:49:18,  3.36it/s]
  6%|▌         | 22454/371472 [1:46:58<29:52:27,  3.25it/s]
  6%|▌         | 22455/371472 [1:46:58<29:22:59,  3.30it/s]
  6%|▌         | 22456/371472 [1:46:59<28:36:55,  3.39it/s]
  6%|▌         | 22457/371472 [1:46:59<27:03:45,  3.58it/s]
  6%|▌         | 22458/371472 [1:46:59<28:11:54,  3.44it/s]
  6%|▌         | 22459/371472 [1:46:59<27:16:03,  3.56it/s]
  6%|▌         | 22460/371472 [1:47:00<27:37:15,  3.51it/s]
                                                           
{'loss': 4.4404, 'learning_rate': 9.460395612919907e-07, 'epoch': 0.97}

  6%|▌         | 22460/371472 [1:47:00<27:37:15,  3.51it/s]
  6%|▌         | 22461/371472 [1:47:00<28:33:04,  3.40it/s]
  6%|▌         | 22462/371472 [1:47:00<27:29:04,  3.53it/s]
  6%|▌         | 22463/371472 [1:47:01<27:56:47,  3.47it/s]
  6%|▌         | 22464/371472 [1:47:01<27:19:02,  3.55it/s]
  6%|▌         | 22465/371472 [1:47:01<26:37:35,  3.64it/s]
  6%|▌         | 22466/371472 [1:47:01<27:54:49,  3.47it/s]
  6%|▌         | 22467/371472 [1:47:02<27:59:45,  3.46it/s]
  6%|▌         | 22468/371472 [1:47:02<27:08:27,  3.57it/s]
  6%|▌         | 22469/371472 [1:47:02<26:32:55,  3.65it/s]
  6%|▌         | 22470/371472 [1:47:03<31:34:39,  3.07it/s]
  6%|▌         | 22471/371472 [1:47:03<30:42:19,  3.16it/s]
  6%|▌         | 22472/371472 [1:47:03<33:07:13,  2.93it/s]
  6%|▌         | 22473/371472 [1:47:04<30:27:27,  3.18it/s]
  6%|▌         | 22474/371472 [1:47:04<32:02:47,  3.03it/s]
  6%|▌         | 22475/371472 [1:47:04<30:20:15,  3.20it/s]
  6%|▌         | 22476/371472 [1:47:05<29:43:44,  3.26it/s]
  6%|▌         | 22477/371472 [1:47:05<29:26:02,  3.29it/s]
  6%|▌         | 22478/371472 [1:47:05<30:15:28,  3.20it/s]
  6%|▌         | 22479/371472 [1:47:05<28:37:52,  3.39it/s]
  6%|▌         | 22480/371472 [1:47:06<27:37:30,  3.51it/s]
                                                           
{'loss': 4.2819, 'learning_rate': 9.459910793165118e-07, 'epoch': 0.97}

  6%|▌         | 22480/371472 [1:47:06<27:37:30,  3.51it/s]
  6%|▌         | 22481/371472 [1:47:06<27:10:31,  3.57it/s]
  6%|▌         | 22482/371472 [1:47:06<26:30:16,  3.66it/s]
  6%|▌         | 22483/371472 [1:47:07<27:00:10,  3.59it/s]
  6%|▌         | 22484/371472 [1:47:07<26:39:03,  3.64it/s]
  6%|▌         | 22485/371472 [1:47:07<25:36:55,  3.78it/s]
  6%|▌         | 22486/371472 [1:47:07<26:04:11,  3.72it/s]
  6%|▌         | 22487/371472 [1:47:08<25:37:03,  3.78it/s]
  6%|▌         | 22488/371472 [1:47:08<25:22:07,  3.82it/s]
  6%|▌         | 22489/371472 [1:47:08<25:12:28,  3.85it/s]
  6%|▌         | 22490/371472 [1:47:08<27:28:36,  3.53it/s]
  6%|▌         | 22491/371472 [1:47:09<26:09:33,  3.71it/s]
  6%|▌         | 22492/371472 [1:47:09<26:45:15,  3.62it/s]
  6%|▌         | 22493/371472 [1:47:09<27:08:37,  3.57it/s]
  6%|▌         | 22494/371472 [1:47:10<27:06:21,  3.58it/s]
  6%|▌         | 22495/371472 [1:47:10<25:58:56,  3.73it/s]
  6%|▌         | 22496/371472 [1:47:10<28:36:06,  3.39it/s]
  6%|▌         | 22497/371472 [1:47:10<30:04:36,  3.22it/s]
  6%|▌         | 22498/371472 [1:47:11<28:44:28,  3.37it/s]
  6%|▌         | 22499/371472 [1:47:11<30:17:37,  3.20it/s]
  6%|▌         | 22500/371472 [1:47:11<29:07:54,  3.33it/s]
                                                           
{'loss': 4.2377, 'learning_rate': 9.45942597341033e-07, 'epoch': 0.97}

  6%|▌         | 22500/371472 [1:47:11<29:07:54,  3.33it/s]
  6%|▌         | 22501/371472 [1:47:12<28:54:20,  3.35it/s]
  6%|▌         | 22502/371472 [1:47:12<27:45:29,  3.49it/s]
  6%|▌         | 22503/371472 [1:47:12<27:20:06,  3.55it/s]
  6%|▌         | 22504/371472 [1:47:13<29:06:48,  3.33it/s]
  6%|▌         | 22505/371472 [1:47:13<27:51:41,  3.48it/s]
  6%|▌         | 22506/371472 [1:47:13<27:08:57,  3.57it/s]
  6%|▌         | 22507/371472 [1:47:13<26:59:17,  3.59it/s]
  6%|▌         | 22508/371472 [1:47:14<26:46:55,  3.62it/s]
  6%|▌         | 22509/371472 [1:47:14<29:18:18,  3.31it/s]
  6%|▌         | 22510/371472 [1:47:14<28:11:54,  3.44it/s]
  6%|▌         | 22511/371472 [1:47:15<28:03:09,  3.46it/s]
  6%|▌         | 22512/371472 [1:47:15<29:22:35,  3.30it/s]
  6%|▌         | 22513/371472 [1:47:15<27:59:09,  3.46it/s]
  6%|▌         | 22514/371472 [1:47:15<28:21:38,  3.42it/s]
  6%|▌         | 22515/371472 [1:47:16<28:01:39,  3.46it/s]
  6%|▌         | 22516/371472 [1:47:16<27:55:41,  3.47it/s]
  6%|▌         | 22517/371472 [1:47:16<26:58:15,  3.59it/s]
  6%|▌         | 22518/371472 [1:47:16<26:30:08,  3.66it/s]
  6%|▌         | 22519/371472 [1:47:17<25:54:02,  3.74it/s]
  6%|▌         | 22520/371472 [1:47:17<25:42:01,  3.77it/s]
                                                           
{'loss': 4.4839, 'learning_rate': 9.458941153655541e-07, 'epoch': 0.97}

  6%|▌         | 22520/371472 [1:47:17<25:42:01,  3.77it/s]
  6%|▌         | 22521/371472 [1:47:17<25:06:22,  3.86it/s]
  6%|▌         | 22522/371472 [1:47:17<25:04:25,  3.87it/s]
  6%|▌         | 22523/371472 [1:47:18<25:38:48,  3.78it/s]
  6%|▌         | 22524/371472 [1:47:18<27:37:18,  3.51it/s]
  6%|▌         | 22525/371472 [1:47:18<27:39:31,  3.50it/s]
  6%|▌         | 22526/371472 [1:47:19<29:17:52,  3.31it/s]
  6%|▌         | 22527/371472 [1:47:19<30:27:54,  3.18it/s]
  6%|▌         | 22528/371472 [1:47:19<28:56:26,  3.35it/s]
  6%|▌         | 22529/371472 [1:47:20<28:40:08,  3.38it/s]
  6%|▌         | 22530/371472 [1:47:20<29:55:52,  3.24it/s]
  6%|▌         | 22531/371472 [1:47:20<33:04:52,  2.93it/s]
  6%|▌         | 22532/371472 [1:47:21<32:27:08,  2.99it/s]
  6%|▌         | 22533/371472 [1:47:21<30:09:46,  3.21it/s]
  6%|▌         | 22534/371472 [1:47:21<29:52:08,  3.25it/s]
  6%|▌         | 22535/371472 [1:47:22<31:06:16,  3.12it/s]
  6%|▌         | 22536/371472 [1:47:22<29:36:26,  3.27it/s]
  6%|▌         | 22537/371472 [1:47:22<29:03:02,  3.34it/s]
  6%|▌         | 22538/371472 [1:47:22<29:12:09,  3.32it/s]
  6%|▌         | 22539/371472 [1:47:23<29:36:21,  3.27it/s]
  6%|▌         | 22540/371472 [1:47:23<28:09:09,  3.44it/s]
                                                           
{'loss': 4.4019, 'learning_rate': 9.458456333900751e-07, 'epoch': 0.97}

  6%|▌         | 22540/371472 [1:47:23<28:09:09,  3.44it/s]
  6%|▌         | 22541/371472 [1:47:23<27:42:01,  3.50it/s]
  6%|▌         | 22542/371472 [1:47:24<27:23:27,  3.54it/s]
  6%|▌         | 22543/371472 [1:47:24<27:13:30,  3.56it/s]
  6%|▌         | 22544/371472 [1:47:24<28:48:38,  3.36it/s]
  6%|▌         | 22545/371472 [1:47:24<28:00:13,  3.46it/s]
  6%|▌         | 22546/371472 [1:47:25<27:16:32,  3.55it/s]
  6%|▌         | 22547/371472 [1:47:25<26:28:52,  3.66it/s]
  6%|▌         | 22548/371472 [1:47:25<25:58:45,  3.73it/s]
  6%|▌         | 22549/371472 [1:47:26<27:00:59,  3.59it/s]
  6%|▌         | 22550/371472 [1:47:26<26:00:27,  3.73it/s]
  6%|▌         | 22551/371472 [1:47:26<25:25:08,  3.81it/s]
  6%|▌         | 22552/371472 [1:47:26<25:38:25,  3.78it/s]
  6%|▌         | 22553/371472 [1:47:27<25:26:11,  3.81it/s]
  6%|▌         | 22554/371472 [1:47:27<25:17:00,  3.83it/s]
  6%|▌         | 22555/371472 [1:47:27<25:02:20,  3.87it/s]
  6%|▌         | 22556/371472 [1:47:27<24:53:33,  3.89it/s]
  6%|▌         | 22557/371472 [1:47:28<25:36:41,  3.78it/s]
  6%|▌         | 22558/371472 [1:47:28<27:51:09,  3.48it/s]
  6%|▌         | 22559/371472 [1:47:28<27:10:58,  3.57it/s]
  6%|▌         | 22560/371472 [1:47:29<30:15:14,  3.20it/s]
                                                           
{'loss': 4.5467, 'learning_rate': 9.457971514145962e-07, 'epoch': 0.97}

  6%|▌         | 22560/371472 [1:47:29<30:15:14,  3.20it/s]
  6%|▌         | 22561/371472 [1:47:29<29:48:17,  3.25it/s]
  6%|▌         | 22562/371472 [1:47:29<30:58:51,  3.13it/s]
  6%|▌         | 22563/371472 [1:47:30<33:00:55,  2.94it/s]
  6%|▌         | 22564/371472 [1:47:30<31:11:31,  3.11it/s]
  6%|▌         | 22565/371472 [1:47:30<28:40:29,  3.38it/s]
  6%|▌         | 22566/371472 [1:47:30<27:19:28,  3.55it/s]
  6%|▌         | 22567/371472 [1:47:31<27:17:45,  3.55it/s]
  6%|▌         | 22568/371472 [1:47:31<27:38:57,  3.51it/s]
  6%|▌         | 22569/371472 [1:47:31<27:14:21,  3.56it/s]
  6%|▌         | 22570/371472 [1:47:32<27:15:03,  3.56it/s]
  6%|▌         | 22571/371472 [1:47:32<27:02:52,  3.58it/s]
  6%|▌         | 22572/371472 [1:47:32<27:18:46,  3.55it/s]
  6%|▌         | 22573/371472 [1:47:32<26:46:41,  3.62it/s]
  6%|▌         | 22574/371472 [1:47:33<27:50:15,  3.48it/s]
  6%|▌         | 22575/371472 [1:47:33<26:59:38,  3.59it/s]
  6%|▌         | 22576/371472 [1:47:33<28:24:34,  3.41it/s]
  6%|▌         | 22577/371472 [1:47:34<28:12:31,  3.44it/s]
  6%|▌         | 22578/371472 [1:47:34<28:14:58,  3.43it/s]
  6%|▌         | 22579/371472 [1:47:34<28:10:55,  3.44it/s]
  6%|▌         | 22580/371472 [1:47:34<27:47:47,  3.49it/s]
                                                           
{'loss': 4.3238, 'learning_rate': 9.457486694391174e-07, 'epoch': 0.97}

  6%|▌         | 22580/371472 [1:47:34<27:47:47,  3.49it/s]
  6%|▌         | 22581/371472 [1:47:35<27:50:14,  3.48it/s]
  6%|▌         | 22582/371472 [1:47:35<26:26:56,  3.66it/s]
  6%|▌         | 22583/371472 [1:47:35<26:05:36,  3.71it/s]
  6%|▌         | 22584/371472 [1:47:36<27:27:54,  3.53it/s]
  6%|▌         | 22585/371472 [1:47:36<26:53:29,  3.60it/s]
  6%|▌         | 22586/371472 [1:47:36<26:59:17,  3.59it/s]
  6%|▌         | 22587/371472 [1:47:36<27:24:58,  3.53it/s]
  6%|▌         | 22588/371472 [1:47:37<26:43:02,  3.63it/s]
  6%|▌         | 22589/371472 [1:47:37<26:17:15,  3.69it/s]
  6%|▌         | 22590/371472 [1:47:37<26:01:55,  3.72it/s]
  6%|▌         | 22591/371472 [1:47:37<26:00:00,  3.73it/s]
  6%|▌         | 22592/371472 [1:47:38<26:07:16,  3.71it/s]
  6%|▌         | 22593/371472 [1:47:38<26:45:37,  3.62it/s]
  6%|▌         | 22594/371472 [1:47:38<26:31:48,  3.65it/s]
  6%|▌         | 22595/371472 [1:47:38<26:04:04,  3.72it/s]
  6%|▌         | 22596/371472 [1:47:39<25:52:29,  3.75it/s]
  6%|▌         | 22597/371472 [1:47:39<27:17:49,  3.55it/s]
  6%|▌         | 22598/371472 [1:47:39<26:57:25,  3.59it/s]
  6%|▌         | 22599/371472 [1:47:40<27:06:03,  3.58it/s]
  6%|▌         | 22600/371472 [1:47:40<27:26:17,  3.53it/s]
                                                           
{'loss': 4.4663, 'learning_rate': 9.457001874636385e-07, 'epoch': 0.97}

  6%|▌         | 22600/371472 [1:47:40<27:26:17,  3.53it/s]
  6%|▌         | 22601/371472 [1:47:40<27:22:03,  3.54it/s]
  6%|▌         | 22602/371472 [1:47:40<26:11:22,  3.70it/s]
  6%|▌         | 22603/371472 [1:47:41<26:32:07,  3.65it/s]
  6%|▌         | 22604/371472 [1:47:41<26:24:43,  3.67it/s]
  6%|▌         | 22605/371472 [1:47:41<26:13:22,  3.70it/s]
  6%|▌         | 22606/371472 [1:47:42<27:45:21,  3.49it/s]
  6%|▌         | 22607/371472 [1:47:42<28:20:29,  3.42it/s]
  6%|▌         | 22608/371472 [1:47:42<28:21:36,  3.42it/s]
  6%|▌         | 22609/371472 [1:47:42<28:06:41,  3.45it/s]
  6%|▌         | 22610/371472 [1:47:43<26:53:56,  3.60it/s]
  6%|▌         | 22611/371472 [1:47:43<26:18:59,  3.68it/s]
  6%|▌         | 22612/371472 [1:47:43<27:07:45,  3.57it/s]
  6%|▌         | 22613/371472 [1:47:44<27:47:11,  3.49it/s]
  6%|▌         | 22614/371472 [1:47:44<26:40:52,  3.63it/s]
  6%|▌         | 22615/371472 [1:47:44<26:40:37,  3.63it/s]
  6%|▌         | 22616/371472 [1:47:44<26:12:43,  3.70it/s]
  6%|▌         | 22617/371472 [1:47:45<26:39:14,  3.64it/s]
  6%|▌         | 22618/371472 [1:47:45<26:01:55,  3.72it/s]
  6%|▌         | 22619/371472 [1:47:45<25:42:24,  3.77it/s]
  6%|▌         | 22620/371472 [1:47:45<25:56:19,  3.74it/s]
                                                           
{'loss': 4.4383, 'learning_rate': 9.456517054881596e-07, 'epoch': 0.97}

  6%|▌         | 22620/371472 [1:47:45<25:56:19,  3.74it/s]
  6%|▌         | 22621/371472 [1:47:46<25:41:29,  3.77it/s]
  6%|▌         | 22622/371472 [1:47:46<28:13:44,  3.43it/s]
  6%|▌         | 22623/371472 [1:47:46<28:07:25,  3.45it/s]
  6%|▌         | 22624/371472 [1:47:47<27:24:44,  3.53it/s]
  6%|▌         | 22625/371472 [1:47:47<26:31:28,  3.65it/s]
  6%|▌         | 22626/371472 [1:47:47<27:00:56,  3.59it/s]
  6%|▌         | 22627/371472 [1:47:47<26:39:57,  3.63it/s]
  6%|▌         | 22628/371472 [1:47:48<26:12:47,  3.70it/s]
  6%|▌         | 22629/371472 [1:47:48<26:03:31,  3.72it/s]
  6%|▌         | 22630/371472 [1:47:48<26:46:18,  3.62it/s]
  6%|▌         | 22631/371472 [1:47:48<26:33:55,  3.65it/s]
  6%|▌         | 22632/371472 [1:47:49<26:45:00,  3.62it/s]
  6%|▌         | 22633/371472 [1:47:49<26:07:58,  3.71it/s]
  6%|▌         | 22634/371472 [1:47:49<26:38:33,  3.64it/s]
  6%|▌         | 22635/371472 [1:47:50<25:56:50,  3.73it/s]
  6%|▌         | 22636/371472 [1:47:50<26:21:58,  3.68it/s]
  6%|▌         | 22637/371472 [1:47:50<25:57:42,  3.73it/s]
  6%|▌         | 22638/371472 [1:47:50<25:24:00,  3.81it/s]
  6%|▌         | 22639/371472 [1:47:51<26:36:56,  3.64it/s]
  6%|▌         | 22640/371472 [1:47:51<26:32:48,  3.65it/s]
                                                           
{'loss': 4.5796, 'learning_rate': 9.456032235126807e-07, 'epoch': 0.98}

  6%|▌         | 22640/371472 [1:47:51<26:32:48,  3.65it/s]
  6%|▌         | 22641/371472 [1:47:51<29:56:42,  3.24it/s]
  6%|▌         | 22642/371472 [1:47:52<32:02:08,  3.02it/s]
  6%|▌         | 22643/371472 [1:47:52<30:48:28,  3.15it/s]
  6%|▌         | 22644/371472 [1:47:52<29:09:30,  3.32it/s]
  6%|▌         | 22645/371472 [1:47:53<28:47:53,  3.36it/s]
  6%|▌         | 22646/371472 [1:47:53<28:20:30,  3.42it/s]
  6%|▌         | 22647/371472 [1:47:53<27:44:20,  3.49it/s]
  6%|▌         | 22648/371472 [1:47:53<27:13:17,  3.56it/s]
  6%|▌         | 22649/371472 [1:47:54<26:59:22,  3.59it/s]
  6%|▌         | 22650/371472 [1:47:54<27:00:44,  3.59it/s]
  6%|▌         | 22651/371472 [1:47:54<26:45:34,  3.62it/s]
  6%|▌         | 22652/371472 [1:47:54<27:40:53,  3.50it/s]
  6%|▌         | 22653/371472 [1:47:55<28:39:23,  3.38it/s]
  6%|▌         | 22654/371472 [1:47:55<27:07:17,  3.57it/s]
  6%|▌         | 22655/371472 [1:47:55<27:01:00,  3.59it/s]
  6%|▌         | 22656/371472 [1:47:56<26:14:13,  3.69it/s]
  6%|▌         | 22657/371472 [1:47:56<28:45:32,  3.37it/s]
  6%|▌         | 22658/371472 [1:47:56<26:57:05,  3.60it/s]
  6%|▌         | 22659/371472 [1:47:56<26:20:11,  3.68it/s]
  6%|▌         | 22660/371472 [1:47:57<26:17:38,  3.68it/s]
                                                           
{'loss': 4.4543, 'learning_rate': 9.455547415372018e-07, 'epoch': 0.98}

  6%|▌         | 22660/371472 [1:47:57<26:17:38,  3.68it/s]
  6%|▌         | 22661/371472 [1:47:57<25:51:02,  3.75it/s]
  6%|▌         | 22662/371472 [1:47:57<27:01:15,  3.59it/s]
  6%|▌         | 22663/371472 [1:47:57<26:11:58,  3.70it/s]
  6%|▌         | 22664/371472 [1:47:58<26:50:45,  3.61it/s]
  6%|▌         | 22665/371472 [1:47:58<27:23:17,  3.54it/s]
  6%|▌         | 22666/371472 [1:47:58<27:09:14,  3.57it/s]
  6%|▌         | 22667/371472 [1:47:59<27:10:28,  3.57it/s]
  6%|▌         | 22668/371472 [1:47:59<26:44:39,  3.62it/s]
  6%|▌         | 22669/371472 [1:47:59<28:59:17,  3.34it/s]
  6%|▌         | 22670/371472 [1:48:00<27:41:47,  3.50it/s]
  6%|▌         | 22671/371472 [1:48:00<29:48:11,  3.25it/s]
  6%|▌         | 22672/371472 [1:48:00<29:32:29,  3.28it/s]
  6%|▌         | 22673/371472 [1:48:00<29:24:05,  3.30it/s]
  6%|▌         | 22674/371472 [1:48:01<28:15:52,  3.43it/s]
  6%|▌         | 22675/371472 [1:48:01<30:17:42,  3.20it/s]
  6%|▌         | 22676/371472 [1:48:01<28:31:12,  3.40it/s]
  6%|▌         | 22677/371472 [1:48:02<27:32:06,  3.52it/s]
  6%|▌         | 22678/371472 [1:48:02<28:03:05,  3.45it/s]
  6%|▌         | 22679/371472 [1:48:02<28:09:36,  3.44it/s]
  6%|▌         | 22680/371472 [1:48:03<29:02:46,  3.34it/s]
                                                           
{'loss': 4.3599, 'learning_rate': 9.455062595617229e-07, 'epoch': 0.98}

  6%|▌         | 22680/371472 [1:48:03<29:02:46,  3.34it/s]
  6%|▌         | 22681/371472 [1:48:03<28:01:28,  3.46it/s]
  6%|▌         | 22682/371472 [1:48:03<28:36:38,  3.39it/s]
  6%|▌         | 22683/371472 [1:48:03<27:47:16,  3.49it/s]
  6%|▌         | 22684/371472 [1:48:04<27:40:19,  3.50it/s]
  6%|▌         | 22685/371472 [1:48:04<26:52:56,  3.60it/s]
  6%|▌         | 22686/371472 [1:48:04<27:07:03,  3.57it/s]
  6%|▌         | 22687/371472 [1:48:05<28:57:13,  3.35it/s]
  6%|▌         | 22688/371472 [1:48:05<28:31:36,  3.40it/s]
  6%|▌         | 22689/371472 [1:48:05<27:22:07,  3.54it/s]
  6%|▌         | 22690/371472 [1:48:05<27:50:25,  3.48it/s]
  6%|▌         | 22691/371472 [1:48:06<27:15:29,  3.55it/s]
  6%|▌         | 22692/371472 [1:48:06<29:52:04,  3.24it/s]
  6%|▌         | 22693/371472 [1:48:06<28:34:02,  3.39it/s]
  6%|▌         | 22694/371472 [1:48:07<28:25:53,  3.41it/s]
  6%|▌         | 22695/371472 [1:48:07<27:03:58,  3.58it/s]
  6%|▌         | 22696/371472 [1:48:07<27:41:27,  3.50it/s]
  6%|▌         | 22697/371472 [1:48:07<27:37:13,  3.51it/s]
  6%|▌         | 22698/371472 [1:48:08<27:15:14,  3.55it/s]
  6%|▌         | 22699/371472 [1:48:08<29:47:35,  3.25it/s]
  6%|▌         | 22700/371472 [1:48:08<29:11:44,  3.32it/s]
                                                           
{'loss': 4.5134, 'learning_rate': 9.45457777586244e-07, 'epoch': 0.98}

  6%|▌         | 22700/371472 [1:48:08<29:11:44,  3.32it/s]
  6%|▌         | 22701/371472 [1:48:09<29:42:35,  3.26it/s]
  6%|▌         | 22702/371472 [1:48:09<28:25:40,  3.41it/s]
  6%|▌         | 22703/371472 [1:48:09<27:26:19,  3.53it/s]
  6%|▌         | 22704/371472 [1:48:09<26:46:34,  3.62it/s]
  6%|▌         | 22705/371472 [1:48:10<26:46:51,  3.62it/s]
  6%|▌         | 22706/371472 [1:48:10<26:42:31,  3.63it/s]
  6%|▌         | 22707/371472 [1:48:10<26:21:27,  3.68it/s]
  6%|▌         | 22708/371472 [1:48:11<27:00:24,  3.59it/s]
  6%|▌         | 22709/371472 [1:48:11<26:44:03,  3.62it/s]
  6%|▌         | 22710/371472 [1:48:11<26:35:28,  3.64it/s]
  6%|▌         | 22711/371472 [1:48:11<28:17:02,  3.43it/s]
  6%|▌         | 22712/371472 [1:48:12<27:24:58,  3.53it/s]
  6%|▌         | 22713/371472 [1:48:12<26:59:15,  3.59it/s]
  6%|▌         | 22714/371472 [1:48:12<27:55:17,  3.47it/s]
  6%|▌         | 22715/371472 [1:48:13<27:33:16,  3.52it/s]
  6%|▌         | 22716/371472 [1:48:13<26:34:03,  3.65it/s]
  6%|▌         | 22717/371472 [1:48:13<27:36:25,  3.51it/s]
  6%|▌         | 22718/371472 [1:48:13<27:06:27,  3.57it/s]
  6%|▌         | 22719/371472 [1:48:14<26:14:46,  3.69it/s]
  6%|▌         | 22720/371472 [1:48:14<26:15:22,  3.69it/s]
                                                           
{'loss': 4.5121, 'learning_rate': 9.454092956107651e-07, 'epoch': 0.98}

  6%|▌         | 22720/371472 [1:48:14<26:15:22,  3.69it/s]
  6%|▌         | 22721/371472 [1:48:14<27:34:24,  3.51it/s]
  6%|▌         | 22722/371472 [1:48:14<26:47:39,  3.62it/s]
  6%|▌         | 22723/371472 [1:48:15<29:29:09,  3.29it/s]
  6%|▌         | 22724/371472 [1:48:15<28:57:10,  3.35it/s]
  6%|▌         | 22725/371472 [1:48:15<28:08:01,  3.44it/s]
  6%|▌         | 22726/371472 [1:48:16<28:25:55,  3.41it/s]
  6%|▌         | 22727/371472 [1:48:16<28:07:48,  3.44it/s]
  6%|▌         | 22728/371472 [1:48:16<28:07:03,  3.45it/s]
  6%|▌         | 22729/371472 [1:48:17<28:39:09,  3.38it/s]
  6%|▌         | 22730/371472 [1:48:17<27:23:22,  3.54it/s]
  6%|▌         | 22731/371472 [1:48:17<26:31:31,  3.65it/s]
  6%|▌         | 22732/371472 [1:48:17<27:32:04,  3.52it/s]
  6%|▌         | 22733/371472 [1:48:18<26:46:12,  3.62it/s]
  6%|▌         | 22734/371472 [1:48:18<27:44:01,  3.49it/s]
  6%|▌         | 22735/371472 [1:48:18<27:06:19,  3.57it/s]
  6%|▌         | 22736/371472 [1:48:19<27:47:27,  3.49it/s]
  6%|▌         | 22737/371472 [1:48:19<29:52:07,  3.24it/s]
  6%|▌         | 22738/371472 [1:48:19<28:26:22,  3.41it/s]
  6%|▌         | 22739/371472 [1:48:19<30:07:31,  3.22it/s]
  6%|▌         | 22740/371472 [1:48:20<28:13:10,  3.43it/s]
                                                           
{'loss': 4.6245, 'learning_rate': 9.453608136352863e-07, 'epoch': 0.98}

  6%|▌         | 22740/371472 [1:48:20<28:13:10,  3.43it/s]
  6%|▌         | 22741/371472 [1:48:20<29:16:18,  3.31it/s]
  6%|▌         | 22742/371472 [1:48:20<27:55:02,  3.47it/s]
  6%|▌         | 22743/371472 [1:48:21<28:41:39,  3.38it/s]
  6%|▌         | 22744/371472 [1:48:21<28:44:41,  3.37it/s]
  6%|▌         | 22745/371472 [1:48:21<27:14:47,  3.56it/s]
  6%|▌         | 22746/371472 [1:48:21<27:30:18,  3.52it/s]
  6%|▌         | 22747/371472 [1:48:22<30:00:01,  3.23it/s]
  6%|▌         | 22748/371472 [1:48:22<28:23:07,  3.41it/s]
  6%|▌         | 22749/371472 [1:48:22<28:04:14,  3.45it/s]
  6%|▌         | 22750/371472 [1:48:23<28:05:33,  3.45it/s]
  6%|▌         | 22751/371472 [1:48:23<29:43:59,  3.26it/s]
  6%|▌         | 22752/371472 [1:48:23<29:44:19,  3.26it/s]
  6%|▌         | 22753/371472 [1:48:24<29:10:19,  3.32it/s]
  6%|▌         | 22754/371472 [1:48:24<27:29:22,  3.52it/s]
  6%|▌         | 22755/371472 [1:48:24<26:45:40,  3.62it/s]
  6%|▌         | 22756/371472 [1:48:24<26:25:42,  3.67it/s]
  6%|▌         | 22757/371472 [1:48:25<26:25:14,  3.67it/s]
  6%|▌         | 22758/371472 [1:48:25<26:56:41,  3.59it/s]
  6%|▌         | 22759/371472 [1:48:25<27:01:52,  3.58it/s]
  6%|▌         | 22760/371472 [1:48:25<27:16:25,  3.55it/s]
                                                           
{'loss': 4.4596, 'learning_rate': 9.453123316598073e-07, 'epoch': 0.98}

  6%|▌         | 22760/371472 [1:48:25<27:16:25,  3.55it/s]
  6%|▌         | 22761/371472 [1:48:26<27:23:15,  3.54it/s]
  6%|▌         | 22762/371472 [1:48:26<27:49:03,  3.48it/s]
  6%|▌         | 22763/371472 [1:48:26<27:54:07,  3.47it/s]
  6%|▌         | 22764/371472 [1:48:27<28:08:34,  3.44it/s]
  6%|▌         | 22765/371472 [1:48:27<28:34:35,  3.39it/s]
  6%|▌         | 22766/371472 [1:48:27<28:01:04,  3.46it/s]
  6%|▌         | 22767/371472 [1:48:28<27:43:09,  3.49it/s]
  6%|▌         | 22768/371472 [1:48:28<29:23:33,  3.30it/s]
  6%|▌         | 22769/371472 [1:48:28<28:22:22,  3.41it/s]
  6%|▌         | 22770/371472 [1:48:28<29:23:41,  3.30it/s]
  6%|▌         | 22771/371472 [1:48:29<28:37:30,  3.38it/s]
  6%|▌         | 22772/371472 [1:48:29<27:41:57,  3.50it/s]
  6%|▌         | 22773/371472 [1:48:29<28:03:09,  3.45it/s]
  6%|▌         | 22774/371472 [1:48:30<27:32:20,  3.52it/s]
  6%|▌         | 22775/371472 [1:48:30<26:49:06,  3.61it/s]
  6%|▌         | 22776/371472 [1:48:30<30:15:15,  3.20it/s]
  6%|▌         | 22777/371472 [1:48:31<30:55:05,  3.13it/s]
  6%|▌         | 22778/371472 [1:48:31<29:54:41,  3.24it/s]
  6%|▌         | 22779/371472 [1:48:31<28:18:14,  3.42it/s]
  6%|▌         | 22780/371472 [1:48:31<27:59:23,  3.46it/s]
                                                           
{'loss': 4.7281, 'learning_rate': 9.452638496843284e-07, 'epoch': 0.98}

  6%|▌         | 22780/371472 [1:48:31<27:59:23,  3.46it/s]
  6%|▌         | 22781/371472 [1:48:32<27:50:12,  3.48it/s]
  6%|▌         | 22782/371472 [1:48:32<27:21:20,  3.54it/s]
  6%|▌         | 22783/371472 [1:48:32<27:01:41,  3.58it/s]
  6%|▌         | 22784/371472 [1:48:33<27:52:35,  3.47it/s]
  6%|▌         | 22785/371472 [1:48:33<27:17:21,  3.55it/s]
  6%|▌         | 22786/371472 [1:48:33<28:41:17,  3.38it/s]
  6%|▌         | 22787/371472 [1:48:33<27:58:11,  3.46it/s]
  6%|▌         | 22788/371472 [1:48:34<29:22:55,  3.30it/s]
  6%|▌         | 22789/371472 [1:48:34<29:16:16,  3.31it/s]
  6%|▌         | 22790/371472 [1:48:35<39:09:17,  2.47it/s]
  6%|▌         | 22791/371472 [1:48:35<34:59:02,  2.77it/s]
  6%|▌         | 22792/371472 [1:48:35<33:07:07,  2.92it/s]
  6%|▌         | 22793/371472 [1:48:36<31:23:24,  3.09it/s]
  6%|▌         | 22794/371472 [1:48:36<29:01:55,  3.34it/s]
  6%|▌         | 22795/371472 [1:48:36<27:21:40,  3.54it/s]
  6%|▌         | 22796/371472 [1:48:36<27:07:27,  3.57it/s]
  6%|▌         | 22797/371472 [1:48:37<27:04:09,  3.58it/s]
  6%|▌         | 22798/371472 [1:48:37<27:01:16,  3.58it/s]
  6%|▌         | 22799/371472 [1:48:37<27:10:16,  3.56it/s]
  6%|▌         | 22800/371472 [1:48:37<28:22:55,  3.41it/s]
                                                           
{'loss': 4.4649, 'learning_rate': 9.452153677088495e-07, 'epoch': 0.98}

  6%|▌         | 22800/371472 [1:48:37<28:22:55,  3.41it/s]
  6%|▌         | 22801/371472 [1:48:38<28:32:17,  3.39it/s]
  6%|▌         | 22802/371472 [1:48:38<27:28:36,  3.52it/s]
  6%|▌         | 22803/371472 [1:48:38<27:59:12,  3.46it/s]
  6%|▌         | 22804/371472 [1:48:39<26:50:13,  3.61it/s]
  6%|▌         | 22805/371472 [1:48:39<26:13:36,  3.69it/s]
  6%|▌         | 22806/371472 [1:48:39<27:00:24,  3.59it/s]
  6%|▌         | 22807/371472 [1:48:39<26:23:55,  3.67it/s]
  6%|▌         | 22808/371472 [1:48:40<26:22:41,  3.67it/s]
  6%|▌         | 22809/371472 [1:48:40<28:37:18,  3.38it/s]
  6%|▌         | 22810/371472 [1:48:40<29:57:30,  3.23it/s]
  6%|▌         | 22811/371472 [1:48:41<30:07:18,  3.22it/s]
  6%|▌         | 22812/371472 [1:48:41<28:13:12,  3.43it/s]
  6%|▌         | 22813/371472 [1:48:41<28:29:56,  3.40it/s]
  6%|▌         | 22814/371472 [1:48:41<27:40:15,  3.50it/s]
  6%|▌         | 22815/371472 [1:48:42<26:38:10,  3.64it/s]
  6%|▌         | 22816/371472 [1:48:42<27:42:10,  3.50it/s]
  6%|▌         | 22817/371472 [1:48:42<27:04:24,  3.58it/s]
  6%|▌         | 22818/371472 [1:48:43<27:44:16,  3.49it/s]
  6%|▌         | 22819/371472 [1:48:43<27:00:39,  3.59it/s]
  6%|▌         | 22820/371472 [1:48:43<28:44:02,  3.37it/s]
                                                           
{'loss': 4.5645, 'learning_rate': 9.451668857333707e-07, 'epoch': 0.98}

  6%|▌         | 22820/371472 [1:48:43<28:44:02,  3.37it/s]
  6%|▌         | 22821/371472 [1:48:43<27:48:44,  3.48it/s]
  6%|▌         | 22822/371472 [1:48:44<26:57:33,  3.59it/s]
  6%|▌         | 22823/371472 [1:48:44<27:22:19,  3.54it/s]
  6%|▌         | 22824/371472 [1:48:44<26:57:17,  3.59it/s]
  6%|▌         | 22825/371472 [1:48:45<27:19:35,  3.54it/s]
  6%|▌         | 22826/371472 [1:48:45<26:19:27,  3.68it/s]
  6%|▌         | 22827/371472 [1:48:45<27:01:12,  3.58it/s]
  6%|▌         | 22828/371472 [1:48:45<27:56:53,  3.47it/s]
  6%|▌         | 22829/371472 [1:48:46<28:11:59,  3.43it/s]
  6%|▌         | 22830/371472 [1:48:46<26:45:36,  3.62it/s]
  6%|▌         | 22831/371472 [1:48:46<26:38:31,  3.64it/s]
  6%|▌         | 22832/371472 [1:48:47<27:46:36,  3.49it/s]
  6%|▌         | 22833/371472 [1:48:47<28:37:33,  3.38it/s]
  6%|▌         | 22834/371472 [1:48:47<27:47:11,  3.49it/s]
  6%|▌         | 22835/371472 [1:48:47<28:31:28,  3.40it/s]
  6%|▌         | 22836/371472 [1:48:48<28:06:39,  3.45it/s]
  6%|▌         | 22837/371472 [1:48:48<27:06:56,  3.57it/s]
  6%|▌         | 22838/371472 [1:48:48<28:09:32,  3.44it/s]
  6%|▌         | 22839/371472 [1:48:49<27:15:21,  3.55it/s]
  6%|▌         | 22840/371472 [1:48:49<27:19:27,  3.54it/s]
                                                           
{'loss': 4.5543, 'learning_rate': 9.451184037578917e-07, 'epoch': 0.98}

  6%|▌         | 22840/371472 [1:48:49<27:19:27,  3.54it/s]
  6%|▌         | 22841/371472 [1:48:49<29:15:22,  3.31it/s]
  6%|▌         | 22842/371472 [1:48:49<30:09:29,  3.21it/s]
  6%|▌         | 22843/371472 [1:48:50<29:12:04,  3.32it/s]
  6%|▌         | 22844/371472 [1:48:50<28:56:19,  3.35it/s]
  6%|▌         | 22845/371472 [1:48:50<27:56:28,  3.47it/s]
  6%|▌         | 22846/371472 [1:48:51<26:49:49,  3.61it/s]
  6%|▌         | 22847/371472 [1:48:51<26:31:15,  3.65it/s]
  6%|▌         | 22848/371472 [1:48:51<26:58:02,  3.59it/s]
  6%|▌         | 22849/371472 [1:48:51<26:26:04,  3.66it/s]
  6%|▌         | 22850/371472 [1:48:52<25:56:59,  3.73it/s]
  6%|▌         | 22851/371472 [1:48:52<25:54:21,  3.74it/s]
  6%|▌         | 22852/371472 [1:48:52<26:01:59,  3.72it/s]
  6%|▌         | 22853/371472 [1:48:53<28:37:54,  3.38it/s]
  6%|▌         | 22854/371472 [1:48:53<28:04:43,  3.45it/s]
  6%|▌         | 22855/371472 [1:48:53<28:26:05,  3.41it/s]
  6%|▌         | 22856/371472 [1:48:53<27:29:44,  3.52it/s]
  6%|▌         | 22857/371472 [1:48:54<26:59:53,  3.59it/s]
  6%|▌         | 22858/371472 [1:48:54<26:32:13,  3.65it/s]
  6%|▌         | 22859/371472 [1:48:54<26:28:00,  3.66it/s]
  6%|▌         | 22860/371472 [1:48:54<26:21:29,  3.67it/s]
                                                           
{'loss': 4.7059, 'learning_rate': 9.450699217824128e-07, 'epoch': 0.98}

  6%|▌         | 22860/371472 [1:48:54<26:21:29,  3.67it/s]
  6%|▌         | 22861/371472 [1:48:55<26:15:59,  3.69it/s]
  6%|▌         | 22862/371472 [1:48:55<26:07:50,  3.71it/s]
  6%|▌         | 22863/371472 [1:48:55<26:39:12,  3.63it/s]
  6%|▌         | 22864/371472 [1:48:56<28:06:30,  3.45it/s]
  6%|▌         | 22865/371472 [1:48:56<27:12:10,  3.56it/s]
  6%|▌         | 22866/371472 [1:48:56<26:43:40,  3.62it/s]
  6%|▌         | 22867/371472 [1:48:56<26:18:50,  3.68it/s]
  6%|▌         | 22868/371472 [1:48:57<26:32:54,  3.65it/s]
  6%|▌         | 22869/371472 [1:48:57<26:25:21,  3.66it/s]
  6%|▌         | 22870/371472 [1:48:57<26:47:58,  3.61it/s]
  6%|▌         | 22871/371472 [1:48:58<27:05:44,  3.57it/s]
  6%|▌         | 22872/371472 [1:48:58<26:58:34,  3.59it/s]
  6%|▌         | 22873/371472 [1:48:58<28:14:11,  3.43it/s]
  6%|▌         | 22874/371472 [1:48:58<29:23:58,  3.29it/s]
  6%|▌         | 22875/371472 [1:48:59<28:27:12,  3.40it/s]
  6%|▌         | 22876/371472 [1:48:59<27:58:31,  3.46it/s]
  6%|▌         | 22877/371472 [1:48:59<28:33:43,  3.39it/s]
  6%|▌         | 22878/371472 [1:49:00<27:40:33,  3.50it/s]
  6%|▌         | 22879/371472 [1:49:00<28:30:29,  3.40it/s]
  6%|▌         | 22880/371472 [1:49:00<30:24:02,  3.19it/s]
                                                           
{'loss': 4.5437, 'learning_rate': 9.45021439806934e-07, 'epoch': 0.99}

  6%|▌         | 22880/371472 [1:49:00<30:24:02,  3.19it/s]
  6%|▌         | 22881/371472 [1:49:01<29:28:33,  3.29it/s]
  6%|▌         | 22882/371472 [1:49:01<28:43:14,  3.37it/s]
  6%|▌         | 22883/371472 [1:49:01<27:18:03,  3.55it/s]
  6%|▌         | 22884/371472 [1:49:01<26:49:34,  3.61it/s]
  6%|▌         | 22885/371472 [1:49:02<26:28:27,  3.66it/s]
  6%|▌         | 22886/371472 [1:49:02<26:58:06,  3.59it/s]
  6%|▌         | 22887/371472 [1:49:02<27:39:13,  3.50it/s]
  6%|▌         | 22888/371472 [1:49:02<26:56:51,  3.59it/s]
  6%|▌         | 22889/371472 [1:49:03<27:12:12,  3.56it/s]
  6%|▌         | 22890/371472 [1:49:03<26:33:35,  3.65it/s]
  6%|▌         | 22891/371472 [1:49:03<27:10:30,  3.56it/s]
  6%|▌         | 22892/371472 [1:49:04<29:11:24,  3.32it/s]
  6%|▌         | 22893/371472 [1:49:04<28:15:10,  3.43it/s]
  6%|▌         | 22894/371472 [1:49:04<28:13:26,  3.43it/s]
  6%|▌         | 22895/371472 [1:49:04<28:11:01,  3.44it/s]
  6%|▌         | 22896/371472 [1:49:05<27:54:03,  3.47it/s]
  6%|▌         | 22897/371472 [1:49:05<27:55:26,  3.47it/s]
  6%|▌         | 22898/371472 [1:49:05<27:43:58,  3.49it/s]
  6%|▌         | 22899/371472 [1:49:06<27:09:52,  3.56it/s]
  6%|▌         | 22900/371472 [1:49:06<26:31:54,  3.65it/s]
                                                           
{'loss': 4.3082, 'learning_rate': 9.449729578314551e-07, 'epoch': 0.99}

  6%|▌         | 22900/371472 [1:49:06<26:31:54,  3.65it/s]
  6%|▌         | 22901/371472 [1:49:06<26:09:44,  3.70it/s]
  6%|▌         | 22902/371472 [1:49:06<26:44:08,  3.62it/s]
  6%|▌         | 22903/371472 [1:49:07<25:57:10,  3.73it/s]
  6%|▌         | 22904/371472 [1:49:07<25:56:01,  3.73it/s]
  6%|▌         | 22905/371472 [1:49:07<26:17:31,  3.68it/s]
  6%|▌         | 22906/371472 [1:49:07<26:21:13,  3.67it/s]
  6%|▌         | 22907/371472 [1:49:08<26:52:19,  3.60it/s]
  6%|▌         | 22908/371472 [1:49:08<30:06:49,  3.22it/s]
  6%|▌         | 22909/371472 [1:49:08<28:56:05,  3.35it/s]
  6%|▌         | 22910/371472 [1:49:09<31:35:37,  3.06it/s]
  6%|▌         | 22911/371472 [1:49:09<29:22:34,  3.30it/s]
  6%|▌         | 22912/371472 [1:49:09<29:27:30,  3.29it/s]
  6%|▌         | 22913/371472 [1:49:10<28:29:30,  3.40it/s]
  6%|▌         | 22914/371472 [1:49:10<27:22:03,  3.54it/s]
  6%|▌         | 22915/371472 [1:49:10<26:45:14,  3.62it/s]
  6%|▌         | 22916/371472 [1:49:10<26:09:00,  3.70it/s]
  6%|▌         | 22917/371472 [1:49:11<26:08:03,  3.70it/s]
  6%|▌         | 22918/371472 [1:49:11<26:06:13,  3.71it/s]
  6%|▌         | 22919/371472 [1:49:11<28:31:49,  3.39it/s]
  6%|▌         | 22920/371472 [1:49:12<28:13:13,  3.43it/s]
                                                           
{'loss': 4.5584, 'learning_rate': 9.449244758559761e-07, 'epoch': 0.99}

  6%|▌         | 22920/371472 [1:49:12<28:13:13,  3.43it/s]
  6%|▌         | 22921/371472 [1:49:12<27:13:49,  3.56it/s]
  6%|▌         | 22922/371472 [1:49:12<27:08:42,  3.57it/s]
  6%|▌         | 22923/371472 [1:49:12<28:04:00,  3.45it/s]
  6%|▌         | 22924/371472 [1:49:13<26:57:03,  3.59it/s]
  6%|▌         | 22925/371472 [1:49:13<26:44:34,  3.62it/s]
  6%|▌         | 22926/371472 [1:49:13<26:08:03,  3.70it/s]
  6%|▌         | 22927/371472 [1:49:13<25:58:36,  3.73it/s]
  6%|▌         | 22928/371472 [1:49:14<25:45:02,  3.76it/s]
  6%|▌         | 22929/371472 [1:49:14<28:34:26,  3.39it/s]
  6%|▌         | 22930/371472 [1:49:14<27:17:59,  3.55it/s]
  6%|▌         | 22931/371472 [1:49:15<26:21:36,  3.67it/s]
  6%|▌         | 22932/371472 [1:49:15<25:42:01,  3.77it/s]
  6%|▌         | 22933/371472 [1:49:15<27:06:39,  3.57it/s]
  6%|▌         | 22934/371472 [1:49:15<26:43:12,  3.62it/s]
  6%|▌         | 22935/371472 [1:49:16<26:21:56,  3.67it/s]
  6%|▌         | 22936/371472 [1:49:16<26:05:55,  3.71it/s]
  6%|▌         | 22937/371472 [1:49:16<27:01:34,  3.58it/s]
  6%|▌         | 22938/371472 [1:49:17<26:50:36,  3.61it/s]
  6%|▌         | 22939/371472 [1:49:17<27:18:22,  3.55it/s]
  6%|▌         | 22940/371472 [1:49:17<28:18:09,  3.42it/s]
                                                           
{'loss': 4.5198, 'learning_rate': 9.448759938804972e-07, 'epoch': 0.99}

  6%|▌         | 22940/371472 [1:49:17<28:18:09,  3.42it/s]
  6%|▌         | 22941/371472 [1:49:17<27:58:08,  3.46it/s]
  6%|▌         | 22942/371472 [1:49:18<27:37:41,  3.50it/s]
  6%|▌         | 22943/371472 [1:49:18<27:23:42,  3.53it/s]
  6%|▌         | 22944/371472 [1:49:18<28:19:59,  3.42it/s]
  6%|▌         | 22945/371472 [1:49:19<28:30:06,  3.40it/s]
  6%|▌         | 22946/371472 [1:49:19<29:17:57,  3.30it/s]
  6%|▌         | 22947/371472 [1:49:19<29:31:04,  3.28it/s]
  6%|▌         | 22948/371472 [1:49:20<28:54:30,  3.35it/s]
  6%|▌         | 22949/371472 [1:49:20<27:33:07,  3.51it/s]
  6%|▌         | 22950/371472 [1:49:20<26:33:24,  3.65it/s]
  6%|▌         | 22951/371472 [1:49:20<25:59:06,  3.73it/s]
  6%|▌         | 22952/371472 [1:49:21<27:15:04,  3.55it/s]
  6%|▌         | 22953/371472 [1:49:21<26:57:10,  3.59it/s]
  6%|▌         | 22954/371472 [1:49:21<25:53:17,  3.74it/s]
  6%|▌         | 22955/371472 [1:49:21<27:31:01,  3.52it/s]
  6%|▌         | 22956/371472 [1:49:22<27:15:31,  3.55it/s]
  6%|▌         | 22957/371472 [1:49:22<26:44:54,  3.62it/s]
  6%|▌         | 22958/371472 [1:49:22<29:56:09,  3.23it/s]
  6%|▌         | 22959/371472 [1:49:23<29:55:17,  3.24it/s]
  6%|▌         | 22960/371472 [1:49:23<29:22:27,  3.30it/s]
                                                           
{'loss': 4.632, 'learning_rate': 9.448275119050184e-07, 'epoch': 0.99}

  6%|▌         | 22960/371472 [1:49:23<29:22:27,  3.30it/s]
  6%|▌         | 22961/371472 [1:49:23<28:15:20,  3.43it/s]
  6%|▌         | 22962/371472 [1:49:23<27:24:25,  3.53it/s]
  6%|▌         | 22963/371472 [1:49:24<27:22:49,  3.54it/s]
  6%|▌         | 22964/371472 [1:49:24<26:27:44,  3.66it/s]
  6%|▌         | 22965/371472 [1:49:24<26:46:41,  3.62it/s]
  6%|▌         | 22966/371472 [1:49:25<26:02:02,  3.72it/s]
  6%|▌         | 22967/371472 [1:49:25<25:27:56,  3.80it/s]
  6%|▌         | 22968/371472 [1:49:25<25:43:47,  3.76it/s]
  6%|▌         | 22969/371472 [1:49:25<28:36:49,  3.38it/s]
  6%|▌         | 22970/371472 [1:49:26<28:31:14,  3.39it/s]
  6%|▌         | 22971/371472 [1:49:26<29:47:47,  3.25it/s]
  6%|▌         | 22972/371472 [1:49:26<28:30:26,  3.40it/s]
  6%|▌         | 22973/371472 [1:49:27<29:10:10,  3.32it/s]
  6%|▌         | 22974/371472 [1:49:27<27:44:46,  3.49it/s]
  6%|▌         | 22975/371472 [1:49:27<27:32:53,  3.51it/s]
  6%|▌         | 22976/371472 [1:49:27<26:29:59,  3.65it/s]
  6%|▌         | 22977/371472 [1:49:28<26:17:20,  3.68it/s]
  6%|▌         | 22978/371472 [1:49:28<26:04:44,  3.71it/s]
  6%|▌         | 22979/371472 [1:49:28<25:21:37,  3.82it/s]
  6%|▌         | 22980/371472 [1:49:29<27:37:46,  3.50it/s]
                                                           
{'loss': 4.5563, 'learning_rate': 9.447790299295395e-07, 'epoch': 0.99}

  6%|▌         | 22980/371472 [1:49:29<27:37:46,  3.50it/s]
  6%|▌         | 22981/371472 [1:49:29<28:47:07,  3.36it/s]
  6%|▌         | 22982/371472 [1:49:29<27:58:57,  3.46it/s]
  6%|▌         | 22983/371472 [1:49:29<27:54:11,  3.47it/s]
  6%|▌         | 22984/371472 [1:49:30<28:26:25,  3.40it/s]
  6%|▌         | 22985/371472 [1:49:30<28:43:48,  3.37it/s]
  6%|▌         | 22986/371472 [1:49:30<30:07:43,  3.21it/s]
  6%|▌         | 22987/371472 [1:49:31<29:57:44,  3.23it/s]
  6%|▌         | 22988/371472 [1:49:31<28:49:44,  3.36it/s]
  6%|▌         | 22989/371472 [1:49:31<29:14:08,  3.31it/s]
  6%|▌         | 22990/371472 [1:49:32<28:07:35,  3.44it/s]
  6%|▌         | 22991/371472 [1:49:32<27:24:51,  3.53it/s]
  6%|▌         | 22992/371472 [1:49:32<28:50:15,  3.36it/s]
  6%|▌         | 22993/371472 [1:49:32<28:12:01,  3.43it/s]
  6%|▌         | 22994/371472 [1:49:33<28:01:06,  3.45it/s]
  6%|▌         | 22995/371472 [1:49:33<26:58:47,  3.59it/s]
  6%|▌         | 22996/371472 [1:49:33<26:41:45,  3.63it/s]
  6%|▌         | 22997/371472 [1:49:33<26:43:46,  3.62it/s]
  6%|▌         | 22998/371472 [1:49:34<26:35:22,  3.64it/s]
  6%|▌         | 22999/371472 [1:49:34<25:45:18,  3.76it/s]
  6%|▌         | 23000/371472 [1:49:34<26:33:09,  3.65it/s]
                                                           
{'loss': 4.8115, 'learning_rate': 9.447305479540606e-07, 'epoch': 0.99}

  6%|▌         | 23000/371472 [1:49:34<26:33:09,  3.65it/s]
  6%|▌         | 23001/371472 [1:49:35<26:17:01,  3.68it/s]
  6%|▌         | 23002/371472 [1:49:35<26:23:12,  3.67it/s]
  6%|▌         | 23003/371472 [1:49:35<26:00:06,  3.72it/s]
  6%|▌         | 23004/371472 [1:49:35<27:01:58,  3.58it/s]
  6%|▌         | 23005/371472 [1:49:36<27:28:45,  3.52it/s]
  6%|▌         | 23006/371472 [1:49:36<27:49:45,  3.48it/s]
  6%|▌         | 23007/371472 [1:49:36<26:50:43,  3.61it/s]
  6%|▌         | 23008/371472 [1:49:37<27:14:10,  3.55it/s]
  6%|▌         | 23009/371472 [1:49:37<26:21:49,  3.67it/s]
  6%|▌         | 23010/371472 [1:49:37<26:17:33,  3.68it/s]
  6%|▌         | 23011/371472 [1:49:37<27:46:34,  3.48it/s]
  6%|▌         | 23012/371472 [1:49:38<27:35:15,  3.51it/s]
  6%|▌         | 23013/371472 [1:49:38<28:21:27,  3.41it/s]
  6%|▌         | 23014/371472 [1:49:38<27:49:44,  3.48it/s]
  6%|▌         | 23015/371472 [1:49:39<27:39:18,  3.50it/s]
  6%|▌         | 23016/371472 [1:49:39<32:23:37,  2.99it/s]
  6%|▌         | 23017/371472 [1:49:39<30:45:59,  3.15it/s]
  6%|▌         | 23018/371472 [1:49:40<30:15:31,  3.20it/s]
  6%|▌         | 23019/371472 [1:49:40<30:01:18,  3.22it/s]
  6%|▌         | 23020/371472 [1:49:40<29:14:02,  3.31it/s]
                                                           
{'loss': 4.5416, 'learning_rate': 9.446820659785817e-07, 'epoch': 0.99}

  6%|▌         | 23020/371472 [1:49:40<29:14:02,  3.31it/s]
  6%|▌         | 23021/371472 [1:49:40<27:56:52,  3.46it/s]
  6%|▌         | 23022/371472 [1:49:41<27:35:06,  3.51it/s]
  6%|▌         | 23023/371472 [1:49:41<27:20:05,  3.54it/s]
  6%|▌         | 23024/371472 [1:49:41<26:16:15,  3.68it/s]
  6%|▌         | 23025/371472 [1:49:42<28:12:00,  3.43it/s]
  6%|▌         | 23026/371472 [1:49:42<29:56:57,  3.23it/s]
  6%|▌         | 23027/371472 [1:49:42<30:29:56,  3.17it/s]
  6%|▌         | 23028/371472 [1:49:42<29:07:42,  3.32it/s]
  6%|▌         | 23029/371472 [1:49:43<29:09:24,  3.32it/s]
  6%|▌         | 23030/371472 [1:49:43<29:54:48,  3.24it/s]
  6%|▌         | 23031/371472 [1:49:43<28:53:32,  3.35it/s]
  6%|▌         | 23032/371472 [1:49:44<27:56:27,  3.46it/s]
  6%|▌         | 23033/371472 [1:49:44<26:40:40,  3.63it/s]
  6%|▌         | 23034/371472 [1:49:44<26:22:53,  3.67it/s]
  6%|▌         | 23035/371472 [1:49:44<26:25:18,  3.66it/s]
  6%|▌         | 23036/371472 [1:49:45<26:07:29,  3.70it/s]
  6%|▌         | 23037/371472 [1:49:45<28:36:19,  3.38it/s]
  6%|▌         | 23038/371472 [1:49:45<27:37:36,  3.50it/s]
  6%|▌         | 23039/371472 [1:49:46<27:07:17,  3.57it/s]
  6%|▌         | 23040/371472 [1:49:46<29:58:56,  3.23it/s]
                                                           
{'loss': 4.1979, 'learning_rate': 9.446335840031028e-07, 'epoch': 0.99}

  6%|▌         | 23040/371472 [1:49:46<29:58:56,  3.23it/s]
  6%|▌         | 23041/371472 [1:49:46<28:45:51,  3.36it/s]
  6%|▌         | 23042/371472 [1:49:46<27:54:07,  3.47it/s]
  6%|▌         | 23043/371472 [1:49:47<27:12:34,  3.56it/s]
  6%|▌         | 23044/371472 [1:49:47<27:00:42,  3.58it/s]
  6%|▌         | 23045/371472 [1:49:47<28:21:52,  3.41it/s]
  6%|▌         | 23046/371472 [1:49:48<27:52:31,  3.47it/s]
  6%|▌         | 23047/371472 [1:49:48<29:32:19,  3.28it/s]
  6%|▌         | 23048/371472 [1:49:48<28:52:46,  3.35it/s]
  6%|▌         | 23049/371472 [1:49:49<28:28:23,  3.40it/s]
  6%|▌         | 23050/371472 [1:49:49<27:32:54,  3.51it/s]
  6%|▌         | 23051/371472 [1:49:49<27:45:51,  3.49it/s]
  6%|▌         | 23052/371472 [1:49:49<27:20:57,  3.54it/s]
  6%|▌         | 23053/371472 [1:49:50<26:37:43,  3.63it/s]
  6%|▌         | 23054/371472 [1:49:50<27:02:03,  3.58it/s]
  6%|▌         | 23055/371472 [1:49:50<28:04:52,  3.45it/s]
  6%|▌         | 23056/371472 [1:49:51<27:32:39,  3.51it/s]
  6%|▌         | 23057/371472 [1:49:51<26:41:53,  3.63it/s]
  6%|▌         | 23058/371472 [1:49:51<26:54:26,  3.60it/s]
  6%|▌         | 23059/371472 [1:49:51<27:40:46,  3.50it/s]
  6%|▌         | 23060/371472 [1:49:52<26:51:26,  3.60it/s]
                                                           
{'loss': 4.4413, 'learning_rate': 9.445851020276238e-07, 'epoch': 0.99}

  6%|▌         | 23060/371472 [1:49:52<26:51:26,  3.60it/s]
  6%|▌         | 23061/371472 [1:49:52<28:16:52,  3.42it/s]
  6%|▌         | 23062/371472 [1:49:52<27:34:25,  3.51it/s]
  6%|▌         | 23063/371472 [1:49:53<28:51:05,  3.35it/s]
  6%|▌         | 23064/371472 [1:49:53<29:33:05,  3.27it/s]
  6%|▌         | 23065/371472 [1:49:53<30:16:43,  3.20it/s]
  6%|▌         | 23066/371472 [1:49:53<28:37:46,  3.38it/s]
  6%|▌         | 23067/371472 [1:49:54<30:39:17,  3.16it/s]
  6%|▌         | 23068/371472 [1:49:54<30:52:19,  3.13it/s]
  6%|▌         | 23069/371472 [1:49:54<28:59:42,  3.34it/s]
  6%|▌         | 23070/371472 [1:49:55<27:32:40,  3.51it/s]
  6%|▌         | 23071/371472 [1:49:55<28:42:16,  3.37it/s]
  6%|▌         | 23072/371472 [1:49:55<27:54:09,  3.47it/s]
  6%|▌         | 23073/371472 [1:49:55<27:06:18,  3.57it/s]
  6%|▌         | 23074/371472 [1:49:56<26:13:31,  3.69it/s]
  6%|▌         | 23075/371472 [1:49:56<26:23:35,  3.67it/s]
  6%|▌         | 23076/371472 [1:49:56<27:17:25,  3.55it/s]
  6%|▌         | 23077/371472 [1:49:57<26:18:41,  3.68it/s]
  6%|▌         | 23078/371472 [1:49:57<25:13:06,  3.84it/s]
  6%|▌         | 23079/371472 [1:49:57<26:27:37,  3.66it/s]
  6%|▌         | 23080/371472 [1:49:57<26:57:49,  3.59it/s]
                                                           
{'loss': 4.4993, 'learning_rate': 9.44536620052145e-07, 'epoch': 0.99}

  6%|▌         | 23080/371472 [1:49:57<26:57:49,  3.59it/s]
  6%|▌         | 23081/371472 [1:49:58<26:21:49,  3.67it/s]
  6%|▌         | 23082/371472 [1:49:58<26:36:41,  3.64it/s]
  6%|▌         | 23083/371472 [1:49:58<26:49:36,  3.61it/s]
  6%|▌         | 23084/371472 [1:49:59<27:20:58,  3.54it/s]
  6%|▌         | 23085/371472 [1:49:59<28:08:30,  3.44it/s]
  6%|▌         | 23086/371472 [1:49:59<26:57:57,  3.59it/s]
  6%|▌         | 23087/371472 [1:49:59<27:48:55,  3.48it/s]
  6%|▌         | 23088/371472 [1:50:00<27:23:02,  3.53it/s]
  6%|▌         | 23089/371472 [1:50:00<26:09:24,  3.70it/s]
  6%|▌         | 23090/371472 [1:50:00<25:34:36,  3.78it/s]
  6%|▌         | 23091/371472 [1:50:00<25:01:20,  3.87it/s]
  6%|▌         | 23092/371472 [1:50:01<26:09:06,  3.70it/s]
  6%|▌         | 23093/371472 [1:50:01<26:01:57,  3.72it/s]
  6%|▌         | 23094/371472 [1:50:01<27:03:26,  3.58it/s]
  6%|▌         | 23095/371472 [1:50:02<26:51:27,  3.60it/s]
  6%|▌         | 23096/371472 [1:50:02<26:10:11,  3.70it/s]
  6%|▌         | 23097/371472 [1:50:02<27:57:15,  3.46it/s]
  6%|▌         | 23098/371472 [1:50:02<30:10:52,  3.21it/s]
  6%|▌         | 23099/371472 [1:50:03<29:33:15,  3.27it/s]
  6%|▌         | 23100/371472 [1:50:03<28:00:12,  3.46it/s]
                                                           
{'loss': 4.4913, 'learning_rate': 9.444881380766661e-07, 'epoch': 0.99}

  6%|▌         | 23100/371472 [1:50:03<28:00:12,  3.46it/s]
  6%|▌         | 23101/371472 [1:50:03<28:00:07,  3.46it/s]
  6%|▌         | 23102/371472 [1:50:04<27:06:20,  3.57it/s]
  6%|▌         | 23103/371472 [1:50:04<27:26:34,  3.53it/s]
  6%|▌         | 23104/371472 [1:50:04<27:07:50,  3.57it/s]
  6%|▌         | 23105/371472 [1:50:04<26:27:27,  3.66it/s]
  6%|▌         | 23106/371472 [1:50:05<28:31:25,  3.39it/s]
  6%|▌         | 23107/371472 [1:50:05<27:44:08,  3.49it/s]
  6%|▌         | 23108/371472 [1:50:05<27:28:56,  3.52it/s]
  6%|▌         | 23109/371472 [1:50:06<26:09:30,  3.70it/s]
  6%|▌         | 23110/371472 [1:50:06<30:27:26,  3.18it/s]
  6%|▌         | 23111/371472 [1:50:06<29:31:53,  3.28it/s]
  6%|▌         | 23112/371472 [1:50:06<28:24:03,  3.41it/s]
  6%|▌         | 23113/371472 [1:50:07<27:43:33,  3.49it/s]
  6%|▌         | 23114/371472 [1:50:07<28:10:32,  3.43it/s]
  6%|▌         | 23115/371472 [1:50:07<29:11:06,  3.32it/s]
  6%|▌         | 23116/371472 [1:50:08<28:13:05,  3.43it/s]
  6%|▌         | 23117/371472 [1:50:08<28:01:09,  3.45it/s]
  6%|▌         | 23118/371472 [1:50:08<28:14:48,  3.43it/s]
  6%|▌         | 23119/371472 [1:50:09<30:26:50,  3.18it/s]
  6%|▌         | 23120/371472 [1:50:09<29:43:53,  3.25it/s]
                                                           
{'loss': 4.3746, 'learning_rate': 9.444396561011873e-07, 'epoch': 1.0}

  6%|▌         | 23120/371472 [1:50:09<29:43:53,  3.25it/s]
  6%|▌         | 23121/371472 [1:50:09<28:10:24,  3.43it/s]
  6%|▌         | 23122/371472 [1:50:09<27:35:13,  3.51it/s]
  6%|▌         | 23123/371472 [1:50:10<34:07:46,  2.84it/s]
  6%|▌         | 23124/371472 [1:50:10<31:59:57,  3.02it/s]
  6%|▌         | 23125/371472 [1:50:10<30:32:49,  3.17it/s]
  6%|▌         | 23126/371472 [1:50:11<32:17:28,  3.00it/s]
  6%|▌         | 23127/371472 [1:50:11<29:57:39,  3.23it/s]
  6%|▌         | 23128/371472 [1:50:11<31:44:07,  3.05it/s]
  6%|▌         | 23129/371472 [1:50:12<30:32:36,  3.17it/s]
  6%|▌         | 23130/371472 [1:50:12<31:09:27,  3.11it/s]
  6%|▌         | 23131/371472 [1:50:12<28:54:31,  3.35it/s]
  6%|▌         | 23132/371472 [1:50:13<27:03:55,  3.58it/s]
  6%|▌         | 23133/371472 [1:50:13<25:58:48,  3.72it/s]
  6%|▌         | 23134/371472 [1:50:13<25:28:54,  3.80it/s]
  6%|▌         | 23135/371472 [1:50:13<26:08:35,  3.70it/s]
  6%|▌         | 23136/371472 [1:50:14<26:27:15,  3.66it/s]
  6%|▌         | 23137/371472 [1:50:14<26:32:01,  3.65it/s]
  6%|▌         | 23138/371472 [1:50:14<28:40:49,  3.37it/s]
  6%|▌         | 23139/371472 [1:50:15<27:18:25,  3.54it/s]
  6%|▌         | 23140/371472 [1:50:15<26:19:52,  3.67it/s]
                                                           
{'loss': 4.6342, 'learning_rate': 9.443911741257083e-07, 'epoch': 1.0}

  6%|▌         | 23140/371472 [1:50:15<26:19:52,  3.67it/s]
  6%|▌         | 23141/371472 [1:50:15<25:49:31,  3.75it/s]
  6%|▌         | 23142/371472 [1:50:15<26:17:45,  3.68it/s]
  6%|▌         | 23143/371472 [1:50:16<28:18:01,  3.42it/s]
  6%|▌         | 23144/371472 [1:50:16<27:21:41,  3.54it/s]
  6%|▌         | 23145/371472 [1:50:16<27:08:36,  3.56it/s]
  6%|▌         | 23146/371472 [1:50:16<26:34:51,  3.64it/s]
  6%|▌         | 23147/371472 [1:50:17<27:17:27,  3.55it/s]
  6%|▌         | 23148/371472 [1:50:17<26:22:24,  3.67it/s]
  6%|▌         | 23149/371472 [1:50:17<26:33:25,  3.64it/s]
  6%|▌         | 23150/371472 [1:50:18<26:46:37,  3.61it/s]
  6%|▌         | 23151/371472 [1:50:18<26:20:14,  3.67it/s]
  6%|▌         | 23152/371472 [1:50:18<26:03:47,  3.71it/s]
  6%|▌         | 23153/371472 [1:50:18<28:45:45,  3.36it/s]
  6%|▌         | 23154/371472 [1:50:19<29:19:58,  3.30it/s]
  6%|▌         | 23155/371472 [1:50:19<28:06:35,  3.44it/s]
  6%|▌         | 23156/371472 [1:50:19<29:41:29,  3.26it/s]
  6%|▌         | 23157/371472 [1:50:20<28:13:43,  3.43it/s]
  6%|▌         | 23158/371472 [1:50:20<28:39:17,  3.38it/s]
  6%|▌         | 23159/371472 [1:50:20<27:52:19,  3.47it/s]
  6%|▌         | 23160/371472 [1:50:20<27:51:42,  3.47it/s]
                                                           
{'loss': 4.4272, 'learning_rate': 9.443426921502295e-07, 'epoch': 1.0}

  6%|▌         | 23160/371472 [1:50:20<27:51:42,  3.47it/s]
  6%|▌         | 23161/371472 [1:50:21<27:49:15,  3.48it/s]
  6%|▌         | 23162/371472 [1:50:21<27:01:20,  3.58it/s]
  6%|▌         | 23163/371472 [1:50:21<27:36:59,  3.50it/s]
  6%|▌         | 23164/371472 [1:50:22<27:12:09,  3.56it/s]
  6%|▌         | 23165/371472 [1:50:22<27:34:44,  3.51it/s]
  6%|▌         | 23166/371472 [1:50:22<26:54:29,  3.60it/s]
  6%|▌         | 23167/371472 [1:50:22<26:37:21,  3.63it/s]
  6%|▌         | 23168/371472 [1:50:23<26:36:24,  3.64it/s]
  6%|▌         | 23169/371472 [1:50:23<27:08:36,  3.56it/s]
  6%|▌         | 23170/371472 [1:50:23<26:54:16,  3.60it/s]
  6%|▌         | 23171/371472 [1:50:24<27:04:26,  3.57it/s]
  6%|▌         | 23172/371472 [1:50:24<28:18:51,  3.42it/s]
  6%|▌         | 23173/371472 [1:50:24<27:07:43,  3.57it/s]
  6%|▌         | 23174/371472 [1:50:24<27:36:00,  3.51it/s]
  6%|▌         | 23175/371472 [1:50:25<26:50:39,  3.60it/s]
  6%|▌         | 23176/371472 [1:50:25<26:08:35,  3.70it/s]
  6%|▌         | 23177/371472 [1:50:25<26:39:48,  3.63it/s]
  6%|▌         | 23178/371472 [1:50:25<25:54:16,  3.73it/s]
  6%|▌         | 23179/371472 [1:50:26<26:32:52,  3.64it/s]
  6%|▌         | 23180/371472 [1:50:26<26:14:25,  3.69it/s]
                                                           
{'loss': 4.6873, 'learning_rate': 9.442942101747505e-07, 'epoch': 1.0}

  6%|▌         | 23180/371472 [1:50:26<26:14:25,  3.69it/s]
  6%|▌         | 23181/371472 [1:50:26<25:58:19,  3.73it/s]
  6%|▌         | 23182/371472 [1:50:27<26:14:11,  3.69it/s]
  6%|▌         | 23183/371472 [1:50:27<25:35:12,  3.78it/s]
  6%|▌         | 23184/371472 [1:50:27<25:42:37,  3.76it/s]
  6%|▌         | 23185/371472 [1:50:27<25:14:55,  3.83it/s]
  6%|▌         | 23186/371472 [1:50:28<25:40:19,  3.77it/s]
  6%|▌         | 23187/371472 [1:50:28<27:13:18,  3.55it/s]
  6%|▌         | 23188/371472 [1:50:28<28:41:35,  3.37it/s]
  6%|▌         | 23189/371472 [1:50:29<27:38:23,  3.50it/s]
  6%|▌         | 23190/371472 [1:50:29<28:05:00,  3.44it/s]
  6%|▌         | 23191/371472 [1:50:29<27:49:01,  3.48it/s]
  6%|▌         | 23192/371472 [1:50:29<29:45:58,  3.25it/s]
  6%|▌         | 23193/371472 [1:50:30<29:19:06,  3.30it/s]
  6%|▌         | 23194/371472 [1:50:30<27:57:50,  3.46it/s]
  6%|▌         | 23195/371472 [1:50:30<27:07:14,  3.57it/s]
  6%|▌         | 23196/371472 [1:50:31<27:27:00,  3.52it/s]
  6%|▌         | 23197/371472 [1:50:31<27:47:32,  3.48it/s]
  6%|▌         | 23198/371472 [1:50:31<26:37:25,  3.63it/s]
  6%|▌         | 23199/371472 [1:50:31<26:54:33,  3.60it/s]
  6%|▌         | 23200/371472 [1:50:32<26:46:18,  3.61it/s]
                                                           
{'loss': 4.4283, 'learning_rate': 9.442457281992717e-07, 'epoch': 1.0}

  6%|▌         | 23200/371472 [1:50:32<26:46:18,  3.61it/s]
  6%|▌         | 23201/371472 [1:50:32<28:00:59,  3.45it/s]
  6%|▌         | 23202/371472 [1:50:32<28:59:02,  3.34it/s]
  6%|▌         | 23203/371472 [1:50:33<28:12:58,  3.43it/s]
  6%|▌         | 23204/371472 [1:50:33<28:05:39,  3.44it/s]
  6%|▌         | 23205/371472 [1:50:33<27:20:25,  3.54it/s]
  6%|▌         | 23206/371472 [1:50:33<27:15:05,  3.55it/s]
  6%|▌         | 23207/371472 [1:50:34<26:08:26,  3.70it/s]
  6%|▌         | 23208/371472 [1:50:34<27:48:55,  3.48it/s]
  6%|▌         | 23209/371472 [1:50:34<30:45:28,  3.15it/s]
  6%|▌         | 23210/371472 [1:50:35<29:43:48,  3.25it/s]
  6%|▌         | 23211/371472 [1:50:35<29:56:38,  3.23it/s]
  6%|▌         | 23212/371472 [1:50:35<29:03:09,  3.33it/s]
  6%|▌         | 23213/371472 [1:50:36<29:38:42,  3.26it/s]
  6%|▌         | 23214/371472 [1:50:36<29:13:43,  3.31it/s]
  6%|▌         | 23215/371472 [1:50:36<28:44:16,  3.37it/s]
  6%|▌         | 23216/371472 [1:50:36<27:46:47,  3.48it/s]
  6%|▋         | 23217/371472 [1:50:37<28:05:34,  3.44it/s]Some non-default generation parameters are set in the model config. These should go into a GenerationConfig file (https://huggingface.co/docs/transformers/generation_strategies#save-a-custom-decoding-strategy-with-your-model) instead. This warning will be raised to an exception in v4.41.
Non-default generation parameters: {'max_length': 200, 'early_stopping': True, 'num_beams': 5, 'forced_eos_token_id': 2}
/opt/conda/lib/python3.10/multiprocessing/popen_fork.py:66: RuntimeWarning: os.fork() was called. os.fork() is incompatible with multithreaded code, and JAX is multithreaded, so this will likely lead to a deadlock.
  self.pid = os.fork()

  6%|▋         | 23218/371472 [1:50:51<421:21:09,  4.36s/it]
  6%|▋         | 23219/371472 [1:50:51<303:00:47,  3.13s/it]
  6%|▋         | 23220/371472 [1:50:51<220:08:07,  2.28s/it]
                                                            
{'loss': 4.5882, 'learning_rate': 9.441972462237927e-07, 'epoch': 1.0}

  6%|▋         | 23220/371472 [1:50:51<220:08:07,  2.28s/it]
  6%|▋         | 23221/371472 [1:50:51<162:47:03,  1.68s/it]
  6%|▋         | 23222/371472 [1:50:52<121:52:40,  1.26s/it]
  6%|▋         | 23223/371472 [1:50:52<93:22:00,  1.04it/s] 
  6%|▋         | 23224/371472 [1:50:52<72:34:00,  1.33it/s]
  6%|▋         | 23225/371472 [1:50:53<60:13:33,  1.61it/s]
  6%|▋         | 23226/371472 [1:50:53<52:14:13,  1.85it/s]
  6%|▋         | 23227/371472 [1:50:53<46:06:43,  2.10it/s]
  6%|▋         | 23228/371472 [1:50:54<42:19:19,  2.29it/s]
  6%|▋         | 23229/371472 [1:50:54<38:25:03,  2.52it/s]
  6%|▋         | 23230/371472 [1:50:54<37:39:21,  2.57it/s]
  6%|▋         | 23231/371472 [1:50:55<35:34:43,  2.72it/s]
  6%|▋         | 23232/371472 [1:50:55<35:51:39,  2.70it/s]
  6%|▋         | 23233/371472 [1:50:55<35:24:28,  2.73it/s]
  6%|▋         | 23234/371472 [1:50:56<36:21:57,  2.66it/s]
  6%|▋         | 23235/371472 [1:50:56<34:23:05,  2.81it/s]
  6%|▋         | 23236/371472 [1:50:56<31:51:43,  3.04it/s]
  6%|▋         | 23237/371472 [1:50:57<30:17:53,  3.19it/s]
  6%|▋         | 23238/371472 [1:50:57<30:46:55,  3.14it/s]
  6%|▋         | 23239/371472 [1:50:57<31:00:27,  3.12it/s]
  6%|▋         | 23240/371472 [1:50:57<30:43:55,  3.15it/s]
                                                           
{'loss': 4.5283, 'learning_rate': 9.441487642483139e-07, 'epoch': 1.0}

  6%|▋         | 23240/371472 [1:50:57<30:43:55,  3.15it/s]
  6%|▋         | 23241/371472 [1:50:58<29:11:15,  3.31it/s]
  6%|▋         | 23242/371472 [1:50:58<29:11:59,  3.31it/s]
  6%|▋         | 23243/371472 [1:50:58<28:40:10,  3.37it/s]
  6%|▋         | 23244/371472 [1:50:59<29:10:12,  3.32it/s]
  6%|▋         | 23245/371472 [1:50:59<30:04:15,  3.22it/s]
  6%|▋         | 23246/371472 [1:50:59<28:55:33,  3.34it/s]
  6%|▋         | 23247/371472 [1:51:00<28:54:01,  3.35it/s]
  6%|▋         | 23248/371472 [1:51:00<28:14:49,  3.42it/s]
  6%|▋         | 23249/371472 [1:51:00<28:04:49,  3.44it/s]
  6%|▋         | 23250/371472 [1:51:00<27:18:05,  3.54it/s]
  6%|▋         | 23251/371472 [1:51:01<30:24:25,  3.18it/s]
  6%|▋         | 23252/371472 [1:51:01<29:07:41,  3.32it/s]
  6%|▋         | 23253/371472 [1:51:01<28:51:10,  3.35it/s]
  6%|▋         | 23254/371472 [1:51:02<31:06:55,  3.11it/s]
  6%|▋         | 23255/371472 [1:51:02<29:19:26,  3.30it/s]
  6%|▋         | 23256/371472 [1:51:02<27:59:44,  3.46it/s]
  6%|▋         | 23257/371472 [1:51:03<27:37:37,  3.50it/s]
  6%|▋         | 23258/371472 [1:51:03<27:33:02,  3.51it/s]
  6%|▋         | 23259/371472 [1:51:03<26:47:10,  3.61it/s]
  6%|▋         | 23260/371472 [1:51:03<26:39:15,  3.63it/s]
                                                           
{'loss': 4.2976, 'learning_rate': 9.44100282272835e-07, 'epoch': 1.0}

  6%|▋         | 23260/371472 [1:51:03<26:39:15,  3.63it/s]
  6%|▋         | 23261/371472 [1:51:04<26:14:00,  3.69it/s]
  6%|▋         | 23262/371472 [1:51:04<26:19:28,  3.67it/s]
  6%|▋         | 23263/371472 [1:51:04<26:54:09,  3.60it/s]
  6%|▋         | 23264/371472 [1:51:04<27:39:47,  3.50it/s]
  6%|▋         | 23265/371472 [1:51:05<27:56:51,  3.46it/s]
  6%|▋         | 23266/371472 [1:51:05<28:09:12,  3.44it/s]
  6%|▋         | 23267/371472 [1:51:05<26:58:28,  3.59it/s]
  6%|▋         | 23268/371472 [1:51:06<27:31:15,  3.51it/s]
  6%|▋         | 23269/371472 [1:51:06<28:33:46,  3.39it/s]
  6%|▋         | 23270/371472 [1:51:06<29:22:49,  3.29it/s]
  6%|▋         | 23271/371472 [1:51:06<27:52:09,  3.47it/s]
  6%|▋         | 23272/371472 [1:51:07<28:34:47,  3.38it/s]
  6%|▋         | 23273/371472 [1:51:07<29:15:16,  3.31it/s]
  6%|▋         | 23274/371472 [1:51:07<28:14:41,  3.42it/s]
  6%|▋         | 23275/371472 [1:51:08<28:36:44,  3.38it/s]
  6%|▋         | 23276/371472 [1:51:08<28:52:23,  3.35it/s]
  6%|▋         | 23277/371472 [1:51:08<28:43:56,  3.37it/s]
  6%|▋         | 23278/371472 [1:51:09<28:22:35,  3.41it/s]
  6%|▋         | 23279/371472 [1:51:09<27:59:15,  3.46it/s]
  6%|▋         | 23280/371472 [1:51:09<28:15:22,  3.42it/s]
                                                           
{'loss': 4.3969, 'learning_rate': 9.440518002973562e-07, 'epoch': 1.0}

  6%|▋         | 23280/371472 [1:51:09<28:15:22,  3.42it/s]
  6%|▋         | 23281/371472 [1:51:09<28:01:28,  3.45it/s]
  6%|▋         | 23282/371472 [1:51:10<27:23:41,  3.53it/s]
  6%|▋         | 23283/371472 [1:51:10<28:18:36,  3.42it/s]
  6%|▋         | 23284/371472 [1:51:10<29:31:46,  3.28it/s]
  6%|▋         | 23285/371472 [1:51:11<28:13:45,  3.43it/s]
  6%|▋         | 23286/371472 [1:51:11<29:03:57,  3.33it/s]
  6%|▋         | 23287/371472 [1:51:11<29:30:09,  3.28it/s]
  6%|▋         | 23288/371472 [1:51:12<28:57:17,  3.34it/s]
  6%|▋         | 23289/371472 [1:51:12<30:08:39,  3.21it/s]
  6%|▋         | 23290/371472 [1:51:12<29:11:11,  3.31it/s]
  6%|▋         | 23291/371472 [1:51:12<27:52:24,  3.47it/s]
  6%|▋         | 23292/371472 [1:51:13<27:24:08,  3.53it/s]
  6%|▋         | 23293/371472 [1:51:13<29:18:06,  3.30it/s]
  6%|▋         | 23294/371472 [1:51:13<28:04:48,  3.44it/s]
  6%|▋         | 23295/371472 [1:51:14<27:25:07,  3.53it/s]
  6%|▋         | 23296/371472 [1:51:14<28:06:41,  3.44it/s]
  6%|▋         | 23297/371472 [1:51:14<27:18:09,  3.54it/s]
  6%|▋         | 23298/371472 [1:51:14<28:08:17,  3.44it/s]
  6%|▋         | 23299/371472 [1:51:15<28:40:40,  3.37it/s]
  6%|▋         | 23300/371472 [1:51:15<30:00:33,  3.22it/s]
                                                           
{'loss': 4.3359, 'learning_rate': 9.44003318321877e-07, 'epoch': 1.0}

  6%|▋         | 23300/371472 [1:51:15<30:00:33,  3.22it/s]
  6%|▋         | 23301/371472 [1:51:15<29:46:03,  3.25it/s]
  6%|▋         | 23302/371472 [1:51:16<31:00:00,  3.12it/s]
  6%|▋         | 23303/371472 [1:51:16<28:45:42,  3.36it/s]
  6%|▋         | 23304/371472 [1:51:16<29:45:41,  3.25it/s]
  6%|▋         | 23305/371472 [1:51:17<29:46:38,  3.25it/s]
  6%|▋         | 23306/371472 [1:51:17<29:32:41,  3.27it/s]
  6%|▋         | 23307/371472 [1:51:17<29:54:21,  3.23it/s]
  6%|▋         | 23308/371472 [1:51:18<29:55:02,  3.23it/s]
  6%|▋         | 23309/371472 [1:51:18<30:53:07,  3.13it/s]
  6%|▋         | 23310/371472 [1:51:18<30:28:59,  3.17it/s]
  6%|▋         | 23311/371472 [1:51:19<30:26:27,  3.18it/s]
  6%|▋         | 23312/371472 [1:51:19<29:23:14,  3.29it/s]
  6%|▋         | 23313/371472 [1:51:19<30:23:16,  3.18it/s]
  6%|▋         | 23314/371472 [1:51:19<28:48:35,  3.36it/s]
  6%|▋         | 23315/371472 [1:51:20<28:06:33,  3.44it/s]
  6%|▋         | 23316/371472 [1:51:20<28:15:51,  3.42it/s]
  6%|▋         | 23317/371472 [1:51:20<29:28:31,  3.28it/s]
  6%|▋         | 23318/371472 [1:51:21<29:08:28,  3.32it/s]
  6%|▋         | 23319/371472 [1:51:21<30:26:57,  3.18it/s]
  6%|▋         | 23320/371472 [1:51:21<29:52:26,  3.24it/s]
                                                           
{'loss': 4.5208, 'learning_rate': 9.439548363463983e-07, 'epoch': 1.0}

  6%|▋         | 23320/371472 [1:51:21<29:52:26,  3.24it/s]
  6%|▋         | 23321/371472 [1:51:22<28:56:37,  3.34it/s]
  6%|▋         | 23322/371472 [1:51:22<28:09:41,  3.43it/s]
  6%|▋         | 23323/371472 [1:51:22<27:23:55,  3.53it/s]
  6%|▋         | 23324/371472 [1:51:22<28:03:59,  3.45it/s]
  6%|▋         | 23325/371472 [1:51:23<30:05:20,  3.21it/s]
  6%|▋         | 23326/371472 [1:51:23<31:02:38,  3.12it/s]
  6%|▋         | 23327/371472 [1:51:23<32:09:30,  3.01it/s]
  6%|▋         | 23328/371472 [1:51:24<33:18:14,  2.90it/s]
  6%|▋         | 23329/371472 [1:51:24<38:36:52,  2.50it/s]
  6%|▋         | 23330/371472 [1:51:25<34:18:15,  2.82it/s]
  6%|▋         | 23331/371472 [1:51:25<32:29:54,  2.98it/s]
  6%|▋         | 23332/371472 [1:51:25<31:46:01,  3.04it/s]
  6%|▋         | 23333/371472 [1:51:25<30:50:52,  3.13it/s]
  6%|▋         | 23334/371472 [1:51:26<28:55:56,  3.34it/s]
  6%|▋         | 23335/371472 [1:51:26<29:40:20,  3.26it/s]
  6%|▋         | 23336/371472 [1:51:26<30:59:36,  3.12it/s]
  6%|▋         | 23337/371472 [1:51:27<28:48:39,  3.36it/s]
  6%|▋         | 23338/371472 [1:51:27<28:18:11,  3.42it/s]
  6%|▋         | 23339/371472 [1:51:27<28:09:12,  3.43it/s]
  6%|▋         | 23340/371472 [1:51:28<28:32:32,  3.39it/s]
                                                           
{'loss': 4.3077, 'learning_rate': 9.439063543709194e-07, 'epoch': 1.01}

  6%|▋         | 23340/371472 [1:51:28<28:32:32,  3.39it/s]
  6%|▋         | 23341/371472 [1:51:28<28:13:13,  3.43it/s]
  6%|▋         | 23342/371472 [1:51:28<30:46:27,  3.14it/s]
  6%|▋         | 23343/371472 [1:51:28<29:06:15,  3.32it/s]
  6%|▋         | 23344/371472 [1:51:29<28:06:36,  3.44it/s]
  6%|▋         | 23345/371472 [1:51:29<28:21:54,  3.41it/s]
  6%|▋         | 23346/371472 [1:51:29<29:02:41,  3.33it/s]
  6%|▋         | 23347/371472 [1:51:30<28:41:54,  3.37it/s]
  6%|▋         | 23348/371472 [1:51:30<28:29:34,  3.39it/s]
  6%|▋         | 23349/371472 [1:51:30<27:44:48,  3.49it/s]
  6%|▋         | 23350/371472 [1:51:30<26:38:25,  3.63it/s]
  6%|▋         | 23351/371472 [1:51:31<27:22:01,  3.53it/s]
  6%|▋         | 23352/371472 [1:51:31<26:51:12,  3.60it/s]
  6%|▋         | 23353/371472 [1:51:31<27:11:23,  3.56it/s]
  6%|▋         | 23354/371472 [1:51:32<27:16:35,  3.55it/s]
  6%|▋         | 23355/371472 [1:51:32<29:06:33,  3.32it/s]
  6%|▋         | 23356/371472 [1:51:32<29:25:56,  3.29it/s]
  6%|▋         | 23357/371472 [1:51:33<29:04:39,  3.33it/s]
  6%|▋         | 23358/371472 [1:51:33<30:30:59,  3.17it/s]
  6%|▋         | 23359/371472 [1:51:33<31:53:45,  3.03it/s]
  6%|▋         | 23360/371472 [1:51:34<31:08:43,  3.10it/s]
                                                           
{'loss': 4.5879, 'learning_rate': 9.438578723954406e-07, 'epoch': 1.01}

  6%|▋         | 23360/371472 [1:51:34<31:08:43,  3.10it/s]
  6%|▋         | 23361/371472 [1:51:34<29:25:58,  3.29it/s]
  6%|▋         | 23362/371472 [1:51:34<29:58:27,  3.23it/s]
  6%|▋         | 23363/371472 [1:51:34<29:04:28,  3.33it/s]
  6%|▋         | 23364/371472 [1:51:35<29:05:15,  3.32it/s]
  6%|▋         | 23365/371472 [1:51:35<27:53:01,  3.47it/s]
  6%|▋         | 23366/371472 [1:51:35<27:40:15,  3.49it/s]
  6%|▋         | 23367/371472 [1:51:36<27:53:48,  3.47it/s]
  6%|▋         | 23368/371472 [1:51:36<27:51:36,  3.47it/s]
  6%|▋         | 23369/371472 [1:51:36<27:31:02,  3.51it/s]
  6%|▋         | 23370/371472 [1:51:36<26:40:35,  3.62it/s]
  6%|▋         | 23371/371472 [1:51:37<26:10:00,  3.70it/s]
  6%|▋         | 23372/371472 [1:51:37<26:55:10,  3.59it/s]
  6%|▋         | 23373/371472 [1:51:37<27:38:55,  3.50it/s]
  6%|▋         | 23374/371472 [1:51:37<27:52:19,  3.47it/s]
  6%|▋         | 23375/371472 [1:51:38<27:53:07,  3.47it/s]
  6%|▋         | 23376/371472 [1:51:38<30:11:30,  3.20it/s]
  6%|▋         | 23377/371472 [1:51:39<31:49:52,  3.04it/s]
  6%|▋         | 23378/371472 [1:51:39<31:07:06,  3.11it/s]
  6%|▋         | 23379/371472 [1:51:39<29:59:06,  3.22it/s]
  6%|▋         | 23380/371472 [1:51:39<31:23:50,  3.08it/s]
                                                           
{'loss': 4.5573, 'learning_rate': 9.438093904199616e-07, 'epoch': 1.01}

  6%|▋         | 23380/371472 [1:51:39<31:23:50,  3.08it/s]
  6%|▋         | 23381/371472 [1:51:40<34:11:23,  2.83it/s]
  6%|▋         | 23382/371472 [1:51:40<32:09:28,  3.01it/s]
  6%|▋         | 23383/371472 [1:51:41<32:10:31,  3.01it/s]
  6%|▋         | 23384/371472 [1:51:41<32:20:58,  2.99it/s]
  6%|▋         | 23385/371472 [1:51:41<30:20:20,  3.19it/s]
  6%|▋         | 23386/371472 [1:51:41<29:50:08,  3.24it/s]
  6%|▋         | 23387/371472 [1:51:42<28:42:08,  3.37it/s]
  6%|▋         | 23388/371472 [1:51:42<28:13:19,  3.43it/s]
  6%|▋         | 23389/371472 [1:51:42<29:24:29,  3.29it/s]
  6%|▋         | 23390/371472 [1:51:43<27:48:29,  3.48it/s]
  6%|▋         | 23391/371472 [1:51:43<27:26:01,  3.52it/s]
  6%|▋         | 23392/371472 [1:51:43<26:57:58,  3.59it/s]
  6%|▋         | 23393/371472 [1:51:43<26:46:00,  3.61it/s]
  6%|▋         | 23394/371472 [1:51:44<27:48:25,  3.48it/s]
  6%|▋         | 23395/371472 [1:51:44<27:19:09,  3.54it/s]
  6%|▋         | 23396/371472 [1:51:44<27:54:02,  3.47it/s]
  6%|▋         | 23397/371472 [1:51:45<27:26:33,  3.52it/s]
  6%|▋         | 23398/371472 [1:51:45<28:20:51,  3.41it/s]
  6%|▋         | 23399/371472 [1:51:45<27:52:23,  3.47it/s]
  6%|▋         | 23400/371472 [1:51:45<26:56:58,  3.59it/s]
                                                           
{'loss': 4.6482, 'learning_rate': 9.437609084444828e-07, 'epoch': 1.01}

  6%|▋         | 23400/371472 [1:51:45<26:56:58,  3.59it/s]
  6%|▋         | 23401/371472 [1:51:46<27:56:41,  3.46it/s]
  6%|▋         | 23402/371472 [1:51:46<27:39:37,  3.50it/s]
  6%|▋         | 23403/371472 [1:51:46<27:55:38,  3.46it/s]
  6%|▋         | 23404/371472 [1:51:47<28:47:50,  3.36it/s]
  6%|▋         | 23405/371472 [1:51:47<28:50:52,  3.35it/s]
  6%|▋         | 23406/371472 [1:51:47<27:15:59,  3.55it/s]
  6%|▋         | 23407/371472 [1:51:47<26:17:24,  3.68it/s]
  6%|▋         | 23408/371472 [1:51:48<27:12:58,  3.55it/s]
  6%|▋         | 23409/371472 [1:51:48<27:05:48,  3.57it/s]
  6%|▋         | 23410/371472 [1:51:48<28:32:53,  3.39it/s]
  6%|▋         | 23411/371472 [1:51:49<28:43:19,  3.37it/s]
  6%|▋         | 23412/371472 [1:51:49<27:44:14,  3.49it/s]
  6%|▋         | 23413/371472 [1:51:49<26:52:47,  3.60it/s]
  6%|▋         | 23414/371472 [1:51:49<26:28:14,  3.65it/s]
  6%|▋         | 23415/371472 [1:51:50<27:18:32,  3.54it/s]
  6%|▋         | 23416/371472 [1:51:50<26:01:57,  3.71it/s]
  6%|▋         | 23417/371472 [1:51:50<25:44:07,  3.76it/s]
  6%|▋         | 23418/371472 [1:51:50<27:42:45,  3.49it/s]
  6%|▋         | 23419/371472 [1:51:51<28:57:27,  3.34it/s]
  6%|▋         | 23420/371472 [1:51:51<28:34:27,  3.38it/s]
                                                           
{'loss': 4.4084, 'learning_rate': 9.437124264690038e-07, 'epoch': 1.01}

  6%|▋         | 23420/371472 [1:51:51<28:34:27,  3.38it/s]
  6%|▋         | 23421/371472 [1:51:51<29:46:46,  3.25it/s]
  6%|▋         | 23422/371472 [1:51:52<29:16:39,  3.30it/s]
  6%|▋         | 23423/371472 [1:51:52<28:56:36,  3.34it/s]
  6%|▋         | 23424/371472 [1:51:52<29:04:52,  3.32it/s]
  6%|▋         | 23425/371472 [1:51:53<29:05:00,  3.32it/s]
  6%|▋         | 23426/371472 [1:51:53<27:44:06,  3.49it/s]
  6%|▋         | 23427/371472 [1:51:53<27:21:19,  3.53it/s]
  6%|▋         | 23428/371472 [1:51:53<27:31:04,  3.51it/s]
  6%|▋         | 23429/371472 [1:51:54<26:55:55,  3.59it/s]
  6%|▋         | 23430/371472 [1:51:54<26:29:59,  3.65it/s]
  6%|▋         | 23431/371472 [1:51:54<26:34:37,  3.64it/s]
  6%|▋         | 23432/371472 [1:51:55<26:43:04,  3.62it/s]
  6%|▋         | 23433/371472 [1:51:55<27:00:20,  3.58it/s]
  6%|▋         | 23434/371472 [1:51:55<26:10:37,  3.69it/s]
  6%|▋         | 23435/371472 [1:51:55<25:58:53,  3.72it/s]
  6%|▋         | 23436/371472 [1:51:56<27:08:37,  3.56it/s]
  6%|▋         | 23437/371472 [1:51:56<26:15:03,  3.68it/s]
  6%|▋         | 23438/371472 [1:51:56<26:02:03,  3.71it/s]
  6%|▋         | 23439/371472 [1:51:56<25:50:04,  3.74it/s]
  6%|▋         | 23440/371472 [1:51:57<25:16:59,  3.82it/s]
                                                           
{'loss': 4.4637, 'learning_rate': 9.436639444935248e-07, 'epoch': 1.01}

  6%|▋         | 23440/371472 [1:51:57<25:16:59,  3.82it/s]
  6%|▋         | 23441/371472 [1:51:57<25:23:04,  3.81it/s]
  6%|▋         | 23442/371472 [1:51:57<25:36:56,  3.77it/s]
  6%|▋         | 23443/371472 [1:51:58<27:06:11,  3.57it/s]
  6%|▋         | 23444/371472 [1:51:58<27:15:26,  3.55it/s]
  6%|▋         | 23445/371472 [1:51:58<27:54:44,  3.46it/s]
  6%|▋         | 23446/371472 [1:51:58<28:38:36,  3.38it/s]
  6%|▋         | 23447/371472 [1:51:59<27:31:14,  3.51it/s]
  6%|▋         | 23448/371472 [1:51:59<26:38:09,  3.63it/s]
  6%|▋         | 23449/371472 [1:51:59<26:47:10,  3.61it/s]
  6%|▋         | 23450/371472 [1:51:59<26:24:42,  3.66it/s]
  6%|▋         | 23451/371472 [1:52:00<27:10:10,  3.56it/s]
  6%|▋         | 23452/371472 [1:52:00<28:53:38,  3.35it/s]
  6%|▋         | 23453/371472 [1:52:00<27:24:32,  3.53it/s]
  6%|▋         | 23454/371472 [1:52:01<26:44:20,  3.62it/s]
  6%|▋         | 23455/371472 [1:52:01<27:31:51,  3.51it/s]
  6%|▋         | 23456/371472 [1:52:01<30:25:26,  3.18it/s]
  6%|▋         | 23457/371472 [1:52:02<30:33:34,  3.16it/s]
  6%|▋         | 23458/371472 [1:52:02<29:15:54,  3.30it/s]
  6%|▋         | 23459/371472 [1:52:02<28:03:12,  3.45it/s]
  6%|▋         | 23460/371472 [1:52:02<27:43:35,  3.49it/s]
                                                           
{'loss': 4.5866, 'learning_rate': 9.43615462518046e-07, 'epoch': 1.01}

  6%|▋         | 23460/371472 [1:52:02<27:43:35,  3.49it/s]
  6%|▋         | 23461/371472 [1:52:03<27:13:56,  3.55it/s]
  6%|▋         | 23462/371472 [1:52:03<27:11:25,  3.56it/s]
  6%|▋         | 23463/371472 [1:52:03<26:22:17,  3.67it/s]
  6%|▋         | 23464/371472 [1:52:03<25:32:22,  3.79it/s]
  6%|▋         | 23465/371472 [1:52:04<25:01:44,  3.86it/s]
  6%|▋         | 23466/371472 [1:52:04<26:38:47,  3.63it/s]
  6%|▋         | 23467/371472 [1:52:04<25:50:25,  3.74it/s]
  6%|▋         | 23468/371472 [1:52:05<26:04:58,  3.71it/s]
  6%|▋         | 23469/371472 [1:52:05<25:35:21,  3.78it/s]
  6%|▋         | 23470/371472 [1:52:05<27:32:52,  3.51it/s]
  6%|▋         | 23471/371472 [1:52:05<28:06:37,  3.44it/s]
  6%|▋         | 23472/371472 [1:52:06<28:06:15,  3.44it/s]
  6%|▋         | 23473/371472 [1:52:06<27:02:16,  3.58it/s]
  6%|▋         | 23474/371472 [1:52:06<27:32:34,  3.51it/s]
  6%|▋         | 23475/371472 [1:52:07<29:28:43,  3.28it/s]
  6%|▋         | 23476/371472 [1:52:07<28:38:16,  3.38it/s]
  6%|▋         | 23477/371472 [1:52:07<27:08:34,  3.56it/s]
  6%|▋         | 23478/371472 [1:52:07<27:53:02,  3.47it/s]
  6%|▋         | 23479/371472 [1:52:08<27:42:25,  3.49it/s]
  6%|▋         | 23480/371472 [1:52:08<27:14:50,  3.55it/s]
                                                           
{'loss': 4.5344, 'learning_rate': 9.435669805425671e-07, 'epoch': 1.01}

  6%|▋         | 23480/371472 [1:52:08<27:14:50,  3.55it/s]
  6%|▋         | 23481/371472 [1:52:08<27:51:09,  3.47it/s]
  6%|▋         | 23482/371472 [1:52:09<26:31:30,  3.64it/s]
  6%|▋         | 23483/371472 [1:52:09<29:07:53,  3.32it/s]
  6%|▋         | 23484/371472 [1:52:09<28:15:20,  3.42it/s]
  6%|▋         | 23485/371472 [1:52:09<27:26:39,  3.52it/s]
  6%|▋         | 23486/371472 [1:52:10<27:36:20,  3.50it/s]
  6%|▋         | 23487/371472 [1:52:10<28:01:55,  3.45it/s]
  6%|▋         | 23488/371472 [1:52:10<27:58:58,  3.45it/s]
  6%|▋         | 23489/371472 [1:52:11<27:45:25,  3.48it/s]
  6%|▋         | 23490/371472 [1:52:11<32:19:09,  2.99it/s]
  6%|▋         | 23491/371472 [1:52:11<30:38:35,  3.15it/s]
  6%|▋         | 23492/371472 [1:52:12<30:33:26,  3.16it/s]
  6%|▋         | 23493/371472 [1:52:12<29:43:47,  3.25it/s]
  6%|▋         | 23494/371472 [1:52:12<29:04:06,  3.33it/s]
  6%|▋         | 23495/371472 [1:52:13<28:48:49,  3.35it/s]
  6%|▋         | 23496/371472 [1:52:13<27:44:08,  3.49it/s]
  6%|▋         | 23497/371472 [1:52:13<28:16:11,  3.42it/s]
  6%|▋         | 23498/371472 [1:52:13<28:04:03,  3.44it/s]
  6%|▋         | 23499/371472 [1:52:14<28:07:55,  3.44it/s]
  6%|▋         | 23500/371472 [1:52:14<26:47:27,  3.61it/s]
                                                           
{'loss': 4.4895, 'learning_rate': 9.435184985670883e-07, 'epoch': 1.01}

  6%|▋         | 23500/371472 [1:52:14<26:47:27,  3.61it/s]
  6%|▋         | 23501/371472 [1:52:14<26:51:45,  3.60it/s]
  6%|▋         | 23502/371472 [1:52:14<26:16:03,  3.68it/s]
  6%|▋         | 23503/371472 [1:52:15<26:33:36,  3.64it/s]
  6%|▋         | 23504/371472 [1:52:15<26:47:07,  3.61it/s]
  6%|▋         | 23505/371472 [1:52:15<27:15:45,  3.55it/s]
  6%|▋         | 23506/371472 [1:52:16<28:26:13,  3.40it/s]
  6%|▋         | 23507/371472 [1:52:16<28:10:22,  3.43it/s]
  6%|▋         | 23508/371472 [1:52:16<29:13:15,  3.31it/s]
  6%|▋         | 23509/371472 [1:52:17<28:12:06,  3.43it/s]
  6%|▋         | 23510/371472 [1:52:17<28:06:47,  3.44it/s]
  6%|▋         | 23511/371472 [1:52:17<26:48:00,  3.61it/s]
  6%|▋         | 23512/371472 [1:52:17<28:26:18,  3.40it/s]
  6%|▋         | 23513/371472 [1:52:18<28:04:39,  3.44it/s]
  6%|▋         | 23514/371472 [1:52:18<30:22:42,  3.18it/s]
  6%|▋         | 23515/371472 [1:52:18<32:02:07,  3.02it/s]
  6%|▋         | 23516/371472 [1:52:19<31:48:31,  3.04it/s]
  6%|▋         | 23517/371472 [1:52:19<31:14:22,  3.09it/s]
  6%|▋         | 23518/371472 [1:52:19<29:59:15,  3.22it/s]
  6%|▋         | 23519/371472 [1:52:20<29:56:18,  3.23it/s]
  6%|▋         | 23520/371472 [1:52:20<29:30:51,  3.27it/s]
                                                           
{'loss': 4.4187, 'learning_rate': 9.434700165916093e-07, 'epoch': 1.01}

  6%|▋         | 23520/371472 [1:52:20<29:30:51,  3.27it/s]
  6%|▋         | 23521/371472 [1:52:20<28:30:36,  3.39it/s]
  6%|▋         | 23522/371472 [1:52:21<28:49:36,  3.35it/s]
  6%|▋         | 23523/371472 [1:52:21<28:20:39,  3.41it/s]
  6%|▋         | 23524/371472 [1:52:21<27:57:26,  3.46it/s]
  6%|▋         | 23525/371472 [1:52:21<29:37:46,  3.26it/s]
  6%|▋         | 23526/371472 [1:52:22<28:53:02,  3.35it/s]
  6%|▋         | 23527/371472 [1:52:22<28:02:32,  3.45it/s]
  6%|▋         | 23528/371472 [1:52:22<27:11:36,  3.55it/s]
  6%|▋         | 23529/371472 [1:52:23<30:32:55,  3.16it/s]
  6%|▋         | 23530/371472 [1:52:23<32:02:08,  3.02it/s]
  6%|▋         | 23531/371472 [1:52:23<30:21:59,  3.18it/s]
  6%|▋         | 23532/371472 [1:52:24<29:20:57,  3.29it/s]
  6%|▋         | 23533/371472 [1:52:24<29:21:31,  3.29it/s]
  6%|▋         | 23534/371472 [1:52:24<28:58:21,  3.34it/s]
  6%|▋         | 23535/371472 [1:52:24<28:40:44,  3.37it/s]
  6%|▋         | 23536/371472 [1:52:25<30:07:35,  3.21it/s]
  6%|▋         | 23537/371472 [1:52:25<29:02:18,  3.33it/s]
  6%|▋         | 23538/371472 [1:52:25<28:48:07,  3.36it/s]
  6%|▋         | 23539/371472 [1:52:26<27:39:29,  3.49it/s]
  6%|▋         | 23540/371472 [1:52:26<29:25:15,  3.28it/s]
                                                           
{'loss': 4.5773, 'learning_rate': 9.434215346161305e-07, 'epoch': 1.01}

  6%|▋         | 23540/371472 [1:52:26<29:25:15,  3.28it/s]
  6%|▋         | 23541/371472 [1:52:26<29:19:51,  3.30it/s]
  6%|▋         | 23542/371472 [1:52:27<29:31:47,  3.27it/s]
  6%|▋         | 23543/371472 [1:52:27<29:17:56,  3.30it/s]
  6%|▋         | 23544/371472 [1:52:27<28:03:19,  3.44it/s]
  6%|▋         | 23545/371472 [1:52:27<28:03:27,  3.44it/s]
  6%|▋         | 23546/371472 [1:52:28<27:08:13,  3.56it/s]
  6%|▋         | 23547/371472 [1:52:28<27:19:30,  3.54it/s]
  6%|▋         | 23548/371472 [1:52:28<28:15:13,  3.42it/s]
  6%|▋         | 23549/371472 [1:52:29<28:05:43,  3.44it/s]
  6%|▋         | 23550/371472 [1:52:29<33:02:47,  2.92it/s]
  6%|▋         | 23551/371472 [1:52:29<32:44:08,  2.95it/s]
  6%|▋         | 23552/371472 [1:52:30<30:25:40,  3.18it/s]
  6%|▋         | 23553/371472 [1:52:30<31:15:29,  3.09it/s]
  6%|▋         | 23554/371472 [1:52:30<32:26:21,  2.98it/s]
  6%|▋         | 23555/371472 [1:52:31<31:02:44,  3.11it/s]
  6%|▋         | 23556/371472 [1:52:31<29:25:26,  3.28it/s]
  6%|▋         | 23557/371472 [1:52:31<31:26:28,  3.07it/s]
  6%|▋         | 23558/371472 [1:52:32<30:26:36,  3.17it/s]
  6%|▋         | 23559/371472 [1:52:32<29:06:23,  3.32it/s]
  6%|▋         | 23560/371472 [1:52:32<28:08:56,  3.43it/s]
                                                           
{'loss': 4.7074, 'learning_rate': 9.433730526406515e-07, 'epoch': 1.01}

  6%|▋         | 23560/371472 [1:52:32<28:08:56,  3.43it/s]
  6%|▋         | 23561/371472 [1:52:32<29:43:42,  3.25it/s]
  6%|▋         | 23562/371472 [1:52:33<29:14:34,  3.30it/s]
  6%|▋         | 23563/371472 [1:52:33<29:21:06,  3.29it/s]
  6%|▋         | 23564/371472 [1:52:33<29:07:31,  3.32it/s]
  6%|▋         | 23565/371472 [1:52:34<27:48:32,  3.48it/s]
  6%|▋         | 23566/371472 [1:52:34<27:59:33,  3.45it/s]
  6%|▋         | 23567/371472 [1:52:34<28:20:41,  3.41it/s]
  6%|▋         | 23568/371472 [1:52:34<27:35:26,  3.50it/s]
  6%|▋         | 23569/371472 [1:52:35<27:21:22,  3.53it/s]
  6%|▋         | 23570/371472 [1:52:35<27:43:39,  3.49it/s]
  6%|▋         | 23571/371472 [1:52:35<28:57:24,  3.34it/s]
  6%|▋         | 23572/371472 [1:52:36<28:45:09,  3.36it/s]
  6%|▋         | 23573/371472 [1:52:36<27:56:54,  3.46it/s]
  6%|▋         | 23574/371472 [1:52:36<27:07:44,  3.56it/s]
  6%|▋         | 23575/371472 [1:52:37<31:37:02,  3.06it/s]
  6%|▋         | 23576/371472 [1:52:37<29:23:25,  3.29it/s]
  6%|▋         | 23577/371472 [1:52:37<28:44:36,  3.36it/s]
  6%|▋         | 23578/371472 [1:52:37<28:07:09,  3.44it/s]
  6%|▋         | 23579/371472 [1:52:38<28:00:19,  3.45it/s]
  6%|▋         | 23580/371472 [1:52:38<28:06:18,  3.44it/s]
                                                           
{'loss': 4.5204, 'learning_rate': 9.433245706651727e-07, 'epoch': 1.02}

  6%|▋         | 23580/371472 [1:52:38<28:06:18,  3.44it/s]
  6%|▋         | 23581/371472 [1:52:38<29:46:32,  3.25it/s]
  6%|▋         | 23582/371472 [1:52:39<29:55:10,  3.23it/s]
  6%|▋         | 23583/371472 [1:52:39<28:13:46,  3.42it/s]
  6%|▋         | 23584/371472 [1:52:39<30:55:41,  3.12it/s]
  6%|▋         | 23585/371472 [1:52:40<32:23:12,  2.98it/s]
  6%|▋         | 23586/371472 [1:52:40<31:02:16,  3.11it/s]
  6%|▋         | 23587/371472 [1:52:40<29:33:14,  3.27it/s]
  6%|▋         | 23588/371472 [1:52:41<29:58:13,  3.22it/s]
  6%|▋         | 23589/371472 [1:52:41<28:10:25,  3.43it/s]
  6%|▋         | 23590/371472 [1:52:41<27:12:23,  3.55it/s]
  6%|▋         | 23591/371472 [1:52:41<27:12:25,  3.55it/s]
  6%|▋         | 23592/371472 [1:52:42<27:54:40,  3.46it/s]
  6%|▋         | 23593/371472 [1:52:42<29:33:47,  3.27it/s]
  6%|▋         | 23594/371472 [1:52:42<29:18:04,  3.30it/s]
  6%|▋         | 23595/371472 [1:52:43<31:14:40,  3.09it/s]
  6%|▋         | 23596/371472 [1:52:43<31:02:42,  3.11it/s]
  6%|▋         | 23597/371472 [1:52:43<30:05:39,  3.21it/s]
  6%|▋         | 23598/371472 [1:52:44<30:19:04,  3.19it/s]
  6%|▋         | 23599/371472 [1:52:44<30:07:24,  3.21it/s]
  6%|▋         | 23600/371472 [1:52:44<28:58:44,  3.33it/s]
                                                           
{'loss': 4.3078, 'learning_rate': 9.432760886896937e-07, 'epoch': 1.02}

  6%|▋         | 23600/371472 [1:52:44<28:58:44,  3.33it/s]
  6%|▋         | 23601/371472 [1:52:44<29:31:25,  3.27it/s]
  6%|▋         | 23602/371472 [1:52:45<29:17:25,  3.30it/s]
  6%|▋         | 23603/371472 [1:52:45<29:04:36,  3.32it/s]
  6%|▋         | 23604/371472 [1:52:45<27:40:20,  3.49it/s]
  6%|▋         | 23605/371472 [1:52:46<28:49:49,  3.35it/s]
  6%|▋         | 23606/371472 [1:52:46<29:16:34,  3.30it/s]
  6%|▋         | 23607/371472 [1:52:46<28:09:31,  3.43it/s]
  6%|▋         | 23608/371472 [1:52:47<29:30:20,  3.27it/s]
  6%|▋         | 23609/371472 [1:52:47<30:16:33,  3.19it/s]
  6%|▋         | 23610/371472 [1:52:47<28:57:20,  3.34it/s]
  6%|▋         | 23611/371472 [1:52:47<28:19:27,  3.41it/s]
  6%|▋         | 23612/371472 [1:52:48<28:10:51,  3.43it/s]
  6%|▋         | 23613/371472 [1:52:48<28:19:20,  3.41it/s]
  6%|▋         | 23614/371472 [1:52:48<29:36:42,  3.26it/s]
  6%|▋         | 23615/371472 [1:52:49<28:52:59,  3.35it/s]
  6%|▋         | 23616/371472 [1:52:49<27:59:10,  3.45it/s]
  6%|▋         | 23617/371472 [1:52:49<27:19:55,  3.54it/s]
  6%|▋         | 23618/371472 [1:52:49<28:08:15,  3.43it/s]
  6%|▋         | 23619/371472 [1:52:50<30:04:37,  3.21it/s]
  6%|▋         | 23620/371472 [1:52:50<29:57:04,  3.23it/s]
                                                           
{'loss': 4.3662, 'learning_rate': 9.432276067142149e-07, 'epoch': 1.02}

  6%|▋         | 23620/371472 [1:52:50<29:57:04,  3.23it/s]
  6%|▋         | 23621/371472 [1:52:50<29:59:08,  3.22it/s]
  6%|▋         | 23622/371472 [1:52:51<28:01:11,  3.45it/s]
  6%|▋         | 23623/371472 [1:52:51<27:07:58,  3.56it/s]
  6%|▋         | 23624/371472 [1:52:51<26:30:46,  3.64it/s]
  6%|▋         | 23625/371472 [1:52:52<27:02:00,  3.57it/s]
  6%|▋         | 23626/371472 [1:52:52<28:12:43,  3.42it/s]
  6%|▋         | 23627/371472 [1:52:52<26:48:47,  3.60it/s]
  6%|▋         | 23628/371472 [1:52:52<27:24:03,  3.53it/s]
  6%|▋         | 23629/371472 [1:52:53<27:02:56,  3.57it/s]
  6%|▋         | 23630/371472 [1:52:53<28:06:40,  3.44it/s]
  6%|▋         | 23631/371472 [1:52:53<27:40:49,  3.49it/s]
  6%|▋         | 23632/371472 [1:52:53<26:57:15,  3.58it/s]
  6%|▋         | 23633/371472 [1:52:54<28:45:26,  3.36it/s]
  6%|▋         | 23634/371472 [1:52:54<28:29:19,  3.39it/s]
  6%|▋         | 23635/371472 [1:52:54<27:16:57,  3.54it/s]
  6%|▋         | 23636/371472 [1:52:55<27:37:06,  3.50it/s]
  6%|▋         | 23637/371472 [1:52:55<27:50:38,  3.47it/s]
  6%|▋         | 23638/371472 [1:52:55<28:23:12,  3.40it/s]
  6%|▋         | 23639/371472 [1:52:56<30:14:05,  3.20it/s]
  6%|▋         | 23640/371472 [1:52:56<33:42:58,  2.87it/s]
                                                           
{'loss': 4.4802, 'learning_rate': 9.43179124738736e-07, 'epoch': 1.02}

  6%|▋         | 23640/371472 [1:52:56<33:42:58,  2.87it/s]
  6%|▋         | 23641/371472 [1:52:56<32:17:04,  2.99it/s]
  6%|▋         | 23642/371472 [1:52:57<30:07:26,  3.21it/s]
  6%|▋         | 23643/371472 [1:52:57<32:07:45,  3.01it/s]
  6%|▋         | 23644/371472 [1:52:57<29:36:30,  3.26it/s]
  6%|▋         | 23645/371472 [1:52:58<28:32:20,  3.39it/s]
  6%|▋         | 23646/371472 [1:52:58<27:38:14,  3.50it/s]
  6%|▋         | 23647/371472 [1:52:58<27:44:00,  3.48it/s]
  6%|▋         | 23648/371472 [1:52:58<28:09:19,  3.43it/s]
  6%|▋         | 23649/371472 [1:52:59<27:43:24,  3.49it/s]
  6%|▋         | 23650/371472 [1:52:59<27:15:00,  3.55it/s]
  6%|▋         | 23651/371472 [1:52:59<28:04:46,  3.44it/s]
  6%|▋         | 23652/371472 [1:53:00<29:41:03,  3.25it/s]
  6%|▋         | 23653/371472 [1:53:00<30:12:10,  3.20it/s]
  6%|▋         | 23654/371472 [1:53:00<29:05:40,  3.32it/s]
  6%|▋         | 23655/371472 [1:53:00<29:14:27,  3.30it/s]
  6%|▋         | 23656/371472 [1:53:01<28:17:44,  3.41it/s]
  6%|▋         | 23657/371472 [1:53:01<29:34:54,  3.27it/s]
  6%|▋         | 23658/371472 [1:53:01<29:22:39,  3.29it/s]
  6%|▋         | 23659/371472 [1:53:02<28:47:08,  3.36it/s]
  6%|▋         | 23660/371472 [1:53:02<29:18:10,  3.30it/s]
                                                           
{'loss': 4.5543, 'learning_rate': 9.431306427632572e-07, 'epoch': 1.02}

  6%|▋         | 23660/371472 [1:53:02<29:18:10,  3.30it/s]
  6%|▋         | 23661/371472 [1:53:02<28:51:28,  3.35it/s]
  6%|▋         | 23662/371472 [1:53:03<27:31:47,  3.51it/s]
  6%|▋         | 23663/371472 [1:53:03<26:43:43,  3.61it/s]
  6%|▋         | 23664/371472 [1:53:03<26:00:12,  3.72it/s]
  6%|▋         | 23665/371472 [1:53:03<27:33:42,  3.51it/s]
  6%|▋         | 23666/371472 [1:53:04<27:36:57,  3.50it/s]
  6%|▋         | 23667/371472 [1:53:04<28:52:14,  3.35it/s]
  6%|▋         | 23668/371472 [1:53:04<27:44:35,  3.48it/s]
  6%|▋         | 23669/371472 [1:53:05<27:37:51,  3.50it/s]
  6%|▋         | 23670/371472 [1:53:05<30:30:26,  3.17it/s]
  6%|▋         | 23671/371472 [1:53:05<28:18:33,  3.41it/s]
  6%|▋         | 23672/371472 [1:53:05<28:20:25,  3.41it/s]
  6%|▋         | 23673/371472 [1:53:06<28:12:57,  3.42it/s]
  6%|▋         | 23674/371472 [1:53:06<28:20:08,  3.41it/s]
  6%|▋         | 23675/371472 [1:53:06<27:27:29,  3.52it/s]
  6%|▋         | 23676/371472 [1:53:07<26:55:04,  3.59it/s]
  6%|▋         | 23677/371472 [1:53:07<26:12:00,  3.69it/s]
  6%|▋         | 23678/371472 [1:53:07<26:30:18,  3.64it/s]
  6%|▋         | 23679/371472 [1:53:07<26:03:08,  3.71it/s]
  6%|▋         | 23680/371472 [1:53:08<28:07:16,  3.44it/s]
                                                           
{'loss': 4.5778, 'learning_rate': 9.430821607877781e-07, 'epoch': 1.02}

  6%|▋         | 23680/371472 [1:53:08<28:07:16,  3.44it/s]
  6%|▋         | 23681/371472 [1:53:08<29:12:08,  3.31it/s]
  6%|▋         | 23682/371472 [1:53:08<29:34:52,  3.27it/s]
  6%|▋         | 23683/371472 [1:53:09<28:20:27,  3.41it/s]
  6%|▋         | 23684/371472 [1:53:09<28:00:49,  3.45it/s]
  6%|▋         | 23685/371472 [1:53:09<27:05:28,  3.57it/s]
  6%|▋         | 23686/371472 [1:53:09<26:46:34,  3.61it/s]
  6%|▋         | 23687/371472 [1:53:10<28:23:01,  3.40it/s]
  6%|▋         | 23688/371472 [1:53:10<28:33:16,  3.38it/s]
  6%|▋         | 23689/371472 [1:53:10<30:00:58,  3.22it/s]
  6%|▋         | 23690/371472 [1:53:11<30:30:38,  3.17it/s]
  6%|▋         | 23691/371472 [1:53:11<29:57:34,  3.22it/s]
  6%|▋         | 23692/371472 [1:53:11<28:48:55,  3.35it/s]
  6%|▋         | 23693/371472 [1:53:12<28:32:22,  3.38it/s]
  6%|▋         | 23694/371472 [1:53:12<27:37:33,  3.50it/s]
  6%|▋         | 23695/371472 [1:53:12<28:41:00,  3.37it/s]
  6%|▋         | 23696/371472 [1:53:12<29:08:08,  3.32it/s]
  6%|▋         | 23697/371472 [1:53:13<27:59:10,  3.45it/s]
  6%|▋         | 23698/371472 [1:53:13<27:53:43,  3.46it/s]
  6%|▋         | 23699/371472 [1:53:13<27:28:43,  3.52it/s]
  6%|▋         | 23700/371472 [1:53:14<28:34:08,  3.38it/s]
                                                           
{'loss': 4.2533, 'learning_rate': 9.430336788122993e-07, 'epoch': 1.02}

  6%|▋         | 23700/371472 [1:53:14<28:34:08,  3.38it/s]
  6%|▋         | 23701/371472 [1:53:14<28:05:01,  3.44it/s]
  6%|▋         | 23702/371472 [1:53:14<27:12:16,  3.55it/s]
  6%|▋         | 23703/371472 [1:53:14<26:54:03,  3.59it/s]
  6%|▋         | 23704/371472 [1:53:15<26:02:25,  3.71it/s]
  6%|▋         | 23705/371472 [1:53:15<27:10:17,  3.56it/s]
  6%|▋         | 23706/371472 [1:53:15<29:12:11,  3.31it/s]
  6%|▋         | 23707/371472 [1:53:16<30:14:00,  3.20it/s]
  6%|▋         | 23708/371472 [1:53:16<29:29:34,  3.28it/s]
  6%|▋         | 23709/371472 [1:53:16<30:26:46,  3.17it/s]
  6%|▋         | 23710/371472 [1:53:17<30:12:42,  3.20it/s]
  6%|▋         | 23711/371472 [1:53:17<32:40:14,  2.96it/s]
  6%|▋         | 23712/371472 [1:53:17<31:06:33,  3.11it/s]
  6%|▋         | 23713/371472 [1:53:18<30:20:23,  3.18it/s]
  6%|▋         | 23714/371472 [1:53:18<29:59:11,  3.22it/s]
  6%|▋         | 23715/371472 [1:53:18<28:21:43,  3.41it/s]
  6%|▋         | 23716/371472 [1:53:18<27:56:10,  3.46it/s]
  6%|▋         | 23717/371472 [1:53:19<28:21:01,  3.41it/s]
  6%|▋         | 23718/371472 [1:53:19<27:52:14,  3.47it/s]
  6%|▋         | 23719/371472 [1:53:19<28:16:17,  3.42it/s]
  6%|▋         | 23720/371472 [1:53:20<29:04:45,  3.32it/s]
                                                           
{'loss': 4.6842, 'learning_rate': 9.429851968368204e-07, 'epoch': 1.02}

  6%|▋         | 23720/371472 [1:53:20<29:04:45,  3.32it/s]
  6%|▋         | 23721/371472 [1:53:20<27:42:09,  3.49it/s]
  6%|▋         | 23722/371472 [1:53:20<27:31:17,  3.51it/s]
  6%|▋         | 23723/371472 [1:53:20<28:28:09,  3.39it/s]
  6%|▋         | 23724/371472 [1:53:21<30:21:48,  3.18it/s]
  6%|▋         | 23725/371472 [1:53:21<29:49:23,  3.24it/s]
  6%|▋         | 23726/371472 [1:53:21<29:18:11,  3.30it/s]
  6%|▋         | 23727/371472 [1:53:22<29:09:12,  3.31it/s]
  6%|▋         | 23728/371472 [1:53:22<29:44:02,  3.25it/s]
  6%|▋         | 23729/371472 [1:53:22<30:58:19,  3.12it/s]
  6%|▋         | 23730/371472 [1:53:23<29:55:52,  3.23it/s]
  6%|▋         | 23731/371472 [1:53:23<29:03:00,  3.33it/s]
  6%|▋         | 23732/371472 [1:53:23<28:20:46,  3.41it/s]
  6%|▋         | 23733/371472 [1:53:23<27:35:19,  3.50it/s]
  6%|▋         | 23734/371472 [1:53:24<28:21:32,  3.41it/s]
  6%|▋         | 23735/371472 [1:53:24<28:44:55,  3.36it/s]
  6%|▋         | 23736/371472 [1:53:24<28:43:07,  3.36it/s]
  6%|▋         | 23737/371472 [1:53:25<29:36:13,  3.26it/s]
  6%|▋         | 23738/371472 [1:53:25<28:44:21,  3.36it/s]
  6%|▋         | 23739/371472 [1:53:25<28:28:03,  3.39it/s]
  6%|▋         | 23740/371472 [1:53:26<28:49:43,  3.35it/s]
                                                           
{'loss': 4.3704, 'learning_rate': 9.429367148613415e-07, 'epoch': 1.02}

  6%|▋         | 23740/371472 [1:53:26<28:49:43,  3.35it/s]
  6%|▋         | 23741/371472 [1:53:26<27:52:07,  3.47it/s]
  6%|▋         | 23742/371472 [1:53:26<27:21:24,  3.53it/s]
  6%|▋         | 23743/371472 [1:53:26<28:09:53,  3.43it/s]
  6%|▋         | 23744/371472 [1:53:27<27:39:49,  3.49it/s]
  6%|▋         | 23745/371472 [1:53:27<27:04:08,  3.57it/s]
  6%|▋         | 23746/371472 [1:53:27<28:14:03,  3.42it/s]
  6%|▋         | 23747/371472 [1:53:28<26:57:09,  3.58it/s]
  6%|▋         | 23748/371472 [1:53:28<26:27:41,  3.65it/s]
  6%|▋         | 23749/371472 [1:53:28<25:54:52,  3.73it/s]
  6%|▋         | 23750/371472 [1:53:28<26:30:14,  3.64it/s]
  6%|▋         | 23751/371472 [1:53:29<26:11:02,  3.69it/s]
  6%|▋         | 23752/371472 [1:53:29<26:16:40,  3.68it/s]
  6%|▋         | 23753/371472 [1:53:29<26:31:51,  3.64it/s]
  6%|▋         | 23754/371472 [1:53:29<25:45:29,  3.75it/s]
  6%|▋         | 23755/371472 [1:53:30<25:52:47,  3.73it/s]
  6%|▋         | 23756/371472 [1:53:30<26:52:45,  3.59it/s]
  6%|▋         | 23757/371472 [1:53:30<28:24:43,  3.40it/s]
  6%|▋         | 23758/371472 [1:53:31<28:30:48,  3.39it/s]
  6%|▋         | 23759/371472 [1:53:31<27:53:06,  3.46it/s]
  6%|▋         | 23760/371472 [1:53:31<26:54:20,  3.59it/s]
                                                           
{'loss': 4.5711, 'learning_rate': 9.428882328858626e-07, 'epoch': 1.02}

  6%|▋         | 23760/371472 [1:53:31<26:54:20,  3.59it/s]
  6%|▋         | 23761/371472 [1:53:31<27:01:50,  3.57it/s]
  6%|▋         | 23762/371472 [1:53:32<27:17:48,  3.54it/s]
  6%|▋         | 23763/371472 [1:53:32<27:16:49,  3.54it/s]
  6%|▋         | 23764/371472 [1:53:32<28:29:53,  3.39it/s]
  6%|▋         | 23765/371472 [1:53:33<27:22:06,  3.53it/s]
  6%|▋         | 23766/371472 [1:53:33<28:08:45,  3.43it/s]
  6%|▋         | 23767/371472 [1:53:33<26:53:00,  3.59it/s]
  6%|▋         | 23768/371472 [1:53:33<26:46:24,  3.61it/s]
  6%|▋         | 23769/371472 [1:53:34<28:12:13,  3.42it/s]
  6%|▋         | 23770/371472 [1:53:34<27:37:39,  3.50it/s]
  6%|▋         | 23771/371472 [1:53:34<31:58:49,  3.02it/s]
  6%|▋         | 23772/371472 [1:53:35<29:59:22,  3.22it/s]
  6%|▋         | 23773/371472 [1:53:35<29:41:46,  3.25it/s]
  6%|▋         | 23774/371472 [1:53:35<28:16:31,  3.42it/s]
  6%|▋         | 23775/371472 [1:53:36<27:46:57,  3.48it/s]
  6%|▋         | 23776/371472 [1:53:36<28:44:27,  3.36it/s]
  6%|▋         | 23777/371472 [1:53:36<27:58:19,  3.45it/s]
  6%|▋         | 23778/371472 [1:53:36<27:46:52,  3.48it/s]
  6%|▋         | 23779/371472 [1:53:37<27:12:59,  3.55it/s]
  6%|▋         | 23780/371472 [1:53:37<29:11:45,  3.31it/s]
                                                           
{'loss': 4.7231, 'learning_rate': 9.428397509103838e-07, 'epoch': 1.02}

  6%|▋         | 23780/371472 [1:53:37<29:11:45,  3.31it/s]
  6%|▋         | 23781/371472 [1:53:37<30:11:38,  3.20it/s]
  6%|▋         | 23782/371472 [1:53:38<32:47:03,  2.95it/s]
  6%|▋         | 23783/371472 [1:53:38<30:51:54,  3.13it/s]
  6%|▋         | 23784/371472 [1:53:38<30:18:07,  3.19it/s]
  6%|▋         | 23785/371472 [1:53:39<28:31:48,  3.39it/s]
  6%|▋         | 23786/371472 [1:53:39<27:43:38,  3.48it/s]
  6%|▋         | 23787/371472 [1:53:39<27:32:18,  3.51it/s]
  6%|▋         | 23788/371472 [1:53:39<26:59:01,  3.58it/s]
  6%|▋         | 23789/371472 [1:53:40<26:13:23,  3.68it/s]
  6%|▋         | 23790/371472 [1:53:40<25:26:43,  3.80it/s]
  6%|▋         | 23791/371472 [1:53:40<25:00:21,  3.86it/s]
  6%|▋         | 23792/371472 [1:53:40<25:03:30,  3.85it/s]
  6%|▋         | 23793/371472 [1:53:41<25:59:13,  3.72it/s]
  6%|▋         | 23794/371472 [1:53:41<25:42:55,  3.76it/s]
  6%|▋         | 23795/371472 [1:53:41<25:59:28,  3.72it/s]
  6%|▋         | 23796/371472 [1:53:42<25:56:43,  3.72it/s]
  6%|▋         | 23797/371472 [1:53:42<25:37:57,  3.77it/s]
  6%|▋         | 23798/371472 [1:53:42<25:30:03,  3.79it/s]
  6%|▋         | 23799/371472 [1:53:42<25:31:51,  3.78it/s]
  6%|▋         | 23800/371472 [1:53:43<26:33:33,  3.64it/s]
                                                           
{'loss': 4.5228, 'learning_rate': 9.427912689349049e-07, 'epoch': 1.03}

  6%|▋         | 23800/371472 [1:53:43<26:33:33,  3.64it/s]
  6%|▋         | 23801/371472 [1:53:43<26:24:55,  3.66it/s]
  6%|▋         | 23802/371472 [1:53:43<25:58:35,  3.72it/s]
  6%|▋         | 23803/371472 [1:53:43<25:53:18,  3.73it/s]
  6%|▋         | 23804/371472 [1:53:44<25:26:32,  3.80it/s]
  6%|▋         | 23805/371472 [1:53:44<26:36:47,  3.63it/s]
  6%|▋         | 23806/371472 [1:53:44<26:49:03,  3.60it/s]
  6%|▋         | 23807/371472 [1:53:45<26:30:51,  3.64it/s]
  6%|▋         | 23808/371472 [1:53:45<28:16:24,  3.42it/s]
  6%|▋         | 23809/371472 [1:53:45<28:28:45,  3.39it/s]
  6%|▋         | 23810/371472 [1:53:45<28:26:36,  3.40it/s]
  6%|▋         | 23811/371472 [1:53:46<28:18:33,  3.41it/s]
  6%|▋         | 23812/371472 [1:53:46<28:27:53,  3.39it/s]
  6%|▋         | 23813/371472 [1:53:46<27:40:51,  3.49it/s]
  6%|▋         | 23814/371472 [1:53:47<27:11:31,  3.55it/s]
  6%|▋         | 23815/371472 [1:53:47<26:42:04,  3.62it/s]
  6%|▋         | 23816/371472 [1:53:47<28:02:13,  3.44it/s]
  6%|▋         | 23817/371472 [1:53:47<29:02:29,  3.33it/s]
  6%|▋         | 23818/371472 [1:53:48<31:33:25,  3.06it/s]
  6%|▋         | 23819/371472 [1:53:48<31:15:06,  3.09it/s]
  6%|▋         | 23820/371472 [1:53:48<28:49:37,  3.35it/s]
                                                           
{'loss': 4.4926, 'learning_rate': 9.427427869594258e-07, 'epoch': 1.03}

  6%|▋         | 23820/371472 [1:53:48<28:49:37,  3.35it/s]
  6%|▋         | 23821/371472 [1:53:49<29:19:10,  3.29it/s]
  6%|▋         | 23822/371472 [1:53:49<28:05:54,  3.44it/s]
  6%|▋         | 23823/371472 [1:53:49<27:07:56,  3.56it/s]
  6%|▋         | 23824/371472 [1:53:50<26:54:34,  3.59it/s]
  6%|▋         | 23825/371472 [1:53:50<26:06:13,  3.70it/s]
  6%|▋         | 23826/371472 [1:53:50<25:51:27,  3.73it/s]
  6%|▋         | 23827/371472 [1:53:50<25:28:10,  3.79it/s]
  6%|▋         | 23828/371472 [1:53:51<25:51:29,  3.73it/s]
  6%|▋         | 23829/371472 [1:53:51<27:05:34,  3.56it/s]
  6%|▋         | 23830/371472 [1:53:51<30:00:53,  3.22it/s]
  6%|▋         | 23831/371472 [1:53:52<29:07:36,  3.32it/s]
  6%|▋         | 23832/371472 [1:53:52<29:27:29,  3.28it/s]
  6%|▋         | 23833/371472 [1:53:52<30:03:21,  3.21it/s]
  6%|▋         | 23834/371472 [1:53:52<28:20:32,  3.41it/s]
  6%|▋         | 23835/371472 [1:53:53<30:56:25,  3.12it/s]
  6%|▋         | 23836/371472 [1:53:53<29:35:28,  3.26it/s]
  6%|▋         | 23837/371472 [1:53:53<28:16:58,  3.41it/s]
  6%|▋         | 23838/371472 [1:53:54<27:56:15,  3.46it/s]
  6%|▋         | 23839/371472 [1:53:54<26:49:05,  3.60it/s]
  6%|▋         | 23840/371472 [1:53:54<26:43:18,  3.61it/s]
                                                           
{'loss': 4.3109, 'learning_rate': 9.42694304983947e-07, 'epoch': 1.03}

  6%|▋         | 23840/371472 [1:53:54<26:43:18,  3.61it/s]
  6%|▋         | 23841/371472 [1:53:54<26:17:47,  3.67it/s]
  6%|▋         | 23842/371472 [1:53:55<27:10:21,  3.55it/s]
  6%|▋         | 23843/371472 [1:53:55<26:27:17,  3.65it/s]
  6%|▋         | 23844/371472 [1:53:55<27:22:16,  3.53it/s]
  6%|▋         | 23845/371472 [1:53:56<28:38:30,  3.37it/s]
  6%|▋         | 23846/371472 [1:53:56<27:06:51,  3.56it/s]
  6%|▋         | 23847/371472 [1:53:56<26:38:44,  3.62it/s]
  6%|▋         | 23848/371472 [1:53:56<26:43:44,  3.61it/s]
  6%|▋         | 23849/371472 [1:53:57<26:50:12,  3.60it/s]
  6%|▋         | 23850/371472 [1:53:57<25:55:53,  3.72it/s]
  6%|▋         | 23851/371472 [1:53:57<26:01:07,  3.71it/s]
  6%|▋         | 23852/371472 [1:53:58<26:57:39,  3.58it/s]
  6%|▋         | 23853/371472 [1:53:58<28:17:11,  3.41it/s]
  6%|▋         | 23854/371472 [1:53:58<27:25:12,  3.52it/s]
  6%|▋         | 23855/371472 [1:53:58<27:12:41,  3.55it/s]
  6%|▋         | 23856/371472 [1:53:59<26:25:53,  3.65it/s]
  6%|▋         | 23857/371472 [1:53:59<25:27:08,  3.79it/s]
  6%|▋         | 23858/371472 [1:53:59<25:50:08,  3.74it/s]
  6%|▋         | 23859/371472 [1:53:59<24:50:40,  3.89it/s]
  6%|▋         | 23860/371472 [1:54:00<25:45:26,  3.75it/s]
                                                           
{'loss': 4.5105, 'learning_rate': 9.426458230084681e-07, 'epoch': 1.03}

  6%|▋         | 23860/371472 [1:54:00<25:45:26,  3.75it/s]
  6%|▋         | 23861/371472 [1:54:00<25:39:28,  3.76it/s]
  6%|▋         | 23862/371472 [1:54:00<24:52:48,  3.88it/s]
  6%|▋         | 23863/371472 [1:54:00<26:19:32,  3.67it/s]
  6%|▋         | 23864/371472 [1:54:01<26:44:38,  3.61it/s]
  6%|▋         | 23865/371472 [1:54:01<26:30:55,  3.64it/s]
  6%|▋         | 23866/371472 [1:54:01<25:58:38,  3.72it/s]
  6%|▋         | 23867/371472 [1:54:02<27:47:33,  3.47it/s]
  6%|▋         | 23868/371472 [1:54:02<27:15:18,  3.54it/s]
  6%|▋         | 23869/371472 [1:54:02<26:24:01,  3.66it/s]
  6%|▋         | 23870/371472 [1:54:02<25:58:06,  3.72it/s]
  6%|▋         | 23871/371472 [1:54:03<25:15:37,  3.82it/s]
  6%|▋         | 23872/371472 [1:54:03<25:58:29,  3.72it/s]
  6%|▋         | 23873/371472 [1:54:03<25:48:57,  3.74it/s]
  6%|▋         | 23874/371472 [1:54:03<26:14:09,  3.68it/s]
  6%|▋         | 23875/371472 [1:54:04<27:52:59,  3.46it/s]
  6%|▋         | 23876/371472 [1:54:04<26:34:03,  3.63it/s]
  6%|▋         | 23877/371472 [1:54:04<25:55:40,  3.72it/s]
  6%|▋         | 23878/371472 [1:54:05<27:44:00,  3.48it/s]
  6%|▋         | 23879/371472 [1:54:05<27:50:12,  3.47it/s]
  6%|▋         | 23880/371472 [1:54:05<26:56:21,  3.58it/s]
                                                           
{'loss': 4.3662, 'learning_rate': 9.425973410329893e-07, 'epoch': 1.03}

  6%|▋         | 23880/371472 [1:54:05<26:56:21,  3.58it/s]
  6%|▋         | 23881/371472 [1:54:05<26:25:36,  3.65it/s]
  6%|▋         | 23882/371472 [1:54:06<27:17:15,  3.54it/s]
  6%|▋         | 23883/371472 [1:54:06<27:43:50,  3.48it/s]
  6%|▋         | 23884/371472 [1:54:06<27:01:38,  3.57it/s]
  6%|▋         | 23885/371472 [1:54:07<26:01:44,  3.71it/s]
  6%|▋         | 23886/371472 [1:54:07<26:19:29,  3.67it/s]
  6%|▋         | 23887/371472 [1:54:07<25:28:20,  3.79it/s]
  6%|▋         | 23888/371472 [1:54:07<25:27:30,  3.79it/s]
  6%|▋         | 23889/371472 [1:54:08<25:33:40,  3.78it/s]
  6%|▋         | 23890/371472 [1:54:08<25:41:48,  3.76it/s]
  6%|▋         | 23891/371472 [1:54:08<26:47:12,  3.60it/s]
  6%|▋         | 23892/371472 [1:54:08<26:24:26,  3.66it/s]
  6%|▋         | 23893/371472 [1:54:09<25:48:31,  3.74it/s]
  6%|▋         | 23894/371472 [1:54:09<25:59:40,  3.71it/s]
  6%|▋         | 23895/371472 [1:54:09<25:07:15,  3.84it/s]
  6%|▋         | 23896/371472 [1:54:09<25:30:50,  3.78it/s]
  6%|▋         | 23897/371472 [1:54:10<25:12:09,  3.83it/s]
  6%|▋         | 23898/371472 [1:54:10<27:19:32,  3.53it/s]
  6%|▋         | 23899/371472 [1:54:10<29:51:52,  3.23it/s]
  6%|▋         | 23900/371472 [1:54:11<28:28:04,  3.39it/s]
                                                           
{'loss': 4.3859, 'learning_rate': 9.425488590575104e-07, 'epoch': 1.03}

  6%|▋         | 23900/371472 [1:54:11<28:28:04,  3.39it/s]
  6%|▋         | 23901/371472 [1:54:11<28:57:07,  3.33it/s]
  6%|▋         | 23902/371472 [1:54:11<28:20:28,  3.41it/s]
  6%|▋         | 23903/371472 [1:54:12<27:52:24,  3.46it/s]
  6%|▋         | 23904/371472 [1:54:12<27:18:19,  3.54it/s]
  6%|▋         | 23905/371472 [1:54:12<26:58:46,  3.58it/s]
  6%|▋         | 23906/371472 [1:54:12<28:15:58,  3.42it/s]
  6%|▋         | 23907/371472 [1:54:13<29:24:20,  3.28it/s]
  6%|▋         | 23908/371472 [1:54:13<28:19:42,  3.41it/s]
  6%|▋         | 23909/371472 [1:54:13<28:10:56,  3.43it/s]
  6%|▋         | 23910/371472 [1:54:14<29:50:27,  3.24it/s]
  6%|▋         | 23911/371472 [1:54:14<29:03:48,  3.32it/s]
  6%|▋         | 23912/371472 [1:54:14<27:43:48,  3.48it/s]
  6%|▋         | 23913/371472 [1:54:14<26:46:42,  3.61it/s]
  6%|▋         | 23914/371472 [1:54:15<26:26:47,  3.65it/s]
  6%|▋         | 23915/371472 [1:54:15<27:47:17,  3.47it/s]
  6%|▋         | 23916/371472 [1:54:15<27:00:11,  3.58it/s]
  6%|▋         | 23917/371472 [1:54:16<27:42:17,  3.48it/s]
  6%|▋         | 23918/371472 [1:54:16<26:51:04,  3.60it/s]
  6%|▋         | 23919/371472 [1:54:16<26:08:58,  3.69it/s]
  6%|▋         | 23920/371472 [1:54:16<26:08:01,  3.69it/s]
                                                           
{'loss': 4.4111, 'learning_rate': 9.425003770820316e-07, 'epoch': 1.03}

  6%|▋         | 23920/371472 [1:54:16<26:08:01,  3.69it/s]
  6%|▋         | 23921/371472 [1:54:17<27:28:29,  3.51it/s]
  6%|▋         | 23922/371472 [1:54:17<28:36:15,  3.38it/s]
  6%|▋         | 23923/371472 [1:54:17<26:42:05,  3.62it/s]
  6%|▋         | 23924/371472 [1:54:18<26:43:54,  3.61it/s]
  6%|▋         | 23925/371472 [1:54:18<27:06:35,  3.56it/s]
  6%|▋         | 23926/371472 [1:54:18<26:22:26,  3.66it/s]
  6%|▋         | 23927/371472 [1:54:18<27:12:56,  3.55it/s]
  6%|▋         | 23928/371472 [1:54:19<26:26:13,  3.65it/s]
  6%|▋         | 23929/371472 [1:54:19<26:06:41,  3.70it/s]
  6%|▋         | 23930/371472 [1:54:19<25:29:41,  3.79it/s]
  6%|▋         | 23931/371472 [1:54:20<27:39:40,  3.49it/s]
  6%|▋         | 23932/371472 [1:54:20<30:17:55,  3.19it/s]
  6%|▋         | 23933/371472 [1:54:20<29:14:56,  3.30it/s]
  6%|▋         | 23934/371472 [1:54:20<29:02:56,  3.32it/s]
  6%|▋         | 23935/371472 [1:54:21<27:05:11,  3.56it/s]
  6%|▋         | 23936/371472 [1:54:21<26:29:55,  3.64it/s]
  6%|▋         | 23937/371472 [1:54:21<26:45:31,  3.61it/s]
  6%|▋         | 23938/371472 [1:54:22<26:47:37,  3.60it/s]
  6%|▋         | 23939/371472 [1:54:22<26:15:58,  3.68it/s]
  6%|▋         | 23940/371472 [1:54:22<27:09:16,  3.56it/s]
                                                           
{'loss': 4.253, 'learning_rate': 9.424518951065525e-07, 'epoch': 1.03}

  6%|▋         | 23940/371472 [1:54:22<27:09:16,  3.56it/s]
  6%|▋         | 23941/371472 [1:54:22<26:27:49,  3.65it/s]
  6%|▋         | 23942/371472 [1:54:23<29:11:16,  3.31it/s]
  6%|▋         | 23943/371472 [1:54:23<28:15:26,  3.42it/s]
  6%|▋         | 23944/371472 [1:54:23<28:08:56,  3.43it/s]
  6%|▋         | 23945/371472 [1:54:24<27:22:57,  3.53it/s]
  6%|▋         | 23946/371472 [1:54:24<29:35:49,  3.26it/s]
  6%|▋         | 23947/371472 [1:54:24<30:35:45,  3.16it/s]
  6%|▋         | 23948/371472 [1:54:25<29:38:00,  3.26it/s]
  6%|▋         | 23949/371472 [1:54:25<30:01:58,  3.21it/s]
  6%|▋         | 23950/371472 [1:54:25<28:20:46,  3.41it/s]
  6%|▋         | 23951/371472 [1:54:25<27:50:04,  3.47it/s]
  6%|▋         | 23952/371472 [1:54:26<27:49:48,  3.47it/s]
  6%|▋         | 23953/371472 [1:54:26<28:10:23,  3.43it/s]
  6%|▋         | 23954/371472 [1:54:26<26:44:11,  3.61it/s]
  6%|▋         | 23955/371472 [1:54:26<26:39:47,  3.62it/s]
  6%|▋         | 23956/371472 [1:54:27<26:23:40,  3.66it/s]
  6%|▋         | 23957/371472 [1:54:27<25:38:58,  3.76it/s]
  6%|▋         | 23958/371472 [1:54:27<27:32:14,  3.51it/s]
  6%|▋         | 23959/371472 [1:54:28<26:48:39,  3.60it/s]
  6%|▋         | 23960/371472 [1:54:28<26:57:58,  3.58it/s]
                                                           
{'loss': 4.5461, 'learning_rate': 9.424034131310737e-07, 'epoch': 1.03}

  6%|▋         | 23960/371472 [1:54:28<26:57:58,  3.58it/s]
  6%|▋         | 23961/371472 [1:54:28<26:40:57,  3.62it/s]
  6%|▋         | 23962/371472 [1:54:28<27:16:55,  3.54it/s]
  6%|▋         | 23963/371472 [1:54:29<26:30:13,  3.64it/s]
  6%|▋         | 23964/371472 [1:54:29<27:36:00,  3.50it/s]
  6%|▋         | 23965/371472 [1:54:29<27:58:46,  3.45it/s]
  6%|▋         | 23966/371472 [1:54:30<27:03:44,  3.57it/s]
  6%|▋         | 23967/371472 [1:54:30<27:59:25,  3.45it/s]
  6%|▋         | 23968/371472 [1:54:30<27:17:22,  3.54it/s]
  6%|▋         | 23969/371472 [1:54:30<28:42:14,  3.36it/s]
  6%|▋         | 23970/371472 [1:54:31<28:28:09,  3.39it/s]
  6%|▋         | 23971/371472 [1:54:31<28:21:25,  3.40it/s]
  6%|▋         | 23972/371472 [1:54:31<26:54:42,  3.59it/s]
  6%|▋         | 23973/371472 [1:54:32<26:34:53,  3.63it/s]
  6%|▋         | 23974/371472 [1:54:32<27:05:27,  3.56it/s]
  6%|▋         | 23975/371472 [1:54:32<25:59:38,  3.71it/s]
  6%|▋         | 23976/371472 [1:54:32<26:21:19,  3.66it/s]
  6%|▋         | 23977/371472 [1:54:33<25:57:22,  3.72it/s]
  6%|▋         | 23978/371472 [1:54:33<27:13:29,  3.55it/s]
  6%|▋         | 23979/371472 [1:54:33<26:51:20,  3.59it/s]
  6%|▋         | 23980/371472 [1:54:33<26:56:56,  3.58it/s]
                                                           
{'loss': 4.4709, 'learning_rate': 9.423549311555947e-07, 'epoch': 1.03}

  6%|▋         | 23980/371472 [1:54:33<26:56:56,  3.58it/s]
  6%|▋         | 23981/371472 [1:54:34<26:40:28,  3.62it/s]
  6%|▋         | 23982/371472 [1:54:34<25:48:51,  3.74it/s]
  6%|▋         | 23983/371472 [1:54:34<25:00:14,  3.86it/s]
  6%|▋         | 23984/371472 [1:54:35<25:18:16,  3.81it/s]
  6%|▋         | 23985/371472 [1:54:35<25:17:30,  3.82it/s]
  6%|▋         | 23986/371472 [1:54:35<25:14:25,  3.82it/s]
  6%|▋         | 23987/371472 [1:54:35<25:10:07,  3.84it/s]
  6%|▋         | 23988/371472 [1:54:36<25:01:59,  3.86it/s]
  6%|▋         | 23989/371472 [1:54:36<24:39:05,  3.92it/s]
  6%|▋         | 23990/371472 [1:54:36<24:32:24,  3.93it/s]
  6%|▋         | 23991/371472 [1:54:36<26:20:28,  3.66it/s]
  6%|▋         | 23992/371472 [1:54:37<27:14:16,  3.54it/s]
  6%|▋         | 23993/371472 [1:54:37<27:41:05,  3.49it/s]
  6%|▋         | 23994/371472 [1:54:37<26:56:48,  3.58it/s]
  6%|▋         | 23995/371472 [1:54:37<25:41:44,  3.76it/s]
  6%|▋         | 23996/371472 [1:54:38<25:40:59,  3.76it/s]
  6%|▋         | 23997/371472 [1:54:38<27:36:26,  3.50it/s]
  6%|▋         | 23998/371472 [1:54:38<26:58:07,  3.58it/s]
  6%|▋         | 23999/371472 [1:54:39<26:06:35,  3.70it/s]
  6%|▋         | 24000/371472 [1:54:39<25:33:14,  3.78it/s]
                                                           
{'loss': 4.376, 'learning_rate': 9.423064491801159e-07, 'epoch': 1.03}

  6%|▋         | 24000/371472 [1:54:39<25:33:14,  3.78it/s]
  6%|▋         | 24001/371472 [1:54:39<25:23:20,  3.80it/s]
  6%|▋         | 24002/371472 [1:54:39<25:09:39,  3.84it/s]
  6%|▋         | 24003/371472 [1:54:40<27:22:24,  3.53it/s]
  6%|▋         | 24004/371472 [1:54:40<26:00:47,  3.71it/s]
  6%|▋         | 24005/371472 [1:54:40<27:13:59,  3.54it/s]
  6%|▋         | 24006/371472 [1:54:41<28:04:00,  3.44it/s]
  6%|▋         | 24007/371472 [1:54:41<27:56:16,  3.45it/s]
  6%|▋         | 24008/371472 [1:54:41<27:30:34,  3.51it/s]
  6%|▋         | 24009/371472 [1:54:41<26:20:06,  3.66it/s]
  6%|▋         | 24010/371472 [1:54:42<25:48:54,  3.74it/s]
  6%|▋         | 24011/371472 [1:54:42<25:28:32,  3.79it/s]
  6%|▋         | 24012/371472 [1:54:42<27:46:35,  3.47it/s]
  6%|▋         | 24013/371472 [1:54:42<27:19:00,  3.53it/s]
  6%|▋         | 24014/371472 [1:54:43<26:44:50,  3.61it/s]
  6%|▋         | 24015/371472 [1:54:43<27:55:04,  3.46it/s]
  6%|▋         | 24016/371472 [1:54:43<29:06:12,  3.32it/s]
  6%|▋         | 24017/371472 [1:54:44<27:39:47,  3.49it/s]
  6%|▋         | 24018/371472 [1:54:44<26:54:15,  3.59it/s]
  6%|▋         | 24019/371472 [1:54:44<26:21:14,  3.66it/s]
  6%|▋         | 24020/371472 [1:54:44<27:29:32,  3.51it/s]
                                                           
{'loss': 4.4641, 'learning_rate': 9.42257967204637e-07, 'epoch': 1.03}

  6%|▋         | 24020/371472 [1:54:44<27:29:32,  3.51it/s]
  6%|▋         | 24021/371472 [1:54:45<26:54:04,  3.59it/s]
  6%|▋         | 24022/371472 [1:54:45<26:43:09,  3.61it/s]
  6%|▋         | 24023/371472 [1:54:45<26:59:32,  3.58it/s]
  6%|▋         | 24024/371472 [1:54:46<26:22:52,  3.66it/s]
  6%|▋         | 24025/371472 [1:54:46<26:53:49,  3.59it/s]
  6%|▋         | 24026/371472 [1:54:46<26:28:42,  3.64it/s]
  6%|▋         | 24027/371472 [1:54:46<27:20:40,  3.53it/s]
  6%|▋         | 24028/371472 [1:54:47<25:53:44,  3.73it/s]
  6%|▋         | 24029/371472 [1:54:47<25:42:31,  3.75it/s]
  6%|▋         | 24030/371472 [1:54:47<26:27:46,  3.65it/s]
  6%|▋         | 24031/371472 [1:54:47<26:47:16,  3.60it/s]
  6%|▋         | 24032/371472 [1:54:48<27:31:58,  3.51it/s]
  6%|▋         | 24033/371472 [1:54:48<27:33:23,  3.50it/s]
  6%|▋         | 24034/371472 [1:54:48<27:32:11,  3.50it/s]
  6%|▋         | 24035/371472 [1:54:49<27:10:31,  3.55it/s]
  6%|▋         | 24036/371472 [1:54:49<27:07:01,  3.56it/s]
  6%|▋         | 24037/371472 [1:54:49<26:02:04,  3.71it/s]
  6%|▋         | 24038/371472 [1:54:50<29:18:14,  3.29it/s]
  6%|▋         | 24039/371472 [1:54:50<28:05:15,  3.44it/s]
  6%|▋         | 24040/371472 [1:54:50<26:41:19,  3.62it/s]
                                                           
{'loss': 4.2648, 'learning_rate': 9.422094852291581e-07, 'epoch': 1.04}

  6%|▋         | 24040/371472 [1:54:50<26:41:19,  3.62it/s]
  6%|▋         | 24041/371472 [1:54:50<27:14:41,  3.54it/s]
  6%|▋         | 24042/371472 [1:54:51<26:06:04,  3.70it/s]
  6%|▋         | 24043/371472 [1:54:51<28:22:47,  3.40it/s]
  6%|▋         | 24044/371472 [1:54:51<29:32:33,  3.27it/s]
  6%|▋         | 24045/371472 [1:54:52<28:55:58,  3.34it/s]
  6%|▋         | 24046/371472 [1:54:52<27:33:28,  3.50it/s]
  6%|▋         | 24047/371472 [1:54:52<28:01:49,  3.44it/s]
  6%|▋         | 24048/371472 [1:54:52<28:32:11,  3.38it/s]
  6%|▋         | 24049/371472 [1:54:53<27:05:56,  3.56it/s]
  6%|▋         | 24050/371472 [1:54:53<30:42:24,  3.14it/s]
  6%|▋         | 24051/371472 [1:54:53<30:41:09,  3.14it/s]
  6%|▋         | 24052/371472 [1:54:54<28:45:20,  3.36it/s]
  6%|▋         | 24053/371472 [1:54:54<29:36:11,  3.26it/s]
  6%|▋         | 24054/371472 [1:54:54<28:25:11,  3.40it/s]
  6%|▋         | 24055/371472 [1:54:55<29:19:25,  3.29it/s]
  6%|▋         | 24056/371472 [1:54:55<29:30:32,  3.27it/s]
  6%|▋         | 24057/371472 [1:54:55<28:45:05,  3.36it/s]
  6%|▋         | 24058/371472 [1:54:55<28:04:31,  3.44it/s]
  6%|▋         | 24059/371472 [1:54:56<28:04:47,  3.44it/s]
  6%|▋         | 24060/371472 [1:54:56<28:22:11,  3.40it/s]
                                                           
{'loss': 4.428, 'learning_rate': 9.421610032536791e-07, 'epoch': 1.04}

  6%|▋         | 24060/371472 [1:54:56<28:22:11,  3.40it/s]
  6%|▋         | 24061/371472 [1:54:56<27:45:38,  3.48it/s]
  6%|▋         | 24062/371472 [1:54:57<27:00:53,  3.57it/s]
  6%|▋         | 24063/371472 [1:54:57<26:10:30,  3.69it/s]
  6%|▋         | 24064/371472 [1:54:57<26:02:05,  3.71it/s]
  6%|▋         | 24065/371472 [1:54:57<25:28:55,  3.79it/s]
  6%|▋         | 24066/371472 [1:54:58<25:25:30,  3.80it/s]
  6%|▋         | 24067/371472 [1:54:58<25:23:52,  3.80it/s]
  6%|▋         | 24068/371472 [1:54:58<26:07:39,  3.69it/s]
  6%|▋         | 24069/371472 [1:54:58<25:40:54,  3.76it/s]
  6%|▋         | 24070/371472 [1:54:59<25:40:55,  3.76it/s]
  6%|▋         | 24071/371472 [1:54:59<26:30:23,  3.64it/s]
  6%|▋         | 24072/371472 [1:54:59<25:17:40,  3.82it/s]
  6%|▋         | 24073/371472 [1:54:59<25:44:51,  3.75it/s]
  6%|▋         | 24074/371472 [1:55:00<24:58:26,  3.86it/s]
  6%|▋         | 24075/371472 [1:55:00<27:06:09,  3.56it/s]
  6%|▋         | 24076/371472 [1:55:00<26:25:00,  3.65it/s]
  6%|▋         | 24077/371472 [1:55:01<26:37:44,  3.62it/s]
  6%|▋         | 24078/371472 [1:55:01<25:52:43,  3.73it/s]
  6%|▋         | 24079/371472 [1:55:01<25:19:40,  3.81it/s]
  6%|▋         | 24080/371472 [1:55:01<24:32:28,  3.93it/s]
                                                           
{'loss': 4.6883, 'learning_rate': 9.421125212782003e-07, 'epoch': 1.04}

  6%|▋         | 24080/371472 [1:55:01<24:32:28,  3.93it/s]
  6%|▋         | 24081/371472 [1:55:02<24:29:20,  3.94it/s]
  6%|▋         | 24082/371472 [1:55:02<25:41:35,  3.76it/s]
  6%|▋         | 24083/371472 [1:55:02<24:40:03,  3.91it/s]
  6%|▋         | 24084/371472 [1:55:02<26:34:53,  3.63it/s]
  6%|▋         | 24085/371472 [1:55:03<26:19:10,  3.67it/s]
  6%|▋         | 24086/371472 [1:55:03<27:18:33,  3.53it/s]
  6%|▋         | 24087/371472 [1:55:03<25:43:29,  3.75it/s]
  6%|▋         | 24088/371472 [1:55:03<26:19:34,  3.67it/s]
  6%|▋         | 24089/371472 [1:55:04<26:31:05,  3.64it/s]
  6%|▋         | 24090/371472 [1:55:04<25:39:29,  3.76it/s]
  6%|▋         | 24091/371472 [1:55:04<25:51:24,  3.73it/s]
  6%|▋         | 24092/371472 [1:55:05<27:35:22,  3.50it/s]
  6%|▋         | 24093/371472 [1:55:05<27:39:48,  3.49it/s]
  6%|▋         | 24094/371472 [1:55:05<29:17:45,  3.29it/s]
  6%|▋         | 24095/371472 [1:55:06<29:23:44,  3.28it/s]
  6%|▋         | 24096/371472 [1:55:06<27:50:24,  3.47it/s]
  6%|▋         | 24097/371472 [1:55:06<28:00:06,  3.45it/s]
  6%|▋         | 24098/371472 [1:55:06<28:20:56,  3.40it/s]
  6%|▋         | 24099/371472 [1:55:07<27:27:16,  3.51it/s]
  6%|▋         | 24100/371472 [1:55:07<28:17:22,  3.41it/s]
                                                           
{'loss': 4.4379, 'learning_rate': 9.420640393027214e-07, 'epoch': 1.04}

  6%|▋         | 24100/371472 [1:55:07<28:17:22,  3.41it/s]
  6%|▋         | 24101/371472 [1:55:07<27:43:53,  3.48it/s]
  6%|▋         | 24102/371472 [1:55:07<26:33:25,  3.63it/s]
  6%|▋         | 24103/371472 [1:55:08<27:43:30,  3.48it/s]
  6%|▋         | 24104/371472 [1:55:08<26:41:54,  3.61it/s]
  6%|▋         | 24105/371472 [1:55:08<26:49:21,  3.60it/s]
  6%|▋         | 24106/371472 [1:55:09<26:34:37,  3.63it/s]
  6%|▋         | 24107/371472 [1:55:09<26:37:27,  3.62it/s]
  6%|▋         | 24108/371472 [1:55:09<26:16:09,  3.67it/s]
  6%|▋         | 24109/371472 [1:55:09<26:59:37,  3.57it/s]
  6%|▋         | 24110/371472 [1:55:10<27:21:55,  3.53it/s]
  6%|▋         | 24111/371472 [1:55:10<27:17:03,  3.54it/s]
  6%|▋         | 24112/371472 [1:55:10<26:52:08,  3.59it/s]
  6%|▋         | 24113/371472 [1:55:11<27:14:40,  3.54it/s]
  6%|▋         | 24114/371472 [1:55:11<27:03:11,  3.57it/s]
  6%|▋         | 24115/371472 [1:55:11<27:34:31,  3.50it/s]
  6%|▋         | 24116/371472 [1:55:11<26:51:51,  3.59it/s]
  6%|▋         | 24117/371472 [1:55:12<26:29:29,  3.64it/s]
  6%|▋         | 24118/371472 [1:55:12<25:32:26,  3.78it/s]
  6%|▋         | 24119/371472 [1:55:12<26:22:19,  3.66it/s]
  6%|▋         | 24120/371472 [1:55:13<27:48:47,  3.47it/s]
                                                           
{'loss': 4.3833, 'learning_rate': 9.420155573272425e-07, 'epoch': 1.04}

  6%|▋         | 24120/371472 [1:55:13<27:48:47,  3.47it/s]
  6%|▋         | 24121/371472 [1:55:13<26:40:46,  3.62it/s]
  6%|▋         | 24122/371472 [1:55:13<28:53:37,  3.34it/s]
  6%|▋         | 24123/371472 [1:55:13<27:39:12,  3.49it/s]
  6%|▋         | 24124/371472 [1:55:14<28:02:22,  3.44it/s]
  6%|▋         | 24125/371472 [1:55:14<26:44:12,  3.61it/s]
  6%|▋         | 24126/371472 [1:55:14<28:38:17,  3.37it/s]
  6%|▋         | 24127/371472 [1:55:15<29:04:07,  3.32it/s]
  6%|▋         | 24128/371472 [1:55:15<28:55:36,  3.34it/s]
  6%|▋         | 24129/371472 [1:55:15<27:29:53,  3.51it/s]
  6%|▋         | 24130/371472 [1:55:15<27:07:07,  3.56it/s]
  6%|▋         | 24131/371472 [1:55:16<27:50:51,  3.46it/s]
  6%|▋         | 24132/371472 [1:55:16<27:53:59,  3.46it/s]
  6%|▋         | 24133/371472 [1:55:16<26:31:59,  3.64it/s]
  6%|▋         | 24134/371472 [1:55:17<28:33:00,  3.38it/s]
  6%|▋         | 24135/371472 [1:55:17<29:23:27,  3.28it/s]
  6%|▋         | 24136/371472 [1:55:17<29:55:52,  3.22it/s]
  6%|▋         | 24137/371472 [1:55:18<29:49:09,  3.24it/s]
  6%|▋         | 24138/371472 [1:55:18<28:39:21,  3.37it/s]
  6%|▋         | 24139/371472 [1:55:18<29:28:16,  3.27it/s]
  6%|▋         | 24140/371472 [1:55:18<28:33:14,  3.38it/s]
                                                           
{'loss': 4.1903, 'learning_rate': 9.419670753517636e-07, 'epoch': 1.04}

  6%|▋         | 24140/371472 [1:55:18<28:33:14,  3.38it/s]
  6%|▋         | 24141/371472 [1:55:19<27:17:44,  3.53it/s]
  6%|▋         | 24142/371472 [1:55:19<27:18:50,  3.53it/s]
  6%|▋         | 24143/371472 [1:55:19<27:40:07,  3.49it/s]
  6%|▋         | 24144/371472 [1:55:20<27:25:59,  3.52it/s]
  6%|▋         | 24145/371472 [1:55:20<26:28:08,  3.64it/s]
  7%|▋         | 24146/371472 [1:55:20<26:18:07,  3.67it/s]
  7%|▋         | 24147/371472 [1:55:20<27:42:17,  3.48it/s]
  7%|▋         | 24148/371472 [1:55:21<28:05:49,  3.43it/s]
  7%|▋         | 24149/371472 [1:55:21<27:33:12,  3.50it/s]
  7%|▋         | 24150/371472 [1:55:21<26:16:30,  3.67it/s]
  7%|▋         | 24151/371472 [1:55:21<27:16:52,  3.54it/s]
  7%|▋         | 24152/371472 [1:55:22<26:14:28,  3.68it/s]
  7%|▋         | 24153/371472 [1:55:22<25:52:40,  3.73it/s]
  7%|▋         | 24154/371472 [1:55:22<26:14:13,  3.68it/s]
  7%|▋         | 24155/371472 [1:55:23<26:39:01,  3.62it/s]
  7%|▋         | 24156/371472 [1:55:23<26:25:42,  3.65it/s]
  7%|▋         | 24157/371472 [1:55:23<26:39:19,  3.62it/s]
  7%|▋         | 24158/371472 [1:55:23<26:56:22,  3.58it/s]
  7%|▋         | 24159/371472 [1:55:24<25:51:46,  3.73it/s]
  7%|▋         | 24160/371472 [1:55:24<27:05:33,  3.56it/s]
                                                           
{'loss': 4.5037, 'learning_rate': 9.419185933762848e-07, 'epoch': 1.04}

  7%|▋         | 24160/371472 [1:55:24<27:05:33,  3.56it/s]
  7%|▋         | 24161/371472 [1:55:24<26:13:22,  3.68it/s]
  7%|▋         | 24162/371472 [1:55:24<26:11:34,  3.68it/s]
  7%|▋         | 24163/371472 [1:55:25<25:46:47,  3.74it/s]
  7%|▋         | 24164/371472 [1:55:25<25:20:04,  3.81it/s]
  7%|▋         | 24165/371472 [1:55:25<25:25:55,  3.79it/s]
  7%|▋         | 24166/371472 [1:55:26<25:26:26,  3.79it/s]
  7%|▋         | 24167/371472 [1:55:26<25:35:27,  3.77it/s]
  7%|▋         | 24168/371472 [1:55:26<26:44:56,  3.61it/s]
  7%|▋         | 24169/371472 [1:55:26<26:45:29,  3.61it/s]
  7%|▋         | 24170/371472 [1:55:27<26:14:30,  3.68it/s]
  7%|▋         | 24171/371472 [1:55:27<25:58:29,  3.71it/s]
  7%|▋         | 24172/371472 [1:55:27<27:17:43,  3.53it/s]
  7%|▋         | 24173/371472 [1:55:27<27:17:02,  3.54it/s]
  7%|▋         | 24174/371472 [1:55:28<27:16:40,  3.54it/s]
  7%|▋         | 24175/371472 [1:55:28<27:20:17,  3.53it/s]
  7%|▋         | 24176/371472 [1:55:28<28:29:12,  3.39it/s]
  7%|▋         | 24177/371472 [1:55:29<27:06:21,  3.56it/s]
  7%|▋         | 24178/371472 [1:55:29<27:09:07,  3.55it/s]
  7%|▋         | 24179/371472 [1:55:29<26:32:03,  3.64it/s]
  7%|▋         | 24180/371472 [1:55:30<31:36:33,  3.05it/s]
                                                           
{'loss': 4.5972, 'learning_rate': 9.418701114008059e-07, 'epoch': 1.04}

  7%|▋         | 24180/371472 [1:55:30<31:36:33,  3.05it/s]
  7%|▋         | 24181/371472 [1:55:30<29:57:38,  3.22it/s]
  7%|▋         | 24182/371472 [1:55:30<29:20:49,  3.29it/s]
  7%|▋         | 24183/371472 [1:55:30<29:34:24,  3.26it/s]
  7%|▋         | 24184/371472 [1:55:31<28:08:29,  3.43it/s]
  7%|▋         | 24185/371472 [1:55:31<28:41:30,  3.36it/s]
  7%|▋         | 24186/371472 [1:55:31<29:16:36,  3.30it/s]
  7%|▋         | 24187/371472 [1:55:32<28:39:22,  3.37it/s]
  7%|▋         | 24188/371472 [1:55:32<27:26:33,  3.52it/s]
  7%|▋         | 24189/371472 [1:55:32<26:16:34,  3.67it/s]
  7%|▋         | 24190/371472 [1:55:32<25:09:37,  3.83it/s]
  7%|▋         | 24191/371472 [1:55:33<25:39:58,  3.76it/s]
  7%|▋         | 24192/371472 [1:55:33<25:29:37,  3.78it/s]
  7%|▋         | 24193/371472 [1:55:33<25:08:18,  3.84it/s]
  7%|▋         | 24194/371472 [1:55:33<24:56:54,  3.87it/s]
  7%|▋         | 24195/371472 [1:55:34<25:19:49,  3.81it/s]
  7%|▋         | 24196/371472 [1:55:34<26:09:12,  3.69it/s]
  7%|▋         | 24197/371472 [1:55:34<28:29:07,  3.39it/s]
  7%|▋         | 24198/371472 [1:55:35<28:42:47,  3.36it/s]
  7%|▋         | 24199/371472 [1:55:35<28:49:08,  3.35it/s]
  7%|▋         | 24200/371472 [1:55:35<27:26:21,  3.52it/s]
                                                           
{'loss': 4.4044, 'learning_rate': 9.418216294253269e-07, 'epoch': 1.04}

  7%|▋         | 24200/371472 [1:55:35<27:26:21,  3.52it/s]
  7%|▋         | 24201/371472 [1:55:35<27:05:36,  3.56it/s]
  7%|▋         | 24202/371472 [1:55:36<27:20:24,  3.53it/s]
  7%|▋         | 24203/371472 [1:55:36<26:15:21,  3.67it/s]
  7%|▋         | 24204/371472 [1:55:36<26:30:16,  3.64it/s]
  7%|▋         | 24205/371472 [1:55:37<26:00:53,  3.71it/s]
  7%|▋         | 24206/371472 [1:55:37<26:42:26,  3.61it/s]
  7%|▋         | 24207/371472 [1:55:37<26:55:26,  3.58it/s]
  7%|▋         | 24208/371472 [1:55:37<26:50:45,  3.59it/s]
  7%|▋         | 24209/371472 [1:55:38<26:16:46,  3.67it/s]
  7%|▋         | 24210/371472 [1:55:38<25:21:16,  3.80it/s]
  7%|▋         | 24211/371472 [1:55:38<25:50:40,  3.73it/s]
  7%|▋         | 24212/371472 [1:55:39<27:44:07,  3.48it/s]
  7%|▋         | 24213/371472 [1:55:39<26:42:17,  3.61it/s]
  7%|▋         | 24214/371472 [1:55:39<26:02:24,  3.70it/s]
  7%|▋         | 24215/371472 [1:55:39<27:30:43,  3.51it/s]
  7%|▋         | 24216/371472 [1:55:40<26:23:29,  3.65it/s]
  7%|▋         | 24217/371472 [1:55:40<27:26:55,  3.51it/s]
  7%|▋         | 24218/371472 [1:55:40<26:13:17,  3.68it/s]
  7%|▋         | 24219/371472 [1:55:40<26:36:13,  3.63it/s]
  7%|▋         | 24220/371472 [1:55:41<26:10:53,  3.68it/s]
                                                           
{'loss': 4.3715, 'learning_rate': 9.41773147449848e-07, 'epoch': 1.04}

  7%|▋         | 24220/371472 [1:55:41<26:10:53,  3.68it/s]
  7%|▋         | 24221/371472 [1:55:41<26:53:37,  3.59it/s]
  7%|▋         | 24222/371472 [1:55:41<27:09:34,  3.55it/s]
  7%|▋         | 24223/371472 [1:55:42<26:16:56,  3.67it/s]
  7%|▋         | 24224/371472 [1:55:42<25:39:10,  3.76it/s]
  7%|▋         | 24225/371472 [1:55:42<29:14:26,  3.30it/s]
  7%|▋         | 24226/371472 [1:55:42<29:15:40,  3.30it/s]
  7%|▋         | 24227/371472 [1:55:43<27:58:53,  3.45it/s]
  7%|▋         | 24228/371472 [1:55:43<27:47:32,  3.47it/s]
  7%|▋         | 24229/371472 [1:55:43<26:59:41,  3.57it/s]
  7%|▋         | 24230/371472 [1:55:44<27:41:21,  3.48it/s]
  7%|▋         | 24231/371472 [1:55:44<28:08:03,  3.43it/s]
  7%|▋         | 24232/371472 [1:55:44<28:05:40,  3.43it/s]
  7%|▋         | 24233/371472 [1:55:44<26:59:03,  3.57it/s]
  7%|▋         | 24234/371472 [1:55:45<29:52:17,  3.23it/s]
  7%|▋         | 24235/371472 [1:55:45<28:31:31,  3.38it/s]
  7%|▋         | 24236/371472 [1:55:45<28:39:15,  3.37it/s]
  7%|▋         | 24237/371472 [1:55:46<28:38:59,  3.37it/s]
  7%|▋         | 24238/371472 [1:55:46<27:30:35,  3.51it/s]
  7%|▋         | 24239/371472 [1:55:46<26:31:01,  3.64it/s]
  7%|▋         | 24240/371472 [1:55:46<25:41:31,  3.75it/s]
                                                           
{'loss': 4.5498, 'learning_rate': 9.417246654743692e-07, 'epoch': 1.04}

  7%|▋         | 24240/371472 [1:55:46<25:41:31,  3.75it/s]
  7%|▋         | 24241/371472 [1:55:47<26:17:52,  3.67it/s]
  7%|▋         | 24242/371472 [1:55:47<26:40:18,  3.62it/s]
  7%|▋         | 24243/371472 [1:55:47<27:17:54,  3.53it/s]
  7%|▋         | 24244/371472 [1:55:48<27:24:32,  3.52it/s]
  7%|▋         | 24245/371472 [1:55:48<33:58:20,  2.84it/s]
  7%|▋         | 24246/371472 [1:55:48<32:51:18,  2.94it/s]
  7%|▋         | 24247/371472 [1:55:49<31:12:01,  3.09it/s]
  7%|▋         | 24248/371472 [1:55:49<28:41:49,  3.36it/s]
  7%|▋         | 24249/371472 [1:55:49<26:55:15,  3.58it/s]
  7%|▋         | 24250/371472 [1:55:49<27:38:14,  3.49it/s]
  7%|▋         | 24251/371472 [1:55:50<29:14:01,  3.30it/s]
  7%|▋         | 24252/371472 [1:55:50<28:24:57,  3.39it/s]
  7%|▋         | 24253/371472 [1:55:50<26:52:19,  3.59it/s]
  7%|▋         | 24254/371472 [1:55:51<25:54:06,  3.72it/s]
  7%|▋         | 24255/371472 [1:55:51<26:10:42,  3.68it/s]
  7%|▋         | 24256/371472 [1:55:51<25:34:55,  3.77it/s]
  7%|▋         | 24257/371472 [1:55:51<26:05:54,  3.70it/s]
  7%|▋         | 24258/371472 [1:55:52<25:35:03,  3.77it/s]
  7%|▋         | 24259/371472 [1:55:52<26:39:06,  3.62it/s]
  7%|▋         | 24260/371472 [1:55:52<26:07:02,  3.69it/s]
                                                           
{'loss': 4.237, 'learning_rate': 9.416761834988903e-07, 'epoch': 1.04}

  7%|▋         | 24260/371472 [1:55:52<26:07:02,  3.69it/s]
  7%|▋         | 24261/371472 [1:55:52<25:22:28,  3.80it/s]
  7%|▋         | 24262/371472 [1:55:53<25:42:18,  3.75it/s]
  7%|▋         | 24263/371472 [1:55:53<26:14:03,  3.68it/s]
  7%|▋         | 24264/371472 [1:55:53<25:44:10,  3.75it/s]
  7%|▋         | 24265/371472 [1:55:54<25:55:57,  3.72it/s]
  7%|▋         | 24266/371472 [1:55:54<28:52:58,  3.34it/s]
  7%|▋         | 24267/371472 [1:55:54<28:47:49,  3.35it/s]
  7%|▋         | 24268/371472 [1:55:55<29:43:31,  3.24it/s]
  7%|▋         | 24269/371472 [1:55:55<30:46:17,  3.13it/s]
  7%|▋         | 24270/371472 [1:55:55<29:58:29,  3.22it/s]
  7%|▋         | 24271/371472 [1:55:55<30:11:32,  3.19it/s]
  7%|▋         | 24272/371472 [1:55:56<29:56:13,  3.22it/s]
  7%|▋         | 24273/371472 [1:55:56<28:33:29,  3.38it/s]
  7%|▋         | 24274/371472 [1:55:56<27:15:27,  3.54it/s]
  7%|▋         | 24275/371472 [1:55:57<28:11:54,  3.42it/s]
  7%|▋         | 24276/371472 [1:55:57<27:27:25,  3.51it/s]
  7%|▋         | 24277/371472 [1:55:57<27:59:44,  3.44it/s]
  7%|▋         | 24278/371472 [1:55:57<27:25:59,  3.52it/s]
  7%|▋         | 24279/371472 [1:55:58<28:16:55,  3.41it/s]
  7%|▋         | 24280/371472 [1:55:58<27:57:58,  3.45it/s]
                                                           
{'loss': 4.4666, 'learning_rate': 9.416277015234114e-07, 'epoch': 1.05}

  7%|▋         | 24280/371472 [1:55:58<27:57:58,  3.45it/s]
  7%|▋         | 24281/371472 [1:55:58<29:07:26,  3.31it/s]
  7%|▋         | 24282/371472 [1:55:59<35:28:52,  2.72it/s]
  7%|▋         | 24283/371472 [1:55:59<33:58:35,  2.84it/s]
  7%|▋         | 24284/371472 [1:56:00<34:09:14,  2.82it/s]
  7%|▋         | 24285/371472 [1:56:00<33:02:11,  2.92it/s]
  7%|▋         | 24286/371472 [1:56:00<32:58:21,  2.92it/s]
  7%|▋         | 24287/371472 [1:56:00<30:52:04,  3.12it/s]
  7%|▋         | 24288/371472 [1:56:01<30:18:24,  3.18it/s]
  7%|▋         | 24289/371472 [1:56:01<28:57:12,  3.33it/s]
  7%|▋         | 24290/371472 [1:56:01<27:35:03,  3.50it/s]
  7%|▋         | 24291/371472 [1:56:02<28:41:38,  3.36it/s]
  7%|▋         | 24292/371472 [1:56:02<27:14:01,  3.54it/s]
  7%|▋         | 24293/371472 [1:56:02<26:58:53,  3.57it/s]
  7%|▋         | 24294/371472 [1:56:02<28:03:54,  3.44it/s]
  7%|▋         | 24295/371472 [1:56:03<27:29:38,  3.51it/s]
  7%|▋         | 24296/371472 [1:56:03<26:17:12,  3.67it/s]
  7%|▋         | 24297/371472 [1:56:03<25:09:11,  3.83it/s]
  7%|▋         | 24298/371472 [1:56:03<25:07:01,  3.84it/s]
  7%|▋         | 24299/371472 [1:56:04<24:43:50,  3.90it/s]
  7%|▋         | 24300/371472 [1:56:04<25:50:08,  3.73it/s]
                                                           
{'loss': 4.4463, 'learning_rate': 9.415792195479325e-07, 'epoch': 1.05}

  7%|▋         | 24300/371472 [1:56:04<25:50:08,  3.73it/s]
  7%|▋         | 24301/371472 [1:56:04<26:06:22,  3.69it/s]
  7%|▋         | 24302/371472 [1:56:05<26:24:11,  3.65it/s]
  7%|▋         | 24303/371472 [1:56:05<27:01:32,  3.57it/s]
  7%|▋         | 24304/371472 [1:56:05<27:59:23,  3.45it/s]
  7%|▋         | 24305/371472 [1:56:05<27:15:14,  3.54it/s]
  7%|▋         | 24306/371472 [1:56:06<26:46:37,  3.60it/s]
  7%|▋         | 24307/371472 [1:56:06<27:31:22,  3.50it/s]
  7%|▋         | 24308/371472 [1:56:06<29:30:13,  3.27it/s]
  7%|▋         | 24309/371472 [1:56:07<29:00:23,  3.32it/s]
  7%|▋         | 24310/371472 [1:56:07<28:52:49,  3.34it/s]
  7%|▋         | 24311/371472 [1:56:07<27:37:19,  3.49it/s]
  7%|▋         | 24312/371472 [1:56:08<27:54:45,  3.45it/s]
  7%|▋         | 24313/371472 [1:56:08<28:30:40,  3.38it/s]
  7%|▋         | 24314/371472 [1:56:08<28:47:07,  3.35it/s]
  7%|▋         | 24315/371472 [1:56:08<27:57:11,  3.45it/s]
  7%|▋         | 24316/371472 [1:56:09<26:53:03,  3.59it/s]
  7%|▋         | 24317/371472 [1:56:09<26:45:19,  3.60it/s]
  7%|▋         | 24318/371472 [1:56:09<26:58:15,  3.58it/s]
  7%|▋         | 24319/371472 [1:56:09<26:11:55,  3.68it/s]
  7%|▋         | 24320/371472 [1:56:10<30:12:32,  3.19it/s]
                                                           
{'loss': 4.361, 'learning_rate': 9.415307375724536e-07, 'epoch': 1.05}

  7%|▋         | 24320/371472 [1:56:10<30:12:32,  3.19it/s]
  7%|▋         | 24321/371472 [1:56:10<28:58:09,  3.33it/s]
  7%|▋         | 24322/371472 [1:56:10<28:28:40,  3.39it/s]
  7%|▋         | 24323/371472 [1:56:11<27:26:52,  3.51it/s]
  7%|▋         | 24324/371472 [1:56:11<26:36:27,  3.62it/s]
  7%|▋         | 24325/371472 [1:56:11<27:22:17,  3.52it/s]
  7%|▋         | 24326/371472 [1:56:12<26:22:44,  3.66it/s]
  7%|▋         | 24327/371472 [1:56:12<26:03:38,  3.70it/s]
  7%|▋         | 24328/371472 [1:56:12<25:46:15,  3.74it/s]
  7%|▋         | 24329/371472 [1:56:12<25:43:33,  3.75it/s]
  7%|▋         | 24330/371472 [1:56:13<24:53:55,  3.87it/s]
  7%|▋         | 24331/371472 [1:56:13<25:48:05,  3.74it/s]
  7%|▋         | 24332/371472 [1:56:13<25:16:55,  3.81it/s]
  7%|▋         | 24333/371472 [1:56:13<26:49:33,  3.59it/s]
  7%|▋         | 24334/371472 [1:56:14<25:45:38,  3.74it/s]
  7%|▋         | 24335/371472 [1:56:14<24:46:03,  3.89it/s]
  7%|▋         | 24336/371472 [1:56:14<25:42:24,  3.75it/s]
  7%|▋         | 24337/371472 [1:56:14<27:07:41,  3.55it/s]
  7%|▋         | 24338/371472 [1:56:15<27:08:36,  3.55it/s]
  7%|▋         | 24339/371472 [1:56:15<26:46:47,  3.60it/s]
  7%|▋         | 24340/371472 [1:56:15<26:23:44,  3.65it/s]
                                                           
{'loss': 4.6172, 'learning_rate': 9.414822555969746e-07, 'epoch': 1.05}

  7%|▋         | 24340/371472 [1:56:15<26:23:44,  3.65it/s]
  7%|▋         | 24341/371472 [1:56:16<25:57:42,  3.71it/s]
  7%|▋         | 24342/371472 [1:56:16<25:53:51,  3.72it/s]
  7%|▋         | 24343/371472 [1:56:16<27:18:42,  3.53it/s]
  7%|▋         | 24344/371472 [1:56:16<26:13:54,  3.68it/s]
  7%|▋         | 24345/371472 [1:56:17<25:59:28,  3.71it/s]
  7%|▋         | 24346/371472 [1:56:17<25:30:11,  3.78it/s]
  7%|▋         | 24347/371472 [1:56:17<27:18:13,  3.53it/s]
  7%|▋         | 24348/371472 [1:56:18<27:35:18,  3.50it/s]
  7%|▋         | 24349/371472 [1:56:18<27:33:24,  3.50it/s]
  7%|▋         | 24350/371472 [1:56:18<26:28:12,  3.64it/s]
  7%|▋         | 24351/371472 [1:56:18<27:12:39,  3.54it/s]
  7%|▋         | 24352/371472 [1:56:19<29:06:29,  3.31it/s]
  7%|▋         | 24353/371472 [1:56:19<31:03:55,  3.10it/s]
  7%|▋         | 24354/371472 [1:56:19<29:57:37,  3.22it/s]
  7%|▋         | 24355/371472 [1:56:20<28:20:26,  3.40it/s]
  7%|▋         | 24356/371472 [1:56:20<28:31:33,  3.38it/s]
  7%|▋         | 24357/371472 [1:56:20<29:26:25,  3.28it/s]
  7%|▋         | 24358/371472 [1:56:20<28:35:32,  3.37it/s]
  7%|▋         | 24359/371472 [1:56:21<29:02:12,  3.32it/s]
  7%|▋         | 24360/371472 [1:56:21<29:45:33,  3.24it/s]
                                                           
{'loss': 4.5976, 'learning_rate': 9.414337736214958e-07, 'epoch': 1.05}

  7%|▋         | 24360/371472 [1:56:21<29:45:33,  3.24it/s]
  7%|▋         | 24361/371472 [1:56:21<30:09:19,  3.20it/s]
  7%|▋         | 24362/371472 [1:56:22<28:44:39,  3.35it/s]
  7%|▋         | 24363/371472 [1:56:22<28:48:30,  3.35it/s]
  7%|▋         | 24364/371472 [1:56:22<27:22:19,  3.52it/s]
  7%|▋         | 24365/371472 [1:56:23<26:26:03,  3.65it/s]
  7%|▋         | 24366/371472 [1:56:23<26:32:23,  3.63it/s]
  7%|▋         | 24367/371472 [1:56:23<27:28:53,  3.51it/s]
  7%|▋         | 24368/371472 [1:56:23<26:07:59,  3.69it/s]
  7%|▋         | 24369/371472 [1:56:24<26:22:29,  3.66it/s]
  7%|▋         | 24370/371472 [1:56:24<26:12:40,  3.68it/s]
  7%|▋         | 24371/371472 [1:56:24<27:47:03,  3.47it/s]
  7%|▋         | 24372/371472 [1:56:24<26:27:00,  3.65it/s]
  7%|▋         | 24373/371472 [1:56:25<25:58:30,  3.71it/s]
  7%|▋         | 24374/371472 [1:56:25<26:58:46,  3.57it/s]
  7%|▋         | 24375/371472 [1:56:25<27:03:17,  3.56it/s]
  7%|▋         | 24376/371472 [1:56:26<26:33:09,  3.63it/s]
  7%|▋         | 24377/371472 [1:56:26<26:24:40,  3.65it/s]
  7%|▋         | 24378/371472 [1:56:26<26:06:35,  3.69it/s]
  7%|▋         | 24379/371472 [1:56:26<25:54:42,  3.72it/s]
  7%|▋         | 24380/371472 [1:56:27<25:48:30,  3.74it/s]
                                                           
{'loss': 4.3985, 'learning_rate': 9.413852916460169e-07, 'epoch': 1.05}

  7%|▋         | 24380/371472 [1:56:27<25:48:30,  3.74it/s]
  7%|▋         | 24381/371472 [1:56:27<30:56:28,  3.12it/s]
  7%|▋         | 24382/371472 [1:56:27<29:12:28,  3.30it/s]
  7%|▋         | 24383/371472 [1:56:28<28:49:02,  3.35it/s]
  7%|▋         | 24384/371472 [1:56:28<28:00:28,  3.44it/s]
  7%|▋         | 24385/371472 [1:56:28<27:28:19,  3.51it/s]
  7%|▋         | 24386/371472 [1:56:28<26:30:59,  3.64it/s]
  7%|▋         | 24387/371472 [1:56:29<25:52:27,  3.73it/s]
  7%|▋         | 24388/371472 [1:56:29<26:51:38,  3.59it/s]
  7%|▋         | 24389/371472 [1:56:29<26:59:29,  3.57it/s]
  7%|▋         | 24390/371472 [1:56:30<27:01:42,  3.57it/s]
  7%|▋         | 24391/371472 [1:56:30<26:33:14,  3.63it/s]
  7%|▋         | 24392/371472 [1:56:30<27:19:29,  3.53it/s]
  7%|▋         | 24393/371472 [1:56:30<27:02:57,  3.56it/s]
  7%|▋         | 24394/371472 [1:56:31<27:29:27,  3.51it/s]
  7%|▋         | 24395/371472 [1:56:31<29:17:46,  3.29it/s]
  7%|▋         | 24396/371472 [1:56:31<29:11:52,  3.30it/s]
  7%|▋         | 24397/371472 [1:56:32<27:29:22,  3.51it/s]
  7%|▋         | 24398/371472 [1:56:32<27:01:19,  3.57it/s]
  7%|▋         | 24399/371472 [1:56:32<27:53:27,  3.46it/s]
  7%|▋         | 24400/371472 [1:56:32<26:58:56,  3.57it/s]
                                                           
{'loss': 4.3975, 'learning_rate': 9.41336809670538e-07, 'epoch': 1.05}

  7%|▋         | 24400/371472 [1:56:32<26:58:56,  3.57it/s]
  7%|▋         | 24401/371472 [1:56:33<26:57:35,  3.58it/s]
  7%|▋         | 24402/371472 [1:56:33<26:10:35,  3.68it/s]
  7%|▋         | 24403/371472 [1:56:33<26:36:04,  3.62it/s]
  7%|▋         | 24404/371472 [1:56:33<26:23:22,  3.65it/s]
  7%|▋         | 24405/371472 [1:56:34<27:32:39,  3.50it/s]
  7%|▋         | 24406/371472 [1:56:34<29:51:33,  3.23it/s]
  7%|▋         | 24407/371472 [1:56:34<29:06:00,  3.31it/s]
  7%|▋         | 24408/371472 [1:56:35<30:34:59,  3.15it/s]
  7%|▋         | 24409/371472 [1:56:35<29:20:36,  3.29it/s]
  7%|▋         | 24410/371472 [1:56:35<28:12:03,  3.42it/s]
  7%|▋         | 24411/371472 [1:56:36<27:30:35,  3.50it/s]
  7%|▋         | 24412/371472 [1:56:36<28:34:52,  3.37it/s]
  7%|▋         | 24413/371472 [1:56:36<30:18:42,  3.18it/s]
  7%|▋         | 24414/371472 [1:56:37<28:52:26,  3.34it/s]
  7%|▋         | 24415/371472 [1:56:37<28:13:54,  3.41it/s]
  7%|▋         | 24416/371472 [1:56:37<27:22:10,  3.52it/s]
  7%|▋         | 24417/371472 [1:56:37<26:52:02,  3.59it/s]
  7%|▋         | 24418/371472 [1:56:38<26:12:29,  3.68it/s]
  7%|▋         | 24419/371472 [1:56:38<25:00:21,  3.86it/s]
  7%|▋         | 24420/371472 [1:56:38<26:31:04,  3.64it/s]
                                                           
{'loss': 4.5018, 'learning_rate': 9.412883276950591e-07, 'epoch': 1.05}

  7%|▋         | 24420/371472 [1:56:38<26:31:04,  3.64it/s]
  7%|▋         | 24421/371472 [1:56:38<27:20:51,  3.53it/s]
  7%|▋         | 24422/371472 [1:56:39<27:37:49,  3.49it/s]
  7%|▋         | 24423/371472 [1:56:39<26:45:23,  3.60it/s]
  7%|▋         | 24424/371472 [1:56:39<27:25:09,  3.52it/s]
  7%|▋         | 24425/371472 [1:56:40<26:09:27,  3.69it/s]
  7%|▋         | 24426/371472 [1:56:40<29:51:58,  3.23it/s]
  7%|▋         | 24427/371472 [1:56:40<28:13:37,  3.42it/s]
  7%|▋         | 24428/371472 [1:56:40<27:57:40,  3.45it/s]
  7%|▋         | 24429/371472 [1:56:41<27:54:19,  3.45it/s]
  7%|▋         | 24430/371472 [1:56:41<28:20:22,  3.40it/s]
  7%|▋         | 24431/371472 [1:56:41<27:16:28,  3.53it/s]
  7%|▋         | 24432/371472 [1:56:42<27:57:26,  3.45it/s]
  7%|▋         | 24433/371472 [1:56:42<29:11:31,  3.30it/s]
  7%|▋         | 24434/371472 [1:56:42<29:10:19,  3.30it/s]
  7%|▋         | 24435/371472 [1:56:43<27:48:12,  3.47it/s]
  7%|▋         | 24436/371472 [1:56:43<26:07:14,  3.69it/s]
  7%|▋         | 24437/371472 [1:56:43<32:52:28,  2.93it/s]
  7%|▋         | 24438/371472 [1:56:44<30:43:00,  3.14it/s]
  7%|▋         | 24439/371472 [1:56:44<29:33:37,  3.26it/s]
  7%|▋         | 24440/371472 [1:56:44<29:11:27,  3.30it/s]
                                                           
{'loss': 4.5551, 'learning_rate': 9.412398457195802e-07, 'epoch': 1.05}

  7%|▋         | 24440/371472 [1:56:44<29:11:27,  3.30it/s]
  7%|▋         | 24441/371472 [1:56:44<29:11:22,  3.30it/s]
  7%|▋         | 24442/371472 [1:56:45<29:35:32,  3.26it/s]
  7%|▋         | 24443/371472 [1:56:45<29:24:13,  3.28it/s]
  7%|▋         | 24444/371472 [1:56:45<27:42:55,  3.48it/s]
  7%|▋         | 24445/371472 [1:56:46<26:58:28,  3.57it/s]
  7%|▋         | 24446/371472 [1:56:46<26:14:08,  3.67it/s]
  7%|▋         | 24447/371472 [1:56:46<26:08:38,  3.69it/s]
  7%|▋         | 24448/371472 [1:56:46<25:25:21,  3.79it/s]
  7%|▋         | 24449/371472 [1:56:47<25:18:53,  3.81it/s]
  7%|▋         | 24450/371472 [1:56:47<26:04:14,  3.70it/s]
  7%|▋         | 24451/371472 [1:56:47<25:28:38,  3.78it/s]
  7%|▋         | 24452/371472 [1:56:47<24:50:04,  3.88it/s]
  7%|▋         | 24453/371472 [1:56:48<24:18:12,  3.97it/s]
  7%|▋         | 24454/371472 [1:56:48<24:25:25,  3.95it/s]
  7%|▋         | 24455/371472 [1:56:48<27:18:46,  3.53it/s]
  7%|▋         | 24456/371472 [1:56:48<26:09:15,  3.69it/s]
  7%|▋         | 24457/371472 [1:56:49<27:30:01,  3.51it/s]
  7%|▋         | 24458/371472 [1:56:49<26:46:09,  3.60it/s]
  7%|▋         | 24459/371472 [1:56:49<26:19:58,  3.66it/s]
  7%|▋         | 24460/371472 [1:56:50<25:24:54,  3.79it/s]
                                                           
{'loss': 4.5351, 'learning_rate': 9.411913637441013e-07, 'epoch': 1.05}

  7%|▋         | 24460/371472 [1:56:50<25:24:54,  3.79it/s]
  7%|▋         | 24461/371472 [1:56:50<24:54:27,  3.87it/s]
  7%|▋         | 24462/371472 [1:56:50<24:26:30,  3.94it/s]
  7%|▋         | 24463/371472 [1:56:50<25:32:01,  3.78it/s]
  7%|▋         | 24464/371472 [1:56:51<27:35:21,  3.49it/s]
  7%|▋         | 24465/371472 [1:56:51<27:39:35,  3.48it/s]
  7%|▋         | 24466/371472 [1:56:51<26:41:48,  3.61it/s]
  7%|▋         | 24467/371472 [1:56:51<26:20:41,  3.66it/s]
  7%|▋         | 24468/371472 [1:56:52<25:39:58,  3.76it/s]
  7%|▋         | 24469/371472 [1:56:52<25:43:20,  3.75it/s]
  7%|▋         | 24470/371472 [1:56:52<27:45:09,  3.47it/s]
  7%|▋         | 24471/371472 [1:56:53<28:32:58,  3.38it/s]
  7%|▋         | 24472/371472 [1:56:53<30:41:11,  3.14it/s]
  7%|▋         | 24473/371472 [1:56:53<29:06:58,  3.31it/s]
  7%|▋         | 24474/371472 [1:56:54<28:32:07,  3.38it/s]
  7%|▋         | 24475/371472 [1:56:54<27:32:18,  3.50it/s]
  7%|▋         | 24476/371472 [1:56:54<27:40:01,  3.48it/s]
  7%|▋         | 24477/371472 [1:56:54<27:18:28,  3.53it/s]
  7%|▋         | 24478/371472 [1:56:55<29:04:13,  3.32it/s]
  7%|▋         | 24479/371472 [1:56:55<28:04:48,  3.43it/s]
  7%|▋         | 24480/371472 [1:56:55<27:05:20,  3.56it/s]
                                                           
{'loss': 4.4579, 'learning_rate': 9.411428817686224e-07, 'epoch': 1.05}

  7%|▋         | 24480/371472 [1:56:55<27:05:20,  3.56it/s]
  7%|▋         | 24481/371472 [1:56:56<26:51:04,  3.59it/s]
  7%|▋         | 24482/371472 [1:56:56<26:00:18,  3.71it/s]
  7%|▋         | 24483/371472 [1:56:56<26:30:09,  3.64it/s]
  7%|▋         | 24484/371472 [1:56:56<26:33:10,  3.63it/s]
  7%|▋         | 24485/371472 [1:56:57<27:35:24,  3.49it/s]
  7%|▋         | 24486/371472 [1:56:57<26:56:53,  3.58it/s]
  7%|▋         | 24487/371472 [1:56:57<26:21:18,  3.66it/s]
  7%|▋         | 24488/371472 [1:56:57<25:16:04,  3.81it/s]
  7%|▋         | 24489/371472 [1:56:58<25:23:27,  3.80it/s]
  7%|▋         | 24490/371472 [1:56:58<26:33:47,  3.63it/s]
  7%|▋         | 24491/371472 [1:56:58<26:53:56,  3.58it/s]
  7%|▋         | 24492/371472 [1:56:59<27:55:53,  3.45it/s]
  7%|▋         | 24493/371472 [1:56:59<27:54:06,  3.45it/s]
  7%|▋         | 24494/371472 [1:56:59<26:48:45,  3.59it/s]
  7%|▋         | 24495/371472 [1:56:59<26:35:24,  3.62it/s]
  7%|▋         | 24496/371472 [1:57:00<25:51:11,  3.73it/s]
  7%|▋         | 24497/371472 [1:57:00<26:41:25,  3.61it/s]
  7%|▋         | 24498/371472 [1:57:00<25:51:19,  3.73it/s]
  7%|▋         | 24499/371472 [1:57:00<26:43:26,  3.61it/s]
  7%|▋         | 24500/371472 [1:57:01<26:36:45,  3.62it/s]
                                                           
{'loss': 4.5496, 'learning_rate': 9.410943997931435e-07, 'epoch': 1.06}

  7%|▋         | 24500/371472 [1:57:01<26:36:45,  3.62it/s]
  7%|▋         | 24501/371472 [1:57:01<26:56:56,  3.58it/s]
  7%|▋         | 24502/371472 [1:57:01<27:02:25,  3.56it/s]
  7%|▋         | 24503/371472 [1:57:02<27:10:53,  3.55it/s]
  7%|▋         | 24504/371472 [1:57:02<26:34:32,  3.63it/s]
  7%|▋         | 24505/371472 [1:57:02<26:30:42,  3.64it/s]
  7%|▋         | 24506/371472 [1:57:02<25:50:19,  3.73it/s]
  7%|▋         | 24507/371472 [1:57:03<28:06:27,  3.43it/s]
  7%|▋         | 24508/371472 [1:57:03<28:13:38,  3.41it/s]
  7%|▋         | 24509/371472 [1:57:03<28:00:52,  3.44it/s]
  7%|▋         | 24510/371472 [1:57:04<27:30:55,  3.50it/s]
  7%|▋         | 24511/371472 [1:57:04<28:02:02,  3.44it/s]
  7%|▋         | 24512/371472 [1:57:04<29:16:51,  3.29it/s]
  7%|▋         | 24513/371472 [1:57:04<28:19:59,  3.40it/s]
  7%|▋         | 24514/371472 [1:57:05<31:05:30,  3.10it/s]
  7%|▋         | 24515/371472 [1:57:05<29:23:10,  3.28it/s]
  7%|▋         | 24516/371472 [1:57:05<30:15:44,  3.18it/s]
  7%|▋         | 24517/371472 [1:57:06<28:36:49,  3.37it/s]
  7%|▋         | 24518/371472 [1:57:06<26:59:55,  3.57it/s]
  7%|▋         | 24519/371472 [1:57:06<28:03:04,  3.44it/s]
  7%|▋         | 24520/371472 [1:57:07<29:06:57,  3.31it/s]
                                                           
{'loss': 4.5997, 'learning_rate': 9.410459178176646e-07, 'epoch': 1.06}

  7%|▋         | 24520/371472 [1:57:07<29:06:57,  3.31it/s]
  7%|▋         | 24521/371472 [1:57:07<28:02:33,  3.44it/s]
  7%|▋         | 24522/371472 [1:57:07<26:44:20,  3.60it/s]
  7%|▋         | 24523/371472 [1:57:07<25:45:43,  3.74it/s]
  7%|▋         | 24524/371472 [1:57:08<24:57:21,  3.86it/s]
  7%|▋         | 24525/371472 [1:57:08<25:59:33,  3.71it/s]
  7%|▋         | 24526/371472 [1:57:08<27:20:28,  3.52it/s]
  7%|▋         | 24527/371472 [1:57:09<27:04:27,  3.56it/s]
  7%|▋         | 24528/371472 [1:57:09<26:55:28,  3.58it/s]
  7%|▋         | 24529/371472 [1:57:09<27:55:11,  3.45it/s]
  7%|▋         | 24530/371472 [1:57:09<28:11:24,  3.42it/s]
  7%|▋         | 24531/371472 [1:57:10<28:01:15,  3.44it/s]
  7%|▋         | 24532/371472 [1:57:10<28:10:10,  3.42it/s]
  7%|▋         | 24533/371472 [1:57:10<27:13:05,  3.54it/s]
  7%|▋         | 24534/371472 [1:57:11<26:55:49,  3.58it/s]
  7%|▋         | 24535/371472 [1:57:11<28:34:58,  3.37it/s]
  7%|▋         | 24536/371472 [1:57:11<27:18:28,  3.53it/s]
  7%|▋         | 24537/371472 [1:57:11<26:43:48,  3.61it/s]
  7%|▋         | 24538/371472 [1:57:12<26:33:28,  3.63it/s]
  7%|▋         | 24539/371472 [1:57:12<28:28:41,  3.38it/s]
  7%|▋         | 24540/371472 [1:57:12<29:10:14,  3.30it/s]
                                                           
{'loss': 4.5158, 'learning_rate': 9.409974358421858e-07, 'epoch': 1.06}

  7%|▋         | 24540/371472 [1:57:12<29:10:14,  3.30it/s]
  7%|▋         | 24541/371472 [1:57:13<32:27:47,  2.97it/s]
  7%|▋         | 24542/371472 [1:57:13<29:53:31,  3.22it/s]
  7%|▋         | 24543/371472 [1:57:13<28:20:40,  3.40it/s]
  7%|▋         | 24544/371472 [1:57:14<28:31:59,  3.38it/s]
  7%|▋         | 24545/371472 [1:57:14<27:42:27,  3.48it/s]
  7%|▋         | 24546/371472 [1:57:14<26:59:13,  3.57it/s]
  7%|▋         | 24547/371472 [1:57:14<26:09:09,  3.68it/s]
  7%|▋         | 24548/371472 [1:57:15<27:09:25,  3.55it/s]
  7%|▋         | 24549/371472 [1:57:15<27:11:20,  3.54it/s]
  7%|▋         | 24550/371472 [1:57:15<27:46:41,  3.47it/s]
  7%|▋         | 24551/371472 [1:57:15<27:44:47,  3.47it/s]
  7%|▋         | 24552/371472 [1:57:16<28:28:26,  3.38it/s]
  7%|▋         | 24553/371472 [1:57:16<30:38:46,  3.14it/s]
  7%|▋         | 24554/371472 [1:57:16<29:57:00,  3.22it/s]
  7%|▋         | 24555/371472 [1:57:17<28:51:22,  3.34it/s]
  7%|▋         | 24556/371472 [1:57:17<28:24:12,  3.39it/s]
  7%|▋         | 24557/371472 [1:57:17<27:35:17,  3.49it/s]
  7%|▋         | 24558/371472 [1:57:18<26:32:29,  3.63it/s]
  7%|▋         | 24559/371472 [1:57:18<29:22:24,  3.28it/s]
  7%|▋         | 24560/371472 [1:57:18<28:22:48,  3.40it/s]
                                                           
{'loss': 4.3401, 'learning_rate': 9.409489538667069e-07, 'epoch': 1.06}

  7%|▋         | 24560/371472 [1:57:18<28:22:48,  3.40it/s]
  7%|▋         | 24561/371472 [1:57:18<29:16:43,  3.29it/s]
  7%|▋         | 24562/371472 [1:57:19<27:26:38,  3.51it/s]
  7%|▋         | 24563/371472 [1:57:19<28:32:34,  3.38it/s]
  7%|▋         | 24564/371472 [1:57:19<27:59:37,  3.44it/s]
  7%|▋         | 24565/371472 [1:57:20<30:17:17,  3.18it/s]
  7%|▋         | 24566/371472 [1:57:20<29:00:48,  3.32it/s]
  7%|▋         | 24567/371472 [1:57:20<27:34:48,  3.49it/s]
  7%|▋         | 24568/371472 [1:57:21<27:46:39,  3.47it/s]
  7%|▋         | 24569/371472 [1:57:21<27:26:38,  3.51it/s]
  7%|▋         | 24570/371472 [1:57:21<26:58:16,  3.57it/s]
  7%|▋         | 24571/371472 [1:57:21<27:15:10,  3.54it/s]
  7%|▋         | 24572/371472 [1:57:22<27:52:27,  3.46it/s]
  7%|▋         | 24573/371472 [1:57:22<27:55:51,  3.45it/s]
  7%|▋         | 24574/371472 [1:57:22<26:47:07,  3.60it/s]
  7%|▋         | 24575/371472 [1:57:22<25:58:38,  3.71it/s]
  7%|▋         | 24576/371472 [1:57:23<26:04:23,  3.70it/s]
  7%|▋         | 24577/371472 [1:57:23<26:36:44,  3.62it/s]
  7%|▋         | 24578/371472 [1:57:23<25:36:22,  3.76it/s]
  7%|▋         | 24579/371472 [1:57:24<25:28:30,  3.78it/s]
  7%|▋         | 24580/371472 [1:57:24<25:17:08,  3.81it/s]
                                                           
{'loss': 4.6352, 'learning_rate': 9.409004718912279e-07, 'epoch': 1.06}

  7%|▋         | 24580/371472 [1:57:24<25:17:08,  3.81it/s]
  7%|▋         | 24581/371472 [1:57:24<26:53:34,  3.58it/s]
  7%|▋         | 24582/371472 [1:57:24<26:29:51,  3.64it/s]
  7%|▋         | 24583/371472 [1:57:25<26:04:10,  3.70it/s]
  7%|▋         | 24584/371472 [1:57:25<26:25:09,  3.65it/s]
  7%|▋         | 24585/371472 [1:57:25<25:51:28,  3.73it/s]
  7%|▋         | 24586/371472 [1:57:26<28:46:32,  3.35it/s]
  7%|▋         | 24587/371472 [1:57:26<27:12:48,  3.54it/s]
  7%|▋         | 24588/371472 [1:57:26<27:16:34,  3.53it/s]
  7%|▋         | 24589/371472 [1:57:26<26:56:47,  3.58it/s]
  7%|▋         | 24590/371472 [1:57:27<27:08:28,  3.55it/s]
  7%|▋         | 24591/371472 [1:57:27<26:58:06,  3.57it/s]
  7%|▋         | 24592/371472 [1:57:27<28:29:42,  3.38it/s]
  7%|▋         | 24593/371472 [1:57:28<28:26:26,  3.39it/s]
  7%|▋         | 24594/371472 [1:57:28<28:32:46,  3.38it/s]
  7%|▋         | 24595/371472 [1:57:28<27:19:42,  3.53it/s]
  7%|▋         | 24596/371472 [1:57:28<26:34:18,  3.63it/s]
  7%|▋         | 24597/371472 [1:57:29<26:22:49,  3.65it/s]
  7%|▋         | 24598/371472 [1:57:29<27:24:39,  3.52it/s]
  7%|▋         | 24599/371472 [1:57:29<27:03:02,  3.56it/s]
  7%|▋         | 24600/371472 [1:57:30<29:12:59,  3.30it/s]
                                                           
{'loss': 4.3259, 'learning_rate': 9.40851989915749e-07, 'epoch': 1.06}

  7%|▋         | 24600/371472 [1:57:30<29:12:59,  3.30it/s]
  7%|▋         | 24601/371472 [1:57:30<30:08:50,  3.20it/s]
  7%|▋         | 24602/371472 [1:57:30<30:06:43,  3.20it/s]
  7%|▋         | 24603/371472 [1:57:30<28:42:22,  3.36it/s]
  7%|▋         | 24604/371472 [1:57:31<27:31:11,  3.50it/s]
  7%|▋         | 24605/371472 [1:57:31<26:48:44,  3.59it/s]
  7%|▋         | 24606/371472 [1:57:31<28:23:40,  3.39it/s]
  7%|▋         | 24607/371472 [1:57:32<27:13:28,  3.54it/s]
  7%|▋         | 24608/371472 [1:57:32<27:33:17,  3.50it/s]
  7%|▋         | 24609/371472 [1:57:32<27:26:17,  3.51it/s]
  7%|▋         | 24610/371472 [1:57:32<26:32:38,  3.63it/s]
  7%|▋         | 24611/371472 [1:57:33<26:47:46,  3.60it/s]
  7%|▋         | 24612/371472 [1:57:33<28:37:46,  3.37it/s]
  7%|▋         | 24613/371472 [1:57:33<27:34:57,  3.49it/s]
  7%|▋         | 24614/371472 [1:57:34<28:45:10,  3.35it/s]
  7%|▋         | 24615/371472 [1:57:34<28:00:59,  3.44it/s]
  7%|▋         | 24616/371472 [1:57:34<26:37:29,  3.62it/s]
  7%|▋         | 24617/371472 [1:57:34<26:28:27,  3.64it/s]
  7%|▋         | 24618/371472 [1:57:35<28:23:42,  3.39it/s]
  7%|▋         | 24619/371472 [1:57:35<29:31:16,  3.26it/s]
  7%|▋         | 24620/371472 [1:57:35<30:49:12,  3.13it/s]
                                                           
{'loss': 4.3454, 'learning_rate': 9.408035079402702e-07, 'epoch': 1.06}

  7%|▋         | 24620/371472 [1:57:35<30:49:12,  3.13it/s]
  7%|▋         | 24621/371472 [1:57:36<31:06:00,  3.10it/s]
  7%|▋         | 24622/371472 [1:57:36<29:45:10,  3.24it/s]
  7%|▋         | 24623/371472 [1:57:36<28:57:58,  3.33it/s]
  7%|▋         | 24624/371472 [1:57:37<27:52:31,  3.46it/s]
  7%|▋         | 24625/371472 [1:57:37<27:33:21,  3.50it/s]
  7%|▋         | 24626/371472 [1:57:37<26:43:16,  3.61it/s]
  7%|▋         | 24627/371472 [1:57:37<27:54:09,  3.45it/s]
  7%|▋         | 24628/371472 [1:57:38<28:23:19,  3.39it/s]
  7%|▋         | 24629/371472 [1:57:38<26:39:28,  3.61it/s]
  7%|▋         | 24630/371472 [1:57:38<29:08:33,  3.31it/s]
  7%|▋         | 24631/371472 [1:57:39<27:31:53,  3.50it/s]
  7%|▋         | 24632/371472 [1:57:39<26:55:11,  3.58it/s]
  7%|▋         | 24633/371472 [1:57:39<26:15:07,  3.67it/s]
  7%|▋         | 24634/371472 [1:57:39<26:27:25,  3.64it/s]
  7%|▋         | 24635/371472 [1:57:40<25:47:41,  3.73it/s]
  7%|▋         | 24636/371472 [1:57:40<26:07:21,  3.69it/s]
  7%|▋         | 24637/371472 [1:57:40<27:31:14,  3.50it/s]
  7%|▋         | 24638/371472 [1:57:40<26:45:54,  3.60it/s]
  7%|▋         | 24639/371472 [1:57:41<26:29:10,  3.64it/s]
  7%|▋         | 24640/371472 [1:57:41<25:56:55,  3.71it/s]
                                                           
{'loss': 4.6752, 'learning_rate': 9.407550259647912e-07, 'epoch': 1.06}

  7%|▋         | 24640/371472 [1:57:41<25:56:55,  3.71it/s]
  7%|▋         | 24641/371472 [1:57:41<25:03:40,  3.84it/s]
  7%|▋         | 24642/371472 [1:57:41<24:44:34,  3.89it/s]
  7%|▋         | 24643/371472 [1:57:42<24:27:45,  3.94it/s]
  7%|▋         | 24644/371472 [1:57:42<25:13:54,  3.82it/s]
  7%|▋         | 24645/371472 [1:57:42<26:07:29,  3.69it/s]
  7%|▋         | 24646/371472 [1:57:43<29:30:24,  3.27it/s]
  7%|▋         | 24647/371472 [1:57:43<28:08:46,  3.42it/s]
  7%|▋         | 24648/371472 [1:57:43<27:03:45,  3.56it/s]
  7%|▋         | 24649/371472 [1:57:44<27:39:18,  3.48it/s]
  7%|▋         | 24650/371472 [1:57:44<26:30:47,  3.63it/s]
  7%|▋         | 24651/371472 [1:57:44<26:00:33,  3.70it/s]
  7%|▋         | 24652/371472 [1:57:44<25:32:20,  3.77it/s]
  7%|▋         | 24653/371472 [1:57:45<25:20:32,  3.80it/s]
  7%|▋         | 24654/371472 [1:57:45<27:29:50,  3.50it/s]
  7%|▋         | 24655/371472 [1:57:45<28:53:03,  3.34it/s]
  7%|▋         | 24656/371472 [1:57:45<27:24:12,  3.52it/s]
  7%|▋         | 24657/371472 [1:57:46<26:58:55,  3.57it/s]
  7%|▋         | 24658/371472 [1:57:46<27:25:03,  3.51it/s]
  7%|▋         | 24659/371472 [1:57:46<28:10:35,  3.42it/s]
  7%|▋         | 24660/371472 [1:57:47<27:58:31,  3.44it/s]
                                                           
{'loss': 4.4029, 'learning_rate': 9.407065439893124e-07, 'epoch': 1.06}

  7%|▋         | 24660/371472 [1:57:47<27:58:31,  3.44it/s]
  7%|▋         | 24661/371472 [1:57:47<28:17:41,  3.40it/s]
  7%|▋         | 24662/371472 [1:57:47<28:52:11,  3.34it/s]
  7%|▋         | 24663/371472 [1:57:47<27:50:15,  3.46it/s]
  7%|▋         | 24664/371472 [1:57:48<27:49:51,  3.46it/s]
  7%|▋         | 24665/371472 [1:57:48<27:49:30,  3.46it/s]
  7%|▋         | 24666/371472 [1:57:48<28:07:01,  3.43it/s]
  7%|▋         | 24667/371472 [1:57:49<27:59:04,  3.44it/s]
  7%|▋         | 24668/371472 [1:57:49<27:15:57,  3.53it/s]
  7%|▋         | 24669/371472 [1:57:49<28:14:26,  3.41it/s]
  7%|▋         | 24670/371472 [1:57:50<28:03:50,  3.43it/s]
  7%|▋         | 24671/371472 [1:57:50<29:23:38,  3.28it/s]
  7%|▋         | 24672/371472 [1:57:50<28:41:13,  3.36it/s]
  7%|▋         | 24673/371472 [1:57:50<27:23:32,  3.52it/s]
  7%|▋         | 24674/371472 [1:57:51<26:23:30,  3.65it/s]
  7%|▋         | 24675/371472 [1:57:51<25:49:18,  3.73it/s]
  7%|▋         | 24676/371472 [1:57:51<24:58:32,  3.86it/s]
  7%|▋         | 24677/371472 [1:57:51<24:52:23,  3.87it/s]
  7%|▋         | 24678/371472 [1:57:52<24:36:32,  3.91it/s]
  7%|▋         | 24679/371472 [1:57:52<25:18:56,  3.81it/s]
  7%|▋         | 24680/371472 [1:57:52<24:59:55,  3.85it/s]
                                                           
{'loss': 4.3, 'learning_rate': 9.406580620138335e-07, 'epoch': 1.06}

  7%|▋         | 24680/371472 [1:57:52<24:59:55,  3.85it/s]
  7%|▋         | 24681/371472 [1:57:52<27:12:03,  3.54it/s]
  7%|▋         | 24682/371472 [1:57:53<26:23:04,  3.65it/s]
  7%|▋         | 24683/371472 [1:57:53<26:05:13,  3.69it/s]
  7%|▋         | 24684/371472 [1:57:53<27:17:51,  3.53it/s]
  7%|▋         | 24685/371472 [1:57:54<28:05:47,  3.43it/s]
  7%|▋         | 24686/371472 [1:57:54<27:25:33,  3.51it/s]
  7%|▋         | 24687/371472 [1:57:54<27:46:57,  3.47it/s]
  7%|▋         | 24688/371472 [1:57:54<27:00:58,  3.57it/s]
  7%|▋         | 24689/371472 [1:57:55<26:19:36,  3.66it/s]
  7%|▋         | 24690/371472 [1:57:55<26:42:18,  3.61it/s]
  7%|▋         | 24691/371472 [1:57:55<26:27:10,  3.64it/s]
  7%|▋         | 24692/371472 [1:57:56<25:21:10,  3.80it/s]
  7%|▋         | 24693/371472 [1:57:56<26:14:11,  3.67it/s]
  7%|▋         | 24694/371472 [1:57:56<25:38:59,  3.76it/s]
  7%|▋         | 24695/371472 [1:57:56<25:47:51,  3.73it/s]
  7%|▋         | 24696/371472 [1:57:57<25:34:08,  3.77it/s]
  7%|▋         | 24697/371472 [1:57:57<27:10:35,  3.54it/s]
  7%|▋         | 24698/371472 [1:57:57<26:37:13,  3.62it/s]
  7%|▋         | 24699/371472 [1:57:57<27:05:16,  3.56it/s]
  7%|▋         | 24700/371472 [1:57:58<25:50:49,  3.73it/s]
                                                           
{'loss': 4.6179, 'learning_rate': 9.406095800383546e-07, 'epoch': 1.06}

  7%|▋         | 24700/371472 [1:57:58<25:50:49,  3.73it/s]
  7%|▋         | 24701/371472 [1:57:58<25:13:59,  3.82it/s]
  7%|▋         | 24702/371472 [1:57:58<25:37:16,  3.76it/s]
  7%|▋         | 24703/371472 [1:57:59<28:58:48,  3.32it/s]
  7%|▋         | 24704/371472 [1:57:59<27:37:09,  3.49it/s]
  7%|▋         | 24705/371472 [1:57:59<30:19:22,  3.18it/s]
  7%|▋         | 24706/371472 [1:57:59<28:29:11,  3.38it/s]
  7%|▋         | 24707/371472 [1:58:00<28:05:49,  3.43it/s]
  7%|▋         | 24708/371472 [1:58:00<27:32:52,  3.50it/s]
  7%|▋         | 24709/371472 [1:58:00<26:27:15,  3.64it/s]
  7%|▋         | 24710/371472 [1:58:01<26:33:42,  3.63it/s]
  7%|▋         | 24711/371472 [1:58:01<26:04:58,  3.69it/s]
  7%|▋         | 24712/371472 [1:58:01<26:25:13,  3.65it/s]
  7%|▋         | 24713/371472 [1:58:01<26:21:33,  3.65it/s]
  7%|▋         | 24714/371472 [1:58:02<26:47:44,  3.59it/s]
  7%|▋         | 24715/371472 [1:58:02<26:41:43,  3.61it/s]
  7%|▋         | 24716/371472 [1:58:02<26:12:36,  3.67it/s]
  7%|▋         | 24717/371472 [1:58:02<25:56:10,  3.71it/s]
  7%|▋         | 24718/371472 [1:58:03<25:30:12,  3.78it/s]
  7%|▋         | 24719/371472 [1:58:03<25:48:43,  3.73it/s]
  7%|▋         | 24720/371472 [1:58:03<25:31:36,  3.77it/s]
                                                           
{'loss': 4.2334, 'learning_rate': 9.405610980628756e-07, 'epoch': 1.06}

  7%|▋         | 24720/371472 [1:58:03<25:31:36,  3.77it/s]
  7%|▋         | 24721/371472 [1:58:04<26:56:59,  3.57it/s]
  7%|▋         | 24722/371472 [1:58:04<26:35:34,  3.62it/s]
  7%|▋         | 24723/371472 [1:58:04<27:41:03,  3.48it/s]
  7%|▋         | 24724/371472 [1:58:05<29:23:12,  3.28it/s]
  7%|▋         | 24725/371472 [1:58:05<28:49:05,  3.34it/s]
  7%|▋         | 24726/371472 [1:58:05<28:20:13,  3.40it/s]
  7%|▋         | 24727/371472 [1:58:05<27:21:03,  3.52it/s]
  7%|▋         | 24728/371472 [1:58:06<27:49:35,  3.46it/s]
  7%|▋         | 24729/371472 [1:58:06<26:24:48,  3.65it/s]
  7%|▋         | 24730/371472 [1:58:06<28:00:22,  3.44it/s]
  7%|▋         | 24731/371472 [1:58:07<29:17:00,  3.29it/s]
  7%|▋         | 24732/371472 [1:58:07<30:27:06,  3.16it/s]
  7%|▋         | 24733/371472 [1:58:07<28:48:48,  3.34it/s]
  7%|▋         | 24734/371472 [1:58:07<28:39:55,  3.36it/s]
  7%|▋         | 24735/371472 [1:58:08<29:56:04,  3.22it/s]
  7%|▋         | 24736/371472 [1:58:08<28:36:20,  3.37it/s]
  7%|▋         | 24737/371472 [1:58:08<28:17:27,  3.40it/s]
  7%|▋         | 24738/371472 [1:58:09<27:58:53,  3.44it/s]
  7%|▋         | 24739/371472 [1:58:09<28:12:40,  3.41it/s]
  7%|▋         | 24740/371472 [1:58:09<27:05:33,  3.56it/s]
                                                           
{'loss': 4.1275, 'learning_rate': 9.405126160873968e-07, 'epoch': 1.07}

  7%|▋         | 24740/371472 [1:58:09<27:05:33,  3.56it/s]
  7%|▋         | 24741/371472 [1:58:09<26:19:29,  3.66it/s]
  7%|▋         | 24742/371472 [1:58:10<28:13:53,  3.41it/s]
  7%|▋         | 24743/371472 [1:58:10<31:30:21,  3.06it/s]
  7%|▋         | 24744/371472 [1:58:10<29:34:48,  3.26it/s]
  7%|▋         | 24745/371472 [1:58:11<28:12:53,  3.41it/s]
  7%|▋         | 24746/371472 [1:58:11<27:04:11,  3.56it/s]
  7%|▋         | 24747/371472 [1:58:11<27:47:55,  3.46it/s]
  7%|▋         | 24748/371472 [1:58:12<27:13:28,  3.54it/s]
  7%|▋         | 24749/371472 [1:58:12<27:57:09,  3.45it/s]
  7%|▋         | 24750/371472 [1:58:12<27:34:02,  3.49it/s]
  7%|▋         | 24751/371472 [1:58:12<30:01:23,  3.21it/s]
  7%|▋         | 24752/371472 [1:58:13<28:38:08,  3.36it/s]
  7%|▋         | 24753/371472 [1:58:13<26:42:30,  3.61it/s]
  7%|▋         | 24754/371472 [1:58:13<26:34:02,  3.63it/s]
  7%|▋         | 24755/371472 [1:58:14<26:39:19,  3.61it/s]
  7%|▋         | 24756/371472 [1:58:14<26:09:34,  3.68it/s]
  7%|▋         | 24757/371472 [1:58:14<25:49:49,  3.73it/s]
  7%|▋         | 24758/371472 [1:58:14<27:06:25,  3.55it/s]
  7%|▋         | 24759/371472 [1:58:15<26:41:27,  3.61it/s]
  7%|▋         | 24760/371472 [1:58:15<27:54:46,  3.45it/s]
                                                           
{'loss': 4.4202, 'learning_rate': 9.404641341119179e-07, 'epoch': 1.07}

  7%|▋         | 24760/371472 [1:58:15<27:54:46,  3.45it/s]
  7%|▋         | 24761/371472 [1:58:15<27:35:28,  3.49it/s]
  7%|▋         | 24762/371472 [1:58:16<28:20:39,  3.40it/s]
  7%|▋         | 24763/371472 [1:58:16<28:10:32,  3.42it/s]
  7%|▋         | 24764/371472 [1:58:16<27:10:02,  3.54it/s]
  7%|▋         | 24765/371472 [1:58:16<26:07:55,  3.69it/s]
  7%|▋         | 24766/371472 [1:58:17<26:32:54,  3.63it/s]
  7%|▋         | 24767/371472 [1:58:17<30:41:40,  3.14it/s]
  7%|▋         | 24768/371472 [1:58:17<29:10:32,  3.30it/s]
  7%|▋         | 24769/371472 [1:58:18<27:53:53,  3.45it/s]
  7%|▋         | 24770/371472 [1:58:18<27:46:19,  3.47it/s]
  7%|▋         | 24771/371472 [1:58:18<26:40:42,  3.61it/s]
  7%|▋         | 24772/371472 [1:58:18<26:59:36,  3.57it/s]
  7%|▋         | 24773/371472 [1:58:19<26:50:56,  3.59it/s]
  7%|▋         | 24774/371472 [1:58:19<26:08:17,  3.68it/s]
  7%|▋         | 24775/371472 [1:58:19<25:28:41,  3.78it/s]
  7%|▋         | 24776/371472 [1:58:19<25:14:49,  3.81it/s]
  7%|▋         | 24777/371472 [1:58:20<24:53:33,  3.87it/s]
  7%|▋         | 24778/371472 [1:58:20<24:48:08,  3.88it/s]
  7%|▋         | 24779/371472 [1:58:20<25:39:29,  3.75it/s]
  7%|▋         | 24780/371472 [1:58:20<25:41:59,  3.75it/s]
                                                           
{'loss': 4.3064, 'learning_rate': 9.404156521364391e-07, 'epoch': 1.07}

  7%|▋         | 24780/371472 [1:58:20<25:41:59,  3.75it/s]
  7%|▋         | 24781/371472 [1:58:21<26:09:09,  3.68it/s]
  7%|▋         | 24782/371472 [1:58:21<26:37:21,  3.62it/s]
  7%|▋         | 24783/371472 [1:58:21<27:34:12,  3.49it/s]
  7%|▋         | 24784/371472 [1:58:22<26:03:35,  3.70it/s]
  7%|▋         | 24785/371472 [1:58:22<27:19:39,  3.52it/s]
  7%|▋         | 24786/371472 [1:58:22<27:21:15,  3.52it/s]
  7%|▋         | 24787/371472 [1:58:22<27:30:18,  3.50it/s]
  7%|▋         | 24788/371472 [1:58:23<26:42:55,  3.60it/s]
  7%|▋         | 24789/371472 [1:58:23<26:17:52,  3.66it/s]
  7%|▋         | 24790/371472 [1:58:23<27:29:52,  3.50it/s]
  7%|▋         | 24791/371472 [1:58:24<30:45:03,  3.13it/s]
  7%|▋         | 24792/371472 [1:58:24<28:34:39,  3.37it/s]
  7%|▋         | 24793/371472 [1:58:24<28:04:25,  3.43it/s]
  7%|▋         | 24794/371472 [1:58:25<27:57:40,  3.44it/s]
  7%|▋         | 24795/371472 [1:58:25<27:04:25,  3.56it/s]
  7%|▋         | 24796/371472 [1:58:25<27:02:22,  3.56it/s]
  7%|▋         | 24797/371472 [1:58:25<27:10:11,  3.54it/s]
  7%|▋         | 24798/371472 [1:58:26<26:25:05,  3.65it/s]
  7%|▋         | 24799/371472 [1:58:26<25:39:36,  3.75it/s]
  7%|▋         | 24800/371472 [1:58:26<25:55:10,  3.72it/s]
                                                           
{'loss': 4.3091, 'learning_rate': 9.403671701609601e-07, 'epoch': 1.07}

  7%|▋         | 24800/371472 [1:58:26<25:55:10,  3.72it/s]
  7%|▋         | 24801/371472 [1:58:26<26:48:19,  3.59it/s]
  7%|▋         | 24802/371472 [1:58:27<26:32:21,  3.63it/s]
  7%|▋         | 24803/371472 [1:58:27<26:16:55,  3.66it/s]
  7%|▋         | 24804/371472 [1:58:27<28:50:09,  3.34it/s]
  7%|▋         | 24805/371472 [1:58:28<28:39:35,  3.36it/s]
  7%|▋         | 24806/371472 [1:58:28<27:17:01,  3.53it/s]
  7%|▋         | 24807/371472 [1:58:28<26:20:32,  3.66it/s]
  7%|▋         | 24808/371472 [1:58:28<27:04:12,  3.56it/s]
  7%|▋         | 24809/371472 [1:58:29<27:56:21,  3.45it/s]
  7%|▋         | 24810/371472 [1:58:29<28:17:57,  3.40it/s]
  7%|▋         | 24811/371472 [1:58:29<27:38:32,  3.48it/s]
  7%|▋         | 24812/371472 [1:58:30<27:15:15,  3.53it/s]
  7%|▋         | 24813/371472 [1:58:30<27:03:57,  3.56it/s]
  7%|▋         | 24814/371472 [1:58:30<27:10:53,  3.54it/s]
  7%|▋         | 24815/371472 [1:58:30<26:52:25,  3.58it/s]
  7%|▋         | 24816/371472 [1:58:31<27:33:20,  3.49it/s]
  7%|▋         | 24817/371472 [1:58:31<27:42:40,  3.47it/s]
  7%|▋         | 24818/371472 [1:58:31<27:22:49,  3.52it/s]
  7%|▋         | 24819/371472 [1:58:32<26:28:12,  3.64it/s]
  7%|▋         | 24820/371472 [1:58:32<26:14:26,  3.67it/s]
                                                           
{'loss': 4.3217, 'learning_rate': 9.403186881854812e-07, 'epoch': 1.07}

  7%|▋         | 24820/371472 [1:58:32<26:14:26,  3.67it/s]
  7%|▋         | 24821/371472 [1:58:32<26:26:29,  3.64it/s]
  7%|▋         | 24822/371472 [1:58:32<27:15:15,  3.53it/s]
  7%|▋         | 24823/371472 [1:58:33<26:39:03,  3.61it/s]
  7%|▋         | 24824/371472 [1:58:33<26:59:17,  3.57it/s]
  7%|▋         | 24825/371472 [1:58:33<29:27:55,  3.27it/s]
  7%|▋         | 24826/371472 [1:58:34<29:15:36,  3.29it/s]
  7%|▋         | 24827/371472 [1:58:34<28:32:50,  3.37it/s]
  7%|▋         | 24828/371472 [1:58:34<27:47:19,  3.47it/s]
  7%|▋         | 24829/371472 [1:58:34<27:55:02,  3.45it/s]
  7%|▋         | 24830/371472 [1:58:35<27:37:33,  3.49it/s]
  7%|▋         | 24831/371472 [1:58:35<26:42:38,  3.60it/s]
  7%|▋         | 24832/371472 [1:58:35<26:27:37,  3.64it/s]
  7%|▋         | 24833/371472 [1:58:35<25:50:04,  3.73it/s]
  7%|▋         | 24834/371472 [1:58:36<25:10:39,  3.82it/s]
  7%|▋         | 24835/371472 [1:58:36<25:58:03,  3.71it/s]
  7%|▋         | 24836/371472 [1:58:36<27:00:43,  3.56it/s]
  7%|▋         | 24837/371472 [1:58:37<26:00:28,  3.70it/s]
  7%|▋         | 24838/371472 [1:58:37<29:05:51,  3.31it/s]
  7%|▋         | 24839/371472 [1:58:37<28:20:39,  3.40it/s]
  7%|▋         | 24840/371472 [1:58:37<27:36:16,  3.49it/s]
                                                           
{'loss': 4.5031, 'learning_rate': 9.402702062100023e-07, 'epoch': 1.07}

  7%|▋         | 24840/371472 [1:58:38<27:36:16,  3.49it/s]
  7%|▋         | 24841/371472 [1:58:38<28:27:11,  3.38it/s]
  7%|▋         | 24842/371472 [1:58:38<29:36:08,  3.25it/s]
  7%|▋         | 24843/371472 [1:58:38<29:19:58,  3.28it/s]
  7%|▋         | 24844/371472 [1:58:39<29:03:18,  3.31it/s]
  7%|▋         | 24845/371472 [1:58:39<27:53:53,  3.45it/s]
  7%|▋         | 24846/371472 [1:58:39<27:32:58,  3.49it/s]
  7%|▋         | 24847/371472 [1:58:40<26:25:38,  3.64it/s]
  7%|▋         | 24848/371472 [1:58:40<26:48:49,  3.59it/s]
  7%|▋         | 24849/371472 [1:58:40<26:42:20,  3.61it/s]
  7%|▋         | 24850/371472 [1:58:40<27:37:00,  3.49it/s]
  7%|▋         | 24851/371472 [1:58:41<27:11:22,  3.54it/s]
  7%|▋         | 24852/371472 [1:58:41<27:58:22,  3.44it/s]
  7%|▋         | 24853/371472 [1:58:41<27:32:13,  3.50it/s]
  7%|▋         | 24854/371472 [1:58:42<29:45:07,  3.24it/s]
  7%|▋         | 24855/371472 [1:58:42<30:16:38,  3.18it/s]
  7%|▋         | 24856/371472 [1:58:42<28:49:46,  3.34it/s]
  7%|▋         | 24857/371472 [1:58:42<28:24:48,  3.39it/s]
  7%|▋         | 24858/371472 [1:58:43<28:01:33,  3.44it/s]
  7%|▋         | 24859/371472 [1:58:43<27:50:59,  3.46it/s]
  7%|▋         | 24860/371472 [1:58:43<27:27:37,  3.51it/s]
                                                           
{'loss': 4.4397, 'learning_rate': 9.402217242345235e-07, 'epoch': 1.07}

  7%|▋         | 24860/371472 [1:58:43<27:27:37,  3.51it/s]
  7%|▋         | 24861/371472 [1:58:44<27:16:09,  3.53it/s]
  7%|▋         | 24862/371472 [1:58:44<26:43:56,  3.60it/s]
  7%|▋         | 24863/371472 [1:58:44<26:56:23,  3.57it/s]
  7%|▋         | 24864/371472 [1:58:44<27:22:04,  3.52it/s]
  7%|▋         | 24865/371472 [1:58:45<26:27:09,  3.64it/s]
  7%|▋         | 24866/371472 [1:58:45<25:54:53,  3.72it/s]
  7%|▋         | 24867/371472 [1:58:45<27:28:36,  3.50it/s]
  7%|▋         | 24868/371472 [1:58:46<27:26:38,  3.51it/s]
  7%|▋         | 24869/371472 [1:58:46<25:59:45,  3.70it/s]
  7%|▋         | 24870/371472 [1:58:46<26:58:13,  3.57it/s]
  7%|▋         | 24871/371472 [1:58:46<26:16:24,  3.66it/s]
  7%|▋         | 24872/371472 [1:58:47<29:46:26,  3.23it/s]
  7%|▋         | 24873/371472 [1:58:47<28:30:31,  3.38it/s]
  7%|▋         | 24874/371472 [1:58:47<28:06:45,  3.42it/s]
  7%|▋         | 24875/371472 [1:58:48<27:28:35,  3.50it/s]
  7%|▋         | 24876/371472 [1:58:48<28:35:55,  3.37it/s]
  7%|▋         | 24877/371472 [1:58:48<28:13:50,  3.41it/s]
  7%|▋         | 24878/371472 [1:58:48<28:05:32,  3.43it/s]
  7%|▋         | 24879/371472 [1:58:49<27:18:55,  3.52it/s]
  7%|▋         | 24880/371472 [1:58:49<26:43:34,  3.60it/s]
                                                           
{'loss': 4.4409, 'learning_rate': 9.401732422590445e-07, 'epoch': 1.07}

  7%|▋         | 24880/371472 [1:58:49<26:43:34,  3.60it/s]
  7%|▋         | 24881/371472 [1:58:49<26:17:05,  3.66it/s]
  7%|▋         | 24882/371472 [1:58:50<26:47:46,  3.59it/s]
  7%|▋         | 24883/371472 [1:58:50<25:36:45,  3.76it/s]
  7%|▋         | 24884/371472 [1:58:50<24:49:09,  3.88it/s]
  7%|▋         | 24885/371472 [1:58:50<26:58:17,  3.57it/s]
  7%|▋         | 24886/371472 [1:58:51<26:42:42,  3.60it/s]
  7%|▋         | 24887/371472 [1:58:51<29:30:10,  3.26it/s]
  7%|▋         | 24888/371472 [1:58:51<28:50:27,  3.34it/s]
  7%|▋         | 24889/371472 [1:58:52<28:40:51,  3.36it/s]
  7%|▋         | 24890/371472 [1:58:52<29:40:40,  3.24it/s]
  7%|▋         | 24891/371472 [1:58:52<29:08:26,  3.30it/s]
  7%|▋         | 24892/371472 [1:58:52<27:16:37,  3.53it/s]
  7%|▋         | 24893/371472 [1:58:53<28:56:43,  3.33it/s]
  7%|▋         | 24894/371472 [1:58:53<29:08:44,  3.30it/s]
  7%|▋         | 24895/371472 [1:58:53<27:35:40,  3.49it/s]
  7%|▋         | 24896/371472 [1:58:54<26:43:06,  3.60it/s]
  7%|▋         | 24897/371472 [1:58:54<26:04:32,  3.69it/s]
  7%|▋         | 24898/371472 [1:58:54<26:24:11,  3.65it/s]
  7%|▋         | 24899/371472 [1:58:54<27:13:11,  3.54it/s]
  7%|▋         | 24900/371472 [1:58:55<27:10:31,  3.54it/s]
                                                           
{'loss': 4.5023, 'learning_rate': 9.401247602835657e-07, 'epoch': 1.07}

  7%|▋         | 24900/371472 [1:58:55<27:10:31,  3.54it/s]
  7%|▋         | 24901/371472 [1:58:55<28:00:01,  3.44it/s]
  7%|▋         | 24902/371472 [1:58:55<27:49:03,  3.46it/s]
  7%|▋         | 24903/371472 [1:58:56<26:37:35,  3.62it/s]
  7%|▋         | 24904/371472 [1:58:56<26:43:08,  3.60it/s]
  7%|▋         | 24905/371472 [1:58:56<29:20:47,  3.28it/s]
  7%|▋         | 24906/371472 [1:58:57<29:23:49,  3.27it/s]
  7%|▋         | 24907/371472 [1:58:57<29:50:26,  3.23it/s]
  7%|▋         | 24908/371472 [1:58:57<28:22:44,  3.39it/s]
  7%|▋         | 24909/371472 [1:58:57<26:32:50,  3.63it/s]
  7%|▋         | 24910/371472 [1:58:58<27:52:30,  3.45it/s]
  7%|▋         | 24911/371472 [1:58:58<26:59:16,  3.57it/s]
  7%|▋         | 24912/371472 [1:58:58<27:21:53,  3.52it/s]
  7%|▋         | 24913/371472 [1:58:59<27:51:11,  3.46it/s]
  7%|▋         | 24914/371472 [1:58:59<27:15:48,  3.53it/s]
  7%|▋         | 24915/371472 [1:58:59<26:41:44,  3.61it/s]
  7%|▋         | 24916/371472 [1:58:59<29:57:35,  3.21it/s]
  7%|▋         | 24917/371472 [1:59:00<29:52:20,  3.22it/s]
  7%|▋         | 24918/371472 [1:59:00<31:06:34,  3.09it/s]
  7%|▋         | 24919/371472 [1:59:00<30:02:55,  3.20it/s]
  7%|▋         | 24920/371472 [1:59:01<31:00:36,  3.10it/s]
                                                           
{'loss': 4.3031, 'learning_rate': 9.400762783080868e-07, 'epoch': 1.07}

  7%|▋         | 24920/371472 [1:59:01<31:00:36,  3.10it/s]
  7%|▋         | 24921/371472 [1:59:01<29:27:03,  3.27it/s]
  7%|▋         | 24922/371472 [1:59:01<28:15:21,  3.41it/s]
  7%|▋         | 24923/371472 [1:59:02<28:13:03,  3.41it/s]
  7%|▋         | 24924/371472 [1:59:02<28:03:49,  3.43it/s]
  7%|▋         | 24925/371472 [1:59:02<28:03:12,  3.43it/s]
  7%|▋         | 24926/371472 [1:59:02<26:53:25,  3.58it/s]
  7%|▋         | 24927/371472 [1:59:03<27:00:09,  3.56it/s]
  7%|▋         | 24928/371472 [1:59:03<26:34:40,  3.62it/s]
  7%|▋         | 24929/371472 [1:59:03<26:44:07,  3.60it/s]
  7%|▋         | 24930/371472 [1:59:03<25:47:30,  3.73it/s]
  7%|▋         | 24931/371472 [1:59:04<28:19:24,  3.40it/s]
  7%|▋         | 24932/371472 [1:59:04<27:13:07,  3.54it/s]
  7%|▋         | 24933/371472 [1:59:04<27:59:55,  3.44it/s]
  7%|▋         | 24934/371472 [1:59:05<26:45:53,  3.60it/s]
  7%|▋         | 24935/371472 [1:59:05<26:47:59,  3.59it/s]
  7%|▋         | 24936/371472 [1:59:05<25:35:49,  3.76it/s]
  7%|▋         | 24937/371472 [1:59:05<25:30:44,  3.77it/s]
  7%|▋         | 24938/371472 [1:59:06<26:51:45,  3.58it/s]
  7%|▋         | 24939/371472 [1:59:06<28:22:28,  3.39it/s]
  7%|▋         | 24940/371472 [1:59:06<27:06:49,  3.55it/s]
                                                           
{'loss': 4.4672, 'learning_rate': 9.400277963326078e-07, 'epoch': 1.07}

  7%|▋         | 24940/371472 [1:59:06<27:06:49,  3.55it/s]
  7%|▋         | 24941/371472 [1:59:07<27:39:18,  3.48it/s]
  7%|▋         | 24942/371472 [1:59:07<27:10:34,  3.54it/s]
  7%|▋         | 24943/371472 [1:59:07<26:00:58,  3.70it/s]
  7%|▋         | 24944/371472 [1:59:07<29:02:27,  3.31it/s]
  7%|▋         | 24945/371472 [1:59:08<28:16:16,  3.40it/s]
  7%|▋         | 24946/371472 [1:59:08<28:39:37,  3.36it/s]
  7%|▋         | 24947/371472 [1:59:08<29:48:48,  3.23it/s]
  7%|▋         | 24948/371472 [1:59:09<29:09:07,  3.30it/s]
  7%|▋         | 24949/371472 [1:59:09<29:37:02,  3.25it/s]
  7%|▋         | 24950/371472 [1:59:09<28:54:29,  3.33it/s]
  7%|▋         | 24951/371472 [1:59:10<27:40:31,  3.48it/s]
  7%|▋         | 24952/371472 [1:59:10<27:40:57,  3.48it/s]
  7%|▋         | 24953/371472 [1:59:10<27:05:08,  3.55it/s]
  7%|▋         | 24954/371472 [1:59:10<27:36:20,  3.49it/s]
  7%|▋         | 24955/371472 [1:59:11<27:15:50,  3.53it/s]
  7%|▋         | 24956/371472 [1:59:11<26:12:44,  3.67it/s]
  7%|▋         | 24957/371472 [1:59:11<25:39:29,  3.75it/s]
  7%|▋         | 24958/371472 [1:59:11<26:07:16,  3.68it/s]
  7%|▋         | 24959/371472 [1:59:12<26:25:23,  3.64it/s]
  7%|▋         | 24960/371472 [1:59:12<26:06:25,  3.69it/s]
                                                           
{'loss': 4.6026, 'learning_rate': 9.399793143571289e-07, 'epoch': 1.08}

  7%|▋         | 24960/371472 [1:59:12<26:06:25,  3.69it/s]
  7%|▋         | 24961/371472 [1:59:12<26:21:20,  3.65it/s]
  7%|▋         | 24962/371472 [1:59:13<29:15:12,  3.29it/s]
  7%|▋         | 24963/371472 [1:59:13<29:52:34,  3.22it/s]
  7%|▋         | 24964/371472 [1:59:13<29:20:34,  3.28it/s]
  7%|▋         | 24965/371472 [1:59:14<28:23:01,  3.39it/s]
  7%|▋         | 24966/371472 [1:59:14<27:12:40,  3.54it/s]
  7%|▋         | 24967/371472 [1:59:14<27:26:50,  3.51it/s]
  7%|▋         | 24968/371472 [1:59:14<27:18:10,  3.53it/s]
  7%|▋         | 24969/371472 [1:59:15<26:52:45,  3.58it/s]
  7%|▋         | 24970/371472 [1:59:15<25:57:54,  3.71it/s]
  7%|▋         | 24971/371472 [1:59:15<26:49:02,  3.59it/s]
  7%|▋         | 24972/371472 [1:59:15<26:38:08,  3.61it/s]
  7%|▋         | 24973/371472 [1:59:16<26:03:00,  3.69it/s]
  7%|▋         | 24974/371472 [1:59:16<25:13:25,  3.82it/s]
  7%|▋         | 24975/371472 [1:59:16<28:04:38,  3.43it/s]
  7%|▋         | 24976/371472 [1:59:17<29:10:58,  3.30it/s]
  7%|▋         | 24977/371472 [1:59:17<29:18:29,  3.28it/s]
  7%|▋         | 24978/371472 [1:59:17<28:20:19,  3.40it/s]
  7%|▋         | 24979/371472 [1:59:18<28:05:50,  3.43it/s]
  7%|▋         | 24980/371472 [1:59:18<31:52:36,  3.02it/s]
                                                           
{'loss': 4.4296, 'learning_rate': 9.399308323816501e-07, 'epoch': 1.08}

  7%|▋         | 24980/371472 [1:59:18<31:52:36,  3.02it/s]
  7%|▋         | 24981/371472 [1:59:18<30:37:05,  3.14it/s]
  7%|▋         | 24982/371472 [1:59:19<29:31:24,  3.26it/s]
  7%|▋         | 24983/371472 [1:59:19<28:02:54,  3.43it/s]
  7%|▋         | 24984/371472 [1:59:19<27:29:12,  3.50it/s]
  7%|▋         | 24985/371472 [1:59:19<27:03:58,  3.56it/s]
  7%|▋         | 24986/371472 [1:59:20<26:35:48,  3.62it/s]
  7%|▋         | 24987/371472 [1:59:20<26:35:40,  3.62it/s]
  7%|▋         | 24988/371472 [1:59:20<26:07:31,  3.68it/s]
  7%|▋         | 24989/371472 [1:59:20<25:19:38,  3.80it/s]
  7%|▋         | 24990/371472 [1:59:21<26:02:41,  3.70it/s]
  7%|▋         | 24991/371472 [1:59:21<27:08:41,  3.55it/s]
  7%|▋         | 24992/371472 [1:59:21<26:36:43,  3.62it/s]
  7%|▋         | 24993/371472 [1:59:22<27:45:59,  3.47it/s]
  7%|▋         | 24994/371472 [1:59:22<27:31:27,  3.50it/s]
  7%|▋         | 24995/371472 [1:59:22<27:31:58,  3.50it/s]
  7%|▋         | 24996/371472 [1:59:22<27:38:43,  3.48it/s]
  7%|▋         | 24997/371472 [1:59:23<26:02:41,  3.70it/s]
  7%|▋         | 24998/371472 [1:59:23<25:31:42,  3.77it/s]
  7%|▋         | 24999/371472 [1:59:23<27:08:22,  3.55it/s]
  7%|▋         | 25000/371472 [1:59:24<27:49:39,  3.46it/s]
                                                           
{'loss': 4.4177, 'learning_rate': 9.398823504061712e-07, 'epoch': 1.08}

  7%|▋         | 25000/371472 [1:59:24<27:49:39,  3.46it/s]
  7%|▋         | 25001/371472 [1:59:24<26:50:02,  3.59it/s]
  7%|▋         | 25002/371472 [1:59:24<27:04:23,  3.55it/s]
  7%|▋         | 25003/371472 [1:59:24<28:01:43,  3.43it/s]
  7%|▋         | 25004/371472 [1:59:25<28:39:02,  3.36it/s]
  7%|▋         | 25005/371472 [1:59:25<28:14:24,  3.41it/s]
  7%|▋         | 25006/371472 [1:59:25<27:15:20,  3.53it/s]
  7%|▋         | 25007/371472 [1:59:25<26:06:10,  3.69it/s]
  7%|▋         | 25008/371472 [1:59:26<25:22:10,  3.79it/s]
  7%|▋         | 25009/371472 [1:59:26<26:00:41,  3.70it/s]
  7%|▋         | 25010/371472 [1:59:26<26:10:15,  3.68it/s]
  7%|▋         | 25011/371472 [1:59:27<26:23:01,  3.65it/s]
  7%|▋         | 25012/371472 [1:59:27<26:13:00,  3.67it/s]
  7%|▋         | 25013/371472 [1:59:27<26:01:52,  3.70it/s]
  7%|▋         | 25014/371472 [1:59:27<26:00:16,  3.70it/s]
  7%|▋         | 25015/371472 [1:59:28<26:07:38,  3.68it/s]
  7%|▋         | 25016/371472 [1:59:28<25:26:13,  3.78it/s]
  7%|▋         | 25017/371472 [1:59:28<26:53:42,  3.58it/s]
  7%|▋         | 25018/371472 [1:59:28<26:35:49,  3.62it/s]
  7%|▋         | 25019/371472 [1:59:29<27:55:41,  3.45it/s]
  7%|▋         | 25020/371472 [1:59:29<27:26:33,  3.51it/s]
                                                           
{'loss': 4.5838, 'learning_rate': 9.398338684306922e-07, 'epoch': 1.08}

  7%|▋         | 25020/371472 [1:59:29<27:26:33,  3.51it/s]
  7%|▋         | 25021/371472 [1:59:29<27:08:14,  3.55it/s]
  7%|▋         | 25022/371472 [1:59:30<29:58:30,  3.21it/s]
  7%|▋         | 25023/371472 [1:59:30<29:21:53,  3.28it/s]
  7%|▋         | 25024/371472 [1:59:30<30:20:21,  3.17it/s]
  7%|▋         | 25025/371472 [1:59:31<30:28:21,  3.16it/s]
  7%|▋         | 25026/371472 [1:59:31<28:39:33,  3.36it/s]
  7%|▋         | 25027/371472 [1:59:31<28:09:19,  3.42it/s]
  7%|▋         | 25028/371472 [1:59:31<27:14:16,  3.53it/s]
  7%|▋         | 25029/371472 [1:59:32<26:43:21,  3.60it/s]
  7%|▋         | 25030/371472 [1:59:32<28:07:13,  3.42it/s]
  7%|▋         | 25031/371472 [1:59:32<29:47:57,  3.23it/s]
  7%|▋         | 25032/371472 [1:59:33<28:04:01,  3.43it/s]
  7%|▋         | 25033/371472 [1:59:33<26:33:30,  3.62it/s]
  7%|▋         | 25034/371472 [1:59:33<26:30:22,  3.63it/s]
  7%|▋         | 25035/371472 [1:59:33<26:27:18,  3.64it/s]
  7%|▋         | 25036/371472 [1:59:34<28:25:58,  3.38it/s]
  7%|▋         | 25037/371472 [1:59:34<29:08:37,  3.30it/s]
  7%|▋         | 25038/371472 [1:59:34<28:25:31,  3.39it/s]
  7%|▋         | 25039/371472 [1:59:35<31:34:10,  3.05it/s]
  7%|▋         | 25040/371472 [1:59:35<29:35:16,  3.25it/s]
                                                           
{'loss': 4.3385, 'learning_rate': 9.397853864552134e-07, 'epoch': 1.08}

  7%|▋         | 25040/371472 [1:59:35<29:35:16,  3.25it/s]
  7%|▋         | 25041/371472 [1:59:35<28:14:54,  3.41it/s]
  7%|▋         | 25042/371472 [1:59:36<27:10:45,  3.54it/s]
  7%|▋         | 25043/371472 [1:59:36<27:03:54,  3.56it/s]
  7%|▋         | 25044/371472 [1:59:36<26:49:29,  3.59it/s]
  7%|▋         | 25045/371472 [1:59:36<26:24:36,  3.64it/s]
  7%|▋         | 25046/371472 [1:59:37<28:03:03,  3.43it/s]
  7%|▋         | 25047/371472 [1:59:37<26:22:41,  3.65it/s]
  7%|▋         | 25048/371472 [1:59:37<26:21:12,  3.65it/s]
  7%|▋         | 25049/371472 [1:59:37<26:09:43,  3.68it/s]
  7%|▋         | 25050/371472 [1:59:38<29:04:22,  3.31it/s]
  7%|▋         | 25051/371472 [1:59:38<27:39:38,  3.48it/s]
  7%|▋         | 25052/371472 [1:59:38<28:10:05,  3.42it/s]
  7%|▋         | 25053/371472 [1:59:39<27:03:48,  3.56it/s]
  7%|▋         | 25054/371472 [1:59:39<27:01:56,  3.56it/s]
  7%|▋         | 25055/371472 [1:59:39<26:01:52,  3.70it/s]
  7%|▋         | 25056/371472 [1:59:39<26:41:52,  3.60it/s]
  7%|▋         | 25057/371472 [1:59:40<26:36:35,  3.62it/s]
  7%|▋         | 25058/371472 [1:59:40<28:02:47,  3.43it/s]
  7%|▋         | 25059/371472 [1:59:40<26:59:30,  3.57it/s]
  7%|▋         | 25060/371472 [1:59:41<26:03:42,  3.69it/s]
                                                           
{'loss': 4.4873, 'learning_rate': 9.397369044797345e-07, 'epoch': 1.08}

  7%|▋         | 25060/371472 [1:59:41<26:03:42,  3.69it/s]
  7%|▋         | 25061/371472 [1:59:41<26:36:05,  3.62it/s]
  7%|▋         | 25062/371472 [1:59:41<25:52:18,  3.72it/s]
  7%|▋         | 25063/371472 [1:59:41<25:58:14,  3.71it/s]
  7%|▋         | 25064/371472 [1:59:42<25:47:02,  3.73it/s]
  7%|▋         | 25065/371472 [1:59:42<25:15:22,  3.81it/s]
  7%|▋         | 25066/371472 [1:59:42<26:28:28,  3.63it/s]
  7%|▋         | 25067/371472 [1:59:42<25:55:52,  3.71it/s]
  7%|▋         | 25068/371472 [1:59:43<25:38:55,  3.75it/s]
  7%|▋         | 25069/371472 [1:59:43<26:57:50,  3.57it/s]
  7%|▋         | 25070/371472 [1:59:43<26:26:20,  3.64it/s]
  7%|▋         | 25071/371472 [1:59:44<26:22:55,  3.65it/s]
  7%|▋         | 25072/371472 [1:59:44<25:32:43,  3.77it/s]
  7%|▋         | 25073/371472 [1:59:44<25:24:51,  3.79it/s]
  7%|▋         | 25074/371472 [1:59:44<25:14:32,  3.81it/s]
  7%|▋         | 25075/371472 [1:59:45<25:04:32,  3.84it/s]
  7%|▋         | 25076/371472 [1:59:45<24:27:45,  3.93it/s]
  7%|▋         | 25077/371472 [1:59:45<25:07:04,  3.83it/s]
  7%|▋         | 25078/371472 [1:59:45<25:09:16,  3.83it/s]
  7%|▋         | 25079/371472 [1:59:46<26:01:40,  3.70it/s]
  7%|▋         | 25080/371472 [1:59:46<26:06:02,  3.69it/s]
                                                           
{'loss': 4.6927, 'learning_rate': 9.396884225042555e-07, 'epoch': 1.08}

  7%|▋         | 25080/371472 [1:59:46<26:06:02,  3.69it/s]
  7%|▋         | 25081/371472 [1:59:46<25:54:34,  3.71it/s]
  7%|▋         | 25082/371472 [1:59:47<26:42:30,  3.60it/s]
  7%|▋         | 25083/371472 [1:59:47<27:36:18,  3.49it/s]
  7%|▋         | 25084/371472 [1:59:47<27:13:21,  3.53it/s]
  7%|▋         | 25085/371472 [1:59:47<26:51:24,  3.58it/s]
  7%|▋         | 25086/371472 [1:59:48<26:46:35,  3.59it/s]
  7%|▋         | 25087/371472 [1:59:48<26:20:38,  3.65it/s]
  7%|▋         | 25088/371472 [1:59:48<27:44:33,  3.47it/s]
  7%|▋         | 25089/371472 [1:59:48<27:00:14,  3.56it/s]
  7%|▋         | 25090/371472 [1:59:49<26:25:09,  3.64it/s]
  7%|▋         | 25091/371472 [1:59:49<25:49:45,  3.73it/s]
  7%|▋         | 25092/371472 [1:59:49<25:49:16,  3.73it/s]
  7%|▋         | 25093/371472 [1:59:50<25:36:13,  3.76it/s]
  7%|▋         | 25094/371472 [1:59:50<27:33:58,  3.49it/s]
  7%|▋         | 25095/371472 [1:59:50<28:35:20,  3.37it/s]
  7%|▋         | 25096/371472 [1:59:50<28:42:47,  3.35it/s]
  7%|▋         | 25097/371472 [1:59:51<28:25:43,  3.38it/s]
  7%|▋         | 25098/371472 [1:59:51<28:09:46,  3.42it/s]
  7%|▋         | 25099/371472 [1:59:51<26:54:25,  3.58it/s]
  7%|▋         | 25100/371472 [1:59:52<26:51:03,  3.58it/s]
                                                           
{'loss': 4.1841, 'learning_rate': 9.396399405287766e-07, 'epoch': 1.08}

  7%|▋         | 25100/371472 [1:59:52<26:51:03,  3.58it/s]
  7%|▋         | 25101/371472 [1:59:52<27:08:17,  3.55it/s]
  7%|▋         | 25102/371472 [1:59:52<26:39:04,  3.61it/s]
  7%|▋         | 25103/371472 [1:59:52<26:28:09,  3.63it/s]
  7%|▋         | 25104/371472 [1:59:53<28:36:26,  3.36it/s]
  7%|▋         | 25105/371472 [1:59:53<27:27:52,  3.50it/s]
  7%|▋         | 25106/371472 [1:59:53<26:19:34,  3.65it/s]
  7%|▋         | 25107/371472 [1:59:54<26:46:58,  3.59it/s]
  7%|▋         | 25108/371472 [1:59:54<29:07:45,  3.30it/s]
  7%|▋         | 25109/371472 [1:59:54<31:59:30,  3.01it/s]
  7%|▋         | 25110/371472 [1:59:55<29:35:52,  3.25it/s]
  7%|▋         | 25111/371472 [1:59:55<31:16:44,  3.08it/s]
  7%|▋         | 25112/371472 [1:59:55<29:01:05,  3.32it/s]
  7%|▋         | 25113/371472 [1:59:55<27:34:58,  3.49it/s]
  7%|▋         | 25114/371472 [1:59:56<30:57:30,  3.11it/s]
  7%|▋         | 25115/371472 [1:59:56<31:16:07,  3.08it/s]
  7%|▋         | 25116/371472 [1:59:56<28:46:22,  3.34it/s]
  7%|▋         | 25117/371472 [1:59:57<28:49:52,  3.34it/s]
  7%|▋         | 25118/371472 [1:59:57<31:30:15,  3.05it/s]
  7%|▋         | 25119/371472 [1:59:57<30:57:30,  3.11it/s]
  7%|▋         | 25120/371472 [1:59:58<28:48:09,  3.34it/s]
                                                           
{'loss': 4.4341, 'learning_rate': 9.395914585532978e-07, 'epoch': 1.08}

  7%|▋         | 25120/371472 [1:59:58<28:48:09,  3.34it/s]
  7%|▋         | 25121/371472 [1:59:58<27:21:39,  3.52it/s]
  7%|▋         | 25122/371472 [1:59:58<26:56:35,  3.57it/s]
  7%|▋         | 25123/371472 [1:59:58<26:42:56,  3.60it/s]
  7%|▋         | 25124/371472 [1:59:59<26:06:12,  3.69it/s]
  7%|▋         | 25125/371472 [1:59:59<25:12:26,  3.82it/s]
  7%|▋         | 25126/371472 [1:59:59<25:41:05,  3.75it/s]
  7%|▋         | 25127/371472 [1:59:59<24:52:09,  3.87it/s]
  7%|▋         | 25128/371472 [2:00:00<26:32:08,  3.63it/s]
  7%|▋         | 25129/371472 [2:00:00<26:10:32,  3.68it/s]
  7%|▋         | 25130/371472 [2:00:00<26:11:12,  3.67it/s]
  7%|▋         | 25131/371472 [2:00:01<25:39:01,  3.75it/s]
  7%|▋         | 25132/371472 [2:00:01<25:19:08,  3.80it/s]
  7%|▋         | 25133/371472 [2:00:01<25:53:56,  3.71it/s]
  7%|▋         | 25134/371472 [2:00:01<25:26:12,  3.78it/s]
  7%|▋         | 25135/371472 [2:00:02<25:00:27,  3.85it/s]
  7%|▋         | 25136/371472 [2:00:02<26:37:42,  3.61it/s]
  7%|▋         | 25137/371472 [2:00:02<26:45:15,  3.60it/s]
  7%|▋         | 25138/371472 [2:00:02<25:55:30,  3.71it/s]
  7%|▋         | 25139/371472 [2:00:03<25:55:22,  3.71it/s]
  7%|▋         | 25140/371472 [2:00:03<25:21:30,  3.79it/s]
                                                           
{'loss': 4.3862, 'learning_rate': 9.395429765778189e-07, 'epoch': 1.08}

  7%|▋         | 25140/371472 [2:00:03<25:21:30,  3.79it/s]
  7%|▋         | 25141/371472 [2:00:03<25:38:51,  3.75it/s]
  7%|▋         | 25142/371472 [2:00:04<25:39:19,  3.75it/s]
  7%|▋         | 25143/371472 [2:00:04<26:26:41,  3.64it/s]
  7%|▋         | 25144/371472 [2:00:04<27:50:40,  3.45it/s]
  7%|▋         | 25145/371472 [2:00:04<26:42:40,  3.60it/s]
  7%|▋         | 25146/371472 [2:00:05<26:21:48,  3.65it/s]
  7%|▋         | 25147/371472 [2:00:05<26:56:57,  3.57it/s]
  7%|▋         | 25148/371472 [2:00:05<26:53:59,  3.58it/s]
  7%|▋         | 25149/371472 [2:00:06<28:30:44,  3.37it/s]
  7%|▋         | 25150/371472 [2:00:06<28:04:45,  3.43it/s]
  7%|▋         | 25151/371472 [2:00:06<26:47:11,  3.59it/s]
  7%|▋         | 25152/371472 [2:00:06<26:18:24,  3.66it/s]
  7%|▋         | 25153/371472 [2:00:07<27:02:34,  3.56it/s]
  7%|▋         | 25154/371472 [2:00:07<26:23:13,  3.65it/s]
  7%|▋         | 25155/371472 [2:00:07<27:32:36,  3.49it/s]
  7%|▋         | 25156/371472 [2:00:07<27:21:10,  3.52it/s]
  7%|▋         | 25157/371472 [2:00:08<27:07:00,  3.55it/s]
  7%|▋         | 25158/371472 [2:00:08<26:33:27,  3.62it/s]
  7%|▋         | 25159/371472 [2:00:08<27:08:27,  3.54it/s]
  7%|▋         | 25160/371472 [2:00:09<26:08:20,  3.68it/s]
                                                           
{'loss': 4.5278, 'learning_rate': 9.394944946023401e-07, 'epoch': 1.08}

  7%|▋         | 25160/371472 [2:00:09<26:08:20,  3.68it/s]
  7%|▋         | 25161/371472 [2:00:09<26:23:28,  3.65it/s]
  7%|▋         | 25162/371472 [2:00:09<26:01:41,  3.70it/s]
  7%|▋         | 25163/371472 [2:00:09<25:06:40,  3.83it/s]
  7%|▋         | 25164/371472 [2:00:10<27:37:38,  3.48it/s]
  7%|▋         | 25165/371472 [2:00:10<28:25:18,  3.38it/s]
  7%|▋         | 25166/371472 [2:00:10<27:00:34,  3.56it/s]
  7%|▋         | 25167/371472 [2:00:11<26:04:24,  3.69it/s]
  7%|▋         | 25168/371472 [2:00:11<25:59:34,  3.70it/s]
  7%|▋         | 25169/371472 [2:00:11<25:02:07,  3.84it/s]
  7%|▋         | 25170/371472 [2:00:11<25:11:27,  3.82it/s]
  7%|▋         | 25171/371472 [2:00:12<27:07:28,  3.55it/s]
  7%|▋         | 25172/371472 [2:00:12<26:14:12,  3.67it/s]
  7%|▋         | 25173/371472 [2:00:12<27:13:21,  3.53it/s]
  7%|▋         | 25174/371472 [2:00:12<26:51:21,  3.58it/s]
  7%|▋         | 25175/371472 [2:00:13<26:29:35,  3.63it/s]
  7%|▋         | 25176/371472 [2:00:13<27:18:55,  3.52it/s]
  7%|▋         | 25177/371472 [2:00:13<27:46:26,  3.46it/s]
  7%|▋         | 25178/371472 [2:00:14<27:51:47,  3.45it/s]
  7%|▋         | 25179/371472 [2:00:14<28:18:11,  3.40it/s]
  7%|▋         | 25180/371472 [2:00:14<28:26:38,  3.38it/s]
                                                           
{'loss': 4.3656, 'learning_rate': 9.394460126268612e-07, 'epoch': 1.08}

  7%|▋         | 25180/371472 [2:00:14<28:26:38,  3.38it/s]
  7%|▋         | 25181/371472 [2:00:15<30:18:52,  3.17it/s]
  7%|▋         | 25182/371472 [2:00:15<29:28:35,  3.26it/s]
  7%|▋         | 25183/371472 [2:00:15<30:00:20,  3.21it/s]
  7%|▋         | 25184/371472 [2:00:15<29:15:12,  3.29it/s]
  7%|▋         | 25185/371472 [2:00:16<28:28:48,  3.38it/s]
  7%|▋         | 25186/371472 [2:00:16<29:09:01,  3.30it/s]
  7%|▋         | 25187/371472 [2:00:16<28:43:37,  3.35it/s]
  7%|▋         | 25188/371472 [2:00:17<27:45:25,  3.47it/s]
  7%|▋         | 25189/371472 [2:00:17<27:38:17,  3.48it/s]
  7%|▋         | 25190/371472 [2:00:17<27:16:39,  3.53it/s]
  7%|▋         | 25191/371472 [2:00:17<28:08:06,  3.42it/s]
  7%|▋         | 25192/371472 [2:00:18<26:53:11,  3.58it/s]
  7%|▋         | 25193/371472 [2:00:18<26:08:33,  3.68it/s]
  7%|▋         | 25194/371472 [2:00:18<27:46:03,  3.46it/s]
  7%|▋         | 25195/371472 [2:00:19<26:30:23,  3.63it/s]
  7%|▋         | 25196/371472 [2:00:19<26:05:02,  3.69it/s]
  7%|▋         | 25197/371472 [2:00:19<26:27:26,  3.64it/s]
  7%|▋         | 25198/371472 [2:00:19<26:59:53,  3.56it/s]
  7%|▋         | 25199/371472 [2:00:20<28:07:25,  3.42it/s]
  7%|▋         | 25200/371472 [2:00:20<28:36:48,  3.36it/s]
                                                           
{'loss': 4.3609, 'learning_rate': 9.393975306513822e-07, 'epoch': 1.09}

  7%|▋         | 25200/371472 [2:00:20<28:36:48,  3.36it/s]
  7%|▋         | 25201/371472 [2:00:20<27:04:23,  3.55it/s]
  7%|▋         | 25202/371472 [2:00:21<26:28:45,  3.63it/s]
  7%|▋         | 25203/371472 [2:00:21<27:30:10,  3.50it/s]
  7%|▋         | 25204/371472 [2:00:21<27:43:01,  3.47it/s]
  7%|▋         | 25205/371472 [2:00:21<28:37:27,  3.36it/s]
  7%|▋         | 25206/371472 [2:00:22<27:32:38,  3.49it/s]
  7%|▋         | 25207/371472 [2:00:22<26:37:50,  3.61it/s]
  7%|▋         | 25208/371472 [2:00:22<27:15:10,  3.53it/s]
  7%|▋         | 25209/371472 [2:00:23<25:55:44,  3.71it/s]
  7%|▋         | 25210/371472 [2:00:23<25:24:51,  3.78it/s]
  7%|▋         | 25211/371472 [2:00:23<26:37:59,  3.61it/s]
  7%|▋         | 25212/371472 [2:00:23<27:11:28,  3.54it/s]
  7%|▋         | 25213/371472 [2:00:24<29:07:42,  3.30it/s]
  7%|▋         | 25214/371472 [2:00:24<28:05:43,  3.42it/s]
  7%|▋         | 25215/371472 [2:00:24<27:08:21,  3.54it/s]
  7%|▋         | 25216/371472 [2:00:24<26:03:47,  3.69it/s]
  7%|▋         | 25217/371472 [2:00:25<25:17:29,  3.80it/s]
  7%|▋         | 25218/371472 [2:00:25<25:04:18,  3.84it/s]
  7%|▋         | 25219/371472 [2:00:25<25:14:51,  3.81it/s]
  7%|▋         | 25220/371472 [2:00:26<25:04:00,  3.84it/s]
                                                           
{'loss': 4.432, 'learning_rate': 9.393490486759033e-07, 'epoch': 1.09}

  7%|▋         | 25220/371472 [2:00:26<25:04:00,  3.84it/s]
  7%|▋         | 25221/371472 [2:00:26<25:18:10,  3.80it/s]
  7%|▋         | 25222/371472 [2:00:26<24:57:39,  3.85it/s]
  7%|▋         | 25223/371472 [2:00:26<25:32:31,  3.77it/s]
  7%|▋         | 25224/371472 [2:00:27<26:14:05,  3.67it/s]
  7%|▋         | 25225/371472 [2:00:27<26:17:18,  3.66it/s]
  7%|▋         | 25226/371472 [2:00:27<26:03:03,  3.69it/s]
  7%|▋         | 25227/371472 [2:00:27<26:00:59,  3.70it/s]
  7%|▋         | 25228/371472 [2:00:28<25:30:36,  3.77it/s]
  7%|▋         | 25229/371472 [2:00:28<25:54:22,  3.71it/s]
  7%|▋         | 25230/371472 [2:00:28<27:12:26,  3.54it/s]
  7%|▋         | 25231/371472 [2:00:29<27:37:49,  3.48it/s]
  7%|▋         | 25232/371472 [2:00:29<28:05:20,  3.42it/s]
  7%|▋         | 25233/371472 [2:00:29<27:43:00,  3.47it/s]
  7%|▋         | 25234/371472 [2:00:29<26:37:48,  3.61it/s]
  7%|▋         | 25235/371472 [2:00:30<25:50:07,  3.72it/s]
  7%|▋         | 25236/371472 [2:00:30<26:51:25,  3.58it/s]
  7%|▋         | 25237/371472 [2:00:30<26:23:26,  3.64it/s]
  7%|▋         | 25238/371472 [2:00:30<26:17:08,  3.66it/s]
  7%|▋         | 25239/371472 [2:00:31<26:42:55,  3.60it/s]
  7%|▋         | 25240/371472 [2:00:31<26:32:17,  3.62it/s]
                                                           
{'loss': 4.4633, 'learning_rate': 9.393005667004245e-07, 'epoch': 1.09}

  7%|▋         | 25240/371472 [2:00:31<26:32:17,  3.62it/s]
  7%|▋         | 25241/371472 [2:00:31<25:59:42,  3.70it/s]
  7%|▋         | 25242/371472 [2:00:32<27:19:33,  3.52it/s]
  7%|▋         | 25243/371472 [2:00:32<26:37:08,  3.61it/s]
  7%|▋         | 25244/371472 [2:00:32<26:49:15,  3.59it/s]
  7%|▋         | 25245/371472 [2:00:32<26:30:57,  3.63it/s]
  7%|▋         | 25246/371472 [2:00:33<25:57:41,  3.70it/s]
  7%|▋         | 25247/371472 [2:00:33<26:47:12,  3.59it/s]
  7%|▋         | 25248/371472 [2:00:33<26:26:10,  3.64it/s]
  7%|▋         | 25249/371472 [2:00:34<30:11:39,  3.19it/s]
  7%|▋         | 25250/371472 [2:00:34<30:32:07,  3.15it/s]
  7%|▋         | 25251/371472 [2:00:34<33:16:40,  2.89it/s]
  7%|▋         | 25252/371472 [2:00:35<32:19:29,  2.98it/s]
  7%|▋         | 25253/371472 [2:00:35<29:32:14,  3.26it/s]
  7%|▋         | 25254/371472 [2:00:35<28:25:04,  3.38it/s]
  7%|▋         | 25255/371472 [2:00:35<28:02:39,  3.43it/s]
  7%|▋         | 25256/371472 [2:00:36<29:17:16,  3.28it/s]
  7%|▋         | 25257/371472 [2:00:36<28:13:39,  3.41it/s]
  7%|▋         | 25258/371472 [2:00:36<27:52:45,  3.45it/s]
  7%|▋         | 25259/371472 [2:00:37<28:33:09,  3.37it/s]
  7%|▋         | 25260/371472 [2:00:37<27:08:12,  3.54it/s]
                                                           
{'loss': 4.3571, 'learning_rate': 9.392520847249455e-07, 'epoch': 1.09}

  7%|▋         | 25260/371472 [2:00:37<27:08:12,  3.54it/s]
  7%|▋         | 25261/371472 [2:00:37<26:45:54,  3.59it/s]
  7%|▋         | 25262/371472 [2:00:37<25:57:32,  3.70it/s]
  7%|▋         | 25263/371472 [2:00:38<27:57:11,  3.44it/s]
  7%|▋         | 25264/371472 [2:00:38<28:32:18,  3.37it/s]
  7%|▋         | 25265/371472 [2:00:38<28:51:06,  3.33it/s]
  7%|▋         | 25266/371472 [2:00:39<27:24:41,  3.51it/s]
  7%|▋         | 25267/371472 [2:00:39<27:41:11,  3.47it/s]
  7%|▋         | 25268/371472 [2:00:39<28:25:44,  3.38it/s]
  7%|▋         | 25269/371472 [2:00:40<27:42:39,  3.47it/s]
  7%|▋         | 25270/371472 [2:00:40<28:58:23,  3.32it/s]
  7%|▋         | 25271/371472 [2:00:40<27:55:34,  3.44it/s]
  7%|▋         | 25272/371472 [2:00:41<30:18:39,  3.17it/s]
  7%|▋         | 25273/371472 [2:00:41<28:27:52,  3.38it/s]
  7%|▋         | 25274/371472 [2:00:41<28:04:30,  3.43it/s]
  7%|▋         | 25275/371472 [2:00:41<28:06:19,  3.42it/s]
  7%|▋         | 25276/371472 [2:00:42<26:36:19,  3.61it/s]
  7%|▋         | 25277/371472 [2:00:42<26:17:56,  3.66it/s]
  7%|▋         | 25278/371472 [2:00:42<27:41:05,  3.47it/s]
  7%|▋         | 25279/371472 [2:00:42<27:58:01,  3.44it/s]
  7%|▋         | 25280/371472 [2:00:43<26:58:45,  3.56it/s]
                                                           
{'loss': 4.3883, 'learning_rate': 9.392036027494667e-07, 'epoch': 1.09}

  7%|▋         | 25280/371472 [2:00:43<26:58:45,  3.56it/s]
  7%|▋         | 25281/371472 [2:00:43<29:11:58,  3.29it/s]
  7%|▋         | 25282/371472 [2:00:43<28:14:44,  3.40it/s]
  7%|▋         | 25283/371472 [2:00:44<28:41:24,  3.35it/s]
  7%|▋         | 25284/371472 [2:00:44<27:42:45,  3.47it/s]
  7%|▋         | 25285/371472 [2:00:44<27:15:11,  3.53it/s]
  7%|▋         | 25286/371472 [2:00:44<26:50:28,  3.58it/s]
  7%|▋         | 25287/371472 [2:00:45<28:19:59,  3.39it/s]
  7%|▋         | 25288/371472 [2:00:45<29:35:37,  3.25it/s]
  7%|▋         | 25289/371472 [2:00:45<28:58:42,  3.32it/s]
  7%|▋         | 25290/371472 [2:00:46<29:48:42,  3.23it/s]
  7%|▋         | 25291/371472 [2:00:46<28:38:51,  3.36it/s]
  7%|▋         | 25292/371472 [2:00:46<28:17:26,  3.40it/s]
  7%|▋         | 25293/371472 [2:00:47<27:41:32,  3.47it/s]
  7%|▋         | 25294/371472 [2:00:47<26:30:32,  3.63it/s]
  7%|▋         | 25295/371472 [2:00:47<26:39:34,  3.61it/s]
  7%|▋         | 25296/371472 [2:00:47<26:07:03,  3.68it/s]
  7%|▋         | 25297/371472 [2:00:48<25:56:21,  3.71it/s]
  7%|▋         | 25298/371472 [2:00:48<25:39:25,  3.75it/s]
  7%|▋         | 25299/371472 [2:00:48<26:05:14,  3.69it/s]
  7%|▋         | 25300/371472 [2:00:48<25:49:11,  3.72it/s]
                                                           
{'loss': 4.5822, 'learning_rate': 9.391551207739878e-07, 'epoch': 1.09}

  7%|▋         | 25300/371472 [2:00:48<25:49:11,  3.72it/s]
  7%|▋         | 25301/371472 [2:00:49<24:56:34,  3.86it/s]
  7%|▋         | 25302/371472 [2:00:49<26:57:51,  3.57it/s]
  7%|▋         | 25303/371472 [2:00:49<26:35:14,  3.62it/s]
  7%|▋         | 25304/371472 [2:00:50<25:48:20,  3.73it/s]
  7%|▋         | 25305/371472 [2:00:50<27:28:45,  3.50it/s]
  7%|▋         | 25306/371472 [2:00:50<28:17:00,  3.40it/s]
  7%|▋         | 25307/371472 [2:00:50<28:31:47,  3.37it/s]
  7%|▋         | 25308/371472 [2:00:51<27:53:36,  3.45it/s]
  7%|▋         | 25309/371472 [2:00:51<30:21:00,  3.17it/s]
  7%|▋         | 25310/371472 [2:00:51<28:33:28,  3.37it/s]
  7%|▋         | 25311/371472 [2:00:52<28:13:57,  3.41it/s]
  7%|▋         | 25312/371472 [2:00:52<28:16:06,  3.40it/s]
  7%|▋         | 25313/371472 [2:00:52<28:17:58,  3.40it/s]
  7%|▋         | 25314/371472 [2:00:53<27:34:40,  3.49it/s]
  7%|▋         | 25315/371472 [2:00:53<27:36:53,  3.48it/s]
  7%|▋         | 25316/371472 [2:00:53<29:11:10,  3.29it/s]
  7%|▋         | 25317/371472 [2:00:53<28:18:23,  3.40it/s]
  7%|▋         | 25318/371472 [2:00:54<26:56:04,  3.57it/s]
  7%|▋         | 25319/371472 [2:00:54<26:48:43,  3.59it/s]
  7%|▋         | 25320/371472 [2:00:54<28:11:24,  3.41it/s]
                                                           
{'loss': 4.416, 'learning_rate': 9.39106638798509e-07, 'epoch': 1.09}

  7%|▋         | 25320/371472 [2:00:54<28:11:24,  3.41it/s]
  7%|▋         | 25321/371472 [2:00:55<28:47:53,  3.34it/s]
  7%|▋         | 25322/371472 [2:00:55<27:57:28,  3.44it/s]
  7%|▋         | 25323/371472 [2:00:55<28:43:26,  3.35it/s]
  7%|▋         | 25324/371472 [2:00:56<33:34:43,  2.86it/s]
  7%|▋         | 25325/371472 [2:00:56<32:24:59,  2.97it/s]
  7%|▋         | 25326/371472 [2:00:56<30:14:30,  3.18it/s]
  7%|▋         | 25327/371472 [2:00:56<29:08:24,  3.30it/s]
  7%|▋         | 25328/371472 [2:00:57<27:42:09,  3.47it/s]
  7%|▋         | 25329/371472 [2:00:57<27:19:31,  3.52it/s]
  7%|▋         | 25330/371472 [2:00:57<27:25:53,  3.51it/s]
  7%|▋         | 25331/371472 [2:00:58<27:21:44,  3.51it/s]
  7%|▋         | 25332/371472 [2:00:58<28:15:04,  3.40it/s]
  7%|▋         | 25333/371472 [2:00:58<27:49:20,  3.46it/s]
  7%|▋         | 25334/371472 [2:00:58<28:10:58,  3.41it/s]
  7%|▋         | 25335/371472 [2:00:59<31:00:15,  3.10it/s]
  7%|▋         | 25336/371472 [2:00:59<29:18:02,  3.28it/s]
  7%|▋         | 25337/371472 [2:00:59<27:30:15,  3.50it/s]
  7%|▋         | 25338/371472 [2:01:00<26:42:10,  3.60it/s]
  7%|▋         | 25339/371472 [2:01:00<26:12:17,  3.67it/s]
  7%|▋         | 25340/371472 [2:01:00<25:21:00,  3.79it/s]
                                                           
{'loss': 4.3431, 'learning_rate': 9.390581568230299e-07, 'epoch': 1.09}

  7%|▋         | 25340/371472 [2:01:00<25:21:00,  3.79it/s]
  7%|▋         | 25341/371472 [2:01:01<29:38:19,  3.24it/s]
  7%|▋         | 25342/371472 [2:01:01<29:25:01,  3.27it/s]
  7%|▋         | 25343/371472 [2:01:01<29:11:50,  3.29it/s]
  7%|▋         | 25344/371472 [2:01:01<27:32:14,  3.49it/s]
  7%|▋         | 25345/371472 [2:01:02<26:54:19,  3.57it/s]
  7%|▋         | 25346/371472 [2:01:02<26:48:27,  3.59it/s]
  7%|▋         | 25347/371472 [2:01:02<28:05:12,  3.42it/s]
  7%|▋         | 25348/371472 [2:01:03<29:10:23,  3.30it/s]
  7%|▋         | 25349/371472 [2:01:03<27:32:23,  3.49it/s]
  7%|▋         | 25350/371472 [2:01:03<30:18:03,  3.17it/s]
  7%|▋         | 25351/371472 [2:01:03<29:17:08,  3.28it/s]
  7%|▋         | 25352/371472 [2:01:04<27:49:24,  3.46it/s]
  7%|▋         | 25353/371472 [2:01:04<27:23:51,  3.51it/s]
  7%|▋         | 25354/371472 [2:01:04<26:25:56,  3.64it/s]
  7%|▋         | 25355/371472 [2:01:05<27:18:45,  3.52it/s]
  7%|▋         | 25356/371472 [2:01:05<27:26:09,  3.50it/s]
  7%|▋         | 25357/371472 [2:01:05<31:47:13,  3.02it/s]
  7%|▋         | 25358/371472 [2:01:06<30:10:19,  3.19it/s]
  7%|▋         | 25359/371472 [2:01:06<27:57:22,  3.44it/s]
  7%|▋         | 25360/371472 [2:01:06<28:01:19,  3.43it/s]
                                                           
{'loss': 4.5583, 'learning_rate': 9.390096748475511e-07, 'epoch': 1.09}

  7%|▋         | 25360/371472 [2:01:06<28:01:19,  3.43it/s]
  7%|▋         | 25361/371472 [2:01:06<28:31:18,  3.37it/s]
  7%|▋         | 25362/371472 [2:01:07<32:22:51,  2.97it/s]
  7%|▋         | 25363/371472 [2:01:07<32:17:11,  2.98it/s]
  7%|▋         | 25364/371472 [2:01:08<32:29:41,  2.96it/s]
  7%|▋         | 25365/371472 [2:01:08<33:02:05,  2.91it/s]
  7%|▋         | 25366/371472 [2:01:08<31:03:36,  3.10it/s]
  7%|▋         | 25367/371472 [2:01:08<30:40:05,  3.13it/s]
  7%|▋         | 25368/371472 [2:01:09<29:26:49,  3.26it/s]
  7%|▋         | 25369/371472 [2:01:09<29:13:05,  3.29it/s]
  7%|▋         | 25370/371472 [2:01:09<28:21:27,  3.39it/s]
  7%|▋         | 25371/371472 [2:01:10<30:00:39,  3.20it/s]
  7%|▋         | 25372/371472 [2:01:10<28:39:13,  3.36it/s]
  7%|▋         | 25373/371472 [2:01:10<27:32:29,  3.49it/s]
  7%|▋         | 25374/371472 [2:01:10<28:13:42,  3.41it/s]
  7%|▋         | 25375/371472 [2:01:11<28:40:36,  3.35it/s]
  7%|▋         | 25376/371472 [2:01:11<27:48:19,  3.46it/s]
  7%|▋         | 25377/371472 [2:01:11<27:45:05,  3.46it/s]
  7%|▋         | 25378/371472 [2:01:12<27:04:51,  3.55it/s]
  7%|▋         | 25379/371472 [2:01:12<26:16:38,  3.66it/s]
  7%|▋         | 25380/371472 [2:01:12<28:47:26,  3.34it/s]
                                                           
{'loss': 4.3422, 'learning_rate': 9.389611928720722e-07, 'epoch': 1.09}

  7%|▋         | 25380/371472 [2:01:12<28:47:26,  3.34it/s]
  7%|▋         | 25381/371472 [2:01:13<29:12:37,  3.29it/s]
  7%|▋         | 25382/371472 [2:01:13<28:05:58,  3.42it/s]
  7%|▋         | 25383/371472 [2:01:13<26:44:35,  3.59it/s]
  7%|▋         | 25384/371472 [2:01:13<26:09:10,  3.68it/s]
  7%|▋         | 25385/371472 [2:01:14<25:09:10,  3.82it/s]
  7%|▋         | 25386/371472 [2:01:14<25:53:28,  3.71it/s]
  7%|▋         | 25387/371472 [2:01:14<25:19:13,  3.80it/s]
  7%|▋         | 25388/371472 [2:01:14<25:47:16,  3.73it/s]
  7%|▋         | 25389/371472 [2:01:15<25:38:59,  3.75it/s]
  7%|▋         | 25390/371472 [2:01:15<24:44:09,  3.89it/s]
  7%|▋         | 25391/371472 [2:01:15<24:35:22,  3.91it/s]
  7%|▋         | 25392/371472 [2:01:15<23:49:43,  4.03it/s]
  7%|▋         | 25393/371472 [2:01:16<24:22:32,  3.94it/s]
  7%|▋         | 25394/371472 [2:01:16<25:10:07,  3.82it/s]
  7%|▋         | 25395/371472 [2:01:16<27:27:23,  3.50it/s]
  7%|▋         | 25396/371472 [2:01:17<28:30:47,  3.37it/s]
  7%|▋         | 25397/371472 [2:01:17<28:56:13,  3.32it/s]
  7%|▋         | 25398/371472 [2:01:17<27:24:57,  3.51it/s]
  7%|▋         | 25399/371472 [2:01:17<27:16:15,  3.53it/s]
  7%|▋         | 25400/371472 [2:01:18<26:12:13,  3.67it/s]
                                                           
{'loss': 4.4077, 'learning_rate': 9.389127108965933e-07, 'epoch': 1.09}

  7%|▋         | 25400/371472 [2:01:18<26:12:13,  3.67it/s]
  7%|▋         | 25401/371472 [2:01:18<27:55:52,  3.44it/s]
  7%|▋         | 25402/371472 [2:01:18<27:00:58,  3.56it/s]
  7%|▋         | 25403/371472 [2:01:19<26:33:11,  3.62it/s]
  7%|▋         | 25404/371472 [2:01:19<28:15:55,  3.40it/s]
  7%|▋         | 25405/371472 [2:01:19<26:40:32,  3.60it/s]
  7%|▋         | 25406/371472 [2:01:19<26:08:40,  3.68it/s]
  7%|▋         | 25407/371472 [2:01:20<29:32:44,  3.25it/s]
  7%|▋         | 25408/371472 [2:01:20<28:09:05,  3.41it/s]
  7%|▋         | 25409/371472 [2:01:20<27:52:27,  3.45it/s]
  7%|▋         | 25410/371472 [2:01:21<27:17:37,  3.52it/s]
  7%|▋         | 25411/371472 [2:01:21<26:24:54,  3.64it/s]
  7%|▋         | 25412/371472 [2:01:21<27:12:14,  3.53it/s]
  7%|▋         | 25413/371472 [2:01:21<26:45:07,  3.59it/s]
  7%|▋         | 25414/371472 [2:01:22<26:54:27,  3.57it/s]
  7%|▋         | 25415/371472 [2:01:22<28:48:38,  3.34it/s]
  7%|▋         | 25416/371472 [2:01:22<28:13:16,  3.41it/s]
  7%|▋         | 25417/371472 [2:01:23<30:24:26,  3.16it/s]
  7%|▋         | 25418/371472 [2:01:23<29:15:56,  3.28it/s]
  7%|▋         | 25419/371472 [2:01:23<28:24:52,  3.38it/s]
  7%|▋         | 25420/371472 [2:01:23<28:00:50,  3.43it/s]
                                                           
{'loss': 4.4079, 'learning_rate': 9.388642289211144e-07, 'epoch': 1.09}

  7%|▋         | 25420/371472 [2:01:23<28:00:50,  3.43it/s]
  7%|▋         | 25421/371472 [2:01:24<27:07:39,  3.54it/s]
  7%|▋         | 25422/371472 [2:01:24<27:06:14,  3.55it/s]
  7%|▋         | 25423/371472 [2:01:24<27:01:08,  3.56it/s]
  7%|▋         | 25424/371472 [2:01:25<27:37:21,  3.48it/s]
  7%|▋         | 25425/371472 [2:01:25<27:25:27,  3.51it/s]
  7%|▋         | 25426/371472 [2:01:25<27:42:52,  3.47it/s]
  7%|▋         | 25427/371472 [2:01:25<27:52:54,  3.45it/s]
  7%|▋         | 25428/371472 [2:01:26<27:19:00,  3.52it/s]
  7%|▋         | 25429/371472 [2:01:26<26:30:08,  3.63it/s]
  7%|▋         | 25430/371472 [2:01:26<27:41:32,  3.47it/s]
  7%|▋         | 25431/371472 [2:01:27<27:21:05,  3.51it/s]
  7%|▋         | 25432/371472 [2:01:27<26:25:10,  3.64it/s]
  7%|▋         | 25433/371472 [2:01:27<26:44:02,  3.60it/s]
  7%|▋         | 25434/371472 [2:01:27<26:43:56,  3.60it/s]
  7%|▋         | 25435/371472 [2:01:28<26:03:09,  3.69it/s]
  7%|▋         | 25436/371472 [2:01:28<28:50:38,  3.33it/s]
  7%|▋         | 25437/371472 [2:01:28<28:34:35,  3.36it/s]
  7%|▋         | 25438/371472 [2:01:29<27:12:49,  3.53it/s]
  7%|▋         | 25439/371472 [2:01:29<28:18:39,  3.40it/s]
  7%|▋         | 25440/371472 [2:01:29<28:31:16,  3.37it/s]
                                                           
{'loss': 4.581, 'learning_rate': 9.388157469456356e-07, 'epoch': 1.1}

  7%|▋         | 25440/371472 [2:01:29<28:31:16,  3.37it/s]
  7%|▋         | 25441/371472 [2:01:29<28:06:05,  3.42it/s]
  7%|▋         | 25442/371472 [2:01:30<27:59:59,  3.43it/s]
  7%|▋         | 25443/371472 [2:01:30<27:18:30,  3.52it/s]
  7%|▋         | 25444/371472 [2:01:30<27:15:13,  3.53it/s]
  7%|▋         | 25445/371472 [2:01:31<27:15:56,  3.53it/s]
  7%|▋         | 25446/371472 [2:01:31<26:12:04,  3.67it/s]
  7%|▋         | 25447/371472 [2:01:31<27:36:41,  3.48it/s]
  7%|▋         | 25448/371472 [2:01:31<27:25:31,  3.50it/s]
  7%|▋         | 25449/371472 [2:01:32<29:26:35,  3.26it/s]
  7%|▋         | 25450/371472 [2:01:32<27:19:02,  3.52it/s]
  7%|▋         | 25451/371472 [2:01:32<27:11:04,  3.54it/s]
  7%|▋         | 25452/371472 [2:01:33<26:35:36,  3.61it/s]
  7%|▋         | 25453/371472 [2:01:33<26:52:38,  3.58it/s]
  7%|▋         | 25454/371472 [2:01:33<27:05:09,  3.55it/s]
  7%|▋         | 25455/371472 [2:01:33<26:13:06,  3.67it/s]
  7%|▋         | 25456/371472 [2:01:34<25:36:38,  3.75it/s]
  7%|▋         | 25457/371472 [2:01:34<25:34:34,  3.76it/s]
  7%|▋         | 25458/371472 [2:01:34<25:18:30,  3.80it/s]
  7%|▋         | 25459/371472 [2:01:34<25:05:04,  3.83it/s]
  7%|▋         | 25460/371472 [2:01:35<25:02:35,  3.84it/s]
                                                           
{'loss': 4.3695, 'learning_rate': 9.387672649701566e-07, 'epoch': 1.1}

  7%|▋         | 25460/371472 [2:01:35<25:02:35,  3.84it/s]
  7%|▋         | 25461/371472 [2:01:35<24:56:53,  3.85it/s]
  7%|▋         | 25462/371472 [2:01:35<24:32:45,  3.92it/s]
  7%|▋         | 25463/371472 [2:01:36<26:41:29,  3.60it/s]
  7%|▋         | 25464/371472 [2:01:36<25:41:16,  3.74it/s]
  7%|▋         | 25465/371472 [2:01:36<28:27:41,  3.38it/s]
  7%|▋         | 25466/371472 [2:01:36<27:39:44,  3.47it/s]
  7%|▋         | 25467/371472 [2:01:37<27:05:10,  3.55it/s]
  7%|▋         | 25468/371472 [2:01:37<26:34:34,  3.62it/s]
  7%|▋         | 25469/371472 [2:01:37<26:11:56,  3.67it/s]
  7%|▋         | 25470/371472 [2:01:37<24:59:54,  3.84it/s]
  7%|▋         | 25471/371472 [2:01:38<27:08:03,  3.54it/s]
  7%|▋         | 25472/371472 [2:01:38<27:24:43,  3.51it/s]
  7%|▋         | 25473/371472 [2:01:38<27:04:23,  3.55it/s]
  7%|▋         | 25474/371472 [2:01:39<26:43:00,  3.60it/s]
  7%|▋         | 25475/371472 [2:01:39<27:11:49,  3.53it/s]
  7%|▋         | 25476/371472 [2:01:39<26:16:03,  3.66it/s]
  7%|▋         | 25477/371472 [2:01:39<27:39:31,  3.47it/s]
  7%|▋         | 25478/371472 [2:01:40<28:46:43,  3.34it/s]
  7%|▋         | 25479/371472 [2:01:40<30:42:09,  3.13it/s]
  7%|▋         | 25480/371472 [2:01:40<29:04:25,  3.31it/s]
                                                           
{'loss': 4.2777, 'learning_rate': 9.387187829946776e-07, 'epoch': 1.1}

  7%|▋         | 25480/371472 [2:01:40<29:04:25,  3.31it/s]
  7%|▋         | 25481/371472 [2:01:41<27:45:44,  3.46it/s]
  7%|▋         | 25482/371472 [2:01:41<26:47:50,  3.59it/s]
  7%|▋         | 25483/371472 [2:01:41<29:12:58,  3.29it/s]
  7%|▋         | 25484/371472 [2:01:42<29:53:20,  3.22it/s]
  7%|▋         | 25485/371472 [2:01:42<29:10:46,  3.29it/s]
  7%|▋         | 25486/371472 [2:01:42<28:18:57,  3.39it/s]
  7%|▋         | 25487/371472 [2:01:42<28:13:46,  3.40it/s]
  7%|▋         | 25488/371472 [2:01:43<27:36:11,  3.48it/s]
  7%|▋         | 25489/371472 [2:01:43<30:15:35,  3.18it/s]
  7%|▋         | 25490/371472 [2:01:43<28:45:10,  3.34it/s]
  7%|▋         | 25491/371472 [2:01:44<28:35:24,  3.36it/s]
  7%|▋         | 25492/371472 [2:01:44<27:43:00,  3.47it/s]
  7%|▋         | 25493/371472 [2:01:44<27:00:49,  3.56it/s]
  7%|▋         | 25494/371472 [2:01:45<31:39:09,  3.04it/s]
  7%|▋         | 25495/371472 [2:01:45<31:03:33,  3.09it/s]
  7%|▋         | 25496/371472 [2:01:45<29:26:07,  3.26it/s]
  7%|▋         | 25497/371472 [2:01:46<31:22:13,  3.06it/s]
  7%|▋         | 25498/371472 [2:01:46<29:50:06,  3.22it/s]
  7%|▋         | 25499/371472 [2:01:46<28:20:44,  3.39it/s]
  7%|▋         | 25500/371472 [2:01:47<31:15:50,  3.07it/s]
                                                           
{'loss': 4.5497, 'learning_rate': 9.386703010191988e-07, 'epoch': 1.1}

  7%|▋         | 25500/371472 [2:01:47<31:15:50,  3.07it/s]
  7%|▋         | 25501/371472 [2:01:47<30:31:24,  3.15it/s]
  7%|▋         | 25502/371472 [2:01:47<29:02:48,  3.31it/s]
  7%|▋         | 25503/371472 [2:01:47<28:34:46,  3.36it/s]
  7%|▋         | 25504/371472 [2:01:48<27:40:14,  3.47it/s]
  7%|▋         | 25505/371472 [2:01:48<28:24:01,  3.38it/s]
  7%|▋         | 25506/371472 [2:01:48<27:34:13,  3.49it/s]
  7%|▋         | 25507/371472 [2:01:49<29:14:44,  3.29it/s]
  7%|▋         | 25508/371472 [2:01:49<29:50:44,  3.22it/s]
  7%|▋         | 25509/371472 [2:01:49<28:50:38,  3.33it/s]
  7%|▋         | 25510/371472 [2:01:49<27:20:49,  3.51it/s]
  7%|▋         | 25511/371472 [2:01:50<26:48:47,  3.58it/s]
  7%|▋         | 25512/371472 [2:01:50<26:09:59,  3.67it/s]
  7%|▋         | 25513/371472 [2:01:50<25:55:06,  3.71it/s]
  7%|▋         | 25514/371472 [2:01:50<26:30:25,  3.63it/s]
  7%|▋         | 25515/371472 [2:01:51<26:21:46,  3.65it/s]
  7%|▋         | 25516/371472 [2:01:51<25:39:20,  3.75it/s]
  7%|▋         | 25517/371472 [2:01:51<25:33:19,  3.76it/s]
  7%|▋         | 25518/371472 [2:01:52<25:29:07,  3.77it/s]
  7%|▋         | 25519/371472 [2:01:52<25:13:18,  3.81it/s]
  7%|▋         | 25520/371472 [2:01:52<25:13:34,  3.81it/s]
                                                           
{'loss': 4.4497, 'learning_rate': 9.3862181904372e-07, 'epoch': 1.1}

  7%|▋         | 25520/371472 [2:01:52<25:13:34,  3.81it/s]
  7%|▋         | 25521/371472 [2:01:52<25:30:32,  3.77it/s]
  7%|▋         | 25522/371472 [2:01:53<25:30:37,  3.77it/s]
  7%|▋         | 25523/371472 [2:01:53<25:06:00,  3.83it/s]
  7%|▋         | 25524/371472 [2:01:53<26:07:57,  3.68it/s]
  7%|▋         | 25525/371472 [2:01:53<25:59:10,  3.70it/s]
  7%|▋         | 25526/371472 [2:01:54<27:31:56,  3.49it/s]
  7%|▋         | 25527/371472 [2:01:54<28:10:54,  3.41it/s]
  7%|▋         | 25528/371472 [2:01:54<27:46:35,  3.46it/s]
  7%|▋         | 25529/371472 [2:01:55<26:53:48,  3.57it/s]
  7%|▋         | 25530/371472 [2:01:55<26:38:44,  3.61it/s]
  7%|▋         | 25531/371472 [2:01:55<28:56:30,  3.32it/s]
  7%|▋         | 25532/371472 [2:01:56<29:30:36,  3.26it/s]
  7%|▋         | 25533/371472 [2:01:56<28:40:46,  3.35it/s]
  7%|▋         | 25534/371472 [2:01:56<27:38:14,  3.48it/s]
  7%|▋         | 25535/371472 [2:01:56<26:52:52,  3.57it/s]
  7%|▋         | 25536/371472 [2:01:57<25:51:39,  3.72it/s]
  7%|▋         | 25537/371472 [2:01:57<25:36:58,  3.75it/s]
  7%|▋         | 25538/371472 [2:01:57<25:32:35,  3.76it/s]
  7%|▋         | 25539/371472 [2:01:57<25:24:23,  3.78it/s]
  7%|▋         | 25540/371472 [2:01:58<25:23:58,  3.78it/s]
                                                           
{'loss': 4.3623, 'learning_rate': 9.38573337068241e-07, 'epoch': 1.1}

  7%|▋         | 25540/371472 [2:01:58<25:23:58,  3.78it/s]
  7%|▋         | 25541/371472 [2:01:58<25:27:40,  3.77it/s]
  7%|▋         | 25542/371472 [2:01:58<25:53:11,  3.71it/s]
  7%|▋         | 25543/371472 [2:01:58<25:19:50,  3.79it/s]
  7%|▋         | 25544/371472 [2:01:59<25:54:44,  3.71it/s]
  7%|▋         | 25545/371472 [2:01:59<25:24:50,  3.78it/s]
  7%|▋         | 25546/371472 [2:01:59<26:05:51,  3.68it/s]
  7%|▋         | 25547/371472 [2:02:00<26:31:16,  3.62it/s]
  7%|▋         | 25548/371472 [2:02:00<26:03:18,  3.69it/s]
  7%|▋         | 25549/371472 [2:02:00<25:55:56,  3.71it/s]
  7%|▋         | 25550/371472 [2:02:00<25:29:06,  3.77it/s]
  7%|▋         | 25551/371472 [2:02:01<25:19:17,  3.79it/s]
  7%|▋         | 25552/371472 [2:02:01<26:00:52,  3.69it/s]
  7%|▋         | 25553/371472 [2:02:01<26:20:08,  3.65it/s]
  7%|▋         | 25554/371472 [2:02:01<26:26:15,  3.63it/s]
  7%|▋         | 25555/371472 [2:02:02<27:23:09,  3.51it/s]
  7%|▋         | 25556/371472 [2:02:02<27:45:47,  3.46it/s]
  7%|▋         | 25557/371472 [2:02:02<27:44:14,  3.46it/s]
  7%|▋         | 25558/371472 [2:02:03<27:16:36,  3.52it/s]
  7%|▋         | 25559/371472 [2:02:03<27:13:14,  3.53it/s]
  7%|▋         | 25560/371472 [2:02:03<26:58:38,  3.56it/s]
                                                           
{'loss': 4.609, 'learning_rate': 9.385248550927621e-07, 'epoch': 1.1}

  7%|▋         | 25560/371472 [2:02:03<26:58:38,  3.56it/s]
  7%|▋         | 25561/371472 [2:02:03<26:26:25,  3.63it/s]
  7%|▋         | 25562/371472 [2:02:04<25:32:27,  3.76it/s]
  7%|▋         | 25563/371472 [2:02:04<26:22:46,  3.64it/s]
  7%|▋         | 25564/371472 [2:02:04<28:34:57,  3.36it/s]
  7%|▋         | 25565/371472 [2:02:05<27:26:22,  3.50it/s]
  7%|▋         | 25566/371472 [2:02:05<27:00:05,  3.56it/s]
  7%|▋         | 25567/371472 [2:02:05<29:11:59,  3.29it/s]
  7%|▋         | 25568/371472 [2:02:05<28:37:54,  3.36it/s]
  7%|▋         | 25569/371472 [2:02:06<28:46:29,  3.34it/s]
  7%|▋         | 25570/371472 [2:02:06<27:52:57,  3.45it/s]
  7%|▋         | 25571/371472 [2:02:06<26:32:34,  3.62it/s]
  7%|▋         | 25572/371472 [2:02:07<26:40:25,  3.60it/s]
  7%|▋         | 25573/371472 [2:02:07<27:03:48,  3.55it/s]
  7%|▋         | 25574/371472 [2:02:07<26:33:32,  3.62it/s]
  7%|▋         | 25575/371472 [2:02:07<26:24:13,  3.64it/s]
  7%|▋         | 25576/371472 [2:02:08<26:29:21,  3.63it/s]
  7%|▋         | 25577/371472 [2:02:08<27:52:03,  3.45it/s]
  7%|▋         | 25578/371472 [2:02:08<28:17:28,  3.40it/s]
  7%|▋         | 25579/371472 [2:02:09<28:11:19,  3.41it/s]
  7%|▋         | 25580/371472 [2:02:09<26:47:55,  3.59it/s]
                                                           
{'loss': 4.2504, 'learning_rate': 9.384763731172833e-07, 'epoch': 1.1}

  7%|▋         | 25580/371472 [2:02:09<26:47:55,  3.59it/s]
  7%|▋         | 25581/371472 [2:02:09<27:05:39,  3.55it/s]
  7%|▋         | 25582/371472 [2:02:09<26:59:38,  3.56it/s]
  7%|▋         | 25583/371472 [2:02:10<28:35:01,  3.36it/s]
  7%|▋         | 25584/371472 [2:02:10<27:24:19,  3.51it/s]
  7%|▋         | 25585/371472 [2:02:10<26:31:43,  3.62it/s]
  7%|▋         | 25586/371472 [2:02:11<25:48:40,  3.72it/s]
  7%|▋         | 25587/371472 [2:02:11<26:30:26,  3.62it/s]
  7%|▋         | 25588/371472 [2:02:11<27:59:26,  3.43it/s]
  7%|▋         | 25589/371472 [2:02:11<27:47:55,  3.46it/s]
  7%|▋         | 25590/371472 [2:02:12<29:32:07,  3.25it/s]
  7%|▋         | 25591/371472 [2:02:12<28:55:03,  3.32it/s]
  7%|▋         | 25592/371472 [2:02:12<29:42:59,  3.23it/s]
  7%|▋         | 25593/371472 [2:02:13<28:16:47,  3.40it/s]
  7%|▋         | 25594/371472 [2:02:13<27:41:50,  3.47it/s]
  7%|▋         | 25595/371472 [2:02:13<27:16:05,  3.52it/s]
  7%|▋         | 25596/371472 [2:02:13<26:27:43,  3.63it/s]
  7%|▋         | 25597/371472 [2:02:14<25:31:57,  3.76it/s]
  7%|▋         | 25598/371472 [2:02:14<25:36:27,  3.75it/s]
  7%|▋         | 25599/371472 [2:02:14<24:54:24,  3.86it/s]
  7%|▋         | 25600/371472 [2:02:15<27:31:39,  3.49it/s]
                                                           
{'loss': 4.5254, 'learning_rate': 9.384278911418043e-07, 'epoch': 1.1}

  7%|▋         | 25600/371472 [2:02:15<27:31:39,  3.49it/s]
  7%|▋         | 25601/371472 [2:02:15<26:31:51,  3.62it/s]
  7%|▋         | 25602/371472 [2:02:15<26:42:58,  3.60it/s]
  7%|▋         | 25603/371472 [2:02:15<26:27:52,  3.63it/s]
  7%|▋         | 25604/371472 [2:02:16<27:28:56,  3.50it/s]
  7%|▋         | 25605/371472 [2:02:16<26:30:21,  3.62it/s]
  7%|▋         | 25606/371472 [2:02:16<25:53:39,  3.71it/s]
  7%|▋         | 25607/371472 [2:02:16<26:05:02,  3.68it/s]
  7%|▋         | 25608/371472 [2:02:17<26:12:01,  3.67it/s]
  7%|▋         | 25609/371472 [2:02:17<27:15:27,  3.52it/s]
  7%|▋         | 25610/371472 [2:02:17<27:42:41,  3.47it/s]
  7%|▋         | 25611/371472 [2:02:18<27:10:24,  3.54it/s]
  7%|▋         | 25612/371472 [2:02:18<26:40:52,  3.60it/s]
  7%|▋         | 25613/371472 [2:02:18<27:17:44,  3.52it/s]
  7%|▋         | 25614/371472 [2:02:18<26:39:36,  3.60it/s]
  7%|▋         | 25615/371472 [2:02:19<27:08:20,  3.54it/s]
  7%|▋         | 25616/371472 [2:02:19<26:57:48,  3.56it/s]
  7%|▋         | 25617/371472 [2:02:19<28:24:33,  3.38it/s]
  7%|▋         | 25618/371472 [2:02:20<27:17:08,  3.52it/s]
  7%|▋         | 25619/371472 [2:02:20<26:15:28,  3.66it/s]
  7%|▋         | 25620/371472 [2:02:20<26:36:55,  3.61it/s]
                                                           
{'loss': 4.4802, 'learning_rate': 9.383794091663254e-07, 'epoch': 1.1}

  7%|▋         | 25620/371472 [2:02:20<26:36:55,  3.61it/s]
  7%|▋         | 25621/371472 [2:02:20<27:36:21,  3.48it/s]
  7%|▋         | 25622/371472 [2:02:21<27:27:26,  3.50it/s]
  7%|▋         | 25623/371472 [2:02:21<28:08:17,  3.41it/s]
  7%|▋         | 25624/371472 [2:02:21<26:55:44,  3.57it/s]
  7%|▋         | 25625/371472 [2:02:22<26:17:17,  3.65it/s]
  7%|▋         | 25626/371472 [2:02:22<25:30:02,  3.77it/s]
  7%|▋         | 25627/371472 [2:02:22<26:24:33,  3.64it/s]
  7%|▋         | 25628/371472 [2:02:22<29:11:52,  3.29it/s]
  7%|▋         | 25629/371472 [2:02:23<31:26:10,  3.06it/s]
  7%|▋         | 25630/371472 [2:02:23<31:29:19,  3.05it/s]
  7%|▋         | 25631/371472 [2:02:23<29:48:06,  3.22it/s]
  7%|▋         | 25632/371472 [2:02:24<29:58:09,  3.21it/s]
  7%|▋         | 25633/371472 [2:02:24<29:04:31,  3.30it/s]
  7%|▋         | 25634/371472 [2:02:24<27:46:00,  3.46it/s]
  7%|▋         | 25635/371472 [2:02:25<28:01:09,  3.43it/s]
  7%|▋         | 25636/371472 [2:02:25<27:13:17,  3.53it/s]
  7%|▋         | 25637/371472 [2:02:25<26:23:40,  3.64it/s]
  7%|▋         | 25638/371472 [2:02:25<27:24:58,  3.50it/s]
  7%|▋         | 25639/371472 [2:02:26<27:47:25,  3.46it/s]
  7%|▋         | 25640/371472 [2:02:26<27:32:01,  3.49it/s]
                                                           
{'loss': 4.5648, 'learning_rate': 9.383309271908465e-07, 'epoch': 1.1}

  7%|▋         | 25640/371472 [2:02:26<27:32:01,  3.49it/s]
  7%|▋         | 25641/371472 [2:02:26<32:43:17,  2.94it/s]
  7%|▋         | 25642/371472 [2:02:27<30:53:02,  3.11it/s]
  7%|▋         | 25643/371472 [2:02:27<29:09:37,  3.29it/s]
  7%|▋         | 25644/371472 [2:02:27<28:20:11,  3.39it/s]
  7%|▋         | 25645/371472 [2:02:28<27:58:53,  3.43it/s]
  7%|▋         | 25646/371472 [2:02:28<29:30:40,  3.26it/s]
  7%|▋         | 25647/371472 [2:02:28<29:03:03,  3.31it/s]
  7%|▋         | 25648/371472 [2:02:28<28:17:58,  3.39it/s]
  7%|▋         | 25649/371472 [2:02:29<28:54:06,  3.32it/s]
  7%|▋         | 25650/371472 [2:02:29<28:29:55,  3.37it/s]
  7%|▋         | 25651/371472 [2:02:29<27:27:16,  3.50it/s]
  7%|▋         | 25652/371472 [2:02:30<27:48:22,  3.45it/s]
  7%|▋         | 25653/371472 [2:02:30<29:18:09,  3.28it/s]
  7%|▋         | 25654/371472 [2:02:30<29:20:06,  3.27it/s]
  7%|▋         | 25655/371472 [2:02:31<30:45:26,  3.12it/s]
  7%|▋         | 25656/371472 [2:02:31<28:59:20,  3.31it/s]
  7%|▋         | 25657/371472 [2:02:31<27:33:17,  3.49it/s]
  7%|▋         | 25658/371472 [2:02:31<26:45:32,  3.59it/s]
  7%|▋         | 25659/371472 [2:02:32<26:37:30,  3.61it/s]
  7%|▋         | 25660/371472 [2:02:32<26:10:47,  3.67it/s]
                                                           
{'loss': 4.4582, 'learning_rate': 9.382824452153677e-07, 'epoch': 1.11}

  7%|▋         | 25660/371472 [2:02:32<26:10:47,  3.67it/s]
  7%|▋         | 25661/371472 [2:02:32<25:45:35,  3.73it/s]
  7%|▋         | 25662/371472 [2:02:33<28:55:55,  3.32it/s]
  7%|▋         | 25663/371472 [2:02:33<39:08:47,  2.45it/s]
  7%|▋         | 25664/371472 [2:02:33<35:02:35,  2.74it/s]
  7%|▋         | 25665/371472 [2:02:34<31:59:28,  3.00it/s]
  7%|▋         | 25666/371472 [2:02:34<31:26:26,  3.06it/s]
  7%|▋         | 25667/371472 [2:02:34<29:31:09,  3.25it/s]
  7%|▋         | 25668/371472 [2:02:35<28:34:29,  3.36it/s]
  7%|▋         | 25669/371472 [2:02:35<28:23:55,  3.38it/s]
  7%|▋         | 25670/371472 [2:02:35<27:22:43,  3.51it/s]
  7%|▋         | 25671/371472 [2:02:35<26:32:52,  3.62it/s]
  7%|▋         | 25672/371472 [2:02:36<26:43:37,  3.59it/s]
  7%|▋         | 25673/371472 [2:02:36<27:59:51,  3.43it/s]
  7%|▋         | 25674/371472 [2:02:36<27:20:53,  3.51it/s]
  7%|▋         | 25675/371472 [2:02:37<27:14:10,  3.53it/s]
  7%|▋         | 25676/371472 [2:02:37<26:46:58,  3.59it/s]
  7%|▋         | 25677/371472 [2:02:37<25:47:15,  3.72it/s]
  7%|▋         | 25678/371472 [2:02:37<25:13:57,  3.81it/s]
  7%|▋         | 25679/371472 [2:02:38<26:10:09,  3.67it/s]
  7%|▋         | 25680/371472 [2:02:38<31:03:28,  3.09it/s]
                                                           
{'loss': 4.5596, 'learning_rate': 9.382339632398888e-07, 'epoch': 1.11}

  7%|▋         | 25680/371472 [2:02:38<31:03:28,  3.09it/s]
  7%|▋         | 25681/371472 [2:02:38<29:49:02,  3.22it/s]
  7%|▋         | 25682/371472 [2:02:39<28:44:46,  3.34it/s]
  7%|▋         | 25683/371472 [2:02:39<28:43:45,  3.34it/s]
  7%|▋         | 25684/371472 [2:02:39<28:11:26,  3.41it/s]
  7%|▋         | 25685/371472 [2:02:39<28:34:30,  3.36it/s]
  7%|▋         | 25686/371472 [2:02:40<27:45:14,  3.46it/s]
  7%|▋         | 25687/371472 [2:02:40<27:21:59,  3.51it/s]
  7%|▋         | 25688/371472 [2:02:40<26:58:17,  3.56it/s]
  7%|▋         | 25689/371472 [2:02:41<26:23:47,  3.64it/s]
  7%|▋         | 25690/371472 [2:02:41<26:09:23,  3.67it/s]
  7%|▋         | 25691/371472 [2:02:41<26:25:16,  3.64it/s]
  7%|▋         | 25692/371472 [2:02:41<25:28:40,  3.77it/s]
  7%|▋         | 25693/371472 [2:02:42<28:13:10,  3.40it/s]
  7%|▋         | 25694/371472 [2:02:42<28:17:57,  3.39it/s]
  7%|▋         | 25695/371472 [2:02:42<30:07:18,  3.19it/s]
  7%|▋         | 25696/371472 [2:02:43<28:12:23,  3.41it/s]
  7%|▋         | 25697/371472 [2:02:43<28:43:54,  3.34it/s]
  7%|▋         | 25698/371472 [2:02:43<27:58:03,  3.43it/s]
  7%|▋         | 25699/371472 [2:02:43<27:50:42,  3.45it/s]
  7%|▋         | 25700/371472 [2:02:44<27:06:59,  3.54it/s]
                                                           
{'loss': 4.4884, 'learning_rate': 9.3818548126441e-07, 'epoch': 1.11}

  7%|▋         | 25700/371472 [2:02:44<27:06:59,  3.54it/s]
  7%|▋         | 25701/371472 [2:02:44<28:40:24,  3.35it/s]
  7%|▋         | 25702/371472 [2:02:44<29:34:36,  3.25it/s]
  7%|▋         | 25703/371472 [2:02:45<29:34:53,  3.25it/s]
  7%|▋         | 25704/371472 [2:02:45<28:07:10,  3.42it/s]
  7%|▋         | 25705/371472 [2:02:45<27:49:40,  3.45it/s]
  7%|▋         | 25706/371472 [2:02:46<28:00:51,  3.43it/s]
  7%|▋         | 25707/371472 [2:02:46<29:16:35,  3.28it/s]
  7%|▋         | 25708/371472 [2:02:46<28:53:09,  3.32it/s]
  7%|▋         | 25709/371472 [2:02:46<28:28:37,  3.37it/s]
  7%|▋         | 25710/371472 [2:02:47<27:53:07,  3.44it/s]
  7%|▋         | 25711/371472 [2:02:47<27:46:02,  3.46it/s]
  7%|▋         | 25712/371472 [2:02:47<28:24:28,  3.38it/s]
  7%|▋         | 25713/371472 [2:02:48<28:19:49,  3.39it/s]
  7%|▋         | 25714/371472 [2:02:48<29:29:04,  3.26it/s]
  7%|▋         | 25715/371472 [2:02:48<28:53:33,  3.32it/s]
  7%|▋         | 25716/371472 [2:02:49<30:13:40,  3.18it/s]
  7%|▋         | 25717/371472 [2:02:49<29:23:39,  3.27it/s]
  7%|▋         | 25718/371472 [2:02:49<28:55:34,  3.32it/s]
  7%|▋         | 25719/371472 [2:02:50<29:50:07,  3.22it/s]
  7%|▋         | 25720/371472 [2:02:50<29:18:25,  3.28it/s]
                                                           
{'loss': 4.3298, 'learning_rate': 9.381369992889309e-07, 'epoch': 1.11}

  7%|▋         | 25720/371472 [2:02:50<29:18:25,  3.28it/s]
  7%|▋         | 25721/371472 [2:02:50<28:17:42,  3.39it/s]
  7%|▋         | 25722/371472 [2:02:50<27:38:00,  3.48it/s]
  7%|▋         | 25723/371472 [2:02:51<27:59:41,  3.43it/s]
  7%|▋         | 25724/371472 [2:02:51<28:55:04,  3.32it/s]
  7%|▋         | 25725/371472 [2:02:51<28:13:34,  3.40it/s]
  7%|▋         | 25726/371472 [2:02:52<27:55:57,  3.44it/s]
  7%|▋         | 25727/371472 [2:02:52<27:44:35,  3.46it/s]
  7%|▋         | 25728/371472 [2:02:52<27:14:04,  3.53it/s]
  7%|▋         | 25729/371472 [2:02:52<27:04:02,  3.55it/s]
  7%|▋         | 25730/371472 [2:02:53<26:42:14,  3.60it/s]
  7%|▋         | 25731/371472 [2:02:53<26:15:48,  3.66it/s]
  7%|▋         | 25732/371472 [2:02:53<31:29:57,  3.05it/s]
  7%|▋         | 25733/371472 [2:02:54<30:19:56,  3.17it/s]
  7%|▋         | 25734/371472 [2:02:54<28:59:32,  3.31it/s]
  7%|▋         | 25735/371472 [2:02:54<27:44:29,  3.46it/s]
  7%|▋         | 25736/371472 [2:02:55<28:54:07,  3.32it/s]
  7%|▋         | 25737/371472 [2:02:55<28:04:03,  3.42it/s]
  7%|▋         | 25738/371472 [2:02:55<28:40:08,  3.35it/s]
  7%|▋         | 25739/371472 [2:02:55<28:01:10,  3.43it/s]
  7%|▋         | 25740/371472 [2:02:56<26:58:08,  3.56it/s]
                                                           
{'loss': 4.3468, 'learning_rate': 9.380885173134521e-07, 'epoch': 1.11}

  7%|▋         | 25740/371472 [2:02:56<26:58:08,  3.56it/s]
  7%|▋         | 25741/371472 [2:02:56<27:20:59,  3.51it/s]
  7%|▋         | 25742/371472 [2:02:56<30:23:09,  3.16it/s]
  7%|▋         | 25743/371472 [2:02:57<29:15:33,  3.28it/s]
  7%|▋         | 25744/371472 [2:02:57<28:56:05,  3.32it/s]
  7%|▋         | 25745/371472 [2:02:57<27:58:53,  3.43it/s]
  7%|▋         | 25746/371472 [2:02:57<27:08:45,  3.54it/s]
  7%|▋         | 25747/371472 [2:02:58<27:07:49,  3.54it/s]
  7%|▋         | 25748/371472 [2:02:58<26:18:50,  3.65it/s]
  7%|▋         | 25749/371472 [2:02:58<27:02:26,  3.55it/s]
  7%|▋         | 25750/371472 [2:02:59<27:37:32,  3.48it/s]
  7%|▋         | 25751/371472 [2:02:59<26:28:32,  3.63it/s]
  7%|▋         | 25752/371472 [2:02:59<26:49:10,  3.58it/s]
  7%|▋         | 25753/371472 [2:02:59<26:59:10,  3.56it/s]
  7%|▋         | 25754/371472 [2:03:00<26:58:28,  3.56it/s]
  7%|▋         | 25755/371472 [2:03:00<27:00:45,  3.56it/s]
  7%|▋         | 25756/371472 [2:03:00<26:58:25,  3.56it/s]
  7%|▋         | 25757/371472 [2:03:01<28:15:40,  3.40it/s]
  7%|▋         | 25758/371472 [2:03:01<27:21:09,  3.51it/s]
  7%|▋         | 25759/371472 [2:03:01<26:32:37,  3.62it/s]
  7%|▋         | 25760/371472 [2:03:01<27:28:45,  3.49it/s]
                                                           
{'loss': 4.3481, 'learning_rate': 9.380400353379732e-07, 'epoch': 1.11}

  7%|▋         | 25760/371472 [2:03:01<27:28:45,  3.49it/s]
  7%|▋         | 25761/371472 [2:03:02<27:43:31,  3.46it/s]
  7%|▋         | 25762/371472 [2:03:02<28:12:00,  3.41it/s]
  7%|▋         | 25763/371472 [2:03:02<28:12:06,  3.41it/s]
  7%|▋         | 25764/371472 [2:03:03<28:32:03,  3.37it/s]
  7%|▋         | 25765/371472 [2:03:03<28:22:59,  3.38it/s]
  7%|▋         | 25766/371472 [2:03:03<27:46:35,  3.46it/s]
  7%|▋         | 25767/371472 [2:03:03<28:13:52,  3.40it/s]
  7%|▋         | 25768/371472 [2:03:04<27:40:31,  3.47it/s]
  7%|▋         | 25769/371472 [2:03:04<26:27:42,  3.63it/s]
  7%|▋         | 25770/371472 [2:03:04<25:58:11,  3.70it/s]
  7%|▋         | 25771/371472 [2:03:05<27:08:03,  3.54it/s]
  7%|▋         | 25772/371472 [2:03:05<26:19:55,  3.65it/s]
  7%|▋         | 25773/371472 [2:03:05<27:29:59,  3.49it/s]
  7%|▋         | 25774/371472 [2:03:05<28:33:13,  3.36it/s]
  7%|▋         | 25775/371472 [2:03:06<28:35:42,  3.36it/s]
  7%|▋         | 25776/371472 [2:03:06<27:31:23,  3.49it/s]
  7%|▋         | 25777/371472 [2:03:06<26:50:50,  3.58it/s]
  7%|▋         | 25778/371472 [2:03:07<28:04:38,  3.42it/s]
  7%|▋         | 25779/371472 [2:03:07<27:02:02,  3.55it/s]
  7%|▋         | 25780/371472 [2:03:07<27:24:39,  3.50it/s]
                                                           
{'loss': 4.4193, 'learning_rate': 9.379915533624943e-07, 'epoch': 1.11}

  7%|▋         | 25780/371472 [2:03:07<27:24:39,  3.50it/s]
  7%|▋         | 25781/371472 [2:03:07<27:12:49,  3.53it/s]
  7%|▋         | 25782/371472 [2:03:08<26:32:55,  3.62it/s]
  7%|▋         | 25783/371472 [2:03:08<26:20:55,  3.64it/s]
  7%|▋         | 25784/371472 [2:03:08<26:02:31,  3.69it/s]
  7%|▋         | 25785/371472 [2:03:08<25:47:42,  3.72it/s]
  7%|▋         | 25786/371472 [2:03:09<25:15:51,  3.80it/s]
  7%|▋         | 25787/371472 [2:03:09<25:43:44,  3.73it/s]
  7%|▋         | 25788/371472 [2:03:09<25:45:33,  3.73it/s]
  7%|▋         | 25789/371472 [2:03:10<25:57:31,  3.70it/s]
  7%|▋         | 25790/371472 [2:03:10<26:12:26,  3.66it/s]
  7%|▋         | 25791/371472 [2:03:10<27:21:05,  3.51it/s]
  7%|▋         | 25792/371472 [2:03:10<29:22:48,  3.27it/s]
  7%|▋         | 25793/371472 [2:03:11<27:58:08,  3.43it/s]
  7%|▋         | 25794/371472 [2:03:11<27:28:38,  3.49it/s]
  7%|▋         | 25795/371472 [2:03:11<27:42:06,  3.47it/s]
  7%|▋         | 25796/371472 [2:03:12<27:25:13,  3.50it/s]
  7%|▋         | 25797/371472 [2:03:12<26:37:20,  3.61it/s]
  7%|▋         | 25798/371472 [2:03:12<28:12:26,  3.40it/s]
  7%|▋         | 25799/371472 [2:03:12<29:10:05,  3.29it/s]
  7%|▋         | 25800/371472 [2:03:13<27:48:43,  3.45it/s]
                                                           
{'loss': 4.4418, 'learning_rate': 9.379430713870154e-07, 'epoch': 1.11}

  7%|▋         | 25800/371472 [2:03:13<27:48:43,  3.45it/s]
  7%|▋         | 25801/371472 [2:03:13<32:01:54,  3.00it/s]
  7%|▋         | 25802/371472 [2:03:14<33:25:00,  2.87it/s]
  7%|▋         | 25803/371472 [2:03:14<30:27:49,  3.15it/s]
  7%|▋         | 25804/371472 [2:03:14<30:55:36,  3.10it/s]
  7%|▋         | 25805/371472 [2:03:14<29:15:37,  3.28it/s]
  7%|▋         | 25806/371472 [2:03:15<29:24:43,  3.26it/s]
  7%|▋         | 25807/371472 [2:03:15<27:58:37,  3.43it/s]
  7%|▋         | 25808/371472 [2:03:15<27:04:54,  3.55it/s]
  7%|▋         | 25809/371472 [2:03:16<27:16:34,  3.52it/s]
  7%|▋         | 25810/371472 [2:03:16<26:30:25,  3.62it/s]
  7%|▋         | 25811/371472 [2:03:16<27:00:54,  3.55it/s]
  7%|▋         | 25812/371472 [2:03:16<26:46:10,  3.59it/s]
  7%|▋         | 25813/371472 [2:03:17<26:29:31,  3.62it/s]
  7%|▋         | 25814/371472 [2:03:17<26:10:27,  3.67it/s]
  7%|▋         | 25815/371472 [2:03:17<26:24:00,  3.64it/s]
  7%|▋         | 25816/371472 [2:03:17<25:57:41,  3.70it/s]
  7%|▋         | 25817/371472 [2:03:18<25:57:59,  3.70it/s]
  7%|▋         | 25818/371472 [2:03:18<25:58:15,  3.70it/s]
  7%|▋         | 25819/371472 [2:03:18<26:25:42,  3.63it/s]
  7%|▋         | 25820/371472 [2:03:19<26:10:02,  3.67it/s]
                                                           
{'loss': 4.4261, 'learning_rate': 9.378945894115366e-07, 'epoch': 1.11}

  7%|▋         | 25820/371472 [2:03:19<26:10:02,  3.67it/s]
  7%|▋         | 25821/371472 [2:03:19<26:29:43,  3.62it/s]
  7%|▋         | 25822/371472 [2:03:19<27:11:32,  3.53it/s]
  7%|▋         | 25823/371472 [2:03:19<26:52:57,  3.57it/s]
  7%|▋         | 25824/371472 [2:03:20<27:05:44,  3.54it/s]
  7%|▋         | 25825/371472 [2:03:20<26:44:55,  3.59it/s]
  7%|▋         | 25826/371472 [2:03:20<26:12:13,  3.66it/s]
  7%|▋         | 25827/371472 [2:03:20<27:09:14,  3.54it/s]
  7%|▋         | 25828/371472 [2:03:21<27:02:25,  3.55it/s]
  7%|▋         | 25829/371472 [2:03:21<26:37:53,  3.61it/s]
  7%|▋         | 25830/371472 [2:03:21<26:30:57,  3.62it/s]
  7%|▋         | 25831/371472 [2:03:22<26:04:01,  3.68it/s]
  7%|▋         | 25832/371472 [2:03:22<29:20:47,  3.27it/s]
  7%|▋         | 25833/371472 [2:03:22<28:38:24,  3.35it/s]
  7%|▋         | 25834/371472 [2:03:23<28:50:19,  3.33it/s]
  7%|▋         | 25835/371472 [2:03:23<28:59:49,  3.31it/s]
  7%|▋         | 25836/371472 [2:03:23<28:10:35,  3.41it/s]
  7%|▋         | 25837/371472 [2:03:23<29:13:03,  3.29it/s]
  7%|▋         | 25838/371472 [2:03:24<28:24:56,  3.38it/s]
  7%|▋         | 25839/371472 [2:03:24<29:19:40,  3.27it/s]
  7%|▋         | 25840/371472 [2:03:24<28:39:19,  3.35it/s]
                                                           
{'loss': 4.4694, 'learning_rate': 9.378461074360575e-07, 'epoch': 1.11}

  7%|▋         | 25840/371472 [2:03:24<28:39:19,  3.35it/s]
  7%|▋         | 25841/371472 [2:03:25<28:03:22,  3.42it/s]
  7%|▋         | 25842/371472 [2:03:25<27:17:28,  3.52it/s]
  7%|▋         | 25843/371472 [2:03:25<27:05:22,  3.54it/s]
  7%|▋         | 25844/371472 [2:03:25<26:33:48,  3.61it/s]
  7%|▋         | 25845/371472 [2:03:26<27:21:20,  3.51it/s]
  7%|▋         | 25846/371472 [2:03:26<27:50:01,  3.45it/s]
  7%|▋         | 25847/371472 [2:03:26<27:08:37,  3.54it/s]
  7%|▋         | 25848/371472 [2:03:27<26:26:46,  3.63it/s]
  7%|▋         | 25849/371472 [2:03:27<26:11:36,  3.67it/s]
  7%|▋         | 25850/371472 [2:03:27<28:34:41,  3.36it/s]
  7%|▋         | 25851/371472 [2:03:28<30:42:37,  3.13it/s]
  7%|▋         | 25852/371472 [2:03:28<29:05:03,  3.30it/s]
  7%|▋         | 25853/371472 [2:03:28<27:56:33,  3.44it/s]
  7%|▋         | 25854/371472 [2:03:28<27:27:39,  3.50it/s]
  7%|▋         | 25855/371472 [2:03:29<26:47:21,  3.58it/s]
  7%|▋         | 25856/371472 [2:03:29<26:56:17,  3.56it/s]
  7%|▋         | 25857/371472 [2:03:29<26:53:56,  3.57it/s]
  7%|▋         | 25858/371472 [2:03:29<27:02:02,  3.55it/s]
  7%|▋         | 25859/371472 [2:03:30<26:40:21,  3.60it/s]
  7%|▋         | 25860/371472 [2:03:30<26:03:20,  3.68it/s]
                                                           
{'loss': 4.3937, 'learning_rate': 9.377976254605787e-07, 'epoch': 1.11}

  7%|▋         | 25860/371472 [2:03:30<26:03:20,  3.68it/s]
  7%|▋         | 25861/371472 [2:03:30<25:57:51,  3.70it/s]
  7%|▋         | 25862/371472 [2:03:31<27:04:22,  3.55it/s]
  7%|▋         | 25863/371472 [2:03:31<26:22:06,  3.64it/s]
  7%|▋         | 25864/371472 [2:03:31<25:45:24,  3.73it/s]
  7%|▋         | 25865/371472 [2:03:31<28:07:45,  3.41it/s]
  7%|▋         | 25866/371472 [2:03:32<27:53:28,  3.44it/s]
  7%|▋         | 25867/371472 [2:03:32<27:04:34,  3.55it/s]
  7%|▋         | 25868/371472 [2:03:32<27:36:57,  3.48it/s]
  7%|▋         | 25869/371472 [2:03:33<27:06:37,  3.54it/s]
  7%|▋         | 25870/371472 [2:03:33<27:47:43,  3.45it/s]
  7%|▋         | 25871/371472 [2:03:33<28:25:27,  3.38it/s]
  7%|▋         | 25872/371472 [2:03:33<27:22:38,  3.51it/s]
  7%|▋         | 25873/371472 [2:03:34<28:13:55,  3.40it/s]
  7%|▋         | 25874/371472 [2:03:34<29:10:37,  3.29it/s]
  7%|▋         | 25875/371472 [2:03:34<28:23:44,  3.38it/s]
  7%|▋         | 25876/371472 [2:03:35<28:20:32,  3.39it/s]
  7%|▋         | 25877/371472 [2:03:35<33:05:05,  2.90it/s]
  7%|▋         | 25878/371472 [2:03:35<31:17:06,  3.07it/s]
  7%|▋         | 25879/371472 [2:03:36<28:59:10,  3.31it/s]
  7%|▋         | 25880/371472 [2:03:36<28:51:05,  3.33it/s]
                                                           
{'loss': 4.2992, 'learning_rate': 9.377491434850998e-07, 'epoch': 1.11}

  7%|▋         | 25880/371472 [2:03:36<28:51:05,  3.33it/s]
  7%|▋         | 25881/371472 [2:03:36<29:04:26,  3.30it/s]
  7%|▋         | 25882/371472 [2:03:36<28:06:37,  3.41it/s]
  7%|▋         | 25883/371472 [2:03:37<27:14:31,  3.52it/s]
  7%|▋         | 25884/371472 [2:03:37<26:46:30,  3.59it/s]
  7%|▋         | 25885/371472 [2:03:37<28:20:05,  3.39it/s]
  7%|▋         | 25886/371472 [2:03:38<29:27:10,  3.26it/s]
  7%|▋         | 25887/371472 [2:03:38<28:06:26,  3.42it/s]
  7%|▋         | 25888/371472 [2:03:38<28:16:23,  3.40it/s]
  7%|▋         | 25889/371472 [2:03:39<27:28:24,  3.49it/s]
  7%|▋         | 25890/371472 [2:03:39<27:25:59,  3.50it/s]
  7%|▋         | 25891/371472 [2:03:39<26:37:51,  3.60it/s]
  7%|▋         | 25892/371472 [2:03:39<26:03:59,  3.68it/s]
  7%|▋         | 25893/371472 [2:03:40<26:31:05,  3.62it/s]
  7%|▋         | 25894/371472 [2:03:40<26:02:08,  3.69it/s]
  7%|▋         | 25895/371472 [2:03:40<25:16:37,  3.80it/s]
  7%|▋         | 25896/371472 [2:03:40<25:45:23,  3.73it/s]
  7%|▋         | 25897/371472 [2:03:41<25:57:30,  3.70it/s]
  7%|▋         | 25898/371472 [2:03:41<26:03:22,  3.68it/s]
  7%|▋         | 25899/371472 [2:03:41<26:32:20,  3.62it/s]
  7%|▋         | 25900/371472 [2:03:41<25:59:25,  3.69it/s]
                                                           
{'loss': 4.5451, 'learning_rate': 9.37700661509621e-07, 'epoch': 1.12}

  7%|▋         | 25900/371472 [2:03:41<25:59:25,  3.69it/s]
  7%|▋         | 25901/371472 [2:03:42<25:30:01,  3.76it/s]
  7%|▋         | 25902/371472 [2:03:42<25:59:41,  3.69it/s]
  7%|▋         | 25903/371472 [2:03:42<26:29:24,  3.62it/s]
  7%|▋         | 25904/371472 [2:03:43<25:59:49,  3.69it/s]
  7%|▋         | 25905/371472 [2:03:43<26:32:21,  3.62it/s]
  7%|▋         | 25906/371472 [2:03:43<26:54:29,  3.57it/s]
  7%|▋         | 25907/371472 [2:03:43<26:19:00,  3.65it/s]
  7%|▋         | 25908/371472 [2:03:44<25:18:59,  3.79it/s]
  7%|▋         | 25909/371472 [2:03:44<24:38:24,  3.90it/s]
  7%|▋         | 25910/371472 [2:03:44<25:24:42,  3.78it/s]
  7%|▋         | 25911/371472 [2:03:44<25:33:23,  3.76it/s]
  7%|▋         | 25912/371472 [2:03:45<26:08:46,  3.67it/s]
  7%|▋         | 25913/371472 [2:03:45<25:45:59,  3.73it/s]
  7%|▋         | 25914/371472 [2:03:45<27:55:27,  3.44it/s]
  7%|▋         | 25915/371472 [2:03:46<29:52:20,  3.21it/s]
  7%|▋         | 25916/371472 [2:03:46<29:06:21,  3.30it/s]
  7%|▋         | 25917/371472 [2:03:46<28:51:24,  3.33it/s]
  7%|▋         | 25918/371472 [2:03:47<29:53:03,  3.21it/s]
  7%|▋         | 25919/371472 [2:03:47<29:28:55,  3.26it/s]
  7%|▋         | 25920/371472 [2:03:47<27:38:29,  3.47it/s]
                                                           
{'loss': 4.4103, 'learning_rate': 9.37652179534142e-07, 'epoch': 1.12}

  7%|▋         | 25920/371472 [2:03:47<27:38:29,  3.47it/s]
  7%|▋         | 25921/371472 [2:03:47<26:34:57,  3.61it/s]
  7%|▋         | 25922/371472 [2:03:48<25:28:29,  3.77it/s]
  7%|▋         | 25923/371472 [2:03:48<25:41:49,  3.74it/s]
  7%|▋         | 25924/371472 [2:03:48<26:40:47,  3.60it/s]
  7%|▋         | 25925/371472 [2:03:48<26:16:28,  3.65it/s]
  7%|▋         | 25926/371472 [2:03:49<28:44:43,  3.34it/s]
  7%|▋         | 25927/371472 [2:03:49<28:15:59,  3.40it/s]
  7%|▋         | 25928/371472 [2:03:49<27:11:19,  3.53it/s]
  7%|▋         | 25929/371472 [2:03:50<27:30:13,  3.49it/s]
  7%|▋         | 25930/371472 [2:03:50<29:33:38,  3.25it/s]
  7%|▋         | 25931/371472 [2:03:50<28:21:58,  3.38it/s]
  7%|▋         | 25932/371472 [2:03:51<28:33:58,  3.36it/s]
  7%|▋         | 25933/371472 [2:03:51<29:12:06,  3.29it/s]
  7%|▋         | 25934/371472 [2:03:51<28:26:38,  3.37it/s]
  7%|▋         | 25935/371472 [2:03:51<27:13:10,  3.53it/s]
  7%|▋         | 25936/371472 [2:03:52<27:24:00,  3.50it/s]
  7%|▋         | 25937/371472 [2:03:52<27:33:21,  3.48it/s]
  7%|▋         | 25938/371472 [2:03:52<29:25:33,  3.26it/s]
  7%|▋         | 25939/371472 [2:03:53<27:55:32,  3.44it/s]
  7%|▋         | 25940/371472 [2:03:53<29:42:40,  3.23it/s]
                                                           
{'loss': 4.3582, 'learning_rate': 9.376036975586632e-07, 'epoch': 1.12}

  7%|▋         | 25940/371472 [2:03:53<29:42:40,  3.23it/s]
  7%|▋         | 25941/371472 [2:03:53<29:33:33,  3.25it/s]
  7%|▋         | 25942/371472 [2:03:54<28:10:08,  3.41it/s]
  7%|▋         | 25943/371472 [2:03:54<28:43:19,  3.34it/s]
  7%|▋         | 25944/371472 [2:03:54<28:25:17,  3.38it/s]
  7%|▋         | 25945/371472 [2:03:54<28:30:12,  3.37it/s]
  7%|▋         | 25946/371472 [2:03:55<27:59:01,  3.43it/s]
  7%|▋         | 25947/371472 [2:03:55<26:57:52,  3.56it/s]
  7%|▋         | 25948/371472 [2:03:55<26:52:33,  3.57it/s]
  7%|▋         | 25949/371472 [2:03:56<26:42:05,  3.59it/s]
  7%|▋         | 25950/371472 [2:03:56<26:04:09,  3.68it/s]
  7%|▋         | 25951/371472 [2:03:56<25:54:56,  3.70it/s]
  7%|▋         | 25952/371472 [2:03:56<26:48:43,  3.58it/s]
  7%|▋         | 25953/371472 [2:03:57<26:03:47,  3.68it/s]
  7%|▋         | 25954/371472 [2:03:57<27:14:37,  3.52it/s]
  7%|▋         | 25955/371472 [2:03:57<30:23:58,  3.16it/s]
  7%|▋         | 25956/371472 [2:03:58<28:32:55,  3.36it/s]
  7%|▋         | 25957/371472 [2:03:58<29:14:39,  3.28it/s]
  7%|▋         | 25958/371472 [2:03:58<28:38:22,  3.35it/s]
  7%|▋         | 25959/371472 [2:03:58<27:52:40,  3.44it/s]
  7%|▋         | 25960/371472 [2:03:59<26:47:23,  3.58it/s]
                                                           
{'loss': 4.3502, 'learning_rate': 9.375552155831843e-07, 'epoch': 1.12}

  7%|▋         | 25960/371472 [2:03:59<26:47:23,  3.58it/s]
  7%|▋         | 25961/371472 [2:03:59<26:06:19,  3.68it/s]
  7%|▋         | 25962/371472 [2:03:59<27:32:17,  3.49it/s]
  7%|▋         | 25963/371472 [2:04:00<26:31:08,  3.62it/s]
  7%|▋         | 25964/371472 [2:04:00<26:17:25,  3.65it/s]
  7%|▋         | 25965/371472 [2:04:00<26:30:37,  3.62it/s]
  7%|▋         | 25966/371472 [2:04:00<27:13:54,  3.52it/s]
  7%|▋         | 25967/371472 [2:04:01<29:22:36,  3.27it/s]
  7%|▋         | 25968/371472 [2:04:01<32:35:00,  2.95it/s]
  7%|▋         | 25969/371472 [2:04:01<31:15:05,  3.07it/s]
  7%|▋         | 25970/371472 [2:04:02<29:44:31,  3.23it/s]
  7%|▋         | 25971/371472 [2:04:02<30:13:16,  3.18it/s]
  7%|▋         | 25972/371472 [2:04:02<28:55:05,  3.32it/s]
  7%|▋         | 25973/371472 [2:04:03<28:56:32,  3.32it/s]
  7%|▋         | 25974/371472 [2:04:03<27:12:19,  3.53it/s]
  7%|▋         | 25975/371472 [2:04:03<27:00:07,  3.55it/s]
  7%|▋         | 25976/371472 [2:04:03<27:21:20,  3.51it/s]
  7%|▋         | 25977/371472 [2:04:04<29:13:10,  3.28it/s]
  7%|▋         | 25978/371472 [2:04:04<28:56:35,  3.32it/s]
  7%|▋         | 25979/371472 [2:04:04<28:06:53,  3.41it/s]
  7%|▋         | 25980/371472 [2:04:05<27:27:30,  3.50it/s]
                                                           
{'loss': 4.4556, 'learning_rate': 9.375067336077054e-07, 'epoch': 1.12}

  7%|▋         | 25980/371472 [2:04:05<27:27:30,  3.50it/s]
  7%|▋         | 25981/371472 [2:04:05<27:28:30,  3.49it/s]
  7%|▋         | 25982/371472 [2:04:05<26:58:05,  3.56it/s]
  7%|▋         | 25983/371472 [2:04:05<26:25:58,  3.63it/s]
  7%|▋         | 25984/371472 [2:04:06<28:12:36,  3.40it/s]
  7%|▋         | 25985/371472 [2:04:06<28:22:45,  3.38it/s]
  7%|▋         | 25986/371472 [2:04:06<27:09:26,  3.53it/s]
  7%|▋         | 25987/371472 [2:04:07<27:27:34,  3.49it/s]
  7%|▋         | 25988/371472 [2:04:07<27:39:01,  3.47it/s]
  7%|▋         | 25989/371472 [2:04:07<27:38:37,  3.47it/s]
  7%|▋         | 25990/371472 [2:04:07<26:37:37,  3.60it/s]
  7%|▋         | 25991/371472 [2:04:08<26:32:59,  3.61it/s]
  7%|▋         | 25992/371472 [2:04:08<27:08:20,  3.54it/s]
  7%|▋         | 25993/371472 [2:04:08<27:22:28,  3.51it/s]
  7%|▋         | 25994/371472 [2:04:09<27:58:58,  3.43it/s]
  7%|▋         | 25995/371472 [2:04:09<26:56:24,  3.56it/s]
  7%|▋         | 25996/371472 [2:04:09<28:15:36,  3.40it/s]
  7%|▋         | 25997/371472 [2:04:09<27:27:01,  3.50it/s]
  7%|▋         | 25998/371472 [2:04:10<28:17:44,  3.39it/s]
  7%|▋         | 25999/371472 [2:04:10<31:33:13,  3.04it/s]
  7%|▋         | 26000/371472 [2:04:10<29:55:36,  3.21it/s]
                                                           
{'loss': 4.8482, 'learning_rate': 9.374582516322264e-07, 'epoch': 1.12}

  7%|▋         | 26000/371472 [2:04:10<29:55:36,  3.21it/s]
  7%|▋         | 26001/371472 [2:04:11<27:57:20,  3.43it/s]
  7%|▋         | 26002/371472 [2:04:11<27:10:08,  3.53it/s]
  7%|▋         | 26003/371472 [2:04:11<27:27:30,  3.49it/s]
  7%|▋         | 26004/371472 [2:04:12<27:14:39,  3.52it/s]
  7%|▋         | 26005/371472 [2:04:12<28:56:16,  3.32it/s]
  7%|▋         | 26006/371472 [2:04:12<27:29:19,  3.49it/s]
  7%|▋         | 26007/371472 [2:04:12<26:34:40,  3.61it/s]
  7%|▋         | 26008/371472 [2:04:13<26:14:39,  3.66it/s]
  7%|▋         | 26009/371472 [2:04:13<28:04:01,  3.42it/s]
  7%|▋         | 26010/371472 [2:04:13<26:52:53,  3.57it/s]
  7%|▋         | 26011/371472 [2:04:14<26:53:39,  3.57it/s]
  7%|▋         | 26012/371472 [2:04:14<28:57:13,  3.31it/s]
  7%|▋         | 26013/371472 [2:04:14<27:52:25,  3.44it/s]
  7%|▋         | 26014/371472 [2:04:14<27:27:11,  3.50it/s]
  7%|▋         | 26015/371472 [2:04:15<27:15:39,  3.52it/s]
  7%|▋         | 26016/371472 [2:04:15<28:01:49,  3.42it/s]
  7%|▋         | 26017/371472 [2:04:15<26:44:19,  3.59it/s]
  7%|▋         | 26018/371472 [2:04:16<26:30:37,  3.62it/s]
  7%|▋         | 26019/371472 [2:04:16<28:01:28,  3.42it/s]
  7%|▋         | 26020/371472 [2:04:16<29:13:55,  3.28it/s]
                                                           
{'loss': 4.4736, 'learning_rate': 9.374097696567476e-07, 'epoch': 1.12}

  7%|▋         | 26020/371472 [2:04:16<29:13:55,  3.28it/s]
  7%|▋         | 26021/371472 [2:04:16<27:42:06,  3.46it/s]
  7%|▋         | 26022/371472 [2:04:17<27:19:09,  3.51it/s]
  7%|▋         | 26023/371472 [2:04:17<27:05:02,  3.54it/s]
  7%|▋         | 26024/371472 [2:04:17<27:04:23,  3.54it/s]
  7%|▋         | 26025/371472 [2:04:18<27:24:10,  3.50it/s]
  7%|▋         | 26026/371472 [2:04:18<26:30:11,  3.62it/s]
  7%|▋         | 26027/371472 [2:04:18<26:12:36,  3.66it/s]
  7%|▋         | 26028/371472 [2:04:18<25:52:18,  3.71it/s]
  7%|▋         | 26029/371472 [2:04:19<25:18:15,  3.79it/s]
  7%|▋         | 26030/371472 [2:04:19<25:40:02,  3.74it/s]
  7%|▋         | 26031/371472 [2:04:19<25:00:33,  3.84it/s]
  7%|▋         | 26032/371472 [2:04:19<25:47:03,  3.72it/s]
  7%|▋         | 26033/371472 [2:04:20<26:51:27,  3.57it/s]
  7%|▋         | 26034/371472 [2:04:20<26:20:24,  3.64it/s]
  7%|▋         | 26035/371472 [2:04:20<25:42:01,  3.73it/s]
  7%|▋         | 26036/371472 [2:04:21<26:08:06,  3.67it/s]
  7%|▋         | 26037/371472 [2:04:21<26:53:43,  3.57it/s]
  7%|▋         | 26038/371472 [2:04:21<29:25:04,  3.26it/s]
  7%|▋         | 26039/371472 [2:04:21<28:38:43,  3.35it/s]
  7%|▋         | 26040/371472 [2:04:22<30:28:11,  3.15it/s]
                                                           
{'loss': 4.4255, 'learning_rate': 9.373612876812687e-07, 'epoch': 1.12}

  7%|▋         | 26040/371472 [2:04:22<30:28:11,  3.15it/s]
  7%|▋         | 26041/371472 [2:04:22<30:07:26,  3.19it/s]
  7%|▋         | 26042/371472 [2:04:22<28:30:46,  3.37it/s]
  7%|▋         | 26043/371472 [2:04:23<28:39:14,  3.35it/s]
  7%|▋         | 26044/371472 [2:04:23<30:17:17,  3.17it/s]
  7%|▋         | 26045/371472 [2:04:23<30:15:26,  3.17it/s]
  7%|▋         | 26046/371472 [2:04:24<29:13:21,  3.28it/s]
  7%|▋         | 26047/371472 [2:04:24<30:24:22,  3.16it/s]
  7%|▋         | 26048/371472 [2:04:24<29:05:31,  3.30it/s]
  7%|▋         | 26049/371472 [2:04:25<28:36:32,  3.35it/s]
  7%|▋         | 26050/371472 [2:04:25<29:00:01,  3.31it/s]
  7%|▋         | 26051/371472 [2:04:25<27:49:29,  3.45it/s]
  7%|▋         | 26052/371472 [2:04:25<26:53:49,  3.57it/s]
  7%|▋         | 26053/371472 [2:04:26<27:28:53,  3.49it/s]
  7%|▋         | 26054/371472 [2:04:26<28:06:37,  3.41it/s]
  7%|▋         | 26055/371472 [2:04:26<27:40:54,  3.47it/s]
  7%|▋         | 26056/371472 [2:04:27<27:37:23,  3.47it/s]
  7%|▋         | 26057/371472 [2:04:27<26:22:30,  3.64it/s]
  7%|▋         | 26058/371472 [2:04:27<26:52:38,  3.57it/s]
  7%|▋         | 26059/371472 [2:04:27<26:08:32,  3.67it/s]
  7%|▋         | 26060/371472 [2:04:28<25:42:06,  3.73it/s]
                                                           
{'loss': 4.3318, 'learning_rate': 9.373128057057899e-07, 'epoch': 1.12}

  7%|▋         | 26060/371472 [2:04:28<25:42:06,  3.73it/s]
  7%|▋         | 26061/371472 [2:04:28<25:57:30,  3.70it/s]
  7%|▋         | 26062/371472 [2:04:28<27:07:49,  3.54it/s]
  7%|▋         | 26063/371472 [2:04:28<26:53:08,  3.57it/s]
  7%|▋         | 26064/371472 [2:04:29<26:09:45,  3.67it/s]
  7%|▋         | 26065/371472 [2:04:29<25:57:24,  3.70it/s]
  7%|▋         | 26066/371472 [2:04:29<26:25:04,  3.63it/s]
  7%|▋         | 26067/371472 [2:04:30<26:25:31,  3.63it/s]
  7%|▋         | 26068/371472 [2:04:30<28:25:42,  3.37it/s]
  7%|▋         | 26069/371472 [2:04:30<29:00:18,  3.31it/s]
  7%|▋         | 26070/371472 [2:04:30<28:03:37,  3.42it/s]
  7%|▋         | 26071/371472 [2:04:31<27:18:48,  3.51it/s]
  7%|▋         | 26072/371472 [2:04:31<26:42:37,  3.59it/s]
  7%|▋         | 26073/371472 [2:04:31<26:36:43,  3.61it/s]
  7%|▋         | 26074/371472 [2:04:32<26:48:25,  3.58it/s]
  7%|▋         | 26075/371472 [2:04:32<27:09:41,  3.53it/s]
  7%|▋         | 26076/371472 [2:04:32<27:31:55,  3.48it/s]
  7%|▋         | 26077/371472 [2:04:32<27:14:03,  3.52it/s]
  7%|▋         | 26078/371472 [2:04:33<27:29:59,  3.49it/s]
  7%|▋         | 26079/371472 [2:04:33<26:57:51,  3.56it/s]
  7%|▋         | 26080/371472 [2:04:33<27:57:57,  3.43it/s]
                                                           
{'loss': 4.3827, 'learning_rate': 9.372643237303109e-07, 'epoch': 1.12}

  7%|▋         | 26080/371472 [2:04:33<27:57:57,  3.43it/s]
  7%|▋         | 26081/371472 [2:04:34<28:46:03,  3.34it/s]
  7%|▋         | 26082/371472 [2:04:34<28:07:13,  3.41it/s]
  7%|▋         | 26083/371472 [2:04:34<28:51:20,  3.32it/s]
  7%|▋         | 26084/371472 [2:04:34<27:37:35,  3.47it/s]
  7%|▋         | 26085/371472 [2:04:35<27:05:20,  3.54it/s]
  7%|▋         | 26086/371472 [2:04:35<26:14:45,  3.66it/s]
  7%|▋         | 26087/371472 [2:04:35<29:23:00,  3.27it/s]
  7%|▋         | 26088/371472 [2:04:36<29:11:58,  3.29it/s]
  7%|▋         | 26089/371472 [2:04:36<27:57:13,  3.43it/s]
  7%|▋         | 26090/371472 [2:04:36<29:17:00,  3.28it/s]
  7%|▋         | 26091/371472 [2:04:37<28:00:01,  3.43it/s]
  7%|▋         | 26092/371472 [2:04:37<27:54:49,  3.44it/s]
  7%|▋         | 26093/371472 [2:04:37<27:19:33,  3.51it/s]
  7%|▋         | 26094/371472 [2:04:37<27:08:02,  3.54it/s]
  7%|▋         | 26095/371472 [2:04:38<29:48:25,  3.22it/s]
  7%|▋         | 26096/371472 [2:04:38<31:53:07,  3.01it/s]
  7%|▋         | 26097/371472 [2:04:38<32:10:46,  2.98it/s]
  7%|▋         | 26098/371472 [2:04:39<30:13:12,  3.17it/s]
  7%|▋         | 26099/371472 [2:04:39<31:45:55,  3.02it/s]
  7%|▋         | 26100/371472 [2:04:39<30:19:15,  3.16it/s]
                                                           
{'loss': 4.4282, 'learning_rate': 9.372158417548319e-07, 'epoch': 1.12}

  7%|▋         | 26100/371472 [2:04:39<30:19:15,  3.16it/s]
  7%|▋         | 26101/371472 [2:04:40<29:26:33,  3.26it/s]
  7%|▋         | 26102/371472 [2:04:40<28:57:29,  3.31it/s]
  7%|▋         | 26103/371472 [2:04:40<28:57:25,  3.31it/s]
  7%|▋         | 26104/371472 [2:04:41<28:53:26,  3.32it/s]
  7%|▋         | 26105/371472 [2:04:41<27:42:50,  3.46it/s]
  7%|▋         | 26106/371472 [2:04:41<26:59:13,  3.55it/s]
  7%|▋         | 26107/371472 [2:04:41<27:04:50,  3.54it/s]
  7%|▋         | 26108/371472 [2:04:42<26:52:57,  3.57it/s]
  7%|▋         | 26109/371472 [2:04:42<26:13:32,  3.66it/s]
  7%|▋         | 26110/371472 [2:04:42<26:50:54,  3.57it/s]
  7%|▋         | 26111/371472 [2:04:42<26:59:25,  3.55it/s]
  7%|▋         | 26112/371472 [2:04:43<28:27:56,  3.37it/s]
  7%|▋         | 26113/371472 [2:04:43<27:03:20,  3.55it/s]
  7%|▋         | 26114/371472 [2:04:43<26:12:03,  3.66it/s]
  7%|▋         | 26115/371472 [2:04:44<26:42:50,  3.59it/s]
  7%|▋         | 26116/371472 [2:04:44<25:38:21,  3.74it/s]
  7%|▋         | 26117/371472 [2:04:44<25:14:41,  3.80it/s]
  7%|▋         | 26118/371472 [2:04:44<25:52:28,  3.71it/s]
  7%|▋         | 26119/371472 [2:04:45<25:46:00,  3.72it/s]
  7%|▋         | 26120/371472 [2:04:45<24:49:47,  3.86it/s]
                                                           
{'loss': 4.4113, 'learning_rate': 9.371673597793531e-07, 'epoch': 1.13}

  7%|▋         | 26120/371472 [2:04:45<24:49:47,  3.86it/s]
  7%|▋         | 26121/371472 [2:04:45<26:52:45,  3.57it/s]
  7%|▋         | 26122/371472 [2:04:45<26:36:17,  3.61it/s]
  7%|▋         | 26123/371472 [2:04:46<27:36:59,  3.47it/s]
  7%|▋         | 26124/371472 [2:04:46<27:07:01,  3.54it/s]
  7%|▋         | 26125/371472 [2:04:46<26:13:27,  3.66it/s]
  7%|▋         | 26126/371472 [2:04:47<25:33:42,  3.75it/s]
  7%|▋         | 26127/371472 [2:04:47<24:44:24,  3.88it/s]
  7%|▋         | 26128/371472 [2:04:47<24:49:32,  3.86it/s]
  7%|▋         | 26129/371472 [2:04:47<25:04:59,  3.82it/s]
  7%|▋         | 26130/371472 [2:04:48<26:14:12,  3.66it/s]
  7%|▋         | 26131/371472 [2:04:48<25:29:28,  3.76it/s]
  7%|▋         | 26132/371472 [2:04:48<26:13:15,  3.66it/s]
  7%|▋         | 26133/371472 [2:04:49<29:53:24,  3.21it/s]
  7%|▋         | 26134/371472 [2:04:49<30:14:10,  3.17it/s]
  7%|▋         | 26135/371472 [2:04:49<29:25:35,  3.26it/s]
  7%|▋         | 26136/371472 [2:04:50<30:09:55,  3.18it/s]
  7%|▋         | 26137/371472 [2:04:50<30:25:13,  3.15it/s]
  7%|▋         | 26138/371472 [2:04:50<28:26:13,  3.37it/s]
  7%|▋         | 26139/371472 [2:04:50<29:31:49,  3.25it/s]
  7%|▋         | 26140/371472 [2:04:51<29:09:39,  3.29it/s]
                                                           
{'loss': 4.3691, 'learning_rate': 9.371188778038741e-07, 'epoch': 1.13}

  7%|▋         | 26140/371472 [2:04:51<29:09:39,  3.29it/s]
  7%|▋         | 26141/371472 [2:04:51<28:55:22,  3.32it/s]
  7%|▋         | 26142/371472 [2:04:51<29:05:46,  3.30it/s]
  7%|▋         | 26143/371472 [2:04:52<27:58:50,  3.43it/s]
  7%|▋         | 26144/371472 [2:04:52<26:44:30,  3.59it/s]
  7%|▋         | 26145/371472 [2:04:52<27:21:27,  3.51it/s]
  7%|▋         | 26146/371472 [2:04:52<26:38:07,  3.60it/s]
  7%|▋         | 26147/371472 [2:04:53<26:13:46,  3.66it/s]
  7%|▋         | 26148/371472 [2:04:53<26:25:16,  3.63it/s]
  7%|▋         | 26149/371472 [2:04:53<26:26:10,  3.63it/s]
  7%|▋         | 26150/371472 [2:04:54<26:53:36,  3.57it/s]
  7%|▋         | 26151/371472 [2:04:54<27:05:36,  3.54it/s]
  7%|▋         | 26152/371472 [2:04:54<27:33:04,  3.48it/s]
  7%|▋         | 26153/371472 [2:04:54<26:25:50,  3.63it/s]
  7%|▋         | 26154/371472 [2:04:55<26:44:45,  3.59it/s]
  7%|▋         | 26155/371472 [2:04:55<28:25:07,  3.38it/s]
  7%|▋         | 26156/371472 [2:04:55<26:57:48,  3.56it/s]
  7%|▋         | 26157/371472 [2:04:55<26:19:18,  3.64it/s]
  7%|▋         | 26158/371472 [2:04:56<26:12:50,  3.66it/s]
  7%|▋         | 26159/371472 [2:04:56<26:11:28,  3.66it/s]
  7%|▋         | 26160/371472 [2:04:56<26:16:19,  3.65it/s]
                                                           
{'loss': 4.469, 'learning_rate': 9.370703958283953e-07, 'epoch': 1.13}

  7%|▋         | 26160/371472 [2:04:56<26:16:19,  3.65it/s]
  7%|▋         | 26161/371472 [2:04:57<26:23:42,  3.63it/s]
  7%|▋         | 26162/371472 [2:04:57<27:41:43,  3.46it/s]
  7%|▋         | 26163/371472 [2:04:57<28:27:18,  3.37it/s]
  7%|▋         | 26164/371472 [2:04:57<27:38:35,  3.47it/s]
  7%|▋         | 26165/371472 [2:04:58<27:19:58,  3.51it/s]
  7%|▋         | 26166/371472 [2:04:58<27:29:53,  3.49it/s]
  7%|▋         | 26167/371472 [2:04:58<27:52:25,  3.44it/s]
  7%|▋         | 26168/371472 [2:04:59<26:25:04,  3.63it/s]
  7%|▋         | 26169/371472 [2:04:59<26:05:23,  3.68it/s]
  7%|▋         | 26170/371472 [2:04:59<27:48:49,  3.45it/s]
  7%|▋         | 26171/371472 [2:04:59<27:31:16,  3.49it/s]
  7%|▋         | 26172/371472 [2:05:00<26:57:17,  3.56it/s]
  7%|▋         | 26173/371472 [2:05:00<26:13:23,  3.66it/s]
  7%|▋         | 26174/371472 [2:05:00<26:46:56,  3.58it/s]
  7%|▋         | 26175/371472 [2:05:01<27:03:37,  3.54it/s]
  7%|▋         | 26176/371472 [2:05:01<26:52:09,  3.57it/s]
  7%|▋         | 26177/371472 [2:05:01<29:11:10,  3.29it/s]
  7%|▋         | 26178/371472 [2:05:01<28:24:59,  3.38it/s]
  7%|▋         | 26179/371472 [2:05:02<28:30:42,  3.36it/s]
  7%|▋         | 26180/371472 [2:05:02<29:19:24,  3.27it/s]
                                                           
{'loss': 4.5255, 'learning_rate': 9.370219138529164e-07, 'epoch': 1.13}

  7%|▋         | 26180/371472 [2:05:02<29:19:24,  3.27it/s]
  7%|▋         | 26181/371472 [2:05:03<32:25:58,  2.96it/s]
  7%|▋         | 26182/371472 [2:05:03<30:17:09,  3.17it/s]
  7%|▋         | 26183/371472 [2:05:03<29:09:49,  3.29it/s]
  7%|▋         | 26184/371472 [2:05:03<28:39:07,  3.35it/s]
  7%|▋         | 26185/371472 [2:05:04<27:31:18,  3.49it/s]
  7%|▋         | 26186/371472 [2:05:04<26:33:24,  3.61it/s]
  7%|▋         | 26187/371472 [2:05:04<26:58:48,  3.55it/s]
  7%|▋         | 26188/371472 [2:05:04<27:27:41,  3.49it/s]
  7%|▋         | 26189/371472 [2:05:05<28:40:15,  3.35it/s]
  7%|▋         | 26190/371472 [2:05:05<28:24:01,  3.38it/s]
  7%|▋         | 26191/371472 [2:05:05<29:12:36,  3.28it/s]
  7%|▋         | 26192/371472 [2:05:06<29:23:40,  3.26it/s]
  7%|▋         | 26193/371472 [2:05:06<28:21:50,  3.38it/s]
  7%|▋         | 26194/371472 [2:05:06<27:09:04,  3.53it/s]
  7%|▋         | 26195/371472 [2:05:07<27:46:11,  3.45it/s]
  7%|▋         | 26196/371472 [2:05:07<27:44:25,  3.46it/s]
  7%|▋         | 26197/371472 [2:05:07<28:49:50,  3.33it/s]
  7%|▋         | 26198/371472 [2:05:07<29:01:51,  3.30it/s]
  7%|▋         | 26199/371472 [2:05:08<27:23:29,  3.50it/s]
  7%|▋         | 26200/371472 [2:05:08<26:50:17,  3.57it/s]
                                                           
{'loss': 4.495, 'learning_rate': 9.369734318774376e-07, 'epoch': 1.13}

  7%|▋         | 26200/371472 [2:05:08<26:50:17,  3.57it/s]
  7%|▋         | 26201/371472 [2:05:08<26:57:18,  3.56it/s]
  7%|▋         | 26202/371472 [2:05:09<27:03:32,  3.54it/s]
  7%|▋         | 26203/371472 [2:05:09<26:59:48,  3.55it/s]
  7%|▋         | 26204/371472 [2:05:09<26:21:22,  3.64it/s]
  7%|▋         | 26205/371472 [2:05:09<25:35:58,  3.75it/s]
  7%|▋         | 26206/371472 [2:05:10<27:16:38,  3.52it/s]
  7%|▋         | 26207/371472 [2:05:10<26:42:02,  3.59it/s]
  7%|▋         | 26208/371472 [2:05:10<27:37:43,  3.47it/s]
  7%|▋         | 26209/371472 [2:05:10<27:02:04,  3.55it/s]
  7%|▋         | 26210/371472 [2:05:11<27:36:49,  3.47it/s]
  7%|▋         | 26211/371472 [2:05:11<29:10:17,  3.29it/s]
  7%|▋         | 26212/371472 [2:05:11<28:12:52,  3.40it/s]
  7%|▋         | 26213/371472 [2:05:12<26:54:57,  3.56it/s]
  7%|▋         | 26214/371472 [2:05:12<27:04:37,  3.54it/s]
  7%|▋         | 26215/371472 [2:05:12<28:52:10,  3.32it/s]
  7%|▋         | 26216/371472 [2:05:13<27:41:21,  3.46it/s]
  7%|▋         | 26217/371472 [2:05:13<26:04:44,  3.68it/s]
  7%|▋         | 26218/371472 [2:05:13<25:52:52,  3.71it/s]
  7%|▋         | 26219/371472 [2:05:13<25:11:23,  3.81it/s]
  7%|▋         | 26220/371472 [2:05:14<27:12:58,  3.52it/s]
                                                           
{'loss': 4.4714, 'learning_rate': 9.369249499019586e-07, 'epoch': 1.13}

  7%|▋         | 26220/371472 [2:05:14<27:12:58,  3.52it/s]
  7%|▋         | 26221/371472 [2:05:14<26:32:37,  3.61it/s]
  7%|▋         | 26222/371472 [2:05:14<26:52:59,  3.57it/s]
  7%|▋         | 26223/371472 [2:05:14<26:23:59,  3.63it/s]
  7%|▋         | 26224/371472 [2:05:15<27:45:24,  3.46it/s]
  7%|▋         | 26225/371472 [2:05:15<26:41:57,  3.59it/s]
  7%|▋         | 26226/371472 [2:05:15<26:49:00,  3.58it/s]
  7%|▋         | 26227/371472 [2:05:16<29:26:27,  3.26it/s]
  7%|▋         | 26228/371472 [2:05:16<29:40:39,  3.23it/s]
  7%|▋         | 26229/371472 [2:05:16<28:16:08,  3.39it/s]
  7%|▋         | 26230/371472 [2:05:17<28:03:38,  3.42it/s]
  7%|▋         | 26231/371472 [2:05:17<27:30:01,  3.49it/s]
  7%|▋         | 26232/371472 [2:05:17<26:45:46,  3.58it/s]
  7%|▋         | 26233/371472 [2:05:17<25:50:39,  3.71it/s]
  7%|▋         | 26234/371472 [2:05:18<25:59:12,  3.69it/s]
  7%|▋         | 26235/371472 [2:05:18<25:29:41,  3.76it/s]
  7%|▋         | 26236/371472 [2:05:18<26:11:28,  3.66it/s]
  7%|▋         | 26237/371472 [2:05:18<26:22:08,  3.64it/s]
  7%|▋         | 26238/371472 [2:05:19<25:49:05,  3.71it/s]
  7%|▋         | 26239/371472 [2:05:19<25:23:52,  3.78it/s]
  7%|▋         | 26240/371472 [2:05:19<25:24:00,  3.78it/s]
                                                           
{'loss': 4.4941, 'learning_rate': 9.368764679264797e-07, 'epoch': 1.13}

  7%|▋         | 26240/371472 [2:05:19<25:24:00,  3.78it/s]
  7%|▋         | 26241/371472 [2:05:19<24:45:30,  3.87it/s]
  7%|▋         | 26242/371472 [2:05:20<25:04:23,  3.82it/s]
  7%|▋         | 26243/371472 [2:05:20<26:05:05,  3.68it/s]
  7%|▋         | 26244/371472 [2:05:20<25:19:51,  3.79it/s]
  7%|▋         | 26245/371472 [2:05:21<25:44:36,  3.73it/s]
  7%|▋         | 26246/371472 [2:05:21<28:01:37,  3.42it/s]
  7%|▋         | 26247/371472 [2:05:21<27:15:56,  3.52it/s]
  7%|▋         | 26248/371472 [2:05:21<27:07:26,  3.54it/s]
  7%|▋         | 26249/371472 [2:05:22<26:40:00,  3.60it/s]
  7%|▋         | 26250/371472 [2:05:22<26:10:00,  3.66it/s]
  7%|▋         | 26251/371472 [2:05:22<26:10:12,  3.66it/s]
  7%|▋         | 26252/371472 [2:05:22<26:10:46,  3.66it/s]
  7%|▋         | 26253/371472 [2:05:23<25:47:23,  3.72it/s]
  7%|▋         | 26254/371472 [2:05:23<26:28:07,  3.62it/s]
  7%|▋         | 26255/371472 [2:05:23<25:40:27,  3.74it/s]
  7%|▋         | 26256/371472 [2:05:24<25:31:53,  3.76it/s]
  7%|▋         | 26257/371472 [2:05:24<26:48:43,  3.58it/s]
  7%|▋         | 26258/371472 [2:05:24<26:13:25,  3.66it/s]
  7%|▋         | 26259/371472 [2:05:24<27:43:08,  3.46it/s]
  7%|▋         | 26260/371472 [2:05:25<27:47:39,  3.45it/s]
                                                           
{'loss': 4.457, 'learning_rate': 9.368279859510008e-07, 'epoch': 1.13}

  7%|▋         | 26260/371472 [2:05:25<27:47:39,  3.45it/s]
  7%|▋         | 26261/371472 [2:05:25<26:41:57,  3.59it/s]
  7%|▋         | 26262/371472 [2:05:25<26:43:02,  3.59it/s]
  7%|▋         | 26263/371472 [2:05:26<28:20:20,  3.38it/s]
  7%|▋         | 26264/371472 [2:05:26<27:25:02,  3.50it/s]
  7%|▋         | 26265/371472 [2:05:26<26:31:17,  3.62it/s]
  7%|▋         | 26266/371472 [2:05:26<26:19:29,  3.64it/s]
  7%|▋         | 26267/371472 [2:05:27<27:02:09,  3.55it/s]
  7%|▋         | 26268/371472 [2:05:27<26:03:02,  3.68it/s]
  7%|▋         | 26269/371472 [2:05:27<26:28:54,  3.62it/s]
  7%|▋         | 26270/371472 [2:05:28<27:06:21,  3.54it/s]
  7%|▋         | 26271/371472 [2:05:28<30:35:23,  3.13it/s]
  7%|▋         | 26272/371472 [2:05:28<31:13:45,  3.07it/s]
  7%|▋         | 26273/371472 [2:05:29<29:39:12,  3.23it/s]
  7%|▋         | 26274/371472 [2:05:29<28:17:11,  3.39it/s]
  7%|▋         | 26275/371472 [2:05:29<28:19:12,  3.39it/s]
  7%|▋         | 26276/371472 [2:05:29<28:00:31,  3.42it/s]
  7%|▋         | 26277/371472 [2:05:30<26:39:14,  3.60it/s]
  7%|▋         | 26278/371472 [2:05:30<26:13:36,  3.66it/s]
  7%|▋         | 26279/371472 [2:05:30<28:08:00,  3.41it/s]
  7%|▋         | 26280/371472 [2:05:30<27:12:03,  3.53it/s]
                                                           
{'loss': 4.3587, 'learning_rate': 9.36779503975522e-07, 'epoch': 1.13}

  7%|▋         | 26280/371472 [2:05:30<27:12:03,  3.53it/s]
  7%|▋         | 26281/371472 [2:05:31<27:49:15,  3.45it/s]
  7%|▋         | 26282/371472 [2:05:31<27:21:46,  3.50it/s]
  7%|▋         | 26283/371472 [2:05:31<26:40:50,  3.59it/s]
  7%|▋         | 26284/371472 [2:05:32<25:50:23,  3.71it/s]
  7%|▋         | 26285/371472 [2:05:32<26:23:31,  3.63it/s]
  7%|▋         | 26286/371472 [2:05:32<27:20:34,  3.51it/s]
  7%|▋         | 26287/371472 [2:05:32<27:35:50,  3.47it/s]
  7%|▋         | 26288/371472 [2:05:33<26:34:38,  3.61it/s]
  7%|▋         | 26289/371472 [2:05:33<26:33:50,  3.61it/s]
  7%|▋         | 26290/371472 [2:05:33<28:56:35,  3.31it/s]
  7%|▋         | 26291/371472 [2:05:34<28:03:29,  3.42it/s]
  7%|▋         | 26292/371472 [2:05:34<27:14:53,  3.52it/s]
  7%|▋         | 26293/371472 [2:05:34<26:18:26,  3.64it/s]
  7%|▋         | 26294/371472 [2:05:35<29:41:03,  3.23it/s]
  7%|▋         | 26295/371472 [2:05:35<28:04:33,  3.42it/s]
  7%|▋         | 26296/371472 [2:05:35<27:39:42,  3.47it/s]
  7%|▋         | 26297/371472 [2:05:35<27:07:35,  3.53it/s]
  7%|▋         | 26298/371472 [2:05:36<27:09:27,  3.53it/s]
  7%|▋         | 26299/371472 [2:05:36<26:11:34,  3.66it/s]
  7%|▋         | 26300/371472 [2:05:36<28:08:22,  3.41it/s]
                                                           
{'loss': 4.326, 'learning_rate': 9.36731022000043e-07, 'epoch': 1.13}

  7%|▋         | 26300/371472 [2:05:36<28:08:22,  3.41it/s]
  7%|▋         | 26301/371472 [2:05:37<28:32:38,  3.36it/s]
  7%|▋         | 26302/371472 [2:05:37<26:42:32,  3.59it/s]
  7%|▋         | 26303/371472 [2:05:37<26:29:19,  3.62it/s]
  7%|▋         | 26304/371472 [2:05:37<26:14:30,  3.65it/s]
  7%|▋         | 26305/371472 [2:05:38<26:34:42,  3.61it/s]
  7%|▋         | 26306/371472 [2:05:38<26:03:26,  3.68it/s]
  7%|▋         | 26307/371472 [2:05:38<27:35:59,  3.47it/s]
  7%|▋         | 26308/371472 [2:05:38<27:57:54,  3.43it/s]
  7%|▋         | 26309/371472 [2:05:39<26:51:24,  3.57it/s]
  7%|▋         | 26310/371472 [2:05:39<26:47:22,  3.58it/s]
  7%|▋         | 26311/371472 [2:05:39<27:14:48,  3.52it/s]
  7%|▋         | 26312/371472 [2:05:40<27:05:43,  3.54it/s]
  7%|▋         | 26313/371472 [2:05:40<26:34:33,  3.61it/s]
  7%|▋         | 26314/371472 [2:05:40<26:31:11,  3.62it/s]
  7%|▋         | 26315/371472 [2:05:40<26:01:54,  3.68it/s]
  7%|▋         | 26316/371472 [2:05:41<25:47:04,  3.72it/s]
  7%|▋         | 26317/371472 [2:05:41<25:33:27,  3.75it/s]
  7%|▋         | 26318/371472 [2:05:41<25:22:00,  3.78it/s]
  7%|▋         | 26319/371472 [2:05:41<25:02:21,  3.83it/s]
  7%|▋         | 26320/371472 [2:05:42<26:26:44,  3.63it/s]
                                                           
{'loss': 4.4715, 'learning_rate': 9.366825400245642e-07, 'epoch': 1.13}

  7%|▋         | 26320/371472 [2:05:42<26:26:44,  3.63it/s]
  7%|▋         | 26321/371472 [2:05:42<27:45:56,  3.45it/s]
  7%|▋         | 26322/371472 [2:05:42<27:44:24,  3.46it/s]
  7%|▋         | 26323/371472 [2:05:43<27:56:35,  3.43it/s]
  7%|▋         | 26324/371472 [2:05:43<28:03:34,  3.42it/s]
  7%|▋         | 26325/371472 [2:05:43<28:41:52,  3.34it/s]
  7%|▋         | 26326/371472 [2:05:44<27:43:58,  3.46it/s]
  7%|▋         | 26327/371472 [2:05:44<27:00:29,  3.55it/s]
  7%|▋         | 26328/371472 [2:05:44<26:59:38,  3.55it/s]
  7%|▋         | 26329/371472 [2:05:44<26:32:36,  3.61it/s]
  7%|▋         | 26330/371472 [2:05:45<25:56:55,  3.69it/s]
  7%|▋         | 26331/371472 [2:05:45<25:43:10,  3.73it/s]
  7%|▋         | 26332/371472 [2:05:45<25:51:34,  3.71it/s]
  7%|▋         | 26333/371472 [2:05:45<25:22:49,  3.78it/s]
  7%|▋         | 26334/371472 [2:05:46<25:18:18,  3.79it/s]
  7%|▋         | 26335/371472 [2:05:46<26:13:13,  3.66it/s]
  7%|▋         | 26336/371472 [2:05:46<27:23:52,  3.50it/s]
  7%|▋         | 26337/371472 [2:05:46<26:33:55,  3.61it/s]
  7%|▋         | 26338/371472 [2:05:47<26:52:33,  3.57it/s]
  7%|▋         | 26339/371472 [2:05:47<25:53:21,  3.70it/s]
  7%|▋         | 26340/371472 [2:05:47<28:55:58,  3.31it/s]
                                                           
{'loss': 4.5996, 'learning_rate': 9.366340580490853e-07, 'epoch': 1.13}

  7%|▋         | 26340/371472 [2:05:47<28:55:58,  3.31it/s]
  7%|▋         | 26341/371472 [2:05:48<29:54:21,  3.21it/s]
  7%|▋         | 26342/371472 [2:05:48<29:22:43,  3.26it/s]
  7%|▋         | 26343/371472 [2:05:48<28:58:51,  3.31it/s]
  7%|▋         | 26344/371472 [2:05:49<27:22:14,  3.50it/s]
  7%|▋         | 26345/371472 [2:05:49<26:02:15,  3.68it/s]
  7%|▋         | 26346/371472 [2:05:49<25:53:16,  3.70it/s]
  7%|▋         | 26347/371472 [2:05:49<25:07:19,  3.82it/s]
  7%|▋         | 26348/371472 [2:05:50<25:41:29,  3.73it/s]
  7%|▋         | 26349/371472 [2:05:50<25:45:46,  3.72it/s]
  7%|▋         | 26350/371472 [2:05:50<26:01:03,  3.68it/s]
  7%|▋         | 26351/371472 [2:05:50<26:45:23,  3.58it/s]
  7%|▋         | 26352/371472 [2:05:51<27:18:02,  3.51it/s]
  7%|▋         | 26353/371472 [2:05:51<27:25:56,  3.49it/s]
  7%|▋         | 26354/371472 [2:05:51<26:35:37,  3.60it/s]
  7%|▋         | 26355/371472 [2:05:52<25:54:29,  3.70it/s]
  7%|▋         | 26356/371472 [2:05:52<25:26:08,  3.77it/s]
  7%|▋         | 26357/371472 [2:05:52<25:14:20,  3.80it/s]
  7%|▋         | 26358/371472 [2:05:52<26:37:38,  3.60it/s]
  7%|▋         | 26359/371472 [2:05:53<26:22:05,  3.64it/s]
  7%|▋         | 26360/371472 [2:05:53<27:51:51,  3.44it/s]
                                                           
{'loss': 4.1874, 'learning_rate': 9.365855760736064e-07, 'epoch': 1.14}

  7%|▋         | 26360/371472 [2:05:53<27:51:51,  3.44it/s]
  7%|▋         | 26361/371472 [2:05:53<27:07:38,  3.53it/s]
  7%|▋         | 26362/371472 [2:05:53<26:13:24,  3.66it/s]
  7%|▋         | 26363/371472 [2:05:54<28:58:51,  3.31it/s]
  7%|▋         | 26364/371472 [2:05:54<28:55:09,  3.31it/s]
  7%|▋         | 26365/371472 [2:05:54<28:28:34,  3.37it/s]
  7%|▋         | 26366/371472 [2:05:55<29:07:09,  3.29it/s]
  7%|▋         | 26367/371472 [2:05:55<28:05:50,  3.41it/s]
  7%|▋         | 26368/371472 [2:05:55<28:48:14,  3.33it/s]
  7%|▋         | 26369/371472 [2:05:56<27:28:16,  3.49it/s]
  7%|▋         | 26370/371472 [2:05:56<27:44:35,  3.46it/s]
  7%|▋         | 26371/371472 [2:05:56<26:48:54,  3.57it/s]
  7%|▋         | 26372/371472 [2:05:56<26:25:43,  3.63it/s]
  7%|▋         | 26373/371472 [2:05:57<25:51:50,  3.71it/s]
  7%|▋         | 26374/371472 [2:05:57<25:59:24,  3.69it/s]
  7%|▋         | 26375/371472 [2:05:57<27:24:14,  3.50it/s]
  7%|▋         | 26376/371472 [2:05:58<27:46:33,  3.45it/s]
  7%|▋         | 26377/371472 [2:05:58<28:00:43,  3.42it/s]
  7%|▋         | 26378/371472 [2:05:58<29:01:44,  3.30it/s]
  7%|▋         | 26379/371472 [2:05:58<27:39:57,  3.46it/s]
  7%|▋         | 26380/371472 [2:05:59<27:48:15,  3.45it/s]
                                                           
{'loss': 4.2523, 'learning_rate': 9.365370940981274e-07, 'epoch': 1.14}

  7%|▋         | 26380/371472 [2:05:59<27:48:15,  3.45it/s]
  7%|▋         | 26381/371472 [2:05:59<28:01:41,  3.42it/s]
  7%|▋         | 26382/371472 [2:05:59<27:34:11,  3.48it/s]
  7%|▋         | 26383/371472 [2:06:00<28:36:14,  3.35it/s]
  7%|▋         | 26384/371472 [2:06:00<28:18:10,  3.39it/s]
  7%|▋         | 26385/371472 [2:06:00<28:46:17,  3.33it/s]
  7%|▋         | 26386/371472 [2:06:01<28:12:01,  3.40it/s]
  7%|▋         | 26387/371472 [2:06:01<28:00:32,  3.42it/s]
  7%|▋         | 26388/371472 [2:06:01<28:02:22,  3.42it/s]
  7%|▋         | 26389/371472 [2:06:01<29:49:08,  3.21it/s]
  7%|▋         | 26390/371472 [2:06:02<30:38:26,  3.13it/s]
  7%|▋         | 26391/371472 [2:06:02<28:50:51,  3.32it/s]
  7%|▋         | 26392/371472 [2:06:02<27:43:16,  3.46it/s]
  7%|▋         | 26393/371472 [2:06:03<27:29:25,  3.49it/s]
  7%|▋         | 26394/371472 [2:06:03<26:28:52,  3.62it/s]
  7%|▋         | 26395/371472 [2:06:03<27:18:59,  3.51it/s]
  7%|▋         | 26396/371472 [2:06:03<26:33:10,  3.61it/s]
  7%|▋         | 26397/371472 [2:06:04<26:12:16,  3.66it/s]
  7%|▋         | 26398/371472 [2:06:04<27:25:35,  3.49it/s]
  7%|▋         | 26399/371472 [2:06:04<26:32:13,  3.61it/s]
  7%|▋         | 26400/371472 [2:06:04<25:57:36,  3.69it/s]
                                                           
{'loss': 4.4615, 'learning_rate': 9.364886121226486e-07, 'epoch': 1.14}

  7%|▋         | 26400/371472 [2:06:04<25:57:36,  3.69it/s]
  7%|▋         | 26401/371472 [2:06:05<26:22:48,  3.63it/s]
  7%|▋         | 26402/371472 [2:06:05<25:30:38,  3.76it/s]
  7%|▋         | 26403/371472 [2:06:05<25:54:45,  3.70it/s]
  7%|▋         | 26404/371472 [2:06:06<25:31:35,  3.75it/s]
  7%|▋         | 26405/371472 [2:06:06<25:32:42,  3.75it/s]
  7%|▋         | 26406/371472 [2:06:06<26:02:46,  3.68it/s]
  7%|▋         | 26407/371472 [2:06:06<25:26:42,  3.77it/s]
  7%|▋         | 26408/371472 [2:06:07<25:41:15,  3.73it/s]
  7%|▋         | 26409/371472 [2:06:07<25:52:52,  3.70it/s]
  7%|▋         | 26410/371472 [2:06:07<26:12:25,  3.66it/s]
  7%|▋         | 26411/371472 [2:06:07<25:38:36,  3.74it/s]
  7%|▋         | 26412/371472 [2:06:08<25:10:10,  3.81it/s]
  7%|▋         | 26413/371472 [2:06:08<25:12:12,  3.80it/s]
  7%|▋         | 26414/371472 [2:06:08<26:04:44,  3.68it/s]
  7%|▋         | 26415/371472 [2:06:09<26:59:20,  3.55it/s]
  7%|▋         | 26416/371472 [2:06:09<26:34:37,  3.61it/s]
  7%|▋         | 26417/371472 [2:06:09<26:19:09,  3.64it/s]
  7%|▋         | 26418/371472 [2:06:09<27:02:27,  3.54it/s]
  7%|▋         | 26419/371472 [2:06:10<27:00:53,  3.55it/s]
  7%|▋         | 26420/371472 [2:06:10<27:16:23,  3.51it/s]
                                                           
{'loss': 4.8248, 'learning_rate': 9.364401301471697e-07, 'epoch': 1.14}

  7%|▋         | 26420/371472 [2:06:10<27:16:23,  3.51it/s]
  7%|▋         | 26421/371472 [2:06:10<26:06:03,  3.67it/s]
  7%|▋         | 26422/371472 [2:06:11<27:53:06,  3.44it/s]
  7%|▋         | 26423/371472 [2:06:11<26:25:48,  3.63it/s]
  7%|▋         | 26424/371472 [2:06:11<26:23:55,  3.63it/s]
  7%|▋         | 26425/371472 [2:06:11<26:35:03,  3.61it/s]
  7%|▋         | 26426/371472 [2:06:12<26:39:34,  3.60it/s]
  7%|▋         | 26427/371472 [2:06:12<27:47:01,  3.45it/s]
  7%|▋         | 26428/371472 [2:06:12<26:51:18,  3.57it/s]
  7%|▋         | 26429/371472 [2:06:12<27:02:51,  3.54it/s]
  7%|▋         | 26430/371472 [2:06:13<25:57:47,  3.69it/s]
  7%|▋         | 26431/371472 [2:06:13<25:34:22,  3.75it/s]
  7%|▋         | 26432/371472 [2:06:13<25:24:33,  3.77it/s]
  7%|▋         | 26433/371472 [2:06:14<26:52:06,  3.57it/s]
  7%|▋         | 26434/371472 [2:06:14<28:09:22,  3.40it/s]
  7%|▋         | 26435/371472 [2:06:14<27:52:43,  3.44it/s]
  7%|▋         | 26436/371472 [2:06:14<27:42:50,  3.46it/s]
  7%|▋         | 26437/371472 [2:06:15<27:43:25,  3.46it/s]
  7%|▋         | 26438/371472 [2:06:15<29:14:05,  3.28it/s]
  7%|▋         | 26439/371472 [2:06:15<28:37:50,  3.35it/s]
  7%|▋         | 26440/371472 [2:06:16<27:06:34,  3.54it/s]
                                                           
{'loss': 4.2533, 'learning_rate': 9.363916481716909e-07, 'epoch': 1.14}

  7%|▋         | 26440/371472 [2:06:16<27:06:34,  3.54it/s]
  7%|▋         | 26441/371472 [2:06:16<26:18:19,  3.64it/s]
  7%|▋         | 26442/371472 [2:06:16<27:52:18,  3.44it/s]
  7%|▋         | 26443/371472 [2:06:16<27:51:59,  3.44it/s]
  7%|▋         | 26444/371472 [2:06:17<27:28:53,  3.49it/s]
  7%|▋         | 26445/371472 [2:06:17<27:23:49,  3.50it/s]
  7%|▋         | 26446/371472 [2:06:17<30:03:30,  3.19it/s]
  7%|▋         | 26447/371472 [2:06:18<28:29:04,  3.36it/s]
  7%|▋         | 26448/371472 [2:06:18<27:09:39,  3.53it/s]
  7%|▋         | 26449/371472 [2:06:18<26:44:45,  3.58it/s]
  7%|▋         | 26450/371472 [2:06:18<26:32:44,  3.61it/s]
  7%|▋         | 26451/371472 [2:06:19<26:05:38,  3.67it/s]
  7%|▋         | 26452/371472 [2:06:19<25:56:12,  3.70it/s]
  7%|▋         | 26453/371472 [2:06:19<27:14:21,  3.52it/s]
  7%|▋         | 26454/371472 [2:06:20<27:38:54,  3.47it/s]
  7%|▋         | 26455/371472 [2:06:20<26:26:05,  3.63it/s]
  7%|▋         | 26456/371472 [2:06:20<26:50:15,  3.57it/s]
  7%|▋         | 26457/371472 [2:06:21<30:21:29,  3.16it/s]
  7%|▋         | 26458/371472 [2:06:21<28:30:15,  3.36it/s]
  7%|▋         | 26459/371472 [2:06:21<28:54:12,  3.32it/s]
  7%|▋         | 26460/371472 [2:06:21<28:24:24,  3.37it/s]
                                                           
{'loss': 4.5715, 'learning_rate': 9.363431661962119e-07, 'epoch': 1.14}

  7%|▋         | 26460/371472 [2:06:21<28:24:24,  3.37it/s]
  7%|▋         | 26461/371472 [2:06:22<28:01:26,  3.42it/s]
  7%|▋         | 26462/371472 [2:06:22<28:13:57,  3.39it/s]
  7%|▋         | 26463/371472 [2:06:22<27:32:25,  3.48it/s]
  7%|▋         | 26464/371472 [2:06:23<26:57:14,  3.56it/s]
  7%|▋         | 26465/371472 [2:06:23<28:45:18,  3.33it/s]
  7%|▋         | 26466/371472 [2:06:23<28:15:14,  3.39it/s]
  7%|▋         | 26467/371472 [2:06:23<27:22:02,  3.50it/s]
  7%|▋         | 26468/371472 [2:06:24<26:41:30,  3.59it/s]
  7%|▋         | 26469/371472 [2:06:24<26:27:47,  3.62it/s]
  7%|▋         | 26470/371472 [2:06:24<26:26:50,  3.62it/s]
  7%|▋         | 26471/371472 [2:06:25<26:18:08,  3.64it/s]
  7%|▋         | 26472/371472 [2:06:25<27:08:08,  3.53it/s]
  7%|▋         | 26473/371472 [2:06:25<28:45:28,  3.33it/s]
  7%|▋         | 26474/371472 [2:06:25<29:56:05,  3.20it/s]
  7%|▋         | 26475/371472 [2:06:26<28:21:49,  3.38it/s]
  7%|▋         | 26476/371472 [2:06:26<26:36:58,  3.60it/s]
  7%|▋         | 26477/371472 [2:06:26<26:56:04,  3.56it/s]
  7%|▋         | 26478/371472 [2:06:27<26:14:39,  3.65it/s]
  7%|▋         | 26479/371472 [2:06:27<27:15:46,  3.52it/s]
  7%|▋         | 26480/371472 [2:06:27<30:11:31,  3.17it/s]
                                                           
{'loss': 4.4302, 'learning_rate': 9.36294684220733e-07, 'epoch': 1.14}

  7%|▋         | 26480/371472 [2:06:27<30:11:31,  3.17it/s]
  7%|▋         | 26481/371472 [2:06:28<31:31:31,  3.04it/s]
  7%|▋         | 26482/371472 [2:06:28<30:04:03,  3.19it/s]
  7%|▋         | 26483/371472 [2:06:28<29:26:11,  3.26it/s]
  7%|▋         | 26484/371472 [2:06:28<28:15:34,  3.39it/s]
  7%|▋         | 26485/371472 [2:06:29<28:59:04,  3.31it/s]
  7%|▋         | 26486/371472 [2:06:29<27:37:16,  3.47it/s]
  7%|▋         | 26487/371472 [2:06:29<27:24:56,  3.50it/s]
  7%|▋         | 26488/371472 [2:06:30<27:30:22,  3.48it/s]
  7%|▋         | 26489/371472 [2:06:30<30:10:15,  3.18it/s]
  7%|▋         | 26490/371472 [2:06:30<29:23:53,  3.26it/s]
  7%|▋         | 26491/371472 [2:06:31<28:33:49,  3.35it/s]
  7%|▋         | 26492/371472 [2:06:31<27:21:53,  3.50it/s]
  7%|▋         | 26493/371472 [2:06:31<28:17:56,  3.39it/s]
  7%|▋         | 26494/371472 [2:06:31<27:47:32,  3.45it/s]
  7%|▋         | 26495/371472 [2:06:32<28:10:02,  3.40it/s]
  7%|▋         | 26496/371472 [2:06:32<27:31:02,  3.48it/s]
  7%|▋         | 26497/371472 [2:06:32<26:54:46,  3.56it/s]
  7%|▋         | 26498/371472 [2:06:33<27:33:52,  3.48it/s]
  7%|▋         | 26499/371472 [2:06:33<28:11:32,  3.40it/s]
  7%|▋         | 26500/371472 [2:06:33<28:09:59,  3.40it/s]
                                                           
{'loss': 4.3582, 'learning_rate': 9.362462022452541e-07, 'epoch': 1.14}

  7%|▋         | 26500/371472 [2:06:33<28:09:59,  3.40it/s]
  7%|▋         | 26501/371472 [2:06:33<26:56:25,  3.56it/s]
  7%|▋         | 26502/371472 [2:06:34<27:58:17,  3.43it/s]
  7%|▋         | 26503/371472 [2:06:34<27:37:52,  3.47it/s]
  7%|▋         | 26504/371472 [2:06:34<27:47:51,  3.45it/s]
  7%|▋         | 26505/371472 [2:06:35<28:33:04,  3.36it/s]
  7%|▋         | 26506/371472 [2:06:35<26:55:47,  3.56it/s]
  7%|▋         | 26507/371472 [2:06:35<26:16:01,  3.65it/s]
  7%|▋         | 26508/371472 [2:06:35<26:31:19,  3.61it/s]
  7%|▋         | 26509/371472 [2:06:36<26:22:55,  3.63it/s]
  7%|▋         | 26510/371472 [2:06:36<28:20:44,  3.38it/s]
  7%|▋         | 26511/371472 [2:06:36<27:37:17,  3.47it/s]
  7%|▋         | 26512/371472 [2:06:37<29:28:28,  3.25it/s]
  7%|▋         | 26513/371472 [2:06:37<28:00:51,  3.42it/s]
  7%|▋         | 26514/371472 [2:06:37<27:18:54,  3.51it/s]
  7%|▋         | 26515/371472 [2:06:37<26:56:48,  3.56it/s]
  7%|▋         | 26516/371472 [2:06:38<26:07:37,  3.67it/s]
  7%|▋         | 26517/371472 [2:06:38<26:34:58,  3.60it/s]
  7%|▋         | 26518/371472 [2:06:38<26:21:04,  3.64it/s]
  7%|▋         | 26519/371472 [2:06:39<27:38:18,  3.47it/s]
  7%|▋         | 26520/371472 [2:06:39<27:08:15,  3.53it/s]
                                                           
{'loss': 4.4676, 'learning_rate': 9.361977202697752e-07, 'epoch': 1.14}

  7%|▋         | 26520/371472 [2:06:39<27:08:15,  3.53it/s]
  7%|▋         | 26521/371472 [2:06:39<27:48:36,  3.45it/s]
  7%|▋         | 26522/371472 [2:06:39<28:03:05,  3.42it/s]
  7%|▋         | 26523/371472 [2:06:40<28:23:14,  3.38it/s]
  7%|▋         | 26524/371472 [2:06:40<27:04:33,  3.54it/s]
  7%|▋         | 26525/371472 [2:06:40<26:10:48,  3.66it/s]
  7%|▋         | 26526/371472 [2:06:40<26:11:38,  3.66it/s]
  7%|▋         | 26527/371472 [2:06:41<25:59:34,  3.69it/s]
  7%|▋         | 26528/371472 [2:06:41<27:22:05,  3.50it/s]
  7%|▋         | 26529/371472 [2:06:41<26:25:37,  3.63it/s]
  7%|▋         | 26530/371472 [2:06:42<26:34:56,  3.60it/s]
  7%|▋         | 26531/371472 [2:06:42<29:24:47,  3.26it/s]
  7%|▋         | 26532/371472 [2:06:42<28:28:54,  3.36it/s]
  7%|▋         | 26533/371472 [2:06:42<26:53:02,  3.56it/s]
  7%|▋         | 26534/371472 [2:06:43<27:41:15,  3.46it/s]
  7%|▋         | 26535/371472 [2:06:43<28:56:48,  3.31it/s]
  7%|▋         | 26536/371472 [2:06:43<29:41:26,  3.23it/s]
  7%|▋         | 26537/371472 [2:06:44<28:46:40,  3.33it/s]
  7%|▋         | 26538/371472 [2:06:44<27:40:27,  3.46it/s]
  7%|▋         | 26539/371472 [2:06:44<26:46:01,  3.58it/s]
  7%|▋         | 26540/371472 [2:06:45<26:42:20,  3.59it/s]
                                                           
{'loss': 4.3547, 'learning_rate': 9.361492382942963e-07, 'epoch': 1.14}

  7%|▋         | 26540/371472 [2:06:45<26:42:20,  3.59it/s]
  7%|▋         | 26541/371472 [2:06:45<27:26:46,  3.49it/s]
  7%|▋         | 26542/371472 [2:06:45<27:50:33,  3.44it/s]
  7%|▋         | 26543/371472 [2:06:45<26:52:30,  3.57it/s]
  7%|▋         | 26544/371472 [2:06:46<25:57:22,  3.69it/s]
  7%|▋         | 26545/371472 [2:06:46<25:46:09,  3.72it/s]
  7%|▋         | 26546/371472 [2:06:46<34:15:24,  2.80it/s]
  7%|▋         | 26547/371472 [2:06:47<32:36:13,  2.94it/s]
  7%|▋         | 26548/371472 [2:06:47<30:01:12,  3.19it/s]
  7%|▋         | 26549/371472 [2:06:47<28:38:44,  3.34it/s]
  7%|▋         | 26550/371472 [2:06:48<27:43:46,  3.46it/s]
  7%|▋         | 26551/371472 [2:06:48<27:44:44,  3.45it/s]
  7%|▋         | 26552/371472 [2:06:48<26:16:12,  3.65it/s]
  7%|▋         | 26553/371472 [2:06:48<27:32:06,  3.48it/s]
  7%|▋         | 26554/371472 [2:06:49<28:45:24,  3.33it/s]
  7%|▋         | 26555/371472 [2:06:49<27:49:49,  3.44it/s]
  7%|▋         | 26556/371472 [2:06:49<26:54:05,  3.56it/s]
  7%|▋         | 26557/371472 [2:06:50<28:04:48,  3.41it/s]
  7%|▋         | 26558/371472 [2:06:50<28:23:03,  3.38it/s]
  7%|▋         | 26559/371472 [2:06:50<28:36:57,  3.35it/s]
  7%|▋         | 26560/371472 [2:06:50<27:25:12,  3.49it/s]
                                                           
{'loss': 4.2655, 'learning_rate': 9.361007563188174e-07, 'epoch': 1.14}

  7%|▋         | 26560/371472 [2:06:50<27:25:12,  3.49it/s]
  7%|▋         | 26561/371472 [2:06:51<28:47:02,  3.33it/s]
  7%|▋         | 26562/371472 [2:06:51<28:13:01,  3.40it/s]
  7%|▋         | 26563/371472 [2:06:51<27:16:26,  3.51it/s]
  7%|▋         | 26564/371472 [2:06:52<26:49:18,  3.57it/s]
  7%|▋         | 26565/371472 [2:06:52<27:39:06,  3.46it/s]
  7%|▋         | 26566/371472 [2:06:52<27:32:38,  3.48it/s]
  7%|▋         | 26567/371472 [2:06:53<28:53:44,  3.32it/s]
  7%|▋         | 26568/371472 [2:06:53<27:39:13,  3.46it/s]
  7%|▋         | 26569/371472 [2:06:53<27:10:28,  3.53it/s]
  7%|▋         | 26570/371472 [2:06:53<26:41:29,  3.59it/s]
  7%|▋         | 26571/371472 [2:06:54<28:25:22,  3.37it/s]
  7%|▋         | 26572/371472 [2:06:54<27:01:28,  3.55it/s]
  7%|▋         | 26573/371472 [2:06:54<25:58:06,  3.69it/s]
  7%|▋         | 26574/371472 [2:06:54<25:30:05,  3.76it/s]
  7%|▋         | 26575/371472 [2:06:55<26:47:17,  3.58it/s]
  7%|▋         | 26576/371472 [2:06:55<27:53:00,  3.44it/s]
  7%|▋         | 26577/371472 [2:06:55<30:27:38,  3.15it/s]
  7%|▋         | 26578/371472 [2:06:56<28:09:23,  3.40it/s]
  7%|▋         | 26579/371472 [2:06:56<26:31:59,  3.61it/s]
  7%|▋         | 26580/371472 [2:06:56<26:40:24,  3.59it/s]
                                                           
{'loss': 4.364, 'learning_rate': 9.360522743433386e-07, 'epoch': 1.14}

  7%|▋         | 26580/371472 [2:06:56<26:40:24,  3.59it/s]
  7%|▋         | 26581/371472 [2:06:56<26:49:30,  3.57it/s]
  7%|▋         | 26582/371472 [2:06:57<26:39:15,  3.59it/s]
  7%|▋         | 26583/371472 [2:06:57<27:04:06,  3.54it/s]
  7%|▋         | 26584/371472 [2:06:57<27:01:22,  3.55it/s]
  7%|▋         | 26585/371472 [2:06:58<28:54:42,  3.31it/s]
  7%|▋         | 26586/371472 [2:06:58<28:51:22,  3.32it/s]
  7%|▋         | 26587/371472 [2:06:58<28:47:45,  3.33it/s]
  7%|▋         | 26588/371472 [2:06:58<26:59:21,  3.55it/s]
  7%|▋         | 26589/371472 [2:06:59<26:54:00,  3.56it/s]
  7%|▋         | 26590/371472 [2:06:59<28:05:37,  3.41it/s]
  7%|▋         | 26591/371472 [2:06:59<27:01:37,  3.54it/s]
  7%|▋         | 26592/371472 [2:07:00<25:37:33,  3.74it/s]
  7%|▋         | 26593/371472 [2:07:00<25:52:23,  3.70it/s]
  7%|▋         | 26594/371472 [2:07:00<26:23:23,  3.63it/s]
  7%|▋         | 26595/371472 [2:07:00<26:17:21,  3.64it/s]
  7%|▋         | 26596/371472 [2:07:01<26:45:04,  3.58it/s]
  7%|▋         | 26597/371472 [2:07:01<27:26:01,  3.49it/s]
  7%|▋         | 26598/371472 [2:07:01<27:56:21,  3.43it/s]
  7%|▋         | 26599/371472 [2:07:02<28:15:13,  3.39it/s]
  7%|▋         | 26600/371472 [2:07:02<27:30:42,  3.48it/s]
                                                           
{'loss': 4.2633, 'learning_rate': 9.360037923678596e-07, 'epoch': 1.15}

  7%|▋         | 26600/371472 [2:07:02<27:30:42,  3.48it/s]
  7%|▋         | 26601/371472 [2:07:02<27:53:56,  3.43it/s]
  7%|▋         | 26602/371472 [2:07:02<28:42:04,  3.34it/s]
  7%|▋         | 26603/371472 [2:07:03<28:04:00,  3.41it/s]
  7%|▋         | 26604/371472 [2:07:03<28:22:10,  3.38it/s]
  7%|▋         | 26605/371472 [2:07:03<29:11:41,  3.28it/s]
  7%|▋         | 26606/371472 [2:07:04<29:23:16,  3.26it/s]
  7%|▋         | 26607/371472 [2:07:04<29:42:21,  3.22it/s]
  7%|▋         | 26608/371472 [2:07:04<28:30:05,  3.36it/s]
  7%|▋         | 26609/371472 [2:07:05<27:28:13,  3.49it/s]
  7%|▋         | 26610/371472 [2:07:05<27:36:54,  3.47it/s]
  7%|▋         | 26611/371472 [2:07:05<26:46:07,  3.58it/s]
  7%|▋         | 26612/371472 [2:07:05<26:00:32,  3.68it/s]
  7%|▋         | 26613/371472 [2:07:06<26:26:41,  3.62it/s]
  7%|▋         | 26614/371472 [2:07:06<27:32:18,  3.48it/s]
  7%|▋         | 26615/371472 [2:07:06<26:58:27,  3.55it/s]
  7%|▋         | 26616/371472 [2:07:07<27:23:25,  3.50it/s]
  7%|▋         | 26617/371472 [2:07:07<27:10:28,  3.53it/s]
  7%|▋         | 26618/371472 [2:07:07<27:23:57,  3.50it/s]
  7%|▋         | 26619/371472 [2:07:07<27:04:41,  3.54it/s]
  7%|▋         | 26620/371472 [2:07:08<26:20:37,  3.64it/s]
                                                           
{'loss': 4.2595, 'learning_rate': 9.359553103923807e-07, 'epoch': 1.15}

  7%|▋         | 26620/371472 [2:07:08<26:20:37,  3.64it/s]
  7%|▋         | 26621/371472 [2:07:08<26:27:03,  3.62it/s]
  7%|▋         | 26622/371472 [2:07:08<25:42:40,  3.73it/s]
  7%|▋         | 26623/371472 [2:07:08<25:25:04,  3.77it/s]
  7%|▋         | 26624/371472 [2:07:09<25:35:23,  3.74it/s]
  7%|▋         | 26625/371472 [2:07:09<26:18:32,  3.64it/s]
  7%|▋         | 26626/371472 [2:07:09<26:58:17,  3.55it/s]
  7%|▋         | 26627/371472 [2:07:10<27:52:03,  3.44it/s]
  7%|▋         | 26628/371472 [2:07:10<27:46:32,  3.45it/s]
  7%|▋         | 26629/371472 [2:07:10<27:25:16,  3.49it/s]
  7%|▋         | 26630/371472 [2:07:10<27:09:39,  3.53it/s]
  7%|▋         | 26631/371472 [2:07:11<26:30:25,  3.61it/s]
  7%|▋         | 26632/371472 [2:07:11<27:46:05,  3.45it/s]
  7%|▋         | 26633/371472 [2:07:11<29:04:50,  3.29it/s]
  7%|▋         | 26634/371472 [2:07:12<29:28:53,  3.25it/s]
  7%|▋         | 26635/371472 [2:07:12<29:12:09,  3.28it/s]
  7%|▋         | 26636/371472 [2:07:12<28:01:48,  3.42it/s]
  7%|▋         | 26637/371472 [2:07:13<27:24:25,  3.50it/s]
  7%|▋         | 26638/371472 [2:07:13<26:31:28,  3.61it/s]
  7%|▋         | 26639/371472 [2:07:13<25:31:28,  3.75it/s]
  7%|▋         | 26640/371472 [2:07:13<26:54:47,  3.56it/s]
                                                           
{'loss': 4.3531, 'learning_rate': 9.359068284169018e-07, 'epoch': 1.15}

  7%|▋         | 26640/371472 [2:07:13<26:54:47,  3.56it/s]
  7%|▋         | 26641/371472 [2:07:14<26:22:35,  3.63it/s]
  7%|▋         | 26642/371472 [2:07:14<26:21:47,  3.63it/s]
  7%|▋         | 26643/371472 [2:07:14<26:28:45,  3.62it/s]
  7%|▋         | 26644/371472 [2:07:14<28:52:01,  3.32it/s]
  7%|▋         | 26645/371472 [2:07:15<27:39:11,  3.46it/s]
  7%|▋         | 26646/371472 [2:07:15<28:25:08,  3.37it/s]
  7%|▋         | 26647/371472 [2:07:15<28:58:44,  3.31it/s]
  7%|▋         | 26648/371472 [2:07:16<29:29:14,  3.25it/s]
  7%|▋         | 26649/371472 [2:07:16<29:33:10,  3.24it/s]
  7%|▋         | 26650/371472 [2:07:16<29:41:06,  3.23it/s]
  7%|▋         | 26651/371472 [2:07:17<28:38:53,  3.34it/s]
  7%|▋         | 26652/371472 [2:07:17<27:11:52,  3.52it/s]
  7%|▋         | 26653/371472 [2:07:17<26:13:18,  3.65it/s]
  7%|▋         | 26654/371472 [2:07:17<26:10:16,  3.66it/s]
  7%|▋         | 26655/371472 [2:07:18<26:37:09,  3.60it/s]
  7%|▋         | 26656/371472 [2:07:18<27:38:44,  3.46it/s]
  7%|▋         | 26657/371472 [2:07:18<27:28:03,  3.49it/s]
  7%|▋         | 26658/371472 [2:07:19<26:29:52,  3.61it/s]
  7%|▋         | 26659/371472 [2:07:19<26:25:11,  3.63it/s]
  7%|▋         | 26660/371472 [2:07:19<25:59:15,  3.69it/s]
                                                           
{'loss': 4.6372, 'learning_rate': 9.35858346441423e-07, 'epoch': 1.15}

  7%|▋         | 26660/371472 [2:07:19<25:59:15,  3.69it/s]
  7%|▋         | 26661/371472 [2:07:19<26:12:46,  3.65it/s]
  7%|▋         | 26662/371472 [2:07:20<25:40:45,  3.73it/s]
  7%|▋         | 26663/371472 [2:07:20<25:02:47,  3.82it/s]
  7%|▋         | 26664/371472 [2:07:20<24:39:20,  3.88it/s]
  7%|▋         | 26665/371472 [2:07:20<26:21:05,  3.63it/s]
  7%|▋         | 26666/371472 [2:07:21<25:43:47,  3.72it/s]
  7%|▋         | 26667/371472 [2:07:21<24:45:34,  3.87it/s]
  7%|▋         | 26668/371472 [2:07:21<24:44:12,  3.87it/s]
  7%|▋         | 26669/371472 [2:07:21<26:02:30,  3.68it/s]
  7%|▋         | 26670/371472 [2:07:22<26:28:45,  3.62it/s]
  7%|▋         | 26671/371472 [2:07:22<26:26:56,  3.62it/s]
  7%|▋         | 26672/371472 [2:07:22<25:48:11,  3.71it/s]
  7%|▋         | 26673/371472 [2:07:23<26:17:26,  3.64it/s]
  7%|▋         | 26674/371472 [2:07:23<25:52:42,  3.70it/s]
  7%|▋         | 26675/371472 [2:07:23<25:19:31,  3.78it/s]
  7%|▋         | 26676/371472 [2:07:23<25:03:24,  3.82it/s]
  7%|▋         | 26677/371472 [2:07:24<27:21:27,  3.50it/s]
  7%|▋         | 26678/371472 [2:07:24<28:55:08,  3.31it/s]
  7%|▋         | 26679/371472 [2:07:24<28:25:21,  3.37it/s]
  7%|▋         | 26680/371472 [2:07:25<28:54:11,  3.31it/s]
                                                           
{'loss': 4.4899, 'learning_rate': 9.35809864465944e-07, 'epoch': 1.15}

  7%|▋         | 26680/371472 [2:07:25<28:54:11,  3.31it/s]
  7%|▋         | 26681/371472 [2:07:25<29:48:12,  3.21it/s]
  7%|▋         | 26682/371472 [2:07:25<28:11:09,  3.40it/s]
  7%|▋         | 26683/371472 [2:07:25<26:56:36,  3.55it/s]
  7%|▋         | 26684/371472 [2:07:26<25:49:24,  3.71it/s]
  7%|▋         | 26685/371472 [2:07:26<25:37:20,  3.74it/s]
  7%|▋         | 26686/371472 [2:07:26<27:49:07,  3.44it/s]
  7%|▋         | 26687/371472 [2:07:27<31:55:28,  3.00it/s]
  7%|▋         | 26688/371472 [2:07:27<31:51:18,  3.01it/s]
  7%|▋         | 26689/371472 [2:07:27<30:12:34,  3.17it/s]
  7%|▋         | 26690/371472 [2:07:28<29:15:30,  3.27it/s]
  7%|▋         | 26691/371472 [2:07:28<27:36:00,  3.47it/s]
  7%|▋         | 26692/371472 [2:07:28<28:28:10,  3.36it/s]
  7%|▋         | 26693/371472 [2:07:28<28:23:38,  3.37it/s]
  7%|▋         | 26694/371472 [2:07:29<27:35:43,  3.47it/s]
  7%|▋         | 26695/371472 [2:07:29<26:15:10,  3.65it/s]
  7%|▋         | 26696/371472 [2:07:29<27:08:51,  3.53it/s]
  7%|▋         | 26697/371472 [2:07:30<27:15:06,  3.51it/s]
  7%|▋         | 26698/371472 [2:07:30<26:26:12,  3.62it/s]
  7%|▋         | 26699/371472 [2:07:30<27:03:32,  3.54it/s]
  7%|▋         | 26700/371472 [2:07:30<29:33:20,  3.24it/s]
                                                           
{'loss': 4.2618, 'learning_rate': 9.357613824904652e-07, 'epoch': 1.15}

  7%|▋         | 26700/371472 [2:07:30<29:33:20,  3.24it/s]
  7%|▋         | 26701/371472 [2:07:31<28:33:10,  3.35it/s]
  7%|▋         | 26702/371472 [2:07:31<27:06:27,  3.53it/s]
  7%|▋         | 26703/371472 [2:07:31<28:15:19,  3.39it/s]
  7%|▋         | 26704/371472 [2:07:32<29:53:07,  3.20it/s]
  7%|▋         | 26705/371472 [2:07:32<33:25:35,  2.87it/s]
  7%|▋         | 26706/371472 [2:07:32<32:22:31,  2.96it/s]
  7%|▋         | 26707/371472 [2:07:33<29:57:53,  3.20it/s]
  7%|▋         | 26708/371472 [2:07:33<28:17:53,  3.38it/s]
  7%|▋         | 26709/371472 [2:07:33<27:07:10,  3.53it/s]
  7%|▋         | 26710/371472 [2:07:33<25:41:39,  3.73it/s]
  7%|▋         | 26711/371472 [2:07:34<25:10:12,  3.80it/s]
  7%|▋         | 26712/371472 [2:07:34<28:16:28,  3.39it/s]
  7%|▋         | 26713/371472 [2:07:34<27:07:13,  3.53it/s]
  7%|▋         | 26714/371472 [2:07:35<27:35:30,  3.47it/s]
  7%|▋         | 26715/371472 [2:07:35<26:53:07,  3.56it/s]
  7%|▋         | 26716/371472 [2:07:35<26:47:52,  3.57it/s]
  7%|▋         | 26717/371472 [2:07:35<28:13:02,  3.39it/s]
  7%|▋         | 26718/371472 [2:07:36<28:53:57,  3.31it/s]
  7%|▋         | 26719/371472 [2:07:36<28:14:35,  3.39it/s]
  7%|▋         | 26720/371472 [2:07:36<27:28:29,  3.49it/s]
                                                           
{'loss': 4.3635, 'learning_rate': 9.357129005149863e-07, 'epoch': 1.15}

  7%|▋         | 26720/371472 [2:07:36<27:28:29,  3.49it/s]
  7%|▋         | 26721/371472 [2:07:37<27:52:34,  3.44it/s]
  7%|▋         | 26722/371472 [2:07:37<27:45:32,  3.45it/s]
  7%|▋         | 26723/371472 [2:07:37<27:10:51,  3.52it/s]
  7%|▋         | 26724/371472 [2:07:37<27:19:55,  3.50it/s]
  7%|▋         | 26725/371472 [2:07:38<28:10:44,  3.40it/s]
  7%|▋         | 26726/371472 [2:07:38<30:03:38,  3.19it/s]
  7%|▋         | 26727/371472 [2:07:38<29:28:34,  3.25it/s]
  7%|▋         | 26728/371472 [2:07:39<29:04:57,  3.29it/s]
  7%|▋         | 26729/371472 [2:07:39<29:15:42,  3.27it/s]
  7%|▋         | 26730/371472 [2:07:39<27:21:57,  3.50it/s]
  7%|▋         | 26731/371472 [2:07:40<27:11:29,  3.52it/s]
  7%|▋         | 26732/371472 [2:07:40<26:13:05,  3.65it/s]
  7%|▋         | 26733/371472 [2:07:40<26:15:42,  3.65it/s]
  7%|▋         | 26734/371472 [2:07:40<26:12:52,  3.65it/s]
  7%|▋         | 26735/371472 [2:07:41<25:34:35,  3.74it/s]
  7%|▋         | 26736/371472 [2:07:41<25:31:19,  3.75it/s]
  7%|▋         | 26737/371472 [2:07:41<25:15:47,  3.79it/s]
  7%|▋         | 26738/371472 [2:07:41<25:32:12,  3.75it/s]
  7%|▋         | 26739/371472 [2:07:42<25:21:06,  3.78it/s]
  7%|▋         | 26740/371472 [2:07:42<26:02:23,  3.68it/s]
                                                           
{'loss': 4.2641, 'learning_rate': 9.356644185395074e-07, 'epoch': 1.15}

  7%|▋         | 26740/371472 [2:07:42<26:02:23,  3.68it/s]
  7%|▋         | 26741/371472 [2:07:42<29:01:06,  3.30it/s]
  7%|▋         | 26742/371472 [2:07:43<30:06:47,  3.18it/s]
  7%|▋         | 26743/371472 [2:07:43<29:10:36,  3.28it/s]
  7%|▋         | 26744/371472 [2:07:43<29:41:51,  3.22it/s]
  7%|▋         | 26745/371472 [2:07:44<28:31:25,  3.36it/s]
  7%|▋         | 26746/371472 [2:07:44<27:38:47,  3.46it/s]
  7%|▋         | 26747/371472 [2:07:44<26:46:19,  3.58it/s]
  7%|▋         | 26748/371472 [2:07:44<28:14:52,  3.39it/s]
  7%|▋         | 26749/371472 [2:07:45<27:53:06,  3.43it/s]
  7%|▋         | 26750/371472 [2:07:45<28:10:23,  3.40it/s]
  7%|▋         | 26751/371472 [2:07:45<27:04:43,  3.54it/s]
  7%|▋         | 26752/371472 [2:07:46<28:11:22,  3.40it/s]
  7%|▋         | 26753/371472 [2:07:46<27:47:05,  3.45it/s]
  7%|▋         | 26754/371472 [2:07:46<29:02:11,  3.30it/s]
  7%|▋         | 26755/371472 [2:07:46<27:57:19,  3.43it/s]
  7%|▋         | 26756/371472 [2:07:47<26:57:15,  3.55it/s]
  7%|▋         | 26757/371472 [2:07:47<26:34:21,  3.60it/s]
  7%|▋         | 26758/371472 [2:07:47<26:48:49,  3.57it/s]
  7%|▋         | 26759/371472 [2:07:48<27:52:05,  3.44it/s]
  7%|▋         | 26760/371472 [2:07:48<27:24:17,  3.49it/s]
                                                           
{'loss': 4.3223, 'learning_rate': 9.356159365640284e-07, 'epoch': 1.15}

  7%|▋         | 26760/371472 [2:07:48<27:24:17,  3.49it/s]
  7%|▋         | 26761/371472 [2:07:48<27:05:20,  3.53it/s]
  7%|▋         | 26762/371472 [2:07:48<26:54:51,  3.56it/s]
  7%|▋         | 26763/371472 [2:07:49<26:54:21,  3.56it/s]
  7%|▋         | 26764/371472 [2:07:49<25:53:41,  3.70it/s]
  7%|▋         | 26765/371472 [2:07:49<25:53:56,  3.70it/s]
  7%|▋         | 26766/371472 [2:07:49<26:11:26,  3.66it/s]
  7%|▋         | 26767/371472 [2:07:50<26:34:06,  3.60it/s]
  7%|▋         | 26768/371472 [2:07:50<26:17:50,  3.64it/s]
  7%|▋         | 26769/371472 [2:07:50<26:00:43,  3.68it/s]
  7%|▋         | 26770/371472 [2:07:51<25:30:41,  3.75it/s]
  7%|▋         | 26771/371472 [2:07:51<25:55:00,  3.69it/s]
  7%|▋         | 26772/371472 [2:07:51<25:17:11,  3.79it/s]
  7%|▋         | 26773/371472 [2:07:51<24:35:57,  3.89it/s]
  7%|▋         | 26774/371472 [2:07:52<24:19:54,  3.94it/s]
  7%|▋         | 26775/371472 [2:07:52<24:50:08,  3.86it/s]
  7%|▋         | 26776/371472 [2:07:52<24:53:33,  3.85it/s]
  7%|▋         | 26777/371472 [2:07:52<25:56:06,  3.69it/s]
  7%|▋         | 26778/371472 [2:07:53<28:07:56,  3.40it/s]
  7%|▋         | 26779/371472 [2:07:53<27:30:44,  3.48it/s]
  7%|▋         | 26780/371472 [2:07:53<27:05:34,  3.53it/s]
                                                           
{'loss': 4.666, 'learning_rate': 9.355674545885496e-07, 'epoch': 1.15}

  7%|▋         | 26780/371472 [2:07:53<27:05:34,  3.53it/s]
  7%|▋         | 26781/371472 [2:07:54<26:53:31,  3.56it/s]
  7%|▋         | 26782/371472 [2:07:54<27:30:05,  3.48it/s]
  7%|▋         | 26783/371472 [2:07:54<27:20:10,  3.50it/s]
  7%|▋         | 26784/371472 [2:07:54<27:32:30,  3.48it/s]
  7%|▋         | 26785/371472 [2:07:55<28:03:21,  3.41it/s]
  7%|▋         | 26786/371472 [2:07:55<29:59:10,  3.19it/s]
  7%|▋         | 26787/371472 [2:07:55<30:26:44,  3.14it/s]
  7%|▋         | 26788/371472 [2:07:56<29:02:15,  3.30it/s]
  7%|▋         | 26789/371472 [2:07:56<28:10:50,  3.40it/s]
  7%|▋         | 26790/371472 [2:07:56<26:29:57,  3.61it/s]
  7%|▋         | 26791/371472 [2:07:57<27:42:31,  3.46it/s]
  7%|▋         | 26792/371472 [2:07:57<27:50:45,  3.44it/s]
  7%|▋         | 26793/371472 [2:07:57<26:57:21,  3.55it/s]
  7%|▋         | 26794/371472 [2:07:57<26:39:09,  3.59it/s]
  7%|▋         | 26795/371472 [2:07:58<25:50:39,  3.70it/s]
  7%|▋         | 26796/371472 [2:07:58<25:52:14,  3.70it/s]
  7%|▋         | 26797/371472 [2:07:58<26:15:40,  3.65it/s]
  7%|▋         | 26798/371472 [2:07:58<26:03:58,  3.67it/s]
  7%|▋         | 26799/371472 [2:07:59<31:41:02,  3.02it/s]
  7%|▋         | 26800/371472 [2:07:59<30:04:52,  3.18it/s]
                                                           
{'loss': 4.4854, 'learning_rate': 9.355189726130707e-07, 'epoch': 1.15}

  7%|▋         | 26800/371472 [2:07:59<30:04:52,  3.18it/s]
  7%|▋         | 26801/371472 [2:07:59<28:44:53,  3.33it/s]
  7%|▋         | 26802/371472 [2:08:00<28:17:51,  3.38it/s]
  7%|▋         | 26803/371472 [2:08:00<27:55:00,  3.43it/s]
  7%|▋         | 26804/371472 [2:08:00<27:23:40,  3.49it/s]
  7%|▋         | 26805/371472 [2:08:01<27:49:24,  3.44it/s]
  7%|▋         | 26806/371472 [2:08:01<26:40:29,  3.59it/s]
  7%|▋         | 26807/371472 [2:08:01<27:04:45,  3.54it/s]
  7%|▋         | 26808/371472 [2:08:01<27:16:19,  3.51it/s]
  7%|▋         | 26809/371472 [2:08:02<26:29:57,  3.61it/s]
  7%|▋         | 26810/371472 [2:08:02<26:31:02,  3.61it/s]
  7%|▋         | 26811/371472 [2:08:02<27:06:21,  3.53it/s]
  7%|▋         | 26812/371472 [2:08:03<26:26:07,  3.62it/s]
  7%|▋         | 26813/371472 [2:08:03<26:35:10,  3.60it/s]
  7%|▋         | 26814/371472 [2:08:03<26:56:12,  3.55it/s]
  7%|▋         | 26815/371472 [2:08:03<28:32:54,  3.35it/s]
  7%|▋         | 26816/371472 [2:08:04<27:36:14,  3.47it/s]
  7%|▋         | 26817/371472 [2:08:04<27:01:44,  3.54it/s]
  7%|▋         | 26818/371472 [2:08:04<27:00:41,  3.54it/s]
  7%|▋         | 26819/371472 [2:08:05<26:24:06,  3.63it/s]
  7%|▋         | 26820/371472 [2:08:05<27:08:35,  3.53it/s]
                                                           
{'loss': 4.3282, 'learning_rate': 9.354704906375919e-07, 'epoch': 1.16}

  7%|▋         | 26820/371472 [2:08:05<27:08:35,  3.53it/s]
  7%|▋         | 26821/371472 [2:08:05<28:27:38,  3.36it/s]
  7%|▋         | 26822/371472 [2:08:05<28:28:00,  3.36it/s]
  7%|▋         | 26823/371472 [2:08:06<27:23:21,  3.50it/s]
  7%|▋         | 26824/371472 [2:08:06<26:27:40,  3.62it/s]
  7%|▋         | 26825/371472 [2:08:06<27:32:20,  3.48it/s]
  7%|▋         | 26826/371472 [2:08:07<27:14:46,  3.51it/s]
  7%|▋         | 26827/371472 [2:08:07<28:55:01,  3.31it/s]
  7%|▋         | 26828/371472 [2:08:07<28:28:46,  3.36it/s]
  7%|▋         | 26829/371472 [2:08:07<28:21:13,  3.38it/s]
  7%|▋         | 26830/371472 [2:08:08<28:59:01,  3.30it/s]
  7%|▋         | 26831/371472 [2:08:08<30:28:00,  3.14it/s]
  7%|▋         | 26832/371472 [2:08:08<29:10:11,  3.28it/s]
  7%|▋         | 26833/371472 [2:08:09<30:47:11,  3.11it/s]
  7%|▋         | 26834/371472 [2:08:09<29:05:15,  3.29it/s]
  7%|▋         | 26835/371472 [2:08:09<27:49:42,  3.44it/s]
  7%|▋         | 26836/371472 [2:08:10<26:50:04,  3.57it/s]
  7%|▋         | 26837/371472 [2:08:10<29:25:55,  3.25it/s]
  7%|▋         | 26838/371472 [2:08:10<29:38:56,  3.23it/s]
  7%|▋         | 26839/371472 [2:08:10<28:16:41,  3.39it/s]
  7%|▋         | 26840/371472 [2:08:11<28:12:18,  3.39it/s]
                                                           
{'loss': 4.4205, 'learning_rate': 9.354220086621129e-07, 'epoch': 1.16}

  7%|▋         | 26840/371472 [2:08:11<28:12:18,  3.39it/s]
  7%|▋         | 26841/371472 [2:08:11<27:40:31,  3.46it/s]
  7%|▋         | 26842/371472 [2:08:11<29:10:09,  3.28it/s]
  7%|▋         | 26843/371472 [2:08:12<28:53:11,  3.31it/s]
  7%|▋         | 26844/371472 [2:08:12<28:51:50,  3.32it/s]
  7%|▋         | 26845/371472 [2:08:12<28:17:31,  3.38it/s]
  7%|▋         | 26846/371472 [2:08:13<26:53:37,  3.56it/s]
  7%|▋         | 26847/371472 [2:08:13<26:22:04,  3.63it/s]
  7%|▋         | 26848/371472 [2:08:13<27:28:44,  3.48it/s]
  7%|▋         | 26849/371472 [2:08:13<27:28:00,  3.49it/s]
  7%|▋         | 26850/371472 [2:08:14<29:33:56,  3.24it/s]
  7%|▋         | 26851/371472 [2:08:14<28:32:43,  3.35it/s]
  7%|▋         | 26852/371472 [2:08:14<27:41:28,  3.46it/s]
  7%|▋         | 26853/371472 [2:08:15<27:05:04,  3.53it/s]
  7%|▋         | 26854/371472 [2:08:15<26:55:19,  3.56it/s]
  7%|▋         | 26855/371472 [2:08:15<27:18:41,  3.50it/s]
  7%|▋         | 26856/371472 [2:08:15<27:01:49,  3.54it/s]
  7%|▋         | 26857/371472 [2:08:16<26:29:23,  3.61it/s]
  7%|▋         | 26858/371472 [2:08:16<26:34:46,  3.60it/s]
  7%|▋         | 26859/371472 [2:08:16<26:19:13,  3.64it/s]
  7%|▋         | 26860/371472 [2:08:16<26:02:34,  3.68it/s]
                                                           
{'loss': 4.5329, 'learning_rate': 9.353735266866339e-07, 'epoch': 1.16}

  7%|▋         | 26860/371472 [2:08:16<26:02:34,  3.68it/s]
  7%|▋         | 26861/371472 [2:08:17<25:35:16,  3.74it/s]
  7%|▋         | 26862/371472 [2:08:17<27:07:15,  3.53it/s]
  7%|▋         | 26863/371472 [2:08:17<27:37:47,  3.46it/s]
  7%|▋         | 26864/371472 [2:08:18<27:19:17,  3.50it/s]
  7%|▋         | 26865/371472 [2:08:18<26:40:07,  3.59it/s]
  7%|▋         | 26866/371472 [2:08:18<26:39:42,  3.59it/s]
  7%|▋         | 26867/371472 [2:08:19<27:46:44,  3.45it/s]
  7%|▋         | 26868/371472 [2:08:19<27:51:09,  3.44it/s]
  7%|▋         | 26869/371472 [2:08:19<27:24:14,  3.49it/s]
  7%|▋         | 26870/371472 [2:08:19<26:20:39,  3.63it/s]
  7%|▋         | 26871/371472 [2:08:20<25:47:33,  3.71it/s]
  7%|▋         | 26872/371472 [2:08:20<26:46:40,  3.57it/s]
  7%|▋         | 26873/371472 [2:08:20<26:28:57,  3.61it/s]
  7%|▋         | 26874/371472 [2:08:20<26:03:03,  3.67it/s]
  7%|▋         | 26875/371472 [2:08:21<29:45:15,  3.22it/s]
  7%|▋         | 26876/371472 [2:08:21<28:36:25,  3.35it/s]
  7%|▋         | 26877/371472 [2:08:21<27:14:12,  3.51it/s]
  7%|▋         | 26878/371472 [2:08:22<28:30:35,  3.36it/s]
  7%|▋         | 26879/371472 [2:08:22<27:10:17,  3.52it/s]
  7%|▋         | 26880/371472 [2:08:22<26:19:35,  3.64it/s]
                                                           
{'loss': 4.2963, 'learning_rate': 9.353250447111551e-07, 'epoch': 1.16}

  7%|▋         | 26880/371472 [2:08:22<26:19:35,  3.64it/s]
  7%|▋         | 26881/371472 [2:08:22<25:51:16,  3.70it/s]
  7%|▋         | 26882/371472 [2:08:23<25:35:29,  3.74it/s]
  7%|▋         | 26883/371472 [2:08:23<26:29:19,  3.61it/s]
  7%|▋         | 26884/371472 [2:08:23<27:36:19,  3.47it/s]
  7%|▋         | 26885/371472 [2:08:24<30:39:47,  3.12it/s]
  7%|▋         | 26886/371472 [2:08:24<30:32:11,  3.13it/s]
  7%|▋         | 26887/371472 [2:08:24<30:08:15,  3.18it/s]
  7%|▋         | 26888/371472 [2:08:25<29:05:25,  3.29it/s]
  7%|▋         | 26889/371472 [2:08:25<29:02:39,  3.30it/s]
  7%|▋         | 26890/371472 [2:08:25<30:02:16,  3.19it/s]
  7%|▋         | 26891/371472 [2:08:26<29:34:28,  3.24it/s]
  7%|▋         | 26892/371472 [2:08:26<30:29:18,  3.14it/s]
  7%|▋         | 26893/371472 [2:08:26<28:52:03,  3.32it/s]
  7%|▋         | 26894/371472 [2:08:26<27:44:18,  3.45it/s]
  7%|▋         | 26895/371472 [2:08:27<27:10:29,  3.52it/s]
  7%|▋         | 26896/371472 [2:08:27<28:19:53,  3.38it/s]
  7%|▋         | 26897/371472 [2:08:27<27:55:18,  3.43it/s]
  7%|▋         | 26898/371472 [2:08:28<28:05:28,  3.41it/s]
  7%|▋         | 26899/371472 [2:08:28<27:58:44,  3.42it/s]
  7%|▋         | 26900/371472 [2:08:28<28:18:15,  3.38it/s]
                                                           
{'loss': 4.2485, 'learning_rate': 9.352765627356762e-07, 'epoch': 1.16}

  7%|▋         | 26900/371472 [2:08:28<28:18:15,  3.38it/s]
  7%|▋         | 26901/371472 [2:08:28<27:25:49,  3.49it/s]
  7%|▋         | 26902/371472 [2:08:29<27:34:16,  3.47it/s]
  7%|▋         | 26903/371472 [2:08:29<26:58:39,  3.55it/s]
  7%|▋         | 26904/371472 [2:08:29<27:23:20,  3.49it/s]
  7%|▋         | 26905/371472 [2:08:30<28:24:22,  3.37it/s]
  7%|▋         | 26906/371472 [2:08:30<27:10:36,  3.52it/s]
  7%|▋         | 26907/371472 [2:08:30<26:11:35,  3.65it/s]
  7%|▋         | 26908/371472 [2:08:30<27:10:28,  3.52it/s]
  7%|▋         | 26909/371472 [2:08:31<27:03:40,  3.54it/s]
  7%|▋         | 26910/371472 [2:08:31<27:55:04,  3.43it/s]
  7%|▋         | 26911/371472 [2:08:31<27:11:28,  3.52it/s]
  7%|▋         | 26912/371472 [2:08:32<29:23:30,  3.26it/s]
  7%|▋         | 26913/371472 [2:08:32<29:46:14,  3.21it/s]
  7%|▋         | 26914/371472 [2:08:32<28:30:18,  3.36it/s]
  7%|▋         | 26915/371472 [2:08:32<27:42:09,  3.45it/s]
  7%|▋         | 26916/371472 [2:08:33<27:13:25,  3.52it/s]
  7%|▋         | 26917/371472 [2:08:33<27:36:47,  3.47it/s]
  7%|▋         | 26918/371472 [2:08:33<26:17:44,  3.64it/s]
  7%|▋         | 26919/371472 [2:08:34<25:11:01,  3.80it/s]
  7%|▋         | 26920/371472 [2:08:34<26:13:40,  3.65it/s]
                                                           
{'loss': 4.4059, 'learning_rate': 9.352280807601973e-07, 'epoch': 1.16}

  7%|▋         | 26920/371472 [2:08:34<26:13:40,  3.65it/s]
  7%|▋         | 26921/371472 [2:08:34<26:00:53,  3.68it/s]
  7%|▋         | 26922/371472 [2:08:34<29:12:59,  3.28it/s]
  7%|▋         | 26923/371472 [2:08:35<28:16:18,  3.39it/s]
  7%|▋         | 26924/371472 [2:08:35<27:26:37,  3.49it/s]
  7%|▋         | 26925/371472 [2:08:35<31:56:30,  3.00it/s]
  7%|▋         | 26926/371472 [2:08:36<30:12:50,  3.17it/s]
  7%|▋         | 26927/371472 [2:08:36<28:30:28,  3.36it/s]
  7%|▋         | 26928/371472 [2:08:36<26:43:04,  3.58it/s]
  7%|▋         | 26929/371472 [2:08:37<26:25:10,  3.62it/s]
  7%|▋         | 26930/371472 [2:08:37<26:07:16,  3.66it/s]
  7%|▋         | 26931/371472 [2:08:37<26:05:39,  3.67it/s]
  7%|▋         | 26932/371472 [2:08:37<26:17:40,  3.64it/s]
  7%|▋         | 26933/371472 [2:08:38<25:56:13,  3.69it/s]
  7%|▋         | 26934/371472 [2:08:38<27:01:33,  3.54it/s]
  7%|▋         | 26935/371472 [2:08:38<26:37:00,  3.60it/s]
  7%|▋         | 26936/371472 [2:08:38<27:17:21,  3.51it/s]
  7%|▋         | 26937/371472 [2:08:39<27:42:12,  3.45it/s]
  7%|▋         | 26938/371472 [2:08:39<27:27:24,  3.49it/s]
  7%|▋         | 26939/371472 [2:08:39<26:48:37,  3.57it/s]
  7%|▋         | 26940/371472 [2:08:40<26:18:54,  3.64it/s]
                                                           
{'loss': 4.5401, 'learning_rate': 9.351795987847185e-07, 'epoch': 1.16}

  7%|▋         | 26940/371472 [2:08:40<26:18:54,  3.64it/s]
  7%|▋         | 26941/371472 [2:08:40<26:51:23,  3.56it/s]
  7%|▋         | 26942/371472 [2:08:40<27:16:48,  3.51it/s]
  7%|▋         | 26943/371472 [2:08:40<27:00:11,  3.54it/s]
  7%|▋         | 26944/371472 [2:08:41<26:03:47,  3.67it/s]
  7%|▋         | 26945/371472 [2:08:41<26:45:39,  3.58it/s]
  7%|▋         | 26946/371472 [2:08:41<26:32:56,  3.60it/s]
  7%|▋         | 26947/371472 [2:08:42<26:37:00,  3.60it/s]
  7%|▋         | 26948/371472 [2:08:42<26:24:17,  3.62it/s]
  7%|▋         | 26949/371472 [2:08:42<25:16:21,  3.79it/s]
  7%|▋         | 26950/371472 [2:08:42<25:39:44,  3.73it/s]
  7%|▋         | 26951/371472 [2:08:43<27:32:43,  3.47it/s]
  7%|▋         | 26952/371472 [2:08:43<27:46:16,  3.45it/s]
  7%|▋         | 26953/371472 [2:08:43<28:30:59,  3.36it/s]
  7%|▋         | 26954/371472 [2:08:44<29:09:13,  3.28it/s]
  7%|▋         | 26955/371472 [2:08:44<28:17:42,  3.38it/s]
  7%|▋         | 26956/371472 [2:08:44<28:14:23,  3.39it/s]
  7%|▋         | 26957/371472 [2:08:44<27:29:44,  3.48it/s]
  7%|▋         | 26958/371472 [2:08:45<26:28:38,  3.61it/s]
  7%|▋         | 26959/371472 [2:08:45<27:01:52,  3.54it/s]
  7%|▋         | 26960/371472 [2:08:45<26:17:59,  3.64it/s]
                                                           
{'loss': 4.6506, 'learning_rate': 9.351311168092397e-07, 'epoch': 1.16}

  7%|▋         | 26960/371472 [2:08:45<26:17:59,  3.64it/s]
  7%|▋         | 26961/371472 [2:08:45<25:44:59,  3.72it/s]
  7%|▋         | 26962/371472 [2:08:46<26:10:49,  3.66it/s]
  7%|▋         | 26963/371472 [2:08:46<25:37:22,  3.73it/s]
  7%|▋         | 26964/371472 [2:08:46<26:10:41,  3.66it/s]
  7%|▋         | 26965/371472 [2:08:47<25:32:53,  3.75it/s]
  7%|▋         | 26966/371472 [2:08:47<26:09:06,  3.66it/s]
  7%|▋         | 26967/371472 [2:08:47<25:19:45,  3.78it/s]
  7%|▋         | 26968/371472 [2:08:47<26:42:53,  3.58it/s]
  7%|▋         | 26969/371472 [2:08:48<26:51:53,  3.56it/s]
  7%|▋         | 26970/371472 [2:08:48<26:07:32,  3.66it/s]
  7%|▋         | 26971/371472 [2:08:48<27:32:37,  3.47it/s]
  7%|▋         | 26972/371472 [2:08:49<27:05:30,  3.53it/s]
  7%|▋         | 26973/371472 [2:08:49<25:44:20,  3.72it/s]
  7%|▋         | 26974/371472 [2:08:49<24:56:52,  3.84it/s]
  7%|▋         | 26975/371472 [2:08:49<28:44:59,  3.33it/s]
  7%|▋         | 26976/371472 [2:08:50<27:30:45,  3.48it/s]
  7%|▋         | 26977/371472 [2:08:50<27:04:28,  3.53it/s]
  7%|▋         | 26978/371472 [2:08:50<27:01:13,  3.54it/s]
  7%|▋         | 26979/371472 [2:08:50<26:16:25,  3.64it/s]
  7%|▋         | 26980/371472 [2:08:51<25:20:56,  3.77it/s]
                                                           
{'loss': 4.3864, 'learning_rate': 9.350826348337606e-07, 'epoch': 1.16}

  7%|▋         | 26980/371472 [2:08:51<25:20:56,  3.77it/s]
  7%|▋         | 26981/371472 [2:08:51<28:07:01,  3.40it/s]
  7%|▋         | 26982/371472 [2:08:51<27:43:21,  3.45it/s]
  7%|▋         | 26983/371472 [2:08:52<27:13:58,  3.51it/s]
  7%|▋         | 26984/371472 [2:08:52<30:14:31,  3.16it/s]
  7%|▋         | 26985/371472 [2:08:52<29:29:26,  3.24it/s]
  7%|▋         | 26986/371472 [2:08:53<31:42:26,  3.02it/s]
  7%|▋         | 26987/371472 [2:08:53<30:16:32,  3.16it/s]
  7%|▋         | 26988/371472 [2:08:53<29:20:09,  3.26it/s]
  7%|▋         | 26989/371472 [2:08:54<29:53:42,  3.20it/s]
  7%|▋         | 26990/371472 [2:08:54<28:53:04,  3.31it/s]
  7%|▋         | 26991/371472 [2:08:54<28:33:37,  3.35it/s]
  7%|▋         | 26992/371472 [2:08:54<27:22:33,  3.50it/s]
  7%|▋         | 26993/371472 [2:08:55<26:22:26,  3.63it/s]
  7%|▋         | 26994/371472 [2:08:55<25:52:31,  3.70it/s]
  7%|▋         | 26995/371472 [2:08:55<26:34:28,  3.60it/s]
  7%|▋         | 26996/371472 [2:08:56<27:59:01,  3.42it/s]
  7%|▋         | 26997/371472 [2:08:56<27:42:41,  3.45it/s]
  7%|▋         | 26998/371472 [2:08:56<26:26:29,  3.62it/s]
  7%|▋         | 26999/371472 [2:08:56<27:34:46,  3.47it/s]
  7%|▋         | 27000/371472 [2:08:57<30:05:53,  3.18it/s]
                                                           
{'loss': 4.5897, 'learning_rate': 9.350341528582817e-07, 'epoch': 1.16}

  7%|▋         | 27000/371472 [2:08:57<30:05:53,  3.18it/s]
  7%|▋         | 27001/371472 [2:08:57<29:24:56,  3.25it/s]
  7%|▋         | 27002/371472 [2:08:57<31:34:25,  3.03it/s]
  7%|▋         | 27003/371472 [2:08:58<29:54:55,  3.20it/s]
  7%|▋         | 27004/371472 [2:08:58<28:50:59,  3.32it/s]
  7%|▋         | 27005/371472 [2:08:58<29:24:03,  3.25it/s]
  7%|▋         | 27006/371472 [2:08:59<29:06:21,  3.29it/s]
  7%|▋         | 27007/371472 [2:08:59<27:23:26,  3.49it/s]
  7%|▋         | 27008/371472 [2:08:59<26:29:30,  3.61it/s]
  7%|▋         | 27009/371472 [2:08:59<27:13:17,  3.52it/s]
  7%|▋         | 27010/371472 [2:09:00<27:11:10,  3.52it/s]
  7%|▋         | 27011/371472 [2:09:00<29:20:21,  3.26it/s]
  7%|▋         | 27012/371472 [2:09:00<28:48:56,  3.32it/s]
  7%|▋         | 27013/371472 [2:09:01<29:59:31,  3.19it/s]
  7%|▋         | 27014/371472 [2:09:01<30:35:46,  3.13it/s]
  7%|▋         | 27015/371472 [2:09:01<29:45:40,  3.21it/s]
  7%|▋         | 27016/371472 [2:09:02<28:40:27,  3.34it/s]
  7%|▋         | 27017/371472 [2:09:02<27:54:15,  3.43it/s]
  7%|▋         | 27018/371472 [2:09:02<27:47:01,  3.44it/s]
  7%|▋         | 27019/371472 [2:09:02<27:56:41,  3.42it/s]
  7%|▋         | 27020/371472 [2:09:03<27:57:33,  3.42it/s]
                                                           
{'loss': 4.4499, 'learning_rate': 9.349856708828029e-07, 'epoch': 1.16}

  7%|▋         | 27020/371472 [2:09:03<27:57:33,  3.42it/s]
  7%|▋         | 27021/371472 [2:09:03<27:40:40,  3.46it/s]
  7%|▋         | 27022/371472 [2:09:03<27:48:07,  3.44it/s]
  7%|▋         | 27023/371472 [2:09:04<27:21:36,  3.50it/s]
  7%|▋         | 27024/371472 [2:09:04<27:16:32,  3.51it/s]
  7%|▋         | 27025/371472 [2:09:04<26:58:36,  3.55it/s]
  7%|▋         | 27026/371472 [2:09:04<27:17:23,  3.51it/s]
  7%|▋         | 27027/371472 [2:09:05<26:08:36,  3.66it/s]
  7%|▋         | 27028/371472 [2:09:05<27:00:21,  3.54it/s]
  7%|▋         | 27029/371472 [2:09:05<26:33:35,  3.60it/s]
  7%|▋         | 27030/371472 [2:09:06<26:10:47,  3.65it/s]
  7%|▋         | 27031/371472 [2:09:06<28:16:57,  3.38it/s]
  7%|▋         | 27032/371472 [2:09:06<28:47:43,  3.32it/s]
  7%|▋         | 27033/371472 [2:09:06<28:44:02,  3.33it/s]
  7%|▋         | 27034/371472 [2:09:07<28:14:26,  3.39it/s]
  7%|▋         | 27035/371472 [2:09:07<30:27:12,  3.14it/s]
  7%|▋         | 27036/371472 [2:09:07<28:22:56,  3.37it/s]
  7%|▋         | 27037/371472 [2:09:08<28:17:35,  3.38it/s]
  7%|▋         | 27038/371472 [2:09:08<28:04:49,  3.41it/s]
  7%|▋         | 27039/371472 [2:09:08<27:47:01,  3.44it/s]
  7%|▋         | 27040/371472 [2:09:09<27:51:41,  3.43it/s]
                                                           
{'loss': 4.464, 'learning_rate': 9.34937188907324e-07, 'epoch': 1.16}

  7%|▋         | 27040/371472 [2:09:09<27:51:41,  3.43it/s]
  7%|▋         | 27041/371472 [2:09:09<27:03:29,  3.54it/s]
  7%|▋         | 27042/371472 [2:09:09<26:34:29,  3.60it/s]
  7%|▋         | 27043/371472 [2:09:09<26:11:12,  3.65it/s]
  7%|▋         | 27044/371472 [2:09:10<25:34:15,  3.74it/s]
  7%|▋         | 27045/371472 [2:09:10<26:02:19,  3.67it/s]
  7%|▋         | 27046/371472 [2:09:10<25:59:15,  3.68it/s]
  7%|▋         | 27047/371472 [2:09:10<26:13:10,  3.65it/s]
  7%|▋         | 27048/371472 [2:09:11<27:28:47,  3.48it/s]
  7%|▋         | 27049/371472 [2:09:11<26:44:32,  3.58it/s]
  7%|▋         | 27050/371472 [2:09:11<27:27:07,  3.49it/s]
  7%|▋         | 27051/371472 [2:09:12<26:58:39,  3.55it/s]
  7%|▋         | 27052/371472 [2:09:12<27:38:04,  3.46it/s]
  7%|▋         | 27053/371472 [2:09:12<26:37:03,  3.59it/s]
  7%|▋         | 27054/371472 [2:09:12<26:56:15,  3.55it/s]
  7%|▋         | 27055/371472 [2:09:13<27:49:39,  3.44it/s]
  7%|▋         | 27056/371472 [2:09:13<26:45:32,  3.58it/s]
  7%|▋         | 27057/371472 [2:09:13<26:43:08,  3.58it/s]
  7%|▋         | 27058/371472 [2:09:14<26:18:21,  3.64it/s]
  7%|▋         | 27059/371472 [2:09:14<26:29:15,  3.61it/s]
  7%|▋         | 27060/371472 [2:09:14<28:03:38,  3.41it/s]
                                                           
{'loss': 4.2179, 'learning_rate': 9.348887069318451e-07, 'epoch': 1.17}

  7%|▋         | 27060/371472 [2:09:14<28:03:38,  3.41it/s]
  7%|▋         | 27061/371472 [2:09:14<27:35:46,  3.47it/s]
  7%|▋         | 27062/371472 [2:09:15<26:53:43,  3.56it/s]
  7%|▋         | 27063/371472 [2:09:15<28:22:55,  3.37it/s]
  7%|▋         | 27064/371472 [2:09:15<27:52:06,  3.43it/s]
  7%|▋         | 27065/371472 [2:09:16<26:50:40,  3.56it/s]
  7%|▋         | 27066/371472 [2:09:16<27:59:53,  3.42it/s]
  7%|▋         | 27067/371472 [2:09:16<29:26:48,  3.25it/s]
  7%|▋         | 27068/371472 [2:09:16<28:08:47,  3.40it/s]
  7%|▋         | 27069/371472 [2:09:17<28:43:53,  3.33it/s]
  7%|▋         | 27070/371472 [2:09:17<29:08:59,  3.28it/s]
  7%|▋         | 27071/371472 [2:09:17<27:37:53,  3.46it/s]
  7%|▋         | 27072/371472 [2:09:18<27:49:06,  3.44it/s]
  7%|▋         | 27073/371472 [2:09:18<27:43:08,  3.45it/s]
  7%|▋         | 27074/371472 [2:09:18<26:51:46,  3.56it/s]
  7%|▋         | 27075/371472 [2:09:18<26:32:48,  3.60it/s]
  7%|▋         | 27076/371472 [2:09:19<25:46:25,  3.71it/s]
  7%|▋         | 27077/371472 [2:09:19<26:29:12,  3.61it/s]
  7%|▋         | 27078/371472 [2:09:19<26:08:09,  3.66it/s]
  7%|▋         | 27079/371472 [2:09:20<25:51:44,  3.70it/s]
  7%|▋         | 27080/371472 [2:09:20<26:30:43,  3.61it/s]
                                                           
{'loss': 4.2474, 'learning_rate': 9.348402249563662e-07, 'epoch': 1.17}

  7%|▋         | 27080/371472 [2:09:20<26:30:43,  3.61it/s]
  7%|▋         | 27081/371472 [2:09:20<26:17:08,  3.64it/s]
  7%|▋         | 27082/371472 [2:09:20<25:13:33,  3.79it/s]
  7%|▋         | 27083/371472 [2:09:21<25:29:48,  3.75it/s]
  7%|▋         | 27084/371472 [2:09:21<26:15:00,  3.64it/s]
  7%|▋         | 27085/371472 [2:09:21<26:54:01,  3.56it/s]
  7%|▋         | 27086/371472 [2:09:21<27:06:43,  3.53it/s]
  7%|▋         | 27087/371472 [2:09:22<26:34:33,  3.60it/s]
  7%|▋         | 27088/371472 [2:09:22<26:53:39,  3.56it/s]
  7%|▋         | 27089/371472 [2:09:22<27:36:24,  3.47it/s]
  7%|▋         | 27090/371472 [2:09:23<27:11:51,  3.52it/s]
  7%|▋         | 27091/371472 [2:09:23<27:05:01,  3.53it/s]
  7%|▋         | 27092/371472 [2:09:23<26:51:48,  3.56it/s]
  7%|▋         | 27093/371472 [2:09:23<25:31:47,  3.75it/s]
  7%|▋         | 27094/371472 [2:09:24<26:56:36,  3.55it/s]
  7%|▋         | 27095/371472 [2:09:24<27:34:02,  3.47it/s]
  7%|▋         | 27096/371472 [2:09:24<28:19:56,  3.38it/s]
  7%|▋         | 27097/371472 [2:09:25<27:43:32,  3.45it/s]
  7%|▋         | 27098/371472 [2:09:25<26:56:44,  3.55it/s]
  7%|▋         | 27099/371472 [2:09:25<26:04:08,  3.67it/s]
  7%|▋         | 27100/371472 [2:09:25<27:33:19,  3.47it/s]
                                                           
{'loss': 4.2296, 'learning_rate': 9.347917429808873e-07, 'epoch': 1.17}

  7%|▋         | 27100/371472 [2:09:25<27:33:19,  3.47it/s]
  7%|▋         | 27101/371472 [2:09:26<28:06:16,  3.40it/s]
  7%|▋         | 27102/371472 [2:09:26<27:37:01,  3.46it/s]
  7%|▋         | 27103/371472 [2:09:26<27:06:15,  3.53it/s]
  7%|▋         | 27104/371472 [2:09:27<27:30:27,  3.48it/s]
  7%|▋         | 27105/371472 [2:09:27<28:19:07,  3.38it/s]
  7%|▋         | 27106/371472 [2:09:27<27:01:04,  3.54it/s]
  7%|▋         | 27107/371472 [2:09:28<28:26:02,  3.36it/s]
  7%|▋         | 27108/371472 [2:09:28<27:43:37,  3.45it/s]
  7%|▋         | 27109/371472 [2:09:28<27:45:28,  3.45it/s]
  7%|▋         | 27110/371472 [2:09:28<27:05:57,  3.53it/s]
  7%|▋         | 27111/371472 [2:09:29<27:33:57,  3.47it/s]
  7%|▋         | 27112/371472 [2:09:29<27:22:28,  3.49it/s]
  7%|▋         | 27113/371472 [2:09:29<26:53:20,  3.56it/s]
  7%|▋         | 27114/371472 [2:09:29<27:21:55,  3.50it/s]
  7%|▋         | 27115/371472 [2:09:30<26:58:55,  3.55it/s]
  7%|▋         | 27116/371472 [2:09:30<27:55:25,  3.43it/s]
  7%|▋         | 27117/371472 [2:09:30<27:42:08,  3.45it/s]
  7%|▋         | 27118/371472 [2:09:31<27:45:38,  3.45it/s]
  7%|▋         | 27119/371472 [2:09:31<27:21:04,  3.50it/s]
  7%|▋         | 27120/371472 [2:09:31<27:07:15,  3.53it/s]
                                                           
{'loss': 4.5144, 'learning_rate': 9.347432610054083e-07, 'epoch': 1.17}

  7%|▋         | 27120/371472 [2:09:31<27:07:15,  3.53it/s]
  7%|▋         | 27121/371472 [2:09:31<27:06:21,  3.53it/s]
  7%|▋         | 27122/371472 [2:09:32<28:09:12,  3.40it/s]
  7%|▋         | 27123/371472 [2:09:32<27:05:10,  3.53it/s]
  7%|▋         | 27124/371472 [2:09:32<27:23:27,  3.49it/s]
  7%|▋         | 27125/371472 [2:09:33<27:30:50,  3.48it/s]
  7%|▋         | 27126/371472 [2:09:33<26:54:40,  3.55it/s]
  7%|▋         | 27127/371472 [2:09:33<26:38:07,  3.59it/s]
  7%|▋         | 27128/371472 [2:09:33<26:26:24,  3.62it/s]
  7%|▋         | 27129/371472 [2:09:34<26:49:01,  3.57it/s]
  7%|▋         | 27130/371472 [2:09:34<25:57:40,  3.68it/s]
  7%|▋         | 27131/371472 [2:09:34<26:57:24,  3.55it/s]
  7%|▋         | 27132/371472 [2:09:35<26:42:28,  3.58it/s]
  7%|▋         | 27133/371472 [2:09:35<26:35:07,  3.60it/s]
  7%|▋         | 27134/371472 [2:09:35<28:29:11,  3.36it/s]
  7%|▋         | 27135/371472 [2:09:35<27:46:26,  3.44it/s]
  7%|▋         | 27136/371472 [2:09:36<29:39:36,  3.22it/s]
  7%|▋         | 27137/371472 [2:09:36<28:14:03,  3.39it/s]
  7%|▋         | 27138/371472 [2:09:36<30:11:05,  3.17it/s]
  7%|▋         | 27139/371472 [2:09:37<29:01:25,  3.30it/s]
  7%|▋         | 27140/371472 [2:09:37<28:29:45,  3.36it/s]
                                                           
{'loss': 4.4157, 'learning_rate': 9.346947790299295e-07, 'epoch': 1.17}

  7%|▋         | 27140/371472 [2:09:37<28:29:45,  3.36it/s]
  7%|▋         | 27141/371472 [2:09:37<28:24:34,  3.37it/s]
  7%|▋         | 27142/371472 [2:09:38<28:16:56,  3.38it/s]
  7%|▋         | 27143/371472 [2:09:38<27:18:08,  3.50it/s]
  7%|▋         | 27144/371472 [2:09:38<26:12:02,  3.65it/s]
  7%|▋         | 27145/371472 [2:09:38<28:45:04,  3.33it/s]
  7%|▋         | 27146/371472 [2:09:39<27:48:33,  3.44it/s]
  7%|▋         | 27147/371472 [2:09:39<27:53:01,  3.43it/s]
  7%|▋         | 27148/371472 [2:09:39<27:11:29,  3.52it/s]
  7%|▋         | 27149/371472 [2:09:40<27:02:57,  3.54it/s]
  7%|▋         | 27150/371472 [2:09:40<26:44:53,  3.58it/s]
  7%|▋         | 27151/371472 [2:09:40<26:37:21,  3.59it/s]
  7%|▋         | 27152/371472 [2:09:40<26:12:25,  3.65it/s]
  7%|▋         | 27153/371472 [2:09:41<25:42:30,  3.72it/s]
  7%|▋         | 27154/371472 [2:09:41<27:27:15,  3.48it/s]
  7%|▋         | 27155/371472 [2:09:41<26:32:28,  3.60it/s]
  7%|▋         | 27156/371472 [2:09:41<26:13:55,  3.65it/s]
  7%|▋         | 27157/371472 [2:09:42<26:46:39,  3.57it/s]
  7%|▋         | 27158/371472 [2:09:42<28:37:04,  3.34it/s]
  7%|▋         | 27159/371472 [2:09:42<28:23:14,  3.37it/s]
  7%|▋         | 27160/371472 [2:09:43<29:00:00,  3.30it/s]
                                                           
{'loss': 4.4907, 'learning_rate': 9.346462970544506e-07, 'epoch': 1.17}

  7%|▋         | 27160/371472 [2:09:43<29:00:00,  3.30it/s]
  7%|▋         | 27161/371472 [2:09:43<28:51:04,  3.32it/s]
  7%|▋         | 27162/371472 [2:09:43<28:12:41,  3.39it/s]
  7%|▋         | 27163/371472 [2:09:44<27:23:50,  3.49it/s]
  7%|▋         | 27164/371472 [2:09:44<28:24:00,  3.37it/s]
  7%|▋         | 27165/371472 [2:09:44<28:24:07,  3.37it/s]
  7%|▋         | 27166/371472 [2:09:45<28:47:54,  3.32it/s]
  7%|▋         | 27167/371472 [2:09:45<27:43:13,  3.45it/s]
  7%|▋         | 27168/371472 [2:09:45<27:50:33,  3.44it/s]
  7%|▋         | 27169/371472 [2:09:45<27:48:13,  3.44it/s]
  7%|▋         | 27170/371472 [2:09:46<27:45:28,  3.45it/s]
  7%|▋         | 27171/371472 [2:09:46<27:02:02,  3.54it/s]
  7%|▋         | 27172/371472 [2:09:46<26:50:53,  3.56it/s]
  7%|▋         | 27173/371472 [2:09:47<28:40:07,  3.34it/s]
  7%|▋         | 27174/371472 [2:09:47<28:08:44,  3.40it/s]
  7%|▋         | 27175/371472 [2:09:47<26:52:12,  3.56it/s]
  7%|▋         | 27176/371472 [2:09:47<26:27:29,  3.61it/s]
  7%|▋         | 27177/371472 [2:09:48<28:09:13,  3.40it/s]
  7%|▋         | 27178/371472 [2:09:48<28:41:19,  3.33it/s]
  7%|▋         | 27179/371472 [2:09:48<27:31:17,  3.47it/s]
  7%|▋         | 27180/371472 [2:09:49<26:45:13,  3.57it/s]
                                                           
{'loss': 4.4599, 'learning_rate': 9.345978150789717e-07, 'epoch': 1.17}

  7%|▋         | 27180/371472 [2:09:49<26:45:13,  3.57it/s]
  7%|▋         | 27181/371472 [2:09:49<26:11:24,  3.65it/s]
  7%|▋         | 27182/371472 [2:09:49<28:14:59,  3.39it/s]
  7%|▋         | 27183/371472 [2:09:49<27:28:33,  3.48it/s]
  7%|▋         | 27184/371472 [2:09:50<26:58:05,  3.55it/s]
  7%|▋         | 27185/371472 [2:09:50<28:00:49,  3.41it/s]
  7%|▋         | 27186/371472 [2:09:50<28:13:25,  3.39it/s]
  7%|▋         | 27187/371472 [2:09:51<28:18:40,  3.38it/s]
  7%|▋         | 27188/371472 [2:09:51<27:33:01,  3.47it/s]
  7%|▋         | 27189/371472 [2:09:51<26:42:06,  3.58it/s]
  7%|▋         | 27190/371472 [2:09:51<26:17:42,  3.64it/s]
  7%|▋         | 27191/371472 [2:09:52<25:16:22,  3.78it/s]
  7%|▋         | 27192/371472 [2:09:52<26:02:11,  3.67it/s]
  7%|▋         | 27193/371472 [2:09:52<26:36:03,  3.60it/s]
  7%|▋         | 27194/371472 [2:09:52<26:56:32,  3.55it/s]
  7%|▋         | 27195/371472 [2:09:53<28:29:48,  3.36it/s]
  7%|▋         | 27196/371472 [2:09:53<27:12:20,  3.52it/s]
  7%|▋         | 27197/371472 [2:09:53<28:00:56,  3.41it/s]
  7%|▋         | 27198/371472 [2:09:54<29:20:39,  3.26it/s]
  7%|▋         | 27199/371472 [2:09:54<27:57:01,  3.42it/s]
  7%|▋         | 27200/371472 [2:09:54<28:13:54,  3.39it/s]
                                                           
{'loss': 4.3646, 'learning_rate': 9.345493331034928e-07, 'epoch': 1.17}

  7%|▋         | 27200/371472 [2:09:54<28:13:54,  3.39it/s]
  7%|▋         | 27201/371472 [2:09:55<28:27:34,  3.36it/s]
  7%|▋         | 27202/371472 [2:09:55<28:06:49,  3.40it/s]
  7%|▋         | 27203/371472 [2:09:55<27:58:16,  3.42it/s]
  7%|▋         | 27204/371472 [2:09:55<27:41:34,  3.45it/s]
  7%|▋         | 27205/371472 [2:09:56<27:14:48,  3.51it/s]
  7%|▋         | 27206/371472 [2:09:56<26:25:10,  3.62it/s]
  7%|▋         | 27207/371472 [2:09:56<25:53:24,  3.69it/s]
  7%|▋         | 27208/371472 [2:09:56<25:47:25,  3.71it/s]
  7%|▋         | 27209/371472 [2:09:57<27:00:42,  3.54it/s]
  7%|▋         | 27210/371472 [2:09:57<27:01:03,  3.54it/s]
  7%|▋         | 27211/371472 [2:09:57<27:00:24,  3.54it/s]
  7%|▋         | 27212/371472 [2:09:58<28:04:40,  3.41it/s]
  7%|▋         | 27213/371472 [2:09:58<28:09:56,  3.40it/s]
  7%|▋         | 27214/371472 [2:09:58<28:04:56,  3.41it/s]
  7%|▋         | 27215/371472 [2:09:59<26:33:39,  3.60it/s]
  7%|▋         | 27216/371472 [2:09:59<27:11:03,  3.52it/s]
  7%|▋         | 27217/371472 [2:09:59<26:19:47,  3.63it/s]
  7%|▋         | 27218/371472 [2:09:59<26:05:03,  3.67it/s]
  7%|▋         | 27219/371472 [2:10:00<26:26:57,  3.62it/s]
  7%|▋         | 27220/371472 [2:10:00<27:55:22,  3.42it/s]
                                                           
{'loss': 4.4938, 'learning_rate': 9.345008511280139e-07, 'epoch': 1.17}

  7%|▋         | 27220/371472 [2:10:00<27:55:22,  3.42it/s]
  7%|▋         | 27221/371472 [2:10:00<28:28:09,  3.36it/s]
  7%|▋         | 27222/371472 [2:10:01<27:33:29,  3.47it/s]
  7%|▋         | 27223/371472 [2:10:01<26:16:34,  3.64it/s]
  7%|▋         | 27224/371472 [2:10:01<28:02:12,  3.41it/s]
  7%|▋         | 27225/371472 [2:10:01<26:48:19,  3.57it/s]
  7%|▋         | 27226/371472 [2:10:02<26:07:54,  3.66it/s]
  7%|▋         | 27227/371472 [2:10:02<28:21:15,  3.37it/s]
  7%|▋         | 27228/371472 [2:10:02<27:03:41,  3.53it/s]
  7%|▋         | 27229/371472 [2:10:03<28:49:05,  3.32it/s]
  7%|▋         | 27230/371472 [2:10:03<28:18:04,  3.38it/s]
  7%|▋         | 27231/371472 [2:10:03<31:50:12,  3.00it/s]
  7%|▋         | 27232/371472 [2:10:04<30:36:13,  3.12it/s]
  7%|▋         | 27233/371472 [2:10:04<31:36:58,  3.02it/s]
  7%|▋         | 27234/371472 [2:10:04<32:13:01,  2.97it/s]
  7%|▋         | 27235/371472 [2:10:05<31:51:18,  3.00it/s]
  7%|▋         | 27236/371472 [2:10:05<30:55:12,  3.09it/s]
  7%|▋         | 27237/371472 [2:10:05<29:56:50,  3.19it/s]
  7%|▋         | 27238/371472 [2:10:05<28:38:35,  3.34it/s]
  7%|▋         | 27239/371472 [2:10:06<29:24:46,  3.25it/s]
  7%|▋         | 27240/371472 [2:10:06<30:12:12,  3.17it/s]
                                                           
{'loss': 4.2979, 'learning_rate': 9.34452369152535e-07, 'epoch': 1.17}

  7%|▋         | 27240/371472 [2:10:06<30:12:12,  3.17it/s]
  7%|▋         | 27241/371472 [2:10:06<29:06:02,  3.29it/s]
  7%|▋         | 27242/371472 [2:10:07<28:23:20,  3.37it/s]
  7%|▋         | 27243/371472 [2:10:07<27:01:29,  3.54it/s]
  7%|▋         | 27244/371472 [2:10:07<27:29:52,  3.48it/s]
  7%|▋         | 27245/371472 [2:10:07<26:22:29,  3.63it/s]
  7%|▋         | 27246/371472 [2:10:08<30:08:06,  3.17it/s]
  7%|▋         | 27247/371472 [2:10:08<29:55:23,  3.20it/s]
  7%|▋         | 27248/371472 [2:10:08<28:16:14,  3.38it/s]
  7%|▋         | 27249/371472 [2:10:09<27:31:06,  3.47it/s]
  7%|▋         | 27250/371472 [2:10:09<25:52:29,  3.70it/s]
  7%|▋         | 27251/371472 [2:10:09<26:22:55,  3.62it/s]
  7%|▋         | 27252/371472 [2:10:09<25:54:54,  3.69it/s]
  7%|▋         | 27253/371472 [2:10:10<27:21:54,  3.49it/s]
  7%|▋         | 27254/371472 [2:10:10<26:42:15,  3.58it/s]
  7%|▋         | 27255/371472 [2:10:10<30:25:58,  3.14it/s]
  7%|▋         | 27256/371472 [2:10:11<29:31:25,  3.24it/s]
  7%|▋         | 27257/371472 [2:10:11<31:52:47,  3.00it/s]
  7%|▋         | 27258/371472 [2:10:11<29:35:45,  3.23it/s]
  7%|▋         | 27259/371472 [2:10:12<29:46:18,  3.21it/s]
  7%|▋         | 27260/371472 [2:10:12<27:53:04,  3.43it/s]
                                                           
{'loss': 4.0727, 'learning_rate': 9.344038871770561e-07, 'epoch': 1.17}

  7%|▋         | 27260/371472 [2:10:12<27:53:04,  3.43it/s]
  7%|▋         | 27261/371472 [2:10:12<27:28:25,  3.48it/s]
  7%|▋         | 27262/371472 [2:10:13<27:18:10,  3.50it/s]
  7%|▋         | 27263/371472 [2:10:13<26:16:26,  3.64it/s]
  7%|▋         | 27264/371472 [2:10:13<25:42:11,  3.72it/s]
  7%|▋         | 27265/371472 [2:10:13<26:44:23,  3.58it/s]
  7%|▋         | 27266/371472 [2:10:14<26:53:40,  3.56it/s]
  7%|▋         | 27267/371472 [2:10:14<26:42:32,  3.58it/s]
  7%|▋         | 27268/371472 [2:10:14<26:19:25,  3.63it/s]
  7%|▋         | 27269/371472 [2:10:14<26:28:39,  3.61it/s]
  7%|▋         | 27270/371472 [2:10:15<33:45:10,  2.83it/s]
  7%|▋         | 27271/371472 [2:10:15<31:31:17,  3.03it/s]
  7%|▋         | 27272/371472 [2:10:16<29:30:08,  3.24it/s]
  7%|▋         | 27273/371472 [2:10:16<33:55:16,  2.82it/s]
  7%|▋         | 27274/371472 [2:10:16<31:58:17,  2.99it/s]
  7%|▋         | 27275/371472 [2:10:17<30:56:50,  3.09it/s]
  7%|▋         | 27276/371472 [2:10:17<28:49:19,  3.32it/s]
  7%|▋         | 27277/371472 [2:10:17<28:34:01,  3.35it/s]
  7%|▋         | 27278/371472 [2:10:17<28:31:11,  3.35it/s]
  7%|▋         | 27279/371472 [2:10:18<29:51:53,  3.20it/s]
  7%|▋         | 27280/371472 [2:10:18<28:41:57,  3.33it/s]
                                                           
{'loss': 4.3746, 'learning_rate': 9.343554052015772e-07, 'epoch': 1.18}

  7%|▋         | 27280/371472 [2:10:18<28:41:57,  3.33it/s]
  7%|▋         | 27281/371472 [2:10:18<28:44:25,  3.33it/s]
  7%|▋         | 27282/371472 [2:10:19<28:00:35,  3.41it/s]
  7%|▋         | 27283/371472 [2:10:19<28:01:45,  3.41it/s]
  7%|▋         | 27284/371472 [2:10:19<26:52:16,  3.56it/s]
  7%|▋         | 27285/371472 [2:10:19<26:27:44,  3.61it/s]
  7%|▋         | 27286/371472 [2:10:20<26:08:33,  3.66it/s]
  7%|▋         | 27287/371472 [2:10:20<25:42:30,  3.72it/s]
  7%|▋         | 27288/371472 [2:10:20<26:30:26,  3.61it/s]
  7%|▋         | 27289/371472 [2:10:21<27:19:26,  3.50it/s]
  7%|▋         | 27290/371472 [2:10:21<27:22:52,  3.49it/s]
  7%|▋         | 27291/371472 [2:10:21<26:21:28,  3.63it/s]
  7%|▋         | 27292/371472 [2:10:21<27:42:27,  3.45it/s]
  7%|▋         | 27293/371472 [2:10:22<27:29:53,  3.48it/s]
  7%|▋         | 27294/371472 [2:10:22<27:44:07,  3.45it/s]
  7%|▋         | 27295/371472 [2:10:22<27:38:21,  3.46it/s]
  7%|▋         | 27296/371472 [2:10:23<28:11:16,  3.39it/s]
  7%|▋         | 27297/371472 [2:10:23<29:11:33,  3.27it/s]
  7%|▋         | 27298/371472 [2:10:23<29:22:04,  3.26it/s]
  7%|▋         | 27299/371472 [2:10:23<28:09:42,  3.39it/s]
  7%|▋         | 27300/371472 [2:10:24<27:24:01,  3.49it/s]
                                                           
{'loss': 4.4847, 'learning_rate': 9.343069232260983e-07, 'epoch': 1.18}

  7%|▋         | 27300/371472 [2:10:24<27:24:01,  3.49it/s]
  7%|▋         | 27301/371472 [2:10:24<28:03:36,  3.41it/s]
  7%|▋         | 27302/371472 [2:10:24<28:18:45,  3.38it/s]
  7%|▋         | 27303/371472 [2:10:25<26:52:01,  3.56it/s]
  7%|▋         | 27304/371472 [2:10:25<27:00:38,  3.54it/s]
  7%|▋         | 27305/371472 [2:10:25<26:45:25,  3.57it/s]
  7%|▋         | 27306/371472 [2:10:25<26:31:31,  3.60it/s]
  7%|▋         | 27307/371472 [2:10:26<25:34:20,  3.74it/s]
  7%|▋         | 27308/371472 [2:10:26<27:23:48,  3.49it/s]
  7%|▋         | 27309/371472 [2:10:26<28:26:37,  3.36it/s]
  7%|▋         | 27310/371472 [2:10:27<27:20:35,  3.50it/s]
  7%|▋         | 27311/371472 [2:10:27<28:20:29,  3.37it/s]
  7%|▋         | 27312/371472 [2:10:27<26:47:56,  3.57it/s]
  7%|▋         | 27313/371472 [2:10:27<26:10:43,  3.65it/s]
  7%|▋         | 27314/371472 [2:10:28<25:36:35,  3.73it/s]
  7%|▋         | 27315/371472 [2:10:28<25:14:38,  3.79it/s]
  7%|▋         | 27316/371472 [2:10:28<25:51:33,  3.70it/s]
  7%|▋         | 27317/371472 [2:10:28<25:49:14,  3.70it/s]
  7%|▋         | 27318/371472 [2:10:29<26:53:49,  3.55it/s]
  7%|▋         | 27319/371472 [2:10:29<26:15:59,  3.64it/s]
  7%|▋         | 27320/371472 [2:10:29<26:37:45,  3.59it/s]
                                                           
{'loss': 4.3683, 'learning_rate': 9.342584412506195e-07, 'epoch': 1.18}

  7%|▋         | 27320/371472 [2:10:29<26:37:45,  3.59it/s]
  7%|▋         | 27321/371472 [2:10:30<25:49:53,  3.70it/s]
  7%|▋         | 27322/371472 [2:10:30<28:46:48,  3.32it/s]
  7%|▋         | 27323/371472 [2:10:30<28:53:23,  3.31it/s]
  7%|▋         | 27324/371472 [2:10:31<28:22:53,  3.37it/s]
  7%|▋         | 27325/371472 [2:10:31<27:30:48,  3.47it/s]
  7%|▋         | 27326/371472 [2:10:31<27:08:12,  3.52it/s]
  7%|▋         | 27327/371472 [2:10:31<26:36:41,  3.59it/s]
  7%|▋         | 27328/371472 [2:10:32<26:23:01,  3.62it/s]
  7%|▋         | 27329/371472 [2:10:32<26:19:50,  3.63it/s]
  7%|▋         | 27330/371472 [2:10:32<27:16:57,  3.50it/s]
  7%|▋         | 27331/371472 [2:10:32<26:34:18,  3.60it/s]
  7%|▋         | 27332/371472 [2:10:33<26:05:50,  3.66it/s]
  7%|▋         | 27333/371472 [2:10:33<27:15:02,  3.51it/s]
  7%|▋         | 27334/371472 [2:10:33<26:32:53,  3.60it/s]
  7%|▋         | 27335/371472 [2:10:34<27:07:30,  3.52it/s]
  7%|▋         | 27336/371472 [2:10:34<27:13:03,  3.51it/s]
  7%|▋         | 27337/371472 [2:10:34<27:29:15,  3.48it/s]
  7%|▋         | 27338/371472 [2:10:34<26:52:09,  3.56it/s]
  7%|▋         | 27339/371472 [2:10:35<28:33:35,  3.35it/s]
  7%|▋         | 27340/371472 [2:10:35<28:21:57,  3.37it/s]
                                                           
{'loss': 4.4623, 'learning_rate': 9.342099592751406e-07, 'epoch': 1.18}

  7%|▋         | 27340/371472 [2:10:35<28:21:57,  3.37it/s]
  7%|▋         | 27341/371472 [2:10:35<27:59:53,  3.41it/s]
  7%|▋         | 27342/371472 [2:10:36<26:57:18,  3.55it/s]
  7%|▋         | 27343/371472 [2:10:36<27:26:35,  3.48it/s]
  7%|▋         | 27344/371472 [2:10:36<26:24:08,  3.62it/s]
  7%|▋         | 27345/371472 [2:10:36<26:00:13,  3.68it/s]
  7%|▋         | 27346/371472 [2:10:37<25:06:22,  3.81it/s]
  7%|▋         | 27347/371472 [2:10:37<25:43:08,  3.72it/s]
  7%|▋         | 27348/371472 [2:10:37<25:32:37,  3.74it/s]
  7%|▋         | 27349/371472 [2:10:38<26:31:41,  3.60it/s]
  7%|▋         | 27350/371472 [2:10:38<28:24:49,  3.36it/s]
  7%|▋         | 27351/371472 [2:10:38<29:15:37,  3.27it/s]
  7%|▋         | 27352/371472 [2:10:39<30:11:21,  3.17it/s]
  7%|▋         | 27353/371472 [2:10:39<28:08:15,  3.40it/s]
  7%|▋         | 27354/371472 [2:10:39<27:22:39,  3.49it/s]
  7%|▋         | 27355/371472 [2:10:39<27:33:40,  3.47it/s]
  7%|▋         | 27356/371472 [2:10:40<30:25:12,  3.14it/s]
  7%|▋         | 27357/371472 [2:10:40<29:44:04,  3.21it/s]
  7%|▋         | 27358/371472 [2:10:40<29:35:08,  3.23it/s]
  7%|▋         | 27359/371472 [2:10:41<28:46:32,  3.32it/s]
  7%|▋         | 27360/371472 [2:10:41<29:48:01,  3.21it/s]
                                                           
{'loss': 4.5681, 'learning_rate': 9.341614772996617e-07, 'epoch': 1.18}

  7%|▋         | 27360/371472 [2:10:41<29:48:01,  3.21it/s]
  7%|▋         | 27361/371472 [2:10:41<29:41:52,  3.22it/s]
  7%|▋         | 27362/371472 [2:10:42<29:29:24,  3.24it/s]
  7%|▋         | 27363/371472 [2:10:42<27:55:32,  3.42it/s]
  7%|▋         | 27364/371472 [2:10:42<27:12:22,  3.51it/s]
  7%|▋         | 27365/371472 [2:10:42<27:01:03,  3.54it/s]
  7%|▋         | 27366/371472 [2:10:43<25:43:50,  3.71it/s]
  7%|▋         | 27367/371472 [2:10:43<26:24:26,  3.62it/s]
  7%|▋         | 27368/371472 [2:10:43<26:29:58,  3.61it/s]
  7%|▋         | 27369/371472 [2:10:43<27:14:06,  3.51it/s]
  7%|▋         | 27370/371472 [2:10:44<26:53:44,  3.55it/s]
  7%|▋         | 27371/371472 [2:10:44<26:19:50,  3.63it/s]
  7%|▋         | 27372/371472 [2:10:44<29:47:33,  3.21it/s]
  7%|▋         | 27373/371472 [2:10:45<29:20:09,  3.26it/s]
  7%|▋         | 27374/371472 [2:10:45<29:38:59,  3.22it/s]
  7%|▋         | 27375/371472 [2:10:45<29:42:05,  3.22it/s]
  7%|▋         | 27376/371472 [2:10:46<28:19:03,  3.38it/s]
  7%|▋         | 27377/371472 [2:10:46<28:18:10,  3.38it/s]
  7%|▋         | 27378/371472 [2:10:46<30:55:07,  3.09it/s]
  7%|▋         | 27379/371472 [2:10:47<29:03:59,  3.29it/s]
  7%|▋         | 27380/371472 [2:10:47<28:22:54,  3.37it/s]
                                                           
{'loss': 4.4459, 'learning_rate': 9.341129953241827e-07, 'epoch': 1.18}

  7%|▋         | 27380/371472 [2:10:47<28:22:54,  3.37it/s]
  7%|▋         | 27381/371472 [2:10:47<27:13:30,  3.51it/s]
  7%|▋         | 27382/371472 [2:10:47<28:35:11,  3.34it/s]
  7%|▋         | 27383/371472 [2:10:48<29:43:10,  3.22it/s]
  7%|▋         | 27384/371472 [2:10:48<28:19:41,  3.37it/s]
  7%|▋         | 27385/371472 [2:10:48<28:57:18,  3.30it/s]
  7%|▋         | 27386/371472 [2:10:49<27:26:29,  3.48it/s]
  7%|▋         | 27387/371472 [2:10:49<26:48:34,  3.57it/s]
  7%|▋         | 27388/371472 [2:10:49<26:08:14,  3.66it/s]
  7%|▋         | 27389/371472 [2:10:49<25:51:43,  3.70it/s]
  7%|▋         | 27390/371472 [2:10:50<25:46:47,  3.71it/s]
  7%|▋         | 27391/371472 [2:10:50<27:44:45,  3.44it/s]
  7%|▋         | 27392/371472 [2:10:50<26:21:51,  3.63it/s]
  7%|▋         | 27393/371472 [2:10:50<27:11:16,  3.52it/s]
  7%|▋         | 27394/371472 [2:10:51<27:20:39,  3.50it/s]
  7%|▋         | 27395/371472 [2:10:51<27:03:57,  3.53it/s]
  7%|▋         | 27396/371472 [2:10:51<29:02:49,  3.29it/s]
  7%|▋         | 27397/371472 [2:10:52<27:40:14,  3.45it/s]
  7%|▋         | 27398/371472 [2:10:52<26:51:43,  3.56it/s]
  7%|▋         | 27399/371472 [2:10:52<26:20:49,  3.63it/s]
  7%|▋         | 27400/371472 [2:10:52<25:59:42,  3.68it/s]
                                                           
{'loss': 4.2048, 'learning_rate': 9.340645133487039e-07, 'epoch': 1.18}

  7%|▋         | 27400/371472 [2:10:52<25:59:42,  3.68it/s]
  7%|▋         | 27401/371472 [2:10:53<28:07:21,  3.40it/s]
  7%|▋         | 27402/371472 [2:10:53<28:29:09,  3.36it/s]
  7%|▋         | 27403/371472 [2:10:53<28:10:00,  3.39it/s]
  7%|▋         | 27404/371472 [2:10:54<27:29:58,  3.48it/s]
  7%|▋         | 27405/371472 [2:10:54<27:06:31,  3.53it/s]
  7%|▋         | 27406/371472 [2:10:54<26:48:30,  3.57it/s]
  7%|▋         | 27407/371472 [2:10:54<26:16:57,  3.64it/s]
  7%|▋         | 27408/371472 [2:10:55<26:36:18,  3.59it/s]
  7%|▋         | 27409/371472 [2:10:55<28:09:28,  3.39it/s]
  7%|▋         | 27410/371472 [2:10:55<26:54:11,  3.55it/s]
  7%|▋         | 27411/371472 [2:10:56<26:20:46,  3.63it/s]
  7%|▋         | 27412/371472 [2:10:56<25:58:23,  3.68it/s]
  7%|▋         | 27413/371472 [2:10:56<27:06:45,  3.53it/s]
  7%|▋         | 27414/371472 [2:10:56<26:55:09,  3.55it/s]
  7%|▋         | 27415/371472 [2:10:57<26:11:07,  3.65it/s]
  7%|▋         | 27416/371472 [2:10:57<27:07:02,  3.52it/s]
  7%|▋         | 27417/371472 [2:10:57<27:02:36,  3.53it/s]
  7%|▋         | 27418/371472 [2:10:58<26:31:42,  3.60it/s]
  7%|▋         | 27419/371472 [2:10:58<26:02:03,  3.67it/s]
  7%|▋         | 27420/371472 [2:10:58<26:48:53,  3.56it/s]
                                                           
{'loss': 4.2432, 'learning_rate': 9.34016031373225e-07, 'epoch': 1.18}

  7%|▋         | 27420/371472 [2:10:58<26:48:53,  3.56it/s]
  7%|▋         | 27421/371472 [2:10:58<26:57:39,  3.54it/s]
  7%|▋         | 27422/371472 [2:10:59<26:17:52,  3.63it/s]
  7%|▋         | 27423/371472 [2:10:59<27:30:29,  3.47it/s]
  7%|▋         | 27424/371472 [2:10:59<27:48:31,  3.44it/s]
  7%|▋         | 27425/371472 [2:11:00<28:50:15,  3.31it/s]
  7%|▋         | 27426/371472 [2:11:00<28:12:58,  3.39it/s]
  7%|▋         | 27427/371472 [2:11:00<29:27:48,  3.24it/s]
  7%|▋         | 27428/371472 [2:11:00<28:02:09,  3.41it/s]
  7%|▋         | 27429/371472 [2:11:01<29:05:40,  3.28it/s]
  7%|▋         | 27430/371472 [2:11:01<27:47:27,  3.44it/s]
  7%|▋         | 27431/371472 [2:11:01<28:26:56,  3.36it/s]
  7%|▋         | 27432/371472 [2:11:02<27:44:40,  3.44it/s]
  7%|▋         | 27433/371472 [2:11:02<26:54:36,  3.55it/s]
  7%|▋         | 27434/371472 [2:11:02<29:05:26,  3.29it/s]
  7%|▋         | 27435/371472 [2:11:03<27:53:08,  3.43it/s]
  7%|▋         | 27436/371472 [2:11:03<27:33:45,  3.47it/s]
  7%|▋         | 27437/371472 [2:11:03<26:53:13,  3.55it/s]
  7%|▋         | 27438/371472 [2:11:03<27:30:14,  3.47it/s]
  7%|▋         | 27439/371472 [2:11:04<26:26:06,  3.62it/s]
  7%|▋         | 27440/371472 [2:11:04<26:19:46,  3.63it/s]
                                                           
{'loss': 4.5315, 'learning_rate': 9.339675493977461e-07, 'epoch': 1.18}

  7%|▋         | 27440/371472 [2:11:04<26:19:46,  3.63it/s]
  7%|▋         | 27441/371472 [2:11:04<25:34:17,  3.74it/s]
  7%|▋         | 27442/371472 [2:11:04<24:41:22,  3.87it/s]
  7%|▋         | 27443/371472 [2:11:05<26:39:14,  3.59it/s]
  7%|▋         | 27444/371472 [2:11:05<26:27:40,  3.61it/s]
  7%|▋         | 27445/371472 [2:11:05<26:14:09,  3.64it/s]
  7%|▋         | 27446/371472 [2:11:06<26:18:49,  3.63it/s]
  7%|▋         | 27447/371472 [2:11:06<26:50:37,  3.56it/s]
  7%|▋         | 27448/371472 [2:11:06<26:05:13,  3.66it/s]
  7%|▋         | 27449/371472 [2:11:06<25:42:57,  3.72it/s]
  7%|▋         | 27450/371472 [2:11:07<26:16:06,  3.64it/s]
  7%|▋         | 27451/371472 [2:11:07<25:56:29,  3.68it/s]
  7%|▋         | 27452/371472 [2:11:07<26:03:58,  3.67it/s]
  7%|▋         | 27453/371472 [2:11:08<29:13:42,  3.27it/s]
  7%|▋         | 27454/371472 [2:11:08<30:33:15,  3.13it/s]
  7%|▋         | 27455/371472 [2:11:08<31:30:15,  3.03it/s]
  7%|▋         | 27456/371472 [2:11:09<30:25:15,  3.14it/s]
  7%|▋         | 27457/371472 [2:11:09<30:14:19,  3.16it/s]
  7%|▋         | 27458/371472 [2:11:09<30:06:06,  3.17it/s]
  7%|▋         | 27459/371472 [2:11:09<28:59:56,  3.30it/s]
  7%|▋         | 27460/371472 [2:11:10<27:47:05,  3.44it/s]
                                                           
{'loss': 4.6568, 'learning_rate': 9.339190674222672e-07, 'epoch': 1.18}

  7%|▋         | 27460/371472 [2:11:10<27:47:05,  3.44it/s]
  7%|▋         | 27461/371472 [2:11:10<27:38:44,  3.46it/s]
  7%|▋         | 27462/371472 [2:11:10<30:10:00,  3.17it/s]
  7%|▋         | 27463/371472 [2:11:11<30:07:17,  3.17it/s]
  7%|▋         | 27464/371472 [2:11:11<28:38:44,  3.34it/s]
  7%|▋         | 27465/371472 [2:11:11<26:58:47,  3.54it/s]
  7%|▋         | 27466/371472 [2:11:11<26:13:12,  3.64it/s]
  7%|▋         | 27467/371472 [2:11:12<26:32:12,  3.60it/s]
  7%|▋         | 27468/371472 [2:11:12<27:11:30,  3.51it/s]
  7%|▋         | 27469/371472 [2:11:12<30:13:42,  3.16it/s]
  7%|▋         | 27470/371472 [2:11:13<31:09:25,  3.07it/s]
  7%|▋         | 27471/371472 [2:11:13<29:17:53,  3.26it/s]
  7%|▋         | 27472/371472 [2:11:13<27:52:21,  3.43it/s]
  7%|▋         | 27473/371472 [2:11:14<27:15:54,  3.50it/s]
  7%|▋         | 27474/371472 [2:11:14<25:56:20,  3.68it/s]
  7%|▋         | 27475/371472 [2:11:14<25:45:28,  3.71it/s]
  7%|▋         | 27476/371472 [2:11:14<27:12:59,  3.51it/s]
  7%|▋         | 27477/371472 [2:11:15<27:27:20,  3.48it/s]
  7%|▋         | 27478/371472 [2:11:15<27:30:25,  3.47it/s]
  7%|▋         | 27479/371472 [2:11:15<27:25:44,  3.48it/s]
  7%|▋         | 27480/371472 [2:11:16<26:47:48,  3.57it/s]
                                                           
{'loss': 4.3739, 'learning_rate': 9.338705854467885e-07, 'epoch': 1.18}

  7%|▋         | 27480/371472 [2:11:16<26:47:48,  3.57it/s]
  7%|▋         | 27481/371472 [2:11:16<27:10:07,  3.52it/s]
  7%|▋         | 27482/371472 [2:11:16<26:02:17,  3.67it/s]
  7%|▋         | 27483/371472 [2:11:16<27:51:03,  3.43it/s]
  7%|▋         | 27484/371472 [2:11:17<27:11:16,  3.51it/s]
  7%|▋         | 27485/371472 [2:11:17<26:55:22,  3.55it/s]
  7%|▋         | 27486/371472 [2:11:17<25:47:05,  3.71it/s]
  7%|▋         | 27487/371472 [2:11:17<25:52:14,  3.69it/s]
  7%|▋         | 27488/371472 [2:11:18<26:04:17,  3.66it/s]
  7%|▋         | 27489/371472 [2:11:18<26:38:00,  3.59it/s]
  7%|▋         | 27490/371472 [2:11:18<26:58:59,  3.54it/s]
  7%|▋         | 27491/371472 [2:11:19<27:13:21,  3.51it/s]
  7%|▋         | 27492/371472 [2:11:19<28:15:40,  3.38it/s]
  7%|▋         | 27493/371472 [2:11:19<27:40:42,  3.45it/s]
  7%|▋         | 27494/371472 [2:11:20<28:17:17,  3.38it/s]
  7%|▋         | 27495/371472 [2:11:20<27:51:51,  3.43it/s]
  7%|▋         | 27496/371472 [2:11:20<27:37:28,  3.46it/s]
  7%|▋         | 27497/371472 [2:11:20<26:57:20,  3.54it/s]
  7%|▋         | 27498/371472 [2:11:21<28:09:11,  3.39it/s]
  7%|▋         | 27499/371472 [2:11:21<27:42:30,  3.45it/s]
  7%|▋         | 27500/371472 [2:11:21<27:14:35,  3.51it/s]
                                                           
{'loss': 4.4015, 'learning_rate': 9.338221034713093e-07, 'epoch': 1.18}

  7%|▋         | 27500/371472 [2:11:21<27:14:35,  3.51it/s]
  7%|▋         | 27501/371472 [2:11:21<26:09:43,  3.65it/s]
  7%|▋         | 27502/371472 [2:11:22<26:45:01,  3.57it/s]
  7%|▋         | 27503/371472 [2:11:22<28:37:50,  3.34it/s]
  7%|▋         | 27504/371472 [2:11:22<27:27:04,  3.48it/s]
  7%|▋         | 27505/371472 [2:11:23<27:18:04,  3.50it/s]
  7%|▋         | 27506/371472 [2:11:23<26:44:32,  3.57it/s]
  7%|▋         | 27507/371472 [2:11:23<27:44:50,  3.44it/s]
  7%|▋         | 27508/371472 [2:11:24<28:19:04,  3.37it/s]
  7%|▋         | 27509/371472 [2:11:24<27:17:09,  3.50it/s]
  7%|▋         | 27510/371472 [2:11:24<26:24:38,  3.62it/s]
  7%|▋         | 27511/371472 [2:11:24<25:54:28,  3.69it/s]
  7%|▋         | 27512/371472 [2:11:25<25:41:07,  3.72it/s]
  7%|▋         | 27513/371472 [2:11:25<26:39:22,  3.58it/s]
  7%|▋         | 27514/371472 [2:11:25<28:28:42,  3.35it/s]
  7%|▋         | 27515/371472 [2:11:26<28:08:37,  3.39it/s]
  7%|▋         | 27516/371472 [2:11:26<26:42:17,  3.58it/s]
  7%|▋         | 27517/371472 [2:11:26<25:47:17,  3.70it/s]
  7%|▋         | 27518/371472 [2:11:26<25:17:47,  3.78it/s]
  7%|▋         | 27519/371472 [2:11:27<25:40:10,  3.72it/s]
  7%|▋         | 27520/371472 [2:11:27<25:59:34,  3.68it/s]
                                                           
{'loss': 4.5714, 'learning_rate': 9.337736214958305e-07, 'epoch': 1.19}

  7%|▋         | 27520/371472 [2:11:27<25:59:34,  3.68it/s]
  7%|▋         | 27521/371472 [2:11:27<25:33:33,  3.74it/s]
  7%|▋         | 27522/371472 [2:11:27<26:55:31,  3.55it/s]
  7%|▋         | 27523/371472 [2:11:28<26:54:32,  3.55it/s]
  7%|▋         | 27524/371472 [2:11:28<26:08:12,  3.66it/s]
  7%|▋         | 27525/371472 [2:11:28<26:25:28,  3.62it/s]
  7%|▋         | 27526/371472 [2:11:29<26:49:52,  3.56it/s]
  7%|▋         | 27527/371472 [2:11:29<26:27:24,  3.61it/s]
  7%|▋         | 27528/371472 [2:11:29<25:57:19,  3.68it/s]
  7%|▋         | 27529/371472 [2:11:29<27:06:43,  3.52it/s]
  7%|▋         | 27530/371472 [2:11:30<27:34:07,  3.47it/s]
  7%|▋         | 27531/371472 [2:11:30<27:20:31,  3.49it/s]
  7%|▋         | 27532/371472 [2:11:30<26:58:10,  3.54it/s]
  7%|▋         | 27533/371472 [2:11:30<26:16:59,  3.63it/s]
  7%|▋         | 27534/371472 [2:11:31<26:42:20,  3.58it/s]
  7%|▋         | 27535/371472 [2:11:31<26:45:21,  3.57it/s]
  7%|▋         | 27536/371472 [2:11:31<27:08:31,  3.52it/s]
  7%|▋         | 27537/371472 [2:11:32<26:34:03,  3.60it/s]
  7%|▋         | 27538/371472 [2:11:32<26:25:48,  3.61it/s]
  7%|▋         | 27539/371472 [2:11:32<25:33:50,  3.74it/s]
  7%|▋         | 27540/371472 [2:11:32<25:07:11,  3.80it/s]
                                                           
{'loss': 4.35, 'learning_rate': 9.337251395203516e-07, 'epoch': 1.19}

  7%|▋         | 27540/371472 [2:11:32<25:07:11,  3.80it/s]
  7%|▋         | 27541/371472 [2:11:33<25:55:43,  3.68it/s]
  7%|▋         | 27542/371472 [2:11:33<27:29:05,  3.48it/s]
  7%|▋         | 27543/371472 [2:11:33<28:20:44,  3.37it/s]
  7%|▋         | 27544/371472 [2:11:34<27:15:25,  3.50it/s]
  7%|▋         | 27545/371472 [2:11:34<28:08:31,  3.39it/s]
  7%|▋         | 27546/371472 [2:11:34<27:15:26,  3.50it/s]
  7%|▋         | 27547/371472 [2:11:34<28:56:44,  3.30it/s]
  7%|▋         | 27548/371472 [2:11:35<28:02:38,  3.41it/s]
  7%|▋         | 27549/371472 [2:11:35<27:08:53,  3.52it/s]
  7%|▋         | 27550/371472 [2:11:35<28:16:35,  3.38it/s]
  7%|▋         | 27551/371472 [2:11:36<28:40:48,  3.33it/s]
  7%|▋         | 27552/371472 [2:11:36<28:37:57,  3.34it/s]
  7%|▋         | 27553/371472 [2:11:36<29:47:39,  3.21it/s]
  7%|▋         | 27554/371472 [2:11:37<29:21:08,  3.25it/s]
  7%|▋         | 27555/371472 [2:11:37<28:41:56,  3.33it/s]
  7%|▋         | 27556/371472 [2:11:37<28:08:07,  3.40it/s]
  7%|▋         | 27557/371472 [2:11:37<27:25:15,  3.48it/s]
  7%|▋         | 27558/371472 [2:11:38<27:40:22,  3.45it/s]
  7%|▋         | 27559/371472 [2:11:38<27:22:14,  3.49it/s]
  7%|▋         | 27560/371472 [2:11:38<27:26:50,  3.48it/s]
                                                           
{'loss': 4.4903, 'learning_rate': 9.336766575448728e-07, 'epoch': 1.19}

  7%|▋         | 27560/371472 [2:11:38<27:26:50,  3.48it/s]
  7%|▋         | 27561/371472 [2:11:39<27:48:31,  3.44it/s]
  7%|▋         | 27562/371472 [2:11:39<27:17:09,  3.50it/s]
  7%|▋         | 27563/371472 [2:11:39<26:39:06,  3.58it/s]
  7%|▋         | 27564/371472 [2:11:39<25:47:10,  3.70it/s]
  7%|▋         | 27565/371472 [2:11:40<28:03:34,  3.40it/s]
  7%|▋         | 27566/371472 [2:11:40<27:16:42,  3.50it/s]
  7%|▋         | 27567/371472 [2:11:40<27:10:33,  3.52it/s]
  7%|▋         | 27568/371472 [2:11:41<26:14:47,  3.64it/s]
  7%|▋         | 27569/371472 [2:11:41<27:37:52,  3.46it/s]
  7%|▋         | 27570/371472 [2:11:41<28:00:33,  3.41it/s]
  7%|▋         | 27571/371472 [2:11:41<27:55:33,  3.42it/s]
  7%|▋         | 27572/371472 [2:11:42<27:43:30,  3.45it/s]
  7%|▋         | 27573/371472 [2:11:42<27:15:26,  3.50it/s]
  7%|▋         | 27574/371472 [2:11:42<26:29:57,  3.60it/s]
  7%|▋         | 27575/371472 [2:11:43<28:41:16,  3.33it/s]
  7%|▋         | 27576/371472 [2:11:43<30:52:52,  3.09it/s]
  7%|▋         | 27577/371472 [2:11:43<34:33:31,  2.76it/s]
  7%|▋         | 27578/371472 [2:11:44<33:34:01,  2.85it/s]
  7%|▋         | 27579/371472 [2:11:44<31:48:41,  3.00it/s]
  7%|▋         | 27580/371472 [2:11:44<30:01:25,  3.18it/s]
                                                           
{'loss': 4.487, 'learning_rate': 9.336281755693938e-07, 'epoch': 1.19}

  7%|▋         | 27580/371472 [2:11:44<30:01:25,  3.18it/s]
  7%|▋         | 27581/371472 [2:11:45<30:48:56,  3.10it/s]
  7%|▋         | 27582/371472 [2:11:45<28:34:08,  3.34it/s]
  7%|▋         | 27583/371472 [2:11:45<27:23:32,  3.49it/s]
  7%|▋         | 27584/371472 [2:11:45<27:22:03,  3.49it/s]
  7%|▋         | 27585/371472 [2:11:46<26:22:44,  3.62it/s]
  7%|▋         | 27586/371472 [2:11:46<26:30:42,  3.60it/s]
  7%|▋         | 27587/371472 [2:11:46<26:15:50,  3.64it/s]
  7%|▋         | 27588/371472 [2:11:47<26:24:06,  3.62it/s]
  7%|▋         | 27589/371472 [2:11:47<29:06:40,  3.28it/s]
  7%|▋         | 27590/371472 [2:11:47<28:12:04,  3.39it/s]
  7%|▋         | 27591/371472 [2:11:47<28:55:11,  3.30it/s]
  7%|▋         | 27592/371472 [2:11:48<28:35:51,  3.34it/s]
  7%|▋         | 27593/371472 [2:11:48<27:44:17,  3.44it/s]
  7%|▋         | 27594/371472 [2:11:48<28:56:41,  3.30it/s]
  7%|▋         | 27595/371472 [2:11:49<29:59:32,  3.18it/s]
  7%|▋         | 27596/371472 [2:11:49<28:56:25,  3.30it/s]
  7%|▋         | 27597/371472 [2:11:49<27:37:26,  3.46it/s]
  7%|▋         | 27598/371472 [2:11:50<28:37:35,  3.34it/s]
  7%|▋         | 27599/371472 [2:11:50<27:59:35,  3.41it/s]
  7%|▋         | 27600/371472 [2:11:50<26:49:46,  3.56it/s]
                                                           
{'loss': 4.446, 'learning_rate': 9.33579693593915e-07, 'epoch': 1.19}

  7%|▋         | 27600/371472 [2:11:50<26:49:46,  3.56it/s]
  7%|▋         | 27601/371472 [2:11:50<26:32:41,  3.60it/s]
  7%|▋         | 27602/371472 [2:11:51<28:50:13,  3.31it/s]
  7%|▋         | 27603/371472 [2:11:51<27:57:15,  3.42it/s]
  7%|▋         | 27604/371472 [2:11:51<29:01:15,  3.29it/s]
  7%|▋         | 27605/371472 [2:11:52<28:15:02,  3.38it/s]
  7%|▋         | 27606/371472 [2:11:52<28:44:12,  3.32it/s]
  7%|▋         | 27607/371472 [2:11:52<28:14:03,  3.38it/s]
  7%|▋         | 27608/371472 [2:11:52<27:47:56,  3.44it/s]
  7%|▋         | 27609/371472 [2:11:53<27:06:00,  3.52it/s]
  7%|▋         | 27610/371472 [2:11:53<26:34:46,  3.59it/s]
  7%|▋         | 27611/371472 [2:11:53<27:28:09,  3.48it/s]
  7%|▋         | 27612/371472 [2:11:54<29:27:26,  3.24it/s]
  7%|▋         | 27613/371472 [2:11:54<28:44:25,  3.32it/s]
  7%|▋         | 27614/371472 [2:11:54<27:52:10,  3.43it/s]
  7%|▋         | 27615/371472 [2:11:55<28:48:47,  3.32it/s]
  7%|▋         | 27616/371472 [2:11:55<27:53:00,  3.43it/s]
  7%|▋         | 27617/371472 [2:11:55<27:02:14,  3.53it/s]
  7%|▋         | 27618/371472 [2:11:55<26:46:20,  3.57it/s]
  7%|▋         | 27619/371472 [2:11:56<26:48:15,  3.56it/s]
  7%|▋         | 27620/371472 [2:11:56<26:15:43,  3.64it/s]
                                                           
{'loss': 4.3769, 'learning_rate': 9.33531211618436e-07, 'epoch': 1.19}

  7%|▋         | 27620/371472 [2:11:56<26:15:43,  3.64it/s]
  7%|▋         | 27621/371472 [2:11:56<27:41:31,  3.45it/s]
  7%|▋         | 27622/371472 [2:11:57<26:57:28,  3.54it/s]
  7%|▋         | 27623/371472 [2:11:57<27:12:08,  3.51it/s]
  7%|▋         | 27624/371472 [2:11:57<27:47:57,  3.44it/s]
  7%|▋         | 27625/371472 [2:11:57<28:37:45,  3.34it/s]
  7%|▋         | 27626/371472 [2:11:58<27:14:13,  3.51it/s]
  7%|▋         | 27627/371472 [2:11:58<26:44:56,  3.57it/s]
  7%|▋         | 27628/371472 [2:11:58<26:46:43,  3.57it/s]
  7%|▋         | 27629/371472 [2:11:58<26:14:58,  3.64it/s]
  7%|▋         | 27630/371472 [2:11:59<25:39:18,  3.72it/s]
  7%|▋         | 27631/371472 [2:11:59<26:27:25,  3.61it/s]
  7%|▋         | 27632/371472 [2:11:59<25:51:56,  3.69it/s]
  7%|▋         | 27633/371472 [2:12:00<25:23:23,  3.76it/s]
  7%|▋         | 27634/371472 [2:12:00<24:49:29,  3.85it/s]
  7%|▋         | 27635/371472 [2:12:00<25:36:06,  3.73it/s]
  7%|▋         | 27636/371472 [2:12:00<25:21:00,  3.77it/s]
  7%|▋         | 27637/371472 [2:12:01<25:44:07,  3.71it/s]
  7%|▋         | 27638/371472 [2:12:01<26:30:37,  3.60it/s]
  7%|▋         | 27639/371472 [2:12:01<27:31:39,  3.47it/s]
  7%|▋         | 27640/371472 [2:12:01<26:31:07,  3.60it/s]
                                                           
{'loss': 4.3718, 'learning_rate': 9.33482729642957e-07, 'epoch': 1.19}

  7%|▋         | 27640/371472 [2:12:01<26:31:07,  3.60it/s]
  7%|▋         | 27641/371472 [2:12:02<27:53:27,  3.42it/s]
  7%|▋         | 27642/371472 [2:12:02<27:07:18,  3.52it/s]
  7%|▋         | 27643/371472 [2:12:02<28:39:53,  3.33it/s]
  7%|▋         | 27644/371472 [2:12:03<28:49:28,  3.31it/s]
  7%|▋         | 27645/371472 [2:12:03<29:08:34,  3.28it/s]
  7%|▋         | 27646/371472 [2:12:03<28:37:47,  3.34it/s]
  7%|▋         | 27647/371472 [2:12:04<28:07:15,  3.40it/s]
  7%|▋         | 27648/371472 [2:12:04<28:25:48,  3.36it/s]
  7%|▋         | 27649/371472 [2:12:04<31:43:03,  3.01it/s]
  7%|▋         | 27650/371472 [2:12:05<29:53:16,  3.20it/s]
  7%|▋         | 27651/371472 [2:12:05<30:37:48,  3.12it/s]
  7%|▋         | 27652/371472 [2:12:05<28:45:45,  3.32it/s]
  7%|▋         | 27653/371472 [2:12:05<27:30:45,  3.47it/s]
  7%|▋         | 27654/371472 [2:12:06<26:52:42,  3.55it/s]
  7%|▋         | 27655/371472 [2:12:06<26:51:12,  3.56it/s]
  7%|▋         | 27656/371472 [2:12:06<28:32:17,  3.35it/s]
  7%|▋         | 27657/371472 [2:12:07<31:00:14,  3.08it/s]
  7%|▋         | 27658/371472 [2:12:07<29:32:06,  3.23it/s]
  7%|▋         | 27659/371472 [2:12:07<28:12:35,  3.39it/s]
  7%|▋         | 27660/371472 [2:12:08<27:45:17,  3.44it/s]
                                                           
{'loss': 4.4117, 'learning_rate': 9.334342476674782e-07, 'epoch': 1.19}

  7%|▋         | 27660/371472 [2:12:08<27:45:17,  3.44it/s]
  7%|▋         | 27661/371472 [2:12:08<27:45:32,  3.44it/s]
  7%|▋         | 27662/371472 [2:12:08<26:56:22,  3.55it/s]
  7%|▋         | 27663/371472 [2:12:08<28:12:36,  3.39it/s]
  7%|▋         | 27664/371472 [2:12:09<27:54:10,  3.42it/s]
  7%|▋         | 27665/371472 [2:12:09<27:21:45,  3.49it/s]
  7%|▋         | 27666/371472 [2:12:09<26:20:36,  3.63it/s]
  7%|▋         | 27667/371472 [2:12:10<27:08:33,  3.52it/s]
  7%|▋         | 27668/371472 [2:12:10<29:14:21,  3.27it/s]
  7%|▋         | 27669/371472 [2:12:10<28:45:07,  3.32it/s]
  7%|▋         | 27670/371472 [2:12:10<27:48:18,  3.43it/s]
  7%|▋         | 27671/371472 [2:12:11<27:25:52,  3.48it/s]
  7%|▋         | 27672/371472 [2:12:11<28:38:24,  3.33it/s]
  7%|▋         | 27673/371472 [2:12:11<27:40:10,  3.45it/s]
  7%|▋         | 27674/371472 [2:12:12<27:40:54,  3.45it/s]
  7%|▋         | 27675/371472 [2:12:12<27:44:55,  3.44it/s]
  7%|▋         | 27676/371472 [2:12:12<27:18:14,  3.50it/s]
  7%|▋         | 27677/371472 [2:12:12<26:35:43,  3.59it/s]
  7%|▋         | 27678/371472 [2:12:13<25:29:13,  3.75it/s]
  7%|▋         | 27679/371472 [2:12:13<25:19:18,  3.77it/s]
  7%|▋         | 27680/371472 [2:12:13<24:49:51,  3.85it/s]
                                                           
{'loss': 4.3429, 'learning_rate': 9.333857656919994e-07, 'epoch': 1.19}

  7%|▋         | 27680/371472 [2:12:13<24:49:51,  3.85it/s]
  7%|▋         | 27681/371472 [2:12:14<26:59:11,  3.54it/s]
  7%|▋         | 27682/371472 [2:12:14<26:46:52,  3.57it/s]
  7%|▋         | 27683/371472 [2:12:14<27:39:53,  3.45it/s]
  7%|▋         | 27684/371472 [2:12:14<26:39:58,  3.58it/s]
  7%|▋         | 27685/371472 [2:12:15<26:58:43,  3.54it/s]
  7%|▋         | 27686/371472 [2:12:15<27:17:35,  3.50it/s]
  7%|▋         | 27687/371472 [2:12:15<26:20:26,  3.63it/s]
  7%|▋         | 27688/371472 [2:12:15<26:19:07,  3.63it/s]
  7%|▋         | 27689/371472 [2:12:16<25:41:16,  3.72it/s]
  7%|▋         | 27690/371472 [2:12:16<26:11:49,  3.65it/s]
  7%|▋         | 27691/371472 [2:12:16<27:03:35,  3.53it/s]
  7%|▋         | 27692/371472 [2:12:17<26:55:42,  3.55it/s]
  7%|▋         | 27693/371472 [2:12:17<27:11:36,  3.51it/s]
  7%|▋         | 27694/371472 [2:12:17<26:39:29,  3.58it/s]
  7%|▋         | 27695/371472 [2:12:17<26:09:18,  3.65it/s]
  7%|▋         | 27696/371472 [2:12:18<25:49:47,  3.70it/s]
  7%|▋         | 27697/371472 [2:12:18<25:56:01,  3.68it/s]
  7%|▋         | 27698/371472 [2:12:18<28:35:42,  3.34it/s]
  7%|▋         | 27699/371472 [2:12:19<28:47:17,  3.32it/s]
  7%|▋         | 27700/371472 [2:12:19<28:05:48,  3.40it/s]
                                                           
{'loss': 4.334, 'learning_rate': 9.333372837165205e-07, 'epoch': 1.19}

  7%|▋         | 27700/371472 [2:12:19<28:05:48,  3.40it/s]
  7%|▋         | 27701/371472 [2:12:19<27:04:58,  3.53it/s]
  7%|▋         | 27702/371472 [2:12:20<29:23:56,  3.25it/s]
  7%|▋         | 27703/371472 [2:12:20<31:06:55,  3.07it/s]
  7%|▋         | 27704/371472 [2:12:20<31:00:55,  3.08it/s]
  7%|▋         | 27705/371472 [2:12:20<29:43:58,  3.21it/s]
  7%|▋         | 27706/371472 [2:12:21<29:18:00,  3.26it/s]
  7%|▋         | 27707/371472 [2:12:21<29:33:30,  3.23it/s]
  7%|▋         | 27708/371472 [2:12:21<31:34:51,  3.02it/s]
  7%|▋         | 27709/371472 [2:12:22<29:57:24,  3.19it/s]
  7%|▋         | 27710/371472 [2:12:22<29:00:53,  3.29it/s]
  7%|▋         | 27711/371472 [2:12:22<27:49:31,  3.43it/s]
  7%|▋         | 27712/371472 [2:12:23<26:59:05,  3.54it/s]
  7%|▋         | 27713/371472 [2:12:23<26:16:06,  3.64it/s]
  7%|▋         | 27714/371472 [2:12:23<26:43:08,  3.57it/s]
  7%|▋         | 27715/371472 [2:12:23<27:23:25,  3.49it/s]
  7%|▋         | 27716/371472 [2:12:24<27:07:15,  3.52it/s]
  7%|▋         | 27717/371472 [2:12:24<26:18:17,  3.63it/s]
  7%|▋         | 27718/371472 [2:12:24<26:03:24,  3.66it/s]
  7%|▋         | 27719/371472 [2:12:24<26:17:01,  3.63it/s]
  7%|▋         | 27720/371472 [2:12:25<26:26:08,  3.61it/s]
                                                           
{'loss': 4.6125, 'learning_rate': 9.332888017410416e-07, 'epoch': 1.19}

  7%|▋         | 27720/371472 [2:12:25<26:26:08,  3.61it/s]
  7%|▋         | 27721/371472 [2:12:25<27:16:05,  3.50it/s]
  7%|▋         | 27722/371472 [2:12:25<28:33:32,  3.34it/s]
  7%|▋         | 27723/371472 [2:12:26<27:54:33,  3.42it/s]
  7%|▋         | 27724/371472 [2:12:26<28:38:12,  3.33it/s]
  7%|▋         | 27725/371472 [2:12:26<27:20:09,  3.49it/s]
  7%|▋         | 27726/371472 [2:12:27<27:02:30,  3.53it/s]
  7%|▋         | 27727/371472 [2:12:27<27:03:07,  3.53it/s]
  7%|▋         | 27728/371472 [2:12:27<27:09:35,  3.52it/s]
  7%|▋         | 27729/371472 [2:12:27<26:22:16,  3.62it/s]
  7%|▋         | 27730/371472 [2:12:28<26:09:31,  3.65it/s]
  7%|▋         | 27731/371472 [2:12:28<26:53:27,  3.55it/s]
  7%|▋         | 27732/371472 [2:12:28<26:14:49,  3.64it/s]
  7%|▋         | 27733/371472 [2:12:28<25:38:02,  3.72it/s]
  7%|▋         | 27734/371472 [2:12:29<26:20:33,  3.62it/s]
  7%|▋         | 27735/371472 [2:12:29<26:01:03,  3.67it/s]
  7%|▋         | 27736/371472 [2:12:29<26:09:49,  3.65it/s]
  7%|▋         | 27737/371472 [2:12:30<28:58:30,  3.30it/s]
  7%|▋         | 27738/371472 [2:12:30<27:47:27,  3.44it/s]
  7%|▋         | 27739/371472 [2:12:30<26:46:19,  3.57it/s]
  7%|▋         | 27740/371472 [2:12:30<26:22:07,  3.62it/s]
                                                           
{'loss': 4.4454, 'learning_rate': 9.332403197655627e-07, 'epoch': 1.19}

  7%|▋         | 27740/371472 [2:12:30<26:22:07,  3.62it/s]
  7%|▋         | 27741/371472 [2:12:31<25:45:21,  3.71it/s]
  7%|▋         | 27742/371472 [2:12:31<25:25:13,  3.76it/s]
  7%|▋         | 27743/371472 [2:12:31<25:42:45,  3.71it/s]
  7%|▋         | 27744/371472 [2:12:31<25:52:06,  3.69it/s]
  7%|▋         | 27745/371472 [2:12:32<26:51:10,  3.56it/s]
  7%|▋         | 27746/371472 [2:12:32<25:43:59,  3.71it/s]
  7%|▋         | 27747/371472 [2:12:32<26:21:25,  3.62it/s]
  7%|▋         | 27748/371472 [2:12:33<25:25:56,  3.75it/s]
  7%|▋         | 27749/371472 [2:12:33<26:11:43,  3.64it/s]
  7%|▋         | 27750/371472 [2:12:33<27:39:10,  3.45it/s]
  7%|▋         | 27751/371472 [2:12:34<28:08:27,  3.39it/s]
  7%|▋         | 27752/371472 [2:12:34<27:34:15,  3.46it/s]
  7%|▋         | 27753/371472 [2:12:34<28:48:06,  3.31it/s]
  7%|▋         | 27754/371472 [2:12:34<28:35:18,  3.34it/s]
  7%|▋         | 27755/371472 [2:12:35<27:26:48,  3.48it/s]
  7%|▋         | 27756/371472 [2:12:35<27:11:37,  3.51it/s]
  7%|▋         | 27757/371472 [2:12:35<30:55:06,  3.09it/s]
  7%|▋         | 27758/371472 [2:12:36<28:50:06,  3.31it/s]
  7%|▋         | 27759/371472 [2:12:36<29:04:13,  3.28it/s]
  7%|▋         | 27760/371472 [2:12:36<28:26:48,  3.36it/s]
                                                           
{'loss': 4.3109, 'learning_rate': 9.331918377900837e-07, 'epoch': 1.2}

  7%|▋         | 27760/371472 [2:12:36<28:26:48,  3.36it/s]
  7%|▋         | 27761/371472 [2:12:37<29:48:32,  3.20it/s]
  7%|▋         | 27762/371472 [2:12:37<29:01:58,  3.29it/s]
  7%|▋         | 27763/371472 [2:12:37<28:31:51,  3.35it/s]
  7%|▋         | 27764/371472 [2:12:37<28:33:13,  3.34it/s]
  7%|▋         | 27765/371472 [2:12:38<28:15:56,  3.38it/s]
  7%|▋         | 27766/371472 [2:12:38<29:09:41,  3.27it/s]
  7%|▋         | 27767/371472 [2:12:38<28:57:34,  3.30it/s]
  7%|▋         | 27768/371472 [2:12:39<27:56:27,  3.42it/s]
  7%|▋         | 27769/371472 [2:12:39<27:04:09,  3.53it/s]
  7%|▋         | 27770/371472 [2:12:39<27:00:10,  3.54it/s]
  7%|▋         | 27771/371472 [2:12:39<26:21:14,  3.62it/s]
  7%|▋         | 27772/371472 [2:12:40<26:30:31,  3.60it/s]
  7%|▋         | 27773/371472 [2:12:40<25:55:46,  3.68it/s]
  7%|▋         | 27774/371472 [2:12:40<26:17:48,  3.63it/s]
  7%|▋         | 27775/371472 [2:12:40<26:08:17,  3.65it/s]
  7%|▋         | 27776/371472 [2:12:41<25:52:15,  3.69it/s]
  7%|▋         | 27777/371472 [2:12:41<26:30:11,  3.60it/s]
  7%|▋         | 27778/371472 [2:12:41<27:47:58,  3.43it/s]
  7%|▋         | 27779/371472 [2:12:42<27:26:03,  3.48it/s]
  7%|▋         | 27780/371472 [2:12:42<27:35:04,  3.46it/s]
                                                           
{'loss': 4.2727, 'learning_rate': 9.331433558146049e-07, 'epoch': 1.2}

  7%|▋         | 27780/371472 [2:12:42<27:35:04,  3.46it/s]
  7%|▋         | 27781/371472 [2:12:42<27:03:20,  3.53it/s]
  7%|▋         | 27782/371472 [2:12:42<26:34:28,  3.59it/s]
  7%|▋         | 27783/371472 [2:12:43<26:13:24,  3.64it/s]
  7%|▋         | 27784/371472 [2:12:43<27:26:30,  3.48it/s]
  7%|▋         | 27785/371472 [2:12:43<27:04:44,  3.53it/s]
  7%|▋         | 27786/371472 [2:12:44<26:11:48,  3.64it/s]
  7%|▋         | 27787/371472 [2:12:44<28:40:24,  3.33it/s]
  7%|▋         | 27788/371472 [2:12:44<27:42:01,  3.45it/s]
  7%|▋         | 27789/371472 [2:12:44<26:58:24,  3.54it/s]
  7%|▋         | 27790/371472 [2:12:45<27:15:19,  3.50it/s]
  7%|▋         | 27791/371472 [2:12:45<28:05:47,  3.40it/s]
  7%|▋         | 27792/371472 [2:12:45<27:04:42,  3.53it/s]
  7%|▋         | 27793/371472 [2:12:46<28:15:01,  3.38it/s]
  7%|▋         | 27794/371472 [2:12:46<28:03:04,  3.40it/s]
  7%|▋         | 27795/371472 [2:12:46<27:13:16,  3.51it/s]
  7%|▋         | 27796/371472 [2:12:47<26:57:50,  3.54it/s]
  7%|▋         | 27797/371472 [2:12:47<27:55:29,  3.42it/s]
  7%|▋         | 27798/371472 [2:12:47<29:14:57,  3.26it/s]
  7%|▋         | 27799/371472 [2:12:47<28:59:02,  3.29it/s]
  7%|▋         | 27800/371472 [2:12:48<29:11:24,  3.27it/s]
                                                           
{'loss': 4.4393, 'learning_rate': 9.33094873839126e-07, 'epoch': 1.2}

  7%|▋         | 27800/371472 [2:12:48<29:11:24,  3.27it/s]
  7%|▋         | 27801/371472 [2:12:48<28:51:51,  3.31it/s]
  7%|▋         | 27802/371472 [2:12:48<29:08:21,  3.28it/s]
  7%|▋         | 27803/371472 [2:12:49<30:41:32,  3.11it/s]
  7%|▋         | 27804/371472 [2:12:49<29:26:43,  3.24it/s]
  7%|▋         | 27805/371472 [2:12:49<29:40:58,  3.22it/s]
  7%|▋         | 27806/371472 [2:12:50<29:06:08,  3.28it/s]
  7%|▋         | 27807/371472 [2:12:50<28:15:18,  3.38it/s]
  7%|▋         | 27808/371472 [2:12:50<28:16:39,  3.38it/s]
  7%|▋         | 27809/371472 [2:12:50<28:08:28,  3.39it/s]
  7%|▋         | 27810/371472 [2:12:51<28:04:26,  3.40it/s]
  7%|▋         | 27811/371472 [2:12:51<28:04:46,  3.40it/s]
  7%|▋         | 27812/371472 [2:12:51<27:55:09,  3.42it/s]
  7%|▋         | 27813/371472 [2:12:52<27:37:22,  3.46it/s]
  7%|▋         | 27814/371472 [2:12:52<28:06:44,  3.40it/s]
  7%|▋         | 27815/371472 [2:12:52<27:24:50,  3.48it/s]
  7%|▋         | 27816/371472 [2:12:53<27:23:02,  3.49it/s]
  7%|▋         | 27817/371472 [2:12:53<31:37:50,  3.02it/s]
  7%|▋         | 27818/371472 [2:12:53<31:15:16,  3.05it/s]
  7%|▋         | 27819/371472 [2:12:54<29:47:55,  3.20it/s]
  7%|▋         | 27820/371472 [2:12:54<28:30:34,  3.35it/s]
                                                           
{'loss': 4.3083, 'learning_rate': 9.330463918636471e-07, 'epoch': 1.2}

  7%|▋         | 27820/371472 [2:12:54<28:30:34,  3.35it/s]
  7%|▋         | 27821/371472 [2:12:54<27:45:20,  3.44it/s]
  7%|▋         | 27822/371472 [2:12:54<26:24:30,  3.61it/s]
  7%|▋         | 27823/371472 [2:12:55<26:43:10,  3.57it/s]
  7%|▋         | 27824/371472 [2:12:55<27:18:02,  3.50it/s]
  7%|▋         | 27825/371472 [2:12:55<27:26:52,  3.48it/s]
  7%|▋         | 27826/371472 [2:12:55<26:38:17,  3.58it/s]
  7%|▋         | 27827/371472 [2:12:56<26:18:30,  3.63it/s]
  7%|▋         | 27828/371472 [2:12:56<27:45:14,  3.44it/s]
  7%|▋         | 27829/371472 [2:12:56<27:25:38,  3.48it/s]
  7%|▋         | 27830/371472 [2:12:57<26:18:40,  3.63it/s]
  7%|▋         | 27831/371472 [2:12:57<25:43:52,  3.71it/s]
  7%|▋         | 27832/371472 [2:12:57<25:44:53,  3.71it/s]
  7%|▋         | 27833/371472 [2:12:57<26:35:14,  3.59it/s]
  7%|▋         | 27834/371472 [2:12:58<26:45:10,  3.57it/s]
  7%|▋         | 27835/371472 [2:12:58<27:59:42,  3.41it/s]
  7%|▋         | 27836/371472 [2:12:58<27:37:24,  3.46it/s]
  7%|▋         | 27837/371472 [2:12:59<26:37:43,  3.58it/s]
  7%|▋         | 27838/371472 [2:12:59<26:13:51,  3.64it/s]
  7%|▋         | 27839/371472 [2:12:59<26:56:37,  3.54it/s]
  7%|▋         | 27840/371472 [2:12:59<26:49:29,  3.56it/s]
                                                           
{'loss': 4.4089, 'learning_rate': 9.329979098881682e-07, 'epoch': 1.2}

  7%|▋         | 27840/371472 [2:12:59<26:49:29,  3.56it/s]
  7%|▋         | 27841/371472 [2:13:00<26:18:12,  3.63it/s]
  7%|▋         | 27842/371472 [2:13:00<26:13:20,  3.64it/s]
  7%|▋         | 27843/371472 [2:13:00<26:32:12,  3.60it/s]
  7%|▋         | 27844/371472 [2:13:01<29:51:47,  3.20it/s]
  7%|▋         | 27845/371472 [2:13:01<28:19:18,  3.37it/s]
  7%|▋         | 27846/371472 [2:13:01<31:46:20,  3.00it/s]
  7%|▋         | 27847/371472 [2:13:02<32:05:47,  2.97it/s]
  7%|▋         | 27848/371472 [2:13:02<30:24:54,  3.14it/s]
  7%|▋         | 27849/371472 [2:13:02<29:38:40,  3.22it/s]
  7%|▋         | 27850/371472 [2:13:02<29:03:24,  3.28it/s]
  7%|▋         | 27851/371472 [2:13:03<28:13:33,  3.38it/s]
  7%|▋         | 27852/371472 [2:13:03<28:21:48,  3.37it/s]
  7%|▋         | 27853/371472 [2:13:03<26:52:32,  3.55it/s]
  7%|▋         | 27854/371472 [2:13:04<27:04:32,  3.53it/s]
  7%|▋         | 27855/371472 [2:13:04<26:44:38,  3.57it/s]
  7%|▋         | 27856/371472 [2:13:04<27:19:22,  3.49it/s]
  7%|▋         | 27857/371472 [2:13:04<26:38:56,  3.58it/s]
  7%|▋         | 27858/371472 [2:13:05<29:01:57,  3.29it/s]
  7%|▋         | 27859/371472 [2:13:05<27:56:52,  3.42it/s]
  7%|▋         | 27860/371472 [2:13:05<28:07:40,  3.39it/s]
                                                           
{'loss': 4.2863, 'learning_rate': 9.329494279126894e-07, 'epoch': 1.2}

  7%|▋         | 27860/371472 [2:13:05<28:07:40,  3.39it/s]
  8%|▊         | 27861/371472 [2:13:06<26:47:25,  3.56it/s]
  8%|▊         | 27862/371472 [2:13:06<26:05:08,  3.66it/s]
  8%|▊         | 27863/371472 [2:13:06<26:11:48,  3.64it/s]
  8%|▊         | 27864/371472 [2:13:06<26:57:25,  3.54it/s]
  8%|▊         | 27865/371472 [2:13:07<26:36:52,  3.59it/s]
  8%|▊         | 27866/371472 [2:13:07<26:37:55,  3.58it/s]
  8%|▊         | 27867/371472 [2:13:07<26:05:40,  3.66it/s]
  8%|▊         | 27868/371472 [2:13:08<25:24:29,  3.76it/s]
  8%|▊         | 27869/371472 [2:13:08<25:36:26,  3.73it/s]
  8%|▊         | 27870/371472 [2:13:08<26:30:19,  3.60it/s]
  8%|▊         | 27871/371472 [2:13:08<26:09:45,  3.65it/s]
  8%|▊         | 27872/371472 [2:13:09<26:59:15,  3.54it/s]
  8%|▊         | 27873/371472 [2:13:09<26:39:25,  3.58it/s]
  8%|▊         | 27874/371472 [2:13:09<27:29:57,  3.47it/s]
  8%|▊         | 27875/371472 [2:13:10<28:04:32,  3.40it/s]
  8%|▊         | 27876/371472 [2:13:10<27:19:12,  3.49it/s]
  8%|▊         | 27877/371472 [2:13:10<26:50:27,  3.56it/s]
  8%|▊         | 27878/371472 [2:13:10<26:50:54,  3.55it/s]
  8%|▊         | 27879/371472 [2:13:11<26:23:37,  3.62it/s]
  8%|▊         | 27880/371472 [2:13:11<26:56:14,  3.54it/s]
                                                           
{'loss': 4.3972, 'learning_rate': 9.329009459372103e-07, 'epoch': 1.2}

  8%|▊         | 27880/371472 [2:13:11<26:56:14,  3.54it/s]
  8%|▊         | 27881/371472 [2:13:11<26:49:09,  3.56it/s]
  8%|▊         | 27882/371472 [2:13:11<26:33:50,  3.59it/s]
  8%|▊         | 27883/371472 [2:13:12<26:25:26,  3.61it/s]
  8%|▊         | 27884/371472 [2:13:12<30:03:25,  3.18it/s]
  8%|▊         | 27885/371472 [2:13:12<29:04:23,  3.28it/s]
  8%|▊         | 27886/371472 [2:13:13<29:33:28,  3.23it/s]
  8%|▊         | 27887/371472 [2:13:13<29:23:59,  3.25it/s]
  8%|▊         | 27888/371472 [2:13:13<27:53:45,  3.42it/s]
  8%|▊         | 27889/371472 [2:13:14<28:18:43,  3.37it/s]
  8%|▊         | 27890/371472 [2:13:14<28:38:31,  3.33it/s]
  8%|▊         | 27891/371472 [2:13:14<28:16:42,  3.37it/s]
  8%|▊         | 27892/371472 [2:13:14<27:21:34,  3.49it/s]
  8%|▊         | 27893/371472 [2:13:15<28:04:01,  3.40it/s]
  8%|▊         | 27894/371472 [2:13:15<27:05:49,  3.52it/s]
  8%|▊         | 27895/371472 [2:13:15<27:32:47,  3.46it/s]
  8%|▊         | 27896/371472 [2:13:16<26:56:53,  3.54it/s]
  8%|▊         | 27897/371472 [2:13:16<26:05:27,  3.66it/s]
  8%|▊         | 27898/371472 [2:13:16<27:18:25,  3.49it/s]
  8%|▊         | 27899/371472 [2:13:16<26:23:45,  3.62it/s]
  8%|▊         | 27900/371472 [2:13:17<27:18:51,  3.49it/s]
                                                           
{'loss': 4.4722, 'learning_rate': 9.328524639617315e-07, 'epoch': 1.2}

  8%|▊         | 27900/371472 [2:13:17<27:18:51,  3.49it/s]
  8%|▊         | 27901/371472 [2:13:17<26:42:38,  3.57it/s]
  8%|▊         | 27902/371472 [2:13:17<28:01:42,  3.40it/s]
  8%|▊         | 27903/371472 [2:13:18<29:29:34,  3.24it/s]
  8%|▊         | 27904/371472 [2:13:18<28:18:59,  3.37it/s]
  8%|▊         | 27905/371472 [2:13:18<27:44:42,  3.44it/s]
  8%|▊         | 27906/371472 [2:13:19<27:33:23,  3.46it/s]
  8%|▊         | 27907/371472 [2:13:19<26:40:45,  3.58it/s]
  8%|▊         | 27908/371472 [2:13:19<28:05:29,  3.40it/s]
  8%|▊         | 27909/371472 [2:13:19<28:01:33,  3.41it/s]
  8%|▊         | 27910/371472 [2:13:20<27:59:20,  3.41it/s]
  8%|▊         | 27911/371472 [2:13:20<28:17:25,  3.37it/s]
  8%|▊         | 27912/371472 [2:13:20<27:34:19,  3.46it/s]
  8%|▊         | 27913/371472 [2:13:21<27:19:06,  3.49it/s]
  8%|▊         | 27914/371472 [2:13:21<27:42:54,  3.44it/s]
  8%|▊         | 27915/371472 [2:13:21<27:46:46,  3.44it/s]
  8%|▊         | 27916/371472 [2:13:21<28:04:21,  3.40it/s]
  8%|▊         | 27917/371472 [2:13:22<27:31:02,  3.47it/s]
  8%|▊         | 27918/371472 [2:13:22<28:03:28,  3.40it/s]
  8%|▊         | 27919/371472 [2:13:22<29:08:29,  3.27it/s]
  8%|▊         | 27920/371472 [2:13:23<28:57:19,  3.30it/s]
                                                           
{'loss': 4.4498, 'learning_rate': 9.328039819862526e-07, 'epoch': 1.2}

  8%|▊         | 27920/371472 [2:13:23<28:57:19,  3.30it/s]
  8%|▊         | 27921/371472 [2:13:23<29:21:58,  3.25it/s]
  8%|▊         | 27922/371472 [2:13:23<29:53:45,  3.19it/s]
  8%|▊         | 27923/371472 [2:13:24<28:46:31,  3.32it/s]
  8%|▊         | 27924/371472 [2:13:24<30:22:35,  3.14it/s]
  8%|▊         | 27925/371472 [2:13:24<28:47:36,  3.31it/s]
  8%|▊         | 27926/371472 [2:13:24<28:04:49,  3.40it/s]
  8%|▊         | 27927/371472 [2:13:25<27:04:36,  3.52it/s]
  8%|▊         | 27928/371472 [2:13:25<27:09:48,  3.51it/s]
  8%|▊         | 27929/371472 [2:13:25<28:12:34,  3.38it/s]
  8%|▊         | 27930/371472 [2:13:26<29:12:34,  3.27it/s]
  8%|▊         | 27931/371472 [2:13:26<28:02:51,  3.40it/s]
  8%|▊         | 27932/371472 [2:13:26<26:40:47,  3.58it/s]
  8%|▊         | 27933/371472 [2:13:26<26:20:18,  3.62it/s]
  8%|▊         | 27934/371472 [2:13:27<25:21:09,  3.76it/s]
  8%|▊         | 27935/371472 [2:13:27<26:24:43,  3.61it/s]
  8%|▊         | 27936/371472 [2:13:27<25:51:58,  3.69it/s]
  8%|▊         | 27937/371472 [2:13:27<25:47:15,  3.70it/s]
  8%|▊         | 27938/371472 [2:13:28<26:21:46,  3.62it/s]
  8%|▊         | 27939/371472 [2:13:28<26:27:35,  3.61it/s]
  8%|▊         | 27940/371472 [2:13:28<26:48:39,  3.56it/s]
                                                           
{'loss': 4.6628, 'learning_rate': 9.327555000107738e-07, 'epoch': 1.2}

  8%|▊         | 27940/371472 [2:13:28<26:48:39,  3.56it/s]
  8%|▊         | 27941/371472 [2:13:29<27:03:21,  3.53it/s]
  8%|▊         | 27942/371472 [2:13:29<29:10:50,  3.27it/s]
  8%|▊         | 27943/371472 [2:13:29<28:19:18,  3.37it/s]
  8%|▊         | 27944/371472 [2:13:30<27:50:48,  3.43it/s]
  8%|▊         | 27945/371472 [2:13:30<26:26:54,  3.61it/s]
  8%|▊         | 27946/371472 [2:13:30<26:08:07,  3.65it/s]
  8%|▊         | 27947/371472 [2:13:30<25:51:38,  3.69it/s]
  8%|▊         | 27948/371472 [2:13:31<25:30:45,  3.74it/s]
  8%|▊         | 27949/371472 [2:13:31<25:05:08,  3.80it/s]
  8%|▊         | 27950/371472 [2:13:31<25:22:14,  3.76it/s]
  8%|▊         | 27951/371472 [2:13:31<25:17:38,  3.77it/s]
  8%|▊         | 27952/371472 [2:13:32<25:22:00,  3.76it/s]
  8%|▊         | 27953/371472 [2:13:32<25:42:01,  3.71it/s]
  8%|▊         | 27954/371472 [2:13:32<25:38:37,  3.72it/s]
  8%|▊         | 27955/371472 [2:13:32<25:35:51,  3.73it/s]
  8%|▊         | 27956/371472 [2:13:33<25:59:28,  3.67it/s]
  8%|▊         | 27957/371472 [2:13:33<28:11:11,  3.39it/s]
  8%|▊         | 27958/371472 [2:13:33<29:41:11,  3.21it/s]
  8%|▊         | 27959/371472 [2:13:34<28:55:58,  3.30it/s]
  8%|▊         | 27960/371472 [2:13:34<28:12:35,  3.38it/s]
                                                           
{'loss': 4.6212, 'learning_rate': 9.327070180352948e-07, 'epoch': 1.2}

  8%|▊         | 27960/371472 [2:13:34<28:12:35,  3.38it/s]
  8%|▊         | 27961/371472 [2:13:34<28:16:22,  3.37it/s]
  8%|▊         | 27962/371472 [2:13:35<27:23:39,  3.48it/s]
  8%|▊         | 27963/371472 [2:13:35<26:47:35,  3.56it/s]
  8%|▊         | 27964/371472 [2:13:35<26:31:27,  3.60it/s]
  8%|▊         | 27965/371472 [2:13:35<29:05:53,  3.28it/s]
  8%|▊         | 27966/371472 [2:13:36<29:36:30,  3.22it/s]
  8%|▊         | 27967/371472 [2:13:36<30:12:26,  3.16it/s]
  8%|▊         | 27968/371472 [2:13:37<32:33:19,  2.93it/s]
  8%|▊         | 27969/371472 [2:13:37<29:40:58,  3.21it/s]
  8%|▊         | 27970/371472 [2:13:37<29:32:32,  3.23it/s]
  8%|▊         | 27971/371472 [2:13:37<28:32:09,  3.34it/s]
  8%|▊         | 27972/371472 [2:13:38<27:30:15,  3.47it/s]
  8%|▊         | 27973/371472 [2:13:38<26:55:02,  3.54it/s]
  8%|▊         | 27974/371472 [2:13:38<26:19:59,  3.62it/s]
  8%|▊         | 27975/371472 [2:13:38<27:04:17,  3.52it/s]
  8%|▊         | 27976/371472 [2:13:39<26:10:05,  3.65it/s]
  8%|▊         | 27977/371472 [2:13:39<26:02:58,  3.66it/s]
  8%|▊         | 27978/371472 [2:13:39<26:32:45,  3.59it/s]
  8%|▊         | 27979/371472 [2:13:40<27:05:43,  3.52it/s]
  8%|▊         | 27980/371472 [2:13:40<26:20:06,  3.62it/s]
                                                           
{'loss': 4.5064, 'learning_rate': 9.32658536059816e-07, 'epoch': 1.21}

  8%|▊         | 27980/371472 [2:13:40<26:20:06,  3.62it/s]
  8%|▊         | 27981/371472 [2:13:40<28:00:17,  3.41it/s]
  8%|▊         | 27982/371472 [2:13:40<26:30:04,  3.60it/s]
  8%|▊         | 27983/371472 [2:13:41<26:25:41,  3.61it/s]
  8%|▊         | 27984/371472 [2:13:41<26:11:33,  3.64it/s]
  8%|▊         | 27985/371472 [2:13:41<25:57:48,  3.67it/s]
  8%|▊         | 27986/371472 [2:13:41<26:07:51,  3.65it/s]
  8%|▊         | 27987/371472 [2:13:42<25:14:23,  3.78it/s]
  8%|▊         | 27988/371472 [2:13:42<25:36:11,  3.73it/s]
  8%|▊         | 27989/371472 [2:13:42<25:46:54,  3.70it/s]
  8%|▊         | 27990/371472 [2:13:43<26:39:55,  3.58it/s]
  8%|▊         | 27991/371472 [2:13:43<26:56:43,  3.54it/s]
  8%|▊         | 27992/371472 [2:13:43<28:26:53,  3.35it/s]
  8%|▊         | 27993/371472 [2:13:43<28:22:51,  3.36it/s]
  8%|▊         | 27994/371472 [2:13:44<28:11:09,  3.39it/s]
  8%|▊         | 27995/371472 [2:13:44<27:44:07,  3.44it/s]
  8%|▊         | 27996/371472 [2:13:44<28:11:45,  3.38it/s]
  8%|▊         | 27997/371472 [2:13:45<29:38:05,  3.22it/s]
  8%|▊         | 27998/371472 [2:13:45<28:16:28,  3.37it/s]
  8%|▊         | 27999/371472 [2:13:45<27:19:55,  3.49it/s]
  8%|▊         | 28000/371472 [2:13:46<27:42:39,  3.44it/s]
                                                           
{'loss': 4.4675, 'learning_rate': 9.326100540843371e-07, 'epoch': 1.21}

  8%|▊         | 28000/371472 [2:13:46<27:42:39,  3.44it/s]
  8%|▊         | 28001/371472 [2:13:46<26:46:30,  3.56it/s]
  8%|▊         | 28002/371472 [2:13:46<26:58:10,  3.54it/s]
  8%|▊         | 28003/371472 [2:13:46<28:16:07,  3.38it/s]
  8%|▊         | 28004/371472 [2:13:47<27:20:38,  3.49it/s]
  8%|▊         | 28005/371472 [2:13:47<27:31:30,  3.47it/s]
  8%|▊         | 28006/371472 [2:13:47<27:09:45,  3.51it/s]
  8%|▊         | 28007/371472 [2:13:48<26:40:06,  3.58it/s]
  8%|▊         | 28008/371472 [2:13:48<26:55:37,  3.54it/s]
  8%|▊         | 28009/371472 [2:13:48<27:04:01,  3.52it/s]
  8%|▊         | 28010/371472 [2:13:48<27:02:14,  3.53it/s]
  8%|▊         | 28011/371472 [2:13:49<26:47:57,  3.56it/s]
  8%|▊         | 28012/371472 [2:13:49<25:58:31,  3.67it/s]
  8%|▊         | 28013/371472 [2:13:49<26:50:37,  3.55it/s]
  8%|▊         | 28014/371472 [2:13:49<26:18:38,  3.63it/s]
  8%|▊         | 28015/371472 [2:13:50<25:49:54,  3.69it/s]
  8%|▊         | 28016/371472 [2:13:50<25:27:59,  3.75it/s]
  8%|▊         | 28017/371472 [2:13:50<26:20:07,  3.62it/s]
  8%|▊         | 28018/371472 [2:13:51<26:42:25,  3.57it/s]
  8%|▊         | 28019/371472 [2:13:51<28:03:20,  3.40it/s]
  8%|▊         | 28020/371472 [2:13:51<27:16:59,  3.50it/s]
                                                           
{'loss': 4.4763, 'learning_rate': 9.325615721088582e-07, 'epoch': 1.21}

  8%|▊         | 28020/371472 [2:13:51<27:16:59,  3.50it/s]
  8%|▊         | 28021/371472 [2:13:51<28:10:43,  3.39it/s]
  8%|▊         | 28022/371472 [2:13:52<29:48:49,  3.20it/s]
  8%|▊         | 28023/371472 [2:13:52<28:18:57,  3.37it/s]
  8%|▊         | 28024/371472 [2:13:52<27:17:20,  3.50it/s]
  8%|▊         | 28025/371472 [2:13:53<27:34:24,  3.46it/s]
  8%|▊         | 28026/371472 [2:13:53<27:29:50,  3.47it/s]
  8%|▊         | 28027/371472 [2:13:53<27:38:31,  3.45it/s]
  8%|▊         | 28028/371472 [2:13:54<27:55:04,  3.42it/s]
  8%|▊         | 28029/371472 [2:13:54<27:00:36,  3.53it/s]
  8%|▊         | 28030/371472 [2:13:54<26:51:15,  3.55it/s]
  8%|▊         | 28031/371472 [2:13:54<27:49:38,  3.43it/s]
  8%|▊         | 28032/371472 [2:13:55<28:07:09,  3.39it/s]
  8%|▊         | 28033/371472 [2:13:55<28:06:24,  3.39it/s]
  8%|▊         | 28034/371472 [2:13:55<28:33:13,  3.34it/s]
  8%|▊         | 28035/371472 [2:13:56<28:19:06,  3.37it/s]
  8%|▊         | 28036/371472 [2:13:56<28:18:12,  3.37it/s]
  8%|▊         | 28037/371472 [2:13:56<27:12:45,  3.51it/s]
  8%|▊         | 28038/371472 [2:13:56<28:09:18,  3.39it/s]
  8%|▊         | 28039/371472 [2:13:57<27:54:40,  3.42it/s]
  8%|▊         | 28040/371472 [2:13:57<29:03:23,  3.28it/s]
                                                           
{'loss': 4.4464, 'learning_rate': 9.325130901333792e-07, 'epoch': 1.21}

  8%|▊         | 28040/371472 [2:13:57<29:03:23,  3.28it/s]
  8%|▊         | 28041/371472 [2:13:57<27:28:39,  3.47it/s]
  8%|▊         | 28042/371472 [2:13:58<27:54:34,  3.42it/s]
  8%|▊         | 28043/371472 [2:13:58<29:46:27,  3.20it/s]
  8%|▊         | 28044/371472 [2:13:58<28:46:49,  3.31it/s]
  8%|▊         | 28045/371472 [2:13:59<31:45:15,  3.00it/s]
  8%|▊         | 28046/371472 [2:13:59<31:06:29,  3.07it/s]
  8%|▊         | 28047/371472 [2:13:59<29:53:30,  3.19it/s]
  8%|▊         | 28048/371472 [2:14:00<29:55:59,  3.19it/s]
  8%|▊         | 28049/371472 [2:14:00<28:50:13,  3.31it/s]
  8%|▊         | 28050/371472 [2:14:00<27:51:51,  3.42it/s]
  8%|▊         | 28051/371472 [2:14:00<29:45:29,  3.21it/s]
  8%|▊         | 28052/371472 [2:14:01<29:57:37,  3.18it/s]
  8%|▊         | 28053/371472 [2:14:01<27:53:06,  3.42it/s]
  8%|▊         | 28054/371472 [2:14:01<26:23:05,  3.62it/s]
  8%|▊         | 28055/371472 [2:14:02<26:15:27,  3.63it/s]
  8%|▊         | 28056/371472 [2:14:02<25:08:23,  3.79it/s]
  8%|▊         | 28057/371472 [2:14:02<25:00:58,  3.81it/s]
  8%|▊         | 28058/371472 [2:14:02<25:00:07,  3.82it/s]
  8%|▊         | 28059/371472 [2:14:03<27:20:51,  3.49it/s]
  8%|▊         | 28060/371472 [2:14:03<27:23:59,  3.48it/s]
                                                           
{'loss': 4.2176, 'learning_rate': 9.324646081579004e-07, 'epoch': 1.21}

  8%|▊         | 28060/371472 [2:14:03<27:23:59,  3.48it/s]
  8%|▊         | 28061/371472 [2:14:03<26:41:17,  3.57it/s]
  8%|▊         | 28062/371472 [2:14:04<27:52:11,  3.42it/s]
  8%|▊         | 28063/371472 [2:14:04<27:06:39,  3.52it/s]
  8%|▊         | 28064/371472 [2:14:04<26:51:12,  3.55it/s]
  8%|▊         | 28065/371472 [2:14:04<28:15:39,  3.38it/s]
  8%|▊         | 28066/371472 [2:14:05<26:35:08,  3.59it/s]
  8%|▊         | 28067/371472 [2:14:05<27:08:59,  3.51it/s]
  8%|▊         | 28068/371472 [2:14:05<26:08:55,  3.65it/s]
  8%|▊         | 28069/371472 [2:14:05<26:01:06,  3.67it/s]
  8%|▊         | 28070/371472 [2:14:06<26:52:10,  3.55it/s]
  8%|▊         | 28071/371472 [2:14:06<26:32:14,  3.59it/s]
  8%|▊         | 28072/371472 [2:14:06<28:38:59,  3.33it/s]
  8%|▊         | 28073/371472 [2:14:07<29:19:55,  3.25it/s]
  8%|▊         | 28074/371472 [2:14:07<27:40:20,  3.45it/s]
  8%|▊         | 28075/371472 [2:14:07<27:45:41,  3.44it/s]
  8%|▊         | 28076/371472 [2:14:07<26:33:22,  3.59it/s]
  8%|▊         | 28077/371472 [2:14:08<26:08:14,  3.65it/s]
  8%|▊         | 28078/371472 [2:14:08<27:02:24,  3.53it/s]
  8%|▊         | 28079/371472 [2:14:08<27:01:12,  3.53it/s]
  8%|▊         | 28080/371472 [2:14:09<28:04:17,  3.40it/s]
                                                           
{'loss': 4.705, 'learning_rate': 9.324161261824215e-07, 'epoch': 1.21}

  8%|▊         | 28080/371472 [2:14:09<28:04:17,  3.40it/s]
  8%|▊         | 28081/371472 [2:14:09<26:51:06,  3.55it/s]
  8%|▊         | 28082/371472 [2:14:09<26:48:23,  3.56it/s]
  8%|▊         | 28083/371472 [2:14:09<26:55:04,  3.54it/s]
  8%|▊         | 28084/371472 [2:14:10<26:07:15,  3.65it/s]
  8%|▊         | 28085/371472 [2:14:10<26:47:08,  3.56it/s]
  8%|▊         | 28086/371472 [2:14:10<27:01:46,  3.53it/s]
  8%|▊         | 28087/371472 [2:14:11<27:33:31,  3.46it/s]
  8%|▊         | 28088/371472 [2:14:11<26:53:11,  3.55it/s]
  8%|▊         | 28089/371472 [2:14:11<26:00:02,  3.67it/s]
  8%|▊         | 28090/371472 [2:14:11<26:50:38,  3.55it/s]
  8%|▊         | 28091/371472 [2:14:12<25:58:46,  3.67it/s]
  8%|▊         | 28092/371472 [2:14:12<26:33:05,  3.59it/s]
  8%|▊         | 28093/371472 [2:14:12<26:31:01,  3.60it/s]
  8%|▊         | 28094/371472 [2:14:13<27:07:07,  3.52it/s]
  8%|▊         | 28095/371472 [2:14:13<27:04:55,  3.52it/s]
  8%|▊         | 28096/371472 [2:14:13<27:41:42,  3.44it/s]
  8%|▊         | 28097/371472 [2:14:13<27:05:15,  3.52it/s]
  8%|▊         | 28098/371472 [2:14:14<29:17:20,  3.26it/s]
  8%|▊         | 28099/371472 [2:14:14<27:38:31,  3.45it/s]
  8%|▊         | 28100/371472 [2:14:14<27:11:12,  3.51it/s]
                                                           
{'loss': 4.3475, 'learning_rate': 9.323676442069426e-07, 'epoch': 1.21}

  8%|▊         | 28100/371472 [2:14:14<27:11:12,  3.51it/s]
  8%|▊         | 28101/371472 [2:14:15<26:10:47,  3.64it/s]
  8%|▊         | 28102/371472 [2:14:15<27:20:10,  3.49it/s]
  8%|▊         | 28103/371472 [2:14:15<27:04:09,  3.52it/s]
  8%|▊         | 28104/371472 [2:14:15<28:20:56,  3.36it/s]
  8%|▊         | 28105/371472 [2:14:16<27:21:43,  3.49it/s]
  8%|▊         | 28106/371472 [2:14:16<26:57:32,  3.54it/s]
  8%|▊         | 28107/371472 [2:14:16<27:53:55,  3.42it/s]
  8%|▊         | 28108/371472 [2:14:17<27:13:16,  3.50it/s]
  8%|▊         | 28109/371472 [2:14:17<25:41:44,  3.71it/s]
  8%|▊         | 28110/371472 [2:14:17<25:31:01,  3.74it/s]
  8%|▊         | 28111/371472 [2:14:17<26:09:54,  3.65it/s]
  8%|▊         | 28112/371472 [2:14:18<25:33:24,  3.73it/s]
  8%|▊         | 28113/371472 [2:14:18<25:52:24,  3.69it/s]
  8%|▊         | 28114/371472 [2:14:18<26:26:17,  3.61it/s]
  8%|▊         | 28115/371472 [2:14:18<25:21:30,  3.76it/s]
  8%|▊         | 28116/371472 [2:14:19<25:38:34,  3.72it/s]
  8%|▊         | 28117/371472 [2:14:19<25:15:36,  3.78it/s]
  8%|▊         | 28118/371472 [2:14:19<24:45:08,  3.85it/s]
  8%|▊         | 28119/371472 [2:14:20<26:01:24,  3.66it/s]
  8%|▊         | 28120/371472 [2:14:20<27:48:36,  3.43it/s]
                                                           
{'loss': 4.1616, 'learning_rate': 9.323191622314637e-07, 'epoch': 1.21}

  8%|▊         | 28120/371472 [2:14:20<27:48:36,  3.43it/s]
  8%|▊         | 28121/371472 [2:14:20<30:03:12,  3.17it/s]
  8%|▊         | 28122/371472 [2:14:21<29:41:23,  3.21it/s]
  8%|▊         | 28123/371472 [2:14:21<28:19:13,  3.37it/s]
  8%|▊         | 28124/371472 [2:14:21<27:31:42,  3.46it/s]
  8%|▊         | 28125/371472 [2:14:21<29:33:44,  3.23it/s]
  8%|▊         | 28126/371472 [2:14:22<27:53:44,  3.42it/s]
  8%|▊         | 28127/371472 [2:14:22<27:48:55,  3.43it/s]
  8%|▊         | 28128/371472 [2:14:22<28:04:14,  3.40it/s]
  8%|▊         | 28129/371472 [2:14:23<27:22:18,  3.48it/s]
  8%|▊         | 28130/371472 [2:14:23<27:05:51,  3.52it/s]
  8%|▊         | 28131/371472 [2:14:23<26:51:27,  3.55it/s]
  8%|▊         | 28132/371472 [2:14:23<26:13:06,  3.64it/s]
  8%|▊         | 28133/371472 [2:14:24<25:53:42,  3.68it/s]
  8%|▊         | 28134/371472 [2:14:24<26:41:49,  3.57it/s]
  8%|▊         | 28135/371472 [2:14:24<27:14:45,  3.50it/s]
  8%|▊         | 28136/371472 [2:14:25<27:41:44,  3.44it/s]
  8%|▊         | 28137/371472 [2:14:25<27:15:55,  3.50it/s]
  8%|▊         | 28138/371472 [2:14:25<27:31:22,  3.47it/s]
  8%|▊         | 28139/371472 [2:14:25<26:57:20,  3.54it/s]
  8%|▊         | 28140/371472 [2:14:26<26:32:54,  3.59it/s]
                                                           
{'loss': 4.4239, 'learning_rate': 9.322706802559848e-07, 'epoch': 1.21}

  8%|▊         | 28140/371472 [2:14:26<26:32:54,  3.59it/s]
  8%|▊         | 28141/371472 [2:14:26<27:14:57,  3.50it/s]
  8%|▊         | 28142/371472 [2:14:26<28:33:42,  3.34it/s]
  8%|▊         | 28143/371472 [2:14:27<29:03:07,  3.28it/s]
  8%|▊         | 28144/371472 [2:14:27<29:41:21,  3.21it/s]
  8%|▊         | 28145/371472 [2:14:27<30:50:45,  3.09it/s]
  8%|▊         | 28146/371472 [2:14:28<29:10:31,  3.27it/s]
  8%|▊         | 28147/371472 [2:14:28<29:58:01,  3.18it/s]
  8%|▊         | 28148/371472 [2:14:28<29:21:34,  3.25it/s]
  8%|▊         | 28149/371472 [2:14:28<29:59:48,  3.18it/s]
  8%|▊         | 28150/371472 [2:14:29<29:53:08,  3.19it/s]
  8%|▊         | 28151/371472 [2:14:29<29:45:38,  3.20it/s]
  8%|▊         | 28152/371472 [2:14:29<30:10:06,  3.16it/s]
  8%|▊         | 28153/371472 [2:14:30<29:27:57,  3.24it/s]
  8%|▊         | 28154/371472 [2:14:30<28:10:44,  3.38it/s]
  8%|▊         | 28155/371472 [2:14:30<28:34:11,  3.34it/s]
  8%|▊         | 28156/371472 [2:14:31<27:16:25,  3.50it/s]
  8%|▊         | 28157/371472 [2:14:31<27:02:22,  3.53it/s]
  8%|▊         | 28158/371472 [2:14:31<26:09:55,  3.64it/s]
  8%|▊         | 28159/371472 [2:14:31<25:52:42,  3.69it/s]
  8%|▊         | 28160/371472 [2:14:32<26:12:17,  3.64it/s]
                                                           
{'loss': 4.3745, 'learning_rate': 9.322221982805059e-07, 'epoch': 1.21}

  8%|▊         | 28160/371472 [2:14:32<26:12:17,  3.64it/s]
  8%|▊         | 28161/371472 [2:14:32<26:30:02,  3.60it/s]
  8%|▊         | 28162/371472 [2:14:32<26:09:40,  3.65it/s]
  8%|▊         | 28163/371472 [2:14:32<26:18:48,  3.62it/s]
  8%|▊         | 28164/371472 [2:14:33<27:12:59,  3.50it/s]
  8%|▊         | 28165/371472 [2:14:33<27:17:57,  3.49it/s]
  8%|▊         | 28166/371472 [2:14:33<27:37:16,  3.45it/s]
  8%|▊         | 28167/371472 [2:14:34<27:21:23,  3.49it/s]
  8%|▊         | 28168/371472 [2:14:34<26:16:44,  3.63it/s]
  8%|▊         | 28169/371472 [2:14:34<26:14:13,  3.63it/s]
  8%|▊         | 28170/371472 [2:14:34<26:21:25,  3.62it/s]
  8%|▊         | 28171/371472 [2:14:35<27:32:38,  3.46it/s]
  8%|▊         | 28172/371472 [2:14:35<28:04:43,  3.40it/s]
  8%|▊         | 28173/371472 [2:14:35<26:55:06,  3.54it/s]
  8%|▊         | 28174/371472 [2:14:36<26:23:39,  3.61it/s]
  8%|▊         | 28175/371472 [2:14:36<26:03:56,  3.66it/s]
  8%|▊         | 28176/371472 [2:14:36<26:43:42,  3.57it/s]
  8%|▊         | 28177/371472 [2:14:36<25:34:21,  3.73it/s]
  8%|▊         | 28178/371472 [2:14:37<24:31:25,  3.89it/s]
  8%|▊         | 28179/371472 [2:14:37<24:29:19,  3.89it/s]
  8%|▊         | 28180/371472 [2:14:37<24:56:33,  3.82it/s]
                                                           
{'loss': 4.394, 'learning_rate': 9.321737163050269e-07, 'epoch': 1.21}

  8%|▊         | 28180/371472 [2:14:37<24:56:33,  3.82it/s]
  8%|▊         | 28181/371472 [2:14:37<25:45:24,  3.70it/s]
  8%|▊         | 28182/371472 [2:14:38<28:51:40,  3.30it/s]
  8%|▊         | 28183/371472 [2:14:38<27:45:13,  3.44it/s]
  8%|▊         | 28184/371472 [2:14:38<27:28:23,  3.47it/s]
  8%|▊         | 28185/371472 [2:14:39<30:33:27,  3.12it/s]
  8%|▊         | 28186/371472 [2:14:39<28:54:15,  3.30it/s]
  8%|▊         | 28187/371472 [2:14:39<27:38:43,  3.45it/s]
  8%|▊         | 28188/371472 [2:14:40<29:39:53,  3.21it/s]
  8%|▊         | 28189/371472 [2:14:40<28:53:04,  3.30it/s]
  8%|▊         | 28190/371472 [2:14:40<27:54:48,  3.42it/s]
  8%|▊         | 28191/371472 [2:14:40<26:39:36,  3.58it/s]
  8%|▊         | 28192/371472 [2:14:41<25:55:52,  3.68it/s]
  8%|▊         | 28193/371472 [2:14:41<25:26:25,  3.75it/s]
  8%|▊         | 28194/371472 [2:14:41<24:49:00,  3.84it/s]
  8%|▊         | 28195/371472 [2:14:41<25:16:37,  3.77it/s]
  8%|▊         | 28196/371472 [2:14:42<27:27:53,  3.47it/s]
  8%|▊         | 28197/371472 [2:14:42<28:43:07,  3.32it/s]
  8%|▊         | 28198/371472 [2:14:42<28:17:05,  3.37it/s]
  8%|▊         | 28199/371472 [2:14:43<28:36:34,  3.33it/s]
  8%|▊         | 28200/371472 [2:14:43<29:00:51,  3.29it/s]
                                                           
{'loss': 4.3618, 'learning_rate': 9.321252343295481e-07, 'epoch': 1.21}

  8%|▊         | 28200/371472 [2:14:43<29:00:51,  3.29it/s]
  8%|▊         | 28201/371472 [2:14:43<29:12:23,  3.26it/s]
  8%|▊         | 28202/371472 [2:14:44<29:17:31,  3.26it/s]
  8%|▊         | 28203/371472 [2:14:44<27:47:56,  3.43it/s]
  8%|▊         | 28204/371472 [2:14:44<31:16:15,  3.05it/s]
  8%|▊         | 28205/371472 [2:14:45<30:17:58,  3.15it/s]
  8%|▊         | 28206/371472 [2:14:45<29:35:12,  3.22it/s]
  8%|▊         | 28207/371472 [2:14:45<28:13:31,  3.38it/s]
  8%|▊         | 28208/371472 [2:14:46<30:54:52,  3.08it/s]
  8%|▊         | 28209/371472 [2:14:46<29:40:59,  3.21it/s]
  8%|▊         | 28210/371472 [2:14:46<28:37:46,  3.33it/s]
  8%|▊         | 28211/371472 [2:14:46<27:34:53,  3.46it/s]
  8%|▊         | 28212/371472 [2:14:47<27:00:33,  3.53it/s]
  8%|▊         | 28213/371472 [2:14:47<26:59:02,  3.53it/s]
  8%|▊         | 28214/371472 [2:14:47<27:50:43,  3.42it/s]
  8%|▊         | 28215/371472 [2:14:48<28:10:39,  3.38it/s]
  8%|▊         | 28216/371472 [2:14:48<27:37:31,  3.45it/s]
  8%|▊         | 28217/371472 [2:14:48<26:43:06,  3.57it/s]
  8%|▊         | 28218/371472 [2:14:48<26:26:45,  3.61it/s]
  8%|▊         | 28219/371472 [2:14:49<25:44:01,  3.71it/s]
  8%|▊         | 28220/371472 [2:14:49<25:18:58,  3.77it/s]
                                                           
{'loss': 4.3503, 'learning_rate': 9.320767523540693e-07, 'epoch': 1.22}

  8%|▊         | 28220/371472 [2:14:49<25:18:58,  3.77it/s]
  8%|▊         | 28221/371472 [2:14:49<25:37:42,  3.72it/s]
  8%|▊         | 28222/371472 [2:14:49<25:31:48,  3.73it/s]
  8%|▊         | 28223/371472 [2:14:50<25:05:19,  3.80it/s]
  8%|▊         | 28224/371472 [2:14:50<25:35:56,  3.72it/s]
  8%|▊         | 28225/371472 [2:14:50<27:31:47,  3.46it/s]
  8%|▊         | 28226/371472 [2:14:51<26:57:04,  3.54it/s]
  8%|▊         | 28227/371472 [2:14:51<26:35:07,  3.59it/s]
  8%|▊         | 28228/371472 [2:14:51<26:45:39,  3.56it/s]
  8%|▊         | 28229/371472 [2:14:51<26:37:53,  3.58it/s]
  8%|▊         | 28230/371472 [2:14:52<26:48:35,  3.56it/s]
  8%|▊         | 28231/371472 [2:14:52<26:17:52,  3.63it/s]
  8%|▊         | 28232/371472 [2:14:52<26:38:57,  3.58it/s]
  8%|▊         | 28233/371472 [2:14:52<25:50:05,  3.69it/s]
  8%|▊         | 28234/371472 [2:14:53<27:36:34,  3.45it/s]
  8%|▊         | 28235/371472 [2:14:53<29:48:02,  3.20it/s]
  8%|▊         | 28236/371472 [2:14:53<28:10:39,  3.38it/s]
  8%|▊         | 28237/371472 [2:14:54<28:03:19,  3.40it/s]
  8%|▊         | 28238/371472 [2:14:54<27:43:14,  3.44it/s]
  8%|▊         | 28239/371472 [2:14:54<30:52:59,  3.09it/s]
  8%|▊         | 28240/371472 [2:14:55<29:05:35,  3.28it/s]
                                                           
{'loss': 4.4078, 'learning_rate': 9.320282703785904e-07, 'epoch': 1.22}

  8%|▊         | 28240/371472 [2:14:55<29:05:35,  3.28it/s]
  8%|▊         | 28241/371472 [2:14:55<28:05:51,  3.39it/s]
  8%|▊         | 28242/371472 [2:14:55<31:10:19,  3.06it/s]
  8%|▊         | 28243/371472 [2:14:56<29:53:02,  3.19it/s]
  8%|▊         | 28244/371472 [2:14:56<29:03:36,  3.28it/s]
  8%|▊         | 28245/371472 [2:14:56<29:32:28,  3.23it/s]
  8%|▊         | 28246/371472 [2:14:57<29:23:51,  3.24it/s]
  8%|▊         | 28247/371472 [2:14:57<29:06:18,  3.28it/s]
  8%|▊         | 28248/371472 [2:14:57<29:27:42,  3.24it/s]
  8%|▊         | 28249/371472 [2:14:57<29:30:17,  3.23it/s]
  8%|▊         | 28250/371472 [2:14:58<29:00:19,  3.29it/s]
  8%|▊         | 28251/371472 [2:14:58<29:38:46,  3.22it/s]
  8%|▊         | 28252/371472 [2:14:58<30:18:36,  3.15it/s]
  8%|▊         | 28253/371472 [2:14:59<29:16:09,  3.26it/s]
  8%|▊         | 28254/371472 [2:14:59<30:14:08,  3.15it/s]
  8%|▊         | 28255/371472 [2:14:59<29:22:09,  3.25it/s]
  8%|▊         | 28256/371472 [2:15:00<28:52:15,  3.30it/s]
  8%|▊         | 28257/371472 [2:15:00<28:08:06,  3.39it/s]
  8%|▊         | 28258/371472 [2:15:00<27:46:00,  3.43it/s]
  8%|▊         | 28259/371472 [2:15:00<27:19:38,  3.49it/s]
  8%|▊         | 28260/371472 [2:15:01<29:39:24,  3.21it/s]
                                                           
{'loss': 4.2004, 'learning_rate': 9.319797884031113e-07, 'epoch': 1.22}

  8%|▊         | 28260/371472 [2:15:01<29:39:24,  3.21it/s]
  8%|▊         | 28261/371472 [2:15:01<29:36:17,  3.22it/s]
  8%|▊         | 28262/371472 [2:15:01<28:49:42,  3.31it/s]
  8%|▊         | 28263/371472 [2:15:02<28:04:36,  3.40it/s]
  8%|▊         | 28264/371472 [2:15:02<27:05:58,  3.52it/s]
  8%|▊         | 28265/371472 [2:15:02<26:38:17,  3.58it/s]
  8%|▊         | 28266/371472 [2:15:02<25:48:58,  3.69it/s]
  8%|▊         | 28267/371472 [2:15:03<26:09:31,  3.64it/s]
  8%|▊         | 28268/371472 [2:15:03<25:24:26,  3.75it/s]
  8%|▊         | 28269/371472 [2:15:03<25:50:44,  3.69it/s]
  8%|▊         | 28270/371472 [2:15:04<26:41:50,  3.57it/s]
  8%|▊         | 28271/371472 [2:15:04<25:46:34,  3.70it/s]
  8%|▊         | 28272/371472 [2:15:04<27:24:30,  3.48it/s]
  8%|▊         | 28273/371472 [2:15:05<31:00:37,  3.07it/s]
  8%|▊         | 28274/371472 [2:15:05<29:14:09,  3.26it/s]
  8%|▊         | 28275/371472 [2:15:05<27:54:59,  3.41it/s]
  8%|▊         | 28276/371472 [2:15:05<29:13:33,  3.26it/s]
  8%|▊         | 28277/371472 [2:15:06<27:56:40,  3.41it/s]
  8%|▊         | 28278/371472 [2:15:06<26:34:14,  3.59it/s]
  8%|▊         | 28279/371472 [2:15:06<25:45:08,  3.70it/s]
  8%|▊         | 28280/371472 [2:15:06<25:27:59,  3.74it/s]
                                                           
{'loss': 4.4605, 'learning_rate': 9.319313064276325e-07, 'epoch': 1.22}

  8%|▊         | 28280/371472 [2:15:06<25:27:59,  3.74it/s]
  8%|▊         | 28281/371472 [2:15:07<25:43:51,  3.70it/s]
  8%|▊         | 28282/371472 [2:15:07<25:34:55,  3.73it/s]
  8%|▊         | 28283/371472 [2:15:07<25:53:48,  3.68it/s]
  8%|▊         | 28284/371472 [2:15:08<26:03:43,  3.66it/s]
  8%|▊         | 28285/371472 [2:15:08<25:59:25,  3.67it/s]
  8%|▊         | 28286/371472 [2:15:08<26:08:52,  3.65it/s]
  8%|▊         | 28287/371472 [2:15:08<26:46:26,  3.56it/s]
  8%|▊         | 28288/371472 [2:15:09<26:11:45,  3.64it/s]
  8%|▊         | 28289/371472 [2:15:09<26:17:28,  3.63it/s]
  8%|▊         | 28290/371472 [2:15:09<26:39:49,  3.58it/s]
  8%|▊         | 28291/371472 [2:15:09<27:01:57,  3.53it/s]
  8%|▊         | 28292/371472 [2:15:10<26:49:09,  3.55it/s]
  8%|▊         | 28293/371472 [2:15:10<25:53:03,  3.68it/s]
  8%|▊         | 28294/371472 [2:15:10<25:24:23,  3.75it/s]
  8%|▊         | 28295/371472 [2:15:11<26:35:19,  3.59it/s]
  8%|▊         | 28296/371472 [2:15:11<26:27:42,  3.60it/s]
  8%|▊         | 28297/371472 [2:15:11<26:05:30,  3.65it/s]
  8%|▊         | 28298/371472 [2:15:11<25:41:43,  3.71it/s]
  8%|▊         | 28299/371472 [2:15:12<25:56:49,  3.67it/s]
  8%|▊         | 28300/371472 [2:15:12<26:01:48,  3.66it/s]
                                                           
{'loss': 4.592, 'learning_rate': 9.318828244521536e-07, 'epoch': 1.22}

  8%|▊         | 28300/371472 [2:15:12<26:01:48,  3.66it/s]
  8%|▊         | 28301/371472 [2:15:12<25:40:26,  3.71it/s]
  8%|▊         | 28302/371472 [2:15:12<25:46:45,  3.70it/s]
  8%|▊         | 28303/371472 [2:15:13<27:17:50,  3.49it/s]
  8%|▊         | 28304/371472 [2:15:13<27:06:56,  3.52it/s]
  8%|▊         | 28305/371472 [2:15:13<29:02:28,  3.28it/s]
  8%|▊         | 28306/371472 [2:15:14<31:10:47,  3.06it/s]
  8%|▊         | 28307/371472 [2:15:14<30:11:00,  3.16it/s]
  8%|▊         | 28308/371472 [2:15:14<29:23:32,  3.24it/s]
  8%|▊         | 28309/371472 [2:15:15<28:57:01,  3.29it/s]
  8%|▊         | 28310/371472 [2:15:15<29:05:40,  3.28it/s]
  8%|▊         | 28311/371472 [2:15:15<29:30:50,  3.23it/s]
  8%|▊         | 28312/371472 [2:15:16<29:33:09,  3.23it/s]
  8%|▊         | 28313/371472 [2:15:16<29:18:22,  3.25it/s]
  8%|▊         | 28314/371472 [2:15:16<29:14:50,  3.26it/s]
  8%|▊         | 28315/371472 [2:15:16<28:11:54,  3.38it/s]
  8%|▊         | 28316/371472 [2:15:17<27:52:23,  3.42it/s]
  8%|▊         | 28317/371472 [2:15:17<27:22:13,  3.48it/s]
  8%|▊         | 28318/371472 [2:15:17<29:04:49,  3.28it/s]
  8%|▊         | 28319/371472 [2:15:18<28:00:52,  3.40it/s]
  8%|▊         | 28320/371472 [2:15:18<26:37:34,  3.58it/s]
                                                           
{'loss': 4.1173, 'learning_rate': 9.318343424766748e-07, 'epoch': 1.22}

  8%|▊         | 28320/371472 [2:15:18<26:37:34,  3.58it/s]
  8%|▊         | 28321/371472 [2:15:18<26:27:13,  3.60it/s]
  8%|▊         | 28322/371472 [2:15:18<26:37:18,  3.58it/s]
  8%|▊         | 28323/371472 [2:15:19<28:45:47,  3.31it/s]
  8%|▊         | 28324/371472 [2:15:19<27:36:50,  3.45it/s]
  8%|▊         | 28325/371472 [2:15:19<27:27:01,  3.47it/s]
  8%|▊         | 28326/371472 [2:15:20<29:55:41,  3.18it/s]
  8%|▊         | 28327/371472 [2:15:20<28:48:05,  3.31it/s]
  8%|▊         | 28328/371472 [2:15:20<29:56:49,  3.18it/s]
  8%|▊         | 28329/371472 [2:15:21<29:25:57,  3.24it/s]
  8%|▊         | 28330/371472 [2:15:21<28:47:23,  3.31it/s]
  8%|▊         | 28331/371472 [2:15:21<29:01:05,  3.28it/s]
  8%|▊         | 28332/371472 [2:15:22<28:31:22,  3.34it/s]
  8%|▊         | 28333/371472 [2:15:22<27:32:48,  3.46it/s]
  8%|▊         | 28334/371472 [2:15:22<28:19:02,  3.37it/s]
  8%|▊         | 28335/371472 [2:15:22<27:57:19,  3.41it/s]
  8%|▊         | 28336/371472 [2:15:23<27:53:31,  3.42it/s]
  8%|▊         | 28337/371472 [2:15:23<29:11:20,  3.27it/s]
  8%|▊         | 28338/371472 [2:15:23<28:15:27,  3.37it/s]
  8%|▊         | 28339/371472 [2:15:24<27:28:27,  3.47it/s]
  8%|▊         | 28340/371472 [2:15:24<27:08:18,  3.51it/s]
                                                           
{'loss': 4.4178, 'learning_rate': 9.317858605011958e-07, 'epoch': 1.22}

  8%|▊         | 28340/371472 [2:15:24<27:08:18,  3.51it/s]
  8%|▊         | 28341/371472 [2:15:24<26:56:20,  3.54it/s]
  8%|▊         | 28342/371472 [2:15:24<27:25:51,  3.47it/s]
  8%|▊         | 28343/371472 [2:15:25<28:06:49,  3.39it/s]
  8%|▊         | 28344/371472 [2:15:25<29:35:47,  3.22it/s]
  8%|▊         | 28345/371472 [2:15:26<32:56:44,  2.89it/s]
  8%|▊         | 28346/371472 [2:15:26<30:50:39,  3.09it/s]
  8%|▊         | 28347/371472 [2:15:26<29:14:13,  3.26it/s]
  8%|▊         | 28348/371472 [2:15:26<29:10:48,  3.27it/s]
  8%|▊         | 28349/371472 [2:15:27<28:45:30,  3.31it/s]
  8%|▊         | 28350/371472 [2:15:27<27:54:10,  3.42it/s]
  8%|▊         | 28351/371472 [2:15:27<27:00:17,  3.53it/s]
  8%|▊         | 28352/371472 [2:15:27<26:38:12,  3.58it/s]
  8%|▊         | 28353/371472 [2:15:28<26:17:47,  3.62it/s]
  8%|▊         | 28354/371472 [2:15:28<26:41:57,  3.57it/s]
  8%|▊         | 28355/371472 [2:15:28<26:47:54,  3.56it/s]
  8%|▊         | 28356/371472 [2:15:29<25:54:07,  3.68it/s]
  8%|▊         | 28357/371472 [2:15:29<27:04:24,  3.52it/s]
  8%|▊         | 28358/371472 [2:15:29<26:54:51,  3.54it/s]
  8%|▊         | 28359/371472 [2:15:29<26:41:25,  3.57it/s]
  8%|▊         | 28360/371472 [2:15:30<26:20:59,  3.62it/s]
                                                           
{'loss': 4.8156, 'learning_rate': 9.31737378525717e-07, 'epoch': 1.22}

  8%|▊         | 28360/371472 [2:15:30<26:20:59,  3.62it/s]
  8%|▊         | 28361/371472 [2:15:30<26:41:24,  3.57it/s]
  8%|▊         | 28362/371472 [2:15:30<26:56:46,  3.54it/s]
  8%|▊         | 28363/371472 [2:15:31<27:49:20,  3.43it/s]
  8%|▊         | 28364/371472 [2:15:31<28:41:25,  3.32it/s]
  8%|▊         | 28365/371472 [2:15:31<28:09:19,  3.39it/s]
  8%|▊         | 28366/371472 [2:15:31<27:29:15,  3.47it/s]
  8%|▊         | 28367/371472 [2:15:32<27:27:44,  3.47it/s]
  8%|▊         | 28368/371472 [2:15:32<28:43:27,  3.32it/s]
  8%|▊         | 28369/371472 [2:15:32<28:25:10,  3.35it/s]
  8%|▊         | 28370/371472 [2:15:33<26:58:13,  3.53it/s]
  8%|▊         | 28371/371472 [2:15:33<27:04:35,  3.52it/s]
  8%|▊         | 28372/371472 [2:15:33<26:24:16,  3.61it/s]
  8%|▊         | 28373/371472 [2:15:33<27:11:57,  3.50it/s]
  8%|▊         | 28374/371472 [2:15:34<27:52:50,  3.42it/s]
  8%|▊         | 28375/371472 [2:15:34<27:18:08,  3.49it/s]
  8%|▊         | 28376/371472 [2:15:34<28:11:46,  3.38it/s]
  8%|▊         | 28377/371472 [2:15:35<27:39:32,  3.45it/s]
  8%|▊         | 28378/371472 [2:15:35<26:53:28,  3.54it/s]
  8%|▊         | 28379/371472 [2:15:35<27:08:43,  3.51it/s]
  8%|▊         | 28380/371472 [2:15:35<27:33:39,  3.46it/s]
                                                           
{'loss': 4.591, 'learning_rate': 9.316888965502381e-07, 'epoch': 1.22}

  8%|▊         | 28380/371472 [2:15:35<27:33:39,  3.46it/s]
  8%|▊         | 28381/371472 [2:15:36<26:24:30,  3.61it/s]
  8%|▊         | 28382/371472 [2:15:36<26:16:23,  3.63it/s]
  8%|▊         | 28383/371472 [2:15:36<25:52:00,  3.68it/s]
  8%|▊         | 28384/371472 [2:15:37<26:03:23,  3.66it/s]
  8%|▊         | 28385/371472 [2:15:37<27:33:25,  3.46it/s]
  8%|▊         | 28386/371472 [2:15:37<26:45:19,  3.56it/s]
  8%|▊         | 28387/371472 [2:15:37<26:12:35,  3.64it/s]
  8%|▊         | 28388/371472 [2:15:38<25:57:20,  3.67it/s]
  8%|▊         | 28389/371472 [2:15:38<25:24:26,  3.75it/s]
  8%|▊         | 28390/371472 [2:15:38<26:30:16,  3.60it/s]
  8%|▊         | 28391/371472 [2:15:39<27:04:37,  3.52it/s]
  8%|▊         | 28392/371472 [2:15:39<26:31:21,  3.59it/s]
  8%|▊         | 28393/371472 [2:15:39<27:22:32,  3.48it/s]
  8%|▊         | 28394/371472 [2:15:39<26:55:03,  3.54it/s]
  8%|▊         | 28395/371472 [2:15:40<28:26:17,  3.35it/s]
  8%|▊         | 28396/371472 [2:15:40<29:17:42,  3.25it/s]
  8%|▊         | 28397/371472 [2:15:40<29:59:02,  3.18it/s]
  8%|▊         | 28398/371472 [2:15:41<30:45:34,  3.10it/s]
  8%|▊         | 28399/371472 [2:15:41<29:12:21,  3.26it/s]
  8%|▊         | 28400/371472 [2:15:41<27:29:40,  3.47it/s]
                                                           
{'loss': 4.5912, 'learning_rate': 9.316404145747591e-07, 'epoch': 1.22}

  8%|▊         | 28400/371472 [2:15:41<27:29:40,  3.47it/s]
  8%|▊         | 28401/371472 [2:15:42<29:09:38,  3.27it/s]
  8%|▊         | 28402/371472 [2:15:42<27:26:33,  3.47it/s]
  8%|▊         | 28403/371472 [2:15:42<28:28:33,  3.35it/s]
  8%|▊         | 28404/371472 [2:15:42<27:51:24,  3.42it/s]
  8%|▊         | 28405/371472 [2:15:43<28:49:55,  3.31it/s]
  8%|▊         | 28406/371472 [2:15:43<29:47:35,  3.20it/s]
  8%|▊         | 28407/371472 [2:15:43<28:58:48,  3.29it/s]
  8%|▊         | 28408/371472 [2:15:44<27:22:44,  3.48it/s]
  8%|▊         | 28409/371472 [2:15:44<26:09:51,  3.64it/s]
  8%|▊         | 28410/371472 [2:15:44<26:49:16,  3.55it/s]
  8%|▊         | 28411/371472 [2:15:44<25:55:13,  3.68it/s]
  8%|▊         | 28412/371472 [2:15:45<25:37:16,  3.72it/s]
  8%|▊         | 28413/371472 [2:15:45<28:37:54,  3.33it/s]
  8%|▊         | 28414/371472 [2:15:45<27:32:26,  3.46it/s]
  8%|▊         | 28415/371472 [2:15:46<28:20:44,  3.36it/s]
  8%|▊         | 28416/371472 [2:15:46<30:31:14,  3.12it/s]
  8%|▊         | 28417/371472 [2:15:46<29:32:51,  3.23it/s]
  8%|▊         | 28418/371472 [2:15:47<28:45:30,  3.31it/s]
  8%|▊         | 28419/371472 [2:15:47<27:43:36,  3.44it/s]
  8%|▊         | 28420/371472 [2:15:47<26:37:07,  3.58it/s]
                                                           
{'loss': 4.2252, 'learning_rate': 9.315919325992802e-07, 'epoch': 1.22}

  8%|▊         | 28420/371472 [2:15:47<26:37:07,  3.58it/s]
  8%|▊         | 28421/371472 [2:15:47<27:17:59,  3.49it/s]
  8%|▊         | 28422/371472 [2:15:48<27:54:07,  3.42it/s]
  8%|▊         | 28423/371472 [2:15:48<26:51:24,  3.55it/s]
  8%|▊         | 28424/371472 [2:15:48<28:41:12,  3.32it/s]
  8%|▊         | 28425/371472 [2:15:49<28:26:02,  3.35it/s]
  8%|▊         | 28426/371472 [2:15:49<27:44:06,  3.44it/s]
  8%|▊         | 28427/371472 [2:15:49<27:38:30,  3.45it/s]
  8%|▊         | 28428/371472 [2:15:49<26:40:40,  3.57it/s]
  8%|▊         | 28429/371472 [2:15:50<27:07:23,  3.51it/s]
  8%|▊         | 28430/371472 [2:15:50<27:54:44,  3.41it/s]
  8%|▊         | 28431/371472 [2:15:50<27:28:30,  3.47it/s]
  8%|▊         | 28432/371472 [2:15:51<27:15:15,  3.50it/s]
  8%|▊         | 28433/371472 [2:15:51<27:15:48,  3.50it/s]
  8%|▊         | 28434/371472 [2:15:51<28:06:06,  3.39it/s]
  8%|▊         | 28435/371472 [2:15:51<28:01:01,  3.40it/s]
  8%|▊         | 28436/371472 [2:15:52<26:55:27,  3.54it/s]
  8%|▊         | 28437/371472 [2:15:52<27:16:50,  3.49it/s]
  8%|▊         | 28438/371472 [2:15:52<27:44:19,  3.44it/s]
  8%|▊         | 28439/371472 [2:15:53<27:31:45,  3.46it/s]
  8%|▊         | 28440/371472 [2:15:53<26:53:59,  3.54it/s]
                                                           
{'loss': 4.2596, 'learning_rate': 9.315434506238014e-07, 'epoch': 1.22}

  8%|▊         | 28440/371472 [2:15:53<26:53:59,  3.54it/s]
  8%|▊         | 28441/371472 [2:15:53<26:19:41,  3.62it/s]
  8%|▊         | 28442/371472 [2:15:53<25:53:14,  3.68it/s]
  8%|▊         | 28443/371472 [2:15:54<25:11:52,  3.78it/s]
  8%|▊         | 28444/371472 [2:15:54<24:53:23,  3.83it/s]
  8%|▊         | 28445/371472 [2:15:54<25:43:43,  3.70it/s]
  8%|▊         | 28446/371472 [2:15:54<26:00:45,  3.66it/s]
  8%|▊         | 28447/371472 [2:15:55<28:29:50,  3.34it/s]
  8%|▊         | 28448/371472 [2:15:55<27:51:29,  3.42it/s]
  8%|▊         | 28449/371472 [2:15:55<27:22:05,  3.48it/s]
  8%|▊         | 28450/371472 [2:15:56<26:21:08,  3.62it/s]
  8%|▊         | 28451/371472 [2:15:56<27:37:27,  3.45it/s]
  8%|▊         | 28452/371472 [2:15:56<26:49:10,  3.55it/s]
  8%|▊         | 28453/371472 [2:15:56<25:54:01,  3.68it/s]
  8%|▊         | 28454/371472 [2:15:57<26:50:16,  3.55it/s]
  8%|▊         | 28455/371472 [2:15:57<26:08:08,  3.65it/s]
  8%|▊         | 28456/371472 [2:15:57<25:47:24,  3.69it/s]
  8%|▊         | 28457/371472 [2:15:58<25:13:05,  3.78it/s]
  8%|▊         | 28458/371472 [2:15:58<26:55:04,  3.54it/s]
  8%|▊         | 28459/371472 [2:15:58<26:01:12,  3.66it/s]
  8%|▊         | 28460/371472 [2:15:58<26:23:40,  3.61it/s]
                                                           
{'loss': 4.4703, 'learning_rate': 9.314949686483225e-07, 'epoch': 1.23}

  8%|▊         | 28460/371472 [2:15:58<26:23:40,  3.61it/s]
  8%|▊         | 28461/371472 [2:15:59<27:02:36,  3.52it/s]
  8%|▊         | 28462/371472 [2:15:59<26:49:49,  3.55it/s]
  8%|▊         | 28463/371472 [2:15:59<31:09:14,  3.06it/s]
  8%|▊         | 28464/371472 [2:16:00<29:15:40,  3.26it/s]
  8%|▊         | 28465/371472 [2:16:00<27:54:29,  3.41it/s]
  8%|▊         | 28466/371472 [2:16:00<29:13:56,  3.26it/s]
  8%|▊         | 28467/371472 [2:16:01<27:56:34,  3.41it/s]
  8%|▊         | 28468/371472 [2:16:01<28:47:33,  3.31it/s]
  8%|▊         | 28469/371472 [2:16:01<28:07:14,  3.39it/s]
  8%|▊         | 28470/371472 [2:16:01<28:49:45,  3.30it/s]
  8%|▊         | 28471/371472 [2:16:02<28:32:07,  3.34it/s]
  8%|▊         | 28472/371472 [2:16:02<31:24:34,  3.03it/s]
  8%|▊         | 28473/371472 [2:16:02<30:47:10,  3.09it/s]
  8%|▊         | 28474/371472 [2:16:03<30:35:01,  3.12it/s]
  8%|▊         | 28475/371472 [2:16:03<28:26:17,  3.35it/s]
  8%|▊         | 28476/371472 [2:16:03<27:23:48,  3.48it/s]
  8%|▊         | 28477/371472 [2:16:04<27:09:36,  3.51it/s]
  8%|▊         | 28478/371472 [2:16:04<27:55:11,  3.41it/s]
  8%|▊         | 28479/371472 [2:16:04<28:55:07,  3.29it/s]
  8%|▊         | 28480/371472 [2:16:04<29:19:38,  3.25it/s]
                                                           
{'loss': 4.3343, 'learning_rate': 9.314464866728436e-07, 'epoch': 1.23}

  8%|▊         | 28480/371472 [2:16:04<29:19:38,  3.25it/s]
  8%|▊         | 28481/371472 [2:16:05<28:10:58,  3.38it/s]
  8%|▊         | 28482/371472 [2:16:05<28:11:39,  3.38it/s]
  8%|▊         | 28483/371472 [2:16:05<27:25:52,  3.47it/s]
  8%|▊         | 28484/371472 [2:16:06<27:29:45,  3.47it/s]
  8%|▊         | 28485/371472 [2:16:06<27:35:44,  3.45it/s]
  8%|▊         | 28486/371472 [2:16:06<28:44:11,  3.32it/s]
  8%|▊         | 28487/371472 [2:16:07<29:11:06,  3.26it/s]
  8%|▊         | 28488/371472 [2:16:07<28:33:58,  3.34it/s]
  8%|▊         | 28489/371472 [2:16:07<27:18:08,  3.49it/s]
  8%|▊         | 28490/371472 [2:16:07<25:58:54,  3.67it/s]
  8%|▊         | 28491/371472 [2:16:08<26:26:02,  3.60it/s]
  8%|▊         | 28492/371472 [2:16:08<25:53:42,  3.68it/s]
  8%|▊         | 28493/371472 [2:16:08<26:15:52,  3.63it/s]
  8%|▊         | 28494/371472 [2:16:08<26:05:44,  3.65it/s]
  8%|▊         | 28495/371472 [2:16:09<24:59:52,  3.81it/s]
  8%|▊         | 28496/371472 [2:16:09<24:33:42,  3.88it/s]
  8%|▊         | 28497/371472 [2:16:09<24:50:22,  3.84it/s]
  8%|▊         | 28498/371472 [2:16:09<25:19:11,  3.76it/s]
  8%|▊         | 28499/371472 [2:16:10<25:53:27,  3.68it/s]
  8%|▊         | 28500/371472 [2:16:10<25:28:43,  3.74it/s]
                                                           
{'loss': 4.4048, 'learning_rate': 9.313980046973647e-07, 'epoch': 1.23}

  8%|▊         | 28500/371472 [2:16:10<25:28:43,  3.74it/s]
  8%|▊         | 28501/371472 [2:16:10<25:33:08,  3.73it/s]
  8%|▊         | 28502/371472 [2:16:11<25:55:28,  3.67it/s]
  8%|▊         | 28503/371472 [2:16:11<26:16:30,  3.63it/s]
  8%|▊         | 28504/371472 [2:16:11<25:19:59,  3.76it/s]
  8%|▊         | 28505/371472 [2:16:11<25:45:10,  3.70it/s]
  8%|▊         | 28506/371472 [2:16:12<27:08:56,  3.51it/s]
  8%|▊         | 28507/371472 [2:16:12<26:34:44,  3.58it/s]
  8%|▊         | 28508/371472 [2:16:12<27:11:10,  3.50it/s]
  8%|▊         | 28509/371472 [2:16:13<27:40:19,  3.44it/s]
  8%|▊         | 28510/371472 [2:16:13<26:33:40,  3.59it/s]
  8%|▊         | 28511/371472 [2:16:13<26:59:39,  3.53it/s]
  8%|▊         | 28512/371472 [2:16:13<27:40:59,  3.44it/s]
  8%|▊         | 28513/371472 [2:16:14<27:47:37,  3.43it/s]
  8%|▊         | 28514/371472 [2:16:14<28:13:18,  3.38it/s]
  8%|▊         | 28515/371472 [2:16:14<27:27:54,  3.47it/s]
  8%|▊         | 28516/371472 [2:16:15<27:28:57,  3.47it/s]
  8%|▊         | 28517/371472 [2:16:15<28:52:42,  3.30it/s]
  8%|▊         | 28518/371472 [2:16:15<27:37:41,  3.45it/s]
  8%|▊         | 28519/371472 [2:16:15<28:49:46,  3.30it/s]
  8%|▊         | 28520/371472 [2:16:16<27:47:08,  3.43it/s]
                                                           
{'loss': 4.6057, 'learning_rate': 9.313495227218858e-07, 'epoch': 1.23}

  8%|▊         | 28520/371472 [2:16:16<27:47:08,  3.43it/s]
  8%|▊         | 28521/371472 [2:16:16<29:34:58,  3.22it/s]
  8%|▊         | 28522/371472 [2:16:16<28:39:19,  3.32it/s]
  8%|▊         | 28523/371472 [2:16:17<28:59:23,  3.29it/s]
  8%|▊         | 28524/371472 [2:16:17<28:11:21,  3.38it/s]
  8%|▊         | 28525/371472 [2:16:17<26:54:40,  3.54it/s]
  8%|▊         | 28526/371472 [2:16:17<25:34:48,  3.72it/s]
  8%|▊         | 28527/371472 [2:16:18<25:40:23,  3.71it/s]
  8%|▊         | 28528/371472 [2:16:18<25:17:11,  3.77it/s]
  8%|▊         | 28529/371472 [2:16:18<26:06:26,  3.65it/s]
  8%|▊         | 28530/371472 [2:16:19<26:17:07,  3.62it/s]
  8%|▊         | 28531/371472 [2:16:19<26:50:25,  3.55it/s]
  8%|▊         | 28532/371472 [2:16:19<26:26:45,  3.60it/s]
  8%|▊         | 28533/371472 [2:16:19<26:22:14,  3.61it/s]
  8%|▊         | 28534/371472 [2:16:20<26:16:31,  3.63it/s]
  8%|▊         | 28535/371472 [2:16:20<26:23:34,  3.61it/s]
  8%|▊         | 28536/371472 [2:16:20<26:08:41,  3.64it/s]
  8%|▊         | 28537/371472 [2:16:21<26:26:11,  3.60it/s]
  8%|▊         | 28538/371472 [2:16:21<25:56:59,  3.67it/s]
  8%|▊         | 28539/371472 [2:16:21<26:00:25,  3.66it/s]
  8%|▊         | 28540/371472 [2:16:21<25:09:17,  3.79it/s]
                                                           
{'loss': 4.5505, 'learning_rate': 9.313010407464069e-07, 'epoch': 1.23}

  8%|▊         | 28540/371472 [2:16:21<25:09:17,  3.79it/s]
  8%|▊         | 28541/371472 [2:16:22<26:49:06,  3.55it/s]
  8%|▊         | 28542/371472 [2:16:22<29:11:24,  3.26it/s]
  8%|▊         | 28543/371472 [2:16:22<28:09:29,  3.38it/s]
  8%|▊         | 28544/371472 [2:16:23<29:12:12,  3.26it/s]
  8%|▊         | 28545/371472 [2:16:23<28:02:41,  3.40it/s]
  8%|▊         | 28546/371472 [2:16:23<29:05:34,  3.27it/s]
  8%|▊         | 28547/371472 [2:16:23<28:32:53,  3.34it/s]
  8%|▊         | 28548/371472 [2:16:24<28:39:35,  3.32it/s]
  8%|▊         | 28549/371472 [2:16:24<28:50:52,  3.30it/s]
  8%|▊         | 28550/371472 [2:16:24<28:43:35,  3.32it/s]
  8%|▊         | 28551/371472 [2:16:25<26:47:58,  3.55it/s]
  8%|▊         | 28552/371472 [2:16:25<26:10:40,  3.64it/s]
  8%|▊         | 28553/371472 [2:16:25<26:10:38,  3.64it/s]
  8%|▊         | 28554/371472 [2:16:26<29:02:55,  3.28it/s]
  8%|▊         | 28555/371472 [2:16:26<29:16:37,  3.25it/s]
  8%|▊         | 28556/371472 [2:16:26<28:47:51,  3.31it/s]
  8%|▊         | 28557/371472 [2:16:26<28:30:06,  3.34it/s]
  8%|▊         | 28558/371472 [2:16:27<26:44:03,  3.56it/s]
  8%|▊         | 28559/371472 [2:16:27<25:31:02,  3.73it/s]
  8%|▊         | 28560/371472 [2:16:27<25:29:21,  3.74it/s]
                                                           
{'loss': 4.5829, 'learning_rate': 9.31252558770928e-07, 'epoch': 1.23}

  8%|▊         | 28560/371472 [2:16:27<25:29:21,  3.74it/s]
  8%|▊         | 28561/371472 [2:16:27<25:40:51,  3.71it/s]
  8%|▊         | 28562/371472 [2:16:28<26:06:07,  3.65it/s]
  8%|▊         | 28563/371472 [2:16:28<27:30:43,  3.46it/s]
  8%|▊         | 28564/371472 [2:16:28<27:07:23,  3.51it/s]
  8%|▊         | 28565/371472 [2:16:29<26:47:45,  3.55it/s]
  8%|▊         | 28566/371472 [2:16:29<26:38:05,  3.58it/s]
  8%|▊         | 28567/371472 [2:16:29<26:41:13,  3.57it/s]
  8%|▊         | 28568/371472 [2:16:29<26:18:36,  3.62it/s]
  8%|▊         | 28569/371472 [2:16:30<26:06:31,  3.65it/s]
  8%|▊         | 28570/371472 [2:16:30<26:21:34,  3.61it/s]
  8%|▊         | 28571/371472 [2:16:30<25:55:15,  3.67it/s]
  8%|▊         | 28572/371472 [2:16:31<27:26:29,  3.47it/s]
  8%|▊         | 28573/371472 [2:16:31<27:42:22,  3.44it/s]
  8%|▊         | 28574/371472 [2:16:31<27:35:16,  3.45it/s]
  8%|▊         | 28575/371472 [2:16:31<27:25:06,  3.47it/s]
  8%|▊         | 28576/371472 [2:16:32<27:28:10,  3.47it/s]
  8%|▊         | 28577/371472 [2:16:32<27:31:59,  3.46it/s]
  8%|▊         | 28578/371472 [2:16:32<27:52:19,  3.42it/s]
  8%|▊         | 28579/371472 [2:16:33<27:36:43,  3.45it/s]
  8%|▊         | 28580/371472 [2:16:33<27:13:16,  3.50it/s]
                                                           
{'loss': 4.2724, 'learning_rate': 9.312040767954491e-07, 'epoch': 1.23}

  8%|▊         | 28580/371472 [2:16:33<27:13:16,  3.50it/s]
  8%|▊         | 28581/371472 [2:16:33<29:50:25,  3.19it/s]
  8%|▊         | 28582/371472 [2:16:34<31:12:56,  3.05it/s]
  8%|▊         | 28583/371472 [2:16:34<30:26:09,  3.13it/s]
  8%|▊         | 28584/371472 [2:16:34<31:08:59,  3.06it/s]
  8%|▊         | 28585/371472 [2:16:35<30:06:26,  3.16it/s]
  8%|▊         | 28586/371472 [2:16:35<30:39:45,  3.11it/s]
  8%|▊         | 28587/371472 [2:16:35<29:00:14,  3.28it/s]
  8%|▊         | 28588/371472 [2:16:35<28:22:15,  3.36it/s]
  8%|▊         | 28589/371472 [2:16:36<27:33:42,  3.46it/s]
  8%|▊         | 28590/371472 [2:16:36<27:04:23,  3.52it/s]
  8%|▊         | 28591/371472 [2:16:36<26:34:29,  3.58it/s]
  8%|▊         | 28592/371472 [2:16:37<28:20:14,  3.36it/s]
  8%|▊         | 28593/371472 [2:16:37<27:40:40,  3.44it/s]
  8%|▊         | 28594/371472 [2:16:37<27:33:24,  3.46it/s]
  8%|▊         | 28595/371472 [2:16:37<27:01:22,  3.52it/s]
  8%|▊         | 28596/371472 [2:16:38<27:33:11,  3.46it/s]
  8%|▊         | 28597/371472 [2:16:38<27:15:07,  3.49it/s]
  8%|▊         | 28598/371472 [2:16:38<27:42:02,  3.44it/s]
  8%|▊         | 28599/371472 [2:16:39<28:00:10,  3.40it/s]
  8%|▊         | 28600/371472 [2:16:39<26:53:50,  3.54it/s]
                                                           
{'loss': 4.5347, 'learning_rate': 9.311555948199703e-07, 'epoch': 1.23}

  8%|▊         | 28600/371472 [2:16:39<26:53:50,  3.54it/s]
  8%|▊         | 28601/371472 [2:16:39<25:52:06,  3.68it/s]
  8%|▊         | 28602/371472 [2:16:39<29:45:42,  3.20it/s]
  8%|▊         | 28603/371472 [2:16:40<29:14:32,  3.26it/s]
  8%|▊         | 28604/371472 [2:16:40<28:28:21,  3.34it/s]
  8%|▊         | 28605/371472 [2:16:40<27:30:32,  3.46it/s]
  8%|▊         | 28606/371472 [2:16:41<27:54:06,  3.41it/s]
  8%|▊         | 28607/371472 [2:16:41<28:37:21,  3.33it/s]
  8%|▊         | 28608/371472 [2:16:41<28:12:39,  3.38it/s]
  8%|▊         | 28609/371472 [2:16:42<28:16:56,  3.37it/s]
  8%|▊         | 28610/371472 [2:16:42<26:38:54,  3.57it/s]
  8%|▊         | 28611/371472 [2:16:42<28:58:31,  3.29it/s]
  8%|▊         | 28612/371472 [2:16:42<28:33:37,  3.33it/s]
  8%|▊         | 28613/371472 [2:16:43<28:55:56,  3.29it/s]
  8%|▊         | 28614/371472 [2:16:43<28:17:54,  3.37it/s]
  8%|▊         | 28615/371472 [2:16:43<29:45:15,  3.20it/s]
  8%|▊         | 28616/371472 [2:16:44<30:47:40,  3.09it/s]
  8%|▊         | 28617/371472 [2:16:44<31:12:52,  3.05it/s]
  8%|▊         | 28618/371472 [2:16:44<29:26:43,  3.23it/s]
  8%|▊         | 28619/371472 [2:16:45<27:51:56,  3.42it/s]
  8%|▊         | 28620/371472 [2:16:45<26:52:11,  3.54it/s]
                                                           
{'loss': 4.3547, 'learning_rate': 9.311071128444914e-07, 'epoch': 1.23}

  8%|▊         | 28620/371472 [2:16:45<26:52:11,  3.54it/s]
  8%|▊         | 28621/371472 [2:16:45<27:30:19,  3.46it/s]
  8%|▊         | 28622/371472 [2:16:45<26:55:58,  3.54it/s]
  8%|▊         | 28623/371472 [2:16:46<26:22:50,  3.61it/s]
  8%|▊         | 28624/371472 [2:16:46<25:53:34,  3.68it/s]
  8%|▊         | 28625/371472 [2:16:46<25:43:28,  3.70it/s]
  8%|▊         | 28626/371472 [2:16:46<25:48:15,  3.69it/s]
  8%|▊         | 28627/371472 [2:16:47<25:42:42,  3.70it/s]
  8%|▊         | 28628/371472 [2:16:47<24:53:31,  3.83it/s]
  8%|▊         | 28629/371472 [2:16:47<25:41:45,  3.71it/s]
  8%|▊         | 28630/371472 [2:16:48<25:30:37,  3.73it/s]
  8%|▊         | 28631/371472 [2:16:48<24:57:31,  3.82it/s]
  8%|▊         | 28632/371472 [2:16:48<25:58:02,  3.67it/s]
  8%|▊         | 28633/371472 [2:16:48<26:33:29,  3.59it/s]
  8%|▊         | 28634/371472 [2:16:49<29:38:48,  3.21it/s]
  8%|▊         | 28635/371472 [2:16:49<28:14:49,  3.37it/s]
  8%|▊         | 28636/371472 [2:16:49<27:21:58,  3.48it/s]
  8%|▊         | 28637/371472 [2:16:50<26:56:52,  3.53it/s]
  8%|▊         | 28638/371472 [2:16:50<26:28:55,  3.60it/s]
  8%|▊         | 28639/371472 [2:16:50<25:40:07,  3.71it/s]
  8%|▊         | 28640/371472 [2:16:50<27:30:47,  3.46it/s]
                                                           
{'loss': 4.5261, 'learning_rate': 9.310586308690123e-07, 'epoch': 1.23}

  8%|▊         | 28640/371472 [2:16:50<27:30:47,  3.46it/s]
  8%|▊         | 28641/371472 [2:16:51<26:21:58,  3.61it/s]
  8%|▊         | 28642/371472 [2:16:51<26:21:51,  3.61it/s]
  8%|▊         | 28643/371472 [2:16:51<26:21:28,  3.61it/s]
  8%|▊         | 28644/371472 [2:16:51<25:58:42,  3.67it/s]
  8%|▊         | 28645/371472 [2:16:52<26:05:37,  3.65it/s]
  8%|▊         | 28646/371472 [2:16:52<25:32:05,  3.73it/s]
  8%|▊         | 28647/371472 [2:16:52<28:08:05,  3.38it/s]
  8%|▊         | 28648/371472 [2:16:53<29:14:36,  3.26it/s]
  8%|▊         | 28649/371472 [2:16:53<27:18:06,  3.49it/s]
  8%|▊         | 28650/371472 [2:16:53<29:23:20,  3.24it/s]
  8%|▊         | 28651/371472 [2:16:54<28:03:19,  3.39it/s]
  8%|▊         | 28652/371472 [2:16:54<26:38:45,  3.57it/s]
  8%|▊         | 28653/371472 [2:16:54<26:53:06,  3.54it/s]
  8%|▊         | 28654/371472 [2:16:54<26:15:22,  3.63it/s]
  8%|▊         | 28655/371472 [2:16:55<27:11:31,  3.50it/s]
  8%|▊         | 28656/371472 [2:16:55<27:11:38,  3.50it/s]
  8%|▊         | 28657/371472 [2:16:55<26:14:34,  3.63it/s]
  8%|▊         | 28658/371472 [2:16:56<29:10:57,  3.26it/s]
  8%|▊         | 28659/371472 [2:16:56<28:01:10,  3.40it/s]
  8%|▊         | 28660/371472 [2:16:56<27:32:23,  3.46it/s]
                                                           
{'loss': 4.5067, 'learning_rate': 9.310101488935335e-07, 'epoch': 1.23}

  8%|▊         | 28660/371472 [2:16:56<27:32:23,  3.46it/s]
  8%|▊         | 28661/371472 [2:16:56<26:10:36,  3.64it/s]
  8%|▊         | 28662/371472 [2:16:57<27:39:42,  3.44it/s]
  8%|▊         | 28663/371472 [2:16:57<27:09:56,  3.51it/s]
  8%|▊         | 28664/371472 [2:16:57<27:19:45,  3.48it/s]
  8%|▊         | 28665/371472 [2:16:58<28:23:10,  3.35it/s]
  8%|▊         | 28666/371472 [2:16:58<27:17:56,  3.49it/s]
  8%|▊         | 28667/371472 [2:16:58<26:36:22,  3.58it/s]
  8%|▊         | 28668/371472 [2:16:58<26:26:01,  3.60it/s]
  8%|▊         | 28669/371472 [2:16:59<26:10:39,  3.64it/s]
  8%|▊         | 28670/371472 [2:16:59<25:52:16,  3.68it/s]
  8%|▊         | 28671/371472 [2:16:59<26:11:48,  3.63it/s]
  8%|▊         | 28672/371472 [2:16:59<26:13:31,  3.63it/s]
  8%|▊         | 28673/371472 [2:17:00<26:47:47,  3.55it/s]
  8%|▊         | 28674/371472 [2:17:00<28:03:03,  3.39it/s]
  8%|▊         | 28675/371472 [2:17:00<27:22:09,  3.48it/s]
  8%|▊         | 28676/371472 [2:17:01<26:07:46,  3.64it/s]
  8%|▊         | 28677/371472 [2:17:01<26:56:00,  3.54it/s]
  8%|▊         | 28678/371472 [2:17:01<27:10:14,  3.50it/s]
  8%|▊         | 28679/371472 [2:17:02<28:23:01,  3.35it/s]
  8%|▊         | 28680/371472 [2:17:02<27:56:51,  3.41it/s]
                                                           
{'loss': 4.4154, 'learning_rate': 9.309616669180547e-07, 'epoch': 1.24}

  8%|▊         | 28680/371472 [2:17:02<27:56:51,  3.41it/s]
  8%|▊         | 28681/371472 [2:17:02<27:14:01,  3.50it/s]
  8%|▊         | 28682/371472 [2:17:02<26:07:53,  3.64it/s]
  8%|▊         | 28683/371472 [2:17:03<29:45:56,  3.20it/s]
  8%|▊         | 28684/371472 [2:17:03<28:54:17,  3.29it/s]
  8%|▊         | 28685/371472 [2:17:03<27:45:54,  3.43it/s]
  8%|▊         | 28686/371472 [2:17:04<27:27:17,  3.47it/s]
  8%|▊         | 28687/371472 [2:17:04<26:41:37,  3.57it/s]
  8%|▊         | 28688/371472 [2:17:04<28:41:03,  3.32it/s]
  8%|▊         | 28689/371472 [2:17:04<28:02:49,  3.39it/s]
  8%|▊         | 28690/371472 [2:17:05<27:43:03,  3.44it/s]
  8%|▊         | 28691/371472 [2:17:05<28:00:37,  3.40it/s]
  8%|▊         | 28692/371472 [2:17:05<26:57:26,  3.53it/s]
  8%|▊         | 28693/371472 [2:17:06<27:29:49,  3.46it/s]
  8%|▊         | 28694/371472 [2:17:06<27:03:36,  3.52it/s]
  8%|▊         | 28695/371472 [2:17:06<27:43:44,  3.43it/s]
  8%|▊         | 28696/371472 [2:17:06<26:23:05,  3.61it/s]
  8%|▊         | 28697/371472 [2:17:07<26:13:39,  3.63it/s]
  8%|▊         | 28698/371472 [2:17:07<26:59:48,  3.53it/s]
  8%|▊         | 28699/371472 [2:17:07<26:01:08,  3.66it/s]
  8%|▊         | 28700/371472 [2:17:08<25:54:06,  3.68it/s]
                                                           
{'loss': 4.2921, 'learning_rate': 9.309131849425757e-07, 'epoch': 1.24}

  8%|▊         | 28700/371472 [2:17:08<25:54:06,  3.68it/s]
  8%|▊         | 28701/371472 [2:17:08<26:14:59,  3.63it/s]
  8%|▊         | 28702/371472 [2:17:08<28:26:22,  3.35it/s]
  8%|▊         | 28703/371472 [2:17:08<29:30:42,  3.23it/s]
  8%|▊         | 28704/371472 [2:17:09<29:05:49,  3.27it/s]
  8%|▊         | 28705/371472 [2:17:09<28:15:40,  3.37it/s]
  8%|▊         | 28706/371472 [2:17:09<29:28:39,  3.23it/s]
  8%|▊         | 28707/371472 [2:17:10<29:08:22,  3.27it/s]
  8%|▊         | 28708/371472 [2:17:10<30:27:14,  3.13it/s]
  8%|▊         | 28709/371472 [2:17:10<28:48:39,  3.30it/s]
  8%|▊         | 28710/371472 [2:17:11<27:51:02,  3.42it/s]
  8%|▊         | 28711/371472 [2:17:11<28:15:05,  3.37it/s]
  8%|▊         | 28712/371472 [2:17:11<27:29:22,  3.46it/s]
  8%|▊         | 28713/371472 [2:17:11<28:07:13,  3.39it/s]
  8%|▊         | 28714/371472 [2:17:12<26:48:03,  3.55it/s]
  8%|▊         | 28715/371472 [2:17:12<26:01:31,  3.66it/s]
  8%|▊         | 28716/371472 [2:17:12<25:51:01,  3.68it/s]
  8%|▊         | 28717/371472 [2:17:12<25:24:16,  3.75it/s]
  8%|▊         | 28718/371472 [2:17:13<27:29:00,  3.46it/s]
  8%|▊         | 28719/371472 [2:17:13<26:50:56,  3.55it/s]
  8%|▊         | 28720/371472 [2:17:13<27:25:12,  3.47it/s]
                                                           
{'loss': 4.5793, 'learning_rate': 9.308647029670968e-07, 'epoch': 1.24}

  8%|▊         | 28720/371472 [2:17:13<27:25:12,  3.47it/s]
  8%|▊         | 28721/371472 [2:17:14<27:31:52,  3.46it/s]
  8%|▊         | 28722/371472 [2:17:14<27:10:24,  3.50it/s]
  8%|▊         | 28723/371472 [2:17:14<27:15:31,  3.49it/s]
  8%|▊         | 28724/371472 [2:17:15<26:26:44,  3.60it/s]
  8%|▊         | 28725/371472 [2:17:15<27:07:55,  3.51it/s]
  8%|▊         | 28726/371472 [2:17:15<26:33:23,  3.59it/s]
  8%|▊         | 28727/371472 [2:17:15<26:48:12,  3.55it/s]
  8%|▊         | 28728/371472 [2:17:16<26:41:39,  3.57it/s]
  8%|▊         | 28729/371472 [2:17:16<26:14:12,  3.63it/s]
  8%|▊         | 28730/371472 [2:17:16<30:23:52,  3.13it/s]
  8%|▊         | 28731/371472 [2:17:17<29:14:12,  3.26it/s]
  8%|▊         | 28732/371472 [2:17:17<27:44:49,  3.43it/s]
  8%|▊         | 28733/371472 [2:17:17<26:32:11,  3.59it/s]
  8%|▊         | 28734/371472 [2:17:17<25:59:10,  3.66it/s]
  8%|▊         | 28735/371472 [2:17:18<25:34:16,  3.72it/s]
  8%|▊         | 28736/371472 [2:17:18<24:52:46,  3.83it/s]
  8%|▊         | 28737/371472 [2:17:18<26:03:04,  3.65it/s]
  8%|▊         | 28738/371472 [2:17:18<26:27:57,  3.60it/s]
  8%|▊         | 28739/371472 [2:17:19<27:40:44,  3.44it/s]
  8%|▊         | 28740/371472 [2:17:19<26:37:30,  3.58it/s]
                                                           
{'loss': 4.3936, 'learning_rate': 9.308162209916181e-07, 'epoch': 1.24}

  8%|▊         | 28740/371472 [2:17:19<26:37:30,  3.58it/s]
  8%|▊         | 28741/371472 [2:17:19<26:14:39,  3.63it/s]
  8%|▊         | 28742/371472 [2:17:20<26:04:15,  3.65it/s]
  8%|▊         | 28743/371472 [2:17:20<25:53:01,  3.68it/s]
  8%|▊         | 28744/371472 [2:17:20<25:41:14,  3.71it/s]
  8%|▊         | 28745/371472 [2:17:20<26:00:32,  3.66it/s]
  8%|▊         | 28746/371472 [2:17:21<26:23:48,  3.61it/s]
  8%|▊         | 28747/371472 [2:17:21<25:29:54,  3.73it/s]
  8%|▊         | 28748/371472 [2:17:21<26:37:26,  3.58it/s]
  8%|▊         | 28749/371472 [2:17:22<26:56:54,  3.53it/s]
  8%|▊         | 28750/371472 [2:17:22<28:18:44,  3.36it/s]
  8%|▊         | 28751/371472 [2:17:22<30:32:48,  3.12it/s]
  8%|▊         | 28752/371472 [2:17:23<30:35:53,  3.11it/s]
  8%|▊         | 28753/371472 [2:17:23<30:26:56,  3.13it/s]
  8%|▊         | 28754/371472 [2:17:23<29:12:30,  3.26it/s]
  8%|▊         | 28755/371472 [2:17:23<30:20:04,  3.14it/s]
  8%|▊         | 28756/371472 [2:17:24<29:04:21,  3.27it/s]
  8%|▊         | 28757/371472 [2:17:24<27:16:07,  3.49it/s]
  8%|▊         | 28758/371472 [2:17:24<27:34:15,  3.45it/s]
  8%|▊         | 28759/371472 [2:17:25<27:44:24,  3.43it/s]
  8%|▊         | 28760/371472 [2:17:25<26:58:08,  3.53it/s]
                                                           
{'loss': 4.2317, 'learning_rate': 9.307677390161391e-07, 'epoch': 1.24}

  8%|▊         | 28760/371472 [2:17:25<26:58:08,  3.53it/s]
  8%|▊         | 28761/371472 [2:17:25<28:26:54,  3.35it/s]
  8%|▊         | 28762/371472 [2:17:25<26:51:52,  3.54it/s]
  8%|▊         | 28763/371472 [2:17:26<27:56:44,  3.41it/s]
  8%|▊         | 28764/371472 [2:17:26<27:35:35,  3.45it/s]
  8%|▊         | 28765/371472 [2:17:26<28:36:02,  3.33it/s]
  8%|▊         | 28766/371472 [2:17:27<27:44:07,  3.43it/s]
  8%|▊         | 28767/371472 [2:17:27<28:48:02,  3.31it/s]
  8%|▊         | 28768/371472 [2:17:27<27:52:38,  3.41it/s]
  8%|▊         | 28769/371472 [2:17:27<26:47:23,  3.55it/s]
  8%|▊         | 28770/371472 [2:17:28<27:30:11,  3.46it/s]
  8%|▊         | 28771/371472 [2:17:28<27:39:46,  3.44it/s]
  8%|▊         | 28772/371472 [2:17:28<28:04:02,  3.39it/s]
  8%|▊         | 28773/371472 [2:17:29<28:25:57,  3.35it/s]
  8%|▊         | 28774/371472 [2:17:29<28:20:33,  3.36it/s]
  8%|▊         | 28775/371472 [2:17:29<27:18:11,  3.49it/s]
  8%|▊         | 28776/371472 [2:17:30<27:23:11,  3.48it/s]
  8%|▊         | 28777/371472 [2:17:30<27:04:07,  3.52it/s]
  8%|▊         | 28778/371472 [2:17:30<26:52:21,  3.54it/s]
  8%|▊         | 28779/371472 [2:17:30<26:13:13,  3.63it/s]
  8%|▊         | 28780/371472 [2:17:31<26:01:58,  3.66it/s]
                                                           
{'loss': 4.1972, 'learning_rate': 9.307192570406601e-07, 'epoch': 1.24}

  8%|▊         | 28780/371472 [2:17:31<26:01:58,  3.66it/s]
  8%|▊         | 28781/371472 [2:17:31<25:58:39,  3.66it/s]
  8%|▊         | 28782/371472 [2:17:31<27:09:55,  3.50it/s]
  8%|▊         | 28783/371472 [2:17:32<28:42:47,  3.32it/s]
  8%|▊         | 28784/371472 [2:17:32<27:49:38,  3.42it/s]
  8%|▊         | 28785/371472 [2:17:32<27:24:05,  3.47it/s]
  8%|▊         | 28786/371472 [2:17:32<26:58:32,  3.53it/s]
  8%|▊         | 28787/371472 [2:17:33<26:48:46,  3.55it/s]
  8%|▊         | 28788/371472 [2:17:33<25:29:36,  3.73it/s]
  8%|▊         | 28789/371472 [2:17:33<25:40:24,  3.71it/s]
  8%|▊         | 28790/371472 [2:17:33<27:22:17,  3.48it/s]
  8%|▊         | 28791/371472 [2:17:34<28:53:26,  3.29it/s]
  8%|▊         | 28792/371472 [2:17:34<28:15:30,  3.37it/s]
  8%|▊         | 28793/371472 [2:17:34<27:51:39,  3.42it/s]
  8%|▊         | 28794/371472 [2:17:35<30:00:10,  3.17it/s]
  8%|▊         | 28795/371472 [2:17:35<28:51:15,  3.30it/s]
  8%|▊         | 28796/371472 [2:17:35<30:39:27,  3.10it/s]
  8%|▊         | 28797/371472 [2:17:36<30:08:10,  3.16it/s]
  8%|▊         | 28798/371472 [2:17:36<30:19:54,  3.14it/s]
  8%|▊         | 28799/371472 [2:17:36<30:39:54,  3.10it/s]
  8%|▊         | 28800/371472 [2:17:37<30:33:46,  3.11it/s]
                                                           
{'loss': 4.4496, 'learning_rate': 9.306707750651812e-07, 'epoch': 1.24}

  8%|▊         | 28800/371472 [2:17:37<30:33:46,  3.11it/s]
  8%|▊         | 28801/371472 [2:17:37<29:21:37,  3.24it/s]
  8%|▊         | 28802/371472 [2:17:37<27:34:05,  3.45it/s]
  8%|▊         | 28803/371472 [2:17:38<27:49:48,  3.42it/s]
  8%|▊         | 28804/371472 [2:17:38<26:59:39,  3.53it/s]
  8%|▊         | 28805/371472 [2:17:38<26:25:28,  3.60it/s]
  8%|▊         | 28806/371472 [2:17:38<27:02:32,  3.52it/s]
  8%|▊         | 28807/371472 [2:17:39<26:14:15,  3.63it/s]
  8%|▊         | 28808/371472 [2:17:39<25:20:09,  3.76it/s]
  8%|▊         | 28809/371472 [2:17:39<25:43:29,  3.70it/s]
  8%|▊         | 28810/371472 [2:17:39<25:07:18,  3.79it/s]
  8%|▊         | 28811/371472 [2:17:40<26:04:33,  3.65it/s]
  8%|▊         | 28812/371472 [2:17:40<25:30:26,  3.73it/s]
  8%|▊         | 28813/371472 [2:17:40<24:56:33,  3.82it/s]
  8%|▊         | 28814/371472 [2:17:40<25:02:19,  3.80it/s]
  8%|▊         | 28815/371472 [2:17:41<24:43:05,  3.85it/s]
  8%|▊         | 28816/371472 [2:17:41<25:05:13,  3.79it/s]
  8%|▊         | 28817/371472 [2:17:41<26:11:57,  3.63it/s]
  8%|▊         | 28818/371472 [2:17:42<25:53:03,  3.68it/s]
  8%|▊         | 28819/371472 [2:17:42<25:52:59,  3.68it/s]
  8%|▊         | 28820/371472 [2:17:42<24:54:33,  3.82it/s]
                                                           
{'loss': 4.4471, 'learning_rate': 9.306222930897024e-07, 'epoch': 1.24}

  8%|▊         | 28820/371472 [2:17:42<24:54:33,  3.82it/s]
  8%|▊         | 28821/371472 [2:17:42<24:49:00,  3.84it/s]
  8%|▊         | 28822/371472 [2:17:43<24:13:44,  3.93it/s]
  8%|▊         | 28823/371472 [2:17:43<24:25:16,  3.90it/s]
  8%|▊         | 28824/371472 [2:17:43<25:33:26,  3.72it/s]
  8%|▊         | 28825/371472 [2:17:43<27:10:06,  3.50it/s]
  8%|▊         | 28826/371472 [2:17:44<26:49:16,  3.55it/s]
  8%|▊         | 28827/371472 [2:17:44<27:31:10,  3.46it/s]
  8%|▊         | 28828/371472 [2:17:44<27:40:42,  3.44it/s]
  8%|▊         | 28829/371472 [2:17:45<28:34:00,  3.33it/s]
  8%|▊         | 28830/371472 [2:17:45<28:08:57,  3.38it/s]
  8%|▊         | 28831/371472 [2:17:45<28:07:34,  3.38it/s]
  8%|▊         | 28832/371472 [2:17:45<28:00:16,  3.40it/s]
  8%|▊         | 28833/371472 [2:17:46<26:57:04,  3.53it/s]
  8%|▊         | 28834/371472 [2:17:46<27:11:33,  3.50it/s]
  8%|▊         | 28835/371472 [2:17:46<26:50:16,  3.55it/s]
  8%|▊         | 28836/371472 [2:17:47<26:46:00,  3.56it/s]
  8%|▊         | 28837/371472 [2:17:47<25:50:46,  3.68it/s]
  8%|▊         | 28838/371472 [2:17:47<26:49:27,  3.55it/s]
  8%|▊         | 28839/371472 [2:17:47<26:20:01,  3.61it/s]
  8%|▊         | 28840/371472 [2:17:48<26:42:34,  3.56it/s]
                                                           
{'loss': 4.3669, 'learning_rate': 9.305738111142235e-07, 'epoch': 1.24}

  8%|▊         | 28840/371472 [2:17:48<26:42:34,  3.56it/s]
  8%|▊         | 28841/371472 [2:17:48<26:43:27,  3.56it/s]
  8%|▊         | 28842/371472 [2:17:48<27:08:52,  3.51it/s]
  8%|▊         | 28843/371472 [2:17:49<26:54:27,  3.54it/s]
  8%|▊         | 28844/371472 [2:17:49<26:28:43,  3.59it/s]
  8%|▊         | 28845/371472 [2:17:49<26:02:29,  3.65it/s]
  8%|▊         | 28846/371472 [2:17:49<26:31:04,  3.59it/s]
  8%|▊         | 28847/371472 [2:17:50<25:49:53,  3.68it/s]
  8%|▊         | 28848/371472 [2:17:50<25:31:54,  3.73it/s]
  8%|▊         | 28849/371472 [2:17:50<25:57:28,  3.67it/s]
  8%|▊         | 28850/371472 [2:17:51<28:11:04,  3.38it/s]
  8%|▊         | 28851/371472 [2:17:51<26:26:38,  3.60it/s]
  8%|▊         | 28852/371472 [2:17:51<26:32:51,  3.58it/s]
  8%|▊         | 28853/371472 [2:17:51<28:12:58,  3.37it/s]
  8%|▊         | 28854/371472 [2:17:52<27:15:50,  3.49it/s]
  8%|▊         | 28855/371472 [2:17:52<26:17:47,  3.62it/s]
  8%|▊         | 28856/371472 [2:17:52<26:03:58,  3.65it/s]
  8%|▊         | 28857/371472 [2:17:52<25:37:26,  3.71it/s]
  8%|▊         | 28858/371472 [2:17:53<27:03:21,  3.52it/s]
  8%|▊         | 28859/371472 [2:17:53<26:58:36,  3.53it/s]
  8%|▊         | 28860/371472 [2:17:53<26:28:40,  3.59it/s]
                                                           
{'loss': 4.6186, 'learning_rate': 9.305253291387446e-07, 'epoch': 1.24}

  8%|▊         | 28860/371472 [2:17:53<26:28:40,  3.59it/s]
  8%|▊         | 28861/371472 [2:17:54<25:58:28,  3.66it/s]
  8%|▊         | 28862/371472 [2:17:54<26:14:25,  3.63it/s]
  8%|▊         | 28863/371472 [2:17:54<25:37:20,  3.71it/s]
  8%|▊         | 28864/371472 [2:17:54<27:26:41,  3.47it/s]
  8%|▊         | 28865/371472 [2:17:55<26:20:40,  3.61it/s]
  8%|▊         | 28866/371472 [2:17:55<25:39:28,  3.71it/s]
  8%|▊         | 28867/371472 [2:17:55<26:55:04,  3.54it/s]
  8%|▊         | 28868/371472 [2:17:55<26:11:33,  3.63it/s]
  8%|▊         | 28869/371472 [2:17:56<27:04:20,  3.52it/s]
  8%|▊         | 28870/371472 [2:17:56<34:28:06,  2.76it/s]
  8%|▊         | 28871/371472 [2:17:57<31:45:55,  3.00it/s]
  8%|▊         | 28872/371472 [2:17:57<29:27:41,  3.23it/s]
  8%|▊         | 28873/371472 [2:17:57<34:16:14,  2.78it/s]
  8%|▊         | 28874/371472 [2:17:58<32:26:57,  2.93it/s]
  8%|▊         | 28875/371472 [2:17:58<30:02:31,  3.17it/s]
  8%|▊         | 28876/371472 [2:17:58<29:35:04,  3.22it/s]
  8%|▊         | 28877/371472 [2:17:58<29:47:07,  3.20it/s]
  8%|▊         | 28878/371472 [2:17:59<28:07:44,  3.38it/s]
  8%|▊         | 28879/371472 [2:17:59<27:07:53,  3.51it/s]
  8%|▊         | 28880/371472 [2:17:59<25:51:09,  3.68it/s]
                                                           
{'loss': 4.374, 'learning_rate': 9.304768471632657e-07, 'epoch': 1.24}

  8%|▊         | 28880/371472 [2:17:59<25:51:09,  3.68it/s]
  8%|▊         | 28881/371472 [2:18:00<25:18:51,  3.76it/s]
  8%|▊         | 28882/371472 [2:18:00<26:16:56,  3.62it/s]
  8%|▊         | 28883/371472 [2:18:00<27:13:30,  3.50it/s]
  8%|▊         | 28884/371472 [2:18:00<26:51:11,  3.54it/s]
  8%|▊         | 28885/371472 [2:18:01<25:59:51,  3.66it/s]
  8%|▊         | 28886/371472 [2:18:01<25:40:13,  3.71it/s]
  8%|▊         | 28887/371472 [2:18:01<26:19:23,  3.62it/s]
  8%|▊         | 28888/371472 [2:18:01<26:24:35,  3.60it/s]
  8%|▊         | 28889/371472 [2:18:02<25:52:26,  3.68it/s]
  8%|▊         | 28890/371472 [2:18:02<25:23:28,  3.75it/s]
  8%|▊         | 28891/371472 [2:18:02<26:09:24,  3.64it/s]
  8%|▊         | 28892/371472 [2:18:03<26:41:45,  3.56it/s]
  8%|▊         | 28893/371472 [2:18:03<26:22:35,  3.61it/s]
  8%|▊         | 28894/371472 [2:18:03<26:13:49,  3.63it/s]
  8%|▊         | 28895/371472 [2:18:03<27:04:08,  3.52it/s]
  8%|▊         | 28896/371472 [2:18:04<27:34:38,  3.45it/s]
  8%|▊         | 28897/371472 [2:18:04<27:33:54,  3.45it/s]
  8%|▊         | 28898/371472 [2:18:04<26:42:06,  3.56it/s]
  8%|▊         | 28899/371472 [2:18:05<26:38:25,  3.57it/s]
  8%|▊         | 28900/371472 [2:18:05<26:20:50,  3.61it/s]
                                                           
{'loss': 4.423, 'learning_rate': 9.304283651877868e-07, 'epoch': 1.24}

  8%|▊         | 28900/371472 [2:18:05<26:20:50,  3.61it/s]
  8%|▊         | 28901/371472 [2:18:05<26:03:49,  3.65it/s]
  8%|▊         | 28902/371472 [2:18:05<26:05:20,  3.65it/s]
  8%|▊         | 28903/371472 [2:18:06<26:18:40,  3.62it/s]
  8%|▊         | 28904/371472 [2:18:06<25:22:26,  3.75it/s]
  8%|▊         | 28905/371472 [2:18:06<26:43:13,  3.56it/s]
  8%|▊         | 28906/371472 [2:18:06<26:38:50,  3.57it/s]
  8%|▊         | 28907/371472 [2:18:07<28:09:39,  3.38it/s]
  8%|▊         | 28908/371472 [2:18:07<27:24:24,  3.47it/s]
  8%|▊         | 28909/371472 [2:18:07<31:02:15,  3.07it/s]
  8%|▊         | 28910/371472 [2:18:08<30:43:06,  3.10it/s]
  8%|▊         | 28911/371472 [2:18:08<31:39:17,  3.01it/s]
  8%|▊         | 28912/371472 [2:18:08<29:56:19,  3.18it/s]
  8%|▊         | 28913/371472 [2:18:09<28:22:12,  3.35it/s]
  8%|▊         | 28914/371472 [2:18:09<28:45:32,  3.31it/s]
  8%|▊         | 28915/371472 [2:18:09<27:13:05,  3.50it/s]
  8%|▊         | 28916/371472 [2:18:10<28:51:05,  3.30it/s]
  8%|▊         | 28917/371472 [2:18:10<28:05:48,  3.39it/s]
  8%|▊         | 28918/371472 [2:18:10<29:57:12,  3.18it/s]
  8%|▊         | 28919/371472 [2:18:11<28:39:18,  3.32it/s]
  8%|▊         | 28920/371472 [2:18:11<27:44:53,  3.43it/s]
                                                           
{'loss': 4.5189, 'learning_rate': 9.303798832123079e-07, 'epoch': 1.25}

  8%|▊         | 28920/371472 [2:18:11<27:44:53,  3.43it/s]
  8%|▊         | 28921/371472 [2:18:11<27:30:03,  3.46it/s]
  8%|▊         | 28922/371472 [2:18:11<27:52:16,  3.41it/s]
  8%|▊         | 28923/371472 [2:18:12<27:30:41,  3.46it/s]
  8%|▊         | 28924/371472 [2:18:12<29:07:31,  3.27it/s]
  8%|▊         | 28925/371472 [2:18:12<28:12:22,  3.37it/s]
  8%|▊         | 28926/371472 [2:18:13<27:03:45,  3.52it/s]
  8%|▊         | 28927/371472 [2:18:13<29:02:55,  3.28it/s]
  8%|▊         | 28928/371472 [2:18:13<27:33:34,  3.45it/s]
  8%|▊         | 28929/371472 [2:18:13<27:28:59,  3.46it/s]
  8%|▊         | 28930/371472 [2:18:14<27:11:20,  3.50it/s]
  8%|▊         | 28931/371472 [2:18:14<27:33:59,  3.45it/s]
  8%|▊         | 28932/371472 [2:18:14<27:38:19,  3.44it/s]
  8%|▊         | 28933/371472 [2:18:15<28:02:14,  3.39it/s]
  8%|▊         | 28934/371472 [2:18:15<32:59:45,  2.88it/s]
  8%|▊         | 28935/371472 [2:18:15<32:38:07,  2.92it/s]
  8%|▊         | 28936/371472 [2:18:16<31:24:38,  3.03it/s]
  8%|▊         | 28937/371472 [2:18:16<29:29:24,  3.23it/s]
  8%|▊         | 28938/371472 [2:18:16<30:18:55,  3.14it/s]
  8%|▊         | 28939/371472 [2:18:17<30:14:02,  3.15it/s]
  8%|▊         | 28940/371472 [2:18:17<29:41:39,  3.20it/s]
                                                           
{'loss': 4.215, 'learning_rate': 9.30331401236829e-07, 'epoch': 1.25}

  8%|▊         | 28940/371472 [2:18:17<29:41:39,  3.20it/s]
  8%|▊         | 28941/371472 [2:18:17<29:39:18,  3.21it/s]
  8%|▊         | 28942/371472 [2:18:17<28:31:02,  3.34it/s]
  8%|▊         | 28943/371472 [2:18:18<29:22:14,  3.24it/s]
  8%|▊         | 28944/371472 [2:18:18<31:32:04,  3.02it/s]
  8%|▊         | 28945/371472 [2:18:18<30:06:55,  3.16it/s]
  8%|▊         | 28946/371472 [2:18:19<30:24:11,  3.13it/s]
  8%|▊         | 28947/371472 [2:18:19<29:53:01,  3.18it/s]
  8%|▊         | 28948/371472 [2:18:19<28:29:11,  3.34it/s]
  8%|▊         | 28949/371472 [2:18:20<27:16:31,  3.49it/s]
  8%|▊         | 28950/371472 [2:18:20<26:44:59,  3.56it/s]
  8%|▊         | 28951/371472 [2:18:20<27:38:20,  3.44it/s]
  8%|▊         | 28952/371472 [2:18:20<26:51:25,  3.54it/s]
  8%|▊         | 28953/371472 [2:18:21<25:59:33,  3.66it/s]
  8%|▊         | 28954/371472 [2:18:21<27:28:37,  3.46it/s]
  8%|▊         | 28955/371472 [2:18:21<26:19:29,  3.61it/s]
  8%|▊         | 28956/371472 [2:18:22<25:56:55,  3.67it/s]
  8%|▊         | 28957/371472 [2:18:22<26:06:02,  3.65it/s]
  8%|▊         | 28958/371472 [2:18:22<27:21:50,  3.48it/s]
  8%|▊         | 28959/371472 [2:18:22<27:28:43,  3.46it/s]
  8%|▊         | 28960/371472 [2:18:23<26:44:35,  3.56it/s]
                                                           
{'loss': 4.4685, 'learning_rate': 9.302829192613501e-07, 'epoch': 1.25}

  8%|▊         | 28960/371472 [2:18:23<26:44:35,  3.56it/s]
  8%|▊         | 28961/371472 [2:18:23<26:20:23,  3.61it/s]
  8%|▊         | 28962/371472 [2:18:23<26:29:47,  3.59it/s]
  8%|▊         | 28963/371472 [2:18:24<26:24:18,  3.60it/s]
  8%|▊         | 28964/371472 [2:18:24<26:32:55,  3.58it/s]
  8%|▊         | 28965/371472 [2:18:24<26:37:30,  3.57it/s]
  8%|▊         | 28966/371472 [2:18:24<26:14:24,  3.63it/s]
  8%|▊         | 28967/371472 [2:18:25<26:49:33,  3.55it/s]
  8%|▊         | 28968/371472 [2:18:25<26:41:39,  3.56it/s]
  8%|▊         | 28969/371472 [2:18:25<26:30:52,  3.59it/s]
  8%|▊         | 28970/371472 [2:18:26<27:25:17,  3.47it/s]
  8%|▊         | 28971/371472 [2:18:26<27:27:08,  3.47it/s]
  8%|▊         | 28972/371472 [2:18:26<29:04:21,  3.27it/s]
  8%|▊         | 28973/371472 [2:18:27<30:03:46,  3.16it/s]
  8%|▊         | 28974/371472 [2:18:27<28:59:54,  3.28it/s]
  8%|▊         | 28975/371472 [2:18:27<28:25:09,  3.35it/s]
  8%|▊         | 28976/371472 [2:18:27<29:46:47,  3.19it/s]
  8%|▊         | 28977/371472 [2:18:28<29:52:30,  3.18it/s]
  8%|▊         | 28978/371472 [2:18:28<28:58:27,  3.28it/s]
  8%|▊         | 28979/371472 [2:18:28<28:41:14,  3.32it/s]
  8%|▊         | 28980/371472 [2:18:29<29:01:43,  3.28it/s]
                                                           
{'loss': 4.2605, 'learning_rate': 9.302344372858713e-07, 'epoch': 1.25}

  8%|▊         | 28980/371472 [2:18:29<29:01:43,  3.28it/s]
  8%|▊         | 28981/371472 [2:18:29<27:46:48,  3.42it/s]
  8%|▊         | 28982/371472 [2:18:29<26:36:36,  3.58it/s]
  8%|▊         | 28983/371472 [2:18:29<26:43:13,  3.56it/s]
  8%|▊         | 28984/371472 [2:18:30<26:29:58,  3.59it/s]
  8%|▊         | 28985/371472 [2:18:30<26:03:21,  3.65it/s]
  8%|▊         | 28986/371472 [2:18:30<25:19:56,  3.76it/s]
  8%|▊         | 28987/371472 [2:18:31<26:54:55,  3.53it/s]
  8%|▊         | 28988/371472 [2:18:31<26:26:55,  3.60it/s]
  8%|▊         | 28989/371472 [2:18:31<27:04:10,  3.51it/s]
  8%|▊         | 28990/371472 [2:18:31<26:59:52,  3.52it/s]
  8%|▊         | 28991/371472 [2:18:32<26:04:44,  3.65it/s]
  8%|▊         | 28992/371472 [2:18:32<26:02:25,  3.65it/s]
  8%|▊         | 28993/371472 [2:18:32<27:13:27,  3.49it/s]
  8%|▊         | 28994/371472 [2:18:33<27:38:32,  3.44it/s]
  8%|▊         | 28995/371472 [2:18:33<26:21:23,  3.61it/s]
  8%|▊         | 28996/371472 [2:18:33<27:44:24,  3.43it/s]
  8%|▊         | 28997/371472 [2:18:33<26:57:35,  3.53it/s]
  8%|▊         | 28998/371472 [2:18:34<26:13:48,  3.63it/s]
  8%|▊         | 28999/371472 [2:18:34<25:22:02,  3.75it/s]
  8%|▊         | 29000/371472 [2:18:34<26:12:45,  3.63it/s]
                                                           
{'loss': 4.5794, 'learning_rate': 9.301859553103923e-07, 'epoch': 1.25}

  8%|▊         | 29000/371472 [2:18:34<26:12:45,  3.63it/s]
  8%|▊         | 29001/371472 [2:18:34<26:27:51,  3.59it/s]
  8%|▊         | 29002/371472 [2:18:35<27:18:45,  3.48it/s]
  8%|▊         | 29003/371472 [2:18:35<28:34:15,  3.33it/s]
  8%|▊         | 29004/371472 [2:18:35<28:15:48,  3.37it/s]
  8%|▊         | 29005/371472 [2:18:36<30:31:10,  3.12it/s]
  8%|▊         | 29006/371472 [2:18:36<30:24:54,  3.13it/s]
  8%|▊         | 29007/371472 [2:18:36<28:35:44,  3.33it/s]
  8%|▊         | 29008/371472 [2:18:37<28:19:35,  3.36it/s]
  8%|▊         | 29009/371472 [2:18:37<27:28:12,  3.46it/s]
  8%|▊         | 29010/371472 [2:18:37<27:45:31,  3.43it/s]
  8%|▊         | 29011/371472 [2:18:37<26:09:04,  3.64it/s]
  8%|▊         | 29012/371472 [2:18:38<25:41:50,  3.70it/s]
  8%|▊         | 29013/371472 [2:18:38<25:49:16,  3.68it/s]
  8%|▊         | 29014/371472 [2:18:38<27:11:33,  3.50it/s]
  8%|▊         | 29015/371472 [2:18:39<27:19:34,  3.48it/s]
  8%|▊         | 29016/371472 [2:18:39<26:09:31,  3.64it/s]
  8%|▊         | 29017/371472 [2:18:39<25:29:19,  3.73it/s]
  8%|▊         | 29018/371472 [2:18:39<25:47:10,  3.69it/s]
  8%|▊         | 29019/371472 [2:18:40<26:31:52,  3.59it/s]
  8%|▊         | 29020/371472 [2:18:40<26:23:44,  3.60it/s]
                                                           
{'loss': 4.3712, 'learning_rate': 9.301374733349134e-07, 'epoch': 1.25}

  8%|▊         | 29020/371472 [2:18:40<26:23:44,  3.60it/s]
  8%|▊         | 29021/371472 [2:18:40<27:56:41,  3.40it/s]
  8%|▊         | 29022/371472 [2:18:40<27:13:46,  3.49it/s]
  8%|▊         | 29023/371472 [2:18:41<28:07:05,  3.38it/s]
  8%|▊         | 29024/371472 [2:18:41<28:06:45,  3.38it/s]
  8%|▊         | 29025/371472 [2:18:41<28:16:35,  3.36it/s]
  8%|▊         | 29026/371472 [2:18:42<29:25:58,  3.23it/s]
  8%|▊         | 29027/371472 [2:18:42<31:26:41,  3.03it/s]
  8%|▊         | 29028/371472 [2:18:42<30:45:19,  3.09it/s]
  8%|▊         | 29029/371472 [2:18:43<30:12:13,  3.15it/s]
  8%|▊         | 29030/371472 [2:18:43<29:41:14,  3.20it/s]
  8%|▊         | 29031/371472 [2:18:43<29:37:29,  3.21it/s]
  8%|▊         | 29032/371472 [2:18:44<29:04:16,  3.27it/s]
  8%|▊         | 29033/371472 [2:18:44<28:23:54,  3.35it/s]
  8%|▊         | 29034/371472 [2:18:44<28:02:35,  3.39it/s]
  8%|▊         | 29035/371472 [2:18:44<27:29:48,  3.46it/s]
  8%|▊         | 29036/371472 [2:18:45<29:36:54,  3.21it/s]
  8%|▊         | 29037/371472 [2:18:45<28:17:36,  3.36it/s]
  8%|▊         | 29038/371472 [2:18:45<27:52:27,  3.41it/s]
  8%|▊         | 29039/371472 [2:18:46<27:31:01,  3.46it/s]
  8%|▊         | 29040/371472 [2:18:46<27:51:12,  3.42it/s]
                                                           
{'loss': 4.2, 'learning_rate': 9.300889913594345e-07, 'epoch': 1.25}

  8%|▊         | 29040/371472 [2:18:46<27:51:12,  3.42it/s]
  8%|▊         | 29041/371472 [2:18:46<26:52:05,  3.54it/s]
  8%|▊         | 29042/371472 [2:18:46<26:02:43,  3.65it/s]
  8%|▊         | 29043/371472 [2:18:47<24:53:40,  3.82it/s]
  8%|▊         | 29044/371472 [2:18:47<24:40:50,  3.85it/s]
  8%|▊         | 29045/371472 [2:18:47<26:35:50,  3.58it/s]
  8%|▊         | 29046/371472 [2:18:48<27:06:03,  3.51it/s]
  8%|▊         | 29047/371472 [2:18:48<27:13:50,  3.49it/s]
  8%|▊         | 29048/371472 [2:18:48<26:28:09,  3.59it/s]
  8%|▊         | 29049/371472 [2:18:48<26:44:41,  3.56it/s]
  8%|▊         | 29050/371472 [2:18:49<27:56:48,  3.40it/s]
  8%|▊         | 29051/371472 [2:18:49<28:03:25,  3.39it/s]
  8%|▊         | 29052/371472 [2:18:49<28:48:09,  3.30it/s]
  8%|▊         | 29053/371472 [2:18:50<27:55:42,  3.41it/s]
  8%|▊         | 29054/371472 [2:18:50<29:29:39,  3.22it/s]
  8%|▊         | 29055/371472 [2:18:50<28:48:32,  3.30it/s]
  8%|▊         | 29056/371472 [2:18:51<28:22:37,  3.35it/s]
  8%|▊         | 29057/371472 [2:18:51<26:44:01,  3.56it/s]
  8%|▊         | 29058/371472 [2:18:51<25:55:34,  3.67it/s]
  8%|▊         | 29059/371472 [2:18:51<29:03:43,  3.27it/s]
  8%|▊         | 29060/371472 [2:18:52<31:05:14,  3.06it/s]
                                                           
{'loss': 4.3306, 'learning_rate': 9.300405093839557e-07, 'epoch': 1.25}

  8%|▊         | 29060/371472 [2:18:52<31:05:14,  3.06it/s]
  8%|▊         | 29061/371472 [2:18:52<29:31:33,  3.22it/s]
  8%|▊         | 29062/371472 [2:18:52<29:09:51,  3.26it/s]
  8%|▊         | 29063/371472 [2:18:53<27:47:31,  3.42it/s]
  8%|▊         | 29064/371472 [2:18:53<27:02:12,  3.52it/s]
  8%|▊         | 29065/371472 [2:18:53<29:07:39,  3.27it/s]
  8%|▊         | 29066/371472 [2:18:54<30:15:39,  3.14it/s]
  8%|▊         | 29067/371472 [2:18:54<29:08:23,  3.26it/s]
  8%|▊         | 29068/371472 [2:18:54<29:05:56,  3.27it/s]
  8%|▊         | 29069/371472 [2:18:54<28:02:55,  3.39it/s]
  8%|▊         | 29070/371472 [2:18:55<26:59:41,  3.52it/s]
  8%|▊         | 29071/371472 [2:18:55<26:32:54,  3.58it/s]
  8%|▊         | 29072/371472 [2:18:55<27:06:25,  3.51it/s]
  8%|▊         | 29073/371472 [2:18:56<26:44:32,  3.56it/s]
  8%|▊         | 29074/371472 [2:18:56<26:08:31,  3.64it/s]
  8%|▊         | 29075/371472 [2:18:56<25:40:52,  3.70it/s]
  8%|▊         | 29076/371472 [2:18:56<25:21:43,  3.75it/s]
  8%|▊         | 29077/371472 [2:18:57<26:57:35,  3.53it/s]
  8%|▊         | 29078/371472 [2:18:57<26:18:28,  3.62it/s]
  8%|▊         | 29079/371472 [2:18:57<27:25:03,  3.47it/s]
  8%|▊         | 29080/371472 [2:18:58<27:34:40,  3.45it/s]
                                                           
{'loss': 4.4159, 'learning_rate': 9.299920274084767e-07, 'epoch': 1.25}

  8%|▊         | 29080/371472 [2:18:58<27:34:40,  3.45it/s]
  8%|▊         | 29081/371472 [2:18:58<28:43:52,  3.31it/s]
  8%|▊         | 29082/371472 [2:18:58<27:53:19,  3.41it/s]
  8%|▊         | 29083/371472 [2:18:58<27:18:51,  3.48it/s]
  8%|▊         | 29084/371472 [2:18:59<26:21:24,  3.61it/s]
  8%|▊         | 29085/371472 [2:18:59<25:22:56,  3.75it/s]
  8%|▊         | 29086/371472 [2:18:59<26:09:09,  3.64it/s]
  8%|▊         | 29087/371472 [2:19:00<27:36:56,  3.44it/s]
  8%|▊         | 29088/371472 [2:19:00<26:49:52,  3.54it/s]
  8%|▊         | 29089/371472 [2:19:00<25:57:59,  3.66it/s]
  8%|▊         | 29090/371472 [2:19:00<25:19:47,  3.75it/s]
  8%|▊         | 29091/371472 [2:19:01<26:35:34,  3.58it/s]
  8%|▊         | 29092/371472 [2:19:01<25:54:47,  3.67it/s]
  8%|▊         | 29093/371472 [2:19:01<26:46:36,  3.55it/s]
  8%|▊         | 29094/371472 [2:19:01<26:59:55,  3.52it/s]
  8%|▊         | 29095/371472 [2:19:02<27:05:27,  3.51it/s]
  8%|▊         | 29096/371472 [2:19:02<26:10:49,  3.63it/s]
  8%|▊         | 29097/371472 [2:19:02<25:52:04,  3.68it/s]
  8%|▊         | 29098/371472 [2:19:03<27:10:09,  3.50it/s]
  8%|▊         | 29099/371472 [2:19:03<28:10:27,  3.38it/s]
  8%|▊         | 29100/371472 [2:19:03<28:39:48,  3.32it/s]
                                                           
{'loss': 4.5091, 'learning_rate': 9.299435454329979e-07, 'epoch': 1.25}

  8%|▊         | 29100/371472 [2:19:03<28:39:48,  3.32it/s]
  8%|▊         | 29101/371472 [2:19:03<27:40:40,  3.44it/s]
  8%|▊         | 29102/371472 [2:19:04<27:58:13,  3.40it/s]
  8%|▊         | 29103/371472 [2:19:04<31:25:35,  3.03it/s]
  8%|▊         | 29104/371472 [2:19:04<29:25:35,  3.23it/s]
  8%|▊         | 29105/371472 [2:19:05<30:08:54,  3.15it/s]
  8%|▊         | 29106/371472 [2:19:05<29:09:37,  3.26it/s]
  8%|▊         | 29107/371472 [2:19:05<27:37:55,  3.44it/s]
  8%|▊         | 29108/371472 [2:19:06<26:13:25,  3.63it/s]
  8%|▊         | 29109/371472 [2:19:06<25:34:12,  3.72it/s]
  8%|▊         | 29110/371472 [2:19:06<26:00:05,  3.66it/s]
  8%|▊         | 29111/371472 [2:19:06<25:54:04,  3.67it/s]
  8%|▊         | 29112/371472 [2:19:07<25:10:53,  3.78it/s]
  8%|▊         | 29113/371472 [2:19:07<26:26:53,  3.60it/s]
  8%|▊         | 29114/371472 [2:19:07<26:32:08,  3.58it/s]
  8%|▊         | 29115/371472 [2:19:08<26:47:06,  3.55it/s]
  8%|▊         | 29116/371472 [2:19:08<25:51:26,  3.68it/s]
  8%|▊         | 29117/371472 [2:19:08<25:47:18,  3.69it/s]
  8%|▊         | 29118/371472 [2:19:08<26:30:47,  3.59it/s]
  8%|▊         | 29119/371472 [2:19:09<28:02:55,  3.39it/s]
  8%|▊         | 29120/371472 [2:19:09<31:32:46,  3.01it/s]
                                                           
{'loss': 4.2013, 'learning_rate': 9.29895063457519e-07, 'epoch': 1.25}

  8%|▊         | 29120/371472 [2:19:09<31:32:46,  3.01it/s]
  8%|▊         | 29121/371472 [2:19:09<30:35:25,  3.11it/s]
  8%|▊         | 29122/371472 [2:19:10<29:33:12,  3.22it/s]
  8%|▊         | 29123/371472 [2:19:10<29:36:39,  3.21it/s]
  8%|▊         | 29124/371472 [2:19:10<28:57:03,  3.28it/s]
  8%|▊         | 29125/371472 [2:19:11<29:58:05,  3.17it/s]
  8%|▊         | 29126/371472 [2:19:11<31:06:08,  3.06it/s]
  8%|▊         | 29127/371472 [2:19:11<30:16:38,  3.14it/s]
  8%|▊         | 29128/371472 [2:19:12<28:59:00,  3.28it/s]
  8%|▊         | 29129/371472 [2:19:12<28:08:22,  3.38it/s]
  8%|▊         | 29130/371472 [2:19:12<28:57:13,  3.28it/s]
  8%|▊         | 29131/371472 [2:19:12<28:02:08,  3.39it/s]
  8%|▊         | 29132/371472 [2:19:13<26:59:16,  3.52it/s]
  8%|▊         | 29133/371472 [2:19:13<28:26:14,  3.34it/s]
  8%|▊         | 29134/371472 [2:19:13<26:51:32,  3.54it/s]
  8%|▊         | 29135/371472 [2:19:14<26:38:22,  3.57it/s]
  8%|▊         | 29136/371472 [2:19:14<26:00:24,  3.66it/s]
  8%|▊         | 29137/371472 [2:19:14<27:01:29,  3.52it/s]
  8%|▊         | 29138/371472 [2:19:14<26:21:27,  3.61it/s]
  8%|▊         | 29139/371472 [2:19:15<26:04:28,  3.65it/s]
  8%|▊         | 29140/371472 [2:19:15<25:28:34,  3.73it/s]
                                                           
{'loss': 4.3171, 'learning_rate': 9.298465814820402e-07, 'epoch': 1.26}

  8%|▊         | 29140/371472 [2:19:15<25:28:34,  3.73it/s]
  8%|▊         | 29141/371472 [2:19:15<24:48:57,  3.83it/s]
  8%|▊         | 29142/371472 [2:19:15<25:09:06,  3.78it/s]
  8%|▊         | 29143/371472 [2:19:16<25:40:43,  3.70it/s]
  8%|▊         | 29144/371472 [2:19:16<25:08:35,  3.78it/s]
  8%|▊         | 29145/371472 [2:19:16<25:18:20,  3.76it/s]
  8%|▊         | 29146/371472 [2:19:16<26:21:31,  3.61it/s]
  8%|▊         | 29147/371472 [2:19:17<26:00:38,  3.66it/s]
  8%|▊         | 29148/371472 [2:19:17<25:37:42,  3.71it/s]
  8%|▊         | 29149/371472 [2:19:17<25:25:20,  3.74it/s]
  8%|▊         | 29150/371472 [2:19:18<27:02:36,  3.52it/s]
  8%|▊         | 29151/371472 [2:19:18<28:00:49,  3.39it/s]
  8%|▊         | 29152/371472 [2:19:18<29:31:33,  3.22it/s]
  8%|▊         | 29153/371472 [2:19:18<27:31:54,  3.45it/s]
  8%|▊         | 29154/371472 [2:19:19<27:22:40,  3.47it/s]
  8%|▊         | 29155/371472 [2:19:19<26:22:50,  3.60it/s]
  8%|▊         | 29156/371472 [2:19:19<27:28:06,  3.46it/s]
  8%|▊         | 29157/371472 [2:19:20<26:39:17,  3.57it/s]
  8%|▊         | 29158/371472 [2:19:20<26:49:54,  3.54it/s]
  8%|▊         | 29159/371472 [2:19:20<29:16:31,  3.25it/s]
  8%|▊         | 29160/371472 [2:19:21<27:47:40,  3.42it/s]
                                                           
{'loss': 4.5649, 'learning_rate': 9.297980995065611e-07, 'epoch': 1.26}

  8%|▊         | 29160/371472 [2:19:21<27:47:40,  3.42it/s]
  8%|▊         | 29161/371472 [2:19:21<26:57:03,  3.53it/s]
  8%|▊         | 29162/371472 [2:19:21<26:17:25,  3.62it/s]
  8%|▊         | 29163/371472 [2:19:21<25:37:44,  3.71it/s]
  8%|▊         | 29164/371472 [2:19:22<27:21:38,  3.48it/s]
  8%|▊         | 29165/371472 [2:19:22<27:16:38,  3.49it/s]
  8%|▊         | 29166/371472 [2:19:22<27:07:48,  3.50it/s]
  8%|▊         | 29167/371472 [2:19:22<26:40:28,  3.56it/s]
  8%|▊         | 29168/371472 [2:19:23<26:25:49,  3.60it/s]
  8%|▊         | 29169/371472 [2:19:23<25:45:09,  3.69it/s]
  8%|▊         | 29170/371472 [2:19:23<24:51:26,  3.83it/s]
  8%|▊         | 29171/371472 [2:19:23<25:05:04,  3.79it/s]
  8%|▊         | 29172/371472 [2:19:24<27:19:56,  3.48it/s]
  8%|▊         | 29173/371472 [2:19:24<27:08:09,  3.50it/s]
  8%|▊         | 29174/371472 [2:19:24<26:31:36,  3.58it/s]
  8%|▊         | 29175/371472 [2:19:25<26:29:19,  3.59it/s]
  8%|▊         | 29176/371472 [2:19:25<26:03:51,  3.65it/s]
  8%|▊         | 29177/371472 [2:19:25<25:17:30,  3.76it/s]
  8%|▊         | 29178/371472 [2:19:25<26:02:05,  3.65it/s]
  8%|▊         | 29179/371472 [2:19:26<24:55:42,  3.81it/s]
  8%|▊         | 29180/371472 [2:19:26<25:00:48,  3.80it/s]
                                                           
{'loss': 5.0627, 'learning_rate': 9.297496175310823e-07, 'epoch': 1.26}

  8%|▊         | 29180/371472 [2:19:26<25:00:48,  3.80it/s]
  8%|▊         | 29181/371472 [2:19:26<25:20:11,  3.75it/s]
  8%|▊         | 29182/371472 [2:19:27<26:02:37,  3.65it/s]
  8%|▊         | 29183/371472 [2:19:27<27:31:23,  3.45it/s]
  8%|▊         | 29184/371472 [2:19:27<26:34:59,  3.58it/s]
  8%|▊         | 29185/371472 [2:19:27<27:26:05,  3.47it/s]
  8%|▊         | 29186/371472 [2:19:28<26:26:25,  3.60it/s]
  8%|▊         | 29187/371472 [2:19:28<26:07:24,  3.64it/s]
  8%|▊         | 29188/371472 [2:19:28<26:14:35,  3.62it/s]
  8%|▊         | 29189/371472 [2:19:29<26:46:02,  3.55it/s]
  8%|▊         | 29190/371472 [2:19:29<28:29:24,  3.34it/s]
  8%|▊         | 29191/371472 [2:19:29<28:05:28,  3.38it/s]
  8%|▊         | 29192/371472 [2:19:29<28:59:48,  3.28it/s]
  8%|▊         | 29193/371472 [2:19:30<29:57:00,  3.17it/s]
  8%|▊         | 29194/371472 [2:19:30<28:32:24,  3.33it/s]
  8%|▊         | 29195/371472 [2:19:30<31:36:01,  3.01it/s]
  8%|▊         | 29196/371472 [2:19:31<29:27:27,  3.23it/s]
  8%|▊         | 29197/371472 [2:19:31<28:27:33,  3.34it/s]
  8%|▊         | 29198/371472 [2:19:31<30:42:33,  3.10it/s]
  8%|▊         | 29199/371472 [2:19:32<34:25:55,  2.76it/s]
  8%|▊         | 29200/371472 [2:19:32<31:15:18,  3.04it/s]
                                                           
{'loss': 7.4767, 'learning_rate': 9.297011355556034e-07, 'epoch': 1.26}

  8%|▊         | 29200/371472 [2:19:32<31:15:18,  3.04it/s]
  8%|▊         | 29201/371472 [2:19:32<30:12:50,  3.15it/s]
  8%|▊         | 29202/371472 [2:19:33<31:28:05,  3.02it/s]
  8%|▊         | 29203/371472 [2:19:33<30:24:51,  3.13it/s]
  8%|▊         | 29204/371472 [2:19:33<28:38:01,  3.32it/s]
  8%|▊         | 29205/371472 [2:19:34<26:57:41,  3.53it/s]
  8%|▊         | 29206/371472 [2:19:34<25:39:30,  3.71it/s]
  8%|▊         | 29207/371472 [2:19:34<26:33:01,  3.58it/s]
  8%|▊         | 29208/371472 [2:19:34<26:48:19,  3.55it/s]
  8%|▊         | 29209/371472 [2:19:35<29:26:13,  3.23it/s]
  8%|▊         | 29210/371472 [2:19:35<28:05:48,  3.38it/s]
  8%|▊         | 29211/371472 [2:19:35<27:43:21,  3.43it/s]
  8%|▊         | 29212/371472 [2:19:36<26:38:12,  3.57it/s]
  8%|▊         | 29213/371472 [2:19:36<26:00:38,  3.66it/s]
  8%|▊         | 29214/371472 [2:19:36<27:45:53,  3.42it/s]
  8%|▊         | 29215/371472 [2:19:37<31:16:51,  3.04it/s]
  8%|▊         | 29216/371472 [2:19:37<30:50:22,  3.08it/s]
  8%|▊         | 29217/371472 [2:19:37<28:53:00,  3.29it/s]
  8%|▊         | 29218/371472 [2:19:37<27:22:57,  3.47it/s]
  8%|▊         | 29219/371472 [2:19:38<26:27:21,  3.59it/s]
  8%|▊         | 29220/371472 [2:19:38<26:05:33,  3.64it/s]
                                                           
{'loss': 9.1112, 'learning_rate': 9.296526535801246e-07, 'epoch': 1.26}

  8%|▊         | 29220/371472 [2:19:38<26:05:33,  3.64it/s]
  8%|▊         | 29221/371472 [2:19:38<26:22:12,  3.61it/s]
  8%|▊         | 29222/371472 [2:19:38<27:34:26,  3.45it/s]
  8%|▊         | 29223/371472 [2:19:39<27:15:16,  3.49it/s]
  8%|▊         | 29224/371472 [2:19:39<27:10:41,  3.50it/s]
  8%|▊         | 29225/371472 [2:19:39<27:02:12,  3.52it/s]
  8%|▊         | 29226/371472 [2:19:40<28:10:12,  3.37it/s]
  8%|▊         | 29227/371472 [2:19:40<26:54:56,  3.53it/s]
  8%|▊         | 29228/371472 [2:19:40<27:27:48,  3.46it/s]
  8%|▊         | 29229/371472 [2:19:40<26:34:49,  3.58it/s]
  8%|▊         | 29230/371472 [2:19:41<26:08:30,  3.64it/s]
  8%|▊         | 29231/371472 [2:19:41<26:39:00,  3.57it/s]
  8%|▊         | 29232/371472 [2:19:41<26:33:03,  3.58it/s]
  8%|▊         | 29233/371472 [2:19:42<27:29:33,  3.46it/s]
  8%|▊         | 29234/371472 [2:19:42<28:30:33,  3.33it/s]
  8%|▊         | 29235/371472 [2:19:42<27:54:58,  3.41it/s]
  8%|▊         | 29236/371472 [2:19:43<27:35:40,  3.45it/s]
  8%|▊         | 29237/371472 [2:19:43<26:56:06,  3.53it/s]
  8%|▊         | 29238/371472 [2:19:43<28:09:09,  3.38it/s]
  8%|▊         | 29239/371472 [2:19:43<27:16:01,  3.49it/s]
  8%|▊         | 29240/371472 [2:19:44<26:21:24,  3.61it/s]
                                                           
{'loss': 9.0257, 'learning_rate': 9.296041716046456e-07, 'epoch': 1.26}

  8%|▊         | 29240/371472 [2:19:44<26:21:24,  3.61it/s]
  8%|▊         | 29241/371472 [2:19:44<29:31:16,  3.22it/s]
  8%|▊         | 29242/371472 [2:19:44<28:38:55,  3.32it/s]
  8%|▊         | 29243/371472 [2:19:45<28:06:50,  3.38it/s]
  8%|▊         | 29244/371472 [2:19:45<27:05:44,  3.51it/s]
  8%|▊         | 29245/371472 [2:19:45<26:11:51,  3.63it/s]
  8%|▊         | 29246/371472 [2:19:45<26:08:32,  3.64it/s]
  8%|▊         | 29247/371472 [2:19:46<26:03:05,  3.65it/s]
  8%|▊         | 29248/371472 [2:19:46<25:26:05,  3.74it/s]
  8%|▊         | 29249/371472 [2:19:46<25:44:47,  3.69it/s]
  8%|▊         | 29250/371472 [2:19:46<25:45:10,  3.69it/s]
  8%|▊         | 29251/371472 [2:19:47<26:07:29,  3.64it/s]
  8%|▊         | 29252/371472 [2:19:47<27:10:04,  3.50it/s]
  8%|▊         | 29253/371472 [2:19:47<27:04:19,  3.51it/s]
  8%|▊         | 29254/371472 [2:19:48<27:16:49,  3.48it/s]
  8%|▊         | 29255/371472 [2:19:48<26:55:20,  3.53it/s]
  8%|▊         | 29256/371472 [2:19:48<27:21:05,  3.48it/s]
  8%|▊         | 29257/371472 [2:19:48<26:27:49,  3.59it/s]
  8%|▊         | 29258/371472 [2:19:49<26:55:27,  3.53it/s]
  8%|▊         | 29259/371472 [2:19:49<28:36:55,  3.32it/s]
  8%|▊         | 29260/371472 [2:19:49<28:09:05,  3.38it/s]
                                                           
{'loss': 8.9185, 'learning_rate': 9.295556896291667e-07, 'epoch': 1.26}

  8%|▊         | 29260/371472 [2:19:49<28:09:05,  3.38it/s]
  8%|▊         | 29261/371472 [2:19:50<27:12:40,  3.49it/s]
  8%|▊         | 29262/371472 [2:19:50<26:24:42,  3.60it/s]
  8%|▊         | 29263/371472 [2:19:50<25:49:09,  3.68it/s]
  8%|▊         | 29264/371472 [2:19:50<26:25:59,  3.60it/s]
  8%|▊         | 29265/371472 [2:19:51<26:38:30,  3.57it/s]
  8%|▊         | 29266/371472 [2:19:51<28:32:31,  3.33it/s]
  8%|▊         | 29267/371472 [2:19:51<27:22:22,  3.47it/s]
  8%|▊         | 29268/371472 [2:19:52<26:45:57,  3.55it/s]
  8%|▊         | 29269/371472 [2:19:52<27:11:59,  3.49it/s]
  8%|▊         | 29270/371472 [2:19:52<27:38:15,  3.44it/s]
  8%|▊         | 29271/371472 [2:19:52<27:16:14,  3.49it/s]
  8%|▊         | 29272/371472 [2:19:53<26:38:53,  3.57it/s]
  8%|▊         | 29273/371472 [2:19:53<29:21:26,  3.24it/s]
  8%|▊         | 29274/371472 [2:19:53<29:48:05,  3.19it/s]
  8%|▊         | 29275/371472 [2:19:54<29:11:47,  3.26it/s]
  8%|▊         | 29276/371472 [2:19:54<27:56:06,  3.40it/s]
  8%|▊         | 29277/371472 [2:19:54<27:24:31,  3.47it/s]
  8%|▊         | 29278/371472 [2:19:55<28:35:51,  3.32it/s]
  8%|▊         | 29279/371472 [2:19:55<27:21:08,  3.48it/s]
  8%|▊         | 29280/371472 [2:19:55<26:52:59,  3.54it/s]
                                                           
{'loss': 9.0897, 'learning_rate': 9.295072076536878e-07, 'epoch': 1.26}

  8%|▊         | 29280/371472 [2:19:55<26:52:59,  3.54it/s]
  8%|▊         | 29281/371472 [2:19:55<26:27:15,  3.59it/s]
  8%|▊         | 29282/371472 [2:19:56<26:14:49,  3.62it/s]
  8%|▊         | 29283/371472 [2:19:56<26:22:07,  3.60it/s]
  8%|▊         | 29284/371472 [2:19:56<25:20:27,  3.75it/s]
  8%|▊         | 29285/371472 [2:19:56<26:45:39,  3.55it/s]
  8%|▊         | 29286/371472 [2:19:57<26:52:43,  3.54it/s]
  8%|▊         | 29287/371472 [2:19:57<27:21:18,  3.47it/s]
  8%|▊         | 29288/371472 [2:19:57<27:46:24,  3.42it/s]
  8%|▊         | 29289/371472 [2:19:58<27:44:23,  3.43it/s]
  8%|▊         | 29290/371472 [2:19:58<26:45:44,  3.55it/s]
  8%|▊         | 29291/371472 [2:19:58<27:44:12,  3.43it/s]
  8%|▊         | 29292/371472 [2:19:59<28:07:41,  3.38it/s]
  8%|▊         | 29293/371472 [2:19:59<28:35:31,  3.32it/s]
  8%|▊         | 29294/371472 [2:19:59<29:15:02,  3.25it/s]
  8%|▊         | 29295/371472 [2:19:59<29:11:23,  3.26it/s]
  8%|▊         | 29296/371472 [2:20:00<27:46:10,  3.42it/s]
  8%|▊         | 29297/371472 [2:20:00<26:57:02,  3.53it/s]
  8%|▊         | 29298/371472 [2:20:00<26:24:26,  3.60it/s]
  8%|▊         | 29299/371472 [2:20:01<25:39:47,  3.70it/s]
  8%|▊         | 29300/371472 [2:20:01<25:43:27,  3.69it/s]
                                                           
{'loss': 8.6666, 'learning_rate': 9.29458725678209e-07, 'epoch': 1.26}

  8%|▊         | 29300/371472 [2:20:01<25:43:27,  3.69it/s]
  8%|▊         | 29301/371472 [2:20:01<27:08:58,  3.50it/s]
  8%|▊         | 29302/371472 [2:20:01<28:26:34,  3.34it/s]
  8%|▊         | 29303/371472 [2:20:02<28:52:48,  3.29it/s]
  8%|▊         | 29304/371472 [2:20:02<29:16:13,  3.25it/s]
  8%|▊         | 29305/371472 [2:20:02<28:17:32,  3.36it/s]
  8%|▊         | 29306/371472 [2:20:03<27:44:08,  3.43it/s]
  8%|▊         | 29307/371472 [2:20:03<26:57:25,  3.53it/s]
  8%|▊         | 29308/371472 [2:20:03<26:30:05,  3.59it/s]
  8%|▊         | 29309/371472 [2:20:03<25:28:03,  3.73it/s]
  8%|▊         | 29310/371472 [2:20:04<25:40:44,  3.70it/s]
  8%|▊         | 29311/371472 [2:20:04<26:29:25,  3.59it/s]
  8%|▊         | 29312/371472 [2:20:04<29:09:43,  3.26it/s]
  8%|▊         | 29313/371472 [2:20:05<28:44:06,  3.31it/s]
  8%|▊         | 29314/371472 [2:20:05<27:48:23,  3.42it/s]
  8%|▊         | 29315/371472 [2:20:05<29:24:16,  3.23it/s]
  8%|▊         | 29316/371472 [2:20:06<28:44:49,  3.31it/s]
  8%|▊         | 29317/371472 [2:20:06<28:45:33,  3.30it/s]
  8%|▊         | 29318/371472 [2:20:06<27:34:08,  3.45it/s]
  8%|▊         | 29319/371472 [2:20:06<27:14:28,  3.49it/s]
  8%|▊         | 29320/371472 [2:20:07<25:57:11,  3.66it/s]
                                                           
{'loss': 8.6319, 'learning_rate': 9.2941024370273e-07, 'epoch': 1.26}

  8%|▊         | 29320/371472 [2:20:07<25:57:11,  3.66it/s]
  8%|▊         | 29321/371472 [2:20:07<26:07:56,  3.64it/s]
  8%|▊         | 29322/371472 [2:20:07<25:43:31,  3.69it/s]
  8%|▊         | 29323/371472 [2:20:07<25:25:44,  3.74it/s]
  8%|▊         | 29324/371472 [2:20:08<25:05:31,  3.79it/s]
  8%|▊         | 29325/371472 [2:20:08<25:41:23,  3.70it/s]
  8%|▊         | 29326/371472 [2:20:08<26:39:48,  3.56it/s]
  8%|▊         | 29327/371472 [2:20:09<26:21:33,  3.61it/s]
  8%|▊         | 29328/371472 [2:20:09<26:29:40,  3.59it/s]
  8%|▊         | 29329/371472 [2:20:09<27:02:26,  3.51it/s]
  8%|▊         | 29330/371472 [2:20:09<26:01:25,  3.65it/s]
  8%|▊         | 29331/371472 [2:20:10<27:29:38,  3.46it/s]
  8%|▊         | 29332/371472 [2:20:10<26:54:21,  3.53it/s]
  8%|▊         | 29333/371472 [2:20:10<26:31:57,  3.58it/s]
  8%|▊         | 29334/371472 [2:20:11<26:17:37,  3.61it/s]
  8%|▊         | 29335/371472 [2:20:11<27:17:10,  3.48it/s]
  8%|▊         | 29336/371472 [2:20:11<26:25:42,  3.60it/s]
  8%|▊         | 29337/371472 [2:20:11<26:25:37,  3.60it/s]
  8%|▊         | 29338/371472 [2:20:12<26:33:29,  3.58it/s]
  8%|▊         | 29339/371472 [2:20:12<25:53:00,  3.67it/s]
  8%|▊         | 29340/371472 [2:20:12<26:22:30,  3.60it/s]
                                                           
{'loss': 8.7006, 'learning_rate': 9.293617617272511e-07, 'epoch': 1.26}

  8%|▊         | 29340/371472 [2:20:12<26:22:30,  3.60it/s]
  8%|▊         | 29341/371472 [2:20:12<26:40:34,  3.56it/s]
  8%|▊         | 29342/371472 [2:20:13<28:13:13,  3.37it/s]
  8%|▊         | 29343/371472 [2:20:13<26:49:10,  3.54it/s]
  8%|▊         | 29344/371472 [2:20:13<27:39:25,  3.44it/s]
  8%|▊         | 29345/371472 [2:20:14<27:56:13,  3.40it/s]
  8%|▊         | 29346/371472 [2:20:14<27:37:14,  3.44it/s]
  8%|▊         | 29347/371472 [2:20:14<27:20:23,  3.48it/s]
  8%|▊         | 29348/371472 [2:20:15<27:07:04,  3.50it/s]
  8%|▊         | 29349/371472 [2:20:15<28:46:51,  3.30it/s]
  8%|▊         | 29350/371472 [2:20:15<28:18:52,  3.36it/s]
  8%|▊         | 29351/371472 [2:20:15<27:06:19,  3.51it/s]
  8%|▊         | 29352/371472 [2:20:16<27:07:44,  3.50it/s]
  8%|▊         | 29353/371472 [2:20:16<26:09:51,  3.63it/s]
  8%|▊         | 29354/371472 [2:20:16<26:45:00,  3.55it/s]
  8%|▊         | 29355/371472 [2:20:17<26:53:29,  3.53it/s]
  8%|▊         | 29356/371472 [2:20:17<26:39:22,  3.57it/s]
  8%|▊         | 29357/371472 [2:20:17<26:10:36,  3.63it/s]
  8%|▊         | 29358/371472 [2:20:17<25:45:57,  3.69it/s]
  8%|▊         | 29359/371472 [2:20:18<25:23:05,  3.74it/s]
  8%|▊         | 29360/371472 [2:20:18<26:05:43,  3.64it/s]
                                                           
{'loss': 8.5091, 'learning_rate': 9.293132797517723e-07, 'epoch': 1.26}

  8%|▊         | 29360/371472 [2:20:18<26:05:43,  3.64it/s]
  8%|▊         | 29361/371472 [2:20:18<27:16:13,  3.48it/s]
  8%|▊         | 29362/371472 [2:20:18<26:12:23,  3.63it/s]
  8%|▊         | 29363/371472 [2:20:19<25:40:06,  3.70it/s]
  8%|▊         | 29364/371472 [2:20:19<27:23:55,  3.47it/s]
  8%|▊         | 29365/371472 [2:20:19<29:06:42,  3.26it/s]
  8%|▊         | 29366/371472 [2:20:20<27:45:03,  3.42it/s]
  8%|▊         | 29367/371472 [2:20:20<27:45:44,  3.42it/s]
  8%|▊         | 29368/371472 [2:20:20<26:31:58,  3.58it/s]
  8%|▊         | 29369/371472 [2:20:21<27:47:29,  3.42it/s]
  8%|▊         | 29370/371472 [2:20:21<29:05:11,  3.27it/s]
  8%|▊         | 29371/371472 [2:20:21<27:36:26,  3.44it/s]
  8%|▊         | 29372/371472 [2:20:21<26:39:02,  3.57it/s]
  8%|▊         | 29373/371472 [2:20:22<27:38:28,  3.44it/s]
  8%|▊         | 29374/371472 [2:20:22<27:48:23,  3.42it/s]
  8%|▊         | 29375/371472 [2:20:22<27:27:39,  3.46it/s]
  8%|▊         | 29376/371472 [2:20:23<26:49:39,  3.54it/s]
  8%|▊         | 29377/371472 [2:20:23<29:08:38,  3.26it/s]
  8%|▊         | 29378/371472 [2:20:23<28:44:58,  3.31it/s]
  8%|▊         | 29379/371472 [2:20:23<28:31:23,  3.33it/s]
  8%|▊         | 29380/371472 [2:20:24<27:28:13,  3.46it/s]
                                                           
{'loss': 8.6262, 'learning_rate': 9.292647977762933e-07, 'epoch': 1.27}

  8%|▊         | 29380/371472 [2:20:24<27:28:13,  3.46it/s]
  8%|▊         | 29381/371472 [2:20:24<26:09:55,  3.63it/s]
  8%|▊         | 29382/371472 [2:20:24<25:51:49,  3.67it/s]
  8%|▊         | 29383/371472 [2:20:25<26:39:14,  3.57it/s]
  8%|▊         | 29384/371472 [2:20:25<26:44:47,  3.55it/s]
  8%|▊         | 29385/371472 [2:20:25<25:51:32,  3.67it/s]
  8%|▊         | 29386/371472 [2:20:25<26:17:53,  3.61it/s]
  8%|▊         | 29387/371472 [2:20:26<26:38:43,  3.57it/s]
  8%|▊         | 29388/371472 [2:20:26<26:30:00,  3.59it/s]
  8%|▊         | 29389/371472 [2:20:26<26:44:51,  3.55it/s]
  8%|▊         | 29390/371472 [2:20:27<27:24:06,  3.47it/s]
  8%|▊         | 29391/371472 [2:20:27<30:21:13,  3.13it/s]
  8%|▊         | 29392/371472 [2:20:27<30:12:04,  3.15it/s]
  8%|▊         | 29393/371472 [2:20:27<29:08:22,  3.26it/s]
  8%|▊         | 29394/371472 [2:20:28<28:32:50,  3.33it/s]
  8%|▊         | 29395/371472 [2:20:28<28:45:12,  3.30it/s]
  8%|▊         | 29396/371472 [2:20:28<27:29:35,  3.46it/s]
  8%|▊         | 29397/371472 [2:20:29<27:24:41,  3.47it/s]
  8%|▊         | 29398/371472 [2:20:29<26:33:43,  3.58it/s]
  8%|▊         | 29399/371472 [2:20:29<25:47:50,  3.68it/s]
  8%|▊         | 29400/371472 [2:20:29<26:12:24,  3.63it/s]
                                                           
{'loss': 8.5565, 'learning_rate': 9.292163158008144e-07, 'epoch': 1.27}

  8%|▊         | 29400/371472 [2:20:29<26:12:24,  3.63it/s]
  8%|▊         | 29401/371472 [2:20:30<26:59:04,  3.52it/s]
  8%|▊         | 29402/371472 [2:20:30<26:25:07,  3.60it/s]
  8%|▊         | 29403/371472 [2:20:30<26:36:18,  3.57it/s]
  8%|▊         | 29404/371472 [2:20:31<26:44:59,  3.55it/s]
  8%|▊         | 29405/371472 [2:20:31<27:52:48,  3.41it/s]
  8%|▊         | 29406/371472 [2:20:31<27:10:41,  3.50it/s]
  8%|▊         | 29407/371472 [2:20:31<28:00:04,  3.39it/s]
  8%|▊         | 29408/371472 [2:20:32<26:44:43,  3.55it/s]
  8%|▊         | 29409/371472 [2:20:32<26:28:32,  3.59it/s]
  8%|▊         | 29410/371472 [2:20:32<26:39:44,  3.56it/s]
  8%|▊         | 29411/371472 [2:20:33<25:41:33,  3.70it/s]
  8%|▊         | 29412/371472 [2:20:33<27:16:09,  3.48it/s]
  8%|▊         | 29413/371472 [2:20:33<27:06:16,  3.51it/s]
  8%|▊         | 29414/371472 [2:20:33<26:23:46,  3.60it/s]
  8%|▊         | 29415/371472 [2:20:34<26:28:29,  3.59it/s]
  8%|▊         | 29416/371472 [2:20:34<25:19:53,  3.75it/s]
  8%|▊         | 29417/371472 [2:20:34<25:20:27,  3.75it/s]
  8%|▊         | 29418/371472 [2:20:34<26:04:26,  3.64it/s]
  8%|▊         | 29419/371472 [2:20:35<25:35:16,  3.71it/s]
  8%|▊         | 29420/371472 [2:20:35<28:26:01,  3.34it/s]
                                                           
{'loss': 8.1368, 'learning_rate': 9.291678338253355e-07, 'epoch': 1.27}

  8%|▊         | 29420/371472 [2:20:35<28:26:01,  3.34it/s]
  8%|▊         | 29421/371472 [2:20:35<27:51:37,  3.41it/s]
  8%|▊         | 29422/371472 [2:20:36<28:28:27,  3.34it/s]
  8%|▊         | 29423/371472 [2:20:36<26:59:16,  3.52it/s]
  8%|▊         | 29424/371472 [2:20:36<27:54:55,  3.40it/s]
  8%|▊         | 29425/371472 [2:20:37<27:17:20,  3.48it/s]
  8%|▊         | 29426/371472 [2:20:37<25:45:41,  3.69it/s]
  8%|▊         | 29427/371472 [2:20:37<25:31:36,  3.72it/s]
  8%|▊         | 29428/371472 [2:20:37<25:23:46,  3.74it/s]
  8%|▊         | 29429/371472 [2:20:38<24:52:15,  3.82it/s]
  8%|▊         | 29430/371472 [2:20:38<24:54:05,  3.82it/s]
  8%|▊         | 29431/371472 [2:20:38<27:55:31,  3.40it/s]
  8%|▊         | 29432/371472 [2:20:38<26:56:17,  3.53it/s]
  8%|▊         | 29433/371472 [2:20:39<26:02:39,  3.65it/s]
  8%|▊         | 29434/371472 [2:20:39<26:37:07,  3.57it/s]
  8%|▊         | 29435/371472 [2:20:39<26:55:53,  3.53it/s]
  8%|▊         | 29436/371472 [2:20:40<26:23:03,  3.60it/s]
  8%|▊         | 29437/371472 [2:20:40<25:52:24,  3.67it/s]
  8%|▊         | 29438/371472 [2:20:40<25:06:55,  3.78it/s]
  8%|▊         | 29439/371472 [2:20:40<24:19:03,  3.91it/s]
  8%|▊         | 29440/371472 [2:20:41<23:49:29,  3.99it/s]
                                                           
{'loss': 8.4045, 'learning_rate': 9.291193518498567e-07, 'epoch': 1.27}

  8%|▊         | 29440/371472 [2:20:41<23:49:29,  3.99it/s]
  8%|▊         | 29441/371472 [2:20:41<25:06:18,  3.78it/s]
  8%|▊         | 29442/371472 [2:20:41<25:49:22,  3.68it/s]
  8%|▊         | 29443/371472 [2:20:41<27:25:04,  3.47it/s]
  8%|▊         | 29444/371472 [2:20:42<26:40:46,  3.56it/s]
  8%|▊         | 29445/371472 [2:20:42<28:05:50,  3.38it/s]
  8%|▊         | 29446/371472 [2:20:42<27:01:20,  3.52it/s]
  8%|▊         | 29447/371472 [2:20:43<30:28:37,  3.12it/s]
  8%|▊         | 29448/371472 [2:20:43<29:30:29,  3.22it/s]
  8%|▊         | 29449/371472 [2:20:43<32:36:23,  2.91it/s]
  8%|▊         | 29450/371472 [2:20:44<31:16:46,  3.04it/s]
  8%|▊         | 29451/371472 [2:20:44<29:45:29,  3.19it/s]
  8%|▊         | 29452/371472 [2:20:44<28:01:55,  3.39it/s]
  8%|▊         | 29453/371472 [2:20:44<27:36:14,  3.44it/s]
  8%|▊         | 29454/371472 [2:20:45<26:28:43,  3.59it/s]
  8%|▊         | 29455/371472 [2:20:45<28:08:29,  3.38it/s]
  8%|▊         | 29456/371472 [2:20:45<29:07:57,  3.26it/s]
  8%|▊         | 29457/371472 [2:20:46<28:08:44,  3.38it/s]
  8%|▊         | 29458/371472 [2:20:46<28:17:54,  3.36it/s]
  8%|▊         | 29459/371472 [2:20:46<27:21:28,  3.47it/s]
  8%|▊         | 29460/371472 [2:20:47<27:11:29,  3.49it/s]
                                                           
{'loss': 8.4389, 'learning_rate': 9.290708698743777e-07, 'epoch': 1.27}

  8%|▊         | 29460/371472 [2:20:47<27:11:29,  3.49it/s]
  8%|▊         | 29461/371472 [2:20:47<26:00:15,  3.65it/s]
  8%|▊         | 29462/371472 [2:20:47<25:35:20,  3.71it/s]
  8%|▊         | 29463/371472 [2:20:47<25:10:37,  3.77it/s]
  8%|▊         | 29464/371472 [2:20:48<25:20:34,  3.75it/s]
  8%|▊         | 29465/371472 [2:20:48<25:02:22,  3.79it/s]
  8%|▊         | 29466/371472 [2:20:48<24:56:35,  3.81it/s]
  8%|▊         | 29467/371472 [2:20:48<25:38:51,  3.70it/s]
  8%|▊         | 29468/371472 [2:20:49<29:00:27,  3.28it/s]
  8%|▊         | 29469/371472 [2:20:49<27:50:29,  3.41it/s]
  8%|▊         | 29470/371472 [2:20:49<27:41:12,  3.43it/s]
  8%|▊         | 29471/371472 [2:20:50<27:20:37,  3.47it/s]
  8%|▊         | 29472/371472 [2:20:50<27:27:55,  3.46it/s]
  8%|▊         | 29473/371472 [2:20:50<27:43:02,  3.43it/s]
  8%|▊         | 29474/371472 [2:20:50<28:06:04,  3.38it/s]
  8%|▊         | 29475/371472 [2:20:51<29:50:54,  3.18it/s]
  8%|▊         | 29476/371472 [2:20:51<29:37:11,  3.21it/s]
  8%|▊         | 29477/371472 [2:20:51<28:09:36,  3.37it/s]
  8%|▊         | 29478/371472 [2:20:52<28:45:18,  3.30it/s]
  8%|▊         | 29479/371472 [2:20:52<27:14:55,  3.49it/s]
  8%|▊         | 29480/371472 [2:20:52<26:53:11,  3.53it/s]
                                                           
{'loss': 8.1549, 'learning_rate': 9.290223878988989e-07, 'epoch': 1.27}

  8%|▊         | 29480/371472 [2:20:52<26:53:11,  3.53it/s]
  8%|▊         | 29481/371472 [2:20:53<29:07:23,  3.26it/s]
  8%|▊         | 29482/371472 [2:20:53<28:35:10,  3.32it/s]
  8%|▊         | 29483/371472 [2:20:53<27:54:22,  3.40it/s]
  8%|▊         | 29484/371472 [2:20:53<28:08:28,  3.38it/s]
  8%|▊         | 29485/371472 [2:20:54<27:43:56,  3.43it/s]
  8%|▊         | 29486/371472 [2:20:54<26:12:40,  3.62it/s]
  8%|▊         | 29487/371472 [2:20:54<25:07:48,  3.78it/s]
  8%|▊         | 29488/371472 [2:20:54<25:07:58,  3.78it/s]
  8%|▊         | 29489/371472 [2:20:55<27:41:21,  3.43it/s]
  8%|▊         | 29490/371472 [2:20:55<27:46:31,  3.42it/s]
  8%|▊         | 29491/371472 [2:20:55<27:24:56,  3.46it/s]
  8%|▊         | 29492/371472 [2:20:56<26:52:08,  3.54it/s]
  8%|▊         | 29493/371472 [2:20:56<26:37:24,  3.57it/s]
  8%|▊         | 29494/371472 [2:20:56<27:03:57,  3.51it/s]
  8%|▊         | 29495/371472 [2:20:57<28:05:22,  3.38it/s]
  8%|▊         | 29496/371472 [2:20:57<27:26:04,  3.46it/s]
  8%|▊         | 29497/371472 [2:20:57<26:50:01,  3.54it/s]
  8%|▊         | 29498/371472 [2:20:57<25:47:02,  3.68it/s]
  8%|▊         | 29499/371472 [2:20:58<25:38:57,  3.70it/s]
  8%|▊         | 29500/371472 [2:20:58<27:42:01,  3.43it/s]
                                                           
{'loss': 8.3515, 'learning_rate': 9.2897390592342e-07, 'epoch': 1.27}

  8%|▊         | 29500/371472 [2:20:58<27:42:01,  3.43it/s]
  8%|▊         | 29501/371472 [2:20:58<28:05:25,  3.38it/s]
  8%|▊         | 29502/371472 [2:20:59<27:19:19,  3.48it/s]
  8%|▊         | 29503/371472 [2:20:59<26:37:13,  3.57it/s]
  8%|▊         | 29504/371472 [2:20:59<26:19:38,  3.61it/s]
  8%|▊         | 29505/371472 [2:20:59<27:26:49,  3.46it/s]
  8%|▊         | 29506/371472 [2:21:00<27:38:44,  3.44it/s]
  8%|▊         | 29507/371472 [2:21:00<30:24:14,  3.12it/s]
  8%|▊         | 29508/371472 [2:21:00<28:52:38,  3.29it/s]
  8%|▊         | 29509/371472 [2:21:01<28:09:06,  3.37it/s]
  8%|▊         | 29510/371472 [2:21:01<27:37:42,  3.44it/s]
  8%|▊         | 29511/371472 [2:21:01<27:51:44,  3.41it/s]
  8%|▊         | 29512/371472 [2:21:02<27:53:51,  3.40it/s]
  8%|▊         | 29513/371472 [2:21:02<29:12:07,  3.25it/s]
  8%|▊         | 29514/371472 [2:21:02<27:47:13,  3.42it/s]
  8%|▊         | 29515/371472 [2:21:02<26:11:42,  3.63it/s]
  8%|▊         | 29516/371472 [2:21:03<26:55:55,  3.53it/s]
  8%|▊         | 29517/371472 [2:21:03<25:51:55,  3.67it/s]
  8%|▊         | 29518/371472 [2:21:03<26:31:01,  3.58it/s]
  8%|▊         | 29519/371472 [2:21:04<28:58:53,  3.28it/s]
  8%|▊         | 29520/371472 [2:21:04<29:01:30,  3.27it/s]
                                                           
{'loss': 8.0843, 'learning_rate': 9.289254239479412e-07, 'epoch': 1.27}

  8%|▊         | 29520/371472 [2:21:04<29:01:30,  3.27it/s]
  8%|▊         | 29521/371472 [2:21:04<29:14:17,  3.25it/s]
  8%|▊         | 29522/371472 [2:21:04<28:42:58,  3.31it/s]
  8%|▊         | 29523/371472 [2:21:05<31:38:22,  3.00it/s]
  8%|▊         | 29524/371472 [2:21:05<30:07:18,  3.15it/s]
  8%|▊         | 29525/371472 [2:21:05<29:26:58,  3.23it/s]
  8%|▊         | 29526/371472 [2:21:06<29:16:59,  3.24it/s]
  8%|▊         | 29527/371472 [2:21:06<28:18:30,  3.36it/s]
  8%|▊         | 29528/371472 [2:21:06<27:50:11,  3.41it/s]
  8%|▊         | 29529/371472 [2:21:07<27:58:55,  3.39it/s]
  8%|▊         | 29530/371472 [2:21:07<27:21:27,  3.47it/s]
  8%|▊         | 29531/371472 [2:21:07<29:33:44,  3.21it/s]
  8%|▊         | 29532/371472 [2:21:08<28:32:45,  3.33it/s]
  8%|▊         | 29533/371472 [2:21:08<27:05:17,  3.51it/s]
  8%|▊         | 29534/371472 [2:21:08<25:59:05,  3.66it/s]
  8%|▊         | 29535/371472 [2:21:08<26:27:39,  3.59it/s]
  8%|▊         | 29536/371472 [2:21:09<26:47:29,  3.55it/s]
  8%|▊         | 29537/371472 [2:21:09<26:17:13,  3.61it/s]
  8%|▊         | 29538/371472 [2:21:09<26:59:57,  3.52it/s]
  8%|▊         | 29539/371472 [2:21:09<28:13:08,  3.37it/s]
  8%|▊         | 29540/371472 [2:21:10<27:17:43,  3.48it/s]
                                                           
{'loss': 7.5458, 'learning_rate': 9.288769419724621e-07, 'epoch': 1.27}

  8%|▊         | 29540/371472 [2:21:10<27:17:43,  3.48it/s]
  8%|▊         | 29541/371472 [2:21:10<26:49:41,  3.54it/s]
  8%|▊         | 29542/371472 [2:21:10<27:11:01,  3.49it/s]
  8%|▊         | 29543/371472 [2:21:11<26:28:15,  3.59it/s]
  8%|▊         | 29544/371472 [2:21:11<27:42:16,  3.43it/s]
  8%|▊         | 29545/371472 [2:21:11<27:56:33,  3.40it/s]
  8%|▊         | 29546/371472 [2:21:11<27:48:59,  3.41it/s]
  8%|▊         | 29547/371472 [2:21:12<26:38:14,  3.57it/s]
  8%|▊         | 29548/371472 [2:21:12<26:39:47,  3.56it/s]
  8%|▊         | 29549/371472 [2:21:12<26:57:56,  3.52it/s]
  8%|▊         | 29550/371472 [2:21:13<27:30:47,  3.45it/s]
  8%|▊         | 29551/371472 [2:21:13<27:36:52,  3.44it/s]
  8%|▊         | 29552/371472 [2:21:13<28:47:55,  3.30it/s]
  8%|▊         | 29553/371472 [2:21:13<27:33:15,  3.45it/s]
  8%|▊         | 29554/371472 [2:21:14<29:06:11,  3.26it/s]
  8%|▊         | 29555/371472 [2:21:14<27:25:57,  3.46it/s]
  8%|▊         | 29556/371472 [2:21:14<27:28:24,  3.46it/s]
  8%|▊         | 29557/371472 [2:21:15<26:46:53,  3.55it/s]
  8%|▊         | 29558/371472 [2:21:15<25:53:16,  3.67it/s]
  8%|▊         | 29559/371472 [2:21:15<25:33:14,  3.72it/s]
  8%|▊         | 29560/371472 [2:21:15<25:24:09,  3.74it/s]
                                                           
{'loss': 7.7321, 'learning_rate': 9.288284599969833e-07, 'epoch': 1.27}

  8%|▊         | 29560/371472 [2:21:15<25:24:09,  3.74it/s]
  8%|▊         | 29561/371472 [2:21:16<26:27:47,  3.59it/s]
  8%|▊         | 29562/371472 [2:21:16<26:55:27,  3.53it/s]
  8%|▊         | 29563/371472 [2:21:16<27:16:39,  3.48it/s]
  8%|▊         | 29564/371472 [2:21:17<26:37:01,  3.57it/s]
  8%|▊         | 29565/371472 [2:21:17<32:14:47,  2.95it/s]
  8%|▊         | 29566/371472 [2:21:17<30:37:41,  3.10it/s]
  8%|▊         | 29567/371472 [2:21:18<29:26:36,  3.23it/s]
  8%|▊         | 29568/371472 [2:21:18<27:49:08,  3.41it/s]
  8%|▊         | 29569/371472 [2:21:18<27:18:04,  3.48it/s]
  8%|▊         | 29570/371472 [2:21:18<27:48:52,  3.41it/s]
  8%|▊         | 29571/371472 [2:21:19<27:43:07,  3.43it/s]
  8%|▊         | 29572/371472 [2:21:19<27:24:15,  3.47it/s]
  8%|▊         | 29573/371472 [2:21:19<27:49:27,  3.41it/s]
  8%|▊         | 29574/371472 [2:21:20<27:18:02,  3.48it/s]
  8%|▊         | 29575/371472 [2:21:20<26:45:56,  3.55it/s]
  8%|▊         | 29576/371472 [2:21:20<28:17:10,  3.36it/s]
  8%|▊         | 29577/371472 [2:21:21<30:10:24,  3.15it/s]
  8%|▊         | 29578/371472 [2:21:21<30:36:46,  3.10it/s]
  8%|▊         | 29579/371472 [2:21:21<29:17:00,  3.24it/s]
  8%|▊         | 29580/371472 [2:21:22<31:10:41,  3.05it/s]
                                                           
{'loss': 7.8405, 'learning_rate': 9.287799780215045e-07, 'epoch': 1.27}

  8%|▊         | 29580/371472 [2:21:22<31:10:41,  3.05it/s]
  8%|▊         | 29581/371472 [2:21:22<31:29:10,  3.02it/s]
  8%|▊         | 29582/371472 [2:21:22<29:19:02,  3.24it/s]
  8%|▊         | 29583/371472 [2:21:22<28:09:36,  3.37it/s]
  8%|▊         | 29584/371472 [2:21:23<27:41:58,  3.43it/s]
  8%|▊         | 29585/371472 [2:21:23<27:50:36,  3.41it/s]
  8%|▊         | 29586/371472 [2:21:23<27:29:13,  3.46it/s]
  8%|▊         | 29587/371472 [2:21:24<26:14:37,  3.62it/s]
  8%|▊         | 29588/371472 [2:21:24<26:49:50,  3.54it/s]
  8%|▊         | 29589/371472 [2:21:24<26:09:23,  3.63it/s]
  8%|▊         | 29590/371472 [2:21:24<26:19:01,  3.61it/s]
  8%|▊         | 29591/371472 [2:21:25<26:19:27,  3.61it/s]
  8%|▊         | 29592/371472 [2:21:25<26:29:44,  3.58it/s]
  8%|▊         | 29593/371472 [2:21:25<25:43:06,  3.69it/s]
  8%|▊         | 29594/371472 [2:21:25<25:18:39,  3.75it/s]
  8%|▊         | 29595/371472 [2:21:26<25:49:13,  3.68it/s]
  8%|▊         | 29596/371472 [2:21:26<25:20:36,  3.75it/s]
  8%|▊         | 29597/371472 [2:21:26<24:54:29,  3.81it/s]
  8%|▊         | 29598/371472 [2:21:27<25:54:47,  3.66it/s]
  8%|▊         | 29599/371472 [2:21:27<24:56:22,  3.81it/s]
  8%|▊         | 29600/371472 [2:21:27<25:59:04,  3.65it/s]
                                                           
{'loss': 7.7172, 'learning_rate': 9.287314960460256e-07, 'epoch': 1.27}

  8%|▊         | 29600/371472 [2:21:27<25:59:04,  3.65it/s]
  8%|▊         | 29601/371472 [2:21:27<26:32:39,  3.58it/s]
  8%|▊         | 29602/371472 [2:21:28<25:55:49,  3.66it/s]
  8%|▊         | 29603/371472 [2:21:28<25:43:14,  3.69it/s]
  8%|▊         | 29604/371472 [2:21:28<26:59:45,  3.52it/s]
  8%|▊         | 29605/371472 [2:21:28<26:13:11,  3.62it/s]
  8%|▊         | 29606/371472 [2:21:29<25:51:57,  3.67it/s]
  8%|▊         | 29607/371472 [2:21:29<25:39:14,  3.70it/s]
  8%|▊         | 29608/371472 [2:21:29<26:34:08,  3.57it/s]
  8%|▊         | 29609/371472 [2:21:30<26:47:54,  3.54it/s]
  8%|▊         | 29610/371472 [2:21:30<27:46:31,  3.42it/s]
  8%|▊         | 29611/371472 [2:21:30<27:21:30,  3.47it/s]
  8%|▊         | 29612/371472 [2:21:30<26:59:17,  3.52it/s]
  8%|▊         | 29613/371472 [2:21:31<27:14:59,  3.48it/s]
  8%|▊         | 29614/371472 [2:21:31<26:37:26,  3.57it/s]
  8%|▊         | 29615/371472 [2:21:31<26:40:02,  3.56it/s]
  8%|▊         | 29616/371472 [2:21:32<26:36:52,  3.57it/s]
  8%|▊         | 29617/371472 [2:21:32<27:44:46,  3.42it/s]
  8%|▊         | 29618/371472 [2:21:32<27:34:38,  3.44it/s]
  8%|▊         | 29619/371472 [2:21:33<35:02:04,  2.71it/s]
  8%|▊         | 29620/371472 [2:21:33<35:29:28,  2.68it/s]
                                                           
{'loss': 8.0011, 'learning_rate': 9.286830140705466e-07, 'epoch': 1.28}

  8%|▊         | 29620/371472 [2:21:33<35:29:28,  2.68it/s]
  8%|▊         | 29621/371472 [2:21:33<32:32:13,  2.92it/s]
  8%|▊         | 29622/371472 [2:21:34<31:39:39,  3.00it/s]
  8%|▊         | 29623/371472 [2:21:34<32:42:03,  2.90it/s]
  8%|▊         | 29624/371472 [2:21:34<29:34:06,  3.21it/s]
  8%|▊         | 29625/371472 [2:21:35<28:09:43,  3.37it/s]
  8%|▊         | 29626/371472 [2:21:35<27:44:45,  3.42it/s]
  8%|▊         | 29627/371472 [2:21:35<26:54:54,  3.53it/s]
  8%|▊         | 29628/371472 [2:21:35<26:42:55,  3.55it/s]
  8%|▊         | 29629/371472 [2:21:36<26:23:56,  3.60it/s]
  8%|▊         | 29630/371472 [2:21:36<26:38:40,  3.56it/s]
  8%|▊         | 29631/371472 [2:21:36<25:47:26,  3.68it/s]
  8%|▊         | 29632/371472 [2:21:36<25:40:35,  3.70it/s]
  8%|▊         | 29633/371472 [2:21:37<28:32:15,  3.33it/s]
  8%|▊         | 29634/371472 [2:21:37<27:49:21,  3.41it/s]
  8%|▊         | 29635/371472 [2:21:37<27:40:28,  3.43it/s]
  8%|▊         | 29636/371472 [2:21:38<27:40:26,  3.43it/s]
  8%|▊         | 29637/371472 [2:21:38<28:02:44,  3.39it/s]
  8%|▊         | 29638/371472 [2:21:38<27:13:09,  3.49it/s]
  8%|▊         | 29639/371472 [2:21:39<27:28:14,  3.46it/s]
  8%|▊         | 29640/371472 [2:21:39<27:57:44,  3.40it/s]
                                                           
{'loss': 7.8851, 'learning_rate': 9.286345320950678e-07, 'epoch': 1.28}

  8%|▊         | 29640/371472 [2:21:39<27:57:44,  3.40it/s]
  8%|▊         | 29641/371472 [2:21:39<28:23:22,  3.34it/s]
  8%|▊         | 29642/371472 [2:21:39<27:22:06,  3.47it/s]
  8%|▊         | 29643/371472 [2:21:40<26:23:41,  3.60it/s]
  8%|▊         | 29644/371472 [2:21:40<27:31:40,  3.45it/s]
  8%|▊         | 29645/371472 [2:21:40<27:11:02,  3.49it/s]
  8%|▊         | 29646/371472 [2:21:40<25:52:35,  3.67it/s]
  8%|▊         | 29647/371472 [2:21:41<25:26:39,  3.73it/s]
  8%|▊         | 29648/371472 [2:21:41<26:12:46,  3.62it/s]
  8%|▊         | 29649/371472 [2:21:41<25:47:00,  3.68it/s]
  8%|▊         | 29650/371472 [2:21:42<25:29:45,  3.72it/s]
  8%|▊         | 29651/371472 [2:21:42<25:55:25,  3.66it/s]
  8%|▊         | 29652/371472 [2:21:42<27:36:33,  3.44it/s]
  8%|▊         | 29653/371472 [2:21:42<27:39:04,  3.43it/s]
  8%|▊         | 29654/371472 [2:21:43<28:01:52,  3.39it/s]
  8%|▊         | 29655/371472 [2:21:43<27:37:06,  3.44it/s]
  8%|▊         | 29656/371472 [2:21:43<26:47:53,  3.54it/s]
  8%|▊         | 29657/371472 [2:21:44<26:43:17,  3.55it/s]
  8%|▊         | 29658/371472 [2:21:44<27:34:17,  3.44it/s]
  8%|▊         | 29659/371472 [2:21:44<27:51:26,  3.41it/s]
  8%|▊         | 29660/371472 [2:21:44<27:12:07,  3.49it/s]
                                                           
{'loss': 7.7286, 'learning_rate': 9.285860501195888e-07, 'epoch': 1.28}

  8%|▊         | 29660/371472 [2:21:44<27:12:07,  3.49it/s]
  8%|▊         | 29661/371472 [2:21:45<26:28:32,  3.59it/s]
  8%|▊         | 29662/371472 [2:21:45<25:48:10,  3.68it/s]
  8%|▊         | 29663/371472 [2:21:45<25:53:41,  3.67it/s]
  8%|▊         | 29664/371472 [2:21:46<25:38:32,  3.70it/s]
  8%|▊         | 29665/371472 [2:21:46<26:55:48,  3.53it/s]
  8%|▊         | 29666/371472 [2:21:46<27:43:57,  3.42it/s]
  8%|▊         | 29667/371472 [2:21:46<27:00:49,  3.51it/s]
  8%|▊         | 29668/371472 [2:21:47<26:17:55,  3.61it/s]
  8%|▊         | 29669/371472 [2:21:47<26:03:01,  3.64it/s]
  8%|▊         | 29670/371472 [2:21:47<25:35:26,  3.71it/s]
  8%|▊         | 29671/371472 [2:21:47<25:26:39,  3.73it/s]
  8%|▊         | 29672/371472 [2:21:48<26:13:03,  3.62it/s]
  8%|▊         | 29673/371472 [2:21:48<27:02:00,  3.51it/s]
  8%|▊         | 29674/371472 [2:21:48<27:19:25,  3.47it/s]
  8%|▊         | 29675/371472 [2:21:49<29:05:31,  3.26it/s]
  8%|▊         | 29676/371472 [2:21:49<28:58:31,  3.28it/s]
  8%|▊         | 29677/371472 [2:21:49<28:15:20,  3.36it/s]
  8%|▊         | 29678/371472 [2:21:50<28:02:45,  3.39it/s]
  8%|▊         | 29679/371472 [2:21:50<27:44:20,  3.42it/s]
  8%|▊         | 29680/371472 [2:21:50<29:32:34,  3.21it/s]
                                                           
{'loss': 8.2685, 'learning_rate': 9.285375681441099e-07, 'epoch': 1.28}

  8%|▊         | 29680/371472 [2:21:50<29:32:34,  3.21it/s]
  8%|▊         | 29681/371472 [2:21:51<29:52:32,  3.18it/s]
  8%|▊         | 29682/371472 [2:21:51<29:30:42,  3.22it/s]
  8%|▊         | 29683/371472 [2:21:51<28:41:09,  3.31it/s]
  8%|▊         | 29684/371472 [2:21:52<32:13:46,  2.95it/s]
  8%|▊         | 29685/371472 [2:21:52<30:09:57,  3.15it/s]
  8%|▊         | 29686/371472 [2:21:52<28:53:49,  3.29it/s]
  8%|▊         | 29687/371472 [2:21:52<28:00:23,  3.39it/s]
  8%|▊         | 29688/371472 [2:21:53<27:35:18,  3.44it/s]
  8%|▊         | 29689/371472 [2:21:53<26:52:35,  3.53it/s]
  8%|▊         | 29690/371472 [2:21:53<27:38:54,  3.43it/s]
  8%|▊         | 29691/371472 [2:21:54<27:14:06,  3.49it/s]
  8%|▊         | 29692/371472 [2:21:54<26:43:38,  3.55it/s]
  8%|▊         | 29693/371472 [2:21:54<27:00:52,  3.51it/s]
  8%|▊         | 29694/371472 [2:21:54<26:04:53,  3.64it/s]
  8%|▊         | 29695/371472 [2:21:55<25:19:19,  3.75it/s]
  8%|▊         | 29696/371472 [2:21:55<27:59:11,  3.39it/s]
  8%|▊         | 29697/371472 [2:21:55<27:10:54,  3.49it/s]
  8%|▊         | 29698/371472 [2:21:55<26:44:33,  3.55it/s]
  8%|▊         | 29699/371472 [2:21:56<28:17:28,  3.36it/s]
  8%|▊         | 29700/371472 [2:21:56<27:15:24,  3.48it/s]
                                                           
{'loss': 8.1651, 'learning_rate': 9.28489086168631e-07, 'epoch': 1.28}

  8%|▊         | 29700/371472 [2:21:56<27:15:24,  3.48it/s]
  8%|▊         | 29701/371472 [2:21:56<26:19:56,  3.61it/s]
  8%|▊         | 29702/371472 [2:21:57<26:19:53,  3.61it/s]
  8%|▊         | 29703/371472 [2:21:57<26:03:40,  3.64it/s]
  8%|▊         | 29704/371472 [2:21:57<26:07:58,  3.63it/s]
  8%|▊         | 29705/371472 [2:21:57<27:55:12,  3.40it/s]
  8%|▊         | 29706/371472 [2:21:58<27:02:16,  3.51it/s]
  8%|▊         | 29707/371472 [2:21:58<27:47:14,  3.42it/s]
  8%|▊         | 29708/371472 [2:21:58<27:16:36,  3.48it/s]
  8%|▊         | 29709/371472 [2:21:59<26:42:50,  3.55it/s]
  8%|▊         | 29710/371472 [2:21:59<27:11:07,  3.49it/s]
  8%|▊         | 29711/371472 [2:21:59<26:12:12,  3.62it/s]
  8%|▊         | 29712/371472 [2:21:59<25:30:02,  3.72it/s]
  8%|▊         | 29713/371472 [2:22:00<25:18:58,  3.75it/s]
  8%|▊         | 29714/371472 [2:22:00<26:57:03,  3.52it/s]
  8%|▊         | 29715/371472 [2:22:00<25:54:41,  3.66it/s]
  8%|▊         | 29716/371472 [2:22:01<27:29:43,  3.45it/s]
  8%|▊         | 29717/371472 [2:22:01<27:18:57,  3.48it/s]
  8%|▊         | 29718/371472 [2:22:01<27:47:51,  3.42it/s]
  8%|▊         | 29719/371472 [2:22:01<27:10:26,  3.49it/s]
  8%|▊         | 29720/371472 [2:22:02<26:43:02,  3.55it/s]
                                                           
{'loss': 7.8719, 'learning_rate': 9.284406041931522e-07, 'epoch': 1.28}

  8%|▊         | 29720/371472 [2:22:02<26:43:02,  3.55it/s]
  8%|▊         | 29721/371472 [2:22:02<26:55:48,  3.53it/s]
  8%|▊         | 29722/371472 [2:22:02<27:15:08,  3.48it/s]
  8%|▊         | 29723/371472 [2:22:03<27:31:39,  3.45it/s]
  8%|▊         | 29724/371472 [2:22:03<26:49:26,  3.54it/s]
  8%|▊         | 29725/371472 [2:22:03<26:53:00,  3.53it/s]
  8%|▊         | 29726/371472 [2:22:03<26:08:28,  3.63it/s]
  8%|▊         | 29727/371472 [2:22:04<26:46:51,  3.54it/s]
  8%|▊         | 29728/371472 [2:22:04<26:02:16,  3.65it/s]
  8%|▊         | 29729/371472 [2:22:04<26:21:51,  3.60it/s]
  8%|▊         | 29730/371472 [2:22:04<25:58:25,  3.65it/s]
  8%|▊         | 29731/371472 [2:22:05<25:53:39,  3.67it/s]
  8%|▊         | 29732/371472 [2:22:05<27:48:05,  3.41it/s]
  8%|▊         | 29733/371472 [2:22:05<26:31:34,  3.58it/s]
  8%|▊         | 29734/371472 [2:22:06<26:00:06,  3.65it/s]
  8%|▊         | 29735/371472 [2:22:06<27:03:03,  3.51it/s]
  8%|▊         | 29736/371472 [2:22:06<26:14:45,  3.62it/s]
  8%|▊         | 29737/371472 [2:22:06<26:15:02,  3.62it/s]
  8%|▊         | 29738/371472 [2:22:07<25:56:12,  3.66it/s]
  8%|▊         | 29739/371472 [2:22:07<26:50:37,  3.54it/s]
  8%|▊         | 29740/371472 [2:22:07<26:34:15,  3.57it/s]
                                                           
{'loss': 8.0637, 'learning_rate': 9.283921222176733e-07, 'epoch': 1.28}

  8%|▊         | 29740/371472 [2:22:07<26:34:15,  3.57it/s]
  8%|▊         | 29741/371472 [2:22:08<26:15:56,  3.61it/s]
  8%|▊         | 29742/371472 [2:22:08<26:18:24,  3.61it/s]
  8%|▊         | 29743/371472 [2:22:08<26:05:21,  3.64it/s]
  8%|▊         | 29744/371472 [2:22:08<27:51:08,  3.41it/s]
  8%|▊         | 29745/371472 [2:22:09<28:59:42,  3.27it/s]
  8%|▊         | 29746/371472 [2:22:09<28:13:24,  3.36it/s]
  8%|▊         | 29747/371472 [2:22:09<28:38:05,  3.31it/s]
  8%|▊         | 29748/371472 [2:22:10<27:53:17,  3.40it/s]
  8%|▊         | 29749/371472 [2:22:10<27:18:12,  3.48it/s]
  8%|▊         | 29750/371472 [2:22:10<26:44:40,  3.55it/s]
  8%|▊         | 29751/371472 [2:22:10<26:11:54,  3.62it/s]
  8%|▊         | 29752/371472 [2:22:11<26:55:03,  3.53it/s]
  8%|▊         | 29753/371472 [2:22:11<27:49:55,  3.41it/s]
  8%|▊         | 29754/371472 [2:22:11<27:13:45,  3.49it/s]
  8%|▊         | 29755/371472 [2:22:12<28:31:34,  3.33it/s]
  8%|▊         | 29756/371472 [2:22:12<27:54:33,  3.40it/s]
  8%|▊         | 29757/371472 [2:22:12<27:27:33,  3.46it/s]
  8%|▊         | 29758/371472 [2:22:13<27:00:05,  3.52it/s]
  8%|▊         | 29759/371472 [2:22:13<28:14:56,  3.36it/s]
  8%|▊         | 29760/371472 [2:22:13<29:16:19,  3.24it/s]
                                                           
{'loss': 7.9024, 'learning_rate': 9.283436402421944e-07, 'epoch': 1.28}

  8%|▊         | 29760/371472 [2:22:13<29:16:19,  3.24it/s]
  8%|▊         | 29761/371472 [2:22:13<28:49:00,  3.29it/s]
  8%|▊         | 29762/371472 [2:22:14<27:07:53,  3.50it/s]
  8%|▊         | 29763/371472 [2:22:14<27:45:52,  3.42it/s]
  8%|▊         | 29764/371472 [2:22:14<26:27:28,  3.59it/s]
  8%|▊         | 29765/371472 [2:22:15<26:48:55,  3.54it/s]
  8%|▊         | 29766/371472 [2:22:15<27:13:42,  3.49it/s]
  8%|▊         | 29767/371472 [2:22:15<28:05:35,  3.38it/s]
  8%|▊         | 29768/371472 [2:22:15<28:08:27,  3.37it/s]
  8%|▊         | 29769/371472 [2:22:16<27:50:28,  3.41it/s]
  8%|▊         | 29770/371472 [2:22:16<27:01:01,  3.51it/s]
  8%|▊         | 29771/371472 [2:22:16<26:54:05,  3.53it/s]
  8%|▊         | 29772/371472 [2:22:17<27:47:54,  3.41it/s]
  8%|▊         | 29773/371472 [2:22:17<26:25:00,  3.59it/s]
  8%|▊         | 29774/371472 [2:22:17<25:35:23,  3.71it/s]
  8%|▊         | 29775/371472 [2:22:17<24:53:53,  3.81it/s]
  8%|▊         | 29776/371472 [2:22:18<25:08:17,  3.78it/s]
  8%|▊         | 29777/371472 [2:22:18<24:53:43,  3.81it/s]
  8%|▊         | 29778/371472 [2:22:18<25:27:45,  3.73it/s]
  8%|▊         | 29779/371472 [2:22:18<25:23:59,  3.74it/s]
  8%|▊         | 29780/371472 [2:22:19<25:12:09,  3.77it/s]
                                                           
{'loss': 7.7219, 'learning_rate': 9.282951582667155e-07, 'epoch': 1.28}

  8%|▊         | 29780/371472 [2:22:19<25:12:09,  3.77it/s]
  8%|▊         | 29781/371472 [2:22:19<25:04:55,  3.78it/s]
  8%|▊         | 29782/371472 [2:22:19<24:47:25,  3.83it/s]
  8%|▊         | 29783/371472 [2:22:19<25:01:01,  3.79it/s]
  8%|▊         | 29784/371472 [2:22:20<25:00:27,  3.80it/s]
  8%|▊         | 29785/371472 [2:22:20<25:09:20,  3.77it/s]
  8%|▊         | 29786/371472 [2:22:20<27:14:29,  3.48it/s]
  8%|▊         | 29787/371472 [2:22:21<28:39:39,  3.31it/s]
  8%|▊         | 29788/371472 [2:22:21<27:34:48,  3.44it/s]
  8%|▊         | 29789/371472 [2:22:21<26:49:43,  3.54it/s]
  8%|▊         | 29790/371472 [2:22:22<28:01:08,  3.39it/s]
  8%|▊         | 29791/371472 [2:22:22<28:20:20,  3.35it/s]
  8%|▊         | 29792/371472 [2:22:22<27:54:50,  3.40it/s]
  8%|▊         | 29793/371472 [2:22:22<26:45:46,  3.55it/s]
  8%|▊         | 29794/371472 [2:22:23<26:41:18,  3.56it/s]
  8%|▊         | 29795/371472 [2:22:23<25:55:01,  3.66it/s]
  8%|▊         | 29796/371472 [2:22:23<26:35:03,  3.57it/s]
  8%|▊         | 29797/371472 [2:22:23<26:29:35,  3.58it/s]
  8%|▊         | 29798/371472 [2:22:24<26:05:19,  3.64it/s]
  8%|▊         | 29799/371472 [2:22:24<25:34:47,  3.71it/s]
  8%|▊         | 29800/371472 [2:22:24<25:24:41,  3.73it/s]
                                                           
{'loss': 7.7878, 'learning_rate': 9.282466762912365e-07, 'epoch': 1.28}

  8%|▊         | 29800/371472 [2:22:24<25:24:41,  3.73it/s]
  8%|▊         | 29801/371472 [2:22:25<26:13:08,  3.62it/s]
  8%|▊         | 29802/371472 [2:22:25<26:24:07,  3.59it/s]
  8%|▊         | 29803/371472 [2:22:25<26:22:15,  3.60it/s]
  8%|▊         | 29804/371472 [2:22:25<27:03:36,  3.51it/s]
  8%|▊         | 29805/371472 [2:22:26<28:29:24,  3.33it/s]
  8%|▊         | 29806/371472 [2:22:26<27:39:07,  3.43it/s]
  8%|▊         | 29807/371472 [2:22:26<27:16:06,  3.48it/s]
  8%|▊         | 29808/371472 [2:22:27<26:36:59,  3.57it/s]
  8%|▊         | 29809/371472 [2:22:27<26:31:17,  3.58it/s]
  8%|▊         | 29810/371472 [2:22:27<25:57:58,  3.65it/s]
  8%|▊         | 29811/371472 [2:22:27<25:33:45,  3.71it/s]
  8%|▊         | 29812/371472 [2:22:28<25:35:23,  3.71it/s]
  8%|▊         | 29813/371472 [2:22:28<28:03:56,  3.38it/s]
  8%|▊         | 29814/371472 [2:22:28<28:49:24,  3.29it/s]
  8%|▊         | 29815/371472 [2:22:29<27:16:55,  3.48it/s]
  8%|▊         | 29816/371472 [2:22:29<27:31:09,  3.45it/s]
  8%|▊         | 29817/371472 [2:22:29<27:07:57,  3.50it/s]
  8%|▊         | 29818/371472 [2:22:29<26:27:22,  3.59it/s]
  8%|▊         | 29819/371472 [2:22:30<26:09:51,  3.63it/s]
  8%|▊         | 29820/371472 [2:22:30<26:44:31,  3.55it/s]
                                                           
{'loss': 7.6931, 'learning_rate': 9.281981943157577e-07, 'epoch': 1.28}

  8%|▊         | 29820/371472 [2:22:30<26:44:31,  3.55it/s]
  8%|▊         | 29821/371472 [2:22:30<27:07:13,  3.50it/s]
  8%|▊         | 29822/371472 [2:22:31<26:38:17,  3.56it/s]
  8%|▊         | 29823/371472 [2:22:31<27:27:35,  3.46it/s]
  8%|▊         | 29824/371472 [2:22:31<30:18:33,  3.13it/s]
  8%|▊         | 29825/371472 [2:22:32<29:50:01,  3.18it/s]
  8%|▊         | 29826/371472 [2:22:32<29:19:01,  3.24it/s]
  8%|▊         | 29827/371472 [2:22:32<27:21:23,  3.47it/s]
  8%|▊         | 29828/371472 [2:22:32<28:22:38,  3.34it/s]
  8%|▊         | 29829/371472 [2:22:33<28:16:54,  3.36it/s]
  8%|▊         | 29830/371472 [2:22:33<27:38:55,  3.43it/s]
  8%|▊         | 29831/371472 [2:22:33<27:00:59,  3.51it/s]
  8%|▊         | 29832/371472 [2:22:34<28:49:29,  3.29it/s]
  8%|▊         | 29833/371472 [2:22:34<27:55:38,  3.40it/s]
  8%|▊         | 29834/371472 [2:22:34<27:15:17,  3.48it/s]
  8%|▊         | 29835/371472 [2:22:34<28:06:23,  3.38it/s]
  8%|▊         | 29836/371472 [2:22:35<27:21:02,  3.47it/s]
  8%|▊         | 29837/371472 [2:22:35<27:12:14,  3.49it/s]
  8%|▊         | 29838/371472 [2:22:35<28:16:19,  3.36it/s]
  8%|▊         | 29839/371472 [2:22:36<27:01:35,  3.51it/s]
  8%|▊         | 29840/371472 [2:22:36<27:12:07,  3.49it/s]
                                                           
{'loss': 7.3598, 'learning_rate': 9.281497123402788e-07, 'epoch': 1.29}

  8%|▊         | 29840/371472 [2:22:36<27:12:07,  3.49it/s]
  8%|▊         | 29841/371472 [2:22:36<27:49:12,  3.41it/s]
  8%|▊         | 29842/371472 [2:22:36<26:46:30,  3.54it/s]
  8%|▊         | 29843/371472 [2:22:37<27:03:45,  3.51it/s]
  8%|▊         | 29844/371472 [2:22:37<26:34:43,  3.57it/s]
  8%|▊         | 29845/371472 [2:22:37<26:49:18,  3.54it/s]
  8%|▊         | 29846/371472 [2:22:38<26:45:28,  3.55it/s]
  8%|▊         | 29847/371472 [2:22:38<25:55:39,  3.66it/s]
  8%|▊         | 29848/371472 [2:22:38<25:07:20,  3.78it/s]
  8%|▊         | 29849/371472 [2:22:38<26:51:29,  3.53it/s]
  8%|▊         | 29850/371472 [2:22:39<26:43:40,  3.55it/s]
  8%|▊         | 29851/371472 [2:22:39<26:25:58,  3.59it/s]
  8%|▊         | 29852/371472 [2:22:39<25:25:11,  3.73it/s]
  8%|▊         | 29853/371472 [2:22:39<25:05:44,  3.78it/s]
  8%|▊         | 29854/371472 [2:22:40<25:23:31,  3.74it/s]
  8%|▊         | 29855/371472 [2:22:40<25:14:52,  3.76it/s]
  8%|▊         | 29856/371472 [2:22:40<25:21:34,  3.74it/s]
  8%|▊         | 29857/371472 [2:22:41<26:41:28,  3.56it/s]
  8%|▊         | 29858/371472 [2:22:41<28:05:28,  3.38it/s]
  8%|▊         | 29859/371472 [2:22:41<28:26:18,  3.34it/s]
  8%|▊         | 29860/371472 [2:22:41<27:34:39,  3.44it/s]
                                                           
{'loss': 7.7623, 'learning_rate': 9.281012303647999e-07, 'epoch': 1.29}

  8%|▊         | 29860/371472 [2:22:41<27:34:39,  3.44it/s]
  8%|▊         | 29861/371472 [2:22:42<28:31:11,  3.33it/s]
  8%|▊         | 29862/371472 [2:22:42<27:32:43,  3.44it/s]
  8%|▊         | 29863/371472 [2:22:42<28:56:04,  3.28it/s]
  8%|▊         | 29864/371472 [2:22:43<30:11:43,  3.14it/s]
  8%|▊         | 29865/371472 [2:22:43<29:32:29,  3.21it/s]
  8%|▊         | 29866/371472 [2:22:43<28:39:48,  3.31it/s]
  8%|▊         | 29867/371472 [2:22:44<28:14:27,  3.36it/s]
  8%|▊         | 29868/371472 [2:22:44<27:49:11,  3.41it/s]
  8%|▊         | 29869/371472 [2:22:44<27:38:37,  3.43it/s]
  8%|▊         | 29870/371472 [2:22:44<27:49:11,  3.41it/s]
  8%|▊         | 29871/371472 [2:22:45<26:58:30,  3.52it/s]
  8%|▊         | 29872/371472 [2:22:45<26:40:27,  3.56it/s]
  8%|▊         | 29873/371472 [2:22:45<25:18:04,  3.75it/s]
  8%|▊         | 29874/371472 [2:22:46<25:34:05,  3.71it/s]
  8%|▊         | 29875/371472 [2:22:46<24:42:44,  3.84it/s]
  8%|▊         | 29876/371472 [2:22:46<25:28:58,  3.72it/s]
  8%|▊         | 29877/371472 [2:22:46<24:39:26,  3.85it/s]
  8%|▊         | 29878/371472 [2:22:47<25:40:47,  3.70it/s]
  8%|▊         | 29879/371472 [2:22:47<27:15:56,  3.48it/s]
  8%|▊         | 29880/371472 [2:22:47<26:29:02,  3.58it/s]
                                                           
{'loss': 7.6945, 'learning_rate': 9.28052748389321e-07, 'epoch': 1.29}

  8%|▊         | 29880/371472 [2:22:47<26:29:02,  3.58it/s]
  8%|▊         | 29881/371472 [2:22:47<26:46:48,  3.54it/s]
  8%|▊         | 29882/371472 [2:22:48<26:47:20,  3.54it/s]
  8%|▊         | 29883/371472 [2:22:48<25:35:05,  3.71it/s]
  8%|▊         | 29884/371472 [2:22:48<27:30:11,  3.45it/s]
  8%|▊         | 29885/371472 [2:22:49<29:16:46,  3.24it/s]
  8%|▊         | 29886/371472 [2:22:49<29:06:28,  3.26it/s]
  8%|▊         | 29887/371472 [2:22:49<27:41:50,  3.43it/s]
  8%|▊         | 29888/371472 [2:22:50<28:33:54,  3.32it/s]
  8%|▊         | 29889/371472 [2:22:50<29:36:31,  3.20it/s]
  8%|▊         | 29890/371472 [2:22:50<28:17:21,  3.35it/s]
  8%|▊         | 29891/371472 [2:22:50<26:59:08,  3.52it/s]
  8%|▊         | 29892/371472 [2:22:51<26:38:47,  3.56it/s]
  8%|▊         | 29893/371472 [2:22:51<26:58:28,  3.52it/s]
  8%|▊         | 29894/371472 [2:22:51<28:18:25,  3.35it/s]
  8%|▊         | 29895/371472 [2:22:52<26:38:35,  3.56it/s]
  8%|▊         | 29896/371472 [2:22:52<27:08:58,  3.49it/s]
  8%|▊         | 29897/371472 [2:22:52<26:28:03,  3.58it/s]
  8%|▊         | 29898/371472 [2:22:52<26:09:32,  3.63it/s]
  8%|▊         | 29899/371472 [2:22:53<26:07:37,  3.63it/s]
  8%|▊         | 29900/371472 [2:22:53<27:25:35,  3.46it/s]
                                                           
{'loss': 7.594, 'learning_rate': 9.280042664138422e-07, 'epoch': 1.29}

  8%|▊         | 29900/371472 [2:22:53<27:25:35,  3.46it/s]
  8%|▊         | 29901/371472 [2:22:53<26:50:50,  3.53it/s]
  8%|▊         | 29902/371472 [2:22:54<27:32:04,  3.45it/s]
  8%|▊         | 29903/371472 [2:22:54<27:43:58,  3.42it/s]
  8%|▊         | 29904/371472 [2:22:54<27:44:05,  3.42it/s]
  8%|▊         | 29905/371472 [2:22:54<26:26:39,  3.59it/s]
  8%|▊         | 29906/371472 [2:22:55<28:09:19,  3.37it/s]
  8%|▊         | 29907/371472 [2:22:55<27:36:25,  3.44it/s]
  8%|▊         | 29908/371472 [2:22:55<26:37:15,  3.56it/s]
  8%|▊         | 29909/371472 [2:22:56<26:11:32,  3.62it/s]
  8%|▊         | 29910/371472 [2:22:56<25:27:03,  3.73it/s]
  8%|▊         | 29911/371472 [2:22:56<26:06:59,  3.63it/s]
  8%|▊         | 29912/371472 [2:22:56<25:05:46,  3.78it/s]
  8%|▊         | 29913/371472 [2:22:57<26:20:38,  3.60it/s]
  8%|▊         | 29914/371472 [2:22:57<26:22:47,  3.60it/s]
  8%|▊         | 29915/371472 [2:22:57<27:43:59,  3.42it/s]
  8%|▊         | 29916/371472 [2:22:57<27:12:41,  3.49it/s]
  8%|▊         | 29917/371472 [2:22:58<28:42:58,  3.30it/s]
  8%|▊         | 29918/371472 [2:22:58<28:01:26,  3.39it/s]
  8%|▊         | 29919/371472 [2:22:58<30:00:41,  3.16it/s]
  8%|▊         | 29920/371472 [2:22:59<30:09:53,  3.15it/s]
                                                           
{'loss': 7.5393, 'learning_rate': 9.279557844383631e-07, 'epoch': 1.29}

  8%|▊         | 29920/371472 [2:22:59<30:09:53,  3.15it/s]
  8%|▊         | 29921/371472 [2:22:59<28:18:21,  3.35it/s]
  8%|▊         | 29922/371472 [2:22:59<27:07:57,  3.50it/s]
  8%|▊         | 29923/371472 [2:23:00<26:45:05,  3.55it/s]
  8%|▊         | 29924/371472 [2:23:00<27:12:44,  3.49it/s]
  8%|▊         | 29925/371472 [2:23:00<27:22:34,  3.47it/s]
  8%|▊         | 29926/371472 [2:23:00<26:35:31,  3.57it/s]
  8%|▊         | 29927/371472 [2:23:01<28:17:35,  3.35it/s]
  8%|▊         | 29928/371472 [2:23:01<29:40:36,  3.20it/s]
  8%|▊         | 29929/371472 [2:23:01<28:06:34,  3.38it/s]
  8%|▊         | 29930/371472 [2:23:02<27:19:26,  3.47it/s]
  8%|▊         | 29931/371472 [2:23:02<27:24:57,  3.46it/s]
  8%|▊         | 29932/371472 [2:23:02<26:54:42,  3.53it/s]
  8%|▊         | 29933/371472 [2:23:02<26:59:47,  3.51it/s]
  8%|▊         | 29934/371472 [2:23:03<26:35:33,  3.57it/s]
  8%|▊         | 29935/371472 [2:23:03<25:39:42,  3.70it/s]
  8%|▊         | 29936/371472 [2:23:03<27:33:14,  3.44it/s]
  8%|▊         | 29937/371472 [2:23:04<27:14:36,  3.48it/s]
  8%|▊         | 29938/371472 [2:23:04<26:48:16,  3.54it/s]
  8%|▊         | 29939/371472 [2:23:04<29:51:46,  3.18it/s]
  8%|▊         | 29940/371472 [2:23:05<30:04:10,  3.16it/s]
                                                           
{'loss': 7.4495, 'learning_rate': 9.279073024628843e-07, 'epoch': 1.29}

  8%|▊         | 29940/371472 [2:23:05<30:04:10,  3.16it/s]
  8%|▊         | 29941/371472 [2:23:05<31:10:26,  3.04it/s]
  8%|▊         | 29942/371472 [2:23:05<29:34:07,  3.21it/s]
  8%|▊         | 29943/371472 [2:23:06<29:15:40,  3.24it/s]
  8%|▊         | 29944/371472 [2:23:06<28:37:32,  3.31it/s]
  8%|▊         | 29945/371472 [2:23:06<27:35:04,  3.44it/s]
  8%|▊         | 29946/371472 [2:23:06<26:53:59,  3.53it/s]
  8%|▊         | 29947/371472 [2:23:07<27:42:14,  3.42it/s]
  8%|▊         | 29948/371472 [2:23:07<27:05:27,  3.50it/s]
  8%|▊         | 29949/371472 [2:23:07<26:41:54,  3.55it/s]
  8%|▊         | 29950/371472 [2:23:07<26:11:50,  3.62it/s]
  8%|▊         | 29951/371472 [2:23:08<25:37:59,  3.70it/s]
  8%|▊         | 29952/371472 [2:23:08<25:40:22,  3.70it/s]
  8%|▊         | 29953/371472 [2:23:08<28:07:58,  3.37it/s]
  8%|▊         | 29954/371472 [2:23:09<28:11:18,  3.37it/s]
  8%|▊         | 29955/371472 [2:23:09<27:11:13,  3.49it/s]
  8%|▊         | 29956/371472 [2:23:09<28:46:34,  3.30it/s]
  8%|▊         | 29957/371472 [2:23:10<27:21:02,  3.47it/s]
  8%|▊         | 29958/371472 [2:23:10<29:54:52,  3.17it/s]
  8%|▊         | 29959/371472 [2:23:10<30:16:59,  3.13it/s]
  8%|▊         | 29960/371472 [2:23:10<28:29:10,  3.33it/s]
                                                           
{'loss': 7.7063, 'learning_rate': 9.278588204874054e-07, 'epoch': 1.29}

  8%|▊         | 29960/371472 [2:23:10<28:29:10,  3.33it/s]
  8%|▊         | 29961/371472 [2:23:11<28:34:29,  3.32it/s]
  8%|▊         | 29962/371472 [2:23:11<27:11:18,  3.49it/s]
  8%|▊         | 29963/371472 [2:23:11<27:03:14,  3.51it/s]
  8%|▊         | 29964/371472 [2:23:12<29:24:02,  3.23it/s]
  8%|▊         | 29965/371472 [2:23:12<27:41:31,  3.43it/s]
  8%|▊         | 29966/371472 [2:23:12<27:05:27,  3.50it/s]
  8%|▊         | 29967/371472 [2:23:12<27:07:23,  3.50it/s]
  8%|▊         | 29968/371472 [2:23:13<26:09:57,  3.63it/s]
  8%|▊         | 29969/371472 [2:23:13<26:07:54,  3.63it/s]
  8%|▊         | 29970/371472 [2:23:13<26:11:27,  3.62it/s]
  8%|▊         | 29971/371472 [2:23:14<26:20:00,  3.60it/s]
  8%|▊         | 29972/371472 [2:23:14<26:27:06,  3.59it/s]
  8%|▊         | 29973/371472 [2:23:14<26:30:22,  3.58it/s]
  8%|▊         | 29974/371472 [2:23:14<27:10:22,  3.49it/s]
  8%|▊         | 29975/371472 [2:23:15<27:02:33,  3.51it/s]
  8%|▊         | 29976/371472 [2:23:15<26:49:17,  3.54it/s]
  8%|▊         | 29977/371472 [2:23:15<26:25:25,  3.59it/s]
  8%|▊         | 29978/371472 [2:23:16<28:43:28,  3.30it/s]
  8%|▊         | 29979/371472 [2:23:16<27:08:27,  3.50it/s]
  8%|▊         | 29980/371472 [2:23:16<27:05:34,  3.50it/s]
                                                           
{'loss': 7.7734, 'learning_rate': 9.278103385119265e-07, 'epoch': 1.29}

  8%|▊         | 29980/371472 [2:23:16<27:05:34,  3.50it/s]
  8%|▊         | 29981/371472 [2:23:16<28:19:30,  3.35it/s]
  8%|▊         | 29982/371472 [2:23:17<27:50:55,  3.41it/s]
  8%|▊         | 29983/371472 [2:23:17<27:00:25,  3.51it/s]
  8%|▊         | 29984/371472 [2:23:17<26:27:25,  3.59it/s]
  8%|▊         | 29985/371472 [2:23:18<28:25:03,  3.34it/s]
  8%|▊         | 29986/371472 [2:23:18<27:37:53,  3.43it/s]
  8%|▊         | 29987/371472 [2:23:18<27:37:59,  3.43it/s]
  8%|▊         | 29988/371472 [2:23:18<26:38:05,  3.56it/s]
  8%|▊         | 29989/371472 [2:23:19<26:51:01,  3.53it/s]
  8%|▊         | 29990/371472 [2:23:19<26:16:48,  3.61it/s]
  8%|▊         | 29991/371472 [2:23:19<26:07:27,  3.63it/s]
  8%|▊         | 29992/371472 [2:23:20<26:17:22,  3.61it/s]
  8%|▊         | 29993/371472 [2:23:20<26:17:33,  3.61it/s]
  8%|▊         | 29994/371472 [2:23:20<25:52:31,  3.67it/s]
  8%|▊         | 29995/371472 [2:23:20<26:21:04,  3.60it/s]
  8%|▊         | 29996/371472 [2:23:21<25:36:28,  3.70it/s]
  8%|▊         | 29997/371472 [2:23:21<25:12:11,  3.76it/s]
  8%|▊         | 29998/371472 [2:23:21<25:17:04,  3.75it/s]
  8%|▊         | 29999/371472 [2:23:22<27:50:43,  3.41it/s]
  8%|▊         | 30000/371472 [2:23:22<29:25:04,  3.22it/s]
                                                           
{'loss': 7.7084, 'learning_rate': 9.277618565364475e-07, 'epoch': 1.29}

  8%|▊         | 30000/371472 [2:23:22<29:25:04,  3.22it/s]
  8%|▊         | 30001/371472 [2:23:22<28:34:06,  3.32it/s]
  8%|▊         | 30002/371472 [2:23:22<27:46:48,  3.41it/s]
  8%|▊         | 30003/371472 [2:23:23<28:05:07,  3.38it/s]
  8%|▊         | 30004/371472 [2:23:23<28:47:26,  3.29it/s]
  8%|▊         | 30005/371472 [2:23:23<29:17:27,  3.24it/s]
  8%|▊         | 30006/371472 [2:23:24<28:57:11,  3.28it/s]
  8%|▊         | 30007/371472 [2:23:24<28:47:11,  3.29it/s]
  8%|▊         | 30008/371472 [2:23:24<27:44:56,  3.42it/s]
  8%|▊         | 30009/371472 [2:23:25<27:58:16,  3.39it/s]
  8%|▊         | 30010/371472 [2:23:25<26:37:48,  3.56it/s]
  8%|▊         | 30011/371472 [2:23:25<26:44:41,  3.55it/s]
  8%|▊         | 30012/371472 [2:23:25<27:01:48,  3.51it/s]
  8%|▊         | 30013/371472 [2:23:26<26:35:13,  3.57it/s]
  8%|▊         | 30014/371472 [2:23:26<26:19:58,  3.60it/s]
  8%|▊         | 30015/371472 [2:23:26<26:41:45,  3.55it/s]
  8%|▊         | 30016/371472 [2:23:26<26:10:46,  3.62it/s]
  8%|▊         | 30017/371472 [2:23:27<27:19:50,  3.47it/s]
  8%|▊         | 30018/371472 [2:23:27<27:31:03,  3.45it/s]
  8%|▊         | 30019/371472 [2:23:27<27:57:41,  3.39it/s]
  8%|▊         | 30020/371472 [2:23:28<27:52:22,  3.40it/s]
                                                           
{'loss': 7.6194, 'learning_rate': 9.277133745609688e-07, 'epoch': 1.29}

  8%|▊         | 30020/371472 [2:23:28<27:52:22,  3.40it/s]
  8%|▊         | 30021/371472 [2:23:28<26:53:28,  3.53it/s]
  8%|▊         | 30022/371472 [2:23:28<25:59:59,  3.65it/s]
  8%|▊         | 30023/371472 [2:23:28<26:17:03,  3.61it/s]
  8%|▊         | 30024/371472 [2:23:29<25:53:11,  3.66it/s]
  8%|▊         | 30025/371472 [2:23:29<25:59:36,  3.65it/s]
  8%|▊         | 30026/371472 [2:23:29<25:16:52,  3.75it/s]
  8%|▊         | 30027/371472 [2:23:30<25:17:55,  3.75it/s]
  8%|▊         | 30028/371472 [2:23:30<25:37:37,  3.70it/s]
  8%|▊         | 30029/371472 [2:23:30<27:19:29,  3.47it/s]
  8%|▊         | 30030/371472 [2:23:30<26:52:28,  3.53it/s]
  8%|▊         | 30031/371472 [2:23:31<28:26:34,  3.33it/s]
  8%|▊         | 30032/371472 [2:23:31<28:13:46,  3.36it/s]
  8%|▊         | 30033/371472 [2:23:31<27:16:23,  3.48it/s]
  8%|▊         | 30034/371472 [2:23:32<27:22:55,  3.46it/s]
  8%|▊         | 30035/371472 [2:23:32<27:22:04,  3.47it/s]
  8%|▊         | 30036/371472 [2:23:32<26:13:01,  3.62it/s]
  8%|▊         | 30037/371472 [2:23:32<27:27:52,  3.45it/s]
  8%|▊         | 30038/371472 [2:23:33<26:57:27,  3.52it/s]
  8%|▊         | 30039/371472 [2:23:33<26:24:46,  3.59it/s]
  8%|▊         | 30040/371472 [2:23:33<29:08:26,  3.25it/s]
                                                           
{'loss': 7.8689, 'learning_rate': 9.276648925854898e-07, 'epoch': 1.29}

  8%|▊         | 30040/371472 [2:23:33<29:08:26,  3.25it/s]
  8%|▊         | 30041/371472 [2:23:34<27:41:43,  3.42it/s]
  8%|▊         | 30042/371472 [2:23:34<27:06:17,  3.50it/s]
  8%|▊         | 30043/371472 [2:23:34<27:07:31,  3.50it/s]
  8%|▊         | 30044/371472 [2:23:34<27:07:10,  3.50it/s]
  8%|▊         | 30045/371472 [2:23:35<26:40:09,  3.56it/s]
  8%|▊         | 30046/371472 [2:23:35<28:06:44,  3.37it/s]
  8%|▊         | 30047/371472 [2:23:35<26:59:11,  3.51it/s]
  8%|▊         | 30048/371472 [2:23:36<27:37:37,  3.43it/s]
  8%|▊         | 30049/371472 [2:23:36<26:40:08,  3.56it/s]
  8%|▊         | 30050/371472 [2:23:36<26:56:20,  3.52it/s]
  8%|▊         | 30051/371472 [2:23:36<27:35:54,  3.44it/s]
  8%|▊         | 30052/371472 [2:23:37<26:56:48,  3.52it/s]
  8%|▊         | 30053/371472 [2:23:37<25:58:04,  3.65it/s]
  8%|▊         | 30054/371472 [2:23:37<25:23:16,  3.74it/s]
  8%|▊         | 30055/371472 [2:23:37<24:50:24,  3.82it/s]
  8%|▊         | 30056/371472 [2:23:38<25:07:56,  3.77it/s]
  8%|▊         | 30057/371472 [2:23:38<25:11:24,  3.76it/s]
  8%|▊         | 30058/371472 [2:23:38<26:33:15,  3.57it/s]
  8%|▊         | 30059/371472 [2:23:39<25:47:00,  3.68it/s]
  8%|▊         | 30060/371472 [2:23:39<24:51:33,  3.81it/s]
                                                           
{'loss': 7.2148, 'learning_rate': 9.276164106100109e-07, 'epoch': 1.29}

  8%|▊         | 30060/371472 [2:23:39<24:51:33,  3.81it/s]
  8%|▊         | 30061/371472 [2:23:39<25:30:10,  3.72it/s]
  8%|▊         | 30062/371472 [2:23:39<25:12:35,  3.76it/s]
  8%|▊         | 30063/371472 [2:23:40<26:02:27,  3.64it/s]
  8%|▊         | 30064/371472 [2:23:40<25:46:28,  3.68it/s]
  8%|▊         | 30065/371472 [2:23:40<27:35:31,  3.44it/s]
  8%|▊         | 30066/371472 [2:23:41<27:57:18,  3.39it/s]
  8%|▊         | 30067/371472 [2:23:41<26:55:22,  3.52it/s]
  8%|▊         | 30068/371472 [2:23:41<27:03:37,  3.50it/s]
  8%|▊         | 30069/371472 [2:23:41<26:50:58,  3.53it/s]
  8%|▊         | 30070/371472 [2:23:42<26:33:40,  3.57it/s]
  8%|▊         | 30071/371472 [2:23:42<27:56:27,  3.39it/s]
  8%|▊         | 30072/371472 [2:23:42<28:16:49,  3.35it/s]
  8%|▊         | 30073/371472 [2:23:43<27:11:23,  3.49it/s]
  8%|▊         | 30074/371472 [2:23:43<26:21:47,  3.60it/s]
  8%|▊         | 30075/371472 [2:23:43<26:29:39,  3.58it/s]
  8%|▊         | 30076/371472 [2:23:43<26:13:49,  3.62it/s]
  8%|▊         | 30077/371472 [2:23:44<26:51:14,  3.53it/s]
  8%|▊         | 30078/371472 [2:23:44<27:03:08,  3.51it/s]
  8%|▊         | 30079/371472 [2:23:44<27:32:24,  3.44it/s]
  8%|▊         | 30080/371472 [2:23:45<27:22:20,  3.46it/s]
                                                           
{'loss': 7.7463, 'learning_rate': 9.27567928634532e-07, 'epoch': 1.3}

  8%|▊         | 30080/371472 [2:23:45<27:22:20,  3.46it/s]
  8%|▊         | 30081/371472 [2:23:45<30:40:12,  3.09it/s]
  8%|▊         | 30082/371472 [2:23:45<28:43:50,  3.30it/s]
  8%|▊         | 30083/371472 [2:23:45<27:53:43,  3.40it/s]
  8%|▊         | 30084/371472 [2:23:46<29:18:55,  3.23it/s]
  8%|▊         | 30085/371472 [2:23:46<29:24:46,  3.22it/s]
  8%|▊         | 30086/371472 [2:23:46<30:11:37,  3.14it/s]
  8%|▊         | 30087/371472 [2:23:47<28:33:35,  3.32it/s]
  8%|▊         | 30088/371472 [2:23:47<28:40:51,  3.31it/s]
  8%|▊         | 30089/371472 [2:23:47<26:55:10,  3.52it/s]
  8%|▊         | 30090/371472 [2:23:48<28:28:41,  3.33it/s]
  8%|▊         | 30091/371472 [2:23:48<27:14:32,  3.48it/s]
  8%|▊         | 30092/371472 [2:23:48<27:01:32,  3.51it/s]
  8%|▊         | 30093/371472 [2:23:48<27:12:05,  3.49it/s]
  8%|▊         | 30094/371472 [2:23:49<27:30:34,  3.45it/s]
  8%|▊         | 30095/371472 [2:23:49<27:03:40,  3.50it/s]
  8%|▊         | 30096/371472 [2:23:49<26:35:01,  3.57it/s]
  8%|▊         | 30097/371472 [2:23:50<25:16:43,  3.75it/s]
  8%|▊         | 30098/371472 [2:23:50<25:24:14,  3.73it/s]
  8%|▊         | 30099/371472 [2:23:50<25:17:24,  3.75it/s]
  8%|▊         | 30100/371472 [2:23:50<25:08:53,  3.77it/s]
                                                           
{'loss': 7.7451, 'learning_rate': 9.275194466590532e-07, 'epoch': 1.3}

  8%|▊         | 30100/371472 [2:23:50<25:08:53,  3.77it/s]
  8%|▊         | 30101/371472 [2:23:51<25:27:19,  3.73it/s]
  8%|▊         | 30102/371472 [2:23:51<25:37:53,  3.70it/s]
  8%|▊         | 30103/371472 [2:23:51<26:12:58,  3.62it/s]
  8%|▊         | 30104/371472 [2:23:51<26:20:02,  3.60it/s]
  8%|▊         | 30105/371472 [2:23:52<28:34:45,  3.32it/s]
  8%|▊         | 30106/371472 [2:23:52<28:22:23,  3.34it/s]
  8%|▊         | 30107/371472 [2:23:52<27:47:59,  3.41it/s]
  8%|▊         | 30108/371472 [2:23:53<26:35:27,  3.57it/s]
  8%|▊         | 30109/371472 [2:23:53<27:18:16,  3.47it/s]
  8%|▊         | 30110/371472 [2:23:53<27:15:39,  3.48it/s]
  8%|▊         | 30111/371472 [2:23:54<27:32:17,  3.44it/s]
  8%|▊         | 30112/371472 [2:23:54<26:33:09,  3.57it/s]
  8%|▊         | 30113/371472 [2:23:54<26:13:31,  3.62it/s]
  8%|▊         | 30114/371472 [2:23:54<26:10:35,  3.62it/s]
  8%|▊         | 30115/371472 [2:23:55<26:59:28,  3.51it/s]
  8%|▊         | 30116/371472 [2:23:55<28:29:18,  3.33it/s]
  8%|▊         | 30117/371472 [2:23:55<27:33:40,  3.44it/s]
  8%|▊         | 30118/371472 [2:23:55<26:33:57,  3.57it/s]
  8%|▊         | 30119/371472 [2:23:56<27:08:46,  3.49it/s]
  8%|▊         | 30120/371472 [2:23:56<26:34:11,  3.57it/s]
                                                           
{'loss': 7.6534, 'learning_rate': 9.274709646835743e-07, 'epoch': 1.3}

  8%|▊         | 30120/371472 [2:23:56<26:34:11,  3.57it/s]
  8%|▊         | 30121/371472 [2:23:56<26:25:01,  3.59it/s]
  8%|▊         | 30122/371472 [2:23:57<26:30:11,  3.58it/s]
  8%|▊         | 30123/371472 [2:23:57<25:48:37,  3.67it/s]
  8%|▊         | 30124/371472 [2:23:57<25:59:58,  3.65it/s]
  8%|▊         | 30125/371472 [2:23:57<25:39:45,  3.69it/s]
  8%|▊         | 30126/371472 [2:23:58<25:56:47,  3.65it/s]
  8%|▊         | 30127/371472 [2:23:58<27:45:21,  3.42it/s]
  8%|▊         | 30128/371472 [2:23:58<27:51:19,  3.40it/s]
  8%|▊         | 30129/371472 [2:23:59<28:06:14,  3.37it/s]
  8%|▊         | 30130/371472 [2:23:59<27:52:04,  3.40it/s]
  8%|▊         | 30131/371472 [2:23:59<27:19:42,  3.47it/s]
  8%|▊         | 30132/371472 [2:23:59<26:57:50,  3.52it/s]
  8%|▊         | 30133/371472 [2:24:00<26:55:02,  3.52it/s]
  8%|▊         | 30134/371472 [2:24:00<27:20:38,  3.47it/s]
  8%|▊         | 30135/371472 [2:24:00<28:18:22,  3.35it/s]
  8%|▊         | 30136/371472 [2:24:01<27:01:39,  3.51it/s]
  8%|▊         | 30137/371472 [2:24:01<27:05:40,  3.50it/s]
  8%|▊         | 30138/371472 [2:24:01<26:23:05,  3.59it/s]
  8%|▊         | 30139/371472 [2:24:02<28:27:21,  3.33it/s]
  8%|▊         | 30140/371472 [2:24:02<29:50:35,  3.18it/s]
                                                           
{'loss': 7.6972, 'learning_rate': 9.274224827080954e-07, 'epoch': 1.3}

  8%|▊         | 30140/371472 [2:24:02<29:50:35,  3.18it/s]
  8%|▊         | 30141/371472 [2:24:02<27:51:43,  3.40it/s]
  8%|▊         | 30142/371472 [2:24:02<29:11:18,  3.25it/s]
  8%|▊         | 30143/371472 [2:24:03<28:32:08,  3.32it/s]
  8%|▊         | 30144/371472 [2:24:03<28:00:36,  3.38it/s]
  8%|▊         | 30145/371472 [2:24:03<29:57:13,  3.17it/s]
  8%|▊         | 30146/371472 [2:24:04<29:23:20,  3.23it/s]
  8%|▊         | 30147/371472 [2:24:04<29:04:01,  3.26it/s]
  8%|▊         | 30148/371472 [2:24:04<28:09:03,  3.37it/s]
  8%|▊         | 30149/371472 [2:24:05<28:42:15,  3.30it/s]
  8%|▊         | 30150/371472 [2:24:05<28:03:44,  3.38it/s]
  8%|▊         | 30151/371472 [2:24:05<28:04:19,  3.38it/s]
  8%|▊         | 30152/371472 [2:24:05<29:13:40,  3.24it/s]
  8%|▊         | 30153/371472 [2:24:06<28:13:49,  3.36it/s]
  8%|▊         | 30154/371472 [2:24:06<27:23:38,  3.46it/s]
  8%|▊         | 30155/371472 [2:24:06<27:19:56,  3.47it/s]
  8%|▊         | 30156/371472 [2:24:07<26:46:43,  3.54it/s]
  8%|▊         | 30157/371472 [2:24:07<28:10:34,  3.36it/s]
  8%|▊         | 30158/371472 [2:24:07<28:05:22,  3.38it/s]
  8%|▊         | 30159/371472 [2:24:07<27:04:08,  3.50it/s]
  8%|▊         | 30160/371472 [2:24:08<26:56:43,  3.52it/s]
                                                           
{'loss': 7.3694, 'learning_rate': 9.273740007326165e-07, 'epoch': 1.3}

  8%|▊         | 30160/371472 [2:24:08<26:56:43,  3.52it/s]
  8%|▊         | 30161/371472 [2:24:08<26:44:31,  3.55it/s]
  8%|▊         | 30162/371472 [2:24:08<27:37:45,  3.43it/s]
  8%|▊         | 30163/371472 [2:24:09<27:01:16,  3.51it/s]
  8%|▊         | 30164/371472 [2:24:09<27:19:16,  3.47it/s]
  8%|▊         | 30165/371472 [2:24:09<28:11:12,  3.36it/s]
  8%|▊         | 30166/371472 [2:24:10<27:38:24,  3.43it/s]
  8%|▊         | 30167/371472 [2:24:10<27:12:56,  3.48it/s]
  8%|▊         | 30168/371472 [2:24:10<26:06:30,  3.63it/s]
  8%|▊         | 30169/371472 [2:24:10<26:17:22,  3.61it/s]
  8%|▊         | 30170/371472 [2:24:11<25:52:51,  3.66it/s]
  8%|▊         | 30171/371472 [2:24:11<27:54:58,  3.40it/s]
  8%|▊         | 30172/371472 [2:24:11<27:55:57,  3.39it/s]
  8%|▊         | 30173/371472 [2:24:11<26:41:56,  3.55it/s]
  8%|▊         | 30174/371472 [2:24:12<26:08:23,  3.63it/s]
  8%|▊         | 30175/371472 [2:24:12<25:19:02,  3.74it/s]
  8%|▊         | 30176/371472 [2:24:12<24:53:17,  3.81it/s]
  8%|▊         | 30177/371472 [2:24:12<24:57:05,  3.80it/s]
  8%|▊         | 30178/371472 [2:24:13<24:48:37,  3.82it/s]
  8%|▊         | 30179/371472 [2:24:13<25:01:35,  3.79it/s]
  8%|▊         | 30180/371472 [2:24:13<24:47:49,  3.82it/s]
                                                           
{'loss': 7.2392, 'learning_rate': 9.273255187571376e-07, 'epoch': 1.3}

  8%|▊         | 30180/371472 [2:24:13<24:47:49,  3.82it/s]
  8%|▊         | 30181/371472 [2:24:14<25:54:31,  3.66it/s]
  8%|▊         | 30182/371472 [2:24:14<26:12:05,  3.62it/s]
  8%|▊         | 30183/371472 [2:24:14<26:37:33,  3.56it/s]
  8%|▊         | 30184/371472 [2:24:14<26:24:36,  3.59it/s]
  8%|▊         | 30185/371472 [2:24:15<28:07:20,  3.37it/s]
  8%|▊         | 30186/371472 [2:24:15<27:38:18,  3.43it/s]
  8%|▊         | 30187/371472 [2:24:15<26:58:38,  3.51it/s]
  8%|▊         | 30188/371472 [2:24:16<27:25:41,  3.46it/s]
  8%|▊         | 30189/371472 [2:24:16<28:55:16,  3.28it/s]
  8%|▊         | 30190/371472 [2:24:16<28:22:55,  3.34it/s]
  8%|▊         | 30191/371472 [2:24:17<29:41:23,  3.19it/s]
  8%|▊         | 30192/371472 [2:24:17<28:59:37,  3.27it/s]
  8%|▊         | 30193/371472 [2:24:17<28:14:19,  3.36it/s]
  8%|▊         | 30194/371472 [2:24:17<28:04:13,  3.38it/s]
  8%|▊         | 30195/371472 [2:24:18<28:22:40,  3.34it/s]
  8%|▊         | 30196/371472 [2:24:18<28:48:47,  3.29it/s]
  8%|▊         | 30197/371472 [2:24:18<30:43:53,  3.08it/s]
  8%|▊         | 30198/371472 [2:24:19<28:36:49,  3.31it/s]
  8%|▊         | 30199/371472 [2:24:19<29:17:30,  3.24it/s]
  8%|▊         | 30200/371472 [2:24:19<30:15:58,  3.13it/s]
                                                           
{'loss': 7.5428, 'learning_rate': 9.272770367816587e-07, 'epoch': 1.3}

  8%|▊         | 30200/371472 [2:24:19<30:15:58,  3.13it/s]
  8%|▊         | 30201/371472 [2:24:20<30:56:18,  3.06it/s]
  8%|▊         | 30202/371472 [2:24:20<28:57:58,  3.27it/s]
  8%|▊         | 30203/371472 [2:24:20<27:38:37,  3.43it/s]
  8%|▊         | 30204/371472 [2:24:20<27:08:29,  3.49it/s]
  8%|▊         | 30205/371472 [2:24:21<26:05:25,  3.63it/s]
  8%|▊         | 30206/371472 [2:24:21<26:50:18,  3.53it/s]
  8%|▊         | 30207/371472 [2:24:21<26:07:07,  3.63it/s]
  8%|▊         | 30208/371472 [2:24:22<27:27:27,  3.45it/s]
  8%|▊         | 30209/371472 [2:24:22<26:34:01,  3.57it/s]
  8%|▊         | 30210/371472 [2:24:22<27:14:17,  3.48it/s]
  8%|▊         | 30211/371472 [2:24:22<26:45:02,  3.54it/s]
  8%|▊         | 30212/371472 [2:24:23<28:09:20,  3.37it/s]
  8%|▊         | 30213/371472 [2:24:23<27:15:32,  3.48it/s]
  8%|▊         | 30214/371472 [2:24:23<28:20:36,  3.34it/s]
  8%|▊         | 30215/371472 [2:24:24<28:22:34,  3.34it/s]
  8%|▊         | 30216/371472 [2:24:24<28:53:46,  3.28it/s]
  8%|▊         | 30217/371472 [2:24:24<28:57:38,  3.27it/s]
  8%|▊         | 30218/371472 [2:24:25<28:08:39,  3.37it/s]
  8%|▊         | 30219/371472 [2:24:25<28:18:45,  3.35it/s]
  8%|▊         | 30220/371472 [2:24:25<28:25:14,  3.34it/s]
                                                           
{'loss': 7.6846, 'learning_rate': 9.272285548061798e-07, 'epoch': 1.3}

  8%|▊         | 30220/371472 [2:24:25<28:25:14,  3.34it/s]
  8%|▊         | 30221/371472 [2:24:26<29:34:51,  3.20it/s]
  8%|▊         | 30222/371472 [2:24:26<28:51:29,  3.28it/s]
  8%|▊         | 30223/371472 [2:24:26<28:13:20,  3.36it/s]
  8%|▊         | 30224/371472 [2:24:26<27:39:11,  3.43it/s]
  8%|▊         | 30225/371472 [2:24:27<27:24:08,  3.46it/s]
  8%|▊         | 30226/371472 [2:24:27<28:35:52,  3.31it/s]
  8%|▊         | 30227/371472 [2:24:27<27:15:11,  3.48it/s]
  8%|▊         | 30228/371472 [2:24:27<26:30:42,  3.58it/s]
  8%|▊         | 30229/371472 [2:24:28<25:52:55,  3.66it/s]
  8%|▊         | 30230/371472 [2:24:28<25:41:06,  3.69it/s]
  8%|▊         | 30231/371472 [2:24:28<26:05:06,  3.63it/s]
  8%|▊         | 30232/371472 [2:24:29<27:38:35,  3.43it/s]
  8%|▊         | 30233/371472 [2:24:29<26:51:17,  3.53it/s]
  8%|▊         | 30234/371472 [2:24:29<26:26:00,  3.59it/s]
  8%|▊         | 30235/371472 [2:24:29<25:43:42,  3.68it/s]
  8%|▊         | 30236/371472 [2:24:30<26:53:24,  3.53it/s]
  8%|▊         | 30237/371472 [2:24:30<28:21:46,  3.34it/s]
  8%|▊         | 30238/371472 [2:24:30<27:55:50,  3.39it/s]
  8%|▊         | 30239/371472 [2:24:31<27:50:10,  3.41it/s]
  8%|▊         | 30240/371472 [2:24:31<27:37:53,  3.43it/s]
                                                           
{'loss': 7.8115, 'learning_rate': 9.271800728307009e-07, 'epoch': 1.3}

  8%|▊         | 30240/371472 [2:24:31<27:37:53,  3.43it/s]
  8%|▊         | 30241/371472 [2:24:31<26:56:34,  3.52it/s]
  8%|▊         | 30242/371472 [2:24:31<27:19:03,  3.47it/s]
  8%|▊         | 30243/371472 [2:24:32<27:06:44,  3.50it/s]
  8%|▊         | 30244/371472 [2:24:32<30:24:45,  3.12it/s]
  8%|▊         | 30245/371472 [2:24:32<29:31:22,  3.21it/s]
  8%|▊         | 30246/371472 [2:24:33<27:57:40,  3.39it/s]
  8%|▊         | 30247/371472 [2:24:33<29:08:20,  3.25it/s]
  8%|▊         | 30248/371472 [2:24:33<29:20:34,  3.23it/s]
  8%|▊         | 30249/371472 [2:24:34<30:43:27,  3.08it/s]
  8%|▊         | 30250/371472 [2:24:34<28:55:47,  3.28it/s]
  8%|▊         | 30251/371472 [2:24:34<28:09:40,  3.37it/s]
  8%|▊         | 30252/371472 [2:24:35<28:30:05,  3.33it/s]
  8%|▊         | 30253/371472 [2:24:35<27:58:52,  3.39it/s]
  8%|▊         | 30254/371472 [2:24:35<27:41:11,  3.42it/s]
  8%|▊         | 30255/371472 [2:24:35<27:51:08,  3.40it/s]
  8%|▊         | 30256/371472 [2:24:36<27:24:01,  3.46it/s]
  8%|▊         | 30257/371472 [2:24:36<26:49:56,  3.53it/s]
  8%|▊         | 30258/371472 [2:24:36<26:53:05,  3.53it/s]
  8%|▊         | 30259/371472 [2:24:37<26:35:05,  3.57it/s]
  8%|▊         | 30260/371472 [2:24:37<27:16:43,  3.47it/s]
                                                           
{'loss': 7.3245, 'learning_rate': 9.271315908552221e-07, 'epoch': 1.3}

  8%|▊         | 30260/371472 [2:24:37<27:16:43,  3.47it/s]
  8%|▊         | 30261/371472 [2:24:37<27:52:45,  3.40it/s]
  8%|▊         | 30262/371472 [2:24:37<28:19:44,  3.35it/s]
  8%|▊         | 30263/371472 [2:24:38<30:18:07,  3.13it/s]
  8%|▊         | 30264/371472 [2:24:38<30:30:31,  3.11it/s]
  8%|▊         | 30265/371472 [2:24:39<31:39:34,  2.99it/s]
  8%|▊         | 30266/371472 [2:24:39<30:49:48,  3.07it/s]
  8%|▊         | 30267/371472 [2:24:39<28:36:38,  3.31it/s]
  8%|▊         | 30268/371472 [2:24:39<27:37:59,  3.43it/s]
  8%|▊         | 30269/371472 [2:24:40<26:58:01,  3.51it/s]
  8%|▊         | 30270/371472 [2:24:40<28:43:03,  3.30it/s]
  8%|▊         | 30271/371472 [2:24:40<30:35:06,  3.10it/s]
  8%|▊         | 30272/371472 [2:24:41<28:36:42,  3.31it/s]
  8%|▊         | 30273/371472 [2:24:41<27:27:24,  3.45it/s]
  8%|▊         | 30274/371472 [2:24:41<27:39:24,  3.43it/s]
  8%|▊         | 30275/371472 [2:24:41<26:36:40,  3.56it/s]
  8%|▊         | 30276/371472 [2:24:42<30:31:09,  3.11it/s]
  8%|▊         | 30277/371472 [2:24:42<28:33:49,  3.32it/s]
  8%|▊         | 30278/371472 [2:24:42<28:00:40,  3.38it/s]
  8%|▊         | 30279/371472 [2:24:43<27:18:01,  3.47it/s]
  8%|▊         | 30280/371472 [2:24:43<26:41:58,  3.55it/s]
                                                           
{'loss': 6.7679, 'learning_rate': 9.270831088797431e-07, 'epoch': 1.3}

  8%|▊         | 30280/371472 [2:24:43<26:41:58,  3.55it/s]
  8%|▊         | 30281/371472 [2:24:43<26:56:34,  3.52it/s]
  8%|▊         | 30282/371472 [2:24:43<26:43:40,  3.55it/s]
  8%|▊         | 30283/371472 [2:24:44<26:10:21,  3.62it/s]
  8%|▊         | 30284/371472 [2:24:44<27:12:12,  3.48it/s]
  8%|▊         | 30285/371472 [2:24:44<27:11:27,  3.49it/s]
  8%|▊         | 30286/371472 [2:24:45<27:09:26,  3.49it/s]
  8%|▊         | 30287/371472 [2:24:45<26:23:11,  3.59it/s]
  8%|▊         | 30288/371472 [2:24:45<26:01:20,  3.64it/s]
  8%|▊         | 30289/371472 [2:24:45<26:04:06,  3.64it/s]
  8%|▊         | 30290/371472 [2:24:46<26:34:43,  3.57it/s]
  8%|▊         | 30291/371472 [2:24:46<26:42:29,  3.55it/s]
  8%|▊         | 30292/371472 [2:24:46<27:36:22,  3.43it/s]
  8%|▊         | 30293/371472 [2:24:47<26:44:05,  3.54it/s]
  8%|▊         | 30294/371472 [2:24:47<27:16:34,  3.47it/s]
  8%|▊         | 30295/371472 [2:24:47<28:00:36,  3.38it/s]
  8%|▊         | 30296/371472 [2:24:47<27:13:53,  3.48it/s]
  8%|▊         | 30297/371472 [2:24:48<26:27:45,  3.58it/s]
  8%|▊         | 30298/371472 [2:24:48<25:30:20,  3.72it/s]
  8%|▊         | 30299/371472 [2:24:48<25:33:48,  3.71it/s]
  8%|▊         | 30300/371472 [2:24:49<26:18:12,  3.60it/s]
                                                           
{'loss': 7.2834, 'learning_rate': 9.270346269042642e-07, 'epoch': 1.31}

  8%|▊         | 30300/371472 [2:24:49<26:18:12,  3.60it/s]
  8%|▊         | 30301/371472 [2:24:49<27:40:11,  3.43it/s]
  8%|▊         | 30302/371472 [2:24:49<26:54:21,  3.52it/s]
  8%|▊         | 30303/371472 [2:24:49<27:56:01,  3.39it/s]
  8%|▊         | 30304/371472 [2:24:50<27:04:59,  3.50it/s]
  8%|▊         | 30305/371472 [2:24:50<28:09:38,  3.37it/s]
  8%|▊         | 30306/371472 [2:24:51<38:00:21,  2.49it/s]
  8%|▊         | 30307/371472 [2:24:51<35:29:32,  2.67it/s]
  8%|▊         | 30308/371472 [2:24:51<32:52:00,  2.88it/s]
  8%|▊         | 30309/371472 [2:24:52<30:46:06,  3.08it/s]
  8%|▊         | 30310/371472 [2:24:52<29:25:46,  3.22it/s]
  8%|▊         | 30311/371472 [2:24:52<28:03:52,  3.38it/s]
  8%|▊         | 30312/371472 [2:24:52<26:43:36,  3.55it/s]
  8%|▊         | 30313/371472 [2:24:53<26:43:07,  3.55it/s]
  8%|▊         | 30314/371472 [2:24:53<28:53:07,  3.28it/s]
  8%|▊         | 30315/371472 [2:24:53<27:46:27,  3.41it/s]
  8%|▊         | 30316/371472 [2:24:53<26:41:16,  3.55it/s]
  8%|▊         | 30317/371472 [2:24:54<26:23:10,  3.59it/s]
  8%|▊         | 30318/371472 [2:24:54<25:54:28,  3.66it/s]
  8%|▊         | 30319/371472 [2:24:54<25:55:44,  3.65it/s]
  8%|▊         | 30320/371472 [2:24:55<26:35:38,  3.56it/s]
                                                           
{'loss': 7.2348, 'learning_rate': 9.269861449287853e-07, 'epoch': 1.31}

  8%|▊         | 30320/371472 [2:24:55<26:35:38,  3.56it/s]
  8%|▊         | 30321/371472 [2:24:55<26:17:15,  3.60it/s]
  8%|▊         | 30322/371472 [2:24:55<27:37:05,  3.43it/s]
  8%|▊         | 30323/371472 [2:24:55<27:20:33,  3.47it/s]
  8%|▊         | 30324/371472 [2:24:56<26:30:25,  3.58it/s]
  8%|▊         | 30325/371472 [2:24:56<26:31:36,  3.57it/s]
  8%|▊         | 30326/371472 [2:24:56<26:08:10,  3.63it/s]
  8%|▊         | 30327/371472 [2:24:57<26:50:14,  3.53it/s]
  8%|▊         | 30328/371472 [2:24:57<26:31:07,  3.57it/s]
  8%|▊         | 30329/371472 [2:24:57<27:46:54,  3.41it/s]
  8%|▊         | 30330/371472 [2:24:57<26:48:41,  3.53it/s]
  8%|▊         | 30331/371472 [2:24:58<26:07:26,  3.63it/s]
  8%|▊         | 30332/371472 [2:24:58<26:09:16,  3.62it/s]
  8%|▊         | 30333/371472 [2:24:58<28:42:21,  3.30it/s]
  8%|▊         | 30334/371472 [2:24:59<27:35:36,  3.43it/s]
  8%|▊         | 30335/371472 [2:24:59<27:31:55,  3.44it/s]
  8%|▊         | 30336/371472 [2:24:59<26:58:53,  3.51it/s]
  8%|▊         | 30337/371472 [2:25:00<30:04:12,  3.15it/s]
  8%|▊         | 30338/371472 [2:25:00<28:50:19,  3.29it/s]
  8%|▊         | 30339/371472 [2:25:00<27:42:02,  3.42it/s]
  8%|▊         | 30340/371472 [2:25:00<27:44:17,  3.42it/s]
                                                           
{'loss': 7.0163, 'learning_rate': 9.269376629533064e-07, 'epoch': 1.31}

  8%|▊         | 30340/371472 [2:25:00<27:44:17,  3.42it/s]
  8%|▊         | 30341/371472 [2:25:01<27:09:39,  3.49it/s]
  8%|▊         | 30342/371472 [2:25:01<26:31:13,  3.57it/s]
  8%|▊         | 30343/371472 [2:25:01<28:43:10,  3.30it/s]
  8%|▊         | 30344/371472 [2:25:02<28:56:04,  3.27it/s]
  8%|▊         | 30345/371472 [2:25:02<27:46:17,  3.41it/s]
  8%|▊         | 30346/371472 [2:25:02<26:38:05,  3.56it/s]
  8%|▊         | 30347/371472 [2:25:02<26:08:00,  3.63it/s]
  8%|▊         | 30348/371472 [2:25:03<25:20:33,  3.74it/s]
  8%|▊         | 30349/371472 [2:25:03<29:56:42,  3.16it/s]
  8%|▊         | 30350/371472 [2:25:03<28:04:40,  3.37it/s]
  8%|▊         | 30351/371472 [2:25:04<28:08:23,  3.37it/s]
  8%|▊         | 30352/371472 [2:25:04<29:21:08,  3.23it/s]
  8%|▊         | 30353/371472 [2:25:04<28:23:26,  3.34it/s]
  8%|▊         | 30354/371472 [2:25:04<27:02:11,  3.50it/s]
  8%|▊         | 30355/371472 [2:25:05<26:54:52,  3.52it/s]
  8%|▊         | 30356/371472 [2:25:05<27:50:31,  3.40it/s]
  8%|▊         | 30357/371472 [2:25:05<27:10:29,  3.49it/s]
  8%|▊         | 30358/371472 [2:25:06<29:43:13,  3.19it/s]
  8%|▊         | 30359/371472 [2:25:06<28:40:57,  3.30it/s]
  8%|▊         | 30360/371472 [2:25:06<28:04:54,  3.37it/s]
                                                           
{'loss': 7.1488, 'learning_rate': 9.268891809778275e-07, 'epoch': 1.31}

  8%|▊         | 30360/371472 [2:25:06<28:04:54,  3.37it/s]
  8%|▊         | 30361/371472 [2:25:07<27:27:08,  3.45it/s]
  8%|▊         | 30362/371472 [2:25:07<28:05:02,  3.37it/s]
  8%|▊         | 30363/371472 [2:25:07<27:24:26,  3.46it/s]
  8%|▊         | 30364/371472 [2:25:07<26:53:38,  3.52it/s]
  8%|▊         | 30365/371472 [2:25:08<26:45:30,  3.54it/s]
  8%|▊         | 30366/371472 [2:25:08<26:18:32,  3.60it/s]
  8%|▊         | 30367/371472 [2:25:08<26:42:07,  3.55it/s]
  8%|▊         | 30368/371472 [2:25:09<26:57:43,  3.51it/s]
  8%|▊         | 30369/371472 [2:25:09<25:44:25,  3.68it/s]
  8%|▊         | 30370/371472 [2:25:09<25:30:02,  3.72it/s]
  8%|▊         | 30371/371472 [2:25:09<25:10:37,  3.76it/s]
  8%|▊         | 30372/371472 [2:25:10<25:25:54,  3.73it/s]
  8%|▊         | 30373/371472 [2:25:10<25:16:56,  3.75it/s]
  8%|▊         | 30374/371472 [2:25:10<25:23:15,  3.73it/s]
  8%|▊         | 30375/371472 [2:25:10<25:27:27,  3.72it/s]
  8%|▊         | 30376/371472 [2:25:11<25:33:30,  3.71it/s]
  8%|▊         | 30377/371472 [2:25:11<25:39:46,  3.69it/s]
  8%|▊         | 30378/371472 [2:25:11<25:43:17,  3.68it/s]
  8%|▊         | 30379/371472 [2:25:11<25:16:10,  3.75it/s]
  8%|▊         | 30380/371472 [2:25:12<27:58:28,  3.39it/s]
                                                           
{'loss': 7.7662, 'learning_rate': 9.268406990023487e-07, 'epoch': 1.31}

  8%|▊         | 30380/371472 [2:25:12<27:58:28,  3.39it/s]
  8%|▊         | 30381/371472 [2:25:12<28:12:03,  3.36it/s]
  8%|▊         | 30382/371472 [2:25:12<28:32:26,  3.32it/s]
  8%|▊         | 30383/371472 [2:25:13<28:39:24,  3.31it/s]
  8%|▊         | 30384/371472 [2:25:13<29:17:39,  3.23it/s]
  8%|▊         | 30385/371472 [2:25:13<28:59:29,  3.27it/s]
  8%|▊         | 30386/371472 [2:25:14<28:34:34,  3.32it/s]
  8%|▊         | 30387/371472 [2:25:14<28:24:32,  3.34it/s]
  8%|▊         | 30388/371472 [2:25:14<31:29:53,  3.01it/s]
  8%|▊         | 30389/371472 [2:25:15<33:11:40,  2.85it/s]
  8%|▊         | 30390/371472 [2:25:15<32:12:17,  2.94it/s]
  8%|▊         | 30391/371472 [2:25:15<30:33:28,  3.10it/s]
  8%|▊         | 30392/371472 [2:25:16<29:32:03,  3.21it/s]
  8%|▊         | 30393/371472 [2:25:16<28:32:34,  3.32it/s]
  8%|▊         | 30394/371472 [2:25:16<28:13:27,  3.36it/s]
  8%|▊         | 30395/371472 [2:25:16<27:16:38,  3.47it/s]
  8%|▊         | 30396/371472 [2:25:17<28:03:19,  3.38it/s]
  8%|▊         | 30397/371472 [2:25:17<27:28:46,  3.45it/s]
  8%|▊         | 30398/371472 [2:25:17<26:06:39,  3.63it/s]
  8%|▊         | 30399/371472 [2:25:18<25:59:04,  3.65it/s]
  8%|▊         | 30400/371472 [2:25:18<25:21:07,  3.74it/s]
                                                           
{'loss': 7.1247, 'learning_rate': 9.267922170268698e-07, 'epoch': 1.31}

  8%|▊         | 30400/371472 [2:25:18<25:21:07,  3.74it/s]
  8%|▊         | 30401/371472 [2:25:18<26:52:03,  3.53it/s]
  8%|▊         | 30402/371472 [2:25:18<28:22:18,  3.34it/s]
  8%|▊         | 30403/371472 [2:25:19<27:57:49,  3.39it/s]
  8%|▊         | 30404/371472 [2:25:19<26:50:19,  3.53it/s]
  8%|▊         | 30405/371472 [2:25:19<26:59:06,  3.51it/s]
  8%|▊         | 30406/371472 [2:25:20<28:04:20,  3.37it/s]
  8%|▊         | 30407/371472 [2:25:20<27:16:12,  3.47it/s]
  8%|▊         | 30408/371472 [2:25:20<26:44:50,  3.54it/s]
  8%|▊         | 30409/371472 [2:25:20<26:23:52,  3.59it/s]
  8%|▊         | 30410/371472 [2:25:21<25:32:59,  3.71it/s]
  8%|▊         | 30411/371472 [2:25:21<25:38:48,  3.69it/s]
  8%|▊         | 30412/371472 [2:25:21<25:29:58,  3.72it/s]
  8%|▊         | 30413/371472 [2:25:21<25:51:14,  3.66it/s]
  8%|▊         | 30414/371472 [2:25:22<26:49:33,  3.53it/s]
  8%|▊         | 30415/371472 [2:25:22<26:28:32,  3.58it/s]
  8%|▊         | 30416/371472 [2:25:22<25:45:59,  3.68it/s]
  8%|▊         | 30417/371472 [2:25:23<25:39:45,  3.69it/s]
  8%|▊         | 30418/371472 [2:25:23<25:19:44,  3.74it/s]
  8%|▊         | 30419/371472 [2:25:23<27:35:06,  3.43it/s]
  8%|▊         | 30420/371472 [2:25:23<27:16:01,  3.47it/s]
                                                           
{'loss': 7.4735, 'learning_rate': 9.267437350513908e-07, 'epoch': 1.31}

  8%|▊         | 30420/371472 [2:25:23<27:16:01,  3.47it/s]
  8%|▊         | 30421/371472 [2:25:24<28:23:31,  3.34it/s]
  8%|▊         | 30422/371472 [2:25:24<27:30:40,  3.44it/s]
  8%|▊         | 30423/371472 [2:25:24<28:04:18,  3.37it/s]
  8%|▊         | 30424/371472 [2:25:25<30:40:58,  3.09it/s]
  8%|▊         | 30425/371472 [2:25:25<30:34:53,  3.10it/s]
  8%|▊         | 30426/371472 [2:25:25<32:01:16,  2.96it/s]
  8%|▊         | 30427/371472 [2:25:26<30:17:37,  3.13it/s]
  8%|▊         | 30428/371472 [2:25:26<28:24:02,  3.34it/s]
  8%|▊         | 30429/371472 [2:25:26<28:22:36,  3.34it/s]
  8%|▊         | 30430/371472 [2:25:27<28:20:35,  3.34it/s]
  8%|▊         | 30431/371472 [2:25:27<27:53:55,  3.40it/s]
  8%|▊         | 30432/371472 [2:25:27<29:47:05,  3.18it/s]
  8%|▊         | 30433/371472 [2:25:27<28:00:57,  3.38it/s]
  8%|▊         | 30434/371472 [2:25:28<27:54:54,  3.39it/s]
  8%|▊         | 30435/371472 [2:25:28<27:37:00,  3.43it/s]
  8%|▊         | 30436/371472 [2:25:28<27:32:51,  3.44it/s]
  8%|▊         | 30437/371472 [2:25:29<26:28:17,  3.58it/s]
  8%|▊         | 30438/371472 [2:25:29<26:06:20,  3.63it/s]
  8%|▊         | 30439/371472 [2:25:29<27:35:41,  3.43it/s]
  8%|▊         | 30440/371472 [2:25:29<28:04:48,  3.37it/s]
                                                           
{'loss': 7.2543, 'learning_rate': 9.266952530759119e-07, 'epoch': 1.31}

  8%|▊         | 30440/371472 [2:25:29<28:04:48,  3.37it/s]
  8%|▊         | 30441/371472 [2:25:30<27:22:12,  3.46it/s]
  8%|▊         | 30442/371472 [2:25:30<27:21:42,  3.46it/s]
  8%|▊         | 30443/371472 [2:25:30<26:11:46,  3.62it/s]
  8%|▊         | 30444/371472 [2:25:31<25:52:08,  3.66it/s]
  8%|▊         | 30445/371472 [2:25:31<27:00:24,  3.51it/s]
  8%|▊         | 30446/371472 [2:25:31<26:46:34,  3.54it/s]
  8%|▊         | 30447/371472 [2:25:31<27:24:04,  3.46it/s]
  8%|▊         | 30448/371472 [2:25:32<27:12:50,  3.48it/s]
  8%|▊         | 30449/371472 [2:25:32<26:31:40,  3.57it/s]
  8%|▊         | 30450/371472 [2:25:32<28:00:45,  3.38it/s]
  8%|▊         | 30451/371472 [2:25:33<27:37:01,  3.43it/s]
  8%|▊         | 30452/371472 [2:25:33<28:15:20,  3.35it/s]
  8%|▊         | 30453/371472 [2:25:33<27:22:25,  3.46it/s]
  8%|▊         | 30454/371472 [2:25:33<27:13:35,  3.48it/s]
  8%|▊         | 30455/371472 [2:25:34<27:36:59,  3.43it/s]
  8%|▊         | 30456/371472 [2:25:34<26:42:27,  3.55it/s]
  8%|▊         | 30457/371472 [2:25:34<25:49:58,  3.67it/s]
  8%|▊         | 30458/371472 [2:25:35<28:51:21,  3.28it/s]
  8%|▊         | 30459/371472 [2:25:35<27:40:35,  3.42it/s]
  8%|▊         | 30460/371472 [2:25:35<26:43:24,  3.54it/s]
                                                           
{'loss': 7.1354, 'learning_rate': 9.26646771100433e-07, 'epoch': 1.31}

  8%|▊         | 30460/371472 [2:25:35<26:43:24,  3.54it/s]
  8%|▊         | 30461/371472 [2:25:35<26:06:43,  3.63it/s]
  8%|▊         | 30462/371472 [2:25:36<26:12:18,  3.61it/s]
  8%|▊         | 30463/371472 [2:25:36<26:30:02,  3.57it/s]
  8%|▊         | 30464/371472 [2:25:36<26:36:00,  3.56it/s]
  8%|▊         | 30465/371472 [2:25:37<26:57:02,  3.51it/s]
  8%|▊         | 30466/371472 [2:25:37<26:18:25,  3.60it/s]
  8%|▊         | 30467/371472 [2:25:37<26:09:36,  3.62it/s]
  8%|▊         | 30468/371472 [2:25:37<26:46:29,  3.54it/s]
  8%|▊         | 30469/371472 [2:25:38<26:52:57,  3.52it/s]
  8%|▊         | 30470/371472 [2:25:38<26:31:51,  3.57it/s]
  8%|▊         | 30471/371472 [2:25:38<27:01:05,  3.51it/s]
  8%|▊         | 30472/371472 [2:25:39<28:43:37,  3.30it/s]
  8%|▊         | 30473/371472 [2:25:39<27:27:16,  3.45it/s]
  8%|▊         | 30474/371472 [2:25:39<26:37:16,  3.56it/s]
  8%|▊         | 30475/371472 [2:25:39<26:05:54,  3.63it/s]
  8%|▊         | 30476/371472 [2:25:40<25:54:36,  3.66it/s]
  8%|▊         | 30477/371472 [2:25:40<26:18:34,  3.60it/s]
  8%|▊         | 30478/371472 [2:25:40<25:53:54,  3.66it/s]
  8%|▊         | 30479/371472 [2:25:41<25:45:46,  3.68it/s]
  8%|▊         | 30480/371472 [2:25:41<26:00:17,  3.64it/s]
                                                           
{'loss': 7.3775, 'learning_rate': 9.265982891249542e-07, 'epoch': 1.31}

  8%|▊         | 30480/371472 [2:25:41<26:00:17,  3.64it/s]
  8%|▊         | 30481/371472 [2:25:41<25:25:54,  3.72it/s]
  8%|▊         | 30482/371472 [2:25:41<25:09:12,  3.77it/s]
  8%|▊         | 30483/371472 [2:25:42<26:53:20,  3.52it/s]
  8%|▊         | 30484/371472 [2:25:42<26:40:51,  3.55it/s]
  8%|▊         | 30485/371472 [2:25:42<25:46:11,  3.68it/s]
  8%|▊         | 30486/371472 [2:25:42<25:38:53,  3.69it/s]
  8%|▊         | 30487/371472 [2:25:43<26:00:15,  3.64it/s]
  8%|▊         | 30488/371472 [2:25:43<26:28:01,  3.58it/s]
  8%|▊         | 30489/371472 [2:25:43<27:00:15,  3.51it/s]
  8%|▊         | 30490/371472 [2:25:44<26:48:31,  3.53it/s]
  8%|▊         | 30491/371472 [2:25:44<26:26:04,  3.58it/s]
  8%|▊         | 30492/371472 [2:25:44<26:53:00,  3.52it/s]
  8%|▊         | 30493/371472 [2:25:44<26:20:34,  3.60it/s]
  8%|▊         | 30494/371472 [2:25:45<26:13:07,  3.61it/s]
  8%|▊         | 30495/371472 [2:25:45<31:55:08,  2.97it/s]
  8%|▊         | 30496/371472 [2:25:45<30:13:25,  3.13it/s]
  8%|▊         | 30497/371472 [2:25:46<28:07:44,  3.37it/s]
  8%|▊         | 30498/371472 [2:25:46<27:08:26,  3.49it/s]
  8%|▊         | 30499/371472 [2:25:46<26:31:20,  3.57it/s]
  8%|▊         | 30500/371472 [2:25:47<27:08:31,  3.49it/s]
                                                           
{'loss': 6.9614, 'learning_rate': 9.265498071494753e-07, 'epoch': 1.31}

  8%|▊         | 30500/371472 [2:25:47<27:08:31,  3.49it/s]
  8%|▊         | 30501/371472 [2:25:47<25:53:26,  3.66it/s]
  8%|▊         | 30502/371472 [2:25:47<25:22:55,  3.73it/s]
  8%|▊         | 30503/371472 [2:25:47<25:56:15,  3.65it/s]
  8%|▊         | 30504/371472 [2:25:48<26:06:02,  3.63it/s]
  8%|▊         | 30505/371472 [2:25:48<28:04:36,  3.37it/s]
  8%|▊         | 30506/371472 [2:25:48<27:45:34,  3.41it/s]
  8%|▊         | 30507/371472 [2:25:48<27:10:05,  3.49it/s]
  8%|▊         | 30508/371472 [2:25:49<26:23:29,  3.59it/s]
  8%|▊         | 30509/371472 [2:25:49<25:35:14,  3.70it/s]
  8%|▊         | 30510/371472 [2:25:49<25:51:21,  3.66it/s]
  8%|▊         | 30511/371472 [2:25:50<27:14:18,  3.48it/s]
  8%|▊         | 30512/371472 [2:25:50<26:24:37,  3.59it/s]
  8%|▊         | 30513/371472 [2:25:50<26:30:37,  3.57it/s]
  8%|▊         | 30514/371472 [2:25:50<25:28:41,  3.72it/s]
  8%|▊         | 30515/371472 [2:25:51<26:38:20,  3.56it/s]
  8%|▊         | 30516/371472 [2:25:51<27:24:07,  3.46it/s]
  8%|▊         | 30517/371472 [2:25:51<27:01:59,  3.50it/s]
  8%|▊         | 30518/371472 [2:25:52<28:04:53,  3.37it/s]
  8%|▊         | 30519/371472 [2:25:52<27:15:55,  3.47it/s]
  8%|▊         | 30520/371472 [2:25:52<28:10:23,  3.36it/s]
                                                           
{'loss': 7.279, 'learning_rate': 9.265013251739965e-07, 'epoch': 1.31}

  8%|▊         | 30520/371472 [2:25:52<28:10:23,  3.36it/s]
  8%|▊         | 30521/371472 [2:25:52<27:35:47,  3.43it/s]
  8%|▊         | 30522/371472 [2:25:53<26:55:33,  3.52it/s]
  8%|▊         | 30523/371472 [2:25:53<27:45:57,  3.41it/s]
  8%|▊         | 30524/371472 [2:25:53<26:40:07,  3.55it/s]
  8%|▊         | 30525/371472 [2:25:54<25:57:46,  3.65it/s]
  8%|▊         | 30526/371472 [2:25:54<27:26:54,  3.45it/s]
  8%|▊         | 30527/371472 [2:25:54<28:12:36,  3.36it/s]
  8%|▊         | 30528/371472 [2:25:54<27:16:22,  3.47it/s]
  8%|▊         | 30529/371472 [2:25:55<26:42:26,  3.55it/s]
  8%|▊         | 30530/371472 [2:25:55<27:46:45,  3.41it/s]
  8%|▊         | 30531/371472 [2:25:55<26:55:13,  3.52it/s]
  8%|▊         | 30532/371472 [2:25:56<26:49:18,  3.53it/s]
  8%|▊         | 30533/371472 [2:25:56<26:02:53,  3.64it/s]
  8%|▊         | 30534/371472 [2:25:56<25:46:06,  3.68it/s]
  8%|▊         | 30535/371472 [2:25:56<28:30:26,  3.32it/s]
  8%|▊         | 30536/371472 [2:25:57<29:20:04,  3.23it/s]
  8%|▊         | 30537/371472 [2:25:57<28:54:44,  3.28it/s]
  8%|▊         | 30538/371472 [2:25:57<27:49:42,  3.40it/s]
  8%|▊         | 30539/371472 [2:25:58<28:19:46,  3.34it/s]
  8%|▊         | 30540/371472 [2:25:58<29:37:49,  3.20it/s]
                                                           
{'loss': 7.148, 'learning_rate': 9.264528431985175e-07, 'epoch': 1.32}

  8%|▊         | 30540/371472 [2:25:58<29:37:49,  3.20it/s]
  8%|▊         | 30541/371472 [2:25:58<30:40:19,  3.09it/s]
  8%|▊         | 30542/371472 [2:25:59<29:30:16,  3.21it/s]
  8%|▊         | 30543/371472 [2:25:59<30:21:45,  3.12it/s]
  8%|▊         | 30544/371472 [2:25:59<28:37:07,  3.31it/s]
  8%|▊         | 30545/371472 [2:26:00<27:23:23,  3.46it/s]
  8%|▊         | 30546/371472 [2:26:00<27:22:30,  3.46it/s]
  8%|▊         | 30547/371472 [2:26:00<26:25:28,  3.58it/s]
  8%|▊         | 30548/371472 [2:26:00<25:58:21,  3.65it/s]
  8%|▊         | 30549/371472 [2:26:01<26:04:53,  3.63it/s]
  8%|▊         | 30550/371472 [2:26:01<25:46:37,  3.67it/s]
  8%|▊         | 30551/371472 [2:26:01<25:35:22,  3.70it/s]
  8%|▊         | 30552/371472 [2:26:01<25:50:23,  3.66it/s]
  8%|▊         | 30553/371472 [2:26:02<28:37:03,  3.31it/s]
  8%|▊         | 30554/371472 [2:26:02<29:11:45,  3.24it/s]
  8%|▊         | 30555/371472 [2:26:02<27:53:31,  3.40it/s]
  8%|▊         | 30556/371472 [2:26:03<28:41:43,  3.30it/s]
  8%|▊         | 30557/371472 [2:26:03<29:06:46,  3.25it/s]
  8%|▊         | 30558/371472 [2:26:03<28:10:49,  3.36it/s]
  8%|▊         | 30559/371472 [2:26:04<28:04:19,  3.37it/s]
  8%|▊         | 30560/371472 [2:26:04<27:14:20,  3.48it/s]
                                                           
{'loss': 6.9021, 'learning_rate': 9.264043612230386e-07, 'epoch': 1.32}

  8%|▊         | 30560/371472 [2:26:04<27:14:20,  3.48it/s]
  8%|▊         | 30561/371472 [2:26:04<26:50:36,  3.53it/s]
  8%|▊         | 30562/371472 [2:26:04<26:30:23,  3.57it/s]
  8%|▊         | 30563/371472 [2:26:05<26:13:35,  3.61it/s]
  8%|▊         | 30564/371472 [2:26:05<25:47:02,  3.67it/s]
  8%|▊         | 30565/371472 [2:26:05<26:10:12,  3.62it/s]
  8%|▊         | 30566/371472 [2:26:06<26:57:20,  3.51it/s]
  8%|▊         | 30567/371472 [2:26:06<25:58:17,  3.65it/s]
  8%|▊         | 30568/371472 [2:26:06<26:09:26,  3.62it/s]
  8%|▊         | 30569/371472 [2:26:06<25:26:55,  3.72it/s]
  8%|▊         | 30570/371472 [2:26:07<25:51:08,  3.66it/s]
  8%|▊         | 30571/371472 [2:26:07<25:33:06,  3.71it/s]
  8%|▊         | 30572/371472 [2:26:07<24:49:23,  3.81it/s]
  8%|▊         | 30573/371472 [2:26:07<26:51:03,  3.53it/s]
  8%|▊         | 30574/371472 [2:26:08<26:53:05,  3.52it/s]
  8%|▊         | 30575/371472 [2:26:08<25:45:01,  3.68it/s]
  8%|▊         | 30576/371472 [2:26:08<26:28:35,  3.58it/s]
  8%|▊         | 30577/371472 [2:26:09<26:23:33,  3.59it/s]
  8%|▊         | 30578/371472 [2:26:09<26:13:02,  3.61it/s]
  8%|▊         | 30579/371472 [2:26:09<25:53:55,  3.66it/s]
  8%|▊         | 30580/371472 [2:26:09<25:24:06,  3.73it/s]
                                                           
{'loss': 7.1499, 'learning_rate': 9.263558792475596e-07, 'epoch': 1.32}

  8%|▊         | 30580/371472 [2:26:09<25:24:06,  3.73it/s]
  8%|▊         | 30581/371472 [2:26:10<25:16:04,  3.75it/s]
  8%|▊         | 30582/371472 [2:26:10<25:27:22,  3.72it/s]
  8%|▊         | 30583/371472 [2:26:10<25:25:35,  3.72it/s]
  8%|▊         | 30584/371472 [2:26:10<25:51:27,  3.66it/s]
  8%|▊         | 30585/371472 [2:26:11<25:00:45,  3.79it/s]
  8%|▊         | 30586/371472 [2:26:11<24:39:27,  3.84it/s]
  8%|▊         | 30587/371472 [2:26:11<25:15:40,  3.75it/s]
  8%|▊         | 30588/371472 [2:26:11<24:25:47,  3.88it/s]
  8%|▊         | 30589/371472 [2:26:12<28:06:19,  3.37it/s]
  8%|▊         | 30590/371472 [2:26:12<27:49:06,  3.40it/s]
  8%|▊         | 30591/371472 [2:26:12<27:00:30,  3.51it/s]
  8%|▊         | 30592/371472 [2:26:13<27:37:56,  3.43it/s]
  8%|▊         | 30593/371472 [2:26:13<28:50:20,  3.28it/s]
  8%|▊         | 30594/371472 [2:26:13<27:15:55,  3.47it/s]
  8%|▊         | 30595/371472 [2:26:14<28:12:04,  3.36it/s]
  8%|▊         | 30596/371472 [2:26:14<28:07:53,  3.37it/s]
  8%|▊         | 30597/371472 [2:26:14<28:47:04,  3.29it/s]
  8%|▊         | 30598/371472 [2:26:14<28:44:43,  3.29it/s]
  8%|▊         | 30599/371472 [2:26:15<28:39:09,  3.30it/s]
  8%|▊         | 30600/371472 [2:26:15<28:00:51,  3.38it/s]
                                                           
{'loss': 7.1387, 'learning_rate': 9.263073972720808e-07, 'epoch': 1.32}

  8%|▊         | 30600/371472 [2:26:15<28:00:51,  3.38it/s]
  8%|▊         | 30601/371472 [2:26:15<27:35:58,  3.43it/s]
  8%|▊         | 30602/371472 [2:26:16<29:18:58,  3.23it/s]
  8%|▊         | 30603/371472 [2:26:16<28:36:24,  3.31it/s]
  8%|▊         | 30604/371472 [2:26:16<28:43:57,  3.30it/s]
  8%|▊         | 30605/371472 [2:26:17<27:18:37,  3.47it/s]
  8%|▊         | 30606/371472 [2:26:17<27:05:04,  3.50it/s]
  8%|▊         | 30607/371472 [2:26:17<27:44:50,  3.41it/s]
  8%|▊         | 30608/371472 [2:26:17<26:30:30,  3.57it/s]
  8%|▊         | 30609/371472 [2:26:18<28:08:46,  3.36it/s]
  8%|▊         | 30610/371472 [2:26:18<29:02:48,  3.26it/s]
  8%|▊         | 30611/371472 [2:26:18<29:37:18,  3.20it/s]
  8%|▊         | 30612/371472 [2:26:19<28:07:12,  3.37it/s]
  8%|▊         | 30613/371472 [2:26:19<27:05:02,  3.50it/s]
  8%|▊         | 30614/371472 [2:26:19<30:00:13,  3.16it/s]
  8%|▊         | 30615/371472 [2:26:20<28:58:41,  3.27it/s]
  8%|▊         | 30616/371472 [2:26:20<28:45:23,  3.29it/s]
  8%|▊         | 30617/371472 [2:26:20<27:59:14,  3.38it/s]
  8%|▊         | 30618/371472 [2:26:20<28:55:04,  3.27it/s]
  8%|▊         | 30619/371472 [2:26:21<27:30:58,  3.44it/s]
  8%|▊         | 30620/371472 [2:26:21<27:56:13,  3.39it/s]
                                                           
{'loss': 7.1563, 'learning_rate': 9.262589152966019e-07, 'epoch': 1.32}

  8%|▊         | 30620/371472 [2:26:21<27:56:13,  3.39it/s]
  8%|▊         | 30621/371472 [2:26:21<29:29:05,  3.21it/s]
  8%|▊         | 30622/371472 [2:26:22<29:54:30,  3.17it/s]
  8%|▊         | 30623/371472 [2:26:22<28:49:25,  3.28it/s]
  8%|▊         | 30624/371472 [2:26:22<27:55:05,  3.39it/s]
  8%|▊         | 30625/371472 [2:26:23<27:08:39,  3.49it/s]
  8%|▊         | 30626/371472 [2:26:23<30:12:15,  3.13it/s]
  8%|▊         | 30627/371472 [2:26:23<30:59:19,  3.06it/s]
  8%|▊         | 30628/371472 [2:26:24<31:36:28,  3.00it/s]
  8%|▊         | 30629/371472 [2:26:24<30:14:27,  3.13it/s]
  8%|▊         | 30630/371472 [2:26:24<28:33:45,  3.31it/s]
  8%|▊         | 30631/371472 [2:26:24<28:25:56,  3.33it/s]
  8%|▊         | 30632/371472 [2:26:25<29:00:09,  3.26it/s]
  8%|▊         | 30633/371472 [2:26:25<30:02:52,  3.15it/s]
  8%|▊         | 30634/371472 [2:26:25<28:46:01,  3.29it/s]
  8%|▊         | 30635/371472 [2:26:26<27:51:56,  3.40it/s]
  8%|▊         | 30636/371472 [2:26:26<27:21:19,  3.46it/s]
  8%|▊         | 30637/371472 [2:26:26<26:17:58,  3.60it/s]
  8%|▊         | 30638/371472 [2:26:26<26:12:04,  3.61it/s]
  8%|▊         | 30639/371472 [2:26:27<28:07:46,  3.37it/s]
  8%|▊         | 30640/371472 [2:26:27<27:40:58,  3.42it/s]
                                                           
{'loss': 6.9685, 'learning_rate': 9.262104333211231e-07, 'epoch': 1.32}

  8%|▊         | 30640/371472 [2:26:27<27:40:58,  3.42it/s]
  8%|▊         | 30641/371472 [2:26:27<27:21:51,  3.46it/s]
  8%|▊         | 30642/371472 [2:26:28<26:03:43,  3.63it/s]
  8%|▊         | 30643/371472 [2:26:28<27:18:40,  3.47it/s]
  8%|▊         | 30644/371472 [2:26:28<27:30:05,  3.44it/s]
  8%|▊         | 30645/371472 [2:26:29<27:41:46,  3.42it/s]
  8%|▊         | 30646/371472 [2:26:29<26:53:00,  3.52it/s]
  8%|▊         | 30647/371472 [2:26:29<26:13:01,  3.61it/s]
  8%|▊         | 30648/371472 [2:26:29<26:02:33,  3.64it/s]
  8%|▊         | 30649/371472 [2:26:30<25:44:45,  3.68it/s]
  8%|▊         | 30650/371472 [2:26:30<25:40:58,  3.69it/s]
  8%|▊         | 30651/371472 [2:26:30<25:30:01,  3.71it/s]
  8%|▊         | 30652/371472 [2:26:30<25:23:32,  3.73it/s]
  8%|▊         | 30653/371472 [2:26:31<25:33:50,  3.70it/s]
  8%|▊         | 30654/371472 [2:26:31<25:34:37,  3.70it/s]
  8%|▊         | 30655/371472 [2:26:31<26:52:31,  3.52it/s]
  8%|▊         | 30656/371472 [2:26:32<26:51:25,  3.53it/s]
  8%|▊         | 30657/371472 [2:26:32<25:58:08,  3.65it/s]
  8%|▊         | 30658/371472 [2:26:32<25:08:01,  3.77it/s]
  8%|▊         | 30659/371472 [2:26:32<25:29:37,  3.71it/s]
  8%|▊         | 30660/371472 [2:26:33<25:36:40,  3.70it/s]
                                                           
{'loss': 7.0773, 'learning_rate': 9.261619513456441e-07, 'epoch': 1.32}

  8%|▊         | 30660/371472 [2:26:33<25:36:40,  3.70it/s]
  8%|▊         | 30661/371472 [2:26:33<25:38:11,  3.69it/s]
  8%|▊         | 30662/371472 [2:26:33<26:21:16,  3.59it/s]
  8%|▊         | 30663/371472 [2:26:33<26:02:25,  3.64it/s]
  8%|▊         | 30664/371472 [2:26:34<25:35:37,  3.70it/s]
  8%|▊         | 30665/371472 [2:26:34<25:35:08,  3.70it/s]
  8%|▊         | 30666/371472 [2:26:34<24:43:38,  3.83it/s]
  8%|▊         | 30667/371472 [2:26:35<29:13:36,  3.24it/s]
  8%|▊         | 30668/371472 [2:26:35<27:29:42,  3.44it/s]
  8%|▊         | 30669/371472 [2:26:35<29:24:00,  3.22it/s]
  8%|▊         | 30670/371472 [2:26:35<28:15:03,  3.35it/s]
  8%|▊         | 30671/371472 [2:26:36<29:42:03,  3.19it/s]
  8%|▊         | 30672/371472 [2:26:36<27:59:19,  3.38it/s]
  8%|▊         | 30673/371472 [2:26:36<26:23:05,  3.59it/s]
  8%|▊         | 30674/371472 [2:26:37<25:33:09,  3.70it/s]
  8%|▊         | 30675/371472 [2:26:37<24:49:42,  3.81it/s]
  8%|▊         | 30676/371472 [2:26:37<28:51:58,  3.28it/s]
  8%|▊         | 30677/371472 [2:26:37<27:24:01,  3.45it/s]
  8%|▊         | 30678/371472 [2:26:38<27:34:14,  3.43it/s]
  8%|▊         | 30679/371472 [2:26:38<26:26:48,  3.58it/s]
  8%|▊         | 30680/371472 [2:26:38<26:27:09,  3.58it/s]
                                                           
{'loss': 7.239, 'learning_rate': 9.261134693701652e-07, 'epoch': 1.32}

  8%|▊         | 30680/371472 [2:26:38<26:27:09,  3.58it/s]
  8%|▊         | 30681/371472 [2:26:39<26:11:00,  3.62it/s]
  8%|▊         | 30682/371472 [2:26:39<26:44:21,  3.54it/s]
  8%|▊         | 30683/371472 [2:26:39<26:57:38,  3.51it/s]
  8%|▊         | 30684/371472 [2:26:39<25:39:56,  3.69it/s]
  8%|▊         | 30685/371472 [2:26:40<26:01:42,  3.64it/s]
  8%|▊         | 30686/371472 [2:26:40<25:18:33,  3.74it/s]
  8%|▊         | 30687/371472 [2:26:40<26:07:51,  3.62it/s]
  8%|▊         | 30688/371472 [2:26:41<26:31:56,  3.57it/s]
  8%|▊         | 30689/371472 [2:26:41<26:15:47,  3.60it/s]
  8%|▊         | 30690/371472 [2:26:41<26:23:30,  3.59it/s]
  8%|▊         | 30691/371472 [2:26:41<26:49:21,  3.53it/s]
  8%|▊         | 30692/371472 [2:26:42<26:01:34,  3.64it/s]
  8%|▊         | 30693/371472 [2:26:42<25:08:35,  3.76it/s]
  8%|▊         | 30694/371472 [2:26:42<25:38:38,  3.69it/s]
  8%|▊         | 30695/371472 [2:26:42<25:39:16,  3.69it/s]
  8%|▊         | 30696/371472 [2:26:43<25:23:37,  3.73it/s]
  8%|▊         | 30697/371472 [2:26:43<26:24:17,  3.58it/s]
  8%|▊         | 30698/371472 [2:26:43<26:25:00,  3.58it/s]
  8%|▊         | 30699/371472 [2:26:44<25:41:33,  3.68it/s]
  8%|▊         | 30700/371472 [2:26:44<25:42:00,  3.68it/s]
                                                           
{'loss': 7.333, 'learning_rate': 9.260649873946863e-07, 'epoch': 1.32}

  8%|▊         | 30700/371472 [2:26:44<25:42:00,  3.68it/s]
  8%|▊         | 30701/371472 [2:26:44<25:39:11,  3.69it/s]
  8%|▊         | 30702/371472 [2:26:44<25:08:04,  3.77it/s]
  8%|▊         | 30703/371472 [2:26:45<24:57:53,  3.79it/s]
  8%|▊         | 30704/371472 [2:26:45<25:57:58,  3.65it/s]
  8%|▊         | 30705/371472 [2:26:45<25:48:10,  3.67it/s]
  8%|▊         | 30706/371472 [2:26:45<25:25:43,  3.72it/s]
  8%|▊         | 30707/371472 [2:26:46<25:45:01,  3.68it/s]
  8%|▊         | 30708/371472 [2:26:46<28:30:11,  3.32it/s]
  8%|▊         | 30709/371472 [2:26:46<27:09:12,  3.49it/s]
  8%|▊         | 30710/371472 [2:26:47<26:39:14,  3.55it/s]
  8%|▊         | 30711/371472 [2:26:47<27:17:41,  3.47it/s]
  8%|▊         | 30712/371472 [2:26:47<26:31:05,  3.57it/s]
  8%|▊         | 30713/371472 [2:26:47<25:46:55,  3.67it/s]
  8%|▊         | 30714/371472 [2:26:48<25:20:59,  3.73it/s]
  8%|▊         | 30715/371472 [2:26:48<25:33:00,  3.70it/s]
  8%|▊         | 30716/371472 [2:26:48<26:01:13,  3.64it/s]
  8%|▊         | 30717/371472 [2:26:48<25:24:21,  3.73it/s]
  8%|▊         | 30718/371472 [2:26:49<26:04:07,  3.63it/s]
  8%|▊         | 30719/371472 [2:26:49<27:01:59,  3.50it/s]
  8%|▊         | 30720/371472 [2:26:49<28:17:41,  3.35it/s]
                                                           
{'loss': 7.1882, 'learning_rate': 9.260165054192075e-07, 'epoch': 1.32}

  8%|▊         | 30720/371472 [2:26:49<28:17:41,  3.35it/s]
  8%|▊         | 30721/371472 [2:26:50<28:34:03,  3.31it/s]
  8%|▊         | 30722/371472 [2:26:50<28:34:52,  3.31it/s]
  8%|▊         | 30723/371472 [2:26:50<28:04:43,  3.37it/s]
  8%|▊         | 30724/371472 [2:26:51<27:32:53,  3.44it/s]
  8%|▊         | 30725/371472 [2:26:51<26:02:56,  3.63it/s]
  8%|▊         | 30726/371472 [2:26:51<25:00:46,  3.78it/s]
  8%|▊         | 30727/371472 [2:26:51<26:52:39,  3.52it/s]
  8%|▊         | 30728/371472 [2:26:52<26:59:55,  3.51it/s]
  8%|▊         | 30729/371472 [2:26:52<26:49:42,  3.53it/s]
  8%|▊         | 30730/371472 [2:26:52<27:44:44,  3.41it/s]
  8%|▊         | 30731/371472 [2:26:53<27:03:58,  3.50it/s]
  8%|▊         | 30732/371472 [2:26:53<26:00:48,  3.64it/s]
  8%|▊         | 30733/371472 [2:26:53<25:48:31,  3.67it/s]
  8%|▊         | 30734/371472 [2:26:53<24:55:09,  3.80it/s]
  8%|▊         | 30735/371472 [2:26:54<26:23:40,  3.59it/s]
  8%|▊         | 30736/371472 [2:26:54<25:45:20,  3.67it/s]
  8%|▊         | 30737/371472 [2:26:54<25:44:39,  3.68it/s]
  8%|▊         | 30738/371472 [2:26:54<25:54:48,  3.65it/s]
  8%|▊         | 30739/371472 [2:26:55<25:47:22,  3.67it/s]
  8%|▊         | 30740/371472 [2:26:55<26:30:01,  3.57it/s]
                                                           
{'loss': 7.0352, 'learning_rate': 9.259680234437285e-07, 'epoch': 1.32}

  8%|▊         | 30740/371472 [2:26:55<26:30:01,  3.57it/s]
  8%|▊         | 30741/371472 [2:26:55<26:11:48,  3.61it/s]
  8%|▊         | 30742/371472 [2:26:55<25:46:49,  3.67it/s]
  8%|▊         | 30743/371472 [2:26:56<27:38:08,  3.42it/s]
  8%|▊         | 30744/371472 [2:26:56<27:19:17,  3.46it/s]
  8%|▊         | 30745/371472 [2:26:56<27:20:08,  3.46it/s]
  8%|▊         | 30746/371472 [2:26:57<29:52:31,  3.17it/s]
  8%|▊         | 30747/371472 [2:26:57<30:43:02,  3.08it/s]
  8%|▊         | 30748/371472 [2:26:57<29:39:42,  3.19it/s]
  8%|▊         | 30749/371472 [2:26:58<28:58:56,  3.27it/s]
  8%|▊         | 30750/371472 [2:26:58<27:10:56,  3.48it/s]
  8%|▊         | 30751/371472 [2:26:58<26:44:20,  3.54it/s]
  8%|▊         | 30752/371472 [2:26:58<26:01:00,  3.64it/s]
  8%|▊         | 30753/371472 [2:26:59<28:35:10,  3.31it/s]
  8%|▊         | 30754/371472 [2:26:59<27:56:00,  3.39it/s]
  8%|▊         | 30755/371472 [2:26:59<27:47:24,  3.41it/s]
  8%|▊         | 30756/371472 [2:27:00<29:08:43,  3.25it/s]
  8%|▊         | 30757/371472 [2:27:00<28:53:13,  3.28it/s]
  8%|▊         | 30758/371472 [2:27:00<28:15:11,  3.35it/s]
  8%|▊         | 30759/371472 [2:27:01<28:07:28,  3.37it/s]
  8%|▊         | 30760/371472 [2:27:01<27:21:41,  3.46it/s]
                                                           
{'loss': 7.3077, 'learning_rate': 9.259195414682497e-07, 'epoch': 1.32}

  8%|▊         | 30760/371472 [2:27:01<27:21:41,  3.46it/s]
  8%|▊         | 30761/371472 [2:27:01<27:44:15,  3.41it/s]
  8%|▊         | 30762/371472 [2:27:01<26:53:45,  3.52it/s]
  8%|▊         | 30763/371472 [2:27:02<28:08:44,  3.36it/s]
  8%|▊         | 30764/371472 [2:27:02<27:25:37,  3.45it/s]
  8%|▊         | 30765/371472 [2:27:02<26:57:17,  3.51it/s]
  8%|▊         | 30766/371472 [2:27:03<27:28:17,  3.45it/s]
  8%|▊         | 30767/371472 [2:27:03<27:17:16,  3.47it/s]
  8%|▊         | 30768/371472 [2:27:03<26:49:22,  3.53it/s]
  8%|▊         | 30769/371472 [2:27:03<26:11:20,  3.61it/s]
  8%|▊         | 30770/371472 [2:27:04<25:25:05,  3.72it/s]
  8%|▊         | 30771/371472 [2:27:04<24:59:57,  3.79it/s]
  8%|▊         | 30772/371472 [2:27:04<26:20:09,  3.59it/s]
  8%|▊         | 30773/371472 [2:27:05<26:36:43,  3.56it/s]
  8%|▊         | 30774/371472 [2:27:05<26:50:21,  3.53it/s]
  8%|▊         | 30775/371472 [2:27:05<26:40:27,  3.55it/s]
  8%|▊         | 30776/371472 [2:27:05<25:45:25,  3.67it/s]
  8%|▊         | 30777/371472 [2:27:06<25:50:18,  3.66it/s]
  8%|▊         | 30778/371472 [2:27:06<24:56:41,  3.79it/s]
  8%|▊         | 30779/371472 [2:27:06<24:36:59,  3.84it/s]
  8%|▊         | 30780/371472 [2:27:06<24:31:13,  3.86it/s]
                                                           
{'loss': 7.2401, 'learning_rate': 9.258710594927708e-07, 'epoch': 1.33}

  8%|▊         | 30780/371472 [2:27:06<24:31:13,  3.86it/s]
  8%|▊         | 30781/371472 [2:27:07<25:45:16,  3.67it/s]
  8%|▊         | 30782/371472 [2:27:07<26:13:57,  3.61it/s]
  8%|▊         | 30783/371472 [2:27:07<25:45:51,  3.67it/s]
  8%|▊         | 30784/371472 [2:27:08<27:19:56,  3.46it/s]
  8%|▊         | 30785/371472 [2:27:08<26:22:02,  3.59it/s]
  8%|▊         | 30786/371472 [2:27:08<25:57:50,  3.64it/s]
  8%|▊         | 30787/371472 [2:27:08<28:35:28,  3.31it/s]
  8%|▊         | 30788/371472 [2:27:09<27:10:05,  3.48it/s]
  8%|▊         | 30789/371472 [2:27:09<27:32:17,  3.44it/s]
  8%|▊         | 30790/371472 [2:27:09<26:27:29,  3.58it/s]
  8%|▊         | 30791/371472 [2:27:10<25:48:42,  3.67it/s]
  8%|▊         | 30792/371472 [2:27:10<25:18:42,  3.74it/s]
  8%|▊         | 30793/371472 [2:27:10<26:19:46,  3.59it/s]
  8%|▊         | 30794/371472 [2:27:10<25:52:49,  3.66it/s]
  8%|▊         | 30795/371472 [2:27:11<25:30:51,  3.71it/s]
  8%|▊         | 30796/371472 [2:27:11<27:04:58,  3.49it/s]
  8%|▊         | 30797/371472 [2:27:11<27:30:08,  3.44it/s]
  8%|▊         | 30798/371472 [2:27:12<26:41:34,  3.55it/s]
  8%|▊         | 30799/371472 [2:27:12<27:01:10,  3.50it/s]
  8%|▊         | 30800/371472 [2:27:12<27:13:31,  3.48it/s]
                                                           
{'loss': 6.9523, 'learning_rate': 9.258225775172919e-07, 'epoch': 1.33}

  8%|▊         | 30800/371472 [2:27:12<27:13:31,  3.48it/s]
  8%|▊         | 30801/371472 [2:27:12<27:13:49,  3.48it/s]
  8%|▊         | 30802/371472 [2:27:13<27:08:02,  3.49it/s]
  8%|▊         | 30803/371472 [2:27:13<27:38:19,  3.42it/s]
  8%|▊         | 30804/371472 [2:27:13<28:27:07,  3.33it/s]
  8%|▊         | 30805/371472 [2:27:14<28:05:00,  3.37it/s]
  8%|▊         | 30806/371472 [2:27:14<31:03:33,  3.05it/s]
  8%|▊         | 30807/371472 [2:27:14<30:35:56,  3.09it/s]
  8%|▊         | 30808/371472 [2:27:15<28:19:57,  3.34it/s]
  8%|▊         | 30809/371472 [2:27:15<28:59:16,  3.26it/s]
  8%|▊         | 30810/371472 [2:27:15<28:33:57,  3.31it/s]
  8%|▊         | 30811/371472 [2:27:15<28:00:39,  3.38it/s]
  8%|▊         | 30812/371472 [2:27:16<27:33:45,  3.43it/s]
  8%|▊         | 30813/371472 [2:27:16<27:40:29,  3.42it/s]
  8%|▊         | 30814/371472 [2:27:16<26:42:27,  3.54it/s]
  8%|▊         | 30815/371472 [2:27:17<26:14:05,  3.61it/s]
  8%|▊         | 30816/371472 [2:27:17<27:34:01,  3.43it/s]
  8%|▊         | 30817/371472 [2:27:17<27:41:47,  3.42it/s]
  8%|▊         | 30818/371472 [2:27:18<29:50:35,  3.17it/s]
  8%|▊         | 30819/371472 [2:27:18<28:42:46,  3.30it/s]
  8%|▊         | 30820/371472 [2:27:18<27:19:58,  3.46it/s]
                                                           
{'loss': 6.9704, 'learning_rate': 9.257740955418129e-07, 'epoch': 1.33}

  8%|▊         | 30820/371472 [2:27:18<27:19:58,  3.46it/s]
  8%|▊         | 30821/371472 [2:27:18<27:46:35,  3.41it/s]
  8%|▊         | 30822/371472 [2:27:19<28:04:53,  3.37it/s]
  8%|▊         | 30823/371472 [2:27:19<27:35:43,  3.43it/s]
  8%|▊         | 30824/371472 [2:27:19<26:11:56,  3.61it/s]
  8%|▊         | 30825/371472 [2:27:19<26:25:32,  3.58it/s]
  8%|▊         | 30826/371472 [2:27:20<25:42:50,  3.68it/s]
  8%|▊         | 30827/371472 [2:27:20<25:19:26,  3.74it/s]
  8%|▊         | 30828/371472 [2:27:20<25:24:30,  3.72it/s]
  8%|▊         | 30829/371472 [2:27:21<27:31:41,  3.44it/s]
  8%|▊         | 30830/371472 [2:27:21<26:32:42,  3.56it/s]
  8%|▊         | 30831/371472 [2:27:21<26:38:31,  3.55it/s]
  8%|▊         | 30832/371472 [2:27:21<25:32:12,  3.71it/s]
  8%|▊         | 30833/371472 [2:27:22<25:40:56,  3.68it/s]
  8%|▊         | 30834/371472 [2:27:22<27:14:08,  3.47it/s]
  8%|▊         | 30835/371472 [2:27:22<25:54:59,  3.65it/s]
  8%|▊         | 30836/371472 [2:27:22<25:53:08,  3.66it/s]
  8%|▊         | 30837/371472 [2:27:23<25:28:14,  3.71it/s]
  8%|▊         | 30838/371472 [2:27:23<27:43:09,  3.41it/s]
  8%|▊         | 30839/371472 [2:27:23<28:21:50,  3.34it/s]
  8%|▊         | 30840/371472 [2:27:24<26:33:39,  3.56it/s]
                                                           
{'loss': 7.0696, 'learning_rate': 9.257256135663341e-07, 'epoch': 1.33}

  8%|▊         | 30840/371472 [2:27:24<26:33:39,  3.56it/s]
  8%|▊         | 30841/371472 [2:27:24<26:26:26,  3.58it/s]
  8%|▊         | 30842/371472 [2:27:24<25:51:00,  3.66it/s]
  8%|▊         | 30843/371472 [2:27:24<26:07:22,  3.62it/s]
  8%|▊         | 30844/371472 [2:27:25<25:45:22,  3.67it/s]
  8%|▊         | 30845/371472 [2:27:25<26:49:34,  3.53it/s]
  8%|▊         | 30846/371472 [2:27:25<26:15:42,  3.60it/s]
  8%|▊         | 30847/371472 [2:27:26<27:51:56,  3.40it/s]
  8%|▊         | 30848/371472 [2:27:26<30:04:06,  3.15it/s]
  8%|▊         | 30849/371472 [2:27:26<29:15:16,  3.23it/s]
  8%|▊         | 30850/371472 [2:27:27<27:44:50,  3.41it/s]
  8%|▊         | 30851/371472 [2:27:27<27:55:42,  3.39it/s]
  8%|▊         | 30852/371472 [2:27:27<27:04:28,  3.49it/s]
  8%|▊         | 30853/371472 [2:27:27<27:36:14,  3.43it/s]
  8%|▊         | 30854/371472 [2:27:28<27:15:52,  3.47it/s]
  8%|▊         | 30855/371472 [2:27:28<27:28:36,  3.44it/s]
  8%|▊         | 30856/371472 [2:27:28<27:26:37,  3.45it/s]
  8%|▊         | 30857/371472 [2:27:29<27:28:33,  3.44it/s]
  8%|▊         | 30858/371472 [2:27:29<26:48:57,  3.53it/s]
  8%|▊         | 30859/371472 [2:27:29<27:47:00,  3.41it/s]
  8%|▊         | 30860/371472 [2:27:29<26:43:15,  3.54it/s]
                                                           
{'loss': 6.9114, 'learning_rate': 9.256771315908552e-07, 'epoch': 1.33}

  8%|▊         | 30860/371472 [2:27:29<26:43:15,  3.54it/s]
  8%|▊         | 30861/371472 [2:27:30<26:24:44,  3.58it/s]
  8%|▊         | 30862/371472 [2:27:30<26:30:56,  3.57it/s]
  8%|▊         | 30863/371472 [2:27:30<28:26:26,  3.33it/s]
  8%|▊         | 30864/371472 [2:27:31<27:57:25,  3.38it/s]
  8%|▊         | 30865/371472 [2:27:31<26:55:34,  3.51it/s]
  8%|▊         | 30866/371472 [2:27:31<27:18:37,  3.46it/s]
  8%|▊         | 30867/371472 [2:27:31<26:21:23,  3.59it/s]
  8%|▊         | 30868/371472 [2:27:32<26:22:48,  3.59it/s]
  8%|▊         | 30869/371472 [2:27:32<26:26:51,  3.58it/s]
  8%|▊         | 30870/371472 [2:27:32<25:55:07,  3.65it/s]
  8%|▊         | 30871/371472 [2:27:33<26:18:27,  3.60it/s]
  8%|▊         | 30872/371472 [2:27:33<26:01:34,  3.64it/s]
  8%|▊         | 30873/371472 [2:27:33<27:13:10,  3.48it/s]
  8%|▊         | 30874/371472 [2:27:33<26:42:36,  3.54it/s]
  8%|▊         | 30875/371472 [2:27:34<26:11:15,  3.61it/s]
  8%|▊         | 30876/371472 [2:27:34<28:07:19,  3.36it/s]
  8%|▊         | 30877/371472 [2:27:34<28:39:37,  3.30it/s]
  8%|▊         | 30878/371472 [2:27:35<28:00:42,  3.38it/s]
  8%|▊         | 30879/371472 [2:27:35<27:26:33,  3.45it/s]
  8%|▊         | 30880/371472 [2:27:35<26:40:50,  3.55it/s]
                                                           
{'loss': 7.0071, 'learning_rate': 9.256286496153762e-07, 'epoch': 1.33}

  8%|▊         | 30880/371472 [2:27:35<26:40:50,  3.55it/s]
  8%|▊         | 30881/371472 [2:27:35<27:34:33,  3.43it/s]
  8%|▊         | 30882/371472 [2:27:36<27:32:40,  3.43it/s]
  8%|▊         | 30883/371472 [2:27:36<28:38:34,  3.30it/s]
  8%|▊         | 30884/371472 [2:27:36<28:18:49,  3.34it/s]
  8%|▊         | 30885/371472 [2:27:37<27:32:53,  3.43it/s]
  8%|▊         | 30886/371472 [2:27:37<27:41:33,  3.42it/s]
  8%|▊         | 30887/371472 [2:27:37<26:48:14,  3.53it/s]
  8%|▊         | 30888/371472 [2:27:37<26:23:47,  3.58it/s]
  8%|▊         | 30889/371472 [2:27:38<27:00:15,  3.50it/s]
  8%|▊         | 30890/371472 [2:27:38<27:36:00,  3.43it/s]
  8%|▊         | 30891/371472 [2:27:38<28:42:54,  3.29it/s]
  8%|▊         | 30892/371472 [2:27:39<28:11:06,  3.36it/s]
  8%|▊         | 30893/371472 [2:27:39<27:27:35,  3.45it/s]
  8%|▊         | 30894/371472 [2:27:39<26:51:10,  3.52it/s]
  8%|▊         | 30895/371472 [2:27:39<26:18:28,  3.60it/s]
  8%|▊         | 30896/371472 [2:27:40<25:58:47,  3.64it/s]
  8%|▊         | 30897/371472 [2:27:40<28:43:45,  3.29it/s]
  8%|▊         | 30898/371472 [2:27:40<28:38:51,  3.30it/s]
  8%|▊         | 30899/371472 [2:27:41<27:32:44,  3.43it/s]
  8%|▊         | 30900/371472 [2:27:41<29:01:16,  3.26it/s]
                                                           
{'loss': 7.0653, 'learning_rate': 9.255801676398974e-07, 'epoch': 1.33}

  8%|▊         | 30900/371472 [2:27:41<29:01:16,  3.26it/s]
  8%|▊         | 30901/371472 [2:27:41<29:01:10,  3.26it/s]
  8%|▊         | 30902/371472 [2:27:42<28:59:26,  3.26it/s]
  8%|▊         | 30903/371472 [2:27:42<27:40:00,  3.42it/s]
  8%|▊         | 30904/371472 [2:27:42<27:19:51,  3.46it/s]
  8%|▊         | 30905/371472 [2:27:42<26:45:43,  3.53it/s]
  8%|▊         | 30906/371472 [2:27:43<27:46:14,  3.41it/s]
  8%|▊         | 30907/371472 [2:27:43<26:56:17,  3.51it/s]
  8%|▊         | 30908/371472 [2:27:43<26:17:15,  3.60it/s]
  8%|▊         | 30909/371472 [2:27:44<26:16:44,  3.60it/s]
  8%|▊         | 30910/371472 [2:27:44<26:06:27,  3.62it/s]
  8%|▊         | 30911/371472 [2:27:44<25:27:29,  3.72it/s]
  8%|▊         | 30912/371472 [2:27:44<26:38:16,  3.55it/s]
  8%|▊         | 30913/371472 [2:27:45<25:53:08,  3.65it/s]
  8%|▊         | 30914/371472 [2:27:45<26:43:24,  3.54it/s]
  8%|▊         | 30915/371472 [2:27:45<28:45:05,  3.29it/s]
  8%|▊         | 30916/371472 [2:27:46<29:39:25,  3.19it/s]
  8%|▊         | 30917/371472 [2:27:46<27:49:12,  3.40it/s]
  8%|▊         | 30918/371472 [2:27:46<28:31:38,  3.32it/s]
  8%|▊         | 30919/371472 [2:27:47<28:13:54,  3.35it/s]
  8%|▊         | 30920/371472 [2:27:47<27:31:24,  3.44it/s]
                                                           
{'loss': 6.9926, 'learning_rate': 9.255316856644186e-07, 'epoch': 1.33}

  8%|▊         | 30920/371472 [2:27:47<27:31:24,  3.44it/s]
  8%|▊         | 30921/371472 [2:27:47<27:55:19,  3.39it/s]
  8%|▊         | 30922/371472 [2:27:47<27:26:41,  3.45it/s]
  8%|▊         | 30923/371472 [2:27:48<26:53:40,  3.52it/s]
  8%|▊         | 30924/371472 [2:27:48<28:23:21,  3.33it/s]
  8%|▊         | 30925/371472 [2:27:48<27:36:08,  3.43it/s]
  8%|▊         | 30926/371472 [2:27:49<27:53:07,  3.39it/s]
  8%|▊         | 30927/371472 [2:27:49<26:48:36,  3.53it/s]
  8%|▊         | 30928/371472 [2:27:49<26:30:55,  3.57it/s]
  8%|▊         | 30929/371472 [2:27:49<26:06:02,  3.62it/s]
  8%|▊         | 30930/371472 [2:27:50<25:31:37,  3.71it/s]
  8%|▊         | 30931/371472 [2:27:50<26:19:42,  3.59it/s]
  8%|▊         | 30932/371472 [2:27:50<28:20:41,  3.34it/s]
  8%|▊         | 30933/371472 [2:27:51<27:32:45,  3.43it/s]
  8%|▊         | 30934/371472 [2:27:51<26:02:47,  3.63it/s]
  8%|▊         | 30935/371472 [2:27:51<25:14:38,  3.75it/s]
  8%|▊         | 30936/371472 [2:27:51<25:35:52,  3.70it/s]
  8%|▊         | 30937/371472 [2:27:52<25:54:50,  3.65it/s]
  8%|▊         | 30938/371472 [2:27:52<25:36:29,  3.69it/s]
  8%|▊         | 30939/371472 [2:27:52<26:05:34,  3.63it/s]
  8%|▊         | 30940/371472 [2:27:52<27:28:05,  3.44it/s]
                                                           
{'loss': 6.9443, 'learning_rate': 9.254832036889396e-07, 'epoch': 1.33}

  8%|▊         | 30940/371472 [2:27:52<27:28:05,  3.44it/s]
  8%|▊         | 30941/371472 [2:27:53<28:19:41,  3.34it/s]
  8%|▊         | 30942/371472 [2:27:53<26:48:55,  3.53it/s]
  8%|▊         | 30943/371472 [2:27:53<29:56:32,  3.16it/s]
  8%|▊         | 30944/371472 [2:27:54<28:30:30,  3.32it/s]
  8%|▊         | 30945/371472 [2:27:54<27:04:59,  3.49it/s]
  8%|▊         | 30946/371472 [2:27:54<27:32:40,  3.43it/s]
  8%|▊         | 30947/371472 [2:27:55<29:50:02,  3.17it/s]
  8%|▊         | 30948/371472 [2:27:55<28:44:42,  3.29it/s]
  8%|▊         | 30949/371472 [2:27:55<27:19:26,  3.46it/s]
  8%|▊         | 30950/371472 [2:27:55<27:51:43,  3.39it/s]
  8%|▊         | 30951/371472 [2:27:56<28:22:55,  3.33it/s]
  8%|▊         | 30952/371472 [2:27:56<28:21:28,  3.34it/s]
  8%|▊         | 30953/371472 [2:27:56<27:36:36,  3.43it/s]
  8%|▊         | 30954/371472 [2:27:57<27:58:26,  3.38it/s]
  8%|▊         | 30955/371472 [2:27:57<27:15:09,  3.47it/s]
  8%|▊         | 30956/371472 [2:27:57<27:34:39,  3.43it/s]
  8%|▊         | 30957/371472 [2:27:57<26:46:22,  3.53it/s]
  8%|▊         | 30958/371472 [2:27:58<26:48:25,  3.53it/s]
  8%|▊         | 30959/371472 [2:27:58<27:10:37,  3.48it/s]
  8%|▊         | 30960/371472 [2:27:58<27:23:42,  3.45it/s]
                                                           
{'loss': 7.1948, 'learning_rate': 9.254347217134606e-07, 'epoch': 1.33}

  8%|▊         | 30960/371472 [2:27:58<27:23:42,  3.45it/s]
  8%|▊         | 30961/371472 [2:27:59<26:31:29,  3.57it/s]
  8%|▊         | 30962/371472 [2:27:59<27:34:26,  3.43it/s]
  8%|▊         | 30963/371472 [2:27:59<27:29:07,  3.44it/s]
  8%|▊         | 30964/371472 [2:27:59<27:01:07,  3.50it/s]
  8%|▊         | 30965/371472 [2:28:00<26:25:38,  3.58it/s]
  8%|▊         | 30966/371472 [2:28:00<25:58:55,  3.64it/s]
  8%|▊         | 30967/371472 [2:28:00<25:48:24,  3.67it/s]
  8%|▊         | 30968/371472 [2:28:01<27:06:36,  3.49it/s]
  8%|▊         | 30969/371472 [2:28:01<26:12:44,  3.61it/s]
  8%|▊         | 30970/371472 [2:28:01<25:53:32,  3.65it/s]
  8%|▊         | 30971/371472 [2:28:01<25:46:16,  3.67it/s]
  8%|▊         | 30972/371472 [2:28:02<24:58:34,  3.79it/s]
  8%|▊         | 30973/371472 [2:28:02<24:45:14,  3.82it/s]
  8%|▊         | 30974/371472 [2:28:02<25:50:33,  3.66it/s]
  8%|▊         | 30975/371472 [2:28:02<27:09:05,  3.48it/s]
  8%|▊         | 30976/371472 [2:28:03<29:12:58,  3.24it/s]
  8%|▊         | 30977/371472 [2:28:03<29:42:02,  3.18it/s]
  8%|▊         | 30978/371472 [2:28:03<28:41:56,  3.30it/s]
  8%|▊         | 30979/371472 [2:28:04<29:36:39,  3.19it/s]
  8%|▊         | 30980/371472 [2:28:04<28:45:55,  3.29it/s]
                                                           
{'loss': 7.0766, 'learning_rate': 9.253862397379818e-07, 'epoch': 1.33}

  8%|▊         | 30980/371472 [2:28:04<28:45:55,  3.29it/s]
  8%|▊         | 30981/371472 [2:28:04<28:17:12,  3.34it/s]
  8%|▊         | 30982/371472 [2:28:05<27:26:18,  3.45it/s]
  8%|▊         | 30983/371472 [2:28:05<26:52:06,  3.52it/s]
  8%|▊         | 30984/371472 [2:28:05<27:53:36,  3.39it/s]
  8%|▊         | 30985/371472 [2:28:06<27:30:48,  3.44it/s]
  8%|▊         | 30986/371472 [2:28:06<27:29:56,  3.44it/s]
  8%|▊         | 30987/371472 [2:28:06<27:16:51,  3.47it/s]
  8%|▊         | 30988/371472 [2:28:06<27:16:02,  3.47it/s]
  8%|▊         | 30989/371472 [2:28:07<27:45:35,  3.41it/s]
  8%|▊         | 30990/371472 [2:28:07<26:31:31,  3.57it/s]
  8%|▊         | 30991/371472 [2:28:07<25:47:51,  3.67it/s]
  8%|▊         | 30992/371472 [2:28:07<27:06:25,  3.49it/s]
  8%|▊         | 30993/371472 [2:28:08<29:25:05,  3.21it/s]
  8%|▊         | 30994/371472 [2:28:08<31:29:46,  3.00it/s]
  8%|▊         | 30995/371472 [2:28:09<31:48:16,  2.97it/s]
  8%|▊         | 30996/371472 [2:28:09<30:20:46,  3.12it/s]
  8%|▊         | 30997/371472 [2:28:09<28:23:21,  3.33it/s]
  8%|▊         | 30998/371472 [2:28:09<27:47:34,  3.40it/s]
  8%|▊         | 30999/371472 [2:28:10<27:19:00,  3.46it/s]
  8%|▊         | 31000/371472 [2:28:10<27:13:21,  3.47it/s]
                                                           
{'loss': 7.1149, 'learning_rate': 9.253377577625029e-07, 'epoch': 1.34}

  8%|▊         | 31000/371472 [2:28:10<27:13:21,  3.47it/s]
  8%|▊         | 31001/371472 [2:28:10<27:03:44,  3.49it/s]
  8%|▊         | 31002/371472 [2:28:11<27:17:15,  3.47it/s]
  8%|▊         | 31003/371472 [2:28:11<27:07:16,  3.49it/s]
  8%|▊         | 31004/371472 [2:28:11<26:59:41,  3.50it/s]
  8%|▊         | 31005/371472 [2:28:11<26:58:01,  3.51it/s]
  8%|▊         | 31006/371472 [2:28:12<26:46:15,  3.53it/s]
  8%|▊         | 31007/371472 [2:28:12<26:25:06,  3.58it/s]
  8%|▊         | 31008/371472 [2:28:12<26:24:33,  3.58it/s]
  8%|▊         | 31009/371472 [2:28:12<25:51:37,  3.66it/s]
  8%|▊         | 31010/371472 [2:28:13<25:01:37,  3.78it/s]
  8%|▊         | 31011/371472 [2:28:13<25:02:20,  3.78it/s]
  8%|▊         | 31012/371472 [2:28:13<25:17:15,  3.74it/s]
  8%|▊         | 31013/371472 [2:28:14<26:15:42,  3.60it/s]
  8%|▊         | 31014/371472 [2:28:14<25:44:14,  3.67it/s]
  8%|▊         | 31015/371472 [2:28:14<25:06:51,  3.77it/s]
  8%|▊         | 31016/371472 [2:28:14<25:19:45,  3.73it/s]
  8%|▊         | 31017/371472 [2:28:15<26:19:57,  3.59it/s]
  8%|▊         | 31018/371472 [2:28:15<25:41:49,  3.68it/s]
  8%|▊         | 31019/371472 [2:28:15<25:34:46,  3.70it/s]
  8%|▊         | 31020/371472 [2:28:15<26:19:50,  3.59it/s]
                                                           
{'loss': 7.3839, 'learning_rate': 9.252892757870241e-07, 'epoch': 1.34}

  8%|▊         | 31020/371472 [2:28:15<26:19:50,  3.59it/s]
  8%|▊         | 31021/371472 [2:28:16<26:24:47,  3.58it/s]
  8%|▊         | 31022/371472 [2:28:16<26:03:23,  3.63it/s]
  8%|▊         | 31023/371472 [2:28:16<25:37:36,  3.69it/s]
  8%|▊         | 31024/371472 [2:28:17<25:43:53,  3.68it/s]
  8%|▊         | 31025/371472 [2:28:17<27:57:49,  3.38it/s]
  8%|▊         | 31026/371472 [2:28:17<27:11:14,  3.48it/s]
  8%|▊         | 31027/371472 [2:28:17<26:40:03,  3.55it/s]
  8%|▊         | 31028/371472 [2:28:18<26:17:39,  3.60it/s]
  8%|▊         | 31029/371472 [2:28:18<26:10:54,  3.61it/s]
  8%|▊         | 31030/371472 [2:28:18<25:54:00,  3.65it/s]
  8%|▊         | 31031/371472 [2:28:19<26:41:15,  3.54it/s]
  8%|▊         | 31032/371472 [2:28:19<26:05:18,  3.62it/s]
  8%|▊         | 31033/371472 [2:28:19<25:39:43,  3.69it/s]
  8%|▊         | 31034/371472 [2:28:19<25:36:28,  3.69it/s]
  8%|▊         | 31035/371472 [2:28:20<25:44:44,  3.67it/s]
  8%|▊         | 31036/371472 [2:28:20<25:12:43,  3.75it/s]
  8%|▊         | 31037/371472 [2:28:20<25:10:35,  3.76it/s]
  8%|▊         | 31038/371472 [2:28:20<27:13:46,  3.47it/s]
  8%|▊         | 31039/371472 [2:28:21<26:39:15,  3.55it/s]
  8%|▊         | 31040/371472 [2:28:21<27:20:16,  3.46it/s]
                                                           
{'loss': 7.0784, 'learning_rate': 9.252407938115451e-07, 'epoch': 1.34}

  8%|▊         | 31040/371472 [2:28:21<27:20:16,  3.46it/s]
  8%|▊         | 31041/371472 [2:28:21<26:51:23,  3.52it/s]
  8%|▊         | 31042/371472 [2:28:22<26:45:55,  3.53it/s]
  8%|▊         | 31043/371472 [2:28:22<26:45:36,  3.53it/s]
  8%|▊         | 31044/371472 [2:28:22<29:19:47,  3.22it/s]
  8%|▊         | 31045/371472 [2:28:23<27:35:28,  3.43it/s]
  8%|▊         | 31046/371472 [2:28:23<27:22:28,  3.45it/s]
  8%|▊         | 31047/371472 [2:28:23<27:36:08,  3.43it/s]
  8%|▊         | 31048/371472 [2:28:23<27:06:35,  3.49it/s]
  8%|▊         | 31049/371472 [2:28:24<26:46:26,  3.53it/s]
  8%|▊         | 31050/371472 [2:28:24<26:57:46,  3.51it/s]
  8%|▊         | 31051/371472 [2:28:24<26:52:23,  3.52it/s]
  8%|▊         | 31052/371472 [2:28:25<28:43:05,  3.29it/s]
  8%|▊         | 31053/371472 [2:28:25<27:30:45,  3.44it/s]
  8%|▊         | 31054/371472 [2:28:25<29:27:35,  3.21it/s]
  8%|▊         | 31055/371472 [2:28:25<29:08:19,  3.25it/s]
  8%|▊         | 31056/371472 [2:28:26<28:02:13,  3.37it/s]
  8%|▊         | 31057/371472 [2:28:26<27:01:00,  3.50it/s]
  8%|▊         | 31058/371472 [2:28:26<29:44:59,  3.18it/s]
  8%|▊         | 31059/371472 [2:28:27<29:09:30,  3.24it/s]
  8%|▊         | 31060/371472 [2:28:27<27:44:47,  3.41it/s]
                                                           
{'loss': 6.9548, 'learning_rate': 9.251923118360662e-07, 'epoch': 1.34}

  8%|▊         | 31060/371472 [2:28:27<27:44:47,  3.41it/s]
  8%|▊         | 31061/371472 [2:28:27<27:09:53,  3.48it/s]
  8%|▊         | 31062/371472 [2:28:27<26:46:14,  3.53it/s]
  8%|▊         | 31063/371472 [2:28:28<26:14:59,  3.60it/s]
  8%|▊         | 31064/371472 [2:28:28<26:32:59,  3.56it/s]
  8%|▊         | 31065/371472 [2:28:28<28:37:21,  3.30it/s]
  8%|▊         | 31066/371472 [2:28:29<27:52:08,  3.39it/s]
  8%|▊         | 31067/371472 [2:28:29<28:02:03,  3.37it/s]
  8%|▊         | 31068/371472 [2:28:29<27:50:33,  3.40it/s]
  8%|▊         | 31069/371472 [2:28:30<27:03:03,  3.50it/s]
  8%|▊         | 31070/371472 [2:28:30<27:37:56,  3.42it/s]
  8%|▊         | 31071/371472 [2:28:30<29:05:35,  3.25it/s]
  8%|▊         | 31072/371472 [2:28:30<28:34:32,  3.31it/s]
  8%|▊         | 31073/371472 [2:28:31<28:49:20,  3.28it/s]
  8%|▊         | 31074/371472 [2:28:31<27:42:22,  3.41it/s]
  8%|▊         | 31075/371472 [2:28:31<28:24:29,  3.33it/s]
  8%|▊         | 31076/371472 [2:28:32<29:04:16,  3.25it/s]
  8%|▊         | 31077/371472 [2:28:32<35:11:35,  2.69it/s]
  8%|▊         | 31078/371472 [2:28:32<32:17:55,  2.93it/s]
  8%|▊         | 31079/371472 [2:28:33<30:28:21,  3.10it/s]
  8%|▊         | 31080/371472 [2:28:33<28:40:47,  3.30it/s]
                                                           
{'loss': 7.0966, 'learning_rate': 9.251438298605873e-07, 'epoch': 1.34}

  8%|▊         | 31080/371472 [2:28:33<28:40:47,  3.30it/s]
  8%|▊         | 31081/371472 [2:28:33<27:34:50,  3.43it/s]
  8%|▊         | 31082/371472 [2:28:34<27:16:08,  3.47it/s]
  8%|▊         | 31083/371472 [2:28:34<26:29:54,  3.57it/s]
  8%|▊         | 31084/371472 [2:28:34<25:45:05,  3.67it/s]
  8%|▊         | 31085/371472 [2:28:34<27:27:57,  3.44it/s]
  8%|▊         | 31086/371472 [2:28:35<27:12:09,  3.48it/s]
  8%|▊         | 31087/371472 [2:28:35<26:06:10,  3.62it/s]
  8%|▊         | 31088/371472 [2:28:35<26:12:30,  3.61it/s]
  8%|▊         | 31089/371472 [2:28:36<26:36:20,  3.55it/s]
  8%|▊         | 31090/371472 [2:28:36<26:29:22,  3.57it/s]
  8%|▊         | 31091/371472 [2:28:36<26:07:25,  3.62it/s]
  8%|▊         | 31092/371472 [2:28:36<26:10:25,  3.61it/s]
  8%|▊         | 31093/371472 [2:28:37<26:25:15,  3.58it/s]
  8%|▊         | 31094/371472 [2:28:37<27:08:01,  3.48it/s]
  8%|▊         | 31095/371472 [2:28:37<27:17:03,  3.47it/s]
  8%|▊         | 31096/371472 [2:28:38<27:21:47,  3.46it/s]
  8%|▊         | 31097/371472 [2:28:38<26:53:27,  3.52it/s]
  8%|▊         | 31098/371472 [2:28:38<27:21:21,  3.46it/s]
  8%|▊         | 31099/371472 [2:28:38<27:36:30,  3.42it/s]
  8%|▊         | 31100/371472 [2:28:39<27:36:30,  3.42it/s]
                                                           
{'loss': 6.9126, 'learning_rate': 9.250953478851085e-07, 'epoch': 1.34}

  8%|▊         | 31100/371472 [2:28:39<27:36:30,  3.42it/s]
  8%|▊         | 31101/371472 [2:28:39<27:15:10,  3.47it/s]
  8%|▊         | 31102/371472 [2:28:39<28:08:00,  3.36it/s]
  8%|▊         | 31103/371472 [2:28:40<29:47:07,  3.17it/s]
  8%|▊         | 31104/371472 [2:28:40<30:50:23,  3.07it/s]
  8%|▊         | 31105/371472 [2:28:40<31:36:24,  2.99it/s]
  8%|▊         | 31106/371472 [2:28:41<31:20:32,  3.02it/s]
  8%|▊         | 31107/371472 [2:28:41<28:55:30,  3.27it/s]
  8%|▊         | 31108/371472 [2:28:41<27:33:09,  3.43it/s]
  8%|▊         | 31109/371472 [2:28:41<26:51:03,  3.52it/s]
  8%|▊         | 31110/371472 [2:28:42<26:17:22,  3.60it/s]
  8%|▊         | 31111/371472 [2:28:42<26:05:32,  3.62it/s]
  8%|▊         | 31112/371472 [2:28:42<29:48:13,  3.17it/s]
  8%|▊         | 31113/371472 [2:28:43<28:34:36,  3.31it/s]
  8%|▊         | 31114/371472 [2:28:43<27:47:25,  3.40it/s]
  8%|▊         | 31115/371472 [2:28:43<28:14:14,  3.35it/s]
  8%|▊         | 31116/371472 [2:28:44<30:59:26,  3.05it/s]
  8%|▊         | 31117/371472 [2:28:44<29:20:24,  3.22it/s]
  8%|▊         | 31118/371472 [2:28:44<27:58:06,  3.38it/s]
  8%|▊         | 31119/371472 [2:28:44<27:11:25,  3.48it/s]
  8%|▊         | 31120/371472 [2:28:45<27:58:56,  3.38it/s]
                                                           
{'loss': 6.8928, 'learning_rate': 9.250468659096295e-07, 'epoch': 1.34}

  8%|▊         | 31120/371472 [2:28:45<27:58:56,  3.38it/s]
  8%|▊         | 31121/371472 [2:28:45<28:12:09,  3.35it/s]
  8%|▊         | 31122/371472 [2:28:45<27:19:03,  3.46it/s]
  8%|▊         | 31123/371472 [2:28:46<29:02:22,  3.26it/s]
  8%|▊         | 31124/371472 [2:28:46<28:45:32,  3.29it/s]
  8%|▊         | 31125/371472 [2:28:46<28:00:10,  3.38it/s]
  8%|▊         | 31126/371472 [2:28:47<28:23:48,  3.33it/s]
  8%|▊         | 31127/371472 [2:28:47<27:43:50,  3.41it/s]
  8%|▊         | 31128/371472 [2:28:47<28:51:52,  3.28it/s]
  8%|▊         | 31129/371472 [2:28:47<27:39:48,  3.42it/s]
  8%|▊         | 31130/371472 [2:28:48<28:12:13,  3.35it/s]
  8%|▊         | 31131/371472 [2:28:48<28:32:00,  3.31it/s]
  8%|▊         | 31132/371472 [2:28:48<28:01:46,  3.37it/s]
  8%|▊         | 31133/371472 [2:28:49<26:38:50,  3.55it/s]
  8%|▊         | 31134/371472 [2:28:49<25:52:16,  3.65it/s]
  8%|▊         | 31135/371472 [2:28:49<25:54:45,  3.65it/s]
  8%|▊         | 31136/371472 [2:28:49<25:20:24,  3.73it/s]
  8%|▊         | 31137/371472 [2:28:50<24:52:29,  3.80it/s]
  8%|▊         | 31138/371472 [2:28:50<27:06:44,  3.49it/s]
  8%|▊         | 31139/371472 [2:28:50<27:53:16,  3.39it/s]
  8%|▊         | 31140/371472 [2:28:51<26:47:54,  3.53it/s]
                                                           
{'loss': 7.2436, 'learning_rate': 9.249983839341507e-07, 'epoch': 1.34}

  8%|▊         | 31140/371472 [2:28:51<26:47:54,  3.53it/s]
  8%|▊         | 31141/371472 [2:28:51<27:45:51,  3.40it/s]
  8%|▊         | 31142/371472 [2:28:51<26:41:01,  3.54it/s]
  8%|▊         | 31143/371472 [2:28:51<26:17:03,  3.60it/s]
  8%|▊         | 31144/371472 [2:28:52<26:32:31,  3.56it/s]
  8%|▊         | 31145/371472 [2:28:52<26:19:29,  3.59it/s]
  8%|▊         | 31146/371472 [2:28:52<27:39:34,  3.42it/s]
  8%|▊         | 31147/371472 [2:28:53<27:26:54,  3.44it/s]
  8%|▊         | 31148/371472 [2:28:53<26:26:00,  3.58it/s]
  8%|▊         | 31149/371472 [2:28:53<26:55:55,  3.51it/s]
  8%|▊         | 31150/371472 [2:28:53<26:40:48,  3.54it/s]
  8%|▊         | 31151/371472 [2:28:54<26:23:26,  3.58it/s]
  8%|▊         | 31152/371472 [2:28:54<26:40:26,  3.54it/s]
  8%|▊         | 31153/371472 [2:28:54<27:46:05,  3.40it/s]
  8%|▊         | 31154/371472 [2:28:55<26:53:01,  3.52it/s]
  8%|▊         | 31155/371472 [2:28:55<26:31:32,  3.56it/s]
  8%|▊         | 31156/371472 [2:28:55<25:55:59,  3.65it/s]
  8%|▊         | 31157/371472 [2:28:55<26:19:12,  3.59it/s]
  8%|▊         | 31158/371472 [2:28:56<27:45:41,  3.41it/s]
  8%|▊         | 31159/371472 [2:28:56<26:38:58,  3.55it/s]
  8%|▊         | 31160/371472 [2:28:56<28:19:30,  3.34it/s]
                                                           
{'loss': 6.7896, 'learning_rate': 9.249499019586718e-07, 'epoch': 1.34}

  8%|▊         | 31160/371472 [2:28:56<28:19:30,  3.34it/s]
  8%|▊         | 31161/371472 [2:28:57<30:21:42,  3.11it/s]
  8%|▊         | 31162/371472 [2:28:57<28:55:48,  3.27it/s]
  8%|▊         | 31163/371472 [2:28:57<28:42:10,  3.29it/s]
  8%|▊         | 31164/371472 [2:28:57<28:25:19,  3.33it/s]
  8%|▊         | 31165/371472 [2:28:58<29:07:40,  3.25it/s]
  8%|▊         | 31166/371472 [2:28:58<28:28:01,  3.32it/s]
  8%|▊         | 31167/371472 [2:28:58<28:36:14,  3.30it/s]
  8%|▊         | 31168/371472 [2:28:59<27:46:05,  3.40it/s]
  8%|▊         | 31169/371472 [2:28:59<27:02:33,  3.50it/s]
  8%|▊         | 31170/371472 [2:28:59<26:18:28,  3.59it/s]
  8%|▊         | 31171/371472 [2:28:59<26:22:12,  3.58it/s]
  8%|▊         | 31172/371472 [2:29:00<25:51:09,  3.66it/s]
  8%|▊         | 31173/371472 [2:29:00<27:07:22,  3.49it/s]
  8%|▊         | 31174/371472 [2:29:00<26:12:20,  3.61it/s]
  8%|▊         | 31175/371472 [2:29:01<27:11:57,  3.48it/s]
  8%|▊         | 31176/371472 [2:29:01<26:47:44,  3.53it/s]
  8%|▊         | 31177/371472 [2:29:01<25:36:25,  3.69it/s]
  8%|▊         | 31178/371472 [2:29:01<24:45:17,  3.82it/s]
  8%|▊         | 31179/371472 [2:29:02<26:55:34,  3.51it/s]
  8%|▊         | 31180/371472 [2:29:02<26:45:22,  3.53it/s]
                                                           
{'loss': 7.2349, 'learning_rate': 9.249014199831928e-07, 'epoch': 1.34}

  8%|▊         | 31180/371472 [2:29:02<26:45:22,  3.53it/s]
  8%|▊         | 31181/371472 [2:29:02<28:59:33,  3.26it/s]
  8%|▊         | 31182/371472 [2:29:03<27:17:54,  3.46it/s]
  8%|▊         | 31183/371472 [2:29:03<29:32:31,  3.20it/s]
  8%|▊         | 31184/371472 [2:29:03<28:04:15,  3.37it/s]
  8%|▊         | 31185/371472 [2:29:04<27:39:04,  3.42it/s]
  8%|▊         | 31186/371472 [2:29:04<26:56:04,  3.51it/s]
  8%|▊         | 31187/371472 [2:29:04<26:34:01,  3.56it/s]
  8%|▊         | 31188/371472 [2:29:04<27:18:55,  3.46it/s]
  8%|▊         | 31189/371472 [2:29:05<29:39:56,  3.19it/s]
  8%|▊         | 31190/371472 [2:29:05<28:57:41,  3.26it/s]
  8%|▊         | 31191/371472 [2:29:05<27:31:51,  3.43it/s]
  8%|▊         | 31192/371472 [2:29:06<27:53:17,  3.39it/s]
  8%|▊         | 31193/371472 [2:29:06<27:27:48,  3.44it/s]
  8%|▊         | 31194/371472 [2:29:06<27:26:58,  3.44it/s]
  8%|▊         | 31195/371472 [2:29:07<30:22:55,  3.11it/s]
  8%|▊         | 31196/371472 [2:29:07<29:39:01,  3.19it/s]
  8%|▊         | 31197/371472 [2:29:07<28:35:07,  3.31it/s]
  8%|▊         | 31198/371472 [2:29:07<28:28:43,  3.32it/s]
  8%|▊         | 31199/371472 [2:29:08<28:10:57,  3.35it/s]
  8%|▊         | 31200/371472 [2:29:08<27:12:38,  3.47it/s]
                                                           
{'loss': 6.7734, 'learning_rate': 9.248529380077139e-07, 'epoch': 1.34}

  8%|▊         | 31200/371472 [2:29:08<27:12:38,  3.47it/s]
  8%|▊         | 31201/371472 [2:29:08<27:13:26,  3.47it/s]
  8%|▊         | 31202/371472 [2:29:09<25:55:54,  3.64it/s]
  8%|▊         | 31203/371472 [2:29:09<25:43:59,  3.67it/s]
  8%|▊         | 31204/371472 [2:29:09<25:40:35,  3.68it/s]
  8%|▊         | 31205/371472 [2:29:09<25:22:25,  3.73it/s]
  8%|▊         | 31206/371472 [2:29:10<27:56:11,  3.38it/s]
  8%|▊         | 31207/371472 [2:29:10<26:38:18,  3.55it/s]
  8%|▊         | 31208/371472 [2:29:10<26:13:02,  3.61it/s]
  8%|▊         | 31209/371472 [2:29:10<26:16:36,  3.60it/s]
  8%|▊         | 31210/371472 [2:29:11<25:58:05,  3.64it/s]
  8%|▊         | 31211/371472 [2:29:11<26:11:09,  3.61it/s]
  8%|▊         | 31212/371472 [2:29:11<26:53:59,  3.51it/s]
  8%|▊         | 31213/371472 [2:29:12<28:34:12,  3.31it/s]
  8%|▊         | 31214/371472 [2:29:12<29:34:23,  3.20it/s]
  8%|▊         | 31215/371472 [2:29:12<29:03:37,  3.25it/s]
  8%|▊         | 31216/371472 [2:29:13<30:43:31,  3.08it/s]
  8%|▊         | 31217/371472 [2:29:13<29:58:03,  3.15it/s]
  8%|▊         | 31218/371472 [2:29:13<30:04:41,  3.14it/s]
  8%|▊         | 31219/371472 [2:29:14<28:49:08,  3.28it/s]
  8%|▊         | 31220/371472 [2:29:14<28:22:22,  3.33it/s]
                                                           
{'loss': 7.0566, 'learning_rate': 9.248044560322351e-07, 'epoch': 1.34}

  8%|▊         | 31220/371472 [2:29:14<28:22:22,  3.33it/s]
  8%|▊         | 31221/371472 [2:29:14<27:13:43,  3.47it/s]
  8%|▊         | 31222/371472 [2:29:14<27:32:14,  3.43it/s]
  8%|▊         | 31223/371472 [2:29:15<28:57:34,  3.26it/s]
  8%|▊         | 31224/371472 [2:29:15<28:52:30,  3.27it/s]
  8%|▊         | 31225/371472 [2:29:15<27:59:13,  3.38it/s]
  8%|▊         | 31226/371472 [2:29:16<27:46:55,  3.40it/s]
  8%|▊         | 31227/371472 [2:29:16<26:30:05,  3.57it/s]
  8%|▊         | 31228/371472 [2:29:16<26:10:55,  3.61it/s]
  8%|▊         | 31229/371472 [2:29:16<26:53:53,  3.51it/s]
  8%|▊         | 31230/371472 [2:29:17<26:12:01,  3.61it/s]
  8%|▊         | 31231/371472 [2:29:17<25:43:43,  3.67it/s]
  8%|▊         | 31232/371472 [2:29:17<26:51:55,  3.52it/s]
  8%|▊         | 31233/371472 [2:29:18<26:27:58,  3.57it/s]
  8%|▊         | 31234/371472 [2:29:18<25:41:58,  3.68it/s]
  8%|▊         | 31235/371472 [2:29:18<25:51:00,  3.66it/s]
  8%|▊         | 31236/371472 [2:29:18<25:50:08,  3.66it/s]
  8%|▊         | 31237/371472 [2:29:19<25:29:53,  3.71it/s]
  8%|▊         | 31238/371472 [2:29:19<25:26:57,  3.71it/s]
  8%|▊         | 31239/371472 [2:29:19<25:33:00,  3.70it/s]
  8%|▊         | 31240/371472 [2:29:19<26:12:26,  3.61it/s]
                                                           
{'loss': 7.0811, 'learning_rate': 9.247559740567562e-07, 'epoch': 1.35}

  8%|▊         | 31240/371472 [2:29:19<26:12:26,  3.61it/s]
  8%|▊         | 31241/371472 [2:29:20<26:19:18,  3.59it/s]
  8%|▊         | 31242/371472 [2:29:20<25:49:52,  3.66it/s]
  8%|▊         | 31243/371472 [2:29:20<25:26:35,  3.71it/s]
  8%|▊         | 31244/371472 [2:29:21<27:14:57,  3.47it/s]
  8%|▊         | 31245/371472 [2:29:21<26:03:54,  3.63it/s]
  8%|▊         | 31246/371472 [2:29:21<28:54:17,  3.27it/s]
  8%|▊         | 31247/371472 [2:29:21<28:03:48,  3.37it/s]
  8%|▊         | 31248/371472 [2:29:22<27:19:19,  3.46it/s]
  8%|▊         | 31249/371472 [2:29:22<27:34:27,  3.43it/s]
  8%|▊         | 31250/371472 [2:29:22<26:39:05,  3.55it/s]
  8%|▊         | 31251/371472 [2:29:23<27:09:02,  3.48it/s]
  8%|▊         | 31252/371472 [2:29:23<26:36:48,  3.55it/s]
  8%|▊         | 31253/371472 [2:29:23<27:44:37,  3.41it/s]
  8%|▊         | 31254/371472 [2:29:23<27:57:13,  3.38it/s]
  8%|▊         | 31255/371472 [2:29:24<27:23:20,  3.45it/s]
  8%|▊         | 31256/371472 [2:29:24<27:13:45,  3.47it/s]
  8%|▊         | 31257/371472 [2:29:24<29:08:56,  3.24it/s]
  8%|▊         | 31258/371472 [2:29:25<29:11:53,  3.24it/s]
  8%|▊         | 31259/371472 [2:29:25<28:31:34,  3.31it/s]
  8%|▊         | 31260/371472 [2:29:25<27:37:00,  3.42it/s]
                                                           
{'loss': 7.2334, 'learning_rate': 9.247074920812773e-07, 'epoch': 1.35}

  8%|▊         | 31260/371472 [2:29:25<27:37:00,  3.42it/s]
  8%|▊         | 31261/371472 [2:29:26<27:29:14,  3.44it/s]
  8%|▊         | 31262/371472 [2:29:26<27:15:21,  3.47it/s]
  8%|▊         | 31263/371472 [2:29:26<28:16:48,  3.34it/s]
  8%|▊         | 31264/371472 [2:29:26<28:22:58,  3.33it/s]
  8%|▊         | 31265/371472 [2:29:27<27:16:31,  3.46it/s]
  8%|▊         | 31266/371472 [2:29:27<25:56:58,  3.64it/s]
  8%|▊         | 31267/371472 [2:29:27<27:19:45,  3.46it/s]
  8%|▊         | 31268/371472 [2:29:28<28:13:20,  3.35it/s]
  8%|▊         | 31269/371472 [2:29:28<27:50:33,  3.39it/s]
  8%|▊         | 31270/371472 [2:29:28<28:05:43,  3.36it/s]
  8%|▊         | 31271/371472 [2:29:28<27:07:40,  3.48it/s]
  8%|▊         | 31272/371472 [2:29:29<25:47:06,  3.66it/s]
  8%|▊         | 31273/371472 [2:29:29<27:34:51,  3.43it/s]
  8%|▊         | 31274/371472 [2:29:29<28:10:00,  3.36it/s]
  8%|▊         | 31275/371472 [2:29:30<27:45:08,  3.41it/s]
  8%|▊         | 31276/371472 [2:29:30<26:22:06,  3.58it/s]
  8%|▊         | 31277/371472 [2:29:30<25:46:34,  3.67it/s]
  8%|▊         | 31278/371472 [2:29:30<25:41:13,  3.68it/s]
  8%|▊         | 31279/371472 [2:29:31<26:13:15,  3.60it/s]
  8%|▊         | 31280/371472 [2:29:31<25:56:05,  3.64it/s]
                                                           
{'loss': 7.1606, 'learning_rate': 9.246590101057984e-07, 'epoch': 1.35}

  8%|▊         | 31280/371472 [2:29:31<25:56:05,  3.64it/s]
  8%|▊         | 31281/371472 [2:29:31<25:36:10,  3.69it/s]
  8%|▊         | 31282/371472 [2:29:31<25:19:30,  3.73it/s]
  8%|▊         | 31283/371472 [2:29:32<25:08:57,  3.76it/s]
  8%|▊         | 31284/371472 [2:29:32<25:07:42,  3.76it/s]
  8%|▊         | 31285/371472 [2:29:32<24:56:11,  3.79it/s]
  8%|▊         | 31286/371472 [2:29:33<25:09:39,  3.76it/s]
  8%|▊         | 31287/371472 [2:29:33<25:28:30,  3.71it/s]
  8%|▊         | 31288/371472 [2:29:33<28:16:05,  3.34it/s]
  8%|▊         | 31289/371472 [2:29:33<27:26:38,  3.44it/s]
  8%|▊         | 31290/371472 [2:29:34<26:38:52,  3.55it/s]
  8%|▊         | 31291/371472 [2:29:34<25:51:17,  3.65it/s]
  8%|▊         | 31292/371472 [2:29:34<26:03:27,  3.63it/s]
  8%|▊         | 31293/371472 [2:29:35<25:48:34,  3.66it/s]
  8%|▊         | 31294/371472 [2:29:35<26:41:26,  3.54it/s]
  8%|▊         | 31295/371472 [2:29:35<26:37:58,  3.55it/s]
  8%|▊         | 31296/371472 [2:29:35<28:35:47,  3.30it/s]
  8%|▊         | 31297/371472 [2:29:36<27:30:19,  3.44it/s]
  8%|▊         | 31298/371472 [2:29:36<27:41:20,  3.41it/s]
  8%|▊         | 31299/371472 [2:29:36<26:58:19,  3.50it/s]
  8%|▊         | 31300/371472 [2:29:37<26:56:25,  3.51it/s]
                                                           
{'loss': 7.0721, 'learning_rate': 9.246105281303196e-07, 'epoch': 1.35}

  8%|▊         | 31300/371472 [2:29:37<26:56:25,  3.51it/s]
  8%|▊         | 31301/371472 [2:29:37<28:01:35,  3.37it/s]
  8%|▊         | 31302/371472 [2:29:37<29:35:16,  3.19it/s]
  8%|▊         | 31303/371472 [2:29:38<27:52:55,  3.39it/s]
  8%|▊         | 31304/371472 [2:29:38<28:24:32,  3.33it/s]
  8%|▊         | 31305/371472 [2:29:38<27:56:38,  3.38it/s]
  8%|▊         | 31306/371472 [2:29:38<27:52:22,  3.39it/s]
  8%|▊         | 31307/371472 [2:29:39<28:12:56,  3.35it/s]
  8%|▊         | 31308/371472 [2:29:39<26:51:44,  3.52it/s]
  8%|▊         | 31309/371472 [2:29:39<26:36:49,  3.55it/s]
  8%|▊         | 31310/371472 [2:29:40<29:11:29,  3.24it/s]
  8%|▊         | 31311/371472 [2:29:40<27:55:37,  3.38it/s]
  8%|▊         | 31312/371472 [2:29:40<26:59:52,  3.50it/s]
  8%|▊         | 31313/371472 [2:29:40<27:52:21,  3.39it/s]
  8%|▊         | 31314/371472 [2:29:41<28:48:49,  3.28it/s]
  8%|▊         | 31315/371472 [2:29:41<27:36:13,  3.42it/s]
  8%|▊         | 31316/371472 [2:29:41<27:44:47,  3.41it/s]
  8%|▊         | 31317/371472 [2:29:42<27:00:20,  3.50it/s]
  8%|▊         | 31318/371472 [2:29:42<27:44:14,  3.41it/s]
  8%|▊         | 31319/371472 [2:29:42<27:47:27,  3.40it/s]
  8%|▊         | 31320/371472 [2:29:42<26:28:13,  3.57it/s]
                                                           
{'loss': 6.8343, 'learning_rate': 9.245620461548406e-07, 'epoch': 1.35}

  8%|▊         | 31320/371472 [2:29:42<26:28:13,  3.57it/s]
  8%|▊         | 31321/371472 [2:29:43<26:21:47,  3.58it/s]
  8%|▊         | 31322/371472 [2:29:43<26:43:04,  3.54it/s]
  8%|▊         | 31323/371472 [2:29:43<26:06:23,  3.62it/s]
  8%|▊         | 31324/371472 [2:29:44<26:49:36,  3.52it/s]
  8%|▊         | 31325/371472 [2:29:44<26:28:37,  3.57it/s]
  8%|▊         | 31326/371472 [2:29:44<25:50:00,  3.66it/s]
  8%|▊         | 31327/371472 [2:29:44<26:36:53,  3.55it/s]
  8%|▊         | 31328/371472 [2:29:45<25:47:20,  3.66it/s]
  8%|▊         | 31329/371472 [2:29:45<28:40:29,  3.30it/s]
  8%|▊         | 31330/371472 [2:29:45<27:56:14,  3.38it/s]
  8%|▊         | 31331/371472 [2:29:46<27:47:56,  3.40it/s]
  8%|▊         | 31332/371472 [2:29:46<28:30:57,  3.31it/s]
  8%|▊         | 31333/371472 [2:29:46<28:48:34,  3.28it/s]
  8%|▊         | 31334/371472 [2:29:47<28:24:57,  3.32it/s]
  8%|▊         | 31335/371472 [2:29:47<29:06:07,  3.25it/s]
  8%|▊         | 31336/371472 [2:29:47<28:07:08,  3.36it/s]
  8%|▊         | 31337/371472 [2:29:47<27:19:31,  3.46it/s]
  8%|▊         | 31338/371472 [2:29:48<29:34:07,  3.20it/s]
  8%|▊         | 31339/371472 [2:29:48<33:45:29,  2.80it/s]
  8%|▊         | 31340/371472 [2:29:48<30:42:30,  3.08it/s]
                                                           
{'loss': 7.0205, 'learning_rate': 9.245135641793617e-07, 'epoch': 1.35}

  8%|▊         | 31340/371472 [2:29:48<30:42:30,  3.08it/s]
  8%|▊         | 31341/371472 [2:29:49<30:14:26,  3.12it/s]
  8%|▊         | 31342/371472 [2:29:49<29:57:01,  3.15it/s]
  8%|▊         | 31343/371472 [2:29:49<30:32:52,  3.09it/s]
  8%|▊         | 31344/371472 [2:29:50<28:28:18,  3.32it/s]
  8%|▊         | 31345/371472 [2:29:50<30:29:09,  3.10it/s]
  8%|▊         | 31346/371472 [2:29:50<29:14:02,  3.23it/s]
  8%|▊         | 31347/371472 [2:29:51<27:48:29,  3.40it/s]
  8%|▊         | 31348/371472 [2:29:51<27:35:56,  3.42it/s]
  8%|▊         | 31349/371472 [2:29:51<27:25:03,  3.45it/s]
  8%|▊         | 31350/371472 [2:29:51<28:13:52,  3.35it/s]
  8%|▊         | 31351/371472 [2:29:52<27:55:06,  3.38it/s]
  8%|▊         | 31352/371472 [2:29:52<27:28:00,  3.44it/s]
  8%|▊         | 31353/371472 [2:29:52<27:33:56,  3.43it/s]
  8%|▊         | 31354/371472 [2:29:53<26:39:48,  3.54it/s]
  8%|▊         | 31355/371472 [2:29:53<26:04:10,  3.62it/s]
  8%|▊         | 31356/371472 [2:29:53<26:40:26,  3.54it/s]
  8%|▊         | 31357/371472 [2:29:53<27:13:53,  3.47it/s]
  8%|▊         | 31358/371472 [2:29:54<26:09:44,  3.61it/s]
  8%|▊         | 31359/371472 [2:29:54<25:51:19,  3.65it/s]
  8%|▊         | 31360/371472 [2:29:54<25:44:32,  3.67it/s]
                                                           
{'loss': 7.0218, 'learning_rate': 9.244650822038829e-07, 'epoch': 1.35}

  8%|▊         | 31360/371472 [2:29:54<25:44:32,  3.67it/s]
  8%|▊         | 31361/371472 [2:29:55<26:04:23,  3.62it/s]
  8%|▊         | 31362/371472 [2:29:55<25:28:13,  3.71it/s]
  8%|▊         | 31363/371472 [2:29:55<25:04:08,  3.77it/s]
  8%|▊         | 31364/371472 [2:29:55<25:14:49,  3.74it/s]
  8%|▊         | 31365/371472 [2:29:56<25:08:11,  3.76it/s]
  8%|▊         | 31366/371472 [2:29:56<26:25:35,  3.57it/s]
  8%|▊         | 31367/371472 [2:29:56<27:20:22,  3.46it/s]
  8%|▊         | 31368/371472 [2:29:56<26:48:58,  3.52it/s]
  8%|▊         | 31369/371472 [2:29:57<26:28:37,  3.57it/s]
  8%|▊         | 31370/371472 [2:29:57<26:27:49,  3.57it/s]
  8%|▊         | 31371/371472 [2:29:57<25:39:17,  3.68it/s]
  8%|▊         | 31372/371472 [2:29:58<26:16:19,  3.60it/s]
  8%|▊         | 31373/371472 [2:29:58<25:49:30,  3.66it/s]
  8%|▊         | 31374/371472 [2:29:58<27:05:53,  3.49it/s]
  8%|▊         | 31375/371472 [2:29:58<27:23:53,  3.45it/s]
  8%|▊         | 31376/371472 [2:29:59<27:31:18,  3.43it/s]
  8%|▊         | 31377/371472 [2:29:59<29:05:59,  3.25it/s]
  8%|▊         | 31378/371472 [2:29:59<27:15:25,  3.47it/s]
  8%|▊         | 31379/371472 [2:30:00<26:43:12,  3.54it/s]
  8%|▊         | 31380/371472 [2:30:00<25:58:14,  3.64it/s]
                                                           
{'loss': 6.9216, 'learning_rate': 9.24416600228404e-07, 'epoch': 1.35}

  8%|▊         | 31380/371472 [2:30:00<25:58:14,  3.64it/s]
  8%|▊         | 31381/371472 [2:30:00<26:06:42,  3.62it/s]
  8%|▊         | 31382/371472 [2:30:00<28:05:54,  3.36it/s]
  8%|▊         | 31383/371472 [2:30:01<26:35:21,  3.55it/s]
  8%|▊         | 31384/371472 [2:30:01<27:27:35,  3.44it/s]
  8%|▊         | 31385/371472 [2:30:01<26:47:10,  3.53it/s]
  8%|▊         | 31386/371472 [2:30:02<27:58:45,  3.38it/s]
  8%|▊         | 31387/371472 [2:30:02<27:04:25,  3.49it/s]
  8%|▊         | 31388/371472 [2:30:02<27:46:30,  3.40it/s]
  8%|▊         | 31389/371472 [2:30:03<29:09:22,  3.24it/s]
  8%|▊         | 31390/371472 [2:30:03<30:04:40,  3.14it/s]
  8%|▊         | 31391/371472 [2:30:03<29:56:36,  3.15it/s]
  8%|▊         | 31392/371472 [2:30:03<28:25:53,  3.32it/s]
  8%|▊         | 31393/371472 [2:30:04<28:43:07,  3.29it/s]
  8%|▊         | 31394/371472 [2:30:04<31:39:17,  2.98it/s]
  8%|▊         | 31395/371472 [2:30:04<29:27:43,  3.21it/s]
  8%|▊         | 31396/371472 [2:30:05<28:09:14,  3.36it/s]
  8%|▊         | 31397/371472 [2:30:05<27:14:04,  3.47it/s]
  8%|▊         | 31398/371472 [2:30:05<27:39:16,  3.42it/s]
  8%|▊         | 31399/371472 [2:30:06<29:35:07,  3.19it/s]
  8%|▊         | 31400/371472 [2:30:06<28:32:56,  3.31it/s]
                                                           
{'loss': 7.1311, 'learning_rate': 9.243681182529251e-07, 'epoch': 1.35}

  8%|▊         | 31400/371472 [2:30:06<28:32:56,  3.31it/s]
  8%|▊         | 31401/371472 [2:30:06<28:00:14,  3.37it/s]
  8%|▊         | 31402/371472 [2:30:07<30:29:07,  3.10it/s]
  8%|▊         | 31403/371472 [2:30:07<29:35:10,  3.19it/s]
  8%|▊         | 31404/371472 [2:30:07<27:48:48,  3.40it/s]
  8%|▊         | 31405/371472 [2:30:07<26:51:41,  3.52it/s]
  8%|▊         | 31406/371472 [2:30:08<26:42:10,  3.54it/s]
  8%|▊         | 31407/371472 [2:30:08<27:11:10,  3.47it/s]
  8%|▊         | 31408/371472 [2:30:08<27:43:08,  3.41it/s]
  8%|▊         | 31409/371472 [2:30:09<27:52:08,  3.39it/s]
  8%|▊         | 31410/371472 [2:30:09<27:20:38,  3.45it/s]
  8%|▊         | 31411/371472 [2:30:09<26:35:01,  3.55it/s]
  8%|▊         | 31412/371472 [2:30:09<26:23:13,  3.58it/s]
  8%|▊         | 31413/371472 [2:30:10<25:45:49,  3.67it/s]
  8%|▊         | 31414/371472 [2:30:10<25:34:06,  3.69it/s]
  8%|▊         | 31415/371472 [2:30:10<26:27:01,  3.57it/s]
  8%|▊         | 31416/371472 [2:30:10<25:55:21,  3.64it/s]
  8%|▊         | 31417/371472 [2:30:11<26:36:37,  3.55it/s]
  8%|▊         | 31418/371472 [2:30:11<26:20:04,  3.59it/s]
  8%|▊         | 31419/371472 [2:30:11<27:00:32,  3.50it/s]
  8%|▊         | 31420/371472 [2:30:12<28:59:46,  3.26it/s]
                                                           
{'loss': 6.7834, 'learning_rate': 9.243196362774461e-07, 'epoch': 1.35}

  8%|▊         | 31420/371472 [2:30:12<28:59:46,  3.26it/s]
  8%|▊         | 31421/371472 [2:30:12<27:40:18,  3.41it/s]
  8%|▊         | 31422/371472 [2:30:12<26:39:48,  3.54it/s]
  8%|▊         | 31423/371472 [2:30:13<27:09:15,  3.48it/s]
  8%|▊         | 31424/371472 [2:30:13<26:16:23,  3.60it/s]
  8%|▊         | 31425/371472 [2:30:13<27:50:42,  3.39it/s]
  8%|▊         | 31426/371472 [2:30:13<28:52:30,  3.27it/s]
  8%|▊         | 31427/371472 [2:30:14<28:41:03,  3.29it/s]
  8%|▊         | 31428/371472 [2:30:14<27:57:42,  3.38it/s]
  8%|▊         | 31429/371472 [2:30:14<27:15:45,  3.46it/s]
  8%|▊         | 31430/371472 [2:30:15<29:20:46,  3.22it/s]
  8%|▊         | 31431/371472 [2:30:15<29:35:28,  3.19it/s]
  8%|▊         | 31432/371472 [2:30:15<28:13:45,  3.35it/s]
  8%|▊         | 31433/371472 [2:30:16<30:53:05,  3.06it/s]
  8%|▊         | 31434/371472 [2:30:16<30:31:28,  3.09it/s]
  8%|▊         | 31435/371472 [2:30:16<28:08:07,  3.36it/s]
  8%|▊         | 31436/371472 [2:30:16<27:36:05,  3.42it/s]
  8%|▊         | 31437/371472 [2:30:17<26:20:17,  3.59it/s]
  8%|▊         | 31438/371472 [2:30:17<25:45:45,  3.67it/s]
  8%|▊         | 31439/371472 [2:30:17<26:19:42,  3.59it/s]
  8%|▊         | 31440/371472 [2:30:18<25:28:58,  3.71it/s]
                                                           
{'loss': 6.7601, 'learning_rate': 9.242711543019672e-07, 'epoch': 1.35}

  8%|▊         | 31440/371472 [2:30:18<25:28:58,  3.71it/s]
  8%|▊         | 31441/371472 [2:30:18<29:12:55,  3.23it/s]
  8%|▊         | 31442/371472 [2:30:18<29:15:27,  3.23it/s]
  8%|▊         | 31443/371472 [2:30:19<28:45:09,  3.29it/s]
  8%|▊         | 31444/371472 [2:30:19<28:22:09,  3.33it/s]
  8%|▊         | 31445/371472 [2:30:19<29:10:19,  3.24it/s]
  8%|▊         | 31446/371472 [2:30:19<28:26:26,  3.32it/s]
  8%|▊         | 31447/371472 [2:30:20<27:46:57,  3.40it/s]
  8%|▊         | 31448/371472 [2:30:20<27:05:52,  3.49it/s]
  8%|▊         | 31449/371472 [2:30:20<27:30:11,  3.43it/s]
  8%|▊         | 31450/371472 [2:30:21<27:03:04,  3.49it/s]
  8%|▊         | 31451/371472 [2:30:21<27:01:23,  3.50it/s]
  8%|▊         | 31452/371472 [2:30:21<26:23:52,  3.58it/s]
  8%|▊         | 31453/371472 [2:30:21<26:11:19,  3.61it/s]
  8%|▊         | 31454/371472 [2:30:22<25:48:42,  3.66it/s]
  8%|▊         | 31455/371472 [2:30:22<27:22:39,  3.45it/s]
  8%|▊         | 31456/371472 [2:30:22<26:35:12,  3.55it/s]
  8%|▊         | 31457/371472 [2:30:22<26:20:24,  3.59it/s]
  8%|▊         | 31458/371472 [2:30:23<28:09:28,  3.35it/s]
  8%|▊         | 31459/371472 [2:30:23<29:13:17,  3.23it/s]
  8%|▊         | 31460/371472 [2:30:23<28:44:31,  3.29it/s]
                                                           
{'loss': 6.9749, 'learning_rate': 9.242226723264884e-07, 'epoch': 1.36}

  8%|▊         | 31460/371472 [2:30:23<28:44:31,  3.29it/s]
  8%|▊         | 31461/371472 [2:30:24<27:36:14,  3.42it/s]
  8%|▊         | 31462/371472 [2:30:24<29:07:43,  3.24it/s]
  8%|▊         | 31463/371472 [2:30:24<27:35:50,  3.42it/s]
  8%|▊         | 31464/371472 [2:30:25<27:17:52,  3.46it/s]
  8%|▊         | 31465/371472 [2:30:25<26:48:27,  3.52it/s]
  8%|▊         | 31466/371472 [2:30:25<26:06:44,  3.62it/s]
  8%|▊         | 31467/371472 [2:30:25<28:06:24,  3.36it/s]
  8%|▊         | 31468/371472 [2:30:26<28:02:21,  3.37it/s]
  8%|▊         | 31469/371472 [2:30:26<26:30:28,  3.56it/s]
  8%|▊         | 31470/371472 [2:30:26<25:38:15,  3.68it/s]
  8%|▊         | 31471/371472 [2:30:27<25:48:12,  3.66it/s]
  8%|▊         | 31472/371472 [2:30:27<29:29:37,  3.20it/s]
  8%|▊         | 31473/371472 [2:30:27<28:23:31,  3.33it/s]
  8%|▊         | 31474/371472 [2:30:28<28:39:38,  3.30it/s]
  8%|▊         | 31475/371472 [2:30:28<28:46:28,  3.28it/s]
  8%|▊         | 31476/371472 [2:30:28<29:06:22,  3.24it/s]
  8%|▊         | 31477/371472 [2:30:28<28:16:43,  3.34it/s]
  8%|▊         | 31478/371472 [2:30:29<28:15:54,  3.34it/s]
  8%|▊         | 31479/371472 [2:30:29<27:17:31,  3.46it/s]
  8%|▊         | 31480/371472 [2:30:29<26:49:38,  3.52it/s]
                                                           
{'loss': 6.8912, 'learning_rate': 9.241741903510094e-07, 'epoch': 1.36}

  8%|▊         | 31480/371472 [2:30:29<26:49:38,  3.52it/s]
  8%|▊         | 31481/371472 [2:30:30<26:18:02,  3.59it/s]
  8%|▊         | 31482/371472 [2:30:30<25:42:45,  3.67it/s]
  8%|▊         | 31483/371472 [2:30:30<25:18:57,  3.73it/s]
  8%|▊         | 31484/371472 [2:30:30<24:55:29,  3.79it/s]
  8%|▊         | 31485/371472 [2:30:31<25:22:22,  3.72it/s]
  8%|▊         | 31486/371472 [2:30:31<25:24:13,  3.72it/s]
  8%|▊         | 31487/371472 [2:30:31<26:11:16,  3.61it/s]
  8%|▊         | 31488/371472 [2:30:31<25:27:15,  3.71it/s]
  8%|▊         | 31489/371472 [2:30:32<27:25:58,  3.44it/s]
  8%|▊         | 31490/371472 [2:30:32<26:17:34,  3.59it/s]
  8%|▊         | 31491/371472 [2:30:32<25:42:20,  3.67it/s]
  8%|▊         | 31492/371472 [2:30:33<25:32:16,  3.70it/s]
  8%|▊         | 31493/371472 [2:30:33<29:18:39,  3.22it/s]
  8%|▊         | 31494/371472 [2:30:33<27:50:36,  3.39it/s]
  8%|▊         | 31495/371472 [2:30:33<27:34:49,  3.42it/s]
  8%|▊         | 31496/371472 [2:30:34<27:24:14,  3.45it/s]
  8%|▊         | 31497/371472 [2:30:34<27:56:35,  3.38it/s]
  8%|▊         | 31498/371472 [2:30:34<27:58:38,  3.38it/s]
  8%|▊         | 31499/371472 [2:30:35<27:19:30,  3.46it/s]
  8%|▊         | 31500/371472 [2:30:35<27:51:53,  3.39it/s]
                                                           
{'loss': 7.0472, 'learning_rate': 9.241257083755305e-07, 'epoch': 1.36}

  8%|▊         | 31500/371472 [2:30:35<27:51:53,  3.39it/s]
  8%|▊         | 31501/371472 [2:30:35<26:55:12,  3.51it/s]
  8%|▊         | 31502/371472 [2:30:35<26:09:55,  3.61it/s]
  8%|▊         | 31503/371472 [2:30:36<25:53:54,  3.65it/s]
  8%|▊         | 31504/371472 [2:30:36<25:29:53,  3.70it/s]
  8%|▊         | 31505/371472 [2:30:36<24:51:11,  3.80it/s]
  8%|▊         | 31506/371472 [2:30:37<26:29:21,  3.57it/s]
  8%|▊         | 31507/371472 [2:30:37<26:51:23,  3.52it/s]
  8%|▊         | 31508/371472 [2:30:37<26:01:05,  3.63it/s]
  8%|▊         | 31509/371472 [2:30:37<26:12:36,  3.60it/s]
  8%|▊         | 31510/371472 [2:30:38<26:15:43,  3.60it/s]
  8%|▊         | 31511/371472 [2:30:38<25:42:31,  3.67it/s]
  8%|▊         | 31512/371472 [2:30:38<25:18:11,  3.73it/s]
  8%|▊         | 31513/371472 [2:30:38<26:05:09,  3.62it/s]
  8%|▊         | 31514/371472 [2:30:39<26:25:47,  3.57it/s]
  8%|▊         | 31515/371472 [2:30:39<26:08:51,  3.61it/s]
  8%|▊         | 31516/371472 [2:30:39<26:08:38,  3.61it/s]
  8%|▊         | 31517/371472 [2:30:40<28:22:26,  3.33it/s]
  8%|▊         | 31518/371472 [2:30:40<28:22:19,  3.33it/s]
  8%|▊         | 31519/371472 [2:30:40<27:32:32,  3.43it/s]
  8%|▊         | 31520/371472 [2:30:41<26:30:51,  3.56it/s]
                                                           
{'loss': 7.0801, 'learning_rate': 9.240772264000517e-07, 'epoch': 1.36}

  8%|▊         | 31520/371472 [2:30:41<26:30:51,  3.56it/s]
  8%|▊         | 31521/371472 [2:30:41<26:09:03,  3.61it/s]
  8%|▊         | 31522/371472 [2:30:41<25:14:42,  3.74it/s]
  8%|▊         | 31523/371472 [2:30:41<25:57:04,  3.64it/s]
  8%|▊         | 31524/371472 [2:30:42<26:14:17,  3.60it/s]
  8%|▊         | 31525/371472 [2:30:42<26:54:43,  3.51it/s]
  8%|▊         | 31526/371472 [2:30:42<26:06:33,  3.62it/s]
  8%|▊         | 31527/371472 [2:30:42<25:36:12,  3.69it/s]
  8%|▊         | 31528/371472 [2:30:43<25:28:29,  3.71it/s]
  8%|▊         | 31529/371472 [2:30:43<26:39:37,  3.54it/s]
  8%|▊         | 31530/371472 [2:30:43<26:17:49,  3.59it/s]
  8%|▊         | 31531/371472 [2:30:44<26:21:10,  3.58it/s]
  8%|▊         | 31532/371472 [2:30:44<26:25:40,  3.57it/s]
  8%|▊         | 31533/371472 [2:30:44<27:23:32,  3.45it/s]
  8%|▊         | 31534/371472 [2:30:44<26:43:42,  3.53it/s]
  8%|▊         | 31535/371472 [2:30:45<26:43:25,  3.53it/s]
  8%|▊         | 31536/371472 [2:30:45<27:59:28,  3.37it/s]
  8%|▊         | 31537/371472 [2:30:45<26:31:53,  3.56it/s]
  8%|▊         | 31538/371472 [2:30:46<26:11:42,  3.60it/s]
  8%|▊         | 31539/371472 [2:30:46<26:10:43,  3.61it/s]
  8%|▊         | 31540/371472 [2:30:46<26:13:50,  3.60it/s]
                                                           
{'loss': 6.9824, 'learning_rate': 9.240287444245728e-07, 'epoch': 1.36}

  8%|▊         | 31540/371472 [2:30:46<26:13:50,  3.60it/s]
  8%|▊         | 31541/371472 [2:30:46<26:35:41,  3.55it/s]
  8%|▊         | 31542/371472 [2:30:47<26:54:51,  3.51it/s]
  8%|▊         | 31543/371472 [2:30:47<28:06:03,  3.36it/s]
  8%|▊         | 31544/371472 [2:30:47<27:24:00,  3.45it/s]
  8%|▊         | 31545/371472 [2:30:48<26:39:19,  3.54it/s]
  8%|▊         | 31546/371472 [2:30:48<26:08:02,  3.61it/s]
  8%|▊         | 31547/371472 [2:30:48<28:38:33,  3.30it/s]
  8%|▊         | 31548/371472 [2:30:48<29:09:09,  3.24it/s]
  8%|▊         | 31549/371472 [2:30:49<27:23:25,  3.45it/s]
  8%|▊         | 31550/371472 [2:30:49<27:21:28,  3.45it/s]
  8%|▊         | 31551/371472 [2:30:49<26:48:56,  3.52it/s]
  8%|▊         | 31552/371472 [2:30:50<26:13:38,  3.60it/s]
  8%|▊         | 31553/371472 [2:30:50<27:18:37,  3.46it/s]
  8%|▊         | 31554/371472 [2:30:50<28:23:52,  3.32it/s]
  8%|▊         | 31555/371472 [2:30:50<27:46:25,  3.40it/s]
  8%|▊         | 31556/371472 [2:30:51<27:44:04,  3.40it/s]
  8%|▊         | 31557/371472 [2:30:51<26:51:28,  3.52it/s]
  8%|▊         | 31558/371472 [2:30:51<25:57:48,  3.64it/s]
  8%|▊         | 31559/371472 [2:30:52<26:21:39,  3.58it/s]
  8%|▊         | 31560/371472 [2:30:52<26:07:40,  3.61it/s]
                                                           
{'loss': 6.8021, 'learning_rate': 9.23980262449094e-07, 'epoch': 1.36}

  8%|▊         | 31560/371472 [2:30:52<26:07:40,  3.61it/s]
  8%|▊         | 31561/371472 [2:30:52<26:04:15,  3.62it/s]
  8%|▊         | 31562/371472 [2:30:52<26:02:47,  3.63it/s]
  8%|▊         | 31563/371472 [2:30:53<26:24:09,  3.58it/s]
  8%|▊         | 31564/371472 [2:30:53<26:11:04,  3.61it/s]
  8%|▊         | 31565/371472 [2:30:53<26:18:31,  3.59it/s]
  8%|▊         | 31566/371472 [2:30:54<25:57:00,  3.64it/s]
  8%|▊         | 31567/371472 [2:30:54<27:08:08,  3.48it/s]
  8%|▊         | 31568/371472 [2:30:54<26:44:26,  3.53it/s]
  8%|▊         | 31569/371472 [2:30:54<26:43:48,  3.53it/s]
  8%|▊         | 31570/371472 [2:30:55<26:18:16,  3.59it/s]
  8%|▊         | 31571/371472 [2:30:55<27:13:02,  3.47it/s]
  8%|▊         | 31572/371472 [2:30:55<27:28:48,  3.44it/s]
  8%|▊         | 31573/371472 [2:30:56<26:33:09,  3.56it/s]
  8%|▊         | 31574/371472 [2:30:56<26:36:22,  3.55it/s]
  8%|▊         | 31575/371472 [2:30:56<26:30:53,  3.56it/s]
  9%|▊         | 31576/371472 [2:30:56<25:45:08,  3.67it/s]
  9%|▊         | 31577/371472 [2:30:57<25:55:01,  3.64it/s]
  9%|▊         | 31578/371472 [2:30:57<26:04:42,  3.62it/s]
  9%|▊         | 31579/371472 [2:30:57<26:37:35,  3.55it/s]
  9%|▊         | 31580/371472 [2:30:58<30:04:34,  3.14it/s]
                                                           
{'loss': 6.6614, 'learning_rate': 9.239317804736149e-07, 'epoch': 1.36}

  9%|▊         | 31580/371472 [2:30:58<30:04:34,  3.14it/s]
  9%|▊         | 31581/371472 [2:30:58<28:59:08,  3.26it/s]
  9%|▊         | 31582/371472 [2:30:58<29:41:56,  3.18it/s]
  9%|▊         | 31583/371472 [2:30:58<27:40:56,  3.41it/s]
  9%|▊         | 31584/371472 [2:30:59<30:10:08,  3.13it/s]
  9%|▊         | 31585/371472 [2:30:59<30:31:58,  3.09it/s]
  9%|▊         | 31586/371472 [2:30:59<28:44:31,  3.28it/s]
  9%|▊         | 31587/371472 [2:31:00<27:53:18,  3.39it/s]
  9%|▊         | 31588/371472 [2:31:00<27:08:27,  3.48it/s]
  9%|▊         | 31589/371472 [2:31:00<26:04:04,  3.62it/s]
  9%|▊         | 31590/371472 [2:31:00<25:26:27,  3.71it/s]
  9%|▊         | 31591/371472 [2:31:01<25:09:07,  3.75it/s]
  9%|▊         | 31592/371472 [2:31:01<25:47:23,  3.66it/s]
  9%|▊         | 31593/371472 [2:31:01<27:30:39,  3.43it/s]
  9%|▊         | 31594/371472 [2:31:02<29:25:37,  3.21it/s]
  9%|▊         | 31595/371472 [2:31:02<28:29:57,  3.31it/s]
  9%|▊         | 31596/371472 [2:31:02<30:45:22,  3.07it/s]
  9%|▊         | 31597/371472 [2:31:03<28:56:57,  3.26it/s]
  9%|▊         | 31598/371472 [2:31:03<27:19:29,  3.46it/s]
  9%|▊         | 31599/371472 [2:31:03<27:37:30,  3.42it/s]
  9%|▊         | 31600/371472 [2:31:03<27:21:23,  3.45it/s]
                                                           
{'loss': 7.0195, 'learning_rate': 9.238832984981361e-07, 'epoch': 1.36}

  9%|▊         | 31600/371472 [2:31:03<27:21:23,  3.45it/s]
  9%|▊         | 31601/371472 [2:31:04<26:36:19,  3.55it/s]
  9%|▊         | 31602/371472 [2:31:04<25:50:45,  3.65it/s]
  9%|▊         | 31603/371472 [2:31:04<25:49:04,  3.66it/s]
  9%|▊         | 31604/371472 [2:31:05<25:50:27,  3.65it/s]
  9%|▊         | 31605/371472 [2:31:05<26:12:39,  3.60it/s]
  9%|▊         | 31606/371472 [2:31:05<25:57:40,  3.64it/s]
  9%|▊         | 31607/371472 [2:31:05<26:11:01,  3.61it/s]
  9%|▊         | 31608/371472 [2:31:06<26:49:48,  3.52it/s]
  9%|▊         | 31609/371472 [2:31:06<28:10:27,  3.35it/s]
  9%|▊         | 31610/371472 [2:31:06<27:06:50,  3.48it/s]
  9%|▊         | 31611/371472 [2:31:06<25:52:29,  3.65it/s]
  9%|▊         | 31612/371472 [2:31:07<25:13:19,  3.74it/s]
  9%|▊         | 31613/371472 [2:31:07<25:02:32,  3.77it/s]
  9%|▊         | 31614/371472 [2:31:07<24:40:38,  3.83it/s]
  9%|▊         | 31615/371472 [2:31:08<25:22:33,  3.72it/s]
  9%|▊         | 31616/371472 [2:31:08<26:27:42,  3.57it/s]
  9%|▊         | 31617/371472 [2:31:08<27:41:05,  3.41it/s]
  9%|▊         | 31618/371472 [2:31:08<26:30:29,  3.56it/s]
  9%|▊         | 31619/371472 [2:31:09<26:45:48,  3.53it/s]
  9%|▊         | 31620/371472 [2:31:09<26:31:46,  3.56it/s]
                                                           
{'loss': 6.989, 'learning_rate': 9.238348165226572e-07, 'epoch': 1.36}

  9%|▊         | 31620/371472 [2:31:09<26:31:46,  3.56it/s]
  9%|▊         | 31621/371472 [2:31:09<26:08:56,  3.61it/s]
  9%|▊         | 31622/371472 [2:31:10<27:16:34,  3.46it/s]
  9%|▊         | 31623/371472 [2:31:10<26:38:18,  3.54it/s]
  9%|▊         | 31624/371472 [2:31:10<26:48:48,  3.52it/s]
  9%|▊         | 31625/371472 [2:31:10<26:18:03,  3.59it/s]
  9%|▊         | 31626/371472 [2:31:11<27:42:21,  3.41it/s]
  9%|▊         | 31627/371472 [2:31:11<26:40:33,  3.54it/s]
  9%|▊         | 31628/371472 [2:31:11<26:34:15,  3.55it/s]
  9%|▊         | 31629/371472 [2:31:12<26:56:29,  3.50it/s]
  9%|▊         | 31630/371472 [2:31:12<26:20:48,  3.58it/s]
  9%|▊         | 31631/371472 [2:31:12<27:51:41,  3.39it/s]
  9%|▊         | 31632/371472 [2:31:12<26:11:02,  3.61it/s]
  9%|▊         | 31633/371472 [2:31:13<25:43:52,  3.67it/s]
  9%|▊         | 31634/371472 [2:31:13<29:48:50,  3.17it/s]
  9%|▊         | 31635/371472 [2:31:13<29:58:31,  3.15it/s]
  9%|▊         | 31636/371472 [2:31:14<37:15:30,  2.53it/s]
  9%|▊         | 31637/371472 [2:31:14<33:26:42,  2.82it/s]
  9%|▊         | 31638/371472 [2:31:15<34:22:02,  2.75it/s]
  9%|▊         | 31639/371472 [2:31:15<32:06:10,  2.94it/s]
  9%|▊         | 31640/371472 [2:31:15<30:27:02,  3.10it/s]
                                                           
{'loss': 6.6913, 'learning_rate': 9.237863345471783e-07, 'epoch': 1.36}

  9%|▊         | 31640/371472 [2:31:15<30:27:02,  3.10it/s]
  9%|▊         | 31641/371472 [2:31:15<28:45:46,  3.28it/s]
  9%|▊         | 31642/371472 [2:31:16<28:01:59,  3.37it/s]
  9%|▊         | 31643/371472 [2:31:16<35:24:11,  2.67it/s]
  9%|▊         | 31644/371472 [2:31:17<32:12:25,  2.93it/s]
  9%|▊         | 31645/371472 [2:31:17<30:07:14,  3.13it/s]
  9%|▊         | 31646/371472 [2:31:17<29:27:49,  3.20it/s]
  9%|▊         | 31647/371472 [2:31:17<29:08:54,  3.24it/s]
  9%|▊         | 31648/371472 [2:31:18<28:26:47,  3.32it/s]
  9%|▊         | 31649/371472 [2:31:18<28:22:00,  3.33it/s]
  9%|▊         | 31650/371472 [2:31:18<28:39:33,  3.29it/s]
  9%|▊         | 31651/371472 [2:31:19<27:55:17,  3.38it/s]
  9%|▊         | 31652/371472 [2:31:19<26:59:17,  3.50it/s]
  9%|▊         | 31653/371472 [2:31:19<26:25:51,  3.57it/s]
  9%|▊         | 31654/371472 [2:31:19<26:41:28,  3.54it/s]
  9%|▊         | 31655/371472 [2:31:20<26:56:29,  3.50it/s]
  9%|▊         | 31656/371472 [2:31:20<26:45:51,  3.53it/s]
  9%|▊         | 31657/371472 [2:31:20<25:57:58,  3.64it/s]
  9%|▊         | 31658/371472 [2:31:21<26:14:52,  3.60it/s]
  9%|▊         | 31659/371472 [2:31:21<25:28:35,  3.71it/s]
  9%|▊         | 31660/371472 [2:31:21<25:39:10,  3.68it/s]
                                                           
{'loss': 6.7222, 'learning_rate': 9.237378525716994e-07, 'epoch': 1.36}

  9%|▊         | 31660/371472 [2:31:21<25:39:10,  3.68it/s]
  9%|▊         | 31661/371472 [2:31:21<25:50:36,  3.65it/s]
  9%|▊         | 31662/371472 [2:31:22<25:43:31,  3.67it/s]
  9%|▊         | 31663/371472 [2:31:22<24:59:24,  3.78it/s]
  9%|▊         | 31664/371472 [2:31:22<26:07:40,  3.61it/s]
  9%|▊         | 31665/371472 [2:31:22<25:41:12,  3.67it/s]
  9%|▊         | 31666/371472 [2:31:23<25:12:20,  3.74it/s]
  9%|▊         | 31667/371472 [2:31:23<25:52:30,  3.65it/s]
  9%|▊         | 31668/371472 [2:31:23<25:50:41,  3.65it/s]
  9%|▊         | 31669/371472 [2:31:23<25:59:31,  3.63it/s]
  9%|▊         | 31670/371472 [2:31:24<26:05:03,  3.62it/s]
  9%|▊         | 31671/371472 [2:31:24<25:21:51,  3.72it/s]
  9%|▊         | 31672/371472 [2:31:24<26:53:46,  3.51it/s]
  9%|▊         | 31673/371472 [2:31:25<27:12:10,  3.47it/s]
  9%|▊         | 31674/371472 [2:31:25<27:21:15,  3.45it/s]
  9%|▊         | 31675/371472 [2:31:25<29:04:50,  3.25it/s]
  9%|▊         | 31676/371472 [2:31:26<28:40:12,  3.29it/s]
  9%|▊         | 31677/371472 [2:31:26<28:06:42,  3.36it/s]
  9%|▊         | 31678/371472 [2:31:26<28:33:54,  3.30it/s]
  9%|▊         | 31679/371472 [2:31:26<27:50:07,  3.39it/s]
  9%|▊         | 31680/371472 [2:31:27<28:01:17,  3.37it/s]
                                                           
{'loss': 6.9444, 'learning_rate': 9.236893705962206e-07, 'epoch': 1.36}

  9%|▊         | 31680/371472 [2:31:27<28:01:17,  3.37it/s]
  9%|▊         | 31681/371472 [2:31:27<28:50:44,  3.27it/s]
  9%|▊         | 31682/371472 [2:31:27<27:56:39,  3.38it/s]
  9%|▊         | 31683/371472 [2:31:28<27:36:56,  3.42it/s]
  9%|▊         | 31684/371472 [2:31:28<28:57:42,  3.26it/s]
  9%|▊         | 31685/371472 [2:31:28<28:31:27,  3.31it/s]
  9%|▊         | 31686/371472 [2:31:29<27:17:56,  3.46it/s]
  9%|▊         | 31687/371472 [2:31:29<27:03:40,  3.49it/s]
  9%|▊         | 31688/371472 [2:31:29<26:47:16,  3.52it/s]
  9%|▊         | 31689/371472 [2:31:29<27:00:40,  3.49it/s]
  9%|▊         | 31690/371472 [2:31:30<27:05:32,  3.48it/s]
  9%|▊         | 31691/371472 [2:31:30<27:46:41,  3.40it/s]
  9%|▊         | 31692/371472 [2:31:30<27:00:21,  3.49it/s]
  9%|▊         | 31693/371472 [2:31:31<28:16:06,  3.34it/s]
  9%|▊         | 31694/371472 [2:31:31<27:04:55,  3.49it/s]
  9%|▊         | 31695/371472 [2:31:31<26:15:31,  3.59it/s]
  9%|▊         | 31696/371472 [2:31:31<26:17:09,  3.59it/s]
  9%|▊         | 31697/371472 [2:31:32<26:40:23,  3.54it/s]
  9%|▊         | 31698/371472 [2:31:32<26:12:26,  3.60it/s]
  9%|▊         | 31699/371472 [2:31:32<26:24:07,  3.57it/s]
  9%|▊         | 31700/371472 [2:31:33<27:12:50,  3.47it/s]
                                                           
{'loss': 6.6173, 'learning_rate': 9.236408886207416e-07, 'epoch': 1.37}

  9%|▊         | 31700/371472 [2:31:33<27:12:50,  3.47it/s]
  9%|▊         | 31701/371472 [2:31:33<26:08:12,  3.61it/s]
  9%|▊         | 31702/371472 [2:31:33<25:23:36,  3.72it/s]
  9%|▊         | 31703/371472 [2:31:33<25:32:08,  3.70it/s]
  9%|▊         | 31704/371472 [2:31:34<26:39:13,  3.54it/s]
  9%|▊         | 31705/371472 [2:31:34<25:43:51,  3.67it/s]
  9%|▊         | 31706/371472 [2:31:34<25:09:54,  3.75it/s]
  9%|▊         | 31707/371472 [2:31:34<24:40:10,  3.83it/s]
  9%|▊         | 31708/371472 [2:31:35<25:25:01,  3.71it/s]
  9%|▊         | 31709/371472 [2:31:35<25:25:08,  3.71it/s]
  9%|▊         | 31710/371472 [2:31:35<28:48:18,  3.28it/s]
  9%|▊         | 31711/371472 [2:31:36<27:24:09,  3.44it/s]
  9%|▊         | 31712/371472 [2:31:36<26:24:14,  3.57it/s]
  9%|▊         | 31713/371472 [2:31:36<27:01:38,  3.49it/s]
  9%|▊         | 31714/371472 [2:31:36<26:53:35,  3.51it/s]
  9%|▊         | 31715/371472 [2:31:37<26:57:00,  3.50it/s]
  9%|▊         | 31716/371472 [2:31:37<26:29:11,  3.56it/s]
  9%|▊         | 31717/371472 [2:31:37<27:40:27,  3.41it/s]
  9%|▊         | 31718/371472 [2:31:38<26:45:52,  3.53it/s]
  9%|▊         | 31719/371472 [2:31:38<26:38:17,  3.54it/s]
  9%|▊         | 31720/371472 [2:31:38<26:03:47,  3.62it/s]
                                                           
{'loss': 6.9346, 'learning_rate': 9.235924066452627e-07, 'epoch': 1.37}

  9%|▊         | 31720/371472 [2:31:38<26:03:47,  3.62it/s]
  9%|▊         | 31721/371472 [2:31:38<26:13:06,  3.60it/s]
  9%|▊         | 31722/371472 [2:31:39<27:45:17,  3.40it/s]
  9%|▊         | 31723/371472 [2:31:39<27:25:44,  3.44it/s]
  9%|▊         | 31724/371472 [2:31:39<26:00:19,  3.63it/s]
  9%|▊         | 31725/371472 [2:31:40<26:45:49,  3.53it/s]
  9%|▊         | 31726/371472 [2:31:40<26:49:15,  3.52it/s]
  9%|▊         | 31727/371472 [2:31:40<27:21:42,  3.45it/s]
  9%|▊         | 31728/371472 [2:31:40<26:56:34,  3.50it/s]
  9%|▊         | 31729/371472 [2:31:41<28:34:21,  3.30it/s]
  9%|▊         | 31730/371472 [2:31:41<30:08:53,  3.13it/s]
  9%|▊         | 31731/371472 [2:31:41<28:55:10,  3.26it/s]
  9%|▊         | 31732/371472 [2:31:42<31:35:12,  2.99it/s]
  9%|▊         | 31733/371472 [2:31:42<30:47:50,  3.06it/s]
  9%|▊         | 31734/371472 [2:31:42<29:45:58,  3.17it/s]
  9%|▊         | 31735/371472 [2:31:43<28:20:08,  3.33it/s]
  9%|▊         | 31736/371472 [2:31:43<28:10:04,  3.35it/s]
  9%|▊         | 31737/371472 [2:31:43<27:15:52,  3.46it/s]
  9%|▊         | 31738/371472 [2:31:43<27:24:44,  3.44it/s]
  9%|▊         | 31739/371472 [2:31:44<26:49:07,  3.52it/s]
  9%|▊         | 31740/371472 [2:31:44<26:24:21,  3.57it/s]
                                                           
{'loss': 6.9446, 'learning_rate': 9.235439246697838e-07, 'epoch': 1.37}

  9%|▊         | 31740/371472 [2:31:44<26:24:21,  3.57it/s]
  9%|▊         | 31741/371472 [2:31:44<26:01:30,  3.63it/s]
  9%|▊         | 31742/371472 [2:31:45<25:06:08,  3.76it/s]
  9%|▊         | 31743/371472 [2:31:45<24:53:48,  3.79it/s]
  9%|▊         | 31744/371472 [2:31:45<24:40:20,  3.82it/s]
  9%|▊         | 31745/371472 [2:31:45<27:16:49,  3.46it/s]
  9%|▊         | 31746/371472 [2:31:46<26:41:47,  3.53it/s]
  9%|▊         | 31747/371472 [2:31:46<29:46:41,  3.17it/s]
  9%|▊         | 31748/371472 [2:31:46<28:39:25,  3.29it/s]
  9%|▊         | 31749/371472 [2:31:47<27:00:57,  3.49it/s]
  9%|▊         | 31750/371472 [2:31:47<26:06:15,  3.61it/s]
  9%|▊         | 31751/371472 [2:31:47<25:58:49,  3.63it/s]
  9%|▊         | 31752/371472 [2:31:47<27:17:07,  3.46it/s]
  9%|▊         | 31753/371472 [2:31:48<26:30:19,  3.56it/s]
  9%|▊         | 31754/371472 [2:31:48<26:52:24,  3.51it/s]
  9%|▊         | 31755/371472 [2:31:48<26:37:10,  3.54it/s]
  9%|▊         | 31756/371472 [2:31:49<26:00:00,  3.63it/s]
  9%|▊         | 31757/371472 [2:31:49<26:21:23,  3.58it/s]
  9%|▊         | 31758/371472 [2:31:49<25:34:55,  3.69it/s]
  9%|▊         | 31759/371472 [2:31:49<26:05:23,  3.62it/s]
  9%|▊         | 31760/371472 [2:31:50<27:06:42,  3.48it/s]
                                                           
{'loss': 7.1068, 'learning_rate': 9.23495442694305e-07, 'epoch': 1.37}

  9%|▊         | 31760/371472 [2:31:50<27:06:42,  3.48it/s]
  9%|▊         | 31761/371472 [2:31:50<26:32:52,  3.55it/s]
  9%|▊         | 31762/371472 [2:31:50<26:37:27,  3.54it/s]
  9%|▊         | 31763/371472 [2:31:50<26:06:12,  3.61it/s]
  9%|▊         | 31764/371472 [2:31:51<26:27:34,  3.57it/s]
  9%|▊         | 31765/371472 [2:31:51<26:21:22,  3.58it/s]
  9%|▊         | 31766/371472 [2:31:51<26:11:53,  3.60it/s]
  9%|▊         | 31767/371472 [2:31:52<26:15:50,  3.59it/s]
  9%|▊         | 31768/371472 [2:31:52<27:00:32,  3.49it/s]
  9%|▊         | 31769/371472 [2:31:52<25:54:25,  3.64it/s]
  9%|▊         | 31770/371472 [2:31:52<27:50:37,  3.39it/s]
  9%|▊         | 31771/371472 [2:31:53<26:40:01,  3.54it/s]
  9%|▊         | 31772/371472 [2:31:53<26:22:53,  3.58it/s]
  9%|▊         | 31773/371472 [2:31:53<25:40:34,  3.68it/s]
  9%|▊         | 31774/371472 [2:31:54<25:16:07,  3.73it/s]
  9%|▊         | 31775/371472 [2:31:54<25:45:39,  3.66it/s]
  9%|▊         | 31776/371472 [2:31:54<27:17:51,  3.46it/s]
  9%|▊         | 31777/371472 [2:31:54<26:29:39,  3.56it/s]
  9%|▊         | 31778/371472 [2:31:55<26:07:47,  3.61it/s]
  9%|▊         | 31779/371472 [2:31:55<26:20:56,  3.58it/s]
  9%|▊         | 31780/371472 [2:31:55<25:57:01,  3.64it/s]
                                                           
{'loss': 6.7589, 'learning_rate': 9.234469607188259e-07, 'epoch': 1.37}

  9%|▊         | 31780/371472 [2:31:55<25:57:01,  3.64it/s]
  9%|▊         | 31781/371472 [2:31:56<27:13:06,  3.47it/s]
  9%|▊         | 31782/371472 [2:31:56<28:34:05,  3.30it/s]
  9%|▊         | 31783/371472 [2:31:56<28:45:02,  3.28it/s]
  9%|▊         | 31784/371472 [2:31:56<28:50:22,  3.27it/s]
  9%|▊         | 31785/371472 [2:31:57<28:05:37,  3.36it/s]
  9%|▊         | 31786/371472 [2:31:57<30:02:45,  3.14it/s]
  9%|▊         | 31787/371472 [2:31:57<28:02:08,  3.37it/s]
  9%|▊         | 31788/371472 [2:31:58<27:21:31,  3.45it/s]
  9%|▊         | 31789/371472 [2:31:58<27:31:18,  3.43it/s]
  9%|▊         | 31790/371472 [2:31:58<30:19:45,  3.11it/s]
  9%|▊         | 31791/371472 [2:31:59<28:28:15,  3.31it/s]
  9%|▊         | 31792/371472 [2:31:59<27:26:05,  3.44it/s]
  9%|▊         | 31793/371472 [2:31:59<28:18:55,  3.33it/s]
  9%|▊         | 31794/371472 [2:31:59<28:02:35,  3.36it/s]
  9%|▊         | 31795/371472 [2:32:00<28:26:33,  3.32it/s]
  9%|▊         | 31796/371472 [2:32:00<28:05:38,  3.36it/s]
  9%|▊         | 31797/371472 [2:32:00<28:00:47,  3.37it/s]
  9%|▊         | 31798/371472 [2:32:01<29:11:06,  3.23it/s]
  9%|▊         | 31799/371472 [2:32:01<28:41:06,  3.29it/s]
  9%|▊         | 31800/371472 [2:32:01<27:55:06,  3.38it/s]
                                                           
{'loss': 6.7636, 'learning_rate': 9.233984787433472e-07, 'epoch': 1.37}

  9%|▊         | 31800/371472 [2:32:01<27:55:06,  3.38it/s]
  9%|▊         | 31801/371472 [2:32:02<26:58:18,  3.50it/s]
  9%|▊         | 31802/371472 [2:32:02<27:35:43,  3.42it/s]
  9%|▊         | 31803/371472 [2:32:02<27:20:05,  3.45it/s]
  9%|▊         | 31804/371472 [2:32:02<27:40:54,  3.41it/s]
  9%|▊         | 31805/371472 [2:32:03<27:41:12,  3.41it/s]
  9%|▊         | 31806/371472 [2:32:03<27:38:59,  3.41it/s]
  9%|▊         | 31807/371472 [2:32:03<26:50:56,  3.51it/s]
  9%|▊         | 31808/371472 [2:32:04<26:28:05,  3.56it/s]
  9%|▊         | 31809/371472 [2:32:04<25:45:41,  3.66it/s]
  9%|▊         | 31810/371472 [2:32:04<26:31:06,  3.56it/s]
  9%|▊         | 31811/371472 [2:32:04<28:07:25,  3.35it/s]
  9%|▊         | 31812/371472 [2:32:05<27:54:56,  3.38it/s]
  9%|▊         | 31813/371472 [2:32:05<28:41:28,  3.29it/s]
  9%|▊         | 31814/371472 [2:32:05<27:16:08,  3.46it/s]
  9%|▊         | 31815/371472 [2:32:06<26:50:47,  3.51it/s]
  9%|▊         | 31816/371472 [2:32:06<27:17:51,  3.46it/s]
  9%|▊         | 31817/371472 [2:32:06<26:50:25,  3.52it/s]
  9%|▊         | 31818/371472 [2:32:06<26:54:05,  3.51it/s]
  9%|▊         | 31819/371472 [2:32:07<26:41:33,  3.53it/s]
  9%|▊         | 31820/371472 [2:32:07<26:55:46,  3.50it/s]
                                                           
{'loss': 6.7678, 'learning_rate': 9.233499967678682e-07, 'epoch': 1.37}

  9%|▊         | 31820/371472 [2:32:07<26:55:46,  3.50it/s]
  9%|▊         | 31821/371472 [2:32:07<26:31:05,  3.56it/s]
  9%|▊         | 31822/371472 [2:32:08<26:06:59,  3.61it/s]
  9%|▊         | 31823/371472 [2:32:08<25:54:55,  3.64it/s]
  9%|▊         | 31824/371472 [2:32:08<25:02:17,  3.77it/s]
  9%|▊         | 31825/371472 [2:32:08<25:51:19,  3.65it/s]
  9%|▊         | 31826/371472 [2:32:09<24:57:44,  3.78it/s]
  9%|▊         | 31827/371472 [2:32:09<25:02:14,  3.77it/s]
  9%|▊         | 31828/371472 [2:32:09<25:10:08,  3.75it/s]
  9%|▊         | 31829/371472 [2:32:09<25:26:32,  3.71it/s]
  9%|▊         | 31830/371472 [2:32:10<26:58:23,  3.50it/s]
  9%|▊         | 31831/371472 [2:32:10<26:57:20,  3.50it/s]
  9%|▊         | 31832/371472 [2:32:10<27:12:31,  3.47it/s]
  9%|▊         | 31833/371472 [2:32:11<27:44:09,  3.40it/s]
  9%|▊         | 31834/371472 [2:32:11<26:45:25,  3.53it/s]
  9%|▊         | 31835/371472 [2:32:11<26:30:18,  3.56it/s]
  9%|▊         | 31836/371472 [2:32:11<27:24:06,  3.44it/s]
  9%|▊         | 31837/371472 [2:32:12<26:58:30,  3.50it/s]
  9%|▊         | 31838/371472 [2:32:12<28:28:46,  3.31it/s]
  9%|▊         | 31839/371472 [2:32:12<27:54:12,  3.38it/s]
  9%|▊         | 31840/371472 [2:32:13<29:07:27,  3.24it/s]
                                                           
{'loss': 6.8524, 'learning_rate': 9.233015147923894e-07, 'epoch': 1.37}

  9%|▊         | 31840/371472 [2:32:13<29:07:27,  3.24it/s]
  9%|▊         | 31841/371472 [2:32:13<28:44:49,  3.28it/s]
  9%|▊         | 31842/371472 [2:32:13<27:38:04,  3.41it/s]
  9%|▊         | 31843/371472 [2:32:14<27:50:41,  3.39it/s]
  9%|▊         | 31844/371472 [2:32:14<29:04:48,  3.24it/s]
  9%|▊         | 31845/371472 [2:32:14<28:39:18,  3.29it/s]
  9%|▊         | 31846/371472 [2:32:14<27:08:56,  3.47it/s]
  9%|▊         | 31847/371472 [2:32:15<26:47:00,  3.52it/s]
  9%|▊         | 31848/371472 [2:32:15<26:26:26,  3.57it/s]
  9%|▊         | 31849/371472 [2:32:15<27:27:17,  3.44it/s]
  9%|▊         | 31850/371472 [2:32:16<28:03:47,  3.36it/s]
  9%|▊         | 31851/371472 [2:32:16<27:49:35,  3.39it/s]
  9%|▊         | 31852/371472 [2:32:16<27:41:10,  3.41it/s]
  9%|▊         | 31853/371472 [2:32:17<27:50:12,  3.39it/s]
  9%|▊         | 31854/371472 [2:32:17<26:50:51,  3.51it/s]
  9%|▊         | 31855/371472 [2:32:17<25:59:04,  3.63it/s]
  9%|▊         | 31856/371472 [2:32:17<26:43:41,  3.53it/s]
  9%|▊         | 31857/371472 [2:32:18<26:32:42,  3.55it/s]
  9%|▊         | 31858/371472 [2:32:18<26:59:47,  3.49it/s]
  9%|▊         | 31859/371472 [2:32:18<26:44:38,  3.53it/s]
  9%|▊         | 31860/371472 [2:32:18<25:58:37,  3.63it/s]
                                                           
{'loss': 6.9558, 'learning_rate': 9.232530328169104e-07, 'epoch': 1.37}

  9%|▊         | 31860/371472 [2:32:18<25:58:37,  3.63it/s]
  9%|▊         | 31861/371472 [2:32:19<26:37:55,  3.54it/s]
  9%|▊         | 31862/371472 [2:32:19<25:41:39,  3.67it/s]
  9%|▊         | 31863/371472 [2:32:19<26:24:05,  3.57it/s]
  9%|▊         | 31864/371472 [2:32:20<27:10:04,  3.47it/s]
  9%|▊         | 31865/371472 [2:32:20<26:54:05,  3.51it/s]
  9%|▊         | 31866/371472 [2:32:20<26:12:12,  3.60it/s]
  9%|▊         | 31867/371472 [2:32:20<27:17:00,  3.46it/s]
  9%|▊         | 31868/371472 [2:32:21<27:31:33,  3.43it/s]
  9%|▊         | 31869/371472 [2:32:21<27:58:40,  3.37it/s]
  9%|▊         | 31870/371472 [2:32:21<27:40:59,  3.41it/s]
  9%|▊         | 31871/371472 [2:32:22<26:49:48,  3.52it/s]
  9%|▊         | 31872/371472 [2:32:22<28:46:06,  3.28it/s]
  9%|▊         | 31873/371472 [2:32:22<28:17:46,  3.33it/s]
  9%|▊         | 31874/371472 [2:32:23<27:40:09,  3.41it/s]
  9%|▊         | 31875/371472 [2:32:23<26:26:41,  3.57it/s]
  9%|▊         | 31876/371472 [2:32:23<26:08:39,  3.61it/s]
  9%|▊         | 31877/371472 [2:32:23<25:26:06,  3.71it/s]
  9%|▊         | 31878/371472 [2:32:24<25:43:10,  3.67it/s]
  9%|▊         | 31879/371472 [2:32:24<25:59:22,  3.63it/s]
  9%|▊         | 31880/371472 [2:32:24<26:45:06,  3.53it/s]
                                                           
{'loss': 6.7935, 'learning_rate': 9.232045508414316e-07, 'epoch': 1.37}

  9%|▊         | 31880/371472 [2:32:24<26:45:06,  3.53it/s]
  9%|▊         | 31881/371472 [2:32:24<25:57:55,  3.63it/s]
  9%|▊         | 31882/371472 [2:32:25<25:21:22,  3.72it/s]
  9%|▊         | 31883/371472 [2:32:25<26:54:11,  3.51it/s]
  9%|▊         | 31884/371472 [2:32:25<26:03:04,  3.62it/s]
  9%|▊         | 31885/371472 [2:32:25<25:35:10,  3.69it/s]
  9%|▊         | 31886/371472 [2:32:26<25:09:27,  3.75it/s]
  9%|▊         | 31887/371472 [2:32:26<25:03:22,  3.76it/s]
  9%|▊         | 31888/371472 [2:32:26<25:40:25,  3.67it/s]
  9%|▊         | 31889/371472 [2:32:27<27:28:04,  3.43it/s]
  9%|▊         | 31890/371472 [2:32:27<27:02:47,  3.49it/s]
  9%|▊         | 31891/371472 [2:32:27<26:29:42,  3.56it/s]
  9%|▊         | 31892/371472 [2:32:27<26:57:25,  3.50it/s]
  9%|▊         | 31893/371472 [2:32:28<26:44:37,  3.53it/s]
  9%|▊         | 31894/371472 [2:32:28<25:44:41,  3.66it/s]
  9%|▊         | 31895/371472 [2:32:28<26:03:48,  3.62it/s]
  9%|▊         | 31896/371472 [2:32:29<25:37:46,  3.68it/s]
  9%|▊         | 31897/371472 [2:32:29<25:18:22,  3.73it/s]
  9%|▊         | 31898/371472 [2:32:29<26:05:51,  3.61it/s]
  9%|▊         | 31899/371472 [2:32:29<25:47:48,  3.66it/s]
  9%|▊         | 31900/371472 [2:32:30<27:11:08,  3.47it/s]
                                                           
{'loss': 6.6628, 'learning_rate': 9.231560688659527e-07, 'epoch': 1.37}

  9%|▊         | 31900/371472 [2:32:30<27:11:08,  3.47it/s]
  9%|▊         | 31901/371472 [2:32:30<26:45:22,  3.53it/s]
  9%|▊         | 31902/371472 [2:32:30<26:06:31,  3.61it/s]
  9%|▊         | 31903/371472 [2:32:31<26:54:58,  3.50it/s]
  9%|▊         | 31904/371472 [2:32:31<26:40:53,  3.54it/s]
  9%|▊         | 31905/371472 [2:32:31<26:07:18,  3.61it/s]
  9%|▊         | 31906/371472 [2:32:31<25:10:18,  3.75it/s]
  9%|▊         | 31907/371472 [2:32:32<25:08:09,  3.75it/s]
  9%|▊         | 31908/371472 [2:32:32<26:03:14,  3.62it/s]
  9%|▊         | 31909/371472 [2:32:32<27:22:58,  3.44it/s]
  9%|▊         | 31910/371472 [2:32:33<28:43:03,  3.28it/s]
  9%|▊         | 31911/371472 [2:32:33<28:27:18,  3.31it/s]
  9%|▊         | 31912/371472 [2:32:33<28:56:35,  3.26it/s]
  9%|▊         | 31913/371472 [2:32:33<27:44:40,  3.40it/s]
  9%|▊         | 31914/371472 [2:32:34<26:43:20,  3.53it/s]
  9%|▊         | 31915/371472 [2:32:34<25:50:11,  3.65it/s]
  9%|▊         | 31916/371472 [2:32:34<26:37:24,  3.54it/s]
  9%|▊         | 31917/371472 [2:32:34<25:15:18,  3.73it/s]
  9%|▊         | 31918/371472 [2:32:35<24:43:18,  3.82it/s]
  9%|▊         | 31919/371472 [2:32:35<25:05:24,  3.76it/s]
  9%|▊         | 31920/371472 [2:32:35<25:07:55,  3.75it/s]
                                                           
{'loss': 6.8103, 'learning_rate': 9.231075868904739e-07, 'epoch': 1.37}

  9%|▊         | 31920/371472 [2:32:35<25:07:55,  3.75it/s]
  9%|▊         | 31921/371472 [2:32:36<25:14:04,  3.74it/s]
  9%|▊         | 31922/371472 [2:32:36<25:46:21,  3.66it/s]
  9%|▊         | 31923/371472 [2:32:36<24:54:40,  3.79it/s]
  9%|▊         | 31924/371472 [2:32:36<24:36:50,  3.83it/s]
  9%|▊         | 31925/371472 [2:32:37<24:47:20,  3.80it/s]
  9%|▊         | 31926/371472 [2:32:37<25:01:19,  3.77it/s]
  9%|▊         | 31927/371472 [2:32:37<25:58:59,  3.63it/s]
  9%|▊         | 31928/371472 [2:32:37<27:11:08,  3.47it/s]
  9%|▊         | 31929/371472 [2:32:38<25:45:52,  3.66it/s]
  9%|▊         | 31930/371472 [2:32:38<25:05:40,  3.76it/s]
  9%|▊         | 31931/371472 [2:32:38<24:36:04,  3.83it/s]
  9%|▊         | 31932/371472 [2:32:39<26:23:02,  3.57it/s]
  9%|▊         | 31933/371472 [2:32:39<25:45:10,  3.66it/s]
  9%|▊         | 31934/371472 [2:32:39<25:55:38,  3.64it/s]
  9%|▊         | 31935/371472 [2:32:39<25:42:36,  3.67it/s]
  9%|▊         | 31936/371472 [2:32:40<25:06:34,  3.76it/s]
  9%|▊         | 31937/371472 [2:32:40<26:16:26,  3.59it/s]
  9%|▊         | 31938/371472 [2:32:40<26:05:17,  3.62it/s]
  9%|▊         | 31939/371472 [2:32:40<26:45:17,  3.53it/s]
  9%|▊         | 31940/371472 [2:32:41<26:30:25,  3.56it/s]
                                                           
{'loss': 6.5024, 'learning_rate': 9.230591049149949e-07, 'epoch': 1.38}

  9%|▊         | 31940/371472 [2:32:41<26:30:25,  3.56it/s]
  9%|▊         | 31941/371472 [2:32:41<25:24:49,  3.71it/s]
  9%|▊         | 31942/371472 [2:32:41<25:23:25,  3.71it/s]
  9%|▊         | 31943/371472 [2:32:42<25:42:24,  3.67it/s]
  9%|▊         | 31944/371472 [2:32:42<25:45:18,  3.66it/s]
  9%|▊         | 31945/371472 [2:32:42<25:33:27,  3.69it/s]
  9%|▊         | 31946/371472 [2:32:42<25:50:17,  3.65it/s]
  9%|▊         | 31947/371472 [2:32:43<25:30:51,  3.70it/s]
  9%|▊         | 31948/371472 [2:32:43<25:27:50,  3.70it/s]
  9%|▊         | 31949/371472 [2:32:43<27:13:28,  3.46it/s]
  9%|▊         | 31950/371472 [2:32:43<26:51:51,  3.51it/s]
  9%|▊         | 31951/371472 [2:32:44<27:34:52,  3.42it/s]
  9%|▊         | 31952/371472 [2:32:44<27:13:07,  3.46it/s]
  9%|▊         | 31953/371472 [2:32:44<26:56:31,  3.50it/s]
  9%|▊         | 31954/371472 [2:32:45<25:49:56,  3.65it/s]
  9%|▊         | 31955/371472 [2:32:45<25:34:49,  3.69it/s]
  9%|▊         | 31956/371472 [2:32:45<26:24:24,  3.57it/s]
  9%|▊         | 31957/371472 [2:32:45<26:07:36,  3.61it/s]
  9%|▊         | 31958/371472 [2:32:46<26:09:57,  3.60it/s]
  9%|▊         | 31959/371472 [2:32:46<26:07:21,  3.61it/s]
  9%|▊         | 31960/371472 [2:32:46<27:20:01,  3.45it/s]
                                                           
{'loss': 6.9965, 'learning_rate': 9.230106229395159e-07, 'epoch': 1.38}

  9%|▊         | 31960/371472 [2:32:46<27:20:01,  3.45it/s]
  9%|▊         | 31961/371472 [2:32:47<27:02:36,  3.49it/s]
  9%|▊         | 31962/371472 [2:32:47<26:38:37,  3.54it/s]
  9%|▊         | 31963/371472 [2:32:47<26:07:59,  3.61it/s]
  9%|▊         | 31964/371472 [2:32:47<26:20:03,  3.58it/s]
  9%|▊         | 31965/371472 [2:32:48<26:43:56,  3.53it/s]
  9%|▊         | 31966/371472 [2:32:48<26:06:23,  3.61it/s]
  9%|▊         | 31967/371472 [2:32:48<27:36:15,  3.42it/s]
  9%|▊         | 31968/371472 [2:32:49<26:38:38,  3.54it/s]
  9%|▊         | 31969/371472 [2:32:49<27:52:18,  3.38it/s]
  9%|▊         | 31970/371472 [2:32:49<27:20:17,  3.45it/s]
  9%|▊         | 31971/371472 [2:32:50<29:09:44,  3.23it/s]
  9%|▊         | 31972/371472 [2:32:50<27:58:49,  3.37it/s]
  9%|▊         | 31973/371472 [2:32:50<27:43:40,  3.40it/s]
  9%|▊         | 31974/371472 [2:32:50<26:58:23,  3.50it/s]
  9%|▊         | 31975/371472 [2:32:51<26:35:58,  3.55it/s]
  9%|▊         | 31976/371472 [2:32:51<26:17:15,  3.59it/s]
  9%|▊         | 31977/371472 [2:32:51<27:54:22,  3.38it/s]
  9%|▊         | 31978/371472 [2:32:51<27:16:16,  3.46it/s]
  9%|▊         | 31979/371472 [2:32:52<27:05:43,  3.48it/s]
  9%|▊         | 31980/371472 [2:32:52<26:48:55,  3.52it/s]
                                                           
{'loss': 6.8808, 'learning_rate': 9.229621409640371e-07, 'epoch': 1.38}

  9%|▊         | 31980/371472 [2:32:52<26:48:55,  3.52it/s]
  9%|▊         | 31981/371472 [2:32:52<27:22:44,  3.44it/s]
  9%|▊         | 31982/371472 [2:32:53<26:50:36,  3.51it/s]
  9%|▊         | 31983/371472 [2:32:53<29:06:15,  3.24it/s]
  9%|▊         | 31984/371472 [2:32:53<27:59:05,  3.37it/s]
  9%|▊         | 31985/371472 [2:32:54<27:51:41,  3.38it/s]
  9%|▊         | 31986/371472 [2:32:54<27:41:56,  3.40it/s]
  9%|▊         | 31987/371472 [2:32:54<28:08:08,  3.35it/s]
  9%|▊         | 31988/371472 [2:32:54<26:52:57,  3.51it/s]
  9%|▊         | 31989/371472 [2:32:55<26:21:38,  3.58it/s]
  9%|▊         | 31990/371472 [2:32:55<25:51:34,  3.65it/s]
  9%|▊         | 31991/371472 [2:32:55<24:56:59,  3.78it/s]
  9%|▊         | 31992/371472 [2:32:55<25:25:51,  3.71it/s]
  9%|▊         | 31993/371472 [2:32:56<25:55:01,  3.64it/s]
  9%|▊         | 31994/371472 [2:32:56<26:57:22,  3.50it/s]
  9%|▊         | 31995/371472 [2:32:56<27:31:59,  3.42it/s]
  9%|▊         | 31996/371472 [2:32:57<26:54:29,  3.50it/s]
  9%|▊         | 31997/371472 [2:32:57<26:48:27,  3.52it/s]
  9%|▊         | 31998/371472 [2:32:57<28:35:38,  3.30it/s]
  9%|▊         | 31999/371472 [2:32:58<27:56:06,  3.38it/s]
  9%|▊         | 32000/371472 [2:32:58<27:44:30,  3.40it/s]
                                                           
{'loss': 6.7527, 'learning_rate': 9.229136589885583e-07, 'epoch': 1.38}

  9%|▊         | 32000/371472 [2:32:58<27:44:30,  3.40it/s]
  9%|▊         | 32001/371472 [2:32:58<26:55:52,  3.50it/s]
  9%|▊         | 32002/371472 [2:32:58<26:56:33,  3.50it/s]
  9%|▊         | 32003/371472 [2:32:59<26:34:13,  3.55it/s]
  9%|▊         | 32004/371472 [2:32:59<25:23:32,  3.71it/s]
  9%|▊         | 32005/371472 [2:32:59<26:18:40,  3.58it/s]
  9%|▊         | 32006/371472 [2:32:59<25:50:36,  3.65it/s]
  9%|▊         | 32007/371472 [2:33:00<25:08:01,  3.75it/s]
  9%|▊         | 32008/371472 [2:33:00<25:37:24,  3.68it/s]
  9%|▊         | 32009/371472 [2:33:00<25:58:47,  3.63it/s]
  9%|▊         | 32010/371472 [2:33:01<25:38:14,  3.68it/s]
  9%|▊         | 32011/371472 [2:33:01<25:51:21,  3.65it/s]
  9%|▊         | 32012/371472 [2:33:01<28:45:33,  3.28it/s]
  9%|▊         | 32013/371472 [2:33:01<27:00:56,  3.49it/s]
  9%|▊         | 32014/371472 [2:33:02<27:41:57,  3.40it/s]
  9%|▊         | 32015/371472 [2:33:02<29:17:22,  3.22it/s]
  9%|▊         | 32016/371472 [2:33:02<28:29:18,  3.31it/s]
  9%|▊         | 32017/371472 [2:33:03<27:44:08,  3.40it/s]
  9%|▊         | 32018/371472 [2:33:03<26:32:39,  3.55it/s]
  9%|▊         | 32019/371472 [2:33:03<27:58:07,  3.37it/s]
  9%|▊         | 32020/371472 [2:33:04<28:36:26,  3.30it/s]
                                                           
{'loss': 6.7427, 'learning_rate': 9.228651770130793e-07, 'epoch': 1.38}

  9%|▊         | 32020/371472 [2:33:04<28:36:26,  3.30it/s]
  9%|▊         | 32021/371472 [2:33:04<28:40:48,  3.29it/s]
  9%|▊         | 32022/371472 [2:33:04<27:57:44,  3.37it/s]
  9%|▊         | 32023/371472 [2:33:04<28:45:43,  3.28it/s]
  9%|▊         | 32024/371472 [2:33:05<28:16:05,  3.34it/s]
  9%|▊         | 32025/371472 [2:33:05<27:00:21,  3.49it/s]
  9%|▊         | 32026/371472 [2:33:05<27:09:19,  3.47it/s]
  9%|▊         | 32027/371472 [2:33:06<26:39:25,  3.54it/s]
  9%|▊         | 32028/371472 [2:33:06<26:19:12,  3.58it/s]
  9%|▊         | 32029/371472 [2:33:06<26:52:04,  3.51it/s]
  9%|▊         | 32030/371472 [2:33:06<26:33:22,  3.55it/s]
  9%|▊         | 32031/371472 [2:33:07<28:09:02,  3.35it/s]
  9%|▊         | 32032/371472 [2:33:07<27:57:00,  3.37it/s]
  9%|▊         | 32033/371472 [2:33:07<27:45:19,  3.40it/s]
  9%|▊         | 32034/371472 [2:33:08<27:08:57,  3.47it/s]
  9%|▊         | 32035/371472 [2:33:08<27:40:49,  3.41it/s]
  9%|▊         | 32036/371472 [2:33:08<28:12:02,  3.34it/s]
  9%|▊         | 32037/371472 [2:33:09<27:29:17,  3.43it/s]
  9%|▊         | 32038/371472 [2:33:09<28:43:00,  3.28it/s]
  9%|▊         | 32039/371472 [2:33:09<30:27:40,  3.10it/s]
  9%|▊         | 32040/371472 [2:33:09<29:03:47,  3.24it/s]
                                                           
{'loss': 6.4327, 'learning_rate': 9.228166950376004e-07, 'epoch': 1.38}

  9%|▊         | 32040/371472 [2:33:09<29:03:47,  3.24it/s]
  9%|▊         | 32041/371472 [2:33:10<28:51:29,  3.27it/s]
  9%|▊         | 32042/371472 [2:33:10<28:26:41,  3.31it/s]
  9%|▊         | 32043/371472 [2:33:10<28:30:06,  3.31it/s]
  9%|▊         | 32044/371472 [2:33:11<30:01:19,  3.14it/s]
  9%|▊         | 32045/371472 [2:33:11<29:07:53,  3.24it/s]
  9%|▊         | 32046/371472 [2:33:11<27:32:02,  3.42it/s]
  9%|▊         | 32047/371472 [2:33:12<26:15:49,  3.59it/s]
  9%|▊         | 32048/371472 [2:33:12<25:31:49,  3.69it/s]
  9%|▊         | 32049/371472 [2:33:12<26:07:56,  3.61it/s]
  9%|▊         | 32050/371472 [2:33:12<29:17:17,  3.22it/s]
  9%|▊         | 32051/371472 [2:33:13<27:58:51,  3.37it/s]
  9%|▊         | 32052/371472 [2:33:13<28:53:23,  3.26it/s]
  9%|▊         | 32053/371472 [2:33:13<29:13:42,  3.23it/s]
  9%|▊         | 32054/371472 [2:33:14<28:27:32,  3.31it/s]
  9%|▊         | 32055/371472 [2:33:14<27:28:27,  3.43it/s]
  9%|▊         | 32056/371472 [2:33:14<28:27:08,  3.31it/s]
  9%|▊         | 32057/371472 [2:33:15<27:27:23,  3.43it/s]
  9%|▊         | 32058/371472 [2:33:15<27:04:06,  3.48it/s]
  9%|▊         | 32059/371472 [2:33:15<26:48:22,  3.52it/s]
  9%|▊         | 32060/371472 [2:33:15<26:07:51,  3.61it/s]
                                                           
{'loss': 6.7198, 'learning_rate': 9.227682130621216e-07, 'epoch': 1.38}

  9%|▊         | 32060/371472 [2:33:15<26:07:51,  3.61it/s]
  9%|▊         | 32061/371472 [2:33:16<26:32:47,  3.55it/s]
  9%|▊         | 32062/371472 [2:33:16<25:47:00,  3.66it/s]
  9%|▊         | 32063/371472 [2:33:16<24:49:22,  3.80it/s]
  9%|▊         | 32064/371472 [2:33:16<24:46:57,  3.80it/s]
  9%|▊         | 32065/371472 [2:33:17<26:50:34,  3.51it/s]
  9%|▊         | 32066/371472 [2:33:17<27:24:41,  3.44it/s]
  9%|▊         | 32067/371472 [2:33:17<26:30:06,  3.56it/s]
  9%|▊         | 32068/371472 [2:33:18<26:13:53,  3.59it/s]
  9%|▊         | 32069/371472 [2:33:18<27:43:22,  3.40it/s]
  9%|▊         | 32070/371472 [2:33:18<26:56:34,  3.50it/s]
  9%|▊         | 32071/371472 [2:33:18<26:22:41,  3.57it/s]
  9%|▊         | 32072/371472 [2:33:19<25:24:50,  3.71it/s]
  9%|▊         | 32073/371472 [2:33:19<25:04:15,  3.76it/s]
  9%|▊         | 32074/371472 [2:33:19<24:51:47,  3.79it/s]
  9%|▊         | 32075/371472 [2:33:19<26:13:57,  3.59it/s]
  9%|▊         | 32076/371472 [2:33:20<25:56:58,  3.63it/s]
  9%|▊         | 32077/371472 [2:33:20<26:08:16,  3.61it/s]
  9%|▊         | 32078/371472 [2:33:20<25:55:35,  3.64it/s]
  9%|▊         | 32079/371472 [2:33:21<26:09:03,  3.61it/s]
  9%|▊         | 32080/371472 [2:33:21<27:18:49,  3.45it/s]
                                                           
{'loss': 6.6045, 'learning_rate': 9.227197310866425e-07, 'epoch': 1.38}

  9%|▊         | 32080/371472 [2:33:21<27:18:49,  3.45it/s]
  9%|▊         | 32081/371472 [2:33:21<27:02:47,  3.49it/s]
  9%|▊         | 32082/371472 [2:33:21<26:43:46,  3.53it/s]
  9%|▊         | 32083/371472 [2:33:22<26:27:33,  3.56it/s]
  9%|▊         | 32084/371472 [2:33:22<28:13:49,  3.34it/s]
  9%|▊         | 32085/371472 [2:33:22<27:26:21,  3.44it/s]
  9%|▊         | 32086/371472 [2:33:23<29:20:53,  3.21it/s]
  9%|▊         | 32087/371472 [2:33:23<29:27:52,  3.20it/s]
  9%|▊         | 32088/371472 [2:33:23<28:13:51,  3.34it/s]
  9%|▊         | 32089/371472 [2:33:24<30:25:06,  3.10it/s]
  9%|▊         | 32090/371472 [2:33:24<30:18:51,  3.11it/s]
  9%|▊         | 32091/371472 [2:33:24<28:42:39,  3.28it/s]
  9%|▊         | 32092/371472 [2:33:25<27:46:59,  3.39it/s]
  9%|▊         | 32093/371472 [2:33:25<26:46:52,  3.52it/s]
  9%|▊         | 32094/371472 [2:33:25<26:28:25,  3.56it/s]
  9%|▊         | 32095/371472 [2:33:25<26:23:51,  3.57it/s]
  9%|▊         | 32096/371472 [2:33:26<25:45:10,  3.66it/s]
  9%|▊         | 32097/371472 [2:33:26<25:39:45,  3.67it/s]
  9%|▊         | 32098/371472 [2:33:26<26:47:14,  3.52it/s]
  9%|▊         | 32099/371472 [2:33:26<27:08:51,  3.47it/s]
  9%|▊         | 32100/371472 [2:33:27<27:42:39,  3.40it/s]
                                                           
{'loss': 6.5851, 'learning_rate': 9.226712491111637e-07, 'epoch': 1.38}

  9%|▊         | 32100/371472 [2:33:27<27:42:39,  3.40it/s]
  9%|▊         | 32101/371472 [2:33:27<27:08:17,  3.47it/s]
  9%|▊         | 32102/371472 [2:33:27<27:33:25,  3.42it/s]
  9%|▊         | 32103/371472 [2:33:28<28:24:55,  3.32it/s]
  9%|▊         | 32104/371472 [2:33:28<27:30:25,  3.43it/s]
  9%|▊         | 32105/371472 [2:33:28<27:01:02,  3.49it/s]
  9%|▊         | 32106/371472 [2:33:29<27:39:57,  3.41it/s]
  9%|▊         | 32107/371472 [2:33:29<27:12:32,  3.46it/s]
  9%|▊         | 32108/371472 [2:33:29<28:04:19,  3.36it/s]
  9%|▊         | 32109/371472 [2:33:29<27:54:22,  3.38it/s]
  9%|▊         | 32110/371472 [2:33:30<28:57:10,  3.26it/s]
  9%|▊         | 32111/371472 [2:33:30<27:59:19,  3.37it/s]
  9%|▊         | 32112/371472 [2:33:30<28:44:46,  3.28it/s]
  9%|▊         | 32113/371472 [2:33:31<26:46:27,  3.52it/s]
  9%|▊         | 32114/371472 [2:33:31<25:23:41,  3.71it/s]
  9%|▊         | 32115/371472 [2:33:31<24:55:50,  3.78it/s]
  9%|▊         | 32116/371472 [2:33:31<25:55:52,  3.64it/s]
  9%|▊         | 32117/371472 [2:33:32<26:31:22,  3.55it/s]
  9%|▊         | 32118/371472 [2:33:32<26:08:00,  3.61it/s]
  9%|▊         | 32119/371472 [2:33:32<25:42:26,  3.67it/s]
  9%|▊         | 32120/371472 [2:33:32<25:34:42,  3.69it/s]
                                                           
{'loss': 6.809, 'learning_rate': 9.226227671356848e-07, 'epoch': 1.38}

  9%|▊         | 32120/371472 [2:33:32<25:34:42,  3.69it/s]
  9%|▊         | 32121/371472 [2:33:33<24:52:26,  3.79it/s]
  9%|▊         | 32122/371472 [2:33:33<29:08:09,  3.24it/s]
  9%|▊         | 32123/371472 [2:33:33<28:41:19,  3.29it/s]
  9%|▊         | 32124/371472 [2:33:34<27:30:02,  3.43it/s]
  9%|▊         | 32125/371472 [2:33:34<26:45:14,  3.52it/s]
  9%|▊         | 32126/371472 [2:33:34<27:23:04,  3.44it/s]
  9%|▊         | 32127/371472 [2:33:35<27:34:04,  3.42it/s]
  9%|▊         | 32128/371472 [2:33:35<29:38:28,  3.18it/s]
  9%|▊         | 32129/371472 [2:33:35<28:58:29,  3.25it/s]
  9%|▊         | 32130/371472 [2:33:35<28:11:40,  3.34it/s]
  9%|▊         | 32131/371472 [2:33:36<27:25:08,  3.44it/s]
  9%|▊         | 32132/371472 [2:33:36<26:15:46,  3.59it/s]
  9%|▊         | 32133/371472 [2:33:36<29:16:32,  3.22it/s]
  9%|▊         | 32134/371472 [2:33:37<28:36:17,  3.30it/s]
  9%|▊         | 32135/371472 [2:33:37<28:49:41,  3.27it/s]
  9%|▊         | 32136/371472 [2:33:37<29:15:14,  3.22it/s]
  9%|▊         | 32137/371472 [2:33:38<29:04:05,  3.24it/s]
  9%|▊         | 32138/371472 [2:33:38<28:13:55,  3.34it/s]
  9%|▊         | 32139/371472 [2:33:38<27:53:04,  3.38it/s]
  9%|▊         | 32140/371472 [2:33:38<28:24:55,  3.32it/s]
                                                           
{'loss': 6.5905, 'learning_rate': 9.22574285160206e-07, 'epoch': 1.38}

  9%|▊         | 32140/371472 [2:33:38<28:24:55,  3.32it/s]
  9%|▊         | 32141/371472 [2:33:39<27:05:51,  3.48it/s]
  9%|▊         | 32142/371472 [2:33:39<26:18:18,  3.58it/s]
  9%|▊         | 32143/371472 [2:33:39<26:24:42,  3.57it/s]
  9%|▊         | 32144/371472 [2:33:40<26:20:50,  3.58it/s]
  9%|▊         | 32145/371472 [2:33:40<26:19:00,  3.58it/s]
  9%|▊         | 32146/371472 [2:33:40<25:41:41,  3.67it/s]
  9%|▊         | 32147/371472 [2:33:40<26:16:13,  3.59it/s]
  9%|▊         | 32148/371472 [2:33:41<26:20:51,  3.58it/s]
  9%|▊         | 32149/371472 [2:33:41<27:06:52,  3.48it/s]
  9%|▊         | 32150/371472 [2:33:41<26:16:20,  3.59it/s]
  9%|▊         | 32151/371472 [2:33:42<26:25:43,  3.57it/s]
  9%|▊         | 32152/371472 [2:33:42<25:47:05,  3.66it/s]
  9%|▊         | 32153/371472 [2:33:42<25:35:27,  3.68it/s]
  9%|▊         | 32154/371472 [2:33:42<27:09:33,  3.47it/s]
  9%|▊         | 32155/371472 [2:33:43<26:59:05,  3.49it/s]
  9%|▊         | 32156/371472 [2:33:43<26:55:36,  3.50it/s]
  9%|▊         | 32157/371472 [2:33:43<27:29:41,  3.43it/s]
  9%|▊         | 32158/371472 [2:33:44<26:57:23,  3.50it/s]
  9%|▊         | 32159/371472 [2:33:44<26:23:46,  3.57it/s]
  9%|▊         | 32160/371472 [2:33:44<25:27:42,  3.70it/s]
                                                           
{'loss': 6.8906, 'learning_rate': 9.22525803184727e-07, 'epoch': 1.39}

  9%|▊         | 32160/371472 [2:33:44<25:27:42,  3.70it/s]
  9%|▊         | 32161/371472 [2:33:44<26:37:18,  3.54it/s]
  9%|▊         | 32162/371472 [2:33:45<26:08:50,  3.60it/s]
  9%|▊         | 32163/371472 [2:33:45<26:34:40,  3.55it/s]
  9%|▊         | 32164/371472 [2:33:45<27:25:16,  3.44it/s]
  9%|▊         | 32165/371472 [2:33:45<26:12:48,  3.60it/s]
  9%|▊         | 32166/371472 [2:33:46<26:55:47,  3.50it/s]
  9%|▊         | 32167/371472 [2:33:46<26:39:29,  3.54it/s]
  9%|▊         | 32168/371472 [2:33:46<28:00:16,  3.37it/s]
  9%|▊         | 32169/371472 [2:33:47<27:40:34,  3.41it/s]
  9%|▊         | 32170/371472 [2:33:47<27:01:37,  3.49it/s]
  9%|▊         | 32171/371472 [2:33:47<26:40:36,  3.53it/s]
  9%|▊         | 32172/371472 [2:33:47<26:20:55,  3.58it/s]
  9%|▊         | 32173/371472 [2:33:48<25:55:15,  3.64it/s]
  9%|▊         | 32174/371472 [2:33:48<26:40:11,  3.53it/s]
  9%|▊         | 32175/371472 [2:33:48<30:38:20,  3.08it/s]
  9%|▊         | 32176/371472 [2:33:49<30:05:54,  3.13it/s]
  9%|▊         | 32177/371472 [2:33:49<32:23:08,  2.91it/s]
  9%|▊         | 32178/371472 [2:33:49<30:25:25,  3.10it/s]
  9%|▊         | 32179/371472 [2:33:50<28:48:56,  3.27it/s]
  9%|▊         | 32180/371472 [2:33:50<28:06:53,  3.35it/s]
                                                           
{'loss': 6.6777, 'learning_rate': 9.224773212092482e-07, 'epoch': 1.39}

  9%|▊         | 32180/371472 [2:33:50<28:06:53,  3.35it/s]
  9%|▊         | 32181/371472 [2:33:50<27:04:46,  3.48it/s]
  9%|▊         | 32182/371472 [2:33:51<29:27:52,  3.20it/s]
  9%|▊         | 32183/371472 [2:33:51<29:28:01,  3.20it/s]
  9%|▊         | 32184/371472 [2:33:51<28:31:06,  3.30it/s]
  9%|▊         | 32185/371472 [2:33:51<27:46:23,  3.39it/s]
  9%|▊         | 32186/371472 [2:33:52<27:51:30,  3.38it/s]
  9%|▊         | 32187/371472 [2:33:52<26:39:35,  3.54it/s]
  9%|▊         | 32188/371472 [2:33:52<26:29:01,  3.56it/s]
  9%|▊         | 32189/371472 [2:33:53<25:26:28,  3.70it/s]
  9%|▊         | 32190/371472 [2:33:53<25:53:33,  3.64it/s]
  9%|▊         | 32191/371472 [2:33:53<26:19:07,  3.58it/s]
  9%|▊         | 32192/371472 [2:33:53<26:26:18,  3.56it/s]
  9%|▊         | 32193/371472 [2:33:54<26:47:15,  3.52it/s]
  9%|▊         | 32194/371472 [2:33:54<26:07:21,  3.61it/s]
  9%|▊         | 32195/371472 [2:33:54<26:35:51,  3.54it/s]
  9%|▊         | 32196/371472 [2:33:55<26:24:30,  3.57it/s]
  9%|▊         | 32197/371472 [2:33:55<26:01:41,  3.62it/s]
  9%|▊         | 32198/371472 [2:33:55<26:19:46,  3.58it/s]
  9%|▊         | 32199/371472 [2:33:55<26:20:29,  3.58it/s]
  9%|▊         | 32200/371472 [2:33:56<25:38:05,  3.68it/s]
                                                           
{'loss': 6.707, 'learning_rate': 9.224288392337692e-07, 'epoch': 1.39}

  9%|▊         | 32200/371472 [2:33:56<25:38:05,  3.68it/s]
  9%|▊         | 32201/371472 [2:33:56<26:13:39,  3.59it/s]
  9%|▊         | 32202/371472 [2:33:56<26:55:39,  3.50it/s]
  9%|▊         | 32203/371472 [2:33:57<27:08:34,  3.47it/s]
  9%|▊         | 32204/371472 [2:33:57<27:11:19,  3.47it/s]
  9%|▊         | 32205/371472 [2:33:57<26:38:08,  3.54it/s]
  9%|▊         | 32206/371472 [2:33:57<26:36:46,  3.54it/s]
  9%|▊         | 32207/371472 [2:33:58<25:36:38,  3.68it/s]
  9%|▊         | 32208/371472 [2:33:58<25:25:06,  3.71it/s]
  9%|▊         | 32209/371472 [2:33:58<28:19:46,  3.33it/s]
  9%|▊         | 32210/371472 [2:33:59<27:50:23,  3.39it/s]
  9%|▊         | 32211/371472 [2:33:59<28:03:04,  3.36it/s]
  9%|▊         | 32212/371472 [2:33:59<27:21:21,  3.44it/s]
  9%|▊         | 32213/371472 [2:33:59<26:17:27,  3.58it/s]
  9%|▊         | 32214/371472 [2:34:00<25:51:25,  3.64it/s]
  9%|▊         | 32215/371472 [2:34:00<25:30:47,  3.69it/s]
  9%|▊         | 32216/371472 [2:34:00<26:57:33,  3.50it/s]
  9%|▊         | 32217/371472 [2:34:01<27:07:41,  3.47it/s]
  9%|▊         | 32218/371472 [2:34:01<27:13:04,  3.46it/s]
  9%|▊         | 32219/371472 [2:34:01<26:50:28,  3.51it/s]
  9%|▊         | 32220/371472 [2:34:01<26:26:18,  3.56it/s]
                                                           
{'loss': 6.6338, 'learning_rate': 9.223803572582904e-07, 'epoch': 1.39}

  9%|▊         | 32220/371472 [2:34:01<26:26:18,  3.56it/s]
  9%|▊         | 32221/371472 [2:34:02<26:08:43,  3.60it/s]
  9%|▊         | 32222/371472 [2:34:02<25:20:56,  3.72it/s]
  9%|▊         | 32223/371472 [2:34:02<25:27:34,  3.70it/s]
  9%|▊         | 32224/371472 [2:34:02<25:12:03,  3.74it/s]
  9%|▊         | 32225/371472 [2:34:03<25:49:18,  3.65it/s]
  9%|▊         | 32226/371472 [2:34:03<27:39:08,  3.41it/s]
  9%|▊         | 32227/371472 [2:34:03<27:25:25,  3.44it/s]
  9%|▊         | 32228/371472 [2:34:04<26:27:04,  3.56it/s]
  9%|▊         | 32229/371472 [2:34:04<26:52:15,  3.51it/s]
  9%|▊         | 32230/371472 [2:34:04<25:53:47,  3.64it/s]
  9%|▊         | 32231/371472 [2:34:04<26:51:04,  3.51it/s]
  9%|▊         | 32232/371472 [2:34:05<25:39:52,  3.67it/s]
  9%|▊         | 32233/371472 [2:34:05<25:30:18,  3.69it/s]
  9%|▊         | 32234/371472 [2:34:05<26:13:42,  3.59it/s]
  9%|▊         | 32235/371472 [2:34:06<26:20:24,  3.58it/s]
  9%|▊         | 32236/371472 [2:34:06<26:03:32,  3.62it/s]
  9%|▊         | 32237/371472 [2:34:06<27:01:09,  3.49it/s]
  9%|▊         | 32238/371472 [2:34:06<26:32:11,  3.55it/s]
  9%|▊         | 32239/371472 [2:34:07<25:37:59,  3.68it/s]
  9%|▊         | 32240/371472 [2:34:07<27:04:32,  3.48it/s]
                                                           
{'loss': 6.8514, 'learning_rate': 9.223318752828114e-07, 'epoch': 1.39}

  9%|▊         | 32240/371472 [2:34:07<27:04:32,  3.48it/s]
  9%|▊         | 32241/371472 [2:34:07<26:40:30,  3.53it/s]
  9%|▊         | 32242/371472 [2:34:08<27:00:53,  3.49it/s]
  9%|▊         | 32243/371472 [2:34:08<27:31:56,  3.42it/s]
  9%|▊         | 32244/371472 [2:34:08<29:37:22,  3.18it/s]
  9%|▊         | 32245/371472 [2:34:09<30:01:58,  3.14it/s]
  9%|▊         | 32246/371472 [2:34:09<28:24:47,  3.32it/s]
  9%|▊         | 32247/371472 [2:34:09<26:58:22,  3.49it/s]
  9%|▊         | 32248/371472 [2:34:09<27:32:09,  3.42it/s]
  9%|▊         | 32249/371472 [2:34:10<26:25:38,  3.57it/s]
  9%|▊         | 32250/371472 [2:34:10<25:22:29,  3.71it/s]
  9%|▊         | 32251/371472 [2:34:10<26:52:36,  3.51it/s]
  9%|▊         | 32252/371472 [2:34:10<26:32:20,  3.55it/s]
  9%|▊         | 32253/371472 [2:34:11<26:23:41,  3.57it/s]
  9%|▊         | 32254/371472 [2:34:11<26:55:56,  3.50it/s]
  9%|▊         | 32255/371472 [2:34:11<28:17:23,  3.33it/s]
  9%|▊         | 32256/371472 [2:34:12<29:28:46,  3.20it/s]
  9%|▊         | 32257/371472 [2:34:12<28:29:39,  3.31it/s]
  9%|▊         | 32258/371472 [2:34:12<28:20:39,  3.32it/s]
  9%|▊         | 32259/371472 [2:34:13<27:52:04,  3.38it/s]
  9%|▊         | 32260/371472 [2:34:13<29:51:27,  3.16it/s]
                                                           
{'loss': 6.6803, 'learning_rate': 9.222833933073326e-07, 'epoch': 1.39}

  9%|▊         | 32260/371472 [2:34:13<29:51:27,  3.16it/s]
  9%|▊         | 32261/371472 [2:34:13<29:35:29,  3.18it/s]
  9%|▊         | 32262/371472 [2:34:13<27:44:10,  3.40it/s]
  9%|▊         | 32263/371472 [2:34:14<28:44:35,  3.28it/s]
  9%|▊         | 32264/371472 [2:34:14<27:59:02,  3.37it/s]
  9%|▊         | 32265/371472 [2:34:14<27:38:52,  3.41it/s]
  9%|▊         | 32266/371472 [2:34:15<27:15:44,  3.46it/s]
  9%|▊         | 32267/371472 [2:34:15<26:57:49,  3.49it/s]
  9%|▊         | 32268/371472 [2:34:15<26:34:13,  3.55it/s]
  9%|▊         | 32269/371472 [2:34:15<26:41:04,  3.53it/s]
  9%|▊         | 32270/371472 [2:34:16<26:16:31,  3.59it/s]
  9%|▊         | 32271/371472 [2:34:16<25:45:07,  3.66it/s]
  9%|▊         | 32272/371472 [2:34:16<24:58:20,  3.77it/s]
  9%|▊         | 32273/371472 [2:34:16<24:53:47,  3.78it/s]
  9%|▊         | 32274/371472 [2:34:17<25:25:11,  3.71it/s]
  9%|▊         | 32275/371472 [2:34:17<24:52:00,  3.79it/s]
  9%|▊         | 32276/371472 [2:34:17<27:24:20,  3.44it/s]
  9%|▊         | 32277/371472 [2:34:18<29:06:25,  3.24it/s]
  9%|▊         | 32278/371472 [2:34:18<27:59:19,  3.37it/s]
  9%|▊         | 32279/371472 [2:34:18<27:47:27,  3.39it/s]
  9%|▊         | 32280/371472 [2:34:19<26:35:35,  3.54it/s]
                                                           
{'loss': 6.7469, 'learning_rate': 9.222349113318537e-07, 'epoch': 1.39}

  9%|▊         | 32280/371472 [2:34:19<26:35:35,  3.54it/s]
  9%|▊         | 32281/371472 [2:34:19<27:46:59,  3.39it/s]
  9%|▊         | 32282/371472 [2:34:19<27:35:44,  3.41it/s]
  9%|▊         | 32283/371472 [2:34:19<26:33:36,  3.55it/s]
  9%|▊         | 32284/371472 [2:34:20<27:45:07,  3.40it/s]
  9%|▊         | 32285/371472 [2:34:20<26:53:35,  3.50it/s]
  9%|▊         | 32286/371472 [2:34:20<26:40:33,  3.53it/s]
  9%|▊         | 32287/371472 [2:34:21<26:18:02,  3.58it/s]
  9%|▊         | 32288/371472 [2:34:21<25:36:45,  3.68it/s]
  9%|▊         | 32289/371472 [2:34:21<27:18:50,  3.45it/s]
  9%|▊         | 32290/371472 [2:34:21<27:07:16,  3.47it/s]
  9%|▊         | 32291/371472 [2:34:22<28:13:52,  3.34it/s]
  9%|▊         | 32292/371472 [2:34:22<28:02:18,  3.36it/s]
  9%|▊         | 32293/371472 [2:34:22<26:33:56,  3.55it/s]
  9%|▊         | 32294/371472 [2:34:23<25:39:09,  3.67it/s]
  9%|▊         | 32295/371472 [2:34:23<25:11:10,  3.74it/s]
  9%|▊         | 32296/371472 [2:34:23<25:11:19,  3.74it/s]
  9%|▊         | 32297/371472 [2:34:23<25:59:27,  3.62it/s]
  9%|▊         | 32298/371472 [2:34:24<25:38:54,  3.67it/s]
  9%|▊         | 32299/371472 [2:34:24<25:19:31,  3.72it/s]
  9%|▊         | 32300/371472 [2:34:24<25:04:07,  3.76it/s]
                                                           
{'loss': 6.7612, 'learning_rate': 9.22186429356375e-07, 'epoch': 1.39}

  9%|▊         | 32300/371472 [2:34:24<25:04:07,  3.76it/s]
  9%|▊         | 32301/371472 [2:34:24<26:12:29,  3.59it/s]
  9%|▊         | 32302/371472 [2:34:25<26:07:01,  3.61it/s]
  9%|▊         | 32303/371472 [2:34:25<25:43:52,  3.66it/s]
  9%|▊         | 32304/371472 [2:34:25<25:49:51,  3.65it/s]
  9%|▊         | 32305/371472 [2:34:26<25:51:13,  3.64it/s]
  9%|▊         | 32306/371472 [2:34:26<27:51:59,  3.38it/s]
  9%|▊         | 32307/371472 [2:34:26<28:13:58,  3.34it/s]
  9%|▊         | 32308/371472 [2:34:26<27:02:41,  3.48it/s]
  9%|▊         | 32309/371472 [2:34:27<27:52:52,  3.38it/s]
  9%|▊         | 32310/371472 [2:34:27<28:15:12,  3.33it/s]
  9%|▊         | 32311/371472 [2:34:27<28:02:34,  3.36it/s]
  9%|▊         | 32312/371472 [2:34:28<26:52:55,  3.50it/s]
  9%|▊         | 32313/371472 [2:34:28<26:10:07,  3.60it/s]
  9%|▊         | 32314/371472 [2:34:28<25:22:47,  3.71it/s]
  9%|▊         | 32315/371472 [2:34:28<25:55:50,  3.63it/s]
  9%|▊         | 32316/371472 [2:34:29<25:27:33,  3.70it/s]
  9%|▊         | 32317/371472 [2:34:29<24:56:00,  3.78it/s]
  9%|▊         | 32318/371472 [2:34:29<26:13:25,  3.59it/s]
  9%|▊         | 32319/371472 [2:34:30<26:10:54,  3.60it/s]
  9%|▊         | 32320/371472 [2:34:30<25:28:37,  3.70it/s]
                                                           
{'loss': 6.8637, 'learning_rate': 9.221379473808959e-07, 'epoch': 1.39}

  9%|▊         | 32320/371472 [2:34:30<25:28:37,  3.70it/s]
  9%|▊         | 32321/371472 [2:34:30<25:01:33,  3.76it/s]
  9%|▊         | 32322/371472 [2:34:30<24:48:57,  3.80it/s]
  9%|▊         | 32323/371472 [2:34:31<24:50:58,  3.79it/s]
  9%|▊         | 32324/371472 [2:34:31<25:40:45,  3.67it/s]
  9%|▊         | 32325/371472 [2:34:31<24:54:34,  3.78it/s]
  9%|▊         | 32326/371472 [2:34:31<24:41:41,  3.81it/s]
  9%|▊         | 32327/371472 [2:34:32<27:31:54,  3.42it/s]
  9%|▊         | 32328/371472 [2:34:32<27:33:15,  3.42it/s]
  9%|▊         | 32329/371472 [2:34:32<26:38:24,  3.54it/s]
  9%|▊         | 32330/371472 [2:34:33<25:54:58,  3.64it/s]
  9%|▊         | 32331/371472 [2:34:33<25:51:59,  3.64it/s]
  9%|▊         | 32332/371472 [2:34:33<27:22:56,  3.44it/s]
  9%|▊         | 32333/371472 [2:34:33<29:17:54,  3.22it/s]
  9%|▊         | 32334/371472 [2:34:34<29:07:13,  3.24it/s]
  9%|▊         | 32335/371472 [2:34:34<30:48:22,  3.06it/s]
  9%|▊         | 32336/371472 [2:34:34<30:41:11,  3.07it/s]
  9%|▊         | 32337/371472 [2:34:35<29:53:25,  3.15it/s]
  9%|▊         | 32338/371472 [2:34:35<31:05:25,  3.03it/s]
  9%|▊         | 32339/371472 [2:34:35<29:54:12,  3.15it/s]
  9%|▊         | 32340/371472 [2:34:36<27:56:21,  3.37it/s]
                                                           
{'loss': 6.6512, 'learning_rate': 9.22089465405417e-07, 'epoch': 1.39}

  9%|▊         | 32340/371472 [2:34:36<27:56:21,  3.37it/s]
  9%|▊         | 32341/371472 [2:34:36<27:10:19,  3.47it/s]
  9%|▊         | 32342/371472 [2:34:36<26:37:50,  3.54it/s]
  9%|▊         | 32343/371472 [2:34:36<26:49:09,  3.51it/s]
  9%|▊         | 32344/371472 [2:34:37<26:11:53,  3.60it/s]
  9%|▊         | 32345/371472 [2:34:37<26:35:47,  3.54it/s]
  9%|▊         | 32346/371472 [2:34:37<26:21:11,  3.57it/s]
  9%|▊         | 32347/371472 [2:34:38<30:29:51,  3.09it/s]
  9%|▊         | 32348/371472 [2:34:38<28:30:57,  3.30it/s]
  9%|▊         | 32349/371472 [2:34:38<28:46:14,  3.27it/s]
  9%|▊         | 32350/371472 [2:34:39<27:28:15,  3.43it/s]
  9%|▊         | 32351/371472 [2:34:39<28:28:28,  3.31it/s]
  9%|▊         | 32352/371472 [2:34:39<27:53:15,  3.38it/s]
  9%|▊         | 32353/371472 [2:34:39<27:22:03,  3.44it/s]
  9%|▊         | 32354/371472 [2:34:40<26:25:46,  3.56it/s]
  9%|▊         | 32355/371472 [2:34:40<26:18:49,  3.58it/s]
  9%|▊         | 32356/371472 [2:34:40<27:22:48,  3.44it/s]
  9%|▊         | 32357/371472 [2:34:41<27:58:09,  3.37it/s]
  9%|▊         | 32358/371472 [2:34:41<31:28:23,  2.99it/s]
  9%|▊         | 32359/371472 [2:34:41<30:25:11,  3.10it/s]
  9%|▊         | 32360/371472 [2:34:42<28:35:14,  3.30it/s]
                                                           
{'loss': 6.5928, 'learning_rate': 9.220409834299381e-07, 'epoch': 1.39}

  9%|▊         | 32360/371472 [2:34:42<28:35:14,  3.30it/s]
  9%|▊         | 32361/371472 [2:34:42<27:16:18,  3.45it/s]
  9%|▊         | 32362/371472 [2:34:42<26:26:37,  3.56it/s]
  9%|▊         | 32363/371472 [2:34:42<25:17:09,  3.73it/s]
  9%|▊         | 32364/371472 [2:34:43<24:36:14,  3.83it/s]
  9%|▊         | 32365/371472 [2:34:43<24:42:17,  3.81it/s]
  9%|▊         | 32366/371472 [2:34:43<25:02:31,  3.76it/s]
  9%|▊         | 32367/371472 [2:34:43<26:48:58,  3.51it/s]
  9%|▊         | 32368/371472 [2:34:44<26:16:00,  3.59it/s]
  9%|▊         | 32369/371472 [2:34:44<25:58:37,  3.63it/s]
  9%|▊         | 32370/371472 [2:34:44<25:48:18,  3.65it/s]
  9%|▊         | 32371/371472 [2:34:45<27:02:02,  3.48it/s]
  9%|▊         | 32372/371472 [2:34:45<26:08:49,  3.60it/s]
  9%|▊         | 32373/371472 [2:34:45<28:18:06,  3.33it/s]
  9%|▊         | 32374/371472 [2:34:45<26:41:43,  3.53it/s]
  9%|▊         | 32375/371472 [2:34:46<26:28:22,  3.56it/s]
  9%|▊         | 32376/371472 [2:34:46<27:32:26,  3.42it/s]
  9%|▊         | 32377/371472 [2:34:46<27:25:31,  3.43it/s]
  9%|▊         | 32378/371472 [2:34:47<26:23:27,  3.57it/s]
  9%|▊         | 32379/371472 [2:34:47<25:56:52,  3.63it/s]
  9%|▊         | 32380/371472 [2:34:47<25:50:19,  3.65it/s]
                                                           
{'loss': 6.5807, 'learning_rate': 9.219925014544593e-07, 'epoch': 1.39}

  9%|▊         | 32380/371472 [2:34:47<25:50:19,  3.65it/s]
  9%|▊         | 32381/371472 [2:34:47<25:18:28,  3.72it/s]
  9%|▊         | 32382/371472 [2:34:48<24:58:24,  3.77it/s]
  9%|▊         | 32383/371472 [2:34:48<25:04:16,  3.76it/s]
  9%|▊         | 32384/371472 [2:34:48<25:24:04,  3.71it/s]
  9%|▊         | 32385/371472 [2:34:48<26:25:29,  3.56it/s]
  9%|▊         | 32386/371472 [2:34:49<27:16:17,  3.45it/s]
  9%|▊         | 32387/371472 [2:34:49<26:18:40,  3.58it/s]
  9%|▊         | 32388/371472 [2:34:49<25:54:43,  3.63it/s]
  9%|▊         | 32389/371472 [2:34:50<25:42:12,  3.66it/s]
  9%|▊         | 32390/371472 [2:34:50<26:04:23,  3.61it/s]
  9%|▊         | 32391/371472 [2:34:50<29:00:33,  3.25it/s]
  9%|▊         | 32392/371472 [2:34:51<28:17:31,  3.33it/s]
  9%|▊         | 32393/371472 [2:34:51<28:08:27,  3.35it/s]
  9%|▊         | 32394/371472 [2:34:51<27:11:34,  3.46it/s]
  9%|▊         | 32395/371472 [2:34:51<25:58:27,  3.63it/s]
  9%|▊         | 32396/371472 [2:34:52<26:13:43,  3.59it/s]
  9%|▊         | 32397/371472 [2:34:52<27:56:37,  3.37it/s]
  9%|▊         | 32398/371472 [2:34:52<28:35:03,  3.30it/s]
  9%|▊         | 32399/371472 [2:34:53<27:13:35,  3.46it/s]
  9%|▊         | 32400/371472 [2:34:53<26:05:36,  3.61it/s]
                                                           
{'loss': 6.5286, 'learning_rate': 9.219440194789803e-07, 'epoch': 1.4}

  9%|▊         | 32400/371472 [2:34:53<26:05:36,  3.61it/s]
  9%|▊         | 32401/371472 [2:34:53<25:20:10,  3.72it/s]
  9%|▊         | 32402/371472 [2:34:53<27:04:56,  3.48it/s]
  9%|▊         | 32403/371472 [2:34:54<27:30:06,  3.42it/s]
  9%|▊         | 32404/371472 [2:34:54<26:52:36,  3.50it/s]
  9%|▊         | 32405/371472 [2:34:54<26:59:14,  3.49it/s]
  9%|▊         | 32406/371472 [2:34:54<26:01:33,  3.62it/s]
  9%|▊         | 32407/371472 [2:34:55<26:52:57,  3.50it/s]
  9%|▊         | 32408/371472 [2:34:55<26:17:17,  3.58it/s]
  9%|▊         | 32409/371472 [2:34:55<26:43:45,  3.52it/s]
  9%|▊         | 32410/371472 [2:34:56<26:08:02,  3.60it/s]
  9%|▊         | 32411/371472 [2:34:56<26:13:05,  3.59it/s]
  9%|▊         | 32412/371472 [2:34:56<25:36:37,  3.68it/s]
  9%|▊         | 32413/371472 [2:34:56<25:41:52,  3.67it/s]
  9%|▊         | 32414/371472 [2:34:57<25:47:25,  3.65it/s]
  9%|▊         | 32415/371472 [2:34:57<26:42:23,  3.53it/s]
  9%|▊         | 32416/371472 [2:34:57<29:23:25,  3.20it/s]
  9%|▊         | 32417/371472 [2:34:58<28:19:34,  3.32it/s]
  9%|▊         | 32418/371472 [2:34:58<28:01:04,  3.36it/s]
  9%|▊         | 32419/371472 [2:34:58<28:38:57,  3.29it/s]
  9%|▊         | 32420/371472 [2:34:59<28:44:14,  3.28it/s]
                                                           
{'loss': 6.4358, 'learning_rate': 9.218955375035015e-07, 'epoch': 1.4}

  9%|▊         | 32420/371472 [2:34:59<28:44:14,  3.28it/s]
  9%|▊         | 32421/371472 [2:34:59<27:16:03,  3.45it/s]
  9%|▊         | 32422/371472 [2:34:59<26:25:07,  3.56it/s]
  9%|▊         | 32423/371472 [2:34:59<26:27:14,  3.56it/s]
  9%|▊         | 32424/371472 [2:35:00<25:45:05,  3.66it/s]
  9%|▊         | 32425/371472 [2:35:00<24:58:24,  3.77it/s]
  9%|▊         | 32426/371472 [2:35:00<25:03:53,  3.76it/s]
  9%|▊         | 32427/371472 [2:35:00<25:36:16,  3.68it/s]
  9%|▊         | 32428/371472 [2:35:01<25:24:12,  3.71it/s]
  9%|▊         | 32429/371472 [2:35:01<24:54:16,  3.78it/s]
  9%|▊         | 32430/371472 [2:35:01<24:50:29,  3.79it/s]
  9%|▊         | 32431/371472 [2:35:01<24:58:06,  3.77it/s]
  9%|▊         | 32432/371472 [2:35:02<26:07:20,  3.61it/s]
  9%|▊         | 32433/371472 [2:35:02<25:51:58,  3.64it/s]
  9%|▊         | 32434/371472 [2:35:02<25:48:24,  3.65it/s]
  9%|▊         | 32435/371472 [2:35:03<25:56:11,  3.63it/s]
  9%|▊         | 32436/371472 [2:35:03<26:46:36,  3.52it/s]
  9%|▊         | 32437/371472 [2:35:03<26:20:48,  3.57it/s]
  9%|▊         | 32438/371472 [2:35:03<27:04:18,  3.48it/s]
  9%|▊         | 32439/371472 [2:35:04<27:10:22,  3.47it/s]
  9%|▊         | 32440/371472 [2:35:04<27:50:46,  3.38it/s]
                                                           
{'loss': 6.7531, 'learning_rate': 9.218470555280226e-07, 'epoch': 1.4}

  9%|▊         | 32440/371472 [2:35:04<27:50:46,  3.38it/s]
  9%|▊         | 32441/371472 [2:35:04<28:23:06,  3.32it/s]
  9%|▊         | 32442/371472 [2:35:05<27:37:33,  3.41it/s]
  9%|▊         | 32443/371472 [2:35:05<26:22:07,  3.57it/s]
  9%|▊         | 32444/371472 [2:35:05<27:23:46,  3.44it/s]
  9%|▊         | 32445/371472 [2:35:06<28:39:55,  3.29it/s]
  9%|▊         | 32446/371472 [2:35:06<28:03:22,  3.36it/s]
  9%|▊         | 32447/371472 [2:35:06<30:20:56,  3.10it/s]
  9%|▊         | 32448/371472 [2:35:06<28:30:28,  3.30it/s]
  9%|▊         | 32449/371472 [2:35:07<27:44:00,  3.40it/s]
  9%|▊         | 32450/371472 [2:35:07<26:41:54,  3.53it/s]
  9%|▊         | 32451/371472 [2:35:07<26:09:26,  3.60it/s]
  9%|▊         | 32452/371472 [2:35:08<28:02:56,  3.36it/s]
  9%|▊         | 32453/371472 [2:35:08<27:50:27,  3.38it/s]
  9%|▊         | 32454/371472 [2:35:08<27:28:38,  3.43it/s]
  9%|▊         | 32455/371472 [2:35:08<27:06:28,  3.47it/s]
  9%|▊         | 32456/371472 [2:35:09<27:32:28,  3.42it/s]
  9%|▊         | 32457/371472 [2:35:09<26:48:54,  3.51it/s]
  9%|▊         | 32458/371472 [2:35:09<26:03:34,  3.61it/s]
  9%|▊         | 32459/371472 [2:35:10<27:10:45,  3.46it/s]
  9%|▊         | 32460/371472 [2:35:10<27:50:26,  3.38it/s]
                                                           
{'loss': 6.7327, 'learning_rate': 9.217985735525436e-07, 'epoch': 1.4}

  9%|▊         | 32460/371472 [2:35:10<27:50:26,  3.38it/s]
  9%|▊         | 32461/371472 [2:35:10<26:46:39,  3.52it/s]
  9%|▊         | 32462/371472 [2:35:10<25:56:09,  3.63it/s]
  9%|▊         | 32463/371472 [2:35:11<26:23:58,  3.57it/s]
  9%|▊         | 32464/371472 [2:35:11<26:08:07,  3.60it/s]
  9%|▊         | 32465/371472 [2:35:11<28:41:20,  3.28it/s]
  9%|▊         | 32466/371472 [2:35:12<26:45:20,  3.52it/s]
  9%|▊         | 32467/371472 [2:35:12<26:41:32,  3.53it/s]
  9%|▊         | 32468/371472 [2:35:12<26:55:44,  3.50it/s]
  9%|▊         | 32469/371472 [2:35:12<26:28:02,  3.56it/s]
  9%|▊         | 32470/371472 [2:35:13<26:03:39,  3.61it/s]
  9%|▊         | 32471/371472 [2:35:13<25:48:48,  3.65it/s]
  9%|▊         | 32472/371472 [2:35:13<26:57:57,  3.49it/s]
  9%|▊         | 32473/371472 [2:35:14<26:25:28,  3.56it/s]
  9%|▊         | 32474/371472 [2:35:14<25:28:34,  3.70it/s]
  9%|▊         | 32475/371472 [2:35:14<25:18:53,  3.72it/s]
  9%|▊         | 32476/371472 [2:35:14<25:24:49,  3.71it/s]
  9%|▊         | 32477/371472 [2:35:15<25:30:56,  3.69it/s]
  9%|▊         | 32478/371472 [2:35:15<27:10:33,  3.47it/s]
  9%|▊         | 32479/371472 [2:35:15<26:37:59,  3.54it/s]
  9%|▊         | 32480/371472 [2:35:16<26:54:26,  3.50it/s]
                                                           
{'loss': 6.9049, 'learning_rate': 9.217500915770647e-07, 'epoch': 1.4}

  9%|▊         | 32480/371472 [2:35:16<26:54:26,  3.50it/s]
  9%|▊         | 32481/371472 [2:35:16<28:14:31,  3.33it/s]
  9%|▊         | 32482/371472 [2:35:16<28:22:06,  3.32it/s]
  9%|▊         | 32483/371472 [2:35:16<28:52:43,  3.26it/s]
  9%|▊         | 32484/371472 [2:35:17<28:33:25,  3.30it/s]
  9%|▊         | 32485/371472 [2:35:17<27:38:44,  3.41it/s]
  9%|▊         | 32486/371472 [2:35:17<26:56:27,  3.50it/s]
  9%|▊         | 32487/371472 [2:35:18<26:30:08,  3.55it/s]
  9%|▊         | 32488/371472 [2:35:18<26:00:02,  3.62it/s]
  9%|▊         | 32489/371472 [2:35:18<26:31:16,  3.55it/s]
  9%|▊         | 32490/371472 [2:35:18<27:01:04,  3.49it/s]
  9%|▊         | 32491/371472 [2:35:19<38:52:41,  2.42it/s]
  9%|▊         | 32492/371472 [2:35:19<34:03:23,  2.76it/s]
  9%|▊         | 32493/371472 [2:35:20<31:44:11,  2.97it/s]
  9%|▊         | 32494/371472 [2:35:20<29:34:14,  3.18it/s]
  9%|▊         | 32495/371472 [2:35:20<28:41:02,  3.28it/s]
  9%|▊         | 32496/371472 [2:35:21<29:10:52,  3.23it/s]
  9%|▊         | 32497/371472 [2:35:21<28:06:52,  3.35it/s]
  9%|▊         | 32498/371472 [2:35:21<26:26:39,  3.56it/s]
  9%|▊         | 32499/371472 [2:35:21<29:34:43,  3.18it/s]
  9%|▊         | 32500/371472 [2:35:22<28:26:28,  3.31it/s]
                                                           
{'loss': 6.744, 'learning_rate': 9.217016096015858e-07, 'epoch': 1.4}

  9%|▊         | 32500/371472 [2:35:22<28:26:28,  3.31it/s]
  9%|▊         | 32501/371472 [2:35:22<27:46:09,  3.39it/s]
  9%|▊         | 32502/371472 [2:35:22<26:35:11,  3.54it/s]
  9%|▊         | 32503/371472 [2:35:23<26:22:14,  3.57it/s]
  9%|▉         | 32504/371472 [2:35:23<27:08:08,  3.47it/s]
  9%|▉         | 32505/371472 [2:35:23<26:19:41,  3.58it/s]
  9%|▉         | 32506/371472 [2:35:23<25:32:48,  3.69it/s]
  9%|▉         | 32507/371472 [2:35:24<26:45:04,  3.52it/s]
  9%|▉         | 32508/371472 [2:35:24<26:13:11,  3.59it/s]
  9%|▉         | 32509/371472 [2:35:24<26:06:55,  3.61it/s]
  9%|▉         | 32510/371472 [2:35:24<26:53:46,  3.50it/s]
  9%|▉         | 32511/371472 [2:35:25<26:35:42,  3.54it/s]
  9%|▉         | 32512/371472 [2:35:25<27:14:49,  3.46it/s]
  9%|▉         | 32513/371472 [2:35:25<27:31:15,  3.42it/s]
  9%|▉         | 32514/371472 [2:35:26<26:12:11,  3.59it/s]
  9%|▉         | 32515/371472 [2:35:26<27:28:39,  3.43it/s]
  9%|▉         | 32516/371472 [2:35:26<26:08:16,  3.60it/s]
  9%|▉         | 32517/371472 [2:35:26<25:54:38,  3.63it/s]
  9%|▉         | 32518/371472 [2:35:27<27:08:39,  3.47it/s]
  9%|▉         | 32519/371472 [2:35:27<28:21:54,  3.32it/s]
  9%|▉         | 32520/371472 [2:35:27<28:08:44,  3.35it/s]
                                                           
{'loss': 6.7219, 'learning_rate': 9.21653127626107e-07, 'epoch': 1.4}

  9%|▉         | 32520/371472 [2:35:27<28:08:44,  3.35it/s]
  9%|▉         | 32521/371472 [2:35:28<27:46:31,  3.39it/s]
  9%|▉         | 32522/371472 [2:35:28<30:26:52,  3.09it/s]
  9%|▉         | 32523/371472 [2:35:28<29:41:19,  3.17it/s]
  9%|▉         | 32524/371472 [2:35:29<30:29:38,  3.09it/s]
  9%|▉         | 32525/371472 [2:35:29<28:58:49,  3.25it/s]
  9%|▉         | 32526/371472 [2:35:29<27:04:43,  3.48it/s]
  9%|▉         | 32527/371472 [2:35:30<27:16:14,  3.45it/s]
  9%|▉         | 32528/371472 [2:35:30<27:17:26,  3.45it/s]
  9%|▉         | 32529/371472 [2:35:30<28:16:58,  3.33it/s]
  9%|▉         | 32530/371472 [2:35:30<27:40:36,  3.40it/s]
  9%|▉         | 32531/371472 [2:35:31<27:04:47,  3.48it/s]
  9%|▉         | 32532/371472 [2:35:31<26:31:16,  3.55it/s]
  9%|▉         | 32533/371472 [2:35:31<26:16:29,  3.58it/s]
  9%|▉         | 32534/371472 [2:35:31<25:16:40,  3.72it/s]
  9%|▉         | 32535/371472 [2:35:32<25:52:49,  3.64it/s]
  9%|▉         | 32536/371472 [2:35:32<26:11:34,  3.59it/s]
  9%|▉         | 32537/371472 [2:35:32<26:28:31,  3.56it/s]
  9%|▉         | 32538/371472 [2:35:33<28:01:11,  3.36it/s]
  9%|▉         | 32539/371472 [2:35:33<28:13:17,  3.34it/s]
  9%|▉         | 32540/371472 [2:35:33<28:11:31,  3.34it/s]
                                                           
{'loss': 6.7781, 'learning_rate': 9.216046456506281e-07, 'epoch': 1.4}

  9%|▉         | 32540/371472 [2:35:33<28:11:31,  3.34it/s]
  9%|▉         | 32541/371472 [2:35:34<27:59:24,  3.36it/s]
  9%|▉         | 32542/371472 [2:35:34<26:53:06,  3.50it/s]
  9%|▉         | 32543/371472 [2:35:34<25:57:46,  3.63it/s]
  9%|▉         | 32544/371472 [2:35:34<26:27:14,  3.56it/s]
  9%|▉         | 32545/371472 [2:35:35<25:31:54,  3.69it/s]
  9%|▉         | 32546/371472 [2:35:35<27:16:00,  3.45it/s]
  9%|▉         | 32547/371472 [2:35:35<29:04:15,  3.24it/s]
  9%|▉         | 32548/371472 [2:35:36<30:47:26,  3.06it/s]
  9%|▉         | 32549/371472 [2:35:36<29:01:57,  3.24it/s]
  9%|▉         | 32550/371472 [2:35:36<28:47:45,  3.27it/s]
  9%|▉         | 32551/371472 [2:35:36<27:10:58,  3.46it/s]
  9%|▉         | 32552/371472 [2:35:37<28:02:48,  3.36it/s]
  9%|▉         | 32553/371472 [2:35:37<28:33:07,  3.30it/s]
  9%|▉         | 32554/371472 [2:35:37<27:58:06,  3.37it/s]
  9%|▉         | 32555/371472 [2:35:38<27:53:57,  3.37it/s]
  9%|▉         | 32556/371472 [2:35:38<27:03:53,  3.48it/s]
  9%|▉         | 32557/371472 [2:35:38<27:10:32,  3.46it/s]
  9%|▉         | 32558/371472 [2:35:39<30:45:41,  3.06it/s]
  9%|▉         | 32559/371472 [2:35:39<30:19:09,  3.11it/s]
  9%|▉         | 32560/371472 [2:35:39<29:48:34,  3.16it/s]
                                                           
{'loss': 6.7637, 'learning_rate': 9.215561636751492e-07, 'epoch': 1.4}

  9%|▉         | 32560/371472 [2:35:39<29:48:34,  3.16it/s]
  9%|▉         | 32561/371472 [2:35:40<29:12:57,  3.22it/s]
  9%|▉         | 32562/371472 [2:35:40<28:04:52,  3.35it/s]
  9%|▉         | 32563/371472 [2:35:40<27:02:57,  3.48it/s]
  9%|▉         | 32564/371472 [2:35:40<27:02:48,  3.48it/s]
  9%|▉         | 32565/371472 [2:35:41<26:37:02,  3.54it/s]
  9%|▉         | 32566/371472 [2:35:41<29:43:25,  3.17it/s]
  9%|▉         | 32567/371472 [2:35:41<29:02:14,  3.24it/s]
  9%|▉         | 32568/371472 [2:35:42<31:14:31,  3.01it/s]
  9%|▉         | 32569/371472 [2:35:42<29:10:01,  3.23it/s]
  9%|▉         | 32570/371472 [2:35:42<29:28:29,  3.19it/s]
  9%|▉         | 32571/371472 [2:35:43<28:28:16,  3.31it/s]
  9%|▉         | 32572/371472 [2:35:43<28:24:46,  3.31it/s]
  9%|▉         | 32573/371472 [2:35:43<29:27:06,  3.20it/s]
  9%|▉         | 32574/371472 [2:35:44<28:57:12,  3.25it/s]
  9%|▉         | 32575/371472 [2:35:44<27:52:25,  3.38it/s]
  9%|▉         | 32576/371472 [2:35:44<27:26:44,  3.43it/s]
  9%|▉         | 32577/371472 [2:35:44<26:40:31,  3.53it/s]
  9%|▉         | 32578/371472 [2:35:45<28:20:56,  3.32it/s]
  9%|▉         | 32579/371472 [2:35:45<28:01:09,  3.36it/s]
  9%|▉         | 32580/371472 [2:35:45<26:55:15,  3.50it/s]
                                                           
{'loss': 6.7455, 'learning_rate': 9.215076816996703e-07, 'epoch': 1.4}

  9%|▉         | 32580/371472 [2:35:45<26:55:15,  3.50it/s]
  9%|▉         | 32581/371472 [2:35:46<28:34:15,  3.29it/s]
  9%|▉         | 32582/371472 [2:35:46<28:21:27,  3.32it/s]
  9%|▉         | 32583/371472 [2:35:46<27:44:07,  3.39it/s]
  9%|▉         | 32584/371472 [2:35:46<27:13:59,  3.46it/s]
  9%|▉         | 32585/371472 [2:35:47<26:39:08,  3.53it/s]
  9%|▉         | 32586/371472 [2:35:47<26:40:10,  3.53it/s]
  9%|▉         | 32587/371472 [2:35:47<26:24:44,  3.56it/s]
  9%|▉         | 32588/371472 [2:35:48<26:20:14,  3.57it/s]
  9%|▉         | 32589/371472 [2:35:48<28:17:29,  3.33it/s]
  9%|▉         | 32590/371472 [2:35:48<27:11:38,  3.46it/s]
  9%|▉         | 32591/371472 [2:35:48<27:44:04,  3.39it/s]
  9%|▉         | 32592/371472 [2:35:49<30:31:04,  3.08it/s]
  9%|▉         | 32593/371472 [2:35:49<28:43:42,  3.28it/s]
  9%|▉         | 32594/371472 [2:35:49<27:54:14,  3.37it/s]
  9%|▉         | 32595/371472 [2:35:50<27:12:14,  3.46it/s]
  9%|▉         | 32596/371472 [2:35:50<27:27:10,  3.43it/s]
  9%|▉         | 32597/371472 [2:35:50<26:58:07,  3.49it/s]
  9%|▉         | 32598/371472 [2:35:51<29:26:09,  3.20it/s]
  9%|▉         | 32599/371472 [2:35:51<29:03:42,  3.24it/s]
  9%|▉         | 32600/371472 [2:35:51<29:03:53,  3.24it/s]
                                                           
{'loss': 6.5962, 'learning_rate': 9.214591997241914e-07, 'epoch': 1.4}

  9%|▉         | 32600/371472 [2:35:51<29:03:53,  3.24it/s]
  9%|▉         | 32601/371472 [2:35:52<28:41:52,  3.28it/s]
  9%|▉         | 32602/371472 [2:35:52<28:17:31,  3.33it/s]
  9%|▉         | 32603/371472 [2:35:52<27:59:57,  3.36it/s]
  9%|▉         | 32604/371472 [2:35:52<27:28:42,  3.43it/s]
  9%|▉         | 32605/371472 [2:35:53<27:43:32,  3.40it/s]
  9%|▉         | 32606/371472 [2:35:53<26:20:53,  3.57it/s]
  9%|▉         | 32607/371472 [2:35:53<25:51:26,  3.64it/s]
  9%|▉         | 32608/371472 [2:35:53<26:00:33,  3.62it/s]
  9%|▉         | 32609/371472 [2:35:54<25:50:03,  3.64it/s]
  9%|▉         | 32610/371472 [2:35:54<26:49:21,  3.51it/s]
  9%|▉         | 32611/371472 [2:35:54<27:32:17,  3.42it/s]
  9%|▉         | 32612/371472 [2:35:55<26:14:26,  3.59it/s]
  9%|▉         | 32613/371472 [2:35:55<25:27:36,  3.70it/s]
  9%|▉         | 32614/371472 [2:35:55<25:55:43,  3.63it/s]
  9%|▉         | 32615/371472 [2:35:55<25:14:13,  3.73it/s]
  9%|▉         | 32616/371472 [2:35:56<25:55:23,  3.63it/s]
  9%|▉         | 32617/371472 [2:35:56<25:19:31,  3.72it/s]
  9%|▉         | 32618/371472 [2:35:56<25:10:48,  3.74it/s]
  9%|▉         | 32619/371472 [2:35:56<25:50:53,  3.64it/s]
  9%|▉         | 32620/371472 [2:35:57<25:27:26,  3.70it/s]
                                                           
{'loss': 6.4006, 'learning_rate': 9.214107177487125e-07, 'epoch': 1.41}

  9%|▉         | 32620/371472 [2:35:57<25:27:26,  3.70it/s]
  9%|▉         | 32621/371472 [2:35:57<25:12:25,  3.73it/s]
  9%|▉         | 32622/371472 [2:35:57<27:08:55,  3.47it/s]
  9%|▉         | 32623/371472 [2:35:58<28:15:15,  3.33it/s]
  9%|▉         | 32624/371472 [2:35:58<27:49:43,  3.38it/s]
  9%|▉         | 32625/371472 [2:35:58<27:48:33,  3.38it/s]
  9%|▉         | 32626/371472 [2:35:59<26:32:45,  3.55it/s]
  9%|▉         | 32627/371472 [2:35:59<28:04:27,  3.35it/s]
  9%|▉         | 32628/371472 [2:35:59<28:09:34,  3.34it/s]
  9%|▉         | 32629/371472 [2:35:59<27:29:54,  3.42it/s]
  9%|▉         | 32630/371472 [2:36:00<27:33:53,  3.41it/s]
  9%|▉         | 32631/371472 [2:36:00<26:24:39,  3.56it/s]
  9%|▉         | 32632/371472 [2:36:00<26:26:40,  3.56it/s]
  9%|▉         | 32633/371472 [2:36:01<26:07:02,  3.60it/s]
  9%|▉         | 32634/371472 [2:36:01<27:29:40,  3.42it/s]
  9%|▉         | 32635/371472 [2:36:01<26:38:02,  3.53it/s]
  9%|▉         | 32636/371472 [2:36:01<27:51:04,  3.38it/s]
  9%|▉         | 32637/371472 [2:36:02<27:18:15,  3.45it/s]
  9%|▉         | 32638/371472 [2:36:02<28:59:40,  3.25it/s]
  9%|▉         | 32639/371472 [2:36:02<27:44:38,  3.39it/s]
  9%|▉         | 32640/371472 [2:36:03<28:09:59,  3.34it/s]
                                                           
{'loss': 6.4812, 'learning_rate': 9.213622357732336e-07, 'epoch': 1.41}

  9%|▉         | 32640/371472 [2:36:03<28:09:59,  3.34it/s]
  9%|▉         | 32641/371472 [2:36:03<27:26:00,  3.43it/s]
  9%|▉         | 32642/371472 [2:36:03<26:30:42,  3.55it/s]
  9%|▉         | 32643/371472 [2:36:03<26:05:34,  3.61it/s]
  9%|▉         | 32644/371472 [2:36:04<25:56:38,  3.63it/s]
  9%|▉         | 32645/371472 [2:36:04<25:15:17,  3.73it/s]
  9%|▉         | 32646/371472 [2:36:04<26:22:17,  3.57it/s]
  9%|▉         | 32647/371472 [2:36:05<26:52:30,  3.50it/s]
  9%|▉         | 32648/371472 [2:36:05<27:17:37,  3.45it/s]
  9%|▉         | 32649/371472 [2:36:05<26:59:28,  3.49it/s]
  9%|▉         | 32650/371472 [2:36:05<26:23:05,  3.57it/s]
  9%|▉         | 32651/371472 [2:36:06<26:42:29,  3.52it/s]
  9%|▉         | 32652/371472 [2:36:06<27:01:04,  3.48it/s]
  9%|▉         | 32653/371472 [2:36:06<25:54:36,  3.63it/s]
  9%|▉         | 32654/371472 [2:36:07<25:33:10,  3.68it/s]
  9%|▉         | 32655/371472 [2:36:07<25:23:36,  3.71it/s]
  9%|▉         | 32656/371472 [2:36:07<25:14:18,  3.73it/s]
  9%|▉         | 32657/371472 [2:36:07<24:38:49,  3.82it/s]
  9%|▉         | 32658/371472 [2:36:08<26:10:50,  3.59it/s]
  9%|▉         | 32659/371472 [2:36:08<25:51:04,  3.64it/s]
  9%|▉         | 32660/371472 [2:36:08<25:41:51,  3.66it/s]
                                                           
{'loss': 6.7662, 'learning_rate': 9.213137537977547e-07, 'epoch': 1.41}

  9%|▉         | 32660/371472 [2:36:08<25:41:51,  3.66it/s]
  9%|▉         | 32661/371472 [2:36:08<27:21:49,  3.44it/s]
  9%|▉         | 32662/371472 [2:36:09<27:21:07,  3.44it/s]
  9%|▉         | 32663/371472 [2:36:09<26:35:56,  3.54it/s]
  9%|▉         | 32664/371472 [2:36:09<26:22:41,  3.57it/s]
  9%|▉         | 32665/371472 [2:36:10<26:26:05,  3.56it/s]
  9%|▉         | 32666/371472 [2:36:10<27:35:17,  3.41it/s]
  9%|▉         | 32667/371472 [2:36:10<26:45:33,  3.52it/s]
  9%|▉         | 32668/371472 [2:36:10<26:37:35,  3.53it/s]
  9%|▉         | 32669/371472 [2:36:11<26:49:35,  3.51it/s]
  9%|▉         | 32670/371472 [2:36:11<25:53:23,  3.64it/s]
  9%|▉         | 32671/371472 [2:36:11<26:05:45,  3.61it/s]
  9%|▉         | 32672/371472 [2:36:12<27:47:09,  3.39it/s]
  9%|▉         | 32673/371472 [2:36:12<27:04:26,  3.48it/s]
  9%|▉         | 32674/371472 [2:36:12<26:19:48,  3.57it/s]
  9%|▉         | 32675/371472 [2:36:12<25:44:20,  3.66it/s]
  9%|▉         | 32676/371472 [2:36:13<26:58:18,  3.49it/s]
  9%|▉         | 32677/371472 [2:36:13<26:49:40,  3.51it/s]
  9%|▉         | 32678/371472 [2:36:13<26:36:02,  3.54it/s]
  9%|▉         | 32679/371472 [2:36:14<27:29:24,  3.42it/s]
  9%|▉         | 32680/371472 [2:36:14<27:13:09,  3.46it/s]
                                                           
{'loss': 6.7259, 'learning_rate': 9.212652718222759e-07, 'epoch': 1.41}

  9%|▉         | 32680/371472 [2:36:14<27:13:09,  3.46it/s]
  9%|▉         | 32681/371472 [2:36:14<26:49:01,  3.51it/s]
  9%|▉         | 32682/371472 [2:36:14<27:09:23,  3.47it/s]
  9%|▉         | 32683/371472 [2:36:15<26:44:46,  3.52it/s]
  9%|▉         | 32684/371472 [2:36:15<27:39:32,  3.40it/s]
  9%|▉         | 32685/371472 [2:36:15<28:12:44,  3.34it/s]
  9%|▉         | 32686/371472 [2:36:16<27:26:43,  3.43it/s]
  9%|▉         | 32687/371472 [2:36:16<27:14:06,  3.46it/s]
  9%|▉         | 32688/371472 [2:36:16<27:28:38,  3.42it/s]
  9%|▉         | 32689/371472 [2:36:17<29:31:28,  3.19it/s]
  9%|▉         | 32690/371472 [2:36:17<29:54:15,  3.15it/s]
  9%|▉         | 32691/371472 [2:36:17<28:45:49,  3.27it/s]
  9%|▉         | 32692/371472 [2:36:17<27:48:03,  3.38it/s]
  9%|▉         | 32693/371472 [2:36:18<26:31:19,  3.55it/s]
  9%|▉         | 32694/371472 [2:36:18<26:09:16,  3.60it/s]
  9%|▉         | 32695/371472 [2:36:18<25:43:31,  3.66it/s]
  9%|▉         | 32696/371472 [2:36:19<26:38:42,  3.53it/s]
  9%|▉         | 32697/371472 [2:36:19<27:06:18,  3.47it/s]
  9%|▉         | 32698/371472 [2:36:19<26:05:00,  3.61it/s]
  9%|▉         | 32699/371472 [2:36:19<26:30:16,  3.55it/s]
  9%|▉         | 32700/371472 [2:36:20<26:07:30,  3.60it/s]
                                                           
{'loss': 6.7009, 'learning_rate': 9.212167898467969e-07, 'epoch': 1.41}

  9%|▉         | 32700/371472 [2:36:20<26:07:30,  3.60it/s]
  9%|▉         | 32701/371472 [2:36:20<26:15:57,  3.58it/s]
  9%|▉         | 32702/371472 [2:36:20<29:08:59,  3.23it/s]
  9%|▉         | 32703/371472 [2:36:21<28:24:28,  3.31it/s]
  9%|▉         | 32704/371472 [2:36:21<27:16:59,  3.45it/s]
  9%|▉         | 32705/371472 [2:36:21<29:00:57,  3.24it/s]
  9%|▉         | 32706/371472 [2:36:21<27:23:30,  3.44it/s]
  9%|▉         | 32707/371472 [2:36:22<26:17:46,  3.58it/s]
  9%|▉         | 32708/371472 [2:36:22<25:45:17,  3.65it/s]
  9%|▉         | 32709/371472 [2:36:22<26:00:13,  3.62it/s]
  9%|▉         | 32710/371472 [2:36:23<26:29:25,  3.55it/s]
  9%|▉         | 32711/371472 [2:36:23<28:29:13,  3.30it/s]
  9%|▉         | 32712/371472 [2:36:23<27:05:00,  3.47it/s]
  9%|▉         | 32713/371472 [2:36:24<29:29:37,  3.19it/s]
  9%|▉         | 32714/371472 [2:36:24<27:43:51,  3.39it/s]
  9%|▉         | 32715/371472 [2:36:24<38:06:23,  2.47it/s]
  9%|▉         | 32716/371472 [2:36:25<34:34:59,  2.72it/s]
  9%|▉         | 32717/371472 [2:36:25<32:17:44,  2.91it/s]
  9%|▉         | 32718/371472 [2:36:25<29:50:20,  3.15it/s]
  9%|▉         | 32719/371472 [2:36:26<28:30:47,  3.30it/s]
  9%|▉         | 32720/371472 [2:36:26<27:35:58,  3.41it/s]
                                                           
{'loss': 6.4475, 'learning_rate': 9.21168307871318e-07, 'epoch': 1.41}

  9%|▉         | 32720/371472 [2:36:26<27:35:58,  3.41it/s]
  9%|▉         | 32721/371472 [2:36:26<26:43:08,  3.52it/s]
  9%|▉         | 32722/371472 [2:36:26<27:03:27,  3.48it/s]
  9%|▉         | 32723/371472 [2:36:27<26:41:55,  3.52it/s]
  9%|▉         | 32724/371472 [2:36:27<26:40:42,  3.53it/s]
  9%|▉         | 32725/371472 [2:36:27<25:52:43,  3.64it/s]
  9%|▉         | 32726/371472 [2:36:27<26:09:02,  3.60it/s]
  9%|▉         | 32727/371472 [2:36:28<26:56:25,  3.49it/s]
  9%|▉         | 32728/371472 [2:36:28<29:18:09,  3.21it/s]
  9%|▉         | 32729/371472 [2:36:28<28:43:49,  3.28it/s]
  9%|▉         | 32730/371472 [2:36:29<27:26:42,  3.43it/s]
  9%|▉         | 32731/371472 [2:36:29<29:52:43,  3.15it/s]
  9%|▉         | 32732/371472 [2:36:29<28:41:53,  3.28it/s]
  9%|▉         | 32733/371472 [2:36:30<28:33:05,  3.30it/s]
  9%|▉         | 32734/371472 [2:36:30<30:59:39,  3.04it/s]
  9%|▉         | 32735/371472 [2:36:30<29:07:08,  3.23it/s]
  9%|▉         | 32736/371472 [2:36:31<28:58:45,  3.25it/s]
  9%|▉         | 32737/371472 [2:36:31<27:18:17,  3.45it/s]
  9%|▉         | 32738/371472 [2:36:31<27:39:29,  3.40it/s]
  9%|▉         | 32739/371472 [2:36:31<26:30:31,  3.55it/s]
  9%|▉         | 32740/371472 [2:36:32<25:58:45,  3.62it/s]
                                                           
{'loss': 6.4441, 'learning_rate': 9.211198258958391e-07, 'epoch': 1.41}

  9%|▉         | 32740/371472 [2:36:32<25:58:45,  3.62it/s]
  9%|▉         | 32741/371472 [2:36:32<25:26:10,  3.70it/s]
  9%|▉         | 32742/371472 [2:36:32<25:09:44,  3.74it/s]
  9%|▉         | 32743/371472 [2:36:32<25:37:29,  3.67it/s]
  9%|▉         | 32744/371472 [2:36:33<28:49:54,  3.26it/s]
  9%|▉         | 32745/371472 [2:36:33<29:01:41,  3.24it/s]
  9%|▉         | 32746/371472 [2:36:33<28:03:03,  3.35it/s]
  9%|▉         | 32747/371472 [2:36:34<28:26:58,  3.31it/s]
  9%|▉         | 32748/371472 [2:36:34<26:50:58,  3.50it/s]
  9%|▉         | 32749/371472 [2:36:34<27:20:43,  3.44it/s]
  9%|▉         | 32750/371472 [2:36:35<27:33:02,  3.42it/s]
  9%|▉         | 32751/371472 [2:36:35<26:11:40,  3.59it/s]
  9%|▉         | 32752/371472 [2:36:35<29:48:28,  3.16it/s]
  9%|▉         | 32753/371472 [2:36:35<27:55:56,  3.37it/s]
  9%|▉         | 32754/371472 [2:36:36<28:09:48,  3.34it/s]
  9%|▉         | 32755/371472 [2:36:36<27:29:01,  3.42it/s]
  9%|▉         | 32756/371472 [2:36:36<27:12:48,  3.46it/s]
  9%|▉         | 32757/371472 [2:36:37<26:06:13,  3.60it/s]
  9%|▉         | 32758/371472 [2:36:37<25:03:32,  3.75it/s]
  9%|▉         | 32759/371472 [2:36:37<24:45:45,  3.80it/s]
  9%|▉         | 32760/371472 [2:36:37<25:21:21,  3.71it/s]
                                                           
{'loss': 6.6392, 'learning_rate': 9.210713439203602e-07, 'epoch': 1.41}

  9%|▉         | 32760/371472 [2:36:37<25:21:21,  3.71it/s]
  9%|▉         | 32761/371472 [2:36:38<25:35:19,  3.68it/s]
  9%|▉         | 32762/371472 [2:36:38<26:26:53,  3.56it/s]
  9%|▉         | 32763/371472 [2:36:38<27:11:02,  3.46it/s]
  9%|▉         | 32764/371472 [2:36:39<27:36:32,  3.41it/s]
  9%|▉         | 32765/371472 [2:36:39<26:47:08,  3.51it/s]
  9%|▉         | 32766/371472 [2:36:39<26:08:04,  3.60it/s]
  9%|▉         | 32767/371472 [2:36:39<25:55:45,  3.63it/s]
  9%|▉         | 32768/371472 [2:36:40<26:09:05,  3.60it/s]
  9%|▉         | 32769/371472 [2:36:40<28:02:47,  3.35it/s]
  9%|▉         | 32770/371472 [2:36:40<29:38:13,  3.17it/s]
  9%|▉         | 32771/371472 [2:36:41<29:01:41,  3.24it/s]
  9%|▉         | 32772/371472 [2:36:41<28:05:52,  3.35it/s]
  9%|▉         | 32773/371472 [2:36:41<28:55:30,  3.25it/s]
  9%|▉         | 32774/371472 [2:36:42<28:20:13,  3.32it/s]
  9%|▉         | 32775/371472 [2:36:42<27:44:36,  3.39it/s]
  9%|▉         | 32776/371472 [2:36:42<27:34:51,  3.41it/s]
  9%|▉         | 32777/371472 [2:36:42<26:27:29,  3.56it/s]
  9%|▉         | 32778/371472 [2:36:43<26:06:38,  3.60it/s]
  9%|▉         | 32779/371472 [2:36:43<26:34:48,  3.54it/s]
  9%|▉         | 32780/371472 [2:36:43<26:52:37,  3.50it/s]
                                                           
{'loss': 6.5847, 'learning_rate': 9.210228619448813e-07, 'epoch': 1.41}

  9%|▉         | 32780/371472 [2:36:43<26:52:37,  3.50it/s]
  9%|▉         | 32781/371472 [2:36:43<26:03:17,  3.61it/s]
  9%|▉         | 32782/371472 [2:36:44<25:20:20,  3.71it/s]
  9%|▉         | 32783/371472 [2:36:44<25:04:12,  3.75it/s]
  9%|▉         | 32784/371472 [2:36:44<25:52:37,  3.64it/s]
  9%|▉         | 32785/371472 [2:36:45<24:53:16,  3.78it/s]
  9%|▉         | 32786/371472 [2:36:45<25:52:45,  3.64it/s]
  9%|▉         | 32787/371472 [2:36:45<26:08:51,  3.60it/s]
  9%|▉         | 32788/371472 [2:36:45<25:11:24,  3.73it/s]
  9%|▉         | 32789/371472 [2:36:46<26:01:46,  3.61it/s]
  9%|▉         | 32790/371472 [2:36:46<25:13:07,  3.73it/s]
  9%|▉         | 32791/371472 [2:36:46<27:02:52,  3.48it/s]
  9%|▉         | 32792/371472 [2:36:47<27:24:31,  3.43it/s]
  9%|▉         | 32793/371472 [2:36:47<27:47:18,  3.39it/s]
  9%|▉         | 32794/371472 [2:36:47<27:39:28,  3.40it/s]
  9%|▉         | 32795/371472 [2:36:47<27:14:18,  3.45it/s]
  9%|▉         | 32796/371472 [2:36:48<27:07:23,  3.47it/s]
  9%|▉         | 32797/371472 [2:36:48<27:44:30,  3.39it/s]
  9%|▉         | 32798/371472 [2:36:48<27:23:29,  3.43it/s]
  9%|▉         | 32799/371472 [2:36:49<27:06:30,  3.47it/s]
  9%|▉         | 32800/371472 [2:36:49<26:58:26,  3.49it/s]
                                                           
{'loss': 6.5724, 'learning_rate': 9.209743799694025e-07, 'epoch': 1.41}

  9%|▉         | 32800/371472 [2:36:49<26:58:26,  3.49it/s]
  9%|▉         | 32801/371472 [2:36:49<25:49:49,  3.64it/s]
  9%|▉         | 32802/371472 [2:36:49<25:14:03,  3.73it/s]
  9%|▉         | 32803/371472 [2:36:50<26:05:06,  3.61it/s]
  9%|▉         | 32804/371472 [2:36:50<26:16:32,  3.58it/s]
  9%|▉         | 32805/371472 [2:36:50<26:08:07,  3.60it/s]
  9%|▉         | 32806/371472 [2:36:50<25:59:50,  3.62it/s]
  9%|▉         | 32807/371472 [2:36:51<25:03:29,  3.75it/s]
  9%|▉         | 32808/371472 [2:36:51<25:45:44,  3.65it/s]
  9%|▉         | 32809/371472 [2:36:51<25:41:34,  3.66it/s]
  9%|▉         | 32810/371472 [2:36:52<25:45:11,  3.65it/s]
  9%|▉         | 32811/371472 [2:36:52<25:45:49,  3.65it/s]
  9%|▉         | 32812/371472 [2:36:52<24:52:06,  3.78it/s]
  9%|▉         | 32813/371472 [2:36:52<24:39:59,  3.81it/s]
  9%|▉         | 32814/371472 [2:36:53<26:15:27,  3.58it/s]
  9%|▉         | 32815/371472 [2:36:53<29:43:07,  3.17it/s]
  9%|▉         | 32816/371472 [2:36:53<29:52:06,  3.15it/s]
  9%|▉         | 32817/371472 [2:36:54<29:02:59,  3.24it/s]
  9%|▉         | 32818/371472 [2:36:54<27:48:30,  3.38it/s]
  9%|▉         | 32819/371472 [2:36:54<29:35:16,  3.18it/s]
  9%|▉         | 32820/371472 [2:36:55<28:46:05,  3.27it/s]
                                                           
{'loss': 6.7541, 'learning_rate': 9.209258979939236e-07, 'epoch': 1.41}

  9%|▉         | 32820/371472 [2:36:55<28:46:05,  3.27it/s]
  9%|▉         | 32821/371472 [2:36:55<28:23:45,  3.31it/s]
  9%|▉         | 32822/371472 [2:36:55<26:54:31,  3.50it/s]
  9%|▉         | 32823/371472 [2:36:55<26:24:35,  3.56it/s]
  9%|▉         | 32824/371472 [2:36:56<25:35:31,  3.68it/s]
  9%|▉         | 32825/371472 [2:36:56<25:33:06,  3.68it/s]
  9%|▉         | 32826/371472 [2:36:56<25:21:52,  3.71it/s]
  9%|▉         | 32827/371472 [2:36:56<25:14:03,  3.73it/s]
  9%|▉         | 32828/371472 [2:36:57<25:08:54,  3.74it/s]
  9%|▉         | 32829/371472 [2:36:57<24:52:33,  3.78it/s]
  9%|▉         | 32830/371472 [2:36:57<25:31:46,  3.68it/s]
  9%|▉         | 32831/371472 [2:36:57<25:06:51,  3.75it/s]
  9%|▉         | 32832/371472 [2:36:58<25:17:18,  3.72it/s]
  9%|▉         | 32833/371472 [2:36:58<26:22:10,  3.57it/s]
  9%|▉         | 32834/371472 [2:36:58<26:22:10,  3.57it/s]
  9%|▉         | 32835/371472 [2:36:59<25:31:47,  3.68it/s]
  9%|▉         | 32836/371472 [2:36:59<27:48:23,  3.38it/s]
  9%|▉         | 32837/371472 [2:36:59<26:44:41,  3.52it/s]
  9%|▉         | 32838/371472 [2:36:59<26:05:47,  3.60it/s]
  9%|▉         | 32839/371472 [2:37:00<25:55:32,  3.63it/s]
  9%|▉         | 32840/371472 [2:37:00<25:49:12,  3.64it/s]
                                                           
{'loss': 6.5684, 'learning_rate': 9.208774160184446e-07, 'epoch': 1.41}

  9%|▉         | 32840/371472 [2:37:00<25:49:12,  3.64it/s]
  9%|▉         | 32841/371472 [2:37:00<25:18:01,  3.72it/s]
  9%|▉         | 32842/371472 [2:37:01<25:01:00,  3.76it/s]
  9%|▉         | 32843/371472 [2:37:01<24:47:49,  3.79it/s]
  9%|▉         | 32844/371472 [2:37:01<24:24:37,  3.85it/s]
  9%|▉         | 32845/371472 [2:37:01<24:46:11,  3.80it/s]
  9%|▉         | 32846/371472 [2:37:02<26:36:23,  3.54it/s]
  9%|▉         | 32847/371472 [2:37:02<26:24:22,  3.56it/s]
  9%|▉         | 32848/371472 [2:37:02<28:03:27,  3.35it/s]
  9%|▉         | 32849/371472 [2:37:03<27:04:09,  3.47it/s]
  9%|▉         | 32850/371472 [2:37:03<26:30:44,  3.55it/s]
  9%|▉         | 32851/371472 [2:37:03<25:48:12,  3.65it/s]
  9%|▉         | 32852/371472 [2:37:03<25:09:35,  3.74it/s]
  9%|▉         | 32853/371472 [2:37:04<25:29:26,  3.69it/s]
  9%|▉         | 32854/371472 [2:37:04<24:44:44,  3.80it/s]
  9%|▉         | 32855/371472 [2:37:04<25:44:40,  3.65it/s]
  9%|▉         | 32856/371472 [2:37:04<25:50:50,  3.64it/s]
  9%|▉         | 32857/371472 [2:37:05<25:52:14,  3.64it/s]
  9%|▉         | 32858/371472 [2:37:05<27:37:27,  3.40it/s]
  9%|▉         | 32859/371472 [2:37:05<27:14:07,  3.45it/s]
  9%|▉         | 32860/371472 [2:37:06<28:02:28,  3.35it/s]
                                                           
{'loss': 6.4602, 'learning_rate': 9.208289340429657e-07, 'epoch': 1.42}

  9%|▉         | 32860/371472 [2:37:06<28:02:28,  3.35it/s]
  9%|▉         | 32861/371472 [2:37:06<27:48:09,  3.38it/s]
  9%|▉         | 32862/371472 [2:37:06<27:28:08,  3.42it/s]
  9%|▉         | 32863/371472 [2:37:06<27:54:05,  3.37it/s]
  9%|▉         | 32864/371472 [2:37:07<28:22:12,  3.32it/s]
  9%|▉         | 32865/371472 [2:37:07<28:11:49,  3.34it/s]
  9%|▉         | 32866/371472 [2:37:07<29:37:51,  3.17it/s]
  9%|▉         | 32867/371472 [2:37:08<28:08:16,  3.34it/s]
  9%|▉         | 32868/371472 [2:37:08<27:04:40,  3.47it/s]
  9%|▉         | 32869/371472 [2:37:08<26:46:32,  3.51it/s]
  9%|▉         | 32870/371472 [2:37:09<27:04:26,  3.47it/s]
  9%|▉         | 32871/371472 [2:37:09<27:05:50,  3.47it/s]
  9%|▉         | 32872/371472 [2:37:09<27:07:01,  3.47it/s]
  9%|▉         | 32873/371472 [2:37:09<26:31:28,  3.55it/s]
  9%|▉         | 32874/371472 [2:37:10<25:27:49,  3.69it/s]
  9%|▉         | 32875/371472 [2:37:10<25:44:33,  3.65it/s]
  9%|▉         | 32876/371472 [2:37:10<25:30:45,  3.69it/s]
  9%|▉         | 32877/371472 [2:37:10<25:55:48,  3.63it/s]
  9%|▉         | 32878/371472 [2:37:11<25:32:51,  3.68it/s]
  9%|▉         | 32879/371472 [2:37:11<27:43:22,  3.39it/s]
  9%|▉         | 32880/371472 [2:37:11<26:51:15,  3.50it/s]
                                                           
{'loss': 6.7454, 'learning_rate': 9.207804520674869e-07, 'epoch': 1.42}

  9%|▉         | 32880/371472 [2:37:11<26:51:15,  3.50it/s]
  9%|▉         | 32881/371472 [2:37:12<28:55:23,  3.25it/s]
  9%|▉         | 32882/371472 [2:37:12<27:49:24,  3.38it/s]
  9%|▉         | 32883/371472 [2:37:12<26:36:22,  3.53it/s]
  9%|▉         | 32884/371472 [2:37:12<26:10:05,  3.59it/s]
  9%|▉         | 32885/371472 [2:37:13<26:02:59,  3.61it/s]
  9%|▉         | 32886/371472 [2:37:13<26:52:17,  3.50it/s]
  9%|▉         | 32887/371472 [2:37:13<26:04:47,  3.61it/s]
  9%|▉         | 32888/371472 [2:37:14<25:35:18,  3.68it/s]
  9%|▉         | 32889/371472 [2:37:14<24:59:40,  3.76it/s]
  9%|▉         | 32890/371472 [2:37:14<25:05:30,  3.75it/s]
  9%|▉         | 32891/371472 [2:37:14<26:39:51,  3.53it/s]
  9%|▉         | 32892/371472 [2:37:15<26:43:01,  3.52it/s]
  9%|▉         | 32893/371472 [2:37:15<26:30:29,  3.55it/s]
  9%|▉         | 32894/371472 [2:37:15<26:25:57,  3.56it/s]
  9%|▉         | 32895/371472 [2:37:16<28:27:50,  3.30it/s]
  9%|▉         | 32896/371472 [2:37:16<26:56:32,  3.49it/s]
  9%|▉         | 32897/371472 [2:37:16<27:50:13,  3.38it/s]
  9%|▉         | 32898/371472 [2:37:17<28:28:38,  3.30it/s]
  9%|▉         | 32899/371472 [2:37:17<27:45:44,  3.39it/s]
  9%|▉         | 32900/371472 [2:37:17<27:13:04,  3.46it/s]
                                                           
{'loss': 6.5201, 'learning_rate': 9.20731970092008e-07, 'epoch': 1.42}

  9%|▉         | 32900/371472 [2:37:17<27:13:04,  3.46it/s]
  9%|▉         | 32901/371472 [2:37:17<26:48:16,  3.51it/s]
  9%|▉         | 32902/371472 [2:37:18<28:53:51,  3.25it/s]
  9%|▉         | 32903/371472 [2:37:18<30:34:22,  3.08it/s]
  9%|▉         | 32904/371472 [2:37:18<29:24:00,  3.20it/s]
  9%|▉         | 32905/371472 [2:37:19<28:36:08,  3.29it/s]
  9%|▉         | 32906/371472 [2:37:19<27:47:30,  3.38it/s]
  9%|▉         | 32907/371472 [2:37:19<26:45:19,  3.52it/s]
  9%|▉         | 32908/371472 [2:37:19<26:14:19,  3.58it/s]
  9%|▉         | 32909/371472 [2:37:20<28:10:19,  3.34it/s]
  9%|▉         | 32910/371472 [2:37:20<27:14:23,  3.45it/s]
  9%|▉         | 32911/371472 [2:37:20<26:21:53,  3.57it/s]
  9%|▉         | 32912/371472 [2:37:21<26:56:43,  3.49it/s]
  9%|▉         | 32913/371472 [2:37:21<27:32:42,  3.41it/s]
  9%|▉         | 32914/371472 [2:37:21<27:00:11,  3.48it/s]
  9%|▉         | 32915/371472 [2:37:22<27:46:20,  3.39it/s]
  9%|▉         | 32916/371472 [2:37:22<27:27:55,  3.42it/s]
  9%|▉         | 32917/371472 [2:37:22<27:34:53,  3.41it/s]
  9%|▉         | 32918/371472 [2:37:22<26:43:02,  3.52it/s]
  9%|▉         | 32919/371472 [2:37:23<26:29:14,  3.55it/s]
  9%|▉         | 32920/371472 [2:37:23<25:55:05,  3.63it/s]
                                                           
{'loss': 6.9773, 'learning_rate': 9.206834881165291e-07, 'epoch': 1.42}

  9%|▉         | 32920/371472 [2:37:23<25:55:05,  3.63it/s]
  9%|▉         | 32921/371472 [2:37:23<25:25:53,  3.70it/s]
  9%|▉         | 32922/371472 [2:37:23<26:45:04,  3.52it/s]
  9%|▉         | 32923/371472 [2:37:24<27:05:25,  3.47it/s]
  9%|▉         | 32924/371472 [2:37:24<26:20:38,  3.57it/s]
  9%|▉         | 32925/371472 [2:37:24<26:17:17,  3.58it/s]
  9%|▉         | 32926/371472 [2:37:25<25:52:45,  3.63it/s]
  9%|▉         | 32927/371472 [2:37:25<24:45:04,  3.80it/s]
  9%|▉         | 32928/371472 [2:37:25<25:21:12,  3.71it/s]
  9%|▉         | 32929/371472 [2:37:25<26:22:01,  3.57it/s]
  9%|▉         | 32930/371472 [2:37:26<25:58:44,  3.62it/s]
  9%|▉         | 32931/371472 [2:37:26<25:35:09,  3.68it/s]
  9%|▉         | 32932/371472 [2:37:26<25:47:34,  3.65it/s]
  9%|▉         | 32933/371472 [2:37:26<25:55:33,  3.63it/s]
  9%|▉         | 32934/371472 [2:37:27<27:46:58,  3.38it/s]
  9%|▉         | 32935/371472 [2:37:27<27:13:56,  3.45it/s]
  9%|▉         | 32936/371472 [2:37:27<27:43:57,  3.39it/s]
  9%|▉         | 32937/371472 [2:37:28<26:57:23,  3.49it/s]
  9%|▉         | 32938/371472 [2:37:28<26:28:46,  3.55it/s]
  9%|▉         | 32939/371472 [2:37:28<26:42:53,  3.52it/s]
  9%|▉         | 32940/371472 [2:37:28<26:11:46,  3.59it/s]
                                                           
{'loss': 6.6975, 'learning_rate': 9.206350061410502e-07, 'epoch': 1.42}

  9%|▉         | 32940/371472 [2:37:28<26:11:46,  3.59it/s]
  9%|▉         | 32941/371472 [2:37:29<26:21:43,  3.57it/s]
  9%|▉         | 32942/371472 [2:37:29<26:06:01,  3.60it/s]
  9%|▉         | 32943/371472 [2:37:29<25:26:35,  3.70it/s]
  9%|▉         | 32944/371472 [2:37:30<25:36:54,  3.67it/s]
  9%|▉         | 32945/371472 [2:37:30<26:35:06,  3.54it/s]
  9%|▉         | 32946/371472 [2:37:30<28:29:19,  3.30it/s]
  9%|▉         | 32947/371472 [2:37:31<28:19:55,  3.32it/s]
  9%|▉         | 32948/371472 [2:37:31<28:36:59,  3.29it/s]
  9%|▉         | 32949/371472 [2:37:31<27:39:43,  3.40it/s]
  9%|▉         | 32950/371472 [2:37:31<27:08:32,  3.46it/s]
  9%|▉         | 32951/371472 [2:37:32<29:08:40,  3.23it/s]
  9%|▉         | 32952/371472 [2:37:32<28:14:12,  3.33it/s]
  9%|▉         | 32953/371472 [2:37:32<28:57:03,  3.25it/s]
  9%|▉         | 32954/371472 [2:37:33<27:12:33,  3.46it/s]
  9%|▉         | 32955/371472 [2:37:33<28:39:04,  3.28it/s]
  9%|▉         | 32956/371472 [2:37:33<27:13:50,  3.45it/s]
  9%|▉         | 32957/371472 [2:37:33<26:35:42,  3.54it/s]
  9%|▉         | 32958/371472 [2:37:34<29:30:36,  3.19it/s]
  9%|▉         | 32959/371472 [2:37:34<28:26:46,  3.31it/s]
  9%|▉         | 32960/371472 [2:37:34<28:06:02,  3.35it/s]
                                                           
{'loss': 6.451, 'learning_rate': 9.205865241655713e-07, 'epoch': 1.42}

  9%|▉         | 32960/371472 [2:37:34<28:06:02,  3.35it/s]
  9%|▉         | 32961/371472 [2:37:35<27:24:48,  3.43it/s]
  9%|▉         | 32962/371472 [2:37:35<27:13:53,  3.45it/s]
  9%|▉         | 32963/371472 [2:37:35<26:16:47,  3.58it/s]
  9%|▉         | 32964/371472 [2:37:35<25:20:35,  3.71it/s]
  9%|▉         | 32965/371472 [2:37:36<25:10:33,  3.73it/s]
  9%|▉         | 32966/371472 [2:37:36<26:14:42,  3.58it/s]
  9%|▉         | 32967/371472 [2:37:36<26:30:36,  3.55it/s]
  9%|▉         | 32968/371472 [2:37:37<25:51:03,  3.64it/s]
  9%|▉         | 32969/371472 [2:37:37<25:13:28,  3.73it/s]
  9%|▉         | 32970/371472 [2:37:37<25:00:41,  3.76it/s]
  9%|▉         | 32971/371472 [2:37:37<26:12:29,  3.59it/s]
  9%|▉         | 32972/371472 [2:37:38<26:12:31,  3.59it/s]
  9%|▉         | 32973/371472 [2:37:38<27:40:57,  3.40it/s]
  9%|▉         | 32974/371472 [2:37:38<26:51:42,  3.50it/s]
  9%|▉         | 32975/371472 [2:37:39<26:16:35,  3.58it/s]
  9%|▉         | 32976/371472 [2:37:39<25:19:00,  3.71it/s]
  9%|▉         | 32977/371472 [2:37:39<25:12:35,  3.73it/s]
  9%|▉         | 32978/371472 [2:37:39<25:02:16,  3.76it/s]
  9%|▉         | 32979/371472 [2:37:40<25:31:54,  3.68it/s]
  9%|▉         | 32980/371472 [2:37:40<27:11:53,  3.46it/s]
                                                           
{'loss': 6.311, 'learning_rate': 9.205380421900924e-07, 'epoch': 1.42}

  9%|▉         | 32980/371472 [2:37:40<27:11:53,  3.46it/s]
  9%|▉         | 32981/371472 [2:37:40<31:12:37,  3.01it/s]
  9%|▉         | 32982/371472 [2:37:41<29:40:58,  3.17it/s]
  9%|▉         | 32983/371472 [2:37:41<28:14:58,  3.33it/s]
  9%|▉         | 32984/371472 [2:37:41<27:09:46,  3.46it/s]
  9%|▉         | 32985/371472 [2:37:41<27:26:03,  3.43it/s]
  9%|▉         | 32986/371472 [2:37:42<26:24:25,  3.56it/s]
  9%|▉         | 32987/371472 [2:37:42<27:12:50,  3.45it/s]
  9%|▉         | 32988/371472 [2:37:42<31:00:08,  3.03it/s]
  9%|▉         | 32989/371472 [2:37:43<29:28:41,  3.19it/s]
  9%|▉         | 32990/371472 [2:37:43<30:04:42,  3.13it/s]
  9%|▉         | 32991/371472 [2:37:43<29:10:20,  3.22it/s]
  9%|▉         | 32992/371472 [2:37:44<28:01:37,  3.35it/s]
  9%|▉         | 32993/371472 [2:37:44<27:54:05,  3.37it/s]
  9%|▉         | 32994/371472 [2:37:44<26:52:38,  3.50it/s]
  9%|▉         | 32995/371472 [2:37:44<26:38:18,  3.53it/s]
  9%|▉         | 32996/371472 [2:37:45<27:50:10,  3.38it/s]
  9%|▉         | 32997/371472 [2:37:45<27:16:04,  3.45it/s]
  9%|▉         | 32998/371472 [2:37:45<26:28:15,  3.55it/s]
  9%|▉         | 32999/371472 [2:37:46<26:32:07,  3.54it/s]
  9%|▉         | 33000/371472 [2:37:46<26:08:45,  3.60it/s]
                                                           
{'loss': 6.6721, 'learning_rate': 9.204895602146135e-07, 'epoch': 1.42}

  9%|▉         | 33000/371472 [2:37:46<26:08:45,  3.60it/s]
  9%|▉         | 33001/371472 [2:37:46<27:25:23,  3.43it/s]
  9%|▉         | 33002/371472 [2:37:47<28:20:57,  3.32it/s]
  9%|▉         | 33003/371472 [2:37:47<28:00:14,  3.36it/s]
  9%|▉         | 33004/371472 [2:37:47<27:18:49,  3.44it/s]
  9%|▉         | 33005/371472 [2:37:47<26:44:17,  3.52it/s]
  9%|▉         | 33006/371472 [2:37:48<25:25:13,  3.70it/s]
  9%|▉         | 33007/371472 [2:37:48<26:18:11,  3.57it/s]
  9%|▉         | 33008/371472 [2:37:48<26:13:00,  3.59it/s]
  9%|▉         | 33009/371472 [2:37:49<27:28:39,  3.42it/s]
  9%|▉         | 33010/371472 [2:37:49<26:45:59,  3.51it/s]
  9%|▉         | 33011/371472 [2:37:49<25:49:27,  3.64it/s]
  9%|▉         | 33012/371472 [2:37:49<26:34:16,  3.54it/s]
  9%|▉         | 33013/371472 [2:37:50<25:45:13,  3.65it/s]
  9%|▉         | 33014/371472 [2:37:50<25:08:30,  3.74it/s]
  9%|▉         | 33015/371472 [2:37:50<27:01:24,  3.48it/s]
  9%|▉         | 33016/371472 [2:37:50<26:25:25,  3.56it/s]
  9%|▉         | 33017/371472 [2:37:51<26:16:54,  3.58it/s]
  9%|▉         | 33018/371472 [2:37:51<28:36:24,  3.29it/s]
  9%|▉         | 33019/371472 [2:37:51<27:26:56,  3.43it/s]
  9%|▉         | 33020/371472 [2:37:52<26:22:47,  3.56it/s]
                                                           
{'loss': 6.5873, 'learning_rate': 9.204410782391346e-07, 'epoch': 1.42}

  9%|▉         | 33020/371472 [2:37:52<26:22:47,  3.56it/s]
  9%|▉         | 33021/371472 [2:37:52<25:54:41,  3.63it/s]
  9%|▉         | 33022/371472 [2:37:52<25:19:13,  3.71it/s]
  9%|▉         | 33023/371472 [2:37:52<25:05:34,  3.75it/s]
  9%|▉         | 33024/371472 [2:37:53<27:36:25,  3.41it/s]
  9%|▉         | 33025/371472 [2:37:53<28:33:21,  3.29it/s]
  9%|▉         | 33026/371472 [2:37:53<27:54:04,  3.37it/s]
  9%|▉         | 33027/371472 [2:37:54<28:00:56,  3.36it/s]
  9%|▉         | 33028/371472 [2:37:54<27:22:49,  3.43it/s]
  9%|▉         | 33029/371472 [2:37:54<26:19:14,  3.57it/s]
  9%|▉         | 33030/371472 [2:37:54<25:10:14,  3.73it/s]
  9%|▉         | 33031/371472 [2:37:55<31:40:11,  2.97it/s]
  9%|▉         | 33032/371472 [2:37:55<30:59:32,  3.03it/s]
  9%|▉         | 33033/371472 [2:37:55<29:10:24,  3.22it/s]
  9%|▉         | 33034/371472 [2:37:56<28:24:20,  3.31it/s]
  9%|▉         | 33035/371472 [2:37:56<28:06:31,  3.34it/s]
  9%|▉         | 33036/371472 [2:37:56<27:40:23,  3.40it/s]
  9%|▉         | 33037/371472 [2:37:57<28:04:51,  3.35it/s]
  9%|▉         | 33038/371472 [2:37:57<27:18:31,  3.44it/s]
  9%|▉         | 33039/371472 [2:37:57<29:22:37,  3.20it/s]
  9%|▉         | 33040/371472 [2:37:58<28:42:13,  3.28it/s]
                                                           
{'loss': 6.7574, 'learning_rate': 9.203925962636556e-07, 'epoch': 1.42}

  9%|▉         | 33040/371472 [2:37:58<28:42:13,  3.28it/s]
  9%|▉         | 33041/371472 [2:37:58<27:30:51,  3.42it/s]
  9%|▉         | 33042/371472 [2:37:58<26:30:38,  3.55it/s]
  9%|▉         | 33043/371472 [2:37:58<27:33:05,  3.41it/s]
  9%|▉         | 33044/371472 [2:37:59<27:18:43,  3.44it/s]
  9%|▉         | 33045/371472 [2:37:59<28:00:38,  3.36it/s]
  9%|▉         | 33046/371472 [2:37:59<27:11:43,  3.46it/s]
  9%|▉         | 33047/371472 [2:38:00<27:10:13,  3.46it/s]
  9%|▉         | 33048/371472 [2:38:00<28:06:18,  3.34it/s]
  9%|▉         | 33049/371472 [2:38:00<29:05:25,  3.23it/s]
  9%|▉         | 33050/371472 [2:38:01<29:31:27,  3.18it/s]
  9%|▉         | 33051/371472 [2:38:01<29:04:06,  3.23it/s]
  9%|▉         | 33052/371472 [2:38:01<28:08:14,  3.34it/s]
  9%|▉         | 33053/371472 [2:38:01<28:25:45,  3.31it/s]
  9%|▉         | 33054/371472 [2:38:02<27:23:34,  3.43it/s]
  9%|▉         | 33055/371472 [2:38:02<26:47:20,  3.51it/s]
  9%|▉         | 33056/371472 [2:38:02<27:45:09,  3.39it/s]
  9%|▉         | 33057/371472 [2:38:03<27:10:11,  3.46it/s]
  9%|▉         | 33058/371472 [2:38:03<29:21:50,  3.20it/s]
  9%|▉         | 33059/371472 [2:38:03<28:12:01,  3.33it/s]
  9%|▉         | 33060/371472 [2:38:03<27:14:59,  3.45it/s]
                                                           
{'loss': 6.7247, 'learning_rate': 9.203441142881769e-07, 'epoch': 1.42}

  9%|▉         | 33060/371472 [2:38:03<27:14:59,  3.45it/s]
  9%|▉         | 33061/371472 [2:38:04<26:23:24,  3.56it/s]
  9%|▉         | 33062/371472 [2:38:04<26:08:40,  3.60it/s]
  9%|▉         | 33063/371472 [2:38:04<26:19:08,  3.57it/s]
  9%|▉         | 33064/371472 [2:38:05<25:45:39,  3.65it/s]
  9%|▉         | 33065/371472 [2:38:05<25:26:58,  3.69it/s]
  9%|▉         | 33066/371472 [2:38:05<27:57:56,  3.36it/s]
  9%|▉         | 33067/371472 [2:38:06<32:00:52,  2.94it/s]
  9%|▉         | 33068/371472 [2:38:06<30:12:04,  3.11it/s]
  9%|▉         | 33069/371472 [2:38:06<30:29:28,  3.08it/s]
  9%|▉         | 33070/371472 [2:38:06<29:15:29,  3.21it/s]
  9%|▉         | 33071/371472 [2:38:07<28:38:57,  3.28it/s]
  9%|▉         | 33072/371472 [2:38:07<30:52:39,  3.04it/s]
  9%|▉         | 33073/371472 [2:38:08<33:10:32,  2.83it/s]
  9%|▉         | 33074/371472 [2:38:08<30:44:04,  3.06it/s]
  9%|▉         | 33075/371472 [2:38:08<29:22:15,  3.20it/s]
  9%|▉         | 33076/371472 [2:38:08<28:59:22,  3.24it/s]
  9%|▉         | 33077/371472 [2:38:09<28:46:57,  3.27it/s]
  9%|▉         | 33078/371472 [2:38:09<29:20:41,  3.20it/s]
  9%|▉         | 33079/371472 [2:38:09<27:36:41,  3.40it/s]
  9%|▉         | 33080/371472 [2:38:10<27:00:35,  3.48it/s]
                                                           
{'loss': 6.7455, 'learning_rate': 9.20295632312698e-07, 'epoch': 1.42}

  9%|▉         | 33080/371472 [2:38:10<27:00:35,  3.48it/s]
  9%|▉         | 33081/371472 [2:38:10<30:31:19,  3.08it/s]
  9%|▉         | 33082/371472 [2:38:10<30:02:23,  3.13it/s]
  9%|▉         | 33083/371472 [2:38:11<29:22:43,  3.20it/s]
  9%|▉         | 33084/371472 [2:38:11<30:24:19,  3.09it/s]
  9%|▉         | 33085/371472 [2:38:11<29:05:53,  3.23it/s]
  9%|▉         | 33086/371472 [2:38:11<28:36:44,  3.29it/s]
  9%|▉         | 33087/371472 [2:38:12<27:12:20,  3.45it/s]
  9%|▉         | 33088/371472 [2:38:12<29:17:33,  3.21it/s]
  9%|▉         | 33089/371472 [2:38:12<28:13:46,  3.33it/s]
  9%|▉         | 33090/371472 [2:38:13<26:58:02,  3.49it/s]
  9%|▉         | 33091/371472 [2:38:13<26:57:28,  3.49it/s]
  9%|▉         | 33092/371472 [2:38:13<27:04:51,  3.47it/s]
  9%|▉         | 33093/371472 [2:38:13<26:44:22,  3.52it/s]
  9%|▉         | 33094/371472 [2:38:14<26:48:43,  3.51it/s]
  9%|▉         | 33095/371472 [2:38:14<26:32:21,  3.54it/s]
  9%|▉         | 33096/371472 [2:38:14<26:25:35,  3.56it/s]
  9%|▉         | 33097/371472 [2:38:15<26:30:17,  3.55it/s]
  9%|▉         | 33098/371472 [2:38:15<26:31:48,  3.54it/s]
  9%|▉         | 33099/371472 [2:38:15<27:01:43,  3.48it/s]
  9%|▉         | 33100/371472 [2:38:16<27:31:26,  3.41it/s]
                                                           
{'loss': 6.559, 'learning_rate': 9.20247150337219e-07, 'epoch': 1.43}

  9%|▉         | 33100/371472 [2:38:16<27:31:26,  3.41it/s]
  9%|▉         | 33101/371472 [2:38:16<26:29:17,  3.55it/s]
  9%|▉         | 33102/371472 [2:38:16<26:26:15,  3.56it/s]
  9%|▉         | 33103/371472 [2:38:16<25:59:38,  3.62it/s]
  9%|▉         | 33104/371472 [2:38:17<25:58:04,  3.62it/s]
  9%|▉         | 33105/371472 [2:38:17<25:21:49,  3.71it/s]
  9%|▉         | 33106/371472 [2:38:17<26:33:09,  3.54it/s]
  9%|▉         | 33107/371472 [2:38:17<26:28:53,  3.55it/s]
  9%|▉         | 33108/371472 [2:38:18<26:59:20,  3.48it/s]
  9%|▉         | 33109/371472 [2:38:18<27:07:34,  3.46it/s]
  9%|▉         | 33110/371472 [2:38:18<27:30:04,  3.42it/s]
  9%|▉         | 33111/371472 [2:38:19<28:29:37,  3.30it/s]
  9%|▉         | 33112/371472 [2:38:19<27:33:01,  3.41it/s]
  9%|▉         | 33113/371472 [2:38:19<26:28:21,  3.55it/s]
  9%|▉         | 33114/371472 [2:38:19<27:15:29,  3.45it/s]
  9%|▉         | 33115/371472 [2:38:20<26:38:04,  3.53it/s]
  9%|▉         | 33116/371472 [2:38:20<26:51:33,  3.50it/s]
  9%|▉         | 33117/371472 [2:38:20<27:36:09,  3.41it/s]
  9%|▉         | 33118/371472 [2:38:21<27:58:10,  3.36it/s]
  9%|▉         | 33119/371472 [2:38:21<27:28:40,  3.42it/s]
  9%|▉         | 33120/371472 [2:38:21<26:48:23,  3.51it/s]
                                                           
{'loss': 6.2385, 'learning_rate': 9.201986683617401e-07, 'epoch': 1.43}

  9%|▉         | 33120/371472 [2:38:21<26:48:23,  3.51it/s]
  9%|▉         | 33121/371472 [2:38:21<25:33:39,  3.68it/s]
  9%|▉         | 33122/371472 [2:38:22<26:01:30,  3.61it/s]
  9%|▉         | 33123/371472 [2:38:22<25:11:03,  3.73it/s]
  9%|▉         | 33124/371472 [2:38:22<26:29:39,  3.55it/s]
  9%|▉         | 33125/371472 [2:38:23<26:56:42,  3.49it/s]
  9%|▉         | 33126/371472 [2:38:23<27:11:44,  3.46it/s]
  9%|▉         | 33127/371472 [2:38:23<26:20:14,  3.57it/s]
  9%|▉         | 33128/371472 [2:38:23<26:52:07,  3.50it/s]
  9%|▉         | 33129/371472 [2:38:24<27:11:24,  3.46it/s]
  9%|▉         | 33130/371472 [2:38:24<30:00:06,  3.13it/s]
  9%|▉         | 33131/371472 [2:38:24<29:54:28,  3.14it/s]
  9%|▉         | 33132/371472 [2:38:25<28:35:33,  3.29it/s]
  9%|▉         | 33133/371472 [2:38:25<29:23:55,  3.20it/s]
  9%|▉         | 33134/371472 [2:38:25<27:49:16,  3.38it/s]
  9%|▉         | 33135/371472 [2:38:26<28:16:53,  3.32it/s]
  9%|▉         | 33136/371472 [2:38:26<28:00:24,  3.36it/s]
  9%|▉         | 33137/371472 [2:38:26<28:21:54,  3.31it/s]
  9%|▉         | 33138/371472 [2:38:27<28:30:46,  3.30it/s]
  9%|▉         | 33139/371472 [2:38:27<31:41:26,  2.97it/s]
  9%|▉         | 33140/371472 [2:38:27<31:23:06,  2.99it/s]
                                                           
{'loss': 6.4429, 'learning_rate': 9.201501863862613e-07, 'epoch': 1.43}

  9%|▉         | 33140/371472 [2:38:27<31:23:06,  2.99it/s]
  9%|▉         | 33141/371472 [2:38:28<29:48:14,  3.15it/s]
  9%|▉         | 33142/371472 [2:38:28<28:26:40,  3.30it/s]
  9%|▉         | 33143/371472 [2:38:28<27:37:31,  3.40it/s]
  9%|▉         | 33144/371472 [2:38:28<29:36:03,  3.17it/s]
  9%|▉         | 33145/371472 [2:38:29<28:37:42,  3.28it/s]
  9%|▉         | 33146/371472 [2:38:29<27:40:46,  3.40it/s]
  9%|▉         | 33147/371472 [2:38:29<26:32:29,  3.54it/s]
  9%|▉         | 33148/371472 [2:38:30<27:13:49,  3.45it/s]
  9%|▉         | 33149/371472 [2:38:30<26:58:59,  3.48it/s]
  9%|▉         | 33150/371472 [2:38:30<27:01:54,  3.48it/s]
  9%|▉         | 33151/371472 [2:38:30<26:51:23,  3.50it/s]
  9%|▉         | 33152/371472 [2:38:31<30:40:09,  3.06it/s]
  9%|▉         | 33153/371472 [2:38:31<32:45:07,  2.87it/s]
  9%|▉         | 33154/371472 [2:38:32<30:48:32,  3.05it/s]
  9%|▉         | 33155/371472 [2:38:32<28:53:42,  3.25it/s]
  9%|▉         | 33156/371472 [2:38:32<29:26:30,  3.19it/s]
  9%|▉         | 33157/371472 [2:38:32<29:24:38,  3.20it/s]
  9%|▉         | 33158/371472 [2:38:33<27:34:31,  3.41it/s]
  9%|▉         | 33159/371472 [2:38:33<27:22:56,  3.43it/s]
  9%|▉         | 33160/371472 [2:38:33<27:18:31,  3.44it/s]
                                                           
{'loss': 6.7354, 'learning_rate': 9.201017044107823e-07, 'epoch': 1.43}

  9%|▉         | 33160/371472 [2:38:33<27:18:31,  3.44it/s]
  9%|▉         | 33161/371472 [2:38:34<27:54:21,  3.37it/s]
  9%|▉         | 33162/371472 [2:38:34<28:12:22,  3.33it/s]
  9%|▉         | 33163/371472 [2:38:34<29:45:46,  3.16it/s]
  9%|▉         | 33164/371472 [2:38:35<31:20:16,  3.00it/s]
  9%|▉         | 33165/371472 [2:38:35<30:24:51,  3.09it/s]
  9%|▉         | 33166/371472 [2:38:35<30:37:16,  3.07it/s]
  9%|▉         | 33167/371472 [2:38:36<28:58:50,  3.24it/s]
  9%|▉         | 33168/371472 [2:38:36<30:03:37,  3.13it/s]
  9%|▉         | 33169/371472 [2:38:36<29:22:46,  3.20it/s]
  9%|▉         | 33170/371472 [2:38:36<28:28:00,  3.30it/s]
  9%|▉         | 33171/371472 [2:38:37<28:59:13,  3.24it/s]
  9%|▉         | 33172/371472 [2:38:37<28:53:54,  3.25it/s]
  9%|▉         | 33173/371472 [2:38:37<30:24:24,  3.09it/s]
  9%|▉         | 33174/371472 [2:38:38<28:43:04,  3.27it/s]
  9%|▉         | 33175/371472 [2:38:38<29:27:20,  3.19it/s]
  9%|▉         | 33176/371472 [2:38:38<29:09:17,  3.22it/s]
  9%|▉         | 33177/371472 [2:38:39<27:59:20,  3.36it/s]
  9%|▉         | 33178/371472 [2:38:39<26:38:45,  3.53it/s]
  9%|▉         | 33179/371472 [2:38:39<25:38:32,  3.66it/s]
  9%|▉         | 33180/371472 [2:38:39<28:50:15,  3.26it/s]
                                                           
{'loss': 6.3568, 'learning_rate': 9.200532224353035e-07, 'epoch': 1.43}

  9%|▉         | 33180/371472 [2:38:39<28:50:15,  3.26it/s]
  9%|▉         | 33181/371472 [2:38:40<28:02:34,  3.35it/s]
  9%|▉         | 33182/371472 [2:38:40<28:24:54,  3.31it/s]
  9%|▉         | 33183/371472 [2:38:40<28:56:47,  3.25it/s]
  9%|▉         | 33184/371472 [2:38:41<29:19:13,  3.20it/s]
  9%|▉         | 33185/371472 [2:38:41<28:07:11,  3.34it/s]
  9%|▉         | 33186/371472 [2:38:41<32:04:32,  2.93it/s]
  9%|▉         | 33187/371472 [2:38:42<31:48:43,  2.95it/s]
  9%|▉         | 33188/371472 [2:38:42<30:15:39,  3.11it/s]
  9%|▉         | 33189/371472 [2:38:42<28:06:24,  3.34it/s]
  9%|▉         | 33190/371472 [2:38:43<27:48:32,  3.38it/s]
  9%|▉         | 33191/371472 [2:38:43<27:09:46,  3.46it/s]
  9%|▉         | 33192/371472 [2:38:43<25:58:08,  3.62it/s]
  9%|▉         | 33193/371472 [2:38:43<26:18:18,  3.57it/s]
  9%|▉         | 33194/371472 [2:38:44<25:28:17,  3.69it/s]
  9%|▉         | 33195/371472 [2:38:44<25:56:33,  3.62it/s]
  9%|▉         | 33196/371472 [2:38:44<24:58:08,  3.76it/s]
  9%|▉         | 33197/371472 [2:38:44<24:43:52,  3.80it/s]
  9%|▉         | 33198/371472 [2:38:45<27:18:16,  3.44it/s]
  9%|▉         | 33199/371472 [2:38:45<26:41:51,  3.52it/s]
  9%|▉         | 33200/371472 [2:38:45<27:46:41,  3.38it/s]
                                                           
{'loss': 6.4991, 'learning_rate': 9.200047404598246e-07, 'epoch': 1.43}

  9%|▉         | 33200/371472 [2:38:45<27:46:41,  3.38it/s]
  9%|▉         | 33201/371472 [2:38:46<28:49:33,  3.26it/s]
  9%|▉         | 33202/371472 [2:38:46<27:36:18,  3.40it/s]
  9%|▉         | 33203/371472 [2:38:47<36:38:31,  2.56it/s]
  9%|▉         | 33204/371472 [2:38:47<33:03:01,  2.84it/s]
  9%|▉         | 33205/371472 [2:38:47<31:16:26,  3.00it/s]
  9%|▉         | 33206/371472 [2:38:47<29:16:43,  3.21it/s]
  9%|▉         | 33207/371472 [2:38:48<27:30:24,  3.42it/s]
  9%|▉         | 33208/371472 [2:38:48<27:02:20,  3.48it/s]
  9%|▉         | 33209/371472 [2:38:48<26:14:42,  3.58it/s]
  9%|▉         | 33210/371472 [2:38:48<27:57:49,  3.36it/s]
  9%|▉         | 33211/371472 [2:38:49<28:04:11,  3.35it/s]
  9%|▉         | 33212/371472 [2:38:49<27:13:14,  3.45it/s]
  9%|▉         | 33213/371472 [2:38:49<27:12:56,  3.45it/s]
  9%|▉         | 33214/371472 [2:38:50<27:19:10,  3.44it/s]
  9%|▉         | 33215/371472 [2:38:50<26:55:12,  3.49it/s]
  9%|▉         | 33216/371472 [2:38:50<31:20:26,  3.00it/s]
  9%|▉         | 33217/371472 [2:38:51<29:39:36,  3.17it/s]
  9%|▉         | 33218/371472 [2:38:51<28:41:34,  3.27it/s]
  9%|▉         | 33219/371472 [2:38:51<28:10:35,  3.33it/s]
  9%|▉         | 33220/371472 [2:38:52<27:55:42,  3.36it/s]
                                                           
{'loss': 6.6018, 'learning_rate': 9.199562584843456e-07, 'epoch': 1.43}

  9%|▉         | 33220/371472 [2:38:52<27:55:42,  3.36it/s]
  9%|▉         | 33221/371472 [2:38:52<29:01:53,  3.24it/s]
  9%|▉         | 33222/371472 [2:38:52<28:04:11,  3.35it/s]
  9%|▉         | 33223/371472 [2:38:52<28:34:03,  3.29it/s]
  9%|▉         | 33224/371472 [2:38:53<27:19:08,  3.44it/s]
  9%|▉         | 33225/371472 [2:38:53<27:16:27,  3.44it/s]
  9%|▉         | 33226/371472 [2:38:53<27:29:11,  3.42it/s]
  9%|▉         | 33227/371472 [2:38:54<27:23:23,  3.43it/s]
  9%|▉         | 33228/371472 [2:38:54<27:48:47,  3.38it/s]
  9%|▉         | 33229/371472 [2:38:54<29:51:11,  3.15it/s]
  9%|▉         | 33230/371472 [2:38:55<28:22:07,  3.31it/s]
  9%|▉         | 33231/371472 [2:38:55<27:22:36,  3.43it/s]
  9%|▉         | 33232/371472 [2:38:55<26:48:00,  3.51it/s]
  9%|▉         | 33233/371472 [2:38:55<26:44:20,  3.51it/s]
  9%|▉         | 33234/371472 [2:38:56<25:56:11,  3.62it/s]
  9%|▉         | 33235/371472 [2:38:56<25:25:54,  3.69it/s]
  9%|▉         | 33236/371472 [2:38:56<24:49:36,  3.78it/s]
  9%|▉         | 33237/371472 [2:38:56<24:36:13,  3.82it/s]
  9%|▉         | 33238/371472 [2:38:57<25:46:11,  3.65it/s]
  9%|▉         | 33239/371472 [2:38:57<25:11:52,  3.73it/s]
  9%|▉         | 33240/371472 [2:38:57<24:33:39,  3.83it/s]
                                                           
{'loss': 6.5083, 'learning_rate': 9.199077765088667e-07, 'epoch': 1.43}

  9%|▉         | 33240/371472 [2:38:57<24:33:39,  3.83it/s]
  9%|▉         | 33241/371472 [2:38:57<24:40:44,  3.81it/s]
  9%|▉         | 33242/371472 [2:38:58<25:04:34,  3.75it/s]
  9%|▉         | 33243/371472 [2:38:58<24:49:18,  3.79it/s]
  9%|▉         | 33244/371472 [2:38:58<26:00:02,  3.61it/s]
  9%|▉         | 33245/371472 [2:38:59<26:17:19,  3.57it/s]
  9%|▉         | 33246/371472 [2:38:59<25:30:44,  3.68it/s]
  9%|▉         | 33247/371472 [2:38:59<27:01:14,  3.48it/s]
  9%|▉         | 33248/371472 [2:38:59<26:13:24,  3.58it/s]
  9%|▉         | 33249/371472 [2:39:00<27:51:32,  3.37it/s]
  9%|▉         | 33250/371472 [2:39:00<28:57:13,  3.24it/s]
  9%|▉         | 33251/371472 [2:39:00<27:20:17,  3.44it/s]
  9%|▉         | 33252/371472 [2:39:01<27:12:58,  3.45it/s]
  9%|▉         | 33253/371472 [2:39:01<27:04:01,  3.47it/s]
  9%|▉         | 33254/371472 [2:39:01<26:41:27,  3.52it/s]
  9%|▉         | 33255/371472 [2:39:01<26:09:53,  3.59it/s]
  9%|▉         | 33256/371472 [2:39:02<26:12:37,  3.58it/s]
  9%|▉         | 33257/371472 [2:39:02<25:55:02,  3.62it/s]
  9%|▉         | 33258/371472 [2:39:02<25:37:03,  3.67it/s]
  9%|▉         | 33259/371472 [2:39:03<25:57:11,  3.62it/s]
  9%|▉         | 33260/371472 [2:39:03<26:01:02,  3.61it/s]
                                                           
{'loss': 6.408, 'learning_rate': 9.198592945333879e-07, 'epoch': 1.43}

  9%|▉         | 33260/371472 [2:39:03<26:01:02,  3.61it/s]
  9%|▉         | 33261/371472 [2:39:03<24:58:25,  3.76it/s]
  9%|▉         | 33262/371472 [2:39:03<26:10:26,  3.59it/s]
  9%|▉         | 33263/371472 [2:39:04<25:30:52,  3.68it/s]
  9%|▉         | 33264/371472 [2:39:04<27:21:50,  3.43it/s]
  9%|▉         | 33265/371472 [2:39:04<26:12:51,  3.58it/s]
  9%|▉         | 33266/371472 [2:39:04<25:30:48,  3.68it/s]
  9%|▉         | 33267/371472 [2:39:05<26:27:58,  3.55it/s]
  9%|▉         | 33268/371472 [2:39:05<26:13:35,  3.58it/s]
  9%|▉         | 33269/371472 [2:39:05<27:05:38,  3.47it/s]
  9%|▉         | 33270/371472 [2:39:06<26:56:07,  3.49it/s]
  9%|▉         | 33271/371472 [2:39:06<27:27:31,  3.42it/s]
  9%|▉         | 33272/371472 [2:39:06<26:10:44,  3.59it/s]
  9%|▉         | 33273/371472 [2:39:06<27:11:00,  3.46it/s]
  9%|▉         | 33274/371472 [2:39:07<26:50:02,  3.50it/s]
  9%|▉         | 33275/371472 [2:39:07<28:04:13,  3.35it/s]
  9%|▉         | 33276/371472 [2:39:07<27:27:09,  3.42it/s]
  9%|▉         | 33277/371472 [2:39:08<26:58:12,  3.48it/s]
  9%|▉         | 33278/371472 [2:39:08<27:15:50,  3.45it/s]
  9%|▉         | 33279/371472 [2:39:08<26:10:30,  3.59it/s]
  9%|▉         | 33280/371472 [2:39:08<26:35:45,  3.53it/s]
                                                           
{'loss': 6.7178, 'learning_rate': 9.19810812557909e-07, 'epoch': 1.43}

  9%|▉         | 33280/371472 [2:39:08<26:35:45,  3.53it/s]
  9%|▉         | 33281/371472 [2:39:09<25:57:15,  3.62it/s]
  9%|▉         | 33282/371472 [2:39:09<27:19:36,  3.44it/s]
  9%|▉         | 33283/371472 [2:39:09<27:31:50,  3.41it/s]
  9%|▉         | 33284/371472 [2:39:10<27:26:57,  3.42it/s]
  9%|▉         | 33285/371472 [2:39:10<27:39:42,  3.40it/s]
  9%|▉         | 33286/371472 [2:39:10<27:32:01,  3.41it/s]
  9%|▉         | 33287/371472 [2:39:11<27:51:23,  3.37it/s]
  9%|▉         | 33288/371472 [2:39:11<29:33:54,  3.18it/s]
  9%|▉         | 33289/371472 [2:39:11<28:44:07,  3.27it/s]
  9%|▉         | 33290/371472 [2:39:11<27:46:51,  3.38it/s]
  9%|▉         | 33291/371472 [2:39:12<28:06:16,  3.34it/s]
  9%|▉         | 33292/371472 [2:39:12<26:42:31,  3.52it/s]
  9%|▉         | 33293/371472 [2:39:12<27:04:00,  3.47it/s]
  9%|▉         | 33294/371472 [2:39:13<26:52:26,  3.50it/s]
  9%|▉         | 33295/371472 [2:39:13<26:23:41,  3.56it/s]
  9%|▉         | 33296/371472 [2:39:13<25:24:15,  3.70it/s]
  9%|▉         | 33297/371472 [2:39:13<26:22:54,  3.56it/s]
  9%|▉         | 33298/371472 [2:39:14<27:08:59,  3.46it/s]
  9%|▉         | 33299/371472 [2:39:14<27:25:23,  3.43it/s]
  9%|▉         | 33300/371472 [2:39:14<27:03:12,  3.47it/s]
                                                           
{'loss': 6.3813, 'learning_rate': 9.197623305824301e-07, 'epoch': 1.43}

  9%|▉         | 33300/371472 [2:39:14<27:03:12,  3.47it/s]
  9%|▉         | 33301/371472 [2:39:15<26:42:34,  3.52it/s]
  9%|▉         | 33302/371472 [2:39:15<26:21:26,  3.56it/s]
  9%|▉         | 33303/371472 [2:39:15<25:50:50,  3.63it/s]
  9%|▉         | 33304/371472 [2:39:15<25:10:51,  3.73it/s]
  9%|▉         | 33305/371472 [2:39:16<25:18:19,  3.71it/s]
  9%|▉         | 33306/371472 [2:39:16<26:33:52,  3.54it/s]
  9%|▉         | 33307/371472 [2:39:16<26:34:19,  3.54it/s]
  9%|▉         | 33308/371472 [2:39:17<26:22:23,  3.56it/s]
  9%|▉         | 33309/371472 [2:39:17<27:50:56,  3.37it/s]
  9%|▉         | 33310/371472 [2:39:17<27:12:27,  3.45it/s]
  9%|▉         | 33311/371472 [2:39:17<28:45:20,  3.27it/s]
  9%|▉         | 33312/371472 [2:39:18<27:37:25,  3.40it/s]
  9%|▉         | 33313/371472 [2:39:18<26:45:11,  3.51it/s]
  9%|▉         | 33314/371472 [2:39:18<27:19:58,  3.44it/s]
  9%|▉         | 33315/371472 [2:39:19<26:10:11,  3.59it/s]
  9%|▉         | 33316/371472 [2:39:19<26:24:58,  3.56it/s]
  9%|▉         | 33317/371472 [2:39:19<26:13:22,  3.58it/s]
  9%|▉         | 33318/371472 [2:39:19<25:20:04,  3.71it/s]
  9%|▉         | 33319/371472 [2:39:20<25:16:09,  3.72it/s]
  9%|▉         | 33320/371472 [2:39:20<25:34:25,  3.67it/s]
                                                           
{'loss': 6.601, 'learning_rate': 9.197138486069512e-07, 'epoch': 1.44}

  9%|▉         | 33320/371472 [2:39:20<25:34:25,  3.67it/s]
  9%|▉         | 33321/371472 [2:39:20<25:32:20,  3.68it/s]
  9%|▉         | 33322/371472 [2:39:21<28:35:38,  3.28it/s]
  9%|▉         | 33323/371472 [2:39:21<27:07:25,  3.46it/s]
  9%|▉         | 33324/371472 [2:39:21<26:36:14,  3.53it/s]
  9%|▉         | 33325/371472 [2:39:21<26:26:51,  3.55it/s]
  9%|▉         | 33326/371472 [2:39:22<35:06:16,  2.68it/s]
  9%|▉         | 33327/371472 [2:39:22<31:43:23,  2.96it/s]
  9%|▉         | 33328/371472 [2:39:22<30:33:03,  3.07it/s]
  9%|▉         | 33329/371472 [2:39:23<29:01:50,  3.24it/s]
  9%|▉         | 33330/371472 [2:39:23<28:44:29,  3.27it/s]
  9%|▉         | 33331/371472 [2:39:23<28:13:24,  3.33it/s]
  9%|▉         | 33332/371472 [2:39:24<28:31:45,  3.29it/s]
  9%|▉         | 33333/371472 [2:39:24<28:09:39,  3.34it/s]
  9%|▉         | 33334/371472 [2:39:24<27:08:41,  3.46it/s]
  9%|▉         | 33335/371472 [2:39:24<26:34:06,  3.54it/s]
  9%|▉         | 33336/371472 [2:39:25<26:21:19,  3.56it/s]
  9%|▉         | 33337/371472 [2:39:25<26:06:18,  3.60it/s]
  9%|▉         | 33338/371472 [2:39:25<25:13:20,  3.72it/s]
  9%|▉         | 33339/371472 [2:39:26<26:23:44,  3.56it/s]
  9%|▉         | 33340/371472 [2:39:26<26:14:19,  3.58it/s]
                                                           
{'loss': 6.7897, 'learning_rate': 9.196653666314724e-07, 'epoch': 1.44}

  9%|▉         | 33340/371472 [2:39:26<26:14:19,  3.58it/s]
  9%|▉         | 33341/371472 [2:39:26<26:21:48,  3.56it/s]
  9%|▉         | 33342/371472 [2:39:26<26:21:45,  3.56it/s]
  9%|▉         | 33343/371472 [2:39:27<26:37:42,  3.53it/s]
  9%|▉         | 33344/371472 [2:39:27<27:20:05,  3.44it/s]
  9%|▉         | 33345/371472 [2:39:27<26:01:39,  3.61it/s]
  9%|▉         | 33346/371472 [2:39:28<29:01:53,  3.24it/s]
  9%|▉         | 33347/371472 [2:39:28<27:35:40,  3.40it/s]
  9%|▉         | 33348/371472 [2:39:28<28:08:58,  3.34it/s]
  9%|▉         | 33349/371472 [2:39:28<26:25:40,  3.55it/s]
  9%|▉         | 33350/371472 [2:39:29<26:20:47,  3.56it/s]
  9%|▉         | 33351/371472 [2:39:29<27:34:22,  3.41it/s]
  9%|▉         | 33352/371472 [2:39:29<26:44:49,  3.51it/s]
  9%|▉         | 33353/371472 [2:39:30<26:12:19,  3.58it/s]
  9%|▉         | 33354/371472 [2:39:30<26:29:12,  3.55it/s]
  9%|▉         | 33355/371472 [2:39:30<25:26:52,  3.69it/s]
  9%|▉         | 33356/371472 [2:39:30<25:38:53,  3.66it/s]
  9%|▉         | 33357/371472 [2:39:31<27:44:28,  3.39it/s]
  9%|▉         | 33358/371472 [2:39:31<26:55:04,  3.49it/s]
  9%|▉         | 33359/371472 [2:39:31<26:13:46,  3.58it/s]
  9%|▉         | 33360/371472 [2:39:32<27:25:16,  3.43it/s]
                                                           
{'loss': 6.7652, 'learning_rate': 9.196168846559933e-07, 'epoch': 1.44}

  9%|▉         | 33360/371472 [2:39:32<27:25:16,  3.43it/s]
  9%|▉         | 33361/371472 [2:39:32<26:49:30,  3.50it/s]
  9%|▉         | 33362/371472 [2:39:32<28:00:07,  3.35it/s]
  9%|▉         | 33363/371472 [2:39:32<27:14:38,  3.45it/s]
  9%|▉         | 33364/371472 [2:39:33<26:32:45,  3.54it/s]
  9%|▉         | 33365/371472 [2:39:33<26:40:11,  3.52it/s]
  9%|▉         | 33366/371472 [2:39:33<25:51:14,  3.63it/s]
  9%|▉         | 33367/371472 [2:39:34<25:39:41,  3.66it/s]
  9%|▉         | 33368/371472 [2:39:34<25:22:18,  3.70it/s]
  9%|▉         | 33369/371472 [2:39:34<25:22:44,  3.70it/s]
  9%|▉         | 33370/371472 [2:39:34<24:46:27,  3.79it/s]
  9%|▉         | 33371/371472 [2:39:35<24:48:34,  3.79it/s]
  9%|▉         | 33372/371472 [2:39:35<25:03:22,  3.75it/s]
  9%|▉         | 33373/371472 [2:39:35<24:34:46,  3.82it/s]
  9%|▉         | 33374/371472 [2:39:35<25:26:41,  3.69it/s]
  9%|▉         | 33375/371472 [2:39:36<25:44:04,  3.65it/s]
  9%|▉         | 33376/371472 [2:39:36<25:42:47,  3.65it/s]
  9%|▉         | 33377/371472 [2:39:36<24:33:00,  3.83it/s]
  9%|▉         | 33378/371472 [2:39:36<24:32:49,  3.83it/s]
  9%|▉         | 33379/371472 [2:39:37<26:35:10,  3.53it/s]
  9%|▉         | 33380/371472 [2:39:37<25:45:40,  3.65it/s]
                                                           
{'loss': 6.7107, 'learning_rate': 9.195684026805145e-07, 'epoch': 1.44}

  9%|▉         | 33380/371472 [2:39:37<25:45:40,  3.65it/s]
  9%|▉         | 33381/371472 [2:39:37<30:10:44,  3.11it/s]
  9%|▉         | 33382/371472 [2:39:38<28:32:07,  3.29it/s]
  9%|▉         | 33383/371472 [2:39:38<30:09:46,  3.11it/s]
  9%|▉         | 33384/371472 [2:39:38<29:21:42,  3.20it/s]
  9%|▉         | 33385/371472 [2:39:39<28:15:30,  3.32it/s]
  9%|▉         | 33386/371472 [2:39:39<28:43:46,  3.27it/s]
  9%|▉         | 33387/371472 [2:39:39<29:35:31,  3.17it/s]
  9%|▉         | 33388/371472 [2:39:40<28:46:08,  3.26it/s]
  9%|▉         | 33389/371472 [2:39:40<26:58:04,  3.48it/s]
  9%|▉         | 33390/371472 [2:39:40<28:20:00,  3.31it/s]
  9%|▉         | 33391/371472 [2:39:40<28:10:16,  3.33it/s]
  9%|▉         | 33392/371472 [2:39:41<28:55:32,  3.25it/s]
  9%|▉         | 33393/371472 [2:39:41<28:49:49,  3.26it/s]
  9%|▉         | 33394/371472 [2:39:41<27:24:00,  3.43it/s]
  9%|▉         | 33395/371472 [2:39:42<26:32:42,  3.54it/s]
  9%|▉         | 33396/371472 [2:39:42<26:22:53,  3.56it/s]
  9%|▉         | 33397/371472 [2:39:42<27:26:52,  3.42it/s]
  9%|▉         | 33398/371472 [2:39:43<27:50:44,  3.37it/s]
  9%|▉         | 33399/371472 [2:39:43<29:00:32,  3.24it/s]
  9%|▉         | 33400/371472 [2:39:43<31:04:37,  3.02it/s]
                                                           
{'loss': 5.7782, 'learning_rate': 9.195199207050356e-07, 'epoch': 1.44}

  9%|▉         | 33400/371472 [2:39:43<31:04:37,  3.02it/s]
  9%|▉         | 33401/371472 [2:39:44<30:30:28,  3.08it/s]
  9%|▉         | 33402/371472 [2:39:44<30:55:38,  3.04it/s]
  9%|▉         | 33403/371472 [2:39:44<30:04:56,  3.12it/s]
  9%|▉         | 33404/371472 [2:39:44<28:58:07,  3.24it/s]
  9%|▉         | 33405/371472 [2:39:45<27:38:47,  3.40it/s]
  9%|▉         | 33406/371472 [2:39:45<27:49:51,  3.37it/s]
  9%|▉         | 33407/371472 [2:39:45<28:19:36,  3.32it/s]
  9%|▉         | 33408/371472 [2:39:46<27:54:41,  3.36it/s]
  9%|▉         | 33409/371472 [2:39:46<26:46:09,  3.51it/s]
  9%|▉         | 33410/371472 [2:39:46<27:07:35,  3.46it/s]
  9%|▉         | 33411/371472 [2:39:46<26:24:43,  3.56it/s]
  9%|▉         | 33412/371472 [2:39:47<25:57:14,  3.62it/s]
  9%|▉         | 33413/371472 [2:39:47<26:46:23,  3.51it/s]
  9%|▉         | 33414/371472 [2:39:47<26:24:01,  3.56it/s]
  9%|▉         | 33415/371472 [2:39:48<26:13:24,  3.58it/s]
  9%|▉         | 33416/371472 [2:39:48<26:29:02,  3.55it/s]
  9%|▉         | 33417/371472 [2:39:48<26:39:30,  3.52it/s]
  9%|▉         | 33418/371472 [2:39:48<27:18:05,  3.44it/s]
  9%|▉         | 33419/371472 [2:39:49<26:23:58,  3.56it/s]
  9%|▉         | 33420/371472 [2:39:49<25:54:24,  3.62it/s]
                                                           
{'loss': 5.4448, 'learning_rate': 9.194714387295568e-07, 'epoch': 1.44}

  9%|▉         | 33420/371472 [2:39:49<25:54:24,  3.62it/s]
  9%|▉         | 33421/371472 [2:39:49<27:28:37,  3.42it/s]
  9%|▉         | 33422/371472 [2:39:50<26:52:13,  3.49it/s]
  9%|▉         | 33423/371472 [2:39:50<26:54:16,  3.49it/s]
  9%|▉         | 33424/371472 [2:39:50<26:36:48,  3.53it/s]
  9%|▉         | 33425/371472 [2:39:50<26:39:07,  3.52it/s]
  9%|▉         | 33426/371472 [2:39:51<26:28:55,  3.55it/s]
  9%|▉         | 33427/371472 [2:39:51<26:12:18,  3.58it/s]
  9%|▉         | 33428/371472 [2:39:51<27:18:38,  3.44it/s]
  9%|▉         | 33429/371472 [2:39:52<26:44:29,  3.51it/s]
  9%|▉         | 33430/371472 [2:39:52<26:32:20,  3.54it/s]
  9%|▉         | 33431/371472 [2:39:52<25:53:05,  3.63it/s]
  9%|▉         | 33432/371472 [2:39:52<25:35:05,  3.67it/s]
  9%|▉         | 33433/371472 [2:39:53<27:27:33,  3.42it/s]
  9%|▉         | 33434/371472 [2:39:53<26:59:13,  3.48it/s]
  9%|▉         | 33435/371472 [2:39:53<26:44:29,  3.51it/s]
  9%|▉         | 33436/371472 [2:39:54<25:52:54,  3.63it/s]
  9%|▉         | 33437/371472 [2:39:54<25:48:13,  3.64it/s]
  9%|▉         | 33438/371472 [2:39:54<29:02:44,  3.23it/s]
  9%|▉         | 33439/371472 [2:39:54<28:04:22,  3.34it/s]
  9%|▉         | 33440/371472 [2:39:55<27:26:51,  3.42it/s]
                                                           
{'loss': 5.6638, 'learning_rate': 9.194229567540778e-07, 'epoch': 1.44}

  9%|▉         | 33440/371472 [2:39:55<27:26:51,  3.42it/s]
  9%|▉         | 33441/371472 [2:39:55<27:10:20,  3.46it/s]
  9%|▉         | 33442/371472 [2:39:55<26:31:35,  3.54it/s]
  9%|▉         | 33443/371472 [2:39:56<26:21:03,  3.56it/s]
  9%|▉         | 33444/371472 [2:39:56<26:04:15,  3.60it/s]
  9%|▉         | 33445/371472 [2:39:56<26:29:44,  3.54it/s]
  9%|▉         | 33446/371472 [2:39:56<26:01:33,  3.61it/s]
  9%|▉         | 33447/371472 [2:39:57<25:29:57,  3.68it/s]
  9%|▉         | 33448/371472 [2:39:57<25:20:24,  3.71it/s]
  9%|▉         | 33449/371472 [2:39:57<24:40:39,  3.80it/s]
  9%|▉         | 33450/371472 [2:39:57<25:47:13,  3.64it/s]
  9%|▉         | 33451/371472 [2:39:58<24:54:49,  3.77it/s]
  9%|▉         | 33452/371472 [2:39:58<26:21:12,  3.56it/s]
  9%|▉         | 33453/371472 [2:39:58<27:05:11,  3.47it/s]
  9%|▉         | 33454/371472 [2:39:59<26:33:24,  3.54it/s]
  9%|▉         | 33455/371472 [2:39:59<25:59:31,  3.61it/s]
  9%|▉         | 33456/371472 [2:39:59<28:53:22,  3.25it/s]
  9%|▉         | 33457/371472 [2:40:00<27:28:40,  3.42it/s]
  9%|▉         | 33458/371472 [2:40:00<26:47:44,  3.50it/s]
  9%|▉         | 33459/371472 [2:40:00<29:05:39,  3.23it/s]
  9%|▉         | 33460/371472 [2:40:00<27:17:00,  3.44it/s]
                                                           
{'loss': 5.1264, 'learning_rate': 9.19374474778599e-07, 'epoch': 1.44}

  9%|▉         | 33460/371472 [2:40:00<27:17:00,  3.44it/s]
  9%|▉         | 33461/371472 [2:40:01<26:54:46,  3.49it/s]
  9%|▉         | 33462/371472 [2:40:01<27:37:22,  3.40it/s]
  9%|▉         | 33463/371472 [2:40:01<28:22:10,  3.31it/s]
  9%|▉         | 33464/371472 [2:40:02<27:45:14,  3.38it/s]
  9%|▉         | 33465/371472 [2:40:02<29:16:50,  3.21it/s]
  9%|▉         | 33466/371472 [2:40:02<28:45:27,  3.26it/s]
  9%|▉         | 33467/371472 [2:40:03<28:56:00,  3.25it/s]
  9%|▉         | 33468/371472 [2:40:03<29:55:30,  3.14it/s]
  9%|▉         | 33469/371472 [2:40:03<28:33:41,  3.29it/s]
  9%|▉         | 33470/371472 [2:40:03<27:02:36,  3.47it/s]
  9%|▉         | 33471/371472 [2:40:04<28:02:49,  3.35it/s]
  9%|▉         | 33472/371472 [2:40:04<26:58:35,  3.48it/s]
  9%|▉         | 33473/371472 [2:40:04<26:03:58,  3.60it/s]
  9%|▉         | 33474/371472 [2:40:05<26:09:26,  3.59it/s]
  9%|▉         | 33475/371472 [2:40:05<27:22:49,  3.43it/s]
  9%|▉         | 33476/371472 [2:40:05<26:53:52,  3.49it/s]
  9%|▉         | 33477/371472 [2:40:05<25:59:06,  3.61it/s]
  9%|▉         | 33478/371472 [2:40:06<25:37:14,  3.66it/s]
  9%|▉         | 33479/371472 [2:40:06<25:31:23,  3.68it/s]
  9%|▉         | 33480/371472 [2:40:06<26:01:24,  3.61it/s]
                                                           
{'loss': 5.0293, 'learning_rate': 9.1932599280312e-07, 'epoch': 1.44}

  9%|▉         | 33480/371472 [2:40:06<26:01:24,  3.61it/s]
  9%|▉         | 33481/371472 [2:40:06<26:48:20,  3.50it/s]
  9%|▉         | 33482/371472 [2:40:07<28:40:11,  3.27it/s]
  9%|▉         | 33483/371472 [2:40:07<27:36:17,  3.40it/s]
  9%|▉         | 33484/371472 [2:40:07<27:38:44,  3.40it/s]
  9%|▉         | 33485/371472 [2:40:08<26:28:32,  3.55it/s]
  9%|▉         | 33486/371472 [2:40:08<26:43:34,  3.51it/s]
  9%|▉         | 33487/371472 [2:40:08<27:05:58,  3.46it/s]
  9%|▉         | 33488/371472 [2:40:09<27:52:43,  3.37it/s]
  9%|▉         | 33489/371472 [2:40:09<27:01:40,  3.47it/s]
  9%|▉         | 33490/371472 [2:40:09<27:01:18,  3.47it/s]
  9%|▉         | 33491/371472 [2:40:09<26:01:48,  3.61it/s]
  9%|▉         | 33492/371472 [2:40:10<26:01:23,  3.61it/s]
  9%|▉         | 33493/371472 [2:40:10<27:01:51,  3.47it/s]
  9%|▉         | 33494/371472 [2:40:10<25:39:30,  3.66it/s]
  9%|▉         | 33495/371472 [2:40:10<25:15:39,  3.72it/s]
  9%|▉         | 33496/371472 [2:40:11<24:58:28,  3.76it/s]
  9%|▉         | 33497/371472 [2:40:11<25:00:48,  3.75it/s]
  9%|▉         | 33498/371472 [2:40:11<26:09:02,  3.59it/s]
  9%|▉         | 33499/371472 [2:40:12<24:57:34,  3.76it/s]
  9%|▉         | 33500/371472 [2:40:12<25:26:42,  3.69it/s]
                                                           
{'loss': 4.9955, 'learning_rate': 9.192775108276412e-07, 'epoch': 1.44}

  9%|▉         | 33500/371472 [2:40:12<25:26:42,  3.69it/s]
  9%|▉         | 33501/371472 [2:40:12<24:55:15,  3.77it/s]
  9%|▉         | 33502/371472 [2:40:12<25:12:16,  3.72it/s]
  9%|▉         | 33503/371472 [2:40:13<28:48:19,  3.26it/s]
  9%|▉         | 33504/371472 [2:40:13<28:08:40,  3.34it/s]
  9%|▉         | 33505/371472 [2:40:13<27:09:12,  3.46it/s]
  9%|▉         | 33506/371472 [2:40:14<26:30:21,  3.54it/s]
  9%|▉         | 33507/371472 [2:40:14<26:49:03,  3.50it/s]
  9%|▉         | 33508/371472 [2:40:14<27:21:16,  3.43it/s]
  9%|▉         | 33509/371472 [2:40:14<27:19:16,  3.44it/s]
  9%|▉         | 33510/371472 [2:40:15<26:55:21,  3.49it/s]
  9%|▉         | 33511/371472 [2:40:15<27:32:54,  3.41it/s]
  9%|▉         | 33512/371472 [2:40:15<28:37:37,  3.28it/s]
  9%|▉         | 33513/371472 [2:40:16<29:26:33,  3.19it/s]
  9%|▉         | 33514/371472 [2:40:16<28:37:38,  3.28it/s]
  9%|▉         | 33515/371472 [2:40:16<26:48:37,  3.50it/s]
  9%|▉         | 33516/371472 [2:40:17<27:26:53,  3.42it/s]
  9%|▉         | 33517/371472 [2:40:17<27:15:51,  3.44it/s]
  9%|▉         | 33518/371472 [2:40:17<26:44:44,  3.51it/s]
  9%|▉         | 33519/371472 [2:40:17<26:16:05,  3.57it/s]
  9%|▉         | 33520/371472 [2:40:18<25:37:11,  3.66it/s]
                                                           
{'loss': 4.7765, 'learning_rate': 9.192290288521622e-07, 'epoch': 1.44}

  9%|▉         | 33520/371472 [2:40:18<25:37:11,  3.66it/s]
  9%|▉         | 33521/371472 [2:40:18<26:41:31,  3.52it/s]
  9%|▉         | 33522/371472 [2:40:18<27:12:24,  3.45it/s]
  9%|▉         | 33523/371472 [2:40:19<27:14:15,  3.45it/s]
  9%|▉         | 33524/371472 [2:40:19<26:39:41,  3.52it/s]
  9%|▉         | 33525/371472 [2:40:19<26:45:04,  3.51it/s]
  9%|▉         | 33526/371472 [2:40:19<26:57:41,  3.48it/s]
  9%|▉         | 33527/371472 [2:40:20<28:20:18,  3.31it/s]
  9%|▉         | 33528/371472 [2:40:20<27:50:39,  3.37it/s]
  9%|▉         | 33529/371472 [2:40:20<26:55:55,  3.49it/s]
  9%|▉         | 33530/371472 [2:40:21<26:06:31,  3.60it/s]
  9%|▉         | 33531/371472 [2:40:21<26:03:23,  3.60it/s]
  9%|▉         | 33532/371472 [2:40:21<26:47:06,  3.50it/s]
  9%|▉         | 33533/371472 [2:40:21<28:23:50,  3.31it/s]
  9%|▉         | 33534/371472 [2:40:22<28:24:46,  3.30it/s]
  9%|▉         | 33535/371472 [2:40:22<27:00:11,  3.48it/s]
  9%|▉         | 33536/371472 [2:40:22<26:36:50,  3.53it/s]
  9%|▉         | 33537/371472 [2:40:23<28:23:21,  3.31it/s]
  9%|▉         | 33538/371472 [2:40:23<28:50:32,  3.25it/s]
  9%|▉         | 33539/371472 [2:40:23<27:31:32,  3.41it/s]
  9%|▉         | 33540/371472 [2:40:23<27:05:30,  3.46it/s]
                                                           
{'loss': 4.6915, 'learning_rate': 9.191805468766834e-07, 'epoch': 1.44}

  9%|▉         | 33540/371472 [2:40:23<27:05:30,  3.46it/s]
  9%|▉         | 33541/371472 [2:40:24<28:25:33,  3.30it/s]
  9%|▉         | 33542/371472 [2:40:24<27:24:22,  3.43it/s]
  9%|▉         | 33543/371472 [2:40:24<26:41:29,  3.52it/s]
  9%|▉         | 33544/371472 [2:40:25<26:13:27,  3.58it/s]
  9%|▉         | 33545/371472 [2:40:25<28:36:00,  3.28it/s]
  9%|▉         | 33546/371472 [2:40:25<27:02:48,  3.47it/s]
  9%|▉         | 33547/371472 [2:40:26<27:28:43,  3.42it/s]
  9%|▉         | 33548/371472 [2:40:26<29:43:36,  3.16it/s]
  9%|▉         | 33549/371472 [2:40:26<30:38:28,  3.06it/s]
  9%|▉         | 33550/371472 [2:40:26<28:32:56,  3.29it/s]
  9%|▉         | 33551/371472 [2:40:27<27:11:15,  3.45it/s]
  9%|▉         | 33552/371472 [2:40:27<26:53:51,  3.49it/s]
  9%|▉         | 33553/371472 [2:40:27<27:00:45,  3.47it/s]
  9%|▉         | 33554/371472 [2:40:28<25:53:48,  3.62it/s]
  9%|▉         | 33555/371472 [2:40:28<25:46:35,  3.64it/s]
  9%|▉         | 33556/371472 [2:40:28<27:33:52,  3.41it/s]
  9%|▉         | 33557/371472 [2:40:28<27:37:12,  3.40it/s]
  9%|▉         | 33558/371472 [2:40:29<27:27:17,  3.42it/s]
  9%|▉         | 33559/371472 [2:40:29<26:35:12,  3.53it/s]
  9%|▉         | 33560/371472 [2:40:29<25:44:58,  3.65it/s]
                                                           
{'loss': 4.6286, 'learning_rate': 9.191320649012044e-07, 'epoch': 1.45}

  9%|▉         | 33560/371472 [2:40:29<25:44:58,  3.65it/s]
  9%|▉         | 33561/371472 [2:40:30<26:40:04,  3.52it/s]
  9%|▉         | 33562/371472 [2:40:30<26:48:50,  3.50it/s]
  9%|▉         | 33563/371472 [2:40:30<26:48:33,  3.50it/s]
  9%|▉         | 33564/371472 [2:40:30<26:17:48,  3.57it/s]
  9%|▉         | 33565/371472 [2:40:31<26:20:22,  3.56it/s]
  9%|▉         | 33566/371472 [2:40:31<26:08:50,  3.59it/s]
  9%|▉         | 33567/371472 [2:40:31<25:35:14,  3.67it/s]
  9%|▉         | 33568/371472 [2:40:32<28:07:19,  3.34it/s]
  9%|▉         | 33569/371472 [2:40:32<26:55:23,  3.49it/s]
  9%|▉         | 33570/371472 [2:40:32<26:00:02,  3.61it/s]
  9%|▉         | 33571/371472 [2:40:32<25:07:41,  3.74it/s]
  9%|▉         | 33572/371472 [2:40:33<26:48:36,  3.50it/s]
  9%|▉         | 33573/371472 [2:40:33<28:03:13,  3.35it/s]
  9%|▉         | 33574/371472 [2:40:33<26:36:48,  3.53it/s]
  9%|▉         | 33575/371472 [2:40:34<26:51:32,  3.49it/s]
  9%|▉         | 33576/371472 [2:40:34<25:59:44,  3.61it/s]
  9%|▉         | 33577/371472 [2:40:34<25:25:12,  3.69it/s]
  9%|▉         | 33578/371472 [2:40:34<25:41:35,  3.65it/s]
  9%|▉         | 33579/371472 [2:40:35<25:22:36,  3.70it/s]
  9%|▉         | 33580/371472 [2:40:35<27:09:05,  3.46it/s]
                                                           
{'loss': 4.7875, 'learning_rate': 9.190835829257256e-07, 'epoch': 1.45}

  9%|▉         | 33580/371472 [2:40:35<27:09:05,  3.46it/s]
  9%|▉         | 33581/371472 [2:40:35<26:23:54,  3.56it/s]
  9%|▉         | 33582/371472 [2:40:35<26:16:23,  3.57it/s]
  9%|▉         | 33583/371472 [2:40:36<26:07:08,  3.59it/s]
  9%|▉         | 33584/371472 [2:40:36<26:13:35,  3.58it/s]
  9%|▉         | 33585/371472 [2:40:36<27:26:47,  3.42it/s]
  9%|▉         | 33586/371472 [2:40:37<28:11:04,  3.33it/s]
  9%|▉         | 33587/371472 [2:40:37<27:13:36,  3.45it/s]
  9%|▉         | 33588/371472 [2:40:37<26:44:20,  3.51it/s]
  9%|▉         | 33589/371472 [2:40:38<31:18:11,  3.00it/s]
  9%|▉         | 33590/371472 [2:40:38<30:30:39,  3.08it/s]
  9%|▉         | 33591/371472 [2:40:38<31:26:50,  2.98it/s]
  9%|▉         | 33592/371472 [2:40:39<31:02:32,  3.02it/s]
  9%|▉         | 33593/371472 [2:40:39<29:22:25,  3.20it/s]
  9%|▉         | 33594/371472 [2:40:39<28:16:59,  3.32it/s]
  9%|▉         | 33595/371472 [2:40:40<29:07:26,  3.22it/s]
  9%|▉         | 33596/371472 [2:40:40<27:37:34,  3.40it/s]
  9%|▉         | 33597/371472 [2:40:40<26:08:32,  3.59it/s]
  9%|▉         | 33598/371472 [2:40:40<26:56:11,  3.48it/s]
  9%|▉         | 33599/371472 [2:40:41<26:17:45,  3.57it/s]
  9%|▉         | 33600/371472 [2:40:41<26:09:02,  3.59it/s]
                                                           
{'loss': 4.5608, 'learning_rate': 9.190351009502466e-07, 'epoch': 1.45}

  9%|▉         | 33600/371472 [2:40:41<26:09:02,  3.59it/s]
  9%|▉         | 33601/371472 [2:40:41<26:59:34,  3.48it/s]
  9%|▉         | 33602/371472 [2:40:41<26:45:51,  3.51it/s]
  9%|▉         | 33603/371472 [2:40:42<26:25:05,  3.55it/s]
  9%|▉         | 33604/371472 [2:40:42<26:38:59,  3.52it/s]
  9%|▉         | 33605/371472 [2:40:42<28:31:51,  3.29it/s]
  9%|▉         | 33606/371472 [2:40:43<27:10:52,  3.45it/s]
  9%|▉         | 33607/371472 [2:40:43<27:07:45,  3.46it/s]
  9%|▉         | 33608/371472 [2:40:43<27:09:26,  3.46it/s]
  9%|▉         | 33609/371472 [2:40:43<26:52:18,  3.49it/s]
  9%|▉         | 33610/371472 [2:40:44<25:52:51,  3.63it/s]
  9%|▉         | 33611/371472 [2:40:44<25:31:55,  3.68it/s]
  9%|▉         | 33612/371472 [2:40:44<26:13:42,  3.58it/s]
  9%|▉         | 33613/371472 [2:40:45<25:44:55,  3.64it/s]
  9%|▉         | 33614/371472 [2:40:45<25:12:32,  3.72it/s]
  9%|▉         | 33615/371472 [2:40:45<27:27:23,  3.42it/s]
  9%|▉         | 33616/371472 [2:40:46<29:33:44,  3.17it/s]
  9%|▉         | 33617/371472 [2:40:46<28:33:43,  3.29it/s]
  9%|▉         | 33618/371472 [2:40:46<28:32:31,  3.29it/s]
  9%|▉         | 33619/371472 [2:40:46<28:27:29,  3.30it/s]
  9%|▉         | 33620/371472 [2:40:47<27:39:16,  3.39it/s]
                                                           
{'loss': 4.3453, 'learning_rate': 9.189866189747678e-07, 'epoch': 1.45}

  9%|▉         | 33620/371472 [2:40:47<27:39:16,  3.39it/s]
  9%|▉         | 33621/371472 [2:40:47<28:02:08,  3.35it/s]
  9%|▉         | 33622/371472 [2:40:47<26:54:35,  3.49it/s]
  9%|▉         | 33623/371472 [2:40:48<25:59:12,  3.61it/s]
  9%|▉         | 33624/371472 [2:40:48<25:27:18,  3.69it/s]
  9%|▉         | 33625/371472 [2:40:48<25:51:31,  3.63it/s]
  9%|▉         | 33626/371472 [2:40:48<26:02:49,  3.60it/s]
  9%|▉         | 33627/371472 [2:40:49<25:58:20,  3.61it/s]
  9%|▉         | 33628/371472 [2:40:49<25:49:20,  3.63it/s]
  9%|▉         | 33629/371472 [2:40:49<26:16:44,  3.57it/s]
  9%|▉         | 33630/371472 [2:40:49<26:44:22,  3.51it/s]
  9%|▉         | 33631/371472 [2:40:50<26:46:34,  3.50it/s]
  9%|▉         | 33632/371472 [2:40:50<29:41:27,  3.16it/s]
  9%|▉         | 33633/371472 [2:40:50<28:28:22,  3.30it/s]
  9%|▉         | 33634/371472 [2:40:51<28:50:23,  3.25it/s]
  9%|▉         | 33635/371472 [2:40:51<28:44:37,  3.26it/s]
  9%|▉         | 33636/371472 [2:40:51<28:46:56,  3.26it/s]
  9%|▉         | 33637/371472 [2:40:52<27:37:40,  3.40it/s]
  9%|▉         | 33638/371472 [2:40:52<27:13:14,  3.45it/s]
  9%|▉         | 33639/371472 [2:40:52<27:10:55,  3.45it/s]
  9%|▉         | 33640/371472 [2:40:52<26:25:40,  3.55it/s]
                                                           
{'loss': 4.8078, 'learning_rate': 9.189381369992889e-07, 'epoch': 1.45}

  9%|▉         | 33640/371472 [2:40:52<26:25:40,  3.55it/s]
  9%|▉         | 33641/371472 [2:40:53<26:11:22,  3.58it/s]
  9%|▉         | 33642/371472 [2:40:53<25:49:59,  3.63it/s]
  9%|▉         | 33643/371472 [2:40:53<26:51:25,  3.49it/s]
  9%|▉         | 33644/371472 [2:40:54<34:25:50,  2.73it/s]
  9%|▉         | 33645/371472 [2:40:54<32:32:06,  2.88it/s]
  9%|▉         | 33646/371472 [2:40:54<30:59:25,  3.03it/s]
  9%|▉         | 33647/371472 [2:40:55<28:44:16,  3.27it/s]
  9%|▉         | 33648/371472 [2:40:55<27:39:56,  3.39it/s]
  9%|▉         | 33649/371472 [2:40:55<27:19:14,  3.43it/s]
  9%|▉         | 33650/371472 [2:40:55<26:07:06,  3.59it/s]
  9%|▉         | 33651/371472 [2:40:56<25:18:31,  3.71it/s]
  9%|▉         | 33652/371472 [2:40:56<26:21:18,  3.56it/s]
  9%|▉         | 33653/371472 [2:40:56<25:19:21,  3.71it/s]
  9%|▉         | 33654/371472 [2:40:57<25:53:53,  3.62it/s]
  9%|▉         | 33655/371472 [2:40:57<25:30:24,  3.68it/s]
  9%|▉         | 33656/371472 [2:40:57<25:03:52,  3.74it/s]
  9%|▉         | 33657/371472 [2:40:57<27:21:10,  3.43it/s]
  9%|▉         | 33658/371472 [2:40:58<28:06:09,  3.34it/s]
  9%|▉         | 33659/371472 [2:40:58<27:27:48,  3.42it/s]
  9%|▉         | 33660/371472 [2:40:58<27:14:18,  3.45it/s]
                                                           
{'loss': 4.7774, 'learning_rate': 9.1888965502381e-07, 'epoch': 1.45}

  9%|▉         | 33660/371472 [2:40:58<27:14:18,  3.45it/s]
  9%|▉         | 33661/371472 [2:40:59<29:12:36,  3.21it/s]
  9%|▉         | 33662/371472 [2:40:59<27:47:42,  3.38it/s]
  9%|▉         | 33663/371472 [2:40:59<26:50:35,  3.50it/s]
  9%|▉         | 33664/371472 [2:40:59<26:42:16,  3.51it/s]
  9%|▉         | 33665/371472 [2:41:00<28:13:23,  3.32it/s]
  9%|▉         | 33666/371472 [2:41:00<27:32:06,  3.41it/s]
  9%|▉         | 33667/371472 [2:41:00<28:05:41,  3.34it/s]
  9%|▉         | 33668/371472 [2:41:01<26:43:43,  3.51it/s]
  9%|▉         | 33669/371472 [2:41:01<30:25:56,  3.08it/s]
  9%|▉         | 33670/371472 [2:41:01<29:15:51,  3.21it/s]
  9%|▉         | 33671/371472 [2:41:02<27:45:41,  3.38it/s]
  9%|▉         | 33672/371472 [2:41:02<27:02:15,  3.47it/s]
  9%|▉         | 33673/371472 [2:41:02<27:00:39,  3.47it/s]
  9%|▉         | 33674/371472 [2:41:02<25:45:28,  3.64it/s]
  9%|▉         | 33675/371472 [2:41:03<25:04:12,  3.74it/s]
  9%|▉         | 33676/371472 [2:41:03<24:57:30,  3.76it/s]
  9%|▉         | 33677/371472 [2:41:03<24:28:30,  3.83it/s]
  9%|▉         | 33678/371472 [2:41:03<25:06:12,  3.74it/s]
  9%|▉         | 33679/371472 [2:41:04<25:00:08,  3.75it/s]
  9%|▉         | 33680/371472 [2:41:04<27:14:58,  3.44it/s]
                                                           
{'loss': 4.8069, 'learning_rate': 9.188411730483311e-07, 'epoch': 1.45}

  9%|▉         | 33680/371472 [2:41:04<27:14:58,  3.44it/s]
  9%|▉         | 33681/371472 [2:41:04<27:40:21,  3.39it/s]
  9%|▉         | 33682/371472 [2:41:05<28:38:59,  3.28it/s]
  9%|▉         | 33683/371472 [2:41:05<27:15:07,  3.44it/s]
  9%|▉         | 33684/371472 [2:41:05<28:30:33,  3.29it/s]
  9%|▉         | 33685/371472 [2:41:06<29:00:00,  3.24it/s]
  9%|▉         | 33686/371472 [2:41:06<27:25:49,  3.42it/s]
  9%|▉         | 33687/371472 [2:41:06<27:25:17,  3.42it/s]
  9%|▉         | 33688/371472 [2:41:06<27:27:50,  3.42it/s]
  9%|▉         | 33689/371472 [2:41:07<30:02:43,  3.12it/s]
  9%|▉         | 33690/371472 [2:41:07<28:29:47,  3.29it/s]
  9%|▉         | 33691/371472 [2:41:07<27:04:41,  3.47it/s]
  9%|▉         | 33692/371472 [2:41:08<26:11:47,  3.58it/s]
  9%|▉         | 33693/371472 [2:41:08<26:40:55,  3.52it/s]
  9%|▉         | 33694/371472 [2:41:08<27:37:14,  3.40it/s]
  9%|▉         | 33695/371472 [2:41:09<28:32:18,  3.29it/s]
  9%|▉         | 33696/371472 [2:41:09<31:49:39,  2.95it/s]
  9%|▉         | 33697/371472 [2:41:09<29:14:44,  3.21it/s]
  9%|▉         | 33698/371472 [2:41:10<30:39:26,  3.06it/s]
  9%|▉         | 33699/371472 [2:41:10<28:28:00,  3.30it/s]
  9%|▉         | 33700/371472 [2:41:10<28:48:21,  3.26it/s]
                                                           
{'loss': 4.5375, 'learning_rate': 9.187926910728522e-07, 'epoch': 1.45}

  9%|▉         | 33700/371472 [2:41:10<28:48:21,  3.26it/s]
  9%|▉         | 33701/371472 [2:41:11<30:53:45,  3.04it/s]
  9%|▉         | 33702/371472 [2:41:11<29:49:06,  3.15it/s]
  9%|▉         | 33703/371472 [2:41:11<29:54:08,  3.14it/s]
  9%|▉         | 33704/371472 [2:41:11<28:45:22,  3.26it/s]
  9%|▉         | 33705/371472 [2:41:12<27:26:57,  3.42it/s]
  9%|▉         | 33706/371472 [2:41:12<30:44:16,  3.05it/s]
  9%|▉         | 33707/371472 [2:41:12<28:49:00,  3.26it/s]
  9%|▉         | 33708/371472 [2:41:13<27:01:30,  3.47it/s]
  9%|▉         | 33709/371472 [2:41:13<25:56:31,  3.62it/s]
  9%|▉         | 33710/371472 [2:41:13<24:53:51,  3.77it/s]
  9%|▉         | 33711/371472 [2:41:13<24:26:37,  3.84it/s]
  9%|▉         | 33712/371472 [2:41:14<24:32:22,  3.82it/s]
  9%|▉         | 33713/371472 [2:41:14<24:13:05,  3.87it/s]
  9%|▉         | 33714/371472 [2:41:14<24:58:13,  3.76it/s]
  9%|▉         | 33715/371472 [2:41:14<25:25:16,  3.69it/s]
  9%|▉         | 33716/371472 [2:41:15<26:58:19,  3.48it/s]
  9%|▉         | 33717/371472 [2:41:15<30:02:47,  3.12it/s]
  9%|▉         | 33718/371472 [2:41:15<30:21:48,  3.09it/s]
  9%|▉         | 33719/371472 [2:41:16<28:33:14,  3.29it/s]
  9%|▉         | 33720/371472 [2:41:16<27:54:07,  3.36it/s]
                                                           
{'loss': 4.6969, 'learning_rate': 9.187442090973734e-07, 'epoch': 1.45}

  9%|▉         | 33720/371472 [2:41:16<27:54:07,  3.36it/s]
  9%|▉         | 33721/371472 [2:41:16<27:14:28,  3.44it/s]
  9%|▉         | 33722/371472 [2:41:17<27:28:38,  3.41it/s]
  9%|▉         | 33723/371472 [2:41:17<26:47:19,  3.50it/s]
  9%|▉         | 33724/371472 [2:41:17<27:15:23,  3.44it/s]
  9%|▉         | 33725/371472 [2:41:17<26:13:14,  3.58it/s]
  9%|▉         | 33726/371472 [2:41:18<27:17:27,  3.44it/s]
  9%|▉         | 33727/371472 [2:41:18<27:40:05,  3.39it/s]
  9%|▉         | 33728/371472 [2:41:18<27:45:37,  3.38it/s]
  9%|▉         | 33729/371472 [2:41:19<29:04:27,  3.23it/s]
  9%|▉         | 33730/371472 [2:41:19<27:26:56,  3.42it/s]
  9%|▉         | 33731/371472 [2:41:19<29:02:06,  3.23it/s]
  9%|▉         | 33732/371472 [2:41:20<27:19:04,  3.43it/s]
  9%|▉         | 33733/371472 [2:41:20<27:53:28,  3.36it/s]
  9%|▉         | 33734/371472 [2:41:20<30:13:03,  3.10it/s]
  9%|▉         | 33735/371472 [2:41:21<30:00:12,  3.13it/s]
  9%|▉         | 33736/371472 [2:41:21<28:10:17,  3.33it/s]
  9%|▉         | 33737/371472 [2:41:21<28:06:12,  3.34it/s]
  9%|▉         | 33738/371472 [2:41:21<26:51:24,  3.49it/s]
  9%|▉         | 33739/371472 [2:41:22<26:44:49,  3.51it/s]
  9%|▉         | 33740/371472 [2:41:22<25:35:37,  3.67it/s]
                                                           
{'loss': 4.6461, 'learning_rate': 9.186957271218943e-07, 'epoch': 1.45}

  9%|▉         | 33740/371472 [2:41:22<25:35:37,  3.67it/s]
  9%|▉         | 33741/371472 [2:41:22<25:52:56,  3.62it/s]
  9%|▉         | 33742/371472 [2:41:22<27:17:56,  3.44it/s]
  9%|▉         | 33743/371472 [2:41:23<26:55:00,  3.49it/s]
  9%|▉         | 33744/371472 [2:41:23<26:38:12,  3.52it/s]
  9%|▉         | 33745/371472 [2:41:23<25:51:24,  3.63it/s]
  9%|▉         | 33746/371472 [2:41:24<27:12:57,  3.45it/s]
  9%|▉         | 33747/371472 [2:41:24<25:56:37,  3.62it/s]
  9%|▉         | 33748/371472 [2:41:24<26:20:50,  3.56it/s]
  9%|▉         | 33749/371472 [2:41:24<25:42:25,  3.65it/s]
  9%|▉         | 33750/371472 [2:41:25<25:14:52,  3.72it/s]
  9%|▉         | 33751/371472 [2:41:25<28:12:01,  3.33it/s]
  9%|▉         | 33752/371472 [2:41:25<28:29:19,  3.29it/s]
  9%|▉         | 33753/371472 [2:41:26<27:36:14,  3.40it/s]
  9%|▉         | 33754/371472 [2:41:26<26:51:25,  3.49it/s]
  9%|▉         | 33755/371472 [2:41:26<25:26:20,  3.69it/s]
  9%|▉         | 33756/371472 [2:41:26<24:46:00,  3.79it/s]
  9%|▉         | 33757/371472 [2:41:27<24:59:49,  3.75it/s]
  9%|▉         | 33758/371472 [2:41:27<24:51:22,  3.77it/s]
  9%|▉         | 33759/371472 [2:41:27<24:51:03,  3.77it/s]
  9%|▉         | 33760/371472 [2:41:27<24:44:28,  3.79it/s]
                                                           
{'loss': 4.6505, 'learning_rate': 9.186472451464155e-07, 'epoch': 1.45}

  9%|▉         | 33760/371472 [2:41:27<24:44:28,  3.79it/s]
  9%|▉         | 33761/371472 [2:41:28<24:22:03,  3.85it/s]
  9%|▉         | 33762/371472 [2:41:28<24:34:15,  3.82it/s]
  9%|▉         | 33763/371472 [2:41:28<25:13:41,  3.72it/s]
  9%|▉         | 33764/371472 [2:41:29<27:23:27,  3.42it/s]
  9%|▉         | 33765/371472 [2:41:29<26:18:45,  3.57it/s]
  9%|▉         | 33766/371472 [2:41:29<25:58:50,  3.61it/s]
  9%|▉         | 33767/371472 [2:41:29<26:13:28,  3.58it/s]
  9%|▉         | 33768/371472 [2:41:30<26:30:02,  3.54it/s]
  9%|▉         | 33769/371472 [2:41:30<26:08:34,  3.59it/s]
  9%|▉         | 33770/371472 [2:41:30<25:40:02,  3.65it/s]
  9%|▉         | 33771/371472 [2:41:30<25:12:11,  3.72it/s]
  9%|▉         | 33772/371472 [2:41:31<27:37:02,  3.40it/s]
  9%|▉         | 33773/371472 [2:41:31<28:40:56,  3.27it/s]
  9%|▉         | 33774/371472 [2:41:31<27:51:52,  3.37it/s]
  9%|▉         | 33775/371472 [2:41:32<26:35:55,  3.53it/s]
  9%|▉         | 33776/371472 [2:41:32<28:47:48,  3.26it/s]
  9%|▉         | 33777/371472 [2:41:32<29:00:11,  3.23it/s]
  9%|▉         | 33778/371472 [2:41:33<27:28:31,  3.41it/s]
  9%|▉         | 33779/371472 [2:41:33<27:45:23,  3.38it/s]
  9%|▉         | 33780/371472 [2:41:33<28:46:30,  3.26it/s]
                                                           
{'loss': 4.4535, 'learning_rate': 9.185987631709366e-07, 'epoch': 1.45}

  9%|▉         | 33780/371472 [2:41:33<28:46:30,  3.26it/s]
  9%|▉         | 33781/371472 [2:41:34<27:39:04,  3.39it/s]
  9%|▉         | 33782/371472 [2:41:34<26:48:36,  3.50it/s]
  9%|▉         | 33783/371472 [2:41:34<25:58:49,  3.61it/s]
  9%|▉         | 33784/371472 [2:41:34<26:17:02,  3.57it/s]
  9%|▉         | 33785/371472 [2:41:35<25:32:57,  3.67it/s]
  9%|▉         | 33786/371472 [2:41:35<24:40:33,  3.80it/s]
  9%|▉         | 33787/371472 [2:41:35<25:21:21,  3.70it/s]
  9%|▉         | 33788/371472 [2:41:35<24:49:18,  3.78it/s]
  9%|▉         | 33789/371472 [2:41:36<26:09:47,  3.59it/s]
  9%|▉         | 33790/371472 [2:41:36<25:24:15,  3.69it/s]
  9%|▉         | 33791/371472 [2:41:36<25:15:33,  3.71it/s]
  9%|▉         | 33792/371472 [2:41:37<27:15:35,  3.44it/s]
  9%|▉         | 33793/371472 [2:41:37<28:09:08,  3.33it/s]
  9%|▉         | 33794/371472 [2:41:37<27:29:04,  3.41it/s]
  9%|▉         | 33795/371472 [2:41:37<27:36:48,  3.40it/s]
  9%|▉         | 33796/371472 [2:41:38<26:12:07,  3.58it/s]
  9%|▉         | 33797/371472 [2:41:38<26:32:33,  3.53it/s]
  9%|▉         | 33798/371472 [2:41:38<27:13:14,  3.45it/s]
  9%|▉         | 33799/371472 [2:41:39<27:03:44,  3.47it/s]
  9%|▉         | 33800/371472 [2:41:39<25:52:08,  3.63it/s]
                                                           
{'loss': 4.8117, 'learning_rate': 9.185502811954578e-07, 'epoch': 1.46}

  9%|▉         | 33800/371472 [2:41:39<25:52:08,  3.63it/s]
  9%|▉         | 33801/371472 [2:41:39<26:31:05,  3.54it/s]
  9%|▉         | 33802/371472 [2:41:39<26:03:04,  3.60it/s]
  9%|▉         | 33803/371472 [2:41:40<25:08:31,  3.73it/s]
  9%|▉         | 33804/371472 [2:41:40<25:46:13,  3.64it/s]
  9%|▉         | 33805/371472 [2:41:40<26:08:26,  3.59it/s]
  9%|▉         | 33806/371472 [2:41:40<25:47:57,  3.64it/s]
  9%|▉         | 33807/371472 [2:41:41<26:04:21,  3.60it/s]
  9%|▉         | 33808/371472 [2:41:41<25:17:15,  3.71it/s]
  9%|▉         | 33809/371472 [2:41:41<26:19:56,  3.56it/s]
  9%|▉         | 33810/371472 [2:41:42<25:16:18,  3.71it/s]
  9%|▉         | 33811/371472 [2:41:42<25:09:57,  3.73it/s]
  9%|▉         | 33812/371472 [2:41:42<24:58:43,  3.75it/s]
  9%|▉         | 33813/371472 [2:41:42<25:09:18,  3.73it/s]
  9%|▉         | 33814/371472 [2:41:43<24:36:53,  3.81it/s]
  9%|▉         | 33815/371472 [2:41:43<24:10:21,  3.88it/s]
  9%|▉         | 33816/371472 [2:41:43<23:46:14,  3.95it/s]
  9%|▉         | 33817/371472 [2:41:43<23:32:34,  3.98it/s]
  9%|▉         | 33818/371472 [2:41:44<24:48:47,  3.78it/s]
  9%|▉         | 33819/371472 [2:41:44<27:40:58,  3.39it/s]
  9%|▉         | 33820/371472 [2:41:44<27:08:54,  3.45it/s]
                                                           
{'loss': 4.6628, 'learning_rate': 9.185017992199788e-07, 'epoch': 1.46}

  9%|▉         | 33820/371472 [2:41:44<27:08:54,  3.45it/s]
  9%|▉         | 33821/371472 [2:41:45<26:21:05,  3.56it/s]
  9%|▉         | 33822/371472 [2:41:45<26:40:20,  3.52it/s]
  9%|▉         | 33823/371472 [2:41:45<26:00:56,  3.61it/s]
  9%|▉         | 33824/371472 [2:41:45<25:38:43,  3.66it/s]
  9%|▉         | 33825/371472 [2:41:46<26:42:06,  3.51it/s]
  9%|▉         | 33826/371472 [2:41:46<27:14:15,  3.44it/s]
  9%|▉         | 33827/371472 [2:41:46<26:20:50,  3.56it/s]
  9%|▉         | 33828/371472 [2:41:46<26:05:48,  3.59it/s]
  9%|▉         | 33829/371472 [2:41:47<27:15:50,  3.44it/s]
  9%|▉         | 33830/371472 [2:41:47<27:56:18,  3.36it/s]
  9%|▉         | 33831/371472 [2:41:47<28:12:42,  3.32it/s]
  9%|▉         | 33832/371472 [2:41:48<27:33:30,  3.40it/s]
  9%|▉         | 33833/371472 [2:41:48<28:16:02,  3.32it/s]
  9%|▉         | 33834/371472 [2:41:48<28:40:07,  3.27it/s]
  9%|▉         | 33835/371472 [2:41:49<28:59:09,  3.24it/s]
  9%|▉         | 33836/371472 [2:41:49<27:47:56,  3.37it/s]
  9%|▉         | 33837/371472 [2:41:49<28:25:21,  3.30it/s]
  9%|▉         | 33838/371472 [2:41:50<28:17:04,  3.32it/s]
  9%|▉         | 33839/371472 [2:41:50<26:41:09,  3.51it/s]
  9%|▉         | 33840/371472 [2:41:50<28:29:08,  3.29it/s]
                                                           
{'loss': 4.6842, 'learning_rate': 9.184533172445e-07, 'epoch': 1.46}

  9%|▉         | 33840/371472 [2:41:50<28:29:08,  3.29it/s]
  9%|▉         | 33841/371472 [2:41:50<27:21:05,  3.43it/s]
  9%|▉         | 33842/371472 [2:41:51<27:17:54,  3.44it/s]
  9%|▉         | 33843/371472 [2:41:51<27:16:29,  3.44it/s]
  9%|▉         | 33844/371472 [2:41:51<27:56:48,  3.36it/s]
  9%|▉         | 33845/371472 [2:41:52<27:58:37,  3.35it/s]
  9%|▉         | 33846/371472 [2:41:52<28:39:20,  3.27it/s]
  9%|▉         | 33847/371472 [2:41:52<27:26:40,  3.42it/s]
  9%|▉         | 33848/371472 [2:41:52<26:11:29,  3.58it/s]
  9%|▉         | 33849/371472 [2:41:53<26:05:21,  3.59it/s]
  9%|▉         | 33850/371472 [2:41:53<27:28:14,  3.41it/s]
  9%|▉         | 33851/371472 [2:41:53<27:23:30,  3.42it/s]
  9%|▉         | 33852/371472 [2:41:54<26:28:47,  3.54it/s]
  9%|▉         | 33853/371472 [2:41:54<26:20:14,  3.56it/s]
  9%|▉         | 33854/371472 [2:41:54<25:52:37,  3.62it/s]
  9%|▉         | 33855/371472 [2:41:54<25:52:54,  3.62it/s]
  9%|▉         | 33856/371472 [2:41:55<26:03:18,  3.60it/s]
  9%|▉         | 33857/371472 [2:41:55<25:30:02,  3.68it/s]
  9%|▉         | 33858/371472 [2:41:55<25:12:10,  3.72it/s]
  9%|▉         | 33859/371472 [2:41:56<27:46:39,  3.38it/s]
  9%|▉         | 33860/371472 [2:41:56<28:29:04,  3.29it/s]
                                                           
{'loss': 4.4481, 'learning_rate': 9.18404835269021e-07, 'epoch': 1.46}

  9%|▉         | 33860/371472 [2:41:56<28:29:04,  3.29it/s]
  9%|▉         | 33861/371472 [2:41:56<28:01:32,  3.35it/s]
  9%|▉         | 33862/371472 [2:41:56<27:50:39,  3.37it/s]
  9%|▉         | 33863/371472 [2:41:57<29:45:08,  3.15it/s]
  9%|▉         | 33864/371472 [2:41:57<28:36:36,  3.28it/s]
  9%|▉         | 33865/371472 [2:41:57<27:58:49,  3.35it/s]
  9%|▉         | 33866/371472 [2:41:58<28:01:23,  3.35it/s]
  9%|▉         | 33867/371472 [2:41:58<27:10:21,  3.45it/s]
  9%|▉         | 33868/371472 [2:41:58<29:20:05,  3.20it/s]
  9%|▉         | 33869/371472 [2:41:59<28:45:50,  3.26it/s]
  9%|▉         | 33870/371472 [2:41:59<27:23:04,  3.42it/s]
  9%|▉         | 33871/371472 [2:41:59<27:33:34,  3.40it/s]
  9%|▉         | 33872/371472 [2:41:59<27:00:41,  3.47it/s]
  9%|▉         | 33873/371472 [2:42:00<28:15:14,  3.32it/s]
  9%|▉         | 33874/371472 [2:42:00<27:40:12,  3.39it/s]
  9%|▉         | 33875/371472 [2:42:00<28:05:42,  3.34it/s]
  9%|▉         | 33876/371472 [2:42:01<26:34:54,  3.53it/s]
  9%|▉         | 33877/371472 [2:42:01<25:55:39,  3.62it/s]
  9%|▉         | 33878/371472 [2:42:01<26:07:53,  3.59it/s]
  9%|▉         | 33879/371472 [2:42:01<25:23:16,  3.69it/s]
  9%|▉         | 33880/371472 [2:42:02<24:48:17,  3.78it/s]
                                                           
{'loss': 4.7234, 'learning_rate': 9.183563532935422e-07, 'epoch': 1.46}

  9%|▉         | 33880/371472 [2:42:02<24:48:17,  3.78it/s]
  9%|▉         | 33881/371472 [2:42:02<25:14:51,  3.71it/s]
  9%|▉         | 33882/371472 [2:42:02<25:09:24,  3.73it/s]
  9%|▉         | 33883/371472 [2:42:03<26:40:26,  3.52it/s]
  9%|▉         | 33884/371472 [2:42:03<25:48:48,  3.63it/s]
  9%|▉         | 33885/371472 [2:42:03<25:59:22,  3.61it/s]
  9%|▉         | 33886/371472 [2:42:03<26:01:29,  3.60it/s]
  9%|▉         | 33887/371472 [2:42:04<27:59:27,  3.35it/s]
  9%|▉         | 33888/371472 [2:42:04<26:49:10,  3.50it/s]
  9%|▉         | 33889/371472 [2:42:04<26:49:14,  3.50it/s]
  9%|▉         | 33890/371472 [2:42:04<26:01:49,  3.60it/s]
  9%|▉         | 33891/371472 [2:42:05<25:24:26,  3.69it/s]
  9%|▉         | 33892/371472 [2:42:05<24:53:26,  3.77it/s]
  9%|▉         | 33893/371472 [2:42:05<25:16:00,  3.71it/s]
  9%|▉         | 33894/371472 [2:42:06<25:17:41,  3.71it/s]
  9%|▉         | 33895/371472 [2:42:06<26:44:39,  3.51it/s]
  9%|▉         | 33896/371472 [2:42:06<26:08:06,  3.59it/s]
  9%|▉         | 33897/371472 [2:42:06<26:09:59,  3.58it/s]
  9%|▉         | 33898/371472 [2:42:07<25:36:09,  3.66it/s]
  9%|▉         | 33899/371472 [2:42:07<25:20:24,  3.70it/s]
  9%|▉         | 33900/371472 [2:42:07<24:52:19,  3.77it/s]
                                                           
{'loss': 4.6209, 'learning_rate': 9.183078713180632e-07, 'epoch': 1.46}

  9%|▉         | 33900/371472 [2:42:07<24:52:19,  3.77it/s]
  9%|▉         | 33901/371472 [2:42:07<25:27:37,  3.68it/s]
  9%|▉         | 33902/371472 [2:42:08<25:10:24,  3.72it/s]
  9%|▉         | 33903/371472 [2:42:08<25:14:04,  3.72it/s]
  9%|▉         | 33904/371472 [2:42:08<26:07:09,  3.59it/s]
  9%|▉         | 33905/371472 [2:42:09<25:44:43,  3.64it/s]
  9%|▉         | 33906/371472 [2:42:09<25:00:10,  3.75it/s]
  9%|▉         | 33907/371472 [2:42:09<24:58:32,  3.75it/s]
  9%|▉         | 33908/371472 [2:42:09<24:30:31,  3.83it/s]
  9%|▉         | 33909/371472 [2:42:10<25:18:03,  3.71it/s]
  9%|▉         | 33910/371472 [2:42:10<24:54:10,  3.77it/s]
  9%|▉         | 33911/371472 [2:42:10<27:07:44,  3.46it/s]
  9%|▉         | 33912/371472 [2:42:10<26:27:08,  3.54it/s]
  9%|▉         | 33913/371472 [2:42:11<25:48:07,  3.63it/s]
  9%|▉         | 33914/371472 [2:42:11<25:38:36,  3.66it/s]
  9%|▉         | 33915/371472 [2:42:11<24:49:35,  3.78it/s]
  9%|▉         | 33916/371472 [2:42:12<24:22:59,  3.85it/s]
  9%|▉         | 33917/371472 [2:42:12<24:35:24,  3.81it/s]
  9%|▉         | 33918/371472 [2:42:12<24:57:32,  3.76it/s]
  9%|▉         | 33919/371472 [2:42:12<26:20:50,  3.56it/s]
  9%|▉         | 33920/371472 [2:42:13<26:47:48,  3.50it/s]
                                                           
{'loss': 4.486, 'learning_rate': 9.182593893425844e-07, 'epoch': 1.46}

  9%|▉         | 33920/371472 [2:42:13<26:47:48,  3.50it/s]
  9%|▉         | 33921/371472 [2:42:13<26:09:31,  3.58it/s]
  9%|▉         | 33922/371472 [2:42:13<28:34:33,  3.28it/s]
  9%|▉         | 33923/371472 [2:42:14<28:19:49,  3.31it/s]
  9%|▉         | 33924/371472 [2:42:14<27:19:18,  3.43it/s]
  9%|▉         | 33925/371472 [2:42:14<27:19:01,  3.43it/s]
  9%|▉         | 33926/371472 [2:42:14<26:09:31,  3.58it/s]
  9%|▉         | 33927/371472 [2:42:15<25:50:57,  3.63it/s]
  9%|▉         | 33928/371472 [2:42:15<25:42:34,  3.65it/s]
  9%|▉         | 33929/371472 [2:42:15<25:36:02,  3.66it/s]
  9%|▉         | 33930/371472 [2:42:15<25:04:22,  3.74it/s]
  9%|▉         | 33931/371472 [2:42:16<25:14:39,  3.71it/s]
  9%|▉         | 33932/371472 [2:42:16<25:20:26,  3.70it/s]
  9%|▉         | 33933/371472 [2:42:16<25:01:07,  3.75it/s]
  9%|▉         | 33934/371472 [2:42:17<24:08:53,  3.88it/s]
  9%|▉         | 33935/371472 [2:42:17<24:40:28,  3.80it/s]
  9%|▉         | 33936/371472 [2:42:17<25:33:57,  3.67it/s]
  9%|▉         | 33937/371472 [2:42:17<24:55:56,  3.76it/s]
  9%|▉         | 33938/371472 [2:42:18<24:46:30,  3.78it/s]
  9%|▉         | 33939/371472 [2:42:18<25:42:11,  3.65it/s]
  9%|▉         | 33940/371472 [2:42:18<25:19:57,  3.70it/s]
                                                           
{'loss': 4.6013, 'learning_rate': 9.182109073671055e-07, 'epoch': 1.46}

  9%|▉         | 33940/371472 [2:42:18<25:19:57,  3.70it/s]
  9%|▉         | 33941/371472 [2:42:18<25:15:34,  3.71it/s]
  9%|▉         | 33942/371472 [2:42:19<26:40:34,  3.51it/s]
  9%|▉         | 33943/371472 [2:42:19<26:42:17,  3.51it/s]
  9%|▉         | 33944/371472 [2:42:19<26:54:23,  3.48it/s]
  9%|▉         | 33945/371472 [2:42:20<25:51:45,  3.63it/s]
  9%|▉         | 33946/371472 [2:42:20<25:57:05,  3.61it/s]
  9%|▉         | 33947/371472 [2:42:20<25:57:27,  3.61it/s]
  9%|▉         | 33948/371472 [2:42:20<27:16:27,  3.44it/s]
  9%|▉         | 33949/371472 [2:42:21<27:25:57,  3.42it/s]
  9%|▉         | 33950/371472 [2:42:21<27:26:29,  3.42it/s]
  9%|▉         | 33951/371472 [2:42:21<26:57:31,  3.48it/s]
  9%|▉         | 33952/371472 [2:42:22<29:07:26,  3.22it/s]
  9%|▉         | 33953/371472 [2:42:22<28:13:09,  3.32it/s]
  9%|▉         | 33954/371472 [2:42:22<29:45:17,  3.15it/s]
  9%|▉         | 33955/371472 [2:42:23<27:46:16,  3.38it/s]
  9%|▉         | 33956/371472 [2:42:23<26:53:45,  3.49it/s]
  9%|▉         | 33957/371472 [2:42:23<25:48:31,  3.63it/s]
  9%|▉         | 33958/371472 [2:42:23<24:53:00,  3.77it/s]
  9%|▉         | 33959/371472 [2:42:24<25:28:12,  3.68it/s]
  9%|▉         | 33960/371472 [2:42:24<25:46:45,  3.64it/s]
                                                           
{'loss': 4.4464, 'learning_rate': 9.181624253916267e-07, 'epoch': 1.46}

  9%|▉         | 33960/371472 [2:42:24<25:46:45,  3.64it/s]
  9%|▉         | 33961/371472 [2:42:24<27:11:14,  3.45it/s]
  9%|▉         | 33962/371472 [2:42:25<29:04:09,  3.23it/s]
  9%|▉         | 33963/371472 [2:42:25<28:47:34,  3.26it/s]
  9%|▉         | 33964/371472 [2:42:25<28:51:32,  3.25it/s]
  9%|▉         | 33965/371472 [2:42:25<29:09:09,  3.22it/s]
  9%|▉         | 33966/371472 [2:42:26<28:39:16,  3.27it/s]
  9%|▉         | 33967/371472 [2:42:26<29:11:00,  3.21it/s]
  9%|▉         | 33968/371472 [2:42:26<29:34:57,  3.17it/s]
  9%|▉         | 33969/371472 [2:42:27<28:39:50,  3.27it/s]
  9%|▉         | 33970/371472 [2:42:27<27:25:23,  3.42it/s]
  9%|▉         | 33971/371472 [2:42:27<26:29:25,  3.54it/s]
  9%|▉         | 33972/371472 [2:42:28<26:33:09,  3.53it/s]
  9%|▉         | 33973/371472 [2:42:28<27:44:24,  3.38it/s]
  9%|▉         | 33974/371472 [2:42:28<27:00:31,  3.47it/s]
  9%|▉         | 33975/371472 [2:42:28<27:10:10,  3.45it/s]
  9%|▉         | 33976/371472 [2:42:29<26:57:32,  3.48it/s]
  9%|▉         | 33977/371472 [2:42:29<26:21:37,  3.56it/s]
  9%|▉         | 33978/371472 [2:42:29<26:33:36,  3.53it/s]
  9%|▉         | 33979/371472 [2:42:30<26:43:43,  3.51it/s]
  9%|▉         | 33980/371472 [2:42:30<26:26:15,  3.55it/s]
                                                           
{'loss': 4.5521, 'learning_rate': 9.181139434161476e-07, 'epoch': 1.46}

  9%|▉         | 33980/371472 [2:42:30<26:26:15,  3.55it/s]
  9%|▉         | 33981/371472 [2:42:30<26:38:45,  3.52it/s]
  9%|▉         | 33982/371472 [2:42:30<25:40:36,  3.65it/s]
  9%|▉         | 33983/371472 [2:42:31<25:25:04,  3.69it/s]
  9%|▉         | 33984/371472 [2:42:31<25:27:33,  3.68it/s]
  9%|▉         | 33985/371472 [2:42:31<25:44:58,  3.64it/s]
  9%|▉         | 33986/371472 [2:42:31<27:03:55,  3.46it/s]
  9%|▉         | 33987/371472 [2:42:32<26:47:42,  3.50it/s]
  9%|▉         | 33988/371472 [2:42:32<26:42:23,  3.51it/s]
  9%|▉         | 33989/371472 [2:42:32<25:41:04,  3.65it/s]
  9%|▉         | 33990/371472 [2:42:33<25:03:55,  3.74it/s]
  9%|▉         | 33991/371472 [2:42:33<26:50:28,  3.49it/s]
  9%|▉         | 33992/371472 [2:42:33<26:54:49,  3.48it/s]
  9%|▉         | 33993/371472 [2:42:33<26:08:05,  3.59it/s]
  9%|▉         | 33994/371472 [2:42:34<25:44:02,  3.64it/s]
  9%|▉         | 33995/371472 [2:42:34<25:58:05,  3.61it/s]
  9%|▉         | 33996/371472 [2:42:34<27:51:01,  3.37it/s]
  9%|▉         | 33997/371472 [2:42:35<27:42:47,  3.38it/s]
  9%|▉         | 33998/371472 [2:42:35<29:14:35,  3.21it/s]
  9%|▉         | 33999/371472 [2:42:35<27:51:45,  3.36it/s]
  9%|▉         | 34000/371472 [2:42:35<26:47:38,  3.50it/s]
                                                           
{'loss': 4.5197, 'learning_rate': 9.180654614406688e-07, 'epoch': 1.46}

  9%|▉         | 34000/371472 [2:42:35<26:47:38,  3.50it/s]
  9%|▉         | 34001/371472 [2:42:36<27:46:10,  3.38it/s]
  9%|▉         | 34002/371472 [2:42:36<28:52:38,  3.25it/s]
  9%|▉         | 34003/371472 [2:42:36<28:59:56,  3.23it/s]
  9%|▉         | 34004/371472 [2:42:37<27:45:02,  3.38it/s]
  9%|▉         | 34005/371472 [2:42:37<26:32:55,  3.53it/s]
  9%|▉         | 34006/371472 [2:42:37<28:12:03,  3.32it/s]
  9%|▉         | 34007/371472 [2:42:38<26:56:39,  3.48it/s]
  9%|▉         | 34008/371472 [2:42:38<27:33:03,  3.40it/s]
  9%|▉         | 34009/371472 [2:42:38<28:17:18,  3.31it/s]
  9%|▉         | 34010/371472 [2:42:38<27:54:28,  3.36it/s]
  9%|▉         | 34011/371472 [2:42:39<27:22:18,  3.42it/s]
  9%|▉         | 34012/371472 [2:42:39<26:35:05,  3.53it/s]
  9%|▉         | 34013/371472 [2:42:39<26:00:36,  3.60it/s]
  9%|▉         | 34014/371472 [2:42:40<27:39:59,  3.39it/s]
  9%|▉         | 34015/371472 [2:42:40<27:04:45,  3.46it/s]
  9%|▉         | 34016/371472 [2:42:40<26:53:24,  3.49it/s]
  9%|▉         | 34017/371472 [2:42:40<25:34:58,  3.66it/s]
  9%|▉         | 34018/371472 [2:42:41<25:35:27,  3.66it/s]
  9%|▉         | 34019/371472 [2:42:41<24:59:27,  3.75it/s]
  9%|▉         | 34020/371472 [2:42:41<25:23:27,  3.69it/s]
                                                           
{'loss': 4.3679, 'learning_rate': 9.180169794651899e-07, 'epoch': 1.47}

  9%|▉         | 34020/371472 [2:42:41<25:23:27,  3.69it/s]
  9%|▉         | 34021/371472 [2:42:42<25:26:08,  3.69it/s]
  9%|▉         | 34022/371472 [2:42:42<25:10:25,  3.72it/s]
  9%|▉         | 34023/371472 [2:42:42<25:40:40,  3.65it/s]
  9%|▉         | 34024/371472 [2:42:42<25:40:44,  3.65it/s]
  9%|▉         | 34025/371472 [2:42:43<25:48:54,  3.63it/s]
  9%|▉         | 34026/371472 [2:42:43<26:04:18,  3.60it/s]
  9%|▉         | 34027/371472 [2:42:43<25:50:07,  3.63it/s]
  9%|▉         | 34028/371472 [2:42:43<25:32:56,  3.67it/s]
  9%|▉         | 34029/371472 [2:42:44<25:12:15,  3.72it/s]
  9%|▉         | 34030/371472 [2:42:44<24:44:45,  3.79it/s]
  9%|▉         | 34031/371472 [2:42:44<24:47:51,  3.78it/s]
  9%|▉         | 34032/371472 [2:42:44<24:24:25,  3.84it/s]
  9%|▉         | 34033/371472 [2:42:45<24:02:00,  3.90it/s]
  9%|▉         | 34034/371472 [2:42:45<24:37:01,  3.81it/s]
  9%|▉         | 34035/371472 [2:42:45<25:12:18,  3.72it/s]
  9%|▉         | 34036/371472 [2:42:46<24:43:38,  3.79it/s]
  9%|▉         | 34037/371472 [2:42:46<25:20:14,  3.70it/s]
  9%|▉         | 34038/371472 [2:42:46<28:25:28,  3.30it/s]
  9%|▉         | 34039/371472 [2:42:46<27:44:37,  3.38it/s]
  9%|▉         | 34040/371472 [2:42:47<26:43:37,  3.51it/s]
                                                           
{'loss': 4.7741, 'learning_rate': 9.17968497489711e-07, 'epoch': 1.47}

  9%|▉         | 34040/371472 [2:42:47<26:43:37,  3.51it/s]
  9%|▉         | 34041/371472 [2:42:47<28:54:42,  3.24it/s]
  9%|▉         | 34042/371472 [2:42:47<29:23:06,  3.19it/s]
  9%|▉         | 34043/371472 [2:42:48<28:18:06,  3.31it/s]
  9%|▉         | 34044/371472 [2:42:48<28:55:44,  3.24it/s]
  9%|▉         | 34045/371472 [2:42:48<29:39:45,  3.16it/s]
  9%|▉         | 34046/371472 [2:42:49<27:34:24,  3.40it/s]
  9%|▉         | 34047/371472 [2:42:49<26:31:23,  3.53it/s]
  9%|▉         | 34048/371472 [2:42:49<29:35:27,  3.17it/s]
  9%|▉         | 34049/371472 [2:42:50<28:34:19,  3.28it/s]
  9%|▉         | 34050/371472 [2:42:50<27:16:43,  3.44it/s]
  9%|▉         | 34051/371472 [2:42:50<26:40:34,  3.51it/s]
  9%|▉         | 34052/371472 [2:42:50<25:43:46,  3.64it/s]
  9%|▉         | 34053/371472 [2:42:51<24:57:44,  3.75it/s]
  9%|▉         | 34054/371472 [2:42:51<25:25:46,  3.69it/s]
  9%|▉         | 34055/371472 [2:42:51<25:32:21,  3.67it/s]
  9%|▉         | 34056/371472 [2:42:51<25:48:07,  3.63it/s]
  9%|▉         | 34057/371472 [2:42:52<25:24:39,  3.69it/s]
  9%|▉         | 34058/371472 [2:42:52<25:14:34,  3.71it/s]
  9%|▉         | 34059/371472 [2:42:52<25:50:56,  3.63it/s]
  9%|▉         | 34060/371472 [2:42:52<26:25:21,  3.55it/s]
                                                           
{'loss': 4.8057, 'learning_rate': 9.179200155142321e-07, 'epoch': 1.47}

  9%|▉         | 34060/371472 [2:42:52<26:25:21,  3.55it/s]
  9%|▉         | 34061/371472 [2:42:53<27:33:04,  3.40it/s]
  9%|▉         | 34062/371472 [2:42:53<27:09:08,  3.45it/s]
  9%|▉         | 34063/371472 [2:42:53<26:27:45,  3.54it/s]
  9%|▉         | 34064/371472 [2:42:54<27:06:17,  3.46it/s]
  9%|▉         | 34065/371472 [2:42:54<26:04:00,  3.60it/s]
  9%|▉         | 34066/371472 [2:42:54<26:10:02,  3.58it/s]
  9%|▉         | 34067/371472 [2:42:54<25:50:33,  3.63it/s]
  9%|▉         | 34068/371472 [2:42:55<25:38:03,  3.66it/s]
  9%|▉         | 34069/371472 [2:42:55<25:33:04,  3.67it/s]
  9%|▉         | 34070/371472 [2:42:55<26:58:59,  3.47it/s]
  9%|▉         | 34071/371472 [2:42:56<27:38:25,  3.39it/s]
  9%|▉         | 34072/371472 [2:42:56<26:29:26,  3.54it/s]
  9%|▉         | 34073/371472 [2:42:56<26:33:41,  3.53it/s]
  9%|▉         | 34074/371472 [2:42:56<26:13:01,  3.57it/s]
  9%|▉         | 34075/371472 [2:42:57<26:27:52,  3.54it/s]
  9%|▉         | 34076/371472 [2:42:57<26:54:38,  3.48it/s]
  9%|▉         | 34077/371472 [2:42:57<26:07:27,  3.59it/s]
  9%|▉         | 34078/371472 [2:42:58<26:14:03,  3.57it/s]
  9%|▉         | 34079/371472 [2:42:58<26:07:17,  3.59it/s]
  9%|▉         | 34080/371472 [2:42:58<26:55:27,  3.48it/s]
                                                           
{'loss': 4.4689, 'learning_rate': 9.178715335387534e-07, 'epoch': 1.47}

  9%|▉         | 34080/371472 [2:42:58<26:55:27,  3.48it/s]
  9%|▉         | 34081/371472 [2:42:58<28:01:29,  3.34it/s]
  9%|▉         | 34082/371472 [2:42:59<27:04:40,  3.46it/s]
  9%|▉         | 34083/371472 [2:42:59<27:35:09,  3.40it/s]
  9%|▉         | 34084/371472 [2:42:59<26:13:57,  3.57it/s]
  9%|▉         | 34085/371472 [2:43:00<25:22:23,  3.69it/s]
  9%|▉         | 34086/371472 [2:43:00<24:36:19,  3.81it/s]
  9%|▉         | 34087/371472 [2:43:00<25:06:19,  3.73it/s]
  9%|▉         | 34088/371472 [2:43:00<26:07:15,  3.59it/s]
  9%|▉         | 34089/371472 [2:43:01<28:01:56,  3.34it/s]
  9%|▉         | 34090/371472 [2:43:01<26:49:21,  3.49it/s]
  9%|▉         | 34091/371472 [2:43:01<26:55:45,  3.48it/s]
  9%|▉         | 34092/371472 [2:43:02<27:11:39,  3.45it/s]
  9%|▉         | 34093/371472 [2:43:02<25:55:53,  3.61it/s]
  9%|▉         | 34094/371472 [2:43:02<26:00:51,  3.60it/s]
  9%|▉         | 34095/371472 [2:43:02<26:40:42,  3.51it/s]
  9%|▉         | 34096/371472 [2:43:03<26:27:55,  3.54it/s]
  9%|▉         | 34097/371472 [2:43:03<26:28:50,  3.54it/s]
  9%|▉         | 34098/371472 [2:43:03<26:11:36,  3.58it/s]
  9%|▉         | 34099/371472 [2:43:04<30:15:57,  3.10it/s]
  9%|▉         | 34100/371472 [2:43:04<29:05:05,  3.22it/s]
                                                           
{'loss': 4.5038, 'learning_rate': 9.178230515632744e-07, 'epoch': 1.47}

  9%|▉         | 34100/371472 [2:43:04<29:05:05,  3.22it/s]
  9%|▉         | 34101/371472 [2:43:04<28:22:41,  3.30it/s]
  9%|▉         | 34102/371472 [2:43:05<27:46:39,  3.37it/s]
  9%|▉         | 34103/371472 [2:43:05<29:07:17,  3.22it/s]
  9%|▉         | 34104/371472 [2:43:05<27:27:24,  3.41it/s]
  9%|▉         | 34105/371472 [2:43:05<27:08:58,  3.45it/s]
  9%|▉         | 34106/371472 [2:43:06<25:56:06,  3.61it/s]
  9%|▉         | 34107/371472 [2:43:06<27:13:00,  3.44it/s]
  9%|▉         | 34108/371472 [2:43:06<27:32:37,  3.40it/s]
  9%|▉         | 34109/371472 [2:43:07<27:30:37,  3.41it/s]
  9%|▉         | 34110/371472 [2:43:07<26:03:38,  3.60it/s]
  9%|▉         | 34111/371472 [2:43:07<25:13:54,  3.71it/s]
  9%|▉         | 34112/371472 [2:43:07<24:50:45,  3.77it/s]
  9%|▉         | 34113/371472 [2:43:08<25:22:20,  3.69it/s]
  9%|▉         | 34114/371472 [2:43:08<25:29:49,  3.68it/s]
  9%|▉         | 34115/371472 [2:43:08<26:33:55,  3.53it/s]
  9%|▉         | 34116/371472 [2:43:08<27:07:12,  3.46it/s]
  9%|▉         | 34117/371472 [2:43:09<27:20:42,  3.43it/s]
  9%|▉         | 34118/371472 [2:43:09<26:53:25,  3.48it/s]
  9%|▉         | 34119/371472 [2:43:09<26:53:20,  3.49it/s]
  9%|▉         | 34120/371472 [2:43:10<26:39:14,  3.52it/s]
                                                           
{'loss': 4.6934, 'learning_rate': 9.177745695877953e-07, 'epoch': 1.47}

  9%|▉         | 34120/371472 [2:43:10<26:39:14,  3.52it/s]
  9%|▉         | 34121/371472 [2:43:10<26:39:28,  3.52it/s]
  9%|▉         | 34122/371472 [2:43:10<26:18:05,  3.56it/s]
  9%|▉         | 34123/371472 [2:43:10<26:50:54,  3.49it/s]
  9%|▉         | 34124/371472 [2:43:11<25:55:36,  3.61it/s]
  9%|▉         | 34125/371472 [2:43:11<25:55:36,  3.61it/s]
  9%|▉         | 34126/371472 [2:43:11<26:34:07,  3.53it/s]
  9%|▉         | 34127/371472 [2:43:12<28:02:56,  3.34it/s]
  9%|▉         | 34128/371472 [2:43:12<29:10:35,  3.21it/s]
  9%|▉         | 34129/371472 [2:43:12<28:53:32,  3.24it/s]
  9%|▉         | 34130/371472 [2:43:13<28:36:58,  3.27it/s]
  9%|▉         | 34131/371472 [2:43:13<28:21:53,  3.30it/s]
  9%|▉         | 34132/371472 [2:43:13<27:35:38,  3.40it/s]
  9%|▉         | 34133/371472 [2:43:13<27:07:05,  3.46it/s]
  9%|▉         | 34134/371472 [2:43:14<26:51:04,  3.49it/s]
  9%|▉         | 34135/371472 [2:43:14<26:56:14,  3.48it/s]
  9%|▉         | 34136/371472 [2:43:14<26:00:52,  3.60it/s]
  9%|▉         | 34137/371472 [2:43:15<26:16:02,  3.57it/s]
  9%|▉         | 34138/371472 [2:43:15<27:16:29,  3.44it/s]
  9%|▉         | 34139/371472 [2:43:15<26:24:43,  3.55it/s]
  9%|▉         | 34140/371472 [2:43:15<25:57:18,  3.61it/s]
                                                           
{'loss': 4.5616, 'learning_rate': 9.177260876123165e-07, 'epoch': 1.47}

  9%|▉         | 34140/371472 [2:43:15<25:57:18,  3.61it/s]
  9%|▉         | 34141/371472 [2:43:16<26:15:47,  3.57it/s]
  9%|▉         | 34142/371472 [2:43:16<25:35:18,  3.66it/s]
  9%|▉         | 34143/371472 [2:43:16<25:44:50,  3.64it/s]
  9%|▉         | 34144/371472 [2:43:16<25:13:05,  3.72it/s]
  9%|▉         | 34145/371472 [2:43:17<25:35:12,  3.66it/s]
  9%|▉         | 34146/371472 [2:43:17<25:43:02,  3.64it/s]
  9%|▉         | 34147/371472 [2:43:17<26:08:06,  3.59it/s]
  9%|▉         | 34148/371472 [2:43:18<25:37:51,  3.66it/s]
  9%|▉         | 34149/371472 [2:43:18<26:15:11,  3.57it/s]
  9%|▉         | 34150/371472 [2:43:18<27:42:42,  3.38it/s]
  9%|▉         | 34151/371472 [2:43:18<27:15:19,  3.44it/s]
  9%|▉         | 34152/371472 [2:43:19<29:19:29,  3.20it/s]
  9%|▉         | 34153/371472 [2:43:19<29:32:29,  3.17it/s]
  9%|▉         | 34154/371472 [2:43:20<30:51:35,  3.04it/s]
  9%|▉         | 34155/371472 [2:43:20<29:14:10,  3.20it/s]
  9%|▉         | 34156/371472 [2:43:20<29:49:55,  3.14it/s]
  9%|▉         | 34157/371472 [2:43:20<29:41:26,  3.16it/s]
  9%|▉         | 34158/371472 [2:43:21<27:26:22,  3.41it/s]
  9%|▉         | 34159/371472 [2:43:21<27:14:16,  3.44it/s]
  9%|▉         | 34160/371472 [2:43:21<25:54:01,  3.62it/s]
                                                           
{'loss': 4.5588, 'learning_rate': 9.176776056368377e-07, 'epoch': 1.47}

  9%|▉         | 34160/371472 [2:43:21<25:54:01,  3.62it/s]
  9%|▉         | 34161/371472 [2:43:21<25:58:14,  3.61it/s]
  9%|▉         | 34162/371472 [2:43:22<26:34:08,  3.53it/s]
  9%|▉         | 34163/371472 [2:43:22<26:24:35,  3.55it/s]
  9%|▉         | 34164/371472 [2:43:22<26:40:18,  3.51it/s]
  9%|▉         | 34165/371472 [2:43:23<26:45:19,  3.50it/s]
  9%|▉         | 34166/371472 [2:43:23<26:02:33,  3.60it/s]
  9%|▉         | 34167/371472 [2:43:23<26:50:19,  3.49it/s]
  9%|▉         | 34168/371472 [2:43:23<25:37:08,  3.66it/s]
  9%|▉         | 34169/371472 [2:43:24<26:17:44,  3.56it/s]
  9%|▉         | 34170/371472 [2:43:24<27:01:51,  3.47it/s]
  9%|▉         | 34171/371472 [2:43:24<27:19:26,  3.43it/s]
  9%|▉         | 34172/371472 [2:43:25<27:03:47,  3.46it/s]
  9%|▉         | 34173/371472 [2:43:25<26:59:24,  3.47it/s]
  9%|▉         | 34174/371472 [2:43:25<25:50:13,  3.63it/s]
  9%|▉         | 34175/371472 [2:43:25<25:32:01,  3.67it/s]
  9%|▉         | 34176/371472 [2:43:26<24:56:06,  3.76it/s]
  9%|▉         | 34177/371472 [2:43:26<24:48:35,  3.78it/s]
  9%|▉         | 34178/371472 [2:43:26<24:48:58,  3.78it/s]
  9%|▉         | 34179/371472 [2:43:26<24:08:39,  3.88it/s]
  9%|▉         | 34180/371472 [2:43:27<24:45:39,  3.78it/s]
                                                           
{'loss': 4.5878, 'learning_rate': 9.176291236613588e-07, 'epoch': 1.47}

  9%|▉         | 34180/371472 [2:43:27<24:45:39,  3.78it/s]
  9%|▉         | 34181/371472 [2:43:27<27:41:54,  3.38it/s]
  9%|▉         | 34182/371472 [2:43:27<27:55:41,  3.35it/s]
  9%|▉         | 34183/371472 [2:43:28<27:25:17,  3.42it/s]
  9%|▉         | 34184/371472 [2:43:28<26:06:45,  3.59it/s]
  9%|▉         | 34185/371472 [2:43:28<26:28:43,  3.54it/s]
  9%|▉         | 34186/371472 [2:43:28<25:22:59,  3.69it/s]
  9%|▉         | 34187/371472 [2:43:29<25:16:08,  3.71it/s]
  9%|▉         | 34188/371472 [2:43:29<25:35:58,  3.66it/s]
  9%|▉         | 34189/371472 [2:43:29<25:19:53,  3.70it/s]
  9%|▉         | 34190/371472 [2:43:30<27:29:08,  3.41it/s]
  9%|▉         | 34191/371472 [2:43:30<26:30:26,  3.53it/s]
  9%|▉         | 34192/371472 [2:43:30<27:37:38,  3.39it/s]
  9%|▉         | 34193/371472 [2:43:30<27:08:35,  3.45it/s]
  9%|▉         | 34194/371472 [2:43:31<27:08:06,  3.45it/s]
  9%|▉         | 34195/371472 [2:43:31<26:06:52,  3.59it/s]
  9%|▉         | 34196/371472 [2:43:31<26:01:17,  3.60it/s]
  9%|▉         | 34197/371472 [2:43:32<27:17:15,  3.43it/s]
  9%|▉         | 34198/371472 [2:43:32<26:39:06,  3.52it/s]
  9%|▉         | 34199/371472 [2:43:32<26:24:29,  3.55it/s]
  9%|▉         | 34200/371472 [2:43:32<27:14:04,  3.44it/s]
                                                           
{'loss': 4.4511, 'learning_rate': 9.175806416858798e-07, 'epoch': 1.47}

  9%|▉         | 34200/371472 [2:43:32<27:14:04,  3.44it/s]
  9%|▉         | 34201/371472 [2:43:33<25:59:05,  3.61it/s]
  9%|▉         | 34202/371472 [2:43:33<27:10:18,  3.45it/s]
  9%|▉         | 34203/371472 [2:43:33<27:04:35,  3.46it/s]
  9%|▉         | 34204/371472 [2:43:34<27:06:29,  3.46it/s]
  9%|▉         | 34205/371472 [2:43:34<27:46:19,  3.37it/s]
  9%|▉         | 34206/371472 [2:43:34<27:46:02,  3.37it/s]
  9%|▉         | 34207/371472 [2:43:34<27:06:32,  3.46it/s]
  9%|▉         | 34208/371472 [2:43:35<26:05:05,  3.59it/s]
  9%|▉         | 34209/371472 [2:43:35<27:26:27,  3.41it/s]
  9%|▉         | 34210/371472 [2:43:35<28:26:11,  3.29it/s]
  9%|▉         | 34211/371472 [2:43:36<29:36:16,  3.16it/s]
  9%|▉         | 34212/371472 [2:43:36<27:54:57,  3.36it/s]
  9%|▉         | 34213/371472 [2:43:36<27:09:58,  3.45it/s]
  9%|▉         | 34214/371472 [2:43:37<27:49:18,  3.37it/s]
  9%|▉         | 34215/371472 [2:43:37<27:27:14,  3.41it/s]
  9%|▉         | 34216/371472 [2:43:37<27:09:00,  3.45it/s]
  9%|▉         | 34217/371472 [2:43:37<27:11:41,  3.44it/s]
  9%|▉         | 34218/371472 [2:43:38<27:24:08,  3.42it/s]
  9%|▉         | 34219/371472 [2:43:38<26:12:31,  3.57it/s]
  9%|▉         | 34220/371472 [2:43:38<27:28:41,  3.41it/s]
                                                           
{'loss': 4.3849, 'learning_rate': 9.17532159710401e-07, 'epoch': 1.47}

  9%|▉         | 34220/371472 [2:43:38<27:28:41,  3.41it/s]
  9%|▉         | 34221/371472 [2:43:39<28:20:29,  3.31it/s]
  9%|▉         | 34222/371472 [2:43:39<27:30:24,  3.41it/s]
  9%|▉         | 34223/371472 [2:43:39<26:18:12,  3.56it/s]
  9%|▉         | 34224/371472 [2:43:39<27:23:07,  3.42it/s]
  9%|▉         | 34225/371472 [2:43:40<27:55:24,  3.35it/s]
  9%|▉         | 34226/371472 [2:43:40<28:26:27,  3.29it/s]
  9%|▉         | 34227/371472 [2:43:40<28:26:04,  3.29it/s]
  9%|▉         | 34228/371472 [2:43:41<27:47:17,  3.37it/s]
  9%|▉         | 34229/371472 [2:43:41<27:04:22,  3.46it/s]
  9%|▉         | 34230/371472 [2:43:41<27:06:42,  3.46it/s]
  9%|▉         | 34231/371472 [2:43:42<26:12:09,  3.58it/s]
  9%|▉         | 34232/371472 [2:43:42<26:17:25,  3.56it/s]
  9%|▉         | 34233/371472 [2:43:42<26:25:51,  3.54it/s]
  9%|▉         | 34234/371472 [2:43:42<27:02:07,  3.46it/s]
  9%|▉         | 34235/371472 [2:43:43<26:41:45,  3.51it/s]
  9%|▉         | 34236/371472 [2:43:43<26:39:05,  3.51it/s]
  9%|▉         | 34237/371472 [2:43:43<25:53:44,  3.62it/s]
  9%|▉         | 34238/371472 [2:43:43<25:19:34,  3.70it/s]
  9%|▉         | 34239/371472 [2:43:44<25:40:54,  3.65it/s]
  9%|▉         | 34240/371472 [2:43:44<25:05:34,  3.73it/s]
                                                           
{'loss': 4.573, 'learning_rate': 9.17483677734922e-07, 'epoch': 1.47}

  9%|▉         | 34240/371472 [2:43:44<25:05:34,  3.73it/s]
  9%|▉         | 34241/371472 [2:43:44<25:25:58,  3.68it/s]
  9%|▉         | 34242/371472 [2:43:45<27:06:50,  3.45it/s]
  9%|▉         | 34243/371472 [2:43:45<31:04:40,  3.01it/s]
  9%|▉         | 34244/371472 [2:43:45<30:48:14,  3.04it/s]
  9%|▉         | 34245/371472 [2:43:46<30:02:10,  3.12it/s]
  9%|▉         | 34246/371472 [2:43:46<30:03:42,  3.12it/s]
  9%|▉         | 34247/371472 [2:43:46<28:42:37,  3.26it/s]
  9%|▉         | 34248/371472 [2:43:47<28:21:59,  3.30it/s]
  9%|▉         | 34249/371472 [2:43:47<27:48:37,  3.37it/s]
  9%|▉         | 34250/371472 [2:43:47<27:34:06,  3.40it/s]
  9%|▉         | 34251/371472 [2:43:47<27:12:09,  3.44it/s]
  9%|▉         | 34252/371472 [2:43:48<28:24:44,  3.30it/s]
  9%|▉         | 34253/371472 [2:43:48<27:52:02,  3.36it/s]
  9%|▉         | 34254/371472 [2:43:48<28:20:02,  3.31it/s]
  9%|▉         | 34255/371472 [2:43:49<27:33:10,  3.40it/s]
  9%|▉         | 34256/371472 [2:43:49<28:53:25,  3.24it/s]
  9%|▉         | 34257/371472 [2:43:49<27:47:06,  3.37it/s]
  9%|▉         | 34258/371472 [2:43:49<26:43:23,  3.51it/s]
  9%|▉         | 34259/371472 [2:43:50<26:49:19,  3.49it/s]
  9%|▉         | 34260/371472 [2:43:50<26:00:57,  3.60it/s]
                                                           
{'loss': 4.6106, 'learning_rate': 9.174351957594432e-07, 'epoch': 1.48}

  9%|▉         | 34260/371472 [2:43:50<26:00:57,  3.60it/s]
  9%|▉         | 34261/371472 [2:43:50<27:29:51,  3.41it/s]
  9%|▉         | 34262/371472 [2:43:51<27:00:34,  3.47it/s]
  9%|▉         | 34263/371472 [2:43:51<27:06:40,  3.45it/s]
  9%|▉         | 34264/371472 [2:43:51<26:33:56,  3.53it/s]
  9%|▉         | 34265/371472 [2:43:51<26:13:20,  3.57it/s]
  9%|▉         | 34266/371472 [2:43:52<26:26:00,  3.54it/s]
  9%|▉         | 34267/371472 [2:43:52<25:53:44,  3.62it/s]
  9%|▉         | 34268/371472 [2:43:52<25:37:44,  3.65it/s]
  9%|▉         | 34269/371472 [2:43:53<26:00:03,  3.60it/s]
  9%|▉         | 34270/371472 [2:43:53<26:42:15,  3.51it/s]
  9%|▉         | 34271/371472 [2:43:53<26:25:08,  3.55it/s]
  9%|▉         | 34272/371472 [2:43:54<29:04:20,  3.22it/s]
  9%|▉         | 34273/371472 [2:43:54<29:08:09,  3.21it/s]
  9%|▉         | 34274/371472 [2:43:54<28:14:18,  3.32it/s]
  9%|▉         | 34275/371472 [2:43:54<27:37:53,  3.39it/s]
  9%|▉         | 34276/371472 [2:43:55<26:07:48,  3.58it/s]
  9%|▉         | 34277/371472 [2:43:55<25:01:02,  3.74it/s]
  9%|▉         | 34278/371472 [2:43:55<26:46:17,  3.50it/s]
  9%|▉         | 34279/371472 [2:43:56<28:56:50,  3.24it/s]
  9%|▉         | 34280/371472 [2:43:56<28:35:00,  3.28it/s]
                                                           
{'loss': 4.5424, 'learning_rate': 9.173867137839642e-07, 'epoch': 1.48}

  9%|▉         | 34280/371472 [2:43:56<28:35:00,  3.28it/s]
  9%|▉         | 34281/371472 [2:43:56<28:32:16,  3.28it/s]
  9%|▉         | 34282/371472 [2:43:56<27:47:19,  3.37it/s]
  9%|▉         | 34283/371472 [2:43:57<27:11:30,  3.44it/s]
  9%|▉         | 34284/371472 [2:43:57<26:38:55,  3.51it/s]
  9%|▉         | 34285/371472 [2:43:57<28:37:33,  3.27it/s]
  9%|▉         | 34286/371472 [2:43:58<28:01:54,  3.34it/s]
  9%|▉         | 34287/371472 [2:43:58<27:56:51,  3.35it/s]
  9%|▉         | 34288/371472 [2:43:58<28:09:33,  3.33it/s]
  9%|▉         | 34289/371472 [2:43:59<27:39:38,  3.39it/s]
  9%|▉         | 34290/371472 [2:43:59<28:09:17,  3.33it/s]
  9%|▉         | 34291/371472 [2:43:59<28:01:26,  3.34it/s]
  9%|▉         | 34292/371472 [2:43:59<28:44:24,  3.26it/s]
  9%|▉         | 34293/371472 [2:44:00<27:29:27,  3.41it/s]
  9%|▉         | 34294/371472 [2:44:00<27:00:57,  3.47it/s]
  9%|▉         | 34295/371472 [2:44:00<26:00:54,  3.60it/s]
  9%|▉         | 34296/371472 [2:44:01<25:34:37,  3.66it/s]
  9%|▉         | 34297/371472 [2:44:01<25:19:42,  3.70it/s]
  9%|▉         | 34298/371472 [2:44:01<26:55:52,  3.48it/s]
  9%|▉         | 34299/371472 [2:44:01<26:18:45,  3.56it/s]
  9%|▉         | 34300/371472 [2:44:02<28:00:14,  3.34it/s]
                                                           
{'loss': 4.3785, 'learning_rate': 9.173382318084854e-07, 'epoch': 1.48}

  9%|▉         | 34300/371472 [2:44:02<28:00:14,  3.34it/s]
  9%|▉         | 34301/371472 [2:44:02<29:52:57,  3.13it/s]
  9%|▉         | 34302/371472 [2:44:02<28:09:35,  3.33it/s]
  9%|▉         | 34303/371472 [2:44:03<27:45:01,  3.38it/s]
  9%|▉         | 34304/371472 [2:44:03<27:55:58,  3.35it/s]
  9%|▉         | 34305/371472 [2:44:03<27:06:28,  3.45it/s]
  9%|▉         | 34306/371472 [2:44:03<26:42:36,  3.51it/s]
  9%|▉         | 34307/371472 [2:44:04<27:26:18,  3.41it/s]
  9%|▉         | 34308/371472 [2:44:04<26:49:48,  3.49it/s]
  9%|▉         | 34309/371472 [2:44:04<26:17:23,  3.56it/s]
  9%|▉         | 34310/371472 [2:44:05<30:03:46,  3.12it/s]
  9%|▉         | 34311/371472 [2:44:05<28:16:05,  3.31it/s]
  9%|▉         | 34312/371472 [2:44:05<27:25:14,  3.42it/s]
  9%|▉         | 34313/371472 [2:44:06<26:40:05,  3.51it/s]
  9%|▉         | 34314/371472 [2:44:06<25:27:46,  3.68it/s]
  9%|▉         | 34315/371472 [2:44:06<26:49:43,  3.49it/s]
  9%|▉         | 34316/371472 [2:44:06<29:37:57,  3.16it/s]
  9%|▉         | 34317/371472 [2:44:07<28:25:41,  3.29it/s]
  9%|▉         | 34318/371472 [2:44:07<28:38:26,  3.27it/s]
  9%|▉         | 34319/371472 [2:44:07<26:41:24,  3.51it/s]
  9%|▉         | 34320/371472 [2:44:08<27:00:39,  3.47it/s]
                                                           
{'loss': 4.6613, 'learning_rate': 9.172897498330065e-07, 'epoch': 1.48}

  9%|▉         | 34320/371472 [2:44:08<27:00:39,  3.47it/s]
  9%|▉         | 34321/371472 [2:44:08<26:53:09,  3.48it/s]
  9%|▉         | 34322/371472 [2:44:08<27:26:32,  3.41it/s]
  9%|▉         | 34323/371472 [2:44:08<27:13:43,  3.44it/s]
  9%|▉         | 34324/371472 [2:44:09<27:01:16,  3.47it/s]
  9%|▉         | 34325/371472 [2:44:09<26:51:56,  3.49it/s]
  9%|▉         | 34326/371472 [2:44:09<26:30:48,  3.53it/s]
  9%|▉         | 34327/371472 [2:44:10<26:41:33,  3.51it/s]
  9%|▉         | 34328/371472 [2:44:10<26:05:39,  3.59it/s]
  9%|▉         | 34329/371472 [2:44:10<26:05:17,  3.59it/s]
  9%|▉         | 34330/371472 [2:44:10<26:33:21,  3.53it/s]
  9%|▉         | 34331/371472 [2:44:11<26:29:11,  3.54it/s]
  9%|▉         | 34332/371472 [2:44:11<27:16:46,  3.43it/s]
  9%|▉         | 34333/371472 [2:44:11<29:43:09,  3.15it/s]
  9%|▉         | 34334/371472 [2:44:12<29:22:54,  3.19it/s]
  9%|▉         | 34335/371472 [2:44:12<27:42:28,  3.38it/s]
  9%|▉         | 34336/371472 [2:44:12<28:12:26,  3.32it/s]
  9%|▉         | 34337/371472 [2:44:13<27:24:43,  3.42it/s]
  9%|▉         | 34338/371472 [2:44:13<28:28:35,  3.29it/s]
  9%|▉         | 34339/371472 [2:44:13<31:15:40,  3.00it/s]
  9%|▉         | 34340/371472 [2:44:14<30:20:34,  3.09it/s]
                                                           
{'loss': 4.31, 'learning_rate': 9.172412678575276e-07, 'epoch': 1.48}

  9%|▉         | 34340/371472 [2:44:14<30:20:34,  3.09it/s]
  9%|▉         | 34341/371472 [2:44:14<29:10:46,  3.21it/s]
  9%|▉         | 34342/371472 [2:44:14<27:55:28,  3.35it/s]
  9%|▉         | 34343/371472 [2:44:14<26:38:01,  3.52it/s]
  9%|▉         | 34344/371472 [2:44:15<26:17:36,  3.56it/s]
  9%|▉         | 34345/371472 [2:44:15<25:26:44,  3.68it/s]
  9%|▉         | 34346/371472 [2:44:15<26:00:01,  3.60it/s]
  9%|▉         | 34347/371472 [2:44:15<26:21:27,  3.55it/s]
  9%|▉         | 34348/371472 [2:44:16<26:32:57,  3.53it/s]
  9%|▉         | 34349/371472 [2:44:16<26:14:38,  3.57it/s]
  9%|▉         | 34350/371472 [2:44:16<25:06:43,  3.73it/s]
  9%|▉         | 34351/371472 [2:44:17<25:46:10,  3.63it/s]
  9%|▉         | 34352/371472 [2:44:17<26:20:20,  3.56it/s]
  9%|▉         | 34353/371472 [2:44:17<25:59:33,  3.60it/s]
  9%|▉         | 34354/371472 [2:44:17<25:20:24,  3.70it/s]
  9%|▉         | 34355/371472 [2:44:18<27:24:21,  3.42it/s]
  9%|▉         | 34356/371472 [2:44:18<26:33:06,  3.53it/s]
  9%|▉         | 34357/371472 [2:44:18<27:58:42,  3.35it/s]
  9%|▉         | 34358/371472 [2:44:19<26:51:16,  3.49it/s]
  9%|▉         | 34359/371472 [2:44:19<26:00:47,  3.60it/s]
  9%|▉         | 34360/371472 [2:44:19<24:53:53,  3.76it/s]
                                                           
{'loss': 4.5539, 'learning_rate': 9.171927858820487e-07, 'epoch': 1.48}

  9%|▉         | 34360/371472 [2:44:19<24:53:53,  3.76it/s]
  9%|▉         | 34361/371472 [2:44:19<25:24:38,  3.69it/s]
  9%|▉         | 34362/371472 [2:44:20<25:06:52,  3.73it/s]
  9%|▉         | 34363/371472 [2:44:20<27:27:55,  3.41it/s]
  9%|▉         | 34364/371472 [2:44:20<26:49:49,  3.49it/s]
  9%|▉         | 34365/371472 [2:44:21<26:16:56,  3.56it/s]
  9%|▉         | 34366/371472 [2:44:21<26:02:08,  3.60it/s]
  9%|▉         | 34367/371472 [2:44:21<28:41:48,  3.26it/s]
  9%|▉         | 34368/371472 [2:44:21<27:29:17,  3.41it/s]
  9%|▉         | 34369/371472 [2:44:22<27:47:43,  3.37it/s]
  9%|▉         | 34370/371472 [2:44:22<27:33:26,  3.40it/s]
  9%|▉         | 34371/371472 [2:44:23<32:52:10,  2.85it/s]
  9%|▉         | 34372/371472 [2:44:23<31:52:58,  2.94it/s]
  9%|▉         | 34373/371472 [2:44:23<30:29:19,  3.07it/s]
  9%|▉         | 34374/371472 [2:44:23<29:29:35,  3.17it/s]
  9%|▉         | 34375/371472 [2:44:24<29:39:02,  3.16it/s]
  9%|▉         | 34376/371472 [2:44:24<28:20:53,  3.30it/s]
  9%|▉         | 34377/371472 [2:44:24<27:34:48,  3.40it/s]
  9%|▉         | 34378/371472 [2:44:25<28:01:15,  3.34it/s]
  9%|▉         | 34379/371472 [2:44:25<28:39:00,  3.27it/s]
  9%|▉         | 34380/371472 [2:44:25<27:53:17,  3.36it/s]
                                                           
{'loss': 4.4384, 'learning_rate': 9.171443039065698e-07, 'epoch': 1.48}

  9%|▉         | 34380/371472 [2:44:25<27:53:17,  3.36it/s]
  9%|▉         | 34381/371472 [2:44:25<27:29:06,  3.41it/s]
  9%|▉         | 34382/371472 [2:44:26<27:42:08,  3.38it/s]
  9%|▉         | 34383/371472 [2:44:26<26:58:36,  3.47it/s]
  9%|▉         | 34384/371472 [2:44:26<26:38:49,  3.51it/s]
  9%|▉         | 34385/371472 [2:44:27<26:39:10,  3.51it/s]
  9%|▉         | 34386/371472 [2:44:27<25:58:39,  3.60it/s]
  9%|▉         | 34387/371472 [2:44:27<27:13:35,  3.44it/s]
  9%|▉         | 34388/371472 [2:44:27<26:53:34,  3.48it/s]
  9%|▉         | 34389/371472 [2:44:28<25:55:14,  3.61it/s]
  9%|▉         | 34390/371472 [2:44:28<27:41:49,  3.38it/s]
  9%|▉         | 34391/371472 [2:44:28<27:04:08,  3.46it/s]
  9%|▉         | 34392/371472 [2:44:29<25:54:38,  3.61it/s]
  9%|▉         | 34393/371472 [2:44:29<25:22:00,  3.69it/s]
  9%|▉         | 34394/371472 [2:44:29<24:56:59,  3.75it/s]
  9%|▉         | 34395/371472 [2:44:29<25:49:06,  3.63it/s]
  9%|▉         | 34396/371472 [2:44:30<26:27:44,  3.54it/s]
  9%|▉         | 34397/371472 [2:44:30<28:10:34,  3.32it/s]
  9%|▉         | 34398/371472 [2:44:30<28:30:13,  3.28it/s]
  9%|▉         | 34399/371472 [2:44:31<28:08:24,  3.33it/s]
  9%|▉         | 34400/371472 [2:44:31<26:33:00,  3.53it/s]
                                                           
{'loss': 4.4427, 'learning_rate': 9.17095821931091e-07, 'epoch': 1.48}

  9%|▉         | 34400/371472 [2:44:31<26:33:00,  3.53it/s]
  9%|▉         | 34401/371472 [2:44:31<26:21:58,  3.55it/s]
  9%|▉         | 34402/371472 [2:44:31<26:13:01,  3.57it/s]
  9%|▉         | 34403/371472 [2:44:32<25:00:45,  3.74it/s]
  9%|▉         | 34404/371472 [2:44:32<24:25:26,  3.83it/s]
  9%|▉         | 34405/371472 [2:44:32<27:10:57,  3.44it/s]
  9%|▉         | 34406/371472 [2:44:33<26:00:20,  3.60it/s]
  9%|▉         | 34407/371472 [2:44:33<26:08:45,  3.58it/s]
  9%|▉         | 34408/371472 [2:44:33<27:34:38,  3.40it/s]
  9%|▉         | 34409/371472 [2:44:33<26:41:03,  3.51it/s]
  9%|▉         | 34410/371472 [2:44:34<26:11:30,  3.57it/s]
  9%|▉         | 34411/371472 [2:44:34<26:46:47,  3.50it/s]
  9%|▉         | 34412/371472 [2:44:34<28:00:32,  3.34it/s]
  9%|▉         | 34413/371472 [2:44:35<27:46:03,  3.37it/s]
  9%|▉         | 34414/371472 [2:44:35<27:13:41,  3.44it/s]
  9%|▉         | 34415/371472 [2:44:35<26:45:18,  3.50it/s]
  9%|▉         | 34416/371472 [2:44:35<26:21:07,  3.55it/s]
  9%|▉         | 34417/371472 [2:44:36<25:30:11,  3.67it/s]
  9%|▉         | 34418/371472 [2:44:36<25:53:48,  3.62it/s]
  9%|▉         | 34419/371472 [2:44:36<25:59:33,  3.60it/s]
  9%|▉         | 34420/371472 [2:44:36<25:41:34,  3.64it/s]
                                                           
{'loss': 4.7581, 'learning_rate': 9.17047339955612e-07, 'epoch': 1.48}

  9%|▉         | 34420/371472 [2:44:37<25:41:34,  3.64it/s]
  9%|▉         | 34421/371472 [2:44:37<27:21:31,  3.42it/s]
  9%|▉         | 34422/371472 [2:44:37<26:45:19,  3.50it/s]
  9%|▉         | 34423/371472 [2:44:37<26:57:10,  3.47it/s]
  9%|▉         | 34424/371472 [2:44:38<26:25:11,  3.54it/s]
  9%|▉         | 34425/371472 [2:44:38<25:26:06,  3.68it/s]
  9%|▉         | 34426/371472 [2:44:38<25:32:08,  3.67it/s]
  9%|▉         | 34427/371472 [2:44:38<25:10:37,  3.72it/s]
  9%|▉         | 34428/371472 [2:44:39<24:54:13,  3.76it/s]
  9%|▉         | 34429/371472 [2:44:39<24:16:41,  3.86it/s]
  9%|▉         | 34430/371472 [2:44:39<24:54:39,  3.76it/s]
  9%|▉         | 34431/371472 [2:44:39<24:41:54,  3.79it/s]
  9%|▉         | 34432/371472 [2:44:40<25:31:59,  3.67it/s]
  9%|▉         | 34433/371472 [2:44:40<25:55:15,  3.61it/s]
  9%|▉         | 34434/371472 [2:44:40<26:33:39,  3.52it/s]
  9%|▉         | 34435/371472 [2:44:41<26:06:50,  3.59it/s]
  9%|▉         | 34436/371472 [2:44:41<26:17:12,  3.56it/s]
  9%|▉         | 34437/371472 [2:44:41<25:26:25,  3.68it/s]
  9%|▉         | 34438/371472 [2:44:41<24:54:52,  3.76it/s]
  9%|▉         | 34439/371472 [2:44:42<25:51:27,  3.62it/s]
  9%|▉         | 34440/371472 [2:44:42<26:34:23,  3.52it/s]
                                                           
{'loss': 4.5789, 'learning_rate': 9.169988579801331e-07, 'epoch': 1.48}

  9%|▉         | 34440/371472 [2:44:42<26:34:23,  3.52it/s]
  9%|▉         | 34441/371472 [2:44:42<26:45:04,  3.50it/s]
  9%|▉         | 34442/371472 [2:44:43<27:03:43,  3.46it/s]
  9%|▉         | 34443/371472 [2:44:43<27:42:56,  3.38it/s]
  9%|▉         | 34444/371472 [2:44:43<26:45:32,  3.50it/s]
  9%|▉         | 34445/371472 [2:44:43<26:18:48,  3.56it/s]
  9%|▉         | 34446/371472 [2:44:44<25:17:32,  3.70it/s]
  9%|▉         | 34447/371472 [2:44:44<24:44:08,  3.78it/s]
  9%|▉         | 34448/371472 [2:44:44<26:47:10,  3.49it/s]
  9%|▉         | 34449/371472 [2:44:45<26:47:08,  3.50it/s]
  9%|▉         | 34450/371472 [2:44:45<26:44:44,  3.50it/s]
  9%|▉         | 34451/371472 [2:44:45<26:15:45,  3.56it/s]
  9%|▉         | 34452/371472 [2:44:45<27:00:40,  3.47it/s]
  9%|▉         | 34453/371472 [2:44:46<26:49:05,  3.49it/s]
  9%|▉         | 34454/371472 [2:44:46<25:49:10,  3.63it/s]
  9%|▉         | 34455/371472 [2:44:46<25:30:10,  3.67it/s]
  9%|▉         | 34456/371472 [2:44:47<28:10:27,  3.32it/s]
  9%|▉         | 34457/371472 [2:44:47<28:04:34,  3.33it/s]
  9%|▉         | 34458/371472 [2:44:47<26:49:30,  3.49it/s]
  9%|▉         | 34459/371472 [2:44:47<26:06:36,  3.59it/s]
  9%|▉         | 34460/371472 [2:44:48<25:50:38,  3.62it/s]
                                                           
{'loss': 4.4681, 'learning_rate': 9.169503760046543e-07, 'epoch': 1.48}

  9%|▉         | 34460/371472 [2:44:48<25:50:38,  3.62it/s]
  9%|▉         | 34461/371472 [2:44:48<27:10:07,  3.45it/s]
  9%|▉         | 34462/371472 [2:44:48<26:41:24,  3.51it/s]
  9%|▉         | 34463/371472 [2:44:49<27:40:22,  3.38it/s]
  9%|▉         | 34464/371472 [2:44:49<29:10:54,  3.21it/s]
  9%|▉         | 34465/371472 [2:44:49<27:46:11,  3.37it/s]
  9%|▉         | 34466/371472 [2:44:49<26:57:18,  3.47it/s]
  9%|▉         | 34467/371472 [2:44:50<26:58:07,  3.47it/s]
  9%|▉         | 34468/371472 [2:44:50<26:14:16,  3.57it/s]
  9%|▉         | 34469/371472 [2:44:50<25:46:25,  3.63it/s]
  9%|▉         | 34470/371472 [2:44:51<25:30:19,  3.67it/s]
  9%|▉         | 34471/371472 [2:44:51<24:36:57,  3.80it/s]
  9%|▉         | 34472/371472 [2:44:51<24:48:36,  3.77it/s]
  9%|▉         | 34473/371472 [2:44:51<24:00:05,  3.90it/s]
  9%|▉         | 34474/371472 [2:44:52<28:43:24,  3.26it/s]
  9%|▉         | 34475/371472 [2:44:52<26:55:58,  3.48it/s]
  9%|▉         | 34476/371472 [2:44:52<26:22:38,  3.55it/s]
  9%|▉         | 34477/371472 [2:44:53<28:14:17,  3.31it/s]
  9%|▉         | 34478/371472 [2:44:53<26:52:21,  3.48it/s]
  9%|▉         | 34479/371472 [2:44:53<25:47:55,  3.63it/s]
  9%|▉         | 34480/371472 [2:44:53<26:01:35,  3.60it/s]
                                                           
{'loss': 4.5523, 'learning_rate': 9.169018940291754e-07, 'epoch': 1.49}

  9%|▉         | 34480/371472 [2:44:53<26:01:35,  3.60it/s]
  9%|▉         | 34481/371472 [2:44:54<26:28:31,  3.54it/s]
  9%|▉         | 34482/371472 [2:44:54<26:03:43,  3.59it/s]
  9%|▉         | 34483/371472 [2:44:54<26:01:02,  3.60it/s]
  9%|▉         | 34484/371472 [2:44:55<26:27:37,  3.54it/s]
  9%|▉         | 34485/371472 [2:44:55<30:04:14,  3.11it/s]
  9%|▉         | 34486/371472 [2:44:55<27:50:57,  3.36it/s]
  9%|▉         | 34487/371472 [2:44:55<28:45:17,  3.26it/s]
  9%|▉         | 34488/371472 [2:44:56<29:07:10,  3.21it/s]
  9%|▉         | 34489/371472 [2:44:56<28:36:14,  3.27it/s]
  9%|▉         | 34490/371472 [2:44:56<27:10:14,  3.45it/s]
  9%|▉         | 34491/371472 [2:44:57<26:17:48,  3.56it/s]
  9%|▉         | 34492/371472 [2:44:57<25:24:13,  3.68it/s]
  9%|▉         | 34493/371472 [2:44:57<25:54:39,  3.61it/s]
  9%|▉         | 34494/371472 [2:44:57<27:06:52,  3.45it/s]
  9%|▉         | 34495/371472 [2:44:58<26:11:31,  3.57it/s]
  9%|▉         | 34496/371472 [2:44:58<26:03:50,  3.59it/s]
  9%|▉         | 34497/371472 [2:44:58<27:53:41,  3.36it/s]
  9%|▉         | 34498/371472 [2:44:59<28:14:24,  3.31it/s]
  9%|▉         | 34499/371472 [2:44:59<27:32:44,  3.40it/s]
  9%|▉         | 34500/371472 [2:44:59<26:47:47,  3.49it/s]
                                                           
{'loss': 4.3729, 'learning_rate': 9.168534120536964e-07, 'epoch': 1.49}

  9%|▉         | 34500/371472 [2:44:59<26:47:47,  3.49it/s]
  9%|▉         | 34501/371472 [2:44:59<26:31:36,  3.53it/s]
  9%|▉         | 34502/371472 [2:45:00<26:12:23,  3.57it/s]
  9%|▉         | 34503/371472 [2:45:00<26:12:56,  3.57it/s]
  9%|▉         | 34504/371472 [2:45:00<25:36:30,  3.66it/s]
  9%|▉         | 34505/371472 [2:45:01<25:57:06,  3.61it/s]
  9%|▉         | 34506/371472 [2:45:01<26:05:48,  3.59it/s]
  9%|▉         | 34507/371472 [2:45:01<26:20:37,  3.55it/s]
  9%|▉         | 34508/371472 [2:45:01<27:14:26,  3.44it/s]
  9%|▉         | 34509/371472 [2:45:02<26:23:31,  3.55it/s]
  9%|▉         | 34510/371472 [2:45:02<26:34:10,  3.52it/s]
  9%|▉         | 34511/371472 [2:45:02<27:15:06,  3.43it/s]
  9%|▉         | 34512/371472 [2:45:03<26:23:22,  3.55it/s]
  9%|▉         | 34513/371472 [2:45:03<27:58:10,  3.35it/s]
  9%|▉         | 34514/371472 [2:45:03<27:19:18,  3.43it/s]
  9%|▉         | 34515/371472 [2:45:03<27:25:44,  3.41it/s]
  9%|▉         | 34516/371472 [2:45:04<28:45:30,  3.25it/s]
  9%|▉         | 34517/371472 [2:45:04<28:07:42,  3.33it/s]
  9%|▉         | 34518/371472 [2:45:04<28:09:02,  3.32it/s]
  9%|▉         | 34519/371472 [2:45:05<26:49:57,  3.49it/s]
  9%|▉         | 34520/371472 [2:45:05<27:29:45,  3.40it/s]
                                                           
{'loss': 4.5161, 'learning_rate': 9.168049300782175e-07, 'epoch': 1.49}

  9%|▉         | 34520/371472 [2:45:05<27:29:45,  3.40it/s]
  9%|▉         | 34521/371472 [2:45:05<28:17:38,  3.31it/s]
  9%|▉         | 34522/371472 [2:45:06<28:09:02,  3.32it/s]
  9%|▉         | 34523/371472 [2:45:06<26:42:16,  3.50it/s]
  9%|▉         | 34524/371472 [2:45:06<27:35:42,  3.39it/s]
  9%|▉         | 34525/371472 [2:45:06<27:36:39,  3.39it/s]
  9%|▉         | 34526/371472 [2:45:07<27:17:42,  3.43it/s]
  9%|▉         | 34527/371472 [2:45:07<25:58:34,  3.60it/s]
  9%|▉         | 34528/371472 [2:45:07<25:17:21,  3.70it/s]
  9%|▉         | 34529/371472 [2:45:08<25:19:32,  3.70it/s]
  9%|▉         | 34530/371472 [2:45:08<25:20:24,  3.69it/s]
  9%|▉         | 34531/371472 [2:45:08<25:11:38,  3.71it/s]
  9%|▉         | 34532/371472 [2:45:08<25:23:28,  3.69it/s]
  9%|▉         | 34533/371472 [2:45:09<26:03:46,  3.59it/s]
  9%|▉         | 34534/371472 [2:45:09<25:11:46,  3.71it/s]
  9%|▉         | 34535/371472 [2:45:09<24:53:07,  3.76it/s]
  9%|▉         | 34536/371472 [2:45:09<26:45:13,  3.50it/s]
  9%|▉         | 34537/371472 [2:45:10<29:45:17,  3.15it/s]
  9%|▉         | 34538/371472 [2:45:10<29:12:05,  3.21it/s]
  9%|▉         | 34539/371472 [2:45:10<28:09:04,  3.32it/s]
  9%|▉         | 34540/371472 [2:45:11<28:38:32,  3.27it/s]
                                                           
{'loss': 4.4172, 'learning_rate': 9.167564481027387e-07, 'epoch': 1.49}

  9%|▉         | 34540/371472 [2:45:11<28:38:32,  3.27it/s]
  9%|▉         | 34541/371472 [2:45:11<28:15:35,  3.31it/s]
  9%|▉         | 34542/371472 [2:45:11<28:00:25,  3.34it/s]
  9%|▉         | 34543/371472 [2:45:12<29:23:52,  3.18it/s]
  9%|▉         | 34544/371472 [2:45:12<27:47:06,  3.37it/s]
  9%|▉         | 34545/371472 [2:45:12<27:24:38,  3.41it/s]
  9%|▉         | 34546/371472 [2:45:12<25:58:23,  3.60it/s]
  9%|▉         | 34547/371472 [2:45:13<27:09:38,  3.45it/s]
  9%|▉         | 34548/371472 [2:45:13<25:47:37,  3.63it/s]
  9%|▉         | 34549/371472 [2:45:13<26:14:43,  3.57it/s]
  9%|▉         | 34550/371472 [2:45:14<25:43:56,  3.64it/s]
  9%|▉         | 34551/371472 [2:45:14<26:16:36,  3.56it/s]
  9%|▉         | 34552/371472 [2:45:14<28:32:17,  3.28it/s]
  9%|▉         | 34553/371472 [2:45:14<27:11:13,  3.44it/s]
  9%|▉         | 34554/371472 [2:45:15<28:11:55,  3.32it/s]
  9%|▉         | 34555/371472 [2:45:15<27:05:20,  3.45it/s]
  9%|▉         | 34556/371472 [2:45:15<27:02:01,  3.46it/s]
  9%|▉         | 34557/371472 [2:45:16<27:48:31,  3.37it/s]
  9%|▉         | 34558/371472 [2:45:16<27:18:26,  3.43it/s]
  9%|▉         | 34559/371472 [2:45:16<27:06:17,  3.45it/s]
  9%|▉         | 34560/371472 [2:45:17<26:44:44,  3.50it/s]
                                                           
{'loss': 4.261, 'learning_rate': 9.167079661272598e-07, 'epoch': 1.49}

  9%|▉         | 34560/371472 [2:45:17<26:44:44,  3.50it/s]
  9%|▉         | 34561/371472 [2:45:17<25:52:33,  3.62it/s]
  9%|▉         | 34562/371472 [2:45:17<25:59:06,  3.60it/s]
  9%|▉         | 34563/371472 [2:45:17<26:47:43,  3.49it/s]
  9%|▉         | 34564/371472 [2:45:18<26:02:12,  3.59it/s]
  9%|▉         | 34565/371472 [2:45:18<26:02:28,  3.59it/s]
  9%|▉         | 34566/371472 [2:45:18<27:11:41,  3.44it/s]
  9%|▉         | 34567/371472 [2:45:18<26:34:47,  3.52it/s]
  9%|▉         | 34568/371472 [2:45:19<26:44:55,  3.50it/s]
  9%|▉         | 34569/371472 [2:45:19<26:45:40,  3.50it/s]
  9%|▉         | 34570/371472 [2:45:19<26:39:41,  3.51it/s]
  9%|▉         | 34571/371472 [2:45:20<26:09:02,  3.58it/s]
  9%|▉         | 34572/371472 [2:45:20<25:46:41,  3.63it/s]
  9%|▉         | 34573/371472 [2:45:20<27:15:06,  3.43it/s]
  9%|▉         | 34574/371472 [2:45:20<26:09:07,  3.58it/s]
  9%|▉         | 34575/371472 [2:45:21<26:16:41,  3.56it/s]
  9%|▉         | 34576/371472 [2:45:21<26:16:06,  3.56it/s]
  9%|▉         | 34577/371472 [2:45:21<26:00:59,  3.60it/s]
  9%|▉         | 34578/371472 [2:45:22<25:12:55,  3.71it/s]
  9%|▉         | 34579/371472 [2:45:22<24:52:38,  3.76it/s]
  9%|▉         | 34580/371472 [2:45:22<24:10:30,  3.87it/s]
                                                           
{'loss': 4.23, 'learning_rate': 9.166594841517809e-07, 'epoch': 1.49}

  9%|▉         | 34580/371472 [2:45:22<24:10:30,  3.87it/s]
  9%|▉         | 34581/371472 [2:45:22<24:59:55,  3.74it/s]
  9%|▉         | 34582/371472 [2:45:23<24:34:07,  3.81it/s]
  9%|▉         | 34583/371472 [2:45:23<24:38:42,  3.80it/s]
  9%|▉         | 34584/371472 [2:45:23<27:11:36,  3.44it/s]
  9%|▉         | 34585/371472 [2:45:23<26:46:15,  3.50it/s]
  9%|▉         | 34586/371472 [2:45:24<28:31:20,  3.28it/s]
  9%|▉         | 34587/371472 [2:45:24<27:29:25,  3.40it/s]
  9%|▉         | 34588/371472 [2:45:24<26:53:29,  3.48it/s]
  9%|▉         | 34589/371472 [2:45:25<27:12:11,  3.44it/s]
  9%|▉         | 34590/371472 [2:45:25<26:18:14,  3.56it/s]
  9%|▉         | 34591/371472 [2:45:25<27:36:20,  3.39it/s]
  9%|▉         | 34592/371472 [2:45:26<27:04:06,  3.46it/s]
  9%|▉         | 34593/371472 [2:45:26<27:12:34,  3.44it/s]
  9%|▉         | 34594/371472 [2:45:26<27:09:30,  3.45it/s]
  9%|▉         | 34595/371472 [2:45:26<26:18:45,  3.56it/s]
  9%|▉         | 34596/371472 [2:45:27<25:38:41,  3.65it/s]
  9%|▉         | 34597/371472 [2:45:27<25:42:51,  3.64it/s]
  9%|▉         | 34598/371472 [2:45:27<28:26:49,  3.29it/s]
  9%|▉         | 34599/371472 [2:45:28<28:50:09,  3.25it/s]
  9%|▉         | 34600/371472 [2:45:28<28:07:06,  3.33it/s]
                                                           
{'loss': 4.339, 'learning_rate': 9.16611002176302e-07, 'epoch': 1.49}

  9%|▉         | 34600/371472 [2:45:28<28:07:06,  3.33it/s]
  9%|▉         | 34601/371472 [2:45:28<27:39:26,  3.38it/s]
  9%|▉         | 34602/371472 [2:45:28<27:26:10,  3.41it/s]
  9%|▉         | 34603/371472 [2:45:29<26:55:06,  3.48it/s]
  9%|▉         | 34604/371472 [2:45:29<26:50:26,  3.49it/s]
  9%|▉         | 34605/371472 [2:45:29<26:49:11,  3.49it/s]
  9%|▉         | 34606/371472 [2:45:30<27:00:13,  3.47it/s]
  9%|▉         | 34607/371472 [2:45:30<27:17:30,  3.43it/s]
  9%|▉         | 34608/371472 [2:45:30<26:36:58,  3.52it/s]
  9%|▉         | 34609/371472 [2:45:30<26:56:02,  3.47it/s]
  9%|▉         | 34610/371472 [2:45:31<26:42:31,  3.50it/s]
  9%|▉         | 34611/371472 [2:45:31<26:20:43,  3.55it/s]
  9%|▉         | 34612/371472 [2:45:31<26:05:50,  3.59it/s]
  9%|▉         | 34613/371472 [2:45:32<29:53:47,  3.13it/s]
  9%|▉         | 34614/371472 [2:45:32<28:06:06,  3.33it/s]
  9%|▉         | 34615/371472 [2:45:32<27:11:05,  3.44it/s]
  9%|▉         | 34616/371472 [2:45:32<26:31:38,  3.53it/s]
  9%|▉         | 34617/371472 [2:45:33<26:45:17,  3.50it/s]
  9%|▉         | 34618/371472 [2:45:33<26:53:21,  3.48it/s]
  9%|▉         | 34619/371472 [2:45:33<26:15:20,  3.56it/s]
  9%|▉         | 34620/371472 [2:45:34<25:52:27,  3.62it/s]
                                                           
{'loss': 4.1811, 'learning_rate': 9.165625202008231e-07, 'epoch': 1.49}

  9%|▉         | 34620/371472 [2:45:34<25:52:27,  3.62it/s]
  9%|▉         | 34621/371472 [2:45:34<26:13:21,  3.57it/s]
  9%|▉         | 34622/371472 [2:45:34<26:22:03,  3.55it/s]
  9%|▉         | 34623/371472 [2:45:34<26:41:08,  3.51it/s]
  9%|▉         | 34624/371472 [2:45:35<30:13:22,  3.10it/s]
  9%|▉         | 34625/371472 [2:45:35<28:15:53,  3.31it/s]
  9%|▉         | 34626/371472 [2:45:35<28:05:49,  3.33it/s]
  9%|▉         | 34627/371472 [2:45:36<27:53:09,  3.36it/s]
  9%|▉         | 34628/371472 [2:45:36<29:33:41,  3.17it/s]
  9%|▉         | 34629/371472 [2:45:36<29:15:29,  3.20it/s]
  9%|▉         | 34630/371472 [2:45:37<30:10:25,  3.10it/s]
  9%|▉         | 34631/371472 [2:45:37<27:49:02,  3.36it/s]
  9%|▉         | 34632/371472 [2:45:37<27:01:03,  3.46it/s]
  9%|▉         | 34633/371472 [2:45:38<29:46:05,  3.14it/s]
  9%|▉         | 34634/371472 [2:45:38<29:48:38,  3.14it/s]
  9%|▉         | 34635/371472 [2:45:38<29:29:55,  3.17it/s]
  9%|▉         | 34636/371472 [2:45:39<28:40:21,  3.26it/s]
  9%|▉         | 34637/371472 [2:45:39<28:58:10,  3.23it/s]
  9%|▉         | 34638/371472 [2:45:39<29:00:38,  3.23it/s]
  9%|▉         | 34639/371472 [2:45:39<27:24:44,  3.41it/s]
  9%|▉         | 34640/371472 [2:45:40<26:26:07,  3.54it/s]
                                                           
{'loss': 4.3727, 'learning_rate': 9.165140382253441e-07, 'epoch': 1.49}

  9%|▉         | 34640/371472 [2:45:40<26:26:07,  3.54it/s]
  9%|▉         | 34641/371472 [2:45:40<26:12:20,  3.57it/s]
  9%|▉         | 34642/371472 [2:45:40<26:27:47,  3.54it/s]
  9%|▉         | 34643/371472 [2:45:40<25:19:14,  3.70it/s]
  9%|▉         | 34644/371472 [2:45:41<25:30:40,  3.67it/s]
  9%|▉         | 34645/371472 [2:45:41<25:30:20,  3.67it/s]
  9%|▉         | 34646/371472 [2:45:41<26:36:29,  3.52it/s]
  9%|▉         | 34647/371472 [2:45:42<25:57:08,  3.61it/s]
  9%|▉         | 34648/371472 [2:45:42<26:21:55,  3.55it/s]
  9%|▉         | 34649/371472 [2:45:42<26:45:28,  3.50it/s]
  9%|▉         | 34650/371472 [2:45:42<26:16:54,  3.56it/s]
  9%|▉         | 34651/371472 [2:45:43<25:59:41,  3.60it/s]
  9%|▉         | 34652/371472 [2:45:43<26:01:53,  3.59it/s]
  9%|▉         | 34653/371472 [2:45:43<25:01:05,  3.74it/s]
  9%|▉         | 34654/371472 [2:45:44<25:48:06,  3.63it/s]
  9%|▉         | 34655/371472 [2:45:44<25:14:10,  3.71it/s]
  9%|▉         | 34656/371472 [2:45:44<25:25:29,  3.68it/s]
  9%|▉         | 34657/371472 [2:45:44<24:52:14,  3.76it/s]
  9%|▉         | 34658/371472 [2:45:45<26:18:53,  3.56it/s]
  9%|▉         | 34659/371472 [2:45:45<25:47:02,  3.63it/s]
  9%|▉         | 34660/371472 [2:45:45<26:22:17,  3.55it/s]
                                                           
{'loss': 4.5534, 'learning_rate': 9.164655562498652e-07, 'epoch': 1.49}

  9%|▉         | 34660/371472 [2:45:45<26:22:17,  3.55it/s]
  9%|▉         | 34661/371472 [2:45:45<25:17:29,  3.70it/s]
  9%|▉         | 34662/371472 [2:45:46<25:37:08,  3.65it/s]
  9%|▉         | 34663/371472 [2:45:46<25:47:36,  3.63it/s]
  9%|▉         | 34664/371472 [2:45:46<24:57:11,  3.75it/s]
  9%|▉         | 34665/371472 [2:45:47<25:49:10,  3.62it/s]
  9%|▉         | 34666/371472 [2:45:47<25:34:02,  3.66it/s]
  9%|▉         | 34667/371472 [2:45:47<25:26:19,  3.68it/s]
  9%|▉         | 34668/371472 [2:45:47<24:57:04,  3.75it/s]
  9%|▉         | 34669/371472 [2:45:48<24:44:26,  3.78it/s]
  9%|▉         | 34670/371472 [2:45:48<25:31:19,  3.67it/s]
  9%|▉         | 34671/371472 [2:45:48<29:49:14,  3.14it/s]
  9%|▉         | 34672/371472 [2:45:49<28:34:27,  3.27it/s]
  9%|▉         | 34673/371472 [2:45:49<30:03:20,  3.11it/s]
  9%|▉         | 34674/371472 [2:45:49<28:09:06,  3.32it/s]
  9%|▉         | 34675/371472 [2:45:50<28:42:37,  3.26it/s]
  9%|▉         | 34676/371472 [2:45:50<26:43:44,  3.50it/s]
  9%|▉         | 34677/371472 [2:45:50<26:35:37,  3.52it/s]
  9%|▉         | 34678/371472 [2:45:50<27:03:33,  3.46it/s]
  9%|▉         | 34679/371472 [2:45:51<26:19:10,  3.55it/s]
  9%|▉         | 34680/371472 [2:45:51<25:46:26,  3.63it/s]
                                                           
{'loss': 4.3347, 'learning_rate': 9.164170742743864e-07, 'epoch': 1.49}

  9%|▉         | 34680/371472 [2:45:51<25:46:26,  3.63it/s]
  9%|▉         | 34681/371472 [2:45:51<26:11:38,  3.57it/s]
  9%|▉         | 34682/371472 [2:45:51<27:38:05,  3.39it/s]
  9%|▉         | 34683/371472 [2:45:52<26:28:06,  3.53it/s]
  9%|▉         | 34684/371472 [2:45:52<25:57:43,  3.60it/s]
  9%|▉         | 34685/371472 [2:45:52<29:08:57,  3.21it/s]
  9%|▉         | 34686/371472 [2:45:53<30:34:15,  3.06it/s]
  9%|▉         | 34687/371472 [2:45:53<29:41:37,  3.15it/s]
  9%|▉         | 34688/371472 [2:45:53<29:51:59,  3.13it/s]
  9%|▉         | 34689/371472 [2:45:54<28:19:20,  3.30it/s]
  9%|▉         | 34690/371472 [2:45:54<27:16:14,  3.43it/s]
  9%|▉         | 34691/371472 [2:45:54<27:47:36,  3.37it/s]
  9%|▉         | 34692/371472 [2:45:55<32:07:27,  2.91it/s]
  9%|▉         | 34693/371472 [2:45:55<29:42:19,  3.15it/s]
  9%|▉         | 34694/371472 [2:45:55<27:38:32,  3.38it/s]
  9%|▉         | 34695/371472 [2:45:56<29:18:47,  3.19it/s]
  9%|▉         | 34696/371472 [2:45:56<29:23:13,  3.18it/s]
  9%|▉         | 34697/371472 [2:45:56<31:42:34,  2.95it/s]
  9%|▉         | 34698/371472 [2:45:57<30:18:54,  3.09it/s]
  9%|▉         | 34699/371472 [2:45:57<29:44:34,  3.15it/s]
  9%|▉         | 34700/371472 [2:45:57<30:42:57,  3.05it/s]
                                                           
{'loss': 4.2064, 'learning_rate': 9.163685922989076e-07, 'epoch': 1.49}

  9%|▉         | 34700/371472 [2:45:57<30:42:57,  3.05it/s]
  9%|▉         | 34701/371472 [2:45:57<29:41:34,  3.15it/s]
  9%|▉         | 34702/371472 [2:45:58<27:49:50,  3.36it/s]
  9%|▉         | 34703/371472 [2:45:58<26:56:04,  3.47it/s]
  9%|▉         | 34704/371472 [2:45:58<27:11:56,  3.44it/s]
  9%|▉         | 34705/371472 [2:45:59<26:31:52,  3.53it/s]
  9%|▉         | 34706/371472 [2:45:59<26:17:48,  3.56it/s]
  9%|▉         | 34707/371472 [2:45:59<27:24:40,  3.41it/s]
  9%|▉         | 34708/371472 [2:45:59<26:50:33,  3.48it/s]
  9%|▉         | 34709/371472 [2:46:00<25:42:31,  3.64it/s]
  9%|▉         | 34710/371472 [2:46:00<25:53:46,  3.61it/s]
  9%|▉         | 34711/371472 [2:46:00<28:28:26,  3.29it/s]
  9%|▉         | 34712/371472 [2:46:01<29:12:24,  3.20it/s]
  9%|▉         | 34713/371472 [2:46:01<28:39:43,  3.26it/s]
  9%|▉         | 34714/371472 [2:46:01<28:02:22,  3.34it/s]
  9%|▉         | 34715/371472 [2:46:02<27:17:51,  3.43it/s]
  9%|▉         | 34716/371472 [2:46:02<27:51:19,  3.36it/s]
  9%|▉         | 34717/371472 [2:46:02<27:26:38,  3.41it/s]
  9%|▉         | 34718/371472 [2:46:02<26:43:07,  3.50it/s]
  9%|▉         | 34719/371472 [2:46:03<27:35:51,  3.39it/s]
  9%|▉         | 34720/371472 [2:46:03<27:43:38,  3.37it/s]
                                                           
{'loss': 4.4352, 'learning_rate': 9.163201103234286e-07, 'epoch': 1.5}

  9%|▉         | 34720/371472 [2:46:03<27:43:38,  3.37it/s]
  9%|▉         | 34721/371472 [2:46:03<27:09:04,  3.45it/s]
  9%|▉         | 34722/371472 [2:46:04<26:24:42,  3.54it/s]
  9%|▉         | 34723/371472 [2:46:04<26:03:34,  3.59it/s]
  9%|▉         | 34724/371472 [2:46:04<25:47:46,  3.63it/s]
  9%|▉         | 34725/371472 [2:46:04<26:36:40,  3.52it/s]
  9%|▉         | 34726/371472 [2:46:05<26:50:22,  3.49it/s]
  9%|▉         | 34727/371472 [2:46:05<27:42:16,  3.38it/s]
  9%|▉         | 34728/371472 [2:46:05<27:12:17,  3.44it/s]
  9%|▉         | 34729/371472 [2:46:06<26:30:42,  3.53it/s]
  9%|▉         | 34730/371472 [2:46:06<26:18:32,  3.56it/s]
  9%|▉         | 34731/371472 [2:46:06<26:07:44,  3.58it/s]
  9%|▉         | 34732/371472 [2:46:06<25:16:40,  3.70it/s]
  9%|▉         | 34733/371472 [2:46:07<24:44:29,  3.78it/s]
  9%|▉         | 34734/371472 [2:46:07<25:18:43,  3.70it/s]
  9%|▉         | 34735/371472 [2:46:07<25:14:15,  3.71it/s]
  9%|▉         | 34736/371472 [2:46:07<25:08:52,  3.72it/s]
  9%|▉         | 34737/371472 [2:46:08<24:45:51,  3.78it/s]
  9%|▉         | 34738/371472 [2:46:08<24:36:57,  3.80it/s]
  9%|▉         | 34739/371472 [2:46:08<24:21:18,  3.84it/s]
  9%|▉         | 34740/371472 [2:46:08<25:17:02,  3.70it/s]
                                                           
{'loss': 4.4662, 'learning_rate': 9.162716283479497e-07, 'epoch': 1.5}

  9%|▉         | 34740/371472 [2:46:08<25:17:02,  3.70it/s]
  9%|▉         | 34741/371472 [2:46:09<25:49:18,  3.62it/s]
  9%|▉         | 34742/371472 [2:46:09<25:59:57,  3.60it/s]
  9%|▉         | 34743/371472 [2:46:09<27:18:53,  3.42it/s]
  9%|▉         | 34744/371472 [2:46:10<27:23:31,  3.41it/s]
  9%|▉         | 34745/371472 [2:46:10<26:21:07,  3.55it/s]
  9%|▉         | 34746/371472 [2:46:10<26:05:47,  3.58it/s]
  9%|▉         | 34747/371472 [2:46:10<25:50:37,  3.62it/s]
  9%|▉         | 34748/371472 [2:46:11<24:44:05,  3.78it/s]
  9%|▉         | 34749/371472 [2:46:11<24:55:04,  3.75it/s]
  9%|▉         | 34750/371472 [2:46:11<24:07:37,  3.88it/s]
  9%|▉         | 34751/371472 [2:46:11<24:09:12,  3.87it/s]
  9%|▉         | 34752/371472 [2:46:12<23:25:37,  3.99it/s]
  9%|▉         | 34753/371472 [2:46:12<24:10:37,  3.87it/s]
  9%|▉         | 34754/371472 [2:46:12<26:31:12,  3.53it/s]
  9%|▉         | 34755/371472 [2:46:13<26:24:37,  3.54it/s]
  9%|▉         | 34756/371472 [2:46:13<29:20:00,  3.19it/s]
  9%|▉         | 34757/371472 [2:46:13<27:50:05,  3.36it/s]
  9%|▉         | 34758/371472 [2:46:13<26:28:24,  3.53it/s]
  9%|▉         | 34759/371472 [2:46:14<26:09:22,  3.58it/s]
  9%|▉         | 34760/371472 [2:46:14<25:24:53,  3.68it/s]
                                                           
{'loss': 4.4698, 'learning_rate': 9.162231463724708e-07, 'epoch': 1.5}

  9%|▉         | 34760/371472 [2:46:14<25:24:53,  3.68it/s]
  9%|▉         | 34761/371472 [2:46:14<25:28:51,  3.67it/s]
  9%|▉         | 34762/371472 [2:46:15<27:03:47,  3.46it/s]
  9%|▉         | 34763/371472 [2:46:15<29:19:51,  3.19it/s]
  9%|▉         | 34764/371472 [2:46:15<28:14:16,  3.31it/s]
  9%|▉         | 34765/371472 [2:46:16<28:05:43,  3.33it/s]
  9%|▉         | 34766/371472 [2:46:16<27:00:03,  3.46it/s]
  9%|▉         | 34767/371472 [2:46:16<26:44:52,  3.50it/s]
  9%|▉         | 34768/371472 [2:46:16<26:14:34,  3.56it/s]
  9%|▉         | 34769/371472 [2:46:17<26:06:56,  3.58it/s]
  9%|▉         | 34770/371472 [2:46:17<28:16:28,  3.31it/s]
  9%|▉         | 34771/371472 [2:46:17<27:15:48,  3.43it/s]
  9%|▉         | 34772/371472 [2:46:18<27:47:49,  3.36it/s]
  9%|▉         | 34773/371472 [2:46:18<26:21:36,  3.55it/s]
  9%|▉         | 34774/371472 [2:46:18<25:51:59,  3.62it/s]
  9%|▉         | 34775/371472 [2:46:18<27:29:25,  3.40it/s]
  9%|▉         | 34776/371472 [2:46:19<27:03:57,  3.46it/s]
  9%|▉         | 34777/371472 [2:46:19<25:56:19,  3.61it/s]
  9%|▉         | 34778/371472 [2:46:19<25:44:59,  3.63it/s]
  9%|▉         | 34779/371472 [2:46:19<25:33:14,  3.66it/s]
  9%|▉         | 34780/371472 [2:46:20<24:55:20,  3.75it/s]
                                                           
{'loss': 4.2969, 'learning_rate': 9.161746643969919e-07, 'epoch': 1.5}

  9%|▉         | 34780/371472 [2:46:20<24:55:20,  3.75it/s]
  9%|▉         | 34781/371472 [2:46:20<24:56:54,  3.75it/s]
  9%|▉         | 34782/371472 [2:46:20<25:25:44,  3.68it/s]
  9%|▉         | 34783/371472 [2:46:21<25:33:07,  3.66it/s]
  9%|▉         | 34784/371472 [2:46:21<25:24:03,  3.68it/s]
  9%|▉         | 34785/371472 [2:46:21<24:42:17,  3.79it/s]
  9%|▉         | 34786/371472 [2:46:21<24:34:51,  3.80it/s]
  9%|▉         | 34787/371472 [2:46:22<25:03:23,  3.73it/s]
  9%|▉         | 34788/371472 [2:46:22<25:56:23,  3.61it/s]
  9%|▉         | 34789/371472 [2:46:22<26:40:18,  3.51it/s]
  9%|▉         | 34790/371472 [2:46:22<26:26:09,  3.54it/s]
  9%|▉         | 34791/371472 [2:46:23<27:25:34,  3.41it/s]
  9%|▉         | 34792/371472 [2:46:23<28:00:23,  3.34it/s]
  9%|▉         | 34793/371472 [2:46:23<27:58:45,  3.34it/s]
  9%|▉         | 34794/371472 [2:46:24<26:14:08,  3.56it/s]
  9%|▉         | 34795/371472 [2:46:24<25:45:43,  3.63it/s]
  9%|▉         | 34796/371472 [2:46:24<25:32:46,  3.66it/s]
  9%|▉         | 34797/371472 [2:46:24<25:16:07,  3.70it/s]
  9%|▉         | 34798/371472 [2:46:25<25:06:48,  3.72it/s]
  9%|▉         | 34799/371472 [2:46:25<25:22:27,  3.69it/s]
  9%|▉         | 34800/371472 [2:46:25<25:32:35,  3.66it/s]
                                                           
{'loss': 4.5373, 'learning_rate': 9.16126182421513e-07, 'epoch': 1.5}

  9%|▉         | 34800/371472 [2:46:25<25:32:35,  3.66it/s]
  9%|▉         | 34801/371472 [2:46:26<24:57:48,  3.75it/s]
  9%|▉         | 34802/371472 [2:46:26<27:27:37,  3.41it/s]
  9%|▉         | 34803/371472 [2:46:26<26:34:10,  3.52it/s]
  9%|▉         | 34804/371472 [2:46:26<25:24:11,  3.68it/s]
  9%|▉         | 34805/371472 [2:46:27<25:32:01,  3.66it/s]
  9%|▉         | 34806/371472 [2:46:27<30:39:54,  3.05it/s]
  9%|▉         | 34807/371472 [2:46:27<31:03:33,  3.01it/s]
  9%|▉         | 34808/371472 [2:46:28<29:13:10,  3.20it/s]
  9%|▉         | 34809/371472 [2:46:28<27:41:13,  3.38it/s]
  9%|▉         | 34810/371472 [2:46:28<26:35:28,  3.52it/s]
  9%|▉         | 34811/371472 [2:46:29<26:16:27,  3.56it/s]
  9%|▉         | 34812/371472 [2:46:29<25:53:46,  3.61it/s]
  9%|▉         | 34813/371472 [2:46:29<26:23:56,  3.54it/s]
  9%|▉         | 34814/371472 [2:46:29<26:17:34,  3.56it/s]
  9%|▉         | 34815/371472 [2:46:30<26:37:34,  3.51it/s]
  9%|▉         | 34816/371472 [2:46:30<25:25:57,  3.68it/s]
  9%|▉         | 34817/371472 [2:46:30<26:26:44,  3.54it/s]
  9%|▉         | 34818/371472 [2:46:30<26:27:43,  3.53it/s]
  9%|▉         | 34819/371472 [2:46:31<26:31:09,  3.53it/s]
  9%|▉         | 34820/371472 [2:46:31<27:34:20,  3.39it/s]
                                                           
{'loss': 4.2752, 'learning_rate': 9.16077700446034e-07, 'epoch': 1.5}

  9%|▉         | 34820/371472 [2:46:31<27:34:20,  3.39it/s]
  9%|▉         | 34821/371472 [2:46:31<28:50:52,  3.24it/s]
  9%|▉         | 34822/371472 [2:46:32<28:16:04,  3.31it/s]
  9%|▉         | 34823/371472 [2:46:32<28:26:21,  3.29it/s]
  9%|▉         | 34824/371472 [2:46:32<27:14:39,  3.43it/s]
  9%|▉         | 34825/371472 [2:46:33<26:25:37,  3.54it/s]
  9%|▉         | 34826/371472 [2:46:33<27:58:31,  3.34it/s]
  9%|▉         | 34827/371472 [2:46:33<27:14:36,  3.43it/s]
  9%|▉         | 34828/371472 [2:46:33<27:10:28,  3.44it/s]
  9%|▉         | 34829/371472 [2:46:34<26:33:49,  3.52it/s]
  9%|▉         | 34830/371472 [2:46:34<25:58:57,  3.60it/s]
  9%|▉         | 34831/371472 [2:46:34<27:02:21,  3.46it/s]
  9%|▉         | 34832/371472 [2:46:35<25:50:29,  3.62it/s]
  9%|▉         | 34833/371472 [2:46:35<26:45:00,  3.50it/s]
  9%|▉         | 34834/371472 [2:46:35<26:27:10,  3.53it/s]
  9%|▉         | 34835/371472 [2:46:35<26:58:13,  3.47it/s]
  9%|▉         | 34836/371472 [2:46:36<27:02:17,  3.46it/s]
  9%|▉         | 34837/371472 [2:46:36<26:08:58,  3.58it/s]
  9%|▉         | 34838/371472 [2:46:36<28:54:58,  3.23it/s]
  9%|▉         | 34839/371472 [2:46:37<29:23:39,  3.18it/s]
  9%|▉         | 34840/371472 [2:46:37<27:56:29,  3.35it/s]
                                                           
{'loss': 4.4435, 'learning_rate': 9.160292184705553e-07, 'epoch': 1.5}

  9%|▉         | 34840/371472 [2:46:37<27:56:29,  3.35it/s]
  9%|▉         | 34841/371472 [2:46:37<26:45:26,  3.49it/s]
  9%|▉         | 34842/371472 [2:46:37<26:09:14,  3.58it/s]
  9%|▉         | 34843/371472 [2:46:38<26:27:09,  3.53it/s]
  9%|▉         | 34844/371472 [2:46:38<26:45:46,  3.49it/s]
  9%|▉         | 34845/371472 [2:46:38<27:49:55,  3.36it/s]
  9%|▉         | 34846/371472 [2:46:39<27:16:53,  3.43it/s]
  9%|▉         | 34847/371472 [2:46:39<26:05:05,  3.58it/s]
  9%|▉         | 34848/371472 [2:46:39<26:15:57,  3.56it/s]
  9%|▉         | 34849/371472 [2:46:39<25:32:08,  3.66it/s]
  9%|▉         | 34850/371472 [2:46:40<25:41:05,  3.64it/s]
  9%|▉         | 34851/371472 [2:46:40<26:04:41,  3.59it/s]
  9%|▉         | 34852/371472 [2:46:40<29:15:52,  3.20it/s]
  9%|▉         | 34853/371472 [2:46:41<27:27:25,  3.41it/s]
  9%|▉         | 34854/371472 [2:46:41<26:04:59,  3.58it/s]
  9%|▉         | 34855/371472 [2:46:41<26:16:56,  3.56it/s]
  9%|▉         | 34856/371472 [2:46:41<26:12:28,  3.57it/s]
  9%|▉         | 34857/371472 [2:46:42<28:10:19,  3.32it/s]
  9%|▉         | 34858/371472 [2:46:42<27:25:37,  3.41it/s]
  9%|▉         | 34859/371472 [2:46:42<30:27:14,  3.07it/s]
  9%|▉         | 34860/371472 [2:46:43<29:14:40,  3.20it/s]
                                                           
{'loss': 4.5597, 'learning_rate': 9.159807364950764e-07, 'epoch': 1.5}

  9%|▉         | 34860/371472 [2:46:43<29:14:40,  3.20it/s]
  9%|▉         | 34861/371472 [2:46:43<30:11:43,  3.10it/s]
  9%|▉         | 34862/371472 [2:46:43<28:32:20,  3.28it/s]
  9%|▉         | 34863/371472 [2:46:44<30:11:06,  3.10it/s]
  9%|▉         | 34864/371472 [2:46:44<28:16:02,  3.31it/s]
  9%|▉         | 34865/371472 [2:46:44<27:58:45,  3.34it/s]
  9%|▉         | 34866/371472 [2:46:45<27:41:37,  3.38it/s]
  9%|▉         | 34867/371472 [2:46:45<26:25:35,  3.54it/s]
  9%|▉         | 34868/371472 [2:46:45<26:24:26,  3.54it/s]
  9%|▉         | 34869/371472 [2:46:45<26:27:39,  3.53it/s]
  9%|▉         | 34870/371472 [2:46:46<26:29:37,  3.53it/s]
  9%|▉         | 34871/371472 [2:46:46<26:01:36,  3.59it/s]
  9%|▉         | 34872/371472 [2:46:46<26:03:03,  3.59it/s]
  9%|▉         | 34873/371472 [2:46:47<26:42:06,  3.50it/s]
  9%|▉         | 34874/371472 [2:46:47<26:36:36,  3.51it/s]
  9%|▉         | 34875/371472 [2:46:47<27:11:47,  3.44it/s]
  9%|▉         | 34876/371472 [2:46:47<27:12:00,  3.44it/s]
  9%|▉         | 34877/371472 [2:46:48<26:43:17,  3.50it/s]
  9%|▉         | 34878/371472 [2:46:48<26:29:08,  3.53it/s]
  9%|▉         | 34879/371472 [2:46:48<26:00:25,  3.60it/s]
  9%|▉         | 34880/371472 [2:46:49<26:46:56,  3.49it/s]
                                                           
{'loss': 4.2376, 'learning_rate': 9.159322545195974e-07, 'epoch': 1.5}

  9%|▉         | 34880/371472 [2:46:49<26:46:56,  3.49it/s]
  9%|▉         | 34881/371472 [2:46:49<26:27:03,  3.53it/s]
  9%|▉         | 34882/371472 [2:46:49<26:44:36,  3.50it/s]
  9%|▉         | 34883/371472 [2:46:49<28:06:57,  3.33it/s]
  9%|▉         | 34884/371472 [2:46:50<29:07:57,  3.21it/s]
  9%|▉         | 34885/371472 [2:46:50<28:19:24,  3.30it/s]
  9%|▉         | 34886/371472 [2:46:50<27:27:36,  3.40it/s]
  9%|▉         | 34887/371472 [2:46:51<27:26:06,  3.41it/s]
  9%|▉         | 34888/371472 [2:46:51<27:18:01,  3.42it/s]
  9%|▉         | 34889/371472 [2:46:51<27:51:13,  3.36it/s]
  9%|▉         | 34890/371472 [2:46:51<26:57:49,  3.47it/s]
  9%|▉         | 34891/371472 [2:46:52<25:58:16,  3.60it/s]
  9%|▉         | 34892/371472 [2:46:52<26:30:11,  3.53it/s]
  9%|▉         | 34893/371472 [2:46:52<26:15:08,  3.56it/s]
  9%|▉         | 34894/371472 [2:46:53<26:13:38,  3.56it/s]
  9%|▉         | 34895/371472 [2:46:53<26:07:52,  3.58it/s]
  9%|▉         | 34896/371472 [2:46:53<26:59:03,  3.46it/s]
  9%|▉         | 34897/371472 [2:46:53<27:19:46,  3.42it/s]
  9%|▉         | 34898/371472 [2:46:54<26:08:39,  3.58it/s]
  9%|▉         | 34899/371472 [2:46:54<26:23:30,  3.54it/s]
  9%|▉         | 34900/371472 [2:46:54<25:59:09,  3.60it/s]
                                                           
{'loss': 4.6336, 'learning_rate': 9.158837725441185e-07, 'epoch': 1.5}

  9%|▉         | 34900/371472 [2:46:54<25:59:09,  3.60it/s]
  9%|▉         | 34901/371472 [2:46:55<25:56:16,  3.60it/s]
  9%|▉         | 34902/371472 [2:46:55<25:53:51,  3.61it/s]
  9%|▉         | 34903/371472 [2:46:55<26:46:22,  3.49it/s]
  9%|▉         | 34904/371472 [2:46:55<26:50:43,  3.48it/s]
  9%|▉         | 34905/371472 [2:46:56<27:48:42,  3.36it/s]
  9%|▉         | 34906/371472 [2:46:56<27:27:46,  3.40it/s]
  9%|▉         | 34907/371472 [2:46:56<27:57:30,  3.34it/s]
  9%|▉         | 34908/371472 [2:46:57<27:25:14,  3.41it/s]
  9%|▉         | 34909/371472 [2:46:57<26:13:07,  3.57it/s]
  9%|▉         | 34910/371472 [2:46:57<26:38:34,  3.51it/s]
  9%|▉         | 34911/371472 [2:46:57<26:17:44,  3.56it/s]
  9%|▉         | 34912/371472 [2:46:58<25:32:17,  3.66it/s]
  9%|▉         | 34913/371472 [2:46:58<24:47:27,  3.77it/s]
  9%|▉         | 34914/371472 [2:46:58<24:34:55,  3.80it/s]
  9%|▉         | 34915/371472 [2:46:59<26:15:24,  3.56it/s]
  9%|▉         | 34916/371472 [2:46:59<26:03:06,  3.59it/s]
  9%|▉         | 34917/371472 [2:46:59<29:19:17,  3.19it/s]
  9%|▉         | 34918/371472 [2:47:00<29:54:40,  3.13it/s]
  9%|▉         | 34919/371472 [2:47:00<28:40:14,  3.26it/s]
  9%|▉         | 34920/371472 [2:47:00<27:54:55,  3.35it/s]
                                                           
{'loss': 4.265, 'learning_rate': 9.158352905686398e-07, 'epoch': 1.5}

  9%|▉         | 34920/371472 [2:47:00<27:54:55,  3.35it/s]
  9%|▉         | 34921/371472 [2:47:00<26:58:41,  3.47it/s]
  9%|▉         | 34922/371472 [2:47:01<26:21:31,  3.55it/s]
  9%|▉         | 34923/371472 [2:47:01<25:26:27,  3.67it/s]
  9%|▉         | 34924/371472 [2:47:01<25:39:59,  3.64it/s]
  9%|▉         | 34925/371472 [2:47:01<25:00:17,  3.74it/s]
  9%|▉         | 34926/371472 [2:47:02<24:40:17,  3.79it/s]
  9%|▉         | 34927/371472 [2:47:02<25:34:20,  3.66it/s]
  9%|▉         | 34928/371472 [2:47:02<25:03:25,  3.73it/s]
  9%|▉         | 34929/371472 [2:47:02<24:48:33,  3.77it/s]
  9%|▉         | 34930/371472 [2:47:03<25:05:59,  3.72it/s]
  9%|▉         | 34931/371472 [2:47:03<25:32:16,  3.66it/s]
  9%|▉         | 34932/371472 [2:47:03<26:14:13,  3.56it/s]
  9%|▉         | 34933/371472 [2:47:04<25:55:02,  3.61it/s]
  9%|▉         | 34934/371472 [2:47:04<26:12:47,  3.57it/s]
  9%|▉         | 34935/371472 [2:47:04<25:49:20,  3.62it/s]
  9%|▉         | 34936/371472 [2:47:04<24:57:43,  3.74it/s]
  9%|▉         | 34937/371472 [2:47:05<25:07:23,  3.72it/s]
  9%|▉         | 34938/371472 [2:47:05<25:06:33,  3.72it/s]
  9%|▉         | 34939/371472 [2:47:05<26:40:19,  3.50it/s]
  9%|▉         | 34940/371472 [2:47:06<26:25:46,  3.54it/s]
                                                           
{'loss': 4.6778, 'learning_rate': 9.157868085931607e-07, 'epoch': 1.5}

  9%|▉         | 34940/371472 [2:47:06<26:25:46,  3.54it/s]
  9%|▉         | 34941/371472 [2:47:06<26:10:12,  3.57it/s]
  9%|▉         | 34942/371472 [2:47:06<26:56:54,  3.47it/s]
  9%|▉         | 34943/371472 [2:47:06<26:26:33,  3.54it/s]
  9%|▉         | 34944/371472 [2:47:07<26:14:54,  3.56it/s]
  9%|▉         | 34945/371472 [2:47:07<26:06:13,  3.58it/s]
  9%|▉         | 34946/371472 [2:47:07<25:33:04,  3.66it/s]
  9%|▉         | 34947/371472 [2:47:07<25:33:03,  3.66it/s]
  9%|▉         | 34948/371472 [2:47:08<27:22:32,  3.41it/s]
  9%|▉         | 34949/371472 [2:47:08<28:09:25,  3.32it/s]
  9%|▉         | 34950/371472 [2:47:08<27:54:44,  3.35it/s]
  9%|▉         | 34951/371472 [2:47:09<27:49:16,  3.36it/s]
  9%|▉         | 34952/371472 [2:47:09<27:47:56,  3.36it/s]
  9%|▉         | 34953/371472 [2:47:09<26:52:38,  3.48it/s]
  9%|▉         | 34954/371472 [2:47:10<27:14:10,  3.43it/s]
  9%|▉         | 34955/371472 [2:47:10<26:43:50,  3.50it/s]
  9%|▉         | 34956/371472 [2:47:10<25:58:21,  3.60it/s]
  9%|▉         | 34957/371472 [2:47:10<25:03:08,  3.73it/s]
  9%|▉         | 34958/371472 [2:47:11<25:54:26,  3.61it/s]
  9%|▉         | 34959/371472 [2:47:11<25:57:55,  3.60it/s]
  9%|▉         | 34960/371472 [2:47:11<26:34:33,  3.52it/s]
                                                           
{'loss': 4.5546, 'learning_rate': 9.157383266176819e-07, 'epoch': 1.51}

  9%|▉         | 34960/371472 [2:47:11<26:34:33,  3.52it/s]
  9%|▉         | 34961/371472 [2:47:11<25:47:59,  3.62it/s]
  9%|▉         | 34962/371472 [2:47:12<26:15:06,  3.56it/s]
  9%|▉         | 34963/371472 [2:47:12<25:44:41,  3.63it/s]
  9%|▉         | 34964/371472 [2:47:12<25:42:29,  3.64it/s]
  9%|▉         | 34965/371472 [2:47:13<26:20:25,  3.55it/s]
  9%|▉         | 34966/371472 [2:47:13<25:47:18,  3.62it/s]
  9%|▉         | 34967/371472 [2:47:13<25:32:11,  3.66it/s]
  9%|▉         | 34968/371472 [2:47:13<25:49:17,  3.62it/s]
  9%|▉         | 34969/371472 [2:47:14<25:00:51,  3.74it/s]
  9%|▉         | 34970/371472 [2:47:14<25:15:11,  3.70it/s]
  9%|▉         | 34971/371472 [2:47:14<24:49:42,  3.76it/s]
  9%|▉         | 34972/371472 [2:47:15<27:36:31,  3.39it/s]
  9%|▉         | 34973/371472 [2:47:15<27:24:55,  3.41it/s]
  9%|▉         | 34974/371472 [2:47:15<26:00:29,  3.59it/s]
  9%|▉         | 34975/371472 [2:47:15<26:49:08,  3.49it/s]
  9%|▉         | 34976/371472 [2:47:16<28:03:13,  3.33it/s]
  9%|▉         | 34977/371472 [2:47:16<26:41:52,  3.50it/s]
  9%|▉         | 34978/371472 [2:47:16<25:45:45,  3.63it/s]
  9%|▉         | 34979/371472 [2:47:17<25:24:51,  3.68it/s]
  9%|▉         | 34980/371472 [2:47:17<26:05:43,  3.58it/s]
                                                           
{'loss': 4.4426, 'learning_rate': 9.15689844642203e-07, 'epoch': 1.51}

  9%|▉         | 34980/371472 [2:47:17<26:05:43,  3.58it/s]
  9%|▉         | 34981/371472 [2:47:17<26:51:21,  3.48it/s]
  9%|▉         | 34982/371472 [2:47:17<26:06:15,  3.58it/s]
  9%|▉         | 34983/371472 [2:47:18<26:00:26,  3.59it/s]
  9%|▉         | 34984/371472 [2:47:18<26:21:25,  3.55it/s]
  9%|▉         | 34985/371472 [2:47:18<25:25:46,  3.68it/s]
  9%|▉         | 34986/371472 [2:47:18<25:01:47,  3.73it/s]
  9%|▉         | 34987/371472 [2:47:19<25:44:55,  3.63it/s]
  9%|▉         | 34988/371472 [2:47:19<25:29:16,  3.67it/s]
  9%|▉         | 34989/371472 [2:47:19<27:33:18,  3.39it/s]
  9%|▉         | 34990/371472 [2:47:20<28:05:40,  3.33it/s]
  9%|▉         | 34991/371472 [2:47:20<26:45:42,  3.49it/s]
  9%|▉         | 34992/371472 [2:47:20<29:21:29,  3.18it/s]
  9%|▉         | 34993/371472 [2:47:21<27:35:02,  3.39it/s]
  9%|▉         | 34994/371472 [2:47:21<26:20:20,  3.55it/s]
  9%|▉         | 34995/371472 [2:47:21<25:23:04,  3.68it/s]
  9%|▉         | 34996/371472 [2:47:21<24:41:51,  3.78it/s]
  9%|▉         | 34997/371472 [2:47:22<24:55:34,  3.75it/s]
  9%|▉         | 34998/371472 [2:47:22<24:34:07,  3.80it/s]
  9%|▉         | 34999/371472 [2:47:22<24:12:33,  3.86it/s]
  9%|▉         | 35000/371472 [2:47:22<24:06:58,  3.88it/s]
                                                           
{'loss': 4.6047, 'learning_rate': 9.156413626667241e-07, 'epoch': 1.51}

  9%|▉         | 35000/371472 [2:47:22<24:06:58,  3.88it/s]
  9%|▉         | 35001/371472 [2:47:23<24:41:44,  3.78it/s]
  9%|▉         | 35002/371472 [2:47:23<24:20:04,  3.84it/s]
  9%|▉         | 35003/371472 [2:47:23<25:36:39,  3.65it/s]
  9%|▉         | 35004/371472 [2:47:24<27:55:42,  3.35it/s]
  9%|▉         | 35005/371472 [2:47:24<27:47:41,  3.36it/s]
  9%|▉         | 35006/371472 [2:47:24<27:13:19,  3.43it/s]
  9%|▉         | 35007/371472 [2:47:24<26:27:06,  3.53it/s]
  9%|▉         | 35008/371472 [2:47:25<25:20:23,  3.69it/s]
  9%|▉         | 35009/371472 [2:47:25<24:24:33,  3.83it/s]
  9%|▉         | 35010/371472 [2:47:25<25:29:53,  3.67it/s]
  9%|▉         | 35011/371472 [2:47:25<25:02:54,  3.73it/s]
  9%|▉         | 35012/371472 [2:47:26<25:20:04,  3.69it/s]
  9%|▉         | 35013/371472 [2:47:26<25:43:21,  3.63it/s]
  9%|▉         | 35014/371472 [2:47:26<25:19:08,  3.69it/s]
  9%|▉         | 35015/371472 [2:47:26<24:27:26,  3.82it/s]
  9%|▉         | 35016/371472 [2:47:27<27:11:56,  3.44it/s]
  9%|▉         | 35017/371472 [2:47:27<26:47:35,  3.49it/s]
  9%|▉         | 35018/371472 [2:47:27<26:45:56,  3.49it/s]
  9%|▉         | 35019/371472 [2:47:28<26:24:06,  3.54it/s]
  9%|▉         | 35020/371472 [2:47:28<27:43:12,  3.37it/s]
                                                           
{'loss': 4.3895, 'learning_rate': 9.155928806912451e-07, 'epoch': 1.51}

  9%|▉         | 35020/371472 [2:47:28<27:43:12,  3.37it/s]
  9%|▉         | 35021/371472 [2:47:28<33:27:07,  2.79it/s]
  9%|▉         | 35022/371472 [2:47:29<31:49:49,  2.94it/s]
  9%|▉         | 35023/371472 [2:47:29<29:24:05,  3.18it/s]
  9%|▉         | 35024/371472 [2:47:29<29:09:08,  3.21it/s]
  9%|▉         | 35025/371472 [2:47:30<30:11:48,  3.09it/s]
  9%|▉         | 35026/371472 [2:47:30<28:10:32,  3.32it/s]
  9%|▉         | 35027/371472 [2:47:30<27:35:09,  3.39it/s]
  9%|▉         | 35028/371472 [2:47:31<27:13:13,  3.43it/s]
  9%|▉         | 35029/371472 [2:47:31<27:02:56,  3.46it/s]
  9%|▉         | 35030/371472 [2:47:31<26:06:15,  3.58it/s]
  9%|▉         | 35031/371472 [2:47:31<25:50:58,  3.62it/s]
  9%|▉         | 35032/371472 [2:47:32<25:41:05,  3.64it/s]
  9%|▉         | 35033/371472 [2:47:32<28:03:45,  3.33it/s]
  9%|▉         | 35034/371472 [2:47:32<26:37:35,  3.51it/s]
  9%|▉         | 35035/371472 [2:47:32<25:52:29,  3.61it/s]
  9%|▉         | 35036/371472 [2:47:33<25:12:27,  3.71it/s]
  9%|▉         | 35037/371472 [2:47:33<26:14:03,  3.56it/s]
  9%|▉         | 35038/371472 [2:47:33<25:07:20,  3.72it/s]
  9%|▉         | 35039/371472 [2:47:34<25:08:11,  3.72it/s]
  9%|▉         | 35040/371472 [2:47:34<27:21:37,  3.42it/s]
                                                           
{'loss': 4.2913, 'learning_rate': 9.155443987157663e-07, 'epoch': 1.51}

  9%|▉         | 35040/371472 [2:47:34<27:21:37,  3.42it/s]
  9%|▉         | 35041/371472 [2:47:34<26:31:43,  3.52it/s]
  9%|▉         | 35042/371472 [2:47:34<26:54:30,  3.47it/s]
  9%|▉         | 35043/371472 [2:47:35<26:41:54,  3.50it/s]
  9%|▉         | 35044/371472 [2:47:35<27:09:13,  3.44it/s]
  9%|▉         | 35045/371472 [2:47:35<26:13:48,  3.56it/s]
  9%|▉         | 35046/371472 [2:47:36<25:49:12,  3.62it/s]
  9%|▉         | 35047/371472 [2:47:36<29:09:14,  3.21it/s]
  9%|▉         | 35048/371472 [2:47:36<28:04:32,  3.33it/s]
  9%|▉         | 35049/371472 [2:47:36<27:18:43,  3.42it/s]
  9%|▉         | 35050/371472 [2:47:37<27:41:27,  3.37it/s]
  9%|▉         | 35051/371472 [2:47:37<27:15:58,  3.43it/s]
  9%|▉         | 35052/371472 [2:47:37<26:21:22,  3.55it/s]
  9%|▉         | 35053/371472 [2:47:38<26:19:06,  3.55it/s]
  9%|▉         | 35054/371472 [2:47:38<26:10:46,  3.57it/s]
  9%|▉         | 35055/371472 [2:47:38<25:34:53,  3.65it/s]
  9%|▉         | 35056/371472 [2:47:38<27:17:30,  3.42it/s]
  9%|▉         | 35057/371472 [2:47:39<25:53:48,  3.61it/s]
  9%|▉         | 35058/371472 [2:47:39<26:29:21,  3.53it/s]
  9%|▉         | 35059/371472 [2:47:39<26:44:38,  3.49it/s]
  9%|▉         | 35060/371472 [2:47:40<25:58:01,  3.60it/s]
                                                           
{'loss': 4.4838, 'learning_rate': 9.154959167402874e-07, 'epoch': 1.51}

  9%|▉         | 35060/371472 [2:47:40<25:58:01,  3.60it/s]
  9%|▉         | 35061/371472 [2:47:40<26:13:57,  3.56it/s]
  9%|▉         | 35062/371472 [2:47:40<27:16:03,  3.43it/s]
  9%|▉         | 35063/371472 [2:47:40<27:03:16,  3.45it/s]
  9%|▉         | 35064/371472 [2:47:41<27:16:59,  3.43it/s]
  9%|▉         | 35065/371472 [2:47:41<25:51:57,  3.61it/s]
  9%|▉         | 35066/371472 [2:47:41<27:58:11,  3.34it/s]
  9%|▉         | 35067/371472 [2:47:42<27:26:41,  3.40it/s]
  9%|▉         | 35068/371472 [2:47:42<26:03:25,  3.59it/s]
  9%|▉         | 35069/371472 [2:47:42<26:10:58,  3.57it/s]
  9%|▉         | 35070/371472 [2:47:42<27:41:24,  3.37it/s]
  9%|▉         | 35071/371472 [2:47:43<26:42:52,  3.50it/s]
  9%|▉         | 35072/371472 [2:47:43<27:06:15,  3.45it/s]
  9%|▉         | 35073/371472 [2:47:43<30:00:28,  3.11it/s]
  9%|▉         | 35074/371472 [2:47:44<28:38:50,  3.26it/s]
  9%|▉         | 35075/371472 [2:47:44<28:29:01,  3.28it/s]
  9%|▉         | 35076/371472 [2:47:44<26:58:57,  3.46it/s]
  9%|▉         | 35077/371472 [2:47:45<26:22:25,  3.54it/s]
  9%|▉         | 35078/371472 [2:47:45<28:09:29,  3.32it/s]
  9%|▉         | 35079/371472 [2:47:45<27:21:39,  3.42it/s]
  9%|▉         | 35080/371472 [2:47:45<26:12:38,  3.57it/s]
                                                           
{'loss': 4.7426, 'learning_rate': 9.154474347648086e-07, 'epoch': 1.51}

  9%|▉         | 35080/371472 [2:47:45<26:12:38,  3.57it/s]
  9%|▉         | 35081/371472 [2:47:46<25:45:21,  3.63it/s]
  9%|▉         | 35082/371472 [2:47:46<25:24:26,  3.68it/s]
  9%|▉         | 35083/371472 [2:47:46<25:36:18,  3.65it/s]
  9%|▉         | 35084/371472 [2:47:47<28:40:01,  3.26it/s]
  9%|▉         | 35085/371472 [2:47:47<28:22:33,  3.29it/s]
  9%|▉         | 35086/371472 [2:47:47<27:36:43,  3.38it/s]
  9%|▉         | 35087/371472 [2:47:47<27:09:40,  3.44it/s]
  9%|▉         | 35088/371472 [2:47:48<25:57:58,  3.60it/s]
  9%|▉         | 35089/371472 [2:47:48<24:55:42,  3.75it/s]
  9%|▉         | 35090/371472 [2:47:48<25:28:21,  3.67it/s]
  9%|▉         | 35091/371472 [2:47:49<26:54:29,  3.47it/s]
  9%|▉         | 35092/371472 [2:47:49<26:53:07,  3.48it/s]
  9%|▉         | 35093/371472 [2:47:49<27:27:46,  3.40it/s]
  9%|▉         | 35094/371472 [2:47:49<25:57:33,  3.60it/s]
  9%|▉         | 35095/371472 [2:47:50<25:56:35,  3.60it/s]
  9%|▉         | 35096/371472 [2:47:50<26:31:11,  3.52it/s]
  9%|▉         | 35097/371472 [2:47:50<25:42:43,  3.63it/s]
  9%|▉         | 35098/371472 [2:47:50<25:04:09,  3.73it/s]
  9%|▉         | 35099/371472 [2:47:51<25:37:40,  3.65it/s]
  9%|▉         | 35100/371472 [2:47:51<24:54:33,  3.75it/s]
                                                           
{'loss': 4.3318, 'learning_rate': 9.153989527893296e-07, 'epoch': 1.51}

  9%|▉         | 35100/371472 [2:47:51<24:54:33,  3.75it/s]
  9%|▉         | 35101/371472 [2:47:51<25:00:44,  3.74it/s]
  9%|▉         | 35102/371472 [2:47:52<24:51:34,  3.76it/s]
  9%|▉         | 35103/371472 [2:47:52<27:23:56,  3.41it/s]
  9%|▉         | 35104/371472 [2:47:52<28:07:38,  3.32it/s]
  9%|▉         | 35105/371472 [2:47:53<27:40:42,  3.38it/s]
  9%|▉         | 35106/371472 [2:47:53<26:38:26,  3.51it/s]
  9%|▉         | 35107/371472 [2:47:53<26:08:12,  3.57it/s]
  9%|▉         | 35108/371472 [2:47:53<25:59:08,  3.60it/s]
  9%|▉         | 35109/371472 [2:47:54<25:31:12,  3.66it/s]
  9%|▉         | 35110/371472 [2:47:54<25:22:47,  3.68it/s]
  9%|▉         | 35111/371472 [2:47:54<24:54:20,  3.75it/s]
  9%|▉         | 35112/371472 [2:47:54<26:29:18,  3.53it/s]
  9%|▉         | 35113/371472 [2:47:55<26:55:35,  3.47it/s]
  9%|▉         | 35114/371472 [2:47:55<25:39:15,  3.64it/s]
  9%|▉         | 35115/371472 [2:47:55<26:14:11,  3.56it/s]
  9%|▉         | 35116/371472 [2:47:56<26:11:06,  3.57it/s]
  9%|▉         | 35117/371472 [2:47:56<27:48:52,  3.36it/s]
  9%|▉         | 35118/371472 [2:47:56<27:35:35,  3.39it/s]
  9%|▉         | 35119/371472 [2:47:56<26:32:36,  3.52it/s]
  9%|▉         | 35120/371472 [2:47:57<27:50:02,  3.36it/s]
                                                           
{'loss': 4.2035, 'learning_rate': 9.153504708138508e-07, 'epoch': 1.51}

  9%|▉         | 35120/371472 [2:47:57<27:50:02,  3.36it/s]
  9%|▉         | 35121/371472 [2:47:57<27:23:06,  3.41it/s]
  9%|▉         | 35122/371472 [2:47:57<26:49:06,  3.48it/s]
  9%|▉         | 35123/371472 [2:47:58<25:47:15,  3.62it/s]
  9%|▉         | 35124/371472 [2:47:58<25:28:04,  3.67it/s]
  9%|▉         | 35125/371472 [2:47:58<26:50:50,  3.48it/s]
  9%|▉         | 35126/371472 [2:47:58<26:24:23,  3.54it/s]
  9%|▉         | 35127/371472 [2:47:59<25:53:55,  3.61it/s]
  9%|▉         | 35128/371472 [2:47:59<26:29:19,  3.53it/s]
  9%|▉         | 35129/371472 [2:47:59<28:53:23,  3.23it/s]
  9%|▉         | 35130/371472 [2:48:00<27:44:09,  3.37it/s]
  9%|▉         | 35131/371472 [2:48:00<29:03:43,  3.21it/s]
  9%|▉         | 35132/371472 [2:48:00<27:28:54,  3.40it/s]
  9%|▉         | 35133/371472 [2:48:00<26:59:49,  3.46it/s]
  9%|▉         | 35134/371472 [2:48:01<29:05:34,  3.21it/s]
  9%|▉         | 35135/371472 [2:48:01<27:48:31,  3.36it/s]
  9%|▉         | 35136/371472 [2:48:01<26:33:40,  3.52it/s]
  9%|▉         | 35137/371472 [2:48:02<25:38:21,  3.64it/s]
  9%|▉         | 35138/371472 [2:48:02<26:13:10,  3.56it/s]
  9%|▉         | 35139/371472 [2:48:02<26:08:43,  3.57it/s]
  9%|▉         | 35140/371472 [2:48:02<26:18:33,  3.55it/s]
                                                           
{'loss': 4.4679, 'learning_rate': 9.153019888383718e-07, 'epoch': 1.51}

  9%|▉         | 35140/371472 [2:48:02<26:18:33,  3.55it/s]
  9%|▉         | 35141/371472 [2:48:03<25:37:18,  3.65it/s]
  9%|▉         | 35142/371472 [2:48:03<26:30:45,  3.52it/s]
  9%|▉         | 35143/371472 [2:48:03<29:25:20,  3.18it/s]
  9%|▉         | 35144/371472 [2:48:04<28:12:25,  3.31it/s]
  9%|▉         | 35145/371472 [2:48:04<27:07:28,  3.44it/s]
  9%|▉         | 35146/371472 [2:48:04<26:08:51,  3.57it/s]
  9%|▉         | 35147/371472 [2:48:04<26:16:13,  3.56it/s]
  9%|▉         | 35148/371472 [2:48:05<25:49:11,  3.62it/s]
  9%|▉         | 35149/371472 [2:48:05<24:42:48,  3.78it/s]
  9%|▉         | 35150/371472 [2:48:05<25:17:02,  3.69it/s]
  9%|▉         | 35151/371472 [2:48:06<25:35:10,  3.65it/s]
  9%|▉         | 35152/371472 [2:48:06<25:20:46,  3.69it/s]
  9%|▉         | 35153/371472 [2:48:06<25:57:14,  3.60it/s]
  9%|▉         | 35154/371472 [2:48:06<26:11:26,  3.57it/s]
  9%|▉         | 35155/371472 [2:48:07<25:32:00,  3.66it/s]
  9%|▉         | 35156/371472 [2:48:07<25:59:54,  3.59it/s]
  9%|▉         | 35157/371472 [2:48:07<26:05:13,  3.58it/s]
  9%|▉         | 35158/371472 [2:48:08<26:41:37,  3.50it/s]
  9%|▉         | 35159/371472 [2:48:08<26:27:47,  3.53it/s]
  9%|▉         | 35160/371472 [2:48:08<28:05:03,  3.33it/s]
                                                           
{'loss': 4.2768, 'learning_rate': 9.15253506862893e-07, 'epoch': 1.51}

  9%|▉         | 35160/371472 [2:48:08<28:05:03,  3.33it/s]
  9%|▉         | 35161/371472 [2:48:08<28:01:00,  3.33it/s]
  9%|▉         | 35162/371472 [2:48:09<27:12:17,  3.43it/s]
  9%|▉         | 35163/371472 [2:48:09<27:05:19,  3.45it/s]
  9%|▉         | 35164/371472 [2:48:09<27:07:53,  3.44it/s]
  9%|▉         | 35165/371472 [2:48:10<26:50:47,  3.48it/s]
  9%|▉         | 35166/371472 [2:48:10<26:02:30,  3.59it/s]
  9%|▉         | 35167/371472 [2:48:10<25:17:25,  3.69it/s]
  9%|▉         | 35168/371472 [2:48:10<26:46:56,  3.49it/s]
  9%|▉         | 35169/371472 [2:48:11<26:54:40,  3.47it/s]
  9%|▉         | 35170/371472 [2:48:11<25:52:51,  3.61it/s]
  9%|▉         | 35171/371472 [2:48:11<24:59:00,  3.74it/s]
  9%|▉         | 35172/371472 [2:48:11<25:01:27,  3.73it/s]
  9%|▉         | 35173/371472 [2:48:12<24:32:52,  3.81it/s]
  9%|▉         | 35174/371472 [2:48:12<26:36:11,  3.51it/s]
  9%|▉         | 35175/371472 [2:48:12<26:45:33,  3.49it/s]
  9%|▉         | 35176/371472 [2:48:13<26:06:17,  3.58it/s]
  9%|▉         | 35177/371472 [2:48:13<26:56:14,  3.47it/s]
  9%|▉         | 35178/371472 [2:48:13<27:52:31,  3.35it/s]
  9%|▉         | 35179/371472 [2:48:14<28:50:27,  3.24it/s]
  9%|▉         | 35180/371472 [2:48:14<27:34:06,  3.39it/s]
                                                           
{'loss': 4.447, 'learning_rate': 9.15205024887414e-07, 'epoch': 1.52}

  9%|▉         | 35180/371472 [2:48:14<27:34:06,  3.39it/s]
  9%|▉         | 35181/371472 [2:48:14<26:42:04,  3.50it/s]
  9%|▉         | 35182/371472 [2:48:14<26:14:05,  3.56it/s]
  9%|▉         | 35183/371472 [2:48:15<26:30:44,  3.52it/s]
  9%|▉         | 35184/371472 [2:48:15<25:39:03,  3.64it/s]
  9%|▉         | 35185/371472 [2:48:15<25:29:55,  3.66it/s]
  9%|▉         | 35186/371472 [2:48:16<29:03:44,  3.21it/s]
  9%|▉         | 35187/371472 [2:48:16<28:32:13,  3.27it/s]
  9%|▉         | 35188/371472 [2:48:16<27:50:18,  3.36it/s]
  9%|▉         | 35189/371472 [2:48:16<28:20:30,  3.30it/s]
  9%|▉         | 35190/371472 [2:48:17<28:17:17,  3.30it/s]
  9%|▉         | 35191/371472 [2:48:17<28:41:55,  3.25it/s]
  9%|▉         | 35192/371472 [2:48:17<27:29:01,  3.40it/s]
  9%|▉         | 35193/371472 [2:48:18<27:06:14,  3.45it/s]
  9%|▉         | 35194/371472 [2:48:18<26:53:57,  3.47it/s]
  9%|▉         | 35195/371472 [2:48:18<26:23:53,  3.54it/s]
  9%|▉         | 35196/371472 [2:48:18<25:39:58,  3.64it/s]
  9%|▉         | 35197/371472 [2:48:19<27:10:01,  3.44it/s]
  9%|▉         | 35198/371472 [2:48:19<26:09:59,  3.57it/s]
  9%|▉         | 35199/371472 [2:48:19<26:05:56,  3.58it/s]
  9%|▉         | 35200/371472 [2:48:20<26:40:19,  3.50it/s]
                                                           
{'loss': 4.5441, 'learning_rate': 9.151565429119351e-07, 'epoch': 1.52}

  9%|▉         | 35200/371472 [2:48:20<26:40:19,  3.50it/s]
  9%|▉         | 35201/371472 [2:48:20<26:55:10,  3.47it/s]
  9%|▉         | 35202/371472 [2:48:20<26:16:13,  3.56it/s]
  9%|▉         | 35203/371472 [2:48:20<26:46:00,  3.49it/s]
  9%|▉         | 35204/371472 [2:48:21<27:11:13,  3.44it/s]
  9%|▉         | 35205/371472 [2:48:21<26:56:56,  3.47it/s]
  9%|▉         | 35206/371472 [2:48:21<25:53:01,  3.61it/s]
  9%|▉         | 35207/371472 [2:48:22<25:47:09,  3.62it/s]
  9%|▉         | 35208/371472 [2:48:22<25:52:42,  3.61it/s]
  9%|▉         | 35209/371472 [2:48:22<29:59:57,  3.11it/s]
  9%|▉         | 35210/371472 [2:48:23<29:05:38,  3.21it/s]
  9%|▉         | 35211/371472 [2:48:23<27:46:46,  3.36it/s]
  9%|▉         | 35212/371472 [2:48:23<28:33:32,  3.27it/s]
  9%|▉         | 35213/371472 [2:48:23<27:14:47,  3.43it/s]
  9%|▉         | 35214/371472 [2:48:24<26:42:15,  3.50it/s]
  9%|▉         | 35215/371472 [2:48:24<26:07:38,  3.57it/s]
  9%|▉         | 35216/371472 [2:48:24<27:17:59,  3.42it/s]
  9%|▉         | 35217/371472 [2:48:25<26:05:06,  3.58it/s]
  9%|▉         | 35218/371472 [2:48:25<25:33:05,  3.66it/s]
  9%|▉         | 35219/371472 [2:48:25<28:14:29,  3.31it/s]
  9%|▉         | 35220/371472 [2:48:25<26:28:20,  3.53it/s]
                                                           
{'loss': 4.239, 'learning_rate': 9.151080609364563e-07, 'epoch': 1.52}

  9%|▉         | 35220/371472 [2:48:25<26:28:20,  3.53it/s]
  9%|▉         | 35221/371472 [2:48:26<26:38:58,  3.50it/s]
  9%|▉         | 35222/371472 [2:48:26<29:01:15,  3.22it/s]
  9%|▉         | 35223/371472 [2:48:26<27:51:59,  3.35it/s]
  9%|▉         | 35224/371472 [2:48:27<27:42:30,  3.37it/s]
  9%|▉         | 35225/371472 [2:48:27<27:19:16,  3.42it/s]
  9%|▉         | 35226/371472 [2:48:27<27:38:29,  3.38it/s]
  9%|▉         | 35227/371472 [2:48:28<28:34:15,  3.27it/s]
  9%|▉         | 35228/371472 [2:48:28<27:19:58,  3.42it/s]
  9%|▉         | 35229/371472 [2:48:28<27:55:42,  3.34it/s]
  9%|▉         | 35230/371472 [2:48:28<28:09:30,  3.32it/s]
  9%|▉         | 35231/371472 [2:48:29<28:45:38,  3.25it/s]
  9%|▉         | 35232/371472 [2:48:29<27:48:39,  3.36it/s]
  9%|▉         | 35233/371472 [2:48:29<28:12:45,  3.31it/s]
  9%|▉         | 35234/371472 [2:48:30<27:07:04,  3.44it/s]
  9%|▉         | 35235/371472 [2:48:30<27:06:17,  3.45it/s]
  9%|▉         | 35236/371472 [2:48:30<26:53:09,  3.47it/s]
  9%|▉         | 35237/371472 [2:48:31<28:22:43,  3.29it/s]
  9%|▉         | 35238/371472 [2:48:31<27:44:27,  3.37it/s]
  9%|▉         | 35239/371472 [2:48:31<31:54:53,  2.93it/s]
  9%|▉         | 35240/371472 [2:48:32<30:28:40,  3.06it/s]
                                                           
{'loss': 4.4943, 'learning_rate': 9.150595789609775e-07, 'epoch': 1.52}

  9%|▉         | 35240/371472 [2:48:32<30:28:40,  3.06it/s]
  9%|▉         | 35241/371472 [2:48:32<29:14:32,  3.19it/s]
  9%|▉         | 35242/371472 [2:48:32<27:43:27,  3.37it/s]
  9%|▉         | 35243/371472 [2:48:32<27:42:46,  3.37it/s]
  9%|▉         | 35244/371472 [2:48:33<26:44:22,  3.49it/s]
  9%|▉         | 35245/371472 [2:48:33<25:49:08,  3.62it/s]
  9%|▉         | 35246/371472 [2:48:33<24:48:22,  3.77it/s]
  9%|▉         | 35247/371472 [2:48:33<26:25:08,  3.54it/s]
  9%|▉         | 35248/371472 [2:48:34<25:23:59,  3.68it/s]
  9%|▉         | 35249/371472 [2:48:34<26:52:29,  3.48it/s]
  9%|▉         | 35250/371472 [2:48:34<28:19:12,  3.30it/s]
  9%|▉         | 35251/371472 [2:48:35<27:11:47,  3.43it/s]
  9%|▉         | 35252/371472 [2:48:35<26:14:04,  3.56it/s]
  9%|▉         | 35253/371472 [2:48:35<26:30:47,  3.52it/s]
  9%|▉         | 35254/371472 [2:48:35<26:12:40,  3.56it/s]
  9%|▉         | 35255/371472 [2:48:36<25:31:13,  3.66it/s]
  9%|▉         | 35256/371472 [2:48:36<26:58:31,  3.46it/s]
  9%|▉         | 35257/371472 [2:48:36<26:03:03,  3.58it/s]
  9%|▉         | 35258/371472 [2:48:37<25:52:13,  3.61it/s]
  9%|▉         | 35259/371472 [2:48:37<29:19:04,  3.19it/s]
  9%|▉         | 35260/371472 [2:48:37<28:38:24,  3.26it/s]
                                                           
{'loss': 4.28, 'learning_rate': 9.150110969854984e-07, 'epoch': 1.52}

  9%|▉         | 35260/371472 [2:48:37<28:38:24,  3.26it/s]
  9%|▉         | 35261/371472 [2:48:38<28:52:52,  3.23it/s]
  9%|▉         | 35262/371472 [2:48:38<28:08:44,  3.32it/s]
  9%|▉         | 35263/371472 [2:48:38<27:50:20,  3.35it/s]
  9%|▉         | 35264/371472 [2:48:38<27:14:39,  3.43it/s]
  9%|▉         | 35265/371472 [2:48:39<30:55:28,  3.02it/s]
  9%|▉         | 35266/371472 [2:48:39<28:58:40,  3.22it/s]
  9%|▉         | 35267/371472 [2:48:39<28:28:40,  3.28it/s]
  9%|▉         | 35268/371472 [2:48:40<28:56:17,  3.23it/s]
  9%|▉         | 35269/371472 [2:48:40<28:16:44,  3.30it/s]
  9%|▉         | 35270/371472 [2:48:40<27:28:20,  3.40it/s]
  9%|▉         | 35271/371472 [2:48:41<26:22:56,  3.54it/s]
  9%|▉         | 35272/371472 [2:48:41<25:55:37,  3.60it/s]
  9%|▉         | 35273/371472 [2:48:41<25:58:16,  3.60it/s]
  9%|▉         | 35274/371472 [2:48:41<26:53:09,  3.47it/s]
  9%|▉         | 35275/371472 [2:48:42<28:55:14,  3.23it/s]
  9%|▉         | 35276/371472 [2:48:42<27:16:07,  3.42it/s]
  9%|▉         | 35277/371472 [2:48:42<26:53:31,  3.47it/s]
  9%|▉         | 35278/371472 [2:48:43<27:10:16,  3.44it/s]
  9%|▉         | 35279/371472 [2:48:43<27:32:56,  3.39it/s]
  9%|▉         | 35280/371472 [2:48:43<28:22:58,  3.29it/s]
                                                           
{'loss': 4.3123, 'learning_rate': 9.149626150100195e-07, 'epoch': 1.52}

  9%|▉         | 35280/371472 [2:48:43<28:22:58,  3.29it/s]
  9%|▉         | 35281/371472 [2:48:44<29:00:48,  3.22it/s]
  9%|▉         | 35282/371472 [2:48:44<27:43:20,  3.37it/s]
  9%|▉         | 35283/371472 [2:48:44<26:38:47,  3.50it/s]
  9%|▉         | 35284/371472 [2:48:44<25:43:42,  3.63it/s]
  9%|▉         | 35285/371472 [2:48:45<25:15:35,  3.70it/s]
  9%|▉         | 35286/371472 [2:48:45<25:09:21,  3.71it/s]
  9%|▉         | 35287/371472 [2:48:45<25:27:37,  3.67it/s]
  9%|▉         | 35288/371472 [2:48:45<24:45:18,  3.77it/s]
  9%|▉         | 35289/371472 [2:48:46<25:45:48,  3.62it/s]
 10%|▉         | 35290/371472 [2:48:46<25:28:50,  3.66it/s]
 10%|▉         | 35291/371472 [2:48:46<24:41:22,  3.78it/s]
 10%|▉         | 35292/371472 [2:48:46<24:32:00,  3.81it/s]
 10%|▉         | 35293/371472 [2:48:47<25:01:45,  3.73it/s]
 10%|▉         | 35294/371472 [2:48:47<25:43:42,  3.63it/s]
 10%|▉         | 35295/371472 [2:48:47<25:12:18,  3.70it/s]
 10%|▉         | 35296/371472 [2:48:48<25:51:35,  3.61it/s]
 10%|▉         | 35297/371472 [2:48:48<26:18:36,  3.55it/s]
 10%|▉         | 35298/371472 [2:48:48<27:00:48,  3.46it/s]
 10%|▉         | 35299/371472 [2:48:48<26:53:28,  3.47it/s]
 10%|▉         | 35300/371472 [2:48:49<26:46:47,  3.49it/s]
                                                           
{'loss': 4.4965, 'learning_rate': 9.149141330345407e-07, 'epoch': 1.52}

 10%|▉         | 35300/371472 [2:48:49<26:46:47,  3.49it/s]
 10%|▉         | 35301/371472 [2:48:49<26:17:43,  3.55it/s]
 10%|▉         | 35302/371472 [2:48:49<26:26:37,  3.53it/s]
 10%|▉         | 35303/371472 [2:48:50<25:41:36,  3.63it/s]
 10%|▉         | 35304/371472 [2:48:50<26:35:46,  3.51it/s]
 10%|▉         | 35305/371472 [2:48:50<26:25:47,  3.53it/s]
 10%|▉         | 35306/371472 [2:48:50<26:29:39,  3.52it/s]
 10%|▉         | 35307/371472 [2:48:51<25:31:15,  3.66it/s]
 10%|▉         | 35308/371472 [2:48:51<25:51:10,  3.61it/s]
 10%|▉         | 35309/371472 [2:48:51<26:09:34,  3.57it/s]
 10%|▉         | 35310/371472 [2:48:52<26:37:48,  3.51it/s]
 10%|▉         | 35311/371472 [2:48:52<26:39:38,  3.50it/s]
 10%|▉         | 35312/371472 [2:48:52<25:47:07,  3.62it/s]
 10%|▉         | 35313/371472 [2:48:52<26:51:13,  3.48it/s]
 10%|▉         | 35314/371472 [2:48:53<25:51:17,  3.61it/s]
 10%|▉         | 35315/371472 [2:48:53<28:10:24,  3.31it/s]
 10%|▉         | 35316/371472 [2:48:53<26:52:53,  3.47it/s]
 10%|▉         | 35317/371472 [2:48:54<26:52:41,  3.47it/s]
 10%|▉         | 35318/371472 [2:48:54<26:59:49,  3.46it/s]
 10%|▉         | 35319/371472 [2:48:54<27:11:00,  3.44it/s]
 10%|▉         | 35320/371472 [2:48:54<27:16:37,  3.42it/s]
                                                           
{'loss': 4.2643, 'learning_rate': 9.148656510590617e-07, 'epoch': 1.52}

 10%|▉         | 35320/371472 [2:48:54<27:16:37,  3.42it/s]
 10%|▉         | 35321/371472 [2:48:55<25:59:11,  3.59it/s]
 10%|▉         | 35322/371472 [2:48:55<25:38:02,  3.64it/s]
 10%|▉         | 35323/371472 [2:48:55<26:31:30,  3.52it/s]
 10%|▉         | 35324/371472 [2:48:55<26:08:07,  3.57it/s]
 10%|▉         | 35325/371472 [2:48:56<26:11:55,  3.56it/s]
 10%|▉         | 35326/371472 [2:48:56<25:44:30,  3.63it/s]
 10%|▉         | 35327/371472 [2:48:56<26:45:23,  3.49it/s]
 10%|▉         | 35328/371472 [2:48:57<25:58:53,  3.59it/s]
 10%|▉         | 35329/371472 [2:48:57<26:43:04,  3.49it/s]
 10%|▉         | 35330/371472 [2:48:57<25:41:05,  3.64it/s]
 10%|▉         | 35331/371472 [2:48:57<24:53:42,  3.75it/s]
 10%|▉         | 35332/371472 [2:48:58<25:15:31,  3.70it/s]
 10%|▉         | 35333/371472 [2:48:58<25:07:54,  3.72it/s]
 10%|▉         | 35334/371472 [2:48:58<26:17:19,  3.55it/s]
 10%|▉         | 35335/371472 [2:48:59<26:37:22,  3.51it/s]
 10%|▉         | 35336/371472 [2:48:59<26:17:38,  3.55it/s]
 10%|▉         | 35337/371472 [2:48:59<27:58:45,  3.34it/s]
 10%|▉         | 35338/371472 [2:48:59<27:04:55,  3.45it/s]
 10%|▉         | 35339/371472 [2:49:00<28:00:52,  3.33it/s]
 10%|▉         | 35340/371472 [2:49:00<27:49:30,  3.36it/s]
                                                           
{'loss': 4.4908, 'learning_rate': 9.148171690835828e-07, 'epoch': 1.52}

 10%|▉         | 35340/371472 [2:49:00<27:49:30,  3.36it/s]
 10%|▉         | 35341/371472 [2:49:00<27:51:28,  3.35it/s]
 10%|▉         | 35342/371472 [2:49:01<28:35:36,  3.27it/s]
 10%|▉         | 35343/371472 [2:49:01<27:42:29,  3.37it/s]
 10%|▉         | 35344/371472 [2:49:01<28:29:02,  3.28it/s]
 10%|▉         | 35345/371472 [2:49:02<28:54:55,  3.23it/s]
 10%|▉         | 35346/371472 [2:49:02<26:55:40,  3.47it/s]
 10%|▉         | 35347/371472 [2:49:02<29:17:35,  3.19it/s]
 10%|▉         | 35348/371472 [2:49:02<28:32:38,  3.27it/s]
 10%|▉         | 35349/371472 [2:49:03<28:37:18,  3.26it/s]
 10%|▉         | 35350/371472 [2:49:03<28:08:55,  3.32it/s]
 10%|▉         | 35351/371472 [2:49:03<27:44:02,  3.37it/s]
 10%|▉         | 35352/371472 [2:49:04<28:29:44,  3.28it/s]
 10%|▉         | 35353/371472 [2:49:04<29:37:36,  3.15it/s]
 10%|▉         | 35354/371472 [2:49:04<28:45:40,  3.25it/s]
 10%|▉         | 35355/371472 [2:49:05<28:20:40,  3.29it/s]
 10%|▉         | 35356/371472 [2:49:05<28:09:23,  3.32it/s]
 10%|▉         | 35357/371472 [2:49:05<27:45:26,  3.36it/s]
 10%|▉         | 35358/371472 [2:49:06<28:29:29,  3.28it/s]
 10%|▉         | 35359/371472 [2:49:06<26:56:48,  3.46it/s]
 10%|▉         | 35360/371472 [2:49:06<26:34:25,  3.51it/s]
                                                           
{'loss': 4.5154, 'learning_rate': 9.14768687108104e-07, 'epoch': 1.52}

 10%|▉         | 35360/371472 [2:49:06<26:34:25,  3.51it/s]
 10%|▉         | 35361/371472 [2:49:06<26:32:08,  3.52it/s]
 10%|▉         | 35362/371472 [2:49:07<27:44:26,  3.37it/s]
 10%|▉         | 35363/371472 [2:49:07<27:25:27,  3.40it/s]
 10%|▉         | 35364/371472 [2:49:07<26:46:21,  3.49it/s]
 10%|▉         | 35365/371472 [2:49:07<25:53:14,  3.61it/s]
 10%|▉         | 35366/371472 [2:49:08<27:43:06,  3.37it/s]
 10%|▉         | 35367/371472 [2:49:08<27:29:44,  3.40it/s]
 10%|▉         | 35368/371472 [2:49:08<28:49:17,  3.24it/s]
 10%|▉         | 35369/371472 [2:49:09<28:08:30,  3.32it/s]
 10%|▉         | 35370/371472 [2:49:09<27:01:15,  3.46it/s]
 10%|▉         | 35371/371472 [2:49:09<27:51:36,  3.35it/s]
 10%|▉         | 35372/371472 [2:49:10<27:13:49,  3.43it/s]
 10%|▉         | 35373/371472 [2:49:10<27:30:37,  3.39it/s]
 10%|▉         | 35374/371472 [2:49:10<28:39:47,  3.26it/s]
 10%|▉         | 35375/371472 [2:49:11<31:04:53,  3.00it/s]
 10%|▉         | 35376/371472 [2:49:11<29:06:25,  3.21it/s]
 10%|▉         | 35377/371472 [2:49:11<28:36:53,  3.26it/s]
 10%|▉         | 35378/371472 [2:49:11<28:13:35,  3.31it/s]
 10%|▉         | 35379/371472 [2:49:12<27:04:27,  3.45it/s]
 10%|▉         | 35380/371472 [2:49:12<28:41:17,  3.25it/s]
                                                           
{'loss': 4.5667, 'learning_rate': 9.147202051326251e-07, 'epoch': 1.52}

 10%|▉         | 35380/371472 [2:49:12<28:41:17,  3.25it/s]
 10%|▉         | 35381/371472 [2:49:12<27:40:26,  3.37it/s]
 10%|▉         | 35382/371472 [2:49:13<28:43:56,  3.25it/s]
 10%|▉         | 35383/371472 [2:49:13<27:53:05,  3.35it/s]
 10%|▉         | 35384/371472 [2:49:13<28:28:15,  3.28it/s]
 10%|▉         | 35385/371472 [2:49:14<28:42:41,  3.25it/s]
 10%|▉         | 35386/371472 [2:49:14<27:59:55,  3.33it/s]
 10%|▉         | 35387/371472 [2:49:14<27:30:14,  3.39it/s]
 10%|▉         | 35388/371472 [2:49:14<27:21:49,  3.41it/s]
 10%|▉         | 35389/371472 [2:49:15<28:27:00,  3.28it/s]
 10%|▉         | 35390/371472 [2:49:15<26:35:22,  3.51it/s]
 10%|▉         | 35391/371472 [2:49:15<26:23:51,  3.54it/s]
 10%|▉         | 35392/371472 [2:49:16<27:29:45,  3.40it/s]
 10%|▉         | 35393/371472 [2:49:16<26:11:49,  3.56it/s]
 10%|▉         | 35394/371472 [2:49:16<25:26:36,  3.67it/s]
 10%|▉         | 35395/371472 [2:49:16<25:34:07,  3.65it/s]
 10%|▉         | 35396/371472 [2:49:17<27:10:44,  3.43it/s]
 10%|▉         | 35397/371472 [2:49:17<25:56:25,  3.60it/s]
 10%|▉         | 35398/371472 [2:49:17<25:43:43,  3.63it/s]
 10%|▉         | 35399/371472 [2:49:18<26:03:32,  3.58it/s]
 10%|▉         | 35400/371472 [2:49:18<25:37:23,  3.64it/s]
                                                           
{'loss': 4.3141, 'learning_rate': 9.146717231571461e-07, 'epoch': 1.52}

 10%|▉         | 35400/371472 [2:49:18<25:37:23,  3.64it/s]
 10%|▉         | 35401/371472 [2:49:18<26:18:57,  3.55it/s]
 10%|▉         | 35402/371472 [2:49:18<26:01:12,  3.59it/s]
 10%|▉         | 35403/371472 [2:49:19<25:35:01,  3.65it/s]
 10%|▉         | 35404/371472 [2:49:19<25:37:03,  3.64it/s]
 10%|▉         | 35405/371472 [2:49:19<26:01:57,  3.59it/s]
 10%|▉         | 35406/371472 [2:49:19<26:17:51,  3.55it/s]
 10%|▉         | 35407/371472 [2:49:20<25:36:54,  3.64it/s]
 10%|▉         | 35408/371472 [2:49:20<26:09:59,  3.57it/s]
 10%|▉         | 35409/371472 [2:49:20<27:11:52,  3.43it/s]
 10%|▉         | 35410/371472 [2:49:21<27:45:33,  3.36it/s]
 10%|▉         | 35411/371472 [2:49:21<27:58:57,  3.34it/s]
 10%|▉         | 35412/371472 [2:49:21<28:14:56,  3.30it/s]
 10%|▉         | 35413/371472 [2:49:22<26:59:59,  3.46it/s]
 10%|▉         | 35414/371472 [2:49:22<26:51:23,  3.48it/s]
 10%|▉         | 35415/371472 [2:49:22<30:42:13,  3.04it/s]
 10%|▉         | 35416/371472 [2:49:23<28:43:34,  3.25it/s]
 10%|▉         | 35417/371472 [2:49:23<29:53:46,  3.12it/s]
 10%|▉         | 35418/371472 [2:49:23<28:11:44,  3.31it/s]
 10%|▉         | 35419/371472 [2:49:23<28:29:04,  3.28it/s]
 10%|▉         | 35420/371472 [2:49:24<27:41:18,  3.37it/s]
                                                           
{'loss': 4.3248, 'learning_rate': 9.146232411816673e-07, 'epoch': 1.53}

 10%|▉         | 35420/371472 [2:49:24<27:41:18,  3.37it/s]
 10%|▉         | 35421/371472 [2:49:24<27:22:05,  3.41it/s]
 10%|▉         | 35422/371472 [2:49:24<27:58:37,  3.34it/s]
 10%|▉         | 35423/371472 [2:49:25<27:25:42,  3.40it/s]
 10%|▉         | 35424/371472 [2:49:25<30:38:14,  3.05it/s]
 10%|▉         | 35425/371472 [2:49:25<28:15:23,  3.30it/s]
 10%|▉         | 35426/371472 [2:49:26<27:21:54,  3.41it/s]
 10%|▉         | 35427/371472 [2:49:26<26:33:14,  3.52it/s]
 10%|▉         | 35428/371472 [2:49:26<25:42:24,  3.63it/s]
 10%|▉         | 35429/371472 [2:49:26<26:36:36,  3.51it/s]
 10%|▉         | 35430/371472 [2:49:27<25:54:25,  3.60it/s]
 10%|▉         | 35431/371472 [2:49:27<27:30:21,  3.39it/s]
 10%|▉         | 35432/371472 [2:49:27<28:57:27,  3.22it/s]
 10%|▉         | 35433/371472 [2:49:28<28:17:55,  3.30it/s]
 10%|▉         | 35434/371472 [2:49:28<26:58:49,  3.46it/s]
 10%|▉         | 35435/371472 [2:49:28<27:11:23,  3.43it/s]
 10%|▉         | 35436/371472 [2:49:28<27:22:15,  3.41it/s]
 10%|▉         | 35437/371472 [2:49:29<26:48:36,  3.48it/s]
 10%|▉         | 35438/371472 [2:49:29<27:01:50,  3.45it/s]
 10%|▉         | 35439/371472 [2:49:29<26:58:34,  3.46it/s]
 10%|▉         | 35440/371472 [2:49:30<27:01:00,  3.45it/s]
                                                           
{'loss': 4.4251, 'learning_rate': 9.145747592061884e-07, 'epoch': 1.53}

 10%|▉         | 35440/371472 [2:49:30<27:01:00,  3.45it/s]
 10%|▉         | 35441/371472 [2:49:30<27:04:56,  3.45it/s]
 10%|▉         | 35442/371472 [2:49:30<26:41:29,  3.50it/s]
 10%|▉         | 35443/371472 [2:49:30<26:14:03,  3.56it/s]
 10%|▉         | 35444/371472 [2:49:31<25:52:08,  3.61it/s]
 10%|▉         | 35445/371472 [2:49:31<26:50:46,  3.48it/s]
 10%|▉         | 35446/371472 [2:49:31<26:55:03,  3.47it/s]
 10%|▉         | 35447/371472 [2:49:32<26:12:28,  3.56it/s]
 10%|▉         | 35448/371472 [2:49:32<25:41:21,  3.63it/s]
 10%|▉         | 35449/371472 [2:49:32<26:31:58,  3.52it/s]
 10%|▉         | 35450/371472 [2:49:32<25:35:18,  3.65it/s]
 10%|▉         | 35451/371472 [2:49:33<24:58:12,  3.74it/s]
 10%|▉         | 35452/371472 [2:49:33<24:43:32,  3.77it/s]
 10%|▉         | 35453/371472 [2:49:33<24:11:34,  3.86it/s]
 10%|▉         | 35454/371472 [2:49:33<24:57:33,  3.74it/s]
 10%|▉         | 35455/371472 [2:49:34<27:15:17,  3.42it/s]
 10%|▉         | 35456/371472 [2:49:34<26:25:56,  3.53it/s]
 10%|▉         | 35457/371472 [2:49:34<25:48:01,  3.62it/s]
 10%|▉         | 35458/371472 [2:49:35<24:49:44,  3.76it/s]
 10%|▉         | 35459/371472 [2:49:35<24:50:25,  3.76it/s]
 10%|▉         | 35460/371472 [2:49:35<24:09:02,  3.86it/s]
                                                           
{'loss': 4.612, 'learning_rate': 9.145262772307096e-07, 'epoch': 1.53}

 10%|▉         | 35460/371472 [2:49:35<24:09:02,  3.86it/s]
 10%|▉         | 35461/371472 [2:49:35<23:58:02,  3.89it/s]
 10%|▉         | 35462/371472 [2:49:36<24:56:34,  3.74it/s]
 10%|▉         | 35463/371472 [2:49:36<25:03:03,  3.73it/s]
 10%|▉         | 35464/371472 [2:49:36<25:32:10,  3.66it/s]
 10%|▉         | 35465/371472 [2:49:37<28:33:23,  3.27it/s]
 10%|▉         | 35466/371472 [2:49:37<27:27:32,  3.40it/s]
 10%|▉         | 35467/371472 [2:49:37<28:01:13,  3.33it/s]
 10%|▉         | 35468/371472 [2:49:37<27:58:20,  3.34it/s]
 10%|▉         | 35469/371472 [2:49:38<27:03:06,  3.45it/s]
 10%|▉         | 35470/371472 [2:49:38<25:58:01,  3.59it/s]
 10%|▉         | 35471/371472 [2:49:38<25:40:00,  3.64it/s]
 10%|▉         | 35472/371472 [2:49:38<25:03:20,  3.73it/s]
 10%|▉         | 35473/371472 [2:49:39<25:44:12,  3.63it/s]
 10%|▉         | 35474/371472 [2:49:39<26:38:10,  3.50it/s]
 10%|▉         | 35475/371472 [2:49:39<26:33:50,  3.51it/s]
 10%|▉         | 35476/371472 [2:49:40<26:09:19,  3.57it/s]
 10%|▉         | 35477/371472 [2:49:40<25:53:47,  3.60it/s]
 10%|▉         | 35478/371472 [2:49:40<25:25:27,  3.67it/s]
 10%|▉         | 35479/371472 [2:49:40<24:49:41,  3.76it/s]
 10%|▉         | 35480/371472 [2:49:41<24:46:21,  3.77it/s]
                                                           
{'loss': 4.5537, 'learning_rate': 9.144777952552306e-07, 'epoch': 1.53}

 10%|▉         | 35480/371472 [2:49:41<24:46:21,  3.77it/s]
 10%|▉         | 35481/371472 [2:49:41<24:36:12,  3.79it/s]
 10%|▉         | 35482/371472 [2:49:41<27:10:06,  3.44it/s]
 10%|▉         | 35483/371472 [2:49:41<25:56:25,  3.60it/s]
 10%|▉         | 35484/371472 [2:49:42<28:03:43,  3.33it/s]
 10%|▉         | 35485/371472 [2:49:42<26:22:17,  3.54it/s]
 10%|▉         | 35486/371472 [2:49:42<26:07:09,  3.57it/s]
 10%|▉         | 35487/371472 [2:49:43<26:55:45,  3.47it/s]
 10%|▉         | 35488/371472 [2:49:43<27:05:20,  3.45it/s]
 10%|▉         | 35489/371472 [2:49:43<27:19:31,  3.42it/s]
 10%|▉         | 35490/371472 [2:49:44<26:51:31,  3.47it/s]
 10%|▉         | 35491/371472 [2:49:44<28:10:11,  3.31it/s]
 10%|▉         | 35492/371472 [2:49:44<27:32:01,  3.39it/s]
 10%|▉         | 35493/371472 [2:49:44<26:24:00,  3.54it/s]
 10%|▉         | 35494/371472 [2:49:45<26:01:53,  3.59it/s]
 10%|▉         | 35495/371472 [2:49:45<26:02:13,  3.58it/s]
 10%|▉         | 35496/371472 [2:49:45<26:19:17,  3.55it/s]
 10%|▉         | 35497/371472 [2:49:46<27:15:16,  3.42it/s]
 10%|▉         | 35498/371472 [2:49:46<26:20:27,  3.54it/s]
 10%|▉         | 35499/371472 [2:49:46<27:15:24,  3.42it/s]
 10%|▉         | 35500/371472 [2:49:46<27:44:20,  3.36it/s]
                                                           
{'loss': 4.414, 'learning_rate': 9.144293132797518e-07, 'epoch': 1.53}

 10%|▉         | 35500/371472 [2:49:46<27:44:20,  3.36it/s]
 10%|▉         | 35501/371472 [2:49:47<27:20:09,  3.41it/s]
 10%|▉         | 35502/371472 [2:49:47<26:09:04,  3.57it/s]
 10%|▉         | 35503/371472 [2:49:47<26:06:22,  3.57it/s]
 10%|▉         | 35504/371472 [2:49:47<25:12:18,  3.70it/s]
 10%|▉         | 35505/371472 [2:49:48<24:58:10,  3.74it/s]
 10%|▉         | 35506/371472 [2:49:48<26:27:44,  3.53it/s]
 10%|▉         | 35507/371472 [2:49:48<26:09:31,  3.57it/s]
 10%|▉         | 35508/371472 [2:49:49<27:23:38,  3.41it/s]
 10%|▉         | 35509/371472 [2:49:49<26:37:07,  3.51it/s]
 10%|▉         | 35510/371472 [2:49:49<26:02:52,  3.58it/s]
 10%|▉         | 35511/371472 [2:49:49<26:17:31,  3.55it/s]
 10%|▉         | 35512/371472 [2:49:50<25:36:38,  3.64it/s]
 10%|▉         | 35513/371472 [2:49:50<25:48:09,  3.62it/s]
 10%|▉         | 35514/371472 [2:49:50<28:19:38,  3.29it/s]
 10%|▉         | 35515/371472 [2:49:51<27:43:24,  3.37it/s]
 10%|▉         | 35516/371472 [2:49:51<28:57:36,  3.22it/s]
 10%|▉         | 35517/371472 [2:49:51<28:04:54,  3.32it/s]
 10%|▉         | 35518/371472 [2:49:52<26:41:34,  3.50it/s]
 10%|▉         | 35519/371472 [2:49:52<26:27:25,  3.53it/s]
 10%|▉         | 35520/371472 [2:49:52<25:08:38,  3.71it/s]
                                                           
{'loss': 4.4837, 'learning_rate': 9.143808313042728e-07, 'epoch': 1.53}

 10%|▉         | 35520/371472 [2:49:52<25:08:38,  3.71it/s]
 10%|▉         | 35521/371472 [2:49:52<24:46:17,  3.77it/s]
 10%|▉         | 35522/371472 [2:49:53<25:55:43,  3.60it/s]
 10%|▉         | 35523/371472 [2:49:53<26:09:57,  3.57it/s]
 10%|▉         | 35524/371472 [2:49:53<25:38:05,  3.64it/s]
 10%|▉         | 35525/371472 [2:49:54<27:08:20,  3.44it/s]
 10%|▉         | 35526/371472 [2:49:54<26:53:47,  3.47it/s]
 10%|▉         | 35527/371472 [2:49:54<26:06:23,  3.57it/s]
 10%|▉         | 35528/371472 [2:49:54<25:16:04,  3.69it/s]
 10%|▉         | 35529/371472 [2:49:55<25:24:26,  3.67it/s]
 10%|▉         | 35530/371472 [2:49:55<25:58:25,  3.59it/s]
 10%|▉         | 35531/371472 [2:49:55<25:54:35,  3.60it/s]
 10%|▉         | 35532/371472 [2:49:55<25:15:40,  3.69it/s]
 10%|▉         | 35533/371472 [2:49:56<25:10:18,  3.71it/s]
 10%|▉         | 35534/371472 [2:49:56<25:14:42,  3.70it/s]
 10%|▉         | 35535/371472 [2:49:56<25:12:26,  3.70it/s]
 10%|▉         | 35536/371472 [2:49:56<24:54:55,  3.75it/s]
 10%|▉         | 35537/371472 [2:49:57<24:36:18,  3.79it/s]
 10%|▉         | 35538/371472 [2:49:57<24:21:18,  3.83it/s]
 10%|▉         | 35539/371472 [2:49:57<23:39:11,  3.95it/s]
 10%|▉         | 35540/371472 [2:49:58<24:46:16,  3.77it/s]
                                                           
{'loss': 4.5767, 'learning_rate': 9.14332349328794e-07, 'epoch': 1.53}

 10%|▉         | 35540/371472 [2:49:58<24:46:16,  3.77it/s]
 10%|▉         | 35541/371472 [2:49:58<25:28:43,  3.66it/s]
 10%|▉         | 35542/371472 [2:49:58<26:29:20,  3.52it/s]
 10%|▉         | 35543/371472 [2:49:58<27:55:54,  3.34it/s]
 10%|▉         | 35544/371472 [2:49:59<27:29:13,  3.39it/s]
 10%|▉         | 35545/371472 [2:49:59<27:02:39,  3.45it/s]
 10%|▉         | 35546/371472 [2:49:59<26:32:00,  3.52it/s]
 10%|▉         | 35547/371472 [2:50:00<29:04:26,  3.21it/s]
 10%|▉         | 35548/371472 [2:50:00<27:35:32,  3.38it/s]
 10%|▉         | 35549/371472 [2:50:00<26:55:33,  3.47it/s]
 10%|▉         | 35550/371472 [2:50:00<26:05:51,  3.58it/s]
 10%|▉         | 35551/371472 [2:50:01<26:19:09,  3.55it/s]
 10%|▉         | 35552/371472 [2:50:01<25:35:49,  3.65it/s]
 10%|▉         | 35553/371472 [2:50:01<27:50:39,  3.35it/s]
 10%|▉         | 35554/371472 [2:50:02<26:27:26,  3.53it/s]
 10%|▉         | 35555/371472 [2:50:02<25:53:51,  3.60it/s]
 10%|▉         | 35556/371472 [2:50:02<32:21:34,  2.88it/s]
 10%|▉         | 35557/371472 [2:50:03<30:57:21,  3.01it/s]
 10%|▉         | 35558/371472 [2:50:03<29:04:25,  3.21it/s]
 10%|▉         | 35559/371472 [2:50:03<27:08:02,  3.44it/s]
 10%|▉         | 35560/371472 [2:50:03<26:46:47,  3.48it/s]
                                                           
{'loss': 4.3294, 'learning_rate': 9.14283867353315e-07, 'epoch': 1.53}

 10%|▉         | 35560/371472 [2:50:03<26:46:47,  3.48it/s]
 10%|▉         | 35561/371472 [2:50:04<28:40:26,  3.25it/s]
 10%|▉         | 35562/371472 [2:50:04<28:31:25,  3.27it/s]
 10%|▉         | 35563/371472 [2:50:04<27:55:08,  3.34it/s]
 10%|▉         | 35564/371472 [2:50:05<27:09:00,  3.44it/s]
 10%|▉         | 35565/371472 [2:50:05<30:51:25,  3.02it/s]
 10%|▉         | 35566/371472 [2:50:05<29:16:33,  3.19it/s]
 10%|▉         | 35567/371472 [2:50:06<29:02:41,  3.21it/s]
 10%|▉         | 35568/371472 [2:50:06<27:40:22,  3.37it/s]
 10%|▉         | 35569/371472 [2:50:06<31:17:34,  2.98it/s]
 10%|▉         | 35570/371472 [2:50:07<30:50:49,  3.02it/s]
 10%|▉         | 35571/371472 [2:50:07<28:39:50,  3.26it/s]
 10%|▉         | 35572/371472 [2:50:07<28:32:25,  3.27it/s]
 10%|▉         | 35573/371472 [2:50:07<27:41:05,  3.37it/s]
 10%|▉         | 35574/371472 [2:50:08<26:04:50,  3.58it/s]
 10%|▉         | 35575/371472 [2:50:08<25:07:13,  3.71it/s]
 10%|▉         | 35576/371472 [2:50:08<25:11:14,  3.70it/s]
 10%|▉         | 35577/371472 [2:50:09<26:18:52,  3.55it/s]
 10%|▉         | 35578/371472 [2:50:09<26:48:04,  3.48it/s]
 10%|▉         | 35579/371472 [2:50:09<25:48:37,  3.61it/s]
 10%|▉         | 35580/371472 [2:50:09<25:58:07,  3.59it/s]
                                                           
{'loss': 4.2305, 'learning_rate': 9.142353853778362e-07, 'epoch': 1.53}

 10%|▉         | 35580/371472 [2:50:09<25:58:07,  3.59it/s]
 10%|▉         | 35581/371472 [2:50:10<25:42:39,  3.63it/s]
 10%|▉         | 35582/371472 [2:50:10<27:11:23,  3.43it/s]
 10%|▉         | 35583/371472 [2:50:10<26:02:38,  3.58it/s]
 10%|▉         | 35584/371472 [2:50:11<26:29:21,  3.52it/s]
 10%|▉         | 35585/371472 [2:50:11<26:13:23,  3.56it/s]
 10%|▉         | 35586/371472 [2:50:11<26:22:33,  3.54it/s]
 10%|▉         | 35587/371472 [2:50:11<25:17:19,  3.69it/s]
 10%|▉         | 35588/371472 [2:50:12<26:15:36,  3.55it/s]
 10%|▉         | 35589/371472 [2:50:12<27:12:11,  3.43it/s]
 10%|▉         | 35590/371472 [2:50:12<26:50:54,  3.48it/s]
 10%|▉         | 35591/371472 [2:50:13<27:21:43,  3.41it/s]
 10%|▉         | 35592/371472 [2:50:13<27:06:08,  3.44it/s]
 10%|▉         | 35593/371472 [2:50:13<26:42:41,  3.49it/s]
 10%|▉         | 35594/371472 [2:50:13<26:20:57,  3.54it/s]
 10%|▉         | 35595/371472 [2:50:14<25:53:00,  3.60it/s]
 10%|▉         | 35596/371472 [2:50:14<25:14:07,  3.70it/s]
 10%|▉         | 35597/371472 [2:50:14<25:11:04,  3.70it/s]
 10%|▉         | 35598/371472 [2:50:14<25:58:23,  3.59it/s]
 10%|▉         | 35599/371472 [2:50:15<26:02:33,  3.58it/s]
 10%|▉         | 35600/371472 [2:50:15<28:39:47,  3.25it/s]
                                                           
{'loss': 4.522, 'learning_rate': 9.141869034023573e-07, 'epoch': 1.53}

 10%|▉         | 35600/371472 [2:50:15<28:39:47,  3.25it/s]
 10%|▉         | 35601/371472 [2:50:16<32:14:19,  2.89it/s]
 10%|▉         | 35602/371472 [2:50:16<31:09:04,  2.99it/s]
 10%|▉         | 35603/371472 [2:50:16<30:14:20,  3.09it/s]
 10%|▉         | 35604/371472 [2:50:16<28:14:51,  3.30it/s]
 10%|▉         | 35605/371472 [2:50:17<29:22:44,  3.18it/s]
 10%|▉         | 35606/371472 [2:50:17<28:37:02,  3.26it/s]
 10%|▉         | 35607/371472 [2:50:17<30:07:40,  3.10it/s]
 10%|▉         | 35608/371472 [2:50:18<28:14:30,  3.30it/s]
 10%|▉         | 35609/371472 [2:50:18<26:58:07,  3.46it/s]
 10%|▉         | 35610/371472 [2:50:18<26:33:44,  3.51it/s]
 10%|▉         | 35611/371472 [2:50:18<25:49:40,  3.61it/s]
 10%|▉         | 35612/371472 [2:50:19<25:22:55,  3.68it/s]
 10%|▉         | 35613/371472 [2:50:19<24:36:56,  3.79it/s]
 10%|▉         | 35614/371472 [2:50:19<25:03:54,  3.72it/s]
 10%|▉         | 35615/371472 [2:50:20<25:16:47,  3.69it/s]
 10%|▉         | 35616/371472 [2:50:20<24:45:40,  3.77it/s]
 10%|▉         | 35617/371472 [2:50:20<26:08:20,  3.57it/s]
 10%|▉         | 35618/371472 [2:50:20<25:35:17,  3.65it/s]
 10%|▉         | 35619/371472 [2:50:21<25:16:29,  3.69it/s]
 10%|▉         | 35620/371472 [2:50:21<28:02:58,  3.33it/s]
                                                           
{'loss': 4.3252, 'learning_rate': 9.141384214268784e-07, 'epoch': 1.53}

 10%|▉         | 35620/371472 [2:50:21<28:02:58,  3.33it/s]
 10%|▉         | 35621/371472 [2:50:21<27:02:54,  3.45it/s]
 10%|▉         | 35622/371472 [2:50:22<27:13:07,  3.43it/s]
 10%|▉         | 35623/371472 [2:50:22<26:02:38,  3.58it/s]
 10%|▉         | 35624/371472 [2:50:22<27:36:11,  3.38it/s]
 10%|▉         | 35625/371472 [2:50:22<26:57:18,  3.46it/s]
 10%|▉         | 35626/371472 [2:50:23<25:55:36,  3.60it/s]
 10%|▉         | 35627/371472 [2:50:23<27:16:31,  3.42it/s]
 10%|▉         | 35628/371472 [2:50:23<27:34:56,  3.38it/s]
 10%|▉         | 35629/371472 [2:50:24<27:16:11,  3.42it/s]
 10%|▉         | 35630/371472 [2:50:24<26:20:01,  3.54it/s]
 10%|▉         | 35631/371472 [2:50:24<25:23:58,  3.67it/s]
 10%|▉         | 35632/371472 [2:50:24<26:00:48,  3.59it/s]
 10%|▉         | 35633/371472 [2:50:25<25:46:30,  3.62it/s]
 10%|▉         | 35634/371472 [2:50:25<25:12:46,  3.70it/s]
 10%|▉         | 35635/371472 [2:50:25<24:54:03,  3.75it/s]
 10%|▉         | 35636/371472 [2:50:25<25:18:06,  3.69it/s]
 10%|▉         | 35637/371472 [2:50:26<27:32:00,  3.39it/s]
 10%|▉         | 35638/371472 [2:50:26<26:10:22,  3.56it/s]
 10%|▉         | 35639/371472 [2:50:26<26:12:23,  3.56it/s]
 10%|▉         | 35640/371472 [2:50:27<27:36:04,  3.38it/s]
                                                           
{'loss': 4.4498, 'learning_rate': 9.140899394513994e-07, 'epoch': 1.54}

 10%|▉         | 35640/371472 [2:50:27<27:36:04,  3.38it/s]
 10%|▉         | 35641/371472 [2:50:27<26:12:45,  3.56it/s]
 10%|▉         | 35642/371472 [2:50:27<27:37:53,  3.38it/s]
 10%|▉         | 35643/371472 [2:50:27<26:43:41,  3.49it/s]
 10%|▉         | 35644/371472 [2:50:28<25:52:22,  3.61it/s]
 10%|▉         | 35645/371472 [2:50:28<25:13:17,  3.70it/s]
 10%|▉         | 35646/371472 [2:50:28<26:40:20,  3.50it/s]
 10%|▉         | 35647/371472 [2:50:29<27:14:52,  3.42it/s]
 10%|▉         | 35648/371472 [2:50:29<28:07:04,  3.32it/s]
 10%|▉         | 35649/371472 [2:50:29<27:06:16,  3.44it/s]
 10%|▉         | 35650/371472 [2:50:29<26:16:19,  3.55it/s]
 10%|▉         | 35651/371472 [2:50:30<25:40:33,  3.63it/s]
 10%|▉         | 35652/371472 [2:50:30<25:51:10,  3.61it/s]
 10%|▉         | 35653/371472 [2:50:30<25:36:29,  3.64it/s]
 10%|▉         | 35654/371472 [2:50:31<24:40:52,  3.78it/s]
 10%|▉         | 35655/371472 [2:50:31<25:49:57,  3.61it/s]
 10%|▉         | 35656/371472 [2:50:31<25:50:20,  3.61it/s]
 10%|▉         | 35657/371472 [2:50:31<26:01:12,  3.58it/s]
 10%|▉         | 35658/371472 [2:50:32<26:05:26,  3.58it/s]
 10%|▉         | 35659/371472 [2:50:32<26:15:18,  3.55it/s]
 10%|▉         | 35660/371472 [2:50:32<25:29:32,  3.66it/s]
                                                           
{'loss': 4.3863, 'learning_rate': 9.140414574759206e-07, 'epoch': 1.54}

 10%|▉         | 35660/371472 [2:50:32<25:29:32,  3.66it/s]
 10%|▉         | 35661/371472 [2:50:32<24:50:58,  3.75it/s]
 10%|▉         | 35662/371472 [2:50:33<24:35:43,  3.79it/s]
 10%|▉         | 35663/371472 [2:50:33<25:40:06,  3.63it/s]
 10%|▉         | 35664/371472 [2:50:33<25:06:08,  3.72it/s]
 10%|▉         | 35665/371472 [2:50:34<24:33:05,  3.80it/s]
 10%|▉         | 35666/371472 [2:50:34<24:39:13,  3.78it/s]
 10%|▉         | 35667/371472 [2:50:34<24:35:53,  3.79it/s]
 10%|▉         | 35668/371472 [2:50:34<27:09:16,  3.44it/s]
 10%|▉         | 35669/371472 [2:50:35<26:05:34,  3.57it/s]
 10%|▉         | 35670/371472 [2:50:35<27:03:02,  3.45it/s]
 10%|▉         | 35671/371472 [2:50:35<27:11:56,  3.43it/s]
 10%|▉         | 35672/371472 [2:50:36<26:49:57,  3.48it/s]
 10%|▉         | 35673/371472 [2:50:36<26:01:57,  3.58it/s]
 10%|▉         | 35674/371472 [2:50:36<28:04:42,  3.32it/s]
 10%|▉         | 35675/371472 [2:50:36<27:36:07,  3.38it/s]
 10%|▉         | 35676/371472 [2:50:37<26:44:33,  3.49it/s]
 10%|▉         | 35677/371472 [2:50:37<26:15:38,  3.55it/s]
 10%|▉         | 35678/371472 [2:50:37<26:19:21,  3.54it/s]
 10%|▉         | 35679/371472 [2:50:38<25:54:48,  3.60it/s]
 10%|▉         | 35680/371472 [2:50:38<24:55:16,  3.74it/s]
                                                           
{'loss': 4.279, 'learning_rate': 9.139929755004417e-07, 'epoch': 1.54}

 10%|▉         | 35680/371472 [2:50:38<24:55:16,  3.74it/s]
 10%|▉         | 35681/371472 [2:50:38<24:46:46,  3.76it/s]
 10%|▉         | 35682/371472 [2:50:38<25:08:52,  3.71it/s]
 10%|▉         | 35683/371472 [2:50:39<24:40:03,  3.78it/s]
 10%|▉         | 35684/371472 [2:50:39<24:27:34,  3.81it/s]
 10%|▉         | 35685/371472 [2:50:39<25:06:16,  3.72it/s]
 10%|▉         | 35686/371472 [2:50:39<24:37:31,  3.79it/s]
 10%|▉         | 35687/371472 [2:50:40<26:00:41,  3.59it/s]
 10%|▉         | 35688/371472 [2:50:40<26:21:11,  3.54it/s]
 10%|▉         | 35689/371472 [2:50:40<25:57:42,  3.59it/s]
 10%|▉         | 35690/371472 [2:50:41<27:38:36,  3.37it/s]
 10%|▉         | 35691/371472 [2:50:41<27:04:54,  3.44it/s]
 10%|▉         | 35692/371472 [2:50:41<26:27:42,  3.52it/s]
 10%|▉         | 35693/371472 [2:50:41<26:41:21,  3.49it/s]
 10%|▉         | 35694/371472 [2:50:42<26:35:41,  3.51it/s]
 10%|▉         | 35695/371472 [2:50:42<26:26:30,  3.53it/s]
 10%|▉         | 35696/371472 [2:50:42<26:53:48,  3.47it/s]
 10%|▉         | 35697/371472 [2:50:43<29:28:17,  3.16it/s]
 10%|▉         | 35698/371472 [2:50:43<28:32:21,  3.27it/s]
 10%|▉         | 35699/371472 [2:50:43<29:31:46,  3.16it/s]
 10%|▉         | 35700/371472 [2:50:44<28:21:35,  3.29it/s]
                                                           
{'loss': 4.3294, 'learning_rate': 9.139444935249628e-07, 'epoch': 1.54}

 10%|▉         | 35700/371472 [2:50:44<28:21:35,  3.29it/s]
 10%|▉         | 35701/371472 [2:50:44<27:39:10,  3.37it/s]
 10%|▉         | 35702/371472 [2:50:44<26:39:32,  3.50it/s]
 10%|▉         | 35703/371472 [2:50:44<25:49:03,  3.61it/s]
 10%|▉         | 35704/371472 [2:50:45<25:31:27,  3.65it/s]
 10%|▉         | 35705/371472 [2:50:45<25:29:57,  3.66it/s]
 10%|▉         | 35706/371472 [2:50:45<25:48:05,  3.61it/s]
 10%|▉         | 35707/371472 [2:50:45<25:40:40,  3.63it/s]
 10%|▉         | 35708/371472 [2:50:46<25:13:34,  3.70it/s]
 10%|▉         | 35709/371472 [2:50:46<31:13:04,  2.99it/s]
 10%|▉         | 35710/371472 [2:50:47<32:20:36,  2.88it/s]
 10%|▉         | 35711/371472 [2:50:47<29:53:17,  3.12it/s]
 10%|▉         | 35712/371472 [2:50:47<29:31:28,  3.16it/s]
 10%|▉         | 35713/371472 [2:50:47<28:07:50,  3.32it/s]
 10%|▉         | 35714/371472 [2:50:48<27:53:40,  3.34it/s]
 10%|▉         | 35715/371472 [2:50:48<27:53:29,  3.34it/s]
 10%|▉         | 35716/371472 [2:50:48<28:58:43,  3.22it/s]
 10%|▉         | 35717/371472 [2:50:49<30:15:37,  3.08it/s]
 10%|▉         | 35718/371472 [2:50:49<30:19:13,  3.08it/s]
 10%|▉         | 35719/371472 [2:50:49<30:01:54,  3.11it/s]
 10%|▉         | 35720/371472 [2:50:50<29:00:04,  3.22it/s]
                                                           
{'loss': 4.5648, 'learning_rate': 9.138960115494839e-07, 'epoch': 1.54}

 10%|▉         | 35720/371472 [2:50:50<29:00:04,  3.22it/s]
 10%|▉         | 35721/371472 [2:50:50<28:47:05,  3.24it/s]
 10%|▉         | 35722/371472 [2:50:50<27:53:01,  3.34it/s]
 10%|▉         | 35723/371472 [2:50:50<27:04:11,  3.45it/s]
 10%|▉         | 35724/371472 [2:50:51<26:33:01,  3.51it/s]
 10%|▉         | 35725/371472 [2:50:51<27:16:42,  3.42it/s]
 10%|▉         | 35726/371472 [2:50:51<26:30:18,  3.52it/s]
 10%|▉         | 35727/371472 [2:50:52<25:40:30,  3.63it/s]
 10%|▉         | 35728/371472 [2:50:52<25:33:20,  3.65it/s]
 10%|▉         | 35729/371472 [2:50:52<26:35:44,  3.51it/s]
 10%|▉         | 35730/371472 [2:50:52<26:30:22,  3.52it/s]
 10%|▉         | 35731/371472 [2:50:53<26:09:32,  3.57it/s]
 10%|▉         | 35732/371472 [2:50:53<26:35:21,  3.51it/s]
 10%|▉         | 35733/371472 [2:50:53<26:38:48,  3.50it/s]
 10%|▉         | 35734/371472 [2:50:54<27:01:32,  3.45it/s]
 10%|▉         | 35735/371472 [2:50:54<26:34:25,  3.51it/s]
 10%|▉         | 35736/371472 [2:50:54<26:37:10,  3.50it/s]
 10%|▉         | 35737/371472 [2:50:54<26:38:31,  3.50it/s]
 10%|▉         | 35738/371472 [2:50:55<26:09:46,  3.56it/s]
 10%|▉         | 35739/371472 [2:50:55<26:56:51,  3.46it/s]
 10%|▉         | 35740/371472 [2:50:55<26:33:45,  3.51it/s]
                                                           
{'loss': 4.6493, 'learning_rate': 9.13847529574005e-07, 'epoch': 1.54}

 10%|▉         | 35740/371472 [2:50:55<26:33:45,  3.51it/s]
 10%|▉         | 35741/371472 [2:50:56<27:58:58,  3.33it/s]
 10%|▉         | 35742/371472 [2:50:56<27:56:42,  3.34it/s]
 10%|▉         | 35743/371472 [2:50:56<27:27:39,  3.40it/s]
 10%|▉         | 35744/371472 [2:50:56<26:57:48,  3.46it/s]
 10%|▉         | 35745/371472 [2:50:57<26:10:29,  3.56it/s]
 10%|▉         | 35746/371472 [2:50:57<25:54:42,  3.60it/s]
 10%|▉         | 35747/371472 [2:50:57<26:11:46,  3.56it/s]
 10%|▉         | 35748/371472 [2:50:58<27:08:12,  3.44it/s]
 10%|▉         | 35749/371472 [2:50:58<27:17:13,  3.42it/s]
 10%|▉         | 35750/371472 [2:50:58<27:56:54,  3.34it/s]
 10%|▉         | 35751/371472 [2:50:58<27:15:55,  3.42it/s]
 10%|▉         | 35752/371472 [2:50:59<27:33:24,  3.38it/s]
 10%|▉         | 35753/371472 [2:50:59<26:57:54,  3.46it/s]
 10%|▉         | 35754/371472 [2:50:59<26:26:06,  3.53it/s]
 10%|▉         | 35755/371472 [2:51:00<26:21:29,  3.54it/s]
 10%|▉         | 35756/371472 [2:51:00<28:07:28,  3.32it/s]
 10%|▉         | 35757/371472 [2:51:00<27:29:32,  3.39it/s]
 10%|▉         | 35758/371472 [2:51:01<26:43:15,  3.49it/s]
 10%|▉         | 35759/371472 [2:51:01<27:55:59,  3.34it/s]
 10%|▉         | 35760/371472 [2:51:01<26:25:22,  3.53it/s]
                                                           
{'loss': 4.4849, 'learning_rate': 9.137990475985261e-07, 'epoch': 1.54}

 10%|▉         | 35760/371472 [2:51:01<26:25:22,  3.53it/s]
 10%|▉         | 35761/371472 [2:51:01<26:34:54,  3.51it/s]
 10%|▉         | 35762/371472 [2:51:02<26:25:23,  3.53it/s]
 10%|▉         | 35763/371472 [2:51:02<26:33:16,  3.51it/s]
 10%|▉         | 35764/371472 [2:51:02<26:37:54,  3.50it/s]
 10%|▉         | 35765/371472 [2:51:03<26:28:34,  3.52it/s]
 10%|▉         | 35766/371472 [2:51:03<26:57:15,  3.46it/s]
 10%|▉         | 35767/371472 [2:51:03<26:45:24,  3.49it/s]
 10%|▉         | 35768/371472 [2:51:03<26:10:44,  3.56it/s]
 10%|▉         | 35769/371472 [2:51:04<27:14:09,  3.42it/s]
 10%|▉         | 35770/371472 [2:51:04<27:10:12,  3.43it/s]
 10%|▉         | 35771/371472 [2:51:04<25:54:53,  3.60it/s]
 10%|▉         | 35772/371472 [2:51:05<26:32:29,  3.51it/s]
 10%|▉         | 35773/371472 [2:51:05<26:09:40,  3.56it/s]
 10%|▉         | 35774/371472 [2:51:05<25:15:23,  3.69it/s]
 10%|▉         | 35775/371472 [2:51:05<25:01:58,  3.73it/s]
 10%|▉         | 35776/371472 [2:51:06<24:46:07,  3.76it/s]
 10%|▉         | 35777/371472 [2:51:06<25:53:31,  3.60it/s]
 10%|▉         | 35778/371472 [2:51:06<26:48:08,  3.48it/s]
 10%|▉         | 35779/371472 [2:51:07<28:45:15,  3.24it/s]
 10%|▉         | 35780/371472 [2:51:07<27:12:24,  3.43it/s]
                                                           
{'loss': 4.5569, 'learning_rate': 9.137505656230472e-07, 'epoch': 1.54}

 10%|▉         | 35780/371472 [2:51:07<27:12:24,  3.43it/s]
 10%|▉         | 35781/371472 [2:51:07<26:41:52,  3.49it/s]
 10%|▉         | 35782/371472 [2:51:07<26:09:35,  3.56it/s]
 10%|▉         | 35783/371472 [2:51:08<26:34:43,  3.51it/s]
 10%|▉         | 35784/371472 [2:51:08<25:48:45,  3.61it/s]
 10%|▉         | 35785/371472 [2:51:08<27:33:50,  3.38it/s]
 10%|▉         | 35786/371472 [2:51:08<26:15:01,  3.55it/s]
 10%|▉         | 35787/371472 [2:51:09<28:06:00,  3.32it/s]
 10%|▉         | 35788/371472 [2:51:09<26:20:59,  3.54it/s]
 10%|▉         | 35789/371472 [2:51:09<25:53:09,  3.60it/s]
 10%|▉         | 35790/371472 [2:51:10<26:18:50,  3.54it/s]
 10%|▉         | 35791/371472 [2:51:10<26:23:54,  3.53it/s]
 10%|▉         | 35792/371472 [2:51:10<27:43:15,  3.36it/s]
 10%|▉         | 35793/371472 [2:51:10<26:15:17,  3.55it/s]
 10%|▉         | 35794/371472 [2:51:11<27:44:53,  3.36it/s]
 10%|▉         | 35795/371472 [2:51:11<26:54:28,  3.47it/s]
 10%|▉         | 35796/371472 [2:51:11<27:49:32,  3.35it/s]
 10%|▉         | 35797/371472 [2:51:12<26:46:22,  3.48it/s]
 10%|▉         | 35798/371472 [2:51:12<27:58:33,  3.33it/s]
 10%|▉         | 35799/371472 [2:51:12<28:39:46,  3.25it/s]
 10%|▉         | 35800/371472 [2:51:13<27:00:09,  3.45it/s]
                                                           
{'loss': 4.5644, 'learning_rate': 9.137020836475683e-07, 'epoch': 1.54}

 10%|▉         | 35800/371472 [2:51:13<27:00:09,  3.45it/s]
 10%|▉         | 35801/371472 [2:51:13<26:25:03,  3.53it/s]
 10%|▉         | 35802/371472 [2:51:13<25:25:11,  3.67it/s]
 10%|▉         | 35803/371472 [2:51:13<25:28:37,  3.66it/s]
 10%|▉         | 35804/371472 [2:51:14<26:02:47,  3.58it/s]
 10%|▉         | 35805/371472 [2:51:14<25:52:02,  3.60it/s]
 10%|▉         | 35806/371472 [2:51:14<27:08:30,  3.44it/s]
 10%|▉         | 35807/371472 [2:51:15<27:34:30,  3.38it/s]
 10%|▉         | 35808/371472 [2:51:15<29:09:51,  3.20it/s]
 10%|▉         | 35809/371472 [2:51:15<27:02:21,  3.45it/s]
 10%|▉         | 35810/371472 [2:51:15<25:42:26,  3.63it/s]
 10%|▉         | 35811/371472 [2:51:16<24:30:47,  3.80it/s]
 10%|▉         | 35812/371472 [2:51:16<24:25:49,  3.82it/s]
 10%|▉         | 35813/371472 [2:51:16<26:47:41,  3.48it/s]
 10%|▉         | 35814/371472 [2:51:17<26:52:34,  3.47it/s]
 10%|▉         | 35815/371472 [2:51:17<26:31:21,  3.52it/s]
 10%|▉         | 35816/371472 [2:51:17<27:11:22,  3.43it/s]
 10%|▉         | 35817/371472 [2:51:17<26:36:46,  3.50it/s]
 10%|▉         | 35818/371472 [2:51:18<25:30:19,  3.66it/s]
 10%|▉         | 35819/371472 [2:51:18<25:15:02,  3.69it/s]
 10%|▉         | 35820/371472 [2:51:18<26:29:06,  3.52it/s]
                                                           
{'loss': 4.4694, 'learning_rate': 9.136536016720894e-07, 'epoch': 1.54}

 10%|▉         | 35820/371472 [2:51:18<26:29:06,  3.52it/s]
 10%|▉         | 35821/371472 [2:51:18<26:47:41,  3.48it/s]
 10%|▉         | 35822/371472 [2:51:19<25:52:53,  3.60it/s]
 10%|▉         | 35823/371472 [2:51:19<26:40:37,  3.49it/s]
 10%|▉         | 35824/371472 [2:51:19<26:10:35,  3.56it/s]
 10%|▉         | 35825/371472 [2:51:20<25:26:03,  3.67it/s]
 10%|▉         | 35826/371472 [2:51:20<25:34:21,  3.65it/s]
 10%|▉         | 35827/371472 [2:51:20<25:06:46,  3.71it/s]
 10%|▉         | 35828/371472 [2:51:20<25:39:40,  3.63it/s]
 10%|▉         | 35829/371472 [2:51:21<26:33:23,  3.51it/s]
 10%|▉         | 35830/371472 [2:51:21<26:36:34,  3.50it/s]
 10%|▉         | 35831/371472 [2:51:21<26:57:18,  3.46it/s]
 10%|▉         | 35832/371472 [2:51:22<26:33:08,  3.51it/s]
 10%|▉         | 35833/371472 [2:51:22<27:33:12,  3.38it/s]
 10%|▉         | 35834/371472 [2:51:22<26:24:18,  3.53it/s]
 10%|▉         | 35835/371472 [2:51:22<26:17:31,  3.55it/s]
 10%|▉         | 35836/371472 [2:51:23<28:14:32,  3.30it/s]
 10%|▉         | 35837/371472 [2:51:23<28:14:24,  3.30it/s]
 10%|▉         | 35838/371472 [2:51:23<28:13:53,  3.30it/s]
 10%|▉         | 35839/371472 [2:51:24<27:06:41,  3.44it/s]
 10%|▉         | 35840/371472 [2:51:24<25:57:19,  3.59it/s]
                                                           
{'loss': 4.5983, 'learning_rate': 9.136051196966106e-07, 'epoch': 1.54}

 10%|▉         | 35840/371472 [2:51:24<25:57:19,  3.59it/s]
 10%|▉         | 35841/371472 [2:51:24<25:34:06,  3.65it/s]
 10%|▉         | 35842/371472 [2:51:24<26:01:46,  3.58it/s]
 10%|▉         | 35843/371472 [2:51:25<26:05:52,  3.57it/s]
 10%|▉         | 35844/371472 [2:51:25<26:44:50,  3.49it/s]
 10%|▉         | 35845/371472 [2:51:25<26:39:54,  3.50it/s]
 10%|▉         | 35846/371472 [2:51:26<29:10:51,  3.19it/s]
 10%|▉         | 35847/371472 [2:51:26<28:52:31,  3.23it/s]
 10%|▉         | 35848/371472 [2:51:26<27:04:59,  3.44it/s]
 10%|▉         | 35849/371472 [2:51:26<26:04:34,  3.58it/s]
 10%|▉         | 35850/371472 [2:51:27<25:36:58,  3.64it/s]
 10%|▉         | 35851/371472 [2:51:27<25:24:03,  3.67it/s]
 10%|▉         | 35852/371472 [2:51:27<25:04:25,  3.72it/s]
 10%|▉         | 35853/371472 [2:51:28<25:32:07,  3.65it/s]
 10%|▉         | 35854/371472 [2:51:28<26:00:39,  3.58it/s]
 10%|▉         | 35855/371472 [2:51:28<25:11:49,  3.70it/s]
 10%|▉         | 35856/371472 [2:51:28<25:29:17,  3.66it/s]
 10%|▉         | 35857/371472 [2:51:29<26:04:38,  3.58it/s]
 10%|▉         | 35858/371472 [2:51:29<25:14:45,  3.69it/s]
 10%|▉         | 35859/371472 [2:51:29<25:33:17,  3.65it/s]
 10%|▉         | 35860/371472 [2:51:29<24:38:46,  3.78it/s]
                                                           
{'loss': 4.4882, 'learning_rate': 9.135566377211316e-07, 'epoch': 1.54}

 10%|▉         | 35860/371472 [2:51:29<24:38:46,  3.78it/s]
 10%|▉         | 35861/371472 [2:51:30<24:10:44,  3.86it/s]
 10%|▉         | 35862/371472 [2:51:30<24:18:36,  3.83it/s]
 10%|▉         | 35863/371472 [2:51:30<24:56:20,  3.74it/s]
 10%|▉         | 35864/371472 [2:51:31<26:48:25,  3.48it/s]
 10%|▉         | 35865/371472 [2:51:31<25:59:14,  3.59it/s]
 10%|▉         | 35866/371472 [2:51:31<25:31:53,  3.65it/s]
 10%|▉         | 35867/371472 [2:51:31<25:12:05,  3.70it/s]
 10%|▉         | 35868/371472 [2:51:32<26:34:55,  3.51it/s]
 10%|▉         | 35869/371472 [2:51:32<26:25:24,  3.53it/s]
 10%|▉         | 35870/371472 [2:51:32<26:01:34,  3.58it/s]
 10%|▉         | 35871/371472 [2:51:33<27:05:35,  3.44it/s]
 10%|▉         | 35872/371472 [2:51:33<27:24:24,  3.40it/s]
 10%|▉         | 35873/371472 [2:51:33<28:35:42,  3.26it/s]
 10%|▉         | 35874/371472 [2:51:34<29:08:05,  3.20it/s]
 10%|▉         | 35875/371472 [2:51:34<28:03:01,  3.32it/s]
 10%|▉         | 35876/371472 [2:51:34<26:49:00,  3.48it/s]
 10%|▉         | 35877/371472 [2:51:34<26:16:41,  3.55it/s]
 10%|▉         | 35878/371472 [2:51:35<26:34:59,  3.51it/s]
 10%|▉         | 35879/371472 [2:51:35<26:38:58,  3.50it/s]
 10%|▉         | 35880/371472 [2:51:35<26:00:13,  3.58it/s]
                                                           
{'loss': 4.5535, 'learning_rate': 9.135081557456528e-07, 'epoch': 1.55}

 10%|▉         | 35880/371472 [2:51:35<26:00:13,  3.58it/s]
 10%|▉         | 35881/371472 [2:51:35<25:11:02,  3.70it/s]
 10%|▉         | 35882/371472 [2:51:36<24:45:53,  3.76it/s]
 10%|▉         | 35883/371472 [2:51:36<25:09:06,  3.71it/s]
 10%|▉         | 35884/371472 [2:51:36<25:26:12,  3.66it/s]
 10%|▉         | 35885/371472 [2:51:37<26:45:48,  3.48it/s]
 10%|▉         | 35886/371472 [2:51:37<25:51:18,  3.61it/s]
 10%|▉         | 35887/371472 [2:51:37<25:56:39,  3.59it/s]
 10%|▉         | 35888/371472 [2:51:37<27:17:55,  3.41it/s]
 10%|▉         | 35889/371472 [2:51:38<28:04:20,  3.32it/s]
 10%|▉         | 35890/371472 [2:51:38<26:40:40,  3.49it/s]
 10%|▉         | 35891/371472 [2:51:38<27:24:51,  3.40it/s]
 10%|▉         | 35892/371472 [2:51:39<27:28:11,  3.39it/s]
 10%|▉         | 35893/371472 [2:51:39<26:53:04,  3.47it/s]
 10%|▉         | 35894/371472 [2:51:39<28:58:11,  3.22it/s]
 10%|▉         | 35895/371472 [2:51:39<28:08:18,  3.31it/s]
 10%|▉         | 35896/371472 [2:51:40<26:33:42,  3.51it/s]
 10%|▉         | 35897/371472 [2:51:40<25:53:30,  3.60it/s]
 10%|▉         | 35898/371472 [2:51:40<26:01:42,  3.58it/s]
 10%|▉         | 35899/371472 [2:51:41<26:03:58,  3.58it/s]
 10%|▉         | 35900/371472 [2:51:41<25:33:15,  3.65it/s]
                                                           
{'loss': 4.4972, 'learning_rate': 9.134596737701738e-07, 'epoch': 1.55}

 10%|▉         | 35900/371472 [2:51:41<25:33:15,  3.65it/s]
 10%|▉         | 35901/371472 [2:51:41<24:40:59,  3.78it/s]
 10%|▉         | 35902/371472 [2:51:41<23:51:33,  3.91it/s]
 10%|▉         | 35903/371472 [2:51:42<23:32:46,  3.96it/s]
 10%|▉         | 35904/371472 [2:51:42<24:27:09,  3.81it/s]
 10%|▉         | 35905/371472 [2:51:42<24:10:09,  3.86it/s]
 10%|▉         | 35906/371472 [2:51:42<26:28:00,  3.52it/s]
 10%|▉         | 35907/371472 [2:51:43<27:59:58,  3.33it/s]
 10%|▉         | 35908/371472 [2:51:43<27:04:22,  3.44it/s]
 10%|▉         | 35909/371472 [2:51:43<27:25:10,  3.40it/s]
 10%|▉         | 35910/371472 [2:51:44<27:28:35,  3.39it/s]
 10%|▉         | 35911/371472 [2:51:44<26:38:08,  3.50it/s]
 10%|▉         | 35912/371472 [2:51:44<26:12:18,  3.56it/s]
 10%|▉         | 35913/371472 [2:51:44<25:43:55,  3.62it/s]
 10%|▉         | 35914/371472 [2:51:45<27:15:25,  3.42it/s]
 10%|▉         | 35915/371472 [2:51:45<27:03:53,  3.44it/s]
 10%|▉         | 35916/371472 [2:51:45<26:01:11,  3.58it/s]
 10%|▉         | 35917/371472 [2:51:46<25:28:49,  3.66it/s]
 10%|▉         | 35918/371472 [2:51:46<25:41:43,  3.63it/s]
 10%|▉         | 35919/371472 [2:51:46<25:21:25,  3.68it/s]
 10%|▉         | 35920/371472 [2:51:46<25:58:41,  3.59it/s]
                                                           
{'loss': 4.6593, 'learning_rate': 9.134111917946949e-07, 'epoch': 1.55}

 10%|▉         | 35920/371472 [2:51:46<25:58:41,  3.59it/s]
 10%|▉         | 35921/371472 [2:51:47<26:18:37,  3.54it/s]
 10%|▉         | 35922/371472 [2:51:47<27:18:58,  3.41it/s]
 10%|▉         | 35923/371472 [2:51:47<26:33:36,  3.51it/s]
 10%|▉         | 35924/371472 [2:51:48<25:33:39,  3.65it/s]
 10%|▉         | 35925/371472 [2:51:48<27:04:48,  3.44it/s]
 10%|▉         | 35926/371472 [2:51:48<27:14:43,  3.42it/s]
 10%|▉         | 35927/371472 [2:51:48<26:46:53,  3.48it/s]
 10%|▉         | 35928/371472 [2:51:49<27:32:32,  3.38it/s]
 10%|▉         | 35929/371472 [2:51:49<26:14:00,  3.55it/s]
 10%|▉         | 35930/371472 [2:51:49<25:21:07,  3.68it/s]
 10%|▉         | 35931/371472 [2:51:50<25:57:55,  3.59it/s]
 10%|▉         | 35932/371472 [2:51:50<26:10:45,  3.56it/s]
 10%|▉         | 35933/371472 [2:51:50<27:40:21,  3.37it/s]
 10%|▉         | 35934/371472 [2:51:51<30:19:54,  3.07it/s]
 10%|▉         | 35935/371472 [2:51:51<29:57:46,  3.11it/s]
 10%|▉         | 35936/371472 [2:51:51<29:48:47,  3.13it/s]
 10%|▉         | 35937/371472 [2:51:51<28:05:30,  3.32it/s]
 10%|▉         | 35938/371472 [2:51:52<26:41:41,  3.49it/s]
 10%|▉         | 35939/371472 [2:51:52<26:32:07,  3.51it/s]
 10%|▉         | 35940/371472 [2:51:52<25:30:03,  3.65it/s]
                                                           
{'loss': 4.1969, 'learning_rate': 9.13362709819216e-07, 'epoch': 1.55}

 10%|▉         | 35940/371472 [2:51:52<25:30:03,  3.65it/s]
 10%|▉         | 35941/371472 [2:51:52<24:54:54,  3.74it/s]
 10%|▉         | 35942/371472 [2:51:53<25:47:20,  3.61it/s]
 10%|▉         | 35943/371472 [2:51:53<25:44:46,  3.62it/s]
 10%|▉         | 35944/371472 [2:51:53<25:57:03,  3.59it/s]
 10%|▉         | 35945/371472 [2:51:54<27:27:08,  3.40it/s]
 10%|▉         | 35946/371472 [2:51:54<26:28:41,  3.52it/s]
 10%|▉         | 35947/371472 [2:51:54<26:12:46,  3.56it/s]
 10%|▉         | 35948/371472 [2:51:54<26:44:27,  3.49it/s]
 10%|▉         | 35949/371472 [2:51:55<25:57:58,  3.59it/s]
 10%|▉         | 35950/371472 [2:51:55<27:38:01,  3.37it/s]
 10%|▉         | 35951/371472 [2:51:55<27:14:49,  3.42it/s]
 10%|▉         | 35952/371472 [2:51:56<26:30:01,  3.52it/s]
 10%|▉         | 35953/371472 [2:51:56<26:50:56,  3.47it/s]
 10%|▉         | 35954/371472 [2:51:56<26:39:13,  3.50it/s]
 10%|▉         | 35955/371472 [2:51:56<25:47:58,  3.61it/s]
 10%|▉         | 35956/371472 [2:51:57<26:48:21,  3.48it/s]
 10%|▉         | 35957/371472 [2:51:57<26:04:48,  3.57it/s]
 10%|▉         | 35958/371472 [2:51:57<25:17:37,  3.68it/s]
 10%|▉         | 35959/371472 [2:51:58<24:28:00,  3.81it/s]
 10%|▉         | 35960/371472 [2:51:58<25:14:30,  3.69it/s]
                                                           
{'loss': 4.2865, 'learning_rate': 9.133142278437372e-07, 'epoch': 1.55}

 10%|▉         | 35960/371472 [2:51:58<25:14:30,  3.69it/s]
 10%|▉         | 35961/371472 [2:51:58<25:59:17,  3.59it/s]
 10%|▉         | 35962/371472 [2:51:58<26:13:43,  3.55it/s]
 10%|▉         | 35963/371472 [2:51:59<25:11:50,  3.70it/s]
 10%|▉         | 35964/371472 [2:51:59<24:38:57,  3.78it/s]
 10%|▉         | 35965/371472 [2:51:59<25:13:07,  3.70it/s]
 10%|▉         | 35966/371472 [2:51:59<26:01:26,  3.58it/s]
 10%|▉         | 35967/371472 [2:52:00<25:52:35,  3.60it/s]
 10%|▉         | 35968/371472 [2:52:00<27:47:51,  3.35it/s]
 10%|▉         | 35969/371472 [2:52:00<28:38:25,  3.25it/s]
 10%|▉         | 35970/371472 [2:52:01<27:45:47,  3.36it/s]
 10%|▉         | 35971/371472 [2:52:01<27:05:51,  3.44it/s]
 10%|▉         | 35972/371472 [2:52:01<26:38:48,  3.50it/s]
 10%|▉         | 35973/371472 [2:52:02<27:53:26,  3.34it/s]
 10%|▉         | 35974/371472 [2:52:02<27:56:30,  3.34it/s]
 10%|▉         | 35975/371472 [2:52:02<27:58:03,  3.33it/s]
 10%|▉         | 35976/371472 [2:52:02<27:52:08,  3.34it/s]
 10%|▉         | 35977/371472 [2:52:03<26:34:09,  3.51it/s]
 10%|▉         | 35978/371472 [2:52:03<26:24:11,  3.53it/s]
 10%|▉         | 35979/371472 [2:52:03<26:21:06,  3.54it/s]
 10%|▉         | 35980/371472 [2:52:04<26:04:09,  3.57it/s]
                                                           
{'loss': 4.2481, 'learning_rate': 9.132657458682583e-07, 'epoch': 1.55}

 10%|▉         | 35980/371472 [2:52:04<26:04:09,  3.57it/s]
 10%|▉         | 35981/371472 [2:52:04<25:41:56,  3.63it/s]
 10%|▉         | 35982/371472 [2:52:04<24:59:55,  3.73it/s]
 10%|▉         | 35983/371472 [2:52:04<25:46:49,  3.61it/s]
 10%|▉         | 35984/371472 [2:52:05<28:19:40,  3.29it/s]
 10%|▉         | 35985/371472 [2:52:05<28:07:09,  3.31it/s]
 10%|▉         | 35986/371472 [2:52:05<27:11:24,  3.43it/s]
 10%|▉         | 35987/371472 [2:52:06<27:12:23,  3.43it/s]
 10%|▉         | 35988/371472 [2:52:06<26:13:09,  3.55it/s]
 10%|▉         | 35989/371472 [2:52:06<25:15:17,  3.69it/s]
 10%|▉         | 35990/371472 [2:52:06<25:26:50,  3.66it/s]
 10%|▉         | 35991/371472 [2:52:07<25:26:38,  3.66it/s]
 10%|▉         | 35992/371472 [2:52:07<24:46:35,  3.76it/s]
 10%|▉         | 35993/371472 [2:52:07<26:25:38,  3.53it/s]
 10%|▉         | 35994/371472 [2:52:08<25:58:29,  3.59it/s]
 10%|▉         | 35995/371472 [2:52:08<28:14:59,  3.30it/s]
 10%|▉         | 35996/371472 [2:52:08<27:50:39,  3.35it/s]
 10%|▉         | 35997/371472 [2:52:09<29:06:39,  3.20it/s]
 10%|▉         | 35998/371472 [2:52:09<27:54:58,  3.34it/s]
 10%|▉         | 35999/371472 [2:52:09<28:29:28,  3.27it/s]
 10%|▉         | 36000/371472 [2:52:09<29:15:34,  3.18it/s]
                                                           
{'loss': 4.6457, 'learning_rate': 9.132172638927794e-07, 'epoch': 1.55}

 10%|▉         | 36000/371472 [2:52:09<29:15:34,  3.18it/s]
 10%|▉         | 36001/371472 [2:52:10<29:13:12,  3.19it/s]
 10%|▉         | 36002/371472 [2:52:10<27:24:50,  3.40it/s]
 10%|▉         | 36003/371472 [2:52:10<27:02:21,  3.45it/s]
 10%|▉         | 36004/371472 [2:52:11<27:11:19,  3.43it/s]
 10%|▉         | 36005/371472 [2:52:11<26:56:53,  3.46it/s]
 10%|▉         | 36006/371472 [2:52:11<26:24:32,  3.53it/s]
 10%|▉         | 36007/371472 [2:52:11<25:12:15,  3.70it/s]
 10%|▉         | 36008/371472 [2:52:12<25:46:46,  3.61it/s]
 10%|▉         | 36009/371472 [2:52:12<26:52:48,  3.47it/s]
 10%|▉         | 36010/371472 [2:52:12<25:54:51,  3.60it/s]
 10%|▉         | 36011/371472 [2:52:13<26:52:29,  3.47it/s]
 10%|▉         | 36012/371472 [2:52:13<26:02:52,  3.58it/s]
 10%|▉         | 36013/371472 [2:52:13<25:18:11,  3.68it/s]
 10%|▉         | 36014/371472 [2:52:13<25:30:06,  3.65it/s]
 10%|▉         | 36015/371472 [2:52:14<27:25:08,  3.40it/s]
 10%|▉         | 36016/371472 [2:52:14<26:40:24,  3.49it/s]
 10%|▉         | 36017/371472 [2:52:14<25:58:46,  3.59it/s]
 10%|▉         | 36018/371472 [2:52:14<25:51:31,  3.60it/s]
 10%|▉         | 36019/371472 [2:52:15<25:09:04,  3.70it/s]
 10%|▉         | 36020/371472 [2:52:15<25:11:58,  3.70it/s]
                                                           
{'loss': 4.4537, 'learning_rate': 9.131687819173004e-07, 'epoch': 1.55}

 10%|▉         | 36020/371472 [2:52:15<25:11:58,  3.70it/s]
 10%|▉         | 36021/371472 [2:52:15<25:40:34,  3.63it/s]
 10%|▉         | 36022/371472 [2:52:16<25:58:16,  3.59it/s]
 10%|▉         | 36023/371472 [2:52:16<25:26:19,  3.66it/s]
 10%|▉         | 36024/371472 [2:52:16<26:41:12,  3.49it/s]
 10%|▉         | 36025/371472 [2:52:16<28:13:16,  3.30it/s]
 10%|▉         | 36026/371472 [2:52:17<28:54:53,  3.22it/s]
 10%|▉         | 36027/371472 [2:52:17<27:38:22,  3.37it/s]
 10%|▉         | 36028/371472 [2:52:17<27:39:00,  3.37it/s]
 10%|▉         | 36029/371472 [2:52:18<26:17:32,  3.54it/s]
 10%|▉         | 36030/371472 [2:52:18<28:40:34,  3.25it/s]
 10%|▉         | 36031/371472 [2:52:18<27:11:54,  3.43it/s]
 10%|▉         | 36032/371472 [2:52:19<28:02:45,  3.32it/s]
 10%|▉         | 36033/371472 [2:52:19<26:19:53,  3.54it/s]
 10%|▉         | 36034/371472 [2:52:19<26:22:24,  3.53it/s]
 10%|▉         | 36035/371472 [2:52:19<25:19:16,  3.68it/s]
 10%|▉         | 36036/371472 [2:52:20<26:20:12,  3.54it/s]
 10%|▉         | 36037/371472 [2:52:20<25:54:43,  3.60it/s]
 10%|▉         | 36038/371472 [2:52:20<25:47:48,  3.61it/s]
 10%|▉         | 36039/371472 [2:52:20<25:54:52,  3.60it/s]
 10%|▉         | 36040/371472 [2:52:21<28:00:33,  3.33it/s]
                                                           
{'loss': 4.2257, 'learning_rate': 9.131202999418216e-07, 'epoch': 1.55}

 10%|▉         | 36040/371472 [2:52:21<28:00:33,  3.33it/s]
 10%|▉         | 36041/371472 [2:52:21<27:54:15,  3.34it/s]
 10%|▉         | 36042/371472 [2:52:21<28:29:47,  3.27it/s]
 10%|▉         | 36043/371472 [2:52:22<27:56:56,  3.33it/s]
 10%|▉         | 36044/371472 [2:52:22<30:54:32,  3.01it/s]
 10%|▉         | 36045/371472 [2:52:22<29:59:26,  3.11it/s]
 10%|▉         | 36046/371472 [2:52:23<30:08:57,  3.09it/s]
 10%|▉         | 36047/371472 [2:52:23<28:03:31,  3.32it/s]
 10%|▉         | 36048/371472 [2:52:23<28:17:07,  3.29it/s]
 10%|▉         | 36049/371472 [2:52:24<26:42:29,  3.49it/s]
 10%|▉         | 36050/371472 [2:52:24<26:41:07,  3.49it/s]
 10%|▉         | 36051/371472 [2:52:24<25:43:32,  3.62it/s]
 10%|▉         | 36052/371472 [2:52:24<26:58:17,  3.45it/s]
 10%|▉         | 36053/371472 [2:52:25<26:05:23,  3.57it/s]
 10%|▉         | 36054/371472 [2:52:25<27:21:14,  3.41it/s]
 10%|▉         | 36055/371472 [2:52:25<26:18:44,  3.54it/s]
 10%|▉         | 36056/371472 [2:52:26<27:54:17,  3.34it/s]
 10%|▉         | 36057/371472 [2:52:26<26:57:49,  3.46it/s]
 10%|▉         | 36058/371472 [2:52:26<26:37:57,  3.50it/s]
 10%|▉         | 36059/371472 [2:52:26<26:38:51,  3.50it/s]
 10%|▉         | 36060/371472 [2:52:27<26:41:56,  3.49it/s]
                                                           
{'loss': 4.3691, 'learning_rate': 9.130718179663427e-07, 'epoch': 1.55}

 10%|▉         | 36060/371472 [2:52:27<26:41:56,  3.49it/s]
 10%|▉         | 36061/371472 [2:52:27<26:59:44,  3.45it/s]
 10%|▉         | 36062/371472 [2:52:27<26:53:07,  3.47it/s]
 10%|▉         | 36063/371472 [2:52:28<26:15:57,  3.55it/s]
 10%|▉         | 36064/371472 [2:52:28<27:12:00,  3.43it/s]
 10%|▉         | 36065/371472 [2:52:28<26:47:03,  3.48it/s]
 10%|▉         | 36066/371472 [2:52:28<27:04:10,  3.44it/s]
 10%|▉         | 36067/371472 [2:52:29<26:49:44,  3.47it/s]
 10%|▉         | 36068/371472 [2:52:29<28:31:59,  3.27it/s]
 10%|▉         | 36069/371472 [2:52:29<28:18:43,  3.29it/s]
 10%|▉         | 36070/371472 [2:52:30<27:52:03,  3.34it/s]
 10%|▉         | 36071/371472 [2:52:30<27:24:14,  3.40it/s]
 10%|▉         | 36072/371472 [2:52:30<27:13:07,  3.42it/s]
 10%|▉         | 36073/371472 [2:52:31<27:09:42,  3.43it/s]
 10%|▉         | 36074/371472 [2:52:31<26:59:06,  3.45it/s]
 10%|▉         | 36075/371472 [2:52:31<26:00:05,  3.58it/s]
 10%|▉         | 36076/371472 [2:52:31<25:17:24,  3.68it/s]
 10%|▉         | 36077/371472 [2:52:32<24:42:12,  3.77it/s]
 10%|▉         | 36078/371472 [2:52:32<24:27:23,  3.81it/s]
 10%|▉         | 36079/371472 [2:52:32<26:14:32,  3.55it/s]
 10%|▉         | 36080/371472 [2:52:32<25:56:00,  3.59it/s]
                                                           
{'loss': 4.3142, 'learning_rate': 9.130233359908638e-07, 'epoch': 1.55}

 10%|▉         | 36080/371472 [2:52:32<25:56:00,  3.59it/s]
 10%|▉         | 36081/371472 [2:52:33<26:51:26,  3.47it/s]
 10%|▉         | 36082/371472 [2:52:33<26:54:17,  3.46it/s]
 10%|▉         | 36083/371472 [2:52:33<26:29:13,  3.52it/s]
 10%|▉         | 36084/371472 [2:52:34<25:30:52,  3.65it/s]
 10%|▉         | 36085/371472 [2:52:34<26:21:40,  3.53it/s]
 10%|▉         | 36086/371472 [2:52:34<26:00:21,  3.58it/s]
 10%|▉         | 36087/371472 [2:52:34<25:17:34,  3.68it/s]
 10%|▉         | 36088/371472 [2:52:35<25:13:33,  3.69it/s]
 10%|▉         | 36089/371472 [2:52:35<26:02:05,  3.58it/s]
 10%|▉         | 36090/371472 [2:52:35<25:29:24,  3.65it/s]
 10%|▉         | 36091/371472 [2:52:35<25:16:01,  3.69it/s]
 10%|▉         | 36092/371472 [2:52:36<24:13:38,  3.85it/s]
 10%|▉         | 36093/371472 [2:52:36<24:09:22,  3.86it/s]
 10%|▉         | 36094/371472 [2:52:36<24:34:57,  3.79it/s]
 10%|▉         | 36095/371472 [2:52:37<24:54:52,  3.74it/s]
 10%|▉         | 36096/371472 [2:52:37<25:35:30,  3.64it/s]
 10%|▉         | 36097/371472 [2:52:37<25:57:02,  3.59it/s]
 10%|▉         | 36098/371472 [2:52:37<25:20:49,  3.68it/s]
 10%|▉         | 36099/371472 [2:52:38<25:45:42,  3.62it/s]
 10%|▉         | 36100/371472 [2:52:38<27:01:11,  3.45it/s]
                                                           
{'loss': 4.3368, 'learning_rate': 9.129748540153849e-07, 'epoch': 1.55}

 10%|▉         | 36100/371472 [2:52:38<27:01:11,  3.45it/s]
 10%|▉         | 36101/371472 [2:52:38<27:20:47,  3.41it/s]
 10%|▉         | 36102/371472 [2:52:39<26:49:26,  3.47it/s]
 10%|▉         | 36103/371472 [2:52:39<34:53:33,  2.67it/s]
 10%|▉         | 36104/371472 [2:52:39<33:29:07,  2.78it/s]
 10%|▉         | 36105/371472 [2:52:40<31:31:09,  2.96it/s]
 10%|▉         | 36106/371472 [2:52:40<28:53:24,  3.22it/s]
 10%|▉         | 36107/371472 [2:52:40<27:53:37,  3.34it/s]
 10%|▉         | 36108/371472 [2:52:41<26:43:00,  3.49it/s]
 10%|▉         | 36109/371472 [2:52:41<28:00:57,  3.33it/s]
 10%|▉         | 36110/371472 [2:52:41<26:28:51,  3.52it/s]
 10%|▉         | 36111/371472 [2:52:41<27:06:15,  3.44it/s]
 10%|▉         | 36112/371472 [2:52:42<26:28:43,  3.52it/s]
 10%|▉         | 36113/371472 [2:52:42<27:50:08,  3.35it/s]
 10%|▉         | 36114/371472 [2:52:42<28:17:23,  3.29it/s]
 10%|▉         | 36115/371472 [2:52:43<28:14:09,  3.30it/s]
 10%|▉         | 36116/371472 [2:52:43<27:11:46,  3.43it/s]
 10%|▉         | 36117/371472 [2:52:43<26:59:37,  3.45it/s]
 10%|▉         | 36118/371472 [2:52:43<25:53:14,  3.60it/s]
 10%|▉         | 36119/371472 [2:52:44<25:54:28,  3.60it/s]
 10%|▉         | 36120/371472 [2:52:44<25:10:22,  3.70it/s]
                                                           
{'loss': 4.638, 'learning_rate': 9.129263720399061e-07, 'epoch': 1.56}

 10%|▉         | 36120/371472 [2:52:44<25:10:22,  3.70it/s]
 10%|▉         | 36121/371472 [2:52:44<25:22:44,  3.67it/s]
 10%|▉         | 36122/371472 [2:52:45<26:13:46,  3.55it/s]
 10%|▉         | 36123/371472 [2:52:45<25:40:27,  3.63it/s]
 10%|▉         | 36124/371472 [2:52:45<25:22:45,  3.67it/s]
 10%|▉         | 36125/371472 [2:52:45<26:09:50,  3.56it/s]
 10%|▉         | 36126/371472 [2:52:46<25:24:21,  3.67it/s]
 10%|▉         | 36127/371472 [2:52:46<26:41:12,  3.49it/s]
 10%|▉         | 36128/371472 [2:52:46<28:14:40,  3.30it/s]
 10%|▉         | 36129/371472 [2:52:47<26:38:54,  3.50it/s]
 10%|▉         | 36130/371472 [2:52:47<25:53:49,  3.60it/s]
 10%|▉         | 36131/371472 [2:52:47<26:41:46,  3.49it/s]
 10%|▉         | 36132/371472 [2:52:47<25:34:32,  3.64it/s]
 10%|▉         | 36133/371472 [2:52:48<26:00:43,  3.58it/s]
 10%|▉         | 36134/371472 [2:52:48<25:18:39,  3.68it/s]
 10%|▉         | 36135/371472 [2:52:48<25:50:32,  3.60it/s]
 10%|▉         | 36136/371472 [2:52:48<26:00:35,  3.58it/s]
 10%|▉         | 36137/371472 [2:52:49<26:08:09,  3.56it/s]
 10%|▉         | 36138/371472 [2:52:49<25:26:26,  3.66it/s]
 10%|▉         | 36139/371472 [2:52:49<24:55:11,  3.74it/s]
 10%|▉         | 36140/371472 [2:52:50<25:40:32,  3.63it/s]
                                                           
{'loss': 4.3089, 'learning_rate': 9.128778900644272e-07, 'epoch': 1.56}

 10%|▉         | 36140/371472 [2:52:50<25:40:32,  3.63it/s]
 10%|▉         | 36141/371472 [2:52:50<25:25:35,  3.66it/s]
 10%|▉         | 36142/371472 [2:52:50<25:56:10,  3.59it/s]
 10%|▉         | 36143/371472 [2:52:50<26:21:14,  3.53it/s]
 10%|▉         | 36144/371472 [2:52:51<26:11:50,  3.56it/s]
 10%|▉         | 36145/371472 [2:52:51<25:48:57,  3.61it/s]
 10%|▉         | 36146/371472 [2:52:51<25:55:33,  3.59it/s]
 10%|▉         | 36147/371472 [2:52:51<25:32:10,  3.65it/s]
 10%|▉         | 36148/371472 [2:52:52<25:44:36,  3.62it/s]
 10%|▉         | 36149/371472 [2:52:52<25:30:07,  3.65it/s]
 10%|▉         | 36150/371472 [2:52:52<25:31:45,  3.65it/s]
 10%|▉         | 36151/371472 [2:52:53<26:29:45,  3.52it/s]
 10%|▉         | 36152/371472 [2:52:53<29:00:45,  3.21it/s]
 10%|▉         | 36153/371472 [2:52:53<29:11:17,  3.19it/s]
 10%|▉         | 36154/371472 [2:52:54<28:24:16,  3.28it/s]
 10%|▉         | 36155/371472 [2:52:54<29:10:40,  3.19it/s]
 10%|▉         | 36156/371472 [2:52:54<27:54:45,  3.34it/s]
 10%|▉         | 36157/371472 [2:52:54<26:25:40,  3.52it/s]
 10%|▉         | 36158/371472 [2:52:55<27:01:23,  3.45it/s]
 10%|▉         | 36159/371472 [2:52:55<26:33:37,  3.51it/s]
 10%|▉         | 36160/371472 [2:52:55<28:51:54,  3.23it/s]
                                                           
{'loss': 4.6912, 'learning_rate': 9.128294080889482e-07, 'epoch': 1.56}

 10%|▉         | 36160/371472 [2:52:55<28:51:54,  3.23it/s]
 10%|▉         | 36161/371472 [2:52:56<28:14:23,  3.30it/s]
 10%|▉         | 36162/371472 [2:52:56<29:07:33,  3.20it/s]
 10%|▉         | 36163/371472 [2:52:56<27:13:51,  3.42it/s]
 10%|▉         | 36164/371472 [2:52:57<26:22:38,  3.53it/s]
 10%|▉         | 36165/371472 [2:52:57<26:18:39,  3.54it/s]
 10%|▉         | 36166/371472 [2:52:57<25:42:27,  3.62it/s]
 10%|▉         | 36167/371472 [2:52:57<29:16:04,  3.18it/s]
 10%|▉         | 36168/371472 [2:52:58<28:16:49,  3.29it/s]
 10%|▉         | 36169/371472 [2:52:58<27:21:20,  3.40it/s]
 10%|▉         | 36170/371472 [2:52:58<27:20:56,  3.41it/s]
 10%|▉         | 36171/371472 [2:52:59<26:01:49,  3.58it/s]
 10%|▉         | 36172/371472 [2:52:59<26:05:48,  3.57it/s]
 10%|▉         | 36173/371472 [2:52:59<25:42:19,  3.62it/s]
 10%|▉         | 36174/371472 [2:52:59<27:28:26,  3.39it/s]
 10%|▉         | 36175/371472 [2:53:00<27:00:36,  3.45it/s]
 10%|▉         | 36176/371472 [2:53:00<27:40:38,  3.37it/s]
 10%|▉         | 36177/371472 [2:53:00<28:11:08,  3.30it/s]
 10%|▉         | 36178/371472 [2:53:01<28:58:47,  3.21it/s]
 10%|▉         | 36179/371472 [2:53:01<28:07:55,  3.31it/s]
 10%|▉         | 36180/371472 [2:53:01<26:45:24,  3.48it/s]
                                                           
{'loss': 4.4828, 'learning_rate': 9.127809261134694e-07, 'epoch': 1.56}

 10%|▉         | 36180/371472 [2:53:01<26:45:24,  3.48it/s]
 10%|▉         | 36181/371472 [2:53:02<28:51:06,  3.23it/s]
 10%|▉         | 36182/371472 [2:53:02<29:19:57,  3.18it/s]
 10%|▉         | 36183/371472 [2:53:02<27:48:24,  3.35it/s]
 10%|▉         | 36184/371472 [2:53:02<27:26:17,  3.39it/s]
 10%|▉         | 36185/371472 [2:53:03<27:06:43,  3.44it/s]
 10%|▉         | 36186/371472 [2:53:03<26:02:00,  3.58it/s]
 10%|▉         | 36187/371472 [2:53:03<26:18:51,  3.54it/s]
 10%|▉         | 36188/371472 [2:53:04<26:35:17,  3.50it/s]
 10%|▉         | 36189/371472 [2:53:04<26:29:19,  3.52it/s]
 10%|▉         | 36190/371472 [2:53:04<28:57:56,  3.22it/s]
 10%|▉         | 36191/371472 [2:53:05<29:36:35,  3.15it/s]
 10%|▉         | 36192/371472 [2:53:05<30:05:40,  3.09it/s]
 10%|▉         | 36193/371472 [2:53:05<30:39:02,  3.04it/s]
 10%|▉         | 36194/371472 [2:53:05<28:18:34,  3.29it/s]
 10%|▉         | 36195/371472 [2:53:06<27:22:22,  3.40it/s]
 10%|▉         | 36196/371472 [2:53:06<26:19:02,  3.54it/s]
 10%|▉         | 36197/371472 [2:53:06<26:17:28,  3.54it/s]
 10%|▉         | 36198/371472 [2:53:07<26:11:33,  3.56it/s]
 10%|▉         | 36199/371472 [2:53:07<27:03:07,  3.44it/s]
 10%|▉         | 36200/371472 [2:53:07<27:02:01,  3.45it/s]
                                                           
{'loss': 4.1292, 'learning_rate': 9.127324441379905e-07, 'epoch': 1.56}

 10%|▉         | 36200/371472 [2:53:07<27:02:01,  3.45it/s]
 10%|▉         | 36201/371472 [2:53:07<26:57:09,  3.46it/s]
 10%|▉         | 36202/371472 [2:53:08<27:15:04,  3.42it/s]
 10%|▉         | 36203/371472 [2:53:08<26:07:50,  3.56it/s]
 10%|▉         | 36204/371472 [2:53:08<27:18:24,  3.41it/s]
 10%|▉         | 36205/371472 [2:53:09<27:28:38,  3.39it/s]
 10%|▉         | 36206/371472 [2:53:09<26:33:13,  3.51it/s]
 10%|▉         | 36207/371472 [2:53:09<25:54:00,  3.60it/s]
 10%|▉         | 36208/371472 [2:53:09<25:12:49,  3.69it/s]
 10%|▉         | 36209/371472 [2:53:10<24:13:27,  3.84it/s]
 10%|▉         | 36210/371472 [2:53:10<24:29:11,  3.80it/s]
 10%|▉         | 36211/371472 [2:53:10<25:17:52,  3.68it/s]
 10%|▉         | 36212/371472 [2:53:10<24:54:37,  3.74it/s]
 10%|▉         | 36213/371472 [2:53:11<25:39:11,  3.63it/s]
 10%|▉         | 36214/371472 [2:53:11<25:34:18,  3.64it/s]
 10%|▉         | 36215/371472 [2:53:11<25:58:54,  3.58it/s]
 10%|▉         | 36216/371472 [2:53:12<25:30:03,  3.65it/s]
 10%|▉         | 36217/371472 [2:53:12<28:00:48,  3.32it/s]
 10%|▉         | 36218/371472 [2:53:12<27:20:22,  3.41it/s]
 10%|▉         | 36219/371472 [2:53:12<26:23:34,  3.53it/s]
 10%|▉         | 36220/371472 [2:53:13<26:12:12,  3.55it/s]
                                                           
{'loss': 4.5201, 'learning_rate': 9.126839621625115e-07, 'epoch': 1.56}

 10%|▉         | 36220/371472 [2:53:13<26:12:12,  3.55it/s]
 10%|▉         | 36221/371472 [2:53:13<25:26:37,  3.66it/s]
 10%|▉         | 36222/371472 [2:53:13<24:48:46,  3.75it/s]
 10%|▉         | 36223/371472 [2:53:14<24:28:15,  3.81it/s]
 10%|▉         | 36224/371472 [2:53:14<25:47:31,  3.61it/s]
 10%|▉         | 36225/371472 [2:53:14<25:15:16,  3.69it/s]
 10%|▉         | 36226/371472 [2:53:14<25:14:16,  3.69it/s]
 10%|▉         | 36227/371472 [2:53:15<25:59:02,  3.58it/s]
 10%|▉         | 36228/371472 [2:53:15<25:44:05,  3.62it/s]
 10%|▉         | 36229/371472 [2:53:15<25:32:29,  3.65it/s]
 10%|▉         | 36230/371472 [2:53:15<25:54:54,  3.59it/s]
 10%|▉         | 36231/371472 [2:53:16<25:36:00,  3.64it/s]
 10%|▉         | 36232/371472 [2:53:16<25:46:47,  3.61it/s]
 10%|▉         | 36233/371472 [2:53:16<25:39:56,  3.63it/s]
 10%|▉         | 36234/371472 [2:53:17<25:05:10,  3.71it/s]
 10%|▉         | 36235/371472 [2:53:17<27:48:53,  3.35it/s]
 10%|▉         | 36236/371472 [2:53:17<30:39:05,  3.04it/s]
 10%|▉         | 36237/371472 [2:53:18<28:49:56,  3.23it/s]
 10%|▉         | 36238/371472 [2:53:18<27:35:52,  3.37it/s]
 10%|▉         | 36239/371472 [2:53:18<28:27:44,  3.27it/s]
 10%|▉         | 36240/371472 [2:53:18<27:55:48,  3.33it/s]
                                                           
{'loss': 4.2531, 'learning_rate': 9.126354801870327e-07, 'epoch': 1.56}

 10%|▉         | 36240/371472 [2:53:18<27:55:48,  3.33it/s]
 10%|▉         | 36241/371472 [2:53:19<29:57:31,  3.11it/s]
 10%|▉         | 36242/371472 [2:53:19<28:33:58,  3.26it/s]
 10%|▉         | 36243/371472 [2:53:19<27:59:45,  3.33it/s]
 10%|▉         | 36244/371472 [2:53:20<26:36:35,  3.50it/s]
 10%|▉         | 36245/371472 [2:53:20<25:58:06,  3.59it/s]
 10%|▉         | 36246/371472 [2:53:20<25:46:35,  3.61it/s]
 10%|▉         | 36247/371472 [2:53:20<25:26:22,  3.66it/s]
 10%|▉         | 36248/371472 [2:53:21<26:04:33,  3.57it/s]
 10%|▉         | 36249/371472 [2:53:21<25:27:24,  3.66it/s]
 10%|▉         | 36250/371472 [2:53:21<25:11:49,  3.70it/s]
 10%|▉         | 36251/371472 [2:53:22<26:03:29,  3.57it/s]
 10%|▉         | 36252/371472 [2:53:22<26:12:56,  3.55it/s]
 10%|▉         | 36253/371472 [2:53:22<28:10:01,  3.31it/s]
 10%|▉         | 36254/371472 [2:53:22<27:26:59,  3.39it/s]
 10%|▉         | 36255/371472 [2:53:23<30:18:26,  3.07it/s]
 10%|▉         | 36256/371472 [2:53:23<29:00:10,  3.21it/s]
 10%|▉         | 36257/371472 [2:53:23<28:30:15,  3.27it/s]
 10%|▉         | 36258/371472 [2:53:24<27:53:39,  3.34it/s]
 10%|▉         | 36259/371472 [2:53:24<28:39:46,  3.25it/s]
 10%|▉         | 36260/371472 [2:53:24<28:05:07,  3.32it/s]
                                                           
{'loss': 4.4037, 'learning_rate': 9.125869982115538e-07, 'epoch': 1.56}

 10%|▉         | 36260/371472 [2:53:24<28:05:07,  3.32it/s]
 10%|▉         | 36261/371472 [2:53:25<27:05:07,  3.44it/s]
 10%|▉         | 36262/371472 [2:53:25<28:59:00,  3.21it/s]
 10%|▉         | 36263/371472 [2:53:25<27:19:28,  3.41it/s]
 10%|▉         | 36264/371472 [2:53:26<29:11:57,  3.19it/s]
 10%|▉         | 36265/371472 [2:53:26<28:30:04,  3.27it/s]
 10%|▉         | 36266/371472 [2:53:26<27:41:56,  3.36it/s]
 10%|▉         | 36267/371472 [2:53:26<28:01:52,  3.32it/s]
 10%|▉         | 36268/371472 [2:53:27<29:13:05,  3.19it/s]
 10%|▉         | 36269/371472 [2:53:27<28:54:43,  3.22it/s]
 10%|▉         | 36270/371472 [2:53:27<28:46:55,  3.24it/s]
 10%|▉         | 36271/371472 [2:53:28<27:31:43,  3.38it/s]
 10%|▉         | 36272/371472 [2:53:28<27:41:36,  3.36it/s]
 10%|▉         | 36273/371472 [2:53:28<29:08:50,  3.19it/s]
 10%|▉         | 36274/371472 [2:53:29<27:22:02,  3.40it/s]
 10%|▉         | 36275/371472 [2:53:29<26:20:41,  3.53it/s]
 10%|▉         | 36276/371472 [2:53:29<27:04:46,  3.44it/s]
 10%|▉         | 36277/371472 [2:53:29<26:46:24,  3.48it/s]
 10%|▉         | 36278/371472 [2:53:30<28:32:56,  3.26it/s]
 10%|▉         | 36279/371472 [2:53:30<27:46:35,  3.35it/s]
 10%|▉         | 36280/371472 [2:53:30<26:15:22,  3.55it/s]
                                                           
{'loss': 4.5505, 'learning_rate': 9.125385162360748e-07, 'epoch': 1.56}

 10%|▉         | 36280/371472 [2:53:30<26:15:22,  3.55it/s]
 10%|▉         | 36281/371472 [2:53:31<27:15:19,  3.42it/s]
 10%|▉         | 36282/371472 [2:53:31<26:34:43,  3.50it/s]
 10%|▉         | 36283/371472 [2:53:31<25:54:03,  3.59it/s]
 10%|▉         | 36284/371472 [2:53:31<25:56:59,  3.59it/s]
 10%|▉         | 36285/371472 [2:53:32<28:59:23,  3.21it/s]
 10%|▉         | 36286/371472 [2:53:32<27:12:42,  3.42it/s]
 10%|▉         | 36287/371472 [2:53:32<28:06:02,  3.31it/s]
 10%|▉         | 36288/371472 [2:53:33<27:33:13,  3.38it/s]
 10%|▉         | 36289/371472 [2:53:33<26:21:44,  3.53it/s]
 10%|▉         | 36290/371472 [2:53:33<26:49:42,  3.47it/s]
 10%|▉         | 36291/371472 [2:53:33<25:51:33,  3.60it/s]
 10%|▉         | 36292/371472 [2:53:34<25:57:12,  3.59it/s]
 10%|▉         | 36293/371472 [2:53:34<26:16:44,  3.54it/s]
 10%|▉         | 36294/371472 [2:53:34<25:15:12,  3.69it/s]
 10%|▉         | 36295/371472 [2:53:35<25:02:59,  3.72it/s]
 10%|▉         | 36296/371472 [2:53:35<27:45:18,  3.35it/s]
 10%|▉         | 36297/371472 [2:53:35<26:35:29,  3.50it/s]
 10%|▉         | 36298/371472 [2:53:35<25:42:20,  3.62it/s]
 10%|▉         | 36299/371472 [2:53:36<27:41:18,  3.36it/s]
 10%|▉         | 36300/371472 [2:53:36<28:32:25,  3.26it/s]
                                                           
{'loss': 4.297, 'learning_rate': 9.124900342605959e-07, 'epoch': 1.56}

 10%|▉         | 36300/371472 [2:53:36<28:32:25,  3.26it/s]
 10%|▉         | 36301/371472 [2:53:36<30:32:01,  3.05it/s]
 10%|▉         | 36302/371472 [2:53:37<31:20:59,  2.97it/s]
 10%|▉         | 36303/371472 [2:53:37<30:05:03,  3.09it/s]
 10%|▉         | 36304/371472 [2:53:37<31:07:10,  2.99it/s]
 10%|▉         | 36305/371472 [2:53:38<30:59:59,  3.00it/s]
 10%|▉         | 36306/371472 [2:53:38<29:43:42,  3.13it/s]
 10%|▉         | 36307/371472 [2:53:38<30:00:46,  3.10it/s]
 10%|▉         | 36308/371472 [2:53:39<29:09:59,  3.19it/s]
 10%|▉         | 36309/371472 [2:53:39<27:31:11,  3.38it/s]
 10%|▉         | 36310/371472 [2:53:39<26:57:32,  3.45it/s]
 10%|▉         | 36311/371472 [2:53:40<26:27:54,  3.52it/s]
 10%|▉         | 36312/371472 [2:53:40<26:17:06,  3.54it/s]
 10%|▉         | 36313/371472 [2:53:40<26:49:26,  3.47it/s]
 10%|▉         | 36314/371472 [2:53:40<26:39:23,  3.49it/s]
 10%|▉         | 36315/371472 [2:53:41<26:40:00,  3.49it/s]
 10%|▉         | 36316/371472 [2:53:41<26:09:38,  3.56it/s]
 10%|▉         | 36317/371472 [2:53:41<25:49:36,  3.60it/s]
 10%|▉         | 36318/371472 [2:53:42<27:41:43,  3.36it/s]
 10%|▉         | 36319/371472 [2:53:42<26:48:05,  3.47it/s]
 10%|▉         | 36320/371472 [2:53:42<26:07:05,  3.56it/s]
                                                           
{'loss': 4.5845, 'learning_rate': 9.124415522851171e-07, 'epoch': 1.56}

 10%|▉         | 36320/371472 [2:53:42<26:07:05,  3.56it/s]
 10%|▉         | 36321/371472 [2:53:42<26:23:06,  3.53it/s]
 10%|▉         | 36322/371472 [2:53:43<28:07:22,  3.31it/s]
 10%|▉         | 36323/371472 [2:53:43<27:37:06,  3.37it/s]
 10%|▉         | 36324/371472 [2:53:43<29:12:14,  3.19it/s]
 10%|▉         | 36325/371472 [2:53:44<27:33:18,  3.38it/s]
 10%|▉         | 36326/371472 [2:53:44<27:43:39,  3.36it/s]
 10%|▉         | 36327/371472 [2:53:44<27:28:40,  3.39it/s]
 10%|▉         | 36328/371472 [2:53:44<27:02:46,  3.44it/s]
 10%|▉         | 36329/371472 [2:53:45<26:16:13,  3.54it/s]
 10%|▉         | 36330/371472 [2:53:45<27:12:56,  3.42it/s]
 10%|▉         | 36331/371472 [2:53:45<27:22:27,  3.40it/s]
 10%|▉         | 36332/371472 [2:53:46<29:16:25,  3.18it/s]
 10%|▉         | 36333/371472 [2:53:46<28:20:25,  3.28it/s]
 10%|▉         | 36334/371472 [2:53:46<29:39:30,  3.14it/s]
 10%|▉         | 36335/371472 [2:53:47<27:40:51,  3.36it/s]
 10%|▉         | 36336/371472 [2:53:47<27:15:26,  3.42it/s]
 10%|▉         | 36337/371472 [2:53:47<29:19:47,  3.17it/s]
 10%|▉         | 36338/371472 [2:53:48<28:50:26,  3.23it/s]
 10%|▉         | 36339/371472 [2:53:48<28:21:31,  3.28it/s]
 10%|▉         | 36340/371472 [2:53:48<28:03:28,  3.32it/s]
                                                           
{'loss': 4.5232, 'learning_rate': 9.123930703096382e-07, 'epoch': 1.57}

 10%|▉         | 36340/371472 [2:53:48<28:03:28,  3.32it/s]
 10%|▉         | 36341/371472 [2:53:48<27:32:17,  3.38it/s]
 10%|▉         | 36342/371472 [2:53:49<26:10:53,  3.56it/s]
 10%|▉         | 36343/371472 [2:53:49<26:38:49,  3.49it/s]
 10%|▉         | 36344/371472 [2:53:49<30:03:37,  3.10it/s]
 10%|▉         | 36345/371472 [2:53:50<29:23:17,  3.17it/s]
 10%|▉         | 36346/371472 [2:53:50<28:11:40,  3.30it/s]
 10%|▉         | 36347/371472 [2:53:50<28:35:59,  3.25it/s]
 10%|▉         | 36348/371472 [2:53:51<28:12:10,  3.30it/s]
 10%|▉         | 36349/371472 [2:53:51<26:44:17,  3.48it/s]
 10%|▉         | 36350/371472 [2:53:51<25:45:33,  3.61it/s]
 10%|▉         | 36351/371472 [2:53:51<25:58:41,  3.58it/s]
 10%|▉         | 36352/371472 [2:53:52<26:59:00,  3.45it/s]
 10%|▉         | 36353/371472 [2:53:52<26:18:23,  3.54it/s]
 10%|▉         | 36354/371472 [2:53:52<25:56:09,  3.59it/s]
 10%|▉         | 36355/371472 [2:53:53<27:35:44,  3.37it/s]
 10%|▉         | 36356/371472 [2:53:53<27:08:18,  3.43it/s]
 10%|▉         | 36357/371472 [2:53:53<25:50:31,  3.60it/s]
 10%|▉         | 36358/371472 [2:53:53<25:11:14,  3.70it/s]
 10%|▉         | 36359/371472 [2:53:54<24:34:43,  3.79it/s]
 10%|▉         | 36360/371472 [2:53:54<24:53:22,  3.74it/s]
                                                           
{'loss': 4.4532, 'learning_rate': 9.123445883341593e-07, 'epoch': 1.57}

 10%|▉         | 36360/371472 [2:53:54<24:53:22,  3.74it/s]
 10%|▉         | 36361/371472 [2:53:54<26:38:37,  3.49it/s]
 10%|▉         | 36362/371472 [2:53:55<28:58:16,  3.21it/s]
 10%|▉         | 36363/371472 [2:53:55<27:03:27,  3.44it/s]
 10%|▉         | 36364/371472 [2:53:55<25:44:55,  3.62it/s]
 10%|▉         | 36365/371472 [2:53:55<24:57:12,  3.73it/s]
 10%|▉         | 36366/371472 [2:53:56<24:42:20,  3.77it/s]
 10%|▉         | 36367/371472 [2:53:56<26:16:26,  3.54it/s]
 10%|▉         | 36368/371472 [2:53:56<29:05:43,  3.20it/s]
 10%|▉         | 36369/371472 [2:53:56<27:41:25,  3.36it/s]
 10%|▉         | 36370/371472 [2:53:57<25:57:32,  3.59it/s]
 10%|▉         | 36371/371472 [2:53:57<27:13:54,  3.42it/s]
 10%|▉         | 36372/371472 [2:53:57<26:28:47,  3.52it/s]
 10%|▉         | 36373/371472 [2:53:58<25:37:39,  3.63it/s]
 10%|▉         | 36374/371472 [2:53:58<25:32:07,  3.65it/s]
 10%|▉         | 36375/371472 [2:53:58<25:06:38,  3.71it/s]
 10%|▉         | 36376/371472 [2:53:58<27:30:38,  3.38it/s]
 10%|▉         | 36377/371472 [2:53:59<27:23:22,  3.40it/s]
 10%|▉         | 36378/371472 [2:53:59<27:52:55,  3.34it/s]
 10%|▉         | 36379/371472 [2:53:59<26:56:26,  3.46it/s]
 10%|▉         | 36380/371472 [2:54:00<27:18:41,  3.41it/s]
                                                           
{'loss': 4.6118, 'learning_rate': 9.122961063586804e-07, 'epoch': 1.57}

 10%|▉         | 36380/371472 [2:54:00<27:18:41,  3.41it/s]
 10%|▉         | 36381/371472 [2:54:00<28:24:01,  3.28it/s]
 10%|▉         | 36382/371472 [2:54:00<26:58:29,  3.45it/s]
 10%|▉         | 36383/371472 [2:54:01<29:06:21,  3.20it/s]
 10%|▉         | 36384/371472 [2:54:01<29:10:56,  3.19it/s]
 10%|▉         | 36385/371472 [2:54:01<28:38:08,  3.25it/s]
 10%|▉         | 36386/371472 [2:54:01<27:00:56,  3.45it/s]
 10%|▉         | 36387/371472 [2:54:02<26:09:14,  3.56it/s]
 10%|▉         | 36388/371472 [2:54:02<26:54:55,  3.46it/s]
 10%|▉         | 36389/371472 [2:54:02<27:48:08,  3.35it/s]
 10%|▉         | 36390/371472 [2:54:03<27:22:14,  3.40it/s]
 10%|▉         | 36391/371472 [2:54:03<27:09:42,  3.43it/s]
 10%|▉         | 36392/371472 [2:54:03<26:15:47,  3.54it/s]
 10%|▉         | 36393/371472 [2:54:03<25:28:58,  3.65it/s]
 10%|▉         | 36394/371472 [2:54:04<26:37:22,  3.50it/s]
 10%|▉         | 36395/371472 [2:54:04<26:03:37,  3.57it/s]
 10%|▉         | 36396/371472 [2:54:04<25:58:52,  3.58it/s]
 10%|▉         | 36397/371472 [2:54:05<25:48:11,  3.61it/s]
 10%|▉         | 36398/371472 [2:54:05<25:32:06,  3.65it/s]
 10%|▉         | 36399/371472 [2:54:05<29:25:13,  3.16it/s]
 10%|▉         | 36400/371472 [2:54:05<28:15:55,  3.29it/s]
                                                           
{'loss': 4.3377, 'learning_rate': 9.122476243832014e-07, 'epoch': 1.57}

 10%|▉         | 36400/371472 [2:54:05<28:15:55,  3.29it/s]
 10%|▉         | 36401/371472 [2:54:06<27:34:53,  3.37it/s]
 10%|▉         | 36402/371472 [2:54:06<28:05:12,  3.31it/s]
 10%|▉         | 36403/371472 [2:54:06<26:49:09,  3.47it/s]
 10%|▉         | 36404/371472 [2:54:07<25:58:41,  3.58it/s]
 10%|▉         | 36405/371472 [2:54:07<28:06:09,  3.31it/s]
 10%|▉         | 36406/371472 [2:54:07<28:33:56,  3.26it/s]
 10%|▉         | 36407/371472 [2:54:08<28:12:31,  3.30it/s]
 10%|▉         | 36408/371472 [2:54:08<26:38:14,  3.49it/s]
 10%|▉         | 36409/371472 [2:54:08<26:06:43,  3.56it/s]
 10%|▉         | 36410/371472 [2:54:08<25:49:20,  3.60it/s]
 10%|▉         | 36411/371472 [2:54:09<25:58:20,  3.58it/s]
 10%|▉         | 36412/371472 [2:54:09<26:45:48,  3.48it/s]
 10%|▉         | 36413/371472 [2:54:09<26:15:04,  3.55it/s]
 10%|▉         | 36414/371472 [2:54:09<26:17:40,  3.54it/s]
 10%|▉         | 36415/371472 [2:54:10<28:09:31,  3.31it/s]
 10%|▉         | 36416/371472 [2:54:10<27:10:31,  3.42it/s]
 10%|▉         | 36417/371472 [2:54:10<27:10:40,  3.42it/s]
 10%|▉         | 36418/371472 [2:54:11<27:10:05,  3.43it/s]
 10%|▉         | 36419/371472 [2:54:11<27:09:17,  3.43it/s]
 10%|▉         | 36420/371472 [2:54:11<27:52:46,  3.34it/s]
                                                           
{'loss': 4.4561, 'learning_rate': 9.121991424077226e-07, 'epoch': 1.57}

 10%|▉         | 36420/371472 [2:54:11<27:52:46,  3.34it/s]
 10%|▉         | 36421/371472 [2:54:12<27:22:54,  3.40it/s]
 10%|▉         | 36422/371472 [2:54:12<27:02:19,  3.44it/s]
 10%|▉         | 36423/371472 [2:54:12<28:10:58,  3.30it/s]
 10%|▉         | 36424/371472 [2:54:12<27:23:32,  3.40it/s]
 10%|▉         | 36425/371472 [2:54:13<26:46:07,  3.48it/s]
 10%|▉         | 36426/371472 [2:54:13<25:39:44,  3.63it/s]
 10%|▉         | 36427/371472 [2:54:13<25:53:03,  3.60it/s]
 10%|▉         | 36428/371472 [2:54:14<28:26:37,  3.27it/s]
 10%|▉         | 36429/371472 [2:54:14<27:29:25,  3.39it/s]
 10%|▉         | 36430/371472 [2:54:14<26:05:16,  3.57it/s]
 10%|▉         | 36431/371472 [2:54:14<26:28:03,  3.52it/s]
 10%|▉         | 36432/371472 [2:54:15<27:57:19,  3.33it/s]
 10%|▉         | 36433/371472 [2:54:15<26:33:01,  3.51it/s]
 10%|▉         | 36434/371472 [2:54:15<25:29:53,  3.65it/s]
 10%|▉         | 36435/371472 [2:54:16<24:30:17,  3.80it/s]
 10%|▉         | 36436/371472 [2:54:16<25:44:15,  3.62it/s]
 10%|▉         | 36437/371472 [2:54:16<26:13:32,  3.55it/s]
 10%|▉         | 36438/371472 [2:54:16<25:32:37,  3.64it/s]
 10%|▉         | 36439/371472 [2:54:17<26:29:15,  3.51it/s]
 10%|▉         | 36440/371472 [2:54:17<26:38:21,  3.49it/s]
                                                           
{'loss': 4.4312, 'learning_rate': 9.121506604322436e-07, 'epoch': 1.57}

 10%|▉         | 36440/371472 [2:54:17<26:38:21,  3.49it/s]
 10%|▉         | 36441/371472 [2:54:17<26:36:11,  3.50it/s]
 10%|▉         | 36442/371472 [2:54:18<25:39:35,  3.63it/s]
 10%|▉         | 36443/371472 [2:54:18<25:36:32,  3.63it/s]
 10%|▉         | 36444/371472 [2:54:18<27:41:54,  3.36it/s]
 10%|▉         | 36445/371472 [2:54:18<27:15:51,  3.41it/s]
 10%|▉         | 36446/371472 [2:54:19<28:04:39,  3.31it/s]
 10%|▉         | 36447/371472 [2:54:19<27:40:25,  3.36it/s]
 10%|▉         | 36448/371472 [2:54:19<26:45:22,  3.48it/s]
 10%|▉         | 36449/371472 [2:54:20<25:49:11,  3.60it/s]
 10%|▉         | 36450/371472 [2:54:20<25:56:48,  3.59it/s]
 10%|▉         | 36451/371472 [2:54:20<27:15:52,  3.41it/s]
 10%|▉         | 36452/371472 [2:54:20<26:48:38,  3.47it/s]
 10%|▉         | 36453/371472 [2:54:21<26:12:28,  3.55it/s]
 10%|▉         | 36454/371472 [2:54:21<25:48:45,  3.61it/s]
 10%|▉         | 36455/371472 [2:54:21<26:13:35,  3.55it/s]
 10%|▉         | 36456/371472 [2:54:22<25:27:26,  3.66it/s]
 10%|▉         | 36457/371472 [2:54:22<26:32:48,  3.51it/s]
 10%|▉         | 36458/371472 [2:54:22<27:22:08,  3.40it/s]
 10%|▉         | 36459/371472 [2:54:22<26:51:17,  3.47it/s]
 10%|▉         | 36460/371472 [2:54:23<27:04:50,  3.44it/s]
                                                           
{'loss': 4.5839, 'learning_rate': 9.121021784567648e-07, 'epoch': 1.57}

 10%|▉         | 36460/371472 [2:54:23<27:04:50,  3.44it/s]
 10%|▉         | 36461/371472 [2:54:23<27:04:13,  3.44it/s]
 10%|▉         | 36462/371472 [2:54:23<26:17:36,  3.54it/s]
 10%|▉         | 36463/371472 [2:54:24<26:28:38,  3.51it/s]
 10%|▉         | 36464/371472 [2:54:24<25:30:11,  3.65it/s]
 10%|▉         | 36465/371472 [2:54:24<26:03:58,  3.57it/s]
 10%|▉         | 36466/371472 [2:54:24<24:59:34,  3.72it/s]
 10%|▉         | 36467/371472 [2:54:25<24:35:51,  3.78it/s]
 10%|▉         | 36468/371472 [2:54:25<24:35:09,  3.78it/s]
 10%|▉         | 36469/371472 [2:54:25<24:25:53,  3.81it/s]
 10%|▉         | 36470/371472 [2:54:25<24:58:58,  3.72it/s]
 10%|▉         | 36471/371472 [2:54:26<25:03:26,  3.71it/s]
 10%|▉         | 36472/371472 [2:54:26<25:11:34,  3.69it/s]
 10%|▉         | 36473/371472 [2:54:26<27:38:39,  3.37it/s]
 10%|▉         | 36474/371472 [2:54:27<27:07:26,  3.43it/s]
 10%|▉         | 36475/371472 [2:54:27<26:12:14,  3.55it/s]
 10%|▉         | 36476/371472 [2:54:27<26:59:44,  3.45it/s]
 10%|▉         | 36477/371472 [2:54:27<27:02:52,  3.44it/s]
 10%|▉         | 36478/371472 [2:54:28<26:10:23,  3.56it/s]
 10%|▉         | 36479/371472 [2:54:28<25:50:33,  3.60it/s]
 10%|▉         | 36480/371472 [2:54:28<27:53:44,  3.34it/s]
                                                           
{'loss': 4.5667, 'learning_rate': 9.120536964812859e-07, 'epoch': 1.57}

 10%|▉         | 36480/371472 [2:54:28<27:53:44,  3.34it/s]
 10%|▉         | 36481/371472 [2:54:29<27:37:24,  3.37it/s]
 10%|▉         | 36482/371472 [2:54:29<26:38:51,  3.49it/s]
 10%|▉         | 36483/371472 [2:54:29<30:49:09,  3.02it/s]
 10%|▉         | 36484/371472 [2:54:30<30:33:57,  3.04it/s]
 10%|▉         | 36485/371472 [2:54:30<28:50:04,  3.23it/s]
 10%|▉         | 36486/371472 [2:54:30<29:24:07,  3.16it/s]
 10%|▉         | 36487/371472 [2:54:31<30:17:37,  3.07it/s]
 10%|▉         | 36488/371472 [2:54:31<28:50:43,  3.23it/s]
 10%|▉         | 36489/371472 [2:54:31<28:05:21,  3.31it/s]
 10%|▉         | 36490/371472 [2:54:31<27:53:36,  3.34it/s]
 10%|▉         | 36491/371472 [2:54:32<28:34:04,  3.26it/s]
 10%|▉         | 36492/371472 [2:54:32<27:58:27,  3.33it/s]
 10%|▉         | 36493/371472 [2:54:32<26:51:41,  3.46it/s]
 10%|▉         | 36494/371472 [2:54:33<26:41:12,  3.49it/s]
 10%|▉         | 36495/371472 [2:54:33<27:35:39,  3.37it/s]
 10%|▉         | 36496/371472 [2:54:33<26:10:58,  3.55it/s]
 10%|▉         | 36497/371472 [2:54:33<25:46:09,  3.61it/s]
 10%|▉         | 36498/371472 [2:54:34<25:10:17,  3.70it/s]
 10%|▉         | 36499/371472 [2:54:34<27:04:18,  3.44it/s]
 10%|▉         | 36500/371472 [2:54:34<28:05:30,  3.31it/s]
                                                           
{'loss': 4.4461, 'learning_rate': 9.120052145058071e-07, 'epoch': 1.57}

 10%|▉         | 36500/371472 [2:54:34<28:05:30,  3.31it/s]
 10%|▉         | 36501/371472 [2:54:35<27:18:54,  3.41it/s]
 10%|▉         | 36502/371472 [2:54:35<26:19:28,  3.53it/s]
 10%|▉         | 36503/371472 [2:54:35<26:27:01,  3.52it/s]
 10%|▉         | 36504/371472 [2:54:35<26:14:11,  3.55it/s]
 10%|▉         | 36505/371472 [2:54:36<25:28:21,  3.65it/s]
 10%|▉         | 36506/371472 [2:54:36<25:17:10,  3.68it/s]
 10%|▉         | 36507/371472 [2:54:36<24:49:49,  3.75it/s]
 10%|▉         | 36508/371472 [2:54:37<25:12:33,  3.69it/s]
 10%|▉         | 36509/371472 [2:54:37<25:07:55,  3.70it/s]
 10%|▉         | 36510/371472 [2:54:37<25:13:58,  3.69it/s]
 10%|▉         | 36511/371472 [2:54:37<25:02:20,  3.72it/s]
 10%|▉         | 36512/371472 [2:54:38<25:10:39,  3.70it/s]
 10%|▉         | 36513/371472 [2:54:38<25:20:23,  3.67it/s]
 10%|▉         | 36514/371472 [2:54:38<25:08:14,  3.70it/s]
 10%|▉         | 36515/371472 [2:54:38<25:39:20,  3.63it/s]
 10%|▉         | 36516/371472 [2:54:39<25:44:13,  3.62it/s]
 10%|▉         | 36517/371472 [2:54:39<25:23:54,  3.66it/s]
 10%|▉         | 36518/371472 [2:54:39<25:04:57,  3.71it/s]
 10%|▉         | 36519/371472 [2:54:40<27:16:46,  3.41it/s]
 10%|▉         | 36520/371472 [2:54:40<26:18:48,  3.54it/s]
                                                           
{'loss': 4.4775, 'learning_rate': 9.119567325303281e-07, 'epoch': 1.57}

 10%|▉         | 36520/371472 [2:54:40<26:18:48,  3.54it/s]
 10%|▉         | 36521/371472 [2:54:40<26:35:57,  3.50it/s]
 10%|▉         | 36522/371472 [2:54:40<26:45:59,  3.48it/s]
 10%|▉         | 36523/371472 [2:54:41<26:26:08,  3.52it/s]
 10%|▉         | 36524/371472 [2:54:41<25:48:36,  3.60it/s]
 10%|▉         | 36525/371472 [2:54:41<25:23:03,  3.67it/s]
 10%|▉         | 36526/371472 [2:54:41<25:21:04,  3.67it/s]
 10%|▉         | 36527/371472 [2:54:42<24:56:24,  3.73it/s]
 10%|▉         | 36528/371472 [2:54:42<24:54:30,  3.74it/s]
 10%|▉         | 36529/371472 [2:54:42<24:39:54,  3.77it/s]
 10%|▉         | 36530/371472 [2:54:43<25:19:25,  3.67it/s]
 10%|▉         | 36531/371472 [2:54:43<25:54:29,  3.59it/s]
 10%|▉         | 36532/371472 [2:54:43<26:20:00,  3.53it/s]
 10%|▉         | 36533/371472 [2:54:43<26:34:50,  3.50it/s]
 10%|▉         | 36534/371472 [2:54:44<26:10:16,  3.55it/s]
 10%|▉         | 36535/371472 [2:54:44<27:04:00,  3.44it/s]
 10%|▉         | 36536/371472 [2:54:44<26:55:05,  3.46it/s]
 10%|▉         | 36537/371472 [2:54:45<26:32:02,  3.51it/s]
 10%|▉         | 36538/371472 [2:54:45<26:46:57,  3.47it/s]
 10%|▉         | 36539/371472 [2:54:45<25:46:35,  3.61it/s]
 10%|▉         | 36540/371472 [2:54:45<25:14:01,  3.69it/s]
                                                           
{'loss': 4.4642, 'learning_rate': 9.119082505548492e-07, 'epoch': 1.57}

 10%|▉         | 36540/371472 [2:54:45<25:14:01,  3.69it/s]
 10%|▉         | 36541/371472 [2:54:46<25:29:09,  3.65it/s]
 10%|▉         | 36542/371472 [2:54:46<25:17:29,  3.68it/s]
 10%|▉         | 36543/371472 [2:54:46<24:51:30,  3.74it/s]
 10%|▉         | 36544/371472 [2:54:46<25:22:02,  3.67it/s]
 10%|▉         | 36545/371472 [2:54:47<24:55:05,  3.73it/s]
 10%|▉         | 36546/371472 [2:54:47<24:55:35,  3.73it/s]
 10%|▉         | 36547/371472 [2:54:47<24:58:15,  3.73it/s]
 10%|▉         | 36548/371472 [2:54:48<25:42:14,  3.62it/s]
 10%|▉         | 36549/371472 [2:54:48<26:25:22,  3.52it/s]
 10%|▉         | 36550/371472 [2:54:48<25:35:37,  3.64it/s]
 10%|▉         | 36551/371472 [2:54:48<26:34:28,  3.50it/s]
 10%|▉         | 36552/371472 [2:54:49<26:32:57,  3.50it/s]
 10%|▉         | 36553/371472 [2:54:49<25:32:09,  3.64it/s]
 10%|▉         | 36554/371472 [2:54:49<25:06:25,  3.71it/s]
 10%|▉         | 36555/371472 [2:54:49<24:50:55,  3.74it/s]
 10%|▉         | 36556/371472 [2:54:50<25:16:43,  3.68it/s]
 10%|▉         | 36557/371472 [2:54:50<25:48:58,  3.60it/s]
 10%|▉         | 36558/371472 [2:54:50<26:01:16,  3.58it/s]
 10%|▉         | 36559/371472 [2:54:51<25:08:50,  3.70it/s]
 10%|▉         | 36560/371472 [2:54:51<24:43:46,  3.76it/s]
                                                           
{'loss': 4.4668, 'learning_rate': 9.118597685793703e-07, 'epoch': 1.57}

 10%|▉         | 36560/371472 [2:54:51<24:43:46,  3.76it/s]
 10%|▉         | 36561/371472 [2:54:51<25:30:21,  3.65it/s]
 10%|▉         | 36562/371472 [2:54:51<25:23:29,  3.66it/s]
 10%|▉         | 36563/371472 [2:54:52<25:32:43,  3.64it/s]
 10%|▉         | 36564/371472 [2:54:52<26:56:21,  3.45it/s]
 10%|▉         | 36565/371472 [2:54:52<26:56:28,  3.45it/s]
 10%|▉         | 36566/371472 [2:54:53<27:37:18,  3.37it/s]
 10%|▉         | 36567/371472 [2:54:53<27:40:23,  3.36it/s]
 10%|▉         | 36568/371472 [2:54:53<29:02:08,  3.20it/s]
 10%|▉         | 36569/371472 [2:54:54<28:43:10,  3.24it/s]
 10%|▉         | 36570/371472 [2:54:54<27:50:55,  3.34it/s]
 10%|▉         | 36571/371472 [2:54:54<27:25:26,  3.39it/s]
 10%|▉         | 36572/371472 [2:54:54<26:05:58,  3.56it/s]
 10%|▉         | 36573/371472 [2:54:55<25:25:44,  3.66it/s]
 10%|▉         | 36574/371472 [2:54:55<25:31:00,  3.65it/s]
 10%|▉         | 36575/371472 [2:54:55<25:54:27,  3.59it/s]
 10%|▉         | 36576/371472 [2:54:56<27:10:05,  3.42it/s]
 10%|▉         | 36577/371472 [2:54:56<27:23:07,  3.40it/s]
 10%|▉         | 36578/371472 [2:54:56<26:18:08,  3.54it/s]
 10%|▉         | 36579/371472 [2:54:56<27:04:22,  3.44it/s]
 10%|▉         | 36580/371472 [2:54:57<25:57:13,  3.58it/s]
                                                           
{'loss': 4.4052, 'learning_rate': 9.118112866038915e-07, 'epoch': 1.58}

 10%|▉         | 36580/371472 [2:54:57<25:57:13,  3.58it/s]
 10%|▉         | 36581/371472 [2:54:57<25:53:10,  3.59it/s]
 10%|▉         | 36582/371472 [2:54:57<24:44:40,  3.76it/s]
 10%|▉         | 36583/371472 [2:54:57<26:29:15,  3.51it/s]
 10%|▉         | 36584/371472 [2:54:58<26:22:44,  3.53it/s]
 10%|▉         | 36585/371472 [2:54:58<28:36:10,  3.25it/s]
 10%|▉         | 36586/371472 [2:54:58<27:50:29,  3.34it/s]
 10%|▉         | 36587/371472 [2:54:59<26:34:25,  3.50it/s]
 10%|▉         | 36588/371472 [2:54:59<26:48:19,  3.47it/s]
 10%|▉         | 36589/371472 [2:54:59<26:45:12,  3.48it/s]
 10%|▉         | 36590/371472 [2:54:59<25:45:04,  3.61it/s]
 10%|▉         | 36591/371472 [2:55:00<24:49:39,  3.75it/s]
 10%|▉         | 36592/371472 [2:55:00<24:07:44,  3.86it/s]
 10%|▉         | 36593/371472 [2:55:00<25:01:33,  3.72it/s]
 10%|▉         | 36594/371472 [2:55:01<24:45:19,  3.76it/s]
 10%|▉         | 36595/371472 [2:55:01<24:36:07,  3.78it/s]
 10%|▉         | 36596/371472 [2:55:01<23:55:52,  3.89it/s]
 10%|▉         | 36597/371472 [2:55:01<24:20:01,  3.82it/s]
 10%|▉         | 36598/371472 [2:55:02<23:36:47,  3.94it/s]
 10%|▉         | 36599/371472 [2:55:02<24:09:31,  3.85it/s]
 10%|▉         | 36600/371472 [2:55:02<24:13:04,  3.84it/s]
                                                           
{'loss': 4.6068, 'learning_rate': 9.117628046284124e-07, 'epoch': 1.58}

 10%|▉         | 36600/371472 [2:55:02<24:13:04,  3.84it/s]
 10%|▉         | 36601/371472 [2:55:02<25:59:02,  3.58it/s]
 10%|▉         | 36602/371472 [2:55:03<25:48:46,  3.60it/s]
 10%|▉         | 36603/371472 [2:55:03<30:27:27,  3.05it/s]
 10%|▉         | 36604/371472 [2:55:03<31:38:05,  2.94it/s]
 10%|▉         | 36605/371472 [2:55:04<29:24:46,  3.16it/s]
 10%|▉         | 36606/371472 [2:55:04<28:17:37,  3.29it/s]
 10%|▉         | 36607/371472 [2:55:04<28:21:55,  3.28it/s]
 10%|▉         | 36608/371472 [2:55:05<29:08:50,  3.19it/s]
 10%|▉         | 36609/371472 [2:55:05<28:53:39,  3.22it/s]
 10%|▉         | 36610/371472 [2:55:05<27:54:41,  3.33it/s]
 10%|▉         | 36611/371472 [2:55:06<27:34:03,  3.37it/s]
 10%|▉         | 36612/371472 [2:55:06<27:24:34,  3.39it/s]
 10%|▉         | 36613/371472 [2:55:06<26:55:37,  3.45it/s]
 10%|▉         | 36614/371472 [2:55:06<26:06:15,  3.56it/s]
 10%|▉         | 36615/371472 [2:55:07<28:39:44,  3.25it/s]
 10%|▉         | 36616/371472 [2:55:07<27:42:00,  3.36it/s]
 10%|▉         | 36617/371472 [2:55:07<27:17:52,  3.41it/s]
 10%|▉         | 36618/371472 [2:55:08<26:58:37,  3.45it/s]
 10%|▉         | 36619/371472 [2:55:08<26:05:28,  3.56it/s]
 10%|▉         | 36620/371472 [2:55:08<25:04:14,  3.71it/s]
                                                           
{'loss': 4.2858, 'learning_rate': 9.117143226529337e-07, 'epoch': 1.58}

 10%|▉         | 36620/371472 [2:55:08<25:04:14,  3.71it/s]
 10%|▉         | 36621/371472 [2:55:08<25:39:58,  3.62it/s]
 10%|▉         | 36622/371472 [2:55:09<26:35:19,  3.50it/s]
 10%|▉         | 36623/371472 [2:55:09<25:25:01,  3.66it/s]
 10%|▉         | 36624/371472 [2:55:09<26:09:26,  3.56it/s]
 10%|▉         | 36625/371472 [2:55:10<27:53:55,  3.33it/s]
 10%|▉         | 36626/371472 [2:55:10<26:58:49,  3.45it/s]
 10%|▉         | 36627/371472 [2:55:10<26:12:12,  3.55it/s]
 10%|▉         | 36628/371472 [2:55:10<25:19:06,  3.67it/s]
 10%|▉         | 36629/371472 [2:55:11<25:46:21,  3.61it/s]
 10%|▉         | 36630/371472 [2:55:11<26:21:32,  3.53it/s]
 10%|▉         | 36631/371472 [2:55:11<27:14:42,  3.41it/s]
 10%|▉         | 36632/371472 [2:55:12<26:56:45,  3.45it/s]
 10%|▉         | 36633/371472 [2:55:12<26:02:30,  3.57it/s]
 10%|▉         | 36634/371472 [2:55:12<29:18:53,  3.17it/s]
 10%|▉         | 36635/371472 [2:55:12<27:12:45,  3.42it/s]
 10%|▉         | 36636/371472 [2:55:13<26:38:15,  3.49it/s]
 10%|▉         | 36637/371472 [2:55:13<27:06:43,  3.43it/s]
 10%|▉         | 36638/371472 [2:55:13<27:42:55,  3.36it/s]
 10%|▉         | 36639/371472 [2:55:14<27:52:34,  3.34it/s]
 10%|▉         | 36640/371472 [2:55:14<27:08:10,  3.43it/s]
                                                           
{'loss': 4.3676, 'learning_rate': 9.116658406774548e-07, 'epoch': 1.58}

 10%|▉         | 36640/371472 [2:55:14<27:08:10,  3.43it/s]
 10%|▉         | 36641/371472 [2:55:14<27:21:44,  3.40it/s]
 10%|▉         | 36642/371472 [2:55:14<27:28:40,  3.38it/s]
 10%|▉         | 36643/371472 [2:55:15<26:23:19,  3.52it/s]
 10%|▉         | 36644/371472 [2:55:15<25:38:25,  3.63it/s]
 10%|▉         | 36645/371472 [2:55:15<27:35:58,  3.37it/s]
 10%|▉         | 36646/371472 [2:55:16<27:53:32,  3.33it/s]
 10%|▉         | 36647/371472 [2:55:16<27:11:49,  3.42it/s]
 10%|▉         | 36648/371472 [2:55:16<26:25:02,  3.52it/s]
 10%|▉         | 36649/371472 [2:55:16<25:36:04,  3.63it/s]
 10%|▉         | 36650/371472 [2:55:17<26:05:11,  3.57it/s]
 10%|▉         | 36651/371472 [2:55:17<25:40:29,  3.62it/s]
 10%|▉         | 36652/371472 [2:55:17<26:13:50,  3.55it/s]
 10%|▉         | 36653/371472 [2:55:18<25:31:41,  3.64it/s]
 10%|▉         | 36654/371472 [2:55:18<26:18:25,  3.54it/s]
 10%|▉         | 36655/371472 [2:55:18<27:22:05,  3.40it/s]
 10%|▉         | 36656/371472 [2:55:18<28:17:56,  3.29it/s]
 10%|▉         | 36657/371472 [2:55:19<28:12:14,  3.30it/s]
 10%|▉         | 36658/371472 [2:55:19<27:51:48,  3.34it/s]
 10%|▉         | 36659/371472 [2:55:19<26:52:08,  3.46it/s]
 10%|▉         | 36660/371472 [2:55:20<26:40:17,  3.49it/s]
                                                           
{'loss': 4.3611, 'learning_rate': 9.116173587019759e-07, 'epoch': 1.58}

 10%|▉         | 36660/371472 [2:55:20<26:40:17,  3.49it/s]
 10%|▉         | 36661/371472 [2:55:20<25:28:15,  3.65it/s]
 10%|▉         | 36662/371472 [2:55:20<25:13:40,  3.69it/s]
 10%|▉         | 36663/371472 [2:55:21<29:13:41,  3.18it/s]
 10%|▉         | 36664/371472 [2:55:21<30:12:15,  3.08it/s]
 10%|▉         | 36665/371472 [2:55:21<28:08:45,  3.30it/s]
 10%|▉         | 36666/371472 [2:55:21<27:02:50,  3.44it/s]
 10%|▉         | 36667/371472 [2:55:22<25:55:51,  3.59it/s]
 10%|▉         | 36668/371472 [2:55:22<27:17:30,  3.41it/s]
 10%|▉         | 36669/371472 [2:55:22<27:08:09,  3.43it/s]
 10%|▉         | 36670/371472 [2:55:23<27:22:23,  3.40it/s]
 10%|▉         | 36671/371472 [2:55:23<28:03:18,  3.31it/s]
 10%|▉         | 36672/371472 [2:55:23<26:37:02,  3.49it/s]
 10%|▉         | 36673/371472 [2:55:23<27:27:17,  3.39it/s]
 10%|▉         | 36674/371472 [2:55:24<25:59:36,  3.58it/s]
 10%|▉         | 36675/371472 [2:55:24<25:37:25,  3.63it/s]
 10%|▉         | 36676/371472 [2:55:24<25:26:16,  3.66it/s]
 10%|▉         | 36677/371472 [2:55:25<25:44:34,  3.61it/s]
 10%|▉         | 36678/371472 [2:55:25<25:41:55,  3.62it/s]
 10%|▉         | 36679/371472 [2:55:25<26:09:48,  3.55it/s]
 10%|▉         | 36680/371472 [2:55:25<26:09:15,  3.56it/s]
                                                           
{'loss': 4.2911, 'learning_rate': 9.115688767264969e-07, 'epoch': 1.58}

 10%|▉         | 36680/371472 [2:55:25<26:09:15,  3.56it/s]
 10%|▉         | 36681/371472 [2:55:26<25:50:50,  3.60it/s]
 10%|▉         | 36682/371472 [2:55:26<26:30:39,  3.51it/s]
 10%|▉         | 36683/371472 [2:55:26<25:48:14,  3.60it/s]
 10%|▉         | 36684/371472 [2:55:26<25:26:37,  3.65it/s]
 10%|▉         | 36685/371472 [2:55:27<26:02:50,  3.57it/s]
 10%|▉         | 36686/371472 [2:55:27<25:34:48,  3.64it/s]
 10%|▉         | 36687/371472 [2:55:27<26:00:11,  3.58it/s]
 10%|▉         | 36688/371472 [2:55:28<27:17:26,  3.41it/s]
 10%|▉         | 36689/371472 [2:55:28<27:14:22,  3.41it/s]
 10%|▉         | 36690/371472 [2:55:28<26:37:26,  3.49it/s]
 10%|▉         | 36691/371472 [2:55:29<27:13:01,  3.42it/s]
 10%|▉         | 36692/371472 [2:55:29<26:54:42,  3.46it/s]
 10%|▉         | 36693/371472 [2:55:29<25:53:12,  3.59it/s]
 10%|▉         | 36694/371472 [2:55:29<25:59:29,  3.58it/s]
 10%|▉         | 36695/371472 [2:55:30<28:06:07,  3.31it/s]
 10%|▉         | 36696/371472 [2:55:30<27:38:00,  3.37it/s]
 10%|▉         | 36697/371472 [2:55:30<27:12:43,  3.42it/s]
 10%|▉         | 36698/371472 [2:55:31<27:17:27,  3.41it/s]
 10%|▉         | 36699/371472 [2:55:31<26:48:44,  3.47it/s]
 10%|▉         | 36700/371472 [2:55:31<28:12:34,  3.30it/s]
                                                           
{'loss': 4.4236, 'learning_rate': 9.115203947510182e-07, 'epoch': 1.58}

 10%|▉         | 36700/371472 [2:55:31<28:12:34,  3.30it/s]
 10%|▉         | 36701/371472 [2:55:31<26:45:03,  3.48it/s]
 10%|▉         | 36702/371472 [2:55:32<26:10:00,  3.55it/s]
 10%|▉         | 36703/371472 [2:55:32<26:01:57,  3.57it/s]
 10%|▉         | 36704/371472 [2:55:32<25:57:20,  3.58it/s]
 10%|▉         | 36705/371472 [2:55:33<26:14:11,  3.54it/s]
 10%|▉         | 36706/371472 [2:55:33<25:55:39,  3.59it/s]
 10%|▉         | 36707/371472 [2:55:33<27:14:00,  3.41it/s]
 10%|▉         | 36708/371472 [2:55:33<26:36:52,  3.49it/s]
 10%|▉         | 36709/371472 [2:55:34<26:05:22,  3.56it/s]
 10%|▉         | 36710/371472 [2:55:34<27:17:16,  3.41it/s]
 10%|▉         | 36711/371472 [2:55:34<26:20:32,  3.53it/s]
 10%|▉         | 36712/371472 [2:55:35<26:19:52,  3.53it/s]
 10%|▉         | 36713/371472 [2:55:35<25:44:12,  3.61it/s]
 10%|▉         | 36714/371472 [2:55:35<25:25:56,  3.66it/s]
 10%|▉         | 36715/371472 [2:55:35<27:44:31,  3.35it/s]
 10%|▉         | 36716/371472 [2:55:36<27:47:16,  3.35it/s]
 10%|▉         | 36717/371472 [2:55:36<26:38:29,  3.49it/s]
 10%|▉         | 36718/371472 [2:55:36<26:27:28,  3.51it/s]
 10%|▉         | 36719/371472 [2:55:37<26:20:37,  3.53it/s]
 10%|▉         | 36720/371472 [2:55:37<29:10:59,  3.19it/s]
                                                           
{'loss': 4.4679, 'learning_rate': 9.114719127755392e-07, 'epoch': 1.58}

 10%|▉         | 36720/371472 [2:55:37<29:10:59,  3.19it/s]
 10%|▉         | 36721/371472 [2:55:37<28:50:20,  3.22it/s]
 10%|▉         | 36722/371472 [2:55:38<28:15:23,  3.29it/s]
 10%|▉         | 36723/371472 [2:55:38<26:51:10,  3.46it/s]
 10%|▉         | 36724/371472 [2:55:38<26:31:59,  3.50it/s]
 10%|▉         | 36725/371472 [2:55:38<25:52:59,  3.59it/s]
 10%|▉         | 36726/371472 [2:55:39<26:09:56,  3.55it/s]
 10%|▉         | 36727/371472 [2:55:39<25:14:29,  3.68it/s]
 10%|▉         | 36728/371472 [2:55:39<24:56:01,  3.73it/s]
 10%|▉         | 36729/371472 [2:55:39<24:51:09,  3.74it/s]
 10%|▉         | 36730/371472 [2:55:40<25:03:50,  3.71it/s]
 10%|▉         | 36731/371472 [2:55:40<24:46:49,  3.75it/s]
 10%|▉         | 36732/371472 [2:55:40<25:55:02,  3.59it/s]
 10%|▉         | 36733/371472 [2:55:41<27:41:09,  3.36it/s]
 10%|▉         | 36734/371472 [2:55:41<26:39:18,  3.49it/s]
 10%|▉         | 36735/371472 [2:55:41<27:29:53,  3.38it/s]
 10%|▉         | 36736/371472 [2:55:41<26:53:08,  3.46it/s]
 10%|▉         | 36737/371472 [2:55:42<25:59:23,  3.58it/s]
 10%|▉         | 36738/371472 [2:55:42<25:41:59,  3.62it/s]
 10%|▉         | 36739/371472 [2:55:42<28:26:23,  3.27it/s]
 10%|▉         | 36740/371472 [2:55:43<27:07:45,  3.43it/s]
                                                           
{'loss': 4.4973, 'learning_rate': 9.114234308000604e-07, 'epoch': 1.58}

 10%|▉         | 36740/371472 [2:55:43<27:07:45,  3.43it/s]
 10%|▉         | 36741/371472 [2:55:43<27:26:37,  3.39it/s]
 10%|▉         | 36742/371472 [2:55:43<26:56:14,  3.45it/s]
 10%|▉         | 36743/371472 [2:55:43<25:48:59,  3.60it/s]
 10%|▉         | 36744/371472 [2:55:44<25:53:12,  3.59it/s]
 10%|▉         | 36745/371472 [2:55:44<26:11:19,  3.55it/s]
 10%|▉         | 36746/371472 [2:55:44<25:30:06,  3.65it/s]
 10%|▉         | 36747/371472 [2:55:44<24:52:24,  3.74it/s]
 10%|▉         | 36748/371472 [2:55:45<24:18:54,  3.82it/s]
 10%|▉         | 36749/371472 [2:55:45<26:31:35,  3.51it/s]
 10%|▉         | 36750/371472 [2:55:45<25:07:48,  3.70it/s]
 10%|▉         | 36751/371472 [2:55:46<26:02:14,  3.57it/s]
 10%|▉         | 36752/371472 [2:55:46<26:31:44,  3.50it/s]
 10%|▉         | 36753/371472 [2:55:46<26:47:33,  3.47it/s]
 10%|▉         | 36754/371472 [2:55:46<25:56:36,  3.58it/s]
 10%|▉         | 36755/371472 [2:55:47<32:38:05,  2.85it/s]
 10%|▉         | 36756/371472 [2:55:47<29:45:56,  3.12it/s]
 10%|▉         | 36757/371472 [2:55:47<28:43:49,  3.24it/s]
 10%|▉         | 36758/371472 [2:55:48<27:22:55,  3.40it/s]
 10%|▉         | 36759/371472 [2:55:48<27:59:09,  3.32it/s]
 10%|▉         | 36760/371472 [2:55:48<28:09:13,  3.30it/s]
                                                           
{'loss': 4.5085, 'learning_rate': 9.113749488245814e-07, 'epoch': 1.58}

 10%|▉         | 36760/371472 [2:55:48<28:09:13,  3.30it/s]
 10%|▉         | 36761/371472 [2:55:49<27:02:05,  3.44it/s]
 10%|▉         | 36762/371472 [2:55:49<27:53:22,  3.33it/s]
 10%|▉         | 36763/371472 [2:55:49<27:27:34,  3.39it/s]
 10%|▉         | 36764/371472 [2:55:50<28:14:21,  3.29it/s]
 10%|▉         | 36765/371472 [2:55:50<27:43:22,  3.35it/s]
 10%|▉         | 36766/371472 [2:55:50<27:17:43,  3.41it/s]
 10%|▉         | 36767/371472 [2:55:50<28:32:35,  3.26it/s]
 10%|▉         | 36768/371472 [2:55:51<27:21:12,  3.40it/s]
 10%|▉         | 36769/371472 [2:55:51<26:21:40,  3.53it/s]
 10%|▉         | 36770/371472 [2:55:51<25:45:14,  3.61it/s]
 10%|▉         | 36771/371472 [2:55:52<28:45:58,  3.23it/s]
 10%|▉         | 36772/371472 [2:55:52<28:17:49,  3.29it/s]
 10%|▉         | 36773/371472 [2:55:52<29:36:04,  3.14it/s]
 10%|▉         | 36774/371472 [2:55:53<27:57:21,  3.33it/s]
 10%|▉         | 36775/371472 [2:55:53<26:51:40,  3.46it/s]
 10%|▉         | 36776/371472 [2:55:53<25:59:05,  3.58it/s]
 10%|▉         | 36777/371472 [2:55:53<25:09:19,  3.70it/s]
 10%|▉         | 36778/371472 [2:55:54<25:07:28,  3.70it/s]
 10%|▉         | 36779/371472 [2:55:54<24:16:29,  3.83it/s]
 10%|▉         | 36780/371472 [2:55:54<25:45:51,  3.61it/s]
                                                           
{'loss': 4.2936, 'learning_rate': 9.113264668491025e-07, 'epoch': 1.58}

 10%|▉         | 36780/371472 [2:55:54<25:45:51,  3.61it/s]
 10%|▉         | 36781/371472 [2:55:54<26:11:55,  3.55it/s]
 10%|▉         | 36782/371472 [2:55:55<26:00:32,  3.57it/s]
 10%|▉         | 36783/371472 [2:55:55<26:16:04,  3.54it/s]
 10%|▉         | 36784/371472 [2:55:55<26:29:25,  3.51it/s]
 10%|▉         | 36785/371472 [2:55:56<26:10:44,  3.55it/s]
 10%|▉         | 36786/371472 [2:55:56<26:03:47,  3.57it/s]
 10%|▉         | 36787/371472 [2:55:56<27:17:25,  3.41it/s]
 10%|▉         | 36788/371472 [2:55:56<26:32:46,  3.50it/s]
 10%|▉         | 36789/371472 [2:55:57<25:21:51,  3.67it/s]
 10%|▉         | 36790/371472 [2:55:57<26:03:57,  3.57it/s]
 10%|▉         | 36791/371472 [2:55:57<27:01:30,  3.44it/s]
 10%|▉         | 36792/371472 [2:55:58<25:29:02,  3.65it/s]
 10%|▉         | 36793/371472 [2:55:58<26:32:49,  3.50it/s]
 10%|▉         | 36794/371472 [2:55:58<26:32:27,  3.50it/s]
 10%|▉         | 36795/371472 [2:55:58<26:46:01,  3.47it/s]
 10%|▉         | 36796/371472 [2:55:59<26:36:02,  3.49it/s]
 10%|▉         | 36797/371472 [2:55:59<26:46:41,  3.47it/s]
 10%|▉         | 36798/371472 [2:55:59<25:31:28,  3.64it/s]
 10%|▉         | 36799/371472 [2:55:59<24:58:14,  3.72it/s]
 10%|▉         | 36800/371472 [2:56:00<24:37:57,  3.77it/s]
                                                           
{'loss': 4.5846, 'learning_rate': 9.112779848736236e-07, 'epoch': 1.59}

 10%|▉         | 36800/371472 [2:56:00<24:37:57,  3.77it/s]
 10%|▉         | 36801/371472 [2:56:00<26:09:25,  3.55it/s]
 10%|▉         | 36802/371472 [2:56:00<25:07:09,  3.70it/s]
 10%|▉         | 36803/371472 [2:56:01<25:14:43,  3.68it/s]
 10%|▉         | 36804/371472 [2:56:01<25:53:20,  3.59it/s]
 10%|▉         | 36805/371472 [2:56:01<27:00:14,  3.44it/s]
 10%|▉         | 36806/371472 [2:56:01<26:23:50,  3.52it/s]
 10%|▉         | 36807/371472 [2:56:02<28:26:07,  3.27it/s]
 10%|▉         | 36808/371472 [2:56:02<28:31:13,  3.26it/s]
 10%|▉         | 36809/371472 [2:56:03<31:13:09,  2.98it/s]
 10%|▉         | 36810/371472 [2:56:03<30:19:24,  3.07it/s]
 10%|▉         | 36811/371472 [2:56:03<29:50:56,  3.11it/s]
 10%|▉         | 36812/371472 [2:56:03<27:55:06,  3.33it/s]
 10%|▉         | 36813/371472 [2:56:04<26:19:34,  3.53it/s]
 10%|▉         | 36814/371472 [2:56:04<25:20:43,  3.67it/s]
 10%|▉         | 36815/371472 [2:56:04<24:56:17,  3.73it/s]
 10%|▉         | 36816/371472 [2:56:04<24:59:40,  3.72it/s]
 10%|▉         | 36817/371472 [2:56:05<25:03:42,  3.71it/s]
 10%|▉         | 36818/371472 [2:56:05<25:16:33,  3.68it/s]
 10%|▉         | 36819/371472 [2:56:05<24:54:57,  3.73it/s]
 10%|▉         | 36820/371472 [2:56:05<24:47:41,  3.75it/s]
                                                           
{'loss': 4.4171, 'learning_rate': 9.112295028981446e-07, 'epoch': 1.59}

 10%|▉         | 36820/371472 [2:56:05<24:47:41,  3.75it/s]
 10%|▉         | 36821/371472 [2:56:06<25:12:06,  3.69it/s]
 10%|▉         | 36822/371472 [2:56:06<24:26:46,  3.80it/s]
 10%|▉         | 36823/371472 [2:56:06<24:06:48,  3.86it/s]
 10%|▉         | 36824/371472 [2:56:07<23:54:17,  3.89it/s]
 10%|▉         | 36825/371472 [2:56:07<26:34:22,  3.50it/s]
 10%|▉         | 36826/371472 [2:56:07<26:16:41,  3.54it/s]
 10%|▉         | 36827/371472 [2:56:07<25:40:04,  3.62it/s]
 10%|▉         | 36828/371472 [2:56:08<26:30:45,  3.51it/s]
 10%|▉         | 36829/371472 [2:56:08<26:08:50,  3.56it/s]
 10%|▉         | 36830/371472 [2:56:08<27:25:09,  3.39it/s]
 10%|▉         | 36831/371472 [2:56:09<30:22:12,  3.06it/s]
 10%|▉         | 36832/371472 [2:56:09<28:14:11,  3.29it/s]
 10%|▉         | 36833/371472 [2:56:09<27:33:51,  3.37it/s]
 10%|▉         | 36834/371472 [2:56:10<28:47:55,  3.23it/s]
 10%|▉         | 36835/371472 [2:56:10<28:22:26,  3.28it/s]
 10%|▉         | 36836/371472 [2:56:10<28:21:12,  3.28it/s]
 10%|▉         | 36837/371472 [2:56:10<27:33:07,  3.37it/s]
 10%|▉         | 36838/371472 [2:56:11<27:20:59,  3.40it/s]
 10%|▉         | 36839/371472 [2:56:11<26:17:26,  3.54it/s]
 10%|▉         | 36840/371472 [2:56:11<27:33:50,  3.37it/s]
                                                           
{'loss': 4.3638, 'learning_rate': 9.111810209226658e-07, 'epoch': 1.59}

 10%|▉         | 36840/371472 [2:56:11<27:33:50,  3.37it/s]
 10%|▉         | 36841/371472 [2:56:12<26:37:15,  3.49it/s]
 10%|▉         | 36842/371472 [2:56:12<27:08:01,  3.43it/s]
 10%|▉         | 36843/371472 [2:56:12<27:49:26,  3.34it/s]
 10%|▉         | 36844/371472 [2:56:13<27:48:01,  3.34it/s]
 10%|▉         | 36845/371472 [2:56:13<27:12:36,  3.42it/s]
 10%|▉         | 36846/371472 [2:56:13<27:32:44,  3.37it/s]
 10%|▉         | 36847/371472 [2:56:13<26:49:26,  3.47it/s]
 10%|▉         | 36848/371472 [2:56:14<26:53:08,  3.46it/s]
 10%|▉         | 36849/371472 [2:56:14<26:07:10,  3.56it/s]
 10%|▉         | 36850/371472 [2:56:14<25:30:04,  3.64it/s]
 10%|▉         | 36851/371472 [2:56:14<24:44:50,  3.76it/s]
 10%|▉         | 36852/371472 [2:56:15<27:01:49,  3.44it/s]
 10%|▉         | 36853/371472 [2:56:15<28:43:43,  3.24it/s]
 10%|▉         | 36854/371472 [2:56:15<29:06:03,  3.19it/s]
 10%|▉         | 36855/371472 [2:56:16<27:18:59,  3.40it/s]
 10%|▉         | 36856/371472 [2:56:16<26:41:35,  3.48it/s]
 10%|▉         | 36857/371472 [2:56:16<27:37:43,  3.36it/s]
 10%|▉         | 36858/371472 [2:56:17<26:54:49,  3.45it/s]
 10%|▉         | 36859/371472 [2:56:17<25:52:33,  3.59it/s]
 10%|▉         | 36860/371472 [2:56:17<25:37:04,  3.63it/s]
                                                           
{'loss': 4.4992, 'learning_rate': 9.11132538947187e-07, 'epoch': 1.59}

 10%|▉         | 36860/371472 [2:56:17<25:37:04,  3.63it/s]
 10%|▉         | 36861/371472 [2:56:17<24:57:15,  3.72it/s]
 10%|▉         | 36862/371472 [2:56:18<24:29:13,  3.80it/s]
 10%|▉         | 36863/371472 [2:56:18<25:07:19,  3.70it/s]
 10%|▉         | 36864/371472 [2:56:18<27:38:41,  3.36it/s]
 10%|▉         | 36865/371472 [2:56:19<26:59:06,  3.44it/s]
 10%|▉         | 36866/371472 [2:56:19<25:49:38,  3.60it/s]
 10%|▉         | 36867/371472 [2:56:19<25:36:26,  3.63it/s]
 10%|▉         | 36868/371472 [2:56:19<24:42:03,  3.76it/s]
 10%|▉         | 36869/371472 [2:56:20<24:34:53,  3.78it/s]
 10%|▉         | 36870/371472 [2:56:20<24:33:30,  3.78it/s]
 10%|▉         | 36871/371472 [2:56:20<24:19:11,  3.82it/s]
 10%|▉         | 36872/371472 [2:56:20<24:47:04,  3.75it/s]
 10%|▉         | 36873/371472 [2:56:21<27:22:30,  3.40it/s]
 10%|▉         | 36874/371472 [2:56:21<26:10:48,  3.55it/s]
 10%|▉         | 36875/371472 [2:56:21<26:26:55,  3.51it/s]
 10%|▉         | 36876/371472 [2:56:22<28:05:21,  3.31it/s]
 10%|▉         | 36877/371472 [2:56:22<27:37:43,  3.36it/s]
 10%|▉         | 36878/371472 [2:56:22<26:10:03,  3.55it/s]
 10%|▉         | 36879/371472 [2:56:22<26:56:34,  3.45it/s]
 10%|▉         | 36880/371472 [2:56:23<26:42:01,  3.48it/s]
                                                           
{'loss': 4.3224, 'learning_rate': 9.110840569717081e-07, 'epoch': 1.59}

 10%|▉         | 36880/371472 [2:56:23<26:42:01,  3.48it/s]
 10%|▉         | 36881/371472 [2:56:23<26:59:51,  3.44it/s]
 10%|▉         | 36882/371472 [2:56:23<27:25:48,  3.39it/s]
 10%|▉         | 36883/371472 [2:56:24<27:08:08,  3.43it/s]
 10%|▉         | 36884/371472 [2:56:24<26:32:11,  3.50it/s]
 10%|▉         | 36885/371472 [2:56:24<26:33:32,  3.50it/s]
 10%|▉         | 36886/371472 [2:56:24<25:49:47,  3.60it/s]
 10%|▉         | 36887/371472 [2:56:25<26:36:36,  3.49it/s]
 10%|▉         | 36888/371472 [2:56:25<26:43:57,  3.48it/s]
 10%|▉         | 36889/371472 [2:56:25<26:19:07,  3.53it/s]
 10%|▉         | 36890/371472 [2:56:26<29:21:02,  3.17it/s]
 10%|▉         | 36891/371472 [2:56:26<28:51:26,  3.22it/s]
 10%|▉         | 36892/371472 [2:56:26<27:26:37,  3.39it/s]
 10%|▉         | 36893/371472 [2:56:26<27:01:53,  3.44it/s]
 10%|▉         | 36894/371472 [2:56:27<28:21:38,  3.28it/s]
 10%|▉         | 36895/371472 [2:56:27<27:47:26,  3.34it/s]
 10%|▉         | 36896/371472 [2:56:27<27:10:10,  3.42it/s]
 10%|▉         | 36897/371472 [2:56:28<27:34:20,  3.37it/s]
 10%|▉         | 36898/371472 [2:56:28<26:55:51,  3.45it/s]
 10%|▉         | 36899/371472 [2:56:28<25:59:14,  3.58it/s]
 10%|▉         | 36900/371472 [2:56:29<28:59:04,  3.21it/s]
                                                           
{'loss': 4.5416, 'learning_rate': 9.110355749962291e-07, 'epoch': 1.59}

 10%|▉         | 36900/371472 [2:56:29<28:59:04,  3.21it/s]
 10%|▉         | 36901/371472 [2:56:29<27:20:07,  3.40it/s]
 10%|▉         | 36902/371472 [2:56:29<26:08:59,  3.55it/s]
 10%|▉         | 36903/371472 [2:56:29<25:43:29,  3.61it/s]
 10%|▉         | 36904/371472 [2:56:30<25:57:48,  3.58it/s]
 10%|▉         | 36905/371472 [2:56:30<25:03:25,  3.71it/s]
 10%|▉         | 36906/371472 [2:56:30<24:52:42,  3.74it/s]
 10%|▉         | 36907/371472 [2:56:30<24:53:39,  3.73it/s]
 10%|▉         | 36908/371472 [2:56:31<25:32:20,  3.64it/s]
 10%|▉         | 36909/371472 [2:56:31<25:14:08,  3.68it/s]
 10%|▉         | 36910/371472 [2:56:31<26:04:42,  3.56it/s]
 10%|▉         | 36911/371472 [2:56:32<25:27:26,  3.65it/s]
 10%|▉         | 36912/371472 [2:56:32<24:59:39,  3.72it/s]
 10%|▉         | 36913/371472 [2:56:32<26:24:48,  3.52it/s]
 10%|▉         | 36914/371472 [2:56:32<26:35:13,  3.50it/s]
 10%|▉         | 36915/371472 [2:56:33<25:54:18,  3.59it/s]
 10%|▉         | 36916/371472 [2:56:33<25:37:12,  3.63it/s]
 10%|▉         | 36917/371472 [2:56:33<26:02:48,  3.57it/s]
 10%|▉         | 36918/371472 [2:56:34<27:12:51,  3.41it/s]
 10%|▉         | 36919/371472 [2:56:34<27:57:50,  3.32it/s]
 10%|▉         | 36920/371472 [2:56:34<26:27:43,  3.51it/s]
                                                           
{'loss': 4.369, 'learning_rate': 9.109870930207502e-07, 'epoch': 1.59}

 10%|▉         | 36920/371472 [2:56:34<26:27:43,  3.51it/s]
 10%|▉         | 36921/371472 [2:56:34<26:32:54,  3.50it/s]
 10%|▉         | 36922/371472 [2:56:35<27:58:41,  3.32it/s]
 10%|▉         | 36923/371472 [2:56:35<26:09:29,  3.55it/s]
 10%|▉         | 36924/371472 [2:56:35<25:34:57,  3.63it/s]
 10%|▉         | 36925/371472 [2:56:36<25:03:58,  3.71it/s]
 10%|▉         | 36926/371472 [2:56:36<24:48:19,  3.75it/s]
 10%|▉         | 36927/371472 [2:56:36<25:19:19,  3.67it/s]
 10%|▉         | 36928/371472 [2:56:36<25:40:24,  3.62it/s]
 10%|▉         | 36929/371472 [2:56:37<25:10:40,  3.69it/s]
 10%|▉         | 36930/371472 [2:56:37<27:02:23,  3.44it/s]
 10%|▉         | 36931/371472 [2:56:37<26:41:00,  3.48it/s]
 10%|▉         | 36932/371472 [2:56:37<25:47:32,  3.60it/s]
 10%|▉         | 36933/371472 [2:56:38<25:33:19,  3.64it/s]
 10%|▉         | 36934/371472 [2:56:38<27:05:52,  3.43it/s]
 10%|▉         | 36935/371472 [2:56:38<27:04:27,  3.43it/s]
 10%|▉         | 36936/371472 [2:56:39<25:49:27,  3.60it/s]
 10%|▉         | 36937/371472 [2:56:39<25:33:44,  3.64it/s]
 10%|▉         | 36938/371472 [2:56:39<27:01:00,  3.44it/s]
 10%|▉         | 36939/371472 [2:56:39<26:32:41,  3.50it/s]
 10%|▉         | 36940/371472 [2:56:40<25:58:31,  3.58it/s]
                                                           
{'loss': 4.6777, 'learning_rate': 9.109386110452713e-07, 'epoch': 1.59}

 10%|▉         | 36940/371472 [2:56:40<25:58:31,  3.58it/s]
 10%|▉         | 36941/371472 [2:56:40<25:36:42,  3.63it/s]
 10%|▉         | 36942/371472 [2:56:40<24:49:04,  3.74it/s]
 10%|▉         | 36943/371472 [2:56:41<24:20:55,  3.82it/s]
 10%|▉         | 36944/371472 [2:56:41<25:41:44,  3.62it/s]
 10%|▉         | 36945/371472 [2:56:41<25:10:06,  3.69it/s]
 10%|▉         | 36946/371472 [2:56:41<26:57:23,  3.45it/s]
 10%|▉         | 36947/371472 [2:56:42<26:31:58,  3.50it/s]
 10%|▉         | 36948/371472 [2:56:42<25:47:13,  3.60it/s]
 10%|▉         | 36949/371472 [2:56:42<25:21:19,  3.66it/s]
 10%|▉         | 36950/371472 [2:56:43<25:59:15,  3.58it/s]
 10%|▉         | 36951/371472 [2:56:43<26:22:31,  3.52it/s]
 10%|▉         | 36952/371472 [2:56:43<25:45:58,  3.61it/s]
 10%|▉         | 36953/371472 [2:56:43<26:36:11,  3.49it/s]
 10%|▉         | 36954/371472 [2:56:44<27:18:55,  3.40it/s]
 10%|▉         | 36955/371472 [2:56:44<25:57:06,  3.58it/s]
 10%|▉         | 36956/371472 [2:56:44<24:56:57,  3.72it/s]
 10%|▉         | 36957/371472 [2:56:44<24:53:38,  3.73it/s]
 10%|▉         | 36958/371472 [2:56:45<23:46:51,  3.91it/s]
 10%|▉         | 36959/371472 [2:56:45<23:35:55,  3.94it/s]
 10%|▉         | 36960/371472 [2:56:45<23:45:48,  3.91it/s]
                                                           
{'loss': 4.4192, 'learning_rate': 9.108901290697925e-07, 'epoch': 1.59}

 10%|▉         | 36960/371472 [2:56:45<23:45:48,  3.91it/s]
 10%|▉         | 36961/371472 [2:56:45<23:31:00,  3.95it/s]
 10%|▉         | 36962/371472 [2:56:46<25:08:03,  3.70it/s]
 10%|▉         | 36963/371472 [2:56:46<25:08:55,  3.69it/s]
 10%|▉         | 36964/371472 [2:56:46<25:44:52,  3.61it/s]
 10%|▉         | 36965/371472 [2:56:47<25:32:33,  3.64it/s]
 10%|▉         | 36966/371472 [2:56:47<25:15:22,  3.68it/s]
 10%|▉         | 36967/371472 [2:56:47<24:33:17,  3.78it/s]
 10%|▉         | 36968/371472 [2:56:47<26:09:52,  3.55it/s]
 10%|▉         | 36969/371472 [2:56:48<28:31:13,  3.26it/s]
 10%|▉         | 36970/371472 [2:56:48<27:29:44,  3.38it/s]
 10%|▉         | 36971/371472 [2:56:48<27:02:05,  3.44it/s]
 10%|▉         | 36972/371472 [2:56:49<28:23:46,  3.27it/s]
 10%|▉         | 36973/371472 [2:56:49<28:01:58,  3.31it/s]
 10%|▉         | 36974/371472 [2:56:49<28:42:06,  3.24it/s]
 10%|▉         | 36975/371472 [2:56:50<27:26:09,  3.39it/s]
 10%|▉         | 36976/371472 [2:56:50<27:06:25,  3.43it/s]
 10%|▉         | 36977/371472 [2:56:50<27:26:34,  3.39it/s]
 10%|▉         | 36978/371472 [2:56:50<26:11:06,  3.55it/s]
 10%|▉         | 36979/371472 [2:56:51<25:54:00,  3.59it/s]
 10%|▉         | 36980/371472 [2:56:51<25:27:08,  3.65it/s]
                                                           
{'loss': 4.4574, 'learning_rate': 9.108416470943135e-07, 'epoch': 1.59}

 10%|▉         | 36980/371472 [2:56:51<25:27:08,  3.65it/s]
 10%|▉         | 36981/371472 [2:56:51<26:34:34,  3.50it/s]
 10%|▉         | 36982/371472 [2:56:51<25:43:37,  3.61it/s]
 10%|▉         | 36983/371472 [2:56:52<25:26:51,  3.65it/s]
 10%|▉         | 36984/371472 [2:56:52<25:06:09,  3.70it/s]
 10%|▉         | 36985/371472 [2:56:52<25:59:15,  3.58it/s]
 10%|▉         | 36986/371472 [2:56:53<26:07:57,  3.56it/s]
 10%|▉         | 36987/371472 [2:56:53<31:11:32,  2.98it/s]
 10%|▉         | 36988/371472 [2:56:53<29:28:59,  3.15it/s]
 10%|▉         | 36989/371472 [2:56:54<27:31:41,  3.38it/s]
 10%|▉         | 36990/371472 [2:56:54<25:55:03,  3.58it/s]
 10%|▉         | 36991/371472 [2:56:54<25:21:38,  3.66it/s]
 10%|▉         | 36992/371472 [2:56:54<26:18:41,  3.53it/s]
 10%|▉         | 36993/371472 [2:56:55<25:34:31,  3.63it/s]
 10%|▉         | 36994/371472 [2:56:55<25:39:57,  3.62it/s]
 10%|▉         | 36995/371472 [2:56:55<26:46:41,  3.47it/s]
 10%|▉         | 36996/371472 [2:56:56<25:53:53,  3.59it/s]
 10%|▉         | 36997/371472 [2:56:56<26:08:52,  3.55it/s]
 10%|▉         | 36998/371472 [2:56:56<25:56:23,  3.58it/s]
 10%|▉         | 36999/371472 [2:56:56<25:00:26,  3.72it/s]
 10%|▉         | 37000/371472 [2:56:57<26:35:41,  3.49it/s]
                                                           
{'loss': 4.4622, 'learning_rate': 9.107931651188347e-07, 'epoch': 1.59}

 10%|▉         | 37000/371472 [2:56:57<26:35:41,  3.49it/s]
 10%|▉         | 37001/371472 [2:56:57<26:37:44,  3.49it/s]
 10%|▉         | 37002/371472 [2:56:57<27:53:36,  3.33it/s]
 10%|▉         | 37003/371472 [2:56:58<27:41:44,  3.35it/s]
 10%|▉         | 37004/371472 [2:56:58<26:48:01,  3.47it/s]
 10%|▉         | 37005/371472 [2:56:58<26:36:35,  3.49it/s]
 10%|▉         | 37006/371472 [2:56:58<27:01:53,  3.44it/s]
 10%|▉         | 37007/371472 [2:56:59<26:27:21,  3.51it/s]
 10%|▉         | 37008/371472 [2:56:59<25:31:15,  3.64it/s]
 10%|▉         | 37009/371472 [2:56:59<24:40:21,  3.77it/s]
 10%|▉         | 37010/371472 [2:56:59<24:50:17,  3.74it/s]
 10%|▉         | 37011/371472 [2:57:00<24:24:12,  3.81it/s]
 10%|▉         | 37012/371472 [2:57:00<25:19:49,  3.67it/s]
 10%|▉         | 37013/371472 [2:57:00<24:20:49,  3.82it/s]
 10%|▉         | 37014/371472 [2:57:01<25:16:07,  3.68it/s]
 10%|▉         | 37015/371472 [2:57:01<25:31:34,  3.64it/s]
 10%|▉         | 37016/371472 [2:57:01<25:36:57,  3.63it/s]
 10%|▉         | 37017/371472 [2:57:01<25:36:21,  3.63it/s]
 10%|▉         | 37018/371472 [2:57:02<26:37:32,  3.49it/s]
 10%|▉         | 37019/371472 [2:57:02<27:09:29,  3.42it/s]
 10%|▉         | 37020/371472 [2:57:02<27:24:38,  3.39it/s]
                                                           
{'loss': 4.2659, 'learning_rate': 9.107446831433558e-07, 'epoch': 1.59}

 10%|▉         | 37020/371472 [2:57:02<27:24:38,  3.39it/s]
 10%|▉         | 37021/371472 [2:57:03<27:01:44,  3.44it/s]
 10%|▉         | 37022/371472 [2:57:03<25:42:02,  3.61it/s]
 10%|▉         | 37023/371472 [2:57:03<25:15:46,  3.68it/s]
 10%|▉         | 37024/371472 [2:57:03<27:35:59,  3.37it/s]
 10%|▉         | 37025/371472 [2:57:04<26:12:52,  3.54it/s]
 10%|▉         | 37026/371472 [2:57:04<25:27:19,  3.65it/s]
 10%|▉         | 37027/371472 [2:57:04<25:26:45,  3.65it/s]
 10%|▉         | 37028/371472 [2:57:04<24:55:31,  3.73it/s]
 10%|▉         | 37029/371472 [2:57:05<25:17:27,  3.67it/s]
 10%|▉         | 37030/371472 [2:57:05<26:34:02,  3.50it/s]
 10%|▉         | 37031/371472 [2:57:05<26:32:36,  3.50it/s]
 10%|▉         | 37032/371472 [2:57:06<26:05:26,  3.56it/s]
 10%|▉         | 37033/371472 [2:57:06<25:35:11,  3.63it/s]
 10%|▉         | 37034/371472 [2:57:06<25:07:49,  3.70it/s]
 10%|▉         | 37035/371472 [2:57:06<24:33:53,  3.78it/s]
 10%|▉         | 37036/371472 [2:57:07<24:33:39,  3.78it/s]
 10%|▉         | 37037/371472 [2:57:07<25:04:05,  3.71it/s]
 10%|▉         | 37038/371472 [2:57:07<24:51:48,  3.74it/s]
 10%|▉         | 37039/371472 [2:57:07<24:38:12,  3.77it/s]
 10%|▉         | 37040/371472 [2:57:08<25:26:03,  3.65it/s]
                                                           
{'loss': 4.3141, 'learning_rate': 9.106962011678769e-07, 'epoch': 1.6}

 10%|▉         | 37040/371472 [2:57:08<25:26:03,  3.65it/s]
 10%|▉         | 37041/371472 [2:57:08<24:52:16,  3.74it/s]
 10%|▉         | 37042/371472 [2:57:08<25:16:21,  3.68it/s]
 10%|▉         | 37043/371472 [2:57:09<25:49:19,  3.60it/s]
 10%|▉         | 37044/371472 [2:57:09<25:38:31,  3.62it/s]
 10%|▉         | 37045/371472 [2:57:09<25:08:47,  3.69it/s]
 10%|▉         | 37046/371472 [2:57:09<26:38:51,  3.49it/s]
 10%|▉         | 37047/371472 [2:57:10<25:17:36,  3.67it/s]
 10%|▉         | 37048/371472 [2:57:10<25:13:02,  3.68it/s]
 10%|▉         | 37049/371472 [2:57:10<24:48:21,  3.74it/s]
 10%|▉         | 37050/371472 [2:57:10<25:25:23,  3.65it/s]
 10%|▉         | 37051/371472 [2:57:11<25:48:51,  3.60it/s]
 10%|▉         | 37052/371472 [2:57:11<26:38:29,  3.49it/s]
 10%|▉         | 37053/371472 [2:57:11<26:39:23,  3.48it/s]
 10%|▉         | 37054/371472 [2:57:12<26:46:46,  3.47it/s]
 10%|▉         | 37055/371472 [2:57:12<25:29:34,  3.64it/s]
 10%|▉         | 37056/371472 [2:57:12<26:12:51,  3.54it/s]
 10%|▉         | 37057/371472 [2:57:12<25:06:21,  3.70it/s]
 10%|▉         | 37058/371472 [2:57:13<25:24:08,  3.66it/s]
 10%|▉         | 37059/371472 [2:57:13<24:19:10,  3.82it/s]
 10%|▉         | 37060/371472 [2:57:13<26:39:13,  3.49it/s]
                                                           
{'loss': 4.1779, 'learning_rate': 9.106477191923979e-07, 'epoch': 1.6}

 10%|▉         | 37060/371472 [2:57:13<26:39:13,  3.49it/s]
 10%|▉         | 37061/371472 [2:57:14<26:13:56,  3.54it/s]
 10%|▉         | 37062/371472 [2:57:14<26:12:11,  3.55it/s]
 10%|▉         | 37063/371472 [2:57:14<25:06:33,  3.70it/s]
 10%|▉         | 37064/371472 [2:57:14<24:06:41,  3.85it/s]
 10%|▉         | 37065/371472 [2:57:15<26:35:38,  3.49it/s]
 10%|▉         | 37066/371472 [2:57:15<25:39:13,  3.62it/s]
 10%|▉         | 37067/371472 [2:57:15<25:25:04,  3.65it/s]
 10%|▉         | 37068/371472 [2:57:15<25:09:06,  3.69it/s]
 10%|▉         | 37069/371472 [2:57:16<24:38:23,  3.77it/s]
 10%|▉         | 37070/371472 [2:57:16<24:18:56,  3.82it/s]
 10%|▉         | 37071/371472 [2:57:16<24:41:46,  3.76it/s]
 10%|▉         | 37072/371472 [2:57:16<23:59:55,  3.87it/s]
 10%|▉         | 37073/371472 [2:57:17<24:06:57,  3.85it/s]
 10%|▉         | 37074/371472 [2:57:17<24:41:57,  3.76it/s]
 10%|▉         | 37075/371472 [2:57:17<23:51:06,  3.89it/s]
 10%|▉         | 37076/371472 [2:57:18<24:43:15,  3.76it/s]
 10%|▉         | 37077/371472 [2:57:18<24:37:14,  3.77it/s]
 10%|▉         | 37078/371472 [2:57:18<23:41:51,  3.92it/s]
 10%|▉         | 37079/371472 [2:57:18<25:39:10,  3.62it/s]
 10%|▉         | 37080/371472 [2:57:19<25:03:11,  3.71it/s]
                                                           
{'loss': 4.4769, 'learning_rate': 9.105992372169191e-07, 'epoch': 1.6}

 10%|▉         | 37080/371472 [2:57:19<25:03:11,  3.71it/s]
 10%|▉         | 37081/371472 [2:57:19<25:01:12,  3.71it/s]
 10%|▉         | 37082/371472 [2:57:19<27:09:58,  3.42it/s]
 10%|▉         | 37083/371472 [2:57:20<29:21:19,  3.16it/s]
 10%|▉         | 37084/371472 [2:57:20<28:47:22,  3.23it/s]
 10%|▉         | 37085/371472 [2:57:20<27:07:10,  3.43it/s]
 10%|▉         | 37086/371472 [2:57:20<25:43:28,  3.61it/s]
 10%|▉         | 37087/371472 [2:57:21<26:03:16,  3.57it/s]
 10%|▉         | 37088/371472 [2:57:21<27:23:29,  3.39it/s]
 10%|▉         | 37089/371472 [2:57:21<26:57:42,  3.45it/s]
 10%|▉         | 37090/371472 [2:57:22<26:47:43,  3.47it/s]
 10%|▉         | 37091/371472 [2:57:22<26:20:11,  3.53it/s]
 10%|▉         | 37092/371472 [2:57:22<26:03:49,  3.56it/s]
 10%|▉         | 37093/371472 [2:57:22<25:31:52,  3.64it/s]
 10%|▉         | 37094/371472 [2:57:23<26:04:09,  3.56it/s]
 10%|▉         | 37095/371472 [2:57:23<25:06:59,  3.70it/s]
 10%|▉         | 37096/371472 [2:57:23<25:40:23,  3.62it/s]
 10%|▉         | 37097/371472 [2:57:24<26:37:03,  3.49it/s]
 10%|▉         | 37098/371472 [2:57:24<25:39:36,  3.62it/s]
 10%|▉         | 37099/371472 [2:57:24<26:19:25,  3.53it/s]
 10%|▉         | 37100/371472 [2:57:24<25:43:02,  3.61it/s]
                                                           
{'loss': 4.306, 'learning_rate': 9.105507552414402e-07, 'epoch': 1.6}

 10%|▉         | 37100/371472 [2:57:24<25:43:02,  3.61it/s]
 10%|▉         | 37101/371472 [2:57:25<26:15:08,  3.54it/s]
 10%|▉         | 37102/371472 [2:57:25<25:00:21,  3.71it/s]
 10%|▉         | 37103/371472 [2:57:25<25:47:23,  3.60it/s]
 10%|▉         | 37104/371472 [2:57:25<26:02:41,  3.57it/s]
 10%|▉         | 37105/371472 [2:57:26<25:24:41,  3.66it/s]
 10%|▉         | 37106/371472 [2:57:26<24:20:48,  3.81it/s]
 10%|▉         | 37107/371472 [2:57:26<23:47:23,  3.90it/s]
 10%|▉         | 37108/371472 [2:57:27<25:42:10,  3.61it/s]
 10%|▉         | 37109/371472 [2:57:27<26:17:46,  3.53it/s]
 10%|▉         | 37110/371472 [2:57:27<26:49:03,  3.46it/s]
 10%|▉         | 37111/371472 [2:57:27<25:53:33,  3.59it/s]
 10%|▉         | 37112/371472 [2:57:28<25:48:21,  3.60it/s]
 10%|▉         | 37113/371472 [2:57:28<25:18:06,  3.67it/s]
 10%|▉         | 37114/371472 [2:57:28<25:46:44,  3.60it/s]
 10%|▉         | 37115/371472 [2:57:28<25:20:06,  3.67it/s]
 10%|▉         | 37116/371472 [2:57:29<24:30:13,  3.79it/s]
 10%|▉         | 37117/371472 [2:57:29<25:01:48,  3.71it/s]
 10%|▉         | 37118/371472 [2:57:29<25:30:12,  3.64it/s]
 10%|▉         | 37119/371472 [2:57:30<25:12:29,  3.68it/s]
 10%|▉         | 37120/371472 [2:57:30<25:59:31,  3.57it/s]
                                                           
{'loss': 4.3981, 'learning_rate': 9.105022732659612e-07, 'epoch': 1.6}

 10%|▉         | 37120/371472 [2:57:30<25:59:31,  3.57it/s]
 10%|▉         | 37121/371472 [2:57:30<25:54:16,  3.59it/s]
 10%|▉         | 37122/371472 [2:57:30<27:09:04,  3.42it/s]
 10%|▉         | 37123/371472 [2:57:31<26:12:16,  3.54it/s]
 10%|▉         | 37124/371472 [2:57:31<25:44:09,  3.61it/s]
 10%|▉         | 37125/371472 [2:57:31<25:21:07,  3.66it/s]
 10%|▉         | 37126/371472 [2:57:32<26:34:39,  3.49it/s]
 10%|▉         | 37127/371472 [2:57:32<26:57:42,  3.44it/s]
 10%|▉         | 37128/371472 [2:57:32<26:02:01,  3.57it/s]
 10%|▉         | 37129/371472 [2:57:32<25:01:37,  3.71it/s]
 10%|▉         | 37130/371472 [2:57:33<24:37:40,  3.77it/s]
 10%|▉         | 37131/371472 [2:57:33<25:23:40,  3.66it/s]
 10%|▉         | 37132/371472 [2:57:33<25:19:15,  3.67it/s]
 10%|▉         | 37133/371472 [2:57:33<25:37:07,  3.63it/s]
 10%|▉         | 37134/371472 [2:57:34<26:03:46,  3.56it/s]
 10%|▉         | 37135/371472 [2:57:34<25:54:30,  3.58it/s]
 10%|▉         | 37136/371472 [2:57:34<27:02:44,  3.43it/s]
 10%|▉         | 37137/371472 [2:57:35<25:57:31,  3.58it/s]
 10%|▉         | 37138/371472 [2:57:35<25:48:53,  3.60it/s]
 10%|▉         | 37139/371472 [2:57:35<25:11:58,  3.69it/s]
 10%|▉         | 37140/371472 [2:57:35<24:18:51,  3.82it/s]
                                                           
{'loss': 4.5685, 'learning_rate': 9.104537912904824e-07, 'epoch': 1.6}

 10%|▉         | 37140/371472 [2:57:35<24:18:51,  3.82it/s]
 10%|▉         | 37141/371472 [2:57:36<24:12:22,  3.84it/s]
 10%|▉         | 37142/371472 [2:57:36<24:35:06,  3.78it/s]
 10%|▉         | 37143/371472 [2:57:36<24:34:21,  3.78it/s]
 10%|▉         | 37144/371472 [2:57:36<24:52:13,  3.73it/s]
 10%|▉         | 37145/371472 [2:57:37<25:24:23,  3.66it/s]
 10%|▉         | 37146/371472 [2:57:37<25:16:40,  3.67it/s]
 10%|▉         | 37147/371472 [2:57:37<25:23:29,  3.66it/s]
 10%|█         | 37148/371472 [2:57:38<25:07:49,  3.70it/s]
 10%|█         | 37149/371472 [2:57:38<26:20:28,  3.53it/s]
 10%|█         | 37150/371472 [2:57:38<26:00:13,  3.57it/s]
 10%|█         | 37151/371472 [2:57:38<26:07:47,  3.55it/s]
 10%|█         | 37152/371472 [2:57:39<25:49:38,  3.60it/s]
 10%|█         | 37153/371472 [2:57:39<25:22:25,  3.66it/s]
 10%|█         | 37154/371472 [2:57:39<28:36:07,  3.25it/s]
 10%|█         | 37155/371472 [2:57:40<26:58:01,  3.44it/s]
 10%|█         | 37156/371472 [2:57:40<27:00:17,  3.44it/s]
 10%|█         | 37157/371472 [2:57:40<26:28:15,  3.51it/s]
 10%|█         | 37158/371472 [2:57:40<25:49:01,  3.60it/s]
 10%|█         | 37159/371472 [2:57:41<25:20:28,  3.66it/s]
 10%|█         | 37160/371472 [2:57:41<24:22:15,  3.81it/s]
                                                           
{'loss': 4.2877, 'learning_rate': 9.104053093150035e-07, 'epoch': 1.6}

 10%|█         | 37160/371472 [2:57:41<24:22:15,  3.81it/s]
 10%|█         | 37161/371472 [2:57:41<24:21:46,  3.81it/s]
 10%|█         | 37162/371472 [2:57:41<24:01:29,  3.87it/s]
 10%|█         | 37163/371472 [2:57:42<23:22:50,  3.97it/s]
 10%|█         | 37164/371472 [2:57:42<24:58:44,  3.72it/s]
 10%|█         | 37165/371472 [2:57:42<26:05:23,  3.56it/s]
 10%|█         | 37166/371472 [2:57:42<25:12:49,  3.68it/s]
 10%|█         | 37167/371472 [2:57:43<25:42:50,  3.61it/s]
 10%|█         | 37168/371472 [2:57:43<26:03:49,  3.56it/s]
 10%|█         | 37169/371472 [2:57:43<25:53:56,  3.59it/s]
 10%|█         | 37170/371472 [2:57:44<25:23:10,  3.66it/s]
 10%|█         | 37171/371472 [2:57:44<24:45:27,  3.75it/s]
 10%|█         | 37172/371472 [2:57:44<25:37:09,  3.62it/s]
 10%|█         | 37173/371472 [2:57:44<26:25:06,  3.51it/s]
 10%|█         | 37174/371472 [2:57:45<27:56:04,  3.32it/s]
 10%|█         | 37175/371472 [2:57:45<28:04:33,  3.31it/s]
 10%|█         | 37176/371472 [2:57:45<28:13:56,  3.29it/s]
 10%|█         | 37177/371472 [2:57:46<26:53:35,  3.45it/s]
 10%|█         | 37178/371472 [2:57:46<25:54:58,  3.58it/s]
 10%|█         | 37179/371472 [2:57:46<26:47:02,  3.47it/s]
 10%|█         | 37180/371472 [2:57:47<26:58:03,  3.44it/s]
                                                           
{'loss': 4.4643, 'learning_rate': 9.103568273395246e-07, 'epoch': 1.6}

 10%|█         | 37180/371472 [2:57:47<26:58:03,  3.44it/s]
 10%|█         | 37181/371472 [2:57:47<25:56:24,  3.58it/s]
 10%|█         | 37182/371472 [2:57:47<26:02:13,  3.57it/s]
 10%|█         | 37183/371472 [2:57:47<25:25:12,  3.65it/s]
 10%|█         | 37184/371472 [2:57:48<25:10:10,  3.69it/s]
 10%|█         | 37185/371472 [2:57:48<24:28:27,  3.79it/s]
 10%|█         | 37186/371472 [2:57:48<25:36:16,  3.63it/s]
 10%|█         | 37187/371472 [2:57:48<26:53:10,  3.45it/s]
 10%|█         | 37188/371472 [2:57:49<28:33:49,  3.25it/s]
 10%|█         | 37189/371472 [2:57:49<29:12:01,  3.18it/s]
 10%|█         | 37190/371472 [2:57:49<26:46:23,  3.47it/s]
 10%|█         | 37191/371472 [2:57:50<26:00:58,  3.57it/s]
 10%|█         | 37192/371472 [2:57:50<24:52:26,  3.73it/s]
 10%|█         | 37193/371472 [2:57:50<24:20:58,  3.81it/s]
 10%|█         | 37194/371472 [2:57:50<25:04:19,  3.70it/s]
 10%|█         | 37195/371472 [2:57:51<25:02:38,  3.71it/s]
 10%|█         | 37196/371472 [2:57:51<24:36:28,  3.77it/s]
 10%|█         | 37197/371472 [2:57:51<25:30:03,  3.64it/s]
 10%|█         | 37198/371472 [2:57:51<25:03:10,  3.71it/s]
 10%|█         | 37199/371472 [2:57:52<26:07:07,  3.56it/s]
 10%|█         | 37200/371472 [2:57:52<25:38:23,  3.62it/s]
                                                           
{'loss': 4.4946, 'learning_rate': 9.103083453640457e-07, 'epoch': 1.6}

 10%|█         | 37200/371472 [2:57:52<25:38:23,  3.62it/s]
 10%|█         | 37201/371472 [2:57:52<25:23:47,  3.66it/s]
 10%|█         | 37202/371472 [2:57:53<25:51:13,  3.59it/s]
 10%|█         | 37203/371472 [2:57:53<26:59:10,  3.44it/s]
 10%|█         | 37204/371472 [2:57:53<26:25:02,  3.51it/s]
 10%|█         | 37205/371472 [2:57:53<26:12:06,  3.54it/s]
 10%|█         | 37206/371472 [2:57:54<26:09:45,  3.55it/s]
 10%|█         | 37207/371472 [2:57:54<26:02:11,  3.57it/s]
 10%|█         | 37208/371472 [2:57:54<25:04:49,  3.70it/s]
 10%|█         | 37209/371472 [2:57:55<25:36:17,  3.63it/s]
 10%|█         | 37210/371472 [2:57:55<25:06:53,  3.70it/s]
 10%|█         | 37211/371472 [2:57:55<26:53:02,  3.45it/s]
 10%|█         | 37212/371472 [2:57:55<27:20:27,  3.40it/s]
 10%|█         | 37213/371472 [2:57:56<26:13:27,  3.54it/s]
 10%|█         | 37214/371472 [2:57:56<32:07:51,  2.89it/s]
 10%|█         | 37215/371472 [2:57:56<29:32:40,  3.14it/s]
 10%|█         | 37216/371472 [2:57:57<29:43:14,  3.12it/s]
 10%|█         | 37217/371472 [2:57:57<28:56:51,  3.21it/s]
 10%|█         | 37218/371472 [2:57:57<26:53:16,  3.45it/s]
 10%|█         | 37219/371472 [2:57:58<28:02:03,  3.31it/s]
 10%|█         | 37220/371472 [2:57:58<27:13:49,  3.41it/s]
                                                           
{'loss': 4.249, 'learning_rate': 9.102598633885668e-07, 'epoch': 1.6}

 10%|█         | 37220/371472 [2:57:58<27:13:49,  3.41it/s]
 10%|█         | 37221/371472 [2:57:58<28:15:29,  3.29it/s]
 10%|█         | 37222/371472 [2:57:59<28:30:33,  3.26it/s]
 10%|█         | 37223/371472 [2:57:59<27:57:35,  3.32it/s]
 10%|█         | 37224/371472 [2:57:59<27:18:47,  3.40it/s]
 10%|█         | 37225/371472 [2:57:59<28:42:21,  3.23it/s]
 10%|█         | 37226/371472 [2:58:00<27:50:09,  3.34it/s]
 10%|█         | 37227/371472 [2:58:00<28:49:06,  3.22it/s]
 10%|█         | 37228/371472 [2:58:00<27:46:36,  3.34it/s]
 10%|█         | 37229/371472 [2:58:01<27:02:30,  3.43it/s]
 10%|█         | 37230/371472 [2:58:01<25:28:44,  3.64it/s]
 10%|█         | 37231/371472 [2:58:01<25:32:49,  3.63it/s]
 10%|█         | 37232/371472 [2:58:02<28:35:30,  3.25it/s]
 10%|█         | 37233/371472 [2:58:02<27:42:50,  3.35it/s]
 10%|█         | 37234/371472 [2:58:02<26:39:10,  3.48it/s]
 10%|█         | 37235/371472 [2:58:02<25:47:27,  3.60it/s]
 10%|█         | 37236/371472 [2:58:03<25:12:15,  3.68it/s]
 10%|█         | 37237/371472 [2:58:03<25:59:39,  3.57it/s]
 10%|█         | 37238/371472 [2:58:03<25:57:11,  3.58it/s]
 10%|█         | 37239/371472 [2:58:03<25:23:57,  3.66it/s]
 10%|█         | 37240/371472 [2:58:04<25:47:49,  3.60it/s]
                                                           
{'loss': 4.3711, 'learning_rate': 9.10211381413088e-07, 'epoch': 1.6}

 10%|█         | 37240/371472 [2:58:04<25:47:49,  3.60it/s]
 10%|█         | 37241/371472 [2:58:04<25:26:40,  3.65it/s]
 10%|█         | 37242/371472 [2:58:04<25:34:19,  3.63it/s]
 10%|█         | 37243/371472 [2:58:05<25:36:34,  3.63it/s]
 10%|█         | 37244/371472 [2:58:05<25:41:43,  3.61it/s]
 10%|█         | 37245/371472 [2:58:05<27:45:31,  3.34it/s]
 10%|█         | 37246/371472 [2:58:05<28:24:49,  3.27it/s]
 10%|█         | 37247/371472 [2:58:06<27:32:45,  3.37it/s]
 10%|█         | 37248/371472 [2:58:06<26:57:25,  3.44it/s]
 10%|█         | 37249/371472 [2:58:06<26:54:08,  3.45it/s]
 10%|█         | 37250/371472 [2:58:07<26:39:14,  3.48it/s]
 10%|█         | 37251/371472 [2:58:07<26:47:43,  3.46it/s]
 10%|█         | 37252/371472 [2:58:07<26:55:23,  3.45it/s]
 10%|█         | 37253/371472 [2:58:07<26:06:11,  3.56it/s]
 10%|█         | 37254/371472 [2:58:08<25:18:21,  3.67it/s]
 10%|█         | 37255/371472 [2:58:08<28:49:18,  3.22it/s]
 10%|█         | 37256/371472 [2:58:08<29:05:12,  3.19it/s]
 10%|█         | 37257/371472 [2:58:09<28:59:43,  3.20it/s]
 10%|█         | 37258/371472 [2:58:09<27:03:23,  3.43it/s]
 10%|█         | 37259/371472 [2:58:09<26:58:54,  3.44it/s]
 10%|█         | 37260/371472 [2:58:10<25:56:46,  3.58it/s]
                                                           
{'loss': 4.4879, 'learning_rate': 9.101628994376091e-07, 'epoch': 1.6}

 10%|█         | 37260/371472 [2:58:10<25:56:46,  3.58it/s]
 10%|█         | 37261/371472 [2:58:10<25:00:23,  3.71it/s]
 10%|█         | 37262/371472 [2:58:10<24:14:27,  3.83it/s]
 10%|█         | 37263/371472 [2:58:10<25:50:22,  3.59it/s]
 10%|█         | 37264/371472 [2:58:11<25:19:25,  3.67it/s]
 10%|█         | 37265/371472 [2:58:11<25:00:46,  3.71it/s]
 10%|█         | 37266/371472 [2:58:11<24:14:07,  3.83it/s]
 10%|█         | 37267/371472 [2:58:11<26:23:44,  3.52it/s]
 10%|█         | 37268/371472 [2:58:12<26:31:40,  3.50it/s]
 10%|█         | 37269/371472 [2:58:12<27:45:34,  3.34it/s]
 10%|█         | 37270/371472 [2:58:12<27:29:56,  3.38it/s]
 10%|█         | 37271/371472 [2:58:13<26:33:22,  3.50it/s]
 10%|█         | 37272/371472 [2:58:13<26:31:51,  3.50it/s]
 10%|█         | 37273/371472 [2:58:13<26:58:20,  3.44it/s]
 10%|█         | 37274/371472 [2:58:13<27:22:47,  3.39it/s]
 10%|█         | 37275/371472 [2:58:14<26:56:02,  3.45it/s]
 10%|█         | 37276/371472 [2:58:14<26:17:26,  3.53it/s]
 10%|█         | 37277/371472 [2:58:14<25:33:47,  3.63it/s]
 10%|█         | 37278/371472 [2:58:15<26:03:07,  3.56it/s]
 10%|█         | 37279/371472 [2:58:15<26:42:03,  3.48it/s]
 10%|█         | 37280/371472 [2:58:15<28:22:01,  3.27it/s]
                                                           
{'loss': 4.4627, 'learning_rate': 9.101144174621302e-07, 'epoch': 1.61}

 10%|█         | 37280/371472 [2:58:15<28:22:01,  3.27it/s]
 10%|█         | 37281/371472 [2:58:16<28:06:10,  3.30it/s]
 10%|█         | 37282/371472 [2:58:16<26:59:16,  3.44it/s]
 10%|█         | 37283/371472 [2:58:16<26:13:11,  3.54it/s]
 10%|█         | 37284/371472 [2:58:16<27:03:37,  3.43it/s]
 10%|█         | 37285/371472 [2:58:17<26:47:39,  3.46it/s]
 10%|█         | 37286/371472 [2:58:17<26:59:45,  3.44it/s]
 10%|█         | 37287/371472 [2:58:17<25:46:49,  3.60it/s]
 10%|█         | 37288/371472 [2:58:17<25:30:11,  3.64it/s]
 10%|█         | 37289/371472 [2:58:18<25:41:51,  3.61it/s]
 10%|█         | 37290/371472 [2:58:18<25:42:14,  3.61it/s]
 10%|█         | 37291/371472 [2:58:18<26:22:23,  3.52it/s]
 10%|█         | 37292/371472 [2:58:19<26:37:28,  3.49it/s]
 10%|█         | 37293/371472 [2:58:19<25:41:22,  3.61it/s]
 10%|█         | 37294/371472 [2:58:19<27:13:14,  3.41it/s]
 10%|█         | 37295/371472 [2:58:19<26:53:55,  3.45it/s]
 10%|█         | 37296/371472 [2:58:20<26:56:39,  3.45it/s]
 10%|█         | 37297/371472 [2:58:20<27:02:29,  3.43it/s]
 10%|█         | 37298/371472 [2:58:20<26:22:53,  3.52it/s]
 10%|█         | 37299/371472 [2:58:21<26:13:31,  3.54it/s]
 10%|█         | 37300/371472 [2:58:21<25:52:12,  3.59it/s]
                                                           
{'loss': 4.3324, 'learning_rate': 9.100659354866512e-07, 'epoch': 1.61}

 10%|█         | 37300/371472 [2:58:21<25:52:12,  3.59it/s]
 10%|█         | 37301/371472 [2:58:21<25:35:23,  3.63it/s]
 10%|█         | 37302/371472 [2:58:21<25:02:57,  3.71it/s]
 10%|█         | 37303/371472 [2:58:22<25:07:03,  3.70it/s]
 10%|█         | 37304/371472 [2:58:22<27:11:15,  3.41it/s]
 10%|█         | 37305/371472 [2:58:22<27:48:48,  3.34it/s]
 10%|█         | 37306/371472 [2:58:23<27:23:53,  3.39it/s]
 10%|█         | 37307/371472 [2:58:23<26:38:46,  3.48it/s]
 10%|█         | 37308/371472 [2:58:23<27:53:55,  3.33it/s]
 10%|█         | 37309/371472 [2:58:24<28:18:36,  3.28it/s]
 10%|█         | 37310/371472 [2:58:24<26:31:07,  3.50it/s]
 10%|█         | 37311/371472 [2:58:24<26:05:55,  3.56it/s]
 10%|█         | 37312/371472 [2:58:24<25:20:34,  3.66it/s]
 10%|█         | 37313/371472 [2:58:25<26:05:14,  3.56it/s]
 10%|█         | 37314/371472 [2:58:25<27:45:37,  3.34it/s]
 10%|█         | 37315/371472 [2:58:25<26:33:53,  3.49it/s]
 10%|█         | 37316/371472 [2:58:26<27:26:30,  3.38it/s]
 10%|█         | 37317/371472 [2:58:26<26:25:11,  3.51it/s]
 10%|█         | 37318/371472 [2:58:26<25:27:27,  3.65it/s]
 10%|█         | 37319/371472 [2:58:26<25:22:39,  3.66it/s]
 10%|█         | 37320/371472 [2:58:27<26:39:27,  3.48it/s]
                                                           
{'loss': 4.345, 'learning_rate': 9.100174535111724e-07, 'epoch': 1.61}

 10%|█         | 37320/371472 [2:58:27<26:39:27,  3.48it/s]
 10%|█         | 37321/371472 [2:58:27<28:22:01,  3.27it/s]
 10%|█         | 37322/371472 [2:58:27<27:19:03,  3.40it/s]
 10%|█         | 37323/371472 [2:58:28<26:40:57,  3.48it/s]
 10%|█         | 37324/371472 [2:58:28<26:22:04,  3.52it/s]
 10%|█         | 37325/371472 [2:58:28<26:04:50,  3.56it/s]
 10%|█         | 37326/371472 [2:58:28<28:03:47,  3.31it/s]
 10%|█         | 37327/371472 [2:58:29<27:00:42,  3.44it/s]
 10%|█         | 37328/371472 [2:58:29<26:44:01,  3.47it/s]
 10%|█         | 37329/371472 [2:58:29<26:27:19,  3.51it/s]
 10%|█         | 37330/371472 [2:58:30<25:56:00,  3.58it/s]
 10%|█         | 37331/371472 [2:58:30<25:30:19,  3.64it/s]
 10%|█         | 37332/371472 [2:58:30<25:42:22,  3.61it/s]
 10%|█         | 37333/371472 [2:58:30<25:07:21,  3.69it/s]
 10%|█         | 37334/371472 [2:58:31<26:04:16,  3.56it/s]
 10%|█         | 37335/371472 [2:58:31<26:12:38,  3.54it/s]
 10%|█         | 37336/371472 [2:58:31<25:45:49,  3.60it/s]
 10%|█         | 37337/371472 [2:58:31<25:48:42,  3.60it/s]
 10%|█         | 37338/371472 [2:58:32<25:33:46,  3.63it/s]
 10%|█         | 37339/371472 [2:58:32<27:15:12,  3.41it/s]
 10%|█         | 37340/371472 [2:58:32<28:35:37,  3.25it/s]
                                                           
{'loss': 4.4219, 'learning_rate': 9.099689715356935e-07, 'epoch': 1.61}

 10%|█         | 37340/371472 [2:58:32<28:35:37,  3.25it/s]
 10%|█         | 37341/371472 [2:58:33<27:24:57,  3.39it/s]
 10%|█         | 37342/371472 [2:58:33<26:30:41,  3.50it/s]
 10%|█         | 37343/371472 [2:58:33<25:43:58,  3.61it/s]
 10%|█         | 37344/371472 [2:58:33<25:12:00,  3.68it/s]
 10%|█         | 37345/371472 [2:58:34<27:50:45,  3.33it/s]
 10%|█         | 37346/371472 [2:58:34<29:37:50,  3.13it/s]
 10%|█         | 37347/371472 [2:58:34<28:01:15,  3.31it/s]
 10%|█         | 37348/371472 [2:58:35<26:41:53,  3.48it/s]
 10%|█         | 37349/371472 [2:58:35<28:06:35,  3.30it/s]
 10%|█         | 37350/371472 [2:58:35<28:03:15,  3.31it/s]
 10%|█         | 37351/371472 [2:58:36<26:41:58,  3.48it/s]
 10%|█         | 37352/371472 [2:58:36<25:52:40,  3.59it/s]
 10%|█         | 37353/371472 [2:58:36<27:14:06,  3.41it/s]
 10%|█         | 37354/371472 [2:58:36<26:47:30,  3.46it/s]
 10%|█         | 37355/371472 [2:58:37<26:35:01,  3.49it/s]
 10%|█         | 37356/371472 [2:58:37<26:03:07,  3.56it/s]
 10%|█         | 37357/371472 [2:58:37<26:02:04,  3.56it/s]
 10%|█         | 37358/371472 [2:58:38<25:44:25,  3.61it/s]
 10%|█         | 37359/371472 [2:58:38<24:46:06,  3.75it/s]
 10%|█         | 37360/371472 [2:58:38<26:22:14,  3.52it/s]
                                                           
{'loss': 4.1766, 'learning_rate': 9.099204895602145e-07, 'epoch': 1.61}

 10%|█         | 37360/371472 [2:58:38<26:22:14,  3.52it/s]
 10%|█         | 37361/371472 [2:58:38<27:35:23,  3.36it/s]
 10%|█         | 37362/371472 [2:58:39<26:49:42,  3.46it/s]
 10%|█         | 37363/371472 [2:58:39<27:07:23,  3.42it/s]
 10%|█         | 37364/371472 [2:58:39<27:00:30,  3.44it/s]
 10%|█         | 37365/371472 [2:58:40<26:24:32,  3.51it/s]
 10%|█         | 37366/371472 [2:58:40<26:36:25,  3.49it/s]
 10%|█         | 37367/371472 [2:58:40<28:04:07,  3.31it/s]
 10%|█         | 37368/371472 [2:58:40<27:31:12,  3.37it/s]
 10%|█         | 37369/371472 [2:58:41<26:59:04,  3.44it/s]
 10%|█         | 37370/371472 [2:58:41<26:40:11,  3.48it/s]
 10%|█         | 37371/371472 [2:58:41<25:47:00,  3.60it/s]
 10%|█         | 37372/371472 [2:58:42<24:59:54,  3.71it/s]
 10%|█         | 37373/371472 [2:58:42<24:34:54,  3.78it/s]
 10%|█         | 37374/371472 [2:58:42<24:45:44,  3.75it/s]
 10%|█         | 37375/371472 [2:58:42<24:35:02,  3.77it/s]
 10%|█         | 37376/371472 [2:58:43<25:46:07,  3.60it/s]
 10%|█         | 37377/371472 [2:58:43<29:13:57,  3.17it/s]
 10%|█         | 37378/371472 [2:58:43<28:15:31,  3.28it/s]
 10%|█         | 37379/371472 [2:58:44<27:22:05,  3.39it/s]
 10%|█         | 37380/371472 [2:58:44<26:31:33,  3.50it/s]
                                                           
{'loss': 4.4342, 'learning_rate': 9.098720075847357e-07, 'epoch': 1.61}

 10%|█         | 37380/371472 [2:58:44<26:31:33,  3.50it/s]
 10%|█         | 37381/371472 [2:58:44<25:56:33,  3.58it/s]
 10%|█         | 37382/371472 [2:58:44<25:20:54,  3.66it/s]
 10%|█         | 37383/371472 [2:58:45<24:54:22,  3.73it/s]
 10%|█         | 37384/371472 [2:58:45<24:32:58,  3.78it/s]
 10%|█         | 37385/371472 [2:58:45<25:17:48,  3.67it/s]
 10%|█         | 37386/371472 [2:58:45<25:08:56,  3.69it/s]
 10%|█         | 37387/371472 [2:58:46<25:27:23,  3.65it/s]
 10%|█         | 37388/371472 [2:58:46<25:51:28,  3.59it/s]
 10%|█         | 37389/371472 [2:58:46<24:55:16,  3.72it/s]
 10%|█         | 37390/371472 [2:58:47<26:26:39,  3.51it/s]
 10%|█         | 37391/371472 [2:58:47<26:54:49,  3.45it/s]
 10%|█         | 37392/371472 [2:58:47<27:26:47,  3.38it/s]
 10%|█         | 37393/371472 [2:58:47<27:20:13,  3.39it/s]
 10%|█         | 37394/371472 [2:58:48<26:19:48,  3.52it/s]
 10%|█         | 37395/371472 [2:58:48<25:39:56,  3.62it/s]
 10%|█         | 37396/371472 [2:58:48<26:11:14,  3.54it/s]
 10%|█         | 37397/371472 [2:58:49<24:50:05,  3.74it/s]
 10%|█         | 37398/371472 [2:58:49<24:39:15,  3.76it/s]
 10%|█         | 37399/371472 [2:58:49<26:42:50,  3.47it/s]
 10%|█         | 37400/371472 [2:58:49<26:25:02,  3.51it/s]
                                                           
{'loss': 4.232, 'learning_rate': 9.098235256092569e-07, 'epoch': 1.61}

 10%|█         | 37400/371472 [2:58:49<26:25:02,  3.51it/s]
 10%|█         | 37401/371472 [2:58:50<29:02:53,  3.19it/s]
 10%|█         | 37402/371472 [2:58:50<27:22:33,  3.39it/s]
 10%|█         | 37403/371472 [2:58:50<31:57:09,  2.90it/s]
 10%|█         | 37404/371472 [2:58:51<31:26:18,  2.95it/s]
 10%|█         | 37405/371472 [2:58:51<29:34:34,  3.14it/s]
 10%|█         | 37406/371472 [2:58:51<31:32:33,  2.94it/s]
 10%|█         | 37407/371472 [2:58:52<28:57:35,  3.20it/s]
 10%|█         | 37408/371472 [2:58:52<28:09:06,  3.30it/s]
 10%|█         | 37409/371472 [2:58:52<28:55:58,  3.21it/s]
 10%|█         | 37410/371472 [2:58:53<28:38:09,  3.24it/s]
 10%|█         | 37411/371472 [2:58:53<27:20:29,  3.39it/s]
 10%|█         | 37412/371472 [2:58:53<28:36:16,  3.24it/s]
 10%|█         | 37413/371472 [2:58:54<27:28:11,  3.38it/s]
 10%|█         | 37414/371472 [2:58:54<26:33:41,  3.49it/s]
 10%|█         | 37415/371472 [2:58:54<25:51:06,  3.59it/s]
 10%|█         | 37416/371472 [2:58:54<26:01:11,  3.57it/s]
 10%|█         | 37417/371472 [2:58:55<26:09:13,  3.55it/s]
 10%|█         | 37418/371472 [2:58:55<25:02:56,  3.70it/s]
 10%|█         | 37419/371472 [2:58:55<25:33:54,  3.63it/s]
 10%|█         | 37420/371472 [2:58:55<25:54:10,  3.58it/s]
                                                           
{'loss': 4.3993, 'learning_rate': 9.097750436337778e-07, 'epoch': 1.61}

 10%|█         | 37420/371472 [2:58:55<25:54:10,  3.58it/s]
 10%|█         | 37421/371472 [2:58:56<25:30:44,  3.64it/s]
 10%|█         | 37422/371472 [2:58:56<25:57:33,  3.57it/s]
 10%|█         | 37423/371472 [2:58:56<26:04:55,  3.56it/s]
 10%|█         | 37424/371472 [2:58:57<25:26:52,  3.65it/s]
 10%|█         | 37425/371472 [2:58:57<25:52:17,  3.59it/s]
 10%|█         | 37426/371472 [2:58:57<26:26:47,  3.51it/s]
 10%|█         | 37427/371472 [2:58:57<26:49:59,  3.46it/s]
 10%|█         | 37428/371472 [2:58:58<27:52:08,  3.33it/s]
 10%|█         | 37429/371472 [2:58:58<26:33:33,  3.49it/s]
 10%|█         | 37430/371472 [2:58:58<27:45:12,  3.34it/s]
 10%|█         | 37431/371472 [2:58:59<27:36:45,  3.36it/s]
 10%|█         | 37432/371472 [2:58:59<26:41:49,  3.48it/s]
 10%|█         | 37433/371472 [2:58:59<29:07:24,  3.19it/s]
 10%|█         | 37434/371472 [2:59:00<28:35:23,  3.25it/s]
 10%|█         | 37435/371472 [2:59:00<28:22:54,  3.27it/s]
 10%|█         | 37436/371472 [2:59:00<27:44:06,  3.35it/s]
 10%|█         | 37437/371472 [2:59:00<26:39:10,  3.48it/s]
 10%|█         | 37438/371472 [2:59:01<26:02:43,  3.56it/s]
 10%|█         | 37439/371472 [2:59:01<27:21:21,  3.39it/s]
 10%|█         | 37440/371472 [2:59:01<30:31:50,  3.04it/s]
                                                           
{'loss': 4.3122, 'learning_rate': 9.097265616582988e-07, 'epoch': 1.61}

 10%|█         | 37440/371472 [2:59:01<30:31:50,  3.04it/s]
 10%|█         | 37441/371472 [2:59:02<29:41:13,  3.13it/s]
 10%|█         | 37442/371472 [2:59:02<27:47:45,  3.34it/s]
 10%|█         | 37443/371472 [2:59:02<27:34:48,  3.36it/s]
 10%|█         | 37444/371472 [2:59:03<26:53:29,  3.45it/s]
 10%|█         | 37445/371472 [2:59:03<26:17:50,  3.53it/s]
 10%|█         | 37446/371472 [2:59:03<25:24:41,  3.65it/s]
 10%|█         | 37447/371472 [2:59:03<25:07:52,  3.69it/s]
 10%|█         | 37448/371472 [2:59:04<26:20:55,  3.52it/s]
 10%|█         | 37449/371472 [2:59:04<25:13:48,  3.68it/s]
 10%|█         | 37450/371472 [2:59:04<27:21:37,  3.39it/s]
 10%|█         | 37451/371472 [2:59:04<25:51:01,  3.59it/s]
 10%|█         | 37452/371472 [2:59:05<28:12:17,  3.29it/s]
 10%|█         | 37453/371472 [2:59:05<28:39:56,  3.24it/s]
 10%|█         | 37454/371472 [2:59:05<27:02:09,  3.43it/s]
 10%|█         | 37455/371472 [2:59:06<26:55:48,  3.45it/s]
 10%|█         | 37456/371472 [2:59:06<26:20:46,  3.52it/s]
 10%|█         | 37457/371472 [2:59:06<26:17:07,  3.53it/s]
 10%|█         | 37458/371472 [2:59:07<27:29:18,  3.38it/s]
 10%|█         | 37459/371472 [2:59:07<27:32:44,  3.37it/s]
 10%|█         | 37460/371472 [2:59:07<26:59:48,  3.44it/s]
                                                           
{'loss': 4.3472, 'learning_rate': 9.096780796828201e-07, 'epoch': 1.61}

 10%|█         | 37460/371472 [2:59:07<26:59:48,  3.44it/s]
 10%|█         | 37461/371472 [2:59:07<27:42:54,  3.35it/s]
 10%|█         | 37462/371472 [2:59:08<26:47:00,  3.46it/s]
 10%|█         | 37463/371472 [2:59:08<26:45:53,  3.47it/s]
 10%|█         | 37464/371472 [2:59:08<26:47:40,  3.46it/s]
 10%|█         | 37465/371472 [2:59:09<26:55:22,  3.45it/s]
 10%|█         | 37466/371472 [2:59:09<26:49:01,  3.46it/s]
 10%|█         | 37467/371472 [2:59:09<27:14:17,  3.41it/s]
 10%|█         | 37468/371472 [2:59:10<30:35:00,  3.03it/s]
 10%|█         | 37469/371472 [2:59:10<28:51:55,  3.21it/s]
 10%|█         | 37470/371472 [2:59:10<27:45:16,  3.34it/s]
 10%|█         | 37471/371472 [2:59:10<26:58:30,  3.44it/s]
 10%|█         | 37472/371472 [2:59:11<31:57:11,  2.90it/s]
 10%|█         | 37473/371472 [2:59:11<30:21:12,  3.06it/s]
 10%|█         | 37474/371472 [2:59:11<29:49:27,  3.11it/s]
 10%|█         | 37475/371472 [2:59:12<28:28:47,  3.26it/s]
 10%|█         | 37476/371472 [2:59:12<27:40:21,  3.35it/s]
 10%|█         | 37477/371472 [2:59:12<27:20:11,  3.39it/s]
 10%|█         | 37478/371472 [2:59:13<27:36:44,  3.36it/s]
 10%|█         | 37479/371472 [2:59:13<28:01:46,  3.31it/s]
 10%|█         | 37480/371472 [2:59:13<28:59:30,  3.20it/s]
                                                           
{'loss': 4.3092, 'learning_rate': 9.096295977073412e-07, 'epoch': 1.61}

 10%|█         | 37480/371472 [2:59:13<28:59:30,  3.20it/s]
 10%|█         | 37481/371472 [2:59:14<27:53:59,  3.33it/s]
 10%|█         | 37482/371472 [2:59:14<27:12:53,  3.41it/s]
 10%|█         | 37483/371472 [2:59:14<27:14:04,  3.41it/s]
 10%|█         | 37484/371472 [2:59:14<26:41:14,  3.48it/s]
 10%|█         | 37485/371472 [2:59:15<26:20:54,  3.52it/s]
 10%|█         | 37486/371472 [2:59:15<25:18:23,  3.67it/s]
 10%|█         | 37487/371472 [2:59:15<25:33:19,  3.63it/s]
 10%|█         | 37488/371472 [2:59:15<25:49:42,  3.59it/s]
 10%|█         | 37489/371472 [2:59:16<25:36:21,  3.62it/s]
 10%|█         | 37490/371472 [2:59:16<24:38:58,  3.76it/s]
 10%|█         | 37491/371472 [2:59:16<24:19:46,  3.81it/s]
 10%|█         | 37492/371472 [2:59:17<26:05:07,  3.56it/s]
 10%|█         | 37493/371472 [2:59:17<25:24:54,  3.65it/s]
 10%|█         | 37494/371472 [2:59:17<26:22:32,  3.52it/s]
 10%|█         | 37495/371472 [2:59:17<25:41:47,  3.61it/s]
 10%|█         | 37496/371472 [2:59:18<25:47:51,  3.60it/s]
 10%|█         | 37497/371472 [2:59:18<24:49:28,  3.74it/s]
 10%|█         | 37498/371472 [2:59:18<25:00:08,  3.71it/s]
 10%|█         | 37499/371472 [2:59:18<25:51:06,  3.59it/s]
 10%|█         | 37500/371472 [2:59:19<26:01:48,  3.56it/s]
                                                           
{'loss': 4.1438, 'learning_rate': 9.095811157318623e-07, 'epoch': 1.62}

 10%|█         | 37500/371472 [2:59:19<26:01:48,  3.56it/s]
 10%|█         | 37501/371472 [2:59:19<26:10:25,  3.54it/s]
 10%|█         | 37502/371472 [2:59:19<27:09:25,  3.42it/s]
 10%|█         | 37503/371472 [2:59:20<26:14:37,  3.53it/s]
 10%|█         | 37504/371472 [2:59:20<25:47:57,  3.60it/s]
 10%|█         | 37505/371472 [2:59:20<26:34:51,  3.49it/s]
 10%|█         | 37506/371472 [2:59:20<27:05:37,  3.42it/s]
 10%|█         | 37507/371472 [2:59:21<29:32:20,  3.14it/s]
 10%|█         | 37508/371472 [2:59:21<28:31:54,  3.25it/s]
 10%|█         | 37509/371472 [2:59:21<28:53:38,  3.21it/s]
 10%|█         | 37510/371472 [2:59:22<27:03:02,  3.43it/s]
 10%|█         | 37511/371472 [2:59:22<28:49:25,  3.22it/s]
 10%|█         | 37512/371472 [2:59:22<27:28:16,  3.38it/s]
 10%|█         | 37513/371472 [2:59:23<25:56:21,  3.58it/s]
 10%|█         | 37514/371472 [2:59:23<27:12:07,  3.41it/s]
 10%|█         | 37515/371472 [2:59:23<26:26:20,  3.51it/s]
 10%|█         | 37516/371472 [2:59:23<25:11:57,  3.68it/s]
 10%|█         | 37517/371472 [2:59:24<25:26:04,  3.65it/s]
 10%|█         | 37518/371472 [2:59:24<26:05:53,  3.55it/s]
 10%|█         | 37519/371472 [2:59:24<26:29:52,  3.50it/s]
 10%|█         | 37520/371472 [2:59:25<26:32:48,  3.49it/s]
                                                           
{'loss': 4.4261, 'learning_rate': 9.095326337563834e-07, 'epoch': 1.62}

 10%|█         | 37520/371472 [2:59:25<26:32:48,  3.49it/s]
 10%|█         | 37521/371472 [2:59:25<26:16:35,  3.53it/s]
 10%|█         | 37522/371472 [2:59:25<25:55:33,  3.58it/s]
 10%|█         | 37523/371472 [2:59:25<28:02:46,  3.31it/s]
 10%|█         | 37524/371472 [2:59:26<27:25:59,  3.38it/s]
 10%|█         | 37525/371472 [2:59:26<29:57:40,  3.10it/s]
 10%|█         | 37526/371472 [2:59:26<28:07:07,  3.30it/s]
 10%|█         | 37527/371472 [2:59:27<27:11:17,  3.41it/s]
 10%|█         | 37528/371472 [2:59:27<26:24:38,  3.51it/s]
 10%|█         | 37529/371472 [2:59:27<26:10:05,  3.54it/s]
 10%|█         | 37530/371472 [2:59:27<25:44:15,  3.60it/s]
 10%|█         | 37531/371472 [2:59:28<25:11:27,  3.68it/s]
 10%|█         | 37532/371472 [2:59:28<24:54:55,  3.72it/s]
 10%|█         | 37533/371472 [2:59:28<26:36:51,  3.49it/s]
 10%|█         | 37534/371472 [2:59:29<26:54:47,  3.45it/s]
 10%|█         | 37535/371472 [2:59:29<26:28:00,  3.50it/s]
 10%|█         | 37536/371472 [2:59:29<26:08:54,  3.55it/s]
 10%|█         | 37537/371472 [2:59:29<25:34:18,  3.63it/s]
 10%|█         | 37538/371472 [2:59:30<25:54:55,  3.58it/s]
 10%|█         | 37539/371472 [2:59:30<27:24:33,  3.38it/s]
 10%|█         | 37540/371472 [2:59:30<27:58:11,  3.32it/s]
                                                           
{'loss': 4.3154, 'learning_rate': 9.094841517809045e-07, 'epoch': 1.62}

 10%|█         | 37540/371472 [2:59:30<27:58:11,  3.32it/s]
 10%|█         | 37541/371472 [2:59:31<28:44:15,  3.23it/s]
 10%|█         | 37542/371472 [2:59:31<26:53:17,  3.45it/s]
 10%|█         | 37543/371472 [2:59:31<26:27:54,  3.50it/s]
 10%|█         | 37544/371472 [2:59:31<25:57:47,  3.57it/s]
 10%|█         | 37545/371472 [2:59:32<26:11:36,  3.54it/s]
 10%|█         | 37546/371472 [2:59:32<25:54:56,  3.58it/s]
 10%|█         | 37547/371472 [2:59:32<25:54:54,  3.58it/s]
 10%|█         | 37548/371472 [2:59:33<27:00:26,  3.43it/s]
 10%|█         | 37549/371472 [2:59:33<26:03:54,  3.56it/s]
 10%|█         | 37550/371472 [2:59:33<26:37:05,  3.48it/s]
 10%|█         | 37551/371472 [2:59:33<25:29:30,  3.64it/s]
 10%|█         | 37552/371472 [2:59:34<26:42:01,  3.47it/s]
 10%|█         | 37553/371472 [2:59:34<28:29:27,  3.26it/s]
 10%|█         | 37554/371472 [2:59:34<28:17:33,  3.28it/s]
 10%|█         | 37555/371472 [2:59:35<27:29:03,  3.37it/s]
 10%|█         | 37556/371472 [2:59:35<28:32:12,  3.25it/s]
 10%|█         | 37557/371472 [2:59:35<28:22:37,  3.27it/s]
 10%|█         | 37558/371472 [2:59:36<27:26:24,  3.38it/s]
 10%|█         | 37559/371472 [2:59:36<25:54:51,  3.58it/s]
 10%|█         | 37560/371472 [2:59:36<26:44:32,  3.47it/s]
                                                           
{'loss': 4.363, 'learning_rate': 9.094356698054256e-07, 'epoch': 1.62}

 10%|█         | 37560/371472 [2:59:36<26:44:32,  3.47it/s]
 10%|█         | 37561/371472 [2:59:36<25:31:50,  3.63it/s]
 10%|█         | 37562/371472 [2:59:37<27:18:06,  3.40it/s]
 10%|█         | 37563/371472 [2:59:37<26:23:03,  3.52it/s]
 10%|█         | 37564/371472 [2:59:37<27:18:03,  3.40it/s]
 10%|█         | 37565/371472 [2:59:38<27:01:35,  3.43it/s]
 10%|█         | 37566/371472 [2:59:38<26:07:49,  3.55it/s]
 10%|█         | 37567/371472 [2:59:38<26:05:06,  3.56it/s]
 10%|█         | 37568/371472 [2:59:38<25:41:53,  3.61it/s]
 10%|█         | 37569/371472 [2:59:39<25:18:24,  3.67it/s]
 10%|█         | 37570/371472 [2:59:39<24:41:05,  3.76it/s]
 10%|█         | 37571/371472 [2:59:39<25:06:00,  3.70it/s]
 10%|█         | 37572/371472 [2:59:39<24:56:29,  3.72it/s]
 10%|█         | 37573/371472 [2:59:40<24:55:13,  3.72it/s]
 10%|█         | 37574/371472 [2:59:40<25:55:59,  3.58it/s]
 10%|█         | 37575/371472 [2:59:40<25:51:43,  3.59it/s]
 10%|█         | 37576/371472 [2:59:41<26:33:00,  3.49it/s]
 10%|█         | 37577/371472 [2:59:41<25:45:51,  3.60it/s]
 10%|█         | 37578/371472 [2:59:41<25:35:30,  3.62it/s]
 10%|█         | 37579/371472 [2:59:41<25:33:28,  3.63it/s]
 10%|█         | 37580/371472 [2:59:42<27:33:18,  3.37it/s]
                                                           
{'loss': 4.2389, 'learning_rate': 9.093871878299467e-07, 'epoch': 1.62}

 10%|█         | 37580/371472 [2:59:42<27:33:18,  3.37it/s]
 10%|█         | 37581/371472 [2:59:42<26:44:30,  3.47it/s]
 10%|█         | 37582/371472 [2:59:42<28:02:25,  3.31it/s]
 10%|█         | 37583/371472 [2:59:43<29:31:12,  3.14it/s]
 10%|█         | 37584/371472 [2:59:43<31:56:07,  2.90it/s]
 10%|█         | 37585/371472 [2:59:43<30:12:16,  3.07it/s]
 10%|█         | 37586/371472 [2:59:44<30:19:30,  3.06it/s]
 10%|█         | 37587/371472 [2:59:44<30:03:21,  3.09it/s]
 10%|█         | 37588/371472 [2:59:44<31:06:39,  2.98it/s]
 10%|█         | 37589/371472 [2:59:45<30:05:34,  3.08it/s]
 10%|█         | 37590/371472 [2:59:45<29:26:41,  3.15it/s]
 10%|█         | 37591/371472 [2:59:45<27:10:43,  3.41it/s]
 10%|█         | 37592/371472 [2:59:46<27:47:12,  3.34it/s]
 10%|█         | 37593/371472 [2:59:46<28:52:22,  3.21it/s]
 10%|█         | 37594/371472 [2:59:46<28:02:40,  3.31it/s]
 10%|█         | 37595/371472 [2:59:46<27:12:01,  3.41it/s]
 10%|█         | 37596/371472 [2:59:47<26:01:42,  3.56it/s]
 10%|█         | 37597/371472 [2:59:47<25:09:26,  3.69it/s]
 10%|█         | 37598/371472 [2:59:47<25:11:55,  3.68it/s]
 10%|█         | 37599/371472 [2:59:48<26:12:06,  3.54it/s]
 10%|█         | 37600/371472 [2:59:48<25:42:48,  3.61it/s]
                                                           
{'loss': 4.3851, 'learning_rate': 9.093387058544678e-07, 'epoch': 1.62}

 10%|█         | 37600/371472 [2:59:48<25:42:48,  3.61it/s]
 10%|█         | 37601/371472 [2:59:48<24:54:46,  3.72it/s]
 10%|█         | 37602/371472 [2:59:48<26:38:02,  3.48it/s]
 10%|█         | 37603/371472 [2:59:49<25:32:41,  3.63it/s]
 10%|█         | 37604/371472 [2:59:49<24:44:42,  3.75it/s]
 10%|█         | 37605/371472 [2:59:49<25:11:00,  3.68it/s]
 10%|█         | 37606/371472 [2:59:49<25:15:12,  3.67it/s]
 10%|█         | 37607/371472 [2:59:50<24:47:46,  3.74it/s]
 10%|█         | 37608/371472 [2:59:50<25:24:15,  3.65it/s]
 10%|█         | 37609/371472 [2:59:50<26:24:58,  3.51it/s]
 10%|█         | 37610/371472 [2:59:51<26:17:51,  3.53it/s]
 10%|█         | 37611/371472 [2:59:51<26:52:48,  3.45it/s]
 10%|█         | 37612/371472 [2:59:51<26:34:41,  3.49it/s]
 10%|█         | 37613/371472 [2:59:51<27:53:45,  3.32it/s]
 10%|█         | 37614/371472 [2:59:52<27:38:50,  3.35it/s]
 10%|█         | 37615/371472 [2:59:52<26:37:26,  3.48it/s]
 10%|█         | 37616/371472 [2:59:52<27:43:06,  3.35it/s]
 10%|█         | 37617/371472 [2:59:53<26:39:21,  3.48it/s]
 10%|█         | 37618/371472 [2:59:53<26:43:02,  3.47it/s]
 10%|█         | 37619/371472 [2:59:53<25:25:42,  3.65it/s]
 10%|█         | 37620/371472 [2:59:54<28:44:54,  3.23it/s]
                                                           
{'loss': 4.4013, 'learning_rate': 9.09290223878989e-07, 'epoch': 1.62}

 10%|█         | 37620/371472 [2:59:54<28:44:54,  3.23it/s]
 10%|█         | 37621/371472 [2:59:54<28:38:04,  3.24it/s]
 10%|█         | 37622/371472 [2:59:54<27:54:14,  3.32it/s]
 10%|█         | 37623/371472 [2:59:55<30:04:04,  3.08it/s]
 10%|█         | 37624/371472 [2:59:55<31:19:50,  2.96it/s]
 10%|█         | 37625/371472 [2:59:55<29:35:21,  3.13it/s]
 10%|█         | 37626/371472 [2:59:56<30:31:07,  3.04it/s]
 10%|█         | 37627/371472 [2:59:56<28:34:27,  3.25it/s]
 10%|█         | 37628/371472 [2:59:56<32:19:28,  2.87it/s]
 10%|█         | 37629/371472 [2:59:57<31:37:47,  2.93it/s]
 10%|█         | 37630/371472 [2:59:57<31:04:43,  2.98it/s]
 10%|█         | 37631/371472 [2:59:57<31:08:00,  2.98it/s]
 10%|█         | 37632/371472 [2:59:57<29:08:13,  3.18it/s]
 10%|█         | 37633/371472 [2:59:58<29:36:18,  3.13it/s]
 10%|█         | 37634/371472 [2:59:58<28:21:48,  3.27it/s]
 10%|█         | 37635/371472 [2:59:58<27:38:38,  3.35it/s]
 10%|█         | 37636/371472 [2:59:59<29:22:22,  3.16it/s]
 10%|█         | 37637/371472 [2:59:59<28:20:06,  3.27it/s]
 10%|█         | 37638/371472 [2:59:59<27:15:08,  3.40it/s]
 10%|█         | 37639/371472 [3:00:00<27:36:41,  3.36it/s]
 10%|█         | 37640/371472 [3:00:00<27:07:42,  3.42it/s]
                                                           
{'loss': 4.3324, 'learning_rate': 9.092417419035101e-07, 'epoch': 1.62}

 10%|█         | 37640/371472 [3:00:00<27:07:42,  3.42it/s]
 10%|█         | 37641/371472 [3:00:00<27:24:49,  3.38it/s]
 10%|█         | 37642/371472 [3:00:00<25:54:44,  3.58it/s]
 10%|█         | 37643/371472 [3:00:01<25:43:34,  3.60it/s]
 10%|█         | 37644/371472 [3:00:01<26:35:09,  3.49it/s]
 10%|█         | 37645/371472 [3:00:01<25:36:24,  3.62it/s]
 10%|█         | 37646/371472 [3:00:01<25:28:00,  3.64it/s]
 10%|█         | 37647/371472 [3:00:02<25:21:57,  3.66it/s]
 10%|█         | 37648/371472 [3:00:02<24:42:45,  3.75it/s]
 10%|█         | 37649/371472 [3:00:02<26:36:49,  3.48it/s]
 10%|█         | 37650/371472 [3:00:03<27:19:53,  3.39it/s]
 10%|█         | 37651/371472 [3:00:03<28:07:06,  3.30it/s]
 10%|█         | 37652/371472 [3:00:03<29:58:05,  3.09it/s]
 10%|█         | 37653/371472 [3:00:04<30:12:22,  3.07it/s]
 10%|█         | 37654/371472 [3:00:04<28:43:39,  3.23it/s]
 10%|█         | 37655/371472 [3:00:04<28:16:47,  3.28it/s]
 10%|█         | 37656/371472 [3:00:05<27:09:04,  3.42it/s]
 10%|█         | 37657/371472 [3:00:05<25:52:26,  3.58it/s]
 10%|█         | 37658/371472 [3:00:05<26:29:57,  3.50it/s]
 10%|█         | 37659/371472 [3:00:05<26:15:05,  3.53it/s]
 10%|█         | 37660/371472 [3:00:06<28:03:15,  3.31it/s]
                                                           
{'loss': 4.373, 'learning_rate': 9.091932599280312e-07, 'epoch': 1.62}

 10%|█         | 37660/371472 [3:00:06<28:03:15,  3.31it/s]
 10%|█         | 37661/371472 [3:00:06<27:06:30,  3.42it/s]
 10%|█         | 37662/371472 [3:00:06<26:00:33,  3.57it/s]
 10%|█         | 37663/371472 [3:00:07<26:08:39,  3.55it/s]
 10%|█         | 37664/371472 [3:00:07<25:53:24,  3.58it/s]
 10%|█         | 37665/371472 [3:00:07<24:43:44,  3.75it/s]
 10%|█         | 37666/371472 [3:00:07<25:17:40,  3.67it/s]
 10%|█         | 37667/371472 [3:00:08<25:48:02,  3.59it/s]
 10%|█         | 37668/371472 [3:00:08<25:46:11,  3.60it/s]
 10%|█         | 37669/371472 [3:00:08<25:40:59,  3.61it/s]
 10%|█         | 37670/371472 [3:00:08<25:42:00,  3.61it/s]
 10%|█         | 37671/371472 [3:00:09<25:03:18,  3.70it/s]
 10%|█         | 37672/371472 [3:00:09<26:39:20,  3.48it/s]
 10%|█         | 37673/371472 [3:00:09<26:36:05,  3.49it/s]
 10%|█         | 37674/371472 [3:00:10<25:48:32,  3.59it/s]
 10%|█         | 37675/371472 [3:00:10<25:17:55,  3.67it/s]
 10%|█         | 37676/371472 [3:00:10<25:16:35,  3.67it/s]
 10%|█         | 37677/371472 [3:00:10<26:07:33,  3.55it/s]
 10%|█         | 37678/371472 [3:00:11<25:55:23,  3.58it/s]
 10%|█         | 37679/371472 [3:00:11<25:24:34,  3.65it/s]
 10%|█         | 37680/371472 [3:00:11<26:18:59,  3.52it/s]
                                                           
{'loss': 4.6259, 'learning_rate': 9.091447779525522e-07, 'epoch': 1.62}

 10%|█         | 37680/371472 [3:00:11<26:18:59,  3.52it/s]
 10%|█         | 37681/371472 [3:00:12<27:45:18,  3.34it/s]
 10%|█         | 37682/371472 [3:00:12<26:36:22,  3.48it/s]
 10%|█         | 37683/371472 [3:00:12<27:50:28,  3.33it/s]
 10%|█         | 37684/371472 [3:00:12<26:23:44,  3.51it/s]
 10%|█         | 37685/371472 [3:00:13<25:35:32,  3.62it/s]
 10%|█         | 37686/371472 [3:00:13<26:15:01,  3.53it/s]
 10%|█         | 37687/371472 [3:00:13<27:04:37,  3.42it/s]
 10%|█         | 37688/371472 [3:00:14<26:19:33,  3.52it/s]
 10%|█         | 37689/371472 [3:00:14<25:44:39,  3.60it/s]
 10%|█         | 37690/371472 [3:00:14<25:15:18,  3.67it/s]
 10%|█         | 37691/371472 [3:00:14<25:08:16,  3.69it/s]
 10%|█         | 37692/371472 [3:00:15<26:04:39,  3.56it/s]
 10%|█         | 37693/371472 [3:00:15<27:41:21,  3.35it/s]
 10%|█         | 37694/371472 [3:00:15<27:17:05,  3.40it/s]
 10%|█         | 37695/371472 [3:00:16<27:22:19,  3.39it/s]
 10%|█         | 37696/371472 [3:00:16<26:29:16,  3.50it/s]
 10%|█         | 37697/371472 [3:00:16<25:43:24,  3.60it/s]
 10%|█         | 37698/371472 [3:00:16<26:18:24,  3.52it/s]
 10%|█         | 37699/371472 [3:00:17<26:02:13,  3.56it/s]
 10%|█         | 37700/371472 [3:00:17<27:04:01,  3.43it/s]
                                                           
{'loss': 4.2269, 'learning_rate': 9.090962959770734e-07, 'epoch': 1.62}

 10%|█         | 37700/371472 [3:00:17<27:04:01,  3.43it/s]
 10%|█         | 37701/371472 [3:00:17<26:51:15,  3.45it/s]
 10%|█         | 37702/371472 [3:00:18<26:12:44,  3.54it/s]
 10%|█         | 37703/371472 [3:00:18<27:27:18,  3.38it/s]
 10%|█         | 37704/371472 [3:00:18<31:07:35,  2.98it/s]
 10%|█         | 37705/371472 [3:00:19<30:33:24,  3.03it/s]
 10%|█         | 37706/371472 [3:00:19<29:04:06,  3.19it/s]
 10%|█         | 37707/371472 [3:00:19<27:55:03,  3.32it/s]
 10%|█         | 37708/371472 [3:00:19<27:16:17,  3.40it/s]
 10%|█         | 37709/371472 [3:00:20<27:42:23,  3.35it/s]
 10%|█         | 37710/371472 [3:00:20<26:23:58,  3.51it/s]
 10%|█         | 37711/371472 [3:00:20<26:18:32,  3.52it/s]
 10%|█         | 37712/371472 [3:00:21<28:09:52,  3.29it/s]
 10%|█         | 37713/371472 [3:00:21<27:37:35,  3.36it/s]
 10%|█         | 37714/371472 [3:00:21<27:19:53,  3.39it/s]
 10%|█         | 37715/371472 [3:00:21<27:34:04,  3.36it/s]
 10%|█         | 37716/371472 [3:00:22<26:18:29,  3.52it/s]
 10%|█         | 37717/371472 [3:00:22<25:38:52,  3.61it/s]
 10%|█         | 37718/371472 [3:00:22<25:58:40,  3.57it/s]
 10%|█         | 37719/371472 [3:00:23<25:05:24,  3.70it/s]
 10%|█         | 37720/371472 [3:00:23<25:51:26,  3.59it/s]
                                                           
{'loss': 4.3219, 'learning_rate': 9.090478140015944e-07, 'epoch': 1.62}

 10%|█         | 37720/371472 [3:00:23<25:51:26,  3.59it/s]
 10%|█         | 37721/371472 [3:00:23<25:48:13,  3.59it/s]
 10%|█         | 37722/371472 [3:00:23<25:31:29,  3.63it/s]
 10%|█         | 37723/371472 [3:00:24<25:02:40,  3.70it/s]
 10%|█         | 37724/371472 [3:00:24<24:35:35,  3.77it/s]
 10%|█         | 37725/371472 [3:00:24<24:17:06,  3.82it/s]
 10%|█         | 37726/371472 [3:00:24<25:20:42,  3.66it/s]
 10%|█         | 37727/371472 [3:00:25<27:52:31,  3.33it/s]
 10%|█         | 37728/371472 [3:00:25<27:32:54,  3.37it/s]
 10%|█         | 37729/371472 [3:00:25<26:48:51,  3.46it/s]
 10%|█         | 37730/371472 [3:00:26<25:45:18,  3.60it/s]
 10%|█         | 37731/371472 [3:00:26<26:05:58,  3.55it/s]
 10%|█         | 37732/371472 [3:00:26<25:58:20,  3.57it/s]
 10%|█         | 37733/371472 [3:00:26<26:56:03,  3.44it/s]
 10%|█         | 37734/371472 [3:00:27<25:49:39,  3.59it/s]
 10%|█         | 37735/371472 [3:00:27<25:08:23,  3.69it/s]
 10%|█         | 37736/371472 [3:00:27<24:53:04,  3.73it/s]
 10%|█         | 37737/371472 [3:00:28<26:08:42,  3.55it/s]
 10%|█         | 37738/371472 [3:00:28<26:30:31,  3.50it/s]
 10%|█         | 37739/371472 [3:00:28<25:09:11,  3.69it/s]
 10%|█         | 37740/371472 [3:00:29<28:44:54,  3.22it/s]
                                                           
{'loss': 4.2986, 'learning_rate': 9.089993320261156e-07, 'epoch': 1.63}

 10%|█         | 37740/371472 [3:00:29<28:44:54,  3.22it/s]
 10%|█         | 37741/371472 [3:00:29<28:56:28,  3.20it/s]
 10%|█         | 37742/371472 [3:00:29<28:16:38,  3.28it/s]
 10%|█         | 37743/371472 [3:00:29<28:43:45,  3.23it/s]
 10%|█         | 37744/371472 [3:00:30<27:36:13,  3.36it/s]
 10%|█         | 37745/371472 [3:00:30<27:04:41,  3.42it/s]
 10%|█         | 37746/371472 [3:00:30<27:28:04,  3.37it/s]
 10%|█         | 37747/371472 [3:00:31<26:42:07,  3.47it/s]
 10%|█         | 37748/371472 [3:00:31<26:04:54,  3.55it/s]
 10%|█         | 37749/371472 [3:00:31<25:49:49,  3.59it/s]
 10%|█         | 37750/371472 [3:00:31<25:40:46,  3.61it/s]
 10%|█         | 37751/371472 [3:00:32<24:50:50,  3.73it/s]
 10%|█         | 37752/371472 [3:00:32<25:38:08,  3.62it/s]
 10%|█         | 37753/371472 [3:00:32<25:06:19,  3.69it/s]
 10%|█         | 37754/371472 [3:00:32<24:59:08,  3.71it/s]
 10%|█         | 37755/371472 [3:00:33<25:16:16,  3.67it/s]
 10%|█         | 37756/371472 [3:00:33<25:17:46,  3.66it/s]
 10%|█         | 37757/371472 [3:00:33<25:06:49,  3.69it/s]
 10%|█         | 37758/371472 [3:00:33<24:18:25,  3.81it/s]
 10%|█         | 37759/371472 [3:00:34<25:23:18,  3.65it/s]
 10%|█         | 37760/371472 [3:00:34<25:52:45,  3.58it/s]
                                                           
{'loss': 4.4416, 'learning_rate': 9.089508500506367e-07, 'epoch': 1.63}

 10%|█         | 37760/371472 [3:00:34<25:52:45,  3.58it/s]
 10%|█         | 37761/371472 [3:00:34<25:32:24,  3.63it/s]
 10%|█         | 37762/371472 [3:00:35<25:17:30,  3.67it/s]
 10%|█         | 37763/371472 [3:00:35<25:02:00,  3.70it/s]
 10%|█         | 37764/371472 [3:00:35<25:47:12,  3.59it/s]
 10%|█         | 37765/371472 [3:00:35<26:16:35,  3.53it/s]
 10%|█         | 37766/371472 [3:00:36<26:35:00,  3.49it/s]
 10%|█         | 37767/371472 [3:00:36<25:16:30,  3.67it/s]
 10%|█         | 37768/371472 [3:00:36<28:03:33,  3.30it/s]
 10%|█         | 37769/371472 [3:00:37<27:01:55,  3.43it/s]
 10%|█         | 37770/371472 [3:00:37<26:26:24,  3.51it/s]
 10%|█         | 37771/371472 [3:00:37<25:23:27,  3.65it/s]
 10%|█         | 37772/371472 [3:00:37<25:16:43,  3.67it/s]
 10%|█         | 37773/371472 [3:00:38<25:04:12,  3.70it/s]
 10%|█         | 37774/371472 [3:00:38<24:21:27,  3.81it/s]
 10%|█         | 37775/371472 [3:00:38<25:05:23,  3.69it/s]
 10%|█         | 37776/371472 [3:00:39<25:12:31,  3.68it/s]
 10%|█         | 37777/371472 [3:00:39<27:05:13,  3.42it/s]
 10%|█         | 37778/371472 [3:00:39<25:46:24,  3.60it/s]
 10%|█         | 37779/371472 [3:00:39<25:39:57,  3.61it/s]
 10%|█         | 37780/371472 [3:00:40<25:12:41,  3.68it/s]
                                                           
{'loss': 4.3954, 'learning_rate': 9.089023680751579e-07, 'epoch': 1.63}

 10%|█         | 37780/371472 [3:00:40<25:12:41,  3.68it/s]
 10%|█         | 37781/371472 [3:00:40<25:22:19,  3.65it/s]
 10%|█         | 37782/371472 [3:00:40<25:41:46,  3.61it/s]
 10%|█         | 37783/371472 [3:00:40<24:55:51,  3.72it/s]
 10%|█         | 37784/371472 [3:00:41<26:16:15,  3.53it/s]
 10%|█         | 37785/371472 [3:00:41<25:42:45,  3.60it/s]
 10%|█         | 37786/371472 [3:00:41<24:58:30,  3.71it/s]
 10%|█         | 37787/371472 [3:00:42<26:49:31,  3.46it/s]
 10%|█         | 37788/371472 [3:00:42<27:59:49,  3.31it/s]
 10%|█         | 37789/371472 [3:00:42<27:00:58,  3.43it/s]
 10%|█         | 37790/371472 [3:00:43<27:12:01,  3.41it/s]
 10%|█         | 37791/371472 [3:00:43<26:35:13,  3.49it/s]
 10%|█         | 37792/371472 [3:00:43<26:36:15,  3.48it/s]
 10%|█         | 37793/371472 [3:00:43<26:30:12,  3.50it/s]
 10%|█         | 37794/371472 [3:00:44<26:12:54,  3.54it/s]
 10%|█         | 37795/371472 [3:00:44<25:39:08,  3.61it/s]
 10%|█         | 37796/371472 [3:00:44<25:55:36,  3.57it/s]
 10%|█         | 37797/371472 [3:00:44<25:17:38,  3.66it/s]
 10%|█         | 37798/371472 [3:00:45<24:51:27,  3.73it/s]
 10%|█         | 37799/371472 [3:00:45<26:40:51,  3.47it/s]
 10%|█         | 37800/371472 [3:00:45<25:36:29,  3.62it/s]
                                                           
{'loss': 4.3065, 'learning_rate': 9.088538860996788e-07, 'epoch': 1.63}

 10%|█         | 37800/371472 [3:00:45<25:36:29,  3.62it/s]
 10%|█         | 37801/371472 [3:00:46<25:37:18,  3.62it/s]
 10%|█         | 37802/371472 [3:00:46<25:47:26,  3.59it/s]
 10%|█         | 37803/371472 [3:00:46<25:16:04,  3.67it/s]
 10%|█         | 37804/371472 [3:00:46<24:47:51,  3.74it/s]
 10%|█         | 37805/371472 [3:00:47<25:01:37,  3.70it/s]
 10%|█         | 37806/371472 [3:00:47<27:17:11,  3.40it/s]
 10%|█         | 37807/371472 [3:00:47<27:20:13,  3.39it/s]
 10%|█         | 37808/371472 [3:00:48<27:20:37,  3.39it/s]
 10%|█         | 37809/371472 [3:00:48<27:44:35,  3.34it/s]
 10%|█         | 37810/371472 [3:00:48<26:38:03,  3.48it/s]
 10%|█         | 37811/371472 [3:00:48<25:49:37,  3.59it/s]
 10%|█         | 37812/371472 [3:00:49<25:43:25,  3.60it/s]
 10%|█         | 37813/371472 [3:00:49<26:08:59,  3.54it/s]
 10%|█         | 37814/371472 [3:00:49<26:12:41,  3.54it/s]
 10%|█         | 37815/371472 [3:00:49<25:23:08,  3.65it/s]
 10%|█         | 37816/371472 [3:00:50<25:16:05,  3.67it/s]
 10%|█         | 37817/371472 [3:00:50<25:11:56,  3.68it/s]
 10%|█         | 37818/371472 [3:00:50<24:32:38,  3.78it/s]
 10%|█         | 37819/371472 [3:00:51<24:44:08,  3.75it/s]
 10%|█         | 37820/371472 [3:00:51<24:53:08,  3.72it/s]
                                                           
{'loss': 4.2826, 'learning_rate': 9.088054041242e-07, 'epoch': 1.63}

 10%|█         | 37820/371472 [3:00:51<24:53:08,  3.72it/s]
 10%|█         | 37821/371472 [3:00:51<26:14:01,  3.53it/s]
 10%|█         | 37822/371472 [3:00:51<26:08:09,  3.55it/s]
 10%|█         | 37823/371472 [3:00:52<26:14:23,  3.53it/s]
 10%|█         | 37824/371472 [3:00:52<25:44:43,  3.60it/s]
 10%|█         | 37825/371472 [3:00:52<25:38:19,  3.61it/s]
 10%|█         | 37826/371472 [3:00:53<26:18:49,  3.52it/s]
 10%|█         | 37827/371472 [3:00:53<25:35:28,  3.62it/s]
 10%|█         | 37828/371472 [3:00:53<27:27:07,  3.38it/s]
 10%|█         | 37829/371472 [3:00:53<26:02:04,  3.56it/s]
 10%|█         | 37830/371472 [3:00:54<25:42:42,  3.60it/s]
 10%|█         | 37831/371472 [3:00:54<26:42:39,  3.47it/s]
 10%|█         | 37832/371472 [3:00:54<28:16:57,  3.28it/s]
 10%|█         | 37833/371472 [3:00:55<28:16:11,  3.28it/s]
 10%|█         | 37834/371472 [3:00:55<27:04:50,  3.42it/s]
 10%|█         | 37835/371472 [3:00:55<27:06:39,  3.42it/s]
 10%|█         | 37836/371472 [3:00:55<26:33:06,  3.49it/s]
 10%|█         | 37837/371472 [3:00:56<25:21:25,  3.65it/s]
 10%|█         | 37838/371472 [3:00:56<25:07:06,  3.69it/s]
 10%|█         | 37839/371472 [3:00:56<27:07:22,  3.42it/s]
 10%|█         | 37840/371472 [3:00:57<27:53:53,  3.32it/s]
                                                           
{'loss': 4.4086, 'learning_rate': 9.087569221487211e-07, 'epoch': 1.63}

 10%|█         | 37840/371472 [3:00:57<27:53:53,  3.32it/s]
 10%|█         | 37841/371472 [3:00:57<27:51:28,  3.33it/s]
 10%|█         | 37842/371472 [3:00:57<26:42:24,  3.47it/s]
 10%|█         | 37843/371472 [3:00:57<26:51:03,  3.45it/s]
 10%|█         | 37844/371472 [3:00:58<25:38:10,  3.61it/s]
 10%|█         | 37845/371472 [3:00:58<25:16:10,  3.67it/s]
 10%|█         | 37846/371472 [3:00:58<26:14:59,  3.53it/s]
 10%|█         | 37847/371472 [3:00:59<25:30:03,  3.63it/s]
 10%|█         | 37848/371472 [3:00:59<25:17:48,  3.66it/s]
 10%|█         | 37849/371472 [3:00:59<26:11:17,  3.54it/s]
 10%|█         | 37850/371472 [3:00:59<25:19:04,  3.66it/s]
 10%|█         | 37851/371472 [3:01:00<26:16:37,  3.53it/s]
 10%|█         | 37852/371472 [3:01:00<25:48:43,  3.59it/s]
 10%|█         | 37853/371472 [3:01:00<27:58:09,  3.31it/s]
 10%|█         | 37854/371472 [3:01:01<27:07:33,  3.42it/s]
 10%|█         | 37855/371472 [3:01:01<29:09:48,  3.18it/s]
 10%|█         | 37856/371472 [3:01:01<27:45:27,  3.34it/s]
 10%|█         | 37857/371472 [3:01:01<26:31:27,  3.49it/s]
 10%|█         | 37858/371472 [3:01:02<26:06:09,  3.55it/s]
 10%|█         | 37859/371472 [3:01:02<25:39:39,  3.61it/s]
 10%|█         | 37860/371472 [3:01:02<25:36:23,  3.62it/s]
                                                           
{'loss': 4.4004, 'learning_rate': 9.087084401732423e-07, 'epoch': 1.63}

 10%|█         | 37860/371472 [3:01:02<25:36:23,  3.62it/s]
 10%|█         | 37861/371472 [3:01:03<26:05:54,  3.55it/s]
 10%|█         | 37862/371472 [3:01:03<25:35:24,  3.62it/s]
 10%|█         | 37863/371472 [3:01:03<25:19:23,  3.66it/s]
 10%|█         | 37864/371472 [3:01:03<26:05:20,  3.55it/s]
 10%|█         | 37865/371472 [3:01:04<25:11:59,  3.68it/s]
 10%|█         | 37866/371472 [3:01:04<24:34:14,  3.77it/s]
 10%|█         | 37867/371472 [3:01:04<24:39:16,  3.76it/s]
 10%|█         | 37868/371472 [3:01:04<24:22:32,  3.80it/s]
 10%|█         | 37869/371472 [3:01:05<24:29:08,  3.78it/s]
 10%|█         | 37870/371472 [3:01:05<24:43:06,  3.75it/s]
 10%|█         | 37871/371472 [3:01:05<24:42:01,  3.75it/s]
 10%|█         | 37872/371472 [3:01:06<26:11:56,  3.54it/s]
 10%|█         | 37873/371472 [3:01:06<26:21:04,  3.52it/s]
 10%|█         | 37874/371472 [3:01:06<25:54:26,  3.58it/s]
 10%|█         | 37875/371472 [3:01:06<24:43:20,  3.75it/s]
 10%|█         | 37876/371472 [3:01:07<24:12:38,  3.83it/s]
 10%|█         | 37877/371472 [3:01:07<25:03:09,  3.70it/s]
 10%|█         | 37878/371472 [3:01:07<25:57:54,  3.57it/s]
 10%|█         | 37879/371472 [3:01:07<25:32:40,  3.63it/s]
 10%|█         | 37880/371472 [3:01:08<25:19:53,  3.66it/s]
                                                           
{'loss': 4.5516, 'learning_rate': 9.086599581977633e-07, 'epoch': 1.63}

 10%|█         | 37880/371472 [3:01:08<25:19:53,  3.66it/s]
 10%|█         | 37881/371472 [3:01:08<25:56:45,  3.57it/s]
 10%|█         | 37882/371472 [3:01:08<26:06:37,  3.55it/s]
 10%|█         | 37883/371472 [3:01:09<25:33:04,  3.63it/s]
 10%|█         | 37884/371472 [3:01:09<25:40:34,  3.61it/s]
 10%|█         | 37885/371472 [3:01:09<27:18:32,  3.39it/s]
 10%|█         | 37886/371472 [3:01:09<26:15:21,  3.53it/s]
 10%|█         | 37887/371472 [3:01:10<25:50:00,  3.59it/s]
 10%|█         | 37888/371472 [3:01:10<29:02:38,  3.19it/s]
 10%|█         | 37889/371472 [3:01:10<27:10:51,  3.41it/s]
 10%|█         | 37890/371472 [3:01:11<26:16:26,  3.53it/s]
 10%|█         | 37891/371472 [3:01:11<25:04:52,  3.69it/s]
 10%|█         | 37892/371472 [3:01:11<25:11:44,  3.68it/s]
 10%|█         | 37893/371472 [3:01:11<25:24:46,  3.65it/s]
 10%|█         | 37894/371472 [3:01:12<27:17:51,  3.39it/s]
 10%|█         | 37895/371472 [3:01:12<27:05:30,  3.42it/s]
 10%|█         | 37896/371472 [3:01:12<28:41:03,  3.23it/s]
 10%|█         | 37897/371472 [3:01:13<29:06:57,  3.18it/s]
 10%|█         | 37898/371472 [3:01:13<28:53:30,  3.21it/s]
 10%|█         | 37899/371472 [3:01:13<28:16:43,  3.28it/s]
 10%|█         | 37900/371472 [3:01:14<27:22:46,  3.38it/s]
                                                           
{'loss': 4.4274, 'learning_rate': 9.086114762222844e-07, 'epoch': 1.63}

 10%|█         | 37900/371472 [3:01:14<27:22:46,  3.38it/s]
 10%|█         | 37901/371472 [3:01:14<26:39:14,  3.48it/s]
 10%|█         | 37902/371472 [3:01:14<26:40:31,  3.47it/s]
 10%|█         | 37903/371472 [3:01:14<25:42:47,  3.60it/s]
 10%|█         | 37904/371472 [3:01:15<26:03:55,  3.55it/s]
 10%|█         | 37905/371472 [3:01:15<25:54:42,  3.58it/s]
 10%|█         | 37906/371472 [3:01:15<27:26:07,  3.38it/s]
 10%|█         | 37907/371472 [3:01:16<26:54:33,  3.44it/s]
 10%|█         | 37908/371472 [3:01:16<27:58:01,  3.31it/s]
 10%|█         | 37909/371472 [3:01:16<26:59:00,  3.43it/s]
 10%|█         | 37910/371472 [3:01:16<27:06:55,  3.42it/s]
 10%|█         | 37911/371472 [3:01:17<28:09:31,  3.29it/s]
 10%|█         | 37912/371472 [3:01:17<27:39:37,  3.35it/s]
 10%|█         | 37913/371472 [3:01:17<26:48:45,  3.46it/s]
 10%|█         | 37914/371472 [3:01:18<25:55:48,  3.57it/s]
 10%|█         | 37915/371472 [3:01:18<26:25:04,  3.51it/s]
 10%|█         | 37916/371472 [3:01:18<26:15:02,  3.53it/s]
 10%|█         | 37917/371472 [3:01:18<25:59:22,  3.57it/s]
 10%|█         | 37918/371472 [3:01:19<25:43:38,  3.60it/s]
 10%|█         | 37919/371472 [3:01:19<26:23:05,  3.51it/s]
 10%|█         | 37920/371472 [3:01:19<27:09:53,  3.41it/s]
                                                           
{'loss': 4.3502, 'learning_rate': 9.085629942468056e-07, 'epoch': 1.63}

 10%|█         | 37920/371472 [3:01:19<27:09:53,  3.41it/s]
 10%|█         | 37921/371472 [3:01:20<26:42:57,  3.47it/s]
 10%|█         | 37922/371472 [3:01:20<26:17:12,  3.52it/s]
 10%|█         | 37923/371472 [3:01:20<26:08:25,  3.54it/s]
 10%|█         | 37924/371472 [3:01:20<25:22:52,  3.65it/s]
 10%|█         | 37925/371472 [3:01:21<26:10:38,  3.54it/s]
 10%|█         | 37926/371472 [3:01:21<25:34:55,  3.62it/s]
 10%|█         | 37927/371472 [3:01:21<25:27:29,  3.64it/s]
 10%|█         | 37928/371472 [3:01:22<25:08:59,  3.68it/s]
 10%|█         | 37929/371472 [3:01:22<26:02:59,  3.56it/s]
 10%|█         | 37930/371472 [3:01:22<29:32:45,  3.14it/s]
 10%|█         | 37931/371472 [3:01:22<27:46:47,  3.34it/s]
 10%|█         | 37932/371472 [3:01:23<26:35:31,  3.48it/s]
 10%|█         | 37933/371472 [3:01:23<25:41:24,  3.61it/s]
 10%|█         | 37934/371472 [3:01:23<25:02:30,  3.70it/s]
 10%|█         | 37935/371472 [3:01:24<25:59:31,  3.56it/s]
 10%|█         | 37936/371472 [3:01:24<25:26:26,  3.64it/s]
 10%|█         | 37937/371472 [3:01:24<26:11:52,  3.54it/s]
 10%|█         | 37938/371472 [3:01:24<25:45:26,  3.60it/s]
 10%|█         | 37939/371472 [3:01:25<25:44:49,  3.60it/s]
 10%|█         | 37940/371472 [3:01:25<24:58:50,  3.71it/s]
                                                           
{'loss': 4.4738, 'learning_rate': 9.085145122713267e-07, 'epoch': 1.63}

 10%|█         | 37940/371472 [3:01:25<24:58:50,  3.71it/s]
 10%|█         | 37941/371472 [3:01:25<26:08:53,  3.54it/s]
 10%|█         | 37942/371472 [3:01:26<27:04:46,  3.42it/s]
 10%|█         | 37943/371472 [3:01:26<26:43:25,  3.47it/s]
 10%|█         | 37944/371472 [3:01:26<26:10:44,  3.54it/s]
 10%|█         | 37945/371472 [3:01:26<25:43:01,  3.60it/s]
 10%|█         | 37946/371472 [3:01:27<25:32:19,  3.63it/s]
 10%|█         | 37947/371472 [3:01:27<26:57:35,  3.44it/s]
 10%|█         | 37948/371472 [3:01:27<26:28:11,  3.50it/s]
 10%|█         | 37949/371472 [3:01:28<26:11:48,  3.54it/s]
 10%|█         | 37950/371472 [3:01:28<25:57:49,  3.57it/s]
 10%|█         | 37951/371472 [3:01:28<26:12:35,  3.53it/s]
 10%|█         | 37952/371472 [3:01:28<26:14:49,  3.53it/s]
 10%|█         | 37953/371472 [3:01:29<25:21:46,  3.65it/s]
 10%|█         | 37954/371472 [3:01:29<25:34:38,  3.62it/s]
 10%|█         | 37955/371472 [3:01:29<24:29:55,  3.78it/s]
 10%|█         | 37956/371472 [3:01:29<25:15:22,  3.67it/s]
 10%|█         | 37957/371472 [3:01:30<25:06:38,  3.69it/s]
 10%|█         | 37958/371472 [3:01:30<24:43:54,  3.75it/s]
 10%|█         | 37959/371472 [3:01:30<27:14:16,  3.40it/s]
 10%|█         | 37960/371472 [3:01:31<26:42:57,  3.47it/s]
                                                           
{'loss': 4.2082, 'learning_rate': 9.084660302958478e-07, 'epoch': 1.64}

 10%|█         | 37960/371472 [3:01:31<26:42:57,  3.47it/s]
 10%|█         | 37961/371472 [3:01:31<28:20:23,  3.27it/s]
 10%|█         | 37962/371472 [3:01:31<26:54:58,  3.44it/s]
 10%|█         | 37963/371472 [3:01:31<25:35:25,  3.62it/s]
 10%|█         | 37964/371472 [3:01:32<25:47:43,  3.59it/s]
 10%|█         | 37965/371472 [3:01:32<25:25:34,  3.64it/s]
 10%|█         | 37966/371472 [3:01:32<24:50:59,  3.73it/s]
 10%|█         | 37967/371472 [3:01:32<24:45:01,  3.74it/s]
 10%|█         | 37968/371472 [3:01:33<26:37:08,  3.48it/s]
 10%|█         | 37969/371472 [3:01:33<26:45:34,  3.46it/s]
 10%|█         | 37970/371472 [3:01:33<25:50:04,  3.59it/s]
 10%|█         | 37971/371472 [3:01:34<25:41:10,  3.61it/s]
 10%|█         | 37972/371472 [3:01:34<25:05:01,  3.69it/s]
 10%|█         | 37973/371472 [3:01:34<25:02:11,  3.70it/s]
 10%|█         | 37974/371472 [3:01:34<24:25:53,  3.79it/s]
 10%|█         | 37975/371472 [3:01:35<24:49:08,  3.73it/s]
 10%|█         | 37976/371472 [3:01:35<24:33:14,  3.77it/s]
 10%|█         | 37977/371472 [3:01:35<24:41:32,  3.75it/s]
 10%|█         | 37978/371472 [3:01:35<24:19:53,  3.81it/s]
 10%|█         | 37979/371472 [3:01:36<24:33:29,  3.77it/s]
 10%|█         | 37980/371472 [3:01:36<24:09:00,  3.84it/s]
                                                           
{'loss': 4.4372, 'learning_rate': 9.084175483203688e-07, 'epoch': 1.64}

 10%|█         | 37980/371472 [3:01:36<24:09:00,  3.84it/s]
 10%|█         | 37981/371472 [3:01:36<24:53:41,  3.72it/s]
 10%|█         | 37982/371472 [3:01:37<24:53:30,  3.72it/s]
 10%|█         | 37983/371472 [3:01:37<28:09:48,  3.29it/s]
 10%|█         | 37984/371472 [3:01:37<27:32:37,  3.36it/s]
 10%|█         | 37985/371472 [3:01:38<27:15:39,  3.40it/s]
 10%|█         | 37986/371472 [3:01:38<26:48:29,  3.46it/s]
 10%|█         | 37987/371472 [3:01:38<26:16:24,  3.53it/s]
 10%|█         | 37988/371472 [3:01:38<26:09:07,  3.54it/s]
 10%|█         | 37989/371472 [3:01:39<27:55:59,  3.32it/s]
 10%|█         | 37990/371472 [3:01:39<27:26:10,  3.38it/s]
 10%|█         | 37991/371472 [3:01:39<27:21:32,  3.39it/s]
 10%|█         | 37992/371472 [3:01:40<26:51:01,  3.45it/s]
 10%|█         | 37993/371472 [3:01:40<26:05:11,  3.55it/s]
 10%|█         | 37994/371472 [3:01:40<25:12:13,  3.68it/s]
 10%|█         | 37995/371472 [3:01:40<26:54:27,  3.44it/s]
 10%|█         | 37996/371472 [3:01:41<26:52:40,  3.45it/s]
 10%|█         | 37997/371472 [3:01:41<27:02:34,  3.43it/s]
 10%|█         | 37998/371472 [3:01:41<26:09:53,  3.54it/s]
 10%|█         | 37999/371472 [3:01:41<25:23:22,  3.65it/s]
 10%|█         | 38000/371472 [3:01:42<25:08:03,  3.69it/s]
                                                           
{'loss': 4.3474, 'learning_rate': 9.0836906634489e-07, 'epoch': 1.64}

 10%|█         | 38000/371472 [3:01:42<25:08:03,  3.69it/s]
 10%|█         | 38001/371472 [3:01:42<25:00:10,  3.70it/s]
 10%|█         | 38002/371472 [3:01:42<24:29:52,  3.78it/s]
 10%|█         | 38003/371472 [3:01:43<24:27:29,  3.79it/s]
 10%|█         | 38004/371472 [3:01:43<24:32:27,  3.77it/s]
 10%|█         | 38005/371472 [3:01:43<24:32:34,  3.77it/s]
 10%|█         | 38006/371472 [3:01:43<26:09:10,  3.54it/s]
 10%|█         | 38007/371472 [3:01:44<24:55:01,  3.72it/s]
 10%|█         | 38008/371472 [3:01:44<24:07:31,  3.84it/s]
 10%|█         | 38009/371472 [3:01:44<26:15:02,  3.53it/s]
 10%|█         | 38010/371472 [3:01:44<25:59:17,  3.56it/s]
 10%|█         | 38011/371472 [3:01:45<25:52:34,  3.58it/s]
 10%|█         | 38012/371472 [3:01:45<25:07:37,  3.69it/s]
 10%|█         | 38013/371472 [3:01:45<25:44:05,  3.60it/s]
 10%|█         | 38014/371472 [3:01:46<25:54:32,  3.58it/s]
 10%|█         | 38015/371472 [3:01:46<25:22:26,  3.65it/s]
 10%|█         | 38016/371472 [3:01:46<24:55:21,  3.72it/s]
 10%|█         | 38017/371472 [3:01:46<26:07:20,  3.55it/s]
 10%|█         | 38018/371472 [3:01:47<26:52:03,  3.45it/s]
 10%|█         | 38019/371472 [3:01:47<26:12:02,  3.54it/s]
 10%|█         | 38020/371472 [3:01:47<25:21:38,  3.65it/s]
                                                           
{'loss': 4.3913, 'learning_rate': 9.08320584369411e-07, 'epoch': 1.64}

 10%|█         | 38020/371472 [3:01:47<25:21:38,  3.65it/s]
 10%|█         | 38021/371472 [3:01:48<25:33:05,  3.63it/s]
 10%|█         | 38022/371472 [3:01:48<25:10:56,  3.68it/s]
 10%|█         | 38023/371472 [3:01:48<25:51:18,  3.58it/s]
 10%|█         | 38024/371472 [3:01:48<26:13:38,  3.53it/s]
 10%|█         | 38025/371472 [3:01:49<26:01:18,  3.56it/s]
 10%|█         | 38026/371472 [3:01:49<25:23:10,  3.65it/s]
 10%|█         | 38027/371472 [3:01:49<24:49:36,  3.73it/s]
 10%|█         | 38028/371472 [3:01:49<26:20:17,  3.52it/s]
 10%|█         | 38029/371472 [3:01:50<26:02:41,  3.56it/s]
 10%|█         | 38030/371472 [3:01:50<27:31:03,  3.37it/s]
 10%|█         | 38031/371472 [3:01:50<29:02:23,  3.19it/s]
 10%|█         | 38032/371472 [3:01:51<29:55:43,  3.09it/s]
 10%|█         | 38033/371472 [3:01:51<28:47:34,  3.22it/s]
 10%|█         | 38034/371472 [3:01:51<27:25:58,  3.38it/s]
 10%|█         | 38035/371472 [3:01:52<26:13:04,  3.53it/s]
 10%|█         | 38036/371472 [3:01:52<28:01:45,  3.30it/s]
 10%|█         | 38037/371472 [3:01:52<26:32:57,  3.49it/s]
 10%|█         | 38038/371472 [3:01:52<25:42:01,  3.60it/s]
 10%|█         | 38039/371472 [3:01:53<25:00:25,  3.70it/s]
 10%|█         | 38040/371472 [3:01:53<25:22:03,  3.65it/s]
                                                           
{'loss': 4.4225, 'learning_rate': 9.082721023939322e-07, 'epoch': 1.64}

 10%|█         | 38040/371472 [3:01:53<25:22:03,  3.65it/s]
 10%|█         | 38041/371472 [3:01:53<25:15:59,  3.67it/s]
 10%|█         | 38042/371472 [3:01:54<25:19:59,  3.66it/s]
 10%|█         | 38043/371472 [3:01:54<25:21:08,  3.65it/s]
 10%|█         | 38044/371472 [3:01:54<25:50:04,  3.59it/s]
 10%|█         | 38045/371472 [3:01:54<27:46:13,  3.34it/s]
 10%|█         | 38046/371472 [3:01:55<27:17:26,  3.39it/s]
 10%|█         | 38047/371472 [3:01:55<26:00:18,  3.56it/s]
 10%|█         | 38048/371472 [3:01:55<25:42:15,  3.60it/s]
 10%|█         | 38049/371472 [3:01:56<25:56:44,  3.57it/s]
 10%|█         | 38050/371472 [3:01:56<26:23:07,  3.51it/s]
 10%|█         | 38051/371472 [3:01:56<29:57:25,  3.09it/s]
 10%|█         | 38052/371472 [3:01:56<28:23:38,  3.26it/s]
 10%|█         | 38053/371472 [3:01:57<27:54:49,  3.32it/s]
 10%|█         | 38054/371472 [3:01:57<28:01:08,  3.31it/s]
 10%|█         | 38055/371472 [3:01:57<26:39:48,  3.47it/s]
 10%|█         | 38056/371472 [3:01:58<26:31:42,  3.49it/s]
 10%|█         | 38057/371472 [3:01:58<26:19:31,  3.52it/s]
 10%|█         | 38058/371472 [3:01:58<26:05:46,  3.55it/s]
 10%|█         | 38059/371472 [3:01:58<26:08:49,  3.54it/s]
 10%|█         | 38060/371472 [3:01:59<24:58:51,  3.71it/s]
                                                           
{'loss': 4.3337, 'learning_rate': 9.082236204184532e-07, 'epoch': 1.64}

 10%|█         | 38060/371472 [3:01:59<24:58:51,  3.71it/s]
 10%|█         | 38061/371472 [3:01:59<24:47:49,  3.73it/s]
 10%|█         | 38062/371472 [3:01:59<25:26:32,  3.64it/s]
 10%|█         | 38063/371472 [3:02:00<26:23:44,  3.51it/s]
 10%|█         | 38064/371472 [3:02:00<27:12:54,  3.40it/s]
 10%|█         | 38065/371472 [3:02:00<27:29:28,  3.37it/s]
 10%|█         | 38066/371472 [3:02:00<27:32:03,  3.36it/s]
 10%|█         | 38067/371472 [3:02:01<27:04:26,  3.42it/s]
 10%|█         | 38068/371472 [3:02:01<26:59:58,  3.43it/s]
 10%|█         | 38069/371472 [3:02:01<26:30:23,  3.49it/s]
 10%|█         | 38070/371472 [3:02:02<25:42:19,  3.60it/s]
 10%|█         | 38071/371472 [3:02:02<25:42:10,  3.60it/s]
 10%|█         | 38072/371472 [3:02:02<25:26:58,  3.64it/s]
 10%|█         | 38073/371472 [3:02:02<25:55:14,  3.57it/s]
 10%|█         | 38074/371472 [3:02:03<26:13:23,  3.53it/s]
 10%|█         | 38075/371472 [3:02:03<25:21:35,  3.65it/s]
 10%|█         | 38076/371472 [3:02:03<26:02:06,  3.56it/s]
 10%|█         | 38077/371472 [3:02:04<25:31:32,  3.63it/s]
 10%|█         | 38078/371472 [3:02:04<24:59:10,  3.71it/s]
 10%|█         | 38079/371472 [3:02:04<25:56:39,  3.57it/s]
 10%|█         | 38080/371472 [3:02:04<25:32:07,  3.63it/s]
                                                           
{'loss': 4.3372, 'learning_rate': 9.081751384429744e-07, 'epoch': 1.64}

 10%|█         | 38080/371472 [3:02:04<25:32:07,  3.63it/s]
 10%|█         | 38081/371472 [3:02:05<25:46:03,  3.59it/s]
 10%|█         | 38082/371472 [3:02:05<24:46:30,  3.74it/s]
 10%|█         | 38083/371472 [3:02:05<24:17:43,  3.81it/s]
 10%|█         | 38084/371472 [3:02:05<24:05:22,  3.84it/s]
 10%|█         | 38085/371472 [3:02:06<23:54:48,  3.87it/s]
 10%|█         | 38086/371472 [3:02:06<25:47:52,  3.59it/s]
 10%|█         | 38087/371472 [3:02:06<25:17:21,  3.66it/s]
 10%|█         | 38088/371472 [3:02:06<25:09:31,  3.68it/s]
 10%|█         | 38089/371472 [3:02:07<25:10:29,  3.68it/s]
 10%|█         | 38090/371472 [3:02:07<24:28:31,  3.78it/s]
 10%|█         | 38091/371472 [3:02:07<27:43:08,  3.34it/s]
 10%|█         | 38092/371472 [3:02:08<26:17:01,  3.52it/s]
 10%|█         | 38093/371472 [3:02:08<25:01:22,  3.70it/s]
 10%|█         | 38094/371472 [3:02:08<27:44:45,  3.34it/s]
 10%|█         | 38095/371472 [3:02:09<27:44:58,  3.34it/s]
 10%|█         | 38096/371472 [3:02:09<27:10:18,  3.41it/s]
 10%|█         | 38097/371472 [3:02:09<26:42:47,  3.47it/s]
 10%|█         | 38098/371472 [3:02:09<27:00:34,  3.43it/s]
 10%|█         | 38099/371472 [3:02:10<26:22:46,  3.51it/s]
 10%|█         | 38100/371472 [3:02:10<25:28:54,  3.63it/s]
                                                           
{'loss': 4.2774, 'learning_rate': 9.081266564674954e-07, 'epoch': 1.64}

 10%|█         | 38100/371472 [3:02:10<25:28:54,  3.63it/s]
 10%|█         | 38101/371472 [3:02:10<25:23:12,  3.65it/s]
 10%|█         | 38102/371472 [3:02:11<27:00:54,  3.43it/s]
 10%|█         | 38103/371472 [3:02:11<26:15:30,  3.53it/s]
 10%|█         | 38104/371472 [3:02:11<25:23:21,  3.65it/s]
 10%|█         | 38105/371472 [3:02:11<25:31:57,  3.63it/s]
 10%|█         | 38106/371472 [3:02:12<25:22:53,  3.65it/s]
 10%|█         | 38107/371472 [3:02:12<26:51:19,  3.45it/s]
 10%|█         | 38108/371472 [3:02:12<26:24:28,  3.51it/s]
 10%|█         | 38109/371472 [3:02:12<26:30:41,  3.49it/s]
 10%|█         | 38110/371472 [3:02:13<26:08:45,  3.54it/s]
 10%|█         | 38111/371472 [3:02:13<26:08:33,  3.54it/s]
 10%|█         | 38112/371472 [3:02:13<25:19:10,  3.66it/s]
 10%|█         | 38113/371472 [3:02:14<26:04:38,  3.55it/s]
 10%|█         | 38114/371472 [3:02:14<27:33:25,  3.36it/s]
 10%|█         | 38115/371472 [3:02:14<27:36:30,  3.35it/s]
 10%|█         | 38116/371472 [3:02:14<27:04:36,  3.42it/s]
 10%|█         | 38117/371472 [3:02:15<26:51:08,  3.45it/s]
 10%|█         | 38118/371472 [3:02:15<26:52:39,  3.45it/s]
 10%|█         | 38119/371472 [3:02:15<28:15:00,  3.28it/s]
 10%|█         | 38120/371472 [3:02:16<28:49:28,  3.21it/s]
                                                           
{'loss': 4.3185, 'learning_rate': 9.080781744920166e-07, 'epoch': 1.64}

 10%|█         | 38120/371472 [3:02:16<28:49:28,  3.21it/s]
 10%|█         | 38121/371472 [3:02:16<27:25:54,  3.38it/s]
 10%|█         | 38122/371472 [3:02:16<26:17:33,  3.52it/s]
 10%|█         | 38123/371472 [3:02:17<26:12:10,  3.53it/s]
 10%|█         | 38124/371472 [3:02:17<26:01:25,  3.56it/s]
 10%|█         | 38125/371472 [3:02:17<25:19:12,  3.66it/s]
 10%|█         | 38126/371472 [3:02:17<25:44:04,  3.60it/s]
 10%|█         | 38127/371472 [3:02:18<26:30:15,  3.49it/s]
 10%|█         | 38128/371472 [3:02:18<25:44:04,  3.60it/s]
 10%|█         | 38129/371472 [3:02:18<25:39:06,  3.61it/s]
 10%|█         | 38130/371472 [3:02:18<25:11:19,  3.68it/s]
 10%|█         | 38131/371472 [3:02:19<25:46:06,  3.59it/s]
 10%|█         | 38132/371472 [3:02:19<25:37:49,  3.61it/s]
 10%|█         | 38133/371472 [3:02:19<25:16:38,  3.66it/s]
 10%|█         | 38134/371472 [3:02:20<27:00:41,  3.43it/s]
 10%|█         | 38135/371472 [3:02:20<25:56:57,  3.57it/s]
 10%|█         | 38136/371472 [3:02:20<26:37:55,  3.48it/s]
 10%|█         | 38137/371472 [3:02:20<26:38:55,  3.47it/s]
 10%|█         | 38138/371472 [3:02:21<26:37:49,  3.48it/s]
 10%|█         | 38139/371472 [3:02:21<26:27:29,  3.50it/s]
 10%|█         | 38140/371472 [3:02:21<25:41:10,  3.60it/s]
                                                           
{'loss': 4.3871, 'learning_rate': 9.080296925165377e-07, 'epoch': 1.64}

 10%|█         | 38140/371472 [3:02:21<25:41:10,  3.60it/s]
 10%|█         | 38141/371472 [3:02:22<26:04:48,  3.55it/s]
 10%|█         | 38142/371472 [3:02:22<25:36:58,  3.61it/s]
 10%|█         | 38143/371472 [3:02:22<25:36:47,  3.61it/s]
 10%|█         | 38144/371472 [3:02:22<26:10:05,  3.54it/s]
 10%|█         | 38145/371472 [3:02:23<25:30:46,  3.63it/s]
 10%|█         | 38146/371472 [3:02:23<26:17:37,  3.52it/s]
 10%|█         | 38147/371472 [3:02:23<26:59:23,  3.43it/s]
 10%|█         | 38148/371472 [3:02:24<25:52:37,  3.58it/s]
 10%|█         | 38149/371472 [3:02:24<26:12:32,  3.53it/s]
 10%|█         | 38150/371472 [3:02:24<26:52:59,  3.44it/s]
 10%|█         | 38151/371472 [3:02:24<25:40:12,  3.61it/s]
 10%|█         | 38152/371472 [3:02:25<25:12:12,  3.67it/s]
 10%|█         | 38153/371472 [3:02:25<24:29:18,  3.78it/s]
 10%|█         | 38154/371472 [3:02:25<25:22:36,  3.65it/s]
 10%|█         | 38155/371472 [3:02:25<25:59:30,  3.56it/s]
 10%|█         | 38156/371472 [3:02:26<27:02:25,  3.42it/s]
 10%|█         | 38157/371472 [3:02:26<27:27:18,  3.37it/s]
 10%|█         | 38158/371472 [3:02:26<27:46:37,  3.33it/s]
 10%|█         | 38159/371472 [3:02:27<30:41:07,  3.02it/s]
 10%|█         | 38160/371472 [3:02:27<28:51:31,  3.21it/s]
                                                           
{'loss': 4.3266, 'learning_rate': 9.079812105410589e-07, 'epoch': 1.64}

 10%|█         | 38160/371472 [3:02:27<28:51:31,  3.21it/s]
 10%|█         | 38161/371472 [3:02:27<27:42:19,  3.34it/s]
 10%|█         | 38162/371472 [3:02:28<26:13:56,  3.53it/s]
 10%|█         | 38163/371472 [3:02:28<26:28:29,  3.50it/s]
 10%|█         | 38164/371472 [3:02:28<26:50:14,  3.45it/s]
 10%|█         | 38165/371472 [3:02:28<26:31:32,  3.49it/s]
 10%|█         | 38166/371472 [3:02:29<28:08:52,  3.29it/s]
 10%|█         | 38167/371472 [3:02:29<28:44:25,  3.22it/s]
 10%|█         | 38168/371472 [3:02:29<28:24:37,  3.26it/s]
 10%|█         | 38169/371472 [3:02:30<26:49:50,  3.45it/s]
 10%|█         | 38170/371472 [3:02:30<26:18:26,  3.52it/s]
 10%|█         | 38171/371472 [3:02:30<25:15:18,  3.67it/s]
 10%|█         | 38172/371472 [3:02:30<24:48:27,  3.73it/s]
 10%|█         | 38173/371472 [3:02:31<24:48:42,  3.73it/s]
 10%|█         | 38174/371472 [3:02:31<24:34:55,  3.77it/s]
 10%|█         | 38175/371472 [3:02:31<25:48:23,  3.59it/s]
 10%|█         | 38176/371472 [3:02:32<26:10:06,  3.54it/s]
 10%|█         | 38177/371472 [3:02:32<26:16:58,  3.52it/s]
 10%|█         | 38178/371472 [3:02:32<26:18:53,  3.52it/s]
 10%|█         | 38179/371472 [3:02:32<26:03:22,  3.55it/s]
 10%|█         | 38180/371472 [3:02:33<25:55:31,  3.57it/s]
                                                           
{'loss': 4.4932, 'learning_rate': 9.079327285655798e-07, 'epoch': 1.64}

 10%|█         | 38180/371472 [3:02:33<25:55:31,  3.57it/s]
 10%|█         | 38181/371472 [3:02:33<25:59:34,  3.56it/s]
 10%|█         | 38182/371472 [3:02:33<26:34:15,  3.48it/s]
 10%|█         | 38183/371472 [3:02:34<26:13:22,  3.53it/s]
 10%|█         | 38184/371472 [3:02:34<26:16:11,  3.52it/s]
 10%|█         | 38185/371472 [3:02:34<26:07:13,  3.54it/s]
 10%|█         | 38186/371472 [3:02:34<25:50:21,  3.58it/s]
 10%|█         | 38187/371472 [3:02:35<26:10:04,  3.54it/s]
 10%|█         | 38188/371472 [3:02:35<26:20:15,  3.52it/s]
 10%|█         | 38189/371472 [3:02:35<25:55:17,  3.57it/s]
 10%|█         | 38190/371472 [3:02:36<25:30:32,  3.63it/s]
 10%|█         | 38191/371472 [3:02:36<26:43:41,  3.46it/s]
 10%|█         | 38192/371472 [3:02:36<25:54:28,  3.57it/s]
 10%|█         | 38193/371472 [3:02:36<25:14:19,  3.67it/s]
 10%|█         | 38194/371472 [3:02:37<25:22:22,  3.65it/s]
 10%|█         | 38195/371472 [3:02:37<25:57:28,  3.57it/s]
 10%|█         | 38196/371472 [3:02:37<25:26:02,  3.64it/s]
 10%|█         | 38197/371472 [3:02:37<25:02:23,  3.70it/s]
 10%|█         | 38198/371472 [3:02:38<25:25:17,  3.64it/s]
 10%|█         | 38199/371472 [3:02:38<24:59:23,  3.70it/s]
 10%|█         | 38200/371472 [3:02:38<26:31:48,  3.49it/s]
                                                           
{'loss': 4.7061, 'learning_rate': 9.07884246590101e-07, 'epoch': 1.65}

 10%|█         | 38200/371472 [3:02:38<26:31:48,  3.49it/s]
 10%|█         | 38201/371472 [3:02:39<25:39:14,  3.61it/s]
 10%|█         | 38202/371472 [3:02:39<26:31:27,  3.49it/s]
 10%|█         | 38203/371472 [3:02:39<28:48:09,  3.21it/s]
 10%|█         | 38204/371472 [3:02:40<28:22:29,  3.26it/s]
 10%|█         | 38205/371472 [3:02:40<29:44:40,  3.11it/s]
 10%|█         | 38206/371472 [3:02:40<28:51:14,  3.21it/s]
 10%|█         | 38207/371472 [3:02:40<27:12:50,  3.40it/s]
 10%|█         | 38208/371472 [3:02:41<26:38:53,  3.47it/s]
 10%|█         | 38209/371472 [3:02:41<27:39:42,  3.35it/s]
 10%|█         | 38210/371472 [3:02:41<27:02:20,  3.42it/s]
 10%|█         | 38211/371472 [3:02:42<26:23:15,  3.51it/s]
 10%|█         | 38212/371472 [3:02:42<27:34:23,  3.36it/s]
 10%|█         | 38213/371472 [3:02:42<27:11:13,  3.40it/s]
 10%|█         | 38214/371472 [3:02:42<26:38:10,  3.48it/s]
 10%|█         | 38215/371472 [3:02:43<27:38:12,  3.35it/s]
 10%|█         | 38216/371472 [3:02:43<27:31:42,  3.36it/s]
 10%|█         | 38217/371472 [3:02:43<27:40:08,  3.35it/s]
 10%|█         | 38218/371472 [3:02:44<26:21:38,  3.51it/s]
 10%|█         | 38219/371472 [3:02:44<25:10:22,  3.68it/s]
 10%|█         | 38220/371472 [3:02:44<24:54:59,  3.72it/s]
                                                           
{'loss': 4.458, 'learning_rate': 9.078357646146221e-07, 'epoch': 1.65}

 10%|█         | 38220/371472 [3:02:44<24:54:59,  3.72it/s]
 10%|█         | 38221/371472 [3:02:44<24:58:36,  3.71it/s]
 10%|█         | 38222/371472 [3:02:45<25:02:48,  3.70it/s]
 10%|█         | 38223/371472 [3:02:45<25:25:05,  3.64it/s]
 10%|█         | 38224/371472 [3:02:45<24:44:23,  3.74it/s]
 10%|█         | 38225/371472 [3:02:46<25:04:23,  3.69it/s]
 10%|█         | 38226/371472 [3:02:46<24:53:20,  3.72it/s]
 10%|█         | 38227/371472 [3:02:46<24:50:45,  3.73it/s]
 10%|█         | 38228/371472 [3:02:46<26:34:40,  3.48it/s]
 10%|█         | 38229/371472 [3:02:47<27:03:43,  3.42it/s]
 10%|█         | 38230/371472 [3:02:47<26:08:50,  3.54it/s]
 10%|█         | 38231/371472 [3:02:47<25:43:41,  3.60it/s]
 10%|█         | 38232/371472 [3:02:47<25:21:43,  3.65it/s]
 10%|█         | 38233/371472 [3:02:48<25:18:11,  3.66it/s]
 10%|█         | 38234/371472 [3:02:48<26:28:02,  3.50it/s]
 10%|█         | 38235/371472 [3:02:48<26:41:58,  3.47it/s]
 10%|█         | 38236/371472 [3:02:49<26:58:12,  3.43it/s]
 10%|█         | 38237/371472 [3:02:49<27:11:56,  3.40it/s]
 10%|█         | 38238/371472 [3:02:49<27:59:36,  3.31it/s]
 10%|█         | 38239/371472 [3:02:50<27:31:03,  3.36it/s]
 10%|█         | 38240/371472 [3:02:50<26:33:37,  3.49it/s]
                                                           
{'loss': 4.3307, 'learning_rate': 9.077872826391433e-07, 'epoch': 1.65}

 10%|█         | 38240/371472 [3:02:50<26:33:37,  3.49it/s]
 10%|█         | 38241/371472 [3:02:50<25:50:01,  3.58it/s]
 10%|█         | 38242/371472 [3:02:50<25:23:04,  3.65it/s]
 10%|█         | 38243/371472 [3:02:51<25:49:55,  3.58it/s]
 10%|█         | 38244/371472 [3:02:51<26:07:46,  3.54it/s]
 10%|█         | 38245/371472 [3:02:51<25:35:27,  3.62it/s]
 10%|█         | 38246/371472 [3:02:51<25:39:28,  3.61it/s]
 10%|█         | 38247/371472 [3:02:52<28:46:05,  3.22it/s]
 10%|█         | 38248/371472 [3:02:52<27:09:54,  3.41it/s]
 10%|█         | 38249/371472 [3:02:52<28:04:17,  3.30it/s]
 10%|█         | 38250/371472 [3:02:53<27:20:23,  3.39it/s]
 10%|█         | 38251/371472 [3:02:53<28:21:17,  3.26it/s]
 10%|█         | 38252/371472 [3:02:53<29:38:14,  3.12it/s]
 10%|█         | 38253/371472 [3:02:54<30:02:57,  3.08it/s]
 10%|█         | 38254/371472 [3:02:54<28:56:11,  3.20it/s]
 10%|█         | 38255/371472 [3:02:54<29:17:27,  3.16it/s]
 10%|█         | 38256/371472 [3:02:55<27:41:21,  3.34it/s]
 10%|█         | 38257/371472 [3:02:55<27:43:01,  3.34it/s]
 10%|█         | 38258/371472 [3:02:55<27:11:24,  3.40it/s]
 10%|█         | 38259/371472 [3:02:55<26:05:35,  3.55it/s]
 10%|█         | 38260/371472 [3:02:56<25:40:15,  3.61it/s]
                                                           
{'loss': 4.1894, 'learning_rate': 9.077388006636643e-07, 'epoch': 1.65}

 10%|█         | 38260/371472 [3:02:56<25:40:15,  3.61it/s]
 10%|█         | 38261/371472 [3:02:56<26:51:44,  3.45it/s]
 10%|█         | 38262/371472 [3:02:56<25:30:43,  3.63it/s]
 10%|█         | 38263/371472 [3:02:57<25:33:31,  3.62it/s]
 10%|█         | 38264/371472 [3:02:57<26:36:02,  3.48it/s]
 10%|█         | 38265/371472 [3:02:57<28:36:59,  3.23it/s]
 10%|█         | 38266/371472 [3:02:58<29:23:01,  3.15it/s]
 10%|█         | 38267/371472 [3:02:58<27:59:59,  3.31it/s]
 10%|█         | 38268/371472 [3:02:58<27:52:29,  3.32it/s]
 10%|█         | 38269/371472 [3:02:58<26:45:38,  3.46it/s]
 10%|█         | 38270/371472 [3:02:59<26:24:20,  3.51it/s]
 10%|█         | 38271/371472 [3:02:59<26:34:00,  3.48it/s]
 10%|█         | 38272/371472 [3:02:59<28:30:44,  3.25it/s]
 10%|█         | 38273/371472 [3:03:00<27:11:59,  3.40it/s]
 10%|█         | 38274/371472 [3:03:00<26:05:15,  3.55it/s]
 10%|█         | 38275/371472 [3:03:00<26:05:31,  3.55it/s]
 10%|█         | 38276/371472 [3:03:00<26:35:06,  3.48it/s]
 10%|█         | 38277/371472 [3:03:01<26:04:20,  3.55it/s]
 10%|█         | 38278/371472 [3:03:01<27:54:19,  3.32it/s]
 10%|█         | 38279/371472 [3:03:01<27:00:37,  3.43it/s]
 10%|█         | 38280/371472 [3:03:02<26:11:18,  3.53it/s]
                                                           
{'loss': 4.2687, 'learning_rate': 9.076903186881855e-07, 'epoch': 1.65}

 10%|█         | 38280/371472 [3:03:02<26:11:18,  3.53it/s]
 10%|█         | 38281/371472 [3:03:02<25:41:02,  3.60it/s]
 10%|█         | 38282/371472 [3:03:02<27:07:01,  3.41it/s]
 10%|█         | 38283/371472 [3:03:02<25:41:42,  3.60it/s]
 10%|█         | 38284/371472 [3:03:03<24:55:29,  3.71it/s]
 10%|█         | 38285/371472 [3:03:03<25:21:20,  3.65it/s]
 10%|█         | 38286/371472 [3:03:03<26:38:38,  3.47it/s]
 10%|█         | 38287/371472 [3:03:04<26:15:22,  3.52it/s]
 10%|█         | 38288/371472 [3:03:04<27:09:38,  3.41it/s]
 10%|█         | 38289/371472 [3:03:04<28:09:58,  3.29it/s]
 10%|█         | 38290/371472 [3:03:05<29:15:10,  3.16it/s]
 10%|█         | 38291/371472 [3:03:05<29:41:28,  3.12it/s]
 10%|█         | 38292/371472 [3:03:05<28:39:45,  3.23it/s]
 10%|█         | 38293/371472 [3:03:05<28:16:29,  3.27it/s]
 10%|█         | 38294/371472 [3:03:06<27:45:32,  3.33it/s]
 10%|█         | 38295/371472 [3:03:06<27:38:30,  3.35it/s]
 10%|█         | 38296/371472 [3:03:06<27:06:19,  3.41it/s]
 10%|█         | 38297/371472 [3:03:07<26:23:47,  3.51it/s]
 10%|█         | 38298/371472 [3:03:07<27:37:47,  3.35it/s]
 10%|█         | 38299/371472 [3:03:07<26:54:27,  3.44it/s]
 10%|█         | 38300/371472 [3:03:07<25:58:14,  3.56it/s]
                                                           
{'loss': 4.4671, 'learning_rate': 9.076418367127066e-07, 'epoch': 1.65}

 10%|█         | 38300/371472 [3:03:07<25:58:14,  3.56it/s]
 10%|█         | 38301/371472 [3:03:08<26:50:39,  3.45it/s]
 10%|█         | 38302/371472 [3:03:08<26:17:39,  3.52it/s]
 10%|█         | 38303/371472 [3:03:08<27:01:20,  3.42it/s]
 10%|█         | 38304/371472 [3:03:09<26:06:36,  3.54it/s]
 10%|█         | 38305/371472 [3:03:09<25:43:42,  3.60it/s]
 10%|█         | 38306/371472 [3:03:09<25:10:24,  3.68it/s]
 10%|█         | 38307/371472 [3:03:09<25:14:47,  3.67it/s]
 10%|█         | 38308/371472 [3:03:10<25:50:13,  3.58it/s]
 10%|█         | 38309/371472 [3:03:10<26:57:07,  3.43it/s]
 10%|█         | 38310/371472 [3:03:10<26:35:53,  3.48it/s]
 10%|█         | 38311/371472 [3:03:11<25:46:30,  3.59it/s]
 10%|█         | 38312/371472 [3:03:11<26:18:43,  3.52it/s]
 10%|█         | 38313/371472 [3:03:11<25:32:35,  3.62it/s]
 10%|█         | 38314/371472 [3:03:11<27:08:59,  3.41it/s]
 10%|█         | 38315/371472 [3:03:12<25:46:51,  3.59it/s]
 10%|█         | 38316/371472 [3:03:12<26:04:13,  3.55it/s]
 10%|█         | 38317/371472 [3:03:12<25:04:38,  3.69it/s]
 10%|█         | 38318/371472 [3:03:12<25:18:02,  3.66it/s]
 10%|█         | 38319/371472 [3:03:13<25:47:32,  3.59it/s]
 10%|█         | 38320/371472 [3:03:13<25:45:01,  3.59it/s]
                                                           
{'loss': 4.4285, 'learning_rate': 9.075933547372277e-07, 'epoch': 1.65}

 10%|█         | 38320/371472 [3:03:13<25:45:01,  3.59it/s]
 10%|█         | 38321/371472 [3:03:13<25:15:22,  3.66it/s]
 10%|█         | 38322/371472 [3:03:14<24:26:27,  3.79it/s]
 10%|█         | 38323/371472 [3:03:14<24:47:08,  3.73it/s]
 10%|█         | 38324/371472 [3:03:14<26:17:40,  3.52it/s]
 10%|█         | 38325/371472 [3:03:14<27:37:00,  3.35it/s]
 10%|█         | 38326/371472 [3:03:15<28:27:08,  3.25it/s]
 10%|█         | 38327/371472 [3:03:15<28:23:25,  3.26it/s]
 10%|█         | 38328/371472 [3:03:15<27:43:59,  3.34it/s]
 10%|█         | 38329/371472 [3:03:16<28:01:08,  3.30it/s]
 10%|█         | 38330/371472 [3:03:16<28:58:04,  3.19it/s]
 10%|█         | 38331/371472 [3:03:16<28:02:12,  3.30it/s]
 10%|█         | 38332/371472 [3:03:17<27:08:59,  3.41it/s]
 10%|█         | 38333/371472 [3:03:17<27:03:41,  3.42it/s]
 10%|█         | 38334/371472 [3:03:17<26:05:12,  3.55it/s]
 10%|█         | 38335/371472 [3:03:17<25:13:57,  3.67it/s]
 10%|█         | 38336/371472 [3:03:18<24:46:24,  3.74it/s]
 10%|█         | 38337/371472 [3:03:18<24:06:00,  3.84it/s]
 10%|█         | 38338/371472 [3:03:18<24:09:25,  3.83it/s]
 10%|█         | 38339/371472 [3:03:18<25:00:14,  3.70it/s]
 10%|█         | 38340/371472 [3:03:19<25:55:02,  3.57it/s]
                                                           
{'loss': 4.4103, 'learning_rate': 9.075448727617487e-07, 'epoch': 1.65}

 10%|█         | 38340/371472 [3:03:19<25:55:02,  3.57it/s]
 10%|█         | 38341/371472 [3:03:19<26:47:08,  3.45it/s]
 10%|█         | 38342/371472 [3:03:19<25:53:59,  3.57it/s]
 10%|█         | 38343/371472 [3:03:20<27:03:39,  3.42it/s]
 10%|█         | 38344/371472 [3:03:20<27:14:57,  3.40it/s]
 10%|█         | 38345/371472 [3:03:20<27:49:32,  3.33it/s]
 10%|█         | 38346/371472 [3:03:21<27:13:43,  3.40it/s]
 10%|█         | 38347/371472 [3:03:21<27:57:45,  3.31it/s]
 10%|█         | 38348/371472 [3:03:21<26:52:14,  3.44it/s]
 10%|█         | 38349/371472 [3:03:21<25:53:07,  3.57it/s]
 10%|█         | 38350/371472 [3:03:22<25:19:42,  3.65it/s]
 10%|█         | 38351/371472 [3:03:22<25:06:18,  3.69it/s]
 10%|█         | 38352/371472 [3:03:22<26:41:59,  3.47it/s]
 10%|█         | 38353/371472 [3:03:22<26:17:34,  3.52it/s]
 10%|█         | 38354/371472 [3:03:23<25:41:01,  3.60it/s]
 10%|█         | 38355/371472 [3:03:23<25:15:46,  3.66it/s]
 10%|█         | 38356/371472 [3:03:23<25:28:14,  3.63it/s]
 10%|█         | 38357/371472 [3:03:24<24:32:29,  3.77it/s]
 10%|█         | 38358/371472 [3:03:24<24:27:55,  3.78it/s]
 10%|█         | 38359/371472 [3:03:24<25:00:49,  3.70it/s]
 10%|█         | 38360/371472 [3:03:24<24:18:14,  3.81it/s]
                                                           
{'loss': 4.4297, 'learning_rate': 9.074963907862699e-07, 'epoch': 1.65}

 10%|█         | 38360/371472 [3:03:24<24:18:14,  3.81it/s]
 10%|█         | 38361/371472 [3:03:25<24:44:57,  3.74it/s]
 10%|█         | 38362/371472 [3:03:25<24:44:48,  3.74it/s]
 10%|█         | 38363/371472 [3:03:25<29:41:19,  3.12it/s]
 10%|█         | 38364/371472 [3:03:26<27:47:36,  3.33it/s]
 10%|█         | 38365/371472 [3:03:26<26:05:43,  3.55it/s]
 10%|█         | 38366/371472 [3:03:26<25:56:27,  3.57it/s]
 10%|█         | 38367/371472 [3:03:26<27:04:58,  3.42it/s]
 10%|█         | 38368/371472 [3:03:27<26:18:59,  3.52it/s]
 10%|█         | 38369/371472 [3:03:27<26:21:03,  3.51it/s]
 10%|█         | 38370/371472 [3:03:27<25:10:25,  3.68it/s]
 10%|█         | 38371/371472 [3:03:27<24:21:49,  3.80it/s]
 10%|█         | 38372/371472 [3:03:28<25:21:50,  3.65it/s]
 10%|█         | 38373/371472 [3:03:28<25:31:21,  3.63it/s]
 10%|█         | 38374/371472 [3:03:28<26:26:54,  3.50it/s]
 10%|█         | 38375/371472 [3:03:29<28:03:07,  3.30it/s]
 10%|█         | 38376/371472 [3:03:29<27:42:42,  3.34it/s]
 10%|█         | 38377/371472 [3:03:29<28:23:16,  3.26it/s]
 10%|█         | 38378/371472 [3:03:30<28:14:00,  3.28it/s]
 10%|█         | 38379/371472 [3:03:30<27:53:05,  3.32it/s]
 10%|█         | 38380/371472 [3:03:30<27:11:46,  3.40it/s]
                                                           
{'loss': 4.5008, 'learning_rate': 9.074479088107909e-07, 'epoch': 1.65}

 10%|█         | 38380/371472 [3:03:30<27:11:46,  3.40it/s]
 10%|█         | 38381/371472 [3:03:30<27:47:14,  3.33it/s]
 10%|█         | 38382/371472 [3:03:31<28:04:52,  3.29it/s]
 10%|█         | 38383/371472 [3:03:31<28:24:23,  3.26it/s]
 10%|█         | 38384/371472 [3:03:32<31:08:33,  2.97it/s]
 10%|█         | 38385/371472 [3:03:32<29:11:17,  3.17it/s]
 10%|█         | 38386/371472 [3:03:32<29:26:05,  3.14it/s]
 10%|█         | 38387/371472 [3:03:32<27:55:30,  3.31it/s]
 10%|█         | 38388/371472 [3:03:33<28:33:02,  3.24it/s]
 10%|█         | 38389/371472 [3:03:33<27:50:48,  3.32it/s]
 10%|█         | 38390/371472 [3:03:33<27:44:58,  3.33it/s]
 10%|█         | 38391/371472 [3:03:34<31:46:19,  2.91it/s]
 10%|█         | 38392/371472 [3:03:34<30:21:04,  3.05it/s]
 10%|█         | 38393/371472 [3:03:34<28:47:12,  3.21it/s]
 10%|█         | 38394/371472 [3:03:35<29:28:32,  3.14it/s]
 10%|█         | 38395/371472 [3:03:35<27:58:11,  3.31it/s]
 10%|█         | 38396/371472 [3:03:35<26:46:21,  3.46it/s]
 10%|█         | 38397/371472 [3:03:35<26:01:10,  3.56it/s]
 10%|█         | 38398/371472 [3:03:36<25:40:55,  3.60it/s]
 10%|█         | 38399/371472 [3:03:36<25:02:57,  3.69it/s]
 10%|█         | 38400/371472 [3:03:36<24:38:10,  3.76it/s]
                                                           
{'loss': 4.2244, 'learning_rate': 9.073994268353122e-07, 'epoch': 1.65}

 10%|█         | 38400/371472 [3:03:36<24:38:10,  3.76it/s]
 10%|█         | 38401/371472 [3:03:36<25:30:17,  3.63it/s]
 10%|█         | 38402/371472 [3:03:37<24:50:03,  3.73it/s]
 10%|█         | 38403/371472 [3:03:37<24:42:42,  3.74it/s]
 10%|█         | 38404/371472 [3:03:37<24:41:51,  3.75it/s]
 10%|█         | 38405/371472 [3:03:38<36:28:35,  2.54it/s]
 10%|█         | 38406/371472 [3:03:38<33:30:11,  2.76it/s]
 10%|█         | 38407/371472 [3:03:39<31:06:32,  2.97it/s]
 10%|█         | 38408/371472 [3:03:39<28:45:32,  3.22it/s]
 10%|█         | 38409/371472 [3:03:39<26:53:15,  3.44it/s]
 10%|█         | 38410/371472 [3:03:39<27:25:42,  3.37it/s]
 10%|█         | 38411/371472 [3:03:40<27:11:54,  3.40it/s]
 10%|█         | 38412/371472 [3:03:40<27:05:48,  3.41it/s]
 10%|█         | 38413/371472 [3:03:40<26:23:50,  3.50it/s]
 10%|█         | 38414/371472 [3:03:40<25:52:43,  3.58it/s]
 10%|█         | 38415/371472 [3:03:41<27:10:58,  3.40it/s]
 10%|█         | 38416/371472 [3:03:41<28:35:04,  3.24it/s]
 10%|█         | 38417/371472 [3:03:41<28:50:08,  3.21it/s]
 10%|█         | 38418/371472 [3:03:42<28:31:08,  3.24it/s]
 10%|█         | 38419/371472 [3:03:42<27:55:05,  3.31it/s]
 10%|█         | 38420/371472 [3:03:42<29:13:01,  3.17it/s]
                                                           
{'loss': 4.4952, 'learning_rate': 9.073509448598332e-07, 'epoch': 1.65}

 10%|█         | 38420/371472 [3:03:42<29:13:01,  3.17it/s]
 10%|█         | 38421/371472 [3:03:43<29:14:55,  3.16it/s]
 10%|█         | 38422/371472 [3:03:43<27:50:15,  3.32it/s]
 10%|█         | 38423/371472 [3:03:43<26:52:13,  3.44it/s]
 10%|█         | 38424/371472 [3:03:43<26:13:19,  3.53it/s]
 10%|█         | 38425/371472 [3:03:44<26:15:01,  3.52it/s]
 10%|█         | 38426/371472 [3:03:44<25:34:38,  3.62it/s]
 10%|█         | 38427/371472 [3:03:44<26:14:56,  3.52it/s]
 10%|█         | 38428/371472 [3:03:45<26:59:06,  3.43it/s]
 10%|█         | 38429/371472 [3:03:45<27:17:42,  3.39it/s]
 10%|█         | 38430/371472 [3:03:45<26:05:17,  3.55it/s]
 10%|█         | 38431/371472 [3:03:45<27:16:09,  3.39it/s]
 10%|█         | 38432/371472 [3:03:46<25:45:48,  3.59it/s]
 10%|█         | 38433/371472 [3:03:46<26:12:20,  3.53it/s]
 10%|█         | 38434/371472 [3:03:46<25:53:43,  3.57it/s]
 10%|█         | 38435/371472 [3:03:47<26:17:30,  3.52it/s]
 10%|█         | 38436/371472 [3:03:47<27:00:36,  3.43it/s]
 10%|█         | 38437/371472 [3:03:47<26:25:24,  3.50it/s]
 10%|█         | 38438/371472 [3:03:47<26:21:35,  3.51it/s]
 10%|█         | 38439/371472 [3:03:48<26:18:27,  3.52it/s]
 10%|█         | 38440/371472 [3:03:48<25:29:22,  3.63it/s]
                                                           
{'loss': 4.5604, 'learning_rate': 9.073024628843542e-07, 'epoch': 1.66}

 10%|█         | 38440/371472 [3:03:48<25:29:22,  3.63it/s]
 10%|█         | 38441/371472 [3:03:48<27:04:24,  3.42it/s]
 10%|█         | 38442/371472 [3:03:49<26:54:06,  3.44it/s]
 10%|█         | 38443/371472 [3:03:49<26:47:34,  3.45it/s]
 10%|█         | 38444/371472 [3:03:49<26:23:04,  3.51it/s]
 10%|█         | 38445/371472 [3:03:49<25:59:23,  3.56it/s]
 10%|█         | 38446/371472 [3:03:50<25:49:32,  3.58it/s]
 10%|█         | 38447/371472 [3:03:50<26:13:51,  3.53it/s]
 10%|█         | 38448/371472 [3:03:50<26:15:27,  3.52it/s]
 10%|█         | 38449/371472 [3:03:51<25:23:42,  3.64it/s]
 10%|█         | 38450/371472 [3:03:51<25:19:55,  3.65it/s]
 10%|█         | 38451/371472 [3:03:51<25:12:52,  3.67it/s]
 10%|█         | 38452/371472 [3:03:51<26:11:03,  3.53it/s]
 10%|█         | 38453/371472 [3:03:52<27:59:01,  3.31it/s]
 10%|█         | 38454/371472 [3:03:52<27:00:08,  3.43it/s]
 10%|█         | 38455/371472 [3:03:52<26:49:58,  3.45it/s]
 10%|█         | 38456/371472 [3:03:53<26:31:44,  3.49it/s]
 10%|█         | 38457/371472 [3:03:53<26:27:39,  3.50it/s]
 10%|█         | 38458/371472 [3:03:53<26:00:10,  3.56it/s]
 10%|█         | 38459/371472 [3:03:53<27:00:10,  3.43it/s]
 10%|█         | 38460/371472 [3:03:54<26:18:55,  3.52it/s]
                                                           
{'loss': 4.4206, 'learning_rate': 9.072539809088754e-07, 'epoch': 1.66}

 10%|█         | 38460/371472 [3:03:54<26:18:55,  3.52it/s]
 10%|█         | 38461/371472 [3:03:54<27:46:25,  3.33it/s]
 10%|█         | 38462/371472 [3:03:54<27:28:50,  3.37it/s]
 10%|█         | 38463/371472 [3:03:55<28:38:12,  3.23it/s]
 10%|█         | 38464/371472 [3:03:55<27:34:16,  3.36it/s]
 10%|█         | 38465/371472 [3:03:55<26:50:07,  3.45it/s]
 10%|█         | 38466/371472 [3:03:56<28:35:53,  3.23it/s]
 10%|█         | 38467/371472 [3:03:56<27:18:14,  3.39it/s]
 10%|█         | 38468/371472 [3:03:56<27:14:10,  3.40it/s]
 10%|█         | 38469/371472 [3:03:56<26:30:40,  3.49it/s]
 10%|█         | 38470/371472 [3:03:57<25:44:45,  3.59it/s]
 10%|█         | 38471/371472 [3:03:57<25:25:41,  3.64it/s]
 10%|█         | 38472/371472 [3:03:57<24:48:15,  3.73it/s]
 10%|█         | 38473/371472 [3:03:57<24:50:21,  3.72it/s]
 10%|█         | 38474/371472 [3:03:58<25:53:05,  3.57it/s]
 10%|█         | 38475/371472 [3:03:58<25:41:35,  3.60it/s]
 10%|█         | 38476/371472 [3:03:58<25:20:16,  3.65it/s]
 10%|█         | 38477/371472 [3:03:59<25:37:18,  3.61it/s]
 10%|█         | 38478/371472 [3:03:59<26:26:22,  3.50it/s]
 10%|█         | 38479/371472 [3:03:59<26:48:31,  3.45it/s]
 10%|█         | 38480/371472 [3:04:00<27:25:18,  3.37it/s]
                                                           
{'loss': 4.3534, 'learning_rate': 9.072054989333966e-07, 'epoch': 1.66}

 10%|█         | 38480/371472 [3:04:00<27:25:18,  3.37it/s]
 10%|█         | 38481/371472 [3:04:00<29:52:23,  3.10it/s]
 10%|█         | 38482/371472 [3:04:00<28:11:44,  3.28it/s]
 10%|█         | 38483/371472 [3:04:00<27:23:29,  3.38it/s]
 10%|█         | 38484/371472 [3:04:01<27:45:58,  3.33it/s]
 10%|█         | 38485/371472 [3:04:01<26:12:02,  3.53it/s]
 10%|█         | 38486/371472 [3:04:01<25:24:19,  3.64it/s]
 10%|█         | 38487/371472 [3:04:02<25:05:45,  3.69it/s]
 10%|█         | 38488/371472 [3:04:02<25:20:49,  3.65it/s]
 10%|█         | 38489/371472 [3:04:02<24:42:16,  3.74it/s]
 10%|█         | 38490/371472 [3:04:02<24:32:11,  3.77it/s]
 10%|█         | 38491/371472 [3:04:03<25:08:53,  3.68it/s]
 10%|█         | 38492/371472 [3:04:03<24:50:05,  3.72it/s]
 10%|█         | 38493/371472 [3:04:03<26:04:33,  3.55it/s]
 10%|█         | 38494/371472 [3:04:03<25:06:09,  3.68it/s]
 10%|█         | 38495/371472 [3:04:04<26:48:03,  3.45it/s]
 10%|█         | 38496/371472 [3:04:04<25:58:24,  3.56it/s]
 10%|█         | 38497/371472 [3:04:04<25:30:24,  3.63it/s]
 10%|█         | 38498/371472 [3:04:05<26:20:40,  3.51it/s]
 10%|█         | 38499/371472 [3:04:05<26:27:02,  3.50it/s]
 10%|█         | 38500/371472 [3:04:05<27:26:37,  3.37it/s]
                                                           
{'loss': 4.4252, 'learning_rate': 9.071570169579176e-07, 'epoch': 1.66}

 10%|█         | 38500/371472 [3:04:05<27:26:37,  3.37it/s]
 10%|█         | 38501/371472 [3:04:05<26:33:25,  3.48it/s]
 10%|█         | 38502/371472 [3:04:06<25:36:50,  3.61it/s]
 10%|█         | 38503/371472 [3:04:06<25:39:50,  3.60it/s]
 10%|█         | 38504/371472 [3:04:06<25:44:08,  3.59it/s]
 10%|█         | 38505/371472 [3:04:07<25:44:48,  3.59it/s]
 10%|█         | 38506/371472 [3:04:07<26:12:29,  3.53it/s]
 10%|█         | 38507/371472 [3:04:07<27:26:49,  3.37it/s]
 10%|█         | 38508/371472 [3:04:07<26:32:34,  3.48it/s]
 10%|█         | 38509/371472 [3:04:08<26:10:23,  3.53it/s]
 10%|█         | 38510/371472 [3:04:08<25:56:50,  3.56it/s]
 10%|█         | 38511/371472 [3:04:08<26:13:12,  3.53it/s]
 10%|█         | 38512/371472 [3:04:09<25:43:39,  3.59it/s]
 10%|█         | 38513/371472 [3:04:09<26:36:36,  3.48it/s]
 10%|█         | 38514/371472 [3:04:09<27:33:41,  3.36it/s]
 10%|█         | 38515/371472 [3:04:09<26:49:55,  3.45it/s]
 10%|█         | 38516/371472 [3:04:10<25:28:16,  3.63it/s]
 10%|█         | 38517/371472 [3:04:10<26:06:32,  3.54it/s]
 10%|█         | 38518/371472 [3:04:10<25:05:27,  3.69it/s]
 10%|█         | 38519/371472 [3:04:10<24:54:23,  3.71it/s]
 10%|█         | 38520/371472 [3:04:11<24:53:25,  3.72it/s]
                                                           
{'loss': 4.6212, 'learning_rate': 9.071085349824387e-07, 'epoch': 1.66}

 10%|█         | 38520/371472 [3:04:11<24:53:25,  3.72it/s]
 10%|█         | 38521/371472 [3:04:11<25:34:29,  3.62it/s]
 10%|█         | 38522/371472 [3:04:11<25:39:03,  3.61it/s]
 10%|█         | 38523/371472 [3:04:12<25:18:47,  3.65it/s]
 10%|█         | 38524/371472 [3:04:12<24:33:41,  3.77it/s]
 10%|█         | 38525/371472 [3:04:12<24:48:43,  3.73it/s]
 10%|█         | 38526/371472 [3:04:12<25:39:22,  3.60it/s]
 10%|█         | 38527/371472 [3:04:13<25:36:44,  3.61it/s]
 10%|█         | 38528/371472 [3:04:13<26:15:09,  3.52it/s]
 10%|█         | 38529/371472 [3:04:13<28:15:58,  3.27it/s]
 10%|█         | 38530/371472 [3:04:14<27:38:07,  3.35it/s]
 10%|█         | 38531/371472 [3:04:14<33:01:11,  2.80it/s]
 10%|█         | 38532/371472 [3:04:14<30:32:47,  3.03it/s]
 10%|█         | 38533/371472 [3:04:15<29:41:48,  3.11it/s]
 10%|█         | 38534/371472 [3:04:15<29:16:48,  3.16it/s]
 10%|█         | 38535/371472 [3:04:15<28:51:50,  3.20it/s]
 10%|█         | 38536/371472 [3:04:16<27:01:38,  3.42it/s]
 10%|█         | 38537/371472 [3:04:16<29:03:58,  3.18it/s]
 10%|█         | 38538/371472 [3:04:16<27:01:50,  3.42it/s]
 10%|█         | 38539/371472 [3:04:16<27:13:10,  3.40it/s]
 10%|█         | 38540/371472 [3:04:17<26:48:13,  3.45it/s]
                                                           
{'loss': 4.3829, 'learning_rate': 9.070600530069599e-07, 'epoch': 1.66}

 10%|█         | 38540/371472 [3:04:17<26:48:13,  3.45it/s]
 10%|█         | 38541/371472 [3:04:17<26:33:52,  3.48it/s]
 10%|█         | 38542/371472 [3:04:17<26:32:32,  3.48it/s]
 10%|█         | 38543/371472 [3:04:18<26:31:00,  3.49it/s]
 10%|█         | 38544/371472 [3:04:18<25:30:09,  3.63it/s]
 10%|█         | 38545/371472 [3:04:18<26:14:49,  3.52it/s]
 10%|█         | 38546/371472 [3:04:18<25:39:12,  3.60it/s]
 10%|█         | 38547/371472 [3:04:19<24:52:40,  3.72it/s]
 10%|█         | 38548/371472 [3:04:19<24:18:46,  3.80it/s]
 10%|█         | 38549/371472 [3:04:19<24:18:31,  3.80it/s]
 10%|█         | 38550/371472 [3:04:19<24:35:28,  3.76it/s]
 10%|█         | 38551/371472 [3:04:20<24:46:10,  3.73it/s]
 10%|█         | 38552/371472 [3:04:20<25:23:10,  3.64it/s]
 10%|█         | 38553/371472 [3:04:20<26:44:39,  3.46it/s]
 10%|█         | 38554/371472 [3:04:21<25:51:42,  3.58it/s]
 10%|█         | 38555/371472 [3:04:21<27:19:34,  3.38it/s]
 10%|█         | 38556/371472 [3:04:21<25:42:42,  3.60it/s]
 10%|█         | 38557/371472 [3:04:21<27:10:25,  3.40it/s]
 10%|█         | 38558/371472 [3:04:22<25:58:20,  3.56it/s]
 10%|█         | 38559/371472 [3:04:22<27:15:34,  3.39it/s]
 10%|█         | 38560/371472 [3:04:22<26:52:42,  3.44it/s]
                                                           
{'loss': 4.5421, 'learning_rate': 9.070115710314809e-07, 'epoch': 1.66}

 10%|█         | 38560/371472 [3:04:22<26:52:42,  3.44it/s]
 10%|█         | 38561/371472 [3:04:23<28:00:58,  3.30it/s]
 10%|█         | 38562/371472 [3:04:23<26:55:06,  3.44it/s]
 10%|█         | 38563/371472 [3:04:23<27:18:18,  3.39it/s]
 10%|█         | 38564/371472 [3:04:24<27:49:49,  3.32it/s]
 10%|█         | 38565/371472 [3:04:24<27:04:39,  3.42it/s]
 10%|█         | 38566/371472 [3:04:24<25:56:02,  3.57it/s]
 10%|█         | 38567/371472 [3:04:24<25:15:21,  3.66it/s]
 10%|█         | 38568/371472 [3:04:25<25:52:26,  3.57it/s]
 10%|█         | 38569/371472 [3:04:25<28:36:31,  3.23it/s]
 10%|█         | 38570/371472 [3:04:25<26:59:14,  3.43it/s]
 10%|█         | 38571/371472 [3:04:26<28:23:14,  3.26it/s]
 10%|█         | 38572/371472 [3:04:26<27:49:30,  3.32it/s]
 10%|█         | 38573/371472 [3:04:26<28:43:43,  3.22it/s]
 10%|█         | 38574/371472 [3:04:27<28:29:08,  3.25it/s]
 10%|█         | 38575/371472 [3:04:27<28:06:33,  3.29it/s]
 10%|█         | 38576/371472 [3:04:27<26:42:57,  3.46it/s]
 10%|█         | 38577/371472 [3:04:27<26:18:10,  3.52it/s]
 10%|█         | 38578/371472 [3:04:28<26:15:38,  3.52it/s]
 10%|█         | 38579/371472 [3:04:28<27:39:04,  3.34it/s]
 10%|█         | 38580/371472 [3:04:28<26:54:24,  3.44it/s]
                                                           
{'loss': 4.3745, 'learning_rate': 9.06963089056002e-07, 'epoch': 1.66}

 10%|█         | 38580/371472 [3:04:28<26:54:24,  3.44it/s]
 10%|█         | 38581/371472 [3:04:28<26:09:30,  3.53it/s]
 10%|█         | 38582/371472 [3:04:29<25:52:18,  3.57it/s]
 10%|█         | 38583/371472 [3:04:29<25:00:52,  3.70it/s]
 10%|█         | 38584/371472 [3:04:29<24:31:25,  3.77it/s]
 10%|█         | 38585/371472 [3:04:30<28:56:05,  3.20it/s]
 10%|█         | 38586/371472 [3:04:30<29:16:26,  3.16it/s]
 10%|█         | 38587/371472 [3:04:30<27:50:03,  3.32it/s]
 10%|█         | 38588/371472 [3:04:31<28:02:41,  3.30it/s]
 10%|█         | 38589/371472 [3:04:31<27:21:25,  3.38it/s]
 10%|█         | 38590/371472 [3:04:31<27:42:53,  3.34it/s]
 10%|█         | 38591/371472 [3:04:32<29:00:10,  3.19it/s]
 10%|█         | 38592/371472 [3:04:32<28:47:18,  3.21it/s]
 10%|█         | 38593/371472 [3:04:32<27:06:28,  3.41it/s]
 10%|█         | 38594/371472 [3:04:32<26:58:31,  3.43it/s]
 10%|█         | 38595/371472 [3:04:33<27:42:15,  3.34it/s]
 10%|█         | 38596/371472 [3:04:33<26:25:25,  3.50it/s]
 10%|█         | 38597/371472 [3:04:33<27:24:55,  3.37it/s]
 10%|█         | 38598/371472 [3:04:34<29:18:59,  3.15it/s]
 10%|█         | 38599/371472 [3:04:34<28:08:59,  3.28it/s]
 10%|█         | 38600/371472 [3:04:34<26:57:22,  3.43it/s]
                                                           
{'loss': 4.4464, 'learning_rate': 9.069146070805231e-07, 'epoch': 1.66}

 10%|█         | 38600/371472 [3:04:34<26:57:22,  3.43it/s]
 10%|█         | 38601/371472 [3:04:34<26:13:25,  3.53it/s]
 10%|█         | 38602/371472 [3:04:35<27:45:52,  3.33it/s]
 10%|█         | 38603/371472 [3:04:35<27:09:38,  3.40it/s]
 10%|█         | 38604/371472 [3:04:35<26:24:47,  3.50it/s]
 10%|█         | 38605/371472 [3:04:36<26:34:08,  3.48it/s]
 10%|█         | 38606/371472 [3:04:36<27:58:14,  3.31it/s]
 10%|█         | 38607/371472 [3:04:36<28:38:35,  3.23it/s]
 10%|█         | 38608/371472 [3:04:37<27:19:24,  3.38it/s]
 10%|█         | 38609/371472 [3:04:37<28:02:12,  3.30it/s]
 10%|█         | 38610/371472 [3:04:37<26:34:41,  3.48it/s]
 10%|█         | 38611/371472 [3:04:37<25:50:02,  3.58it/s]
 10%|█         | 38612/371472 [3:04:38<25:53:28,  3.57it/s]
 10%|█         | 38613/371472 [3:04:38<24:58:38,  3.70it/s]
 10%|█         | 38614/371472 [3:04:38<24:58:29,  3.70it/s]
 10%|█         | 38615/371472 [3:04:38<25:32:03,  3.62it/s]
 10%|█         | 38616/371472 [3:04:39<25:35:57,  3.61it/s]
 10%|█         | 38617/371472 [3:04:39<25:42:09,  3.60it/s]
 10%|█         | 38618/371472 [3:04:39<26:02:08,  3.55it/s]
 10%|█         | 38619/371472 [3:04:40<26:22:32,  3.51it/s]
 10%|█         | 38620/371472 [3:04:40<27:31:59,  3.36it/s]
                                                           
{'loss': 4.4741, 'learning_rate': 9.068661251050443e-07, 'epoch': 1.66}

 10%|█         | 38620/371472 [3:04:40<27:31:59,  3.36it/s]
 10%|█         | 38621/371472 [3:04:40<26:56:30,  3.43it/s]
 10%|█         | 38622/371472 [3:04:40<27:06:51,  3.41it/s]
 10%|█         | 38623/371472 [3:04:41<27:30:26,  3.36it/s]
 10%|█         | 38624/371472 [3:04:41<26:51:03,  3.44it/s]
 10%|█         | 38625/371472 [3:04:41<26:17:44,  3.52it/s]
 10%|█         | 38626/371472 [3:04:42<27:50:52,  3.32it/s]
 10%|█         | 38627/371472 [3:04:42<28:03:20,  3.30it/s]
 10%|█         | 38628/371472 [3:04:42<27:38:28,  3.34it/s]
 10%|█         | 38629/371472 [3:04:43<26:54:00,  3.44it/s]
 10%|█         | 38630/371472 [3:04:43<26:34:35,  3.48it/s]
 10%|█         | 38631/371472 [3:04:43<25:58:07,  3.56it/s]
 10%|█         | 38632/371472 [3:04:43<26:30:16,  3.49it/s]
 10%|█         | 38633/371472 [3:04:44<26:04:54,  3.54it/s]
 10%|█         | 38634/371472 [3:04:44<25:58:09,  3.56it/s]
 10%|█         | 38635/371472 [3:04:44<26:24:47,  3.50it/s]
 10%|█         | 38636/371472 [3:04:45<28:23:43,  3.26it/s]
 10%|█         | 38637/371472 [3:04:45<28:33:33,  3.24it/s]
 10%|█         | 38638/371472 [3:04:45<27:34:36,  3.35it/s]
 10%|█         | 38639/371472 [3:04:45<26:38:30,  3.47it/s]
 10%|█         | 38640/371472 [3:04:46<26:27:11,  3.49it/s]
                                                           
{'loss': 4.2344, 'learning_rate': 9.068176431295653e-07, 'epoch': 1.66}

 10%|█         | 38640/371472 [3:04:46<26:27:11,  3.49it/s]
 10%|█         | 38641/371472 [3:04:46<27:07:01,  3.41it/s]
 10%|█         | 38642/371472 [3:04:46<27:59:45,  3.30it/s]
 10%|█         | 38643/371472 [3:04:47<27:11:50,  3.40it/s]
 10%|█         | 38644/371472 [3:04:47<26:31:25,  3.49it/s]
 10%|█         | 38645/371472 [3:04:47<26:30:16,  3.49it/s]
 10%|█         | 38646/371472 [3:04:48<28:19:00,  3.26it/s]
 10%|█         | 38647/371472 [3:04:48<27:47:27,  3.33it/s]
 10%|█         | 38648/371472 [3:04:48<26:37:17,  3.47it/s]
 10%|█         | 38649/371472 [3:04:48<29:12:40,  3.16it/s]
 10%|█         | 38650/371472 [3:04:49<28:35:27,  3.23it/s]
 10%|█         | 38651/371472 [3:04:49<26:36:36,  3.47it/s]
 10%|█         | 38652/371472 [3:04:49<25:50:26,  3.58it/s]
 10%|█         | 38653/371472 [3:04:50<26:40:27,  3.47it/s]
 10%|█         | 38654/371472 [3:04:50<27:03:31,  3.42it/s]
 10%|█         | 38655/371472 [3:04:50<26:30:40,  3.49it/s]
 10%|█         | 38656/371472 [3:04:50<26:17:50,  3.52it/s]
 10%|█         | 38657/371472 [3:04:51<27:04:54,  3.41it/s]
 10%|█         | 38658/371472 [3:04:51<27:32:28,  3.36it/s]
 10%|█         | 38659/371472 [3:04:51<26:53:06,  3.44it/s]
 10%|█         | 38660/371472 [3:04:52<26:13:26,  3.53it/s]
                                                           
{'loss': 4.3982, 'learning_rate': 9.067691611540865e-07, 'epoch': 1.67}

 10%|█         | 38660/371472 [3:04:52<26:13:26,  3.53it/s]
 10%|█         | 38661/371472 [3:04:52<27:58:17,  3.31it/s]
 10%|█         | 38662/371472 [3:04:52<27:22:17,  3.38it/s]
 10%|█         | 38663/371472 [3:04:52<26:17:24,  3.52it/s]
 10%|█         | 38664/371472 [3:04:53<26:45:02,  3.46it/s]
 10%|█         | 38665/371472 [3:04:53<25:54:51,  3.57it/s]
 10%|█         | 38666/371472 [3:04:53<28:30:03,  3.24it/s]
 10%|█         | 38667/371472 [3:04:54<27:24:32,  3.37it/s]
 10%|█         | 38668/371472 [3:04:54<27:01:16,  3.42it/s]
 10%|█         | 38669/371472 [3:04:54<26:11:00,  3.53it/s]
 10%|█         | 38670/371472 [3:04:54<25:08:51,  3.68it/s]
 10%|█         | 38671/371472 [3:04:55<26:06:24,  3.54it/s]
 10%|█         | 38672/371472 [3:04:55<26:55:09,  3.43it/s]
 10%|█         | 38673/371472 [3:04:55<25:53:24,  3.57it/s]
 10%|█         | 38674/371472 [3:04:56<26:32:27,  3.48it/s]
 10%|█         | 38675/371472 [3:04:56<25:55:29,  3.57it/s]
 10%|█         | 38676/371472 [3:04:56<29:29:39,  3.13it/s]
 10%|█         | 38677/371472 [3:04:57<28:31:34,  3.24it/s]
 10%|█         | 38678/371472 [3:04:57<26:49:32,  3.45it/s]
 10%|█         | 38679/371472 [3:04:57<28:20:19,  3.26it/s]
 10%|█         | 38680/371472 [3:04:57<27:11:12,  3.40it/s]
                                                           
{'loss': 4.2757, 'learning_rate': 9.067206791786076e-07, 'epoch': 1.67}

 10%|█         | 38680/371472 [3:04:57<27:11:12,  3.40it/s]
 10%|█         | 38681/371472 [3:04:58<26:52:50,  3.44it/s]
 10%|█         | 38682/371472 [3:04:58<26:15:07,  3.52it/s]
 10%|█         | 38683/371472 [3:04:58<26:41:54,  3.46it/s]
 10%|█         | 38684/371472 [3:04:59<26:01:55,  3.55it/s]
 10%|█         | 38685/371472 [3:04:59<25:32:03,  3.62it/s]
 10%|█         | 38686/371472 [3:04:59<27:16:16,  3.39it/s]
 10%|█         | 38687/371472 [3:04:59<26:10:28,  3.53it/s]
 10%|█         | 38688/371472 [3:05:00<25:45:40,  3.59it/s]
 10%|█         | 38689/371472 [3:05:00<25:19:00,  3.65it/s]
 10%|█         | 38690/371472 [3:05:00<25:14:00,  3.66it/s]
 10%|█         | 38691/371472 [3:05:01<26:51:21,  3.44it/s]
 10%|█         | 38692/371472 [3:05:01<25:54:30,  3.57it/s]
 10%|█         | 38693/371472 [3:05:01<26:26:56,  3.49it/s]
 10%|█         | 38694/371472 [3:05:01<27:02:53,  3.42it/s]
 10%|█         | 38695/371472 [3:05:02<27:17:22,  3.39it/s]
 10%|█         | 38696/371472 [3:05:02<26:16:07,  3.52it/s]
 10%|█         | 38697/371472 [3:05:02<26:26:49,  3.50it/s]
 10%|█         | 38698/371472 [3:05:03<25:36:50,  3.61it/s]
 10%|█         | 38699/371472 [3:05:03<26:07:01,  3.54it/s]
 10%|█         | 38700/371472 [3:05:03<28:42:32,  3.22it/s]
                                                           
{'loss': 4.3779, 'learning_rate': 9.066721972031286e-07, 'epoch': 1.67}

 10%|█         | 38700/371472 [3:05:03<28:42:32,  3.22it/s]
 10%|█         | 38701/371472 [3:05:03<27:02:17,  3.42it/s]
 10%|█         | 38702/371472 [3:05:04<26:05:41,  3.54it/s]
 10%|█         | 38703/371472 [3:05:04<28:48:12,  3.21it/s]
 10%|█         | 38704/371472 [3:05:04<27:44:13,  3.33it/s]
 10%|█         | 38705/371472 [3:05:05<26:46:18,  3.45it/s]
 10%|█         | 38706/371472 [3:05:05<27:02:12,  3.42it/s]
 10%|█         | 38707/371472 [3:05:05<27:12:48,  3.40it/s]
 10%|█         | 38708/371472 [3:05:05<26:10:09,  3.53it/s]
 10%|█         | 38709/371472 [3:05:06<25:58:59,  3.56it/s]
 10%|█         | 38710/371472 [3:05:06<25:28:03,  3.63it/s]
 10%|█         | 38711/371472 [3:05:06<25:08:37,  3.68it/s]
 10%|█         | 38712/371472 [3:05:07<28:16:39,  3.27it/s]
 10%|█         | 38713/371472 [3:05:07<27:25:06,  3.37it/s]
 10%|█         | 38714/371472 [3:05:07<26:29:26,  3.49it/s]
 10%|█         | 38715/371472 [3:05:08<27:18:33,  3.38it/s]
 10%|█         | 38716/371472 [3:05:08<30:51:33,  3.00it/s]
 10%|█         | 38717/371472 [3:05:08<32:28:53,  2.85it/s]
 10%|█         | 38718/371472 [3:05:09<30:12:53,  3.06it/s]
 10%|█         | 38719/371472 [3:05:09<29:01:48,  3.18it/s]
 10%|█         | 38720/371472 [3:05:09<27:28:58,  3.36it/s]
                                                           
{'loss': 4.2537, 'learning_rate': 9.066237152276497e-07, 'epoch': 1.67}

 10%|█         | 38720/371472 [3:05:09<27:28:58,  3.36it/s]
 10%|█         | 38721/371472 [3:05:09<26:49:53,  3.44it/s]
 10%|█         | 38722/371472 [3:05:10<26:06:44,  3.54it/s]
 10%|█         | 38723/371472 [3:05:10<27:11:51,  3.40it/s]
 10%|█         | 38724/371472 [3:05:10<26:52:22,  3.44it/s]
 10%|█         | 38725/371472 [3:05:11<27:31:05,  3.36it/s]
 10%|█         | 38726/371472 [3:05:11<26:51:24,  3.44it/s]
 10%|█         | 38727/371472 [3:05:11<25:35:43,  3.61it/s]
 10%|█         | 38728/371472 [3:05:11<25:30:50,  3.62it/s]
 10%|█         | 38729/371472 [3:05:12<25:46:35,  3.59it/s]
 10%|█         | 38730/371472 [3:05:12<25:26:51,  3.63it/s]
 10%|█         | 38731/371472 [3:05:12<25:34:41,  3.61it/s]
 10%|█         | 38732/371472 [3:05:13<27:15:13,  3.39it/s]
 10%|█         | 38733/371472 [3:05:13<26:49:24,  3.45it/s]
 10%|█         | 38734/371472 [3:05:13<26:46:47,  3.45it/s]
 10%|█         | 38735/371472 [3:05:13<26:32:31,  3.48it/s]
 10%|█         | 38736/371472 [3:05:14<25:50:34,  3.58it/s]
 10%|█         | 38737/371472 [3:05:14<27:28:53,  3.36it/s]
 10%|█         | 38738/371472 [3:05:14<26:11:24,  3.53it/s]
 10%|█         | 38739/371472 [3:05:15<26:17:16,  3.52it/s]
 10%|█         | 38740/371472 [3:05:15<26:08:56,  3.53it/s]
                                                           
{'loss': 4.459, 'learning_rate': 9.065752332521709e-07, 'epoch': 1.67}

 10%|█         | 38740/371472 [3:05:15<26:08:56,  3.53it/s]
 10%|█         | 38741/371472 [3:05:15<27:30:21,  3.36it/s]
 10%|█         | 38742/371472 [3:05:16<29:39:41,  3.12it/s]
 10%|█         | 38743/371472 [3:05:16<29:52:11,  3.09it/s]
 10%|█         | 38744/371472 [3:05:16<28:39:06,  3.23it/s]
 10%|█         | 38745/371472 [3:05:16<26:56:52,  3.43it/s]
 10%|█         | 38746/371472 [3:05:17<26:22:10,  3.50it/s]
 10%|█         | 38747/371472 [3:05:17<26:36:16,  3.47it/s]
 10%|█         | 38748/371472 [3:05:17<26:14:26,  3.52it/s]
 10%|█         | 38749/371472 [3:05:18<27:00:05,  3.42it/s]
 10%|█         | 38750/371472 [3:05:18<26:32:14,  3.48it/s]
 10%|█         | 38751/371472 [3:05:18<28:07:55,  3.29it/s]
 10%|█         | 38752/371472 [3:05:18<28:09:02,  3.28it/s]
 10%|█         | 38753/371472 [3:05:19<27:23:51,  3.37it/s]
 10%|█         | 38754/371472 [3:05:19<26:18:41,  3.51it/s]
 10%|█         | 38755/371472 [3:05:19<25:47:32,  3.58it/s]
 10%|█         | 38756/371472 [3:05:20<25:29:21,  3.63it/s]
 10%|█         | 38757/371472 [3:05:20<25:21:06,  3.65it/s]
 10%|█         | 38758/371472 [3:05:20<25:32:12,  3.62it/s]
 10%|█         | 38759/371472 [3:05:20<26:09:09,  3.53it/s]
 10%|█         | 38760/371472 [3:05:21<27:22:14,  3.38it/s]
                                                           
{'loss': 4.3083, 'learning_rate': 9.06526751276692e-07, 'epoch': 1.67}

 10%|█         | 38760/371472 [3:05:21<27:22:14,  3.38it/s]
 10%|█         | 38761/371472 [3:05:21<26:09:48,  3.53it/s]
 10%|█         | 38762/371472 [3:05:21<28:46:53,  3.21it/s]
 10%|█         | 38763/371472 [3:05:22<28:05:23,  3.29it/s]
 10%|█         | 38764/371472 [3:05:22<30:49:26,  3.00it/s]
 10%|█         | 38765/371472 [3:05:22<29:56:02,  3.09it/s]
 10%|█         | 38766/371472 [3:05:23<30:54:54,  2.99it/s]
 10%|█         | 38767/371472 [3:05:23<29:45:23,  3.11it/s]
 10%|█         | 38768/371472 [3:05:23<28:13:12,  3.27it/s]
 10%|█         | 38769/371472 [3:05:24<26:57:56,  3.43it/s]
 10%|█         | 38770/371472 [3:05:24<25:59:21,  3.56it/s]
 10%|█         | 38771/371472 [3:05:24<27:16:46,  3.39it/s]
 10%|█         | 38772/371472 [3:05:24<26:07:41,  3.54it/s]
 10%|█         | 38773/371472 [3:05:25<28:33:26,  3.24it/s]
 10%|█         | 38774/371472 [3:05:25<27:35:41,  3.35it/s]
 10%|█         | 38775/371472 [3:05:25<26:58:15,  3.43it/s]
 10%|█         | 38776/371472 [3:05:26<26:03:25,  3.55it/s]
 10%|█         | 38777/371472 [3:05:26<28:05:39,  3.29it/s]
 10%|█         | 38778/371472 [3:05:26<27:03:38,  3.42it/s]
 10%|█         | 38779/371472 [3:05:26<27:00:34,  3.42it/s]
 10%|█         | 38780/371472 [3:05:27<26:53:13,  3.44it/s]
                                                           
{'loss': 4.5771, 'learning_rate': 9.064782693012131e-07, 'epoch': 1.67}

 10%|█         | 38780/371472 [3:05:27<26:53:13,  3.44it/s]
 10%|█         | 38781/371472 [3:05:27<25:54:46,  3.57it/s]
 10%|█         | 38782/371472 [3:05:27<25:34:21,  3.61it/s]
 10%|█         | 38783/371472 [3:05:28<25:37:18,  3.61it/s]
 10%|█         | 38784/371472 [3:05:28<25:51:21,  3.57it/s]
 10%|█         | 38785/371472 [3:05:28<26:13:18,  3.52it/s]
 10%|█         | 38786/371472 [3:05:28<26:36:09,  3.47it/s]
 10%|█         | 38787/371472 [3:05:29<25:56:19,  3.56it/s]
 10%|█         | 38788/371472 [3:05:29<25:10:34,  3.67it/s]
 10%|█         | 38789/371472 [3:05:29<24:50:50,  3.72it/s]
 10%|█         | 38790/371472 [3:05:30<26:21:38,  3.51it/s]
 10%|█         | 38791/371472 [3:05:30<28:16:35,  3.27it/s]
 10%|█         | 38792/371472 [3:05:30<26:43:23,  3.46it/s]
 10%|█         | 38793/371472 [3:05:30<25:19:14,  3.65it/s]
 10%|█         | 38794/371472 [3:05:31<25:31:34,  3.62it/s]
 10%|█         | 38795/371472 [3:05:31<25:52:11,  3.57it/s]
 10%|█         | 38796/371472 [3:05:31<26:54:31,  3.43it/s]
 10%|█         | 38797/371472 [3:05:32<26:33:27,  3.48it/s]
 10%|█         | 38798/371472 [3:05:32<25:30:18,  3.62it/s]
 10%|█         | 38799/371472 [3:05:32<25:02:43,  3.69it/s]
 10%|█         | 38800/371472 [3:05:32<24:39:17,  3.75it/s]
                                                           
{'loss': 4.6128, 'learning_rate': 9.064297873257342e-07, 'epoch': 1.67}

 10%|█         | 38800/371472 [3:05:32<24:39:17,  3.75it/s]
 10%|█         | 38801/371472 [3:05:33<26:28:59,  3.49it/s]
 10%|█         | 38802/371472 [3:05:33<26:06:04,  3.54it/s]
 10%|█         | 38803/371472 [3:05:33<26:15:04,  3.52it/s]
 10%|█         | 38804/371472 [3:05:33<25:21:51,  3.64it/s]
 10%|█         | 38805/371472 [3:05:34<26:42:09,  3.46it/s]
 10%|█         | 38806/371472 [3:05:34<26:31:36,  3.48it/s]
 10%|█         | 38807/371472 [3:05:34<26:33:20,  3.48it/s]
 10%|█         | 38808/371472 [3:05:35<26:58:17,  3.43it/s]
 10%|█         | 38809/371472 [3:05:35<26:16:19,  3.52it/s]
 10%|█         | 38810/371472 [3:05:35<25:56:40,  3.56it/s]
 10%|█         | 38811/371472 [3:05:36<28:26:26,  3.25it/s]
 10%|█         | 38812/371472 [3:05:36<28:42:58,  3.22it/s]
 10%|█         | 38813/371472 [3:05:36<28:29:21,  3.24it/s]
 10%|█         | 38814/371472 [3:05:36<28:06:33,  3.29it/s]
 10%|█         | 38815/371472 [3:05:37<28:40:25,  3.22it/s]
 10%|█         | 38816/371472 [3:05:37<28:25:57,  3.25it/s]
 10%|█         | 38817/371472 [3:05:37<27:50:22,  3.32it/s]
 10%|█         | 38818/371472 [3:05:38<26:50:44,  3.44it/s]
 10%|█         | 38819/371472 [3:05:38<26:53:09,  3.44it/s]
 10%|█         | 38820/371472 [3:05:38<28:14:01,  3.27it/s]
                                                           
{'loss': 4.3605, 'learning_rate': 9.063813053502553e-07, 'epoch': 1.67}

 10%|█         | 38820/371472 [3:05:38<28:14:01,  3.27it/s]
 10%|█         | 38821/371472 [3:05:39<30:17:08,  3.05it/s]
 10%|█         | 38822/371472 [3:05:39<28:26:24,  3.25it/s]
 10%|█         | 38823/371472 [3:05:39<27:17:26,  3.39it/s]
 10%|█         | 38824/371472 [3:05:39<26:07:17,  3.54it/s]
 10%|█         | 38825/371472 [3:05:40<27:50:39,  3.32it/s]
 10%|█         | 38826/371472 [3:05:40<27:52:30,  3.31it/s]
 10%|█         | 38827/371472 [3:05:40<26:49:33,  3.44it/s]
 10%|█         | 38828/371472 [3:05:41<26:24:54,  3.50it/s]
 10%|█         | 38829/371472 [3:05:41<26:09:19,  3.53it/s]
 10%|█         | 38830/371472 [3:05:41<26:04:30,  3.54it/s]
 10%|█         | 38831/371472 [3:05:41<26:24:41,  3.50it/s]
 10%|█         | 38832/371472 [3:05:42<25:30:47,  3.62it/s]
 10%|█         | 38833/371472 [3:05:42<25:28:41,  3.63it/s]
 10%|█         | 38834/371472 [3:05:42<25:52:30,  3.57it/s]
 10%|█         | 38835/371472 [3:05:43<27:03:28,  3.41it/s]
 10%|█         | 38836/371472 [3:05:43<28:47:10,  3.21it/s]
 10%|█         | 38837/371472 [3:05:43<27:00:07,  3.42it/s]
 10%|█         | 38838/371472 [3:05:43<26:15:12,  3.52it/s]
 10%|█         | 38839/371472 [3:05:44<26:16:06,  3.52it/s]
 10%|█         | 38840/371472 [3:05:44<25:26:31,  3.63it/s]
                                                           
{'loss': 4.3275, 'learning_rate': 9.063328233747764e-07, 'epoch': 1.67}

 10%|█         | 38840/371472 [3:05:44<25:26:31,  3.63it/s]
 10%|█         | 38841/371472 [3:05:44<25:03:04,  3.69it/s]
 10%|█         | 38842/371472 [3:05:45<25:48:51,  3.58it/s]
 10%|█         | 38843/371472 [3:05:45<25:21:18,  3.64it/s]
 10%|█         | 38844/371472 [3:05:45<27:26:50,  3.37it/s]
 10%|█         | 38845/371472 [3:05:45<26:01:57,  3.55it/s]
 10%|█         | 38846/371472 [3:05:46<26:35:36,  3.47it/s]
 10%|█         | 38847/371472 [3:05:46<26:05:20,  3.54it/s]
 10%|█         | 38848/371472 [3:05:46<25:26:14,  3.63it/s]
 10%|█         | 38849/371472 [3:05:47<25:56:00,  3.56it/s]
 10%|█         | 38850/371472 [3:05:47<27:07:00,  3.41it/s]
 10%|█         | 38851/371472 [3:05:47<26:53:35,  3.44it/s]
 10%|█         | 38852/371472 [3:05:48<28:10:39,  3.28it/s]
 10%|█         | 38853/371472 [3:05:48<26:41:19,  3.46it/s]
 10%|█         | 38854/371472 [3:05:48<26:02:53,  3.55it/s]
 10%|█         | 38855/371472 [3:05:48<26:40:23,  3.46it/s]
 10%|█         | 38856/371472 [3:05:49<25:44:40,  3.59it/s]
 10%|█         | 38857/371472 [3:05:49<25:37:16,  3.61it/s]
 10%|█         | 38858/371472 [3:05:49<26:18:13,  3.51it/s]
 10%|█         | 38859/371472 [3:05:49<26:30:19,  3.49it/s]
 10%|█         | 38860/371472 [3:05:50<25:32:36,  3.62it/s]
                                                           
{'loss': 4.4422, 'learning_rate': 9.062843413992975e-07, 'epoch': 1.67}

 10%|█         | 38860/371472 [3:05:50<25:32:36,  3.62it/s]
 10%|█         | 38861/371472 [3:05:50<25:49:52,  3.58it/s]
 10%|█         | 38862/371472 [3:05:50<25:32:19,  3.62it/s]
 10%|█         | 38863/371472 [3:05:51<28:36:59,  3.23it/s]
 10%|█         | 38864/371472 [3:05:51<27:35:08,  3.35it/s]
 10%|█         | 38865/371472 [3:05:51<27:16:56,  3.39it/s]
 10%|█         | 38866/371472 [3:05:51<26:12:42,  3.52it/s]
 10%|█         | 38867/371472 [3:05:52<25:46:51,  3.58it/s]
 10%|█         | 38868/371472 [3:05:52<25:26:26,  3.63it/s]
 10%|█         | 38869/371472 [3:05:52<25:19:00,  3.65it/s]
 10%|█         | 38870/371472 [3:05:53<24:56:03,  3.71it/s]
 10%|█         | 38871/371472 [3:05:53<24:09:50,  3.82it/s]
 10%|█         | 38872/371472 [3:05:53<25:12:14,  3.67it/s]
 10%|█         | 38873/371472 [3:05:54<29:40:22,  3.11it/s]
 10%|█         | 38874/371472 [3:05:54<28:18:07,  3.26it/s]
 10%|█         | 38875/371472 [3:05:54<27:16:08,  3.39it/s]
 10%|█         | 38876/371472 [3:05:54<27:41:53,  3.34it/s]
 10%|█         | 38877/371472 [3:05:55<27:48:42,  3.32it/s]
 10%|█         | 38878/371472 [3:05:55<26:47:42,  3.45it/s]
 10%|█         | 38879/371472 [3:05:55<26:26:31,  3.49it/s]
 10%|█         | 38880/371472 [3:05:56<26:33:32,  3.48it/s]
                                                           
{'loss': 4.4172, 'learning_rate': 9.062358594238186e-07, 'epoch': 1.67}

 10%|█         | 38880/371472 [3:05:56<26:33:32,  3.48it/s]
 10%|█         | 38881/371472 [3:05:56<26:54:09,  3.43it/s]
 10%|█         | 38882/371472 [3:05:56<26:46:43,  3.45it/s]
 10%|█         | 38883/371472 [3:05:56<25:56:51,  3.56it/s]
 10%|█         | 38884/371472 [3:05:57<26:25:11,  3.50it/s]
 10%|█         | 38885/371472 [3:05:57<27:43:18,  3.33it/s]
 10%|█         | 38886/371472 [3:05:57<27:41:20,  3.34it/s]
 10%|█         | 38887/371472 [3:05:58<27:20:33,  3.38it/s]
 10%|█         | 38888/371472 [3:05:58<27:06:40,  3.41it/s]
 10%|█         | 38889/371472 [3:05:58<26:11:34,  3.53it/s]
 10%|█         | 38890/371472 [3:05:58<26:47:05,  3.45it/s]
 10%|█         | 38891/371472 [3:05:59<27:08:56,  3.40it/s]
 10%|█         | 38892/371472 [3:05:59<26:13:31,  3.52it/s]
 10%|█         | 38893/371472 [3:05:59<25:02:31,  3.69it/s]
 10%|█         | 38894/371472 [3:05:59<25:06:55,  3.68it/s]
 10%|█         | 38895/371472 [3:06:00<24:31:50,  3.77it/s]
 10%|█         | 38896/371472 [3:06:00<25:58:03,  3.56it/s]
 10%|█         | 38897/371472 [3:06:00<25:18:01,  3.65it/s]
 10%|█         | 38898/371472 [3:06:01<24:24:53,  3.78it/s]
 10%|█         | 38899/371472 [3:06:01<23:58:06,  3.85it/s]
 10%|█         | 38900/371472 [3:06:01<24:35:00,  3.76it/s]
                                                           
{'loss': 4.5314, 'learning_rate': 9.061873774483397e-07, 'epoch': 1.68}

 10%|█         | 38900/371472 [3:06:01<24:35:00,  3.76it/s]
 10%|█         | 38901/371472 [3:06:01<24:28:14,  3.78it/s]
 10%|█         | 38902/371472 [3:06:02<25:27:58,  3.63it/s]
 10%|█         | 38903/371472 [3:06:02<25:18:50,  3.65it/s]
 10%|█         | 38904/371472 [3:06:02<25:39:46,  3.60it/s]
 10%|█         | 38905/371472 [3:06:03<26:18:04,  3.51it/s]
 10%|█         | 38906/371472 [3:06:03<26:03:44,  3.54it/s]
 10%|█         | 38907/371472 [3:06:03<26:38:13,  3.47it/s]
 10%|█         | 38908/371472 [3:06:03<26:51:37,  3.44it/s]
 10%|█         | 38909/371472 [3:06:04<27:12:06,  3.40it/s]
 10%|█         | 38910/371472 [3:06:04<27:55:53,  3.31it/s]
 10%|█         | 38911/371472 [3:06:04<26:38:57,  3.47it/s]
 10%|█         | 38912/371472 [3:06:05<25:58:06,  3.56it/s]
 10%|█         | 38913/371472 [3:06:05<27:14:46,  3.39it/s]
 10%|█         | 38914/371472 [3:06:05<27:33:17,  3.35it/s]
 10%|█         | 38915/371472 [3:06:06<28:38:55,  3.22it/s]
 10%|█         | 38916/371472 [3:06:06<27:11:12,  3.40it/s]
 10%|█         | 38917/371472 [3:06:06<25:42:06,  3.59it/s]
 10%|█         | 38918/371472 [3:06:06<26:36:19,  3.47it/s]
 10%|█         | 38919/371472 [3:06:07<26:09:06,  3.53it/s]
 10%|█         | 38920/371472 [3:06:07<25:31:55,  3.62it/s]
                                                           
{'loss': 4.4356, 'learning_rate': 9.061388954728609e-07, 'epoch': 1.68}

 10%|█         | 38920/371472 [3:06:07<25:31:55,  3.62it/s]
 10%|█         | 38921/371472 [3:06:07<30:06:35,  3.07it/s]
 10%|█         | 38922/371472 [3:06:08<28:00:17,  3.30it/s]
 10%|█         | 38923/371472 [3:06:08<30:35:17,  3.02it/s]
 10%|█         | 38924/371472 [3:06:08<29:37:47,  3.12it/s]
 10%|█         | 38925/371472 [3:06:09<28:14:40,  3.27it/s]
 10%|█         | 38926/371472 [3:06:09<27:07:45,  3.40it/s]
 10%|█         | 38927/371472 [3:06:09<27:49:57,  3.32it/s]
 10%|█         | 38928/371472 [3:06:09<26:44:13,  3.45it/s]
 10%|█         | 38929/371472 [3:06:10<26:16:57,  3.51it/s]
 10%|█         | 38930/371472 [3:06:10<26:37:07,  3.47it/s]
 10%|█         | 38931/371472 [3:06:10<27:05:19,  3.41it/s]
 10%|█         | 38932/371472 [3:06:10<26:04:46,  3.54it/s]
 10%|█         | 38933/371472 [3:06:11<27:24:55,  3.37it/s]
 10%|█         | 38934/371472 [3:06:11<26:15:33,  3.52it/s]
 10%|█         | 38935/371472 [3:06:11<26:18:18,  3.51it/s]
 10%|█         | 38936/371472 [3:06:12<25:33:45,  3.61it/s]
 10%|█         | 38937/371472 [3:06:12<25:06:54,  3.68it/s]
 10%|█         | 38938/371472 [3:06:12<24:28:47,  3.77it/s]
 10%|█         | 38939/371472 [3:06:12<25:14:17,  3.66it/s]
 10%|█         | 38940/371472 [3:06:13<25:55:52,  3.56it/s]
                                                           
{'loss': 4.1629, 'learning_rate': 9.060904134973819e-07, 'epoch': 1.68}

 10%|█         | 38940/371472 [3:06:13<25:55:52,  3.56it/s]
 10%|█         | 38941/371472 [3:06:13<26:29:40,  3.49it/s]
 10%|█         | 38942/371472 [3:06:13<26:10:18,  3.53it/s]
 10%|█         | 38943/371472 [3:06:14<26:19:01,  3.51it/s]
 10%|█         | 38944/371472 [3:06:14<26:31:08,  3.48it/s]
 10%|█         | 38945/371472 [3:06:14<27:42:26,  3.33it/s]
 10%|█         | 38946/371472 [3:06:14<26:22:02,  3.50it/s]
 10%|█         | 38947/371472 [3:06:15<28:01:15,  3.30it/s]
 10%|█         | 38948/371472 [3:06:15<26:32:20,  3.48it/s]
 10%|█         | 38949/371472 [3:06:15<25:52:18,  3.57it/s]
 10%|█         | 38950/371472 [3:06:16<27:18:54,  3.38it/s]
 10%|█         | 38951/371472 [3:06:16<26:30:18,  3.48it/s]
 10%|█         | 38952/371472 [3:06:16<26:57:15,  3.43it/s]
 10%|█         | 38953/371472 [3:06:16<26:51:14,  3.44it/s]
 10%|█         | 38954/371472 [3:06:17<28:07:12,  3.28it/s]
 10%|█         | 38955/371472 [3:06:17<26:39:40,  3.46it/s]
 10%|█         | 38956/371472 [3:06:17<25:56:05,  3.56it/s]
 10%|█         | 38957/371472 [3:06:18<26:55:11,  3.43it/s]
 10%|█         | 38958/371472 [3:06:18<26:00:33,  3.55it/s]
 10%|█         | 38959/371472 [3:06:18<27:11:57,  3.40it/s]
 10%|█         | 38960/371472 [3:06:19<29:17:02,  3.15it/s]
                                                           
{'loss': 4.4948, 'learning_rate': 9.06041931521903e-07, 'epoch': 1.68}

 10%|█         | 38960/371472 [3:06:19<29:17:02,  3.15it/s]
 10%|█         | 38961/371472 [3:06:19<28:02:42,  3.29it/s]
 10%|█         | 38962/371472 [3:06:19<28:42:10,  3.22it/s]
 10%|█         | 38963/371472 [3:06:19<27:19:32,  3.38it/s]
 10%|█         | 38964/371472 [3:06:20<26:08:05,  3.53it/s]
 10%|█         | 38965/371472 [3:06:20<26:00:48,  3.55it/s]
 10%|█         | 38966/371472 [3:06:20<26:36:38,  3.47it/s]
 10%|█         | 38967/371472 [3:06:21<26:06:59,  3.54it/s]
 10%|█         | 38968/371472 [3:06:21<25:28:12,  3.63it/s]
 10%|█         | 38969/371472 [3:06:21<26:01:29,  3.55it/s]
 10%|█         | 38970/371472 [3:06:21<25:56:08,  3.56it/s]
 10%|█         | 38971/371472 [3:06:22<25:38:37,  3.60it/s]
 10%|█         | 38972/371472 [3:06:22<27:01:36,  3.42it/s]
 10%|█         | 38973/371472 [3:06:22<26:27:56,  3.49it/s]
 10%|█         | 38974/371472 [3:06:23<26:05:48,  3.54it/s]
 10%|█         | 38975/371472 [3:06:23<27:22:55,  3.37it/s]
 10%|█         | 38976/371472 [3:06:23<25:58:26,  3.56it/s]
 10%|█         | 38977/371472 [3:06:23<26:41:44,  3.46it/s]
 10%|█         | 38978/371472 [3:06:24<25:39:07,  3.60it/s]
 10%|█         | 38979/371472 [3:06:24<26:26:30,  3.49it/s]
 10%|█         | 38980/371472 [3:06:24<25:10:35,  3.67it/s]
                                                           
{'loss': 4.787, 'learning_rate': 9.059934495464241e-07, 'epoch': 1.68}

 10%|█         | 38980/371472 [3:06:24<25:10:35,  3.67it/s]
 10%|█         | 38981/371472 [3:06:25<28:09:45,  3.28it/s]
 10%|█         | 38982/371472 [3:06:25<27:24:08,  3.37it/s]
 10%|█         | 38983/371472 [3:06:25<26:07:03,  3.54it/s]
 10%|█         | 38984/371472 [3:06:25<26:27:40,  3.49it/s]
 10%|█         | 38985/371472 [3:06:26<25:47:07,  3.58it/s]
 10%|█         | 38986/371472 [3:06:26<25:02:52,  3.69it/s]
 10%|█         | 38987/371472 [3:06:26<25:51:09,  3.57it/s]
 10%|█         | 38988/371472 [3:06:27<25:52:18,  3.57it/s]
 10%|█         | 38989/371472 [3:06:27<25:37:38,  3.60it/s]
 10%|█         | 38990/371472 [3:06:27<25:57:05,  3.56it/s]
 10%|█         | 38991/371472 [3:06:27<26:06:45,  3.54it/s]
 10%|█         | 38992/371472 [3:06:28<27:22:20,  3.37it/s]
 10%|█         | 38993/371472 [3:06:28<26:49:11,  3.44it/s]
 10%|█         | 38994/371472 [3:06:28<26:37:49,  3.47it/s]
 10%|█         | 38995/371472 [3:06:29<25:40:00,  3.60it/s]
 10%|█         | 38996/371472 [3:06:29<25:04:58,  3.68it/s]
 10%|█         | 38997/371472 [3:06:29<24:35:58,  3.75it/s]
 10%|█         | 38998/371472 [3:06:29<24:21:55,  3.79it/s]
 10%|█         | 38999/371472 [3:06:30<26:54:20,  3.43it/s]
 10%|█         | 39000/371472 [3:06:30<26:13:55,  3.52it/s]
                                                           
{'loss': 4.1931, 'learning_rate': 9.059449675709452e-07, 'epoch': 1.68}

 10%|█         | 39000/371472 [3:06:30<26:13:55,  3.52it/s]
 10%|█         | 39001/371472 [3:06:30<27:17:55,  3.38it/s]
 10%|█         | 39002/371472 [3:06:31<27:32:17,  3.35it/s]
 10%|█         | 39003/371472 [3:06:31<26:36:08,  3.47it/s]
 10%|█         | 39004/371472 [3:06:31<28:05:11,  3.29it/s]
 11%|█         | 39005/371472 [3:06:31<27:11:42,  3.40it/s]
 11%|█         | 39006/371472 [3:06:32<29:06:31,  3.17it/s]
 11%|█         | 39007/371472 [3:06:32<29:56:39,  3.08it/s]
 11%|█         | 39008/371472 [3:06:32<28:34:12,  3.23it/s]
 11%|█         | 39009/371472 [3:06:33<27:38:28,  3.34it/s]
 11%|█         | 39010/371472 [3:06:33<28:04:29,  3.29it/s]
 11%|█         | 39011/371472 [3:06:33<29:40:52,  3.11it/s]
 11%|█         | 39012/371472 [3:06:34<28:03:37,  3.29it/s]
 11%|█         | 39013/371472 [3:06:34<27:52:19,  3.31it/s]
 11%|█         | 39014/371472 [3:06:34<27:47:53,  3.32it/s]
 11%|█         | 39015/371472 [3:06:34<27:12:54,  3.39it/s]
 11%|█         | 39016/371472 [3:06:35<28:05:30,  3.29it/s]
 11%|█         | 39017/371472 [3:06:35<27:23:53,  3.37it/s]
 11%|█         | 39018/371472 [3:06:35<27:41:01,  3.34it/s]
 11%|█         | 39019/371472 [3:06:36<26:46:06,  3.45it/s]
 11%|█         | 39020/371472 [3:06:36<25:51:33,  3.57it/s]
                                                           
{'loss': 4.1048, 'learning_rate': 9.058964855954664e-07, 'epoch': 1.68}

 11%|█         | 39020/371472 [3:06:36<25:51:33,  3.57it/s]
 11%|█         | 39021/371472 [3:06:36<25:19:35,  3.65it/s]
 11%|█         | 39022/371472 [3:06:36<25:25:07,  3.63it/s]
 11%|█         | 39023/371472 [3:06:37<26:32:36,  3.48it/s]
 11%|█         | 39024/371472 [3:06:37<25:57:20,  3.56it/s]
 11%|█         | 39025/371472 [3:06:37<26:41:53,  3.46it/s]
 11%|█         | 39026/371472 [3:06:38<27:17:25,  3.38it/s]
 11%|█         | 39027/371472 [3:06:38<25:51:48,  3.57it/s]
 11%|█         | 39028/371472 [3:06:38<27:18:59,  3.38it/s]
 11%|█         | 39029/371472 [3:06:39<26:13:51,  3.52it/s]
 11%|█         | 39030/371472 [3:06:39<27:03:10,  3.41it/s]
 11%|█         | 39031/371472 [3:06:39<27:43:16,  3.33it/s]
 11%|█         | 39032/371472 [3:06:39<26:30:07,  3.48it/s]
 11%|█         | 39033/371472 [3:06:40<26:07:15,  3.54it/s]
 11%|█         | 39034/371472 [3:06:40<25:26:04,  3.63it/s]
 11%|█         | 39035/371472 [3:06:40<24:52:28,  3.71it/s]
 11%|█         | 39036/371472 [3:06:40<25:52:49,  3.57it/s]
 11%|█         | 39037/371472 [3:06:41<25:29:16,  3.62it/s]
 11%|█         | 39038/371472 [3:06:41<28:39:32,  3.22it/s]
 11%|█         | 39039/371472 [3:06:41<28:10:19,  3.28it/s]
 11%|█         | 39040/371472 [3:06:42<27:54:39,  3.31it/s]
                                                           
{'loss': 4.522, 'learning_rate': 9.058480036199875e-07, 'epoch': 1.68}

 11%|█         | 39040/371472 [3:06:42<27:54:39,  3.31it/s]
 11%|█         | 39041/371472 [3:06:42<26:56:52,  3.43it/s]
 11%|█         | 39042/371472 [3:06:42<26:38:35,  3.47it/s]
 11%|█         | 39043/371472 [3:06:43<25:52:08,  3.57it/s]
 11%|█         | 39044/371472 [3:06:43<25:02:11,  3.69it/s]
 11%|█         | 39045/371472 [3:06:43<24:08:38,  3.82it/s]
 11%|█         | 39046/371472 [3:06:43<24:47:11,  3.73it/s]
 11%|█         | 39047/371472 [3:06:44<25:37:38,  3.60it/s]
 11%|█         | 39048/371472 [3:06:44<25:35:32,  3.61it/s]
 11%|█         | 39049/371472 [3:06:44<25:24:42,  3.63it/s]
 11%|█         | 39050/371472 [3:06:44<26:13:31,  3.52it/s]
 11%|█         | 39051/371472 [3:06:45<27:53:38,  3.31it/s]
 11%|█         | 39052/371472 [3:06:45<27:18:40,  3.38it/s]
 11%|█         | 39053/371472 [3:06:45<26:10:06,  3.53it/s]
 11%|█         | 39054/371472 [3:06:46<25:01:40,  3.69it/s]
 11%|█         | 39055/371472 [3:06:46<24:57:04,  3.70it/s]
 11%|█         | 39056/371472 [3:06:46<25:07:06,  3.68it/s]
 11%|█         | 39057/371472 [3:06:46<25:42:01,  3.59it/s]
 11%|█         | 39058/371472 [3:06:47<25:43:12,  3.59it/s]
 11%|█         | 39059/371472 [3:06:47<25:58:24,  3.56it/s]
 11%|█         | 39060/371472 [3:06:47<27:33:17,  3.35it/s]
                                                           
{'loss': 4.4355, 'learning_rate': 9.057995216445086e-07, 'epoch': 1.68}

 11%|█         | 39060/371472 [3:06:47<27:33:17,  3.35it/s]
 11%|█         | 39061/371472 [3:06:48<26:24:01,  3.50it/s]
 11%|█         | 39062/371472 [3:06:48<26:12:54,  3.52it/s]
 11%|█         | 39063/371472 [3:06:48<25:46:28,  3.58it/s]
 11%|█         | 39064/371472 [3:06:48<26:24:33,  3.50it/s]
 11%|█         | 39065/371472 [3:06:49<29:09:02,  3.17it/s]
 11%|█         | 39066/371472 [3:06:49<28:09:19,  3.28it/s]
 11%|█         | 39067/371472 [3:06:49<26:51:01,  3.44it/s]
 11%|█         | 39068/371472 [3:06:50<26:35:17,  3.47it/s]
 11%|█         | 39069/371472 [3:06:50<28:21:25,  3.26it/s]
 11%|█         | 39070/371472 [3:06:50<27:11:16,  3.40it/s]
 11%|█         | 39071/371472 [3:06:51<27:04:08,  3.41it/s]
 11%|█         | 39072/371472 [3:06:51<26:15:35,  3.52it/s]
 11%|█         | 39073/371472 [3:06:51<26:49:56,  3.44it/s]
 11%|█         | 39074/371472 [3:06:51<25:39:23,  3.60it/s]
 11%|█         | 39075/371472 [3:06:52<24:33:25,  3.76it/s]
 11%|█         | 39076/371472 [3:06:52<26:57:05,  3.43it/s]
 11%|█         | 39077/371472 [3:06:52<27:10:31,  3.40it/s]
 11%|█         | 39078/371472 [3:06:53<27:01:23,  3.42it/s]
 11%|█         | 39079/371472 [3:06:53<29:17:53,  3.15it/s]
 11%|█         | 39080/371472 [3:06:53<28:34:49,  3.23it/s]
                                                           
{'loss': 4.2634, 'learning_rate': 9.057510396690296e-07, 'epoch': 1.68}

 11%|█         | 39080/371472 [3:06:53<28:34:49,  3.23it/s]
 11%|█         | 39081/371472 [3:06:54<28:46:28,  3.21it/s]
 11%|█         | 39082/371472 [3:06:54<27:40:52,  3.34it/s]
 11%|█         | 39083/371472 [3:06:54<27:25:31,  3.37it/s]
 11%|█         | 39084/371472 [3:06:54<28:22:38,  3.25it/s]
 11%|█         | 39085/371472 [3:06:55<26:48:12,  3.44it/s]
 11%|█         | 39086/371472 [3:06:55<28:59:27,  3.18it/s]
 11%|█         | 39087/371472 [3:06:55<26:56:35,  3.43it/s]
 11%|█         | 39088/371472 [3:06:56<25:27:02,  3.63it/s]
 11%|█         | 39089/371472 [3:06:56<26:05:42,  3.54it/s]
 11%|█         | 39090/371472 [3:06:56<27:07:34,  3.40it/s]
 11%|█         | 39091/371472 [3:06:56<26:10:06,  3.53it/s]
 11%|█         | 39092/371472 [3:06:57<26:05:37,  3.54it/s]
 11%|█         | 39093/371472 [3:06:57<25:37:03,  3.60it/s]
 11%|█         | 39094/371472 [3:06:57<26:28:33,  3.49it/s]
 11%|█         | 39095/371472 [3:06:58<25:38:11,  3.60it/s]
 11%|█         | 39096/371472 [3:06:58<25:48:03,  3.58it/s]
 11%|█         | 39097/371472 [3:06:58<26:09:02,  3.53it/s]
 11%|█         | 39098/371472 [3:06:58<26:04:11,  3.54it/s]
 11%|█         | 39099/371472 [3:06:59<25:38:41,  3.60it/s]
 11%|█         | 39100/371472 [3:06:59<27:44:10,  3.33it/s]
                                                           
{'loss': 4.3253, 'learning_rate': 9.057025576935507e-07, 'epoch': 1.68}

 11%|█         | 39100/371472 [3:06:59<27:44:10,  3.33it/s]
 11%|█         | 39101/371472 [3:06:59<26:48:22,  3.44it/s]
 11%|█         | 39102/371472 [3:07:00<27:58:36,  3.30it/s]
 11%|█         | 39103/371472 [3:07:00<27:00:37,  3.42it/s]
 11%|█         | 39104/371472 [3:07:00<26:30:23,  3.48it/s]
 11%|█         | 39105/371472 [3:07:00<25:35:38,  3.61it/s]
 11%|█         | 39106/371472 [3:07:01<25:22:14,  3.64it/s]
 11%|█         | 39107/371472 [3:07:01<25:14:38,  3.66it/s]
 11%|█         | 39108/371472 [3:07:01<25:12:35,  3.66it/s]
 11%|█         | 39109/371472 [3:07:02<26:18:00,  3.51it/s]
 11%|█         | 39110/371472 [3:07:02<26:38:32,  3.47it/s]
 11%|█         | 39111/371472 [3:07:02<27:28:32,  3.36it/s]
 11%|█         | 39112/371472 [3:07:02<26:12:33,  3.52it/s]
 11%|█         | 39113/371472 [3:07:03<28:15:32,  3.27it/s]
 11%|█         | 39114/371472 [3:07:03<27:57:18,  3.30it/s]
 11%|█         | 39115/371472 [3:07:03<26:55:54,  3.43it/s]
 11%|█         | 39116/371472 [3:07:04<27:44:50,  3.33it/s]
 11%|█         | 39117/371472 [3:07:04<27:21:29,  3.37it/s]
 11%|█         | 39118/371472 [3:07:04<27:08:24,  3.40it/s]
 11%|█         | 39119/371472 [3:07:04<26:42:41,  3.46it/s]
 11%|█         | 39120/371472 [3:07:05<27:28:40,  3.36it/s]
                                                           
{'loss': 4.2652, 'learning_rate': 9.056540757180719e-07, 'epoch': 1.68}

 11%|█         | 39120/371472 [3:07:05<27:28:40,  3.36it/s]
 11%|█         | 39121/371472 [3:07:05<27:36:11,  3.34it/s]
 11%|█         | 39122/371472 [3:07:05<27:29:41,  3.36it/s]
 11%|█         | 39123/371472 [3:07:06<27:18:40,  3.38it/s]
 11%|█         | 39124/371472 [3:07:06<26:49:01,  3.44it/s]
 11%|█         | 39125/371472 [3:07:06<27:47:01,  3.32it/s]
 11%|█         | 39126/371472 [3:07:07<27:14:10,  3.39it/s]
 11%|█         | 39127/371472 [3:07:07<26:16:41,  3.51it/s]
 11%|█         | 39128/371472 [3:07:07<25:44:47,  3.59it/s]
 11%|█         | 39129/371472 [3:07:07<26:47:56,  3.44it/s]
 11%|█         | 39130/371472 [3:07:08<27:21:47,  3.37it/s]
 11%|█         | 39131/371472 [3:07:08<27:08:12,  3.40it/s]
 11%|█         | 39132/371472 [3:07:08<28:11:16,  3.28it/s]
 11%|█         | 39133/371472 [3:07:09<28:04:50,  3.29it/s]
 11%|█         | 39134/371472 [3:07:09<27:30:54,  3.36it/s]
 11%|█         | 39135/371472 [3:07:09<28:24:18,  3.25it/s]
 11%|█         | 39136/371472 [3:07:10<28:40:25,  3.22it/s]
 11%|█         | 39137/371472 [3:07:10<27:59:12,  3.30it/s]
 11%|█         | 39138/371472 [3:07:10<26:27:41,  3.49it/s]
 11%|█         | 39139/371472 [3:07:10<25:14:18,  3.66it/s]
 11%|█         | 39140/371472 [3:07:11<27:00:52,  3.42it/s]
                                                           
{'loss': 4.3281, 'learning_rate': 9.05605593742593e-07, 'epoch': 1.69}

 11%|█         | 39140/371472 [3:07:11<27:00:52,  3.42it/s]
 11%|█         | 39141/371472 [3:07:11<27:31:16,  3.35it/s]
 11%|█         | 39142/371472 [3:07:11<26:25:12,  3.49it/s]
 11%|█         | 39143/371472 [3:07:12<25:40:39,  3.60it/s]
 11%|█         | 39144/371472 [3:07:12<25:55:12,  3.56it/s]
 11%|█         | 39145/371472 [3:07:12<25:33:40,  3.61it/s]
 11%|█         | 39146/371472 [3:07:12<25:16:28,  3.65it/s]
 11%|█         | 39147/371472 [3:07:13<24:47:21,  3.72it/s]
 11%|█         | 39148/371472 [3:07:13<23:57:29,  3.85it/s]
 11%|█         | 39149/371472 [3:07:13<24:56:36,  3.70it/s]
 11%|█         | 39150/371472 [3:07:13<24:44:03,  3.73it/s]
 11%|█         | 39151/371472 [3:07:14<25:33:07,  3.61it/s]
 11%|█         | 39152/371472 [3:07:14<26:35:04,  3.47it/s]
 11%|█         | 39153/371472 [3:07:14<27:28:55,  3.36it/s]
 11%|█         | 39154/371472 [3:07:15<27:04:47,  3.41it/s]
 11%|█         | 39155/371472 [3:07:15<28:17:21,  3.26it/s]
 11%|█         | 39156/371472 [3:07:15<27:23:22,  3.37it/s]
 11%|█         | 39157/371472 [3:07:15<27:12:17,  3.39it/s]
 11%|█         | 39158/371472 [3:07:16<28:42:02,  3.22it/s]
 11%|█         | 39159/371472 [3:07:16<29:19:51,  3.15it/s]
 11%|█         | 39160/371472 [3:07:16<28:08:08,  3.28it/s]
                                                           
{'loss': 4.391, 'learning_rate': 9.055571117671141e-07, 'epoch': 1.69}

 11%|█         | 39160/371472 [3:07:16<28:08:08,  3.28it/s]
 11%|█         | 39161/371472 [3:07:17<28:29:27,  3.24it/s]
 11%|█         | 39162/371472 [3:07:17<27:27:04,  3.36it/s]
 11%|█         | 39163/371472 [3:07:17<27:02:22,  3.41it/s]
 11%|█         | 39164/371472 [3:07:18<26:47:05,  3.45it/s]
 11%|█         | 39165/371472 [3:07:18<25:36:30,  3.60it/s]
 11%|█         | 39166/371472 [3:07:18<24:55:28,  3.70it/s]
 11%|█         | 39167/371472 [3:07:18<26:40:21,  3.46it/s]
 11%|█         | 39168/371472 [3:07:19<27:06:45,  3.40it/s]
 11%|█         | 39169/371472 [3:07:19<27:15:37,  3.39it/s]
 11%|█         | 39170/371472 [3:07:19<26:32:15,  3.48it/s]
 11%|█         | 39171/371472 [3:07:20<25:41:34,  3.59it/s]
 11%|█         | 39172/371472 [3:07:20<25:44:54,  3.58it/s]
 11%|█         | 39173/371472 [3:07:20<26:39:00,  3.46it/s]
 11%|█         | 39174/371472 [3:07:20<26:17:45,  3.51it/s]
 11%|█         | 39175/371472 [3:07:21<26:57:11,  3.42it/s]
 11%|█         | 39176/371472 [3:07:21<28:09:19,  3.28it/s]
 11%|█         | 39177/371472 [3:07:21<26:42:06,  3.46it/s]
 11%|█         | 39178/371472 [3:07:22<26:31:54,  3.48it/s]
 11%|█         | 39179/371472 [3:07:22<28:20:17,  3.26it/s]
 11%|█         | 39180/371472 [3:07:22<26:34:20,  3.47it/s]
                                                           
{'loss': 4.3401, 'learning_rate': 9.055086297916352e-07, 'epoch': 1.69}

 11%|█         | 39180/371472 [3:07:22<26:34:20,  3.47it/s]
 11%|█         | 39181/371472 [3:07:23<27:06:36,  3.40it/s]
 11%|█         | 39182/371472 [3:07:23<27:53:19,  3.31it/s]
 11%|█         | 39183/371472 [3:07:23<26:27:00,  3.49it/s]
 11%|█         | 39184/371472 [3:07:23<25:52:24,  3.57it/s]
 11%|█         | 39185/371472 [3:07:24<26:17:16,  3.51it/s]
 11%|█         | 39186/371472 [3:07:24<26:41:07,  3.46it/s]
 11%|█         | 39187/371472 [3:07:24<28:10:42,  3.28it/s]
 11%|█         | 39188/371472 [3:07:25<28:04:18,  3.29it/s]
 11%|█         | 39189/371472 [3:07:25<27:06:14,  3.41it/s]
 11%|█         | 39190/371472 [3:07:25<26:06:37,  3.54it/s]
 11%|█         | 39191/371472 [3:07:25<27:58:09,  3.30it/s]
 11%|█         | 39192/371472 [3:07:26<28:36:04,  3.23it/s]
 11%|█         | 39193/371472 [3:07:26<26:33:29,  3.48it/s]
 11%|█         | 39194/371472 [3:07:26<25:31:52,  3.62it/s]
 11%|█         | 39195/371472 [3:07:27<25:38:29,  3.60it/s]
 11%|█         | 39196/371472 [3:07:27<26:18:42,  3.51it/s]
 11%|█         | 39197/371472 [3:07:27<25:31:24,  3.62it/s]
 11%|█         | 39198/371472 [3:07:27<26:47:23,  3.45it/s]
 11%|█         | 39199/371472 [3:07:28<27:51:22,  3.31it/s]
 11%|█         | 39200/371472 [3:07:28<28:07:17,  3.28it/s]
                                                           
{'loss': 4.3509, 'learning_rate': 9.054601478161563e-07, 'epoch': 1.69}

 11%|█         | 39200/371472 [3:07:28<28:07:17,  3.28it/s]
 11%|█         | 39201/371472 [3:07:28<27:06:43,  3.40it/s]
 11%|█         | 39202/371472 [3:07:29<28:23:47,  3.25it/s]
 11%|█         | 39203/371472 [3:07:29<28:23:52,  3.25it/s]
 11%|█         | 39204/371472 [3:07:29<27:04:29,  3.41it/s]
 11%|█         | 39205/371472 [3:07:30<27:05:36,  3.41it/s]
 11%|█         | 39206/371472 [3:07:30<27:48:32,  3.32it/s]
 11%|█         | 39207/371472 [3:07:30<26:39:56,  3.46it/s]
 11%|█         | 39208/371472 [3:07:30<25:50:11,  3.57it/s]
 11%|█         | 39209/371472 [3:07:31<27:37:12,  3.34it/s]
 11%|█         | 39210/371472 [3:07:31<26:06:27,  3.54it/s]
 11%|█         | 39211/371472 [3:07:31<25:34:34,  3.61it/s]
 11%|█         | 39212/371472 [3:07:32<26:38:18,  3.46it/s]
 11%|█         | 39213/371472 [3:07:32<25:32:23,  3.61it/s]
 11%|█         | 39214/371472 [3:07:32<25:29:52,  3.62it/s]
 11%|█         | 39215/371472 [3:07:32<25:06:44,  3.68it/s]
 11%|█         | 39216/371472 [3:07:33<25:25:11,  3.63it/s]
 11%|█         | 39217/371472 [3:07:33<25:06:22,  3.68it/s]
 11%|█         | 39218/371472 [3:07:33<24:13:53,  3.81it/s]
 11%|█         | 39219/371472 [3:07:33<24:25:34,  3.78it/s]
 11%|█         | 39220/371472 [3:07:34<24:22:14,  3.79it/s]
                                                           
{'loss': 4.4641, 'learning_rate': 9.054116658406772e-07, 'epoch': 1.69}

 11%|█         | 39220/371472 [3:07:34<24:22:14,  3.79it/s]
 11%|█         | 39221/371472 [3:07:34<24:41:52,  3.74it/s]
 11%|█         | 39222/371472 [3:07:34<25:45:45,  3.58it/s]
 11%|█         | 39223/371472 [3:07:35<25:15:54,  3.65it/s]
 11%|█         | 39224/371472 [3:07:35<25:44:19,  3.59it/s]
 11%|█         | 39225/371472 [3:07:35<25:19:41,  3.64it/s]
 11%|█         | 39226/371472 [3:07:35<26:28:28,  3.49it/s]
 11%|█         | 39227/371472 [3:07:36<29:05:10,  3.17it/s]
 11%|█         | 39228/371472 [3:07:36<27:37:11,  3.34it/s]
 11%|█         | 39229/371472 [3:07:36<26:52:36,  3.43it/s]
 11%|█         | 39230/371472 [3:07:37<25:32:04,  3.61it/s]
 11%|█         | 39231/371472 [3:07:37<25:57:40,  3.55it/s]
 11%|█         | 39232/371472 [3:07:37<27:32:39,  3.35it/s]
 11%|█         | 39233/371472 [3:07:37<27:09:16,  3.40it/s]
 11%|█         | 39234/371472 [3:07:38<26:40:31,  3.46it/s]
 11%|█         | 39235/371472 [3:07:38<26:50:06,  3.44it/s]
 11%|█         | 39236/371472 [3:07:38<26:35:58,  3.47it/s]
 11%|█         | 39237/371472 [3:07:39<26:12:20,  3.52it/s]
 11%|█         | 39238/371472 [3:07:39<27:03:14,  3.41it/s]
 11%|█         | 39239/371472 [3:07:39<27:21:04,  3.37it/s]
 11%|█         | 39240/371472 [3:07:39<26:14:23,  3.52it/s]
                                                           
{'loss': 4.3644, 'learning_rate': 9.053631838651985e-07, 'epoch': 1.69}

 11%|█         | 39240/371472 [3:07:39<26:14:23,  3.52it/s]
 11%|█         | 39241/371472 [3:07:40<27:08:43,  3.40it/s]
 11%|█         | 39242/371472 [3:07:40<26:55:40,  3.43it/s]
 11%|█         | 39243/371472 [3:07:40<25:53:13,  3.56it/s]
 11%|█         | 39244/371472 [3:07:41<26:49:27,  3.44it/s]
 11%|█         | 39245/371472 [3:07:41<27:54:59,  3.31it/s]
 11%|█         | 39246/371472 [3:07:41<28:46:17,  3.21it/s]
 11%|█         | 39247/371472 [3:07:42<28:14:13,  3.27it/s]
 11%|█         | 39248/371472 [3:07:42<27:39:48,  3.34it/s]
 11%|█         | 39249/371472 [3:07:42<26:34:29,  3.47it/s]
 11%|█         | 39250/371472 [3:07:43<31:18:13,  2.95it/s]
 11%|█         | 39251/371472 [3:07:43<28:41:38,  3.22it/s]
 11%|█         | 39252/371472 [3:07:43<28:55:19,  3.19it/s]
 11%|█         | 39253/371472 [3:07:43<28:14:48,  3.27it/s]
 11%|█         | 39254/371472 [3:07:44<30:47:01,  3.00it/s]
 11%|█         | 39255/371472 [3:07:44<31:12:30,  2.96it/s]
 11%|█         | 39256/371472 [3:07:44<28:39:27,  3.22it/s]
 11%|█         | 39257/371472 [3:07:45<27:29:02,  3.36it/s]
 11%|█         | 39258/371472 [3:07:45<26:33:25,  3.47it/s]
 11%|█         | 39259/371472 [3:07:45<26:23:47,  3.50it/s]
 11%|█         | 39260/371472 [3:07:46<26:43:34,  3.45it/s]
                                                           
{'loss': 4.4213, 'learning_rate': 9.053147018897196e-07, 'epoch': 1.69}

 11%|█         | 39260/371472 [3:07:46<26:43:34,  3.45it/s]
 11%|█         | 39261/371472 [3:07:46<27:00:04,  3.42it/s]
 11%|█         | 39262/371472 [3:07:46<26:50:18,  3.44it/s]
 11%|█         | 39263/371472 [3:07:46<26:02:52,  3.54it/s]
 11%|█         | 39264/371472 [3:07:47<26:24:22,  3.49it/s]
 11%|█         | 39265/371472 [3:07:47<25:36:35,  3.60it/s]
 11%|█         | 39266/371472 [3:07:47<25:12:43,  3.66it/s]
 11%|█         | 39267/371472 [3:07:48<25:45:12,  3.58it/s]
 11%|█         | 39268/371472 [3:07:48<26:05:02,  3.54it/s]
 11%|█         | 39269/371472 [3:07:48<26:24:11,  3.49it/s]
 11%|█         | 39270/371472 [3:07:48<28:42:56,  3.21it/s]
 11%|█         | 39271/371472 [3:07:49<28:13:12,  3.27it/s]
 11%|█         | 39272/371472 [3:07:49<26:48:03,  3.44it/s]
 11%|█         | 39273/371472 [3:07:49<25:40:25,  3.59it/s]
 11%|█         | 39274/371472 [3:07:50<25:08:38,  3.67it/s]
 11%|█         | 39275/371472 [3:07:50<24:39:05,  3.74it/s]
 11%|█         | 39276/371472 [3:07:50<26:53:05,  3.43it/s]
 11%|█         | 39277/371472 [3:07:50<27:02:56,  3.41it/s]
 11%|█         | 39278/371472 [3:07:51<26:12:51,  3.52it/s]
 11%|█         | 39279/371472 [3:07:51<27:16:59,  3.38it/s]
 11%|█         | 39280/371472 [3:07:51<27:15:30,  3.39it/s]
                                                           
{'loss': 4.4868, 'learning_rate': 9.052662199142408e-07, 'epoch': 1.69}

 11%|█         | 39280/371472 [3:07:51<27:15:30,  3.39it/s]
 11%|█         | 39281/371472 [3:07:52<26:11:40,  3.52it/s]
 11%|█         | 39282/371472 [3:07:52<26:25:18,  3.49it/s]
 11%|█         | 39283/371472 [3:07:52<25:38:21,  3.60it/s]
 11%|█         | 39284/371472 [3:07:52<25:42:45,  3.59it/s]
 11%|█         | 39285/371472 [3:07:53<26:51:13,  3.44it/s]
 11%|█         | 39286/371472 [3:07:53<26:41:56,  3.46it/s]
 11%|█         | 39287/371472 [3:07:53<26:10:46,  3.52it/s]
 11%|█         | 39288/371472 [3:07:54<25:38:32,  3.60it/s]
 11%|█         | 39289/371472 [3:07:54<25:35:58,  3.60it/s]
 11%|█         | 39290/371472 [3:07:54<25:36:42,  3.60it/s]
 11%|█         | 39291/371472 [3:07:54<24:55:40,  3.70it/s]
 11%|█         | 39292/371472 [3:07:55<24:43:02,  3.73it/s]
 11%|█         | 39293/371472 [3:07:55<24:51:08,  3.71it/s]
 11%|█         | 39294/371472 [3:07:55<24:06:38,  3.83it/s]
 11%|█         | 39295/371472 [3:07:55<25:24:01,  3.63it/s]
 11%|█         | 39296/371472 [3:07:56<26:54:28,  3.43it/s]
 11%|█         | 39297/371472 [3:07:56<26:23:33,  3.50it/s]
 11%|█         | 39298/371472 [3:07:56<26:43:38,  3.45it/s]
 11%|█         | 39299/371472 [3:07:57<26:08:08,  3.53it/s]
 11%|█         | 39300/371472 [3:07:57<24:57:54,  3.70it/s]
                                                           
{'loss': 4.3956, 'learning_rate': 9.052177379387618e-07, 'epoch': 1.69}

 11%|█         | 39300/371472 [3:07:57<24:57:54,  3.70it/s]
 11%|█         | 39301/371472 [3:07:57<26:42:23,  3.45it/s]
 11%|█         | 39302/371472 [3:07:57<26:19:36,  3.50it/s]
 11%|█         | 39303/371472 [3:07:58<25:33:21,  3.61it/s]
 11%|█         | 39304/371472 [3:07:58<27:00:35,  3.42it/s]
 11%|█         | 39305/371472 [3:07:58<27:32:12,  3.35it/s]
 11%|█         | 39306/371472 [3:07:59<28:26:26,  3.24it/s]
 11%|█         | 39307/371472 [3:07:59<27:08:13,  3.40it/s]
 11%|█         | 39308/371472 [3:07:59<27:42:18,  3.33it/s]
 11%|█         | 39309/371472 [3:08:00<26:43:16,  3.45it/s]
 11%|█         | 39310/371472 [3:08:00<25:40:19,  3.59it/s]
 11%|█         | 39311/371472 [3:08:00<26:02:06,  3.54it/s]
 11%|█         | 39312/371472 [3:08:00<26:50:44,  3.44it/s]
 11%|█         | 39313/371472 [3:08:01<29:39:58,  3.11it/s]
 11%|█         | 39314/371472 [3:08:01<28:07:28,  3.28it/s]
 11%|█         | 39315/371472 [3:08:01<26:56:41,  3.42it/s]
 11%|█         | 39316/371472 [3:08:02<26:40:28,  3.46it/s]
 11%|█         | 39317/371472 [3:08:02<27:22:30,  3.37it/s]
 11%|█         | 39318/371472 [3:08:02<27:25:04,  3.37it/s]
 11%|█         | 39319/371472 [3:08:02<26:03:26,  3.54it/s]
 11%|█         | 39320/371472 [3:08:03<25:14:40,  3.65it/s]
                                                           
{'loss': 4.5938, 'learning_rate': 9.051692559632829e-07, 'epoch': 1.69}

 11%|█         | 39320/371472 [3:08:03<25:14:40,  3.65it/s]
 11%|█         | 39321/371472 [3:08:03<26:16:17,  3.51it/s]
 11%|█         | 39322/371472 [3:08:03<26:02:57,  3.54it/s]
 11%|█         | 39323/371472 [3:08:04<25:47:56,  3.58it/s]
 11%|█         | 39324/371472 [3:08:04<24:49:32,  3.72it/s]
 11%|█         | 39325/371472 [3:08:04<25:23:23,  3.63it/s]
 11%|█         | 39326/371472 [3:08:04<25:05:20,  3.68it/s]
 11%|█         | 39327/371472 [3:08:05<24:45:03,  3.73it/s]
 11%|█         | 39328/371472 [3:08:05<24:16:10,  3.80it/s]
 11%|█         | 39329/371472 [3:08:05<24:13:54,  3.81it/s]
 11%|█         | 39330/371472 [3:08:05<24:40:54,  3.74it/s]
 11%|█         | 39331/371472 [3:08:06<25:00:31,  3.69it/s]
 11%|█         | 39332/371472 [3:08:06<25:37:09,  3.60it/s]
 11%|█         | 39333/371472 [3:08:06<25:20:19,  3.64it/s]
 11%|█         | 39334/371472 [3:08:07<25:47:24,  3.58it/s]
 11%|█         | 39335/371472 [3:08:07<25:27:49,  3.62it/s]
 11%|█         | 39336/371472 [3:08:07<25:11:31,  3.66it/s]
 11%|█         | 39337/371472 [3:08:07<26:02:28,  3.54it/s]
 11%|█         | 39338/371472 [3:08:08<26:23:10,  3.50it/s]
 11%|█         | 39339/371472 [3:08:08<26:03:44,  3.54it/s]
 11%|█         | 39340/371472 [3:08:08<25:50:48,  3.57it/s]
                                                           
{'loss': 4.4835, 'learning_rate': 9.05120773987804e-07, 'epoch': 1.69}

 11%|█         | 39340/371472 [3:08:08<25:50:48,  3.57it/s]
 11%|█         | 39341/371472 [3:08:09<26:17:15,  3.51it/s]
 11%|█         | 39342/371472 [3:08:09<27:32:39,  3.35it/s]
 11%|█         | 39343/371472 [3:08:09<26:45:06,  3.45it/s]
 11%|█         | 39344/371472 [3:08:09<27:25:29,  3.36it/s]
 11%|█         | 39345/371472 [3:08:10<27:29:47,  3.36it/s]
 11%|█         | 39346/371472 [3:08:10<29:28:44,  3.13it/s]
 11%|█         | 39347/371472 [3:08:10<28:16:56,  3.26it/s]
 11%|█         | 39348/371472 [3:08:11<28:53:19,  3.19it/s]
 11%|█         | 39349/371472 [3:08:11<29:35:09,  3.12it/s]
 11%|█         | 39350/371472 [3:08:11<28:37:43,  3.22it/s]
 11%|█         | 39351/371472 [3:08:12<27:56:41,  3.30it/s]
 11%|█         | 39352/371472 [3:08:12<26:21:54,  3.50it/s]
 11%|█         | 39353/371472 [3:08:12<26:07:03,  3.53it/s]
 11%|█         | 39354/371472 [3:08:12<28:36:34,  3.22it/s]
 11%|█         | 39355/371472 [3:08:13<29:47:54,  3.10it/s]
 11%|█         | 39356/371472 [3:08:13<28:36:02,  3.23it/s]
 11%|█         | 39357/371472 [3:08:13<28:53:42,  3.19it/s]
 11%|█         | 39358/371472 [3:08:14<27:17:17,  3.38it/s]
 11%|█         | 39359/371472 [3:08:14<25:32:43,  3.61it/s]
 11%|█         | 39360/371472 [3:08:14<25:42:23,  3.59it/s]
                                                           
{'loss': 4.2902, 'learning_rate': 9.050722920123252e-07, 'epoch': 1.7}

 11%|█         | 39360/371472 [3:08:14<25:42:23,  3.59it/s]
 11%|█         | 39361/371472 [3:08:14<25:19:55,  3.64it/s]
 11%|█         | 39362/371472 [3:08:15<24:46:29,  3.72it/s]
 11%|█         | 39363/371472 [3:08:15<25:21:52,  3.64it/s]
 11%|█         | 39364/371472 [3:08:15<25:31:19,  3.61it/s]
 11%|█         | 39365/371472 [3:08:16<24:52:02,  3.71it/s]
 11%|█         | 39366/371472 [3:08:16<27:42:18,  3.33it/s]
 11%|█         | 39367/371472 [3:08:16<28:12:52,  3.27it/s]
 11%|█         | 39368/371472 [3:08:17<27:40:10,  3.33it/s]
 11%|█         | 39369/371472 [3:08:17<26:27:13,  3.49it/s]
 11%|█         | 39370/371472 [3:08:17<25:47:11,  3.58it/s]
 11%|█         | 39371/371472 [3:08:17<25:55:21,  3.56it/s]
 11%|█         | 39372/371472 [3:08:18<26:45:35,  3.45it/s]
 11%|█         | 39373/371472 [3:08:18<25:53:49,  3.56it/s]
 11%|█         | 39374/371472 [3:08:18<25:23:14,  3.63it/s]
 11%|█         | 39375/371472 [3:08:18<25:47:07,  3.58it/s]
 11%|█         | 39376/371472 [3:08:19<27:22:59,  3.37it/s]
 11%|█         | 39377/371472 [3:08:19<26:24:22,  3.49it/s]
 11%|█         | 39378/371472 [3:08:19<25:46:34,  3.58it/s]
 11%|█         | 39379/371472 [3:08:20<26:04:06,  3.54it/s]
 11%|█         | 39380/371472 [3:08:20<25:24:22,  3.63it/s]
                                                           
{'loss': 4.3747, 'learning_rate': 9.050238100368462e-07, 'epoch': 1.7}

 11%|█         | 39380/371472 [3:08:20<25:24:22,  3.63it/s]
 11%|█         | 39381/371472 [3:08:20<24:51:56,  3.71it/s]
 11%|█         | 39382/371472 [3:08:20<24:22:52,  3.78it/s]
 11%|█         | 39383/371472 [3:08:21<25:42:16,  3.59it/s]
 11%|█         | 39384/371472 [3:08:21<27:35:04,  3.34it/s]
 11%|█         | 39385/371472 [3:08:21<26:46:34,  3.45it/s]
 11%|█         | 39386/371472 [3:08:22<31:34:35,  2.92it/s]
 11%|█         | 39387/371472 [3:08:22<30:57:25,  2.98it/s]
 11%|█         | 39388/371472 [3:08:22<30:08:50,  3.06it/s]
 11%|█         | 39389/371472 [3:08:23<30:02:25,  3.07it/s]
 11%|█         | 39390/371472 [3:08:23<29:09:27,  3.16it/s]
 11%|█         | 39391/371472 [3:08:23<27:32:10,  3.35it/s]
 11%|█         | 39392/371472 [3:08:24<26:45:41,  3.45it/s]
 11%|█         | 39393/371472 [3:08:24<26:07:53,  3.53it/s]
 11%|█         | 39394/371472 [3:08:24<27:00:35,  3.42it/s]
 11%|█         | 39395/371472 [3:08:24<27:14:41,  3.39it/s]
 11%|█         | 39396/371472 [3:08:25<26:06:23,  3.53it/s]
 11%|█         | 39397/371472 [3:08:25<26:17:07,  3.51it/s]
 11%|█         | 39398/371472 [3:08:25<25:20:10,  3.64it/s]
 11%|█         | 39399/371472 [3:08:26<26:04:47,  3.54it/s]
 11%|█         | 39400/371472 [3:08:26<25:40:12,  3.59it/s]
                                                           
{'loss': 4.482, 'learning_rate': 9.049753280613674e-07, 'epoch': 1.7}

 11%|█         | 39400/371472 [3:08:26<25:40:12,  3.59it/s]
 11%|█         | 39401/371472 [3:08:26<28:59:39,  3.18it/s]
 11%|█         | 39402/371472 [3:08:26<28:24:18,  3.25it/s]
 11%|█         | 39403/371472 [3:08:27<26:42:02,  3.45it/s]
 11%|█         | 39404/371472 [3:08:27<26:57:49,  3.42it/s]
 11%|█         | 39405/371472 [3:08:27<27:48:18,  3.32it/s]
 11%|█         | 39406/371472 [3:08:28<26:38:12,  3.46it/s]
 11%|█         | 39407/371472 [3:08:28<26:13:41,  3.52it/s]
 11%|█         | 39408/371472 [3:08:28<26:35:36,  3.47it/s]
 11%|█         | 39409/371472 [3:08:29<27:24:51,  3.36it/s]
 11%|█         | 39410/371472 [3:08:29<26:10:37,  3.52it/s]
 11%|█         | 39411/371472 [3:08:29<25:26:16,  3.63it/s]
 11%|█         | 39412/371472 [3:08:29<24:49:17,  3.72it/s]
 11%|█         | 39413/371472 [3:08:30<26:11:23,  3.52it/s]
 11%|█         | 39414/371472 [3:08:30<26:42:41,  3.45it/s]
 11%|█         | 39415/371472 [3:08:30<25:31:34,  3.61it/s]
 11%|█         | 39416/371472 [3:08:30<26:12:32,  3.52it/s]
 11%|█         | 39417/371472 [3:08:31<25:12:24,  3.66it/s]
 11%|█         | 39418/371472 [3:08:31<27:21:02,  3.37it/s]
 11%|█         | 39419/371472 [3:08:31<26:27:51,  3.49it/s]
 11%|█         | 39420/371472 [3:08:32<25:52:18,  3.57it/s]
                                                           
{'loss': 4.2359, 'learning_rate': 9.049268460858885e-07, 'epoch': 1.7}

 11%|█         | 39420/371472 [3:08:32<25:52:18,  3.57it/s]
 11%|█         | 39421/371472 [3:08:32<25:06:47,  3.67it/s]
 11%|█         | 39422/371472 [3:08:32<24:55:46,  3.70it/s]
 11%|█         | 39423/371472 [3:08:32<24:28:47,  3.77it/s]
 11%|█         | 39424/371472 [3:08:33<24:51:05,  3.71it/s]
 11%|█         | 39425/371472 [3:08:33<25:33:18,  3.61it/s]
 11%|█         | 39426/371472 [3:08:33<26:58:53,  3.42it/s]
 11%|█         | 39427/371472 [3:08:34<28:13:08,  3.27it/s]
 11%|█         | 39428/371472 [3:08:34<28:27:34,  3.24it/s]
 11%|█         | 39429/371472 [3:08:34<26:45:21,  3.45it/s]
 11%|█         | 39430/371472 [3:08:34<27:54:40,  3.30it/s]
 11%|█         | 39431/371472 [3:08:35<26:11:53,  3.52it/s]
 11%|█         | 39432/371472 [3:08:35<29:56:35,  3.08it/s]
 11%|█         | 39433/371472 [3:08:35<29:15:11,  3.15it/s]
 11%|█         | 39434/371472 [3:08:36<27:22:00,  3.37it/s]
 11%|█         | 39435/371472 [3:08:36<28:57:55,  3.18it/s]
 11%|█         | 39436/371472 [3:08:36<27:48:23,  3.32it/s]
 11%|█         | 39437/371472 [3:08:37<26:50:27,  3.44it/s]
 11%|█         | 39438/371472 [3:08:37<26:15:12,  3.51it/s]
 11%|█         | 39439/371472 [3:08:37<25:00:08,  3.69it/s]
 11%|█         | 39440/371472 [3:08:37<25:21:13,  3.64it/s]
                                                           
{'loss': 4.3643, 'learning_rate': 9.048783641104097e-07, 'epoch': 1.7}

 11%|█         | 39440/371472 [3:08:37<25:21:13,  3.64it/s]
 11%|█         | 39441/371472 [3:08:38<24:36:45,  3.75it/s]
 11%|█         | 39442/371472 [3:08:38<24:02:30,  3.84it/s]
 11%|█         | 39443/371472 [3:08:38<24:18:10,  3.80it/s]
 11%|█         | 39444/371472 [3:08:39<27:48:46,  3.32it/s]
 11%|█         | 39445/371472 [3:08:39<26:42:11,  3.45it/s]
 11%|█         | 39446/371472 [3:08:39<26:44:00,  3.45it/s]
 11%|█         | 39447/371472 [3:08:39<26:40:16,  3.46it/s]
 11%|█         | 39448/371472 [3:08:40<26:25:01,  3.49it/s]
 11%|█         | 39449/371472 [3:08:40<26:39:36,  3.46it/s]
 11%|█         | 39450/371472 [3:08:40<26:28:47,  3.48it/s]
 11%|█         | 39451/371472 [3:08:40<25:19:54,  3.64it/s]
 11%|█         | 39452/371472 [3:08:41<25:41:08,  3.59it/s]
 11%|█         | 39453/371472 [3:08:41<27:28:11,  3.36it/s]
 11%|█         | 39454/371472 [3:08:41<26:28:21,  3.48it/s]
 11%|█         | 39455/371472 [3:08:42<25:59:35,  3.55it/s]
 11%|█         | 39456/371472 [3:08:42<25:37:02,  3.60it/s]
 11%|█         | 39457/371472 [3:08:42<25:05:10,  3.68it/s]
 11%|█         | 39458/371472 [3:08:42<25:30:47,  3.61it/s]
 11%|█         | 39459/371472 [3:08:43<25:36:00,  3.60it/s]
 11%|█         | 39460/371472 [3:08:43<26:24:25,  3.49it/s]
                                                           
{'loss': 4.1877, 'learning_rate': 9.048298821349306e-07, 'epoch': 1.7}

 11%|█         | 39460/371472 [3:08:43<26:24:25,  3.49it/s]
 11%|█         | 39461/371472 [3:08:43<30:20:51,  3.04it/s]
 11%|█         | 39462/371472 [3:08:44<30:08:26,  3.06it/s]
 11%|█         | 39463/371472 [3:08:44<28:29:46,  3.24it/s]
 11%|█         | 39464/371472 [3:08:44<26:44:48,  3.45it/s]
 11%|█         | 39465/371472 [3:08:45<26:11:49,  3.52it/s]
 11%|█         | 39466/371472 [3:08:45<27:32:24,  3.35it/s]
 11%|█         | 39467/371472 [3:08:45<26:39:40,  3.46it/s]
 11%|█         | 39468/371472 [3:08:45<26:30:57,  3.48it/s]
 11%|█         | 39469/371472 [3:08:46<26:51:42,  3.43it/s]
 11%|█         | 39470/371472 [3:08:46<26:23:00,  3.50it/s]
 11%|█         | 39471/371472 [3:08:46<25:44:29,  3.58it/s]
 11%|█         | 39472/371472 [3:08:47<25:22:19,  3.63it/s]
 11%|█         | 39473/371472 [3:08:47<25:41:01,  3.59it/s]
 11%|█         | 39474/371472 [3:08:47<26:09:02,  3.53it/s]
 11%|█         | 39475/371472 [3:08:47<25:35:02,  3.60it/s]
 11%|█         | 39476/371472 [3:08:48<24:34:02,  3.75it/s]
 11%|█         | 39477/371472 [3:08:48<24:57:00,  3.70it/s]
 11%|█         | 39478/371472 [3:08:48<25:06:44,  3.67it/s]
 11%|█         | 39479/371472 [3:08:49<27:00:33,  3.41it/s]
 11%|█         | 39480/371472 [3:08:49<27:12:36,  3.39it/s]
                                                           
{'loss': 4.1596, 'learning_rate': 9.047814001594518e-07, 'epoch': 1.7}

 11%|█         | 39480/371472 [3:08:49<27:12:36,  3.39it/s]
 11%|█         | 39481/371472 [3:08:49<26:36:43,  3.47it/s]
 11%|█         | 39482/371472 [3:08:49<25:22:12,  3.63it/s]
 11%|█         | 39483/371472 [3:08:50<26:19:59,  3.50it/s]
 11%|█         | 39484/371472 [3:08:50<26:13:39,  3.52it/s]
 11%|█         | 39485/371472 [3:08:50<26:20:52,  3.50it/s]
 11%|█         | 39486/371472 [3:08:50<25:52:59,  3.56it/s]
 11%|█         | 39487/371472 [3:08:51<27:21:29,  3.37it/s]
 11%|█         | 39488/371472 [3:08:51<27:33:58,  3.35it/s]
 11%|█         | 39489/371472 [3:08:51<26:35:00,  3.47it/s]
 11%|█         | 39490/371472 [3:08:52<26:30:38,  3.48it/s]
 11%|█         | 39491/371472 [3:08:52<28:52:04,  3.19it/s]
 11%|█         | 39492/371472 [3:08:52<28:25:06,  3.24it/s]
 11%|█         | 39493/371472 [3:08:53<29:50:20,  3.09it/s]
 11%|█         | 39494/371472 [3:08:53<27:55:54,  3.30it/s]
 11%|█         | 39495/371472 [3:08:53<27:14:58,  3.38it/s]
 11%|█         | 39496/371472 [3:08:53<25:53:23,  3.56it/s]
 11%|█         | 39497/371472 [3:08:54<28:09:15,  3.28it/s]
 11%|█         | 39498/371472 [3:08:54<27:10:53,  3.39it/s]
 11%|█         | 39499/371472 [3:08:54<26:49:53,  3.44it/s]
 11%|█         | 39500/371472 [3:08:55<26:00:32,  3.55it/s]
                                                           
{'loss': 4.2136, 'learning_rate': 9.047329181839729e-07, 'epoch': 1.7}

 11%|█         | 39500/371472 [3:08:55<26:00:32,  3.55it/s]
 11%|█         | 39501/371472 [3:08:55<28:14:02,  3.27it/s]
 11%|█         | 39502/371472 [3:08:55<27:03:16,  3.41it/s]
 11%|█         | 39503/371472 [3:08:56<28:41:30,  3.21it/s]
 11%|█         | 39504/371472 [3:08:56<27:37:32,  3.34it/s]
 11%|█         | 39505/371472 [3:08:56<26:29:36,  3.48it/s]
 11%|█         | 39506/371472 [3:08:56<25:25:28,  3.63it/s]
 11%|█         | 39507/371472 [3:08:57<24:45:24,  3.72it/s]
 11%|█         | 39508/371472 [3:08:57<24:39:37,  3.74it/s]
 11%|█         | 39509/371472 [3:08:57<25:45:25,  3.58it/s]
 11%|█         | 39510/371472 [3:08:58<26:36:04,  3.47it/s]
 11%|█         | 39511/371472 [3:08:58<26:14:28,  3.51it/s]
 11%|█         | 39512/371472 [3:08:58<26:31:42,  3.48it/s]
 11%|█         | 39513/371472 [3:08:58<26:46:26,  3.44it/s]
 11%|█         | 39514/371472 [3:08:59<26:12:45,  3.52it/s]
 11%|█         | 39515/371472 [3:08:59<25:22:00,  3.64it/s]
 11%|█         | 39516/371472 [3:08:59<28:06:24,  3.28it/s]
 11%|█         | 39517/371472 [3:09:00<28:13:54,  3.27it/s]
 11%|█         | 39518/371472 [3:09:00<27:10:10,  3.39it/s]
 11%|█         | 39519/371472 [3:09:00<26:02:27,  3.54it/s]
 11%|█         | 39520/371472 [3:09:00<27:06:26,  3.40it/s]
                                                           
{'loss': 4.3671, 'learning_rate': 9.04684436208494e-07, 'epoch': 1.7}

 11%|█         | 39520/371472 [3:09:00<27:06:26,  3.40it/s]
 11%|█         | 39521/371472 [3:09:01<28:40:24,  3.22it/s]
 11%|█         | 39522/371472 [3:09:01<27:16:38,  3.38it/s]
 11%|█         | 39523/371472 [3:09:01<27:18:04,  3.38it/s]
 11%|█         | 39524/371472 [3:09:02<26:34:46,  3.47it/s]
 11%|█         | 39525/371472 [3:09:02<26:18:10,  3.51it/s]
 11%|█         | 39526/371472 [3:09:02<25:32:41,  3.61it/s]
 11%|█         | 39527/371472 [3:09:02<25:21:22,  3.64it/s]
 11%|█         | 39528/371472 [3:09:03<26:14:49,  3.51it/s]
 11%|█         | 39529/371472 [3:09:03<27:14:20,  3.39it/s]
 11%|█         | 39530/371472 [3:09:03<28:28:58,  3.24it/s]
 11%|█         | 39531/371472 [3:09:04<29:09:39,  3.16it/s]
 11%|█         | 39532/371472 [3:09:04<29:48:47,  3.09it/s]
 11%|█         | 39533/371472 [3:09:04<28:00:51,  3.29it/s]
 11%|█         | 39534/371472 [3:09:05<26:36:23,  3.47it/s]
 11%|█         | 39535/371472 [3:09:05<28:52:33,  3.19it/s]
 11%|█         | 39536/371472 [3:09:05<28:24:16,  3.25it/s]
 11%|█         | 39537/371472 [3:09:06<27:19:04,  3.38it/s]
 11%|█         | 39538/371472 [3:09:06<26:27:08,  3.49it/s]
 11%|█         | 39539/371472 [3:09:06<25:39:20,  3.59it/s]
 11%|█         | 39540/371472 [3:09:06<25:06:24,  3.67it/s]
                                                           
{'loss': 4.3725, 'learning_rate': 9.046359542330151e-07, 'epoch': 1.7}

 11%|█         | 39540/371472 [3:09:06<25:06:24,  3.67it/s]
 11%|█         | 39541/371472 [3:09:07<25:17:45,  3.64it/s]
 11%|█         | 39542/371472 [3:09:07<25:46:48,  3.58it/s]
 11%|█         | 39543/371472 [3:09:07<25:39:51,  3.59it/s]
 11%|█         | 39544/371472 [3:09:07<25:47:17,  3.58it/s]
 11%|█         | 39545/371472 [3:09:08<26:11:17,  3.52it/s]
 11%|█         | 39546/371472 [3:09:08<28:10:49,  3.27it/s]
 11%|█         | 39547/371472 [3:09:08<27:52:15,  3.31it/s]
 11%|█         | 39548/371472 [3:09:09<26:58:32,  3.42it/s]
 11%|█         | 39549/371472 [3:09:09<26:12:10,  3.52it/s]
 11%|█         | 39550/371472 [3:09:09<26:24:10,  3.49it/s]
 11%|█         | 39551/371472 [3:09:10<26:25:13,  3.49it/s]
 11%|█         | 39552/371472 [3:09:10<25:56:25,  3.55it/s]
 11%|█         | 39553/371472 [3:09:10<26:15:01,  3.51it/s]
 11%|█         | 39554/371472 [3:09:10<25:44:58,  3.58it/s]
 11%|█         | 39555/371472 [3:09:11<25:47:02,  3.58it/s]
 11%|█         | 39556/371472 [3:09:11<29:11:38,  3.16it/s]
 11%|█         | 39557/371472 [3:09:11<28:00:59,  3.29it/s]
 11%|█         | 39558/371472 [3:09:12<26:59:24,  3.42it/s]
 11%|█         | 39559/371472 [3:09:12<26:52:01,  3.43it/s]
 11%|█         | 39560/371472 [3:09:12<28:31:28,  3.23it/s]
                                                           
{'loss': 4.4943, 'learning_rate': 9.045874722575363e-07, 'epoch': 1.7}

 11%|█         | 39560/371472 [3:09:12<28:31:28,  3.23it/s]
 11%|█         | 39561/371472 [3:09:12<27:25:46,  3.36it/s]
 11%|█         | 39562/371472 [3:09:13<26:35:22,  3.47it/s]
 11%|█         | 39563/371472 [3:09:13<28:54:41,  3.19it/s]
 11%|█         | 39564/371472 [3:09:13<28:06:13,  3.28it/s]
 11%|█         | 39565/371472 [3:09:14<27:17:45,  3.38it/s]
 11%|█         | 39566/371472 [3:09:14<27:28:30,  3.36it/s]
 11%|█         | 39567/371472 [3:09:14<27:25:44,  3.36it/s]
 11%|█         | 39568/371472 [3:09:15<27:23:40,  3.37it/s]
 11%|█         | 39569/371472 [3:09:15<27:33:28,  3.35it/s]
 11%|█         | 39570/371472 [3:09:15<27:14:08,  3.39it/s]
 11%|█         | 39571/371472 [3:09:15<26:37:38,  3.46it/s]
 11%|█         | 39572/371472 [3:09:16<26:07:49,  3.53it/s]
 11%|█         | 39573/371472 [3:09:16<25:29:21,  3.62it/s]
 11%|█         | 39574/371472 [3:09:16<25:10:25,  3.66it/s]
 11%|█         | 39575/371472 [3:09:17<25:34:14,  3.61it/s]
 11%|█         | 39576/371472 [3:09:17<25:27:04,  3.62it/s]
 11%|█         | 39577/371472 [3:09:17<26:07:20,  3.53it/s]
 11%|█         | 39578/371472 [3:09:17<25:51:38,  3.56it/s]
 11%|█         | 39579/371472 [3:09:18<25:43:09,  3.58it/s]
 11%|█         | 39580/371472 [3:09:18<28:28:14,  3.24it/s]
                                                           
{'loss': 4.429, 'learning_rate': 9.045389902820573e-07, 'epoch': 1.7}

 11%|█         | 39580/371472 [3:09:18<28:28:14,  3.24it/s]
 11%|█         | 39581/371472 [3:09:18<28:28:16,  3.24it/s]
 11%|█         | 39582/371472 [3:09:19<27:37:18,  3.34it/s]
 11%|█         | 39583/371472 [3:09:19<27:53:48,  3.30it/s]
 11%|█         | 39584/371472 [3:09:19<27:47:32,  3.32it/s]
 11%|█         | 39585/371472 [3:09:19<26:42:17,  3.45it/s]
 11%|█         | 39586/371472 [3:09:20<27:10:07,  3.39it/s]
 11%|█         | 39587/371472 [3:09:20<26:09:34,  3.52it/s]
 11%|█         | 39588/371472 [3:09:20<25:53:52,  3.56it/s]
 11%|█         | 39589/371472 [3:09:21<25:55:35,  3.56it/s]
 11%|█         | 39590/371472 [3:09:21<26:38:03,  3.46it/s]
 11%|█         | 39591/371472 [3:09:21<26:47:26,  3.44it/s]
 11%|█         | 39592/371472 [3:09:22<27:35:33,  3.34it/s]
 11%|█         | 39593/371472 [3:09:22<26:43:42,  3.45it/s]
 11%|█         | 39594/371472 [3:09:22<26:01:55,  3.54it/s]
 11%|█         | 39595/371472 [3:09:22<25:20:29,  3.64it/s]
 11%|█         | 39596/371472 [3:09:23<25:22:58,  3.63it/s]
 11%|█         | 39597/371472 [3:09:23<28:23:59,  3.25it/s]
 11%|█         | 39598/371472 [3:09:23<27:56:38,  3.30it/s]
 11%|█         | 39599/371472 [3:09:24<26:43:43,  3.45it/s]
 11%|█         | 39600/371472 [3:09:24<26:23:53,  3.49it/s]
                                                           
{'loss': 4.4638, 'learning_rate': 9.044905083065783e-07, 'epoch': 1.71}

 11%|█         | 39600/371472 [3:09:24<26:23:53,  3.49it/s]
 11%|█         | 39601/371472 [3:09:24<25:39:14,  3.59it/s]
 11%|█         | 39602/371472 [3:09:24<25:20:21,  3.64it/s]
 11%|█         | 39603/371472 [3:09:25<25:37:35,  3.60it/s]
 11%|█         | 39604/371472 [3:09:25<25:42:35,  3.59it/s]
 11%|█         | 39605/371472 [3:09:25<25:16:03,  3.65it/s]
 11%|█         | 39606/371472 [3:09:25<25:14:27,  3.65it/s]
 11%|█         | 39607/371472 [3:09:26<27:10:37,  3.39it/s]
 11%|█         | 39608/371472 [3:09:26<27:29:06,  3.35it/s]
 11%|█         | 39609/371472 [3:09:26<27:39:48,  3.33it/s]
 11%|█         | 39610/371472 [3:09:27<26:20:07,  3.50it/s]
 11%|█         | 39611/371472 [3:09:27<25:37:12,  3.60it/s]
 11%|█         | 39612/371472 [3:09:27<27:22:12,  3.37it/s]
 11%|█         | 39613/371472 [3:09:28<27:07:52,  3.40it/s]
 11%|█         | 39614/371472 [3:09:28<26:40:41,  3.46it/s]
 11%|█         | 39615/371472 [3:09:28<28:26:26,  3.24it/s]
 11%|█         | 39616/371472 [3:09:28<29:22:18,  3.14it/s]
 11%|█         | 39617/371472 [3:09:29<27:54:14,  3.30it/s]
 11%|█         | 39618/371472 [3:09:29<26:37:14,  3.46it/s]
 11%|█         | 39619/371472 [3:09:29<26:20:10,  3.50it/s]
 11%|█         | 39620/371472 [3:09:30<27:08:50,  3.40it/s]
                                                           
{'loss': 4.3664, 'learning_rate': 9.044420263310995e-07, 'epoch': 1.71}

 11%|█         | 39620/371472 [3:09:30<27:08:50,  3.40it/s]
 11%|█         | 39621/371472 [3:09:30<26:21:44,  3.50it/s]
 11%|█         | 39622/371472 [3:09:30<25:44:49,  3.58it/s]
 11%|█         | 39623/371472 [3:09:30<26:28:26,  3.48it/s]
 11%|█         | 39624/371472 [3:09:31<25:45:42,  3.58it/s]
 11%|█         | 39625/371472 [3:09:31<25:21:26,  3.64it/s]
 11%|█         | 39626/371472 [3:09:31<25:46:49,  3.58it/s]
 11%|█         | 39627/371472 [3:09:32<25:30:15,  3.61it/s]
 11%|█         | 39628/371472 [3:09:32<25:03:51,  3.68it/s]
 11%|█         | 39629/371472 [3:09:32<26:07:21,  3.53it/s]
 11%|█         | 39630/371472 [3:09:32<25:22:50,  3.63it/s]
 11%|█         | 39631/371472 [3:09:33<25:15:14,  3.65it/s]
 11%|█         | 39632/371472 [3:09:33<24:48:49,  3.71it/s]
 11%|█         | 39633/371472 [3:09:33<24:35:56,  3.75it/s]
 11%|█         | 39634/371472 [3:09:33<24:38:16,  3.74it/s]
 11%|█         | 39635/371472 [3:09:34<24:54:08,  3.70it/s]
 11%|█         | 39636/371472 [3:09:34<26:01:38,  3.54it/s]
 11%|█         | 39637/371472 [3:09:34<25:35:27,  3.60it/s]
 11%|█         | 39638/371472 [3:09:35<26:54:39,  3.43it/s]
 11%|█         | 39639/371472 [3:09:35<26:04:59,  3.53it/s]
 11%|█         | 39640/371472 [3:09:35<26:36:36,  3.46it/s]
                                                           
{'loss': 4.3404, 'learning_rate': 9.043935443556205e-07, 'epoch': 1.71}

 11%|█         | 39640/371472 [3:09:35<26:36:36,  3.46it/s]
 11%|█         | 39641/371472 [3:09:35<25:51:36,  3.56it/s]
 11%|█         | 39642/371472 [3:09:36<26:39:53,  3.46it/s]
 11%|█         | 39643/371472 [3:09:36<26:27:17,  3.48it/s]
 11%|█         | 39644/371472 [3:09:36<25:59:24,  3.55it/s]
 11%|█         | 39645/371472 [3:09:37<25:36:22,  3.60it/s]
 11%|█         | 39646/371472 [3:09:37<27:14:12,  3.38it/s]
 11%|█         | 39647/371472 [3:09:37<26:16:43,  3.51it/s]
 11%|█         | 39648/371472 [3:09:37<25:11:42,  3.66it/s]
 11%|█         | 39649/371472 [3:09:38<25:31:40,  3.61it/s]
 11%|█         | 39650/371472 [3:09:38<25:01:27,  3.68it/s]
 11%|█         | 39651/371472 [3:09:38<24:34:06,  3.75it/s]
 11%|█         | 39652/371472 [3:09:38<24:07:10,  3.82it/s]
 11%|█         | 39653/371472 [3:09:39<26:04:59,  3.53it/s]
 11%|█         | 39654/371472 [3:09:39<25:56:06,  3.55it/s]
 11%|█         | 39655/371472 [3:09:39<26:05:48,  3.53it/s]
 11%|█         | 39656/371472 [3:09:40<26:25:02,  3.49it/s]
 11%|█         | 39657/371472 [3:09:40<26:00:10,  3.54it/s]
 11%|█         | 39658/371472 [3:09:40<26:41:13,  3.45it/s]
 11%|█         | 39659/371472 [3:09:40<26:24:35,  3.49it/s]
 11%|█         | 39660/371472 [3:09:41<25:50:22,  3.57it/s]
                                                           
{'loss': 4.3263, 'learning_rate': 9.043450623801418e-07, 'epoch': 1.71}

 11%|█         | 39660/371472 [3:09:41<25:50:22,  3.57it/s]
 11%|█         | 39661/371472 [3:09:41<25:17:15,  3.64it/s]
 11%|█         | 39662/371472 [3:09:41<25:42:10,  3.59it/s]
 11%|█         | 39663/371472 [3:09:42<25:13:23,  3.65it/s]
 11%|█         | 39664/371472 [3:09:42<24:48:32,  3.72it/s]
 11%|█         | 39665/371472 [3:09:42<24:26:20,  3.77it/s]
 11%|█         | 39666/371472 [3:09:42<25:23:35,  3.63it/s]
 11%|█         | 39667/371472 [3:09:43<24:59:37,  3.69it/s]
 11%|█         | 39668/371472 [3:09:43<25:08:08,  3.67it/s]
 11%|█         | 39669/371472 [3:09:43<25:22:04,  3.63it/s]
 11%|█         | 39670/371472 [3:09:43<25:26:53,  3.62it/s]
 11%|█         | 39671/371472 [3:09:44<26:33:11,  3.47it/s]
 11%|█         | 39672/371472 [3:09:44<25:59:55,  3.55it/s]
 11%|█         | 39673/371472 [3:09:44<25:01:59,  3.68it/s]
 11%|█         | 39674/371472 [3:09:45<25:00:55,  3.68it/s]
 11%|█         | 39675/371472 [3:09:45<25:43:48,  3.58it/s]
 11%|█         | 39676/371472 [3:09:45<27:18:38,  3.37it/s]
 11%|█         | 39677/371472 [3:09:46<26:52:06,  3.43it/s]
 11%|█         | 39678/371472 [3:09:46<27:18:35,  3.37it/s]
 11%|█         | 39679/371472 [3:09:46<26:34:09,  3.47it/s]
 11%|█         | 39680/371472 [3:09:46<28:25:34,  3.24it/s]
                                                           
{'loss': 4.2613, 'learning_rate': 9.042965804046628e-07, 'epoch': 1.71}

 11%|█         | 39680/371472 [3:09:46<28:25:34,  3.24it/s]
 11%|█         | 39681/371472 [3:09:47<27:00:25,  3.41it/s]
 11%|█         | 39682/371472 [3:09:47<26:04:17,  3.54it/s]
 11%|█         | 39683/371472 [3:09:47<25:42:51,  3.58it/s]
 11%|█         | 39684/371472 [3:09:48<25:52:49,  3.56it/s]
 11%|█         | 39685/371472 [3:09:48<26:09:47,  3.52it/s]
 11%|█         | 39686/371472 [3:09:48<25:46:05,  3.58it/s]
 11%|█         | 39687/371472 [3:09:48<26:42:17,  3.45it/s]
 11%|█         | 39688/371472 [3:09:49<26:40:35,  3.45it/s]
 11%|█         | 39689/371472 [3:09:49<25:53:39,  3.56it/s]
 11%|█         | 39690/371472 [3:09:49<27:24:44,  3.36it/s]
 11%|█         | 39691/371472 [3:09:50<28:34:12,  3.23it/s]
 11%|█         | 39692/371472 [3:09:50<26:59:15,  3.41it/s]
 11%|█         | 39693/371472 [3:09:50<25:48:05,  3.57it/s]
 11%|█         | 39694/371472 [3:09:50<25:23:25,  3.63it/s]
 11%|█         | 39695/371472 [3:09:51<24:38:19,  3.74it/s]
 11%|█         | 39696/371472 [3:09:51<25:32:10,  3.61it/s]
 11%|█         | 39697/371472 [3:09:51<25:54:31,  3.56it/s]
 11%|█         | 39698/371472 [3:09:51<25:29:09,  3.62it/s]
 11%|█         | 39699/371472 [3:09:52<25:17:25,  3.64it/s]
 11%|█         | 39700/371472 [3:09:52<25:26:34,  3.62it/s]
                                                           
{'loss': 4.1147, 'learning_rate': 9.04248098429184e-07, 'epoch': 1.71}

 11%|█         | 39700/371472 [3:09:52<25:26:34,  3.62it/s]
 11%|█         | 39701/371472 [3:09:52<27:18:13,  3.38it/s]
 11%|█         | 39702/371472 [3:09:53<29:23:38,  3.14it/s]
 11%|█         | 39703/371472 [3:09:53<28:03:26,  3.28it/s]
 11%|█         | 39704/371472 [3:09:53<26:42:01,  3.45it/s]
 11%|█         | 39705/371472 [3:09:54<28:14:47,  3.26it/s]
 11%|█         | 39706/371472 [3:09:54<27:05:49,  3.40it/s]
 11%|█         | 39707/371472 [3:09:54<27:16:18,  3.38it/s]
 11%|█         | 39708/371472 [3:09:55<30:55:16,  2.98it/s]
 11%|█         | 39709/371472 [3:09:55<29:05:07,  3.17it/s]
 11%|█         | 39710/371472 [3:09:55<28:11:06,  3.27it/s]
 11%|█         | 39711/371472 [3:09:55<27:27:43,  3.36it/s]
 11%|█         | 39712/371472 [3:09:56<26:49:12,  3.44it/s]
 11%|█         | 39713/371472 [3:09:56<28:06:09,  3.28it/s]
 11%|█         | 39714/371472 [3:09:56<30:10:43,  3.05it/s]
 11%|█         | 39715/371472 [3:09:57<29:01:14,  3.18it/s]
 11%|█         | 39716/371472 [3:09:57<27:40:55,  3.33it/s]
 11%|█         | 39717/371472 [3:09:57<27:23:29,  3.36it/s]
 11%|█         | 39718/371472 [3:09:58<26:53:35,  3.43it/s]
 11%|█         | 39719/371472 [3:09:58<25:47:50,  3.57it/s]
 11%|█         | 39720/371472 [3:09:58<25:10:18,  3.66it/s]
                                                           
{'loss': 4.2168, 'learning_rate': 9.04199616453705e-07, 'epoch': 1.71}

 11%|█         | 39720/371472 [3:09:58<25:10:18,  3.66it/s]
 11%|█         | 39721/371472 [3:09:58<26:38:48,  3.46it/s]
 11%|█         | 39722/371472 [3:09:59<26:48:53,  3.44it/s]
 11%|█         | 39723/371472 [3:09:59<25:59:10,  3.55it/s]
 11%|█         | 39724/371472 [3:09:59<25:43:34,  3.58it/s]
 11%|█         | 39725/371472 [3:10:00<25:55:19,  3.55it/s]
 11%|█         | 39726/371472 [3:10:00<25:01:02,  3.68it/s]
 11%|█         | 39727/371472 [3:10:00<24:59:43,  3.69it/s]
 11%|█         | 39728/371472 [3:10:00<26:40:21,  3.45it/s]
 11%|█         | 39729/371472 [3:10:01<27:25:21,  3.36it/s]
 11%|█         | 39730/371472 [3:10:01<27:32:24,  3.35it/s]
 11%|█         | 39731/371472 [3:10:01<27:07:12,  3.40it/s]
 11%|█         | 39732/371472 [3:10:01<25:23:24,  3.63it/s]
 11%|█         | 39733/371472 [3:10:02<25:28:17,  3.62it/s]
 11%|█         | 39734/371472 [3:10:02<25:14:03,  3.65it/s]
 11%|█         | 39735/371472 [3:10:02<25:14:33,  3.65it/s]
 11%|█         | 39736/371472 [3:10:03<25:10:08,  3.66it/s]
 11%|█         | 39737/371472 [3:10:03<24:51:15,  3.71it/s]
 11%|█         | 39738/371472 [3:10:03<24:41:58,  3.73it/s]
 11%|█         | 39739/371472 [3:10:03<27:00:00,  3.41it/s]
 11%|█         | 39740/371472 [3:10:04<26:15:55,  3.51it/s]
                                                           
{'loss': 4.0227, 'learning_rate': 9.041511344782263e-07, 'epoch': 1.71}

 11%|█         | 39740/371472 [3:10:04<26:15:55,  3.51it/s]
 11%|█         | 39741/371472 [3:10:04<25:44:42,  3.58it/s]
 11%|█         | 39742/371472 [3:10:04<25:31:04,  3.61it/s]
 11%|█         | 39743/371472 [3:10:05<25:30:20,  3.61it/s]
 11%|█         | 39744/371472 [3:10:05<24:49:12,  3.71it/s]
 11%|█         | 39745/371472 [3:10:05<25:16:12,  3.65it/s]
 11%|█         | 39746/371472 [3:10:05<25:24:41,  3.63it/s]
 11%|█         | 39747/371472 [3:10:06<24:39:42,  3.74it/s]
 11%|█         | 39748/371472 [3:10:06<24:51:53,  3.71it/s]
 11%|█         | 39749/371472 [3:10:06<24:23:14,  3.78it/s]
 11%|█         | 39750/371472 [3:10:06<24:59:53,  3.69it/s]
 11%|█         | 39751/371472 [3:10:07<26:26:20,  3.49it/s]
 11%|█         | 39752/371472 [3:10:07<25:54:51,  3.56it/s]
 11%|█         | 39753/371472 [3:10:07<26:36:17,  3.46it/s]
 11%|█         | 39754/371472 [3:10:08<25:52:06,  3.56it/s]
 11%|█         | 39755/371472 [3:10:08<27:28:50,  3.35it/s]
 11%|█         | 39756/371472 [3:10:08<26:33:43,  3.47it/s]
 11%|█         | 39757/371472 [3:10:08<25:54:21,  3.56it/s]
 11%|█         | 39758/371472 [3:10:09<25:26:19,  3.62it/s]
 11%|█         | 39759/371472 [3:10:09<25:27:19,  3.62it/s]
 11%|█         | 39760/371472 [3:10:09<25:34:59,  3.60it/s]
                                                           
{'loss': 4.563, 'learning_rate': 9.041026525027472e-07, 'epoch': 1.71}

 11%|█         | 39760/371472 [3:10:09<25:34:59,  3.60it/s]
 11%|█         | 39761/371472 [3:10:10<25:13:11,  3.65it/s]
 11%|█         | 39762/371472 [3:10:10<24:30:39,  3.76it/s]
 11%|█         | 39763/371472 [3:10:10<26:48:33,  3.44it/s]
 11%|█         | 39764/371472 [3:10:10<27:29:01,  3.35it/s]
 11%|█         | 39765/371472 [3:10:11<27:11:29,  3.39it/s]
 11%|█         | 39766/371472 [3:10:11<27:04:31,  3.40it/s]
 11%|█         | 39767/371472 [3:10:11<25:54:10,  3.56it/s]
 11%|█         | 39768/371472 [3:10:12<27:25:18,  3.36it/s]
 11%|█         | 39769/371472 [3:10:12<26:54:52,  3.42it/s]
 11%|█         | 39770/371472 [3:10:12<25:59:43,  3.54it/s]
 11%|█         | 39771/371472 [3:10:13<29:16:28,  3.15it/s]
 11%|█         | 39772/371472 [3:10:13<29:34:55,  3.11it/s]
 11%|█         | 39773/371472 [3:10:13<29:23:26,  3.13it/s]
 11%|█         | 39774/371472 [3:10:14<29:25:28,  3.13it/s]
 11%|█         | 39775/371472 [3:10:14<28:28:31,  3.24it/s]
 11%|█         | 39776/371472 [3:10:14<31:08:09,  2.96it/s]
 11%|█         | 39777/371472 [3:10:15<30:42:31,  3.00it/s]
 11%|█         | 39778/371472 [3:10:15<28:36:38,  3.22it/s]
 11%|█         | 39779/371472 [3:10:15<27:45:08,  3.32it/s]
 11%|█         | 39780/371472 [3:10:15<28:11:22,  3.27it/s]
                                                           
{'loss': 4.4562, 'learning_rate': 9.040541705272684e-07, 'epoch': 1.71}

 11%|█         | 39780/371472 [3:10:15<28:11:22,  3.27it/s]
 11%|█         | 39781/371472 [3:10:16<29:01:26,  3.17it/s]
 11%|█         | 39782/371472 [3:10:16<28:33:55,  3.23it/s]
 11%|█         | 39783/371472 [3:10:16<27:37:21,  3.34it/s]
 11%|█         | 39784/371472 [3:10:17<27:24:47,  3.36it/s]
 11%|█         | 39785/371472 [3:10:17<27:12:48,  3.39it/s]
 11%|█         | 39786/371472 [3:10:17<27:13:27,  3.38it/s]
 11%|█         | 39787/371472 [3:10:18<28:12:17,  3.27it/s]
 11%|█         | 39788/371472 [3:10:18<26:43:18,  3.45it/s]
 11%|█         | 39789/371472 [3:10:18<26:06:45,  3.53it/s]
 11%|█         | 39790/371472 [3:10:18<26:17:12,  3.50it/s]
 11%|█         | 39791/371472 [3:10:19<25:42:03,  3.58it/s]
 11%|█         | 39792/371472 [3:10:19<27:26:54,  3.36it/s]
 11%|█         | 39793/371472 [3:10:19<26:50:33,  3.43it/s]
 11%|█         | 39794/371472 [3:10:19<26:43:57,  3.45it/s]
 11%|█         | 39795/371472 [3:10:20<25:57:51,  3.55it/s]
 11%|█         | 39796/371472 [3:10:20<25:11:06,  3.66it/s]
 11%|█         | 39797/371472 [3:10:20<24:50:47,  3.71it/s]
 11%|█         | 39798/371472 [3:10:21<26:06:16,  3.53it/s]
 11%|█         | 39799/371472 [3:10:21<24:42:18,  3.73it/s]
 11%|█         | 39800/371472 [3:10:21<24:32:20,  3.75it/s]
                                                           
{'loss': 4.3732, 'learning_rate': 9.040056885517895e-07, 'epoch': 1.71}

 11%|█         | 39800/371472 [3:10:21<24:32:20,  3.75it/s]
 11%|█         | 39801/371472 [3:10:21<24:18:53,  3.79it/s]
 11%|█         | 39802/371472 [3:10:22<25:32:52,  3.61it/s]
 11%|█         | 39803/371472 [3:10:22<25:05:37,  3.67it/s]
 11%|█         | 39804/371472 [3:10:22<26:29:15,  3.48it/s]
 11%|█         | 39805/371472 [3:10:22<26:17:48,  3.50it/s]
 11%|█         | 39806/371472 [3:10:23<25:33:53,  3.60it/s]
 11%|█         | 39807/371472 [3:10:23<27:09:21,  3.39it/s]
 11%|█         | 39808/371472 [3:10:23<27:01:57,  3.41it/s]
 11%|█         | 39809/371472 [3:10:24<26:58:54,  3.41it/s]
 11%|█         | 39810/371472 [3:10:24<25:57:32,  3.55it/s]
 11%|█         | 39811/371472 [3:10:24<26:26:32,  3.48it/s]
 11%|█         | 39812/371472 [3:10:25<27:34:07,  3.34it/s]
 11%|█         | 39813/371472 [3:10:25<26:22:56,  3.49it/s]
 11%|█         | 39814/371472 [3:10:25<26:51:37,  3.43it/s]
 11%|█         | 39815/371472 [3:10:25<28:36:48,  3.22it/s]
 11%|█         | 39816/371472 [3:10:26<27:14:44,  3.38it/s]
 11%|█         | 39817/371472 [3:10:26<26:39:34,  3.46it/s]
 11%|█         | 39818/371472 [3:10:26<25:58:02,  3.55it/s]
 11%|█         | 39819/371472 [3:10:27<26:22:13,  3.49it/s]
 11%|█         | 39820/371472 [3:10:27<25:30:09,  3.61it/s]
                                                           
{'loss': 4.5097, 'learning_rate': 9.039572065763107e-07, 'epoch': 1.72}

 11%|█         | 39820/371472 [3:10:27<25:30:09,  3.61it/s]
 11%|█         | 39821/371472 [3:10:27<26:03:39,  3.53it/s]
 11%|█         | 39822/371472 [3:10:27<26:07:28,  3.53it/s]
 11%|█         | 39823/371472 [3:10:28<26:06:07,  3.53it/s]
 11%|█         | 39824/371472 [3:10:28<25:30:56,  3.61it/s]
 11%|█         | 39825/371472 [3:10:28<26:03:24,  3.54it/s]
 11%|█         | 39826/371472 [3:10:29<26:38:11,  3.46it/s]
 11%|█         | 39827/371472 [3:10:29<25:35:59,  3.60it/s]
 11%|█         | 39828/371472 [3:10:29<25:09:50,  3.66it/s]
 11%|█         | 39829/371472 [3:10:29<25:54:53,  3.55it/s]
 11%|█         | 39830/371472 [3:10:30<25:38:46,  3.59it/s]
 11%|█         | 39831/371472 [3:10:30<27:17:37,  3.38it/s]
 11%|█         | 39832/371472 [3:10:30<26:48:56,  3.44it/s]
 11%|█         | 39833/371472 [3:10:31<26:00:23,  3.54it/s]
 11%|█         | 39834/371472 [3:10:31<26:37:43,  3.46it/s]
 11%|█         | 39835/371472 [3:10:31<25:51:07,  3.56it/s]
 11%|█         | 39836/371472 [3:10:31<25:03:03,  3.68it/s]
 11%|█         | 39837/371472 [3:10:32<24:03:16,  3.83it/s]
 11%|█         | 39838/371472 [3:10:32<23:44:41,  3.88it/s]
 11%|█         | 39839/371472 [3:10:32<24:51:43,  3.71it/s]
 11%|█         | 39840/371472 [3:10:32<25:29:31,  3.61it/s]
                                                           
{'loss': 4.4336, 'learning_rate': 9.039087246008316e-07, 'epoch': 1.72}

 11%|█         | 39840/371472 [3:10:32<25:29:31,  3.61it/s]
 11%|█         | 39841/371472 [3:10:33<25:53:44,  3.56it/s]
 11%|█         | 39842/371472 [3:10:33<26:31:28,  3.47it/s]
 11%|█         | 39843/371472 [3:10:33<25:36:30,  3.60it/s]
 11%|█         | 39844/371472 [3:10:34<25:59:28,  3.54it/s]
 11%|█         | 39845/371472 [3:10:34<26:59:37,  3.41it/s]
 11%|█         | 39846/371472 [3:10:34<27:06:25,  3.40it/s]
 11%|█         | 39847/371472 [3:10:34<26:28:33,  3.48it/s]
 11%|█         | 39848/371472 [3:10:35<27:00:25,  3.41it/s]
 11%|█         | 39849/371472 [3:10:35<26:48:16,  3.44it/s]
 11%|█         | 39850/371472 [3:10:35<25:29:39,  3.61it/s]
 11%|█         | 39851/371472 [3:10:36<24:47:32,  3.72it/s]
 11%|█         | 39852/371472 [3:10:36<24:37:02,  3.74it/s]
 11%|█         | 39853/371472 [3:10:36<25:14:35,  3.65it/s]
 11%|█         | 39854/371472 [3:10:37<29:29:13,  3.12it/s]
 11%|█         | 39855/371472 [3:10:37<27:33:59,  3.34it/s]
 11%|█         | 39856/371472 [3:10:37<28:50:02,  3.19it/s]
 11%|█         | 39857/371472 [3:10:37<28:57:40,  3.18it/s]
 11%|█         | 39858/371472 [3:10:38<27:26:04,  3.36it/s]
 11%|█         | 39859/371472 [3:10:38<26:25:57,  3.48it/s]
 11%|█         | 39860/371472 [3:10:38<26:06:40,  3.53it/s]
                                                           
{'loss': 4.3732, 'learning_rate': 9.038602426253528e-07, 'epoch': 1.72}

 11%|█         | 39860/371472 [3:10:38<26:06:40,  3.53it/s]
 11%|█         | 39861/371472 [3:10:38<25:22:37,  3.63it/s]
 11%|█         | 39862/371472 [3:10:39<25:18:28,  3.64it/s]
 11%|█         | 39863/371472 [3:10:39<24:40:58,  3.73it/s]
 11%|█         | 39864/371472 [3:10:39<24:13:19,  3.80it/s]
 11%|█         | 39865/371472 [3:10:40<24:54:08,  3.70it/s]
 11%|█         | 39866/371472 [3:10:40<24:32:31,  3.75it/s]
 11%|█         | 39867/371472 [3:10:40<24:29:15,  3.76it/s]
 11%|█         | 39868/371472 [3:10:40<27:11:36,  3.39it/s]
 11%|█         | 39869/371472 [3:10:41<25:49:32,  3.57it/s]
 11%|█         | 39870/371472 [3:10:41<26:31:01,  3.47it/s]
 11%|█         | 39871/371472 [3:10:41<26:50:27,  3.43it/s]
 11%|█         | 39872/371472 [3:10:42<26:35:05,  3.46it/s]
 11%|█         | 39873/371472 [3:10:42<25:40:49,  3.59it/s]
 11%|█         | 39874/371472 [3:10:42<25:53:29,  3.56it/s]
 11%|█         | 39875/371472 [3:10:42<25:51:22,  3.56it/s]
 11%|█         | 39876/371472 [3:10:43<25:37:46,  3.59it/s]
 11%|█         | 39877/371472 [3:10:43<24:43:12,  3.73it/s]
 11%|█         | 39878/371472 [3:10:43<25:05:13,  3.67it/s]
 11%|█         | 39879/371472 [3:10:44<31:12:50,  2.95it/s]
 11%|█         | 39880/371472 [3:10:44<30:11:46,  3.05it/s]
                                                           
{'loss': 4.214, 'learning_rate': 9.038117606498739e-07, 'epoch': 1.72}

 11%|█         | 39880/371472 [3:10:44<30:11:46,  3.05it/s]
 11%|█         | 39881/371472 [3:10:44<28:59:18,  3.18it/s]
 11%|█         | 39882/371472 [3:10:45<28:47:25,  3.20it/s]
 11%|█         | 39883/371472 [3:10:45<27:35:20,  3.34it/s]
 11%|█         | 39884/371472 [3:10:45<26:58:07,  3.42it/s]
 11%|█         | 39885/371472 [3:10:45<26:23:04,  3.49it/s]
 11%|█         | 39886/371472 [3:10:46<26:59:48,  3.41it/s]
 11%|█         | 39887/371472 [3:10:46<27:08:01,  3.39it/s]
 11%|█         | 39888/371472 [3:10:46<27:00:51,  3.41it/s]
 11%|█         | 39889/371472 [3:10:47<26:21:44,  3.49it/s]
 11%|█         | 39890/371472 [3:10:47<26:21:57,  3.49it/s]
 11%|█         | 39891/371472 [3:10:47<27:41:35,  3.33it/s]
 11%|█         | 39892/371472 [3:10:47<27:19:26,  3.37it/s]
 11%|█         | 39893/371472 [3:10:48<26:20:59,  3.50it/s]
 11%|█         | 39894/371472 [3:10:48<26:01:28,  3.54it/s]
 11%|█         | 39895/371472 [3:10:48<27:05:26,  3.40it/s]
 11%|█         | 39896/371472 [3:10:49<27:08:42,  3.39it/s]
 11%|█         | 39897/371472 [3:10:49<26:00:27,  3.54it/s]
 11%|█         | 39898/371472 [3:10:49<27:17:01,  3.38it/s]
 11%|█         | 39899/371472 [3:10:49<26:07:21,  3.53it/s]
 11%|█         | 39900/371472 [3:10:50<25:18:24,  3.64it/s]
                                                           
{'loss': 4.3972, 'learning_rate': 9.037632786743951e-07, 'epoch': 1.72}

 11%|█         | 39900/371472 [3:10:50<25:18:24,  3.64it/s]
 11%|█         | 39901/371472 [3:10:50<26:24:06,  3.49it/s]
 11%|█         | 39902/371472 [3:10:50<26:02:02,  3.54it/s]
 11%|█         | 39903/371472 [3:10:51<26:20:56,  3.50it/s]
 11%|█         | 39904/371472 [3:10:51<25:47:18,  3.57it/s]
 11%|█         | 39905/371472 [3:10:51<26:01:29,  3.54it/s]
 11%|█         | 39906/371472 [3:10:51<26:33:39,  3.47it/s]
 11%|█         | 39907/371472 [3:10:52<28:58:18,  3.18it/s]
 11%|█         | 39908/371472 [3:10:52<27:33:04,  3.34it/s]
 11%|█         | 39909/371472 [3:10:52<28:46:30,  3.20it/s]
 11%|█         | 39910/371472 [3:10:53<28:21:06,  3.25it/s]
 11%|█         | 39911/371472 [3:10:53<26:59:30,  3.41it/s]
 11%|█         | 39912/371472 [3:10:53<25:58:52,  3.54it/s]
 11%|█         | 39913/371472 [3:10:54<25:39:56,  3.59it/s]
 11%|█         | 39914/371472 [3:10:54<27:53:23,  3.30it/s]
 11%|█         | 39915/371472 [3:10:54<29:52:41,  3.08it/s]
 11%|█         | 39916/371472 [3:10:55<29:33:59,  3.11it/s]
 11%|█         | 39917/371472 [3:10:55<28:18:05,  3.25it/s]
 11%|█         | 39918/371472 [3:10:55<27:45:59,  3.32it/s]
 11%|█         | 39919/371472 [3:10:55<27:16:54,  3.38it/s]
 11%|█         | 39920/371472 [3:10:56<26:01:42,  3.54it/s]
                                                           
{'loss': 4.3894, 'learning_rate': 9.037147966989161e-07, 'epoch': 1.72}

 11%|█         | 39920/371472 [3:10:56<26:01:42,  3.54it/s]
 11%|█         | 39921/371472 [3:10:56<25:02:37,  3.68it/s]
 11%|█         | 39922/371472 [3:10:56<24:17:21,  3.79it/s]
 11%|█         | 39923/371472 [3:10:56<23:55:27,  3.85it/s]
 11%|█         | 39924/371472 [3:10:57<24:16:43,  3.79it/s]
 11%|█         | 39925/371472 [3:10:57<24:13:02,  3.80it/s]
 11%|█         | 39926/371472 [3:10:57<24:01:08,  3.83it/s]
 11%|█         | 39927/371472 [3:10:57<24:26:05,  3.77it/s]
 11%|█         | 39928/371472 [3:10:58<25:28:59,  3.61it/s]
 11%|█         | 39929/371472 [3:10:58<25:56:58,  3.55it/s]
 11%|█         | 39930/371472 [3:10:58<26:32:33,  3.47it/s]
 11%|█         | 39931/371472 [3:10:59<26:54:06,  3.42it/s]
 11%|█         | 39932/371472 [3:10:59<26:28:51,  3.48it/s]
 11%|█         | 39933/371472 [3:10:59<25:48:28,  3.57it/s]
 11%|█         | 39934/371472 [3:10:59<25:50:34,  3.56it/s]
 11%|█         | 39935/371472 [3:11:00<26:01:20,  3.54it/s]
 11%|█         | 39936/371472 [3:11:00<27:02:16,  3.41it/s]
 11%|█         | 39937/371472 [3:11:00<26:40:18,  3.45it/s]
 11%|█         | 39938/371472 [3:11:01<25:13:48,  3.65it/s]
 11%|█         | 39939/371472 [3:11:01<25:48:27,  3.57it/s]
 11%|█         | 39940/371472 [3:11:01<25:36:47,  3.60it/s]
                                                           
{'loss': 4.2121, 'learning_rate': 9.036663147234373e-07, 'epoch': 1.72}

 11%|█         | 39940/371472 [3:11:01<25:36:47,  3.60it/s]
 11%|█         | 39941/371472 [3:11:01<26:37:02,  3.46it/s]
 11%|█         | 39942/371472 [3:11:02<26:33:23,  3.47it/s]
 11%|█         | 39943/371472 [3:11:02<26:18:56,  3.50it/s]
 11%|█         | 39944/371472 [3:11:02<26:29:56,  3.48it/s]
 11%|█         | 39945/371472 [3:11:03<26:51:05,  3.43it/s]
 11%|█         | 39946/371472 [3:11:03<26:55:45,  3.42it/s]
 11%|█         | 39947/371472 [3:11:03<25:45:59,  3.57it/s]
 11%|█         | 39948/371472 [3:11:03<26:21:36,  3.49it/s]
 11%|█         | 39949/371472 [3:11:04<26:08:50,  3.52it/s]
 11%|█         | 39950/371472 [3:11:04<28:24:17,  3.24it/s]
 11%|█         | 39951/371472 [3:11:04<29:03:07,  3.17it/s]
 11%|█         | 39952/371472 [3:11:05<27:35:22,  3.34it/s]
 11%|█         | 39953/371472 [3:11:05<27:04:41,  3.40it/s]
 11%|█         | 39954/371472 [3:11:05<27:46:18,  3.32it/s]
 11%|█         | 39955/371472 [3:11:06<27:19:48,  3.37it/s]
 11%|█         | 39956/371472 [3:11:06<26:23:19,  3.49it/s]
 11%|█         | 39957/371472 [3:11:06<27:03:01,  3.40it/s]
 11%|█         | 39958/371472 [3:11:06<25:58:26,  3.55it/s]
 11%|█         | 39959/371472 [3:11:07<26:20:40,  3.50it/s]
 11%|█         | 39960/371472 [3:11:07<25:16:57,  3.64it/s]
                                                           
{'loss': 4.3815, 'learning_rate': 9.036178327479583e-07, 'epoch': 1.72}

 11%|█         | 39960/371472 [3:11:07<25:16:57,  3.64it/s]
 11%|█         | 39961/371472 [3:11:07<26:04:52,  3.53it/s]
 11%|█         | 39962/371472 [3:11:08<26:56:44,  3.42it/s]
 11%|█         | 39963/371472 [3:11:08<26:47:18,  3.44it/s]
 11%|█         | 39964/371472 [3:11:08<26:53:44,  3.42it/s]
 11%|█         | 39965/371472 [3:11:08<26:09:35,  3.52it/s]
 11%|█         | 39966/371472 [3:11:09<25:46:42,  3.57it/s]
 11%|█         | 39967/371472 [3:11:09<25:37:49,  3.59it/s]
 11%|█         | 39968/371472 [3:11:09<26:57:18,  3.42it/s]
 11%|█         | 39969/371472 [3:11:10<25:21:24,  3.63it/s]
 11%|█         | 39970/371472 [3:11:10<26:01:32,  3.54it/s]
 11%|█         | 39971/371472 [3:11:10<25:23:06,  3.63it/s]
 11%|█         | 39972/371472 [3:11:10<25:43:39,  3.58it/s]
 11%|█         | 39973/371472 [3:11:11<26:39:20,  3.45it/s]
 11%|█         | 39974/371472 [3:11:11<25:57:34,  3.55it/s]
 11%|█         | 39975/371472 [3:11:11<27:30:13,  3.35it/s]
 11%|█         | 39976/371472 [3:11:12<26:42:02,  3.45it/s]
 11%|█         | 39977/371472 [3:11:12<26:30:05,  3.47it/s]
 11%|█         | 39978/371472 [3:11:12<26:30:55,  3.47it/s]
 11%|█         | 39979/371472 [3:11:12<25:49:04,  3.57it/s]
 11%|█         | 39980/371472 [3:11:13<25:04:57,  3.67it/s]
                                                           
{'loss': 4.4487, 'learning_rate': 9.035693507724794e-07, 'epoch': 1.72}

 11%|█         | 39980/371472 [3:11:13<25:04:57,  3.67it/s]
 11%|█         | 39981/371472 [3:11:13<26:36:07,  3.46it/s]
 11%|█         | 39982/371472 [3:11:13<28:02:27,  3.28it/s]
 11%|█         | 39983/371472 [3:11:14<28:15:32,  3.26it/s]
 11%|█         | 39984/371472 [3:11:14<27:52:15,  3.30it/s]
 11%|█         | 39985/371472 [3:11:14<27:08:45,  3.39it/s]
 11%|█         | 39986/371472 [3:11:14<25:54:23,  3.55it/s]
 11%|█         | 39987/371472 [3:11:15<25:26:30,  3.62it/s]
 11%|█         | 39988/371472 [3:11:15<24:36:37,  3.74it/s]
 11%|█         | 39989/371472 [3:11:15<26:48:57,  3.43it/s]
 11%|█         | 39990/371472 [3:11:16<25:36:46,  3.59it/s]
 11%|█         | 39991/371472 [3:11:16<26:31:08,  3.47it/s]
 11%|█         | 39992/371472 [3:11:16<25:54:48,  3.55it/s]
 11%|█         | 39993/371472 [3:11:16<25:58:14,  3.55it/s]
 11%|█         | 39994/371472 [3:11:17<25:39:40,  3.59it/s]
 11%|█         | 39995/371472 [3:11:17<28:29:20,  3.23it/s]
 11%|█         | 39996/371472 [3:11:17<27:31:51,  3.34it/s]
 11%|█         | 39997/371472 [3:11:18<26:13:24,  3.51it/s]
 11%|█         | 39998/371472 [3:11:18<25:33:25,  3.60it/s]
 11%|█         | 39999/371472 [3:11:18<25:00:16,  3.68it/s]
 11%|█         | 40000/371472 [3:11:18<25:35:49,  3.60it/s]
                                                           
{'loss': 4.2327, 'learning_rate': 9.035208687970005e-07, 'epoch': 1.72}

 11%|█         | 40000/371472 [3:11:18<25:35:49,  3.60it/s]
 11%|█         | 40001/371472 [3:11:19<27:24:30,  3.36it/s]
 11%|█         | 40002/371472 [3:11:19<27:09:42,  3.39it/s]
 11%|█         | 40003/371472 [3:11:19<26:54:07,  3.42it/s]
 11%|█         | 40004/371472 [3:11:20<27:32:56,  3.34it/s]
 11%|█         | 40005/371472 [3:11:20<26:23:17,  3.49it/s]
 11%|█         | 40006/371472 [3:11:20<25:49:08,  3.57it/s]
 11%|█         | 40007/371472 [3:11:20<25:38:30,  3.59it/s]
 11%|█         | 40008/371472 [3:11:21<25:27:55,  3.62it/s]
 11%|█         | 40009/371472 [3:11:21<25:50:52,  3.56it/s]
 11%|█         | 40010/371472 [3:11:21<26:41:33,  3.45it/s]
 11%|█         | 40011/371472 [3:11:22<26:53:19,  3.42it/s]
 11%|█         | 40012/371472 [3:11:22<25:45:03,  3.58it/s]
 11%|█         | 40013/371472 [3:11:22<26:04:48,  3.53it/s]
 11%|█         | 40014/371472 [3:11:22<25:20:03,  3.63it/s]
 11%|█         | 40015/371472 [3:11:23<25:28:56,  3.61it/s]
 11%|█         | 40016/371472 [3:11:23<25:53:20,  3.56it/s]
 11%|█         | 40017/371472 [3:11:23<25:57:11,  3.55it/s]
 11%|█         | 40018/371472 [3:11:24<25:55:07,  3.55it/s]
 11%|█         | 40019/371472 [3:11:24<26:03:29,  3.53it/s]
 11%|█         | 40020/371472 [3:11:24<25:21:04,  3.63it/s]
                                                           
{'loss': 4.1977, 'learning_rate': 9.034723868215217e-07, 'epoch': 1.72}

 11%|█         | 40020/371472 [3:11:24<25:21:04,  3.63it/s]
 11%|█         | 40021/371472 [3:11:24<25:06:25,  3.67it/s]
 11%|█         | 40022/371472 [3:11:25<25:33:01,  3.60it/s]
 11%|█         | 40023/371472 [3:11:25<24:56:34,  3.69it/s]
 11%|█         | 40024/371472 [3:11:25<27:36:56,  3.33it/s]
 11%|█         | 40025/371472 [3:11:26<26:57:03,  3.42it/s]
 11%|█         | 40026/371472 [3:11:26<28:00:05,  3.29it/s]
 11%|█         | 40027/371472 [3:11:26<26:39:01,  3.45it/s]
 11%|█         | 40028/371472 [3:11:26<26:19:03,  3.50it/s]
 11%|█         | 40029/371472 [3:11:27<25:23:50,  3.63it/s]
 11%|█         | 40030/371472 [3:11:27<24:38:30,  3.74it/s]
 11%|█         | 40031/371472 [3:11:27<25:58:10,  3.55it/s]
 11%|█         | 40032/371472 [3:11:28<27:05:47,  3.40it/s]
 11%|█         | 40033/371472 [3:11:28<26:56:20,  3.42it/s]
 11%|█         | 40034/371472 [3:11:28<27:08:57,  3.39it/s]
 11%|█         | 40035/371472 [3:11:28<26:34:50,  3.46it/s]
 11%|█         | 40036/371472 [3:11:29<25:48:04,  3.57it/s]
 11%|█         | 40037/371472 [3:11:29<25:08:53,  3.66it/s]
 11%|█         | 40038/371472 [3:11:29<24:29:43,  3.76it/s]
 11%|█         | 40039/371472 [3:11:30<26:27:41,  3.48it/s]
 11%|█         | 40040/371472 [3:11:30<26:10:57,  3.52it/s]
                                                           
{'loss': 4.6189, 'learning_rate': 9.034239048460428e-07, 'epoch': 1.72}

 11%|█         | 40040/371472 [3:11:30<26:10:57,  3.52it/s]
 11%|█         | 40041/371472 [3:11:30<26:15:41,  3.51it/s]
 11%|█         | 40042/371472 [3:11:30<25:55:25,  3.55it/s]
 11%|█         | 40043/371472 [3:11:31<27:41:44,  3.32it/s]
 11%|█         | 40044/371472 [3:11:31<28:39:23,  3.21it/s]
 11%|█         | 40045/371472 [3:11:31<27:00:34,  3.41it/s]
 11%|█         | 40046/371472 [3:11:32<25:56:13,  3.55it/s]
 11%|█         | 40047/371472 [3:11:32<27:23:59,  3.36it/s]
 11%|█         | 40048/371472 [3:11:32<27:59:52,  3.29it/s]
 11%|█         | 40049/371472 [3:11:32<26:42:36,  3.45it/s]
 11%|█         | 40050/371472 [3:11:33<26:48:15,  3.43it/s]
 11%|█         | 40051/371472 [3:11:33<27:54:45,  3.30it/s]
 11%|█         | 40052/371472 [3:11:33<27:04:28,  3.40it/s]
 11%|█         | 40053/371472 [3:11:34<26:06:53,  3.53it/s]
 11%|█         | 40054/371472 [3:11:34<26:41:14,  3.45it/s]
 11%|█         | 40055/371472 [3:11:34<26:20:52,  3.49it/s]
 11%|█         | 40056/371472 [3:11:35<26:31:10,  3.47it/s]
 11%|█         | 40057/371472 [3:11:35<25:56:03,  3.55it/s]
 11%|█         | 40058/371472 [3:11:35<27:29:39,  3.35it/s]
 11%|█         | 40059/371472 [3:11:35<26:56:16,  3.42it/s]
 11%|█         | 40060/371472 [3:11:36<26:08:45,  3.52it/s]
                                                           
{'loss': 4.366, 'learning_rate': 9.033754228705638e-07, 'epoch': 1.73}

 11%|█         | 40060/371472 [3:11:36<26:08:45,  3.52it/s]
 11%|█         | 40061/371472 [3:11:36<26:05:25,  3.53it/s]
 11%|█         | 40062/371472 [3:11:36<26:03:21,  3.53it/s]
 11%|█         | 40063/371472 [3:11:37<27:41:55,  3.32it/s]
 11%|█         | 40064/371472 [3:11:37<26:53:30,  3.42it/s]
 11%|█         | 40065/371472 [3:11:37<27:54:23,  3.30it/s]
 11%|█         | 40066/371472 [3:11:37<26:17:51,  3.50it/s]
 11%|█         | 40067/371472 [3:11:38<26:54:50,  3.42it/s]
 11%|█         | 40068/371472 [3:11:38<27:53:25,  3.30it/s]
 11%|█         | 40069/371472 [3:11:38<27:53:24,  3.30it/s]
 11%|█         | 40070/371472 [3:11:39<27:50:58,  3.31it/s]
 11%|█         | 40071/371472 [3:11:39<27:14:46,  3.38it/s]
 11%|█         | 40072/371472 [3:11:39<26:46:11,  3.44it/s]
 11%|█         | 40073/371472 [3:11:40<28:17:54,  3.25it/s]
 11%|█         | 40074/371472 [3:11:40<27:46:59,  3.31it/s]
 11%|█         | 40075/371472 [3:11:40<27:06:46,  3.40it/s]
 11%|█         | 40076/371472 [3:11:40<26:22:02,  3.49it/s]
 11%|█         | 40077/371472 [3:11:41<25:34:12,  3.60it/s]
 11%|█         | 40078/371472 [3:11:41<26:46:09,  3.44it/s]
 11%|█         | 40079/371472 [3:11:41<26:30:17,  3.47it/s]
 11%|█         | 40080/371472 [3:11:42<26:50:26,  3.43it/s]
                                                           
{'loss': 4.3975, 'learning_rate': 9.03326940895085e-07, 'epoch': 1.73}

 11%|█         | 40080/371472 [3:11:42<26:50:26,  3.43it/s]
 11%|█         | 40081/371472 [3:11:42<26:00:24,  3.54it/s]
 11%|█         | 40082/371472 [3:11:42<25:29:36,  3.61it/s]
 11%|█         | 40083/371472 [3:11:42<26:11:04,  3.52it/s]
 11%|█         | 40084/371472 [3:11:43<25:18:26,  3.64it/s]
 11%|█         | 40085/371472 [3:11:43<26:03:34,  3.53it/s]
 11%|█         | 40086/371472 [3:11:43<26:19:34,  3.50it/s]
 11%|█         | 40087/371472 [3:11:44<27:28:44,  3.35it/s]
 11%|█         | 40088/371472 [3:11:44<26:10:38,  3.52it/s]
 11%|█         | 40089/371472 [3:11:44<25:13:33,  3.65it/s]
 11%|█         | 40090/371472 [3:11:44<26:52:35,  3.42it/s]
 11%|█         | 40091/371472 [3:11:45<27:11:17,  3.39it/s]
 11%|█         | 40092/371472 [3:11:45<25:47:46,  3.57it/s]
 11%|█         | 40093/371472 [3:11:45<25:37:07,  3.59it/s]
 11%|█         | 40094/371472 [3:11:45<24:55:43,  3.69it/s]
 11%|█         | 40095/371472 [3:11:46<24:57:17,  3.69it/s]
 11%|█         | 40096/371472 [3:11:46<24:20:40,  3.78it/s]
 11%|█         | 40097/371472 [3:11:46<24:38:12,  3.74it/s]
 11%|█         | 40098/371472 [3:11:47<24:19:54,  3.78it/s]
 11%|█         | 40099/371472 [3:11:47<27:26:52,  3.35it/s]
 11%|█         | 40100/371472 [3:11:47<26:05:05,  3.53it/s]
                                                           
{'loss': 4.2507, 'learning_rate': 9.032784589196061e-07, 'epoch': 1.73}

 11%|█         | 40100/371472 [3:11:47<26:05:05,  3.53it/s]
 11%|█         | 40101/371472 [3:11:47<25:42:43,  3.58it/s]
 11%|█         | 40102/371472 [3:11:48<25:16:32,  3.64it/s]
 11%|█         | 40103/371472 [3:11:48<26:27:34,  3.48it/s]
 11%|█         | 40104/371472 [3:11:48<25:59:38,  3.54it/s]
 11%|█         | 40105/371472 [3:11:49<24:56:13,  3.69it/s]
 11%|█         | 40106/371472 [3:11:49<24:52:49,  3.70it/s]
 11%|█         | 40107/371472 [3:11:49<25:29:30,  3.61it/s]
 11%|█         | 40108/371472 [3:11:49<25:14:37,  3.65it/s]
 11%|█         | 40109/371472 [3:11:50<25:35:15,  3.60it/s]
 11%|█         | 40110/371472 [3:11:50<26:27:56,  3.48it/s]
 11%|█         | 40111/371472 [3:11:50<26:52:05,  3.43it/s]
 11%|█         | 40112/371472 [3:11:51<27:04:06,  3.40it/s]
 11%|█         | 40113/371472 [3:11:51<27:23:53,  3.36it/s]
 11%|█         | 40114/371472 [3:11:51<26:48:34,  3.43it/s]
 11%|█         | 40115/371472 [3:11:51<25:17:08,  3.64it/s]
 11%|█         | 40116/371472 [3:11:52<25:34:21,  3.60it/s]
 11%|█         | 40117/371472 [3:11:52<25:36:29,  3.59it/s]
 11%|█         | 40118/371472 [3:11:52<26:31:16,  3.47it/s]
 11%|█         | 40119/371472 [3:11:53<26:22:21,  3.49it/s]
 11%|█         | 40120/371472 [3:11:53<26:17:51,  3.50it/s]
                                                           
{'loss': 4.5417, 'learning_rate': 9.032299769441272e-07, 'epoch': 1.73}

 11%|█         | 40120/371472 [3:11:53<26:17:51,  3.50it/s]
 11%|█         | 40121/371472 [3:11:53<27:48:16,  3.31it/s]
 11%|█         | 40122/371472 [3:11:53<26:05:20,  3.53it/s]
 11%|█         | 40123/371472 [3:11:54<28:55:51,  3.18it/s]
 11%|█         | 40124/371472 [3:11:54<27:21:59,  3.36it/s]
 11%|█         | 40125/371472 [3:11:54<27:38:19,  3.33it/s]
 11%|█         | 40126/371472 [3:11:55<26:21:31,  3.49it/s]
 11%|█         | 40127/371472 [3:11:55<25:20:42,  3.63it/s]
 11%|█         | 40128/371472 [3:11:55<24:47:24,  3.71it/s]
 11%|█         | 40129/371472 [3:11:55<24:48:26,  3.71it/s]
 11%|█         | 40130/371472 [3:11:56<25:55:40,  3.55it/s]
 11%|█         | 40131/371472 [3:11:56<25:14:39,  3.65it/s]
 11%|█         | 40132/371472 [3:11:56<25:24:14,  3.62it/s]
 11%|█         | 40133/371472 [3:11:56<24:50:17,  3.71it/s]
 11%|█         | 40134/371472 [3:11:57<25:06:44,  3.67it/s]
 11%|█         | 40135/371472 [3:11:57<25:27:10,  3.62it/s]
 11%|█         | 40136/371472 [3:11:57<25:41:37,  3.58it/s]
 11%|█         | 40137/371472 [3:11:58<26:35:35,  3.46it/s]
 11%|█         | 40138/371472 [3:11:58<26:11:27,  3.51it/s]
 11%|█         | 40139/371472 [3:11:58<25:55:59,  3.55it/s]
 11%|█         | 40140/371472 [3:11:58<27:05:42,  3.40it/s]
                                                           
{'loss': 4.4213, 'learning_rate': 9.031814949686482e-07, 'epoch': 1.73}

 11%|█         | 40140/371472 [3:11:58<27:05:42,  3.40it/s]
 11%|█         | 40141/371472 [3:11:59<27:44:15,  3.32it/s]
 11%|█         | 40142/371472 [3:11:59<27:13:15,  3.38it/s]
 11%|█         | 40143/371472 [3:11:59<26:02:29,  3.53it/s]
 11%|█         | 40144/371472 [3:12:00<26:37:53,  3.46it/s]
 11%|█         | 40145/371472 [3:12:00<29:14:35,  3.15it/s]
 11%|█         | 40146/371472 [3:12:00<28:17:17,  3.25it/s]
 11%|█         | 40147/371472 [3:12:01<28:01:03,  3.28it/s]
 11%|█         | 40148/371472 [3:12:01<27:25:34,  3.36it/s]
 11%|█         | 40149/371472 [3:12:01<28:29:24,  3.23it/s]
 11%|█         | 40150/371472 [3:12:02<27:21:38,  3.36it/s]
 11%|█         | 40151/371472 [3:12:02<31:24:14,  2.93it/s]
 11%|█         | 40152/371472 [3:12:02<29:54:56,  3.08it/s]
 11%|█         | 40153/371472 [3:12:03<28:32:15,  3.22it/s]
 11%|█         | 40154/371472 [3:12:03<27:16:01,  3.38it/s]
 11%|█         | 40155/371472 [3:12:03<26:53:08,  3.42it/s]
 11%|█         | 40156/371472 [3:12:03<26:36:35,  3.46it/s]
 11%|█         | 40157/371472 [3:12:04<27:11:51,  3.38it/s]
 11%|█         | 40158/371472 [3:12:04<27:20:10,  3.37it/s]
 11%|█         | 40159/371472 [3:12:04<27:06:17,  3.40it/s]
 11%|█         | 40160/371472 [3:12:05<26:26:28,  3.48it/s]
                                                           
{'loss': 4.5404, 'learning_rate': 9.031330129931693e-07, 'epoch': 1.73}

 11%|█         | 40160/371472 [3:12:05<26:26:28,  3.48it/s]
 11%|█         | 40161/371472 [3:12:05<27:07:12,  3.39it/s]
 11%|█         | 40162/371472 [3:12:05<26:41:44,  3.45it/s]
 11%|█         | 40163/371472 [3:12:05<26:13:45,  3.51it/s]
 11%|█         | 40164/371472 [3:12:06<26:34:40,  3.46it/s]
 11%|█         | 40165/371472 [3:12:06<27:02:37,  3.40it/s]
 11%|█         | 40166/371472 [3:12:06<28:43:55,  3.20it/s]
 11%|█         | 40167/371472 [3:12:07<27:34:52,  3.34it/s]
 11%|█         | 40168/371472 [3:12:07<27:26:38,  3.35it/s]
 11%|█         | 40169/371472 [3:12:07<27:27:04,  3.35it/s]
 11%|█         | 40170/371472 [3:12:08<28:12:11,  3.26it/s]
 11%|█         | 40171/371472 [3:12:08<26:59:17,  3.41it/s]
 11%|█         | 40172/371472 [3:12:08<26:04:58,  3.53it/s]
 11%|█         | 40173/371472 [3:12:08<26:00:44,  3.54it/s]
 11%|█         | 40174/371472 [3:12:09<25:29:54,  3.61it/s]
 11%|█         | 40175/371472 [3:12:09<24:59:57,  3.68it/s]
 11%|█         | 40176/371472 [3:12:09<26:34:49,  3.46it/s]
 11%|█         | 40177/371472 [3:12:10<30:42:06,  3.00it/s]
 11%|█         | 40178/371472 [3:12:10<28:16:35,  3.25it/s]
 11%|█         | 40179/371472 [3:12:10<27:18:06,  3.37it/s]
 11%|█         | 40180/371472 [3:12:10<28:10:07,  3.27it/s]
                                                           
{'loss': 4.3475, 'learning_rate': 9.030845310176905e-07, 'epoch': 1.73}

 11%|█         | 40180/371472 [3:12:10<28:10:07,  3.27it/s]
 11%|█         | 40181/371472 [3:12:11<28:17:13,  3.25it/s]
 11%|█         | 40182/371472 [3:12:11<27:11:43,  3.38it/s]
 11%|█         | 40183/371472 [3:12:11<26:57:44,  3.41it/s]
 11%|█         | 40184/371472 [3:12:12<26:05:11,  3.53it/s]
 11%|█         | 40185/371472 [3:12:12<25:47:29,  3.57it/s]
 11%|█         | 40186/371472 [3:12:12<24:47:45,  3.71it/s]
 11%|█         | 40187/371472 [3:12:12<24:55:44,  3.69it/s]
 11%|█         | 40188/371472 [3:12:13<25:40:17,  3.58it/s]
 11%|█         | 40189/371472 [3:12:13<25:18:55,  3.64it/s]
 11%|█         | 40190/371472 [3:12:13<24:46:21,  3.71it/s]
 11%|█         | 40191/371472 [3:12:13<24:46:55,  3.71it/s]
 11%|█         | 40192/371472 [3:12:14<24:42:27,  3.72it/s]
 11%|█         | 40193/371472 [3:12:14<24:59:32,  3.68it/s]
 11%|█         | 40194/371472 [3:12:14<24:32:00,  3.75it/s]
 11%|█         | 40195/371472 [3:12:15<25:36:07,  3.59it/s]
 11%|█         | 40196/371472 [3:12:15<24:29:32,  3.76it/s]
 11%|█         | 40197/371472 [3:12:15<23:50:31,  3.86it/s]
 11%|█         | 40198/371472 [3:12:15<24:17:09,  3.79it/s]
 11%|█         | 40199/371472 [3:12:16<26:58:16,  3.41it/s]
 11%|█         | 40200/371472 [3:12:16<25:19:03,  3.63it/s]
                                                           
{'loss': 4.3838, 'learning_rate': 9.030360490422117e-07, 'epoch': 1.73}

 11%|█         | 40200/371472 [3:12:16<25:19:03,  3.63it/s]
 11%|█         | 40201/371472 [3:12:16<29:05:07,  3.16it/s]
 11%|█         | 40202/371472 [3:12:17<27:50:39,  3.30it/s]
 11%|█         | 40203/371472 [3:12:17<26:43:39,  3.44it/s]
 11%|█         | 40204/371472 [3:12:17<26:22:26,  3.49it/s]
 11%|█         | 40205/371472 [3:12:17<26:27:08,  3.48it/s]
 11%|█         | 40206/371472 [3:12:18<26:17:27,  3.50it/s]
 11%|█         | 40207/371472 [3:12:18<26:21:25,  3.49it/s]
 11%|█         | 40208/371472 [3:12:18<26:43:52,  3.44it/s]
 11%|█         | 40209/371472 [3:12:19<27:02:52,  3.40it/s]
 11%|█         | 40210/371472 [3:12:19<26:18:23,  3.50it/s]
 11%|█         | 40211/371472 [3:12:19<27:01:02,  3.41it/s]
 11%|█         | 40212/371472 [3:12:19<25:57:07,  3.55it/s]
 11%|█         | 40213/371472 [3:12:20<25:08:33,  3.66it/s]
 11%|█         | 40214/371472 [3:12:20<27:15:44,  3.38it/s]
 11%|█         | 40215/371472 [3:12:20<26:30:18,  3.47it/s]
 11%|█         | 40216/371472 [3:12:21<29:53:10,  3.08it/s]
 11%|█         | 40217/371472 [3:12:21<28:10:34,  3.27it/s]
 11%|█         | 40218/371472 [3:12:21<26:43:17,  3.44it/s]
 11%|█         | 40219/371472 [3:12:22<26:23:33,  3.49it/s]
 11%|█         | 40220/371472 [3:12:22<26:21:47,  3.49it/s]
                                                           
{'loss': 4.404, 'learning_rate': 9.029875670667326e-07, 'epoch': 1.73}

 11%|█         | 40220/371472 [3:12:22<26:21:47,  3.49it/s]
 11%|█         | 40221/371472 [3:12:22<26:39:20,  3.45it/s]
 11%|█         | 40222/371472 [3:12:22<26:31:40,  3.47it/s]
 11%|█         | 40223/371472 [3:12:23<27:00:18,  3.41it/s]
 11%|█         | 40224/371472 [3:12:23<26:54:22,  3.42it/s]
 11%|█         | 40225/371472 [3:12:23<27:34:22,  3.34it/s]
 11%|█         | 40226/371472 [3:12:24<26:09:07,  3.52it/s]
 11%|█         | 40227/371472 [3:12:24<25:35:36,  3.60it/s]
 11%|█         | 40228/371472 [3:12:24<25:16:24,  3.64it/s]
 11%|█         | 40229/371472 [3:12:24<26:30:26,  3.47it/s]
 11%|█         | 40230/371472 [3:12:25<26:33:17,  3.46it/s]
 11%|█         | 40231/371472 [3:12:25<26:18:26,  3.50it/s]
 11%|█         | 40232/371472 [3:12:25<26:44:22,  3.44it/s]
 11%|█         | 40233/371472 [3:12:26<28:18:29,  3.25it/s]
 11%|█         | 40234/371472 [3:12:26<26:37:50,  3.46it/s]
 11%|█         | 40235/371472 [3:12:26<27:16:14,  3.37it/s]
 11%|█         | 40236/371472 [3:12:26<26:21:24,  3.49it/s]
 11%|█         | 40237/371472 [3:12:27<25:38:23,  3.59it/s]
 11%|█         | 40238/371472 [3:12:27<26:56:01,  3.42it/s]
 11%|█         | 40239/371472 [3:12:27<26:13:44,  3.51it/s]
 11%|█         | 40240/371472 [3:12:28<25:50:29,  3.56it/s]
                                                           
{'loss': 4.4143, 'learning_rate': 9.029390850912538e-07, 'epoch': 1.73}

 11%|█         | 40240/371472 [3:12:28<25:50:29,  3.56it/s]
 11%|█         | 40241/371472 [3:12:28<25:06:34,  3.66it/s]
 11%|█         | 40242/371472 [3:12:28<25:58:12,  3.54it/s]
 11%|█         | 40243/371472 [3:12:28<27:05:38,  3.40it/s]
 11%|█         | 40244/371472 [3:12:29<27:43:28,  3.32it/s]
 11%|█         | 40245/371472 [3:12:29<27:37:07,  3.33it/s]
 11%|█         | 40246/371472 [3:12:29<27:06:52,  3.39it/s]
 11%|█         | 40247/371472 [3:12:30<25:54:34,  3.55it/s]
 11%|█         | 40248/371472 [3:12:30<25:52:23,  3.56it/s]
 11%|█         | 40249/371472 [3:12:30<26:27:33,  3.48it/s]
 11%|█         | 40250/371472 [3:12:30<25:52:25,  3.56it/s]
 11%|█         | 40251/371472 [3:12:31<25:12:10,  3.65it/s]
 11%|█         | 40252/371472 [3:12:31<24:35:28,  3.74it/s]
 11%|█         | 40253/371472 [3:12:31<25:47:11,  3.57it/s]
 11%|█         | 40254/371472 [3:12:32<26:39:40,  3.45it/s]
 11%|█         | 40255/371472 [3:12:32<27:02:28,  3.40it/s]
 11%|█         | 40256/371472 [3:12:32<29:16:52,  3.14it/s]
 11%|█         | 40257/371472 [3:12:33<27:45:31,  3.31it/s]
 11%|█         | 40258/371472 [3:12:33<27:17:01,  3.37it/s]
 11%|█         | 40259/371472 [3:12:33<26:30:51,  3.47it/s]
 11%|█         | 40260/371472 [3:12:33<25:20:59,  3.63it/s]
                                                           
{'loss': 4.4484, 'learning_rate': 9.028906031157749e-07, 'epoch': 1.73}

 11%|█         | 40260/371472 [3:12:33<25:20:59,  3.63it/s]
 11%|█         | 40261/371472 [3:12:34<25:06:32,  3.66it/s]
 11%|█         | 40262/371472 [3:12:34<26:16:03,  3.50it/s]
 11%|█         | 40263/371472 [3:12:34<26:39:38,  3.45it/s]
 11%|█         | 40264/371472 [3:12:35<28:18:21,  3.25it/s]
 11%|█         | 40265/371472 [3:12:35<26:35:14,  3.46it/s]
 11%|█         | 40266/371472 [3:12:35<27:20:07,  3.37it/s]
 11%|█         | 40267/371472 [3:12:35<25:54:34,  3.55it/s]
 11%|█         | 40268/371472 [3:12:36<27:16:17,  3.37it/s]
 11%|█         | 40269/371472 [3:12:36<25:42:44,  3.58it/s]
 11%|█         | 40270/371472 [3:12:36<24:58:23,  3.68it/s]
 11%|█         | 40271/371472 [3:12:36<25:31:59,  3.60it/s]
 11%|█         | 40272/371472 [3:12:37<27:14:39,  3.38it/s]
 11%|█         | 40273/371472 [3:12:37<26:12:35,  3.51it/s]
 11%|█         | 40274/371472 [3:12:37<25:40:22,  3.58it/s]
 11%|█         | 40275/371472 [3:12:38<24:40:55,  3.73it/s]
 11%|█         | 40276/371472 [3:12:38<25:07:00,  3.66it/s]
 11%|█         | 40277/371472 [3:12:38<25:28:50,  3.61it/s]
 11%|█         | 40278/371472 [3:12:38<25:27:19,  3.61it/s]
 11%|█         | 40279/371472 [3:12:39<25:56:34,  3.55it/s]
 11%|█         | 40280/371472 [3:12:39<26:49:51,  3.43it/s]
                                                           
{'loss': 4.3804, 'learning_rate': 9.02842121140296e-07, 'epoch': 1.73}

 11%|█         | 40280/371472 [3:12:39<26:49:51,  3.43it/s]
 11%|█         | 40281/371472 [3:12:39<26:01:57,  3.53it/s]
 11%|█         | 40282/371472 [3:12:40<25:32:04,  3.60it/s]
 11%|█         | 40283/371472 [3:12:40<24:48:38,  3.71it/s]
 11%|█         | 40284/371472 [3:12:40<26:08:56,  3.52it/s]
 11%|█         | 40285/371472 [3:12:40<25:45:28,  3.57it/s]
 11%|█         | 40286/371472 [3:12:41<25:27:05,  3.61it/s]
 11%|█         | 40287/371472 [3:12:41<25:15:28,  3.64it/s]
 11%|█         | 40288/371472 [3:12:41<24:36:07,  3.74it/s]
 11%|█         | 40289/371472 [3:12:41<25:11:46,  3.65it/s]
 11%|█         | 40290/371472 [3:12:42<25:03:20,  3.67it/s]
 11%|█         | 40291/371472 [3:12:42<25:59:26,  3.54it/s]
 11%|█         | 40292/371472 [3:12:42<28:10:33,  3.26it/s]
 11%|█         | 40293/371472 [3:12:43<26:22:55,  3.49it/s]
 11%|█         | 40294/371472 [3:12:43<26:47:29,  3.43it/s]
 11%|█         | 40295/371472 [3:12:43<26:48:26,  3.43it/s]
 11%|█         | 40296/371472 [3:12:44<29:00:06,  3.17it/s]
 11%|█         | 40297/371472 [3:12:44<28:24:44,  3.24it/s]
 11%|█         | 40298/371472 [3:12:44<26:55:15,  3.42it/s]
 11%|█         | 40299/371472 [3:12:44<25:52:51,  3.55it/s]
 11%|█         | 40300/371472 [3:12:45<25:20:47,  3.63it/s]
                                                           
{'loss': 4.3601, 'learning_rate': 9.027936391648171e-07, 'epoch': 1.74}

 11%|█         | 40300/371472 [3:12:45<25:20:47,  3.63it/s]
 11%|█         | 40301/371472 [3:12:45<24:24:58,  3.77it/s]
 11%|█         | 40302/371472 [3:12:45<24:30:59,  3.75it/s]
 11%|█         | 40303/371472 [3:12:45<24:28:31,  3.76it/s]
 11%|█         | 40304/371472 [3:12:46<24:22:10,  3.77it/s]
 11%|█         | 40305/371472 [3:12:46<24:05:18,  3.82it/s]
 11%|█         | 40306/371472 [3:12:46<24:12:37,  3.80it/s]
 11%|█         | 40307/371472 [3:12:46<24:01:17,  3.83it/s]
 11%|█         | 40308/371472 [3:12:47<24:48:17,  3.71it/s]
 11%|█         | 40309/371472 [3:12:47<25:01:28,  3.68it/s]
 11%|█         | 40310/371472 [3:12:47<24:40:36,  3.73it/s]
 11%|█         | 40311/371472 [3:12:48<24:17:57,  3.79it/s]
 11%|█         | 40312/371472 [3:12:48<27:36:30,  3.33it/s]
 11%|█         | 40313/371472 [3:12:48<26:24:52,  3.48it/s]
 11%|█         | 40314/371472 [3:12:48<26:20:06,  3.49it/s]
 11%|█         | 40315/371472 [3:12:49<25:57:02,  3.54it/s]
 11%|█         | 40316/371472 [3:12:49<25:36:24,  3.59it/s]
 11%|█         | 40317/371472 [3:12:49<25:47:37,  3.57it/s]
 11%|█         | 40318/371472 [3:12:50<25:37:40,  3.59it/s]
 11%|█         | 40319/371472 [3:12:50<25:50:43,  3.56it/s]
 11%|█         | 40320/371472 [3:12:50<26:46:09,  3.44it/s]
                                                           
{'loss': 4.3157, 'learning_rate': 9.027451571893383e-07, 'epoch': 1.74}

 11%|█         | 40320/371472 [3:12:50<26:46:09,  3.44it/s]
 11%|█         | 40321/371472 [3:12:50<26:18:04,  3.50it/s]
 11%|█         | 40322/371472 [3:12:51<24:53:29,  3.70it/s]
 11%|█         | 40323/371472 [3:12:51<24:30:17,  3.75it/s]
 11%|█         | 40324/371472 [3:12:51<25:31:12,  3.60it/s]
 11%|█         | 40325/371472 [3:12:52<24:36:03,  3.74it/s]
 11%|█         | 40326/371472 [3:12:52<25:21:27,  3.63it/s]
 11%|█         | 40327/371472 [3:12:52<25:50:16,  3.56it/s]
 11%|█         | 40328/371472 [3:12:52<27:12:05,  3.38it/s]
 11%|█         | 40329/371472 [3:12:53<26:44:20,  3.44it/s]
 11%|█         | 40330/371472 [3:12:53<25:52:18,  3.56it/s]
 11%|█         | 40331/371472 [3:12:53<26:53:03,  3.42it/s]
 11%|█         | 40332/371472 [3:12:54<25:48:12,  3.56it/s]
 11%|█         | 40333/371472 [3:12:54<25:10:10,  3.65it/s]
 11%|█         | 40334/371472 [3:12:54<24:33:36,  3.75it/s]
 11%|█         | 40335/371472 [3:12:54<24:59:31,  3.68it/s]
 11%|█         | 40336/371472 [3:12:55<24:23:15,  3.77it/s]
 11%|█         | 40337/371472 [3:12:55<24:13:59,  3.80it/s]
 11%|█         | 40338/371472 [3:12:55<24:02:58,  3.82it/s]
 11%|█         | 40339/371472 [3:12:55<23:23:49,  3.93it/s]
 11%|█         | 40340/371472 [3:12:56<23:26:18,  3.92it/s]
                                                           
{'loss': 4.5075, 'learning_rate': 9.026966752138594e-07, 'epoch': 1.74}

 11%|█         | 40340/371472 [3:12:56<23:26:18,  3.92it/s]
 11%|█         | 40341/371472 [3:12:56<24:51:34,  3.70it/s]
 11%|█         | 40342/371472 [3:12:56<23:56:19,  3.84it/s]
 11%|█         | 40343/371472 [3:12:56<24:12:47,  3.80it/s]
 11%|█         | 40344/371472 [3:12:57<25:43:12,  3.58it/s]
 11%|█         | 40345/371472 [3:12:57<26:40:35,  3.45it/s]
 11%|█         | 40346/371472 [3:12:57<25:20:03,  3.63it/s]
 11%|█         | 40347/371472 [3:12:58<25:12:35,  3.65it/s]
 11%|█         | 40348/371472 [3:12:58<24:11:36,  3.80it/s]
 11%|█         | 40349/371472 [3:12:58<24:33:00,  3.75it/s]
 11%|█         | 40350/371472 [3:12:58<25:55:52,  3.55it/s]
 11%|█         | 40351/371472 [3:12:59<25:36:23,  3.59it/s]
 11%|█         | 40352/371472 [3:12:59<24:45:41,  3.71it/s]
 11%|█         | 40353/371472 [3:12:59<26:17:39,  3.50it/s]
 11%|█         | 40354/371472 [3:13:00<27:15:48,  3.37it/s]
 11%|█         | 40355/371472 [3:13:00<26:06:54,  3.52it/s]
 11%|█         | 40356/371472 [3:13:00<27:37:59,  3.33it/s]
 11%|█         | 40357/371472 [3:13:00<26:52:01,  3.42it/s]
 11%|█         | 40358/371472 [3:13:01<25:43:13,  3.58it/s]
 11%|█         | 40359/371472 [3:13:01<25:57:14,  3.54it/s]
 11%|█         | 40360/371472 [3:13:01<25:21:37,  3.63it/s]
                                                           
{'loss': 4.2924, 'learning_rate': 9.026481932383804e-07, 'epoch': 1.74}

 11%|█         | 40360/371472 [3:13:01<25:21:37,  3.63it/s]
 11%|█         | 40361/371472 [3:13:01<24:55:08,  3.69it/s]
 11%|█         | 40362/371472 [3:13:02<25:30:00,  3.61it/s]
 11%|█         | 40363/371472 [3:13:02<25:16:56,  3.64it/s]
 11%|█         | 40364/371472 [3:13:02<25:51:14,  3.56it/s]
 11%|█         | 40365/371472 [3:13:03<25:30:22,  3.61it/s]
 11%|█         | 40366/371472 [3:13:03<26:39:37,  3.45it/s]
 11%|█         | 40367/371472 [3:13:03<26:29:17,  3.47it/s]
 11%|█         | 40368/371472 [3:13:03<26:05:40,  3.52it/s]
 11%|█         | 40369/371472 [3:13:04<25:38:14,  3.59it/s]
 11%|█         | 40370/371472 [3:13:04<25:45:18,  3.57it/s]
 11%|█         | 40371/371472 [3:13:04<28:15:36,  3.25it/s]
 11%|█         | 40372/371472 [3:13:05<27:14:07,  3.38it/s]
 11%|█         | 40373/371472 [3:13:05<26:54:14,  3.42it/s]
 11%|█         | 40374/371472 [3:13:05<26:03:21,  3.53it/s]
 11%|█         | 40375/371472 [3:13:05<25:48:28,  3.56it/s]
 11%|█         | 40376/371472 [3:13:06<25:15:53,  3.64it/s]
 11%|█         | 40377/371472 [3:13:06<24:38:48,  3.73it/s]
 11%|█         | 40378/371472 [3:13:06<23:48:44,  3.86it/s]
 11%|█         | 40379/371472 [3:13:07<24:46:57,  3.71it/s]
 11%|█         | 40380/371472 [3:13:07<24:01:51,  3.83it/s]
                                                           
{'loss': 4.4275, 'learning_rate': 9.025997112629015e-07, 'epoch': 1.74}

 11%|█         | 40380/371472 [3:13:07<24:01:51,  3.83it/s]
 11%|█         | 40381/371472 [3:13:07<25:10:45,  3.65it/s]
 11%|█         | 40382/371472 [3:13:07<25:04:57,  3.67it/s]
 11%|█         | 40383/371472 [3:13:08<25:16:38,  3.64it/s]
 11%|█         | 40384/371472 [3:13:08<26:04:20,  3.53it/s]
 11%|█         | 40385/371472 [3:13:08<25:41:58,  3.58it/s]
 11%|█         | 40386/371472 [3:13:08<26:11:17,  3.51it/s]
 11%|█         | 40387/371472 [3:13:09<26:02:58,  3.53it/s]
 11%|█         | 40388/371472 [3:13:09<24:48:19,  3.71it/s]
 11%|█         | 40389/371472 [3:13:09<24:39:18,  3.73it/s]
 11%|█         | 40390/371472 [3:13:10<24:49:00,  3.71it/s]
 11%|█         | 40391/371472 [3:13:10<24:45:59,  3.71it/s]
 11%|█         | 40392/371472 [3:13:10<24:31:36,  3.75it/s]
 11%|█         | 40393/371472 [3:13:10<24:10:38,  3.80it/s]
 11%|█         | 40394/371472 [3:13:11<24:10:50,  3.80it/s]
 11%|█         | 40395/371472 [3:13:11<24:32:21,  3.75it/s]
 11%|█         | 40396/371472 [3:13:11<25:38:03,  3.59it/s]
 11%|█         | 40397/371472 [3:13:11<25:30:39,  3.60it/s]
 11%|█         | 40398/371472 [3:13:12<26:38:59,  3.45it/s]
 11%|█         | 40399/371472 [3:13:12<28:12:22,  3.26it/s]
 11%|█         | 40400/371472 [3:13:12<29:08:50,  3.16it/s]
                                                           
{'loss': 4.198, 'learning_rate': 9.025512292874227e-07, 'epoch': 1.74}

 11%|█         | 40400/371472 [3:13:12<29:08:50,  3.16it/s]
 11%|█         | 40401/371472 [3:13:13<27:57:44,  3.29it/s]
 11%|█         | 40402/371472 [3:13:13<27:04:02,  3.40it/s]
 11%|█         | 40403/371472 [3:13:13<26:00:05,  3.54it/s]
 11%|█         | 40404/371472 [3:13:14<26:09:17,  3.52it/s]
 11%|█         | 40405/371472 [3:13:14<26:23:55,  3.48it/s]
 11%|█         | 40406/371472 [3:13:14<26:40:48,  3.45it/s]
 11%|█         | 40407/371472 [3:13:14<27:43:31,  3.32it/s]
 11%|█         | 40408/371472 [3:13:15<27:19:44,  3.36it/s]
 11%|█         | 40409/371472 [3:13:15<27:03:24,  3.40it/s]
 11%|█         | 40410/371472 [3:13:15<26:24:27,  3.48it/s]
 11%|█         | 40411/371472 [3:13:16<26:10:53,  3.51it/s]
 11%|█         | 40412/371472 [3:13:16<26:00:57,  3.53it/s]
 11%|█         | 40413/371472 [3:13:16<25:54:27,  3.55it/s]
 11%|█         | 40414/371472 [3:13:16<25:49:38,  3.56it/s]
 11%|█         | 40415/371472 [3:13:17<25:43:53,  3.57it/s]
 11%|█         | 40416/371472 [3:13:17<25:13:34,  3.65it/s]
 11%|█         | 40417/371472 [3:13:17<25:13:39,  3.65it/s]
 11%|█         | 40418/371472 [3:13:18<27:18:01,  3.37it/s]
 11%|█         | 40419/371472 [3:13:18<27:30:00,  3.34it/s]
 11%|█         | 40420/371472 [3:13:18<26:28:31,  3.47it/s]
                                                           
{'loss': 4.3831, 'learning_rate': 9.025027473119438e-07, 'epoch': 1.74}

 11%|█         | 40420/371472 [3:13:18<26:28:31,  3.47it/s]
 11%|█         | 40421/371472 [3:13:18<26:41:28,  3.45it/s]
 11%|█         | 40422/371472 [3:13:19<26:12:39,  3.51it/s]
 11%|█         | 40423/371472 [3:13:19<25:13:50,  3.64it/s]
 11%|█         | 40424/371472 [3:13:19<27:25:03,  3.35it/s]
 11%|█         | 40425/371472 [3:13:20<27:57:04,  3.29it/s]
 11%|█         | 40426/371472 [3:13:20<27:19:16,  3.37it/s]
 11%|█         | 40427/371472 [3:13:20<26:39:09,  3.45it/s]
 11%|█         | 40428/371472 [3:13:21<28:17:39,  3.25it/s]
 11%|█         | 40429/371472 [3:13:21<27:18:15,  3.37it/s]
 11%|█         | 40430/371472 [3:13:21<25:42:35,  3.58it/s]
 11%|█         | 40431/371472 [3:13:21<24:54:26,  3.69it/s]
 11%|█         | 40432/371472 [3:13:22<24:27:31,  3.76it/s]
 11%|█         | 40433/371472 [3:13:22<26:47:44,  3.43it/s]
 11%|█         | 40434/371472 [3:13:22<27:37:54,  3.33it/s]
 11%|█         | 40435/371472 [3:13:23<28:41:30,  3.20it/s]
 11%|█         | 40436/371472 [3:13:23<28:20:40,  3.24it/s]
 11%|█         | 40437/371472 [3:13:23<27:53:15,  3.30it/s]
 11%|█         | 40438/371472 [3:13:23<27:44:10,  3.32it/s]
 11%|█         | 40439/371472 [3:13:24<26:26:45,  3.48it/s]
 11%|█         | 40440/371472 [3:13:24<27:41:16,  3.32it/s]
                                                           
{'loss': 4.3877, 'learning_rate': 9.024542653364649e-07, 'epoch': 1.74}

 11%|█         | 40440/371472 [3:13:24<27:41:16,  3.32it/s]
 11%|█         | 40441/371472 [3:13:24<26:48:44,  3.43it/s]
 11%|█         | 40442/371472 [3:13:25<25:41:16,  3.58it/s]
 11%|█         | 40443/371472 [3:13:25<25:10:10,  3.65it/s]
 11%|█         | 40444/371472 [3:13:25<26:40:49,  3.45it/s]
 11%|█         | 40445/371472 [3:13:25<26:50:21,  3.43it/s]
 11%|█         | 40446/371472 [3:13:26<26:21:53,  3.49it/s]
 11%|█         | 40447/371472 [3:13:26<26:40:31,  3.45it/s]
 11%|█         | 40448/371472 [3:13:26<26:26:56,  3.48it/s]
 11%|█         | 40449/371472 [3:13:27<25:53:07,  3.55it/s]
 11%|█         | 40450/371472 [3:13:27<28:43:32,  3.20it/s]
 11%|█         | 40451/371472 [3:13:27<28:03:36,  3.28it/s]
 11%|█         | 40452/371472 [3:13:28<27:05:42,  3.39it/s]
 11%|█         | 40453/371472 [3:13:28<26:42:26,  3.44it/s]
 11%|█         | 40454/371472 [3:13:28<26:09:09,  3.52it/s]
 11%|█         | 40455/371472 [3:13:28<25:51:41,  3.56it/s]
 11%|█         | 40456/371472 [3:13:29<26:06:24,  3.52it/s]
 11%|█         | 40457/371472 [3:13:29<28:32:44,  3.22it/s]
 11%|█         | 40458/371472 [3:13:29<27:05:59,  3.39it/s]
 11%|█         | 40459/371472 [3:13:30<26:14:22,  3.50it/s]
 11%|█         | 40460/371472 [3:13:30<25:25:26,  3.62it/s]
                                                           
{'loss': 4.4235, 'learning_rate': 9.02405783360986e-07, 'epoch': 1.74}

 11%|█         | 40460/371472 [3:13:30<25:25:26,  3.62it/s]
 11%|█         | 40461/371472 [3:13:30<24:52:09,  3.70it/s]
 11%|█         | 40462/371472 [3:13:30<24:44:27,  3.72it/s]
 11%|█         | 40463/371472 [3:13:31<25:01:56,  3.67it/s]
 11%|█         | 40464/371472 [3:13:31<25:15:59,  3.64it/s]
 11%|█         | 40465/371472 [3:13:31<24:50:47,  3.70it/s]
 11%|█         | 40466/371472 [3:13:31<24:34:28,  3.74it/s]
 11%|█         | 40467/371472 [3:13:32<24:35:42,  3.74it/s]
 11%|█         | 40468/371472 [3:13:32<24:27:51,  3.76it/s]
 11%|█         | 40469/371472 [3:13:32<30:30:04,  3.01it/s]
 11%|█         | 40470/371472 [3:13:33<28:15:41,  3.25it/s]
 11%|█         | 40471/371472 [3:13:33<26:59:51,  3.41it/s]
 11%|█         | 40472/371472 [3:13:33<26:45:05,  3.44it/s]
 11%|█         | 40473/371472 [3:13:34<28:42:13,  3.20it/s]
 11%|█         | 40474/371472 [3:13:34<28:24:51,  3.24it/s]
 11%|█         | 40475/371472 [3:13:34<26:54:52,  3.42it/s]
 11%|█         | 40476/371472 [3:13:34<25:48:57,  3.56it/s]
 11%|█         | 40477/371472 [3:13:35<25:32:57,  3.60it/s]
 11%|█         | 40478/371472 [3:13:35<26:08:13,  3.52it/s]
 11%|█         | 40479/371472 [3:13:35<27:15:04,  3.37it/s]
 11%|█         | 40480/371472 [3:13:36<25:55:03,  3.55it/s]
                                                           
{'loss': 4.5444, 'learning_rate': 9.023573013855071e-07, 'epoch': 1.74}

 11%|█         | 40480/371472 [3:13:36<25:55:03,  3.55it/s]
 11%|█         | 40481/371472 [3:13:36<29:05:07,  3.16it/s]
 11%|█         | 40482/371472 [3:13:36<28:06:00,  3.27it/s]
 11%|█         | 40483/371472 [3:13:36<26:47:50,  3.43it/s]
 11%|█         | 40484/371472 [3:13:37<25:35:48,  3.59it/s]
 11%|█         | 40485/371472 [3:13:37<26:53:14,  3.42it/s]
 11%|█         | 40486/371472 [3:13:37<27:27:51,  3.35it/s]
 11%|█         | 40487/371472 [3:13:38<28:06:20,  3.27it/s]
 11%|█         | 40488/371472 [3:13:38<27:17:50,  3.37it/s]
 11%|█         | 40489/371472 [3:13:38<27:59:21,  3.28it/s]
 11%|█         | 40490/371472 [3:13:39<27:09:19,  3.39it/s]
 11%|█         | 40491/371472 [3:13:39<27:14:43,  3.37it/s]
 11%|█         | 40492/371472 [3:13:39<26:53:35,  3.42it/s]
 11%|█         | 40493/371472 [3:13:39<26:24:57,  3.48it/s]
 11%|█         | 40494/371472 [3:13:40<25:46:25,  3.57it/s]
 11%|█         | 40495/371472 [3:13:40<27:42:13,  3.32it/s]
 11%|█         | 40496/371472 [3:13:40<25:52:01,  3.55it/s]
 11%|█         | 40497/371472 [3:13:40<25:13:21,  3.65it/s]
 11%|█         | 40498/371472 [3:13:41<25:01:11,  3.67it/s]
 11%|█         | 40499/371472 [3:13:41<25:39:12,  3.58it/s]
 11%|█         | 40500/371472 [3:13:41<25:59:54,  3.54it/s]
                                                           
{'loss': 4.2116, 'learning_rate': 9.023088194100282e-07, 'epoch': 1.74}

 11%|█         | 40500/371472 [3:13:41<25:59:54,  3.54it/s]
 11%|█         | 40501/371472 [3:13:42<25:02:59,  3.67it/s]
 11%|█         | 40502/371472 [3:13:42<24:56:37,  3.69it/s]
 11%|█         | 40503/371472 [3:13:42<25:13:55,  3.64it/s]
 11%|█         | 40504/371472 [3:13:42<24:44:36,  3.72it/s]
 11%|█         | 40505/371472 [3:13:43<24:51:44,  3.70it/s]
 11%|█         | 40506/371472 [3:13:43<24:53:06,  3.69it/s]
 11%|█         | 40507/371472 [3:13:43<25:21:42,  3.62it/s]
 11%|█         | 40508/371472 [3:13:43<24:29:08,  3.75it/s]
 11%|█         | 40509/371472 [3:13:44<26:25:43,  3.48it/s]
 11%|█         | 40510/371472 [3:13:44<25:52:04,  3.55it/s]
 11%|█         | 40511/371472 [3:13:44<26:21:58,  3.49it/s]
 11%|█         | 40512/371472 [3:13:45<26:39:03,  3.45it/s]
 11%|█         | 40513/371472 [3:13:45<26:16:42,  3.50it/s]
 11%|█         | 40514/371472 [3:13:45<26:15:21,  3.50it/s]
 11%|█         | 40515/371472 [3:13:46<26:15:29,  3.50it/s]
 11%|█         | 40516/371472 [3:13:46<25:49:03,  3.56it/s]
 11%|█         | 40517/371472 [3:13:46<25:29:31,  3.61it/s]
 11%|█         | 40518/371472 [3:13:46<25:59:21,  3.54it/s]
 11%|█         | 40519/371472 [3:13:47<27:04:52,  3.39it/s]
 11%|█         | 40520/371472 [3:13:47<29:10:04,  3.15it/s]
                                                           
{'loss': 4.4303, 'learning_rate': 9.022603374345493e-07, 'epoch': 1.75}

 11%|█         | 40520/371472 [3:13:47<29:10:04,  3.15it/s]
 11%|█         | 40521/371472 [3:13:47<27:57:09,  3.29it/s]
 11%|█         | 40522/371472 [3:13:48<26:54:40,  3.42it/s]
 11%|█         | 40523/371472 [3:13:48<26:34:25,  3.46it/s]
 11%|█         | 40524/371472 [3:13:48<26:27:35,  3.47it/s]
 11%|█         | 40525/371472 [3:13:48<26:56:04,  3.41it/s]
 11%|█         | 40526/371472 [3:13:49<27:55:18,  3.29it/s]
 11%|█         | 40527/371472 [3:13:49<27:29:41,  3.34it/s]
 11%|█         | 40528/371472 [3:13:49<26:29:13,  3.47it/s]
 11%|█         | 40529/371472 [3:13:50<26:46:59,  3.43it/s]
 11%|█         | 40530/371472 [3:13:50<25:32:05,  3.60it/s]
 11%|█         | 40531/371472 [3:13:50<26:08:23,  3.52it/s]
 11%|█         | 40532/371472 [3:13:50<25:29:13,  3.61it/s]
 11%|█         | 40533/371472 [3:13:51<25:17:20,  3.64it/s]
 11%|█         | 40534/371472 [3:13:51<24:37:31,  3.73it/s]
 11%|█         | 40535/371472 [3:13:51<25:28:26,  3.61it/s]
 11%|█         | 40536/371472 [3:13:52<24:55:01,  3.69it/s]
 11%|█         | 40537/371472 [3:13:52<24:34:28,  3.74it/s]
 11%|█         | 40538/371472 [3:13:52<24:29:46,  3.75it/s]
 11%|█         | 40539/371472 [3:13:52<23:52:20,  3.85it/s]
 11%|█         | 40540/371472 [3:13:53<23:57:42,  3.84it/s]
                                                           
{'loss': 4.2506, 'learning_rate': 9.022118554590704e-07, 'epoch': 1.75}

 11%|█         | 40540/371472 [3:13:53<23:57:42,  3.84it/s]
 11%|█         | 40541/371472 [3:13:53<25:03:16,  3.67it/s]
 11%|█         | 40542/371472 [3:13:53<24:41:48,  3.72it/s]
 11%|█         | 40543/371472 [3:13:53<24:47:36,  3.71it/s]
 11%|█         | 40544/371472 [3:13:54<25:19:40,  3.63it/s]
 11%|█         | 40545/371472 [3:13:54<26:39:44,  3.45it/s]
 11%|█         | 40546/371472 [3:13:54<25:51:28,  3.55it/s]
 11%|█         | 40547/371472 [3:13:55<25:41:23,  3.58it/s]
 11%|█         | 40548/371472 [3:13:55<26:09:34,  3.51it/s]
 11%|█         | 40549/371472 [3:13:55<25:31:03,  3.60it/s]
 11%|█         | 40550/371472 [3:13:55<25:11:26,  3.65it/s]
 11%|█         | 40551/371472 [3:13:56<24:36:56,  3.73it/s]
 11%|█         | 40552/371472 [3:13:56<25:16:05,  3.64it/s]
 11%|█         | 40553/371472 [3:13:56<26:33:01,  3.46it/s]
 11%|█         | 40554/371472 [3:13:57<26:50:54,  3.42it/s]
 11%|█         | 40555/371472 [3:13:57<26:10:20,  3.51it/s]
 11%|█         | 40556/371472 [3:13:57<25:54:51,  3.55it/s]
 11%|█         | 40557/371472 [3:13:57<25:44:42,  3.57it/s]
 11%|█         | 40558/371472 [3:13:58<26:04:33,  3.53it/s]
 11%|█         | 40559/371472 [3:13:58<25:05:00,  3.66it/s]
 11%|█         | 40560/371472 [3:13:58<25:53:35,  3.55it/s]
                                                           
{'loss': 4.3852, 'learning_rate': 9.021633734835916e-07, 'epoch': 1.75}

 11%|█         | 40560/371472 [3:13:58<25:53:35,  3.55it/s]
 11%|█         | 40561/371472 [3:13:59<26:38:43,  3.45it/s]
 11%|█         | 40562/371472 [3:13:59<25:36:41,  3.59it/s]
 11%|█         | 40563/371472 [3:13:59<25:43:42,  3.57it/s]
 11%|█         | 40564/371472 [3:13:59<26:25:19,  3.48it/s]
 11%|█         | 40565/371472 [3:14:00<26:41:06,  3.44it/s]
 11%|█         | 40566/371472 [3:14:00<26:08:48,  3.52it/s]
 11%|█         | 40567/371472 [3:14:00<26:00:30,  3.53it/s]
 11%|█         | 40568/371472 [3:14:00<25:21:07,  3.63it/s]
 11%|█         | 40569/371472 [3:14:01<25:06:19,  3.66it/s]
 11%|█         | 40570/371472 [3:14:01<24:30:53,  3.75it/s]
 11%|█         | 40571/371472 [3:14:01<24:11:42,  3.80it/s]
 11%|█         | 40572/371472 [3:14:01<24:07:46,  3.81it/s]
 11%|█         | 40573/371472 [3:14:02<24:04:08,  3.82it/s]
 11%|█         | 40574/371472 [3:14:02<25:16:32,  3.64it/s]
 11%|█         | 40575/371472 [3:14:02<24:59:03,  3.68it/s]
 11%|█         | 40576/371472 [3:14:03<25:18:24,  3.63it/s]
 11%|█         | 40577/371472 [3:14:03<25:32:23,  3.60it/s]
 11%|█         | 40578/371472 [3:14:03<24:43:41,  3.72it/s]
 11%|█         | 40579/371472 [3:14:03<25:00:49,  3.67it/s]
 11%|█         | 40580/371472 [3:14:04<24:56:30,  3.69it/s]
                                                           
{'loss': 4.3947, 'learning_rate': 9.021148915081126e-07, 'epoch': 1.75}

 11%|█         | 40580/371472 [3:14:04<24:56:30,  3.69it/s]
 11%|█         | 40581/371472 [3:14:04<24:34:16,  3.74it/s]
 11%|█         | 40582/371472 [3:14:04<24:16:11,  3.79it/s]
 11%|█         | 40583/371472 [3:14:04<23:40:40,  3.88it/s]
 11%|█         | 40584/371472 [3:14:05<23:40:15,  3.88it/s]
 11%|█         | 40585/371472 [3:14:05<24:15:50,  3.79it/s]
 11%|█         | 40586/371472 [3:14:05<24:53:01,  3.69it/s]
 11%|█         | 40587/371472 [3:14:06<24:31:50,  3.75it/s]
 11%|█         | 40588/371472 [3:14:06<25:13:19,  3.64it/s]
 11%|█         | 40589/371472 [3:14:06<25:53:18,  3.55it/s]
 11%|█         | 40590/371472 [3:14:06<25:11:54,  3.65it/s]
 11%|█         | 40591/371472 [3:14:07<25:42:22,  3.58it/s]
 11%|█         | 40592/371472 [3:14:07<27:15:36,  3.37it/s]
 11%|█         | 40593/371472 [3:14:07<27:39:40,  3.32it/s]
 11%|█         | 40594/371472 [3:14:08<26:55:17,  3.41it/s]
 11%|█         | 40595/371472 [3:14:08<26:54:14,  3.42it/s]
 11%|█         | 40596/371472 [3:14:08<26:26:31,  3.48it/s]
 11%|█         | 40597/371472 [3:14:08<25:47:39,  3.56it/s]
 11%|█         | 40598/371472 [3:14:09<25:09:54,  3.65it/s]
 11%|█         | 40599/371472 [3:14:09<25:15:46,  3.64it/s]
 11%|█         | 40600/371472 [3:14:09<24:27:02,  3.76it/s]
                                                           
{'loss': 4.3598, 'learning_rate': 9.020664095326336e-07, 'epoch': 1.75}

 11%|█         | 40600/371472 [3:14:09<24:27:02,  3.76it/s]
 11%|█         | 40601/371472 [3:14:09<24:50:03,  3.70it/s]
 11%|█         | 40602/371472 [3:14:10<24:39:42,  3.73it/s]
 11%|█         | 40603/371472 [3:14:10<25:46:10,  3.57it/s]
 11%|█         | 40604/371472 [3:14:10<25:10:09,  3.65it/s]
 11%|█         | 40605/371472 [3:14:11<25:02:06,  3.67it/s]
 11%|█         | 40606/371472 [3:14:11<25:05:59,  3.66it/s]
 11%|█         | 40607/371472 [3:14:11<25:08:24,  3.66it/s]
 11%|█         | 40608/371472 [3:14:11<25:41:16,  3.58it/s]
 11%|█         | 40609/371472 [3:14:12<25:11:03,  3.65it/s]
 11%|█         | 40610/371472 [3:14:12<26:48:56,  3.43it/s]
 11%|█         | 40611/371472 [3:14:12<26:57:10,  3.41it/s]
 11%|█         | 40612/371472 [3:14:13<26:11:22,  3.51it/s]
 11%|█         | 40613/371472 [3:14:13<25:58:57,  3.54it/s]
 11%|█         | 40614/371472 [3:14:13<25:59:34,  3.54it/s]
 11%|█         | 40615/371472 [3:14:13<27:00:25,  3.40it/s]
 11%|█         | 40616/371472 [3:14:14<28:32:41,  3.22it/s]
 11%|█         | 40617/371472 [3:14:14<26:54:26,  3.42it/s]
 11%|█         | 40618/371472 [3:14:14<28:25:22,  3.23it/s]
 11%|█         | 40619/371472 [3:14:15<27:40:58,  3.32it/s]
 11%|█         | 40620/371472 [3:14:15<26:13:51,  3.50it/s]
                                                           
{'loss': 4.2804, 'learning_rate': 9.020179275571548e-07, 'epoch': 1.75}

 11%|█         | 40620/371472 [3:14:15<26:13:51,  3.50it/s]
 11%|█         | 40621/371472 [3:14:15<27:33:47,  3.33it/s]
 11%|█         | 40622/371472 [3:14:16<28:15:14,  3.25it/s]
 11%|█         | 40623/371472 [3:14:16<26:34:53,  3.46it/s]
 11%|█         | 40624/371472 [3:14:16<26:04:50,  3.52it/s]
 11%|█         | 40625/371472 [3:14:16<25:10:54,  3.65it/s]
 11%|█         | 40626/371472 [3:14:17<24:34:46,  3.74it/s]
 11%|█         | 40627/371472 [3:14:17<24:44:47,  3.71it/s]
 11%|█         | 40628/371472 [3:14:17<32:18:32,  2.84it/s]
 11%|█         | 40629/371472 [3:14:18<29:49:06,  3.08it/s]
 11%|█         | 40630/371472 [3:14:18<27:36:54,  3.33it/s]
 11%|█         | 40631/371472 [3:14:18<28:19:03,  3.25it/s]
 11%|█         | 40632/371472 [3:14:19<26:56:16,  3.41it/s]
 11%|█         | 40633/371472 [3:14:19<26:18:18,  3.49it/s]
 11%|█         | 40634/371472 [3:14:19<26:13:14,  3.50it/s]
 11%|█         | 40635/371472 [3:14:19<26:31:35,  3.46it/s]
 11%|█         | 40636/371472 [3:14:20<25:28:40,  3.61it/s]
 11%|█         | 40637/371472 [3:14:20<25:25:56,  3.61it/s]
 11%|█         | 40638/371472 [3:14:20<26:23:29,  3.48it/s]
 11%|█         | 40639/371472 [3:14:20<25:37:00,  3.59it/s]
 11%|█         | 40640/371472 [3:14:21<26:21:18,  3.49it/s]
                                                           
{'loss': 4.4294, 'learning_rate': 9.01969445581676e-07, 'epoch': 1.75}

 11%|█         | 40640/371472 [3:14:21<26:21:18,  3.49it/s]
 11%|█         | 40641/371472 [3:14:21<25:37:37,  3.59it/s]
 11%|█         | 40642/371472 [3:14:21<25:44:15,  3.57it/s]
 11%|█         | 40643/371472 [3:14:22<27:10:37,  3.38it/s]
 11%|█         | 40644/371472 [3:14:22<29:50:49,  3.08it/s]
 11%|█         | 40645/371472 [3:14:22<29:36:29,  3.10it/s]
 11%|█         | 40646/371472 [3:14:23<27:29:56,  3.34it/s]
 11%|█         | 40647/371472 [3:14:23<26:41:06,  3.44it/s]
 11%|█         | 40648/371472 [3:14:23<26:30:28,  3.47it/s]
 11%|█         | 40649/371472 [3:14:23<26:19:43,  3.49it/s]
 11%|█         | 40650/371472 [3:14:24<27:26:56,  3.35it/s]
 11%|█         | 40651/371472 [3:14:24<26:48:55,  3.43it/s]
 11%|█         | 40652/371472 [3:14:24<26:11:08,  3.51it/s]
 11%|█         | 40653/371472 [3:14:25<26:14:05,  3.50it/s]
 11%|█         | 40654/371472 [3:14:25<25:49:11,  3.56it/s]
 11%|█         | 40655/371472 [3:14:25<25:16:19,  3.64it/s]
 11%|█         | 40656/371472 [3:14:25<25:37:49,  3.59it/s]
 11%|█         | 40657/371472 [3:14:26<24:39:04,  3.73it/s]
 11%|█         | 40658/371472 [3:14:26<25:14:56,  3.64it/s]
 11%|█         | 40659/371472 [3:14:26<25:41:15,  3.58it/s]
 11%|█         | 40660/371472 [3:14:27<25:25:11,  3.61it/s]
                                                           
{'loss': 4.5575, 'learning_rate': 9.01920963606197e-07, 'epoch': 1.75}

 11%|█         | 40660/371472 [3:14:27<25:25:11,  3.61it/s]
 11%|█         | 40661/371472 [3:14:27<24:46:00,  3.71it/s]
 11%|█         | 40662/371472 [3:14:27<27:20:53,  3.36it/s]
 11%|█         | 40663/371472 [3:14:27<25:56:21,  3.54it/s]
 11%|█         | 40664/371472 [3:14:28<25:41:49,  3.58it/s]
 11%|█         | 40665/371472 [3:14:28<25:22:18,  3.62it/s]
 11%|█         | 40666/371472 [3:14:28<26:35:57,  3.45it/s]
 11%|█         | 40667/371472 [3:14:29<27:06:19,  3.39it/s]
 11%|█         | 40668/371472 [3:14:29<27:24:21,  3.35it/s]
 11%|█         | 40669/371472 [3:14:29<26:24:29,  3.48it/s]
 11%|█         | 40670/371472 [3:14:29<25:49:29,  3.56it/s]
 11%|█         | 40671/371472 [3:14:30<25:01:07,  3.67it/s]
 11%|█         | 40672/371472 [3:14:30<24:43:17,  3.72it/s]
 11%|█         | 40673/371472 [3:14:30<24:08:49,  3.81it/s]
 11%|█         | 40674/371472 [3:14:30<26:14:38,  3.50it/s]
 11%|█         | 40675/371472 [3:14:31<26:58:45,  3.41it/s]
 11%|█         | 40676/371472 [3:14:31<25:49:27,  3.56it/s]
 11%|█         | 40677/371472 [3:14:31<25:40:13,  3.58it/s]
 11%|█         | 40678/371472 [3:14:32<25:36:15,  3.59it/s]
 11%|█         | 40679/371472 [3:14:32<24:49:19,  3.70it/s]
 11%|█         | 40680/371472 [3:14:32<26:45:54,  3.43it/s]
                                                           
{'loss': 4.1388, 'learning_rate': 9.018724816307181e-07, 'epoch': 1.75}

 11%|█         | 40680/371472 [3:14:32<26:45:54,  3.43it/s]
 11%|█         | 40681/371472 [3:14:32<25:50:40,  3.56it/s]
 11%|█         | 40682/371472 [3:14:33<25:59:35,  3.53it/s]
 11%|█         | 40683/371472 [3:14:33<26:15:44,  3.50it/s]
 11%|█         | 40684/371472 [3:14:33<25:34:16,  3.59it/s]
 11%|█         | 40685/371472 [3:14:34<25:10:39,  3.65it/s]
 11%|█         | 40686/371472 [3:14:34<25:41:45,  3.58it/s]
 11%|█         | 40687/371472 [3:14:34<26:21:09,  3.49it/s]
 11%|█         | 40688/371472 [3:14:34<26:19:20,  3.49it/s]
 11%|█         | 40689/371472 [3:14:35<25:41:28,  3.58it/s]
 11%|█         | 40690/371472 [3:14:35<25:07:37,  3.66it/s]
 11%|█         | 40691/371472 [3:14:35<24:17:41,  3.78it/s]
 11%|█         | 40692/371472 [3:14:35<25:26:19,  3.61it/s]
 11%|█         | 40693/371472 [3:14:36<25:21:00,  3.62it/s]
 11%|█         | 40694/371472 [3:14:36<25:40:32,  3.58it/s]
 11%|█         | 40695/371472 [3:14:36<25:56:51,  3.54it/s]
 11%|█         | 40696/371472 [3:14:37<26:54:43,  3.41it/s]
 11%|█         | 40697/371472 [3:14:37<26:28:41,  3.47it/s]
 11%|█         | 40698/371472 [3:14:37<25:59:47,  3.53it/s]
 11%|█         | 40699/371472 [3:14:37<25:54:29,  3.55it/s]
 11%|█         | 40700/371472 [3:14:38<25:16:17,  3.64it/s]
                                                           
{'loss': 4.2976, 'learning_rate': 9.018239996552393e-07, 'epoch': 1.75}

 11%|█         | 40700/371472 [3:14:38<25:16:17,  3.64it/s]
 11%|█         | 40701/371472 [3:14:38<24:45:01,  3.71it/s]
 11%|█         | 40702/371472 [3:14:38<25:32:13,  3.60it/s]
 11%|█         | 40703/371472 [3:14:39<25:08:15,  3.66it/s]
 11%|█         | 40704/371472 [3:14:39<25:26:28,  3.61it/s]
 11%|█         | 40705/371472 [3:14:39<24:27:55,  3.76it/s]
 11%|█         | 40706/371472 [3:14:39<23:46:26,  3.86it/s]
 11%|█         | 40707/371472 [3:14:40<24:31:18,  3.75it/s]
 11%|█         | 40708/371472 [3:14:40<24:42:23,  3.72it/s]
 11%|█         | 40709/371472 [3:14:40<25:51:03,  3.55it/s]
 11%|█         | 40710/371472 [3:14:40<25:38:06,  3.58it/s]
 11%|█         | 40711/371472 [3:14:41<24:50:57,  3.70it/s]
 11%|█         | 40712/371472 [3:14:41<25:57:32,  3.54it/s]
 11%|█         | 40713/371472 [3:14:41<26:05:01,  3.52it/s]
 11%|█         | 40714/371472 [3:14:42<25:24:11,  3.62it/s]
 11%|█         | 40715/371472 [3:14:42<25:37:18,  3.59it/s]
 11%|█         | 40716/371472 [3:14:42<25:16:31,  3.64it/s]
 11%|█         | 40717/371472 [3:14:42<25:47:11,  3.56it/s]
 11%|█         | 40718/371472 [3:14:43<24:59:50,  3.68it/s]
 11%|█         | 40719/371472 [3:14:43<27:04:15,  3.39it/s]
 11%|█         | 40720/371472 [3:14:43<26:30:20,  3.47it/s]
                                                           
{'loss': 4.1478, 'learning_rate': 9.017755176797604e-07, 'epoch': 1.75}

 11%|█         | 40720/371472 [3:14:43<26:30:20,  3.47it/s]
 11%|█         | 40721/371472 [3:14:44<25:57:45,  3.54it/s]
 11%|█         | 40722/371472 [3:14:44<26:22:31,  3.48it/s]
 11%|█         | 40723/371472 [3:14:44<25:42:58,  3.57it/s]
 11%|█         | 40724/371472 [3:14:44<24:58:11,  3.68it/s]
 11%|█         | 40725/371472 [3:14:45<29:40:23,  3.10it/s]
 11%|█         | 40726/371472 [3:14:45<27:44:31,  3.31it/s]
 11%|█         | 40727/371472 [3:14:45<26:50:04,  3.42it/s]
 11%|█         | 40728/371472 [3:14:46<25:34:02,  3.59it/s]
 11%|█         | 40729/371472 [3:14:46<25:23:35,  3.62it/s]
 11%|█         | 40730/371472 [3:14:46<25:29:57,  3.60it/s]
 11%|█         | 40731/371472 [3:14:46<26:02:20,  3.53it/s]
 11%|█         | 40732/371472 [3:14:47<25:23:59,  3.62it/s]
 11%|█         | 40733/371472 [3:14:47<25:13:10,  3.64it/s]
 11%|█         | 40734/371472 [3:14:47<26:37:42,  3.45it/s]
 11%|█         | 40735/371472 [3:14:48<27:20:57,  3.36it/s]
 11%|█         | 40736/371472 [3:14:48<27:37:20,  3.33it/s]
 11%|█         | 40737/371472 [3:14:48<28:01:28,  3.28it/s]
 11%|█         | 40738/371472 [3:14:48<26:41:51,  3.44it/s]
 11%|█         | 40739/371472 [3:14:49<25:51:34,  3.55it/s]
 11%|█         | 40740/371472 [3:14:49<25:57:38,  3.54it/s]
                                                           
{'loss': 4.4194, 'learning_rate': 9.017270357042814e-07, 'epoch': 1.75}

 11%|█         | 40740/371472 [3:14:49<25:57:38,  3.54it/s]
 11%|█         | 40741/371472 [3:14:49<25:22:06,  3.62it/s]
 11%|█         | 40742/371472 [3:14:50<26:05:05,  3.52it/s]
 11%|█         | 40743/371472 [3:14:50<25:43:55,  3.57it/s]
 11%|█         | 40744/371472 [3:14:50<25:29:10,  3.60it/s]
 11%|█         | 40745/371472 [3:14:50<25:29:48,  3.60it/s]
 11%|█         | 40746/371472 [3:14:51<25:26:44,  3.61it/s]
 11%|█         | 40747/371472 [3:14:51<24:58:38,  3.68it/s]
 11%|█         | 40748/371472 [3:14:51<24:51:34,  3.70it/s]
 11%|█         | 40749/371472 [3:14:51<24:19:43,  3.78it/s]
 11%|█         | 40750/371472 [3:14:52<25:24:55,  3.61it/s]
 11%|█         | 40751/371472 [3:14:52<25:41:18,  3.58it/s]
 11%|█         | 40752/371472 [3:14:52<26:10:09,  3.51it/s]
 11%|█         | 40753/371472 [3:14:53<25:45:40,  3.57it/s]
 11%|█         | 40754/371472 [3:14:53<25:43:08,  3.57it/s]
 11%|█         | 40755/371472 [3:14:53<25:20:37,  3.62it/s]
 11%|█         | 40756/371472 [3:14:53<26:21:12,  3.49it/s]
 11%|█         | 40757/371472 [3:14:54<26:09:23,  3.51it/s]
 11%|█         | 40758/371472 [3:14:54<25:31:29,  3.60it/s]
 11%|█         | 40759/371472 [3:14:54<25:06:08,  3.66it/s]
 11%|█         | 40760/371472 [3:14:55<26:13:36,  3.50it/s]
                                                           
{'loss': 4.3831, 'learning_rate': 9.016785537288025e-07, 'epoch': 1.76}

 11%|█         | 40760/371472 [3:14:55<26:13:36,  3.50it/s]
 11%|█         | 40761/371472 [3:14:55<27:51:47,  3.30it/s]
 11%|█         | 40762/371472 [3:14:55<26:09:29,  3.51it/s]
 11%|█         | 40763/371472 [3:14:55<26:05:37,  3.52it/s]
 11%|█         | 40764/371472 [3:14:56<27:25:54,  3.35it/s]
 11%|█         | 40765/371472 [3:14:56<26:21:22,  3.49it/s]
 11%|█         | 40766/371472 [3:14:56<26:05:07,  3.52it/s]
 11%|█         | 40767/371472 [3:14:57<25:54:48,  3.54it/s]
 11%|█         | 40768/371472 [3:14:57<27:27:12,  3.35it/s]
 11%|█         | 40769/371472 [3:14:57<26:02:28,  3.53it/s]
 11%|█         | 40770/371472 [3:14:57<25:31:08,  3.60it/s]
 11%|█         | 40771/371472 [3:14:58<26:27:14,  3.47it/s]
 11%|█         | 40772/371472 [3:14:58<26:02:37,  3.53it/s]
 11%|█         | 40773/371472 [3:14:58<26:11:56,  3.51it/s]
 11%|█         | 40774/371472 [3:14:59<29:48:05,  3.08it/s]
 11%|█         | 40775/371472 [3:14:59<28:32:34,  3.22it/s]
 11%|█         | 40776/371472 [3:14:59<27:12:15,  3.38it/s]
 11%|█         | 40777/371472 [3:15:00<26:22:25,  3.48it/s]
 11%|█         | 40778/371472 [3:15:00<26:10:46,  3.51it/s]
 11%|█         | 40779/371472 [3:15:00<25:44:38,  3.57it/s]
 11%|█         | 40780/371472 [3:15:00<25:24:04,  3.62it/s]
                                                           
{'loss': 4.2891, 'learning_rate': 9.016300717533237e-07, 'epoch': 1.76}

 11%|█         | 40780/371472 [3:15:00<25:24:04,  3.62it/s]
 11%|█         | 40781/371472 [3:15:01<25:30:35,  3.60it/s]
 11%|█         | 40782/371472 [3:15:01<25:58:13,  3.54it/s]
 11%|█         | 40783/371472 [3:15:01<25:16:52,  3.63it/s]
 11%|█         | 40784/371472 [3:15:02<27:05:39,  3.39it/s]
 11%|█         | 40785/371472 [3:15:02<25:47:06,  3.56it/s]
 11%|█         | 40786/371472 [3:15:02<27:20:51,  3.36it/s]
 11%|█         | 40787/371472 [3:15:02<26:54:25,  3.41it/s]
 11%|█         | 40788/371472 [3:15:03<26:10:43,  3.51it/s]
 11%|█         | 40789/371472 [3:15:03<27:02:00,  3.40it/s]
 11%|█         | 40790/371472 [3:15:03<27:00:44,  3.40it/s]
 11%|█         | 40791/371472 [3:15:04<25:43:28,  3.57it/s]
 11%|█         | 40792/371472 [3:15:04<25:26:22,  3.61it/s]
 11%|█         | 40793/371472 [3:15:04<24:59:54,  3.67it/s]
 11%|█         | 40794/371472 [3:15:04<24:25:42,  3.76it/s]
 11%|█         | 40795/371472 [3:15:05<26:43:51,  3.44it/s]
 11%|█         | 40796/371472 [3:15:05<25:18:24,  3.63it/s]
 11%|█         | 40797/371472 [3:15:05<25:33:32,  3.59it/s]
 11%|█         | 40798/371472 [3:15:06<27:32:35,  3.33it/s]
 11%|█         | 40799/371472 [3:15:06<26:30:30,  3.47it/s]
 11%|█         | 40800/371472 [3:15:06<25:36:37,  3.59it/s]
                                                           
{'loss': 4.3545, 'learning_rate': 9.015815897778448e-07, 'epoch': 1.76}

 11%|█         | 40800/371472 [3:15:06<25:36:37,  3.59it/s]
 11%|█         | 40801/371472 [3:15:06<25:41:47,  3.57it/s]
 11%|█         | 40802/371472 [3:15:07<26:12:58,  3.50it/s]
 11%|█         | 40803/371472 [3:15:07<25:49:59,  3.56it/s]
 11%|█         | 40804/371472 [3:15:07<25:53:19,  3.55it/s]
 11%|█         | 40805/371472 [3:15:07<25:36:17,  3.59it/s]
 11%|█         | 40806/371472 [3:15:08<27:33:18,  3.33it/s]
 11%|█         | 40807/371472 [3:15:08<27:26:17,  3.35it/s]
 11%|█         | 40808/371472 [3:15:08<28:29:38,  3.22it/s]
 11%|█         | 40809/371472 [3:15:09<27:18:25,  3.36it/s]
 11%|█         | 40810/371472 [3:15:09<29:27:07,  3.12it/s]
 11%|█         | 40811/371472 [3:15:09<27:33:55,  3.33it/s]
 11%|█         | 40812/371472 [3:15:10<26:10:23,  3.51it/s]
 11%|█         | 40813/371472 [3:15:10<27:08:59,  3.38it/s]
 11%|█         | 40814/371472 [3:15:10<27:09:08,  3.38it/s]
 11%|█         | 40815/371472 [3:15:11<28:03:35,  3.27it/s]
 11%|█         | 40816/371472 [3:15:11<26:44:20,  3.44it/s]
 11%|█         | 40817/371472 [3:15:11<27:16:07,  3.37it/s]
 11%|█         | 40818/371472 [3:15:12<30:50:35,  2.98it/s]
 11%|█         | 40819/371472 [3:15:12<28:47:14,  3.19it/s]
 11%|█         | 40820/371472 [3:15:12<27:56:27,  3.29it/s]
                                                           
{'loss': 4.3924, 'learning_rate': 9.015331078023659e-07, 'epoch': 1.76}

 11%|█         | 40820/371472 [3:15:12<27:56:27,  3.29it/s]
 11%|█         | 40821/371472 [3:15:12<27:58:49,  3.28it/s]
 11%|█         | 40822/371472 [3:15:13<26:37:19,  3.45it/s]
 11%|█         | 40823/371472 [3:15:13<26:33:19,  3.46it/s]
 11%|█         | 40824/371472 [3:15:13<26:01:03,  3.53it/s]
 11%|█         | 40825/371472 [3:15:14<26:56:11,  3.41it/s]
 11%|█         | 40826/371472 [3:15:14<26:02:59,  3.53it/s]
 11%|█         | 40827/371472 [3:15:14<24:55:32,  3.68it/s]
 11%|█         | 40828/371472 [3:15:14<25:19:14,  3.63it/s]
 11%|█         | 40829/371472 [3:15:15<24:59:56,  3.67it/s]
 11%|█         | 40830/371472 [3:15:15<24:35:52,  3.73it/s]
 11%|█         | 40831/371472 [3:15:15<25:15:43,  3.64it/s]
 11%|█         | 40832/371472 [3:15:15<25:03:44,  3.66it/s]
 11%|█         | 40833/371472 [3:15:16<24:43:13,  3.72it/s]
 11%|█         | 40834/371472 [3:15:16<27:12:35,  3.38it/s]
 11%|█         | 40835/371472 [3:15:16<27:42:45,  3.31it/s]
 11%|█         | 40836/371472 [3:15:17<26:07:39,  3.52it/s]
 11%|█         | 40837/371472 [3:15:17<25:31:35,  3.60it/s]
 11%|█         | 40838/371472 [3:15:17<25:04:42,  3.66it/s]
 11%|█         | 40839/371472 [3:15:17<25:10:24,  3.65it/s]
 11%|█         | 40840/371472 [3:15:18<24:33:12,  3.74it/s]
                                                           
{'loss': 4.4795, 'learning_rate': 9.01484625826887e-07, 'epoch': 1.76}

 11%|█         | 40840/371472 [3:15:18<24:33:12,  3.74it/s]
 11%|█         | 40841/371472 [3:15:18<24:10:38,  3.80it/s]
 11%|█         | 40842/371472 [3:15:18<24:27:46,  3.75it/s]
 11%|█         | 40843/371472 [3:15:19<26:26:56,  3.47it/s]
 11%|█         | 40844/371472 [3:15:19<25:17:26,  3.63it/s]
 11%|█         | 40845/371472 [3:15:19<25:25:49,  3.61it/s]
 11%|█         | 40846/371472 [3:15:19<25:18:44,  3.63it/s]
 11%|█         | 40847/371472 [3:15:20<25:16:06,  3.63it/s]
 11%|█         | 40848/371472 [3:15:20<24:41:01,  3.72it/s]
 11%|█         | 40849/371472 [3:15:20<24:34:44,  3.74it/s]
 11%|█         | 40850/371472 [3:15:20<24:20:02,  3.77it/s]
 11%|█         | 40851/371472 [3:15:21<23:46:24,  3.86it/s]
 11%|█         | 40852/371472 [3:15:21<25:24:30,  3.61it/s]
 11%|█         | 40853/371472 [3:15:21<25:19:27,  3.63it/s]
 11%|█         | 40854/371472 [3:15:21<25:23:52,  3.62it/s]
 11%|█         | 40855/371472 [3:15:22<24:55:53,  3.68it/s]
 11%|█         | 40856/371472 [3:15:22<24:46:55,  3.71it/s]
 11%|█         | 40857/371472 [3:15:22<24:51:32,  3.69it/s]
 11%|█         | 40858/371472 [3:15:23<25:16:48,  3.63it/s]
 11%|█         | 40859/371472 [3:15:23<24:37:20,  3.73it/s]
 11%|█         | 40860/371472 [3:15:23<25:48:49,  3.56it/s]
                                                           
{'loss': 4.1988, 'learning_rate': 9.014361438514081e-07, 'epoch': 1.76}

 11%|█         | 40860/371472 [3:15:23<25:48:49,  3.56it/s]
 11%|█         | 40861/371472 [3:15:23<25:18:00,  3.63it/s]
 11%|█         | 40862/371472 [3:15:24<25:17:15,  3.63it/s]
 11%|█         | 40863/371472 [3:15:24<25:00:25,  3.67it/s]
 11%|█         | 40864/371472 [3:15:24<25:24:31,  3.61it/s]
 11%|█         | 40865/371472 [3:15:24<24:50:03,  3.70it/s]
 11%|█         | 40866/371472 [3:15:25<24:32:35,  3.74it/s]
 11%|█         | 40867/371472 [3:15:25<24:08:54,  3.80it/s]
 11%|█         | 40868/371472 [3:15:25<24:05:22,  3.81it/s]
 11%|█         | 40869/371472 [3:15:26<24:22:40,  3.77it/s]
 11%|█         | 40870/371472 [3:15:26<24:43:02,  3.72it/s]
 11%|█         | 40871/371472 [3:15:26<27:35:47,  3.33it/s]
 11%|█         | 40872/371472 [3:15:27<29:40:12,  3.10it/s]
 11%|█         | 40873/371472 [3:15:27<28:29:37,  3.22it/s]
 11%|█         | 40874/371472 [3:15:27<29:21:20,  3.13it/s]
 11%|█         | 40875/371472 [3:15:27<27:55:06,  3.29it/s]
 11%|█         | 40876/371472 [3:15:28<31:23:17,  2.93it/s]
 11%|█         | 40877/371472 [3:15:28<30:32:12,  3.01it/s]
 11%|█         | 40878/371472 [3:15:28<30:11:31,  3.04it/s]
 11%|█         | 40879/371472 [3:15:29<27:53:27,  3.29it/s]
 11%|█         | 40880/371472 [3:15:29<27:10:53,  3.38it/s]
                                                           
{'loss': 4.5492, 'learning_rate': 9.013876618759291e-07, 'epoch': 1.76}

 11%|█         | 40880/371472 [3:15:29<27:10:53,  3.38it/s]
 11%|█         | 40881/371472 [3:15:29<28:31:00,  3.22it/s]
 11%|█         | 40882/371472 [3:15:30<29:00:58,  3.16it/s]
 11%|█         | 40883/371472 [3:15:30<28:50:46,  3.18it/s]
 11%|█         | 40884/371472 [3:15:30<28:02:57,  3.27it/s]
 11%|█         | 40885/371472 [3:15:31<26:30:46,  3.46it/s]
 11%|█         | 40886/371472 [3:15:31<26:13:15,  3.50it/s]
 11%|█         | 40887/371472 [3:15:31<27:56:41,  3.29it/s]
 11%|█         | 40888/371472 [3:15:31<28:01:59,  3.28it/s]
 11%|█         | 40889/371472 [3:15:32<27:54:01,  3.29it/s]
 11%|█         | 40890/371472 [3:15:32<27:32:03,  3.34it/s]
 11%|█         | 40891/371472 [3:15:32<26:13:31,  3.50it/s]
 11%|█         | 40892/371472 [3:15:33<25:30:47,  3.60it/s]
 11%|█         | 40893/371472 [3:15:33<25:43:32,  3.57it/s]
 11%|█         | 40894/371472 [3:15:33<25:11:22,  3.65it/s]
 11%|█         | 40895/371472 [3:15:33<25:54:53,  3.54it/s]
 11%|█         | 40896/371472 [3:15:34<25:22:12,  3.62it/s]
 11%|█         | 40897/371472 [3:15:34<24:38:50,  3.73it/s]
 11%|█         | 40898/371472 [3:15:34<24:06:21,  3.81it/s]
 11%|█         | 40899/371472 [3:15:34<24:14:10,  3.79it/s]
 11%|█         | 40900/371472 [3:15:35<24:17:11,  3.78it/s]
                                                           
{'loss': 4.3368, 'learning_rate': 9.013391799004503e-07, 'epoch': 1.76}

 11%|█         | 40900/371472 [3:15:35<24:17:11,  3.78it/s]
 11%|█         | 40901/371472 [3:15:35<24:57:44,  3.68it/s]
 11%|█         | 40902/371472 [3:15:35<24:43:18,  3.71it/s]
 11%|█         | 40903/371472 [3:15:36<24:44:44,  3.71it/s]
 11%|█         | 40904/371472 [3:15:36<24:27:27,  3.75it/s]
 11%|█         | 40905/371472 [3:15:36<25:56:02,  3.54it/s]
 11%|█         | 40906/371472 [3:15:36<25:05:02,  3.66it/s]
 11%|█         | 40907/371472 [3:15:37<24:49:09,  3.70it/s]
 11%|█         | 40908/371472 [3:15:37<25:05:53,  3.66it/s]
 11%|█         | 40909/371472 [3:15:37<26:06:22,  3.52it/s]
 11%|█         | 40910/371472 [3:15:37<26:10:10,  3.51it/s]
 11%|█         | 40911/371472 [3:15:38<25:40:38,  3.58it/s]
 11%|█         | 40912/371472 [3:15:38<24:41:01,  3.72it/s]
 11%|█         | 40913/371472 [3:15:38<25:12:21,  3.64it/s]
 11%|█         | 40914/371472 [3:15:39<25:06:26,  3.66it/s]
 11%|█         | 40915/371472 [3:15:39<26:06:08,  3.52it/s]
 11%|█         | 40916/371472 [3:15:39<25:28:28,  3.60it/s]
 11%|█         | 40917/371472 [3:15:39<26:24:45,  3.48it/s]
 11%|█         | 40918/371472 [3:15:40<26:21:37,  3.48it/s]
 11%|█         | 40919/371472 [3:15:40<25:32:13,  3.60it/s]
 11%|█         | 40920/371472 [3:15:40<24:36:58,  3.73it/s]
                                                           
{'loss': 4.388, 'learning_rate': 9.012906979249714e-07, 'epoch': 1.76}

 11%|█         | 40920/371472 [3:15:40<24:36:58,  3.73it/s]
 11%|█         | 40921/371472 [3:15:41<24:38:33,  3.73it/s]
 11%|█         | 40922/371472 [3:15:41<25:36:26,  3.59it/s]
 11%|█         | 40923/371472 [3:15:41<26:08:50,  3.51it/s]
 11%|█         | 40924/371472 [3:15:41<26:49:24,  3.42it/s]
 11%|█         | 40925/371472 [3:15:42<25:55:55,  3.54it/s]
 11%|█         | 40926/371472 [3:15:42<26:32:45,  3.46it/s]
 11%|█         | 40927/371472 [3:15:42<26:40:09,  3.44it/s]
 11%|█         | 40928/371472 [3:15:43<26:50:38,  3.42it/s]
 11%|█         | 40929/371472 [3:15:43<27:47:06,  3.30it/s]
 11%|█         | 40930/371472 [3:15:43<28:09:53,  3.26it/s]
 11%|█         | 40931/371472 [3:15:44<27:43:21,  3.31it/s]
 11%|█         | 40932/371472 [3:15:44<26:37:23,  3.45it/s]
 11%|█         | 40933/371472 [3:15:44<25:49:24,  3.56it/s]
 11%|█         | 40934/371472 [3:15:44<26:48:19,  3.43it/s]
 11%|█         | 40935/371472 [3:15:45<29:38:32,  3.10it/s]
 11%|█         | 40936/371472 [3:15:45<27:16:58,  3.37it/s]
 11%|█         | 40937/371472 [3:15:45<26:30:22,  3.46it/s]
 11%|█         | 40938/371472 [3:15:46<26:29:38,  3.47it/s]
 11%|█         | 40939/371472 [3:15:46<27:45:01,  3.31it/s]
 11%|█         | 40940/371472 [3:15:46<30:57:13,  2.97it/s]
                                                           
{'loss': 4.2305, 'learning_rate': 9.012422159494926e-07, 'epoch': 1.76}

 11%|█         | 40940/371472 [3:15:46<30:57:13,  2.97it/s]
 11%|█         | 40941/371472 [3:15:47<29:25:07,  3.12it/s]
 11%|█         | 40942/371472 [3:15:47<29:29:02,  3.11it/s]
 11%|█         | 40943/371472 [3:15:47<27:45:59,  3.31it/s]
 11%|█         | 40944/371472 [3:15:47<26:24:48,  3.48it/s]
 11%|█         | 40945/371472 [3:15:48<26:07:24,  3.51it/s]
 11%|█         | 40946/371472 [3:15:48<26:10:33,  3.51it/s]
 11%|█         | 40947/371472 [3:15:48<25:50:10,  3.55it/s]
 11%|█         | 40948/371472 [3:15:49<26:10:22,  3.51it/s]
 11%|█         | 40949/371472 [3:15:49<25:23:19,  3.62it/s]
 11%|█         | 40950/371472 [3:15:49<25:09:27,  3.65it/s]
 11%|█         | 40951/371472 [3:15:49<24:21:02,  3.77it/s]
 11%|█         | 40952/371472 [3:15:50<24:28:54,  3.75it/s]
 11%|█         | 40953/371472 [3:15:50<24:01:01,  3.82it/s]
 11%|█         | 40954/371472 [3:15:50<24:16:14,  3.78it/s]
 11%|█         | 40955/371472 [3:15:50<25:08:11,  3.65it/s]
 11%|█         | 40956/371472 [3:15:51<25:58:17,  3.54it/s]
 11%|█         | 40957/371472 [3:15:51<25:49:40,  3.55it/s]
 11%|█         | 40958/371472 [3:15:51<26:18:20,  3.49it/s]
 11%|█         | 40959/371472 [3:15:52<25:25:04,  3.61it/s]
 11%|█         | 40960/371472 [3:15:52<26:34:52,  3.45it/s]
                                                           
{'loss': 4.5238, 'learning_rate': 9.011937339740136e-07, 'epoch': 1.76}

 11%|█         | 40960/371472 [3:15:52<26:34:52,  3.45it/s]
 11%|█         | 40961/371472 [3:15:52<25:33:28,  3.59it/s]
 11%|█         | 40962/371472 [3:15:52<25:47:30,  3.56it/s]
 11%|█         | 40963/371472 [3:15:53<25:16:14,  3.63it/s]
 11%|█         | 40964/371472 [3:15:53<25:34:27,  3.59it/s]
 11%|█         | 40965/371472 [3:15:53<25:29:28,  3.60it/s]
 11%|█         | 40966/371472 [3:15:53<25:36:35,  3.58it/s]
 11%|█         | 40967/371472 [3:15:54<26:14:41,  3.50it/s]
 11%|█         | 40968/371472 [3:15:54<25:51:49,  3.55it/s]
 11%|█         | 40969/371472 [3:15:54<25:37:17,  3.58it/s]
 11%|█         | 40970/371472 [3:15:55<25:28:58,  3.60it/s]
 11%|█         | 40971/371472 [3:15:55<25:47:13,  3.56it/s]
 11%|█         | 40972/371472 [3:15:55<24:51:37,  3.69it/s]
 11%|█         | 40973/371472 [3:15:55<24:10:35,  3.80it/s]
 11%|█         | 40974/371472 [3:15:56<25:49:17,  3.56it/s]
 11%|█         | 40975/371472 [3:15:56<25:56:46,  3.54it/s]
 11%|█         | 40976/371472 [3:15:56<26:29:59,  3.46it/s]
 11%|█         | 40977/371472 [3:15:57<25:56:18,  3.54it/s]
 11%|█         | 40978/371472 [3:15:57<25:38:27,  3.58it/s]
 11%|█         | 40979/371472 [3:15:57<27:45:44,  3.31it/s]
 11%|█         | 40980/371472 [3:15:57<26:38:51,  3.45it/s]
                                                           
{'loss': 4.5662, 'learning_rate': 9.011452519985347e-07, 'epoch': 1.77}

 11%|█         | 40980/371472 [3:15:57<26:38:51,  3.45it/s]
 11%|█         | 40981/371472 [3:15:58<25:34:58,  3.59it/s]
 11%|█         | 40982/371472 [3:15:58<25:19:59,  3.62it/s]
 11%|█         | 40983/371472 [3:15:58<25:46:05,  3.56it/s]
 11%|█         | 40984/371472 [3:15:59<27:36:39,  3.32it/s]
 11%|█         | 40985/371472 [3:15:59<27:44:54,  3.31it/s]
 11%|█         | 40986/371472 [3:15:59<26:25:26,  3.47it/s]
 11%|█         | 40987/371472 [3:15:59<25:53:41,  3.55it/s]
 11%|█         | 40988/371472 [3:16:00<26:41:07,  3.44it/s]
 11%|█         | 40989/371472 [3:16:00<28:27:09,  3.23it/s]
 11%|█         | 40990/371472 [3:16:00<27:13:50,  3.37it/s]
 11%|█         | 40991/371472 [3:16:01<25:57:35,  3.54it/s]
 11%|█         | 40992/371472 [3:16:01<27:13:32,  3.37it/s]
 11%|█         | 40993/371472 [3:16:01<26:44:14,  3.43it/s]
 11%|█         | 40994/371472 [3:16:01<25:54:41,  3.54it/s]
 11%|█         | 40995/371472 [3:16:02<29:18:22,  3.13it/s]
 11%|█         | 40996/371472 [3:16:02<28:03:02,  3.27it/s]
 11%|█         | 40997/371472 [3:16:02<27:56:32,  3.29it/s]
 11%|█         | 40998/371472 [3:16:03<28:29:30,  3.22it/s]
 11%|█         | 40999/371472 [3:16:03<29:46:52,  3.08it/s]
 11%|█         | 41000/371472 [3:16:03<29:01:17,  3.16it/s]
                                                           
{'loss': 4.4144, 'learning_rate': 9.010967700230557e-07, 'epoch': 1.77}

 11%|█         | 41000/371472 [3:16:03<29:01:17,  3.16it/s]
 11%|█         | 41001/371472 [3:16:04<29:19:55,  3.13it/s]
 11%|█         | 41002/371472 [3:16:04<28:50:33,  3.18it/s]
 11%|█         | 41003/371472 [3:16:05<32:22:44,  2.84it/s]
 11%|█         | 41004/371472 [3:16:05<29:50:31,  3.08it/s]
 11%|█         | 41005/371472 [3:16:05<30:12:51,  3.04it/s]
 11%|█         | 41006/371472 [3:16:05<28:47:31,  3.19it/s]
 11%|█         | 41007/371472 [3:16:06<27:28:11,  3.34it/s]
 11%|█         | 41008/371472 [3:16:06<27:10:42,  3.38it/s]
 11%|█         | 41009/371472 [3:16:06<26:37:18,  3.45it/s]
 11%|█         | 41010/371472 [3:16:07<26:51:01,  3.42it/s]
 11%|█         | 41011/371472 [3:16:07<26:58:13,  3.40it/s]
 11%|█         | 41012/371472 [3:16:07<26:01:35,  3.53it/s]
 11%|█         | 41013/371472 [3:16:07<25:07:37,  3.65it/s]
 11%|█         | 41014/371472 [3:16:08<24:39:44,  3.72it/s]
 11%|█         | 41015/371472 [3:16:08<25:27:06,  3.61it/s]
 11%|█         | 41016/371472 [3:16:08<26:17:08,  3.49it/s]
 11%|█         | 41017/371472 [3:16:09<27:33:53,  3.33it/s]
 11%|█         | 41018/371472 [3:16:09<26:45:04,  3.43it/s]
 11%|█         | 41019/371472 [3:16:09<26:34:15,  3.45it/s]
 11%|█         | 41020/371472 [3:16:09<25:09:03,  3.65it/s]
                                                           
{'loss': 4.2149, 'learning_rate': 9.01048288047577e-07, 'epoch': 1.77}

 11%|█         | 41020/371472 [3:16:09<25:09:03,  3.65it/s]
 11%|█         | 41021/371472 [3:16:10<26:10:52,  3.51it/s]
 11%|█         | 41022/371472 [3:16:10<27:17:05,  3.36it/s]
 11%|█         | 41023/371472 [3:16:10<26:08:38,  3.51it/s]
 11%|█         | 41024/371472 [3:16:11<26:20:59,  3.48it/s]
 11%|█         | 41025/371472 [3:16:11<26:29:52,  3.46it/s]
 11%|█         | 41026/371472 [3:16:11<25:43:46,  3.57it/s]
 11%|█         | 41027/371472 [3:16:11<24:56:48,  3.68it/s]
 11%|█         | 41028/371472 [3:16:12<24:44:16,  3.71it/s]
 11%|█         | 41029/371472 [3:16:12<24:58:34,  3.68it/s]
 11%|█         | 41030/371472 [3:16:12<24:28:10,  3.75it/s]
 11%|█         | 41031/371472 [3:16:12<25:02:07,  3.67it/s]
 11%|█         | 41032/371472 [3:16:13<25:31:24,  3.60it/s]
 11%|█         | 41033/371472 [3:16:13<25:49:02,  3.56it/s]
 11%|█         | 41034/371472 [3:16:13<24:48:47,  3.70it/s]
 11%|█         | 41035/371472 [3:16:14<25:07:20,  3.65it/s]
 11%|█         | 41036/371472 [3:16:14<25:26:57,  3.61it/s]
 11%|█         | 41037/371472 [3:16:14<24:53:48,  3.69it/s]
 11%|█         | 41038/371472 [3:16:14<24:40:43,  3.72it/s]
 11%|█         | 41039/371472 [3:16:15<24:30:28,  3.75it/s]
 11%|█         | 41040/371472 [3:16:15<25:27:41,  3.60it/s]
                                                           
{'loss': 4.4242, 'learning_rate': 9.00999806072098e-07, 'epoch': 1.77}

 11%|█         | 41040/371472 [3:16:15<25:27:41,  3.60it/s]
 11%|█         | 41041/371472 [3:16:15<24:48:00,  3.70it/s]
 11%|█         | 41042/371472 [3:16:15<23:53:56,  3.84it/s]
 11%|█         | 41043/371472 [3:16:16<24:42:01,  3.72it/s]
 11%|█         | 41044/371472 [3:16:16<24:44:46,  3.71it/s]
 11%|█         | 41045/371472 [3:16:16<24:59:50,  3.67it/s]
 11%|█         | 41046/371472 [3:16:16<25:18:54,  3.63it/s]
 11%|█         | 41047/371472 [3:16:17<24:44:54,  3.71it/s]
 11%|█         | 41048/371472 [3:16:17<24:32:49,  3.74it/s]
 11%|█         | 41049/371472 [3:16:17<24:07:49,  3.80it/s]
 11%|█         | 41050/371472 [3:16:18<24:41:54,  3.72it/s]
 11%|█         | 41051/371472 [3:16:18<25:33:24,  3.59it/s]
 11%|█         | 41052/371472 [3:16:18<25:01:56,  3.67it/s]
 11%|█         | 41053/371472 [3:16:18<26:06:53,  3.51it/s]
 11%|█         | 41054/371472 [3:16:19<25:32:59,  3.59it/s]
 11%|█         | 41055/371472 [3:16:19<26:35:12,  3.45it/s]
 11%|█         | 41056/371472 [3:16:19<25:44:14,  3.57it/s]
 11%|█         | 41057/371472 [3:16:20<25:19:35,  3.62it/s]
 11%|█         | 41058/371472 [3:16:20<25:06:18,  3.66it/s]
 11%|█         | 41059/371472 [3:16:20<25:12:33,  3.64it/s]
 11%|█         | 41060/371472 [3:16:20<24:29:55,  3.75it/s]
                                                           
{'loss': 4.4088, 'learning_rate': 9.009513240966192e-07, 'epoch': 1.77}

 11%|█         | 41060/371472 [3:16:20<24:29:55,  3.75it/s]
 11%|█         | 41061/371472 [3:16:21<25:55:22,  3.54it/s]
 11%|█         | 41062/371472 [3:16:21<25:43:14,  3.57it/s]
 11%|█         | 41063/371472 [3:16:21<26:01:05,  3.53it/s]
 11%|█         | 41064/371472 [3:16:21<25:49:36,  3.55it/s]
 11%|█         | 41065/371472 [3:16:22<25:44:23,  3.57it/s]
 11%|█         | 41066/371472 [3:16:22<25:34:48,  3.59it/s]
 11%|█         | 41067/371472 [3:16:22<25:09:10,  3.65it/s]
 11%|█         | 41068/371472 [3:16:23<26:14:47,  3.50it/s]
 11%|█         | 41069/371472 [3:16:23<25:53:22,  3.55it/s]
 11%|█         | 41070/371472 [3:16:23<25:08:06,  3.65it/s]
 11%|█         | 41071/371472 [3:16:23<25:58:34,  3.53it/s]
 11%|█         | 41072/371472 [3:16:24<26:11:53,  3.50it/s]
 11%|█         | 41073/371472 [3:16:24<25:54:36,  3.54it/s]
 11%|█         | 41074/371472 [3:16:24<25:41:48,  3.57it/s]
 11%|█         | 41075/371472 [3:16:25<24:59:04,  3.67it/s]
 11%|█         | 41076/371472 [3:16:25<25:05:59,  3.66it/s]
 11%|█         | 41077/371472 [3:16:25<25:28:19,  3.60it/s]
 11%|█         | 41078/371472 [3:16:25<26:20:12,  3.48it/s]
 11%|█         | 41079/371472 [3:16:26<25:56:23,  3.54it/s]
 11%|█         | 41080/371472 [3:16:26<26:22:43,  3.48it/s]
                                                           
{'loss': 4.323, 'learning_rate': 9.009028421211403e-07, 'epoch': 1.77}

 11%|█         | 41080/371472 [3:16:26<26:22:43,  3.48it/s]
 11%|█         | 41081/371472 [3:16:26<25:48:27,  3.56it/s]
 11%|█         | 41082/371472 [3:16:27<25:41:33,  3.57it/s]
 11%|█         | 41083/371472 [3:16:27<24:44:08,  3.71it/s]
 11%|█         | 41084/371472 [3:16:27<24:22:50,  3.76it/s]
 11%|█         | 41085/371472 [3:16:27<24:11:35,  3.79it/s]
 11%|█         | 41086/371472 [3:16:28<23:37:29,  3.88it/s]
 11%|█         | 41087/371472 [3:16:28<23:14:56,  3.95it/s]
 11%|█         | 41088/371472 [3:16:28<23:21:02,  3.93it/s]
 11%|█         | 41089/371472 [3:16:28<25:18:27,  3.63it/s]
 11%|█         | 41090/371472 [3:16:29<25:26:57,  3.61it/s]
 11%|█         | 41091/371472 [3:16:29<25:31:42,  3.59it/s]
 11%|█         | 41092/371472 [3:16:29<24:58:36,  3.67it/s]
 11%|█         | 41093/371472 [3:16:29<24:25:09,  3.76it/s]
 11%|█         | 41094/371472 [3:16:30<24:09:20,  3.80it/s]
 11%|█         | 41095/371472 [3:16:30<23:36:35,  3.89it/s]
 11%|█         | 41096/371472 [3:16:30<25:46:40,  3.56it/s]
 11%|█         | 41097/371472 [3:16:31<25:34:24,  3.59it/s]
 11%|█         | 41098/371472 [3:16:31<27:33:05,  3.33it/s]
 11%|█         | 41099/371472 [3:16:31<28:05:16,  3.27it/s]
 11%|█         | 41100/371472 [3:16:31<26:28:55,  3.47it/s]
                                                           
{'loss': 4.4107, 'learning_rate': 9.008543601456614e-07, 'epoch': 1.77}

 11%|█         | 41100/371472 [3:16:31<26:28:55,  3.47it/s]
 11%|█         | 41101/371472 [3:16:32<26:14:43,  3.50it/s]
 11%|█         | 41102/371472 [3:16:32<27:04:08,  3.39it/s]
 11%|█         | 41103/371472 [3:16:32<25:48:28,  3.56it/s]
 11%|█         | 41104/371472 [3:16:33<26:12:31,  3.50it/s]
 11%|█         | 41105/371472 [3:16:33<26:14:52,  3.50it/s]
 11%|█         | 41106/371472 [3:16:33<26:20:56,  3.48it/s]
 11%|█         | 41107/371472 [3:16:33<26:32:06,  3.46it/s]
 11%|█         | 41108/371472 [3:16:34<26:53:04,  3.41it/s]
 11%|█         | 41109/371472 [3:16:34<26:42:07,  3.44it/s]
 11%|█         | 41110/371472 [3:16:34<26:31:13,  3.46it/s]
 11%|█         | 41111/371472 [3:16:35<26:44:37,  3.43it/s]
 11%|█         | 41112/371472 [3:16:35<25:57:30,  3.54it/s]
 11%|█         | 41113/371472 [3:16:35<26:03:46,  3.52it/s]
 11%|█         | 41114/371472 [3:16:35<26:26:24,  3.47it/s]
 11%|█         | 41115/371472 [3:16:36<28:27:55,  3.22it/s]
 11%|█         | 41116/371472 [3:16:36<27:08:51,  3.38it/s]
 11%|█         | 41117/371472 [3:16:36<26:05:19,  3.52it/s]
 11%|█         | 41118/371472 [3:16:37<25:14:07,  3.64it/s]
 11%|█         | 41119/371472 [3:16:37<25:45:13,  3.56it/s]
 11%|█         | 41120/371472 [3:16:37<25:37:13,  3.58it/s]
                                                           
{'loss': 4.5422, 'learning_rate': 9.008058781701824e-07, 'epoch': 1.77}

 11%|█         | 41120/371472 [3:16:37<25:37:13,  3.58it/s]
 11%|█         | 41121/371472 [3:16:37<25:43:41,  3.57it/s]
 11%|█         | 41122/371472 [3:16:38<25:07:28,  3.65it/s]
 11%|█         | 41123/371472 [3:16:38<25:10:21,  3.65it/s]
 11%|█         | 41124/371472 [3:16:38<26:02:13,  3.52it/s]
 11%|█         | 41125/371472 [3:16:39<27:35:32,  3.33it/s]
 11%|█         | 41126/371472 [3:16:39<26:27:55,  3.47it/s]
 11%|█         | 41127/371472 [3:16:39<26:55:00,  3.41it/s]
 11%|█         | 41128/371472 [3:16:40<29:15:04,  3.14it/s]
 11%|█         | 41129/371472 [3:16:40<28:11:09,  3.26it/s]
 11%|█         | 41130/371472 [3:16:40<27:16:25,  3.36it/s]
 11%|█         | 41131/371472 [3:16:41<29:17:53,  3.13it/s]
 11%|█         | 41132/371472 [3:16:41<27:20:22,  3.36it/s]
 11%|█         | 41133/371472 [3:16:41<27:18:37,  3.36it/s]
 11%|█         | 41134/371472 [3:16:41<26:51:44,  3.42it/s]
 11%|█         | 41135/371472 [3:16:42<25:51:06,  3.55it/s]
 11%|█         | 41136/371472 [3:16:42<24:59:54,  3.67it/s]
 11%|█         | 41137/371472 [3:16:42<24:44:39,  3.71it/s]
 11%|█         | 41138/371472 [3:16:42<27:03:21,  3.39it/s]
 11%|█         | 41139/371472 [3:16:43<26:45:22,  3.43it/s]
 11%|█         | 41140/371472 [3:16:43<26:10:14,  3.51it/s]
                                                           
{'loss': 4.4039, 'learning_rate': 9.007573961947035e-07, 'epoch': 1.77}

 11%|█         | 41140/371472 [3:16:43<26:10:14,  3.51it/s]
 11%|█         | 41141/371472 [3:16:43<25:51:26,  3.55it/s]
 11%|█         | 41142/371472 [3:16:44<26:22:13,  3.48it/s]
 11%|█         | 41143/371472 [3:16:44<25:52:16,  3.55it/s]
 11%|█         | 41144/371472 [3:16:44<26:01:59,  3.52it/s]
 11%|█         | 41145/371472 [3:16:44<26:29:18,  3.46it/s]
 11%|█         | 41146/371472 [3:16:45<26:28:03,  3.47it/s]
 11%|█         | 41147/371472 [3:16:45<26:00:36,  3.53it/s]
 11%|█         | 41148/371472 [3:16:45<26:00:37,  3.53it/s]
 11%|█         | 41149/371472 [3:16:46<25:23:45,  3.61it/s]
 11%|█         | 41150/371472 [3:16:46<26:03:54,  3.52it/s]
 11%|█         | 41151/371472 [3:16:46<26:27:52,  3.47it/s]
 11%|█         | 41152/371472 [3:16:46<25:34:59,  3.59it/s]
 11%|█         | 41153/371472 [3:16:47<25:16:38,  3.63it/s]
 11%|█         | 41154/371472 [3:16:47<24:29:36,  3.75it/s]
 11%|█         | 41155/371472 [3:16:47<23:53:37,  3.84it/s]
 11%|█         | 41156/371472 [3:16:47<25:37:41,  3.58it/s]
 11%|█         | 41157/371472 [3:16:48<25:49:43,  3.55it/s]
 11%|█         | 41158/371472 [3:16:48<30:28:32,  3.01it/s]
 11%|█         | 41159/371472 [3:16:49<30:28:12,  3.01it/s]
 11%|█         | 41160/371472 [3:16:49<31:04:50,  2.95it/s]
                                                           
{'loss': 4.2002, 'learning_rate': 9.007089142192247e-07, 'epoch': 1.77}

 11%|█         | 41160/371472 [3:16:49<31:04:50,  2.95it/s]
 11%|█         | 41161/371472 [3:16:49<29:20:50,  3.13it/s]
 11%|█         | 41162/371472 [3:16:49<28:30:58,  3.22it/s]
 11%|█         | 41163/371472 [3:16:50<28:01:58,  3.27it/s]
 11%|█         | 41164/371472 [3:16:50<28:17:03,  3.24it/s]
 11%|█         | 41165/371472 [3:16:50<26:30:05,  3.46it/s]
 11%|█         | 41166/371472 [3:16:51<26:38:09,  3.44it/s]
 11%|█         | 41167/371472 [3:16:51<25:39:34,  3.58it/s]
 11%|█         | 41168/371472 [3:16:51<25:34:03,  3.59it/s]
 11%|█         | 41169/371472 [3:16:51<25:16:29,  3.63it/s]
 11%|█         | 41170/371472 [3:16:52<27:26:31,  3.34it/s]
 11%|█         | 41171/371472 [3:16:52<28:09:55,  3.26it/s]
 11%|█         | 41172/371472 [3:16:52<27:46:36,  3.30it/s]
 11%|█         | 41173/371472 [3:16:53<26:22:06,  3.48it/s]
 11%|█         | 41174/371472 [3:16:53<27:15:26,  3.37it/s]
 11%|█         | 41175/371472 [3:16:53<26:50:01,  3.42it/s]
 11%|█         | 41176/371472 [3:16:54<25:39:53,  3.57it/s]
 11%|█         | 41177/371472 [3:16:54<25:50:18,  3.55it/s]
 11%|█         | 41178/371472 [3:16:54<25:07:40,  3.65it/s]
 11%|█         | 41179/371472 [3:16:54<26:38:14,  3.44it/s]
 11%|█         | 41180/371472 [3:16:55<26:39:08,  3.44it/s]
                                                           
{'loss': 4.3473, 'learning_rate': 9.006604322437459e-07, 'epoch': 1.77}

 11%|█         | 41180/371472 [3:16:55<26:39:08,  3.44it/s]
 11%|█         | 41181/371472 [3:16:55<26:58:37,  3.40it/s]
 11%|█         | 41182/371472 [3:16:55<25:44:37,  3.56it/s]
 11%|█         | 41183/371472 [3:16:55<24:48:14,  3.70it/s]
 11%|█         | 41184/371472 [3:16:56<24:27:59,  3.75it/s]
 11%|█         | 41185/371472 [3:16:56<23:56:40,  3.83it/s]
 11%|█         | 41186/371472 [3:16:56<24:10:16,  3.80it/s]
 11%|█         | 41187/371472 [3:16:57<24:54:27,  3.68it/s]
 11%|█         | 41188/371472 [3:16:57<25:08:13,  3.65it/s]
 11%|█         | 41189/371472 [3:16:57<25:11:15,  3.64it/s]
 11%|█         | 41190/371472 [3:16:57<24:40:23,  3.72it/s]
 11%|█         | 41191/371472 [3:16:58<26:42:14,  3.44it/s]
 11%|█         | 41192/371472 [3:16:58<26:19:16,  3.49it/s]
 11%|█         | 41193/371472 [3:16:58<27:18:28,  3.36it/s]
 11%|█         | 41194/371472 [3:16:59<26:10:12,  3.51it/s]
 11%|█         | 41195/371472 [3:16:59<27:03:43,  3.39it/s]
 11%|█         | 41196/371472 [3:16:59<26:19:44,  3.48it/s]
 11%|█         | 41197/371472 [3:16:59<25:19:42,  3.62it/s]
 11%|█         | 41198/371472 [3:17:00<25:14:53,  3.63it/s]
 11%|█         | 41199/371472 [3:17:00<24:39:23,  3.72it/s]
 11%|█         | 41200/371472 [3:17:00<25:41:19,  3.57it/s]
                                                           
{'loss': 4.2903, 'learning_rate': 9.006119502682669e-07, 'epoch': 1.77}

 11%|█         | 41200/371472 [3:17:00<25:41:19,  3.57it/s]
 11%|█         | 41201/371472 [3:17:01<26:32:49,  3.46it/s]
 11%|█         | 41202/371472 [3:17:01<26:36:44,  3.45it/s]
 11%|█         | 41203/371472 [3:17:01<26:30:04,  3.46it/s]
 11%|█         | 41204/371472 [3:17:01<25:33:12,  3.59it/s]
 11%|█         | 41205/371472 [3:17:02<26:11:38,  3.50it/s]
 11%|█         | 41206/371472 [3:17:02<25:05:20,  3.66it/s]
 11%|█         | 41207/371472 [3:17:02<26:00:05,  3.53it/s]
 11%|█         | 41208/371472 [3:17:02<25:35:13,  3.59it/s]
 11%|█         | 41209/371472 [3:17:03<24:37:24,  3.73it/s]
 11%|█         | 41210/371472 [3:17:03<25:44:46,  3.56it/s]
 11%|█         | 41211/371472 [3:17:03<27:04:59,  3.39it/s]
 11%|█         | 41212/371472 [3:17:04<25:51:29,  3.55it/s]
 11%|█         | 41213/371472 [3:17:04<25:05:23,  3.66it/s]
 11%|█         | 41214/371472 [3:17:04<25:26:54,  3.60it/s]
 11%|█         | 41215/371472 [3:17:04<25:29:50,  3.60it/s]
 11%|█         | 41216/371472 [3:17:05<24:37:32,  3.73it/s]
 11%|█         | 41217/371472 [3:17:05<25:32:12,  3.59it/s]
 11%|█         | 41218/371472 [3:17:05<29:42:10,  3.09it/s]
 11%|█         | 41219/371472 [3:17:06<28:30:39,  3.22it/s]
 11%|█         | 41220/371472 [3:17:06<29:26:32,  3.12it/s]
                                                           
{'loss': 4.4221, 'learning_rate': 9.00563468292788e-07, 'epoch': 1.78}

 11%|█         | 41220/371472 [3:17:06<29:26:32,  3.12it/s]
 11%|█         | 41221/371472 [3:17:06<28:05:14,  3.27it/s]
 11%|█         | 41222/371472 [3:17:07<27:34:31,  3.33it/s]
 11%|█         | 41223/371472 [3:17:07<27:08:40,  3.38it/s]
 11%|█         | 41224/371472 [3:17:07<27:18:56,  3.36it/s]
 11%|█         | 41225/371472 [3:17:07<28:03:07,  3.27it/s]
 11%|█         | 41226/371472 [3:17:08<26:36:00,  3.45it/s]
 11%|█         | 41227/371472 [3:17:08<26:16:15,  3.49it/s]
 11%|█         | 41228/371472 [3:17:08<26:10:03,  3.51it/s]
 11%|█         | 41229/371472 [3:17:09<26:18:46,  3.49it/s]
 11%|█         | 41230/371472 [3:17:09<25:17:45,  3.63it/s]
 11%|█         | 41231/371472 [3:17:09<26:12:46,  3.50it/s]
 11%|█         | 41232/371472 [3:17:09<25:27:49,  3.60it/s]
 11%|█         | 41233/371472 [3:17:10<24:41:35,  3.71it/s]
 11%|█         | 41234/371472 [3:17:10<24:06:05,  3.81it/s]
 11%|█         | 41235/371472 [3:17:10<24:53:11,  3.69it/s]
 11%|█         | 41236/371472 [3:17:11<25:32:43,  3.59it/s]
 11%|█         | 41237/371472 [3:17:11<27:55:59,  3.28it/s]
 11%|█         | 41238/371472 [3:17:11<27:19:55,  3.36it/s]
 11%|█         | 41239/371472 [3:17:11<26:22:50,  3.48it/s]
 11%|█         | 41240/371472 [3:17:12<26:30:35,  3.46it/s]
                                                           
{'loss': 4.3886, 'learning_rate': 9.005149863173091e-07, 'epoch': 1.78}

 11%|█         | 41240/371472 [3:17:12<26:30:35,  3.46it/s]
 11%|█         | 41241/371472 [3:17:12<25:56:45,  3.54it/s]
 11%|█         | 41242/371472 [3:17:12<28:12:08,  3.25it/s]
 11%|█         | 41243/371472 [3:17:13<26:36:19,  3.45it/s]
 11%|█         | 41244/371472 [3:17:13<26:39:35,  3.44it/s]
 11%|█         | 41245/371472 [3:17:13<25:27:59,  3.60it/s]
 11%|█         | 41246/371472 [3:17:13<25:50:33,  3.55it/s]
 11%|█         | 41247/371472 [3:17:14<25:55:07,  3.54it/s]
 11%|█         | 41248/371472 [3:17:14<25:16:50,  3.63it/s]
 11%|█         | 41249/371472 [3:17:14<26:15:20,  3.49it/s]
 11%|█         | 41250/371472 [3:17:15<26:07:34,  3.51it/s]
 11%|█         | 41251/371472 [3:17:15<25:04:01,  3.66it/s]
 11%|█         | 41252/371472 [3:17:15<24:20:51,  3.77it/s]
 11%|█         | 41253/371472 [3:17:15<25:30:24,  3.60it/s]
 11%|█         | 41254/371472 [3:17:16<24:57:00,  3.68it/s]
 11%|█         | 41255/371472 [3:17:16<24:43:52,  3.71it/s]
 11%|█         | 41256/371472 [3:17:16<25:28:19,  3.60it/s]
 11%|█         | 41257/371472 [3:17:17<27:06:21,  3.38it/s]
 11%|█         | 41258/371472 [3:17:17<27:51:36,  3.29it/s]
 11%|█         | 41259/371472 [3:17:17<27:30:11,  3.34it/s]
 11%|█         | 41260/371472 [3:17:17<26:58:13,  3.40it/s]
                                                           
{'loss': 4.3666, 'learning_rate': 9.004665043418301e-07, 'epoch': 1.78}

 11%|█         | 41260/371472 [3:17:17<26:58:13,  3.40it/s]
 11%|█         | 41261/371472 [3:17:18<26:41:21,  3.44it/s]
 11%|█         | 41262/371472 [3:17:18<27:16:25,  3.36it/s]
 11%|█         | 41263/371472 [3:17:18<26:58:29,  3.40it/s]
 11%|█         | 41264/371472 [3:17:19<25:51:45,  3.55it/s]
 11%|█         | 41265/371472 [3:17:19<26:46:30,  3.43it/s]
 11%|█         | 41266/371472 [3:17:19<25:31:43,  3.59it/s]
 11%|█         | 41267/371472 [3:17:19<25:48:46,  3.55it/s]
 11%|█         | 41268/371472 [3:17:20<28:19:27,  3.24it/s]
 11%|█         | 41269/371472 [3:17:20<27:40:13,  3.31it/s]
 11%|█         | 41270/371472 [3:17:20<26:16:21,  3.49it/s]
 11%|█         | 41271/371472 [3:17:21<26:00:41,  3.53it/s]
 11%|█         | 41272/371472 [3:17:21<27:33:30,  3.33it/s]
 11%|█         | 41273/371472 [3:17:21<26:47:50,  3.42it/s]
 11%|█         | 41274/371472 [3:17:21<26:12:09,  3.50it/s]
 11%|█         | 41275/371472 [3:17:22<27:11:15,  3.37it/s]
 11%|█         | 41276/371472 [3:17:22<25:38:39,  3.58it/s]
 11%|█         | 41277/371472 [3:17:22<25:45:42,  3.56it/s]
 11%|█         | 41278/371472 [3:17:23<26:03:45,  3.52it/s]
 11%|█         | 41279/371472 [3:17:23<26:17:00,  3.49it/s]
 11%|█         | 41280/371472 [3:17:23<27:32:38,  3.33it/s]
                                                           
{'loss': 4.3247, 'learning_rate': 9.004180223663513e-07, 'epoch': 1.78}

 11%|█         | 41280/371472 [3:17:23<27:32:38,  3.33it/s]
 11%|█         | 41281/371472 [3:17:24<27:35:51,  3.32it/s]
 11%|█         | 41282/371472 [3:17:24<27:17:09,  3.36it/s]
 11%|█         | 41283/371472 [3:17:24<26:27:01,  3.47it/s]
 11%|█         | 41284/371472 [3:17:24<27:31:32,  3.33it/s]
 11%|█         | 41285/371472 [3:17:25<27:59:34,  3.28it/s]
 11%|█         | 41286/371472 [3:17:25<26:26:36,  3.47it/s]
 11%|█         | 41287/371472 [3:17:25<25:33:23,  3.59it/s]
 11%|█         | 41288/371472 [3:17:26<25:25:04,  3.61it/s]
 11%|█         | 41289/371472 [3:17:26<27:01:21,  3.39it/s]
 11%|█         | 41290/371472 [3:17:26<26:26:07,  3.47it/s]
 11%|█         | 41291/371472 [3:17:26<28:39:21,  3.20it/s]
 11%|█         | 41292/371472 [3:17:27<26:45:07,  3.43it/s]
 11%|█         | 41293/371472 [3:17:27<25:58:54,  3.53it/s]
 11%|█         | 41294/371472 [3:17:27<26:16:25,  3.49it/s]
 11%|█         | 41295/371472 [3:17:28<29:19:16,  3.13it/s]
 11%|█         | 41296/371472 [3:17:28<31:14:09,  2.94it/s]
 11%|█         | 41297/371472 [3:17:28<29:28:44,  3.11it/s]
 11%|█         | 41298/371472 [3:17:29<28:45:15,  3.19it/s]
 11%|█         | 41299/371472 [3:17:29<28:10:35,  3.25it/s]
 11%|█         | 41300/371472 [3:17:29<26:50:44,  3.42it/s]
                                                           
{'loss': 4.4073, 'learning_rate': 9.003695403908724e-07, 'epoch': 1.78}

 11%|█         | 41300/371472 [3:17:29<26:50:44,  3.42it/s]
 11%|█         | 41301/371472 [3:17:29<25:52:59,  3.54it/s]
 11%|█         | 41302/371472 [3:17:30<24:58:54,  3.67it/s]
 11%|█         | 41303/371472 [3:17:30<25:32:17,  3.59it/s]
 11%|█         | 41304/371472 [3:17:30<25:19:20,  3.62it/s]
 11%|█         | 41305/371472 [3:17:31<27:17:54,  3.36it/s]
 11%|█         | 41306/371472 [3:17:31<25:46:31,  3.56it/s]
 11%|█         | 41307/371472 [3:17:31<25:42:37,  3.57it/s]
 11%|█         | 41308/371472 [3:17:31<25:17:39,  3.63it/s]
 11%|█         | 41309/371472 [3:17:32<24:57:23,  3.67it/s]
 11%|█         | 41310/371472 [3:17:32<24:29:21,  3.74it/s]
 11%|█         | 41311/371472 [3:17:32<26:05:50,  3.51it/s]
 11%|█         | 41312/371472 [3:17:33<25:29:33,  3.60it/s]
 11%|█         | 41313/371472 [3:17:33<25:21:52,  3.62it/s]
 11%|█         | 41314/371472 [3:17:33<26:26:42,  3.47it/s]
 11%|█         | 41315/371472 [3:17:33<27:55:16,  3.28it/s]
 11%|█         | 41316/371472 [3:17:34<26:53:05,  3.41it/s]
 11%|█         | 41317/371472 [3:17:34<26:35:53,  3.45it/s]
 11%|█         | 41318/371472 [3:17:34<27:32:24,  3.33it/s]
 11%|█         | 41319/371472 [3:17:35<26:10:39,  3.50it/s]
 11%|█         | 41320/371472 [3:17:35<26:04:24,  3.52it/s]
                                                           
{'loss': 4.1473, 'learning_rate': 9.003210584153936e-07, 'epoch': 1.78}

 11%|█         | 41320/371472 [3:17:35<26:04:24,  3.52it/s]
 11%|█         | 41321/371472 [3:17:35<25:24:20,  3.61it/s]
 11%|█         | 41322/371472 [3:17:35<27:43:04,  3.31it/s]
 11%|█         | 41323/371472 [3:17:36<26:58:56,  3.40it/s]
 11%|█         | 41324/371472 [3:17:36<26:44:47,  3.43it/s]
 11%|█         | 41325/371472 [3:17:36<25:43:09,  3.57it/s]
 11%|█         | 41326/371472 [3:17:37<28:24:44,  3.23it/s]
 11%|█         | 41327/371472 [3:17:37<27:41:19,  3.31it/s]
 11%|█         | 41328/371472 [3:17:37<27:58:17,  3.28it/s]
 11%|█         | 41329/371472 [3:17:38<28:17:19,  3.24it/s]
 11%|█         | 41330/371472 [3:17:38<30:28:40,  3.01it/s]
 11%|█         | 41331/371472 [3:17:38<29:46:37,  3.08it/s]
 11%|█         | 41332/371472 [3:17:39<29:36:37,  3.10it/s]
 11%|█         | 41333/371472 [3:17:39<31:13:01,  2.94it/s]
 11%|█         | 41334/371472 [3:17:39<29:21:30,  3.12it/s]
 11%|█         | 41335/371472 [3:17:40<27:57:13,  3.28it/s]
 11%|█         | 41336/371472 [3:17:40<29:27:30,  3.11it/s]
 11%|█         | 41337/371472 [3:17:40<27:36:21,  3.32it/s]
 11%|█         | 41338/371472 [3:17:40<27:19:21,  3.36it/s]
 11%|█         | 41339/371472 [3:17:41<28:57:20,  3.17it/s]
 11%|█         | 41340/371472 [3:17:41<26:56:08,  3.40it/s]
                                                           
{'loss': 4.3599, 'learning_rate': 9.002725764399146e-07, 'epoch': 1.78}

 11%|█         | 41340/371472 [3:17:41<26:56:08,  3.40it/s]
 11%|█         | 41341/371472 [3:17:41<27:27:34,  3.34it/s]
 11%|█         | 41342/371472 [3:17:42<26:44:20,  3.43it/s]
 11%|█         | 41343/371472 [3:17:42<27:03:44,  3.39it/s]
 11%|█         | 41344/371472 [3:17:42<25:54:35,  3.54it/s]
 11%|█         | 41345/371472 [3:17:42<26:43:12,  3.43it/s]
 11%|█         | 41346/371472 [3:17:43<27:29:51,  3.33it/s]
 11%|█         | 41347/371472 [3:17:43<26:05:07,  3.52it/s]
 11%|█         | 41348/371472 [3:17:43<25:55:54,  3.54it/s]
 11%|█         | 41349/371472 [3:17:44<26:07:11,  3.51it/s]
 11%|█         | 41350/371472 [3:17:44<25:57:11,  3.53it/s]
 11%|█         | 41351/371472 [3:17:44<27:09:16,  3.38it/s]
 11%|█         | 41352/371472 [3:17:44<26:47:28,  3.42it/s]
 11%|█         | 41353/371472 [3:17:45<27:35:59,  3.32it/s]
 11%|█         | 41354/371472 [3:17:45<28:28:13,  3.22it/s]
 11%|█         | 41355/371472 [3:17:45<27:25:31,  3.34it/s]
 11%|█         | 41356/371472 [3:17:46<29:07:59,  3.15it/s]
 11%|█         | 41357/371472 [3:17:46<28:12:12,  3.25it/s]
 11%|█         | 41358/371472 [3:17:46<26:52:10,  3.41it/s]
 11%|█         | 41359/371472 [3:17:47<27:02:16,  3.39it/s]
 11%|█         | 41360/371472 [3:17:47<27:34:26,  3.33it/s]
                                                           
{'loss': 4.2765, 'learning_rate': 9.002240944644357e-07, 'epoch': 1.78}

 11%|█         | 41360/371472 [3:17:47<27:34:26,  3.33it/s]
 11%|█         | 41361/371472 [3:17:47<26:20:41,  3.48it/s]
 11%|█         | 41362/371472 [3:17:47<25:04:21,  3.66it/s]
 11%|█         | 41363/371472 [3:17:48<24:55:35,  3.68it/s]
 11%|█         | 41364/371472 [3:17:48<26:26:50,  3.47it/s]
 11%|█         | 41365/371472 [3:17:48<26:22:54,  3.48it/s]
 11%|█         | 41366/371472 [3:17:49<28:33:02,  3.21it/s]
 11%|█         | 41367/371472 [3:17:49<28:38:23,  3.20it/s]
 11%|█         | 41368/371472 [3:17:49<29:06:48,  3.15it/s]
 11%|█         | 41369/371472 [3:17:50<28:26:11,  3.22it/s]
 11%|█         | 41370/371472 [3:17:50<28:16:39,  3.24it/s]
 11%|█         | 41371/371472 [3:17:50<27:18:03,  3.36it/s]
 11%|█         | 41372/371472 [3:17:50<26:16:38,  3.49it/s]
 11%|█         | 41373/371472 [3:17:51<27:31:14,  3.33it/s]
 11%|█         | 41374/371472 [3:17:51<27:17:43,  3.36it/s]
 11%|█         | 41375/371472 [3:17:51<26:14:24,  3.49it/s]
 11%|█         | 41376/371472 [3:17:52<25:00:41,  3.67it/s]
 11%|█         | 41377/371472 [3:17:52<25:14:20,  3.63it/s]
 11%|█         | 41378/371472 [3:17:52<25:48:43,  3.55it/s]
 11%|█         | 41379/371472 [3:17:52<26:00:30,  3.53it/s]
 11%|█         | 41380/371472 [3:17:53<25:18:48,  3.62it/s]
                                                           
{'loss': 4.4386, 'learning_rate': 9.001756124889568e-07, 'epoch': 1.78}

 11%|█         | 41380/371472 [3:17:53<25:18:48,  3.62it/s]
 11%|█         | 41381/371472 [3:17:53<25:18:03,  3.62it/s]
 11%|█         | 41382/371472 [3:17:53<24:37:41,  3.72it/s]
 11%|█         | 41383/371472 [3:17:54<24:43:01,  3.71it/s]
 11%|█         | 41384/371472 [3:17:54<25:33:16,  3.59it/s]
 11%|█         | 41385/371472 [3:17:54<24:58:37,  3.67it/s]
 11%|█         | 41386/371472 [3:17:54<25:27:37,  3.60it/s]
 11%|█         | 41387/371472 [3:17:55<25:57:01,  3.53it/s]
 11%|█         | 41388/371472 [3:17:55<25:59:01,  3.53it/s]
 11%|█         | 41389/371472 [3:17:55<25:15:03,  3.63it/s]
 11%|█         | 41390/371472 [3:17:55<26:07:53,  3.51it/s]
 11%|█         | 41391/371472 [3:17:56<25:49:09,  3.55it/s]
 11%|█         | 41392/371472 [3:17:56<24:33:27,  3.73it/s]
 11%|█         | 41393/371472 [3:17:56<24:06:39,  3.80it/s]
 11%|█         | 41394/371472 [3:17:57<23:34:11,  3.89it/s]
 11%|█         | 41395/371472 [3:17:57<24:49:26,  3.69it/s]
 11%|█         | 41396/371472 [3:17:57<25:27:27,  3.60it/s]
 11%|█         | 41397/371472 [3:17:57<24:54:17,  3.68it/s]
 11%|█         | 41398/371472 [3:17:58<24:24:25,  3.76it/s]
 11%|█         | 41399/371472 [3:17:58<24:26:50,  3.75it/s]
 11%|█         | 41400/371472 [3:17:58<25:45:45,  3.56it/s]
                                                           
{'loss': 4.5666, 'learning_rate': 9.00127130513478e-07, 'epoch': 1.78}

 11%|█         | 41400/371472 [3:17:58<25:45:45,  3.56it/s]
 11%|█         | 41401/371472 [3:17:58<25:40:11,  3.57it/s]
 11%|█         | 41402/371472 [3:17:59<24:42:23,  3.71it/s]
 11%|█         | 41403/371472 [3:17:59<24:15:40,  3.78it/s]
 11%|█         | 41404/371472 [3:17:59<24:45:08,  3.70it/s]
 11%|█         | 41405/371472 [3:18:00<26:22:19,  3.48it/s]
 11%|█         | 41406/371472 [3:18:00<26:06:22,  3.51it/s]
 11%|█         | 41407/371472 [3:18:00<28:01:47,  3.27it/s]
 11%|█         | 41408/371472 [3:18:00<27:10:12,  3.37it/s]
 11%|█         | 41409/371472 [3:18:01<27:45:17,  3.30it/s]
 11%|█         | 41410/371472 [3:18:01<27:32:13,  3.33it/s]
 11%|█         | 41411/371472 [3:18:01<27:23:55,  3.35it/s]
 11%|█         | 41412/371472 [3:18:02<26:27:54,  3.46it/s]
 11%|█         | 41413/371472 [3:18:02<25:29:49,  3.60it/s]
 11%|█         | 41414/371472 [3:18:02<24:55:07,  3.68it/s]
 11%|█         | 41415/371472 [3:18:02<24:43:14,  3.71it/s]
 11%|█         | 41416/371472 [3:18:03<26:46:14,  3.42it/s]
 11%|█         | 41417/371472 [3:18:03<26:23:01,  3.47it/s]
 11%|█         | 41418/371472 [3:18:03<27:19:52,  3.35it/s]
 11%|█         | 41419/371472 [3:18:04<26:27:23,  3.47it/s]
 11%|█         | 41420/371472 [3:18:04<26:21:14,  3.48it/s]
                                                           
{'loss': 4.3756, 'learning_rate': 9.000786485379989e-07, 'epoch': 1.78}

 11%|█         | 41420/371472 [3:18:04<26:21:14,  3.48it/s]
 11%|█         | 41421/371472 [3:18:04<26:22:12,  3.48it/s]
 11%|█         | 41422/371472 [3:18:05<28:29:27,  3.22it/s]
 11%|█         | 41423/371472 [3:18:05<28:56:20,  3.17it/s]
 11%|█         | 41424/371472 [3:18:05<30:56:56,  2.96it/s]
 11%|█         | 41425/371472 [3:18:06<28:28:24,  3.22it/s]
 11%|█         | 41426/371472 [3:18:06<27:08:08,  3.38it/s]
 11%|█         | 41427/371472 [3:18:06<27:19:32,  3.36it/s]
 11%|█         | 41428/371472 [3:18:06<26:48:39,  3.42it/s]
 11%|█         | 41429/371472 [3:18:07<25:25:52,  3.60it/s]
 11%|█         | 41430/371472 [3:18:07<25:18:41,  3.62it/s]
 11%|█         | 41431/371472 [3:18:07<25:13:21,  3.63it/s]
 11%|█         | 41432/371472 [3:18:07<24:25:39,  3.75it/s]
 11%|█         | 41433/371472 [3:18:08<24:41:35,  3.71it/s]
 11%|█         | 41434/371472 [3:18:08<24:58:22,  3.67it/s]
 11%|█         | 41435/371472 [3:18:08<26:11:09,  3.50it/s]
 11%|█         | 41436/371472 [3:18:09<25:38:24,  3.58it/s]
 11%|█         | 41437/371472 [3:18:09<24:54:54,  3.68it/s]
 11%|█         | 41438/371472 [3:18:09<24:51:31,  3.69it/s]
 11%|█         | 41439/371472 [3:18:09<27:50:17,  3.29it/s]
 11%|█         | 41440/371472 [3:18:10<27:51:20,  3.29it/s]
                                                           
{'loss': 4.2232, 'learning_rate': 9.000301665625202e-07, 'epoch': 1.78}

 11%|█         | 41440/371472 [3:18:10<27:51:20,  3.29it/s]
 11%|█         | 41441/371472 [3:18:10<30:28:32,  3.01it/s]
 11%|█         | 41442/371472 [3:18:10<30:15:37,  3.03it/s]
 11%|█         | 41443/371472 [3:18:11<28:19:29,  3.24it/s]
 11%|█         | 41444/371472 [3:18:11<27:58:18,  3.28it/s]
 11%|█         | 41445/371472 [3:18:11<27:06:16,  3.38it/s]
 11%|█         | 41446/371472 [3:18:12<25:52:03,  3.54it/s]
 11%|█         | 41447/371472 [3:18:12<25:16:23,  3.63it/s]
 11%|█         | 41448/371472 [3:18:12<24:53:05,  3.68it/s]
 11%|█         | 41449/371472 [3:18:12<25:00:54,  3.66it/s]
 11%|█         | 41450/371472 [3:18:13<25:21:33,  3.61it/s]
 11%|█         | 41451/371472 [3:18:13<24:53:21,  3.68it/s]
 11%|█         | 41452/371472 [3:18:13<24:31:13,  3.74it/s]
 11%|█         | 41453/371472 [3:18:13<24:20:31,  3.77it/s]
 11%|█         | 41454/371472 [3:18:14<26:56:04,  3.40it/s]
 11%|█         | 41455/371472 [3:18:14<25:52:19,  3.54it/s]
 11%|█         | 41456/371472 [3:18:14<25:27:36,  3.60it/s]
 11%|█         | 41457/371472 [3:18:15<24:42:01,  3.71it/s]
 11%|█         | 41458/371472 [3:18:15<24:15:51,  3.78it/s]
 11%|█         | 41459/371472 [3:18:15<26:28:18,  3.46it/s]
 11%|█         | 41460/371472 [3:18:15<26:15:32,  3.49it/s]
                                                           
{'loss': 4.2154, 'learning_rate': 8.999816845870413e-07, 'epoch': 1.79}

 11%|█         | 41460/371472 [3:18:15<26:15:32,  3.49it/s]
 11%|█         | 41461/371472 [3:18:16<25:21:16,  3.62it/s]
 11%|█         | 41462/371472 [3:18:16<25:21:38,  3.61it/s]
 11%|█         | 41463/371472 [3:18:16<26:42:48,  3.43it/s]
 11%|█         | 41464/371472 [3:18:17<27:24:34,  3.34it/s]
 11%|█         | 41465/371472 [3:18:17<26:06:21,  3.51it/s]
 11%|█         | 41466/371472 [3:18:17<25:30:17,  3.59it/s]
 11%|█         | 41467/371472 [3:18:17<25:32:03,  3.59it/s]
 11%|█         | 41468/371472 [3:18:18<26:49:37,  3.42it/s]
 11%|█         | 41469/371472 [3:18:18<25:56:48,  3.53it/s]
 11%|█         | 41470/371472 [3:18:18<26:36:31,  3.44it/s]
 11%|█         | 41471/371472 [3:18:19<29:01:46,  3.16it/s]
 11%|█         | 41472/371472 [3:18:19<27:12:56,  3.37it/s]
 11%|█         | 41473/371472 [3:18:19<27:45:03,  3.30it/s]
 11%|█         | 41474/371472 [3:18:20<27:49:38,  3.29it/s]
 11%|█         | 41475/371472 [3:18:20<28:25:11,  3.23it/s]
 11%|█         | 41476/371472 [3:18:20<26:58:54,  3.40it/s]
 11%|█         | 41477/371472 [3:18:20<26:05:39,  3.51it/s]
 11%|█         | 41478/371472 [3:18:21<25:37:57,  3.58it/s]
 11%|█         | 41479/371472 [3:18:21<25:37:01,  3.58it/s]
 11%|█         | 41480/371472 [3:18:21<26:04:06,  3.52it/s]
                                                           
{'loss': 4.4487, 'learning_rate': 8.999332026115625e-07, 'epoch': 1.79}

 11%|█         | 41480/371472 [3:18:21<26:04:06,  3.52it/s]
 11%|█         | 41481/371472 [3:18:22<26:05:42,  3.51it/s]
 11%|█         | 41482/371472 [3:18:22<25:55:23,  3.54it/s]
 11%|█         | 41483/371472 [3:18:22<25:27:45,  3.60it/s]
 11%|█         | 41484/371472 [3:18:22<25:15:38,  3.63it/s]
 11%|█         | 41485/371472 [3:18:23<26:43:29,  3.43it/s]
 11%|█         | 41486/371472 [3:18:23<26:04:10,  3.52it/s]
 11%|█         | 41487/371472 [3:18:23<26:15:51,  3.49it/s]
 11%|█         | 41488/371472 [3:18:24<27:36:19,  3.32it/s]
 11%|█         | 41489/371472 [3:18:24<26:29:42,  3.46it/s]
 11%|█         | 41490/371472 [3:18:24<26:16:59,  3.49it/s]
 11%|█         | 41491/371472 [3:18:24<27:18:57,  3.36it/s]
 11%|█         | 41492/371472 [3:18:25<26:30:36,  3.46it/s]
 11%|█         | 41493/371472 [3:18:25<26:10:14,  3.50it/s]
 11%|█         | 41494/371472 [3:18:25<25:32:05,  3.59it/s]
 11%|█         | 41495/371472 [3:18:26<28:51:43,  3.18it/s]
 11%|█         | 41496/371472 [3:18:26<27:24:51,  3.34it/s]
 11%|█         | 41497/371472 [3:18:26<27:46:09,  3.30it/s]
 11%|█         | 41498/371472 [3:18:27<28:00:23,  3.27it/s]
 11%|█         | 41499/371472 [3:18:27<27:26:42,  3.34it/s]
 11%|█         | 41500/371472 [3:18:27<26:24:09,  3.47it/s]
                                                           
{'loss': 4.1479, 'learning_rate': 8.998847206360834e-07, 'epoch': 1.79}

 11%|█         | 41500/371472 [3:18:27<26:24:09,  3.47it/s]
 11%|█         | 41501/371472 [3:18:27<26:31:49,  3.45it/s]
 11%|█         | 41502/371472 [3:18:28<25:11:01,  3.64it/s]
 11%|█         | 41503/371472 [3:18:28<26:10:44,  3.50it/s]
 11%|█         | 41504/371472 [3:18:28<25:42:53,  3.56it/s]
 11%|█         | 41505/371472 [3:18:28<25:33:19,  3.59it/s]
 11%|█         | 41506/371472 [3:18:29<27:16:59,  3.36it/s]
 11%|█         | 41507/371472 [3:18:29<26:27:11,  3.46it/s]
 11%|█         | 41508/371472 [3:18:29<27:01:49,  3.39it/s]
 11%|█         | 41509/371472 [3:18:30<25:49:29,  3.55it/s]
 11%|█         | 41510/371472 [3:18:30<28:54:51,  3.17it/s]
 11%|█         | 41511/371472 [3:18:30<28:09:13,  3.26it/s]
 11%|█         | 41512/371472 [3:18:31<29:12:43,  3.14it/s]
 11%|█         | 41513/371472 [3:18:31<28:10:17,  3.25it/s]
 11%|█         | 41514/371472 [3:18:31<28:07:24,  3.26it/s]
 11%|█         | 41515/371472 [3:18:31<26:37:42,  3.44it/s]
 11%|█         | 41516/371472 [3:18:32<30:42:22,  2.98it/s]
 11%|█         | 41517/371472 [3:18:32<28:52:13,  3.17it/s]
 11%|█         | 41518/371472 [3:18:33<28:45:25,  3.19it/s]
 11%|█         | 41519/371472 [3:18:33<27:29:58,  3.33it/s]
 11%|█         | 41520/371472 [3:18:33<26:35:03,  3.45it/s]
                                                           
{'loss': 4.2259, 'learning_rate': 8.998362386606047e-07, 'epoch': 1.79}

 11%|█         | 41520/371472 [3:18:33<26:35:03,  3.45it/s]
 11%|█         | 41521/371472 [3:18:33<25:41:35,  3.57it/s]
 11%|█         | 41522/371472 [3:18:34<25:47:14,  3.55it/s]
 11%|█         | 41523/371472 [3:18:34<26:29:53,  3.46it/s]
 11%|█         | 41524/371472 [3:18:34<25:36:44,  3.58it/s]
 11%|█         | 41525/371472 [3:18:34<25:28:07,  3.60it/s]
 11%|█         | 41526/371472 [3:18:35<25:41:45,  3.57it/s]
 11%|█         | 41527/371472 [3:18:35<25:04:15,  3.66it/s]
 11%|█         | 41528/371472 [3:18:35<24:22:26,  3.76it/s]
 11%|█         | 41529/371472 [3:18:35<24:18:22,  3.77it/s]
 11%|█         | 41530/371472 [3:18:36<24:48:00,  3.70it/s]
 11%|█         | 41531/371472 [3:18:36<24:30:44,  3.74it/s]
 11%|█         | 41532/371472 [3:18:36<26:24:20,  3.47it/s]
 11%|█         | 41533/371472 [3:18:37<25:41:53,  3.57it/s]
 11%|█         | 41534/371472 [3:18:37<25:19:33,  3.62it/s]
 11%|█         | 41535/371472 [3:18:37<24:21:38,  3.76it/s]
 11%|█         | 41536/371472 [3:18:37<25:52:04,  3.54it/s]
 11%|█         | 41537/371472 [3:18:38<26:18:06,  3.48it/s]
 11%|█         | 41538/371472 [3:18:38<26:55:22,  3.40it/s]
 11%|█         | 41539/371472 [3:18:38<26:19:23,  3.48it/s]
 11%|█         | 41540/371472 [3:18:39<25:38:30,  3.57it/s]
                                                           
{'loss': 4.4609, 'learning_rate': 8.997877566851257e-07, 'epoch': 1.79}

 11%|█         | 41540/371472 [3:18:39<25:38:30,  3.57it/s]
 11%|█         | 41541/371472 [3:18:39<24:58:50,  3.67it/s]
 11%|█         | 41542/371472 [3:18:39<24:48:41,  3.69it/s]
 11%|█         | 41543/371472 [3:18:39<23:58:31,  3.82it/s]
 11%|█         | 41544/371472 [3:18:40<26:04:31,  3.51it/s]
 11%|█         | 41545/371472 [3:18:40<25:00:49,  3.66it/s]
 11%|█         | 41546/371472 [3:18:40<25:12:19,  3.64it/s]
 11%|█         | 41547/371472 [3:18:40<24:36:00,  3.73it/s]
 11%|█         | 41548/371472 [3:18:41<25:30:58,  3.59it/s]
 11%|█         | 41549/371472 [3:18:41<26:26:52,  3.47it/s]
 11%|█         | 41550/371472 [3:18:41<27:15:22,  3.36it/s]
 11%|█         | 41551/371472 [3:18:42<27:23:52,  3.34it/s]
 11%|█         | 41552/371472 [3:18:42<27:17:47,  3.36it/s]
 11%|█         | 41553/371472 [3:18:42<26:10:33,  3.50it/s]
 11%|█         | 41554/371472 [3:18:43<25:30:32,  3.59it/s]
 11%|█         | 41555/371472 [3:18:43<26:07:38,  3.51it/s]
 11%|█         | 41556/371472 [3:18:43<26:16:28,  3.49it/s]
 11%|█         | 41557/371472 [3:18:43<24:56:01,  3.68it/s]
 11%|█         | 41558/371472 [3:18:44<25:52:39,  3.54it/s]
 11%|█         | 41559/371472 [3:18:44<26:08:37,  3.51it/s]
 11%|█         | 41560/371472 [3:18:44<25:05:51,  3.65it/s]
                                                           
{'loss': 4.2485, 'learning_rate': 8.997392747096468e-07, 'epoch': 1.79}

 11%|█         | 41560/371472 [3:18:44<25:05:51,  3.65it/s]
 11%|█         | 41561/371472 [3:18:44<25:30:36,  3.59it/s]
 11%|█         | 41562/371472 [3:18:45<25:26:30,  3.60it/s]
 11%|█         | 41563/371472 [3:18:45<24:47:39,  3.70it/s]
 11%|█         | 41564/371472 [3:18:45<26:07:34,  3.51it/s]
 11%|█         | 41565/371472 [3:18:46<25:35:48,  3.58it/s]
 11%|█         | 41566/371472 [3:18:46<25:43:34,  3.56it/s]
 11%|█         | 41567/371472 [3:18:46<25:59:53,  3.52it/s]
 11%|█         | 41568/371472 [3:18:46<25:29:29,  3.59it/s]
 11%|█         | 41569/371472 [3:18:47<26:53:16,  3.41it/s]
 11%|█         | 41570/371472 [3:18:47<26:09:01,  3.50it/s]
 11%|█         | 41571/371472 [3:18:47<26:20:19,  3.48it/s]
 11%|█         | 41572/371472 [3:18:48<25:16:15,  3.63it/s]
 11%|█         | 41573/371472 [3:18:48<25:07:50,  3.65it/s]
 11%|█         | 41574/371472 [3:18:48<26:25:35,  3.47it/s]
 11%|█         | 41575/371472 [3:18:48<25:18:10,  3.62it/s]
 11%|█         | 41576/371472 [3:18:49<24:54:12,  3.68it/s]
 11%|█         | 41577/371472 [3:18:49<26:31:23,  3.46it/s]
 11%|█         | 41578/371472 [3:18:49<26:45:43,  3.42it/s]
 11%|█         | 41579/371472 [3:18:50<26:01:35,  3.52it/s]
 11%|█         | 41580/371472 [3:18:50<25:08:23,  3.65it/s]
                                                           
{'loss': 4.3681, 'learning_rate': 8.996907927341679e-07, 'epoch': 1.79}

 11%|█         | 41580/371472 [3:18:50<25:08:23,  3.65it/s]
 11%|█         | 41581/371472 [3:18:50<24:38:02,  3.72it/s]
 11%|█         | 41582/371472 [3:18:50<24:34:36,  3.73it/s]
 11%|█         | 41583/371472 [3:18:51<24:51:57,  3.69it/s]
 11%|█         | 41584/371472 [3:18:51<24:54:13,  3.68it/s]
 11%|█         | 41585/371472 [3:18:51<27:08:34,  3.38it/s]
 11%|█         | 41586/371472 [3:18:52<26:38:26,  3.44it/s]
 11%|█         | 41587/371472 [3:18:52<27:26:07,  3.34it/s]
 11%|█         | 41588/371472 [3:18:52<27:19:23,  3.35it/s]
 11%|█         | 41589/371472 [3:18:52<26:58:49,  3.40it/s]
 11%|█         | 41590/371472 [3:18:53<26:52:00,  3.41it/s]
 11%|█         | 41591/371472 [3:18:53<25:52:04,  3.54it/s]
 11%|█         | 41592/371472 [3:18:53<28:53:27,  3.17it/s]
 11%|█         | 41593/371472 [3:18:54<29:58:43,  3.06it/s]
 11%|█         | 41594/371472 [3:18:54<28:28:11,  3.22it/s]
 11%|█         | 41595/371472 [3:18:54<27:00:28,  3.39it/s]
 11%|█         | 41596/371472 [3:18:55<26:36:21,  3.44it/s]
 11%|█         | 41597/371472 [3:18:55<25:36:28,  3.58it/s]
 11%|█         | 41598/371472 [3:18:55<25:17:58,  3.62it/s]
 11%|█         | 41599/371472 [3:18:55<25:37:49,  3.58it/s]
 11%|█         | 41600/371472 [3:18:56<25:13:17,  3.63it/s]
                                                           
{'loss': 4.2164, 'learning_rate': 8.996423107586891e-07, 'epoch': 1.79}

 11%|█         | 41600/371472 [3:18:56<25:13:17,  3.63it/s]
 11%|█         | 41601/371472 [3:18:56<25:25:55,  3.60it/s]
 11%|█         | 41602/371472 [3:18:56<26:08:38,  3.50it/s]
 11%|█         | 41603/371472 [3:18:56<25:48:44,  3.55it/s]
 11%|█         | 41604/371472 [3:18:57<25:43:38,  3.56it/s]
 11%|█         | 41605/371472 [3:18:57<25:13:04,  3.63it/s]
 11%|█         | 41606/371472 [3:18:57<24:43:28,  3.71it/s]
 11%|█         | 41607/371472 [3:18:58<24:33:45,  3.73it/s]
 11%|█         | 41608/371472 [3:18:58<23:43:50,  3.86it/s]
 11%|█         | 41609/371472 [3:18:58<24:26:25,  3.75it/s]
 11%|█         | 41610/371472 [3:18:58<25:00:40,  3.66it/s]
 11%|█         | 41611/371472 [3:18:59<28:54:19,  3.17it/s]
 11%|█         | 41612/371472 [3:18:59<28:00:20,  3.27it/s]
 11%|█         | 41613/371472 [3:18:59<26:00:52,  3.52it/s]
 11%|█         | 41614/371472 [3:19:00<26:58:18,  3.40it/s]
 11%|█         | 41615/371472 [3:19:00<26:52:50,  3.41it/s]
 11%|█         | 41616/371472 [3:19:00<26:07:36,  3.51it/s]
 11%|█         | 41617/371472 [3:19:00<26:12:02,  3.50it/s]
 11%|█         | 41618/371472 [3:19:01<25:40:42,  3.57it/s]
 11%|█         | 41619/371472 [3:19:01<26:04:58,  3.51it/s]
 11%|█         | 41620/371472 [3:19:01<27:45:42,  3.30it/s]
                                                           
{'loss': 4.1929, 'learning_rate': 8.995938287832101e-07, 'epoch': 1.79}

 11%|█         | 41620/371472 [3:19:01<27:45:42,  3.30it/s]
 11%|█         | 41621/371472 [3:19:02<28:54:52,  3.17it/s]
 11%|█         | 41622/371472 [3:19:02<27:27:28,  3.34it/s]
 11%|█         | 41623/371472 [3:19:02<29:25:42,  3.11it/s]
 11%|█         | 41624/371472 [3:19:03<28:15:17,  3.24it/s]
 11%|█         | 41625/371472 [3:19:03<26:39:27,  3.44it/s]
 11%|█         | 41626/371472 [3:19:03<25:53:56,  3.54it/s]
 11%|█         | 41627/371472 [3:19:03<27:30:05,  3.33it/s]
 11%|█         | 41628/371472 [3:19:04<26:20:33,  3.48it/s]
 11%|█         | 41629/371472 [3:19:04<25:32:54,  3.59it/s]
 11%|█         | 41630/371472 [3:19:04<25:13:18,  3.63it/s]
 11%|█         | 41631/371472 [3:19:04<24:34:26,  3.73it/s]
 11%|█         | 41632/371472 [3:19:05<24:30:33,  3.74it/s]
 11%|█         | 41633/371472 [3:19:05<24:23:47,  3.76it/s]
 11%|█         | 41634/371472 [3:19:05<25:05:22,  3.65it/s]
 11%|█         | 41635/371472 [3:19:06<24:47:13,  3.70it/s]
 11%|█         | 41636/371472 [3:19:06<25:22:37,  3.61it/s]
 11%|█         | 41637/371472 [3:19:06<24:52:16,  3.68it/s]
 11%|█         | 41638/371472 [3:19:06<26:03:21,  3.52it/s]
 11%|█         | 41639/371472 [3:19:07<25:04:50,  3.65it/s]
 11%|█         | 41640/371472 [3:19:07<24:48:46,  3.69it/s]
                                                           
{'loss': 4.226, 'learning_rate': 8.995453468077312e-07, 'epoch': 1.79}

 11%|█         | 41640/371472 [3:19:07<24:48:46,  3.69it/s]
 11%|█         | 41641/371472 [3:19:07<25:04:50,  3.65it/s]
 11%|█         | 41642/371472 [3:19:07<24:34:57,  3.73it/s]
 11%|█         | 41643/371472 [3:19:08<24:47:04,  3.70it/s]
 11%|█         | 41644/371472 [3:19:08<24:41:35,  3.71it/s]
 11%|█         | 41645/371472 [3:19:08<25:30:20,  3.59it/s]
 11%|█         | 41646/371472 [3:19:09<24:35:35,  3.73it/s]
 11%|█         | 41647/371472 [3:19:09<25:14:23,  3.63it/s]
 11%|█         | 41648/371472 [3:19:09<24:31:48,  3.73it/s]
 11%|█         | 41649/371472 [3:19:09<24:47:52,  3.69it/s]
 11%|█         | 41650/371472 [3:19:10<24:21:21,  3.76it/s]
 11%|█         | 41651/371472 [3:19:10<25:00:08,  3.66it/s]
 11%|█         | 41652/371472 [3:19:10<25:50:12,  3.55it/s]
 11%|█         | 41653/371472 [3:19:10<24:59:12,  3.67it/s]
 11%|█         | 41654/371472 [3:19:11<24:51:03,  3.69it/s]
 11%|█         | 41655/371472 [3:19:11<24:26:30,  3.75it/s]
 11%|█         | 41656/371472 [3:19:11<24:48:39,  3.69it/s]
 11%|█         | 41657/371472 [3:19:12<24:11:09,  3.79it/s]
 11%|█         | 41658/371472 [3:19:12<23:53:57,  3.83it/s]
 11%|█         | 41659/371472 [3:19:12<24:14:05,  3.78it/s]
 11%|█         | 41660/371472 [3:19:12<25:02:21,  3.66it/s]
                                                           
{'loss': 4.3083, 'learning_rate': 8.994968648322523e-07, 'epoch': 1.79}

 11%|█         | 41660/371472 [3:19:12<25:02:21,  3.66it/s]
 11%|█         | 41661/371472 [3:19:13<26:25:07,  3.47it/s]
 11%|█         | 41662/371472 [3:19:13<28:21:30,  3.23it/s]
 11%|█         | 41663/371472 [3:19:13<27:15:24,  3.36it/s]
 11%|█         | 41664/371472 [3:19:14<26:26:33,  3.46it/s]
 11%|█         | 41665/371472 [3:19:14<26:16:03,  3.49it/s]
 11%|█         | 41666/371472 [3:19:14<26:14:18,  3.49it/s]
 11%|█         | 41667/371472 [3:19:14<25:39:33,  3.57it/s]
 11%|█         | 41668/371472 [3:19:15<25:40:33,  3.57it/s]
 11%|█         | 41669/371472 [3:19:15<25:17:15,  3.62it/s]
 11%|█         | 41670/371472 [3:19:15<25:55:38,  3.53it/s]
 11%|█         | 41671/371472 [3:19:16<25:41:17,  3.57it/s]
 11%|█         | 41672/371472 [3:19:16<25:48:07,  3.55it/s]
 11%|█         | 41673/371472 [3:19:16<25:42:30,  3.56it/s]
 11%|█         | 41674/371472 [3:19:16<24:35:06,  3.73it/s]
 11%|█         | 41675/371472 [3:19:17<24:24:31,  3.75it/s]
 11%|█         | 41676/371472 [3:19:17<24:50:03,  3.69it/s]
 11%|█         | 41677/371472 [3:19:17<25:56:26,  3.53it/s]
 11%|█         | 41678/371472 [3:19:18<26:26:03,  3.47it/s]
 11%|█         | 41679/371472 [3:19:18<25:03:49,  3.66it/s]
 11%|█         | 41680/371472 [3:19:18<24:46:11,  3.70it/s]
                                                           
{'loss': 4.2247, 'learning_rate': 8.994483828567734e-07, 'epoch': 1.8}

 11%|█         | 41680/371472 [3:19:18<24:46:11,  3.70it/s]
 11%|█         | 41681/371472 [3:19:18<25:41:22,  3.57it/s]
 11%|█         | 41682/371472 [3:19:19<24:24:06,  3.75it/s]
 11%|█         | 41683/371472 [3:19:19<25:12:17,  3.63it/s]
 11%|█         | 41684/371472 [3:19:19<27:19:05,  3.35it/s]
 11%|█         | 41685/371472 [3:19:19<26:00:01,  3.52it/s]
 11%|█         | 41686/371472 [3:19:20<25:30:47,  3.59it/s]
 11%|█         | 41687/371472 [3:19:20<25:51:22,  3.54it/s]
 11%|█         | 41688/371472 [3:19:20<26:09:34,  3.50it/s]
 11%|█         | 41689/371472 [3:19:21<25:50:20,  3.55it/s]
 11%|█         | 41690/371472 [3:19:21<25:37:33,  3.57it/s]
 11%|█         | 41691/371472 [3:19:21<25:41:35,  3.57it/s]
 11%|█         | 41692/371472 [3:19:21<24:55:29,  3.68it/s]
 11%|█         | 41693/371472 [3:19:22<24:43:03,  3.71it/s]
 11%|█         | 41694/371472 [3:19:22<24:24:52,  3.75it/s]
 11%|█         | 41695/371472 [3:19:22<24:05:55,  3.80it/s]
 11%|█         | 41696/371472 [3:19:22<25:47:37,  3.55it/s]
 11%|█         | 41697/371472 [3:19:23<26:05:51,  3.51it/s]
 11%|█         | 41698/371472 [3:19:23<26:53:19,  3.41it/s]
 11%|█         | 41699/371472 [3:19:23<28:00:30,  3.27it/s]
 11%|█         | 41700/371472 [3:19:24<27:21:25,  3.35it/s]
                                                           
{'loss': 4.1595, 'learning_rate': 8.993999008812946e-07, 'epoch': 1.8}

 11%|█         | 41700/371472 [3:19:24<27:21:25,  3.35it/s]
 11%|█         | 41701/371472 [3:19:24<26:25:58,  3.47it/s]
 11%|█         | 41702/371472 [3:19:24<30:03:37,  3.05it/s]
 11%|█         | 41703/371472 [3:19:25<31:51:02,  2.88it/s]
 11%|█         | 41704/371472 [3:19:25<29:45:22,  3.08it/s]
 11%|█         | 41705/371472 [3:19:25<27:39:44,  3.31it/s]
 11%|█         | 41706/371472 [3:19:26<27:06:54,  3.38it/s]
 11%|█         | 41707/371472 [3:19:26<26:06:20,  3.51it/s]
 11%|█         | 41708/371472 [3:19:26<25:02:58,  3.66it/s]
 11%|█         | 41709/371472 [3:19:26<24:50:59,  3.69it/s]
 11%|█         | 41710/371472 [3:19:27<24:50:19,  3.69it/s]
 11%|█         | 41711/371472 [3:19:27<24:52:58,  3.68it/s]
 11%|█         | 41712/371472 [3:19:27<25:39:00,  3.57it/s]
 11%|█         | 41713/371472 [3:19:27<25:25:48,  3.60it/s]
 11%|█         | 41714/371472 [3:19:28<26:53:53,  3.41it/s]
 11%|█         | 41715/371472 [3:19:28<26:44:46,  3.42it/s]
 11%|█         | 41716/371472 [3:19:28<27:05:50,  3.38it/s]
 11%|█         | 41717/371472 [3:19:29<26:36:10,  3.44it/s]
 11%|█         | 41718/371472 [3:19:29<25:56:28,  3.53it/s]
 11%|█         | 41719/371472 [3:19:29<26:28:26,  3.46it/s]
 11%|█         | 41720/371472 [3:19:30<26:01:03,  3.52it/s]
                                                           
{'loss': 4.2684, 'learning_rate': 8.993514189058157e-07, 'epoch': 1.8}

 11%|█         | 41720/371472 [3:19:30<26:01:03,  3.52it/s]
 11%|█         | 41721/371472 [3:19:30<25:00:27,  3.66it/s]
 11%|█         | 41722/371472 [3:19:30<24:52:09,  3.68it/s]
 11%|█         | 41723/371472 [3:19:30<25:30:44,  3.59it/s]
 11%|█         | 41724/371472 [3:19:31<25:46:59,  3.55it/s]
 11%|█         | 41725/371472 [3:19:31<25:45:04,  3.56it/s]
 11%|█         | 41726/371472 [3:19:31<27:40:02,  3.31it/s]
 11%|█         | 41727/371472 [3:19:32<27:27:22,  3.34it/s]
 11%|█         | 41728/371472 [3:19:32<26:17:09,  3.48it/s]
 11%|█         | 41729/371472 [3:19:32<25:28:54,  3.59it/s]
 11%|█         | 41730/371472 [3:19:32<25:25:20,  3.60it/s]
 11%|█         | 41731/371472 [3:19:33<26:55:50,  3.40it/s]
 11%|█         | 41732/371472 [3:19:33<27:01:21,  3.39it/s]
 11%|█         | 41733/371472 [3:19:33<25:52:43,  3.54it/s]
 11%|█         | 41734/371472 [3:19:34<27:48:27,  3.29it/s]
 11%|█         | 41735/371472 [3:19:34<26:45:43,  3.42it/s]
 11%|█         | 41736/371472 [3:19:34<25:46:31,  3.55it/s]
 11%|█         | 41737/371472 [3:19:34<25:20:38,  3.61it/s]
 11%|█         | 41738/371472 [3:19:35<26:33:56,  3.45it/s]
 11%|█         | 41739/371472 [3:19:35<25:57:11,  3.53it/s]
 11%|█         | 41740/371472 [3:19:35<25:52:32,  3.54it/s]
                                                           
{'loss': 4.3604, 'learning_rate': 8.993029369303367e-07, 'epoch': 1.8}

 11%|█         | 41740/371472 [3:19:35<25:52:32,  3.54it/s]
 11%|█         | 41741/371472 [3:19:35<25:28:06,  3.60it/s]
 11%|█         | 41742/371472 [3:19:36<25:32:48,  3.59it/s]
 11%|█         | 41743/371472 [3:19:36<25:52:11,  3.54it/s]
 11%|█         | 41744/371472 [3:19:36<25:34:05,  3.58it/s]
 11%|█         | 41745/371472 [3:19:37<25:27:37,  3.60it/s]
 11%|█         | 41746/371472 [3:19:37<28:13:16,  3.25it/s]
 11%|█         | 41747/371472 [3:19:37<27:28:21,  3.33it/s]
 11%|█         | 41748/371472 [3:19:38<26:33:15,  3.45it/s]
 11%|█         | 41749/371472 [3:19:38<26:35:41,  3.44it/s]
 11%|█         | 41750/371472 [3:19:38<27:01:58,  3.39it/s]
 11%|█         | 41751/371472 [3:19:38<26:41:28,  3.43it/s]
 11%|█         | 41752/371472 [3:19:39<26:40:14,  3.43it/s]
 11%|█         | 41753/371472 [3:19:39<25:43:48,  3.56it/s]
 11%|█         | 41754/371472 [3:19:39<25:24:05,  3.61it/s]
 11%|█         | 41755/371472 [3:19:39<24:11:20,  3.79it/s]
 11%|█         | 41756/371472 [3:19:40<24:42:08,  3.71it/s]
 11%|█         | 41757/371472 [3:19:40<24:16:59,  3.77it/s]
 11%|█         | 41758/371472 [3:19:40<24:04:24,  3.80it/s]
 11%|█         | 41759/371472 [3:19:41<23:36:56,  3.88it/s]
 11%|█         | 41760/371472 [3:19:41<24:31:38,  3.73it/s]
                                                           
{'loss': 4.2129, 'learning_rate': 8.992544549548578e-07, 'epoch': 1.8}

 11%|█         | 41760/371472 [3:19:41<24:31:38,  3.73it/s]
 11%|█         | 41761/371472 [3:19:41<26:35:12,  3.44it/s]
 11%|█         | 41762/371472 [3:19:41<26:17:48,  3.48it/s]
 11%|█         | 41763/371472 [3:19:42<25:51:37,  3.54it/s]
 11%|█         | 41764/371472 [3:19:42<26:22:16,  3.47it/s]
 11%|█         | 41765/371472 [3:19:42<26:02:09,  3.52it/s]
 11%|█         | 41766/371472 [3:19:43<26:15:45,  3.49it/s]
 11%|█         | 41767/371472 [3:19:43<28:47:23,  3.18it/s]
 11%|█         | 41768/371472 [3:19:43<27:23:14,  3.34it/s]
 11%|█         | 41769/371472 [3:19:43<26:12:30,  3.49it/s]
 11%|█         | 41770/371472 [3:19:44<24:58:29,  3.67it/s]
 11%|█         | 41771/371472 [3:19:44<26:29:49,  3.46it/s]
 11%|█         | 41772/371472 [3:19:44<27:29:07,  3.33it/s]
 11%|█         | 41773/371472 [3:19:45<26:26:08,  3.46it/s]
 11%|█         | 41774/371472 [3:19:45<26:50:58,  3.41it/s]
 11%|█         | 41775/371472 [3:19:45<26:13:57,  3.49it/s]
 11%|█         | 41776/371472 [3:19:45<25:57:11,  3.53it/s]
 11%|█         | 41777/371472 [3:19:46<25:15:44,  3.63it/s]
 11%|█         | 41778/371472 [3:19:46<25:56:03,  3.53it/s]
 11%|█         | 41779/371472 [3:19:46<25:21:30,  3.61it/s]
 11%|█         | 41780/371472 [3:19:47<24:55:58,  3.67it/s]
                                                           
{'loss': 4.381, 'learning_rate': 8.99205972979379e-07, 'epoch': 1.8}

 11%|█         | 41780/371472 [3:19:47<24:55:58,  3.67it/s]
 11%|█         | 41781/371472 [3:19:47<24:38:03,  3.72it/s]
 11%|█         | 41782/371472 [3:19:47<24:40:08,  3.71it/s]
 11%|█         | 41783/371472 [3:19:47<27:04:32,  3.38it/s]
 11%|█         | 41784/371472 [3:19:48<26:09:32,  3.50it/s]
 11%|█         | 41785/371472 [3:19:48<25:22:50,  3.61it/s]
 11%|█         | 41786/371472 [3:19:48<26:05:51,  3.51it/s]
 11%|█         | 41787/371472 [3:19:49<27:20:51,  3.35it/s]
 11%|█         | 41788/371472 [3:19:49<25:49:58,  3.55it/s]
 11%|█         | 41789/371472 [3:19:49<26:12:47,  3.49it/s]
 11%|█         | 41790/371472 [3:19:49<26:34:49,  3.45it/s]
 11%|█▏        | 41791/371472 [3:19:50<25:40:59,  3.57it/s]
 11%|█▏        | 41792/371472 [3:19:50<25:30:30,  3.59it/s]
 11%|█▏        | 41793/371472 [3:19:50<25:40:19,  3.57it/s]
 11%|█▏        | 41794/371472 [3:19:51<26:55:35,  3.40it/s]
 11%|█▏        | 41795/371472 [3:19:51<29:57:04,  3.06it/s]
 11%|█▏        | 41796/371472 [3:19:51<28:53:48,  3.17it/s]
 11%|█▏        | 41797/371472 [3:19:52<27:36:06,  3.32it/s]
 11%|█▏        | 41798/371472 [3:19:52<26:57:37,  3.40it/s]
 11%|█▏        | 41799/371472 [3:19:52<26:07:08,  3.51it/s]
 11%|█▏        | 41800/371472 [3:19:52<25:26:38,  3.60it/s]
                                                           
{'loss': 4.2786, 'learning_rate': 8.991574910039e-07, 'epoch': 1.8}

 11%|█▏        | 41800/371472 [3:19:52<25:26:38,  3.60it/s]
 11%|█▏        | 41801/371472 [3:19:53<24:58:07,  3.67it/s]
 11%|█▏        | 41802/371472 [3:19:53<25:59:42,  3.52it/s]
 11%|█▏        | 41803/371472 [3:19:53<25:30:42,  3.59it/s]
 11%|█▏        | 41804/371472 [3:19:53<24:51:12,  3.68it/s]
 11%|█▏        | 41805/371472 [3:19:54<25:06:52,  3.65it/s]
 11%|█▏        | 41806/371472 [3:19:54<24:52:22,  3.68it/s]
 11%|█▏        | 41807/371472 [3:19:54<24:54:58,  3.68it/s]
 11%|█▏        | 41808/371472 [3:19:54<23:55:51,  3.83it/s]
 11%|█▏        | 41809/371472 [3:19:55<25:22:23,  3.61it/s]
 11%|█▏        | 41810/371472 [3:19:55<26:41:45,  3.43it/s]
 11%|█▏        | 41811/371472 [3:19:55<25:52:32,  3.54it/s]
 11%|█▏        | 41812/371472 [3:19:56<25:58:02,  3.53it/s]
 11%|█▏        | 41813/371472 [3:19:56<25:01:25,  3.66it/s]
 11%|█▏        | 41814/371472 [3:19:56<24:47:49,  3.69it/s]
 11%|█▏        | 41815/371472 [3:19:56<25:14:27,  3.63it/s]
 11%|█▏        | 41816/371472 [3:19:57<27:39:01,  3.31it/s]
 11%|█▏        | 41817/371472 [3:19:57<26:34:02,  3.45it/s]
 11%|█▏        | 41818/371472 [3:19:58<30:53:05,  2.96it/s]
 11%|█▏        | 41819/371472 [3:19:58<28:18:15,  3.24it/s]
 11%|█▏        | 41820/371472 [3:19:58<26:44:17,  3.42it/s]
                                                           
{'loss': 4.4976, 'learning_rate': 8.991090090284212e-07, 'epoch': 1.8}

 11%|█▏        | 41820/371472 [3:19:58<26:44:17,  3.42it/s]
 11%|█▏        | 41821/371472 [3:19:58<26:57:09,  3.40it/s]
 11%|█▏        | 41822/371472 [3:19:59<27:20:45,  3.35it/s]
 11%|█▏        | 41823/371472 [3:19:59<26:10:31,  3.50it/s]
 11%|█▏        | 41824/371472 [3:19:59<26:17:10,  3.48it/s]
 11%|█▏        | 41825/371472 [3:19:59<25:43:06,  3.56it/s]
 11%|█▏        | 41826/371472 [3:20:00<25:26:37,  3.60it/s]
 11%|█▏        | 41827/371472 [3:20:00<25:08:11,  3.64it/s]
 11%|█▏        | 41828/371472 [3:20:00<25:33:19,  3.58it/s]
 11%|█▏        | 41829/371472 [3:20:01<25:35:55,  3.58it/s]
 11%|█▏        | 41830/371472 [3:20:01<24:46:14,  3.70it/s]
 11%|█▏        | 41831/371472 [3:20:01<25:10:19,  3.64it/s]
 11%|█▏        | 41832/371472 [3:20:01<25:30:57,  3.59it/s]
 11%|█▏        | 41833/371472 [3:20:02<25:50:19,  3.54it/s]
 11%|█▏        | 41834/371472 [3:20:02<25:03:47,  3.65it/s]
 11%|█▏        | 41835/371472 [3:20:02<25:13:03,  3.63it/s]
 11%|█▏        | 41836/371472 [3:20:03<26:10:59,  3.50it/s]
 11%|█▏        | 41837/371472 [3:20:03<26:06:00,  3.51it/s]
 11%|█▏        | 41838/371472 [3:20:03<25:23:02,  3.61it/s]
 11%|█▏        | 41839/371472 [3:20:03<26:26:44,  3.46it/s]
 11%|█▏        | 41840/371472 [3:20:04<25:55:03,  3.53it/s]
                                                           
{'loss': 4.2708, 'learning_rate': 8.990605270529423e-07, 'epoch': 1.8}

 11%|█▏        | 41840/371472 [3:20:04<25:55:03,  3.53it/s]
 11%|█▏        | 41841/371472 [3:20:04<26:06:29,  3.51it/s]
 11%|█▏        | 41842/371472 [3:20:04<25:50:37,  3.54it/s]
 11%|█▏        | 41843/371472 [3:20:04<25:44:10,  3.56it/s]
 11%|█▏        | 41844/371472 [3:20:05<27:00:56,  3.39it/s]
 11%|█▏        | 41845/371472 [3:20:05<25:52:16,  3.54it/s]
 11%|█▏        | 41846/371472 [3:20:05<25:24:23,  3.60it/s]
 11%|█▏        | 41847/371472 [3:20:06<24:44:46,  3.70it/s]
 11%|█▏        | 41848/371472 [3:20:06<24:40:54,  3.71it/s]
 11%|█▏        | 41849/371472 [3:20:06<25:00:45,  3.66it/s]
 11%|█▏        | 41850/371472 [3:20:06<24:21:52,  3.76it/s]
 11%|█▏        | 41851/371472 [3:20:07<23:50:40,  3.84it/s]
 11%|█▏        | 41852/371472 [3:20:07<26:04:58,  3.51it/s]
 11%|█▏        | 41853/371472 [3:20:07<26:07:03,  3.51it/s]
 11%|█▏        | 41854/371472 [3:20:08<26:40:06,  3.43it/s]
 11%|█▏        | 41855/371472 [3:20:08<27:00:26,  3.39it/s]
 11%|█▏        | 41856/371472 [3:20:08<25:57:31,  3.53it/s]
 11%|█▏        | 41857/371472 [3:20:08<27:01:28,  3.39it/s]
 11%|█▏        | 41858/371472 [3:20:09<28:41:34,  3.19it/s]
 11%|█▏        | 41859/371472 [3:20:09<27:22:11,  3.35it/s]
 11%|█▏        | 41860/371472 [3:20:09<28:12:08,  3.25it/s]
                                                           
{'loss': 4.271, 'learning_rate': 8.990120450774634e-07, 'epoch': 1.8}

 11%|█▏        | 41860/371472 [3:20:09<28:12:08,  3.25it/s]
 11%|█▏        | 41861/371472 [3:20:10<27:48:27,  3.29it/s]
 11%|█▏        | 41862/371472 [3:20:10<27:25:36,  3.34it/s]
 11%|█▏        | 41863/371472 [3:20:10<26:49:15,  3.41it/s]
 11%|█▏        | 41864/371472 [3:20:11<25:40:57,  3.56it/s]
 11%|█▏        | 41865/371472 [3:20:11<24:45:24,  3.70it/s]
 11%|█▏        | 41866/371472 [3:20:11<24:29:04,  3.74it/s]
 11%|█▏        | 41867/371472 [3:20:11<24:34:25,  3.73it/s]
 11%|█▏        | 41868/371472 [3:20:12<24:02:49,  3.81it/s]
 11%|█▏        | 41869/371472 [3:20:12<23:57:02,  3.82it/s]
 11%|█▏        | 41870/371472 [3:20:12<23:57:31,  3.82it/s]
 11%|█▏        | 41871/371472 [3:20:12<23:36:57,  3.88it/s]
 11%|█▏        | 41872/371472 [3:20:13<24:14:52,  3.78it/s]
 11%|█▏        | 41873/371472 [3:20:13<24:48:21,  3.69it/s]
 11%|█▏        | 41874/371472 [3:20:13<25:25:28,  3.60it/s]
 11%|█▏        | 41875/371472 [3:20:13<24:48:04,  3.69it/s]
 11%|█▏        | 41876/371472 [3:20:14<24:40:58,  3.71it/s]
 11%|█▏        | 41877/371472 [3:20:14<23:57:07,  3.82it/s]
 11%|█▏        | 41878/371472 [3:20:14<25:16:05,  3.62it/s]
 11%|█▏        | 41879/371472 [3:20:15<26:10:30,  3.50it/s]
 11%|█▏        | 41880/371472 [3:20:15<25:47:59,  3.55it/s]
                                                           
{'loss': 4.5042, 'learning_rate': 8.989635631019844e-07, 'epoch': 1.8}

 11%|█▏        | 41880/371472 [3:20:15<25:47:59,  3.55it/s]
 11%|█▏        | 41881/371472 [3:20:15<25:16:50,  3.62it/s]
 11%|█▏        | 41882/371472 [3:20:15<27:08:49,  3.37it/s]
 11%|█▏        | 41883/371472 [3:20:16<27:12:38,  3.36it/s]
 11%|█▏        | 41884/371472 [3:20:16<26:27:21,  3.46it/s]
 11%|█▏        | 41885/371472 [3:20:16<26:24:32,  3.47it/s]
 11%|█▏        | 41886/371472 [3:20:17<25:14:16,  3.63it/s]
 11%|█▏        | 41887/371472 [3:20:17<24:41:09,  3.71it/s]
 11%|█▏        | 41888/371472 [3:20:17<25:05:31,  3.65it/s]
 11%|█▏        | 41889/371472 [3:20:17<24:51:27,  3.68it/s]
 11%|█▏        | 41890/371472 [3:20:18<26:36:10,  3.44it/s]
 11%|█▏        | 41891/371472 [3:20:18<26:17:58,  3.48it/s]
 11%|█▏        | 41892/371472 [3:20:18<27:19:58,  3.35it/s]
 11%|█▏        | 41893/371472 [3:20:19<26:57:00,  3.40it/s]
 11%|█▏        | 41894/371472 [3:20:19<25:49:43,  3.54it/s]
 11%|█▏        | 41895/371472 [3:20:19<25:12:27,  3.63it/s]
 11%|█▏        | 41896/371472 [3:20:19<26:19:47,  3.48it/s]
 11%|█▏        | 41897/371472 [3:20:20<25:44:24,  3.56it/s]
 11%|█▏        | 41898/371472 [3:20:20<26:04:10,  3.51it/s]
 11%|█▏        | 41899/371472 [3:20:20<25:17:58,  3.62it/s]
 11%|█▏        | 41900/371472 [3:20:20<24:15:01,  3.78it/s]
                                                           
{'loss': 4.677, 'learning_rate': 8.989150811265056e-07, 'epoch': 1.8}

 11%|█▏        | 41900/371472 [3:20:20<24:15:01,  3.78it/s]
 11%|█▏        | 41901/371472 [3:20:21<24:13:59,  3.78it/s]
 11%|█▏        | 41902/371472 [3:20:21<24:00:40,  3.81it/s]
 11%|█▏        | 41903/371472 [3:20:21<25:35:44,  3.58it/s]
 11%|█▏        | 41904/371472 [3:20:22<25:27:55,  3.59it/s]
 11%|█▏        | 41905/371472 [3:20:22<25:20:56,  3.61it/s]
 11%|█▏        | 41906/371472 [3:20:22<24:53:11,  3.68it/s]
 11%|█▏        | 41907/371472 [3:20:22<24:30:03,  3.74it/s]
 11%|█▏        | 41908/371472 [3:20:23<26:13:19,  3.49it/s]
 11%|█▏        | 41909/371472 [3:20:23<25:10:05,  3.64it/s]
 11%|█▏        | 41910/371472 [3:20:23<26:37:53,  3.44it/s]
 11%|█▏        | 41911/371472 [3:20:24<26:32:06,  3.45it/s]
 11%|█▏        | 41912/371472 [3:20:24<26:02:08,  3.52it/s]
 11%|█▏        | 41913/371472 [3:20:24<25:22:20,  3.61it/s]
 11%|█▏        | 41914/371472 [3:20:24<25:02:33,  3.66it/s]
 11%|█▏        | 41915/371472 [3:20:25<25:29:14,  3.59it/s]
 11%|█▏        | 41916/371472 [3:20:25<26:39:49,  3.43it/s]
 11%|█▏        | 41917/371472 [3:20:25<25:47:32,  3.55it/s]
 11%|█▏        | 41918/371472 [3:20:26<25:57:57,  3.53it/s]
 11%|█▏        | 41919/371472 [3:20:26<27:16:07,  3.36it/s]
 11%|█▏        | 41920/371472 [3:20:26<27:30:16,  3.33it/s]
                                                           
{'loss': 4.2695, 'learning_rate': 8.988665991510267e-07, 'epoch': 1.81}

 11%|█▏        | 41920/371472 [3:20:26<27:30:16,  3.33it/s]
 11%|█▏        | 41921/371472 [3:20:26<25:47:15,  3.55it/s]
 11%|█▏        | 41922/371472 [3:20:27<25:05:42,  3.65it/s]
 11%|█▏        | 41923/371472 [3:20:27<24:30:26,  3.74it/s]
 11%|█▏        | 41924/371472 [3:20:27<24:03:45,  3.80it/s]
 11%|█▏        | 41925/371472 [3:20:27<24:04:09,  3.80it/s]
 11%|█▏        | 41926/371472 [3:20:28<24:23:35,  3.75it/s]
 11%|█▏        | 41927/371472 [3:20:28<24:26:19,  3.75it/s]
 11%|█▏        | 41928/371472 [3:20:28<26:14:07,  3.49it/s]
 11%|█▏        | 41929/371472 [3:20:29<26:57:12,  3.40it/s]
 11%|█▏        | 41930/371472 [3:20:29<27:10:28,  3.37it/s]
 11%|█▏        | 41931/371472 [3:20:29<25:41:58,  3.56it/s]
 11%|█▏        | 41932/371472 [3:20:29<26:14:37,  3.49it/s]
 11%|█▏        | 41933/371472 [3:20:30<25:48:12,  3.55it/s]
 11%|█▏        | 41934/371472 [3:20:30<26:23:05,  3.47it/s]
 11%|█▏        | 41935/371472 [3:20:30<27:38:12,  3.31it/s]
 11%|█▏        | 41936/371472 [3:20:31<26:26:56,  3.46it/s]
 11%|█▏        | 41937/371472 [3:20:31<25:50:54,  3.54it/s]
 11%|█▏        | 41938/371472 [3:20:31<26:15:29,  3.49it/s]
 11%|█▏        | 41939/371472 [3:20:31<26:14:22,  3.49it/s]
 11%|█▏        | 41940/371472 [3:20:32<26:23:15,  3.47it/s]
                                                           
{'loss': 4.3243, 'learning_rate': 8.988181171755477e-07, 'epoch': 1.81}

 11%|█▏        | 41940/371472 [3:20:32<26:23:15,  3.47it/s]
 11%|█▏        | 41941/371472 [3:20:32<29:17:31,  3.12it/s]
 11%|█▏        | 41942/371472 [3:20:32<27:47:30,  3.29it/s]
 11%|█▏        | 41943/371472 [3:20:33<27:34:53,  3.32it/s]
 11%|█▏        | 41944/371472 [3:20:33<28:16:25,  3.24it/s]
 11%|█▏        | 41945/371472 [3:20:33<27:19:06,  3.35it/s]
 11%|█▏        | 41946/371472 [3:20:34<26:17:00,  3.48it/s]
 11%|█▏        | 41947/371472 [3:20:34<26:41:22,  3.43it/s]
 11%|█▏        | 41948/371472 [3:20:34<26:57:08,  3.40it/s]
 11%|█▏        | 41949/371472 [3:20:35<29:12:15,  3.13it/s]
 11%|█▏        | 41950/371472 [3:20:35<28:39:45,  3.19it/s]
 11%|█▏        | 41951/371472 [3:20:35<28:06:51,  3.26it/s]
 11%|█▏        | 41952/371472 [3:20:35<28:23:21,  3.22it/s]
 11%|█▏        | 41953/371472 [3:20:36<27:18:38,  3.35it/s]
 11%|█▏        | 41954/371472 [3:20:36<28:26:08,  3.22it/s]
 11%|█▏        | 41955/371472 [3:20:36<28:12:01,  3.25it/s]
 11%|█▏        | 41956/371472 [3:20:37<27:04:26,  3.38it/s]
 11%|█▏        | 41957/371472 [3:20:37<25:55:48,  3.53it/s]
 11%|█▏        | 41958/371472 [3:20:37<25:19:47,  3.61it/s]
 11%|█▏        | 41959/371472 [3:20:37<24:59:04,  3.66it/s]
 11%|█▏        | 41960/371472 [3:20:38<27:56:10,  3.28it/s]
                                                           
{'loss': 4.3315, 'learning_rate': 8.987696352000689e-07, 'epoch': 1.81}

 11%|█▏        | 41960/371472 [3:20:38<27:56:10,  3.28it/s]
 11%|█▏        | 41961/371472 [3:20:38<26:42:23,  3.43it/s]
 11%|█▏        | 41962/371472 [3:20:38<26:24:43,  3.47it/s]
 11%|█▏        | 41963/371472 [3:20:39<26:24:49,  3.47it/s]
 11%|█▏        | 41964/371472 [3:20:39<25:36:17,  3.57it/s]
 11%|█▏        | 41965/371472 [3:20:39<24:38:17,  3.71it/s]
 11%|█▏        | 41966/371472 [3:20:39<24:27:37,  3.74it/s]
 11%|█▏        | 41967/371472 [3:20:40<24:24:06,  3.75it/s]
 11%|█▏        | 41968/371472 [3:20:40<25:28:28,  3.59it/s]
 11%|█▏        | 41969/371472 [3:20:40<25:18:23,  3.62it/s]
 11%|█▏        | 41970/371472 [3:20:40<24:34:24,  3.72it/s]
 11%|█▏        | 41971/371472 [3:20:41<26:14:45,  3.49it/s]
 11%|█▏        | 41972/371472 [3:20:41<26:21:08,  3.47it/s]
 11%|█▏        | 41973/371472 [3:20:41<25:43:31,  3.56it/s]
 11%|█▏        | 41974/371472 [3:20:42<25:55:52,  3.53it/s]
 11%|█▏        | 41975/371472 [3:20:42<24:57:30,  3.67it/s]
 11%|█▏        | 41976/371472 [3:20:42<24:34:12,  3.73it/s]
 11%|█▏        | 41977/371472 [3:20:42<25:25:47,  3.60it/s]
 11%|█▏        | 41978/371472 [3:20:43<24:49:19,  3.69it/s]
 11%|█▏        | 41979/371472 [3:20:43<24:45:49,  3.70it/s]
 11%|█▏        | 41980/371472 [3:20:43<24:35:46,  3.72it/s]
                                                           
{'loss': 4.4334, 'learning_rate': 8.987211532245901e-07, 'epoch': 1.81}

 11%|█▏        | 41980/371472 [3:20:43<24:35:46,  3.72it/s]
 11%|█▏        | 41981/371472 [3:20:43<23:49:48,  3.84it/s]
 11%|█▏        | 41982/371472 [3:20:44<24:05:40,  3.80it/s]
 11%|█▏        | 41983/371472 [3:20:44<23:52:06,  3.83it/s]
 11%|█▏        | 41984/371472 [3:20:44<24:05:32,  3.80it/s]
 11%|█▏        | 41985/371472 [3:20:45<26:08:48,  3.50it/s]
 11%|█▏        | 41986/371472 [3:20:45<26:05:54,  3.51it/s]
 11%|█▏        | 41987/371472 [3:20:45<27:26:35,  3.34it/s]
 11%|█▏        | 41988/371472 [3:20:45<25:53:57,  3.53it/s]
 11%|█▏        | 41989/371472 [3:20:46<27:30:37,  3.33it/s]
 11%|█▏        | 41990/371472 [3:20:46<26:56:04,  3.40it/s]
 11%|█▏        | 41991/371472 [3:20:46<26:47:02,  3.42it/s]
 11%|█▏        | 41992/371472 [3:20:47<29:27:31,  3.11it/s]
 11%|█▏        | 41993/371472 [3:20:47<28:43:08,  3.19it/s]
 11%|█▏        | 41994/371472 [3:20:47<27:43:53,  3.30it/s]
 11%|█▏        | 41995/371472 [3:20:48<25:52:20,  3.54it/s]
 11%|█▏        | 41996/371472 [3:20:48<27:31:23,  3.33it/s]
 11%|█▏        | 41997/371472 [3:20:48<26:36:27,  3.44it/s]
 11%|█▏        | 41998/371472 [3:20:48<26:17:29,  3.48it/s]
 11%|█▏        | 41999/371472 [3:20:49<25:48:49,  3.55it/s]
 11%|█▏        | 42000/371472 [3:20:49<27:15:28,  3.36it/s]
                                                           
{'loss': 4.456, 'learning_rate': 8.986726712491111e-07, 'epoch': 1.81}

 11%|█▏        | 42000/371472 [3:20:49<27:15:28,  3.36it/s]
 11%|█▏        | 42001/371472 [3:20:49<26:03:12,  3.51it/s]
 11%|█▏        | 42002/371472 [3:20:50<25:37:11,  3.57it/s]
 11%|█▏        | 42003/371472 [3:20:50<25:11:48,  3.63it/s]
 11%|█▏        | 42004/371472 [3:20:50<25:42:48,  3.56it/s]
 11%|█▏        | 42005/371472 [3:20:50<26:28:51,  3.46it/s]
 11%|█▏        | 42006/371472 [3:20:51<26:35:14,  3.44it/s]
 11%|█▏        | 42007/371472 [3:20:51<25:39:35,  3.57it/s]
 11%|█▏        | 42008/371472 [3:20:51<25:13:22,  3.63it/s]
 11%|█▏        | 42009/371472 [3:20:52<25:04:27,  3.65it/s]
 11%|█▏        | 42010/371472 [3:20:52<25:12:22,  3.63it/s]
 11%|█▏        | 42011/371472 [3:20:52<25:51:10,  3.54it/s]
 11%|█▏        | 42012/371472 [3:20:52<25:44:37,  3.55it/s]
 11%|█▏        | 42013/371472 [3:20:53<25:37:20,  3.57it/s]
 11%|█▏        | 42014/371472 [3:20:53<25:01:32,  3.66it/s]
 11%|█▏        | 42015/371472 [3:20:53<24:34:09,  3.72it/s]
 11%|█▏        | 42016/371472 [3:20:53<24:49:44,  3.69it/s]
 11%|█▏        | 42017/371472 [3:20:54<24:37:16,  3.72it/s]
 11%|█▏        | 42018/371472 [3:20:54<23:52:21,  3.83it/s]
 11%|█▏        | 42019/371472 [3:20:54<24:10:29,  3.79it/s]
 11%|█▏        | 42020/371472 [3:20:55<26:26:08,  3.46it/s]
                                                           
{'loss': 4.2427, 'learning_rate': 8.986241892736322e-07, 'epoch': 1.81}

 11%|█▏        | 42020/371472 [3:20:55<26:26:08,  3.46it/s]
 11%|█▏        | 42021/371472 [3:20:55<27:07:09,  3.37it/s]
 11%|█▏        | 42022/371472 [3:20:55<29:06:40,  3.14it/s]
 11%|█▏        | 42023/371472 [3:20:56<28:12:33,  3.24it/s]
 11%|█▏        | 42024/371472 [3:20:56<26:33:41,  3.45it/s]
 11%|█▏        | 42025/371472 [3:20:56<26:50:04,  3.41it/s]
 11%|█▏        | 42026/371472 [3:20:56<26:05:03,  3.51it/s]
 11%|█▏        | 42027/371472 [3:20:57<27:10:07,  3.37it/s]
 11%|█▏        | 42028/371472 [3:20:57<25:48:36,  3.55it/s]
 11%|█▏        | 42029/371472 [3:20:57<24:38:42,  3.71it/s]
 11%|█▏        | 42030/371472 [3:20:57<23:56:03,  3.82it/s]
 11%|█▏        | 42031/371472 [3:20:58<23:25:11,  3.91it/s]
 11%|█▏        | 42032/371472 [3:20:58<23:27:09,  3.90it/s]
 11%|█▏        | 42033/371472 [3:20:58<23:38:36,  3.87it/s]
 11%|█▏        | 42034/371472 [3:20:59<24:48:36,  3.69it/s]
 11%|█▏        | 42035/371472 [3:20:59<28:51:04,  3.17it/s]
 11%|█▏        | 42036/371472 [3:20:59<28:13:35,  3.24it/s]
 11%|█▏        | 42037/371472 [3:21:00<27:36:39,  3.31it/s]
 11%|█▏        | 42038/371472 [3:21:00<28:38:40,  3.19it/s]
 11%|█▏        | 42039/371472 [3:21:00<29:19:22,  3.12it/s]
 11%|█▏        | 42040/371472 [3:21:00<28:42:54,  3.19it/s]
                                                           
{'loss': 4.5055, 'learning_rate': 8.985757072981533e-07, 'epoch': 1.81}

 11%|█▏        | 42040/371472 [3:21:00<28:42:54,  3.19it/s]
 11%|█▏        | 42041/371472 [3:21:01<27:51:11,  3.29it/s]
 11%|█▏        | 42042/371472 [3:21:01<27:13:20,  3.36it/s]
 11%|█▏        | 42043/371472 [3:21:01<26:22:09,  3.47it/s]
 11%|█▏        | 42044/371472 [3:21:02<25:13:52,  3.63it/s]
 11%|█▏        | 42045/371472 [3:21:02<24:22:15,  3.75it/s]
 11%|█▏        | 42046/371472 [3:21:02<24:12:11,  3.78it/s]
 11%|█▏        | 42047/371472 [3:21:02<24:01:13,  3.81it/s]
 11%|█▏        | 42048/371472 [3:21:03<23:48:03,  3.84it/s]
 11%|█▏        | 42049/371472 [3:21:03<23:44:41,  3.85it/s]
 11%|█▏        | 42050/371472 [3:21:03<24:28:55,  3.74it/s]
 11%|█▏        | 42051/371472 [3:21:03<25:04:51,  3.65it/s]
 11%|█▏        | 42052/371472 [3:21:04<25:43:29,  3.56it/s]
 11%|█▏        | 42053/371472 [3:21:04<25:31:51,  3.58it/s]
 11%|█▏        | 42054/371472 [3:21:04<24:44:11,  3.70it/s]
 11%|█▏        | 42055/371472 [3:21:05<25:01:50,  3.66it/s]
 11%|█▏        | 42056/371472 [3:21:05<23:59:07,  3.82it/s]
 11%|█▏        | 42057/371472 [3:21:05<24:52:03,  3.68it/s]
 11%|█▏        | 42058/371472 [3:21:05<25:02:19,  3.65it/s]
 11%|█▏        | 42059/371472 [3:21:06<25:25:32,  3.60it/s]
 11%|█▏        | 42060/371472 [3:21:06<25:02:49,  3.65it/s]
                                                           
{'loss': 4.7073, 'learning_rate': 8.985272253226745e-07, 'epoch': 1.81}

 11%|█▏        | 42060/371472 [3:21:06<25:02:49,  3.65it/s]
 11%|█▏        | 42061/371472 [3:21:06<25:02:28,  3.65it/s]
 11%|█▏        | 42062/371472 [3:21:06<25:08:42,  3.64it/s]
 11%|█▏        | 42063/371472 [3:21:07<26:02:55,  3.51it/s]
 11%|█▏        | 42064/371472 [3:21:07<25:46:04,  3.55it/s]
 11%|█▏        | 42065/371472 [3:21:07<25:27:19,  3.59it/s]
 11%|█▏        | 42066/371472 [3:21:08<26:29:57,  3.45it/s]
 11%|█▏        | 42067/371472 [3:21:08<25:47:56,  3.55it/s]
 11%|█▏        | 42068/371472 [3:21:08<25:55:43,  3.53it/s]
 11%|█▏        | 42069/371472 [3:21:08<26:36:35,  3.44it/s]
 11%|█▏        | 42070/371472 [3:21:09<26:22:10,  3.47it/s]
 11%|█▏        | 42071/371472 [3:21:09<26:21:39,  3.47it/s]
 11%|█▏        | 42072/371472 [3:21:09<26:18:45,  3.48it/s]
 11%|█▏        | 42073/371472 [3:21:10<25:17:06,  3.62it/s]
 11%|█▏        | 42074/371472 [3:21:10<24:48:19,  3.69it/s]
 11%|█▏        | 42075/371472 [3:21:10<25:49:30,  3.54it/s]
 11%|█▏        | 42076/371472 [3:21:10<25:12:36,  3.63it/s]
 11%|█▏        | 42077/371472 [3:21:11<24:18:39,  3.76it/s]
 11%|█▏        | 42078/371472 [3:21:11<26:13:35,  3.49it/s]
 11%|█▏        | 42079/371472 [3:21:11<25:46:05,  3.55it/s]
 11%|█▏        | 42080/371472 [3:21:11<25:02:45,  3.65it/s]
                                                           
{'loss': 4.4209, 'learning_rate': 8.984787433471956e-07, 'epoch': 1.81}

 11%|█▏        | 42080/371472 [3:21:11<25:02:45,  3.65it/s]
 11%|█▏        | 42081/371472 [3:21:12<25:13:59,  3.63it/s]
 11%|█▏        | 42082/371472 [3:21:12<25:26:12,  3.60it/s]
 11%|█▏        | 42083/371472 [3:21:12<24:23:15,  3.75it/s]
 11%|█▏        | 42084/371472 [3:21:13<25:14:09,  3.63it/s]
 11%|█▏        | 42085/371472 [3:21:13<26:21:57,  3.47it/s]
 11%|█▏        | 42086/371472 [3:21:13<25:52:45,  3.54it/s]
 11%|█▏        | 42087/371472 [3:21:13<25:27:44,  3.59it/s]
 11%|█▏        | 42088/371472 [3:21:14<24:43:43,  3.70it/s]
 11%|█▏        | 42089/371472 [3:21:14<25:13:06,  3.63it/s]
 11%|█▏        | 42090/371472 [3:21:14<24:14:26,  3.77it/s]
 11%|█▏        | 42091/371472 [3:21:15<24:24:03,  3.75it/s]
 11%|█▏        | 42092/371472 [3:21:15<25:16:24,  3.62it/s]
 11%|█▏        | 42093/371472 [3:21:15<25:34:28,  3.58it/s]
 11%|█▏        | 42094/371472 [3:21:15<25:52:18,  3.54it/s]
 11%|█▏        | 42095/371472 [3:21:16<25:27:25,  3.59it/s]
 11%|█▏        | 42096/371472 [3:21:16<25:49:45,  3.54it/s]
 11%|█▏        | 42097/371472 [3:21:16<25:01:18,  3.66it/s]
 11%|█▏        | 42098/371472 [3:21:16<24:06:26,  3.80it/s]
 11%|█▏        | 42099/371472 [3:21:17<24:36:58,  3.72it/s]
 11%|█▏        | 42100/371472 [3:21:17<24:05:41,  3.80it/s]
                                                           
{'loss': 4.4284, 'learning_rate': 8.984302613717167e-07, 'epoch': 1.81}

 11%|█▏        | 42100/371472 [3:21:17<24:05:41,  3.80it/s]
 11%|█▏        | 42101/371472 [3:21:17<27:31:50,  3.32it/s]
 11%|█▏        | 42102/371472 [3:21:18<26:49:23,  3.41it/s]
 11%|█▏        | 42103/371472 [3:21:18<26:10:56,  3.49it/s]
 11%|█▏        | 42104/371472 [3:21:18<26:06:33,  3.50it/s]
 11%|█▏        | 42105/371472 [3:21:18<24:57:16,  3.67it/s]
 11%|█▏        | 42106/371472 [3:21:19<27:54:07,  3.28it/s]
 11%|█▏        | 42107/371472 [3:21:19<26:51:43,  3.41it/s]
 11%|█▏        | 42108/371472 [3:21:19<27:06:59,  3.37it/s]
 11%|█▏        | 42109/371472 [3:21:20<26:48:04,  3.41it/s]
 11%|█▏        | 42110/371472 [3:21:20<25:34:48,  3.58it/s]
 11%|█▏        | 42111/371472 [3:21:20<24:57:52,  3.66it/s]
 11%|█▏        | 42112/371472 [3:21:20<24:41:50,  3.70it/s]
 11%|█▏        | 42113/371472 [3:21:21<25:37:50,  3.57it/s]
 11%|█▏        | 42114/371472 [3:21:21<25:45:42,  3.55it/s]
 11%|█▏        | 42115/371472 [3:21:21<26:04:17,  3.51it/s]
 11%|█▏        | 42116/371472 [3:21:22<25:21:43,  3.61it/s]
 11%|█▏        | 42117/371472 [3:21:22<25:18:33,  3.61it/s]
 11%|█▏        | 42118/371472 [3:21:22<24:39:38,  3.71it/s]
 11%|█▏        | 42119/371472 [3:21:22<25:18:47,  3.61it/s]
 11%|█▏        | 42120/371472 [3:21:23<25:55:44,  3.53it/s]
                                                           
{'loss': 4.2628, 'learning_rate': 8.983817793962378e-07, 'epoch': 1.81}

 11%|█▏        | 42120/371472 [3:21:23<25:55:44,  3.53it/s]
 11%|█▏        | 42121/371472 [3:21:23<27:30:03,  3.33it/s]
 11%|█▏        | 42122/371472 [3:21:23<26:27:43,  3.46it/s]
 11%|█▏        | 42123/371472 [3:21:24<26:07:21,  3.50it/s]
 11%|█▏        | 42124/371472 [3:21:24<25:42:37,  3.56it/s]
 11%|█▏        | 42125/371472 [3:21:24<26:10:39,  3.49it/s]
 11%|█▏        | 42126/371472 [3:21:24<25:31:15,  3.58it/s]
 11%|█▏        | 42127/371472 [3:21:25<26:15:40,  3.48it/s]
 11%|█▏        | 42128/371472 [3:21:25<27:37:56,  3.31it/s]
 11%|█▏        | 42129/371472 [3:21:25<26:16:59,  3.48it/s]
 11%|█▏        | 42130/371472 [3:21:26<26:08:48,  3.50it/s]
 11%|█▏        | 42131/371472 [3:21:26<26:34:21,  3.44it/s]
 11%|█▏        | 42132/371472 [3:21:26<25:52:58,  3.53it/s]
 11%|█▏        | 42133/371472 [3:21:26<25:31:00,  3.59it/s]
 11%|█▏        | 42134/371472 [3:21:27<26:45:19,  3.42it/s]
 11%|█▏        | 42135/371472 [3:21:27<26:39:47,  3.43it/s]
 11%|█▏        | 42136/371472 [3:21:27<25:27:26,  3.59it/s]
 11%|█▏        | 42137/371472 [3:21:28<26:43:57,  3.42it/s]
 11%|█▏        | 42138/371472 [3:21:28<25:27:09,  3.59it/s]
 11%|█▏        | 42139/371472 [3:21:28<25:08:23,  3.64it/s]
 11%|█▏        | 42140/371472 [3:21:28<25:05:14,  3.65it/s]
                                                           
{'loss': 4.3875, 'learning_rate': 8.983332974207589e-07, 'epoch': 1.82}

 11%|█▏        | 42140/371472 [3:21:28<25:05:14,  3.65it/s]
 11%|█▏        | 42141/371472 [3:21:29<26:29:00,  3.45it/s]
 11%|█▏        | 42142/371472 [3:21:29<25:49:44,  3.54it/s]
 11%|█▏        | 42143/371472 [3:21:29<25:31:36,  3.58it/s]
 11%|█▏        | 42144/371472 [3:21:30<29:56:19,  3.06it/s]
 11%|█▏        | 42145/371472 [3:21:30<29:27:10,  3.11it/s]
 11%|█▏        | 42146/371472 [3:21:30<29:23:29,  3.11it/s]
 11%|█▏        | 42147/371472 [3:21:31<27:59:27,  3.27it/s]
 11%|█▏        | 42148/371472 [3:21:31<27:05:08,  3.38it/s]
 11%|█▏        | 42149/371472 [3:21:31<25:37:34,  3.57it/s]
 11%|█▏        | 42150/371472 [3:21:31<25:18:23,  3.61it/s]
 11%|█▏        | 42151/371472 [3:21:32<24:37:31,  3.71it/s]
 11%|█▏        | 42152/371472 [3:21:32<25:30:11,  3.59it/s]
 11%|█▏        | 42153/371472 [3:21:32<25:01:08,  3.66it/s]
 11%|█▏        | 42154/371472 [3:21:32<25:52:08,  3.54it/s]
 11%|█▏        | 42155/371472 [3:21:33<26:00:09,  3.52it/s]
 11%|█▏        | 42156/371472 [3:21:33<26:19:57,  3.47it/s]
 11%|█▏        | 42157/371472 [3:21:33<25:18:34,  3.61it/s]
 11%|█▏        | 42158/371472 [3:21:34<24:46:51,  3.69it/s]
 11%|█▏        | 42159/371472 [3:21:34<24:39:48,  3.71it/s]
 11%|█▏        | 42160/371472 [3:21:34<24:55:58,  3.67it/s]
                                                           
{'loss': 4.2567, 'learning_rate': 8.982848154452799e-07, 'epoch': 1.82}

 11%|█▏        | 42160/371472 [3:21:34<24:55:58,  3.67it/s]
 11%|█▏        | 42161/371472 [3:21:34<24:42:19,  3.70it/s]
 11%|█▏        | 42162/371472 [3:21:35<25:59:44,  3.52it/s]
 11%|█▏        | 42163/371472 [3:21:35<25:54:58,  3.53it/s]
 11%|█▏        | 42164/371472 [3:21:35<26:40:29,  3.43it/s]
 11%|█▏        | 42165/371472 [3:21:36<28:01:08,  3.26it/s]
 11%|█▏        | 42166/371472 [3:21:36<28:22:50,  3.22it/s]
 11%|█▏        | 42167/371472 [3:21:36<27:49:58,  3.29it/s]
 11%|█▏        | 42168/371472 [3:21:36<26:04:23,  3.51it/s]
 11%|█▏        | 42169/371472 [3:21:37<25:31:37,  3.58it/s]
 11%|█▏        | 42170/371472 [3:21:37<28:51:36,  3.17it/s]
 11%|█▏        | 42171/371472 [3:21:37<27:04:03,  3.38it/s]
 11%|█▏        | 42172/371472 [3:21:38<25:51:34,  3.54it/s]
 11%|█▏        | 42173/371472 [3:21:38<25:31:16,  3.58it/s]
 11%|█▏        | 42174/371472 [3:21:38<27:45:17,  3.30it/s]
 11%|█▏        | 42175/371472 [3:21:39<28:51:50,  3.17it/s]
 11%|█▏        | 42176/371472 [3:21:39<27:37:53,  3.31it/s]
 11%|█▏        | 42177/371472 [3:21:39<28:37:29,  3.20it/s]
 11%|█▏        | 42178/371472 [3:21:40<27:28:06,  3.33it/s]
 11%|█▏        | 42179/371472 [3:21:40<27:51:53,  3.28it/s]
 11%|█▏        | 42180/371472 [3:21:40<26:28:16,  3.46it/s]
                                                           
{'loss': 4.2877, 'learning_rate': 8.982363334698011e-07, 'epoch': 1.82}

 11%|█▏        | 42180/371472 [3:21:40<26:28:16,  3.46it/s]
 11%|█▏        | 42181/371472 [3:21:40<26:55:53,  3.40it/s]
 11%|█▏        | 42182/371472 [3:21:41<26:18:15,  3.48it/s]
 11%|█▏        | 42183/371472 [3:21:41<27:12:59,  3.36it/s]
 11%|█▏        | 42184/371472 [3:21:41<26:53:14,  3.40it/s]
 11%|█▏        | 42185/371472 [3:21:42<26:49:07,  3.41it/s]
 11%|█▏        | 42186/371472 [3:21:42<25:21:23,  3.61it/s]
 11%|█▏        | 42187/371472 [3:21:42<25:32:37,  3.58it/s]
 11%|█▏        | 42188/371472 [3:21:42<25:01:46,  3.65it/s]
 11%|█▏        | 42189/371472 [3:21:43<25:09:10,  3.64it/s]
 11%|█▏        | 42190/371472 [3:21:43<24:48:27,  3.69it/s]
 11%|█▏        | 42191/371472 [3:21:43<25:40:23,  3.56it/s]
 11%|█▏        | 42192/371472 [3:21:43<25:13:46,  3.63it/s]
 11%|█▏        | 42193/371472 [3:21:44<26:50:28,  3.41it/s]
 11%|█▏        | 42194/371472 [3:21:44<25:38:34,  3.57it/s]
 11%|█▏        | 42195/371472 [3:21:44<24:50:34,  3.68it/s]
 11%|█▏        | 42196/371472 [3:21:45<24:51:19,  3.68it/s]
 11%|█▏        | 42197/371472 [3:21:45<25:20:07,  3.61it/s]
 11%|█▏        | 42198/371472 [3:21:45<24:21:53,  3.75it/s]
 11%|█▏        | 42199/371472 [3:21:45<25:14:18,  3.62it/s]
 11%|█▏        | 42200/371472 [3:21:46<27:12:49,  3.36it/s]
                                                           
{'loss': 4.4149, 'learning_rate': 8.981878514943222e-07, 'epoch': 1.82}

 11%|█▏        | 42200/371472 [3:21:46<27:12:49,  3.36it/s]
 11%|█▏        | 42201/371472 [3:21:46<26:52:06,  3.40it/s]
 11%|█▏        | 42202/371472 [3:21:46<26:15:56,  3.48it/s]
 11%|█▏        | 42203/371472 [3:21:47<25:45:56,  3.55it/s]
 11%|█▏        | 42204/371472 [3:21:47<26:37:33,  3.44it/s]
 11%|█▏        | 42205/371472 [3:21:47<25:55:10,  3.53it/s]
 11%|█▏        | 42206/371472 [3:21:47<25:48:12,  3.54it/s]
 11%|█▏        | 42207/371472 [3:21:48<25:58:42,  3.52it/s]
 11%|█▏        | 42208/371472 [3:21:48<25:37:03,  3.57it/s]
 11%|█▏        | 42209/371472 [3:21:48<25:58:16,  3.52it/s]
 11%|█▏        | 42210/371472 [3:21:49<25:58:33,  3.52it/s]
 11%|█▏        | 42211/371472 [3:21:49<27:50:16,  3.29it/s]
 11%|█▏        | 42212/371472 [3:21:49<27:41:05,  3.30it/s]
 11%|█▏        | 42213/371472 [3:21:49<26:43:58,  3.42it/s]
 11%|█▏        | 42214/371472 [3:21:50<26:02:42,  3.51it/s]
 11%|█▏        | 42215/371472 [3:21:50<26:13:04,  3.49it/s]
 11%|█▏        | 42216/371472 [3:21:50<26:52:27,  3.40it/s]
 11%|█▏        | 42217/371472 [3:21:51<26:36:16,  3.44it/s]
 11%|█▏        | 42218/371472 [3:21:51<28:44:47,  3.18it/s]
 11%|█▏        | 42219/371472 [3:21:51<27:16:20,  3.35it/s]
 11%|█▏        | 42220/371472 [3:21:52<29:01:08,  3.15it/s]
                                                           
{'loss': 4.2483, 'learning_rate': 8.981393695188433e-07, 'epoch': 1.82}

 11%|█▏        | 42220/371472 [3:21:52<29:01:08,  3.15it/s]
 11%|█▏        | 42221/371472 [3:21:52<29:20:32,  3.12it/s]
 11%|█▏        | 42222/371472 [3:21:52<28:24:36,  3.22it/s]
 11%|█▏        | 42223/371472 [3:21:53<31:16:21,  2.92it/s]
 11%|█▏        | 42224/371472 [3:21:53<29:49:28,  3.07it/s]
 11%|█▏        | 42225/371472 [3:21:53<28:18:10,  3.23it/s]
 11%|█▏        | 42226/371472 [3:21:54<30:56:48,  2.96it/s]
 11%|█▏        | 42227/371472 [3:21:54<30:30:22,  3.00it/s]
 11%|█▏        | 42228/371472 [3:21:54<28:20:09,  3.23it/s]
 11%|█▏        | 42229/371472 [3:21:54<26:48:14,  3.41it/s]
 11%|█▏        | 42230/371472 [3:21:55<25:52:35,  3.53it/s]
 11%|█▏        | 42231/371472 [3:21:55<25:14:23,  3.62it/s]
 11%|█▏        | 42232/371472 [3:21:55<24:12:03,  3.78it/s]
 11%|█▏        | 42233/371472 [3:21:56<25:29:07,  3.59it/s]
 11%|█▏        | 42234/371472 [3:21:56<29:12:21,  3.13it/s]
 11%|█▏        | 42235/371472 [3:21:56<29:37:29,  3.09it/s]
 11%|█▏        | 42236/371472 [3:21:57<29:56:08,  3.06it/s]
 11%|█▏        | 42237/371472 [3:21:57<28:12:35,  3.24it/s]
 11%|█▏        | 42238/371472 [3:21:57<28:25:12,  3.22it/s]
 11%|█▏        | 42239/371472 [3:21:57<28:06:59,  3.25it/s]
 11%|█▏        | 42240/371472 [3:21:58<27:28:20,  3.33it/s]
                                                           
{'loss': 4.5543, 'learning_rate': 8.980908875433644e-07, 'epoch': 1.82}

 11%|█▏        | 42240/371472 [3:21:58<27:28:20,  3.33it/s]
 11%|█▏        | 42241/371472 [3:21:58<26:26:11,  3.46it/s]
 11%|█▏        | 42242/371472 [3:21:58<27:10:43,  3.36it/s]
 11%|█▏        | 42243/371472 [3:21:59<26:14:06,  3.49it/s]
 11%|█▏        | 42244/371472 [3:21:59<26:02:34,  3.51it/s]
 11%|█▏        | 42245/371472 [3:21:59<26:09:02,  3.50it/s]
 11%|█▏        | 42246/371472 [3:21:59<26:21:53,  3.47it/s]
 11%|█▏        | 42247/371472 [3:22:00<25:45:14,  3.55it/s]
 11%|█▏        | 42248/371472 [3:22:00<25:40:53,  3.56it/s]
 11%|█▏        | 42249/371472 [3:22:00<26:59:20,  3.39it/s]
 11%|█▏        | 42250/371472 [3:22:01<27:09:04,  3.37it/s]
 11%|█▏        | 42251/371472 [3:22:01<26:17:23,  3.48it/s]
 11%|█▏        | 42252/371472 [3:22:01<25:17:02,  3.62it/s]
 11%|█▏        | 42253/371472 [3:22:01<24:37:45,  3.71it/s]
 11%|█▏        | 42254/371472 [3:22:02<24:34:47,  3.72it/s]
 11%|█▏        | 42255/371472 [3:22:02<26:20:21,  3.47it/s]
 11%|█▏        | 42256/371472 [3:22:02<25:00:29,  3.66it/s]
 11%|█▏        | 42257/371472 [3:22:03<25:10:45,  3.63it/s]
 11%|█▏        | 42258/371472 [3:22:03<27:35:46,  3.31it/s]
 11%|█▏        | 42259/371472 [3:22:03<26:32:24,  3.45it/s]
 11%|█▏        | 42260/371472 [3:22:03<25:48:39,  3.54it/s]
                                                           
{'loss': 4.5195, 'learning_rate': 8.980424055678855e-07, 'epoch': 1.82}

 11%|█▏        | 42260/371472 [3:22:03<25:48:39,  3.54it/s]
 11%|█▏        | 42261/371472 [3:22:04<26:20:40,  3.47it/s]
 11%|█▏        | 42262/371472 [3:22:04<26:04:37,  3.51it/s]
 11%|█▏        | 42263/371472 [3:22:04<25:14:17,  3.62it/s]
 11%|█▏        | 42264/371472 [3:22:05<25:45:24,  3.55it/s]
 11%|█▏        | 42265/371472 [3:22:05<25:59:36,  3.52it/s]
 11%|█▏        | 42266/371472 [3:22:05<25:34:32,  3.58it/s]
 11%|█▏        | 42267/371472 [3:22:05<25:03:19,  3.65it/s]
 11%|█▏        | 42268/371472 [3:22:06<24:46:31,  3.69it/s]
 11%|█▏        | 42269/371472 [3:22:06<24:40:35,  3.71it/s]
 11%|█▏        | 42270/371472 [3:22:06<25:39:16,  3.56it/s]
 11%|█▏        | 42271/371472 [3:22:06<25:06:13,  3.64it/s]
 11%|█▏        | 42272/371472 [3:22:07<25:53:02,  3.53it/s]
 11%|█▏        | 42273/371472 [3:22:07<25:13:58,  3.62it/s]
 11%|█▏        | 42274/371472 [3:22:07<26:03:48,  3.51it/s]
 11%|█▏        | 42275/371472 [3:22:08<25:05:04,  3.65it/s]
 11%|█▏        | 42276/371472 [3:22:08<24:30:16,  3.73it/s]
 11%|█▏        | 42277/371472 [3:22:08<24:19:14,  3.76it/s]
 11%|█▏        | 42278/371472 [3:22:08<26:07:41,  3.50it/s]
 11%|█▏        | 42279/371472 [3:22:09<26:14:47,  3.48it/s]
 11%|█▏        | 42280/371472 [3:22:09<25:19:46,  3.61it/s]
                                                           
{'loss': 4.3553, 'learning_rate': 8.979939235924066e-07, 'epoch': 1.82}

 11%|█▏        | 42280/371472 [3:22:09<25:19:46,  3.61it/s]
 11%|█▏        | 42281/371472 [3:22:09<26:25:03,  3.46it/s]
 11%|█▏        | 42282/371472 [3:22:10<26:44:11,  3.42it/s]
 11%|█▏        | 42283/371472 [3:22:10<27:21:40,  3.34it/s]
 11%|█▏        | 42284/371472 [3:22:10<26:41:07,  3.43it/s]
 11%|█▏        | 42285/371472 [3:22:10<26:08:43,  3.50it/s]
 11%|█▏        | 42286/371472 [3:22:11<25:59:44,  3.52it/s]
 11%|█▏        | 42287/371472 [3:22:11<25:33:22,  3.58it/s]
 11%|█▏        | 42288/371472 [3:22:11<24:51:56,  3.68it/s]
 11%|█▏        | 42289/371472 [3:22:11<23:56:40,  3.82it/s]
 11%|█▏        | 42290/371472 [3:22:12<26:10:48,  3.49it/s]
 11%|█▏        | 42291/371472 [3:22:12<26:28:06,  3.45it/s]
 11%|█▏        | 42292/371472 [3:22:12<25:40:52,  3.56it/s]
 11%|█▏        | 42293/371472 [3:22:13<25:20:16,  3.61it/s]
 11%|█▏        | 42294/371472 [3:22:13<25:45:35,  3.55it/s]
 11%|█▏        | 42295/371472 [3:22:13<25:46:57,  3.55it/s]
 11%|█▏        | 42296/371472 [3:22:14<25:17:06,  3.62it/s]
 11%|█▏        | 42297/371472 [3:22:14<24:55:26,  3.67it/s]
 11%|█▏        | 42298/371472 [3:22:14<25:36:57,  3.57it/s]
 11%|█▏        | 42299/371472 [3:22:14<25:12:00,  3.63it/s]
 11%|█▏        | 42300/371472 [3:22:15<25:36:36,  3.57it/s]
                                                           
{'loss': 4.1781, 'learning_rate': 8.979454416169277e-07, 'epoch': 1.82}

 11%|█▏        | 42300/371472 [3:22:15<25:36:36,  3.57it/s]
 11%|█▏        | 42301/371472 [3:22:15<27:36:54,  3.31it/s]
 11%|█▏        | 42302/371472 [3:22:15<26:26:04,  3.46it/s]
 11%|█▏        | 42303/371472 [3:22:16<26:58:12,  3.39it/s]
 11%|█▏        | 42304/371472 [3:22:16<26:22:19,  3.47it/s]
 11%|█▏        | 42305/371472 [3:22:16<25:37:19,  3.57it/s]
 11%|█▏        | 42306/371472 [3:22:16<25:42:34,  3.56it/s]
 11%|█▏        | 42307/371472 [3:22:17<25:06:29,  3.64it/s]
 11%|█▏        | 42308/371472 [3:22:17<25:06:56,  3.64it/s]
 11%|█▏        | 42309/371472 [3:22:17<24:27:07,  3.74it/s]
 11%|█▏        | 42310/371472 [3:22:17<24:52:36,  3.68it/s]
 11%|█▏        | 42311/371472 [3:22:18<24:34:35,  3.72it/s]
 11%|█▏        | 42312/371472 [3:22:18<24:36:06,  3.72it/s]
 11%|█▏        | 42313/371472 [3:22:18<24:41:03,  3.70it/s]
 11%|█▏        | 42314/371472 [3:22:18<24:35:58,  3.72it/s]
 11%|█▏        | 42315/371472 [3:22:19<24:45:17,  3.69it/s]
 11%|█▏        | 42316/371472 [3:22:19<25:10:22,  3.63it/s]
 11%|█▏        | 42317/371472 [3:22:19<24:25:23,  3.74it/s]
 11%|█▏        | 42318/371472 [3:22:20<24:34:54,  3.72it/s]
 11%|█▏        | 42319/371472 [3:22:20<24:42:41,  3.70it/s]
 11%|█▏        | 42320/371472 [3:22:20<24:05:46,  3.79it/s]
                                                           
{'loss': 4.4369, 'learning_rate': 8.978969596414488e-07, 'epoch': 1.82}

 11%|█▏        | 42320/371472 [3:22:20<24:05:46,  3.79it/s]
 11%|█▏        | 42321/371472 [3:22:20<25:23:38,  3.60it/s]
 11%|█▏        | 42322/371472 [3:22:21<26:42:42,  3.42it/s]
 11%|█▏        | 42323/371472 [3:22:21<27:08:32,  3.37it/s]
 11%|█▏        | 42324/371472 [3:22:21<26:43:02,  3.42it/s]
 11%|█▏        | 42325/371472 [3:22:22<27:19:19,  3.35it/s]
 11%|█▏        | 42326/371472 [3:22:22<27:33:49,  3.32it/s]
 11%|█▏        | 42327/371472 [3:22:22<26:54:40,  3.40it/s]
 11%|█▏        | 42328/371472 [3:22:22<25:59:00,  3.52it/s]
 11%|█▏        | 42329/371472 [3:22:23<26:12:32,  3.49it/s]
 11%|█▏        | 42330/371472 [3:22:23<25:24:29,  3.60it/s]
 11%|█▏        | 42331/371472 [3:22:23<26:35:48,  3.44it/s]
 11%|█▏        | 42332/371472 [3:22:24<25:58:06,  3.52it/s]
 11%|█▏        | 42333/371472 [3:22:24<25:26:22,  3.59it/s]
 11%|█▏        | 42334/371472 [3:22:24<25:46:48,  3.55it/s]
 11%|█▏        | 42335/371472 [3:22:24<24:35:38,  3.72it/s]
 11%|█▏        | 42336/371472 [3:22:25<24:37:46,  3.71it/s]
 11%|█▏        | 42337/371472 [3:22:25<25:28:49,  3.59it/s]
 11%|█▏        | 42338/371472 [3:22:25<26:48:37,  3.41it/s]
 11%|█▏        | 42339/371472 [3:22:26<25:43:57,  3.55it/s]
 11%|█▏        | 42340/371472 [3:22:26<25:36:43,  3.57it/s]
                                                           
{'loss': 4.2777, 'learning_rate': 8.978484776659699e-07, 'epoch': 1.82}

 11%|█▏        | 42340/371472 [3:22:26<25:36:43,  3.57it/s]
 11%|█▏        | 42341/371472 [3:22:26<25:02:50,  3.65it/s]
 11%|█▏        | 42342/371472 [3:22:26<24:36:55,  3.71it/s]
 11%|█▏        | 42343/371472 [3:22:27<24:08:34,  3.79it/s]
 11%|█▏        | 42344/371472 [3:22:27<26:40:01,  3.43it/s]
 11%|█▏        | 42345/371472 [3:22:27<26:37:16,  3.43it/s]
 11%|█▏        | 42346/371472 [3:22:28<25:48:57,  3.54it/s]
 11%|█▏        | 42347/371472 [3:22:28<24:59:18,  3.66it/s]
 11%|█▏        | 42348/371472 [3:22:28<26:47:23,  3.41it/s]
 11%|█▏        | 42349/371472 [3:22:28<27:14:34,  3.36it/s]
 11%|█▏        | 42350/371472 [3:22:29<26:13:43,  3.49it/s]
 11%|█▏        | 42351/371472 [3:22:29<25:26:11,  3.59it/s]
 11%|█▏        | 42352/371472 [3:22:29<25:18:16,  3.61it/s]
 11%|█▏        | 42353/371472 [3:22:29<25:17:13,  3.62it/s]
 11%|█▏        | 42354/371472 [3:22:30<26:45:36,  3.42it/s]
 11%|█▏        | 42355/371472 [3:22:30<25:48:53,  3.54it/s]
 11%|█▏        | 42356/371472 [3:22:30<27:13:29,  3.36it/s]
 11%|█▏        | 42357/371472 [3:22:31<26:50:11,  3.41it/s]
 11%|█▏        | 42358/371472 [3:22:31<26:20:36,  3.47it/s]
 11%|█▏        | 42359/371472 [3:22:31<26:34:50,  3.44it/s]
 11%|█▏        | 42360/371472 [3:22:32<26:22:29,  3.47it/s]
                                                           
{'loss': 4.3465, 'learning_rate': 8.977999956904911e-07, 'epoch': 1.82}

 11%|█▏        | 42360/371472 [3:22:32<26:22:29,  3.47it/s]
 11%|█▏        | 42361/371472 [3:22:32<25:27:13,  3.59it/s]
 11%|█▏        | 42362/371472 [3:22:32<24:45:34,  3.69it/s]
 11%|█▏        | 42363/371472 [3:22:32<25:02:49,  3.65it/s]
 11%|█▏        | 42364/371472 [3:22:33<26:14:32,  3.48it/s]
 11%|█▏        | 42365/371472 [3:22:33<25:54:31,  3.53it/s]
 11%|█▏        | 42366/371472 [3:22:33<26:53:24,  3.40it/s]
 11%|█▏        | 42367/371472 [3:22:34<27:05:43,  3.37it/s]
 11%|█▏        | 42368/371472 [3:22:34<28:10:06,  3.25it/s]
 11%|█▏        | 42369/371472 [3:22:34<26:46:02,  3.42it/s]
 11%|█▏        | 42370/371472 [3:22:34<26:52:25,  3.40it/s]
 11%|█▏        | 42371/371472 [3:22:35<25:28:10,  3.59it/s]
 11%|█▏        | 42372/371472 [3:22:35<26:12:27,  3.49it/s]
 11%|█▏        | 42373/371472 [3:22:35<25:55:27,  3.53it/s]
 11%|█▏        | 42374/371472 [3:22:36<25:15:03,  3.62it/s]
 11%|█▏        | 42375/371472 [3:22:36<24:45:41,  3.69it/s]
 11%|█▏        | 42376/371472 [3:22:36<25:10:27,  3.63it/s]
 11%|█▏        | 42377/371472 [3:22:36<25:47:17,  3.54it/s]
 11%|█▏        | 42378/371472 [3:22:37<25:52:19,  3.53it/s]
 11%|█▏        | 42379/371472 [3:22:37<27:21:38,  3.34it/s]
 11%|█▏        | 42380/371472 [3:22:37<27:34:32,  3.32it/s]
                                                           
{'loss': 4.3886, 'learning_rate': 8.97751513715012e-07, 'epoch': 1.83}

 11%|█▏        | 42380/371472 [3:22:37<27:34:32,  3.32it/s]
 11%|█▏        | 42381/371472 [3:22:38<27:03:01,  3.38it/s]
 11%|█▏        | 42382/371472 [3:22:38<25:57:14,  3.52it/s]
 11%|█▏        | 42383/371472 [3:22:38<26:01:13,  3.51it/s]
 11%|█▏        | 42384/371472 [3:22:38<26:46:43,  3.41it/s]
 11%|█▏        | 42385/371472 [3:22:39<25:57:11,  3.52it/s]
 11%|█▏        | 42386/371472 [3:22:39<25:23:20,  3.60it/s]
 11%|█▏        | 42387/371472 [3:22:39<26:13:28,  3.49it/s]
 11%|█▏        | 42388/371472 [3:22:40<25:09:11,  3.63it/s]
 11%|█▏        | 42389/371472 [3:22:40<25:20:28,  3.61it/s]
 11%|█▏        | 42390/371472 [3:22:40<25:23:40,  3.60it/s]
 11%|█▏        | 42391/371472 [3:22:40<28:57:22,  3.16it/s]
 11%|█▏        | 42392/371472 [3:22:41<28:27:31,  3.21it/s]
 11%|█▏        | 42393/371472 [3:22:41<27:37:11,  3.31it/s]
 11%|█▏        | 42394/371472 [3:22:41<27:13:52,  3.36it/s]
 11%|█▏        | 42395/371472 [3:22:42<26:31:30,  3.45it/s]
 11%|█▏        | 42396/371472 [3:22:42<26:03:30,  3.51it/s]
 11%|█▏        | 42397/371472 [3:22:42<25:16:32,  3.62it/s]
 11%|█▏        | 42398/371472 [3:22:42<25:49:38,  3.54it/s]
 11%|█▏        | 42399/371472 [3:22:43<25:47:42,  3.54it/s]
 11%|█▏        | 42400/371472 [3:22:43<27:13:27,  3.36it/s]
                                                           
{'loss': 4.2146, 'learning_rate': 8.977030317395332e-07, 'epoch': 1.83}

 11%|█▏        | 42400/371472 [3:22:43<27:13:27,  3.36it/s]
 11%|█▏        | 42401/371472 [3:22:43<25:45:12,  3.55it/s]
 11%|█▏        | 42402/371472 [3:22:44<25:07:03,  3.64it/s]
 11%|█▏        | 42403/371472 [3:22:44<24:40:37,  3.70it/s]
 11%|█▏        | 42404/371472 [3:22:44<24:24:16,  3.75it/s]
 11%|█▏        | 42405/371472 [3:22:44<24:52:05,  3.68it/s]
 11%|█▏        | 42406/371472 [3:22:45<25:37:29,  3.57it/s]
 11%|█▏        | 42407/371472 [3:22:45<25:43:36,  3.55it/s]
 11%|█▏        | 42408/371472 [3:22:45<25:43:59,  3.55it/s]
 11%|█▏        | 42409/371472 [3:22:45<24:55:24,  3.67it/s]
 11%|█▏        | 42410/371472 [3:22:46<26:02:06,  3.51it/s]
 11%|█▏        | 42411/371472 [3:22:46<25:27:54,  3.59it/s]
 11%|█▏        | 42412/371472 [3:22:46<24:45:09,  3.69it/s]
 11%|█▏        | 42413/371472 [3:22:47<24:56:29,  3.66it/s]
 11%|█▏        | 42414/371472 [3:22:47<24:37:54,  3.71it/s]
 11%|█▏        | 42415/371472 [3:22:47<25:32:38,  3.58it/s]
 11%|█▏        | 42416/371472 [3:22:47<26:55:10,  3.40it/s]
 11%|█▏        | 42417/371472 [3:22:48<26:51:22,  3.40it/s]
 11%|█▏        | 42418/371472 [3:22:48<26:38:08,  3.43it/s]
 11%|█▏        | 42419/371472 [3:22:48<26:39:53,  3.43it/s]
 11%|█▏        | 42420/371472 [3:22:49<26:07:24,  3.50it/s]
                                                           
{'loss': 4.3834, 'learning_rate': 8.976545497640543e-07, 'epoch': 1.83}

 11%|█▏        | 42420/371472 [3:22:49<26:07:24,  3.50it/s]
 11%|█▏        | 42421/371472 [3:22:49<26:15:27,  3.48it/s]
 11%|█▏        | 42422/371472 [3:22:49<26:05:42,  3.50it/s]
 11%|█▏        | 42423/371472 [3:22:50<26:18:14,  3.47it/s]
 11%|█▏        | 42424/371472 [3:22:50<25:29:48,  3.58it/s]
 11%|█▏        | 42425/371472 [3:22:50<26:35:09,  3.44it/s]
 11%|█▏        | 42426/371472 [3:22:50<25:40:10,  3.56it/s]
 11%|█▏        | 42427/371472 [3:22:51<25:12:55,  3.62it/s]
 11%|█▏        | 42428/371472 [3:22:51<26:35:32,  3.44it/s]
 11%|█▏        | 42429/371472 [3:22:51<25:43:14,  3.55it/s]
 11%|█▏        | 42430/371472 [3:22:51<24:32:15,  3.72it/s]
 11%|█▏        | 42431/371472 [3:22:52<25:15:53,  3.62it/s]
 11%|█▏        | 42432/371472 [3:22:52<24:49:12,  3.68it/s]
 11%|█▏        | 42433/371472 [3:22:52<26:06:04,  3.50it/s]
 11%|█▏        | 42434/371472 [3:22:53<26:28:19,  3.45it/s]
 11%|█▏        | 42435/371472 [3:22:53<27:15:00,  3.35it/s]
 11%|█▏        | 42436/371472 [3:22:53<28:16:11,  3.23it/s]
 11%|█▏        | 42437/371472 [3:22:54<28:03:21,  3.26it/s]
 11%|█▏        | 42438/371472 [3:22:54<26:58:50,  3.39it/s]
 11%|█▏        | 42439/371472 [3:22:54<26:46:27,  3.41it/s]
 11%|█▏        | 42440/371472 [3:22:54<26:44:09,  3.42it/s]
                                                           
{'loss': 4.4563, 'learning_rate': 8.976060677885755e-07, 'epoch': 1.83}

 11%|█▏        | 42440/371472 [3:22:54<26:44:09,  3.42it/s]
 11%|█▏        | 42441/371472 [3:22:55<26:20:57,  3.47it/s]
 11%|█▏        | 42442/371472 [3:22:55<25:30:37,  3.58it/s]
 11%|█▏        | 42443/371472 [3:22:55<25:18:56,  3.61it/s]
 11%|█▏        | 42444/371472 [3:22:56<25:45:31,  3.55it/s]
 11%|█▏        | 42445/371472 [3:22:56<26:45:00,  3.42it/s]
 11%|█▏        | 42446/371472 [3:22:56<26:02:07,  3.51it/s]
 11%|█▏        | 42447/371472 [3:22:56<25:25:57,  3.59it/s]
 11%|█▏        | 42448/371472 [3:22:57<25:07:32,  3.64it/s]
 11%|█▏        | 42449/371472 [3:22:57<24:53:08,  3.67it/s]
 11%|█▏        | 42450/371472 [3:22:57<24:48:19,  3.68it/s]
 11%|█▏        | 42451/371472 [3:22:57<24:25:49,  3.74it/s]
 11%|█▏        | 42452/371472 [3:22:58<24:25:53,  3.74it/s]
 11%|█▏        | 42453/371472 [3:22:58<24:57:02,  3.66it/s]
 11%|█▏        | 42454/371472 [3:22:58<25:45:42,  3.55it/s]
 11%|█▏        | 42455/371472 [3:22:59<26:33:56,  3.44it/s]
 11%|█▏        | 42456/371472 [3:22:59<25:54:50,  3.53it/s]
 11%|█▏        | 42457/371472 [3:22:59<25:31:06,  3.58it/s]
 11%|█▏        | 42458/371472 [3:22:59<27:56:47,  3.27it/s]
 11%|█▏        | 42459/371472 [3:23:00<28:39:36,  3.19it/s]
 11%|█▏        | 42460/371472 [3:23:00<30:46:22,  2.97it/s]
                                                           
{'loss': 4.2038, 'learning_rate': 8.975575858130965e-07, 'epoch': 1.83}

 11%|█▏        | 42460/371472 [3:23:00<30:46:22,  2.97it/s]
 11%|█▏        | 42461/371472 [3:23:00<29:12:20,  3.13it/s]
 11%|█▏        | 42462/371472 [3:23:01<28:07:23,  3.25it/s]
 11%|█▏        | 42463/371472 [3:23:01<27:58:42,  3.27it/s]
 11%|█▏        | 42464/371472 [3:23:01<26:53:17,  3.40it/s]
 11%|█▏        | 42465/371472 [3:23:02<25:51:36,  3.53it/s]
 11%|█▏        | 42466/371472 [3:23:02<24:58:08,  3.66it/s]
 11%|█▏        | 42467/371472 [3:23:02<30:30:47,  3.00it/s]
 11%|█▏        | 42468/371472 [3:23:03<29:21:13,  3.11it/s]
 11%|█▏        | 42469/371472 [3:23:03<29:37:06,  3.09it/s]
 11%|█▏        | 42470/371472 [3:23:03<29:39:40,  3.08it/s]
 11%|█▏        | 42471/371472 [3:23:04<28:42:14,  3.18it/s]
 11%|█▏        | 42472/371472 [3:23:04<27:26:30,  3.33it/s]
 11%|█▏        | 42473/371472 [3:23:04<26:46:31,  3.41it/s]
 11%|█▏        | 42474/371472 [3:23:04<25:33:39,  3.58it/s]
 11%|█▏        | 42475/371472 [3:23:05<27:43:16,  3.30it/s]
 11%|█▏        | 42476/371472 [3:23:05<26:32:43,  3.44it/s]
 11%|█▏        | 42477/371472 [3:23:05<27:27:41,  3.33it/s]
 11%|█▏        | 42478/371472 [3:23:06<29:08:31,  3.14it/s]
 11%|█▏        | 42479/371472 [3:23:06<27:19:40,  3.34it/s]
 11%|█▏        | 42480/371472 [3:23:06<26:21:27,  3.47it/s]
                                                           
{'loss': 4.4039, 'learning_rate': 8.975091038376177e-07, 'epoch': 1.83}

 11%|█▏        | 42480/371472 [3:23:06<26:21:27,  3.47it/s]
 11%|█▏        | 42481/371472 [3:23:06<26:04:50,  3.50it/s]
 11%|█▏        | 42482/371472 [3:23:07<25:36:28,  3.57it/s]
 11%|█▏        | 42483/371472 [3:23:07<26:14:50,  3.48it/s]
 11%|█▏        | 42484/371472 [3:23:07<26:16:25,  3.48it/s]
 11%|█▏        | 42485/371472 [3:23:08<27:04:46,  3.37it/s]
 11%|█▏        | 42486/371472 [3:23:08<26:16:08,  3.48it/s]
 11%|█▏        | 42487/371472 [3:23:08<29:50:00,  3.06it/s]
 11%|█▏        | 42488/371472 [3:23:09<29:12:45,  3.13it/s]
 11%|█▏        | 42489/371472 [3:23:09<31:15:48,  2.92it/s]
 11%|█▏        | 42490/371472 [3:23:09<29:00:01,  3.15it/s]
 11%|█▏        | 42491/371472 [3:23:10<28:02:11,  3.26it/s]
 11%|█▏        | 42492/371472 [3:23:10<28:33:19,  3.20it/s]
 11%|█▏        | 42493/371472 [3:23:10<28:51:59,  3.17it/s]
 11%|█▏        | 42494/371472 [3:23:11<28:46:12,  3.18it/s]
 11%|█▏        | 42495/371472 [3:23:11<28:18:18,  3.23it/s]
 11%|█▏        | 42496/371472 [3:23:11<28:35:49,  3.20it/s]
 11%|█▏        | 42497/371472 [3:23:11<27:38:47,  3.31it/s]
 11%|█▏        | 42498/371472 [3:23:12<26:19:45,  3.47it/s]
 11%|█▏        | 42499/371472 [3:23:12<29:52:14,  3.06it/s]
 11%|█▏        | 42500/371472 [3:23:12<29:09:25,  3.13it/s]
                                                           
{'loss': 4.1675, 'learning_rate': 8.974606218621388e-07, 'epoch': 1.83}

 11%|█▏        | 42500/371472 [3:23:12<29:09:25,  3.13it/s]
 11%|█▏        | 42501/371472 [3:23:13<28:04:49,  3.25it/s]
 11%|█▏        | 42502/371472 [3:23:13<27:04:17,  3.38it/s]
 11%|█▏        | 42503/371472 [3:23:13<28:00:36,  3.26it/s]
 11%|█▏        | 42504/371472 [3:23:14<27:55:30,  3.27it/s]
 11%|█▏        | 42505/371472 [3:23:14<26:08:14,  3.50it/s]
 11%|█▏        | 42506/371472 [3:23:14<25:57:00,  3.52it/s]
 11%|█▏        | 42507/371472 [3:23:14<26:00:00,  3.51it/s]
 11%|█▏        | 42508/371472 [3:23:15<28:30:36,  3.21it/s]
 11%|█▏        | 42509/371472 [3:23:15<26:56:47,  3.39it/s]
 11%|█▏        | 42510/371472 [3:23:15<26:33:57,  3.44it/s]
 11%|█▏        | 42511/371472 [3:23:16<26:07:39,  3.50it/s]
 11%|█▏        | 42512/371472 [3:23:16<25:57:12,  3.52it/s]
 11%|█▏        | 42513/371472 [3:23:16<26:16:16,  3.48it/s]
 11%|█▏        | 42514/371472 [3:23:16<26:12:33,  3.49it/s]
 11%|█▏        | 42515/371472 [3:23:17<26:47:26,  3.41it/s]
 11%|█▏        | 42516/371472 [3:23:17<27:22:10,  3.34it/s]
 11%|█▏        | 42517/371472 [3:23:17<26:26:43,  3.46it/s]
 11%|█▏        | 42518/371472 [3:23:18<27:09:45,  3.36it/s]
 11%|█▏        | 42519/371472 [3:23:18<25:50:04,  3.54it/s]
 11%|█▏        | 42520/371472 [3:23:18<25:27:17,  3.59it/s]
                                                           
{'loss': 4.3842, 'learning_rate': 8.974121398866599e-07, 'epoch': 1.83}

 11%|█▏        | 42520/371472 [3:23:18<25:27:17,  3.59it/s]
 11%|█▏        | 42521/371472 [3:23:18<26:41:53,  3.42it/s]
 11%|█▏        | 42522/371472 [3:23:19<25:22:54,  3.60it/s]
 11%|█▏        | 42523/371472 [3:23:19<25:58:41,  3.52it/s]
 11%|█▏        | 42524/371472 [3:23:19<25:41:39,  3.56it/s]
 11%|█▏        | 42525/371472 [3:23:20<25:47:01,  3.54it/s]
 11%|█▏        | 42526/371472 [3:23:20<25:28:46,  3.59it/s]
 11%|█▏        | 42527/371472 [3:23:20<26:52:27,  3.40it/s]
 11%|█▏        | 42528/371472 [3:23:20<25:30:05,  3.58it/s]
 11%|█▏        | 42529/371472 [3:23:21<27:12:49,  3.36it/s]
 11%|█▏        | 42530/371472 [3:23:21<26:20:36,  3.47it/s]
 11%|█▏        | 42531/371472 [3:23:21<26:13:56,  3.48it/s]
 11%|█▏        | 42532/371472 [3:23:22<26:43:01,  3.42it/s]
 11%|█▏        | 42533/371472 [3:23:22<27:49:29,  3.28it/s]
 11%|█▏        | 42534/371472 [3:23:22<26:27:52,  3.45it/s]
 11%|█▏        | 42535/371472 [3:23:22<25:35:24,  3.57it/s]
 11%|█▏        | 42536/371472 [3:23:23<27:31:28,  3.32it/s]
 11%|█▏        | 42537/371472 [3:23:23<27:21:32,  3.34it/s]
 11%|█▏        | 42538/371472 [3:23:23<27:47:06,  3.29it/s]
 11%|█▏        | 42539/371472 [3:23:24<27:32:28,  3.32it/s]
 11%|█▏        | 42540/371472 [3:23:24<27:04:41,  3.37it/s]
                                                           
{'loss': 4.2416, 'learning_rate': 8.973636579111809e-07, 'epoch': 1.83}

 11%|█▏        | 42540/371472 [3:23:24<27:04:41,  3.37it/s]
 11%|█▏        | 42541/371472 [3:23:24<26:55:05,  3.39it/s]
 11%|█▏        | 42542/371472 [3:23:25<26:30:14,  3.45it/s]
 11%|█▏        | 42543/371472 [3:23:25<27:42:40,  3.30it/s]
 11%|█▏        | 42544/371472 [3:23:25<28:41:31,  3.18it/s]
 11%|█▏        | 42545/371472 [3:23:26<30:27:33,  3.00it/s]
 11%|█▏        | 42546/371472 [3:23:26<30:47:04,  2.97it/s]
 11%|█▏        | 42547/371472 [3:23:26<28:46:30,  3.18it/s]
 11%|█▏        | 42548/371472 [3:23:26<27:30:23,  3.32it/s]
 11%|█▏        | 42549/371472 [3:23:27<27:28:03,  3.33it/s]
 11%|█▏        | 42550/371472 [3:23:27<26:26:21,  3.46it/s]
 11%|█▏        | 42551/371472 [3:23:27<25:13:30,  3.62it/s]
 11%|█▏        | 42552/371472 [3:23:28<26:06:33,  3.50it/s]
 11%|█▏        | 42553/371472 [3:23:28<26:09:18,  3.49it/s]
 11%|█▏        | 42554/371472 [3:23:28<28:12:32,  3.24it/s]
 11%|█▏        | 42555/371472 [3:23:29<28:05:38,  3.25it/s]
 11%|█▏        | 42556/371472 [3:23:29<28:39:48,  3.19it/s]
 11%|█▏        | 42557/371472 [3:23:29<27:05:43,  3.37it/s]
 11%|█▏        | 42558/371472 [3:23:29<27:06:18,  3.37it/s]
 11%|█▏        | 42559/371472 [3:23:30<27:09:47,  3.36it/s]
 11%|█▏        | 42560/371472 [3:23:30<26:55:30,  3.39it/s]
                                                           
{'loss': 4.5044, 'learning_rate': 8.973151759357021e-07, 'epoch': 1.83}

 11%|█▏        | 42560/371472 [3:23:30<26:55:30,  3.39it/s]
 11%|█▏        | 42561/371472 [3:23:30<25:58:00,  3.52it/s]
 11%|█▏        | 42562/371472 [3:23:31<25:51:22,  3.53it/s]
 11%|█▏        | 42563/371472 [3:23:31<26:02:21,  3.51it/s]
 11%|█▏        | 42564/371472 [3:23:31<25:58:47,  3.52it/s]
 11%|█▏        | 42565/371472 [3:23:31<25:52:26,  3.53it/s]
 11%|█▏        | 42566/371472 [3:23:32<24:55:15,  3.67it/s]
 11%|█▏        | 42567/371472 [3:23:32<26:35:14,  3.44it/s]
 11%|█▏        | 42568/371472 [3:23:32<26:27:55,  3.45it/s]
 11%|█▏        | 42569/371472 [3:23:33<25:59:01,  3.52it/s]
 11%|█▏        | 42570/371472 [3:23:33<25:48:57,  3.54it/s]
 11%|█▏        | 42571/371472 [3:23:33<25:23:31,  3.60it/s]
 11%|█▏        | 42572/371472 [3:23:33<24:51:07,  3.68it/s]
 11%|█▏        | 42573/371472 [3:23:34<24:07:37,  3.79it/s]
 11%|█▏        | 42574/371472 [3:23:34<23:51:43,  3.83it/s]
 11%|█▏        | 42575/371472 [3:23:34<24:16:25,  3.76it/s]
 11%|█▏        | 42576/371472 [3:23:34<23:48:07,  3.84it/s]
 11%|█▏        | 42577/371472 [3:23:35<26:14:14,  3.48it/s]
 11%|█▏        | 42578/371472 [3:23:35<26:10:15,  3.49it/s]
 11%|█▏        | 42579/371472 [3:23:35<25:47:00,  3.54it/s]
 11%|█▏        | 42580/371472 [3:23:36<27:13:31,  3.36it/s]
                                                           
{'loss': 4.3566, 'learning_rate': 8.972666939602232e-07, 'epoch': 1.83}

 11%|█▏        | 42580/371472 [3:23:36<27:13:31,  3.36it/s]
 11%|█▏        | 42581/371472 [3:23:36<27:05:18,  3.37it/s]
 11%|█▏        | 42582/371472 [3:23:36<30:20:46,  3.01it/s]
 11%|█▏        | 42583/371472 [3:23:37<28:58:33,  3.15it/s]
 11%|█▏        | 42584/371472 [3:23:37<27:59:22,  3.26it/s]
 11%|█▏        | 42585/371472 [3:23:37<26:52:56,  3.40it/s]
 11%|█▏        | 42586/371472 [3:23:37<26:25:17,  3.46it/s]
 11%|█▏        | 42587/371472 [3:23:38<27:58:06,  3.27it/s]
 11%|█▏        | 42588/371472 [3:23:38<27:29:20,  3.32it/s]
 11%|█▏        | 42589/371472 [3:23:38<26:27:48,  3.45it/s]
 11%|█▏        | 42590/371472 [3:23:39<27:22:59,  3.34it/s]
 11%|█▏        | 42591/371472 [3:23:39<28:32:49,  3.20it/s]
 11%|█▏        | 42592/371472 [3:23:39<27:08:43,  3.37it/s]
 11%|█▏        | 42593/371472 [3:23:40<25:44:29,  3.55it/s]
 11%|█▏        | 42594/371472 [3:23:40<25:05:26,  3.64it/s]
 11%|█▏        | 42595/371472 [3:23:40<25:12:41,  3.62it/s]
 11%|█▏        | 42596/371472 [3:23:40<24:39:42,  3.70it/s]
 11%|█▏        | 42597/371472 [3:23:41<24:51:05,  3.68it/s]
 11%|█▏        | 42598/371472 [3:23:41<25:57:31,  3.52it/s]
 11%|█▏        | 42599/371472 [3:23:41<25:11:21,  3.63it/s]
 11%|█▏        | 42600/371472 [3:23:41<25:35:56,  3.57it/s]
                                                           
{'loss': 4.503, 'learning_rate': 8.972182119847444e-07, 'epoch': 1.83}

 11%|█▏        | 42600/371472 [3:23:41<25:35:56,  3.57it/s]
 11%|█▏        | 42601/371472 [3:23:42<24:51:05,  3.68it/s]
 11%|█▏        | 42602/371472 [3:23:42<25:13:57,  3.62it/s]
 11%|█▏        | 42603/371472 [3:23:42<25:09:35,  3.63it/s]
 11%|█▏        | 42604/371472 [3:23:43<25:02:50,  3.65it/s]
 11%|█▏        | 42605/371472 [3:23:43<25:05:45,  3.64it/s]
 11%|█▏        | 42606/371472 [3:23:43<28:09:33,  3.24it/s]
 11%|█▏        | 42607/371472 [3:23:44<29:46:10,  3.07it/s]
 11%|█▏        | 42608/371472 [3:23:44<27:38:07,  3.31it/s]
 11%|█▏        | 42609/371472 [3:23:44<27:08:30,  3.37it/s]
 11%|█▏        | 42610/371472 [3:23:44<25:58:55,  3.52it/s]
 11%|█▏        | 42611/371472 [3:23:45<26:14:40,  3.48it/s]
 11%|█▏        | 42612/371472 [3:23:45<25:15:38,  3.62it/s]
 11%|█▏        | 42613/371472 [3:23:45<26:18:29,  3.47it/s]
 11%|█▏        | 42614/371472 [3:23:46<26:53:18,  3.40it/s]
 11%|█▏        | 42615/371472 [3:23:46<27:26:27,  3.33it/s]
 11%|█▏        | 42616/371472 [3:23:46<26:18:57,  3.47it/s]
 11%|█▏        | 42617/371472 [3:23:46<25:35:05,  3.57it/s]
 11%|█▏        | 42618/371472 [3:23:47<24:48:36,  3.68it/s]
 11%|█▏        | 42619/371472 [3:23:47<24:45:35,  3.69it/s]
 11%|█▏        | 42620/371472 [3:23:47<24:58:51,  3.66it/s]
                                                           
{'loss': 4.339, 'learning_rate': 8.971697300092654e-07, 'epoch': 1.84}

 11%|█▏        | 42620/371472 [3:23:47<24:58:51,  3.66it/s]
 11%|█▏        | 42621/371472 [3:23:48<29:06:50,  3.14it/s]
 11%|█▏        | 42622/371472 [3:23:48<28:28:08,  3.21it/s]
 11%|█▏        | 42623/371472 [3:23:48<27:10:30,  3.36it/s]
 11%|█▏        | 42624/371472 [3:23:48<26:26:31,  3.45it/s]
 11%|█▏        | 42625/371472 [3:23:49<25:56:29,  3.52it/s]
 11%|█▏        | 42626/371472 [3:23:49<26:20:44,  3.47it/s]
 11%|█▏        | 42627/371472 [3:23:49<25:39:43,  3.56it/s]
 11%|█▏        | 42628/371472 [3:23:50<25:19:26,  3.61it/s]
 11%|█▏        | 42629/371472 [3:23:50<25:55:34,  3.52it/s]
 11%|█▏        | 42630/371472 [3:23:50<26:06:52,  3.50it/s]
 11%|█▏        | 42631/371472 [3:23:50<26:54:25,  3.39it/s]
 11%|█▏        | 42632/371472 [3:23:51<28:20:57,  3.22it/s]
 11%|█▏        | 42633/371472 [3:23:51<30:32:32,  2.99it/s]
 11%|█▏        | 42634/371472 [3:23:51<30:02:58,  3.04it/s]
 11%|█▏        | 42635/371472 [3:23:52<29:42:17,  3.08it/s]
 11%|█▏        | 42636/371472 [3:23:52<28:08:00,  3.25it/s]
 11%|█▏        | 42637/371472 [3:23:52<26:54:50,  3.39it/s]
 11%|█▏        | 42638/371472 [3:23:53<27:01:05,  3.38it/s]
 11%|█▏        | 42639/371472 [3:23:53<26:51:34,  3.40it/s]
 11%|█▏        | 42640/371472 [3:23:53<26:29:42,  3.45it/s]
                                                           
{'loss': 4.2754, 'learning_rate': 8.971212480337865e-07, 'epoch': 1.84}

 11%|█▏        | 42640/371472 [3:23:53<26:29:42,  3.45it/s]
 11%|█▏        | 42641/371472 [3:23:53<25:43:20,  3.55it/s]
 11%|█▏        | 42642/371472 [3:23:54<24:59:19,  3.66it/s]
 11%|█▏        | 42643/371472 [3:23:54<26:41:55,  3.42it/s]
 11%|█▏        | 42644/371472 [3:23:54<26:12:54,  3.48it/s]
 11%|█▏        | 42645/371472 [3:23:55<25:20:52,  3.60it/s]
 11%|█▏        | 42646/371472 [3:23:55<25:00:13,  3.65it/s]
 11%|█▏        | 42647/371472 [3:23:55<25:34:59,  3.57it/s]
 11%|█▏        | 42648/371472 [3:23:55<24:56:26,  3.66it/s]
 11%|█▏        | 42649/371472 [3:23:56<24:45:01,  3.69it/s]
 11%|█▏        | 42650/371472 [3:23:56<25:40:36,  3.56it/s]
 11%|█▏        | 42651/371472 [3:23:56<25:32:26,  3.58it/s]
 11%|█▏        | 42652/371472 [3:23:57<25:45:49,  3.55it/s]
 11%|█▏        | 42653/371472 [3:23:57<26:00:45,  3.51it/s]
 11%|█▏        | 42654/371472 [3:23:57<26:20:25,  3.47it/s]
 11%|█▏        | 42655/371472 [3:23:57<26:30:00,  3.45it/s]
 11%|█▏        | 42656/371472 [3:23:58<28:37:30,  3.19it/s]
 11%|█▏        | 42657/371472 [3:23:58<27:57:59,  3.27it/s]
 11%|█▏        | 42658/371472 [3:23:58<28:45:54,  3.18it/s]
 11%|█▏        | 42659/371472 [3:23:59<27:23:22,  3.33it/s]
 11%|█▏        | 42660/371472 [3:23:59<26:31:52,  3.44it/s]
                                                           
{'loss': 4.1781, 'learning_rate': 8.970727660583076e-07, 'epoch': 1.84}

 11%|█▏        | 42660/371472 [3:23:59<26:31:52,  3.44it/s]
 11%|█▏        | 42661/371472 [3:23:59<29:23:30,  3.11it/s]
 11%|█▏        | 42662/371472 [3:24:00<28:06:45,  3.25it/s]
 11%|█▏        | 42663/371472 [3:24:00<27:14:10,  3.35it/s]
 11%|█▏        | 42664/371472 [3:24:00<27:21:54,  3.34it/s]
 11%|█▏        | 42665/371472 [3:24:00<26:55:28,  3.39it/s]
 11%|█▏        | 42666/371472 [3:24:01<28:34:38,  3.20it/s]
 11%|█▏        | 42667/371472 [3:24:01<28:07:22,  3.25it/s]
 11%|█▏        | 42668/371472 [3:24:01<26:51:52,  3.40it/s]
 11%|█▏        | 42669/371472 [3:24:02<26:02:32,  3.51it/s]
 11%|█▏        | 42670/371472 [3:24:02<25:47:56,  3.54it/s]
 11%|█▏        | 42671/371472 [3:24:02<25:54:40,  3.52it/s]
 11%|█▏        | 42672/371472 [3:24:02<25:36:58,  3.57it/s]
 11%|█▏        | 42673/371472 [3:24:03<25:59:28,  3.51it/s]
 11%|█▏        | 42674/371472 [3:24:03<25:09:57,  3.63it/s]
 11%|█▏        | 42675/371472 [3:24:03<25:24:42,  3.59it/s]
 11%|█▏        | 42676/371472 [3:24:04<26:48:35,  3.41it/s]
 11%|█▏        | 42677/371472 [3:24:04<25:53:21,  3.53it/s]
 11%|█▏        | 42678/371472 [3:24:04<25:45:14,  3.55it/s]
 11%|█▏        | 42679/371472 [3:24:05<27:15:20,  3.35it/s]
 11%|█▏        | 42680/371472 [3:24:05<27:26:10,  3.33it/s]
                                                           
{'loss': 4.3477, 'learning_rate': 8.970242840828288e-07, 'epoch': 1.84}

 11%|█▏        | 42680/371472 [3:24:05<27:26:10,  3.33it/s]
 11%|█▏        | 42681/371472 [3:24:05<27:49:48,  3.28it/s]
 11%|█▏        | 42682/371472 [3:24:05<26:57:46,  3.39it/s]
 11%|█▏        | 42683/371472 [3:24:06<28:45:59,  3.17it/s]
 11%|█▏        | 42684/371472 [3:24:06<29:10:53,  3.13it/s]
 11%|█▏        | 42685/371472 [3:24:06<29:42:55,  3.07it/s]
 11%|█▏        | 42686/371472 [3:24:07<30:43:19,  2.97it/s]
 11%|█▏        | 42687/371472 [3:24:07<31:13:50,  2.92it/s]
 11%|█▏        | 42688/371472 [3:24:07<31:16:10,  2.92it/s]
 11%|█▏        | 42689/371472 [3:24:08<28:36:44,  3.19it/s]
 11%|█▏        | 42690/371472 [3:24:08<26:59:01,  3.38it/s]
 11%|█▏        | 42691/371472 [3:24:08<27:01:40,  3.38it/s]
 11%|█▏        | 42692/371472 [3:24:09<25:57:39,  3.52it/s]
 11%|█▏        | 42693/371472 [3:24:09<26:34:29,  3.44it/s]
 11%|█▏        | 42694/371472 [3:24:09<27:20:54,  3.34it/s]
 11%|█▏        | 42695/371472 [3:24:09<26:52:10,  3.40it/s]
 11%|█▏        | 42696/371472 [3:24:10<26:17:19,  3.47it/s]
 11%|█▏        | 42697/371472 [3:24:10<26:05:01,  3.50it/s]
 11%|█▏        | 42698/371472 [3:24:10<27:44:54,  3.29it/s]
 11%|█▏        | 42699/371472 [3:24:11<26:44:35,  3.41it/s]
 11%|█▏        | 42700/371472 [3:24:11<26:23:55,  3.46it/s]
                                                           
{'loss': 4.4648, 'learning_rate': 8.969758021073498e-07, 'epoch': 1.84}

 11%|█▏        | 42700/371472 [3:24:11<26:23:55,  3.46it/s]
 11%|█▏        | 42701/371472 [3:24:11<28:18:48,  3.23it/s]
 11%|█▏        | 42702/371472 [3:24:12<28:03:15,  3.26it/s]
 11%|█▏        | 42703/371472 [3:24:12<26:53:19,  3.40it/s]
 11%|█▏        | 42704/371472 [3:24:12<26:06:22,  3.50it/s]
 11%|█▏        | 42705/371472 [3:24:12<25:28:38,  3.58it/s]
 11%|█▏        | 42706/371472 [3:24:13<27:05:55,  3.37it/s]
 11%|█▏        | 42707/371472 [3:24:13<27:40:43,  3.30it/s]
 11%|█▏        | 42708/371472 [3:24:13<26:53:48,  3.40it/s]
 11%|█▏        | 42709/371472 [3:24:14<26:45:37,  3.41it/s]
 11%|█▏        | 42710/371472 [3:24:14<26:49:12,  3.41it/s]
 11%|█▏        | 42711/371472 [3:24:14<26:51:31,  3.40it/s]
 11%|█▏        | 42712/371472 [3:24:15<28:20:19,  3.22it/s]
 11%|█▏        | 42713/371472 [3:24:15<27:33:24,  3.31it/s]
 11%|█▏        | 42714/371472 [3:24:15<27:26:12,  3.33it/s]
 11%|█▏        | 42715/371472 [3:24:15<26:12:01,  3.49it/s]
 11%|█▏        | 42716/371472 [3:24:16<27:03:55,  3.37it/s]
 11%|█▏        | 42717/371472 [3:24:16<26:27:03,  3.45it/s]
 11%|█▏        | 42718/371472 [3:24:16<25:44:45,  3.55it/s]
 11%|█▏        | 42719/371472 [3:24:16<25:37:38,  3.56it/s]
 12%|█▏        | 42720/371472 [3:24:17<25:40:08,  3.56it/s]
                                                           
{'loss': 4.4001, 'learning_rate': 8.96927320131871e-07, 'epoch': 1.84}

 12%|█▏        | 42720/371472 [3:24:17<25:40:08,  3.56it/s]
 12%|█▏        | 42721/371472 [3:24:17<25:59:35,  3.51it/s]
 12%|█▏        | 42722/371472 [3:24:17<25:07:35,  3.63it/s]
 12%|█▏        | 42723/371472 [3:24:18<24:14:56,  3.77it/s]
 12%|█▏        | 42724/371472 [3:24:18<27:38:59,  3.30it/s]
 12%|█▏        | 42725/371472 [3:24:18<27:03:33,  3.37it/s]
 12%|█▏        | 42726/371472 [3:24:19<27:32:45,  3.32it/s]
 12%|█▏        | 42727/371472 [3:24:19<26:45:44,  3.41it/s]
 12%|█▏        | 42728/371472 [3:24:19<28:36:44,  3.19it/s]
 12%|█▏        | 42729/371472 [3:24:19<26:54:51,  3.39it/s]
 12%|█▏        | 42730/371472 [3:24:20<26:57:40,  3.39it/s]
 12%|█▏        | 42731/371472 [3:24:20<26:25:15,  3.46it/s]
 12%|█▏        | 42732/371472 [3:24:20<25:48:32,  3.54it/s]
 12%|█▏        | 42733/371472 [3:24:21<25:20:53,  3.60it/s]
 12%|█▏        | 42734/371472 [3:24:21<25:19:29,  3.61it/s]
 12%|█▏        | 42735/371472 [3:24:21<25:21:55,  3.60it/s]
 12%|█▏        | 42736/371472 [3:24:21<27:36:20,  3.31it/s]
 12%|█▏        | 42737/371472 [3:24:22<27:01:41,  3.38it/s]
 12%|█▏        | 42738/371472 [3:24:22<26:42:25,  3.42it/s]
 12%|█▏        | 42739/371472 [3:24:22<26:07:35,  3.50it/s]
 12%|█▏        | 42740/371472 [3:24:23<28:06:15,  3.25it/s]
                                                           
{'loss': 4.3718, 'learning_rate': 8.968788381563921e-07, 'epoch': 1.84}

 12%|█▏        | 42740/371472 [3:24:23<28:06:15,  3.25it/s]
 12%|█▏        | 42741/371472 [3:24:23<26:25:20,  3.46it/s]
 12%|█▏        | 42742/371472 [3:24:23<27:31:02,  3.32it/s]
 12%|█▏        | 42743/371472 [3:24:24<28:41:48,  3.18it/s]
 12%|█▏        | 42744/371472 [3:24:24<28:59:38,  3.15it/s]
 12%|█▏        | 42745/371472 [3:24:24<27:42:20,  3.30it/s]
 12%|█▏        | 42746/371472 [3:24:24<26:52:08,  3.40it/s]
 12%|█▏        | 42747/371472 [3:24:25<27:00:21,  3.38it/s]
 12%|█▏        | 42748/371472 [3:24:25<25:29:49,  3.58it/s]
 12%|█▏        | 42749/371472 [3:24:25<24:50:31,  3.68it/s]
 12%|█▏        | 42750/371472 [3:24:25<24:56:09,  3.66it/s]
 12%|█▏        | 42751/371472 [3:24:26<25:01:53,  3.65it/s]
 12%|█▏        | 42752/371472 [3:24:26<25:11:14,  3.63it/s]
 12%|█▏        | 42753/371472 [3:24:26<24:45:25,  3.69it/s]
 12%|█▏        | 42754/371472 [3:24:27<25:15:03,  3.62it/s]
 12%|█▏        | 42755/371472 [3:24:27<25:06:08,  3.64it/s]
 12%|█▏        | 42756/371472 [3:24:27<25:21:28,  3.60it/s]
 12%|█▏        | 42757/371472 [3:24:27<26:12:31,  3.48it/s]
 12%|█▏        | 42758/371472 [3:24:28<26:00:10,  3.51it/s]
 12%|█▏        | 42759/371472 [3:24:28<25:19:10,  3.61it/s]
 12%|█▏        | 42760/371472 [3:24:28<25:52:58,  3.53it/s]
                                                           
{'loss': 4.2497, 'learning_rate': 8.968303561809131e-07, 'epoch': 1.84}

 12%|█▏        | 42760/371472 [3:24:28<25:52:58,  3.53it/s]
 12%|█▏        | 42761/371472 [3:24:29<25:40:54,  3.56it/s]
 12%|█▏        | 42762/371472 [3:24:29<25:18:09,  3.61it/s]
 12%|█▏        | 42763/371472 [3:24:29<25:56:03,  3.52it/s]
 12%|█▏        | 42764/371472 [3:24:29<26:26:31,  3.45it/s]
 12%|█▏        | 42765/371472 [3:24:30<26:42:02,  3.42it/s]
 12%|█▏        | 42766/371472 [3:24:30<25:52:10,  3.53it/s]
 12%|█▏        | 42767/371472 [3:24:30<26:04:29,  3.50it/s]
 12%|█▏        | 42768/371472 [3:24:31<26:15:16,  3.48it/s]
 12%|█▏        | 42769/371472 [3:24:31<25:24:35,  3.59it/s]
 12%|█▏        | 42770/371472 [3:24:31<25:33:47,  3.57it/s]
 12%|█▏        | 42771/371472 [3:24:31<24:29:49,  3.73it/s]
 12%|█▏        | 42772/371472 [3:24:32<25:20:59,  3.60it/s]
 12%|█▏        | 42773/371472 [3:24:32<27:16:43,  3.35it/s]
 12%|█▏        | 42774/371472 [3:24:32<26:05:40,  3.50it/s]
 12%|█▏        | 42775/371472 [3:24:33<26:37:10,  3.43it/s]
 12%|█▏        | 42776/371472 [3:24:33<27:53:57,  3.27it/s]
 12%|█▏        | 42777/371472 [3:24:33<27:03:08,  3.38it/s]
 12%|█▏        | 42778/371472 [3:24:34<27:19:43,  3.34it/s]
 12%|█▏        | 42779/371472 [3:24:34<26:46:03,  3.41it/s]
 12%|█▏        | 42780/371472 [3:24:34<27:43:09,  3.29it/s]
                                                           
{'loss': 4.426, 'learning_rate': 8.967818742054341e-07, 'epoch': 1.84}

 12%|█▏        | 42780/371472 [3:24:34<27:43:09,  3.29it/s]
 12%|█▏        | 42781/371472 [3:24:34<26:26:22,  3.45it/s]
 12%|█▏        | 42782/371472 [3:24:35<25:46:33,  3.54it/s]
 12%|█▏        | 42783/371472 [3:24:35<26:19:26,  3.47it/s]
 12%|█▏        | 42784/371472 [3:24:35<25:59:12,  3.51it/s]
 12%|█▏        | 42785/371472 [3:24:36<26:20:55,  3.47it/s]
 12%|█▏        | 42786/371472 [3:24:36<26:08:24,  3.49it/s]
 12%|█▏        | 42787/371472 [3:24:36<25:52:26,  3.53it/s]
 12%|█▏        | 42788/371472 [3:24:36<25:26:59,  3.59it/s]
 12%|█▏        | 42789/371472 [3:24:37<26:12:37,  3.48it/s]
 12%|█▏        | 42790/371472 [3:24:37<25:53:43,  3.53it/s]
 12%|█▏        | 42791/371472 [3:24:37<28:01:49,  3.26it/s]
 12%|█▏        | 42792/371472 [3:24:38<26:15:11,  3.48it/s]
 12%|█▏        | 42793/371472 [3:24:38<26:33:03,  3.44it/s]
 12%|█▏        | 42794/371472 [3:24:38<30:18:42,  3.01it/s]
 12%|█▏        | 42795/371472 [3:24:39<28:41:49,  3.18it/s]
 12%|█▏        | 42796/371472 [3:24:39<27:34:16,  3.31it/s]
 12%|█▏        | 42797/371472 [3:24:39<26:50:06,  3.40it/s]
 12%|█▏        | 42798/371472 [3:24:39<25:40:12,  3.56it/s]
 12%|█▏        | 42799/371472 [3:24:40<25:28:22,  3.58it/s]
 12%|█▏        | 42800/371472 [3:24:40<25:50:13,  3.53it/s]
                                                           
{'loss': 4.4254, 'learning_rate': 8.967333922299554e-07, 'epoch': 1.84}

 12%|█▏        | 42800/371472 [3:24:40<25:50:13,  3.53it/s]
 12%|█▏        | 42801/371472 [3:24:40<26:50:53,  3.40it/s]
 12%|█▏        | 42802/371472 [3:24:41<27:28:00,  3.32it/s]
 12%|█▏        | 42803/371472 [3:24:41<28:07:26,  3.25it/s]
 12%|█▏        | 42804/371472 [3:24:41<27:53:03,  3.27it/s]
 12%|█▏        | 42805/371472 [3:24:41<26:51:56,  3.40it/s]
 12%|█▏        | 42806/371472 [3:24:42<26:16:29,  3.47it/s]
 12%|█▏        | 42807/371472 [3:24:42<25:17:30,  3.61it/s]
 12%|█▏        | 42808/371472 [3:24:42<24:26:31,  3.74it/s]
 12%|█▏        | 42809/371472 [3:24:42<24:06:14,  3.79it/s]
 12%|█▏        | 42810/371472 [3:24:43<23:24:02,  3.90it/s]
 12%|█▏        | 42811/371472 [3:24:43<26:24:07,  3.46it/s]
 12%|█▏        | 42812/371472 [3:24:43<27:04:39,  3.37it/s]
 12%|█▏        | 42813/371472 [3:24:44<26:52:34,  3.40it/s]
 12%|█▏        | 42814/371472 [3:24:44<26:36:25,  3.43it/s]
 12%|█▏        | 42815/371472 [3:24:44<26:08:33,  3.49it/s]
 12%|█▏        | 42816/371472 [3:24:44<25:32:30,  3.57it/s]
 12%|█▏        | 42817/371472 [3:24:45<25:12:04,  3.62it/s]
 12%|█▏        | 42818/371472 [3:24:45<25:11:19,  3.62it/s]
 12%|█▏        | 42819/371472 [3:24:45<28:08:02,  3.24it/s]
 12%|█▏        | 42820/371472 [3:24:46<30:06:58,  3.03it/s]
                                                           
{'loss': 4.2573, 'learning_rate': 8.966849102544765e-07, 'epoch': 1.84}

 12%|█▏        | 42820/371472 [3:24:46<30:06:58,  3.03it/s]
 12%|█▏        | 42821/371472 [3:24:46<29:47:14,  3.06it/s]
 12%|█▏        | 42822/371472 [3:24:46<28:09:59,  3.24it/s]
 12%|█▏        | 42823/371472 [3:24:47<28:05:30,  3.25it/s]
 12%|█▏        | 42824/371472 [3:24:47<31:41:03,  2.88it/s]
 12%|█▏        | 42825/371472 [3:24:47<29:04:48,  3.14it/s]
 12%|█▏        | 42826/371472 [3:24:48<27:53:11,  3.27it/s]
 12%|█▏        | 42827/371472 [3:24:48<26:37:01,  3.43it/s]
 12%|█▏        | 42828/371472 [3:24:48<25:49:00,  3.54it/s]
 12%|█▏        | 42829/371472 [3:24:48<26:17:29,  3.47it/s]
 12%|█▏        | 42830/371472 [3:24:49<25:35:00,  3.57it/s]
 12%|█▏        | 42831/371472 [3:24:49<24:36:26,  3.71it/s]
 12%|█▏        | 42832/371472 [3:24:49<24:07:45,  3.78it/s]
 12%|█▏        | 42833/371472 [3:24:49<24:38:14,  3.71it/s]
 12%|█▏        | 42834/371472 [3:24:50<24:28:13,  3.73it/s]
 12%|█▏        | 42835/371472 [3:24:50<25:13:48,  3.62it/s]
 12%|█▏        | 42836/371472 [3:24:50<24:37:01,  3.71it/s]
 12%|█▏        | 42837/371472 [3:24:51<24:51:47,  3.67it/s]
 12%|█▏        | 42838/371472 [3:24:51<24:49:24,  3.68it/s]
 12%|█▏        | 42839/371472 [3:24:51<24:39:05,  3.70it/s]
 12%|█▏        | 42840/371472 [3:24:51<24:50:08,  3.68it/s]
                                                           
{'loss': 4.205, 'learning_rate': 8.966364282789975e-07, 'epoch': 1.85}

 12%|█▏        | 42840/371472 [3:24:51<24:50:08,  3.68it/s]
 12%|█▏        | 42841/371472 [3:24:52<25:08:35,  3.63it/s]
 12%|█▏        | 42842/371472 [3:24:52<25:55:53,  3.52it/s]
 12%|█▏        | 42843/371472 [3:24:52<25:39:32,  3.56it/s]
 12%|█▏        | 42844/371472 [3:24:53<25:06:12,  3.64it/s]
 12%|█▏        | 42845/371472 [3:24:53<26:38:28,  3.43it/s]
 12%|█▏        | 42846/371472 [3:24:53<25:47:28,  3.54it/s]
 12%|█▏        | 42847/371472 [3:24:53<26:02:51,  3.50it/s]
 12%|█▏        | 42848/371472 [3:24:54<25:44:53,  3.55it/s]
 12%|█▏        | 42849/371472 [3:24:54<26:28:27,  3.45it/s]
 12%|█▏        | 42850/371472 [3:24:54<25:19:22,  3.60it/s]
 12%|█▏        | 42851/371472 [3:24:54<24:46:40,  3.68it/s]
 12%|█▏        | 42852/371472 [3:24:55<24:35:21,  3.71it/s]
 12%|█▏        | 42853/371472 [3:24:55<24:27:16,  3.73it/s]
 12%|█▏        | 42854/371472 [3:24:55<25:48:11,  3.54it/s]
 12%|█▏        | 42855/371472 [3:24:56<27:11:49,  3.36it/s]
 12%|█▏        | 42856/371472 [3:24:56<26:05:35,  3.50it/s]
 12%|█▏        | 42857/371472 [3:24:56<25:46:09,  3.54it/s]
 12%|█▏        | 42858/371472 [3:24:57<26:22:41,  3.46it/s]
 12%|█▏        | 42859/371472 [3:24:57<25:49:24,  3.53it/s]
 12%|█▏        | 42860/371472 [3:24:57<26:01:21,  3.51it/s]
                                                           
{'loss': 4.5753, 'learning_rate': 8.965879463035187e-07, 'epoch': 1.85}

 12%|█▏        | 42860/371472 [3:24:57<26:01:21,  3.51it/s]
 12%|█▏        | 42861/371472 [3:24:57<27:26:15,  3.33it/s]
 12%|█▏        | 42862/371472 [3:24:58<26:07:17,  3.49it/s]
 12%|█▏        | 42863/371472 [3:24:58<25:28:42,  3.58it/s]
 12%|█▏        | 42864/371472 [3:24:58<26:30:20,  3.44it/s]
 12%|█▏        | 42865/371472 [3:24:59<26:36:28,  3.43it/s]
 12%|█▏        | 42866/371472 [3:24:59<25:42:49,  3.55it/s]
 12%|█▏        | 42867/371472 [3:24:59<25:56:10,  3.52it/s]
 12%|█▏        | 42868/371472 [3:24:59<26:01:50,  3.51it/s]
 12%|█▏        | 42869/371472 [3:25:00<25:29:40,  3.58it/s]
 12%|█▏        | 42870/371472 [3:25:00<25:48:38,  3.54it/s]
 12%|█▏        | 42871/371472 [3:25:00<28:19:37,  3.22it/s]
 12%|█▏        | 42872/371472 [3:25:01<30:48:55,  2.96it/s]
 12%|█▏        | 42873/371472 [3:25:01<30:31:17,  2.99it/s]
 12%|█▏        | 42874/371472 [3:25:01<29:06:49,  3.14it/s]
 12%|█▏        | 42875/371472 [3:25:02<27:43:27,  3.29it/s]
 12%|█▏        | 42876/371472 [3:25:02<26:39:32,  3.42it/s]
 12%|█▏        | 42877/371472 [3:25:02<26:07:50,  3.49it/s]
 12%|█▏        | 42878/371472 [3:25:02<25:20:25,  3.60it/s]
 12%|█▏        | 42879/371472 [3:25:03<25:26:51,  3.59it/s]
 12%|█▏        | 42880/371472 [3:25:03<25:00:28,  3.65it/s]
                                                           
{'loss': 4.2849, 'learning_rate': 8.965394643280399e-07, 'epoch': 1.85}

 12%|█▏        | 42880/371472 [3:25:03<25:00:28,  3.65it/s]
 12%|█▏        | 42881/371472 [3:25:03<24:46:36,  3.68it/s]
 12%|█▏        | 42882/371472 [3:25:03<25:07:09,  3.63it/s]
 12%|█▏        | 42883/371472 [3:25:04<24:09:26,  3.78it/s]
 12%|█▏        | 42884/371472 [3:25:04<26:55:05,  3.39it/s]
 12%|█▏        | 42885/371472 [3:25:04<26:41:34,  3.42it/s]
 12%|█▏        | 42886/371472 [3:25:05<26:15:54,  3.48it/s]
 12%|█▏        | 42887/371472 [3:25:05<25:13:06,  3.62it/s]
 12%|█▏        | 42888/371472 [3:25:05<26:21:46,  3.46it/s]
 12%|█▏        | 42889/371472 [3:25:06<27:11:56,  3.36it/s]
 12%|█▏        | 42890/371472 [3:25:06<27:56:01,  3.27it/s]
 12%|█▏        | 42891/371472 [3:25:06<27:39:56,  3.30it/s]
 12%|█▏        | 42892/371472 [3:25:06<27:00:45,  3.38it/s]
 12%|█▏        | 42893/371472 [3:25:07<25:54:52,  3.52it/s]
 12%|█▏        | 42894/371472 [3:25:07<27:30:48,  3.32it/s]
 12%|█▏        | 42895/371472 [3:25:07<27:36:55,  3.31it/s]
 12%|█▏        | 42896/371472 [3:25:08<26:14:37,  3.48it/s]
 12%|█▏        | 42897/371472 [3:25:08<25:55:00,  3.52it/s]
 12%|█▏        | 42898/371472 [3:25:08<26:36:00,  3.43it/s]
 12%|█▏        | 42899/371472 [3:25:08<27:15:02,  3.35it/s]
 12%|█▏        | 42900/371472 [3:25:09<26:18:09,  3.47it/s]
                                                           
{'loss': 4.4319, 'learning_rate': 8.964909823525609e-07, 'epoch': 1.85}

 12%|█▏        | 42900/371472 [3:25:09<26:18:09,  3.47it/s]
 12%|█▏        | 42901/371472 [3:25:09<26:29:42,  3.44it/s]
 12%|█▏        | 42902/371472 [3:25:09<27:42:26,  3.29it/s]
 12%|█▏        | 42903/371472 [3:25:10<26:26:34,  3.45it/s]
 12%|█▏        | 42904/371472 [3:25:10<25:43:48,  3.55it/s]
 12%|█▏        | 42905/371472 [3:25:10<26:03:42,  3.50it/s]
 12%|█▏        | 42906/371472 [3:25:11<27:09:00,  3.36it/s]
 12%|█▏        | 42907/371472 [3:25:11<26:44:27,  3.41it/s]
 12%|█▏        | 42908/371472 [3:25:11<26:30:56,  3.44it/s]
 12%|█▏        | 42909/371472 [3:25:11<26:32:10,  3.44it/s]
 12%|█▏        | 42910/371472 [3:25:12<25:32:54,  3.57it/s]
 12%|█▏        | 42911/371472 [3:25:12<24:46:46,  3.68it/s]
 12%|█▏        | 42912/371472 [3:25:12<28:23:29,  3.21it/s]
 12%|█▏        | 42913/371472 [3:25:13<27:47:43,  3.28it/s]
 12%|█▏        | 42914/371472 [3:25:13<26:59:21,  3.38it/s]
 12%|█▏        | 42915/371472 [3:25:13<27:27:42,  3.32it/s]
 12%|█▏        | 42916/371472 [3:25:13<26:31:37,  3.44it/s]
 12%|█▏        | 42917/371472 [3:25:14<25:21:39,  3.60it/s]
 12%|█▏        | 42918/371472 [3:25:14<24:57:23,  3.66it/s]
 12%|█▏        | 42919/371472 [3:25:14<27:18:01,  3.34it/s]
 12%|█▏        | 42920/371472 [3:25:15<26:04:28,  3.50it/s]
                                                           
{'loss': 4.4898, 'learning_rate': 8.964425003770819e-07, 'epoch': 1.85}

 12%|█▏        | 42920/371472 [3:25:15<26:04:28,  3.50it/s]
 12%|█▏        | 42921/371472 [3:25:15<24:59:55,  3.65it/s]
 12%|█▏        | 42922/371472 [3:25:15<25:46:20,  3.54it/s]
 12%|█▏        | 42923/371472 [3:25:15<25:50:52,  3.53it/s]
 12%|█▏        | 42924/371472 [3:25:16<26:13:57,  3.48it/s]
 12%|█▏        | 42925/371472 [3:25:16<25:26:18,  3.59it/s]
 12%|█▏        | 42926/371472 [3:25:16<25:08:47,  3.63it/s]
 12%|█▏        | 42927/371472 [3:25:16<25:25:51,  3.59it/s]
 12%|█▏        | 42928/371472 [3:25:17<24:48:21,  3.68it/s]
 12%|█▏        | 42929/371472 [3:25:17<24:50:07,  3.67it/s]
 12%|█▏        | 42930/371472 [3:25:17<24:23:42,  3.74it/s]
 12%|█▏        | 42931/371472 [3:25:18<24:52:31,  3.67it/s]
 12%|█▏        | 42932/371472 [3:25:18<26:24:21,  3.46it/s]
 12%|█▏        | 42933/371472 [3:25:18<25:58:17,  3.51it/s]
 12%|█▏        | 42934/371472 [3:25:18<25:37:05,  3.56it/s]
 12%|█▏        | 42935/371472 [3:25:19<25:38:55,  3.56it/s]
 12%|█▏        | 42936/371472 [3:25:19<26:05:06,  3.50it/s]
 12%|█▏        | 42937/371472 [3:25:19<26:07:52,  3.49it/s]
 12%|█▏        | 42938/371472 [3:25:20<25:41:56,  3.55it/s]
 12%|█▏        | 42939/371472 [3:25:20<25:03:51,  3.64it/s]
 12%|█▏        | 42940/371472 [3:25:20<24:30:53,  3.72it/s]
                                                           
{'loss': 4.393, 'learning_rate': 8.963940184016031e-07, 'epoch': 1.85}

 12%|█▏        | 42940/371472 [3:25:20<24:30:53,  3.72it/s]
 12%|█▏        | 42941/371472 [3:25:21<32:43:13,  2.79it/s]
 12%|█▏        | 42942/371472 [3:25:21<31:48:10,  2.87it/s]
 12%|█▏        | 42943/371472 [3:25:21<29:11:32,  3.13it/s]
 12%|█▏        | 42944/371472 [3:25:22<28:27:16,  3.21it/s]
 12%|█▏        | 42945/371472 [3:25:22<30:22:55,  3.00it/s]
 12%|█▏        | 42946/371472 [3:25:22<28:59:06,  3.15it/s]
 12%|█▏        | 42947/371472 [3:25:22<27:24:38,  3.33it/s]
 12%|█▏        | 42948/371472 [3:25:23<26:16:04,  3.47it/s]
 12%|█▏        | 42949/371472 [3:25:23<25:15:34,  3.61it/s]
 12%|█▏        | 42950/371472 [3:25:23<25:43:02,  3.55it/s]
 12%|█▏        | 42951/371472 [3:25:24<25:09:38,  3.63it/s]
 12%|█▏        | 42952/371472 [3:25:24<27:00:56,  3.38it/s]
 12%|█▏        | 42953/371472 [3:25:24<25:53:46,  3.52it/s]
 12%|█▏        | 42954/371472 [3:25:24<25:44:52,  3.54it/s]
 12%|█▏        | 42955/371472 [3:25:25<25:26:41,  3.59it/s]
 12%|█▏        | 42956/371472 [3:25:25<26:10:20,  3.49it/s]
 12%|█▏        | 42957/371472 [3:25:25<25:27:47,  3.58it/s]
 12%|█▏        | 42958/371472 [3:25:25<24:42:44,  3.69it/s]
 12%|█▏        | 42959/371472 [3:25:26<24:32:01,  3.72it/s]
 12%|█▏        | 42960/371472 [3:25:26<24:30:42,  3.72it/s]
                                                           
{'loss': 4.3307, 'learning_rate': 8.963455364261242e-07, 'epoch': 1.85}

 12%|█▏        | 42960/371472 [3:25:26<24:30:42,  3.72it/s]
 12%|█▏        | 42961/371472 [3:25:26<24:30:17,  3.72it/s]
 12%|█▏        | 42962/371472 [3:25:27<24:24:45,  3.74it/s]
 12%|█▏        | 42963/371472 [3:25:27<24:25:15,  3.74it/s]
 12%|█▏        | 42964/371472 [3:25:27<24:11:33,  3.77it/s]
 12%|█▏        | 42965/371472 [3:25:27<25:14:04,  3.62it/s]
 12%|█▏        | 42966/371472 [3:25:28<25:09:16,  3.63it/s]
 12%|█▏        | 42967/371472 [3:25:28<24:36:47,  3.71it/s]
 12%|█▏        | 42968/371472 [3:25:28<24:44:28,  3.69it/s]
 12%|█▏        | 42969/371472 [3:25:28<25:09:09,  3.63it/s]
 12%|█▏        | 42970/371472 [3:25:29<25:19:26,  3.60it/s]
 12%|█▏        | 42971/371472 [3:25:29<25:07:09,  3.63it/s]
 12%|█▏        | 42972/371472 [3:25:29<25:42:54,  3.55it/s]
 12%|█▏        | 42973/371472 [3:25:30<24:51:18,  3.67it/s]
 12%|█▏        | 42974/371472 [3:25:30<26:03:16,  3.50it/s]
 12%|█▏        | 42975/371472 [3:25:30<25:55:34,  3.52it/s]
 12%|█▏        | 42976/371472 [3:25:30<25:00:03,  3.65it/s]
 12%|█▏        | 42977/371472 [3:25:31<25:29:23,  3.58it/s]
 12%|█▏        | 42978/371472 [3:25:31<26:51:47,  3.40it/s]
 12%|█▏        | 42979/371472 [3:25:31<25:38:57,  3.56it/s]
 12%|█▏        | 42980/371472 [3:25:32<25:57:04,  3.52it/s]
                                                           
{'loss': 4.2222, 'learning_rate': 8.962970544506454e-07, 'epoch': 1.85}

 12%|█▏        | 42980/371472 [3:25:32<25:57:04,  3.52it/s]
 12%|█▏        | 42981/371472 [3:25:32<27:20:52,  3.34it/s]
 12%|█▏        | 42982/371472 [3:25:32<26:19:31,  3.47it/s]
 12%|█▏        | 42983/371472 [3:25:32<26:17:32,  3.47it/s]
 12%|█▏        | 42984/371472 [3:25:33<25:28:57,  3.58it/s]
 12%|█▏        | 42985/371472 [3:25:33<25:57:33,  3.51it/s]
 12%|█▏        | 42986/371472 [3:25:33<25:05:14,  3.64it/s]
 12%|█▏        | 42987/371472 [3:25:34<25:27:17,  3.58it/s]
 12%|█▏        | 42988/371472 [3:25:34<26:08:34,  3.49it/s]
 12%|█▏        | 42989/371472 [3:25:34<25:37:16,  3.56it/s]
 12%|█▏        | 42990/371472 [3:25:34<25:09:33,  3.63it/s]
 12%|█▏        | 42991/371472 [3:25:35<24:36:07,  3.71it/s]
 12%|█▏        | 42992/371472 [3:25:35<24:43:02,  3.69it/s]
 12%|█▏        | 42993/371472 [3:25:35<24:36:03,  3.71it/s]
 12%|█▏        | 42994/371472 [3:25:35<24:27:15,  3.73it/s]
 12%|█▏        | 42995/371472 [3:25:36<25:39:28,  3.56it/s]
 12%|█▏        | 42996/371472 [3:25:36<26:10:21,  3.49it/s]
 12%|█▏        | 42997/371472 [3:25:36<25:44:06,  3.55it/s]
 12%|█▏        | 42998/371472 [3:25:37<26:57:36,  3.38it/s]
 12%|█▏        | 42999/371472 [3:25:37<26:51:40,  3.40it/s]
 12%|█▏        | 43000/371472 [3:25:37<25:57:39,  3.51it/s]
                                                           
{'loss': 4.3846, 'learning_rate': 8.962485724751664e-07, 'epoch': 1.85}

 12%|█▏        | 43000/371472 [3:25:37<25:57:39,  3.51it/s]
 12%|█▏        | 43001/371472 [3:25:37<25:11:51,  3.62it/s]
 12%|█▏        | 43002/371472 [3:25:38<24:10:23,  3.77it/s]
 12%|█▏        | 43003/371472 [3:25:38<23:51:34,  3.82it/s]
 12%|█▏        | 43004/371472 [3:25:38<25:33:23,  3.57it/s]
 12%|█▏        | 43005/371472 [3:25:39<24:36:06,  3.71it/s]
 12%|█▏        | 43006/371472 [3:25:39<25:31:44,  3.57it/s]
 12%|█▏        | 43007/371472 [3:25:39<26:27:15,  3.45it/s]
 12%|█▏        | 43008/371472 [3:25:39<26:37:43,  3.43it/s]
 12%|█▏        | 43009/371472 [3:25:40<26:15:33,  3.47it/s]
 12%|█▏        | 43010/371472 [3:25:40<26:20:33,  3.46it/s]
 12%|█▏        | 43011/371472 [3:25:40<26:28:07,  3.45it/s]
 12%|█▏        | 43012/371472 [3:25:41<25:44:01,  3.55it/s]
 12%|█▏        | 43013/371472 [3:25:41<25:29:16,  3.58it/s]
 12%|█▏        | 43014/371472 [3:25:41<25:12:20,  3.62it/s]
 12%|█▏        | 43015/371472 [3:25:41<24:54:21,  3.66it/s]
 12%|█▏        | 43016/371472 [3:25:42<24:49:27,  3.68it/s]
 12%|█▏        | 43017/371472 [3:25:42<25:06:05,  3.63it/s]
 12%|█▏        | 43018/371472 [3:25:42<24:17:04,  3.76it/s]
 12%|█▏        | 43019/371472 [3:25:42<25:10:07,  3.63it/s]
 12%|█▏        | 43020/371472 [3:25:43<25:01:41,  3.65it/s]
                                                           
{'loss': 4.2039, 'learning_rate': 8.962000904996875e-07, 'epoch': 1.85}

 12%|█▏        | 43020/371472 [3:25:43<25:01:41,  3.65it/s]
 12%|█▏        | 43021/371472 [3:25:43<28:12:56,  3.23it/s]
 12%|█▏        | 43022/371472 [3:25:43<28:22:35,  3.22it/s]
 12%|█▏        | 43023/371472 [3:25:44<27:41:52,  3.29it/s]
 12%|█▏        | 43024/371472 [3:25:44<26:00:47,  3.51it/s]
 12%|█▏        | 43025/371472 [3:25:44<26:06:10,  3.50it/s]
 12%|█▏        | 43026/371472 [3:25:45<25:58:12,  3.51it/s]
 12%|█▏        | 43027/371472 [3:25:45<25:53:35,  3.52it/s]
 12%|█▏        | 43028/371472 [3:25:45<24:58:54,  3.65it/s]
 12%|█▏        | 43029/371472 [3:25:45<24:21:35,  3.75it/s]
 12%|█▏        | 43030/371472 [3:25:46<24:39:51,  3.70it/s]
 12%|█▏        | 43031/371472 [3:25:46<25:28:43,  3.58it/s]
 12%|█▏        | 43032/371472 [3:25:46<24:50:41,  3.67it/s]
 12%|█▏        | 43033/371472 [3:25:46<24:24:13,  3.74it/s]
 12%|█▏        | 43034/371472 [3:25:47<24:18:04,  3.75it/s]
 12%|█▏        | 43035/371472 [3:25:47<25:11:17,  3.62it/s]
 12%|█▏        | 43036/371472 [3:25:47<25:00:07,  3.65it/s]
 12%|█▏        | 43037/371472 [3:25:48<25:19:42,  3.60it/s]
 12%|█▏        | 43038/371472 [3:25:48<24:35:53,  3.71it/s]
 12%|█▏        | 43039/371472 [3:25:48<24:35:35,  3.71it/s]
 12%|█▏        | 43040/371472 [3:25:48<28:02:43,  3.25it/s]
                                                           
{'loss': 4.3454, 'learning_rate': 8.961516085242086e-07, 'epoch': 1.85}

 12%|█▏        | 43040/371472 [3:25:48<28:02:43,  3.25it/s]
 12%|█▏        | 43041/371472 [3:25:49<27:59:56,  3.26it/s]
 12%|█▏        | 43042/371472 [3:25:49<27:59:00,  3.26it/s]
 12%|█▏        | 43043/371472 [3:25:49<26:59:15,  3.38it/s]
 12%|█▏        | 43044/371472 [3:25:50<28:55:53,  3.15it/s]
 12%|█▏        | 43045/371472 [3:25:50<27:09:53,  3.36it/s]
 12%|█▏        | 43046/371472 [3:25:50<26:10:15,  3.49it/s]
 12%|█▏        | 43047/371472 [3:25:50<25:22:50,  3.59it/s]
 12%|█▏        | 43048/371472 [3:25:51<26:16:40,  3.47it/s]
 12%|█▏        | 43049/371472 [3:25:51<26:00:48,  3.51it/s]
 12%|█▏        | 43050/371472 [3:25:51<25:46:23,  3.54it/s]
 12%|█▏        | 43051/371472 [3:25:52<25:38:03,  3.56it/s]
 12%|█▏        | 43052/371472 [3:25:52<25:00:45,  3.65it/s]
 12%|█▏        | 43053/371472 [3:25:52<24:42:16,  3.69it/s]
 12%|█▏        | 43054/371472 [3:25:52<24:36:40,  3.71it/s]
 12%|█▏        | 43055/371472 [3:25:53<28:41:29,  3.18it/s]
 12%|█▏        | 43056/371472 [3:25:53<27:40:03,  3.30it/s]
 12%|█▏        | 43057/371472 [3:25:53<28:13:28,  3.23it/s]
 12%|█▏        | 43058/371472 [3:25:54<26:50:19,  3.40it/s]
 12%|█▏        | 43059/371472 [3:25:54<26:21:16,  3.46it/s]
 12%|█▏        | 43060/371472 [3:25:54<25:23:02,  3.59it/s]
                                                           
{'loss': 4.3098, 'learning_rate': 8.961031265487297e-07, 'epoch': 1.85}

 12%|█▏        | 43060/371472 [3:25:54<25:23:02,  3.59it/s]
 12%|█▏        | 43061/371472 [3:25:55<25:39:19,  3.56it/s]
 12%|█▏        | 43062/371472 [3:25:55<25:12:26,  3.62it/s]
 12%|█▏        | 43063/371472 [3:25:55<24:09:26,  3.78it/s]
 12%|█▏        | 43064/371472 [3:25:55<24:58:43,  3.65it/s]
 12%|█▏        | 43065/371472 [3:25:56<25:25:50,  3.59it/s]
 12%|█▏        | 43066/371472 [3:25:56<24:58:13,  3.65it/s]
 12%|█▏        | 43067/371472 [3:25:56<25:43:54,  3.55it/s]
 12%|█▏        | 43068/371472 [3:25:56<26:48:21,  3.40it/s]
 12%|█▏        | 43069/371472 [3:25:57<28:35:58,  3.19it/s]
 12%|█▏        | 43070/371472 [3:25:57<27:21:11,  3.33it/s]
 12%|█▏        | 43071/371472 [3:25:57<26:17:37,  3.47it/s]
 12%|█▏        | 43072/371472 [3:25:58<30:54:40,  2.95it/s]
 12%|█▏        | 43073/371472 [3:25:58<28:44:29,  3.17it/s]
 12%|█▏        | 43074/371472 [3:25:58<28:02:10,  3.25it/s]
 12%|█▏        | 43075/371472 [3:25:59<27:23:58,  3.33it/s]
 12%|█▏        | 43076/371472 [3:25:59<26:35:03,  3.43it/s]
 12%|█▏        | 43077/371472 [3:25:59<26:28:41,  3.45it/s]
 12%|█▏        | 43078/371472 [3:25:59<25:55:47,  3.52it/s]
 12%|█▏        | 43079/371472 [3:26:00<27:21:18,  3.33it/s]
 12%|█▏        | 43080/371472 [3:26:00<29:08:42,  3.13it/s]
                                                           
{'loss': 4.3761, 'learning_rate': 8.960546445732508e-07, 'epoch': 1.86}

 12%|█▏        | 43080/371472 [3:26:00<29:08:42,  3.13it/s]
 12%|█▏        | 43081/371472 [3:26:00<27:42:16,  3.29it/s]
 12%|█▏        | 43082/371472 [3:26:01<26:48:10,  3.40it/s]
 12%|█▏        | 43083/371472 [3:26:01<27:07:57,  3.36it/s]
 12%|█▏        | 43084/371472 [3:26:01<25:45:37,  3.54it/s]
 12%|█▏        | 43085/371472 [3:26:02<28:31:12,  3.20it/s]
 12%|█▏        | 43086/371472 [3:26:02<27:51:04,  3.28it/s]
 12%|█▏        | 43087/371472 [3:26:02<26:52:46,  3.39it/s]
 12%|█▏        | 43088/371472 [3:26:02<25:50:44,  3.53it/s]
 12%|█▏        | 43089/371472 [3:26:03<25:04:30,  3.64it/s]
 12%|█▏        | 43090/371472 [3:26:03<26:34:28,  3.43it/s]
 12%|█▏        | 43091/371472 [3:26:03<26:25:16,  3.45it/s]
 12%|█▏        | 43092/371472 [3:26:04<27:03:42,  3.37it/s]
 12%|█▏        | 43093/371472 [3:26:04<27:55:13,  3.27it/s]
 12%|█▏        | 43094/371472 [3:26:04<26:15:39,  3.47it/s]
 12%|█▏        | 43095/371472 [3:26:05<25:30:16,  3.58it/s]
 12%|█▏        | 43096/371472 [3:26:05<26:04:48,  3.50it/s]
 12%|█▏        | 43097/371472 [3:26:05<25:14:28,  3.61it/s]
 12%|█▏        | 43098/371472 [3:26:05<26:09:32,  3.49it/s]
 12%|█▏        | 43099/371472 [3:26:06<25:44:17,  3.54it/s]
 12%|█▏        | 43100/371472 [3:26:06<26:02:58,  3.50it/s]
                                                           
{'loss': 4.3821, 'learning_rate': 8.96006162597772e-07, 'epoch': 1.86}

 12%|█▏        | 43100/371472 [3:26:06<26:02:58,  3.50it/s]
 12%|█▏        | 43101/371472 [3:26:06<26:21:27,  3.46it/s]
 12%|█▏        | 43102/371472 [3:26:06<25:41:53,  3.55it/s]
 12%|█▏        | 43103/371472 [3:26:07<26:35:56,  3.43it/s]
 12%|█▏        | 43104/371472 [3:26:07<26:53:50,  3.39it/s]
 12%|█▏        | 43105/371472 [3:26:07<25:58:56,  3.51it/s]
 12%|█▏        | 43106/371472 [3:26:08<26:46:42,  3.41it/s]
 12%|█▏        | 43107/371472 [3:26:08<26:24:07,  3.45it/s]
 12%|█▏        | 43108/371472 [3:26:08<26:37:53,  3.42it/s]
 12%|█▏        | 43109/371472 [3:26:09<25:57:06,  3.51it/s]
 12%|█▏        | 43110/371472 [3:26:09<25:02:14,  3.64it/s]
 12%|█▏        | 43111/371472 [3:26:09<24:06:07,  3.78it/s]
 12%|█▏        | 43112/371472 [3:26:09<25:24:13,  3.59it/s]
 12%|█▏        | 43113/371472 [3:26:10<24:56:05,  3.66it/s]
 12%|█▏        | 43114/371472 [3:26:10<24:37:24,  3.70it/s]
 12%|█▏        | 43115/371472 [3:26:10<26:31:59,  3.44it/s]
 12%|█▏        | 43116/371472 [3:26:11<27:10:30,  3.36it/s]
 12%|█▏        | 43117/371472 [3:26:11<26:07:14,  3.49it/s]
 12%|█▏        | 43118/371472 [3:26:11<25:50:56,  3.53it/s]
 12%|█▏        | 43119/371472 [3:26:11<25:12:16,  3.62it/s]
 12%|█▏        | 43120/371472 [3:26:12<25:25:35,  3.59it/s]
                                                           
{'loss': 4.3961, 'learning_rate': 8.959576806222931e-07, 'epoch': 1.86}

 12%|█▏        | 43120/371472 [3:26:12<25:25:35,  3.59it/s]
 12%|█▏        | 43121/371472 [3:26:12<25:57:43,  3.51it/s]
 12%|█▏        | 43122/371472 [3:26:12<26:03:34,  3.50it/s]
 12%|█▏        | 43123/371472 [3:26:12<25:44:57,  3.54it/s]
 12%|█▏        | 43124/371472 [3:26:13<24:38:25,  3.70it/s]
 12%|█▏        | 43125/371472 [3:26:13<24:31:59,  3.72it/s]
 12%|█▏        | 43126/371472 [3:26:13<24:28:02,  3.73it/s]
 12%|█▏        | 43127/371472 [3:26:14<24:35:41,  3.71it/s]
 12%|█▏        | 43128/371472 [3:26:14<24:49:46,  3.67it/s]
 12%|█▏        | 43129/371472 [3:26:14<23:58:35,  3.80it/s]
 12%|█▏        | 43130/371472 [3:26:14<24:00:32,  3.80it/s]
 12%|█▏        | 43131/371472 [3:26:15<24:36:17,  3.71it/s]
 12%|█▏        | 43132/371472 [3:26:15<25:10:22,  3.62it/s]
 12%|█▏        | 43133/371472 [3:26:15<26:06:23,  3.49it/s]
 12%|█▏        | 43134/371472 [3:26:16<31:14:31,  2.92it/s]
 12%|█▏        | 43135/371472 [3:26:16<29:28:17,  3.09it/s]
 12%|█▏        | 43136/371472 [3:26:16<29:45:32,  3.06it/s]
 12%|█▏        | 43137/371472 [3:26:17<28:38:21,  3.18it/s]
 12%|█▏        | 43138/371472 [3:26:17<30:19:01,  3.01it/s]
 12%|█▏        | 43139/371472 [3:26:17<28:37:42,  3.19it/s]
 12%|█▏        | 43140/371472 [3:26:17<27:42:37,  3.29it/s]
                                                           
{'loss': 4.1976, 'learning_rate': 8.959091986468141e-07, 'epoch': 1.86}

 12%|█▏        | 43140/371472 [3:26:17<27:42:37,  3.29it/s]
 12%|█▏        | 43141/371472 [3:26:18<27:15:32,  3.35it/s]
 12%|█▏        | 43142/371472 [3:26:18<25:59:10,  3.51it/s]
 12%|█▏        | 43143/371472 [3:26:18<26:23:53,  3.45it/s]
 12%|█▏        | 43144/371472 [3:26:19<28:57:34,  3.15it/s]
 12%|█▏        | 43145/371472 [3:26:19<28:33:41,  3.19it/s]
 12%|█▏        | 43146/371472 [3:26:19<26:55:36,  3.39it/s]
 12%|█▏        | 43147/371472 [3:26:20<26:05:12,  3.50it/s]
 12%|█▏        | 43148/371472 [3:26:20<25:54:38,  3.52it/s]
 12%|█▏        | 43149/371472 [3:26:20<25:24:44,  3.59it/s]
 12%|█▏        | 43150/371472 [3:26:20<28:18:34,  3.22it/s]
 12%|█▏        | 43151/371472 [3:26:21<27:43:00,  3.29it/s]
 12%|█▏        | 43152/371472 [3:26:21<26:56:32,  3.39it/s]
 12%|█▏        | 43153/371472 [3:26:21<25:36:03,  3.56it/s]
 12%|█▏        | 43154/371472 [3:26:22<27:38:38,  3.30it/s]
 12%|█▏        | 43155/371472 [3:26:22<27:23:44,  3.33it/s]
 12%|█▏        | 43156/371472 [3:26:22<27:02:58,  3.37it/s]
 12%|█▏        | 43157/371472 [3:26:22<25:52:02,  3.53it/s]
 12%|█▏        | 43158/371472 [3:26:23<25:04:58,  3.64it/s]
 12%|█▏        | 43159/371472 [3:26:23<24:52:53,  3.67it/s]
 12%|█▏        | 43160/371472 [3:26:23<24:24:30,  3.74it/s]
                                                           
{'loss': 4.2587, 'learning_rate': 8.958607166713352e-07, 'epoch': 1.86}

 12%|█▏        | 43160/371472 [3:26:23<24:24:30,  3.74it/s]
 12%|█▏        | 43161/371472 [3:26:24<26:00:02,  3.51it/s]
 12%|█▏        | 43162/371472 [3:26:24<25:30:20,  3.58it/s]
 12%|█▏        | 43163/371472 [3:26:24<24:38:49,  3.70it/s]
 12%|█▏        | 43164/371472 [3:26:24<23:56:32,  3.81it/s]
 12%|█▏        | 43165/371472 [3:26:25<26:15:41,  3.47it/s]
 12%|█▏        | 43166/371472 [3:26:25<27:53:11,  3.27it/s]
 12%|█▏        | 43167/371472 [3:26:25<28:02:11,  3.25it/s]
 12%|█▏        | 43168/371472 [3:26:26<29:14:24,  3.12it/s]
 12%|█▏        | 43169/371472 [3:26:26<29:00:12,  3.14it/s]
 12%|█▏        | 43170/371472 [3:26:26<27:47:34,  3.28it/s]
 12%|█▏        | 43171/371472 [3:26:27<29:10:44,  3.13it/s]
 12%|█▏        | 43172/371472 [3:26:27<29:46:48,  3.06it/s]
 12%|█▏        | 43173/371472 [3:26:27<27:38:41,  3.30it/s]
 12%|█▏        | 43174/371472 [3:26:28<28:46:44,  3.17it/s]
 12%|█▏        | 43175/371472 [3:26:28<27:26:09,  3.32it/s]
 12%|█▏        | 43176/371472 [3:26:28<28:35:31,  3.19it/s]
 12%|█▏        | 43177/371472 [3:26:28<28:18:07,  3.22it/s]
 12%|█▏        | 43178/371472 [3:26:29<26:51:30,  3.40it/s]
 12%|█▏        | 43179/371472 [3:26:29<27:40:32,  3.30it/s]
 12%|█▏        | 43180/371472 [3:26:29<26:52:15,  3.39it/s]
                                                           
{'loss': 4.3849, 'learning_rate': 8.958122346958564e-07, 'epoch': 1.86}

 12%|█▏        | 43180/371472 [3:26:29<26:52:15,  3.39it/s]
 12%|█▏        | 43181/371472 [3:26:30<25:52:21,  3.52it/s]
 12%|█▏        | 43182/371472 [3:26:30<24:58:15,  3.65it/s]
 12%|█▏        | 43183/371472 [3:26:30<24:31:26,  3.72it/s]
 12%|█▏        | 43184/371472 [3:26:30<24:28:14,  3.73it/s]
 12%|█▏        | 43185/371472 [3:26:31<25:04:29,  3.64it/s]
 12%|█▏        | 43186/371472 [3:26:31<28:40:22,  3.18it/s]
 12%|█▏        | 43187/371472 [3:26:31<27:31:00,  3.31it/s]
 12%|█▏        | 43188/371472 [3:26:32<27:17:30,  3.34it/s]
 12%|█▏        | 43189/371472 [3:26:32<27:02:30,  3.37it/s]
 12%|█▏        | 43190/371472 [3:26:32<26:24:16,  3.45it/s]
 12%|█▏        | 43191/371472 [3:26:33<27:48:34,  3.28it/s]
 12%|█▏        | 43192/371472 [3:26:33<26:34:24,  3.43it/s]
 12%|█▏        | 43193/371472 [3:26:33<25:28:00,  3.58it/s]
 12%|█▏        | 43194/371472 [3:26:33<27:14:48,  3.35it/s]
 12%|█▏        | 43195/371472 [3:26:34<27:17:28,  3.34it/s]
 12%|█▏        | 43196/371472 [3:26:34<26:59:52,  3.38it/s]
 12%|█▏        | 43197/371472 [3:26:34<26:29:14,  3.44it/s]
 12%|█▏        | 43198/371472 [3:26:34<25:36:10,  3.56it/s]
 12%|█▏        | 43199/371472 [3:26:35<25:38:28,  3.56it/s]
 12%|█▏        | 43200/371472 [3:26:35<26:05:18,  3.50it/s]
                                                           
{'loss': 4.2497, 'learning_rate': 8.957637527203775e-07, 'epoch': 1.86}

 12%|█▏        | 43200/371472 [3:26:35<26:05:18,  3.50it/s]
 12%|█▏        | 43201/371472 [3:26:35<27:44:02,  3.29it/s]
 12%|█▏        | 43202/371472 [3:26:36<27:25:40,  3.32it/s]
 12%|█▏        | 43203/371472 [3:26:36<26:25:10,  3.45it/s]
 12%|█▏        | 43204/371472 [3:26:36<27:36:55,  3.30it/s]
 12%|█▏        | 43205/371472 [3:26:37<26:51:21,  3.40it/s]
 12%|█▏        | 43206/371472 [3:26:37<27:29:46,  3.32it/s]
 12%|█▏        | 43207/371472 [3:26:37<27:34:44,  3.31it/s]
 12%|█▏        | 43208/371472 [3:26:37<27:16:00,  3.34it/s]
 12%|█▏        | 43209/371472 [3:26:38<26:12:48,  3.48it/s]
 12%|█▏        | 43210/371472 [3:26:38<25:49:08,  3.53it/s]
 12%|█▏        | 43211/371472 [3:26:38<25:53:32,  3.52it/s]
 12%|█▏        | 43212/371472 [3:26:39<25:38:02,  3.56it/s]
 12%|█▏        | 43213/371472 [3:26:39<24:29:49,  3.72it/s]
 12%|█▏        | 43214/371472 [3:26:39<26:03:06,  3.50it/s]
 12%|█▏        | 43215/371472 [3:26:39<25:35:31,  3.56it/s]
 12%|█▏        | 43216/371472 [3:26:40<25:08:17,  3.63it/s]
 12%|█▏        | 43217/371472 [3:26:40<24:59:19,  3.65it/s]
 12%|█▏        | 43218/371472 [3:26:40<24:59:07,  3.65it/s]
 12%|█▏        | 43219/371472 [3:26:40<24:42:11,  3.69it/s]
 12%|█▏        | 43220/371472 [3:26:41<25:12:17,  3.62it/s]
                                                           
{'loss': 4.2743, 'learning_rate': 8.957152707448986e-07, 'epoch': 1.86}

 12%|█▏        | 43220/371472 [3:26:41<25:12:17,  3.62it/s]
 12%|█▏        | 43221/371472 [3:26:41<24:45:57,  3.68it/s]
 12%|█▏        | 43222/371472 [3:26:41<24:59:52,  3.65it/s]
 12%|█▏        | 43223/371472 [3:26:42<27:58:52,  3.26it/s]
 12%|█▏        | 43224/371472 [3:26:42<27:41:35,  3.29it/s]
 12%|█▏        | 43225/371472 [3:26:42<29:43:04,  3.07it/s]
 12%|█▏        | 43226/371472 [3:26:43<28:39:18,  3.18it/s]
 12%|█▏        | 43227/371472 [3:26:43<28:15:09,  3.23it/s]
 12%|█▏        | 43228/371472 [3:26:43<26:49:59,  3.40it/s]
 12%|█▏        | 43229/371472 [3:26:43<26:18:03,  3.47it/s]
 12%|█▏        | 43230/371472 [3:26:44<26:03:42,  3.50it/s]
 12%|█▏        | 43231/371472 [3:26:44<25:56:02,  3.52it/s]
 12%|█▏        | 43232/371472 [3:26:44<25:07:45,  3.63it/s]
 12%|█▏        | 43233/371472 [3:26:45<25:11:33,  3.62it/s]
 12%|█▏        | 43234/371472 [3:26:45<25:39:58,  3.55it/s]
 12%|█▏        | 43235/371472 [3:26:45<25:12:53,  3.62it/s]
 12%|█▏        | 43236/371472 [3:26:45<25:27:40,  3.58it/s]
 12%|█▏        | 43237/371472 [3:26:46<25:31:56,  3.57it/s]
 12%|█▏        | 43238/371472 [3:26:46<25:37:36,  3.56it/s]
 12%|█▏        | 43239/371472 [3:26:46<25:43:16,  3.54it/s]
 12%|█▏        | 43240/371472 [3:26:47<24:41:21,  3.69it/s]
                                                           
{'loss': 4.384, 'learning_rate': 8.956667887694197e-07, 'epoch': 1.86}

 12%|█▏        | 43240/371472 [3:26:47<24:41:21,  3.69it/s]
 12%|█▏        | 43241/371472 [3:26:47<25:46:22,  3.54it/s]
 12%|█▏        | 43242/371472 [3:26:47<26:10:24,  3.48it/s]
 12%|█▏        | 43243/371472 [3:26:47<26:31:32,  3.44it/s]
 12%|█▏        | 43244/371472 [3:26:48<26:26:07,  3.45it/s]
 12%|█▏        | 43245/371472 [3:26:48<25:59:47,  3.51it/s]
 12%|█▏        | 43246/371472 [3:26:48<26:21:44,  3.46it/s]
 12%|█▏        | 43247/371472 [3:26:49<27:13:13,  3.35it/s]
 12%|█▏        | 43248/371472 [3:26:49<26:52:25,  3.39it/s]
 12%|█▏        | 43249/371472 [3:26:49<27:35:06,  3.31it/s]
 12%|█▏        | 43250/371472 [3:26:50<27:41:12,  3.29it/s]
 12%|█▏        | 43251/371472 [3:26:50<27:09:56,  3.36it/s]
 12%|█▏        | 43252/371472 [3:26:50<26:26:31,  3.45it/s]
 12%|█▏        | 43253/371472 [3:26:50<26:29:06,  3.44it/s]
 12%|█▏        | 43254/371472 [3:26:51<25:24:23,  3.59it/s]
 12%|█▏        | 43255/371472 [3:26:51<25:14:17,  3.61it/s]
 12%|█▏        | 43256/371472 [3:26:51<26:40:35,  3.42it/s]
 12%|█▏        | 43257/371472 [3:26:51<25:37:59,  3.56it/s]
 12%|█▏        | 43258/371472 [3:26:52<24:45:20,  3.68it/s]
 12%|█▏        | 43259/371472 [3:26:52<25:12:53,  3.62it/s]
 12%|█▏        | 43260/371472 [3:26:52<25:39:06,  3.55it/s]
                                                           
{'loss': 4.1961, 'learning_rate': 8.956183067939409e-07, 'epoch': 1.86}

 12%|█▏        | 43260/371472 [3:26:52<25:39:06,  3.55it/s]
 12%|█▏        | 43261/371472 [3:26:53<27:28:00,  3.32it/s]
 12%|█▏        | 43262/371472 [3:26:53<27:23:37,  3.33it/s]
 12%|█▏        | 43263/371472 [3:26:53<27:37:27,  3.30it/s]
 12%|█▏        | 43264/371472 [3:26:54<28:56:06,  3.15it/s]
 12%|█▏        | 43265/371472 [3:26:54<26:48:10,  3.40it/s]
 12%|█▏        | 43266/371472 [3:26:54<26:06:22,  3.49it/s]
 12%|█▏        | 43267/371472 [3:26:54<26:45:38,  3.41it/s]
 12%|█▏        | 43268/371472 [3:26:55<25:39:24,  3.55it/s]
 12%|█▏        | 43269/371472 [3:26:55<24:26:55,  3.73it/s]
 12%|█▏        | 43270/371472 [3:26:55<25:17:03,  3.61it/s]
 12%|█▏        | 43271/371472 [3:26:55<24:27:13,  3.73it/s]
 12%|█▏        | 43272/371472 [3:26:56<23:58:41,  3.80it/s]
 12%|█▏        | 43273/371472 [3:26:56<24:42:10,  3.69it/s]
 12%|█▏        | 43274/371472 [3:26:56<25:08:39,  3.63it/s]
 12%|█▏        | 43275/371472 [3:26:57<24:11:10,  3.77it/s]
 12%|█▏        | 43276/371472 [3:26:57<25:24:51,  3.59it/s]
 12%|█▏        | 43277/371472 [3:26:57<25:18:31,  3.60it/s]
 12%|█▏        | 43278/371472 [3:26:57<26:48:07,  3.40it/s]
 12%|█▏        | 43279/371472 [3:26:58<26:24:27,  3.45it/s]
 12%|█▏        | 43280/371472 [3:26:58<26:23:04,  3.46it/s]
                                                           
{'loss': 4.1731, 'learning_rate': 8.955698248184619e-07, 'epoch': 1.86}

 12%|█▏        | 43280/371472 [3:26:58<26:23:04,  3.46it/s]
 12%|█▏        | 43281/371472 [3:26:58<26:13:19,  3.48it/s]
 12%|█▏        | 43282/371472 [3:26:59<25:56:56,  3.51it/s]
 12%|█▏        | 43283/371472 [3:26:59<25:12:28,  3.62it/s]
 12%|█▏        | 43284/371472 [3:26:59<27:35:55,  3.30it/s]
 12%|█▏        | 43285/371472 [3:26:59<27:00:43,  3.37it/s]
 12%|█▏        | 43286/371472 [3:27:00<26:20:39,  3.46it/s]
 12%|█▏        | 43287/371472 [3:27:00<26:03:11,  3.50it/s]
 12%|█▏        | 43288/371472 [3:27:00<27:11:08,  3.35it/s]
 12%|█▏        | 43289/371472 [3:27:01<27:22:40,  3.33it/s]
 12%|█▏        | 43290/371472 [3:27:01<26:22:15,  3.46it/s]
 12%|█▏        | 43291/371472 [3:27:01<25:14:55,  3.61it/s]
 12%|█▏        | 43292/371472 [3:27:01<25:39:39,  3.55it/s]
 12%|█▏        | 43293/371472 [3:27:02<25:26:55,  3.58it/s]
 12%|█▏        | 43294/371472 [3:27:02<24:55:53,  3.66it/s]
 12%|█▏        | 43295/371472 [3:27:02<25:23:05,  3.59it/s]
 12%|█▏        | 43296/371472 [3:27:03<25:10:21,  3.62it/s]
 12%|█▏        | 43297/371472 [3:27:03<24:34:12,  3.71it/s]
 12%|█▏        | 43298/371472 [3:27:03<26:05:21,  3.49it/s]
 12%|█▏        | 43299/371472 [3:27:03<25:19:22,  3.60it/s]
 12%|█▏        | 43300/371472 [3:27:04<25:36:25,  3.56it/s]
                                                           
{'loss': 4.1847, 'learning_rate': 8.955213428429829e-07, 'epoch': 1.87}

 12%|█▏        | 43300/371472 [3:27:04<25:36:25,  3.56it/s]
 12%|█▏        | 43301/371472 [3:27:04<25:30:52,  3.57it/s]
 12%|█▏        | 43302/371472 [3:27:04<25:43:01,  3.54it/s]
 12%|█▏        | 43303/371472 [3:27:05<25:31:15,  3.57it/s]
 12%|█▏        | 43304/371472 [3:27:05<25:05:09,  3.63it/s]
 12%|█▏        | 43305/371472 [3:27:05<25:03:35,  3.64it/s]
 12%|█▏        | 43306/371472 [3:27:05<24:44:22,  3.68it/s]
 12%|█▏        | 43307/371472 [3:27:06<24:31:27,  3.72it/s]
 12%|█▏        | 43308/371472 [3:27:06<25:29:21,  3.58it/s]
 12%|█▏        | 43309/371472 [3:27:06<25:52:49,  3.52it/s]
 12%|█▏        | 43310/371472 [3:27:07<26:36:21,  3.43it/s]
 12%|█▏        | 43311/371472 [3:27:07<26:53:09,  3.39it/s]
 12%|█▏        | 43312/371472 [3:27:07<27:32:50,  3.31it/s]
 12%|█▏        | 43313/371472 [3:27:07<26:24:09,  3.45it/s]
 12%|█▏        | 43314/371472 [3:27:08<27:00:49,  3.37it/s]
 12%|█▏        | 43315/371472 [3:27:08<26:29:50,  3.44it/s]
 12%|█▏        | 43316/371472 [3:27:08<26:01:02,  3.50it/s]
 12%|█▏        | 43317/371472 [3:27:09<26:04:26,  3.50it/s]
 12%|█▏        | 43318/371472 [3:27:09<26:28:59,  3.44it/s]
 12%|█▏        | 43319/371472 [3:27:09<25:43:48,  3.54it/s]
 12%|█▏        | 43320/371472 [3:27:09<25:02:49,  3.64it/s]
                                                           
{'loss': 4.3402, 'learning_rate': 8.954728608675041e-07, 'epoch': 1.87}

 12%|█▏        | 43320/371472 [3:27:09<25:02:49,  3.64it/s]
 12%|█▏        | 43321/371472 [3:27:10<24:28:52,  3.72it/s]
 12%|█▏        | 43322/371472 [3:27:10<23:34:34,  3.87it/s]
 12%|█▏        | 43323/371472 [3:27:10<25:30:52,  3.57it/s]
 12%|█▏        | 43324/371472 [3:27:11<26:56:16,  3.38it/s]
 12%|█▏        | 43325/371472 [3:27:11<26:00:40,  3.50it/s]
 12%|█▏        | 43326/371472 [3:27:11<25:55:17,  3.52it/s]
 12%|█▏        | 43327/371472 [3:27:11<25:49:42,  3.53it/s]
 12%|█▏        | 43328/371472 [3:27:12<26:56:21,  3.38it/s]
 12%|█▏        | 43329/371472 [3:27:12<26:21:42,  3.46it/s]
 12%|█▏        | 43330/371472 [3:27:12<25:58:11,  3.51it/s]
 12%|█▏        | 43331/371472 [3:27:12<25:10:31,  3.62it/s]
 12%|█▏        | 43332/371472 [3:27:13<24:41:29,  3.69it/s]
 12%|█▏        | 43333/371472 [3:27:13<24:13:37,  3.76it/s]
 12%|█▏        | 43334/371472 [3:27:13<24:10:15,  3.77it/s]
 12%|█▏        | 43335/371472 [3:27:13<23:42:54,  3.84it/s]
 12%|█▏        | 43336/371472 [3:27:14<23:07:48,  3.94it/s]
 12%|█▏        | 43337/371472 [3:27:14<23:58:18,  3.80it/s]
 12%|█▏        | 43338/371472 [3:27:14<24:02:22,  3.79it/s]
 12%|█▏        | 43339/371472 [3:27:15<23:50:33,  3.82it/s]
 12%|█▏        | 43340/371472 [3:27:15<24:26:36,  3.73it/s]
                                                           
{'loss': 4.5423, 'learning_rate': 8.954243788920253e-07, 'epoch': 1.87}

 12%|█▏        | 43340/371472 [3:27:15<24:26:36,  3.73it/s]
 12%|█▏        | 43341/371472 [3:27:15<27:20:58,  3.33it/s]
 12%|█▏        | 43342/371472 [3:27:15<26:51:07,  3.39it/s]
 12%|█▏        | 43343/371472 [3:27:16<26:12:30,  3.48it/s]
 12%|█▏        | 43344/371472 [3:27:16<24:57:20,  3.65it/s]
 12%|█▏        | 43345/371472 [3:27:16<24:13:49,  3.76it/s]
 12%|█▏        | 43346/371472 [3:27:17<26:35:16,  3.43it/s]
 12%|█▏        | 43347/371472 [3:27:17<26:16:12,  3.47it/s]
 12%|█▏        | 43348/371472 [3:27:17<25:37:19,  3.56it/s]
 12%|█▏        | 43349/371472 [3:27:17<25:58:36,  3.51it/s]
 12%|█▏        | 43350/371472 [3:27:18<25:40:53,  3.55it/s]
 12%|█▏        | 43351/371472 [3:27:18<25:26:41,  3.58it/s]
 12%|█▏        | 43352/371472 [3:27:18<25:11:15,  3.62it/s]
 12%|█▏        | 43353/371472 [3:27:18<24:17:16,  3.75it/s]
 12%|█▏        | 43354/371472 [3:27:19<24:22:16,  3.74it/s]
 12%|█▏        | 43355/371472 [3:27:19<25:17:56,  3.60it/s]
 12%|█▏        | 43356/371472 [3:27:19<24:45:19,  3.68it/s]
 12%|█▏        | 43357/371472 [3:27:20<25:00:12,  3.65it/s]
 12%|█▏        | 43358/371472 [3:27:20<24:34:18,  3.71it/s]
 12%|█▏        | 43359/371472 [3:27:20<24:11:34,  3.77it/s]
 12%|█▏        | 43360/371472 [3:27:20<25:47:33,  3.53it/s]
                                                           
{'loss': 4.3562, 'learning_rate': 8.953758969165464e-07, 'epoch': 1.87}

 12%|█▏        | 43360/371472 [3:27:20<25:47:33,  3.53it/s]
 12%|█▏        | 43361/371472 [3:27:21<25:15:18,  3.61it/s]
 12%|█▏        | 43362/371472 [3:27:21<24:47:07,  3.68it/s]
 12%|█▏        | 43363/371472 [3:27:21<24:31:43,  3.72it/s]
 12%|█▏        | 43364/371472 [3:27:22<25:56:01,  3.51it/s]
 12%|█▏        | 43365/371472 [3:27:22<25:14:55,  3.61it/s]
 12%|█▏        | 43366/371472 [3:27:22<25:25:18,  3.59it/s]
 12%|█▏        | 43367/371472 [3:27:22<25:37:47,  3.56it/s]
 12%|█▏        | 43368/371472 [3:27:23<28:40:43,  3.18it/s]
 12%|█▏        | 43369/371472 [3:27:23<28:08:47,  3.24it/s]
 12%|█▏        | 43370/371472 [3:27:23<27:39:02,  3.30it/s]
 12%|█▏        | 43371/371472 [3:27:24<27:23:18,  3.33it/s]
 12%|█▏        | 43372/371472 [3:27:24<26:10:48,  3.48it/s]
 12%|█▏        | 43373/371472 [3:27:24<28:04:09,  3.25it/s]
 12%|█▏        | 43374/371472 [3:27:25<26:37:58,  3.42it/s]
 12%|█▏        | 43375/371472 [3:27:25<25:34:54,  3.56it/s]
 12%|█▏        | 43376/371472 [3:27:25<25:15:56,  3.61it/s]
 12%|█▏        | 43377/371472 [3:27:25<25:31:55,  3.57it/s]
 12%|█▏        | 43378/371472 [3:27:26<26:15:56,  3.47it/s]
 12%|█▏        | 43379/371472 [3:27:26<26:29:17,  3.44it/s]
 12%|█▏        | 43380/371472 [3:27:26<26:13:10,  3.48it/s]
                                                           
{'loss': 4.3731, 'learning_rate': 8.953274149410674e-07, 'epoch': 1.87}

 12%|█▏        | 43380/371472 [3:27:26<26:13:10,  3.48it/s]
 12%|█▏        | 43381/371472 [3:27:26<25:53:36,  3.52it/s]
 12%|█▏        | 43382/371472 [3:27:27<26:58:40,  3.38it/s]
 12%|█▏        | 43383/371472 [3:27:27<26:19:27,  3.46it/s]
 12%|█▏        | 43384/371472 [3:27:27<24:58:47,  3.65it/s]
 12%|█▏        | 43385/371472 [3:27:28<24:03:35,  3.79it/s]
 12%|█▏        | 43386/371472 [3:27:28<26:15:15,  3.47it/s]
 12%|█▏        | 43387/371472 [3:27:28<26:13:43,  3.47it/s]
 12%|█▏        | 43388/371472 [3:27:28<25:14:11,  3.61it/s]
 12%|█▏        | 43389/371472 [3:27:29<25:13:40,  3.61it/s]
 12%|█▏        | 43390/371472 [3:27:29<25:29:14,  3.58it/s]
 12%|█▏        | 43391/371472 [3:27:29<24:59:10,  3.65it/s]
 12%|█▏        | 43392/371472 [3:27:30<24:16:07,  3.76it/s]
 12%|█▏        | 43393/371472 [3:27:30<24:27:58,  3.72it/s]
 12%|█▏        | 43394/371472 [3:27:30<26:17:39,  3.47it/s]
 12%|█▏        | 43395/371472 [3:27:30<27:19:05,  3.34it/s]
 12%|█▏        | 43396/371472 [3:27:31<26:59:54,  3.38it/s]
 12%|█▏        | 43397/371472 [3:27:31<25:58:30,  3.51it/s]
 12%|█▏        | 43398/371472 [3:27:31<25:48:42,  3.53it/s]
 12%|█▏        | 43399/371472 [3:27:32<26:46:36,  3.40it/s]
 12%|█▏        | 43400/371472 [3:27:32<25:24:55,  3.59it/s]
                                                           
{'loss': 4.286, 'learning_rate': 8.952789329655885e-07, 'epoch': 1.87}

 12%|█▏        | 43400/371472 [3:27:32<25:24:55,  3.59it/s]
 12%|█▏        | 43401/371472 [3:27:32<25:36:26,  3.56it/s]
 12%|█▏        | 43402/371472 [3:27:32<26:50:03,  3.40it/s]
 12%|█▏        | 43403/371472 [3:27:33<26:21:06,  3.46it/s]
 12%|█▏        | 43404/371472 [3:27:33<26:01:36,  3.50it/s]
 12%|█▏        | 43405/371472 [3:27:33<26:39:56,  3.42it/s]
 12%|█▏        | 43406/371472 [3:27:34<26:03:01,  3.50it/s]
 12%|█▏        | 43407/371472 [3:27:34<27:26:34,  3.32it/s]
 12%|█▏        | 43408/371472 [3:27:34<26:14:38,  3.47it/s]
 12%|█▏        | 43409/371472 [3:27:34<25:29:39,  3.57it/s]
 12%|█▏        | 43410/371472 [3:27:35<26:46:09,  3.40it/s]
 12%|█▏        | 43411/371472 [3:27:35<26:40:48,  3.42it/s]
 12%|█▏        | 43412/371472 [3:27:35<26:20:23,  3.46it/s]
 12%|█▏        | 43413/371472 [3:27:36<25:38:37,  3.55it/s]
 12%|█▏        | 43414/371472 [3:27:36<25:23:06,  3.59it/s]
 12%|█▏        | 43415/371472 [3:27:36<25:38:09,  3.55it/s]
 12%|█▏        | 43416/371472 [3:27:36<25:00:55,  3.64it/s]
 12%|█▏        | 43417/371472 [3:27:37<26:59:53,  3.38it/s]
 12%|█▏        | 43418/371472 [3:27:37<25:48:32,  3.53it/s]
 12%|█▏        | 43419/371472 [3:27:37<25:20:43,  3.60it/s]
 12%|█▏        | 43420/371472 [3:27:38<25:32:10,  3.57it/s]
                                                           
{'loss': 4.2101, 'learning_rate': 8.952304509901096e-07, 'epoch': 1.87}

 12%|█▏        | 43420/371472 [3:27:38<25:32:10,  3.57it/s]
 12%|█▏        | 43421/371472 [3:27:38<25:39:02,  3.55it/s]
 12%|█▏        | 43422/371472 [3:27:38<25:16:17,  3.61it/s]
 12%|█▏        | 43423/371472 [3:27:39<30:51:17,  2.95it/s]
 12%|█▏        | 43424/371472 [3:27:39<30:25:43,  2.99it/s]
 12%|█▏        | 43425/371472 [3:27:39<29:01:48,  3.14it/s]
 12%|█▏        | 43426/371472 [3:27:40<29:02:58,  3.14it/s]
 12%|█▏        | 43427/371472 [3:27:40<31:39:17,  2.88it/s]
 12%|█▏        | 43428/371472 [3:27:40<31:09:07,  2.93it/s]
 12%|█▏        | 43429/371472 [3:27:41<28:59:50,  3.14it/s]
 12%|█▏        | 43430/371472 [3:27:41<27:09:31,  3.36it/s]
 12%|█▏        | 43431/371472 [3:27:41<27:10:36,  3.35it/s]
 12%|█▏        | 43432/371472 [3:27:41<25:59:52,  3.50it/s]
 12%|█▏        | 43433/371472 [3:27:42<26:16:33,  3.47it/s]
 12%|█▏        | 43434/371472 [3:27:42<25:54:24,  3.52it/s]
 12%|█▏        | 43435/371472 [3:27:42<26:10:19,  3.48it/s]
 12%|█▏        | 43436/371472 [3:27:42<25:25:41,  3.58it/s]
 12%|█▏        | 43437/371472 [3:27:43<26:53:43,  3.39it/s]
 12%|█▏        | 43438/371472 [3:27:43<25:59:58,  3.50it/s]
 12%|█▏        | 43439/371472 [3:27:43<26:10:48,  3.48it/s]
 12%|█▏        | 43440/371472 [3:27:44<25:31:11,  3.57it/s]
                                                           
{'loss': 4.2868, 'learning_rate': 8.951819690146307e-07, 'epoch': 1.87}

 12%|█▏        | 43440/371472 [3:27:44<25:31:11,  3.57it/s]
 12%|█▏        | 43441/371472 [3:27:44<25:03:26,  3.64it/s]
 12%|█▏        | 43442/371472 [3:27:44<24:51:44,  3.66it/s]
 12%|█▏        | 43443/371472 [3:27:44<25:10:12,  3.62it/s]
 12%|█▏        | 43444/371472 [3:27:45<25:45:44,  3.54it/s]
 12%|█▏        | 43445/371472 [3:27:45<25:40:40,  3.55it/s]
 12%|█▏        | 43446/371472 [3:27:45<25:45:11,  3.54it/s]
 12%|█▏        | 43447/371472 [3:27:46<31:27:23,  2.90it/s]
 12%|█▏        | 43448/371472 [3:27:46<29:34:43,  3.08it/s]
 12%|█▏        | 43449/371472 [3:27:46<28:16:17,  3.22it/s]
 12%|█▏        | 43450/371472 [3:27:47<29:39:14,  3.07it/s]
 12%|█▏        | 43451/371472 [3:27:47<31:04:43,  2.93it/s]
 12%|█▏        | 43452/371472 [3:27:47<30:06:20,  3.03it/s]
 12%|█▏        | 43453/371472 [3:27:48<27:59:40,  3.25it/s]
 12%|█▏        | 43454/371472 [3:27:48<26:47:51,  3.40it/s]
 12%|█▏        | 43455/371472 [3:27:48<25:54:41,  3.52it/s]
 12%|█▏        | 43456/371472 [3:27:48<25:15:27,  3.61it/s]
 12%|█▏        | 43457/371472 [3:27:49<26:34:00,  3.43it/s]
 12%|█▏        | 43458/371472 [3:27:49<26:34:03,  3.43it/s]
 12%|█▏        | 43459/371472 [3:27:49<26:21:34,  3.46it/s]
 12%|█▏        | 43460/371472 [3:27:50<26:37:09,  3.42it/s]
                                                           
{'loss': 4.2495, 'learning_rate': 8.951334870391518e-07, 'epoch': 1.87}

 12%|█▏        | 43460/371472 [3:27:50<26:37:09,  3.42it/s]
 12%|█▏        | 43461/371472 [3:27:50<26:09:53,  3.48it/s]
 12%|█▏        | 43462/371472 [3:27:50<26:09:51,  3.48it/s]
 12%|█▏        | 43463/371472 [3:27:51<27:23:29,  3.33it/s]
 12%|█▏        | 43464/371472 [3:27:51<27:33:14,  3.31it/s]
 12%|█▏        | 43465/371472 [3:27:51<25:59:21,  3.51it/s]
 12%|█▏        | 43466/371472 [3:27:51<27:07:52,  3.36it/s]
 12%|█▏        | 43467/371472 [3:27:52<26:38:28,  3.42it/s]
 12%|█▏        | 43468/371472 [3:27:52<27:01:23,  3.37it/s]
 12%|█▏        | 43469/371472 [3:27:52<27:01:28,  3.37it/s]
 12%|█▏        | 43470/371472 [3:27:53<27:31:40,  3.31it/s]
 12%|█▏        | 43471/371472 [3:27:53<26:56:16,  3.38it/s]
 12%|█▏        | 43472/371472 [3:27:53<26:51:44,  3.39it/s]
 12%|█▏        | 43473/371472 [3:27:53<25:52:28,  3.52it/s]
 12%|█▏        | 43474/371472 [3:27:54<25:05:56,  3.63it/s]
 12%|█▏        | 43475/371472 [3:27:54<25:25:14,  3.58it/s]
 12%|█▏        | 43476/371472 [3:27:54<25:10:28,  3.62it/s]
 12%|█▏        | 43477/371472 [3:27:54<24:44:21,  3.68it/s]
 12%|█▏        | 43478/371472 [3:27:55<25:52:01,  3.52it/s]
 12%|█▏        | 43479/371472 [3:27:55<25:33:49,  3.56it/s]
 12%|█▏        | 43480/371472 [3:27:55<25:52:38,  3.52it/s]
                                                           
{'loss': 4.3549, 'learning_rate': 8.95085005063673e-07, 'epoch': 1.87}

 12%|█▏        | 43480/371472 [3:27:55<25:52:38,  3.52it/s]
 12%|█▏        | 43481/371472 [3:27:56<25:33:05,  3.57it/s]
 12%|█▏        | 43482/371472 [3:27:56<25:24:55,  3.58it/s]
 12%|█▏        | 43483/371472 [3:27:56<26:10:49,  3.48it/s]
 12%|█▏        | 43484/371472 [3:27:56<25:16:57,  3.60it/s]
 12%|█▏        | 43485/371472 [3:27:57<26:47:55,  3.40it/s]
 12%|█▏        | 43486/371472 [3:27:57<28:50:10,  3.16it/s]
 12%|█▏        | 43487/371472 [3:27:57<28:13:01,  3.23it/s]
 12%|█▏        | 43488/371472 [3:27:58<28:26:30,  3.20it/s]
 12%|█▏        | 43489/371472 [3:27:58<27:40:23,  3.29it/s]
 12%|█▏        | 43490/371472 [3:27:58<27:14:37,  3.34it/s]
 12%|█▏        | 43491/371472 [3:27:59<26:40:49,  3.41it/s]
 12%|█▏        | 43492/371472 [3:27:59<26:50:02,  3.40it/s]
 12%|█▏        | 43493/371472 [3:27:59<26:00:22,  3.50it/s]
 12%|█▏        | 43494/371472 [3:28:00<26:57:05,  3.38it/s]
 12%|█▏        | 43495/371472 [3:28:00<26:16:17,  3.47it/s]
 12%|█▏        | 43496/371472 [3:28:00<25:37:42,  3.55it/s]
 12%|█▏        | 43497/371472 [3:28:00<25:53:54,  3.52it/s]
 12%|█▏        | 43498/371472 [3:28:01<25:33:54,  3.56it/s]
 12%|█▏        | 43499/371472 [3:28:01<26:02:35,  3.50it/s]
 12%|█▏        | 43500/371472 [3:28:01<25:38:46,  3.55it/s]
                                                           
{'loss': 4.1452, 'learning_rate': 8.950365230881941e-07, 'epoch': 1.87}

 12%|█▏        | 43500/371472 [3:28:01<25:38:46,  3.55it/s]
 12%|█▏        | 43501/371472 [3:28:01<24:48:32,  3.67it/s]
 12%|█▏        | 43502/371472 [3:28:02<25:07:26,  3.63it/s]
 12%|█▏        | 43503/371472 [3:28:02<24:54:54,  3.66it/s]
 12%|█▏        | 43504/371472 [3:28:02<25:08:40,  3.62it/s]
 12%|█▏        | 43505/371472 [3:28:03<24:21:40,  3.74it/s]
 12%|█▏        | 43506/371472 [3:28:03<24:58:25,  3.65it/s]
 12%|█▏        | 43507/371472 [3:28:03<25:52:26,  3.52it/s]
 12%|█▏        | 43508/371472 [3:28:03<25:33:55,  3.56it/s]
 12%|█▏        | 43509/371472 [3:28:04<25:32:16,  3.57it/s]
 12%|█▏        | 43510/371472 [3:28:04<27:45:14,  3.28it/s]
 12%|█▏        | 43511/371472 [3:28:04<27:25:10,  3.32it/s]
 12%|█▏        | 43512/371472 [3:28:05<27:56:40,  3.26it/s]
 12%|█▏        | 43513/371472 [3:28:05<27:43:29,  3.29it/s]
 12%|█▏        | 43514/371472 [3:28:05<27:24:59,  3.32it/s]
 12%|█▏        | 43515/371472 [3:28:05<25:52:11,  3.52it/s]
 12%|█▏        | 43516/371472 [3:28:06<25:37:47,  3.55it/s]
 12%|█▏        | 43517/371472 [3:28:06<24:38:58,  3.70it/s]
 12%|█▏        | 43518/371472 [3:28:06<24:36:53,  3.70it/s]
 12%|█▏        | 43519/371472 [3:28:07<26:27:08,  3.44it/s]
 12%|█▏        | 43520/371472 [3:28:07<25:23:43,  3.59it/s]
                                                           
{'loss': 4.2519, 'learning_rate': 8.949880411127151e-07, 'epoch': 1.87}

 12%|█▏        | 43520/371472 [3:28:07<25:23:43,  3.59it/s]
 12%|█▏        | 43521/371472 [3:28:07<25:33:34,  3.56it/s]
 12%|█▏        | 43522/371472 [3:28:08<28:55:55,  3.15it/s]
 12%|█▏        | 43523/371472 [3:28:08<28:38:25,  3.18it/s]
 12%|█▏        | 43524/371472 [3:28:08<28:08:09,  3.24it/s]
 12%|█▏        | 43525/371472 [3:28:08<27:08:27,  3.36it/s]
 12%|█▏        | 43526/371472 [3:28:09<26:08:27,  3.48it/s]
 12%|█▏        | 43527/371472 [3:28:09<27:04:53,  3.36it/s]
 12%|█▏        | 43528/371472 [3:28:09<27:21:00,  3.33it/s]
 12%|█▏        | 43529/371472 [3:28:10<26:15:41,  3.47it/s]
 12%|█▏        | 43530/371472 [3:28:10<25:56:12,  3.51it/s]
 12%|█▏        | 43531/371472 [3:28:10<25:56:47,  3.51it/s]
 12%|█▏        | 43532/371472 [3:28:10<26:01:12,  3.50it/s]
 12%|█▏        | 43533/371472 [3:28:11<25:35:46,  3.56it/s]
 12%|█▏        | 43534/371472 [3:28:11<25:04:34,  3.63it/s]
 12%|█▏        | 43535/371472 [3:28:11<25:24:12,  3.59it/s]
 12%|█▏        | 43536/371472 [3:28:12<25:16:11,  3.60it/s]
 12%|█▏        | 43537/371472 [3:28:12<25:25:45,  3.58it/s]
 12%|█▏        | 43538/371472 [3:28:12<24:36:35,  3.70it/s]
 12%|█▏        | 43539/371472 [3:28:12<24:13:53,  3.76it/s]
 12%|█▏        | 43540/371472 [3:28:13<23:56:17,  3.81it/s]
                                                           
{'loss': 4.1753, 'learning_rate': 8.949395591372362e-07, 'epoch': 1.88}

 12%|█▏        | 43540/371472 [3:28:13<23:56:17,  3.81it/s]
 12%|█▏        | 43541/371472 [3:28:13<23:13:08,  3.92it/s]
 12%|█▏        | 43542/371472 [3:28:13<23:13:42,  3.92it/s]
 12%|█▏        | 43543/371472 [3:28:13<23:30:30,  3.87it/s]
 12%|█▏        | 43544/371472 [3:28:14<24:26:07,  3.73it/s]
 12%|█▏        | 43545/371472 [3:28:14<26:13:19,  3.47it/s]
 12%|█▏        | 43546/371472 [3:28:14<27:23:30,  3.33it/s]
 12%|█▏        | 43547/371472 [3:28:15<26:39:59,  3.42it/s]
 12%|█▏        | 43548/371472 [3:28:15<27:24:13,  3.32it/s]
 12%|█▏        | 43549/371472 [3:28:15<27:16:05,  3.34it/s]
 12%|█▏        | 43550/371472 [3:28:15<27:17:17,  3.34it/s]
 12%|█▏        | 43551/371472 [3:28:16<27:08:24,  3.36it/s]
 12%|█▏        | 43552/371472 [3:28:16<27:25:31,  3.32it/s]
 12%|█▏        | 43553/371472 [3:28:16<25:46:30,  3.53it/s]
 12%|█▏        | 43554/371472 [3:28:17<25:18:23,  3.60it/s]
 12%|█▏        | 43555/371472 [3:28:17<28:26:11,  3.20it/s]
 12%|█▏        | 43556/371472 [3:28:17<27:49:28,  3.27it/s]
 12%|█▏        | 43557/371472 [3:28:18<26:35:51,  3.42it/s]
 12%|█▏        | 43558/371472 [3:28:18<26:06:20,  3.49it/s]
 12%|█▏        | 43559/371472 [3:28:18<27:31:08,  3.31it/s]
 12%|█▏        | 43560/371472 [3:28:19<29:19:57,  3.11it/s]
                                                           
{'loss': 4.2263, 'learning_rate': 8.948910771617574e-07, 'epoch': 1.88}

 12%|█▏        | 43560/371472 [3:28:19<29:19:57,  3.11it/s]
 12%|█▏        | 43561/371472 [3:28:19<28:13:33,  3.23it/s]
 12%|█▏        | 43562/371472 [3:28:19<26:16:40,  3.47it/s]
 12%|█▏        | 43563/371472 [3:28:19<26:13:56,  3.47it/s]
 12%|█▏        | 43564/371472 [3:28:20<25:18:30,  3.60it/s]
 12%|█▏        | 43565/371472 [3:28:20<24:42:29,  3.69it/s]
 12%|█▏        | 43566/371472 [3:28:20<25:07:03,  3.63it/s]
 12%|█▏        | 43567/371472 [3:28:20<25:01:21,  3.64it/s]
 12%|█▏        | 43568/371472 [3:28:21<24:36:18,  3.70it/s]
 12%|█▏        | 43569/371472 [3:28:21<24:19:14,  3.75it/s]
 12%|█▏        | 43570/371472 [3:28:21<26:39:05,  3.42it/s]
 12%|█▏        | 43571/371472 [3:28:22<26:25:08,  3.45it/s]
 12%|█▏        | 43572/371472 [3:28:22<25:36:46,  3.56it/s]
 12%|█▏        | 43573/371472 [3:28:22<27:29:14,  3.31it/s]
 12%|█▏        | 43574/371472 [3:28:22<26:51:58,  3.39it/s]
 12%|█▏        | 43575/371472 [3:28:23<26:30:16,  3.44it/s]
 12%|█▏        | 43576/371472 [3:28:23<25:33:56,  3.56it/s]
 12%|█▏        | 43577/371472 [3:28:23<25:58:05,  3.51it/s]
 12%|█▏        | 43578/371472 [3:28:24<26:08:49,  3.48it/s]
 12%|█▏        | 43579/371472 [3:28:24<25:16:19,  3.60it/s]
 12%|█▏        | 43580/371472 [3:28:24<24:58:37,  3.65it/s]
                                                           
{'loss': 4.3419, 'learning_rate': 8.948425951862785e-07, 'epoch': 1.88}

 12%|█▏        | 43580/371472 [3:28:24<24:58:37,  3.65it/s]
 12%|█▏        | 43581/371472 [3:28:24<27:59:36,  3.25it/s]
 12%|█▏        | 43582/371472 [3:28:25<26:36:25,  3.42it/s]
 12%|█▏        | 43583/371472 [3:28:25<26:10:57,  3.48it/s]
 12%|█▏        | 43584/371472 [3:28:25<25:56:06,  3.51it/s]
 12%|█▏        | 43585/371472 [3:28:26<24:52:43,  3.66it/s]
 12%|█▏        | 43586/371472 [3:28:26<24:18:33,  3.75it/s]
 12%|█▏        | 43587/371472 [3:28:26<26:14:42,  3.47it/s]
 12%|█▏        | 43588/371472 [3:28:26<26:45:13,  3.40it/s]
 12%|█▏        | 43589/371472 [3:28:27<26:53:19,  3.39it/s]
 12%|█▏        | 43590/371472 [3:28:27<26:10:59,  3.48it/s]
 12%|█▏        | 43591/371472 [3:28:27<25:51:07,  3.52it/s]
 12%|█▏        | 43592/371472 [3:28:28<25:43:16,  3.54it/s]
 12%|█▏        | 43593/371472 [3:28:28<25:23:01,  3.59it/s]
 12%|█▏        | 43594/371472 [3:28:28<25:22:50,  3.59it/s]
 12%|█▏        | 43595/371472 [3:28:28<25:41:21,  3.55it/s]
 12%|█▏        | 43596/371472 [3:28:29<25:28:27,  3.58it/s]
 12%|█▏        | 43597/371472 [3:28:29<25:14:04,  3.61it/s]
 12%|█▏        | 43598/371472 [3:28:29<26:47:03,  3.40it/s]
 12%|█▏        | 43599/371472 [3:28:30<26:28:55,  3.44it/s]
 12%|█▏        | 43600/371472 [3:28:30<26:09:18,  3.48it/s]
                                                           
{'loss': 4.0941, 'learning_rate': 8.947941132107996e-07, 'epoch': 1.88}

 12%|█▏        | 43600/371472 [3:28:30<26:09:18,  3.48it/s]
 12%|█▏        | 43601/371472 [3:28:30<25:49:13,  3.53it/s]
 12%|█▏        | 43602/371472 [3:28:30<27:52:40,  3.27it/s]
 12%|█▏        | 43603/371472 [3:28:31<26:20:31,  3.46it/s]
 12%|█▏        | 43604/371472 [3:28:31<25:51:59,  3.52it/s]
 12%|█▏        | 43605/371472 [3:28:31<31:30:30,  2.89it/s]
 12%|█▏        | 43606/371472 [3:28:32<30:52:18,  2.95it/s]
 12%|█▏        | 43607/371472 [3:28:32<29:13:35,  3.12it/s]
 12%|█▏        | 43608/371472 [3:28:32<27:27:35,  3.32it/s]
 12%|█▏        | 43609/371472 [3:28:33<26:44:45,  3.41it/s]
 12%|█▏        | 43610/371472 [3:28:33<25:32:59,  3.56it/s]
 12%|█▏        | 43611/371472 [3:28:33<25:05:17,  3.63it/s]
 12%|█▏        | 43612/371472 [3:28:33<24:50:00,  3.67it/s]
 12%|█▏        | 43613/371472 [3:28:34<24:21:09,  3.74it/s]
 12%|█▏        | 43614/371472 [3:28:34<24:17:25,  3.75it/s]
 12%|█▏        | 43615/371472 [3:28:34<25:07:13,  3.63it/s]
 12%|█▏        | 43616/371472 [3:28:34<25:57:31,  3.51it/s]
 12%|█▏        | 43617/371472 [3:28:35<27:14:36,  3.34it/s]
 12%|█▏        | 43618/371472 [3:28:35<25:34:15,  3.56it/s]
 12%|█▏        | 43619/371472 [3:28:35<25:10:04,  3.62it/s]
 12%|█▏        | 43620/371472 [3:28:36<24:37:53,  3.70it/s]
                                                           
{'loss': 4.2375, 'learning_rate': 8.947456312353207e-07, 'epoch': 1.88}

 12%|█▏        | 43620/371472 [3:28:36<24:37:53,  3.70it/s]
 12%|█▏        | 43621/371472 [3:28:36<24:10:15,  3.77it/s]
 12%|█▏        | 43622/371472 [3:28:36<24:49:51,  3.67it/s]
 12%|█▏        | 43623/371472 [3:28:36<26:31:10,  3.43it/s]
 12%|█▏        | 43624/371472 [3:28:37<26:29:25,  3.44it/s]
 12%|█▏        | 43625/371472 [3:28:37<25:28:28,  3.57it/s]
 12%|█▏        | 43626/371472 [3:28:37<25:11:26,  3.62it/s]
 12%|█▏        | 43627/371472 [3:28:38<24:20:48,  3.74it/s]
 12%|█▏        | 43628/371472 [3:28:38<26:24:50,  3.45it/s]
 12%|█▏        | 43629/371472 [3:28:38<26:14:17,  3.47it/s]
 12%|█▏        | 43630/371472 [3:28:38<25:39:35,  3.55it/s]
 12%|█▏        | 43631/371472 [3:28:39<26:13:11,  3.47it/s]
 12%|█▏        | 43632/371472 [3:28:39<25:41:49,  3.54it/s]
 12%|█▏        | 43633/371472 [3:28:39<25:33:38,  3.56it/s]
 12%|█▏        | 43634/371472 [3:28:40<27:08:40,  3.35it/s]
 12%|█▏        | 43635/371472 [3:28:40<26:39:54,  3.42it/s]
 12%|█▏        | 43636/371472 [3:28:40<28:18:51,  3.22it/s]
 12%|█▏        | 43637/371472 [3:28:41<27:06:36,  3.36it/s]
 12%|█▏        | 43638/371472 [3:28:41<26:05:53,  3.49it/s]
 12%|█▏        | 43639/371472 [3:28:41<28:07:28,  3.24it/s]
 12%|█▏        | 43640/371472 [3:28:41<27:46:06,  3.28it/s]
                                                           
{'loss': 4.2234, 'learning_rate': 8.946971492598419e-07, 'epoch': 1.88}

 12%|█▏        | 43640/371472 [3:28:41<27:46:06,  3.28it/s]
 12%|█▏        | 43641/371472 [3:28:42<26:56:02,  3.38it/s]
 12%|█▏        | 43642/371472 [3:28:42<27:31:39,  3.31it/s]
 12%|█▏        | 43643/371472 [3:28:42<26:31:32,  3.43it/s]
 12%|█▏        | 43644/371472 [3:28:43<28:13:23,  3.23it/s]
 12%|█▏        | 43645/371472 [3:28:43<27:12:27,  3.35it/s]
 12%|█▏        | 43646/371472 [3:28:43<25:41:00,  3.55it/s]
 12%|█▏        | 43647/371472 [3:28:43<27:16:38,  3.34it/s]
 12%|█▏        | 43648/371472 [3:28:44<29:28:49,  3.09it/s]
 12%|█▏        | 43649/371472 [3:28:44<28:14:26,  3.22it/s]
 12%|█▏        | 43650/371472 [3:28:44<27:24:31,  3.32it/s]
 12%|█▏        | 43651/371472 [3:28:45<26:35:00,  3.43it/s]
 12%|█▏        | 43652/371472 [3:28:45<26:16:59,  3.46it/s]
 12%|█▏        | 43653/371472 [3:28:45<25:22:46,  3.59it/s]
 12%|█▏        | 43654/371472 [3:28:45<24:35:53,  3.70it/s]
 12%|█▏        | 43655/371472 [3:28:46<23:59:10,  3.80it/s]
 12%|█▏        | 43656/371472 [3:28:46<23:53:29,  3.81it/s]
 12%|█▏        | 43657/371472 [3:28:46<26:04:06,  3.49it/s]
 12%|█▏        | 43658/371472 [3:28:47<24:59:46,  3.64it/s]
 12%|█▏        | 43659/371472 [3:28:47<24:46:16,  3.68it/s]
 12%|█▏        | 43660/371472 [3:28:47<24:06:00,  3.78it/s]
                                                           
{'loss': 4.3174, 'learning_rate': 8.946486672843628e-07, 'epoch': 1.88}

 12%|█▏        | 43660/371472 [3:28:47<24:06:00,  3.78it/s]
 12%|█▏        | 43661/371472 [3:28:48<29:05:21,  3.13it/s]
 12%|█▏        | 43662/371472 [3:28:48<27:38:34,  3.29it/s]
 12%|█▏        | 43663/371472 [3:28:48<26:24:34,  3.45it/s]
 12%|█▏        | 43664/371472 [3:28:48<26:03:18,  3.49it/s]
 12%|█▏        | 43665/371472 [3:28:49<24:53:42,  3.66it/s]
 12%|█▏        | 43666/371472 [3:28:49<24:40:40,  3.69it/s]
 12%|█▏        | 43667/371472 [3:28:49<24:34:42,  3.70it/s]
 12%|█▏        | 43668/371472 [3:28:49<24:26:21,  3.73it/s]
 12%|█▏        | 43669/371472 [3:28:50<24:45:39,  3.68it/s]
 12%|█▏        | 43670/371472 [3:28:50<25:13:54,  3.61it/s]
 12%|█▏        | 43671/371472 [3:28:50<25:39:46,  3.55it/s]
 12%|█▏        | 43672/371472 [3:28:51<25:52:06,  3.52it/s]
 12%|█▏        | 43673/371472 [3:28:51<26:41:17,  3.41it/s]
 12%|█▏        | 43674/371472 [3:28:51<26:21:43,  3.45it/s]
 12%|█▏        | 43675/371472 [3:28:51<26:21:06,  3.46it/s]
 12%|█▏        | 43676/371472 [3:28:52<26:32:05,  3.43it/s]
 12%|█▏        | 43677/371472 [3:28:52<26:04:51,  3.49it/s]
 12%|█▏        | 43678/371472 [3:28:52<30:24:49,  2.99it/s]
 12%|█▏        | 43679/371472 [3:28:53<28:02:43,  3.25it/s]
 12%|█▏        | 43680/371472 [3:28:53<26:28:16,  3.44it/s]
                                                           
{'loss': 4.3217, 'learning_rate': 8.94600185308884e-07, 'epoch': 1.88}

 12%|█▏        | 43680/371472 [3:28:53<26:28:16,  3.44it/s]
 12%|█▏        | 43681/371472 [3:28:53<25:55:49,  3.51it/s]
 12%|█▏        | 43682/371472 [3:28:53<25:30:10,  3.57it/s]
 12%|█▏        | 43683/371472 [3:28:54<25:08:53,  3.62it/s]
 12%|█▏        | 43684/371472 [3:28:54<24:55:17,  3.65it/s]
 12%|█▏        | 43685/371472 [3:28:54<25:39:32,  3.55it/s]
 12%|█▏        | 43686/371472 [3:28:55<27:17:41,  3.34it/s]
 12%|█▏        | 43687/371472 [3:28:55<28:12:35,  3.23it/s]
 12%|█▏        | 43688/371472 [3:28:55<26:54:50,  3.38it/s]
 12%|█▏        | 43689/371472 [3:28:56<27:11:07,  3.35it/s]
 12%|█▏        | 43690/371472 [3:28:56<26:22:46,  3.45it/s]
 12%|█▏        | 43691/371472 [3:28:56<25:08:05,  3.62it/s]
 12%|█▏        | 43692/371472 [3:28:56<25:14:34,  3.61it/s]
 12%|█▏        | 43693/371472 [3:28:57<25:18:02,  3.60it/s]
 12%|█▏        | 43694/371472 [3:28:57<25:06:43,  3.63it/s]
 12%|█▏        | 43695/371472 [3:28:57<28:55:53,  3.15it/s]
 12%|█▏        | 43696/371472 [3:28:58<27:08:50,  3.35it/s]
 12%|█▏        | 43697/371472 [3:28:58<26:10:00,  3.48it/s]
 12%|█▏        | 43698/371472 [3:28:58<25:45:38,  3.53it/s]
 12%|█▏        | 43699/371472 [3:28:58<25:35:04,  3.56it/s]
 12%|█▏        | 43700/371472 [3:28:59<25:51:23,  3.52it/s]
                                                           
{'loss': 4.4135, 'learning_rate': 8.945517033334051e-07, 'epoch': 1.88}

 12%|█▏        | 43700/371472 [3:28:59<25:51:23,  3.52it/s]
 12%|█▏        | 43701/371472 [3:28:59<25:59:45,  3.50it/s]
 12%|█▏        | 43702/371472 [3:28:59<24:54:05,  3.66it/s]
 12%|█▏        | 43703/371472 [3:28:59<25:06:08,  3.63it/s]
 12%|█▏        | 43704/371472 [3:29:00<24:27:32,  3.72it/s]
 12%|█▏        | 43705/371472 [3:29:00<26:08:35,  3.48it/s]
 12%|█▏        | 43706/371472 [3:29:00<27:03:42,  3.36it/s]
 12%|█▏        | 43707/371472 [3:29:01<28:02:48,  3.25it/s]
 12%|█▏        | 43708/371472 [3:29:01<26:53:39,  3.39it/s]
 12%|█▏        | 43709/371472 [3:29:01<25:45:19,  3.53it/s]
 12%|█▏        | 43710/371472 [3:29:02<26:54:11,  3.38it/s]
 12%|█▏        | 43711/371472 [3:29:02<26:46:51,  3.40it/s]
 12%|█▏        | 43712/371472 [3:29:02<28:41:35,  3.17it/s]
 12%|█▏        | 43713/371472 [3:29:02<27:18:18,  3.33it/s]
 12%|█▏        | 43714/371472 [3:29:03<26:08:31,  3.48it/s]
 12%|█▏        | 43715/371472 [3:29:03<24:43:57,  3.68it/s]
 12%|█▏        | 43716/371472 [3:29:03<24:01:52,  3.79it/s]
 12%|█▏        | 43717/371472 [3:29:03<24:04:05,  3.78it/s]
 12%|█▏        | 43718/371472 [3:29:04<23:40:06,  3.85it/s]
 12%|█▏        | 43719/371472 [3:29:04<23:51:36,  3.82it/s]
 12%|█▏        | 43720/371472 [3:29:04<24:30:38,  3.71it/s]
                                                           
{'loss': 4.2409, 'learning_rate': 8.945032213579262e-07, 'epoch': 1.88}

 12%|█▏        | 43720/371472 [3:29:04<24:30:38,  3.71it/s]
 12%|█▏        | 43721/371472 [3:29:05<24:23:26,  3.73it/s]
 12%|█▏        | 43722/371472 [3:29:05<25:01:50,  3.64it/s]
 12%|█▏        | 43723/371472 [3:29:05<26:30:27,  3.43it/s]
 12%|█▏        | 43724/371472 [3:29:05<26:24:36,  3.45it/s]
 12%|█▏        | 43725/371472 [3:29:06<25:43:46,  3.54it/s]
 12%|█▏        | 43726/371472 [3:29:06<25:30:30,  3.57it/s]
 12%|█▏        | 43727/371472 [3:29:06<26:49:17,  3.39it/s]
 12%|█▏        | 43728/371472 [3:29:07<26:50:03,  3.39it/s]
 12%|█▏        | 43729/371472 [3:29:07<26:24:37,  3.45it/s]
 12%|█▏        | 43730/371472 [3:29:07<27:09:50,  3.35it/s]
 12%|█▏        | 43731/371472 [3:29:08<27:39:48,  3.29it/s]
 12%|█▏        | 43732/371472 [3:29:08<26:45:43,  3.40it/s]
 12%|█▏        | 43733/371472 [3:29:08<25:49:28,  3.53it/s]
 12%|█▏        | 43734/371472 [3:29:08<26:29:02,  3.44it/s]
 12%|█▏        | 43735/371472 [3:29:09<26:07:49,  3.48it/s]
 12%|█▏        | 43736/371472 [3:29:09<25:19:58,  3.59it/s]
 12%|█▏        | 43737/371472 [3:29:09<25:04:42,  3.63it/s]
 12%|█▏        | 43738/371472 [3:29:09<24:17:23,  3.75it/s]
 12%|█▏        | 43739/371472 [3:29:10<25:07:35,  3.62it/s]
 12%|█▏        | 43740/371472 [3:29:10<27:24:35,  3.32it/s]
                                                           
{'loss': 4.4634, 'learning_rate': 8.944547393824473e-07, 'epoch': 1.88}

 12%|█▏        | 43740/371472 [3:29:10<27:24:35,  3.32it/s]
 12%|█▏        | 43741/371472 [3:29:10<26:31:38,  3.43it/s]
 12%|█▏        | 43742/371472 [3:29:11<25:18:31,  3.60it/s]
 12%|█▏        | 43743/371472 [3:29:11<26:02:53,  3.49it/s]
 12%|█▏        | 43744/371472 [3:29:11<25:37:35,  3.55it/s]
 12%|█▏        | 43745/371472 [3:29:11<25:22:55,  3.59it/s]
 12%|█▏        | 43746/371472 [3:29:12<25:25:28,  3.58it/s]
 12%|█▏        | 43747/371472 [3:29:12<25:48:06,  3.53it/s]
 12%|█▏        | 43748/371472 [3:29:12<28:10:58,  3.23it/s]
 12%|█▏        | 43749/371472 [3:29:13<26:53:05,  3.39it/s]
 12%|█▏        | 43750/371472 [3:29:13<26:19:36,  3.46it/s]
 12%|█▏        | 43751/371472 [3:29:13<26:00:01,  3.50it/s]
 12%|█▏        | 43752/371472 [3:29:14<26:57:37,  3.38it/s]
 12%|█▏        | 43753/371472 [3:29:14<27:09:16,  3.35it/s]
 12%|█▏        | 43754/371472 [3:29:14<26:31:01,  3.43it/s]
 12%|█▏        | 43755/371472 [3:29:14<25:55:00,  3.51it/s]
 12%|█▏        | 43756/371472 [3:29:15<26:58:09,  3.38it/s]
 12%|█▏        | 43757/371472 [3:29:15<26:48:38,  3.40it/s]
 12%|█▏        | 43758/371472 [3:29:15<26:15:49,  3.47it/s]
 12%|█▏        | 43759/371472 [3:29:16<25:19:11,  3.60it/s]
 12%|█▏        | 43760/371472 [3:29:16<27:49:54,  3.27it/s]
                                                           
{'loss': 4.2902, 'learning_rate': 8.944062574069685e-07, 'epoch': 1.88}

 12%|█▏        | 43760/371472 [3:29:16<27:49:54,  3.27it/s]
 12%|█▏        | 43761/371472 [3:29:16<26:07:38,  3.48it/s]
 12%|█▏        | 43762/371472 [3:29:16<25:40:23,  3.55it/s]
 12%|█▏        | 43763/371472 [3:29:17<25:02:17,  3.64it/s]
 12%|█▏        | 43764/371472 [3:29:17<26:32:41,  3.43it/s]
 12%|█▏        | 43765/371472 [3:29:17<26:41:50,  3.41it/s]
 12%|█▏        | 43766/371472 [3:29:18<27:41:39,  3.29it/s]
 12%|█▏        | 43767/371472 [3:29:18<26:29:41,  3.44it/s]
 12%|█▏        | 43768/371472 [3:29:18<25:42:04,  3.54it/s]
 12%|█▏        | 43769/371472 [3:29:18<25:10:43,  3.62it/s]
 12%|█▏        | 43770/371472 [3:29:19<24:43:09,  3.68it/s]
 12%|█▏        | 43771/371472 [3:29:19<26:18:36,  3.46it/s]
 12%|█▏        | 43772/371472 [3:29:19<26:12:45,  3.47it/s]
 12%|█▏        | 43773/371472 [3:29:20<25:41:27,  3.54it/s]
 12%|█▏        | 43774/371472 [3:29:20<24:52:11,  3.66it/s]
 12%|█▏        | 43775/371472 [3:29:20<24:19:50,  3.74it/s]
 12%|█▏        | 43776/371472 [3:29:20<23:56:47,  3.80it/s]
 12%|█▏        | 43777/371472 [3:29:21<25:29:25,  3.57it/s]
 12%|█▏        | 43778/371472 [3:29:21<25:28:37,  3.57it/s]
 12%|█▏        | 43779/371472 [3:29:21<24:24:36,  3.73it/s]
 12%|█▏        | 43780/371472 [3:29:21<24:56:08,  3.65it/s]
                                                           
{'loss': 4.296, 'learning_rate': 8.943577754314895e-07, 'epoch': 1.89}

 12%|█▏        | 43780/371472 [3:29:21<24:56:08,  3.65it/s]
 12%|█▏        | 43781/371472 [3:29:22<24:57:41,  3.65it/s]
 12%|█▏        | 43782/371472 [3:29:22<24:14:46,  3.75it/s]
 12%|█▏        | 43783/371472 [3:29:22<24:31:14,  3.71it/s]
 12%|█▏        | 43784/371472 [3:29:23<24:42:10,  3.68it/s]
 12%|█▏        | 43785/371472 [3:29:23<24:53:09,  3.66it/s]
 12%|█▏        | 43786/371472 [3:29:23<24:49:41,  3.67it/s]
 12%|█▏        | 43787/371472 [3:29:23<27:32:34,  3.30it/s]
 12%|█▏        | 43788/371472 [3:29:24<27:43:49,  3.28it/s]
 12%|█▏        | 43789/371472 [3:29:24<26:31:58,  3.43it/s]
 12%|█▏        | 43790/371472 [3:29:24<27:09:41,  3.35it/s]
 12%|█▏        | 43791/371472 [3:29:25<27:03:31,  3.36it/s]
 12%|█▏        | 43792/371472 [3:29:25<26:54:34,  3.38it/s]
 12%|█▏        | 43793/371472 [3:29:25<26:28:11,  3.44it/s]
 12%|█▏        | 43794/371472 [3:29:25<26:10:59,  3.48it/s]
 12%|█▏        | 43795/371472 [3:29:26<26:15:04,  3.47it/s]
 12%|█▏        | 43796/371472 [3:29:26<25:57:24,  3.51it/s]
 12%|█▏        | 43797/371472 [3:29:26<26:18:17,  3.46it/s]
 12%|█▏        | 43798/371472 [3:29:27<25:33:03,  3.56it/s]
 12%|█▏        | 43799/371472 [3:29:27<24:32:24,  3.71it/s]
 12%|█▏        | 43800/371472 [3:29:27<24:45:28,  3.68it/s]
                                                           
{'loss': 4.2914, 'learning_rate': 8.943092934560107e-07, 'epoch': 1.89}

 12%|█▏        | 43800/371472 [3:29:27<24:45:28,  3.68it/s]
 12%|█▏        | 43801/371472 [3:29:27<25:57:53,  3.51it/s]
 12%|█▏        | 43802/371472 [3:29:28<25:41:02,  3.54it/s]
 12%|█▏        | 43803/371472 [3:29:28<27:17:01,  3.34it/s]
 12%|█▏        | 43804/371472 [3:29:28<27:11:26,  3.35it/s]
 12%|█▏        | 43805/371472 [3:29:29<26:21:02,  3.45it/s]
 12%|█▏        | 43806/371472 [3:29:29<26:42:46,  3.41it/s]
 12%|█▏        | 43807/371472 [3:29:29<26:06:24,  3.49it/s]
 12%|█▏        | 43808/371472 [3:29:29<26:07:41,  3.48it/s]
 12%|█▏        | 43809/371472 [3:29:30<25:24:49,  3.58it/s]
 12%|█▏        | 43810/371472 [3:29:30<25:17:29,  3.60it/s]
 12%|█▏        | 43811/371472 [3:29:30<25:08:04,  3.62it/s]
 12%|█▏        | 43812/371472 [3:29:31<24:48:58,  3.67it/s]
 12%|█▏        | 43813/371472 [3:29:31<24:53:54,  3.66it/s]
 12%|█▏        | 43814/371472 [3:29:31<24:55:18,  3.65it/s]
 12%|█▏        | 43815/371472 [3:29:31<25:05:14,  3.63it/s]
 12%|█▏        | 43816/371472 [3:29:32<25:02:24,  3.63it/s]
 12%|█▏        | 43817/371472 [3:29:32<24:11:44,  3.76it/s]
 12%|█▏        | 43818/371472 [3:29:32<26:18:16,  3.46it/s]
 12%|█▏        | 43819/371472 [3:29:33<26:06:50,  3.49it/s]
 12%|█▏        | 43820/371472 [3:29:33<25:28:17,  3.57it/s]
                                                           
{'loss': 4.2811, 'learning_rate': 8.942608114805317e-07, 'epoch': 1.89}

 12%|█▏        | 43820/371472 [3:29:33<25:28:17,  3.57it/s]
 12%|█▏        | 43821/371472 [3:29:33<25:03:07,  3.63it/s]
 12%|█▏        | 43822/371472 [3:29:33<24:45:12,  3.68it/s]
 12%|█▏        | 43823/371472 [3:29:34<24:07:12,  3.77it/s]
 12%|█▏        | 43824/371472 [3:29:34<23:35:25,  3.86it/s]
 12%|█▏        | 43825/371472 [3:29:34<23:18:28,  3.90it/s]
 12%|█▏        | 43826/371472 [3:29:34<25:13:10,  3.61it/s]
 12%|█▏        | 43827/371472 [3:29:35<24:47:45,  3.67it/s]
 12%|█▏        | 43828/371472 [3:29:35<24:30:26,  3.71it/s]
 12%|█▏        | 43829/371472 [3:29:35<25:21:05,  3.59it/s]
 12%|█▏        | 43830/371472 [3:29:36<26:04:34,  3.49it/s]
 12%|█▏        | 43831/371472 [3:29:36<26:05:44,  3.49it/s]
 12%|█▏        | 43832/371472 [3:29:36<24:51:14,  3.66it/s]
 12%|█▏        | 43833/371472 [3:29:36<25:28:24,  3.57it/s]
 12%|█▏        | 43834/371472 [3:29:37<26:43:52,  3.40it/s]
 12%|█▏        | 43835/371472 [3:29:37<26:50:37,  3.39it/s]
 12%|█▏        | 43836/371472 [3:29:37<26:22:57,  3.45it/s]
 12%|█▏        | 43837/371472 [3:29:38<29:57:06,  3.04it/s]
 12%|█▏        | 43838/371472 [3:29:38<27:59:39,  3.25it/s]
 12%|█▏        | 43839/371472 [3:29:38<27:28:47,  3.31it/s]
 12%|█▏        | 43840/371472 [3:29:38<26:44:30,  3.40it/s]
                                                           
{'loss': 4.4442, 'learning_rate': 8.942123295050528e-07, 'epoch': 1.89}

 12%|█▏        | 43840/371472 [3:29:38<26:44:30,  3.40it/s]
 12%|█▏        | 43841/371472 [3:29:39<25:58:13,  3.50it/s]
 12%|█▏        | 43842/371472 [3:29:39<26:23:12,  3.45it/s]
 12%|█▏        | 43843/371472 [3:29:39<25:35:52,  3.56it/s]
 12%|█▏        | 43844/371472 [3:29:40<26:12:55,  3.47it/s]
 12%|█▏        | 43845/371472 [3:29:40<26:28:18,  3.44it/s]
 12%|█▏        | 43846/371472 [3:29:40<26:21:25,  3.45it/s]
 12%|█▏        | 43847/371472 [3:29:40<25:16:50,  3.60it/s]
 12%|█▏        | 43848/371472 [3:29:41<24:29:44,  3.72it/s]
 12%|█▏        | 43849/371472 [3:29:41<24:06:24,  3.78it/s]
 12%|█▏        | 43850/371472 [3:29:41<24:28:39,  3.72it/s]
 12%|█▏        | 43851/371472 [3:29:42<26:18:37,  3.46it/s]
 12%|█▏        | 43852/371472 [3:29:42<26:26:28,  3.44it/s]
 12%|█▏        | 43853/371472 [3:29:42<26:16:47,  3.46it/s]
 12%|█▏        | 43854/371472 [3:29:42<25:17:25,  3.60it/s]
 12%|█▏        | 43855/371472 [3:29:43<26:44:14,  3.40it/s]
 12%|█▏        | 43856/371472 [3:29:43<25:38:47,  3.55it/s]
 12%|█▏        | 43857/371472 [3:29:43<25:11:43,  3.61it/s]
 12%|█▏        | 43858/371472 [3:29:44<25:24:21,  3.58it/s]
 12%|█▏        | 43859/371472 [3:29:44<26:39:08,  3.41it/s]
 12%|█▏        | 43860/371472 [3:29:44<25:38:53,  3.55it/s]
                                                           
{'loss': 4.2375, 'learning_rate': 8.94163847529574e-07, 'epoch': 1.89}

 12%|█▏        | 43860/371472 [3:29:44<25:38:53,  3.55it/s]
 12%|█▏        | 43861/371472 [3:29:44<25:24:24,  3.58it/s]
 12%|█▏        | 43862/371472 [3:29:45<26:13:10,  3.47it/s]
 12%|█▏        | 43863/371472 [3:29:45<25:33:39,  3.56it/s]
 12%|█▏        | 43864/371472 [3:29:45<25:11:31,  3.61it/s]
 12%|█▏        | 43865/371472 [3:29:45<24:33:51,  3.70it/s]
 12%|█▏        | 43866/371472 [3:29:46<25:14:27,  3.61it/s]
 12%|█▏        | 43867/371472 [3:29:46<25:15:24,  3.60it/s]
 12%|█▏        | 43868/371472 [3:29:46<25:25:43,  3.58it/s]
 12%|█▏        | 43869/371472 [3:29:47<26:56:52,  3.38it/s]
 12%|█▏        | 43870/371472 [3:29:47<26:26:29,  3.44it/s]
 12%|█▏        | 43871/371472 [3:29:47<25:31:44,  3.56it/s]
 12%|█▏        | 43872/371472 [3:29:47<25:58:07,  3.50it/s]
 12%|█▏        | 43873/371472 [3:29:48<25:53:36,  3.51it/s]
 12%|█▏        | 43874/371472 [3:29:48<27:48:55,  3.27it/s]
 12%|█▏        | 43875/371472 [3:29:49<29:38:08,  3.07it/s]
 12%|█▏        | 43876/371472 [3:29:49<27:42:27,  3.28it/s]
 12%|█▏        | 43877/371472 [3:29:49<28:20:32,  3.21it/s]
 12%|█▏        | 43878/371472 [3:29:49<30:18:48,  3.00it/s]
 12%|█▏        | 43879/371472 [3:29:50<28:51:50,  3.15it/s]
 12%|█▏        | 43880/371472 [3:29:50<26:54:46,  3.38it/s]
                                                           
{'loss': 4.202, 'learning_rate': 8.941153655540952e-07, 'epoch': 1.89}

 12%|█▏        | 43880/371472 [3:29:50<26:54:46,  3.38it/s]
 12%|█▏        | 43881/371472 [3:29:50<28:30:24,  3.19it/s]
 12%|█▏        | 43882/371472 [3:29:51<27:09:00,  3.35it/s]
 12%|█▏        | 43883/371472 [3:29:51<26:54:38,  3.38it/s]
 12%|█▏        | 43884/371472 [3:29:51<25:53:57,  3.51it/s]
 12%|█▏        | 43885/371472 [3:29:51<25:09:37,  3.62it/s]
 12%|█▏        | 43886/371472 [3:29:52<25:49:44,  3.52it/s]
 12%|█▏        | 43887/371472 [3:29:52<25:30:13,  3.57it/s]
 12%|█▏        | 43888/371472 [3:29:52<26:32:01,  3.43it/s]
 12%|█▏        | 43889/371472 [3:29:53<26:20:34,  3.45it/s]
 12%|█▏        | 43890/371472 [3:29:53<27:31:23,  3.31it/s]
 12%|█▏        | 43891/371472 [3:29:53<28:23:51,  3.20it/s]
 12%|█▏        | 43892/371472 [3:29:54<29:19:38,  3.10it/s]
 12%|█▏        | 43893/371472 [3:29:54<27:22:42,  3.32it/s]
 12%|█▏        | 43894/371472 [3:29:54<26:01:15,  3.50it/s]
 12%|█▏        | 43895/371472 [3:29:54<27:08:48,  3.35it/s]
 12%|█▏        | 43896/371472 [3:29:55<28:00:53,  3.25it/s]
 12%|█▏        | 43897/371472 [3:29:55<27:31:26,  3.31it/s]
 12%|█▏        | 43898/371472 [3:29:55<26:22:51,  3.45it/s]
 12%|█▏        | 43899/371472 [3:29:56<25:48:39,  3.53it/s]
 12%|█▏        | 43900/371472 [3:29:56<25:02:36,  3.63it/s]
                                                           
{'loss': 4.2511, 'learning_rate': 8.940668835786162e-07, 'epoch': 1.89}

 12%|█▏        | 43900/371472 [3:29:56<25:02:36,  3.63it/s]
 12%|█▏        | 43901/371472 [3:29:56<26:09:03,  3.48it/s]
 12%|█▏        | 43902/371472 [3:29:56<26:06:59,  3.48it/s]
 12%|█▏        | 43903/371472 [3:29:57<25:14:04,  3.61it/s]
 12%|█▏        | 43904/371472 [3:29:57<25:16:23,  3.60it/s]
 12%|█▏        | 43905/371472 [3:29:57<26:37:29,  3.42it/s]
 12%|█▏        | 43906/371472 [3:29:58<26:34:14,  3.42it/s]
 12%|█▏        | 43907/371472 [3:29:58<26:21:00,  3.45it/s]
 12%|█▏        | 43908/371472 [3:29:58<27:11:57,  3.35it/s]
 12%|█▏        | 43909/371472 [3:29:58<26:16:37,  3.46it/s]
 12%|█▏        | 43910/371472 [3:29:59<26:07:09,  3.48it/s]
 12%|█▏        | 43911/371472 [3:29:59<25:11:33,  3.61it/s]
 12%|█▏        | 43912/371472 [3:29:59<26:12:40,  3.47it/s]
 12%|█▏        | 43913/371472 [3:30:00<28:37:52,  3.18it/s]
 12%|█▏        | 43914/371472 [3:30:00<28:02:09,  3.25it/s]
 12%|█▏        | 43915/371472 [3:30:00<26:17:25,  3.46it/s]
 12%|█▏        | 43916/371472 [3:30:00<25:27:15,  3.57it/s]
 12%|█▏        | 43917/371472 [3:30:01<24:54:31,  3.65it/s]
 12%|█▏        | 43918/371472 [3:30:01<26:31:35,  3.43it/s]
 12%|█▏        | 43919/371472 [3:30:01<27:27:11,  3.31it/s]
 12%|█▏        | 43920/371472 [3:30:02<27:38:23,  3.29it/s]
                                                           
{'loss': 4.2208, 'learning_rate': 8.940184016031372e-07, 'epoch': 1.89}

 12%|█▏        | 43920/371472 [3:30:02<27:38:23,  3.29it/s]
 12%|█▏        | 43921/371472 [3:30:02<26:37:34,  3.42it/s]
 12%|█▏        | 43922/371472 [3:30:02<26:09:32,  3.48it/s]
 12%|█▏        | 43923/371472 [3:30:03<24:59:00,  3.64it/s]
 12%|█▏        | 43924/371472 [3:30:03<24:28:57,  3.72it/s]
 12%|█▏        | 43925/371472 [3:30:03<24:29:25,  3.72it/s]
 12%|█▏        | 43926/371472 [3:30:03<25:15:53,  3.60it/s]
 12%|█▏        | 43927/371472 [3:30:04<24:56:20,  3.65it/s]
 12%|█▏        | 43928/371472 [3:30:04<24:33:01,  3.71it/s]
 12%|█▏        | 43929/371472 [3:30:04<24:32:52,  3.71it/s]
 12%|█▏        | 43930/371472 [3:30:04<26:17:38,  3.46it/s]
 12%|█▏        | 43931/371472 [3:30:05<25:34:17,  3.56it/s]
 12%|█▏        | 43932/371472 [3:30:05<26:26:03,  3.44it/s]
 12%|█▏        | 43933/371472 [3:30:05<26:01:34,  3.50it/s]
 12%|█▏        | 43934/371472 [3:30:06<26:20:47,  3.45it/s]
 12%|█▏        | 43935/371472 [3:30:06<25:43:48,  3.54it/s]
 12%|█▏        | 43936/371472 [3:30:06<26:22:23,  3.45it/s]
 12%|█▏        | 43937/371472 [3:30:06<25:13:02,  3.61it/s]
 12%|█▏        | 43938/371472 [3:30:07<27:49:33,  3.27it/s]
 12%|█▏        | 43939/371472 [3:30:07<27:36:54,  3.29it/s]
 12%|█▏        | 43940/371472 [3:30:07<25:48:44,  3.52it/s]
                                                           
{'loss': 4.4483, 'learning_rate': 8.939699196276584e-07, 'epoch': 1.89}

 12%|█▏        | 43940/371472 [3:30:07<25:48:44,  3.52it/s]
 12%|█▏        | 43941/371472 [3:30:08<26:05:46,  3.49it/s]
 12%|█▏        | 43942/371472 [3:30:08<25:53:26,  3.51it/s]
 12%|█▏        | 43943/371472 [3:30:08<25:48:42,  3.52it/s]
 12%|█▏        | 43944/371472 [3:30:09<26:44:26,  3.40it/s]
 12%|█▏        | 43945/371472 [3:30:09<26:03:41,  3.49it/s]
 12%|█▏        | 43946/371472 [3:30:09<25:44:30,  3.53it/s]
 12%|█▏        | 43947/371472 [3:30:09<25:15:15,  3.60it/s]
 12%|█▏        | 43948/371472 [3:30:10<26:02:09,  3.49it/s]
 12%|█▏        | 43949/371472 [3:30:10<25:24:28,  3.58it/s]
 12%|█▏        | 43950/371472 [3:30:10<25:14:10,  3.61it/s]
 12%|█▏        | 43951/371472 [3:30:10<25:12:41,  3.61it/s]
 12%|█▏        | 43952/371472 [3:30:11<25:58:07,  3.50it/s]
 12%|█▏        | 43953/371472 [3:30:11<25:31:09,  3.57it/s]
 12%|█▏        | 43954/371472 [3:30:11<24:26:02,  3.72it/s]
 12%|█▏        | 43955/371472 [3:30:12<24:44:18,  3.68it/s]
 12%|█▏        | 43956/371472 [3:30:12<24:01:33,  3.79it/s]
 12%|█▏        | 43957/371472 [3:30:12<25:09:17,  3.62it/s]
 12%|█▏        | 43958/371472 [3:30:12<27:35:49,  3.30it/s]
 12%|█▏        | 43959/371472 [3:30:13<26:09:58,  3.48it/s]
 12%|█▏        | 43960/371472 [3:30:13<27:52:31,  3.26it/s]
                                                           
{'loss': 4.2544, 'learning_rate': 8.939214376521794e-07, 'epoch': 1.89}

 12%|█▏        | 43960/371472 [3:30:13<27:52:31,  3.26it/s]
 12%|█▏        | 43961/371472 [3:30:13<26:46:11,  3.40it/s]
 12%|█▏        | 43962/371472 [3:30:14<27:54:11,  3.26it/s]
 12%|█▏        | 43963/371472 [3:30:14<27:11:00,  3.35it/s]
 12%|█▏        | 43964/371472 [3:30:14<27:34:58,  3.30it/s]
 12%|█▏        | 43965/371472 [3:30:15<26:40:03,  3.41it/s]
 12%|█▏        | 43966/371472 [3:30:15<26:54:29,  3.38it/s]
 12%|█▏        | 43967/371472 [3:30:15<26:58:08,  3.37it/s]
 12%|█▏        | 43968/371472 [3:30:15<26:01:23,  3.50it/s]
 12%|█▏        | 43969/371472 [3:30:16<25:34:11,  3.56it/s]
 12%|█▏        | 43970/371472 [3:30:16<26:02:42,  3.49it/s]
 12%|█▏        | 43971/371472 [3:30:16<26:00:18,  3.50it/s]
 12%|█▏        | 43972/371472 [3:30:17<28:24:25,  3.20it/s]
 12%|█▏        | 43973/371472 [3:30:17<26:42:43,  3.41it/s]
 12%|█▏        | 43974/371472 [3:30:17<26:12:22,  3.47it/s]
 12%|█▏        | 43975/371472 [3:30:17<25:30:05,  3.57it/s]
 12%|█▏        | 43976/371472 [3:30:18<25:22:22,  3.59it/s]
 12%|█▏        | 43977/371472 [3:30:18<25:05:25,  3.63it/s]
 12%|█▏        | 43978/371472 [3:30:18<25:11:33,  3.61it/s]
 12%|█▏        | 43979/371472 [3:30:19<26:40:28,  3.41it/s]
 12%|█▏        | 43980/371472 [3:30:19<25:52:25,  3.52it/s]
                                                           
{'loss': 4.3998, 'learning_rate': 8.938729556767006e-07, 'epoch': 1.89}

 12%|█▏        | 43980/371472 [3:30:19<25:52:25,  3.52it/s]
 12%|█▏        | 43981/371472 [3:30:19<25:30:07,  3.57it/s]
 12%|█▏        | 43982/371472 [3:30:19<25:23:26,  3.58it/s]
 12%|█▏        | 43983/371472 [3:30:20<25:22:48,  3.58it/s]
 12%|█▏        | 43984/371472 [3:30:20<26:20:40,  3.45it/s]
 12%|█▏        | 43985/371472 [3:30:20<25:02:42,  3.63it/s]
 12%|█▏        | 43986/371472 [3:30:20<25:01:05,  3.64it/s]
 12%|█▏        | 43987/371472 [3:30:21<24:52:28,  3.66it/s]
 12%|█▏        | 43988/371472 [3:30:21<24:56:31,  3.65it/s]
 12%|█▏        | 43989/371472 [3:30:21<26:43:56,  3.40it/s]
 12%|█▏        | 43990/371472 [3:30:22<25:53:18,  3.51it/s]
 12%|█▏        | 43991/371472 [3:30:22<25:42:50,  3.54it/s]
 12%|█▏        | 43992/371472 [3:30:22<24:53:43,  3.65it/s]
 12%|█▏        | 43993/371472 [3:30:22<25:39:59,  3.54it/s]
 12%|█▏        | 43994/371472 [3:30:23<24:46:58,  3.67it/s]
 12%|█▏        | 43995/371472 [3:30:23<26:47:10,  3.40it/s]
 12%|█▏        | 43996/371472 [3:30:23<26:47:23,  3.40it/s]
 12%|█▏        | 43997/371472 [3:30:24<26:43:53,  3.40it/s]
 12%|█▏        | 43998/371472 [3:30:24<25:53:21,  3.51it/s]
 12%|█▏        | 43999/371472 [3:30:24<26:02:12,  3.49it/s]
 12%|█▏        | 44000/371472 [3:30:24<26:03:23,  3.49it/s]
                                                           
{'loss': 4.3337, 'learning_rate': 8.938244737012217e-07, 'epoch': 1.9}

 12%|█▏        | 44000/371472 [3:30:24<26:03:23,  3.49it/s]
 12%|█▏        | 44001/371472 [3:30:25<25:29:47,  3.57it/s]
 12%|█▏        | 44002/371472 [3:30:25<25:43:30,  3.54it/s]
 12%|█▏        | 44003/371472 [3:30:25<25:03:31,  3.63it/s]
 12%|█▏        | 44004/371472 [3:30:26<24:23:43,  3.73it/s]
 12%|█▏        | 44005/371472 [3:30:26<24:04:57,  3.78it/s]
 12%|█▏        | 44006/371472 [3:30:26<24:22:54,  3.73it/s]
 12%|█▏        | 44007/371472 [3:30:26<24:09:06,  3.77it/s]
 12%|█▏        | 44008/371472 [3:30:27<25:30:44,  3.57it/s]
 12%|█▏        | 44009/371472 [3:30:27<24:52:46,  3.66it/s]
 12%|█▏        | 44010/371472 [3:30:27<24:24:03,  3.73it/s]
 12%|█▏        | 44011/371472 [3:30:27<24:41:10,  3.68it/s]
 12%|█▏        | 44012/371472 [3:30:28<24:42:31,  3.68it/s]
 12%|█▏        | 44013/371472 [3:30:28<24:22:54,  3.73it/s]
 12%|█▏        | 44014/371472 [3:30:28<25:10:45,  3.61it/s]
 12%|█▏        | 44015/371472 [3:30:29<24:53:52,  3.65it/s]
 12%|█▏        | 44016/371472 [3:30:29<25:02:07,  3.63it/s]
 12%|█▏        | 44017/371472 [3:30:29<24:21:51,  3.73it/s]
 12%|█▏        | 44018/371472 [3:30:29<24:33:48,  3.70it/s]
 12%|█▏        | 44019/371472 [3:30:30<23:51:08,  3.81it/s]
 12%|█▏        | 44020/371472 [3:30:30<23:15:04,  3.91it/s]
                                                           
{'loss': 4.5991, 'learning_rate': 8.937759917257429e-07, 'epoch': 1.9}

 12%|█▏        | 44020/371472 [3:30:30<23:15:04,  3.91it/s]
 12%|█▏        | 44021/371472 [3:30:30<23:44:06,  3.83it/s]
 12%|█▏        | 44022/371472 [3:30:30<24:21:00,  3.74it/s]
 12%|█▏        | 44023/371472 [3:30:31<23:59:41,  3.79it/s]
 12%|█▏        | 44024/371472 [3:30:31<23:51:58,  3.81it/s]
 12%|█▏        | 44025/371472 [3:30:31<23:48:19,  3.82it/s]
 12%|█▏        | 44026/371472 [3:30:31<24:05:51,  3.77it/s]
 12%|█▏        | 44027/371472 [3:30:32<24:29:53,  3.71it/s]
 12%|█▏        | 44028/371472 [3:30:32<24:15:39,  3.75it/s]
 12%|█▏        | 44029/371472 [3:30:32<25:56:06,  3.51it/s]
 12%|█▏        | 44030/371472 [3:30:33<25:12:29,  3.61it/s]
 12%|█▏        | 44031/371472 [3:30:33<25:04:04,  3.63it/s]
 12%|█▏        | 44032/371472 [3:30:33<26:36:32,  3.42it/s]
 12%|█▏        | 44033/371472 [3:30:33<25:24:01,  3.58it/s]
 12%|█▏        | 44034/371472 [3:30:34<25:16:48,  3.60it/s]
 12%|█▏        | 44035/371472 [3:30:34<25:27:57,  3.57it/s]
 12%|█▏        | 44036/371472 [3:30:34<24:47:56,  3.67it/s]
 12%|█▏        | 44037/371472 [3:30:35<28:07:50,  3.23it/s]
 12%|█▏        | 44038/371472 [3:30:35<27:16:54,  3.33it/s]
 12%|█▏        | 44039/371472 [3:30:35<26:01:59,  3.49it/s]
 12%|█▏        | 44040/371472 [3:30:35<26:26:25,  3.44it/s]
                                                           
{'loss': 4.4394, 'learning_rate': 8.937275097502637e-07, 'epoch': 1.9}

 12%|█▏        | 44040/371472 [3:30:35<26:26:25,  3.44it/s]
 12%|█▏        | 44041/371472 [3:30:36<27:44:41,  3.28it/s]
 12%|█▏        | 44042/371472 [3:30:36<26:11:03,  3.47it/s]
 12%|█▏        | 44043/371472 [3:30:36<27:05:12,  3.36it/s]
 12%|█▏        | 44044/371472 [3:30:37<26:54:40,  3.38it/s]
 12%|█▏        | 44045/371472 [3:30:37<26:02:40,  3.49it/s]
 12%|█▏        | 44046/371472 [3:30:37<25:48:29,  3.52it/s]
 12%|█▏        | 44047/371472 [3:30:37<25:42:25,  3.54it/s]
 12%|█▏        | 44048/371472 [3:30:38<26:07:06,  3.48it/s]
 12%|█▏        | 44049/371472 [3:30:38<26:02:21,  3.49it/s]
 12%|█▏        | 44050/371472 [3:30:38<26:15:33,  3.46it/s]
 12%|█▏        | 44051/371472 [3:30:39<26:44:26,  3.40it/s]
 12%|█▏        | 44052/371472 [3:30:39<26:41:31,  3.41it/s]
 12%|█▏        | 44053/371472 [3:30:39<25:30:00,  3.57it/s]
 12%|█▏        | 44054/371472 [3:30:39<25:56:46,  3.51it/s]
 12%|█▏        | 44055/371472 [3:30:40<26:23:04,  3.45it/s]
 12%|█▏        | 44056/371472 [3:30:40<25:14:52,  3.60it/s]
 12%|█▏        | 44057/371472 [3:30:40<27:55:41,  3.26it/s]
 12%|█▏        | 44058/371472 [3:30:41<26:54:09,  3.38it/s]
 12%|█▏        | 44059/371472 [3:30:41<25:21:06,  3.59it/s]
 12%|█▏        | 44060/371472 [3:30:41<25:39:07,  3.55it/s]
                                                           
{'loss': 4.1898, 'learning_rate': 8.93679027774785e-07, 'epoch': 1.9}

 12%|█▏        | 44060/371472 [3:30:41<25:39:07,  3.55it/s]
 12%|█▏        | 44061/371472 [3:30:41<24:45:55,  3.67it/s]
 12%|█▏        | 44062/371472 [3:30:42<24:19:57,  3.74it/s]
 12%|█▏        | 44063/371472 [3:30:42<24:34:23,  3.70it/s]
 12%|█▏        | 44064/371472 [3:30:42<24:26:51,  3.72it/s]
 12%|█▏        | 44065/371472 [3:30:43<24:30:15,  3.71it/s]
 12%|█▏        | 44066/371472 [3:30:43<25:16:46,  3.60it/s]
 12%|█▏        | 44067/371472 [3:30:43<26:30:07,  3.43it/s]
 12%|█▏        | 44068/371472 [3:30:43<26:08:26,  3.48it/s]
 12%|█▏        | 44069/371472 [3:30:44<26:15:22,  3.46it/s]
 12%|█▏        | 44070/371472 [3:30:44<28:10:53,  3.23it/s]
 12%|█▏        | 44071/371472 [3:30:45<31:39:44,  2.87it/s]
 12%|█▏        | 44072/371472 [3:30:45<30:01:48,  3.03it/s]
 12%|█▏        | 44073/371472 [3:30:45<30:09:01,  3.02it/s]
 12%|█▏        | 44074/371472 [3:30:45<27:48:30,  3.27it/s]
 12%|█▏        | 44075/371472 [3:30:46<27:01:44,  3.36it/s]
 12%|█▏        | 44076/371472 [3:30:46<25:44:03,  3.53it/s]
 12%|█▏        | 44077/371472 [3:30:46<25:24:25,  3.58it/s]
 12%|█▏        | 44078/371472 [3:30:46<25:52:38,  3.51it/s]
 12%|█▏        | 44079/371472 [3:30:47<26:04:50,  3.49it/s]
 12%|█▏        | 44080/371472 [3:30:47<25:22:01,  3.59it/s]
                                                           
{'loss': 4.2828, 'learning_rate': 8.936305457993061e-07, 'epoch': 1.9}

 12%|█▏        | 44080/371472 [3:30:47<25:22:01,  3.59it/s]
 12%|█▏        | 44081/371472 [3:30:47<24:41:32,  3.68it/s]
 12%|█▏        | 44082/371472 [3:30:48<26:41:07,  3.41it/s]
 12%|█▏        | 44083/371472 [3:30:48<26:49:12,  3.39it/s]
 12%|█▏        | 44084/371472 [3:30:48<30:00:41,  3.03it/s]
 12%|█▏        | 44085/371472 [3:30:49<29:54:59,  3.04it/s]
 12%|█▏        | 44086/371472 [3:30:49<29:48:10,  3.05it/s]
 12%|█▏        | 44087/371472 [3:30:49<28:10:48,  3.23it/s]
 12%|█▏        | 44088/371472 [3:30:50<28:07:27,  3.23it/s]
 12%|█▏        | 44089/371472 [3:30:50<27:32:56,  3.30it/s]
 12%|█▏        | 44090/371472 [3:30:50<28:20:24,  3.21it/s]
 12%|█▏        | 44091/371472 [3:30:50<27:29:39,  3.31it/s]
 12%|█▏        | 44092/371472 [3:30:51<26:11:26,  3.47it/s]
 12%|█▏        | 44093/371472 [3:30:51<25:05:50,  3.62it/s]
 12%|█▏        | 44094/371472 [3:30:51<27:16:34,  3.33it/s]
 12%|█▏        | 44095/371472 [3:30:52<27:00:35,  3.37it/s]
 12%|█▏        | 44096/371472 [3:30:52<28:01:18,  3.25it/s]
 12%|█▏        | 44097/371472 [3:30:52<27:58:23,  3.25it/s]
 12%|█▏        | 44098/371472 [3:30:53<26:33:30,  3.42it/s]
 12%|█▏        | 44099/371472 [3:30:53<26:48:49,  3.39it/s]
 12%|█▏        | 44100/371472 [3:30:53<26:33:23,  3.42it/s]
                                                           
{'loss': 4.5109, 'learning_rate': 8.935820638238273e-07, 'epoch': 1.9}

 12%|█▏        | 44100/371472 [3:30:53<26:33:23,  3.42it/s]
 12%|█▏        | 44101/371472 [3:30:53<27:16:01,  3.34it/s]
 12%|█▏        | 44102/371472 [3:30:54<27:03:11,  3.36it/s]
 12%|█▏        | 44103/371472 [3:30:54<26:43:04,  3.40it/s]
 12%|█▏        | 44104/371472 [3:30:54<25:57:14,  3.50it/s]
 12%|█▏        | 44105/371472 [3:30:55<26:56:18,  3.38it/s]
 12%|█▏        | 44106/371472 [3:30:55<25:49:59,  3.52it/s]
 12%|█▏        | 44107/371472 [3:30:55<25:17:20,  3.60it/s]
 12%|█▏        | 44108/371472 [3:30:55<25:26:40,  3.57it/s]
 12%|█▏        | 44109/371472 [3:30:56<25:21:12,  3.59it/s]
 12%|█▏        | 44110/371472 [3:30:56<26:55:07,  3.38it/s]
 12%|█▏        | 44111/371472 [3:30:56<27:20:58,  3.32it/s]
 12%|█▏        | 44112/371472 [3:30:57<27:10:21,  3.35it/s]
 12%|█▏        | 44113/371472 [3:30:57<26:12:21,  3.47it/s]
 12%|█▏        | 44114/371472 [3:30:57<25:41:08,  3.54it/s]
 12%|█▏        | 44115/371472 [3:30:57<25:40:52,  3.54it/s]
 12%|█▏        | 44116/371472 [3:30:58<26:29:11,  3.43it/s]
 12%|█▏        | 44117/371472 [3:30:58<25:15:13,  3.60it/s]
 12%|█▏        | 44118/371472 [3:30:58<25:21:53,  3.58it/s]
 12%|█▏        | 44119/371472 [3:30:59<24:50:22,  3.66it/s]
 12%|█▏        | 44120/371472 [3:30:59<25:29:15,  3.57it/s]
                                                           
{'loss': 4.4199, 'learning_rate': 8.935335818483483e-07, 'epoch': 1.9}

 12%|█▏        | 44120/371472 [3:30:59<25:29:15,  3.57it/s]
 12%|█▏        | 44121/371472 [3:30:59<26:56:44,  3.37it/s]
 12%|█▏        | 44122/371472 [3:30:59<26:13:45,  3.47it/s]
 12%|█▏        | 44123/371472 [3:31:00<26:24:07,  3.44it/s]
 12%|█▏        | 44124/371472 [3:31:00<27:15:39,  3.34it/s]
 12%|█▏        | 44125/371472 [3:31:00<27:17:50,  3.33it/s]
 12%|█▏        | 44126/371472 [3:31:01<25:42:44,  3.54it/s]
 12%|█▏        | 44127/371472 [3:31:01<25:48:08,  3.52it/s]
 12%|█▏        | 44128/371472 [3:31:01<26:28:15,  3.44it/s]
 12%|█▏        | 44129/371472 [3:31:02<27:51:02,  3.26it/s]
 12%|█▏        | 44130/371472 [3:31:02<26:49:26,  3.39it/s]
 12%|█▏        | 44131/371472 [3:31:02<26:19:13,  3.45it/s]
 12%|█▏        | 44132/371472 [3:31:02<25:31:25,  3.56it/s]
 12%|█▏        | 44133/371472 [3:31:03<25:04:37,  3.63it/s]
 12%|█▏        | 44134/371472 [3:31:03<25:05:11,  3.62it/s]
 12%|█▏        | 44135/371472 [3:31:03<24:54:05,  3.65it/s]
 12%|█▏        | 44136/371472 [3:31:03<25:59:59,  3.50it/s]
 12%|█▏        | 44137/371472 [3:31:04<27:05:25,  3.36it/s]
 12%|█▏        | 44138/371472 [3:31:04<26:42:52,  3.40it/s]
 12%|█▏        | 44139/371472 [3:31:04<26:22:41,  3.45it/s]
 12%|█▏        | 44140/371472 [3:31:05<25:51:18,  3.52it/s]
                                                           
{'loss': 4.2196, 'learning_rate': 8.934850998728695e-07, 'epoch': 1.9}

 12%|█▏        | 44140/371472 [3:31:05<25:51:18,  3.52it/s]
 12%|█▏        | 44141/371472 [3:31:05<26:29:46,  3.43it/s]
 12%|█▏        | 44142/371472 [3:31:05<26:41:15,  3.41it/s]
 12%|█▏        | 44143/371472 [3:31:06<26:55:31,  3.38it/s]
 12%|█▏        | 44144/371472 [3:31:06<25:57:47,  3.50it/s]
 12%|█▏        | 44145/371472 [3:31:06<25:43:40,  3.53it/s]
 12%|█▏        | 44146/371472 [3:31:06<25:19:45,  3.59it/s]
 12%|█▏        | 44147/371472 [3:31:07<25:02:11,  3.63it/s]
 12%|█▏        | 44148/371472 [3:31:07<25:14:42,  3.60it/s]
 12%|█▏        | 44149/371472 [3:31:07<24:19:12,  3.74it/s]
 12%|█▏        | 44150/371472 [3:31:07<24:30:07,  3.71it/s]
 12%|█▏        | 44151/371472 [3:31:08<24:12:47,  3.76it/s]
 12%|█▏        | 44152/371472 [3:31:08<23:32:05,  3.86it/s]
 12%|█▏        | 44153/371472 [3:31:08<24:35:47,  3.70it/s]
 12%|█▏        | 44154/371472 [3:31:08<25:06:22,  3.62it/s]
 12%|█▏        | 44155/371472 [3:31:09<24:43:08,  3.68it/s]
 12%|█▏        | 44156/371472 [3:31:09<24:36:13,  3.70it/s]
 12%|█▏        | 44157/371472 [3:31:09<25:13:35,  3.60it/s]
 12%|█▏        | 44158/371472 [3:31:10<25:02:01,  3.63it/s]
 12%|█▏        | 44159/371472 [3:31:10<25:54:58,  3.51it/s]
 12%|█▏        | 44160/371472 [3:31:10<24:44:31,  3.67it/s]
                                                           
{'loss': 4.4022, 'learning_rate': 8.934366178973905e-07, 'epoch': 1.9}

 12%|█▏        | 44160/371472 [3:31:10<24:44:31,  3.67it/s]
 12%|█▏        | 44161/371472 [3:31:10<24:18:43,  3.74it/s]
 12%|█▏        | 44162/371472 [3:31:11<25:10:37,  3.61it/s]
 12%|█▏        | 44163/371472 [3:31:11<24:52:08,  3.66it/s]
 12%|█▏        | 44164/371472 [3:31:11<25:47:10,  3.53it/s]
 12%|█▏        | 44165/371472 [3:31:12<26:25:22,  3.44it/s]
 12%|█▏        | 44166/371472 [3:31:12<25:34:42,  3.55it/s]
 12%|█▏        | 44167/371472 [3:31:12<25:17:35,  3.59it/s]
 12%|█▏        | 44168/371472 [3:31:12<26:29:30,  3.43it/s]
 12%|█▏        | 44169/371472 [3:31:13<25:47:40,  3.52it/s]
 12%|█▏        | 44170/371472 [3:31:13<25:39:10,  3.54it/s]
 12%|█▏        | 44171/371472 [3:31:13<25:29:20,  3.57it/s]
 12%|█▏        | 44172/371472 [3:31:13<24:58:08,  3.64it/s]
 12%|█▏        | 44173/371472 [3:31:14<25:27:25,  3.57it/s]
 12%|█▏        | 44174/371472 [3:31:14<27:16:18,  3.33it/s]
 12%|█▏        | 44175/371472 [3:31:14<26:12:42,  3.47it/s]
 12%|█▏        | 44176/371472 [3:31:15<25:34:02,  3.56it/s]
 12%|█▏        | 44177/371472 [3:31:15<25:52:54,  3.51it/s]
 12%|█▏        | 44178/371472 [3:31:15<27:49:18,  3.27it/s]
 12%|█▏        | 44179/371472 [3:31:16<27:40:38,  3.28it/s]
 12%|█▏        | 44180/371472 [3:31:16<28:41:17,  3.17it/s]
                                                           
{'loss': 4.2565, 'learning_rate': 8.933881359219117e-07, 'epoch': 1.9}

 12%|█▏        | 44180/371472 [3:31:16<28:41:17,  3.17it/s]
 12%|█▏        | 44181/371472 [3:31:16<29:15:10,  3.11it/s]
 12%|█▏        | 44182/371472 [3:31:17<27:23:01,  3.32it/s]
 12%|█▏        | 44183/371472 [3:31:17<28:03:51,  3.24it/s]
 12%|█▏        | 44184/371472 [3:31:17<27:42:21,  3.28it/s]
 12%|█▏        | 44185/371472 [3:31:17<27:01:37,  3.36it/s]
 12%|█▏        | 44186/371472 [3:31:18<26:32:08,  3.43it/s]
 12%|█▏        | 44187/371472 [3:31:18<27:40:23,  3.29it/s]
 12%|█▏        | 44188/371472 [3:31:18<27:21:05,  3.32it/s]
 12%|█▏        | 44189/371472 [3:31:19<26:26:31,  3.44it/s]
 12%|█▏        | 44190/371472 [3:31:19<26:16:55,  3.46it/s]
 12%|█▏        | 44191/371472 [3:31:19<25:46:43,  3.53it/s]
 12%|█▏        | 44192/371472 [3:31:19<26:01:30,  3.49it/s]
 12%|█▏        | 44193/371472 [3:31:20<27:53:08,  3.26it/s]
 12%|█▏        | 44194/371472 [3:31:20<27:34:51,  3.30it/s]
 12%|█▏        | 44195/371472 [3:31:20<26:47:51,  3.39it/s]
 12%|█▏        | 44196/371472 [3:31:21<27:39:13,  3.29it/s]
 12%|█▏        | 44197/371472 [3:31:21<26:34:42,  3.42it/s]
 12%|█▏        | 44198/371472 [3:31:21<26:26:56,  3.44it/s]
 12%|█▏        | 44199/371472 [3:31:22<26:16:26,  3.46it/s]
 12%|█▏        | 44200/371472 [3:31:22<26:55:37,  3.38it/s]
                                                           
{'loss': 4.1588, 'learning_rate': 8.933396539464327e-07, 'epoch': 1.9}

 12%|█▏        | 44200/371472 [3:31:22<26:55:37,  3.38it/s]
 12%|█▏        | 44201/371472 [3:31:22<25:45:02,  3.53it/s]
 12%|█▏        | 44202/371472 [3:31:22<25:21:24,  3.59it/s]
 12%|█▏        | 44203/371472 [3:31:23<24:35:37,  3.70it/s]
 12%|█▏        | 44204/371472 [3:31:23<24:59:05,  3.64it/s]
 12%|█▏        | 44205/371472 [3:31:23<26:22:34,  3.45it/s]
 12%|█▏        | 44206/371472 [3:31:24<26:44:30,  3.40it/s]
 12%|█▏        | 44207/371472 [3:31:24<25:42:28,  3.54it/s]
 12%|█▏        | 44208/371472 [3:31:24<25:45:10,  3.53it/s]
 12%|█▏        | 44209/371472 [3:31:24<25:28:15,  3.57it/s]
 12%|█▏        | 44210/371472 [3:31:25<25:19:20,  3.59it/s]
 12%|█▏        | 44211/371472 [3:31:25<28:25:58,  3.20it/s]
 12%|█▏        | 44212/371472 [3:31:25<26:59:39,  3.37it/s]
 12%|█▏        | 44213/371472 [3:31:26<26:13:13,  3.47it/s]
 12%|█▏        | 44214/371472 [3:31:26<26:58:36,  3.37it/s]
 12%|█▏        | 44215/371472 [3:31:26<26:25:54,  3.44it/s]
 12%|█▏        | 44216/371472 [3:31:26<26:48:00,  3.39it/s]
 12%|█▏        | 44217/371472 [3:31:27<25:45:20,  3.53it/s]
 12%|█▏        | 44218/371472 [3:31:27<25:58:32,  3.50it/s]
 12%|█▏        | 44219/371472 [3:31:27<25:43:14,  3.53it/s]
 12%|█▏        | 44220/371472 [3:31:28<26:53:25,  3.38it/s]
                                                           
{'loss': 4.3023, 'learning_rate': 8.932911719709539e-07, 'epoch': 1.9}

 12%|█▏        | 44220/371472 [3:31:28<26:53:25,  3.38it/s]
 12%|█▏        | 44221/371472 [3:31:28<25:47:47,  3.52it/s]
 12%|█▏        | 44222/371472 [3:31:28<27:51:29,  3.26it/s]
 12%|█▏        | 44223/371472 [3:31:29<27:45:25,  3.27it/s]
 12%|█▏        | 44224/371472 [3:31:29<26:51:48,  3.38it/s]
 12%|█▏        | 44225/371472 [3:31:29<26:30:22,  3.43it/s]
 12%|█▏        | 44226/371472 [3:31:29<25:27:16,  3.57it/s]
 12%|█▏        | 44227/371472 [3:31:30<24:12:08,  3.76it/s]
 12%|█▏        | 44228/371472 [3:31:30<26:45:26,  3.40it/s]
 12%|█▏        | 44229/371472 [3:31:30<26:44:03,  3.40it/s]
 12%|█▏        | 44230/371472 [3:31:30<26:08:00,  3.48it/s]
 12%|█▏        | 44231/371472 [3:31:31<27:09:21,  3.35it/s]
 12%|█▏        | 44232/371472 [3:31:31<25:39:54,  3.54it/s]
 12%|█▏        | 44233/371472 [3:31:31<27:20:48,  3.32it/s]
 12%|█▏        | 44234/371472 [3:31:32<25:52:32,  3.51it/s]
 12%|█▏        | 44235/371472 [3:31:32<24:59:14,  3.64it/s]
 12%|█▏        | 44236/371472 [3:31:32<24:08:17,  3.77it/s]
 12%|█▏        | 44237/371472 [3:31:32<25:45:49,  3.53it/s]
 12%|█▏        | 44238/371472 [3:31:33<25:07:52,  3.62it/s]
 12%|█▏        | 44239/371472 [3:31:33<25:19:26,  3.59it/s]
 12%|█▏        | 44240/371472 [3:31:33<24:49:27,  3.66it/s]
                                                           
{'loss': 4.4887, 'learning_rate': 8.93242689995475e-07, 'epoch': 1.91}

 12%|█▏        | 44240/371472 [3:31:33<24:49:27,  3.66it/s]
 12%|█▏        | 44241/371472 [3:31:34<24:40:46,  3.68it/s]
 12%|█▏        | 44242/371472 [3:31:34<24:13:35,  3.75it/s]
 12%|█▏        | 44243/371472 [3:31:34<25:40:59,  3.54it/s]
 12%|█▏        | 44244/371472 [3:31:34<28:09:45,  3.23it/s]
 12%|█▏        | 44245/371472 [3:31:35<27:33:36,  3.30it/s]
 12%|█▏        | 44246/371472 [3:31:35<26:58:46,  3.37it/s]
 12%|█▏        | 44247/371472 [3:31:35<26:05:32,  3.48it/s]
 12%|█▏        | 44248/371472 [3:31:36<26:28:27,  3.43it/s]
 12%|█▏        | 44249/371472 [3:31:36<25:31:17,  3.56it/s]
 12%|█▏        | 44250/371472 [3:31:36<25:18:12,  3.59it/s]
 12%|█▏        | 44251/371472 [3:31:36<25:43:34,  3.53it/s]
 12%|█▏        | 44252/371472 [3:31:37<24:40:55,  3.68it/s]
 12%|█▏        | 44253/371472 [3:31:37<24:23:17,  3.73it/s]
 12%|█▏        | 44254/371472 [3:31:37<23:46:34,  3.82it/s]
 12%|█▏        | 44255/371472 [3:31:38<24:54:56,  3.65it/s]
 12%|█▏        | 44256/371472 [3:31:38<25:31:14,  3.56it/s]
 12%|█▏        | 44257/371472 [3:31:38<24:59:32,  3.64it/s]
 12%|█▏        | 44258/371472 [3:31:38<25:13:25,  3.60it/s]
 12%|█▏        | 44259/371472 [3:31:39<24:54:18,  3.65it/s]
 12%|█▏        | 44260/371472 [3:31:39<24:13:41,  3.75it/s]
                                                           
{'loss': 4.4413, 'learning_rate': 8.931942080199962e-07, 'epoch': 1.91}

 12%|█▏        | 44260/371472 [3:31:39<24:13:41,  3.75it/s]
 12%|█▏        | 44261/371472 [3:31:39<24:16:06,  3.75it/s]
 12%|█▏        | 44262/371472 [3:31:39<26:16:04,  3.46it/s]
 12%|█▏        | 44263/371472 [3:31:40<25:43:14,  3.53it/s]
 12%|█▏        | 44264/371472 [3:31:40<26:32:14,  3.43it/s]
 12%|█▏        | 44265/371472 [3:31:40<25:50:58,  3.52it/s]
 12%|█▏        | 44266/371472 [3:31:41<26:05:00,  3.48it/s]
 12%|█▏        | 44267/371472 [3:31:41<25:40:11,  3.54it/s]
 12%|█▏        | 44268/371472 [3:31:41<24:45:01,  3.67it/s]
 12%|█▏        | 44269/371472 [3:31:41<23:58:02,  3.79it/s]
 12%|█▏        | 44270/371472 [3:31:42<27:05:21,  3.36it/s]
 12%|█▏        | 44271/371472 [3:31:42<27:38:28,  3.29it/s]
 12%|█▏        | 44272/371472 [3:31:42<26:02:26,  3.49it/s]
 12%|█▏        | 44273/371472 [3:31:43<25:23:14,  3.58it/s]
 12%|█▏        | 44274/371472 [3:31:43<26:14:08,  3.46it/s]
 12%|█▏        | 44275/371472 [3:31:43<25:22:42,  3.58it/s]
 12%|█▏        | 44276/371472 [3:31:43<25:16:28,  3.60it/s]
 12%|█▏        | 44277/371472 [3:31:44<24:54:42,  3.65it/s]
 12%|█▏        | 44278/371472 [3:31:44<24:50:18,  3.66it/s]
 12%|█▏        | 44279/371472 [3:31:44<25:11:19,  3.61it/s]
 12%|█▏        | 44280/371472 [3:31:45<24:49:21,  3.66it/s]
                                                           
{'loss': 4.549, 'learning_rate': 8.931457260445172e-07, 'epoch': 1.91}

 12%|█▏        | 44280/371472 [3:31:45<24:49:21,  3.66it/s]
 12%|█▏        | 44281/371472 [3:31:45<25:04:40,  3.62it/s]
 12%|█▏        | 44282/371472 [3:31:45<25:35:35,  3.55it/s]
 12%|█▏        | 44283/371472 [3:31:45<28:23:27,  3.20it/s]
 12%|█▏        | 44284/371472 [3:31:46<28:17:58,  3.21it/s]
 12%|█▏        | 44285/371472 [3:31:46<26:44:07,  3.40it/s]
 12%|█▏        | 44286/371472 [3:31:46<26:07:49,  3.48it/s]
 12%|█▏        | 44287/371472 [3:31:47<29:16:18,  3.10it/s]
 12%|█▏        | 44288/371472 [3:31:47<27:51:24,  3.26it/s]
 12%|█▏        | 44289/371472 [3:31:47<27:13:42,  3.34it/s]
 12%|█▏        | 44290/371472 [3:31:48<26:00:47,  3.49it/s]
 12%|█▏        | 44291/371472 [3:31:48<25:37:41,  3.55it/s]
 12%|█▏        | 44292/371472 [3:31:48<25:40:40,  3.54it/s]
 12%|█▏        | 44293/371472 [3:31:48<26:41:19,  3.41it/s]
 12%|█▏        | 44294/371472 [3:31:49<25:43:56,  3.53it/s]
 12%|█▏        | 44295/371472 [3:31:49<25:25:00,  3.58it/s]
 12%|█▏        | 44296/371472 [3:31:49<26:35:12,  3.42it/s]
 12%|█▏        | 44297/371472 [3:31:50<27:22:39,  3.32it/s]
 12%|█▏        | 44298/371472 [3:31:50<26:09:11,  3.47it/s]
 12%|█▏        | 44299/371472 [3:31:50<25:11:49,  3.61it/s]
 12%|█▏        | 44300/371472 [3:31:50<24:52:16,  3.65it/s]
                                                           
{'loss': 4.2645, 'learning_rate': 8.930972440690383e-07, 'epoch': 1.91}

 12%|█▏        | 44300/371472 [3:31:50<24:52:16,  3.65it/s]
 12%|█▏        | 44301/371472 [3:31:51<24:13:42,  3.75it/s]
 12%|█▏        | 44302/371472 [3:31:51<24:24:30,  3.72it/s]
 12%|█▏        | 44303/371472 [3:31:51<24:36:05,  3.69it/s]
 12%|█▏        | 44304/371472 [3:31:51<25:02:58,  3.63it/s]
 12%|█▏        | 44305/371472 [3:31:52<25:20:54,  3.59it/s]
 12%|█▏        | 44306/371472 [3:31:52<25:26:59,  3.57it/s]
 12%|█▏        | 44307/371472 [3:31:52<25:40:05,  3.54it/s]
 12%|█▏        | 44308/371472 [3:31:53<25:14:57,  3.60it/s]
 12%|█▏        | 44309/371472 [3:31:53<28:17:36,  3.21it/s]
 12%|█▏        | 44310/371472 [3:31:53<26:49:22,  3.39it/s]
 12%|█▏        | 44311/371472 [3:31:53<25:38:20,  3.54it/s]
 12%|█▏        | 44312/371472 [3:31:54<26:40:45,  3.41it/s]
 12%|█▏        | 44313/371472 [3:31:54<25:37:47,  3.55it/s]
 12%|█▏        | 44314/371472 [3:31:54<25:00:26,  3.63it/s]
 12%|█▏        | 44315/371472 [3:31:55<25:33:21,  3.56it/s]
 12%|█▏        | 44316/371472 [3:31:55<25:46:48,  3.53it/s]
 12%|█▏        | 44317/371472 [3:31:55<27:48:16,  3.27it/s]
 12%|█▏        | 44318/371472 [3:31:56<27:07:54,  3.35it/s]
 12%|█▏        | 44319/371472 [3:31:56<27:01:39,  3.36it/s]
 12%|█▏        | 44320/371472 [3:31:56<27:08:06,  3.35it/s]
                                                           
{'loss': 4.5101, 'learning_rate': 8.930487620935594e-07, 'epoch': 1.91}

 12%|█▏        | 44320/371472 [3:31:56<27:08:06,  3.35it/s]
 12%|█▏        | 44321/371472 [3:31:56<26:46:41,  3.39it/s]
 12%|█▏        | 44322/371472 [3:31:57<27:00:27,  3.36it/s]
 12%|█▏        | 44323/371472 [3:31:57<26:37:21,  3.41it/s]
 12%|█▏        | 44324/371472 [3:31:57<26:26:52,  3.44it/s]
 12%|█▏        | 44325/371472 [3:31:58<26:42:54,  3.40it/s]
 12%|█▏        | 44326/371472 [3:31:58<26:18:06,  3.46it/s]
 12%|█▏        | 44327/371472 [3:31:58<26:33:59,  3.42it/s]
 12%|█▏        | 44328/371472 [3:31:58<26:31:24,  3.43it/s]
 12%|█▏        | 44329/371472 [3:31:59<26:36:42,  3.41it/s]
 12%|█▏        | 44330/371472 [3:31:59<27:27:56,  3.31it/s]
 12%|█▏        | 44331/371472 [3:31:59<26:02:00,  3.49it/s]
 12%|█▏        | 44332/371472 [3:32:00<26:01:59,  3.49it/s]
 12%|█▏        | 44333/371472 [3:32:00<25:26:25,  3.57it/s]
 12%|█▏        | 44334/371472 [3:32:00<25:37:35,  3.55it/s]
 12%|█▏        | 44335/371472 [3:32:00<26:58:04,  3.37it/s]
 12%|█▏        | 44336/371472 [3:32:01<25:56:18,  3.50it/s]
 12%|█▏        | 44337/371472 [3:32:01<25:03:04,  3.63it/s]
 12%|█▏        | 44338/371472 [3:32:01<24:38:07,  3.69it/s]
 12%|█▏        | 44339/371472 [3:32:02<25:54:42,  3.51it/s]
 12%|█▏        | 44340/371472 [3:32:02<24:54:25,  3.65it/s]
                                                           
{'loss': 4.1307, 'learning_rate': 8.930002801180805e-07, 'epoch': 1.91}

 12%|█▏        | 44340/371472 [3:32:02<24:54:25,  3.65it/s]
 12%|█▏        | 44341/371472 [3:32:02<24:57:42,  3.64it/s]
 12%|█▏        | 44342/371472 [3:32:02<24:02:30,  3.78it/s]
 12%|█▏        | 44343/371472 [3:32:03<24:04:19,  3.77it/s]
 12%|█▏        | 44344/371472 [3:32:03<23:57:23,  3.79it/s]
 12%|█▏        | 44345/371472 [3:32:03<24:17:03,  3.74it/s]
 12%|█▏        | 44346/371472 [3:32:03<24:46:06,  3.67it/s]
 12%|█▏        | 44347/371472 [3:32:04<24:43:33,  3.68it/s]
 12%|█▏        | 44348/371472 [3:32:04<23:47:27,  3.82it/s]
 12%|█▏        | 44349/371472 [3:32:04<23:29:16,  3.87it/s]
 12%|█▏        | 44350/371472 [3:32:04<24:24:30,  3.72it/s]
 12%|█▏        | 44351/371472 [3:32:05<25:11:20,  3.61it/s]
 12%|█▏        | 44352/371472 [3:32:05<26:25:43,  3.44it/s]
 12%|█▏        | 44353/371472 [3:32:05<25:44:38,  3.53it/s]
 12%|█▏        | 44354/371472 [3:32:06<26:08:10,  3.48it/s]
 12%|█▏        | 44355/371472 [3:32:06<26:29:06,  3.43it/s]
 12%|█▏        | 44356/371472 [3:32:06<25:18:22,  3.59it/s]
 12%|█▏        | 44357/371472 [3:32:06<24:23:34,  3.73it/s]
 12%|█▏        | 44358/371472 [3:32:07<27:07:04,  3.35it/s]
 12%|█▏        | 44359/371472 [3:32:07<28:29:46,  3.19it/s]
 12%|█▏        | 44360/371472 [3:32:07<28:45:39,  3.16it/s]
                                                           
{'loss': 4.5143, 'learning_rate': 8.929517981426016e-07, 'epoch': 1.91}

 12%|█▏        | 44360/371472 [3:32:07<28:45:39,  3.16it/s]
 12%|█▏        | 44361/371472 [3:32:08<27:21:22,  3.32it/s]
 12%|█▏        | 44362/371472 [3:32:08<26:38:10,  3.41it/s]
 12%|█▏        | 44363/371472 [3:32:08<25:57:37,  3.50it/s]
 12%|█▏        | 44364/371472 [3:32:09<25:16:45,  3.59it/s]
 12%|█▏        | 44365/371472 [3:32:09<24:52:50,  3.65it/s]
 12%|█▏        | 44366/371472 [3:32:09<24:05:58,  3.77it/s]
 12%|█▏        | 44367/371472 [3:32:09<23:38:58,  3.84it/s]
 12%|█▏        | 44368/371472 [3:32:10<24:05:13,  3.77it/s]
 12%|█▏        | 44369/371472 [3:32:10<23:57:32,  3.79it/s]
 12%|█▏        | 44370/371472 [3:32:10<23:28:04,  3.87it/s]
 12%|█▏        | 44371/371472 [3:32:10<24:03:58,  3.78it/s]
 12%|█▏        | 44372/371472 [3:32:11<24:16:12,  3.74it/s]
 12%|█▏        | 44373/371472 [3:32:11<24:52:07,  3.65it/s]
 12%|█▏        | 44374/371472 [3:32:11<24:10:37,  3.76it/s]
 12%|█▏        | 44375/371472 [3:32:12<25:36:21,  3.55it/s]
 12%|█▏        | 44376/371472 [3:32:12<25:15:43,  3.60it/s]
 12%|█▏        | 44377/371472 [3:32:12<25:22:58,  3.58it/s]
 12%|█▏        | 44378/371472 [3:32:12<25:04:17,  3.62it/s]
 12%|█▏        | 44379/371472 [3:32:13<24:38:36,  3.69it/s]
 12%|█▏        | 44380/371472 [3:32:13<25:09:14,  3.61it/s]
                                                           
{'loss': 4.3989, 'learning_rate': 8.929033161671227e-07, 'epoch': 1.91}

 12%|█▏        | 44380/371472 [3:32:13<25:09:14,  3.61it/s]
 12%|█▏        | 44381/371472 [3:32:13<25:03:59,  3.62it/s]
 12%|█▏        | 44382/371472 [3:32:13<24:14:08,  3.75it/s]
 12%|█▏        | 44383/371472 [3:32:14<24:44:38,  3.67it/s]
 12%|█▏        | 44384/371472 [3:32:14<25:37:32,  3.55it/s]
 12%|█▏        | 44385/371472 [3:32:14<25:36:22,  3.55it/s]
 12%|█▏        | 44386/371472 [3:32:15<25:53:04,  3.51it/s]
 12%|█▏        | 44387/371472 [3:32:15<25:34:37,  3.55it/s]
 12%|█▏        | 44388/371472 [3:32:15<24:33:08,  3.70it/s]
 12%|█▏        | 44389/371472 [3:32:15<26:01:42,  3.49it/s]
 12%|█▏        | 44390/371472 [3:32:16<25:22:57,  3.58it/s]
 12%|█▏        | 44391/371472 [3:32:16<25:20:32,  3.59it/s]
 12%|█▏        | 44392/371472 [3:32:16<26:25:29,  3.44it/s]
 12%|█▏        | 44393/371472 [3:32:17<26:26:11,  3.44it/s]
 12%|█▏        | 44394/371472 [3:32:17<26:08:32,  3.48it/s]
 12%|█▏        | 44395/371472 [3:32:17<25:35:47,  3.55it/s]
 12%|█▏        | 44396/371472 [3:32:17<25:29:32,  3.56it/s]
 12%|█▏        | 44397/371472 [3:32:18<24:57:46,  3.64it/s]
 12%|█▏        | 44398/371472 [3:32:18<24:40:41,  3.68it/s]
 12%|█▏        | 44399/371472 [3:32:18<25:28:41,  3.57it/s]
 12%|█▏        | 44400/371472 [3:32:18<24:30:15,  3.71it/s]
                                                           
{'loss': 4.3002, 'learning_rate': 8.928548341916439e-07, 'epoch': 1.91}

 12%|█▏        | 44400/371472 [3:32:18<24:30:15,  3.71it/s]
 12%|█▏        | 44401/371472 [3:32:19<24:50:26,  3.66it/s]
 12%|█▏        | 44402/371472 [3:32:19<25:35:24,  3.55it/s]
 12%|█▏        | 44403/371472 [3:32:19<26:10:03,  3.47it/s]
 12%|█▏        | 44404/371472 [3:32:20<27:54:32,  3.26it/s]
 12%|█▏        | 44405/371472 [3:32:20<27:47:26,  3.27it/s]
 12%|█▏        | 44406/371472 [3:32:20<28:15:52,  3.21it/s]
 12%|█▏        | 44407/371472 [3:32:21<27:05:23,  3.35it/s]
 12%|█▏        | 44408/371472 [3:32:21<27:32:59,  3.30it/s]
 12%|█▏        | 44409/371472 [3:32:21<26:48:12,  3.39it/s]
 12%|█▏        | 44410/371472 [3:32:21<26:59:45,  3.37it/s]
 12%|█▏        | 44411/371472 [3:32:22<25:54:18,  3.51it/s]
 12%|█▏        | 44412/371472 [3:32:22<27:17:46,  3.33it/s]
 12%|█▏        | 44413/371472 [3:32:22<25:32:58,  3.56it/s]
 12%|█▏        | 44414/371472 [3:32:23<24:33:00,  3.70it/s]
 12%|█▏        | 44415/371472 [3:32:23<24:55:31,  3.64it/s]
 12%|█▏        | 44416/371472 [3:32:23<24:55:48,  3.64it/s]
 12%|█▏        | 44417/371472 [3:32:23<26:41:47,  3.40it/s]
 12%|█▏        | 44418/371472 [3:32:24<25:45:58,  3.53it/s]
 12%|█▏        | 44419/371472 [3:32:24<24:46:21,  3.67it/s]
 12%|█▏        | 44420/371472 [3:32:24<24:01:13,  3.78it/s]
                                                           
{'loss': 4.4724, 'learning_rate': 8.928063522161649e-07, 'epoch': 1.91}

 12%|█▏        | 44420/371472 [3:32:24<24:01:13,  3.78it/s]
 12%|█▏        | 44421/371472 [3:32:24<24:27:43,  3.71it/s]
 12%|█▏        | 44422/371472 [3:32:25<25:27:45,  3.57it/s]
 12%|█▏        | 44423/371472 [3:32:25<24:25:55,  3.72it/s]
 12%|█▏        | 44424/371472 [3:32:25<26:32:43,  3.42it/s]
 12%|█▏        | 44425/371472 [3:32:26<27:23:19,  3.32it/s]
 12%|█▏        | 44426/371472 [3:32:26<26:45:30,  3.40it/s]
 12%|█▏        | 44427/371472 [3:32:26<26:35:10,  3.42it/s]
 12%|█▏        | 44428/371472 [3:32:27<26:06:53,  3.48it/s]
 12%|█▏        | 44429/371472 [3:32:27<25:31:03,  3.56it/s]
 12%|█▏        | 44430/371472 [3:32:27<27:08:56,  3.35it/s]
 12%|█▏        | 44431/371472 [3:32:27<28:41:30,  3.17it/s]
 12%|█▏        | 44432/371472 [3:32:28<27:38:33,  3.29it/s]
 12%|█▏        | 44433/371472 [3:32:28<29:42:15,  3.06it/s]
 12%|█▏        | 44434/371472 [3:32:28<28:07:00,  3.23it/s]
 12%|█▏        | 44435/371472 [3:32:29<27:09:15,  3.35it/s]
 12%|█▏        | 44436/371472 [3:32:29<27:07:27,  3.35it/s]
 12%|█▏        | 44437/371472 [3:32:29<25:59:01,  3.50it/s]
 12%|█▏        | 44438/371472 [3:32:29<24:58:11,  3.64it/s]
 12%|█▏        | 44439/371472 [3:32:30<24:27:51,  3.71it/s]
 12%|█▏        | 44440/371472 [3:32:30<24:59:22,  3.64it/s]
                                                           
{'loss': 4.423, 'learning_rate': 8.92757870240686e-07, 'epoch': 1.91}

 12%|█▏        | 44440/371472 [3:32:30<24:59:22,  3.64it/s]
 12%|█▏        | 44441/371472 [3:32:30<28:04:18,  3.24it/s]
 12%|█▏        | 44442/371472 [3:32:31<27:06:57,  3.35it/s]
 12%|█▏        | 44443/371472 [3:32:31<25:48:25,  3.52it/s]
 12%|█▏        | 44444/371472 [3:32:31<27:02:04,  3.36it/s]
 12%|█▏        | 44445/371472 [3:32:32<25:33:18,  3.55it/s]
 12%|█▏        | 44446/371472 [3:32:32<25:09:55,  3.61it/s]
 12%|█▏        | 44447/371472 [3:32:32<25:07:29,  3.62it/s]
 12%|█▏        | 44448/371472 [3:32:32<24:58:05,  3.64it/s]
 12%|█▏        | 44449/371472 [3:32:33<25:24:22,  3.58it/s]
 12%|█▏        | 44450/371472 [3:32:33<25:04:23,  3.62it/s]
 12%|█▏        | 44451/371472 [3:32:33<24:33:03,  3.70it/s]
 12%|█▏        | 44452/371472 [3:32:33<25:01:44,  3.63it/s]
 12%|█▏        | 44453/371472 [3:32:34<25:07:49,  3.61it/s]
 12%|█▏        | 44454/371472 [3:32:34<26:03:46,  3.49it/s]
 12%|█▏        | 44455/371472 [3:32:34<25:25:38,  3.57it/s]
 12%|█▏        | 44456/371472 [3:32:35<24:44:51,  3.67it/s]
 12%|█▏        | 44457/371472 [3:32:35<27:01:07,  3.36it/s]
 12%|█▏        | 44458/371472 [3:32:35<25:53:22,  3.51it/s]
 12%|█▏        | 44459/371472 [3:32:35<25:26:05,  3.57it/s]
 12%|█▏        | 44460/371472 [3:32:36<24:51:29,  3.65it/s]
                                                           
{'loss': 4.2459, 'learning_rate': 8.927093882652071e-07, 'epoch': 1.91}

 12%|█▏        | 44460/371472 [3:32:36<24:51:29,  3.65it/s]
 12%|█▏        | 44461/371472 [3:32:36<25:15:37,  3.60it/s]
 12%|█▏        | 44462/371472 [3:32:36<24:53:14,  3.65it/s]
 12%|█▏        | 44463/371472 [3:32:37<26:20:20,  3.45it/s]
 12%|█▏        | 44464/371472 [3:32:37<26:23:01,  3.44it/s]
 12%|█▏        | 44465/371472 [3:32:37<25:03:06,  3.63it/s]
 12%|█▏        | 44466/371472 [3:32:37<27:22:05,  3.32it/s]
 12%|█▏        | 44467/371472 [3:32:38<27:20:46,  3.32it/s]
 12%|█▏        | 44468/371472 [3:32:38<27:13:38,  3.34it/s]
 12%|█▏        | 44469/371472 [3:32:38<26:36:14,  3.41it/s]
 12%|█▏        | 44470/371472 [3:32:39<27:34:34,  3.29it/s]
 12%|█▏        | 44471/371472 [3:32:39<26:50:51,  3.38it/s]
 12%|█▏        | 44472/371472 [3:32:39<26:44:41,  3.40it/s]
 12%|█▏        | 44473/371472 [3:32:40<26:10:37,  3.47it/s]
 12%|█▏        | 44474/371472 [3:32:40<27:25:22,  3.31it/s]
 12%|█▏        | 44475/371472 [3:32:40<26:41:11,  3.40it/s]
 12%|█▏        | 44476/371472 [3:32:40<27:04:57,  3.35it/s]
 12%|█▏        | 44477/371472 [3:32:41<26:02:21,  3.49it/s]
 12%|█▏        | 44478/371472 [3:32:41<25:34:12,  3.55it/s]
 12%|█▏        | 44479/371472 [3:32:41<25:06:33,  3.62it/s]
 12%|█▏        | 44480/371472 [3:32:42<25:54:28,  3.51it/s]
                                                           
{'loss': 4.3396, 'learning_rate': 8.926609062897283e-07, 'epoch': 1.92}

 12%|█▏        | 44480/371472 [3:32:42<25:54:28,  3.51it/s]
 12%|█▏        | 44481/371472 [3:32:42<27:18:16,  3.33it/s]
 12%|█▏        | 44482/371472 [3:32:42<26:23:23,  3.44it/s]
 12%|█▏        | 44483/371472 [3:32:42<25:59:00,  3.50it/s]
 12%|█▏        | 44484/371472 [3:32:43<27:56:31,  3.25it/s]
 12%|█▏        | 44485/371472 [3:32:43<28:20:51,  3.20it/s]
 12%|█▏        | 44486/371472 [3:32:43<26:49:58,  3.38it/s]
 12%|█▏        | 44487/371472 [3:32:44<25:41:29,  3.54it/s]
 12%|█▏        | 44488/371472 [3:32:44<26:11:22,  3.47it/s]
 12%|█▏        | 44489/371472 [3:32:44<27:03:48,  3.36it/s]
 12%|█▏        | 44490/371472 [3:32:45<28:09:58,  3.22it/s]
 12%|█▏        | 44491/371472 [3:32:45<27:17:41,  3.33it/s]
 12%|█▏        | 44492/371472 [3:32:45<26:32:24,  3.42it/s]
 12%|█▏        | 44493/371472 [3:32:45<26:49:18,  3.39it/s]
 12%|█▏        | 44494/371472 [3:32:46<26:33:42,  3.42it/s]
 12%|█▏        | 44495/371472 [3:32:46<26:08:32,  3.47it/s]
 12%|█▏        | 44496/371472 [3:32:46<25:12:29,  3.60it/s]
 12%|█▏        | 44497/371472 [3:32:46<24:55:25,  3.64it/s]
 12%|█▏        | 44498/371472 [3:32:47<24:33:47,  3.70it/s]
 12%|█▏        | 44499/371472 [3:32:47<25:11:48,  3.60it/s]
 12%|█▏        | 44500/371472 [3:32:47<24:26:34,  3.72it/s]
                                                           
{'loss': 4.4372, 'learning_rate': 8.926124243142493e-07, 'epoch': 1.92}

 12%|█▏        | 44500/371472 [3:32:47<24:26:34,  3.72it/s]
 12%|█▏        | 44501/371472 [3:32:48<24:13:05,  3.75it/s]
 12%|█▏        | 44502/371472 [3:32:48<24:07:42,  3.76it/s]
 12%|█▏        | 44503/371472 [3:32:48<24:32:11,  3.70it/s]
 12%|█▏        | 44504/371472 [3:32:48<26:21:45,  3.45it/s]
 12%|█▏        | 44505/371472 [3:32:49<25:53:53,  3.51it/s]
 12%|█▏        | 44506/371472 [3:32:49<27:00:53,  3.36it/s]
 12%|█▏        | 44507/371472 [3:32:49<26:08:15,  3.47it/s]
 12%|█▏        | 44508/371472 [3:32:50<27:18:24,  3.33it/s]
 12%|█▏        | 44509/371472 [3:32:50<26:45:06,  3.40it/s]
 12%|█▏        | 44510/371472 [3:32:50<26:10:04,  3.47it/s]
 12%|█▏        | 44511/371472 [3:32:50<25:55:27,  3.50it/s]
 12%|█▏        | 44512/371472 [3:32:51<25:42:28,  3.53it/s]
 12%|█▏        | 44513/371472 [3:32:51<25:14:22,  3.60it/s]
 12%|█▏        | 44514/371472 [3:32:51<24:13:31,  3.75it/s]
 12%|█▏        | 44515/371472 [3:32:52<24:46:14,  3.67it/s]
 12%|█▏        | 44516/371472 [3:32:52<26:39:16,  3.41it/s]
 12%|█▏        | 44517/371472 [3:32:52<26:19:21,  3.45it/s]
 12%|█▏        | 44518/371472 [3:32:52<25:51:36,  3.51it/s]
 12%|█▏        | 44519/371472 [3:32:53<24:40:11,  3.68it/s]
 12%|█▏        | 44520/371472 [3:32:53<27:49:02,  3.26it/s]
                                                           
{'loss': 4.288, 'learning_rate': 8.925639423387705e-07, 'epoch': 1.92}

 12%|█▏        | 44520/371472 [3:32:53<27:49:02,  3.26it/s]
 12%|█▏        | 44521/371472 [3:32:53<28:21:51,  3.20it/s]
 12%|█▏        | 44522/371472 [3:32:54<28:10:15,  3.22it/s]
 12%|█▏        | 44523/371472 [3:32:54<26:36:36,  3.41it/s]
 12%|█▏        | 44524/371472 [3:32:54<26:05:54,  3.48it/s]
 12%|█▏        | 44525/371472 [3:32:55<26:11:54,  3.47it/s]
 12%|█▏        | 44526/371472 [3:32:55<25:38:12,  3.54it/s]
 12%|█▏        | 44527/371472 [3:32:55<25:32:38,  3.56it/s]
 12%|█▏        | 44528/371472 [3:32:55<24:52:15,  3.65it/s]
 12%|█▏        | 44529/371472 [3:32:56<24:36:23,  3.69it/s]
 12%|█▏        | 44530/371472 [3:32:56<25:05:42,  3.62it/s]
 12%|█▏        | 44531/371472 [3:32:56<25:00:27,  3.63it/s]
 12%|█▏        | 44532/371472 [3:32:56<24:39:35,  3.68it/s]
 12%|█▏        | 44533/371472 [3:32:57<24:49:24,  3.66it/s]
 12%|█▏        | 44534/371472 [3:32:57<25:31:59,  3.56it/s]
 12%|█▏        | 44535/371472 [3:32:57<27:38:49,  3.28it/s]
 12%|█▏        | 44536/371472 [3:32:58<26:18:32,  3.45it/s]
 12%|█▏        | 44537/371472 [3:32:58<26:10:29,  3.47it/s]
 12%|█▏        | 44538/371472 [3:32:58<26:21:18,  3.45it/s]
 12%|█▏        | 44539/371472 [3:32:58<27:07:26,  3.35it/s]
 12%|█▏        | 44540/371472 [3:32:59<27:14:56,  3.33it/s]
                                                           
{'loss': 4.4371, 'learning_rate': 8.925154603632916e-07, 'epoch': 1.92}

 12%|█▏        | 44540/371472 [3:32:59<27:14:56,  3.33it/s]
 12%|█▏        | 44541/371472 [3:32:59<26:52:00,  3.38it/s]
 12%|█▏        | 44542/371472 [3:32:59<27:28:36,  3.31it/s]
 12%|█▏        | 44543/371472 [3:33:00<27:18:01,  3.33it/s]
 12%|█▏        | 44544/371472 [3:33:00<26:44:58,  3.39it/s]
 12%|█▏        | 44545/371472 [3:33:00<25:51:44,  3.51it/s]
 12%|█▏        | 44546/371472 [3:33:00<24:55:41,  3.64it/s]
 12%|█▏        | 44547/371472 [3:33:01<26:16:46,  3.46it/s]
 12%|█▏        | 44548/371472 [3:33:01<26:43:02,  3.40it/s]
 12%|█▏        | 44549/371472 [3:33:01<26:24:55,  3.44it/s]
 12%|█▏        | 44550/371472 [3:33:02<25:22:28,  3.58it/s]
 12%|█▏        | 44551/371472 [3:33:02<25:14:22,  3.60it/s]
 12%|█▏        | 44552/371472 [3:33:02<25:18:57,  3.59it/s]
 12%|█▏        | 44553/371472 [3:33:02<24:54:04,  3.65it/s]
 12%|█▏        | 44554/371472 [3:33:03<28:10:54,  3.22it/s]
 12%|█▏        | 44555/371472 [3:33:03<27:12:39,  3.34it/s]
 12%|█▏        | 44556/371472 [3:33:03<26:26:16,  3.43it/s]
 12%|█▏        | 44557/371472 [3:33:04<26:32:00,  3.42it/s]
 12%|█▏        | 44558/371472 [3:33:04<25:42:23,  3.53it/s]
 12%|█▏        | 44559/371472 [3:33:04<25:13:54,  3.60it/s]
 12%|█▏        | 44560/371472 [3:33:05<26:12:40,  3.46it/s]
                                                           
{'loss': 4.1958, 'learning_rate': 8.924669783878125e-07, 'epoch': 1.92}

 12%|█▏        | 44560/371472 [3:33:05<26:12:40,  3.46it/s]
 12%|█▏        | 44561/371472 [3:33:05<27:28:51,  3.30it/s]
 12%|█▏        | 44562/371472 [3:33:05<29:22:48,  3.09it/s]
 12%|█▏        | 44563/371472 [3:33:06<28:36:34,  3.17it/s]
 12%|█▏        | 44564/371472 [3:33:06<27:49:51,  3.26it/s]
 12%|█▏        | 44565/371472 [3:33:06<27:50:11,  3.26it/s]
 12%|█▏        | 44566/371472 [3:33:06<27:37:02,  3.29it/s]
 12%|█▏        | 44567/371472 [3:33:07<26:53:23,  3.38it/s]
 12%|█▏        | 44568/371472 [3:33:07<29:02:04,  3.13it/s]
 12%|█▏        | 44569/371472 [3:33:07<27:48:34,  3.27it/s]
 12%|█▏        | 44570/371472 [3:33:08<27:23:13,  3.32it/s]
 12%|█▏        | 44571/371472 [3:33:08<28:52:33,  3.14it/s]
 12%|█▏        | 44572/371472 [3:33:08<27:37:50,  3.29it/s]
 12%|█▏        | 44573/371472 [3:33:09<28:07:43,  3.23it/s]
 12%|█▏        | 44574/371472 [3:33:09<26:26:29,  3.43it/s]
 12%|█▏        | 44575/371472 [3:33:09<25:58:51,  3.50it/s]
 12%|█▏        | 44576/371472 [3:33:09<25:19:35,  3.59it/s]
 12%|█▏        | 44577/371472 [3:33:10<25:03:27,  3.62it/s]
 12%|█▏        | 44578/371472 [3:33:10<24:36:04,  3.69it/s]
 12%|█▏        | 44579/371472 [3:33:10<25:05:38,  3.62it/s]
 12%|█▏        | 44580/371472 [3:33:11<26:02:53,  3.49it/s]
                                                           
{'loss': 4.1513, 'learning_rate': 8.924184964123337e-07, 'epoch': 1.92}

 12%|█▏        | 44580/371472 [3:33:11<26:02:53,  3.49it/s]
 12%|█▏        | 44581/371472 [3:33:11<26:20:45,  3.45it/s]
 12%|█▏        | 44582/371472 [3:33:11<25:37:51,  3.54it/s]
 12%|█▏        | 44583/371472 [3:33:11<25:16:23,  3.59it/s]
 12%|█▏        | 44584/371472 [3:33:12<25:13:45,  3.60it/s]
 12%|█▏        | 44585/371472 [3:33:12<24:14:14,  3.75it/s]
 12%|█▏        | 44586/371472 [3:33:12<23:36:01,  3.85it/s]
 12%|█▏        | 44587/371472 [3:33:12<24:55:53,  3.64it/s]
 12%|█▏        | 44588/371472 [3:33:13<24:44:39,  3.67it/s]
 12%|█▏        | 44589/371472 [3:33:13<25:47:21,  3.52it/s]
 12%|█▏        | 44590/371472 [3:33:13<25:16:36,  3.59it/s]
 12%|█▏        | 44591/371472 [3:33:14<26:55:33,  3.37it/s]
 12%|█▏        | 44592/371472 [3:33:14<27:55:17,  3.25it/s]
 12%|█▏        | 44593/371472 [3:33:14<27:17:13,  3.33it/s]
 12%|█▏        | 44594/371472 [3:33:15<26:47:04,  3.39it/s]
 12%|█▏        | 44595/371472 [3:33:15<28:04:40,  3.23it/s]
 12%|█▏        | 44596/371472 [3:33:15<27:15:55,  3.33it/s]
 12%|█▏        | 44597/371472 [3:33:15<25:46:54,  3.52it/s]
 12%|█▏        | 44598/371472 [3:33:16<25:11:17,  3.60it/s]
 12%|█▏        | 44599/371472 [3:33:16<28:46:51,  3.15it/s]
 12%|█▏        | 44600/371472 [3:33:16<27:53:04,  3.26it/s]
                                                           
{'loss': 4.2007, 'learning_rate': 8.923700144368549e-07, 'epoch': 1.92}

 12%|█▏        | 44600/371472 [3:33:16<27:53:04,  3.26it/s]
 12%|█▏        | 44601/371472 [3:33:17<26:35:41,  3.41it/s]
 12%|█▏        | 44602/371472 [3:33:17<26:59:11,  3.36it/s]
 12%|█▏        | 44603/371472 [3:33:17<27:10:05,  3.34it/s]
 12%|█▏        | 44604/371472 [3:33:17<26:38:57,  3.41it/s]
 12%|█▏        | 44605/371472 [3:33:18<26:51:51,  3.38it/s]
 12%|█▏        | 44606/371472 [3:33:18<26:36:27,  3.41it/s]
 12%|█▏        | 44607/371472 [3:33:18<26:16:20,  3.46it/s]
 12%|█▏        | 44608/371472 [3:33:19<26:10:32,  3.47it/s]
 12%|█▏        | 44609/371472 [3:33:19<26:06:35,  3.48it/s]
 12%|█▏        | 44610/371472 [3:33:19<26:05:16,  3.48it/s]
 12%|█▏        | 44611/371472 [3:33:19<25:40:31,  3.54it/s]
 12%|█▏        | 44612/371472 [3:33:20<26:25:00,  3.44it/s]
 12%|█▏        | 44613/371472 [3:33:20<26:32:42,  3.42it/s]
 12%|█▏        | 44614/371472 [3:33:20<26:31:30,  3.42it/s]
 12%|█▏        | 44615/371472 [3:33:21<25:34:08,  3.55it/s]
 12%|█▏        | 44616/371472 [3:33:21<25:27:04,  3.57it/s]
 12%|█▏        | 44617/371472 [3:33:21<26:08:24,  3.47it/s]
 12%|█▏        | 44618/371472 [3:33:21<25:47:17,  3.52it/s]
 12%|█▏        | 44619/371472 [3:33:22<25:15:12,  3.60it/s]
 12%|█▏        | 44620/371472 [3:33:22<25:36:02,  3.55it/s]
                                                           
{'loss': 4.1913, 'learning_rate': 8.92321532461376e-07, 'epoch': 1.92}

 12%|█▏        | 44620/371472 [3:33:22<25:36:02,  3.55it/s]
 12%|█▏        | 44621/371472 [3:33:22<25:27:33,  3.57it/s]
 12%|█▏        | 44622/371472 [3:33:23<25:01:17,  3.63it/s]
 12%|█▏        | 44623/371472 [3:33:23<24:37:37,  3.69it/s]
 12%|█▏        | 44624/371472 [3:33:23<24:57:13,  3.64it/s]
 12%|█▏        | 44625/371472 [3:33:23<25:59:23,  3.49it/s]
 12%|█▏        | 44626/371472 [3:33:24<25:17:31,  3.59it/s]
 12%|█▏        | 44627/371472 [3:33:24<27:06:33,  3.35it/s]
 12%|█▏        | 44628/371472 [3:33:24<26:23:07,  3.44it/s]
 12%|█▏        | 44629/371472 [3:33:25<27:01:49,  3.36it/s]
 12%|█▏        | 44630/371472 [3:33:25<30:41:56,  2.96it/s]
 12%|█▏        | 44631/371472 [3:33:25<28:42:41,  3.16it/s]
 12%|█▏        | 44632/371472 [3:33:26<26:51:52,  3.38it/s]
 12%|█▏        | 44633/371472 [3:33:26<28:15:27,  3.21it/s]
 12%|█▏        | 44634/371472 [3:33:26<28:36:41,  3.17it/s]
 12%|█▏        | 44635/371472 [3:33:27<27:16:31,  3.33it/s]
 12%|█▏        | 44636/371472 [3:33:27<27:54:35,  3.25it/s]
 12%|█▏        | 44637/371472 [3:33:27<26:27:17,  3.43it/s]
 12%|█▏        | 44638/371472 [3:33:27<25:43:10,  3.53it/s]
 12%|█▏        | 44639/371472 [3:33:28<24:55:19,  3.64it/s]
 12%|█▏        | 44640/371472 [3:33:28<25:36:23,  3.55it/s]
                                                           
{'loss': 4.3211, 'learning_rate': 8.922730504858971e-07, 'epoch': 1.92}

 12%|█▏        | 44640/371472 [3:33:28<25:36:23,  3.55it/s]
 12%|█▏        | 44641/371472 [3:33:28<25:54:35,  3.50it/s]
 12%|█▏        | 44642/371472 [3:33:28<25:10:04,  3.61it/s]
 12%|█▏        | 44643/371472 [3:33:29<25:34:43,  3.55it/s]
 12%|█▏        | 44644/371472 [3:33:29<25:48:00,  3.52it/s]
 12%|█▏        | 44645/371472 [3:33:29<25:26:07,  3.57it/s]
 12%|█▏        | 44646/371472 [3:33:30<24:57:26,  3.64it/s]
 12%|█▏        | 44647/371472 [3:33:30<27:28:27,  3.30it/s]
 12%|█▏        | 44648/371472 [3:33:30<27:53:05,  3.26it/s]
 12%|█▏        | 44649/371472 [3:33:31<26:21:18,  3.44it/s]
 12%|█▏        | 44650/371472 [3:33:31<25:29:26,  3.56it/s]
 12%|█▏        | 44651/371472 [3:33:31<24:43:32,  3.67it/s]
 12%|█▏        | 44652/371472 [3:33:31<24:40:59,  3.68it/s]
 12%|█▏        | 44653/371472 [3:33:32<24:28:33,  3.71it/s]
 12%|█▏        | 44654/371472 [3:33:32<25:56:33,  3.50it/s]
 12%|█▏        | 44655/371472 [3:33:32<26:04:30,  3.48it/s]
 12%|█▏        | 44656/371472 [3:33:32<26:27:20,  3.43it/s]
 12%|█▏        | 44657/371472 [3:33:33<26:17:33,  3.45it/s]
 12%|█▏        | 44658/371472 [3:33:33<25:02:26,  3.63it/s]
 12%|█▏        | 44659/371472 [3:33:33<25:31:39,  3.56it/s]
 12%|█▏        | 44660/371472 [3:33:34<25:01:21,  3.63it/s]
                                                           
{'loss': 4.3395, 'learning_rate': 8.922245685104183e-07, 'epoch': 1.92}

 12%|█▏        | 44660/371472 [3:33:34<25:01:21,  3.63it/s]
 12%|█▏        | 44661/371472 [3:33:34<26:41:24,  3.40it/s]
 12%|█▏        | 44662/371472 [3:33:34<26:16:53,  3.45it/s]
 12%|█▏        | 44663/371472 [3:33:34<25:37:36,  3.54it/s]
 12%|█▏        | 44664/371472 [3:33:35<25:40:01,  3.54it/s]
 12%|█▏        | 44665/371472 [3:33:35<26:01:10,  3.49it/s]
 12%|█▏        | 44666/371472 [3:33:35<27:12:06,  3.34it/s]
 12%|█▏        | 44667/371472 [3:33:36<27:40:50,  3.28it/s]
 12%|█▏        | 44668/371472 [3:33:36<26:14:26,  3.46it/s]
 12%|█▏        | 44669/371472 [3:33:36<26:22:33,  3.44it/s]
 12%|█▏        | 44670/371472 [3:33:36<25:15:53,  3.59it/s]
 12%|█▏        | 44671/371472 [3:33:37<24:44:53,  3.67it/s]
 12%|█▏        | 44672/371472 [3:33:37<24:11:56,  3.75it/s]
 12%|█▏        | 44673/371472 [3:33:37<26:35:38,  3.41it/s]
 12%|█▏        | 44674/371472 [3:33:38<26:13:02,  3.46it/s]
 12%|█▏        | 44675/371472 [3:33:38<26:37:41,  3.41it/s]
 12%|█▏        | 44676/371472 [3:33:38<28:06:12,  3.23it/s]
 12%|█▏        | 44677/371472 [3:33:39<27:31:06,  3.30it/s]
 12%|█▏        | 44678/371472 [3:33:39<27:16:21,  3.33it/s]
 12%|█▏        | 44679/371472 [3:33:39<27:01:07,  3.36it/s]
 12%|█▏        | 44680/371472 [3:33:39<26:45:34,  3.39it/s]
                                                           
{'loss': 4.2522, 'learning_rate': 8.921760865349393e-07, 'epoch': 1.92}

 12%|█▏        | 44680/371472 [3:33:39<26:45:34,  3.39it/s]
 12%|█▏        | 44681/371472 [3:33:40<26:20:44,  3.45it/s]
 12%|█▏        | 44682/371472 [3:33:40<26:35:48,  3.41it/s]
 12%|█▏        | 44683/371472 [3:33:40<25:33:30,  3.55it/s]
 12%|█▏        | 44684/371472 [3:33:41<25:03:01,  3.62it/s]
 12%|█▏        | 44685/371472 [3:33:41<25:25:42,  3.57it/s]
 12%|█▏        | 44686/371472 [3:33:41<24:33:02,  3.70it/s]
 12%|█▏        | 44687/371472 [3:33:41<25:06:07,  3.62it/s]
 12%|█▏        | 44688/371472 [3:33:42<26:50:57,  3.38it/s]
 12%|█▏        | 44689/371472 [3:33:42<26:49:35,  3.38it/s]
 12%|█▏        | 44690/371472 [3:33:42<25:18:47,  3.59it/s]
 12%|█▏        | 44691/371472 [3:33:42<24:51:15,  3.65it/s]
 12%|█▏        | 44692/371472 [3:33:43<25:10:25,  3.61it/s]
 12%|█▏        | 44693/371472 [3:33:43<25:27:42,  3.57it/s]
 12%|█▏        | 44694/371472 [3:33:43<25:30:05,  3.56it/s]
 12%|█▏        | 44695/371472 [3:33:44<25:09:54,  3.61it/s]
 12%|█▏        | 44696/371472 [3:33:44<24:31:50,  3.70it/s]
 12%|█▏        | 44697/371472 [3:33:44<24:07:26,  3.76it/s]
 12%|█▏        | 44698/371472 [3:33:44<23:46:53,  3.82it/s]
 12%|█▏        | 44699/371472 [3:33:45<26:55:22,  3.37it/s]
 12%|█▏        | 44700/371472 [3:33:45<26:51:21,  3.38it/s]
                                                           
{'loss': 4.279, 'learning_rate': 8.921276045594604e-07, 'epoch': 1.93}

 12%|█▏        | 44700/371472 [3:33:45<26:51:21,  3.38it/s]
 12%|█▏        | 44701/371472 [3:33:45<26:49:20,  3.38it/s]
 12%|█▏        | 44702/371472 [3:33:46<26:45:11,  3.39it/s]
 12%|█▏        | 44703/371472 [3:33:46<26:11:13,  3.47it/s]
 12%|█▏        | 44704/371472 [3:33:46<25:31:20,  3.56it/s]
 12%|█▏        | 44705/371472 [3:33:46<26:22:22,  3.44it/s]
 12%|█▏        | 44706/371472 [3:33:47<25:35:41,  3.55it/s]
 12%|█▏        | 44707/371472 [3:33:47<27:15:50,  3.33it/s]
 12%|█▏        | 44708/371472 [3:33:47<26:23:13,  3.44it/s]
 12%|█▏        | 44709/371472 [3:33:48<26:39:22,  3.41it/s]
 12%|█▏        | 44710/371472 [3:33:48<26:23:14,  3.44it/s]
 12%|█▏        | 44711/371472 [3:33:48<25:20:36,  3.58it/s]
 12%|█▏        | 44712/371472 [3:33:48<24:10:58,  3.75it/s]
 12%|█▏        | 44713/371472 [3:33:49<23:35:47,  3.85it/s]
 12%|█▏        | 44714/371472 [3:33:49<24:46:52,  3.66it/s]
 12%|█▏        | 44715/371472 [3:33:49<25:12:50,  3.60it/s]
 12%|█▏        | 44716/371472 [3:33:50<26:50:17,  3.38it/s]
 12%|█▏        | 44717/371472 [3:33:50<25:28:34,  3.56it/s]
 12%|█▏        | 44718/371472 [3:33:50<28:30:53,  3.18it/s]
 12%|█▏        | 44719/371472 [3:33:50<26:36:45,  3.41it/s]
 12%|█▏        | 44720/371472 [3:33:51<27:51:57,  3.26it/s]
                                                           
{'loss': 4.2267, 'learning_rate': 8.920791225839815e-07, 'epoch': 1.93}

 12%|█▏        | 44720/371472 [3:33:51<27:51:57,  3.26it/s]
 12%|█▏        | 44721/371472 [3:33:51<26:50:39,  3.38it/s]
 12%|█▏        | 44722/371472 [3:33:51<25:21:41,  3.58it/s]
 12%|█▏        | 44723/371472 [3:33:52<24:50:50,  3.65it/s]
 12%|█▏        | 44724/371472 [3:33:52<24:42:05,  3.67it/s]
 12%|█▏        | 44725/371472 [3:33:52<24:56:00,  3.64it/s]
 12%|█▏        | 44726/371472 [3:33:52<24:01:41,  3.78it/s]
 12%|█▏        | 44727/371472 [3:33:53<23:56:32,  3.79it/s]
 12%|█▏        | 44728/371472 [3:33:53<24:10:03,  3.76it/s]
 12%|█▏        | 44729/371472 [3:33:53<24:05:27,  3.77it/s]
 12%|█▏        | 44730/371472 [3:33:54<26:11:35,  3.47it/s]
 12%|█▏        | 44731/371472 [3:33:54<26:40:39,  3.40it/s]
 12%|█▏        | 44732/371472 [3:33:54<26:46:35,  3.39it/s]
 12%|█▏        | 44733/371472 [3:33:54<26:12:17,  3.46it/s]
 12%|█▏        | 44734/371472 [3:33:55<26:17:43,  3.45it/s]
 12%|█▏        | 44735/371472 [3:33:55<25:07:34,  3.61it/s]
 12%|█▏        | 44736/371472 [3:33:55<25:22:24,  3.58it/s]
 12%|█▏        | 44737/371472 [3:33:56<25:18:04,  3.59it/s]
 12%|█▏        | 44738/371472 [3:33:56<24:45:54,  3.66it/s]
 12%|█▏        | 44739/371472 [3:33:56<24:53:52,  3.65it/s]
 12%|█▏        | 44740/371472 [3:33:56<26:21:11,  3.44it/s]
                                                           
{'loss': 4.3767, 'learning_rate': 8.920306406085026e-07, 'epoch': 1.93}

 12%|█▏        | 44740/371472 [3:33:56<26:21:11,  3.44it/s]
 12%|█▏        | 44741/371472 [3:33:57<25:39:54,  3.54it/s]
 12%|█▏        | 44742/371472 [3:33:57<26:11:18,  3.47it/s]
 12%|█▏        | 44743/371472 [3:33:57<25:43:21,  3.53it/s]
 12%|█▏        | 44744/371472 [3:33:58<25:57:35,  3.50it/s]
 12%|█▏        | 44745/371472 [3:33:58<26:10:42,  3.47it/s]
 12%|█▏        | 44746/371472 [3:33:58<28:58:02,  3.13it/s]
 12%|█▏        | 44747/371472 [3:33:59<29:21:34,  3.09it/s]
 12%|█▏        | 44748/371472 [3:33:59<30:58:13,  2.93it/s]
 12%|█▏        | 44749/371472 [3:33:59<28:44:15,  3.16it/s]
 12%|█▏        | 44750/371472 [3:33:59<28:38:35,  3.17it/s]
 12%|█▏        | 44751/371472 [3:34:00<28:13:20,  3.22it/s]
 12%|█▏        | 44752/371472 [3:34:00<28:29:31,  3.19it/s]
 12%|█▏        | 44753/371472 [3:34:01<30:36:29,  2.97it/s]
 12%|█▏        | 44754/371472 [3:34:01<27:59:10,  3.24it/s]
 12%|█▏        | 44755/371472 [3:34:01<28:14:10,  3.21it/s]
 12%|█▏        | 44756/371472 [3:34:01<26:24:31,  3.44it/s]
 12%|█▏        | 44757/371472 [3:34:02<25:48:38,  3.52it/s]
 12%|█▏        | 44758/371472 [3:34:02<24:44:59,  3.67it/s]
 12%|█▏        | 44759/371472 [3:34:02<24:54:47,  3.64it/s]
 12%|█▏        | 44760/371472 [3:34:02<24:52:54,  3.65it/s]
                                                           
{'loss': 4.0336, 'learning_rate': 8.919821586330238e-07, 'epoch': 1.93}

 12%|█▏        | 44760/371472 [3:34:02<24:52:54,  3.65it/s]
 12%|█▏        | 44761/371472 [3:34:03<25:13:57,  3.60it/s]
 12%|█▏        | 44762/371472 [3:34:03<24:13:56,  3.75it/s]
 12%|█▏        | 44763/371472 [3:34:03<25:34:22,  3.55it/s]
 12%|█▏        | 44764/371472 [3:34:03<24:28:25,  3.71it/s]
 12%|█▏        | 44765/371472 [3:34:04<28:25:49,  3.19it/s]
 12%|█▏        | 44766/371472 [3:34:04<27:47:11,  3.27it/s]
 12%|█▏        | 44767/371472 [3:34:04<27:13:23,  3.33it/s]
 12%|█▏        | 44768/371472 [3:34:05<26:28:07,  3.43it/s]
 12%|█▏        | 44769/371472 [3:34:05<27:47:55,  3.26it/s]
 12%|█▏        | 44770/371472 [3:34:05<26:39:28,  3.40it/s]
 12%|█▏        | 44771/371472 [3:34:06<26:08:26,  3.47it/s]
 12%|█▏        | 44772/371472 [3:34:06<26:21:20,  3.44it/s]
 12%|█▏        | 44773/371472 [3:34:06<26:51:29,  3.38it/s]
 12%|█▏        | 44774/371472 [3:34:07<27:13:11,  3.33it/s]
 12%|█▏        | 44775/371472 [3:34:07<26:47:23,  3.39it/s]
 12%|█▏        | 44776/371472 [3:34:07<27:01:25,  3.36it/s]
 12%|█▏        | 44777/371472 [3:34:07<25:30:54,  3.56it/s]
 12%|█▏        | 44778/371472 [3:34:08<24:35:36,  3.69it/s]
 12%|█▏        | 44779/371472 [3:34:08<24:52:39,  3.65it/s]
 12%|█▏        | 44780/371472 [3:34:08<24:46:06,  3.66it/s]
                                                           
{'loss': 4.3381, 'learning_rate': 8.919336766575449e-07, 'epoch': 1.93}

 12%|█▏        | 44780/371472 [3:34:08<24:46:06,  3.66it/s]
 12%|█▏        | 44781/371472 [3:34:08<25:44:33,  3.53it/s]
 12%|█▏        | 44782/371472 [3:34:09<25:40:43,  3.53it/s]
 12%|█▏        | 44783/371472 [3:34:09<28:40:02,  3.17it/s]
 12%|█▏        | 44784/371472 [3:34:09<27:48:21,  3.26it/s]
 12%|█▏        | 44785/371472 [3:34:10<27:16:15,  3.33it/s]
 12%|█▏        | 44786/371472 [3:34:10<29:14:25,  3.10it/s]
 12%|█▏        | 44787/371472 [3:34:10<27:45:55,  3.27it/s]
 12%|█▏        | 44788/371472 [3:34:11<26:28:31,  3.43it/s]
 12%|█▏        | 44789/371472 [3:34:11<25:46:31,  3.52it/s]
 12%|█▏        | 44790/371472 [3:34:11<26:25:54,  3.43it/s]
 12%|█▏        | 44791/371472 [3:34:11<26:39:58,  3.40it/s]
 12%|█▏        | 44792/371472 [3:34:12<26:14:32,  3.46it/s]
 12%|█▏        | 44793/371472 [3:34:12<26:48:54,  3.38it/s]
 12%|█▏        | 44794/371472 [3:34:12<30:22:25,  2.99it/s]
 12%|█▏        | 44795/371472 [3:34:13<28:48:27,  3.15it/s]
 12%|█▏        | 44796/371472 [3:34:13<28:14:29,  3.21it/s]
 12%|█▏        | 44797/371472 [3:34:13<29:24:08,  3.09it/s]
 12%|█▏        | 44798/371472 [3:34:14<28:40:22,  3.16it/s]
 12%|█▏        | 44799/371472 [3:34:14<28:21:51,  3.20it/s]
 12%|█▏        | 44800/371472 [3:34:14<28:15:53,  3.21it/s]
                                                           
{'loss': 4.218, 'learning_rate': 8.918851946820659e-07, 'epoch': 1.93}

 12%|█▏        | 44800/371472 [3:34:14<28:15:53,  3.21it/s]
 12%|█▏        | 44801/371472 [3:34:15<27:21:40,  3.32it/s]
 12%|█▏        | 44802/371472 [3:34:15<27:04:58,  3.35it/s]
 12%|█▏        | 44803/371472 [3:34:15<26:31:36,  3.42it/s]
 12%|█▏        | 44804/371472 [3:34:15<25:47:31,  3.52it/s]
 12%|█▏        | 44805/371472 [3:34:16<25:24:38,  3.57it/s]
 12%|█▏        | 44806/371472 [3:34:16<26:29:44,  3.42it/s]
 12%|█▏        | 44807/371472 [3:34:16<25:15:19,  3.59it/s]
 12%|█▏        | 44808/371472 [3:34:17<25:16:04,  3.59it/s]
 12%|█▏        | 44809/371472 [3:34:17<25:12:09,  3.60it/s]
 12%|█▏        | 44810/371472 [3:34:17<25:16:56,  3.59it/s]
 12%|█▏        | 44811/371472 [3:34:17<24:57:56,  3.63it/s]
 12%|█▏        | 44812/371472 [3:34:18<24:35:17,  3.69it/s]
 12%|█▏        | 44813/371472 [3:34:18<24:52:21,  3.65it/s]
 12%|█▏        | 44814/371472 [3:34:18<25:16:12,  3.59it/s]
 12%|█▏        | 44815/371472 [3:34:18<25:02:45,  3.62it/s]
 12%|█▏        | 44816/371472 [3:34:19<25:17:14,  3.59it/s]
 12%|█▏        | 44817/371472 [3:34:19<24:31:41,  3.70it/s]
 12%|█▏        | 44818/371472 [3:34:19<24:32:10,  3.70it/s]
 12%|█▏        | 44819/371472 [3:34:20<25:27:44,  3.56it/s]
 12%|█▏        | 44820/371472 [3:34:20<25:16:00,  3.59it/s]
                                                           
{'loss': 4.251, 'learning_rate': 8.91836712706587e-07, 'epoch': 1.93}

 12%|█▏        | 44820/371472 [3:34:20<25:16:00,  3.59it/s]
 12%|█▏        | 44821/371472 [3:34:20<24:45:25,  3.67it/s]
 12%|█▏        | 44822/371472 [3:34:20<24:58:23,  3.63it/s]
 12%|█▏        | 44823/371472 [3:34:21<24:53:12,  3.65it/s]
 12%|█▏        | 44824/371472 [3:34:21<24:13:09,  3.75it/s]
 12%|█▏        | 44825/371472 [3:34:21<25:16:54,  3.59it/s]
 12%|█▏        | 44826/371472 [3:34:22<25:53:04,  3.51it/s]
 12%|█▏        | 44827/371472 [3:34:22<25:15:35,  3.59it/s]
 12%|█▏        | 44828/371472 [3:34:22<24:42:26,  3.67it/s]
 12%|█▏        | 44829/371472 [3:34:22<24:15:12,  3.74it/s]
 12%|█▏        | 44830/371472 [3:34:23<26:21:12,  3.44it/s]
 12%|█▏        | 44831/371472 [3:34:23<28:05:39,  3.23it/s]
 12%|█▏        | 44832/371472 [3:34:23<27:27:56,  3.30it/s]
 12%|█▏        | 44833/371472 [3:34:24<27:45:27,  3.27it/s]
 12%|█▏        | 44834/371472 [3:34:24<27:51:36,  3.26it/s]
 12%|█▏        | 44835/371472 [3:34:24<27:21:05,  3.32it/s]
 12%|█▏        | 44836/371472 [3:34:25<29:31:09,  3.07it/s]
 12%|█▏        | 44837/371472 [3:34:25<27:45:17,  3.27it/s]
 12%|█▏        | 44838/371472 [3:34:25<27:00:04,  3.36it/s]
 12%|█▏        | 44839/371472 [3:34:26<30:52:30,  2.94it/s]
 12%|█▏        | 44840/371472 [3:34:26<28:50:41,  3.15it/s]
                                                           
{'loss': 4.305, 'learning_rate': 8.917882307311082e-07, 'epoch': 1.93}

 12%|█▏        | 44840/371472 [3:34:26<28:50:41,  3.15it/s]
 12%|█▏        | 44841/371472 [3:34:26<29:50:07,  3.04it/s]
 12%|█▏        | 44842/371472 [3:34:26<29:02:30,  3.12it/s]
 12%|█▏        | 44843/371472 [3:34:27<27:51:49,  3.26it/s]
 12%|█▏        | 44844/371472 [3:34:27<26:26:23,  3.43it/s]
 12%|█▏        | 44845/371472 [3:34:27<25:52:30,  3.51it/s]
 12%|█▏        | 44846/371472 [3:34:28<25:24:07,  3.57it/s]
 12%|█▏        | 44847/371472 [3:34:28<24:31:42,  3.70it/s]
 12%|█▏        | 44848/371472 [3:34:28<26:05:57,  3.48it/s]
 12%|█▏        | 44849/371472 [3:34:28<25:07:31,  3.61it/s]
 12%|█▏        | 44850/371472 [3:34:29<25:04:33,  3.62it/s]
 12%|█▏        | 44851/371472 [3:34:29<25:39:09,  3.54it/s]
 12%|█▏        | 44852/371472 [3:34:29<25:44:32,  3.52it/s]
 12%|█▏        | 44853/371472 [3:34:30<26:19:23,  3.45it/s]
 12%|█▏        | 44854/371472 [3:34:30<26:34:40,  3.41it/s]
 12%|█▏        | 44855/371472 [3:34:30<26:01:42,  3.49it/s]
 12%|█▏        | 44856/371472 [3:34:30<25:34:35,  3.55it/s]
 12%|█▏        | 44857/371472 [3:34:31<26:00:49,  3.49it/s]
 12%|█▏        | 44858/371472 [3:34:31<24:57:43,  3.63it/s]
 12%|█▏        | 44859/371472 [3:34:31<24:55:42,  3.64it/s]
 12%|█▏        | 44860/371472 [3:34:31<24:23:26,  3.72it/s]
                                                           
{'loss': 4.2406, 'learning_rate': 8.917397487556293e-07, 'epoch': 1.93}

 12%|█▏        | 44860/371472 [3:34:31<24:23:26,  3.72it/s]
 12%|█▏        | 44861/371472 [3:34:32<24:19:27,  3.73it/s]
 12%|█▏        | 44862/371472 [3:34:32<24:33:45,  3.69it/s]
 12%|█▏        | 44863/371472 [3:34:32<23:57:47,  3.79it/s]
 12%|█▏        | 44864/371472 [3:34:33<24:58:31,  3.63it/s]
 12%|█▏        | 44865/371472 [3:34:33<25:20:29,  3.58it/s]
 12%|█▏        | 44866/371472 [3:34:33<24:38:29,  3.68it/s]
 12%|█▏        | 44867/371472 [3:34:33<24:23:16,  3.72it/s]
 12%|█▏        | 44868/371472 [3:34:34<25:18:46,  3.58it/s]
 12%|█▏        | 44869/371472 [3:34:34<24:15:58,  3.74it/s]
 12%|█▏        | 44870/371472 [3:34:34<23:59:12,  3.78it/s]
 12%|█▏        | 44871/371472 [3:34:34<24:46:30,  3.66it/s]
 12%|█▏        | 44872/371472 [3:34:35<24:49:39,  3.65it/s]
 12%|█▏        | 44873/371472 [3:34:35<24:54:04,  3.64it/s]
 12%|█▏        | 44874/371472 [3:34:35<24:36:42,  3.69it/s]
 12%|█▏        | 44875/371472 [3:34:36<24:55:54,  3.64it/s]
 12%|█▏        | 44876/371472 [3:34:36<24:21:58,  3.72it/s]
 12%|█▏        | 44877/371472 [3:34:36<23:36:23,  3.84it/s]
 12%|█▏        | 44878/371472 [3:34:36<24:15:18,  3.74it/s]
 12%|█▏        | 44879/371472 [3:34:37<25:22:37,  3.57it/s]
 12%|█▏        | 44880/371472 [3:34:37<25:54:32,  3.50it/s]
                                                           
{'loss': 4.4796, 'learning_rate': 8.916912667801504e-07, 'epoch': 1.93}

 12%|█▏        | 44880/371472 [3:34:37<25:54:32,  3.50it/s]
 12%|█▏        | 44881/371472 [3:34:37<25:52:33,  3.51it/s]
 12%|█▏        | 44882/371472 [3:34:37<24:51:26,  3.65it/s]
 12%|█▏        | 44883/371472 [3:34:38<24:44:19,  3.67it/s]
 12%|█▏        | 44884/371472 [3:34:38<25:07:54,  3.61it/s]
 12%|█▏        | 44885/371472 [3:34:38<25:33:31,  3.55it/s]
 12%|█▏        | 44886/371472 [3:34:39<25:16:05,  3.59it/s]
 12%|█▏        | 44887/371472 [3:34:39<24:28:21,  3.71it/s]
 12%|█▏        | 44888/371472 [3:34:39<24:05:52,  3.76it/s]
 12%|█▏        | 44889/371472 [3:34:39<24:18:56,  3.73it/s]
 12%|█▏        | 44890/371472 [3:34:40<24:03:56,  3.77it/s]
 12%|█▏        | 44891/371472 [3:34:40<23:48:18,  3.81it/s]
 12%|█▏        | 44892/371472 [3:34:40<23:20:42,  3.89it/s]
 12%|█▏        | 44893/371472 [3:34:40<23:51:48,  3.80it/s]
 12%|█▏        | 44894/371472 [3:34:41<24:17:43,  3.73it/s]
 12%|█▏        | 44895/371472 [3:34:41<24:43:35,  3.67it/s]
 12%|█▏        | 44896/371472 [3:34:41<25:46:35,  3.52it/s]
 12%|█▏        | 44897/371472 [3:34:42<27:30:33,  3.30it/s]
 12%|█▏        | 44898/371472 [3:34:42<28:26:10,  3.19it/s]
 12%|█▏        | 44899/371472 [3:34:42<27:52:52,  3.25it/s]
 12%|█▏        | 44900/371472 [3:34:43<26:13:52,  3.46it/s]
                                                           
{'loss': 4.2853, 'learning_rate': 8.916427848046715e-07, 'epoch': 1.93}

 12%|█▏        | 44900/371472 [3:34:43<26:13:52,  3.46it/s]
 12%|█▏        | 44901/371472 [3:34:43<27:03:00,  3.35it/s]
 12%|█▏        | 44902/371472 [3:34:43<26:53:27,  3.37it/s]
 12%|█▏        | 44903/371472 [3:34:43<26:27:25,  3.43it/s]
 12%|█▏        | 44904/371472 [3:34:44<25:23:24,  3.57it/s]
 12%|█▏        | 44905/371472 [3:34:44<26:31:35,  3.42it/s]
 12%|█▏        | 44906/371472 [3:34:44<27:13:47,  3.33it/s]
 12%|█▏        | 44907/371472 [3:34:45<27:13:22,  3.33it/s]
 12%|█▏        | 44908/371472 [3:34:45<26:08:43,  3.47it/s]
 12%|█▏        | 44909/371472 [3:34:45<27:10:41,  3.34it/s]
 12%|█▏        | 44910/371472 [3:34:45<25:59:54,  3.49it/s]
 12%|█▏        | 44911/371472 [3:34:46<25:25:18,  3.57it/s]
 12%|█▏        | 44912/371472 [3:34:46<26:59:34,  3.36it/s]
 12%|█▏        | 44913/371472 [3:34:46<26:20:34,  3.44it/s]
 12%|█▏        | 44914/371472 [3:34:47<26:51:31,  3.38it/s]
 12%|█▏        | 44915/371472 [3:34:47<26:25:48,  3.43it/s]
 12%|█▏        | 44916/371472 [3:34:47<26:20:49,  3.44it/s]
 12%|█▏        | 44917/371472 [3:34:47<25:05:57,  3.61it/s]
 12%|█▏        | 44918/371472 [3:34:48<24:29:59,  3.70it/s]
 12%|█▏        | 44919/371472 [3:34:48<27:41:45,  3.28it/s]
 12%|█▏        | 44920/371472 [3:34:48<27:41:39,  3.28it/s]
                                                           
{'loss': 4.3997, 'learning_rate': 8.915943028291926e-07, 'epoch': 1.93}

 12%|█▏        | 44920/371472 [3:34:48<27:41:39,  3.28it/s]
 12%|█▏        | 44921/371472 [3:34:49<26:52:58,  3.37it/s]
 12%|█▏        | 44922/371472 [3:34:49<25:59:27,  3.49it/s]
 12%|█▏        | 44923/371472 [3:34:49<26:50:31,  3.38it/s]
 12%|█▏        | 44924/371472 [3:34:49<25:35:01,  3.55it/s]
 12%|█▏        | 44925/371472 [3:34:50<26:35:58,  3.41it/s]
 12%|█▏        | 44926/371472 [3:34:50<25:54:56,  3.50it/s]
 12%|█▏        | 44927/371472 [3:34:50<26:54:06,  3.37it/s]
 12%|█▏        | 44928/371472 [3:34:51<27:24:13,  3.31it/s]
 12%|█▏        | 44929/371472 [3:34:51<27:14:42,  3.33it/s]
 12%|█▏        | 44930/371472 [3:34:51<28:08:42,  3.22it/s]
 12%|█▏        | 44931/371472 [3:34:52<27:06:00,  3.35it/s]
 12%|█▏        | 44932/371472 [3:34:52<27:20:34,  3.32it/s]
 12%|█▏        | 44933/371472 [3:34:52<25:55:58,  3.50it/s]
 12%|█▏        | 44934/371472 [3:34:52<25:43:44,  3.53it/s]
 12%|█▏        | 44935/371472 [3:34:53<26:01:28,  3.49it/s]
 12%|█▏        | 44936/371472 [3:34:53<25:01:58,  3.62it/s]
 12%|█▏        | 44937/371472 [3:34:53<25:31:54,  3.55it/s]
 12%|█▏        | 44938/371472 [3:34:54<25:39:01,  3.54it/s]
 12%|█▏        | 44939/371472 [3:34:54<26:21:29,  3.44it/s]
 12%|█▏        | 44940/371472 [3:34:54<26:33:12,  3.42it/s]
                                                           
{'loss': 4.2774, 'learning_rate': 8.915458208537136e-07, 'epoch': 1.94}

 12%|█▏        | 44940/371472 [3:34:54<26:33:12,  3.42it/s]
 12%|█▏        | 44941/371472 [3:34:55<29:44:15,  3.05it/s]
 12%|█▏        | 44942/371472 [3:34:55<27:37:26,  3.28it/s]
 12%|█▏        | 44943/371472 [3:34:55<25:48:00,  3.52it/s]
 12%|█▏        | 44944/371472 [3:34:55<25:14:08,  3.59it/s]
 12%|█▏        | 44945/371472 [3:34:56<25:35:20,  3.54it/s]
 12%|█▏        | 44946/371472 [3:34:56<26:25:29,  3.43it/s]
 12%|█▏        | 44947/371472 [3:34:56<26:18:45,  3.45it/s]
 12%|█▏        | 44948/371472 [3:34:57<25:44:36,  3.52it/s]
 12%|█▏        | 44949/371472 [3:34:57<25:56:39,  3.50it/s]
 12%|█▏        | 44950/371472 [3:34:57<27:18:32,  3.32it/s]
 12%|█▏        | 44951/371472 [3:34:57<27:43:04,  3.27it/s]
 12%|█▏        | 44952/371472 [3:34:58<26:39:51,  3.40it/s]
 12%|█▏        | 44953/371472 [3:34:58<29:48:46,  3.04it/s]
 12%|█▏        | 44954/371472 [3:34:58<28:26:30,  3.19it/s]
 12%|█▏        | 44955/371472 [3:34:59<27:39:27,  3.28it/s]
 12%|█▏        | 44956/371472 [3:34:59<26:24:58,  3.43it/s]
 12%|█▏        | 44957/371472 [3:34:59<25:12:33,  3.60it/s]
 12%|█▏        | 44958/371472 [3:34:59<24:41:46,  3.67it/s]
 12%|█▏        | 44959/371472 [3:35:00<24:26:30,  3.71it/s]
 12%|█▏        | 44960/371472 [3:35:00<25:04:08,  3.62it/s]
                                                           
{'loss': 4.2732, 'learning_rate': 8.914973388782348e-07, 'epoch': 1.94}

 12%|█▏        | 44960/371472 [3:35:00<25:04:08,  3.62it/s]
 12%|█▏        | 44961/371472 [3:35:00<24:20:46,  3.73it/s]
 12%|█▏        | 44962/371472 [3:35:01<23:54:58,  3.79it/s]
 12%|█▏        | 44963/371472 [3:35:01<24:40:15,  3.68it/s]
 12%|█▏        | 44964/371472 [3:35:01<25:01:03,  3.63it/s]
 12%|█▏        | 44965/371472 [3:35:01<26:09:39,  3.47it/s]
 12%|█▏        | 44966/371472 [3:35:02<25:26:01,  3.57it/s]
 12%|█▏        | 44967/371472 [3:35:02<26:42:23,  3.40it/s]
 12%|█▏        | 44968/371472 [3:35:02<26:02:04,  3.48it/s]
 12%|█▏        | 44969/371472 [3:35:03<25:53:51,  3.50it/s]
 12%|█▏        | 44970/371472 [3:35:03<24:34:46,  3.69it/s]
 12%|█▏        | 44971/371472 [3:35:03<29:20:22,  3.09it/s]
 12%|█▏        | 44972/371472 [3:35:04<28:34:13,  3.17it/s]
 12%|█▏        | 44973/371472 [3:35:04<27:55:54,  3.25it/s]
 12%|█▏        | 44974/371472 [3:35:04<27:41:07,  3.28it/s]
 12%|█▏        | 44975/371472 [3:35:04<26:55:33,  3.37it/s]
 12%|█▏        | 44976/371472 [3:35:05<26:04:58,  3.48it/s]
 12%|█▏        | 44977/371472 [3:35:05<27:01:10,  3.36it/s]
 12%|█▏        | 44978/371472 [3:35:05<25:34:09,  3.55it/s]
 12%|█▏        | 44979/371472 [3:35:05<24:13:54,  3.74it/s]
 12%|█▏        | 44980/371472 [3:35:06<26:51:40,  3.38it/s]
                                                           
{'loss': 4.4675, 'learning_rate': 8.914488569027559e-07, 'epoch': 1.94}

 12%|█▏        | 44980/371472 [3:35:06<26:51:40,  3.38it/s]
 12%|█▏        | 44981/371472 [3:35:06<27:01:05,  3.36it/s]
 12%|█▏        | 44982/371472 [3:35:06<25:54:56,  3.50it/s]
 12%|█▏        | 44983/371472 [3:35:07<26:54:06,  3.37it/s]
 12%|█▏        | 44984/371472 [3:35:07<26:41:01,  3.40it/s]
 12%|█▏        | 44985/371472 [3:35:07<28:21:45,  3.20it/s]
 12%|█▏        | 44986/371472 [3:35:08<27:17:53,  3.32it/s]
 12%|█▏        | 44987/371472 [3:35:08<26:37:45,  3.41it/s]
 12%|█▏        | 44988/371472 [3:35:08<28:25:42,  3.19it/s]
 12%|█▏        | 44989/371472 [3:35:09<26:52:43,  3.37it/s]
 12%|█▏        | 44990/371472 [3:35:09<26:51:03,  3.38it/s]
 12%|█▏        | 44991/371472 [3:35:09<26:52:03,  3.38it/s]
 12%|█▏        | 44992/371472 [3:35:09<25:45:04,  3.52it/s]
 12%|█▏        | 44993/371472 [3:35:10<25:21:48,  3.58it/s]
 12%|█▏        | 44994/371472 [3:35:10<24:45:37,  3.66it/s]
 12%|█▏        | 44995/371472 [3:35:10<24:34:36,  3.69it/s]
 12%|█▏        | 44996/371472 [3:35:10<24:46:13,  3.66it/s]
 12%|█▏        | 44997/371472 [3:35:11<25:19:41,  3.58it/s]
 12%|█▏        | 44998/371472 [3:35:11<24:32:16,  3.70it/s]
 12%|█▏        | 44999/371472 [3:35:11<23:51:03,  3.80it/s]
 12%|█▏        | 45000/371472 [3:35:11<24:11:55,  3.75it/s]
                                                           
{'loss': 4.3969, 'learning_rate': 8.91400374927277e-07, 'epoch': 1.94}

 12%|█▏        | 45000/371472 [3:35:11<24:11:55,  3.75it/s]
 12%|█▏        | 45001/371472 [3:35:12<23:45:11,  3.82it/s]
 12%|█▏        | 45002/371472 [3:35:12<24:22:05,  3.72it/s]
 12%|█▏        | 45003/371472 [3:35:12<24:20:44,  3.72it/s]
 12%|█▏        | 45004/371472 [3:35:13<23:59:52,  3.78it/s]
 12%|█▏        | 45005/371472 [3:35:13<24:29:26,  3.70it/s]
 12%|█▏        | 45006/371472 [3:35:13<24:01:45,  3.77it/s]
 12%|█▏        | 45007/371472 [3:35:13<24:09:27,  3.75it/s]
 12%|█▏        | 45008/371472 [3:35:14<23:48:28,  3.81it/s]
 12%|█▏        | 45009/371472 [3:35:14<27:49:23,  3.26it/s]
 12%|█▏        | 45010/371472 [3:35:14<27:32:14,  3.29it/s]
 12%|█▏        | 45011/371472 [3:35:15<27:37:47,  3.28it/s]
 12%|█▏        | 45012/371472 [3:35:15<27:12:14,  3.33it/s]
 12%|█▏        | 45013/371472 [3:35:15<26:59:58,  3.36it/s]
 12%|█▏        | 45014/371472 [3:35:15<26:33:29,  3.41it/s]
 12%|█▏        | 45015/371472 [3:35:16<26:10:05,  3.47it/s]
 12%|█▏        | 45016/371472 [3:35:16<25:36:24,  3.54it/s]
 12%|█▏        | 45017/371472 [3:35:16<25:30:45,  3.55it/s]
 12%|█▏        | 45018/371472 [3:35:17<28:04:31,  3.23it/s]
 12%|█▏        | 45019/371472 [3:35:17<26:47:42,  3.38it/s]
 12%|█▏        | 45020/371472 [3:35:17<27:22:18,  3.31it/s]
                                                           
{'loss': 4.3149, 'learning_rate': 8.913518929517981e-07, 'epoch': 1.94}

 12%|█▏        | 45020/371472 [3:35:17<27:22:18,  3.31it/s]
 12%|█▏        | 45021/371472 [3:35:18<27:12:54,  3.33it/s]
 12%|█▏        | 45022/371472 [3:35:18<27:44:19,  3.27it/s]
 12%|█▏        | 45023/371472 [3:35:18<27:32:54,  3.29it/s]
 12%|█▏        | 45024/371472 [3:35:18<27:04:55,  3.35it/s]
 12%|█▏        | 45025/371472 [3:35:19<27:52:15,  3.25it/s]
 12%|█▏        | 45026/371472 [3:35:19<28:00:23,  3.24it/s]
 12%|█▏        | 45027/371472 [3:35:19<26:48:05,  3.38it/s]
 12%|█▏        | 45028/371472 [3:35:20<26:17:45,  3.45it/s]
 12%|█▏        | 45029/371472 [3:35:20<25:28:17,  3.56it/s]
 12%|█▏        | 45030/371472 [3:35:20<25:42:27,  3.53it/s]
 12%|█▏        | 45031/371472 [3:35:21<26:17:07,  3.45it/s]
 12%|█▏        | 45032/371472 [3:35:21<25:36:19,  3.54it/s]
 12%|█▏        | 45033/371472 [3:35:21<24:43:18,  3.67it/s]
 12%|█▏        | 45034/371472 [3:35:21<24:16:52,  3.73it/s]
 12%|█▏        | 45035/371472 [3:35:22<26:01:14,  3.48it/s]
 12%|█▏        | 45036/371472 [3:35:22<25:45:27,  3.52it/s]
 12%|█▏        | 45037/371472 [3:35:22<25:48:39,  3.51it/s]
 12%|█▏        | 45038/371472 [3:35:22<26:11:41,  3.46it/s]
 12%|█▏        | 45039/371472 [3:35:23<26:34:18,  3.41it/s]
 12%|█▏        | 45040/371472 [3:35:23<25:32:45,  3.55it/s]
                                                           
{'loss': 4.4777, 'learning_rate': 8.913034109763192e-07, 'epoch': 1.94}

 12%|█▏        | 45040/371472 [3:35:23<25:32:45,  3.55it/s]
 12%|█▏        | 45041/371472 [3:35:23<25:56:56,  3.49it/s]
 12%|█▏        | 45042/371472 [3:35:24<27:32:28,  3.29it/s]
 12%|█▏        | 45043/371472 [3:35:24<27:16:08,  3.33it/s]
 12%|█▏        | 45044/371472 [3:35:24<26:11:21,  3.46it/s]
 12%|█▏        | 45045/371472 [3:35:24<25:22:19,  3.57it/s]
 12%|█▏        | 45046/371472 [3:35:25<24:31:54,  3.70it/s]
 12%|█▏        | 45047/371472 [3:35:25<24:21:55,  3.72it/s]
 12%|█▏        | 45048/371472 [3:35:25<24:06:21,  3.76it/s]
 12%|█▏        | 45049/371472 [3:35:26<24:56:58,  3.63it/s]
 12%|█▏        | 45050/371472 [3:35:26<24:41:26,  3.67it/s]
 12%|█▏        | 45051/371472 [3:35:26<24:49:06,  3.65it/s]
 12%|█▏        | 45052/371472 [3:35:26<26:42:27,  3.39it/s]
 12%|█▏        | 45053/371472 [3:35:27<26:20:35,  3.44it/s]
 12%|█▏        | 45054/371472 [3:35:27<25:59:47,  3.49it/s]
 12%|█▏        | 45055/371472 [3:35:27<25:31:38,  3.55it/s]
 12%|█▏        | 45056/371472 [3:35:28<24:36:46,  3.68it/s]
 12%|█▏        | 45057/371472 [3:35:28<24:46:50,  3.66it/s]
 12%|█▏        | 45058/371472 [3:35:28<24:48:53,  3.65it/s]
 12%|█▏        | 45059/371472 [3:35:28<25:41:17,  3.53it/s]
 12%|█▏        | 45060/371472 [3:35:29<24:54:27,  3.64it/s]
                                                           
{'loss': 4.426, 'learning_rate': 8.912549290008403e-07, 'epoch': 1.94}

 12%|█▏        | 45060/371472 [3:35:29<24:54:27,  3.64it/s]
 12%|█▏        | 45061/371472 [3:35:29<24:16:52,  3.73it/s]
 12%|█▏        | 45062/371472 [3:35:29<24:37:39,  3.68it/s]
 12%|█▏        | 45063/371472 [3:35:30<26:53:06,  3.37it/s]
 12%|█▏        | 45064/371472 [3:35:30<27:24:28,  3.31it/s]
 12%|█▏        | 45065/371472 [3:35:30<27:42:13,  3.27it/s]
 12%|█▏        | 45066/371472 [3:35:30<27:43:54,  3.27it/s]
 12%|█▏        | 45067/371472 [3:35:31<27:25:25,  3.31it/s]
 12%|█▏        | 45068/371472 [3:35:31<26:37:20,  3.41it/s]
 12%|█▏        | 45069/371472 [3:35:31<25:40:29,  3.53it/s]
 12%|█▏        | 45070/371472 [3:35:32<25:26:39,  3.56it/s]
 12%|█▏        | 45071/371472 [3:35:32<25:37:19,  3.54it/s]
 12%|█▏        | 45072/371472 [3:35:32<25:06:37,  3.61it/s]
 12%|█▏        | 45073/371472 [3:35:32<25:37:14,  3.54it/s]
 12%|█▏        | 45074/371472 [3:35:33<25:44:58,  3.52it/s]
 12%|█▏        | 45075/371472 [3:35:33<26:00:40,  3.49it/s]
 12%|█▏        | 45076/371472 [3:35:33<27:29:29,  3.30it/s]
 12%|█▏        | 45077/371472 [3:35:34<27:34:29,  3.29it/s]
 12%|█▏        | 45078/371472 [3:35:34<26:17:17,  3.45it/s]
 12%|█▏        | 45079/371472 [3:35:34<25:49:18,  3.51it/s]
 12%|█▏        | 45080/371472 [3:35:34<25:01:01,  3.62it/s]
                                                           
{'loss': 4.2196, 'learning_rate': 8.912064470253614e-07, 'epoch': 1.94}

 12%|█▏        | 45080/371472 [3:35:34<25:01:01,  3.62it/s]
 12%|█▏        | 45081/371472 [3:35:35<24:11:23,  3.75it/s]
 12%|█▏        | 45082/371472 [3:35:35<24:04:21,  3.77it/s]
 12%|█▏        | 45083/371472 [3:35:35<24:43:27,  3.67it/s]
 12%|█▏        | 45084/371472 [3:35:35<24:31:00,  3.70it/s]
 12%|█▏        | 45085/371472 [3:35:36<24:58:02,  3.63it/s]
 12%|█▏        | 45086/371472 [3:35:36<25:14:25,  3.59it/s]
 12%|█▏        | 45087/371472 [3:35:36<26:29:01,  3.42it/s]
 12%|█▏        | 45088/371472 [3:35:37<26:39:23,  3.40it/s]
 12%|█▏        | 45089/371472 [3:35:37<28:25:46,  3.19it/s]
 12%|█▏        | 45090/371472 [3:35:37<26:38:28,  3.40it/s]
 12%|█▏        | 45091/371472 [3:35:38<26:22:37,  3.44it/s]
 12%|█▏        | 45092/371472 [3:35:38<26:25:36,  3.43it/s]
 12%|█▏        | 45093/371472 [3:35:38<25:45:34,  3.52it/s]
 12%|█▏        | 45094/371472 [3:35:39<28:54:51,  3.14it/s]
 12%|█▏        | 45095/371472 [3:35:39<28:51:11,  3.14it/s]
 12%|█▏        | 45096/371472 [3:35:39<27:46:31,  3.26it/s]
 12%|█▏        | 45097/371472 [3:35:39<26:31:56,  3.42it/s]
 12%|█▏        | 45098/371472 [3:35:40<26:12:09,  3.46it/s]
 12%|█▏        | 45099/371472 [3:35:40<25:32:05,  3.55it/s]
 12%|█▏        | 45100/371472 [3:35:40<25:38:00,  3.54it/s]
                                                           
{'loss': 4.2747, 'learning_rate': 8.911579650498825e-07, 'epoch': 1.94}

 12%|█▏        | 45100/371472 [3:35:40<25:38:00,  3.54it/s]
 12%|█▏        | 45101/371472 [3:35:40<24:43:32,  3.67it/s]
 12%|█▏        | 45102/371472 [3:35:41<24:14:58,  3.74it/s]
 12%|█▏        | 45103/371472 [3:35:41<25:13:51,  3.59it/s]
 12%|█▏        | 45104/371472 [3:35:41<25:08:28,  3.61it/s]
 12%|█▏        | 45105/371472 [3:35:42<26:00:52,  3.48it/s]
 12%|█▏        | 45106/371472 [3:35:42<26:58:11,  3.36it/s]
 12%|█▏        | 45107/371472 [3:35:42<25:51:04,  3.51it/s]
 12%|█▏        | 45108/371472 [3:35:42<25:26:58,  3.56it/s]
 12%|█▏        | 45109/371472 [3:35:43<25:34:11,  3.55it/s]
 12%|█▏        | 45110/371472 [3:35:43<24:26:44,  3.71it/s]
 12%|█▏        | 45111/371472 [3:35:43<26:18:23,  3.45it/s]
 12%|█▏        | 45112/371472 [3:35:44<26:47:30,  3.38it/s]
 12%|█▏        | 45113/371472 [3:35:44<28:20:16,  3.20it/s]
 12%|█▏        | 45114/371472 [3:35:44<26:20:37,  3.44it/s]
 12%|█▏        | 45115/371472 [3:35:45<26:52:30,  3.37it/s]
 12%|█▏        | 45116/371472 [3:35:45<25:54:48,  3.50it/s]
 12%|█▏        | 45117/371472 [3:35:45<24:47:12,  3.66it/s]
 12%|█▏        | 45118/371472 [3:35:45<25:53:09,  3.50it/s]
 12%|█▏        | 45119/371472 [3:35:46<26:45:23,  3.39it/s]
 12%|█▏        | 45120/371472 [3:35:46<27:38:51,  3.28it/s]
                                                           
{'loss': 4.2879, 'learning_rate': 8.911094830744036e-07, 'epoch': 1.94}

 12%|█▏        | 45120/371472 [3:35:46<27:38:51,  3.28it/s]
 12%|█▏        | 45121/371472 [3:35:46<26:22:19,  3.44it/s]
 12%|█▏        | 45122/371472 [3:35:47<25:37:11,  3.54it/s]
 12%|█▏        | 45123/371472 [3:35:47<24:58:21,  3.63it/s]
 12%|█▏        | 45124/371472 [3:35:47<26:27:27,  3.43it/s]
 12%|█▏        | 45125/371472 [3:35:47<26:22:50,  3.44it/s]
 12%|█▏        | 45126/371472 [3:35:48<25:35:20,  3.54it/s]
 12%|█▏        | 45127/371472 [3:35:48<25:54:57,  3.50it/s]
 12%|█▏        | 45128/371472 [3:35:48<27:44:05,  3.27it/s]
 12%|█▏        | 45129/371472 [3:35:49<27:10:07,  3.34it/s]
 12%|█▏        | 45130/371472 [3:35:49<26:28:39,  3.42it/s]
 12%|█▏        | 45131/371472 [3:35:49<26:08:49,  3.47it/s]
 12%|█▏        | 45132/371472 [3:35:49<25:37:33,  3.54it/s]
 12%|█▏        | 45133/371472 [3:35:50<24:41:49,  3.67it/s]
 12%|█▏        | 45134/371472 [3:35:50<24:30:11,  3.70it/s]
 12%|█▏        | 45135/371472 [3:35:50<24:11:34,  3.75it/s]
 12%|█▏        | 45136/371472 [3:35:51<25:52:27,  3.50it/s]
 12%|█▏        | 45137/371472 [3:35:51<27:24:52,  3.31it/s]
 12%|█▏        | 45138/371472 [3:35:51<26:39:14,  3.40it/s]
 12%|█▏        | 45139/371472 [3:35:51<27:49:35,  3.26it/s]
 12%|█▏        | 45140/371472 [3:35:52<26:54:07,  3.37it/s]
                                                           
{'loss': 4.3427, 'learning_rate': 8.910610010989248e-07, 'epoch': 1.94}

 12%|█▏        | 45140/371472 [3:35:52<26:54:07,  3.37it/s]
 12%|█▏        | 45141/371472 [3:35:52<26:29:12,  3.42it/s]
 12%|█▏        | 45142/371472 [3:35:52<25:44:11,  3.52it/s]
 12%|█▏        | 45143/371472 [3:35:53<26:36:37,  3.41it/s]
 12%|█▏        | 45144/371472 [3:35:53<26:13:10,  3.46it/s]
 12%|█▏        | 45145/371472 [3:35:53<25:46:54,  3.52it/s]
 12%|█▏        | 45146/371472 [3:35:53<25:22:50,  3.57it/s]
 12%|█▏        | 45147/371472 [3:35:54<26:11:58,  3.46it/s]
 12%|█▏        | 45148/371472 [3:35:54<26:28:40,  3.42it/s]
 12%|█▏        | 45149/371472 [3:35:54<25:42:54,  3.52it/s]
 12%|█▏        | 45150/371472 [3:35:55<25:53:44,  3.50it/s]
 12%|█▏        | 45151/371472 [3:35:55<25:24:54,  3.57it/s]
 12%|█▏        | 45152/371472 [3:35:55<24:58:14,  3.63it/s]
 12%|█▏        | 45153/371472 [3:35:55<25:01:51,  3.62it/s]
 12%|█▏        | 45154/371472 [3:35:56<24:28:59,  3.70it/s]
 12%|█▏        | 45155/371472 [3:35:56<24:15:50,  3.74it/s]
 12%|█▏        | 45156/371472 [3:35:56<26:44:02,  3.39it/s]
 12%|█▏        | 45157/371472 [3:35:57<26:25:08,  3.43it/s]
 12%|█▏        | 45158/371472 [3:35:57<26:13:19,  3.46it/s]
 12%|█▏        | 45159/371472 [3:35:57<27:08:50,  3.34it/s]
 12%|█▏        | 45160/371472 [3:35:57<25:40:21,  3.53it/s]
                                                           
{'loss': 4.3285, 'learning_rate': 8.910125191234459e-07, 'epoch': 1.95}

 12%|█▏        | 45160/371472 [3:35:57<25:40:21,  3.53it/s]
 12%|█▏        | 45161/371472 [3:35:58<27:37:52,  3.28it/s]
 12%|█▏        | 45162/371472 [3:35:58<26:16:00,  3.45it/s]
 12%|█▏        | 45163/371472 [3:35:58<27:39:52,  3.28it/s]
 12%|█▏        | 45164/371472 [3:35:59<27:23:26,  3.31it/s]
 12%|█▏        | 45165/371472 [3:35:59<26:19:40,  3.44it/s]
 12%|█▏        | 45166/371472 [3:35:59<25:03:40,  3.62it/s]
 12%|█▏        | 45167/371472 [3:35:59<25:58:52,  3.49it/s]
 12%|█▏        | 45168/371472 [3:36:00<25:27:03,  3.56it/s]
 12%|█▏        | 45169/371472 [3:36:00<24:43:39,  3.67it/s]
 12%|█▏        | 45170/371472 [3:36:00<25:49:12,  3.51it/s]
 12%|█▏        | 45171/371472 [3:36:01<25:33:09,  3.55it/s]
 12%|█▏        | 45172/371472 [3:36:01<24:56:57,  3.63it/s]
 12%|█▏        | 45173/371472 [3:36:01<28:14:11,  3.21it/s]
 12%|█▏        | 45174/371472 [3:36:02<28:04:18,  3.23it/s]
 12%|█▏        | 45175/371472 [3:36:02<26:17:33,  3.45it/s]
 12%|█▏        | 45176/371472 [3:36:02<26:38:38,  3.40it/s]
 12%|█▏        | 45177/371472 [3:36:02<26:20:03,  3.44it/s]
 12%|█▏        | 45178/371472 [3:36:03<25:32:22,  3.55it/s]
 12%|█▏        | 45179/371472 [3:36:03<25:34:36,  3.54it/s]
 12%|█▏        | 45180/371472 [3:36:03<25:02:00,  3.62it/s]
                                                           
{'loss': 4.4457, 'learning_rate': 8.909640371479669e-07, 'epoch': 1.95}

 12%|█▏        | 45180/371472 [3:36:03<25:02:00,  3.62it/s]
 12%|█▏        | 45181/371472 [3:36:03<25:10:18,  3.60it/s]
 12%|█▏        | 45182/371472 [3:36:04<25:15:10,  3.59it/s]
 12%|█▏        | 45183/371472 [3:36:04<26:08:19,  3.47it/s]
 12%|█▏        | 45184/371472 [3:36:04<25:27:42,  3.56it/s]
 12%|█▏        | 45185/371472 [3:36:05<26:15:20,  3.45it/s]
 12%|█▏        | 45186/371472 [3:36:05<25:36:52,  3.54it/s]
 12%|█▏        | 45187/371472 [3:36:05<25:52:33,  3.50it/s]
 12%|█▏        | 45188/371472 [3:36:05<25:56:56,  3.49it/s]
 12%|█▏        | 45189/371472 [3:36:06<25:22:29,  3.57it/s]
 12%|█▏        | 45190/371472 [3:36:06<24:35:20,  3.69it/s]
 12%|█▏        | 45191/371472 [3:36:06<24:40:30,  3.67it/s]
 12%|█▏        | 45192/371472 [3:36:07<24:18:05,  3.73it/s]
 12%|█▏        | 45193/371472 [3:36:07<23:58:43,  3.78it/s]
 12%|█▏        | 45194/371472 [3:36:07<24:06:16,  3.76it/s]
 12%|█▏        | 45195/371472 [3:36:07<25:12:18,  3.60it/s]
 12%|█▏        | 45196/371472 [3:36:08<25:23:56,  3.57it/s]
 12%|█▏        | 45197/371472 [3:36:08<25:04:24,  3.61it/s]
 12%|█▏        | 45198/371472 [3:36:08<24:55:01,  3.64it/s]
 12%|█▏        | 45199/371472 [3:36:08<25:07:39,  3.61it/s]
 12%|█▏        | 45200/371472 [3:36:09<24:35:53,  3.68it/s]
                                                           
{'loss': 4.5181, 'learning_rate': 8.90915555172488e-07, 'epoch': 1.95}

 12%|█▏        | 45200/371472 [3:36:09<24:35:53,  3.68it/s]
 12%|█▏        | 45201/371472 [3:36:09<24:18:21,  3.73it/s]
 12%|█▏        | 45202/371472 [3:36:09<23:57:40,  3.78it/s]
 12%|█▏        | 45203/371472 [3:36:10<24:36:28,  3.68it/s]
 12%|█▏        | 45204/371472 [3:36:10<24:28:58,  3.70it/s]
 12%|█▏        | 45205/371472 [3:36:10<25:25:35,  3.56it/s]
 12%|█▏        | 45206/371472 [3:36:10<27:52:31,  3.25it/s]
 12%|█▏        | 45207/371472 [3:36:11<27:18:47,  3.32it/s]
 12%|█▏        | 45208/371472 [3:36:11<25:42:59,  3.52it/s]
 12%|█▏        | 45209/371472 [3:36:11<25:33:41,  3.55it/s]
 12%|█▏        | 45210/371472 [3:36:12<24:59:31,  3.63it/s]
 12%|█▏        | 45211/371472 [3:36:12<26:53:59,  3.37it/s]
 12%|█▏        | 45212/371472 [3:36:12<27:19:28,  3.32it/s]
 12%|█▏        | 45213/371472 [3:36:12<25:42:49,  3.52it/s]
 12%|█▏        | 45214/371472 [3:36:13<25:11:13,  3.60it/s]
 12%|█▏        | 45215/371472 [3:36:13<26:33:31,  3.41it/s]
 12%|█▏        | 45216/371472 [3:36:13<28:38:39,  3.16it/s]
 12%|█▏        | 45217/371472 [3:36:14<27:08:01,  3.34it/s]
 12%|█▏        | 45218/371472 [3:36:14<26:13:43,  3.46it/s]
 12%|█▏        | 45219/371472 [3:36:14<25:54:10,  3.50it/s]
 12%|█▏        | 45220/371472 [3:36:14<26:01:19,  3.48it/s]
                                                           
{'loss': 4.4637, 'learning_rate': 8.908670731970092e-07, 'epoch': 1.95}

 12%|█▏        | 45220/371472 [3:36:14<26:01:19,  3.48it/s]
 12%|█▏        | 45221/371472 [3:36:15<26:52:34,  3.37it/s]
 12%|█▏        | 45222/371472 [3:36:15<26:07:01,  3.47it/s]
 12%|█▏        | 45223/371472 [3:36:15<27:12:45,  3.33it/s]
 12%|█▏        | 45224/371472 [3:36:16<26:44:56,  3.39it/s]
 12%|█▏        | 45225/371472 [3:36:16<25:40:39,  3.53it/s]
 12%|█▏        | 45226/371472 [3:36:16<26:44:09,  3.39it/s]
 12%|█▏        | 45227/371472 [3:36:17<27:33:00,  3.29it/s]
 12%|█▏        | 45228/371472 [3:36:17<26:03:23,  3.48it/s]
 12%|█▏        | 45229/371472 [3:36:17<25:33:04,  3.55it/s]
 12%|█▏        | 45230/371472 [3:36:17<25:39:39,  3.53it/s]
 12%|█▏        | 45231/371472 [3:36:18<25:07:12,  3.61it/s]
 12%|█▏        | 45232/371472 [3:36:18<25:00:45,  3.62it/s]
 12%|█▏        | 45233/371472 [3:36:18<24:52:44,  3.64it/s]
 12%|█▏        | 45234/371472 [3:36:19<27:01:30,  3.35it/s]
 12%|█▏        | 45235/371472 [3:36:19<25:48:54,  3.51it/s]
 12%|█▏        | 45236/371472 [3:36:19<25:01:25,  3.62it/s]
 12%|█▏        | 45237/371472 [3:36:19<25:35:53,  3.54it/s]
 12%|█▏        | 45238/371472 [3:36:20<25:12:15,  3.60it/s]
 12%|█▏        | 45239/371472 [3:36:20<24:48:11,  3.65it/s]
 12%|█▏        | 45240/371472 [3:36:20<24:07:02,  3.76it/s]
                                                           
{'loss': 4.2949, 'learning_rate': 8.908185912215302e-07, 'epoch': 1.95}

 12%|█▏        | 45240/371472 [3:36:20<24:07:02,  3.76it/s]
 12%|█▏        | 45241/371472 [3:36:20<24:24:23,  3.71it/s]
 12%|█▏        | 45242/371472 [3:36:21<24:28:58,  3.70it/s]
 12%|█▏        | 45243/371472 [3:36:21<24:26:55,  3.71it/s]
 12%|█▏        | 45244/371472 [3:36:21<25:02:48,  3.62it/s]
 12%|█▏        | 45245/371472 [3:36:22<26:57:10,  3.36it/s]
 12%|█▏        | 45246/371472 [3:36:22<26:07:00,  3.47it/s]
 12%|█▏        | 45247/371472 [3:36:22<25:28:31,  3.56it/s]
 12%|█▏        | 45248/371472 [3:36:22<25:21:31,  3.57it/s]
 12%|█▏        | 45249/371472 [3:36:23<24:38:51,  3.68it/s]
 12%|█▏        | 45250/371472 [3:36:23<23:46:03,  3.81it/s]
 12%|█▏        | 45251/371472 [3:36:23<23:52:56,  3.79it/s]
 12%|█▏        | 45252/371472 [3:36:23<25:03:31,  3.62it/s]
 12%|█▏        | 45253/371472 [3:36:24<26:02:40,  3.48it/s]
 12%|█▏        | 45254/371472 [3:36:24<25:19:54,  3.58it/s]
 12%|█▏        | 45255/371472 [3:36:24<25:43:15,  3.52it/s]
 12%|█▏        | 45256/371472 [3:36:25<25:29:58,  3.55it/s]
 12%|█▏        | 45257/371472 [3:36:25<28:09:39,  3.22it/s]
 12%|█▏        | 45258/371472 [3:36:25<28:21:33,  3.20it/s]
 12%|█▏        | 45259/371472 [3:36:26<26:37:07,  3.40it/s]
 12%|█▏        | 45260/371472 [3:36:26<28:27:06,  3.18it/s]
                                                           
{'loss': 4.2796, 'learning_rate': 8.907701092460514e-07, 'epoch': 1.95}

 12%|█▏        | 45260/371472 [3:36:26<28:27:06,  3.18it/s]
 12%|█▏        | 45261/371472 [3:36:26<27:22:20,  3.31it/s]
 12%|█▏        | 45262/371472 [3:36:27<28:00:28,  3.24it/s]
 12%|█▏        | 45263/371472 [3:36:27<26:42:45,  3.39it/s]
 12%|█▏        | 45264/371472 [3:36:27<25:59:17,  3.49it/s]
 12%|█▏        | 45265/371472 [3:36:27<24:45:24,  3.66it/s]
 12%|█▏        | 45266/371472 [3:36:28<25:32:41,  3.55it/s]
 12%|█▏        | 45267/371472 [3:36:28<24:30:04,  3.70it/s]
 12%|█▏        | 45268/371472 [3:36:28<24:31:23,  3.69it/s]
 12%|█▏        | 45269/371472 [3:36:28<25:23:55,  3.57it/s]
 12%|█▏        | 45270/371472 [3:36:29<25:39:28,  3.53it/s]
 12%|█▏        | 45271/371472 [3:36:29<25:36:00,  3.54it/s]
 12%|█▏        | 45272/371472 [3:36:29<24:44:22,  3.66it/s]
 12%|█▏        | 45273/371472 [3:36:30<24:47:01,  3.66it/s]
 12%|█▏        | 45274/371472 [3:36:30<26:06:26,  3.47it/s]
 12%|█▏        | 45275/371472 [3:36:30<26:04:10,  3.48it/s]
 12%|█▏        | 45276/371472 [3:36:30<25:19:00,  3.58it/s]
 12%|█▏        | 45277/371472 [3:36:31<24:47:02,  3.66it/s]
 12%|█▏        | 45278/371472 [3:36:31<24:48:50,  3.65it/s]
 12%|█▏        | 45279/371472 [3:36:31<24:19:24,  3.73it/s]
 12%|█▏        | 45280/371472 [3:36:31<25:39:30,  3.53it/s]
                                                           
{'loss': 4.3893, 'learning_rate': 8.907216272705725e-07, 'epoch': 1.95}

 12%|█▏        | 45280/371472 [3:36:31<25:39:30,  3.53it/s]
 12%|█▏        | 45281/371472 [3:36:32<28:01:23,  3.23it/s]
 12%|█▏        | 45282/371472 [3:36:32<27:45:53,  3.26it/s]
 12%|█▏        | 45283/371472 [3:36:32<26:30:08,  3.42it/s]
 12%|█▏        | 45284/371472 [3:36:33<26:10:29,  3.46it/s]
 12%|█▏        | 45285/371472 [3:36:33<25:07:21,  3.61it/s]
 12%|█▏        | 45286/371472 [3:36:33<24:19:49,  3.72it/s]
 12%|█▏        | 45287/371472 [3:36:33<24:33:26,  3.69it/s]
 12%|█▏        | 45288/371472 [3:36:34<25:02:29,  3.62it/s]
 12%|█▏        | 45289/371472 [3:36:34<25:15:21,  3.59it/s]
 12%|█▏        | 45290/371472 [3:36:34<27:49:11,  3.26it/s]
 12%|█▏        | 45291/371472 [3:36:35<29:25:22,  3.08it/s]
 12%|█▏        | 45292/371472 [3:36:35<27:35:22,  3.28it/s]
 12%|█▏        | 45293/371472 [3:36:35<28:27:11,  3.18it/s]
 12%|█▏        | 45294/371472 [3:36:36<27:05:48,  3.34it/s]
 12%|█▏        | 45295/371472 [3:36:36<27:57:02,  3.24it/s]
 12%|█▏        | 45296/371472 [3:36:36<26:57:46,  3.36it/s]
 12%|█▏        | 45297/371472 [3:36:37<27:00:37,  3.35it/s]
 12%|█▏        | 45298/371472 [3:36:37<25:51:14,  3.50it/s]
 12%|█▏        | 45299/371472 [3:36:37<25:46:27,  3.52it/s]
 12%|█▏        | 45300/371472 [3:36:37<25:11:14,  3.60it/s]
                                                           
{'loss': 4.2103, 'learning_rate': 8.906731452950936e-07, 'epoch': 1.95}

 12%|█▏        | 45300/371472 [3:36:37<25:11:14,  3.60it/s]
 12%|█▏        | 45301/371472 [3:36:38<25:00:42,  3.62it/s]
 12%|█▏        | 45302/371472 [3:36:38<25:34:47,  3.54it/s]
 12%|█▏        | 45303/371472 [3:36:38<25:22:53,  3.57it/s]
 12%|█▏        | 45304/371472 [3:36:38<24:43:47,  3.66it/s]
 12%|█▏        | 45305/371472 [3:36:39<24:39:30,  3.67it/s]
 12%|█▏        | 45306/371472 [3:36:39<24:13:20,  3.74it/s]
 12%|█▏        | 45307/371472 [3:36:39<25:27:09,  3.56it/s]
 12%|█▏        | 45308/371472 [3:36:40<25:11:05,  3.60it/s]
 12%|█▏        | 45309/371472 [3:36:40<25:07:02,  3.61it/s]
 12%|█▏        | 45310/371472 [3:36:40<24:43:52,  3.66it/s]
 12%|█▏        | 45311/371472 [3:36:40<25:41:43,  3.53it/s]
 12%|█▏        | 45312/371472 [3:36:41<25:51:59,  3.50it/s]
 12%|█▏        | 45313/371472 [3:36:41<25:59:39,  3.49it/s]
 12%|█▏        | 45314/371472 [3:36:41<26:11:29,  3.46it/s]
 12%|█▏        | 45315/371472 [3:36:42<26:15:54,  3.45it/s]
 12%|█▏        | 45316/371472 [3:36:42<25:26:57,  3.56it/s]
 12%|█▏        | 45317/371472 [3:36:42<27:33:01,  3.29it/s]
 12%|█▏        | 45318/371472 [3:36:42<26:22:19,  3.44it/s]
 12%|█▏        | 45319/371472 [3:36:43<25:32:48,  3.55it/s]
 12%|█▏        | 45320/371472 [3:36:43<25:18:00,  3.58it/s]
                                                           
{'loss': 4.1402, 'learning_rate': 8.906246633196146e-07, 'epoch': 1.95}

 12%|█▏        | 45320/371472 [3:36:43<25:18:00,  3.58it/s]
 12%|█▏        | 45321/371472 [3:36:43<25:55:19,  3.49it/s]
 12%|█▏        | 45322/371472 [3:36:44<26:36:18,  3.41it/s]
 12%|█▏        | 45323/371472 [3:36:44<26:28:20,  3.42it/s]
 12%|█▏        | 45324/371472 [3:36:44<28:27:17,  3.18it/s]
 12%|█▏        | 45325/371472 [3:36:45<27:06:38,  3.34it/s]
 12%|█▏        | 45326/371472 [3:36:45<27:00:11,  3.36it/s]
 12%|█▏        | 45327/371472 [3:36:45<25:47:02,  3.51it/s]
 12%|█▏        | 45328/371472 [3:36:45<25:50:36,  3.51it/s]
 12%|█▏        | 45329/371472 [3:36:46<25:38:32,  3.53it/s]
 12%|█▏        | 45330/371472 [3:36:46<25:25:07,  3.56it/s]
 12%|█▏        | 45331/371472 [3:36:46<25:19:52,  3.58it/s]
 12%|█▏        | 45332/371472 [3:36:46<25:30:31,  3.55it/s]
 12%|█▏        | 45333/371472 [3:36:47<24:53:15,  3.64it/s]
 12%|█▏        | 45334/371472 [3:36:47<24:17:17,  3.73it/s]
 12%|█▏        | 45335/371472 [3:36:47<24:33:58,  3.69it/s]
 12%|█▏        | 45336/371472 [3:36:48<25:06:05,  3.61it/s]
 12%|█▏        | 45337/371472 [3:36:48<24:54:49,  3.64it/s]
 12%|█▏        | 45338/371472 [3:36:48<24:53:47,  3.64it/s]
 12%|█▏        | 45339/371472 [3:36:48<25:27:09,  3.56it/s]
 12%|█▏        | 45340/371472 [3:36:49<26:17:17,  3.45it/s]
                                                           
{'loss': 4.3627, 'learning_rate': 8.905761813441358e-07, 'epoch': 1.95}

 12%|█▏        | 45340/371472 [3:36:49<26:17:17,  3.45it/s]
 12%|█▏        | 45341/371472 [3:36:49<27:39:42,  3.27it/s]
 12%|█▏        | 45342/371472 [3:36:49<28:02:11,  3.23it/s]
 12%|█▏        | 45343/371472 [3:36:50<28:02:40,  3.23it/s]
 12%|█▏        | 45344/371472 [3:36:50<26:49:58,  3.38it/s]
 12%|█▏        | 45345/371472 [3:36:50<25:59:44,  3.48it/s]
 12%|█▏        | 45346/371472 [3:36:50<25:16:43,  3.58it/s]
 12%|█▏        | 45347/371472 [3:36:51<24:28:12,  3.70it/s]
 12%|█▏        | 45348/371472 [3:36:51<24:22:17,  3.72it/s]
 12%|█▏        | 45349/371472 [3:36:51<24:52:50,  3.64it/s]
 12%|█▏        | 45350/371472 [3:36:52<26:07:44,  3.47it/s]
 12%|█▏        | 45351/371472 [3:36:52<25:47:23,  3.51it/s]
 12%|█▏        | 45352/371472 [3:36:52<25:09:10,  3.60it/s]
 12%|█▏        | 45353/371472 [3:36:52<24:18:44,  3.73it/s]
 12%|█▏        | 45354/371472 [3:36:53<24:11:43,  3.74it/s]
 12%|█▏        | 45355/371472 [3:36:53<25:48:40,  3.51it/s]
 12%|█▏        | 45356/371472 [3:36:53<25:33:43,  3.54it/s]
 12%|█▏        | 45357/371472 [3:36:54<25:25:28,  3.56it/s]
 12%|█▏        | 45358/371472 [3:36:54<25:13:19,  3.59it/s]
 12%|█▏        | 45359/371472 [3:36:54<25:18:55,  3.58it/s]
 12%|█▏        | 45360/371472 [3:36:54<26:18:00,  3.44it/s]
                                                           
{'loss': 4.3429, 'learning_rate': 8.905276993686569e-07, 'epoch': 1.95}

 12%|█▏        | 45360/371472 [3:36:54<26:18:00,  3.44it/s]
 12%|█▏        | 45361/371472 [3:36:55<25:09:27,  3.60it/s]
 12%|█▏        | 45362/371472 [3:36:55<25:08:04,  3.60it/s]
 12%|█▏        | 45363/371472 [3:36:55<24:26:13,  3.71it/s]
 12%|█▏        | 45364/371472 [3:36:55<23:59:15,  3.78it/s]
 12%|█▏        | 45365/371472 [3:36:56<23:56:47,  3.78it/s]
 12%|█▏        | 45366/371472 [3:36:56<25:05:16,  3.61it/s]
 12%|█▏        | 45367/371472 [3:36:56<25:16:02,  3.59it/s]
 12%|█▏        | 45368/371472 [3:36:57<25:42:01,  3.52it/s]
 12%|█▏        | 45369/371472 [3:36:57<25:13:40,  3.59it/s]
 12%|█▏        | 45370/371472 [3:36:57<24:44:25,  3.66it/s]
 12%|█▏        | 45371/371472 [3:36:57<24:52:15,  3.64it/s]
 12%|█▏        | 45372/371472 [3:36:58<24:14:45,  3.74it/s]
 12%|█▏        | 45373/371472 [3:36:58<24:37:19,  3.68it/s]
 12%|█▏        | 45374/371472 [3:36:58<25:22:10,  3.57it/s]
 12%|█▏        | 45375/371472 [3:36:58<25:35:24,  3.54it/s]
 12%|█▏        | 45376/371472 [3:36:59<26:36:06,  3.41it/s]
 12%|█▏        | 45377/371472 [3:36:59<25:47:50,  3.51it/s]
 12%|█▏        | 45378/371472 [3:36:59<25:09:54,  3.60it/s]
 12%|█▏        | 45379/371472 [3:37:00<24:24:33,  3.71it/s]
 12%|█▏        | 45380/371472 [3:37:00<25:27:50,  3.56it/s]
                                                           
{'loss': 4.4115, 'learning_rate': 8.904792173931781e-07, 'epoch': 1.95}

 12%|█▏        | 45380/371472 [3:37:00<25:27:50,  3.56it/s]
 12%|█▏        | 45381/371472 [3:37:00<25:09:18,  3.60it/s]
 12%|█▏        | 45382/371472 [3:37:00<25:36:04,  3.54it/s]
 12%|█▏        | 45383/371472 [3:37:01<26:47:09,  3.38it/s]
 12%|█▏        | 45384/371472 [3:37:01<27:26:24,  3.30it/s]
 12%|█▏        | 45385/371472 [3:37:01<26:47:47,  3.38it/s]
 12%|█▏        | 45386/371472 [3:37:02<25:42:14,  3.52it/s]
 12%|█▏        | 45387/371472 [3:37:02<26:39:42,  3.40it/s]
 12%|█▏        | 45388/371472 [3:37:02<26:03:31,  3.48it/s]
 12%|█▏        | 45389/371472 [3:37:03<25:55:45,  3.49it/s]
 12%|█▏        | 45390/371472 [3:37:03<25:50:20,  3.51it/s]
 12%|█▏        | 45391/371472 [3:37:03<26:24:07,  3.43it/s]
 12%|█▏        | 45392/371472 [3:37:03<25:09:10,  3.60it/s]
 12%|█▏        | 45393/371472 [3:37:04<24:14:35,  3.74it/s]
 12%|█▏        | 45394/371472 [3:37:04<26:53:18,  3.37it/s]
 12%|█▏        | 45395/371472 [3:37:04<27:21:49,  3.31it/s]
 12%|█▏        | 45396/371472 [3:37:05<26:37:14,  3.40it/s]
 12%|█▏        | 45397/371472 [3:37:05<25:55:18,  3.49it/s]
 12%|█▏        | 45398/371472 [3:37:05<26:37:29,  3.40it/s]
 12%|█▏        | 45399/371472 [3:37:05<25:51:43,  3.50it/s]
 12%|█▏        | 45400/371472 [3:37:06<25:11:23,  3.60it/s]
                                                           
{'loss': 4.6042, 'learning_rate': 8.904307354176991e-07, 'epoch': 1.96}

 12%|█▏        | 45400/371472 [3:37:06<25:11:23,  3.60it/s]
 12%|█▏        | 45401/371472 [3:37:06<24:52:01,  3.64it/s]
 12%|█▏        | 45402/371472 [3:37:06<25:36:54,  3.54it/s]
 12%|█▏        | 45403/371472 [3:37:06<25:08:24,  3.60it/s]
 12%|█▏        | 45404/371472 [3:37:07<27:19:18,  3.32it/s]
 12%|█▏        | 45405/371472 [3:37:07<27:14:21,  3.33it/s]
 12%|█▏        | 45406/371472 [3:37:07<26:33:01,  3.41it/s]
 12%|█▏        | 45407/371472 [3:37:08<27:06:50,  3.34it/s]
 12%|█▏        | 45408/371472 [3:37:08<26:47:40,  3.38it/s]
 12%|█▏        | 45409/371472 [3:37:08<26:36:07,  3.40it/s]
 12%|█▏        | 45410/371472 [3:37:09<26:14:35,  3.45it/s]
 12%|█▏        | 45411/371472 [3:37:09<26:27:18,  3.42it/s]
 12%|█▏        | 45412/371472 [3:37:09<25:55:45,  3.49it/s]
 12%|█▏        | 45413/371472 [3:37:09<25:25:24,  3.56it/s]
 12%|█▏        | 45414/371472 [3:37:10<25:56:13,  3.49it/s]
 12%|█▏        | 45415/371472 [3:37:10<25:25:41,  3.56it/s]
 12%|█▏        | 45416/371472 [3:37:10<25:56:36,  3.49it/s]
 12%|█▏        | 45417/371472 [3:37:11<25:50:49,  3.50it/s]
 12%|█▏        | 45418/371472 [3:37:11<25:22:44,  3.57it/s]
 12%|█▏        | 45419/371472 [3:37:11<25:05:45,  3.61it/s]
 12%|█▏        | 45420/371472 [3:37:11<24:51:28,  3.64it/s]
                                                           
{'loss': 4.2902, 'learning_rate': 8.903822534422203e-07, 'epoch': 1.96}

 12%|█▏        | 45420/371472 [3:37:11<24:51:28,  3.64it/s]
 12%|█▏        | 45421/371472 [3:37:12<24:16:23,  3.73it/s]
 12%|█▏        | 45422/371472 [3:37:12<24:20:56,  3.72it/s]
 12%|█▏        | 45423/371472 [3:37:12<23:56:43,  3.78it/s]
 12%|█▏        | 45424/371472 [3:37:13<26:47:26,  3.38it/s]
 12%|█▏        | 45425/371472 [3:37:13<28:04:29,  3.23it/s]
 12%|█▏        | 45426/371472 [3:37:13<27:25:20,  3.30it/s]
 12%|█▏        | 45427/371472 [3:37:13<26:46:14,  3.38it/s]
 12%|█▏        | 45428/371472 [3:37:14<26:27:09,  3.42it/s]
 12%|█▏        | 45429/371472 [3:37:14<25:45:58,  3.51it/s]
 12%|█▏        | 45430/371472 [3:37:14<25:33:44,  3.54it/s]
 12%|█▏        | 45431/371472 [3:37:15<25:21:13,  3.57it/s]
 12%|█▏        | 45432/371472 [3:37:15<25:23:51,  3.57it/s]
 12%|█▏        | 45433/371472 [3:37:15<24:45:48,  3.66it/s]
 12%|█▏        | 45434/371472 [3:37:15<25:00:55,  3.62it/s]
 12%|█▏        | 45435/371472 [3:37:16<24:48:02,  3.65it/s]
 12%|█▏        | 45436/371472 [3:37:16<27:18:17,  3.32it/s]
 12%|█▏        | 45437/371472 [3:37:16<27:03:10,  3.35it/s]
 12%|█▏        | 45438/371472 [3:37:17<25:38:08,  3.53it/s]
 12%|█▏        | 45439/371472 [3:37:17<24:40:07,  3.67it/s]
 12%|█▏        | 45440/371472 [3:37:17<24:30:53,  3.69it/s]
                                                           
{'loss': 4.2655, 'learning_rate': 8.903337714667413e-07, 'epoch': 1.96}

 12%|█▏        | 45440/371472 [3:37:17<24:30:53,  3.69it/s]
 12%|█▏        | 45441/371472 [3:37:17<25:07:05,  3.61it/s]
 12%|█▏        | 45442/371472 [3:37:18<26:51:50,  3.37it/s]
 12%|█▏        | 45443/371472 [3:37:18<25:23:24,  3.57it/s]
 12%|█▏        | 45444/371472 [3:37:18<25:11:31,  3.59it/s]
 12%|█▏        | 45445/371472 [3:37:19<26:19:41,  3.44it/s]
 12%|█▏        | 45446/371472 [3:37:19<25:04:58,  3.61it/s]
 12%|█▏        | 45447/371472 [3:37:19<25:31:56,  3.55it/s]
 12%|█▏        | 45448/371472 [3:37:19<24:24:41,  3.71it/s]
 12%|█▏        | 45449/371472 [3:37:20<25:31:34,  3.55it/s]
 12%|█▏        | 45450/371472 [3:37:20<25:22:44,  3.57it/s]
 12%|█▏        | 45451/371472 [3:37:20<25:21:47,  3.57it/s]
 12%|█▏        | 45452/371472 [3:37:20<24:58:43,  3.63it/s]
 12%|█▏        | 45453/371472 [3:37:21<24:35:28,  3.68it/s]
 12%|█▏        | 45454/371472 [3:37:21<24:48:47,  3.65it/s]
 12%|█▏        | 45455/371472 [3:37:21<25:17:02,  3.58it/s]
 12%|█▏        | 45456/371472 [3:37:22<24:38:58,  3.67it/s]
 12%|█▏        | 45457/371472 [3:37:22<24:19:50,  3.72it/s]
 12%|█▏        | 45458/371472 [3:37:22<25:14:33,  3.59it/s]
 12%|█▏        | 45459/371472 [3:37:22<24:42:37,  3.66it/s]
 12%|█▏        | 45460/371472 [3:37:23<24:42:59,  3.66it/s]
                                                           
{'loss': 4.2639, 'learning_rate': 8.902852894912624e-07, 'epoch': 1.96}

 12%|█▏        | 45460/371472 [3:37:23<24:42:59,  3.66it/s]
 12%|█▏        | 45461/371472 [3:37:23<26:11:44,  3.46it/s]
 12%|█▏        | 45462/371472 [3:37:23<25:07:07,  3.61it/s]
 12%|█▏        | 45463/371472 [3:37:23<24:43:42,  3.66it/s]
 12%|█▏        | 45464/371472 [3:37:24<24:01:42,  3.77it/s]
 12%|█▏        | 45465/371472 [3:37:24<24:08:38,  3.75it/s]
 12%|█▏        | 45466/371472 [3:37:24<24:25:27,  3.71it/s]
 12%|█▏        | 45467/371472 [3:37:25<26:30:59,  3.42it/s]
 12%|█▏        | 45468/371472 [3:37:25<26:59:34,  3.35it/s]
 12%|█▏        | 45469/371472 [3:37:25<25:50:07,  3.51it/s]
 12%|█▏        | 45470/371472 [3:37:25<25:37:56,  3.53it/s]
 12%|█▏        | 45471/371472 [3:37:26<25:43:21,  3.52it/s]
 12%|█▏        | 45472/371472 [3:37:26<25:26:30,  3.56it/s]
 12%|█▏        | 45473/371472 [3:37:26<25:51:42,  3.50it/s]
 12%|█▏        | 45474/371472 [3:37:27<26:11:40,  3.46it/s]
 12%|█▏        | 45475/371472 [3:37:27<26:48:01,  3.38it/s]
 12%|█▏        | 45476/371472 [3:37:27<26:32:02,  3.41it/s]
 12%|█▏        | 45477/371472 [3:37:28<28:07:56,  3.22it/s]
 12%|█▏        | 45478/371472 [3:37:28<27:58:38,  3.24it/s]
 12%|█▏        | 45479/371472 [3:37:28<26:56:13,  3.36it/s]
 12%|█▏        | 45480/371472 [3:37:28<26:15:34,  3.45it/s]
                                                           
{'loss': 4.4137, 'learning_rate': 8.902368075157835e-07, 'epoch': 1.96}

 12%|█▏        | 45480/371472 [3:37:28<26:15:34,  3.45it/s]
 12%|█▏        | 45481/371472 [3:37:29<25:27:08,  3.56it/s]
 12%|█▏        | 45482/371472 [3:37:29<28:08:57,  3.22it/s]
 12%|█▏        | 45483/371472 [3:37:29<27:26:43,  3.30it/s]
 12%|█▏        | 45484/371472 [3:37:30<26:28:39,  3.42it/s]
 12%|█▏        | 45485/371472 [3:37:30<28:02:06,  3.23it/s]
 12%|█▏        | 45486/371472 [3:37:30<26:35:38,  3.40it/s]
 12%|█▏        | 45487/371472 [3:37:30<26:55:15,  3.36it/s]
 12%|█▏        | 45488/371472 [3:37:31<26:13:18,  3.45it/s]
 12%|█▏        | 45489/371472 [3:37:31<25:42:24,  3.52it/s]
 12%|█▏        | 45490/371472 [3:37:31<26:31:18,  3.41it/s]
 12%|█▏        | 45491/371472 [3:37:32<25:04:49,  3.61it/s]
 12%|█▏        | 45492/371472 [3:37:32<25:17:49,  3.58it/s]
 12%|█▏        | 45493/371472 [3:37:32<24:56:55,  3.63it/s]
 12%|█▏        | 45494/371472 [3:37:33<28:06:43,  3.22it/s]
 12%|█▏        | 45495/371472 [3:37:33<28:55:39,  3.13it/s]
 12%|█▏        | 45496/371472 [3:37:33<29:48:56,  3.04it/s]
 12%|█▏        | 45497/371472 [3:37:33<28:08:31,  3.22it/s]
 12%|█▏        | 45498/371472 [3:37:34<28:03:31,  3.23it/s]
 12%|█▏        | 45499/371472 [3:37:34<27:30:18,  3.29it/s]
 12%|█▏        | 45500/371472 [3:37:34<26:29:22,  3.42it/s]
                                                           
{'loss': 4.4555, 'learning_rate': 8.901883255403046e-07, 'epoch': 1.96}

 12%|█▏        | 45500/371472 [3:37:34<26:29:22,  3.42it/s]
 12%|█▏        | 45501/371472 [3:37:35<25:52:57,  3.50it/s]
 12%|█▏        | 45502/371472 [3:37:35<25:16:18,  3.58it/s]
 12%|█▏        | 45503/371472 [3:37:35<24:39:43,  3.67it/s]
 12%|█▏        | 45504/371472 [3:37:36<27:28:09,  3.30it/s]
 12%|█▏        | 45505/371472 [3:37:36<28:17:04,  3.20it/s]
 12%|█▏        | 45506/371472 [3:37:36<27:27:54,  3.30it/s]
 12%|█▏        | 45507/371472 [3:37:36<27:02:31,  3.35it/s]
 12%|█▏        | 45508/371472 [3:37:37<26:41:05,  3.39it/s]
 12%|█▏        | 45509/371472 [3:37:37<26:19:25,  3.44it/s]
 12%|█▏        | 45510/371472 [3:37:37<25:55:38,  3.49it/s]
 12%|█▏        | 45511/371472 [3:37:38<26:02:58,  3.48it/s]
 12%|█▏        | 45512/371472 [3:37:38<25:33:01,  3.54it/s]
 12%|█▏        | 45513/371472 [3:37:38<27:24:40,  3.30it/s]
 12%|█▏        | 45514/371472 [3:37:38<27:12:57,  3.33it/s]
 12%|█▏        | 45515/371472 [3:37:39<29:16:12,  3.09it/s]
 12%|█▏        | 45516/371472 [3:37:39<29:01:00,  3.12it/s]
 12%|█▏        | 45517/371472 [3:37:39<29:30:30,  3.07it/s]
 12%|█▏        | 45518/371472 [3:37:40<27:30:27,  3.29it/s]
 12%|█▏        | 45519/371472 [3:37:40<27:24:02,  3.30it/s]
 12%|█▏        | 45520/371472 [3:37:40<26:01:48,  3.48it/s]
                                                           
{'loss': 4.2671, 'learning_rate': 8.901398435648258e-07, 'epoch': 1.96}

 12%|█▏        | 45520/371472 [3:37:40<26:01:48,  3.48it/s]
 12%|█▏        | 45521/371472 [3:37:41<25:46:13,  3.51it/s]
 12%|█▏        | 45522/371472 [3:37:41<25:54:00,  3.50it/s]
 12%|█▏        | 45523/371472 [3:37:41<25:45:44,  3.51it/s]
 12%|█▏        | 45524/371472 [3:37:41<26:19:55,  3.44it/s]
 12%|█▏        | 45525/371472 [3:37:42<26:21:44,  3.43it/s]
 12%|█▏        | 45526/371472 [3:37:42<26:48:06,  3.38it/s]
 12%|█▏        | 45527/371472 [3:37:42<29:18:46,  3.09it/s]
 12%|█▏        | 45528/371472 [3:37:43<27:18:53,  3.31it/s]
 12%|█▏        | 45529/371472 [3:37:43<26:16:22,  3.45it/s]
 12%|█▏        | 45530/371472 [3:37:43<26:27:15,  3.42it/s]
 12%|█▏        | 45531/371472 [3:37:44<25:39:43,  3.53it/s]
 12%|█▏        | 45532/371472 [3:37:44<24:34:25,  3.68it/s]
 12%|█▏        | 45533/371472 [3:37:44<24:08:24,  3.75it/s]
 12%|█▏        | 45534/371472 [3:37:44<24:20:25,  3.72it/s]
 12%|█▏        | 45535/371472 [3:37:45<24:12:09,  3.74it/s]
 12%|█▏        | 45536/371472 [3:37:45<25:15:59,  3.58it/s]
 12%|█▏        | 45537/371472 [3:37:45<25:13:58,  3.59it/s]
 12%|█▏        | 45538/371472 [3:37:45<24:13:48,  3.74it/s]
 12%|█▏        | 45539/371472 [3:37:46<24:40:12,  3.67it/s]
 12%|█▏        | 45540/371472 [3:37:46<24:54:30,  3.63it/s]
                                                           
{'loss': 4.3513, 'learning_rate': 8.900913615893468e-07, 'epoch': 1.96}

 12%|█▏        | 45540/371472 [3:37:46<24:54:30,  3.63it/s]
 12%|█▏        | 45541/371472 [3:37:46<25:17:01,  3.58it/s]
 12%|█▏        | 45542/371472 [3:37:47<26:32:23,  3.41it/s]
 12%|█▏        | 45543/371472 [3:37:47<27:08:39,  3.34it/s]
 12%|█▏        | 45544/371472 [3:37:47<25:59:09,  3.48it/s]
 12%|█▏        | 45545/371472 [3:37:47<25:25:01,  3.56it/s]
 12%|█▏        | 45546/371472 [3:37:48<25:58:14,  3.49it/s]
 12%|█▏        | 45547/371472 [3:37:48<25:08:51,  3.60it/s]
 12%|█▏        | 45548/371472 [3:37:48<26:07:17,  3.47it/s]
 12%|█▏        | 45549/371472 [3:37:49<25:51:21,  3.50it/s]
 12%|█▏        | 45550/371472 [3:37:49<26:38:01,  3.40it/s]
 12%|█▏        | 45551/371472 [3:37:49<25:54:02,  3.50it/s]
 12%|█▏        | 45552/371472 [3:37:49<24:57:46,  3.63it/s]
 12%|█▏        | 45553/371472 [3:37:50<25:11:25,  3.59it/s]
 12%|█▏        | 45554/371472 [3:37:50<25:47:09,  3.51it/s]
 12%|█▏        | 45555/371472 [3:37:50<24:53:10,  3.64it/s]
 12%|█▏        | 45556/371472 [3:37:51<25:19:48,  3.57it/s]
 12%|█▏        | 45557/371472 [3:37:51<26:42:02,  3.39it/s]
 12%|█▏        | 45558/371472 [3:37:51<25:58:40,  3.48it/s]
 12%|█▏        | 45559/371472 [3:37:52<30:15:23,  2.99it/s]
 12%|█▏        | 45560/371472 [3:37:52<28:59:47,  3.12it/s]
                                                           
{'loss': 4.2389, 'learning_rate': 8.900428796138679e-07, 'epoch': 1.96}

 12%|█▏        | 45560/371472 [3:37:52<28:59:47,  3.12it/s]
 12%|█▏        | 45561/371472 [3:37:52<27:18:08,  3.32it/s]
 12%|█▏        | 45562/371472 [3:37:52<28:02:10,  3.23it/s]
 12%|█▏        | 45563/371472 [3:37:53<26:59:36,  3.35it/s]
 12%|█▏        | 45564/371472 [3:37:53<26:10:30,  3.46it/s]
 12%|█▏        | 45565/371472 [3:37:53<28:32:45,  3.17it/s]
 12%|█▏        | 45566/371472 [3:37:54<27:15:25,  3.32it/s]
 12%|█▏        | 45567/371472 [3:37:54<27:14:14,  3.32it/s]
 12%|█▏        | 45568/371472 [3:37:54<25:55:34,  3.49it/s]
 12%|█▏        | 45569/371472 [3:37:54<25:39:08,  3.53it/s]
 12%|█▏        | 45570/371472 [3:37:55<31:10:00,  2.90it/s]
 12%|█▏        | 45571/371472 [3:37:55<29:15:55,  3.09it/s]
 12%|█▏        | 45572/371472 [3:37:55<27:41:12,  3.27it/s]
 12%|█▏        | 45573/371472 [3:37:56<26:15:03,  3.45it/s]
 12%|█▏        | 45574/371472 [3:37:56<27:35:35,  3.28it/s]
 12%|█▏        | 45575/371472 [3:37:56<26:38:08,  3.40it/s]
 12%|█▏        | 45576/371472 [3:37:57<26:20:38,  3.44it/s]
 12%|█▏        | 45577/371472 [3:37:57<26:30:32,  3.41it/s]
 12%|█▏        | 45578/371472 [3:37:57<25:24:23,  3.56it/s]
 12%|█▏        | 45579/371472 [3:37:57<26:49:33,  3.37it/s]
 12%|█▏        | 45580/371472 [3:37:58<26:07:47,  3.46it/s]
                                                           
{'loss': 4.1699, 'learning_rate': 8.89994397638389e-07, 'epoch': 1.96}

 12%|█▏        | 45580/371472 [3:37:58<26:07:47,  3.46it/s]
 12%|█▏        | 45581/371472 [3:37:58<25:43:47,  3.52it/s]
 12%|█▏        | 45582/371472 [3:37:58<29:33:46,  3.06it/s]
 12%|█▏        | 45583/371472 [3:37:59<28:13:20,  3.21it/s]
 12%|█▏        | 45584/371472 [3:37:59<27:47:03,  3.26it/s]
 12%|█▏        | 45585/371472 [3:37:59<27:42:56,  3.27it/s]
 12%|█▏        | 45586/371472 [3:38:00<27:08:55,  3.33it/s]
 12%|█▏        | 45587/371472 [3:38:00<25:52:59,  3.50it/s]
 12%|█▏        | 45588/371472 [3:38:00<25:14:13,  3.59it/s]
 12%|█▏        | 45589/371472 [3:38:00<25:13:46,  3.59it/s]
 12%|█▏        | 45590/371472 [3:38:01<25:01:35,  3.62it/s]
 12%|█▏        | 45591/371472 [3:38:01<24:39:17,  3.67it/s]
 12%|█▏        | 45592/371472 [3:38:01<24:50:37,  3.64it/s]
 12%|█▏        | 45593/371472 [3:38:01<24:20:48,  3.72it/s]
 12%|█▏        | 45594/371472 [3:38:02<24:15:48,  3.73it/s]
 12%|█▏        | 45595/371472 [3:38:02<25:44:05,  3.52it/s]
 12%|█▏        | 45596/371472 [3:38:02<25:30:33,  3.55it/s]
 12%|█▏        | 45597/371472 [3:38:03<25:24:19,  3.56it/s]
 12%|█▏        | 45598/371472 [3:38:03<26:13:19,  3.45it/s]
 12%|█▏        | 45599/371472 [3:38:03<25:23:03,  3.57it/s]
 12%|█▏        | 45600/371472 [3:38:03<24:46:54,  3.65it/s]
                                                           
{'loss': 4.2811, 'learning_rate': 8.899459156629102e-07, 'epoch': 1.96}

 12%|█▏        | 45600/371472 [3:38:03<24:46:54,  3.65it/s]
 12%|█▏        | 45601/371472 [3:38:04<24:19:35,  3.72it/s]
 12%|█▏        | 45602/371472 [3:38:04<24:02:57,  3.76it/s]
 12%|█▏        | 45603/371472 [3:38:04<23:56:02,  3.78it/s]
 12%|█▏        | 45604/371472 [3:38:05<26:37:42,  3.40it/s]
 12%|█▏        | 45605/371472 [3:38:05<25:53:42,  3.50it/s]
 12%|█▏        | 45606/371472 [3:38:05<25:31:40,  3.55it/s]
 12%|█▏        | 45607/371472 [3:38:05<25:43:01,  3.52it/s]
 12%|█▏        | 45608/371472 [3:38:06<26:44:42,  3.38it/s]
 12%|█▏        | 45609/371472 [3:38:06<25:53:30,  3.50it/s]
 12%|█▏        | 45610/371472 [3:38:06<29:26:02,  3.08it/s]
 12%|█▏        | 45611/371472 [3:38:07<28:06:31,  3.22it/s]
 12%|█▏        | 45612/371472 [3:38:07<27:52:22,  3.25it/s]
 12%|█▏        | 45613/371472 [3:38:07<27:58:17,  3.24it/s]
 12%|█▏        | 45614/371472 [3:38:08<26:57:51,  3.36it/s]
 12%|█▏        | 45615/371472 [3:38:08<25:40:31,  3.53it/s]
 12%|█▏        | 45616/371472 [3:38:08<24:56:37,  3.63it/s]
 12%|█▏        | 45617/371472 [3:38:08<24:41:01,  3.67it/s]
 12%|█▏        | 45618/371472 [3:38:09<25:36:14,  3.54it/s]
 12%|█▏        | 45619/371472 [3:38:09<25:11:06,  3.59it/s]
 12%|█▏        | 45620/371472 [3:38:09<25:26:21,  3.56it/s]
                                                           
{'loss': 4.5388, 'learning_rate': 8.898974336874312e-07, 'epoch': 1.96}

 12%|█▏        | 45620/371472 [3:38:09<25:26:21,  3.56it/s]
 12%|█▏        | 45621/371472 [3:38:09<25:08:08,  3.60it/s]
 12%|█▏        | 45622/371472 [3:38:10<24:43:31,  3.66it/s]
 12%|█▏        | 45623/371472 [3:38:10<24:59:21,  3.62it/s]
 12%|█▏        | 45624/371472 [3:38:10<26:49:58,  3.37it/s]
 12%|█▏        | 45625/371472 [3:38:11<26:39:51,  3.39it/s]
 12%|█▏        | 45626/371472 [3:38:11<26:31:39,  3.41it/s]
 12%|█▏        | 45627/371472 [3:38:11<27:34:26,  3.28it/s]
 12%|█▏        | 45628/371472 [3:38:12<28:15:40,  3.20it/s]
 12%|█▏        | 45629/371472 [3:38:12<28:14:58,  3.20it/s]
 12%|█▏        | 45630/371472 [3:38:12<28:02:39,  3.23it/s]
 12%|█▏        | 45631/371472 [3:38:13<27:40:22,  3.27it/s]
 12%|█▏        | 45632/371472 [3:38:13<27:11:32,  3.33it/s]
 12%|█▏        | 45633/371472 [3:38:13<26:43:56,  3.39it/s]
 12%|█▏        | 45634/371472 [3:38:13<25:27:32,  3.56it/s]
 12%|█▏        | 45635/371472 [3:38:14<24:51:55,  3.64it/s]
 12%|█▏        | 45636/371472 [3:38:14<24:19:33,  3.72it/s]
 12%|█▏        | 45637/371472 [3:38:14<25:14:00,  3.59it/s]
 12%|█▏        | 45638/371472 [3:38:14<25:39:23,  3.53it/s]
 12%|█▏        | 45639/371472 [3:38:15<25:17:46,  3.58it/s]
 12%|█▏        | 45640/371472 [3:38:15<29:39:06,  3.05it/s]
                                                           
{'loss': 4.2654, 'learning_rate': 8.898489517119524e-07, 'epoch': 1.97}

 12%|█▏        | 45640/371472 [3:38:15<29:39:06,  3.05it/s]
 12%|█▏        | 45641/371472 [3:38:15<28:07:15,  3.22it/s]
 12%|█▏        | 45642/371472 [3:38:16<27:33:22,  3.28it/s]
 12%|█▏        | 45643/371472 [3:38:16<26:44:41,  3.38it/s]
 12%|█▏        | 45644/371472 [3:38:16<28:12:08,  3.21it/s]
 12%|█▏        | 45645/371472 [3:38:17<26:35:04,  3.40it/s]
 12%|█▏        | 45646/371472 [3:38:17<25:17:22,  3.58it/s]
 12%|█▏        | 45647/371472 [3:38:17<25:53:14,  3.50it/s]
 12%|█▏        | 45648/371472 [3:38:17<24:45:34,  3.66it/s]
 12%|█▏        | 45649/371472 [3:38:18<24:36:37,  3.68it/s]
 12%|█▏        | 45650/371472 [3:38:18<25:19:41,  3.57it/s]
 12%|█▏        | 45651/371472 [3:38:18<25:18:47,  3.58it/s]
 12%|█▏        | 45652/371472 [3:38:19<26:47:18,  3.38it/s]
 12%|█▏        | 45653/371472 [3:38:19<25:50:55,  3.50it/s]
 12%|█▏        | 45654/371472 [3:38:19<31:27:22,  2.88it/s]
 12%|█▏        | 45655/371472 [3:38:20<30:03:26,  3.01it/s]
 12%|█▏        | 45656/371472 [3:38:20<28:10:11,  3.21it/s]
 12%|█▏        | 45657/371472 [3:38:20<27:31:05,  3.29it/s]
 12%|█▏        | 45658/371472 [3:38:20<25:54:42,  3.49it/s]
 12%|█▏        | 45659/371472 [3:38:21<24:53:07,  3.64it/s]
 12%|█▏        | 45660/371472 [3:38:21<23:57:15,  3.78it/s]
                                                           
{'loss': 4.2945, 'learning_rate': 8.898004697364735e-07, 'epoch': 1.97}

 12%|█▏        | 45660/371472 [3:38:21<23:57:15,  3.78it/s]
 12%|█▏        | 45661/371472 [3:38:21<23:55:55,  3.78it/s]
 12%|█▏        | 45662/371472 [3:38:22<26:13:57,  3.45it/s]
 12%|█▏        | 45663/371472 [3:38:22<28:44:42,  3.15it/s]
 12%|█▏        | 45664/371472 [3:38:22<31:51:48,  2.84it/s]
 12%|█▏        | 45665/371472 [3:38:23<30:56:41,  2.92it/s]
 12%|█▏        | 45666/371472 [3:38:23<28:35:39,  3.17it/s]
 12%|█▏        | 45667/371472 [3:38:23<30:15:46,  2.99it/s]
 12%|█▏        | 45668/371472 [3:38:24<28:51:46,  3.14it/s]
 12%|█▏        | 45669/371472 [3:38:24<28:42:40,  3.15it/s]
 12%|█▏        | 45670/371472 [3:38:24<27:18:39,  3.31it/s]
 12%|█▏        | 45671/371472 [3:38:24<26:09:48,  3.46it/s]
 12%|█▏        | 45672/371472 [3:38:25<26:15:24,  3.45it/s]
 12%|█▏        | 45673/371472 [3:38:25<25:18:37,  3.58it/s]
 12%|█▏        | 45674/371472 [3:38:25<25:12:27,  3.59it/s]
 12%|█▏        | 45675/371472 [3:38:26<25:07:59,  3.60it/s]
 12%|█▏        | 45676/371472 [3:38:26<24:15:44,  3.73it/s]
 12%|█▏        | 45677/371472 [3:38:26<23:38:38,  3.83it/s]
 12%|█▏        | 45678/371472 [3:38:26<23:13:55,  3.90it/s]
 12%|█▏        | 45679/371472 [3:38:27<23:06:37,  3.92it/s]
 12%|█▏        | 45680/371472 [3:38:27<22:46:51,  3.97it/s]
                                                           
{'loss': 4.3381, 'learning_rate': 8.897519877609947e-07, 'epoch': 1.97}

 12%|█▏        | 45680/371472 [3:38:27<22:46:51,  3.97it/s]
 12%|█▏        | 45681/371472 [3:38:27<23:06:32,  3.92it/s]
 12%|█▏        | 45682/371472 [3:38:27<25:13:29,  3.59it/s]
 12%|█▏        | 45683/371472 [3:38:28<28:14:28,  3.20it/s]
 12%|█▏        | 45684/371472 [3:38:28<28:02:45,  3.23it/s]
 12%|█▏        | 45685/371472 [3:38:28<27:04:06,  3.34it/s]
 12%|█▏        | 45686/371472 [3:38:29<28:06:09,  3.22it/s]
 12%|█▏        | 45687/371472 [3:38:29<26:31:26,  3.41it/s]
 12%|█▏        | 45688/371472 [3:38:29<25:55:42,  3.49it/s]
 12%|█▏        | 45689/371472 [3:38:29<25:03:01,  3.61it/s]
 12%|█▏        | 45690/371472 [3:38:30<26:49:58,  3.37it/s]
 12%|█▏        | 45691/371472 [3:38:30<26:00:26,  3.48it/s]
 12%|█▏        | 45692/371472 [3:38:30<24:58:06,  3.62it/s]
 12%|█▏        | 45693/371472 [3:38:31<24:44:30,  3.66it/s]
 12%|█▏        | 45694/371472 [3:38:31<24:36:29,  3.68it/s]
 12%|█▏        | 45695/371472 [3:38:31<25:20:25,  3.57it/s]
 12%|█▏        | 45696/371472 [3:38:31<25:56:41,  3.49it/s]
 12%|█▏        | 45697/371472 [3:38:32<24:59:50,  3.62it/s]
 12%|█▏        | 45698/371472 [3:38:32<25:15:54,  3.58it/s]
 12%|█▏        | 45699/371472 [3:38:32<25:10:34,  3.59it/s]
 12%|█▏        | 45700/371472 [3:38:33<25:47:55,  3.51it/s]
                                                           
{'loss': 4.3183, 'learning_rate': 8.897035057855156e-07, 'epoch': 1.97}

 12%|█▏        | 45700/371472 [3:38:33<25:47:55,  3.51it/s]
 12%|█▏        | 45701/371472 [3:38:33<25:41:05,  3.52it/s]
 12%|█▏        | 45702/371472 [3:38:33<25:03:08,  3.61it/s]
 12%|█▏        | 45703/371472 [3:38:33<24:23:43,  3.71it/s]
 12%|█▏        | 45704/371472 [3:38:34<23:53:31,  3.79it/s]
 12%|█▏        | 45705/371472 [3:38:34<25:42:15,  3.52it/s]
 12%|█▏        | 45706/371472 [3:38:34<26:45:29,  3.38it/s]
 12%|█▏        | 45707/371472 [3:38:35<26:08:33,  3.46it/s]
 12%|█▏        | 45708/371472 [3:38:35<25:16:22,  3.58it/s]
 12%|█▏        | 45709/371472 [3:38:35<25:24:45,  3.56it/s]
 12%|█▏        | 45710/371472 [3:38:35<27:07:14,  3.34it/s]
 12%|█▏        | 45711/371472 [3:38:36<25:59:26,  3.48it/s]
 12%|█▏        | 45712/371472 [3:38:36<24:53:04,  3.64it/s]
 12%|█▏        | 45713/371472 [3:38:36<24:05:35,  3.76it/s]
 12%|█▏        | 45714/371472 [3:38:36<23:24:23,  3.87it/s]
 12%|█▏        | 45715/371472 [3:38:37<23:55:25,  3.78it/s]
 12%|█▏        | 45716/371472 [3:38:37<24:17:39,  3.72it/s]
 12%|█▏        | 45717/371472 [3:38:37<23:54:47,  3.78it/s]
 12%|█▏        | 45718/371472 [3:38:38<24:50:44,  3.64it/s]
 12%|█▏        | 45719/371472 [3:38:38<24:55:34,  3.63it/s]
 12%|█▏        | 45720/371472 [3:38:38<24:58:58,  3.62it/s]
                                                           
{'loss': 4.0999, 'learning_rate': 8.896550238100368e-07, 'epoch': 1.97}

 12%|█▏        | 45720/371472 [3:38:38<24:58:58,  3.62it/s]
 12%|█▏        | 45721/371472 [3:38:38<25:06:12,  3.60it/s]
 12%|█▏        | 45722/371472 [3:38:39<26:46:11,  3.38it/s]
 12%|█▏        | 45723/371472 [3:38:39<25:37:02,  3.53it/s]
 12%|█▏        | 45724/371472 [3:38:39<26:09:52,  3.46it/s]
 12%|█▏        | 45725/371472 [3:38:40<27:01:14,  3.35it/s]
 12%|█▏        | 45726/371472 [3:38:40<25:38:27,  3.53it/s]
 12%|█▏        | 45727/371472 [3:38:40<24:23:58,  3.71it/s]
 12%|█▏        | 45728/371472 [3:38:40<24:31:59,  3.69it/s]
 12%|█▏        | 45729/371472 [3:38:41<26:28:14,  3.42it/s]
 12%|█▏        | 45730/371472 [3:38:41<26:47:50,  3.38it/s]
 12%|█▏        | 45731/371472 [3:38:41<25:24:09,  3.56it/s]
 12%|█▏        | 45732/371472 [3:38:41<24:51:35,  3.64it/s]
 12%|█▏        | 45733/371472 [3:38:42<24:11:53,  3.74it/s]
 12%|█▏        | 45734/371472 [3:38:42<25:08:07,  3.60it/s]
 12%|█▏        | 45735/371472 [3:38:42<24:53:29,  3.64it/s]
 12%|█▏        | 45736/371472 [3:38:43<25:02:51,  3.61it/s]
 12%|█▏        | 45737/371472 [3:38:43<25:32:38,  3.54it/s]
 12%|█▏        | 45738/371472 [3:38:43<26:11:41,  3.45it/s]
 12%|█▏        | 45739/371472 [3:38:43<27:01:18,  3.35it/s]
 12%|█▏        | 45740/371472 [3:38:44<25:51:34,  3.50it/s]
                                                           
{'loss': 4.1506, 'learning_rate': 8.896065418345579e-07, 'epoch': 1.97}

 12%|█▏        | 45740/371472 [3:38:44<25:51:34,  3.50it/s]
 12%|█▏        | 45741/371472 [3:38:44<25:48:25,  3.51it/s]
 12%|█▏        | 45742/371472 [3:38:44<26:17:08,  3.44it/s]
 12%|█▏        | 45743/371472 [3:38:45<27:26:36,  3.30it/s]
 12%|█▏        | 45744/371472 [3:38:45<27:20:06,  3.31it/s]
 12%|█▏        | 45745/371472 [3:38:45<26:09:59,  3.46it/s]
 12%|█▏        | 45746/371472 [3:38:45<25:08:42,  3.60it/s]
 12%|█▏        | 45747/371472 [3:38:46<26:00:37,  3.48it/s]
 12%|█▏        | 45748/371472 [3:38:46<25:54:48,  3.49it/s]
 12%|█▏        | 45749/371472 [3:38:46<24:42:03,  3.66it/s]
 12%|█▏        | 45750/371472 [3:38:47<24:17:31,  3.72it/s]
 12%|█▏        | 45751/371472 [3:38:47<24:10:53,  3.74it/s]
 12%|█▏        | 45752/371472 [3:38:47<24:44:58,  3.66it/s]
 12%|█▏        | 45753/371472 [3:38:47<25:34:59,  3.54it/s]
 12%|█▏        | 45754/371472 [3:38:48<26:05:19,  3.47it/s]
 12%|█▏        | 45755/371472 [3:38:48<25:21:04,  3.57it/s]
 12%|█▏        | 45756/371472 [3:38:48<27:10:29,  3.33it/s]
 12%|█▏        | 45757/371472 [3:38:49<27:00:52,  3.35it/s]
 12%|█▏        | 45758/371472 [3:38:49<26:22:13,  3.43it/s]
 12%|█▏        | 45759/371472 [3:38:49<27:16:36,  3.32it/s]
 12%|█▏        | 45760/371472 [3:38:50<26:40:54,  3.39it/s]
                                                           
{'loss': 4.2768, 'learning_rate': 8.895580598590791e-07, 'epoch': 1.97}

 12%|█▏        | 45760/371472 [3:38:50<26:40:54,  3.39it/s]
 12%|█▏        | 45761/371472 [3:38:50<26:53:55,  3.36it/s]
 12%|█▏        | 45762/371472 [3:38:50<26:53:32,  3.36it/s]
 12%|█▏        | 45763/371472 [3:38:50<26:58:51,  3.35it/s]
 12%|█▏        | 45764/371472 [3:38:51<25:55:53,  3.49it/s]
 12%|█▏        | 45765/371472 [3:38:51<27:04:07,  3.34it/s]
 12%|█▏        | 45766/371472 [3:38:51<27:31:01,  3.29it/s]
 12%|█▏        | 45767/371472 [3:38:52<27:05:45,  3.34it/s]
 12%|█▏        | 45768/371472 [3:38:52<26:47:10,  3.38it/s]
 12%|█▏        | 45769/371472 [3:38:52<26:56:20,  3.36it/s]
 12%|█▏        | 45770/371472 [3:38:52<25:38:44,  3.53it/s]
 12%|█▏        | 45771/371472 [3:38:53<24:43:28,  3.66it/s]
 12%|█▏        | 45772/371472 [3:38:53<24:14:14,  3.73it/s]
 12%|█▏        | 45773/371472 [3:38:53<23:59:56,  3.77it/s]
 12%|█▏        | 45774/371472 [3:38:53<23:30:31,  3.85it/s]
 12%|█▏        | 45775/371472 [3:38:54<23:35:01,  3.84it/s]
 12%|█▏        | 45776/371472 [3:38:54<23:42:50,  3.82it/s]
 12%|█▏        | 45777/371472 [3:38:54<23:47:49,  3.80it/s]
 12%|█▏        | 45778/371472 [3:38:55<24:07:15,  3.75it/s]
 12%|█▏        | 45779/371472 [3:38:55<26:36:01,  3.40it/s]
 12%|█▏        | 45780/371472 [3:38:55<27:29:55,  3.29it/s]
                                                           
{'loss': 4.2313, 'learning_rate': 8.895095778836001e-07, 'epoch': 1.97}

 12%|█▏        | 45780/371472 [3:38:55<27:29:55,  3.29it/s]
 12%|█▏        | 45781/371472 [3:38:55<26:59:45,  3.35it/s]
 12%|█▏        | 45782/371472 [3:38:56<26:34:45,  3.40it/s]
 12%|█▏        | 45783/371472 [3:38:56<26:33:33,  3.41it/s]
 12%|█▏        | 45784/371472 [3:38:56<26:43:49,  3.38it/s]
 12%|█▏        | 45785/371472 [3:38:57<25:55:24,  3.49it/s]
 12%|█▏        | 45786/371472 [3:38:57<26:22:04,  3.43it/s]
 12%|█▏        | 45787/371472 [3:38:57<25:21:41,  3.57it/s]
 12%|█▏        | 45788/371472 [3:38:57<25:44:12,  3.52it/s]
 12%|█▏        | 45789/371472 [3:38:58<26:48:14,  3.38it/s]
 12%|█▏        | 45790/371472 [3:38:58<26:16:31,  3.44it/s]
 12%|█▏        | 45791/371472 [3:38:58<26:18:28,  3.44it/s]
 12%|█▏        | 45792/371472 [3:38:59<27:14:53,  3.32it/s]
 12%|█▏        | 45793/371472 [3:38:59<26:48:12,  3.38it/s]
 12%|█▏        | 45794/371472 [3:38:59<26:43:52,  3.38it/s]
 12%|█▏        | 45795/371472 [3:39:00<25:17:24,  3.58it/s]
 12%|█▏        | 45796/371472 [3:39:00<26:54:04,  3.36it/s]
 12%|█▏        | 45797/371472 [3:39:00<25:15:11,  3.58it/s]
 12%|█▏        | 45798/371472 [3:39:00<24:01:10,  3.77it/s]
 12%|█▏        | 45799/371472 [3:39:01<24:01:56,  3.76it/s]
 12%|█▏        | 45800/371472 [3:39:01<23:21:16,  3.87it/s]
                                                           
{'loss': 4.1688, 'learning_rate': 8.894610959081213e-07, 'epoch': 1.97}

 12%|█▏        | 45800/371472 [3:39:01<23:21:16,  3.87it/s]
 12%|█▏        | 45801/371472 [3:39:01<23:43:13,  3.81it/s]
 12%|█▏        | 45802/371472 [3:39:01<25:05:21,  3.61it/s]
 12%|█▏        | 45803/371472 [3:39:02<27:07:53,  3.33it/s]
 12%|█▏        | 45804/371472 [3:39:02<25:46:42,  3.51it/s]
 12%|█▏        | 45805/371472 [3:39:02<24:58:13,  3.62it/s]
 12%|█▏        | 45806/371472 [3:39:03<26:15:03,  3.45it/s]
 12%|█▏        | 45807/371472 [3:39:03<25:45:41,  3.51it/s]
 12%|█▏        | 45808/371472 [3:39:03<25:24:49,  3.56it/s]
 12%|█▏        | 45809/371472 [3:39:03<24:59:04,  3.62it/s]
 12%|█▏        | 45810/371472 [3:39:04<25:26:37,  3.56it/s]
 12%|█▏        | 45811/371472 [3:39:04<25:59:58,  3.48it/s]
 12%|█▏        | 45812/371472 [3:39:04<26:13:44,  3.45it/s]
 12%|█▏        | 45813/371472 [3:39:05<25:07:59,  3.60it/s]
 12%|█▏        | 45814/371472 [3:39:05<25:37:34,  3.53it/s]
 12%|█▏        | 45815/371472 [3:39:05<25:02:06,  3.61it/s]
 12%|█▏        | 45816/371472 [3:39:05<26:05:06,  3.47it/s]
 12%|█▏        | 45817/371472 [3:39:06<25:23:27,  3.56it/s]
 12%|█▏        | 45818/371472 [3:39:06<25:08:42,  3.60it/s]
 12%|█▏        | 45819/371472 [3:39:06<24:47:23,  3.65it/s]
 12%|█▏        | 45820/371472 [3:39:07<24:55:54,  3.63it/s]
                                                           
{'loss': 4.5331, 'learning_rate': 8.894126139326422e-07, 'epoch': 1.97}

 12%|█▏        | 45820/371472 [3:39:07<24:55:54,  3.63it/s]
 12%|█▏        | 45821/371472 [3:39:07<24:14:46,  3.73it/s]
 12%|█▏        | 45822/371472 [3:39:07<24:09:17,  3.74it/s]
 12%|█▏        | 45823/371472 [3:39:07<23:58:11,  3.77it/s]
 12%|█▏        | 45824/371472 [3:39:08<24:18:49,  3.72it/s]
 12%|█▏        | 45825/371472 [3:39:08<23:52:30,  3.79it/s]
 12%|█▏        | 45826/371472 [3:39:08<24:47:31,  3.65it/s]
 12%|█▏        | 45827/371472 [3:39:08<25:23:56,  3.56it/s]
 12%|█▏        | 45828/371472 [3:39:09<27:18:09,  3.31it/s]
 12%|█▏        | 45829/371472 [3:39:09<26:31:25,  3.41it/s]
 12%|█▏        | 45830/371472 [3:39:09<27:12:04,  3.33it/s]
 12%|█▏        | 45831/371472 [3:39:10<27:16:36,  3.32it/s]
 12%|█▏        | 45832/371472 [3:39:10<27:29:46,  3.29it/s]
 12%|█▏        | 45833/371472 [3:39:10<26:12:16,  3.45it/s]
 12%|█▏        | 45834/371472 [3:39:11<26:16:56,  3.44it/s]
 12%|█▏        | 45835/371472 [3:39:11<25:39:59,  3.52it/s]
 12%|█▏        | 45836/371472 [3:39:11<25:42:23,  3.52it/s]
 12%|█▏        | 45837/371472 [3:39:11<25:51:22,  3.50it/s]
 12%|█▏        | 45838/371472 [3:39:12<25:42:24,  3.52it/s]
 12%|█▏        | 45839/371472 [3:39:12<25:43:53,  3.52it/s]
 12%|█▏        | 45840/371472 [3:39:12<25:32:43,  3.54it/s]
                                                           
{'loss': 4.1421, 'learning_rate': 8.893641319571635e-07, 'epoch': 1.97}

 12%|█▏        | 45840/371472 [3:39:12<25:32:43,  3.54it/s]
 12%|█▏        | 45841/371472 [3:39:13<26:48:28,  3.37it/s]
 12%|█▏        | 45842/371472 [3:39:13<26:39:13,  3.39it/s]
 12%|█▏        | 45843/371472 [3:39:13<27:13:03,  3.32it/s]
 12%|█▏        | 45844/371472 [3:39:13<26:11:36,  3.45it/s]
 12%|█▏        | 45845/371472 [3:39:14<28:20:11,  3.19it/s]
 12%|█▏        | 45846/371472 [3:39:14<27:38:49,  3.27it/s]
 12%|█▏        | 45847/371472 [3:39:14<26:46:23,  3.38it/s]
 12%|█▏        | 45848/371472 [3:39:15<26:17:39,  3.44it/s]
 12%|█▏        | 45849/371472 [3:39:15<26:18:00,  3.44it/s]
 12%|█▏        | 45850/371472 [3:39:15<25:16:14,  3.58it/s]
 12%|█▏        | 45851/371472 [3:39:15<24:39:02,  3.67it/s]
 12%|█▏        | 45852/371472 [3:39:16<23:52:31,  3.79it/s]
 12%|█▏        | 45853/371472 [3:39:16<24:09:53,  3.74it/s]
 12%|█▏        | 45854/371472 [3:39:16<23:59:39,  3.77it/s]
 12%|█▏        | 45855/371472 [3:39:16<23:30:22,  3.85it/s]
 12%|█▏        | 45856/371472 [3:39:17<23:42:39,  3.81it/s]
 12%|█▏        | 45857/371472 [3:39:17<23:15:05,  3.89it/s]
 12%|█▏        | 45858/371472 [3:39:17<24:20:00,  3.72it/s]
 12%|█▏        | 45859/371472 [3:39:18<25:01:25,  3.61it/s]
 12%|█▏        | 45860/371472 [3:39:18<24:03:43,  3.76it/s]
                                                           
{'loss': 4.4491, 'learning_rate': 8.893156499816845e-07, 'epoch': 1.98}

 12%|█▏        | 45860/371472 [3:39:18<24:03:43,  3.76it/s]
 12%|█▏        | 45861/371472 [3:39:18<25:20:31,  3.57it/s]
 12%|█▏        | 45862/371472 [3:39:18<25:17:20,  3.58it/s]
 12%|█▏        | 45863/371472 [3:39:19<26:09:35,  3.46it/s]
 12%|█▏        | 45864/371472 [3:39:19<25:20:59,  3.57it/s]
 12%|█▏        | 45865/371472 [3:39:19<24:36:19,  3.68it/s]
 12%|█▏        | 45866/371472 [3:39:19<24:20:17,  3.72it/s]
 12%|█▏        | 45867/371472 [3:39:20<25:16:38,  3.58it/s]
 12%|█▏        | 45868/371472 [3:39:20<24:47:40,  3.65it/s]
 12%|█▏        | 45869/371472 [3:39:20<24:06:36,  3.75it/s]
 12%|█▏        | 45870/371472 [3:39:21<25:07:22,  3.60it/s]
 12%|█▏        | 45871/371472 [3:39:21<25:24:16,  3.56it/s]
 12%|█▏        | 45872/371472 [3:39:21<26:17:00,  3.44it/s]
 12%|█▏        | 45873/371472 [3:39:21<25:44:07,  3.51it/s]
 12%|█▏        | 45874/371472 [3:39:22<25:29:09,  3.55it/s]
 12%|█▏        | 45875/371472 [3:39:22<25:29:20,  3.55it/s]
 12%|█▏        | 45876/371472 [3:39:22<26:41:30,  3.39it/s]
 12%|█▏        | 45877/371472 [3:39:23<26:23:05,  3.43it/s]
 12%|█▏        | 45878/371472 [3:39:23<26:53:22,  3.36it/s]
 12%|█▏        | 45879/371472 [3:39:23<26:49:32,  3.37it/s]
 12%|█▏        | 45880/371472 [3:39:24<31:11:44,  2.90it/s]
                                                           
{'loss': 4.1742, 'learning_rate': 8.892671680062057e-07, 'epoch': 1.98}

 12%|█▏        | 45880/371472 [3:39:24<31:11:44,  2.90it/s]
 12%|█▏        | 45881/371472 [3:39:24<29:18:12,  3.09it/s]
 12%|█▏        | 45882/371472 [3:39:24<30:58:12,  2.92it/s]
 12%|█▏        | 45883/371472 [3:39:25<30:43:14,  2.94it/s]
 12%|█▏        | 45884/371472 [3:39:25<30:21:43,  2.98it/s]
 12%|█▏        | 45885/371472 [3:39:25<28:22:28,  3.19it/s]
 12%|█▏        | 45886/371472 [3:39:26<29:19:14,  3.08it/s]
 12%|█▏        | 45887/371472 [3:39:26<28:35:40,  3.16it/s]
 12%|█▏        | 45888/371472 [3:39:26<27:25:20,  3.30it/s]
 12%|█▏        | 45889/371472 [3:39:26<25:57:02,  3.49it/s]
 12%|█▏        | 45890/371472 [3:39:27<25:23:56,  3.56it/s]
 12%|█▏        | 45891/371472 [3:39:27<24:28:38,  3.69it/s]
 12%|█▏        | 45892/371472 [3:39:27<27:48:25,  3.25it/s]
 12%|█▏        | 45893/371472 [3:39:28<26:58:35,  3.35it/s]
 12%|█▏        | 45894/371472 [3:39:28<27:11:57,  3.33it/s]
 12%|█▏        | 45895/371472 [3:39:28<26:00:01,  3.48it/s]
 12%|█▏        | 45896/371472 [3:39:28<25:02:18,  3.61it/s]
 12%|█▏        | 45897/371472 [3:39:29<24:18:45,  3.72it/s]
 12%|█▏        | 45898/371472 [3:39:29<25:09:27,  3.59it/s]
 12%|█▏        | 45899/371472 [3:39:29<27:15:48,  3.32it/s]
 12%|█▏        | 45900/371472 [3:39:30<26:51:34,  3.37it/s]
                                                           
{'loss': 4.2573, 'learning_rate': 8.892186860307268e-07, 'epoch': 1.98}

 12%|█▏        | 45900/371472 [3:39:30<26:51:34,  3.37it/s]
 12%|█▏        | 45901/371472 [3:39:30<26:46:08,  3.38it/s]
 12%|█▏        | 45902/371472 [3:39:30<27:15:52,  3.32it/s]
 12%|█▏        | 45903/371472 [3:39:30<25:40:59,  3.52it/s]
 12%|█▏        | 45904/371472 [3:39:31<26:45:01,  3.38it/s]
 12%|█▏        | 45905/371472 [3:39:31<28:50:28,  3.14it/s]
 12%|█▏        | 45906/371472 [3:39:31<27:23:36,  3.30it/s]
 12%|█▏        | 45907/371472 [3:39:32<27:15:08,  3.32it/s]
 12%|█▏        | 45908/371472 [3:39:32<25:43:28,  3.52it/s]
 12%|█▏        | 45909/371472 [3:39:32<25:13:04,  3.59it/s]
 12%|█▏        | 45910/371472 [3:39:33<24:50:40,  3.64it/s]
 12%|█▏        | 45911/371472 [3:39:33<25:39:25,  3.52it/s]
 12%|█▏        | 45912/371472 [3:39:33<26:48:34,  3.37it/s]
 12%|█▏        | 45913/371472 [3:39:33<25:59:42,  3.48it/s]
 12%|█▏        | 45914/371472 [3:39:34<26:57:26,  3.35it/s]
 12%|█▏        | 45915/371472 [3:39:34<27:19:41,  3.31it/s]
 12%|█▏        | 45916/371472 [3:39:34<26:50:09,  3.37it/s]
 12%|█▏        | 45917/371472 [3:39:35<28:23:59,  3.18it/s]
 12%|█▏        | 45918/371472 [3:39:35<27:27:25,  3.29it/s]
 12%|█▏        | 45919/371472 [3:39:35<26:31:40,  3.41it/s]
 12%|█▏        | 45920/371472 [3:39:36<26:14:06,  3.45it/s]
                                                           
{'loss': 4.3677, 'learning_rate': 8.89170204055248e-07, 'epoch': 1.98}

 12%|█▏        | 45920/371472 [3:39:36<26:14:06,  3.45it/s]
 12%|█▏        | 45921/371472 [3:39:36<26:32:21,  3.41it/s]
 12%|█▏        | 45922/371472 [3:39:36<27:46:09,  3.26it/s]
 12%|█▏        | 45923/371472 [3:39:36<28:52:30,  3.13it/s]
 12%|█▏        | 45924/371472 [3:39:37<27:34:29,  3.28it/s]
 12%|█▏        | 45925/371472 [3:39:37<26:27:24,  3.42it/s]
 12%|█▏        | 45926/371472 [3:39:37<27:11:10,  3.33it/s]
 12%|█▏        | 45927/371472 [3:39:38<26:39:30,  3.39it/s]
 12%|█▏        | 45928/371472 [3:39:38<26:30:05,  3.41it/s]
 12%|█▏        | 45929/371472 [3:39:38<25:47:55,  3.51it/s]
 12%|█▏        | 45930/371472 [3:39:38<25:21:25,  3.57it/s]
 12%|█▏        | 45931/371472 [3:39:39<28:08:49,  3.21it/s]
 12%|█▏        | 45932/371472 [3:39:39<27:21:20,  3.31it/s]
 12%|█▏        | 45933/371472 [3:39:39<25:33:37,  3.54it/s]
 12%|█▏        | 45934/371472 [3:39:40<24:45:16,  3.65it/s]
 12%|█▏        | 45935/371472 [3:39:40<24:30:24,  3.69it/s]
 12%|█▏        | 45936/371472 [3:39:40<24:50:33,  3.64it/s]
 12%|█▏        | 45937/371472 [3:39:40<25:40:34,  3.52it/s]
 12%|█▏        | 45938/371472 [3:39:41<25:10:05,  3.59it/s]
 12%|█▏        | 45939/371472 [3:39:41<26:41:19,  3.39it/s]
 12%|█▏        | 45940/371472 [3:39:41<26:52:01,  3.37it/s]
                                                           
{'loss': 4.3011, 'learning_rate': 8.891217220797689e-07, 'epoch': 1.98}

 12%|█▏        | 45940/371472 [3:39:41<26:52:01,  3.37it/s]
 12%|█▏        | 45941/371472 [3:39:42<26:03:23,  3.47it/s]
 12%|█▏        | 45942/371472 [3:39:42<27:37:50,  3.27it/s]
 12%|█▏        | 45943/371472 [3:39:42<28:44:44,  3.15it/s]
 12%|█▏        | 45944/371472 [3:39:43<27:21:36,  3.30it/s]
 12%|█▏        | 45945/371472 [3:39:43<27:16:03,  3.32it/s]
 12%|█▏        | 45946/371472 [3:39:43<26:28:46,  3.41it/s]
 12%|█▏        | 45947/371472 [3:39:43<26:22:33,  3.43it/s]
 12%|█▏        | 45948/371472 [3:39:44<26:32:27,  3.41it/s]
 12%|█▏        | 45949/371472 [3:39:44<25:38:04,  3.53it/s]
 12%|█▏        | 45950/371472 [3:39:44<25:05:16,  3.60it/s]
 12%|█▏        | 45951/371472 [3:39:45<24:41:01,  3.66it/s]
 12%|█▏        | 45952/371472 [3:39:45<27:06:38,  3.34it/s]
 12%|█▏        | 45953/371472 [3:39:45<28:07:19,  3.22it/s]
 12%|█▏        | 45954/371472 [3:39:46<27:46:18,  3.26it/s]
 12%|█▏        | 45955/371472 [3:39:46<26:40:06,  3.39it/s]
 12%|█▏        | 45956/371472 [3:39:46<26:27:37,  3.42it/s]
 12%|█▏        | 45957/371472 [3:39:46<25:17:48,  3.57it/s]
 12%|█▏        | 45958/371472 [3:39:47<24:45:18,  3.65it/s]
 12%|█▏        | 45959/371472 [3:39:47<25:40:50,  3.52it/s]
 12%|█▏        | 45960/371472 [3:39:47<25:35:36,  3.53it/s]
                                                           
{'loss': 4.4628, 'learning_rate': 8.890732401042901e-07, 'epoch': 1.98}

 12%|█▏        | 45960/371472 [3:39:47<25:35:36,  3.53it/s]
 12%|█▏        | 45961/371472 [3:39:47<24:50:09,  3.64it/s]
 12%|█▏        | 45962/371472 [3:39:48<25:08:13,  3.60it/s]
 12%|█▏        | 45963/371472 [3:39:48<27:00:02,  3.35it/s]
 12%|█▏        | 45964/371472 [3:39:48<26:42:29,  3.39it/s]
 12%|█▏        | 45965/371472 [3:39:49<26:06:52,  3.46it/s]
 12%|█▏        | 45966/371472 [3:39:49<25:49:14,  3.50it/s]
 12%|█▏        | 45967/371472 [3:39:49<25:44:56,  3.51it/s]
 12%|█▏        | 45968/371472 [3:39:49<26:18:12,  3.44it/s]
 12%|█▏        | 45969/371472 [3:39:50<25:31:12,  3.54it/s]
 12%|█▏        | 45970/371472 [3:39:50<24:37:38,  3.67it/s]
 12%|█▏        | 45971/371472 [3:39:50<24:52:21,  3.64it/s]
 12%|█▏        | 45972/371472 [3:39:51<24:47:33,  3.65it/s]
 12%|█▏        | 45973/371472 [3:39:51<24:54:12,  3.63it/s]
 12%|█▏        | 45974/371472 [3:39:51<25:24:59,  3.56it/s]
 12%|█▏        | 45975/371472 [3:39:51<25:13:34,  3.58it/s]
 12%|█▏        | 45976/371472 [3:39:52<26:31:57,  3.41it/s]
 12%|█▏        | 45977/371472 [3:39:52<25:31:28,  3.54it/s]
 12%|█▏        | 45978/371472 [3:39:52<28:34:14,  3.16it/s]
 12%|█▏        | 45979/371472 [3:39:53<27:51:25,  3.25it/s]
 12%|█▏        | 45980/371472 [3:39:53<28:00:31,  3.23it/s]
                                                           
{'loss': 4.2885, 'learning_rate': 8.890247581288112e-07, 'epoch': 1.98}

 12%|█▏        | 45980/371472 [3:39:53<28:00:31,  3.23it/s]
 12%|█▏        | 45981/371472 [3:39:53<26:48:06,  3.37it/s]
 12%|█▏        | 45982/371472 [3:39:54<27:13:10,  3.32it/s]
 12%|█▏        | 45983/371472 [3:39:54<26:28:55,  3.41it/s]
 12%|█▏        | 45984/371472 [3:39:54<27:35:08,  3.28it/s]
 12%|█▏        | 45985/371472 [3:39:54<26:33:12,  3.40it/s]
 12%|█▏        | 45986/371472 [3:39:55<26:10:54,  3.45it/s]
 12%|█▏        | 45987/371472 [3:39:55<25:17:06,  3.58it/s]
 12%|█▏        | 45988/371472 [3:39:55<25:18:45,  3.57it/s]
 12%|█▏        | 45989/371472 [3:39:56<34:00:33,  2.66it/s]
 12%|█▏        | 45990/371472 [3:39:56<31:07:07,  2.91it/s]
 12%|█▏        | 45991/371472 [3:39:56<29:16:46,  3.09it/s]
 12%|█▏        | 45992/371472 [3:39:57<27:30:31,  3.29it/s]
 12%|█▏        | 45993/371472 [3:39:57<26:08:28,  3.46it/s]
 12%|█▏        | 45994/371472 [3:39:57<26:01:27,  3.47it/s]
 12%|█▏        | 45995/371472 [3:39:58<27:20:51,  3.31it/s]
 12%|█▏        | 45996/371472 [3:39:58<28:46:40,  3.14it/s]
 12%|█▏        | 45997/371472 [3:39:58<28:38:59,  3.16it/s]
 12%|█▏        | 45998/371472 [3:39:58<27:29:52,  3.29it/s]
 12%|█▏        | 45999/371472 [3:39:59<26:24:22,  3.42it/s]
 12%|█▏        | 46000/371472 [3:39:59<25:12:15,  3.59it/s]
                                                           
{'loss': 4.2826, 'learning_rate': 8.889762761533322e-07, 'epoch': 1.98}

 12%|█▏        | 46000/371472 [3:39:59<25:12:15,  3.59it/s]
 12%|█▏        | 46001/371472 [3:39:59<25:12:16,  3.59it/s]
 12%|█▏        | 46002/371472 [3:40:00<25:00:47,  3.61it/s]
 12%|█▏        | 46003/371472 [3:40:00<24:36:45,  3.67it/s]
 12%|█▏        | 46004/371472 [3:40:00<23:59:18,  3.77it/s]
 12%|█▏        | 46005/371472 [3:40:00<26:37:21,  3.40it/s]
 12%|█▏        | 46006/371472 [3:40:01<26:42:59,  3.38it/s]
 12%|█▏        | 46007/371472 [3:40:01<28:05:27,  3.22it/s]
 12%|█▏        | 46008/371472 [3:40:01<27:00:27,  3.35it/s]
 12%|█▏        | 46009/371472 [3:40:02<27:33:43,  3.28it/s]
 12%|█▏        | 46010/371472 [3:40:02<26:51:09,  3.37it/s]
 12%|█▏        | 46011/371472 [3:40:02<25:35:07,  3.53it/s]
 12%|█▏        | 46012/371472 [3:40:03<26:35:16,  3.40it/s]
 12%|█▏        | 46013/371472 [3:40:03<25:51:09,  3.50it/s]
 12%|█▏        | 46014/371472 [3:40:03<25:12:47,  3.59it/s]
 12%|█▏        | 46015/371472 [3:40:03<27:02:34,  3.34it/s]
 12%|█▏        | 46016/371472 [3:40:04<25:48:03,  3.50it/s]
 12%|█▏        | 46017/371472 [3:40:04<26:00:19,  3.48it/s]
 12%|█▏        | 46018/371472 [3:40:04<26:00:10,  3.48it/s]
 12%|█▏        | 46019/371472 [3:40:05<27:15:12,  3.32it/s]
 12%|█▏        | 46020/371472 [3:40:05<26:49:16,  3.37it/s]
                                                           
{'loss': 4.219, 'learning_rate': 8.889277941778534e-07, 'epoch': 1.98}

 12%|█▏        | 46020/371472 [3:40:05<26:49:16,  3.37it/s]
 12%|█▏        | 46021/371472 [3:40:05<28:47:43,  3.14it/s]
 12%|█▏        | 46022/371472 [3:40:05<27:05:10,  3.34it/s]
 12%|█▏        | 46023/371472 [3:40:06<26:01:02,  3.47it/s]
 12%|█▏        | 46024/371472 [3:40:06<26:58:48,  3.35it/s]
 12%|█▏        | 46025/371472 [3:40:06<26:31:40,  3.41it/s]
 12%|█▏        | 46026/371472 [3:40:07<25:39:17,  3.52it/s]
 12%|█▏        | 46027/371472 [3:40:07<25:21:50,  3.56it/s]
 12%|█▏        | 46028/371472 [3:40:07<25:29:28,  3.55it/s]
 12%|█▏        | 46029/371472 [3:40:07<25:02:08,  3.61it/s]
 12%|█▏        | 46030/371472 [3:40:08<26:57:07,  3.35it/s]
 12%|█▏        | 46031/371472 [3:40:08<26:12:27,  3.45it/s]
 12%|█▏        | 46032/371472 [3:40:08<26:04:59,  3.47it/s]
 12%|█▏        | 46033/371472 [3:40:09<27:18:54,  3.31it/s]
 12%|█▏        | 46034/371472 [3:40:09<26:16:34,  3.44it/s]
 12%|█▏        | 46035/371472 [3:40:09<28:34:49,  3.16it/s]
 12%|█▏        | 46036/371472 [3:40:10<27:20:31,  3.31it/s]
 12%|█▏        | 46037/371472 [3:40:10<27:27:10,  3.29it/s]
 12%|█▏        | 46038/371472 [3:40:10<26:18:37,  3.44it/s]
 12%|█▏        | 46039/371472 [3:40:10<26:24:18,  3.42it/s]
 12%|█▏        | 46040/371472 [3:40:11<27:12:31,  3.32it/s]
                                                           
{'loss': 4.5854, 'learning_rate': 8.888793122023746e-07, 'epoch': 1.98}

 12%|█▏        | 46040/371472 [3:40:11<27:12:31,  3.32it/s]
 12%|█▏        | 46041/371472 [3:40:11<28:15:35,  3.20it/s]
 12%|█▏        | 46042/371472 [3:40:11<28:14:11,  3.20it/s]
 12%|█▏        | 46043/371472 [3:40:12<28:24:55,  3.18it/s]
 12%|█▏        | 46044/371472 [3:40:12<28:25:13,  3.18it/s]
 12%|█▏        | 46045/371472 [3:40:12<26:44:18,  3.38it/s]
 12%|█▏        | 46046/371472 [3:40:13<26:58:52,  3.35it/s]
 12%|█▏        | 46047/371472 [3:40:13<25:47:13,  3.51it/s]
 12%|█▏        | 46048/371472 [3:40:13<25:43:34,  3.51it/s]
 12%|█▏        | 46049/371472 [3:40:13<25:27:20,  3.55it/s]
 12%|█▏        | 46050/371472 [3:40:14<24:57:28,  3.62it/s]
 12%|█▏        | 46051/371472 [3:40:14<24:03:06,  3.76it/s]
 12%|█▏        | 46052/371472 [3:40:14<23:58:16,  3.77it/s]
 12%|█▏        | 46053/371472 [3:40:14<23:54:27,  3.78it/s]
 12%|█▏        | 46054/371472 [3:40:15<25:23:44,  3.56it/s]
 12%|█▏        | 46055/371472 [3:40:15<24:43:19,  3.66it/s]
 12%|█▏        | 46056/371472 [3:40:15<25:47:10,  3.51it/s]
 12%|█▏        | 46057/371472 [3:40:16<25:35:54,  3.53it/s]
 12%|█▏        | 46058/371472 [3:40:16<26:04:05,  3.47it/s]
 12%|█▏        | 46059/371472 [3:40:16<26:15:23,  3.44it/s]
 12%|█▏        | 46060/371472 [3:40:16<26:19:05,  3.43it/s]
                                                           
{'loss': 4.2624, 'learning_rate': 8.888308302268957e-07, 'epoch': 1.98}

 12%|█▏        | 46060/371472 [3:40:16<26:19:05,  3.43it/s]
 12%|█▏        | 46061/371472 [3:40:17<26:38:26,  3.39it/s]
 12%|█▏        | 46062/371472 [3:40:17<26:59:56,  3.35it/s]
 12%|█▏        | 46063/371472 [3:40:17<26:55:07,  3.36it/s]
 12%|█▏        | 46064/371472 [3:40:18<25:48:29,  3.50it/s]
 12%|█▏        | 46065/371472 [3:40:18<26:30:19,  3.41it/s]
 12%|█▏        | 46066/371472 [3:40:18<27:13:27,  3.32it/s]
 12%|█▏        | 46067/371472 [3:40:19<26:34:21,  3.40it/s]
 12%|█▏        | 46068/371472 [3:40:19<25:55:57,  3.49it/s]
 12%|█▏        | 46069/371472 [3:40:19<25:39:34,  3.52it/s]
 12%|█▏        | 46070/371472 [3:40:19<26:32:16,  3.41it/s]
 12%|█▏        | 46071/371472 [3:40:20<26:51:48,  3.36it/s]
 12%|█▏        | 46072/371472 [3:40:20<27:17:56,  3.31it/s]
 12%|█▏        | 46073/371472 [3:40:20<28:03:30,  3.22it/s]
 12%|█▏        | 46074/371472 [3:40:21<26:43:19,  3.38it/s]
 12%|█▏        | 46075/371472 [3:40:21<26:20:49,  3.43it/s]
 12%|█▏        | 46076/371472 [3:40:21<26:10:52,  3.45it/s]
 12%|█▏        | 46077/371472 [3:40:21<26:02:29,  3.47it/s]
 12%|█▏        | 46078/371472 [3:40:22<25:57:09,  3.48it/s]
 12%|█▏        | 46079/371472 [3:40:22<25:07:56,  3.60it/s]
 12%|█▏        | 46080/371472 [3:40:22<26:42:46,  3.38it/s]
                                                           
{'loss': 4.1914, 'learning_rate': 8.887823482514166e-07, 'epoch': 1.98}

 12%|█▏        | 46080/371472 [3:40:22<26:42:46,  3.38it/s]
 12%|█▏        | 46081/371472 [3:40:23<25:59:13,  3.48it/s]
 12%|█▏        | 46082/371472 [3:40:23<27:28:38,  3.29it/s]
 12%|█▏        | 46083/371472 [3:40:23<27:00:58,  3.35it/s]
 12%|█▏        | 46084/371472 [3:40:24<26:12:14,  3.45it/s]
 12%|█▏        | 46085/371472 [3:40:24<24:51:13,  3.64it/s]
 12%|█▏        | 46086/371472 [3:40:24<30:17:45,  2.98it/s]
 12%|█▏        | 46087/371472 [3:40:25<28:26:12,  3.18it/s]
 12%|█▏        | 46088/371472 [3:40:25<27:33:54,  3.28it/s]
 12%|█▏        | 46089/371472 [3:40:25<26:43:00,  3.38it/s]
 12%|█▏        | 46090/371472 [3:40:25<27:03:55,  3.34it/s]
 12%|█▏        | 46091/371472 [3:40:26<26:07:51,  3.46it/s]
 12%|█▏        | 46092/371472 [3:40:26<25:35:21,  3.53it/s]
 12%|█▏        | 46093/371472 [3:40:26<25:01:39,  3.61it/s]
 12%|█▏        | 46094/371472 [3:40:26<24:59:48,  3.62it/s]
 12%|█▏        | 46095/371472 [3:40:27<23:56:11,  3.78it/s]
 12%|█▏        | 46096/371472 [3:40:27<23:18:27,  3.88it/s]
 12%|█▏        | 46097/371472 [3:40:27<23:49:47,  3.79it/s]
 12%|█▏        | 46098/371472 [3:40:27<24:31:30,  3.69it/s]
 12%|█▏        | 46099/371472 [3:40:28<25:01:23,  3.61it/s]
 12%|█▏        | 46100/371472 [3:40:28<25:19:54,  3.57it/s]
                                                           
{'loss': 4.4736, 'learning_rate': 8.887338662759378e-07, 'epoch': 1.99}

 12%|█▏        | 46100/371472 [3:40:28<25:19:54,  3.57it/s]
 12%|█▏        | 46101/371472 [3:40:28<25:29:24,  3.55it/s]
 12%|█▏        | 46102/371472 [3:40:29<27:28:52,  3.29it/s]
 12%|█▏        | 46103/371472 [3:40:29<26:57:32,  3.35it/s]
 12%|█▏        | 46104/371472 [3:40:29<28:33:01,  3.17it/s]
 12%|█▏        | 46105/371472 [3:40:30<27:44:59,  3.26it/s]
 12%|█▏        | 46106/371472 [3:40:30<27:50:39,  3.25it/s]
 12%|█▏        | 46107/371472 [3:40:30<28:06:07,  3.22it/s]
 12%|█▏        | 46108/371472 [3:40:31<26:59:05,  3.35it/s]
 12%|█▏        | 46109/371472 [3:40:31<26:31:06,  3.41it/s]
 12%|█▏        | 46110/371472 [3:40:31<26:09:43,  3.45it/s]
 12%|█▏        | 46111/371472 [3:40:31<25:01:11,  3.61it/s]
 12%|█▏        | 46112/371472 [3:40:32<26:33:45,  3.40it/s]
 12%|█▏        | 46113/371472 [3:40:32<25:53:18,  3.49it/s]
 12%|█▏        | 46114/371472 [3:40:32<26:36:47,  3.40it/s]
 12%|█▏        | 46115/371472 [3:40:33<26:24:23,  3.42it/s]
 12%|█▏        | 46116/371472 [3:40:33<25:45:12,  3.51it/s]
 12%|█▏        | 46117/371472 [3:40:33<25:54:06,  3.49it/s]
 12%|█▏        | 46118/371472 [3:40:33<25:36:15,  3.53it/s]
 12%|█▏        | 46119/371472 [3:40:34<25:13:32,  3.58it/s]
 12%|█▏        | 46120/371472 [3:40:34<24:21:10,  3.71it/s]
                                                           
{'loss': 4.1645, 'learning_rate': 8.886853843004589e-07, 'epoch': 1.99}

 12%|█▏        | 46120/371472 [3:40:34<24:21:10,  3.71it/s]
 12%|█▏        | 46121/371472 [3:40:34<24:15:52,  3.72it/s]
 12%|█▏        | 46122/371472 [3:40:34<24:47:47,  3.64it/s]
 12%|█▏        | 46123/371472 [3:40:35<26:02:37,  3.47it/s]
 12%|█▏        | 46124/371472 [3:40:35<26:15:51,  3.44it/s]
 12%|█▏        | 46125/371472 [3:40:35<26:09:24,  3.46it/s]
 12%|█▏        | 46126/371472 [3:40:36<25:19:31,  3.57it/s]
 12%|█▏        | 46127/371472 [3:40:36<24:43:59,  3.65it/s]
 12%|█▏        | 46128/371472 [3:40:36<25:51:31,  3.49it/s]
 12%|█▏        | 46129/371472 [3:40:36<26:16:12,  3.44it/s]
 12%|█▏        | 46130/371472 [3:40:37<25:17:23,  3.57it/s]
 12%|█▏        | 46131/371472 [3:40:37<24:59:10,  3.62it/s]
 12%|█▏        | 46132/371472 [3:40:37<25:27:58,  3.55it/s]
 12%|█▏        | 46133/371472 [3:40:38<25:35:08,  3.53it/s]
 12%|█▏        | 46134/371472 [3:40:38<25:32:52,  3.54it/s]
 12%|█▏        | 46135/371472 [3:40:38<25:15:22,  3.58it/s]
 12%|█▏        | 46136/371472 [3:40:38<26:05:03,  3.46it/s]
 12%|█▏        | 46137/371472 [3:40:39<25:24:20,  3.56it/s]
 12%|█▏        | 46138/371472 [3:40:39<24:21:27,  3.71it/s]
 12%|█▏        | 46139/371472 [3:40:39<24:26:01,  3.70it/s]
 12%|█▏        | 46140/371472 [3:40:40<24:57:59,  3.62it/s]
                                                           
{'loss': 4.2593, 'learning_rate': 8.8863690232498e-07, 'epoch': 1.99}

 12%|█▏        | 46140/371472 [3:40:40<24:57:59,  3.62it/s]
 12%|█▏        | 46141/371472 [3:40:40<25:12:45,  3.58it/s]
 12%|█▏        | 46142/371472 [3:40:40<25:03:47,  3.61it/s]
 12%|█▏        | 46143/371472 [3:40:40<25:46:33,  3.51it/s]
 12%|█▏        | 46144/371472 [3:40:41<26:38:21,  3.39it/s]
 12%|█▏        | 46145/371472 [3:40:41<25:26:58,  3.55it/s]
 12%|█▏        | 46146/371472 [3:40:41<26:14:21,  3.44it/s]
 12%|█▏        | 46147/371472 [3:40:42<25:04:08,  3.60it/s]
 12%|█▏        | 46148/371472 [3:40:42<25:15:01,  3.58it/s]
 12%|█▏        | 46149/371472 [3:40:42<25:42:21,  3.52it/s]
 12%|█▏        | 46150/371472 [3:40:42<25:32:28,  3.54it/s]
 12%|█▏        | 46151/371472 [3:40:43<25:58:58,  3.48it/s]
 12%|█▏        | 46152/371472 [3:40:43<26:00:19,  3.47it/s]
 12%|█▏        | 46153/371472 [3:40:43<24:50:21,  3.64it/s]
 12%|█▏        | 46154/371472 [3:40:44<25:46:29,  3.51it/s]
 12%|█▏        | 46155/371472 [3:40:44<25:59:36,  3.48it/s]
 12%|█▏        | 46156/371472 [3:40:44<25:22:21,  3.56it/s]
 12%|█▏        | 46157/371472 [3:40:44<25:59:12,  3.48it/s]
 12%|█▏        | 46158/371472 [3:40:45<24:38:35,  3.67it/s]
 12%|█▏        | 46159/371472 [3:40:45<27:30:05,  3.29it/s]
 12%|█▏        | 46160/371472 [3:40:45<26:28:38,  3.41it/s]
                                                           
{'loss': 4.2933, 'learning_rate': 8.885884203495011e-07, 'epoch': 1.99}

 12%|█▏        | 46160/371472 [3:40:45<26:28:38,  3.41it/s]
 12%|█▏        | 46161/371472 [3:40:46<25:21:28,  3.56it/s]
 12%|█▏        | 46162/371472 [3:40:46<25:00:02,  3.61it/s]
 12%|█▏        | 46163/371472 [3:40:46<25:14:47,  3.58it/s]
 12%|█▏        | 46164/371472 [3:40:46<24:58:52,  3.62it/s]
 12%|█▏        | 46165/371472 [3:40:47<24:14:56,  3.73it/s]
 12%|█▏        | 46166/371472 [3:40:47<24:10:37,  3.74it/s]
 12%|█▏        | 46167/371472 [3:40:47<23:46:18,  3.80it/s]
 12%|█▏        | 46168/371472 [3:40:47<23:04:45,  3.92it/s]
 12%|█▏        | 46169/371472 [3:40:48<23:13:27,  3.89it/s]
 12%|█▏        | 46170/371472 [3:40:48<24:14:20,  3.73it/s]
 12%|█▏        | 46171/371472 [3:40:48<25:10:02,  3.59it/s]
 12%|█▏        | 46172/371472 [3:40:49<26:01:04,  3.47it/s]
 12%|█▏        | 46173/371472 [3:40:49<25:30:05,  3.54it/s]
 12%|█▏        | 46174/371472 [3:40:49<24:36:19,  3.67it/s]
 12%|█▏        | 46175/371472 [3:40:49<25:59:52,  3.48it/s]
 12%|█▏        | 46176/371472 [3:40:50<25:11:05,  3.59it/s]
 12%|█▏        | 46177/371472 [3:40:50<24:26:27,  3.70it/s]
 12%|█▏        | 46178/371472 [3:40:50<24:10:21,  3.74it/s]
 12%|█▏        | 46179/371472 [3:40:50<27:02:17,  3.34it/s]
 12%|█▏        | 46180/371472 [3:40:51<26:36:32,  3.40it/s]
                                                           
{'loss': 4.472, 'learning_rate': 8.885399383740223e-07, 'epoch': 1.99}

 12%|█▏        | 46180/371472 [3:40:51<26:36:32,  3.40it/s]
 12%|█▏        | 46181/371472 [3:40:51<27:51:05,  3.24it/s]
 12%|█▏        | 46182/371472 [3:40:51<28:11:58,  3.20it/s]
 12%|█▏        | 46183/371472 [3:40:52<29:00:36,  3.11it/s]
 12%|█▏        | 46184/371472 [3:40:52<27:41:14,  3.26it/s]
 12%|█▏        | 46185/371472 [3:40:52<25:58:56,  3.48it/s]
 12%|█▏        | 46186/371472 [3:40:53<25:01:10,  3.61it/s]
 12%|█▏        | 46187/371472 [3:40:53<25:29:42,  3.54it/s]
 12%|█▏        | 46188/371472 [3:40:53<25:07:01,  3.60it/s]
 12%|█▏        | 46189/371472 [3:40:53<24:44:47,  3.65it/s]
 12%|█▏        | 46190/371472 [3:40:54<24:35:53,  3.67it/s]
 12%|█▏        | 46191/371472 [3:40:54<24:37:40,  3.67it/s]
 12%|█▏        | 46192/371472 [3:40:54<24:28:39,  3.69it/s]
 12%|█▏        | 46193/371472 [3:40:54<25:53:10,  3.49it/s]
 12%|█▏        | 46194/371472 [3:40:55<24:41:38,  3.66it/s]
 12%|█▏        | 46195/371472 [3:40:55<24:09:17,  3.74it/s]
 12%|█▏        | 46196/371472 [3:40:55<24:10:18,  3.74it/s]
 12%|█▏        | 46197/371472 [3:40:56<24:07:28,  3.75it/s]
 12%|█▏        | 46198/371472 [3:40:56<23:40:38,  3.82it/s]
 12%|█▏        | 46199/371472 [3:40:56<23:37:09,  3.83it/s]
 12%|█▏        | 46200/371472 [3:40:56<24:40:24,  3.66it/s]
                                                           
{'loss': 4.5536, 'learning_rate': 8.884914563985433e-07, 'epoch': 1.99}

 12%|█▏        | 46200/371472 [3:40:56<24:40:24,  3.66it/s]
 12%|█▏        | 46201/371472 [3:40:57<25:00:17,  3.61it/s]
 12%|█▏        | 46202/371472 [3:40:57<27:23:50,  3.30it/s]
 12%|█▏        | 46203/371472 [3:40:57<30:30:25,  2.96it/s]
 12%|█▏        | 46204/371472 [3:40:58<28:46:17,  3.14it/s]
 12%|█▏        | 46205/371472 [3:40:58<28:53:36,  3.13it/s]
 12%|█▏        | 46206/371472 [3:40:58<28:21:21,  3.19it/s]
 12%|█▏        | 46207/371472 [3:40:59<26:49:08,  3.37it/s]
 12%|█▏        | 46208/371472 [3:40:59<26:39:18,  3.39it/s]
 12%|█▏        | 46209/371472 [3:40:59<26:13:56,  3.44it/s]
 12%|█▏        | 46210/371472 [3:40:59<25:06:42,  3.60it/s]
 12%|█▏        | 46211/371472 [3:41:00<26:15:42,  3.44it/s]
 12%|█▏        | 46212/371472 [3:41:00<26:13:09,  3.45it/s]
 12%|█▏        | 46213/371472 [3:41:00<26:14:08,  3.44it/s]
 12%|█▏        | 46214/371472 [3:41:01<25:38:21,  3.52it/s]
 12%|█▏        | 46215/371472 [3:41:01<25:35:34,  3.53it/s]
 12%|█▏        | 46216/371472 [3:41:01<24:52:55,  3.63it/s]
 12%|█▏        | 46217/371472 [3:41:01<24:49:31,  3.64it/s]
 12%|█▏        | 46218/371472 [3:41:02<25:21:19,  3.56it/s]
 12%|█▏        | 46219/371472 [3:41:02<26:12:52,  3.45it/s]
 12%|█▏        | 46220/371472 [3:41:02<27:19:04,  3.31it/s]
                                                           
{'loss': 4.111, 'learning_rate': 8.884429744230644e-07, 'epoch': 1.99}

 12%|█▏        | 46220/371472 [3:41:02<27:19:04,  3.31it/s]
 12%|█▏        | 46221/371472 [3:41:03<26:28:32,  3.41it/s]
 12%|█▏        | 46222/371472 [3:41:03<27:43:27,  3.26it/s]
 12%|█▏        | 46223/371472 [3:41:03<26:15:44,  3.44it/s]
 12%|█▏        | 46224/371472 [3:41:03<25:20:10,  3.57it/s]
 12%|█▏        | 46225/371472 [3:41:04<25:54:58,  3.49it/s]
 12%|█▏        | 46226/371472 [3:41:04<25:36:40,  3.53it/s]
 12%|█▏        | 46227/371472 [3:41:04<25:33:25,  3.54it/s]
 12%|█▏        | 46228/371472 [3:41:05<26:25:52,  3.42it/s]
 12%|█▏        | 46229/371472 [3:41:05<25:35:08,  3.53it/s]
 12%|█▏        | 46230/371472 [3:41:05<24:32:12,  3.68it/s]
 12%|█▏        | 46231/371472 [3:41:05<26:01:41,  3.47it/s]
 12%|█▏        | 46232/371472 [3:41:06<25:38:42,  3.52it/s]
 12%|█▏        | 46233/371472 [3:41:06<27:47:37,  3.25it/s]
 12%|█▏        | 46234/371472 [3:41:06<26:05:54,  3.46it/s]
 12%|█▏        | 46235/371472 [3:41:07<25:35:21,  3.53it/s]
 12%|█▏        | 46236/371472 [3:41:07<25:47:41,  3.50it/s]
 12%|█▏        | 46237/371472 [3:41:07<25:19:47,  3.57it/s]
 12%|█▏        | 46238/371472 [3:41:07<25:31:59,  3.54it/s]
 12%|█▏        | 46239/371472 [3:41:08<25:23:15,  3.56it/s]
 12%|█▏        | 46240/371472 [3:41:08<25:06:25,  3.60it/s]
                                                           
{'loss': 4.3073, 'learning_rate': 8.883944924475855e-07, 'epoch': 1.99}

 12%|█▏        | 46240/371472 [3:41:08<25:06:25,  3.60it/s]
 12%|█▏        | 46241/371472 [3:41:08<25:28:41,  3.55it/s]
 12%|█▏        | 46242/371472 [3:41:09<25:35:51,  3.53it/s]
 12%|█▏        | 46243/371472 [3:41:09<25:30:00,  3.54it/s]
 12%|█▏        | 46244/371472 [3:41:09<24:43:13,  3.65it/s]
 12%|█▏        | 46245/371472 [3:41:09<25:54:42,  3.49it/s]
 12%|█▏        | 46246/371472 [3:41:10<25:08:16,  3.59it/s]
 12%|█▏        | 46247/371472 [3:41:10<25:13:11,  3.58it/s]
 12%|█▏        | 46248/371472 [3:41:10<24:49:29,  3.64it/s]
 12%|█▏        | 46249/371472 [3:41:10<25:02:46,  3.61it/s]
 12%|█▏        | 46250/371472 [3:41:11<25:30:15,  3.54it/s]
 12%|█▏        | 46251/371472 [3:41:11<24:48:58,  3.64it/s]
 12%|█▏        | 46252/371472 [3:41:11<24:22:05,  3.71it/s]
 12%|█▏        | 46253/371472 [3:41:12<26:34:59,  3.40it/s]
 12%|█▏        | 46254/371472 [3:41:12<26:29:08,  3.41it/s]
 12%|█▏        | 46255/371472 [3:41:12<27:53:00,  3.24it/s]
 12%|█▏        | 46256/371472 [3:41:13<26:43:17,  3.38it/s]
 12%|█▏        | 46257/371472 [3:41:13<25:15:32,  3.58it/s]
 12%|█▏        | 46258/371472 [3:41:13<24:06:44,  3.75it/s]
 12%|█▏        | 46259/371472 [3:41:13<24:20:15,  3.71it/s]
 12%|█▏        | 46260/371472 [3:41:14<24:07:15,  3.75it/s]
                                                           
{'loss': 4.2787, 'learning_rate': 8.883460104721067e-07, 'epoch': 1.99}

 12%|█▏        | 46260/371472 [3:41:14<24:07:15,  3.75it/s]
 12%|█▏        | 46261/371472 [3:41:14<23:55:44,  3.78it/s]
 12%|█▏        | 46262/371472 [3:41:14<23:43:31,  3.81it/s]
 12%|█▏        | 46263/371472 [3:41:14<24:44:13,  3.65it/s]
 12%|█▏        | 46264/371472 [3:41:15<24:07:50,  3.74it/s]
 12%|█▏        | 46265/371472 [3:41:15<24:51:22,  3.63it/s]
 12%|█▏        | 46266/371472 [3:41:15<25:07:31,  3.60it/s]
 12%|█▏        | 46267/371472 [3:41:15<24:27:02,  3.69it/s]
 12%|█▏        | 46268/371472 [3:41:16<25:47:36,  3.50it/s]
 12%|█▏        | 46269/371472 [3:41:16<25:20:27,  3.56it/s]
 12%|█▏        | 46270/371472 [3:41:16<24:28:06,  3.69it/s]
 12%|█▏        | 46271/371472 [3:41:17<24:00:32,  3.76it/s]
 12%|█▏        | 46272/371472 [3:41:17<23:29:39,  3.84it/s]
 12%|█▏        | 46273/371472 [3:41:17<25:05:59,  3.60it/s]
 12%|█▏        | 46274/371472 [3:41:17<24:57:32,  3.62it/s]
 12%|█▏        | 46275/371472 [3:41:18<25:49:54,  3.50it/s]
 12%|█▏        | 46276/371472 [3:41:18<25:22:10,  3.56it/s]
 12%|█▏        | 46277/371472 [3:41:18<25:31:51,  3.54it/s]
 12%|█▏        | 46278/371472 [3:41:19<25:09:04,  3.59it/s]
 12%|█▏        | 46279/371472 [3:41:19<26:07:39,  3.46it/s]
 12%|█▏        | 46280/371472 [3:41:19<27:10:36,  3.32it/s]
                                                           
{'loss': 4.195, 'learning_rate': 8.882975284966278e-07, 'epoch': 1.99}

 12%|█▏        | 46280/371472 [3:41:19<27:10:36,  3.32it/s]
 12%|█▏        | 46281/371472 [3:41:19<26:37:46,  3.39it/s]
 12%|█▏        | 46282/371472 [3:41:20<25:19:40,  3.57it/s]
 12%|█▏        | 46283/371472 [3:41:20<26:12:31,  3.45it/s]
 12%|█▏        | 46284/371472 [3:41:20<26:48:50,  3.37it/s]
 12%|█▏        | 46285/371472 [3:41:21<26:32:23,  3.40it/s]
 12%|█▏        | 46286/371472 [3:41:21<26:26:39,  3.42it/s]
 12%|█▏        | 46287/371472 [3:41:21<25:09:30,  3.59it/s]
 12%|█▏        | 46288/371472 [3:41:21<25:10:47,  3.59it/s]
 12%|█▏        | 46289/371472 [3:41:22<24:40:09,  3.66it/s]
 12%|█▏        | 46290/371472 [3:41:22<24:17:54,  3.72it/s]
 12%|█▏        | 46291/371472 [3:41:22<26:12:09,  3.45it/s]
 12%|█▏        | 46292/371472 [3:41:23<25:45:31,  3.51it/s]
 12%|█▏        | 46293/371472 [3:41:23<24:43:59,  3.65it/s]
 12%|█▏        | 46294/371472 [3:41:23<24:15:38,  3.72it/s]
 12%|█▏        | 46295/371472 [3:41:23<23:58:17,  3.77it/s]
 12%|█▏        | 46296/371472 [3:41:24<23:51:05,  3.79it/s]
 12%|█▏        | 46297/371472 [3:41:24<24:38:38,  3.67it/s]
 12%|█▏        | 46298/371472 [3:41:24<24:58:07,  3.62it/s]
 12%|█▏        | 46299/371472 [3:41:24<24:08:42,  3.74it/s]
 12%|█▏        | 46300/371472 [3:41:25<23:45:49,  3.80it/s]
                                                           
{'loss': 4.3508, 'learning_rate': 8.882490465211489e-07, 'epoch': 1.99}

 12%|█▏        | 46300/371472 [3:41:25<23:45:49,  3.80it/s]
 12%|█▏        | 46301/371472 [3:41:25<23:49:09,  3.79it/s]
 12%|█▏        | 46302/371472 [3:41:25<23:54:10,  3.78it/s]
 12%|█▏        | 46303/371472 [3:41:25<23:17:42,  3.88it/s]
 12%|█▏        | 46304/371472 [3:41:26<24:27:38,  3.69it/s]
 12%|█▏        | 46305/371472 [3:41:26<25:49:21,  3.50it/s]
 12%|█▏        | 46306/371472 [3:41:26<26:08:37,  3.45it/s]
 12%|█▏        | 46307/371472 [3:41:27<26:06:48,  3.46it/s]
 12%|█▏        | 46308/371472 [3:41:27<25:41:24,  3.52it/s]
 12%|█▏        | 46309/371472 [3:41:27<25:34:41,  3.53it/s]
 12%|█▏        | 46310/371472 [3:41:27<25:40:49,  3.52it/s]
 12%|█▏        | 46311/371472 [3:41:28<24:57:38,  3.62it/s]
 12%|█▏        | 46312/371472 [3:41:28<25:41:01,  3.52it/s]
 12%|█▏        | 46313/371472 [3:41:28<25:43:19,  3.51it/s]
 12%|█▏        | 46314/371472 [3:41:29<25:58:45,  3.48it/s]
 12%|█▏        | 46315/371472 [3:41:29<25:26:22,  3.55it/s]
 12%|█▏        | 46316/371472 [3:41:29<27:55:17,  3.23it/s]
 12%|█▏        | 46317/371472 [3:41:30<27:02:16,  3.34it/s]
 12%|█▏        | 46318/371472 [3:41:30<28:20:47,  3.19it/s]
 12%|█▏        | 46319/371472 [3:41:30<26:40:48,  3.39it/s]
 12%|█▏        | 46320/371472 [3:41:30<27:25:06,  3.29it/s]
                                                           
{'loss': 4.2283, 'learning_rate': 8.8820056454567e-07, 'epoch': 2.0}

 12%|█▏        | 46320/371472 [3:41:30<27:25:06,  3.29it/s]
 12%|█▏        | 46321/371472 [3:41:31<27:34:41,  3.28it/s]
 12%|█▏        | 46322/371472 [3:41:31<27:14:59,  3.31it/s]
 12%|█▏        | 46323/371472 [3:41:31<27:14:03,  3.32it/s]
 12%|█▏        | 46324/371472 [3:41:32<28:19:29,  3.19it/s]
 12%|█▏        | 46325/371472 [3:41:32<28:11:02,  3.20it/s]
 12%|█▏        | 46326/371472 [3:41:32<27:13:09,  3.32it/s]
 12%|█▏        | 46327/371472 [3:41:33<26:03:40,  3.47it/s]
 12%|█▏        | 46328/371472 [3:41:33<25:50:21,  3.50it/s]
 12%|█▏        | 46329/371472 [3:41:33<25:22:44,  3.56it/s]
 12%|█▏        | 46330/371472 [3:41:33<25:57:48,  3.48it/s]
 12%|█▏        | 46331/371472 [3:41:34<25:21:21,  3.56it/s]
 12%|█▏        | 46332/371472 [3:41:34<24:53:22,  3.63it/s]
 12%|█▏        | 46333/371472 [3:41:34<23:58:04,  3.77it/s]
 12%|█▏        | 46334/371472 [3:41:34<24:43:30,  3.65it/s]
 12%|█▏        | 46335/371472 [3:41:35<28:40:35,  3.15it/s]
 12%|█▏        | 46336/371472 [3:41:35<28:01:59,  3.22it/s]
 12%|█▏        | 46337/371472 [3:41:35<28:10:27,  3.21it/s]
 12%|█▏        | 46338/371472 [3:41:36<27:26:20,  3.29it/s]
 12%|█▏        | 46339/371472 [3:41:36<27:23:20,  3.30it/s]
 12%|█▏        | 46340/371472 [3:41:36<26:55:56,  3.35it/s]
                                                           
{'loss': 4.0979, 'learning_rate': 8.88152082570191e-07, 'epoch': 2.0}

 12%|█▏        | 46340/371472 [3:41:36<26:55:56,  3.35it/s]
 12%|█▏        | 46341/371472 [3:41:37<26:18:16,  3.43it/s]
 12%|█▏        | 46342/371472 [3:41:37<25:57:56,  3.48it/s]
 12%|█▏        | 46343/371472 [3:41:37<26:54:47,  3.36it/s]
 12%|█▏        | 46344/371472 [3:41:38<28:43:36,  3.14it/s]
 12%|█▏        | 46345/371472 [3:41:38<28:38:35,  3.15it/s]
 12%|█▏        | 46346/371472 [3:41:38<27:38:55,  3.27it/s]
 12%|█▏        | 46347/371472 [3:41:39<27:42:14,  3.26it/s]
 12%|█▏        | 46348/371472 [3:41:39<28:56:57,  3.12it/s]
 12%|█▏        | 46349/371472 [3:41:39<27:55:44,  3.23it/s]
 12%|█▏        | 46350/371472 [3:41:39<27:40:07,  3.26it/s]
 12%|█▏        | 46351/371472 [3:41:40<26:36:01,  3.40it/s]
 12%|█▏        | 46352/371472 [3:41:40<27:17:55,  3.31it/s]
 12%|█▏        | 46353/371472 [3:41:40<26:19:52,  3.43it/s]
 12%|█▏        | 46354/371472 [3:41:41<25:49:44,  3.50it/s]
 12%|█▏        | 46355/371472 [3:41:41<25:37:19,  3.52it/s]
 12%|█▏        | 46356/371472 [3:41:41<25:06:37,  3.60it/s]
 12%|█▏        | 46357/371472 [3:41:41<25:03:38,  3.60it/s]
 12%|█▏        | 46358/371472 [3:41:42<24:17:01,  3.72it/s]
 12%|█▏        | 46359/371472 [3:41:42<23:51:52,  3.78it/s]
 12%|█▏        | 46360/371472 [3:41:42<23:51:38,  3.78it/s]
                                                           
{'loss': 4.509, 'learning_rate': 8.881036005947122e-07, 'epoch': 2.0}

 12%|█▏        | 46360/371472 [3:41:42<23:51:38,  3.78it/s]
 12%|█▏        | 46361/371472 [3:41:42<24:58:03,  3.62it/s]
 12%|█▏        | 46362/371472 [3:41:43<26:39:18,  3.39it/s]
 12%|█▏        | 46363/371472 [3:41:43<25:50:56,  3.49it/s]
 12%|█▏        | 46364/371472 [3:41:43<24:31:37,  3.68it/s]
 12%|█▏        | 46365/371472 [3:41:44<25:55:42,  3.48it/s]
 12%|█▏        | 46366/371472 [3:41:44<25:24:39,  3.55it/s]
 12%|█▏        | 46367/371472 [3:41:44<24:58:16,  3.62it/s]
 12%|█▏        | 46368/371472 [3:41:44<24:29:35,  3.69it/s]
 12%|█▏        | 46369/371472 [3:41:45<26:29:11,  3.41it/s]
 12%|█▏        | 46370/371472 [3:41:45<27:15:38,  3.31it/s]
 12%|█▏        | 46371/371472 [3:41:45<26:43:07,  3.38it/s]
 12%|█▏        | 46372/371472 [3:41:46<25:57:03,  3.48it/s]
 12%|█▏        | 46373/371472 [3:41:46<25:47:59,  3.50it/s]
 12%|█▏        | 46374/371472 [3:41:46<25:48:37,  3.50it/s]
 12%|█▏        | 46375/371472 [3:41:46<25:03:55,  3.60it/s]
 12%|█▏        | 46376/371472 [3:41:47<28:19:33,  3.19it/s]
 12%|█▏        | 46377/371472 [3:41:47<27:14:43,  3.31it/s]
 12%|█▏        | 46378/371472 [3:41:47<28:33:04,  3.16it/s]
 12%|█▏        | 46379/371472 [3:41:48<28:46:42,  3.14it/s]
 12%|█▏        | 46380/371472 [3:41:48<29:39:24,  3.04it/s]
                                                           
{'loss': 4.3608, 'learning_rate': 8.880551186192333e-07, 'epoch': 2.0}

 12%|█▏        | 46380/371472 [3:41:48<29:39:24,  3.04it/s]
 12%|█▏        | 46381/371472 [3:41:49<30:34:05,  2.95it/s]
 12%|█▏        | 46382/371472 [3:41:49<30:08:43,  3.00it/s]
 12%|█▏        | 46383/371472 [3:41:49<30:14:49,  2.99it/s]
 12%|█▏        | 46384/371472 [3:41:49<28:06:28,  3.21it/s]
 12%|█▏        | 46385/371472 [3:41:50<27:33:29,  3.28it/s]
 12%|█▏        | 46386/371472 [3:41:50<28:13:40,  3.20it/s]
 12%|█▏        | 46387/371472 [3:41:50<27:14:06,  3.32it/s]
 12%|█▏        | 46388/371472 [3:41:51<26:12:38,  3.45it/s]
 12%|█▏        | 46389/371472 [3:41:51<24:37:44,  3.67it/s]
 12%|█▏        | 46390/371472 [3:41:51<25:06:48,  3.60it/s]
 12%|█▏        | 46391/371472 [3:41:51<24:43:07,  3.65it/s]
 12%|█▏        | 46392/371472 [3:41:52<27:15:21,  3.31it/s]
 12%|█▏        | 46393/371472 [3:41:52<26:04:10,  3.46it/s]
 12%|█▏        | 46394/371472 [3:41:52<25:44:53,  3.51it/s]
 12%|█▏        | 46395/371472 [3:41:53<25:03:25,  3.60it/s]
 12%|█▏        | 46396/371472 [3:41:53<24:50:58,  3.63it/s]
 12%|█▏        | 46397/371472 [3:41:53<26:05:38,  3.46it/s]
 12%|█▏        | 46398/371472 [3:41:53<25:32:31,  3.54it/s]
 12%|█▏        | 46399/371472 [3:41:54<24:59:25,  3.61it/s]
 12%|█▏        | 46400/371472 [3:41:54<28:07:35,  3.21it/s]
                                                           
{'loss': 4.1539, 'learning_rate': 8.880066366437544e-07, 'epoch': 2.0}

 12%|█▏        | 46400/371472 [3:41:54<28:07:35,  3.21it/s]
 12%|█▏        | 46401/371472 [3:41:54<28:28:00,  3.17it/s]
 12%|█▏        | 46402/371472 [3:41:55<29:13:35,  3.09it/s]
 12%|█▏        | 46403/371472 [3:41:55<28:45:10,  3.14it/s]
 12%|█▏        | 46404/371472 [3:41:55<27:34:57,  3.27it/s]
 12%|█▏        | 46405/371472 [3:41:56<26:30:10,  3.41it/s]
 12%|█▏        | 46406/371472 [3:41:56<25:38:37,  3.52it/s]
 12%|█▏        | 46407/371472 [3:41:56<25:10:56,  3.59it/s]
 12%|█▏        | 46408/371472 [3:41:56<25:29:57,  3.54it/s]
 12%|█▏        | 46409/371472 [3:41:57<26:16:35,  3.44it/s]
 12%|█▏        | 46410/371472 [3:41:57<25:43:42,  3.51it/s]
 12%|█▏        | 46411/371472 [3:41:57<25:12:17,  3.58it/s]
 12%|█▏        | 46412/371472 [3:41:58<26:06:45,  3.46it/s]
 12%|█▏        | 46413/371472 [3:41:58<25:51:50,  3.49it/s]
 12%|█▏        | 46414/371472 [3:41:58<26:52:34,  3.36it/s]
 12%|█▏        | 46415/371472 [3:41:58<27:27:48,  3.29it/s]
 12%|█▏        | 46416/371472 [3:41:59<26:52:48,  3.36it/s]
 12%|█▏        | 46417/371472 [3:41:59<25:58:01,  3.48it/s]
 12%|█▏        | 46418/371472 [3:41:59<25:10:25,  3.59it/s]
 12%|█▏        | 46419/371472 [3:42:00<25:33:16,  3.53it/s]
 12%|█▏        | 46420/371472 [3:42:00<25:37:07,  3.52it/s]
                                                           
{'loss': 4.287, 'learning_rate': 8.879581546682756e-07, 'epoch': 2.0}

 12%|█▏        | 46420/371472 [3:42:00<25:37:07,  3.52it/s]
 12%|█▏        | 46421/371472 [3:42:00<26:53:47,  3.36it/s]
 12%|█▏        | 46422/371472 [3:42:00<26:56:28,  3.35it/s]
 12%|█▏        | 46423/371472 [3:42:01<26:06:34,  3.46it/s]
 12%|█▏        | 46424/371472 [3:42:01<27:23:44,  3.30it/s]
 12%|█▏        | 46425/371472 [3:42:01<26:23:58,  3.42it/s]
 12%|█▏        | 46426/371472 [3:42:02<27:17:47,  3.31it/s]
 12%|█▏        | 46427/371472 [3:42:02<26:16:10,  3.44it/s]
 12%|█▏        | 46428/371472 [3:42:02<26:28:10,  3.41it/s]
 12%|█▏        | 46429/371472 [3:42:03<26:19:50,  3.43it/s]
 12%|█▏        | 46430/371472 [3:42:03<27:48:34,  3.25it/s]
 12%|█▏        | 46431/371472 [3:42:03<26:53:03,  3.36it/s]
 12%|█▏        | 46432/371472 [3:42:03<26:31:54,  3.40it/s]
 12%|█▏        | 46433/371472 [3:42:04<25:27:52,  3.55it/s]
 12%|█▎        | 46434/371472 [3:42:04<26:45:58,  3.37it/s]Some non-default generation parameters are set in the model config. These should go into a GenerationConfig file (https://huggingface.co/docs/transformers/generation_strategies#save-a-custom-decoding-strategy-with-your-model) instead. This warning will be raised to an exception in v4.41.
Non-default generation parameters: {'max_length': 200, 'early_stopping': True, 'num_beams': 5, 'forced_eos_token_id': 2}
/opt/conda/lib/python3.10/multiprocessing/popen_fork.py:66: RuntimeWarning: os.fork() was called. os.fork() is incompatible with multithreaded code, and JAX is multithreaded, so this will likely lead to a deadlock.
  self.pid = os.fork()

 13%|█▎        | 46435/371472 [3:42:31<759:15:55,  8.41s/it]
 13%|█▎        | 46436/371472 [3:42:32<539:03:58,  5.97s/it]
 13%|█▎        | 46437/371472 [3:42:32<384:23:16,  4.26s/it]
 13%|█▎        | 46438/371472 [3:42:32<276:51:20,  3.07s/it]
 13%|█▎        | 46439/371472 [3:42:32<201:41:15,  2.23s/it]
 13%|█▎        | 46440/371472 [3:42:33<148:23:38,  1.64s/it]
                                                            
{'loss': 4.2811, 'learning_rate': 8.879096726927968e-07, 'epoch': 2.0}

 13%|█▎        | 46440/371472 [3:42:33<148:23:38,  1.64s/it]
 13%|█▎        | 46441/371472 [3:42:33<111:22:37,  1.23s/it]
 13%|█▎        | 46442/371472 [3:42:33<86:26:32,  1.04it/s] 
 13%|█▎        | 46443/371472 [3:42:34<68:25:30,  1.32it/s]
 13%|█▎        | 46444/371472 [3:42:34<55:33:37,  1.62it/s]
 13%|█▎        | 46445/371472 [3:42:34<47:25:41,  1.90it/s]
 13%|█▎        | 46446/371472 [3:42:35<42:10:39,  2.14it/s]
 13%|█▎        | 46447/371472 [3:42:35<38:10:39,  2.36it/s]
 13%|█▎        | 46448/371472 [3:42:35<35:29:24,  2.54it/s]
 13%|█▎        | 46449/371472 [3:42:36<34:00:25,  2.65it/s]
 13%|█▎        | 46450/371472 [3:42:36<31:45:12,  2.84it/s]
 13%|█▎        | 46451/371472 [3:42:36<33:20:56,  2.71it/s]
 13%|█▎        | 46452/371472 [3:42:37<30:54:55,  2.92it/s]
 13%|█▎        | 46453/371472 [3:42:37<30:15:36,  2.98it/s]
 13%|█▎        | 46454/371472 [3:42:37<32:43:51,  2.76it/s]
 13%|█▎        | 46455/371472 [3:42:38<30:51:35,  2.93it/s]
 13%|█▎        | 46456/371472 [3:42:38<30:18:02,  2.98it/s]
 13%|█▎        | 46457/371472 [3:42:38<29:01:07,  3.11it/s]
 13%|█▎        | 46458/371472 [3:42:38<28:36:57,  3.15it/s]
 13%|█▎        | 46459/371472 [3:42:39<27:48:38,  3.25it/s]
 13%|█▎        | 46460/371472 [3:42:39<27:26:42,  3.29it/s]
                                                           
{'loss': 4.3977, 'learning_rate': 8.878611907173177e-07, 'epoch': 2.0}

 13%|█▎        | 46460/371472 [3:42:39<27:26:42,  3.29it/s]
 13%|█▎        | 46461/371472 [3:42:39<26:18:42,  3.43it/s]
 13%|█▎        | 46462/371472 [3:42:40<25:54:37,  3.48it/s]
 13%|█▎        | 46463/371472 [3:42:40<26:25:32,  3.42it/s]
 13%|█▎        | 46464/371472 [3:42:40<26:34:21,  3.40it/s]
 13%|█▎        | 46465/371472 [3:42:40<26:08:53,  3.45it/s]
 13%|█▎        | 46466/371472 [3:42:41<26:00:20,  3.47it/s]
 13%|█▎        | 46467/371472 [3:42:41<25:50:11,  3.49it/s]
 13%|█▎        | 46468/371472 [3:42:41<25:52:51,  3.49it/s]
 13%|█▎        | 46469/371472 [3:42:42<25:37:53,  3.52it/s]
 13%|█▎        | 46470/371472 [3:42:42<24:48:56,  3.64it/s]
 13%|█▎        | 46471/371472 [3:42:42<25:23:40,  3.56it/s]
 13%|█▎        | 46472/371472 [3:42:43<26:43:49,  3.38it/s]
 13%|█▎        | 46473/371472 [3:42:43<26:32:28,  3.40it/s]
 13%|█▎        | 46474/371472 [3:42:43<26:00:21,  3.47it/s]
 13%|█▎        | 46475/371472 [3:42:43<24:54:32,  3.62it/s]
 13%|█▎        | 46476/371472 [3:42:44<24:22:52,  3.70it/s]
 13%|█▎        | 46477/371472 [3:42:44<23:56:58,  3.77it/s]
 13%|█▎        | 46478/371472 [3:42:44<24:00:17,  3.76it/s]
 13%|█▎        | 46479/371472 [3:42:44<25:38:45,  3.52it/s]
 13%|█▎        | 46480/371472 [3:42:45<25:03:18,  3.60it/s]
                                                           
{'loss': 4.4591, 'learning_rate': 8.878127087418388e-07, 'epoch': 2.0}

 13%|█▎        | 46480/371472 [3:42:45<25:03:18,  3.60it/s]
 13%|█▎        | 46481/371472 [3:42:45<25:06:15,  3.60it/s]
 13%|█▎        | 46482/371472 [3:42:45<24:15:53,  3.72it/s]
 13%|█▎        | 46483/371472 [3:42:45<24:13:00,  3.73it/s]
 13%|█▎        | 46484/371472 [3:42:46<24:19:03,  3.71it/s]
 13%|█▎        | 46485/371472 [3:42:46<23:45:25,  3.80it/s]
 13%|█▎        | 46486/371472 [3:42:46<24:19:20,  3.71it/s]
 13%|█▎        | 46487/371472 [3:42:47<24:35:33,  3.67it/s]
 13%|█▎        | 46488/371472 [3:42:47<25:38:02,  3.52it/s]
 13%|█▎        | 46489/371472 [3:42:47<25:50:37,  3.49it/s]
 13%|█▎        | 46490/371472 [3:42:47<25:51:59,  3.49it/s]
 13%|█▎        | 46491/371472 [3:42:48<25:30:24,  3.54it/s]
 13%|█▎        | 46492/371472 [3:42:48<30:32:35,  2.96it/s]
 13%|█▎        | 46493/371472 [3:42:48<28:43:46,  3.14it/s]
 13%|█▎        | 46494/371472 [3:42:49<29:01:40,  3.11it/s]
 13%|█▎        | 46495/371472 [3:42:49<27:25:35,  3.29it/s]
 13%|█▎        | 46496/371472 [3:42:49<27:13:48,  3.32it/s]
 13%|█▎        | 46497/371472 [3:42:50<26:24:36,  3.42it/s]
 13%|█▎        | 46498/371472 [3:42:50<27:00:30,  3.34it/s]
 13%|█▎        | 46499/371472 [3:42:50<26:07:52,  3.45it/s]
 13%|█▎        | 46500/371472 [3:42:50<25:49:17,  3.50it/s]
                                                           
{'loss': 4.3031, 'learning_rate': 8.8776422676636e-07, 'epoch': 2.0}

 13%|█▎        | 46500/371472 [3:42:50<25:49:17,  3.50it/s]
 13%|█▎        | 46501/371472 [3:42:51<25:09:18,  3.59it/s]
 13%|█▎        | 46502/371472 [3:42:51<26:20:54,  3.43it/s]
 13%|█▎        | 46503/371472 [3:42:51<26:03:45,  3.46it/s]
 13%|█▎        | 46504/371472 [3:42:52<25:51:24,  3.49it/s]
 13%|█▎        | 46505/371472 [3:42:52<24:53:17,  3.63it/s]
 13%|█▎        | 46506/371472 [3:42:52<24:59:00,  3.61it/s]
 13%|█▎        | 46507/371472 [3:42:52<25:24:05,  3.55it/s]
 13%|█▎        | 46508/371472 [3:42:53<25:28:39,  3.54it/s]
 13%|█▎        | 46509/371472 [3:42:53<26:01:13,  3.47it/s]
 13%|█▎        | 46510/371472 [3:42:53<25:19:27,  3.56it/s]
 13%|█▎        | 46511/371472 [3:42:54<26:54:05,  3.36it/s]
 13%|█▎        | 46512/371472 [3:42:54<25:54:01,  3.49it/s]
 13%|█▎        | 46513/371472 [3:42:54<25:28:31,  3.54it/s]
 13%|█▎        | 46514/371472 [3:42:54<25:14:55,  3.58it/s]
 13%|█▎        | 46515/371472 [3:42:55<26:07:07,  3.46it/s]
 13%|█▎        | 46516/371472 [3:42:55<26:11:36,  3.45it/s]
 13%|█▎        | 46517/371472 [3:42:55<25:41:51,  3.51it/s]
 13%|█▎        | 46518/371472 [3:42:56<26:06:42,  3.46it/s]
 13%|█▎        | 46519/371472 [3:42:56<26:12:50,  3.44it/s]
 13%|█▎        | 46520/371472 [3:42:56<26:18:13,  3.43it/s]
                                                           
{'loss': 4.3416, 'learning_rate': 8.87715744790881e-07, 'epoch': 2.0}

 13%|█▎        | 46520/371472 [3:42:56<26:18:13,  3.43it/s]
 13%|█▎        | 46521/371472 [3:42:56<25:17:23,  3.57it/s]
 13%|█▎        | 46522/371472 [3:42:57<24:37:36,  3.67it/s]
 13%|█▎        | 46523/371472 [3:42:57<27:06:26,  3.33it/s]
 13%|█▎        | 46524/371472 [3:42:57<28:20:43,  3.18it/s]
 13%|█▎        | 46525/371472 [3:42:58<27:47:01,  3.25it/s]
 13%|█▎        | 46526/371472 [3:42:58<28:29:18,  3.17it/s]
 13%|█▎        | 46527/371472 [3:42:58<28:04:14,  3.22it/s]
 13%|█▎        | 46528/371472 [3:42:59<29:49:38,  3.03it/s]
 13%|█▎        | 46529/371472 [3:42:59<29:38:21,  3.05it/s]
 13%|█▎        | 46530/371472 [3:42:59<27:52:00,  3.24it/s]
 13%|█▎        | 46531/371472 [3:43:00<28:04:03,  3.22it/s]
 13%|█▎        | 46532/371472 [3:43:00<26:53:16,  3.36it/s]
 13%|█▎        | 46533/371472 [3:43:00<26:30:11,  3.41it/s]
 13%|█▎        | 46534/371472 [3:43:00<26:44:15,  3.38it/s]
 13%|█▎        | 46535/371472 [3:43:01<25:41:09,  3.51it/s]
 13%|█▎        | 46536/371472 [3:43:01<27:20:33,  3.30it/s]
 13%|█▎        | 46537/371472 [3:43:01<26:30:03,  3.41it/s]
 13%|█▎        | 46538/371472 [3:43:02<27:23:53,  3.29it/s]
 13%|█▎        | 46539/371472 [3:43:02<26:50:23,  3.36it/s]
 13%|█▎        | 46540/371472 [3:43:02<26:25:05,  3.42it/s]
                                                           
{'loss': 4.2634, 'learning_rate': 8.876672628154021e-07, 'epoch': 2.0}

 13%|█▎        | 46540/371472 [3:43:02<26:25:05,  3.42it/s]
 13%|█▎        | 46541/371472 [3:43:02<24:56:15,  3.62it/s]
 13%|█▎        | 46542/371472 [3:43:03<25:52:42,  3.49it/s]
 13%|█▎        | 46543/371472 [3:43:03<26:52:20,  3.36it/s]
 13%|█▎        | 46544/371472 [3:43:03<28:11:02,  3.20it/s]
 13%|█▎        | 46545/371472 [3:43:04<28:22:03,  3.18it/s]
 13%|█▎        | 46546/371472 [3:43:04<26:31:49,  3.40it/s]
 13%|█▎        | 46547/371472 [3:43:04<26:08:08,  3.45it/s]
 13%|█▎        | 46548/371472 [3:43:05<25:28:34,  3.54it/s]
 13%|█▎        | 46549/371472 [3:43:05<25:54:07,  3.48it/s]
 13%|█▎        | 46550/371472 [3:43:05<28:51:05,  3.13it/s]
 13%|█▎        | 46551/371472 [3:43:06<28:31:12,  3.16it/s]
 13%|█▎        | 46552/371472 [3:43:06<27:56:46,  3.23it/s]
 13%|█▎        | 46553/371472 [3:43:06<26:55:42,  3.35it/s]
 13%|█▎        | 46554/371472 [3:43:06<28:04:06,  3.22it/s]
 13%|█▎        | 46555/371472 [3:43:07<28:54:42,  3.12it/s]
 13%|█▎        | 46556/371472 [3:43:07<28:28:56,  3.17it/s]
 13%|█▎        | 46557/371472 [3:43:07<26:59:16,  3.34it/s]
 13%|█▎        | 46558/371472 [3:43:08<27:28:07,  3.29it/s]
 13%|█▎        | 46559/371472 [3:43:08<26:27:07,  3.41it/s]
 13%|█▎        | 46560/371472 [3:43:08<27:05:44,  3.33it/s]
                                                           
{'loss': 4.2435, 'learning_rate': 8.876187808399233e-07, 'epoch': 2.01}

 13%|█▎        | 46560/371472 [3:43:08<27:05:44,  3.33it/s]
 13%|█▎        | 46561/371472 [3:43:09<26:39:26,  3.39it/s]
 13%|█▎        | 46562/371472 [3:43:09<27:39:14,  3.26it/s]
 13%|█▎        | 46563/371472 [3:43:09<27:08:27,  3.33it/s]
 13%|█▎        | 46564/371472 [3:43:09<26:12:24,  3.44it/s]
 13%|█▎        | 46565/371472 [3:43:10<25:12:13,  3.58it/s]
 13%|█▎        | 46566/371472 [3:43:10<25:46:40,  3.50it/s]
 13%|█▎        | 46567/371472 [3:43:10<26:13:52,  3.44it/s]
 13%|█▎        | 46568/371472 [3:43:11<25:20:59,  3.56it/s]
 13%|█▎        | 46569/371472 [3:43:11<24:52:05,  3.63it/s]
 13%|█▎        | 46570/371472 [3:43:11<27:31:57,  3.28it/s]
 13%|█▎        | 46571/371472 [3:43:12<30:02:16,  3.00it/s]
 13%|█▎        | 46572/371472 [3:43:12<29:28:11,  3.06it/s]
 13%|█▎        | 46573/371472 [3:43:12<29:32:48,  3.05it/s]
 13%|█▎        | 46574/371472 [3:43:13<28:31:09,  3.16it/s]
 13%|█▎        | 46575/371472 [3:43:13<27:12:26,  3.32it/s]
 13%|█▎        | 46576/371472 [3:43:13<26:49:03,  3.37it/s]
 13%|█▎        | 46577/371472 [3:43:13<27:39:49,  3.26it/s]
 13%|█▎        | 46578/371472 [3:43:14<26:54:23,  3.35it/s]
 13%|█▎        | 46579/371472 [3:43:14<26:36:58,  3.39it/s]
 13%|█▎        | 46580/371472 [3:43:14<29:50:52,  3.02it/s]
                                                           
{'loss': 4.444, 'learning_rate': 8.875702988644444e-07, 'epoch': 2.01}

 13%|█▎        | 46580/371472 [3:43:14<29:50:52,  3.02it/s]
 13%|█▎        | 46581/371472 [3:43:15<28:37:01,  3.15it/s]
 13%|█▎        | 46582/371472 [3:43:15<27:56:57,  3.23it/s]
 13%|█▎        | 46583/371472 [3:43:15<27:41:44,  3.26it/s]
 13%|█▎        | 46584/371472 [3:43:16<26:14:03,  3.44it/s]
 13%|█▎        | 46585/371472 [3:43:16<25:40:09,  3.52it/s]
 13%|█▎        | 46586/371472 [3:43:16<25:26:15,  3.55it/s]
 13%|█▎        | 46587/371472 [3:43:16<25:08:43,  3.59it/s]
 13%|█▎        | 46588/371472 [3:43:17<24:48:44,  3.64it/s]
 13%|█▎        | 46589/371472 [3:43:17<25:40:17,  3.52it/s]
 13%|█▎        | 46590/371472 [3:43:17<24:48:40,  3.64it/s]
 13%|█▎        | 46591/371472 [3:43:18<25:54:48,  3.48it/s]
 13%|█▎        | 46592/371472 [3:43:18<25:33:10,  3.53it/s]
 13%|█▎        | 46593/371472 [3:43:18<24:51:48,  3.63it/s]
 13%|█▎        | 46594/371472 [3:43:18<26:27:21,  3.41it/s]
 13%|█▎        | 46595/371472 [3:43:19<26:28:47,  3.41it/s]
 13%|█▎        | 46596/371472 [3:43:19<26:14:55,  3.44it/s]
 13%|█▎        | 46597/371472 [3:43:19<26:39:29,  3.39it/s]
 13%|█▎        | 46598/371472 [3:43:19<25:22:39,  3.56it/s]
 13%|█▎        | 46599/371472 [3:43:20<25:16:31,  3.57it/s]
 13%|█▎        | 46600/371472 [3:43:20<25:28:57,  3.54it/s]
                                                           
{'loss': 4.2953, 'learning_rate': 8.875218168889654e-07, 'epoch': 2.01}

 13%|█▎        | 46600/371472 [3:43:20<25:28:57,  3.54it/s]
 13%|█▎        | 46601/371472 [3:43:20<24:48:03,  3.64it/s]
 13%|█▎        | 46602/371472 [3:43:21<24:12:59,  3.73it/s]
 13%|█▎        | 46603/371472 [3:43:21<24:31:57,  3.68it/s]
 13%|█▎        | 46604/371472 [3:43:21<24:37:03,  3.67it/s]
 13%|█▎        | 46605/371472 [3:43:21<25:30:28,  3.54it/s]
 13%|█▎        | 46606/371472 [3:43:22<24:58:16,  3.61it/s]
 13%|█▎        | 46607/371472 [3:43:22<25:39:56,  3.52it/s]
 13%|█▎        | 46608/371472 [3:43:22<26:10:02,  3.45it/s]
 13%|█▎        | 46609/371472 [3:43:23<26:34:20,  3.40it/s]
 13%|█▎        | 46610/371472 [3:43:23<25:36:06,  3.52it/s]
 13%|█▎        | 46611/371472 [3:43:23<25:36:22,  3.52it/s]
 13%|█▎        | 46612/371472 [3:43:23<24:48:17,  3.64it/s]
 13%|█▎        | 46613/371472 [3:43:24<25:54:42,  3.48it/s]
 13%|█▎        | 46614/371472 [3:43:24<26:20:33,  3.43it/s]
 13%|█▎        | 46615/371472 [3:43:24<25:23:16,  3.55it/s]
 13%|█▎        | 46616/371472 [3:43:25<26:16:52,  3.43it/s]
 13%|█▎        | 46617/371472 [3:43:25<25:54:54,  3.48it/s]
 13%|█▎        | 46618/371472 [3:43:25<24:58:35,  3.61it/s]
 13%|█▎        | 46619/371472 [3:43:25<25:20:03,  3.56it/s]
 13%|█▎        | 46620/371472 [3:43:26<25:07:15,  3.59it/s]
                                                           
{'loss': 4.1916, 'learning_rate': 8.874733349134865e-07, 'epoch': 2.01}

 13%|█▎        | 46620/371472 [3:43:26<25:07:15,  3.59it/s]
 13%|█▎        | 46621/371472 [3:43:26<25:34:06,  3.53it/s]
 13%|█▎        | 46622/371472 [3:43:26<26:53:27,  3.36it/s]
 13%|█▎        | 46623/371472 [3:43:27<27:35:17,  3.27it/s]
 13%|█▎        | 46624/371472 [3:43:27<29:32:07,  3.06it/s]
 13%|█▎        | 46625/371472 [3:43:27<30:10:17,  2.99it/s]
 13%|█▎        | 46626/371472 [3:43:28<29:36:29,  3.05it/s]
 13%|█▎        | 46627/371472 [3:43:28<28:55:25,  3.12it/s]
 13%|█▎        | 46628/371472 [3:43:28<28:05:03,  3.21it/s]
 13%|█▎        | 46629/371472 [3:43:29<28:02:17,  3.22it/s]
 13%|█▎        | 46630/371472 [3:43:29<28:43:44,  3.14it/s]
 13%|█▎        | 46631/371472 [3:43:29<27:39:43,  3.26it/s]
 13%|█▎        | 46632/371472 [3:43:30<28:40:21,  3.15it/s]
 13%|█▎        | 46633/371472 [3:43:30<28:51:34,  3.13it/s]
 13%|█▎        | 46634/371472 [3:43:30<29:25:26,  3.07it/s]
 13%|█▎        | 46635/371472 [3:43:30<28:13:59,  3.20it/s]
 13%|█▎        | 46636/371472 [3:43:31<27:29:00,  3.28it/s]
 13%|█▎        | 46637/371472 [3:43:31<26:43:44,  3.38it/s]
 13%|█▎        | 46638/371472 [3:43:31<26:32:36,  3.40it/s]
 13%|█▎        | 46639/371472 [3:43:32<26:45:09,  3.37it/s]
 13%|█▎        | 46640/371472 [3:43:32<26:05:32,  3.46it/s]
                                                           
{'loss': 4.208, 'learning_rate': 8.874248529380077e-07, 'epoch': 2.01}

 13%|█▎        | 46640/371472 [3:43:32<26:05:32,  3.46it/s]
 13%|█▎        | 46641/371472 [3:43:32<26:57:21,  3.35it/s]
 13%|█▎        | 46642/371472 [3:43:32<25:40:12,  3.51it/s]
 13%|█▎        | 46643/371472 [3:43:33<26:23:28,  3.42it/s]
 13%|█▎        | 46644/371472 [3:43:33<25:42:56,  3.51it/s]
 13%|█▎        | 46645/371472 [3:43:33<25:10:44,  3.58it/s]
 13%|█▎        | 46646/371472 [3:43:34<25:00:04,  3.61it/s]
 13%|█▎        | 46647/371472 [3:43:34<26:57:47,  3.35it/s]
 13%|█▎        | 46648/371472 [3:43:34<25:58:00,  3.47it/s]
 13%|█▎        | 46649/371472 [3:43:34<24:59:11,  3.61it/s]
 13%|█▎        | 46650/371472 [3:43:35<25:01:22,  3.61it/s]
 13%|█▎        | 46651/371472 [3:43:35<26:26:00,  3.41it/s]
 13%|█▎        | 46652/371472 [3:43:35<25:41:31,  3.51it/s]
 13%|█▎        | 46653/371472 [3:43:36<25:01:39,  3.61it/s]
 13%|█▎        | 46654/371472 [3:43:36<25:54:51,  3.48it/s]
 13%|█▎        | 46655/371472 [3:43:36<26:10:34,  3.45it/s]
 13%|█▎        | 46656/371472 [3:43:37<26:47:48,  3.37it/s]
 13%|█▎        | 46657/371472 [3:43:37<26:46:30,  3.37it/s]
 13%|█▎        | 46658/371472 [3:43:37<26:41:15,  3.38it/s]
 13%|█▎        | 46659/371472 [3:43:37<25:51:37,  3.49it/s]
 13%|█▎        | 46660/371472 [3:43:38<25:26:00,  3.55it/s]
                                                           
{'loss': 4.3798, 'learning_rate': 8.873763709625289e-07, 'epoch': 2.01}

 13%|█▎        | 46660/371472 [3:43:38<25:26:00,  3.55it/s]
 13%|█▎        | 46661/371472 [3:43:38<24:53:37,  3.62it/s]
 13%|█▎        | 46662/371472 [3:43:38<25:05:37,  3.60it/s]
 13%|█▎        | 46663/371472 [3:43:38<24:34:07,  3.67it/s]
 13%|█▎        | 46664/371472 [3:43:39<24:27:01,  3.69it/s]
 13%|█▎        | 46665/371472 [3:43:39<26:05:48,  3.46it/s]
 13%|█▎        | 46666/371472 [3:43:39<26:38:33,  3.39it/s]
 13%|█▎        | 46667/371472 [3:43:40<28:14:42,  3.19it/s]
 13%|█▎        | 46668/371472 [3:43:40<28:34:46,  3.16it/s]
 13%|█▎        | 46669/371472 [3:43:40<29:22:05,  3.07it/s]
 13%|█▎        | 46670/371472 [3:43:41<30:38:54,  2.94it/s]
 13%|█▎        | 46671/371472 [3:43:41<31:20:40,  2.88it/s]
 13%|█▎        | 46672/371472 [3:43:42<32:14:19,  2.80it/s]
 13%|█▎        | 46673/371472 [3:43:42<35:17:39,  2.56it/s]
 13%|█▎        | 46674/371472 [3:43:42<33:56:16,  2.66it/s]
 13%|█▎        | 46675/371472 [3:43:43<32:02:03,  2.82it/s]
 13%|█▎        | 46676/371472 [3:43:43<30:35:26,  2.95it/s]
 13%|█▎        | 46677/371472 [3:43:43<29:39:19,  3.04it/s]
 13%|█▎        | 46678/371472 [3:43:43<28:01:04,  3.22it/s]
 13%|█▎        | 46679/371472 [3:43:44<29:03:41,  3.10it/s]
 13%|█▎        | 46680/371472 [3:43:44<28:14:26,  3.19it/s]
                                                           
{'loss': 4.2406, 'learning_rate': 8.873278889870499e-07, 'epoch': 2.01}

 13%|█▎        | 46680/371472 [3:43:44<28:14:26,  3.19it/s]
 13%|█▎        | 46681/371472 [3:43:44<28:42:58,  3.14it/s]
 13%|█▎        | 46682/371472 [3:43:45<27:39:26,  3.26it/s]
 13%|█▎        | 46683/371472 [3:43:45<27:49:28,  3.24it/s]
 13%|█▎        | 46684/371472 [3:43:45<27:33:18,  3.27it/s]
 13%|█▎        | 46685/371472 [3:43:46<25:54:06,  3.48it/s]
 13%|█▎        | 46686/371472 [3:43:46<26:12:41,  3.44it/s]
 13%|█▎        | 46687/371472 [3:43:46<26:02:31,  3.46it/s]
 13%|█▎        | 46688/371472 [3:43:46<26:08:53,  3.45it/s]
 13%|█▎        | 46689/371472 [3:43:47<25:52:56,  3.49it/s]
 13%|█▎        | 46690/371472 [3:43:47<25:12:46,  3.58it/s]
 13%|█▎        | 46691/371472 [3:43:47<25:11:48,  3.58it/s]
 13%|█▎        | 46692/371472 [3:43:48<25:13:47,  3.58it/s]
 13%|█▎        | 46693/371472 [3:43:48<25:12:12,  3.58it/s]
 13%|█▎        | 46694/371472 [3:43:48<25:08:35,  3.59it/s]
 13%|█▎        | 46695/371472 [3:43:48<25:03:03,  3.60it/s]
 13%|█▎        | 46696/371472 [3:43:49<27:18:26,  3.30it/s]
 13%|█▎        | 46697/371472 [3:43:49<26:23:32,  3.42it/s]
 13%|█▎        | 46698/371472 [3:43:49<25:26:36,  3.55it/s]
 13%|█▎        | 46699/371472 [3:43:50<25:49:22,  3.49it/s]
 13%|█▎        | 46700/371472 [3:43:50<27:26:06,  3.29it/s]
                                                           
{'loss': 4.2977, 'learning_rate': 8.87279407011571e-07, 'epoch': 2.01}

 13%|█▎        | 46700/371472 [3:43:50<27:26:06,  3.29it/s]
 13%|█▎        | 46701/371472 [3:43:50<29:00:54,  3.11it/s]
 13%|█▎        | 46702/371472 [3:43:51<27:07:30,  3.33it/s]
 13%|█▎        | 46703/371472 [3:43:51<26:36:08,  3.39it/s]
 13%|█▎        | 46704/371472 [3:43:51<26:14:30,  3.44it/s]
 13%|█▎        | 46705/371472 [3:43:51<25:22:31,  3.56it/s]
 13%|█▎        | 46706/371472 [3:43:52<25:02:17,  3.60it/s]
 13%|█▎        | 46707/371472 [3:43:52<24:32:37,  3.68it/s]
 13%|█▎        | 46708/371472 [3:43:52<23:46:38,  3.79it/s]
 13%|█▎        | 46709/371472 [3:43:52<24:57:48,  3.61it/s]
 13%|█▎        | 46710/371472 [3:43:53<26:47:04,  3.37it/s]
 13%|█▎        | 46711/371472 [3:43:53<27:08:45,  3.32it/s]
 13%|█▎        | 46712/371472 [3:43:53<27:23:58,  3.29it/s]
 13%|█▎        | 46713/371472 [3:43:54<26:03:08,  3.46it/s]
 13%|█▎        | 46714/371472 [3:43:54<27:34:41,  3.27it/s]
 13%|█▎        | 46715/371472 [3:43:54<26:15:01,  3.44it/s]
 13%|█▎        | 46716/371472 [3:43:55<26:22:04,  3.42it/s]
 13%|█▎        | 46717/371472 [3:43:55<26:30:49,  3.40it/s]
 13%|█▎        | 46718/371472 [3:43:55<26:13:47,  3.44it/s]
 13%|█▎        | 46719/371472 [3:43:55<25:54:12,  3.48it/s]
 13%|█▎        | 46720/371472 [3:43:56<25:06:01,  3.59it/s]
                                                           
{'loss': 4.1866, 'learning_rate': 8.872309250360921e-07, 'epoch': 2.01}

 13%|█▎        | 46720/371472 [3:43:56<25:06:01,  3.59it/s]
 13%|█▎        | 46721/371472 [3:43:56<25:35:45,  3.52it/s]
 13%|█▎        | 46722/371472 [3:43:56<29:08:52,  3.09it/s]
 13%|█▎        | 46723/371472 [3:43:57<28:25:33,  3.17it/s]
 13%|█▎        | 46724/371472 [3:43:57<27:00:30,  3.34it/s]
 13%|█▎        | 46725/371472 [3:43:57<28:08:39,  3.21it/s]
 13%|█▎        | 46726/371472 [3:43:58<28:25:51,  3.17it/s]
 13%|█▎        | 46727/371472 [3:43:58<28:10:10,  3.20it/s]
 13%|█▎        | 46728/371472 [3:43:58<29:10:13,  3.09it/s]
 13%|█▎        | 46729/371472 [3:43:59<27:47:06,  3.25it/s]
 13%|█▎        | 46730/371472 [3:43:59<27:09:56,  3.32it/s]
 13%|█▎        | 46731/371472 [3:43:59<27:10:18,  3.32it/s]
 13%|█▎        | 46732/371472 [3:43:59<26:33:17,  3.40it/s]
 13%|█▎        | 46733/371472 [3:44:00<26:22:37,  3.42it/s]
 13%|█▎        | 46734/371472 [3:44:00<25:37:10,  3.52it/s]
 13%|█▎        | 46735/371472 [3:44:00<26:23:07,  3.42it/s]
 13%|█▎        | 46736/371472 [3:44:01<26:20:32,  3.42it/s]
 13%|█▎        | 46737/371472 [3:44:01<25:05:50,  3.59it/s]
 13%|█▎        | 46738/371472 [3:44:01<24:55:38,  3.62it/s]
 13%|█▎        | 46739/371472 [3:44:01<24:59:19,  3.61it/s]
 13%|█▎        | 46740/371472 [3:44:02<25:46:41,  3.50it/s]
                                                           
{'loss': 3.9985, 'learning_rate': 8.871824430606132e-07, 'epoch': 2.01}

 13%|█▎        | 46740/371472 [3:44:02<25:46:41,  3.50it/s]
 13%|█▎        | 46741/371472 [3:44:02<26:32:39,  3.40it/s]
 13%|█▎        | 46742/371472 [3:44:02<25:18:28,  3.56it/s]
 13%|█▎        | 46743/371472 [3:44:02<24:45:48,  3.64it/s]
 13%|█▎        | 46744/371472 [3:44:03<24:22:14,  3.70it/s]
 13%|█▎        | 46745/371472 [3:44:03<25:21:05,  3.56it/s]
 13%|█▎        | 46746/371472 [3:44:03<25:31:28,  3.53it/s]
 13%|█▎        | 46747/371472 [3:44:04<27:53:54,  3.23it/s]
 13%|█▎        | 46748/371472 [3:44:04<26:24:53,  3.41it/s]
 13%|█▎        | 46749/371472 [3:44:04<26:08:59,  3.45it/s]
 13%|█▎        | 46750/371472 [3:44:05<27:02:40,  3.34it/s]
 13%|█▎        | 46751/371472 [3:44:05<26:36:22,  3.39it/s]
 13%|█▎        | 46752/371472 [3:44:05<26:59:36,  3.34it/s]
 13%|█▎        | 46753/371472 [3:44:05<26:02:57,  3.46it/s]
 13%|█▎        | 46754/371472 [3:44:06<25:03:31,  3.60it/s]
 13%|█▎        | 46755/371472 [3:44:06<24:41:37,  3.65it/s]
 13%|█▎        | 46756/371472 [3:44:06<25:00:56,  3.61it/s]
 13%|█▎        | 46757/371472 [3:44:07<26:33:45,  3.40it/s]
 13%|█▎        | 46758/371472 [3:44:07<26:09:02,  3.45it/s]
 13%|█▎        | 46759/371472 [3:44:07<25:38:43,  3.52it/s]
 13%|█▎        | 46760/371472 [3:44:07<24:54:26,  3.62it/s]
                                                           
{'loss': 4.3315, 'learning_rate': 8.871339610851343e-07, 'epoch': 2.01}

 13%|█▎        | 46760/371472 [3:44:07<24:54:26,  3.62it/s]
 13%|█▎        | 46761/371472 [3:44:08<25:18:31,  3.56it/s]
 13%|█▎        | 46762/371472 [3:44:08<25:39:57,  3.51it/s]
 13%|█▎        | 46763/371472 [3:44:08<26:15:18,  3.44it/s]
 13%|█▎        | 46764/371472 [3:44:09<26:28:38,  3.41it/s]
 13%|█▎        | 46765/371472 [3:44:09<26:27:16,  3.41it/s]
 13%|█▎        | 46766/371472 [3:44:09<26:17:10,  3.43it/s]
 13%|█▎        | 46767/371472 [3:44:09<27:06:01,  3.33it/s]
 13%|█▎        | 46768/371472 [3:44:10<25:57:45,  3.47it/s]
 13%|█▎        | 46769/371472 [3:44:10<25:59:13,  3.47it/s]
 13%|█▎        | 46770/371472 [3:44:10<25:04:12,  3.60it/s]
 13%|█▎        | 46771/371472 [3:44:11<27:40:50,  3.26it/s]
 13%|█▎        | 46772/371472 [3:44:11<27:12:08,  3.32it/s]
 13%|█▎        | 46773/371472 [3:44:11<25:37:25,  3.52it/s]
 13%|█▎        | 46774/371472 [3:44:11<26:19:01,  3.43it/s]
 13%|█▎        | 46775/371472 [3:44:12<25:49:14,  3.49it/s]
 13%|█▎        | 46776/371472 [3:44:12<27:20:18,  3.30it/s]
 13%|█▎        | 46777/371472 [3:44:12<26:18:02,  3.43it/s]
 13%|█▎        | 46778/371472 [3:44:13<28:00:31,  3.22it/s]
 13%|█▎        | 46779/371472 [3:44:13<26:28:16,  3.41it/s]
 13%|█▎        | 46780/371472 [3:44:13<25:18:03,  3.56it/s]
                                                           
{'loss': 4.3568, 'learning_rate': 8.870854791096554e-07, 'epoch': 2.01}

 13%|█▎        | 46780/371472 [3:44:13<25:18:03,  3.56it/s]
 13%|█▎        | 46781/371472 [3:44:14<25:03:42,  3.60it/s]
 13%|█▎        | 46782/371472 [3:44:14<30:11:31,  2.99it/s]
 13%|█▎        | 46783/371472 [3:44:14<27:40:07,  3.26it/s]
 13%|█▎        | 46784/371472 [3:44:15<27:19:39,  3.30it/s]
 13%|█▎        | 46785/371472 [3:44:15<26:50:19,  3.36it/s]
 13%|█▎        | 46786/371472 [3:44:15<27:01:33,  3.34it/s]
 13%|█▎        | 46787/371472 [3:44:15<26:23:33,  3.42it/s]
 13%|█▎        | 46788/371472 [3:44:16<26:55:50,  3.35it/s]
 13%|█▎        | 46789/371472 [3:44:16<25:35:55,  3.52it/s]
 13%|█▎        | 46790/371472 [3:44:16<26:04:25,  3.46it/s]
 13%|█▎        | 46791/371472 [3:44:16<25:06:04,  3.59it/s]
 13%|█▎        | 46792/371472 [3:44:17<27:23:52,  3.29it/s]
 13%|█▎        | 46793/371472 [3:44:17<26:42:24,  3.38it/s]
 13%|█▎        | 46794/371472 [3:44:17<25:34:06,  3.53it/s]
 13%|█▎        | 46795/371472 [3:44:18<26:00:45,  3.47it/s]
 13%|█▎        | 46796/371472 [3:44:18<25:14:18,  3.57it/s]
 13%|█▎        | 46797/371472 [3:44:18<25:26:53,  3.54it/s]
 13%|█▎        | 46798/371472 [3:44:19<25:18:32,  3.56it/s]
 13%|█▎        | 46799/371472 [3:44:19<24:42:36,  3.65it/s]
 13%|█▎        | 46800/371472 [3:44:19<24:54:41,  3.62it/s]
                                                           
{'loss': 4.4983, 'learning_rate': 8.870369971341766e-07, 'epoch': 2.02}

 13%|█▎        | 46800/371472 [3:44:19<24:54:41,  3.62it/s]
 13%|█▎        | 46801/371472 [3:44:19<24:53:55,  3.62it/s]
 13%|█▎        | 46802/371472 [3:44:20<25:10:43,  3.58it/s]
 13%|█▎        | 46803/371472 [3:44:20<26:30:16,  3.40it/s]
 13%|█▎        | 46804/371472 [3:44:20<26:32:12,  3.40it/s]
 13%|█▎        | 46805/371472 [3:44:21<28:37:00,  3.15it/s]
 13%|█▎        | 46806/371472 [3:44:21<27:05:39,  3.33it/s]
 13%|█▎        | 46807/371472 [3:44:21<26:21:07,  3.42it/s]
 13%|█▎        | 46808/371472 [3:44:21<26:18:04,  3.43it/s]
 13%|█▎        | 46809/371472 [3:44:22<27:42:18,  3.26it/s]
 13%|█▎        | 46810/371472 [3:44:22<27:21:54,  3.30it/s]
 13%|█▎        | 46811/371472 [3:44:22<27:21:33,  3.30it/s]
 13%|█▎        | 46812/371472 [3:44:23<27:19:06,  3.30it/s]
 13%|█▎        | 46813/371472 [3:44:23<26:19:10,  3.43it/s]
 13%|█▎        | 46814/371472 [3:44:23<25:34:28,  3.53it/s]
 13%|█▎        | 46815/371472 [3:44:24<26:08:49,  3.45it/s]
 13%|█▎        | 46816/371472 [3:44:24<26:13:06,  3.44it/s]
 13%|█▎        | 46817/371472 [3:44:24<28:00:29,  3.22it/s]
 13%|█▎        | 46818/371472 [3:44:24<26:43:18,  3.37it/s]
 13%|█▎        | 46819/371472 [3:44:25<30:15:26,  2.98it/s]
 13%|█▎        | 46820/371472 [3:44:25<28:41:04,  3.14it/s]
                                                           
{'loss': 4.3196, 'learning_rate': 8.869885151586976e-07, 'epoch': 2.02}

 13%|█▎        | 46820/371472 [3:44:25<28:41:04,  3.14it/s]
 13%|█▎        | 46821/371472 [3:44:25<27:28:53,  3.28it/s]
 13%|█▎        | 46822/371472 [3:44:26<27:21:40,  3.30it/s]
 13%|█▎        | 46823/371472 [3:44:26<26:07:33,  3.45it/s]
 13%|█▎        | 46824/371472 [3:44:26<27:17:57,  3.30it/s]
 13%|█▎        | 46825/371472 [3:44:27<28:38:00,  3.15it/s]
 13%|█▎        | 46826/371472 [3:44:27<30:53:34,  2.92it/s]
 13%|█▎        | 46827/371472 [3:44:27<31:40:57,  2.85it/s]
 13%|█▎        | 46828/371472 [3:44:28<30:11:08,  2.99it/s]
 13%|█▎        | 46829/371472 [3:44:28<29:52:07,  3.02it/s]
 13%|█▎        | 46830/371472 [3:44:28<29:08:12,  3.10it/s]
 13%|█▎        | 46831/371472 [3:44:29<28:05:29,  3.21it/s]
 13%|█▎        | 46832/371472 [3:44:29<27:35:33,  3.27it/s]
 13%|█▎        | 46833/371472 [3:44:29<27:20:32,  3.30it/s]
 13%|█▎        | 46834/371472 [3:44:30<26:58:06,  3.34it/s]
 13%|█▎        | 46835/371472 [3:44:30<26:12:32,  3.44it/s]
 13%|█▎        | 46836/371472 [3:44:30<26:48:21,  3.36it/s]
 13%|█▎        | 46837/371472 [3:44:30<27:18:27,  3.30it/s]
 13%|█▎        | 46838/371472 [3:44:31<26:40:59,  3.38it/s]
 13%|█▎        | 46839/371472 [3:44:31<26:14:33,  3.44it/s]
 13%|█▎        | 46840/371472 [3:44:31<26:30:01,  3.40it/s]
                                                           
{'loss': 4.3064, 'learning_rate': 8.869400331832187e-07, 'epoch': 2.02}

 13%|█▎        | 46840/371472 [3:44:31<26:30:01,  3.40it/s]
 13%|█▎        | 46841/371472 [3:44:32<26:52:43,  3.35it/s]
 13%|█▎        | 46842/371472 [3:44:32<27:09:13,  3.32it/s]
 13%|█▎        | 46843/371472 [3:44:32<27:23:44,  3.29it/s]
 13%|█▎        | 46844/371472 [3:44:32<26:45:04,  3.37it/s]
 13%|█▎        | 46845/371472 [3:44:33<25:32:31,  3.53it/s]
 13%|█▎        | 46846/371472 [3:44:33<24:22:03,  3.70it/s]
 13%|█▎        | 46847/371472 [3:44:33<26:08:55,  3.45it/s]
 13%|█▎        | 46848/371472 [3:44:34<27:07:05,  3.33it/s]
 13%|█▎        | 46849/371472 [3:44:34<25:36:00,  3.52it/s]
 13%|█▎        | 46850/371472 [3:44:34<25:20:16,  3.56it/s]
 13%|█▎        | 46851/371472 [3:44:34<25:04:49,  3.60it/s]
 13%|█▎        | 46852/371472 [3:44:35<24:37:23,  3.66it/s]
 13%|█▎        | 46853/371472 [3:44:35<24:33:11,  3.67it/s]
 13%|█▎        | 46854/371472 [3:44:35<24:10:55,  3.73it/s]
 13%|█▎        | 46855/371472 [3:44:35<24:47:06,  3.64it/s]
 13%|█▎        | 46856/371472 [3:44:36<25:01:27,  3.60it/s]
 13%|█▎        | 46857/371472 [3:44:36<25:52:07,  3.49it/s]
 13%|█▎        | 46858/371472 [3:44:36<27:20:11,  3.30it/s]
 13%|█▎        | 46859/371472 [3:44:37<27:16:54,  3.31it/s]
 13%|█▎        | 46860/371472 [3:44:37<28:14:42,  3.19it/s]
                                                           
{'loss': 4.2872, 'learning_rate': 8.868915512077398e-07, 'epoch': 2.02}

 13%|█▎        | 46860/371472 [3:44:37<28:14:42,  3.19it/s]
 13%|█▎        | 46861/371472 [3:44:37<29:00:49,  3.11it/s]
 13%|█▎        | 46862/371472 [3:44:38<30:21:54,  2.97it/s]
 13%|█▎        | 46863/371472 [3:44:38<28:32:14,  3.16it/s]
 13%|█▎        | 46864/371472 [3:44:38<26:54:47,  3.35it/s]
 13%|█▎        | 46865/371472 [3:44:39<27:31:33,  3.28it/s]
 13%|█▎        | 46866/371472 [3:44:39<27:36:52,  3.27it/s]
 13%|█▎        | 46867/371472 [3:44:39<27:10:35,  3.32it/s]
 13%|█▎        | 46868/371472 [3:44:40<28:04:37,  3.21it/s]
 13%|█▎        | 46869/371472 [3:44:40<27:14:40,  3.31it/s]
 13%|█▎        | 46870/371472 [3:44:40<26:01:39,  3.46it/s]
 13%|█▎        | 46871/371472 [3:44:40<25:18:12,  3.56it/s]
 13%|█▎        | 46872/371472 [3:44:41<25:28:12,  3.54it/s]
 13%|█▎        | 46873/371472 [3:44:41<25:41:58,  3.51it/s]
 13%|█▎        | 46874/371472 [3:44:41<26:42:23,  3.38it/s]
 13%|█▎        | 46875/371472 [3:44:42<26:45:45,  3.37it/s]
 13%|█▎        | 46876/371472 [3:44:42<27:37:06,  3.26it/s]
 13%|█▎        | 46877/371472 [3:44:42<26:38:28,  3.38it/s]
 13%|█▎        | 46878/371472 [3:44:42<26:46:04,  3.37it/s]
 13%|█▎        | 46879/371472 [3:44:43<25:49:09,  3.49it/s]
 13%|█▎        | 46880/371472 [3:44:43<25:46:13,  3.50it/s]
                                                           
{'loss': 4.3508, 'learning_rate': 8.86843069232261e-07, 'epoch': 2.02}

 13%|█▎        | 46880/371472 [3:44:43<25:46:13,  3.50it/s]
 13%|█▎        | 46881/371472 [3:44:43<26:25:06,  3.41it/s]
 13%|█▎        | 46882/371472 [3:44:44<26:19:37,  3.42it/s]
 13%|█▎        | 46883/371472 [3:44:44<26:19:35,  3.42it/s]
 13%|█▎        | 46884/371472 [3:44:44<26:19:00,  3.43it/s]
 13%|█▎        | 46885/371472 [3:44:44<25:42:02,  3.51it/s]
 13%|█▎        | 46886/371472 [3:44:45<26:04:16,  3.46it/s]
 13%|█▎        | 46887/371472 [3:44:45<25:24:58,  3.55it/s]
 13%|█▎        | 46888/371472 [3:44:45<26:36:32,  3.39it/s]
 13%|█▎        | 46889/371472 [3:44:46<26:48:30,  3.36it/s]
 13%|█▎        | 46890/371472 [3:44:46<29:14:45,  3.08it/s]
 13%|█▎        | 46891/371472 [3:44:46<27:58:30,  3.22it/s]
 13%|█▎        | 46892/371472 [3:44:47<27:52:49,  3.23it/s]
 13%|█▎        | 46893/371472 [3:44:47<27:49:41,  3.24it/s]
 13%|█▎        | 46894/371472 [3:44:47<27:51:37,  3.24it/s]
 13%|█▎        | 46895/371472 [3:44:48<27:30:22,  3.28it/s]
 13%|█▎        | 46896/371472 [3:44:48<27:08:50,  3.32it/s]
 13%|█▎        | 46897/371472 [3:44:48<26:17:01,  3.43it/s]
 13%|█▎        | 46898/371472 [3:44:48<26:03:50,  3.46it/s]
 13%|█▎        | 46899/371472 [3:44:49<27:00:05,  3.34it/s]
 13%|█▎        | 46900/371472 [3:44:49<27:50:40,  3.24it/s]
                                                           
{'loss': 4.3117, 'learning_rate': 8.86794587256782e-07, 'epoch': 2.02}

 13%|█▎        | 46900/371472 [3:44:49<27:50:40,  3.24it/s]
 13%|█▎        | 46901/371472 [3:44:49<26:19:44,  3.42it/s]
 13%|█▎        | 46902/371472 [3:44:50<26:09:57,  3.45it/s]
 13%|█▎        | 46903/371472 [3:44:50<26:05:14,  3.46it/s]
 13%|█▎        | 46904/371472 [3:44:50<26:15:48,  3.43it/s]
 13%|█▎        | 46905/371472 [3:44:50<26:29:40,  3.40it/s]
 13%|█▎        | 46906/371472 [3:44:51<26:46:03,  3.37it/s]
 13%|█▎        | 46907/371472 [3:44:51<26:41:45,  3.38it/s]
 13%|█▎        | 46908/371472 [3:44:51<27:02:39,  3.33it/s]
 13%|█▎        | 46909/371472 [3:44:52<25:30:32,  3.53it/s]
 13%|█▎        | 46910/371472 [3:44:52<25:16:06,  3.57it/s]
 13%|█▎        | 46911/371472 [3:44:52<24:41:32,  3.65it/s]
 13%|█▎        | 46912/371472 [3:44:52<24:01:38,  3.75it/s]
 13%|█▎        | 46913/371472 [3:44:53<23:44:52,  3.80it/s]
 13%|█▎        | 46914/371472 [3:44:53<24:25:50,  3.69it/s]
 13%|█▎        | 46915/371472 [3:44:53<26:58:01,  3.34it/s]
 13%|█▎        | 46916/371472 [3:44:54<27:30:31,  3.28it/s]
 13%|█▎        | 46917/371472 [3:44:54<26:08:13,  3.45it/s]
 13%|█▎        | 46918/371472 [3:44:54<24:36:19,  3.66it/s]
 13%|█▎        | 46919/371472 [3:44:54<26:15:58,  3.43it/s]
 13%|█▎        | 46920/371472 [3:44:55<25:51:26,  3.49it/s]
                                                           
{'loss': 4.3204, 'learning_rate': 8.867461052813032e-07, 'epoch': 2.02}

 13%|█▎        | 46920/371472 [3:44:55<25:51:26,  3.49it/s]
 13%|█▎        | 46921/371472 [3:44:55<25:50:26,  3.49it/s]
 13%|█▎        | 46922/371472 [3:44:55<26:28:00,  3.41it/s]
 13%|█▎        | 46923/371472 [3:44:56<26:18:15,  3.43it/s]
 13%|█▎        | 46924/371472 [3:44:56<25:19:38,  3.56it/s]
 13%|█▎        | 46925/371472 [3:44:56<24:57:25,  3.61it/s]
 13%|█▎        | 46926/371472 [3:44:56<24:05:22,  3.74it/s]
 13%|█▎        | 46927/371472 [3:44:57<24:14:27,  3.72it/s]
 13%|█▎        | 46928/371472 [3:44:57<26:02:17,  3.46it/s]
 13%|█▎        | 46929/371472 [3:44:57<25:32:07,  3.53it/s]
 13%|█▎        | 46930/371472 [3:44:58<26:30:59,  3.40it/s]
 13%|█▎        | 46931/371472 [3:44:58<25:33:53,  3.53it/s]
 13%|█▎        | 46932/371472 [3:44:58<24:59:46,  3.61it/s]
 13%|█▎        | 46933/371472 [3:44:58<27:23:47,  3.29it/s]
 13%|█▎        | 46934/371472 [3:44:59<27:19:46,  3.30it/s]
 13%|█▎        | 46935/371472 [3:44:59<26:04:11,  3.46it/s]
 13%|█▎        | 46936/371472 [3:44:59<25:43:41,  3.50it/s]
 13%|█▎        | 46937/371472 [3:45:00<25:53:39,  3.48it/s]
 13%|█▎        | 46938/371472 [3:45:00<25:00:13,  3.61it/s]
 13%|█▎        | 46939/371472 [3:45:00<25:15:03,  3.57it/s]
 13%|█▎        | 46940/371472 [3:45:00<25:40:51,  3.51it/s]
                                                           
{'loss': 4.2796, 'learning_rate': 8.866976233058243e-07, 'epoch': 2.02}

 13%|█▎        | 46940/371472 [3:45:00<25:40:51,  3.51it/s]
 13%|█▎        | 46941/371472 [3:45:01<26:03:56,  3.46it/s]
 13%|█▎        | 46942/371472 [3:45:01<25:28:50,  3.54it/s]
 13%|█▎        | 46943/371472 [3:45:01<27:49:22,  3.24it/s]
 13%|█▎        | 46944/371472 [3:45:02<27:49:40,  3.24it/s]
 13%|█▎        | 46945/371472 [3:45:02<27:31:58,  3.27it/s]
 13%|█▎        | 46946/371472 [3:45:02<27:08:03,  3.32it/s]
 13%|█▎        | 46947/371472 [3:45:03<27:06:58,  3.32it/s]
 13%|█▎        | 46948/371472 [3:45:03<27:30:26,  3.28it/s]
 13%|█▎        | 46949/371472 [3:45:03<26:21:37,  3.42it/s]
 13%|█▎        | 46950/371472 [3:45:03<26:28:27,  3.40it/s]
 13%|█▎        | 46951/371472 [3:45:04<25:14:48,  3.57it/s]
 13%|█▎        | 46952/371472 [3:45:04<25:05:57,  3.59it/s]
 13%|█▎        | 46953/371472 [3:45:04<25:57:52,  3.47it/s]
 13%|█▎        | 46954/371472 [3:45:05<26:59:38,  3.34it/s]
 13%|█▎        | 46955/371472 [3:45:05<25:48:36,  3.49it/s]
 13%|█▎        | 46956/371472 [3:45:05<26:05:59,  3.45it/s]
 13%|█▎        | 46957/371472 [3:45:05<26:01:13,  3.46it/s]
 13%|█▎        | 46958/371472 [3:45:06<26:45:46,  3.37it/s]
 13%|█▎        | 46959/371472 [3:45:06<25:49:15,  3.49it/s]
 13%|█▎        | 46960/371472 [3:45:06<25:11:28,  3.58it/s]
                                                           
{'loss': 4.3953, 'learning_rate': 8.866491413303454e-07, 'epoch': 2.02}

 13%|█▎        | 46960/371472 [3:45:06<25:11:28,  3.58it/s]
 13%|█▎        | 46961/371472 [3:45:07<25:05:37,  3.59it/s]
 13%|█▎        | 46962/371472 [3:45:07<24:44:27,  3.64it/s]
 13%|█▎        | 46963/371472 [3:45:07<25:11:53,  3.58it/s]
 13%|█▎        | 46964/371472 [3:45:07<24:40:50,  3.65it/s]
 13%|█▎        | 46965/371472 [3:45:08<24:55:53,  3.62it/s]
 13%|█▎        | 46966/371472 [3:45:08<25:08:18,  3.59it/s]
 13%|█▎        | 46967/371472 [3:45:08<25:58:09,  3.47it/s]
 13%|█▎        | 46968/371472 [3:45:08<24:38:17,  3.66it/s]
 13%|█▎        | 46969/371472 [3:45:09<27:07:17,  3.32it/s]
 13%|█▎        | 46970/371472 [3:45:09<27:47:21,  3.24it/s]
 13%|█▎        | 46971/371472 [3:45:09<28:30:39,  3.16it/s]
 13%|█▎        | 46972/371472 [3:45:10<26:54:56,  3.35it/s]
 13%|█▎        | 46973/371472 [3:45:10<27:26:23,  3.28it/s]
 13%|█▎        | 46974/371472 [3:45:10<27:36:38,  3.26it/s]
 13%|█▎        | 46975/371472 [3:45:11<26:11:43,  3.44it/s]
 13%|█▎        | 46976/371472 [3:45:11<25:34:11,  3.53it/s]
 13%|█▎        | 46977/371472 [3:45:11<24:50:13,  3.63it/s]
 13%|█▎        | 46978/371472 [3:45:11<24:55:01,  3.62it/s]
 13%|█▎        | 46979/371472 [3:45:12<25:28:00,  3.54it/s]
 13%|█▎        | 46980/371472 [3:45:12<25:09:08,  3.58it/s]
                                                           
{'loss': 4.3401, 'learning_rate': 8.866006593548664e-07, 'epoch': 2.02}

 13%|█▎        | 46980/371472 [3:45:12<25:09:08,  3.58it/s]
 13%|█▎        | 46981/371472 [3:45:12<24:39:59,  3.65it/s]
 13%|█▎        | 46982/371472 [3:45:13<24:22:39,  3.70it/s]
 13%|█▎        | 46983/371472 [3:45:13<23:58:39,  3.76it/s]
 13%|█▎        | 46984/371472 [3:45:13<25:03:21,  3.60it/s]
 13%|█▎        | 46985/371472 [3:45:13<24:51:21,  3.63it/s]
 13%|█▎        | 46986/371472 [3:45:14<25:53:30,  3.48it/s]
 13%|█▎        | 46987/371472 [3:45:14<27:02:46,  3.33it/s]
 13%|█▎        | 46988/371472 [3:45:14<26:57:27,  3.34it/s]
 13%|█▎        | 46989/371472 [3:45:15<30:02:47,  3.00it/s]
 13%|█▎        | 46990/371472 [3:45:15<28:18:09,  3.18it/s]
 13%|█▎        | 46991/371472 [3:45:15<27:51:51,  3.23it/s]
 13%|█▎        | 46992/371472 [3:45:16<26:24:14,  3.41it/s]
 13%|█▎        | 46993/371472 [3:45:16<25:41:52,  3.51it/s]
 13%|█▎        | 46994/371472 [3:45:16<25:15:33,  3.57it/s]
 13%|█▎        | 46995/371472 [3:45:16<24:13:38,  3.72it/s]
 13%|█▎        | 46996/371472 [3:45:17<24:18:13,  3.71it/s]
 13%|█▎        | 46997/371472 [3:45:17<26:32:13,  3.40it/s]
 13%|█▎        | 46998/371472 [3:45:17<25:59:23,  3.47it/s]
 13%|█▎        | 46999/371472 [3:45:18<27:34:12,  3.27it/s]
 13%|█▎        | 47000/371472 [3:45:18<26:33:02,  3.39it/s]
                                                           
{'loss': 4.4807, 'learning_rate': 8.865521773793875e-07, 'epoch': 2.02}

 13%|█▎        | 47000/371472 [3:45:18<26:33:02,  3.39it/s]
 13%|█▎        | 47001/371472 [3:45:18<26:00:26,  3.47it/s]
 13%|█▎        | 47002/371472 [3:45:18<26:16:54,  3.43it/s]
 13%|█▎        | 47003/371472 [3:45:19<26:18:54,  3.43it/s]
 13%|█▎        | 47004/371472 [3:45:19<27:24:06,  3.29it/s]
 13%|█▎        | 47005/371472 [3:45:19<25:33:21,  3.53it/s]
 13%|█▎        | 47006/371472 [3:45:20<24:27:38,  3.68it/s]
 13%|█▎        | 47007/371472 [3:45:20<25:39:53,  3.51it/s]
 13%|█▎        | 47008/371472 [3:45:20<26:05:42,  3.45it/s]
 13%|█▎        | 47009/371472 [3:45:20<26:13:58,  3.44it/s]
 13%|█▎        | 47010/371472 [3:45:21<26:29:40,  3.40it/s]
 13%|█▎        | 47011/371472 [3:45:21<26:07:15,  3.45it/s]
 13%|█▎        | 47012/371472 [3:45:21<26:46:23,  3.37it/s]
 13%|█▎        | 47013/371472 [3:45:22<25:24:36,  3.55it/s]
 13%|█▎        | 47014/371472 [3:45:22<25:09:43,  3.58it/s]
 13%|█▎        | 47015/371472 [3:45:22<23:56:27,  3.76it/s]
 13%|█▎        | 47016/371472 [3:45:22<23:29:19,  3.84it/s]
 13%|█▎        | 47017/371472 [3:45:23<24:09:17,  3.73it/s]
 13%|█▎        | 47018/371472 [3:45:23<23:41:17,  3.80it/s]
 13%|█▎        | 47019/371472 [3:45:23<23:41:02,  3.81it/s]
 13%|█▎        | 47020/371472 [3:45:23<24:24:04,  3.69it/s]
                                                           
{'loss': 4.2138, 'learning_rate': 8.865036954039087e-07, 'epoch': 2.03}

 13%|█▎        | 47020/371472 [3:45:23<24:24:04,  3.69it/s]
 13%|█▎        | 47021/371472 [3:45:24<25:25:22,  3.55it/s]
 13%|█▎        | 47022/371472 [3:45:24<25:10:39,  3.58it/s]
 13%|█▎        | 47023/371472 [3:45:24<25:10:34,  3.58it/s]
 13%|█▎        | 47024/371472 [3:45:25<24:47:13,  3.64it/s]
 13%|█▎        | 47025/371472 [3:45:25<24:44:35,  3.64it/s]
 13%|█▎        | 47026/371472 [3:45:25<27:55:30,  3.23it/s]
 13%|█▎        | 47027/371472 [3:45:26<29:45:32,  3.03it/s]
 13%|█▎        | 47028/371472 [3:45:26<30:21:02,  2.97it/s]
 13%|█▎        | 47029/371472 [3:45:26<28:24:51,  3.17it/s]
 13%|█▎        | 47030/371472 [3:45:26<27:26:20,  3.28it/s]
 13%|█▎        | 47031/371472 [3:45:27<28:51:18,  3.12it/s]
 13%|█▎        | 47032/371472 [3:45:27<27:28:16,  3.28it/s]
 13%|█▎        | 47033/371472 [3:45:27<26:32:57,  3.39it/s]
 13%|█▎        | 47034/371472 [3:45:28<26:18:23,  3.43it/s]
 13%|█▎        | 47035/371472 [3:45:28<25:14:30,  3.57it/s]
 13%|█▎        | 47036/371472 [3:45:28<25:39:24,  3.51it/s]
 13%|█▎        | 47037/371472 [3:45:29<26:22:21,  3.42it/s]
 13%|█▎        | 47038/371472 [3:45:29<27:16:42,  3.30it/s]
 13%|█▎        | 47039/371472 [3:45:29<26:07:08,  3.45it/s]
 13%|█▎        | 47040/371472 [3:45:29<25:31:13,  3.53it/s]
                                                           
{'loss': 4.2883, 'learning_rate': 8.864552134284299e-07, 'epoch': 2.03}

 13%|█▎        | 47040/371472 [3:45:29<25:31:13,  3.53it/s]
 13%|█▎        | 47041/371472 [3:45:30<27:05:37,  3.33it/s]
 13%|█▎        | 47042/371472 [3:45:30<27:24:28,  3.29it/s]
 13%|█▎        | 47043/371472 [3:45:30<26:27:26,  3.41it/s]
 13%|█▎        | 47044/371472 [3:45:31<26:22:26,  3.42it/s]
 13%|█▎        | 47045/371472 [3:45:31<26:41:13,  3.38it/s]
 13%|█▎        | 47046/371472 [3:45:31<25:51:15,  3.49it/s]
 13%|█▎        | 47047/371472 [3:45:31<26:06:46,  3.45it/s]
 13%|█▎        | 47048/371472 [3:45:32<27:20:04,  3.30it/s]
 13%|█▎        | 47049/371472 [3:45:32<28:05:02,  3.21it/s]
 13%|█▎        | 47050/371472 [3:45:32<28:06:45,  3.21it/s]
 13%|█▎        | 47051/371472 [3:45:33<28:01:32,  3.22it/s]
 13%|█▎        | 47052/371472 [3:45:33<29:36:42,  3.04it/s]
 13%|█▎        | 47053/371472 [3:45:33<28:34:45,  3.15it/s]
 13%|█▎        | 47054/371472 [3:45:34<27:13:25,  3.31it/s]
 13%|█▎        | 47055/371472 [3:45:34<25:39:07,  3.51it/s]
 13%|█▎        | 47056/371472 [3:45:34<24:56:26,  3.61it/s]
 13%|█▎        | 47057/371472 [3:45:34<25:23:33,  3.55it/s]
 13%|█▎        | 47058/371472 [3:45:35<25:03:14,  3.60it/s]
 13%|█▎        | 47059/371472 [3:45:35<26:25:00,  3.41it/s]
 13%|█▎        | 47060/371472 [3:45:35<26:31:04,  3.40it/s]
                                                           
{'loss': 4.353, 'learning_rate': 8.864067314529509e-07, 'epoch': 2.03}

 13%|█▎        | 47060/371472 [3:45:35<26:31:04,  3.40it/s]
 13%|█▎        | 47061/371472 [3:45:36<25:38:12,  3.52it/s]
 13%|█▎        | 47062/371472 [3:45:36<24:48:21,  3.63it/s]
 13%|█▎        | 47063/371472 [3:45:36<23:56:22,  3.76it/s]
 13%|█▎        | 47064/371472 [3:45:36<25:49:03,  3.49it/s]
 13%|█▎        | 47065/371472 [3:45:37<24:30:42,  3.68it/s]
 13%|█▎        | 47066/371472 [3:45:37<25:06:46,  3.59it/s]
 13%|█▎        | 47067/371472 [3:45:37<26:59:04,  3.34it/s]
 13%|█▎        | 47068/371472 [3:45:38<26:23:51,  3.41it/s]
 13%|█▎        | 47069/371472 [3:45:38<25:03:22,  3.60it/s]
 13%|█▎        | 47070/371472 [3:45:38<24:30:25,  3.68it/s]
 13%|█▎        | 47071/371472 [3:45:38<24:18:10,  3.71it/s]
 13%|█▎        | 47072/371472 [3:45:39<23:24:41,  3.85it/s]
 13%|█▎        | 47073/371472 [3:45:39<23:49:04,  3.78it/s]
 13%|█▎        | 47074/371472 [3:45:39<23:29:55,  3.83it/s]
 13%|█▎        | 47075/371472 [3:45:39<25:25:50,  3.54it/s]
 13%|█▎        | 47076/371472 [3:45:40<24:25:08,  3.69it/s]
 13%|█▎        | 47077/371472 [3:45:40<25:45:08,  3.50it/s]
 13%|█▎        | 47078/371472 [3:45:40<24:53:42,  3.62it/s]
 13%|█▎        | 47079/371472 [3:45:41<24:14:16,  3.72it/s]
 13%|█▎        | 47080/371472 [3:45:41<24:05:20,  3.74it/s]
                                                           
{'loss': 4.291, 'learning_rate': 8.86358249477472e-07, 'epoch': 2.03}

 13%|█▎        | 47080/371472 [3:45:41<24:05:20,  3.74it/s]
 13%|█▎        | 47081/371472 [3:45:41<23:35:48,  3.82it/s]
 13%|█▎        | 47082/371472 [3:45:41<23:31:11,  3.83it/s]
 13%|█▎        | 47083/371472 [3:45:42<22:59:01,  3.92it/s]
 13%|█▎        | 47084/371472 [3:45:42<23:21:39,  3.86it/s]
 13%|█▎        | 47085/371472 [3:45:42<23:59:56,  3.75it/s]
 13%|█▎        | 47086/371472 [3:45:42<22:54:22,  3.93it/s]
 13%|█▎        | 47087/371472 [3:45:43<23:33:05,  3.83it/s]
 13%|█▎        | 47088/371472 [3:45:43<23:02:52,  3.91it/s]
 13%|█▎        | 47089/371472 [3:45:43<24:05:59,  3.74it/s]
 13%|█▎        | 47090/371472 [3:45:43<24:15:56,  3.71it/s]
 13%|█▎        | 47091/371472 [3:45:44<25:51:07,  3.49it/s]
 13%|█▎        | 47092/371472 [3:45:44<25:54:06,  3.48it/s]
 13%|█▎        | 47093/371472 [3:45:44<25:06:21,  3.59it/s]
 13%|█▎        | 47094/371472 [3:45:45<25:19:44,  3.56it/s]
 13%|█▎        | 47095/371472 [3:45:45<27:54:32,  3.23it/s]
 13%|█▎        | 47096/371472 [3:45:45<26:57:06,  3.34it/s]
 13%|█▎        | 47097/371472 [3:45:45<25:42:17,  3.51it/s]
 13%|█▎        | 47098/371472 [3:45:46<25:48:05,  3.49it/s]
 13%|█▎        | 47099/371472 [3:45:46<26:38:39,  3.38it/s]
 13%|█▎        | 47100/371472 [3:45:46<24:54:15,  3.62it/s]
                                                           
{'loss': 4.2781, 'learning_rate': 8.863097675019931e-07, 'epoch': 2.03}

 13%|█▎        | 47100/371472 [3:45:46<24:54:15,  3.62it/s]
 13%|█▎        | 47101/371472 [3:45:47<24:05:19,  3.74it/s]
 13%|█▎        | 47102/371472 [3:45:47<25:10:43,  3.58it/s]
 13%|█▎        | 47103/371472 [3:45:47<24:59:40,  3.60it/s]
 13%|█▎        | 47104/371472 [3:45:47<24:36:41,  3.66it/s]
 13%|█▎        | 47105/371472 [3:45:48<24:00:39,  3.75it/s]
 13%|█▎        | 47106/371472 [3:45:48<24:08:54,  3.73it/s]
 13%|█▎        | 47107/371472 [3:45:48<25:06:25,  3.59it/s]
 13%|█▎        | 47108/371472 [3:45:48<24:54:45,  3.62it/s]
 13%|█▎        | 47109/371472 [3:45:49<24:20:16,  3.70it/s]
 13%|█▎        | 47110/371472 [3:45:49<25:34:52,  3.52it/s]
 13%|█▎        | 47111/371472 [3:45:49<24:41:00,  3.65it/s]
 13%|█▎        | 47112/371472 [3:45:50<23:57:49,  3.76it/s]
 13%|█▎        | 47113/371472 [3:45:50<23:30:08,  3.83it/s]
 13%|█▎        | 47114/371472 [3:45:50<23:30:25,  3.83it/s]
 13%|█▎        | 47115/371472 [3:45:50<26:11:16,  3.44it/s]
 13%|█▎        | 47116/371472 [3:45:51<29:09:42,  3.09it/s]
 13%|█▎        | 47117/371472 [3:45:51<28:32:12,  3.16it/s]
 13%|█▎        | 47118/371472 [3:45:51<27:01:34,  3.33it/s]
 13%|█▎        | 47119/371472 [3:45:52<26:45:07,  3.37it/s]
 13%|█▎        | 47120/371472 [3:45:52<25:49:52,  3.49it/s]
                                                           
{'loss': 4.2815, 'learning_rate': 8.862612855265142e-07, 'epoch': 2.03}

 13%|█▎        | 47120/371472 [3:45:52<25:49:52,  3.49it/s]
 13%|█▎        | 47121/371472 [3:45:52<25:36:43,  3.52it/s]
 13%|█▎        | 47122/371472 [3:45:53<25:25:07,  3.54it/s]
 13%|█▎        | 47123/371472 [3:45:53<25:23:55,  3.55it/s]
 13%|█▎        | 47124/371472 [3:45:53<25:53:52,  3.48it/s]
 13%|█▎        | 47125/371472 [3:45:53<24:54:37,  3.62it/s]
 13%|█▎        | 47126/371472 [3:45:54<24:27:25,  3.68it/s]
 13%|█▎        | 47127/371472 [3:45:54<24:10:32,  3.73it/s]
 13%|█▎        | 47128/371472 [3:45:54<25:04:19,  3.59it/s]
 13%|█▎        | 47129/371472 [3:45:54<24:39:02,  3.65it/s]
 13%|█▎        | 47130/371472 [3:45:55<24:19:37,  3.70it/s]
 13%|█▎        | 47131/371472 [3:45:55<23:45:48,  3.79it/s]
 13%|█▎        | 47132/371472 [3:45:55<24:46:21,  3.64it/s]
 13%|█▎        | 47133/371472 [3:45:55<24:10:26,  3.73it/s]
 13%|█▎        | 47134/371472 [3:45:56<23:34:02,  3.82it/s]
 13%|█▎        | 47135/371472 [3:45:56<24:59:52,  3.60it/s]
 13%|█▎        | 47136/371472 [3:45:56<26:19:46,  3.42it/s]
 13%|█▎        | 47137/371472 [3:45:57<25:30:42,  3.53it/s]
 13%|█▎        | 47138/371472 [3:45:57<24:43:19,  3.64it/s]
 13%|█▎        | 47139/371472 [3:45:57<24:16:42,  3.71it/s]
 13%|█▎        | 47140/371472 [3:45:57<23:47:36,  3.79it/s]
                                                           
{'loss': 4.1737, 'learning_rate': 8.862128035510353e-07, 'epoch': 2.03}

 13%|█▎        | 47140/371472 [3:45:57<23:47:36,  3.79it/s]
 13%|█▎        | 47141/371472 [3:45:58<24:28:27,  3.68it/s]
 13%|█▎        | 47142/371472 [3:45:58<26:30:16,  3.40it/s]
 13%|█▎        | 47143/371472 [3:45:58<27:17:11,  3.30it/s]
 13%|█▎        | 47144/371472 [3:45:59<26:23:53,  3.41it/s]
 13%|█▎        | 47145/371472 [3:45:59<25:19:53,  3.56it/s]
 13%|█▎        | 47146/371472 [3:45:59<28:59:03,  3.11it/s]
 13%|█▎        | 47147/371472 [3:46:00<28:54:39,  3.12it/s]
 13%|█▎        | 47148/371472 [3:46:00<27:21:53,  3.29it/s]
 13%|█▎        | 47149/371472 [3:46:00<29:00:03,  3.11it/s]
 13%|█▎        | 47150/371472 [3:46:01<28:27:01,  3.17it/s]
 13%|█▎        | 47151/371472 [3:46:01<27:18:46,  3.30it/s]
 13%|█▎        | 47152/371472 [3:46:01<27:02:11,  3.33it/s]
 13%|█▎        | 47153/371472 [3:46:01<26:20:08,  3.42it/s]
 13%|█▎        | 47154/371472 [3:46:02<27:24:01,  3.29it/s]
 13%|█▎        | 47155/371472 [3:46:02<29:45:56,  3.03it/s]
 13%|█▎        | 47156/371472 [3:46:02<28:26:07,  3.17it/s]
 13%|█▎        | 47157/371472 [3:46:03<27:03:54,  3.33it/s]
 13%|█▎        | 47158/371472 [3:46:03<26:46:57,  3.36it/s]
 13%|█▎        | 47159/371472 [3:46:03<26:29:30,  3.40it/s]
 13%|█▎        | 47160/371472 [3:46:03<25:18:07,  3.56it/s]
                                                           
{'loss': 4.1671, 'learning_rate': 8.861643215755564e-07, 'epoch': 2.03}

 13%|█▎        | 47160/371472 [3:46:03<25:18:07,  3.56it/s]
 13%|█▎        | 47161/371472 [3:46:04<25:49:46,  3.49it/s]
 13%|█▎        | 47162/371472 [3:46:04<25:40:39,  3.51it/s]
 13%|█▎        | 47163/371472 [3:46:04<25:28:19,  3.54it/s]
 13%|█▎        | 47164/371472 [3:46:05<25:29:05,  3.53it/s]
 13%|█▎        | 47165/371472 [3:46:05<24:59:33,  3.60it/s]
 13%|█▎        | 47166/371472 [3:46:05<24:38:59,  3.65it/s]
 13%|█▎        | 47167/371472 [3:46:05<24:04:34,  3.74it/s]
 13%|█▎        | 47168/371472 [3:46:06<23:45:07,  3.79it/s]
 13%|█▎        | 47169/371472 [3:46:06<23:05:31,  3.90it/s]
 13%|█▎        | 47170/371472 [3:46:06<23:55:33,  3.77it/s]
 13%|█▎        | 47171/371472 [3:46:06<24:37:30,  3.66it/s]
 13%|█▎        | 47172/371472 [3:46:07<25:12:29,  3.57it/s]
 13%|█▎        | 47173/371472 [3:46:07<25:13:06,  3.57it/s]
 13%|█▎        | 47174/371472 [3:46:07<25:21:17,  3.55it/s]
 13%|█▎        | 47175/371472 [3:46:08<25:06:42,  3.59it/s]
 13%|█▎        | 47176/371472 [3:46:08<26:22:13,  3.42it/s]
 13%|█▎        | 47177/371472 [3:46:08<27:02:52,  3.33it/s]
 13%|█▎        | 47178/371472 [3:46:09<25:48:54,  3.49it/s]
 13%|█▎        | 47179/371472 [3:46:09<27:34:46,  3.27it/s]
 13%|█▎        | 47180/371472 [3:46:09<28:43:23,  3.14it/s]
                                                           
{'loss': 4.4056, 'learning_rate': 8.861158396000776e-07, 'epoch': 2.03}

 13%|█▎        | 47180/371472 [3:46:09<28:43:23,  3.14it/s]
 13%|█▎        | 47181/371472 [3:46:10<29:10:18,  3.09it/s]
 13%|█▎        | 47182/371472 [3:46:10<27:47:47,  3.24it/s]
 13%|█▎        | 47183/371472 [3:46:10<26:42:51,  3.37it/s]
 13%|█▎        | 47184/371472 [3:46:10<26:07:14,  3.45it/s]
 13%|█▎        | 47185/371472 [3:46:11<27:09:47,  3.32it/s]
 13%|█▎        | 47186/371472 [3:46:11<26:10:25,  3.44it/s]
 13%|█▎        | 47187/371472 [3:46:11<25:32:40,  3.53it/s]
 13%|█▎        | 47188/371472 [3:46:12<25:31:36,  3.53it/s]
 13%|█▎        | 47189/371472 [3:46:12<27:15:18,  3.31it/s]
 13%|█▎        | 47190/371472 [3:46:12<26:56:02,  3.34it/s]
 13%|█▎        | 47191/371472 [3:46:13<29:27:28,  3.06it/s]
 13%|█▎        | 47192/371472 [3:46:13<28:13:14,  3.19it/s]
 13%|█▎        | 47193/371472 [3:46:13<26:50:36,  3.36it/s]
 13%|█▎        | 47194/371472 [3:46:13<27:51:09,  3.23it/s]
 13%|█▎        | 47195/371472 [3:46:14<27:11:34,  3.31it/s]
 13%|█▎        | 47196/371472 [3:46:14<25:58:09,  3.47it/s]
 13%|█▎        | 47197/371472 [3:46:14<27:02:16,  3.33it/s]
 13%|█▎        | 47198/371472 [3:46:15<25:46:12,  3.50it/s]
 13%|█▎        | 47199/371472 [3:46:15<25:00:52,  3.60it/s]
 13%|█▎        | 47200/371472 [3:46:15<24:16:28,  3.71it/s]
                                                           
{'loss': 4.3964, 'learning_rate': 8.860673576245987e-07, 'epoch': 2.03}

 13%|█▎        | 47200/371472 [3:46:15<24:16:28,  3.71it/s]
 13%|█▎        | 47201/371472 [3:46:15<27:24:48,  3.29it/s]
 13%|█▎        | 47202/371472 [3:46:16<26:16:09,  3.43it/s]
 13%|█▎        | 47203/371472 [3:46:16<25:30:35,  3.53it/s]
 13%|█▎        | 47204/371472 [3:46:16<24:59:00,  3.61it/s]
 13%|█▎        | 47205/371472 [3:46:16<23:56:20,  3.76it/s]
 13%|█▎        | 47206/371472 [3:46:17<24:39:17,  3.65it/s]
 13%|█▎        | 47207/371472 [3:46:17<24:44:25,  3.64it/s]
 13%|█▎        | 47208/371472 [3:46:17<24:46:55,  3.63it/s]
 13%|█▎        | 47209/371472 [3:46:18<25:08:53,  3.58it/s]
 13%|█▎        | 47210/371472 [3:46:18<25:31:49,  3.53it/s]
 13%|█▎        | 47211/371472 [3:46:18<26:19:09,  3.42it/s]
 13%|█▎        | 47212/371472 [3:46:19<26:47:55,  3.36it/s]
 13%|█▎        | 47213/371472 [3:46:19<25:31:50,  3.53it/s]
 13%|█▎        | 47214/371472 [3:46:19<24:42:40,  3.64it/s]
 13%|█▎        | 47215/371472 [3:46:19<24:53:51,  3.62it/s]
 13%|█▎        | 47216/371472 [3:46:20<24:59:23,  3.60it/s]
 13%|█▎        | 47217/371472 [3:46:20<25:59:43,  3.46it/s]
 13%|█▎        | 47218/371472 [3:46:20<25:26:44,  3.54it/s]
 13%|█▎        | 47219/371472 [3:46:20<25:09:39,  3.58it/s]
 13%|█▎        | 47220/371472 [3:46:21<25:49:14,  3.49it/s]
                                                           
{'loss': 4.1294, 'learning_rate': 8.860188756491197e-07, 'epoch': 2.03}

 13%|█▎        | 47220/371472 [3:46:21<25:49:14,  3.49it/s]
 13%|█▎        | 47221/371472 [3:46:21<25:03:44,  3.59it/s]
 13%|█▎        | 47222/371472 [3:46:21<24:59:06,  3.60it/s]
 13%|█▎        | 47223/371472 [3:46:22<24:15:03,  3.71it/s]
 13%|█▎        | 47224/371472 [3:46:22<24:15:49,  3.71it/s]
 13%|█▎        | 47225/371472 [3:46:22<24:13:32,  3.72it/s]
 13%|█▎        | 47226/371472 [3:46:22<24:47:20,  3.63it/s]
 13%|█▎        | 47227/371472 [3:46:23<23:51:25,  3.78it/s]
 13%|█▎        | 47228/371472 [3:46:23<23:13:19,  3.88it/s]
 13%|█▎        | 47229/371472 [3:46:23<24:06:03,  3.74it/s]
 13%|█▎        | 47230/371472 [3:46:23<23:29:09,  3.83it/s]
 13%|█▎        | 47231/371472 [3:46:24<23:53:56,  3.77it/s]
 13%|█▎        | 47232/371472 [3:46:24<24:46:51,  3.63it/s]
 13%|█▎        | 47233/371472 [3:46:24<24:00:52,  3.75it/s]
 13%|█▎        | 47234/371472 [3:46:24<23:56:12,  3.76it/s]
 13%|█▎        | 47235/371472 [3:46:25<25:53:18,  3.48it/s]
 13%|█▎        | 47236/371472 [3:46:25<27:08:06,  3.32it/s]
 13%|█▎        | 47237/371472 [3:46:25<25:31:07,  3.53it/s]
 13%|█▎        | 47238/371472 [3:46:26<25:35:16,  3.52it/s]
 13%|█▎        | 47239/371472 [3:46:26<24:16:00,  3.71it/s]
 13%|█▎        | 47240/371472 [3:46:26<24:27:15,  3.68it/s]
                                                           
{'loss': 4.2129, 'learning_rate': 8.859703936736408e-07, 'epoch': 2.03}

 13%|█▎        | 47240/371472 [3:46:26<24:27:15,  3.68it/s]
 13%|█▎        | 47241/371472 [3:46:26<24:30:21,  3.68it/s]
 13%|█▎        | 47242/371472 [3:46:27<24:54:44,  3.62it/s]
 13%|█▎        | 47243/371472 [3:46:27<23:50:18,  3.78it/s]
 13%|█▎        | 47244/371472 [3:46:27<24:33:26,  3.67it/s]
 13%|█▎        | 47245/371472 [3:46:28<24:20:13,  3.70it/s]
 13%|█▎        | 47246/371472 [3:46:28<24:55:24,  3.61it/s]
 13%|█▎        | 47247/371472 [3:46:28<23:49:33,  3.78it/s]
 13%|█▎        | 47248/371472 [3:46:28<27:38:28,  3.26it/s]
 13%|█▎        | 47249/371472 [3:46:29<26:18:46,  3.42it/s]
 13%|█▎        | 47250/371472 [3:46:29<26:28:03,  3.40it/s]
 13%|█▎        | 47251/371472 [3:46:29<27:17:55,  3.30it/s]
 13%|█▎        | 47252/371472 [3:46:30<27:28:31,  3.28it/s]
 13%|█▎        | 47253/371472 [3:46:30<29:15:11,  3.08it/s]
 13%|█▎        | 47254/371472 [3:46:30<27:47:14,  3.24it/s]
 13%|█▎        | 47255/371472 [3:46:31<25:57:53,  3.47it/s]
 13%|█▎        | 47256/371472 [3:46:31<30:26:09,  2.96it/s]
 13%|█▎        | 47257/371472 [3:46:31<29:04:17,  3.10it/s]
 13%|█▎        | 47258/371472 [3:46:32<26:45:07,  3.37it/s]
 13%|█▎        | 47259/371472 [3:46:32<25:46:01,  3.50it/s]
 13%|█▎        | 47260/371472 [3:46:32<25:07:30,  3.58it/s]
                                                           
{'loss': 4.342, 'learning_rate': 8.85921911698162e-07, 'epoch': 2.04}

 13%|█▎        | 47260/371472 [3:46:32<25:07:30,  3.58it/s]
 13%|█▎        | 47261/371472 [3:46:32<25:56:45,  3.47it/s]
 13%|█▎        | 47262/371472 [3:46:33<25:41:28,  3.51it/s]
 13%|█▎        | 47263/371472 [3:46:33<25:51:47,  3.48it/s]
 13%|█▎        | 47264/371472 [3:46:33<24:20:28,  3.70it/s]
 13%|█▎        | 47265/371472 [3:46:33<25:21:21,  3.55it/s]
 13%|█▎        | 47266/371472 [3:46:34<24:08:13,  3.73it/s]
 13%|█▎        | 47267/371472 [3:46:34<25:04:21,  3.59it/s]
 13%|█▎        | 47268/371472 [3:46:34<26:35:36,  3.39it/s]
 13%|█▎        | 47269/371472 [3:46:35<26:14:42,  3.43it/s]
 13%|█▎        | 47270/371472 [3:46:35<25:56:17,  3.47it/s]
 13%|█▎        | 47271/371472 [3:46:35<26:18:49,  3.42it/s]
 13%|█▎        | 47272/371472 [3:46:35<25:32:01,  3.53it/s]
 13%|█▎        | 47273/371472 [3:46:36<25:07:07,  3.59it/s]
 13%|█▎        | 47274/371472 [3:46:36<24:47:34,  3.63it/s]
 13%|█▎        | 47275/371472 [3:46:36<24:24:51,  3.69it/s]
 13%|█▎        | 47276/371472 [3:46:36<23:51:11,  3.78it/s]
 13%|█▎        | 47277/371472 [3:46:37<24:01:57,  3.75it/s]
 13%|█▎        | 47278/371472 [3:46:37<23:13:50,  3.88it/s]
 13%|█▎        | 47279/371472 [3:46:37<22:59:45,  3.92it/s]
 13%|█▎        | 47280/371472 [3:46:38<23:42:12,  3.80it/s]
                                                           
{'loss': 4.3192, 'learning_rate': 8.85873429722683e-07, 'epoch': 2.04}

 13%|█▎        | 47280/371472 [3:46:38<23:42:12,  3.80it/s]
 13%|█▎        | 47281/371472 [3:46:38<24:06:15,  3.74it/s]
 13%|█▎        | 47282/371472 [3:46:38<23:33:53,  3.82it/s]
 13%|█▎        | 47283/371472 [3:46:38<24:06:27,  3.74it/s]
 13%|█▎        | 47284/371472 [3:46:39<24:09:15,  3.73it/s]
 13%|█▎        | 47285/371472 [3:46:39<23:21:21,  3.86it/s]
 13%|█▎        | 47286/371472 [3:46:39<23:50:37,  3.78it/s]
 13%|█▎        | 47287/371472 [3:46:39<24:22:57,  3.69it/s]
 13%|█▎        | 47288/371472 [3:46:40<24:06:26,  3.74it/s]
 13%|█▎        | 47289/371472 [3:46:40<26:19:24,  3.42it/s]
 13%|█▎        | 47290/371472 [3:46:40<26:54:50,  3.35it/s]
 13%|█▎        | 47291/371472 [3:46:41<26:00:40,  3.46it/s]
 13%|█▎        | 47292/371472 [3:46:41<25:43:14,  3.50it/s]
 13%|█▎        | 47293/371472 [3:46:41<26:21:26,  3.42it/s]
 13%|█▎        | 47294/371472 [3:46:41<25:51:35,  3.48it/s]
 13%|█▎        | 47295/371472 [3:46:42<24:56:08,  3.61it/s]
 13%|█▎        | 47296/371472 [3:46:42<25:18:50,  3.56it/s]
 13%|█▎        | 47297/371472 [3:46:42<26:58:20,  3.34it/s]
 13%|█▎        | 47298/371472 [3:46:43<26:44:36,  3.37it/s]
 13%|█▎        | 47299/371472 [3:46:43<25:35:10,  3.52it/s]
 13%|█▎        | 47300/371472 [3:46:43<24:44:45,  3.64it/s]
                                                           
{'loss': 4.4086, 'learning_rate': 8.858249477472042e-07, 'epoch': 2.04}

 13%|█▎        | 47300/371472 [3:46:43<24:44:45,  3.64it/s]
 13%|█▎        | 47301/371472 [3:46:43<26:33:32,  3.39it/s]
 13%|█▎        | 47302/371472 [3:46:44<25:25:46,  3.54it/s]
 13%|█▎        | 47303/371472 [3:46:44<24:40:56,  3.65it/s]
 13%|█▎        | 47304/371472 [3:46:44<24:09:09,  3.73it/s]
 13%|█▎        | 47305/371472 [3:46:45<25:22:15,  3.55it/s]
 13%|█▎        | 47306/371472 [3:46:45<25:23:31,  3.55it/s]
 13%|█▎        | 47307/371472 [3:46:45<24:32:39,  3.67it/s]
 13%|█▎        | 47308/371472 [3:46:45<25:02:23,  3.60it/s]
 13%|█▎        | 47309/371472 [3:46:46<25:55:11,  3.47it/s]
 13%|█▎        | 47310/371472 [3:46:46<24:41:14,  3.65it/s]
 13%|█▎        | 47311/371472 [3:46:46<24:38:36,  3.65it/s]
 13%|█▎        | 47312/371472 [3:46:46<24:52:10,  3.62it/s]
 13%|█▎        | 47313/371472 [3:46:47<26:45:42,  3.36it/s]
 13%|█▎        | 47314/371472 [3:46:47<28:23:39,  3.17it/s]
 13%|█▎        | 47315/371472 [3:46:47<27:00:47,  3.33it/s]
 13%|█▎        | 47316/371472 [3:46:48<25:04:31,  3.59it/s]
 13%|█▎        | 47317/371472 [3:46:48<24:05:45,  3.74it/s]
 13%|█▎        | 47318/371472 [3:46:48<23:51:43,  3.77it/s]
 13%|█▎        | 47319/371472 [3:46:48<24:54:38,  3.61it/s]
 13%|█▎        | 47320/371472 [3:46:49<24:05:08,  3.74it/s]
                                                           
{'loss': 4.2597, 'learning_rate': 8.857764657717253e-07, 'epoch': 2.04}

 13%|█▎        | 47320/371472 [3:46:49<24:05:08,  3.74it/s]
 13%|█▎        | 47321/371472 [3:46:49<26:08:54,  3.44it/s]
 13%|█▎        | 47322/371472 [3:46:49<26:05:03,  3.45it/s]
 13%|█▎        | 47323/371472 [3:46:50<24:35:59,  3.66it/s]
 13%|█▎        | 47324/371472 [3:46:50<23:49:48,  3.78it/s]
 13%|█▎        | 47325/371472 [3:46:50<24:20:54,  3.70it/s]
 13%|█▎        | 47326/371472 [3:46:50<26:01:13,  3.46it/s]
 13%|█▎        | 47327/371472 [3:46:51<25:26:30,  3.54it/s]
 13%|█▎        | 47328/371472 [3:46:51<25:47:36,  3.49it/s]
 13%|█▎        | 47329/371472 [3:46:51<24:44:04,  3.64it/s]
 13%|█▎        | 47330/371472 [3:46:52<25:10:12,  3.58it/s]
 13%|█▎        | 47331/371472 [3:46:52<24:38:03,  3.66it/s]
 13%|█▎        | 47332/371472 [3:46:52<25:16:17,  3.56it/s]
 13%|█▎        | 47333/371472 [3:46:52<24:33:16,  3.67it/s]
 13%|█▎        | 47334/371472 [3:46:53<27:12:33,  3.31it/s]
 13%|█▎        | 47335/371472 [3:46:53<26:27:28,  3.40it/s]
 13%|█▎        | 47336/371472 [3:46:53<26:02:08,  3.46it/s]
 13%|█▎        | 47337/371472 [3:46:54<25:17:12,  3.56it/s]
 13%|█▎        | 47338/371472 [3:46:54<24:43:42,  3.64it/s]
 13%|█▎        | 47339/371472 [3:46:54<26:25:19,  3.41it/s]
 13%|█▎        | 47340/371472 [3:46:54<25:18:37,  3.56it/s]
                                                           
{'loss': 4.3538, 'learning_rate': 8.857279837962464e-07, 'epoch': 2.04}

 13%|█▎        | 47340/371472 [3:46:54<25:18:37,  3.56it/s]
 13%|█▎        | 47341/371472 [3:46:55<27:05:21,  3.32it/s]
 13%|█▎        | 47342/371472 [3:46:55<28:26:50,  3.16it/s]
 13%|█▎        | 47343/371472 [3:46:55<28:25:32,  3.17it/s]
 13%|█▎        | 47344/371472 [3:46:56<27:22:33,  3.29it/s]
 13%|█▎        | 47345/371472 [3:46:56<25:51:47,  3.48it/s]
 13%|█▎        | 47346/371472 [3:46:56<25:52:58,  3.48it/s]
 13%|█▎        | 47347/371472 [3:46:57<26:31:21,  3.39it/s]
 13%|█▎        | 47348/371472 [3:46:57<25:41:15,  3.50it/s]
 13%|█▎        | 47349/371472 [3:46:57<28:06:36,  3.20it/s]
 13%|█▎        | 47350/371472 [3:46:57<26:14:25,  3.43it/s]
 13%|█▎        | 47351/371472 [3:46:58<25:02:49,  3.59it/s]
 13%|█▎        | 47352/371472 [3:46:58<25:21:55,  3.55it/s]
 13%|█▎        | 47353/371472 [3:46:58<25:46:04,  3.49it/s]
 13%|█▎        | 47354/371472 [3:46:59<25:30:07,  3.53it/s]
 13%|█▎        | 47355/371472 [3:46:59<25:52:43,  3.48it/s]
 13%|█▎        | 47356/371472 [3:46:59<25:36:26,  3.52it/s]
 13%|█▎        | 47357/371472 [3:46:59<25:44:50,  3.50it/s]
 13%|█▎        | 47358/371472 [3:47:00<25:59:34,  3.46it/s]
 13%|█▎        | 47359/371472 [3:47:00<25:24:25,  3.54it/s]
 13%|█▎        | 47360/371472 [3:47:00<25:17:26,  3.56it/s]
                                                           
{'loss': 4.3276, 'learning_rate': 8.856795018207674e-07, 'epoch': 2.04}

 13%|█▎        | 47360/371472 [3:47:00<25:17:26,  3.56it/s]
 13%|█▎        | 47361/371472 [3:47:01<24:28:36,  3.68it/s]
 13%|█▎        | 47362/371472 [3:47:01<24:08:46,  3.73it/s]
 13%|█▎        | 47363/371472 [3:47:01<25:10:51,  3.58it/s]
 13%|█▎        | 47364/371472 [3:47:01<25:14:20,  3.57it/s]
 13%|█▎        | 47365/371472 [3:47:02<24:04:22,  3.74it/s]
 13%|█▎        | 47366/371472 [3:47:02<26:39:49,  3.38it/s]
 13%|█▎        | 47367/371472 [3:47:02<25:26:26,  3.54it/s]
 13%|█▎        | 47368/371472 [3:47:02<24:50:25,  3.62it/s]
 13%|█▎        | 47369/371472 [3:47:03<26:06:11,  3.45it/s]
 13%|█▎        | 47370/371472 [3:47:03<26:20:05,  3.42it/s]
 13%|█▎        | 47371/371472 [3:47:03<25:23:51,  3.54it/s]
 13%|█▎        | 47372/371472 [3:47:04<25:40:47,  3.51it/s]
 13%|█▎        | 47373/371472 [3:47:04<24:54:35,  3.61it/s]
 13%|█▎        | 47374/371472 [3:47:04<26:56:53,  3.34it/s]
 13%|█▎        | 47375/371472 [3:47:05<26:43:03,  3.37it/s]
 13%|█▎        | 47376/371472 [3:47:05<26:52:55,  3.35it/s]
 13%|█▎        | 47377/371472 [3:47:05<26:25:46,  3.41it/s]
 13%|█▎        | 47378/371472 [3:47:05<25:33:26,  3.52it/s]
 13%|█▎        | 47379/371472 [3:47:06<24:27:01,  3.68it/s]
 13%|█▎        | 47380/371472 [3:47:06<24:08:37,  3.73it/s]
                                                           
{'loss': 4.3319, 'learning_rate': 8.856310198452886e-07, 'epoch': 2.04}

 13%|█▎        | 47380/371472 [3:47:06<24:08:37,  3.73it/s]
 13%|█▎        | 47381/371472 [3:47:06<25:30:54,  3.53it/s]
 13%|█▎        | 47382/371472 [3:47:06<25:17:13,  3.56it/s]
 13%|█▎        | 47383/371472 [3:47:07<24:01:35,  3.75it/s]
 13%|█▎        | 47384/371472 [3:47:07<24:00:52,  3.75it/s]
 13%|█▎        | 47385/371472 [3:47:07<24:40:00,  3.65it/s]
 13%|█▎        | 47386/371472 [3:47:08<25:09:47,  3.58it/s]
 13%|█▎        | 47387/371472 [3:47:08<26:52:24,  3.35it/s]
 13%|█▎        | 47388/371472 [3:47:08<26:20:24,  3.42it/s]
 13%|█▎        | 47389/371472 [3:47:09<27:18:41,  3.30it/s]
 13%|█▎        | 47390/371472 [3:47:09<25:48:48,  3.49it/s]
 13%|█▎        | 47391/371472 [3:47:09<24:32:14,  3.67it/s]
 13%|█▎        | 47392/371472 [3:47:09<24:11:53,  3.72it/s]
 13%|█▎        | 47393/371472 [3:47:10<23:55:20,  3.76it/s]
 13%|█▎        | 47394/371472 [3:47:10<24:12:56,  3.72it/s]
 13%|█▎        | 47395/371472 [3:47:10<25:35:50,  3.52it/s]
 13%|█▎        | 47396/371472 [3:47:10<24:52:37,  3.62it/s]
 13%|█▎        | 47397/371472 [3:47:11<24:01:55,  3.75it/s]
 13%|█▎        | 47398/371472 [3:47:11<24:44:04,  3.64it/s]
 13%|█▎        | 47399/371472 [3:47:11<24:41:42,  3.65it/s]
 13%|█▎        | 47400/371472 [3:47:12<26:27:21,  3.40it/s]
                                                           
{'loss': 4.3089, 'learning_rate': 8.855825378698097e-07, 'epoch': 2.04}

 13%|█▎        | 47400/371472 [3:47:12<26:27:21,  3.40it/s]
 13%|█▎        | 47401/371472 [3:47:12<27:03:37,  3.33it/s]
 13%|█▎        | 47402/371472 [3:47:12<26:34:54,  3.39it/s]
 13%|█▎        | 47403/371472 [3:47:12<25:54:22,  3.47it/s]
 13%|█▎        | 47404/371472 [3:47:13<24:56:23,  3.61it/s]
 13%|█▎        | 47405/371472 [3:47:13<24:05:48,  3.74it/s]
 13%|█▎        | 47406/371472 [3:47:13<24:00:50,  3.75it/s]
 13%|█▎        | 47407/371472 [3:47:13<24:13:53,  3.71it/s]
 13%|█▎        | 47408/371472 [3:47:14<25:30:00,  3.53it/s]
 13%|█▎        | 47409/371472 [3:47:14<24:40:12,  3.65it/s]
 13%|█▎        | 47410/371472 [3:47:14<26:14:35,  3.43it/s]
 13%|█▎        | 47411/371472 [3:47:15<24:31:07,  3.67it/s]
 13%|█▎        | 47412/371472 [3:47:15<24:50:54,  3.62it/s]
 13%|█▎        | 47413/371472 [3:47:15<24:50:59,  3.62it/s]
 13%|█▎        | 47414/371472 [3:47:15<25:00:13,  3.60it/s]
 13%|█▎        | 47415/371472 [3:47:16<26:46:30,  3.36it/s]
 13%|█▎        | 47416/371472 [3:47:16<27:35:35,  3.26it/s]
 13%|█▎        | 47417/371472 [3:47:16<26:30:44,  3.40it/s]
 13%|█▎        | 47418/371472 [3:47:17<28:09:32,  3.20it/s]
 13%|█▎        | 47419/371472 [3:47:17<28:46:39,  3.13it/s]
 13%|█▎        | 47420/371472 [3:47:17<27:32:23,  3.27it/s]
                                                           
{'loss': 4.4973, 'learning_rate': 8.855340558943309e-07, 'epoch': 2.04}

 13%|█▎        | 47420/371472 [3:47:17<27:32:23,  3.27it/s]
 13%|█▎        | 47421/371472 [3:47:18<26:01:34,  3.46it/s]
 13%|█▎        | 47422/371472 [3:47:18<27:50:02,  3.23it/s]
 13%|█▎        | 47423/371472 [3:47:18<28:27:09,  3.16it/s]
 13%|█▎        | 47424/371472 [3:47:18<26:29:31,  3.40it/s]
 13%|█▎        | 47425/371472 [3:47:19<25:04:19,  3.59it/s]
 13%|█▎        | 47426/371472 [3:47:19<24:03:36,  3.74it/s]
 13%|█▎        | 47427/371472 [3:47:19<23:34:48,  3.82it/s]
 13%|█▎        | 47428/371472 [3:47:20<24:48:49,  3.63it/s]
 13%|█▎        | 47429/371472 [3:47:20<24:31:21,  3.67it/s]
 13%|█▎        | 47430/371472 [3:47:20<27:28:38,  3.28it/s]
 13%|█▎        | 47431/371472 [3:47:20<26:29:56,  3.40it/s]
 13%|█▎        | 47432/371472 [3:47:21<25:19:28,  3.55it/s]
 13%|█▎        | 47433/371472 [3:47:21<25:12:43,  3.57it/s]
 13%|█▎        | 47434/371472 [3:47:21<24:48:41,  3.63it/s]
 13%|█▎        | 47435/371472 [3:47:21<24:11:57,  3.72it/s]
 13%|█▎        | 47436/371472 [3:47:22<23:43:31,  3.79it/s]
 13%|█▎        | 47437/371472 [3:47:22<25:01:48,  3.60it/s]
 13%|█▎        | 47438/371472 [3:47:22<24:01:28,  3.75it/s]
 13%|█▎        | 47439/371472 [3:47:23<24:24:36,  3.69it/s]
 13%|█▎        | 47440/371472 [3:47:23<23:42:45,  3.80it/s]
                                                           
{'loss': 4.4496, 'learning_rate': 8.854855739188519e-07, 'epoch': 2.04}

 13%|█▎        | 47440/371472 [3:47:23<23:42:45,  3.80it/s]
 13%|█▎        | 47441/371472 [3:47:23<23:26:55,  3.84it/s]
 13%|█▎        | 47442/371472 [3:47:23<23:40:07,  3.80it/s]
 13%|█▎        | 47443/371472 [3:47:24<24:23:12,  3.69it/s]
 13%|█▎        | 47444/371472 [3:47:24<24:08:40,  3.73it/s]
 13%|█▎        | 47445/371472 [3:47:24<25:35:36,  3.52it/s]
 13%|█▎        | 47446/371472 [3:47:25<26:26:01,  3.41it/s]
 13%|█▎        | 47447/371472 [3:47:25<25:59:00,  3.46it/s]
 13%|█▎        | 47448/371472 [3:47:25<24:33:50,  3.66it/s]
 13%|█▎        | 47449/371472 [3:47:25<26:14:21,  3.43it/s]
 13%|█▎        | 47450/371472 [3:47:26<25:25:03,  3.54it/s]
 13%|█▎        | 47451/371472 [3:47:26<25:34:36,  3.52it/s]
 13%|█▎        | 47452/371472 [3:47:26<24:30:05,  3.67it/s]
 13%|█▎        | 47453/371472 [3:47:26<25:15:57,  3.56it/s]
 13%|█▎        | 47454/371472 [3:47:27<24:11:10,  3.72it/s]
 13%|█▎        | 47455/371472 [3:47:27<25:06:38,  3.58it/s]
 13%|█▎        | 47456/371472 [3:47:27<24:51:24,  3.62it/s]
 13%|█▎        | 47457/371472 [3:47:28<25:13:05,  3.57it/s]
 13%|█▎        | 47458/371472 [3:47:28<25:43:36,  3.50it/s]
 13%|█▎        | 47459/371472 [3:47:28<25:21:40,  3.55it/s]
 13%|█▎        | 47460/371472 [3:47:28<24:52:27,  3.62it/s]
                                                           
{'loss': 4.395, 'learning_rate': 8.854370919433731e-07, 'epoch': 2.04}

 13%|█▎        | 47460/371472 [3:47:28<24:52:27,  3.62it/s]
 13%|█▎        | 47461/371472 [3:47:29<24:40:20,  3.65it/s]
 13%|█▎        | 47462/371472 [3:47:29<25:17:18,  3.56it/s]
 13%|█▎        | 47463/371472 [3:47:29<24:21:33,  3.69it/s]
 13%|█▎        | 47464/371472 [3:47:30<25:49:29,  3.49it/s]
 13%|█▎        | 47465/371472 [3:47:30<24:39:18,  3.65it/s]
 13%|█▎        | 47466/371472 [3:47:30<25:24:54,  3.54it/s]
 13%|█▎        | 47467/371472 [3:47:30<26:44:28,  3.37it/s]
 13%|█▎        | 47468/371472 [3:47:31<27:00:23,  3.33it/s]
 13%|█▎        | 47469/371472 [3:47:31<25:07:30,  3.58it/s]
 13%|█▎        | 47470/371472 [3:47:31<24:23:50,  3.69it/s]
 13%|█▎        | 47471/371472 [3:47:31<23:46:46,  3.78it/s]
 13%|█▎        | 47472/371472 [3:47:32<25:01:43,  3.60it/s]
 13%|█▎        | 47473/371472 [3:47:32<28:03:15,  3.21it/s]
 13%|█▎        | 47474/371472 [3:47:33<29:57:54,  3.00it/s]
 13%|█▎        | 47475/371472 [3:47:33<28:24:31,  3.17it/s]
 13%|█▎        | 47476/371472 [3:47:33<27:42:54,  3.25it/s]
 13%|█▎        | 47477/371472 [3:47:33<27:08:53,  3.32it/s]
 13%|█▎        | 47478/371472 [3:47:34<27:04:46,  3.32it/s]
 13%|█▎        | 47479/371472 [3:47:34<26:46:32,  3.36it/s]
 13%|█▎        | 47480/371472 [3:47:34<26:04:54,  3.45it/s]
                                                           
{'loss': 4.0993, 'learning_rate': 8.853886099678941e-07, 'epoch': 2.05}

 13%|█▎        | 47480/371472 [3:47:34<26:04:54,  3.45it/s]
 13%|█▎        | 47481/371472 [3:47:35<25:21:51,  3.55it/s]
 13%|█▎        | 47482/371472 [3:47:35<24:14:24,  3.71it/s]
 13%|█▎        | 47483/371472 [3:47:35<23:38:40,  3.81it/s]
 13%|█▎        | 47484/371472 [3:47:35<24:22:50,  3.69it/s]
 13%|█▎        | 47485/371472 [3:47:36<25:49:38,  3.48it/s]
 13%|█▎        | 47486/371472 [3:47:36<25:42:05,  3.50it/s]
 13%|█▎        | 47487/371472 [3:47:36<26:24:54,  3.41it/s]
 13%|█▎        | 47488/371472 [3:47:36<25:05:30,  3.59it/s]
 13%|█▎        | 47489/371472 [3:47:37<24:51:12,  3.62it/s]
 13%|█▎        | 47490/371472 [3:47:37<24:53:44,  3.61it/s]
 13%|█▎        | 47491/371472 [3:47:37<23:52:42,  3.77it/s]
 13%|█▎        | 47492/371472 [3:47:38<24:20:01,  3.70it/s]
 13%|█▎        | 47493/371472 [3:47:38<23:29:21,  3.83it/s]
 13%|█▎        | 47494/371472 [3:47:38<23:18:18,  3.86it/s]
 13%|█▎        | 47495/371472 [3:47:38<24:50:10,  3.62it/s]
 13%|█▎        | 47496/371472 [3:47:39<25:25:22,  3.54it/s]
 13%|█▎        | 47497/371472 [3:47:39<25:28:01,  3.53it/s]
 13%|█▎        | 47498/371472 [3:47:39<24:53:31,  3.62it/s]
 13%|█▎        | 47499/371472 [3:47:39<24:20:44,  3.70it/s]
 13%|█▎        | 47500/371472 [3:47:40<24:35:52,  3.66it/s]
                                                           
{'loss': 4.3092, 'learning_rate': 8.853401279924152e-07, 'epoch': 2.05}

 13%|█▎        | 47500/371472 [3:47:40<24:35:52,  3.66it/s]
 13%|█▎        | 47501/371472 [3:47:40<25:17:39,  3.56it/s]
 13%|█▎        | 47502/371472 [3:47:40<25:41:57,  3.50it/s]
 13%|█▎        | 47503/371472 [3:47:41<25:12:25,  3.57it/s]
 13%|█▎        | 47504/371472 [3:47:41<24:46:16,  3.63it/s]
 13%|█▎        | 47505/371472 [3:47:41<25:24:43,  3.54it/s]
 13%|█▎        | 47506/371472 [3:47:41<26:47:34,  3.36it/s]
 13%|█▎        | 47507/371472 [3:47:42<27:47:32,  3.24it/s]
 13%|█▎        | 47508/371472 [3:47:42<27:49:19,  3.23it/s]
 13%|█▎        | 47509/371472 [3:47:42<26:19:32,  3.42it/s]
 13%|█▎        | 47510/371472 [3:47:43<26:28:57,  3.40it/s]
 13%|█▎        | 47511/371472 [3:47:43<25:15:05,  3.56it/s]
 13%|█▎        | 47512/371472 [3:47:43<25:44:02,  3.50it/s]
 13%|█▎        | 47513/371472 [3:47:44<26:10:25,  3.44it/s]
 13%|█▎        | 47514/371472 [3:47:44<27:03:27,  3.33it/s]
 13%|█▎        | 47515/371472 [3:47:44<25:48:47,  3.49it/s]
 13%|█▎        | 47516/371472 [3:47:44<25:50:44,  3.48it/s]
 13%|█▎        | 47517/371472 [3:47:45<24:23:55,  3.69it/s]
 13%|█▎        | 47518/371472 [3:47:45<23:50:47,  3.77it/s]
 13%|█▎        | 47519/371472 [3:47:45<23:15:58,  3.87it/s]
 13%|█▎        | 47520/371472 [3:47:45<23:16:03,  3.87it/s]
                                                           
{'loss': 4.1731, 'learning_rate': 8.852916460169363e-07, 'epoch': 2.05}

 13%|█▎        | 47520/371472 [3:47:45<23:16:03,  3.87it/s]
 13%|█▎        | 47521/371472 [3:47:46<22:54:12,  3.93it/s]
 13%|█▎        | 47522/371472 [3:47:46<23:02:21,  3.91it/s]
 13%|█▎        | 47523/371472 [3:47:46<22:35:59,  3.98it/s]
 13%|█▎        | 47524/371472 [3:47:46<22:11:06,  4.06it/s]
 13%|█▎        | 47525/371472 [3:47:47<24:06:38,  3.73it/s]
 13%|█▎        | 47526/371472 [3:47:47<23:37:29,  3.81it/s]
 13%|█▎        | 47527/371472 [3:47:47<24:11:40,  3.72it/s]
 13%|█▎        | 47528/371472 [3:47:48<26:46:17,  3.36it/s]
 13%|█▎        | 47529/371472 [3:47:48<26:00:22,  3.46it/s]
 13%|█▎        | 47530/371472 [3:47:48<24:45:29,  3.63it/s]
 13%|█▎        | 47531/371472 [3:47:48<24:28:06,  3.68it/s]
 13%|█▎        | 47532/371472 [3:47:49<24:51:34,  3.62it/s]
 13%|█▎        | 47533/371472 [3:47:49<24:51:36,  3.62it/s]
 13%|█▎        | 47534/371472 [3:47:49<24:00:21,  3.75it/s]
 13%|█▎        | 47535/371472 [3:47:49<24:41:26,  3.64it/s]
 13%|█▎        | 47536/371472 [3:47:50<24:54:57,  3.61it/s]
 13%|█▎        | 47537/371472 [3:47:50<24:26:08,  3.68it/s]
 13%|█▎        | 47538/371472 [3:47:50<24:13:33,  3.71it/s]
 13%|█▎        | 47539/371472 [3:47:51<24:25:47,  3.68it/s]
 13%|█▎        | 47540/371472 [3:47:51<23:50:33,  3.77it/s]
                                                           
{'loss': 4.498, 'learning_rate': 8.852431640414574e-07, 'epoch': 2.05}

 13%|█▎        | 47540/371472 [3:47:51<23:50:33,  3.77it/s]
 13%|█▎        | 47541/371472 [3:47:51<24:28:03,  3.68it/s]
 13%|█▎        | 47542/371472 [3:47:51<26:31:47,  3.39it/s]
 13%|█▎        | 47543/371472 [3:47:52<25:16:54,  3.56it/s]
 13%|█▎        | 47544/371472 [3:47:52<26:18:25,  3.42it/s]
 13%|█▎        | 47545/371472 [3:47:52<25:24:18,  3.54it/s]
 13%|█▎        | 47546/371472 [3:47:52<24:08:11,  3.73it/s]
 13%|█▎        | 47547/371472 [3:47:53<24:33:07,  3.66it/s]
 13%|█▎        | 47548/371472 [3:47:53<24:26:01,  3.68it/s]
 13%|█▎        | 47549/371472 [3:47:53<23:43:29,  3.79it/s]
 13%|█▎        | 47550/371472 [3:47:54<24:29:59,  3.67it/s]
 13%|█▎        | 47551/371472 [3:47:54<23:36:54,  3.81it/s]
 13%|█▎        | 47552/371472 [3:47:54<23:33:17,  3.82it/s]
 13%|█▎        | 47553/371472 [3:47:54<25:25:22,  3.54it/s]
 13%|█▎        | 47554/371472 [3:47:55<25:29:11,  3.53it/s]
 13%|█▎        | 47555/371472 [3:47:55<25:19:12,  3.55it/s]
 13%|█▎        | 47556/371472 [3:47:55<25:03:58,  3.59it/s]
 13%|█▎        | 47557/371472 [3:47:56<25:00:11,  3.60it/s]
 13%|█▎        | 47558/371472 [3:47:56<24:50:41,  3.62it/s]
 13%|█▎        | 47559/371472 [3:47:56<23:54:18,  3.76it/s]
 13%|█▎        | 47560/371472 [3:47:56<23:56:02,  3.76it/s]
                                                           
{'loss': 4.301, 'learning_rate': 8.851946820659786e-07, 'epoch': 2.05}

 13%|█▎        | 47560/371472 [3:47:56<23:56:02,  3.76it/s]
 13%|█▎        | 47561/371472 [3:47:57<24:13:58,  3.71it/s]
 13%|█▎        | 47562/371472 [3:47:57<24:03:35,  3.74it/s]
 13%|█▎        | 47563/371472 [3:47:57<23:40:56,  3.80it/s]
 13%|█▎        | 47564/371472 [3:47:57<24:27:51,  3.68it/s]
 13%|█▎        | 47565/371472 [3:47:58<24:31:34,  3.67it/s]
 13%|█▎        | 47566/371472 [3:47:58<24:12:47,  3.72it/s]
 13%|█▎        | 47567/371472 [3:47:58<26:02:35,  3.45it/s]
 13%|█▎        | 47568/371472 [3:47:59<25:17:15,  3.56it/s]
 13%|█▎        | 47569/371472 [3:47:59<24:27:42,  3.68it/s]
 13%|█▎        | 47570/371472 [3:47:59<24:30:07,  3.67it/s]
 13%|█▎        | 47571/371472 [3:47:59<25:01:51,  3.59it/s]
 13%|█▎        | 47572/371472 [3:48:00<25:28:46,  3.53it/s]
 13%|█▎        | 47573/371472 [3:48:00<25:03:54,  3.59it/s]
 13%|█▎        | 47574/371472 [3:48:00<24:04:16,  3.74it/s]
 13%|█▎        | 47575/371472 [3:48:00<24:09:46,  3.72it/s]
 13%|█▎        | 47576/371472 [3:48:01<25:47:23,  3.49it/s]
 13%|█▎        | 47577/371472 [3:48:01<24:49:59,  3.62it/s]
 13%|█▎        | 47578/371472 [3:48:01<24:19:23,  3.70it/s]
 13%|█▎        | 47579/371472 [3:48:02<24:20:44,  3.70it/s]
 13%|█▎        | 47580/371472 [3:48:02<24:42:15,  3.64it/s]
                                                           
{'loss': 4.0986, 'learning_rate': 8.851462000904997e-07, 'epoch': 2.05}

 13%|█▎        | 47580/371472 [3:48:02<24:42:15,  3.64it/s]
 13%|█▎        | 47581/371472 [3:48:02<24:48:24,  3.63it/s]
 13%|█▎        | 47582/371472 [3:48:02<25:50:19,  3.48it/s]
 13%|█▎        | 47583/371472 [3:48:03<25:54:32,  3.47it/s]
 13%|█▎        | 47584/371472 [3:48:03<25:21:36,  3.55it/s]
 13%|█▎        | 47585/371472 [3:48:03<24:54:09,  3.61it/s]
 13%|█▎        | 47586/371472 [3:48:03<24:10:04,  3.72it/s]
 13%|█▎        | 47587/371472 [3:48:04<25:47:28,  3.49it/s]
 13%|█▎        | 47588/371472 [3:48:04<24:58:52,  3.60it/s]
 13%|█▎        | 47589/371472 [3:48:04<24:38:21,  3.65it/s]
 13%|█▎        | 47590/371472 [3:48:05<24:46:00,  3.63it/s]
 13%|█▎        | 47591/371472 [3:48:05<26:30:30,  3.39it/s]
 13%|█▎        | 47592/371472 [3:48:05<25:17:31,  3.56it/s]
 13%|█▎        | 47593/371472 [3:48:05<26:24:26,  3.41it/s]
 13%|█▎        | 47594/371472 [3:48:06<26:15:43,  3.43it/s]
 13%|█▎        | 47595/371472 [3:48:06<26:51:35,  3.35it/s]
 13%|█▎        | 47596/371472 [3:48:06<27:00:00,  3.33it/s]
 13%|█▎        | 47597/371472 [3:48:07<26:02:03,  3.46it/s]
 13%|█▎        | 47598/371472 [3:48:07<26:09:11,  3.44it/s]
 13%|█▎        | 47599/371472 [3:48:07<25:10:41,  3.57it/s]
 13%|█▎        | 47600/371472 [3:48:07<24:58:10,  3.60it/s]
                                                           
{'loss': 4.3623, 'learning_rate': 8.850977181150206e-07, 'epoch': 2.05}

 13%|█▎        | 47600/371472 [3:48:07<24:58:10,  3.60it/s]
 13%|█▎        | 47601/371472 [3:48:08<24:47:07,  3.63it/s]
 13%|█▎        | 47602/371472 [3:48:08<24:09:30,  3.72it/s]
 13%|█▎        | 47603/371472 [3:48:08<25:58:33,  3.46it/s]
 13%|█▎        | 47604/371472 [3:48:09<25:18:36,  3.55it/s]
 13%|█▎        | 47605/371472 [3:48:09<24:37:09,  3.65it/s]
 13%|█▎        | 47606/371472 [3:48:09<24:39:41,  3.65it/s]
 13%|█▎        | 47607/371472 [3:48:09<25:49:09,  3.48it/s]
 13%|█▎        | 47608/371472 [3:48:10<26:21:37,  3.41it/s]
 13%|█▎        | 47609/371472 [3:48:10<26:02:23,  3.45it/s]
 13%|█▎        | 47610/371472 [3:48:10<24:50:09,  3.62it/s]
 13%|█▎        | 47611/371472 [3:48:11<26:48:08,  3.36it/s]
 13%|█▎        | 47612/371472 [3:48:11<27:23:48,  3.28it/s]
 13%|█▎        | 47613/371472 [3:48:11<26:32:37,  3.39it/s]
 13%|█▎        | 47614/371472 [3:48:12<26:01:48,  3.46it/s]
 13%|█▎        | 47615/371472 [3:48:12<25:50:37,  3.48it/s]
 13%|█▎        | 47616/371472 [3:48:12<25:34:50,  3.52it/s]
 13%|█▎        | 47617/371472 [3:48:12<24:50:11,  3.62it/s]
 13%|█▎        | 47618/371472 [3:48:13<23:55:10,  3.76it/s]
 13%|█▎        | 47619/371472 [3:48:13<25:04:15,  3.59it/s]
 13%|█▎        | 47620/371472 [3:48:13<24:00:32,  3.75it/s]
                                                           
{'loss': 4.186, 'learning_rate': 8.850492361395418e-07, 'epoch': 2.05}

 13%|█▎        | 47620/371472 [3:48:13<24:00:32,  3.75it/s]
 13%|█▎        | 47621/371472 [3:48:13<24:02:53,  3.74it/s]
 13%|█▎        | 47622/371472 [3:48:14<24:07:53,  3.73it/s]
 13%|█▎        | 47623/371472 [3:48:14<25:21:56,  3.55it/s]
 13%|█▎        | 47624/371472 [3:48:14<26:42:47,  3.37it/s]
 13%|█▎        | 47625/371472 [3:48:15<25:34:56,  3.52it/s]
 13%|█▎        | 47626/371472 [3:48:15<26:10:48,  3.44it/s]
 13%|█▎        | 47627/371472 [3:48:15<25:43:38,  3.50it/s]
 13%|█▎        | 47628/371472 [3:48:15<25:14:54,  3.56it/s]
 13%|█▎        | 47629/371472 [3:48:16<24:43:09,  3.64it/s]
 13%|█▎        | 47630/371472 [3:48:16<24:30:26,  3.67it/s]
 13%|█▎        | 47631/371472 [3:48:16<24:18:35,  3.70it/s]
 13%|█▎        | 47632/371472 [3:48:16<24:31:31,  3.67it/s]
 13%|█▎        | 47633/371472 [3:48:17<25:34:32,  3.52it/s]
 13%|█▎        | 47634/371472 [3:48:17<25:12:52,  3.57it/s]
 13%|█▎        | 47635/371472 [3:48:17<25:44:21,  3.49it/s]
 13%|█▎        | 47636/371472 [3:48:18<25:49:14,  3.48it/s]
 13%|█▎        | 47637/371472 [3:48:18<25:20:55,  3.55it/s]
 13%|█▎        | 47638/371472 [3:48:18<25:16:11,  3.56it/s]
 13%|█▎        | 47639/371472 [3:48:18<24:48:09,  3.63it/s]
 13%|█▎        | 47640/371472 [3:48:19<24:56:47,  3.61it/s]
                                                           
{'loss': 4.2125, 'learning_rate': 8.85000754164063e-07, 'epoch': 2.05}

 13%|█▎        | 47640/371472 [3:48:19<24:56:47,  3.61it/s]
 13%|█▎        | 47641/371472 [3:48:19<25:42:59,  3.50it/s]
 13%|█▎        | 47642/371472 [3:48:19<25:05:57,  3.58it/s]
 13%|█▎        | 47643/371472 [3:48:20<25:00:10,  3.60it/s]
 13%|█▎        | 47644/371472 [3:48:20<24:26:25,  3.68it/s]
 13%|█▎        | 47645/371472 [3:48:20<23:52:12,  3.77it/s]
 13%|█▎        | 47646/371472 [3:48:20<25:17:14,  3.56it/s]
 13%|█▎        | 47647/371472 [3:48:21<25:32:39,  3.52it/s]
 13%|█▎        | 47648/371472 [3:48:21<25:48:53,  3.48it/s]
 13%|█▎        | 47649/371472 [3:48:21<26:05:52,  3.45it/s]
 13%|█▎        | 47650/371472 [3:48:22<26:18:19,  3.42it/s]
 13%|█▎        | 47651/371472 [3:48:22<25:16:46,  3.56it/s]
 13%|█▎        | 47652/371472 [3:48:22<25:18:40,  3.55it/s]
 13%|█▎        | 47653/371472 [3:48:22<23:59:34,  3.75it/s]
 13%|█▎        | 47654/371472 [3:48:23<24:05:32,  3.73it/s]
 13%|█▎        | 47655/371472 [3:48:23<26:28:58,  3.40it/s]
 13%|█▎        | 47656/371472 [3:48:23<24:59:39,  3.60it/s]
 13%|█▎        | 47657/371472 [3:48:24<27:00:57,  3.33it/s]
 13%|█▎        | 47658/371472 [3:48:24<28:05:56,  3.20it/s]
 13%|█▎        | 47659/371472 [3:48:24<27:43:09,  3.24it/s]
 13%|█▎        | 47660/371472 [3:48:24<26:23:16,  3.41it/s]
                                                           
{'loss': 4.3799, 'learning_rate': 8.849522721885841e-07, 'epoch': 2.05}

 13%|█▎        | 47660/371472 [3:48:24<26:23:16,  3.41it/s]
 13%|█▎        | 47661/371472 [3:48:25<25:53:37,  3.47it/s]
 13%|█▎        | 47662/371472 [3:48:25<24:41:06,  3.64it/s]
 13%|█▎        | 47663/371472 [3:48:25<24:52:59,  3.61it/s]
 13%|█▎        | 47664/371472 [3:48:26<24:27:19,  3.68it/s]
 13%|█▎        | 47665/371472 [3:48:26<23:58:16,  3.75it/s]
 13%|█▎        | 47666/371472 [3:48:26<24:20:33,  3.69it/s]
 13%|█▎        | 47667/371472 [3:48:26<23:41:52,  3.80it/s]
 13%|█▎        | 47668/371472 [3:48:27<23:34:51,  3.81it/s]
 13%|█▎        | 47669/371472 [3:48:27<23:11:50,  3.88it/s]
 13%|█▎        | 47670/371472 [3:48:27<23:46:42,  3.78it/s]
 13%|█▎        | 47671/371472 [3:48:27<23:41:16,  3.80it/s]
 13%|█▎        | 47672/371472 [3:48:28<24:07:55,  3.73it/s]
 13%|█▎        | 47673/371472 [3:48:28<24:54:30,  3.61it/s]
 13%|█▎        | 47674/371472 [3:48:28<24:39:44,  3.65it/s]
 13%|█▎        | 47675/371472 [3:48:28<24:13:52,  3.71it/s]
 13%|█▎        | 47676/371472 [3:48:29<24:41:03,  3.64it/s]
 13%|█▎        | 47677/371472 [3:48:29<24:50:58,  3.62it/s]
 13%|█▎        | 47678/371472 [3:48:29<24:14:52,  3.71it/s]
 13%|█▎        | 47679/371472 [3:48:30<25:35:43,  3.51it/s]
 13%|█▎        | 47680/371472 [3:48:30<28:10:04,  3.19it/s]
                                                           
{'loss': 4.2715, 'learning_rate': 8.849037902131052e-07, 'epoch': 2.05}

 13%|█▎        | 47680/371472 [3:48:30<28:10:04,  3.19it/s]
 13%|█▎        | 47681/371472 [3:48:30<26:38:32,  3.38it/s]
 13%|█▎        | 47682/371472 [3:48:31<28:00:22,  3.21it/s]
 13%|█▎        | 47683/371472 [3:48:31<27:01:09,  3.33it/s]
 13%|█▎        | 47684/371472 [3:48:31<27:57:49,  3.22it/s]
 13%|█▎        | 47685/371472 [3:48:31<26:14:29,  3.43it/s]
 13%|█▎        | 47686/371472 [3:48:32<25:10:21,  3.57it/s]
 13%|█▎        | 47687/371472 [3:48:32<27:13:57,  3.30it/s]
 13%|█▎        | 47688/371472 [3:48:32<25:16:17,  3.56it/s]
 13%|█▎        | 47689/371472 [3:48:33<26:24:05,  3.41it/s]
 13%|█▎        | 47690/371472 [3:48:33<25:08:43,  3.58it/s]
 13%|█▎        | 47691/371472 [3:48:33<24:53:58,  3.61it/s]
 13%|█▎        | 47692/371472 [3:48:33<24:18:02,  3.70it/s]
 13%|█▎        | 47693/371472 [3:48:34<24:36:18,  3.66it/s]
 13%|█▎        | 47694/371472 [3:48:34<23:38:55,  3.80it/s]
 13%|█▎        | 47695/371472 [3:48:34<23:35:20,  3.81it/s]
 13%|█▎        | 47696/371472 [3:48:34<23:28:42,  3.83it/s]
 13%|█▎        | 47697/371472 [3:48:35<25:51:20,  3.48it/s]
 13%|█▎        | 47698/371472 [3:48:35<27:35:46,  3.26it/s]
 13%|█▎        | 47699/371472 [3:48:35<25:55:07,  3.47it/s]
 13%|█▎        | 47700/371472 [3:48:36<24:49:19,  3.62it/s]
                                                           
{'loss': 4.3085, 'learning_rate': 8.848553082376264e-07, 'epoch': 2.05}

 13%|█▎        | 47700/371472 [3:48:36<24:49:19,  3.62it/s]
 13%|█▎        | 47701/371472 [3:48:36<24:34:00,  3.66it/s]
 13%|█▎        | 47702/371472 [3:48:36<23:25:36,  3.84it/s]
 13%|█▎        | 47703/371472 [3:48:36<24:47:32,  3.63it/s]
 13%|█▎        | 47704/371472 [3:48:37<24:56:08,  3.61it/s]
 13%|█▎        | 47705/371472 [3:48:37<27:08:43,  3.31it/s]
 13%|█▎        | 47706/371472 [3:48:37<25:57:19,  3.46it/s]
 13%|█▎        | 47707/371472 [3:48:38<26:35:13,  3.38it/s]
 13%|█▎        | 47708/371472 [3:48:38<26:47:04,  3.36it/s]
 13%|█▎        | 47709/371472 [3:48:38<25:50:19,  3.48it/s]
 13%|█▎        | 47710/371472 [3:48:38<25:50:36,  3.48it/s]
 13%|█▎        | 47711/371472 [3:48:39<25:18:14,  3.55it/s]
 13%|█▎        | 47712/371472 [3:48:39<24:24:48,  3.68it/s]
 13%|█▎        | 47713/371472 [3:48:39<24:27:21,  3.68it/s]
 13%|█▎        | 47714/371472 [3:48:40<24:04:28,  3.74it/s]
 13%|█▎        | 47715/371472 [3:48:40<24:54:34,  3.61it/s]
 13%|█▎        | 47716/371472 [3:48:40<24:42:08,  3.64it/s]
 13%|█▎        | 47717/371472 [3:48:40<24:21:47,  3.69it/s]
 13%|█▎        | 47718/371472 [3:48:41<25:37:07,  3.51it/s]
 13%|█▎        | 47719/371472 [3:48:41<26:07:52,  3.44it/s]
 13%|█▎        | 47720/371472 [3:48:41<25:15:36,  3.56it/s]
                                                           
{'loss': 4.4178, 'learning_rate': 8.848068262621473e-07, 'epoch': 2.06}

 13%|█▎        | 47720/371472 [3:48:41<25:15:36,  3.56it/s]
 13%|█▎        | 47721/371472 [3:48:42<24:49:57,  3.62it/s]
 13%|█▎        | 47722/371472 [3:48:42<25:02:09,  3.59it/s]
 13%|█▎        | 47723/371472 [3:48:42<25:04:55,  3.59it/s]
 13%|█▎        | 47724/371472 [3:48:42<25:19:07,  3.55it/s]
 13%|█▎        | 47725/371472 [3:48:43<26:58:57,  3.33it/s]
 13%|█▎        | 47726/371472 [3:48:43<25:47:30,  3.49it/s]
 13%|█▎        | 47727/371472 [3:48:43<24:40:17,  3.65it/s]
 13%|█▎        | 47728/371472 [3:48:44<25:39:35,  3.50it/s]
 13%|█▎        | 47729/371472 [3:48:44<25:02:28,  3.59it/s]
 13%|█▎        | 47730/371472 [3:48:44<24:46:05,  3.63it/s]
 13%|█▎        | 47731/371472 [3:48:44<24:30:33,  3.67it/s]
 13%|█▎        | 47732/371472 [3:48:45<24:01:11,  3.74it/s]
 13%|█▎        | 47733/371472 [3:48:45<26:47:19,  3.36it/s]
 13%|█▎        | 47734/371472 [3:48:45<25:49:31,  3.48it/s]
 13%|█▎        | 47735/371472 [3:48:45<24:45:04,  3.63it/s]
 13%|█▎        | 47736/371472 [3:48:46<24:23:29,  3.69it/s]
 13%|█▎        | 47737/371472 [3:48:46<24:20:04,  3.70it/s]
 13%|█▎        | 47738/371472 [3:48:46<26:15:26,  3.42it/s]
 13%|█▎        | 47739/371472 [3:48:47<25:37:58,  3.51it/s]
 13%|█▎        | 47740/371472 [3:48:47<26:47:09,  3.36it/s]
                                                           
{'loss': 4.3978, 'learning_rate': 8.847583442866685e-07, 'epoch': 2.06}

 13%|█▎        | 47740/371472 [3:48:47<26:47:09,  3.36it/s]
 13%|█▎        | 47741/371472 [3:48:47<25:48:11,  3.49it/s]
 13%|█▎        | 47742/371472 [3:48:47<24:57:09,  3.60it/s]
 13%|█▎        | 47743/371472 [3:48:48<25:21:49,  3.55it/s]
 13%|█▎        | 47744/371472 [3:48:48<24:17:26,  3.70it/s]
 13%|█▎        | 47745/371472 [3:48:48<23:40:02,  3.80it/s]
 13%|█▎        | 47746/371472 [3:48:48<23:33:07,  3.82it/s]
 13%|█▎        | 47747/371472 [3:48:49<25:47:28,  3.49it/s]
 13%|█▎        | 47748/371472 [3:48:49<25:06:29,  3.58it/s]
 13%|█▎        | 47749/371472 [3:48:49<25:20:44,  3.55it/s]
 13%|█▎        | 47750/371472 [3:48:50<23:53:47,  3.76it/s]
 13%|█▎        | 47751/371472 [3:48:50<26:17:26,  3.42it/s]
 13%|█▎        | 47752/371472 [3:48:50<26:18:39,  3.42it/s]
 13%|█▎        | 47753/371472 [3:48:51<25:53:57,  3.47it/s]
 13%|█▎        | 47754/371472 [3:48:51<25:36:42,  3.51it/s]
 13%|█▎        | 47755/371472 [3:48:51<25:27:28,  3.53it/s]
 13%|█▎        | 47756/371472 [3:48:51<24:26:13,  3.68it/s]
 13%|█▎        | 47757/371472 [3:48:52<25:37:40,  3.51it/s]
 13%|█▎        | 47758/371472 [3:48:52<26:35:05,  3.38it/s]
 13%|█▎        | 47759/371472 [3:48:52<25:46:35,  3.49it/s]
 13%|█▎        | 47760/371472 [3:48:52<24:42:03,  3.64it/s]
                                                           
{'loss': 4.2653, 'learning_rate': 8.847098623111896e-07, 'epoch': 2.06}

 13%|█▎        | 47760/371472 [3:48:52<24:42:03,  3.64it/s]
 13%|█▎        | 47761/371472 [3:48:53<25:02:44,  3.59it/s]
 13%|█▎        | 47762/371472 [3:48:53<25:06:53,  3.58it/s]
 13%|█▎        | 47763/371472 [3:48:53<25:40:08,  3.50it/s]
 13%|█▎        | 47764/371472 [3:48:54<25:32:32,  3.52it/s]
 13%|█▎        | 47765/371472 [3:48:54<25:03:40,  3.59it/s]
 13%|█▎        | 47766/371472 [3:48:54<25:04:49,  3.59it/s]
 13%|█▎        | 47767/371472 [3:48:55<26:51:55,  3.35it/s]
 13%|█▎        | 47768/371472 [3:48:55<25:55:50,  3.47it/s]
 13%|█▎        | 47769/371472 [3:48:55<27:49:13,  3.23it/s]
 13%|█▎        | 47770/371472 [3:48:55<26:37:24,  3.38it/s]
 13%|█▎        | 47771/371472 [3:48:56<26:22:20,  3.41it/s]
 13%|█▎        | 47772/371472 [3:48:56<25:07:30,  3.58it/s]
 13%|█▎        | 47773/371472 [3:48:56<24:59:31,  3.60it/s]
 13%|█▎        | 47774/371472 [3:48:56<24:27:20,  3.68it/s]
 13%|█▎        | 47775/371472 [3:48:57<24:04:03,  3.74it/s]
 13%|█▎        | 47776/371472 [3:48:57<24:10:09,  3.72it/s]
 13%|█▎        | 47777/371472 [3:48:57<23:52:54,  3.77it/s]
 13%|█▎        | 47778/371472 [3:48:58<23:49:44,  3.77it/s]
 13%|█▎        | 47779/371472 [3:48:58<23:23:56,  3.84it/s]
 13%|█▎        | 47780/371472 [3:48:58<23:51:22,  3.77it/s]
                                                           
{'loss': 4.3894, 'learning_rate': 8.846613803357107e-07, 'epoch': 2.06}

 13%|█▎        | 47780/371472 [3:48:58<23:51:22,  3.77it/s]
 13%|█▎        | 47781/371472 [3:48:58<24:08:05,  3.73it/s]
 13%|█▎        | 47782/371472 [3:48:59<23:34:43,  3.81it/s]
 13%|█▎        | 47783/371472 [3:48:59<25:27:16,  3.53it/s]
 13%|█▎        | 47784/371472 [3:48:59<25:19:41,  3.55it/s]
 13%|█▎        | 47785/371472 [3:48:59<25:38:29,  3.51it/s]
 13%|█▎        | 47786/371472 [3:49:00<24:43:57,  3.64it/s]
 13%|█▎        | 47787/371472 [3:49:00<24:46:48,  3.63it/s]
 13%|█▎        | 47788/371472 [3:49:00<24:18:50,  3.70it/s]
 13%|█▎        | 47789/371472 [3:49:01<25:15:25,  3.56it/s]
 13%|█▎        | 47790/371472 [3:49:01<25:00:51,  3.59it/s]
 13%|█▎        | 47791/371472 [3:49:01<25:45:20,  3.49it/s]
 13%|█▎        | 47792/371472 [3:49:02<30:14:13,  2.97it/s]
 13%|█▎        | 47793/371472 [3:49:02<28:24:45,  3.16it/s]
 13%|█▎        | 47794/371472 [3:49:02<29:29:23,  3.05it/s]
 13%|█▎        | 47795/371472 [3:49:02<27:41:18,  3.25it/s]
 13%|█▎        | 47796/371472 [3:49:03<27:19:03,  3.29it/s]
 13%|█▎        | 47797/371472 [3:49:03<27:13:55,  3.30it/s]
 13%|█▎        | 47798/371472 [3:49:03<26:51:13,  3.35it/s]
 13%|█▎        | 47799/371472 [3:49:04<26:34:09,  3.38it/s]
 13%|█▎        | 47800/371472 [3:49:04<27:10:11,  3.31it/s]
                                                           
{'loss': 4.1731, 'learning_rate': 8.846128983602318e-07, 'epoch': 2.06}

 13%|█▎        | 47800/371472 [3:49:04<27:10:11,  3.31it/s]
 13%|█▎        | 47801/371472 [3:49:04<27:40:44,  3.25it/s]
 13%|█▎        | 47802/371472 [3:49:05<26:18:10,  3.42it/s]
 13%|█▎        | 47803/371472 [3:49:05<25:43:19,  3.50it/s]
 13%|█▎        | 47804/371472 [3:49:05<26:01:59,  3.45it/s]
 13%|█▎        | 47805/371472 [3:49:05<25:21:50,  3.54it/s]
 13%|█▎        | 47806/371472 [3:49:06<24:39:32,  3.65it/s]
 13%|█▎        | 47807/371472 [3:49:06<24:48:59,  3.62it/s]
 13%|█▎        | 47808/371472 [3:49:06<23:53:08,  3.76it/s]
 13%|█▎        | 47809/371472 [3:49:06<23:07:51,  3.89it/s]
 13%|█▎        | 47810/371472 [3:49:07<24:32:36,  3.66it/s]
 13%|█▎        | 47811/371472 [3:49:07<24:05:50,  3.73it/s]
 13%|█▎        | 47812/371472 [3:49:07<25:06:20,  3.58it/s]
 13%|█▎        | 47813/371472 [3:49:08<25:07:20,  3.58it/s]
 13%|█▎        | 47814/371472 [3:49:08<25:04:32,  3.59it/s]
 13%|█▎        | 47815/371472 [3:49:08<24:59:18,  3.60it/s]
 13%|█▎        | 47816/371472 [3:49:08<25:45:06,  3.49it/s]
 13%|█▎        | 47817/371472 [3:49:09<24:53:10,  3.61it/s]
 13%|█▎        | 47818/371472 [3:49:09<23:42:59,  3.79it/s]
 13%|█▎        | 47819/371472 [3:49:09<23:55:08,  3.76it/s]
 13%|█▎        | 47820/371472 [3:49:09<25:07:19,  3.58it/s]
                                                           
{'loss': 4.2996, 'learning_rate': 8.845644163847529e-07, 'epoch': 2.06}

 13%|█▎        | 47820/371472 [3:49:09<25:07:19,  3.58it/s]
 13%|█▎        | 47821/371472 [3:49:10<25:50:05,  3.48it/s]
 13%|█▎        | 47822/371472 [3:49:10<25:19:05,  3.55it/s]
 13%|█▎        | 47823/371472 [3:49:10<27:37:50,  3.25it/s]
 13%|█▎        | 47824/371472 [3:49:11<26:18:09,  3.42it/s]
 13%|█▎        | 47825/371472 [3:49:11<26:02:19,  3.45it/s]
 13%|█▎        | 47826/371472 [3:49:11<24:46:45,  3.63it/s]
 13%|█▎        | 47827/371472 [3:49:11<24:44:31,  3.63it/s]
 13%|█▎        | 47828/371472 [3:49:12<24:36:07,  3.65it/s]
 13%|█▎        | 47829/371472 [3:49:12<25:14:20,  3.56it/s]
 13%|█▎        | 47830/371472 [3:49:12<24:53:08,  3.61it/s]
 13%|█▎        | 47831/371472 [3:49:13<25:15:13,  3.56it/s]
 13%|█▎        | 47832/371472 [3:49:13<26:38:46,  3.37it/s]
 13%|█▎        | 47833/371472 [3:49:13<25:49:59,  3.48it/s]
 13%|█▎        | 47834/371472 [3:49:13<24:50:11,  3.62it/s]
 13%|█▎        | 47835/371472 [3:49:14<25:50:48,  3.48it/s]
 13%|█▎        | 47836/371472 [3:49:14<25:55:49,  3.47it/s]
 13%|█▎        | 47837/371472 [3:49:14<26:27:19,  3.40it/s]
 13%|█▎        | 47838/371472 [3:49:15<25:43:36,  3.49it/s]
 13%|█▎        | 47839/371472 [3:49:15<24:22:36,  3.69it/s]
 13%|█▎        | 47840/371472 [3:49:15<25:33:27,  3.52it/s]
                                                           
{'loss': 4.2233, 'learning_rate': 8.845159344092741e-07, 'epoch': 2.06}

 13%|█▎        | 47840/371472 [3:49:15<25:33:27,  3.52it/s]
 13%|█▎        | 47841/371472 [3:49:15<24:31:53,  3.66it/s]
 13%|█▎        | 47842/371472 [3:49:16<23:47:50,  3.78it/s]
 13%|█▎        | 47843/371472 [3:49:16<23:26:04,  3.84it/s]
 13%|█▎        | 47844/371472 [3:49:16<23:32:44,  3.82it/s]
 13%|█▎        | 47845/371472 [3:49:16<24:41:08,  3.64it/s]
 13%|█▎        | 47846/371472 [3:49:17<24:54:48,  3.61it/s]
 13%|█▎        | 47847/371472 [3:49:17<24:43:34,  3.64it/s]
 13%|█▎        | 47848/371472 [3:49:18<32:44:52,  2.75it/s]
 13%|█▎        | 47849/371472 [3:49:18<30:06:36,  2.99it/s]
 13%|█▎        | 47850/371472 [3:49:18<29:15:13,  3.07it/s]
 13%|█▎        | 47851/371472 [3:49:18<28:40:08,  3.14it/s]
 13%|█▎        | 47852/371472 [3:49:19<29:15:57,  3.07it/s]
 13%|█▎        | 47853/371472 [3:49:19<27:15:53,  3.30it/s]
 13%|█▎        | 47854/371472 [3:49:19<26:12:40,  3.43it/s]
 13%|█▎        | 47855/371472 [3:49:20<25:26:36,  3.53it/s]
 13%|█▎        | 47856/371472 [3:49:20<24:22:02,  3.69it/s]
 13%|█▎        | 47857/371472 [3:49:20<23:15:29,  3.86it/s]
 13%|█▎        | 47858/371472 [3:49:20<23:17:04,  3.86it/s]
 13%|█▎        | 47859/371472 [3:49:21<22:43:45,  3.95it/s]
 13%|█▎        | 47860/371472 [3:49:21<23:14:17,  3.87it/s]
                                                           
{'loss': 4.3654, 'learning_rate': 8.844674524337951e-07, 'epoch': 2.06}

 13%|█▎        | 47860/371472 [3:49:21<23:14:17,  3.87it/s]
 13%|█▎        | 47861/371472 [3:49:21<23:12:49,  3.87it/s]
 13%|█▎        | 47862/371472 [3:49:21<23:42:02,  3.79it/s]
 13%|█▎        | 47863/371472 [3:49:22<25:28:28,  3.53it/s]
 13%|█▎        | 47864/371472 [3:49:22<25:18:00,  3.55it/s]
 13%|█▎        | 47865/371472 [3:49:22<25:38:26,  3.51it/s]
 13%|█▎        | 47866/371472 [3:49:23<25:03:23,  3.59it/s]
 13%|█▎        | 47867/371472 [3:49:23<25:10:06,  3.57it/s]
 13%|█▎        | 47868/371472 [3:49:23<24:24:36,  3.68it/s]
 13%|█▎        | 47869/371472 [3:49:23<24:20:11,  3.69it/s]
 13%|█▎        | 47870/371472 [3:49:24<23:52:35,  3.76it/s]
 13%|█▎        | 47871/371472 [3:49:24<23:31:01,  3.82it/s]
 13%|█▎        | 47872/371472 [3:49:24<24:18:02,  3.70it/s]
 13%|█▎        | 47873/371472 [3:49:24<24:16:37,  3.70it/s]
 13%|█▎        | 47874/371472 [3:49:25<23:55:21,  3.76it/s]
 13%|█▎        | 47875/371472 [3:49:25<24:24:35,  3.68it/s]
 13%|█▎        | 47876/371472 [3:49:25<23:48:07,  3.78it/s]
 13%|█▎        | 47877/371472 [3:49:25<23:29:29,  3.83it/s]
 13%|█▎        | 47878/371472 [3:49:26<22:53:05,  3.93it/s]
 13%|█▎        | 47879/371472 [3:49:26<23:16:12,  3.86it/s]
 13%|█▎        | 47880/371472 [3:49:26<23:26:57,  3.83it/s]
                                                           
{'loss': 4.1437, 'learning_rate': 8.844189704583162e-07, 'epoch': 2.06}

 13%|█▎        | 47880/371472 [3:49:26<23:26:57,  3.83it/s]
 13%|█▎        | 47881/371472 [3:49:27<24:10:32,  3.72it/s]
 13%|█▎        | 47882/371472 [3:49:27<24:06:32,  3.73it/s]
 13%|█▎        | 47883/371472 [3:49:27<23:59:41,  3.75it/s]
 13%|█▎        | 47884/371472 [3:49:27<24:33:32,  3.66it/s]
 13%|█▎        | 47885/371472 [3:49:28<25:19:41,  3.55it/s]
 13%|█▎        | 47886/371472 [3:49:28<25:09:17,  3.57it/s]
 13%|█▎        | 47887/371472 [3:49:28<25:39:01,  3.50it/s]
 13%|█▎        | 47888/371472 [3:49:29<26:18:28,  3.42it/s]
 13%|█▎        | 47889/371472 [3:49:29<26:15:22,  3.42it/s]
 13%|█▎        | 47890/371472 [3:49:29<25:31:42,  3.52it/s]
 13%|█▎        | 47891/371472 [3:49:29<25:42:27,  3.50it/s]
 13%|█▎        | 47892/371472 [3:49:30<25:27:43,  3.53it/s]
 13%|█▎        | 47893/371472 [3:49:30<26:28:18,  3.40it/s]
 13%|█▎        | 47894/371472 [3:49:30<26:40:32,  3.37it/s]
 13%|█▎        | 47895/371472 [3:49:31<32:38:54,  2.75it/s]
 13%|█▎        | 47896/371472 [3:49:31<30:31:06,  2.95it/s]
 13%|█▎        | 47897/371472 [3:49:31<30:22:04,  2.96it/s]
 13%|█▎        | 47898/371472 [3:49:32<28:05:37,  3.20it/s]
 13%|█▎        | 47899/371472 [3:49:32<26:36:37,  3.38it/s]
 13%|█▎        | 47900/371472 [3:49:32<28:03:36,  3.20it/s]
                                                           
{'loss': 4.3644, 'learning_rate': 8.843704884828373e-07, 'epoch': 2.06}

 13%|█▎        | 47900/371472 [3:49:32<28:03:36,  3.20it/s]
 13%|█▎        | 47901/371472 [3:49:33<28:17:34,  3.18it/s]
 13%|█▎        | 47902/371472 [3:49:33<26:55:10,  3.34it/s]
 13%|█▎        | 47903/371472 [3:49:33<25:47:49,  3.48it/s]
 13%|█▎        | 47904/371472 [3:49:33<25:48:45,  3.48it/s]
 13%|█▎        | 47905/371472 [3:49:34<25:47:31,  3.48it/s]
 13%|█▎        | 47906/371472 [3:49:34<26:24:58,  3.40it/s]
 13%|█▎        | 47907/371472 [3:49:34<24:51:16,  3.62it/s]
 13%|█▎        | 47908/371472 [3:49:35<25:22:33,  3.54it/s]
 13%|█▎        | 47909/371472 [3:49:35<24:15:57,  3.70it/s]
 13%|█▎        | 47910/371472 [3:49:35<24:23:35,  3.68it/s]
 13%|█▎        | 47911/371472 [3:49:35<24:22:06,  3.69it/s]
 13%|█▎        | 47912/371472 [3:49:36<24:34:55,  3.66it/s]
 13%|█▎        | 47913/371472 [3:49:36<24:11:35,  3.71it/s]
 13%|█▎        | 47914/371472 [3:49:36<24:17:41,  3.70it/s]
 13%|█▎        | 47915/371472 [3:49:36<24:28:03,  3.67it/s]
 13%|█▎        | 47916/371472 [3:49:37<27:57:47,  3.21it/s]
 13%|█▎        | 47917/371472 [3:49:37<27:13:48,  3.30it/s]
 13%|█▎        | 47918/371472 [3:49:37<28:43:01,  3.13it/s]
 13%|█▎        | 47919/371472 [3:49:38<27:32:37,  3.26it/s]
 13%|█▎        | 47920/371472 [3:49:38<27:16:27,  3.30it/s]
                                                           
{'loss': 4.2227, 'learning_rate': 8.843220065073585e-07, 'epoch': 2.06}

 13%|█▎        | 47920/371472 [3:49:38<27:16:27,  3.30it/s]
 13%|█▎        | 47921/371472 [3:49:38<27:32:45,  3.26it/s]
 13%|█▎        | 47922/371472 [3:49:39<26:50:06,  3.35it/s]
 13%|█▎        | 47923/371472 [3:49:39<25:52:57,  3.47it/s]
 13%|█▎        | 47924/371472 [3:49:39<25:16:41,  3.56it/s]
 13%|█▎        | 47925/371472 [3:49:39<24:38:32,  3.65it/s]
 13%|█▎        | 47926/371472 [3:49:40<24:59:32,  3.60it/s]
 13%|█▎        | 47927/371472 [3:49:40<24:04:45,  3.73it/s]
 13%|█▎        | 47928/371472 [3:49:40<25:21:45,  3.54it/s]
 13%|█▎        | 47929/371472 [3:49:41<26:29:19,  3.39it/s]
 13%|█▎        | 47930/371472 [3:49:41<25:34:06,  3.51it/s]
 13%|█▎        | 47931/371472 [3:49:41<24:34:43,  3.66it/s]
 13%|█▎        | 47932/371472 [3:49:41<23:51:24,  3.77it/s]
 13%|█▎        | 47933/371472 [3:49:42<23:58:00,  3.75it/s]
 13%|█▎        | 47934/371472 [3:49:42<23:39:19,  3.80it/s]
 13%|█▎        | 47935/371472 [3:49:42<23:56:31,  3.75it/s]
 13%|█▎        | 47936/371472 [3:49:42<23:41:14,  3.79it/s]
 13%|█▎        | 47937/371472 [3:49:43<23:53:59,  3.76it/s]
 13%|█▎        | 47938/371472 [3:49:43<24:39:22,  3.64it/s]
 13%|█▎        | 47939/371472 [3:49:43<25:28:43,  3.53it/s]
 13%|█▎        | 47940/371472 [3:49:44<26:27:12,  3.40it/s]
                                                           
{'loss': 4.0454, 'learning_rate': 8.842735245318796e-07, 'epoch': 2.06}

 13%|█▎        | 47940/371472 [3:49:44<26:27:12,  3.40it/s]
 13%|█▎        | 47941/371472 [3:49:44<26:44:19,  3.36it/s]
 13%|█▎        | 47942/371472 [3:49:44<25:38:35,  3.50it/s]
 13%|█▎        | 47943/371472 [3:49:44<25:28:29,  3.53it/s]
 13%|█▎        | 47944/371472 [3:49:45<24:22:11,  3.69it/s]
 13%|█▎        | 47945/371472 [3:49:45<24:13:40,  3.71it/s]
 13%|█▎        | 47946/371472 [3:49:45<25:44:35,  3.49it/s]
 13%|█▎        | 47947/371472 [3:49:46<28:43:18,  3.13it/s]
 13%|█▎        | 47948/371472 [3:49:46<28:11:02,  3.19it/s]
 13%|█▎        | 47949/371472 [3:49:46<29:10:12,  3.08it/s]
 13%|█▎        | 47950/371472 [3:49:47<27:23:50,  3.28it/s]
 13%|█▎        | 47951/371472 [3:49:47<25:29:08,  3.53it/s]
 13%|█▎        | 47952/371472 [3:49:47<24:14:38,  3.71it/s]
 13%|█▎        | 47953/371472 [3:49:47<23:37:39,  3.80it/s]
 13%|█▎        | 47954/371472 [3:49:48<23:22:39,  3.84it/s]
 13%|█▎        | 47955/371472 [3:49:48<23:48:33,  3.77it/s]
 13%|█▎        | 47956/371472 [3:49:48<24:55:15,  3.61it/s]
 13%|█▎        | 47957/371472 [3:49:48<25:00:53,  3.59it/s]
 13%|█▎        | 47958/371472 [3:49:49<24:12:44,  3.71it/s]
 13%|█▎        | 47959/371472 [3:49:49<24:31:08,  3.67it/s]
 13%|█▎        | 47960/371472 [3:49:49<23:48:48,  3.77it/s]
                                                           
{'loss': 4.4391, 'learning_rate': 8.842250425564007e-07, 'epoch': 2.07}

 13%|█▎        | 47960/371472 [3:49:49<23:48:48,  3.77it/s]
 13%|█▎        | 47961/371472 [3:49:49<25:08:30,  3.57it/s]
 13%|█▎        | 47962/371472 [3:49:50<26:15:55,  3.42it/s]
 13%|█▎        | 47963/371472 [3:49:50<30:32:58,  2.94it/s]
 13%|█▎        | 47964/371472 [3:49:51<29:08:13,  3.08it/s]
 13%|█▎        | 47965/371472 [3:49:51<27:41:56,  3.24it/s]
 13%|█▎        | 47966/371472 [3:49:51<26:34:40,  3.38it/s]
 13%|█▎        | 47967/371472 [3:49:51<28:20:39,  3.17it/s]
 13%|█▎        | 47968/371472 [3:49:52<26:07:35,  3.44it/s]
 13%|█▎        | 47969/371472 [3:49:52<24:44:11,  3.63it/s]
 13%|█▎        | 47970/371472 [3:49:52<23:43:41,  3.79it/s]
 13%|█▎        | 47971/371472 [3:49:52<24:55:44,  3.60it/s]
 13%|█▎        | 47972/371472 [3:49:53<25:34:39,  3.51it/s]
 13%|█▎        | 47973/371472 [3:49:53<25:19:34,  3.55it/s]
 13%|█▎        | 47974/371472 [3:49:53<25:38:25,  3.50it/s]
 13%|█▎        | 47975/371472 [3:49:54<24:50:47,  3.62it/s]
 13%|█▎        | 47976/371472 [3:49:54<24:20:26,  3.69it/s]
 13%|█▎        | 47977/371472 [3:49:54<24:10:24,  3.72it/s]
 13%|█▎        | 47978/371472 [3:49:54<23:18:58,  3.85it/s]
 13%|█▎        | 47979/371472 [3:49:55<23:29:23,  3.83it/s]
 13%|█▎        | 47980/371472 [3:49:55<25:13:13,  3.56it/s]
                                                           
{'loss': 4.3234, 'learning_rate': 8.841765605809217e-07, 'epoch': 2.07}

 13%|█▎        | 47980/371472 [3:49:55<25:13:13,  3.56it/s]
 13%|█▎        | 47981/371472 [3:49:55<24:10:14,  3.72it/s]
 13%|█▎        | 47982/371472 [3:49:55<24:28:58,  3.67it/s]
 13%|█▎        | 47983/371472 [3:49:56<23:35:43,  3.81it/s]
 13%|█▎        | 47984/371472 [3:49:56<23:24:56,  3.84it/s]
 13%|█▎        | 47985/371472 [3:49:56<24:19:53,  3.69it/s]
 13%|█▎        | 47986/371472 [3:49:56<23:43:33,  3.79it/s]
 13%|█▎        | 47987/371472 [3:49:57<26:35:53,  3.38it/s]
 13%|█▎        | 47988/371472 [3:49:57<25:24:27,  3.54it/s]
 13%|█▎        | 47989/371472 [3:49:57<24:43:55,  3.63it/s]
 13%|█▎        | 47990/371472 [3:49:58<25:57:24,  3.46it/s]
 13%|█▎        | 47991/371472 [3:49:58<25:48:50,  3.48it/s]
 13%|█▎        | 47992/371472 [3:49:58<26:14:58,  3.42it/s]
 13%|█▎        | 47993/371472 [3:49:59<25:51:31,  3.47it/s]
 13%|█▎        | 47994/371472 [3:49:59<28:24:24,  3.16it/s]
 13%|█▎        | 47995/371472 [3:49:59<26:33:31,  3.38it/s]
 13%|█▎        | 47996/371472 [3:49:59<26:18:45,  3.41it/s]
 13%|█▎        | 47997/371472 [3:50:00<28:30:05,  3.15it/s]
 13%|█▎        | 47998/371472 [3:50:00<27:29:36,  3.27it/s]
 13%|█▎        | 47999/371472 [3:50:00<25:58:10,  3.46it/s]
 13%|█▎        | 48000/371472 [3:50:01<26:18:14,  3.42it/s]
                                                           
{'loss': 4.2496, 'learning_rate': 8.841280786054429e-07, 'epoch': 2.07}

 13%|█▎        | 48000/371472 [3:50:01<26:18:14,  3.42it/s]
 13%|█▎        | 48001/371472 [3:50:01<25:12:56,  3.56it/s]
 13%|█▎        | 48002/371472 [3:50:01<25:27:51,  3.53it/s]
 13%|█▎        | 48003/371472 [3:50:02<25:50:25,  3.48it/s]
 13%|█▎        | 48004/371472 [3:50:02<27:40:15,  3.25it/s]
 13%|█▎        | 48005/371472 [3:50:02<26:07:39,  3.44it/s]
 13%|█▎        | 48006/371472 [3:50:02<28:20:47,  3.17it/s]
 13%|█▎        | 48007/371472 [3:50:03<29:10:41,  3.08it/s]
 13%|█▎        | 48008/371472 [3:50:03<27:53:05,  3.22it/s]
 13%|█▎        | 48009/371472 [3:50:03<26:14:04,  3.42it/s]
 13%|█▎        | 48010/371472 [3:50:04<25:34:23,  3.51it/s]
 13%|█▎        | 48011/371472 [3:50:04<24:36:55,  3.65it/s]
 13%|█▎        | 48012/371472 [3:50:04<23:58:25,  3.75it/s]
 13%|█▎        | 48013/371472 [3:50:04<23:11:21,  3.87it/s]
 13%|█▎        | 48014/371472 [3:50:05<22:37:46,  3.97it/s]
 13%|█▎        | 48015/371472 [3:50:05<22:49:30,  3.94it/s]
 13%|█▎        | 48016/371472 [3:50:05<23:54:19,  3.76it/s]
 13%|█▎        | 48017/371472 [3:50:05<24:15:32,  3.70it/s]
 13%|█▎        | 48018/371472 [3:50:06<26:35:56,  3.38it/s]
 13%|█▎        | 48019/371472 [3:50:06<25:25:40,  3.53it/s]
 13%|█▎        | 48020/371472 [3:50:06<24:09:19,  3.72it/s]
                                                           
{'loss': 4.166, 'learning_rate': 8.84079596629964e-07, 'epoch': 2.07}

 13%|█▎        | 48020/371472 [3:50:06<24:09:19,  3.72it/s]
 13%|█▎        | 48021/371472 [3:50:07<24:15:49,  3.70it/s]
 13%|█▎        | 48022/371472 [3:50:07<23:41:17,  3.79it/s]
 13%|█▎        | 48023/371472 [3:50:07<23:30:57,  3.82it/s]
 13%|█▎        | 48024/371472 [3:50:07<23:52:43,  3.76it/s]
 13%|█▎        | 48025/371472 [3:50:08<26:54:37,  3.34it/s]
 13%|█▎        | 48026/371472 [3:50:08<25:35:19,  3.51it/s]
 13%|█▎        | 48027/371472 [3:50:08<27:20:58,  3.29it/s]
 13%|█▎        | 48028/371472 [3:50:09<26:03:07,  3.45it/s]
 13%|█▎        | 48029/371472 [3:50:09<26:49:01,  3.35it/s]
 13%|█▎        | 48030/371472 [3:50:09<27:27:36,  3.27it/s]
 13%|█▎        | 48031/371472 [3:50:09<26:25:10,  3.40it/s]
 13%|█▎        | 48032/371472 [3:50:10<27:08:52,  3.31it/s]
 13%|█▎        | 48033/371472 [3:50:10<26:48:52,  3.35it/s]
 13%|█▎        | 48034/371472 [3:50:10<25:52:23,  3.47it/s]
 13%|█▎        | 48035/371472 [3:50:11<25:08:47,  3.57it/s]
 13%|█▎        | 48036/371472 [3:50:11<25:12:53,  3.56it/s]
 13%|█▎        | 48037/371472 [3:50:11<24:19:49,  3.69it/s]
 13%|█▎        | 48038/371472 [3:50:11<24:44:23,  3.63it/s]
 13%|█▎        | 48039/371472 [3:50:12<24:44:48,  3.63it/s]
 13%|█▎        | 48040/371472 [3:50:12<25:44:25,  3.49it/s]
                                                           
{'loss': 4.2374, 'learning_rate': 8.840311146544851e-07, 'epoch': 2.07}

 13%|█▎        | 48040/371472 [3:50:12<25:44:25,  3.49it/s]
 13%|█▎        | 48041/371472 [3:50:12<25:07:57,  3.57it/s]
 13%|█▎        | 48042/371472 [3:50:13<24:28:37,  3.67it/s]
 13%|█▎        | 48043/371472 [3:50:13<24:23:31,  3.68it/s]
 13%|█▎        | 48044/371472 [3:50:13<24:35:27,  3.65it/s]
 13%|█▎        | 48045/371472 [3:50:13<24:49:06,  3.62it/s]
 13%|█▎        | 48046/371472 [3:50:14<25:58:38,  3.46it/s]
 13%|█▎        | 48047/371472 [3:50:14<26:13:06,  3.43it/s]
 13%|█▎        | 48048/371472 [3:50:14<26:30:13,  3.39it/s]
 13%|█▎        | 48049/371472 [3:50:15<25:11:34,  3.57it/s]
 13%|█▎        | 48050/371472 [3:50:15<24:36:33,  3.65it/s]
 13%|█▎        | 48051/371472 [3:50:15<24:15:41,  3.70it/s]
 13%|█▎        | 48052/371472 [3:50:15<26:25:13,  3.40it/s]
 13%|█▎        | 48053/371472 [3:50:16<25:36:37,  3.51it/s]
 13%|█▎        | 48054/371472 [3:50:16<25:39:14,  3.50it/s]
 13%|█▎        | 48055/371472 [3:50:16<26:47:23,  3.35it/s]
 13%|█▎        | 48056/371472 [3:50:17<25:58:15,  3.46it/s]
 13%|█▎        | 48057/371472 [3:50:17<25:48:22,  3.48it/s]
 13%|█▎        | 48058/371472 [3:50:17<25:33:31,  3.51it/s]
 13%|█▎        | 48059/371472 [3:50:17<25:05:20,  3.58it/s]
 13%|█▎        | 48060/371472 [3:50:18<25:29:37,  3.52it/s]
                                                           
{'loss': 4.2214, 'learning_rate': 8.839826326790062e-07, 'epoch': 2.07}

 13%|█▎        | 48060/371472 [3:50:18<25:29:37,  3.52it/s]
 13%|█▎        | 48061/371472 [3:50:18<25:19:34,  3.55it/s]
 13%|█▎        | 48062/371472 [3:50:18<25:24:33,  3.54it/s]
 13%|█▎        | 48063/371472 [3:50:19<26:35:23,  3.38it/s]
 13%|█▎        | 48064/371472 [3:50:19<26:06:11,  3.44it/s]
 13%|█▎        | 48065/371472 [3:50:19<26:16:48,  3.42it/s]
 13%|█▎        | 48066/371472 [3:50:19<26:22:02,  3.41it/s]
 13%|█▎        | 48067/371472 [3:50:20<24:59:43,  3.59it/s]
 13%|█▎        | 48068/371472 [3:50:20<24:36:29,  3.65it/s]
 13%|█▎        | 48069/371472 [3:50:20<23:59:26,  3.74it/s]
 13%|█▎        | 48070/371472 [3:50:20<24:05:15,  3.73it/s]
 13%|█▎        | 48071/371472 [3:50:21<24:09:24,  3.72it/s]
 13%|█▎        | 48072/371472 [3:50:21<23:48:15,  3.77it/s]
 13%|█▎        | 48073/371472 [3:50:21<27:13:47,  3.30it/s]
 13%|█▎        | 48074/371472 [3:50:22<26:32:45,  3.38it/s]
 13%|█▎        | 48075/371472 [3:50:22<25:59:49,  3.46it/s]
 13%|█▎        | 48076/371472 [3:50:22<25:04:25,  3.58it/s]
 13%|█▎        | 48077/371472 [3:50:22<25:23:01,  3.54it/s]
 13%|█▎        | 48078/371472 [3:50:23<25:03:51,  3.58it/s]
 13%|█▎        | 48079/371472 [3:50:23<26:56:47,  3.33it/s]
 13%|█▎        | 48080/371472 [3:50:23<26:34:23,  3.38it/s]
                                                           
{'loss': 4.177, 'learning_rate': 8.839341507035273e-07, 'epoch': 2.07}

 13%|█▎        | 48080/371472 [3:50:23<26:34:23,  3.38it/s]
 13%|█▎        | 48081/371472 [3:50:24<26:12:02,  3.43it/s]
 13%|█▎        | 48082/371472 [3:50:24<25:33:12,  3.52it/s]
 13%|█▎        | 48083/371472 [3:50:24<28:31:42,  3.15it/s]
 13%|█▎        | 48084/371472 [3:50:25<26:45:15,  3.36it/s]
 13%|█▎        | 48085/371472 [3:50:25<25:24:40,  3.54it/s]
 13%|█▎        | 48086/371472 [3:50:25<25:58:45,  3.46it/s]
 13%|█▎        | 48087/371472 [3:50:25<27:50:07,  3.23it/s]
 13%|█▎        | 48088/371472 [3:50:26<25:57:43,  3.46it/s]
 13%|█▎        | 48089/371472 [3:50:26<25:00:06,  3.59it/s]
 13%|█▎        | 48090/371472 [3:50:26<25:56:17,  3.46it/s]
 13%|█▎        | 48091/371472 [3:50:27<25:52:11,  3.47it/s]
 13%|█▎        | 48092/371472 [3:50:27<28:10:21,  3.19it/s]
 13%|█▎        | 48093/371472 [3:50:27<28:28:24,  3.15it/s]
 13%|█▎        | 48094/371472 [3:50:28<26:46:03,  3.36it/s]
 13%|█▎        | 48095/371472 [3:50:28<25:16:52,  3.55it/s]
 13%|█▎        | 48096/371472 [3:50:28<27:20:23,  3.29it/s]
 13%|█▎        | 48097/371472 [3:50:28<25:46:25,  3.49it/s]
 13%|█▎        | 48098/371472 [3:50:29<25:41:09,  3.50it/s]
 13%|█▎        | 48099/371472 [3:50:29<25:06:51,  3.58it/s]
 13%|█▎        | 48100/371472 [3:50:29<24:28:34,  3.67it/s]
                                                           
{'loss': 4.1296, 'learning_rate': 8.838856687280484e-07, 'epoch': 2.07}

 13%|█▎        | 48100/371472 [3:50:29<24:28:34,  3.67it/s]
 13%|█▎        | 48101/371472 [3:50:29<23:39:18,  3.80it/s]
 13%|█▎        | 48102/371472 [3:50:30<23:59:04,  3.75it/s]
 13%|█▎        | 48103/371472 [3:50:30<23:37:21,  3.80it/s]
 13%|█▎        | 48104/371472 [3:50:30<24:27:58,  3.67it/s]
 13%|█▎        | 48105/371472 [3:50:31<24:19:25,  3.69it/s]
 13%|█▎        | 48106/371472 [3:50:31<23:36:32,  3.80it/s]
 13%|█▎        | 48107/371472 [3:50:31<23:55:52,  3.75it/s]
 13%|█▎        | 48108/371472 [3:50:31<23:45:42,  3.78it/s]
 13%|█▎        | 48109/371472 [3:50:32<24:32:36,  3.66it/s]
 13%|█▎        | 48110/371472 [3:50:32<23:32:40,  3.81it/s]
 13%|█▎        | 48111/371472 [3:50:32<23:44:32,  3.78it/s]
 13%|█▎        | 48112/371472 [3:50:32<24:15:52,  3.70it/s]
 13%|█▎        | 48113/371472 [3:50:33<24:17:22,  3.70it/s]
 13%|█▎        | 48114/371472 [3:50:33<24:37:48,  3.65it/s]
 13%|█▎        | 48115/371472 [3:50:33<25:34:45,  3.51it/s]
 13%|█▎        | 48116/371472 [3:50:34<25:54:13,  3.47it/s]
 13%|█▎        | 48117/371472 [3:50:34<24:28:06,  3.67it/s]
 13%|█▎        | 48118/371472 [3:50:34<23:45:25,  3.78it/s]
 13%|█▎        | 48119/371472 [3:50:34<23:38:55,  3.80it/s]
 13%|█▎        | 48120/371472 [3:50:35<22:57:56,  3.91it/s]
                                                           
{'loss': 4.1983, 'learning_rate': 8.838371867525694e-07, 'epoch': 2.07}

 13%|█▎        | 48120/371472 [3:50:35<22:57:56,  3.91it/s]
 13%|█▎        | 48121/371472 [3:50:35<23:47:07,  3.78it/s]
 13%|█▎        | 48122/371472 [3:50:35<23:29:16,  3.82it/s]
 13%|█▎        | 48123/371472 [3:50:35<24:39:21,  3.64it/s]
 13%|█▎        | 48124/371472 [3:50:36<26:09:32,  3.43it/s]
 13%|█▎        | 48125/371472 [3:50:36<26:37:27,  3.37it/s]
 13%|█▎        | 48126/371472 [3:50:36<29:22:13,  3.06it/s]
 13%|█▎        | 48127/371472 [3:50:37<27:05:03,  3.32it/s]
 13%|█▎        | 48128/371472 [3:50:37<26:57:47,  3.33it/s]
 13%|█▎        | 48129/371472 [3:50:37<25:18:52,  3.55it/s]
 13%|█▎        | 48130/371472 [3:50:37<24:35:00,  3.65it/s]
 13%|█▎        | 48131/371472 [3:50:38<24:44:06,  3.63it/s]
 13%|█▎        | 48132/371472 [3:50:38<23:55:59,  3.75it/s]
 13%|█▎        | 48133/371472 [3:50:38<26:21:04,  3.41it/s]
 13%|█▎        | 48134/371472 [3:50:39<25:40:23,  3.50it/s]
 13%|█▎        | 48135/371472 [3:50:39<25:44:56,  3.49it/s]
 13%|█▎        | 48136/371472 [3:50:39<26:40:00,  3.37it/s]
 13%|█▎        | 48137/371472 [3:50:39<24:50:46,  3.61it/s]
 13%|█▎        | 48138/371472 [3:50:40<25:44:56,  3.49it/s]
 13%|█▎        | 48139/371472 [3:50:40<25:31:32,  3.52it/s]
 13%|█▎        | 48140/371472 [3:50:40<26:36:25,  3.38it/s]
                                                           
{'loss': 4.2373, 'learning_rate': 8.837887047770906e-07, 'epoch': 2.07}

 13%|█▎        | 48140/371472 [3:50:40<26:36:25,  3.38it/s]
 13%|█▎        | 48141/371472 [3:50:41<27:25:39,  3.27it/s]
 13%|█▎        | 48142/371472 [3:50:41<25:53:38,  3.47it/s]
 13%|█▎        | 48143/371472 [3:50:41<25:33:59,  3.51it/s]
 13%|█▎        | 48144/371472 [3:50:42<26:07:05,  3.44it/s]
 13%|█▎        | 48145/371472 [3:50:42<25:49:23,  3.48it/s]
 13%|█▎        | 48146/371472 [3:50:42<25:03:29,  3.58it/s]
 13%|█▎        | 48147/371472 [3:50:42<24:50:47,  3.61it/s]
 13%|█▎        | 48148/371472 [3:50:43<24:32:48,  3.66it/s]
 13%|█▎        | 48149/371472 [3:50:43<24:41:54,  3.64it/s]
 13%|█▎        | 48150/371472 [3:50:43<24:41:29,  3.64it/s]
 13%|█▎        | 48151/371472 [3:50:43<24:15:32,  3.70it/s]
 13%|█▎        | 48152/371472 [3:50:44<24:34:23,  3.65it/s]
 13%|█▎        | 48153/371472 [3:50:44<23:58:41,  3.75it/s]
 13%|█▎        | 48154/371472 [3:50:44<24:29:44,  3.67it/s]
 13%|█▎        | 48155/371472 [3:50:45<25:05:26,  3.58it/s]
 13%|█▎        | 48156/371472 [3:50:45<24:40:37,  3.64it/s]
 13%|█▎        | 48157/371472 [3:50:45<25:14:10,  3.56it/s]
 13%|█▎        | 48158/371472 [3:50:45<25:17:36,  3.55it/s]
 13%|█▎        | 48159/371472 [3:50:46<28:01:35,  3.20it/s]
 13%|█▎        | 48160/371472 [3:50:46<27:16:20,  3.29it/s]
                                                           
{'loss': 4.1931, 'learning_rate': 8.837402228016117e-07, 'epoch': 2.07}

 13%|█▎        | 48160/371472 [3:50:46<27:16:20,  3.29it/s]
 13%|█▎        | 48161/371472 [3:50:46<26:27:34,  3.39it/s]
 13%|█▎        | 48162/371472 [3:50:47<29:29:03,  3.05it/s]
 13%|█▎        | 48163/371472 [3:50:47<29:26:12,  3.05it/s]
 13%|█▎        | 48164/371472 [3:50:47<27:27:18,  3.27it/s]
 13%|█▎        | 48165/371472 [3:50:48<26:26:27,  3.40it/s]
 13%|█▎        | 48166/371472 [3:50:48<26:29:50,  3.39it/s]
 13%|█▎        | 48167/371472 [3:50:48<27:06:47,  3.31it/s]
 13%|█▎        | 48168/371472 [3:50:48<26:32:34,  3.38it/s]
 13%|█▎        | 48169/371472 [3:50:49<26:29:40,  3.39it/s]
 13%|█▎        | 48170/371472 [3:50:49<25:28:07,  3.53it/s]
 13%|█▎        | 48171/371472 [3:50:49<24:35:22,  3.65it/s]
 13%|█▎        | 48172/371472 [3:50:49<23:51:25,  3.76it/s]
 13%|█▎        | 48173/371472 [3:50:50<24:51:36,  3.61it/s]
 13%|█▎        | 48174/371472 [3:50:50<25:00:33,  3.59it/s]
 13%|█▎        | 48175/371472 [3:50:50<24:25:19,  3.68it/s]
 13%|█▎        | 48176/371472 [3:50:51<26:05:34,  3.44it/s]
 13%|█▎        | 48177/371472 [3:50:51<25:59:07,  3.46it/s]
 13%|█▎        | 48178/371472 [3:50:51<25:20:03,  3.54it/s]
 13%|█▎        | 48179/371472 [3:50:51<25:17:24,  3.55it/s]
 13%|█▎        | 48180/371472 [3:50:52<25:42:01,  3.49it/s]
                                                           
{'loss': 4.0753, 'learning_rate': 8.836917408261328e-07, 'epoch': 2.08}

 13%|█▎        | 48180/371472 [3:50:52<25:42:01,  3.49it/s]
 13%|█▎        | 48181/371472 [3:50:52<25:58:19,  3.46it/s]
 13%|█▎        | 48182/371472 [3:50:52<25:07:32,  3.57it/s]
 13%|█▎        | 48183/371472 [3:50:53<24:50:38,  3.61it/s]
 13%|█▎        | 48184/371472 [3:50:53<24:00:26,  3.74it/s]
 13%|█▎        | 48185/371472 [3:50:53<23:01:22,  3.90it/s]
 13%|█▎        | 48186/371472 [3:50:53<23:08:41,  3.88it/s]
 13%|█▎        | 48187/371472 [3:50:54<23:19:12,  3.85it/s]
 13%|█▎        | 48188/371472 [3:50:54<25:56:21,  3.46it/s]
 13%|█▎        | 48189/371472 [3:50:54<25:25:51,  3.53it/s]
 13%|█▎        | 48190/371472 [3:50:55<24:53:10,  3.61it/s]
 13%|█▎        | 48191/371472 [3:50:55<24:50:18,  3.62it/s]
 13%|█▎        | 48192/371472 [3:50:55<24:26:05,  3.68it/s]
 13%|█▎        | 48193/371472 [3:50:55<23:15:59,  3.86it/s]
 13%|█▎        | 48194/371472 [3:50:56<22:55:54,  3.92it/s]
 13%|█▎        | 48195/371472 [3:50:56<23:10:20,  3.88it/s]
 13%|█▎        | 48196/371472 [3:50:56<23:55:55,  3.75it/s]
 13%|█▎        | 48197/371472 [3:50:56<23:43:28,  3.79it/s]
 13%|█▎        | 48198/371472 [3:50:57<24:23:36,  3.68it/s]
 13%|█▎        | 48199/371472 [3:50:57<24:20:48,  3.69it/s]
 13%|█▎        | 48200/371472 [3:50:57<25:30:51,  3.52it/s]
                                                           
{'loss': 4.4324, 'learning_rate': 8.83643258850654e-07, 'epoch': 2.08}

 13%|█▎        | 48200/371472 [3:50:57<25:30:51,  3.52it/s]
 13%|█▎        | 48201/371472 [3:50:58<26:00:08,  3.45it/s]
 13%|█▎        | 48202/371472 [3:50:58<27:10:05,  3.31it/s]
 13%|█▎        | 48203/371472 [3:50:58<27:03:59,  3.32it/s]
 13%|█▎        | 48204/371472 [3:50:58<27:14:26,  3.30it/s]
 13%|█▎        | 48205/371472 [3:50:59<26:52:24,  3.34it/s]
 13%|█▎        | 48206/371472 [3:50:59<26:19:46,  3.41it/s]
 13%|█▎        | 48207/371472 [3:50:59<26:00:58,  3.45it/s]
 13%|█▎        | 48208/371472 [3:51:00<27:58:29,  3.21it/s]
 13%|█▎        | 48209/371472 [3:51:00<26:22:58,  3.40it/s]
 13%|█▎        | 48210/371472 [3:51:00<25:35:26,  3.51it/s]
 13%|█▎        | 48211/371472 [3:51:00<24:20:09,  3.69it/s]
 13%|█▎        | 48212/371472 [3:51:01<24:14:27,  3.70it/s]
 13%|█▎        | 48213/371472 [3:51:01<25:10:43,  3.57it/s]
 13%|█▎        | 48214/371472 [3:51:01<24:24:51,  3.68it/s]
 13%|█▎        | 48215/371472 [3:51:02<24:41:15,  3.64it/s]
 13%|█▎        | 48216/371472 [3:51:02<24:03:40,  3.73it/s]
 13%|█▎        | 48217/371472 [3:51:02<25:02:02,  3.59it/s]
 13%|█▎        | 48218/371472 [3:51:02<24:53:44,  3.61it/s]
 13%|█▎        | 48219/371472 [3:51:03<23:54:29,  3.76it/s]
 13%|█▎        | 48220/371472 [3:51:03<23:02:23,  3.90it/s]
                                                           
{'loss': 4.2271, 'learning_rate': 8.835947768751752e-07, 'epoch': 2.08}

 13%|█▎        | 48220/371472 [3:51:03<23:02:23,  3.90it/s]
 13%|█▎        | 48221/371472 [3:51:03<23:28:30,  3.82it/s]
 13%|█▎        | 48222/371472 [3:51:03<22:51:32,  3.93it/s]
 13%|█▎        | 48223/371472 [3:51:04<27:05:26,  3.31it/s]
 13%|█▎        | 48224/371472 [3:51:04<27:43:38,  3.24it/s]
 13%|█▎        | 48225/371472 [3:51:04<26:38:13,  3.37it/s]
 13%|█▎        | 48226/371472 [3:51:05<25:34:39,  3.51it/s]
 13%|█▎        | 48227/371472 [3:51:05<25:33:00,  3.51it/s]
 13%|█▎        | 48228/371472 [3:51:05<24:27:31,  3.67it/s]
 13%|█▎        | 48229/371472 [3:51:05<24:58:37,  3.59it/s]
 13%|█▎        | 48230/371472 [3:51:06<25:23:18,  3.54it/s]
 13%|█▎        | 48231/371472 [3:51:06<24:51:48,  3.61it/s]
 13%|█▎        | 48232/371472 [3:51:06<23:59:03,  3.74it/s]
 13%|█▎        | 48233/371472 [3:51:06<23:42:17,  3.79it/s]
 13%|█▎        | 48234/371472 [3:51:07<22:50:02,  3.93it/s]
 13%|█▎        | 48235/371472 [3:51:07<22:50:21,  3.93it/s]
 13%|█▎        | 48236/371472 [3:51:07<25:37:48,  3.50it/s]
 13%|█▎        | 48237/371472 [3:51:08<25:59:45,  3.45it/s]
 13%|█▎        | 48238/371472 [3:51:08<25:37:36,  3.50it/s]
 13%|█▎        | 48239/371472 [3:51:08<26:17:43,  3.41it/s]
 13%|█▎        | 48240/371472 [3:51:09<26:46:10,  3.35it/s]
                                                           
{'loss': 4.1287, 'learning_rate': 8.835462948996961e-07, 'epoch': 2.08}

 13%|█▎        | 48240/371472 [3:51:09<26:46:10,  3.35it/s]
 13%|█▎        | 48241/371472 [3:51:09<26:07:51,  3.44it/s]
 13%|█▎        | 48242/371472 [3:51:09<25:12:11,  3.56it/s]
 13%|█▎        | 48243/371472 [3:51:09<24:52:49,  3.61it/s]
 13%|█▎        | 48244/371472 [3:51:10<24:10:21,  3.71it/s]
 13%|█▎        | 48245/371472 [3:51:10<24:04:50,  3.73it/s]
 13%|█▎        | 48246/371472 [3:51:10<25:26:49,  3.53it/s]
 13%|█▎        | 48247/371472 [3:51:10<26:01:16,  3.45it/s]
 13%|█▎        | 48248/371472 [3:51:11<26:32:00,  3.38it/s]
 13%|█▎        | 48249/371472 [3:51:11<25:52:25,  3.47it/s]
 13%|█▎        | 48250/371472 [3:51:11<25:26:59,  3.53it/s]
 13%|█▎        | 48251/371472 [3:51:12<24:54:46,  3.60it/s]
 13%|█▎        | 48252/371472 [3:51:12<25:07:49,  3.57it/s]
 13%|█▎        | 48253/371472 [3:51:12<25:33:05,  3.51it/s]
 13%|█▎        | 48254/371472 [3:51:12<25:06:23,  3.58it/s]
 13%|█▎        | 48255/371472 [3:51:13<24:44:07,  3.63it/s]
 13%|█▎        | 48256/371472 [3:51:13<24:54:32,  3.60it/s]
 13%|█▎        | 48257/371472 [3:51:13<24:29:18,  3.67it/s]
 13%|█▎        | 48258/371472 [3:51:13<23:42:24,  3.79it/s]
 13%|█▎        | 48259/371472 [3:51:14<25:27:01,  3.53it/s]
 13%|█▎        | 48260/371472 [3:51:14<24:43:08,  3.63it/s]
                                                           
{'loss': 4.3173, 'learning_rate': 8.834978129242172e-07, 'epoch': 2.08}

 13%|█▎        | 48260/371472 [3:51:14<24:43:08,  3.63it/s]
 13%|█▎        | 48261/371472 [3:51:14<24:25:10,  3.68it/s]
 13%|█▎        | 48262/371472 [3:51:15<25:44:36,  3.49it/s]
 13%|█▎        | 48263/371472 [3:51:15<24:59:19,  3.59it/s]
 13%|█▎        | 48264/371472 [3:51:15<24:21:03,  3.69it/s]
 13%|█▎        | 48265/371472 [3:51:15<24:05:02,  3.73it/s]
 13%|█▎        | 48266/371472 [3:51:16<24:17:30,  3.70it/s]
 13%|█▎        | 48267/371472 [3:51:16<24:07:45,  3.72it/s]
 13%|█▎        | 48268/371472 [3:51:16<25:44:00,  3.49it/s]
 13%|█▎        | 48269/371472 [3:51:17<25:21:12,  3.54it/s]
 13%|█▎        | 48270/371472 [3:51:17<25:52:09,  3.47it/s]
 13%|█▎        | 48271/371472 [3:51:17<27:20:03,  3.28it/s]
 13%|█▎        | 48272/371472 [3:51:17<26:03:27,  3.45it/s]
 13%|█▎        | 48273/371472 [3:51:18<25:24:46,  3.53it/s]
 13%|█▎        | 48274/371472 [3:51:18<27:18:38,  3.29it/s]
 13%|█▎        | 48275/371472 [3:51:18<28:50:22,  3.11it/s]
 13%|█▎        | 48276/371472 [3:51:19<27:10:23,  3.30it/s]
 13%|█▎        | 48277/371472 [3:51:19<25:34:45,  3.51it/s]
 13%|█▎        | 48278/371472 [3:51:19<27:01:04,  3.32it/s]
 13%|█▎        | 48279/371472 [3:51:20<26:50:38,  3.34it/s]
 13%|█▎        | 48280/371472 [3:51:20<27:20:08,  3.28it/s]
                                                           
{'loss': 4.1593, 'learning_rate': 8.834493309487383e-07, 'epoch': 2.08}

 13%|█▎        | 48280/371472 [3:51:20<27:20:08,  3.28it/s]
 13%|█▎        | 48281/371472 [3:51:20<27:08:17,  3.31it/s]
 13%|█▎        | 48282/371472 [3:51:20<26:02:40,  3.45it/s]
 13%|█▎        | 48283/371472 [3:51:21<24:53:04,  3.61it/s]
 13%|█▎        | 48284/371472 [3:51:21<25:28:45,  3.52it/s]
 13%|█▎        | 48285/371472 [3:51:21<24:26:47,  3.67it/s]
 13%|█▎        | 48286/371472 [3:51:22<26:46:21,  3.35it/s]
 13%|█▎        | 48287/371472 [3:51:22<25:36:35,  3.51it/s]
 13%|█▎        | 48288/371472 [3:51:22<25:18:46,  3.55it/s]
 13%|█▎        | 48289/371472 [3:51:22<25:21:53,  3.54it/s]
 13%|█▎        | 48290/371472 [3:51:23<24:22:33,  3.68it/s]
 13%|█▎        | 48291/371472 [3:51:23<24:07:44,  3.72it/s]
 13%|█▎        | 48292/371472 [3:51:23<25:15:13,  3.55it/s]
 13%|█▎        | 48293/371472 [3:51:24<28:38:42,  3.13it/s]
 13%|█▎        | 48294/371472 [3:51:24<27:25:36,  3.27it/s]
 13%|█▎        | 48295/371472 [3:51:24<26:45:34,  3.35it/s]
 13%|█▎        | 48296/371472 [3:51:24<26:07:37,  3.44it/s]
 13%|█▎        | 48297/371472 [3:51:25<27:23:26,  3.28it/s]
 13%|█▎        | 48298/371472 [3:51:25<26:17:54,  3.41it/s]
 13%|█▎        | 48299/371472 [3:51:25<26:00:15,  3.45it/s]
 13%|█▎        | 48300/371472 [3:51:26<26:27:17,  3.39it/s]
                                                           
{'loss': 4.265, 'learning_rate': 8.834008489732595e-07, 'epoch': 2.08}

 13%|█▎        | 48300/371472 [3:51:26<26:27:17,  3.39it/s]
 13%|█▎        | 48301/371472 [3:51:26<26:34:00,  3.38it/s]
 13%|█▎        | 48302/371472 [3:51:26<28:35:18,  3.14it/s]
 13%|█▎        | 48303/371472 [3:51:27<27:10:57,  3.30it/s]
 13%|█▎        | 48304/371472 [3:51:27<29:37:30,  3.03it/s]
 13%|█▎        | 48305/371472 [3:51:27<29:28:50,  3.05it/s]
 13%|█▎        | 48306/371472 [3:51:28<27:29:25,  3.27it/s]
 13%|█▎        | 48307/371472 [3:51:28<27:06:52,  3.31it/s]
 13%|█▎        | 48308/371472 [3:51:28<28:06:19,  3.19it/s]
 13%|█▎        | 48309/371472 [3:51:28<26:41:36,  3.36it/s]
 13%|█▎        | 48310/371472 [3:51:29<25:47:07,  3.48it/s]
 13%|█▎        | 48311/371472 [3:51:29<24:53:48,  3.61it/s]
 13%|█▎        | 48312/371472 [3:51:29<27:37:17,  3.25it/s]
 13%|█▎        | 48313/371472 [3:51:30<25:52:04,  3.47it/s]
 13%|█▎        | 48314/371472 [3:51:30<25:32:49,  3.51it/s]
 13%|█▎        | 48315/371472 [3:51:30<25:16:46,  3.55it/s]
 13%|█▎        | 48316/371472 [3:51:30<24:16:45,  3.70it/s]
 13%|█▎        | 48317/371472 [3:51:31<24:28:42,  3.67it/s]
 13%|█▎        | 48318/371472 [3:51:31<27:34:40,  3.25it/s]
 13%|█▎        | 48319/371472 [3:51:31<26:33:49,  3.38it/s]
 13%|█▎        | 48320/371472 [3:51:32<30:27:53,  2.95it/s]
                                                           
{'loss': 4.2934, 'learning_rate': 8.833523669977806e-07, 'epoch': 2.08}

 13%|█▎        | 48320/371472 [3:51:32<30:27:53,  2.95it/s]
 13%|█▎        | 48321/371472 [3:51:32<28:20:47,  3.17it/s]
 13%|█▎        | 48322/371472 [3:51:32<29:01:07,  3.09it/s]
 13%|█▎        | 48323/371472 [3:51:33<28:37:19,  3.14it/s]
 13%|█▎        | 48324/371472 [3:51:33<28:48:55,  3.12it/s]
 13%|█▎        | 48325/371472 [3:51:33<27:18:55,  3.29it/s]
 13%|█▎        | 48326/371472 [3:51:34<28:56:02,  3.10it/s]
 13%|█▎        | 48327/371472 [3:51:34<27:48:12,  3.23it/s]
 13%|█▎        | 48328/371472 [3:51:34<27:28:53,  3.27it/s]
 13%|█▎        | 48329/371472 [3:51:35<28:07:45,  3.19it/s]
 13%|█▎        | 48330/371472 [3:51:35<26:27:46,  3.39it/s]
 13%|█▎        | 48331/371472 [3:51:35<25:36:05,  3.51it/s]
 13%|█▎        | 48332/371472 [3:51:35<26:32:48,  3.38it/s]
 13%|█▎        | 48333/371472 [3:51:36<26:07:59,  3.43it/s]
 13%|█▎        | 48334/371472 [3:51:36<24:50:24,  3.61it/s]
 13%|█▎        | 48335/371472 [3:51:36<24:49:16,  3.62it/s]
 13%|█▎        | 48336/371472 [3:51:36<24:38:34,  3.64it/s]
 13%|█▎        | 48337/371472 [3:51:37<25:04:58,  3.58it/s]
 13%|█▎        | 48338/371472 [3:51:37<25:06:42,  3.57it/s]
 13%|█▎        | 48339/371472 [3:51:37<25:44:09,  3.49it/s]
 13%|█▎        | 48340/371472 [3:51:38<25:49:32,  3.48it/s]
                                                           
{'loss': 4.3757, 'learning_rate': 8.833038850223017e-07, 'epoch': 2.08}

 13%|█▎        | 48340/371472 [3:51:38<25:49:32,  3.48it/s]
 13%|█▎        | 48341/371472 [3:51:38<25:18:38,  3.55it/s]
 13%|█▎        | 48342/371472 [3:51:38<27:32:30,  3.26it/s]
 13%|█▎        | 48343/371472 [3:51:38<25:59:55,  3.45it/s]
 13%|█▎        | 48344/371472 [3:51:39<25:14:29,  3.56it/s]
 13%|█▎        | 48345/371472 [3:51:39<24:12:15,  3.71it/s]
 13%|█▎        | 48346/371472 [3:51:39<24:25:20,  3.68it/s]
 13%|█▎        | 48347/371472 [3:51:40<23:53:41,  3.76it/s]
 13%|█▎        | 48348/371472 [3:51:40<23:47:14,  3.77it/s]
 13%|█▎        | 48349/371472 [3:51:40<24:01:07,  3.74it/s]
 13%|█▎        | 48350/371472 [3:51:40<23:26:29,  3.83it/s]
 13%|█▎        | 48351/371472 [3:51:41<24:06:14,  3.72it/s]
 13%|█▎        | 48352/371472 [3:51:41<25:00:51,  3.59it/s]
 13%|█▎        | 48353/371472 [3:51:41<24:08:25,  3.72it/s]
 13%|█▎        | 48354/371472 [3:51:41<23:28:15,  3.82it/s]
 13%|█▎        | 48355/371472 [3:51:42<24:05:36,  3.73it/s]
 13%|█▎        | 48356/371472 [3:51:42<25:34:32,  3.51it/s]
 13%|█▎        | 48357/371472 [3:51:42<25:14:36,  3.56it/s]
 13%|█▎        | 48358/371472 [3:51:43<24:45:47,  3.62it/s]
 13%|█▎        | 48359/371472 [3:51:43<25:50:43,  3.47it/s]
 13%|█▎        | 48360/371472 [3:51:43<25:53:45,  3.47it/s]
                                                           
{'loss': 4.3117, 'learning_rate': 8.832554030468227e-07, 'epoch': 2.08}

 13%|█▎        | 48360/371472 [3:51:43<25:53:45,  3.47it/s]
 13%|█▎        | 48361/371472 [3:51:43<24:54:23,  3.60it/s]
 13%|█▎        | 48362/371472 [3:51:44<25:36:35,  3.50it/s]
 13%|█▎        | 48363/371472 [3:51:44<25:02:47,  3.58it/s]
 13%|█▎        | 48364/371472 [3:51:44<24:11:42,  3.71it/s]
 13%|█▎        | 48365/371472 [3:51:44<23:26:05,  3.83it/s]
 13%|█▎        | 48366/371472 [3:51:45<25:24:13,  3.53it/s]
 13%|█▎        | 48367/371472 [3:51:45<24:22:34,  3.68it/s]
 13%|█▎        | 48368/371472 [3:51:45<25:50:15,  3.47it/s]
 13%|█▎        | 48369/371472 [3:51:46<26:15:44,  3.42it/s]
 13%|█▎        | 48370/371472 [3:51:46<24:50:33,  3.61it/s]
 13%|█▎        | 48371/371472 [3:51:46<24:58:26,  3.59it/s]
 13%|█▎        | 48372/371472 [3:51:46<24:46:29,  3.62it/s]
 13%|█▎        | 48373/371472 [3:51:47<26:18:26,  3.41it/s]
 13%|█▎        | 48374/371472 [3:51:47<25:40:26,  3.50it/s]
 13%|█▎        | 48375/371472 [3:51:47<25:44:50,  3.49it/s]
 13%|█▎        | 48376/371472 [3:51:48<24:37:10,  3.65it/s]
 13%|█▎        | 48377/371472 [3:51:48<25:20:47,  3.54it/s]
 13%|█▎        | 48378/371472 [3:51:48<24:48:07,  3.62it/s]
 13%|█▎        | 48379/371472 [3:51:48<25:34:01,  3.51it/s]
 13%|█▎        | 48380/371472 [3:51:49<24:07:52,  3.72it/s]
                                                           
{'loss': 4.3394, 'learning_rate': 8.832069210713439e-07, 'epoch': 2.08}

 13%|█▎        | 48380/371472 [3:51:49<24:07:52,  3.72it/s]
 13%|█▎        | 48381/371472 [3:51:49<23:39:07,  3.79it/s]
 13%|█▎        | 48382/371472 [3:51:49<23:38:44,  3.80it/s]
 13%|█▎        | 48383/371472 [3:51:50<25:39:03,  3.50it/s]
 13%|█▎        | 48384/371472 [3:51:50<24:55:34,  3.60it/s]
 13%|█▎        | 48385/371472 [3:51:50<25:05:24,  3.58it/s]
 13%|█▎        | 48386/371472 [3:51:50<24:50:32,  3.61it/s]
 13%|█▎        | 48387/371472 [3:51:51<24:24:34,  3.68it/s]
 13%|█▎        | 48388/371472 [3:51:51<24:07:43,  3.72it/s]
 13%|█▎        | 48389/371472 [3:51:51<25:06:20,  3.57it/s]
 13%|█▎        | 48390/371472 [3:51:51<25:05:23,  3.58it/s]
 13%|█▎        | 48391/371472 [3:51:52<25:48:35,  3.48it/s]
 13%|█▎        | 48392/371472 [3:51:52<26:08:32,  3.43it/s]
 13%|█▎        | 48393/371472 [3:51:52<27:45:58,  3.23it/s]
 13%|█▎        | 48394/371472 [3:51:53<26:12:59,  3.42it/s]
 13%|█▎        | 48395/371472 [3:51:53<25:10:35,  3.56it/s]
 13%|█▎        | 48396/371472 [3:51:53<24:12:40,  3.71it/s]
 13%|█▎        | 48397/371472 [3:51:53<25:00:00,  3.59it/s]
 13%|█▎        | 48398/371472 [3:51:54<24:12:44,  3.71it/s]
 13%|█▎        | 48399/371472 [3:51:54<25:17:45,  3.55it/s]
 13%|█▎        | 48400/371472 [3:51:54<25:21:01,  3.54it/s]
                                                           
{'loss': 4.2903, 'learning_rate': 8.831584390958649e-07, 'epoch': 2.08}

 13%|█▎        | 48400/371472 [3:51:54<25:21:01,  3.54it/s]
 13%|█▎        | 48401/371472 [3:51:55<25:07:19,  3.57it/s]
 13%|█▎        | 48402/371472 [3:51:55<25:10:05,  3.57it/s]
 13%|█▎        | 48403/371472 [3:51:55<24:27:10,  3.67it/s]
 13%|█▎        | 48404/371472 [3:51:55<23:33:42,  3.81it/s]
 13%|█▎        | 48405/371472 [3:51:56<24:33:27,  3.65it/s]
 13%|█▎        | 48406/371472 [3:51:56<23:42:46,  3.78it/s]
 13%|█▎        | 48407/371472 [3:51:56<24:21:33,  3.68it/s]
 13%|█▎        | 48408/371472 [3:51:56<24:49:29,  3.61it/s]
 13%|█▎        | 48409/371472 [3:51:57<23:51:36,  3.76it/s]
 13%|█▎        | 48410/371472 [3:51:57<24:27:16,  3.67it/s]
 13%|█▎        | 48411/371472 [3:51:57<24:01:57,  3.73it/s]
 13%|█▎        | 48412/371472 [3:51:58<25:00:59,  3.59it/s]
 13%|█▎        | 48413/371472 [3:51:58<25:25:31,  3.53it/s]
 13%|█▎        | 48414/371472 [3:51:58<27:13:50,  3.30it/s]
 13%|█▎        | 48415/371472 [3:51:59<29:35:51,  3.03it/s]
 13%|█▎        | 48416/371472 [3:51:59<27:42:00,  3.24it/s]
 13%|█▎        | 48417/371472 [3:51:59<27:53:05,  3.22it/s]
 13%|█▎        | 48418/371472 [3:52:00<28:44:36,  3.12it/s]
 13%|█▎        | 48419/371472 [3:52:00<28:05:06,  3.20it/s]
 13%|█▎        | 48420/371472 [3:52:00<27:56:07,  3.21it/s]
                                                           
{'loss': 4.4071, 'learning_rate': 8.831099571203861e-07, 'epoch': 2.09}

 13%|█▎        | 48420/371472 [3:52:00<27:56:07,  3.21it/s]
 13%|█▎        | 48421/371472 [3:52:00<27:17:12,  3.29it/s]
 13%|█▎        | 48422/371472 [3:52:01<29:14:29,  3.07it/s]
 13%|█▎        | 48423/371472 [3:52:01<27:40:58,  3.24it/s]
 13%|█▎        | 48424/371472 [3:52:01<26:38:29,  3.37it/s]
 13%|█▎        | 48425/371472 [3:52:02<25:21:54,  3.54it/s]
 13%|█▎        | 48426/371472 [3:52:02<25:52:11,  3.47it/s]
 13%|█▎        | 48427/371472 [3:52:02<26:27:59,  3.39it/s]
 13%|█▎        | 48428/371472 [3:52:02<26:02:56,  3.44it/s]
 13%|█▎        | 48429/371472 [3:52:03<24:39:17,  3.64it/s]
 13%|█▎        | 48430/371472 [3:52:03<25:11:08,  3.56it/s]
 13%|█▎        | 48431/371472 [3:52:03<26:41:36,  3.36it/s]
 13%|█▎        | 48432/371472 [3:52:04<26:11:34,  3.43it/s]
 13%|█▎        | 48433/371472 [3:52:04<25:32:45,  3.51it/s]
 13%|█▎        | 48434/371472 [3:52:04<26:02:49,  3.45it/s]
 13%|█▎        | 48435/371472 [3:52:04<25:52:51,  3.47it/s]
 13%|█▎        | 48436/371472 [3:52:05<25:36:49,  3.50it/s]
 13%|█▎        | 48437/371472 [3:52:05<26:42:49,  3.36it/s]
 13%|█▎        | 48438/371472 [3:52:05<27:49:06,  3.23it/s]
 13%|█▎        | 48439/371472 [3:52:06<26:55:53,  3.33it/s]
 13%|█▎        | 48440/371472 [3:52:06<25:55:18,  3.46it/s]
                                                           
{'loss': 4.0438, 'learning_rate': 8.830614751449072e-07, 'epoch': 2.09}

 13%|█▎        | 48440/371472 [3:52:06<25:55:18,  3.46it/s]
 13%|█▎        | 48441/371472 [3:52:06<25:22:47,  3.54it/s]
 13%|█▎        | 48442/371472 [3:52:06<24:43:16,  3.63it/s]
 13%|█▎        | 48443/371472 [3:52:07<25:15:50,  3.55it/s]
 13%|█▎        | 48444/371472 [3:52:07<25:23:13,  3.53it/s]
 13%|█▎        | 48445/371472 [3:52:07<25:18:40,  3.55it/s]
 13%|█▎        | 48446/371472 [3:52:08<28:17:48,  3.17it/s]
 13%|█▎        | 48447/371472 [3:52:08<28:05:03,  3.19it/s]
 13%|█▎        | 48448/371472 [3:52:08<27:46:08,  3.23it/s]
 13%|█▎        | 48449/371472 [3:52:09<28:06:03,  3.19it/s]
 13%|█▎        | 48450/371472 [3:52:09<27:52:06,  3.22it/s]
 13%|█▎        | 48451/371472 [3:52:09<26:44:14,  3.36it/s]
 13%|█▎        | 48452/371472 [3:52:10<26:31:08,  3.38it/s]
 13%|█▎        | 48453/371472 [3:52:10<25:35:01,  3.51it/s]
 13%|█▎        | 48454/371472 [3:52:10<24:15:15,  3.70it/s]
 13%|█▎        | 48455/371472 [3:52:10<23:47:58,  3.77it/s]
 13%|█▎        | 48456/371472 [3:52:11<24:32:18,  3.66it/s]
 13%|█▎        | 48457/371472 [3:52:11<24:11:20,  3.71it/s]
 13%|█▎        | 48458/371472 [3:52:11<23:58:56,  3.74it/s]
 13%|█▎        | 48459/371472 [3:52:11<26:07:45,  3.43it/s]
 13%|█▎        | 48460/371472 [3:52:12<25:13:40,  3.56it/s]
                                                           
{'loss': 4.3352, 'learning_rate': 8.830129931694284e-07, 'epoch': 2.09}

 13%|█▎        | 48460/371472 [3:52:12<25:13:40,  3.56it/s]
 13%|█▎        | 48461/371472 [3:52:12<25:20:43,  3.54it/s]
 13%|█▎        | 48462/371472 [3:52:12<28:26:34,  3.15it/s]
 13%|█▎        | 48463/371472 [3:52:13<27:19:19,  3.28it/s]
 13%|█▎        | 48464/371472 [3:52:13<26:33:12,  3.38it/s]
 13%|█▎        | 48465/371472 [3:52:13<26:24:35,  3.40it/s]
 13%|█▎        | 48466/371472 [3:52:13<25:22:38,  3.54it/s]
 13%|█▎        | 48467/371472 [3:52:14<25:14:13,  3.56it/s]
 13%|█▎        | 48468/371472 [3:52:14<24:42:55,  3.63it/s]
 13%|█▎        | 48469/371472 [3:52:14<23:50:26,  3.76it/s]
 13%|█▎        | 48470/371472 [3:52:15<23:16:48,  3.85it/s]
 13%|█▎        | 48471/371472 [3:52:15<24:15:07,  3.70it/s]
 13%|█▎        | 48472/371472 [3:52:15<24:43:26,  3.63it/s]
 13%|█▎        | 48473/371472 [3:52:15<24:08:11,  3.72it/s]
 13%|█▎        | 48474/371472 [3:52:16<23:43:58,  3.78it/s]
 13%|█▎        | 48475/371472 [3:52:16<23:19:36,  3.85it/s]
 13%|█▎        | 48476/371472 [3:52:16<23:57:48,  3.74it/s]
 13%|█▎        | 48477/371472 [3:52:16<23:15:25,  3.86it/s]
 13%|█▎        | 48478/371472 [3:52:17<23:30:55,  3.82it/s]
 13%|█▎        | 48479/371472 [3:52:17<23:43:56,  3.78it/s]
 13%|█▎        | 48480/371472 [3:52:17<24:20:13,  3.69it/s]
                                                           
{'loss': 4.2519, 'learning_rate': 8.829645111939494e-07, 'epoch': 2.09}

 13%|█▎        | 48480/371472 [3:52:17<24:20:13,  3.69it/s]
 13%|█▎        | 48481/371472 [3:52:18<25:34:10,  3.51it/s]
 13%|█▎        | 48482/371472 [3:52:18<25:46:39,  3.48it/s]
 13%|█▎        | 48483/371472 [3:52:18<25:21:45,  3.54it/s]
 13%|█▎        | 48484/371472 [3:52:18<25:27:32,  3.52it/s]
 13%|█▎        | 48485/371472 [3:52:19<25:19:00,  3.54it/s]
 13%|█▎        | 48486/371472 [3:52:19<24:59:59,  3.59it/s]
 13%|█▎        | 48487/371472 [3:52:19<26:17:58,  3.41it/s]
 13%|█▎        | 48488/371472 [3:52:20<26:57:08,  3.33it/s]
 13%|█▎        | 48489/371472 [3:52:20<28:59:15,  3.10it/s]
 13%|█▎        | 48490/371472 [3:52:20<27:20:14,  3.28it/s]
 13%|█▎        | 48491/371472 [3:52:20<26:26:15,  3.39it/s]
 13%|█▎        | 48492/371472 [3:52:21<25:50:12,  3.47it/s]
 13%|█▎        | 48493/371472 [3:52:21<25:40:56,  3.49it/s]
 13%|█▎        | 48494/371472 [3:52:21<25:20:28,  3.54it/s]
 13%|█▎        | 48495/371472 [3:52:22<25:00:42,  3.59it/s]
 13%|█▎        | 48496/371472 [3:52:22<25:57:28,  3.46it/s]
 13%|█▎        | 48497/371472 [3:52:22<26:07:54,  3.43it/s]
 13%|█▎        | 48498/371472 [3:52:22<26:07:20,  3.43it/s]
 13%|█▎        | 48499/371472 [3:52:23<26:31:42,  3.38it/s]
 13%|█▎        | 48500/371472 [3:52:23<26:58:28,  3.33it/s]
                                                           
{'loss': 4.3348, 'learning_rate': 8.829160292184705e-07, 'epoch': 2.09}

 13%|█▎        | 48500/371472 [3:52:23<26:58:28,  3.33it/s]
 13%|█▎        | 48501/371472 [3:52:23<26:30:00,  3.39it/s]
 13%|█▎        | 48502/371472 [3:52:24<27:15:28,  3.29it/s]
 13%|█▎        | 48503/371472 [3:52:24<27:45:29,  3.23it/s]
 13%|█▎        | 48504/371472 [3:52:24<27:02:59,  3.32it/s]
 13%|█▎        | 48505/371472 [3:52:25<25:57:29,  3.46it/s]
 13%|█▎        | 48506/371472 [3:52:25<24:50:00,  3.61it/s]
 13%|█▎        | 48507/371472 [3:52:25<24:01:57,  3.73it/s]
 13%|█▎        | 48508/371472 [3:52:25<24:27:55,  3.67it/s]
 13%|█▎        | 48509/371472 [3:52:26<23:40:11,  3.79it/s]
 13%|█▎        | 48510/371472 [3:52:26<24:03:25,  3.73it/s]
 13%|█▎        | 48511/371472 [3:52:26<25:01:46,  3.58it/s]
 13%|█▎        | 48512/371472 [3:52:26<25:32:02,  3.51it/s]
 13%|█▎        | 48513/371472 [3:52:27<24:47:03,  3.62it/s]
 13%|█▎        | 48514/371472 [3:52:27<25:22:43,  3.53it/s]
 13%|█▎        | 48515/371472 [3:52:27<25:30:04,  3.52it/s]
 13%|█▎        | 48516/371472 [3:52:28<24:53:59,  3.60it/s]
 13%|█▎        | 48517/371472 [3:52:28<25:30:15,  3.52it/s]
 13%|█▎        | 48518/371472 [3:52:28<25:55:28,  3.46it/s]
 13%|█▎        | 48519/371472 [3:52:28<25:59:10,  3.45it/s]
 13%|█▎        | 48520/371472 [3:52:29<27:57:31,  3.21it/s]
                                                           
{'loss': 4.0967, 'learning_rate': 8.828675472429916e-07, 'epoch': 2.09}

 13%|█▎        | 48520/371472 [3:52:29<27:57:31,  3.21it/s]
 13%|█▎        | 48521/371472 [3:52:29<26:22:56,  3.40it/s]
 13%|█▎        | 48522/371472 [3:52:29<26:27:44,  3.39it/s]
 13%|█▎        | 48523/371472 [3:52:30<25:36:49,  3.50it/s]
 13%|█▎        | 48524/371472 [3:52:30<24:00:08,  3.74it/s]
 13%|█▎        | 48525/371472 [3:52:30<24:49:31,  3.61it/s]
 13%|█▎        | 48526/371472 [3:52:30<24:21:00,  3.68it/s]
 13%|█▎        | 48527/371472 [3:52:31<23:48:24,  3.77it/s]
 13%|█▎        | 48528/371472 [3:52:31<24:14:00,  3.70it/s]
 13%|█▎        | 48529/371472 [3:52:31<24:11:56,  3.71it/s]
 13%|█▎        | 48530/371472 [3:52:31<24:19:43,  3.69it/s]
 13%|█▎        | 48531/371472 [3:52:32<25:55:04,  3.46it/s]
 13%|█▎        | 48532/371472 [3:52:32<27:27:17,  3.27it/s]
 13%|█▎        | 48533/371472 [3:52:32<25:31:46,  3.51it/s]
 13%|█▎        | 48534/371472 [3:52:33<26:59:22,  3.32it/s]
 13%|█▎        | 48535/371472 [3:52:33<25:38:15,  3.50it/s]
 13%|█▎        | 48536/371472 [3:52:33<24:29:46,  3.66it/s]
 13%|█▎        | 48537/371472 [3:52:34<24:26:06,  3.67it/s]
 13%|█▎        | 48538/371472 [3:52:34<24:29:02,  3.66it/s]
 13%|█▎        | 48539/371472 [3:52:34<25:42:36,  3.49it/s]
 13%|█▎        | 48540/371472 [3:52:34<25:56:55,  3.46it/s]
                                                           
{'loss': 4.4048, 'learning_rate': 8.828190652675128e-07, 'epoch': 2.09}

 13%|█▎        | 48540/371472 [3:52:34<25:56:55,  3.46it/s]
 13%|█▎        | 48541/371472 [3:52:35<26:05:32,  3.44it/s]
 13%|█▎        | 48542/371472 [3:52:35<26:21:57,  3.40it/s]
 13%|█▎        | 48543/371472 [3:52:35<24:48:26,  3.62it/s]
 13%|█▎        | 48544/371472 [3:52:35<23:51:17,  3.76it/s]
 13%|█▎        | 48545/371472 [3:52:36<24:27:04,  3.67it/s]
 13%|█▎        | 48546/371472 [3:52:36<24:40:48,  3.63it/s]
 13%|█▎        | 48547/371472 [3:52:36<24:22:32,  3.68it/s]
 13%|█▎        | 48548/371472 [3:52:37<25:20:20,  3.54it/s]
 13%|█▎        | 48549/371472 [3:52:37<25:00:41,  3.59it/s]
 13%|█▎        | 48550/371472 [3:52:37<23:47:38,  3.77it/s]
 13%|█▎        | 48551/371472 [3:52:37<23:50:38,  3.76it/s]
 13%|█▎        | 48552/371472 [3:52:38<23:41:54,  3.79it/s]
 13%|█▎        | 48553/371472 [3:52:38<23:39:47,  3.79it/s]
 13%|█▎        | 48554/371472 [3:52:38<24:32:59,  3.65it/s]
 13%|█▎        | 48555/371472 [3:52:39<25:25:40,  3.53it/s]
 13%|█▎        | 48556/371472 [3:52:39<26:55:38,  3.33it/s]
 13%|█▎        | 48557/371472 [3:52:39<25:59:55,  3.45it/s]
 13%|█▎        | 48558/371472 [3:52:39<25:55:59,  3.46it/s]
 13%|█▎        | 48559/371472 [3:52:40<26:55:31,  3.33it/s]
 13%|█▎        | 48560/371472 [3:52:40<26:08:23,  3.43it/s]
                                                           
{'loss': 4.379, 'learning_rate': 8.827705832920338e-07, 'epoch': 2.09}

 13%|█▎        | 48560/371472 [3:52:40<26:08:23,  3.43it/s]
 13%|█▎        | 48561/371472 [3:52:40<25:14:52,  3.55it/s]
 13%|█▎        | 48562/371472 [3:52:41<24:38:11,  3.64it/s]
 13%|█▎        | 48563/371472 [3:52:41<23:48:19,  3.77it/s]
 13%|█▎        | 48564/371472 [3:52:41<25:40:10,  3.49it/s]
 13%|█▎        | 48565/371472 [3:52:41<25:49:57,  3.47it/s]
 13%|█▎        | 48566/371472 [3:52:42<24:33:08,  3.65it/s]
 13%|█▎        | 48567/371472 [3:52:42<24:24:54,  3.67it/s]
 13%|█▎        | 48568/371472 [3:52:42<24:42:33,  3.63it/s]
 13%|█▎        | 48569/371472 [3:52:42<24:57:18,  3.59it/s]
 13%|█▎        | 48570/371472 [3:52:43<24:38:19,  3.64it/s]
 13%|█▎        | 48571/371472 [3:52:43<24:36:58,  3.64it/s]
 13%|█▎        | 48572/371472 [3:52:43<25:30:25,  3.52it/s]
 13%|█▎        | 48573/371472 [3:52:44<25:07:08,  3.57it/s]
 13%|█▎        | 48574/371472 [3:52:44<24:06:31,  3.72it/s]
 13%|█▎        | 48575/371472 [3:52:44<26:30:58,  3.38it/s]
 13%|█▎        | 48576/371472 [3:52:44<26:45:40,  3.35it/s]
 13%|█▎        | 48577/371472 [3:52:45<25:55:59,  3.46it/s]
 13%|█▎        | 48578/371472 [3:52:45<26:18:43,  3.41it/s]
 13%|█▎        | 48579/371472 [3:52:45<24:57:25,  3.59it/s]
 13%|█▎        | 48580/371472 [3:52:46<24:47:48,  3.62it/s]
                                                           
{'loss': 4.3112, 'learning_rate': 8.82722101316555e-07, 'epoch': 2.09}

 13%|█▎        | 48580/371472 [3:52:46<24:47:48,  3.62it/s]
 13%|█▎        | 48581/371472 [3:52:46<24:40:13,  3.64it/s]
 13%|█▎        | 48582/371472 [3:52:46<26:49:48,  3.34it/s]
 13%|█▎        | 48583/371472 [3:52:46<26:48:14,  3.35it/s]
 13%|█▎        | 48584/371472 [3:52:47<26:31:23,  3.38it/s]
 13%|█▎        | 48585/371472 [3:52:47<25:10:15,  3.56it/s]
 13%|█▎        | 48586/371472 [3:52:47<25:31:10,  3.51it/s]
 13%|█▎        | 48587/371472 [3:52:48<26:14:05,  3.42it/s]
 13%|█▎        | 48588/371472 [3:52:48<25:02:34,  3.58it/s]
 13%|█▎        | 48589/371472 [3:52:48<24:38:12,  3.64it/s]
 13%|█▎        | 48590/371472 [3:52:48<25:36:29,  3.50it/s]
 13%|█▎        | 48591/371472 [3:52:49<24:50:38,  3.61it/s]
 13%|█▎        | 48592/371472 [3:52:49<24:26:41,  3.67it/s]
 13%|█▎        | 48593/371472 [3:52:49<23:41:21,  3.79it/s]
 13%|█▎        | 48594/371472 [3:52:49<23:04:18,  3.89it/s]
 13%|█▎        | 48595/371472 [3:52:50<22:58:50,  3.90it/s]
 13%|█▎        | 48596/371472 [3:52:50<23:15:13,  3.86it/s]
 13%|█▎        | 48597/371472 [3:52:50<23:13:55,  3.86it/s]
 13%|█▎        | 48598/371472 [3:52:51<24:30:01,  3.66it/s]
 13%|█▎        | 48599/371472 [3:52:51<23:50:54,  3.76it/s]
 13%|█▎        | 48600/371472 [3:52:51<23:34:36,  3.80it/s]
                                                           
{'loss': 4.2812, 'learning_rate': 8.826736193410761e-07, 'epoch': 2.09}

 13%|█▎        | 48600/371472 [3:52:51<23:34:36,  3.80it/s]
 13%|█▎        | 48601/371472 [3:52:51<24:07:55,  3.72it/s]
 13%|█▎        | 48602/371472 [3:52:52<23:48:14,  3.77it/s]
 13%|█▎        | 48603/371472 [3:52:52<23:13:03,  3.86it/s]
 13%|█▎        | 48604/371472 [3:52:52<23:00:01,  3.90it/s]
 13%|█▎        | 48605/371472 [3:52:52<22:45:07,  3.94it/s]
 13%|█▎        | 48606/371472 [3:52:53<23:56:32,  3.75it/s]
 13%|█▎        | 48607/371472 [3:52:53<23:28:38,  3.82it/s]
 13%|█▎        | 48608/371472 [3:52:53<23:19:21,  3.85it/s]
 13%|█▎        | 48609/371472 [3:52:53<24:45:12,  3.62it/s]
 13%|█▎        | 48610/371472 [3:52:54<25:04:07,  3.58it/s]
 13%|█▎        | 48611/371472 [3:52:54<26:13:50,  3.42it/s]
 13%|█▎        | 48612/371472 [3:52:54<24:49:27,  3.61it/s]
 13%|█▎        | 48613/371472 [3:52:55<25:20:20,  3.54it/s]
 13%|█▎        | 48614/371472 [3:52:55<25:42:09,  3.49it/s]
 13%|█▎        | 48615/371472 [3:52:55<25:30:34,  3.52it/s]
 13%|█▎        | 48616/371472 [3:52:55<25:06:10,  3.57it/s]
 13%|█▎        | 48617/371472 [3:52:56<25:45:42,  3.48it/s]
 13%|█▎        | 48618/371472 [3:52:56<24:51:18,  3.61it/s]
 13%|█▎        | 48619/371472 [3:52:56<24:10:07,  3.71it/s]
 13%|█▎        | 48620/371472 [3:52:57<23:35:14,  3.80it/s]
                                                           
{'loss': 4.2841, 'learning_rate': 8.82625137365597e-07, 'epoch': 2.09}

 13%|█▎        | 48620/371472 [3:52:57<23:35:14,  3.80it/s]
 13%|█▎        | 48621/371472 [3:52:57<24:06:43,  3.72it/s]
 13%|█▎        | 48622/371472 [3:52:57<24:41:04,  3.63it/s]
 13%|█▎        | 48623/371472 [3:52:57<24:10:28,  3.71it/s]
 13%|█▎        | 48624/371472 [3:52:58<25:34:23,  3.51it/s]
 13%|█▎        | 48625/371472 [3:52:58<24:30:14,  3.66it/s]
 13%|█▎        | 48626/371472 [3:52:58<24:45:13,  3.62it/s]
 13%|█▎        | 48627/371472 [3:52:58<25:37:00,  3.50it/s]
 13%|█▎        | 48628/371472 [3:52:59<24:34:54,  3.65it/s]
 13%|█▎        | 48629/371472 [3:52:59<25:40:00,  3.49it/s]
 13%|█▎        | 48630/371472 [3:52:59<27:42:33,  3.24it/s]
 13%|█▎        | 48631/371472 [3:53:00<27:55:30,  3.21it/s]
 13%|█▎        | 48632/371472 [3:53:00<27:18:46,  3.28it/s]
 13%|█▎        | 48633/371472 [3:53:00<26:35:28,  3.37it/s]
 13%|█▎        | 48634/371472 [3:53:01<26:06:46,  3.43it/s]
 13%|█▎        | 48635/371472 [3:53:01<25:39:41,  3.49it/s]
 13%|█▎        | 48636/371472 [3:53:01<24:39:41,  3.64it/s]
 13%|█▎        | 48637/371472 [3:53:01<24:08:27,  3.71it/s]
 13%|█▎        | 48638/371472 [3:53:02<23:19:11,  3.85it/s]
 13%|█▎        | 48639/371472 [3:53:02<24:33:15,  3.65it/s]
 13%|█▎        | 48640/371472 [3:53:02<24:58:58,  3.59it/s]
                                                           
{'loss': 4.4263, 'learning_rate': 8.825766553901182e-07, 'epoch': 2.1}

 13%|█▎        | 48640/371472 [3:53:02<24:58:58,  3.59it/s]
 13%|█▎        | 48641/371472 [3:53:02<25:02:47,  3.58it/s]
 13%|█▎        | 48642/371472 [3:53:03<24:54:38,  3.60it/s]
 13%|█▎        | 48643/371472 [3:53:03<24:28:43,  3.66it/s]
 13%|█▎        | 48644/371472 [3:53:03<24:42:49,  3.63it/s]
 13%|█▎        | 48645/371472 [3:53:04<23:33:47,  3.81it/s]
 13%|█▎        | 48646/371472 [3:53:04<23:16:59,  3.85it/s]
 13%|█▎        | 48647/371472 [3:53:04<24:54:40,  3.60it/s]
 13%|█▎        | 48648/371472 [3:53:04<24:44:50,  3.62it/s]
 13%|█▎        | 48649/371472 [3:53:05<25:58:23,  3.45it/s]
 13%|█▎        | 48650/371472 [3:53:05<25:09:11,  3.57it/s]
 13%|█▎        | 48651/371472 [3:53:05<25:01:18,  3.58it/s]
 13%|█▎        | 48652/371472 [3:53:06<25:11:20,  3.56it/s]
 13%|█▎        | 48653/371472 [3:53:06<24:25:14,  3.67it/s]
 13%|█▎        | 48654/371472 [3:53:06<24:11:48,  3.71it/s]
 13%|█▎        | 48655/371472 [3:53:06<23:32:45,  3.81it/s]
 13%|█▎        | 48656/371472 [3:53:07<23:37:24,  3.80it/s]
 13%|█▎        | 48657/371472 [3:53:07<23:33:20,  3.81it/s]
 13%|█▎        | 48658/371472 [3:53:07<23:39:13,  3.79it/s]
 13%|█▎        | 48659/371472 [3:53:07<23:09:35,  3.87it/s]
 13%|█▎        | 48660/371472 [3:53:08<23:20:17,  3.84it/s]
                                                           
{'loss': 4.4555, 'learning_rate': 8.825281734146394e-07, 'epoch': 2.1}

 13%|█▎        | 48660/371472 [3:53:08<23:20:17,  3.84it/s]
 13%|█▎        | 48661/371472 [3:53:08<23:39:12,  3.79it/s]
 13%|█▎        | 48662/371472 [3:53:08<25:48:08,  3.48it/s]
 13%|█▎        | 48663/371472 [3:53:08<25:31:10,  3.51it/s]
 13%|█▎        | 48664/371472 [3:53:09<26:33:11,  3.38it/s]
 13%|█▎        | 48665/371472 [3:53:09<25:38:25,  3.50it/s]
 13%|█▎        | 48666/371472 [3:53:09<25:15:39,  3.55it/s]
 13%|█▎        | 48667/371472 [3:53:10<25:05:11,  3.57it/s]
 13%|█▎        | 48668/371472 [3:53:10<24:25:24,  3.67it/s]
 13%|█▎        | 48669/371472 [3:53:10<23:43:23,  3.78it/s]
 13%|█▎        | 48670/371472 [3:53:10<24:30:23,  3.66it/s]
 13%|█▎        | 48671/371472 [3:53:11<24:45:55,  3.62it/s]
 13%|█▎        | 48672/371472 [3:53:11<25:18:34,  3.54it/s]
 13%|█▎        | 48673/371472 [3:53:11<26:21:02,  3.40it/s]
 13%|█▎        | 48674/371472 [3:53:12<25:34:59,  3.50it/s]
 13%|█▎        | 48675/371472 [3:53:12<27:10:37,  3.30it/s]
 13%|█▎        | 48676/371472 [3:53:12<26:41:04,  3.36it/s]
 13%|█▎        | 48677/371472 [3:53:12<26:20:53,  3.40it/s]
 13%|█▎        | 48678/371472 [3:53:13<25:31:35,  3.51it/s]
 13%|█▎        | 48679/371472 [3:53:13<24:45:47,  3.62it/s]
 13%|█▎        | 48680/371472 [3:53:13<26:00:42,  3.45it/s]
                                                           
{'loss': 4.2405, 'learning_rate': 8.824796914391605e-07, 'epoch': 2.1}

 13%|█▎        | 48680/371472 [3:53:13<26:00:42,  3.45it/s]
 13%|█▎        | 48681/371472 [3:53:14<26:03:41,  3.44it/s]
 13%|█▎        | 48682/371472 [3:53:14<26:10:14,  3.43it/s]
 13%|█▎        | 48683/371472 [3:53:14<25:35:09,  3.50it/s]
 13%|█▎        | 48684/371472 [3:53:14<25:00:57,  3.58it/s]
 13%|█▎        | 48685/371472 [3:53:15<25:30:39,  3.51it/s]
 13%|█▎        | 48686/371472 [3:53:15<25:47:59,  3.48it/s]
 13%|█▎        | 48687/371472 [3:53:15<26:23:37,  3.40it/s]
 13%|█▎        | 48688/371472 [3:53:16<27:29:26,  3.26it/s]
 13%|█▎        | 48689/371472 [3:53:16<26:01:47,  3.44it/s]
 13%|█▎        | 48690/371472 [3:53:16<26:30:45,  3.38it/s]
 13%|█▎        | 48691/371472 [3:53:16<25:07:14,  3.57it/s]
 13%|█▎        | 48692/371472 [3:53:17<24:22:34,  3.68it/s]
 13%|█▎        | 48693/371472 [3:53:17<23:46:05,  3.77it/s]
 13%|█▎        | 48694/371472 [3:53:17<23:17:36,  3.85it/s]
 13%|█▎        | 48695/371472 [3:53:17<23:30:26,  3.81it/s]
 13%|█▎        | 48696/371472 [3:53:18<23:32:57,  3.81it/s]
 13%|█▎        | 48697/371472 [3:53:18<23:23:28,  3.83it/s]
 13%|█▎        | 48698/371472 [3:53:18<24:33:04,  3.65it/s]
 13%|█▎        | 48699/371472 [3:53:19<25:01:00,  3.58it/s]
 13%|█▎        | 48700/371472 [3:53:19<25:42:56,  3.49it/s]
                                                           
{'loss': 4.1133, 'learning_rate': 8.824312094636815e-07, 'epoch': 2.1}

 13%|█▎        | 48700/371472 [3:53:19<25:42:56,  3.49it/s]
 13%|█▎        | 48701/371472 [3:53:19<25:20:42,  3.54it/s]
 13%|█▎        | 48702/371472 [3:53:19<24:19:32,  3.69it/s]
 13%|█▎        | 48703/371472 [3:53:20<24:15:38,  3.70it/s]
 13%|█▎        | 48704/371472 [3:53:20<24:35:12,  3.65it/s]
 13%|█▎        | 48705/371472 [3:53:20<24:34:17,  3.65it/s]
 13%|█▎        | 48706/371472 [3:53:21<24:36:47,  3.64it/s]
 13%|█▎        | 48707/371472 [3:53:21<25:04:53,  3.57it/s]
 13%|█▎        | 48708/371472 [3:53:21<23:55:20,  3.75it/s]
 13%|█▎        | 48709/371472 [3:53:21<23:44:44,  3.78it/s]
 13%|█▎        | 48710/371472 [3:53:22<24:37:21,  3.64it/s]
 13%|█▎        | 48711/371472 [3:53:22<27:22:35,  3.27it/s]
 13%|█▎        | 48712/371472 [3:53:22<26:36:15,  3.37it/s]
 13%|█▎        | 48713/371472 [3:53:23<25:16:51,  3.55it/s]
 13%|█▎        | 48714/371472 [3:53:23<24:43:54,  3.63it/s]
 13%|█▎        | 48715/371472 [3:53:23<25:28:26,  3.52it/s]
 13%|█▎        | 48716/371472 [3:53:23<24:49:14,  3.61it/s]
 13%|█▎        | 48717/371472 [3:53:24<24:30:40,  3.66it/s]
 13%|█▎        | 48718/371472 [3:53:24<24:38:44,  3.64it/s]
 13%|█▎        | 48719/371472 [3:53:24<24:33:44,  3.65it/s]
 13%|█▎        | 48720/371472 [3:53:24<26:15:52,  3.41it/s]
                                                           
{'loss': 4.2703, 'learning_rate': 8.823827274882027e-07, 'epoch': 2.1}

 13%|█▎        | 48720/371472 [3:53:24<26:15:52,  3.41it/s]
 13%|█▎        | 48721/371472 [3:53:25<25:48:49,  3.47it/s]
 13%|█▎        | 48722/371472 [3:53:25<24:54:48,  3.60it/s]
 13%|█▎        | 48723/371472 [3:53:25<24:22:15,  3.68it/s]
 13%|█▎        | 48724/371472 [3:53:26<25:08:45,  3.57it/s]
 13%|█▎        | 48725/371472 [3:53:26<25:29:06,  3.52it/s]
 13%|█▎        | 48726/371472 [3:53:26<25:54:33,  3.46it/s]
 13%|█▎        | 48727/371472 [3:53:27<27:22:49,  3.27it/s]
 13%|█▎        | 48728/371472 [3:53:27<26:04:41,  3.44it/s]
 13%|█▎        | 48729/371472 [3:53:27<25:05:45,  3.57it/s]
 13%|█▎        | 48730/371472 [3:53:27<24:30:25,  3.66it/s]
 13%|█▎        | 48731/371472 [3:53:28<24:21:17,  3.68it/s]
 13%|█▎        | 48732/371472 [3:53:28<24:07:44,  3.72it/s]
 13%|█▎        | 48733/371472 [3:53:28<25:09:02,  3.56it/s]
 13%|█▎        | 48734/371472 [3:53:28<25:56:15,  3.46it/s]
 13%|█▎        | 48735/371472 [3:53:29<25:29:59,  3.52it/s]
 13%|█▎        | 48736/371472 [3:53:29<25:24:57,  3.53it/s]
 13%|█▎        | 48737/371472 [3:53:29<24:24:02,  3.67it/s]
 13%|█▎        | 48738/371472 [3:53:30<24:19:08,  3.69it/s]
 13%|█▎        | 48739/371472 [3:53:30<23:52:53,  3.75it/s]
 13%|█▎        | 48740/371472 [3:53:30<23:18:57,  3.84it/s]
                                                           
{'loss': 4.5088, 'learning_rate': 8.823342455127238e-07, 'epoch': 2.1}

 13%|█▎        | 48740/371472 [3:53:30<23:18:57,  3.84it/s]
 13%|█▎        | 48741/371472 [3:53:30<22:36:34,  3.97it/s]
 13%|█▎        | 48742/371472 [3:53:31<24:14:56,  3.70it/s]
 13%|█▎        | 48743/371472 [3:53:31<24:48:57,  3.61it/s]
 13%|█▎        | 48744/371472 [3:53:31<24:20:31,  3.68it/s]
 13%|█▎        | 48745/371472 [3:53:31<23:35:29,  3.80it/s]
 13%|█▎        | 48746/371472 [3:53:32<24:42:37,  3.63it/s]
 13%|█▎        | 48747/371472 [3:53:32<24:47:22,  3.62it/s]
 13%|█▎        | 48748/371472 [3:53:32<24:11:20,  3.71it/s]
 13%|█▎        | 48749/371472 [3:53:32<25:01:06,  3.58it/s]
 13%|█▎        | 48750/371472 [3:53:33<25:03:41,  3.58it/s]
 13%|█▎        | 48751/371472 [3:53:33<26:31:31,  3.38it/s]
 13%|█▎        | 48752/371472 [3:53:33<27:49:13,  3.22it/s]
 13%|█▎        | 48753/371472 [3:53:34<26:32:55,  3.38it/s]
 13%|█▎        | 48754/371472 [3:53:34<25:04:05,  3.58it/s]
 13%|█▎        | 48755/371472 [3:53:34<25:04:00,  3.58it/s]
 13%|█▎        | 48756/371472 [3:53:35<24:59:30,  3.59it/s]
 13%|█▎        | 48757/371472 [3:53:35<24:01:30,  3.73it/s]
 13%|█▎        | 48758/371472 [3:53:35<24:59:55,  3.59it/s]
 13%|█▎        | 48759/371472 [3:53:35<24:41:37,  3.63it/s]
 13%|█▎        | 48760/371472 [3:53:36<24:25:46,  3.67it/s]
                                                           
{'loss': 4.1103, 'learning_rate': 8.822857635372449e-07, 'epoch': 2.1}

 13%|█▎        | 48760/371472 [3:53:36<24:25:46,  3.67it/s]
 13%|█▎        | 48761/371472 [3:53:36<23:57:10,  3.74it/s]
 13%|█▎        | 48762/371472 [3:53:36<23:34:38,  3.80it/s]
 13%|█▎        | 48763/371472 [3:53:36<24:12:31,  3.70it/s]
 13%|█▎        | 48764/371472 [3:53:37<23:57:31,  3.74it/s]
 13%|█▎        | 48765/371472 [3:53:37<23:34:13,  3.80it/s]
 13%|█▎        | 48766/371472 [3:53:37<22:57:13,  3.91it/s]
 13%|█▎        | 48767/371472 [3:53:37<22:51:03,  3.92it/s]
 13%|█▎        | 48768/371472 [3:53:38<24:53:47,  3.60it/s]
 13%|█▎        | 48769/371472 [3:53:38<24:22:24,  3.68it/s]
 13%|█▎        | 48770/371472 [3:53:38<24:41:20,  3.63it/s]
 13%|█▎        | 48771/371472 [3:53:39<24:02:38,  3.73it/s]
 13%|█▎        | 48772/371472 [3:53:39<25:24:53,  3.53it/s]
 13%|█▎        | 48773/371472 [3:53:39<24:17:51,  3.69it/s]
 13%|█▎        | 48774/371472 [3:53:39<24:57:16,  3.59it/s]
 13%|█▎        | 48775/371472 [3:53:40<24:29:19,  3.66it/s]
 13%|█▎        | 48776/371472 [3:53:40<25:33:25,  3.51it/s]
 13%|█▎        | 48777/371472 [3:53:40<24:44:08,  3.62it/s]
 13%|█▎        | 48778/371472 [3:53:40<24:27:18,  3.67it/s]
 13%|█▎        | 48779/371472 [3:53:41<24:57:49,  3.59it/s]
 13%|█▎        | 48780/371472 [3:53:41<23:51:51,  3.76it/s]
                                                           
{'loss': 4.4763, 'learning_rate': 8.822372815617659e-07, 'epoch': 2.1}

 13%|█▎        | 48780/371472 [3:53:41<23:51:51,  3.76it/s]
 13%|█▎        | 48781/371472 [3:53:41<23:09:20,  3.87it/s]
 13%|█▎        | 48782/371472 [3:53:42<23:35:46,  3.80it/s]
 13%|█▎        | 48783/371472 [3:53:42<26:41:19,  3.36it/s]
 13%|█▎        | 48784/371472 [3:53:42<27:09:35,  3.30it/s]
 13%|█▎        | 48785/371472 [3:53:42<25:56:35,  3.46it/s]
 13%|█▎        | 48786/371472 [3:53:43<24:22:50,  3.68it/s]
 13%|█▎        | 48787/371472 [3:53:43<23:26:43,  3.82it/s]
 13%|█▎        | 48788/371472 [3:53:43<22:58:15,  3.90it/s]
 13%|█▎        | 48789/371472 [3:53:43<23:54:01,  3.75it/s]
 13%|█▎        | 48790/371472 [3:53:44<23:35:51,  3.80it/s]
 13%|█▎        | 48791/371472 [3:53:44<23:38:46,  3.79it/s]
 13%|█▎        | 48792/371472 [3:53:44<23:50:41,  3.76it/s]
 13%|█▎        | 48793/371472 [3:53:45<24:36:31,  3.64it/s]
 13%|█▎        | 48794/371472 [3:53:45<24:04:09,  3.72it/s]
 13%|█▎        | 48795/371472 [3:53:45<23:48:12,  3.77it/s]
 13%|█▎        | 48796/371472 [3:53:45<24:38:17,  3.64it/s]
 13%|█▎        | 48797/371472 [3:53:46<25:14:52,  3.55it/s]
 13%|█▎        | 48798/371472 [3:53:46<25:14:34,  3.55it/s]
 13%|█▎        | 48799/371472 [3:53:46<25:24:34,  3.53it/s]
 13%|█▎        | 48800/371472 [3:53:46<24:13:27,  3.70it/s]
                                                           
{'loss': 4.2769, 'learning_rate': 8.821887995862871e-07, 'epoch': 2.1}

 13%|█▎        | 48800/371472 [3:53:46<24:13:27,  3.70it/s]
 13%|█▎        | 48801/371472 [3:53:47<27:44:10,  3.23it/s]
 13%|█▎        | 48802/371472 [3:53:47<25:54:10,  3.46it/s]
 13%|█▎        | 48803/371472 [3:53:47<26:43:49,  3.35it/s]
 13%|█▎        | 48804/371472 [3:53:48<25:20:35,  3.54it/s]
 13%|█▎        | 48805/371472 [3:53:48<23:59:18,  3.74it/s]
 13%|█▎        | 48806/371472 [3:53:48<24:19:45,  3.68it/s]
 13%|█▎        | 48807/371472 [3:53:48<24:01:18,  3.73it/s]
 13%|█▎        | 48808/371472 [3:53:49<23:22:50,  3.83it/s]
 13%|█▎        | 48809/371472 [3:53:49<23:15:01,  3.85it/s]
 13%|█▎        | 48810/371472 [3:53:49<24:02:34,  3.73it/s]
 13%|█▎        | 48811/371472 [3:53:50<24:08:41,  3.71it/s]
 13%|█▎        | 48812/371472 [3:53:50<24:24:05,  3.67it/s]
 13%|█▎        | 48813/371472 [3:53:50<23:41:34,  3.78it/s]
 13%|█▎        | 48814/371472 [3:53:50<23:52:05,  3.76it/s]
 13%|█▎        | 48815/371472 [3:53:51<27:27:35,  3.26it/s]
 13%|█▎        | 48816/371472 [3:53:51<26:12:07,  3.42it/s]
 13%|█▎        | 48817/371472 [3:53:51<25:20:19,  3.54it/s]
 13%|█▎        | 48818/371472 [3:53:52<25:52:15,  3.46it/s]
 13%|█▎        | 48819/371472 [3:53:52<24:27:03,  3.67it/s]
 13%|█▎        | 48820/371472 [3:53:52<26:17:54,  3.41it/s]
                                                           
{'loss': 4.4507, 'learning_rate': 8.821403176108082e-07, 'epoch': 2.1}

 13%|█▎        | 48820/371472 [3:53:52<26:17:54,  3.41it/s]
 13%|█▎        | 48821/371472 [3:53:52<25:44:53,  3.48it/s]
 13%|█▎        | 48822/371472 [3:53:53<26:11:18,  3.42it/s]
 13%|█▎        | 48823/371472 [3:53:53<26:04:49,  3.44it/s]
 13%|█▎        | 48824/371472 [3:53:53<25:11:34,  3.56it/s]
 13%|█▎        | 48825/371472 [3:53:54<26:39:20,  3.36it/s]
 13%|█▎        | 48826/371472 [3:53:54<26:14:16,  3.42it/s]
 13%|█▎        | 48827/371472 [3:53:54<25:37:15,  3.50it/s]
 13%|█▎        | 48828/371472 [3:53:54<25:20:35,  3.54it/s]
 13%|█▎        | 48829/371472 [3:53:55<25:06:25,  3.57it/s]
 13%|█▎        | 48830/371472 [3:53:55<28:09:06,  3.18it/s]
 13%|█▎        | 48831/371472 [3:53:55<26:36:59,  3.37it/s]
 13%|█▎        | 48832/371472 [3:53:56<26:25:08,  3.39it/s]
 13%|█▎        | 48833/371472 [3:53:56<27:04:18,  3.31it/s]
 13%|█▎        | 48834/371472 [3:53:56<28:30:57,  3.14it/s]
 13%|█▎        | 48835/371472 [3:53:57<27:52:36,  3.21it/s]
 13%|█▎        | 48836/371472 [3:53:57<26:55:33,  3.33it/s]
 13%|█▎        | 48837/371472 [3:53:57<25:28:36,  3.52it/s]
 13%|█▎        | 48838/371472 [3:53:57<25:12:26,  3.56it/s]
 13%|█▎        | 48839/371472 [3:53:58<29:23:55,  3.05it/s]
 13%|█▎        | 48840/371472 [3:53:58<28:46:09,  3.12it/s]
                                                           
{'loss': 4.1722, 'learning_rate': 8.820918356353294e-07, 'epoch': 2.1}

 13%|█▎        | 48840/371472 [3:53:58<28:46:09,  3.12it/s]
 13%|█▎        | 48841/371472 [3:53:58<29:00:42,  3.09it/s]
 13%|█▎        | 48842/371472 [3:53:59<28:05:22,  3.19it/s]
 13%|█▎        | 48843/371472 [3:53:59<26:05:16,  3.44it/s]
 13%|█▎        | 48844/371472 [3:53:59<26:06:32,  3.43it/s]
 13%|█▎        | 48845/371472 [3:54:00<25:52:15,  3.46it/s]
 13%|█▎        | 48846/371472 [3:54:00<26:41:48,  3.36it/s]
 13%|█▎        | 48847/371472 [3:54:00<25:37:49,  3.50it/s]
 13%|█▎        | 48848/371472 [3:54:00<24:59:58,  3.58it/s]
 13%|█▎        | 48849/371472 [3:54:01<25:43:24,  3.48it/s]
 13%|█▎        | 48850/371472 [3:54:01<25:58:53,  3.45it/s]
 13%|█▎        | 48851/371472 [3:54:01<24:54:21,  3.60it/s]
 13%|█▎        | 48852/371472 [3:54:02<24:51:10,  3.61it/s]
 13%|█▎        | 48853/371472 [3:54:02<24:50:57,  3.61it/s]
 13%|█▎        | 48854/371472 [3:54:02<24:01:22,  3.73it/s]
 13%|█▎        | 48855/371472 [3:54:02<24:24:04,  3.67it/s]
 13%|█▎        | 48856/371472 [3:54:03<24:29:47,  3.66it/s]
 13%|█▎        | 48857/371472 [3:54:03<24:15:05,  3.70it/s]
 13%|█▎        | 48858/371472 [3:54:03<25:08:19,  3.56it/s]
 13%|█▎        | 48859/371472 [3:54:03<24:19:22,  3.68it/s]
 13%|█▎        | 48860/371472 [3:54:04<26:11:56,  3.42it/s]
                                                           
{'loss': 4.1197, 'learning_rate': 8.820433536598504e-07, 'epoch': 2.1}

 13%|█▎        | 48860/371472 [3:54:04<26:11:56,  3.42it/s]
 13%|█▎        | 48861/371472 [3:54:04<24:49:51,  3.61it/s]
 13%|█▎        | 48862/371472 [3:54:04<25:18:42,  3.54it/s]
 13%|█▎        | 48863/371472 [3:54:05<26:24:38,  3.39it/s]
 13%|█▎        | 48864/371472 [3:54:05<29:37:38,  3.02it/s]
 13%|█▎        | 48865/371472 [3:54:05<28:39:36,  3.13it/s]
 13%|█▎        | 48866/371472 [3:54:06<27:46:21,  3.23it/s]
 13%|█▎        | 48867/371472 [3:54:06<27:56:53,  3.21it/s]
 13%|█▎        | 48868/371472 [3:54:06<27:26:31,  3.27it/s]
 13%|█▎        | 48869/371472 [3:54:06<26:17:07,  3.41it/s]
 13%|█▎        | 48870/371472 [3:54:07<25:37:05,  3.50it/s]
 13%|█▎        | 48871/371472 [3:54:07<24:35:43,  3.64it/s]
 13%|█▎        | 48872/371472 [3:54:07<23:53:39,  3.75it/s]
 13%|█▎        | 48873/371472 [3:54:08<23:40:13,  3.79it/s]
 13%|█▎        | 48874/371472 [3:54:08<23:44:45,  3.77it/s]
 13%|█▎        | 48875/371472 [3:54:08<24:02:21,  3.73it/s]
 13%|█▎        | 48876/371472 [3:54:08<26:46:26,  3.35it/s]
 13%|█▎        | 48877/371472 [3:54:09<26:14:45,  3.41it/s]
 13%|█▎        | 48878/371472 [3:54:09<26:05:45,  3.43it/s]
 13%|█▎        | 48879/371472 [3:54:09<24:42:01,  3.63it/s]
 13%|█▎        | 48880/371472 [3:54:09<24:01:18,  3.73it/s]
                                                           
{'loss': 4.0937, 'learning_rate': 8.819948716843715e-07, 'epoch': 2.11}

 13%|█▎        | 48880/371472 [3:54:09<24:01:18,  3.73it/s]
 13%|█▎        | 48881/371472 [3:54:10<23:19:39,  3.84it/s]
 13%|█▎        | 48882/371472 [3:54:10<24:14:48,  3.70it/s]
 13%|█▎        | 48883/371472 [3:54:10<24:19:33,  3.68it/s]
 13%|█▎        | 48884/371472 [3:54:11<24:03:11,  3.73it/s]
 13%|█▎        | 48885/371472 [3:54:11<24:26:22,  3.67it/s]
 13%|█▎        | 48886/371472 [3:54:11<24:05:06,  3.72it/s]
 13%|█▎        | 48887/371472 [3:54:11<24:02:52,  3.73it/s]
 13%|█▎        | 48888/371472 [3:54:12<24:17:22,  3.69it/s]
 13%|█▎        | 48889/371472 [3:54:12<24:09:25,  3.71it/s]
 13%|█▎        | 48890/371472 [3:54:12<23:35:13,  3.80it/s]
 13%|█▎        | 48891/371472 [3:54:12<23:16:28,  3.85it/s]
 13%|█▎        | 48892/371472 [3:54:13<23:44:34,  3.77it/s]
 13%|█▎        | 48893/371472 [3:54:13<26:23:54,  3.39it/s]
 13%|█▎        | 48894/371472 [3:54:13<28:58:27,  3.09it/s]
 13%|█▎        | 48895/371472 [3:54:14<27:41:09,  3.24it/s]
 13%|█▎        | 48896/371472 [3:54:14<26:22:52,  3.40it/s]
 13%|█▎        | 48897/371472 [3:54:14<25:45:12,  3.48it/s]
 13%|█▎        | 48898/371472 [3:54:14<24:46:39,  3.62it/s]
 13%|█▎        | 48899/371472 [3:54:15<24:12:16,  3.70it/s]
 13%|█▎        | 48900/371472 [3:54:15<29:17:04,  3.06it/s]
                                                           
{'loss': 4.2682, 'learning_rate': 8.819463897088926e-07, 'epoch': 2.11}

 13%|█▎        | 48900/371472 [3:54:15<29:17:04,  3.06it/s]
 13%|█▎        | 48901/371472 [3:54:15<28:22:07,  3.16it/s]
 13%|█▎        | 48902/371472 [3:54:16<26:28:26,  3.38it/s]
 13%|█▎        | 48903/371472 [3:54:16<25:21:46,  3.53it/s]
 13%|█▎        | 48904/371472 [3:54:16<25:35:07,  3.50it/s]
 13%|█▎        | 48905/371472 [3:54:17<24:10:57,  3.71it/s]
 13%|█▎        | 48906/371472 [3:54:17<23:44:59,  3.77it/s]
 13%|█▎        | 48907/371472 [3:54:17<23:54:42,  3.75it/s]
 13%|█▎        | 48908/371472 [3:54:17<26:13:28,  3.42it/s]
 13%|█▎        | 48909/371472 [3:54:18<27:04:04,  3.31it/s]
 13%|█▎        | 48910/371472 [3:54:18<26:21:19,  3.40it/s]
 13%|█▎        | 48911/371472 [3:54:18<26:35:32,  3.37it/s]
 13%|█▎        | 48912/371472 [3:54:19<25:53:47,  3.46it/s]
 13%|█▎        | 48913/371472 [3:54:19<24:47:10,  3.61it/s]
 13%|█▎        | 48914/371472 [3:54:19<24:26:24,  3.67it/s]
 13%|█▎        | 48915/371472 [3:54:19<24:39:29,  3.63it/s]
 13%|█▎        | 48916/371472 [3:54:20<27:31:00,  3.26it/s]
 13%|█▎        | 48917/371472 [3:54:20<26:30:38,  3.38it/s]
 13%|█▎        | 48918/371472 [3:54:20<26:11:32,  3.42it/s]
 13%|█▎        | 48919/371472 [3:54:21<26:47:23,  3.34it/s]
 13%|█▎        | 48920/371472 [3:54:21<29:49:32,  3.00it/s]
                                                           
{'loss': 4.2429, 'learning_rate': 8.818979077334138e-07, 'epoch': 2.11}

 13%|█▎        | 48920/371472 [3:54:21<29:49:32,  3.00it/s]
 13%|█▎        | 48921/371472 [3:54:21<30:07:50,  2.97it/s]
 13%|█▎        | 48922/371472 [3:54:22<28:14:47,  3.17it/s]
 13%|█▎        | 48923/371472 [3:54:22<26:32:17,  3.38it/s]
 13%|█▎        | 48924/371472 [3:54:22<26:23:16,  3.40it/s]
 13%|█▎        | 48925/371472 [3:54:22<25:48:23,  3.47it/s]
 13%|█▎        | 48926/371472 [3:54:23<24:52:30,  3.60it/s]
 13%|█▎        | 48927/371472 [3:54:23<24:25:11,  3.67it/s]
 13%|█▎        | 48928/371472 [3:54:23<26:41:43,  3.36it/s]
 13%|█▎        | 48929/371472 [3:54:24<26:44:34,  3.35it/s]
 13%|█▎        | 48930/371472 [3:54:24<28:46:25,  3.11it/s]
 13%|█▎        | 48931/371472 [3:54:24<27:30:36,  3.26it/s]
 13%|█▎        | 48932/371472 [3:54:25<27:13:41,  3.29it/s]
 13%|█▎        | 48933/371472 [3:54:25<29:20:01,  3.05it/s]
 13%|█▎        | 48934/371472 [3:54:25<29:00:09,  3.09it/s]
 13%|█▎        | 48935/371472 [3:54:26<28:16:04,  3.17it/s]
 13%|█▎        | 48936/371472 [3:54:26<27:45:59,  3.23it/s]
 13%|█▎        | 48937/371472 [3:54:26<27:44:33,  3.23it/s]
 13%|█▎        | 48938/371472 [3:54:26<26:33:30,  3.37it/s]
 13%|█▎        | 48939/371472 [3:54:27<25:52:07,  3.46it/s]
 13%|█▎        | 48940/371472 [3:54:27<25:20:24,  3.54it/s]
                                                           
{'loss': 4.2731, 'learning_rate': 8.818494257579348e-07, 'epoch': 2.11}

 13%|█▎        | 48940/371472 [3:54:27<25:20:24,  3.54it/s]
 13%|█▎        | 48941/371472 [3:54:27<25:11:44,  3.56it/s]
 13%|█▎        | 48942/371472 [3:54:28<24:21:34,  3.68it/s]
 13%|█▎        | 48943/371472 [3:54:28<23:47:17,  3.77it/s]
 13%|█▎        | 48944/371472 [3:54:28<23:39:37,  3.79it/s]
 13%|█▎        | 48945/371472 [3:54:28<25:23:54,  3.53it/s]
 13%|█▎        | 48946/371472 [3:54:29<25:20:53,  3.53it/s]
 13%|█▎        | 48947/371472 [3:54:29<26:30:45,  3.38it/s]
 13%|█▎        | 48948/371472 [3:54:29<25:37:53,  3.50it/s]
 13%|█▎        | 48949/371472 [3:54:30<26:45:33,  3.35it/s]
 13%|█▎        | 48950/371472 [3:54:30<26:15:37,  3.41it/s]
 13%|█▎        | 48951/371472 [3:54:30<25:53:48,  3.46it/s]
 13%|█▎        | 48952/371472 [3:54:30<26:12:23,  3.42it/s]
 13%|█▎        | 48953/371472 [3:54:31<25:24:18,  3.53it/s]
 13%|█▎        | 48954/371472 [3:54:31<23:56:29,  3.74it/s]
 13%|█▎        | 48955/371472 [3:54:31<23:17:40,  3.85it/s]
 13%|█▎        | 48956/371472 [3:54:31<23:15:52,  3.85it/s]
 13%|█▎        | 48957/371472 [3:54:32<23:17:58,  3.85it/s]
 13%|█▎        | 48958/371472 [3:54:32<23:07:35,  3.87it/s]
 13%|█▎        | 48959/371472 [3:54:32<22:59:56,  3.90it/s]
 13%|█▎        | 48960/371472 [3:54:32<23:57:17,  3.74it/s]
                                                           
{'loss': 4.2936, 'learning_rate': 8.81800943782456e-07, 'epoch': 2.11}

 13%|█▎        | 48960/371472 [3:54:32<23:57:17,  3.74it/s]
 13%|█▎        | 48961/371472 [3:54:33<25:32:53,  3.51it/s]
 13%|█▎        | 48962/371472 [3:54:33<24:41:16,  3.63it/s]
 13%|█▎        | 48963/371472 [3:54:33<24:04:13,  3.72it/s]
 13%|█▎        | 48964/371472 [3:54:34<23:38:18,  3.79it/s]
 13%|█▎        | 48965/371472 [3:54:34<23:54:42,  3.75it/s]
 13%|█▎        | 48966/371472 [3:54:34<23:23:07,  3.83it/s]
 13%|█▎        | 48967/371472 [3:54:34<23:24:06,  3.83it/s]
 13%|█▎        | 48968/371472 [3:54:35<23:33:10,  3.80it/s]
 13%|█▎        | 48969/371472 [3:54:35<23:40:03,  3.79it/s]
 13%|█▎        | 48970/371472 [3:54:35<24:33:28,  3.65it/s]
 13%|█▎        | 48971/371472 [3:54:35<25:05:01,  3.57it/s]
 13%|█▎        | 48972/371472 [3:54:36<24:36:51,  3.64it/s]
 13%|█▎        | 48973/371472 [3:54:36<24:18:40,  3.68it/s]
 13%|█▎        | 48974/371472 [3:54:36<24:56:04,  3.59it/s]
 13%|█▎        | 48975/371472 [3:54:37<26:06:08,  3.43it/s]
 13%|█▎        | 48976/371472 [3:54:37<26:19:12,  3.40it/s]
 13%|█▎        | 48977/371472 [3:54:37<26:05:16,  3.43it/s]
 13%|█▎        | 48978/371472 [3:54:37<24:54:52,  3.60it/s]
 13%|█▎        | 48979/371472 [3:54:38<25:15:03,  3.55it/s]
 13%|█▎        | 48980/371472 [3:54:38<25:26:59,  3.52it/s]
                                                           
{'loss': 4.3315, 'learning_rate': 8.817524618069771e-07, 'epoch': 2.11}

 13%|█▎        | 48980/371472 [3:54:38<25:26:59,  3.52it/s]
 13%|█▎        | 48981/371472 [3:54:38<26:03:30,  3.44it/s]
 13%|█▎        | 48982/371472 [3:54:39<27:42:59,  3.23it/s]
 13%|█▎        | 48983/371472 [3:54:39<26:16:23,  3.41it/s]
 13%|█▎        | 48984/371472 [3:54:39<26:32:29,  3.38it/s]
 13%|█▎        | 48985/371472 [3:54:40<26:16:04,  3.41it/s]
 13%|█▎        | 48986/371472 [3:54:40<26:59:43,  3.32it/s]
 13%|█▎        | 48987/371472 [3:54:40<25:54:34,  3.46it/s]
 13%|█▎        | 48988/371472 [3:54:40<25:45:00,  3.48it/s]
 13%|█▎        | 48989/371472 [3:54:41<26:17:01,  3.41it/s]
 13%|█▎        | 48990/371472 [3:54:41<25:29:15,  3.51it/s]
 13%|█▎        | 48991/371472 [3:54:41<24:23:15,  3.67it/s]
 13%|█▎        | 48992/371472 [3:54:41<24:23:11,  3.67it/s]
 13%|█▎        | 48993/371472 [3:54:42<24:04:29,  3.72it/s]
 13%|█▎        | 48994/371472 [3:54:42<24:16:40,  3.69it/s]
 13%|█▎        | 48995/371472 [3:54:42<23:42:50,  3.78it/s]
 13%|█▎        | 48996/371472 [3:54:43<26:08:53,  3.43it/s]
 13%|█▎        | 48997/371472 [3:54:43<25:00:48,  3.58it/s]
 13%|█▎        | 48998/371472 [3:54:43<24:00:47,  3.73it/s]
 13%|█▎        | 48999/371472 [3:54:43<23:46:39,  3.77it/s]
 13%|█▎        | 49000/371472 [3:54:44<23:55:04,  3.75it/s]
                                                           
{'loss': 4.3196, 'learning_rate': 8.817039798314981e-07, 'epoch': 2.11}

 13%|█▎        | 49000/371472 [3:54:44<23:55:04,  3.75it/s]
 13%|█▎        | 49001/371472 [3:54:44<23:34:27,  3.80it/s]
 13%|█▎        | 49002/371472 [3:54:44<23:12:55,  3.86it/s]
 13%|█▎        | 49003/371472 [3:54:44<23:12:25,  3.86it/s]
 13%|█▎        | 49004/371472 [3:54:45<23:26:05,  3.82it/s]
 13%|█▎        | 49005/371472 [3:54:45<23:37:50,  3.79it/s]
 13%|█▎        | 49006/371472 [3:54:45<23:10:57,  3.86it/s]
 13%|█▎        | 49007/371472 [3:54:45<23:20:08,  3.84it/s]
 13%|█▎        | 49008/371472 [3:54:46<23:57:52,  3.74it/s]
 13%|█▎        | 49009/371472 [3:54:46<23:30:54,  3.81it/s]
 13%|█▎        | 49010/371472 [3:54:46<22:51:55,  3.92it/s]
 13%|█▎        | 49011/371472 [3:54:46<23:02:42,  3.89it/s]
 13%|█▎        | 49012/371472 [3:54:47<24:16:24,  3.69it/s]
 13%|█▎        | 49013/371472 [3:54:47<25:55:11,  3.46it/s]
 13%|█▎        | 49014/371472 [3:54:47<25:14:49,  3.55it/s]
 13%|█▎        | 49015/371472 [3:54:48<24:32:19,  3.65it/s]
 13%|█▎        | 49016/371472 [3:54:48<24:06:41,  3.71it/s]
 13%|█▎        | 49017/371472 [3:54:48<25:29:37,  3.51it/s]
 13%|█▎        | 49018/371472 [3:54:48<25:02:18,  3.58it/s]
 13%|█▎        | 49019/371472 [3:54:49<24:25:31,  3.67it/s]
 13%|█▎        | 49020/371472 [3:54:49<23:29:58,  3.81it/s]
                                                           
{'loss': 4.192, 'learning_rate': 8.816554978560192e-07, 'epoch': 2.11}

 13%|█▎        | 49020/371472 [3:54:49<23:29:58,  3.81it/s]
 13%|█▎        | 49021/371472 [3:54:49<24:37:31,  3.64it/s]
 13%|█▎        | 49022/371472 [3:54:50<24:15:47,  3.69it/s]
 13%|█▎        | 49023/371472 [3:54:50<24:40:02,  3.63it/s]
 13%|█▎        | 49024/371472 [3:54:50<24:51:21,  3.60it/s]
 13%|█▎        | 49025/371472 [3:54:50<24:46:32,  3.62it/s]
 13%|█▎        | 49026/371472 [3:54:51<23:51:56,  3.75it/s]
 13%|█▎        | 49027/371472 [3:54:51<23:50:44,  3.76it/s]
 13%|█▎        | 49028/371472 [3:54:51<23:03:05,  3.89it/s]
 13%|█▎        | 49029/371472 [3:54:51<22:18:10,  4.02it/s]
 13%|█▎        | 49030/371472 [3:54:52<22:56:42,  3.90it/s]
 13%|█▎        | 49031/371472 [3:54:52<24:46:51,  3.61it/s]
 13%|█▎        | 49032/371472 [3:54:52<25:47:36,  3.47it/s]
 13%|█▎        | 49033/371472 [3:54:53<26:38:59,  3.36it/s]
 13%|█▎        | 49034/371472 [3:54:53<27:43:00,  3.23it/s]
 13%|█▎        | 49035/371472 [3:54:53<26:39:10,  3.36it/s]
 13%|█▎        | 49036/371472 [3:54:53<26:57:34,  3.32it/s]
 13%|█▎        | 49037/371472 [3:54:54<25:40:01,  3.49it/s]
 13%|█▎        | 49038/371472 [3:54:54<25:05:24,  3.57it/s]
 13%|█▎        | 49039/371472 [3:54:54<25:10:49,  3.56it/s]
 13%|█▎        | 49040/371472 [3:54:55<24:01:12,  3.73it/s]
                                                           
{'loss': 4.261, 'learning_rate': 8.816070158805404e-07, 'epoch': 2.11}

 13%|█▎        | 49040/371472 [3:54:55<24:01:12,  3.73it/s]
 13%|█▎        | 49041/371472 [3:54:55<25:01:13,  3.58it/s]
 13%|█▎        | 49042/371472 [3:54:55<24:38:56,  3.63it/s]
 13%|█▎        | 49043/371472 [3:54:55<24:38:57,  3.63it/s]
 13%|█▎        | 49044/371472 [3:54:56<25:56:33,  3.45it/s]
 13%|█▎        | 49045/371472 [3:54:56<26:14:35,  3.41it/s]
 13%|█▎        | 49046/371472 [3:54:56<26:18:35,  3.40it/s]
 13%|█▎        | 49047/371472 [3:54:57<25:17:51,  3.54it/s]
 13%|█▎        | 49048/371472 [3:54:57<25:07:51,  3.56it/s]
 13%|█▎        | 49049/371472 [3:54:57<24:19:57,  3.68it/s]
 13%|█▎        | 49050/371472 [3:54:57<24:25:53,  3.67it/s]
 13%|█▎        | 49051/371472 [3:54:58<23:51:32,  3.75it/s]
 13%|█▎        | 49052/371472 [3:54:58<24:06:03,  3.72it/s]
 13%|█▎        | 49053/371472 [3:54:58<24:39:10,  3.63it/s]
 13%|█▎        | 49054/371472 [3:54:58<24:07:11,  3.71it/s]
 13%|█▎        | 49055/371472 [3:54:59<24:27:25,  3.66it/s]
 13%|█▎        | 49056/371472 [3:54:59<24:08:45,  3.71it/s]
 13%|█▎        | 49057/371472 [3:54:59<24:56:27,  3.59it/s]
 13%|█▎        | 49058/371472 [3:55:00<24:32:50,  3.65it/s]
 13%|█▎        | 49059/371472 [3:55:00<24:20:26,  3.68it/s]
 13%|█▎        | 49060/371472 [3:55:00<24:19:16,  3.68it/s]
                                                           
{'loss': 4.3711, 'learning_rate': 8.815585339050615e-07, 'epoch': 2.11}

 13%|█▎        | 49060/371472 [3:55:00<24:19:16,  3.68it/s]
 13%|█▎        | 49061/371472 [3:55:00<26:02:55,  3.44it/s]
 13%|█▎        | 49062/371472 [3:55:01<25:02:32,  3.58it/s]
 13%|█▎        | 49063/371472 [3:55:01<25:17:49,  3.54it/s]
 13%|█▎        | 49064/371472 [3:55:01<25:07:37,  3.56it/s]
 13%|█▎        | 49065/371472 [3:55:02<25:28:21,  3.52it/s]
 13%|█▎        | 49066/371472 [3:55:02<25:03:12,  3.57it/s]
 13%|█▎        | 49067/371472 [3:55:02<27:51:36,  3.21it/s]
 13%|█▎        | 49068/371472 [3:55:02<27:09:30,  3.30it/s]
 13%|█▎        | 49069/371472 [3:55:03<28:04:12,  3.19it/s]
 13%|█▎        | 49070/371472 [3:55:03<30:35:50,  2.93it/s]
 13%|█▎        | 49071/371472 [3:55:03<29:07:54,  3.07it/s]
 13%|█▎        | 49072/371472 [3:55:04<27:00:49,  3.32it/s]
 13%|█▎        | 49073/371472 [3:55:04<27:24:23,  3.27it/s]
 13%|█▎        | 49074/371472 [3:55:04<26:57:10,  3.32it/s]
 13%|█▎        | 49075/371472 [3:55:05<25:58:43,  3.45it/s]
 13%|█▎        | 49076/371472 [3:55:05<24:34:46,  3.64it/s]
 13%|█▎        | 49077/371472 [3:55:05<23:40:02,  3.78it/s]
 13%|█▎        | 49078/371472 [3:55:05<22:59:01,  3.90it/s]
 13%|█▎        | 49079/371472 [3:55:06<24:40:22,  3.63it/s]
 13%|█▎        | 49080/371472 [3:55:06<23:50:43,  3.76it/s]
                                                           
{'loss': 4.4269, 'learning_rate': 8.815100519295826e-07, 'epoch': 2.11}

 13%|█▎        | 49080/371472 [3:55:06<23:50:43,  3.76it/s]
 13%|█▎        | 49081/371472 [3:55:06<23:09:53,  3.87it/s]
 13%|█▎        | 49082/371472 [3:55:06<23:00:13,  3.89it/s]
 13%|█▎        | 49083/371472 [3:55:07<24:30:22,  3.65it/s]
 13%|█▎        | 49084/371472 [3:55:07<24:47:50,  3.61it/s]
 13%|█▎        | 49085/371472 [3:55:07<25:03:55,  3.57it/s]
 13%|█▎        | 49086/371472 [3:55:08<24:58:00,  3.59it/s]
 13%|█▎        | 49087/371472 [3:55:08<25:24:00,  3.53it/s]
 13%|█▎        | 49088/371472 [3:55:08<27:31:51,  3.25it/s]
 13%|█▎        | 49089/371472 [3:55:08<25:53:05,  3.46it/s]
 13%|█▎        | 49090/371472 [3:55:09<26:05:13,  3.43it/s]
 13%|█▎        | 49091/371472 [3:55:09<26:53:39,  3.33it/s]
 13%|█▎        | 49092/371472 [3:55:09<25:55:02,  3.46it/s]
 13%|█▎        | 49093/371472 [3:55:10<26:13:46,  3.41it/s]
 13%|█▎        | 49094/371472 [3:55:10<25:11:36,  3.55it/s]
 13%|█▎        | 49095/371472 [3:55:10<24:31:36,  3.65it/s]
 13%|█▎        | 49096/371472 [3:55:10<24:05:40,  3.72it/s]
 13%|█▎        | 49097/371472 [3:55:11<25:37:16,  3.50it/s]
 13%|█▎        | 49098/371472 [3:55:11<25:35:21,  3.50it/s]
 13%|█▎        | 49099/371472 [3:55:11<24:23:26,  3.67it/s]
 13%|█▎        | 49100/371472 [3:55:11<23:27:38,  3.82it/s]
                                                           
{'loss': 4.4123, 'learning_rate': 8.814615699541037e-07, 'epoch': 2.11}

 13%|█▎        | 49100/371472 [3:55:11<23:27:38,  3.82it/s]
 13%|█▎        | 49101/371472 [3:55:12<22:58:38,  3.90it/s]
 13%|█▎        | 49102/371472 [3:55:12<24:24:45,  3.67it/s]
 13%|█▎        | 49103/371472 [3:55:12<25:14:42,  3.55it/s]
 13%|█▎        | 49104/371472 [3:55:13<24:36:01,  3.64it/s]
 13%|█▎        | 49105/371472 [3:55:13<25:42:05,  3.48it/s]
 13%|█▎        | 49106/371472 [3:55:13<27:01:12,  3.31it/s]
 13%|█▎        | 49107/371472 [3:55:14<27:40:58,  3.23it/s]
 13%|█▎        | 49108/371472 [3:55:14<26:13:31,  3.41it/s]
 13%|█▎        | 49109/371472 [3:55:14<27:12:27,  3.29it/s]
 13%|█▎        | 49110/371472 [3:55:14<26:14:24,  3.41it/s]
 13%|█▎        | 49111/371472 [3:55:15<26:27:59,  3.38it/s]
 13%|█▎        | 49112/371472 [3:55:15<25:59:37,  3.44it/s]
 13%|█▎        | 49113/371472 [3:55:15<28:07:50,  3.18it/s]
 13%|█▎        | 49114/371472 [3:55:16<26:44:06,  3.35it/s]
 13%|█▎        | 49115/371472 [3:55:16<25:42:24,  3.48it/s]
 13%|█▎        | 49116/371472 [3:55:16<24:55:43,  3.59it/s]
 13%|█▎        | 49117/371472 [3:55:16<24:28:47,  3.66it/s]
 13%|█▎        | 49118/371472 [3:55:17<23:38:34,  3.79it/s]
 13%|█▎        | 49119/371472 [3:55:17<24:04:52,  3.72it/s]
 13%|█▎        | 49120/371472 [3:55:17<23:42:38,  3.78it/s]
                                                           
{'loss': 4.1912, 'learning_rate': 8.814130879786248e-07, 'epoch': 2.12}

 13%|█▎        | 49120/371472 [3:55:17<23:42:38,  3.78it/s]
 13%|█▎        | 49121/371472 [3:55:17<23:01:54,  3.89it/s]
 13%|█▎        | 49122/371472 [3:55:18<22:41:03,  3.95it/s]
 13%|█▎        | 49123/371472 [3:55:18<22:21:12,  4.01it/s]
 13%|█▎        | 49124/371472 [3:55:18<22:26:57,  3.99it/s]
 13%|█▎        | 49125/371472 [3:55:19<25:29:25,  3.51it/s]
 13%|█▎        | 49126/371472 [3:55:19<24:29:37,  3.66it/s]
 13%|█▎        | 49127/371472 [3:55:19<23:55:46,  3.74it/s]
 13%|█▎        | 49128/371472 [3:55:19<24:18:54,  3.68it/s]
 13%|█▎        | 49129/371472 [3:55:20<24:46:14,  3.61it/s]
 13%|█▎        | 49130/371472 [3:55:20<24:35:46,  3.64it/s]
 13%|█▎        | 49131/371472 [3:55:20<24:06:18,  3.71it/s]
 13%|█▎        | 49132/371472 [3:55:20<26:23:45,  3.39it/s]
 13%|█▎        | 49133/371472 [3:55:21<25:33:20,  3.50it/s]
 13%|█▎        | 49134/371472 [3:55:21<25:28:27,  3.51it/s]
 13%|█▎        | 49135/371472 [3:55:21<27:22:00,  3.27it/s]
 13%|█▎        | 49136/371472 [3:55:22<29:51:49,  3.00it/s]
 13%|█▎        | 49137/371472 [3:55:22<28:07:21,  3.18it/s]
 13%|█▎        | 49138/371472 [3:55:22<27:29:20,  3.26it/s]
 13%|█▎        | 49139/371472 [3:55:23<26:05:10,  3.43it/s]
 13%|█▎        | 49140/371472 [3:55:23<26:47:23,  3.34it/s]
                                                           
{'loss': 4.2693, 'learning_rate': 8.813646060031459e-07, 'epoch': 2.12}

 13%|█▎        | 49140/371472 [3:55:23<26:47:23,  3.34it/s]
 13%|█▎        | 49141/371472 [3:55:23<26:02:10,  3.44it/s]
 13%|█▎        | 49142/371472 [3:55:24<30:30:20,  2.94it/s]
 13%|█▎        | 49143/371472 [3:55:24<28:09:55,  3.18it/s]
 13%|█▎        | 49144/371472 [3:55:24<27:44:47,  3.23it/s]
 13%|█▎        | 49145/371472 [3:55:24<25:54:40,  3.46it/s]
 13%|█▎        | 49146/371472 [3:55:25<25:52:42,  3.46it/s]
 13%|█▎        | 49147/371472 [3:55:25<25:24:26,  3.52it/s]
 13%|█▎        | 49148/371472 [3:55:25<24:40:46,  3.63it/s]
 13%|█▎        | 49149/371472 [3:55:26<25:11:17,  3.55it/s]
 13%|█▎        | 49150/371472 [3:55:26<25:53:51,  3.46it/s]
 13%|█▎        | 49151/371472 [3:55:26<25:09:29,  3.56it/s]
 13%|█▎        | 49152/371472 [3:55:26<24:39:49,  3.63it/s]
 13%|█▎        | 49153/371472 [3:55:27<24:00:16,  3.73it/s]
 13%|█▎        | 49154/371472 [3:55:27<24:35:01,  3.64it/s]
 13%|█▎        | 49155/371472 [3:55:27<24:18:32,  3.68it/s]
 13%|█▎        | 49156/371472 [3:55:27<23:45:05,  3.77it/s]
 13%|█▎        | 49157/371472 [3:55:28<24:49:34,  3.61it/s]
 13%|█▎        | 49158/371472 [3:55:28<24:35:35,  3.64it/s]
 13%|█▎        | 49159/371472 [3:55:28<25:00:50,  3.58it/s]
 13%|█▎        | 49160/371472 [3:55:29<24:48:19,  3.61it/s]
                                                           
{'loss': 4.4526, 'learning_rate': 8.813161240276669e-07, 'epoch': 2.12}

 13%|█▎        | 49160/371472 [3:55:29<24:48:19,  3.61it/s]
 13%|█▎        | 49161/371472 [3:55:29<24:11:38,  3.70it/s]
 13%|█▎        | 49162/371472 [3:55:29<23:45:55,  3.77it/s]
 13%|█▎        | 49163/371472 [3:55:29<24:39:02,  3.63it/s]
 13%|█▎        | 49164/371472 [3:55:30<24:14:21,  3.69it/s]
 13%|█▎        | 49165/371472 [3:55:30<23:31:24,  3.81it/s]
 13%|█▎        | 49166/371472 [3:55:30<24:22:09,  3.67it/s]
 13%|█▎        | 49167/371472 [3:55:30<24:10:44,  3.70it/s]
 13%|█▎        | 49168/371472 [3:55:31<25:04:57,  3.57it/s]
 13%|█▎        | 49169/371472 [3:55:31<25:09:01,  3.56it/s]
 13%|█▎        | 49170/371472 [3:55:31<24:22:21,  3.67it/s]
 13%|█▎        | 49171/371472 [3:55:32<24:28:28,  3.66it/s]
 13%|█▎        | 49172/371472 [3:55:32<26:31:09,  3.38it/s]
 13%|█▎        | 49173/371472 [3:55:32<25:52:04,  3.46it/s]
 13%|█▎        | 49174/371472 [3:55:32<25:53:26,  3.46it/s]
 13%|█▎        | 49175/371472 [3:55:33<25:32:23,  3.51it/s]
 13%|█▎        | 49176/371472 [3:55:33<26:20:35,  3.40it/s]
 13%|█▎        | 49177/371472 [3:55:33<27:47:58,  3.22it/s]
 13%|█▎        | 49178/371472 [3:55:34<26:43:38,  3.35it/s]
 13%|█▎        | 49179/371472 [3:55:34<26:31:19,  3.38it/s]
 13%|█▎        | 49180/371472 [3:55:34<25:06:31,  3.57it/s]
                                                           
{'loss': 4.4448, 'learning_rate': 8.812676420521881e-07, 'epoch': 2.12}

 13%|█▎        | 49180/371472 [3:55:34<25:06:31,  3.57it/s]
 13%|█▎        | 49181/371472 [3:55:34<24:12:25,  3.70it/s]
 13%|█▎        | 49182/371472 [3:55:35<25:10:12,  3.56it/s]
 13%|█▎        | 49183/371472 [3:55:35<25:06:49,  3.56it/s]
 13%|█▎        | 49184/371472 [3:55:35<25:40:13,  3.49it/s]
 13%|█▎        | 49185/371472 [3:55:36<24:35:10,  3.64it/s]
 13%|█▎        | 49186/371472 [3:55:36<25:53:47,  3.46it/s]
 13%|█▎        | 49187/371472 [3:55:36<25:43:16,  3.48it/s]
 13%|█▎        | 49188/371472 [3:55:36<25:20:08,  3.53it/s]
 13%|█▎        | 49189/371472 [3:55:37<24:51:47,  3.60it/s]
 13%|█▎        | 49190/371472 [3:55:37<23:56:17,  3.74it/s]
 13%|█▎        | 49191/371472 [3:55:37<25:55:24,  3.45it/s]
 13%|█▎        | 49192/371472 [3:55:38<25:35:48,  3.50it/s]
 13%|█▎        | 49193/371472 [3:55:38<24:24:54,  3.67it/s]
 13%|█▎        | 49194/371472 [3:55:38<24:48:56,  3.61it/s]
 13%|█▎        | 49195/371472 [3:55:39<27:38:47,  3.24it/s]
 13%|█▎        | 49196/371472 [3:55:39<26:46:44,  3.34it/s]
 13%|█▎        | 49197/371472 [3:55:39<25:31:04,  3.51it/s]
 13%|█▎        | 49198/371472 [3:55:39<26:15:08,  3.41it/s]
 13%|█▎        | 49199/371472 [3:55:40<26:07:49,  3.43it/s]
 13%|█▎        | 49200/371472 [3:55:40<25:30:20,  3.51it/s]
                                                           
{'loss': 4.1797, 'learning_rate': 8.812191600767093e-07, 'epoch': 2.12}

 13%|█▎        | 49200/371472 [3:55:40<25:30:20,  3.51it/s]
 13%|█▎        | 49201/371472 [3:55:40<25:31:07,  3.51it/s]
 13%|█▎        | 49202/371472 [3:55:40<24:50:06,  3.60it/s]
 13%|█▎        | 49203/371472 [3:55:41<24:36:28,  3.64it/s]
 13%|█▎        | 49204/371472 [3:55:41<27:34:46,  3.25it/s]
 13%|█▎        | 49205/371472 [3:55:41<26:14:09,  3.41it/s]
 13%|█▎        | 49206/371472 [3:55:42<25:54:38,  3.45it/s]
 13%|█▎        | 49207/371472 [3:55:42<28:07:29,  3.18it/s]
 13%|█▎        | 49208/371472 [3:55:42<26:04:39,  3.43it/s]
 13%|█▎        | 49209/371472 [3:55:43<25:36:07,  3.50it/s]
 13%|█▎        | 49210/371472 [3:55:43<25:31:43,  3.51it/s]
 13%|█▎        | 49211/371472 [3:55:43<25:19:13,  3.54it/s]
 13%|█▎        | 49212/371472 [3:55:44<28:31:02,  3.14it/s]
 13%|█▎        | 49213/371472 [3:55:44<26:38:22,  3.36it/s]
 13%|█▎        | 49214/371472 [3:55:44<26:16:27,  3.41it/s]
 13%|█▎        | 49215/371472 [3:55:44<25:53:50,  3.46it/s]
 13%|█▎        | 49216/371472 [3:55:45<24:31:37,  3.65it/s]
 13%|█▎        | 49217/371472 [3:55:45<24:40:22,  3.63it/s]
 13%|█▎        | 49218/371472 [3:55:45<23:58:08,  3.73it/s]
 13%|█▎        | 49219/371472 [3:55:45<24:15:32,  3.69it/s]
 13%|█▎        | 49220/371472 [3:55:46<25:07:45,  3.56it/s]
                                                           
{'loss': 4.0822, 'learning_rate': 8.811706781012304e-07, 'epoch': 2.12}

 13%|█▎        | 49220/371472 [3:55:46<25:07:45,  3.56it/s]
 13%|█▎        | 49221/371472 [3:55:46<24:40:57,  3.63it/s]
 13%|█▎        | 49222/371472 [3:55:46<25:03:10,  3.57it/s]
 13%|█▎        | 49223/371472 [3:55:47<26:02:30,  3.44it/s]
 13%|█▎        | 49224/371472 [3:55:47<26:29:55,  3.38it/s]
 13%|█▎        | 49225/371472 [3:55:47<25:02:19,  3.57it/s]
 13%|█▎        | 49226/371472 [3:55:47<26:05:58,  3.43it/s]
 13%|█▎        | 49227/371472 [3:55:48<26:45:22,  3.35it/s]
 13%|█▎        | 49228/371472 [3:55:48<25:52:52,  3.46it/s]
 13%|█▎        | 49229/371472 [3:55:48<25:57:21,  3.45it/s]
 13%|█▎        | 49230/371472 [3:55:49<25:47:33,  3.47it/s]
 13%|█▎        | 49231/371472 [3:55:49<24:47:58,  3.61it/s]
 13%|█▎        | 49232/371472 [3:55:49<24:59:35,  3.58it/s]
 13%|█▎        | 49233/371472 [3:55:49<24:25:19,  3.67it/s]
 13%|█▎        | 49234/371472 [3:55:50<26:15:50,  3.41it/s]
 13%|█▎        | 49235/371472 [3:55:50<24:54:51,  3.59it/s]
 13%|█▎        | 49236/371472 [3:55:50<24:29:25,  3.65it/s]
 13%|█▎        | 49237/371472 [3:55:50<23:55:00,  3.74it/s]
 13%|█▎        | 49238/371472 [3:55:51<24:01:07,  3.73it/s]
 13%|█▎        | 49239/371472 [3:55:51<24:04:07,  3.72it/s]
 13%|█▎        | 49240/371472 [3:55:51<23:35:47,  3.79it/s]
                                                           
{'loss': 4.3429, 'learning_rate': 8.811221961257514e-07, 'epoch': 2.12}

 13%|█▎        | 49240/371472 [3:55:51<23:35:47,  3.79it/s]
 13%|█▎        | 49241/371472 [3:55:52<24:17:09,  3.69it/s]
 13%|█▎        | 49242/371472 [3:55:52<26:00:47,  3.44it/s]
 13%|█▎        | 49243/371472 [3:55:52<25:24:14,  3.52it/s]
 13%|█▎        | 49244/371472 [3:55:52<24:28:31,  3.66it/s]
 13%|█▎        | 49245/371472 [3:55:53<23:37:53,  3.79it/s]
 13%|█▎        | 49246/371472 [3:55:53<24:41:08,  3.63it/s]
 13%|█▎        | 49247/371472 [3:55:53<24:08:27,  3.71it/s]
 13%|█▎        | 49248/371472 [3:55:53<23:52:07,  3.75it/s]
 13%|█▎        | 49249/371472 [3:55:54<24:01:02,  3.73it/s]
 13%|█▎        | 49250/371472 [3:55:54<24:03:49,  3.72it/s]
 13%|█▎        | 49251/371472 [3:55:54<24:00:04,  3.73it/s]
 13%|█▎        | 49252/371472 [3:55:55<23:49:24,  3.76it/s]
 13%|█▎        | 49253/371472 [3:55:55<25:34:56,  3.50it/s]
 13%|█▎        | 49254/371472 [3:55:55<25:21:40,  3.53it/s]
 13%|█▎        | 49255/371472 [3:55:55<24:58:54,  3.58it/s]
 13%|█▎        | 49256/371472 [3:55:56<25:15:01,  3.54it/s]
 13%|█▎        | 49257/371472 [3:55:56<26:15:03,  3.41it/s]
 13%|█▎        | 49258/371472 [3:55:56<26:47:05,  3.34it/s]
 13%|█▎        | 49259/371472 [3:55:57<29:05:45,  3.08it/s]
 13%|█▎        | 49260/371472 [3:55:57<27:47:58,  3.22it/s]
                                                           
{'loss': 4.2108, 'learning_rate': 8.810737141502725e-07, 'epoch': 2.12}

 13%|█▎        | 49260/371472 [3:55:57<27:47:58,  3.22it/s]
 13%|█▎        | 49261/371472 [3:55:57<26:31:02,  3.38it/s]
 13%|█▎        | 49262/371472 [3:55:58<25:19:53,  3.53it/s]
 13%|█▎        | 49263/371472 [3:55:58<24:44:39,  3.62it/s]
 13%|█▎        | 49264/371472 [3:55:58<25:02:09,  3.57it/s]
 13%|█▎        | 49265/371472 [3:55:58<26:35:59,  3.36it/s]
 13%|█▎        | 49266/371472 [3:55:59<26:15:41,  3.41it/s]
 13%|█▎        | 49267/371472 [3:55:59<25:31:20,  3.51it/s]
 13%|█▎        | 49268/371472 [3:55:59<24:39:52,  3.63it/s]
 13%|█▎        | 49269/371472 [3:56:00<26:48:40,  3.34it/s]
 13%|█▎        | 49270/371472 [3:56:00<25:23:18,  3.53it/s]
 13%|█▎        | 49271/371472 [3:56:00<25:44:30,  3.48it/s]
 13%|█▎        | 49272/371472 [3:56:00<24:37:52,  3.63it/s]
 13%|█▎        | 49273/371472 [3:56:01<25:39:11,  3.49it/s]
 13%|█▎        | 49274/371472 [3:56:01<26:28:12,  3.38it/s]
 13%|█▎        | 49275/371472 [3:56:01<25:40:27,  3.49it/s]
 13%|█▎        | 49276/371472 [3:56:01<24:49:31,  3.61it/s]
 13%|█▎        | 49277/371472 [3:56:02<24:07:40,  3.71it/s]
 13%|█▎        | 49278/371472 [3:56:02<25:13:18,  3.55it/s]
 13%|█▎        | 49279/371472 [3:56:02<24:35:19,  3.64it/s]
 13%|█▎        | 49280/371472 [3:56:03<24:11:35,  3.70it/s]
                                                           
{'loss': 4.3856, 'learning_rate': 8.810252321747937e-07, 'epoch': 2.12}

 13%|█▎        | 49280/371472 [3:56:03<24:11:35,  3.70it/s]
 13%|█▎        | 49281/371472 [3:56:03<24:01:21,  3.73it/s]
 13%|█▎        | 49282/371472 [3:56:03<27:30:48,  3.25it/s]
 13%|█▎        | 49283/371472 [3:56:03<26:20:23,  3.40it/s]
 13%|█▎        | 49284/371472 [3:56:04<26:45:00,  3.35it/s]
 13%|█▎        | 49285/371472 [3:56:04<26:05:25,  3.43it/s]
 13%|█▎        | 49286/371472 [3:56:04<26:18:39,  3.40it/s]
 13%|█▎        | 49287/371472 [3:56:05<27:56:13,  3.20it/s]
 13%|█▎        | 49288/371472 [3:56:05<27:23:41,  3.27it/s]
 13%|█▎        | 49289/371472 [3:56:05<27:44:38,  3.23it/s]
 13%|█▎        | 49290/371472 [3:56:06<29:02:47,  3.08it/s]
 13%|█▎        | 49291/371472 [3:56:06<26:49:12,  3.34it/s]
 13%|█▎        | 49292/371472 [3:56:06<25:49:29,  3.47it/s]
 13%|█▎        | 49293/371472 [3:56:06<25:04:25,  3.57it/s]
 13%|█▎        | 49294/371472 [3:56:07<26:45:57,  3.34it/s]
 13%|█▎        | 49295/371472 [3:56:07<26:46:22,  3.34it/s]
 13%|█▎        | 49296/371472 [3:56:07<25:59:00,  3.44it/s]
 13%|█▎        | 49297/371472 [3:56:08<27:24:34,  3.27it/s]
 13%|█▎        | 49298/371472 [3:56:08<26:31:46,  3.37it/s]
 13%|█▎        | 49299/371472 [3:56:08<25:58:14,  3.45it/s]
 13%|█▎        | 49300/371472 [3:56:09<25:50:32,  3.46it/s]
                                                           
{'loss': 4.3599, 'learning_rate': 8.809767501993147e-07, 'epoch': 2.12}

 13%|█▎        | 49300/371472 [3:56:09<25:50:32,  3.46it/s]
 13%|█▎        | 49301/371472 [3:56:09<25:36:20,  3.50it/s]
 13%|█▎        | 49302/371472 [3:56:09<25:13:18,  3.55it/s]
 13%|█▎        | 49303/371472 [3:56:09<24:42:10,  3.62it/s]
 13%|█▎        | 49304/371472 [3:56:10<25:03:35,  3.57it/s]
 13%|█▎        | 49305/371472 [3:56:10<25:56:01,  3.45it/s]
 13%|█▎        | 49306/371472 [3:56:10<25:50:39,  3.46it/s]
 13%|█▎        | 49307/371472 [3:56:11<26:31:01,  3.37it/s]
 13%|█▎        | 49308/371472 [3:56:11<26:24:07,  3.39it/s]
 13%|█▎        | 49309/371472 [3:56:11<25:06:31,  3.56it/s]
 13%|█▎        | 49310/371472 [3:56:11<25:18:37,  3.54it/s]
 13%|█▎        | 49311/371472 [3:56:12<24:06:51,  3.71it/s]
 13%|█▎        | 49312/371472 [3:56:12<24:54:43,  3.59it/s]
 13%|█▎        | 49313/371472 [3:56:12<25:36:59,  3.49it/s]
 13%|█▎        | 49314/371472 [3:56:12<24:43:54,  3.62it/s]
 13%|█▎        | 49315/371472 [3:56:13<25:17:32,  3.54it/s]
 13%|█▎        | 49316/371472 [3:56:13<24:36:04,  3.64it/s]
 13%|█▎        | 49317/371472 [3:56:13<24:27:21,  3.66it/s]
 13%|█▎        | 49318/371472 [3:56:14<23:48:47,  3.76it/s]
 13%|█▎        | 49319/371472 [3:56:14<23:38:41,  3.78it/s]
 13%|█▎        | 49320/371472 [3:56:14<23:39:08,  3.78it/s]
                                                           
{'loss': 4.1637, 'learning_rate': 8.809282682238358e-07, 'epoch': 2.12}

 13%|█▎        | 49320/371472 [3:56:14<23:39:08,  3.78it/s]
 13%|█▎        | 49321/371472 [3:56:14<24:44:23,  3.62it/s]
 13%|█▎        | 49322/371472 [3:56:15<25:35:14,  3.50it/s]
 13%|█▎        | 49323/371472 [3:56:15<24:23:47,  3.67it/s]
 13%|█▎        | 49324/371472 [3:56:15<23:57:15,  3.74it/s]
 13%|█▎        | 49325/371472 [3:56:15<24:16:46,  3.69it/s]
 13%|█▎        | 49326/371472 [3:56:16<25:02:08,  3.57it/s]
 13%|█▎        | 49327/371472 [3:56:16<25:38:06,  3.49it/s]
 13%|█▎        | 49328/371472 [3:56:16<24:53:44,  3.59it/s]
 13%|█▎        | 49329/371472 [3:56:17<26:24:28,  3.39it/s]
 13%|█▎        | 49330/371472 [3:56:17<25:27:17,  3.52it/s]
 13%|█▎        | 49331/371472 [3:56:17<26:42:44,  3.35it/s]
 13%|█▎        | 49332/371472 [3:56:18<25:22:14,  3.53it/s]
 13%|█▎        | 49333/371472 [3:56:18<24:40:32,  3.63it/s]
 13%|█▎        | 49334/371472 [3:56:18<25:03:36,  3.57it/s]
 13%|█▎        | 49335/371472 [3:56:18<25:17:09,  3.54it/s]
 13%|█▎        | 49336/371472 [3:56:19<24:57:19,  3.59it/s]
 13%|█▎        | 49337/371472 [3:56:19<24:42:20,  3.62it/s]
 13%|█▎        | 49338/371472 [3:56:19<24:09:48,  3.70it/s]
 13%|█▎        | 49339/371472 [3:56:19<23:18:41,  3.84it/s]
 13%|█▎        | 49340/371472 [3:56:20<23:27:01,  3.82it/s]
                                                           
{'loss': 4.3569, 'learning_rate': 8.80879786248357e-07, 'epoch': 2.13}

 13%|█▎        | 49340/371472 [3:56:20<23:27:01,  3.82it/s]
 13%|█▎        | 49341/371472 [3:56:20<24:00:50,  3.73it/s]
 13%|█▎        | 49342/371472 [3:56:20<24:23:18,  3.67it/s]
 13%|█▎        | 49343/371472 [3:56:21<26:40:00,  3.36it/s]
 13%|█▎        | 49344/371472 [3:56:21<25:51:46,  3.46it/s]
 13%|█▎        | 49345/371472 [3:56:21<24:47:17,  3.61it/s]
 13%|█▎        | 49346/371472 [3:56:21<24:12:20,  3.70it/s]
 13%|█▎        | 49347/371472 [3:56:22<24:34:37,  3.64it/s]
 13%|█▎        | 49348/371472 [3:56:22<27:14:53,  3.28it/s]
 13%|█▎        | 49349/371472 [3:56:22<27:09:38,  3.29it/s]
 13%|█▎        | 49350/371472 [3:56:23<28:31:47,  3.14it/s]
 13%|█▎        | 49351/371472 [3:56:23<28:47:11,  3.11it/s]
 13%|█▎        | 49352/371472 [3:56:23<27:30:53,  3.25it/s]
 13%|█▎        | 49353/371472 [3:56:24<27:30:11,  3.25it/s]
 13%|█▎        | 49354/371472 [3:56:24<26:07:23,  3.43it/s]
 13%|█▎        | 49355/371472 [3:56:24<25:16:51,  3.54it/s]
 13%|█▎        | 49356/371472 [3:56:24<25:07:31,  3.56it/s]
 13%|█▎        | 49357/371472 [3:56:25<24:06:37,  3.71it/s]
 13%|█▎        | 49358/371472 [3:56:25<26:06:41,  3.43it/s]
 13%|█▎        | 49359/371472 [3:56:25<24:45:11,  3.61it/s]
 13%|█▎        | 49360/371472 [3:56:25<24:18:41,  3.68it/s]
                                                           
{'loss': 4.312, 'learning_rate': 8.808313042728781e-07, 'epoch': 2.13}

 13%|█▎        | 49360/371472 [3:56:25<24:18:41,  3.68it/s]
 13%|█▎        | 49361/371472 [3:56:26<24:20:06,  3.68it/s]
 13%|█▎        | 49362/371472 [3:56:26<25:54:51,  3.45it/s]
 13%|█▎        | 49363/371472 [3:56:26<26:13:14,  3.41it/s]
 13%|█▎        | 49364/371472 [3:56:27<26:10:43,  3.42it/s]
 13%|█▎        | 49365/371472 [3:56:27<25:11:47,  3.55it/s]
 13%|█▎        | 49366/371472 [3:56:27<25:09:16,  3.56it/s]
 13%|█▎        | 49367/371472 [3:56:27<24:25:59,  3.66it/s]
 13%|█▎        | 49368/371472 [3:56:28<24:24:14,  3.67it/s]
 13%|█▎        | 49369/371472 [3:56:28<24:10:10,  3.70it/s]
 13%|█▎        | 49370/371472 [3:56:28<26:19:38,  3.40it/s]
 13%|█▎        | 49371/371472 [3:56:29<27:07:47,  3.30it/s]
 13%|█▎        | 49372/371472 [3:56:29<27:32:12,  3.25it/s]
 13%|█▎        | 49373/371472 [3:56:29<27:05:00,  3.30it/s]
 13%|█▎        | 49374/371472 [3:56:30<27:05:31,  3.30it/s]
 13%|█▎        | 49375/371472 [3:56:30<25:42:20,  3.48it/s]
 13%|█▎        | 49376/371472 [3:56:30<27:40:38,  3.23it/s]
 13%|█▎        | 49377/371472 [3:56:30<27:55:43,  3.20it/s]
 13%|█▎        | 49378/371472 [3:56:31<26:51:54,  3.33it/s]
 13%|█▎        | 49379/371472 [3:56:31<25:46:40,  3.47it/s]
 13%|█▎        | 49380/371472 [3:56:31<25:33:42,  3.50it/s]
                                                           
{'loss': 4.2211, 'learning_rate': 8.80782822297399e-07, 'epoch': 2.13}

 13%|█▎        | 49380/371472 [3:56:31<25:33:42,  3.50it/s]
 13%|█▎        | 49381/371472 [3:56:32<25:01:51,  3.57it/s]
 13%|█▎        | 49382/371472 [3:56:32<24:30:31,  3.65it/s]
 13%|█▎        | 49383/371472 [3:56:32<24:44:40,  3.62it/s]
 13%|█▎        | 49384/371472 [3:56:32<24:03:30,  3.72it/s]
 13%|█▎        | 49385/371472 [3:56:33<26:48:24,  3.34it/s]
 13%|█▎        | 49386/371472 [3:56:33<26:10:24,  3.42it/s]
 13%|█▎        | 49387/371472 [3:56:33<26:02:20,  3.44it/s]
 13%|█▎        | 49388/371472 [3:56:34<24:54:28,  3.59it/s]
 13%|█▎        | 49389/371472 [3:56:34<25:25:41,  3.52it/s]
 13%|█▎        | 49390/371472 [3:56:34<24:33:42,  3.64it/s]
 13%|█▎        | 49391/371472 [3:56:34<27:43:23,  3.23it/s]
 13%|█▎        | 49392/371472 [3:56:35<27:40:42,  3.23it/s]
 13%|█▎        | 49393/371472 [3:56:35<25:40:34,  3.48it/s]
 13%|█▎        | 49394/371472 [3:56:35<25:58:16,  3.44it/s]
 13%|█▎        | 49395/371472 [3:56:36<26:58:40,  3.32it/s]
 13%|█▎        | 49396/371472 [3:56:36<26:33:37,  3.37it/s]
 13%|█▎        | 49397/371472 [3:56:36<25:54:24,  3.45it/s]
 13%|█▎        | 49398/371472 [3:56:37<25:56:17,  3.45it/s]
 13%|█▎        | 49399/371472 [3:56:37<24:44:11,  3.62it/s]
 13%|█▎        | 49400/371472 [3:56:37<25:38:22,  3.49it/s]
                                                           
{'loss': 4.3182, 'learning_rate': 8.807343403219202e-07, 'epoch': 2.13}

 13%|█▎        | 49400/371472 [3:56:37<25:38:22,  3.49it/s]
 13%|█▎        | 49401/371472 [3:56:37<24:28:57,  3.65it/s]
 13%|█▎        | 49402/371472 [3:56:38<23:28:38,  3.81it/s]
 13%|█▎        | 49403/371472 [3:56:38<24:19:49,  3.68it/s]
 13%|█▎        | 49404/371472 [3:56:38<25:43:28,  3.48it/s]
 13%|█▎        | 49405/371472 [3:56:38<26:26:33,  3.38it/s]
 13%|█▎        | 49406/371472 [3:56:39<24:48:19,  3.61it/s]
 13%|█▎        | 49407/371472 [3:56:39<24:16:43,  3.68it/s]
 13%|█▎        | 49408/371472 [3:56:39<24:38:54,  3.63it/s]
 13%|█▎        | 49409/371472 [3:56:40<25:47:26,  3.47it/s]
 13%|█▎        | 49410/371472 [3:56:40<25:31:44,  3.50it/s]
 13%|█▎        | 49411/371472 [3:56:40<25:11:57,  3.55it/s]
 13%|█▎        | 49412/371472 [3:56:40<24:02:51,  3.72it/s]
 13%|█▎        | 49413/371472 [3:56:41<24:07:05,  3.71it/s]
 13%|█▎        | 49414/371472 [3:56:41<23:51:53,  3.75it/s]
 13%|█▎        | 49415/371472 [3:56:41<23:32:54,  3.80it/s]
 13%|█▎        | 49416/371472 [3:56:41<25:36:27,  3.49it/s]
 13%|█▎        | 49417/371472 [3:56:42<26:52:11,  3.33it/s]
 13%|█▎        | 49418/371472 [3:56:42<26:14:24,  3.41it/s]
 13%|█▎        | 49419/371472 [3:56:42<25:18:14,  3.54it/s]
 13%|█▎        | 49420/371472 [3:56:43<26:36:49,  3.36it/s]
                                                           
{'loss': 4.3647, 'learning_rate': 8.806858583464414e-07, 'epoch': 2.13}

 13%|█▎        | 49420/371472 [3:56:43<26:36:49,  3.36it/s]
 13%|█▎        | 49421/371472 [3:56:43<25:31:01,  3.51it/s]
 13%|█▎        | 49422/371472 [3:56:43<25:00:36,  3.58it/s]
 13%|█▎        | 49423/371472 [3:56:43<24:32:43,  3.64it/s]
 13%|█▎        | 49424/371472 [3:56:44<25:33:33,  3.50it/s]
 13%|█▎        | 49425/371472 [3:56:44<26:17:58,  3.40it/s]
 13%|█▎        | 49426/371472 [3:56:44<26:39:24,  3.36it/s]
 13%|█▎        | 49427/371472 [3:56:45<27:29:07,  3.25it/s]
 13%|█▎        | 49428/371472 [3:56:45<25:58:48,  3.44it/s]
 13%|█▎        | 49429/371472 [3:56:45<26:21:48,  3.39it/s]
 13%|█▎        | 49430/371472 [3:56:46<25:20:33,  3.53it/s]
 13%|█▎        | 49431/371472 [3:56:46<25:33:36,  3.50it/s]
 13%|█▎        | 49432/371472 [3:56:46<25:42:19,  3.48it/s]
 13%|█▎        | 49433/371472 [3:56:46<24:40:44,  3.62it/s]
 13%|█▎        | 49434/371472 [3:56:47<23:40:33,  3.78it/s]
 13%|█▎        | 49435/371472 [3:56:47<24:38:39,  3.63it/s]
 13%|█▎        | 49436/371472 [3:56:47<24:21:13,  3.67it/s]
 13%|█▎        | 49437/371472 [3:56:48<26:44:46,  3.34it/s]
 13%|█▎        | 49438/371472 [3:56:48<26:16:13,  3.41it/s]
 13%|█▎        | 49439/371472 [3:56:48<26:09:30,  3.42it/s]
 13%|█▎        | 49440/371472 [3:56:48<25:56:00,  3.45it/s]
                                                           
{'loss': 4.1665, 'learning_rate': 8.806373763709625e-07, 'epoch': 2.13}

 13%|█▎        | 49440/371472 [3:56:48<25:56:00,  3.45it/s]
 13%|█▎        | 49441/371472 [3:56:49<26:08:55,  3.42it/s]
 13%|█▎        | 49442/371472 [3:56:49<27:22:15,  3.27it/s]
 13%|█▎        | 49443/371472 [3:56:49<26:18:50,  3.40it/s]
 13%|█▎        | 49444/371472 [3:56:50<26:08:41,  3.42it/s]
 13%|█▎        | 49445/371472 [3:56:50<27:19:04,  3.27it/s]
 13%|█▎        | 49446/371472 [3:56:50<27:27:07,  3.26it/s]
 13%|█▎        | 49447/371472 [3:56:51<27:16:15,  3.28it/s]
 13%|█▎        | 49448/371472 [3:56:51<26:36:56,  3.36it/s]
 13%|█▎        | 49449/371472 [3:56:51<26:47:25,  3.34it/s]
 13%|█▎        | 49450/371472 [3:56:51<26:25:35,  3.38it/s]
 13%|█▎        | 49451/371472 [3:56:52<26:10:24,  3.42it/s]
 13%|█▎        | 49452/371472 [3:56:52<24:51:46,  3.60it/s]
 13%|█▎        | 49453/371472 [3:56:52<24:15:31,  3.69it/s]
 13%|█▎        | 49454/371472 [3:56:52<23:49:18,  3.75it/s]
 13%|█▎        | 49455/371472 [3:56:53<24:39:57,  3.63it/s]
 13%|█▎        | 49456/371472 [3:56:53<25:08:09,  3.56it/s]
 13%|█▎        | 49457/371472 [3:56:53<23:49:24,  3.75it/s]
 13%|█▎        | 49458/371472 [3:56:54<22:59:23,  3.89it/s]
 13%|█▎        | 49459/371472 [3:56:54<23:30:27,  3.81it/s]
 13%|█▎        | 49460/371472 [3:56:54<24:24:52,  3.66it/s]
                                                           
{'loss': 4.3388, 'learning_rate': 8.805888943954836e-07, 'epoch': 2.13}

 13%|█▎        | 49460/371472 [3:56:54<24:24:52,  3.66it/s]
 13%|█▎        | 49461/371472 [3:56:54<24:40:01,  3.63it/s]
 13%|█▎        | 49462/371472 [3:56:55<24:15:38,  3.69it/s]
 13%|█▎        | 49463/371472 [3:56:55<24:07:26,  3.71it/s]
 13%|█▎        | 49464/371472 [3:56:55<23:26:36,  3.82it/s]
 13%|█▎        | 49465/371472 [3:56:55<23:40:38,  3.78it/s]
 13%|█▎        | 49466/371472 [3:56:56<25:09:39,  3.55it/s]
 13%|█▎        | 49467/371472 [3:56:56<24:38:32,  3.63it/s]
 13%|█▎        | 49468/371472 [3:56:56<24:01:23,  3.72it/s]
 13%|█▎        | 49469/371472 [3:56:57<24:27:44,  3.66it/s]
 13%|█▎        | 49470/371472 [3:56:57<24:27:58,  3.66it/s]
 13%|█▎        | 49471/371472 [3:56:57<23:52:23,  3.75it/s]
 13%|█▎        | 49472/371472 [3:56:57<23:46:25,  3.76it/s]
 13%|█▎        | 49473/371472 [3:56:58<25:32:47,  3.50it/s]
 13%|█▎        | 49474/371472 [3:56:58<24:42:03,  3.62it/s]
 13%|█▎        | 49475/371472 [3:56:58<25:45:24,  3.47it/s]
 13%|█▎        | 49476/371472 [3:56:59<29:18:23,  3.05it/s]
 13%|█▎        | 49477/371472 [3:56:59<29:33:08,  3.03it/s]
 13%|█▎        | 49478/371472 [3:56:59<27:25:47,  3.26it/s]
 13%|█▎        | 49479/371472 [3:57:00<28:31:03,  3.14it/s]
 13%|█▎        | 49480/371472 [3:57:00<27:04:35,  3.30it/s]
                                                           
{'loss': 4.3251, 'learning_rate': 8.805404124200048e-07, 'epoch': 2.13}

 13%|█▎        | 49480/371472 [3:57:00<27:04:35,  3.30it/s]
 13%|█▎        | 49481/371472 [3:57:00<25:55:33,  3.45it/s]
 13%|█▎        | 49482/371472 [3:57:00<25:15:05,  3.54it/s]
 13%|█▎        | 49483/371472 [3:57:01<25:28:20,  3.51it/s]
 13%|█▎        | 49484/371472 [3:57:01<27:35:40,  3.24it/s]
 13%|█▎        | 49485/371472 [3:57:01<28:24:56,  3.15it/s]
 13%|█▎        | 49486/371472 [3:57:02<27:39:23,  3.23it/s]
 13%|█▎        | 49487/371472 [3:57:02<25:57:44,  3.45it/s]
 13%|█▎        | 49488/371472 [3:57:02<25:26:50,  3.51it/s]
 13%|█▎        | 49489/371472 [3:57:02<24:59:08,  3.58it/s]
 13%|█▎        | 49490/371472 [3:57:03<27:44:17,  3.22it/s]
 13%|█▎        | 49491/371472 [3:57:03<26:04:59,  3.43it/s]
 13%|█▎        | 49492/371472 [3:57:03<25:06:11,  3.56it/s]
 13%|█▎        | 49493/371472 [3:57:04<26:30:04,  3.37it/s]
 13%|█▎        | 49494/371472 [3:57:04<27:12:20,  3.29it/s]
 13%|█▎        | 49495/371472 [3:57:04<25:33:32,  3.50it/s]
 13%|█▎        | 49496/371472 [3:57:04<24:27:09,  3.66it/s]
 13%|█▎        | 49497/371472 [3:57:05<25:22:51,  3.52it/s]
 13%|█▎        | 49498/371472 [3:57:05<25:04:22,  3.57it/s]
 13%|█▎        | 49499/371472 [3:57:05<24:22:03,  3.67it/s]
 13%|█▎        | 49500/371472 [3:57:06<24:18:54,  3.68it/s]
                                                           
{'loss': 4.3496, 'learning_rate': 8.804919304445258e-07, 'epoch': 2.13}

 13%|█▎        | 49500/371472 [3:57:06<24:18:54,  3.68it/s]
 13%|█▎        | 49501/371472 [3:57:06<26:56:36,  3.32it/s]
 13%|█▎        | 49502/371472 [3:57:06<25:27:42,  3.51it/s]
 13%|█▎        | 49503/371472 [3:57:06<25:20:17,  3.53it/s]
 13%|█▎        | 49504/371472 [3:57:07<25:20:37,  3.53it/s]
 13%|█▎        | 49505/371472 [3:57:07<24:05:11,  3.71it/s]
 13%|█▎        | 49506/371472 [3:57:07<29:02:12,  3.08it/s]
 13%|█▎        | 49507/371472 [3:57:08<27:47:53,  3.22it/s]
 13%|█▎        | 49508/371472 [3:57:08<26:12:53,  3.41it/s]
 13%|█▎        | 49509/371472 [3:57:08<26:27:36,  3.38it/s]
 13%|█▎        | 49510/371472 [3:57:09<26:14:42,  3.41it/s]
 13%|█▎        | 49511/371472 [3:57:09<25:25:18,  3.52it/s]
 13%|█▎        | 49512/371472 [3:57:09<24:33:48,  3.64it/s]
 13%|█▎        | 49513/371472 [3:57:09<24:48:37,  3.60it/s]
 13%|█▎        | 49514/371472 [3:57:10<23:30:35,  3.80it/s]
 13%|█▎        | 49515/371472 [3:57:10<25:03:41,  3.57it/s]
 13%|█▎        | 49516/371472 [3:57:10<24:09:41,  3.70it/s]
 13%|█▎        | 49517/371472 [3:57:10<25:44:28,  3.47it/s]
 13%|█▎        | 49518/371472 [3:57:11<27:03:05,  3.31it/s]
 13%|█▎        | 49519/371472 [3:57:11<27:02:02,  3.31it/s]
 13%|█▎        | 49520/371472 [3:57:11<26:13:53,  3.41it/s]
                                                           
{'loss': 4.0173, 'learning_rate': 8.804434484690469e-07, 'epoch': 2.13}

 13%|█▎        | 49520/371472 [3:57:11<26:13:53,  3.41it/s]
 13%|█▎        | 49521/371472 [3:57:12<25:36:30,  3.49it/s]
 13%|█▎        | 49522/371472 [3:57:12<24:24:39,  3.66it/s]
 13%|█▎        | 49523/371472 [3:57:12<24:56:26,  3.59it/s]
 13%|█▎        | 49524/371472 [3:57:12<24:11:36,  3.70it/s]
 13%|█▎        | 49525/371472 [3:57:13<25:18:37,  3.53it/s]
 13%|█▎        | 49526/371472 [3:57:13<26:28:43,  3.38it/s]
 13%|█▎        | 49527/371472 [3:57:13<27:16:06,  3.28it/s]
 13%|█▎        | 49528/371472 [3:57:14<27:31:58,  3.25it/s]
 13%|█▎        | 49529/371472 [3:57:14<26:26:30,  3.38it/s]
 13%|█▎        | 49530/371472 [3:57:14<26:11:52,  3.41it/s]
 13%|█▎        | 49531/371472 [3:57:15<25:50:19,  3.46it/s]
 13%|█▎        | 49532/371472 [3:57:15<24:52:15,  3.60it/s]
 13%|█▎        | 49533/371472 [3:57:15<25:44:32,  3.47it/s]
 13%|█▎        | 49534/371472 [3:57:15<26:10:02,  3.42it/s]
 13%|█▎        | 49535/371472 [3:57:16<26:29:21,  3.38it/s]
 13%|█▎        | 49536/371472 [3:57:16<25:19:02,  3.53it/s]
 13%|█▎        | 49537/371472 [3:57:16<25:40:38,  3.48it/s]
 13%|█▎        | 49538/371472 [3:57:17<25:08:04,  3.56it/s]
 13%|█▎        | 49539/371472 [3:57:17<24:24:35,  3.66it/s]
 13%|█▎        | 49540/371472 [3:57:17<23:31:19,  3.80it/s]
                                                           
{'loss': 4.291, 'learning_rate': 8.80394966493568e-07, 'epoch': 2.13}

 13%|█▎        | 49540/371472 [3:57:17<23:31:19,  3.80it/s]
 13%|█▎        | 49541/371472 [3:57:17<23:15:51,  3.84it/s]
 13%|█▎        | 49542/371472 [3:57:18<23:35:19,  3.79it/s]
 13%|█▎        | 49543/371472 [3:57:18<25:20:20,  3.53it/s]
 13%|█▎        | 49544/371472 [3:57:18<25:10:28,  3.55it/s]
 13%|█▎        | 49545/371472 [3:57:19<26:41:53,  3.35it/s]
 13%|█▎        | 49546/371472 [3:57:19<25:24:55,  3.52it/s]
 13%|█▎        | 49547/371472 [3:57:19<25:09:10,  3.56it/s]
 13%|█▎        | 49548/371472 [3:57:19<24:34:34,  3.64it/s]
 13%|█▎        | 49549/371472 [3:57:20<23:44:02,  3.77it/s]
 13%|█▎        | 49550/371472 [3:57:20<24:00:58,  3.72it/s]
 13%|█▎        | 49551/371472 [3:57:20<23:51:29,  3.75it/s]
 13%|█▎        | 49552/371472 [3:57:20<24:44:16,  3.61it/s]
 13%|█▎        | 49553/371472 [3:57:21<25:44:28,  3.47it/s]
 13%|█▎        | 49554/371472 [3:57:21<26:06:08,  3.43it/s]
 13%|█▎        | 49555/371472 [3:57:21<26:23:24,  3.39it/s]
 13%|█▎        | 49556/371472 [3:57:22<27:15:34,  3.28it/s]
 13%|█▎        | 49557/371472 [3:57:22<28:20:25,  3.16it/s]
 13%|█▎        | 49558/371472 [3:57:22<26:59:16,  3.31it/s]
 13%|█▎        | 49559/371472 [3:57:23<27:51:37,  3.21it/s]
 13%|█▎        | 49560/371472 [3:57:23<26:16:04,  3.40it/s]
                                                           
{'loss': 4.271, 'learning_rate': 8.803464845180891e-07, 'epoch': 2.13}

 13%|█▎        | 49560/371472 [3:57:23<26:16:04,  3.40it/s]
 13%|█▎        | 49561/371472 [3:57:23<26:43:24,  3.35it/s]
 13%|█▎        | 49562/371472 [3:57:23<25:22:19,  3.52it/s]
 13%|█▎        | 49563/371472 [3:57:24<24:31:48,  3.65it/s]
 13%|█▎        | 49564/371472 [3:57:24<24:43:53,  3.62it/s]
 13%|█▎        | 49565/371472 [3:57:24<24:40:16,  3.62it/s]
 13%|█▎        | 49566/371472 [3:57:24<24:08:44,  3.70it/s]
 13%|█▎        | 49567/371472 [3:57:25<24:49:36,  3.60it/s]
 13%|█▎        | 49568/371472 [3:57:25<24:31:29,  3.65it/s]
 13%|█▎        | 49569/371472 [3:57:25<26:44:38,  3.34it/s]
 13%|█▎        | 49570/371472 [3:57:26<29:43:22,  3.01it/s]
 13%|█▎        | 49571/371472 [3:57:26<27:40:13,  3.23it/s]
 13%|█▎        | 49572/371472 [3:57:26<27:11:19,  3.29it/s]
 13%|█▎        | 49573/371472 [3:57:27<25:43:57,  3.47it/s]
 13%|█▎        | 49574/371472 [3:57:27<25:02:48,  3.57it/s]
 13%|█▎        | 49575/371472 [3:57:27<25:47:26,  3.47it/s]
 13%|█▎        | 49576/371472 [3:57:27<25:18:46,  3.53it/s]
 13%|█▎        | 49577/371472 [3:57:28<24:08:52,  3.70it/s]
 13%|█▎        | 49578/371472 [3:57:28<25:00:13,  3.58it/s]
 13%|█▎        | 49579/371472 [3:57:28<25:33:47,  3.50it/s]
 13%|█▎        | 49580/371472 [3:57:29<25:32:40,  3.50it/s]
                                                           
{'loss': 4.1767, 'learning_rate': 8.802980025426103e-07, 'epoch': 2.14}

 13%|█▎        | 49580/371472 [3:57:29<25:32:40,  3.50it/s]
 13%|█▎        | 49581/371472 [3:57:29<25:41:33,  3.48it/s]
 13%|█▎        | 49582/371472 [3:57:29<25:08:03,  3.56it/s]
 13%|█▎        | 49583/371472 [3:57:29<24:23:31,  3.67it/s]
 13%|█▎        | 49584/371472 [3:57:30<24:43:05,  3.62it/s]
 13%|█▎        | 49585/371472 [3:57:30<24:45:52,  3.61it/s]
 13%|█▎        | 49586/371472 [3:57:30<24:25:30,  3.66it/s]
 13%|█▎        | 49587/371472 [3:57:30<25:04:57,  3.56it/s]
 13%|█▎        | 49588/371472 [3:57:31<25:03:30,  3.57it/s]
 13%|█▎        | 49589/371472 [3:57:31<25:00:21,  3.58it/s]
 13%|█▎        | 49590/371472 [3:57:31<25:32:07,  3.50it/s]
 13%|█▎        | 49591/371472 [3:57:32<26:57:13,  3.32it/s]
 13%|█▎        | 49592/371472 [3:57:32<26:46:11,  3.34it/s]
 13%|█▎        | 49593/371472 [3:57:32<25:45:48,  3.47it/s]
 13%|█▎        | 49594/371472 [3:57:33<26:31:39,  3.37it/s]
 13%|█▎        | 49595/371472 [3:57:33<27:24:20,  3.26it/s]
 13%|█▎        | 49596/371472 [3:57:33<26:54:58,  3.32it/s]
 13%|█▎        | 49597/371472 [3:57:34<28:31:22,  3.13it/s]
 13%|█▎        | 49598/371472 [3:57:34<27:37:19,  3.24it/s]
 13%|█▎        | 49599/371472 [3:57:34<27:05:17,  3.30it/s]
 13%|█▎        | 49600/371472 [3:57:34<25:46:40,  3.47it/s]
                                                           
{'loss': 4.3604, 'learning_rate': 8.802495205671313e-07, 'epoch': 2.14}

 13%|█▎        | 49600/371472 [3:57:34<25:46:40,  3.47it/s]
 13%|█▎        | 49601/371472 [3:57:35<24:46:10,  3.61it/s]
 13%|█▎        | 49602/371472 [3:57:35<24:56:03,  3.59it/s]
 13%|█▎        | 49603/371472 [3:57:35<24:21:02,  3.67it/s]
 13%|█▎        | 49604/371472 [3:57:36<27:57:43,  3.20it/s]
 13%|█▎        | 49605/371472 [3:57:36<31:47:09,  2.81it/s]
 13%|█▎        | 49606/371472 [3:57:36<29:46:29,  3.00it/s]
 13%|█▎        | 49607/371472 [3:57:37<28:00:29,  3.19it/s]
 13%|█▎        | 49608/371472 [3:57:37<27:16:18,  3.28it/s]
 13%|█▎        | 49609/371472 [3:57:37<26:12:03,  3.41it/s]
 13%|█▎        | 49610/371472 [3:57:37<26:28:26,  3.38it/s]
 13%|█▎        | 49611/371472 [3:57:38<27:47:05,  3.22it/s]
 13%|█▎        | 49612/371472 [3:57:38<27:53:53,  3.20it/s]
 13%|█▎        | 49613/371472 [3:57:38<27:26:13,  3.26it/s]
 13%|█▎        | 49614/371472 [3:57:39<26:19:55,  3.40it/s]
 13%|█▎        | 49615/371472 [3:57:39<26:42:44,  3.35it/s]
 13%|█▎        | 49616/371472 [3:57:39<26:36:28,  3.36it/s]
 13%|█▎        | 49617/371472 [3:57:40<26:51:56,  3.33it/s]
 13%|█▎        | 49618/371472 [3:57:40<27:22:20,  3.27it/s]
 13%|█▎        | 49619/371472 [3:57:40<25:54:38,  3.45it/s]
 13%|█▎        | 49620/371472 [3:57:40<27:13:31,  3.28it/s]
                                                           
{'loss': 4.2652, 'learning_rate': 8.802010385916525e-07, 'epoch': 2.14}

 13%|█▎        | 49620/371472 [3:57:40<27:13:31,  3.28it/s]
 13%|█▎        | 49621/371472 [3:57:41<26:49:08,  3.33it/s]
 13%|█▎        | 49622/371472 [3:57:41<27:27:13,  3.26it/s]
 13%|█▎        | 49623/371472 [3:57:41<25:43:53,  3.47it/s]
 13%|█▎        | 49624/371472 [3:57:42<27:58:55,  3.19it/s]
 13%|█▎        | 49625/371472 [3:57:42<26:12:41,  3.41it/s]
 13%|█▎        | 49626/371472 [3:57:42<26:32:19,  3.37it/s]
 13%|█▎        | 49627/371472 [3:57:42<24:50:18,  3.60it/s]
 13%|█▎        | 49628/371472 [3:57:43<26:01:33,  3.44it/s]
 13%|█▎        | 49629/371472 [3:57:43<25:46:58,  3.47it/s]
 13%|█▎        | 49630/371472 [3:57:43<25:16:00,  3.54it/s]
 13%|█▎        | 49631/371472 [3:57:44<24:32:17,  3.64it/s]
 13%|█▎        | 49632/371472 [3:57:44<26:20:46,  3.39it/s]
 13%|█▎        | 49633/371472 [3:57:44<26:51:52,  3.33it/s]
 13%|█▎        | 49634/371472 [3:57:45<26:13:25,  3.41it/s]
 13%|█▎        | 49635/371472 [3:57:45<25:18:05,  3.53it/s]
 13%|█▎        | 49636/371472 [3:57:45<24:39:13,  3.63it/s]
 13%|█▎        | 49637/371472 [3:57:45<25:14:29,  3.54it/s]
 13%|█▎        | 49638/371472 [3:57:46<24:24:04,  3.66it/s]
 13%|█▎        | 49639/371472 [3:57:46<26:11:34,  3.41it/s]
 13%|█▎        | 49640/371472 [3:57:46<26:28:44,  3.38it/s]
                                                           
{'loss': 4.296, 'learning_rate': 8.801525566161735e-07, 'epoch': 2.14}

 13%|█▎        | 49640/371472 [3:57:46<26:28:44,  3.38it/s]
 13%|█▎        | 49641/371472 [3:57:46<25:36:55,  3.49it/s]
 13%|█▎        | 49642/371472 [3:57:47<26:11:33,  3.41it/s]
 13%|█▎        | 49643/371472 [3:57:47<29:41:28,  3.01it/s]
 13%|█▎        | 49644/371472 [3:57:48<28:20:24,  3.15it/s]
 13%|█▎        | 49645/371472 [3:57:48<26:16:31,  3.40it/s]
 13%|█▎        | 49646/371472 [3:57:48<25:56:44,  3.45it/s]
 13%|█▎        | 49647/371472 [3:57:48<28:02:08,  3.19it/s]
 13%|█▎        | 49648/371472 [3:57:49<25:55:35,  3.45it/s]
 13%|█▎        | 49649/371472 [3:57:49<25:26:58,  3.51it/s]
 13%|█▎        | 49650/371472 [3:57:49<26:00:15,  3.44it/s]
 13%|█▎        | 49651/371472 [3:57:49<25:07:41,  3.56it/s]
 13%|█▎        | 49652/371472 [3:57:50<24:18:07,  3.68it/s]
 13%|█▎        | 49653/371472 [3:57:50<23:36:10,  3.79it/s]
 13%|█▎        | 49654/371472 [3:57:50<27:19:54,  3.27it/s]
 13%|█▎        | 49655/371472 [3:57:51<27:38:09,  3.23it/s]
 13%|█▎        | 49656/371472 [3:57:51<26:12:22,  3.41it/s]
 13%|█▎        | 49657/371472 [3:57:51<25:49:48,  3.46it/s]
 13%|█▎        | 49658/371472 [3:57:51<25:25:16,  3.52it/s]
 13%|█▎        | 49659/371472 [3:57:52<26:43:01,  3.35it/s]
 13%|█▎        | 49660/371472 [3:57:52<25:48:04,  3.46it/s]
                                                           
{'loss': 4.3255, 'learning_rate': 8.801040746406947e-07, 'epoch': 2.14}

 13%|█▎        | 49660/371472 [3:57:52<25:48:04,  3.46it/s]
 13%|█▎        | 49661/371472 [3:57:52<26:19:09,  3.40it/s]
 13%|█▎        | 49662/371472 [3:57:53<25:18:40,  3.53it/s]
 13%|█▎        | 49663/371472 [3:57:53<25:45:43,  3.47it/s]
 13%|█▎        | 49664/371472 [3:57:53<25:59:12,  3.44it/s]
 13%|█▎        | 49665/371472 [3:57:54<24:52:10,  3.59it/s]
 13%|█▎        | 49666/371472 [3:57:54<24:28:00,  3.65it/s]
 13%|█▎        | 49667/371472 [3:57:54<24:11:19,  3.70it/s]
 13%|█▎        | 49668/371472 [3:57:54<24:56:18,  3.58it/s]
 13%|█▎        | 49669/371472 [3:57:55<23:56:01,  3.73it/s]
 13%|█▎        | 49670/371472 [3:57:55<23:58:25,  3.73it/s]
 13%|█▎        | 49671/371472 [3:57:55<24:04:26,  3.71it/s]
 13%|█▎        | 49672/371472 [3:57:55<23:55:59,  3.73it/s]
 13%|█▎        | 49673/371472 [3:57:56<25:54:22,  3.45it/s]
 13%|█▎        | 49674/371472 [3:57:56<24:53:02,  3.59it/s]
 13%|█▎        | 49675/371472 [3:57:56<28:24:28,  3.15it/s]
 13%|█▎        | 49676/371472 [3:57:57<27:00:54,  3.31it/s]
 13%|█▎        | 49677/371472 [3:57:57<25:22:53,  3.52it/s]
 13%|█▎        | 49678/371472 [3:57:57<24:33:15,  3.64it/s]
 13%|█▎        | 49679/371472 [3:57:57<24:40:14,  3.62it/s]
 13%|█▎        | 49680/371472 [3:57:58<23:52:12,  3.74it/s]
                                                           
{'loss': 4.2263, 'learning_rate': 8.800555926652157e-07, 'epoch': 2.14}

 13%|█▎        | 49680/371472 [3:57:58<23:52:12,  3.74it/s]
 13%|█▎        | 49681/371472 [3:57:58<23:24:25,  3.82it/s]
 13%|█▎        | 49682/371472 [3:57:58<24:39:24,  3.63it/s]
 13%|█▎        | 49683/371472 [3:57:58<24:15:53,  3.68it/s]
 13%|█▎        | 49684/371472 [3:57:59<25:27:42,  3.51it/s]
 13%|█▎        | 49685/371472 [3:57:59<24:29:54,  3.65it/s]
 13%|█▎        | 49686/371472 [3:57:59<24:29:12,  3.65it/s]
 13%|█▎        | 49687/371472 [3:58:00<25:21:13,  3.53it/s]
 13%|█▎        | 49688/371472 [3:58:00<24:57:34,  3.58it/s]
 13%|█▎        | 49689/371472 [3:58:00<24:57:19,  3.58it/s]
 13%|█▎        | 49690/371472 [3:58:00<25:04:06,  3.57it/s]
 13%|█▎        | 49691/371472 [3:58:01<25:55:05,  3.45it/s]
 13%|█▎        | 49692/371472 [3:58:01<25:39:28,  3.48it/s]
 13%|█▎        | 49693/371472 [3:58:01<25:47:59,  3.46it/s]
 13%|█▎        | 49694/371472 [3:58:02<25:03:09,  3.57it/s]
 13%|█▎        | 49695/371472 [3:58:02<27:01:12,  3.31it/s]
 13%|█▎        | 49696/371472 [3:58:02<26:53:45,  3.32it/s]
 13%|█▎        | 49697/371472 [3:58:03<25:47:02,  3.47it/s]
 13%|█▎        | 49698/371472 [3:58:03<26:29:06,  3.37it/s]
 13%|█▎        | 49699/371472 [3:58:03<26:11:42,  3.41it/s]
 13%|█▎        | 49700/371472 [3:58:03<25:39:12,  3.48it/s]
                                                           
{'loss': 4.3562, 'learning_rate': 8.800071106897368e-07, 'epoch': 2.14}

 13%|█▎        | 49700/371472 [3:58:03<25:39:12,  3.48it/s]
 13%|█▎        | 49701/371472 [3:58:04<24:33:46,  3.64it/s]
 13%|█▎        | 49702/371472 [3:58:04<23:44:52,  3.76it/s]
 13%|█▎        | 49703/371472 [3:58:04<25:37:06,  3.49it/s]
 13%|█▎        | 49704/371472 [3:58:04<25:16:36,  3.54it/s]
 13%|█▎        | 49705/371472 [3:58:05<25:24:34,  3.52it/s]
 13%|█▎        | 49706/371472 [3:58:05<25:32:12,  3.50it/s]
 13%|█▎        | 49707/371472 [3:58:05<25:50:41,  3.46it/s]
 13%|█▎        | 49708/371472 [3:58:06<25:58:32,  3.44it/s]
 13%|█▎        | 49709/371472 [3:58:06<24:19:14,  3.67it/s]
 13%|█▎        | 49710/371472 [3:58:06<25:21:30,  3.52it/s]
 13%|█▎        | 49711/371472 [3:58:06<24:32:23,  3.64it/s]
 13%|█▎        | 49712/371472 [3:58:07<24:24:13,  3.66it/s]
 13%|█▎        | 49713/371472 [3:58:07<23:54:26,  3.74it/s]
 13%|█▎        | 49714/371472 [3:58:07<23:52:56,  3.74it/s]
 13%|█▎        | 49715/371472 [3:58:08<24:21:49,  3.67it/s]
 13%|█▎        | 49716/371472 [3:58:08<23:33:56,  3.79it/s]
 13%|█▎        | 49717/371472 [3:58:08<23:19:21,  3.83it/s]
 13%|█▎        | 49718/371472 [3:58:08<23:59:32,  3.73it/s]
 13%|█▎        | 49719/371472 [3:58:09<24:29:05,  3.65it/s]
 13%|█▎        | 49720/371472 [3:58:09<24:18:31,  3.68it/s]
                                                           
{'loss': 4.1724, 'learning_rate': 8.79958628714258e-07, 'epoch': 2.14}

 13%|█▎        | 49720/371472 [3:58:09<24:18:31,  3.68it/s]
 13%|█▎        | 49721/371472 [3:58:09<23:48:00,  3.76it/s]
 13%|█▎        | 49722/371472 [3:58:09<24:10:25,  3.70it/s]
 13%|█▎        | 49723/371472 [3:58:10<23:38:00,  3.78it/s]
 13%|█▎        | 49724/371472 [3:58:10<24:59:01,  3.58it/s]
 13%|█▎        | 49725/371472 [3:58:10<26:22:11,  3.39it/s]
 13%|█▎        | 49726/371472 [3:58:11<25:05:55,  3.56it/s]
 13%|█▎        | 49727/371472 [3:58:11<24:44:41,  3.61it/s]
 13%|█▎        | 49728/371472 [3:58:11<24:36:05,  3.63it/s]
 13%|█▎        | 49729/371472 [3:58:11<25:27:08,  3.51it/s]
 13%|█▎        | 49730/371472 [3:58:12<25:50:08,  3.46it/s]
 13%|█▎        | 49731/371472 [3:58:12<25:10:08,  3.55it/s]
 13%|█▎        | 49732/371472 [3:58:12<25:49:25,  3.46it/s]
 13%|█▎        | 49733/371472 [3:58:13<25:46:23,  3.47it/s]
 13%|█▎        | 49734/371472 [3:58:13<25:19:11,  3.53it/s]
 13%|█▎        | 49735/371472 [3:58:13<24:30:24,  3.65it/s]
 13%|█▎        | 49736/371472 [3:58:13<24:55:31,  3.59it/s]
 13%|█▎        | 49737/371472 [3:58:14<24:31:19,  3.64it/s]
 13%|█▎        | 49738/371472 [3:58:14<23:56:48,  3.73it/s]
 13%|█▎        | 49739/371472 [3:58:14<24:12:06,  3.69it/s]
 13%|█▎        | 49740/371472 [3:58:14<24:40:26,  3.62it/s]
                                                           
{'loss': 4.3046, 'learning_rate': 8.799101467387792e-07, 'epoch': 2.14}

 13%|█▎        | 49740/371472 [3:58:14<24:40:26,  3.62it/s]
 13%|█▎        | 49741/371472 [3:58:15<23:32:59,  3.79it/s]
 13%|█▎        | 49742/371472 [3:58:15<23:02:24,  3.88it/s]
 13%|█▎        | 49743/371472 [3:58:15<23:08:12,  3.86it/s]
 13%|█▎        | 49744/371472 [3:58:16<24:48:09,  3.60it/s]
 13%|█▎        | 49745/371472 [3:58:16<24:27:16,  3.65it/s]
 13%|█▎        | 49746/371472 [3:58:16<24:35:23,  3.63it/s]
 13%|█▎        | 49747/371472 [3:58:16<25:39:42,  3.48it/s]
 13%|█▎        | 49748/371472 [3:58:17<25:23:50,  3.52it/s]
 13%|█▎        | 49749/371472 [3:58:17<25:07:30,  3.56it/s]
 13%|█▎        | 49750/371472 [3:58:17<24:39:16,  3.62it/s]
 13%|█▎        | 49751/371472 [3:58:17<24:35:51,  3.63it/s]
 13%|█▎        | 49752/371472 [3:58:18<25:53:59,  3.45it/s]
 13%|█▎        | 49753/371472 [3:58:18<26:55:17,  3.32it/s]
 13%|█▎        | 49754/371472 [3:58:18<26:04:36,  3.43it/s]
 13%|█▎        | 49755/371472 [3:58:19<24:52:52,  3.59it/s]
 13%|█▎        | 49756/371472 [3:58:19<23:32:59,  3.79it/s]
 13%|█▎        | 49757/371472 [3:58:19<24:52:00,  3.59it/s]
 13%|█▎        | 49758/371472 [3:58:20<27:11:59,  3.29it/s]
 13%|█▎        | 49759/371472 [3:58:20<27:20:31,  3.27it/s]
 13%|█▎        | 49760/371472 [3:58:20<26:40:02,  3.35it/s]
                                                           
{'loss': 4.3324, 'learning_rate': 8.798616647633001e-07, 'epoch': 2.14}

 13%|█▎        | 49760/371472 [3:58:20<26:40:02,  3.35it/s]
 13%|█▎        | 49761/371472 [3:58:20<26:26:17,  3.38it/s]
 13%|█▎        | 49762/371472 [3:58:21<27:47:04,  3.22it/s]
 13%|█▎        | 49763/371472 [3:58:21<26:51:10,  3.33it/s]
 13%|█▎        | 49764/371472 [3:58:21<25:46:10,  3.47it/s]
 13%|█▎        | 49765/371472 [3:58:22<24:47:10,  3.61it/s]
 13%|█▎        | 49766/371472 [3:58:22<24:28:17,  3.65it/s]
 13%|█▎        | 49767/371472 [3:58:22<24:23:46,  3.66it/s]
 13%|█▎        | 49768/371472 [3:58:22<23:27:10,  3.81it/s]
 13%|█▎        | 49769/371472 [3:58:23<23:52:14,  3.74it/s]
 13%|█▎        | 49770/371472 [3:58:23<24:46:05,  3.61it/s]
 13%|█▎        | 49771/371472 [3:58:23<26:40:32,  3.35it/s]
 13%|█▎        | 49772/371472 [3:58:23<25:25:05,  3.52it/s]
 13%|█▎        | 49773/371472 [3:58:24<24:25:45,  3.66it/s]
 13%|█▎        | 49774/371472 [3:58:24<25:57:12,  3.44it/s]
 13%|█▎        | 49775/371472 [3:58:24<25:43:18,  3.47it/s]
 13%|█▎        | 49776/371472 [3:58:25<25:22:54,  3.52it/s]
 13%|█▎        | 49777/371472 [3:58:25<24:43:40,  3.61it/s]
 13%|█▎        | 49778/371472 [3:58:25<24:35:32,  3.63it/s]
 13%|█▎        | 49779/371472 [3:58:25<25:13:25,  3.54it/s]
 13%|█▎        | 49780/371472 [3:58:26<25:17:41,  3.53it/s]
                                                           
{'loss': 4.106, 'learning_rate': 8.798131827878212e-07, 'epoch': 2.14}

 13%|█▎        | 49780/371472 [3:58:26<25:17:41,  3.53it/s]
 13%|█▎        | 49781/371472 [3:58:26<25:49:03,  3.46it/s]
 13%|█▎        | 49782/371472 [3:58:26<24:47:21,  3.60it/s]
 13%|█▎        | 49783/371472 [3:58:27<24:53:02,  3.59it/s]
 13%|█▎        | 49784/371472 [3:58:27<24:53:02,  3.59it/s]
 13%|█▎        | 49785/371472 [3:58:27<26:21:14,  3.39it/s]
 13%|█▎        | 49786/371472 [3:58:28<27:13:24,  3.28it/s]
 13%|█▎        | 49787/371472 [3:58:28<28:05:20,  3.18it/s]
 13%|█▎        | 49788/371472 [3:58:28<28:12:24,  3.17it/s]
 13%|█▎        | 49789/371472 [3:58:29<29:42:42,  3.01it/s]
 13%|█▎        | 49790/371472 [3:58:29<28:03:54,  3.18it/s]
 13%|█▎        | 49791/371472 [3:58:29<27:08:31,  3.29it/s]
 13%|█▎        | 49792/371472 [3:58:29<27:02:52,  3.30it/s]
 13%|█▎        | 49793/371472 [3:58:30<27:41:04,  3.23it/s]
 13%|█▎        | 49794/371472 [3:58:30<26:24:06,  3.38it/s]
 13%|█▎        | 49795/371472 [3:58:30<26:03:16,  3.43it/s]
 13%|█▎        | 49796/371472 [3:58:31<25:37:22,  3.49it/s]
 13%|█▎        | 49797/371472 [3:58:31<26:19:40,  3.39it/s]
 13%|█▎        | 49798/371472 [3:58:31<25:19:01,  3.53it/s]
 13%|█▎        | 49799/371472 [3:58:31<24:40:42,  3.62it/s]
 13%|█▎        | 49800/371472 [3:58:32<23:48:48,  3.75it/s]
                                                           
{'loss': 4.2116, 'learning_rate': 8.797647008123424e-07, 'epoch': 2.14}

 13%|█▎        | 49800/371472 [3:58:32<23:48:48,  3.75it/s]
 13%|█▎        | 49801/371472 [3:58:32<25:09:05,  3.55it/s]
 13%|█▎        | 49802/371472 [3:58:32<24:27:39,  3.65it/s]
 13%|█▎        | 49803/371472 [3:58:32<24:15:34,  3.68it/s]
 13%|█▎        | 49804/371472 [3:58:33<27:07:14,  3.29it/s]
 13%|█▎        | 49805/371472 [3:58:33<26:16:17,  3.40it/s]
 13%|█▎        | 49806/371472 [3:58:33<25:42:41,  3.48it/s]
 13%|█▎        | 49807/371472 [3:58:34<24:40:22,  3.62it/s]
 13%|█▎        | 49808/371472 [3:58:34<24:32:29,  3.64it/s]
 13%|█▎        | 49809/371472 [3:58:34<23:47:16,  3.76it/s]
 13%|█▎        | 49810/371472 [3:58:34<24:24:18,  3.66it/s]
 13%|█▎        | 49811/371472 [3:58:35<25:47:40,  3.46it/s]
 13%|█▎        | 49812/371472 [3:58:35<26:08:31,  3.42it/s]
 13%|█▎        | 49813/371472 [3:58:35<26:11:42,  3.41it/s]
 13%|█▎        | 49814/371472 [3:58:36<26:19:13,  3.39it/s]
 13%|█▎        | 49815/371472 [3:58:36<25:50:21,  3.46it/s]
 13%|█▎        | 49816/371472 [3:58:36<25:14:21,  3.54it/s]
 13%|█▎        | 49817/371472 [3:58:36<24:28:45,  3.65it/s]
 13%|█▎        | 49818/371472 [3:58:37<23:52:45,  3.74it/s]
 13%|█▎        | 49819/371472 [3:58:37<23:16:53,  3.84it/s]
 13%|█▎        | 49820/371472 [3:58:37<27:54:12,  3.20it/s]
                                                           
{'loss': 4.3622, 'learning_rate': 8.797162188368636e-07, 'epoch': 2.15}

 13%|█▎        | 49820/371472 [3:58:37<27:54:12,  3.20it/s]
 13%|█▎        | 49821/371472 [3:58:38<26:06:27,  3.42it/s]
 13%|█▎        | 49822/371472 [3:58:38<25:46:42,  3.47it/s]
 13%|█▎        | 49823/371472 [3:58:38<26:18:05,  3.40it/s]
 13%|█▎        | 49824/371472 [3:58:39<27:40:46,  3.23it/s]
 13%|█▎        | 49825/371472 [3:58:39<27:38:00,  3.23it/s]
 13%|█▎        | 49826/371472 [3:58:39<26:41:48,  3.35it/s]
 13%|█▎        | 49827/371472 [3:58:39<25:47:58,  3.46it/s]
 13%|█▎        | 49828/371472 [3:58:40<27:11:54,  3.28it/s]
 13%|█▎        | 49829/371472 [3:58:40<26:01:43,  3.43it/s]
 13%|█▎        | 49830/371472 [3:58:40<25:54:09,  3.45it/s]
 13%|█▎        | 49831/371472 [3:58:41<25:29:23,  3.51it/s]
 13%|█▎        | 49832/371472 [3:58:41<25:31:32,  3.50it/s]
 13%|█▎        | 49833/371472 [3:58:41<24:59:16,  3.58it/s]
 13%|█▎        | 49834/371472 [3:58:41<25:39:02,  3.48it/s]
 13%|█▎        | 49835/371472 [3:58:42<26:00:04,  3.44it/s]
 13%|█▎        | 49836/371472 [3:58:42<25:47:20,  3.46it/s]
 13%|█▎        | 49837/371472 [3:58:42<26:51:25,  3.33it/s]
 13%|█▎        | 49838/371472 [3:58:43<29:41:25,  3.01it/s]
 13%|█▎        | 49839/371472 [3:58:43<29:27:28,  3.03it/s]
 13%|█▎        | 49840/371472 [3:58:43<30:18:46,  2.95it/s]
                                                           
{'loss': 4.2366, 'learning_rate': 8.796677368613846e-07, 'epoch': 2.15}

 13%|█▎        | 49840/371472 [3:58:43<30:18:46,  2.95it/s]
 13%|█▎        | 49841/371472 [3:58:44<29:16:34,  3.05it/s]
 13%|█▎        | 49842/371472 [3:58:44<27:57:01,  3.20it/s]
 13%|█▎        | 49843/371472 [3:58:44<26:25:11,  3.38it/s]
 13%|█▎        | 49844/371472 [3:58:44<24:54:42,  3.59it/s]
 13%|█▎        | 49845/371472 [3:58:45<24:05:15,  3.71it/s]
 13%|█▎        | 49846/371472 [3:58:45<24:23:25,  3.66it/s]
 13%|█▎        | 49847/371472 [3:58:45<23:55:38,  3.73it/s]
 13%|█▎        | 49848/371472 [3:58:46<23:28:42,  3.81it/s]
 13%|█▎        | 49849/371472 [3:58:46<24:59:59,  3.57it/s]
 13%|█▎        | 49850/371472 [3:58:46<25:32:09,  3.50it/s]
 13%|█▎        | 49851/371472 [3:58:46<24:17:27,  3.68it/s]
 13%|█▎        | 49852/371472 [3:58:47<24:46:18,  3.61it/s]
 13%|█▎        | 49853/371472 [3:58:47<25:11:32,  3.55it/s]
 13%|█▎        | 49854/371472 [3:58:47<28:47:25,  3.10it/s]
 13%|█▎        | 49855/371472 [3:58:48<26:38:49,  3.35it/s]
 13%|█▎        | 49856/371472 [3:58:48<31:08:32,  2.87it/s]
 13%|█▎        | 49857/371472 [3:58:48<30:05:09,  2.97it/s]
 13%|█▎        | 49858/371472 [3:58:49<27:58:50,  3.19it/s]
 13%|█▎        | 49859/371472 [3:58:49<26:05:31,  3.42it/s]
 13%|█▎        | 49860/371472 [3:58:49<25:42:11,  3.48it/s]
                                                           
{'loss': 4.34, 'learning_rate': 8.796192548859057e-07, 'epoch': 2.15}

 13%|█▎        | 49860/371472 [3:58:49<25:42:11,  3.48it/s]
 13%|█▎        | 49861/371472 [3:58:49<26:18:55,  3.39it/s]
 13%|█▎        | 49862/371472 [3:58:50<26:56:41,  3.32it/s]
 13%|█▎        | 49863/371472 [3:58:50<26:15:51,  3.40it/s]
 13%|█▎        | 49864/371472 [3:58:50<25:28:05,  3.51it/s]
 13%|█▎        | 49865/371472 [3:58:51<26:02:37,  3.43it/s]
 13%|█▎        | 49866/371472 [3:58:51<25:10:11,  3.55it/s]
 13%|█▎        | 49867/371472 [3:58:51<24:03:22,  3.71it/s]
 13%|█▎        | 49868/371472 [3:58:51<25:05:44,  3.56it/s]
 13%|█▎        | 49869/371472 [3:58:52<25:21:40,  3.52it/s]
 13%|█▎        | 49870/371472 [3:58:52<25:49:51,  3.46it/s]
 13%|█▎        | 49871/371472 [3:58:52<24:31:24,  3.64it/s]
 13%|█▎        | 49872/371472 [3:58:53<23:54:03,  3.74it/s]
 13%|█▎        | 49873/371472 [3:58:53<25:23:23,  3.52it/s]
 13%|█▎        | 49874/371472 [3:58:53<24:26:13,  3.66it/s]
 13%|█▎        | 49875/371472 [3:58:53<24:42:05,  3.62it/s]
 13%|█▎        | 49876/371472 [3:58:54<25:56:17,  3.44it/s]
 13%|█▎        | 49877/371472 [3:58:54<25:35:17,  3.49it/s]
 13%|█▎        | 49878/371472 [3:58:54<24:56:26,  3.58it/s]
 13%|█▎        | 49879/371472 [3:58:55<25:15:45,  3.54it/s]
 13%|█▎        | 49880/371472 [3:58:55<25:12:33,  3.54it/s]
                                                           
{'loss': 4.1654, 'learning_rate': 8.795707729104269e-07, 'epoch': 2.15}

 13%|█▎        | 49880/371472 [3:58:55<25:12:33,  3.54it/s]
 13%|█▎        | 49881/371472 [3:58:55<25:39:53,  3.48it/s]
 13%|█▎        | 49882/371472 [3:58:55<24:56:37,  3.58it/s]
 13%|█▎        | 49883/371472 [3:58:56<24:03:38,  3.71it/s]
 13%|█▎        | 49884/371472 [3:58:56<24:04:37,  3.71it/s]
 13%|█▎        | 49885/371472 [3:58:56<23:38:17,  3.78it/s]
 13%|█▎        | 49886/371472 [3:58:56<24:27:34,  3.65it/s]
 13%|█▎        | 49887/371472 [3:58:57<24:21:04,  3.67it/s]
 13%|█▎        | 49888/371472 [3:58:57<24:13:50,  3.69it/s]
 13%|█▎        | 49889/371472 [3:58:57<23:27:37,  3.81it/s]
 13%|█▎        | 49890/371472 [3:58:58<24:07:29,  3.70it/s]
 13%|█▎        | 49891/371472 [3:58:58<25:16:32,  3.53it/s]
 13%|█▎        | 49892/371472 [3:58:58<24:41:30,  3.62it/s]
 13%|█▎        | 49893/371472 [3:58:58<25:35:47,  3.49it/s]
 13%|█▎        | 49894/371472 [3:58:59<26:59:14,  3.31it/s]
 13%|█▎        | 49895/371472 [3:58:59<25:58:59,  3.44it/s]
 13%|█▎        | 49896/371472 [3:58:59<25:07:26,  3.56it/s]
 13%|█▎        | 49897/371472 [3:59:00<26:47:41,  3.33it/s]
 13%|█▎        | 49898/371472 [3:59:00<25:50:07,  3.46it/s]
 13%|█▎        | 49899/371472 [3:59:00<26:17:22,  3.40it/s]
 13%|█▎        | 49900/371472 [3:59:00<25:12:52,  3.54it/s]
                                                           
{'loss': 4.3001, 'learning_rate': 8.795222909349478e-07, 'epoch': 2.15}

 13%|█▎        | 49900/371472 [3:59:00<25:12:52,  3.54it/s]
 13%|█▎        | 49901/371472 [3:59:01<24:32:48,  3.64it/s]
 13%|█▎        | 49902/371472 [3:59:01<24:41:39,  3.62it/s]
 13%|█▎        | 49903/371472 [3:59:01<24:49:45,  3.60it/s]
 13%|█▎        | 49904/371472 [3:59:02<25:01:12,  3.57it/s]
 13%|█▎        | 49905/371472 [3:59:02<25:57:34,  3.44it/s]
 13%|█▎        | 49906/371472 [3:59:02<26:30:28,  3.37it/s]
 13%|█▎        | 49907/371472 [3:59:02<25:11:24,  3.55it/s]
 13%|█▎        | 49908/371472 [3:59:03<24:17:28,  3.68it/s]
 13%|█▎        | 49909/371472 [3:59:03<24:16:25,  3.68it/s]
 13%|█▎        | 49910/371472 [3:59:03<24:29:53,  3.65it/s]
 13%|█▎        | 49911/371472 [3:59:03<23:50:43,  3.75it/s]
 13%|█▎        | 49912/371472 [3:59:04<23:07:20,  3.86it/s]
 13%|█▎        | 49913/371472 [3:59:04<23:34:08,  3.79it/s]
 13%|█▎        | 49914/371472 [3:59:04<22:58:07,  3.89it/s]
 13%|█▎        | 49915/371472 [3:59:04<22:37:25,  3.95it/s]
 13%|█▎        | 49916/371472 [3:59:05<24:48:31,  3.60it/s]
 13%|█▎        | 49917/371472 [3:59:05<25:58:59,  3.44it/s]
 13%|█▎        | 49918/371472 [3:59:05<24:43:59,  3.61it/s]
 13%|█▎        | 49919/371472 [3:59:06<24:44:29,  3.61it/s]
 13%|█▎        | 49920/371472 [3:59:06<24:32:07,  3.64it/s]
                                                           
{'loss': 4.2751, 'learning_rate': 8.79473808959469e-07, 'epoch': 2.15}

 13%|█▎        | 49920/371472 [3:59:06<24:32:07,  3.64it/s]
 13%|█▎        | 49921/371472 [3:59:06<23:41:44,  3.77it/s]
 13%|█▎        | 49922/371472 [3:59:06<23:11:48,  3.85it/s]
 13%|█▎        | 49923/371472 [3:59:07<22:26:36,  3.98it/s]
 13%|█▎        | 49924/371472 [3:59:07<25:01:08,  3.57it/s]
 13%|█▎        | 49925/371472 [3:59:07<25:26:46,  3.51it/s]
 13%|█▎        | 49926/371472 [3:59:08<24:54:08,  3.59it/s]
 13%|█▎        | 49927/371472 [3:59:08<24:20:28,  3.67it/s]
 13%|█▎        | 49928/371472 [3:59:08<25:47:28,  3.46it/s]
 13%|█▎        | 49929/371472 [3:59:08<25:13:35,  3.54it/s]
 13%|█▎        | 49930/371472 [3:59:09<25:12:51,  3.54it/s]
 13%|█▎        | 49931/371472 [3:59:09<24:53:30,  3.59it/s]
 13%|█▎        | 49932/371472 [3:59:09<25:28:10,  3.51it/s]
 13%|█▎        | 49933/371472 [3:59:10<24:38:41,  3.62it/s]
 13%|█▎        | 49934/371472 [3:59:10<25:21:33,  3.52it/s]
 13%|█▎        | 49935/371472 [3:59:10<27:14:16,  3.28it/s]
 13%|█▎        | 49936/371472 [3:59:10<25:55:23,  3.45it/s]
 13%|█▎        | 49937/371472 [3:59:11<25:49:02,  3.46it/s]
 13%|█▎        | 49938/371472 [3:59:11<26:47:24,  3.33it/s]
 13%|█▎        | 49939/371472 [3:59:11<26:10:25,  3.41it/s]
 13%|█▎        | 49940/371472 [3:59:12<27:05:57,  3.30it/s]
                                                           
{'loss': 4.2452, 'learning_rate': 8.794253269839901e-07, 'epoch': 2.15}

 13%|█▎        | 49940/371472 [3:59:12<27:05:57,  3.30it/s]
 13%|█▎        | 49941/371472 [3:59:12<26:38:14,  3.35it/s]
 13%|█▎        | 49942/371472 [3:59:12<27:03:11,  3.30it/s]
 13%|█▎        | 49943/371472 [3:59:12<25:29:53,  3.50it/s]
 13%|█▎        | 49944/371472 [3:59:13<26:24:02,  3.38it/s]
 13%|█▎        | 49945/371472 [3:59:13<27:31:41,  3.24it/s]
 13%|█▎        | 49946/371472 [3:59:13<27:55:59,  3.20it/s]
 13%|█▎        | 49947/371472 [3:59:14<26:31:28,  3.37it/s]
 13%|█▎        | 49948/371472 [3:59:14<25:05:58,  3.56it/s]
 13%|█▎        | 49949/371472 [3:59:14<25:27:00,  3.51it/s]
 13%|█▎        | 49950/371472 [3:59:15<26:36:42,  3.36it/s]
 13%|█▎        | 49951/371472 [3:59:15<26:20:56,  3.39it/s]
 13%|█▎        | 49952/371472 [3:59:15<25:44:53,  3.47it/s]
 13%|█▎        | 49953/371472 [3:59:15<25:31:15,  3.50it/s]
 13%|█▎        | 49954/371472 [3:59:16<25:07:26,  3.55it/s]
 13%|█▎        | 49955/371472 [3:59:16<25:26:56,  3.51it/s]
 13%|█▎        | 49956/371472 [3:59:16<26:06:42,  3.42it/s]
 13%|█▎        | 49957/371472 [3:59:17<24:49:09,  3.60it/s]
 13%|█▎        | 49958/371472 [3:59:17<28:31:32,  3.13it/s]
 13%|█▎        | 49959/371472 [3:59:17<28:10:33,  3.17it/s]
 13%|█▎        | 49960/371472 [3:59:18<26:39:56,  3.35it/s]
                                                           
{'loss': 4.2826, 'learning_rate': 8.793768450085113e-07, 'epoch': 2.15}

 13%|█▎        | 49960/371472 [3:59:18<26:39:56,  3.35it/s]
 13%|█▎        | 49961/371472 [3:59:18<26:37:55,  3.35it/s]
 13%|█▎        | 49962/371472 [3:59:18<25:59:39,  3.44it/s]
 13%|█▎        | 49963/371472 [3:59:18<25:44:03,  3.47it/s]
 13%|█▎        | 49964/371472 [3:59:19<24:38:00,  3.63it/s]
 13%|█▎        | 49965/371472 [3:59:19<24:27:52,  3.65it/s]
 13%|█▎        | 49966/371472 [3:59:19<26:54:43,  3.32it/s]
 13%|█▎        | 49967/371472 [3:59:20<26:44:54,  3.34it/s]
 13%|█▎        | 49968/371472 [3:59:20<27:23:33,  3.26it/s]
 13%|█▎        | 49969/371472 [3:59:20<27:16:08,  3.28it/s]
 13%|█▎        | 49970/371472 [3:59:20<26:32:04,  3.37it/s]
 13%|█▎        | 49971/371472 [3:59:21<26:07:23,  3.42it/s]
 13%|█▎        | 49972/371472 [3:59:21<25:09:08,  3.55it/s]
 13%|█▎        | 49973/371472 [3:59:21<25:37:07,  3.49it/s]
 13%|█▎        | 49974/371472 [3:59:22<25:16:20,  3.53it/s]
 13%|█▎        | 49975/371472 [3:59:22<24:31:36,  3.64it/s]
 13%|█▎        | 49976/371472 [3:59:22<24:07:01,  3.70it/s]
 13%|█▎        | 49977/371472 [3:59:22<23:49:43,  3.75it/s]
 13%|█▎        | 49978/371472 [3:59:23<23:50:56,  3.74it/s]
 13%|█▎        | 49979/371472 [3:59:23<23:35:14,  3.79it/s]
 13%|█▎        | 49980/371472 [3:59:23<23:48:58,  3.75it/s]
                                                           
{'loss': 4.0487, 'learning_rate': 8.793283630330323e-07, 'epoch': 2.15}

 13%|█▎        | 49980/371472 [3:59:23<23:48:58,  3.75it/s]
 13%|█▎        | 49981/371472 [3:59:23<24:04:55,  3.71it/s]
 13%|█▎        | 49982/371472 [3:59:24<23:59:29,  3.72it/s]
 13%|█▎        | 49983/371472 [3:59:24<24:35:46,  3.63it/s]
 13%|█▎        | 49984/371472 [3:59:24<24:07:06,  3.70it/s]
 13%|█▎        | 49985/371472 [3:59:25<24:41:35,  3.62it/s]
 13%|█▎        | 49986/371472 [3:59:25<23:55:26,  3.73it/s]
 13%|█▎        | 49987/371472 [3:59:25<25:39:38,  3.48it/s]
 13%|█▎        | 49988/371472 [3:59:25<24:31:51,  3.64it/s]
 13%|█▎        | 49989/371472 [3:59:26<23:39:49,  3.77it/s]
 13%|█▎        | 49990/371472 [3:59:26<26:32:26,  3.36it/s]
 13%|█▎        | 49991/371472 [3:59:26<25:38:03,  3.48it/s]
 13%|█▎        | 49992/371472 [3:59:26<24:43:00,  3.61it/s]
 13%|█▎        | 49993/371472 [3:59:27<24:37:44,  3.63it/s]
 13%|█▎        | 49994/371472 [3:59:27<27:49:16,  3.21it/s]
 13%|█▎        | 49995/371472 [3:59:27<27:34:13,  3.24it/s]
 13%|█▎        | 49996/371472 [3:59:28<26:01:17,  3.43it/s]
 13%|█▎        | 49997/371472 [3:59:28<24:39:26,  3.62it/s]
 13%|█▎        | 49998/371472 [3:59:28<24:54:26,  3.59it/s]
 13%|█▎        | 49999/371472 [3:59:28<24:04:16,  3.71it/s]
 13%|█▎        | 50000/371472 [3:59:29<24:25:57,  3.65it/s]
                                                           
{'loss': 4.0342, 'learning_rate': 8.792798810575536e-07, 'epoch': 2.15}

 13%|█▎        | 50000/371472 [3:59:29<24:25:57,  3.65it/s]
 13%|█▎        | 50001/371472 [3:59:29<23:51:52,  3.74it/s]
 13%|█▎        | 50002/371472 [3:59:29<23:20:18,  3.83it/s]
 13%|█▎        | 50003/371472 [3:59:30<23:04:59,  3.87it/s]
 13%|█▎        | 50004/371472 [3:59:30<23:11:55,  3.85it/s]
 13%|█▎        | 50005/371472 [3:59:30<22:57:54,  3.89it/s]
 13%|█▎        | 50006/371472 [3:59:30<22:39:22,  3.94it/s]
 13%|█▎        | 50007/371472 [3:59:31<23:52:41,  3.74it/s]
 13%|█▎        | 50008/371472 [3:59:31<23:41:43,  3.77it/s]
 13%|█▎        | 50009/371472 [3:59:31<23:06:38,  3.86it/s]
 13%|█▎        | 50010/371472 [3:59:31<23:07:46,  3.86it/s]
 13%|█▎        | 50011/371472 [3:59:32<23:50:09,  3.75it/s]
 13%|█▎        | 50012/371472 [3:59:32<25:00:46,  3.57it/s]
 13%|█▎        | 50013/371472 [3:59:32<24:46:16,  3.60it/s]
 13%|█▎        | 50014/371472 [3:59:33<25:20:39,  3.52it/s]
 13%|█▎        | 50015/371472 [3:59:33<25:04:48,  3.56it/s]
 13%|█▎        | 50016/371472 [3:59:33<25:27:39,  3.51it/s]
 13%|█▎        | 50017/371472 [3:59:33<25:58:29,  3.44it/s]
 13%|█▎        | 50018/371472 [3:59:34<24:41:11,  3.62it/s]
 13%|█▎        | 50019/371472 [3:59:34<23:50:58,  3.74it/s]
 13%|█▎        | 50020/371472 [3:59:34<23:14:01,  3.84it/s]
                                                           
{'loss': 4.3066, 'learning_rate': 8.792313990820745e-07, 'epoch': 2.15}

 13%|█▎        | 50020/371472 [3:59:34<23:14:01,  3.84it/s]
 13%|█▎        | 50021/371472 [3:59:34<23:56:08,  3.73it/s]
 13%|█▎        | 50022/371472 [3:59:35<24:44:12,  3.61it/s]
 13%|█▎        | 50023/371472 [3:59:35<24:31:16,  3.64it/s]
 13%|█▎        | 50024/371472 [3:59:35<23:33:03,  3.79it/s]
 13%|█▎        | 50025/371472 [3:59:35<23:27:06,  3.81it/s]
 13%|█▎        | 50026/371472 [3:59:36<24:33:36,  3.64it/s]
 13%|█▎        | 50027/371472 [3:59:36<24:18:44,  3.67it/s]
 13%|█▎        | 50028/371472 [3:59:36<24:50:15,  3.59it/s]
 13%|█▎        | 50029/371472 [3:59:37<26:21:35,  3.39it/s]
 13%|█▎        | 50030/371472 [3:59:37<25:42:14,  3.47it/s]
 13%|█▎        | 50031/371472 [3:59:37<26:08:51,  3.41it/s]
 13%|█▎        | 50032/371472 [3:59:38<25:38:59,  3.48it/s]
 13%|█▎        | 50033/371472 [3:59:38<25:15:19,  3.54it/s]
 13%|█▎        | 50034/371472 [3:59:38<25:01:57,  3.57it/s]
 13%|█▎        | 50035/371472 [3:59:38<24:58:54,  3.57it/s]
 13%|█▎        | 50036/371472 [3:59:39<25:28:04,  3.51it/s]
 13%|█▎        | 50037/371472 [3:59:39<24:42:45,  3.61it/s]
 13%|█▎        | 50038/371472 [3:59:39<24:34:19,  3.63it/s]
 13%|█▎        | 50039/371472 [3:59:39<24:53:02,  3.59it/s]
 13%|█▎        | 50040/371472 [3:59:40<23:56:29,  3.73it/s]
                                                           
{'loss': 4.2279, 'learning_rate': 8.791829171065957e-07, 'epoch': 2.16}

 13%|█▎        | 50040/371472 [3:59:40<23:56:29,  3.73it/s]
 13%|█▎        | 50041/371472 [3:59:40<23:29:12,  3.80it/s]
 13%|█▎        | 50042/371472 [3:59:40<23:20:55,  3.82it/s]
 13%|█▎        | 50043/371472 [3:59:40<23:05:03,  3.87it/s]
 13%|█▎        | 50044/371472 [3:59:41<23:04:18,  3.87it/s]
 13%|█▎        | 50045/371472 [3:59:41<24:23:29,  3.66it/s]
 13%|█▎        | 50046/371472 [3:59:41<24:34:22,  3.63it/s]
 13%|█▎        | 50047/371472 [3:59:42<24:45:58,  3.61it/s]
 13%|█▎        | 50048/371472 [3:59:42<26:15:29,  3.40it/s]
 13%|█▎        | 50049/371472 [3:59:43<36:00:44,  2.48it/s]
 13%|█▎        | 50050/371472 [3:59:43<31:58:32,  2.79it/s]
 13%|█▎        | 50051/371472 [3:59:43<31:47:37,  2.81it/s]
 13%|█▎        | 50052/371472 [3:59:43<29:25:44,  3.03it/s]
 13%|█▎        | 50053/371472 [3:59:44<32:00:00,  2.79it/s]
 13%|█▎        | 50054/371472 [3:59:44<29:37:16,  3.01it/s]
 13%|█▎        | 50055/371472 [3:59:44<27:45:14,  3.22it/s]
 13%|█▎        | 50056/371472 [3:59:45<27:34:29,  3.24it/s]
 13%|█▎        | 50057/371472 [3:59:45<26:42:21,  3.34it/s]
 13%|█▎        | 50058/371472 [3:59:45<28:03:53,  3.18it/s]
 13%|█▎        | 50059/371472 [3:59:46<26:57:55,  3.31it/s]
 13%|█▎        | 50060/371472 [3:59:46<26:54:41,  3.32it/s]
                                                           
{'loss': 4.2122, 'learning_rate': 8.791344351311167e-07, 'epoch': 2.16}

 13%|█▎        | 50060/371472 [3:59:46<26:54:41,  3.32it/s]
 13%|█▎        | 50061/371472 [3:59:46<28:00:39,  3.19it/s]
 13%|█▎        | 50062/371472 [3:59:47<28:12:45,  3.16it/s]
 13%|█▎        | 50063/371472 [3:59:47<28:30:01,  3.13it/s]
 13%|█▎        | 50064/371472 [3:59:47<28:06:40,  3.18it/s]
 13%|█▎        | 50065/371472 [3:59:48<28:05:57,  3.18it/s]
 13%|█▎        | 50066/371472 [3:59:48<26:58:31,  3.31it/s]
 13%|█▎        | 50067/371472 [3:59:48<27:47:42,  3.21it/s]
 13%|█▎        | 50068/371472 [3:59:48<27:58:36,  3.19it/s]
 13%|█▎        | 50069/371472 [3:59:49<27:21:44,  3.26it/s]
 13%|█▎        | 50070/371472 [3:59:49<27:00:21,  3.31it/s]
 13%|█▎        | 50071/371472 [3:59:49<26:23:03,  3.38it/s]
 13%|█▎        | 50072/371472 [3:59:50<27:18:07,  3.27it/s]
 13%|█▎        | 50073/371472 [3:59:50<26:08:06,  3.42it/s]
 13%|█▎        | 50074/371472 [3:59:50<27:12:21,  3.28it/s]
 13%|█▎        | 50075/371472 [3:59:51<26:48:04,  3.33it/s]
 13%|█▎        | 50076/371472 [3:59:51<25:46:11,  3.46it/s]
 13%|█▎        | 50077/371472 [3:59:51<25:49:30,  3.46it/s]
 13%|█▎        | 50078/371472 [3:59:51<25:42:51,  3.47it/s]
 13%|█▎        | 50079/371472 [3:59:52<25:04:46,  3.56it/s]
 13%|█▎        | 50080/371472 [3:59:52<24:14:16,  3.68it/s]
                                                           
{'loss': 4.2016, 'learning_rate': 8.790859531556379e-07, 'epoch': 2.16}

 13%|█▎        | 50080/371472 [3:59:52<24:14:16,  3.68it/s]
 13%|█▎        | 50081/371472 [3:59:52<25:24:18,  3.51it/s]
 13%|█▎        | 50082/371472 [3:59:52<24:53:09,  3.59it/s]
 13%|█▎        | 50083/371472 [3:59:53<24:20:39,  3.67it/s]
 13%|█▎        | 50084/371472 [3:59:53<24:11:20,  3.69it/s]
 13%|█▎        | 50085/371472 [3:59:53<24:01:18,  3.72it/s]
 13%|█▎        | 50086/371472 [3:59:53<23:28:03,  3.80it/s]
 13%|█▎        | 50087/371472 [3:59:54<23:04:40,  3.87it/s]
 13%|█▎        | 50088/371472 [3:59:54<22:44:05,  3.93it/s]
 13%|█▎        | 50089/371472 [3:59:54<27:47:28,  3.21it/s]
 13%|█▎        | 50090/371472 [3:59:55<26:16:47,  3.40it/s]
 13%|█▎        | 50091/371472 [3:59:55<27:23:52,  3.26it/s]
 13%|█▎        | 50092/371472 [3:59:55<27:50:03,  3.21it/s]
 13%|█▎        | 50093/371472 [3:59:56<26:42:53,  3.34it/s]
 13%|█▎        | 50094/371472 [3:59:56<25:15:05,  3.54it/s]
 13%|█▎        | 50095/371472 [3:59:56<24:29:18,  3.65it/s]
 13%|█▎        | 50096/371472 [3:59:56<25:04:54,  3.56it/s]
 13%|█▎        | 50097/371472 [3:59:57<25:02:20,  3.57it/s]
 13%|█▎        | 50098/371472 [3:59:57<25:11:51,  3.54it/s]
 13%|█▎        | 50099/371472 [3:59:57<27:01:24,  3.30it/s]
 13%|█▎        | 50100/371472 [3:59:58<26:15:40,  3.40it/s]
                                                           
{'loss': 4.3734, 'learning_rate': 8.79037471180159e-07, 'epoch': 2.16}

 13%|█▎        | 50100/371472 [3:59:58<26:15:40,  3.40it/s]
 13%|█▎        | 50101/371472 [3:59:58<26:55:44,  3.31it/s]
 13%|█▎        | 50102/371472 [3:59:58<26:09:09,  3.41it/s]
 13%|█▎        | 50103/371472 [3:59:59<29:12:55,  3.06it/s]
 13%|█▎        | 50104/371472 [3:59:59<27:36:27,  3.23it/s]
 13%|█▎        | 50105/371472 [3:59:59<29:09:47,  3.06it/s]
 13%|█▎        | 50106/371472 [3:59:59<27:06:48,  3.29it/s]
 13%|█▎        | 50107/371472 [4:00:00<25:34:40,  3.49it/s]
 13%|█▎        | 50108/371472 [4:00:00<24:45:50,  3.60it/s]
 13%|█▎        | 50109/371472 [4:00:00<23:59:53,  3.72it/s]
 13%|█▎        | 50110/371472 [4:00:01<28:08:59,  3.17it/s]
 13%|█▎        | 50111/371472 [4:00:01<26:06:42,  3.42it/s]
 13%|█▎        | 50112/371472 [4:00:01<25:54:12,  3.45it/s]
 13%|█▎        | 50113/371472 [4:00:01<25:11:53,  3.54it/s]
 13%|█▎        | 50114/371472 [4:00:02<24:21:22,  3.67it/s]
 13%|█▎        | 50115/371472 [4:00:02<25:02:51,  3.56it/s]
 13%|█▎        | 50116/371472 [4:00:02<26:52:22,  3.32it/s]
 13%|█▎        | 50117/371472 [4:00:03<28:10:50,  3.17it/s]
 13%|█▎        | 50118/371472 [4:00:03<26:59:01,  3.31it/s]
 13%|█▎        | 50119/371472 [4:00:03<25:44:56,  3.47it/s]
 13%|█▎        | 50120/371472 [4:00:03<24:46:40,  3.60it/s]
                                                           
{'loss': 4.3605, 'learning_rate': 8.789889892046802e-07, 'epoch': 2.16}

 13%|█▎        | 50120/371472 [4:00:03<24:46:40,  3.60it/s]
 13%|█▎        | 50121/371472 [4:00:04<26:52:16,  3.32it/s]
 13%|█▎        | 50122/371472 [4:00:04<25:20:13,  3.52it/s]
 13%|█▎        | 50123/371472 [4:00:04<25:55:45,  3.44it/s]
 13%|█▎        | 50124/371472 [4:00:05<25:29:21,  3.50it/s]
 13%|█▎        | 50125/371472 [4:00:05<24:26:54,  3.65it/s]
 13%|█▎        | 50126/371472 [4:00:05<23:22:00,  3.82it/s]
 13%|█▎        | 50127/371472 [4:00:05<24:01:08,  3.72it/s]
 13%|█▎        | 50128/371472 [4:00:06<25:47:43,  3.46it/s]
 13%|█▎        | 50129/371472 [4:00:06<26:05:44,  3.42it/s]
 13%|█▎        | 50130/371472 [4:00:06<25:56:39,  3.44it/s]
 13%|█▎        | 50131/371472 [4:00:07<24:55:25,  3.58it/s]
 13%|█▎        | 50132/371472 [4:00:07<25:01:57,  3.57it/s]
 13%|█▎        | 50133/371472 [4:00:07<25:14:46,  3.54it/s]
 13%|█▎        | 50134/371472 [4:00:07<25:34:04,  3.49it/s]
 13%|█▎        | 50135/371472 [4:00:08<24:16:39,  3.68it/s]
 13%|█▎        | 50136/371472 [4:00:08<23:08:35,  3.86it/s]
 13%|█▎        | 50137/371472 [4:00:08<24:17:06,  3.68it/s]
 13%|█▎        | 50138/371472 [4:00:09<24:57:26,  3.58it/s]
 13%|█▎        | 50139/371472 [4:00:09<24:04:19,  3.71it/s]
 13%|█▎        | 50140/371472 [4:00:09<23:38:59,  3.77it/s]
                                                           
{'loss': 4.125, 'learning_rate': 8.789405072292011e-07, 'epoch': 2.16}

 13%|█▎        | 50140/371472 [4:00:09<23:38:59,  3.77it/s]
 13%|█▎        | 50141/371472 [4:00:09<23:50:59,  3.74it/s]
 13%|█▎        | 50142/371472 [4:00:10<24:00:16,  3.72it/s]
 13%|█▎        | 50143/371472 [4:00:10<24:57:16,  3.58it/s]
 13%|█▎        | 50144/371472 [4:00:10<24:11:42,  3.69it/s]
 13%|█▎        | 50145/371472 [4:00:10<23:51:48,  3.74it/s]
 13%|█▎        | 50146/371472 [4:00:11<24:23:39,  3.66it/s]
 13%|█▎        | 50147/371472 [4:00:11<23:46:48,  3.75it/s]
 13%|█▎        | 50148/371472 [4:00:11<23:51:27,  3.74it/s]
 14%|█▎        | 50149/371472 [4:00:12<25:11:00,  3.54it/s]
 14%|█▎        | 50150/371472 [4:00:12<24:10:36,  3.69it/s]
 14%|█▎        | 50151/371472 [4:00:12<24:23:09,  3.66it/s]
 14%|█▎        | 50152/371472 [4:00:12<23:43:43,  3.76it/s]
 14%|█▎        | 50153/371472 [4:00:13<23:21:10,  3.82it/s]
 14%|█▎        | 50154/371472 [4:00:13<24:16:26,  3.68it/s]
 14%|█▎        | 50155/371472 [4:00:13<23:22:09,  3.82it/s]
 14%|█▎        | 50156/371472 [4:00:13<24:07:28,  3.70it/s]
 14%|█▎        | 50157/371472 [4:00:14<23:32:52,  3.79it/s]
 14%|█▎        | 50158/371472 [4:00:14<23:18:08,  3.83it/s]
 14%|█▎        | 50159/371472 [4:00:14<23:17:12,  3.83it/s]
 14%|█▎        | 50160/371472 [4:00:14<22:38:10,  3.94it/s]
                                                           
{'loss': 4.3302, 'learning_rate': 8.788920252537223e-07, 'epoch': 2.16}

 14%|█▎        | 50160/371472 [4:00:14<22:38:10,  3.94it/s]
 14%|█▎        | 50161/371472 [4:00:15<23:56:46,  3.73it/s]
 14%|█▎        | 50162/371472 [4:00:15<24:32:55,  3.64it/s]
 14%|█▎        | 50163/371472 [4:00:15<23:41:00,  3.77it/s]
 14%|█▎        | 50164/371472 [4:00:16<25:28:06,  3.50it/s]
 14%|█▎        | 50165/371472 [4:00:16<24:31:29,  3.64it/s]
 14%|█▎        | 50166/371472 [4:00:16<26:54:57,  3.32it/s]
 14%|█▎        | 50167/371472 [4:00:16<25:02:02,  3.57it/s]
 14%|█▎        | 50168/371472 [4:00:17<24:38:23,  3.62it/s]
 14%|█▎        | 50169/371472 [4:00:17<24:11:30,  3.69it/s]
 14%|█▎        | 50170/371472 [4:00:17<24:07:03,  3.70it/s]
 14%|█▎        | 50171/371472 [4:00:17<24:32:35,  3.64it/s]
 14%|█▎        | 50172/371472 [4:00:18<29:22:34,  3.04it/s]
 14%|█▎        | 50173/371472 [4:00:18<27:56:25,  3.19it/s]
 14%|█▎        | 50174/371472 [4:00:18<26:48:52,  3.33it/s]
 14%|█▎        | 50175/371472 [4:00:19<25:53:06,  3.45it/s]
 14%|█▎        | 50176/371472 [4:00:19<25:24:25,  3.51it/s]
 14%|█▎        | 50177/371472 [4:00:19<25:16:44,  3.53it/s]
 14%|█▎        | 50178/371472 [4:00:20<24:28:49,  3.65it/s]
 14%|█▎        | 50179/371472 [4:00:20<25:51:18,  3.45it/s]
 14%|█▎        | 50180/371472 [4:00:20<24:55:09,  3.58it/s]
                                                           
{'loss': 4.142, 'learning_rate': 8.788435432782434e-07, 'epoch': 2.16}

 14%|█▎        | 50180/371472 [4:00:20<24:55:09,  3.58it/s]
 14%|█▎        | 50181/371472 [4:00:20<26:21:14,  3.39it/s]
 14%|█▎        | 50182/371472 [4:00:21<25:49:24,  3.46it/s]
 14%|█▎        | 50183/371472 [4:00:21<26:29:39,  3.37it/s]
 14%|█▎        | 50184/371472 [4:00:21<25:56:27,  3.44it/s]
 14%|█▎        | 50185/371472 [4:00:22<27:27:25,  3.25it/s]
 14%|█▎        | 50186/371472 [4:00:22<26:55:47,  3.31it/s]
 14%|█▎        | 50187/371472 [4:00:22<25:49:09,  3.46it/s]
 14%|█▎        | 50188/371472 [4:00:22<24:44:37,  3.61it/s]
 14%|█▎        | 50189/371472 [4:00:23<25:18:48,  3.53it/s]
 14%|█▎        | 50190/371472 [4:00:23<25:29:00,  3.50it/s]
 14%|█▎        | 50191/371472 [4:00:23<27:28:34,  3.25it/s]
 14%|█▎        | 50192/371472 [4:00:24<27:42:40,  3.22it/s]
 14%|█▎        | 50193/371472 [4:00:24<27:34:08,  3.24it/s]
 14%|█▎        | 50194/371472 [4:00:24<28:19:30,  3.15it/s]
 14%|█▎        | 50195/371472 [4:00:25<27:34:11,  3.24it/s]
 14%|█▎        | 50196/371472 [4:00:25<26:02:07,  3.43it/s]
 14%|█▎        | 50197/371472 [4:00:25<24:57:50,  3.57it/s]
 14%|█▎        | 50198/371472 [4:00:25<25:10:42,  3.54it/s]
 14%|█▎        | 50199/371472 [4:00:26<24:52:58,  3.59it/s]
 14%|█▎        | 50200/371472 [4:00:26<24:46:33,  3.60it/s]
                                                           
{'loss': 4.2163, 'learning_rate': 8.787950613027646e-07, 'epoch': 2.16}

 14%|█▎        | 50200/371472 [4:00:26<24:46:33,  3.60it/s]
 14%|█▎        | 50201/371472 [4:00:26<27:19:47,  3.27it/s]
 14%|█▎        | 50202/371472 [4:00:27<26:32:52,  3.36it/s]
 14%|█▎        | 50203/371472 [4:00:27<26:21:48,  3.39it/s]
 14%|█▎        | 50204/371472 [4:00:27<25:35:32,  3.49it/s]
 14%|█▎        | 50205/371472 [4:00:27<24:22:36,  3.66it/s]
 14%|█▎        | 50206/371472 [4:00:28<23:46:11,  3.75it/s]
 14%|█▎        | 50207/371472 [4:00:28<26:03:33,  3.42it/s]
 14%|█▎        | 50208/371472 [4:00:28<26:10:00,  3.41it/s]
 14%|█▎        | 50209/371472 [4:00:29<25:24:36,  3.51it/s]
 14%|█▎        | 50210/371472 [4:00:29<24:33:58,  3.63it/s]
 14%|█▎        | 50211/371472 [4:00:29<24:18:20,  3.67it/s]
 14%|█▎        | 50212/371472 [4:00:29<23:48:53,  3.75it/s]
 14%|█▎        | 50213/371472 [4:00:30<27:26:13,  3.25it/s]
 14%|█▎        | 50214/371472 [4:00:30<26:19:38,  3.39it/s]
 14%|█▎        | 50215/371472 [4:00:30<25:06:55,  3.55it/s]
 14%|█▎        | 50216/371472 [4:00:31<25:01:31,  3.57it/s]
 14%|█▎        | 50217/371472 [4:00:31<24:43:23,  3.61it/s]
 14%|█▎        | 50218/371472 [4:00:31<23:47:55,  3.75it/s]
 14%|█▎        | 50219/371472 [4:00:31<25:08:11,  3.55it/s]
 14%|█▎        | 50220/371472 [4:00:32<24:06:27,  3.70it/s]
                                                           
{'loss': 4.226, 'learning_rate': 8.787465793272856e-07, 'epoch': 2.16}

 14%|█▎        | 50220/371472 [4:00:32<24:06:27,  3.70it/s]
 14%|█▎        | 50221/371472 [4:00:32<23:15:49,  3.84it/s]
 14%|█▎        | 50222/371472 [4:00:32<23:29:57,  3.80it/s]
 14%|█▎        | 50223/371472 [4:00:32<23:20:45,  3.82it/s]
 14%|█▎        | 50224/371472 [4:00:33<22:43:36,  3.93it/s]
 14%|█▎        | 50225/371472 [4:00:33<23:10:59,  3.85it/s]
 14%|█▎        | 50226/371472 [4:00:33<24:02:25,  3.71it/s]
 14%|█▎        | 50227/371472 [4:00:33<23:25:18,  3.81it/s]
 14%|█▎        | 50228/371472 [4:00:34<23:30:15,  3.80it/s]
 14%|█▎        | 50229/371472 [4:00:34<24:52:58,  3.59it/s]
 14%|█▎        | 50230/371472 [4:00:34<24:33:50,  3.63it/s]
 14%|█▎        | 50231/371472 [4:00:35<24:59:56,  3.57it/s]
 14%|█▎        | 50232/371472 [4:00:35<31:45:17,  2.81it/s]
 14%|█▎        | 50233/371472 [4:00:35<29:47:52,  2.99it/s]
 14%|█▎        | 50234/371472 [4:00:36<27:22:27,  3.26it/s]
 14%|█▎        | 50235/371472 [4:00:36<26:18:52,  3.39it/s]
 14%|█▎        | 50236/371472 [4:00:36<25:35:11,  3.49it/s]
 14%|█▎        | 50237/371472 [4:00:36<24:19:08,  3.67it/s]
 14%|█▎        | 50238/371472 [4:00:37<23:14:50,  3.84it/s]
 14%|█▎        | 50239/371472 [4:00:37<23:13:43,  3.84it/s]
 14%|█▎        | 50240/371472 [4:00:37<22:40:59,  3.93it/s]
                                                           
{'loss': 4.2411, 'learning_rate': 8.786980973518067e-07, 'epoch': 2.16}

 14%|█▎        | 50240/371472 [4:00:37<22:40:59,  3.93it/s]
 14%|█▎        | 50241/371472 [4:00:37<22:49:39,  3.91it/s]
 14%|█▎        | 50242/371472 [4:00:38<23:23:38,  3.81it/s]
 14%|█▎        | 50243/371472 [4:00:38<23:40:44,  3.77it/s]
 14%|█▎        | 50244/371472 [4:00:38<23:27:58,  3.80it/s]
 14%|█▎        | 50245/371472 [4:00:38<23:38:53,  3.77it/s]
 14%|█▎        | 50246/371472 [4:00:39<26:05:54,  3.42it/s]
 14%|█▎        | 50247/371472 [4:00:39<25:29:39,  3.50it/s]
 14%|█▎        | 50248/371472 [4:00:39<27:10:05,  3.28it/s]
 14%|█▎        | 50249/371472 [4:00:40<25:46:48,  3.46it/s]
 14%|█▎        | 50250/371472 [4:00:40<25:49:20,  3.46it/s]
 14%|█▎        | 50251/371472 [4:00:40<25:52:18,  3.45it/s]
 14%|█▎        | 50252/371472 [4:00:41<26:02:47,  3.43it/s]
 14%|█▎        | 50253/371472 [4:00:41<25:29:40,  3.50it/s]
 14%|█▎        | 50254/371472 [4:00:41<25:07:24,  3.55it/s]
 14%|█▎        | 50255/371472 [4:00:41<24:47:46,  3.60it/s]
 14%|█▎        | 50256/371472 [4:00:42<24:02:13,  3.71it/s]
 14%|█▎        | 50257/371472 [4:00:42<25:42:18,  3.47it/s]
 14%|█▎        | 50258/371472 [4:00:42<26:22:25,  3.38it/s]
 14%|█▎        | 50259/371472 [4:00:43<24:52:29,  3.59it/s]
 14%|█▎        | 50260/371472 [4:00:43<25:54:50,  3.44it/s]
                                                           
{'loss': 4.4795, 'learning_rate': 8.786496153763279e-07, 'epoch': 2.16}

 14%|█▎        | 50260/371472 [4:00:43<25:54:50,  3.44it/s]
 14%|█▎        | 50261/371472 [4:00:43<25:54:26,  3.44it/s]
 14%|█▎        | 50262/371472 [4:00:43<25:43:41,  3.47it/s]
 14%|█▎        | 50263/371472 [4:00:44<26:23:37,  3.38it/s]
 14%|█▎        | 50264/371472 [4:00:44<27:49:00,  3.21it/s]
 14%|█▎        | 50265/371472 [4:00:44<25:48:57,  3.46it/s]
 14%|█▎        | 50266/371472 [4:00:45<25:05:35,  3.56it/s]
 14%|█▎        | 50267/371472 [4:00:45<25:27:58,  3.50it/s]
 14%|█▎        | 50268/371472 [4:00:45<26:07:27,  3.42it/s]
 14%|█▎        | 50269/371472 [4:00:45<25:07:31,  3.55it/s]
 14%|█▎        | 50270/371472 [4:00:46<26:00:07,  3.43it/s]
 14%|█▎        | 50271/371472 [4:00:46<31:10:24,  2.86it/s]
 14%|█▎        | 50272/371472 [4:00:47<30:49:26,  2.89it/s]
 14%|█▎        | 50273/371472 [4:00:47<29:57:44,  2.98it/s]
 14%|█▎        | 50274/371472 [4:00:47<27:25:25,  3.25it/s]
 14%|█▎        | 50275/371472 [4:00:47<27:02:35,  3.30it/s]
 14%|█▎        | 50276/371472 [4:00:48<26:48:25,  3.33it/s]
 14%|█▎        | 50277/371472 [4:00:48<27:31:22,  3.24it/s]
 14%|█▎        | 50278/371472 [4:00:48<27:48:07,  3.21it/s]
 14%|█▎        | 50279/371472 [4:00:49<26:27:15,  3.37it/s]
 14%|█▎        | 50280/371472 [4:00:49<27:07:17,  3.29it/s]
                                                           
{'loss': 4.0183, 'learning_rate': 8.786011334008489e-07, 'epoch': 2.17}

 14%|█▎        | 50280/371472 [4:00:49<27:07:17,  3.29it/s]
 14%|█▎        | 50281/371472 [4:00:49<25:47:56,  3.46it/s]
 14%|█▎        | 50282/371472 [4:00:50<26:25:03,  3.38it/s]
 14%|█▎        | 50283/371472 [4:00:50<26:30:55,  3.36it/s]
 14%|█▎        | 50284/371472 [4:00:50<26:01:14,  3.43it/s]
 14%|█▎        | 50285/371472 [4:00:50<26:59:02,  3.31it/s]
 14%|█▎        | 50286/371472 [4:00:51<26:26:57,  3.37it/s]
 14%|█▎        | 50287/371472 [4:00:51<26:53:21,  3.32it/s]
 14%|█▎        | 50288/371472 [4:00:51<26:01:53,  3.43it/s]
 14%|█▎        | 50289/371472 [4:00:52<25:26:56,  3.51it/s]
 14%|█▎        | 50290/371472 [4:00:52<25:13:37,  3.54it/s]
 14%|█▎        | 50291/371472 [4:00:52<25:31:03,  3.50it/s]
 14%|█▎        | 50292/371472 [4:00:52<25:16:07,  3.53it/s]
 14%|█▎        | 50293/371472 [4:00:53<24:53:47,  3.58it/s]
 14%|█▎        | 50294/371472 [4:00:53<24:48:25,  3.60it/s]
 14%|█▎        | 50295/371472 [4:00:53<24:37:33,  3.62it/s]
 14%|█▎        | 50296/371472 [4:00:54<25:09:41,  3.55it/s]
 14%|█▎        | 50297/371472 [4:00:54<25:00:56,  3.57it/s]
 14%|█▎        | 50298/371472 [4:00:54<25:51:42,  3.45it/s]
 14%|█▎        | 50299/371472 [4:00:54<26:09:02,  3.41it/s]
 14%|█▎        | 50300/371472 [4:00:55<25:14:05,  3.54it/s]
                                                           
{'loss': 4.1343, 'learning_rate': 8.7855265142537e-07, 'epoch': 2.17}

 14%|█▎        | 50300/371472 [4:00:55<25:14:05,  3.54it/s]
 14%|█▎        | 50301/371472 [4:00:55<25:02:09,  3.56it/s]
 14%|█▎        | 50302/371472 [4:00:55<24:21:24,  3.66it/s]
 14%|█▎        | 50303/371472 [4:00:55<23:55:05,  3.73it/s]
 14%|█▎        | 50304/371472 [4:00:56<24:16:54,  3.67it/s]
 14%|█▎        | 50305/371472 [4:00:56<24:57:55,  3.57it/s]
 14%|█▎        | 50306/371472 [4:00:56<24:09:50,  3.69it/s]
 14%|█▎        | 50307/371472 [4:00:57<23:21:33,  3.82it/s]
 14%|█▎        | 50308/371472 [4:00:57<24:51:24,  3.59it/s]
 14%|█▎        | 50309/371472 [4:00:57<26:05:08,  3.42it/s]
 14%|█▎        | 50310/371472 [4:00:57<25:22:44,  3.52it/s]
 14%|█▎        | 50311/371472 [4:00:58<26:09:43,  3.41it/s]
 14%|█▎        | 50312/371472 [4:00:58<26:09:22,  3.41it/s]
 14%|█▎        | 50313/371472 [4:00:58<26:01:54,  3.43it/s]
 14%|█▎        | 50314/371472 [4:00:59<24:51:37,  3.59it/s]
 14%|█▎        | 50315/371472 [4:00:59<24:03:10,  3.71it/s]
 14%|█▎        | 50316/371472 [4:00:59<24:09:19,  3.69it/s]
 14%|█▎        | 50317/371472 [4:00:59<24:23:01,  3.66it/s]
 14%|█▎        | 50318/371472 [4:01:00<24:01:26,  3.71it/s]
 14%|█▎        | 50319/371472 [4:01:00<24:34:29,  3.63it/s]
 14%|█▎        | 50320/371472 [4:01:00<24:25:35,  3.65it/s]
                                                           
{'loss': 4.1272, 'learning_rate': 8.785041694498912e-07, 'epoch': 2.17}

 14%|█▎        | 50320/371472 [4:01:00<24:25:35,  3.65it/s]
 14%|█▎        | 50321/371472 [4:01:00<23:44:16,  3.76it/s]
 14%|█▎        | 50322/371472 [4:01:01<26:06:48,  3.42it/s]
 14%|█▎        | 50323/371472 [4:01:01<28:07:33,  3.17it/s]
 14%|█▎        | 50324/371472 [4:01:02<28:58:29,  3.08it/s]
 14%|█▎        | 50325/371472 [4:01:02<27:03:13,  3.30it/s]
 14%|█▎        | 50326/371472 [4:01:02<26:45:33,  3.33it/s]
 14%|█▎        | 50327/371472 [4:01:02<25:48:08,  3.46it/s]
 14%|█▎        | 50328/371472 [4:01:03<25:18:51,  3.52it/s]
 14%|█▎        | 50329/371472 [4:01:03<24:50:48,  3.59it/s]
 14%|█▎        | 50330/371472 [4:01:03<25:51:02,  3.45it/s]
 14%|█▎        | 50331/371472 [4:01:03<25:43:42,  3.47it/s]
 14%|█▎        | 50332/371472 [4:01:04<24:34:23,  3.63it/s]
 14%|█▎        | 50333/371472 [4:01:04<23:34:51,  3.78it/s]
 14%|█▎        | 50334/371472 [4:01:04<24:20:59,  3.66it/s]
 14%|█▎        | 50335/371472 [4:01:05<23:40:14,  3.77it/s]
 14%|█▎        | 50336/371472 [4:01:05<23:53:46,  3.73it/s]
 14%|█▎        | 50337/371472 [4:01:05<23:54:45,  3.73it/s]
 14%|█▎        | 50338/371472 [4:01:05<23:49:07,  3.75it/s]
 14%|█▎        | 50339/371472 [4:01:06<23:51:08,  3.74it/s]
 14%|█▎        | 50340/371472 [4:01:06<23:55:26,  3.73it/s]
                                                           
{'loss': 4.4295, 'learning_rate': 8.784556874744123e-07, 'epoch': 2.17}

 14%|█▎        | 50340/371472 [4:01:06<23:55:26,  3.73it/s]
 14%|█▎        | 50341/371472 [4:01:06<25:33:53,  3.49it/s]
 14%|█▎        | 50342/371472 [4:01:06<24:33:02,  3.63it/s]
 14%|█▎        | 50343/371472 [4:01:07<24:21:37,  3.66it/s]
 14%|█▎        | 50344/371472 [4:01:07<24:38:52,  3.62it/s]
 14%|█▎        | 50345/371472 [4:01:07<24:02:05,  3.71it/s]
 14%|█▎        | 50346/371472 [4:01:07<23:47:11,  3.75it/s]
 14%|█▎        | 50347/371472 [4:01:08<23:13:14,  3.84it/s]
 14%|█▎        | 50348/371472 [4:01:08<23:48:51,  3.75it/s]
 14%|█▎        | 50349/371472 [4:01:08<25:18:22,  3.52it/s]
 14%|█▎        | 50350/371472 [4:01:09<25:44:03,  3.47it/s]
 14%|█▎        | 50351/371472 [4:01:09<24:26:48,  3.65it/s]
 14%|█▎        | 50352/371472 [4:01:09<23:59:39,  3.72it/s]
 14%|█▎        | 50353/371472 [4:01:09<23:54:32,  3.73it/s]
 14%|█▎        | 50354/371472 [4:01:10<22:52:17,  3.90it/s]
 14%|█▎        | 50355/371472 [4:01:10<23:54:09,  3.73it/s]
 14%|█▎        | 50356/371472 [4:01:10<23:52:29,  3.74it/s]
 14%|█▎        | 50357/371472 [4:01:10<23:04:11,  3.87it/s]
 14%|█▎        | 50358/371472 [4:01:11<24:04:20,  3.71it/s]
 14%|█▎        | 50359/371472 [4:01:11<24:29:26,  3.64it/s]
 14%|█▎        | 50360/371472 [4:01:11<24:45:11,  3.60it/s]
                                                           
{'loss': 4.179, 'learning_rate': 8.784072054989334e-07, 'epoch': 2.17}

 14%|█▎        | 50360/371472 [4:01:11<24:45:11,  3.60it/s]
 14%|█▎        | 50361/371472 [4:01:12<24:06:18,  3.70it/s]
 14%|█▎        | 50362/371472 [4:01:12<27:08:24,  3.29it/s]
 14%|█▎        | 50363/371472 [4:01:12<26:08:13,  3.41it/s]
 14%|█▎        | 50364/371472 [4:01:13<26:42:50,  3.34it/s]
 14%|█▎        | 50365/371472 [4:01:13<25:25:37,  3.51it/s]
 14%|█▎        | 50366/371472 [4:01:13<25:22:11,  3.52it/s]
 14%|█▎        | 50367/371472 [4:01:13<25:34:12,  3.49it/s]
 14%|█▎        | 50368/371472 [4:01:14<24:39:42,  3.62it/s]
 14%|█▎        | 50369/371472 [4:01:14<26:44:02,  3.34it/s]
 14%|█▎        | 50370/371472 [4:01:14<25:41:17,  3.47it/s]
 14%|█▎        | 50371/371472 [4:01:14<25:43:06,  3.47it/s]
 14%|█▎        | 50372/371472 [4:01:15<24:40:09,  3.62it/s]
 14%|█▎        | 50373/371472 [4:01:15<24:24:20,  3.65it/s]
 14%|█▎        | 50374/371472 [4:01:15<25:23:37,  3.51it/s]
 14%|█▎        | 50375/371472 [4:01:16<24:42:06,  3.61it/s]
 14%|█▎        | 50376/371472 [4:01:16<23:58:00,  3.72it/s]
 14%|█▎        | 50377/371472 [4:01:16<24:27:40,  3.65it/s]
 14%|█▎        | 50378/371472 [4:01:16<24:01:37,  3.71it/s]
 14%|█▎        | 50379/371472 [4:01:17<23:25:19,  3.81it/s]
 14%|█▎        | 50380/371472 [4:01:17<23:46:09,  3.75it/s]
                                                           
{'loss': 4.4046, 'learning_rate': 8.783587235234545e-07, 'epoch': 2.17}

 14%|█▎        | 50380/371472 [4:01:17<23:46:09,  3.75it/s]
 14%|█▎        | 50381/371472 [4:01:17<23:23:10,  3.81it/s]
 14%|█▎        | 50382/371472 [4:01:17<24:47:37,  3.60it/s]
 14%|█▎        | 50383/371472 [4:01:18<25:23:14,  3.51it/s]
 14%|█▎        | 50384/371472 [4:01:18<32:25:39,  2.75it/s]
 14%|█▎        | 50385/371472 [4:01:19<29:40:29,  3.01it/s]
 14%|█▎        | 50386/371472 [4:01:19<29:29:47,  3.02it/s]
 14%|█▎        | 50387/371472 [4:01:19<27:24:08,  3.25it/s]
 14%|█▎        | 50388/371472 [4:01:19<25:59:12,  3.43it/s]
 14%|█▎        | 50389/371472 [4:01:20<24:37:30,  3.62it/s]
 14%|█▎        | 50390/371472 [4:01:20<25:36:15,  3.48it/s]
 14%|█▎        | 50391/371472 [4:01:20<24:38:29,  3.62it/s]
 14%|█▎        | 50392/371472 [4:01:21<25:53:18,  3.45it/s]
 14%|█▎        | 50393/371472 [4:01:21<26:57:30,  3.31it/s]
 14%|█▎        | 50394/371472 [4:01:21<29:18:03,  3.04it/s]
 14%|█▎        | 50395/371472 [4:01:22<27:28:18,  3.25it/s]
 14%|█▎        | 50396/371472 [4:01:22<26:44:21,  3.34it/s]
 14%|█▎        | 50397/371472 [4:01:22<25:06:29,  3.55it/s]
 14%|█▎        | 50398/371472 [4:01:22<24:59:07,  3.57it/s]
 14%|█▎        | 50399/371472 [4:01:23<23:55:03,  3.73it/s]
 14%|█▎        | 50400/371472 [4:01:23<23:02:21,  3.87it/s]
                                                           
{'loss': 4.3233, 'learning_rate': 8.783102415479755e-07, 'epoch': 2.17}

 14%|█▎        | 50400/371472 [4:01:23<23:02:21,  3.87it/s]
 14%|█▎        | 50401/371472 [4:01:23<23:18:47,  3.83it/s]
 14%|█▎        | 50402/371472 [4:01:23<23:37:17,  3.78it/s]
 14%|█▎        | 50403/371472 [4:01:24<22:56:04,  3.89it/s]
 14%|█▎        | 50404/371472 [4:01:24<23:24:12,  3.81it/s]
 14%|█▎        | 50405/371472 [4:01:24<23:17:03,  3.83it/s]
 14%|█▎        | 50406/371472 [4:01:24<23:52:18,  3.74it/s]
 14%|█▎        | 50407/371472 [4:01:25<25:34:33,  3.49it/s]
 14%|█▎        | 50408/371472 [4:01:25<24:08:44,  3.69it/s]
 14%|█▎        | 50409/371472 [4:01:25<24:05:05,  3.70it/s]
 14%|█▎        | 50410/371472 [4:01:25<23:42:00,  3.76it/s]
 14%|█▎        | 50411/371472 [4:01:26<24:06:07,  3.70it/s]
 14%|█▎        | 50412/371472 [4:01:26<23:35:17,  3.78it/s]
 14%|█▎        | 50413/371472 [4:01:26<24:13:45,  3.68it/s]
 14%|█▎        | 50414/371472 [4:01:27<23:59:48,  3.72it/s]
 14%|█▎        | 50415/371472 [4:01:27<23:21:32,  3.82it/s]
 14%|█▎        | 50416/371472 [4:01:27<23:38:23,  3.77it/s]
 14%|█▎        | 50417/371472 [4:01:27<23:17:31,  3.83it/s]
 14%|█▎        | 50418/371472 [4:01:28<23:37:14,  3.78it/s]
 14%|█▎        | 50419/371472 [4:01:28<23:05:37,  3.86it/s]
 14%|█▎        | 50420/371472 [4:01:28<24:15:37,  3.68it/s]
                                                           
{'loss': 4.0627, 'learning_rate': 8.782617595724967e-07, 'epoch': 2.17}

 14%|█▎        | 50420/371472 [4:01:28<24:15:37,  3.68it/s]
 14%|█▎        | 50421/371472 [4:01:28<23:52:04,  3.74it/s]
 14%|█▎        | 50422/371472 [4:01:29<24:45:23,  3.60it/s]
 14%|█▎        | 50423/371472 [4:01:29<24:41:22,  3.61it/s]
 14%|█▎        | 50424/371472 [4:01:29<24:09:49,  3.69it/s]
 14%|█▎        | 50425/371472 [4:01:29<23:36:57,  3.78it/s]
 14%|█▎        | 50426/371472 [4:01:30<25:23:39,  3.51it/s]
 14%|█▎        | 50427/371472 [4:01:30<26:39:36,  3.35it/s]
 14%|█▎        | 50428/371472 [4:01:30<25:31:04,  3.49it/s]
 14%|█▎        | 50429/371472 [4:01:31<25:05:44,  3.55it/s]
 14%|█▎        | 50430/371472 [4:01:31<24:12:19,  3.68it/s]
 14%|█▎        | 50431/371472 [4:01:31<23:46:41,  3.75it/s]
 14%|█▎        | 50432/371472 [4:01:31<24:32:41,  3.63it/s]
 14%|█▎        | 50433/371472 [4:01:32<24:48:03,  3.60it/s]
 14%|█▎        | 50434/371472 [4:01:32<24:27:57,  3.64it/s]
 14%|█▎        | 50435/371472 [4:01:32<23:16:38,  3.83it/s]
 14%|█▎        | 50436/371472 [4:01:33<22:50:15,  3.90it/s]
 14%|█▎        | 50437/371472 [4:01:33<25:50:00,  3.45it/s]
 14%|█▎        | 50438/371472 [4:01:33<27:35:52,  3.23it/s]
 14%|█▎        | 50439/371472 [4:01:34<26:48:28,  3.33it/s]
 14%|█▎        | 50440/371472 [4:01:34<27:12:28,  3.28it/s]
                                                           
{'loss': 4.2086, 'learning_rate': 8.782132775970177e-07, 'epoch': 2.17}

 14%|█▎        | 50440/371472 [4:01:34<27:12:28,  3.28it/s]
 14%|█▎        | 50441/371472 [4:01:34<27:04:35,  3.29it/s]
 14%|█▎        | 50442/371472 [4:01:34<25:30:07,  3.50it/s]
 14%|█▎        | 50443/371472 [4:01:35<25:34:02,  3.49it/s]
 14%|█▎        | 50444/371472 [4:01:35<24:35:28,  3.63it/s]
 14%|█▎        | 50445/371472 [4:01:35<23:27:47,  3.80it/s]
 14%|█▎        | 50446/371472 [4:01:35<25:36:19,  3.48it/s]
 14%|█▎        | 50447/371472 [4:01:36<25:00:46,  3.57it/s]
 14%|█▎        | 50448/371472 [4:01:36<25:23:20,  3.51it/s]
 14%|█▎        | 50449/371472 [4:01:36<24:54:17,  3.58it/s]
 14%|█▎        | 50450/371472 [4:01:37<24:35:25,  3.63it/s]
 14%|█▎        | 50451/371472 [4:01:37<23:46:25,  3.75it/s]
 14%|█▎        | 50452/371472 [4:01:37<24:03:45,  3.71it/s]
 14%|█▎        | 50453/371472 [4:01:37<24:22:33,  3.66it/s]
 14%|█▎        | 50454/371472 [4:01:38<24:34:15,  3.63it/s]
 14%|█▎        | 50455/371472 [4:01:38<25:34:21,  3.49it/s]
 14%|█▎        | 50456/371472 [4:01:38<25:06:23,  3.55it/s]
 14%|█▎        | 50457/371472 [4:01:38<24:05:43,  3.70it/s]
 14%|█▎        | 50458/371472 [4:01:39<23:40:50,  3.77it/s]
 14%|█▎        | 50459/371472 [4:01:39<24:55:56,  3.58it/s]
 14%|█▎        | 50460/371472 [4:01:39<24:32:18,  3.63it/s]
                                                           
{'loss': 4.2934, 'learning_rate': 8.781647956215389e-07, 'epoch': 2.17}

 14%|█▎        | 50460/371472 [4:01:39<24:32:18,  3.63it/s]
 14%|█▎        | 50461/371472 [4:01:40<23:41:29,  3.76it/s]
 14%|█▎        | 50462/371472 [4:01:40<24:07:31,  3.70it/s]
 14%|█▎        | 50463/371472 [4:01:40<25:17:22,  3.53it/s]
 14%|█▎        | 50464/371472 [4:01:40<23:52:19,  3.74it/s]
 14%|█▎        | 50465/371472 [4:01:41<26:28:01,  3.37it/s]
 14%|█▎        | 50466/371472 [4:01:41<26:43:10,  3.34it/s]
 14%|█▎        | 50467/371472 [4:01:41<27:51:31,  3.20it/s]
 14%|█▎        | 50468/371472 [4:01:42<26:01:20,  3.43it/s]
 14%|█▎        | 50469/371472 [4:01:42<24:57:12,  3.57it/s]
 14%|█▎        | 50470/371472 [4:01:42<26:51:14,  3.32it/s]
 14%|█▎        | 50471/371472 [4:01:42<25:16:38,  3.53it/s]
 14%|█▎        | 50472/371472 [4:01:43<25:52:22,  3.45it/s]
 14%|█▎        | 50473/371472 [4:01:43<24:46:05,  3.60it/s]
 14%|█▎        | 50474/371472 [4:01:43<25:03:02,  3.56it/s]
 14%|█▎        | 50475/371472 [4:01:44<24:36:30,  3.62it/s]
 14%|█▎        | 50476/371472 [4:01:44<25:15:05,  3.53it/s]
 14%|█▎        | 50477/371472 [4:01:44<26:06:50,  3.41it/s]
 14%|█▎        | 50478/371472 [4:01:44<25:26:47,  3.50it/s]
 14%|█▎        | 50479/371472 [4:01:45<26:01:24,  3.43it/s]
 14%|█▎        | 50480/371472 [4:01:45<25:07:36,  3.55it/s]
                                                           
{'loss': 4.3135, 'learning_rate': 8.7811631364606e-07, 'epoch': 2.17}

 14%|█▎        | 50480/371472 [4:01:45<25:07:36,  3.55it/s]
 14%|█▎        | 50481/371472 [4:01:45<24:22:50,  3.66it/s]
 14%|█▎        | 50482/371472 [4:01:46<23:57:54,  3.72it/s]
 14%|█▎        | 50483/371472 [4:01:46<23:24:42,  3.81it/s]
 14%|█▎        | 50484/371472 [4:01:46<24:41:04,  3.61it/s]
 14%|█▎        | 50485/371472 [4:01:46<25:03:43,  3.56it/s]
 14%|█▎        | 50486/371472 [4:01:47<25:29:45,  3.50it/s]
 14%|█▎        | 50487/371472 [4:01:47<25:29:26,  3.50it/s]
 14%|█▎        | 50488/371472 [4:01:47<24:57:40,  3.57it/s]
 14%|█▎        | 50489/371472 [4:01:48<25:33:36,  3.49it/s]
 14%|█▎        | 50490/371472 [4:01:48<26:58:14,  3.31it/s]
 14%|█▎        | 50491/371472 [4:01:48<27:21:16,  3.26it/s]
 14%|█▎        | 50492/371472 [4:01:48<26:39:27,  3.34it/s]
 14%|█▎        | 50493/371472 [4:01:49<25:13:21,  3.53it/s]
 14%|█▎        | 50494/371472 [4:01:49<26:35:57,  3.35it/s]
 14%|█▎        | 50495/371472 [4:01:49<25:38:03,  3.48it/s]
 14%|█▎        | 50496/371472 [4:01:50<25:50:00,  3.45it/s]
 14%|█▎        | 50497/371472 [4:01:50<25:55:20,  3.44it/s]
 14%|█▎        | 50498/371472 [4:01:50<24:57:03,  3.57it/s]
 14%|█▎        | 50499/371472 [4:01:50<24:03:01,  3.71it/s]
 14%|█▎        | 50500/371472 [4:01:51<23:57:43,  3.72it/s]
                                                           
{'loss': 4.0578, 'learning_rate': 8.780678316705812e-07, 'epoch': 2.18}

 14%|█▎        | 50500/371472 [4:01:51<23:57:43,  3.72it/s]
 14%|█▎        | 50501/371472 [4:01:51<23:11:07,  3.85it/s]
 14%|█▎        | 50502/371472 [4:01:51<23:23:31,  3.81it/s]
 14%|█▎        | 50503/371472 [4:01:51<22:46:11,  3.92it/s]
 14%|█▎        | 50504/371472 [4:01:52<22:53:45,  3.89it/s]
 14%|█▎        | 50505/371472 [4:01:52<22:52:10,  3.90it/s]
 14%|█▎        | 50506/371472 [4:01:52<23:17:19,  3.83it/s]
 14%|█▎        | 50507/371472 [4:01:53<24:04:32,  3.70it/s]
 14%|█▎        | 50508/371472 [4:01:53<24:32:47,  3.63it/s]
 14%|█▎        | 50509/371472 [4:01:53<25:22:13,  3.51it/s]
 14%|█▎        | 50510/371472 [4:01:53<27:45:19,  3.21it/s]
 14%|█▎        | 50511/371472 [4:01:54<26:36:46,  3.35it/s]
 14%|█▎        | 50512/371472 [4:01:54<27:35:29,  3.23it/s]
 14%|█▎        | 50513/371472 [4:01:54<26:38:40,  3.35it/s]
 14%|█▎        | 50514/371472 [4:01:55<27:23:02,  3.26it/s]
 14%|█▎        | 50515/371472 [4:01:55<26:46:24,  3.33it/s]
 14%|█▎        | 50516/371472 [4:01:55<26:08:13,  3.41it/s]
 14%|█▎        | 50517/371472 [4:01:56<27:02:30,  3.30it/s]
 14%|█▎        | 50518/371472 [4:01:56<25:39:05,  3.48it/s]
 14%|█▎        | 50519/371472 [4:01:56<26:22:39,  3.38it/s]
 14%|█▎        | 50520/371472 [4:01:56<26:10:22,  3.41it/s]
                                                           
{'loss': 4.1289, 'learning_rate': 8.780193496951022e-07, 'epoch': 2.18}

 14%|█▎        | 50520/371472 [4:01:56<26:10:22,  3.41it/s]
 14%|█▎        | 50521/371472 [4:01:57<25:20:38,  3.52it/s]
 14%|█▎        | 50522/371472 [4:01:57<26:26:08,  3.37it/s]
 14%|█▎        | 50523/371472 [4:01:57<25:44:38,  3.46it/s]
 14%|█▎        | 50524/371472 [4:01:58<26:34:27,  3.35it/s]
 14%|█▎        | 50525/371472 [4:01:58<27:27:55,  3.25it/s]
 14%|█▎        | 50526/371472 [4:01:58<27:15:58,  3.27it/s]
 14%|█▎        | 50527/371472 [4:01:58<25:42:47,  3.47it/s]
 14%|█▎        | 50528/371472 [4:01:59<26:22:14,  3.38it/s]
 14%|█▎        | 50529/371472 [4:01:59<25:43:56,  3.46it/s]
 14%|█▎        | 50530/371472 [4:01:59<25:45:13,  3.46it/s]
 14%|█▎        | 50531/371472 [4:02:00<24:22:32,  3.66it/s]
 14%|█▎        | 50532/371472 [4:02:00<24:12:57,  3.68it/s]
 14%|█▎        | 50533/371472 [4:02:00<25:28:11,  3.50it/s]
 14%|█▎        | 50534/371472 [4:02:00<24:20:28,  3.66it/s]
 14%|█▎        | 50535/371472 [4:02:01<25:41:46,  3.47it/s]
 14%|█▎        | 50536/371472 [4:02:01<26:02:24,  3.42it/s]
 14%|█▎        | 50537/371472 [4:02:01<26:08:25,  3.41it/s]
 14%|█▎        | 50538/371472 [4:02:02<25:15:28,  3.53it/s]
 14%|█▎        | 50539/371472 [4:02:02<24:22:35,  3.66it/s]
 14%|█▎        | 50540/371472 [4:02:02<25:17:06,  3.53it/s]
                                                           
{'loss': 4.2016, 'learning_rate': 8.779708677196233e-07, 'epoch': 2.18}

 14%|█▎        | 50540/371472 [4:02:02<25:17:06,  3.53it/s]
 14%|█▎        | 50541/371472 [4:02:02<24:49:46,  3.59it/s]
 14%|█▎        | 50542/371472 [4:02:03<24:00:07,  3.71it/s]
 14%|█▎        | 50543/371472 [4:02:03<23:49:13,  3.74it/s]
 14%|█▎        | 50544/371472 [4:02:03<23:31:56,  3.79it/s]
 14%|█▎        | 50545/371472 [4:02:03<23:15:03,  3.83it/s]
 14%|█▎        | 50546/371472 [4:02:04<25:12:28,  3.54it/s]
 14%|█▎        | 50547/371472 [4:02:04<24:26:14,  3.65it/s]
 14%|█▎        | 50548/371472 [4:02:04<26:49:29,  3.32it/s]
 14%|█▎        | 50549/371472 [4:02:05<27:34:51,  3.23it/s]
 14%|█▎        | 50550/371472 [4:02:05<27:12:06,  3.28it/s]
 14%|█▎        | 50551/371472 [4:02:05<26:38:03,  3.35it/s]
 14%|█▎        | 50552/371472 [4:02:06<25:40:53,  3.47it/s]
 14%|█▎        | 50553/371472 [4:02:06<25:08:32,  3.55it/s]
 14%|█▎        | 50554/371472 [4:02:06<24:26:28,  3.65it/s]
 14%|█▎        | 50555/371472 [4:02:06<23:27:58,  3.80it/s]
 14%|█▎        | 50556/371472 [4:02:07<24:16:35,  3.67it/s]
 14%|█▎        | 50557/371472 [4:02:07<24:19:04,  3.67it/s]
 14%|█▎        | 50558/371472 [4:02:07<24:29:10,  3.64it/s]
 14%|█▎        | 50559/371472 [4:02:08<25:38:31,  3.48it/s]
 14%|█▎        | 50560/371472 [4:02:08<28:07:42,  3.17it/s]
                                                           
{'loss': 4.0938, 'learning_rate': 8.779223857441444e-07, 'epoch': 2.18}

 14%|█▎        | 50560/371472 [4:02:08<28:07:42,  3.17it/s]
 14%|█▎        | 50561/371472 [4:02:08<28:22:38,  3.14it/s]
 14%|█▎        | 50562/371472 [4:02:08<26:54:40,  3.31it/s]
 14%|█▎        | 50563/371472 [4:02:09<26:04:19,  3.42it/s]
 14%|█▎        | 50564/371472 [4:02:09<24:58:59,  3.57it/s]
 14%|█▎        | 50565/371472 [4:02:09<24:26:50,  3.65it/s]
 14%|█▎        | 50566/371472 [4:02:10<23:39:28,  3.77it/s]
 14%|█▎        | 50567/371472 [4:02:10<24:27:43,  3.64it/s]
 14%|█▎        | 50568/371472 [4:02:10<23:32:25,  3.79it/s]
 14%|█▎        | 50569/371472 [4:02:10<23:30:57,  3.79it/s]
 14%|█▎        | 50570/371472 [4:02:11<23:23:31,  3.81it/s]
 14%|█▎        | 50571/371472 [4:02:11<23:06:39,  3.86it/s]
 14%|█▎        | 50572/371472 [4:02:11<24:45:32,  3.60it/s]
 14%|█▎        | 50573/371472 [4:02:11<24:13:03,  3.68it/s]
 14%|█▎        | 50574/371472 [4:02:12<23:31:07,  3.79it/s]
 14%|█▎        | 50575/371472 [4:02:12<25:11:06,  3.54it/s]
 14%|█▎        | 50576/371472 [4:02:12<25:50:15,  3.45it/s]
 14%|█▎        | 50577/371472 [4:02:13<26:15:53,  3.39it/s]
 14%|█▎        | 50578/371472 [4:02:13<26:25:09,  3.37it/s]
 14%|█▎        | 50579/371472 [4:02:13<25:08:35,  3.55it/s]
 14%|█▎        | 50580/371472 [4:02:14<29:09:03,  3.06it/s]
                                                           
{'loss': 4.345, 'learning_rate': 8.778739037686655e-07, 'epoch': 2.18}

 14%|█▎        | 50580/371472 [4:02:14<29:09:03,  3.06it/s]
 14%|█▎        | 50581/371472 [4:02:14<27:10:02,  3.28it/s]
 14%|█▎        | 50582/371472 [4:02:14<26:53:49,  3.31it/s]
 14%|█▎        | 50583/371472 [4:02:14<27:39:30,  3.22it/s]
 14%|█▎        | 50584/371472 [4:02:15<26:49:07,  3.32it/s]
 14%|█▎        | 50585/371472 [4:02:15<26:03:57,  3.42it/s]
 14%|█▎        | 50586/371472 [4:02:15<24:24:23,  3.65it/s]
 14%|█▎        | 50587/371472 [4:02:16<25:22:23,  3.51it/s]
 14%|█▎        | 50588/371472 [4:02:16<24:45:35,  3.60it/s]
 14%|█▎        | 50589/371472 [4:02:16<23:55:04,  3.73it/s]
 14%|█▎        | 50590/371472 [4:02:16<23:07:16,  3.86it/s]
 14%|█▎        | 50591/371472 [4:02:17<23:43:21,  3.76it/s]
 14%|█▎        | 50592/371472 [4:02:17<23:30:28,  3.79it/s]
 14%|█▎        | 50593/371472 [4:02:17<22:59:06,  3.88it/s]
 14%|█▎        | 50594/371472 [4:02:17<25:57:50,  3.43it/s]
 14%|█▎        | 50595/371472 [4:02:18<26:23:54,  3.38it/s]
 14%|█▎        | 50596/371472 [4:02:18<26:05:47,  3.42it/s]
 14%|█▎        | 50597/371472 [4:02:18<26:10:24,  3.41it/s]
 14%|█▎        | 50598/371472 [4:02:19<25:44:43,  3.46it/s]
 14%|█▎        | 50599/371472 [4:02:19<25:24:50,  3.51it/s]
 14%|█▎        | 50600/371472 [4:02:19<24:45:22,  3.60it/s]
                                                           
{'loss': 4.3269, 'learning_rate': 8.778254217931866e-07, 'epoch': 2.18}

 14%|█▎        | 50600/371472 [4:02:19<24:45:22,  3.60it/s]
 14%|█▎        | 50601/371472 [4:02:19<24:33:32,  3.63it/s]
 14%|█▎        | 50602/371472 [4:02:20<26:12:50,  3.40it/s]
 14%|█▎        | 50603/371472 [4:02:20<28:23:52,  3.14it/s]
 14%|█▎        | 50604/371472 [4:02:20<26:16:16,  3.39it/s]
 14%|█▎        | 50605/371472 [4:02:21<26:31:15,  3.36it/s]
 14%|█▎        | 50606/371472 [4:02:21<25:09:06,  3.54it/s]
 14%|█▎        | 50607/371472 [4:02:21<26:50:41,  3.32it/s]
 14%|█▎        | 50608/371472 [4:02:22<26:50:37,  3.32it/s]
 14%|█▎        | 50609/371472 [4:02:22<28:01:23,  3.18it/s]
 14%|█▎        | 50610/371472 [4:02:22<28:22:09,  3.14it/s]
 14%|█▎        | 50611/371472 [4:02:23<27:44:31,  3.21it/s]
 14%|█▎        | 50612/371472 [4:02:23<26:05:02,  3.42it/s]
 14%|█▎        | 50613/371472 [4:02:23<26:22:22,  3.38it/s]
 14%|█▎        | 50614/371472 [4:02:23<25:48:28,  3.45it/s]
 14%|█▎        | 50615/371472 [4:02:24<25:58:52,  3.43it/s]
 14%|█▎        | 50616/371472 [4:02:24<25:58:49,  3.43it/s]
 14%|█▎        | 50617/371472 [4:02:24<26:02:36,  3.42it/s]
 14%|█▎        | 50618/371472 [4:02:24<25:06:43,  3.55it/s]
 14%|█▎        | 50619/371472 [4:02:25<24:35:02,  3.63it/s]
 14%|█▎        | 50620/371472 [4:02:25<24:40:20,  3.61it/s]
                                                           
{'loss': 4.2461, 'learning_rate': 8.777769398177078e-07, 'epoch': 2.18}

 14%|█▎        | 50620/371472 [4:02:25<24:40:20,  3.61it/s]
 14%|█▎        | 50621/371472 [4:02:25<23:38:18,  3.77it/s]
 14%|█▎        | 50622/371472 [4:02:26<23:29:54,  3.79it/s]
 14%|█▎        | 50623/371472 [4:02:26<25:19:04,  3.52it/s]
 14%|█▎        | 50624/371472 [4:02:26<26:14:47,  3.40it/s]
 14%|█▎        | 50625/371472 [4:02:26<24:47:38,  3.59it/s]
 14%|█▎        | 50626/371472 [4:02:27<24:49:09,  3.59it/s]
 14%|█▎        | 50627/371472 [4:02:27<26:29:05,  3.37it/s]
 14%|█▎        | 50628/371472 [4:02:27<25:10:51,  3.54it/s]
 14%|█▎        | 50629/371472 [4:02:28<26:06:29,  3.41it/s]
 14%|█▎        | 50630/371472 [4:02:28<25:09:29,  3.54it/s]
 14%|█▎        | 50631/371472 [4:02:28<25:37:45,  3.48it/s]
 14%|█▎        | 50632/371472 [4:02:28<25:06:04,  3.55it/s]
 14%|█▎        | 50633/371472 [4:02:29<24:22:44,  3.66it/s]
 14%|█▎        | 50634/371472 [4:02:29<25:10:42,  3.54it/s]
 14%|█▎        | 50635/371472 [4:02:29<25:14:59,  3.53it/s]
 14%|█▎        | 50636/371472 [4:02:30<24:54:43,  3.58it/s]
 14%|█▎        | 50637/371472 [4:02:30<24:39:05,  3.62it/s]
 14%|█▎        | 50638/371472 [4:02:30<24:15:20,  3.67it/s]
 14%|█▎        | 50639/371472 [4:02:30<23:14:43,  3.83it/s]
 14%|█▎        | 50640/371472 [4:02:31<23:20:15,  3.82it/s]
                                                           
{'loss': 4.1303, 'learning_rate': 8.777284578422289e-07, 'epoch': 2.18}

 14%|█▎        | 50640/371472 [4:02:31<23:20:15,  3.82it/s]
 14%|█▎        | 50641/371472 [4:02:31<26:05:12,  3.42it/s]
 14%|█▎        | 50642/371472 [4:02:31<25:56:34,  3.44it/s]
 14%|█▎        | 50643/371472 [4:02:32<27:34:11,  3.23it/s]
 14%|█▎        | 50644/371472 [4:02:32<27:03:30,  3.29it/s]
 14%|█▎        | 50645/371472 [4:02:32<25:49:22,  3.45it/s]
 14%|█▎        | 50646/371472 [4:02:32<24:39:22,  3.61it/s]
 14%|█▎        | 50647/371472 [4:02:33<24:13:54,  3.68it/s]
 14%|█▎        | 50648/371472 [4:02:33<25:35:10,  3.48it/s]
 14%|█▎        | 50649/371472 [4:02:33<24:52:58,  3.58it/s]
 14%|█▎        | 50650/371472 [4:02:33<25:04:40,  3.55it/s]
 14%|█▎        | 50651/371472 [4:02:34<24:40:10,  3.61it/s]
 14%|█▎        | 50652/371472 [4:02:34<25:10:05,  3.54it/s]
 14%|█▎        | 50653/371472 [4:02:34<24:26:56,  3.65it/s]
 14%|█▎        | 50654/371472 [4:02:35<24:18:13,  3.67it/s]
 14%|█▎        | 50655/371472 [4:02:35<25:19:56,  3.52it/s]
 14%|█▎        | 50656/371472 [4:02:35<24:57:32,  3.57it/s]
 14%|█▎        | 50657/371472 [4:02:35<26:01:33,  3.42it/s]
 14%|█▎        | 50658/371472 [4:02:36<25:36:37,  3.48it/s]
 14%|█▎        | 50659/371472 [4:02:36<24:32:10,  3.63it/s]
 14%|█▎        | 50660/371472 [4:02:36<23:44:33,  3.75it/s]
                                                           
{'loss': 4.2371, 'learning_rate': 8.776799758667499e-07, 'epoch': 2.18}

 14%|█▎        | 50660/371472 [4:02:36<23:44:33,  3.75it/s]
 14%|█▎        | 50661/371472 [4:02:37<25:54:03,  3.44it/s]
 14%|█▎        | 50662/371472 [4:02:37<25:27:21,  3.50it/s]
 14%|█▎        | 50663/371472 [4:02:37<24:46:37,  3.60it/s]
 14%|█▎        | 50664/371472 [4:02:37<24:37:42,  3.62it/s]
 14%|█▎        | 50665/371472 [4:02:38<25:02:29,  3.56it/s]
 14%|█▎        | 50666/371472 [4:02:38<24:45:18,  3.60it/s]
 14%|█▎        | 50667/371472 [4:02:38<24:55:11,  3.58it/s]
 14%|█▎        | 50668/371472 [4:02:39<24:17:19,  3.67it/s]
 14%|█▎        | 50669/371472 [4:02:39<24:14:23,  3.68it/s]
 14%|█▎        | 50670/371472 [4:02:39<25:19:44,  3.52it/s]
 14%|█▎        | 50671/371472 [4:02:39<25:47:40,  3.45it/s]
 14%|█▎        | 50672/371472 [4:02:40<24:18:23,  3.67it/s]
 14%|█▎        | 50673/371472 [4:02:40<23:47:07,  3.75it/s]
 14%|█▎        | 50674/371472 [4:02:40<24:02:43,  3.71it/s]
 14%|█▎        | 50675/371472 [4:02:40<24:50:08,  3.59it/s]
 14%|█▎        | 50676/371472 [4:02:41<24:35:08,  3.62it/s]
 14%|█▎        | 50677/371472 [4:02:41<24:37:12,  3.62it/s]
 14%|█▎        | 50678/371472 [4:02:41<24:08:41,  3.69it/s]
 14%|█▎        | 50679/371472 [4:02:42<23:25:28,  3.80it/s]
 14%|█▎        | 50680/371472 [4:02:42<23:32:10,  3.79it/s]
                                                           
{'loss': 4.2818, 'learning_rate': 8.77631493891271e-07, 'epoch': 2.18}

 14%|█▎        | 50680/371472 [4:02:42<23:32:10,  3.79it/s]
 14%|█▎        | 50681/371472 [4:02:42<23:05:56,  3.86it/s]
 14%|█▎        | 50682/371472 [4:02:42<22:56:12,  3.88it/s]
 14%|█▎        | 50683/371472 [4:02:43<23:07:58,  3.85it/s]
 14%|█▎        | 50684/371472 [4:02:43<23:16:35,  3.83it/s]
 14%|█▎        | 50685/371472 [4:02:43<22:55:07,  3.89it/s]
 14%|█▎        | 50686/371472 [4:02:43<23:25:11,  3.80it/s]
 14%|█▎        | 50687/371472 [4:02:44<24:18:16,  3.67it/s]
 14%|█▎        | 50688/371472 [4:02:44<24:07:56,  3.69it/s]
 14%|█▎        | 50689/371472 [4:02:44<23:53:34,  3.73it/s]
 14%|█▎        | 50690/371472 [4:02:44<24:55:26,  3.58it/s]
 14%|█▎        | 50691/371472 [4:02:45<24:07:18,  3.69it/s]
 14%|█▎        | 50692/371472 [4:02:45<23:13:40,  3.84it/s]
 14%|█▎        | 50693/371472 [4:02:45<23:06:24,  3.86it/s]
 14%|█▎        | 50694/371472 [4:02:45<23:32:49,  3.78it/s]
 14%|█▎        | 50695/371472 [4:02:46<24:09:02,  3.69it/s]
 14%|█▎        | 50696/371472 [4:02:46<23:57:48,  3.72it/s]
 14%|█▎        | 50697/371472 [4:02:46<24:29:39,  3.64it/s]
 14%|█▎        | 50698/371472 [4:02:47<24:02:54,  3.71it/s]
 14%|█▎        | 50699/371472 [4:02:47<25:48:06,  3.45it/s]
 14%|█▎        | 50700/371472 [4:02:47<24:26:35,  3.65it/s]
                                                           
{'loss': 4.5456, 'learning_rate': 8.775830119157922e-07, 'epoch': 2.18}

 14%|█▎        | 50700/371472 [4:02:47<24:26:35,  3.65it/s]
 14%|█▎        | 50701/371472 [4:02:47<23:32:23,  3.79it/s]
 14%|█▎        | 50702/371472 [4:02:48<24:21:56,  3.66it/s]
 14%|█▎        | 50703/371472 [4:02:48<24:22:23,  3.66it/s]
 14%|█▎        | 50704/371472 [4:02:48<24:28:11,  3.64it/s]
 14%|█▎        | 50705/371472 [4:02:49<25:26:59,  3.50it/s]
 14%|█▎        | 50706/371472 [4:02:49<25:37:04,  3.48it/s]
 14%|█▎        | 50707/371472 [4:02:49<24:46:12,  3.60it/s]
 14%|█▎        | 50708/371472 [4:02:49<24:53:55,  3.58it/s]
 14%|█▎        | 50709/371472 [4:02:50<24:07:40,  3.69it/s]
 14%|█▎        | 50710/371472 [4:02:50<24:23:02,  3.65it/s]
 14%|█▎        | 50711/371472 [4:02:50<25:37:40,  3.48it/s]
 14%|█▎        | 50712/371472 [4:02:51<25:09:52,  3.54it/s]
 14%|█▎        | 50713/371472 [4:02:51<25:25:43,  3.50it/s]
 14%|█▎        | 50714/371472 [4:02:51<24:14:06,  3.68it/s]
 14%|█▎        | 50715/371472 [4:02:51<24:55:58,  3.57it/s]
 14%|█▎        | 50716/371472 [4:02:52<26:45:39,  3.33it/s]
 14%|█▎        | 50717/371472 [4:02:52<29:17:27,  3.04it/s]
 14%|█▎        | 50718/371472 [4:02:52<27:25:49,  3.25it/s]
 14%|█▎        | 50719/371472 [4:02:53<27:01:19,  3.30it/s]
 14%|█▎        | 50720/371472 [4:02:53<25:21:20,  3.51it/s]
                                                           
{'loss': 4.3468, 'learning_rate': 8.775345299403133e-07, 'epoch': 2.18}

 14%|█▎        | 50720/371472 [4:02:53<25:21:20,  3.51it/s]
 14%|█▎        | 50721/371472 [4:02:53<26:45:24,  3.33it/s]
 14%|█▎        | 50722/371472 [4:02:53<25:26:25,  3.50it/s]
 14%|█▎        | 50723/371472 [4:02:54<25:50:04,  3.45it/s]
 14%|█▎        | 50724/371472 [4:02:54<29:32:20,  3.02it/s]
 14%|█▎        | 50725/371472 [4:02:54<28:12:28,  3.16it/s]
 14%|█▎        | 50726/371472 [4:02:55<26:07:03,  3.41it/s]
 14%|█▎        | 50727/371472 [4:02:55<26:13:48,  3.40it/s]
 14%|█▎        | 50728/371472 [4:02:55<25:45:32,  3.46it/s]
 14%|█▎        | 50729/371472 [4:02:56<25:33:53,  3.49it/s]
 14%|█▎        | 50730/371472 [4:02:56<25:23:49,  3.51it/s]
 14%|█▎        | 50731/371472 [4:02:56<25:31:36,  3.49it/s]
 14%|█▎        | 50732/371472 [4:02:56<26:02:39,  3.42it/s]
 14%|█▎        | 50733/371472 [4:02:57<27:03:29,  3.29it/s]
 14%|█▎        | 50734/371472 [4:02:57<25:59:23,  3.43it/s]
 14%|█▎        | 50735/371472 [4:02:57<24:37:33,  3.62it/s]
 14%|█▎        | 50736/371472 [4:02:58<24:42:19,  3.61it/s]
 14%|█▎        | 50737/371472 [4:02:58<23:21:16,  3.81it/s]
 14%|█▎        | 50738/371472 [4:02:58<23:33:38,  3.78it/s]
 14%|█▎        | 50739/371472 [4:02:58<23:42:00,  3.76it/s]
 14%|█▎        | 50740/371472 [4:02:59<23:27:25,  3.80it/s]
                                                           
{'loss': 4.2847, 'learning_rate': 8.774860479648344e-07, 'epoch': 2.19}

 14%|█▎        | 50740/371472 [4:02:59<23:27:25,  3.80it/s]
 14%|█▎        | 50741/371472 [4:02:59<23:28:18,  3.80it/s]
 14%|█▎        | 50742/371472 [4:02:59<23:37:24,  3.77it/s]
 14%|█▎        | 50743/371472 [4:02:59<23:07:40,  3.85it/s]
 14%|█▎        | 50744/371472 [4:03:00<25:33:37,  3.49it/s]
 14%|█▎        | 50745/371472 [4:03:00<24:50:23,  3.59it/s]
 14%|█▎        | 50746/371472 [4:03:00<24:25:33,  3.65it/s]
 14%|█▎        | 50747/371472 [4:03:01<26:13:03,  3.40it/s]
 14%|█▎        | 50748/371472 [4:03:01<25:45:01,  3.46it/s]
 14%|█▎        | 50749/371472 [4:03:01<26:13:46,  3.40it/s]
 14%|█▎        | 50750/371472 [4:03:01<25:18:23,  3.52it/s]
 14%|█▎        | 50751/371472 [4:03:02<25:01:21,  3.56it/s]
 14%|█▎        | 50752/371472 [4:03:02<26:10:05,  3.40it/s]
 14%|█▎        | 50753/371472 [4:03:02<25:43:54,  3.46it/s]
 14%|█▎        | 50754/371472 [4:03:03<25:39:04,  3.47it/s]
 14%|█▎        | 50755/371472 [4:03:03<25:42:27,  3.47it/s]
 14%|█▎        | 50756/371472 [4:03:03<25:14:46,  3.53it/s]
 14%|█▎        | 50757/371472 [4:03:03<25:48:03,  3.45it/s]
 14%|█▎        | 50758/371472 [4:03:04<25:24:39,  3.51it/s]
 14%|█▎        | 50759/371472 [4:03:04<24:47:10,  3.59it/s]
 14%|█▎        | 50760/371472 [4:03:04<26:10:06,  3.40it/s]
                                                           
{'loss': 4.203, 'learning_rate': 8.774375659893555e-07, 'epoch': 2.19}

 14%|█▎        | 50760/371472 [4:03:04<26:10:06,  3.40it/s]
 14%|█▎        | 50761/371472 [4:03:05<25:54:08,  3.44it/s]
 14%|█▎        | 50762/371472 [4:03:05<25:22:02,  3.51it/s]
 14%|█▎        | 50763/371472 [4:03:05<25:01:26,  3.56it/s]
 14%|█▎        | 50764/371472 [4:03:05<23:49:42,  3.74it/s]
 14%|█▎        | 50765/371472 [4:03:06<24:31:13,  3.63it/s]
 14%|█▎        | 50766/371472 [4:03:06<24:00:52,  3.71it/s]
 14%|█▎        | 50767/371472 [4:03:06<23:29:44,  3.79it/s]
 14%|█▎        | 50768/371472 [4:03:06<23:18:17,  3.82it/s]
 14%|█▎        | 50769/371472 [4:03:07<23:24:53,  3.80it/s]
 14%|█▎        | 50770/371472 [4:03:07<23:21:52,  3.81it/s]
 14%|█▎        | 50771/371472 [4:03:07<24:25:02,  3.65it/s]
 14%|█▎        | 50772/371472 [4:03:08<24:01:49,  3.71it/s]
 14%|█▎        | 50773/371472 [4:03:08<27:42:06,  3.22it/s]
 14%|█▎        | 50774/371472 [4:03:08<27:58:15,  3.18it/s]
 14%|█▎        | 50775/371472 [4:03:08<26:05:50,  3.41it/s]
 14%|█▎        | 50776/371472 [4:03:09<25:38:17,  3.47it/s]
 14%|█▎        | 50777/371472 [4:03:09<25:34:37,  3.48it/s]
 14%|█▎        | 50778/371472 [4:03:09<24:45:05,  3.60it/s]
 14%|█▎        | 50779/371472 [4:03:10<24:31:10,  3.63it/s]
 14%|█▎        | 50780/371472 [4:03:10<24:06:09,  3.70it/s]
                                                           
{'loss': 4.0493, 'learning_rate': 8.773890840138765e-07, 'epoch': 2.19}

 14%|█▎        | 50780/371472 [4:03:10<24:06:09,  3.70it/s]
 14%|█▎        | 50781/371472 [4:03:10<24:45:29,  3.60it/s]
 14%|█▎        | 50782/371472 [4:03:10<23:43:55,  3.75it/s]
 14%|█▎        | 50783/371472 [4:03:11<23:39:40,  3.76it/s]
 14%|█▎        | 50784/371472 [4:03:11<23:00:35,  3.87it/s]
 14%|█▎        | 50785/371472 [4:03:11<22:59:27,  3.87it/s]
 14%|█▎        | 50786/371472 [4:03:11<23:23:03,  3.81it/s]
 14%|█▎        | 50787/371472 [4:03:12<23:31:03,  3.79it/s]
 14%|█▎        | 50788/371472 [4:03:12<23:22:11,  3.81it/s]
 14%|█▎        | 50789/371472 [4:03:12<24:44:02,  3.60it/s]
 14%|█▎        | 50790/371472 [4:03:13<26:41:53,  3.34it/s]
 14%|█▎        | 50791/371472 [4:03:13<25:18:43,  3.52it/s]
 14%|█▎        | 50792/371472 [4:03:13<25:16:53,  3.52it/s]
 14%|█▎        | 50793/371472 [4:03:13<27:16:10,  3.27it/s]
 14%|█▎        | 50794/371472 [4:03:14<27:20:43,  3.26it/s]
 14%|█▎        | 50795/371472 [4:03:14<26:10:44,  3.40it/s]
 14%|█▎        | 50796/371472 [4:03:14<25:59:44,  3.43it/s]
 14%|█▎        | 50797/371472 [4:03:15<25:37:37,  3.48it/s]
 14%|█▎        | 50798/371472 [4:03:15<26:17:41,  3.39it/s]
 14%|█▎        | 50799/371472 [4:03:15<25:52:08,  3.44it/s]
 14%|█▎        | 50800/371472 [4:03:16<26:04:42,  3.42it/s]
                                                           
{'loss': 4.2606, 'learning_rate': 8.773406020383977e-07, 'epoch': 2.19}

 14%|█▎        | 50800/371472 [4:03:16<26:04:42,  3.42it/s]
 14%|█▎        | 50801/371472 [4:03:16<25:07:34,  3.55it/s]
 14%|█▎        | 50802/371472 [4:03:16<24:53:52,  3.58it/s]
 14%|█▎        | 50803/371472 [4:03:16<23:39:56,  3.76it/s]
 14%|█▎        | 50804/371472 [4:03:17<23:09:37,  3.85it/s]
 14%|█▎        | 50805/371472 [4:03:17<24:19:36,  3.66it/s]
 14%|█▎        | 50806/371472 [4:03:17<24:00:56,  3.71it/s]
 14%|█▎        | 50807/371472 [4:03:17<24:26:02,  3.65it/s]
 14%|█▎        | 50808/371472 [4:03:18<24:46:21,  3.60it/s]
 14%|█▎        | 50809/371472 [4:03:18<24:15:08,  3.67it/s]
 14%|█▎        | 50810/371472 [4:03:18<24:29:26,  3.64it/s]
 14%|█▎        | 50811/371472 [4:03:18<23:59:12,  3.71it/s]
 14%|█▎        | 50812/371472 [4:03:19<25:04:31,  3.55it/s]
 14%|█▎        | 50813/371472 [4:03:19<26:51:11,  3.32it/s]
 14%|█▎        | 50814/371472 [4:03:19<25:46:44,  3.46it/s]
 14%|█▎        | 50815/371472 [4:03:20<25:05:23,  3.55it/s]
 14%|█▎        | 50816/371472 [4:03:20<26:24:49,  3.37it/s]
 14%|█▎        | 50817/371472 [4:03:20<25:03:44,  3.55it/s]
 14%|█▎        | 50818/371472 [4:03:20<25:05:51,  3.55it/s]
 14%|█▎        | 50819/371472 [4:03:21<24:22:59,  3.65it/s]
 14%|█▎        | 50820/371472 [4:03:21<23:41:24,  3.76it/s]
                                                           
{'loss': 4.1683, 'learning_rate': 8.772921200629188e-07, 'epoch': 2.19}

 14%|█▎        | 50820/371472 [4:03:21<23:41:24,  3.76it/s]
 14%|█▎        | 50821/371472 [4:03:21<23:40:35,  3.76it/s]
 14%|█▎        | 50822/371472 [4:03:22<24:17:53,  3.67it/s]
 14%|█▎        | 50823/371472 [4:03:22<24:37:05,  3.62it/s]
 14%|█▎        | 50824/371472 [4:03:22<28:30:05,  3.13it/s]
 14%|█▎        | 50825/371472 [4:03:23<27:43:51,  3.21it/s]
 14%|█▎        | 50826/371472 [4:03:23<28:35:24,  3.12it/s]
 14%|█▎        | 50827/371472 [4:03:23<29:51:08,  2.98it/s]
 14%|█▎        | 50828/371472 [4:03:24<28:56:25,  3.08it/s]
 14%|█▎        | 50829/371472 [4:03:24<29:04:33,  3.06it/s]
 14%|█▎        | 50830/371472 [4:03:24<27:27:18,  3.24it/s]
 14%|█▎        | 50831/371472 [4:03:24<25:39:23,  3.47it/s]
 14%|█▎        | 50832/371472 [4:03:25<25:16:43,  3.52it/s]
 14%|█▎        | 50833/371472 [4:03:25<26:02:56,  3.42it/s]
 14%|█▎        | 50834/371472 [4:03:25<24:23:38,  3.65it/s]
 14%|█▎        | 50835/371472 [4:03:25<24:00:42,  3.71it/s]
 14%|█▎        | 50836/371472 [4:03:26<23:55:10,  3.72it/s]
 14%|█▎        | 50837/371472 [4:03:26<23:23:39,  3.81it/s]
 14%|█▎        | 50838/371472 [4:03:26<22:40:42,  3.93it/s]
 14%|█▎        | 50839/371472 [4:03:26<22:09:22,  4.02it/s]
 14%|█▎        | 50840/371472 [4:03:27<23:14:36,  3.83it/s]
                                                           
{'loss': 4.3027, 'learning_rate': 8.772436380874399e-07, 'epoch': 2.19}

 14%|█▎        | 50840/371472 [4:03:27<23:14:36,  3.83it/s]
 14%|█▎        | 50841/371472 [4:03:27<22:52:19,  3.89it/s]
 14%|█▎        | 50842/371472 [4:03:27<23:43:49,  3.75it/s]
 14%|█▎        | 50843/371472 [4:03:28<24:11:06,  3.68it/s]
 14%|█▎        | 50844/371472 [4:03:28<25:45:22,  3.46it/s]
 14%|█▎        | 50845/371472 [4:03:28<26:52:00,  3.31it/s]
 14%|█▎        | 50846/371472 [4:03:29<27:51:48,  3.20it/s]
 14%|█▎        | 50847/371472 [4:03:29<25:55:05,  3.44it/s]
 14%|█▎        | 50848/371472 [4:03:29<24:48:05,  3.59it/s]
 14%|█▎        | 50849/371472 [4:03:29<23:56:20,  3.72it/s]
 14%|█▎        | 50850/371472 [4:03:30<25:39:20,  3.47it/s]
 14%|█▎        | 50851/371472 [4:03:30<26:07:49,  3.41it/s]
 14%|█▎        | 50852/371472 [4:03:30<27:02:26,  3.29it/s]
 14%|█▎        | 50853/371472 [4:03:31<26:33:55,  3.35it/s]
 14%|█▎        | 50854/371472 [4:03:31<25:21:20,  3.51it/s]
 14%|█▎        | 50855/371472 [4:03:31<24:19:34,  3.66it/s]
 14%|█▎        | 50856/371472 [4:03:31<23:49:41,  3.74it/s]
 14%|█▎        | 50857/371472 [4:03:32<24:18:12,  3.66it/s]
 14%|█▎        | 50858/371472 [4:03:32<24:03:43,  3.70it/s]
 14%|█▎        | 50859/371472 [4:03:32<23:23:09,  3.81it/s]
 14%|█▎        | 50860/371472 [4:03:32<23:42:08,  3.76it/s]
                                                           
{'loss': 4.2621, 'learning_rate': 8.77195156111961e-07, 'epoch': 2.19}

 14%|█▎        | 50860/371472 [4:03:32<23:42:08,  3.76it/s]
 14%|█▎        | 50861/371472 [4:03:33<24:19:50,  3.66it/s]
 14%|█▎        | 50862/371472 [4:03:33<24:48:58,  3.59it/s]
 14%|█▎        | 50863/371472 [4:03:33<25:09:18,  3.54it/s]
 14%|█▎        | 50864/371472 [4:03:34<24:56:01,  3.57it/s]
 14%|█▎        | 50865/371472 [4:03:34<26:02:30,  3.42it/s]
 14%|█▎        | 50866/371472 [4:03:34<25:44:08,  3.46it/s]
 14%|█▎        | 50867/371472 [4:03:34<24:48:13,  3.59it/s]
 14%|█▎        | 50868/371472 [4:03:35<23:51:25,  3.73it/s]
 14%|█▎        | 50869/371472 [4:03:35<23:41:52,  3.76it/s]
 14%|█▎        | 50870/371472 [4:03:35<24:42:24,  3.60it/s]
 14%|█▎        | 50871/371472 [4:03:35<24:18:18,  3.66it/s]
 14%|█▎        | 50872/371472 [4:03:36<25:08:37,  3.54it/s]
 14%|█▎        | 50873/371472 [4:03:36<24:49:48,  3.59it/s]
 14%|█▎        | 50874/371472 [4:03:36<24:31:48,  3.63it/s]
 14%|█▎        | 50875/371472 [4:03:37<24:26:10,  3.64it/s]
 14%|█▎        | 50876/371472 [4:03:37<24:39:48,  3.61it/s]
 14%|█▎        | 50877/371472 [4:03:37<24:05:51,  3.70it/s]
 14%|█▎        | 50878/371472 [4:03:37<23:52:19,  3.73it/s]
 14%|█▎        | 50879/371472 [4:03:38<24:27:22,  3.64it/s]
 14%|█▎        | 50880/371472 [4:03:38<24:40:00,  3.61it/s]
                                                           
{'loss': 4.4363, 'learning_rate': 8.771466741364821e-07, 'epoch': 2.19}

 14%|█▎        | 50880/371472 [4:03:38<24:40:00,  3.61it/s]
 14%|█▎        | 50881/371472 [4:03:38<25:55:16,  3.44it/s]
 14%|█▎        | 50882/371472 [4:03:39<25:08:56,  3.54it/s]
 14%|█▎        | 50883/371472 [4:03:39<24:10:32,  3.68it/s]
 14%|█▎        | 50884/371472 [4:03:39<29:32:26,  3.01it/s]
 14%|█▎        | 50885/371472 [4:03:40<29:14:26,  3.05it/s]
 14%|█▎        | 50886/371472 [4:03:40<27:17:33,  3.26it/s]
 14%|█▎        | 50887/371472 [4:03:40<28:00:23,  3.18it/s]
 14%|█▎        | 50888/371472 [4:03:40<27:56:42,  3.19it/s]
 14%|█▎        | 50889/371472 [4:03:41<26:51:21,  3.32it/s]
 14%|█▎        | 50890/371472 [4:03:41<25:25:49,  3.50it/s]
 14%|█▎        | 50891/371472 [4:03:41<25:43:02,  3.46it/s]
 14%|█▎        | 50892/371472 [4:03:42<24:55:25,  3.57it/s]
 14%|█▎        | 50893/371472 [4:03:42<24:14:56,  3.67it/s]
 14%|█▎        | 50894/371472 [4:03:42<24:10:11,  3.68it/s]
 14%|█▎        | 50895/371472 [4:03:42<24:59:30,  3.56it/s]
 14%|█▎        | 50896/371472 [4:03:43<24:57:37,  3.57it/s]
 14%|█▎        | 50897/371472 [4:03:43<24:57:47,  3.57it/s]
 14%|█▎        | 50898/371472 [4:03:43<25:25:07,  3.50it/s]
 14%|█▎        | 50899/371472 [4:03:43<24:31:43,  3.63it/s]
 14%|█▎        | 50900/371472 [4:03:44<23:33:43,  3.78it/s]
                                                           
{'loss': 4.4562, 'learning_rate': 8.770981921610032e-07, 'epoch': 2.19}

 14%|█▎        | 50900/371472 [4:03:44<23:33:43,  3.78it/s]
 14%|█▎        | 50901/371472 [4:03:44<23:29:12,  3.79it/s]
 14%|█▎        | 50902/371472 [4:03:44<24:00:53,  3.71it/s]
 14%|█▎        | 50903/371472 [4:03:45<23:46:11,  3.75it/s]
 14%|█▎        | 50904/371472 [4:03:45<23:27:56,  3.79it/s]
 14%|█▎        | 50905/371472 [4:03:45<23:13:01,  3.84it/s]
 14%|█▎        | 50906/371472 [4:03:45<23:36:52,  3.77it/s]
 14%|█▎        | 50907/371472 [4:03:46<24:34:25,  3.62it/s]
 14%|█▎        | 50908/371472 [4:03:46<23:39:49,  3.76it/s]
 14%|█▎        | 50909/371472 [4:03:46<23:19:33,  3.82it/s]
 14%|█▎        | 50910/371472 [4:03:46<22:50:11,  3.90it/s]
 14%|█▎        | 50911/371472 [4:03:47<22:49:48,  3.90it/s]
 14%|█▎        | 50912/371472 [4:03:47<23:58:28,  3.71it/s]
 14%|█▎        | 50913/371472 [4:03:47<23:09:23,  3.85it/s]
 14%|█▎        | 50914/371472 [4:03:47<23:02:31,  3.86it/s]
 14%|█▎        | 50915/371472 [4:03:48<23:48:37,  3.74it/s]
 14%|█▎        | 50916/371472 [4:03:48<23:09:38,  3.84it/s]
 14%|█▎        | 50917/371472 [4:03:48<24:13:11,  3.68it/s]
 14%|█▎        | 50918/371472 [4:03:48<23:57:17,  3.72it/s]
 14%|█▎        | 50919/371472 [4:03:49<24:59:12,  3.56it/s]
 14%|█▎        | 50920/371472 [4:03:49<25:08:04,  3.54it/s]
                                                           
{'loss': 4.2564, 'learning_rate': 8.770497101855243e-07, 'epoch': 2.19}

 14%|█▎        | 50920/371472 [4:03:49<25:08:04,  3.54it/s]
 14%|█▎        | 50921/371472 [4:03:49<25:26:10,  3.50it/s]
 14%|█▎        | 50922/371472 [4:03:50<26:32:11,  3.36it/s]
 14%|█▎        | 50923/371472 [4:03:50<25:38:52,  3.47it/s]
 14%|█▎        | 50924/371472 [4:03:50<24:47:59,  3.59it/s]
 14%|█▎        | 50925/371472 [4:03:50<23:36:41,  3.77it/s]
 14%|█▎        | 50926/371472 [4:03:51<23:08:04,  3.85it/s]
 14%|█▎        | 50927/371472 [4:03:51<22:49:31,  3.90it/s]
 14%|█▎        | 50928/371472 [4:03:51<24:16:45,  3.67it/s]
 14%|█▎        | 50929/371472 [4:03:52<25:48:23,  3.45it/s]
 14%|█▎        | 50930/371472 [4:03:52<25:18:40,  3.52it/s]
 14%|█▎        | 50931/371472 [4:03:52<25:09:50,  3.54it/s]
 14%|█▎        | 50932/371472 [4:03:52<24:41:57,  3.60it/s]
 14%|█▎        | 50933/371472 [4:03:53<24:53:36,  3.58it/s]
 14%|█▎        | 50934/371472 [4:03:53<24:41:21,  3.61it/s]
 14%|█▎        | 50935/371472 [4:03:53<23:54:36,  3.72it/s]
 14%|█▎        | 50936/371472 [4:03:54<24:16:56,  3.67it/s]
 14%|█▎        | 50937/371472 [4:03:54<24:34:56,  3.62it/s]
 14%|█▎        | 50938/371472 [4:03:54<25:28:36,  3.49it/s]
 14%|█▎        | 50939/371472 [4:03:54<24:49:17,  3.59it/s]
 14%|█▎        | 50940/371472 [4:03:55<24:14:20,  3.67it/s]
                                                           
{'loss': 4.2429, 'learning_rate': 8.770012282100454e-07, 'epoch': 2.19}

 14%|█▎        | 50940/371472 [4:03:55<24:14:20,  3.67it/s]
 14%|█▎        | 50941/371472 [4:03:55<24:33:30,  3.63it/s]
 14%|█▎        | 50942/371472 [4:03:55<24:02:57,  3.70it/s]
 14%|█▎        | 50943/371472 [4:03:55<25:15:16,  3.53it/s]
 14%|█▎        | 50944/371472 [4:03:56<24:30:28,  3.63it/s]
 14%|█▎        | 50945/371472 [4:03:56<24:09:29,  3.69it/s]
 14%|█▎        | 50946/371472 [4:03:56<25:51:57,  3.44it/s]
 14%|█▎        | 50947/371472 [4:03:57<25:21:22,  3.51it/s]
 14%|█▎        | 50948/371472 [4:03:57<24:54:51,  3.57it/s]
 14%|█▎        | 50949/371472 [4:03:57<24:06:39,  3.69it/s]
 14%|█▎        | 50950/371472 [4:03:57<24:50:48,  3.58it/s]
 14%|█▎        | 50951/371472 [4:03:58<23:52:53,  3.73it/s]
 14%|█▎        | 50952/371472 [4:03:58<23:42:22,  3.76it/s]
 14%|█▎        | 50953/371472 [4:03:58<24:41:53,  3.60it/s]
 14%|█▎        | 50954/371472 [4:03:58<24:31:49,  3.63it/s]
 14%|█▎        | 50955/371472 [4:03:59<25:14:31,  3.53it/s]
 14%|█▎        | 50956/371472 [4:03:59<25:39:10,  3.47it/s]
 14%|█▎        | 50957/371472 [4:03:59<26:19:37,  3.38it/s]
 14%|█▎        | 50958/371472 [4:04:00<27:25:31,  3.25it/s]
 14%|█▎        | 50959/371472 [4:04:00<27:06:22,  3.28it/s]
 14%|█▎        | 50960/371472 [4:04:00<26:47:06,  3.32it/s]
                                                           
{'loss': 4.3255, 'learning_rate': 8.769527462345665e-07, 'epoch': 2.19}

 14%|█▎        | 50960/371472 [4:04:00<26:47:06,  3.32it/s]
 14%|█▎        | 50961/371472 [4:04:01<28:46:50,  3.09it/s]
 14%|█▎        | 50962/371472 [4:04:01<27:39:35,  3.22it/s]
 14%|█▎        | 50963/371472 [4:04:01<26:15:35,  3.39it/s]
 14%|█▎        | 50964/371472 [4:04:01<25:08:46,  3.54it/s]
 14%|█▎        | 50965/371472 [4:04:02<26:09:41,  3.40it/s]
 14%|█▎        | 50966/371472 [4:04:02<25:12:59,  3.53it/s]
 14%|█▎        | 50967/371472 [4:04:02<24:28:49,  3.64it/s]
 14%|█▎        | 50968/371472 [4:04:03<23:54:54,  3.72it/s]
 14%|█▎        | 50969/371472 [4:04:03<25:22:10,  3.51it/s]
 14%|█▎        | 50970/371472 [4:04:03<25:00:54,  3.56it/s]
 14%|█▎        | 50971/371472 [4:04:03<24:46:26,  3.59it/s]
 14%|█▎        | 50972/371472 [4:04:04<24:53:36,  3.58it/s]
 14%|█▎        | 50973/371472 [4:04:04<27:05:17,  3.29it/s]
 14%|█▎        | 50974/371472 [4:04:04<29:01:55,  3.07it/s]
 14%|█▎        | 50975/371472 [4:04:05<27:48:26,  3.20it/s]
 14%|█▎        | 50976/371472 [4:04:05<27:13:09,  3.27it/s]
 14%|█▎        | 50977/371472 [4:04:05<26:48:16,  3.32it/s]
 14%|█▎        | 50978/371472 [4:04:06<25:20:17,  3.51it/s]
 14%|█▎        | 50979/371472 [4:04:06<24:53:10,  3.58it/s]
 14%|█▎        | 50980/371472 [4:04:06<25:08:32,  3.54it/s]
                                                           
{'loss': 4.2201, 'learning_rate': 8.769042642590876e-07, 'epoch': 2.2}

 14%|█▎        | 50980/371472 [4:04:06<25:08:32,  3.54it/s]
 14%|█▎        | 50981/371472 [4:04:06<25:44:52,  3.46it/s]
 14%|█▎        | 50982/371472 [4:04:07<25:13:00,  3.53it/s]
 14%|█▎        | 50983/371472 [4:04:07<24:53:15,  3.58it/s]
 14%|█▎        | 50984/371472 [4:04:07<24:03:16,  3.70it/s]
 14%|█▎        | 50985/371472 [4:04:08<24:15:41,  3.67it/s]
 14%|█▎        | 50986/371472 [4:04:08<24:10:38,  3.68it/s]
 14%|█▎        | 50987/371472 [4:04:08<27:06:34,  3.28it/s]
 14%|█▎        | 50988/371472 [4:04:09<28:20:31,  3.14it/s]
 14%|█▎        | 50989/371472 [4:04:09<27:22:22,  3.25it/s]
 14%|█▎        | 50990/371472 [4:04:09<27:22:10,  3.25it/s]
 14%|█▎        | 50991/371472 [4:04:09<27:41:07,  3.22it/s]
 14%|█▎        | 50992/371472 [4:04:10<27:36:28,  3.22it/s]
 14%|█▎        | 50993/371472 [4:04:10<28:18:23,  3.14it/s]
 14%|█▎        | 50994/371472 [4:04:10<27:09:17,  3.28it/s]
 14%|█▎        | 50995/371472 [4:04:11<26:44:25,  3.33it/s]
 14%|█▎        | 50996/371472 [4:04:11<26:06:18,  3.41it/s]
 14%|█▎        | 50997/371472 [4:04:11<25:33:11,  3.48it/s]
 14%|█▎        | 50998/371472 [4:04:11<24:38:53,  3.61it/s]
 14%|█▎        | 50999/371472 [4:04:12<24:22:21,  3.65it/s]
 14%|█▎        | 51000/371472 [4:04:12<23:25:27,  3.80it/s]
                                                           
{'loss': 4.3356, 'learning_rate': 8.768557822836088e-07, 'epoch': 2.2}

 14%|█▎        | 51000/371472 [4:04:12<23:25:27,  3.80it/s]
 14%|█▎        | 51001/371472 [4:04:12<22:50:09,  3.90it/s]
 14%|█▎        | 51002/371472 [4:04:12<22:28:10,  3.96it/s]
 14%|█▎        | 51003/371472 [4:04:13<23:46:38,  3.74it/s]
 14%|█▎        | 51004/371472 [4:04:13<22:59:45,  3.87it/s]
 14%|█▎        | 51005/371472 [4:04:13<22:44:06,  3.92it/s]
 14%|█▎        | 51006/371472 [4:04:13<22:37:16,  3.94it/s]
 14%|█▎        | 51007/371472 [4:04:14<22:52:35,  3.89it/s]
 14%|█▎        | 51008/371472 [4:04:14<23:10:18,  3.84it/s]
 14%|█▎        | 51009/371472 [4:04:14<23:17:45,  3.82it/s]
 14%|█▎        | 51010/371472 [4:04:15<23:47:29,  3.74it/s]
 14%|█▎        | 51011/371472 [4:04:15<23:55:06,  3.72it/s]
 14%|█▎        | 51012/371472 [4:04:15<25:11:38,  3.53it/s]
 14%|█▎        | 51013/371472 [4:04:16<28:17:57,  3.15it/s]
 14%|█▎        | 51014/371472 [4:04:16<28:37:28,  3.11it/s]
 14%|█▎        | 51015/371472 [4:04:16<27:46:16,  3.21it/s]
 14%|█▎        | 51016/371472 [4:04:16<26:49:46,  3.32it/s]
 14%|█▎        | 51017/371472 [4:04:17<25:44:07,  3.46it/s]
 14%|█▎        | 51018/371472 [4:04:17<24:14:49,  3.67it/s]
 14%|█▎        | 51019/371472 [4:04:17<24:06:01,  3.69it/s]
 14%|█▎        | 51020/371472 [4:04:17<23:28:31,  3.79it/s]
                                                           
{'loss': 4.019, 'learning_rate': 8.768073003081299e-07, 'epoch': 2.2}

 14%|█▎        | 51020/371472 [4:04:17<23:28:31,  3.79it/s]
 14%|█▎        | 51021/371472 [4:04:18<23:48:01,  3.74it/s]
 14%|█▎        | 51022/371472 [4:04:18<23:44:56,  3.75it/s]
 14%|█▎        | 51023/371472 [4:04:18<24:14:41,  3.67it/s]
 14%|█▎        | 51024/371472 [4:04:19<25:18:28,  3.52it/s]
 14%|█▎        | 51025/371472 [4:04:19<24:49:08,  3.59it/s]
 14%|█▎        | 51026/371472 [4:04:19<24:10:13,  3.68it/s]
 14%|█▎        | 51027/371472 [4:04:19<23:55:09,  3.72it/s]
 14%|█▎        | 51028/371472 [4:04:20<25:07:37,  3.54it/s]
 14%|█▎        | 51029/371472 [4:04:20<25:21:53,  3.51it/s]
 14%|█▎        | 51030/371472 [4:04:20<25:21:41,  3.51it/s]
 14%|█▎        | 51031/371472 [4:04:21<24:51:35,  3.58it/s]
 14%|█▎        | 51032/371472 [4:04:21<24:13:02,  3.68it/s]
 14%|█▎        | 51033/371472 [4:04:21<26:10:19,  3.40it/s]
 14%|█▎        | 51034/371472 [4:04:21<26:06:41,  3.41it/s]
 14%|█▎        | 51035/371472 [4:04:22<25:00:21,  3.56it/s]
 14%|█▎        | 51036/371472 [4:04:22<25:45:19,  3.46it/s]
 14%|█▎        | 51037/371472 [4:04:22<26:50:23,  3.32it/s]
 14%|█▎        | 51038/371472 [4:04:23<25:14:22,  3.53it/s]
 14%|█▎        | 51039/371472 [4:04:23<23:58:58,  3.71it/s]
 14%|█▎        | 51040/371472 [4:04:23<23:48:10,  3.74it/s]
                                                           
{'loss': 4.3707, 'learning_rate': 8.767588183326509e-07, 'epoch': 2.2}

 14%|█▎        | 51040/371472 [4:04:23<23:48:10,  3.74it/s]
 14%|█▎        | 51041/371472 [4:04:23<24:03:02,  3.70it/s]
 14%|█▎        | 51042/371472 [4:04:24<23:32:33,  3.78it/s]
 14%|█▎        | 51043/371472 [4:04:24<24:13:43,  3.67it/s]
 14%|█▎        | 51044/371472 [4:04:24<25:05:42,  3.55it/s]
 14%|█▎        | 51045/371472 [4:04:24<24:32:57,  3.63it/s]
 14%|█▎        | 51046/371472 [4:04:25<23:37:33,  3.77it/s]
 14%|█▎        | 51047/371472 [4:04:25<24:06:37,  3.69it/s]
 14%|█▎        | 51048/371472 [4:04:25<23:33:43,  3.78it/s]
 14%|█▎        | 51049/371472 [4:04:25<23:32:08,  3.78it/s]
 14%|█▎        | 51050/371472 [4:04:26<23:06:17,  3.85it/s]
 14%|█▎        | 51051/371472 [4:04:26<24:50:53,  3.58it/s]
 14%|█▎        | 51052/371472 [4:04:26<24:41:45,  3.60it/s]
 14%|█▎        | 51053/371472 [4:04:27<24:07:31,  3.69it/s]
 14%|█▎        | 51054/371472 [4:04:27<23:36:16,  3.77it/s]
 14%|█▎        | 51055/371472 [4:04:27<23:52:59,  3.73it/s]
 14%|█▎        | 51056/371472 [4:04:27<24:06:41,  3.69it/s]
 14%|█▎        | 51057/371472 [4:04:28<23:14:17,  3.83it/s]
 14%|█▎        | 51058/371472 [4:04:28<24:25:14,  3.64it/s]
 14%|█▎        | 51059/371472 [4:04:28<26:00:30,  3.42it/s]
 14%|█▎        | 51060/371472 [4:04:29<26:26:53,  3.37it/s]
                                                           
{'loss': 4.2873, 'learning_rate': 8.76710336357172e-07, 'epoch': 2.2}

 14%|█▎        | 51060/371472 [4:04:29<26:26:53,  3.37it/s]
 14%|█▎        | 51061/371472 [4:04:29<25:59:51,  3.42it/s]
 14%|█▎        | 51062/371472 [4:04:29<24:48:42,  3.59it/s]
 14%|█▎        | 51063/371472 [4:04:29<24:20:01,  3.66it/s]
 14%|█▎        | 51064/371472 [4:04:30<24:13:18,  3.67it/s]
 14%|█▎        | 51065/371472 [4:04:30<25:48:46,  3.45it/s]
 14%|█▎        | 51066/371472 [4:04:30<25:21:56,  3.51it/s]
 14%|█▎        | 51067/371472 [4:04:31<25:44:29,  3.46it/s]
 14%|█▎        | 51068/371472 [4:04:31<25:10:52,  3.53it/s]
 14%|█▎        | 51069/371472 [4:04:31<24:23:52,  3.65it/s]
 14%|█▎        | 51070/371472 [4:04:31<24:05:13,  3.69it/s]
 14%|█▎        | 51071/371472 [4:04:32<24:07:34,  3.69it/s]
 14%|█▎        | 51072/371472 [4:04:32<23:24:27,  3.80it/s]
 14%|█▎        | 51073/371472 [4:04:32<23:56:27,  3.72it/s]
 14%|█▎        | 51074/371472 [4:04:32<23:45:59,  3.74it/s]
 14%|█▎        | 51075/371472 [4:04:33<24:13:09,  3.67it/s]
 14%|█▎        | 51076/371472 [4:04:33<24:16:20,  3.67it/s]
 14%|█▎        | 51077/371472 [4:04:33<24:04:11,  3.70it/s]
 14%|█▍        | 51078/371472 [4:04:33<23:19:49,  3.81it/s]
 14%|█▍        | 51079/371472 [4:04:34<24:34:44,  3.62it/s]
 14%|█▍        | 51080/371472 [4:04:34<24:38:27,  3.61it/s]
                                                           
{'loss': 4.4412, 'learning_rate': 8.766618543816932e-07, 'epoch': 2.2}

 14%|█▍        | 51080/371472 [4:04:34<24:38:27,  3.61it/s]
 14%|█▍        | 51081/371472 [4:04:34<24:32:09,  3.63it/s]
 14%|█▍        | 51082/371472 [4:04:35<24:11:50,  3.68it/s]
 14%|█▍        | 51083/371472 [4:04:35<24:24:15,  3.65it/s]
 14%|█▍        | 51084/371472 [4:04:35<24:08:14,  3.69it/s]
 14%|█▍        | 51085/371472 [4:04:35<24:55:36,  3.57it/s]
 14%|█▍        | 51086/371472 [4:04:36<27:15:15,  3.27it/s]
 14%|█▍        | 51087/371472 [4:04:36<25:32:51,  3.48it/s]
 14%|█▍        | 51088/371472 [4:04:36<24:13:11,  3.67it/s]
 14%|█▍        | 51089/371472 [4:04:37<24:17:30,  3.66it/s]
 14%|█▍        | 51090/371472 [4:04:37<23:38:27,  3.76it/s]
 14%|█▍        | 51091/371472 [4:04:37<23:42:01,  3.75it/s]
 14%|█▍        | 51092/371472 [4:04:37<23:03:00,  3.86it/s]
 14%|█▍        | 51093/371472 [4:04:38<23:22:12,  3.81it/s]
 14%|█▍        | 51094/371472 [4:04:38<24:31:51,  3.63it/s]
 14%|█▍        | 51095/371472 [4:04:38<24:41:07,  3.61it/s]
 14%|█▍        | 51096/371472 [4:04:38<25:25:57,  3.50it/s]
 14%|█▍        | 51097/371472 [4:04:39<24:41:36,  3.60it/s]
 14%|█▍        | 51098/371472 [4:04:39<24:11:47,  3.68it/s]
 14%|█▍        | 51099/371472 [4:04:39<24:26:16,  3.64it/s]
 14%|█▍        | 51100/371472 [4:04:40<25:58:14,  3.43it/s]
                                                           
{'loss': 4.2582, 'learning_rate': 8.766133724062143e-07, 'epoch': 2.2}

 14%|█▍        | 51100/371472 [4:04:40<25:58:14,  3.43it/s]
 14%|█▍        | 51101/371472 [4:04:40<27:22:43,  3.25it/s]
 14%|█▍        | 51102/371472 [4:04:40<27:33:24,  3.23it/s]
 14%|█▍        | 51103/371472 [4:04:40<25:52:43,  3.44it/s]
 14%|█▍        | 51104/371472 [4:04:41<25:44:37,  3.46it/s]
 14%|█▍        | 51105/371472 [4:04:41<24:52:00,  3.58it/s]
 14%|█▍        | 51106/371472 [4:04:41<24:42:55,  3.60it/s]
 14%|█▍        | 51107/371472 [4:04:42<25:41:31,  3.46it/s]
 14%|█▍        | 51108/371472 [4:04:42<27:35:26,  3.23it/s]
 14%|█▍        | 51109/371472 [4:04:42<27:41:50,  3.21it/s]
 14%|█▍        | 51110/371472 [4:04:43<26:33:03,  3.35it/s]
 14%|█▍        | 51111/371472 [4:04:43<24:54:24,  3.57it/s]
 14%|█▍        | 51112/371472 [4:04:43<23:45:11,  3.75it/s]
 14%|█▍        | 51113/371472 [4:04:43<23:19:06,  3.82it/s]
 14%|█▍        | 51114/371472 [4:04:44<23:51:34,  3.73it/s]
 14%|█▍        | 51115/371472 [4:04:44<24:09:25,  3.68it/s]
 14%|█▍        | 51116/371472 [4:04:44<23:47:55,  3.74it/s]
 14%|█▍        | 51117/371472 [4:04:44<23:49:09,  3.74it/s]
 14%|█▍        | 51118/371472 [4:04:45<23:12:56,  3.83it/s]
 14%|█▍        | 51119/371472 [4:04:45<25:26:44,  3.50it/s]
 14%|█▍        | 51120/371472 [4:04:45<24:26:54,  3.64it/s]
                                                           
{'loss': 4.1803, 'learning_rate': 8.765648904307354e-07, 'epoch': 2.2}

 14%|█▍        | 51120/371472 [4:04:45<24:26:54,  3.64it/s]
 14%|█▍        | 51121/371472 [4:04:46<25:29:54,  3.49it/s]
 14%|█▍        | 51122/371472 [4:04:46<24:52:25,  3.58it/s]
 14%|█▍        | 51123/371472 [4:04:46<25:37:00,  3.47it/s]
 14%|█▍        | 51124/371472 [4:04:46<26:58:43,  3.30it/s]
 14%|█▍        | 51125/371472 [4:04:47<26:45:57,  3.32it/s]
 14%|█▍        | 51126/371472 [4:04:47<26:11:13,  3.40it/s]
 14%|█▍        | 51127/371472 [4:04:47<25:00:50,  3.56it/s]
 14%|█▍        | 51128/371472 [4:04:48<24:44:46,  3.60it/s]
 14%|█▍        | 51129/371472 [4:04:48<24:27:24,  3.64it/s]
 14%|█▍        | 51130/371472 [4:04:48<24:56:03,  3.57it/s]
 14%|█▍        | 51131/371472 [4:04:48<25:15:09,  3.52it/s]
 14%|█▍        | 51132/371472 [4:04:49<24:11:00,  3.68it/s]
 14%|█▍        | 51133/371472 [4:04:49<24:08:12,  3.69it/s]
 14%|█▍        | 51134/371472 [4:04:49<23:50:19,  3.73it/s]
 14%|█▍        | 51135/371472 [4:04:49<24:48:13,  3.59it/s]
 14%|█▍        | 51136/371472 [4:04:50<24:03:51,  3.70it/s]
 14%|█▍        | 51137/371472 [4:04:50<24:35:42,  3.62it/s]
 14%|█▍        | 51138/371472 [4:04:50<25:02:42,  3.55it/s]
 14%|█▍        | 51139/371472 [4:04:51<25:04:56,  3.55it/s]
 14%|█▍        | 51140/371472 [4:04:51<24:27:43,  3.64it/s]
                                                           
{'loss': 4.3579, 'learning_rate': 8.765164084552565e-07, 'epoch': 2.2}

 14%|█▍        | 51140/371472 [4:04:51<24:27:43,  3.64it/s]
 14%|█▍        | 51141/371472 [4:04:51<23:37:49,  3.77it/s]
 14%|█▍        | 51142/371472 [4:04:51<25:55:06,  3.43it/s]
 14%|█▍        | 51143/371472 [4:04:52<25:28:12,  3.49it/s]
 14%|█▍        | 51144/371472 [4:04:52<24:41:00,  3.60it/s]
 14%|█▍        | 51145/371472 [4:04:52<23:50:57,  3.73it/s]
 14%|█▍        | 51146/371472 [4:04:52<23:18:48,  3.82it/s]
 14%|█▍        | 51147/371472 [4:04:53<23:31:19,  3.78it/s]
 14%|█▍        | 51148/371472 [4:04:53<23:16:46,  3.82it/s]
 14%|█▍        | 51149/371472 [4:04:53<22:51:44,  3.89it/s]
 14%|█▍        | 51150/371472 [4:04:53<22:26:55,  3.96it/s]
 14%|█▍        | 51151/371472 [4:04:54<22:40:14,  3.92it/s]
 14%|█▍        | 51152/371472 [4:04:54<23:17:48,  3.82it/s]
 14%|█▍        | 51153/371472 [4:04:54<23:52:59,  3.73it/s]
 14%|█▍        | 51154/371472 [4:04:55<23:43:15,  3.75it/s]
 14%|█▍        | 51155/371472 [4:04:55<23:05:39,  3.85it/s]
 14%|█▍        | 51156/371472 [4:04:55<23:54:25,  3.72it/s]
 14%|█▍        | 51157/371472 [4:04:55<23:53:06,  3.73it/s]
 14%|█▍        | 51158/371472 [4:04:56<23:55:58,  3.72it/s]
 14%|█▍        | 51159/371472 [4:04:56<24:52:41,  3.58it/s]
 14%|█▍        | 51160/371472 [4:04:56<27:33:48,  3.23it/s]
                                                           
{'loss': 4.3487, 'learning_rate': 8.764679264797775e-07, 'epoch': 2.2}

 14%|█▍        | 51160/371472 [4:04:56<27:33:48,  3.23it/s]
 14%|█▍        | 51161/371472 [4:04:57<26:09:34,  3.40it/s]
 14%|█▍        | 51162/371472 [4:04:57<25:22:03,  3.51it/s]
 14%|█▍        | 51163/371472 [4:04:57<24:30:28,  3.63it/s]
 14%|█▍        | 51164/371472 [4:04:57<23:41:54,  3.75it/s]
 14%|█▍        | 51165/371472 [4:04:58<24:30:59,  3.63it/s]
 14%|█▍        | 51166/371472 [4:04:58<23:52:23,  3.73it/s]
 14%|█▍        | 51167/371472 [4:04:58<24:41:34,  3.60it/s]
 14%|█▍        | 51168/371472 [4:04:58<25:08:35,  3.54it/s]
 14%|█▍        | 51169/371472 [4:04:59<25:51:13,  3.44it/s]
 14%|█▍        | 51170/371472 [4:04:59<24:51:35,  3.58it/s]
 14%|█▍        | 51171/371472 [4:04:59<25:33:42,  3.48it/s]
 14%|█▍        | 51172/371472 [4:05:00<24:43:54,  3.60it/s]
 14%|█▍        | 51173/371472 [4:05:00<25:26:56,  3.50it/s]
 14%|█▍        | 51174/371472 [4:05:00<24:20:28,  3.66it/s]
 14%|█▍        | 51175/371472 [4:05:00<23:46:20,  3.74it/s]
 14%|█▍        | 51176/371472 [4:05:01<24:18:14,  3.66it/s]
 14%|█▍        | 51177/371472 [4:05:01<25:19:35,  3.51it/s]
 14%|█▍        | 51178/371472 [4:05:01<25:54:48,  3.43it/s]
 14%|█▍        | 51179/371472 [4:05:02<24:21:41,  3.65it/s]
 14%|█▍        | 51180/371472 [4:05:02<24:08:14,  3.69it/s]
                                                           
{'loss': 4.2576, 'learning_rate': 8.764194445042986e-07, 'epoch': 2.2}

 14%|█▍        | 51180/371472 [4:05:02<24:08:14,  3.69it/s]
 14%|█▍        | 51181/371472 [4:05:02<24:26:07,  3.64it/s]
 14%|█▍        | 51182/371472 [4:05:02<27:14:01,  3.27it/s]
 14%|█▍        | 51183/371472 [4:05:03<27:11:09,  3.27it/s]
 14%|█▍        | 51184/371472 [4:05:03<28:36:13,  3.11it/s]
 14%|█▍        | 51185/371472 [4:05:03<27:39:55,  3.22it/s]
 14%|█▍        | 51186/371472 [4:05:04<26:40:49,  3.33it/s]
 14%|█▍        | 51187/371472 [4:05:04<26:28:20,  3.36it/s]
 14%|█▍        | 51188/371472 [4:05:04<26:19:37,  3.38it/s]
 14%|█▍        | 51189/371472 [4:05:05<25:36:16,  3.47it/s]
 14%|█▍        | 51190/371472 [4:05:05<25:47:02,  3.45it/s]
 14%|█▍        | 51191/371472 [4:05:05<24:51:38,  3.58it/s]
 14%|█▍        | 51192/371472 [4:05:05<25:02:53,  3.55it/s]
 14%|█▍        | 51193/371472 [4:05:06<25:18:31,  3.52it/s]
 14%|█▍        | 51194/371472 [4:05:06<26:23:08,  3.37it/s]
 14%|█▍        | 51195/371472 [4:05:06<26:05:12,  3.41it/s]
 14%|█▍        | 51196/371472 [4:05:07<25:20:53,  3.51it/s]
 14%|█▍        | 51197/371472 [4:05:07<24:36:09,  3.62it/s]
 14%|█▍        | 51198/371472 [4:05:07<23:55:49,  3.72it/s]
 14%|█▍        | 51199/371472 [4:05:07<25:32:50,  3.48it/s]
 14%|█▍        | 51200/371472 [4:05:08<24:19:43,  3.66it/s]
                                                           
{'loss': 4.1051, 'learning_rate': 8.763709625288198e-07, 'epoch': 2.21}

 14%|█▍        | 51200/371472 [4:05:08<24:19:43,  3.66it/s]
 14%|█▍        | 51201/371472 [4:05:08<23:39:13,  3.76it/s]
 14%|█▍        | 51202/371472 [4:05:08<24:50:06,  3.58it/s]
 14%|█▍        | 51203/371472 [4:05:08<24:46:43,  3.59it/s]
 14%|█▍        | 51204/371472 [4:05:09<24:34:44,  3.62it/s]
 14%|█▍        | 51205/371472 [4:05:09<24:59:36,  3.56it/s]
 14%|█▍        | 51206/371472 [4:05:09<24:41:32,  3.60it/s]
 14%|█▍        | 51207/371472 [4:05:10<24:14:27,  3.67it/s]
 14%|█▍        | 51208/371472 [4:05:10<26:01:34,  3.42it/s]
 14%|█▍        | 51209/371472 [4:05:10<25:24:26,  3.50it/s]
 14%|█▍        | 51210/371472 [4:05:10<25:08:22,  3.54it/s]
 14%|█▍        | 51211/371472 [4:05:11<24:54:24,  3.57it/s]
 14%|█▍        | 51212/371472 [4:05:11<25:19:47,  3.51it/s]
 14%|█▍        | 51213/371472 [4:05:11<26:35:26,  3.35it/s]
 14%|█▍        | 51214/371472 [4:05:12<26:10:26,  3.40it/s]
 14%|█▍        | 51215/371472 [4:05:12<25:34:45,  3.48it/s]
 14%|█▍        | 51216/371472 [4:05:12<25:16:01,  3.52it/s]
 14%|█▍        | 51217/371472 [4:05:12<25:04:12,  3.55it/s]
 14%|█▍        | 51218/371472 [4:05:13<24:58:45,  3.56it/s]
 14%|█▍        | 51219/371472 [4:05:13<25:10:46,  3.53it/s]
 14%|█▍        | 51220/371472 [4:05:13<25:01:19,  3.56it/s]
                                                           
{'loss': 4.1606, 'learning_rate': 8.763224805533409e-07, 'epoch': 2.21}

 14%|█▍        | 51220/371472 [4:05:13<25:01:19,  3.56it/s]
 14%|█▍        | 51221/371472 [4:05:14<25:22:37,  3.51it/s]
 14%|█▍        | 51222/371472 [4:05:14<25:02:14,  3.55it/s]
 14%|█▍        | 51223/371472 [4:05:14<25:06:23,  3.54it/s]
 14%|█▍        | 51224/371472 [4:05:14<23:51:29,  3.73it/s]
 14%|█▍        | 51225/371472 [4:05:15<23:37:17,  3.77it/s]
 14%|█▍        | 51226/371472 [4:05:15<23:54:24,  3.72it/s]
 14%|█▍        | 51227/371472 [4:05:15<23:40:59,  3.76it/s]
 14%|█▍        | 51228/371472 [4:05:15<24:45:36,  3.59it/s]
 14%|█▍        | 51229/371472 [4:05:16<24:00:57,  3.70it/s]
 14%|█▍        | 51230/371472 [4:05:16<24:11:11,  3.68it/s]
 14%|█▍        | 51231/371472 [4:05:16<24:49:50,  3.58it/s]
 14%|█▍        | 51232/371472 [4:05:17<24:14:43,  3.67it/s]
 14%|█▍        | 51233/371472 [4:05:17<23:44:26,  3.75it/s]
 14%|█▍        | 51234/371472 [4:05:17<23:11:07,  3.84it/s]
 14%|█▍        | 51235/371472 [4:05:17<24:26:22,  3.64it/s]
 14%|█▍        | 51236/371472 [4:05:18<24:01:00,  3.70it/s]
 14%|█▍        | 51237/371472 [4:05:18<24:16:57,  3.66it/s]
 14%|█▍        | 51238/371472 [4:05:18<23:59:22,  3.71it/s]
 14%|█▍        | 51239/371472 [4:05:18<24:01:14,  3.70it/s]
 14%|█▍        | 51240/371472 [4:05:19<23:24:04,  3.80it/s]
                                                           
{'loss': 4.594, 'learning_rate': 8.762739985778621e-07, 'epoch': 2.21}

 14%|█▍        | 51240/371472 [4:05:19<23:24:04,  3.80it/s]
 14%|█▍        | 51241/371472 [4:05:19<24:28:49,  3.63it/s]
 14%|█▍        | 51242/371472 [4:05:19<24:18:34,  3.66it/s]
 14%|█▍        | 51243/371472 [4:05:20<25:24:36,  3.50it/s]
 14%|█▍        | 51244/371472 [4:05:20<25:00:05,  3.56it/s]
 14%|█▍        | 51245/371472 [4:05:20<25:33:58,  3.48it/s]
 14%|█▍        | 51246/371472 [4:05:20<24:56:28,  3.57it/s]
 14%|█▍        | 51247/371472 [4:05:21<26:43:29,  3.33it/s]
 14%|█▍        | 51248/371472 [4:05:21<26:20:04,  3.38it/s]
 14%|█▍        | 51249/371472 [4:05:21<26:01:22,  3.42it/s]
 14%|█▍        | 51250/371472 [4:05:22<26:53:11,  3.31it/s]
 14%|█▍        | 51251/371472 [4:05:22<27:24:22,  3.25it/s]
 14%|█▍        | 51252/371472 [4:05:22<26:18:42,  3.38it/s]
 14%|█▍        | 51253/371472 [4:05:22<25:18:21,  3.51it/s]
 14%|█▍        | 51254/371472 [4:05:23<26:17:16,  3.38it/s]
 14%|█▍        | 51255/371472 [4:05:23<26:08:19,  3.40it/s]
 14%|█▍        | 51256/371472 [4:05:23<27:10:09,  3.27it/s]
 14%|█▍        | 51257/371472 [4:05:24<27:04:24,  3.29it/s]
 14%|█▍        | 51258/371472 [4:05:24<28:59:52,  3.07it/s]
 14%|█▍        | 51259/371472 [4:05:24<27:09:02,  3.28it/s]
 14%|█▍        | 51260/371472 [4:05:25<26:13:50,  3.39it/s]
                                                           
{'loss': 4.1487, 'learning_rate': 8.762255166023832e-07, 'epoch': 2.21}

 14%|█▍        | 51260/371472 [4:05:25<26:13:50,  3.39it/s]
 14%|█▍        | 51261/371472 [4:05:25<27:01:15,  3.29it/s]
 14%|█▍        | 51262/371472 [4:05:25<25:43:57,  3.46it/s]
 14%|█▍        | 51263/371472 [4:05:25<24:33:45,  3.62it/s]
 14%|█▍        | 51264/371472 [4:05:26<26:06:13,  3.41it/s]
 14%|█▍        | 51265/371472 [4:05:26<26:30:58,  3.35it/s]
 14%|█▍        | 51266/371472 [4:05:26<26:36:42,  3.34it/s]
 14%|█▍        | 51267/371472 [4:05:27<27:16:44,  3.26it/s]
 14%|█▍        | 51268/371472 [4:05:27<25:34:15,  3.48it/s]
 14%|█▍        | 51269/371472 [4:05:27<24:55:10,  3.57it/s]
 14%|█▍        | 51270/371472 [4:05:28<25:09:48,  3.53it/s]
 14%|█▍        | 51271/371472 [4:05:28<24:42:55,  3.60it/s]
 14%|█▍        | 51272/371472 [4:05:28<26:53:32,  3.31it/s]
 14%|█▍        | 51273/371472 [4:05:28<25:54:38,  3.43it/s]
 14%|█▍        | 51274/371472 [4:05:29<27:24:54,  3.24it/s]
 14%|█▍        | 51275/371472 [4:05:29<26:47:08,  3.32it/s]
 14%|█▍        | 51276/371472 [4:05:29<25:44:00,  3.46it/s]
 14%|█▍        | 51277/371472 [4:05:30<25:13:27,  3.53it/s]
 14%|█▍        | 51278/371472 [4:05:30<26:38:11,  3.34it/s]
 14%|█▍        | 51279/371472 [4:05:30<25:44:12,  3.46it/s]
 14%|█▍        | 51280/371472 [4:05:30<24:39:16,  3.61it/s]
                                                           
{'loss': 4.1725, 'learning_rate': 8.761770346269042e-07, 'epoch': 2.21}

 14%|█▍        | 51280/371472 [4:05:30<24:39:16,  3.61it/s]
 14%|█▍        | 51281/371472 [4:05:31<26:03:21,  3.41it/s]
 14%|█▍        | 51282/371472 [4:05:31<27:01:09,  3.29it/s]
 14%|█▍        | 51283/371472 [4:05:31<25:29:43,  3.49it/s]
 14%|█▍        | 51284/371472 [4:05:32<24:15:45,  3.67it/s]
 14%|█▍        | 51285/371472 [4:05:32<24:09:35,  3.68it/s]
 14%|█▍        | 51286/371472 [4:05:32<23:55:40,  3.72it/s]
 14%|█▍        | 51287/371472 [4:05:33<28:36:14,  3.11it/s]
 14%|█▍        | 51288/371472 [4:05:33<27:08:33,  3.28it/s]
 14%|█▍        | 51289/371472 [4:05:33<25:26:46,  3.50it/s]
 14%|█▍        | 51290/371472 [4:05:33<25:34:53,  3.48it/s]
 14%|█▍        | 51291/371472 [4:05:34<26:26:13,  3.36it/s]
 14%|█▍        | 51292/371472 [4:05:34<35:58:16,  2.47it/s]
 14%|█▍        | 51293/371472 [4:05:35<33:20:33,  2.67it/s]
 14%|█▍        | 51294/371472 [4:05:35<29:46:28,  2.99it/s]
 14%|█▍        | 51295/371472 [4:05:35<27:36:00,  3.22it/s]
 14%|█▍        | 51296/371472 [4:05:35<26:22:48,  3.37it/s]
 14%|█▍        | 51297/371472 [4:05:36<26:09:05,  3.40it/s]
 14%|█▍        | 51298/371472 [4:05:36<25:37:29,  3.47it/s]
 14%|█▍        | 51299/371472 [4:05:36<25:04:30,  3.55it/s]
 14%|█▍        | 51300/371472 [4:05:36<24:41:46,  3.60it/s]
                                                           
{'loss': 4.1257, 'learning_rate': 8.761285526514253e-07, 'epoch': 2.21}

 14%|█▍        | 51300/371472 [4:05:36<24:41:46,  3.60it/s]
 14%|█▍        | 51301/371472 [4:05:37<24:10:53,  3.68it/s]
 14%|█▍        | 51302/371472 [4:05:37<24:04:05,  3.70it/s]
 14%|█▍        | 51303/371472 [4:05:37<25:06:49,  3.54it/s]
 14%|█▍        | 51304/371472 [4:05:38<24:11:44,  3.68it/s]
 14%|█▍        | 51305/371472 [4:05:38<23:28:52,  3.79it/s]
 14%|█▍        | 51306/371472 [4:05:38<22:59:19,  3.87it/s]
 14%|█▍        | 51307/371472 [4:05:38<24:05:07,  3.69it/s]
 14%|█▍        | 51308/371472 [4:05:39<23:59:47,  3.71it/s]
 14%|█▍        | 51309/371472 [4:05:39<23:28:09,  3.79it/s]
 14%|█▍        | 51310/371472 [4:05:39<22:53:46,  3.88it/s]
 14%|█▍        | 51311/371472 [4:05:39<22:29:43,  3.95it/s]
 14%|█▍        | 51312/371472 [4:05:40<22:56:49,  3.88it/s]
 14%|█▍        | 51313/371472 [4:05:40<23:38:24,  3.76it/s]
 14%|█▍        | 51314/371472 [4:05:40<23:23:12,  3.80it/s]
 14%|█▍        | 51315/371472 [4:05:40<23:36:28,  3.77it/s]
 14%|█▍        | 51316/371472 [4:05:41<25:40:22,  3.46it/s]
 14%|█▍        | 51317/371472 [4:05:41<25:26:11,  3.50it/s]
 14%|█▍        | 51318/371472 [4:05:41<26:46:53,  3.32it/s]
 14%|█▍        | 51319/371472 [4:05:42<25:34:32,  3.48it/s]
 14%|█▍        | 51320/371472 [4:05:42<24:28:22,  3.63it/s]
                                                           
{'loss': 4.2533, 'learning_rate': 8.760800706759464e-07, 'epoch': 2.21}

 14%|█▍        | 51320/371472 [4:05:42<24:28:22,  3.63it/s]
 14%|█▍        | 51321/371472 [4:05:42<26:32:27,  3.35it/s]
 14%|█▍        | 51322/371472 [4:05:43<25:24:56,  3.50it/s]
 14%|█▍        | 51323/371472 [4:05:43<25:04:15,  3.55it/s]
 14%|█▍        | 51324/371472 [4:05:43<25:02:41,  3.55it/s]
 14%|█▍        | 51325/371472 [4:05:43<24:17:04,  3.66it/s]
 14%|█▍        | 51326/371472 [4:05:44<23:50:32,  3.73it/s]
 14%|█▍        | 51327/371472 [4:05:44<24:34:19,  3.62it/s]
 14%|█▍        | 51328/371472 [4:05:44<24:09:07,  3.68it/s]
 14%|█▍        | 51329/371472 [4:05:45<27:59:01,  3.18it/s]
 14%|█▍        | 51330/371472 [4:05:45<26:36:02,  3.34it/s]
 14%|█▍        | 51331/371472 [4:05:45<30:41:15,  2.90it/s]
 14%|█▍        | 51332/371472 [4:05:46<29:34:05,  3.01it/s]
 14%|█▍        | 51333/371472 [4:05:46<29:00:12,  3.07it/s]
 14%|█▍        | 51334/371472 [4:05:46<27:39:08,  3.22it/s]
 14%|█▍        | 51335/371472 [4:05:46<25:59:29,  3.42it/s]
 14%|█▍        | 51336/371472 [4:05:47<24:43:36,  3.60it/s]
 14%|█▍        | 51337/371472 [4:05:47<24:09:25,  3.68it/s]
 14%|█▍        | 51338/371472 [4:05:47<23:24:11,  3.80it/s]
 14%|█▍        | 51339/371472 [4:05:47<23:07:32,  3.85it/s]
 14%|█▍        | 51340/371472 [4:05:48<24:04:02,  3.69it/s]
                                                           
{'loss': 4.1158, 'learning_rate': 8.760315887004675e-07, 'epoch': 2.21}

 14%|█▍        | 51340/371472 [4:05:48<24:04:02,  3.69it/s]
 14%|█▍        | 51341/371472 [4:05:48<23:50:54,  3.73it/s]
 14%|█▍        | 51342/371472 [4:05:48<23:59:34,  3.71it/s]
 14%|█▍        | 51343/371472 [4:05:48<23:26:47,  3.79it/s]
 14%|█▍        | 51344/371472 [4:05:49<23:36:38,  3.77it/s]
 14%|█▍        | 51345/371472 [4:05:49<24:03:31,  3.70it/s]
 14%|█▍        | 51346/371472 [4:05:49<23:46:50,  3.74it/s]
 14%|█▍        | 51347/371472 [4:05:50<23:11:04,  3.84it/s]
 14%|█▍        | 51348/371472 [4:05:50<25:51:35,  3.44it/s]
 14%|█▍        | 51349/371472 [4:05:50<24:48:25,  3.58it/s]
 14%|█▍        | 51350/371472 [4:05:50<25:42:56,  3.46it/s]
 14%|█▍        | 51351/371472 [4:05:51<26:02:53,  3.41it/s]
 14%|█▍        | 51352/371472 [4:05:51<24:54:29,  3.57it/s]
 14%|█▍        | 51353/371472 [4:05:51<24:06:57,  3.69it/s]
 14%|█▍        | 51354/371472 [4:05:52<23:58:36,  3.71it/s]
 14%|█▍        | 51355/371472 [4:05:52<24:25:03,  3.64it/s]
 14%|█▍        | 51356/371472 [4:05:52<23:33:22,  3.77it/s]
 14%|█▍        | 51357/371472 [4:05:52<23:05:58,  3.85it/s]
 14%|█▍        | 51358/371472 [4:05:53<23:39:35,  3.76it/s]
 14%|█▍        | 51359/371472 [4:05:53<22:57:35,  3.87it/s]
 14%|█▍        | 51360/371472 [4:05:53<22:56:54,  3.87it/s]
                                                           
{'loss': 4.4128, 'learning_rate': 8.759831067249887e-07, 'epoch': 2.21}

 14%|█▍        | 51360/371472 [4:05:53<22:56:54,  3.87it/s]
 14%|█▍        | 51361/371472 [4:05:53<22:40:15,  3.92it/s]
 14%|█▍        | 51362/371472 [4:05:54<22:32:45,  3.94it/s]
 14%|█▍        | 51363/371472 [4:05:54<23:44:40,  3.74it/s]
 14%|█▍        | 51364/371472 [4:05:54<23:32:27,  3.78it/s]
 14%|█▍        | 51365/371472 [4:05:54<25:21:42,  3.51it/s]
 14%|█▍        | 51366/371472 [4:05:55<26:37:11,  3.34it/s]
 14%|█▍        | 51367/371472 [4:05:55<25:14:19,  3.52it/s]
 14%|█▍        | 51368/371472 [4:05:55<24:16:14,  3.66it/s]
 14%|█▍        | 51369/371472 [4:05:56<24:40:27,  3.60it/s]
 14%|█▍        | 51370/371472 [4:05:56<24:00:22,  3.70it/s]
 14%|█▍        | 51371/371472 [4:05:56<24:17:08,  3.66it/s]
 14%|█▍        | 51372/371472 [4:05:56<25:29:48,  3.49it/s]
 14%|█▍        | 51373/371472 [4:05:57<24:52:15,  3.58it/s]
 14%|█▍        | 51374/371472 [4:05:57<24:38:09,  3.61it/s]
 14%|█▍        | 51375/371472 [4:05:57<25:46:51,  3.45it/s]
 14%|█▍        | 51376/371472 [4:05:58<25:14:38,  3.52it/s]
 14%|█▍        | 51377/371472 [4:05:58<26:03:15,  3.41it/s]
 14%|█▍        | 51378/371472 [4:05:58<26:07:29,  3.40it/s]
 14%|█▍        | 51379/371472 [4:05:58<24:57:17,  3.56it/s]
 14%|█▍        | 51380/371472 [4:05:59<25:36:44,  3.47it/s]
                                                           
{'loss': 4.2981, 'learning_rate': 8.759346247495098e-07, 'epoch': 2.21}

 14%|█▍        | 51380/371472 [4:05:59<25:36:44,  3.47it/s]
 14%|█▍        | 51381/371472 [4:05:59<26:21:15,  3.37it/s]
 14%|█▍        | 51382/371472 [4:05:59<25:54:00,  3.43it/s]
 14%|█▍        | 51383/371472 [4:06:00<25:01:31,  3.55it/s]
 14%|█▍        | 51384/371472 [4:06:00<24:32:59,  3.62it/s]
 14%|█▍        | 51385/371472 [4:06:00<25:13:38,  3.52it/s]
 14%|█▍        | 51386/371472 [4:06:00<24:28:57,  3.63it/s]
 14%|█▍        | 51387/371472 [4:06:01<24:10:11,  3.68it/s]
 14%|█▍        | 51388/371472 [4:06:01<24:39:15,  3.61it/s]
 14%|█▍        | 51389/371472 [4:06:01<25:33:08,  3.48it/s]
 14%|█▍        | 51390/371472 [4:06:02<24:07:40,  3.69it/s]
 14%|█▍        | 51391/371472 [4:06:02<23:40:50,  3.75it/s]
 14%|█▍        | 51392/371472 [4:06:02<23:16:33,  3.82it/s]
 14%|█▍        | 51393/371472 [4:06:02<23:28:23,  3.79it/s]
 14%|█▍        | 51394/371472 [4:06:03<23:21:05,  3.81it/s]
 14%|█▍        | 51395/371472 [4:06:03<24:01:53,  3.70it/s]
 14%|█▍        | 51396/371472 [4:06:03<25:48:29,  3.45it/s]
 14%|█▍        | 51397/371472 [4:06:03<25:08:28,  3.54it/s]
 14%|█▍        | 51398/371472 [4:06:04<23:47:31,  3.74it/s]
 14%|█▍        | 51399/371472 [4:06:04<23:25:02,  3.80it/s]
 14%|█▍        | 51400/371472 [4:06:04<25:19:55,  3.51it/s]
                                                           
{'loss': 4.2351, 'learning_rate': 8.758861427740309e-07, 'epoch': 2.21}

 14%|█▍        | 51400/371472 [4:06:04<25:19:55,  3.51it/s]
 14%|█▍        | 51401/371472 [4:06:05<25:28:10,  3.49it/s]
 14%|█▍        | 51402/371472 [4:06:05<26:34:15,  3.35it/s]
 14%|█▍        | 51403/371472 [4:06:05<26:07:17,  3.40it/s]
 14%|█▍        | 51404/371472 [4:06:05<26:52:18,  3.31it/s]
 14%|█▍        | 51405/371472 [4:06:06<26:07:14,  3.40it/s]
 14%|█▍        | 51406/371472 [4:06:06<26:15:18,  3.39it/s]
 14%|█▍        | 51407/371472 [4:06:06<24:42:30,  3.60it/s]
 14%|█▍        | 51408/371472 [4:06:07<25:25:45,  3.50it/s]
 14%|█▍        | 51409/371472 [4:06:07<24:18:36,  3.66it/s]
 14%|█▍        | 51410/371472 [4:06:07<23:40:12,  3.76it/s]
 14%|█▍        | 51411/371472 [4:06:07<23:43:27,  3.75it/s]
 14%|█▍        | 51412/371472 [4:06:08<24:18:10,  3.66it/s]
 14%|█▍        | 51413/371472 [4:06:08<24:57:45,  3.56it/s]
 14%|█▍        | 51414/371472 [4:06:08<25:06:55,  3.54it/s]
 14%|█▍        | 51415/371472 [4:06:08<24:06:18,  3.69it/s]
 14%|█▍        | 51416/371472 [4:06:09<23:16:05,  3.82it/s]
 14%|█▍        | 51417/371472 [4:06:09<22:52:29,  3.89it/s]
 14%|█▍        | 51418/371472 [4:06:09<23:14:53,  3.82it/s]
 14%|█▍        | 51419/371472 [4:06:10<26:20:11,  3.38it/s]
 14%|█▍        | 51420/371472 [4:06:10<26:33:06,  3.35it/s]
                                                           
{'loss': 4.1967, 'learning_rate': 8.758376607985519e-07, 'epoch': 2.21}

 14%|█▍        | 51420/371472 [4:06:10<26:33:06,  3.35it/s]
 14%|█▍        | 51421/371472 [4:06:10<25:37:59,  3.47it/s]
 14%|█▍        | 51422/371472 [4:06:10<25:16:43,  3.52it/s]
 14%|█▍        | 51423/371472 [4:06:11<27:03:11,  3.29it/s]
 14%|█▍        | 51424/371472 [4:06:11<25:01:01,  3.55it/s]
 14%|█▍        | 51425/371472 [4:06:11<24:31:25,  3.63it/s]
 14%|█▍        | 51426/371472 [4:06:12<25:56:25,  3.43it/s]
 14%|█▍        | 51427/371472 [4:06:12<27:45:28,  3.20it/s]
 14%|█▍        | 51428/371472 [4:06:12<28:37:15,  3.11it/s]
 14%|█▍        | 51429/371472 [4:06:13<26:23:00,  3.37it/s]
 14%|█▍        | 51430/371472 [4:06:13<27:48:04,  3.20it/s]
 14%|█▍        | 51431/371472 [4:06:13<26:28:34,  3.36it/s]
 14%|█▍        | 51432/371472 [4:06:13<24:54:40,  3.57it/s]
 14%|█▍        | 51433/371472 [4:06:14<25:34:33,  3.48it/s]
 14%|█▍        | 51434/371472 [4:06:14<24:06:40,  3.69it/s]
 14%|█▍        | 51435/371472 [4:06:14<24:47:15,  3.59it/s]
 14%|█▍        | 51436/371472 [4:06:15<24:22:25,  3.65it/s]
 14%|█▍        | 51437/371472 [4:06:15<24:46:50,  3.59it/s]
 14%|█▍        | 51438/371472 [4:06:15<24:19:24,  3.65it/s]
 14%|█▍        | 51439/371472 [4:06:15<24:59:51,  3.56it/s]
 14%|█▍        | 51440/371472 [4:06:16<25:26:49,  3.49it/s]
                                                           
{'loss': 4.1482, 'learning_rate': 8.757891788230731e-07, 'epoch': 2.22}

 14%|█▍        | 51440/371472 [4:06:16<25:26:49,  3.49it/s]
 14%|█▍        | 51441/371472 [4:06:16<26:12:55,  3.39it/s]
 14%|█▍        | 51442/371472 [4:06:16<25:54:11,  3.43it/s]
 14%|█▍        | 51443/371472 [4:06:17<25:22:54,  3.50it/s]
 14%|█▍        | 51444/371472 [4:06:17<25:34:06,  3.48it/s]
 14%|█▍        | 51445/371472 [4:06:17<25:15:44,  3.52it/s]
 14%|█▍        | 51446/371472 [4:06:17<25:06:41,  3.54it/s]
 14%|█▍        | 51447/371472 [4:06:18<24:40:53,  3.60it/s]
 14%|█▍        | 51448/371472 [4:06:18<24:52:22,  3.57it/s]
 14%|█▍        | 51449/371472 [4:06:18<25:28:15,  3.49it/s]
 14%|█▍        | 51450/371472 [4:06:19<25:20:28,  3.51it/s]
 14%|█▍        | 51451/371472 [4:06:19<25:06:08,  3.54it/s]
 14%|█▍        | 51452/371472 [4:06:19<25:11:51,  3.53it/s]
 14%|█▍        | 51453/371472 [4:06:19<24:14:29,  3.67it/s]
 14%|█▍        | 51454/371472 [4:06:20<25:22:31,  3.50it/s]
 14%|█▍        | 51455/371472 [4:06:20<25:24:30,  3.50it/s]
 14%|█▍        | 51456/371472 [4:06:20<24:36:17,  3.61it/s]
 14%|█▍        | 51457/371472 [4:06:20<24:10:55,  3.68it/s]
 14%|█▍        | 51458/371472 [4:06:21<25:35:33,  3.47it/s]
 14%|█▍        | 51459/371472 [4:06:21<27:18:21,  3.26it/s]
 14%|█▍        | 51460/371472 [4:06:21<25:43:47,  3.45it/s]
                                                           
{'loss': 4.2317, 'learning_rate': 8.757406968475942e-07, 'epoch': 2.22}

 14%|█▍        | 51460/371472 [4:06:21<25:43:47,  3.45it/s]
 14%|█▍        | 51461/371472 [4:06:22<26:00:45,  3.42it/s]
 14%|█▍        | 51462/371472 [4:06:22<26:07:06,  3.40it/s]
 14%|█▍        | 51463/371472 [4:06:22<27:05:43,  3.28it/s]
 14%|█▍        | 51464/371472 [4:06:23<25:28:08,  3.49it/s]
 14%|█▍        | 51465/371472 [4:06:23<25:36:43,  3.47it/s]
 14%|█▍        | 51466/371472 [4:06:23<24:53:25,  3.57it/s]
 14%|█▍        | 51467/371472 [4:06:23<24:04:44,  3.69it/s]
 14%|█▍        | 51468/371472 [4:06:24<24:35:17,  3.62it/s]
 14%|█▍        | 51469/371472 [4:06:24<23:47:06,  3.74it/s]
 14%|█▍        | 51470/371472 [4:06:24<23:24:17,  3.80it/s]
 14%|█▍        | 51471/371472 [4:06:24<24:09:01,  3.68it/s]
 14%|█▍        | 51472/371472 [4:06:25<24:38:39,  3.61it/s]
 14%|█▍        | 51473/371472 [4:06:25<29:34:47,  3.01it/s]
 14%|█▍        | 51474/371472 [4:06:25<29:11:15,  3.05it/s]
 14%|█▍        | 51475/371472 [4:06:26<27:57:54,  3.18it/s]
 14%|█▍        | 51476/371472 [4:06:26<28:47:49,  3.09it/s]
 14%|█▍        | 51477/371472 [4:06:26<27:44:29,  3.20it/s]
 14%|█▍        | 51478/371472 [4:06:27<26:11:15,  3.39it/s]
 14%|█▍        | 51479/371472 [4:06:27<26:28:30,  3.36it/s]
 14%|█▍        | 51480/371472 [4:06:27<25:51:40,  3.44it/s]
                                                           
{'loss': 4.2784, 'learning_rate': 8.756922148721152e-07, 'epoch': 2.22}

 14%|█▍        | 51480/371472 [4:06:27<25:51:40,  3.44it/s]
 14%|█▍        | 51481/371472 [4:06:28<26:19:55,  3.38it/s]
 14%|█▍        | 51482/371472 [4:06:28<29:23:51,  3.02it/s]
 14%|█▍        | 51483/371472 [4:06:28<28:43:05,  3.10it/s]
 14%|█▍        | 51484/371472 [4:06:29<26:55:22,  3.30it/s]
 14%|█▍        | 51485/371472 [4:06:29<28:45:15,  3.09it/s]
 14%|█▍        | 51486/371472 [4:06:29<28:11:37,  3.15it/s]
 14%|█▍        | 51487/371472 [4:06:29<26:38:55,  3.34it/s]
 14%|█▍        | 51488/371472 [4:06:30<26:27:46,  3.36it/s]
 14%|█▍        | 51489/371472 [4:06:30<25:35:01,  3.47it/s]
 14%|█▍        | 51490/371472 [4:06:30<25:53:28,  3.43it/s]
 14%|█▍        | 51491/371472 [4:06:31<27:33:56,  3.22it/s]
 14%|█▍        | 51492/371472 [4:06:31<26:09:37,  3.40it/s]
 14%|█▍        | 51493/371472 [4:06:31<25:04:01,  3.55it/s]
 14%|█▍        | 51494/371472 [4:06:31<25:04:07,  3.55it/s]
 14%|█▍        | 51495/371472 [4:06:32<24:23:56,  3.64it/s]
 14%|█▍        | 51496/371472 [4:06:32<24:06:28,  3.69it/s]
 14%|█▍        | 51497/371472 [4:06:32<24:14:22,  3.67it/s]
 14%|█▍        | 51498/371472 [4:06:33<26:55:51,  3.30it/s]
 14%|█▍        | 51499/371472 [4:06:33<27:17:16,  3.26it/s]
 14%|█▍        | 51500/371472 [4:06:33<28:01:11,  3.17it/s]
                                                           
{'loss': 4.3519, 'learning_rate': 8.756437328966364e-07, 'epoch': 2.22}

 14%|█▍        | 51500/371472 [4:06:33<28:01:11,  3.17it/s]
 14%|█▍        | 51501/371472 [4:06:34<26:03:19,  3.41it/s]
 14%|█▍        | 51502/371472 [4:06:34<25:06:09,  3.54it/s]
 14%|█▍        | 51503/371472 [4:06:34<25:12:03,  3.53it/s]
 14%|█▍        | 51504/371472 [4:06:34<24:17:24,  3.66it/s]
 14%|█▍        | 51505/371472 [4:06:35<24:59:43,  3.56it/s]
 14%|█▍        | 51506/371472 [4:06:35<25:24:55,  3.50it/s]
 14%|█▍        | 51507/371472 [4:06:35<26:16:04,  3.38it/s]
 14%|█▍        | 51508/371472 [4:06:35<25:01:13,  3.55it/s]
 14%|█▍        | 51509/371472 [4:06:36<24:27:53,  3.63it/s]
 14%|█▍        | 51510/371472 [4:06:36<23:34:47,  3.77it/s]
 14%|█▍        | 51511/371472 [4:06:36<23:40:31,  3.75it/s]
 14%|█▍        | 51512/371472 [4:06:37<25:22:09,  3.50it/s]
 14%|█▍        | 51513/371472 [4:06:37<25:50:37,  3.44it/s]
 14%|█▍        | 51514/371472 [4:06:37<24:38:55,  3.61it/s]
 14%|█▍        | 51515/371472 [4:06:37<25:01:22,  3.55it/s]
 14%|█▍        | 51516/371472 [4:06:38<24:58:49,  3.56it/s]
 14%|█▍        | 51517/371472 [4:06:38<26:00:21,  3.42it/s]
 14%|█▍        | 51518/371472 [4:06:38<25:35:40,  3.47it/s]
 14%|█▍        | 51519/371472 [4:06:39<24:31:47,  3.62it/s]
 14%|█▍        | 51520/371472 [4:06:39<25:08:05,  3.54it/s]
                                                           
{'loss': 4.3672, 'learning_rate': 8.755952509211575e-07, 'epoch': 2.22}

 14%|█▍        | 51520/371472 [4:06:39<25:08:05,  3.54it/s]
 14%|█▍        | 51521/371472 [4:06:39<25:43:45,  3.45it/s]
 14%|█▍        | 51522/371472 [4:06:39<25:37:31,  3.47it/s]
 14%|█▍        | 51523/371472 [4:06:40<25:06:40,  3.54it/s]
 14%|█▍        | 51524/371472 [4:06:40<25:01:34,  3.55it/s]
 14%|█▍        | 51525/371472 [4:06:40<25:00:07,  3.55it/s]
 14%|█▍        | 51526/371472 [4:06:41<26:57:34,  3.30it/s]
 14%|█▍        | 51527/371472 [4:06:41<25:21:05,  3.51it/s]
 14%|█▍        | 51528/371472 [4:06:41<25:45:59,  3.45it/s]
 14%|█▍        | 51529/371472 [4:06:41<25:56:31,  3.43it/s]
 14%|█▍        | 51530/371472 [4:06:42<25:04:12,  3.54it/s]
 14%|█▍        | 51531/371472 [4:06:42<24:38:38,  3.61it/s]
 14%|█▍        | 51532/371472 [4:06:42<24:54:56,  3.57it/s]
 14%|█▍        | 51533/371472 [4:06:43<24:38:32,  3.61it/s]
 14%|█▍        | 51534/371472 [4:06:43<23:58:43,  3.71it/s]
 14%|█▍        | 51535/371472 [4:06:43<23:21:48,  3.80it/s]
 14%|█▍        | 51536/371472 [4:06:43<25:02:04,  3.55it/s]
 14%|█▍        | 51537/371472 [4:06:44<25:25:22,  3.50it/s]
 14%|█▍        | 51538/371472 [4:06:44<25:08:30,  3.53it/s]
 14%|█▍        | 51539/371472 [4:06:44<25:27:11,  3.49it/s]
 14%|█▍        | 51540/371472 [4:06:45<25:23:45,  3.50it/s]
                                                           
{'loss': 4.1288, 'learning_rate': 8.755467689456786e-07, 'epoch': 2.22}

 14%|█▍        | 51540/371472 [4:06:45<25:23:45,  3.50it/s]
 14%|█▍        | 51541/371472 [4:06:45<25:23:16,  3.50it/s]
 14%|█▍        | 51542/371472 [4:06:45<27:48:31,  3.20it/s]
 14%|█▍        | 51543/371472 [4:06:45<27:25:12,  3.24it/s]
 14%|█▍        | 51544/371472 [4:06:46<26:14:13,  3.39it/s]
 14%|█▍        | 51545/371472 [4:06:46<25:48:18,  3.44it/s]
 14%|█▍        | 51546/371472 [4:06:46<25:51:32,  3.44it/s]
 14%|█▍        | 51547/371472 [4:06:47<26:06:38,  3.40it/s]
 14%|█▍        | 51548/371472 [4:06:47<26:26:09,  3.36it/s]
 14%|█▍        | 51549/371472 [4:06:47<25:44:43,  3.45it/s]
 14%|█▍        | 51550/371472 [4:06:47<25:13:47,  3.52it/s]
 14%|█▍        | 51551/371472 [4:06:48<24:42:10,  3.60it/s]
 14%|█▍        | 51552/371472 [4:06:48<24:24:31,  3.64it/s]
 14%|█▍        | 51553/371472 [4:06:48<24:55:55,  3.56it/s]
 14%|█▍        | 51554/371472 [4:06:49<24:44:57,  3.59it/s]
 14%|█▍        | 51555/371472 [4:06:49<24:23:18,  3.64it/s]
 14%|█▍        | 51556/371472 [4:06:49<24:04:56,  3.69it/s]
 14%|█▍        | 51557/371472 [4:06:49<24:10:26,  3.68it/s]
 14%|█▍        | 51558/371472 [4:06:50<25:08:16,  3.54it/s]
 14%|█▍        | 51559/371472 [4:06:50<25:13:58,  3.52it/s]
 14%|█▍        | 51560/371472 [4:06:50<24:40:12,  3.60it/s]
                                                           
{'loss': 4.4207, 'learning_rate': 8.754982869701996e-07, 'epoch': 2.22}

 14%|█▍        | 51560/371472 [4:06:50<24:40:12,  3.60it/s]
 14%|█▍        | 51561/371472 [4:06:50<24:17:46,  3.66it/s]
 14%|█▍        | 51562/371472 [4:06:51<24:25:08,  3.64it/s]
 14%|█▍        | 51563/371472 [4:06:51<24:30:28,  3.63it/s]
 14%|█▍        | 51564/371472 [4:06:51<24:18:10,  3.66it/s]
 14%|█▍        | 51565/371472 [4:06:52<23:31:17,  3.78it/s]
 14%|█▍        | 51566/371472 [4:06:52<24:17:59,  3.66it/s]
 14%|█▍        | 51567/371472 [4:06:52<23:52:40,  3.72it/s]
 14%|█▍        | 51568/371472 [4:06:52<23:19:57,  3.81it/s]
 14%|█▍        | 51569/371472 [4:06:53<24:21:38,  3.65it/s]
 14%|█▍        | 51570/371472 [4:06:53<23:48:38,  3.73it/s]
 14%|█▍        | 51571/371472 [4:06:53<23:25:11,  3.79it/s]
 14%|█▍        | 51572/371472 [4:06:54<27:36:04,  3.22it/s]
 14%|█▍        | 51573/371472 [4:06:54<26:27:20,  3.36it/s]
 14%|█▍        | 51574/371472 [4:06:54<27:03:06,  3.28it/s]
 14%|█▍        | 51575/371472 [4:06:54<26:10:09,  3.40it/s]
 14%|█▍        | 51576/371472 [4:06:55<25:57:18,  3.42it/s]
 14%|█▍        | 51577/371472 [4:06:55<25:54:03,  3.43it/s]
 14%|█▍        | 51578/371472 [4:06:55<26:04:39,  3.41it/s]
 14%|█▍        | 51579/371472 [4:06:56<24:38:05,  3.61it/s]
 14%|█▍        | 51580/371472 [4:06:56<23:23:06,  3.80it/s]
                                                           
{'loss': 4.5234, 'learning_rate': 8.754498049947208e-07, 'epoch': 2.22}

 14%|█▍        | 51580/371472 [4:06:56<23:23:06,  3.80it/s]
 14%|█▍        | 51581/371472 [4:06:56<24:47:06,  3.59it/s]
 14%|█▍        | 51582/371472 [4:06:56<23:43:04,  3.75it/s]
 14%|█▍        | 51583/371472 [4:06:57<23:57:24,  3.71it/s]
 14%|█▍        | 51584/371472 [4:06:57<25:50:30,  3.44it/s]
 14%|█▍        | 51585/371472 [4:06:57<24:40:13,  3.60it/s]
 14%|█▍        | 51586/371472 [4:06:58<26:37:35,  3.34it/s]
 14%|█▍        | 51587/371472 [4:06:58<25:35:42,  3.47it/s]
 14%|█▍        | 51588/371472 [4:06:58<24:28:37,  3.63it/s]
 14%|█▍        | 51589/371472 [4:06:58<24:27:05,  3.63it/s]
 14%|█▍        | 51590/371472 [4:06:59<23:31:46,  3.78it/s]
 14%|█▍        | 51591/371472 [4:06:59<24:24:25,  3.64it/s]
 14%|█▍        | 51592/371472 [4:06:59<26:26:08,  3.36it/s]
 14%|█▍        | 51593/371472 [4:07:00<30:53:11,  2.88it/s]
 14%|█▍        | 51594/371472 [4:07:00<30:07:43,  2.95it/s]
 14%|█▍        | 51595/371472 [4:07:00<28:00:22,  3.17it/s]
 14%|█▍        | 51596/371472 [4:07:01<26:24:17,  3.37it/s]
 14%|█▍        | 51597/371472 [4:07:01<25:54:21,  3.43it/s]
 14%|█▍        | 51598/371472 [4:07:01<24:55:33,  3.56it/s]
 14%|█▍        | 51599/371472 [4:07:01<24:30:40,  3.63it/s]
 14%|█▍        | 51600/371472 [4:07:02<24:19:51,  3.65it/s]
                                                           
{'loss': 4.2745, 'learning_rate': 8.754013230192419e-07, 'epoch': 2.22}

 14%|█▍        | 51600/371472 [4:07:02<24:19:51,  3.65it/s]
 14%|█▍        | 51601/371472 [4:07:02<23:33:20,  3.77it/s]
 14%|█▍        | 51602/371472 [4:07:02<24:05:49,  3.69it/s]
 14%|█▍        | 51603/371472 [4:07:02<24:26:49,  3.63it/s]
 14%|█▍        | 51604/371472 [4:07:03<24:38:52,  3.60it/s]
 14%|█▍        | 51605/371472 [4:07:03<24:30:38,  3.63it/s]
 14%|█▍        | 51606/371472 [4:07:03<24:41:02,  3.60it/s]
 14%|█▍        | 51607/371472 [4:07:04<24:51:27,  3.57it/s]
 14%|█▍        | 51608/371472 [4:07:04<25:03:55,  3.54it/s]
 14%|█▍        | 51609/371472 [4:07:04<25:58:25,  3.42it/s]
 14%|█▍        | 51610/371472 [4:07:04<27:41:15,  3.21it/s]
 14%|█▍        | 51611/371472 [4:07:05<25:56:11,  3.43it/s]
 14%|█▍        | 51612/371472 [4:07:05<24:48:51,  3.58it/s]
 14%|█▍        | 51613/371472 [4:07:05<25:19:36,  3.51it/s]
 14%|█▍        | 51614/371472 [4:07:06<23:50:22,  3.73it/s]
 14%|█▍        | 51615/371472 [4:07:06<24:11:45,  3.67it/s]
 14%|█▍        | 51616/371472 [4:07:06<25:04:48,  3.54it/s]
 14%|█▍        | 51617/371472 [4:07:06<25:07:31,  3.54it/s]
 14%|█▍        | 51618/371472 [4:07:07<25:26:20,  3.49it/s]
 14%|█▍        | 51619/371472 [4:07:07<24:38:46,  3.60it/s]
 14%|█▍        | 51620/371472 [4:07:07<23:25:25,  3.79it/s]
                                                           
{'loss': 4.2628, 'learning_rate': 8.753528410437631e-07, 'epoch': 2.22}

 14%|█▍        | 51620/371472 [4:07:07<23:25:25,  3.79it/s]
 14%|█▍        | 51621/371472 [4:07:07<23:56:15,  3.71it/s]
 14%|█▍        | 51622/371472 [4:07:08<23:09:37,  3.84it/s]
 14%|█▍        | 51623/371472 [4:07:08<23:33:59,  3.77it/s]
 14%|█▍        | 51624/371472 [4:07:08<24:03:47,  3.69it/s]
 14%|█▍        | 51625/371472 [4:07:09<24:42:49,  3.60it/s]
 14%|█▍        | 51626/371472 [4:07:09<23:56:52,  3.71it/s]
 14%|█▍        | 51627/371472 [4:07:09<27:08:53,  3.27it/s]
 14%|█▍        | 51628/371472 [4:07:09<25:52:40,  3.43it/s]
 14%|█▍        | 51629/371472 [4:07:10<25:02:08,  3.55it/s]
 14%|█▍        | 51630/371472 [4:07:10<23:59:27,  3.70it/s]
 14%|█▍        | 51631/371472 [4:07:10<24:41:23,  3.60it/s]
 14%|█▍        | 51632/371472 [4:07:10<24:01:25,  3.70it/s]
 14%|█▍        | 51633/371472 [4:07:11<23:25:25,  3.79it/s]
 14%|█▍        | 51634/371472 [4:07:11<23:56:18,  3.71it/s]
 14%|█▍        | 51635/371472 [4:07:11<23:55:51,  3.71it/s]
 14%|█▍        | 51636/371472 [4:07:12<23:47:43,  3.73it/s]
 14%|█▍        | 51637/371472 [4:07:12<25:41:28,  3.46it/s]
 14%|█▍        | 51638/371472 [4:07:12<25:20:33,  3.51it/s]
 14%|█▍        | 51639/371472 [4:07:12<24:55:11,  3.57it/s]
 14%|█▍        | 51640/371472 [4:07:13<25:12:11,  3.53it/s]
                                                           
{'loss': 4.2123, 'learning_rate': 8.753043590682841e-07, 'epoch': 2.22}

 14%|█▍        | 51640/371472 [4:07:13<25:12:11,  3.53it/s]
 14%|█▍        | 51641/371472 [4:07:13<26:30:21,  3.35it/s]
 14%|█▍        | 51642/371472 [4:07:13<26:21:58,  3.37it/s]
 14%|█▍        | 51643/371472 [4:07:14<25:32:05,  3.48it/s]
 14%|█▍        | 51644/371472 [4:07:14<24:23:26,  3.64it/s]
 14%|█▍        | 51645/371472 [4:07:14<23:52:15,  3.72it/s]
 14%|█▍        | 51646/371472 [4:07:14<24:22:42,  3.64it/s]
 14%|█▍        | 51647/371472 [4:07:15<25:11:50,  3.53it/s]
 14%|█▍        | 51648/371472 [4:07:15<25:22:13,  3.50it/s]
 14%|█▍        | 51649/371472 [4:07:15<24:56:42,  3.56it/s]
 14%|█▍        | 51650/371472 [4:07:16<24:27:22,  3.63it/s]
 14%|█▍        | 51651/371472 [4:07:16<24:35:47,  3.61it/s]
 14%|█▍        | 51652/371472 [4:07:16<25:27:39,  3.49it/s]
 14%|█▍        | 51653/371472 [4:07:16<24:43:35,  3.59it/s]
 14%|█▍        | 51654/371472 [4:07:17<23:53:42,  3.72it/s]
 14%|█▍        | 51655/371472 [4:07:17<24:26:31,  3.63it/s]
 14%|█▍        | 51656/371472 [4:07:17<25:22:24,  3.50it/s]
 14%|█▍        | 51657/371472 [4:07:17<24:15:04,  3.66it/s]
 14%|█▍        | 51658/371472 [4:07:18<24:57:54,  3.56it/s]
 14%|█▍        | 51659/371472 [4:07:18<24:07:32,  3.68it/s]
 14%|█▍        | 51660/371472 [4:07:18<25:50:02,  3.44it/s]
                                                           
{'loss': 4.3077, 'learning_rate': 8.752558770928053e-07, 'epoch': 2.23}

 14%|█▍        | 51660/371472 [4:07:18<25:50:02,  3.44it/s]
 14%|█▍        | 51661/371472 [4:07:19<25:23:11,  3.50it/s]
 14%|█▍        | 51662/371472 [4:07:19<24:12:10,  3.67it/s]
 14%|█▍        | 51663/371472 [4:07:19<24:23:54,  3.64it/s]
 14%|█▍        | 51664/371472 [4:07:19<24:03:32,  3.69it/s]
 14%|█▍        | 51665/371472 [4:07:20<24:02:18,  3.70it/s]
 14%|█▍        | 51666/371472 [4:07:20<24:05:59,  3.69it/s]
 14%|█▍        | 51667/371472 [4:07:20<24:02:18,  3.70it/s]
 14%|█▍        | 51668/371472 [4:07:20<23:27:43,  3.79it/s]
 14%|█▍        | 51669/371472 [4:07:21<24:05:47,  3.69it/s]
 14%|█▍        | 51670/371472 [4:07:21<24:00:40,  3.70it/s]
 14%|█▍        | 51671/371472 [4:07:21<24:56:04,  3.56it/s]
 14%|█▍        | 51672/371472 [4:07:22<24:20:18,  3.65it/s]
 14%|█▍        | 51673/371472 [4:07:22<25:22:55,  3.50it/s]
 14%|█▍        | 51674/371472 [4:07:22<24:07:59,  3.68it/s]
 14%|█▍        | 51675/371472 [4:07:22<23:58:53,  3.70it/s]
 14%|█▍        | 51676/371472 [4:07:23<23:40:33,  3.75it/s]
 14%|█▍        | 51677/371472 [4:07:23<23:50:39,  3.73it/s]
 14%|█▍        | 51678/371472 [4:07:23<25:06:11,  3.54it/s]
 14%|█▍        | 51679/371472 [4:07:24<24:49:11,  3.58it/s]
 14%|█▍        | 51680/371472 [4:07:24<25:23:52,  3.50it/s]
                                                           
{'loss': 4.245, 'learning_rate': 8.752073951173263e-07, 'epoch': 2.23}

 14%|█▍        | 51680/371472 [4:07:24<25:23:52,  3.50it/s]
 14%|█▍        | 51681/371472 [4:07:24<26:37:49,  3.34it/s]
 14%|█▍        | 51682/371472 [4:07:24<27:07:03,  3.28it/s]
 14%|█▍        | 51683/371472 [4:07:25<27:15:39,  3.26it/s]
 14%|█▍        | 51684/371472 [4:07:25<25:50:14,  3.44it/s]
 14%|█▍        | 51685/371472 [4:07:25<25:03:38,  3.54it/s]
 14%|█▍        | 51686/371472 [4:07:26<25:30:01,  3.48it/s]
 14%|█▍        | 51687/371472 [4:07:26<24:39:54,  3.60it/s]
 14%|█▍        | 51688/371472 [4:07:26<24:38:28,  3.60it/s]
 14%|█▍        | 51689/371472 [4:07:26<23:39:58,  3.75it/s]
 14%|█▍        | 51690/371472 [4:07:27<24:18:14,  3.65it/s]
 14%|█▍        | 51691/371472 [4:07:27<23:47:46,  3.73it/s]
 14%|█▍        | 51692/371472 [4:07:27<23:44:34,  3.74it/s]
 14%|█▍        | 51693/371472 [4:07:27<23:11:59,  3.83it/s]
 14%|█▍        | 51694/371472 [4:07:28<24:13:14,  3.67it/s]
 14%|█▍        | 51695/371472 [4:07:28<23:43:23,  3.74it/s]
 14%|█▍        | 51696/371472 [4:07:28<23:47:57,  3.73it/s]
 14%|█▍        | 51697/371472 [4:07:29<24:42:28,  3.60it/s]
 14%|█▍        | 51698/371472 [4:07:29<24:02:23,  3.69it/s]
 14%|█▍        | 51699/371472 [4:07:29<23:06:24,  3.84it/s]
 14%|█▍        | 51700/371472 [4:07:29<22:47:30,  3.90it/s]
                                                           
{'loss': 4.2597, 'learning_rate': 8.751589131418475e-07, 'epoch': 2.23}

 14%|█▍        | 51700/371472 [4:07:29<22:47:30,  3.90it/s]
 14%|█▍        | 51701/371472 [4:07:30<22:59:30,  3.86it/s]
 14%|█▍        | 51702/371472 [4:07:30<23:16:22,  3.82it/s]
 14%|█▍        | 51703/371472 [4:07:30<23:05:36,  3.85it/s]
 14%|█▍        | 51704/371472 [4:07:30<25:26:49,  3.49it/s]
 14%|█▍        | 51705/371472 [4:07:31<26:30:13,  3.35it/s]
 14%|█▍        | 51706/371472 [4:07:31<28:55:22,  3.07it/s]
 14%|█▍        | 51707/371472 [4:07:31<27:03:11,  3.28it/s]
 14%|█▍        | 51708/371472 [4:07:32<25:18:16,  3.51it/s]
 14%|█▍        | 51709/371472 [4:07:32<24:01:13,  3.70it/s]
 14%|█▍        | 51710/371472 [4:07:32<23:21:56,  3.80it/s]
 14%|█▍        | 51711/371472 [4:07:32<23:36:35,  3.76it/s]
 14%|█▍        | 51712/371472 [4:07:33<23:48:39,  3.73it/s]
 14%|█▍        | 51713/371472 [4:07:33<24:42:48,  3.59it/s]
 14%|█▍        | 51714/371472 [4:07:33<24:22:29,  3.64it/s]
 14%|█▍        | 51715/371472 [4:07:33<23:32:59,  3.77it/s]
 14%|█▍        | 51716/371472 [4:07:34<23:10:57,  3.83it/s]
 14%|█▍        | 51717/371472 [4:07:34<23:08:11,  3.84it/s]
 14%|█▍        | 51718/371472 [4:07:34<24:16:55,  3.66it/s]
 14%|█▍        | 51719/371472 [4:07:35<23:51:56,  3.72it/s]
 14%|█▍        | 51720/371472 [4:07:35<24:09:46,  3.68it/s]
                                                           
{'loss': 4.4867, 'learning_rate': 8.751104311663685e-07, 'epoch': 2.23}

 14%|█▍        | 51720/371472 [4:07:35<24:09:46,  3.68it/s]
 14%|█▍        | 51721/371472 [4:07:35<24:46:10,  3.59it/s]
 14%|█▍        | 51722/371472 [4:07:35<24:08:47,  3.68it/s]
 14%|█▍        | 51723/371472 [4:07:36<23:52:31,  3.72it/s]
 14%|█▍        | 51724/371472 [4:07:36<23:54:44,  3.71it/s]
 14%|█▍        | 51725/371472 [4:07:36<23:15:06,  3.82it/s]
 14%|█▍        | 51726/371472 [4:07:36<23:02:16,  3.86it/s]
 14%|█▍        | 51727/371472 [4:07:37<23:27:10,  3.79it/s]
 14%|█▍        | 51728/371472 [4:07:37<23:23:31,  3.80it/s]
 14%|█▍        | 51729/371472 [4:07:37<23:04:00,  3.85it/s]
 14%|█▍        | 51730/371472 [4:07:37<23:26:14,  3.79it/s]
 14%|█▍        | 51731/371472 [4:07:38<24:35:24,  3.61it/s]
 14%|█▍        | 51732/371472 [4:07:38<25:51:36,  3.43it/s]
 14%|█▍        | 51733/371472 [4:07:38<25:25:52,  3.49it/s]
 14%|█▍        | 51734/371472 [4:07:39<25:41:33,  3.46it/s]
 14%|█▍        | 51735/371472 [4:07:39<25:02:32,  3.55it/s]
 14%|█▍        | 51736/371472 [4:07:39<25:09:17,  3.53it/s]
 14%|█▍        | 51737/371472 [4:07:39<24:33:19,  3.62it/s]
 14%|█▍        | 51738/371472 [4:07:40<25:01:31,  3.55it/s]
 14%|█▍        | 51739/371472 [4:07:40<26:18:25,  3.38it/s]
 14%|█▍        | 51740/371472 [4:07:40<25:52:32,  3.43it/s]
                                                           
{'loss': 4.5026, 'learning_rate': 8.750619491908897e-07, 'epoch': 2.23}

 14%|█▍        | 51740/371472 [4:07:40<25:52:32,  3.43it/s]
 14%|█▍        | 51741/371472 [4:07:41<26:12:23,  3.39it/s]
 14%|█▍        | 51742/371472 [4:07:41<26:32:37,  3.35it/s]
 14%|█▍        | 51743/371472 [4:07:41<25:28:36,  3.49it/s]
 14%|█▍        | 51744/371472 [4:07:42<24:49:10,  3.58it/s]
 14%|█▍        | 51745/371472 [4:07:42<24:48:26,  3.58it/s]
 14%|█▍        | 51746/371472 [4:07:42<24:07:35,  3.68it/s]
 14%|█▍        | 51747/371472 [4:07:42<23:45:53,  3.74it/s]
 14%|█▍        | 51748/371472 [4:07:43<23:11:59,  3.83it/s]
 14%|█▍        | 51749/371472 [4:07:43<25:34:21,  3.47it/s]
 14%|█▍        | 51750/371472 [4:07:43<24:35:33,  3.61it/s]
 14%|█▍        | 51751/371472 [4:07:43<24:37:29,  3.61it/s]
 14%|█▍        | 51752/371472 [4:07:44<24:40:19,  3.60it/s]
 14%|█▍        | 51753/371472 [4:07:44<23:36:38,  3.76it/s]
 14%|█▍        | 51754/371472 [4:07:44<25:49:52,  3.44it/s]
 14%|█▍        | 51755/371472 [4:07:45<25:08:31,  3.53it/s]
 14%|█▍        | 51756/371472 [4:07:45<24:10:49,  3.67it/s]
 14%|█▍        | 51757/371472 [4:07:45<24:54:51,  3.56it/s]
 14%|█▍        | 51758/371472 [4:07:45<24:45:38,  3.59it/s]
 14%|█▍        | 51759/371472 [4:07:46<25:54:35,  3.43it/s]
 14%|█▍        | 51760/371472 [4:07:46<25:04:38,  3.54it/s]
                                                           
{'loss': 4.2651, 'learning_rate': 8.750134672154108e-07, 'epoch': 2.23}

 14%|█▍        | 51760/371472 [4:07:46<25:04:38,  3.54it/s]
 14%|█▍        | 51761/371472 [4:07:46<23:52:08,  3.72it/s]
 14%|█▍        | 51762/371472 [4:07:46<23:28:23,  3.78it/s]
 14%|█▍        | 51763/371472 [4:07:47<23:33:59,  3.77it/s]
 14%|█▍        | 51764/371472 [4:07:47<23:56:58,  3.71it/s]
 14%|█▍        | 51765/371472 [4:07:47<23:34:17,  3.77it/s]
 14%|█▍        | 51766/371472 [4:07:48<23:18:46,  3.81it/s]
 14%|█▍        | 51767/371472 [4:07:48<26:28:40,  3.35it/s]
 14%|█▍        | 51768/371472 [4:07:48<26:07:40,  3.40it/s]
 14%|█▍        | 51769/371472 [4:07:48<25:14:00,  3.52it/s]
 14%|█▍        | 51770/371472 [4:07:49<26:10:54,  3.39it/s]
 14%|█▍        | 51771/371472 [4:07:49<25:40:20,  3.46it/s]
 14%|█▍        | 51772/371472 [4:07:49<25:54:22,  3.43it/s]
 14%|█▍        | 51773/371472 [4:07:50<25:07:04,  3.54it/s]
 14%|█▍        | 51774/371472 [4:07:50<26:11:52,  3.39it/s]
 14%|█▍        | 51775/371472 [4:07:50<25:32:26,  3.48it/s]
 14%|█▍        | 51776/371472 [4:07:50<24:46:20,  3.58it/s]
 14%|█▍        | 51777/371472 [4:07:51<24:08:33,  3.68it/s]
 14%|█▍        | 51778/371472 [4:07:51<24:02:02,  3.69it/s]
 14%|█▍        | 51779/371472 [4:07:51<24:31:38,  3.62it/s]
 14%|█▍        | 51780/371472 [4:07:52<23:56:11,  3.71it/s]
                                                           
{'loss': 4.3774, 'learning_rate': 8.749649852399321e-07, 'epoch': 2.23}

 14%|█▍        | 51780/371472 [4:07:52<23:56:11,  3.71it/s]
 14%|█▍        | 51781/371472 [4:07:52<23:29:53,  3.78it/s]
 14%|█▍        | 51782/371472 [4:07:52<23:49:51,  3.73it/s]
 14%|█▍        | 51783/371472 [4:07:52<24:15:42,  3.66it/s]
 14%|█▍        | 51784/371472 [4:07:53<24:38:36,  3.60it/s]
 14%|█▍        | 51785/371472 [4:07:53<23:59:09,  3.70it/s]
 14%|█▍        | 51786/371472 [4:07:53<23:35:57,  3.76it/s]
 14%|█▍        | 51787/371472 [4:07:53<24:03:49,  3.69it/s]
 14%|█▍        | 51788/371472 [4:07:54<24:39:20,  3.60it/s]
 14%|█▍        | 51789/371472 [4:07:54<23:55:07,  3.71it/s]
 14%|█▍        | 51790/371472 [4:07:54<22:59:35,  3.86it/s]
 14%|█▍        | 51791/371472 [4:07:54<23:00:42,  3.86it/s]
 14%|█▍        | 51792/371472 [4:07:55<22:46:03,  3.90it/s]
 14%|█▍        | 51793/371472 [4:07:55<22:24:38,  3.96it/s]
 14%|█▍        | 51794/371472 [4:07:55<24:50:29,  3.57it/s]
 14%|█▍        | 51795/371472 [4:07:56<25:02:53,  3.55it/s]
 14%|█▍        | 51796/371472 [4:07:56<25:00:35,  3.55it/s]
 14%|█▍        | 51797/371472 [4:07:56<24:32:06,  3.62it/s]
 14%|█▍        | 51798/371472 [4:07:56<26:57:31,  3.29it/s]
 14%|█▍        | 51799/371472 [4:07:57<27:33:19,  3.22it/s]
 14%|█▍        | 51800/371472 [4:07:57<27:27:07,  3.23it/s]
                                                           
{'loss': 4.2054, 'learning_rate': 8.749165032644529e-07, 'epoch': 2.23}

 14%|█▍        | 51800/371472 [4:07:57<27:27:07,  3.23it/s]
 14%|█▍        | 51801/371472 [4:07:57<26:35:54,  3.34it/s]
 14%|█▍        | 51802/371472 [4:07:58<25:07:13,  3.53it/s]
 14%|█▍        | 51803/371472 [4:07:58<24:50:00,  3.58it/s]
 14%|█▍        | 51804/371472 [4:07:58<28:40:37,  3.10it/s]
 14%|█▍        | 51805/371472 [4:07:59<27:44:20,  3.20it/s]
 14%|█▍        | 51806/371472 [4:07:59<26:35:58,  3.34it/s]
 14%|█▍        | 51807/371472 [4:07:59<25:54:39,  3.43it/s]
 14%|█▍        | 51808/371472 [4:08:00<27:07:36,  3.27it/s]
 14%|█▍        | 51809/371472 [4:08:00<25:38:47,  3.46it/s]
 14%|█▍        | 51810/371472 [4:08:00<24:54:57,  3.56it/s]
 14%|█▍        | 51811/371472 [4:08:00<24:40:20,  3.60it/s]
 14%|█▍        | 51812/371472 [4:08:01<24:42:04,  3.59it/s]
 14%|█▍        | 51813/371472 [4:08:01<25:42:56,  3.45it/s]
 14%|█▍        | 51814/371472 [4:08:01<24:12:56,  3.67it/s]
 14%|█▍        | 51815/371472 [4:08:01<25:08:50,  3.53it/s]
 14%|█▍        | 51816/371472 [4:08:02<24:08:26,  3.68it/s]
 14%|█▍        | 51817/371472 [4:08:02<24:35:37,  3.61it/s]
 14%|█▍        | 51818/371472 [4:08:02<24:09:26,  3.68it/s]
 14%|█▍        | 51819/371472 [4:08:03<25:29:03,  3.48it/s]
 14%|█▍        | 51820/371472 [4:08:03<25:16:14,  3.51it/s]
                                                           
{'loss': 4.3723, 'learning_rate': 8.748680212889741e-07, 'epoch': 2.23}

 14%|█▍        | 51820/371472 [4:08:03<25:16:14,  3.51it/s]
 14%|█▍        | 51821/371472 [4:08:03<25:29:14,  3.48it/s]
 14%|█▍        | 51822/371472 [4:08:03<25:47:34,  3.44it/s]
 14%|█▍        | 51823/371472 [4:08:04<24:51:57,  3.57it/s]
 14%|█▍        | 51824/371472 [4:08:04<26:01:41,  3.41it/s]
 14%|█▍        | 51825/371472 [4:08:04<25:15:11,  3.52it/s]
 14%|█▍        | 51826/371472 [4:08:05<28:45:21,  3.09it/s]
 14%|█▍        | 51827/371472 [4:08:05<27:31:57,  3.22it/s]
 14%|█▍        | 51828/371472 [4:08:05<26:37:27,  3.33it/s]
 14%|█▍        | 51829/371472 [4:08:06<27:33:31,  3.22it/s]
 14%|█▍        | 51830/371472 [4:08:06<27:21:30,  3.25it/s]
 14%|█▍        | 51831/371472 [4:08:06<25:44:10,  3.45it/s]
 14%|█▍        | 51832/371472 [4:08:06<25:26:33,  3.49it/s]
 14%|█▍        | 51833/371472 [4:08:07<26:08:06,  3.40it/s]
 14%|█▍        | 51834/371472 [4:08:07<25:07:48,  3.53it/s]
 14%|█▍        | 51835/371472 [4:08:07<24:23:51,  3.64it/s]
 14%|█▍        | 51836/371472 [4:08:08<26:53:52,  3.30it/s]
 14%|█▍        | 51837/371472 [4:08:08<26:58:39,  3.29it/s]
 14%|█▍        | 51838/371472 [4:08:08<27:38:42,  3.21it/s]
 14%|█▍        | 51839/371472 [4:08:08<26:35:31,  3.34it/s]
 14%|█▍        | 51840/371472 [4:08:09<25:35:04,  3.47it/s]
                                                           
{'loss': 4.2458, 'learning_rate': 8.748195393134952e-07, 'epoch': 2.23}

 14%|█▍        | 51840/371472 [4:08:09<25:35:04,  3.47it/s]
 14%|█▍        | 51841/371472 [4:08:09<26:33:55,  3.34it/s]
 14%|█▍        | 51842/371472 [4:08:09<25:28:16,  3.49it/s]
 14%|█▍        | 51843/371472 [4:08:10<24:35:45,  3.61it/s]
 14%|█▍        | 51844/371472 [4:08:10<23:50:04,  3.73it/s]
 14%|█▍        | 51845/371472 [4:08:10<25:05:00,  3.54it/s]
 14%|█▍        | 51846/371472 [4:08:10<25:09:18,  3.53it/s]
 14%|█▍        | 51847/371472 [4:08:11<24:40:53,  3.60it/s]
 14%|█▍        | 51848/371472 [4:08:11<25:24:18,  3.49it/s]
 14%|█▍        | 51849/371472 [4:08:11<25:16:13,  3.51it/s]
 14%|█▍        | 51850/371472 [4:08:12<25:23:18,  3.50it/s]
 14%|█▍        | 51851/371472 [4:08:12<24:32:12,  3.62it/s]
 14%|█▍        | 51852/371472 [4:08:12<25:25:54,  3.49it/s]
 14%|█▍        | 51853/371472 [4:08:13<27:41:43,  3.21it/s]
 14%|█▍        | 51854/371472 [4:08:13<26:05:11,  3.40it/s]
 14%|█▍        | 51855/371472 [4:08:13<25:53:29,  3.43it/s]
 14%|█▍        | 51856/371472 [4:08:13<24:49:59,  3.58it/s]
 14%|█▍        | 51857/371472 [4:08:14<23:35:01,  3.76it/s]
 14%|█▍        | 51858/371472 [4:08:14<23:57:45,  3.71it/s]
 14%|█▍        | 51859/371472 [4:08:14<23:12:37,  3.83it/s]
 14%|█▍        | 51860/371472 [4:08:14<24:16:28,  3.66it/s]
                                                           
{'loss': 4.1491, 'learning_rate': 8.747710573380162e-07, 'epoch': 2.23}

 14%|█▍        | 51860/371472 [4:08:14<24:16:28,  3.66it/s]
 14%|█▍        | 51861/371472 [4:08:15<24:18:54,  3.65it/s]
 14%|█▍        | 51862/371472 [4:08:15<24:22:46,  3.64it/s]
 14%|█▍        | 51863/371472 [4:08:15<24:27:02,  3.63it/s]
 14%|█▍        | 51864/371472 [4:08:15<23:51:48,  3.72it/s]
 14%|█▍        | 51865/371472 [4:08:16<24:50:10,  3.57it/s]
 14%|█▍        | 51866/371472 [4:08:16<24:58:47,  3.55it/s]
 14%|█▍        | 51867/371472 [4:08:16<24:18:24,  3.65it/s]
 14%|█▍        | 51868/371472 [4:08:17<24:19:12,  3.65it/s]
 14%|█▍        | 51869/371472 [4:08:17<26:18:16,  3.38it/s]
 14%|█▍        | 51870/371472 [4:08:17<24:43:51,  3.59it/s]
 14%|█▍        | 51871/371472 [4:08:17<24:19:33,  3.65it/s]
 14%|█▍        | 51872/371472 [4:08:18<23:07:02,  3.84it/s]
 14%|█▍        | 51873/371472 [4:08:18<23:51:17,  3.72it/s]
 14%|█▍        | 51874/371472 [4:08:18<26:33:10,  3.34it/s]
 14%|█▍        | 51875/371472 [4:08:19<27:12:11,  3.26it/s]
 14%|█▍        | 51876/371472 [4:08:19<26:37:09,  3.34it/s]
 14%|█▍        | 51877/371472 [4:08:19<26:10:55,  3.39it/s]
 14%|█▍        | 51878/371472 [4:08:19<26:06:22,  3.40it/s]
 14%|█▍        | 51879/371472 [4:08:20<26:27:44,  3.35it/s]
 14%|█▍        | 51880/371472 [4:08:20<26:48:27,  3.31it/s]
                                                           
{'loss': 4.0953, 'learning_rate': 8.747225753625374e-07, 'epoch': 2.23}

 14%|█▍        | 51880/371472 [4:08:20<26:48:27,  3.31it/s]
 14%|█▍        | 51881/371472 [4:08:20<25:58:56,  3.42it/s]
 14%|█▍        | 51882/371472 [4:08:21<28:56:07,  3.07it/s]
 14%|█▍        | 51883/371472 [4:08:21<26:55:21,  3.30it/s]
 14%|█▍        | 51884/371472 [4:08:21<25:04:09,  3.54it/s]
 14%|█▍        | 51885/371472 [4:08:22<24:42:28,  3.59it/s]
 14%|█▍        | 51886/371472 [4:08:22<25:41:37,  3.46it/s]
 14%|█▍        | 51887/371472 [4:08:22<24:55:04,  3.56it/s]
 14%|█▍        | 51888/371472 [4:08:22<24:02:32,  3.69it/s]
 14%|█▍        | 51889/371472 [4:08:23<23:32:17,  3.77it/s]
 14%|█▍        | 51890/371472 [4:08:23<23:11:08,  3.83it/s]
 14%|█▍        | 51891/371472 [4:08:23<23:29:59,  3.78it/s]
 14%|█▍        | 51892/371472 [4:08:23<23:15:43,  3.82it/s]
 14%|█▍        | 51893/371472 [4:08:24<23:36:03,  3.76it/s]
 14%|█▍        | 51894/371472 [4:08:24<23:33:30,  3.77it/s]
 14%|█▍        | 51895/371472 [4:08:24<23:13:19,  3.82it/s]
 14%|█▍        | 51896/371472 [4:08:24<22:57:36,  3.87it/s]
 14%|█▍        | 51897/371472 [4:08:25<24:50:00,  3.57it/s]
 14%|█▍        | 51898/371472 [4:08:25<24:44:33,  3.59it/s]
 14%|█▍        | 51899/371472 [4:08:25<24:05:04,  3.69it/s]
 14%|█▍        | 51900/371472 [4:08:26<24:19:50,  3.65it/s]
                                                           
{'loss': 4.2957, 'learning_rate': 8.746740933870586e-07, 'epoch': 2.24}

 14%|█▍        | 51900/371472 [4:08:26<24:19:50,  3.65it/s]
 14%|█▍        | 51901/371472 [4:08:26<24:17:04,  3.66it/s]
 14%|█▍        | 51902/371472 [4:08:26<24:07:09,  3.68it/s]
 14%|█▍        | 51903/371472 [4:08:26<24:19:28,  3.65it/s]
 14%|█▍        | 51904/371472 [4:08:27<25:25:15,  3.49it/s]
 14%|█▍        | 51905/371472 [4:08:27<27:45:58,  3.20it/s]
 14%|█▍        | 51906/371472 [4:08:27<26:41:32,  3.33it/s]
 14%|█▍        | 51907/371472 [4:08:28<26:57:39,  3.29it/s]
 14%|█▍        | 51908/371472 [4:08:28<25:50:03,  3.44it/s]
 14%|█▍        | 51909/371472 [4:08:28<25:20:16,  3.50it/s]
 14%|█▍        | 51910/371472 [4:08:29<26:03:05,  3.41it/s]
 14%|█▍        | 51911/371472 [4:08:29<25:04:10,  3.54it/s]
 14%|█▍        | 51912/371472 [4:08:29<24:55:28,  3.56it/s]
 14%|█▍        | 51913/371472 [4:08:29<25:33:26,  3.47it/s]
 14%|█▍        | 51914/371472 [4:08:30<24:53:51,  3.57it/s]
 14%|█▍        | 51915/371472 [4:08:30<24:39:34,  3.60it/s]
 14%|█▍        | 51916/371472 [4:08:30<24:17:58,  3.65it/s]
 14%|█▍        | 51917/371472 [4:08:30<24:00:38,  3.70it/s]
 14%|█▍        | 51918/371472 [4:08:31<23:45:46,  3.74it/s]
 14%|█▍        | 51919/371472 [4:08:31<26:06:44,  3.40it/s]
 14%|█▍        | 51920/371472 [4:08:31<24:49:53,  3.57it/s]
                                                           
{'loss': 4.0886, 'learning_rate': 8.746256114115796e-07, 'epoch': 2.24}

 14%|█▍        | 51920/371472 [4:08:31<24:49:53,  3.57it/s]
 14%|█▍        | 51921/371472 [4:08:32<24:18:27,  3.65it/s]
 14%|█▍        | 51922/371472 [4:08:32<24:19:48,  3.65it/s]
 14%|█▍        | 51923/371472 [4:08:32<23:31:23,  3.77it/s]
 14%|█▍        | 51924/371472 [4:08:32<23:34:17,  3.77it/s]
 14%|█▍        | 51925/371472 [4:08:33<23:17:29,  3.81it/s]
 14%|█▍        | 51926/371472 [4:08:33<23:56:06,  3.71it/s]
 14%|█▍        | 51927/371472 [4:08:33<23:50:39,  3.72it/s]
 14%|█▍        | 51928/371472 [4:08:33<24:11:46,  3.67it/s]
 14%|█▍        | 51929/371472 [4:08:34<24:43:02,  3.59it/s]
 14%|█▍        | 51930/371472 [4:08:34<23:37:04,  3.76it/s]
 14%|█▍        | 51931/371472 [4:08:34<22:49:24,  3.89it/s]
 14%|█▍        | 51932/371472 [4:08:34<23:01:25,  3.86it/s]
 14%|█▍        | 51933/371472 [4:08:35<22:45:46,  3.90it/s]
 14%|█▍        | 51934/371472 [4:08:35<23:04:23,  3.85it/s]
 14%|█▍        | 51935/371472 [4:08:35<22:50:06,  3.89it/s]
 14%|█▍        | 51936/371472 [4:08:35<22:19:49,  3.97it/s]
 14%|█▍        | 51937/371472 [4:08:36<22:09:13,  4.01it/s]
 14%|█▍        | 51938/371472 [4:08:36<23:10:03,  3.83it/s]
 14%|█▍        | 51939/371472 [4:08:36<22:53:13,  3.88it/s]
 14%|█▍        | 51940/371472 [4:08:37<24:32:20,  3.62it/s]
                                                           
{'loss': 4.2769, 'learning_rate': 8.745771294361006e-07, 'epoch': 2.24}

 14%|█▍        | 51940/371472 [4:08:37<24:32:20,  3.62it/s]
 14%|█▍        | 51941/371472 [4:08:37<24:13:16,  3.66it/s]
 14%|█▍        | 51942/371472 [4:08:37<23:43:38,  3.74it/s]
 14%|█▍        | 51943/371472 [4:08:37<23:24:42,  3.79it/s]
 14%|█▍        | 51944/371472 [4:08:38<23:32:01,  3.77it/s]
 14%|█▍        | 51945/371472 [4:08:38<22:55:36,  3.87it/s]
 14%|█▍        | 51946/371472 [4:08:38<23:43:16,  3.74it/s]
 14%|█▍        | 51947/371472 [4:08:38<24:13:01,  3.67it/s]
 14%|█▍        | 51948/371472 [4:08:39<25:18:57,  3.51it/s]
 14%|█▍        | 51949/371472 [4:08:39<26:12:45,  3.39it/s]
 14%|█▍        | 51950/371472 [4:08:39<26:56:26,  3.29it/s]
 14%|█▍        | 51951/371472 [4:08:40<25:27:33,  3.49it/s]
 14%|█▍        | 51952/371472 [4:08:40<25:04:10,  3.54it/s]
 14%|█▍        | 51953/371472 [4:08:40<24:04:09,  3.69it/s]
 14%|█▍        | 51954/371472 [4:08:40<24:03:32,  3.69it/s]
 14%|█▍        | 51955/371472 [4:08:41<23:54:27,  3.71it/s]
 14%|█▍        | 51956/371472 [4:08:41<23:30:00,  3.78it/s]
 14%|█▍        | 51957/371472 [4:08:41<24:31:09,  3.62it/s]
 14%|█▍        | 51958/371472 [4:08:42<25:40:06,  3.46it/s]
 14%|█▍        | 51959/371472 [4:08:42<25:31:44,  3.48it/s]
 14%|█▍        | 51960/371472 [4:08:42<24:10:44,  3.67it/s]
                                                           
{'loss': 4.2706, 'learning_rate': 8.745286474606218e-07, 'epoch': 2.24}

 14%|█▍        | 51960/371472 [4:08:42<24:10:44,  3.67it/s]
 14%|█▍        | 51961/371472 [4:08:42<24:37:38,  3.60it/s]
 14%|█▍        | 51962/371472 [4:08:43<25:20:58,  3.50it/s]
 14%|█▍        | 51963/371472 [4:08:43<25:15:42,  3.51it/s]
 14%|█▍        | 51964/371472 [4:08:43<25:30:40,  3.48it/s]
 14%|█▍        | 51965/371472 [4:08:43<24:29:26,  3.62it/s]
 14%|█▍        | 51966/371472 [4:08:44<24:21:00,  3.64it/s]
 14%|█▍        | 51967/371472 [4:08:44<35:45:22,  2.48it/s]
 14%|█▍        | 51968/371472 [4:08:45<31:47:52,  2.79it/s]
 14%|█▍        | 51969/371472 [4:08:45<29:33:47,  3.00it/s]
 14%|█▍        | 51970/371472 [4:08:45<27:10:54,  3.27it/s]
 14%|█▍        | 51971/371472 [4:08:45<26:04:47,  3.40it/s]
 14%|█▍        | 51972/371472 [4:08:46<24:46:13,  3.58it/s]
 14%|█▍        | 51973/371472 [4:08:46<25:10:40,  3.52it/s]
 14%|█▍        | 51974/371472 [4:08:46<25:09:01,  3.53it/s]
 14%|█▍        | 51975/371472 [4:08:47<26:04:27,  3.40it/s]
 14%|█▍        | 51976/371472 [4:08:47<25:34:28,  3.47it/s]
 14%|█▍        | 51977/371472 [4:08:47<26:10:29,  3.39it/s]
 14%|█▍        | 51978/371472 [4:08:48<26:08:59,  3.39it/s]
 14%|█▍        | 51979/371472 [4:08:48<24:43:12,  3.59it/s]
 14%|█▍        | 51980/371472 [4:08:48<24:28:43,  3.63it/s]
                                                           
{'loss': 4.2817, 'learning_rate': 8.74480165485143e-07, 'epoch': 2.24}

 14%|█▍        | 51980/371472 [4:08:48<24:28:43,  3.63it/s]
 14%|█▍        | 51981/371472 [4:08:48<24:46:55,  3.58it/s]
 14%|█▍        | 51982/371472 [4:08:49<24:43:32,  3.59it/s]
 14%|█▍        | 51983/371472 [4:08:49<24:38:15,  3.60it/s]
 14%|█▍        | 51984/371472 [4:08:49<23:49:35,  3.72it/s]
 14%|█▍        | 51985/371472 [4:08:49<24:36:01,  3.61it/s]
 14%|█▍        | 51986/371472 [4:08:50<23:36:58,  3.76it/s]
 14%|█▍        | 51987/371472 [4:08:50<24:15:28,  3.66it/s]
 14%|█▍        | 51988/371472 [4:08:50<24:55:30,  3.56it/s]
 14%|█▍        | 51989/371472 [4:08:51<27:25:37,  3.24it/s]
 14%|█▍        | 51990/371472 [4:08:51<27:14:24,  3.26it/s]
 14%|█▍        | 51991/371472 [4:08:51<26:45:11,  3.32it/s]
 14%|█▍        | 51992/371472 [4:08:51<26:12:00,  3.39it/s]
 14%|█▍        | 51993/371472 [4:08:52<25:23:01,  3.50it/s]
 14%|█▍        | 51994/371472 [4:08:52<24:25:31,  3.63it/s]
 14%|█▍        | 51995/371472 [4:08:52<23:58:58,  3.70it/s]
 14%|█▍        | 51996/371472 [4:08:53<23:19:52,  3.80it/s]
 14%|█▍        | 51997/371472 [4:08:53<23:29:40,  3.78it/s]
 14%|█▍        | 51998/371472 [4:08:53<22:58:02,  3.86it/s]
 14%|█▍        | 51999/371472 [4:08:53<23:23:22,  3.79it/s]
 14%|█▍        | 52000/371472 [4:08:54<23:43:55,  3.74it/s]
                                                           
{'loss': 4.1763, 'learning_rate': 8.744316835096641e-07, 'epoch': 2.24}

 14%|█▍        | 52000/371472 [4:08:54<23:43:55,  3.74it/s]
 14%|█▍        | 52001/371472 [4:08:54<24:43:19,  3.59it/s]
 14%|█▍        | 52002/371472 [4:08:54<25:13:22,  3.52it/s]
 14%|█▍        | 52003/371472 [4:08:54<24:54:19,  3.56it/s]
 14%|█▍        | 52004/371472 [4:08:55<27:24:07,  3.24it/s]
 14%|█▍        | 52005/371472 [4:08:55<26:55:00,  3.30it/s]
 14%|█▍        | 52006/371472 [4:08:55<25:58:16,  3.42it/s]
 14%|█▍        | 52007/371472 [4:08:56<24:43:35,  3.59it/s]
 14%|█▍        | 52008/371472 [4:08:56<24:20:12,  3.65it/s]
 14%|█▍        | 52009/371472 [4:08:56<25:11:15,  3.52it/s]
 14%|█▍        | 52010/371472 [4:08:56<24:15:15,  3.66it/s]
 14%|█▍        | 52011/371472 [4:08:57<25:19:37,  3.50it/s]
 14%|█▍        | 52012/371472 [4:08:57<25:21:14,  3.50it/s]
 14%|█▍        | 52013/371472 [4:08:57<24:09:50,  3.67it/s]
 14%|█▍        | 52014/371472 [4:08:58<24:27:42,  3.63it/s]
 14%|█▍        | 52015/371472 [4:08:58<25:38:58,  3.46it/s]
 14%|█▍        | 52016/371472 [4:08:58<25:45:07,  3.45it/s]
 14%|█▍        | 52017/371472 [4:08:58<26:04:56,  3.40it/s]
 14%|█▍        | 52018/371472 [4:08:59<24:25:31,  3.63it/s]
 14%|█▍        | 52019/371472 [4:08:59<23:32:10,  3.77it/s]
 14%|█▍        | 52020/371472 [4:08:59<24:55:07,  3.56it/s]
                                                           
{'loss': 4.3284, 'learning_rate': 8.743832015341851e-07, 'epoch': 2.24}

 14%|█▍        | 52020/371472 [4:08:59<24:55:07,  3.56it/s]
 14%|█▍        | 52021/371472 [4:09:00<25:28:08,  3.48it/s]
 14%|█▍        | 52022/371472 [4:09:00<24:24:22,  3.64it/s]
 14%|█▍        | 52023/371472 [4:09:00<24:13:37,  3.66it/s]
 14%|█▍        | 52024/371472 [4:09:00<24:55:59,  3.56it/s]
 14%|█▍        | 52025/371472 [4:09:01<25:13:46,  3.52it/s]
 14%|█▍        | 52026/371472 [4:09:01<24:47:15,  3.58it/s]
 14%|█▍        | 52027/371472 [4:09:01<24:11:46,  3.67it/s]
 14%|█▍        | 52028/371472 [4:09:01<23:53:56,  3.71it/s]
 14%|█▍        | 52029/371472 [4:09:02<24:19:17,  3.65it/s]
 14%|█▍        | 52030/371472 [4:09:02<23:38:52,  3.75it/s]
 14%|█▍        | 52031/371472 [4:09:02<24:26:13,  3.63it/s]
 14%|█▍        | 52032/371472 [4:09:03<24:30:41,  3.62it/s]
 14%|█▍        | 52033/371472 [4:09:03<25:06:32,  3.53it/s]
 14%|█▍        | 52034/371472 [4:09:03<25:09:41,  3.53it/s]
 14%|█▍        | 52035/371472 [4:09:04<27:26:39,  3.23it/s]
 14%|█▍        | 52036/371472 [4:09:04<26:10:44,  3.39it/s]
 14%|█▍        | 52037/371472 [4:09:04<25:44:34,  3.45it/s]
 14%|█▍        | 52038/371472 [4:09:04<24:50:32,  3.57it/s]
 14%|█▍        | 52039/371472 [4:09:05<25:21:48,  3.50it/s]
 14%|█▍        | 52040/371472 [4:09:05<25:15:45,  3.51it/s]
                                                           
{'loss': 4.3196, 'learning_rate': 8.743347195587063e-07, 'epoch': 2.24}

 14%|█▍        | 52040/371472 [4:09:05<25:15:45,  3.51it/s]
 14%|█▍        | 52041/371472 [4:09:05<25:10:01,  3.53it/s]
 14%|█▍        | 52042/371472 [4:09:05<24:22:33,  3.64it/s]
 14%|█▍        | 52043/371472 [4:09:06<24:19:52,  3.65it/s]
 14%|█▍        | 52044/371472 [4:09:06<23:44:41,  3.74it/s]
 14%|█▍        | 52045/371472 [4:09:06<26:10:40,  3.39it/s]
 14%|█▍        | 52046/371472 [4:09:07<26:10:59,  3.39it/s]
 14%|█▍        | 52047/371472 [4:09:07<26:16:53,  3.38it/s]
 14%|█▍        | 52048/371472 [4:09:07<25:22:09,  3.50it/s]
 14%|█▍        | 52049/371472 [4:09:07<24:50:05,  3.57it/s]
 14%|█▍        | 52050/371472 [4:09:08<24:04:43,  3.68it/s]
 14%|█▍        | 52051/371472 [4:09:08<23:36:52,  3.76it/s]
 14%|█▍        | 52052/371472 [4:09:08<24:51:48,  3.57it/s]
 14%|█▍        | 52053/371472 [4:09:09<24:38:07,  3.60it/s]
 14%|█▍        | 52054/371472 [4:09:09<24:11:19,  3.67it/s]
 14%|█▍        | 52055/371472 [4:09:09<23:53:03,  3.71it/s]
 14%|█▍        | 52056/371472 [4:09:09<26:01:18,  3.41it/s]
 14%|█▍        | 52057/371472 [4:09:10<27:41:43,  3.20it/s]
 14%|█▍        | 52058/371472 [4:09:10<27:51:16,  3.19it/s]
 14%|█▍        | 52059/371472 [4:09:10<26:20:37,  3.37it/s]
 14%|█▍        | 52060/371472 [4:09:11<25:17:16,  3.51it/s]
                                                           
{'loss': 4.4508, 'learning_rate': 8.742862375832273e-07, 'epoch': 2.24}

 14%|█▍        | 52060/371472 [4:09:11<25:17:16,  3.51it/s]
 14%|█▍        | 52061/371472 [4:09:11<24:11:18,  3.67it/s]
 14%|█▍        | 52062/371472 [4:09:11<23:32:05,  3.77it/s]
 14%|█▍        | 52063/371472 [4:09:11<23:03:40,  3.85it/s]
 14%|█▍        | 52064/371472 [4:09:12<23:02:31,  3.85it/s]
 14%|█▍        | 52065/371472 [4:09:12<23:18:17,  3.81it/s]
 14%|█▍        | 52066/371472 [4:09:12<23:15:08,  3.82it/s]
 14%|█▍        | 52067/371472 [4:09:12<25:25:57,  3.49it/s]
 14%|█▍        | 52068/371472 [4:09:13<24:35:16,  3.61it/s]
 14%|█▍        | 52069/371472 [4:09:13<26:15:36,  3.38it/s]
 14%|█▍        | 52070/371472 [4:09:13<24:44:24,  3.59it/s]
 14%|█▍        | 52071/371472 [4:09:14<24:58:07,  3.55it/s]
 14%|█▍        | 52072/371472 [4:09:14<25:39:08,  3.46it/s]
 14%|█▍        | 52073/371472 [4:09:14<24:39:49,  3.60it/s]
 14%|█▍        | 52074/371472 [4:09:15<28:18:37,  3.13it/s]
 14%|█▍        | 52075/371472 [4:09:15<27:33:35,  3.22it/s]
 14%|█▍        | 52076/371472 [4:09:15<26:40:57,  3.33it/s]
 14%|█▍        | 52077/371472 [4:09:15<25:59:59,  3.41it/s]
 14%|█▍        | 52078/371472 [4:09:16<25:12:52,  3.52it/s]
 14%|█▍        | 52079/371472 [4:09:16<26:33:45,  3.34it/s]
 14%|█▍        | 52080/371472 [4:09:16<26:16:42,  3.38it/s]
                                                           
{'loss': 4.0581, 'learning_rate': 8.742377556077485e-07, 'epoch': 2.24}

 14%|█▍        | 52080/371472 [4:09:16<26:16:42,  3.38it/s]
 14%|█▍        | 52081/371472 [4:09:17<25:13:42,  3.52it/s]
 14%|█▍        | 52082/371472 [4:09:17<25:39:00,  3.46it/s]
 14%|█▍        | 52083/371472 [4:09:17<25:05:01,  3.54it/s]
 14%|█▍        | 52084/371472 [4:09:17<25:35:48,  3.47it/s]
 14%|█▍        | 52085/371472 [4:09:18<24:57:38,  3.55it/s]
 14%|█▍        | 52086/371472 [4:09:18<23:54:07,  3.71it/s]
 14%|█▍        | 52087/371472 [4:09:18<23:07:00,  3.84it/s]
 14%|█▍        | 52088/371472 [4:09:18<23:02:56,  3.85it/s]
 14%|█▍        | 52089/371472 [4:09:19<22:47:05,  3.89it/s]
 14%|█▍        | 52090/371472 [4:09:19<23:25:55,  3.79it/s]
 14%|█▍        | 52091/371472 [4:09:19<25:05:16,  3.54it/s]
 14%|█▍        | 52092/371472 [4:09:20<24:13:12,  3.66it/s]
 14%|█▍        | 52093/371472 [4:09:20<24:06:30,  3.68it/s]
 14%|█▍        | 52094/371472 [4:09:20<25:14:03,  3.52it/s]
 14%|█▍        | 52095/371472 [4:09:20<26:01:12,  3.41it/s]
 14%|█▍        | 52096/371472 [4:09:21<24:50:23,  3.57it/s]
 14%|█▍        | 52097/371472 [4:09:21<25:16:01,  3.51it/s]
 14%|█▍        | 52098/371472 [4:09:21<25:22:48,  3.50it/s]
 14%|█▍        | 52099/371472 [4:09:22<25:03:39,  3.54it/s]
 14%|█▍        | 52100/371472 [4:09:22<24:42:23,  3.59it/s]
                                                           
{'loss': 4.3669, 'learning_rate': 8.741892736322696e-07, 'epoch': 2.24}

 14%|█▍        | 52100/371472 [4:09:22<24:42:23,  3.59it/s]
 14%|█▍        | 52101/371472 [4:09:22<23:51:08,  3.72it/s]
 14%|█▍        | 52102/371472 [4:09:22<23:43:12,  3.74it/s]
 14%|█▍        | 52103/371472 [4:09:23<23:04:14,  3.85it/s]
 14%|█▍        | 52104/371472 [4:09:23<24:43:17,  3.59it/s]
 14%|█▍        | 52105/371472 [4:09:23<23:30:08,  3.77it/s]
 14%|█▍        | 52106/371472 [4:09:23<22:48:49,  3.89it/s]
 14%|█▍        | 52107/371472 [4:09:24<22:30:43,  3.94it/s]
 14%|█▍        | 52108/371472 [4:09:24<22:31:45,  3.94it/s]
 14%|█▍        | 52109/371472 [4:09:24<24:01:27,  3.69it/s]
 14%|█▍        | 52110/371472 [4:09:24<25:17:03,  3.51it/s]
 14%|█▍        | 52111/371472 [4:09:25<24:26:27,  3.63it/s]
 14%|█▍        | 52112/371472 [4:09:25<24:17:46,  3.65it/s]
 14%|█▍        | 52113/371472 [4:09:25<25:46:45,  3.44it/s]
 14%|█▍        | 52114/371472 [4:09:26<25:46:01,  3.44it/s]
 14%|█▍        | 52115/371472 [4:09:26<24:28:58,  3.62it/s]
 14%|█▍        | 52116/371472 [4:09:26<24:34:48,  3.61it/s]
 14%|█▍        | 52117/371472 [4:09:26<25:13:47,  3.52it/s]
 14%|█▍        | 52118/371472 [4:09:27<24:55:05,  3.56it/s]
 14%|█▍        | 52119/371472 [4:09:27<23:51:42,  3.72it/s]
 14%|█▍        | 52120/371472 [4:09:27<23:06:48,  3.84it/s]
                                                           
{'loss': 4.1813, 'learning_rate': 8.741407916567907e-07, 'epoch': 2.24}

 14%|█▍        | 52120/371472 [4:09:27<23:06:48,  3.84it/s]
 14%|█▍        | 52121/371472 [4:09:27<23:29:58,  3.77it/s]
 14%|█▍        | 52122/371472 [4:09:28<23:59:28,  3.70it/s]
 14%|█▍        | 52123/371472 [4:09:28<25:38:29,  3.46it/s]
 14%|█▍        | 52124/371472 [4:09:28<27:16:35,  3.25it/s]
 14%|█▍        | 52125/371472 [4:09:29<26:59:37,  3.29it/s]
 14%|█▍        | 52126/371472 [4:09:29<26:01:46,  3.41it/s]
 14%|█▍        | 52127/371472 [4:09:29<28:46:41,  3.08it/s]
 14%|█▍        | 52128/371472 [4:09:30<27:48:05,  3.19it/s]
 14%|█▍        | 52129/371472 [4:09:30<26:01:09,  3.41it/s]
 14%|█▍        | 52130/371472 [4:09:30<25:28:55,  3.48it/s]
 14%|█▍        | 52131/371472 [4:09:30<25:08:24,  3.53it/s]
 14%|█▍        | 52132/371472 [4:09:31<27:08:50,  3.27it/s]
 14%|█▍        | 52133/371472 [4:09:31<25:47:29,  3.44it/s]
 14%|█▍        | 52134/371472 [4:09:31<24:52:53,  3.57it/s]
 14%|█▍        | 52135/371472 [4:09:32<24:34:33,  3.61it/s]
 14%|█▍        | 52136/371472 [4:09:32<24:50:19,  3.57it/s]
 14%|█▍        | 52137/371472 [4:09:32<24:36:43,  3.60it/s]
 14%|█▍        | 52138/371472 [4:09:32<25:08:46,  3.53it/s]
 14%|█▍        | 52139/371472 [4:09:33<24:53:17,  3.56it/s]
 14%|█▍        | 52140/371472 [4:09:33<25:22:02,  3.50it/s]
                                                           
{'loss': 4.2587, 'learning_rate': 8.740923096813118e-07, 'epoch': 2.25}

 14%|█▍        | 52140/371472 [4:09:33<25:22:02,  3.50it/s]
 14%|█▍        | 52141/371472 [4:09:33<25:52:56,  3.43it/s]
 14%|█▍        | 52142/371472 [4:09:34<24:17:46,  3.65it/s]
 14%|█▍        | 52143/371472 [4:09:34<24:18:30,  3.65it/s]
 14%|█▍        | 52144/371472 [4:09:34<24:13:01,  3.66it/s]
 14%|█▍        | 52145/371472 [4:09:34<24:07:42,  3.68it/s]
 14%|█▍        | 52146/371472 [4:09:35<23:31:35,  3.77it/s]
 14%|█▍        | 52147/371472 [4:09:35<23:43:43,  3.74it/s]
 14%|█▍        | 52148/371472 [4:09:35<23:40:10,  3.75it/s]
 14%|█▍        | 52149/371472 [4:09:35<23:25:21,  3.79it/s]
 14%|█▍        | 52150/371472 [4:09:36<23:37:18,  3.76it/s]
 14%|█▍        | 52151/371472 [4:09:36<23:18:34,  3.81it/s]
 14%|█▍        | 52152/371472 [4:09:36<23:55:04,  3.71it/s]
 14%|█▍        | 52153/371472 [4:09:37<24:17:54,  3.65it/s]
 14%|█▍        | 52154/371472 [4:09:37<23:27:53,  3.78it/s]
 14%|█▍        | 52155/371472 [4:09:37<24:03:46,  3.69it/s]
 14%|█▍        | 52156/371472 [4:09:37<23:47:32,  3.73it/s]
 14%|█▍        | 52157/371472 [4:09:38<23:43:33,  3.74it/s]
 14%|█▍        | 52158/371472 [4:09:38<25:21:51,  3.50it/s]
 14%|█▍        | 52159/371472 [4:09:38<25:03:13,  3.54it/s]
 14%|█▍        | 52160/371472 [4:09:39<26:35:08,  3.34it/s]
                                                           
{'loss': 4.1264, 'learning_rate': 8.74043827705833e-07, 'epoch': 2.25}

 14%|█▍        | 52160/371472 [4:09:39<26:35:08,  3.34it/s]
 14%|█▍        | 52161/371472 [4:09:39<25:26:09,  3.49it/s]
 14%|█▍        | 52162/371472 [4:09:39<25:56:11,  3.42it/s]
 14%|█▍        | 52163/371472 [4:09:39<26:23:08,  3.36it/s]
 14%|█▍        | 52164/371472 [4:09:40<26:00:40,  3.41it/s]
 14%|█▍        | 52165/371472 [4:09:40<25:57:23,  3.42it/s]
 14%|█▍        | 52166/371472 [4:09:40<25:57:04,  3.42it/s]
 14%|█▍        | 52167/371472 [4:09:41<25:05:11,  3.54it/s]
 14%|█▍        | 52168/371472 [4:09:41<26:19:40,  3.37it/s]
 14%|█▍        | 52169/371472 [4:09:41<25:46:00,  3.44it/s]
 14%|█▍        | 52170/371472 [4:09:41<25:58:10,  3.42it/s]
 14%|█▍        | 52171/371472 [4:09:42<24:55:38,  3.56it/s]
 14%|█▍        | 52172/371472 [4:09:42<24:57:02,  3.55it/s]
 14%|█▍        | 52173/371472 [4:09:42<24:43:29,  3.59it/s]
 14%|█▍        | 52174/371472 [4:09:43<24:19:28,  3.65it/s]
 14%|█▍        | 52175/371472 [4:09:43<25:09:52,  3.52it/s]
 14%|█▍        | 52176/371472 [4:09:43<24:15:05,  3.66it/s]
 14%|█▍        | 52177/371472 [4:09:43<24:21:15,  3.64it/s]
 14%|█▍        | 52178/371472 [4:09:44<24:03:53,  3.69it/s]
 14%|█▍        | 52179/371472 [4:09:44<23:39:24,  3.75it/s]
 14%|█▍        | 52180/371472 [4:09:44<23:01:09,  3.85it/s]
                                                           
{'loss': 4.2917, 'learning_rate': 8.739953457303539e-07, 'epoch': 2.25}

 14%|█▍        | 52180/371472 [4:09:44<23:01:09,  3.85it/s]
 14%|█▍        | 52181/371472 [4:09:44<23:35:31,  3.76it/s]
 14%|█▍        | 52182/371472 [4:09:45<23:15:41,  3.81it/s]
 14%|█▍        | 52183/371472 [4:09:45<23:56:45,  3.70it/s]
 14%|█▍        | 52184/371472 [4:09:45<24:19:03,  3.65it/s]
 14%|█▍        | 52185/371472 [4:09:46<25:20:43,  3.50it/s]
 14%|█▍        | 52186/371472 [4:09:46<24:42:32,  3.59it/s]
 14%|█▍        | 52187/371472 [4:09:46<24:49:29,  3.57it/s]
 14%|█▍        | 52188/371472 [4:09:46<24:45:33,  3.58it/s]
 14%|█▍        | 52189/371472 [4:09:47<25:57:31,  3.42it/s]
 14%|█▍        | 52190/371472 [4:09:47<25:52:41,  3.43it/s]
 14%|█▍        | 52191/371472 [4:09:47<26:42:37,  3.32it/s]
 14%|█▍        | 52192/371472 [4:09:48<26:44:32,  3.32it/s]
 14%|█▍        | 52193/371472 [4:09:48<26:13:58,  3.38it/s]
 14%|█▍        | 52194/371472 [4:09:48<25:00:08,  3.55it/s]
 14%|█▍        | 52195/371472 [4:09:48<24:22:27,  3.64it/s]
 14%|█▍        | 52196/371472 [4:09:49<25:07:01,  3.53it/s]
 14%|█▍        | 52197/371472 [4:09:49<24:21:49,  3.64it/s]
 14%|█▍        | 52198/371472 [4:09:49<29:03:35,  3.05it/s]
 14%|█▍        | 52199/371472 [4:09:50<29:20:37,  3.02it/s]
 14%|█▍        | 52200/371472 [4:09:50<26:47:06,  3.31it/s]
                                                           
{'loss': 4.3568, 'learning_rate': 8.739468637548751e-07, 'epoch': 2.25}

 14%|█▍        | 52200/371472 [4:09:50<26:47:06,  3.31it/s]
 14%|█▍        | 52201/371472 [4:09:50<27:04:02,  3.28it/s]
 14%|█▍        | 52202/371472 [4:09:51<26:37:01,  3.33it/s]
 14%|█▍        | 52203/371472 [4:09:51<26:01:10,  3.41it/s]
 14%|█▍        | 52204/371472 [4:09:51<24:26:40,  3.63it/s]
 14%|█▍        | 52205/371472 [4:09:51<25:31:55,  3.47it/s]
 14%|█▍        | 52206/371472 [4:09:52<24:02:42,  3.69it/s]
 14%|█▍        | 52207/371472 [4:09:52<23:33:23,  3.76it/s]
 14%|█▍        | 52208/371472 [4:09:52<23:02:55,  3.85it/s]
 14%|█▍        | 52209/371472 [4:09:52<23:37:19,  3.75it/s]
 14%|█▍        | 52210/371472 [4:09:53<23:02:56,  3.85it/s]
 14%|█▍        | 52211/371472 [4:09:53<22:26:50,  3.95it/s]
 14%|█▍        | 52212/371472 [4:09:53<23:48:08,  3.73it/s]
 14%|█▍        | 52213/371472 [4:09:53<23:22:58,  3.79it/s]
 14%|█▍        | 52214/371472 [4:09:54<23:29:51,  3.77it/s]
 14%|█▍        | 52215/371472 [4:09:54<23:15:19,  3.81it/s]
 14%|█▍        | 52216/371472 [4:09:54<23:43:58,  3.74it/s]
 14%|█▍        | 52217/371472 [4:09:55<24:41:38,  3.59it/s]
 14%|█▍        | 52218/371472 [4:09:55<23:53:56,  3.71it/s]
 14%|█▍        | 52219/371472 [4:09:55<25:15:17,  3.51it/s]
 14%|█▍        | 52220/371472 [4:09:56<27:30:20,  3.22it/s]
                                                           
{'loss': 4.3348, 'learning_rate': 8.738983817793962e-07, 'epoch': 2.25}

 14%|█▍        | 52220/371472 [4:09:56<27:30:20,  3.22it/s]
 14%|█▍        | 52221/371472 [4:09:56<26:03:52,  3.40it/s]
 14%|█▍        | 52222/371472 [4:09:56<26:20:30,  3.37it/s]
 14%|█▍        | 52223/371472 [4:09:56<26:18:11,  3.37it/s]
 14%|█▍        | 52224/371472 [4:09:57<25:40:43,  3.45it/s]
 14%|█▍        | 52225/371472 [4:09:57<25:11:59,  3.52it/s]
 14%|█▍        | 52226/371472 [4:09:57<24:05:57,  3.68it/s]
 14%|█▍        | 52227/371472 [4:09:57<24:19:12,  3.65it/s]
 14%|█▍        | 52228/371472 [4:09:58<26:19:06,  3.37it/s]
 14%|█▍        | 52229/371472 [4:09:58<25:47:21,  3.44it/s]
 14%|█▍        | 52230/371472 [4:09:58<25:03:43,  3.54it/s]
 14%|█▍        | 52231/371472 [4:09:59<24:23:06,  3.64it/s]
 14%|█▍        | 52232/371472 [4:09:59<24:25:11,  3.63it/s]
 14%|█▍        | 52233/371472 [4:09:59<24:25:04,  3.63it/s]
 14%|█▍        | 52234/371472 [4:09:59<25:13:21,  3.52it/s]
 14%|█▍        | 52235/371472 [4:10:00<26:09:46,  3.39it/s]
 14%|█▍        | 52236/371472 [4:10:00<25:51:23,  3.43it/s]
 14%|█▍        | 52237/371472 [4:10:00<24:52:19,  3.57it/s]
 14%|█▍        | 52238/371472 [4:10:01<25:31:50,  3.47it/s]
 14%|█▍        | 52239/371472 [4:10:01<25:04:55,  3.54it/s]
 14%|█▍        | 52240/371472 [4:10:01<24:41:02,  3.59it/s]
                                                           
{'loss': 4.3902, 'learning_rate': 8.738498998039173e-07, 'epoch': 2.25}

 14%|█▍        | 52240/371472 [4:10:01<24:41:02,  3.59it/s]
 14%|█▍        | 52241/371472 [4:10:01<24:18:05,  3.65it/s]
 14%|█▍        | 52242/371472 [4:10:02<24:09:00,  3.67it/s]
 14%|█▍        | 52243/371472 [4:10:02<24:58:11,  3.55it/s]
 14%|█▍        | 52244/371472 [4:10:02<24:56:55,  3.55it/s]
 14%|█▍        | 52245/371472 [4:10:03<25:12:32,  3.52it/s]
 14%|█▍        | 52246/371472 [4:10:03<26:08:34,  3.39it/s]
 14%|█▍        | 52247/371472 [4:10:03<25:12:11,  3.52it/s]
 14%|█▍        | 52248/371472 [4:10:03<24:03:25,  3.69it/s]
 14%|█▍        | 52249/371472 [4:10:04<24:29:43,  3.62it/s]
 14%|█▍        | 52250/371472 [4:10:04<24:05:33,  3.68it/s]
 14%|█▍        | 52251/371472 [4:10:04<24:17:06,  3.65it/s]
 14%|█▍        | 52252/371472 [4:10:04<23:47:35,  3.73it/s]
 14%|█▍        | 52253/371472 [4:10:05<23:09:18,  3.83it/s]
 14%|█▍        | 52254/371472 [4:10:05<23:22:21,  3.79it/s]
 14%|█▍        | 52255/371472 [4:10:05<25:06:08,  3.53it/s]
 14%|█▍        | 52256/371472 [4:10:06<24:45:39,  3.58it/s]
 14%|█▍        | 52257/371472 [4:10:06<25:41:40,  3.45it/s]
 14%|█▍        | 52258/371472 [4:10:06<25:24:29,  3.49it/s]
 14%|█▍        | 52259/371472 [4:10:06<24:46:14,  3.58it/s]
 14%|█▍        | 52260/371472 [4:10:07<25:03:08,  3.54it/s]
                                                           
{'loss': 4.1351, 'learning_rate': 8.738014178284384e-07, 'epoch': 2.25}

 14%|█▍        | 52260/371472 [4:10:07<25:03:08,  3.54it/s]
 14%|█▍        | 52261/371472 [4:10:07<24:28:48,  3.62it/s]
 14%|█▍        | 52262/371472 [4:10:07<24:15:37,  3.65it/s]
 14%|█▍        | 52263/371472 [4:10:08<26:06:19,  3.40it/s]
 14%|█▍        | 52264/371472 [4:10:08<25:39:00,  3.46it/s]
 14%|█▍        | 52265/371472 [4:10:08<25:53:30,  3.42it/s]
 14%|█▍        | 52266/371472 [4:10:09<27:37:36,  3.21it/s]
 14%|█▍        | 52267/371472 [4:10:09<27:38:13,  3.21it/s]
 14%|█▍        | 52268/371472 [4:10:09<28:54:25,  3.07it/s]
 14%|█▍        | 52269/371472 [4:10:09<27:11:44,  3.26it/s]
 14%|█▍        | 52270/371472 [4:10:10<26:02:25,  3.40it/s]
 14%|█▍        | 52271/371472 [4:10:10<24:46:38,  3.58it/s]
 14%|█▍        | 52272/371472 [4:10:10<23:54:34,  3.71it/s]
 14%|█▍        | 52273/371472 [4:10:10<23:18:18,  3.80it/s]
 14%|█▍        | 52274/371472 [4:10:11<23:19:31,  3.80it/s]
 14%|█▍        | 52275/371472 [4:10:11<25:05:43,  3.53it/s]
 14%|█▍        | 52276/371472 [4:10:11<23:58:47,  3.70it/s]
 14%|█▍        | 52277/371472 [4:10:12<22:58:41,  3.86it/s]
 14%|█▍        | 52278/371472 [4:10:12<22:42:21,  3.90it/s]
 14%|█▍        | 52279/371472 [4:10:12<23:47:58,  3.73it/s]
 14%|█▍        | 52280/371472 [4:10:12<23:24:15,  3.79it/s]
                                                           
{'loss': 4.3549, 'learning_rate': 8.737529358529596e-07, 'epoch': 2.25}

 14%|█▍        | 52280/371472 [4:10:12<23:24:15,  3.79it/s]
 14%|█▍        | 52281/371472 [4:10:13<26:04:53,  3.40it/s]
 14%|█▍        | 52282/371472 [4:10:13<25:28:21,  3.48it/s]
 14%|█▍        | 52283/371472 [4:10:13<26:35:24,  3.33it/s]
 14%|█▍        | 52284/371472 [4:10:14<27:05:37,  3.27it/s]
 14%|█▍        | 52285/371472 [4:10:14<26:01:27,  3.41it/s]
 14%|█▍        | 52286/371472 [4:10:14<25:42:47,  3.45it/s]
 14%|█▍        | 52287/371472 [4:10:14<24:48:00,  3.58it/s]
 14%|█▍        | 52288/371472 [4:10:15<24:34:48,  3.61it/s]
 14%|█▍        | 52289/371472 [4:10:15<23:33:35,  3.76it/s]
 14%|█▍        | 52290/371472 [4:10:15<23:06:01,  3.84it/s]
 14%|█▍        | 52291/371472 [4:10:15<24:19:25,  3.65it/s]
 14%|█▍        | 52292/371472 [4:10:16<23:40:04,  3.75it/s]
 14%|█▍        | 52293/371472 [4:10:16<22:57:51,  3.86it/s]
 14%|█▍        | 52294/371472 [4:10:16<22:59:54,  3.86it/s]
 14%|█▍        | 52295/371472 [4:10:16<23:45:32,  3.73it/s]
 14%|█▍        | 52296/371472 [4:10:17<23:29:24,  3.77it/s]
 14%|█▍        | 52297/371472 [4:10:17<23:13:16,  3.82it/s]
 14%|█▍        | 52298/371472 [4:10:17<23:42:44,  3.74it/s]
 14%|█▍        | 52299/371472 [4:10:18<24:47:19,  3.58it/s]
 14%|█▍        | 52300/371472 [4:10:18<24:53:57,  3.56it/s]
                                                           
{'loss': 4.2185, 'learning_rate': 8.737044538774807e-07, 'epoch': 2.25}

 14%|█▍        | 52300/371472 [4:10:18<24:53:57,  3.56it/s]
 14%|█▍        | 52301/371472 [4:10:18<25:25:11,  3.49it/s]
 14%|█▍        | 52302/371472 [4:10:18<25:47:37,  3.44it/s]
 14%|█▍        | 52303/371472 [4:10:19<25:03:28,  3.54it/s]
 14%|█▍        | 52304/371472 [4:10:19<25:02:04,  3.54it/s]
 14%|█▍        | 52305/371472 [4:10:19<26:17:50,  3.37it/s]
 14%|█▍        | 52306/371472 [4:10:20<27:23:11,  3.24it/s]
 14%|█▍        | 52307/371472 [4:10:20<27:31:46,  3.22it/s]
 14%|█▍        | 52308/371472 [4:10:20<26:00:44,  3.41it/s]
 14%|█▍        | 52309/371472 [4:10:21<26:58:14,  3.29it/s]
 14%|█▍        | 52310/371472 [4:10:21<25:55:13,  3.42it/s]
 14%|█▍        | 52311/371472 [4:10:21<26:05:42,  3.40it/s]
 14%|█▍        | 52312/371472 [4:10:21<25:15:48,  3.51it/s]
 14%|█▍        | 52313/371472 [4:10:22<24:52:42,  3.56it/s]
 14%|█▍        | 52314/371472 [4:10:22<25:44:13,  3.44it/s]
 14%|█▍        | 52315/371472 [4:10:22<25:44:21,  3.44it/s]
 14%|█▍        | 52316/371472 [4:10:23<25:05:04,  3.53it/s]
 14%|█▍        | 52317/371472 [4:10:23<26:16:36,  3.37it/s]
 14%|█▍        | 52318/371472 [4:10:23<25:50:11,  3.43it/s]
 14%|█▍        | 52319/371472 [4:10:23<26:49:21,  3.31it/s]
 14%|█▍        | 52320/371472 [4:10:24<25:14:50,  3.51it/s]
                                                           
{'loss': 4.0571, 'learning_rate': 8.736559719020016e-07, 'epoch': 2.25}

 14%|█▍        | 52320/371472 [4:10:24<25:14:50,  3.51it/s]
 14%|█▍        | 52321/371472 [4:10:24<25:33:48,  3.47it/s]
 14%|█▍        | 52322/371472 [4:10:24<25:51:35,  3.43it/s]
 14%|█▍        | 52323/371472 [4:10:25<26:01:56,  3.41it/s]
 14%|█▍        | 52324/371472 [4:10:25<24:47:18,  3.58it/s]
 14%|█▍        | 52325/371472 [4:10:25<24:42:46,  3.59it/s]
 14%|█▍        | 52326/371472 [4:10:25<23:20:46,  3.80it/s]
 14%|█▍        | 52327/371472 [4:10:26<23:21:51,  3.79it/s]
 14%|█▍        | 52328/371472 [4:10:26<23:34:50,  3.76it/s]
 14%|█▍        | 52329/371472 [4:10:26<23:46:05,  3.73it/s]
 14%|█▍        | 52330/371472 [4:10:26<23:42:35,  3.74it/s]
 14%|█▍        | 52331/371472 [4:10:27<23:33:09,  3.76it/s]
 14%|█▍        | 52332/371472 [4:10:27<23:37:49,  3.75it/s]
 14%|█▍        | 52333/371472 [4:10:27<23:23:02,  3.79it/s]
 14%|█▍        | 52334/371472 [4:10:28<23:43:17,  3.74it/s]
 14%|█▍        | 52335/371472 [4:10:28<24:30:03,  3.62it/s]
 14%|█▍        | 52336/371472 [4:10:28<24:40:36,  3.59it/s]
 14%|█▍        | 52337/371472 [4:10:28<24:23:29,  3.63it/s]
 14%|█▍        | 52338/371472 [4:10:29<23:27:48,  3.78it/s]
 14%|█▍        | 52339/371472 [4:10:29<23:00:25,  3.85it/s]
 14%|█▍        | 52340/371472 [4:10:29<23:22:11,  3.79it/s]
                                                           
{'loss': 4.1322, 'learning_rate': 8.736074899265228e-07, 'epoch': 2.25}

 14%|█▍        | 52340/371472 [4:10:29<23:22:11,  3.79it/s]
 14%|█▍        | 52341/371472 [4:10:29<23:07:54,  3.83it/s]
 14%|█▍        | 52342/371472 [4:10:30<22:53:37,  3.87it/s]
 14%|█▍        | 52343/371472 [4:10:30<26:42:34,  3.32it/s]
 14%|█▍        | 52344/371472 [4:10:30<26:10:01,  3.39it/s]
 14%|█▍        | 52345/371472 [4:10:31<27:17:03,  3.25it/s]
 14%|█▍        | 52346/371472 [4:10:31<25:52:05,  3.43it/s]
 14%|█▍        | 52347/371472 [4:10:31<25:18:12,  3.50it/s]
 14%|█▍        | 52348/371472 [4:10:31<25:41:26,  3.45it/s]
 14%|█▍        | 52349/371472 [4:10:32<25:54:33,  3.42it/s]
 14%|█▍        | 52350/371472 [4:10:32<25:56:52,  3.42it/s]
 14%|█▍        | 52351/371472 [4:10:32<25:35:32,  3.46it/s]
 14%|█▍        | 52352/371472 [4:10:33<24:19:54,  3.64it/s]
 14%|█▍        | 52353/371472 [4:10:33<24:32:44,  3.61it/s]
 14%|█▍        | 52354/371472 [4:10:33<26:08:17,  3.39it/s]
 14%|█▍        | 52355/371472 [4:10:34<26:08:40,  3.39it/s]
 14%|█▍        | 52356/371472 [4:10:34<25:28:28,  3.48it/s]
 14%|█▍        | 52357/371472 [4:10:34<25:41:02,  3.45it/s]
 14%|█▍        | 52358/371472 [4:10:34<25:23:21,  3.49it/s]
 14%|█▍        | 52359/371472 [4:10:35<24:02:00,  3.69it/s]
 14%|█▍        | 52360/371472 [4:10:35<24:59:34,  3.55it/s]
                                                           
{'loss': 4.1068, 'learning_rate': 8.73559007951044e-07, 'epoch': 2.26}

 14%|█▍        | 52360/371472 [4:10:35<24:59:34,  3.55it/s]
 14%|█▍        | 52361/371472 [4:10:35<25:44:24,  3.44it/s]
 14%|█▍        | 52362/371472 [4:10:36<26:55:34,  3.29it/s]
 14%|█▍        | 52363/371472 [4:10:36<25:43:21,  3.45it/s]
 14%|█▍        | 52364/371472 [4:10:36<26:19:36,  3.37it/s]
 14%|█▍        | 52365/371472 [4:10:36<26:06:11,  3.40it/s]
 14%|█▍        | 52366/371472 [4:10:37<24:56:08,  3.55it/s]
 14%|█▍        | 52367/371472 [4:10:37<25:16:05,  3.51it/s]
 14%|█▍        | 52368/371472 [4:10:37<24:38:10,  3.60it/s]
 14%|█▍        | 52369/371472 [4:10:37<24:24:46,  3.63it/s]
 14%|█▍        | 52370/371472 [4:10:38<23:56:14,  3.70it/s]
 14%|█▍        | 52371/371472 [4:10:38<24:17:45,  3.65it/s]
 14%|█▍        | 52372/371472 [4:10:38<24:31:49,  3.61it/s]
 14%|█▍        | 52373/371472 [4:10:39<24:02:48,  3.69it/s]
 14%|█▍        | 52374/371472 [4:10:39<23:23:22,  3.79it/s]
 14%|█▍        | 52375/371472 [4:10:39<22:43:16,  3.90it/s]
 14%|█▍        | 52376/371472 [4:10:39<22:58:31,  3.86it/s]
 14%|█▍        | 52377/371472 [4:10:40<24:02:57,  3.69it/s]
 14%|█▍        | 52378/371472 [4:10:40<23:50:17,  3.72it/s]
 14%|█▍        | 52379/371472 [4:10:40<22:54:35,  3.87it/s]
 14%|█▍        | 52380/371472 [4:10:40<23:38:27,  3.75it/s]
                                                           
{'loss': 4.4032, 'learning_rate': 8.73510525975565e-07, 'epoch': 2.26}

 14%|█▍        | 52380/371472 [4:10:40<23:38:27,  3.75it/s]
 14%|█▍        | 52381/371472 [4:10:41<24:10:55,  3.67it/s]
 14%|█▍        | 52382/371472 [4:10:41<24:14:15,  3.66it/s]
 14%|█▍        | 52383/371472 [4:10:41<24:07:15,  3.67it/s]
 14%|█▍        | 52384/371472 [4:10:41<24:05:19,  3.68it/s]
 14%|█▍        | 52385/371472 [4:10:42<24:37:41,  3.60it/s]
 14%|█▍        | 52386/371472 [4:10:42<23:27:17,  3.78it/s]
 14%|█▍        | 52387/371472 [4:10:42<23:58:03,  3.70it/s]
 14%|█▍        | 52388/371472 [4:10:43<24:45:30,  3.58it/s]
 14%|█▍        | 52389/371472 [4:10:43<24:51:28,  3.57it/s]
 14%|█▍        | 52390/371472 [4:10:43<24:29:52,  3.62it/s]
 14%|█▍        | 52391/371472 [4:10:43<24:28:31,  3.62it/s]
 14%|█▍        | 52392/371472 [4:10:44<24:05:51,  3.68it/s]
 14%|█▍        | 52393/371472 [4:10:44<24:28:18,  3.62it/s]
 14%|█▍        | 52394/371472 [4:10:44<24:27:37,  3.62it/s]
 14%|█▍        | 52395/371472 [4:10:45<24:13:36,  3.66it/s]
 14%|█▍        | 52396/371472 [4:10:45<24:49:24,  3.57it/s]
 14%|█▍        | 52397/371472 [4:10:45<23:50:48,  3.72it/s]
 14%|█▍        | 52398/371472 [4:10:45<24:41:13,  3.59it/s]
 14%|█▍        | 52399/371472 [4:10:46<24:05:40,  3.68it/s]
 14%|█▍        | 52400/371472 [4:10:46<23:51:00,  3.72it/s]
                                                           
{'loss': 4.2477, 'learning_rate': 8.734620440000861e-07, 'epoch': 2.26}

 14%|█▍        | 52400/371472 [4:10:46<23:51:00,  3.72it/s]
 14%|█▍        | 52401/371472 [4:10:46<23:35:14,  3.76it/s]
 14%|█▍        | 52402/371472 [4:10:46<24:30:20,  3.62it/s]
 14%|█▍        | 52403/371472 [4:10:47<23:47:19,  3.73it/s]
 14%|█▍        | 52404/371472 [4:10:47<24:20:09,  3.64it/s]
 14%|█▍        | 52405/371472 [4:10:47<24:29:54,  3.62it/s]
 14%|█▍        | 52406/371472 [4:10:48<24:34:47,  3.61it/s]
 14%|█▍        | 52407/371472 [4:10:48<25:03:05,  3.54it/s]
 14%|█▍        | 52408/371472 [4:10:48<26:39:44,  3.32it/s]
 14%|█▍        | 52409/371472 [4:10:48<25:23:35,  3.49it/s]
 14%|█▍        | 52410/371472 [4:10:49<28:01:54,  3.16it/s]
 14%|█▍        | 52411/371472 [4:10:49<28:18:06,  3.13it/s]
 14%|█▍        | 52412/371472 [4:10:49<27:35:59,  3.21it/s]
 14%|█▍        | 52413/371472 [4:10:50<28:10:59,  3.14it/s]
 14%|█▍        | 52414/371472 [4:10:50<27:29:38,  3.22it/s]
 14%|█▍        | 52415/371472 [4:10:50<25:54:33,  3.42it/s]
 14%|█▍        | 52416/371472 [4:10:51<24:31:48,  3.61it/s]
 14%|█▍        | 52417/371472 [4:10:51<24:05:21,  3.68it/s]
 14%|█▍        | 52418/371472 [4:10:51<24:13:27,  3.66it/s]
 14%|█▍        | 52419/371472 [4:10:51<24:37:50,  3.60it/s]
 14%|█▍        | 52420/371472 [4:10:52<23:28:45,  3.77it/s]
                                                           
{'loss': 4.3231, 'learning_rate': 8.734135620246073e-07, 'epoch': 2.26}

 14%|█▍        | 52420/371472 [4:10:52<23:28:45,  3.77it/s]
 14%|█▍        | 52421/371472 [4:10:52<25:10:28,  3.52it/s]
 14%|█▍        | 52422/371472 [4:10:52<24:48:56,  3.57it/s]
 14%|█▍        | 52423/371472 [4:10:53<27:21:04,  3.24it/s]
 14%|█▍        | 52424/371472 [4:10:53<26:09:45,  3.39it/s]
 14%|█▍        | 52425/371472 [4:10:53<25:17:45,  3.50it/s]
 14%|█▍        | 52426/371472 [4:10:53<24:41:57,  3.59it/s]
 14%|█▍        | 52427/371472 [4:10:54<24:44:39,  3.58it/s]
 14%|█▍        | 52428/371472 [4:10:54<23:50:58,  3.72it/s]
 14%|█▍        | 52429/371472 [4:10:54<23:35:47,  3.76it/s]
 14%|█▍        | 52430/371472 [4:10:54<22:57:11,  3.86it/s]
 14%|█▍        | 52431/371472 [4:10:55<22:39:29,  3.91it/s]
 14%|█▍        | 52432/371472 [4:10:55<24:12:57,  3.66it/s]
 14%|█▍        | 52433/371472 [4:10:55<23:34:57,  3.76it/s]
 14%|█▍        | 52434/371472 [4:10:55<23:15:01,  3.81it/s]
 14%|█▍        | 52435/371472 [4:10:56<23:52:32,  3.71it/s]
 14%|█▍        | 52436/371472 [4:10:56<23:54:43,  3.71it/s]
 14%|█▍        | 52437/371472 [4:10:56<25:29:32,  3.48it/s]
 14%|█▍        | 52438/371472 [4:10:57<26:24:02,  3.36it/s]
 14%|█▍        | 52439/371472 [4:10:57<26:02:00,  3.40it/s]
 14%|█▍        | 52440/371472 [4:10:57<25:23:07,  3.49it/s]
                                                           
{'loss': 4.1685, 'learning_rate': 8.733650800491284e-07, 'epoch': 2.26}

 14%|█▍        | 52440/371472 [4:10:57<25:23:07,  3.49it/s]
 14%|█▍        | 52441/371472 [4:10:57<24:11:44,  3.66it/s]
 14%|█▍        | 52442/371472 [4:10:58<25:34:17,  3.47it/s]
 14%|█▍        | 52443/371472 [4:10:58<24:28:59,  3.62it/s]
 14%|█▍        | 52444/371472 [4:10:58<24:36:09,  3.60it/s]
 14%|█▍        | 52445/371472 [4:10:59<25:36:03,  3.46it/s]
 14%|█▍        | 52446/371472 [4:10:59<24:49:19,  3.57it/s]
 14%|█▍        | 52447/371472 [4:10:59<24:09:15,  3.67it/s]
 14%|█▍        | 52448/371472 [4:10:59<23:21:15,  3.79it/s]
 14%|█▍        | 52449/371472 [4:11:00<22:30:15,  3.94it/s]
 14%|█▍        | 52450/371472 [4:11:00<24:14:36,  3.66it/s]
 14%|█▍        | 52451/371472 [4:11:00<25:45:44,  3.44it/s]
 14%|█▍        | 52452/371472 [4:11:01<26:19:07,  3.37it/s]
 14%|█▍        | 52453/371472 [4:11:01<25:48:39,  3.43it/s]
 14%|█▍        | 52454/371472 [4:11:01<24:30:28,  3.62it/s]
 14%|█▍        | 52455/371472 [4:11:01<25:06:52,  3.53it/s]
 14%|█▍        | 52456/371472 [4:11:02<26:30:51,  3.34it/s]
 14%|█▍        | 52457/371472 [4:11:02<25:46:05,  3.44it/s]
 14%|█▍        | 52458/371472 [4:11:02<24:20:40,  3.64it/s]
 14%|█▍        | 52459/371472 [4:11:03<24:31:01,  3.61it/s]
 14%|█▍        | 52460/371472 [4:11:03<23:42:55,  3.74it/s]
                                                           
{'loss': 4.3216, 'learning_rate': 8.733165980736494e-07, 'epoch': 2.26}

 14%|█▍        | 52460/371472 [4:11:03<23:42:55,  3.74it/s]
 14%|█▍        | 52461/371472 [4:11:03<23:39:51,  3.74it/s]
 14%|█▍        | 52462/371472 [4:11:03<26:30:50,  3.34it/s]
 14%|█▍        | 52463/371472 [4:11:04<25:17:54,  3.50it/s]
 14%|█▍        | 52464/371472 [4:11:04<24:56:02,  3.55it/s]
 14%|█▍        | 52465/371472 [4:11:04<24:16:36,  3.65it/s]
 14%|█▍        | 52466/371472 [4:11:04<24:20:43,  3.64it/s]
 14%|█▍        | 52467/371472 [4:11:05<23:26:04,  3.78it/s]
 14%|█▍        | 52468/371472 [4:11:05<24:17:30,  3.65it/s]
 14%|█▍        | 52469/371472 [4:11:05<24:11:11,  3.66it/s]
 14%|█▍        | 52470/371472 [4:11:06<23:32:39,  3.76it/s]
 14%|█▍        | 52471/371472 [4:11:06<24:41:18,  3.59it/s]
 14%|█▍        | 52472/371472 [4:11:06<25:34:03,  3.47it/s]
 14%|█▍        | 52473/371472 [4:11:06<25:09:37,  3.52it/s]
 14%|█▍        | 52474/371472 [4:11:07<24:32:43,  3.61it/s]
 14%|█▍        | 52475/371472 [4:11:07<24:32:18,  3.61it/s]
 14%|█▍        | 52476/371472 [4:11:07<23:20:09,  3.80it/s]
 14%|█▍        | 52477/371472 [4:11:07<23:45:09,  3.73it/s]
 14%|█▍        | 52478/371472 [4:11:08<23:50:31,  3.72it/s]
 14%|█▍        | 52479/371472 [4:11:08<24:47:22,  3.57it/s]
 14%|█▍        | 52480/371472 [4:11:08<24:51:06,  3.57it/s]
                                                           
{'loss': 4.227, 'learning_rate': 8.732681160981705e-07, 'epoch': 2.26}

 14%|█▍        | 52480/371472 [4:11:08<24:51:06,  3.57it/s]
 14%|█▍        | 52481/371472 [4:11:09<24:38:41,  3.60it/s]
 14%|█▍        | 52482/371472 [4:11:09<25:04:13,  3.53it/s]
 14%|█▍        | 52483/371472 [4:11:09<24:50:27,  3.57it/s]
 14%|█▍        | 52484/371472 [4:11:09<24:13:30,  3.66it/s]
 14%|█▍        | 52485/371472 [4:11:10<24:24:13,  3.63it/s]
 14%|█▍        | 52486/371472 [4:11:10<23:42:46,  3.74it/s]
 14%|█▍        | 52487/371472 [4:11:10<23:54:23,  3.71it/s]
 14%|█▍        | 52488/371472 [4:11:11<24:11:32,  3.66it/s]
 14%|█▍        | 52489/371472 [4:11:11<23:46:54,  3.73it/s]
 14%|█▍        | 52490/371472 [4:11:11<28:53:05,  3.07it/s]
 14%|█▍        | 52491/371472 [4:11:12<27:43:16,  3.20it/s]
 14%|█▍        | 52492/371472 [4:11:12<28:05:55,  3.15it/s]
 14%|█▍        | 52493/371472 [4:11:12<27:22:26,  3.24it/s]
 14%|█▍        | 52494/371472 [4:11:12<27:37:48,  3.21it/s]
 14%|█▍        | 52495/371472 [4:11:13<26:59:31,  3.28it/s]
 14%|█▍        | 52496/371472 [4:11:13<26:01:15,  3.41it/s]
 14%|█▍        | 52497/371472 [4:11:13<25:47:42,  3.43it/s]
 14%|█▍        | 52498/371472 [4:11:14<24:37:30,  3.60it/s]
 14%|█▍        | 52499/371472 [4:11:14<26:26:36,  3.35it/s]
 14%|█▍        | 52500/371472 [4:11:14<26:05:58,  3.39it/s]
                                                           
{'loss': 4.244, 'learning_rate': 8.732196341226917e-07, 'epoch': 2.26}

 14%|█▍        | 52500/371472 [4:11:14<26:05:58,  3.39it/s]
 14%|█▍        | 52501/371472 [4:11:14<25:31:11,  3.47it/s]
 14%|█▍        | 52502/371472 [4:11:15<26:24:11,  3.36it/s]
 14%|█▍        | 52503/371472 [4:11:15<25:25:54,  3.48it/s]
 14%|█▍        | 52504/371472 [4:11:15<25:04:09,  3.53it/s]
 14%|█▍        | 52505/371472 [4:11:16<24:42:29,  3.59it/s]
 14%|█▍        | 52506/371472 [4:11:16<24:33:32,  3.61it/s]
 14%|█▍        | 52507/371472 [4:11:16<24:06:24,  3.68it/s]
 14%|█▍        | 52508/371472 [4:11:16<25:33:18,  3.47it/s]
 14%|█▍        | 52509/371472 [4:11:17<25:08:40,  3.52it/s]
 14%|█▍        | 52510/371472 [4:11:17<24:33:53,  3.61it/s]
 14%|█▍        | 52511/371472 [4:11:17<25:01:11,  3.54it/s]
 14%|█▍        | 52512/371472 [4:11:18<25:16:32,  3.51it/s]
 14%|█▍        | 52513/371472 [4:11:18<25:20:46,  3.50it/s]
 14%|█▍        | 52514/371472 [4:11:18<27:39:02,  3.20it/s]
 14%|█▍        | 52515/371472 [4:11:18<26:38:22,  3.33it/s]
 14%|█▍        | 52516/371472 [4:11:19<27:16:14,  3.25it/s]
 14%|█▍        | 52517/371472 [4:11:19<27:48:09,  3.19it/s]
 14%|█▍        | 52518/371472 [4:11:19<27:20:45,  3.24it/s]
 14%|█▍        | 52519/371472 [4:11:20<25:36:43,  3.46it/s]
 14%|█▍        | 52520/371472 [4:11:20<32:46:17,  2.70it/s]
                                                           
{'loss': 4.3651, 'learning_rate': 8.731711521472129e-07, 'epoch': 2.26}

 14%|█▍        | 52520/371472 [4:11:20<32:46:17,  2.70it/s]
 14%|█▍        | 52521/371472 [4:11:21<30:12:37,  2.93it/s]
 14%|█▍        | 52522/371472 [4:11:21<29:49:28,  2.97it/s]
 14%|█▍        | 52523/371472 [4:11:21<28:01:45,  3.16it/s]
 14%|█▍        | 52524/371472 [4:11:21<27:03:44,  3.27it/s]
 14%|█▍        | 52525/371472 [4:11:22<26:03:02,  3.40it/s]
 14%|█▍        | 52526/371472 [4:11:22<25:23:07,  3.49it/s]
 14%|█▍        | 52527/371472 [4:11:22<25:16:45,  3.50it/s]
 14%|█▍        | 52528/371472 [4:11:22<24:22:53,  3.63it/s]
 14%|█▍        | 52529/371472 [4:11:23<24:20:48,  3.64it/s]
 14%|█▍        | 52530/371472 [4:11:23<23:54:51,  3.70it/s]
 14%|█▍        | 52531/371472 [4:11:23<23:35:02,  3.76it/s]
 14%|█▍        | 52532/371472 [4:11:24<23:20:07,  3.80it/s]
 14%|█▍        | 52533/371472 [4:11:24<23:56:41,  3.70it/s]
 14%|█▍        | 52534/371472 [4:11:24<24:02:04,  3.69it/s]
 14%|█▍        | 52535/371472 [4:11:24<23:34:34,  3.76it/s]
 14%|█▍        | 52536/371472 [4:11:25<23:02:07,  3.85it/s]
 14%|█▍        | 52537/371472 [4:11:25<24:15:58,  3.65it/s]
 14%|█▍        | 52538/371472 [4:11:25<24:03:11,  3.68it/s]
 14%|█▍        | 52539/371472 [4:11:25<26:04:08,  3.40it/s]
 14%|█▍        | 52540/371472 [4:11:26<27:11:38,  3.26it/s]
                                                           
{'loss': 4.4109, 'learning_rate': 8.731226701717339e-07, 'epoch': 2.26}

 14%|█▍        | 52540/371472 [4:11:26<27:11:38,  3.26it/s]
 14%|█▍        | 52541/371472 [4:11:26<26:38:18,  3.33it/s]
 14%|█▍        | 52542/371472 [4:11:26<25:51:48,  3.43it/s]
 14%|█▍        | 52543/371472 [4:11:27<24:57:30,  3.55it/s]
 14%|█▍        | 52544/371472 [4:11:27<23:57:11,  3.70it/s]
 14%|█▍        | 52545/371472 [4:11:27<25:10:56,  3.52it/s]
 14%|█▍        | 52546/371472 [4:11:27<24:16:23,  3.65it/s]
 14%|█▍        | 52547/371472 [4:11:28<23:30:35,  3.77it/s]
 14%|█▍        | 52548/371472 [4:11:28<22:45:13,  3.89it/s]
 14%|█▍        | 52549/371472 [4:11:28<25:29:06,  3.48it/s]
 14%|█▍        | 52550/371472 [4:11:29<24:50:38,  3.57it/s]
 14%|█▍        | 52551/371472 [4:11:29<26:23:05,  3.36it/s]
 14%|█▍        | 52552/371472 [4:11:29<24:59:27,  3.54it/s]
 14%|█▍        | 52553/371472 [4:11:29<24:00:52,  3.69it/s]
 14%|█▍        | 52554/371472 [4:11:30<24:41:49,  3.59it/s]
 14%|█▍        | 52555/371472 [4:11:30<24:04:04,  3.68it/s]
 14%|█▍        | 52556/371472 [4:11:30<23:11:09,  3.82it/s]
 14%|█▍        | 52557/371472 [4:11:30<24:17:36,  3.65it/s]
 14%|█▍        | 52558/371472 [4:11:31<24:20:15,  3.64it/s]
 14%|█▍        | 52559/371472 [4:11:31<25:35:03,  3.46it/s]
 14%|█▍        | 52560/371472 [4:11:31<26:46:31,  3.31it/s]
                                                           
{'loss': 4.2073, 'learning_rate': 8.730741881962549e-07, 'epoch': 2.26}

 14%|█▍        | 52560/371472 [4:11:31<26:46:31,  3.31it/s]
 14%|█▍        | 52561/371472 [4:11:32<25:27:24,  3.48it/s]
 14%|█▍        | 52562/371472 [4:11:32<25:33:19,  3.47it/s]
 14%|█▍        | 52563/371472 [4:11:32<24:59:35,  3.54it/s]
 14%|█▍        | 52564/371472 [4:11:33<25:14:42,  3.51it/s]
 14%|█▍        | 52565/371472 [4:11:33<24:06:06,  3.68it/s]
 14%|█▍        | 52566/371472 [4:11:33<24:44:37,  3.58it/s]
 14%|█▍        | 52567/371472 [4:11:33<24:41:26,  3.59it/s]
 14%|█▍        | 52568/371472 [4:11:34<24:45:21,  3.58it/s]
 14%|█▍        | 52569/371472 [4:11:34<23:53:16,  3.71it/s]
 14%|█▍        | 52570/371472 [4:11:34<24:40:59,  3.59it/s]
 14%|█▍        | 52571/371472 [4:11:34<24:21:38,  3.64it/s]
 14%|█▍        | 52572/371472 [4:11:35<23:55:28,  3.70it/s]
 14%|█▍        | 52573/371472 [4:11:35<23:16:02,  3.81it/s]
 14%|█▍        | 52574/371472 [4:11:35<22:51:31,  3.88it/s]
 14%|█▍        | 52575/371472 [4:11:35<23:52:08,  3.71it/s]
 14%|█▍        | 52576/371472 [4:11:36<23:35:04,  3.76it/s]
 14%|█▍        | 52577/371472 [4:11:36<24:26:12,  3.62it/s]
 14%|█▍        | 52578/371472 [4:11:36<26:58:30,  3.28it/s]
 14%|█▍        | 52579/371472 [4:11:37<25:36:22,  3.46it/s]
 14%|█▍        | 52580/371472 [4:11:37<24:29:52,  3.62it/s]
                                                           
{'loss': 4.3845, 'learning_rate': 8.730257062207761e-07, 'epoch': 2.26}

 14%|█▍        | 52580/371472 [4:11:37<24:29:52,  3.62it/s]
 14%|█▍        | 52581/371472 [4:11:37<23:33:19,  3.76it/s]
 14%|█▍        | 52582/371472 [4:11:37<25:10:57,  3.52it/s]
 14%|█▍        | 52583/371472 [4:11:38<25:03:32,  3.53it/s]
 14%|█▍        | 52584/371472 [4:11:38<24:16:04,  3.65it/s]
 14%|█▍        | 52585/371472 [4:11:38<24:44:05,  3.58it/s]
 14%|█▍        | 52586/371472 [4:11:39<24:00:35,  3.69it/s]
 14%|█▍        | 52587/371472 [4:11:39<23:43:03,  3.73it/s]
 14%|█▍        | 52588/371472 [4:11:39<24:01:24,  3.69it/s]
 14%|█▍        | 52589/371472 [4:11:39<24:08:08,  3.67it/s]
 14%|█▍        | 52590/371472 [4:11:40<23:48:16,  3.72it/s]
 14%|█▍        | 52591/371472 [4:11:40<23:58:09,  3.70it/s]
 14%|█▍        | 52592/371472 [4:11:40<24:09:41,  3.67it/s]
 14%|█▍        | 52593/371472 [4:11:40<23:58:44,  3.69it/s]
 14%|█▍        | 52594/371472 [4:11:41<23:31:50,  3.76it/s]
 14%|█▍        | 52595/371472 [4:11:41<25:06:43,  3.53it/s]
 14%|█▍        | 52596/371472 [4:11:41<25:24:30,  3.49it/s]
 14%|█▍        | 52597/371472 [4:11:42<24:22:26,  3.63it/s]
 14%|█▍        | 52598/371472 [4:11:42<23:36:11,  3.75it/s]
 14%|█▍        | 52599/371472 [4:11:42<23:07:04,  3.83it/s]
 14%|█▍        | 52600/371472 [4:11:42<24:28:56,  3.62it/s]
                                                           
{'loss': 4.3746, 'learning_rate': 8.729772242452972e-07, 'epoch': 2.27}

 14%|█▍        | 52600/371472 [4:11:42<24:28:56,  3.62it/s]
 14%|█▍        | 52601/371472 [4:11:43<26:05:12,  3.40it/s]
 14%|█▍        | 52602/371472 [4:11:43<26:37:40,  3.33it/s]
 14%|█▍        | 52603/371472 [4:11:43<25:28:08,  3.48it/s]
 14%|█▍        | 52604/371472 [4:11:44<25:21:09,  3.49it/s]
 14%|█▍        | 52605/371472 [4:11:44<26:38:58,  3.32it/s]
 14%|█▍        | 52606/371472 [4:11:44<25:43:26,  3.44it/s]
 14%|█▍        | 52607/371472 [4:11:44<24:29:27,  3.62it/s]
 14%|█▍        | 52608/371472 [4:11:45<24:26:32,  3.62it/s]
 14%|█▍        | 52609/371472 [4:11:45<24:57:13,  3.55it/s]
 14%|█▍        | 52610/371472 [4:11:45<25:06:05,  3.53it/s]
 14%|█▍        | 52611/371472 [4:11:46<28:09:02,  3.15it/s]
 14%|█▍        | 52612/371472 [4:11:46<27:51:00,  3.18it/s]
 14%|█▍        | 52613/371472 [4:11:46<26:44:11,  3.31it/s]
 14%|█▍        | 52614/371472 [4:11:47<26:14:46,  3.37it/s]
 14%|█▍        | 52615/371472 [4:11:47<26:28:19,  3.35it/s]
 14%|█▍        | 52616/371472 [4:11:47<25:49:35,  3.43it/s]
 14%|█▍        | 52617/371472 [4:11:47<26:17:53,  3.37it/s]
 14%|█▍        | 52618/371472 [4:11:48<25:01:10,  3.54it/s]
 14%|█▍        | 52619/371472 [4:11:48<24:45:16,  3.58it/s]
 14%|█▍        | 52620/371472 [4:11:48<24:04:43,  3.68it/s]
                                                           
{'loss': 4.0557, 'learning_rate': 8.729287422698183e-07, 'epoch': 2.27}

 14%|█▍        | 52620/371472 [4:11:48<24:04:43,  3.68it/s]
 14%|█▍        | 52621/371472 [4:11:48<23:44:26,  3.73it/s]
 14%|█▍        | 52622/371472 [4:11:49<22:49:24,  3.88it/s]
 14%|█▍        | 52623/371472 [4:11:49<22:41:58,  3.90it/s]
 14%|█▍        | 52624/371472 [4:11:49<22:21:05,  3.96it/s]
 14%|█▍        | 52625/371472 [4:11:50<24:59:29,  3.54it/s]
 14%|█▍        | 52626/371472 [4:11:50<25:52:38,  3.42it/s]
 14%|█▍        | 52627/371472 [4:11:50<25:37:35,  3.46it/s]
 14%|█▍        | 52628/371472 [4:11:50<25:22:11,  3.49it/s]
 14%|█▍        | 52629/371472 [4:11:51<25:47:03,  3.43it/s]
 14%|█▍        | 52630/371472 [4:11:51<24:59:07,  3.54it/s]
 14%|█▍        | 52631/371472 [4:11:51<24:28:04,  3.62it/s]
 14%|█▍        | 52632/371472 [4:11:51<24:01:35,  3.69it/s]
 14%|█▍        | 52633/371472 [4:11:52<23:18:29,  3.80it/s]
 14%|█▍        | 52634/371472 [4:11:52<23:44:41,  3.73it/s]
 14%|█▍        | 52635/371472 [4:11:52<23:43:06,  3.73it/s]
 14%|█▍        | 52636/371472 [4:11:53<25:56:23,  3.41it/s]
 14%|█▍        | 52637/371472 [4:11:53<26:37:37,  3.33it/s]
 14%|█▍        | 52638/371472 [4:11:53<25:57:20,  3.41it/s]
 14%|█▍        | 52639/371472 [4:11:54<25:58:25,  3.41it/s]
 14%|█▍        | 52640/371472 [4:11:54<25:55:51,  3.42it/s]
                                                           
{'loss': 4.3143, 'learning_rate': 8.728802602943394e-07, 'epoch': 2.27}

 14%|█▍        | 52640/371472 [4:11:54<25:55:51,  3.42it/s]
 14%|█▍        | 52641/371472 [4:11:54<26:07:39,  3.39it/s]
 14%|█▍        | 52642/371472 [4:11:54<25:45:45,  3.44it/s]
 14%|█▍        | 52643/371472 [4:11:55<27:18:40,  3.24it/s]
 14%|█▍        | 52644/371472 [4:11:55<30:43:31,  2.88it/s]
 14%|█▍        | 52645/371472 [4:11:56<30:12:23,  2.93it/s]
 14%|█▍        | 52646/371472 [4:11:56<28:00:46,  3.16it/s]
 14%|█▍        | 52647/371472 [4:11:56<26:34:41,  3.33it/s]
 14%|█▍        | 52648/371472 [4:11:56<26:54:47,  3.29it/s]
 14%|█▍        | 52649/371472 [4:11:57<26:25:05,  3.35it/s]
 14%|█▍        | 52650/371472 [4:11:57<25:49:16,  3.43it/s]
 14%|█▍        | 52651/371472 [4:11:57<28:07:05,  3.15it/s]
 14%|█▍        | 52652/371472 [4:11:58<27:34:34,  3.21it/s]
 14%|█▍        | 52653/371472 [4:11:58<27:34:49,  3.21it/s]
 14%|█▍        | 52654/371472 [4:11:58<27:14:10,  3.25it/s]
 14%|█▍        | 52655/371472 [4:11:58<27:00:09,  3.28it/s]
 14%|█▍        | 52656/371472 [4:11:59<25:09:28,  3.52it/s]
 14%|█▍        | 52657/371472 [4:11:59<25:01:23,  3.54it/s]
 14%|█▍        | 52658/371472 [4:11:59<24:56:34,  3.55it/s]
 14%|█▍        | 52659/371472 [4:12:00<25:13:25,  3.51it/s]
 14%|█▍        | 52660/371472 [4:12:00<25:00:15,  3.54it/s]
                                                           
{'loss': 3.9698, 'learning_rate': 8.728317783188606e-07, 'epoch': 2.27}

 14%|█▍        | 52660/371472 [4:12:00<25:00:15,  3.54it/s]
 14%|█▍        | 52661/371472 [4:12:00<24:48:09,  3.57it/s]
 14%|█▍        | 52662/371472 [4:12:00<24:51:43,  3.56it/s]
 14%|█▍        | 52663/371472 [4:12:01<24:23:57,  3.63it/s]
 14%|█▍        | 52664/371472 [4:12:01<25:06:17,  3.53it/s]
 14%|█▍        | 52665/371472 [4:12:01<25:07:11,  3.53it/s]
 14%|█▍        | 52666/371472 [4:12:02<24:20:14,  3.64it/s]
 14%|█▍        | 52667/371472 [4:12:02<24:16:13,  3.65it/s]
 14%|█▍        | 52668/371472 [4:12:02<23:49:15,  3.72it/s]
 14%|█▍        | 52669/371472 [4:12:02<23:08:19,  3.83it/s]
 14%|█▍        | 52670/371472 [4:12:03<22:48:14,  3.88it/s]
 14%|█▍        | 52671/371472 [4:12:03<23:05:10,  3.84it/s]
 14%|█▍        | 52672/371472 [4:12:03<23:42:03,  3.74it/s]
 14%|█▍        | 52673/371472 [4:12:03<23:03:04,  3.84it/s]
 14%|█▍        | 52674/371472 [4:12:04<23:33:00,  3.76it/s]
 14%|█▍        | 52675/371472 [4:12:04<24:11:15,  3.66it/s]
 14%|█▍        | 52676/371472 [4:12:04<23:51:53,  3.71it/s]
 14%|█▍        | 52677/371472 [4:12:04<25:24:55,  3.48it/s]
 14%|█▍        | 52678/371472 [4:12:05<26:21:19,  3.36it/s]
 14%|█▍        | 52679/371472 [4:12:05<25:12:15,  3.51it/s]
 14%|█▍        | 52680/371472 [4:12:05<25:53:49,  3.42it/s]
                                                           
{'loss': 4.1787, 'learning_rate': 8.727832963433817e-07, 'epoch': 2.27}

 14%|█▍        | 52680/371472 [4:12:05<25:53:49,  3.42it/s]
 14%|█▍        | 52681/371472 [4:12:06<25:19:22,  3.50it/s]
 14%|█▍        | 52682/371472 [4:12:06<25:12:03,  3.51it/s]
 14%|█▍        | 52683/371472 [4:12:06<24:50:30,  3.56it/s]
 14%|█▍        | 52684/371472 [4:12:06<23:50:22,  3.71it/s]
 14%|█▍        | 52685/371472 [4:12:07<24:16:15,  3.65it/s]
 14%|█▍        | 52686/371472 [4:12:07<25:10:14,  3.52it/s]
 14%|█▍        | 52687/371472 [4:12:07<24:20:17,  3.64it/s]
 14%|█▍        | 52688/371472 [4:12:08<24:01:44,  3.69it/s]
 14%|█▍        | 52689/371472 [4:12:08<24:48:30,  3.57it/s]
 14%|█▍        | 52690/371472 [4:12:08<24:40:20,  3.59it/s]
 14%|█▍        | 52691/371472 [4:12:08<25:17:52,  3.50it/s]
 14%|█▍        | 52692/371472 [4:12:09<26:05:16,  3.39it/s]
 14%|█▍        | 52693/371472 [4:12:09<25:13:26,  3.51it/s]
 14%|█▍        | 52694/371472 [4:12:09<24:51:32,  3.56it/s]
 14%|█▍        | 52695/371472 [4:12:10<24:03:12,  3.68it/s]
 14%|█▍        | 52696/371472 [4:12:10<24:03:25,  3.68it/s]
 14%|█▍        | 52697/371472 [4:12:10<25:06:55,  3.53it/s]
 14%|█▍        | 52698/371472 [4:12:10<25:10:30,  3.52it/s]
 14%|█▍        | 52699/371472 [4:12:11<25:42:31,  3.44it/s]
 14%|█▍        | 52700/371472 [4:12:11<25:20:39,  3.49it/s]
                                                           
{'loss': 4.294, 'learning_rate': 8.727348143679027e-07, 'epoch': 2.27}

 14%|█▍        | 52700/371472 [4:12:11<25:20:39,  3.49it/s]
 14%|█▍        | 52701/371472 [4:12:11<25:46:05,  3.44it/s]
 14%|█▍        | 52702/371472 [4:12:12<25:06:58,  3.53it/s]
 14%|█▍        | 52703/371472 [4:12:12<24:38:36,  3.59it/s]
 14%|█▍        | 52704/371472 [4:12:12<24:42:34,  3.58it/s]
 14%|█▍        | 52705/371472 [4:12:12<25:13:37,  3.51it/s]
 14%|█▍        | 52706/371472 [4:12:13<25:11:11,  3.52it/s]
 14%|█▍        | 52707/371472 [4:12:13<24:00:54,  3.69it/s]
 14%|█▍        | 52708/371472 [4:12:13<23:33:37,  3.76it/s]
 14%|█▍        | 52709/371472 [4:12:13<23:27:19,  3.78it/s]
 14%|█▍        | 52710/371472 [4:12:14<23:57:41,  3.70it/s]
 14%|█▍        | 52711/371472 [4:12:14<23:37:35,  3.75it/s]
 14%|█▍        | 52712/371472 [4:12:14<23:57:00,  3.70it/s]
 14%|█▍        | 52713/371472 [4:12:15<25:30:58,  3.47it/s]
 14%|█▍        | 52714/371472 [4:12:15<27:34:19,  3.21it/s]
 14%|█▍        | 52715/371472 [4:12:15<27:22:46,  3.23it/s]
 14%|█▍        | 52716/371472 [4:12:16<26:54:33,  3.29it/s]
 14%|█▍        | 52717/371472 [4:12:16<26:29:30,  3.34it/s]
 14%|█▍        | 52718/371472 [4:12:16<27:19:48,  3.24it/s]
 14%|█▍        | 52719/371472 [4:12:16<26:01:46,  3.40it/s]
 14%|█▍        | 52720/371472 [4:12:17<25:01:07,  3.54it/s]
                                                           
{'loss': 4.1294, 'learning_rate': 8.726863323924238e-07, 'epoch': 2.27}

 14%|█▍        | 52720/371472 [4:12:17<25:01:07,  3.54it/s]
 14%|█▍        | 52721/371472 [4:12:17<24:45:51,  3.58it/s]
 14%|█▍        | 52722/371472 [4:12:17<24:07:15,  3.67it/s]
 14%|█▍        | 52723/371472 [4:12:17<23:39:05,  3.74it/s]
 14%|█▍        | 52724/371472 [4:12:18<23:25:33,  3.78it/s]
 14%|█▍        | 52725/371472 [4:12:18<24:06:53,  3.67it/s]
 14%|█▍        | 52726/371472 [4:12:18<25:11:51,  3.51it/s]
 14%|█▍        | 52727/371472 [4:12:19<24:53:26,  3.56it/s]
 14%|█▍        | 52728/371472 [4:12:19<26:17:25,  3.37it/s]
 14%|█▍        | 52729/371472 [4:12:19<26:35:46,  3.33it/s]
 14%|█▍        | 52730/371472 [4:12:20<27:38:25,  3.20it/s]
 14%|█▍        | 52731/371472 [4:12:20<26:19:32,  3.36it/s]
 14%|█▍        | 52732/371472 [4:12:20<25:43:42,  3.44it/s]
 14%|█▍        | 52733/371472 [4:12:20<25:16:57,  3.50it/s]
 14%|█▍        | 52734/371472 [4:12:21<25:23:53,  3.49it/s]
 14%|█▍        | 52735/371472 [4:12:21<24:31:28,  3.61it/s]
 14%|█▍        | 52736/371472 [4:12:21<23:44:49,  3.73it/s]
 14%|█▍        | 52737/371472 [4:12:21<22:56:20,  3.86it/s]
 14%|█▍        | 52738/371472 [4:12:22<22:58:18,  3.85it/s]
 14%|█▍        | 52739/371472 [4:12:22<22:20:42,  3.96it/s]
 14%|█▍        | 52740/371472 [4:12:22<24:13:08,  3.66it/s]
                                                           
{'loss': 4.3712, 'learning_rate': 8.72637850416945e-07, 'epoch': 2.27}

 14%|█▍        | 52740/371472 [4:12:22<24:13:08,  3.66it/s]
 14%|█▍        | 52741/371472 [4:12:23<25:27:06,  3.48it/s]
 14%|█▍        | 52742/371472 [4:12:23<25:05:47,  3.53it/s]
 14%|█▍        | 52743/371472 [4:12:23<24:17:48,  3.64it/s]
 14%|█▍        | 52744/371472 [4:12:23<24:31:12,  3.61it/s]
 14%|█▍        | 52745/371472 [4:12:24<23:46:45,  3.72it/s]
 14%|█▍        | 52746/371472 [4:12:24<24:40:35,  3.59it/s]
 14%|█▍        | 52747/371472 [4:12:24<24:48:14,  3.57it/s]
 14%|█▍        | 52748/371472 [4:12:24<24:37:15,  3.60it/s]
 14%|█▍        | 52749/371472 [4:12:25<24:35:46,  3.60it/s]
 14%|█▍        | 52750/371472 [4:12:25<25:02:01,  3.54it/s]
 14%|█▍        | 52751/371472 [4:12:25<25:03:53,  3.53it/s]
 14%|█▍        | 52752/371472 [4:12:26<27:31:38,  3.22it/s]
 14%|█▍        | 52753/371472 [4:12:26<26:16:00,  3.37it/s]
 14%|█▍        | 52754/371472 [4:12:26<25:04:20,  3.53it/s]
 14%|█▍        | 52755/371472 [4:12:27<25:06:30,  3.53it/s]
 14%|█▍        | 52756/371472 [4:12:27<24:14:19,  3.65it/s]
 14%|█▍        | 52757/371472 [4:12:27<24:27:18,  3.62it/s]
 14%|█▍        | 52758/371472 [4:12:27<23:36:16,  3.75it/s]
 14%|█▍        | 52759/371472 [4:12:28<25:05:16,  3.53it/s]
 14%|█▍        | 52760/371472 [4:12:28<25:24:52,  3.48it/s]
                                                           
{'loss': 4.4626, 'learning_rate': 8.72589368441466e-07, 'epoch': 2.27}

 14%|█▍        | 52760/371472 [4:12:28<25:24:52,  3.48it/s]
 14%|█▍        | 52761/371472 [4:12:28<28:39:10,  3.09it/s]
 14%|█▍        | 52762/371472 [4:12:29<27:07:17,  3.26it/s]
 14%|█▍        | 52763/371472 [4:12:29<26:31:15,  3.34it/s]
 14%|█▍        | 52764/371472 [4:12:29<25:35:32,  3.46it/s]
 14%|█▍        | 52765/371472 [4:12:29<26:08:14,  3.39it/s]
 14%|█▍        | 52766/371472 [4:12:30<25:35:54,  3.46it/s]
 14%|█▍        | 52767/371472 [4:12:30<26:46:43,  3.31it/s]
 14%|█▍        | 52768/371472 [4:12:30<26:34:47,  3.33it/s]
 14%|█▍        | 52769/371472 [4:12:31<25:02:02,  3.54it/s]
 14%|█▍        | 52770/371472 [4:12:31<24:21:09,  3.64it/s]
 14%|█▍        | 52771/371472 [4:12:31<23:33:11,  3.76it/s]
 14%|█▍        | 52772/371472 [4:12:31<27:02:49,  3.27it/s]
 14%|█▍        | 52773/371472 [4:12:32<26:17:01,  3.37it/s]
 14%|█▍        | 52774/371472 [4:12:32<25:28:13,  3.48it/s]
 14%|█▍        | 52775/371472 [4:12:32<24:30:50,  3.61it/s]
 14%|█▍        | 52776/371472 [4:12:33<23:25:15,  3.78it/s]
 14%|█▍        | 52777/371472 [4:12:33<25:48:01,  3.43it/s]
 14%|█▍        | 52778/371472 [4:12:33<25:22:02,  3.49it/s]
 14%|█▍        | 52779/371472 [4:12:33<25:01:53,  3.54it/s]
 14%|█▍        | 52780/371472 [4:12:34<24:30:21,  3.61it/s]
                                                           
{'loss': 4.1864, 'learning_rate': 8.725408864659872e-07, 'epoch': 2.27}

 14%|█▍        | 52780/371472 [4:12:34<24:30:21,  3.61it/s]
 14%|█▍        | 52781/371472 [4:12:34<24:35:50,  3.60it/s]
 14%|█▍        | 52782/371472 [4:12:34<24:53:58,  3.56it/s]
 14%|█▍        | 52783/371472 [4:12:35<24:18:17,  3.64it/s]
 14%|█▍        | 52784/371472 [4:12:35<27:11:05,  3.26it/s]
 14%|█▍        | 52785/371472 [4:12:35<25:18:59,  3.50it/s]
 14%|█▍        | 52786/371472 [4:12:35<25:35:19,  3.46it/s]
 14%|█▍        | 52787/371472 [4:12:36<25:10:47,  3.52it/s]
 14%|█▍        | 52788/371472 [4:12:36<24:49:03,  3.57it/s]
 14%|█▍        | 52789/371472 [4:12:36<24:03:30,  3.68it/s]
 14%|█▍        | 52790/371472 [4:12:36<24:25:44,  3.62it/s]
 14%|█▍        | 52791/371472 [4:12:37<27:20:01,  3.24it/s]
 14%|█▍        | 52792/371472 [4:12:37<28:31:09,  3.10it/s]
 14%|█▍        | 52793/371472 [4:12:37<26:38:03,  3.32it/s]
 14%|█▍        | 52794/371472 [4:12:38<25:52:50,  3.42it/s]
 14%|█▍        | 52795/371472 [4:12:38<28:09:22,  3.14it/s]
 14%|█▍        | 52796/371472 [4:12:38<28:11:10,  3.14it/s]
 14%|█▍        | 52797/371472 [4:12:39<27:57:25,  3.17it/s]
 14%|█▍        | 52798/371472 [4:12:39<27:27:33,  3.22it/s]
 14%|█▍        | 52799/371472 [4:12:39<26:25:08,  3.35it/s]
 14%|█▍        | 52800/371472 [4:12:40<24:49:00,  3.57it/s]
                                                           
{'loss': 4.0382, 'learning_rate': 8.724924044905083e-07, 'epoch': 2.27}

 14%|█▍        | 52800/371472 [4:12:40<24:49:00,  3.57it/s]
 14%|█▍        | 52801/371472 [4:12:40<23:52:47,  3.71it/s]
 14%|█▍        | 52802/371472 [4:12:40<23:59:56,  3.69it/s]
 14%|█▍        | 52803/371472 [4:12:40<25:37:23,  3.45it/s]
 14%|█▍        | 52804/371472 [4:12:41<24:48:15,  3.57it/s]
 14%|█▍        | 52805/371472 [4:12:41<24:05:58,  3.67it/s]
 14%|█▍        | 52806/371472 [4:12:41<23:56:57,  3.70it/s]
 14%|█▍        | 52807/371472 [4:12:42<25:04:25,  3.53it/s]
 14%|█▍        | 52808/371472 [4:12:42<26:05:13,  3.39it/s]
 14%|█▍        | 52809/371472 [4:12:42<26:36:49,  3.33it/s]
 14%|█▍        | 52810/371472 [4:12:42<27:06:54,  3.26it/s]
 14%|█▍        | 52811/371472 [4:12:43<25:45:08,  3.44it/s]
 14%|█▍        | 52812/371472 [4:12:43<26:25:54,  3.35it/s]
 14%|█▍        | 52813/371472 [4:12:43<25:51:10,  3.42it/s]
 14%|█▍        | 52814/371472 [4:12:44<25:03:04,  3.53it/s]
 14%|█▍        | 52815/371472 [4:12:44<24:41:41,  3.58it/s]
 14%|█▍        | 52816/371472 [4:12:44<24:12:54,  3.66it/s]
 14%|█▍        | 52817/371472 [4:12:44<24:21:34,  3.63it/s]
 14%|█▍        | 52818/371472 [4:12:45<24:32:29,  3.61it/s]
 14%|█▍        | 52819/371472 [4:12:45<24:46:13,  3.57it/s]
 14%|█▍        | 52820/371472 [4:12:45<24:51:47,  3.56it/s]
                                                           
{'loss': 4.1505, 'learning_rate': 8.724439225150294e-07, 'epoch': 2.28}

 14%|█▍        | 52820/371472 [4:12:45<24:51:47,  3.56it/s]
 14%|█▍        | 52821/371472 [4:12:46<24:44:27,  3.58it/s]
 14%|█▍        | 52822/371472 [4:12:46<24:37:50,  3.59it/s]
 14%|█▍        | 52823/371472 [4:12:46<24:30:00,  3.61it/s]
 14%|█▍        | 52824/371472 [4:12:46<24:23:41,  3.63it/s]
 14%|█▍        | 52825/371472 [4:12:47<24:35:16,  3.60it/s]
 14%|█▍        | 52826/371472 [4:12:47<25:34:40,  3.46it/s]
 14%|█▍        | 52827/371472 [4:12:47<25:53:59,  3.42it/s]
 14%|█▍        | 52828/371472 [4:12:48<25:10:35,  3.52it/s]
 14%|█▍        | 52829/371472 [4:12:48<27:59:20,  3.16it/s]
 14%|█▍        | 52830/371472 [4:12:48<26:29:13,  3.34it/s]
 14%|█▍        | 52831/371472 [4:12:48<25:27:24,  3.48it/s]
 14%|█▍        | 52832/371472 [4:12:49<25:15:48,  3.50it/s]
 14%|█▍        | 52833/371472 [4:12:49<24:18:18,  3.64it/s]
 14%|█▍        | 52834/371472 [4:12:49<24:17:51,  3.64it/s]
 14%|█▍        | 52835/371472 [4:12:50<24:42:14,  3.58it/s]
 14%|█▍        | 52836/371472 [4:12:50<24:49:49,  3.56it/s]
 14%|█▍        | 52837/371472 [4:12:50<24:42:44,  3.58it/s]
 14%|█▍        | 52838/371472 [4:12:50<25:16:56,  3.50it/s]
 14%|█▍        | 52839/371472 [4:12:51<25:12:36,  3.51it/s]
 14%|█▍        | 52840/371472 [4:12:51<26:20:08,  3.36it/s]
                                                           
{'loss': 4.3047, 'learning_rate': 8.723954405395504e-07, 'epoch': 2.28}

 14%|█▍        | 52840/371472 [4:12:51<26:20:08,  3.36it/s]
 14%|█▍        | 52841/371472 [4:12:51<25:44:50,  3.44it/s]
 14%|█▍        | 52842/371472 [4:12:52<26:56:19,  3.29it/s]
 14%|█▍        | 52843/371472 [4:12:52<25:31:50,  3.47it/s]
 14%|█▍        | 52844/371472 [4:12:52<24:50:33,  3.56it/s]
 14%|█▍        | 52845/371472 [4:12:52<25:15:09,  3.50it/s]
 14%|█▍        | 52846/371472 [4:12:53<24:56:50,  3.55it/s]
 14%|█▍        | 52847/371472 [4:12:53<24:27:17,  3.62it/s]
 14%|█▍        | 52848/371472 [4:12:53<24:53:02,  3.56it/s]
 14%|█▍        | 52849/371472 [4:12:54<25:24:31,  3.48it/s]
 14%|█▍        | 52850/371472 [4:12:54<24:07:10,  3.67it/s]
 14%|█▍        | 52851/371472 [4:12:54<26:05:23,  3.39it/s]
 14%|█▍        | 52852/371472 [4:12:54<26:46:20,  3.31it/s]
 14%|█▍        | 52853/371472 [4:12:55<26:14:42,  3.37it/s]
 14%|█▍        | 52854/371472 [4:12:55<25:41:51,  3.44it/s]
 14%|█▍        | 52855/371472 [4:12:55<25:05:08,  3.53it/s]
 14%|█▍        | 52856/371472 [4:12:56<25:10:05,  3.52it/s]
 14%|█▍        | 52857/371472 [4:12:56<25:05:16,  3.53it/s]
 14%|█▍        | 52858/371472 [4:12:56<25:38:17,  3.45it/s]
 14%|█▍        | 52859/371472 [4:12:56<25:08:04,  3.52it/s]
 14%|█▍        | 52860/371472 [4:12:57<24:57:11,  3.55it/s]
                                                           
{'loss': 4.4541, 'learning_rate': 8.723469585640715e-07, 'epoch': 2.28}

 14%|█▍        | 52860/371472 [4:12:57<24:57:11,  3.55it/s]
 14%|█▍        | 52861/371472 [4:12:57<26:57:00,  3.28it/s]
 14%|█▍        | 52862/371472 [4:12:57<25:25:44,  3.48it/s]
 14%|█▍        | 52863/371472 [4:12:58<24:22:35,  3.63it/s]
 14%|█▍        | 52864/371472 [4:12:58<26:44:48,  3.31it/s]
 14%|█▍        | 52865/371472 [4:12:58<25:43:31,  3.44it/s]
 14%|█▍        | 52866/371472 [4:12:59<27:44:14,  3.19it/s]
 14%|█▍        | 52867/371472 [4:12:59<26:36:17,  3.33it/s]
 14%|█▍        | 52868/371472 [4:12:59<25:50:50,  3.42it/s]
 14%|█▍        | 52869/371472 [4:12:59<24:48:26,  3.57it/s]
 14%|█▍        | 52870/371472 [4:13:00<24:14:07,  3.65it/s]
 14%|█▍        | 52871/371472 [4:13:00<23:58:35,  3.69it/s]
 14%|█▍        | 52872/371472 [4:13:00<24:21:22,  3.63it/s]
 14%|█▍        | 52873/371472 [4:13:00<24:30:38,  3.61it/s]
 14%|█▍        | 52874/371472 [4:13:01<23:25:04,  3.78it/s]
 14%|█▍        | 52875/371472 [4:13:01<23:31:20,  3.76it/s]
 14%|█▍        | 52876/371472 [4:13:01<23:26:54,  3.77it/s]
 14%|█▍        | 52877/371472 [4:13:01<23:07:32,  3.83it/s]
 14%|█▍        | 52878/371472 [4:13:02<24:17:40,  3.64it/s]
 14%|█▍        | 52879/371472 [4:13:02<26:25:14,  3.35it/s]
 14%|█▍        | 52880/371472 [4:13:02<25:08:30,  3.52it/s]
                                                           
{'loss': 4.1365, 'learning_rate': 8.722984765885927e-07, 'epoch': 2.28}

 14%|█▍        | 52880/371472 [4:13:02<25:08:30,  3.52it/s]
 14%|█▍        | 52881/371472 [4:13:03<24:43:17,  3.58it/s]
 14%|█▍        | 52882/371472 [4:13:03<26:58:37,  3.28it/s]
 14%|█▍        | 52883/371472 [4:13:03<25:28:52,  3.47it/s]
 14%|█▍        | 52884/371472 [4:13:04<25:18:59,  3.50it/s]
 14%|█▍        | 52885/371472 [4:13:04<24:39:35,  3.59it/s]
 14%|█▍        | 52886/371472 [4:13:04<25:19:44,  3.49it/s]
 14%|█▍        | 52887/371472 [4:13:04<26:35:58,  3.33it/s]
 14%|█▍        | 52888/371472 [4:13:05<25:07:36,  3.52it/s]
 14%|█▍        | 52889/371472 [4:13:05<24:35:01,  3.60it/s]
 14%|█▍        | 52890/371472 [4:13:05<24:28:20,  3.62it/s]
 14%|█▍        | 52891/371472 [4:13:05<24:48:10,  3.57it/s]
 14%|█▍        | 52892/371472 [4:13:06<24:32:44,  3.61it/s]
 14%|█▍        | 52893/371472 [4:13:06<23:34:30,  3.75it/s]
 14%|█▍        | 52894/371472 [4:13:06<24:00:04,  3.69it/s]
 14%|█▍        | 52895/371472 [4:13:07<24:43:54,  3.58it/s]
 14%|█▍        | 52896/371472 [4:13:07<24:58:28,  3.54it/s]
 14%|█▍        | 52897/371472 [4:13:07<24:13:11,  3.65it/s]
 14%|█▍        | 52898/371472 [4:13:07<23:58:21,  3.69it/s]
 14%|█▍        | 52899/371472 [4:13:08<24:22:29,  3.63it/s]
 14%|█▍        | 52900/371472 [4:13:08<23:45:25,  3.72it/s]
                                                           
{'loss': 4.2079, 'learning_rate': 8.722499946131139e-07, 'epoch': 2.28}

 14%|█▍        | 52900/371472 [4:13:08<23:45:25,  3.72it/s]
 14%|█▍        | 52901/371472 [4:13:08<23:09:49,  3.82it/s]
 14%|█▍        | 52902/371472 [4:13:08<23:16:03,  3.80it/s]
 14%|█▍        | 52903/371472 [4:13:09<23:05:16,  3.83it/s]
 14%|█▍        | 52904/371472 [4:13:09<23:40:02,  3.74it/s]
 14%|█▍        | 52905/371472 [4:13:09<23:20:19,  3.79it/s]
 14%|█▍        | 52906/371472 [4:13:10<23:51:01,  3.71it/s]
 14%|█▍        | 52907/371472 [4:13:10<25:30:32,  3.47it/s]
 14%|█▍        | 52908/371472 [4:13:10<28:04:12,  3.15it/s]
 14%|█▍        | 52909/371472 [4:13:11<28:04:43,  3.15it/s]
 14%|█▍        | 52910/371472 [4:13:11<27:02:33,  3.27it/s]
 14%|█▍        | 52911/371472 [4:13:11<26:16:25,  3.37it/s]
 14%|█▍        | 52912/371472 [4:13:11<26:22:30,  3.36it/s]
 14%|█▍        | 52913/371472 [4:13:12<27:39:18,  3.20it/s]
 14%|█▍        | 52914/371472 [4:13:12<25:37:54,  3.45it/s]
 14%|█▍        | 52915/371472 [4:13:12<24:48:43,  3.57it/s]
 14%|█▍        | 52916/371472 [4:13:13<24:25:47,  3.62it/s]
 14%|█▍        | 52917/371472 [4:13:13<23:41:57,  3.73it/s]
 14%|█▍        | 52918/371472 [4:13:13<24:12:48,  3.65it/s]
 14%|█▍        | 52919/371472 [4:13:13<24:19:02,  3.64it/s]
 14%|█▍        | 52920/371472 [4:13:14<24:08:56,  3.66it/s]
                                                           
{'loss': 4.2184, 'learning_rate': 8.722015126376349e-07, 'epoch': 2.28}

 14%|█▍        | 52920/371472 [4:13:14<24:08:56,  3.66it/s]
 14%|█▍        | 52921/371472 [4:13:14<26:39:06,  3.32it/s]
 14%|█▍        | 52922/371472 [4:13:14<27:46:29,  3.19it/s]
 14%|█▍        | 52923/371472 [4:13:15<26:52:37,  3.29it/s]
 14%|█▍        | 52924/371472 [4:13:15<25:13:20,  3.51it/s]
 14%|█▍        | 52925/371472 [4:13:15<31:41:14,  2.79it/s]
 14%|█▍        | 52926/371472 [4:13:16<28:47:42,  3.07it/s]
 14%|█▍        | 52927/371472 [4:13:16<26:47:16,  3.30it/s]
 14%|█▍        | 52928/371472 [4:13:16<25:33:02,  3.46it/s]
 14%|█▍        | 52929/371472 [4:13:16<25:07:50,  3.52it/s]
 14%|█▍        | 52930/371472 [4:13:17<24:38:14,  3.59it/s]
 14%|█▍        | 52931/371472 [4:13:17<24:42:51,  3.58it/s]
 14%|█▍        | 52932/371472 [4:13:17<23:58:11,  3.69it/s]
 14%|█▍        | 52933/371472 [4:13:17<25:08:56,  3.52it/s]
 14%|█▍        | 52934/371472 [4:13:18<25:09:49,  3.52it/s]
 14%|█▍        | 52935/371472 [4:13:18<24:18:41,  3.64it/s]
 14%|█▍        | 52936/371472 [4:13:18<25:25:06,  3.48it/s]
 14%|█▍        | 52937/371472 [4:13:19<24:26:34,  3.62it/s]
 14%|█▍        | 52938/371472 [4:13:19<24:21:34,  3.63it/s]
 14%|█▍        | 52939/371472 [4:13:19<24:29:39,  3.61it/s]
 14%|█▍        | 52940/371472 [4:13:19<25:50:08,  3.42it/s]
                                                           
{'loss': 4.298, 'learning_rate': 8.721530306621559e-07, 'epoch': 2.28}

 14%|█▍        | 52940/371472 [4:13:19<25:50:08,  3.42it/s]
 14%|█▍        | 52941/371472 [4:13:20<24:46:15,  3.57it/s]
 14%|█▍        | 52942/371472 [4:13:20<25:39:21,  3.45it/s]
 14%|█▍        | 52943/371472 [4:13:20<24:40:28,  3.59it/s]
 14%|█▍        | 52944/371472 [4:13:21<24:05:38,  3.67it/s]
 14%|█▍        | 52945/371472 [4:13:21<24:07:18,  3.67it/s]
 14%|█▍        | 52946/371472 [4:13:21<25:14:11,  3.51it/s]
 14%|█▍        | 52947/371472 [4:13:21<26:28:01,  3.34it/s]
 14%|█▍        | 52948/371472 [4:13:22<25:16:43,  3.50it/s]
 14%|█▍        | 52949/371472 [4:13:22<25:53:09,  3.42it/s]
 14%|█▍        | 52950/371472 [4:13:22<25:45:43,  3.43it/s]
 14%|█▍        | 52951/371472 [4:13:23<26:40:54,  3.32it/s]
 14%|█▍        | 52952/371472 [4:13:23<26:15:04,  3.37it/s]
 14%|█▍        | 52953/371472 [4:13:23<25:09:17,  3.52it/s]
 14%|█▍        | 52954/371472 [4:13:23<24:11:07,  3.66it/s]
 14%|█▍        | 52955/371472 [4:13:24<23:41:23,  3.73it/s]
 14%|█▍        | 52956/371472 [4:13:24<24:10:28,  3.66it/s]
 14%|█▍        | 52957/371472 [4:13:24<25:02:47,  3.53it/s]
 14%|█▍        | 52958/371472 [4:13:25<27:17:16,  3.24it/s]
 14%|█▍        | 52959/371472 [4:13:25<26:55:33,  3.29it/s]
 14%|█▍        | 52960/371472 [4:13:25<26:09:37,  3.38it/s]
                                                           
{'loss': 4.2712, 'learning_rate': 8.721045486866771e-07, 'epoch': 2.28}

 14%|█▍        | 52960/371472 [4:13:25<26:09:37,  3.38it/s]
 14%|█▍        | 52961/371472 [4:13:26<25:49:34,  3.43it/s]
 14%|█▍        | 52962/371472 [4:13:26<25:19:58,  3.49it/s]
 14%|█▍        | 52963/371472 [4:13:26<25:34:03,  3.46it/s]
 14%|█▍        | 52964/371472 [4:13:26<24:37:03,  3.59it/s]
 14%|█▍        | 52965/371472 [4:13:27<23:51:18,  3.71it/s]
 14%|█▍        | 52966/371472 [4:13:27<23:22:57,  3.78it/s]
 14%|█▍        | 52967/371472 [4:13:27<23:21:51,  3.79it/s]
 14%|█▍        | 52968/371472 [4:13:27<23:37:24,  3.75it/s]
 14%|█▍        | 52969/371472 [4:13:28<23:02:12,  3.84it/s]
 14%|█▍        | 52970/371472 [4:13:28<24:06:17,  3.67it/s]
 14%|█▍        | 52971/371472 [4:13:28<24:59:16,  3.54it/s]
 14%|█▍        | 52972/371472 [4:13:29<26:31:35,  3.34it/s]
 14%|█▍        | 52973/371472 [4:13:29<25:54:17,  3.42it/s]
 14%|█▍        | 52974/371472 [4:13:29<25:22:48,  3.49it/s]
 14%|█▍        | 52975/371472 [4:13:29<25:48:15,  3.43it/s]
 14%|█▍        | 52976/371472 [4:13:30<24:15:28,  3.65it/s]
 14%|█▍        | 52977/371472 [4:13:30<25:05:03,  3.53it/s]
 14%|█▍        | 52978/371472 [4:13:30<25:09:14,  3.52it/s]
 14%|█▍        | 52979/371472 [4:13:31<25:11:00,  3.51it/s]
 14%|█▍        | 52980/371472 [4:13:31<27:09:21,  3.26it/s]
                                                           
{'loss': 4.2324, 'learning_rate': 8.720560667111983e-07, 'epoch': 2.28}

 14%|█▍        | 52980/371472 [4:13:31<27:09:21,  3.26it/s]
 14%|█▍        | 52981/371472 [4:13:31<26:37:55,  3.32it/s]
 14%|█▍        | 52982/371472 [4:13:31<25:10:45,  3.51it/s]
 14%|█▍        | 52983/371472 [4:13:32<25:00:44,  3.54it/s]
 14%|█▍        | 52984/371472 [4:13:32<27:58:14,  3.16it/s]
 14%|█▍        | 52985/371472 [4:13:32<27:41:52,  3.19it/s]
 14%|█▍        | 52986/371472 [4:13:33<25:46:08,  3.43it/s]
 14%|█▍        | 52987/371472 [4:13:33<25:44:29,  3.44it/s]
 14%|█▍        | 52988/371472 [4:13:33<25:33:54,  3.46it/s]
 14%|█▍        | 52989/371472 [4:13:33<24:51:23,  3.56it/s]
 14%|█▍        | 52990/371472 [4:13:34<24:38:33,  3.59it/s]
 14%|█▍        | 52991/371472 [4:13:34<23:41:33,  3.73it/s]
 14%|█▍        | 52992/371472 [4:13:34<25:33:14,  3.46it/s]
 14%|█▍        | 52993/371472 [4:13:35<25:10:24,  3.51it/s]
 14%|█▍        | 52994/371472 [4:13:35<24:25:06,  3.62it/s]
 14%|█▍        | 52995/371472 [4:13:35<23:59:59,  3.69it/s]
 14%|█▍        | 52996/371472 [4:13:35<24:14:36,  3.65it/s]
 14%|█▍        | 52997/371472 [4:13:36<26:01:50,  3.40it/s]
 14%|█▍        | 52998/371472 [4:13:36<25:10:09,  3.51it/s]
 14%|█▍        | 52999/371472 [4:13:36<23:55:28,  3.70it/s]
 14%|█▍        | 53000/371472 [4:13:36<23:25:46,  3.78it/s]
                                                           
{'loss': 4.2026, 'learning_rate': 8.720075847357193e-07, 'epoch': 2.28}

 14%|█▍        | 53000/371472 [4:13:36<23:25:46,  3.78it/s]
 14%|█▍        | 53001/371472 [4:13:37<23:15:06,  3.80it/s]
 14%|█▍        | 53002/371472 [4:13:37<23:41:09,  3.73it/s]
 14%|█▍        | 53003/371472 [4:13:37<25:24:59,  3.48it/s]
 14%|█▍        | 53004/371472 [4:13:38<25:13:03,  3.51it/s]
 14%|█▍        | 53005/371472 [4:13:38<25:17:30,  3.50it/s]
 14%|█▍        | 53006/371472 [4:13:38<25:05:10,  3.53it/s]
 14%|█▍        | 53007/371472 [4:13:38<24:23:03,  3.63it/s]
 14%|█▍        | 53008/371472 [4:13:39<23:45:47,  3.72it/s]
 14%|█▍        | 53009/371472 [4:13:39<25:04:09,  3.53it/s]
 14%|█▍        | 53010/371472 [4:13:39<24:53:20,  3.55it/s]
 14%|█▍        | 53011/371472 [4:13:40<25:05:01,  3.53it/s]
 14%|█▍        | 53012/371472 [4:13:40<24:55:57,  3.55it/s]
 14%|█▍        | 53013/371472 [4:13:40<24:04:25,  3.67it/s]
 14%|█▍        | 53014/371472 [4:13:40<23:37:34,  3.74it/s]
 14%|█▍        | 53015/371472 [4:13:41<24:34:24,  3.60it/s]
 14%|█▍        | 53016/371472 [4:13:41<23:55:35,  3.70it/s]
 14%|█▍        | 53017/371472 [4:13:41<23:38:39,  3.74it/s]
 14%|█▍        | 53018/371472 [4:13:41<23:50:35,  3.71it/s]
 14%|█▍        | 53019/371472 [4:13:42<25:52:01,  3.42it/s]
 14%|█▍        | 53020/371472 [4:13:42<27:13:24,  3.25it/s]
                                                           
{'loss': 4.2496, 'learning_rate': 8.719591027602404e-07, 'epoch': 2.28}

 14%|█▍        | 53020/371472 [4:13:42<27:13:24,  3.25it/s]
 14%|█▍        | 53021/371472 [4:13:42<25:51:06,  3.42it/s]
 14%|█▍        | 53022/371472 [4:13:43<24:55:00,  3.55it/s]
 14%|█▍        | 53023/371472 [4:13:43<24:25:16,  3.62it/s]
 14%|█▍        | 53024/371472 [4:13:43<24:22:00,  3.63it/s]
 14%|█▍        | 53025/371472 [4:13:43<23:25:45,  3.78it/s]
 14%|█▍        | 53026/371472 [4:13:44<22:32:13,  3.92it/s]
 14%|█▍        | 53027/371472 [4:13:44<23:22:17,  3.78it/s]
 14%|█▍        | 53028/371472 [4:13:44<22:46:52,  3.88it/s]
 14%|█▍        | 53029/371472 [4:13:44<23:05:01,  3.83it/s]
 14%|█▍        | 53030/371472 [4:13:45<23:33:16,  3.76it/s]
 14%|█▍        | 53031/371472 [4:13:45<24:40:06,  3.59it/s]
 14%|█▍        | 53032/371472 [4:13:45<24:29:16,  3.61it/s]
 14%|█▍        | 53033/371472 [4:13:46<27:24:32,  3.23it/s]
 14%|█▍        | 53034/371472 [4:13:46<27:24:29,  3.23it/s]
 14%|█▍        | 53035/371472 [4:13:46<26:53:31,  3.29it/s]
 14%|█▍        | 53036/371472 [4:13:47<25:10:41,  3.51it/s]
 14%|█▍        | 53037/371472 [4:13:47<26:09:02,  3.38it/s]
 14%|█▍        | 53038/371472 [4:13:47<26:17:11,  3.36it/s]
 14%|█▍        | 53039/371472 [4:13:47<25:15:57,  3.50it/s]
 14%|█▍        | 53040/371472 [4:13:48<25:11:43,  3.51it/s]
                                                           
{'loss': 4.337, 'learning_rate': 8.719106207847617e-07, 'epoch': 2.28}

 14%|█▍        | 53040/371472 [4:13:48<25:11:43,  3.51it/s]
 14%|█▍        | 53041/371472 [4:13:48<27:04:03,  3.27it/s]
 14%|█▍        | 53042/371472 [4:13:48<26:31:20,  3.34it/s]
 14%|█▍        | 53043/371472 [4:13:49<25:53:30,  3.42it/s]
 14%|█▍        | 53044/371472 [4:13:49<25:12:48,  3.51it/s]
 14%|█▍        | 53045/371472 [4:13:49<24:14:25,  3.65it/s]
 14%|█▍        | 53046/371472 [4:13:49<23:55:41,  3.70it/s]
 14%|█▍        | 53047/371472 [4:13:50<24:29:31,  3.61it/s]
 14%|█▍        | 53048/371472 [4:13:50<23:41:59,  3.73it/s]
 14%|█▍        | 53049/371472 [4:13:50<24:00:59,  3.68it/s]
 14%|█▍        | 53050/371472 [4:13:50<23:50:07,  3.71it/s]
 14%|█▍        | 53051/371472 [4:13:51<23:42:15,  3.73it/s]
 14%|█▍        | 53052/371472 [4:13:51<24:11:09,  3.66it/s]
 14%|█▍        | 53053/371472 [4:13:51<23:31:56,  3.76it/s]
 14%|█▍        | 53054/371472 [4:13:52<25:47:22,  3.43it/s]
 14%|█▍        | 53055/371472 [4:13:52<25:04:57,  3.53it/s]
 14%|█▍        | 53056/371472 [4:13:52<26:28:13,  3.34it/s]
 14%|█▍        | 53057/371472 [4:13:53<27:29:46,  3.22it/s]
 14%|█▍        | 53058/371472 [4:13:53<27:24:07,  3.23it/s]
 14%|█▍        | 53059/371472 [4:13:53<27:34:20,  3.21it/s]
 14%|█▍        | 53060/371472 [4:13:54<27:15:04,  3.25it/s]
                                                           
{'loss': 4.2557, 'learning_rate': 8.718621388092826e-07, 'epoch': 2.29}

 14%|█▍        | 53060/371472 [4:13:54<27:15:04,  3.25it/s]
 14%|█▍        | 53061/371472 [4:13:54<27:35:52,  3.20it/s]
 14%|█▍        | 53062/371472 [4:13:54<25:42:08,  3.44it/s]
 14%|█▍        | 53063/371472 [4:13:54<25:34:56,  3.46it/s]
 14%|█▍        | 53064/371472 [4:13:55<24:29:43,  3.61it/s]
 14%|█▍        | 53065/371472 [4:13:55<26:28:09,  3.34it/s]
 14%|█▍        | 53066/371472 [4:13:55<26:10:47,  3.38it/s]
 14%|█▍        | 53067/371472 [4:13:56<26:39:48,  3.32it/s]
 14%|█▍        | 53068/371472 [4:13:56<25:27:40,  3.47it/s]
 14%|█▍        | 53069/371472 [4:13:56<25:33:23,  3.46it/s]
 14%|█▍        | 53070/371472 [4:13:56<25:41:17,  3.44it/s]
 14%|█▍        | 53071/371472 [4:13:57<25:50:42,  3.42it/s]
 14%|█▍        | 53072/371472 [4:13:57<24:57:38,  3.54it/s]
 14%|█▍        | 53073/371472 [4:13:57<24:20:26,  3.63it/s]
 14%|█▍        | 53074/371472 [4:13:58<26:12:05,  3.38it/s]
 14%|█▍        | 53075/371472 [4:13:58<25:11:30,  3.51it/s]
 14%|█▍        | 53076/371472 [4:13:58<25:04:45,  3.53it/s]
 14%|█▍        | 53077/371472 [4:13:58<25:14:01,  3.50it/s]
 14%|█▍        | 53078/371472 [4:13:59<24:52:45,  3.55it/s]
 14%|█▍        | 53079/371472 [4:13:59<25:17:32,  3.50it/s]
 14%|█▍        | 53080/371472 [4:13:59<25:12:33,  3.51it/s]
                                                           
{'loss': 4.2969, 'learning_rate': 8.718136568338037e-07, 'epoch': 2.29}

 14%|█▍        | 53080/371472 [4:13:59<25:12:33,  3.51it/s]
 14%|█▍        | 53081/371472 [4:13:59<24:27:48,  3.62it/s]
 14%|█▍        | 53082/371472 [4:14:00<24:17:35,  3.64it/s]
 14%|█▍        | 53083/371472 [4:14:00<24:23:48,  3.63it/s]
 14%|█▍        | 53084/371472 [4:14:00<23:26:10,  3.77it/s]
 14%|█▍        | 53085/371472 [4:14:01<23:07:58,  3.82it/s]
 14%|█▍        | 53086/371472 [4:14:01<24:34:37,  3.60it/s]
 14%|█▍        | 53087/371472 [4:14:01<24:40:11,  3.58it/s]
 14%|█▍        | 53088/371472 [4:14:01<23:36:23,  3.75it/s]
 14%|█▍        | 53089/371472 [4:14:02<23:57:14,  3.69it/s]
 14%|█▍        | 53090/371472 [4:14:02<23:07:19,  3.82it/s]
 14%|█▍        | 53091/371472 [4:14:02<25:07:37,  3.52it/s]
 14%|█▍        | 53092/371472 [4:14:03<24:45:31,  3.57it/s]
 14%|█▍        | 53093/371472 [4:14:03<25:09:45,  3.51it/s]
 14%|█▍        | 53094/371472 [4:14:03<25:02:24,  3.53it/s]
 14%|█▍        | 53095/371472 [4:14:03<24:51:57,  3.56it/s]
 14%|█▍        | 53096/371472 [4:14:04<24:43:06,  3.58it/s]
 14%|█▍        | 53097/371472 [4:14:04<25:20:42,  3.49it/s]
 14%|█▍        | 53098/371472 [4:14:04<25:25:48,  3.48it/s]
 14%|█▍        | 53099/371472 [4:14:05<25:14:19,  3.50it/s]
 14%|█▍        | 53100/371472 [4:14:05<25:16:45,  3.50it/s]
                                                           
{'loss': 4.4096, 'learning_rate': 8.717651748583248e-07, 'epoch': 2.29}

 14%|█▍        | 53100/371472 [4:14:05<25:16:45,  3.50it/s]
 14%|█▍        | 53101/371472 [4:14:05<25:36:13,  3.45it/s]
 14%|█▍        | 53102/371472 [4:14:05<25:12:12,  3.51it/s]
 14%|█▍        | 53103/371472 [4:14:06<24:19:28,  3.64it/s]
 14%|█▍        | 53104/371472 [4:14:06<24:20:12,  3.63it/s]
 14%|█▍        | 53105/371472 [4:14:06<24:25:00,  3.62it/s]
 14%|█▍        | 53106/371472 [4:14:06<24:59:26,  3.54it/s]
 14%|█▍        | 53107/371472 [4:14:07<23:57:38,  3.69it/s]
 14%|█▍        | 53108/371472 [4:14:07<24:02:30,  3.68it/s]
 14%|█▍        | 53109/371472 [4:14:07<23:25:19,  3.78it/s]
 14%|█▍        | 53110/371472 [4:14:08<23:30:19,  3.76it/s]
 14%|█▍        | 53111/371472 [4:14:08<24:37:14,  3.59it/s]
 14%|█▍        | 53112/371472 [4:14:08<23:50:46,  3.71it/s]
 14%|█▍        | 53113/371472 [4:14:08<23:47:05,  3.72it/s]
 14%|█▍        | 53114/371472 [4:14:09<26:17:54,  3.36it/s]
 14%|█▍        | 53115/371472 [4:14:09<26:36:51,  3.32it/s]
 14%|█▍        | 53116/371472 [4:14:09<25:20:09,  3.49it/s]
 14%|█▍        | 53117/371472 [4:14:10<24:53:06,  3.55it/s]
 14%|█▍        | 53118/371472 [4:14:10<24:58:16,  3.54it/s]
 14%|█▍        | 53119/371472 [4:14:10<23:46:33,  3.72it/s]
 14%|█▍        | 53120/371472 [4:14:10<23:22:58,  3.78it/s]
                                                           
{'loss': 4.312, 'learning_rate': 8.71716692882846e-07, 'epoch': 2.29}

 14%|█▍        | 53120/371472 [4:14:10<23:22:58,  3.78it/s]
 14%|█▍        | 53121/371472 [4:14:11<23:21:55,  3.78it/s]
 14%|█▍        | 53122/371472 [4:14:11<24:29:35,  3.61it/s]
 14%|█▍        | 53123/371472 [4:14:11<23:41:14,  3.73it/s]
 14%|█▍        | 53124/371472 [4:14:11<24:21:58,  3.63it/s]
 14%|█▍        | 53125/371472 [4:14:12<23:41:18,  3.73it/s]
 14%|█▍        | 53126/371472 [4:14:12<24:13:23,  3.65it/s]
 14%|█▍        | 53127/371472 [4:14:12<24:49:20,  3.56it/s]
 14%|█▍        | 53128/371472 [4:14:13<24:16:00,  3.64it/s]
 14%|█▍        | 53129/371472 [4:14:13<25:19:11,  3.49it/s]
 14%|█▍        | 53130/371472 [4:14:13<26:20:42,  3.36it/s]
 14%|█▍        | 53131/371472 [4:14:13<25:19:23,  3.49it/s]
 14%|█▍        | 53132/371472 [4:14:14<25:43:54,  3.44it/s]
 14%|█▍        | 53133/371472 [4:14:14<24:36:31,  3.59it/s]
 14%|█▍        | 53134/371472 [4:14:14<24:30:27,  3.61it/s]
 14%|█▍        | 53135/371472 [4:14:15<25:14:17,  3.50it/s]
 14%|█▍        | 53136/371472 [4:14:15<24:43:15,  3.58it/s]
 14%|█▍        | 53137/371472 [4:14:15<25:16:45,  3.50it/s]
 14%|█▍        | 53138/371472 [4:14:15<26:39:10,  3.32it/s]
 14%|█▍        | 53139/371472 [4:14:16<25:42:18,  3.44it/s]
 14%|█▍        | 53140/371472 [4:14:16<25:14:49,  3.50it/s]
                                                           
{'loss': 4.2076, 'learning_rate': 8.71668210907367e-07, 'epoch': 2.29}

 14%|█▍        | 53140/371472 [4:14:16<25:14:49,  3.50it/s]
 14%|█▍        | 53141/371472 [4:14:16<24:38:56,  3.59it/s]
 14%|█▍        | 53142/371472 [4:14:17<24:53:33,  3.55it/s]
 14%|█▍        | 53143/371472 [4:14:17<23:54:56,  3.70it/s]
 14%|█▍        | 53144/371472 [4:14:17<24:01:10,  3.68it/s]
 14%|█▍        | 53145/371472 [4:14:17<23:36:05,  3.75it/s]
 14%|█▍        | 53146/371472 [4:14:18<24:31:25,  3.61it/s]
 14%|█▍        | 53147/371472 [4:14:18<24:39:50,  3.59it/s]
 14%|█▍        | 53148/371472 [4:14:18<24:52:24,  3.55it/s]
 14%|█▍        | 53149/371472 [4:14:18<24:18:31,  3.64it/s]
 14%|█▍        | 53150/371472 [4:14:19<24:25:45,  3.62it/s]
 14%|█▍        | 53151/371472 [4:14:19<23:44:13,  3.73it/s]
 14%|█▍        | 53152/371472 [4:14:19<23:59:05,  3.69it/s]
 14%|█▍        | 53153/371472 [4:14:19<23:34:15,  3.75it/s]
 14%|█▍        | 53154/371472 [4:14:20<24:14:42,  3.65it/s]
 14%|█▍        | 53155/371472 [4:14:20<24:18:46,  3.64it/s]
 14%|█▍        | 53156/371472 [4:14:20<23:46:46,  3.72it/s]
 14%|█▍        | 53157/371472 [4:14:21<25:01:01,  3.53it/s]
 14%|█▍        | 53158/371472 [4:14:21<25:05:13,  3.52it/s]
 14%|█▍        | 53159/371472 [4:14:21<23:50:31,  3.71it/s]
 14%|█▍        | 53160/371472 [4:14:21<23:49:09,  3.71it/s]
                                                           
{'loss': 4.1274, 'learning_rate': 8.716197289318882e-07, 'epoch': 2.29}

 14%|█▍        | 53160/371472 [4:14:21<23:49:09,  3.71it/s]
 14%|█▍        | 53161/371472 [4:14:22<23:29:39,  3.76it/s]
 14%|█▍        | 53162/371472 [4:14:22<23:36:20,  3.75it/s]
 14%|█▍        | 53163/371472 [4:14:22<24:05:45,  3.67it/s]
 14%|█▍        | 53164/371472 [4:14:23<24:24:26,  3.62it/s]
 14%|█▍        | 53165/371472 [4:14:23<24:57:27,  3.54it/s]
 14%|█▍        | 53166/371472 [4:14:23<23:40:55,  3.73it/s]
 14%|█▍        | 53167/371472 [4:14:23<24:07:19,  3.67it/s]
 14%|█▍        | 53168/371472 [4:14:24<25:46:38,  3.43it/s]
 14%|█▍        | 53169/371472 [4:14:24<24:46:48,  3.57it/s]
 14%|█▍        | 53170/371472 [4:14:24<24:01:15,  3.68it/s]
 14%|█▍        | 53171/371472 [4:14:25<26:13:15,  3.37it/s]
 14%|█▍        | 53172/371472 [4:14:25<24:58:53,  3.54it/s]
 14%|█▍        | 53173/371472 [4:14:25<25:18:51,  3.49it/s]
 14%|█▍        | 53174/371472 [4:14:25<24:05:49,  3.67it/s]
 14%|█▍        | 53175/371472 [4:14:26<24:01:23,  3.68it/s]
 14%|█▍        | 53176/371472 [4:14:26<23:50:20,  3.71it/s]
 14%|█▍        | 53177/371472 [4:14:26<24:56:13,  3.55it/s]
 14%|█▍        | 53178/371472 [4:14:26<24:02:03,  3.68it/s]
 14%|█▍        | 53179/371472 [4:14:27<23:29:52,  3.76it/s]
 14%|█▍        | 53180/371472 [4:14:27<27:30:29,  3.21it/s]
                                                           
{'loss': 4.2475, 'learning_rate': 8.715712469564093e-07, 'epoch': 2.29}

 14%|█▍        | 53180/371472 [4:14:27<27:30:29,  3.21it/s]
 14%|█▍        | 53181/371472 [4:14:27<27:16:30,  3.24it/s]
 14%|█▍        | 53182/371472 [4:14:28<25:39:49,  3.45it/s]
 14%|█▍        | 53183/371472 [4:14:28<27:53:44,  3.17it/s]
 14%|█▍        | 53184/371472 [4:14:28<28:34:07,  3.09it/s]
 14%|█▍        | 53185/371472 [4:14:29<28:23:27,  3.11it/s]
 14%|█▍        | 53186/371472 [4:14:29<27:19:18,  3.24it/s]
 14%|█▍        | 53187/371472 [4:14:29<26:27:47,  3.34it/s]
 14%|█▍        | 53188/371472 [4:14:29<25:37:50,  3.45it/s]
 14%|█▍        | 53189/371472 [4:14:30<25:48:12,  3.43it/s]
 14%|█▍        | 53190/371472 [4:14:30<25:55:19,  3.41it/s]
 14%|█▍        | 53191/371472 [4:14:30<25:25:26,  3.48it/s]
 14%|█▍        | 53192/371472 [4:14:31<25:27:25,  3.47it/s]
 14%|█▍        | 53193/371472 [4:14:31<24:19:10,  3.64it/s]
 14%|█▍        | 53194/371472 [4:14:31<23:53:05,  3.70it/s]
 14%|█▍        | 53195/371472 [4:14:31<24:31:02,  3.61it/s]
 14%|█▍        | 53196/371472 [4:14:32<24:17:42,  3.64it/s]
 14%|█▍        | 53197/371472 [4:14:32<24:56:45,  3.54it/s]
 14%|█▍        | 53198/371472 [4:14:32<24:00:20,  3.68it/s]
 14%|█▍        | 53199/371472 [4:14:33<23:19:07,  3.79it/s]
 14%|█▍        | 53200/371472 [4:14:33<22:59:34,  3.85it/s]
                                                           
{'loss': 4.1663, 'learning_rate': 8.715227649809304e-07, 'epoch': 2.29}

 14%|█▍        | 53200/371472 [4:14:33<22:59:34,  3.85it/s]
 14%|█▍        | 53201/371472 [4:14:33<24:59:17,  3.54it/s]
 14%|█▍        | 53202/371472 [4:14:33<23:57:01,  3.69it/s]
 14%|█▍        | 53203/371472 [4:14:34<25:30:47,  3.47it/s]
 14%|█▍        | 53204/371472 [4:14:34<24:31:03,  3.61it/s]
 14%|█▍        | 53205/371472 [4:14:34<25:27:43,  3.47it/s]
 14%|█▍        | 53206/371472 [4:14:35<27:41:55,  3.19it/s]
 14%|█▍        | 53207/371472 [4:14:35<25:59:59,  3.40it/s]
 14%|█▍        | 53208/371472 [4:14:35<26:00:19,  3.40it/s]
 14%|█▍        | 53209/371472 [4:14:35<25:18:58,  3.49it/s]
 14%|█▍        | 53210/371472 [4:14:36<24:00:48,  3.68it/s]
 14%|█▍        | 53211/371472 [4:14:36<23:52:02,  3.70it/s]
 14%|█▍        | 53212/371472 [4:14:36<24:22:35,  3.63it/s]
 14%|█▍        | 53213/371472 [4:14:37<25:32:27,  3.46it/s]
 14%|█▍        | 53214/371472 [4:14:37<24:35:50,  3.59it/s]
 14%|█▍        | 53215/371472 [4:14:37<23:54:28,  3.70it/s]
 14%|█▍        | 53216/371472 [4:14:37<23:39:16,  3.74it/s]
 14%|█▍        | 53217/371472 [4:14:38<23:38:28,  3.74it/s]
 14%|█▍        | 53218/371472 [4:14:38<23:18:13,  3.79it/s]
 14%|█▍        | 53219/371472 [4:14:38<22:35:54,  3.91it/s]
 14%|█▍        | 53220/371472 [4:14:38<23:26:59,  3.77it/s]
                                                           
{'loss': 4.2687, 'learning_rate': 8.714742830054514e-07, 'epoch': 2.29}

 14%|█▍        | 53220/371472 [4:14:38<23:26:59,  3.77it/s]
 14%|█▍        | 53221/371472 [4:14:39<23:26:05,  3.77it/s]
 14%|█▍        | 53222/371472 [4:14:39<23:09:13,  3.82it/s]
 14%|█▍        | 53223/371472 [4:14:39<23:57:27,  3.69it/s]
 14%|█▍        | 53224/371472 [4:14:39<23:44:58,  3.72it/s]
 14%|█▍        | 53225/371472 [4:14:40<23:47:28,  3.72it/s]
 14%|█▍        | 53226/371472 [4:14:40<25:24:58,  3.48it/s]
 14%|█▍        | 53227/371472 [4:14:40<25:16:14,  3.50it/s]
 14%|█▍        | 53228/371472 [4:14:41<28:30:58,  3.10it/s]
 14%|█▍        | 53229/371472 [4:14:41<26:24:46,  3.35it/s]
 14%|█▍        | 53230/371472 [4:14:41<24:53:00,  3.55it/s]
 14%|█▍        | 53231/371472 [4:14:41<25:35:58,  3.45it/s]
 14%|█▍        | 53232/371472 [4:14:42<25:38:36,  3.45it/s]
 14%|█▍        | 53233/371472 [4:14:42<26:04:06,  3.39it/s]
 14%|█▍        | 53234/371472 [4:14:42<25:29:46,  3.47it/s]
 14%|█▍        | 53235/371472 [4:14:43<25:26:41,  3.47it/s]
 14%|█▍        | 53236/371472 [4:14:43<25:19:47,  3.49it/s]
 14%|█▍        | 53237/371472 [4:14:43<26:01:50,  3.40it/s]
 14%|█▍        | 53238/371472 [4:14:43<24:45:37,  3.57it/s]
 14%|█▍        | 53239/371472 [4:14:44<25:30:37,  3.47it/s]
 14%|█▍        | 53240/371472 [4:14:44<25:15:56,  3.50it/s]
                                                           
{'loss': 4.1586, 'learning_rate': 8.714258010299726e-07, 'epoch': 2.29}

 14%|█▍        | 53240/371472 [4:14:44<25:15:56,  3.50it/s]
 14%|█▍        | 53241/371472 [4:14:44<24:08:23,  3.66it/s]
 14%|█▍        | 53242/371472 [4:14:45<24:19:37,  3.63it/s]
 14%|█▍        | 53243/371472 [4:14:45<25:44:40,  3.43it/s]
 14%|█▍        | 53244/371472 [4:14:45<27:17:47,  3.24it/s]
 14%|█▍        | 53245/371472 [4:14:46<25:55:26,  3.41it/s]
 14%|█▍        | 53246/371472 [4:14:46<25:37:06,  3.45it/s]
 14%|█▍        | 53247/371472 [4:14:46<25:33:28,  3.46it/s]
 14%|█▍        | 53248/371472 [4:14:46<24:38:56,  3.59it/s]
 14%|█▍        | 53249/371472 [4:14:47<24:02:18,  3.68it/s]
 14%|█▍        | 53250/371472 [4:14:47<23:34:16,  3.75it/s]
 14%|█▍        | 53251/371472 [4:14:47<25:16:19,  3.50it/s]
 14%|█▍        | 53252/371472 [4:14:48<26:08:11,  3.38it/s]
 14%|█▍        | 53253/371472 [4:14:48<25:15:33,  3.50it/s]
 14%|█▍        | 53254/371472 [4:14:48<29:59:09,  2.95it/s]
 14%|█▍        | 53255/371472 [4:14:49<28:49:26,  3.07it/s]
 14%|█▍        | 53256/371472 [4:14:49<27:13:51,  3.25it/s]
 14%|█▍        | 53257/371472 [4:14:49<26:42:31,  3.31it/s]
 14%|█▍        | 53258/371472 [4:14:49<25:55:37,  3.41it/s]
 14%|█▍        | 53259/371472 [4:14:50<25:14:30,  3.50it/s]
 14%|█▍        | 53260/371472 [4:14:50<25:55:51,  3.41it/s]
                                                           
{'loss': 4.2607, 'learning_rate': 8.713773190544937e-07, 'epoch': 2.29}

 14%|█▍        | 53260/371472 [4:14:50<25:55:51,  3.41it/s]
 14%|█▍        | 53261/371472 [4:14:50<24:57:00,  3.54it/s]
 14%|█▍        | 53262/371472 [4:14:50<23:38:08,  3.74it/s]
 14%|█▍        | 53263/371472 [4:14:51<22:57:17,  3.85it/s]
 14%|█▍        | 53264/371472 [4:14:51<22:52:52,  3.86it/s]
 14%|█▍        | 53265/371472 [4:14:51<23:03:50,  3.83it/s]
 14%|█▍        | 53266/371472 [4:14:52<24:27:01,  3.62it/s]
 14%|█▍        | 53267/371472 [4:14:52<24:24:44,  3.62it/s]
 14%|█▍        | 53268/371472 [4:14:52<26:02:25,  3.39it/s]
 14%|█▍        | 53269/371472 [4:14:52<24:47:21,  3.57it/s]
 14%|█▍        | 53270/371472 [4:14:53<23:46:55,  3.72it/s]
 14%|█▍        | 53271/371472 [4:14:53<23:02:15,  3.84it/s]
 14%|█▍        | 53272/371472 [4:14:53<23:07:02,  3.82it/s]
 14%|█▍        | 53273/371472 [4:14:53<23:05:28,  3.83it/s]
 14%|█▍        | 53274/371472 [4:14:54<23:25:02,  3.77it/s]
 14%|█▍        | 53275/371472 [4:14:54<24:34:06,  3.60it/s]
 14%|█▍        | 53276/371472 [4:14:54<25:39:30,  3.44it/s]
 14%|█▍        | 53277/371472 [4:14:55<25:43:00,  3.44it/s]
 14%|█▍        | 53278/371472 [4:14:55<25:56:21,  3.41it/s]
 14%|█▍        | 53279/371472 [4:14:55<25:16:17,  3.50it/s]
 14%|█▍        | 53280/371472 [4:14:55<25:37:15,  3.45it/s]
                                                           
{'loss': 4.2607, 'learning_rate': 8.713288370790149e-07, 'epoch': 2.29}

 14%|█▍        | 53280/371472 [4:14:55<25:37:15,  3.45it/s]
 14%|█▍        | 53281/371472 [4:14:56<25:36:39,  3.45it/s]
 14%|█▍        | 53282/371472 [4:14:56<24:46:25,  3.57it/s]
 14%|█▍        | 53283/371472 [4:14:56<24:10:22,  3.66it/s]
 14%|█▍        | 53284/371472 [4:14:57<24:53:26,  3.55it/s]
 14%|█▍        | 53285/371472 [4:14:57<25:57:24,  3.41it/s]
 14%|█▍        | 53286/371472 [4:14:57<26:38:28,  3.32it/s]
 14%|█▍        | 53287/371472 [4:14:57<26:09:13,  3.38it/s]
 14%|█▍        | 53288/371472 [4:14:58<25:05:56,  3.52it/s]
 14%|█▍        | 53289/371472 [4:14:58<24:44:45,  3.57it/s]
 14%|█▍        | 53290/371472 [4:14:58<26:24:47,  3.35it/s]
 14%|█▍        | 53291/371472 [4:14:59<26:22:13,  3.35it/s]
 14%|█▍        | 53292/371472 [4:14:59<25:10:00,  3.51it/s]
 14%|█▍        | 53293/371472 [4:14:59<24:38:56,  3.59it/s]
 14%|█▍        | 53294/371472 [4:14:59<24:17:09,  3.64it/s]
 14%|█▍        | 53295/371472 [4:15:00<24:24:12,  3.62it/s]
 14%|█▍        | 53296/371472 [4:15:00<27:11:57,  3.25it/s]
 14%|█▍        | 53297/371472 [4:15:00<26:01:56,  3.40it/s]
 14%|█▍        | 53298/371472 [4:15:01<26:31:52,  3.33it/s]
 14%|█▍        | 53299/371472 [4:15:01<25:16:34,  3.50it/s]
 14%|█▍        | 53300/371472 [4:15:01<26:07:10,  3.38it/s]
                                                           
{'loss': 4.1282, 'learning_rate': 8.712803551035359e-07, 'epoch': 2.3}

 14%|█▍        | 53300/371472 [4:15:01<26:07:10,  3.38it/s]
 14%|█▍        | 53301/371472 [4:15:02<26:35:56,  3.32it/s]
 14%|█▍        | 53302/371472 [4:15:02<26:49:10,  3.30it/s]
 14%|█▍        | 53303/371472 [4:15:02<28:04:14,  3.15it/s]
 14%|█▍        | 53304/371472 [4:15:03<29:06:27,  3.04it/s]
 14%|█▍        | 53305/371472 [4:15:03<29:53:33,  2.96it/s]
 14%|█▍        | 53306/371472 [4:15:03<28:47:50,  3.07it/s]
 14%|█▍        | 53307/371472 [4:15:03<26:38:31,  3.32it/s]
 14%|█▍        | 53308/371472 [4:15:04<25:13:56,  3.50it/s]
 14%|█▍        | 53309/371472 [4:15:04<25:16:23,  3.50it/s]
 14%|█▍        | 53310/371472 [4:15:04<25:05:58,  3.52it/s]
 14%|█▍        | 53311/371472 [4:15:05<24:57:33,  3.54it/s]
 14%|█▍        | 53312/371472 [4:15:05<24:26:32,  3.62it/s]
 14%|█▍        | 53313/371472 [4:15:05<25:29:07,  3.47it/s]
 14%|█▍        | 53314/371472 [4:15:05<26:22:07,  3.35it/s]
 14%|█▍        | 53315/371472 [4:15:06<26:19:58,  3.36it/s]
 14%|█▍        | 53316/371472 [4:15:06<27:44:23,  3.19it/s]
 14%|█▍        | 53317/371472 [4:15:06<27:34:36,  3.20it/s]
 14%|█▍        | 53318/371472 [4:15:07<25:47:07,  3.43it/s]
 14%|█▍        | 53319/371472 [4:15:07<25:22:47,  3.48it/s]
 14%|█▍        | 53320/371472 [4:15:07<29:16:34,  3.02it/s]
                                                           
{'loss': 4.0689, 'learning_rate': 8.71231873128057e-07, 'epoch': 2.3}

 14%|█▍        | 53320/371472 [4:15:07<29:16:34,  3.02it/s]
 14%|█▍        | 53321/371472 [4:15:08<27:10:39,  3.25it/s]
 14%|█▍        | 53322/371472 [4:15:08<25:33:51,  3.46it/s]
 14%|█▍        | 53323/371472 [4:15:08<26:18:15,  3.36it/s]
 14%|█▍        | 53324/371472 [4:15:08<26:06:10,  3.39it/s]
 14%|█▍        | 53325/371472 [4:15:09<26:30:49,  3.33it/s]
 14%|█▍        | 53326/371472 [4:15:09<25:04:25,  3.52it/s]
 14%|█▍        | 53327/371472 [4:15:09<27:03:43,  3.27it/s]
 14%|█▍        | 53328/371472 [4:15:10<27:31:57,  3.21it/s]
 14%|█▍        | 53329/371472 [4:15:10<25:46:03,  3.43it/s]
 14%|█▍        | 53330/371472 [4:15:10<27:17:34,  3.24it/s]
 14%|█▍        | 53331/371472 [4:15:11<26:16:58,  3.36it/s]
 14%|█▍        | 53332/371472 [4:15:11<25:03:40,  3.53it/s]
 14%|█▍        | 53333/371472 [4:15:11<24:29:54,  3.61it/s]
 14%|█▍        | 53334/371472 [4:15:11<23:46:44,  3.72it/s]
 14%|█▍        | 53335/371472 [4:15:12<22:55:55,  3.85it/s]
 14%|█▍        | 53336/371472 [4:15:12<23:05:42,  3.83it/s]
 14%|█▍        | 53337/371472 [4:15:12<22:44:05,  3.89it/s]
 14%|█▍        | 53338/371472 [4:15:12<23:08:36,  3.82it/s]
 14%|█▍        | 53339/371472 [4:15:13<23:21:42,  3.78it/s]
 14%|█▍        | 53340/371472 [4:15:13<22:58:03,  3.85it/s]
                                                           
{'loss': 4.3091, 'learning_rate': 8.711833911525781e-07, 'epoch': 2.3}

 14%|█▍        | 53340/371472 [4:15:13<22:58:03,  3.85it/s]
 14%|█▍        | 53341/371472 [4:15:13<23:41:47,  3.73it/s]
 14%|█▍        | 53342/371472 [4:15:13<24:03:03,  3.67it/s]
 14%|█▍        | 53343/371472 [4:15:14<23:58:03,  3.69it/s]
 14%|█▍        | 53344/371472 [4:15:14<24:13:10,  3.65it/s]
 14%|█▍        | 53345/371472 [4:15:14<24:03:53,  3.67it/s]
 14%|█▍        | 53346/371472 [4:15:15<24:17:35,  3.64it/s]
 14%|█▍        | 53347/371472 [4:15:15<24:02:24,  3.68it/s]
 14%|█▍        | 53348/371472 [4:15:15<23:51:14,  3.70it/s]
 14%|█▍        | 53349/371472 [4:15:15<25:07:02,  3.52it/s]
 14%|█▍        | 53350/371472 [4:15:16<24:55:39,  3.54it/s]
 14%|█▍        | 53351/371472 [4:15:16<24:37:56,  3.59it/s]
 14%|█▍        | 53352/371472 [4:15:16<24:26:31,  3.62it/s]
 14%|█▍        | 53353/371472 [4:15:16<24:06:58,  3.66it/s]
 14%|█▍        | 53354/371472 [4:15:17<24:17:40,  3.64it/s]
 14%|█▍        | 53355/371472 [4:15:17<24:20:11,  3.63it/s]
 14%|█▍        | 53356/371472 [4:15:17<24:03:21,  3.67it/s]
 14%|█▍        | 53357/371472 [4:15:18<24:24:53,  3.62it/s]
 14%|█▍        | 53358/371472 [4:15:18<25:26:56,  3.47it/s]
 14%|█▍        | 53359/371472 [4:15:18<24:55:03,  3.55it/s]
 14%|█▍        | 53360/371472 [4:15:18<25:41:29,  3.44it/s]
                                                           
{'loss': 4.1475, 'learning_rate': 8.711349091770992e-07, 'epoch': 2.3}

 14%|█▍        | 53360/371472 [4:15:18<25:41:29,  3.44it/s]
 14%|█▍        | 53361/371472 [4:15:19<27:54:52,  3.17it/s]
 14%|█▍        | 53362/371472 [4:15:19<26:11:36,  3.37it/s]
 14%|█▍        | 53363/371472 [4:15:19<27:13:18,  3.25it/s]
 14%|█▍        | 53364/371472 [4:15:20<27:14:34,  3.24it/s]
 14%|█▍        | 53365/371472 [4:15:20<26:57:42,  3.28it/s]
 14%|█▍        | 53366/371472 [4:15:20<26:10:40,  3.38it/s]
 14%|█▍        | 53367/371472 [4:15:21<26:02:20,  3.39it/s]
 14%|█▍        | 53368/371472 [4:15:21<25:48:12,  3.42it/s]
 14%|█▍        | 53369/371472 [4:15:21<24:49:01,  3.56it/s]
 14%|█▍        | 53370/371472 [4:15:21<24:51:40,  3.55it/s]
 14%|█▍        | 53371/371472 [4:15:22<24:36:04,  3.59it/s]
 14%|█▍        | 53372/371472 [4:15:22<24:28:26,  3.61it/s]
 14%|█▍        | 53373/371472 [4:15:22<23:47:20,  3.71it/s]
 14%|█▍        | 53374/371472 [4:15:23<23:34:46,  3.75it/s]
 14%|█▍        | 53375/371472 [4:15:23<23:31:39,  3.76it/s]
 14%|█▍        | 53376/371472 [4:15:23<26:50:21,  3.29it/s]
 14%|█▍        | 53377/371472 [4:15:23<25:41:24,  3.44it/s]
 14%|█▍        | 53378/371472 [4:15:24<25:22:04,  3.48it/s]
 14%|█▍        | 53379/371472 [4:15:24<26:10:51,  3.37it/s]
 14%|█▍        | 53380/371472 [4:15:24<26:18:46,  3.36it/s]
                                                           
{'loss': 4.1784, 'learning_rate': 8.710864272016203e-07, 'epoch': 2.3}

 14%|█▍        | 53380/371472 [4:15:24<26:18:46,  3.36it/s]
 14%|█▍        | 53381/371472 [4:15:25<25:07:22,  3.52it/s]
 14%|█▍        | 53382/371472 [4:15:25<24:33:04,  3.60it/s]
 14%|█▍        | 53383/371472 [4:15:25<23:33:31,  3.75it/s]
 14%|█▍        | 53384/371472 [4:15:25<25:10:18,  3.51it/s]
 14%|█▍        | 53385/371472 [4:15:26<24:41:06,  3.58it/s]
 14%|█▍        | 53386/371472 [4:15:26<24:05:27,  3.67it/s]
 14%|█▍        | 53387/371472 [4:15:26<24:29:25,  3.61it/s]
 14%|█▍        | 53388/371472 [4:15:26<24:05:45,  3.67it/s]
 14%|█▍        | 53389/371472 [4:15:27<24:15:33,  3.64it/s]
 14%|█▍        | 53390/371472 [4:15:27<24:03:23,  3.67it/s]
 14%|█▍        | 53391/371472 [4:15:27<23:22:17,  3.78it/s]
 14%|█▍        | 53392/371472 [4:15:28<24:23:52,  3.62it/s]
 14%|█▍        | 53393/371472 [4:15:28<24:58:19,  3.54it/s]
 14%|█▍        | 53394/371472 [4:15:28<24:35:32,  3.59it/s]
 14%|█▍        | 53395/371472 [4:15:28<24:02:52,  3.67it/s]
 14%|█▍        | 53396/371472 [4:15:29<26:42:41,  3.31it/s]
 14%|█▍        | 53397/371472 [4:15:29<25:39:57,  3.44it/s]
 14%|█▍        | 53398/371472 [4:15:29<24:35:32,  3.59it/s]
 14%|█▍        | 53399/371472 [4:15:30<24:18:56,  3.63it/s]
 14%|█▍        | 53400/371472 [4:15:30<24:52:16,  3.55it/s]
                                                           
{'loss': 4.1835, 'learning_rate': 8.710379452261414e-07, 'epoch': 2.3}

 14%|█▍        | 53400/371472 [4:15:30<24:52:16,  3.55it/s]
 14%|█▍        | 53401/371472 [4:15:30<24:24:16,  3.62it/s]
 14%|█▍        | 53402/371472 [4:15:30<23:49:43,  3.71it/s]
 14%|█▍        | 53403/371472 [4:15:31<23:25:48,  3.77it/s]
 14%|█▍        | 53404/371472 [4:15:31<23:07:39,  3.82it/s]
 14%|█▍        | 53405/371472 [4:15:31<23:00:59,  3.84it/s]
 14%|█▍        | 53406/371472 [4:15:31<22:54:19,  3.86it/s]
 14%|█▍        | 53407/371472 [4:15:32<22:32:28,  3.92it/s]
 14%|█▍        | 53408/371472 [4:15:32<22:28:09,  3.93it/s]
 14%|█▍        | 53409/371472 [4:15:32<21:55:47,  4.03it/s]
 14%|█▍        | 53410/371472 [4:15:32<22:46:38,  3.88it/s]
 14%|█▍        | 53411/371472 [4:15:33<24:21:55,  3.63it/s]
 14%|█▍        | 53412/371472 [4:15:33<26:35:41,  3.32it/s]
 14%|█▍        | 53413/371472 [4:15:33<25:55:01,  3.41it/s]
 14%|█▍        | 53414/371472 [4:15:34<25:59:17,  3.40it/s]
 14%|█▍        | 53415/371472 [4:15:34<26:04:32,  3.39it/s]
 14%|█▍        | 53416/371472 [4:15:34<25:24:40,  3.48it/s]
 14%|█▍        | 53417/371472 [4:15:34<25:02:21,  3.53it/s]
 14%|█▍        | 53418/371472 [4:15:35<24:36:25,  3.59it/s]
 14%|█▍        | 53419/371472 [4:15:35<24:55:57,  3.54it/s]
 14%|█▍        | 53420/371472 [4:15:35<25:24:58,  3.48it/s]
                                                           
{'loss': 4.1533, 'learning_rate': 8.709894632506626e-07, 'epoch': 2.3}

 14%|█▍        | 53420/371472 [4:15:35<25:24:58,  3.48it/s]
 14%|█▍        | 53421/371472 [4:15:36<25:10:08,  3.51it/s]
 14%|█▍        | 53422/371472 [4:15:36<25:06:45,  3.52it/s]
 14%|█▍        | 53423/371472 [4:15:36<25:18:51,  3.49it/s]
 14%|█▍        | 53424/371472 [4:15:36<24:58:03,  3.54it/s]
 14%|█▍        | 53425/371472 [4:15:37<25:05:24,  3.52it/s]
 14%|█▍        | 53426/371472 [4:15:37<25:40:58,  3.44it/s]
 14%|█▍        | 53427/371472 [4:15:37<25:16:05,  3.50it/s]
 14%|█▍        | 53428/371472 [4:15:38<24:52:22,  3.55it/s]
 14%|█▍        | 53429/371472 [4:15:38<25:02:56,  3.53it/s]
 14%|█▍        | 53430/371472 [4:15:38<24:32:43,  3.60it/s]
 14%|█▍        | 53431/371472 [4:15:38<25:24:39,  3.48it/s]
 14%|█▍        | 53432/371472 [4:15:39<25:04:27,  3.52it/s]
 14%|█▍        | 53433/371472 [4:15:39<24:01:48,  3.68it/s]
 14%|█▍        | 53434/371472 [4:15:39<23:18:45,  3.79it/s]
 14%|█▍        | 53435/371472 [4:15:40<24:36:02,  3.59it/s]
 14%|█▍        | 53436/371472 [4:15:40<23:42:42,  3.73it/s]
 14%|█▍        | 53437/371472 [4:15:40<24:54:40,  3.55it/s]
 14%|█▍        | 53438/371472 [4:15:40<23:43:24,  3.72it/s]
 14%|█▍        | 53439/371472 [4:15:41<23:51:24,  3.70it/s]
 14%|█▍        | 53440/371472 [4:15:41<23:40:46,  3.73it/s]
                                                           
{'loss': 4.2843, 'learning_rate': 8.709409812751837e-07, 'epoch': 2.3}

 14%|█▍        | 53440/371472 [4:15:41<23:40:46,  3.73it/s]
 14%|█▍        | 53441/371472 [4:15:41<23:11:27,  3.81it/s]
 14%|█▍        | 53442/371472 [4:15:41<23:08:34,  3.82it/s]
 14%|█▍        | 53443/371472 [4:15:42<22:44:29,  3.88it/s]
 14%|█▍        | 53444/371472 [4:15:42<22:37:33,  3.90it/s]
 14%|█▍        | 53445/371472 [4:15:42<22:58:15,  3.85it/s]
 14%|█▍        | 53446/371472 [4:15:42<22:47:08,  3.88it/s]
 14%|█▍        | 53447/371472 [4:15:43<22:42:52,  3.89it/s]
 14%|█▍        | 53448/371472 [4:15:43<22:42:38,  3.89it/s]
 14%|█▍        | 53449/371472 [4:15:43<23:37:18,  3.74it/s]
 14%|█▍        | 53450/371472 [4:15:43<23:22:30,  3.78it/s]
 14%|█▍        | 53451/371472 [4:15:44<23:43:57,  3.72it/s]
 14%|█▍        | 53452/371472 [4:15:44<23:32:53,  3.75it/s]
 14%|█▍        | 53453/371472 [4:15:44<24:27:48,  3.61it/s]
 14%|█▍        | 53454/371472 [4:15:45<26:00:38,  3.40it/s]
 14%|█▍        | 53455/371472 [4:15:45<24:50:11,  3.56it/s]
 14%|█▍        | 53456/371472 [4:15:45<23:37:14,  3.74it/s]
 14%|█▍        | 53457/371472 [4:15:45<25:35:58,  3.45it/s]
 14%|█▍        | 53458/371472 [4:15:46<24:13:57,  3.65it/s]
 14%|█▍        | 53459/371472 [4:15:46<23:15:26,  3.80it/s]
 14%|█▍        | 53460/371472 [4:15:46<23:08:11,  3.82it/s]
                                                           
{'loss': 4.1374, 'learning_rate': 8.708924992997047e-07, 'epoch': 2.3}

 14%|█▍        | 53460/371472 [4:15:46<23:08:11,  3.82it/s]
 14%|█▍        | 53461/371472 [4:15:46<23:19:41,  3.79it/s]
 14%|█▍        | 53462/371472 [4:15:47<25:07:16,  3.52it/s]
 14%|█▍        | 53463/371472 [4:15:47<25:24:32,  3.48it/s]
 14%|█▍        | 53464/371472 [4:15:47<24:47:00,  3.56it/s]
 14%|█▍        | 53465/371472 [4:15:48<23:54:21,  3.70it/s]
 14%|█▍        | 53466/371472 [4:15:48<23:21:20,  3.78it/s]
 14%|█▍        | 53467/371472 [4:15:48<23:04:00,  3.83it/s]
 14%|█▍        | 53468/371472 [4:15:48<24:13:45,  3.65it/s]
 14%|█▍        | 53469/371472 [4:15:49<25:36:49,  3.45it/s]
 14%|█▍        | 53470/371472 [4:15:49<25:37:29,  3.45it/s]
 14%|█▍        | 53471/371472 [4:15:49<24:30:44,  3.60it/s]
 14%|█▍        | 53472/371472 [4:15:50<24:40:41,  3.58it/s]
 14%|█▍        | 53473/371472 [4:15:50<24:03:09,  3.67it/s]
 14%|█▍        | 53474/371472 [4:15:50<23:58:32,  3.68it/s]
 14%|█▍        | 53475/371472 [4:15:50<24:13:47,  3.65it/s]
 14%|█▍        | 53476/371472 [4:15:51<23:45:21,  3.72it/s]
 14%|█▍        | 53477/371472 [4:15:51<27:09:00,  3.25it/s]
 14%|█▍        | 53478/371472 [4:15:51<27:37:05,  3.20it/s]
 14%|█▍        | 53479/371472 [4:15:52<26:21:46,  3.35it/s]
 14%|█▍        | 53480/371472 [4:15:52<26:02:09,  3.39it/s]
                                                           
{'loss': 4.1059, 'learning_rate': 8.708440173242258e-07, 'epoch': 2.3}

 14%|█▍        | 53480/371472 [4:15:52<26:02:09,  3.39it/s]
 14%|█▍        | 53481/371472 [4:15:52<25:05:43,  3.52it/s]
 14%|█▍        | 53482/371472 [4:15:52<24:32:04,  3.60it/s]
 14%|█▍        | 53483/371472 [4:15:53<24:45:16,  3.57it/s]
 14%|█▍        | 53484/371472 [4:15:53<24:35:12,  3.59it/s]
 14%|█▍        | 53485/371472 [4:15:53<24:23:53,  3.62it/s]
 14%|█▍        | 53486/371472 [4:15:54<23:56:57,  3.69it/s]
 14%|█▍        | 53487/371472 [4:15:54<23:50:12,  3.71it/s]
 14%|█▍        | 53488/371472 [4:15:54<23:23:38,  3.78it/s]
 14%|█▍        | 53489/371472 [4:15:54<24:53:29,  3.55it/s]
 14%|█▍        | 53490/371472 [4:15:55<24:51:16,  3.55it/s]
 14%|█▍        | 53491/371472 [4:15:55<24:22:31,  3.62it/s]
 14%|█▍        | 53492/371472 [4:15:55<24:13:45,  3.65it/s]
 14%|█▍        | 53493/371472 [4:15:55<23:45:18,  3.72it/s]
 14%|█▍        | 53494/371472 [4:15:56<25:31:17,  3.46it/s]
 14%|█▍        | 53495/371472 [4:15:56<25:35:23,  3.45it/s]
 14%|█▍        | 53496/371472 [4:15:56<24:19:09,  3.63it/s]
 14%|█▍        | 53497/371472 [4:15:57<23:50:40,  3.70it/s]
 14%|█▍        | 53498/371472 [4:15:57<28:18:37,  3.12it/s]
 14%|█▍        | 53499/371472 [4:15:57<26:33:49,  3.33it/s]
 14%|█▍        | 53500/371472 [4:15:58<25:34:31,  3.45it/s]
                                                           
{'loss': 4.1689, 'learning_rate': 8.70795535348747e-07, 'epoch': 2.3}

 14%|█▍        | 53500/371472 [4:15:58<25:34:31,  3.45it/s]
 14%|█▍        | 53501/371472 [4:15:58<26:02:16,  3.39it/s]
 14%|█▍        | 53502/371472 [4:15:58<26:04:56,  3.39it/s]
 14%|█▍        | 53503/371472 [4:15:58<26:15:47,  3.36it/s]
 14%|█▍        | 53504/371472 [4:15:59<25:58:37,  3.40it/s]
 14%|█▍        | 53505/371472 [4:15:59<24:44:00,  3.57it/s]
 14%|█▍        | 53506/371472 [4:15:59<24:18:19,  3.63it/s]
 14%|█▍        | 53507/371472 [4:16:00<25:08:06,  3.51it/s]
 14%|█▍        | 53508/371472 [4:16:00<25:57:52,  3.40it/s]
 14%|█▍        | 53509/371472 [4:16:00<24:40:00,  3.58it/s]
 14%|█▍        | 53510/371472 [4:16:00<25:45:38,  3.43it/s]
 14%|█▍        | 53511/371472 [4:16:01<26:14:29,  3.37it/s]
 14%|█▍        | 53512/371472 [4:16:01<25:12:04,  3.50it/s]
 14%|█▍        | 53513/371472 [4:16:01<24:26:43,  3.61it/s]
 14%|█▍        | 53514/371472 [4:16:01<23:18:01,  3.79it/s]
 14%|█▍        | 53515/371472 [4:16:02<22:31:31,  3.92it/s]
 14%|█▍        | 53516/371472 [4:16:02<24:42:10,  3.58it/s]
 14%|█▍        | 53517/371472 [4:16:02<24:24:56,  3.62it/s]
 14%|█▍        | 53518/371472 [4:16:03<24:05:01,  3.67it/s]
 14%|█▍        | 53519/371472 [4:16:03<23:35:29,  3.74it/s]
 14%|█▍        | 53520/371472 [4:16:03<22:42:56,  3.89it/s]
                                                           
{'loss': 4.3381, 'learning_rate': 8.707470533732681e-07, 'epoch': 2.31}

 14%|█▍        | 53520/371472 [4:16:03<22:42:56,  3.89it/s]
 14%|█▍        | 53521/371472 [4:16:03<23:00:29,  3.84it/s]
 14%|█▍        | 53522/371472 [4:16:04<22:25:22,  3.94it/s]
 14%|█▍        | 53523/371472 [4:16:04<23:10:23,  3.81it/s]
 14%|█▍        | 53524/371472 [4:16:04<23:21:10,  3.78it/s]
 14%|█▍        | 53525/371472 [4:16:04<25:08:05,  3.51it/s]
 14%|█▍        | 53526/371472 [4:16:05<24:52:04,  3.55it/s]
 14%|█▍        | 53527/371472 [4:16:05<24:38:28,  3.58it/s]
 14%|█▍        | 53528/371472 [4:16:05<24:01:21,  3.68it/s]
 14%|█▍        | 53529/371472 [4:16:06<24:04:13,  3.67it/s]
 14%|█▍        | 53530/371472 [4:16:06<23:48:43,  3.71it/s]
 14%|█▍        | 53531/371472 [4:16:06<24:40:12,  3.58it/s]
 14%|█▍        | 53532/371472 [4:16:06<24:26:14,  3.61it/s]
 14%|█▍        | 53533/371472 [4:16:07<25:41:15,  3.44it/s]
 14%|█▍        | 53534/371472 [4:16:07<24:51:39,  3.55it/s]
 14%|█▍        | 53535/371472 [4:16:07<31:06:30,  2.84it/s]
 14%|█▍        | 53536/371472 [4:16:08<28:49:04,  3.06it/s]
 14%|█▍        | 53537/371472 [4:16:08<31:33:36,  2.80it/s]
 14%|█▍        | 53538/371472 [4:16:08<30:18:40,  2.91it/s]
 14%|█▍        | 53539/371472 [4:16:09<28:33:31,  3.09it/s]
 14%|█▍        | 53540/371472 [4:16:09<28:05:12,  3.14it/s]
                                                           
{'loss': 4.0695, 'learning_rate': 8.706985713977892e-07, 'epoch': 2.31}

 14%|█▍        | 53540/371472 [4:16:09<28:05:12,  3.14it/s]
 14%|█▍        | 53541/371472 [4:16:09<25:59:22,  3.40it/s]
 14%|█▍        | 53542/371472 [4:16:10<25:55:02,  3.41it/s]
 14%|█▍        | 53543/371472 [4:16:10<26:45:16,  3.30it/s]
 14%|█▍        | 53544/371472 [4:16:10<26:34:10,  3.32it/s]
 14%|█▍        | 53545/371472 [4:16:10<26:02:14,  3.39it/s]
 14%|█▍        | 53546/371472 [4:16:11<27:14:11,  3.24it/s]
 14%|█▍        | 53547/371472 [4:16:11<26:36:18,  3.32it/s]
 14%|█▍        | 53548/371472 [4:16:11<27:13:34,  3.24it/s]
 14%|█▍        | 53549/371472 [4:16:12<25:53:24,  3.41it/s]
 14%|█▍        | 53550/371472 [4:16:12<25:20:24,  3.49it/s]
 14%|█▍        | 53551/371472 [4:16:12<27:05:03,  3.26it/s]
 14%|█▍        | 53552/371472 [4:16:13<26:02:52,  3.39it/s]
 14%|█▍        | 53553/371472 [4:16:13<25:45:14,  3.43it/s]
 14%|█▍        | 53554/371472 [4:16:13<26:07:25,  3.38it/s]
 14%|█▍        | 53555/371472 [4:16:13<25:41:09,  3.44it/s]
 14%|█▍        | 53556/371472 [4:16:14<25:13:07,  3.50it/s]
 14%|█▍        | 53557/371472 [4:16:14<24:52:44,  3.55it/s]
 14%|█▍        | 53558/371472 [4:16:14<24:34:40,  3.59it/s]
 14%|█▍        | 53559/371472 [4:16:15<25:56:13,  3.40it/s]
 14%|█▍        | 53560/371472 [4:16:15<24:36:20,  3.59it/s]
                                                           
{'loss': 4.3566, 'learning_rate': 8.706500894223103e-07, 'epoch': 2.31}

 14%|█▍        | 53560/371472 [4:16:15<24:36:20,  3.59it/s]
 14%|█▍        | 53561/371472 [4:16:15<24:59:22,  3.53it/s]
 14%|█▍        | 53562/371472 [4:16:15<24:20:39,  3.63it/s]
 14%|█▍        | 53563/371472 [4:16:16<23:28:48,  3.76it/s]
 14%|█▍        | 53564/371472 [4:16:16<24:55:36,  3.54it/s]
 14%|█▍        | 53565/371472 [4:16:16<26:09:40,  3.38it/s]
 14%|█▍        | 53566/371472 [4:16:17<25:07:23,  3.51it/s]
 14%|█▍        | 53567/371472 [4:16:17<25:16:05,  3.49it/s]
 14%|█▍        | 53568/371472 [4:16:17<25:12:16,  3.50it/s]
 14%|█▍        | 53569/371472 [4:16:17<25:07:26,  3.51it/s]
 14%|█▍        | 53570/371472 [4:16:18<26:15:31,  3.36it/s]
 14%|█▍        | 53571/371472 [4:16:18<26:38:26,  3.31it/s]
 14%|█▍        | 53572/371472 [4:16:18<26:09:38,  3.38it/s]
 14%|█▍        | 53573/371472 [4:16:19<25:16:03,  3.49it/s]
 14%|█▍        | 53574/371472 [4:16:19<25:08:02,  3.51it/s]
 14%|█▍        | 53575/371472 [4:16:19<24:43:04,  3.57it/s]
 14%|█▍        | 53576/371472 [4:16:19<26:36:34,  3.32it/s]
 14%|█▍        | 53577/371472 [4:16:20<25:19:11,  3.49it/s]
 14%|█▍        | 53578/371472 [4:16:20<24:14:36,  3.64it/s]
 14%|█▍        | 53579/371472 [4:16:20<24:05:07,  3.67it/s]
 14%|█▍        | 53580/371472 [4:16:21<24:08:20,  3.66it/s]
                                                           
{'loss': 4.1611, 'learning_rate': 8.706016074468314e-07, 'epoch': 2.31}

 14%|█▍        | 53580/371472 [4:16:21<24:08:20,  3.66it/s]
 14%|█▍        | 53581/371472 [4:16:21<25:08:01,  3.51it/s]
 14%|█▍        | 53582/371472 [4:16:21<24:22:14,  3.62it/s]
 14%|█▍        | 53583/371472 [4:16:21<24:04:42,  3.67it/s]
 14%|█▍        | 53584/371472 [4:16:22<24:21:52,  3.62it/s]
 14%|█▍        | 53585/371472 [4:16:22<24:57:27,  3.54it/s]
 14%|█▍        | 53586/371472 [4:16:22<24:39:25,  3.58it/s]
 14%|█▍        | 53587/371472 [4:16:22<23:31:57,  3.75it/s]
 14%|█▍        | 53588/371472 [4:16:23<25:40:54,  3.44it/s]
 14%|█▍        | 53589/371472 [4:16:23<24:38:24,  3.58it/s]
 14%|█▍        | 53590/371472 [4:16:23<24:18:17,  3.63it/s]
 14%|█▍        | 53591/371472 [4:16:24<23:16:52,  3.79it/s]
 14%|█▍        | 53592/371472 [4:16:24<23:28:39,  3.76it/s]
 14%|█▍        | 53593/371472 [4:16:24<23:06:51,  3.82it/s]
 14%|█▍        | 53594/371472 [4:16:24<24:36:06,  3.59it/s]
 14%|█▍        | 53595/371472 [4:16:25<24:31:54,  3.60it/s]
 14%|█▍        | 53596/371472 [4:16:25<24:34:39,  3.59it/s]
 14%|█▍        | 53597/371472 [4:16:25<24:45:00,  3.57it/s]
 14%|█▍        | 53598/371472 [4:16:26<24:11:51,  3.65it/s]
 14%|█▍        | 53599/371472 [4:16:26<23:17:32,  3.79it/s]
 14%|█▍        | 53600/371472 [4:16:26<23:42:52,  3.72it/s]
                                                           
{'loss': 4.2708, 'learning_rate': 8.705531254713525e-07, 'epoch': 2.31}

 14%|█▍        | 53600/371472 [4:16:26<23:42:52,  3.72it/s]
 14%|█▍        | 53601/371472 [4:16:26<23:25:55,  3.77it/s]
 14%|█▍        | 53602/371472 [4:16:27<24:24:03,  3.62it/s]
 14%|█▍        | 53603/371472 [4:16:27<23:46:33,  3.71it/s]
 14%|█▍        | 53604/371472 [4:16:27<22:54:10,  3.86it/s]
 14%|█▍        | 53605/371472 [4:16:27<26:16:22,  3.36it/s]
 14%|█▍        | 53606/371472 [4:16:28<25:17:51,  3.49it/s]
 14%|█▍        | 53607/371472 [4:16:28<27:53:39,  3.17it/s]
 14%|█▍        | 53608/371472 [4:16:28<27:22:53,  3.22it/s]
 14%|█▍        | 53609/371472 [4:16:29<25:40:48,  3.44it/s]
 14%|█▍        | 53610/371472 [4:16:29<24:18:13,  3.63it/s]
 14%|█▍        | 53611/371472 [4:16:29<24:12:35,  3.65it/s]
 14%|█▍        | 53612/371472 [4:16:29<23:16:12,  3.79it/s]
 14%|█▍        | 53613/371472 [4:16:30<22:54:59,  3.85it/s]
 14%|█▍        | 53614/371472 [4:16:30<22:27:37,  3.93it/s]
 14%|█▍        | 53615/371472 [4:16:30<23:00:50,  3.84it/s]
 14%|█▍        | 53616/371472 [4:16:31<30:39:31,  2.88it/s]
 14%|█▍        | 53617/371472 [4:16:31<27:59:05,  3.16it/s]
 14%|█▍        | 53618/371472 [4:16:31<26:54:48,  3.28it/s]
 14%|█▍        | 53619/371472 [4:16:32<26:45:49,  3.30it/s]
 14%|█▍        | 53620/371472 [4:16:32<26:09:22,  3.38it/s]
                                                           
{'loss': 4.2761, 'learning_rate': 8.705046434958736e-07, 'epoch': 2.31}

 14%|█▍        | 53620/371472 [4:16:32<26:09:22,  3.38it/s]
 14%|█▍        | 53621/371472 [4:16:32<26:21:51,  3.35it/s]
 14%|█▍        | 53622/371472 [4:16:32<25:34:44,  3.45it/s]
 14%|█▍        | 53623/371472 [4:16:33<24:51:17,  3.55it/s]
 14%|█▍        | 53624/371472 [4:16:33<24:11:55,  3.65it/s]
 14%|█▍        | 53625/371472 [4:16:33<24:16:45,  3.64it/s]
 14%|█▍        | 53626/371472 [4:16:34<26:28:50,  3.33it/s]
 14%|█▍        | 53627/371472 [4:16:34<26:07:32,  3.38it/s]
 14%|█▍        | 53628/371472 [4:16:34<24:39:57,  3.58it/s]
 14%|█▍        | 53629/371472 [4:16:34<24:24:07,  3.62it/s]
 14%|█▍        | 53630/371472 [4:16:35<25:01:46,  3.53it/s]
 14%|█▍        | 53631/371472 [4:16:35<24:02:18,  3.67it/s]
 14%|█▍        | 53632/371472 [4:16:35<26:12:31,  3.37it/s]
 14%|█▍        | 53633/371472 [4:16:35<25:02:16,  3.53it/s]
 14%|█▍        | 53634/371472 [4:16:36<25:59:02,  3.40it/s]
 14%|█▍        | 53635/371472 [4:16:36<26:14:33,  3.36it/s]
 14%|█▍        | 53636/371472 [4:16:36<25:29:43,  3.46it/s]
 14%|█▍        | 53637/371472 [4:16:37<25:56:23,  3.40it/s]
 14%|█▍        | 53638/371472 [4:16:37<25:18:06,  3.49it/s]
 14%|█▍        | 53639/371472 [4:16:37<25:28:22,  3.47it/s]
 14%|█▍        | 53640/371472 [4:16:38<25:25:57,  3.47it/s]
                                                           
{'loss': 4.2535, 'learning_rate': 8.704561615203947e-07, 'epoch': 2.31}

 14%|█▍        | 53640/371472 [4:16:38<25:25:57,  3.47it/s]
 14%|█▍        | 53641/371472 [4:16:38<25:38:22,  3.44it/s]
 14%|█▍        | 53642/371472 [4:16:38<24:50:12,  3.55it/s]
 14%|█▍        | 53643/371472 [4:16:38<25:56:16,  3.40it/s]
 14%|█▍        | 53644/371472 [4:16:39<25:19:13,  3.49it/s]
 14%|█▍        | 53645/371472 [4:16:39<25:20:58,  3.48it/s]
 14%|█▍        | 53646/371472 [4:16:39<24:42:40,  3.57it/s]
 14%|█▍        | 53647/371472 [4:16:40<25:07:32,  3.51it/s]
 14%|█▍        | 53648/371472 [4:16:40<24:20:29,  3.63it/s]
 14%|█▍        | 53649/371472 [4:16:40<24:50:35,  3.55it/s]
 14%|█▍        | 53650/371472 [4:16:40<24:06:35,  3.66it/s]
 14%|█▍        | 53651/371472 [4:16:41<24:39:02,  3.58it/s]
 14%|█▍        | 53652/371472 [4:16:41<25:42:17,  3.43it/s]
 14%|█▍        | 53653/371472 [4:16:41<26:22:21,  3.35it/s]
 14%|█▍        | 53654/371472 [4:16:42<25:16:14,  3.49it/s]
 14%|█▍        | 53655/371472 [4:16:42<24:58:52,  3.53it/s]
 14%|█▍        | 53656/371472 [4:16:42<25:03:13,  3.52it/s]
 14%|█▍        | 53657/371472 [4:16:42<25:22:30,  3.48it/s]
 14%|█▍        | 53658/371472 [4:16:43<24:38:22,  3.58it/s]
 14%|█▍        | 53659/371472 [4:16:43<26:11:47,  3.37it/s]
 14%|█▍        | 53660/371472 [4:16:43<25:01:35,  3.53it/s]
                                                           
{'loss': 4.331, 'learning_rate': 8.704076795449159e-07, 'epoch': 2.31}

 14%|█▍        | 53660/371472 [4:16:43<25:01:35,  3.53it/s]
 14%|█▍        | 53661/371472 [4:16:43<24:18:39,  3.63it/s]
 14%|█▍        | 53662/371472 [4:16:44<23:30:14,  3.76it/s]
 14%|█▍        | 53663/371472 [4:16:44<23:19:41,  3.78it/s]
 14%|█▍        | 53664/371472 [4:16:44<23:42:48,  3.72it/s]
 14%|█▍        | 53665/371472 [4:16:45<23:10:07,  3.81it/s]
 14%|█▍        | 53666/371472 [4:16:45<26:25:27,  3.34it/s]
 14%|█▍        | 53667/371472 [4:16:45<25:40:01,  3.44it/s]
 14%|█▍        | 53668/371472 [4:16:45<25:32:00,  3.46it/s]
 14%|█▍        | 53669/371472 [4:16:46<24:57:23,  3.54it/s]
 14%|█▍        | 53670/371472 [4:16:46<24:19:29,  3.63it/s]
 14%|█▍        | 53671/371472 [4:16:46<23:47:42,  3.71it/s]
 14%|█▍        | 53672/371472 [4:16:46<23:30:03,  3.76it/s]
 14%|█▍        | 53673/371472 [4:16:47<25:22:03,  3.48it/s]
 14%|█▍        | 53674/371472 [4:16:47<25:04:05,  3.52it/s]
 14%|█▍        | 53675/371472 [4:16:47<23:45:27,  3.72it/s]
 14%|█▍        | 53676/371472 [4:16:48<23:39:54,  3.73it/s]
 14%|█▍        | 53677/371472 [4:16:48<24:09:55,  3.65it/s]
 14%|█▍        | 53678/371472 [4:16:48<23:58:52,  3.68it/s]
 14%|█▍        | 53679/371472 [4:16:48<24:10:12,  3.65it/s]
 14%|█▍        | 53680/371472 [4:16:49<24:26:24,  3.61it/s]
                                                           
{'loss': 4.2145, 'learning_rate': 8.703591975694369e-07, 'epoch': 2.31}

 14%|█▍        | 53680/371472 [4:16:49<24:26:24,  3.61it/s]
 14%|█▍        | 53681/371472 [4:16:49<24:33:35,  3.59it/s]
 14%|█▍        | 53682/371472 [4:16:49<24:42:43,  3.57it/s]
 14%|█▍        | 53683/371472 [4:16:50<24:54:14,  3.54it/s]
 14%|█▍        | 53684/371472 [4:16:50<25:04:08,  3.52it/s]
 14%|█▍        | 53685/371472 [4:16:50<25:00:27,  3.53it/s]
 14%|█▍        | 53686/371472 [4:16:50<24:05:26,  3.66it/s]
 14%|█▍        | 53687/371472 [4:16:51<24:34:32,  3.59it/s]
 14%|█▍        | 53688/371472 [4:16:51<25:27:29,  3.47it/s]
 14%|█▍        | 53689/371472 [4:16:51<26:08:05,  3.38it/s]
 14%|█▍        | 53690/371472 [4:16:52<25:08:01,  3.51it/s]
 14%|█▍        | 53691/371472 [4:16:52<24:37:37,  3.58it/s]
 14%|█▍        | 53692/371472 [4:16:52<24:26:46,  3.61it/s]
 14%|█▍        | 53693/371472 [4:16:53<28:33:14,  3.09it/s]
 14%|█▍        | 53694/371472 [4:16:53<27:44:18,  3.18it/s]
 14%|█▍        | 53695/371472 [4:16:53<26:14:05,  3.36it/s]
 14%|█▍        | 53696/371472 [4:16:53<25:01:50,  3.53it/s]
 14%|█▍        | 53697/371472 [4:16:54<24:57:50,  3.54it/s]
 14%|█▍        | 53698/371472 [4:16:54<23:59:42,  3.68it/s]
 14%|█▍        | 53699/371472 [4:16:54<23:05:43,  3.82it/s]
 14%|█▍        | 53700/371472 [4:16:54<25:23:09,  3.48it/s]
                                                           
{'loss': 4.162, 'learning_rate': 8.70310715593958e-07, 'epoch': 2.31}

 14%|█▍        | 53700/371472 [4:16:54<25:23:09,  3.48it/s]
 14%|█▍        | 53701/371472 [4:16:55<25:03:15,  3.52it/s]
 14%|█▍        | 53702/371472 [4:16:55<25:14:56,  3.50it/s]
 14%|█▍        | 53703/371472 [4:16:55<25:13:49,  3.50it/s]
 14%|█▍        | 53704/371472 [4:16:56<24:16:39,  3.64it/s]
 14%|█▍        | 53705/371472 [4:16:56<23:57:15,  3.68it/s]
 14%|█▍        | 53706/371472 [4:16:56<24:04:42,  3.67it/s]
 14%|█▍        | 53707/371472 [4:16:56<23:49:06,  3.71it/s]
 14%|█▍        | 53708/371472 [4:16:57<23:20:30,  3.78it/s]
 14%|█▍        | 53709/371472 [4:16:57<24:09:06,  3.65it/s]
 14%|█▍        | 53710/371472 [4:16:57<25:32:10,  3.46it/s]
 14%|█▍        | 53711/371472 [4:16:58<25:03:36,  3.52it/s]
 14%|█▍        | 53712/371472 [4:16:58<24:50:37,  3.55it/s]
 14%|█▍        | 53713/371472 [4:16:58<24:06:35,  3.66it/s]
 14%|█▍        | 53714/371472 [4:16:58<25:08:07,  3.51it/s]
 14%|█▍        | 53715/371472 [4:16:59<26:12:30,  3.37it/s]
 14%|█▍        | 53716/371472 [4:16:59<25:24:56,  3.47it/s]
 14%|█▍        | 53717/371472 [4:16:59<25:11:43,  3.50it/s]
 14%|█▍        | 53718/371472 [4:16:59<24:26:56,  3.61it/s]
 14%|█▍        | 53719/371472 [4:17:00<23:56:43,  3.69it/s]
 14%|█▍        | 53720/371472 [4:17:00<24:16:24,  3.64it/s]
                                                           
{'loss': 4.1911, 'learning_rate': 8.702622336184791e-07, 'epoch': 2.31}

 14%|█▍        | 53720/371472 [4:17:00<24:16:24,  3.64it/s]
 14%|█▍        | 53721/371472 [4:17:00<24:59:17,  3.53it/s]
 14%|█▍        | 53722/371472 [4:17:01<24:42:43,  3.57it/s]
 14%|█▍        | 53723/371472 [4:17:01<23:29:16,  3.76it/s]
 14%|█▍        | 53724/371472 [4:17:01<23:35:40,  3.74it/s]
 14%|█▍        | 53725/371472 [4:17:01<24:25:23,  3.61it/s]
 14%|█▍        | 53726/371472 [4:17:02<24:05:07,  3.66it/s]
 14%|█▍        | 53727/371472 [4:17:02<23:38:48,  3.73it/s]
 14%|█▍        | 53728/371472 [4:17:02<25:04:30,  3.52it/s]
 14%|█▍        | 53729/371472 [4:17:03<25:26:54,  3.47it/s]
 14%|█▍        | 53730/371472 [4:17:03<25:04:54,  3.52it/s]
 14%|█▍        | 53731/371472 [4:17:03<24:33:27,  3.59it/s]
 14%|█▍        | 53732/371472 [4:17:03<24:47:06,  3.56it/s]
 14%|█▍        | 53733/371472 [4:17:04<25:38:18,  3.44it/s]
 14%|█▍        | 53734/371472 [4:17:04<25:04:01,  3.52it/s]
 14%|█▍        | 53735/371472 [4:17:04<24:48:50,  3.56it/s]
 14%|█▍        | 53736/371472 [4:17:05<24:52:38,  3.55it/s]
 14%|█▍        | 53737/371472 [4:17:05<24:33:35,  3.59it/s]
 14%|█▍        | 53738/371472 [4:17:05<25:06:07,  3.52it/s]
 14%|█▍        | 53739/371472 [4:17:05<24:11:45,  3.65it/s]
 14%|█▍        | 53740/371472 [4:17:06<23:40:35,  3.73it/s]
                                                           
{'loss': 4.4483, 'learning_rate': 8.702137516430002e-07, 'epoch': 2.31}

 14%|█▍        | 53740/371472 [4:17:06<23:40:35,  3.73it/s]
 14%|█▍        | 53741/371472 [4:17:06<23:30:54,  3.75it/s]
 14%|█▍        | 53742/371472 [4:17:06<23:10:29,  3.81it/s]
 14%|█▍        | 53743/371472 [4:17:06<24:09:58,  3.65it/s]
 14%|█▍        | 53744/371472 [4:17:07<23:24:26,  3.77it/s]
 14%|█▍        | 53745/371472 [4:17:07<22:50:45,  3.86it/s]
 14%|█▍        | 53746/371472 [4:17:07<22:36:31,  3.90it/s]
 14%|█▍        | 53747/371472 [4:17:07<23:31:54,  3.75it/s]
 14%|█▍        | 53748/371472 [4:17:08<22:58:16,  3.84it/s]
 14%|█▍        | 53749/371472 [4:17:08<24:45:33,  3.56it/s]
 14%|█▍        | 53750/371472 [4:17:08<24:58:56,  3.53it/s]
 14%|█▍        | 53751/371472 [4:17:09<24:33:41,  3.59it/s]
 14%|█▍        | 53752/371472 [4:17:09<24:50:10,  3.55it/s]
 14%|█▍        | 53753/371472 [4:17:09<24:58:19,  3.53it/s]
 14%|█▍        | 53754/371472 [4:17:09<25:40:19,  3.44it/s]
 14%|█▍        | 53755/371472 [4:17:10<24:23:14,  3.62it/s]
 14%|█▍        | 53756/371472 [4:17:10<24:11:32,  3.65it/s]
 14%|█▍        | 53757/371472 [4:17:10<24:50:50,  3.55it/s]
 14%|█▍        | 53758/371472 [4:17:11<24:59:24,  3.53it/s]
 14%|█▍        | 53759/371472 [4:17:11<25:46:34,  3.42it/s]
 14%|█▍        | 53760/371472 [4:17:11<26:23:30,  3.34it/s]
                                                           
{'loss': 4.1958, 'learning_rate': 8.701652696675213e-07, 'epoch': 2.32}

 14%|█▍        | 53760/371472 [4:17:11<26:23:30,  3.34it/s]
 14%|█▍        | 53761/371472 [4:17:11<26:00:38,  3.39it/s]
 14%|█▍        | 53762/371472 [4:17:12<25:52:32,  3.41it/s]
 14%|█▍        | 53763/371472 [4:17:12<27:18:31,  3.23it/s]
 14%|█▍        | 53764/371472 [4:17:12<26:14:47,  3.36it/s]
 14%|█▍        | 53765/371472 [4:17:13<25:23:13,  3.48it/s]
 14%|█▍        | 53766/371472 [4:17:13<25:28:51,  3.46it/s]
 14%|█▍        | 53767/371472 [4:17:13<24:45:41,  3.56it/s]
 14%|█▍        | 53768/371472 [4:17:13<23:53:22,  3.69it/s]
 14%|█▍        | 53769/371472 [4:17:14<24:01:51,  3.67it/s]
 14%|█▍        | 53770/371472 [4:17:14<24:07:52,  3.66it/s]
 14%|█▍        | 53771/371472 [4:17:14<23:27:15,  3.76it/s]
 14%|█▍        | 53772/371472 [4:17:15<24:51:58,  3.55it/s]
 14%|█▍        | 53773/371472 [4:17:15<23:52:09,  3.70it/s]
 14%|█▍        | 53774/371472 [4:17:15<23:56:17,  3.69it/s]
 14%|█▍        | 53775/371472 [4:17:15<24:26:55,  3.61it/s]
 14%|█▍        | 53776/371472 [4:17:16<23:27:29,  3.76it/s]
 14%|█▍        | 53777/371472 [4:17:16<24:09:11,  3.65it/s]
 14%|█▍        | 53778/371472 [4:17:16<23:31:46,  3.75it/s]
 14%|█▍        | 53779/371472 [4:17:16<24:12:33,  3.65it/s]
 14%|█▍        | 53780/371472 [4:17:17<23:42:44,  3.72it/s]
                                                           
{'loss': 4.3123, 'learning_rate': 8.701167876920425e-07, 'epoch': 2.32}

 14%|█▍        | 53780/371472 [4:17:17<23:42:44,  3.72it/s]
 14%|█▍        | 53781/371472 [4:17:17<24:37:16,  3.58it/s]
 14%|█▍        | 53782/371472 [4:17:17<24:12:58,  3.64it/s]
 14%|█▍        | 53783/371472 [4:17:18<24:14:24,  3.64it/s]
 14%|█▍        | 53784/371472 [4:17:18<24:23:01,  3.62it/s]
 14%|█▍        | 53785/371472 [4:17:18<24:41:52,  3.57it/s]
 14%|█▍        | 53786/371472 [4:17:18<24:35:43,  3.59it/s]
 14%|█▍        | 53787/371472 [4:17:19<23:55:58,  3.69it/s]
 14%|█▍        | 53788/371472 [4:17:19<23:10:29,  3.81it/s]
 14%|█▍        | 53789/371472 [4:17:19<23:27:53,  3.76it/s]
 14%|█▍        | 53790/371472 [4:17:19<23:14:38,  3.80it/s]
 14%|█▍        | 53791/371472 [4:17:20<23:49:01,  3.71it/s]
 14%|█▍        | 53792/371472 [4:17:20<23:48:23,  3.71it/s]
 14%|█▍        | 53793/371472 [4:17:20<24:31:44,  3.60it/s]
 14%|█▍        | 53794/371472 [4:17:20<23:31:46,  3.75it/s]
 14%|█▍        | 53795/371472 [4:17:21<24:46:05,  3.56it/s]
 14%|█▍        | 53796/371472 [4:17:21<26:16:06,  3.36it/s]
 14%|█▍        | 53797/371472 [4:17:21<25:41:16,  3.44it/s]
 14%|█▍        | 53798/371472 [4:17:22<24:52:15,  3.55it/s]
 14%|█▍        | 53799/371472 [4:17:22<25:19:44,  3.48it/s]
 14%|█▍        | 53800/371472 [4:17:22<24:40:38,  3.58it/s]
                                                           
{'loss': 4.251, 'learning_rate': 8.700683057165636e-07, 'epoch': 2.32}

 14%|█▍        | 53800/371472 [4:17:22<24:40:38,  3.58it/s]
 14%|█▍        | 53801/371472 [4:17:23<25:05:54,  3.52it/s]
 14%|█▍        | 53802/371472 [4:17:23<24:31:13,  3.60it/s]
 14%|█▍        | 53803/371472 [4:17:23<25:23:31,  3.48it/s]
 14%|█▍        | 53804/371472 [4:17:23<25:32:02,  3.46it/s]
 14%|█▍        | 53805/371472 [4:17:24<24:40:40,  3.58it/s]
 14%|█▍        | 53806/371472 [4:17:24<24:07:47,  3.66it/s]
 14%|█▍        | 53807/371472 [4:17:24<24:21:14,  3.62it/s]
 14%|█▍        | 53808/371472 [4:17:25<28:09:14,  3.13it/s]
 14%|█▍        | 53809/371472 [4:17:25<26:07:57,  3.38it/s]
 14%|█▍        | 53810/371472 [4:17:25<25:14:01,  3.50it/s]
 14%|█▍        | 53811/371472 [4:17:25<24:27:30,  3.61it/s]
 14%|█▍        | 53812/371472 [4:17:26<23:54:46,  3.69it/s]
 14%|█▍        | 53813/371472 [4:17:26<23:03:13,  3.83it/s]
 14%|█▍        | 53814/371472 [4:17:26<22:54:03,  3.85it/s]
 14%|█▍        | 53815/371472 [4:17:26<23:06:29,  3.82it/s]
 14%|█▍        | 53816/371472 [4:17:27<23:15:31,  3.79it/s]
 14%|█▍        | 53817/371472 [4:17:27<23:22:09,  3.78it/s]
 14%|█▍        | 53818/371472 [4:17:27<24:02:20,  3.67it/s]
 14%|█▍        | 53819/371472 [4:17:28<24:33:25,  3.59it/s]
 14%|█▍        | 53820/371472 [4:17:28<24:13:51,  3.64it/s]
                                                           
{'loss': 4.3, 'learning_rate': 8.700198237410847e-07, 'epoch': 2.32}

 14%|█▍        | 53820/371472 [4:17:28<24:13:51,  3.64it/s]
 14%|█▍        | 53821/371472 [4:17:28<24:05:36,  3.66it/s]
 14%|█▍        | 53822/371472 [4:17:28<24:15:55,  3.64it/s]
 14%|█▍        | 53823/371472 [4:17:29<23:08:29,  3.81it/s]
 14%|█▍        | 53824/371472 [4:17:29<23:22:56,  3.77it/s]
 14%|█▍        | 53825/371472 [4:17:29<23:33:24,  3.75it/s]
 14%|█▍        | 53826/371472 [4:17:29<24:09:14,  3.65it/s]
 14%|█▍        | 53827/371472 [4:17:30<24:12:30,  3.64it/s]
 14%|█▍        | 53828/371472 [4:17:30<23:53:24,  3.69it/s]
 14%|█▍        | 53829/371472 [4:17:30<25:07:04,  3.51it/s]
 14%|█▍        | 53830/371472 [4:17:30<23:54:08,  3.69it/s]
 14%|█▍        | 53831/371472 [4:17:31<24:06:19,  3.66it/s]
 14%|█▍        | 53832/371472 [4:17:31<23:15:50,  3.79it/s]
 14%|█▍        | 53833/371472 [4:17:31<23:04:30,  3.82it/s]
 14%|█▍        | 53834/371472 [4:17:32<22:51:13,  3.86it/s]
 14%|█▍        | 53835/371472 [4:17:32<22:27:40,  3.93it/s]
 14%|█▍        | 53836/371472 [4:17:32<22:51:06,  3.86it/s]
 14%|█▍        | 53837/371472 [4:17:32<23:25:49,  3.77it/s]
 14%|█▍        | 53838/371472 [4:17:33<22:58:56,  3.84it/s]
 14%|█▍        | 53839/371472 [4:17:33<26:04:04,  3.38it/s]
 14%|█▍        | 53840/371472 [4:17:33<25:30:20,  3.46it/s]
                                                           
{'loss': 4.327, 'learning_rate': 8.699713417656057e-07, 'epoch': 2.32}

 14%|█▍        | 53840/371472 [4:17:33<25:30:20,  3.46it/s]
 14%|█▍        | 53841/371472 [4:17:33<24:55:01,  3.54it/s]
 14%|█▍        | 53842/371472 [4:17:34<24:10:41,  3.65it/s]
 14%|█▍        | 53843/371472 [4:17:34<25:55:28,  3.40it/s]
 14%|█▍        | 53844/371472 [4:17:34<24:29:27,  3.60it/s]
 14%|█▍        | 53845/371472 [4:17:35<23:54:27,  3.69it/s]
 14%|█▍        | 53846/371472 [4:17:35<23:43:43,  3.72it/s]
 14%|█▍        | 53847/371472 [4:17:35<23:46:08,  3.71it/s]
 14%|█▍        | 53848/371472 [4:17:35<23:32:35,  3.75it/s]
 14%|█▍        | 53849/371472 [4:17:36<24:24:15,  3.62it/s]
 14%|█▍        | 53850/371472 [4:17:36<23:53:38,  3.69it/s]
 14%|█▍        | 53851/371472 [4:17:36<24:15:09,  3.64it/s]
 14%|█▍        | 53852/371472 [4:17:37<25:18:55,  3.49it/s]
 14%|█▍        | 53853/371472 [4:17:37<25:20:22,  3.48it/s]
 14%|█▍        | 53854/371472 [4:17:37<25:28:48,  3.46it/s]
 14%|█▍        | 53855/371472 [4:17:37<25:20:39,  3.48it/s]
 14%|█▍        | 53856/371472 [4:17:38<26:09:18,  3.37it/s]
 14%|█▍        | 53857/371472 [4:17:38<27:15:14,  3.24it/s]
 14%|█▍        | 53858/371472 [4:17:38<26:40:14,  3.31it/s]
 14%|█▍        | 53859/371472 [4:17:39<27:08:09,  3.25it/s]
 14%|█▍        | 53860/371472 [4:17:39<28:28:22,  3.10it/s]
                                                           
{'loss': 4.5191, 'learning_rate': 8.699228597901269e-07, 'epoch': 2.32}

 14%|█▍        | 53860/371472 [4:17:39<28:28:22,  3.10it/s]
 14%|█▍        | 53861/371472 [4:17:39<28:04:52,  3.14it/s]
 14%|█▍        | 53862/371472 [4:17:40<29:52:20,  2.95it/s]
 14%|█▍        | 53863/371472 [4:17:40<27:52:18,  3.17it/s]
 15%|█▍        | 53864/371472 [4:17:40<26:49:07,  3.29it/s]
 15%|█▍        | 53865/371472 [4:17:40<25:51:18,  3.41it/s]
 15%|█▍        | 53866/371472 [4:17:41<25:12:49,  3.50it/s]
 15%|█▍        | 53867/371472 [4:17:41<28:20:08,  3.11it/s]
 15%|█▍        | 53868/371472 [4:17:41<28:02:28,  3.15it/s]
 15%|█▍        | 53869/371472 [4:17:42<28:19:31,  3.11it/s]
 15%|█▍        | 53870/371472 [4:17:42<28:14:51,  3.12it/s]
 15%|█▍        | 53871/371472 [4:17:42<27:27:18,  3.21it/s]
 15%|█▍        | 53872/371472 [4:17:43<27:21:32,  3.22it/s]
 15%|█▍        | 53873/371472 [4:17:43<25:39:38,  3.44it/s]
 15%|█▍        | 53874/371472 [4:17:43<24:23:09,  3.62it/s]
 15%|█▍        | 53875/371472 [4:17:43<24:21:29,  3.62it/s]
 15%|█▍        | 53876/371472 [4:17:44<24:05:42,  3.66it/s]
 15%|█▍        | 53877/371472 [4:17:44<25:59:07,  3.40it/s]
 15%|█▍        | 53878/371472 [4:17:44<26:10:05,  3.37it/s]
 15%|█▍        | 53879/371472 [4:17:45<25:16:28,  3.49it/s]
 15%|█▍        | 53880/371472 [4:17:45<24:18:10,  3.63it/s]
                                                           
{'loss': 4.0079, 'learning_rate': 8.698743778146481e-07, 'epoch': 2.32}

 15%|█▍        | 53880/371472 [4:17:45<24:18:10,  3.63it/s]
 15%|█▍        | 53881/371472 [4:17:45<24:47:03,  3.56it/s]
 15%|█▍        | 53882/371472 [4:17:45<24:48:01,  3.56it/s]
 15%|█▍        | 53883/371472 [4:17:46<24:30:50,  3.60it/s]
 15%|█▍        | 53884/371472 [4:17:46<23:36:34,  3.74it/s]
 15%|█▍        | 53885/371472 [4:17:46<25:30:26,  3.46it/s]
 15%|█▍        | 53886/371472 [4:17:47<25:21:26,  3.48it/s]
 15%|█▍        | 53887/371472 [4:17:47<26:02:34,  3.39it/s]
 15%|█▍        | 53888/371472 [4:17:47<24:53:32,  3.54it/s]
 15%|█▍        | 53889/371472 [4:17:48<26:13:03,  3.36it/s]
 15%|█▍        | 53890/371472 [4:17:48<24:26:19,  3.61it/s]
 15%|█▍        | 53891/371472 [4:17:48<23:10:43,  3.81it/s]
 15%|█▍        | 53892/371472 [4:17:48<24:13:17,  3.64it/s]
 15%|█▍        | 53893/371472 [4:17:49<24:09:37,  3.65it/s]
 15%|█▍        | 53894/371472 [4:17:49<25:04:04,  3.52it/s]
 15%|█▍        | 53895/371472 [4:17:49<25:24:48,  3.47it/s]
 15%|█▍        | 53896/371472 [4:17:49<25:32:42,  3.45it/s]
 15%|█▍        | 53897/371472 [4:17:50<25:13:10,  3.50it/s]
 15%|█▍        | 53898/371472 [4:17:50<26:04:51,  3.38it/s]
 15%|█▍        | 53899/371472 [4:17:50<25:19:48,  3.48it/s]
 15%|█▍        | 53900/371472 [4:17:51<24:36:57,  3.58it/s]
                                                           
{'loss': 4.1226, 'learning_rate': 8.698258958391691e-07, 'epoch': 2.32}

 15%|█▍        | 53900/371472 [4:17:51<24:36:57,  3.58it/s]
 15%|█▍        | 53901/371472 [4:17:51<24:19:50,  3.63it/s]
 15%|█▍        | 53902/371472 [4:17:51<25:53:43,  3.41it/s]
 15%|█▍        | 53903/371472 [4:17:51<24:44:55,  3.56it/s]
 15%|█▍        | 53904/371472 [4:17:52<24:13:05,  3.64it/s]
 15%|█▍        | 53905/371472 [4:17:52<23:31:47,  3.75it/s]
 15%|█▍        | 53906/371472 [4:17:52<24:26:43,  3.61it/s]
 15%|█▍        | 53907/371472 [4:17:52<23:39:20,  3.73it/s]
 15%|█▍        | 53908/371472 [4:17:53<24:11:27,  3.65it/s]
 15%|█▍        | 53909/371472 [4:17:53<24:12:00,  3.65it/s]
 15%|█▍        | 53910/371472 [4:17:53<23:46:05,  3.71it/s]
 15%|█▍        | 53911/371472 [4:17:54<24:32:07,  3.60it/s]
 15%|█▍        | 53912/371472 [4:17:54<23:45:31,  3.71it/s]
 15%|█▍        | 53913/371472 [4:17:54<23:46:31,  3.71it/s]
 15%|█▍        | 53914/371472 [4:17:54<24:44:55,  3.56it/s]
 15%|█▍        | 53915/371472 [4:17:55<24:51:10,  3.55it/s]
 15%|█▍        | 53916/371472 [4:17:55<24:09:10,  3.65it/s]
 15%|█▍        | 53917/371472 [4:17:55<23:14:38,  3.79it/s]
 15%|█▍        | 53918/371472 [4:17:56<23:57:40,  3.68it/s]
 15%|█▍        | 53919/371472 [4:17:56<23:40:56,  3.72it/s]
 15%|█▍        | 53920/371472 [4:17:56<24:38:09,  3.58it/s]
                                                           
{'loss': 4.2492, 'learning_rate': 8.697774138636902e-07, 'epoch': 2.32}

 15%|█▍        | 53920/371472 [4:17:56<24:38:09,  3.58it/s]
 15%|█▍        | 53921/371472 [4:17:56<23:35:08,  3.74it/s]
 15%|█▍        | 53922/371472 [4:17:57<24:32:56,  3.59it/s]
 15%|█▍        | 53923/371472 [4:17:57<23:49:39,  3.70it/s]
 15%|█▍        | 53924/371472 [4:17:57<24:42:29,  3.57it/s]
 15%|█▍        | 53925/371472 [4:17:57<24:34:41,  3.59it/s]
 15%|█▍        | 53926/371472 [4:17:58<24:20:41,  3.62it/s]
 15%|█▍        | 53927/371472 [4:17:58<24:49:59,  3.55it/s]
 15%|█▍        | 53928/371472 [4:17:58<25:34:43,  3.45it/s]
 15%|█▍        | 53929/371472 [4:17:59<24:56:31,  3.54it/s]
 15%|█▍        | 53930/371472 [4:17:59<24:24:36,  3.61it/s]
 15%|█▍        | 53931/371472 [4:17:59<25:52:08,  3.41it/s]
 15%|█▍        | 53932/371472 [4:17:59<25:15:52,  3.49it/s]
 15%|█▍        | 53933/371472 [4:18:00<24:00:55,  3.67it/s]
 15%|█▍        | 53934/371472 [4:18:00<23:25:37,  3.77it/s]
 15%|█▍        | 53935/371472 [4:18:00<27:06:40,  3.25it/s]
 15%|█▍        | 53936/371472 [4:18:01<26:34:01,  3.32it/s]
 15%|█▍        | 53937/371472 [4:18:01<25:06:25,  3.51it/s]
 15%|█▍        | 53938/371472 [4:18:01<24:13:10,  3.64it/s]
 15%|█▍        | 53939/371472 [4:18:01<23:49:48,  3.70it/s]
 15%|█▍        | 53940/371472 [4:18:02<23:29:49,  3.75it/s]
                                                           
{'loss': 4.2787, 'learning_rate': 8.697289318882113e-07, 'epoch': 2.32}

 15%|█▍        | 53940/371472 [4:18:02<23:29:49,  3.75it/s]
 15%|█▍        | 53941/371472 [4:18:02<23:22:16,  3.77it/s]
 15%|█▍        | 53942/371472 [4:18:02<23:03:41,  3.82it/s]
 15%|█▍        | 53943/371472 [4:18:02<24:06:56,  3.66it/s]
 15%|█▍        | 53944/371472 [4:18:03<23:18:40,  3.78it/s]
 15%|█▍        | 53945/371472 [4:18:03<24:56:30,  3.54it/s]
 15%|█▍        | 53946/371472 [4:18:03<24:19:29,  3.63it/s]
 15%|█▍        | 53947/371472 [4:18:04<25:19:05,  3.48it/s]
 15%|█▍        | 53948/371472 [4:18:04<25:04:38,  3.52it/s]
 15%|█▍        | 53949/371472 [4:18:04<24:59:06,  3.53it/s]
 15%|█▍        | 53950/371472 [4:18:04<24:44:02,  3.57it/s]
 15%|█▍        | 53951/371472 [4:18:05<25:03:07,  3.52it/s]
 15%|█▍        | 53952/371472 [4:18:05<25:49:03,  3.42it/s]
 15%|█▍        | 53953/371472 [4:18:05<25:50:07,  3.41it/s]
 15%|█▍        | 53954/371472 [4:18:06<24:35:26,  3.59it/s]
 15%|█▍        | 53955/371472 [4:18:06<24:22:04,  3.62it/s]
 15%|█▍        | 53956/371472 [4:18:06<24:01:34,  3.67it/s]
 15%|█▍        | 53957/371472 [4:18:06<25:20:59,  3.48it/s]
 15%|█▍        | 53958/371472 [4:18:07<24:24:16,  3.61it/s]
 15%|█▍        | 53959/371472 [4:18:07<23:58:35,  3.68it/s]
 15%|█▍        | 53960/371472 [4:18:07<24:25:47,  3.61it/s]
                                                           
{'loss': 4.1966, 'learning_rate': 8.696804499127323e-07, 'epoch': 2.32}

 15%|█▍        | 53960/371472 [4:18:07<24:25:47,  3.61it/s]
 15%|█▍        | 53961/371472 [4:18:08<24:29:52,  3.60it/s]
 15%|█▍        | 53962/371472 [4:18:08<24:53:32,  3.54it/s]
 15%|█▍        | 53963/371472 [4:18:08<27:17:51,  3.23it/s]
 15%|█▍        | 53964/371472 [4:18:08<26:33:57,  3.32it/s]
 15%|█▍        | 53965/371472 [4:18:09<24:55:25,  3.54it/s]
 15%|█▍        | 53966/371472 [4:18:09<25:53:45,  3.41it/s]
 15%|█▍        | 53967/371472 [4:18:09<24:57:33,  3.53it/s]
 15%|█▍        | 53968/371472 [4:18:10<25:03:12,  3.52it/s]
 15%|█▍        | 53969/371472 [4:18:10<25:06:06,  3.51it/s]
 15%|█▍        | 53970/371472 [4:18:10<25:21:38,  3.48it/s]
 15%|█▍        | 53971/371472 [4:18:10<24:48:13,  3.56it/s]
 15%|█▍        | 53972/371472 [4:18:11<24:51:26,  3.55it/s]
 15%|█▍        | 53973/371472 [4:18:11<25:49:05,  3.42it/s]
 15%|█▍        | 53974/371472 [4:18:11<26:12:03,  3.37it/s]
 15%|█▍        | 53975/371472 [4:18:12<27:19:52,  3.23it/s]
 15%|█▍        | 53976/371472 [4:18:12<27:18:35,  3.23it/s]
 15%|█▍        | 53977/371472 [4:18:12<27:54:50,  3.16it/s]
 15%|█▍        | 53978/371472 [4:18:13<26:03:12,  3.39it/s]
 15%|█▍        | 53979/371472 [4:18:13<26:59:32,  3.27it/s]
 15%|█▍        | 53980/371472 [4:18:13<25:36:48,  3.44it/s]
                                                           
{'loss': 4.2201, 'learning_rate': 8.696319679372535e-07, 'epoch': 2.33}

 15%|█▍        | 53980/371472 [4:18:13<25:36:48,  3.44it/s]
 15%|█▍        | 53981/371472 [4:18:13<26:00:07,  3.39it/s]
 15%|█▍        | 53982/371472 [4:18:14<24:40:22,  3.57it/s]
 15%|█▍        | 53983/371472 [4:18:14<25:41:13,  3.43it/s]
 15%|█▍        | 53984/371472 [4:18:14<25:37:21,  3.44it/s]
 15%|█▍        | 53985/371472 [4:18:15<26:31:09,  3.33it/s]
 15%|█▍        | 53986/371472 [4:18:15<25:50:53,  3.41it/s]
 15%|█▍        | 53987/371472 [4:18:15<25:54:54,  3.40it/s]
 15%|█▍        | 53988/371472 [4:18:15<24:47:26,  3.56it/s]
 15%|█▍        | 53989/371472 [4:18:16<24:42:34,  3.57it/s]
 15%|█▍        | 53990/371472 [4:18:16<25:28:11,  3.46it/s]
 15%|█▍        | 53991/371472 [4:18:16<24:56:30,  3.54it/s]
 15%|█▍        | 53992/371472 [4:18:17<24:41:49,  3.57it/s]
 15%|█▍        | 53993/371472 [4:18:17<24:10:58,  3.65it/s]
 15%|█▍        | 53994/371472 [4:18:17<24:10:29,  3.65it/s]
 15%|█▍        | 53995/371472 [4:18:17<25:41:42,  3.43it/s]
 15%|█▍        | 53996/371472 [4:18:18<27:21:52,  3.22it/s]
 15%|█▍        | 53997/371472 [4:18:18<26:36:00,  3.32it/s]
 15%|█▍        | 53998/371472 [4:18:18<25:38:25,  3.44it/s]
 15%|█▍        | 53999/371472 [4:18:19<25:35:00,  3.45it/s]
 15%|█▍        | 54000/371472 [4:18:19<25:49:52,  3.41it/s]
                                                           
{'loss': 4.2533, 'learning_rate': 8.695834859617746e-07, 'epoch': 2.33}

 15%|█▍        | 54000/371472 [4:18:19<25:49:52,  3.41it/s]
 15%|█▍        | 54001/371472 [4:18:19<26:33:01,  3.32it/s]
 15%|█▍        | 54002/371472 [4:18:20<25:48:06,  3.42it/s]
 15%|█▍        | 54003/371472 [4:18:20<24:43:58,  3.57it/s]
 15%|█▍        | 54004/371472 [4:18:20<24:36:32,  3.58it/s]
 15%|█▍        | 54005/371472 [4:18:20<24:59:17,  3.53it/s]
 15%|█▍        | 54006/371472 [4:18:21<25:17:34,  3.49it/s]
 15%|█▍        | 54007/371472 [4:18:21<25:09:09,  3.51it/s]
 15%|█▍        | 54008/371472 [4:18:21<23:54:56,  3.69it/s]
 15%|█▍        | 54009/371472 [4:18:21<24:05:07,  3.66it/s]
 15%|█▍        | 54010/371472 [4:18:22<24:48:57,  3.55it/s]
 15%|█▍        | 54011/371472 [4:18:22<24:25:15,  3.61it/s]
 15%|█▍        | 54012/371472 [4:18:22<24:12:07,  3.64it/s]
 15%|█▍        | 54013/371472 [4:18:22<23:02:59,  3.83it/s]
 15%|█▍        | 54014/371472 [4:18:23<25:09:43,  3.50it/s]
 15%|█▍        | 54015/371472 [4:18:23<24:50:54,  3.55it/s]
 15%|█▍        | 54016/371472 [4:18:23<25:20:17,  3.48it/s]
 15%|█▍        | 54017/371472 [4:18:24<25:12:12,  3.50it/s]
 15%|█▍        | 54018/371472 [4:18:24<26:05:56,  3.38it/s]
 15%|█▍        | 54019/371472 [4:18:24<25:09:01,  3.51it/s]
 15%|█▍        | 54020/371472 [4:18:25<24:32:55,  3.59it/s]
                                                           
{'loss': 4.2268, 'learning_rate': 8.695350039862957e-07, 'epoch': 2.33}

 15%|█▍        | 54020/371472 [4:18:25<24:32:55,  3.59it/s]
 15%|█▍        | 54021/371472 [4:18:25<24:05:58,  3.66it/s]
 15%|█▍        | 54022/371472 [4:18:25<23:25:19,  3.76it/s]
 15%|█▍        | 54023/371472 [4:18:25<23:11:22,  3.80it/s]
 15%|█▍        | 54024/371472 [4:18:26<25:37:12,  3.44it/s]
 15%|█▍        | 54025/371472 [4:18:26<24:33:56,  3.59it/s]
 15%|█▍        | 54026/371472 [4:18:26<24:43:38,  3.57it/s]
 15%|█▍        | 54027/371472 [4:18:27<25:53:32,  3.41it/s]
 15%|█▍        | 54028/371472 [4:18:27<25:42:29,  3.43it/s]
 15%|█▍        | 54029/371472 [4:18:27<25:52:34,  3.41it/s]
 15%|█▍        | 54030/371472 [4:18:27<24:46:21,  3.56it/s]
 15%|█▍        | 54031/371472 [4:18:28<24:58:26,  3.53it/s]
 15%|█▍        | 54032/371472 [4:18:28<23:50:33,  3.70it/s]
 15%|█▍        | 54033/371472 [4:18:28<23:35:04,  3.74it/s]
 15%|█▍        | 54034/371472 [4:18:28<24:05:40,  3.66it/s]
 15%|█▍        | 54035/371472 [4:18:29<23:49:23,  3.70it/s]
 15%|█▍        | 54036/371472 [4:18:29<23:07:02,  3.81it/s]
 15%|█▍        | 54037/371472 [4:18:29<23:23:42,  3.77it/s]
 15%|█▍        | 54038/371472 [4:18:29<23:26:22,  3.76it/s]
 15%|█▍        | 54039/371472 [4:18:30<23:06:37,  3.82it/s]
 15%|█▍        | 54040/371472 [4:18:30<24:19:17,  3.63it/s]
                                                           
{'loss': 4.2416, 'learning_rate': 8.694865220108168e-07, 'epoch': 2.33}

 15%|█▍        | 54040/371472 [4:18:30<24:19:17,  3.63it/s]
 15%|█▍        | 54041/371472 [4:18:30<24:15:47,  3.63it/s]
 15%|█▍        | 54042/371472 [4:18:31<23:56:13,  3.68it/s]
 15%|█▍        | 54043/371472 [4:18:31<24:15:57,  3.63it/s]
 15%|█▍        | 54044/371472 [4:18:31<26:13:05,  3.36it/s]
 15%|█▍        | 54045/371472 [4:18:31<24:40:18,  3.57it/s]
 15%|█▍        | 54046/371472 [4:18:32<24:46:25,  3.56it/s]
 15%|█▍        | 54047/371472 [4:18:32<24:19:07,  3.63it/s]
 15%|█▍        | 54048/371472 [4:18:32<26:08:02,  3.37it/s]
 15%|█▍        | 54049/371472 [4:18:33<24:57:05,  3.53it/s]
 15%|█▍        | 54050/371472 [4:18:33<24:46:12,  3.56it/s]
 15%|█▍        | 54051/371472 [4:18:33<26:33:54,  3.32it/s]
 15%|█▍        | 54052/371472 [4:18:33<25:28:29,  3.46it/s]
 15%|█▍        | 54053/371472 [4:18:34<24:56:50,  3.53it/s]
 15%|█▍        | 54054/371472 [4:18:34<24:46:20,  3.56it/s]
 15%|█▍        | 54055/371472 [4:18:34<23:56:46,  3.68it/s]
 15%|█▍        | 54056/371472 [4:18:35<24:58:49,  3.53it/s]
 15%|█▍        | 54057/371472 [4:18:35<26:13:04,  3.36it/s]
 15%|█▍        | 54058/371472 [4:18:35<25:24:42,  3.47it/s]
 15%|█▍        | 54059/371472 [4:18:36<26:31:03,  3.32it/s]
 15%|█▍        | 54060/371472 [4:18:36<25:15:33,  3.49it/s]
                                                           
{'loss': 4.1719, 'learning_rate': 8.69438040035338e-07, 'epoch': 2.33}

 15%|█▍        | 54060/371472 [4:18:36<25:15:33,  3.49it/s]
 15%|█▍        | 54061/371472 [4:18:36<26:13:14,  3.36it/s]
 15%|█▍        | 54062/371472 [4:18:36<25:50:28,  3.41it/s]
 15%|█▍        | 54063/371472 [4:18:37<25:09:37,  3.50it/s]
 15%|█▍        | 54064/371472 [4:18:37<25:59:53,  3.39it/s]
 15%|█▍        | 54065/371472 [4:18:37<26:13:47,  3.36it/s]
 15%|█▍        | 54066/371472 [4:18:38<26:06:32,  3.38it/s]
 15%|█▍        | 54067/371472 [4:18:38<25:08:42,  3.51it/s]
 15%|█▍        | 54068/371472 [4:18:38<24:54:18,  3.54it/s]
 15%|█▍        | 54069/371472 [4:18:38<24:25:11,  3.61it/s]
 15%|█▍        | 54070/371472 [4:18:39<24:37:47,  3.58it/s]
 15%|█▍        | 54071/371472 [4:18:39<24:30:16,  3.60it/s]
 15%|█▍        | 54072/371472 [4:18:39<24:24:39,  3.61it/s]
 15%|█▍        | 54073/371472 [4:18:39<24:19:34,  3.62it/s]
 15%|█▍        | 54074/371472 [4:18:40<23:02:44,  3.83it/s]
 15%|█▍        | 54075/371472 [4:18:40<22:57:05,  3.84it/s]
 15%|█▍        | 54076/371472 [4:18:40<24:54:10,  3.54it/s]
 15%|█▍        | 54077/371472 [4:18:41<25:42:41,  3.43it/s]
 15%|█▍        | 54078/371472 [4:18:41<25:24:19,  3.47it/s]
 15%|█▍        | 54079/371472 [4:18:41<24:23:59,  3.61it/s]
 15%|█▍        | 54080/371472 [4:18:41<24:53:56,  3.54it/s]
                                                           
{'loss': 4.4017, 'learning_rate': 8.693895580598591e-07, 'epoch': 2.33}

 15%|█▍        | 54080/371472 [4:18:41<24:53:56,  3.54it/s]
 15%|█▍        | 54081/371472 [4:18:42<24:22:05,  3.62it/s]
 15%|█▍        | 54082/371472 [4:18:42<24:18:07,  3.63it/s]
 15%|█▍        | 54083/371472 [4:18:42<23:36:06,  3.74it/s]
 15%|█▍        | 54084/371472 [4:18:42<23:26:17,  3.76it/s]
 15%|█▍        | 54085/371472 [4:18:43<26:24:26,  3.34it/s]
 15%|█▍        | 54086/371472 [4:18:43<26:17:40,  3.35it/s]
 15%|█▍        | 54087/371472 [4:18:43<26:21:23,  3.34it/s]
 15%|█▍        | 54088/371472 [4:18:44<26:39:16,  3.31it/s]
 15%|█▍        | 54089/371472 [4:18:44<26:35:50,  3.31it/s]
 15%|█▍        | 54090/371472 [4:18:44<25:31:38,  3.45it/s]
 15%|█▍        | 54091/371472 [4:18:45<25:36:24,  3.44it/s]
 15%|█▍        | 54092/371472 [4:18:45<24:56:28,  3.53it/s]
 15%|█▍        | 54093/371472 [4:18:45<24:18:55,  3.63it/s]
 15%|█▍        | 54094/371472 [4:18:45<23:53:27,  3.69it/s]
 15%|█▍        | 54095/371472 [4:18:46<23:19:41,  3.78it/s]
 15%|█▍        | 54096/371472 [4:18:46<24:22:45,  3.62it/s]
 15%|█▍        | 54097/371472 [4:18:46<24:53:54,  3.54it/s]
 15%|█▍        | 54098/371472 [4:18:46<24:19:18,  3.62it/s]
 15%|█▍        | 54099/371472 [4:18:47<25:31:52,  3.45it/s]
 15%|█▍        | 54100/371472 [4:18:47<25:22:47,  3.47it/s]
                                                           
{'loss': 4.3052, 'learning_rate': 8.693410760843801e-07, 'epoch': 2.33}

 15%|█▍        | 54100/371472 [4:18:47<25:22:47,  3.47it/s]
 15%|█▍        | 54101/371472 [4:18:47<24:14:14,  3.64it/s]
 15%|█▍        | 54102/371472 [4:18:48<23:20:40,  3.78it/s]
 15%|█▍        | 54103/371472 [4:18:48<24:16:24,  3.63it/s]
 15%|█▍        | 54104/371472 [4:18:48<23:36:13,  3.73it/s]
 15%|█▍        | 54105/371472 [4:18:48<24:34:24,  3.59it/s]
 15%|█▍        | 54106/371472 [4:18:49<26:20:17,  3.35it/s]
 15%|█▍        | 54107/371472 [4:18:49<25:36:56,  3.44it/s]
 15%|█▍        | 54108/371472 [4:18:49<25:25:13,  3.47it/s]
 15%|█▍        | 54109/371472 [4:18:50<25:29:09,  3.46it/s]
 15%|█▍        | 54110/371472 [4:18:50<26:35:50,  3.31it/s]
 15%|█▍        | 54111/371472 [4:18:50<25:43:03,  3.43it/s]
 15%|█▍        | 54112/371472 [4:18:51<25:24:34,  3.47it/s]
 15%|█▍        | 54113/371472 [4:18:51<24:25:28,  3.61it/s]
 15%|█▍        | 54114/371472 [4:18:51<26:39:25,  3.31it/s]
 15%|█▍        | 54115/371472 [4:18:51<26:52:09,  3.28it/s]
 15%|█▍        | 54116/371472 [4:18:52<25:25:14,  3.47it/s]
 15%|█▍        | 54117/371472 [4:18:52<26:09:16,  3.37it/s]
 15%|█▍        | 54118/371472 [4:18:52<25:32:22,  3.45it/s]
 15%|█▍        | 54119/371472 [4:18:53<24:47:04,  3.56it/s]
 15%|█▍        | 54120/371472 [4:18:53<24:01:11,  3.67it/s]
                                                           
{'loss': 4.1228, 'learning_rate': 8.692925941089012e-07, 'epoch': 2.33}

 15%|█▍        | 54120/371472 [4:18:53<24:01:11,  3.67it/s]
 15%|█▍        | 54121/371472 [4:18:53<23:34:59,  3.74it/s]
 15%|█▍        | 54122/371472 [4:18:53<23:07:52,  3.81it/s]
 15%|█▍        | 54123/371472 [4:18:54<25:00:10,  3.53it/s]
 15%|█▍        | 54124/371472 [4:18:54<24:26:51,  3.61it/s]
 15%|█▍        | 54125/371472 [4:18:54<23:36:53,  3.73it/s]
 15%|█▍        | 54126/371472 [4:18:54<23:40:01,  3.72it/s]
 15%|█▍        | 54127/371472 [4:18:55<23:45:25,  3.71it/s]
 15%|█▍        | 54128/371472 [4:18:55<22:52:46,  3.85it/s]
 15%|█▍        | 54129/371472 [4:18:55<22:47:28,  3.87it/s]
 15%|█▍        | 54130/371472 [4:18:55<24:03:41,  3.66it/s]
 15%|█▍        | 54131/371472 [4:18:56<23:14:02,  3.79it/s]
 15%|█▍        | 54132/371472 [4:18:56<24:07:40,  3.65it/s]
 15%|█▍        | 54133/371472 [4:18:56<25:00:20,  3.53it/s]
 15%|█▍        | 54134/371472 [4:18:57<25:01:36,  3.52it/s]
 15%|█▍        | 54135/371472 [4:18:57<24:51:54,  3.55it/s]
 15%|█▍        | 54136/371472 [4:18:57<24:41:20,  3.57it/s]
 15%|█▍        | 54137/371472 [4:18:57<25:23:14,  3.47it/s]
 15%|█▍        | 54138/371472 [4:18:58<24:59:02,  3.53it/s]
 15%|█▍        | 54139/371472 [4:18:58<25:18:38,  3.48it/s]
 15%|█▍        | 54140/371472 [4:18:58<25:26:03,  3.47it/s]
                                                           
{'loss': 4.2331, 'learning_rate': 8.692441121334224e-07, 'epoch': 2.33}

 15%|█▍        | 54140/371472 [4:18:58<25:26:03,  3.47it/s]
 15%|█▍        | 54141/371472 [4:18:59<25:09:37,  3.50it/s]
 15%|█▍        | 54142/371472 [4:18:59<24:09:03,  3.65it/s]
 15%|█▍        | 54143/371472 [4:18:59<22:58:22,  3.84it/s]
 15%|█▍        | 54144/371472 [4:18:59<22:28:11,  3.92it/s]
 15%|█▍        | 54145/371472 [4:19:00<22:27:04,  3.93it/s]
 15%|█▍        | 54146/371472 [4:19:00<24:23:58,  3.61it/s]
 15%|█▍        | 54147/371472 [4:19:00<26:23:04,  3.34it/s]
 15%|█▍        | 54148/371472 [4:19:01<25:03:07,  3.52it/s]
 15%|█▍        | 54149/371472 [4:19:01<26:27:57,  3.33it/s]
 15%|█▍        | 54150/371472 [4:19:01<28:02:02,  3.14it/s]
 15%|█▍        | 54151/371472 [4:19:01<26:46:27,  3.29it/s]
 15%|█▍        | 54152/371472 [4:19:02<25:50:00,  3.41it/s]
 15%|█▍        | 54153/371472 [4:19:02<26:44:54,  3.30it/s]
 15%|█▍        | 54154/371472 [4:19:02<26:38:15,  3.31it/s]
 15%|█▍        | 54155/371472 [4:19:03<25:16:48,  3.49it/s]
 15%|█▍        | 54156/371472 [4:19:03<26:47:19,  3.29it/s]
 15%|█▍        | 54157/371472 [4:19:03<26:27:16,  3.33it/s]
 15%|█▍        | 54158/371472 [4:19:04<25:41:31,  3.43it/s]
 15%|█▍        | 54159/371472 [4:19:04<25:04:56,  3.51it/s]
 15%|█▍        | 54160/371472 [4:19:04<26:29:27,  3.33it/s]
                                                           
{'loss': 4.055, 'learning_rate': 8.691956301579435e-07, 'epoch': 2.33}

 15%|█▍        | 54160/371472 [4:19:04<26:29:27,  3.33it/s]
 15%|█▍        | 54161/371472 [4:19:05<28:35:17,  3.08it/s]
 15%|█▍        | 54162/371472 [4:19:05<27:37:09,  3.19it/s]
 15%|█▍        | 54163/371472 [4:19:05<28:02:02,  3.14it/s]
 15%|█▍        | 54164/371472 [4:19:05<28:37:24,  3.08it/s]
 15%|█▍        | 54165/371472 [4:19:06<27:06:00,  3.25it/s]
 15%|█▍        | 54166/371472 [4:19:06<27:18:31,  3.23it/s]
 15%|█▍        | 54167/371472 [4:19:06<26:59:43,  3.27it/s]
 15%|█▍        | 54168/371472 [4:19:07<26:06:28,  3.38it/s]
 15%|█▍        | 54169/371472 [4:19:07<25:19:16,  3.48it/s]
 15%|█▍        | 54170/371472 [4:19:07<24:08:51,  3.65it/s]
 15%|█▍        | 54171/371472 [4:19:07<24:47:01,  3.56it/s]
 15%|█▍        | 54172/371472 [4:19:08<24:12:13,  3.64it/s]
 15%|█▍        | 54173/371472 [4:19:08<22:59:56,  3.83it/s]
 15%|█▍        | 54174/371472 [4:19:08<23:10:14,  3.80it/s]
 15%|█▍        | 54175/371472 [4:19:08<23:55:33,  3.68it/s]
 15%|█▍        | 54176/371472 [4:19:09<23:16:00,  3.79it/s]
 15%|█▍        | 54177/371472 [4:19:09<25:30:30,  3.46it/s]
 15%|█▍        | 54178/371472 [4:19:09<24:50:36,  3.55it/s]
 15%|█▍        | 54179/371472 [4:19:10<24:24:49,  3.61it/s]
 15%|█▍        | 54180/371472 [4:19:10<24:16:09,  3.63it/s]
                                                           
{'loss': 4.3784, 'learning_rate': 8.691471481824646e-07, 'epoch': 2.33}

 15%|█▍        | 54180/371472 [4:19:10<24:16:09,  3.63it/s]
 15%|█▍        | 54181/371472 [4:19:10<24:16:13,  3.63it/s]
 15%|█▍        | 54182/371472 [4:19:10<24:22:44,  3.62it/s]
 15%|█▍        | 54183/371472 [4:19:11<24:34:06,  3.59it/s]
 15%|█▍        | 54184/371472 [4:19:11<23:56:06,  3.68it/s]
 15%|█▍        | 54185/371472 [4:19:11<24:40:26,  3.57it/s]
 15%|█▍        | 54186/371472 [4:19:12<24:19:02,  3.62it/s]
 15%|█▍        | 54187/371472 [4:19:12<23:42:07,  3.72it/s]
 15%|█▍        | 54188/371472 [4:19:12<23:12:43,  3.80it/s]
 15%|█▍        | 54189/371472 [4:19:12<22:32:05,  3.91it/s]
 15%|█▍        | 54190/371472 [4:19:13<24:55:29,  3.54it/s]
 15%|█▍        | 54191/371472 [4:19:13<24:13:47,  3.64it/s]
 15%|█▍        | 54192/371472 [4:19:13<25:51:22,  3.41it/s]
 15%|█▍        | 54193/371472 [4:19:13<25:10:47,  3.50it/s]
 15%|█▍        | 54194/371472 [4:19:14<26:33:12,  3.32it/s]
 15%|█▍        | 54195/371472 [4:19:14<25:11:58,  3.50it/s]
 15%|█▍        | 54196/371472 [4:19:14<26:24:24,  3.34it/s]
 15%|█▍        | 54197/371472 [4:19:15<27:37:01,  3.19it/s]
 15%|█▍        | 54198/371472 [4:19:15<28:33:29,  3.09it/s]
 15%|█▍        | 54199/371472 [4:19:15<28:41:02,  3.07it/s]
 15%|█▍        | 54200/371472 [4:19:16<28:41:48,  3.07it/s]
                                                           
{'loss': 4.362, 'learning_rate': 8.690986662069857e-07, 'epoch': 2.33}

 15%|█▍        | 54200/371472 [4:19:16<28:41:48,  3.07it/s]
 15%|█▍        | 54201/371472 [4:19:16<28:04:12,  3.14it/s]
 15%|█▍        | 54202/371472 [4:19:16<28:41:58,  3.07it/s]
 15%|█▍        | 54203/371472 [4:19:17<26:57:43,  3.27it/s]
 15%|█▍        | 54204/371472 [4:19:17<27:10:07,  3.24it/s]
 15%|█▍        | 54205/371472 [4:19:17<26:28:09,  3.33it/s]
 15%|█▍        | 54206/371472 [4:19:18<25:31:45,  3.45it/s]
 15%|█▍        | 54207/371472 [4:19:18<28:25:10,  3.10it/s]
 15%|█▍        | 54208/371472 [4:19:18<26:51:20,  3.28it/s]
 15%|█▍        | 54209/371472 [4:19:18<25:37:44,  3.44it/s]
 15%|█▍        | 54210/371472 [4:19:19<25:17:43,  3.48it/s]
 15%|█▍        | 54211/371472 [4:19:19<26:13:03,  3.36it/s]
 15%|█▍        | 54212/371472 [4:19:19<25:13:11,  3.49it/s]
 15%|█▍        | 54213/371472 [4:19:20<26:48:48,  3.29it/s]
 15%|█▍        | 54214/371472 [4:19:20<27:09:27,  3.25it/s]
 15%|█▍        | 54215/371472 [4:19:20<25:49:48,  3.41it/s]
 15%|█▍        | 54216/371472 [4:19:20<24:43:20,  3.56it/s]
 15%|█▍        | 54217/371472 [4:19:21<24:29:21,  3.60it/s]
 15%|█▍        | 54218/371472 [4:19:21<23:56:40,  3.68it/s]
 15%|█▍        | 54219/371472 [4:19:21<24:12:45,  3.64it/s]
 15%|█▍        | 54220/371472 [4:19:22<25:11:41,  3.50it/s]
                                                           
{'loss': 4.2607, 'learning_rate': 8.690501842315067e-07, 'epoch': 2.34}

 15%|█▍        | 54220/371472 [4:19:22<25:11:41,  3.50it/s]
 15%|█▍        | 54221/371472 [4:19:22<25:11:02,  3.50it/s]
 15%|█▍        | 54222/371472 [4:19:22<25:41:38,  3.43it/s]
 15%|█▍        | 54223/371472 [4:19:23<26:41:34,  3.30it/s]
 15%|█▍        | 54224/371472 [4:19:23<25:09:22,  3.50it/s]
 15%|█▍        | 54225/371472 [4:19:23<27:22:04,  3.22it/s]
 15%|█▍        | 54226/371472 [4:19:23<25:48:02,  3.42it/s]
 15%|█▍        | 54227/371472 [4:19:24<24:51:20,  3.55it/s]
 15%|█▍        | 54228/371472 [4:19:24<24:02:31,  3.67it/s]
 15%|█▍        | 54229/371472 [4:19:24<23:35:59,  3.73it/s]
 15%|█▍        | 54230/371472 [4:19:24<23:42:27,  3.72it/s]
 15%|█▍        | 54231/371472 [4:19:25<23:58:31,  3.68it/s]
 15%|█▍        | 54232/371472 [4:19:25<24:07:44,  3.65it/s]
 15%|█▍        | 54233/371472 [4:19:25<24:26:55,  3.60it/s]
 15%|█▍        | 54234/371472 [4:19:25<23:23:33,  3.77it/s]
 15%|█▍        | 54235/371472 [4:19:26<24:23:41,  3.61it/s]
 15%|█▍        | 54236/371472 [4:19:26<24:06:42,  3.65it/s]
 15%|█▍        | 54237/371472 [4:19:26<25:00:16,  3.52it/s]
 15%|█▍        | 54238/371472 [4:19:27<25:25:07,  3.47it/s]
 15%|█▍        | 54239/371472 [4:19:27<25:14:07,  3.49it/s]
 15%|█▍        | 54240/371472 [4:19:27<24:25:27,  3.61it/s]
                                                           
{'loss': 4.4963, 'learning_rate': 8.690017022560279e-07, 'epoch': 2.34}

 15%|█▍        | 54240/371472 [4:19:27<24:25:27,  3.61it/s]
 15%|█▍        | 54241/371472 [4:19:27<24:56:37,  3.53it/s]
 15%|█▍        | 54242/371472 [4:19:28<24:35:16,  3.58it/s]
 15%|█▍        | 54243/371472 [4:19:28<25:11:20,  3.50it/s]
 15%|█▍        | 54244/371472 [4:19:28<25:53:23,  3.40it/s]
 15%|█▍        | 54245/371472 [4:19:29<25:19:40,  3.48it/s]
 15%|█▍        | 54246/371472 [4:19:29<24:30:02,  3.60it/s]
 15%|█▍        | 54247/371472 [4:19:29<23:50:29,  3.70it/s]
 15%|█▍        | 54248/371472 [4:19:29<23:57:28,  3.68it/s]
 15%|█▍        | 54249/371472 [4:19:30<23:55:02,  3.68it/s]
 15%|█▍        | 54250/371472 [4:19:30<24:02:47,  3.66it/s]
 15%|█▍        | 54251/371472 [4:19:30<24:14:46,  3.63it/s]
 15%|█▍        | 54252/371472 [4:19:31<24:14:05,  3.64it/s]
 15%|█▍        | 54253/371472 [4:19:31<24:02:53,  3.66it/s]
 15%|█▍        | 54254/371472 [4:19:31<23:44:29,  3.71it/s]
 15%|█▍        | 54255/371472 [4:19:31<23:19:34,  3.78it/s]
 15%|█▍        | 54256/371472 [4:19:32<23:21:37,  3.77it/s]
 15%|█▍        | 54257/371472 [4:19:32<22:39:21,  3.89it/s]
 15%|█▍        | 54258/371472 [4:19:32<24:51:22,  3.54it/s]
 15%|█▍        | 54259/371472 [4:19:32<25:48:45,  3.41it/s]
 15%|█▍        | 54260/371472 [4:19:33<24:41:09,  3.57it/s]
                                                           
{'loss': 4.2517, 'learning_rate': 8.68953220280549e-07, 'epoch': 2.34}

 15%|█▍        | 54260/371472 [4:19:33<24:41:09,  3.57it/s]
 15%|█▍        | 54261/371472 [4:19:33<24:37:17,  3.58it/s]
 15%|█▍        | 54262/371472 [4:19:33<25:01:45,  3.52it/s]
 15%|█▍        | 54263/371472 [4:19:34<26:32:21,  3.32it/s]
 15%|█▍        | 54264/371472 [4:19:34<24:53:04,  3.54it/s]
 15%|█▍        | 54265/371472 [4:19:34<25:29:00,  3.46it/s]
 15%|█▍        | 54266/371472 [4:19:34<24:20:11,  3.62it/s]
 15%|█▍        | 54267/371472 [4:19:35<24:52:01,  3.54it/s]
 15%|█▍        | 54268/371472 [4:19:35<24:56:51,  3.53it/s]
 15%|█▍        | 54269/371472 [4:19:35<24:47:07,  3.55it/s]
 15%|█▍        | 54270/371472 [4:19:36<23:50:24,  3.70it/s]
 15%|█▍        | 54271/371472 [4:19:36<23:57:47,  3.68it/s]
 15%|█▍        | 54272/371472 [4:19:36<24:58:42,  3.53it/s]
 15%|█▍        | 54273/371472 [4:19:36<24:31:50,  3.59it/s]
 15%|█▍        | 54274/371472 [4:19:37<23:37:47,  3.73it/s]
 15%|█▍        | 54275/371472 [4:19:37<23:01:13,  3.83it/s]
 15%|█▍        | 54276/371472 [4:19:37<23:49:56,  3.70it/s]
 15%|█▍        | 54277/371472 [4:19:37<23:35:01,  3.74it/s]
 15%|█▍        | 54278/371472 [4:19:38<24:31:53,  3.59it/s]
 15%|█▍        | 54279/371472 [4:19:38<24:41:50,  3.57it/s]
 15%|█▍        | 54280/371472 [4:19:38<24:45:57,  3.56it/s]
                                                           
{'loss': 4.3148, 'learning_rate': 8.689047383050701e-07, 'epoch': 2.34}

 15%|█▍        | 54280/371472 [4:19:38<24:45:57,  3.56it/s]
 15%|█▍        | 54281/371472 [4:19:39<23:58:32,  3.67it/s]
 15%|█▍        | 54282/371472 [4:19:39<23:45:19,  3.71it/s]
 15%|█▍        | 54283/371472 [4:19:39<22:57:23,  3.84it/s]
 15%|█▍        | 54284/371472 [4:19:39<22:50:30,  3.86it/s]
 15%|█▍        | 54285/371472 [4:19:40<23:25:23,  3.76it/s]
 15%|█▍        | 54286/371472 [4:19:40<24:30:45,  3.59it/s]
 15%|█▍        | 54287/371472 [4:19:40<24:52:04,  3.54it/s]
 15%|█▍        | 54288/371472 [4:19:41<25:44:08,  3.42it/s]
 15%|█▍        | 54289/371472 [4:19:41<24:51:17,  3.54it/s]
 15%|█▍        | 54290/371472 [4:19:41<23:53:11,  3.69it/s]
 15%|█▍        | 54291/371472 [4:19:42<33:22:15,  2.64it/s]
 15%|█▍        | 54292/371472 [4:19:42<31:33:03,  2.79it/s]
 15%|█▍        | 54293/371472 [4:19:42<29:09:05,  3.02it/s]
 15%|█▍        | 54294/371472 [4:19:42<27:06:38,  3.25it/s]
 15%|█▍        | 54295/371472 [4:19:43<26:56:13,  3.27it/s]
 15%|█▍        | 54296/371472 [4:19:43<26:12:40,  3.36it/s]
 15%|█▍        | 54297/371472 [4:19:43<25:33:59,  3.45it/s]
 15%|█▍        | 54298/371472 [4:19:44<25:09:49,  3.50it/s]
 15%|█▍        | 54299/371472 [4:19:44<25:13:32,  3.49it/s]
 15%|█▍        | 54300/371472 [4:19:44<24:51:11,  3.54it/s]
                                                           
{'loss': 4.2369, 'learning_rate': 8.688562563295913e-07, 'epoch': 2.34}

 15%|█▍        | 54300/371472 [4:19:44<24:51:11,  3.54it/s]
 15%|█▍        | 54301/371472 [4:19:44<25:08:43,  3.50it/s]
 15%|█▍        | 54302/371472 [4:19:45<24:24:44,  3.61it/s]
 15%|█▍        | 54303/371472 [4:19:45<24:06:19,  3.65it/s]
 15%|█▍        | 54304/371472 [4:19:45<23:43:34,  3.71it/s]
 15%|█▍        | 54305/371472 [4:19:46<23:39:48,  3.72it/s]
 15%|█▍        | 54306/371472 [4:19:46<23:56:16,  3.68it/s]
 15%|█▍        | 54307/371472 [4:19:46<24:19:31,  3.62it/s]
 15%|█▍        | 54308/371472 [4:19:46<24:17:17,  3.63it/s]
 15%|█▍        | 54309/371472 [4:19:47<23:56:11,  3.68it/s]
 15%|█▍        | 54310/371472 [4:19:47<24:04:40,  3.66it/s]
 15%|█▍        | 54311/371472 [4:19:47<24:34:19,  3.59it/s]
 15%|█▍        | 54312/371472 [4:19:47<23:52:46,  3.69it/s]
 15%|█▍        | 54313/371472 [4:19:48<23:16:00,  3.79it/s]
 15%|█▍        | 54314/371472 [4:19:48<23:12:38,  3.80it/s]
 15%|█▍        | 54315/371472 [4:19:48<25:37:58,  3.44it/s]
 15%|█▍        | 54316/371472 [4:19:49<27:05:27,  3.25it/s]
 15%|█▍        | 54317/371472 [4:19:49<26:17:26,  3.35it/s]
 15%|█▍        | 54318/371472 [4:19:49<26:18:35,  3.35it/s]
 15%|█▍        | 54319/371472 [4:19:50<26:12:55,  3.36it/s]
 15%|█▍        | 54320/371472 [4:19:50<25:05:46,  3.51it/s]
                                                           
{'loss': 4.2441, 'learning_rate': 8.688077743541124e-07, 'epoch': 2.34}

 15%|█▍        | 54320/371472 [4:19:50<25:05:46,  3.51it/s]
 15%|█▍        | 54321/371472 [4:19:50<23:53:14,  3.69it/s]
 15%|█▍        | 54322/371472 [4:19:50<24:57:44,  3.53it/s]
 15%|█▍        | 54323/371472 [4:19:51<25:38:28,  3.44it/s]
 15%|█▍        | 54324/371472 [4:19:51<24:11:16,  3.64it/s]
 15%|█▍        | 54325/371472 [4:19:51<23:44:21,  3.71it/s]
 15%|█▍        | 54326/371472 [4:19:51<23:24:25,  3.76it/s]
 15%|█▍        | 54327/371472 [4:19:52<22:46:45,  3.87it/s]
 15%|█▍        | 54328/371472 [4:19:52<23:03:08,  3.82it/s]
 15%|█▍        | 54329/371472 [4:19:52<25:05:47,  3.51it/s]
 15%|█▍        | 54330/371472 [4:19:52<24:23:55,  3.61it/s]
 15%|█▍        | 54331/371472 [4:19:53<25:27:35,  3.46it/s]
 15%|█▍        | 54332/371472 [4:19:53<26:31:13,  3.32it/s]
 15%|█▍        | 54333/371472 [4:19:53<25:56:40,  3.40it/s]
 15%|█▍        | 54334/371472 [4:19:54<24:37:58,  3.58it/s]
 15%|█▍        | 54335/371472 [4:19:54<24:20:05,  3.62it/s]
 15%|█▍        | 54336/371472 [4:19:54<24:22:02,  3.62it/s]
 15%|█▍        | 54337/371472 [4:19:54<24:00:06,  3.67it/s]
 15%|█▍        | 54338/371472 [4:19:55<25:41:26,  3.43it/s]
 15%|█▍        | 54339/371472 [4:19:55<26:52:42,  3.28it/s]
 15%|█▍        | 54340/371472 [4:19:55<25:55:21,  3.40it/s]
                                                           
{'loss': 4.0943, 'learning_rate': 8.687592923786333e-07, 'epoch': 2.34}

 15%|█▍        | 54340/371472 [4:19:55<25:55:21,  3.40it/s]
 15%|█▍        | 54341/371472 [4:19:56<25:04:44,  3.51it/s]
 15%|█▍        | 54342/371472 [4:19:56<25:02:02,  3.52it/s]
 15%|█▍        | 54343/371472 [4:19:56<24:56:20,  3.53it/s]
 15%|█▍        | 54344/371472 [4:19:57<27:52:28,  3.16it/s]
 15%|█▍        | 54345/371472 [4:19:57<26:16:59,  3.35it/s]
 15%|█▍        | 54346/371472 [4:19:57<24:57:08,  3.53it/s]
 15%|█▍        | 54347/371472 [4:19:57<25:03:18,  3.52it/s]
 15%|█▍        | 54348/371472 [4:19:58<24:05:02,  3.66it/s]
 15%|█▍        | 54349/371472 [4:19:58<26:19:24,  3.35it/s]
 15%|█▍        | 54350/371472 [4:19:58<25:45:15,  3.42it/s]
 15%|█▍        | 54351/371472 [4:19:59<25:05:33,  3.51it/s]
 15%|█▍        | 54352/371472 [4:19:59<24:09:14,  3.65it/s]
 15%|█▍        | 54353/371472 [4:19:59<25:50:25,  3.41it/s]
 15%|█▍        | 54354/371472 [4:19:59<25:08:35,  3.50it/s]
 15%|█▍        | 54355/371472 [4:20:00<24:17:29,  3.63it/s]
 15%|█▍        | 54356/371472 [4:20:00<23:31:29,  3.74it/s]
 15%|█▍        | 54357/371472 [4:20:00<26:09:30,  3.37it/s]
 15%|█▍        | 54358/371472 [4:20:01<26:15:48,  3.35it/s]
 15%|█▍        | 54359/371472 [4:20:01<25:15:32,  3.49it/s]
 15%|█▍        | 54360/371472 [4:20:01<24:10:32,  3.64it/s]
                                                           
{'loss': 4.3473, 'learning_rate': 8.687108104031545e-07, 'epoch': 2.34}

 15%|█▍        | 54360/371472 [4:20:01<24:10:32,  3.64it/s]
 15%|█▍        | 54361/371472 [4:20:01<23:51:11,  3.69it/s]
 15%|█▍        | 54362/371472 [4:20:02<23:14:04,  3.79it/s]
 15%|█▍        | 54363/371472 [4:20:02<23:01:32,  3.83it/s]
 15%|█▍        | 54364/371472 [4:20:02<23:08:49,  3.81it/s]
 15%|█▍        | 54365/371472 [4:20:02<24:08:07,  3.65it/s]
 15%|█▍        | 54366/371472 [4:20:03<23:06:08,  3.81it/s]
 15%|█▍        | 54367/371472 [4:20:03<23:20:47,  3.77it/s]
 15%|█▍        | 54368/371472 [4:20:03<23:35:58,  3.73it/s]
 15%|█▍        | 54369/371472 [4:20:03<23:02:35,  3.82it/s]
 15%|█▍        | 54370/371472 [4:20:04<24:49:19,  3.55it/s]
 15%|█▍        | 54371/371472 [4:20:04<23:36:55,  3.73it/s]
 15%|█▍        | 54372/371472 [4:20:04<23:24:58,  3.76it/s]
 15%|█▍        | 54373/371472 [4:20:05<23:03:52,  3.82it/s]
 15%|█▍        | 54374/371472 [4:20:05<23:18:32,  3.78it/s]
 15%|█▍        | 54375/371472 [4:20:05<23:35:09,  3.73it/s]
 15%|█▍        | 54376/371472 [4:20:05<23:26:37,  3.76it/s]
 15%|█▍        | 54377/371472 [4:20:06<24:08:15,  3.65it/s]
 15%|█▍        | 54378/371472 [4:20:06<24:32:04,  3.59it/s]
 15%|█▍        | 54379/371472 [4:20:06<24:40:16,  3.57it/s]
 15%|█▍        | 54380/371472 [4:20:07<25:26:50,  3.46it/s]
                                                           
{'loss': 4.2992, 'learning_rate': 8.686623284276756e-07, 'epoch': 2.34}

 15%|█▍        | 54380/371472 [4:20:07<25:26:50,  3.46it/s]
 15%|█▍        | 54381/371472 [4:20:07<25:51:42,  3.41it/s]
 15%|█▍        | 54382/371472 [4:20:07<25:18:44,  3.48it/s]
 15%|█▍        | 54383/371472 [4:20:07<24:52:22,  3.54it/s]
 15%|█▍        | 54384/371472 [4:20:08<24:14:22,  3.63it/s]
 15%|█▍        | 54385/371472 [4:20:08<24:07:10,  3.65it/s]
 15%|█▍        | 54386/371472 [4:20:08<23:46:00,  3.71it/s]
 15%|█▍        | 54387/371472 [4:20:08<24:15:59,  3.63it/s]
 15%|█▍        | 54388/371472 [4:20:09<24:54:21,  3.54it/s]
 15%|█▍        | 54389/371472 [4:20:09<24:57:47,  3.53it/s]
 15%|█▍        | 54390/371472 [4:20:09<25:29:11,  3.46it/s]
 15%|█▍        | 54391/371472 [4:20:10<24:46:29,  3.56it/s]
 15%|█▍        | 54392/371472 [4:20:10<23:31:30,  3.74it/s]
 15%|█▍        | 54393/371472 [4:20:10<23:21:11,  3.77it/s]
 15%|█▍        | 54394/371472 [4:20:10<24:50:52,  3.54it/s]
 15%|█▍        | 54395/371472 [4:20:11<25:21:58,  3.47it/s]
 15%|█▍        | 54396/371472 [4:20:11<24:43:44,  3.56it/s]
 15%|█▍        | 54397/371472 [4:20:11<23:54:31,  3.68it/s]
 15%|█▍        | 54398/371472 [4:20:12<26:37:23,  3.31it/s]
 15%|█▍        | 54399/371472 [4:20:12<25:28:08,  3.46it/s]
 15%|█▍        | 54400/371472 [4:20:12<26:13:26,  3.36it/s]
                                                           
{'loss': 4.2246, 'learning_rate': 8.686138464521968e-07, 'epoch': 2.34}

 15%|█▍        | 54400/371472 [4:20:12<26:13:26,  3.36it/s]
 15%|█▍        | 54401/371472 [4:20:12<25:10:26,  3.50it/s]
 15%|█▍        | 54402/371472 [4:20:13<23:39:41,  3.72it/s]
 15%|█▍        | 54403/371472 [4:20:13<24:15:06,  3.63it/s]
 15%|█▍        | 54404/371472 [4:20:13<23:50:34,  3.69it/s]
 15%|█▍        | 54405/371472 [4:20:13<23:24:53,  3.76it/s]
 15%|█▍        | 54406/371472 [4:20:14<23:13:35,  3.79it/s]
 15%|█▍        | 54407/371472 [4:20:14<24:09:25,  3.65it/s]
 15%|█▍        | 54408/371472 [4:20:14<23:11:15,  3.80it/s]
 15%|█▍        | 54409/371472 [4:20:15<25:40:54,  3.43it/s]
 15%|█▍        | 54410/371472 [4:20:15<24:25:29,  3.61it/s]
 15%|█▍        | 54411/371472 [4:20:15<24:37:25,  3.58it/s]
 15%|█▍        | 54412/371472 [4:20:15<25:43:22,  3.42it/s]
 15%|█▍        | 54413/371472 [4:20:16<24:24:55,  3.61it/s]
 15%|█▍        | 54414/371472 [4:20:16<24:15:36,  3.63it/s]
 15%|█▍        | 54415/371472 [4:20:16<23:12:37,  3.79it/s]
 15%|█▍        | 54416/371472 [4:20:16<22:41:29,  3.88it/s]
 15%|█▍        | 54417/371472 [4:20:17<25:40:33,  3.43it/s]
 15%|█▍        | 54418/371472 [4:20:17<27:52:10,  3.16it/s]
 15%|█▍        | 54419/371472 [4:20:17<26:24:17,  3.34it/s]
 15%|█▍        | 54420/371472 [4:20:18<25:07:01,  3.51it/s]
                                                           
{'loss': 4.4738, 'learning_rate': 8.685653644767178e-07, 'epoch': 2.34}

 15%|█▍        | 54420/371472 [4:20:18<25:07:01,  3.51it/s]
 15%|█▍        | 54421/371472 [4:20:18<27:48:41,  3.17it/s]
 15%|█▍        | 54422/371472 [4:20:18<29:07:09,  3.02it/s]
 15%|█▍        | 54423/371472 [4:20:19<29:23:39,  3.00it/s]
 15%|█▍        | 54424/371472 [4:20:19<29:21:31,  3.00it/s]
 15%|█▍        | 54425/371472 [4:20:19<28:31:05,  3.09it/s]
 15%|█▍        | 54426/371472 [4:20:20<28:03:40,  3.14it/s]
 15%|█▍        | 54427/371472 [4:20:20<26:14:54,  3.36it/s]
 15%|█▍        | 54428/371472 [4:20:20<25:04:15,  3.51it/s]
 15%|█▍        | 54429/371472 [4:20:21<26:03:41,  3.38it/s]
 15%|█▍        | 54430/371472 [4:20:21<24:45:26,  3.56it/s]
 15%|█▍        | 54431/371472 [4:20:21<24:06:14,  3.65it/s]
 15%|█▍        | 54432/371472 [4:20:21<23:32:01,  3.74it/s]
 15%|█▍        | 54433/371472 [4:20:22<23:21:52,  3.77it/s]
 15%|█▍        | 54434/371472 [4:20:22<23:54:36,  3.68it/s]
 15%|█▍        | 54435/371472 [4:20:22<23:56:50,  3.68it/s]
 15%|█▍        | 54436/371472 [4:20:22<24:35:23,  3.58it/s]
 15%|█▍        | 54437/371472 [4:20:23<24:04:37,  3.66it/s]
 15%|█▍        | 54438/371472 [4:20:23<24:07:35,  3.65it/s]
 15%|█▍        | 54439/371472 [4:20:23<23:28:51,  3.75it/s]
 15%|█▍        | 54440/371472 [4:20:24<23:41:26,  3.72it/s]
                                                           
{'loss': 4.1206, 'learning_rate': 8.68516882501239e-07, 'epoch': 2.34}

 15%|█▍        | 54440/371472 [4:20:24<23:41:26,  3.72it/s]
 15%|█▍        | 54441/371472 [4:20:24<23:10:28,  3.80it/s]
 15%|█▍        | 54442/371472 [4:20:24<24:07:50,  3.65it/s]
 15%|█▍        | 54443/371472 [4:20:24<25:35:10,  3.44it/s]
 15%|█▍        | 54444/371472 [4:20:25<25:17:33,  3.48it/s]
 15%|█▍        | 54445/371472 [4:20:25<24:22:28,  3.61it/s]
 15%|█▍        | 54446/371472 [4:20:25<24:03:36,  3.66it/s]
 15%|█▍        | 54447/371472 [4:20:25<24:16:50,  3.63it/s]
 15%|█▍        | 54448/371472 [4:20:26<25:26:10,  3.46it/s]
 15%|█▍        | 54449/371472 [4:20:26<26:37:58,  3.31it/s]
 15%|█▍        | 54450/371472 [4:20:26<24:58:02,  3.53it/s]
 15%|█▍        | 54451/371472 [4:20:27<24:36:06,  3.58it/s]
 15%|█▍        | 54452/371472 [4:20:27<24:06:09,  3.65it/s]
 15%|█▍        | 54453/371472 [4:20:27<24:17:31,  3.63it/s]
 15%|█▍        | 54454/371472 [4:20:28<25:34:15,  3.44it/s]
 15%|█▍        | 54455/371472 [4:20:28<24:34:54,  3.58it/s]
 15%|█▍        | 54456/371472 [4:20:28<23:37:03,  3.73it/s]
 15%|█▍        | 54457/371472 [4:20:28<24:42:40,  3.56it/s]
 15%|█▍        | 54458/371472 [4:20:29<23:43:26,  3.71it/s]
 15%|█▍        | 54459/371472 [4:20:29<23:07:20,  3.81it/s]
 15%|█▍        | 54460/371472 [4:20:29<24:24:07,  3.61it/s]
                                                           
{'loss': 4.3221, 'learning_rate': 8.684684005257601e-07, 'epoch': 2.35}

 15%|█▍        | 54460/371472 [4:20:29<24:24:07,  3.61it/s]
 15%|█▍        | 54461/371472 [4:20:29<23:36:44,  3.73it/s]
 15%|█▍        | 54462/371472 [4:20:30<24:04:36,  3.66it/s]
 15%|█▍        | 54463/371472 [4:20:30<23:40:13,  3.72it/s]
 15%|█▍        | 54464/371472 [4:20:30<25:18:39,  3.48it/s]
 15%|█▍        | 54465/371472 [4:20:31<28:46:22,  3.06it/s]
 15%|█▍        | 54466/371472 [4:20:31<27:22:50,  3.22it/s]
 15%|█▍        | 54467/371472 [4:20:31<26:01:54,  3.38it/s]
 15%|█▍        | 54468/371472 [4:20:31<24:44:35,  3.56it/s]
 15%|█▍        | 54469/371472 [4:20:32<26:14:43,  3.36it/s]
 15%|█▍        | 54470/371472 [4:20:32<24:41:06,  3.57it/s]
 15%|█▍        | 54471/371472 [4:20:32<24:46:53,  3.55it/s]
 15%|█▍        | 54472/371472 [4:20:33<24:35:05,  3.58it/s]
 15%|█▍        | 54473/371472 [4:20:33<23:37:31,  3.73it/s]
 15%|█▍        | 54474/371472 [4:20:33<23:48:01,  3.70it/s]
 15%|█▍        | 54475/371472 [4:20:33<27:19:46,  3.22it/s]
 15%|█▍        | 54476/371472 [4:20:34<26:27:27,  3.33it/s]
 15%|█▍        | 54477/371472 [4:20:34<25:28:15,  3.46it/s]
 15%|█▍        | 54478/371472 [4:20:34<24:35:55,  3.58it/s]
 15%|█▍        | 54479/371472 [4:20:35<23:43:43,  3.71it/s]
 15%|█▍        | 54480/371472 [4:20:35<24:10:19,  3.64it/s]
                                                           
{'loss': 4.277, 'learning_rate': 8.68419918550281e-07, 'epoch': 2.35}

 15%|█▍        | 54480/371472 [4:20:35<24:10:19,  3.64it/s]
 15%|█▍        | 54481/371472 [4:20:35<24:37:56,  3.57it/s]
 15%|█▍        | 54482/371472 [4:20:35<24:41:37,  3.57it/s]
 15%|█▍        | 54483/371472 [4:20:36<23:30:14,  3.75it/s]
 15%|█▍        | 54484/371472 [4:20:36<24:57:59,  3.53it/s]
 15%|█▍        | 54485/371472 [4:20:36<28:38:11,  3.07it/s]
 15%|█▍        | 54486/371472 [4:20:37<26:58:34,  3.26it/s]
 15%|█▍        | 54487/371472 [4:20:37<27:56:49,  3.15it/s]
 15%|█▍        | 54488/371472 [4:20:37<29:23:24,  3.00it/s]
 15%|█▍        | 54489/371472 [4:20:38<28:12:10,  3.12it/s]
 15%|█▍        | 54490/371472 [4:20:38<26:35:41,  3.31it/s]
 15%|█▍        | 54491/371472 [4:20:38<26:35:33,  3.31it/s]
 15%|█▍        | 54492/371472 [4:20:38<25:51:40,  3.40it/s]
 15%|█▍        | 54493/371472 [4:20:39<25:05:30,  3.51it/s]
 15%|█▍        | 54494/371472 [4:20:39<24:15:25,  3.63it/s]
 15%|█▍        | 54495/371472 [4:20:39<24:02:42,  3.66it/s]
 15%|█▍        | 54496/371472 [4:20:40<24:24:14,  3.61it/s]
 15%|█▍        | 54497/371472 [4:20:40<24:16:54,  3.63it/s]
 15%|█▍        | 54498/371472 [4:20:40<25:10:11,  3.50it/s]
 15%|█▍        | 54499/371472 [4:20:40<25:13:57,  3.49it/s]
 15%|█▍        | 54500/371472 [4:20:41<26:45:56,  3.29it/s]
                                                           
{'loss': 4.3785, 'learning_rate': 8.683714365748022e-07, 'epoch': 2.35}

 15%|█▍        | 54500/371472 [4:20:41<26:45:56,  3.29it/s]
 15%|█▍        | 54501/371472 [4:20:41<26:14:02,  3.36it/s]
 15%|█▍        | 54502/371472 [4:20:41<25:16:46,  3.48it/s]
 15%|█▍        | 54503/371472 [4:20:42<24:53:13,  3.54it/s]
 15%|█▍        | 54504/371472 [4:20:42<25:15:21,  3.49it/s]
 15%|█▍        | 54505/371472 [4:20:42<25:24:00,  3.47it/s]
 15%|█▍        | 54506/371472 [4:20:42<25:29:57,  3.45it/s]
 15%|█▍        | 54507/371472 [4:20:43<25:38:54,  3.43it/s]
 15%|█▍        | 54508/371472 [4:20:43<26:31:33,  3.32it/s]
 15%|█▍        | 54509/371472 [4:20:43<26:14:58,  3.35it/s]
 15%|█▍        | 54510/371472 [4:20:44<25:42:39,  3.42it/s]
 15%|█▍        | 54511/371472 [4:20:44<25:09:19,  3.50it/s]
 15%|█▍        | 54512/371472 [4:20:44<23:55:25,  3.68it/s]
 15%|█▍        | 54513/371472 [4:20:44<25:04:15,  3.51it/s]
 15%|█▍        | 54514/371472 [4:20:45<24:50:45,  3.54it/s]
 15%|█▍        | 54515/371472 [4:20:45<24:40:14,  3.57it/s]
 15%|█▍        | 54516/371472 [4:20:45<23:49:24,  3.70it/s]
 15%|█▍        | 54517/371472 [4:20:46<23:12:38,  3.79it/s]
 15%|█▍        | 54518/371472 [4:20:46<23:16:44,  3.78it/s]
 15%|█▍        | 54519/371472 [4:20:46<23:01:31,  3.82it/s]
 15%|█▍        | 54520/371472 [4:20:46<22:28:19,  3.92it/s]
                                                           
{'loss': 4.381, 'learning_rate': 8.683229545993234e-07, 'epoch': 2.35}

 15%|█▍        | 54520/371472 [4:20:46<22:28:19,  3.92it/s]
 15%|█▍        | 54521/371472 [4:20:47<22:40:21,  3.88it/s]
 15%|█▍        | 54522/371472 [4:20:47<22:25:40,  3.93it/s]
 15%|█▍        | 54523/371472 [4:20:47<22:15:11,  3.96it/s]
 15%|█▍        | 54524/371472 [4:20:47<22:10:14,  3.97it/s]
 15%|█▍        | 54525/371472 [4:20:48<24:57:24,  3.53it/s]
 15%|█▍        | 54526/371472 [4:20:48<25:03:34,  3.51it/s]
 15%|█▍        | 54527/371472 [4:20:48<25:25:14,  3.46it/s]
 15%|█▍        | 54528/371472 [4:20:49<25:21:25,  3.47it/s]
 15%|█▍        | 54529/371472 [4:20:49<24:21:01,  3.62it/s]
 15%|█▍        | 54530/371472 [4:20:49<23:48:00,  3.70it/s]
 15%|█▍        | 54531/371472 [4:20:49<23:36:32,  3.73it/s]
 15%|█▍        | 54532/371472 [4:20:50<24:09:37,  3.64it/s]
 15%|█▍        | 54533/371472 [4:20:50<25:01:44,  3.52it/s]
 15%|█▍        | 54534/371472 [4:20:50<25:08:39,  3.50it/s]
 15%|█▍        | 54535/371472 [4:20:50<25:18:40,  3.48it/s]
 15%|█▍        | 54536/371472 [4:20:51<24:45:25,  3.56it/s]
 15%|█▍        | 54537/371472 [4:20:51<24:08:13,  3.65it/s]
 15%|█▍        | 54538/371472 [4:20:51<23:51:01,  3.69it/s]
 15%|█▍        | 54539/371472 [4:20:52<23:43:53,  3.71it/s]
 15%|█▍        | 54540/371472 [4:20:52<23:53:48,  3.68it/s]
                                                           
{'loss': 4.4255, 'learning_rate': 8.682744726238445e-07, 'epoch': 2.35}

 15%|█▍        | 54540/371472 [4:20:52<23:53:48,  3.68it/s]
 15%|█▍        | 54541/371472 [4:20:52<23:35:39,  3.73it/s]
 15%|█▍        | 54542/371472 [4:20:52<23:28:57,  3.75it/s]
 15%|█▍        | 54543/371472 [4:20:53<23:38:12,  3.72it/s]
 15%|█▍        | 54544/371472 [4:20:53<23:19:43,  3.77it/s]
 15%|█▍        | 54545/371472 [4:20:53<24:11:01,  3.64it/s]
 15%|█▍        | 54546/371472 [4:20:53<24:11:44,  3.64it/s]
 15%|█▍        | 54547/371472 [4:20:54<24:24:30,  3.61it/s]
 15%|█▍        | 54548/371472 [4:20:54<24:46:40,  3.55it/s]
 15%|█▍        | 54549/371472 [4:20:54<23:47:21,  3.70it/s]
 15%|█▍        | 54550/371472 [4:20:55<23:50:56,  3.69it/s]
 15%|█▍        | 54551/371472 [4:20:55<24:00:04,  3.67it/s]
 15%|█▍        | 54552/371472 [4:20:55<24:10:52,  3.64it/s]
 15%|█▍        | 54553/371472 [4:20:55<24:04:06,  3.66it/s]
 15%|█▍        | 54554/371472 [4:20:56<23:53:05,  3.69it/s]
 15%|█▍        | 54555/371472 [4:20:56<24:13:34,  3.63it/s]
 15%|█▍        | 54556/371472 [4:20:56<24:58:18,  3.53it/s]
 15%|█▍        | 54557/371472 [4:20:56<24:22:18,  3.61it/s]
 15%|█▍        | 54558/371472 [4:20:57<23:26:30,  3.76it/s]
 15%|█▍        | 54559/371472 [4:20:57<25:10:14,  3.50it/s]
 15%|█▍        | 54560/371472 [4:20:57<25:16:11,  3.48it/s]
                                                           
{'loss': 4.1823, 'learning_rate': 8.682259906483656e-07, 'epoch': 2.35}

 15%|█▍        | 54560/371472 [4:20:57<25:16:11,  3.48it/s]
 15%|█▍        | 54561/371472 [4:20:58<24:30:59,  3.59it/s]
 15%|█▍        | 54562/371472 [4:20:58<24:18:31,  3.62it/s]
 15%|█▍        | 54563/371472 [4:20:58<27:03:59,  3.25it/s]
 15%|█▍        | 54564/371472 [4:20:59<26:19:25,  3.34it/s]
 15%|█▍        | 54565/371472 [4:20:59<27:34:58,  3.19it/s]
 15%|█▍        | 54566/371472 [4:20:59<25:52:27,  3.40it/s]
 15%|█▍        | 54567/371472 [4:20:59<26:30:28,  3.32it/s]
 15%|█▍        | 54568/371472 [4:21:00<25:21:30,  3.47it/s]
 15%|█▍        | 54569/371472 [4:21:00<24:26:42,  3.60it/s]
 15%|█▍        | 54570/371472 [4:21:00<23:39:11,  3.72it/s]
 15%|█▍        | 54571/371472 [4:21:00<23:00:50,  3.82it/s]
 15%|█▍        | 54572/371472 [4:21:01<24:07:35,  3.65it/s]
 15%|█▍        | 54573/371472 [4:21:01<23:08:49,  3.80it/s]
 15%|█▍        | 54574/371472 [4:21:01<23:20:39,  3.77it/s]
 15%|█▍        | 54575/371472 [4:21:01<23:02:00,  3.82it/s]
 15%|█▍        | 54576/371472 [4:21:02<23:33:13,  3.74it/s]
 15%|█▍        | 54577/371472 [4:21:02<26:15:31,  3.35it/s]
 15%|█▍        | 54578/371472 [4:21:02<26:06:17,  3.37it/s]
 15%|█▍        | 54579/371472 [4:21:03<25:47:22,  3.41it/s]
 15%|█▍        | 54580/371472 [4:21:03<25:17:28,  3.48it/s]
                                                           
{'loss': 4.3709, 'learning_rate': 8.681775086728867e-07, 'epoch': 2.35}

 15%|█▍        | 54580/371472 [4:21:03<25:17:28,  3.48it/s]
 15%|█▍        | 54581/371472 [4:21:03<25:18:23,  3.48it/s]
 15%|█▍        | 54582/371472 [4:21:04<27:10:20,  3.24it/s]
 15%|█▍        | 54583/371472 [4:21:04<27:51:21,  3.16it/s]
 15%|█▍        | 54584/371472 [4:21:04<26:32:37,  3.32it/s]
 15%|█▍        | 54585/371472 [4:21:04<25:16:22,  3.48it/s]
 15%|█▍        | 54586/371472 [4:21:05<24:19:14,  3.62it/s]
 15%|█▍        | 54587/371472 [4:21:05<25:39:44,  3.43it/s]
 15%|█▍        | 54588/371472 [4:21:05<24:51:23,  3.54it/s]
 15%|█▍        | 54589/371472 [4:21:06<24:36:07,  3.58it/s]
 15%|█▍        | 54590/371472 [4:21:06<24:36:14,  3.58it/s]
 15%|█▍        | 54591/371472 [4:21:06<24:48:18,  3.55it/s]
 15%|█▍        | 54592/371472 [4:21:06<24:23:06,  3.61it/s]
 15%|█▍        | 54593/371472 [4:21:07<23:53:04,  3.69it/s]
 15%|█▍        | 54594/371472 [4:21:07<23:01:52,  3.82it/s]
 15%|█▍        | 54595/371472 [4:21:07<23:33:20,  3.74it/s]
 15%|█▍        | 54596/371472 [4:21:07<23:10:49,  3.80it/s]
 15%|█▍        | 54597/371472 [4:21:08<23:29:00,  3.75it/s]
 15%|█▍        | 54598/371472 [4:21:08<23:11:51,  3.79it/s]
 15%|█▍        | 54599/371472 [4:21:08<23:40:56,  3.72it/s]
 15%|█▍        | 54600/371472 [4:21:09<24:24:33,  3.61it/s]
                                                           
{'loss': 4.1439, 'learning_rate': 8.681290266974078e-07, 'epoch': 2.35}

 15%|█▍        | 54600/371472 [4:21:09<24:24:33,  3.61it/s]
 15%|█▍        | 54601/371472 [4:21:09<23:34:18,  3.73it/s]
 15%|█▍        | 54602/371472 [4:21:09<23:56:10,  3.68it/s]
 15%|█▍        | 54603/371472 [4:21:09<23:44:01,  3.71it/s]
 15%|█▍        | 54604/371472 [4:21:10<26:02:49,  3.38it/s]
 15%|█▍        | 54605/371472 [4:21:10<24:48:04,  3.55it/s]
 15%|█▍        | 54606/371472 [4:21:10<25:10:26,  3.50it/s]
 15%|█▍        | 54607/371472 [4:21:11<24:23:10,  3.61it/s]
 15%|█▍        | 54608/371472 [4:21:11<24:35:08,  3.58it/s]
 15%|█▍        | 54609/371472 [4:21:11<23:56:33,  3.68it/s]
 15%|█▍        | 54610/371472 [4:21:11<23:03:59,  3.82it/s]
 15%|█▍        | 54611/371472 [4:21:12<22:56:18,  3.84it/s]
 15%|█▍        | 54612/371472 [4:21:12<23:02:28,  3.82it/s]
 15%|█▍        | 54613/371472 [4:21:12<25:09:26,  3.50it/s]
 15%|█▍        | 54614/371472 [4:21:12<24:42:00,  3.56it/s]
 15%|█▍        | 54615/371472 [4:21:13<25:15:59,  3.48it/s]
 15%|█▍        | 54616/371472 [4:21:13<23:52:11,  3.69it/s]
 15%|█▍        | 54617/371472 [4:21:13<25:48:44,  3.41it/s]
 15%|█▍        | 54618/371472 [4:21:14<25:55:21,  3.40it/s]
 15%|█▍        | 54619/371472 [4:21:14<25:44:24,  3.42it/s]
 15%|█▍        | 54620/371472 [4:21:14<24:34:55,  3.58it/s]
                                                           
{'loss': 4.4158, 'learning_rate': 8.680805447219289e-07, 'epoch': 2.35}

 15%|█▍        | 54620/371472 [4:21:14<24:34:55,  3.58it/s]
 15%|█▍        | 54621/371472 [4:21:14<25:31:26,  3.45it/s]
 15%|█▍        | 54622/371472 [4:21:15<25:22:08,  3.47it/s]
 15%|█▍        | 54623/371472 [4:21:15<25:56:04,  3.39it/s]
 15%|█▍        | 54624/371472 [4:21:15<26:11:59,  3.36it/s]
 15%|█▍        | 54625/371472 [4:21:16<25:24:28,  3.46it/s]
 15%|█▍        | 54626/371472 [4:21:16<24:51:42,  3.54it/s]
 15%|█▍        | 54627/371472 [4:21:16<24:07:36,  3.65it/s]
 15%|█▍        | 54628/371472 [4:21:16<23:35:37,  3.73it/s]
 15%|█▍        | 54629/371472 [4:21:17<25:10:24,  3.50it/s]
 15%|█▍        | 54630/371472 [4:21:17<24:30:03,  3.59it/s]
 15%|█▍        | 54631/371472 [4:21:17<23:57:19,  3.67it/s]
 15%|█▍        | 54632/371472 [4:21:18<23:55:33,  3.68it/s]
 15%|█▍        | 54633/371472 [4:21:18<23:06:28,  3.81it/s]
 15%|█▍        | 54634/371472 [4:21:18<23:30:36,  3.74it/s]
 15%|█▍        | 54635/371472 [4:21:18<26:21:59,  3.34it/s]
 15%|█▍        | 54636/371472 [4:21:19<26:23:30,  3.33it/s]
 15%|█▍        | 54637/371472 [4:21:19<25:30:55,  3.45it/s]
 15%|█▍        | 54638/371472 [4:21:19<26:20:24,  3.34it/s]
 15%|█▍        | 54639/371472 [4:21:20<25:27:41,  3.46it/s]
 15%|█▍        | 54640/371472 [4:21:20<24:41:14,  3.56it/s]
                                                           
{'loss': 4.2438, 'learning_rate': 8.680320627464499e-07, 'epoch': 2.35}

 15%|█▍        | 54640/371472 [4:21:20<24:41:14,  3.56it/s]
 15%|█▍        | 54641/371472 [4:21:20<24:42:11,  3.56it/s]
 15%|█▍        | 54642/371472 [4:21:20<24:18:59,  3.62it/s]
 15%|█▍        | 54643/371472 [4:21:21<23:51:00,  3.69it/s]
 15%|█▍        | 54644/371472 [4:21:21<23:41:45,  3.71it/s]
 15%|█▍        | 54645/371472 [4:21:21<23:01:07,  3.82it/s]
 15%|█▍        | 54646/371472 [4:21:21<23:16:03,  3.78it/s]
 15%|█▍        | 54647/371472 [4:21:22<26:02:12,  3.38it/s]
 15%|█▍        | 54648/371472 [4:21:22<25:15:16,  3.48it/s]
 15%|█▍        | 54649/371472 [4:21:22<24:19:52,  3.62it/s]
 15%|█▍        | 54650/371472 [4:21:23<24:16:29,  3.63it/s]
 15%|█▍        | 54651/371472 [4:21:23<24:08:09,  3.65it/s]
 15%|█▍        | 54652/371472 [4:21:23<24:22:32,  3.61it/s]
 15%|█▍        | 54653/371472 [4:21:23<24:37:22,  3.57it/s]
 15%|█▍        | 54654/371472 [4:21:24<24:21:30,  3.61it/s]
 15%|█▍        | 54655/371472 [4:21:24<25:37:36,  3.43it/s]
 15%|█▍        | 54656/371472 [4:21:24<28:13:00,  3.12it/s]
 15%|█▍        | 54657/371472 [4:21:25<26:14:41,  3.35it/s]
 15%|█▍        | 54658/371472 [4:21:25<26:21:08,  3.34it/s]
 15%|█▍        | 54659/371472 [4:21:25<27:12:54,  3.23it/s]
 15%|█▍        | 54660/371472 [4:21:26<26:54:57,  3.27it/s]
                                                           
{'loss': 4.1635, 'learning_rate': 8.679835807709711e-07, 'epoch': 2.35}

 15%|█▍        | 54660/371472 [4:21:26<26:54:57,  3.27it/s]
 15%|█▍        | 54661/371472 [4:21:26<26:50:43,  3.28it/s]
 15%|█▍        | 54662/371472 [4:21:26<27:22:48,  3.21it/s]
 15%|█▍        | 54663/371472 [4:21:26<26:18:51,  3.34it/s]
 15%|█▍        | 54664/371472 [4:21:27<26:03:22,  3.38it/s]
 15%|█▍        | 54665/371472 [4:21:27<25:38:55,  3.43it/s]
 15%|█▍        | 54666/371472 [4:21:27<25:10:32,  3.50it/s]
 15%|█▍        | 54667/371472 [4:21:28<24:44:15,  3.56it/s]
 15%|█▍        | 54668/371472 [4:21:28<25:25:07,  3.46it/s]
 15%|█▍        | 54669/371472 [4:21:28<26:02:57,  3.38it/s]
 15%|█▍        | 54670/371472 [4:21:29<26:01:46,  3.38it/s]
 15%|█▍        | 54671/371472 [4:21:29<26:13:05,  3.36it/s]
 15%|█▍        | 54672/371472 [4:21:29<27:42:20,  3.18it/s]
 15%|█▍        | 54673/371472 [4:21:29<26:38:07,  3.30it/s]
 15%|█▍        | 54674/371472 [4:21:30<25:42:57,  3.42it/s]
 15%|█▍        | 54675/371472 [4:21:30<24:48:23,  3.55it/s]
 15%|█▍        | 54676/371472 [4:21:30<24:09:12,  3.64it/s]
 15%|█▍        | 54677/371472 [4:21:31<26:05:35,  3.37it/s]
 15%|█▍        | 54678/371472 [4:21:31<25:58:41,  3.39it/s]
 15%|█▍        | 54679/371472 [4:21:31<25:13:53,  3.49it/s]
 15%|█▍        | 54680/371472 [4:21:31<26:26:33,  3.33it/s]
                                                           
{'loss': 4.1807, 'learning_rate': 8.679350987954923e-07, 'epoch': 2.36}

 15%|█▍        | 54680/371472 [4:21:31<26:26:33,  3.33it/s]
 15%|█▍        | 54681/371472 [4:21:32<25:03:29,  3.51it/s]
 15%|█▍        | 54682/371472 [4:21:32<23:47:59,  3.70it/s]
 15%|█▍        | 54683/371472 [4:21:32<24:11:12,  3.64it/s]
 15%|█▍        | 54684/371472 [4:21:32<23:46:39,  3.70it/s]
 15%|█▍        | 54685/371472 [4:21:33<23:33:17,  3.74it/s]
 15%|█▍        | 54686/371472 [4:21:33<22:57:17,  3.83it/s]
 15%|█▍        | 54687/371472 [4:21:33<23:51:03,  3.69it/s]
 15%|█▍        | 54688/371472 [4:21:34<26:36:24,  3.31it/s]
 15%|█▍        | 54689/371472 [4:21:34<25:50:27,  3.41it/s]
 15%|█▍        | 54690/371472 [4:21:34<26:17:16,  3.35it/s]
 15%|█▍        | 54691/371472 [4:21:35<27:49:41,  3.16it/s]
 15%|█▍        | 54692/371472 [4:21:35<26:01:40,  3.38it/s]
 15%|█▍        | 54693/371472 [4:21:35<25:22:30,  3.47it/s]
 15%|█▍        | 54694/371472 [4:21:35<26:34:14,  3.31it/s]
 15%|█▍        | 54695/371472 [4:21:36<26:47:26,  3.28it/s]
 15%|█▍        | 54696/371472 [4:21:36<27:59:12,  3.14it/s]
 15%|█▍        | 54697/371472 [4:21:36<26:59:14,  3.26it/s]
 15%|█▍        | 54698/371472 [4:21:37<26:14:57,  3.35it/s]
 15%|█▍        | 54699/371472 [4:21:37<25:21:51,  3.47it/s]
 15%|█▍        | 54700/371472 [4:21:37<25:39:11,  3.43it/s]
                                                           
{'loss': 4.311, 'learning_rate': 8.678866168200134e-07, 'epoch': 2.36}

 15%|█▍        | 54700/371472 [4:21:37<25:39:11,  3.43it/s]
 15%|█▍        | 54701/371472 [4:21:38<26:04:08,  3.38it/s]
 15%|█▍        | 54702/371472 [4:21:38<25:47:03,  3.41it/s]
 15%|█▍        | 54703/371472 [4:21:38<27:31:56,  3.20it/s]
 15%|█▍        | 54704/371472 [4:21:38<26:13:43,  3.35it/s]
 15%|█▍        | 54705/371472 [4:21:39<25:35:00,  3.44it/s]
 15%|█▍        | 54706/371472 [4:21:39<26:08:51,  3.37it/s]
 15%|█▍        | 54707/371472 [4:21:39<25:48:13,  3.41it/s]
 15%|█▍        | 54708/371472 [4:21:40<26:01:23,  3.38it/s]
 15%|█▍        | 54709/371472 [4:21:40<24:53:17,  3.54it/s]
 15%|█▍        | 54710/371472 [4:21:40<24:19:23,  3.62it/s]
 15%|█▍        | 54711/371472 [4:21:40<23:48:14,  3.70it/s]
 15%|█▍        | 54712/371472 [4:21:41<23:25:32,  3.76it/s]
 15%|█▍        | 54713/371472 [4:21:41<22:56:18,  3.84it/s]
 15%|█▍        | 54714/371472 [4:21:41<24:03:50,  3.66it/s]
 15%|█▍        | 54715/371472 [4:21:42<24:53:39,  3.53it/s]
 15%|█▍        | 54716/371472 [4:21:42<23:50:22,  3.69it/s]
 15%|█▍        | 54717/371472 [4:21:42<22:43:36,  3.87it/s]
 15%|█▍        | 54718/371472 [4:21:42<23:15:00,  3.78it/s]
 15%|█▍        | 54719/371472 [4:21:43<23:56:49,  3.67it/s]
 15%|█▍        | 54720/371472 [4:21:43<24:33:19,  3.58it/s]
                                                           
{'loss': 4.1099, 'learning_rate': 8.678381348445343e-07, 'epoch': 2.36}

 15%|█▍        | 54720/371472 [4:21:43<24:33:19,  3.58it/s]
 15%|█▍        | 54721/371472 [4:21:43<24:42:42,  3.56it/s]
 15%|█▍        | 54722/371472 [4:21:43<24:34:58,  3.58it/s]
 15%|█▍        | 54723/371472 [4:21:44<23:53:18,  3.68it/s]
 15%|█▍        | 54724/371472 [4:21:44<27:11:07,  3.24it/s]
 15%|█▍        | 54725/371472 [4:21:44<26:16:58,  3.35it/s]
 15%|█▍        | 54726/371472 [4:21:45<26:55:14,  3.27it/s]
 15%|█▍        | 54727/371472 [4:21:45<26:09:05,  3.36it/s]
 15%|█▍        | 54728/371472 [4:21:45<25:12:00,  3.49it/s]
 15%|█▍        | 54729/371472 [4:21:45<23:45:12,  3.70it/s]
 15%|█▍        | 54730/371472 [4:21:46<23:21:38,  3.77it/s]
 15%|█▍        | 54731/371472 [4:21:46<25:31:02,  3.45it/s]
 15%|█▍        | 54732/371472 [4:21:46<25:51:52,  3.40it/s]
 15%|█▍        | 54733/371472 [4:21:47<25:54:27,  3.40it/s]
 15%|█▍        | 54734/371472 [4:21:47<25:03:01,  3.51it/s]
 15%|█▍        | 54735/371472 [4:21:47<24:04:55,  3.65it/s]
 15%|█▍        | 54736/371472 [4:21:47<24:09:48,  3.64it/s]
 15%|█▍        | 54737/371472 [4:21:48<24:34:29,  3.58it/s]
 15%|█▍        | 54738/371472 [4:21:48<24:54:00,  3.53it/s]
 15%|█▍        | 54739/371472 [4:21:48<25:44:18,  3.42it/s]
 15%|█▍        | 54740/371472 [4:21:49<25:37:59,  3.43it/s]
                                                           
{'loss': 4.1695, 'learning_rate': 8.677896528690555e-07, 'epoch': 2.36}

 15%|█▍        | 54740/371472 [4:21:49<25:37:59,  3.43it/s]
 15%|█▍        | 54741/371472 [4:21:49<24:45:23,  3.55it/s]
 15%|█▍        | 54742/371472 [4:21:49<25:33:43,  3.44it/s]
 15%|█▍        | 54743/371472 [4:21:50<28:46:18,  3.06it/s]
 15%|█▍        | 54744/371472 [4:21:50<27:41:11,  3.18it/s]
 15%|█▍        | 54745/371472 [4:21:50<26:25:32,  3.33it/s]
 15%|█▍        | 54746/371472 [4:21:50<25:38:11,  3.43it/s]
 15%|█▍        | 54747/371472 [4:21:51<24:41:06,  3.56it/s]
 15%|█▍        | 54748/371472 [4:21:51<25:03:09,  3.51it/s]
 15%|█▍        | 54749/371472 [4:21:51<24:06:21,  3.65it/s]
 15%|█▍        | 54750/371472 [4:21:52<24:32:31,  3.58it/s]
 15%|█▍        | 54751/371472 [4:21:52<25:02:27,  3.51it/s]
 15%|█▍        | 54752/371472 [4:21:52<24:55:32,  3.53it/s]
 15%|█▍        | 54753/371472 [4:21:52<24:13:56,  3.63it/s]
 15%|█▍        | 54754/371472 [4:21:53<23:35:07,  3.73it/s]
 15%|█▍        | 54755/371472 [4:21:53<23:34:01,  3.73it/s]
 15%|█▍        | 54756/371472 [4:21:53<23:29:46,  3.74it/s]
 15%|█▍        | 54757/371472 [4:21:53<24:29:26,  3.59it/s]
 15%|█▍        | 54758/371472 [4:21:54<24:05:11,  3.65it/s]
 15%|█▍        | 54759/371472 [4:21:54<25:16:11,  3.48it/s]
 15%|█▍        | 54760/371472 [4:21:54<23:58:05,  3.67it/s]
                                                           
{'loss': 4.2379, 'learning_rate': 8.677411708935766e-07, 'epoch': 2.36}

 15%|█▍        | 54760/371472 [4:21:54<23:58:05,  3.67it/s]
 15%|█▍        | 54761/371472 [4:21:55<23:36:04,  3.73it/s]
 15%|█▍        | 54762/371472 [4:21:55<23:22:22,  3.76it/s]
 15%|█▍        | 54763/371472 [4:21:55<22:45:20,  3.87it/s]
 15%|█▍        | 54764/371472 [4:21:55<24:01:27,  3.66it/s]
 15%|█▍        | 54765/371472 [4:21:56<23:20:56,  3.77it/s]
 15%|█▍        | 54766/371472 [4:21:56<24:22:28,  3.61it/s]
 15%|█▍        | 54767/371472 [4:21:56<24:57:21,  3.53it/s]
 15%|█▍        | 54768/371472 [4:21:56<26:00:00,  3.38it/s]
 15%|█▍        | 54769/371472 [4:21:57<25:27:36,  3.46it/s]
 15%|█▍        | 54770/371472 [4:21:57<24:07:11,  3.65it/s]
 15%|█▍        | 54771/371472 [4:21:57<23:39:58,  3.72it/s]
 15%|█▍        | 54772/371472 [4:21:58<24:06:09,  3.65it/s]
 15%|█▍        | 54773/371472 [4:21:58<23:30:19,  3.74it/s]
 15%|█▍        | 54774/371472 [4:21:58<23:57:06,  3.67it/s]
 15%|█▍        | 54775/371472 [4:21:58<24:43:16,  3.56it/s]
 15%|█▍        | 54776/371472 [4:21:59<24:17:20,  3.62it/s]
 15%|█▍        | 54777/371472 [4:21:59<23:24:33,  3.76it/s]
 15%|█▍        | 54778/371472 [4:21:59<25:01:44,  3.51it/s]
 15%|█▍        | 54779/371472 [4:22:00<25:30:55,  3.45it/s]
 15%|█▍        | 54780/371472 [4:22:00<24:22:00,  3.61it/s]
                                                           
{'loss': 4.2587, 'learning_rate': 8.676926889180978e-07, 'epoch': 2.36}

 15%|█▍        | 54780/371472 [4:22:00<24:22:00,  3.61it/s]
 15%|█▍        | 54781/371472 [4:22:00<25:23:21,  3.46it/s]
 15%|█▍        | 54782/371472 [4:22:00<24:01:49,  3.66it/s]
 15%|█▍        | 54783/371472 [4:22:01<24:26:25,  3.60it/s]
 15%|█▍        | 54784/371472 [4:22:01<23:28:31,  3.75it/s]
 15%|█▍        | 54785/371472 [4:22:01<25:23:13,  3.47it/s]
 15%|█▍        | 54786/371472 [4:22:01<24:39:30,  3.57it/s]
 15%|█▍        | 54787/371472 [4:22:02<24:08:31,  3.64it/s]
 15%|█▍        | 54788/371472 [4:22:02<23:02:20,  3.82it/s]
 15%|█▍        | 54789/371472 [4:22:02<24:07:58,  3.65it/s]
 15%|█▍        | 54790/371472 [4:22:02<23:39:17,  3.72it/s]
 15%|█▍        | 54791/371472 [4:22:03<23:12:22,  3.79it/s]
 15%|█▍        | 54792/371472 [4:22:03<24:01:12,  3.66it/s]
 15%|█▍        | 54793/371472 [4:22:03<24:05:45,  3.65it/s]
 15%|█▍        | 54794/371472 [4:22:04<26:11:18,  3.36it/s]
 15%|█▍        | 54795/371472 [4:22:04<25:32:43,  3.44it/s]
 15%|█▍        | 54796/371472 [4:22:04<26:02:23,  3.38it/s]
 15%|█▍        | 54797/371472 [4:22:05<25:59:54,  3.38it/s]
 15%|█▍        | 54798/371472 [4:22:05<25:12:41,  3.49it/s]
 15%|█▍        | 54799/371472 [4:22:05<27:00:31,  3.26it/s]
 15%|█▍        | 54800/371472 [4:22:05<25:20:31,  3.47it/s]
                                                           
{'loss': 4.1083, 'learning_rate': 8.676442069426188e-07, 'epoch': 2.36}

 15%|█▍        | 54800/371472 [4:22:05<25:20:31,  3.47it/s]
 15%|█▍        | 54801/371472 [4:22:06<24:39:02,  3.57it/s]
 15%|█▍        | 54802/371472 [4:22:06<24:03:56,  3.66it/s]
 15%|█▍        | 54803/371472 [4:22:06<24:45:03,  3.55it/s]
 15%|█▍        | 54804/371472 [4:22:07<25:56:28,  3.39it/s]
 15%|█▍        | 54805/371472 [4:22:07<25:50:28,  3.40it/s]
 15%|█▍        | 54806/371472 [4:22:07<26:23:34,  3.33it/s]
 15%|█▍        | 54807/371472 [4:22:07<25:08:00,  3.50it/s]
 15%|█▍        | 54808/371472 [4:22:08<24:37:48,  3.57it/s]
 15%|█▍        | 54809/371472 [4:22:08<24:56:39,  3.53it/s]
 15%|█▍        | 54810/371472 [4:22:08<24:40:22,  3.57it/s]
 15%|█▍        | 54811/371472 [4:22:09<25:30:04,  3.45it/s]
 15%|█▍        | 54812/371472 [4:22:09<26:22:15,  3.34it/s]
 15%|█▍        | 54813/371472 [4:22:09<25:01:40,  3.51it/s]
 15%|█▍        | 54814/371472 [4:22:09<25:59:53,  3.38it/s]
 15%|█▍        | 54815/371472 [4:22:10<25:04:37,  3.51it/s]
 15%|█▍        | 54816/371472 [4:22:10<25:03:32,  3.51it/s]
 15%|█▍        | 54817/371472 [4:22:10<26:14:52,  3.35it/s]
 15%|█▍        | 54818/371472 [4:22:11<25:38:07,  3.43it/s]
 15%|█▍        | 54819/371472 [4:22:11<24:40:13,  3.57it/s]
 15%|█▍        | 54820/371472 [4:22:11<24:09:35,  3.64it/s]
                                                           
{'loss': 4.0596, 'learning_rate': 8.675957249671401e-07, 'epoch': 2.36}

 15%|█▍        | 54820/371472 [4:22:11<24:09:35,  3.64it/s]
 15%|█▍        | 54821/371472 [4:22:11<23:40:21,  3.72it/s]
 15%|█▍        | 54822/371472 [4:22:12<23:23:25,  3.76it/s]
 15%|█▍        | 54823/371472 [4:22:12<23:29:38,  3.74it/s]
 15%|█▍        | 54824/371472 [4:22:12<22:56:37,  3.83it/s]
 15%|█▍        | 54825/371472 [4:22:13<25:21:10,  3.47it/s]
 15%|█▍        | 54826/371472 [4:22:13<24:16:46,  3.62it/s]
 15%|█▍        | 54827/371472 [4:22:13<23:10:41,  3.79it/s]
 15%|█▍        | 54828/371472 [4:22:13<23:44:19,  3.71it/s]
 15%|█▍        | 54829/371472 [4:22:14<23:51:36,  3.69it/s]
 15%|█▍        | 54830/371472 [4:22:14<24:16:24,  3.62it/s]
 15%|█▍        | 54831/371472 [4:22:14<23:58:52,  3.67it/s]
 15%|█▍        | 54832/371472 [4:22:14<24:17:17,  3.62it/s]
 15%|█▍        | 54833/371472 [4:22:15<24:41:12,  3.56it/s]
 15%|█▍        | 54834/371472 [4:22:15<24:27:00,  3.60it/s]
 15%|█▍        | 54835/371472 [4:22:15<25:42:29,  3.42it/s]
 15%|█▍        | 54836/371472 [4:22:16<26:29:45,  3.32it/s]
 15%|█▍        | 54837/371472 [4:22:16<28:05:25,  3.13it/s]
 15%|█▍        | 54838/371472 [4:22:16<27:30:50,  3.20it/s]
 15%|█▍        | 54839/371472 [4:22:17<26:04:47,  3.37it/s]
 15%|█▍        | 54840/371472 [4:22:17<25:19:53,  3.47it/s]
                                                           
{'loss': 3.8836, 'learning_rate': 8.675472429916611e-07, 'epoch': 2.36}

 15%|█▍        | 54840/371472 [4:22:17<25:19:53,  3.47it/s]
 15%|█▍        | 54841/371472 [4:22:17<25:39:22,  3.43it/s]
 15%|█▍        | 54842/371472 [4:22:17<25:50:57,  3.40it/s]
 15%|█▍        | 54843/371472 [4:22:18<25:10:40,  3.49it/s]
 15%|█▍        | 54844/371472 [4:22:18<26:02:16,  3.38it/s]
 15%|█▍        | 54845/371472 [4:22:18<26:02:44,  3.38it/s]
 15%|█▍        | 54846/371472 [4:22:19<25:43:22,  3.42it/s]
 15%|█▍        | 54847/371472 [4:22:19<24:24:17,  3.60it/s]
 15%|█▍        | 54848/371472 [4:22:19<25:14:39,  3.48it/s]
 15%|█▍        | 54849/371472 [4:22:19<26:36:39,  3.31it/s]
 15%|█▍        | 54850/371472 [4:22:20<26:31:45,  3.32it/s]
 15%|█▍        | 54851/371472 [4:22:20<27:29:42,  3.20it/s]
 15%|█▍        | 54852/371472 [4:22:20<26:28:39,  3.32it/s]
 15%|█▍        | 54853/371472 [4:22:21<25:44:51,  3.42it/s]
 15%|█▍        | 54854/371472 [4:22:21<27:40:55,  3.18it/s]
 15%|█▍        | 54855/371472 [4:22:21<26:14:27,  3.35it/s]
 15%|█▍        | 54856/371472 [4:22:22<25:19:58,  3.47it/s]
 15%|█▍        | 54857/371472 [4:22:22<24:26:56,  3.60it/s]
 15%|█▍        | 54858/371472 [4:22:22<24:04:19,  3.65it/s]
 15%|█▍        | 54859/371472 [4:22:22<24:06:39,  3.65it/s]
 15%|█▍        | 54860/371472 [4:22:23<23:29:57,  3.74it/s]
                                                           
{'loss': 4.306, 'learning_rate': 8.674987610161822e-07, 'epoch': 2.36}

 15%|█▍        | 54860/371472 [4:22:23<23:29:57,  3.74it/s]
 15%|█▍        | 54861/371472 [4:22:23<23:53:47,  3.68it/s]
 15%|█▍        | 54862/371472 [4:22:23<24:07:18,  3.65it/s]
 15%|█▍        | 54863/371472 [4:22:23<24:15:57,  3.62it/s]
 15%|█▍        | 54864/371472 [4:22:24<23:13:00,  3.79it/s]
 15%|█▍        | 54865/371472 [4:22:24<24:08:35,  3.64it/s]
 15%|█▍        | 54866/371472 [4:22:24<23:24:57,  3.76it/s]
 15%|█▍        | 54867/371472 [4:22:24<23:32:14,  3.74it/s]
 15%|█▍        | 54868/371472 [4:22:25<24:27:15,  3.60it/s]
 15%|█▍        | 54869/371472 [4:22:25<24:44:18,  3.56it/s]
 15%|█▍        | 54870/371472 [4:22:25<25:34:34,  3.44it/s]
 15%|█▍        | 54871/371472 [4:22:26<24:56:02,  3.53it/s]
 15%|█▍        | 54872/371472 [4:22:26<25:01:38,  3.51it/s]
 15%|█▍        | 54873/371472 [4:22:26<25:07:49,  3.50it/s]
 15%|█▍        | 54874/371472 [4:22:27<25:59:23,  3.38it/s]
 15%|█▍        | 54875/371472 [4:22:27<24:34:56,  3.58it/s]
 15%|█▍        | 54876/371472 [4:22:27<24:20:13,  3.61it/s]
 15%|█▍        | 54877/371472 [4:22:27<26:30:20,  3.32it/s]
 15%|█▍        | 54878/371472 [4:22:28<25:20:33,  3.47it/s]
 15%|█▍        | 54879/371472 [4:22:28<27:03:21,  3.25it/s]
 15%|█▍        | 54880/371472 [4:22:28<26:46:10,  3.29it/s]
                                                           
{'loss': 4.215, 'learning_rate': 8.674502790407032e-07, 'epoch': 2.36}

 15%|█▍        | 54880/371472 [4:22:28<26:46:10,  3.29it/s]
 15%|█▍        | 54881/371472 [4:22:29<26:08:38,  3.36it/s]
 15%|█▍        | 54882/371472 [4:22:29<28:09:53,  3.12it/s]
 15%|█▍        | 54883/371472 [4:22:29<27:08:27,  3.24it/s]
 15%|█▍        | 54884/371472 [4:22:29<25:45:47,  3.41it/s]
 15%|█▍        | 54885/371472 [4:22:30<26:02:40,  3.38it/s]
 15%|█▍        | 54886/371472 [4:22:30<24:54:36,  3.53it/s]
 15%|█▍        | 54887/371472 [4:22:30<24:47:09,  3.55it/s]
 15%|█▍        | 54888/371472 [4:22:31<24:20:53,  3.61it/s]
 15%|█▍        | 54889/371472 [4:22:31<25:56:06,  3.39it/s]
 15%|█▍        | 54890/371472 [4:22:31<25:06:20,  3.50it/s]
 15%|█▍        | 54891/371472 [4:22:31<25:00:24,  3.52it/s]
 15%|█▍        | 54892/371472 [4:22:32<24:10:19,  3.64it/s]
 15%|█▍        | 54893/371472 [4:22:32<23:45:43,  3.70it/s]
 15%|█▍        | 54894/371472 [4:22:32<23:39:33,  3.72it/s]
 15%|█▍        | 54895/371472 [4:22:33<26:49:36,  3.28it/s]
 15%|█▍        | 54896/371472 [4:22:33<25:35:45,  3.44it/s]
 15%|█▍        | 54897/371472 [4:22:33<24:26:24,  3.60it/s]
 15%|█▍        | 54898/371472 [4:22:33<23:39:03,  3.72it/s]
 15%|█▍        | 54899/371472 [4:22:34<23:54:07,  3.68it/s]
 15%|█▍        | 54900/371472 [4:22:34<23:24:58,  3.76it/s]
                                                           
{'loss': 4.0287, 'learning_rate': 8.674017970652244e-07, 'epoch': 2.36}

 15%|█▍        | 54900/371472 [4:22:34<23:24:58,  3.76it/s]
 15%|█▍        | 54901/371472 [4:22:34<24:00:20,  3.66it/s]
 15%|█▍        | 54902/371472 [4:22:34<23:28:32,  3.75it/s]
 15%|█▍        | 54903/371472 [4:22:35<24:08:03,  3.64it/s]
 15%|█▍        | 54904/371472 [4:22:35<27:38:00,  3.18it/s]
 15%|█▍        | 54905/371472 [4:22:35<26:40:00,  3.30it/s]
 15%|█▍        | 54906/371472 [4:22:36<26:52:29,  3.27it/s]
 15%|█▍        | 54907/371472 [4:22:36<25:13:52,  3.49it/s]
 15%|█▍        | 54908/371472 [4:22:36<24:54:33,  3.53it/s]
 15%|█▍        | 54909/371472 [4:22:37<26:35:56,  3.31it/s]
 15%|█▍        | 54910/371472 [4:22:37<26:03:21,  3.37it/s]
 15%|█▍        | 54911/371472 [4:22:37<25:19:23,  3.47it/s]
 15%|█▍        | 54912/371472 [4:22:37<24:42:24,  3.56it/s]
 15%|█▍        | 54913/371472 [4:22:38<24:15:15,  3.63it/s]
 15%|█▍        | 54914/371472 [4:22:38<26:07:20,  3.37it/s]
 15%|█▍        | 54915/371472 [4:22:38<26:18:30,  3.34it/s]
 15%|█▍        | 54916/371472 [4:22:39<26:01:18,  3.38it/s]
 15%|█▍        | 54917/371472 [4:22:39<24:35:37,  3.58it/s]
 15%|█▍        | 54918/371472 [4:22:39<24:22:54,  3.61it/s]
 15%|█▍        | 54919/371472 [4:22:39<24:12:39,  3.63it/s]
 15%|█▍        | 54920/371472 [4:22:40<23:08:14,  3.80it/s]
                                                           
{'loss': 4.4671, 'learning_rate': 8.673533150897455e-07, 'epoch': 2.37}

 15%|█▍        | 54920/371472 [4:22:40<23:08:14,  3.80it/s]
 15%|█▍        | 54921/371472 [4:22:40<24:42:43,  3.56it/s]
 15%|█▍        | 54922/371472 [4:22:40<24:00:12,  3.66it/s]
 15%|█▍        | 54923/371472 [4:22:41<23:59:46,  3.66it/s]
 15%|█▍        | 54924/371472 [4:22:41<23:31:37,  3.74it/s]
 15%|█▍        | 54925/371472 [4:22:41<23:56:54,  3.67it/s]
 15%|█▍        | 54926/371472 [4:22:41<24:31:32,  3.59it/s]
 15%|█▍        | 54927/371472 [4:22:42<24:29:42,  3.59it/s]
 15%|█▍        | 54928/371472 [4:22:42<24:16:53,  3.62it/s]
 15%|█▍        | 54929/371472 [4:22:42<23:43:29,  3.71it/s]
 15%|█▍        | 54930/371472 [4:22:42<23:31:38,  3.74it/s]
 15%|█▍        | 54931/371472 [4:22:43<24:17:20,  3.62it/s]
 15%|█▍        | 54932/371472 [4:22:43<25:45:21,  3.41it/s]
 15%|█▍        | 54933/371472 [4:22:43<24:58:10,  3.52it/s]
 15%|█▍        | 54934/371472 [4:22:44<24:47:15,  3.55it/s]
 15%|█▍        | 54935/371472 [4:22:44<24:43:30,  3.56it/s]
 15%|█▍        | 54936/371472 [4:22:44<23:51:45,  3.68it/s]
 15%|█▍        | 54937/371472 [4:22:44<23:26:31,  3.75it/s]
 15%|█▍        | 54938/371472 [4:22:45<23:31:52,  3.74it/s]
 15%|█▍        | 54939/371472 [4:22:45<23:27:16,  3.75it/s]
 15%|█▍        | 54940/371472 [4:22:45<22:39:59,  3.88it/s]
                                                           
{'loss': 4.3428, 'learning_rate': 8.673048331142666e-07, 'epoch': 2.37}

 15%|█▍        | 54940/371472 [4:22:45<22:39:59,  3.88it/s]
 15%|█▍        | 54941/371472 [4:22:45<24:11:41,  3.63it/s]
 15%|█▍        | 54942/371472 [4:22:46<24:01:26,  3.66it/s]
 15%|█▍        | 54943/371472 [4:22:46<24:16:22,  3.62it/s]
 15%|█▍        | 54944/371472 [4:22:46<24:19:39,  3.61it/s]
 15%|█▍        | 54945/371472 [4:22:47<23:50:01,  3.69it/s]
 15%|█▍        | 54946/371472 [4:22:47<23:56:26,  3.67it/s]
 15%|█▍        | 54947/371472 [4:22:47<23:22:44,  3.76it/s]
 15%|█▍        | 54948/371472 [4:22:47<24:00:19,  3.66it/s]
 15%|█▍        | 54949/371472 [4:22:48<24:16:42,  3.62it/s]
 15%|█▍        | 54950/371472 [4:22:48<24:48:43,  3.54it/s]
 15%|█▍        | 54951/371472 [4:22:48<25:40:55,  3.42it/s]
 15%|█▍        | 54952/371472 [4:22:49<25:24:07,  3.46it/s]
 15%|█▍        | 54953/371472 [4:22:49<25:03:16,  3.51it/s]
 15%|█▍        | 54954/371472 [4:22:49<24:30:03,  3.59it/s]
 15%|█▍        | 54955/371472 [4:22:49<28:24:04,  3.10it/s]
 15%|█▍        | 54956/371472 [4:22:50<30:28:14,  2.89it/s]
 15%|█▍        | 54957/371472 [4:22:50<29:29:02,  2.98it/s]
 15%|█▍        | 54958/371472 [4:22:51<28:45:03,  3.06it/s]
 15%|█▍        | 54959/371472 [4:22:51<27:29:18,  3.20it/s]
 15%|█▍        | 54960/371472 [4:22:51<26:37:48,  3.30it/s]
                                                           
{'loss': 4.0316, 'learning_rate': 8.672563511387877e-07, 'epoch': 2.37}

 15%|█▍        | 54960/371472 [4:22:51<26:37:48,  3.30it/s]
 15%|█▍        | 54961/371472 [4:22:51<25:36:32,  3.43it/s]
 15%|█▍        | 54962/371472 [4:22:52<26:18:31,  3.34it/s]
 15%|█▍        | 54963/371472 [4:22:52<25:58:35,  3.38it/s]
 15%|█▍        | 54964/371472 [4:22:52<25:25:16,  3.46it/s]
 15%|█▍        | 54965/371472 [4:22:52<24:09:52,  3.64it/s]
 15%|█▍        | 54966/371472 [4:22:53<24:02:13,  3.66it/s]
 15%|█▍        | 54967/371472 [4:22:53<23:10:43,  3.79it/s]
 15%|█▍        | 54968/371472 [4:22:53<24:28:26,  3.59it/s]
 15%|█▍        | 54969/371472 [4:22:54<25:08:45,  3.50it/s]
 15%|█▍        | 54970/371472 [4:22:54<27:02:58,  3.25it/s]
 15%|█▍        | 54971/371472 [4:22:54<25:05:24,  3.50it/s]
 15%|█▍        | 54972/371472 [4:22:54<25:05:31,  3.50it/s]
 15%|█▍        | 54973/371472 [4:22:55<24:13:54,  3.63it/s]
 15%|█▍        | 54974/371472 [4:22:55<23:03:21,  3.81it/s]
 15%|█▍        | 54975/371472 [4:22:55<23:18:01,  3.77it/s]
 15%|█▍        | 54976/371472 [4:22:55<22:59:34,  3.82it/s]
 15%|█▍        | 54977/371472 [4:22:56<23:28:23,  3.75it/s]
 15%|█▍        | 54978/371472 [4:22:56<26:40:14,  3.30it/s]
 15%|█▍        | 54979/371472 [4:22:56<26:06:50,  3.37it/s]
 15%|█▍        | 54980/371472 [4:22:57<24:48:17,  3.54it/s]
                                                           
{'loss': 4.2033, 'learning_rate': 8.672078691633088e-07, 'epoch': 2.37}

 15%|█▍        | 54980/371472 [4:22:57<24:48:17,  3.54it/s]
 15%|█▍        | 54981/371472 [4:22:57<24:31:35,  3.58it/s]
 15%|█▍        | 54982/371472 [4:22:57<23:21:59,  3.76it/s]
 15%|█▍        | 54983/371472 [4:22:57<23:25:57,  3.75it/s]
 15%|█▍        | 54984/371472 [4:22:58<25:22:49,  3.46it/s]
 15%|█▍        | 54985/371472 [4:22:58<24:59:31,  3.52it/s]
 15%|█▍        | 54986/371472 [4:22:58<25:06:58,  3.50it/s]
 15%|█▍        | 54987/371472 [4:22:59<24:03:58,  3.65it/s]
 15%|█▍        | 54988/371472 [4:22:59<23:54:23,  3.68it/s]
 15%|█▍        | 54989/371472 [4:22:59<24:28:04,  3.59it/s]
 15%|█▍        | 54990/371472 [4:22:59<25:35:20,  3.44it/s]
 15%|█▍        | 54991/371472 [4:23:00<27:02:41,  3.25it/s]
 15%|█▍        | 54992/371472 [4:23:00<25:47:44,  3.41it/s]
 15%|█▍        | 54993/371472 [4:23:00<24:37:22,  3.57it/s]
 15%|█▍        | 54994/371472 [4:23:01<23:41:56,  3.71it/s]
 15%|█▍        | 54995/371472 [4:23:01<25:22:46,  3.46it/s]
 15%|█▍        | 54996/371472 [4:23:01<24:40:21,  3.56it/s]
 15%|█▍        | 54997/371472 [4:23:01<23:53:01,  3.68it/s]
 15%|█▍        | 54998/371472 [4:23:02<24:48:34,  3.54it/s]
 15%|█▍        | 54999/371472 [4:23:02<24:34:40,  3.58it/s]
 15%|█▍        | 55000/371472 [4:23:02<25:21:33,  3.47it/s]
                                                           
{'loss': 4.3097, 'learning_rate': 8.671593871878299e-07, 'epoch': 2.37}

 15%|█▍        | 55000/371472 [4:23:02<25:21:33,  3.47it/s]
 15%|█▍        | 55001/371472 [4:23:03<24:47:53,  3.54it/s]
 15%|█▍        | 55002/371472 [4:23:03<23:43:10,  3.71it/s]
 15%|█▍        | 55003/371472 [4:23:03<24:17:26,  3.62it/s]
 15%|█▍        | 55004/371472 [4:23:03<24:19:28,  3.61it/s]
 15%|█▍        | 55005/371472 [4:23:04<25:12:29,  3.49it/s]
 15%|█▍        | 55006/371472 [4:23:04<24:43:45,  3.55it/s]
 15%|█▍        | 55007/371472 [4:23:04<24:03:42,  3.65it/s]
 15%|█▍        | 55008/371472 [4:23:05<24:58:21,  3.52it/s]
 15%|█▍        | 55009/371472 [4:23:05<24:15:08,  3.62it/s]
 15%|█▍        | 55010/371472 [4:23:05<24:06:05,  3.65it/s]
 15%|█▍        | 55011/371472 [4:23:05<23:46:54,  3.70it/s]
 15%|█▍        | 55012/371472 [4:23:06<23:50:12,  3.69it/s]
 15%|█▍        | 55013/371472 [4:23:06<25:34:33,  3.44it/s]
 15%|█▍        | 55014/371472 [4:23:06<24:29:37,  3.59it/s]
 15%|█▍        | 55015/371472 [4:23:06<24:27:17,  3.59it/s]
 15%|█▍        | 55016/371472 [4:23:07<24:34:47,  3.58it/s]
 15%|█▍        | 55017/371472 [4:23:07<24:07:31,  3.64it/s]
 15%|█▍        | 55018/371472 [4:23:07<24:26:31,  3.60it/s]
 15%|█▍        | 55019/371472 [4:23:08<24:36:38,  3.57it/s]
 15%|█▍        | 55020/371472 [4:23:08<26:36:37,  3.30it/s]
                                                           
{'loss': 4.1758, 'learning_rate': 8.671109052123509e-07, 'epoch': 2.37}

 15%|█▍        | 55020/371472 [4:23:08<26:36:37,  3.30it/s]
 15%|█▍        | 55021/371472 [4:23:08<25:45:43,  3.41it/s]
 15%|█▍        | 55022/371472 [4:23:08<24:42:17,  3.56it/s]
 15%|█▍        | 55023/371472 [4:23:09<23:35:51,  3.73it/s]
 15%|█▍        | 55024/371472 [4:23:09<24:23:56,  3.60it/s]
 15%|█▍        | 55025/371472 [4:23:09<24:13:18,  3.63it/s]
 15%|█▍        | 55026/371472 [4:23:10<24:24:43,  3.60it/s]
 15%|█▍        | 55027/371472 [4:23:10<25:29:04,  3.45it/s]
 15%|█▍        | 55028/371472 [4:23:10<27:18:09,  3.22it/s]
 15%|█▍        | 55029/371472 [4:23:10<26:05:20,  3.37it/s]
 15%|█▍        | 55030/371472 [4:23:11<25:08:58,  3.50it/s]
 15%|█▍        | 55031/371472 [4:23:11<24:37:03,  3.57it/s]
 15%|█▍        | 55032/371472 [4:23:11<24:08:09,  3.64it/s]
 15%|█▍        | 55033/371472 [4:23:12<24:46:36,  3.55it/s]
 15%|█▍        | 55034/371472 [4:23:12<24:54:05,  3.53it/s]
 15%|█▍        | 55035/371472 [4:23:12<25:28:45,  3.45it/s]
 15%|█▍        | 55036/371472 [4:23:12<25:24:30,  3.46it/s]
 15%|█▍        | 55037/371472 [4:23:13<25:35:36,  3.43it/s]
 15%|█▍        | 55038/371472 [4:23:13<25:19:04,  3.47it/s]
 15%|█▍        | 55039/371472 [4:23:13<25:38:58,  3.43it/s]
 15%|█▍        | 55040/371472 [4:23:14<25:04:52,  3.50it/s]
                                                           
{'loss': 4.5582, 'learning_rate': 8.670624232368721e-07, 'epoch': 2.37}

 15%|█▍        | 55040/371472 [4:23:14<25:04:52,  3.50it/s]
 15%|█▍        | 55041/371472 [4:23:14<24:11:45,  3.63it/s]
 15%|█▍        | 55042/371472 [4:23:14<22:55:25,  3.83it/s]
 15%|█▍        | 55043/371472 [4:23:14<22:38:25,  3.88it/s]
 15%|█▍        | 55044/371472 [4:23:15<23:10:49,  3.79it/s]
 15%|█▍        | 55045/371472 [4:23:15<23:47:34,  3.69it/s]
 15%|█▍        | 55046/371472 [4:23:15<24:10:20,  3.64it/s]
 15%|█▍        | 55047/371472 [4:23:15<24:02:44,  3.66it/s]
 15%|█▍        | 55048/371472 [4:23:16<26:21:52,  3.33it/s]
 15%|█▍        | 55049/371472 [4:23:16<24:37:13,  3.57it/s]
 15%|█▍        | 55050/371472 [4:23:16<24:15:42,  3.62it/s]
 15%|█▍        | 55051/371472 [4:23:17<24:18:58,  3.61it/s]
 15%|█▍        | 55052/371472 [4:23:17<23:59:57,  3.66it/s]
 15%|█▍        | 55053/371472 [4:23:17<25:04:53,  3.50it/s]
 15%|█▍        | 55054/371472 [4:23:17<25:21:24,  3.47it/s]
 15%|█▍        | 55055/371472 [4:23:18<25:18:49,  3.47it/s]
 15%|█▍        | 55056/371472 [4:23:18<24:23:10,  3.60it/s]
 15%|█▍        | 55057/371472 [4:23:18<24:28:19,  3.59it/s]
 15%|█▍        | 55058/371472 [4:23:19<23:57:36,  3.67it/s]
 15%|█▍        | 55059/371472 [4:23:19<25:11:38,  3.49it/s]
 15%|█▍        | 55060/371472 [4:23:19<25:11:59,  3.49it/s]
                                                           
{'loss': 4.3608, 'learning_rate': 8.670139412613933e-07, 'epoch': 2.37}

 15%|█▍        | 55060/371472 [4:23:19<25:11:59,  3.49it/s]
 15%|█▍        | 55061/371472 [4:23:19<26:54:01,  3.27it/s]
 15%|█▍        | 55062/371472 [4:23:20<25:41:16,  3.42it/s]
 15%|█▍        | 55063/371472 [4:23:20<30:26:56,  2.89it/s]
 15%|█▍        | 55064/371472 [4:23:21<29:12:19,  3.01it/s]
 15%|█▍        | 55065/371472 [4:23:21<27:57:18,  3.14it/s]
 15%|█▍        | 55066/371472 [4:23:21<27:15:42,  3.22it/s]
 15%|█▍        | 55067/371472 [4:23:21<25:54:41,  3.39it/s]
 15%|█▍        | 55068/371472 [4:23:22<26:33:44,  3.31it/s]
 15%|█▍        | 55069/371472 [4:23:22<26:18:15,  3.34it/s]
 15%|█▍        | 55070/371472 [4:23:22<25:45:19,  3.41it/s]
 15%|█▍        | 55071/371472 [4:23:23<26:44:43,  3.29it/s]
 15%|█▍        | 55072/371472 [4:23:23<26:34:08,  3.31it/s]
 15%|█▍        | 55073/371472 [4:23:23<26:21:52,  3.33it/s]
 15%|█▍        | 55074/371472 [4:23:23<26:21:11,  3.34it/s]
 15%|█▍        | 55075/371472 [4:23:24<25:24:38,  3.46it/s]
 15%|█▍        | 55076/371472 [4:23:24<24:24:46,  3.60it/s]
 15%|█▍        | 55077/371472 [4:23:24<24:01:42,  3.66it/s]
 15%|█▍        | 55078/371472 [4:23:25<24:38:04,  3.57it/s]
 15%|█▍        | 55079/371472 [4:23:25<25:05:23,  3.50it/s]
 15%|█▍        | 55080/371472 [4:23:25<24:25:26,  3.60it/s]
                                                           
{'loss': 4.3383, 'learning_rate': 8.669654592859144e-07, 'epoch': 2.37}

 15%|█▍        | 55080/371472 [4:23:25<24:25:26,  3.60it/s]
 15%|█▍        | 55081/371472 [4:23:25<23:49:01,  3.69it/s]
 15%|█▍        | 55082/371472 [4:23:26<24:08:21,  3.64it/s]
 15%|█▍        | 55083/371472 [4:23:26<24:54:48,  3.53it/s]
 15%|█▍        | 55084/371472 [4:23:26<27:24:53,  3.21it/s]
 15%|█▍        | 55085/371472 [4:23:27<27:32:43,  3.19it/s]
 15%|█▍        | 55086/371472 [4:23:27<26:08:15,  3.36it/s]
 15%|█▍        | 55087/371472 [4:23:27<27:05:39,  3.24it/s]
 15%|█▍        | 55088/371472 [4:23:28<26:40:30,  3.29it/s]
 15%|█▍        | 55089/371472 [4:23:28<26:19:53,  3.34it/s]
 15%|█▍        | 55090/371472 [4:23:28<25:34:36,  3.44it/s]
 15%|█▍        | 55091/371472 [4:23:28<25:32:17,  3.44it/s]
 15%|█▍        | 55092/371472 [4:23:29<25:02:32,  3.51it/s]
 15%|█▍        | 55093/371472 [4:23:29<25:06:14,  3.50it/s]
 15%|█▍        | 55094/371472 [4:23:29<24:29:56,  3.59it/s]
 15%|█▍        | 55095/371472 [4:23:29<23:55:20,  3.67it/s]
 15%|█▍        | 55096/371472 [4:23:30<24:20:14,  3.61it/s]
 15%|█▍        | 55097/371472 [4:23:30<24:24:35,  3.60it/s]
 15%|█▍        | 55098/371472 [4:23:30<24:15:37,  3.62it/s]
 15%|█▍        | 55099/371472 [4:23:31<23:21:55,  3.76it/s]
 15%|█▍        | 55100/371472 [4:23:31<22:39:07,  3.88it/s]
                                                           
{'loss': 4.1525, 'learning_rate': 8.669169773104354e-07, 'epoch': 2.37}

 15%|█▍        | 55100/371472 [4:23:31<22:39:07,  3.88it/s]
 15%|█▍        | 55101/371472 [4:23:31<24:44:11,  3.55it/s]
 15%|█▍        | 55102/371472 [4:23:31<26:00:01,  3.38it/s]
 15%|█▍        | 55103/371472 [4:23:32<24:40:06,  3.56it/s]
 15%|█▍        | 55104/371472 [4:23:32<24:06:56,  3.64it/s]
 15%|█▍        | 55105/371472 [4:23:32<23:51:45,  3.68it/s]
 15%|█▍        | 55106/371472 [4:23:33<24:24:15,  3.60it/s]
 15%|█▍        | 55107/371472 [4:23:33<24:29:52,  3.59it/s]
 15%|█▍        | 55108/371472 [4:23:33<24:50:55,  3.54it/s]
 15%|█▍        | 55109/371472 [4:23:33<26:11:45,  3.35it/s]
 15%|█▍        | 55110/371472 [4:23:34<24:58:47,  3.52it/s]
 15%|█▍        | 55111/371472 [4:23:34<25:06:22,  3.50it/s]
 15%|█▍        | 55112/371472 [4:23:34<24:13:22,  3.63it/s]
 15%|█▍        | 55113/371472 [4:23:35<25:34:57,  3.44it/s]
 15%|█▍        | 55114/371472 [4:23:35<25:16:29,  3.48it/s]
 15%|█▍        | 55115/371472 [4:23:35<25:25:59,  3.46it/s]
 15%|█▍        | 55116/371472 [4:23:35<24:58:35,  3.52it/s]
 15%|█▍        | 55117/371472 [4:23:36<25:18:41,  3.47it/s]
 15%|█▍        | 55118/371472 [4:23:36<24:58:46,  3.52it/s]
 15%|█▍        | 55119/371472 [4:23:36<25:13:00,  3.48it/s]
 15%|█▍        | 55120/371472 [4:23:36<24:11:29,  3.63it/s]
                                                           
{'loss': 4.1372, 'learning_rate': 8.668684953349565e-07, 'epoch': 2.37}

 15%|█▍        | 55120/371472 [4:23:36<24:11:29,  3.63it/s]
 15%|█▍        | 55121/371472 [4:23:37<23:56:34,  3.67it/s]
 15%|█▍        | 55122/371472 [4:23:37<24:18:02,  3.62it/s]
 15%|█▍        | 55123/371472 [4:23:37<23:33:37,  3.73it/s]
 15%|█▍        | 55124/371472 [4:23:38<24:15:24,  3.62it/s]
 15%|█▍        | 55125/371472 [4:23:38<23:29:49,  3.74it/s]
 15%|█▍        | 55126/371472 [4:23:38<24:50:10,  3.54it/s]
 15%|█▍        | 55127/371472 [4:23:38<24:48:32,  3.54it/s]
 15%|█▍        | 55128/371472 [4:23:39<24:31:06,  3.58it/s]
 15%|█▍        | 55129/371472 [4:23:39<24:25:29,  3.60it/s]
 15%|█▍        | 55130/371472 [4:23:39<23:47:06,  3.69it/s]
 15%|█▍        | 55131/371472 [4:23:40<24:17:38,  3.62it/s]
 15%|█▍        | 55132/371472 [4:23:40<25:13:05,  3.48it/s]
 15%|█▍        | 55133/371472 [4:23:40<24:24:35,  3.60it/s]
 15%|█▍        | 55134/371472 [4:23:40<24:01:08,  3.66it/s]
 15%|█▍        | 55135/371472 [4:23:41<24:29:40,  3.59it/s]
 15%|█▍        | 55136/371472 [4:23:41<24:05:16,  3.65it/s]
 15%|█▍        | 55137/371472 [4:23:41<25:01:10,  3.51it/s]
 15%|█▍        | 55138/371472 [4:23:42<25:36:50,  3.43it/s]
 15%|█▍        | 55139/371472 [4:23:42<25:01:10,  3.51it/s]
 15%|█▍        | 55140/371472 [4:23:42<23:38:13,  3.72it/s]
                                                           
{'loss': 4.3853, 'learning_rate': 8.668200133594777e-07, 'epoch': 2.37}

 15%|█▍        | 55140/371472 [4:23:42<23:38:13,  3.72it/s]
 15%|█▍        | 55141/371472 [4:23:42<24:15:09,  3.62it/s]
 15%|█▍        | 55142/371472 [4:23:43<23:46:12,  3.70it/s]
 15%|█▍        | 55143/371472 [4:23:43<22:45:16,  3.86it/s]
 15%|█▍        | 55144/371472 [4:23:43<23:19:03,  3.77it/s]
 15%|█▍        | 55145/371472 [4:23:43<25:16:03,  3.48it/s]
 15%|█▍        | 55146/371472 [4:23:44<25:46:54,  3.41it/s]
 15%|█▍        | 55147/371472 [4:23:44<24:50:36,  3.54it/s]
 15%|█▍        | 55148/371472 [4:23:44<25:53:09,  3.39it/s]
 15%|█▍        | 55149/371472 [4:23:45<25:21:27,  3.47it/s]
 15%|█▍        | 55150/371472 [4:23:45<25:46:50,  3.41it/s]
 15%|█▍        | 55151/371472 [4:23:45<25:43:51,  3.41it/s]
 15%|█▍        | 55152/371472 [4:23:46<27:29:26,  3.20it/s]
 15%|█▍        | 55153/371472 [4:23:46<25:46:55,  3.41it/s]
 15%|█▍        | 55154/371472 [4:23:46<24:07:45,  3.64it/s]
 15%|█▍        | 55155/371472 [4:23:46<25:00:57,  3.51it/s]
 15%|█▍        | 55156/371472 [4:23:47<23:50:33,  3.69it/s]
 15%|█▍        | 55157/371472 [4:23:47<24:23:03,  3.60it/s]
 15%|█▍        | 55158/371472 [4:23:47<24:14:11,  3.63it/s]
 15%|█▍        | 55159/371472 [4:23:47<23:45:42,  3.70it/s]
 15%|█▍        | 55160/371472 [4:23:48<24:35:49,  3.57it/s]
                                                           
{'loss': 4.1832, 'learning_rate': 8.667715313839988e-07, 'epoch': 2.38}

 15%|█▍        | 55160/371472 [4:23:48<24:35:49,  3.57it/s]
 15%|█▍        | 55161/371472 [4:23:48<24:56:52,  3.52it/s]
 15%|█▍        | 55162/371472 [4:23:48<25:56:15,  3.39it/s]
 15%|█▍        | 55163/371472 [4:23:49<24:54:41,  3.53it/s]
 15%|█▍        | 55164/371472 [4:23:49<25:06:26,  3.50it/s]
 15%|█▍        | 55165/371472 [4:23:49<24:24:28,  3.60it/s]
 15%|█▍        | 55166/371472 [4:23:49<23:15:42,  3.78it/s]
 15%|█▍        | 55167/371472 [4:23:50<24:07:33,  3.64it/s]
 15%|█▍        | 55168/371472 [4:23:50<24:02:18,  3.66it/s]
 15%|█▍        | 55169/371472 [4:23:50<23:26:29,  3.75it/s]
 15%|█▍        | 55170/371472 [4:23:50<23:19:34,  3.77it/s]
 15%|█▍        | 55171/371472 [4:23:51<22:34:13,  3.89it/s]
 15%|█▍        | 55172/371472 [4:23:51<22:55:16,  3.83it/s]
 15%|█▍        | 55173/371472 [4:23:51<23:01:19,  3.82it/s]
 15%|█▍        | 55174/371472 [4:23:51<23:00:27,  3.82it/s]
 15%|█▍        | 55175/371472 [4:23:52<22:57:39,  3.83it/s]
 15%|█▍        | 55176/371472 [4:23:52<23:02:54,  3.81it/s]
 15%|█▍        | 55177/371472 [4:23:52<22:25:32,  3.92it/s]
 15%|█▍        | 55178/371472 [4:23:53<23:56:38,  3.67it/s]
 15%|█▍        | 55179/371472 [4:23:53<24:40:49,  3.56it/s]
 15%|█▍        | 55180/371472 [4:23:53<23:48:25,  3.69it/s]
                                                           
{'loss': 4.3249, 'learning_rate': 8.667230494085198e-07, 'epoch': 2.38}

 15%|█▍        | 55180/371472 [4:23:53<23:48:25,  3.69it/s]
 15%|█▍        | 55181/371472 [4:23:53<23:33:53,  3.73it/s]
 15%|█▍        | 55182/371472 [4:23:54<24:04:51,  3.65it/s]
 15%|█▍        | 55183/371472 [4:23:54<24:09:02,  3.64it/s]
 15%|█▍        | 55184/371472 [4:23:54<24:01:40,  3.66it/s]
 15%|█▍        | 55185/371472 [4:23:54<23:24:43,  3.75it/s]
 15%|█▍        | 55186/371472 [4:23:55<23:08:00,  3.80it/s]
 15%|█▍        | 55187/371472 [4:23:55<23:29:27,  3.74it/s]
 15%|█▍        | 55188/371472 [4:23:55<25:24:34,  3.46it/s]
 15%|█▍        | 55189/371472 [4:23:56<24:37:53,  3.57it/s]
 15%|█▍        | 55190/371472 [4:23:56<23:51:54,  3.68it/s]
 15%|█▍        | 55191/371472 [4:23:56<23:45:58,  3.70it/s]
 15%|█▍        | 55192/371472 [4:23:56<24:56:43,  3.52it/s]
 15%|█▍        | 55193/371472 [4:23:57<25:45:08,  3.41it/s]
 15%|█▍        | 55194/371472 [4:23:57<24:35:35,  3.57it/s]
 15%|█▍        | 55195/371472 [4:23:57<25:36:33,  3.43it/s]
 15%|█▍        | 55196/371472 [4:23:58<24:14:58,  3.62it/s]
 15%|█▍        | 55197/371472 [4:23:58<25:41:29,  3.42it/s]
 15%|█▍        | 55198/371472 [4:23:58<26:50:16,  3.27it/s]
 15%|█▍        | 55199/371472 [4:23:58<25:37:28,  3.43it/s]
 15%|█▍        | 55200/371472 [4:23:59<24:39:13,  3.56it/s]
                                                           
{'loss': 4.231, 'learning_rate': 8.66674567433041e-07, 'epoch': 2.38}

 15%|█▍        | 55200/371472 [4:23:59<24:39:13,  3.56it/s]
 15%|█▍        | 55201/371472 [4:23:59<24:07:03,  3.64it/s]
 15%|█▍        | 55202/371472 [4:23:59<24:32:28,  3.58it/s]
 15%|█▍        | 55203/371472 [4:24:00<25:13:27,  3.48it/s]
 15%|█▍        | 55204/371472 [4:24:00<25:15:29,  3.48it/s]
 15%|█▍        | 55205/371472 [4:24:00<26:22:57,  3.33it/s]
 15%|█▍        | 55206/371472 [4:24:00<26:03:06,  3.37it/s]
 15%|█▍        | 55207/371472 [4:24:01<26:43:30,  3.29it/s]
 15%|█▍        | 55208/371472 [4:24:01<26:16:09,  3.34it/s]
 15%|█▍        | 55209/371472 [4:24:01<28:22:31,  3.10it/s]
 15%|█▍        | 55210/371472 [4:24:02<26:11:59,  3.35it/s]
 15%|█▍        | 55211/371472 [4:24:02<25:23:19,  3.46it/s]
 15%|█▍        | 55212/371472 [4:24:02<25:24:53,  3.46it/s]
 15%|█▍        | 55213/371472 [4:24:03<24:02:32,  3.65it/s]
 15%|█▍        | 55214/371472 [4:24:03<24:33:41,  3.58it/s]
 15%|█▍        | 55215/371472 [4:24:03<24:09:33,  3.64it/s]
 15%|█▍        | 55216/371472 [4:24:03<24:11:14,  3.63it/s]
 15%|█▍        | 55217/371472 [4:24:04<23:29:41,  3.74it/s]
 15%|█▍        | 55218/371472 [4:24:04<23:47:08,  3.69it/s]
 15%|█▍        | 55219/371472 [4:24:04<23:28:19,  3.74it/s]
 15%|█▍        | 55220/371472 [4:24:04<22:35:50,  3.89it/s]
                                                           
{'loss': 4.3996, 'learning_rate': 8.666260854575622e-07, 'epoch': 2.38}

 15%|█▍        | 55220/371472 [4:24:04<22:35:50,  3.89it/s]
 15%|█▍        | 55221/371472 [4:24:05<22:02:12,  3.99it/s]
 15%|█▍        | 55222/371472 [4:24:05<24:02:34,  3.65it/s]
 15%|█▍        | 55223/371472 [4:24:05<23:56:45,  3.67it/s]
 15%|█▍        | 55224/371472 [4:24:05<23:57:20,  3.67it/s]
 15%|█▍        | 55225/371472 [4:24:06<24:21:55,  3.61it/s]
 15%|█▍        | 55226/371472 [4:24:06<24:05:58,  3.65it/s]
 15%|█▍        | 55227/371472 [4:24:06<24:59:16,  3.52it/s]
 15%|█▍        | 55228/371472 [4:24:07<24:02:21,  3.65it/s]
 15%|█▍        | 55229/371472 [4:24:07<24:35:00,  3.57it/s]
 15%|█▍        | 55230/371472 [4:24:07<26:12:28,  3.35it/s]
 15%|█▍        | 55231/371472 [4:24:07<25:39:11,  3.42it/s]
 15%|█▍        | 55232/371472 [4:24:08<25:31:09,  3.44it/s]
 15%|█▍        | 55233/371472 [4:24:08<24:55:35,  3.52it/s]
 15%|█▍        | 55234/371472 [4:24:08<24:29:30,  3.59it/s]
 15%|█▍        | 55235/371472 [4:24:09<26:10:15,  3.36it/s]
 15%|█▍        | 55236/371472 [4:24:09<25:34:34,  3.43it/s]
 15%|█▍        | 55237/371472 [4:24:09<24:50:26,  3.54it/s]
 15%|█▍        | 55238/371472 [4:24:09<24:23:03,  3.60it/s]
 15%|█▍        | 55239/371472 [4:24:10<24:54:33,  3.53it/s]
 15%|█▍        | 55240/371472 [4:24:10<24:15:02,  3.62it/s]
                                                           
{'loss': 4.3011, 'learning_rate': 8.665776034820831e-07, 'epoch': 2.38}

 15%|█▍        | 55240/371472 [4:24:10<24:15:02,  3.62it/s]
 15%|█▍        | 55241/371472 [4:24:10<24:18:24,  3.61it/s]
 15%|█▍        | 55242/371472 [4:24:11<26:31:38,  3.31it/s]
 15%|█▍        | 55243/371472 [4:24:11<26:31:01,  3.31it/s]
 15%|█▍        | 55244/371472 [4:24:11<26:46:13,  3.28it/s]
 15%|█▍        | 55245/371472 [4:24:12<25:49:51,  3.40it/s]
 15%|█▍        | 55246/371472 [4:24:12<25:04:32,  3.50it/s]
 15%|█▍        | 55247/371472 [4:24:12<24:27:51,  3.59it/s]
 15%|█▍        | 55248/371472 [4:24:12<23:44:25,  3.70it/s]
 15%|█▍        | 55249/371472 [4:24:13<25:12:57,  3.48it/s]
 15%|█▍        | 55250/371472 [4:24:13<24:19:50,  3.61it/s]
 15%|█▍        | 55251/371472 [4:24:13<25:07:51,  3.50it/s]
 15%|█▍        | 55252/371472 [4:24:14<26:05:12,  3.37it/s]
 15%|█▍        | 55253/371472 [4:24:14<25:33:05,  3.44it/s]
 15%|█▍        | 55254/371472 [4:24:14<26:54:22,  3.26it/s]
 15%|█▍        | 55255/371472 [4:24:14<26:10:45,  3.36it/s]
 15%|█▍        | 55256/371472 [4:24:15<25:05:39,  3.50it/s]
 15%|█▍        | 55257/371472 [4:24:15<25:57:19,  3.38it/s]
 15%|█▍        | 55258/371472 [4:24:15<25:04:00,  3.50it/s]
 15%|█▍        | 55259/371472 [4:24:15<23:43:15,  3.70it/s]
 15%|█▍        | 55260/371472 [4:24:16<23:34:41,  3.73it/s]
                                                           
{'loss': 4.1059, 'learning_rate': 8.665291215066042e-07, 'epoch': 2.38}

 15%|█▍        | 55260/371472 [4:24:16<23:34:41,  3.73it/s]
 15%|█▍        | 55261/371472 [4:24:16<23:03:51,  3.81it/s]
 15%|█▍        | 55262/371472 [4:24:16<23:25:47,  3.75it/s]
 15%|█▍        | 55263/371472 [4:24:17<23:11:39,  3.79it/s]
 15%|█▍        | 55264/371472 [4:24:17<24:11:45,  3.63it/s]
 15%|█▍        | 55265/371472 [4:24:17<25:43:18,  3.41it/s]
 15%|█▍        | 55266/371472 [4:24:18<28:18:43,  3.10it/s]
 15%|█▍        | 55267/371472 [4:24:18<26:26:34,  3.32it/s]
 15%|█▍        | 55268/371472 [4:24:18<26:10:02,  3.36it/s]
 15%|█▍        | 55269/371472 [4:24:18<25:59:53,  3.38it/s]
 15%|█▍        | 55270/371472 [4:24:19<25:09:07,  3.49it/s]
 15%|█▍        | 55271/371472 [4:24:19<24:35:16,  3.57it/s]
 15%|█▍        | 55272/371472 [4:24:19<24:46:33,  3.55it/s]
 15%|█▍        | 55273/371472 [4:24:19<24:26:17,  3.59it/s]
 15%|█▍        | 55274/371472 [4:24:20<24:06:06,  3.64it/s]
 15%|█▍        | 55275/371472 [4:24:20<24:08:16,  3.64it/s]
 15%|█▍        | 55276/371472 [4:24:20<26:33:09,  3.31it/s]
 15%|█▍        | 55277/371472 [4:24:21<27:12:55,  3.23it/s]
 15%|█▍        | 55278/371472 [4:24:21<26:26:46,  3.32it/s]
 15%|█▍        | 55279/371472 [4:24:21<25:34:49,  3.43it/s]
 15%|█▍        | 55280/371472 [4:24:22<24:22:40,  3.60it/s]
                                                           
{'loss': 4.1404, 'learning_rate': 8.664806395311254e-07, 'epoch': 2.38}

 15%|█▍        | 55280/371472 [4:24:22<24:22:40,  3.60it/s]
 15%|█▍        | 55281/371472 [4:24:22<23:52:23,  3.68it/s]
 15%|█▍        | 55282/371472 [4:24:22<24:14:50,  3.62it/s]
 15%|█▍        | 55283/371472 [4:24:22<23:54:00,  3.67it/s]
 15%|█▍        | 55284/371472 [4:24:23<25:12:01,  3.49it/s]
 15%|█▍        | 55285/371472 [4:24:23<26:13:03,  3.35it/s]
 15%|█▍        | 55286/371472 [4:24:23<24:46:49,  3.54it/s]
 15%|█▍        | 55287/371472 [4:24:24<25:22:19,  3.46it/s]
 15%|█▍        | 55288/371472 [4:24:24<25:39:43,  3.42it/s]
 15%|█▍        | 55289/371472 [4:24:24<26:18:08,  3.34it/s]
 15%|█▍        | 55290/371472 [4:24:24<26:12:44,  3.35it/s]
 15%|█▍        | 55291/371472 [4:24:25<26:34:49,  3.30it/s]
 15%|█▍        | 55292/371472 [4:24:25<25:30:02,  3.44it/s]
 15%|█▍        | 55293/371472 [4:24:25<24:29:11,  3.59it/s]
 15%|█▍        | 55294/371472 [4:24:26<23:42:25,  3.70it/s]
 15%|█▍        | 55295/371472 [4:24:26<23:10:31,  3.79it/s]
 15%|█▍        | 55296/371472 [4:24:26<23:16:39,  3.77it/s]
 15%|█▍        | 55297/371472 [4:24:26<23:42:51,  3.70it/s]
 15%|█▍        | 55298/371472 [4:24:27<23:17:47,  3.77it/s]
 15%|█▍        | 55299/371472 [4:24:27<23:05:06,  3.80it/s]
 15%|█▍        | 55300/371472 [4:24:27<23:16:47,  3.77it/s]
                                                           
{'loss': 4.2836, 'learning_rate': 8.664321575556465e-07, 'epoch': 2.38}

 15%|█▍        | 55300/371472 [4:24:27<23:16:47,  3.77it/s]
 15%|█▍        | 55301/371472 [4:24:27<24:29:37,  3.59it/s]
 15%|█▍        | 55302/371472 [4:24:28<25:31:57,  3.44it/s]
 15%|█▍        | 55303/371472 [4:24:28<24:09:51,  3.63it/s]
 15%|█▍        | 55304/371472 [4:24:28<24:29:28,  3.59it/s]
 15%|█▍        | 55305/371472 [4:24:28<23:50:47,  3.68it/s]
 15%|█▍        | 55306/371472 [4:24:29<23:32:38,  3.73it/s]
 15%|█▍        | 55307/371472 [4:24:29<23:11:23,  3.79it/s]
 15%|█▍        | 55308/371472 [4:24:29<23:44:07,  3.70it/s]
 15%|█▍        | 55309/371472 [4:24:30<24:09:53,  3.63it/s]
 15%|█▍        | 55310/371472 [4:24:30<23:38:25,  3.71it/s]
 15%|█▍        | 55311/371472 [4:24:30<23:19:40,  3.76it/s]
 15%|█▍        | 55312/371472 [4:24:30<23:33:27,  3.73it/s]
 15%|█▍        | 55313/371472 [4:24:31<24:03:24,  3.65it/s]
 15%|█▍        | 55314/371472 [4:24:31<24:10:08,  3.63it/s]
 15%|█▍        | 55315/371472 [4:24:31<23:43:32,  3.70it/s]
 15%|█▍        | 55316/371472 [4:24:31<23:32:39,  3.73it/s]
 15%|█▍        | 55317/371472 [4:24:32<23:06:40,  3.80it/s]
 15%|█▍        | 55318/371472 [4:24:32<25:13:27,  3.48it/s]
 15%|█▍        | 55319/371472 [4:24:32<25:52:25,  3.39it/s]
 15%|█▍        | 55320/371472 [4:24:33<27:29:32,  3.19it/s]
                                                           
{'loss': 4.2736, 'learning_rate': 8.663836755801676e-07, 'epoch': 2.38}

 15%|█▍        | 55320/371472 [4:24:33<27:29:32,  3.19it/s]
 15%|█▍        | 55321/371472 [4:24:33<26:12:02,  3.35it/s]
 15%|█▍        | 55322/371472 [4:24:33<25:23:46,  3.46it/s]
 15%|█▍        | 55323/371472 [4:24:34<26:19:57,  3.33it/s]
 15%|█▍        | 55324/371472 [4:24:34<24:53:47,  3.53it/s]
 15%|█▍        | 55325/371472 [4:24:34<23:27:38,  3.74it/s]
 15%|█▍        | 55326/371472 [4:24:34<23:46:32,  3.69it/s]
 15%|█▍        | 55327/371472 [4:24:35<23:44:51,  3.70it/s]
 15%|█▍        | 55328/371472 [4:24:35<23:13:11,  3.78it/s]
 15%|█▍        | 55329/371472 [4:24:35<23:34:02,  3.73it/s]
 15%|█▍        | 55330/371472 [4:24:35<23:57:01,  3.67it/s]
 15%|█▍        | 55331/371472 [4:24:36<24:00:05,  3.66it/s]
 15%|█▍        | 55332/371472 [4:24:36<24:47:50,  3.54it/s]
 15%|█▍        | 55333/371472 [4:24:36<24:50:02,  3.54it/s]
 15%|█▍        | 55334/371472 [4:24:37<24:22:53,  3.60it/s]
 15%|█▍        | 55335/371472 [4:24:37<23:31:55,  3.73it/s]
 15%|█▍        | 55336/371472 [4:24:37<22:51:12,  3.84it/s]
 15%|█▍        | 55337/371472 [4:24:37<22:57:17,  3.83it/s]
 15%|█▍        | 55338/371472 [4:24:38<26:52:21,  3.27it/s]
 15%|█▍        | 55339/371472 [4:24:38<25:50:23,  3.40it/s]
 15%|█▍        | 55340/371472 [4:24:38<24:58:53,  3.52it/s]
                                                           
{'loss': 4.0531, 'learning_rate': 8.663351936046887e-07, 'epoch': 2.38}

 15%|█▍        | 55340/371472 [4:24:38<24:58:53,  3.52it/s]
 15%|█▍        | 55341/371472 [4:24:39<25:54:02,  3.39it/s]
 15%|█▍        | 55342/371472 [4:24:39<26:31:07,  3.31it/s]
 15%|█▍        | 55343/371472 [4:24:39<25:13:57,  3.48it/s]
 15%|█▍        | 55344/371472 [4:24:39<25:30:13,  3.44it/s]
 15%|█▍        | 55345/371472 [4:24:40<24:44:55,  3.55it/s]
 15%|█▍        | 55346/371472 [4:24:40<24:26:47,  3.59it/s]
 15%|█▍        | 55347/371472 [4:24:40<23:53:17,  3.68it/s]
 15%|█▍        | 55348/371472 [4:24:41<27:22:06,  3.21it/s]
 15%|█▍        | 55349/371472 [4:24:41<25:48:05,  3.40it/s]
 15%|█▍        | 55350/371472 [4:24:41<25:06:21,  3.50it/s]
 15%|█▍        | 55351/371472 [4:24:41<25:21:37,  3.46it/s]
 15%|█▍        | 55352/371472 [4:24:42<25:15:45,  3.48it/s]
 15%|█▍        | 55353/371472 [4:24:42<24:28:19,  3.59it/s]
 15%|█▍        | 55354/371472 [4:24:42<24:39:31,  3.56it/s]
 15%|█▍        | 55355/371472 [4:24:43<23:53:59,  3.67it/s]
 15%|█▍        | 55356/371472 [4:24:43<23:20:40,  3.76it/s]
 15%|█▍        | 55357/371472 [4:24:43<23:11:43,  3.79it/s]
 15%|█▍        | 55358/371472 [4:24:43<23:37:33,  3.72it/s]
 15%|█▍        | 55359/371472 [4:24:44<24:41:37,  3.56it/s]
 15%|█▍        | 55360/371472 [4:24:44<23:55:53,  3.67it/s]
                                                           
{'loss': 4.2524, 'learning_rate': 8.662867116292098e-07, 'epoch': 2.38}

 15%|█▍        | 55360/371472 [4:24:44<23:55:53,  3.67it/s]
 15%|█▍        | 55361/371472 [4:24:44<23:30:53,  3.73it/s]
 15%|█▍        | 55362/371472 [4:24:44<23:23:53,  3.75it/s]
 15%|█▍        | 55363/371472 [4:24:45<23:16:41,  3.77it/s]
 15%|█▍        | 55364/371472 [4:24:45<24:36:56,  3.57it/s]
 15%|█▍        | 55365/371472 [4:24:45<23:54:49,  3.67it/s]
 15%|█▍        | 55366/371472 [4:24:45<24:01:47,  3.65it/s]
 15%|█▍        | 55367/371472 [4:24:46<23:36:05,  3.72it/s]
 15%|█▍        | 55368/371472 [4:24:46<24:43:18,  3.55it/s]
 15%|█▍        | 55369/371472 [4:24:46<24:08:25,  3.64it/s]
 15%|█▍        | 55370/371472 [4:24:47<25:57:27,  3.38it/s]
 15%|█▍        | 55371/371472 [4:24:47<25:25:07,  3.45it/s]
 15%|█▍        | 55372/371472 [4:24:47<24:41:03,  3.56it/s]
 15%|█▍        | 55373/371472 [4:24:47<23:59:11,  3.66it/s]
 15%|█▍        | 55374/371472 [4:24:48<24:14:45,  3.62it/s]
 15%|█▍        | 55375/371472 [4:24:48<23:39:34,  3.71it/s]
 15%|█▍        | 55376/371472 [4:24:48<23:58:08,  3.66it/s]
 15%|█▍        | 55377/371472 [4:24:49<24:12:15,  3.63it/s]
 15%|█▍        | 55378/371472 [4:24:49<24:00:52,  3.66it/s]
 15%|█▍        | 55379/371472 [4:24:49<24:28:19,  3.59it/s]
 15%|█▍        | 55380/371472 [4:24:49<24:12:25,  3.63it/s]
                                                           
{'loss': 4.307, 'learning_rate': 8.662382296537309e-07, 'epoch': 2.39}

 15%|█▍        | 55380/371472 [4:24:49<24:12:25,  3.63it/s]
 15%|█▍        | 55381/371472 [4:24:50<23:49:26,  3.69it/s]
 15%|█▍        | 55382/371472 [4:24:50<25:16:10,  3.47it/s]
 15%|█▍        | 55383/371472 [4:24:50<24:32:57,  3.58it/s]
 15%|█▍        | 55384/371472 [4:24:50<23:42:21,  3.70it/s]
 15%|█▍        | 55385/371472 [4:24:51<22:59:01,  3.82it/s]
 15%|█▍        | 55386/371472 [4:24:51<22:31:22,  3.90it/s]
 15%|█▍        | 55387/371472 [4:24:51<22:50:57,  3.84it/s]
 15%|█▍        | 55388/371472 [4:24:51<22:55:01,  3.83it/s]
 15%|█▍        | 55389/371472 [4:24:52<23:16:06,  3.77it/s]
 15%|█▍        | 55390/371472 [4:24:52<23:33:15,  3.73it/s]
 15%|█▍        | 55391/371472 [4:24:52<24:34:28,  3.57it/s]
 15%|█▍        | 55392/371472 [4:24:53<23:43:17,  3.70it/s]
 15%|█▍        | 55393/371472 [4:24:53<25:28:55,  3.45it/s]
 15%|█▍        | 55394/371472 [4:24:53<29:28:21,  2.98it/s]
 15%|█▍        | 55395/371472 [4:24:54<28:32:01,  3.08it/s]
 15%|█▍        | 55396/371472 [4:24:54<26:31:47,  3.31it/s]
 15%|█▍        | 55397/371472 [4:24:54<26:05:13,  3.37it/s]
 15%|█▍        | 55398/371472 [4:24:54<25:18:08,  3.47it/s]
 15%|█▍        | 55399/371472 [4:24:55<25:47:04,  3.41it/s]
 15%|█▍        | 55400/371472 [4:24:55<24:59:53,  3.51it/s]
                                                           
{'loss': 4.2786, 'learning_rate': 8.66189747678252e-07, 'epoch': 2.39}

 15%|█▍        | 55400/371472 [4:24:55<24:59:53,  3.51it/s]
 15%|█▍        | 55401/371472 [4:24:55<25:36:16,  3.43it/s]
 15%|█▍        | 55402/371472 [4:24:56<26:21:32,  3.33it/s]
 15%|█▍        | 55403/371472 [4:24:56<25:13:22,  3.48it/s]
 15%|█▍        | 55404/371472 [4:24:56<26:17:53,  3.34it/s]
 15%|█▍        | 55405/371472 [4:24:57<25:54:45,  3.39it/s]
 15%|█▍        | 55406/371472 [4:24:57<25:05:58,  3.50it/s]
 15%|█▍        | 55407/371472 [4:24:57<25:08:23,  3.49it/s]
 15%|█▍        | 55408/371472 [4:24:57<24:42:16,  3.55it/s]
 15%|█▍        | 55409/371472 [4:24:58<25:01:24,  3.51it/s]
 15%|█▍        | 55410/371472 [4:24:58<25:39:58,  3.42it/s]
 15%|█▍        | 55411/371472 [4:24:58<25:22:27,  3.46it/s]
 15%|█▍        | 55412/371472 [4:24:59<26:48:46,  3.27it/s]
 15%|█▍        | 55413/371472 [4:24:59<24:58:32,  3.52it/s]
 15%|█▍        | 55414/371472 [4:24:59<24:24:11,  3.60it/s]
 15%|█▍        | 55415/371472 [4:24:59<23:32:35,  3.73it/s]
 15%|█▍        | 55416/371472 [4:25:00<25:37:03,  3.43it/s]
 15%|█▍        | 55417/371472 [4:25:00<24:39:39,  3.56it/s]
 15%|█▍        | 55418/371472 [4:25:00<24:00:34,  3.66it/s]
 15%|█▍        | 55419/371472 [4:25:01<24:47:56,  3.54it/s]
 15%|█▍        | 55420/371472 [4:25:01<24:45:53,  3.55it/s]
                                                           
{'loss': 3.9889, 'learning_rate': 8.661412657027731e-07, 'epoch': 2.39}

 15%|█▍        | 55420/371472 [4:25:01<24:45:53,  3.55it/s]
 15%|█▍        | 55421/371472 [4:25:01<25:18:11,  3.47it/s]
 15%|█▍        | 55422/371472 [4:25:01<24:13:44,  3.62it/s]
 15%|█▍        | 55423/371472 [4:25:02<24:34:11,  3.57it/s]
 15%|█▍        | 55424/371472 [4:25:02<25:12:51,  3.48it/s]
 15%|█▍        | 55425/371472 [4:25:02<26:53:15,  3.27it/s]
 15%|█▍        | 55426/371472 [4:25:03<26:19:50,  3.33it/s]
 15%|█▍        | 55427/371472 [4:25:03<25:23:39,  3.46it/s]
 15%|█▍        | 55428/371472 [4:25:03<28:56:18,  3.03it/s]
 15%|█▍        | 55429/371472 [4:25:03<26:31:39,  3.31it/s]
 15%|█▍        | 55430/371472 [4:25:04<25:10:41,  3.49it/s]
 15%|█▍        | 55431/371472 [4:25:04<25:42:18,  3.42it/s]
 15%|█▍        | 55432/371472 [4:25:04<24:07:32,  3.64it/s]
 15%|█▍        | 55433/371472 [4:25:05<24:58:51,  3.51it/s]
 15%|█▍        | 55434/371472 [4:25:05<24:00:35,  3.66it/s]
 15%|█▍        | 55435/371472 [4:25:05<26:14:22,  3.35it/s]
 15%|█▍        | 55436/371472 [4:25:05<25:34:03,  3.43it/s]
 15%|█▍        | 55437/371472 [4:25:06<24:38:34,  3.56it/s]
 15%|█▍        | 55438/371472 [4:25:06<24:24:35,  3.60it/s]
 15%|█▍        | 55439/371472 [4:25:06<24:33:40,  3.57it/s]
 15%|█▍        | 55440/371472 [4:25:07<25:54:26,  3.39it/s]
                                                           
{'loss': 4.381, 'learning_rate': 8.660927837272943e-07, 'epoch': 2.39}

 15%|█▍        | 55440/371472 [4:25:07<25:54:26,  3.39it/s]
 15%|█▍        | 55441/371472 [4:25:07<25:36:32,  3.43it/s]
 15%|█▍        | 55442/371472 [4:25:07<23:51:59,  3.68it/s]
 15%|█▍        | 55443/371472 [4:25:07<23:10:37,  3.79it/s]
 15%|█▍        | 55444/371472 [4:25:08<24:02:08,  3.65it/s]
 15%|█▍        | 55445/371472 [4:25:08<29:57:09,  2.93it/s]
 15%|█▍        | 55446/371472 [4:25:08<27:18:10,  3.22it/s]
 15%|█▍        | 55447/371472 [4:25:09<26:39:11,  3.29it/s]
 15%|█▍        | 55448/371472 [4:25:09<25:38:09,  3.42it/s]
 15%|█▍        | 55449/371472 [4:25:09<25:09:54,  3.49it/s]
 15%|█▍        | 55450/371472 [4:25:09<24:19:00,  3.61it/s]
 15%|█▍        | 55451/371472 [4:25:10<24:07:26,  3.64it/s]
 15%|█▍        | 55452/371472 [4:25:10<24:24:35,  3.60it/s]
 15%|█▍        | 55453/371472 [4:25:10<24:26:45,  3.59it/s]
 15%|█▍        | 55454/371472 [4:25:11<25:41:47,  3.42it/s]
 15%|█▍        | 55455/371472 [4:25:11<24:26:39,  3.59it/s]
 15%|█▍        | 55456/371472 [4:25:11<24:43:51,  3.55it/s]
 15%|█▍        | 55457/371472 [4:25:11<24:07:26,  3.64it/s]
 15%|█▍        | 55458/371472 [4:25:12<23:55:33,  3.67it/s]
 15%|█▍        | 55459/371472 [4:25:12<25:17:00,  3.47it/s]
 15%|█▍        | 55460/371472 [4:25:12<24:33:42,  3.57it/s]
                                                           
{'loss': 4.3136, 'learning_rate': 8.660443017518154e-07, 'epoch': 2.39}

 15%|█▍        | 55460/371472 [4:25:12<24:33:42,  3.57it/s]
 15%|█▍        | 55461/371472 [4:25:13<24:43:59,  3.55it/s]
 15%|█▍        | 55462/371472 [4:25:13<24:22:54,  3.60it/s]
 15%|█▍        | 55463/371472 [4:25:13<23:24:27,  3.75it/s]
 15%|█▍        | 55464/371472 [4:25:13<22:36:39,  3.88it/s]
 15%|█▍        | 55465/371472 [4:25:14<21:55:22,  4.00it/s]
 15%|█▍        | 55466/371472 [4:25:14<22:10:29,  3.96it/s]
 15%|█▍        | 55467/371472 [4:25:14<22:37:23,  3.88it/s]
 15%|█▍        | 55468/371472 [4:25:14<26:03:09,  3.37it/s]
 15%|█▍        | 55469/371472 [4:25:15<25:20:31,  3.46it/s]
 15%|█▍        | 55470/371472 [4:25:15<25:57:36,  3.38it/s]
 15%|█▍        | 55471/371472 [4:25:15<24:36:57,  3.57it/s]
 15%|█▍        | 55472/371472 [4:25:16<25:31:29,  3.44it/s]
 15%|█▍        | 55473/371472 [4:25:16<28:43:42,  3.06it/s]
 15%|█▍        | 55474/371472 [4:25:16<28:17:22,  3.10it/s]
 15%|█▍        | 55475/371472 [4:25:17<26:32:27,  3.31it/s]
 15%|█▍        | 55476/371472 [4:25:17<24:55:58,  3.52it/s]
 15%|█▍        | 55477/371472 [4:25:17<24:54:55,  3.52it/s]
 15%|█▍        | 55478/371472 [4:25:17<23:52:25,  3.68it/s]
 15%|█▍        | 55479/371472 [4:25:18<24:18:09,  3.61it/s]
 15%|█▍        | 55480/371472 [4:25:18<23:49:34,  3.68it/s]
                                                           
{'loss': 4.1068, 'learning_rate': 8.659958197763364e-07, 'epoch': 2.39}

 15%|█▍        | 55480/371472 [4:25:18<23:49:34,  3.68it/s]
 15%|█▍        | 55481/371472 [4:25:18<23:29:50,  3.74it/s]
 15%|█▍        | 55482/371472 [4:25:18<23:41:16,  3.71it/s]
 15%|█▍        | 55483/371472 [4:25:19<23:57:23,  3.66it/s]
 15%|█▍        | 55484/371472 [4:25:19<23:14:08,  3.78it/s]
 15%|█▍        | 55485/371472 [4:25:19<23:06:41,  3.80it/s]
 15%|█▍        | 55486/371472 [4:25:19<22:27:04,  3.91it/s]
 15%|█▍        | 55487/371472 [4:25:20<22:18:03,  3.94it/s]
 15%|█▍        | 55488/371472 [4:25:20<25:14:59,  3.48it/s]
 15%|█▍        | 55489/371472 [4:25:20<26:18:04,  3.34it/s]
 15%|█▍        | 55490/371472 [4:25:21<26:25:49,  3.32it/s]
 15%|█▍        | 55491/371472 [4:25:21<25:56:10,  3.38it/s]
 15%|█▍        | 55492/371472 [4:25:21<27:04:06,  3.24it/s]
 15%|█▍        | 55493/371472 [4:25:22<25:31:59,  3.44it/s]
 15%|█▍        | 55494/371472 [4:25:22<24:59:54,  3.51it/s]
 15%|█▍        | 55495/371472 [4:25:22<24:17:26,  3.61it/s]
 15%|█▍        | 55496/371472 [4:25:22<24:06:37,  3.64it/s]
 15%|█▍        | 55497/371472 [4:25:23<23:25:33,  3.75it/s]
 15%|█▍        | 55498/371472 [4:25:23<23:39:10,  3.71it/s]
 15%|█▍        | 55499/371472 [4:25:23<23:49:45,  3.68it/s]
 15%|█▍        | 55500/371472 [4:25:23<23:59:09,  3.66it/s]
                                                           
{'loss': 4.2248, 'learning_rate': 8.659473378008575e-07, 'epoch': 2.39}

 15%|█▍        | 55500/371472 [4:25:23<23:59:09,  3.66it/s]
 15%|█▍        | 55501/371472 [4:25:24<24:20:13,  3.61it/s]
 15%|█▍        | 55502/371472 [4:25:24<23:39:59,  3.71it/s]
 15%|█▍        | 55503/371472 [4:25:24<24:02:35,  3.65it/s]
 15%|█▍        | 55504/371472 [4:25:25<24:11:08,  3.63it/s]
 15%|█▍        | 55505/371472 [4:25:25<24:10:58,  3.63it/s]
 15%|█▍        | 55506/371472 [4:25:25<23:59:17,  3.66it/s]
 15%|█▍        | 55507/371472 [4:25:25<25:28:21,  3.45it/s]
 15%|█▍        | 55508/371472 [4:25:26<25:24:59,  3.45it/s]
 15%|█▍        | 55509/371472 [4:25:26<25:55:20,  3.39it/s]
 15%|█▍        | 55510/371472 [4:25:26<26:08:56,  3.36it/s]
 15%|█▍        | 55511/371472 [4:25:27<25:29:38,  3.44it/s]
 15%|█▍        | 55512/371472 [4:25:27<24:40:46,  3.56it/s]
 15%|█▍        | 55513/371472 [4:25:27<23:31:22,  3.73it/s]
 15%|█▍        | 55514/371472 [4:25:27<24:11:14,  3.63it/s]
 15%|█▍        | 55515/371472 [4:25:28<24:32:13,  3.58it/s]
 15%|█▍        | 55516/371472 [4:25:28<25:47:55,  3.40it/s]
 15%|█▍        | 55517/371472 [4:25:28<25:48:15,  3.40it/s]
 15%|█▍        | 55518/371472 [4:25:29<25:05:41,  3.50it/s]
 15%|█▍        | 55519/371472 [4:25:29<25:20:51,  3.46it/s]
 15%|█▍        | 55520/371472 [4:25:29<24:00:58,  3.65it/s]
                                                           
{'loss': 3.9636, 'learning_rate': 8.658988558253787e-07, 'epoch': 2.39}

 15%|█▍        | 55520/371472 [4:25:29<24:00:58,  3.65it/s]
 15%|█▍        | 55521/371472 [4:25:29<23:21:28,  3.76it/s]
 15%|█▍        | 55522/371472 [4:25:30<22:45:48,  3.86it/s]
 15%|█▍        | 55523/371472 [4:25:30<23:05:52,  3.80it/s]
 15%|█▍        | 55524/371472 [4:25:30<24:08:24,  3.64it/s]
 15%|█▍        | 55525/371472 [4:25:30<24:16:11,  3.62it/s]
 15%|█▍        | 55526/371472 [4:25:31<25:21:42,  3.46it/s]
 15%|█▍        | 55527/371472 [4:25:31<23:56:40,  3.67it/s]
 15%|█▍        | 55528/371472 [4:25:31<24:23:16,  3.60it/s]
 15%|█▍        | 55529/371472 [4:25:32<25:05:56,  3.50it/s]
 15%|█▍        | 55530/371472 [4:25:32<24:33:16,  3.57it/s]
 15%|█▍        | 55531/371472 [4:25:32<23:53:20,  3.67it/s]
 15%|█▍        | 55532/371472 [4:25:32<24:08:25,  3.64it/s]
 15%|█▍        | 55533/371472 [4:25:33<23:36:11,  3.72it/s]
 15%|█▍        | 55534/371472 [4:25:33<24:00:58,  3.65it/s]
 15%|█▍        | 55535/371472 [4:25:33<25:54:38,  3.39it/s]
 15%|█▍        | 55536/371472 [4:25:34<25:36:28,  3.43it/s]
 15%|█▍        | 55537/371472 [4:25:34<25:40:49,  3.42it/s]
 15%|█▍        | 55538/371472 [4:25:34<25:38:17,  3.42it/s]
 15%|█▍        | 55539/371472 [4:25:34<26:47:07,  3.28it/s]
 15%|█▍        | 55540/371472 [4:25:35<25:26:46,  3.45it/s]
                                                           
{'loss': 4.3415, 'learning_rate': 8.658503738498997e-07, 'epoch': 2.39}

 15%|█▍        | 55540/371472 [4:25:35<25:26:46,  3.45it/s]
 15%|█▍        | 55541/371472 [4:25:35<26:41:50,  3.29it/s]
 15%|█▍        | 55542/371472 [4:25:35<26:37:27,  3.30it/s]
 15%|█▍        | 55543/371472 [4:25:36<25:17:30,  3.47it/s]
 15%|█▍        | 55544/371472 [4:25:36<24:43:56,  3.55it/s]
 15%|█▍        | 55545/371472 [4:25:36<23:57:27,  3.66it/s]
 15%|█▍        | 55546/371472 [4:25:36<25:29:29,  3.44it/s]
 15%|█▍        | 55547/371472 [4:25:37<24:19:25,  3.61it/s]
 15%|█▍        | 55548/371472 [4:25:37<24:58:35,  3.51it/s]
 15%|█▍        | 55549/371472 [4:25:37<23:35:31,  3.72it/s]
 15%|█▍        | 55550/371472 [4:25:38<25:07:38,  3.49it/s]
 15%|█▍        | 55551/371472 [4:25:38<23:54:32,  3.67it/s]
 15%|█▍        | 55552/371472 [4:25:38<24:32:47,  3.58it/s]
 15%|█▍        | 55553/371472 [4:25:38<24:22:24,  3.60it/s]
 15%|█▍        | 55554/371472 [4:25:39<23:23:20,  3.75it/s]
 15%|█▍        | 55555/371472 [4:25:39<24:19:09,  3.61it/s]
 15%|█▍        | 55556/371472 [4:25:39<23:58:39,  3.66it/s]
 15%|█▍        | 55557/371472 [4:25:39<24:11:40,  3.63it/s]
 15%|█▍        | 55558/371472 [4:25:40<24:14:48,  3.62it/s]
 15%|█▍        | 55559/371472 [4:25:40<23:26:29,  3.74it/s]
 15%|█▍        | 55560/371472 [4:25:40<23:20:20,  3.76it/s]
                                                           
{'loss': 4.2074, 'learning_rate': 8.658018918744207e-07, 'epoch': 2.39}

 15%|█▍        | 55560/371472 [4:25:40<23:20:20,  3.76it/s]
 15%|█▍        | 55561/371472 [4:25:41<25:10:27,  3.49it/s]
 15%|█▍        | 55562/371472 [4:25:41<25:05:44,  3.50it/s]
 15%|█▍        | 55563/371472 [4:25:41<24:39:03,  3.56it/s]
 15%|█▍        | 55564/371472 [4:25:41<24:51:47,  3.53it/s]
 15%|█▍        | 55565/371472 [4:25:42<26:08:38,  3.36it/s]
 15%|█▍        | 55566/371472 [4:25:42<26:04:20,  3.37it/s]
 15%|█▍        | 55567/371472 [4:25:42<25:00:19,  3.51it/s]
 15%|█▍        | 55568/371472 [4:25:43<24:04:21,  3.65it/s]
 15%|█▍        | 55569/371472 [4:25:43<23:53:24,  3.67it/s]
 15%|█▍        | 55570/371472 [4:25:43<24:10:01,  3.63it/s]
 15%|█▍        | 55571/371472 [4:25:43<23:25:20,  3.75it/s]
 15%|█▍        | 55572/371472 [4:25:44<23:19:21,  3.76it/s]
 15%|█▍        | 55573/371472 [4:25:44<24:22:57,  3.60it/s]
 15%|█▍        | 55574/371472 [4:25:44<23:55:49,  3.67it/s]
 15%|█▍        | 55575/371472 [4:25:44<23:30:35,  3.73it/s]
 15%|█▍        | 55576/371472 [4:25:45<23:05:02,  3.80it/s]
 15%|█▍        | 55577/371472 [4:25:45<23:27:02,  3.74it/s]
 15%|█▍        | 55578/371472 [4:25:45<22:59:09,  3.82it/s]
 15%|█▍        | 55579/371472 [4:25:46<23:35:34,  3.72it/s]
 15%|█▍        | 55580/371472 [4:25:46<23:37:16,  3.71it/s]
                                                           
{'loss': 4.472, 'learning_rate': 8.65753409898942e-07, 'epoch': 2.39}

 15%|█▍        | 55580/371472 [4:25:46<23:37:16,  3.71it/s]
 15%|█▍        | 55581/371472 [4:25:46<24:22:00,  3.60it/s]
 15%|█▍        | 55582/371472 [4:25:46<24:12:01,  3.63it/s]
 15%|█▍        | 55583/371472 [4:25:47<23:48:40,  3.69it/s]
 15%|█▍        | 55584/371472 [4:25:47<27:24:00,  3.20it/s]
 15%|█▍        | 55585/371472 [4:25:47<25:28:23,  3.44it/s]
 15%|█▍        | 55586/371472 [4:25:48<25:13:04,  3.48it/s]
 15%|█▍        | 55587/371472 [4:25:48<24:21:50,  3.60it/s]
 15%|█▍        | 55588/371472 [4:25:48<24:13:06,  3.62it/s]
 15%|█▍        | 55589/371472 [4:25:48<24:58:16,  3.51it/s]
 15%|█▍        | 55590/371472 [4:25:49<24:01:12,  3.65it/s]
 15%|█▍        | 55591/371472 [4:25:49<25:30:13,  3.44it/s]
 15%|█▍        | 55592/371472 [4:25:49<25:28:00,  3.45it/s]
 15%|█▍        | 55593/371472 [4:25:50<26:08:45,  3.36it/s]
 15%|█▍        | 55594/371472 [4:25:50<25:15:36,  3.47it/s]
 15%|█▍        | 55595/371472 [4:25:50<25:00:49,  3.51it/s]
 15%|█▍        | 55596/371472 [4:25:50<24:33:09,  3.57it/s]
 15%|█▍        | 55597/371472 [4:25:51<29:12:55,  3.00it/s]
 15%|█▍        | 55598/371472 [4:25:51<28:12:33,  3.11it/s]
 15%|█▍        | 55599/371472 [4:25:51<27:01:21,  3.25it/s]
 15%|█▍        | 55600/371472 [4:25:52<26:42:27,  3.29it/s]
                                                           
{'loss': 4.221, 'learning_rate': 8.657049279234632e-07, 'epoch': 2.39}

 15%|█▍        | 55600/371472 [4:25:52<26:42:27,  3.29it/s]
 15%|█▍        | 55601/371472 [4:25:52<25:12:54,  3.48it/s]
 15%|█▍        | 55602/371472 [4:25:52<24:08:48,  3.63it/s]
 15%|█▍        | 55603/371472 [4:25:52<23:41:36,  3.70it/s]
 15%|█▍        | 55604/371472 [4:25:53<23:30:18,  3.73it/s]
 15%|█▍        | 55605/371472 [4:25:53<23:33:34,  3.72it/s]
 15%|█▍        | 55606/371472 [4:25:53<23:36:01,  3.72it/s]
 15%|█▍        | 55607/371472 [4:25:54<23:46:14,  3.69it/s]
 15%|█▍        | 55608/371472 [4:25:54<24:59:12,  3.51it/s]
 15%|█▍        | 55609/371472 [4:25:54<24:33:30,  3.57it/s]
 15%|█▍        | 55610/371472 [4:25:54<24:02:43,  3.65it/s]
 15%|█▍        | 55611/371472 [4:25:55<24:56:28,  3.52it/s]
 15%|█▍        | 55612/371472 [4:25:55<25:02:17,  3.50it/s]
 15%|█▍        | 55613/371472 [4:25:55<24:19:58,  3.61it/s]
 15%|█▍        | 55614/371472 [4:25:56<25:17:10,  3.47it/s]
 15%|█▍        | 55615/371472 [4:25:56<25:00:11,  3.51it/s]
 15%|█▍        | 55616/371472 [4:25:56<26:20:55,  3.33it/s]
 15%|█▍        | 55617/371472 [4:25:56<25:06:33,  3.49it/s]
 15%|█▍        | 55618/371472 [4:25:57<25:21:55,  3.46it/s]
 15%|█▍        | 55619/371472 [4:25:57<24:51:29,  3.53it/s]
 15%|█▍        | 55620/371472 [4:25:57<25:01:16,  3.51it/s]
                                                           
{'loss': 4.027, 'learning_rate': 8.656564459479841e-07, 'epoch': 2.4}

 15%|█▍        | 55620/371472 [4:25:57<25:01:16,  3.51it/s]
 15%|█▍        | 55621/371472 [4:25:58<24:18:34,  3.61it/s]
 15%|█▍        | 55622/371472 [4:25:58<24:04:58,  3.64it/s]
 15%|█▍        | 55623/371472 [4:25:58<23:23:57,  3.75it/s]
 15%|█▍        | 55624/371472 [4:25:58<24:33:30,  3.57it/s]
 15%|█▍        | 55625/371472 [4:25:59<24:02:26,  3.65it/s]
 15%|█▍        | 55626/371472 [4:25:59<24:07:46,  3.64it/s]
 15%|█▍        | 55627/371472 [4:25:59<23:44:23,  3.70it/s]
 15%|█▍        | 55628/371472 [4:25:59<23:16:31,  3.77it/s]
 15%|█▍        | 55629/371472 [4:26:00<27:02:05,  3.25it/s]
 15%|█▍        | 55630/371472 [4:26:00<25:45:47,  3.41it/s]
 15%|█▍        | 55631/371472 [4:26:00<26:36:52,  3.30it/s]
 15%|█▍        | 55632/371472 [4:26:01<25:31:12,  3.44it/s]
 15%|█▍        | 55633/371472 [4:26:01<24:20:02,  3.61it/s]
 15%|█▍        | 55634/371472 [4:26:01<25:15:57,  3.47it/s]
 15%|█▍        | 55635/371472 [4:26:02<24:48:20,  3.54it/s]
 15%|█▍        | 55636/371472 [4:26:02<26:05:15,  3.36it/s]
 15%|█▍        | 55637/371472 [4:26:02<24:40:17,  3.56it/s]
 15%|█▍        | 55638/371472 [4:26:02<25:07:30,  3.49it/s]
 15%|█▍        | 55639/371472 [4:26:03<24:24:52,  3.59it/s]
 15%|█▍        | 55640/371472 [4:26:03<24:41:06,  3.55it/s]
                                                           
{'loss': 4.1817, 'learning_rate': 8.656079639725052e-07, 'epoch': 2.4}

 15%|█▍        | 55640/371472 [4:26:03<24:41:06,  3.55it/s]
 15%|█▍        | 55641/371472 [4:26:03<24:17:20,  3.61it/s]
 15%|█▍        | 55642/371472 [4:26:03<23:57:51,  3.66it/s]
 15%|█▍        | 55643/371472 [4:26:04<26:06:09,  3.36it/s]
 15%|█▍        | 55644/371472 [4:26:04<25:44:28,  3.41it/s]
 15%|█▍        | 55645/371472 [4:26:04<24:51:09,  3.53it/s]
 15%|█▍        | 55646/371472 [4:26:05<24:59:31,  3.51it/s]
 15%|█▍        | 55647/371472 [4:26:05<24:35:09,  3.57it/s]
 15%|█▍        | 55648/371472 [4:26:05<25:48:06,  3.40it/s]
 15%|█▍        | 55649/371472 [4:26:06<25:21:27,  3.46it/s]
 15%|█▍        | 55650/371472 [4:26:06<25:35:38,  3.43it/s]
 15%|█▍        | 55651/371472 [4:26:06<25:32:19,  3.44it/s]
 15%|█▍        | 55652/371472 [4:26:06<25:40:31,  3.42it/s]
 15%|█▍        | 55653/371472 [4:26:07<26:20:00,  3.33it/s]
 15%|█▍        | 55654/371472 [4:26:07<26:12:57,  3.35it/s]
 15%|█▍        | 55655/371472 [4:26:07<24:41:53,  3.55it/s]
 15%|█▍        | 55656/371472 [4:26:08<23:54:29,  3.67it/s]
 15%|█▍        | 55657/371472 [4:26:08<23:58:43,  3.66it/s]
 15%|█▍        | 55658/371472 [4:26:08<24:46:20,  3.54it/s]
 15%|█▍        | 55659/371472 [4:26:08<24:32:02,  3.58it/s]
 15%|█▍        | 55660/371472 [4:26:09<24:14:41,  3.62it/s]
                                                           
{'loss': 3.85, 'learning_rate': 8.655594819970265e-07, 'epoch': 2.4}

 15%|█▍        | 55660/371472 [4:26:09<24:14:41,  3.62it/s]
 15%|█▍        | 55661/371472 [4:26:09<25:27:16,  3.45it/s]
 15%|█▍        | 55662/371472 [4:26:09<25:59:21,  3.38it/s]
 15%|█▍        | 55663/371472 [4:26:10<25:06:44,  3.49it/s]
 15%|█▍        | 55664/371472 [4:26:10<29:16:04,  3.00it/s]
 15%|█▍        | 55665/371472 [4:26:10<27:45:37,  3.16it/s]
 15%|█▍        | 55666/371472 [4:26:11<27:19:39,  3.21it/s]
 15%|█▍        | 55667/371472 [4:26:11<27:24:13,  3.20it/s]
 15%|█▍        | 55668/371472 [4:26:11<26:31:25,  3.31it/s]
 15%|█▍        | 55669/371472 [4:26:11<26:07:25,  3.36it/s]
 15%|█▍        | 55670/371472 [4:26:12<25:29:55,  3.44it/s]
 15%|█▍        | 55671/371472 [4:26:12<24:43:08,  3.55it/s]
 15%|█▍        | 55672/371472 [4:26:12<24:13:12,  3.62it/s]
 15%|█▍        | 55673/371472 [4:26:12<23:42:43,  3.70it/s]
 15%|█▍        | 55674/371472 [4:26:13<24:34:51,  3.57it/s]
 15%|█▍        | 55675/371472 [4:26:13<28:20:13,  3.10it/s]
 15%|█▍        | 55676/371472 [4:26:13<26:21:02,  3.33it/s]
 15%|█▍        | 55677/371472 [4:26:14<25:05:26,  3.50it/s]
 15%|█▍        | 55678/371472 [4:26:14<26:05:42,  3.36it/s]
 15%|█▍        | 55679/371472 [4:26:14<24:52:35,  3.53it/s]
 15%|█▍        | 55680/371472 [4:26:15<25:00:46,  3.51it/s]
                                                           
{'loss': 4.1537, 'learning_rate': 8.655110000215476e-07, 'epoch': 2.4}

 15%|█▍        | 55680/371472 [4:26:15<25:00:46,  3.51it/s]
 15%|█▍        | 55681/371472 [4:26:15<24:18:06,  3.61it/s]
 15%|█▍        | 55682/371472 [4:26:15<24:27:34,  3.59it/s]
 15%|█▍        | 55683/371472 [4:26:15<24:50:23,  3.53it/s]
 15%|█▍        | 55684/371472 [4:26:16<25:02:08,  3.50it/s]
 15%|█▍        | 55685/371472 [4:26:16<24:29:05,  3.58it/s]
 15%|█▍        | 55686/371472 [4:26:16<24:24:20,  3.59it/s]
 15%|█▍        | 55687/371472 [4:26:17<24:26:09,  3.59it/s]
 15%|█▍        | 55688/371472 [4:26:17<23:32:14,  3.73it/s]
 15%|█▍        | 55689/371472 [4:26:17<26:05:24,  3.36it/s]
 15%|█▍        | 55690/371472 [4:26:17<27:01:55,  3.24it/s]
 15%|█▍        | 55691/371472 [4:26:18<25:28:18,  3.44it/s]
 15%|█▍        | 55692/371472 [4:26:18<24:58:59,  3.51it/s]
 15%|█▍        | 55693/371472 [4:26:18<24:57:47,  3.51it/s]
 15%|█▍        | 55694/371472 [4:26:19<25:04:35,  3.50it/s]
 15%|█▍        | 55695/371472 [4:26:19<24:04:56,  3.64it/s]
 15%|█▍        | 55696/371472 [4:26:19<25:32:00,  3.44it/s]
 15%|█▍        | 55697/371472 [4:26:19<26:12:17,  3.35it/s]
 15%|█▍        | 55698/371472 [4:26:20<24:47:28,  3.54it/s]
 15%|█▍        | 55699/371472 [4:26:20<24:54:35,  3.52it/s]
 15%|█▍        | 55700/371472 [4:26:20<24:38:51,  3.56it/s]
                                                           
{'loss': 4.1673, 'learning_rate': 8.654625180460686e-07, 'epoch': 2.4}

 15%|█▍        | 55700/371472 [4:26:20<24:38:51,  3.56it/s]
 15%|█▍        | 55701/371472 [4:26:21<24:13:15,  3.62it/s]
 15%|█▍        | 55702/371472 [4:26:21<25:19:22,  3.46it/s]
 15%|█▍        | 55703/371472 [4:26:21<24:19:50,  3.61it/s]
 15%|█▍        | 55704/371472 [4:26:21<23:46:05,  3.69it/s]
 15%|█▍        | 55705/371472 [4:26:22<26:22:58,  3.32it/s]
 15%|█▍        | 55706/371472 [4:26:22<25:16:23,  3.47it/s]
 15%|█▍        | 55707/371472 [4:26:22<23:58:30,  3.66it/s]
 15%|█▍        | 55708/371472 [4:26:23<24:28:43,  3.58it/s]
 15%|█▍        | 55709/371472 [4:26:23<25:33:03,  3.43it/s]
 15%|█▍        | 55710/371472 [4:26:23<24:40:31,  3.55it/s]
 15%|█▍        | 55711/371472 [4:26:23<25:14:08,  3.48it/s]
 15%|█▍        | 55712/371472 [4:26:24<25:55:09,  3.38it/s]
 15%|█▍        | 55713/371472 [4:26:24<24:55:32,  3.52it/s]
 15%|█▍        | 55714/371472 [4:26:24<23:38:12,  3.71it/s]
 15%|█▍        | 55715/371472 [4:26:24<24:04:15,  3.64it/s]
 15%|█▍        | 55716/371472 [4:26:25<24:34:09,  3.57it/s]
 15%|█▍        | 55717/371472 [4:26:25<23:55:44,  3.67it/s]
 15%|█▍        | 55718/371472 [4:26:25<23:58:00,  3.66it/s]
 15%|█▍        | 55719/371472 [4:26:26<23:46:30,  3.69it/s]
 15%|█▍        | 55720/371472 [4:26:26<26:59:28,  3.25it/s]
                                                           
{'loss': 4.3035, 'learning_rate': 8.654140360705897e-07, 'epoch': 2.4}

 15%|█▍        | 55720/371472 [4:26:26<26:59:28,  3.25it/s]
 15%|█▌        | 55721/371472 [4:26:26<27:08:39,  3.23it/s]
 15%|█▌        | 55722/371472 [4:26:27<27:58:06,  3.14it/s]
 15%|█▌        | 55723/371472 [4:26:27<26:18:14,  3.33it/s]
 15%|█▌        | 55724/371472 [4:26:27<25:56:27,  3.38it/s]
 15%|█▌        | 55725/371472 [4:26:27<25:19:25,  3.46it/s]
 15%|█▌        | 55726/371472 [4:26:28<26:22:29,  3.33it/s]
 15%|█▌        | 55727/371472 [4:26:28<25:35:32,  3.43it/s]
 15%|█▌        | 55728/371472 [4:26:28<26:22:09,  3.33it/s]
 15%|█▌        | 55729/371472 [4:26:29<26:11:43,  3.35it/s]
 15%|█▌        | 55730/371472 [4:26:29<25:22:20,  3.46it/s]
 15%|█▌        | 55731/371472 [4:26:29<25:36:29,  3.42it/s]
 15%|█▌        | 55732/371472 [4:26:29<24:47:02,  3.54it/s]
 15%|█▌        | 55733/371472 [4:26:30<27:12:42,  3.22it/s]
 15%|█▌        | 55734/371472 [4:26:30<25:35:08,  3.43it/s]
 15%|█▌        | 55735/371472 [4:26:30<25:12:52,  3.48it/s]
 15%|█▌        | 55736/371472 [4:26:31<25:53:32,  3.39it/s]
 15%|█▌        | 55737/371472 [4:26:31<24:11:55,  3.62it/s]
 15%|█▌        | 55738/371472 [4:26:31<24:16:27,  3.61it/s]
 15%|█▌        | 55739/371472 [4:26:31<24:38:51,  3.56it/s]
 15%|█▌        | 55740/371472 [4:26:32<24:44:20,  3.55it/s]
                                                           
{'loss': 4.3662, 'learning_rate': 8.653655540951108e-07, 'epoch': 2.4}

 15%|█▌        | 55740/371472 [4:26:32<24:44:20,  3.55it/s]
 15%|█▌        | 55741/371472 [4:26:32<27:29:34,  3.19it/s]
 15%|█▌        | 55742/371472 [4:26:32<26:33:07,  3.30it/s]
 15%|█▌        | 55743/371472 [4:26:33<24:54:13,  3.52it/s]
 15%|█▌        | 55744/371472 [4:26:33<24:10:15,  3.63it/s]
 15%|█▌        | 55745/371472 [4:26:33<25:31:37,  3.44it/s]
 15%|█▌        | 55746/371472 [4:26:34<24:59:18,  3.51it/s]
 15%|█▌        | 55747/371472 [4:26:34<24:15:43,  3.61it/s]
 15%|█▌        | 55748/371472 [4:26:34<23:58:38,  3.66it/s]
 15%|█▌        | 55749/371472 [4:26:34<25:52:30,  3.39it/s]
 15%|█▌        | 55750/371472 [4:26:35<25:12:24,  3.48it/s]
 15%|█▌        | 55751/371472 [4:26:35<24:25:43,  3.59it/s]
 15%|█▌        | 55752/371472 [4:26:35<23:53:24,  3.67it/s]
 15%|█▌        | 55753/371472 [4:26:35<23:49:39,  3.68it/s]
 15%|█▌        | 55754/371472 [4:26:36<23:14:56,  3.77it/s]
 15%|█▌        | 55755/371472 [4:26:36<25:22:09,  3.46it/s]
 15%|█▌        | 55756/371472 [4:26:36<24:17:38,  3.61it/s]
 15%|█▌        | 55757/371472 [4:26:37<23:43:58,  3.70it/s]
 15%|█▌        | 55758/371472 [4:26:37<23:15:03,  3.77it/s]
 15%|█▌        | 55759/371472 [4:26:37<23:56:54,  3.66it/s]
 15%|█▌        | 55760/371472 [4:26:37<23:23:45,  3.75it/s]
                                                           
{'loss': 4.3216, 'learning_rate': 8.65317072119632e-07, 'epoch': 2.4}

 15%|█▌        | 55760/371472 [4:26:37<23:23:45,  3.75it/s]
 15%|█▌        | 55761/371472 [4:26:38<23:08:43,  3.79it/s]
 15%|█▌        | 55762/371472 [4:26:38<23:39:26,  3.71it/s]
 15%|█▌        | 55763/371472 [4:26:38<23:26:46,  3.74it/s]
 15%|█▌        | 55764/371472 [4:26:38<24:28:38,  3.58it/s]
 15%|█▌        | 55765/371472 [4:26:39<24:49:09,  3.53it/s]
 15%|█▌        | 55766/371472 [4:26:39<24:19:42,  3.60it/s]
 15%|█▌        | 55767/371472 [4:26:39<24:02:13,  3.65it/s]
 15%|█▌        | 55768/371472 [4:26:40<23:00:14,  3.81it/s]
 15%|█▌        | 55769/371472 [4:26:40<23:48:20,  3.68it/s]
 15%|█▌        | 55770/371472 [4:26:40<23:44:22,  3.69it/s]
 15%|█▌        | 55771/371472 [4:26:40<23:12:06,  3.78it/s]
 15%|█▌        | 55772/371472 [4:26:41<22:48:29,  3.84it/s]
 15%|█▌        | 55773/371472 [4:26:41<23:24:18,  3.75it/s]
 15%|█▌        | 55774/371472 [4:26:41<23:58:54,  3.66it/s]
 15%|█▌        | 55775/371472 [4:26:41<24:01:58,  3.65it/s]
 15%|█▌        | 55776/371472 [4:26:42<23:18:17,  3.76it/s]
 15%|█▌        | 55777/371472 [4:26:42<23:27:25,  3.74it/s]
 15%|█▌        | 55778/371472 [4:26:42<25:47:37,  3.40it/s]
 15%|█▌        | 55779/371472 [4:26:43<24:35:47,  3.57it/s]
 15%|█▌        | 55780/371472 [4:26:43<24:18:58,  3.61it/s]
                                                           
{'loss': 4.1805, 'learning_rate': 8.65268590144153e-07, 'epoch': 2.4}

 15%|█▌        | 55780/371472 [4:26:43<24:18:58,  3.61it/s]
 15%|█▌        | 55781/371472 [4:26:43<25:14:44,  3.47it/s]
 15%|█▌        | 55782/371472 [4:26:43<24:20:19,  3.60it/s]
 15%|█▌        | 55783/371472 [4:26:44<23:33:55,  3.72it/s]
 15%|█▌        | 55784/371472 [4:26:44<23:35:51,  3.72it/s]
 15%|█▌        | 55785/371472 [4:26:44<25:12:20,  3.48it/s]
 15%|█▌        | 55786/371472 [4:26:45<26:18:23,  3.33it/s]
 15%|█▌        | 55787/371472 [4:26:45<26:51:53,  3.26it/s]
 15%|█▌        | 55788/371472 [4:26:45<26:09:49,  3.35it/s]
 15%|█▌        | 55789/371472 [4:26:45<25:03:54,  3.50it/s]
 15%|█▌        | 55790/371472 [4:26:46<25:48:08,  3.40it/s]
 15%|█▌        | 55791/371472 [4:26:46<25:36:54,  3.42it/s]
 15%|█▌        | 55792/371472 [4:26:46<24:31:25,  3.58it/s]
 15%|█▌        | 55793/371472 [4:26:47<23:59:26,  3.66it/s]
 15%|█▌        | 55794/371472 [4:26:47<25:02:25,  3.50it/s]
 15%|█▌        | 55795/371472 [4:26:47<24:05:09,  3.64it/s]
 15%|█▌        | 55796/371472 [4:26:47<24:21:30,  3.60it/s]
 15%|█▌        | 55797/371472 [4:26:48<24:10:54,  3.63it/s]
 15%|█▌        | 55798/371472 [4:26:48<24:31:33,  3.58it/s]
 15%|█▌        | 55799/371472 [4:26:48<24:21:38,  3.60it/s]
 15%|█▌        | 55800/371472 [4:26:48<24:00:42,  3.65it/s]
                                                           
{'loss': 4.1321, 'learning_rate': 8.652201081686741e-07, 'epoch': 2.4}

 15%|█▌        | 55800/371472 [4:26:48<24:00:42,  3.65it/s]
 15%|█▌        | 55801/371472 [4:26:49<23:51:52,  3.67it/s]
 15%|█▌        | 55802/371472 [4:26:49<23:50:52,  3.68it/s]
 15%|█▌        | 55803/371472 [4:26:49<24:11:08,  3.63it/s]
 15%|█▌        | 55804/371472 [4:26:50<23:37:54,  3.71it/s]
 15%|█▌        | 55805/371472 [4:26:50<23:31:08,  3.73it/s]
 15%|█▌        | 55806/371472 [4:26:50<23:43:32,  3.70it/s]
 15%|█▌        | 55807/371472 [4:26:50<23:29:34,  3.73it/s]
 15%|█▌        | 55808/371472 [4:26:51<23:36:06,  3.72it/s]
 15%|█▌        | 55809/371472 [4:26:51<23:56:54,  3.66it/s]
 15%|█▌        | 55810/371472 [4:26:51<23:05:22,  3.80it/s]
 15%|█▌        | 55811/371472 [4:26:51<24:08:27,  3.63it/s]
 15%|█▌        | 55812/371472 [4:26:52<25:05:57,  3.49it/s]
 15%|█▌        | 55813/371472 [4:26:52<24:40:16,  3.55it/s]
 15%|█▌        | 55814/371472 [4:26:52<24:06:59,  3.64it/s]
 15%|█▌        | 55815/371472 [4:26:53<23:38:51,  3.71it/s]
 15%|█▌        | 55816/371472 [4:26:53<23:12:14,  3.78it/s]
 15%|█▌        | 55817/371472 [4:26:53<23:09:59,  3.78it/s]
 15%|█▌        | 55818/371472 [4:26:53<23:44:23,  3.69it/s]
 15%|█▌        | 55819/371472 [4:26:54<23:15:28,  3.77it/s]
 15%|█▌        | 55820/371472 [4:26:54<24:16:39,  3.61it/s]
                                                           
{'loss': 4.3409, 'learning_rate': 8.651716261931953e-07, 'epoch': 2.4}

 15%|█▌        | 55820/371472 [4:26:54<24:16:39,  3.61it/s]
 15%|█▌        | 55821/371472 [4:26:54<24:27:16,  3.59it/s]
 15%|█▌        | 55822/371472 [4:26:54<24:02:26,  3.65it/s]
 15%|█▌        | 55823/371472 [4:26:55<23:48:15,  3.68it/s]
 15%|█▌        | 55824/371472 [4:26:55<24:07:41,  3.63it/s]
 15%|█▌        | 55825/371472 [4:26:55<26:27:15,  3.31it/s]
 15%|█▌        | 55826/371472 [4:26:56<25:54:45,  3.38it/s]
 15%|█▌        | 55827/371472 [4:26:56<26:41:29,  3.28it/s]
 15%|█▌        | 55828/371472 [4:26:56<28:37:59,  3.06it/s]
 15%|█▌        | 55829/371472 [4:26:57<26:38:25,  3.29it/s]
 15%|█▌        | 55830/371472 [4:26:57<26:10:35,  3.35it/s]
 15%|█▌        | 55831/371472 [4:26:57<26:24:28,  3.32it/s]
 15%|█▌        | 55832/371472 [4:26:57<25:37:33,  3.42it/s]
 15%|█▌        | 55833/371472 [4:26:58<25:45:51,  3.40it/s]
 15%|█▌        | 55834/371472 [4:26:58<25:51:49,  3.39it/s]
 15%|█▌        | 55835/371472 [4:26:58<25:30:20,  3.44it/s]
 15%|█▌        | 55836/371472 [4:26:59<24:08:54,  3.63it/s]
 15%|█▌        | 55837/371472 [4:26:59<24:14:04,  3.62it/s]
 15%|█▌        | 55838/371472 [4:26:59<23:50:33,  3.68it/s]
 15%|█▌        | 55839/371472 [4:26:59<23:04:15,  3.80it/s]
 15%|█▌        | 55840/371472 [4:27:00<24:50:20,  3.53it/s]
                                                           
{'loss': 4.2178, 'learning_rate': 8.651231442177163e-07, 'epoch': 2.41}

 15%|█▌        | 55840/371472 [4:27:00<24:50:20,  3.53it/s]
 15%|█▌        | 55841/371472 [4:27:00<25:10:42,  3.48it/s]
 15%|█▌        | 55842/371472 [4:27:00<25:28:27,  3.44it/s]
 15%|█▌        | 55843/371472 [4:27:01<24:40:55,  3.55it/s]
 15%|█▌        | 55844/371472 [4:27:01<25:16:53,  3.47it/s]
 15%|█▌        | 55845/371472 [4:27:01<24:52:41,  3.52it/s]
 15%|█▌        | 55846/371472 [4:27:01<24:12:20,  3.62it/s]
 15%|█▌        | 55847/371472 [4:27:02<24:15:01,  3.62it/s]
 15%|█▌        | 55848/371472 [4:27:02<24:00:32,  3.65it/s]
 15%|█▌        | 55849/371472 [4:27:02<23:36:58,  3.71it/s]
 15%|█▌        | 55850/371472 [4:27:02<22:55:31,  3.82it/s]
 15%|█▌        | 55851/371472 [4:27:03<23:12:34,  3.78it/s]
 15%|█▌        | 55852/371472 [4:27:03<22:51:15,  3.84it/s]
 15%|█▌        | 55853/371472 [4:27:03<23:28:54,  3.73it/s]
 15%|█▌        | 55854/371472 [4:27:04<24:06:21,  3.64it/s]
 15%|█▌        | 55855/371472 [4:27:04<23:35:51,  3.72it/s]
 15%|█▌        | 55856/371472 [4:27:04<24:18:10,  3.61it/s]
 15%|█▌        | 55857/371472 [4:27:04<23:54:19,  3.67it/s]
 15%|█▌        | 55858/371472 [4:27:05<23:54:57,  3.67it/s]
 15%|█▌        | 55859/371472 [4:27:05<23:20:12,  3.76it/s]
 15%|█▌        | 55860/371472 [4:27:05<24:37:37,  3.56it/s]
                                                           
{'loss': 4.1659, 'learning_rate': 8.650746622422375e-07, 'epoch': 2.41}

 15%|█▌        | 55860/371472 [4:27:05<24:37:37,  3.56it/s]
 15%|█▌        | 55861/371472 [4:27:06<25:49:27,  3.39it/s]
 15%|█▌        | 55862/371472 [4:27:06<25:25:15,  3.45it/s]
 15%|█▌        | 55863/371472 [4:27:06<24:26:32,  3.59it/s]
 15%|█▌        | 55864/371472 [4:27:06<24:50:33,  3.53it/s]
 15%|█▌        | 55865/371472 [4:27:07<25:36:35,  3.42it/s]
 15%|█▌        | 55866/371472 [4:27:07<25:29:37,  3.44it/s]
 15%|█▌        | 55867/371472 [4:27:07<27:22:11,  3.20it/s]
 15%|█▌        | 55868/371472 [4:27:08<25:38:59,  3.42it/s]
 15%|█▌        | 55869/371472 [4:27:08<26:08:01,  3.35it/s]
 15%|█▌        | 55870/371472 [4:27:08<26:12:21,  3.35it/s]
 15%|█▌        | 55871/371472 [4:27:08<25:10:00,  3.48it/s]
 15%|█▌        | 55872/371472 [4:27:09<24:59:46,  3.51it/s]
 15%|█▌        | 55873/371472 [4:27:09<24:57:02,  3.51it/s]
 15%|█▌        | 55874/371472 [4:27:09<24:59:58,  3.51it/s]
 15%|█▌        | 55875/371472 [4:27:10<24:40:48,  3.55it/s]
 15%|█▌        | 55876/371472 [4:27:10<23:33:44,  3.72it/s]
 15%|█▌        | 55877/371472 [4:27:10<23:49:30,  3.68it/s]
 15%|█▌        | 55878/371472 [4:27:10<23:32:53,  3.72it/s]
 15%|█▌        | 55879/371472 [4:27:11<23:31:22,  3.73it/s]
 15%|█▌        | 55880/371472 [4:27:11<23:38:13,  3.71it/s]
                                                           
{'loss': 3.9914, 'learning_rate': 8.650261802667585e-07, 'epoch': 2.41}

 15%|█▌        | 55880/371472 [4:27:11<23:38:13,  3.71it/s]
 15%|█▌        | 55881/371472 [4:27:11<26:55:43,  3.26it/s]
 15%|█▌        | 55882/371472 [4:27:12<25:57:22,  3.38it/s]
 15%|█▌        | 55883/371472 [4:27:12<26:43:04,  3.28it/s]
 15%|█▌        | 55884/371472 [4:27:12<27:13:30,  3.22it/s]
 15%|█▌        | 55885/371472 [4:27:12<26:22:56,  3.32it/s]
 15%|█▌        | 55886/371472 [4:27:13<26:37:18,  3.29it/s]
 15%|█▌        | 55887/371472 [4:27:13<27:40:19,  3.17it/s]
 15%|█▌        | 55888/371472 [4:27:13<25:44:46,  3.40it/s]
 15%|█▌        | 55889/371472 [4:27:14<27:17:43,  3.21it/s]
 15%|█▌        | 55890/371472 [4:27:14<27:12:26,  3.22it/s]
 15%|█▌        | 55891/371472 [4:27:14<26:33:46,  3.30it/s]
 15%|█▌        | 55892/371472 [4:27:15<25:20:39,  3.46it/s]
 15%|█▌        | 55893/371472 [4:27:15<23:59:24,  3.65it/s]
 15%|█▌        | 55894/371472 [4:27:15<23:31:42,  3.73it/s]
 15%|█▌        | 55895/371472 [4:27:15<25:05:06,  3.49it/s]
 15%|█▌        | 55896/371472 [4:27:16<25:15:17,  3.47it/s]
 15%|█▌        | 55897/371472 [4:27:16<25:49:43,  3.39it/s]
 15%|█▌        | 55898/371472 [4:27:16<24:53:47,  3.52it/s]
 15%|█▌        | 55899/371472 [4:27:17<25:03:22,  3.50it/s]
 15%|█▌        | 55900/371472 [4:27:17<23:55:18,  3.66it/s]
                                                           
{'loss': 4.1824, 'learning_rate': 8.649776982912797e-07, 'epoch': 2.41}

 15%|█▌        | 55900/371472 [4:27:17<23:55:18,  3.66it/s]
 15%|█▌        | 55901/371472 [4:27:17<24:45:04,  3.54it/s]
 15%|█▌        | 55902/371472 [4:27:17<25:20:53,  3.46it/s]
 15%|█▌        | 55903/371472 [4:27:18<27:16:47,  3.21it/s]
 15%|█▌        | 55904/371472 [4:27:18<25:56:40,  3.38it/s]
 15%|█▌        | 55905/371472 [4:27:18<25:12:16,  3.48it/s]
 15%|█▌        | 55906/371472 [4:27:19<24:52:39,  3.52it/s]
 15%|█▌        | 55907/371472 [4:27:19<25:25:49,  3.45it/s]
 15%|█▌        | 55908/371472 [4:27:19<24:41:32,  3.55it/s]
 15%|█▌        | 55909/371472 [4:27:19<23:58:46,  3.66it/s]
 15%|█▌        | 55910/371472 [4:27:20<23:36:09,  3.71it/s]
 15%|█▌        | 55911/371472 [4:27:20<23:52:43,  3.67it/s]
 15%|█▌        | 55912/371472 [4:27:20<23:21:18,  3.75it/s]
 15%|█▌        | 55913/371472 [4:27:20<22:35:55,  3.88it/s]
 15%|█▌        | 55914/371472 [4:27:21<24:58:59,  3.51it/s]
 15%|█▌        | 55915/371472 [4:27:21<23:46:58,  3.69it/s]
 15%|█▌        | 55916/371472 [4:27:21<23:29:47,  3.73it/s]
 15%|█▌        | 55917/371472 [4:27:21<22:41:04,  3.86it/s]
 15%|█▌        | 55918/371472 [4:27:22<23:00:53,  3.81it/s]
 15%|█▌        | 55919/371472 [4:27:22<22:58:07,  3.82it/s]
 15%|█▌        | 55920/371472 [4:27:22<23:19:18,  3.76it/s]
                                                           
{'loss': 4.2067, 'learning_rate': 8.649292163158007e-07, 'epoch': 2.41}

 15%|█▌        | 55920/371472 [4:27:22<23:19:18,  3.76it/s]
 15%|█▌        | 55921/371472 [4:27:23<23:17:08,  3.76it/s]
 15%|█▌        | 55922/371472 [4:27:23<23:19:29,  3.76it/s]
 15%|█▌        | 55923/371472 [4:27:23<24:30:58,  3.58it/s]
 15%|█▌        | 55924/371472 [4:27:23<23:48:06,  3.68it/s]
 15%|█▌        | 55925/371472 [4:27:24<23:17:59,  3.76it/s]
 15%|█▌        | 55926/371472 [4:27:24<23:55:04,  3.66it/s]
 15%|█▌        | 55927/371472 [4:27:24<23:53:55,  3.67it/s]
 15%|█▌        | 55928/371472 [4:27:24<23:41:21,  3.70it/s]
 15%|█▌        | 55929/371472 [4:27:25<24:13:47,  3.62it/s]
 15%|█▌        | 55930/371472 [4:27:25<25:59:41,  3.37it/s]
 15%|█▌        | 55931/371472 [4:27:25<24:56:00,  3.52it/s]
 15%|█▌        | 55932/371472 [4:27:26<24:26:12,  3.59it/s]
 15%|█▌        | 55933/371472 [4:27:26<24:18:45,  3.61it/s]
 15%|█▌        | 55934/371472 [4:27:26<23:54:00,  3.67it/s]
 15%|█▌        | 55935/371472 [4:27:26<23:27:03,  3.74it/s]
 15%|█▌        | 55936/371472 [4:27:27<23:09:48,  3.78it/s]
 15%|█▌        | 55937/371472 [4:27:27<23:48:03,  3.68it/s]
 15%|█▌        | 55938/371472 [4:27:27<23:22:38,  3.75it/s]
 15%|█▌        | 55939/371472 [4:27:27<23:09:15,  3.79it/s]
 15%|█▌        | 55940/371472 [4:27:28<23:18:59,  3.76it/s]
                                                           
{'loss': 4.3716, 'learning_rate': 8.648807343403219e-07, 'epoch': 2.41}

 15%|█▌        | 55940/371472 [4:27:28<23:18:59,  3.76it/s]
 15%|█▌        | 55941/371472 [4:27:28<23:59:59,  3.65it/s]
 15%|█▌        | 55942/371472 [4:27:28<24:14:23,  3.62it/s]
 15%|█▌        | 55943/371472 [4:27:29<27:54:33,  3.14it/s]
 15%|█▌        | 55944/371472 [4:27:29<29:56:38,  2.93it/s]
 15%|█▌        | 55945/371472 [4:27:29<28:46:58,  3.05it/s]
 15%|█▌        | 55946/371472 [4:27:30<28:04:24,  3.12it/s]
 15%|█▌        | 55947/371472 [4:27:30<26:41:09,  3.28it/s]
 15%|█▌        | 55948/371472 [4:27:30<27:34:52,  3.18it/s]
 15%|█▌        | 55949/371472 [4:27:31<26:08:23,  3.35it/s]
 15%|█▌        | 55950/371472 [4:27:31<25:46:14,  3.40it/s]
 15%|█▌        | 55951/371472 [4:27:31<25:02:32,  3.50it/s]
 15%|█▌        | 55952/371472 [4:27:31<24:33:56,  3.57it/s]
 15%|█▌        | 55953/371472 [4:27:32<24:03:42,  3.64it/s]
 15%|█▌        | 55954/371472 [4:27:32<23:19:48,  3.76it/s]
 15%|█▌        | 55955/371472 [4:27:32<23:40:46,  3.70it/s]
 15%|█▌        | 55956/371472 [4:27:32<23:13:37,  3.77it/s]
 15%|█▌        | 55957/371472 [4:27:33<22:42:02,  3.86it/s]
 15%|█▌        | 55958/371472 [4:27:33<22:57:18,  3.82it/s]
 15%|█▌        | 55959/371472 [4:27:33<23:27:06,  3.74it/s]
 15%|█▌        | 55960/371472 [4:27:34<24:39:23,  3.55it/s]
                                                           
{'loss': 4.183, 'learning_rate': 8.64832252364843e-07, 'epoch': 2.41}

 15%|█▌        | 55960/371472 [4:27:34<24:39:23,  3.55it/s]
 15%|█▌        | 55961/371472 [4:27:34<24:55:26,  3.52it/s]
 15%|█▌        | 55962/371472 [4:27:34<24:12:22,  3.62it/s]
 15%|█▌        | 55963/371472 [4:27:34<25:15:09,  3.47it/s]
 15%|█▌        | 55964/371472 [4:27:35<23:57:15,  3.66it/s]
 15%|█▌        | 55965/371472 [4:27:35<24:12:06,  3.62it/s]
 15%|█▌        | 55966/371472 [4:27:35<23:47:42,  3.68it/s]
 15%|█▌        | 55967/371472 [4:27:35<23:45:02,  3.69it/s]
 15%|█▌        | 55968/371472 [4:27:36<24:14:04,  3.62it/s]
 15%|█▌        | 55969/371472 [4:27:36<23:41:40,  3.70it/s]
 15%|█▌        | 55970/371472 [4:27:36<23:28:27,  3.73it/s]
 15%|█▌        | 55971/371472 [4:27:37<23:52:21,  3.67it/s]
 15%|█▌        | 55972/371472 [4:27:37<23:58:39,  3.66it/s]
 15%|█▌        | 55973/371472 [4:27:37<23:34:05,  3.72it/s]
 15%|█▌        | 55974/371472 [4:27:37<24:32:41,  3.57it/s]
 15%|█▌        | 55975/371472 [4:27:38<26:40:19,  3.29it/s]
 15%|█▌        | 55976/371472 [4:27:38<25:50:32,  3.39it/s]
 15%|█▌        | 55977/371472 [4:27:38<25:00:57,  3.50it/s]
 15%|█▌        | 55978/371472 [4:27:39<24:06:38,  3.63it/s]
 15%|█▌        | 55979/371472 [4:27:39<24:19:23,  3.60it/s]
 15%|█▌        | 55980/371472 [4:27:39<29:57:49,  2.92it/s]
                                                           
{'loss': 4.3275, 'learning_rate': 8.647837703893642e-07, 'epoch': 2.41}

 15%|█▌        | 55980/371472 [4:27:39<29:57:49,  2.92it/s]
 15%|█▌        | 55981/371472 [4:27:40<28:21:38,  3.09it/s]
 15%|█▌        | 55982/371472 [4:27:40<28:25:24,  3.08it/s]
 15%|█▌        | 55983/371472 [4:27:40<28:02:37,  3.12it/s]
 15%|█▌        | 55984/371472 [4:27:41<26:57:33,  3.25it/s]
 15%|█▌        | 55985/371472 [4:27:41<29:18:45,  2.99it/s]
 15%|█▌        | 55986/371472 [4:27:41<28:08:59,  3.11it/s]
 15%|█▌        | 55987/371472 [4:27:41<25:43:20,  3.41it/s]
 15%|█▌        | 55988/371472 [4:27:42<26:08:07,  3.35it/s]
 15%|█▌        | 55989/371472 [4:27:42<25:10:44,  3.48it/s]
 15%|█▌        | 55990/371472 [4:27:42<24:04:08,  3.64it/s]
 15%|█▌        | 55991/371472 [4:27:43<24:52:41,  3.52it/s]
 15%|█▌        | 55992/371472 [4:27:43<24:53:54,  3.52it/s]
 15%|█▌        | 55993/371472 [4:27:43<27:39:36,  3.17it/s]
 15%|█▌        | 55994/371472 [4:27:44<27:20:45,  3.20it/s]
 15%|█▌        | 55995/371472 [4:27:44<27:44:30,  3.16it/s]
 15%|█▌        | 55996/371472 [4:27:44<26:02:55,  3.36it/s]
 15%|█▌        | 55997/371472 [4:27:45<29:34:57,  2.96it/s]
 15%|█▌        | 55998/371472 [4:27:45<27:20:05,  3.21it/s]
 15%|█▌        | 55999/371472 [4:27:45<25:33:35,  3.43it/s]
 15%|█▌        | 56000/371472 [4:27:45<24:40:42,  3.55it/s]
                                                           
{'loss': 4.0832, 'learning_rate': 8.647352884138851e-07, 'epoch': 2.41}

 15%|█▌        | 56000/371472 [4:27:45<24:40:42,  3.55it/s]
 15%|█▌        | 56001/371472 [4:27:46<24:32:07,  3.57it/s]
 15%|█▌        | 56002/371472 [4:27:46<23:44:36,  3.69it/s]
 15%|█▌        | 56003/371472 [4:27:46<23:16:42,  3.76it/s]
 15%|█▌        | 56004/371472 [4:27:46<22:18:25,  3.93it/s]
 15%|█▌        | 56005/371472 [4:27:47<22:45:10,  3.85it/s]
 15%|█▌        | 56006/371472 [4:27:47<24:20:18,  3.60it/s]
 15%|█▌        | 56007/371472 [4:27:47<24:04:47,  3.64it/s]
 15%|█▌        | 56008/371472 [4:27:47<24:35:56,  3.56it/s]
 15%|█▌        | 56009/371472 [4:27:48<26:02:56,  3.36it/s]
 15%|█▌        | 56010/371472 [4:27:48<25:54:29,  3.38it/s]
 15%|█▌        | 56011/371472 [4:27:48<25:53:09,  3.39it/s]
 15%|█▌        | 56012/371472 [4:27:49<24:32:11,  3.57it/s]
 15%|█▌        | 56013/371472 [4:27:49<27:15:29,  3.21it/s]
 15%|█▌        | 56014/371472 [4:27:49<26:15:03,  3.34it/s]
 15%|█▌        | 56015/371472 [4:27:50<24:54:21,  3.52it/s]
 15%|█▌        | 56016/371472 [4:27:50<24:40:41,  3.55it/s]
 15%|█▌        | 56017/371472 [4:27:50<23:57:34,  3.66it/s]
 15%|█▌        | 56018/371472 [4:27:50<23:44:43,  3.69it/s]
 15%|█▌        | 56019/371472 [4:27:51<23:42:35,  3.70it/s]
 15%|█▌        | 56020/371472 [4:27:51<23:07:47,  3.79it/s]
                                                           
{'loss': 4.0189, 'learning_rate': 8.646868064384063e-07, 'epoch': 2.41}

 15%|█▌        | 56020/371472 [4:27:51<23:07:47,  3.79it/s]
 15%|█▌        | 56021/371472 [4:27:51<22:50:03,  3.84it/s]
 15%|█▌        | 56022/371472 [4:27:51<23:53:53,  3.67it/s]
 15%|█▌        | 56023/371472 [4:27:52<23:59:24,  3.65it/s]
 15%|█▌        | 56024/371472 [4:27:52<23:31:20,  3.73it/s]
 15%|█▌        | 56025/371472 [4:27:52<25:15:58,  3.47it/s]
 15%|█▌        | 56026/371472 [4:27:53<24:11:31,  3.62it/s]
 15%|█▌        | 56027/371472 [4:27:53<23:31:38,  3.72it/s]
 15%|█▌        | 56028/371472 [4:27:53<24:48:32,  3.53it/s]
 15%|█▌        | 56029/371472 [4:27:53<24:12:13,  3.62it/s]
 15%|█▌        | 56030/371472 [4:27:54<24:07:02,  3.63it/s]
 15%|█▌        | 56031/371472 [4:27:54<24:04:23,  3.64it/s]
 15%|█▌        | 56032/371472 [4:27:54<23:26:37,  3.74it/s]
 15%|█▌        | 56033/371472 [4:27:54<24:56:30,  3.51it/s]
 15%|█▌        | 56034/371472 [4:27:55<23:45:46,  3.69it/s]
 15%|█▌        | 56035/371472 [4:27:55<24:04:48,  3.64it/s]
 15%|█▌        | 56036/371472 [4:27:55<23:43:17,  3.69it/s]
 15%|█▌        | 56037/371472 [4:27:56<23:23:18,  3.75it/s]
 15%|█▌        | 56038/371472 [4:27:56<23:09:40,  3.78it/s]
 15%|█▌        | 56039/371472 [4:27:56<22:54:15,  3.83it/s]
 15%|█▌        | 56040/371472 [4:27:56<23:59:34,  3.65it/s]
                                                           
{'loss': 4.3236, 'learning_rate': 8.646383244629274e-07, 'epoch': 2.41}

 15%|█▌        | 56040/371472 [4:27:56<23:59:34,  3.65it/s]
 15%|█▌        | 56041/371472 [4:27:57<24:00:09,  3.65it/s]
 15%|█▌        | 56042/371472 [4:27:57<23:14:36,  3.77it/s]
 15%|█▌        | 56043/371472 [4:27:57<24:44:29,  3.54it/s]
 15%|█▌        | 56044/371472 [4:27:57<25:09:28,  3.48it/s]
 15%|█▌        | 56045/371472 [4:27:58<25:25:00,  3.45it/s]
 15%|█▌        | 56046/371472 [4:27:58<24:50:53,  3.53it/s]
 15%|█▌        | 56047/371472 [4:27:58<25:04:53,  3.49it/s]
 15%|█▌        | 56048/371472 [4:27:59<24:15:49,  3.61it/s]
 15%|█▌        | 56049/371472 [4:27:59<23:54:44,  3.66it/s]
 15%|█▌        | 56050/371472 [4:27:59<24:08:00,  3.63it/s]
 15%|█▌        | 56051/371472 [4:27:59<23:56:03,  3.66it/s]
 15%|█▌        | 56052/371472 [4:28:00<27:04:23,  3.24it/s]
 15%|█▌        | 56053/371472 [4:28:00<26:47:23,  3.27it/s]
 15%|█▌        | 56054/371472 [4:28:00<26:34:28,  3.30it/s]
 15%|█▌        | 56055/371472 [4:28:01<25:06:52,  3.49it/s]
 15%|█▌        | 56056/371472 [4:28:01<25:14:07,  3.47it/s]
 15%|█▌        | 56057/371472 [4:28:01<24:35:12,  3.56it/s]
 15%|█▌        | 56058/371472 [4:28:01<24:31:13,  3.57it/s]
 15%|█▌        | 56059/371472 [4:28:02<24:06:29,  3.63it/s]
 15%|█▌        | 56060/371472 [4:28:02<24:31:58,  3.57it/s]
                                                           
{'loss': 4.2682, 'learning_rate': 8.645898424874486e-07, 'epoch': 2.41}

 15%|█▌        | 56060/371472 [4:28:02<24:31:58,  3.57it/s]
 15%|█▌        | 56061/371472 [4:28:02<25:08:05,  3.49it/s]
 15%|█▌        | 56062/371472 [4:28:03<24:00:17,  3.65it/s]
 15%|█▌        | 56063/371472 [4:28:03<23:11:28,  3.78it/s]
 15%|█▌        | 56064/371472 [4:28:03<27:04:39,  3.24it/s]
 15%|█▌        | 56065/371472 [4:28:03<25:38:31,  3.42it/s]
 15%|█▌        | 56066/371472 [4:28:04<24:32:28,  3.57it/s]
 15%|█▌        | 56067/371472 [4:28:04<24:51:20,  3.52it/s]
 15%|█▌        | 56068/371472 [4:28:04<24:35:05,  3.56it/s]
 15%|█▌        | 56069/371472 [4:28:05<24:38:08,  3.56it/s]
 15%|█▌        | 56070/371472 [4:28:05<24:09:14,  3.63it/s]
 15%|█▌        | 56071/371472 [4:28:05<25:44:01,  3.40it/s]
 15%|█▌        | 56072/371472 [4:28:05<24:40:17,  3.55it/s]
 15%|█▌        | 56073/371472 [4:28:06<24:04:09,  3.64it/s]
 15%|█▌        | 56074/371472 [4:28:06<25:06:50,  3.49it/s]
 15%|█▌        | 56075/371472 [4:28:06<24:11:53,  3.62it/s]
 15%|█▌        | 56076/371472 [4:28:07<23:32:01,  3.72it/s]
 15%|█▌        | 56077/371472 [4:28:07<24:42:53,  3.54it/s]
 15%|█▌        | 56078/371472 [4:28:07<23:58:27,  3.65it/s]
 15%|█▌        | 56079/371472 [4:28:07<24:19:00,  3.60it/s]
 15%|█▌        | 56080/371472 [4:28:08<24:17:50,  3.61it/s]
                                                           
{'loss': 4.2826, 'learning_rate': 8.645413605119695e-07, 'epoch': 2.42}

 15%|█▌        | 56080/371472 [4:28:08<24:17:50,  3.61it/s]
 15%|█▌        | 56081/371472 [4:28:08<26:03:02,  3.36it/s]
 15%|█▌        | 56082/371472 [4:28:08<25:20:11,  3.46it/s]
 15%|█▌        | 56083/371472 [4:28:09<24:52:35,  3.52it/s]
 15%|█▌        | 56084/371472 [4:28:09<26:12:09,  3.34it/s]
 15%|█▌        | 56085/371472 [4:28:09<26:34:45,  3.30it/s]
 15%|█▌        | 56086/371472 [4:28:09<25:19:26,  3.46it/s]
 15%|█▌        | 56087/371472 [4:28:10<24:37:14,  3.56it/s]
 15%|█▌        | 56088/371472 [4:28:10<23:58:44,  3.65it/s]
 15%|█▌        | 56089/371472 [4:28:10<23:23:13,  3.75it/s]
 15%|█▌        | 56090/371472 [4:28:10<22:59:22,  3.81it/s]
 15%|█▌        | 56091/371472 [4:28:11<23:41:29,  3.70it/s]
 15%|█▌        | 56092/371472 [4:28:11<24:01:47,  3.65it/s]
 15%|█▌        | 56093/371472 [4:28:11<23:41:12,  3.70it/s]
 15%|█▌        | 56094/371472 [4:28:12<24:15:23,  3.61it/s]
 15%|█▌        | 56095/371472 [4:28:12<25:10:54,  3.48it/s]
 15%|█▌        | 56096/371472 [4:28:12<27:11:58,  3.22it/s]
 15%|█▌        | 56097/371472 [4:28:13<25:45:03,  3.40it/s]
 15%|█▌        | 56098/371472 [4:28:13<28:14:46,  3.10it/s]
 15%|█▌        | 56099/371472 [4:28:13<27:16:24,  3.21it/s]
 15%|█▌        | 56100/371472 [4:28:13<26:24:09,  3.32it/s]
                                                           
{'loss': 4.0921, 'learning_rate': 8.644928785364907e-07, 'epoch': 2.42}

 15%|█▌        | 56100/371472 [4:28:13<26:24:09,  3.32it/s]
 15%|█▌        | 56101/371472 [4:28:14<26:09:49,  3.35it/s]
 15%|█▌        | 56102/371472 [4:28:14<25:55:35,  3.38it/s]
 15%|█▌        | 56103/371472 [4:28:14<24:52:14,  3.52it/s]
 15%|█▌        | 56104/371472 [4:28:15<26:10:34,  3.35it/s]
 15%|█▌        | 56105/371472 [4:28:15<25:20:20,  3.46it/s]
 15%|█▌        | 56106/371472 [4:28:15<26:04:25,  3.36it/s]
 15%|█▌        | 56107/371472 [4:28:15<25:38:18,  3.42it/s]
 15%|█▌        | 56108/371472 [4:28:16<25:28:37,  3.44it/s]
 15%|█▌        | 56109/371472 [4:28:16<24:40:47,  3.55it/s]
 15%|█▌        | 56110/371472 [4:28:16<24:27:06,  3.58it/s]
 15%|█▌        | 56111/371472 [4:28:17<24:09:07,  3.63it/s]
 15%|█▌        | 56112/371472 [4:28:17<23:56:23,  3.66it/s]
 15%|█▌        | 56113/371472 [4:28:17<23:04:16,  3.80it/s]
 15%|█▌        | 56114/371472 [4:28:17<22:53:26,  3.83it/s]
 15%|█▌        | 56115/371472 [4:28:18<23:49:17,  3.68it/s]
 15%|█▌        | 56116/371472 [4:28:18<24:20:33,  3.60it/s]
 15%|█▌        | 56117/371472 [4:28:18<28:15:10,  3.10it/s]
 15%|█▌        | 56118/371472 [4:28:19<26:33:22,  3.30it/s]
 15%|█▌        | 56119/371472 [4:28:19<26:13:13,  3.34it/s]
 15%|█▌        | 56120/371472 [4:28:19<25:59:45,  3.37it/s]
                                                           
{'loss': 4.0919, 'learning_rate': 8.644443965610118e-07, 'epoch': 2.42}

 15%|█▌        | 56120/371472 [4:28:19<25:59:45,  3.37it/s]
 15%|█▌        | 56121/371472 [4:28:19<25:19:45,  3.46it/s]
 15%|█▌        | 56122/371472 [4:28:20<24:56:51,  3.51it/s]
 15%|█▌        | 56123/371472 [4:28:20<24:25:57,  3.59it/s]
 15%|█▌        | 56124/371472 [4:28:20<24:44:56,  3.54it/s]
 15%|█▌        | 56125/371472 [4:28:21<25:16:40,  3.47it/s]
 15%|█▌        | 56126/371472 [4:28:21<24:52:21,  3.52it/s]
 15%|█▌        | 56127/371472 [4:28:21<24:04:00,  3.64it/s]
 15%|█▌        | 56128/371472 [4:28:21<24:04:35,  3.64it/s]
 15%|█▌        | 56129/371472 [4:28:22<23:58:10,  3.65it/s]
 15%|█▌        | 56130/371472 [4:28:22<23:33:47,  3.72it/s]
 15%|█▌        | 56131/371472 [4:28:22<23:36:11,  3.71it/s]
 15%|█▌        | 56132/371472 [4:28:22<23:46:40,  3.68it/s]
 15%|█▌        | 56133/371472 [4:28:23<28:10:40,  3.11it/s]
 15%|█▌        | 56134/371472 [4:28:23<26:15:44,  3.34it/s]
 15%|█▌        | 56135/371472 [4:28:23<26:20:51,  3.32it/s]
 15%|█▌        | 56136/371472 [4:28:24<27:52:55,  3.14it/s]
 15%|█▌        | 56137/371472 [4:28:24<27:11:46,  3.22it/s]
 15%|█▌        | 56138/371472 [4:28:24<25:32:03,  3.43it/s]
 15%|█▌        | 56139/371472 [4:28:25<24:23:59,  3.59it/s]
 15%|█▌        | 56140/371472 [4:28:25<28:39:54,  3.06it/s]
                                                           
{'loss': 3.8716, 'learning_rate': 8.64395914585533e-07, 'epoch': 2.42}

 15%|█▌        | 56140/371472 [4:28:25<28:39:54,  3.06it/s]
 15%|█▌        | 56141/371472 [4:28:25<28:28:30,  3.08it/s]
 15%|█▌        | 56142/371472 [4:28:26<26:12:57,  3.34it/s]
 15%|█▌        | 56143/371472 [4:28:26<24:55:54,  3.51it/s]
 15%|█▌        | 56144/371472 [4:28:26<24:34:58,  3.56it/s]
 15%|█▌        | 56145/371472 [4:28:26<24:01:52,  3.64it/s]
 15%|█▌        | 56146/371472 [4:28:27<24:46:44,  3.53it/s]
 15%|█▌        | 56147/371472 [4:28:27<24:29:50,  3.58it/s]
 15%|█▌        | 56148/371472 [4:28:27<24:58:00,  3.51it/s]
 15%|█▌        | 56149/371472 [4:28:28<25:16:57,  3.46it/s]
 15%|█▌        | 56150/371472 [4:28:28<25:08:03,  3.48it/s]
 15%|█▌        | 56151/371472 [4:28:28<24:11:10,  3.62it/s]
 15%|█▌        | 56152/371472 [4:28:28<24:43:58,  3.54it/s]
 15%|█▌        | 56153/371472 [4:28:29<23:41:57,  3.70it/s]
 15%|█▌        | 56154/371472 [4:28:29<23:25:26,  3.74it/s]
 15%|█▌        | 56155/371472 [4:28:29<23:24:36,  3.74it/s]
 15%|█▌        | 56156/371472 [4:28:30<25:01:16,  3.50it/s]
 15%|█▌        | 56157/371472 [4:28:30<24:51:04,  3.52it/s]
 15%|█▌        | 56158/371472 [4:28:30<24:04:05,  3.64it/s]
 15%|█▌        | 56159/371472 [4:28:30<23:43:31,  3.69it/s]
 15%|█▌        | 56160/371472 [4:28:31<23:53:17,  3.67it/s]
                                                           
{'loss': 4.2843, 'learning_rate': 8.64347432610054e-07, 'epoch': 2.42}

 15%|█▌        | 56160/371472 [4:28:31<23:53:17,  3.67it/s]
 15%|█▌        | 56161/371472 [4:28:31<24:14:19,  3.61it/s]
 15%|█▌        | 56162/371472 [4:28:31<23:38:23,  3.71it/s]
 15%|█▌        | 56163/371472 [4:28:31<26:09:03,  3.35it/s]
 15%|█▌        | 56164/371472 [4:28:32<24:36:22,  3.56it/s]
 15%|█▌        | 56165/371472 [4:28:32<24:14:47,  3.61it/s]
 15%|█▌        | 56166/371472 [4:28:32<23:04:40,  3.80it/s]
 15%|█▌        | 56167/371472 [4:28:33<24:52:07,  3.52it/s]
 15%|█▌        | 56168/371472 [4:28:33<25:06:21,  3.49it/s]
 15%|█▌        | 56169/371472 [4:28:33<26:35:00,  3.29it/s]
 15%|█▌        | 56170/371472 [4:28:33<26:01:06,  3.37it/s]
 15%|█▌        | 56171/371472 [4:28:34<24:32:07,  3.57it/s]
 15%|█▌        | 56172/371472 [4:28:34<24:59:45,  3.50it/s]
 15%|█▌        | 56173/371472 [4:28:34<25:14:50,  3.47it/s]
 15%|█▌        | 56174/371472 [4:28:35<25:03:16,  3.50it/s]
 15%|█▌        | 56175/371472 [4:28:35<24:51:27,  3.52it/s]
 15%|█▌        | 56176/371472 [4:28:35<23:41:30,  3.70it/s]
 15%|█▌        | 56177/371472 [4:28:35<23:04:40,  3.80it/s]
 15%|█▌        | 56178/371472 [4:28:36<23:19:27,  3.75it/s]
 15%|█▌        | 56179/371472 [4:28:36<24:08:20,  3.63it/s]
 15%|█▌        | 56180/371472 [4:28:36<24:13:17,  3.62it/s]
                                                           
{'loss': 4.3531, 'learning_rate': 8.642989506345751e-07, 'epoch': 2.42}

 15%|█▌        | 56180/371472 [4:28:36<24:13:17,  3.62it/s]
 15%|█▌        | 56181/371472 [4:28:36<24:16:10,  3.61it/s]
 15%|█▌        | 56182/371472 [4:28:37<24:59:10,  3.51it/s]
 15%|█▌        | 56183/371472 [4:28:37<25:07:53,  3.48it/s]
 15%|█▌        | 56184/371472 [4:28:37<24:41:34,  3.55it/s]
 15%|█▌        | 56185/371472 [4:28:38<25:02:25,  3.50it/s]
 15%|█▌        | 56186/371472 [4:28:38<24:20:26,  3.60it/s]
 15%|█▌        | 56187/371472 [4:28:38<24:10:30,  3.62it/s]
 15%|█▌        | 56188/371472 [4:28:38<24:47:30,  3.53it/s]
 15%|█▌        | 56189/371472 [4:28:39<24:06:01,  3.63it/s]
 15%|█▌        | 56190/371472 [4:28:39<23:35:14,  3.71it/s]
 15%|█▌        | 56191/371472 [4:28:39<23:24:45,  3.74it/s]
 15%|█▌        | 56192/371472 [4:28:40<24:15:13,  3.61it/s]
 15%|█▌        | 56193/371472 [4:28:40<22:53:40,  3.83it/s]
 15%|█▌        | 56194/371472 [4:28:40<24:08:04,  3.63it/s]
 15%|█▌        | 56195/371472 [4:28:40<26:31:36,  3.30it/s]
 15%|█▌        | 56196/371472 [4:28:41<24:49:06,  3.53it/s]
 15%|█▌        | 56197/371472 [4:28:41<25:13:04,  3.47it/s]
 15%|█▌        | 56198/371472 [4:28:41<25:22:46,  3.45it/s]
 15%|█▌        | 56199/371472 [4:28:42<24:33:06,  3.57it/s]
 15%|█▌        | 56200/371472 [4:28:42<24:40:16,  3.55it/s]
                                                           
{'loss': 3.9195, 'learning_rate': 8.642504686590963e-07, 'epoch': 2.42}

 15%|█▌        | 56200/371472 [4:28:42<24:40:16,  3.55it/s]
 15%|█▌        | 56201/371472 [4:28:42<25:09:13,  3.48it/s]
 15%|█▌        | 56202/371472 [4:28:42<25:02:17,  3.50it/s]
 15%|█▌        | 56203/371472 [4:28:43<25:21:41,  3.45it/s]
 15%|█▌        | 56204/371472 [4:28:43<25:25:37,  3.44it/s]
 15%|█▌        | 56205/371472 [4:28:43<25:19:18,  3.46it/s]
 15%|█▌        | 56206/371472 [4:28:44<24:29:33,  3.58it/s]
 15%|█▌        | 56207/371472 [4:28:44<24:51:51,  3.52it/s]
 15%|█▌        | 56208/371472 [4:28:44<24:50:34,  3.53it/s]
 15%|█▌        | 56209/371472 [4:28:44<25:30:39,  3.43it/s]
 15%|█▌        | 56210/371472 [4:28:45<24:44:26,  3.54it/s]
 15%|█▌        | 56211/371472 [4:28:45<23:29:59,  3.73it/s]
 15%|█▌        | 56212/371472 [4:28:45<24:23:14,  3.59it/s]
 15%|█▌        | 56213/371472 [4:28:45<23:24:26,  3.74it/s]
 15%|█▌        | 56214/371472 [4:28:46<23:56:22,  3.66it/s]
 15%|█▌        | 56215/371472 [4:28:46<23:30:15,  3.73it/s]
 15%|█▌        | 56216/371472 [4:28:46<23:08:52,  3.78it/s]
 15%|█▌        | 56217/371472 [4:28:47<22:38:41,  3.87it/s]
 15%|█▌        | 56218/371472 [4:28:47<24:48:26,  3.53it/s]
 15%|█▌        | 56219/371472 [4:28:47<28:41:33,  3.05it/s]
 15%|█▌        | 56220/371472 [4:28:48<27:14:28,  3.21it/s]
                                                           
{'loss': 4.4277, 'learning_rate': 8.642019866836174e-07, 'epoch': 2.42}

 15%|█▌        | 56220/371472 [4:28:48<27:14:28,  3.21it/s]
 15%|█▌        | 56221/371472 [4:28:48<26:27:18,  3.31it/s]
 15%|█▌        | 56222/371472 [4:28:48<24:55:03,  3.51it/s]
 15%|█▌        | 56223/371472 [4:28:48<24:18:05,  3.60it/s]
 15%|█▌        | 56224/371472 [4:28:49<23:25:13,  3.74it/s]
 15%|█▌        | 56225/371472 [4:28:49<23:23:50,  3.74it/s]
 15%|█▌        | 56226/371472 [4:28:49<22:48:32,  3.84it/s]
 15%|█▌        | 56227/371472 [4:28:49<22:08:56,  3.95it/s]
 15%|█▌        | 56228/371472 [4:28:50<22:46:33,  3.84it/s]
 15%|█▌        | 56229/371472 [4:28:50<22:55:15,  3.82it/s]
 15%|█▌        | 56230/371472 [4:28:50<23:12:21,  3.77it/s]
 15%|█▌        | 56231/371472 [4:28:50<23:29:06,  3.73it/s]
 15%|█▌        | 56232/371472 [4:28:51<23:02:05,  3.80it/s]
 15%|█▌        | 56233/371472 [4:28:51<24:16:51,  3.61it/s]
 15%|█▌        | 56234/371472 [4:28:51<24:16:38,  3.61it/s]
 15%|█▌        | 56235/371472 [4:28:52<24:44:21,  3.54it/s]
 15%|█▌        | 56236/371472 [4:28:52<24:58:50,  3.51it/s]
 15%|█▌        | 56237/371472 [4:28:52<24:36:18,  3.56it/s]
 15%|█▌        | 56238/371472 [4:28:52<24:22:23,  3.59it/s]
 15%|█▌        | 56239/371472 [4:28:53<24:53:29,  3.52it/s]
 15%|█▌        | 56240/371472 [4:28:53<24:45:32,  3.54it/s]
                                                           
{'loss': 4.2536, 'learning_rate': 8.641535047081385e-07, 'epoch': 2.42}

 15%|█▌        | 56240/371472 [4:28:53<24:45:32,  3.54it/s]
 15%|█▌        | 56241/371472 [4:28:53<24:37:17,  3.56it/s]
 15%|█▌        | 56242/371472 [4:28:54<24:11:07,  3.62it/s]
 15%|█▌        | 56243/371472 [4:28:54<23:44:47,  3.69it/s]
 15%|█▌        | 56244/371472 [4:28:54<26:00:27,  3.37it/s]
 15%|█▌        | 56245/371472 [4:28:55<28:19:36,  3.09it/s]
 15%|█▌        | 56246/371472 [4:28:55<28:21:26,  3.09it/s]
 15%|█▌        | 56247/371472 [4:28:55<27:40:47,  3.16it/s]
 15%|█▌        | 56248/371472 [4:28:55<26:26:11,  3.31it/s]
 15%|█▌        | 56249/371472 [4:28:56<26:48:47,  3.27it/s]
 15%|█▌        | 56250/371472 [4:28:56<26:27:24,  3.31it/s]
 15%|█▌        | 56251/371472 [4:28:56<25:09:02,  3.48it/s]
 15%|█▌        | 56252/371472 [4:28:57<25:56:56,  3.37it/s]
 15%|█▌        | 56253/371472 [4:28:57<25:58:42,  3.37it/s]
 15%|█▌        | 56254/371472 [4:28:57<25:03:44,  3.49it/s]
 15%|█▌        | 56255/371472 [4:28:57<24:03:09,  3.64it/s]
 15%|█▌        | 56256/371472 [4:28:58<24:18:59,  3.60it/s]
 15%|█▌        | 56257/371472 [4:28:58<29:52:00,  2.93it/s]
 15%|█▌        | 56258/371472 [4:28:58<29:11:07,  3.00it/s]
 15%|█▌        | 56259/371472 [4:28:59<27:56:54,  3.13it/s]
 15%|█▌        | 56260/371472 [4:28:59<27:54:04,  3.14it/s]
                                                           
{'loss': 4.2423, 'learning_rate': 8.641050227326595e-07, 'epoch': 2.42}

 15%|█▌        | 56260/371472 [4:28:59<27:54:04,  3.14it/s]
 15%|█▌        | 56261/371472 [4:28:59<26:43:41,  3.28it/s]
 15%|█▌        | 56262/371472 [4:29:00<25:58:49,  3.37it/s]
 15%|█▌        | 56263/371472 [4:29:00<25:47:46,  3.39it/s]
 15%|█▌        | 56264/371472 [4:29:00<25:41:58,  3.41it/s]
 15%|█▌        | 56265/371472 [4:29:01<26:00:35,  3.37it/s]
 15%|█▌        | 56266/371472 [4:29:01<25:19:39,  3.46it/s]
 15%|█▌        | 56267/371472 [4:29:01<27:11:51,  3.22it/s]
 15%|█▌        | 56268/371472 [4:29:01<25:55:15,  3.38it/s]
 15%|█▌        | 56269/371472 [4:29:02<26:53:41,  3.26it/s]
 15%|█▌        | 56270/371472 [4:29:02<26:16:19,  3.33it/s]
 15%|█▌        | 56271/371472 [4:29:02<25:11:42,  3.48it/s]
 15%|█▌        | 56272/371472 [4:29:03<24:34:24,  3.56it/s]
 15%|█▌        | 56273/371472 [4:29:03<24:02:56,  3.64it/s]
 15%|█▌        | 56274/371472 [4:29:03<24:20:40,  3.60it/s]
 15%|█▌        | 56275/371472 [4:29:03<24:17:40,  3.60it/s]
 15%|█▌        | 56276/371472 [4:29:04<23:53:16,  3.67it/s]
 15%|█▌        | 56277/371472 [4:29:04<24:55:50,  3.51it/s]
 15%|█▌        | 56278/371472 [4:29:04<24:01:24,  3.64it/s]
 15%|█▌        | 56279/371472 [4:29:05<25:27:35,  3.44it/s]
 15%|█▌        | 56280/371472 [4:29:05<24:49:06,  3.53it/s]
                                                           
{'loss': 4.4274, 'learning_rate': 8.640565407571807e-07, 'epoch': 2.42}

 15%|█▌        | 56280/371472 [4:29:05<24:49:06,  3.53it/s]
 15%|█▌        | 56281/371472 [4:29:05<25:32:33,  3.43it/s]
 15%|█▌        | 56282/371472 [4:29:05<26:58:32,  3.25it/s]
 15%|█▌        | 56283/371472 [4:29:06<28:25:21,  3.08it/s]
 15%|█▌        | 56284/371472 [4:29:06<27:10:45,  3.22it/s]
 15%|█▌        | 56285/371472 [4:29:06<26:12:56,  3.34it/s]
 15%|█▌        | 56286/371472 [4:29:07<25:02:47,  3.50it/s]
 15%|█▌        | 56287/371472 [4:29:07<24:50:14,  3.52it/s]
 15%|█▌        | 56288/371472 [4:29:07<24:42:48,  3.54it/s]
 15%|█▌        | 56289/371472 [4:29:07<24:36:25,  3.56it/s]
 15%|█▌        | 56290/371472 [4:29:08<24:17:24,  3.60it/s]
 15%|█▌        | 56291/371472 [4:29:08<23:45:57,  3.68it/s]
 15%|█▌        | 56292/371472 [4:29:08<23:59:55,  3.65it/s]
 15%|█▌        | 56293/371472 [4:29:09<23:56:40,  3.66it/s]
 15%|█▌        | 56294/371472 [4:29:09<23:26:50,  3.73it/s]
 15%|█▌        | 56295/371472 [4:29:09<22:29:15,  3.89it/s]
 15%|█▌        | 56296/371472 [4:29:09<21:51:05,  4.01it/s]
 15%|█▌        | 56297/371472 [4:29:10<22:11:36,  3.94it/s]
 15%|█▌        | 56298/371472 [4:29:10<22:13:07,  3.94it/s]
 15%|█▌        | 56299/371472 [4:29:10<23:03:28,  3.80it/s]
 15%|█▌        | 56300/371472 [4:29:10<24:56:51,  3.51it/s]
                                                           
{'loss': 4.3172, 'learning_rate': 8.640080587817018e-07, 'epoch': 2.42}

 15%|█▌        | 56300/371472 [4:29:10<24:56:51,  3.51it/s]
 15%|█▌        | 56301/371472 [4:29:11<24:30:39,  3.57it/s]
 15%|█▌        | 56302/371472 [4:29:11<24:26:48,  3.58it/s]
 15%|█▌        | 56303/371472 [4:29:11<25:10:03,  3.48it/s]
 15%|█▌        | 56304/371472 [4:29:12<25:53:56,  3.38it/s]
 15%|█▌        | 56305/371472 [4:29:12<24:09:49,  3.62it/s]
 15%|█▌        | 56306/371472 [4:29:12<25:26:23,  3.44it/s]
 15%|█▌        | 56307/371472 [4:29:12<24:35:53,  3.56it/s]
 15%|█▌        | 56308/371472 [4:29:13<24:25:43,  3.58it/s]
 15%|█▌        | 56309/371472 [4:29:13<25:16:20,  3.46it/s]
 15%|█▌        | 56310/371472 [4:29:13<25:22:53,  3.45it/s]
 15%|█▌        | 56311/371472 [4:29:14<29:24:08,  2.98it/s]
 15%|█▌        | 56312/371472 [4:29:14<27:20:56,  3.20it/s]
 15%|█▌        | 56313/371472 [4:29:14<27:59:56,  3.13it/s]
 15%|█▌        | 56314/371472 [4:29:15<26:58:51,  3.24it/s]
 15%|█▌        | 56315/371472 [4:29:15<27:29:21,  3.18it/s]
 15%|█▌        | 56316/371472 [4:29:15<25:58:00,  3.37it/s]
 15%|█▌        | 56317/371472 [4:29:15<26:00:05,  3.37it/s]
 15%|█▌        | 56318/371472 [4:29:16<25:40:28,  3.41it/s]
 15%|█▌        | 56319/371472 [4:29:16<25:58:40,  3.37it/s]
 15%|█▌        | 56320/371472 [4:29:16<25:29:49,  3.43it/s]
                                                           
{'loss': 4.1643, 'learning_rate': 8.639595768062229e-07, 'epoch': 2.43}

 15%|█▌        | 56320/371472 [4:29:16<25:29:49,  3.43it/s]
 15%|█▌        | 56321/371472 [4:29:17<25:51:06,  3.39it/s]
 15%|█▌        | 56322/371472 [4:29:17<25:24:04,  3.45it/s]
 15%|█▌        | 56323/371472 [4:29:17<24:23:11,  3.59it/s]
 15%|█▌        | 56324/371472 [4:29:17<25:25:28,  3.44it/s]
 15%|█▌        | 56325/371472 [4:29:18<24:57:14,  3.51it/s]
 15%|█▌        | 56326/371472 [4:29:18<25:43:48,  3.40it/s]
 15%|█▌        | 56327/371472 [4:29:18<25:17:40,  3.46it/s]
 15%|█▌        | 56328/371472 [4:29:19<23:54:00,  3.66it/s]
 15%|█▌        | 56329/371472 [4:29:19<23:51:00,  3.67it/s]
 15%|█▌        | 56330/371472 [4:29:19<23:50:20,  3.67it/s]
 15%|█▌        | 56331/371472 [4:29:19<23:44:37,  3.69it/s]
 15%|█▌        | 56332/371472 [4:29:20<23:28:06,  3.73it/s]
 15%|█▌        | 56333/371472 [4:29:20<24:00:39,  3.65it/s]
 15%|█▌        | 56334/371472 [4:29:20<24:38:48,  3.55it/s]
 15%|█▌        | 56335/371472 [4:29:20<24:07:50,  3.63it/s]
 15%|█▌        | 56336/371472 [4:29:21<24:37:18,  3.56it/s]
 15%|█▌        | 56337/371472 [4:29:21<23:41:52,  3.69it/s]
 15%|█▌        | 56338/371472 [4:29:21<23:24:43,  3.74it/s]
 15%|█▌        | 56339/371472 [4:29:22<23:40:27,  3.70it/s]
 15%|█▌        | 56340/371472 [4:29:22<23:33:22,  3.72it/s]
                                                           
{'loss': 4.1716, 'learning_rate': 8.63911094830744e-07, 'epoch': 2.43}

 15%|█▌        | 56340/371472 [4:29:22<23:33:22,  3.72it/s]
 15%|█▌        | 56341/371472 [4:29:22<24:22:12,  3.59it/s]
 15%|█▌        | 56342/371472 [4:29:22<24:33:50,  3.56it/s]
 15%|█▌        | 56343/371472 [4:29:23<23:29:34,  3.73it/s]
 15%|█▌        | 56344/371472 [4:29:23<23:14:25,  3.77it/s]
 15%|█▌        | 56345/371472 [4:29:23<22:34:10,  3.88it/s]
 15%|█▌        | 56346/371472 [4:29:23<22:53:41,  3.82it/s]
 15%|█▌        | 56347/371472 [4:29:24<23:03:41,  3.80it/s]
 15%|█▌        | 56348/371472 [4:29:24<23:10:09,  3.78it/s]
 15%|█▌        | 56349/371472 [4:29:24<23:30:12,  3.72it/s]
 15%|█▌        | 56350/371472 [4:29:25<23:42:39,  3.69it/s]
 15%|█▌        | 56351/371472 [4:29:25<23:24:17,  3.74it/s]
 15%|█▌        | 56352/371472 [4:29:25<24:36:26,  3.56it/s]
 15%|█▌        | 56353/371472 [4:29:25<24:05:48,  3.63it/s]
 15%|█▌        | 56354/371472 [4:29:26<23:21:07,  3.75it/s]
 15%|█▌        | 56355/371472 [4:29:26<23:31:15,  3.72it/s]
 15%|█▌        | 56356/371472 [4:29:26<22:53:42,  3.82it/s]
 15%|█▌        | 56357/371472 [4:29:26<23:38:45,  3.70it/s]
 15%|█▌        | 56358/371472 [4:29:27<25:17:36,  3.46it/s]
 15%|█▌        | 56359/371472 [4:29:27<26:27:08,  3.31it/s]
 15%|█▌        | 56360/371472 [4:29:27<25:30:18,  3.43it/s]
                                                           
{'loss': 4.2735, 'learning_rate': 8.638626128552652e-07, 'epoch': 2.43}

 15%|█▌        | 56360/371472 [4:29:27<25:30:18,  3.43it/s]
 15%|█▌        | 56361/371472 [4:29:28<24:52:56,  3.52it/s]
 15%|█▌        | 56362/371472 [4:29:28<26:27:01,  3.31it/s]
 15%|█▌        | 56363/371472 [4:29:28<25:44:12,  3.40it/s]
 15%|█▌        | 56364/371472 [4:29:29<27:42:03,  3.16it/s]
 15%|█▌        | 56365/371472 [4:29:29<26:34:56,  3.29it/s]
 15%|█▌        | 56366/371472 [4:29:29<26:33:35,  3.30it/s]
 15%|█▌        | 56367/371472 [4:29:29<25:02:47,  3.49it/s]
 15%|█▌        | 56368/371472 [4:29:30<24:49:00,  3.53it/s]
 15%|█▌        | 56369/371472 [4:29:30<24:21:46,  3.59it/s]
 15%|█▌        | 56370/371472 [4:29:30<24:17:01,  3.60it/s]
 15%|█▌        | 56371/371472 [4:29:31<26:22:30,  3.32it/s]
 15%|█▌        | 56372/371472 [4:29:31<25:18:01,  3.46it/s]
 15%|█▌        | 56373/371472 [4:29:31<26:11:47,  3.34it/s]
 15%|█▌        | 56374/371472 [4:29:31<25:07:51,  3.48it/s]
 15%|█▌        | 56375/371472 [4:29:32<25:11:15,  3.47it/s]
 15%|█▌        | 56376/371472 [4:29:32<25:02:34,  3.50it/s]
 15%|█▌        | 56377/371472 [4:29:32<24:01:17,  3.64it/s]
 15%|█▌        | 56378/371472 [4:29:33<23:28:06,  3.73it/s]
 15%|█▌        | 56379/371472 [4:29:33<24:50:48,  3.52it/s]
 15%|█▌        | 56380/371472 [4:29:33<24:03:01,  3.64it/s]
                                                           
{'loss': 4.2517, 'learning_rate': 8.638141308797861e-07, 'epoch': 2.43}

 15%|█▌        | 56380/371472 [4:29:33<24:03:01,  3.64it/s]
 15%|█▌        | 56381/371472 [4:29:33<24:06:30,  3.63it/s]
 15%|█▌        | 56382/371472 [4:29:34<25:39:54,  3.41it/s]
 15%|█▌        | 56383/371472 [4:29:34<25:06:24,  3.49it/s]
 15%|█▌        | 56384/371472 [4:29:34<25:53:24,  3.38it/s]
 15%|█▌        | 56385/371472 [4:29:35<26:26:21,  3.31it/s]
 15%|█▌        | 56386/371472 [4:29:35<28:45:23,  3.04it/s]
 15%|█▌        | 56387/371472 [4:29:35<26:53:46,  3.25it/s]
 15%|█▌        | 56388/371472 [4:29:36<26:05:41,  3.35it/s]
 15%|█▌        | 56389/371472 [4:29:36<26:13:38,  3.34it/s]
 15%|█▌        | 56390/371472 [4:29:36<25:07:32,  3.48it/s]
 15%|█▌        | 56391/371472 [4:29:36<24:25:45,  3.58it/s]
 15%|█▌        | 56392/371472 [4:29:37<24:23:46,  3.59it/s]
 15%|█▌        | 56393/371472 [4:29:37<24:11:31,  3.62it/s]
 15%|█▌        | 56394/371472 [4:29:37<23:44:31,  3.69it/s]
 15%|█▌        | 56395/371472 [4:29:37<24:18:35,  3.60it/s]
 15%|█▌        | 56396/371472 [4:29:38<23:30:21,  3.72it/s]
 15%|█▌        | 56397/371472 [4:29:38<26:08:26,  3.35it/s]
 15%|█▌        | 56398/371472 [4:29:38<25:48:59,  3.39it/s]
 15%|█▌        | 56399/371472 [4:29:39<25:58:37,  3.37it/s]
 15%|█▌        | 56400/371472 [4:29:39<24:51:50,  3.52it/s]
                                                           
{'loss': 4.2051, 'learning_rate': 8.637656489043073e-07, 'epoch': 2.43}

 15%|█▌        | 56400/371472 [4:29:39<24:51:50,  3.52it/s]
 15%|█▌        | 56401/371472 [4:29:39<24:39:55,  3.55it/s]
 15%|█▌        | 56402/371472 [4:29:39<24:21:57,  3.59it/s]
 15%|█▌        | 56403/371472 [4:29:40<23:45:42,  3.68it/s]
 15%|█▌        | 56404/371472 [4:29:40<23:37:50,  3.70it/s]
 15%|█▌        | 56405/371472 [4:29:40<23:29:39,  3.73it/s]
 15%|█▌        | 56406/371472 [4:29:41<24:31:09,  3.57it/s]
 15%|█▌        | 56407/371472 [4:29:41<24:32:02,  3.57it/s]
 15%|█▌        | 56408/371472 [4:29:41<24:25:26,  3.58it/s]
 15%|█▌        | 56409/371472 [4:29:41<24:10:32,  3.62it/s]
 15%|█▌        | 56410/371472 [4:29:42<23:28:38,  3.73it/s]
 15%|█▌        | 56411/371472 [4:29:42<24:36:28,  3.56it/s]
 15%|█▌        | 56412/371472 [4:29:42<23:33:03,  3.72it/s]
 15%|█▌        | 56413/371472 [4:29:42<23:31:11,  3.72it/s]
 15%|█▌        | 56414/371472 [4:29:43<22:55:49,  3.82it/s]
 15%|█▌        | 56415/371472 [4:29:43<23:26:56,  3.73it/s]
 15%|█▌        | 56416/371472 [4:29:43<23:32:25,  3.72it/s]
 15%|█▌        | 56417/371472 [4:29:44<24:26:12,  3.58it/s]
 15%|█▌        | 56418/371472 [4:29:44<23:36:40,  3.71it/s]
 15%|█▌        | 56419/371472 [4:29:44<23:13:53,  3.77it/s]
 15%|█▌        | 56420/371472 [4:29:44<22:32:32,  3.88it/s]
                                                           
{'loss': 4.1685, 'learning_rate': 8.637171669288284e-07, 'epoch': 2.43}

 15%|█▌        | 56420/371472 [4:29:44<22:32:32,  3.88it/s]
 15%|█▌        | 56421/371472 [4:29:45<22:08:47,  3.95it/s]
 15%|█▌        | 56422/371472 [4:29:45<24:00:50,  3.64it/s]
 15%|█▌        | 56423/371472 [4:29:45<24:10:55,  3.62it/s]
 15%|█▌        | 56424/371472 [4:29:45<23:35:14,  3.71it/s]
 15%|█▌        | 56425/371472 [4:29:46<23:30:23,  3.72it/s]
 15%|█▌        | 56426/371472 [4:29:46<23:13:06,  3.77it/s]
 15%|█▌        | 56427/371472 [4:29:46<23:23:14,  3.74it/s]
 15%|█▌        | 56428/371472 [4:29:46<23:46:12,  3.68it/s]
 15%|█▌        | 56429/371472 [4:29:47<24:15:24,  3.61it/s]
 15%|█▌        | 56430/371472 [4:29:47<25:08:33,  3.48it/s]
 15%|█▌        | 56431/371472 [4:29:47<23:57:17,  3.65it/s]
 15%|█▌        | 56432/371472 [4:29:48<24:03:39,  3.64it/s]
 15%|█▌        | 56433/371472 [4:29:48<23:13:35,  3.77it/s]
 15%|█▌        | 56434/371472 [4:29:48<23:18:48,  3.75it/s]
 15%|█▌        | 56435/371472 [4:29:48<25:59:14,  3.37it/s]
 15%|█▌        | 56436/371472 [4:29:49<25:26:40,  3.44it/s]
 15%|█▌        | 56437/371472 [4:29:49<24:52:07,  3.52it/s]
 15%|█▌        | 56438/371472 [4:29:49<24:12:36,  3.61it/s]
 15%|█▌        | 56439/371472 [4:29:50<24:45:21,  3.53it/s]
 15%|█▌        | 56440/371472 [4:29:50<24:34:55,  3.56it/s]
                                                           
{'loss': 4.0869, 'learning_rate': 8.636686849533496e-07, 'epoch': 2.43}

 15%|█▌        | 56440/371472 [4:29:50<24:34:55,  3.56it/s]
 15%|█▌        | 56441/371472 [4:29:50<23:28:03,  3.73it/s]
 15%|█▌        | 56442/371472 [4:29:50<23:54:03,  3.66it/s]
 15%|█▌        | 56443/371472 [4:29:51<24:02:36,  3.64it/s]
 15%|█▌        | 56444/371472 [4:29:51<23:12:47,  3.77it/s]
 15%|█▌        | 56445/371472 [4:29:51<23:47:16,  3.68it/s]
 15%|█▌        | 56446/371472 [4:29:51<23:18:49,  3.75it/s]
 15%|█▌        | 56447/371472 [4:29:52<22:22:30,  3.91it/s]
 15%|█▌        | 56448/371472 [4:29:52<22:53:44,  3.82it/s]
 15%|█▌        | 56449/371472 [4:29:52<23:43:56,  3.69it/s]
 15%|█▌        | 56450/371472 [4:29:52<23:01:25,  3.80it/s]
 15%|█▌        | 56451/371472 [4:29:53<25:32:49,  3.43it/s]
 15%|█▌        | 56452/371472 [4:29:53<24:24:45,  3.58it/s]
 15%|█▌        | 56453/371472 [4:29:53<26:59:21,  3.24it/s]
 15%|█▌        | 56454/371472 [4:29:54<25:11:16,  3.47it/s]
 15%|█▌        | 56455/371472 [4:29:54<23:56:06,  3.66it/s]
 15%|█▌        | 56456/371472 [4:29:54<23:32:16,  3.72it/s]
 15%|█▌        | 56457/371472 [4:29:55<24:34:59,  3.56it/s]
 15%|█▌        | 56458/371472 [4:29:55<26:56:17,  3.25it/s]
 15%|█▌        | 56459/371472 [4:29:55<26:14:58,  3.33it/s]
 15%|█▌        | 56460/371472 [4:29:55<25:19:26,  3.46it/s]
                                                           
{'loss': 4.0233, 'learning_rate': 8.636202029778706e-07, 'epoch': 2.43}

 15%|█▌        | 56460/371472 [4:29:55<25:19:26,  3.46it/s]
 15%|█▌        | 56461/371472 [4:29:56<24:01:12,  3.64it/s]
 15%|█▌        | 56462/371472 [4:29:56<24:05:21,  3.63it/s]
 15%|█▌        | 56463/371472 [4:29:56<24:59:42,  3.50it/s]
 15%|█▌        | 56464/371472 [4:29:57<24:28:13,  3.58it/s]
 15%|█▌        | 56465/371472 [4:29:57<23:36:16,  3.71it/s]
 15%|█▌        | 56466/371472 [4:29:57<23:53:57,  3.66it/s]
 15%|█▌        | 56467/371472 [4:29:57<23:13:17,  3.77it/s]
 15%|█▌        | 56468/371472 [4:29:58<25:08:23,  3.48it/s]
 15%|█▌        | 56469/371472 [4:29:58<24:37:34,  3.55it/s]
 15%|█▌        | 56470/371472 [4:29:58<24:28:49,  3.57it/s]
 15%|█▌        | 56471/371472 [4:29:59<25:57:30,  3.37it/s]
 15%|█▌        | 56472/371472 [4:29:59<26:21:45,  3.32it/s]
 15%|█▌        | 56473/371472 [4:29:59<25:31:37,  3.43it/s]
 15%|█▌        | 56474/371472 [4:29:59<25:08:03,  3.48it/s]
 15%|█▌        | 56475/371472 [4:30:00<24:39:54,  3.55it/s]
 15%|█▌        | 56476/371472 [4:30:00<24:28:28,  3.58it/s]
 15%|█▌        | 56477/371472 [4:30:00<24:12:59,  3.61it/s]
 15%|█▌        | 56478/371472 [4:30:00<23:54:41,  3.66it/s]
 15%|█▌        | 56479/371472 [4:30:01<23:16:13,  3.76it/s]
 15%|█▌        | 56480/371472 [4:30:01<23:26:21,  3.73it/s]
                                                           
{'loss': 4.2422, 'learning_rate': 8.635717210023918e-07, 'epoch': 2.43}

 15%|█▌        | 56480/371472 [4:30:01<23:26:21,  3.73it/s]
 15%|█▌        | 56481/371472 [4:30:01<23:00:44,  3.80it/s]
 15%|█▌        | 56482/371472 [4:30:01<23:33:22,  3.71it/s]
 15%|█▌        | 56483/371472 [4:30:02<23:36:11,  3.71it/s]
 15%|█▌        | 56484/371472 [4:30:02<23:48:35,  3.67it/s]
 15%|█▌        | 56485/371472 [4:30:02<22:57:52,  3.81it/s]
 15%|█▌        | 56486/371472 [4:30:03<22:35:05,  3.87it/s]
 15%|█▌        | 56487/371472 [4:30:03<22:40:50,  3.86it/s]
 15%|█▌        | 56488/371472 [4:30:03<22:20:05,  3.92it/s]
 15%|█▌        | 56489/371472 [4:30:03<26:21:11,  3.32it/s]
 15%|█▌        | 56490/371472 [4:30:04<25:54:48,  3.38it/s]
 15%|█▌        | 56491/371472 [4:30:04<25:20:06,  3.45it/s]
 15%|█▌        | 56492/371472 [4:30:04<24:29:55,  3.57it/s]
 15%|█▌        | 56493/371472 [4:30:05<24:18:39,  3.60it/s]
 15%|█▌        | 56494/371472 [4:30:05<23:26:54,  3.73it/s]
 15%|█▌        | 56495/371472 [4:30:05<24:02:41,  3.64it/s]
 15%|█▌        | 56496/371472 [4:30:05<23:50:11,  3.67it/s]
 15%|█▌        | 56497/371472 [4:30:06<26:42:17,  3.28it/s]
 15%|█▌        | 56498/371472 [4:30:06<25:36:22,  3.42it/s]
 15%|█▌        | 56499/371472 [4:30:06<24:20:53,  3.59it/s]
 15%|█▌        | 56500/371472 [4:30:07<25:55:09,  3.38it/s]
                                                           
{'loss': 4.2122, 'learning_rate': 8.635232390269128e-07, 'epoch': 2.43}

 15%|█▌        | 56500/371472 [4:30:07<25:55:09,  3.38it/s]
 15%|█▌        | 56501/371472 [4:30:07<25:15:56,  3.46it/s]
 15%|█▌        | 56502/371472 [4:30:07<25:03:14,  3.49it/s]
 15%|█▌        | 56503/371472 [4:30:07<24:32:31,  3.56it/s]
 15%|█▌        | 56504/371472 [4:30:08<24:18:39,  3.60it/s]
 15%|█▌        | 56505/371472 [4:30:08<24:53:34,  3.51it/s]
 15%|█▌        | 56506/371472 [4:30:08<25:25:44,  3.44it/s]
 15%|█▌        | 56507/371472 [4:30:09<24:51:23,  3.52it/s]
 15%|█▌        | 56508/371472 [4:30:09<24:57:53,  3.50it/s]
 15%|█▌        | 56509/371472 [4:30:09<24:02:36,  3.64it/s]
 15%|█▌        | 56510/371472 [4:30:09<25:39:35,  3.41it/s]
 15%|█▌        | 56511/371472 [4:30:10<27:59:31,  3.13it/s]
 15%|█▌        | 56512/371472 [4:30:10<28:13:35,  3.10it/s]
 15%|█▌        | 56513/371472 [4:30:10<26:48:01,  3.26it/s]
 15%|█▌        | 56514/371472 [4:30:11<27:22:04,  3.20it/s]
 15%|█▌        | 56515/371472 [4:30:11<27:42:12,  3.16it/s]
 15%|█▌        | 56516/371472 [4:30:11<26:56:38,  3.25it/s]
 15%|█▌        | 56517/371472 [4:30:12<25:27:22,  3.44it/s]
 15%|█▌        | 56518/371472 [4:30:12<26:24:18,  3.31it/s]
 15%|█▌        | 56519/371472 [4:30:12<25:17:38,  3.46it/s]
 15%|█▌        | 56520/371472 [4:30:12<25:07:39,  3.48it/s]
                                                           
{'loss': 4.0499, 'learning_rate': 8.634747570514339e-07, 'epoch': 2.43}

 15%|█▌        | 56520/371472 [4:30:12<25:07:39,  3.48it/s]
 15%|█▌        | 56521/371472 [4:30:13<24:27:30,  3.58it/s]
 15%|█▌        | 56522/371472 [4:30:13<25:45:44,  3.40it/s]
 15%|█▌        | 56523/371472 [4:30:13<28:31:47,  3.07it/s]
 15%|█▌        | 56524/371472 [4:30:14<27:04:03,  3.23it/s]
 15%|█▌        | 56525/371472 [4:30:14<25:46:34,  3.39it/s]
 15%|█▌        | 56526/371472 [4:30:14<24:48:18,  3.53it/s]
 15%|█▌        | 56527/371472 [4:30:14<24:11:39,  3.62it/s]
 15%|█▌        | 56528/371472 [4:30:15<24:17:30,  3.60it/s]
 15%|█▌        | 56529/371472 [4:30:15<25:29:09,  3.43it/s]
 15%|█▌        | 56530/371472 [4:30:15<24:59:15,  3.50it/s]
 15%|█▌        | 56531/371472 [4:30:16<25:29:13,  3.43it/s]
 15%|█▌        | 56532/371472 [4:30:16<26:08:08,  3.35it/s]
 15%|█▌        | 56533/371472 [4:30:16<24:58:08,  3.50it/s]
 15%|█▌        | 56534/371472 [4:30:17<24:57:42,  3.50it/s]
 15%|█▌        | 56535/371472 [4:30:17<24:31:06,  3.57it/s]
 15%|█▌        | 56536/371472 [4:30:17<23:39:50,  3.70it/s]
 15%|█▌        | 56537/371472 [4:30:17<23:00:49,  3.80it/s]
 15%|█▌        | 56538/371472 [4:30:18<23:58:13,  3.65it/s]
 15%|█▌        | 56539/371472 [4:30:18<24:48:21,  3.53it/s]
 15%|█▌        | 56540/371472 [4:30:18<25:33:34,  3.42it/s]
                                                           
{'loss': 4.3853, 'learning_rate': 8.63426275075955e-07, 'epoch': 2.44}

 15%|█▌        | 56540/371472 [4:30:18<25:33:34,  3.42it/s]
 15%|█▌        | 56541/371472 [4:30:19<26:36:09,  3.29it/s]
 15%|█▌        | 56542/371472 [4:30:19<25:27:22,  3.44it/s]
 15%|█▌        | 56543/371472 [4:30:19<25:43:20,  3.40it/s]
 15%|█▌        | 56544/371472 [4:30:19<24:51:26,  3.52it/s]
 15%|█▌        | 56545/371472 [4:30:20<23:54:41,  3.66it/s]
 15%|█▌        | 56546/371472 [4:30:20<24:13:30,  3.61it/s]
 15%|█▌        | 56547/371472 [4:30:20<23:50:46,  3.67it/s]
 15%|█▌        | 56548/371472 [4:30:21<27:42:47,  3.16it/s]
 15%|█▌        | 56549/371472 [4:30:21<28:45:10,  3.04it/s]
 15%|█▌        | 56550/371472 [4:30:21<27:07:26,  3.23it/s]
 15%|█▌        | 56551/371472 [4:30:21<25:39:53,  3.41it/s]
 15%|█▌        | 56552/371472 [4:30:22<24:48:42,  3.53it/s]
 15%|█▌        | 56553/371472 [4:30:22<25:18:28,  3.46it/s]
 15%|█▌        | 56554/371472 [4:30:22<24:51:45,  3.52it/s]
 15%|█▌        | 56555/371472 [4:30:23<26:45:31,  3.27it/s]
 15%|█▌        | 56556/371472 [4:30:23<25:04:15,  3.49it/s]
 15%|█▌        | 56557/371472 [4:30:23<24:22:52,  3.59it/s]
 15%|█▌        | 56558/371472 [4:30:23<24:47:53,  3.53it/s]
 15%|█▌        | 56559/371472 [4:30:24<25:02:54,  3.49it/s]
 15%|█▌        | 56560/371472 [4:30:24<27:18:03,  3.20it/s]
                                                           
{'loss': 4.4201, 'learning_rate': 8.633777931004762e-07, 'epoch': 2.44}

 15%|█▌        | 56560/371472 [4:30:24<27:18:03,  3.20it/s]
 15%|█▌        | 56561/371472 [4:30:24<27:52:09,  3.14it/s]
 15%|█▌        | 56562/371472 [4:30:25<28:01:32,  3.12it/s]
 15%|█▌        | 56563/371472 [4:30:25<28:08:31,  3.11it/s]
 15%|█▌        | 56564/371472 [4:30:25<27:25:48,  3.19it/s]
 15%|█▌        | 56565/371472 [4:30:26<26:09:46,  3.34it/s]
 15%|█▌        | 56566/371472 [4:30:26<25:30:42,  3.43it/s]
 15%|█▌        | 56567/371472 [4:30:26<24:53:44,  3.51it/s]
 15%|█▌        | 56568/371472 [4:30:27<26:28:49,  3.30it/s]
 15%|█▌        | 56569/371472 [4:30:27<24:49:11,  3.52it/s]
 15%|█▌        | 56570/371472 [4:30:27<24:15:18,  3.61it/s]
 15%|█▌        | 56571/371472 [4:30:27<25:16:59,  3.46it/s]
 15%|█▌        | 56572/371472 [4:30:28<24:12:45,  3.61it/s]
 15%|█▌        | 56573/371472 [4:30:28<26:25:47,  3.31it/s]
 15%|█▌        | 56574/371472 [4:30:28<27:44:40,  3.15it/s]
 15%|█▌        | 56575/371472 [4:30:29<26:07:43,  3.35it/s]
 15%|█▌        | 56576/371472 [4:30:29<25:37:07,  3.41it/s]
 15%|█▌        | 56577/371472 [4:30:29<24:35:30,  3.56it/s]
 15%|█▌        | 56578/371472 [4:30:29<24:17:21,  3.60it/s]
 15%|█▌        | 56579/371472 [4:30:30<23:44:14,  3.68it/s]
 15%|█▌        | 56580/371472 [4:30:30<23:50:13,  3.67it/s]
                                                           
{'loss': 4.1895, 'learning_rate': 8.633293111249973e-07, 'epoch': 2.44}

 15%|█▌        | 56580/371472 [4:30:30<23:50:13,  3.67it/s]
 15%|█▌        | 56581/371472 [4:30:30<25:55:16,  3.37it/s]
 15%|█▌        | 56582/371472 [4:30:31<25:14:33,  3.47it/s]
 15%|█▌        | 56583/371472 [4:30:31<24:05:35,  3.63it/s]
 15%|█▌        | 56584/371472 [4:30:31<23:37:31,  3.70it/s]
 15%|█▌        | 56585/371472 [4:30:31<23:58:34,  3.65it/s]
 15%|█▌        | 56586/371472 [4:30:32<23:33:52,  3.71it/s]
 15%|█▌        | 56587/371472 [4:30:32<24:09:16,  3.62it/s]
 15%|█▌        | 56588/371472 [4:30:32<24:00:31,  3.64it/s]
 15%|█▌        | 56589/371472 [4:30:32<24:13:28,  3.61it/s]
 15%|█▌        | 56590/371472 [4:30:33<23:13:34,  3.77it/s]
 15%|█▌        | 56591/371472 [4:30:33<24:18:04,  3.60it/s]
 15%|█▌        | 56592/371472 [4:30:33<23:58:47,  3.65it/s]
 15%|█▌        | 56593/371472 [4:30:34<25:29:02,  3.43it/s]
 15%|█▌        | 56594/371472 [4:30:34<24:46:33,  3.53it/s]
 15%|█▌        | 56595/371472 [4:30:34<24:33:41,  3.56it/s]
 15%|█▌        | 56596/371472 [4:30:34<27:28:47,  3.18it/s]
 15%|█▌        | 56597/371472 [4:30:35<27:48:17,  3.15it/s]
 15%|█▌        | 56598/371472 [4:30:35<26:13:47,  3.33it/s]
 15%|█▌        | 56599/371472 [4:30:36<29:28:27,  2.97it/s]
 15%|█▌        | 56600/371472 [4:30:36<27:08:17,  3.22it/s]
                                                           
{'loss': 4.3688, 'learning_rate': 8.632808291495185e-07, 'epoch': 2.44}

 15%|█▌        | 56600/371472 [4:30:36<27:08:17,  3.22it/s]
 15%|█▌        | 56601/371472 [4:30:36<25:54:27,  3.38it/s]
 15%|█▌        | 56602/371472 [4:30:36<24:50:11,  3.52it/s]
 15%|█▌        | 56603/371472 [4:30:37<23:52:53,  3.66it/s]
 15%|█▌        | 56604/371472 [4:30:37<22:52:53,  3.82it/s]
 15%|█▌        | 56605/371472 [4:30:37<22:26:07,  3.90it/s]
 15%|█▌        | 56606/371472 [4:30:37<22:05:00,  3.96it/s]
 15%|█▌        | 56607/371472 [4:30:38<23:57:13,  3.65it/s]
 15%|█▌        | 56608/371472 [4:30:38<24:15:59,  3.60it/s]
 15%|█▌        | 56609/371472 [4:30:38<24:18:53,  3.60it/s]
 15%|█▌        | 56610/371472 [4:30:38<24:03:28,  3.64it/s]
 15%|█▌        | 56611/371472 [4:30:39<25:21:51,  3.45it/s]
 15%|█▌        | 56612/371472 [4:30:39<24:48:54,  3.52it/s]
 15%|█▌        | 56613/371472 [4:30:39<25:12:11,  3.47it/s]
 15%|█▌        | 56614/371472 [4:30:40<25:55:24,  3.37it/s]
 15%|█▌        | 56615/371472 [4:30:40<24:57:38,  3.50it/s]
 15%|█▌        | 56616/371472 [4:30:40<24:24:42,  3.58it/s]
 15%|█▌        | 56617/371472 [4:30:40<24:48:17,  3.53it/s]
 15%|█▌        | 56618/371472 [4:30:41<23:53:11,  3.66it/s]
 15%|█▌        | 56619/371472 [4:30:41<23:55:48,  3.65it/s]
 15%|█▌        | 56620/371472 [4:30:41<23:32:17,  3.72it/s]
                                                           
{'loss': 4.3445, 'learning_rate': 8.632323471740395e-07, 'epoch': 2.44}

 15%|█▌        | 56620/371472 [4:30:41<23:32:17,  3.72it/s]
 15%|█▌        | 56621/371472 [4:30:41<23:54:49,  3.66it/s]
 15%|█▌        | 56622/371472 [4:30:42<23:54:38,  3.66it/s]
 15%|█▌        | 56623/371472 [4:30:42<24:45:31,  3.53it/s]
 15%|█▌        | 56624/371472 [4:30:42<26:12:25,  3.34it/s]
 15%|█▌        | 56625/371472 [4:30:43<26:00:10,  3.36it/s]
 15%|█▌        | 56626/371472 [4:30:43<24:19:57,  3.59it/s]
 15%|█▌        | 56627/371472 [4:30:43<24:55:35,  3.51it/s]
 15%|█▌        | 56628/371472 [4:30:44<24:45:43,  3.53it/s]
 15%|█▌        | 56629/371472 [4:30:44<24:15:48,  3.60it/s]
 15%|█▌        | 56630/371472 [4:30:44<23:54:16,  3.66it/s]
 15%|█▌        | 56631/371472 [4:30:44<24:08:37,  3.62it/s]
 15%|█▌        | 56632/371472 [4:30:45<23:29:26,  3.72it/s]
 15%|█▌        | 56633/371472 [4:30:45<25:16:41,  3.46it/s]
 15%|█▌        | 56634/371472 [4:30:45<24:04:29,  3.63it/s]
 15%|█▌        | 56635/371472 [4:30:45<23:40:03,  3.70it/s]
 15%|█▌        | 56636/371472 [4:30:46<23:29:56,  3.72it/s]
 15%|█▌        | 56637/371472 [4:30:46<24:36:48,  3.55it/s]
 15%|█▌        | 56638/371472 [4:30:46<26:09:08,  3.34it/s]
 15%|█▌        | 56639/371472 [4:30:47<27:13:02,  3.21it/s]
 15%|█▌        | 56640/371472 [4:30:47<25:31:21,  3.43it/s]
                                                           
{'loss': 4.0405, 'learning_rate': 8.631838651985605e-07, 'epoch': 2.44}

 15%|█▌        | 56640/371472 [4:30:47<25:31:21,  3.43it/s]
 15%|█▌        | 56641/371472 [4:30:47<25:45:04,  3.40it/s]
 15%|█▌        | 56642/371472 [4:30:47<24:25:50,  3.58it/s]
 15%|█▌        | 56643/371472 [4:30:48<25:50:16,  3.38it/s]
 15%|█▌        | 56644/371472 [4:30:48<26:01:08,  3.36it/s]
 15%|█▌        | 56645/371472 [4:30:48<28:32:09,  3.06it/s]
 15%|█▌        | 56646/371472 [4:30:49<26:17:25,  3.33it/s]
 15%|█▌        | 56647/371472 [4:30:49<26:09:27,  3.34it/s]
 15%|█▌        | 56648/371472 [4:30:49<25:19:43,  3.45it/s]
 15%|█▌        | 56649/371472 [4:30:50<25:38:15,  3.41it/s]
 15%|█▌        | 56650/371472 [4:30:50<25:03:17,  3.49it/s]
 15%|█▌        | 56651/371472 [4:30:50<24:35:47,  3.56it/s]
 15%|█▌        | 56652/371472 [4:30:50<25:48:03,  3.39it/s]
 15%|█▌        | 56653/371472 [4:30:51<25:28:54,  3.43it/s]
 15%|█▌        | 56654/371472 [4:30:51<25:19:54,  3.45it/s]
 15%|█▌        | 56655/371472 [4:30:51<26:23:43,  3.31it/s]
 15%|█▌        | 56656/371472 [4:30:52<26:28:08,  3.30it/s]
 15%|█▌        | 56657/371472 [4:30:52<25:18:09,  3.46it/s]
 15%|█▌        | 56658/371472 [4:30:52<24:42:29,  3.54it/s]
 15%|█▌        | 56659/371472 [4:30:52<25:03:17,  3.49it/s]
 15%|█▌        | 56660/371472 [4:30:53<24:40:20,  3.54it/s]
                                                           
{'loss': 4.1405, 'learning_rate': 8.631353832230817e-07, 'epoch': 2.44}

 15%|█▌        | 56660/371472 [4:30:53<24:40:20,  3.54it/s]
 15%|█▌        | 56661/371472 [4:30:53<24:35:04,  3.56it/s]
 15%|█▌        | 56662/371472 [4:30:53<23:26:43,  3.73it/s]
 15%|█▌        | 56663/371472 [4:30:54<23:23:12,  3.74it/s]
 15%|█▌        | 56664/371472 [4:30:54<22:59:51,  3.80it/s]
 15%|█▌        | 56665/371472 [4:30:54<22:24:44,  3.90it/s]
 15%|█▌        | 56666/371472 [4:30:54<23:00:19,  3.80it/s]
 15%|█▌        | 56667/371472 [4:30:55<24:21:17,  3.59it/s]
 15%|█▌        | 56668/371472 [4:30:55<24:06:39,  3.63it/s]
 15%|█▌        | 56669/371472 [4:30:55<24:11:11,  3.62it/s]
 15%|█▌        | 56670/371472 [4:30:55<24:34:28,  3.56it/s]
 15%|█▌        | 56671/371472 [4:30:56<25:00:59,  3.50it/s]
 15%|█▌        | 56672/371472 [4:30:56<24:31:26,  3.57it/s]
 15%|█▌        | 56673/371472 [4:30:56<26:50:36,  3.26it/s]
 15%|█▌        | 56674/371472 [4:30:57<25:48:54,  3.39it/s]
 15%|█▌        | 56675/371472 [4:30:57<24:18:15,  3.60it/s]
 15%|█▌        | 56676/371472 [4:30:57<25:10:44,  3.47it/s]
 15%|█▌        | 56677/371472 [4:30:58<26:02:50,  3.36it/s]
 15%|█▌        | 56678/371472 [4:30:58<25:18:08,  3.46it/s]
 15%|█▌        | 56679/371472 [4:30:58<26:39:11,  3.28it/s]
 15%|█▌        | 56680/371472 [4:30:58<26:31:05,  3.30it/s]
                                                           
{'loss': 4.1484, 'learning_rate': 8.630869012476028e-07, 'epoch': 2.44}

 15%|█▌        | 56680/371472 [4:30:58<26:31:05,  3.30it/s]
 15%|█▌        | 56681/371472 [4:30:59<25:03:31,  3.49it/s]
 15%|█▌        | 56682/371472 [4:30:59<24:43:04,  3.54it/s]
 15%|█▌        | 56683/371472 [4:30:59<24:12:47,  3.61it/s]
 15%|█▌        | 56684/371472 [4:30:59<23:47:25,  3.68it/s]
 15%|█▌        | 56685/371472 [4:31:00<23:05:01,  3.79it/s]
 15%|█▌        | 56686/371472 [4:31:00<23:13:20,  3.77it/s]
 15%|█▌        | 56687/371472 [4:31:00<23:21:02,  3.74it/s]
 15%|█▌        | 56688/371472 [4:31:01<22:36:05,  3.87it/s]
 15%|█▌        | 56689/371472 [4:31:01<22:47:40,  3.84it/s]
 15%|█▌        | 56690/371472 [4:31:01<23:22:14,  3.74it/s]
 15%|█▌        | 56691/371472 [4:31:01<24:14:29,  3.61it/s]
 15%|█▌        | 56692/371472 [4:31:02<26:26:02,  3.31it/s]
 15%|█▌        | 56693/371472 [4:31:02<25:14:55,  3.46it/s]
 15%|█▌        | 56694/371472 [4:31:02<29:51:57,  2.93it/s]
 15%|█▌        | 56695/371472 [4:31:03<28:15:03,  3.10it/s]
 15%|█▌        | 56696/371472 [4:31:03<27:41:39,  3.16it/s]
 15%|█▌        | 56697/371472 [4:31:03<26:01:59,  3.36it/s]
 15%|█▌        | 56698/371472 [4:31:04<26:17:29,  3.33it/s]
 15%|█▌        | 56699/371472 [4:31:04<27:04:01,  3.23it/s]
 15%|█▌        | 56700/371472 [4:31:04<25:14:09,  3.46it/s]
                                                           
{'loss': 4.2479, 'learning_rate': 8.630384192721239e-07, 'epoch': 2.44}

 15%|█▌        | 56700/371472 [4:31:04<25:14:09,  3.46it/s]
 15%|█▌        | 56701/371472 [4:31:04<25:38:33,  3.41it/s]
 15%|█▌        | 56702/371472 [4:31:05<24:46:06,  3.53it/s]
 15%|█▌        | 56703/371472 [4:31:05<26:15:51,  3.33it/s]
 15%|█▌        | 56704/371472 [4:31:05<25:58:50,  3.37it/s]
 15%|█▌        | 56705/371472 [4:31:06<25:54:34,  3.37it/s]
 15%|█▌        | 56706/371472 [4:31:06<26:11:35,  3.34it/s]
 15%|█▌        | 56707/371472 [4:31:06<25:04:58,  3.49it/s]
 15%|█▌        | 56708/371472 [4:31:06<24:55:44,  3.51it/s]
 15%|█▌        | 56709/371472 [4:31:07<23:55:54,  3.65it/s]
 15%|█▌        | 56710/371472 [4:31:07<25:15:21,  3.46it/s]
 15%|█▌        | 56711/371472 [4:31:07<25:37:29,  3.41it/s]
 15%|█▌        | 56712/371472 [4:31:08<25:54:00,  3.38it/s]
 15%|█▌        | 56713/371472 [4:31:08<24:44:47,  3.53it/s]
 15%|█▌        | 56714/371472 [4:31:08<24:46:09,  3.53it/s]
 15%|█▌        | 56715/371472 [4:31:08<24:10:00,  3.62it/s]
 15%|█▌        | 56716/371472 [4:31:09<26:35:36,  3.29it/s]
 15%|█▌        | 56717/371472 [4:31:09<26:01:59,  3.36it/s]
 15%|█▌        | 56718/371472 [4:31:09<26:57:53,  3.24it/s]
 15%|█▌        | 56719/371472 [4:31:10<25:58:59,  3.36it/s]
 15%|█▌        | 56720/371472 [4:31:10<25:08:17,  3.48it/s]
                                                           
{'loss': 4.1576, 'learning_rate': 8.62989937296645e-07, 'epoch': 2.44}

 15%|█▌        | 56720/371472 [4:31:10<25:08:17,  3.48it/s]
 15%|█▌        | 56721/371472 [4:31:10<24:08:11,  3.62it/s]
 15%|█▌        | 56722/371472 [4:31:11<23:45:52,  3.68it/s]
 15%|█▌        | 56723/371472 [4:31:11<23:09:47,  3.77it/s]
 15%|█▌        | 56724/371472 [4:31:11<23:08:03,  3.78it/s]
 15%|█▌        | 56725/371472 [4:31:11<22:40:39,  3.86it/s]
 15%|█▌        | 56726/371472 [4:31:12<23:02:41,  3.79it/s]
 15%|█▌        | 56727/371472 [4:31:12<22:20:28,  3.91it/s]
 15%|█▌        | 56728/371472 [4:31:12<23:10:04,  3.77it/s]
 15%|█▌        | 56729/371472 [4:31:12<23:10:37,  3.77it/s]
 15%|█▌        | 56730/371472 [4:31:13<22:42:48,  3.85it/s]
 15%|█▌        | 56731/371472 [4:31:13<22:35:20,  3.87it/s]
 15%|█▌        | 56732/371472 [4:31:13<22:31:52,  3.88it/s]
 15%|█▌        | 56733/371472 [4:31:13<22:18:05,  3.92it/s]
 15%|█▌        | 56734/371472 [4:31:14<21:36:27,  4.05it/s]
 15%|█▌        | 56735/371472 [4:31:14<22:20:57,  3.91it/s]
 15%|█▌        | 56736/371472 [4:31:14<21:50:38,  4.00it/s]
 15%|█▌        | 56737/371472 [4:31:14<22:05:32,  3.96it/s]
 15%|█▌        | 56738/371472 [4:31:15<24:14:43,  3.61it/s]
 15%|█▌        | 56739/371472 [4:31:15<26:06:22,  3.35it/s]
 15%|█▌        | 56740/371472 [4:31:15<26:20:11,  3.32it/s]
                                                           
{'loss': 4.3753, 'learning_rate': 8.629414553211662e-07, 'epoch': 2.44}

 15%|█▌        | 56740/371472 [4:31:15<26:20:11,  3.32it/s]
 15%|█▌        | 56741/371472 [4:31:16<25:08:23,  3.48it/s]
 15%|█▌        | 56742/371472 [4:31:16<23:56:44,  3.65it/s]
 15%|█▌        | 56743/371472 [4:31:16<23:45:30,  3.68it/s]
 15%|█▌        | 56744/371472 [4:31:16<25:22:02,  3.45it/s]
 15%|█▌        | 56745/371472 [4:31:17<24:44:44,  3.53it/s]
 15%|█▌        | 56746/371472 [4:31:17<25:00:02,  3.50it/s]
 15%|█▌        | 56747/371472 [4:31:17<24:49:42,  3.52it/s]
 15%|█▌        | 56748/371472 [4:31:18<24:07:57,  3.62it/s]
 15%|█▌        | 56749/371472 [4:31:18<25:26:36,  3.44it/s]
 15%|█▌        | 56750/371472 [4:31:18<24:00:00,  3.64it/s]
 15%|█▌        | 56751/371472 [4:31:18<23:44:56,  3.68it/s]
 15%|█▌        | 56752/371472 [4:31:19<25:42:33,  3.40it/s]
 15%|█▌        | 56753/371472 [4:31:19<24:35:19,  3.56it/s]
 15%|█▌        | 56754/371472 [4:31:19<23:40:09,  3.69it/s]
 15%|█▌        | 56755/371472 [4:31:19<23:32:45,  3.71it/s]
 15%|█▌        | 56756/371472 [4:31:20<23:11:59,  3.77it/s]
 15%|█▌        | 56757/371472 [4:31:20<24:32:16,  3.56it/s]
 15%|█▌        | 56758/371472 [4:31:20<23:27:17,  3.73it/s]
 15%|█▌        | 56759/371472 [4:31:21<25:55:50,  3.37it/s]
 15%|█▌        | 56760/371472 [4:31:21<25:24:02,  3.44it/s]
                                                           
{'loss': 4.4392, 'learning_rate': 8.628929733456872e-07, 'epoch': 2.44}

 15%|█▌        | 56760/371472 [4:31:21<25:24:02,  3.44it/s]
 15%|█▌        | 56761/371472 [4:31:21<26:26:39,  3.31it/s]
 15%|█▌        | 56762/371472 [4:31:22<26:13:11,  3.33it/s]
 15%|█▌        | 56763/371472 [4:31:22<26:07:05,  3.35it/s]
 15%|█▌        | 56764/371472 [4:31:22<26:21:35,  3.32it/s]
 15%|█▌        | 56765/371472 [4:31:22<25:19:06,  3.45it/s]
 15%|█▌        | 56766/371472 [4:31:23<25:27:57,  3.43it/s]
 15%|█▌        | 56767/371472 [4:31:23<24:55:32,  3.51it/s]
 15%|█▌        | 56768/371472 [4:31:23<24:13:31,  3.61it/s]
 15%|█▌        | 56769/371472 [4:31:23<24:06:01,  3.63it/s]
 15%|█▌        | 56770/371472 [4:31:24<23:44:40,  3.68it/s]
 15%|█▌        | 56771/371472 [4:31:24<23:25:27,  3.73it/s]
 15%|█▌        | 56772/371472 [4:31:24<23:52:33,  3.66it/s]
 15%|█▌        | 56773/371472 [4:31:25<23:43:40,  3.68it/s]
 15%|█▌        | 56774/371472 [4:31:25<23:49:45,  3.67it/s]
 15%|█▌        | 56775/371472 [4:31:25<25:29:28,  3.43it/s]
 15%|█▌        | 56776/371472 [4:31:25<24:47:43,  3.53it/s]
 15%|█▌        | 56777/371472 [4:31:26<24:26:53,  3.58it/s]
 15%|█▌        | 56778/371472 [4:31:26<24:40:15,  3.54it/s]
 15%|█▌        | 56779/371472 [4:31:26<24:16:46,  3.60it/s]
 15%|█▌        | 56780/371472 [4:31:27<23:29:12,  3.72it/s]
                                                           
{'loss': 4.1372, 'learning_rate': 8.628444913702083e-07, 'epoch': 2.45}

 15%|█▌        | 56780/371472 [4:31:27<23:29:12,  3.72it/s]
 15%|█▌        | 56781/371472 [4:31:27<23:10:41,  3.77it/s]
 15%|█▌        | 56782/371472 [4:31:27<23:13:32,  3.76it/s]
 15%|█▌        | 56783/371472 [4:31:27<24:13:36,  3.61it/s]
 15%|█▌        | 56784/371472 [4:31:28<23:20:38,  3.74it/s]
 15%|█▌        | 56785/371472 [4:31:28<22:54:44,  3.82it/s]
 15%|█▌        | 56786/371472 [4:31:28<22:09:04,  3.95it/s]
 15%|█▌        | 56787/371472 [4:31:28<24:06:49,  3.63it/s]
 15%|█▌        | 56788/371472 [4:31:29<24:06:46,  3.63it/s]
 15%|█▌        | 56789/371472 [4:31:29<23:43:48,  3.68it/s]
 15%|█▌        | 56790/371472 [4:31:29<24:42:59,  3.54it/s]
 15%|█▌        | 56791/371472 [4:31:30<24:37:24,  3.55it/s]
 15%|█▌        | 56792/371472 [4:31:30<24:55:12,  3.51it/s]
 15%|█▌        | 56793/371472 [4:31:30<24:12:26,  3.61it/s]
 15%|█▌        | 56794/371472 [4:31:30<23:28:32,  3.72it/s]
 15%|█▌        | 56795/371472 [4:31:31<22:49:10,  3.83it/s]
 15%|█▌        | 56796/371472 [4:31:31<22:46:14,  3.84it/s]
 15%|█▌        | 56797/371472 [4:31:31<23:38:31,  3.70it/s]
 15%|█▌        | 56798/371472 [4:31:31<22:54:12,  3.82it/s]
 15%|█▌        | 56799/371472 [4:31:32<22:53:51,  3.82it/s]
 15%|█▌        | 56800/371472 [4:31:32<22:11:29,  3.94it/s]
                                                           
{'loss': 4.1564, 'learning_rate': 8.627960093947294e-07, 'epoch': 2.45}

 15%|█▌        | 56800/371472 [4:31:32<22:11:29,  3.94it/s]
 15%|█▌        | 56801/371472 [4:31:32<22:43:06,  3.85it/s]
 15%|█▌        | 56802/371472 [4:31:32<23:28:31,  3.72it/s]
 15%|█▌        | 56803/371472 [4:31:33<23:34:22,  3.71it/s]
 15%|█▌        | 56804/371472 [4:31:33<23:10:22,  3.77it/s]
 15%|█▌        | 56805/371472 [4:31:33<25:58:23,  3.37it/s]
 15%|█▌        | 56806/371472 [4:31:34<24:47:04,  3.53it/s]
 15%|█▌        | 56807/371472 [4:31:34<25:06:21,  3.48it/s]
 15%|█▌        | 56808/371472 [4:31:34<25:06:46,  3.48it/s]
 15%|█▌        | 56809/371472 [4:31:34<24:42:06,  3.54it/s]
 15%|█▌        | 56810/371472 [4:31:35<25:11:06,  3.47it/s]
 15%|█▌        | 56811/371472 [4:31:35<24:11:48,  3.61it/s]
 15%|█▌        | 56812/371472 [4:31:35<23:57:51,  3.65it/s]
 15%|█▌        | 56813/371472 [4:31:36<24:16:07,  3.60it/s]
 15%|█▌        | 56814/371472 [4:31:36<25:29:59,  3.43it/s]
 15%|█▌        | 56815/371472 [4:31:36<24:59:48,  3.50it/s]
 15%|█▌        | 56816/371472 [4:31:36<23:50:32,  3.67it/s]
 15%|█▌        | 56817/371472 [4:31:37<23:55:15,  3.65it/s]
 15%|█▌        | 56818/371472 [4:31:37<23:44:35,  3.68it/s]
 15%|█▌        | 56819/371472 [4:31:37<23:04:38,  3.79it/s]
 15%|█▌        | 56820/371472 [4:31:37<22:26:18,  3.90it/s]
                                                           
{'loss': 4.1573, 'learning_rate': 8.627475274192505e-07, 'epoch': 2.45}

 15%|█▌        | 56820/371472 [4:31:37<22:26:18,  3.90it/s]
 15%|█▌        | 56821/371472 [4:31:38<22:57:30,  3.81it/s]
 15%|█▌        | 56822/371472 [4:31:38<22:23:54,  3.90it/s]
 15%|█▌        | 56823/371472 [4:31:38<25:48:09,  3.39it/s]
 15%|█▌        | 56824/371472 [4:31:39<25:20:11,  3.45it/s]
 15%|█▌        | 56825/371472 [4:31:39<24:55:03,  3.51it/s]
 15%|█▌        | 56826/371472 [4:31:39<25:29:43,  3.43it/s]
 15%|█▌        | 56827/371472 [4:31:39<25:21:58,  3.45it/s]
 15%|█▌        | 56828/371472 [4:31:40<24:39:59,  3.54it/s]
 15%|█▌        | 56829/371472 [4:31:40<24:34:09,  3.56it/s]
 15%|█▌        | 56830/371472 [4:31:40<24:44:10,  3.53it/s]
 15%|█▌        | 56831/371472 [4:31:41<23:33:09,  3.71it/s]
 15%|█▌        | 56832/371472 [4:31:41<23:37:34,  3.70it/s]
 15%|█▌        | 56833/371472 [4:31:41<23:39:50,  3.69it/s]
 15%|█▌        | 56834/371472 [4:31:41<24:25:09,  3.58it/s]
 15%|█▌        | 56835/371472 [4:31:42<23:59:56,  3.64it/s]
 15%|█▌        | 56836/371472 [4:31:42<24:06:58,  3.62it/s]
 15%|█▌        | 56837/371472 [4:31:42<25:38:04,  3.41it/s]
 15%|█▌        | 56838/371472 [4:31:43<25:33:51,  3.42it/s]
 15%|█▌        | 56839/371472 [4:31:43<24:19:18,  3.59it/s]
 15%|█▌        | 56840/371472 [4:31:43<24:54:55,  3.51it/s]
                                                           
{'loss': 4.0543, 'learning_rate': 8.626990454437717e-07, 'epoch': 2.45}

 15%|█▌        | 56840/371472 [4:31:43<24:54:55,  3.51it/s]
 15%|█▌        | 56841/371472 [4:31:43<25:05:50,  3.48it/s]
 15%|█▌        | 56842/371472 [4:31:44<24:51:01,  3.52it/s]
 15%|█▌        | 56843/371472 [4:31:44<24:47:15,  3.53it/s]
 15%|█▌        | 56844/371472 [4:31:44<25:11:09,  3.47it/s]
 15%|█▌        | 56845/371472 [4:31:44<24:46:50,  3.53it/s]
 15%|█▌        | 56846/371472 [4:31:45<24:30:58,  3.56it/s]
 15%|█▌        | 56847/371472 [4:31:45<24:07:42,  3.62it/s]
 15%|█▌        | 56848/371472 [4:31:45<23:31:30,  3.71it/s]
 15%|█▌        | 56849/371472 [4:31:46<25:19:56,  3.45it/s]
 15%|█▌        | 56850/371472 [4:31:46<25:19:29,  3.45it/s]
 15%|█▌        | 56851/371472 [4:31:46<24:31:23,  3.56it/s]
 15%|█▌        | 56852/371472 [4:31:46<24:27:30,  3.57it/s]
 15%|█▌        | 56853/371472 [4:31:47<30:03:11,  2.91it/s]
 15%|█▌        | 56854/371472 [4:31:47<28:34:50,  3.06it/s]
 15%|█▌        | 56855/371472 [4:31:48<27:18:34,  3.20it/s]
 15%|█▌        | 56856/371472 [4:31:48<27:16:35,  3.20it/s]
 15%|█▌        | 56857/371472 [4:31:48<25:07:05,  3.48it/s]
 15%|█▌        | 56858/371472 [4:31:48<24:55:23,  3.51it/s]
 15%|█▌        | 56859/371472 [4:31:49<24:11:20,  3.61it/s]
 15%|█▌        | 56860/371472 [4:31:49<23:59:13,  3.64it/s]
                                                           
{'loss': 4.077, 'learning_rate': 8.626505634682928e-07, 'epoch': 2.45}

 15%|█▌        | 56860/371472 [4:31:49<23:59:13,  3.64it/s]
 15%|█▌        | 56861/371472 [4:31:49<24:37:22,  3.55it/s]
 15%|█▌        | 56862/371472 [4:31:49<24:14:19,  3.61it/s]
 15%|█▌        | 56863/371472 [4:31:50<23:17:47,  3.75it/s]
 15%|█▌        | 56864/371472 [4:31:50<25:15:15,  3.46it/s]
 15%|█▌        | 56865/371472 [4:31:50<24:31:29,  3.56it/s]
 15%|█▌        | 56866/371472 [4:31:51<24:03:03,  3.63it/s]
 15%|█▌        | 56867/371472 [4:31:51<24:47:33,  3.52it/s]
 15%|█▌        | 56868/371472 [4:31:51<25:41:15,  3.40it/s]
 15%|█▌        | 56869/371472 [4:31:51<24:57:17,  3.50it/s]
 15%|█▌        | 56870/371472 [4:31:52<25:12:05,  3.47it/s]
 15%|█▌        | 56871/371472 [4:31:52<27:18:36,  3.20it/s]
 15%|█▌        | 56872/371472 [4:31:52<26:42:31,  3.27it/s]
 15%|█▌        | 56873/371472 [4:31:53<26:06:42,  3.35it/s]
 15%|█▌        | 56874/371472 [4:31:53<25:41:51,  3.40it/s]
 15%|█▌        | 56875/371472 [4:31:53<26:14:04,  3.33it/s]
 15%|█▌        | 56876/371472 [4:31:54<24:54:14,  3.51it/s]
 15%|█▌        | 56877/371472 [4:31:54<24:19:50,  3.59it/s]
 15%|█▌        | 56878/371472 [4:31:54<25:06:22,  3.48it/s]
 15%|█▌        | 56879/371472 [4:31:54<24:19:37,  3.59it/s]
 15%|█▌        | 56880/371472 [4:31:55<23:10:25,  3.77it/s]
                                                           
{'loss': 4.2958, 'learning_rate': 8.626020814928139e-07, 'epoch': 2.45}

 15%|█▌        | 56880/371472 [4:31:55<23:10:25,  3.77it/s]
 15%|█▌        | 56881/371472 [4:31:55<25:00:34,  3.49it/s]
 15%|█▌        | 56882/371472 [4:31:55<24:50:47,  3.52it/s]
 15%|█▌        | 56883/371472 [4:31:55<25:07:27,  3.48it/s]
 15%|█▌        | 56884/371472 [4:31:56<23:53:53,  3.66it/s]
 15%|█▌        | 56885/371472 [4:31:56<23:43:35,  3.68it/s]
 15%|█▌        | 56886/371472 [4:31:56<25:04:49,  3.48it/s]
 15%|█▌        | 56887/371472 [4:31:57<25:52:24,  3.38it/s]
 15%|█▌        | 56888/371472 [4:31:57<25:34:51,  3.42it/s]
 15%|█▌        | 56889/371472 [4:31:57<25:13:30,  3.46it/s]
 15%|█▌        | 56890/371472 [4:31:58<26:07:37,  3.34it/s]
 15%|█▌        | 56891/371472 [4:31:58<25:23:57,  3.44it/s]
 15%|█▌        | 56892/371472 [4:31:58<24:59:11,  3.50it/s]
 15%|█▌        | 56893/371472 [4:31:58<24:58:46,  3.50it/s]
 15%|█▌        | 56894/371472 [4:31:59<24:09:27,  3.62it/s]
 15%|█▌        | 56895/371472 [4:31:59<23:41:26,  3.69it/s]
 15%|█▌        | 56896/371472 [4:31:59<22:50:29,  3.83it/s]
 15%|█▌        | 56897/371472 [4:31:59<23:39:51,  3.69it/s]
 15%|█▌        | 56898/371472 [4:32:00<22:57:33,  3.81it/s]
 15%|█▌        | 56899/371472 [4:32:00<22:10:18,  3.94it/s]
 15%|█▌        | 56900/371472 [4:32:00<22:01:18,  3.97it/s]
                                                           
{'loss': 3.9361, 'learning_rate': 8.625535995173349e-07, 'epoch': 2.45}

 15%|█▌        | 56900/371472 [4:32:00<22:01:18,  3.97it/s]
 15%|█▌        | 56901/371472 [4:32:00<22:34:59,  3.87it/s]
 15%|█▌        | 56902/371472 [4:32:01<24:10:49,  3.61it/s]
 15%|█▌        | 56903/371472 [4:32:01<24:16:56,  3.60it/s]
 15%|█▌        | 56904/371472 [4:32:01<26:51:52,  3.25it/s]
 15%|█▌        | 56905/371472 [4:32:02<26:34:37,  3.29it/s]
 15%|█▌        | 56906/371472 [4:32:02<25:03:50,  3.49it/s]
 15%|█▌        | 56907/371472 [4:32:02<23:41:01,  3.69it/s]
 15%|█▌        | 56908/371472 [4:32:02<23:46:10,  3.68it/s]
 15%|█▌        | 56909/371472 [4:32:03<24:41:09,  3.54it/s]
 15%|█▌        | 56910/371472 [4:32:03<23:21:56,  3.74it/s]
 15%|█▌        | 56911/371472 [4:32:03<22:41:04,  3.85it/s]
 15%|█▌        | 56912/371472 [4:32:03<23:20:10,  3.74it/s]
 15%|█▌        | 56913/371472 [4:32:04<23:50:19,  3.67it/s]
 15%|█▌        | 56914/371472 [4:32:04<23:38:20,  3.70it/s]
 15%|█▌        | 56915/371472 [4:32:04<22:54:29,  3.81it/s]
 15%|█▌        | 56916/371472 [4:32:05<23:03:18,  3.79it/s]
 15%|█▌        | 56917/371472 [4:32:05<24:45:32,  3.53it/s]
 15%|█▌        | 56918/371472 [4:32:05<24:22:27,  3.58it/s]
 15%|█▌        | 56919/371472 [4:32:05<24:18:02,  3.60it/s]
 15%|█▌        | 56920/371472 [4:32:06<23:32:45,  3.71it/s]
                                                           
{'loss': 4.3521, 'learning_rate': 8.625051175418561e-07, 'epoch': 2.45}

 15%|█▌        | 56920/371472 [4:32:06<23:32:45,  3.71it/s]
 15%|█▌        | 56921/371472 [4:32:06<25:00:34,  3.49it/s]
 15%|█▌        | 56922/371472 [4:32:06<24:25:32,  3.58it/s]
 15%|█▌        | 56923/371472 [4:32:07<25:04:29,  3.48it/s]
 15%|█▌        | 56924/371472 [4:32:07<26:21:16,  3.32it/s]
 15%|█▌        | 56925/371472 [4:32:07<25:56:46,  3.37it/s]
 15%|█▌        | 56926/371472 [4:32:08<28:01:11,  3.12it/s]
 15%|█▌        | 56927/371472 [4:32:08<26:32:32,  3.29it/s]
 15%|█▌        | 56928/371472 [4:32:08<25:47:37,  3.39it/s]
 15%|█▌        | 56929/371472 [4:32:08<25:59:26,  3.36it/s]
 15%|█▌        | 56930/371472 [4:32:09<24:44:22,  3.53it/s]
 15%|█▌        | 56931/371472 [4:32:09<24:50:06,  3.52it/s]
 15%|█▌        | 56932/371472 [4:32:09<25:01:52,  3.49it/s]
 15%|█▌        | 56933/371472 [4:32:09<24:36:55,  3.55it/s]
 15%|█▌        | 56934/371472 [4:32:10<23:25:14,  3.73it/s]
 15%|█▌        | 56935/371472 [4:32:10<22:56:51,  3.81it/s]
 15%|█▌        | 56936/371472 [4:32:10<22:25:48,  3.90it/s]
 15%|█▌        | 56937/371472 [4:32:10<22:02:20,  3.96it/s]
 15%|█▌        | 56938/371472 [4:32:11<23:33:16,  3.71it/s]
 15%|█▌        | 56939/371472 [4:32:11<23:08:50,  3.77it/s]
 15%|█▌        | 56940/371472 [4:32:11<22:45:29,  3.84it/s]
                                                           
{'loss': 4.432, 'learning_rate': 8.624566355663772e-07, 'epoch': 2.45}

 15%|█▌        | 56940/371472 [4:32:11<22:45:29,  3.84it/s]
 15%|█▌        | 56941/371472 [4:32:12<22:58:55,  3.80it/s]
 15%|█▌        | 56942/371472 [4:32:12<22:54:18,  3.81it/s]
 15%|█▌        | 56943/371472 [4:32:12<22:06:05,  3.95it/s]
 15%|█▌        | 56944/371472 [4:32:12<21:41:26,  4.03it/s]
 15%|█▌        | 56945/371472 [4:32:13<22:43:17,  3.85it/s]
 15%|█▌        | 56946/371472 [4:32:13<22:22:42,  3.90it/s]
 15%|█▌        | 56947/371472 [4:32:13<22:15:07,  3.93it/s]
 15%|█▌        | 56948/371472 [4:32:13<22:46:54,  3.83it/s]
 15%|█▌        | 56949/371472 [4:32:14<22:15:08,  3.93it/s]
 15%|█▌        | 56950/371472 [4:32:14<21:59:11,  3.97it/s]
 15%|█▌        | 56951/371472 [4:32:14<22:25:41,  3.90it/s]
 15%|█▌        | 56952/371472 [4:32:14<24:54:36,  3.51it/s]
 15%|█▌        | 56953/371472 [4:32:15<24:30:49,  3.56it/s]
 15%|█▌        | 56954/371472 [4:32:15<23:33:11,  3.71it/s]
 15%|█▌        | 56955/371472 [4:32:15<23:44:55,  3.68it/s]
 15%|█▌        | 56956/371472 [4:32:16<23:35:34,  3.70it/s]
 15%|█▌        | 56957/371472 [4:32:16<23:46:43,  3.67it/s]
 15%|█▌        | 56958/371472 [4:32:16<24:11:26,  3.61it/s]
 15%|█▌        | 56959/371472 [4:32:16<23:21:52,  3.74it/s]
 15%|█▌        | 56960/371472 [4:32:17<23:52:25,  3.66it/s]
                                                           
{'loss': 3.9227, 'learning_rate': 8.624081535908983e-07, 'epoch': 2.45}

 15%|█▌        | 56960/371472 [4:32:17<23:52:25,  3.66it/s]
 15%|█▌        | 56961/371472 [4:32:17<23:50:43,  3.66it/s]
 15%|█▌        | 56962/371472 [4:32:17<23:40:49,  3.69it/s]
 15%|█▌        | 56963/371472 [4:32:17<24:30:16,  3.57it/s]
 15%|█▌        | 56964/371472 [4:32:18<24:24:06,  3.58it/s]
 15%|█▌        | 56965/371472 [4:32:18<24:14:24,  3.60it/s]
 15%|█▌        | 56966/371472 [4:32:18<24:35:04,  3.55it/s]
 15%|█▌        | 56967/371472 [4:32:19<23:36:51,  3.70it/s]
 15%|█▌        | 56968/371472 [4:32:19<23:33:20,  3.71it/s]
 15%|█▌        | 56969/371472 [4:32:19<23:42:54,  3.68it/s]
 15%|█▌        | 56970/371472 [4:32:19<26:49:32,  3.26it/s]
 15%|█▌        | 56971/371472 [4:32:20<25:00:20,  3.49it/s]
 15%|█▌        | 56972/371472 [4:32:20<23:58:54,  3.64it/s]
 15%|█▌        | 56973/371472 [4:32:20<25:32:27,  3.42it/s]
 15%|█▌        | 56974/371472 [4:32:21<26:01:49,  3.36it/s]
 15%|█▌        | 56975/371472 [4:32:21<24:51:40,  3.51it/s]
 15%|█▌        | 56976/371472 [4:32:21<24:15:59,  3.60it/s]
 15%|█▌        | 56977/371472 [4:32:21<23:27:42,  3.72it/s]
 15%|█▌        | 56978/371472 [4:32:22<23:31:12,  3.71it/s]
 15%|█▌        | 56979/371472 [4:32:22<26:16:16,  3.33it/s]
 15%|█▌        | 56980/371472 [4:32:22<25:30:33,  3.42it/s]
                                                           
{'loss': 4.1412, 'learning_rate': 8.623596716154194e-07, 'epoch': 2.45}

 15%|█▌        | 56980/371472 [4:32:22<25:30:33,  3.42it/s]
 15%|█▌        | 56981/371472 [4:32:23<25:19:10,  3.45it/s]
 15%|█▌        | 56982/371472 [4:32:23<25:36:05,  3.41it/s]
 15%|█▌        | 56983/371472 [4:32:23<24:58:47,  3.50it/s]
 15%|█▌        | 56984/371472 [4:32:23<25:13:43,  3.46it/s]
 15%|█▌        | 56985/371472 [4:32:24<24:36:23,  3.55it/s]
 15%|█▌        | 56986/371472 [4:32:24<25:07:22,  3.48it/s]
 15%|█▌        | 56987/371472 [4:32:24<25:36:10,  3.41it/s]
 15%|█▌        | 56988/371472 [4:32:25<25:23:14,  3.44it/s]
 15%|█▌        | 56989/371472 [4:32:25<25:18:31,  3.45it/s]
 15%|█▌        | 56990/371472 [4:32:25<24:26:40,  3.57it/s]
 15%|█▌        | 56991/371472 [4:32:25<24:07:05,  3.62it/s]
 15%|█▌        | 56992/371472 [4:32:26<23:40:50,  3.69it/s]
 15%|█▌        | 56993/371472 [4:32:26<27:02:23,  3.23it/s]
 15%|█▌        | 56994/371472 [4:32:26<26:27:13,  3.30it/s]
 15%|█▌        | 56995/371472 [4:32:27<28:04:11,  3.11it/s]
 15%|█▌        | 56996/371472 [4:32:27<25:57:34,  3.37it/s]
 15%|█▌        | 56997/371472 [4:32:27<25:19:06,  3.45it/s]
 15%|█▌        | 56998/371472 [4:32:27<23:56:38,  3.65it/s]
 15%|█▌        | 56999/371472 [4:32:28<23:41:06,  3.69it/s]
 15%|█▌        | 57000/371472 [4:32:28<23:16:52,  3.75it/s]
                                                           
{'loss': 4.073, 'learning_rate': 8.623111896399405e-07, 'epoch': 2.46}

 15%|█▌        | 57000/371472 [4:32:28<23:16:52,  3.75it/s]
 15%|█▌        | 57001/371472 [4:32:28<23:44:53,  3.68it/s]
 15%|█▌        | 57002/371472 [4:32:29<23:54:46,  3.65it/s]
 15%|█▌        | 57003/371472 [4:32:29<23:34:10,  3.71it/s]
 15%|█▌        | 57004/371472 [4:32:29<23:50:55,  3.66it/s]
 15%|█▌        | 57005/371472 [4:32:29<23:27:52,  3.72it/s]
 15%|█▌        | 57006/371472 [4:32:30<23:12:08,  3.76it/s]
 15%|█▌        | 57007/371472 [4:32:30<24:39:54,  3.54it/s]
 15%|█▌        | 57008/371472 [4:32:30<24:30:35,  3.56it/s]
 15%|█▌        | 57009/371472 [4:32:30<24:37:52,  3.55it/s]
 15%|█▌        | 57010/371472 [4:32:31<24:59:44,  3.49it/s]
 15%|█▌        | 57011/371472 [4:32:31<24:13:16,  3.61it/s]
 15%|█▌        | 57012/371472 [4:32:31<24:28:04,  3.57it/s]
 15%|█▌        | 57013/371472 [4:32:32<25:04:37,  3.48it/s]
 15%|█▌        | 57014/371472 [4:32:32<25:23:46,  3.44it/s]
 15%|█▌        | 57015/371472 [4:32:32<25:28:16,  3.43it/s]
 15%|█▌        | 57016/371472 [4:32:32<24:11:36,  3.61it/s]
 15%|█▌        | 57017/371472 [4:32:33<23:33:12,  3.71it/s]
 15%|█▌        | 57018/371472 [4:32:33<23:05:28,  3.78it/s]
 15%|█▌        | 57019/371472 [4:32:33<24:33:01,  3.56it/s]
 15%|█▌        | 57020/371472 [4:32:34<23:17:54,  3.75it/s]
                                                           
{'loss': 4.2698, 'learning_rate': 8.622627076644616e-07, 'epoch': 2.46}

 15%|█▌        | 57020/371472 [4:32:34<23:17:54,  3.75it/s]
 15%|█▌        | 57021/371472 [4:32:34<24:04:37,  3.63it/s]
 15%|█▌        | 57022/371472 [4:32:34<24:48:06,  3.52it/s]
 15%|█▌        | 57023/371472 [4:32:34<27:05:40,  3.22it/s]
 15%|█▌        | 57024/371472 [4:32:35<25:10:48,  3.47it/s]
 15%|█▌        | 57025/371472 [4:32:35<23:50:49,  3.66it/s]
 15%|█▌        | 57026/371472 [4:32:35<24:28:17,  3.57it/s]
 15%|█▌        | 57027/371472 [4:32:36<23:47:35,  3.67it/s]
 15%|█▌        | 57028/371472 [4:32:36<24:06:10,  3.62it/s]
 15%|█▌        | 57029/371472 [4:32:36<24:59:49,  3.49it/s]
 15%|█▌        | 57030/371472 [4:32:36<24:30:34,  3.56it/s]
 15%|█▌        | 57031/371472 [4:32:37<27:27:20,  3.18it/s]
 15%|█▌        | 57032/371472 [4:32:37<27:07:50,  3.22it/s]
 15%|█▌        | 57033/371472 [4:32:37<26:07:36,  3.34it/s]
 15%|█▌        | 57034/371472 [4:32:38<25:11:26,  3.47it/s]
 15%|█▌        | 57035/371472 [4:32:38<25:15:43,  3.46it/s]
 15%|█▌        | 57036/371472 [4:32:38<24:58:40,  3.50it/s]
 15%|█▌        | 57037/371472 [4:32:38<23:55:46,  3.65it/s]
 15%|█▌        | 57038/371472 [4:32:39<23:31:22,  3.71it/s]
 15%|█▌        | 57039/371472 [4:32:39<24:09:05,  3.62it/s]
 15%|█▌        | 57040/371472 [4:32:39<25:11:40,  3.47it/s]
                                                           
{'loss': 4.2295, 'learning_rate': 8.622142256889827e-07, 'epoch': 2.46}

 15%|█▌        | 57040/371472 [4:32:39<25:11:40,  3.47it/s]
 15%|█▌        | 57041/371472 [4:32:40<24:46:23,  3.53it/s]
 15%|█▌        | 57042/371472 [4:32:40<24:26:27,  3.57it/s]
 15%|█▌        | 57043/371472 [4:32:40<24:21:05,  3.59it/s]
 15%|█▌        | 57044/371472 [4:32:40<23:27:54,  3.72it/s]
 15%|█▌        | 57045/371472 [4:32:41<23:51:47,  3.66it/s]
 15%|█▌        | 57046/371472 [4:32:41<25:07:02,  3.48it/s]
 15%|█▌        | 57047/371472 [4:32:41<25:15:59,  3.46it/s]
 15%|█▌        | 57048/371472 [4:32:41<24:17:08,  3.60it/s]
 15%|█▌        | 57049/371472 [4:32:42<24:54:23,  3.51it/s]
 15%|█▌        | 57050/371472 [4:32:42<26:03:18,  3.35it/s]
 15%|█▌        | 57051/371472 [4:32:42<25:49:34,  3.38it/s]
 15%|█▌        | 57052/371472 [4:32:43<27:30:16,  3.18it/s]
 15%|█▌        | 57053/371472 [4:32:43<25:39:57,  3.40it/s]
 15%|█▌        | 57054/371472 [4:32:43<25:31:16,  3.42it/s]
 15%|█▌        | 57055/371472 [4:32:44<24:49:03,  3.52it/s]
 15%|█▌        | 57056/371472 [4:32:44<24:20:04,  3.59it/s]
 15%|█▌        | 57057/371472 [4:32:44<23:41:45,  3.69it/s]
 15%|█▌        | 57058/371472 [4:32:44<23:43:31,  3.68it/s]
 15%|█▌        | 57059/371472 [4:32:45<24:07:59,  3.62it/s]
 15%|█▌        | 57060/371472 [4:32:45<24:06:50,  3.62it/s]
                                                           
{'loss': 4.3758, 'learning_rate': 8.621657437135038e-07, 'epoch': 2.46}

 15%|█▌        | 57060/371472 [4:32:45<24:06:50,  3.62it/s]
 15%|█▌        | 57061/371472 [4:32:45<24:27:02,  3.57it/s]
 15%|█▌        | 57062/371472 [4:32:46<25:08:23,  3.47it/s]
 15%|█▌        | 57063/371472 [4:32:46<25:43:30,  3.39it/s]
 15%|█▌        | 57064/371472 [4:32:46<26:35:34,  3.28it/s]
 15%|█▌        | 57065/371472 [4:32:46<25:27:52,  3.43it/s]
 15%|█▌        | 57066/371472 [4:32:47<25:03:16,  3.49it/s]
 15%|█▌        | 57067/371472 [4:32:47<24:45:04,  3.53it/s]
 15%|█▌        | 57068/371472 [4:32:47<23:44:52,  3.68it/s]
 15%|█▌        | 57069/371472 [4:32:48<24:18:39,  3.59it/s]
 15%|█▌        | 57070/371472 [4:32:48<24:01:24,  3.64it/s]
 15%|█▌        | 57071/371472 [4:32:48<25:26:19,  3.43it/s]
 15%|█▌        | 57072/371472 [4:32:48<26:03:21,  3.35it/s]
 15%|█▌        | 57073/371472 [4:32:49<26:34:51,  3.29it/s]
 15%|█▌        | 57074/371472 [4:32:49<24:45:06,  3.53it/s]
 15%|█▌        | 57075/371472 [4:32:49<24:09:42,  3.61it/s]
 15%|█▌        | 57076/371472 [4:32:49<23:02:58,  3.79it/s]
 15%|█▌        | 57077/371472 [4:32:50<22:21:59,  3.90it/s]
 15%|█▌        | 57078/371472 [4:32:50<24:06:47,  3.62it/s]
 15%|█▌        | 57079/371472 [4:32:50<23:41:43,  3.69it/s]
 15%|█▌        | 57080/371472 [4:32:51<23:30:11,  3.72it/s]
                                                           
{'loss': 4.4118, 'learning_rate': 8.621172617380249e-07, 'epoch': 2.46}

 15%|█▌        | 57080/371472 [4:32:51<23:30:11,  3.72it/s]
 15%|█▌        | 57081/371472 [4:32:51<23:32:03,  3.71it/s]
 15%|█▌        | 57082/371472 [4:32:51<23:11:48,  3.76it/s]
 15%|█▌        | 57083/371472 [4:32:51<23:25:07,  3.73it/s]
 15%|█▌        | 57084/371472 [4:32:52<23:32:37,  3.71it/s]
 15%|█▌        | 57085/371472 [4:32:52<22:52:51,  3.82it/s]
 15%|█▌        | 57086/371472 [4:32:52<24:18:32,  3.59it/s]
 15%|█▌        | 57087/371472 [4:32:52<24:14:02,  3.60it/s]
 15%|█▌        | 57088/371472 [4:32:53<27:40:08,  3.16it/s]
 15%|█▌        | 57089/371472 [4:32:53<25:51:47,  3.38it/s]
 15%|█▌        | 57090/371472 [4:32:53<24:35:30,  3.55it/s]
 15%|█▌        | 57091/371472 [4:32:54<23:46:43,  3.67it/s]
 15%|█▌        | 57092/371472 [4:32:54<24:37:24,  3.55it/s]
 15%|█▌        | 57093/371472 [4:32:54<23:17:15,  3.75it/s]
 15%|█▌        | 57094/371472 [4:32:54<23:48:01,  3.67it/s]
 15%|█▌        | 57095/371472 [4:32:55<26:03:17,  3.35it/s]
 15%|█▌        | 57096/371472 [4:32:55<24:50:29,  3.52it/s]
 15%|█▌        | 57097/371472 [4:32:55<24:42:57,  3.53it/s]
 15%|█▌        | 57098/371472 [4:32:56<23:33:57,  3.71it/s]
 15%|█▌        | 57099/371472 [4:32:56<22:46:21,  3.83it/s]
 15%|█▌        | 57100/371472 [4:32:56<25:23:09,  3.44it/s]
                                                           
{'loss': 4.3054, 'learning_rate': 8.620687797625461e-07, 'epoch': 2.46}

 15%|█▌        | 57100/371472 [4:32:56<25:23:09,  3.44it/s]
 15%|█▌        | 57101/371472 [4:32:56<25:14:15,  3.46it/s]
 15%|█▌        | 57102/371472 [4:32:57<24:45:20,  3.53it/s]
 15%|█▌        | 57103/371472 [4:32:57<23:59:46,  3.64it/s]
 15%|█▌        | 57104/371472 [4:32:57<24:50:45,  3.51it/s]
 15%|█▌        | 57105/371472 [4:32:58<26:21:14,  3.31it/s]
 15%|█▌        | 57106/371472 [4:32:58<25:05:01,  3.48it/s]
 15%|█▌        | 57107/371472 [4:32:58<25:15:01,  3.46it/s]
 15%|█▌        | 57108/371472 [4:32:58<25:06:33,  3.48it/s]
 15%|█▌        | 57109/371472 [4:32:59<26:01:31,  3.36it/s]
 15%|█▌        | 57110/371472 [4:32:59<25:31:09,  3.42it/s]
 15%|█▌        | 57111/371472 [4:32:59<25:07:28,  3.48it/s]
 15%|█▌        | 57112/371472 [4:33:00<25:58:28,  3.36it/s]
 15%|█▌        | 57113/371472 [4:33:00<25:33:29,  3.42it/s]
 15%|█▌        | 57114/371472 [4:33:00<25:02:09,  3.49it/s]
 15%|█▌        | 57115/371472 [4:33:00<24:35:08,  3.55it/s]
 15%|█▌        | 57116/371472 [4:33:01<27:13:43,  3.21it/s]
 15%|█▌        | 57117/371472 [4:33:01<26:20:35,  3.31it/s]
 15%|█▌        | 57118/371472 [4:33:01<25:31:24,  3.42it/s]
 15%|█▌        | 57119/371472 [4:33:02<25:15:34,  3.46it/s]
 15%|█▌        | 57120/371472 [4:33:02<28:02:55,  3.11it/s]
                                                           
{'loss': 4.1352, 'learning_rate': 8.620202977870671e-07, 'epoch': 2.46}

 15%|█▌        | 57120/371472 [4:33:02<28:02:55,  3.11it/s]
 15%|█▌        | 57121/371472 [4:33:02<26:12:42,  3.33it/s]
 15%|█▌        | 57122/371472 [4:33:03<25:34:59,  3.41it/s]
 15%|█▌        | 57123/371472 [4:33:03<25:27:42,  3.43it/s]
 15%|█▌        | 57124/371472 [4:33:03<24:54:48,  3.50it/s]
 15%|█▌        | 57125/371472 [4:33:03<25:34:43,  3.41it/s]
 15%|█▌        | 57126/371472 [4:33:04<25:03:19,  3.49it/s]
 15%|█▌        | 57127/371472 [4:33:04<24:55:33,  3.50it/s]
 15%|█▌        | 57128/371472 [4:33:04<24:53:37,  3.51it/s]
 15%|█▌        | 57129/371472 [4:33:05<27:08:18,  3.22it/s]
 15%|█▌        | 57130/371472 [4:33:05<25:47:02,  3.39it/s]
 15%|█▌        | 57131/371472 [4:33:05<26:46:23,  3.26it/s]
 15%|█▌        | 57132/371472 [4:33:06<25:23:07,  3.44it/s]
 15%|█▌        | 57133/371472 [4:33:06<25:12:50,  3.46it/s]
 15%|█▌        | 57134/371472 [4:33:06<25:49:23,  3.38it/s]
 15%|█▌        | 57135/371472 [4:33:06<24:49:54,  3.52it/s]
 15%|█▌        | 57136/371472 [4:33:07<25:43:49,  3.39it/s]
 15%|█▌        | 57137/371472 [4:33:07<25:18:00,  3.45it/s]
 15%|█▌        | 57138/371472 [4:33:07<26:03:27,  3.35it/s]
 15%|█▌        | 57139/371472 [4:33:08<24:44:38,  3.53it/s]
 15%|█▌        | 57140/371472 [4:33:08<24:50:58,  3.51it/s]
                                                           
{'loss': 4.2934, 'learning_rate': 8.619718158115882e-07, 'epoch': 2.46}

 15%|█▌        | 57140/371472 [4:33:08<24:50:58,  3.51it/s]
 15%|█▌        | 57141/371472 [4:33:08<23:55:35,  3.65it/s]
 15%|█▌        | 57142/371472 [4:33:08<24:02:36,  3.63it/s]
 15%|█▌        | 57143/371472 [4:33:09<24:24:17,  3.58it/s]
 15%|█▌        | 57144/371472 [4:33:09<23:33:27,  3.71it/s]
 15%|█▌        | 57145/371472 [4:33:09<25:03:22,  3.48it/s]
 15%|█▌        | 57146/371472 [4:33:10<24:53:46,  3.51it/s]
 15%|█▌        | 57147/371472 [4:33:10<25:53:54,  3.37it/s]
 15%|█▌        | 57148/371472 [4:33:10<24:21:51,  3.58it/s]
 15%|█▌        | 57149/371472 [4:33:10<23:43:23,  3.68it/s]
 15%|█▌        | 57150/371472 [4:33:11<23:02:52,  3.79it/s]
 15%|█▌        | 57151/371472 [4:33:11<23:09:35,  3.77it/s]
 15%|█▌        | 57152/371472 [4:33:11<25:04:48,  3.48it/s]
 15%|█▌        | 57153/371472 [4:33:11<24:39:56,  3.54it/s]
 15%|█▌        | 57154/371472 [4:33:12<25:15:57,  3.46it/s]
 15%|█▌        | 57155/371472 [4:33:12<25:43:49,  3.39it/s]
 15%|█▌        | 57156/371472 [4:33:12<28:20:55,  3.08it/s]
 15%|█▌        | 57157/371472 [4:33:13<29:12:04,  2.99it/s]
 15%|█▌        | 57158/371472 [4:33:13<28:22:54,  3.08it/s]
 15%|█▌        | 57159/371472 [4:33:13<26:30:27,  3.29it/s]
 15%|█▌        | 57160/371472 [4:33:14<27:24:26,  3.19it/s]
                                                           
{'loss': 4.1653, 'learning_rate': 8.619233338361093e-07, 'epoch': 2.46}

 15%|█▌        | 57160/371472 [4:33:14<27:24:26,  3.19it/s]
 15%|█▌        | 57161/371472 [4:33:14<26:49:22,  3.25it/s]
 15%|█▌        | 57162/371472 [4:33:14<26:47:27,  3.26it/s]
 15%|█▌        | 57163/371472 [4:33:15<26:32:03,  3.29it/s]
 15%|█▌        | 57164/371472 [4:33:15<26:25:39,  3.30it/s]
 15%|█▌        | 57165/371472 [4:33:15<25:31:55,  3.42it/s]
 15%|█▌        | 57166/371472 [4:33:15<24:29:16,  3.57it/s]
 15%|█▌        | 57167/371472 [4:33:16<26:10:56,  3.33it/s]
 15%|█▌        | 57168/371472 [4:33:16<25:52:25,  3.37it/s]
 15%|█▌        | 57169/371472 [4:33:16<25:00:12,  3.49it/s]
 15%|█▌        | 57170/371472 [4:33:17<25:10:23,  3.47it/s]
 15%|█▌        | 57171/371472 [4:33:17<24:40:36,  3.54it/s]
 15%|█▌        | 57172/371472 [4:33:17<25:54:03,  3.37it/s]
 15%|█▌        | 57173/371472 [4:33:18<26:20:21,  3.31it/s]
 15%|█▌        | 57174/371472 [4:33:18<26:21:40,  3.31it/s]
 15%|█▌        | 57175/371472 [4:33:18<27:15:55,  3.20it/s]
 15%|█▌        | 57176/371472 [4:33:18<26:20:12,  3.31it/s]
 15%|█▌        | 57177/371472 [4:33:19<24:50:47,  3.51it/s]
 15%|█▌        | 57178/371472 [4:33:19<25:02:10,  3.49it/s]
 15%|█▌        | 57179/371472 [4:33:19<24:02:44,  3.63it/s]
 15%|█▌        | 57180/371472 [4:33:19<22:52:58,  3.82it/s]
                                                           
{'loss': 4.2276, 'learning_rate': 8.618748518606304e-07, 'epoch': 2.46}

 15%|█▌        | 57180/371472 [4:33:19<22:52:58,  3.82it/s]
 15%|█▌        | 57181/371472 [4:33:20<22:53:33,  3.81it/s]
 15%|█▌        | 57182/371472 [4:33:20<22:27:02,  3.89it/s]
 15%|█▌        | 57183/371472 [4:33:20<23:15:36,  3.75it/s]
 15%|█▌        | 57184/371472 [4:33:21<22:55:04,  3.81it/s]
 15%|█▌        | 57185/371472 [4:33:21<25:17:31,  3.45it/s]
 15%|█▌        | 57186/371472 [4:33:21<25:36:14,  3.41it/s]
 15%|█▌        | 57187/371472 [4:33:22<27:17:29,  3.20it/s]
 15%|█▌        | 57188/371472 [4:33:22<29:46:25,  2.93it/s]
 15%|█▌        | 57189/371472 [4:33:22<27:55:11,  3.13it/s]
 15%|█▌        | 57190/371472 [4:33:23<27:34:18,  3.17it/s]
 15%|█▌        | 57191/371472 [4:33:23<25:58:05,  3.36it/s]
 15%|█▌        | 57192/371472 [4:33:23<25:06:30,  3.48it/s]
 15%|█▌        | 57193/371472 [4:33:23<24:56:01,  3.50it/s]
 15%|█▌        | 57194/371472 [4:33:24<25:58:34,  3.36it/s]
 15%|█▌        | 57195/371472 [4:33:24<25:28:19,  3.43it/s]
 15%|█▌        | 57196/371472 [4:33:24<27:00:13,  3.23it/s]
 15%|█▌        | 57197/371472 [4:33:25<26:00:45,  3.36it/s]
 15%|█▌        | 57198/371472 [4:33:25<24:25:01,  3.58it/s]
 15%|█▌        | 57199/371472 [4:33:25<24:41:10,  3.54it/s]
 15%|█▌        | 57200/371472 [4:33:25<24:16:58,  3.60it/s]
                                                           
{'loss': 4.1756, 'learning_rate': 8.618263698851515e-07, 'epoch': 2.46}

 15%|█▌        | 57200/371472 [4:33:25<24:16:58,  3.60it/s]
 15%|█▌        | 57201/371472 [4:33:26<23:41:20,  3.69it/s]
 15%|█▌        | 57202/371472 [4:33:26<23:04:59,  3.78it/s]
 15%|█▌        | 57203/371472 [4:33:26<22:15:42,  3.92it/s]
 15%|█▌        | 57204/371472 [4:33:26<22:14:54,  3.92it/s]
 15%|█▌        | 57205/371472 [4:33:27<23:58:49,  3.64it/s]
 15%|█▌        | 57206/371472 [4:33:27<23:28:43,  3.72it/s]
 15%|█▌        | 57207/371472 [4:33:27<23:07:46,  3.77it/s]
 15%|█▌        | 57208/371472 [4:33:27<22:53:03,  3.81it/s]
 15%|█▌        | 57209/371472 [4:33:28<23:16:50,  3.75it/s]
 15%|█▌        | 57210/371472 [4:33:28<23:42:52,  3.68it/s]
 15%|█▌        | 57211/371472 [4:33:28<24:37:01,  3.55it/s]
 15%|█▌        | 57212/371472 [4:33:29<24:09:52,  3.61it/s]
 15%|█▌        | 57213/371472 [4:33:29<23:40:03,  3.69it/s]
 15%|█▌        | 57214/371472 [4:33:29<25:25:19,  3.43it/s]
 15%|█▌        | 57215/371472 [4:33:29<24:31:44,  3.56it/s]
 15%|█▌        | 57216/371472 [4:33:30<25:54:28,  3.37it/s]
 15%|█▌        | 57217/371472 [4:33:30<26:12:53,  3.33it/s]
 15%|█▌        | 57218/371472 [4:33:30<25:02:29,  3.49it/s]
 15%|█▌        | 57219/371472 [4:33:31<24:56:36,  3.50it/s]
 15%|█▌        | 57220/371472 [4:33:31<24:14:52,  3.60it/s]
                                                           
{'loss': 4.2888, 'learning_rate': 8.617778879096727e-07, 'epoch': 2.46}

 15%|█▌        | 57220/371472 [4:33:31<24:14:52,  3.60it/s]
 15%|█▌        | 57221/371472 [4:33:31<24:06:14,  3.62it/s]
 15%|█▌        | 57222/371472 [4:33:31<23:18:02,  3.75it/s]
 15%|█▌        | 57223/371472 [4:33:32<23:37:16,  3.70it/s]
 15%|█▌        | 57224/371472 [4:33:32<23:36:14,  3.70it/s]
 15%|█▌        | 57225/371472 [4:33:32<23:17:56,  3.75it/s]
 15%|█▌        | 57226/371472 [4:33:32<24:05:11,  3.62it/s]
 15%|█▌        | 57227/371472 [4:33:33<24:34:42,  3.55it/s]
 15%|█▌        | 57228/371472 [4:33:33<25:02:00,  3.49it/s]
 15%|█▌        | 57229/371472 [4:33:33<24:33:22,  3.55it/s]
 15%|█▌        | 57230/371472 [4:33:34<24:09:31,  3.61it/s]
 15%|█▌        | 57231/371472 [4:33:34<24:15:17,  3.60it/s]
 15%|█▌        | 57232/371472 [4:33:34<24:34:01,  3.55it/s]
 15%|█▌        | 57233/371472 [4:33:34<23:27:07,  3.72it/s]
 15%|█▌        | 57234/371472 [4:33:35<22:52:38,  3.82it/s]
 15%|█▌        | 57235/371472 [4:33:35<22:34:31,  3.87it/s]
 15%|█▌        | 57236/371472 [4:33:35<24:09:24,  3.61it/s]
 15%|█▌        | 57237/371472 [4:33:35<23:47:09,  3.67it/s]
 15%|█▌        | 57238/371472 [4:33:36<25:52:06,  3.37it/s]
 15%|█▌        | 57239/371472 [4:33:36<25:36:05,  3.41it/s]
 15%|█▌        | 57240/371472 [4:33:36<26:05:24,  3.35it/s]
                                                           
{'loss': 4.1995, 'learning_rate': 8.617294059341938e-07, 'epoch': 2.47}

 15%|█▌        | 57240/371472 [4:33:36<26:05:24,  3.35it/s]
 15%|█▌        | 57241/371472 [4:33:37<24:32:56,  3.56it/s]
 15%|█▌        | 57242/371472 [4:33:37<25:33:36,  3.41it/s]
 15%|█▌        | 57243/371472 [4:33:37<25:08:22,  3.47it/s]
 15%|█▌        | 57244/371472 [4:33:38<24:30:58,  3.56it/s]
 15%|█▌        | 57245/371472 [4:33:38<24:27:14,  3.57it/s]
 15%|█▌        | 57246/371472 [4:33:38<23:23:01,  3.73it/s]
 15%|█▌        | 57247/371472 [4:33:38<23:27:51,  3.72it/s]
 15%|█▌        | 57248/371472 [4:33:39<22:35:04,  3.86it/s]
 15%|█▌        | 57249/371472 [4:33:39<23:24:49,  3.73it/s]
 15%|█▌        | 57250/371472 [4:33:39<24:01:55,  3.63it/s]
 15%|█▌        | 57251/371472 [4:33:39<23:44:14,  3.68it/s]
 15%|█▌        | 57252/371472 [4:33:40<23:37:37,  3.69it/s]
 15%|█▌        | 57253/371472 [4:33:40<23:34:11,  3.70it/s]
 15%|█▌        | 57254/371472 [4:33:40<23:12:58,  3.76it/s]
 15%|█▌        | 57255/371472 [4:33:41<24:16:24,  3.60it/s]
 15%|█▌        | 57256/371472 [4:33:41<24:57:58,  3.50it/s]
 15%|█▌        | 57257/371472 [4:33:41<24:32:35,  3.56it/s]
 15%|█▌        | 57258/371472 [4:33:41<24:41:43,  3.53it/s]
 15%|█▌        | 57259/371472 [4:33:42<23:42:20,  3.68it/s]
 15%|█▌        | 57260/371472 [4:33:42<23:57:45,  3.64it/s]
                                                           
{'loss': 4.2819, 'learning_rate': 8.616809239587149e-07, 'epoch': 2.47}

 15%|█▌        | 57260/371472 [4:33:42<23:57:45,  3.64it/s]
 15%|█▌        | 57261/371472 [4:33:42<25:13:48,  3.46it/s]
 15%|█▌        | 57262/371472 [4:33:42<24:17:37,  3.59it/s]
 15%|█▌        | 57263/371472 [4:33:43<23:19:51,  3.74it/s]
 15%|█▌        | 57264/371472 [4:33:43<24:08:33,  3.62it/s]
 15%|█▌        | 57265/371472 [4:33:43<23:38:24,  3.69it/s]
 15%|█▌        | 57266/371472 [4:33:44<24:07:06,  3.62it/s]
 15%|█▌        | 57267/371472 [4:33:44<26:02:17,  3.35it/s]
 15%|█▌        | 57268/371472 [4:33:44<25:26:05,  3.43it/s]
 15%|█▌        | 57269/371472 [4:33:44<25:06:17,  3.48it/s]
 15%|█▌        | 57270/371472 [4:33:45<26:41:09,  3.27it/s]
 15%|█▌        | 57271/371472 [4:33:45<25:29:04,  3.42it/s]
 15%|█▌        | 57272/371472 [4:33:45<26:56:43,  3.24it/s]
 15%|█▌        | 57273/371472 [4:33:46<25:14:01,  3.46it/s]
 15%|█▌        | 57274/371472 [4:33:46<25:19:26,  3.45it/s]
 15%|█▌        | 57275/371472 [4:33:46<24:34:03,  3.55it/s]
 15%|█▌        | 57276/371472 [4:33:46<23:35:47,  3.70it/s]
 15%|█▌        | 57277/371472 [4:33:47<24:02:04,  3.63it/s]
 15%|█▌        | 57278/371472 [4:33:47<24:14:52,  3.60it/s]
 15%|█▌        | 57279/371472 [4:33:47<24:07:26,  3.62it/s]
 15%|█▌        | 57280/371472 [4:33:48<24:03:22,  3.63it/s]
                                                           
{'loss': 4.3963, 'learning_rate': 8.616324419832359e-07, 'epoch': 2.47}

 15%|█▌        | 57280/371472 [4:33:48<24:03:22,  3.63it/s]
 15%|█▌        | 57281/371472 [4:33:48<24:12:43,  3.60it/s]
 15%|█▌        | 57282/371472 [4:33:48<24:19:09,  3.59it/s]
 15%|█▌        | 57283/371472 [4:33:48<24:14:55,  3.60it/s]
 15%|█▌        | 57284/371472 [4:33:49<25:42:00,  3.40it/s]
 15%|█▌        | 57285/371472 [4:33:49<24:13:16,  3.60it/s]
 15%|█▌        | 57286/371472 [4:33:49<24:07:37,  3.62it/s]
 15%|█▌        | 57287/371472 [4:33:50<23:43:13,  3.68it/s]
 15%|█▌        | 57288/371472 [4:33:50<24:05:15,  3.62it/s]
 15%|█▌        | 57289/371472 [4:33:50<24:20:00,  3.59it/s]
 15%|█▌        | 57290/371472 [4:33:50<26:03:40,  3.35it/s]
 15%|█▌        | 57291/371472 [4:33:51<24:25:40,  3.57it/s]
 15%|█▌        | 57292/371472 [4:33:51<25:28:53,  3.42it/s]
 15%|█▌        | 57293/371472 [4:33:51<26:04:25,  3.35it/s]
 15%|█▌        | 57294/371472 [4:33:52<24:58:03,  3.50it/s]
 15%|█▌        | 57295/371472 [4:33:52<25:30:00,  3.42it/s]
 15%|█▌        | 57296/371472 [4:33:52<24:44:39,  3.53it/s]
 15%|█▌        | 57297/371472 [4:33:53<31:51:27,  2.74it/s]
 15%|█▌        | 57298/371472 [4:33:53<29:25:55,  2.97it/s]
 15%|█▌        | 57299/371472 [4:33:53<26:42:14,  3.27it/s]
 15%|█▌        | 57300/371472 [4:33:54<26:48:41,  3.25it/s]
                                                           
{'loss': 4.3, 'learning_rate': 8.615839600077571e-07, 'epoch': 2.47}

 15%|█▌        | 57300/371472 [4:33:54<26:48:41,  3.25it/s]
 15%|█▌        | 57301/371472 [4:33:54<25:54:38,  3.37it/s]
 15%|█▌        | 57302/371472 [4:33:54<24:29:59,  3.56it/s]
 15%|█▌        | 57303/371472 [4:33:54<24:47:53,  3.52it/s]
 15%|█▌        | 57304/371472 [4:33:55<23:49:44,  3.66it/s]
 15%|█▌        | 57305/371472 [4:33:55<25:10:28,  3.47it/s]
 15%|█▌        | 57306/371472 [4:33:55<26:02:43,  3.35it/s]
 15%|█▌        | 57307/371472 [4:33:55<24:33:10,  3.55it/s]
 15%|█▌        | 57308/371472 [4:33:56<24:32:55,  3.55it/s]
 15%|█▌        | 57309/371472 [4:33:56<23:39:44,  3.69it/s]
 15%|█▌        | 57310/371472 [4:33:56<24:01:24,  3.63it/s]
 15%|█▌        | 57311/371472 [4:33:57<24:35:16,  3.55it/s]
 15%|█▌        | 57312/371472 [4:33:57<25:54:36,  3.37it/s]
 15%|█▌        | 57313/371472 [4:33:57<25:07:13,  3.47it/s]
 15%|█▌        | 57314/371472 [4:33:57<25:42:06,  3.40it/s]
 15%|█▌        | 57315/371472 [4:33:58<24:44:00,  3.53it/s]
 15%|█▌        | 57316/371472 [4:33:58<24:13:11,  3.60it/s]
 15%|█▌        | 57317/371472 [4:33:58<24:46:03,  3.52it/s]
 15%|█▌        | 57318/371472 [4:33:59<25:25:23,  3.43it/s]
 15%|█▌        | 57319/371472 [4:33:59<25:56:51,  3.36it/s]
 15%|█▌        | 57320/371472 [4:33:59<26:34:23,  3.28it/s]
                                                           
{'loss': 4.0509, 'learning_rate': 8.615354780322782e-07, 'epoch': 2.47}

 15%|█▌        | 57320/371472 [4:33:59<26:34:23,  3.28it/s]
 15%|█▌        | 57321/371472 [4:34:00<26:11:03,  3.33it/s]
 15%|█▌        | 57322/371472 [4:34:00<25:08:56,  3.47it/s]
 15%|█▌        | 57323/371472 [4:34:00<25:23:58,  3.44it/s]
 15%|█▌        | 57324/371472 [4:34:00<24:30:58,  3.56it/s]
 15%|█▌        | 57325/371472 [4:34:01<24:32:04,  3.56it/s]
 15%|█▌        | 57326/371472 [4:34:01<24:49:56,  3.51it/s]
 15%|█▌        | 57327/371472 [4:34:01<24:40:26,  3.54it/s]
 15%|█▌        | 57328/371472 [4:34:01<24:16:27,  3.59it/s]
 15%|█▌        | 57329/371472 [4:34:02<24:19:25,  3.59it/s]
 15%|█▌        | 57330/371472 [4:34:02<24:20:55,  3.58it/s]
 15%|█▌        | 57331/371472 [4:34:02<23:33:51,  3.70it/s]
 15%|█▌        | 57332/371472 [4:34:03<24:13:29,  3.60it/s]
 15%|█▌        | 57333/371472 [4:34:03<24:57:35,  3.50it/s]
 15%|█▌        | 57334/371472 [4:34:03<26:44:43,  3.26it/s]
 15%|█▌        | 57335/371472 [4:34:04<26:14:38,  3.32it/s]
 15%|█▌        | 57336/371472 [4:34:04<26:31:51,  3.29it/s]
 15%|█▌        | 57337/371472 [4:34:04<25:36:19,  3.41it/s]
 15%|█▌        | 57338/371472 [4:34:04<26:26:11,  3.30it/s]
 15%|█▌        | 57339/371472 [4:34:05<25:18:29,  3.45it/s]
 15%|█▌        | 57340/371472 [4:34:05<25:13:35,  3.46it/s]
                                                           
{'loss': 4.3817, 'learning_rate': 8.614869960567991e-07, 'epoch': 2.47}

 15%|█▌        | 57340/371472 [4:34:05<25:13:35,  3.46it/s]
 15%|█▌        | 57341/371472 [4:34:05<24:36:13,  3.55it/s]
 15%|█▌        | 57342/371472 [4:34:05<24:09:05,  3.61it/s]
 15%|█▌        | 57343/371472 [4:34:06<23:05:12,  3.78it/s]
 15%|█▌        | 57344/371472 [4:34:06<22:52:33,  3.81it/s]
 15%|█▌        | 57345/371472 [4:34:06<22:44:45,  3.84it/s]
 15%|█▌        | 57346/371472 [4:34:07<22:51:50,  3.82it/s]
 15%|█▌        | 57347/371472 [4:34:07<22:21:08,  3.90it/s]
 15%|█▌        | 57348/371472 [4:34:07<22:32:28,  3.87it/s]
 15%|█▌        | 57349/371472 [4:34:07<22:58:07,  3.80it/s]
 15%|█▌        | 57350/371472 [4:34:08<23:16:26,  3.75it/s]
 15%|█▌        | 57351/371472 [4:34:08<26:02:47,  3.35it/s]
 15%|█▌        | 57352/371472 [4:34:08<26:14:05,  3.33it/s]
 15%|█▌        | 57353/371472 [4:34:09<26:04:50,  3.35it/s]
 15%|█▌        | 57354/371472 [4:34:09<25:04:01,  3.48it/s]
 15%|█▌        | 57355/371472 [4:34:09<24:28:04,  3.57it/s]
 15%|█▌        | 57356/371472 [4:34:09<23:28:14,  3.72it/s]
 15%|█▌        | 57357/371472 [4:34:10<23:21:27,  3.74it/s]
 15%|█▌        | 57358/371472 [4:34:10<25:23:52,  3.44it/s]
 15%|█▌        | 57359/371472 [4:34:10<24:07:11,  3.62it/s]
 15%|█▌        | 57360/371472 [4:34:10<23:40:29,  3.69it/s]
                                                           
{'loss': 4.2557, 'learning_rate': 8.614385140813204e-07, 'epoch': 2.47}

 15%|█▌        | 57360/371472 [4:34:10<23:40:29,  3.69it/s]
 15%|█▌        | 57361/371472 [4:34:11<23:37:11,  3.69it/s]
 15%|█▌        | 57362/371472 [4:34:11<25:23:36,  3.44it/s]
 15%|█▌        | 57363/371472 [4:34:11<26:52:36,  3.25it/s]
 15%|█▌        | 57364/371472 [4:34:12<26:49:58,  3.25it/s]
 15%|█▌        | 57365/371472 [4:34:12<25:06:12,  3.48it/s]
 15%|█▌        | 57366/371472 [4:34:12<24:12:16,  3.60it/s]
 15%|█▌        | 57367/371472 [4:34:12<24:37:07,  3.54it/s]
 15%|█▌        | 57368/371472 [4:34:13<24:25:19,  3.57it/s]
 15%|█▌        | 57369/371472 [4:34:13<24:46:54,  3.52it/s]
 15%|█▌        | 57370/371472 [4:34:13<23:54:31,  3.65it/s]
 15%|█▌        | 57371/371472 [4:34:14<23:28:27,  3.72it/s]
 15%|█▌        | 57372/371472 [4:34:14<23:48:36,  3.66it/s]
 15%|█▌        | 57373/371472 [4:34:14<24:08:04,  3.62it/s]
 15%|█▌        | 57374/371472 [4:34:14<23:33:07,  3.70it/s]
 15%|█▌        | 57375/371472 [4:34:15<23:17:23,  3.75it/s]
 15%|█▌        | 57376/371472 [4:34:15<22:54:45,  3.81it/s]
 15%|█▌        | 57377/371472 [4:34:15<24:25:30,  3.57it/s]
 15%|█▌        | 57378/371472 [4:34:16<26:55:39,  3.24it/s]
 15%|█▌        | 57379/371472 [4:34:16<25:50:52,  3.38it/s]
 15%|█▌        | 57380/371472 [4:34:16<25:11:05,  3.46it/s]
                                                           
{'loss': 4.3308, 'learning_rate': 8.613900321058416e-07, 'epoch': 2.47}

 15%|█▌        | 57380/371472 [4:34:16<25:11:05,  3.46it/s]
 15%|█▌        | 57381/371472 [4:34:16<24:48:42,  3.52it/s]
 15%|█▌        | 57382/371472 [4:34:17<23:52:57,  3.65it/s]
 15%|█▌        | 57383/371472 [4:34:17<23:31:43,  3.71it/s]
 15%|█▌        | 57384/371472 [4:34:17<23:34:43,  3.70it/s]
 15%|█▌        | 57385/371472 [4:34:17<22:56:31,  3.80it/s]
 15%|█▌        | 57386/371472 [4:34:18<23:56:19,  3.64it/s]
 15%|█▌        | 57387/371472 [4:34:18<23:11:30,  3.76it/s]
 15%|█▌        | 57388/371472 [4:34:18<23:08:04,  3.77it/s]
 15%|█▌        | 57389/371472 [4:34:18<22:59:12,  3.80it/s]
 15%|█▌        | 57390/371472 [4:34:19<22:41:53,  3.84it/s]
 15%|█▌        | 57391/371472 [4:34:19<23:18:47,  3.74it/s]
 15%|█▌        | 57392/371472 [4:34:19<23:04:24,  3.78it/s]
 15%|█▌        | 57393/371472 [4:34:20<24:38:11,  3.54it/s]
 15%|█▌        | 57394/371472 [4:34:20<24:11:38,  3.61it/s]
 15%|█▌        | 57395/371472 [4:34:20<24:46:54,  3.52it/s]
 15%|█▌        | 57396/371472 [4:34:20<24:32:25,  3.56it/s]
 15%|█▌        | 57397/371472 [4:34:21<24:15:02,  3.60it/s]
 15%|█▌        | 57398/371472 [4:34:21<24:21:22,  3.58it/s]
 15%|█▌        | 57399/371472 [4:34:21<24:37:16,  3.54it/s]
 15%|█▌        | 57400/371472 [4:34:22<24:23:43,  3.58it/s]
                                                           
{'loss': 4.3975, 'learning_rate': 8.613415501303626e-07, 'epoch': 2.47}

 15%|█▌        | 57400/371472 [4:34:22<24:23:43,  3.58it/s]
 15%|█▌        | 57401/371472 [4:34:22<24:36:08,  3.55it/s]
 15%|█▌        | 57402/371472 [4:34:22<23:30:25,  3.71it/s]
 15%|█▌        | 57403/371472 [4:34:22<25:30:50,  3.42it/s]
 15%|█▌        | 57404/371472 [4:34:23<24:10:02,  3.61it/s]
 15%|█▌        | 57405/371472 [4:34:23<25:00:09,  3.49it/s]
 15%|█▌        | 57406/371472 [4:34:23<24:29:48,  3.56it/s]
 15%|█▌        | 57407/371472 [4:34:24<26:10:19,  3.33it/s]
 15%|█▌        | 57408/371472 [4:34:24<26:28:35,  3.29it/s]
 15%|█▌        | 57409/371472 [4:34:24<24:47:30,  3.52it/s]
 15%|█▌        | 57410/371472 [4:34:24<25:02:21,  3.48it/s]
 15%|█▌        | 57411/371472 [4:34:25<24:38:54,  3.54it/s]
 15%|█▌        | 57412/371472 [4:34:25<23:54:13,  3.65it/s]
 15%|█▌        | 57413/371472 [4:34:25<24:40:10,  3.54it/s]
 15%|█▌        | 57414/371472 [4:34:26<23:44:57,  3.67it/s]
 15%|█▌        | 57415/371472 [4:34:26<24:47:29,  3.52it/s]
 15%|█▌        | 57416/371472 [4:34:26<24:11:19,  3.61it/s]
 15%|█▌        | 57417/371472 [4:34:26<25:43:43,  3.39it/s]
 15%|█▌        | 57418/371472 [4:34:27<25:00:26,  3.49it/s]
 15%|█▌        | 57419/371472 [4:34:27<24:10:56,  3.61it/s]
 15%|█▌        | 57420/371472 [4:34:27<24:22:01,  3.58it/s]
                                                           
{'loss': 4.1042, 'learning_rate': 8.612930681548836e-07, 'epoch': 2.47}

 15%|█▌        | 57420/371472 [4:34:27<24:22:01,  3.58it/s]
 15%|█▌        | 57421/371472 [4:34:28<26:21:03,  3.31it/s]
 15%|█▌        | 57422/371472 [4:34:28<24:47:55,  3.52it/s]
 15%|█▌        | 57423/371472 [4:34:28<23:43:08,  3.68it/s]
 15%|█▌        | 57424/371472 [4:34:28<24:11:35,  3.61it/s]
 15%|█▌        | 57425/371472 [4:34:29<23:28:01,  3.72it/s]
 15%|█▌        | 57426/371472 [4:34:29<23:46:04,  3.67it/s]
 15%|█▌        | 57427/371472 [4:34:29<23:37:29,  3.69it/s]
 15%|█▌        | 57428/371472 [4:34:29<23:11:04,  3.76it/s]
 15%|█▌        | 57429/371472 [4:34:30<23:09:44,  3.77it/s]
 15%|█▌        | 57430/371472 [4:34:30<24:13:49,  3.60it/s]
 15%|█▌        | 57431/371472 [4:34:30<23:56:30,  3.64it/s]
 15%|█▌        | 57432/371472 [4:34:30<23:29:52,  3.71it/s]
 15%|█▌        | 57433/371472 [4:34:31<23:53:00,  3.65it/s]
 15%|█▌        | 57434/371472 [4:34:31<24:25:39,  3.57it/s]
 15%|█▌        | 57435/371472 [4:34:31<24:51:49,  3.51it/s]
 15%|█▌        | 57436/371472 [4:34:32<24:27:20,  3.57it/s]
 15%|█▌        | 57437/371472 [4:34:32<23:48:34,  3.66it/s]
 15%|█▌        | 57438/371472 [4:34:32<23:17:04,  3.75it/s]
 15%|█▌        | 57439/371472 [4:34:32<23:06:37,  3.77it/s]
 15%|█▌        | 57440/371472 [4:34:33<22:44:59,  3.83it/s]
                                                           
{'loss': 4.2089, 'learning_rate': 8.612445861794049e-07, 'epoch': 2.47}

 15%|█▌        | 57440/371472 [4:34:33<22:44:59,  3.83it/s]
 15%|█▌        | 57441/371472 [4:34:33<22:36:45,  3.86it/s]
 15%|█▌        | 57442/371472 [4:34:33<24:07:46,  3.62it/s]
 15%|█▌        | 57443/371472 [4:34:34<24:32:30,  3.55it/s]
 15%|█▌        | 57444/371472 [4:34:34<25:27:49,  3.43it/s]
 15%|█▌        | 57445/371472 [4:34:34<26:46:15,  3.26it/s]
 15%|█▌        | 57446/371472 [4:34:34<25:15:41,  3.45it/s]
 15%|█▌        | 57447/371472 [4:34:35<25:50:16,  3.38it/s]
 15%|█▌        | 57448/371472 [4:34:35<26:04:13,  3.35it/s]
 15%|█▌        | 57449/371472 [4:34:35<24:35:02,  3.55it/s]
 15%|█▌        | 57450/371472 [4:34:36<24:15:16,  3.60it/s]
 15%|█▌        | 57451/371472 [4:34:36<26:02:54,  3.35it/s]
 15%|█▌        | 57452/371472 [4:34:36<25:14:39,  3.46it/s]
 15%|█▌        | 57453/371472 [4:34:36<24:18:00,  3.59it/s]
 15%|█▌        | 57454/371472 [4:34:37<23:40:09,  3.69it/s]
 15%|█▌        | 57455/371472 [4:34:37<24:03:12,  3.63it/s]
 15%|█▌        | 57456/371472 [4:34:37<23:36:26,  3.69it/s]
 15%|█▌        | 57457/371472 [4:34:38<23:50:07,  3.66it/s]
 15%|█▌        | 57458/371472 [4:34:38<25:27:09,  3.43it/s]
 15%|█▌        | 57459/371472 [4:34:38<25:12:17,  3.46it/s]
 15%|█▌        | 57460/371472 [4:34:39<30:13:11,  2.89it/s]
                                                           
{'loss': 4.1088, 'learning_rate': 8.611961042039259e-07, 'epoch': 2.47}

 15%|█▌        | 57460/371472 [4:34:39<30:13:11,  2.89it/s]
 15%|█▌        | 57461/371472 [4:34:39<28:35:04,  3.05it/s]
 15%|█▌        | 57462/371472 [4:34:39<28:11:56,  3.09it/s]
 15%|█▌        | 57463/371472 [4:34:39<26:10:35,  3.33it/s]
 15%|█▌        | 57464/371472 [4:34:40<25:19:18,  3.44it/s]
 15%|█▌        | 57465/371472 [4:34:40<24:28:18,  3.56it/s]
 15%|█▌        | 57466/371472 [4:34:40<27:18:35,  3.19it/s]
 15%|█▌        | 57467/371472 [4:34:41<27:27:07,  3.18it/s]
 15%|█▌        | 57468/371472 [4:34:41<26:04:54,  3.34it/s]
 15%|█▌        | 57469/371472 [4:34:41<24:37:50,  3.54it/s]
 15%|█▌        | 57470/371472 [4:34:41<24:00:00,  3.63it/s]
 15%|█▌        | 57471/371472 [4:34:42<27:39:11,  3.15it/s]
 15%|█▌        | 57472/371472 [4:34:42<26:05:47,  3.34it/s]
 15%|█▌        | 57473/371472 [4:34:42<25:46:02,  3.38it/s]
 15%|█▌        | 57474/371472 [4:34:43<26:20:43,  3.31it/s]
 15%|█▌        | 57475/371472 [4:34:43<25:25:02,  3.43it/s]
 15%|█▌        | 57476/371472 [4:34:43<25:16:09,  3.45it/s]
 15%|█▌        | 57477/371472 [4:34:44<24:43:13,  3.53it/s]
 15%|█▌        | 57478/371472 [4:34:44<25:18:16,  3.45it/s]
 15%|█▌        | 57479/371472 [4:34:44<25:11:58,  3.46it/s]
 15%|█▌        | 57480/371472 [4:34:44<25:48:28,  3.38it/s]
                                                           
{'loss': 4.3419, 'learning_rate': 8.611476222284471e-07, 'epoch': 2.48}

 15%|█▌        | 57480/371472 [4:34:44<25:48:28,  3.38it/s]
 15%|█▌        | 57481/371472 [4:34:45<26:15:00,  3.32it/s]
 15%|█▌        | 57482/371472 [4:34:45<25:58:11,  3.36it/s]
 15%|█▌        | 57483/371472 [4:34:45<25:13:42,  3.46it/s]
 15%|█▌        | 57484/371472 [4:34:46<24:48:50,  3.51it/s]
 15%|█▌        | 57485/371472 [4:34:46<24:58:45,  3.49it/s]
 15%|█▌        | 57486/371472 [4:34:46<23:37:48,  3.69it/s]
 15%|█▌        | 57487/371472 [4:34:46<25:21:12,  3.44it/s]
 15%|█▌        | 57488/371472 [4:34:47<24:06:42,  3.62it/s]
 15%|█▌        | 57489/371472 [4:34:47<23:46:33,  3.67it/s]
 15%|█▌        | 57490/371472 [4:34:47<23:51:57,  3.65it/s]
 15%|█▌        | 57491/371472 [4:34:48<24:20:55,  3.58it/s]
 15%|█▌        | 57492/371472 [4:34:48<23:57:59,  3.64it/s]
 15%|█▌        | 57493/371472 [4:34:48<23:35:43,  3.70it/s]
 15%|█▌        | 57494/371472 [4:34:48<23:48:43,  3.66it/s]
 15%|█▌        | 57495/371472 [4:34:49<23:04:27,  3.78it/s]
 15%|█▌        | 57496/371472 [4:34:49<22:26:13,  3.89it/s]
 15%|█▌        | 57497/371472 [4:34:49<22:49:21,  3.82it/s]
 15%|█▌        | 57498/371472 [4:34:49<23:53:25,  3.65it/s]
 15%|█▌        | 57499/371472 [4:34:50<25:10:14,  3.46it/s]
 15%|█▌        | 57500/371472 [4:34:50<24:26:30,  3.57it/s]
                                                           
{'loss': 4.2666, 'learning_rate': 8.610991402529681e-07, 'epoch': 2.48}

 15%|█▌        | 57500/371472 [4:34:50<24:26:30,  3.57it/s]
 15%|█▌        | 57501/371472 [4:34:50<23:57:03,  3.64it/s]
 15%|█▌        | 57502/371472 [4:34:51<24:11:52,  3.60it/s]
 15%|█▌        | 57503/371472 [4:34:51<25:51:08,  3.37it/s]
 15%|█▌        | 57504/371472 [4:34:51<25:39:58,  3.40it/s]
 15%|█▌        | 57505/371472 [4:34:51<25:20:07,  3.44it/s]
 15%|█▌        | 57506/371472 [4:34:52<24:30:11,  3.56it/s]
 15%|█▌        | 57507/371472 [4:34:52<24:20:43,  3.58it/s]
 15%|█▌        | 57508/371472 [4:34:52<23:15:00,  3.75it/s]
 15%|█▌        | 57509/371472 [4:34:52<23:07:06,  3.77it/s]
 15%|█▌        | 57510/371472 [4:34:53<23:35:42,  3.70it/s]
 15%|█▌        | 57511/371472 [4:34:53<23:25:17,  3.72it/s]
 15%|█▌        | 57512/371472 [4:34:53<24:33:15,  3.55it/s]
 15%|█▌        | 57513/371472 [4:34:54<23:52:18,  3.65it/s]
 15%|█▌        | 57514/371472 [4:34:54<23:16:49,  3.75it/s]
 15%|█▌        | 57515/371472 [4:34:54<23:58:31,  3.64it/s]
 15%|█▌        | 57516/371472 [4:34:54<25:04:50,  3.48it/s]
 15%|█▌        | 57517/371472 [4:34:55<24:45:55,  3.52it/s]
 15%|█▌        | 57518/371472 [4:34:55<25:47:57,  3.38it/s]
 15%|█▌        | 57519/371472 [4:34:55<24:57:18,  3.49it/s]
 15%|█▌        | 57520/371472 [4:34:56<24:19:54,  3.58it/s]
                                                           
{'loss': 4.252, 'learning_rate': 8.610506582774892e-07, 'epoch': 2.48}

 15%|█▌        | 57520/371472 [4:34:56<24:19:54,  3.58it/s]
 15%|█▌        | 57521/371472 [4:34:56<23:16:48,  3.75it/s]
 15%|█▌        | 57522/371472 [4:34:56<22:59:36,  3.79it/s]
 15%|█▌        | 57523/371472 [4:34:56<23:00:38,  3.79it/s]
 15%|█▌        | 57524/371472 [4:34:57<22:48:25,  3.82it/s]
 15%|█▌        | 57525/371472 [4:34:57<22:05:39,  3.95it/s]
 15%|█▌        | 57526/371472 [4:34:57<24:04:53,  3.62it/s]
 15%|█▌        | 57527/371472 [4:34:57<24:58:10,  3.49it/s]
 15%|█▌        | 57528/371472 [4:34:58<28:51:28,  3.02it/s]
 15%|█▌        | 57529/371472 [4:34:58<28:53:17,  3.02it/s]
 15%|█▌        | 57530/371472 [4:34:59<27:23:24,  3.18it/s]
 15%|█▌        | 57531/371472 [4:34:59<26:45:41,  3.26it/s]
 15%|█▌        | 57532/371472 [4:34:59<26:07:39,  3.34it/s]
 15%|█▌        | 57533/371472 [4:34:59<24:22:32,  3.58it/s]
 15%|█▌        | 57534/371472 [4:35:00<23:53:45,  3.65it/s]
 15%|█▌        | 57535/371472 [4:35:00<24:24:03,  3.57it/s]
 15%|█▌        | 57536/371472 [4:35:00<24:09:23,  3.61it/s]
 15%|█▌        | 57537/371472 [4:35:00<23:23:25,  3.73it/s]
 15%|█▌        | 57538/371472 [4:35:01<24:43:14,  3.53it/s]
 15%|█▌        | 57539/371472 [4:35:01<23:58:26,  3.64it/s]
 15%|█▌        | 57540/371472 [4:35:01<23:21:04,  3.73it/s]
                                                           
{'loss': 4.0077, 'learning_rate': 8.610021763020103e-07, 'epoch': 2.48}

 15%|█▌        | 57540/371472 [4:35:01<23:21:04,  3.73it/s]
 15%|█▌        | 57541/371472 [4:35:01<23:25:36,  3.72it/s]
 15%|█▌        | 57542/371472 [4:35:02<23:57:28,  3.64it/s]
 15%|█▌        | 57543/371472 [4:35:02<23:35:09,  3.70it/s]
 15%|█▌        | 57544/371472 [4:35:02<24:30:22,  3.56it/s]
 15%|█▌        | 57545/371472 [4:35:03<24:44:24,  3.52it/s]
 15%|█▌        | 57546/371472 [4:35:03<24:37:44,  3.54it/s]
 15%|█▌        | 57547/371472 [4:35:03<23:53:31,  3.65it/s]
 15%|█▌        | 57548/371472 [4:35:03<23:20:47,  3.74it/s]
 15%|█▌        | 57549/371472 [4:35:04<26:19:05,  3.31it/s]
 15%|█▌        | 57550/371472 [4:35:04<28:05:40,  3.10it/s]
 15%|█▌        | 57551/371472 [4:35:04<27:37:54,  3.16it/s]
 15%|█▌        | 57552/371472 [4:35:05<27:44:36,  3.14it/s]
 15%|█▌        | 57553/371472 [4:35:05<27:04:01,  3.22it/s]
 15%|█▌        | 57554/371472 [4:35:05<26:08:54,  3.33it/s]
 15%|█▌        | 57555/371472 [4:35:06<25:17:21,  3.45it/s]
 15%|█▌        | 57556/371472 [4:35:06<25:01:35,  3.48it/s]
 15%|█▌        | 57557/371472 [4:35:06<24:12:10,  3.60it/s]
 15%|█▌        | 57558/371472 [4:35:06<23:41:33,  3.68it/s]
 15%|█▌        | 57559/371472 [4:35:07<24:10:35,  3.61it/s]
 15%|█▌        | 57560/371472 [4:35:07<23:20:00,  3.74it/s]
                                                           
{'loss': 3.9771, 'learning_rate': 8.609536943265315e-07, 'epoch': 2.48}

 15%|█▌        | 57560/371472 [4:35:07<23:20:00,  3.74it/s]
 15%|█▌        | 57561/371472 [4:35:07<24:48:37,  3.51it/s]
 15%|█▌        | 57562/371472 [4:35:08<24:01:50,  3.63it/s]
 15%|█▌        | 57563/371472 [4:35:08<23:43:04,  3.68it/s]
 15%|█▌        | 57564/371472 [4:35:08<24:28:34,  3.56it/s]
 15%|█▌        | 57565/371472 [4:35:08<24:30:27,  3.56it/s]
 15%|█▌        | 57566/371472 [4:35:09<24:18:52,  3.59it/s]
 15%|█▌        | 57567/371472 [4:35:09<23:40:06,  3.68it/s]
 15%|█▌        | 57568/371472 [4:35:09<23:46:50,  3.67it/s]
 15%|█▌        | 57569/371472 [4:35:09<23:17:24,  3.74it/s]
 15%|█▌        | 57570/371472 [4:35:10<23:04:11,  3.78it/s]
 15%|█▌        | 57571/371472 [4:35:10<23:42:25,  3.68it/s]
 15%|█▌        | 57572/371472 [4:35:10<24:03:32,  3.62it/s]
 15%|█▌        | 57573/371472 [4:35:11<23:58:02,  3.64it/s]
 15%|█▌        | 57574/371472 [4:35:11<23:22:56,  3.73it/s]
 15%|█▌        | 57575/371472 [4:35:11<23:22:52,  3.73it/s]
 15%|█▌        | 57576/371472 [4:35:11<23:40:52,  3.68it/s]
 15%|█▌        | 57577/371472 [4:35:12<23:58:17,  3.64it/s]
 15%|█▌        | 57578/371472 [4:35:12<22:55:48,  3.80it/s]
 16%|█▌        | 57579/371472 [4:35:12<24:49:32,  3.51it/s]
 16%|█▌        | 57580/371472 [4:35:12<24:33:46,  3.55it/s]
                                                           
{'loss': 4.2792, 'learning_rate': 8.609052123510525e-07, 'epoch': 2.48}

 16%|█▌        | 57580/371472 [4:35:12<24:33:46,  3.55it/s]
 16%|█▌        | 57581/371472 [4:35:13<24:31:00,  3.56it/s]
 16%|█▌        | 57582/371472 [4:35:13<23:27:11,  3.72it/s]
 16%|█▌        | 57583/371472 [4:35:13<24:01:16,  3.63it/s]
 16%|█▌        | 57584/371472 [4:35:14<24:06:15,  3.62it/s]
 16%|█▌        | 57585/371472 [4:35:14<23:35:05,  3.70it/s]
 16%|█▌        | 57586/371472 [4:35:14<23:20:26,  3.74it/s]
 16%|█▌        | 57587/371472 [4:35:14<23:14:00,  3.75it/s]
 16%|█▌        | 57588/371472 [4:35:15<22:39:09,  3.85it/s]
 16%|█▌        | 57589/371472 [4:35:15<25:57:21,  3.36it/s]
 16%|█▌        | 57590/371472 [4:35:15<25:14:08,  3.45it/s]
 16%|█▌        | 57591/371472 [4:35:15<24:04:11,  3.62it/s]
 16%|█▌        | 57592/371472 [4:35:16<23:32:01,  3.70it/s]
 16%|█▌        | 57593/371472 [4:35:16<22:45:41,  3.83it/s]
 16%|█▌        | 57594/371472 [4:35:16<22:36:11,  3.86it/s]
 16%|█▌        | 57595/371472 [4:35:17<23:06:29,  3.77it/s]
 16%|█▌        | 57596/371472 [4:35:17<23:05:09,  3.78it/s]
 16%|█▌        | 57597/371472 [4:35:17<22:56:09,  3.80it/s]
 16%|█▌        | 57598/371472 [4:35:17<23:46:20,  3.67it/s]
 16%|█▌        | 57599/371472 [4:35:18<23:17:25,  3.74it/s]
 16%|█▌        | 57600/371472 [4:35:18<22:35:31,  3.86it/s]
                                                           
{'loss': 4.3579, 'learning_rate': 8.608567303755737e-07, 'epoch': 2.48}

 16%|█▌        | 57600/371472 [4:35:18<22:35:31,  3.86it/s]
 16%|█▌        | 57601/371472 [4:35:18<22:33:57,  3.86it/s]
 16%|█▌        | 57602/371472 [4:35:18<23:51:51,  3.65it/s]
 16%|█▌        | 57603/371472 [4:35:19<24:09:38,  3.61it/s]
 16%|█▌        | 57604/371472 [4:35:19<24:48:43,  3.51it/s]
 16%|█▌        | 57605/371472 [4:35:19<25:30:57,  3.42it/s]
 16%|█▌        | 57606/371472 [4:35:20<24:35:31,  3.55it/s]
 16%|█▌        | 57607/371472 [4:35:20<26:41:36,  3.27it/s]
 16%|█▌        | 57608/371472 [4:35:20<25:20:01,  3.44it/s]
 16%|█▌        | 57609/371472 [4:35:20<24:20:24,  3.58it/s]
 16%|█▌        | 57610/371472 [4:35:21<25:07:25,  3.47it/s]
 16%|█▌        | 57611/371472 [4:35:21<24:07:50,  3.61it/s]
 16%|█▌        | 57612/371472 [4:35:21<23:55:57,  3.64it/s]
 16%|█▌        | 57613/371472 [4:35:22<24:43:09,  3.53it/s]
 16%|█▌        | 57614/371472 [4:35:22<25:16:29,  3.45it/s]
 16%|█▌        | 57615/371472 [4:35:22<24:37:36,  3.54it/s]
 16%|█▌        | 57616/371472 [4:35:22<24:19:55,  3.58it/s]
 16%|█▌        | 57617/371472 [4:35:23<23:49:56,  3.66it/s]
 16%|█▌        | 57618/371472 [4:35:23<23:56:07,  3.64it/s]
 16%|█▌        | 57619/371472 [4:35:23<22:48:59,  3.82it/s]
 16%|█▌        | 57620/371472 [4:35:23<22:11:38,  3.93it/s]
                                                           
{'loss': 4.29, 'learning_rate': 8.608082484000948e-07, 'epoch': 2.48}

 16%|█▌        | 57620/371472 [4:35:23<22:11:38,  3.93it/s]
 16%|█▌        | 57621/371472 [4:35:24<22:05:53,  3.95it/s]
 16%|█▌        | 57622/371472 [4:35:24<22:14:14,  3.92it/s]
 16%|█▌        | 57623/371472 [4:35:24<22:38:04,  3.85it/s]
 16%|█▌        | 57624/371472 [4:35:24<22:20:42,  3.90it/s]
 16%|█▌        | 57625/371472 [4:35:25<22:24:11,  3.89it/s]
 16%|█▌        | 57626/371472 [4:35:25<23:44:30,  3.67it/s]
 16%|█▌        | 57627/371472 [4:35:25<23:50:22,  3.66it/s]
 16%|█▌        | 57628/371472 [4:35:26<23:22:00,  3.73it/s]
 16%|█▌        | 57629/371472 [4:35:26<24:26:04,  3.57it/s]
 16%|█▌        | 57630/371472 [4:35:26<23:41:06,  3.68it/s]
 16%|█▌        | 57631/371472 [4:35:26<25:15:42,  3.45it/s]
 16%|█▌        | 57632/371472 [4:35:27<25:51:14,  3.37it/s]
 16%|█▌        | 57633/371472 [4:35:27<24:45:23,  3.52it/s]
 16%|█▌        | 57634/371472 [4:35:27<25:40:46,  3.39it/s]
 16%|█▌        | 57635/371472 [4:35:28<24:35:30,  3.54it/s]
 16%|█▌        | 57636/371472 [4:35:28<25:12:25,  3.46it/s]
 16%|█▌        | 57637/371472 [4:35:28<26:16:29,  3.32it/s]
 16%|█▌        | 57638/371472 [4:35:28<25:27:04,  3.43it/s]
 16%|█▌        | 57639/371472 [4:35:29<26:17:09,  3.32it/s]
 16%|█▌        | 57640/371472 [4:35:29<24:46:51,  3.52it/s]
                                                           
{'loss': 4.3093, 'learning_rate': 8.60759766424616e-07, 'epoch': 2.48}

 16%|█▌        | 57640/371472 [4:35:29<24:46:51,  3.52it/s]
 16%|█▌        | 57641/371472 [4:35:29<24:45:03,  3.52it/s]
 16%|█▌        | 57642/371472 [4:35:30<23:34:02,  3.70it/s]
 16%|█▌        | 57643/371472 [4:35:30<22:58:51,  3.79it/s]
 16%|█▌        | 57644/371472 [4:35:30<22:37:15,  3.85it/s]
 16%|█▌        | 57645/371472 [4:35:30<23:39:06,  3.69it/s]
 16%|█▌        | 57646/371472 [4:35:31<23:04:07,  3.78it/s]
 16%|█▌        | 57647/371472 [4:35:31<23:00:33,  3.79it/s]
 16%|█▌        | 57648/371472 [4:35:31<24:27:35,  3.56it/s]
 16%|█▌        | 57649/371472 [4:35:31<23:32:49,  3.70it/s]
 16%|█▌        | 57650/371472 [4:35:32<23:30:00,  3.71it/s]
 16%|█▌        | 57651/371472 [4:35:32<22:52:57,  3.81it/s]
 16%|█▌        | 57652/371472 [4:35:32<23:56:57,  3.64it/s]
 16%|█▌        | 57653/371472 [4:35:33<25:26:19,  3.43it/s]
 16%|█▌        | 57654/371472 [4:35:33<26:52:28,  3.24it/s]
 16%|█▌        | 57655/371472 [4:35:33<26:59:14,  3.23it/s]
 16%|█▌        | 57656/371472 [4:35:34<26:46:35,  3.26it/s]
 16%|█▌        | 57657/371472 [4:35:34<29:36:00,  2.94it/s]
 16%|█▌        | 57658/371472 [4:35:34<28:07:08,  3.10it/s]
 16%|█▌        | 57659/371472 [4:35:35<27:17:32,  3.19it/s]
 16%|█▌        | 57660/371472 [4:35:35<26:45:14,  3.26it/s]
                                                           
{'loss': 4.3589, 'learning_rate': 8.607112844491369e-07, 'epoch': 2.48}

 16%|█▌        | 57660/371472 [4:35:35<26:45:14,  3.26it/s]
 16%|█▌        | 57661/371472 [4:35:35<26:06:20,  3.34it/s]
 16%|█▌        | 57662/371472 [4:35:35<24:45:05,  3.52it/s]
 16%|█▌        | 57663/371472 [4:35:36<24:37:53,  3.54it/s]
 16%|█▌        | 57664/371472 [4:35:36<23:20:00,  3.74it/s]
 16%|█▌        | 57665/371472 [4:35:36<23:49:01,  3.66it/s]
 16%|█▌        | 57666/371472 [4:35:36<22:44:32,  3.83it/s]
 16%|█▌        | 57667/371472 [4:35:37<23:33:11,  3.70it/s]
 16%|█▌        | 57668/371472 [4:35:37<23:43:19,  3.67it/s]
 16%|█▌        | 57669/371472 [4:35:37<23:22:47,  3.73it/s]
 16%|█▌        | 57670/371472 [4:35:37<23:50:50,  3.66it/s]
 16%|█▌        | 57671/371472 [4:35:38<22:56:16,  3.80it/s]
 16%|█▌        | 57672/371472 [4:35:38<22:16:34,  3.91it/s]
 16%|█▌        | 57673/371472 [4:35:38<23:09:23,  3.76it/s]
 16%|█▌        | 57674/371472 [4:35:39<23:19:24,  3.74it/s]
 16%|█▌        | 57675/371472 [4:35:39<23:29:25,  3.71it/s]
 16%|█▌        | 57676/371472 [4:35:39<22:44:34,  3.83it/s]
 16%|█▌        | 57677/371472 [4:35:39<22:00:40,  3.96it/s]
 16%|█▌        | 57678/371472 [4:35:40<23:20:49,  3.73it/s]
 16%|█▌        | 57679/371472 [4:35:40<25:02:28,  3.48it/s]
 16%|█▌        | 57680/371472 [4:35:40<23:50:22,  3.66it/s]
                                                           
{'loss': 4.4272, 'learning_rate': 8.606628024736581e-07, 'epoch': 2.48}

 16%|█▌        | 57680/371472 [4:35:40<23:50:22,  3.66it/s]
 16%|█▌        | 57681/371472 [4:35:40<25:11:26,  3.46it/s]
 16%|█▌        | 57682/371472 [4:35:41<25:39:10,  3.40it/s]
 16%|█▌        | 57683/371472 [4:35:41<27:30:50,  3.17it/s]
 16%|█▌        | 57684/371472 [4:35:41<25:52:54,  3.37it/s]
 16%|█▌        | 57685/371472 [4:35:42<25:03:49,  3.48it/s]
 16%|█▌        | 57686/371472 [4:35:42<25:49:17,  3.38it/s]
 16%|█▌        | 57687/371472 [4:35:42<24:24:21,  3.57it/s]
 16%|█▌        | 57688/371472 [4:35:42<23:49:17,  3.66it/s]
 16%|█▌        | 57689/371472 [4:35:43<24:04:15,  3.62it/s]
 16%|█▌        | 57690/371472 [4:35:43<26:20:23,  3.31it/s]
 16%|█▌        | 57691/371472 [4:35:43<27:44:16,  3.14it/s]
 16%|█▌        | 57692/371472 [4:35:44<30:19:06,  2.87it/s]
 16%|█▌        | 57693/371472 [4:35:44<28:28:29,  3.06it/s]
 16%|█▌        | 57694/371472 [4:35:44<26:38:35,  3.27it/s]
 16%|█▌        | 57695/371472 [4:35:45<25:57:49,  3.36it/s]
 16%|█▌        | 57696/371472 [4:35:45<25:17:09,  3.45it/s]
 16%|█▌        | 57697/371472 [4:35:45<24:21:49,  3.58it/s]
 16%|█▌        | 57698/371472 [4:35:46<24:50:54,  3.51it/s]
 16%|█▌        | 57699/371472 [4:35:46<23:49:17,  3.66it/s]
 16%|█▌        | 57700/371472 [4:35:46<24:33:15,  3.55it/s]
                                                           
{'loss': 4.0898, 'learning_rate': 8.606143204981792e-07, 'epoch': 2.49}

 16%|█▌        | 57700/371472 [4:35:46<24:33:15,  3.55it/s]
 16%|█▌        | 57701/371472 [4:35:46<27:16:24,  3.20it/s]
 16%|█▌        | 57702/371472 [4:35:47<25:45:49,  3.38it/s]
 16%|█▌        | 57703/371472 [4:35:47<24:58:20,  3.49it/s]
 16%|█▌        | 57704/371472 [4:35:47<24:14:10,  3.60it/s]
 16%|█▌        | 57705/371472 [4:35:48<23:47:00,  3.66it/s]
 16%|█▌        | 57706/371472 [4:35:48<24:01:27,  3.63it/s]
 16%|█▌        | 57707/371472 [4:35:48<24:58:00,  3.49it/s]
 16%|█▌        | 57708/371472 [4:35:48<24:17:53,  3.59it/s]
 16%|█▌        | 57709/371472 [4:35:49<25:24:13,  3.43it/s]
 16%|█▌        | 57710/371472 [4:35:49<24:17:57,  3.59it/s]
 16%|█▌        | 57711/371472 [4:35:49<24:07:04,  3.61it/s]
 16%|█▌        | 57712/371472 [4:35:50<24:30:54,  3.56it/s]
 16%|█▌        | 57713/371472 [4:35:50<25:29:19,  3.42it/s]
 16%|█▌        | 57714/371472 [4:35:50<25:09:14,  3.46it/s]
 16%|█▌        | 57715/371472 [4:35:50<24:43:39,  3.52it/s]
 16%|█▌        | 57716/371472 [4:35:51<24:32:26,  3.55it/s]
 16%|█▌        | 57717/371472 [4:35:51<24:16:11,  3.59it/s]
 16%|█▌        | 57718/371472 [4:35:51<23:45:48,  3.67it/s]
 16%|█▌        | 57719/371472 [4:35:51<24:17:26,  3.59it/s]
 16%|█▌        | 57720/371472 [4:35:52<24:01:24,  3.63it/s]
                                                           
{'loss': 4.2245, 'learning_rate': 8.605658385227002e-07, 'epoch': 2.49}

 16%|█▌        | 57720/371472 [4:35:52<24:01:24,  3.63it/s]
 16%|█▌        | 57721/371472 [4:35:52<26:37:16,  3.27it/s]
 16%|█▌        | 57722/371472 [4:35:52<26:15:44,  3.32it/s]
 16%|█▌        | 57723/371472 [4:35:53<24:30:45,  3.56it/s]
 16%|█▌        | 57724/371472 [4:35:53<25:02:26,  3.48it/s]
 16%|█▌        | 57725/371472 [4:35:53<23:46:50,  3.66it/s]
 16%|█▌        | 57726/371472 [4:35:53<23:38:33,  3.69it/s]
 16%|█▌        | 57727/371472 [4:35:54<24:46:06,  3.52it/s]
 16%|█▌        | 57728/371472 [4:35:54<25:05:59,  3.47it/s]
 16%|█▌        | 57729/371472 [4:35:54<23:51:32,  3.65it/s]
 16%|█▌        | 57730/371472 [4:35:55<27:07:56,  3.21it/s]
 16%|█▌        | 57731/371472 [4:35:55<26:50:46,  3.25it/s]
 16%|█▌        | 57732/371472 [4:35:55<28:07:51,  3.10it/s]
 16%|█▌        | 57733/371472 [4:35:56<29:00:10,  3.00it/s]
 16%|█▌        | 57734/371472 [4:35:56<28:47:02,  3.03it/s]
 16%|█▌        | 57735/371472 [4:35:56<27:20:55,  3.19it/s]
 16%|█▌        | 57736/371472 [4:35:57<25:32:36,  3.41it/s]
 16%|█▌        | 57737/371472 [4:35:57<25:56:38,  3.36it/s]
 16%|█▌        | 57738/371472 [4:35:57<24:51:18,  3.51it/s]
 16%|█▌        | 57739/371472 [4:35:57<25:21:36,  3.44it/s]
 16%|█▌        | 57740/371472 [4:35:58<25:54:16,  3.36it/s]
                                                           
{'loss': 4.4094, 'learning_rate': 8.605173565472214e-07, 'epoch': 2.49}

 16%|█▌        | 57740/371472 [4:35:58<25:54:16,  3.36it/s]
 16%|█▌        | 57741/371472 [4:35:58<24:15:22,  3.59it/s]
 16%|█▌        | 57742/371472 [4:35:58<24:21:33,  3.58it/s]
 16%|█▌        | 57743/371472 [4:35:59<24:48:48,  3.51it/s]
 16%|█▌        | 57744/371472 [4:35:59<23:33:57,  3.70it/s]
 16%|█▌        | 57745/371472 [4:35:59<24:56:59,  3.49it/s]
 16%|█▌        | 57746/371472 [4:35:59<24:29:16,  3.56it/s]
 16%|█▌        | 57747/371472 [4:36:00<23:36:36,  3.69it/s]
 16%|█▌        | 57748/371472 [4:36:00<25:15:53,  3.45it/s]
 16%|█▌        | 57749/371472 [4:36:00<25:05:50,  3.47it/s]
 16%|█▌        | 57750/371472 [4:36:01<24:12:24,  3.60it/s]
 16%|█▌        | 57751/371472 [4:36:01<24:39:13,  3.53it/s]
 16%|█▌        | 57752/371472 [4:36:01<25:40:36,  3.39it/s]
 16%|█▌        | 57753/371472 [4:36:01<25:14:48,  3.45it/s]
 16%|█▌        | 57754/371472 [4:36:02<24:25:17,  3.57it/s]
 16%|█▌        | 57755/371472 [4:36:02<23:50:04,  3.66it/s]
 16%|█▌        | 57756/371472 [4:36:02<23:37:14,  3.69it/s]
 16%|█▌        | 57757/371472 [4:36:02<23:19:52,  3.74it/s]
 16%|█▌        | 57758/371472 [4:36:03<23:18:27,  3.74it/s]
 16%|█▌        | 57759/371472 [4:36:03<23:25:37,  3.72it/s]
 16%|█▌        | 57760/371472 [4:36:03<22:39:53,  3.84it/s]
                                                           
{'loss': 4.1925, 'learning_rate': 8.604688745717426e-07, 'epoch': 2.49}

 16%|█▌        | 57760/371472 [4:36:03<22:39:53,  3.84it/s]
 16%|█▌        | 57761/371472 [4:36:03<23:08:25,  3.77it/s]
 16%|█▌        | 57762/371472 [4:36:04<22:59:08,  3.79it/s]
 16%|█▌        | 57763/371472 [4:36:04<25:05:50,  3.47it/s]
 16%|█▌        | 57764/371472 [4:36:04<24:26:31,  3.57it/s]
 16%|█▌        | 57765/371472 [4:36:05<23:33:40,  3.70it/s]
 16%|█▌        | 57766/371472 [4:36:05<25:08:17,  3.47it/s]
 16%|█▌        | 57767/371472 [4:36:05<25:18:57,  3.44it/s]
 16%|█▌        | 57768/371472 [4:36:06<25:18:12,  3.44it/s]
 16%|█▌        | 57769/371472 [4:36:06<25:28:20,  3.42it/s]
 16%|█▌        | 57770/371472 [4:36:06<25:17:14,  3.45it/s]
 16%|█▌        | 57771/371472 [4:36:06<24:12:15,  3.60it/s]
 16%|█▌        | 57772/371472 [4:36:07<24:03:24,  3.62it/s]
 16%|█▌        | 57773/371472 [4:36:07<24:54:17,  3.50it/s]
 16%|█▌        | 57774/371472 [4:36:07<25:31:50,  3.41it/s]
 16%|█▌        | 57775/371472 [4:36:08<25:09:01,  3.46it/s]
 16%|█▌        | 57776/371472 [4:36:08<24:33:55,  3.55it/s]
 16%|█▌        | 57777/371472 [4:36:08<24:31:06,  3.55it/s]
 16%|█▌        | 57778/371472 [4:36:08<24:13:28,  3.60it/s]
 16%|█▌        | 57779/371472 [4:36:09<23:51:58,  3.65it/s]
 16%|█▌        | 57780/371472 [4:36:09<24:31:01,  3.55it/s]
                                                           
{'loss': 4.2971, 'learning_rate': 8.604203925962636e-07, 'epoch': 2.49}

 16%|█▌        | 57780/371472 [4:36:09<24:31:01,  3.55it/s]
 16%|█▌        | 57781/371472 [4:36:09<28:21:14,  3.07it/s]
 16%|█▌        | 57782/371472 [4:36:10<28:58:20,  3.01it/s]
 16%|█▌        | 57783/371472 [4:36:10<26:33:21,  3.28it/s]
 16%|█▌        | 57784/371472 [4:36:10<25:22:36,  3.43it/s]
 16%|█▌        | 57785/371472 [4:36:10<24:35:50,  3.54it/s]
 16%|█▌        | 57786/371472 [4:36:11<25:47:39,  3.38it/s]
 16%|█▌        | 57787/371472 [4:36:11<25:17:13,  3.45it/s]
 16%|█▌        | 57788/371472 [4:36:11<25:10:19,  3.46it/s]
 16%|█▌        | 57789/371472 [4:36:12<25:23:39,  3.43it/s]
 16%|█▌        | 57790/371472 [4:36:12<24:23:20,  3.57it/s]
 16%|█▌        | 57791/371472 [4:36:12<25:37:43,  3.40it/s]
 16%|█▌        | 57792/371472 [4:36:12<24:18:46,  3.58it/s]
 16%|█▌        | 57793/371472 [4:36:13<25:11:47,  3.46it/s]
 16%|█▌        | 57794/371472 [4:36:13<25:13:49,  3.45it/s]
 16%|█▌        | 57795/371472 [4:36:13<24:20:19,  3.58it/s]
 16%|█▌        | 57796/371472 [4:36:14<24:52:15,  3.50it/s]
 16%|█▌        | 57797/371472 [4:36:14<24:43:47,  3.52it/s]
 16%|█▌        | 57798/371472 [4:36:14<23:26:32,  3.72it/s]
 16%|█▌        | 57799/371472 [4:36:14<24:17:35,  3.59it/s]
 16%|█▌        | 57800/371472 [4:36:15<24:18:56,  3.58it/s]
                                                           
{'loss': 4.3134, 'learning_rate': 8.603719106207846e-07, 'epoch': 2.49}

 16%|█▌        | 57800/371472 [4:36:15<24:18:56,  3.58it/s]
 16%|█▌        | 57801/371472 [4:36:15<25:05:58,  3.47it/s]
 16%|█▌        | 57802/371472 [4:36:15<24:29:42,  3.56it/s]
 16%|█▌        | 57803/371472 [4:36:16<26:19:21,  3.31it/s]
 16%|█▌        | 57804/371472 [4:36:16<25:03:15,  3.48it/s]
 16%|█▌        | 57805/371472 [4:36:16<25:52:37,  3.37it/s]
 16%|█▌        | 57806/371472 [4:36:16<24:43:32,  3.52it/s]
 16%|█▌        | 57807/371472 [4:36:17<24:48:12,  3.51it/s]
 16%|█▌        | 57808/371472 [4:36:17<25:36:37,  3.40it/s]
 16%|█▌        | 57809/371472 [4:36:17<25:01:17,  3.48it/s]
 16%|█▌        | 57810/371472 [4:36:18<26:27:20,  3.29it/s]
 16%|█▌        | 57811/371472 [4:36:18<26:34:46,  3.28it/s]
 16%|█▌        | 57812/371472 [4:36:18<25:13:15,  3.45it/s]
 16%|█▌        | 57813/371472 [4:36:19<24:39:29,  3.53it/s]
 16%|█▌        | 57814/371472 [4:36:19<25:13:46,  3.45it/s]
 16%|█▌        | 57815/371472 [4:36:19<24:20:52,  3.58it/s]
 16%|█▌        | 57816/371472 [4:36:19<23:59:25,  3.63it/s]
 16%|█▌        | 57817/371472 [4:36:20<22:57:00,  3.80it/s]
 16%|█▌        | 57818/371472 [4:36:20<22:51:17,  3.81it/s]
 16%|█▌        | 57819/371472 [4:36:20<24:11:13,  3.60it/s]
 16%|█▌        | 57820/371472 [4:36:20<23:16:39,  3.74it/s]
                                                           
{'loss': 4.0966, 'learning_rate': 8.603234286453058e-07, 'epoch': 2.49}

 16%|█▌        | 57820/371472 [4:36:20<23:16:39,  3.74it/s]
 16%|█▌        | 57821/371472 [4:36:21<22:48:01,  3.82it/s]
 16%|█▌        | 57822/371472 [4:36:21<22:48:26,  3.82it/s]
 16%|█▌        | 57823/371472 [4:36:21<23:40:36,  3.68it/s]
 16%|█▌        | 57824/371472 [4:36:21<24:02:35,  3.62it/s]
 16%|█▌        | 57825/371472 [4:36:22<23:58:04,  3.64it/s]
 16%|█▌        | 57826/371472 [4:36:22<26:12:06,  3.33it/s]
 16%|█▌        | 57827/371472 [4:36:22<24:42:16,  3.53it/s]
 16%|█▌        | 57828/371472 [4:36:23<23:43:01,  3.67it/s]
 16%|█▌        | 57829/371472 [4:36:23<23:14:52,  3.75it/s]
 16%|█▌        | 57830/371472 [4:36:23<25:14:15,  3.45it/s]
 16%|█▌        | 57831/371472 [4:36:23<24:33:09,  3.55it/s]
 16%|█▌        | 57832/371472 [4:36:24<24:54:08,  3.50it/s]
 16%|█▌        | 57833/371472 [4:36:24<26:05:34,  3.34it/s]
 16%|█▌        | 57834/371472 [4:36:24<25:48:05,  3.38it/s]
 16%|█▌        | 57835/371472 [4:36:25<27:19:19,  3.19it/s]
 16%|█▌        | 57836/371472 [4:36:25<25:43:04,  3.39it/s]
 16%|█▌        | 57837/371472 [4:36:25<28:37:36,  3.04it/s]
 16%|█▌        | 57838/371472 [4:36:26<28:17:21,  3.08it/s]
 16%|█▌        | 57839/371472 [4:36:26<28:49:52,  3.02it/s]
 16%|█▌        | 57840/371472 [4:36:26<27:58:37,  3.11it/s]
                                                           
{'loss': 4.1384, 'learning_rate': 8.60274946669827e-07, 'epoch': 2.49}

 16%|█▌        | 57840/371472 [4:36:26<27:58:37,  3.11it/s]
 16%|█▌        | 57841/371472 [4:36:27<27:16:56,  3.19it/s]
 16%|█▌        | 57842/371472 [4:36:27<25:49:25,  3.37it/s]
 16%|█▌        | 57843/371472 [4:36:27<24:16:53,  3.59it/s]
 16%|█▌        | 57844/371472 [4:36:27<23:25:04,  3.72it/s]
 16%|█▌        | 57845/371472 [4:36:28<22:38:45,  3.85it/s]
 16%|█▌        | 57846/371472 [4:36:28<22:10:16,  3.93it/s]
 16%|█▌        | 57847/371472 [4:36:28<22:01:31,  3.96it/s]
 16%|█▌        | 57848/371472 [4:36:28<23:28:29,  3.71it/s]
 16%|█▌        | 57849/371472 [4:36:29<23:38:37,  3.68it/s]
 16%|█▌        | 57850/371472 [4:36:29<24:11:52,  3.60it/s]
 16%|█▌        | 57851/371472 [4:36:29<23:51:09,  3.65it/s]
 16%|█▌        | 57852/371472 [4:36:30<23:47:07,  3.66it/s]
 16%|█▌        | 57853/371472 [4:36:30<23:17:14,  3.74it/s]
 16%|█▌        | 57854/371472 [4:36:30<22:48:19,  3.82it/s]
 16%|█▌        | 57855/371472 [4:36:30<22:32:54,  3.86it/s]
 16%|█▌        | 57856/371472 [4:36:31<23:18:42,  3.74it/s]
 16%|█▌        | 57857/371472 [4:36:31<23:25:20,  3.72it/s]
 16%|█▌        | 57858/371472 [4:36:31<23:23:50,  3.72it/s]
 16%|█▌        | 57859/371472 [4:36:31<24:11:03,  3.60it/s]
 16%|█▌        | 57860/371472 [4:36:32<24:33:54,  3.55it/s]
                                                           
{'loss': 4.3345, 'learning_rate': 8.60226464694348e-07, 'epoch': 2.49}

 16%|█▌        | 57860/371472 [4:36:32<24:33:54,  3.55it/s]
 16%|█▌        | 57861/371472 [4:36:32<23:56:07,  3.64it/s]
 16%|█▌        | 57862/371472 [4:36:32<22:44:19,  3.83it/s]
 16%|█▌        | 57863/371472 [4:36:32<22:38:07,  3.85it/s]
 16%|█▌        | 57864/371472 [4:36:33<24:07:53,  3.61it/s]
 16%|█▌        | 57865/371472 [4:36:33<23:32:33,  3.70it/s]
 16%|█▌        | 57866/371472 [4:36:33<23:42:40,  3.67it/s]
 16%|█▌        | 57867/371472 [4:36:34<23:13:24,  3.75it/s]
 16%|█▌        | 57868/371472 [4:36:34<24:48:01,  3.51it/s]
 16%|█▌        | 57869/371472 [4:36:34<25:21:33,  3.44it/s]
 16%|█▌        | 57870/371472 [4:36:34<25:06:42,  3.47it/s]
 16%|█▌        | 57871/371472 [4:36:35<24:39:27,  3.53it/s]
 16%|█▌        | 57872/371472 [4:36:35<24:05:54,  3.61it/s]
 16%|█▌        | 57873/371472 [4:36:35<23:43:33,  3.67it/s]
 16%|█▌        | 57874/371472 [4:36:36<23:36:01,  3.69it/s]
 16%|█▌        | 57875/371472 [4:36:36<24:47:50,  3.51it/s]
 16%|█▌        | 57876/371472 [4:36:36<25:11:16,  3.46it/s]
 16%|█▌        | 57877/371472 [4:36:36<25:02:24,  3.48it/s]
 16%|█▌        | 57878/371472 [4:36:37<23:52:44,  3.65it/s]
 16%|█▌        | 57879/371472 [4:36:37<25:15:20,  3.45it/s]
 16%|█▌        | 57880/371472 [4:36:37<25:49:10,  3.37it/s]
                                                           
{'loss': 4.0805, 'learning_rate': 8.601779827188691e-07, 'epoch': 2.49}

 16%|█▌        | 57880/371472 [4:36:37<25:49:10,  3.37it/s]
 16%|█▌        | 57881/371472 [4:36:38<26:15:49,  3.32it/s]
 16%|█▌        | 57882/371472 [4:36:38<26:42:24,  3.26it/s]
 16%|█▌        | 57883/371472 [4:36:38<26:34:55,  3.28it/s]
 16%|█▌        | 57884/371472 [4:36:39<26:35:40,  3.28it/s]
 16%|█▌        | 57885/371472 [4:36:39<26:22:01,  3.30it/s]
 16%|█▌        | 57886/371472 [4:36:39<25:09:18,  3.46it/s]
 16%|█▌        | 57887/371472 [4:36:39<24:51:16,  3.50it/s]
 16%|█▌        | 57888/371472 [4:36:40<23:43:54,  3.67it/s]
 16%|█▌        | 57889/371472 [4:36:40<22:57:25,  3.79it/s]
 16%|█▌        | 57890/371472 [4:36:40<24:07:22,  3.61it/s]
 16%|█▌        | 57891/371472 [4:36:41<26:39:38,  3.27it/s]
 16%|█▌        | 57892/371472 [4:36:41<25:00:48,  3.48it/s]
 16%|█▌        | 57893/371472 [4:36:41<24:12:11,  3.60it/s]
 16%|█▌        | 57894/371472 [4:36:41<24:39:10,  3.53it/s]
 16%|█▌        | 57895/371472 [4:36:42<24:10:52,  3.60it/s]
 16%|█▌        | 57896/371472 [4:36:42<23:48:39,  3.66it/s]
 16%|█▌        | 57897/371472 [4:36:42<23:06:39,  3.77it/s]
 16%|█▌        | 57898/371472 [4:36:42<25:19:14,  3.44it/s]
 16%|█▌        | 57899/371472 [4:36:43<25:57:44,  3.36it/s]
 16%|█▌        | 57900/371472 [4:36:43<25:12:21,  3.46it/s]
                                                           
{'loss': 4.3075, 'learning_rate': 8.601295007433902e-07, 'epoch': 2.49}

 16%|█▌        | 57900/371472 [4:36:43<25:12:21,  3.46it/s]
 16%|█▌        | 57901/371472 [4:36:43<24:58:34,  3.49it/s]
 16%|█▌        | 57902/371472 [4:36:44<24:21:52,  3.57it/s]
 16%|█▌        | 57903/371472 [4:36:44<24:15:59,  3.59it/s]
 16%|█▌        | 57904/371472 [4:36:44<26:09:42,  3.33it/s]
 16%|█▌        | 57905/371472 [4:36:44<24:24:14,  3.57it/s]
 16%|█▌        | 57906/371472 [4:36:45<24:56:28,  3.49it/s]
 16%|█▌        | 57907/371472 [4:36:45<24:12:52,  3.60it/s]
 16%|█▌        | 57908/371472 [4:36:45<23:48:00,  3.66it/s]
 16%|█▌        | 57909/371472 [4:36:46<23:10:15,  3.76it/s]
 16%|█▌        | 57910/371472 [4:36:46<22:36:25,  3.85it/s]
 16%|█▌        | 57911/371472 [4:36:46<21:58:59,  3.96it/s]
 16%|█▌        | 57912/371472 [4:36:46<22:25:59,  3.88it/s]
 16%|█▌        | 57913/371472 [4:36:47<24:10:19,  3.60it/s]
 16%|█▌        | 57914/371472 [4:36:47<23:53:18,  3.65it/s]
 16%|█▌        | 57915/371472 [4:36:47<25:46:13,  3.38it/s]
 16%|█▌        | 57916/371472 [4:36:48<26:00:12,  3.35it/s]
 16%|█▌        | 57917/371472 [4:36:48<24:25:49,  3.57it/s]
 16%|█▌        | 57918/371472 [4:36:48<24:23:38,  3.57it/s]
 16%|█▌        | 57919/371472 [4:36:48<24:56:59,  3.49it/s]
 16%|█▌        | 57920/371472 [4:36:49<25:05:35,  3.47it/s]
                                                           
{'loss': 3.9731, 'learning_rate': 8.600810187679114e-07, 'epoch': 2.49}

 16%|█▌        | 57920/371472 [4:36:49<25:05:35,  3.47it/s]
 16%|█▌        | 57921/371472 [4:36:49<25:39:36,  3.39it/s]
 16%|█▌        | 57922/371472 [4:36:49<25:30:29,  3.41it/s]
 16%|█▌        | 57923/371472 [4:36:49<24:54:24,  3.50it/s]
 16%|█▌        | 57924/371472 [4:36:50<23:54:18,  3.64it/s]
 16%|█▌        | 57925/371472 [4:36:50<23:49:13,  3.66it/s]
 16%|█▌        | 57926/371472 [4:36:50<24:23:23,  3.57it/s]
 16%|█▌        | 57927/371472 [4:36:51<23:22:54,  3.72it/s]
 16%|█▌        | 57928/371472 [4:36:51<24:04:17,  3.62it/s]
 16%|█▌        | 57929/371472 [4:36:51<23:26:59,  3.71it/s]
 16%|█▌        | 57930/371472 [4:36:51<24:18:38,  3.58it/s]
 16%|█▌        | 57931/371472 [4:36:52<24:53:20,  3.50it/s]
 16%|█▌        | 57932/371472 [4:36:52<25:31:14,  3.41it/s]
 16%|█▌        | 57933/371472 [4:36:52<25:34:28,  3.41it/s]
 16%|█▌        | 57934/371472 [4:36:53<24:44:01,  3.52it/s]
 16%|█▌        | 57935/371472 [4:36:53<25:07:30,  3.47it/s]
 16%|█▌        | 57936/371472 [4:36:53<25:17:46,  3.44it/s]
 16%|█▌        | 57937/371472 [4:36:53<25:42:23,  3.39it/s]
 16%|█▌        | 57938/371472 [4:36:54<25:17:21,  3.44it/s]
 16%|█▌        | 57939/371472 [4:36:54<24:39:57,  3.53it/s]
 16%|█▌        | 57940/371472 [4:36:54<24:21:02,  3.58it/s]
                                                           
{'loss': 4.2603, 'learning_rate': 8.600325367924325e-07, 'epoch': 2.5}

 16%|█▌        | 57940/371472 [4:36:54<24:21:02,  3.58it/s]
 16%|█▌        | 57941/371472 [4:36:55<24:57:43,  3.49it/s]
 16%|█▌        | 57942/371472 [4:36:55<24:01:57,  3.62it/s]
 16%|█▌        | 57943/371472 [4:36:55<24:06:40,  3.61it/s]
 16%|█▌        | 57944/371472 [4:36:55<23:50:29,  3.65it/s]
 16%|█▌        | 57945/371472 [4:36:56<23:49:45,  3.65it/s]
 16%|█▌        | 57946/371472 [4:36:56<24:09:30,  3.60it/s]
 16%|█▌        | 57947/371472 [4:36:56<23:48:43,  3.66it/s]
 16%|█▌        | 57948/371472 [4:36:56<23:20:54,  3.73it/s]
 16%|█▌        | 57949/371472 [4:36:57<23:15:55,  3.74it/s]
 16%|█▌        | 57950/371472 [4:36:57<23:47:34,  3.66it/s]
 16%|█▌        | 57951/371472 [4:36:57<23:16:42,  3.74it/s]
 16%|█▌        | 57952/371472 [4:36:58<22:40:56,  3.84it/s]
 16%|█▌        | 57953/371472 [4:36:58<23:57:00,  3.64it/s]
 16%|█▌        | 57954/371472 [4:36:58<24:35:20,  3.54it/s]
 16%|█▌        | 57955/371472 [4:36:58<24:35:42,  3.54it/s]
 16%|█▌        | 57956/371472 [4:36:59<25:11:05,  3.46it/s]
 16%|█▌        | 57957/371472 [4:36:59<24:33:02,  3.55it/s]
 16%|█▌        | 57958/371472 [4:36:59<25:02:54,  3.48it/s]
 16%|█▌        | 57959/371472 [4:37:00<26:13:54,  3.32it/s]
 16%|█▌        | 57960/371472 [4:37:00<25:35:39,  3.40it/s]
                                                           
{'loss': 4.26, 'learning_rate': 8.599840548169535e-07, 'epoch': 2.5}

 16%|█▌        | 57960/371472 [4:37:00<25:35:39,  3.40it/s]
 16%|█▌        | 57961/371472 [4:37:00<24:07:15,  3.61it/s]
 16%|█▌        | 57962/371472 [4:37:00<22:59:40,  3.79it/s]
 16%|█▌        | 57963/371472 [4:37:01<24:50:59,  3.50it/s]
 16%|█▌        | 57964/371472 [4:37:01<24:38:12,  3.53it/s]
 16%|█▌        | 57965/371472 [4:37:01<24:36:45,  3.54it/s]
 16%|█▌        | 57966/371472 [4:37:02<24:25:07,  3.57it/s]
 16%|█▌        | 57967/371472 [4:37:02<24:24:22,  3.57it/s]
 16%|█▌        | 57968/371472 [4:37:02<23:34:20,  3.69it/s]
 16%|█▌        | 57969/371472 [4:37:02<23:16:22,  3.74it/s]
 16%|█▌        | 57970/371472 [4:37:03<23:03:27,  3.78it/s]
 16%|█▌        | 57971/371472 [4:37:03<23:17:25,  3.74it/s]
 16%|█▌        | 57972/371472 [4:37:03<22:53:40,  3.80it/s]
 16%|█▌        | 57973/371472 [4:37:03<22:39:33,  3.84it/s]
 16%|█▌        | 57974/371472 [4:37:04<23:51:51,  3.65it/s]
 16%|█▌        | 57975/371472 [4:37:04<24:00:38,  3.63it/s]
 16%|█▌        | 57976/371472 [4:37:04<26:02:16,  3.34it/s]
 16%|█▌        | 57977/371472 [4:37:05<26:02:02,  3.34it/s]
 16%|█▌        | 57978/371472 [4:37:05<24:25:44,  3.56it/s]
 16%|█▌        | 57979/371472 [4:37:05<24:09:43,  3.60it/s]
 16%|█▌        | 57980/371472 [4:37:05<23:46:52,  3.66it/s]
                                                           
{'loss': 3.9662, 'learning_rate': 8.599355728414747e-07, 'epoch': 2.5}

 16%|█▌        | 57980/371472 [4:37:05<23:46:52,  3.66it/s]
 16%|█▌        | 57981/371472 [4:37:06<24:31:11,  3.55it/s]
 16%|█▌        | 57982/371472 [4:37:06<23:32:49,  3.70it/s]
 16%|█▌        | 57983/371472 [4:37:06<23:42:19,  3.67it/s]
 16%|█▌        | 57984/371472 [4:37:06<22:54:55,  3.80it/s]
 16%|█▌        | 57985/371472 [4:37:07<24:25:17,  3.57it/s]
 16%|█▌        | 57986/371472 [4:37:07<24:47:16,  3.51it/s]
 16%|█▌        | 57987/371472 [4:37:07<26:12:48,  3.32it/s]
 16%|█▌        | 57988/371472 [4:37:08<26:26:51,  3.29it/s]
 16%|█▌        | 57989/371472 [4:37:08<26:37:35,  3.27it/s]
 16%|█▌        | 57990/371472 [4:37:08<27:08:59,  3.21it/s]
 16%|█▌        | 57991/371472 [4:37:09<26:12:38,  3.32it/s]
 16%|█▌        | 57992/371472 [4:37:09<25:25:43,  3.42it/s]
 16%|█▌        | 57993/371472 [4:37:09<25:13:03,  3.45it/s]
 16%|█▌        | 57994/371472 [4:37:10<26:59:58,  3.23it/s]
 16%|█▌        | 57995/371472 [4:37:10<25:52:08,  3.37it/s]
 16%|█▌        | 57996/371472 [4:37:10<27:49:17,  3.13it/s]
 16%|█▌        | 57997/371472 [4:37:10<27:11:04,  3.20it/s]
 16%|█▌        | 57998/371472 [4:37:11<25:10:48,  3.46it/s]
 16%|█▌        | 57999/371472 [4:37:11<24:12:49,  3.60it/s]
 16%|█▌        | 58000/371472 [4:37:11<25:27:23,  3.42it/s]
                                                           
{'loss': 4.4137, 'learning_rate': 8.598870908659958e-07, 'epoch': 2.5}

 16%|█▌        | 58000/371472 [4:37:11<25:27:23,  3.42it/s]
 16%|█▌        | 58001/371472 [4:37:12<24:56:04,  3.49it/s]
 16%|█▌        | 58002/371472 [4:37:12<24:19:58,  3.58it/s]
 16%|█▌        | 58003/371472 [4:37:12<25:50:39,  3.37it/s]
 16%|█▌        | 58004/371472 [4:37:12<25:40:35,  3.39it/s]
 16%|█▌        | 58005/371472 [4:37:13<24:44:36,  3.52it/s]
 16%|█▌        | 58006/371472 [4:37:13<23:31:34,  3.70it/s]
 16%|█▌        | 58007/371472 [4:37:13<24:16:58,  3.59it/s]
 16%|█▌        | 58008/371472 [4:37:13<23:20:42,  3.73it/s]
 16%|█▌        | 58009/371472 [4:37:14<23:08:56,  3.76it/s]
 16%|█▌        | 58010/371472 [4:37:14<23:09:48,  3.76it/s]
 16%|█▌        | 58011/371472 [4:37:14<22:20:46,  3.90it/s]
 16%|█▌        | 58012/371472 [4:37:14<22:00:08,  3.96it/s]
 16%|█▌        | 58013/371472 [4:37:15<23:04:23,  3.77it/s]
 16%|█▌        | 58014/371472 [4:37:15<23:45:10,  3.67it/s]
 16%|█▌        | 58015/371472 [4:37:15<23:46:28,  3.66it/s]
 16%|█▌        | 58016/371472 [4:37:16<22:54:08,  3.80it/s]
 16%|█▌        | 58017/371472 [4:37:16<23:30:34,  3.70it/s]
 16%|█▌        | 58018/371472 [4:37:16<25:35:32,  3.40it/s]
 16%|█▌        | 58019/371472 [4:37:16<25:26:50,  3.42it/s]
 16%|█▌        | 58020/371472 [4:37:17<26:00:41,  3.35it/s]
                                                           
{'loss': 4.3187, 'learning_rate': 8.59838608890517e-07, 'epoch': 2.5}

 16%|█▌        | 58020/371472 [4:37:17<26:00:41,  3.35it/s]
 16%|█▌        | 58021/371472 [4:37:17<25:44:45,  3.38it/s]
 16%|█▌        | 58022/371472 [4:37:17<24:07:34,  3.61it/s]
 16%|█▌        | 58023/371472 [4:37:18<23:45:40,  3.66it/s]
 16%|█▌        | 58024/371472 [4:37:18<23:52:57,  3.65it/s]
 16%|█▌        | 58025/371472 [4:37:18<25:54:03,  3.36it/s]
 16%|█▌        | 58026/371472 [4:37:18<25:21:18,  3.43it/s]
 16%|█▌        | 58027/371472 [4:37:19<24:36:06,  3.54it/s]
 16%|█▌        | 58028/371472 [4:37:19<26:04:01,  3.34it/s]
 16%|█▌        | 58029/371472 [4:37:19<24:52:59,  3.50it/s]
 16%|█▌        | 58030/371472 [4:37:20<25:39:48,  3.39it/s]
 16%|█▌        | 58031/371472 [4:37:20<25:10:45,  3.46it/s]
 16%|█▌        | 58032/371472 [4:37:20<24:21:29,  3.57it/s]
 16%|█▌        | 58033/371472 [4:37:21<25:48:52,  3.37it/s]
 16%|█▌        | 58034/371472 [4:37:21<25:36:04,  3.40it/s]
 16%|█▌        | 58035/371472 [4:37:21<25:33:45,  3.41it/s]
 16%|█▌        | 58036/371472 [4:37:21<25:59:47,  3.35it/s]
 16%|█▌        | 58037/371472 [4:37:22<25:06:09,  3.47it/s]
 16%|█▌        | 58038/371472 [4:37:22<24:44:40,  3.52it/s]
 16%|█▌        | 58039/371472 [4:37:22<25:10:13,  3.46it/s]
 16%|█▌        | 58040/371472 [4:37:23<24:10:42,  3.60it/s]
                                                           
{'loss': 4.3463, 'learning_rate': 8.597901269150379e-07, 'epoch': 2.5}

 16%|█▌        | 58040/371472 [4:37:23<24:10:42,  3.60it/s]
 16%|█▌        | 58041/371472 [4:37:23<25:26:36,  3.42it/s]
 16%|█▌        | 58042/371472 [4:37:23<24:29:21,  3.56it/s]
 16%|█▌        | 58043/371472 [4:37:23<23:57:06,  3.63it/s]
 16%|█▌        | 58044/371472 [4:37:24<24:51:21,  3.50it/s]
 16%|█▌        | 58045/371472 [4:37:24<24:11:45,  3.60it/s]
 16%|█▌        | 58046/371472 [4:37:24<24:48:14,  3.51it/s]
 16%|█▌        | 58047/371472 [4:37:25<25:16:22,  3.44it/s]
 16%|█▌        | 58048/371472 [4:37:25<27:58:07,  3.11it/s]
 16%|█▌        | 58049/371472 [4:37:25<26:36:46,  3.27it/s]
 16%|█▌        | 58050/371472 [4:37:25<25:51:44,  3.37it/s]
 16%|█▌        | 58051/371472 [4:37:26<26:56:14,  3.23it/s]
 16%|█▌        | 58052/371472 [4:37:26<25:52:29,  3.36it/s]
 16%|█▌        | 58053/371472 [4:37:26<24:19:11,  3.58it/s]
 16%|█▌        | 58054/371472 [4:37:27<23:26:33,  3.71it/s]
 16%|█▌        | 58055/371472 [4:37:27<23:39:28,  3.68it/s]
 16%|█▌        | 58056/371472 [4:37:27<24:45:29,  3.52it/s]
 16%|█▌        | 58057/371472 [4:37:28<26:31:21,  3.28it/s]
 16%|█▌        | 58058/371472 [4:37:28<25:11:48,  3.46it/s]
 16%|█▌        | 58059/371472 [4:37:28<24:11:44,  3.60it/s]
 16%|█▌        | 58060/371472 [4:37:28<24:46:01,  3.52it/s]
                                                           
{'loss': 4.1218, 'learning_rate': 8.597416449395591e-07, 'epoch': 2.5}

 16%|█▌        | 58060/371472 [4:37:28<24:46:01,  3.52it/s]
 16%|█▌        | 58061/371472 [4:37:29<24:47:56,  3.51it/s]
 16%|█▌        | 58062/371472 [4:37:29<24:26:33,  3.56it/s]
 16%|█▌        | 58063/371472 [4:37:29<23:44:37,  3.67it/s]
 16%|█▌        | 58064/371472 [4:37:29<23:13:31,  3.75it/s]
 16%|█▌        | 58065/371472 [4:37:30<23:07:50,  3.76it/s]
 16%|█▌        | 58066/371472 [4:37:30<24:10:09,  3.60it/s]
 16%|█▌        | 58067/371472 [4:37:30<25:39:57,  3.39it/s]
 16%|█▌        | 58068/371472 [4:37:31<24:31:57,  3.55it/s]
 16%|█▌        | 58069/371472 [4:37:31<24:04:09,  3.62it/s]
 16%|█▌        | 58070/371472 [4:37:31<22:58:50,  3.79it/s]
 16%|█▌        | 58071/371472 [4:37:31<22:52:47,  3.80it/s]
 16%|█▌        | 58072/371472 [4:37:32<22:50:40,  3.81it/s]
 16%|█▌        | 58073/371472 [4:37:32<23:53:59,  3.64it/s]
 16%|█▌        | 58074/371472 [4:37:32<24:38:51,  3.53it/s]
 16%|█▌        | 58075/371472 [4:37:33<26:24:10,  3.30it/s]
 16%|█▌        | 58076/371472 [4:37:33<24:30:06,  3.55it/s]
 16%|█▌        | 58077/371472 [4:37:33<23:45:09,  3.67it/s]
 16%|█▌        | 58078/371472 [4:37:33<26:23:00,  3.30it/s]
 16%|█▌        | 58079/371472 [4:37:34<26:11:27,  3.32it/s]
 16%|█▌        | 58080/371472 [4:37:34<24:36:09,  3.54it/s]
                                                           
{'loss': 4.2526, 'learning_rate': 8.596931629640802e-07, 'epoch': 2.5}

 16%|█▌        | 58080/371472 [4:37:34<24:36:09,  3.54it/s]
 16%|█▌        | 58081/371472 [4:37:34<24:21:51,  3.57it/s]
 16%|█▌        | 58082/371472 [4:37:34<25:09:30,  3.46it/s]
 16%|█▌        | 58083/371472 [4:37:35<23:50:20,  3.65it/s]
 16%|█▌        | 58084/371472 [4:37:35<26:38:53,  3.27it/s]
 16%|█▌        | 58085/371472 [4:37:35<25:30:41,  3.41it/s]
 16%|█▌        | 58086/371472 [4:37:36<24:50:31,  3.50it/s]
 16%|█▌        | 58087/371472 [4:37:36<24:22:20,  3.57it/s]
 16%|█▌        | 58088/371472 [4:37:36<24:18:24,  3.58it/s]
 16%|█▌        | 58089/371472 [4:37:36<23:42:28,  3.67it/s]
 16%|█▌        | 58090/371472 [4:37:37<24:24:33,  3.57it/s]
 16%|█▌        | 58091/371472 [4:37:37<23:24:16,  3.72it/s]
 16%|█▌        | 58092/371472 [4:37:37<23:27:41,  3.71it/s]
 16%|█▌        | 58093/371472 [4:37:38<24:30:55,  3.55it/s]
 16%|█▌        | 58094/371472 [4:37:38<23:54:41,  3.64it/s]
 16%|█▌        | 58095/371472 [4:37:38<23:06:34,  3.77it/s]
 16%|█▌        | 58096/371472 [4:37:38<24:35:07,  3.54it/s]
 16%|█▌        | 58097/371472 [4:37:39<24:45:03,  3.52it/s]
 16%|█▌        | 58098/371472 [4:37:39<24:18:18,  3.58it/s]
 16%|█▌        | 58099/371472 [4:37:39<23:32:10,  3.70it/s]
 16%|█▌        | 58100/371472 [4:37:39<24:37:34,  3.53it/s]
                                                           
{'loss': 4.4045, 'learning_rate': 8.596446809886013e-07, 'epoch': 2.5}

 16%|█▌        | 58100/371472 [4:37:39<24:37:34,  3.53it/s]
 16%|█▌        | 58101/371472 [4:37:40<24:31:17,  3.55it/s]
 16%|█▌        | 58102/371472 [4:37:40<23:18:07,  3.74it/s]
 16%|█▌        | 58103/371472 [4:37:40<24:53:54,  3.50it/s]
 16%|█▌        | 58104/371472 [4:37:41<26:06:00,  3.34it/s]
 16%|█▌        | 58105/371472 [4:37:41<26:46:16,  3.25it/s]
 16%|█▌        | 58106/371472 [4:37:41<26:29:08,  3.29it/s]
 16%|█▌        | 58107/371472 [4:37:42<28:54:51,  3.01it/s]
 16%|█▌        | 58108/371472 [4:37:42<26:52:57,  3.24it/s]
 16%|█▌        | 58109/371472 [4:37:42<25:37:27,  3.40it/s]
 16%|█▌        | 58110/371472 [4:37:43<25:58:11,  3.35it/s]
 16%|█▌        | 58111/371472 [4:37:43<24:31:54,  3.55it/s]
 16%|█▌        | 58112/371472 [4:37:43<23:28:23,  3.71it/s]
 16%|█▌        | 58113/371472 [4:37:43<23:27:45,  3.71it/s]
 16%|█▌        | 58114/371472 [4:37:44<22:47:31,  3.82it/s]
 16%|█▌        | 58115/371472 [4:37:44<23:05:10,  3.77it/s]
 16%|█▌        | 58116/371472 [4:37:44<22:54:14,  3.80it/s]
 16%|█▌        | 58117/371472 [4:37:44<23:19:25,  3.73it/s]
 16%|█▌        | 58118/371472 [4:37:45<23:16:20,  3.74it/s]
 16%|█▌        | 58119/371472 [4:37:45<22:21:09,  3.89it/s]
 16%|█▌        | 58120/371472 [4:37:45<22:44:18,  3.83it/s]
                                                           
{'loss': 4.1303, 'learning_rate': 8.595961990131224e-07, 'epoch': 2.5}

 16%|█▌        | 58120/371472 [4:37:45<22:44:18,  3.83it/s]
 16%|█▌        | 58121/371472 [4:37:45<22:57:43,  3.79it/s]
 16%|█▌        | 58122/371472 [4:37:46<24:05:01,  3.61it/s]
 16%|█▌        | 58123/371472 [4:37:46<23:59:15,  3.63it/s]
 16%|█▌        | 58124/371472 [4:37:46<25:51:45,  3.37it/s]
 16%|█▌        | 58125/371472 [4:37:47<24:28:03,  3.56it/s]
 16%|█▌        | 58126/371472 [4:37:47<24:56:59,  3.49it/s]
 16%|█▌        | 58127/371472 [4:37:47<25:57:35,  3.35it/s]
 16%|█▌        | 58128/371472 [4:37:47<26:02:17,  3.34it/s]
 16%|█▌        | 58129/371472 [4:37:48<25:09:03,  3.46it/s]
 16%|█▌        | 58130/371472 [4:37:48<24:01:38,  3.62it/s]
 16%|█▌        | 58131/371472 [4:37:48<25:20:59,  3.43it/s]
 16%|█▌        | 58132/371472 [4:37:49<24:29:42,  3.55it/s]
 16%|█▌        | 58133/371472 [4:37:49<25:40:52,  3.39it/s]
 16%|█▌        | 58134/371472 [4:37:49<24:52:14,  3.50it/s]
 16%|█▌        | 58135/371472 [4:37:49<24:28:42,  3.56it/s]
 16%|█▌        | 58136/371472 [4:37:50<25:11:53,  3.45it/s]
 16%|█▌        | 58137/371472 [4:37:50<25:02:36,  3.48it/s]
 16%|█▌        | 58138/371472 [4:37:50<23:54:16,  3.64it/s]
 16%|█▌        | 58139/371472 [4:37:51<23:34:38,  3.69it/s]
 16%|█▌        | 58140/371472 [4:37:51<23:42:48,  3.67it/s]
                                                           
{'loss': 4.0786, 'learning_rate': 8.595477170376436e-07, 'epoch': 2.5}

 16%|█▌        | 58140/371472 [4:37:51<23:42:48,  3.67it/s]
 16%|█▌        | 58141/371472 [4:37:51<25:11:24,  3.46it/s]
 16%|█▌        | 58142/371472 [4:37:51<24:09:00,  3.60it/s]
 16%|█▌        | 58143/371472 [4:37:52<24:13:00,  3.59it/s]
 16%|█▌        | 58144/371472 [4:37:52<23:31:51,  3.70it/s]
 16%|█▌        | 58145/371472 [4:37:52<22:50:35,  3.81it/s]
 16%|█▌        | 58146/371472 [4:37:52<23:29:12,  3.71it/s]
 16%|█▌        | 58147/371472 [4:37:53<23:20:38,  3.73it/s]
 16%|█▌        | 58148/371472 [4:37:53<22:44:24,  3.83it/s]
 16%|█▌        | 58149/371472 [4:37:53<22:42:01,  3.83it/s]
 16%|█▌        | 58150/371472 [4:37:54<24:13:14,  3.59it/s]
 16%|█▌        | 58151/371472 [4:37:54<24:39:25,  3.53it/s]
 16%|█▌        | 58152/371472 [4:37:54<24:15:10,  3.59it/s]
 16%|█▌        | 58153/371472 [4:37:54<23:19:24,  3.73it/s]
 16%|█▌        | 58154/371472 [4:37:55<22:45:44,  3.82it/s]
 16%|█▌        | 58155/371472 [4:37:55<22:48:35,  3.82it/s]
 16%|█▌        | 58156/371472 [4:37:55<22:17:00,  3.91it/s]
 16%|█▌        | 58157/371472 [4:37:55<23:45:50,  3.66it/s]
 16%|█▌        | 58158/371472 [4:37:56<22:58:06,  3.79it/s]
 16%|█▌        | 58159/371472 [4:37:56<24:05:53,  3.61it/s]
 16%|█▌        | 58160/371472 [4:37:56<23:33:45,  3.69it/s]
                                                           
{'loss': 4.2704, 'learning_rate': 8.594992350621646e-07, 'epoch': 2.51}

 16%|█▌        | 58160/371472 [4:37:56<23:33:45,  3.69it/s]
 16%|█▌        | 58161/371472 [4:37:56<22:51:16,  3.81it/s]
 16%|█▌        | 58162/371472 [4:37:57<22:12:15,  3.92it/s]
 16%|█▌        | 58163/371472 [4:37:57<22:34:05,  3.86it/s]
 16%|█▌        | 58164/371472 [4:37:57<24:30:06,  3.55it/s]
 16%|█▌        | 58165/371472 [4:37:58<23:57:44,  3.63it/s]
 16%|█▌        | 58166/371472 [4:37:58<24:42:03,  3.52it/s]
 16%|█▌        | 58167/371472 [4:37:58<24:54:03,  3.49it/s]
 16%|█▌        | 58168/371472 [4:37:58<25:44:14,  3.38it/s]
 16%|█▌        | 58169/371472 [4:37:59<24:36:58,  3.54it/s]
 16%|█▌        | 58170/371472 [4:37:59<23:39:27,  3.68it/s]
 16%|█▌        | 58171/371472 [4:37:59<23:28:36,  3.71it/s]
 16%|█▌        | 58172/371472 [4:37:59<22:24:21,  3.88it/s]
 16%|█▌        | 58173/371472 [4:38:00<22:36:12,  3.85it/s]
 16%|█▌        | 58174/371472 [4:38:00<22:51:12,  3.81it/s]
 16%|█▌        | 58175/371472 [4:38:00<22:34:45,  3.85it/s]
 16%|█▌        | 58176/371472 [4:38:01<23:08:10,  3.76it/s]
 16%|█▌        | 58177/371472 [4:38:01<22:43:30,  3.83it/s]
 16%|█▌        | 58178/371472 [4:38:01<22:32:07,  3.86it/s]
 16%|█▌        | 58179/371472 [4:38:01<22:08:58,  3.93it/s]
 16%|█▌        | 58180/371472 [4:38:02<22:08:50,  3.93it/s]
                                                           
{'loss': 4.2644, 'learning_rate': 8.594507530866857e-07, 'epoch': 2.51}

 16%|█▌        | 58180/371472 [4:38:02<22:08:50,  3.93it/s]
 16%|█▌        | 58181/371472 [4:38:02<23:56:47,  3.63it/s]
 16%|█▌        | 58182/371472 [4:38:02<23:49:08,  3.65it/s]
 16%|█▌        | 58183/371472 [4:38:02<23:31:26,  3.70it/s]
 16%|█▌        | 58184/371472 [4:38:03<25:31:35,  3.41it/s]
 16%|█▌        | 58185/371472 [4:38:03<25:31:59,  3.41it/s]
 16%|█▌        | 58186/371472 [4:38:03<26:00:46,  3.35it/s]
 16%|█▌        | 58187/371472 [4:38:04<24:23:53,  3.57it/s]
 16%|█▌        | 58188/371472 [4:38:04<24:36:57,  3.54it/s]
 16%|█▌        | 58189/371472 [4:38:04<24:34:57,  3.54it/s]
 16%|█▌        | 58190/371472 [4:38:04<23:41:57,  3.67it/s]
 16%|█▌        | 58191/371472 [4:38:05<23:15:13,  3.74it/s]
 16%|█▌        | 58192/371472 [4:38:05<24:05:39,  3.61it/s]
 16%|█▌        | 58193/371472 [4:38:05<25:16:47,  3.44it/s]
 16%|█▌        | 58194/371472 [4:38:06<24:27:55,  3.56it/s]
 16%|█▌        | 58195/371472 [4:38:06<23:28:45,  3.71it/s]
 16%|█▌        | 58196/371472 [4:38:06<23:14:41,  3.74it/s]
 16%|█▌        | 58197/371472 [4:38:06<22:43:22,  3.83it/s]
 16%|█▌        | 58198/371472 [4:38:07<22:50:00,  3.81it/s]
 16%|█▌        | 58199/371472 [4:38:07<22:38:33,  3.84it/s]
 16%|█▌        | 58200/371472 [4:38:07<24:46:37,  3.51it/s]
                                                           
{'loss': 4.4116, 'learning_rate': 8.594022711112068e-07, 'epoch': 2.51}

 16%|█▌        | 58200/371472 [4:38:07<24:46:37,  3.51it/s]
 16%|█▌        | 58201/371472 [4:38:07<24:16:42,  3.58it/s]
 16%|█▌        | 58202/371472 [4:38:08<24:42:59,  3.52it/s]
 16%|█▌        | 58203/371472 [4:38:08<24:06:50,  3.61it/s]
 16%|█▌        | 58204/371472 [4:38:08<24:35:31,  3.54it/s]
 16%|█▌        | 58205/371472 [4:38:09<25:13:42,  3.45it/s]
 16%|█▌        | 58206/371472 [4:38:09<24:01:29,  3.62it/s]
 16%|█▌        | 58207/371472 [4:38:09<23:58:58,  3.63it/s]
 16%|█▌        | 58208/371472 [4:38:09<23:38:47,  3.68it/s]
 16%|█▌        | 58209/371472 [4:38:10<23:18:29,  3.73it/s]
 16%|█▌        | 58210/371472 [4:38:10<22:54:51,  3.80it/s]
 16%|█▌        | 58211/371472 [4:38:10<23:31:41,  3.70it/s]
 16%|█▌        | 58212/371472 [4:38:10<24:22:06,  3.57it/s]
 16%|█▌        | 58213/371472 [4:38:11<24:29:23,  3.55it/s]
 16%|█▌        | 58214/371472 [4:38:11<24:40:42,  3.53it/s]
 16%|█▌        | 58215/371472 [4:38:11<24:31:20,  3.55it/s]
 16%|█▌        | 58216/371472 [4:38:12<23:42:07,  3.67it/s]
 16%|█▌        | 58217/371472 [4:38:12<23:01:07,  3.78it/s]
 16%|█▌        | 58218/371472 [4:38:12<24:04:38,  3.61it/s]
 16%|█▌        | 58219/371472 [4:38:12<24:17:51,  3.58it/s]
 16%|█▌        | 58220/371472 [4:38:13<25:09:15,  3.46it/s]
                                                           
{'loss': 4.0617, 'learning_rate': 8.59353789135728e-07, 'epoch': 2.51}

 16%|█▌        | 58220/371472 [4:38:13<25:09:15,  3.46it/s]
 16%|█▌        | 58221/371472 [4:38:13<24:23:06,  3.57it/s]
 16%|█▌        | 58222/371472 [4:38:13<24:13:18,  3.59it/s]
 16%|█▌        | 58223/371472 [4:38:13<23:32:39,  3.70it/s]
 16%|█▌        | 58224/371472 [4:38:14<23:30:54,  3.70it/s]
 16%|█▌        | 58225/371472 [4:38:14<24:18:08,  3.58it/s]
 16%|█▌        | 58226/371472 [4:38:14<25:44:31,  3.38it/s]
 16%|█▌        | 58227/371472 [4:38:15<24:38:04,  3.53it/s]
 16%|█▌        | 58228/371472 [4:38:15<25:18:32,  3.44it/s]
 16%|█▌        | 58229/371472 [4:38:15<24:28:04,  3.56it/s]
 16%|█▌        | 58230/371472 [4:38:15<23:53:20,  3.64it/s]
 16%|█▌        | 58231/371472 [4:38:16<24:04:56,  3.61it/s]
 16%|█▌        | 58232/371472 [4:38:16<23:57:23,  3.63it/s]
 16%|█▌        | 58233/371472 [4:38:16<24:07:49,  3.61it/s]
 16%|█▌        | 58234/371472 [4:38:17<24:44:44,  3.52it/s]
 16%|█▌        | 58235/371472 [4:38:17<24:49:14,  3.51it/s]
 16%|█▌        | 58236/371472 [4:38:17<24:17:44,  3.58it/s]
 16%|█▌        | 58237/371472 [4:38:17<24:56:19,  3.49it/s]
 16%|█▌        | 58238/371472 [4:38:18<26:21:50,  3.30it/s]
 16%|█▌        | 58239/371472 [4:38:18<25:28:02,  3.42it/s]
 16%|█▌        | 58240/371472 [4:38:18<27:47:10,  3.13it/s]
                                                           
{'loss': 4.3488, 'learning_rate': 8.593053071602491e-07, 'epoch': 2.51}

 16%|█▌        | 58240/371472 [4:38:18<27:47:10,  3.13it/s]
 16%|█▌        | 58241/371472 [4:38:19<25:37:43,  3.39it/s]
 16%|█▌        | 58242/371472 [4:38:19<25:05:18,  3.47it/s]
 16%|█▌        | 58243/371472 [4:38:19<24:33:59,  3.54it/s]
 16%|█▌        | 58244/371472 [4:38:20<24:46:14,  3.51it/s]
 16%|█▌        | 58245/371472 [4:38:20<24:18:04,  3.58it/s]
 16%|█▌        | 58246/371472 [4:38:20<24:50:29,  3.50it/s]
 16%|█▌        | 58247/371472 [4:38:20<23:57:17,  3.63it/s]
 16%|█▌        | 58248/371472 [4:38:21<23:19:22,  3.73it/s]
 16%|█▌        | 58249/371472 [4:38:21<23:46:28,  3.66it/s]
 16%|█▌        | 58250/371472 [4:38:21<23:04:46,  3.77it/s]
 16%|█▌        | 58251/371472 [4:38:21<23:02:23,  3.78it/s]
 16%|█▌        | 58252/371472 [4:38:22<23:16:45,  3.74it/s]
 16%|█▌        | 58253/371472 [4:38:22<23:49:31,  3.65it/s]
 16%|█▌        | 58254/371472 [4:38:22<23:03:37,  3.77it/s]
 16%|█▌        | 58255/371472 [4:38:22<23:54:07,  3.64it/s]
 16%|█▌        | 58256/371472 [4:38:23<23:41:30,  3.67it/s]
 16%|█▌        | 58257/371472 [4:38:23<23:06:52,  3.76it/s]
 16%|█▌        | 58258/371472 [4:38:23<22:20:01,  3.90it/s]
 16%|█▌        | 58259/371472 [4:38:24<24:07:47,  3.61it/s]
 16%|█▌        | 58260/371472 [4:38:24<24:08:08,  3.60it/s]
                                                           
{'loss': 4.213, 'learning_rate': 8.592568251847701e-07, 'epoch': 2.51}

 16%|█▌        | 58260/371472 [4:38:24<24:08:08,  3.60it/s]
 16%|█▌        | 58261/371472 [4:38:24<23:33:01,  3.69it/s]
 16%|█▌        | 58262/371472 [4:38:24<22:59:21,  3.78it/s]
 16%|█▌        | 58263/371472 [4:38:25<23:16:44,  3.74it/s]
 16%|█▌        | 58264/371472 [4:38:25<24:07:14,  3.61it/s]
 16%|█▌        | 58265/371472 [4:38:25<23:59:40,  3.63it/s]
 16%|█▌        | 58266/371472 [4:38:25<23:11:48,  3.75it/s]
 16%|█▌        | 58267/371472 [4:38:26<24:08:04,  3.60it/s]
 16%|█▌        | 58268/371472 [4:38:26<22:54:28,  3.80it/s]
 16%|█▌        | 58269/371472 [4:38:26<23:20:09,  3.73it/s]
 16%|█▌        | 58270/371472 [4:38:26<22:52:31,  3.80it/s]
 16%|█▌        | 58271/371472 [4:38:27<22:39:11,  3.84it/s]
 16%|█▌        | 58272/371472 [4:38:27<23:09:31,  3.76it/s]
 16%|█▌        | 58273/371472 [4:38:27<23:42:50,  3.67it/s]
 16%|█▌        | 58274/371472 [4:38:28<22:53:35,  3.80it/s]
 16%|█▌        | 58275/371472 [4:38:28<22:20:52,  3.89it/s]
 16%|█▌        | 58276/371472 [4:38:28<21:59:13,  3.96it/s]
 16%|█▌        | 58277/371472 [4:38:28<22:55:27,  3.80it/s]
 16%|█▌        | 58278/371472 [4:38:29<22:52:51,  3.80it/s]
 16%|█▌        | 58279/371472 [4:38:29<22:55:13,  3.80it/s]
 16%|█▌        | 58280/371472 [4:38:29<23:33:48,  3.69it/s]
                                                           
{'loss': 4.5169, 'learning_rate': 8.592083432092912e-07, 'epoch': 2.51}

 16%|█▌        | 58280/371472 [4:38:29<23:33:48,  3.69it/s]
 16%|█▌        | 58281/371472 [4:38:29<22:51:53,  3.80it/s]
 16%|█▌        | 58282/371472 [4:38:30<25:23:07,  3.43it/s]
 16%|█▌        | 58283/371472 [4:38:30<26:34:08,  3.27it/s]
 16%|█▌        | 58284/371472 [4:38:30<25:14:41,  3.45it/s]
 16%|█▌        | 58285/371472 [4:38:31<23:57:21,  3.63it/s]
 16%|█▌        | 58286/371472 [4:38:31<23:32:15,  3.70it/s]
 16%|█▌        | 58287/371472 [4:38:31<24:04:17,  3.61it/s]
 16%|█▌        | 58288/371472 [4:38:31<23:52:18,  3.64it/s]
 16%|█▌        | 58289/371472 [4:38:32<23:50:21,  3.65it/s]
 16%|█▌        | 58290/371472 [4:38:32<24:09:15,  3.60it/s]
 16%|█▌        | 58291/371472 [4:38:32<23:40:45,  3.67it/s]
 16%|█▌        | 58292/371472 [4:38:32<23:26:12,  3.71it/s]
 16%|█▌        | 58293/371472 [4:38:33<23:24:59,  3.72it/s]
 16%|█▌        | 58294/371472 [4:38:33<23:17:07,  3.74it/s]
 16%|█▌        | 58295/371472 [4:38:33<23:43:24,  3.67it/s]
 16%|█▌        | 58296/371472 [4:38:34<25:18:01,  3.44it/s]
 16%|█▌        | 58297/371472 [4:38:34<23:46:16,  3.66it/s]
 16%|█▌        | 58298/371472 [4:38:34<23:25:00,  3.71it/s]
 16%|█▌        | 58299/371472 [4:38:34<23:37:13,  3.68it/s]
 16%|█▌        | 58300/371472 [4:38:35<24:43:49,  3.52it/s]
                                                           
{'loss': 4.0503, 'learning_rate': 8.591598612338124e-07, 'epoch': 2.51}

 16%|█▌        | 58300/371472 [4:38:35<24:43:49,  3.52it/s]
 16%|█▌        | 58301/371472 [4:38:35<27:04:00,  3.21it/s]
 16%|█▌        | 58302/371472 [4:38:35<27:30:05,  3.16it/s]
 16%|█▌        | 58303/371472 [4:38:36<26:50:57,  3.24it/s]
 16%|█▌        | 58304/371472 [4:38:36<25:05:17,  3.47it/s]
 16%|█▌        | 58305/371472 [4:38:36<23:51:39,  3.65it/s]
 16%|█▌        | 58306/371472 [4:38:36<24:10:33,  3.60it/s]
 16%|█▌        | 58307/371472 [4:38:37<23:55:23,  3.64it/s]
 16%|█▌        | 58308/371472 [4:38:37<24:27:53,  3.56it/s]
 16%|█▌        | 58309/371472 [4:38:37<25:10:21,  3.46it/s]
 16%|█▌        | 58310/371472 [4:38:38<26:15:11,  3.31it/s]
 16%|█▌        | 58311/371472 [4:38:38<29:43:41,  2.93it/s]
 16%|█▌        | 58312/371472 [4:38:38<27:54:27,  3.12it/s]
 16%|█▌        | 58313/371472 [4:38:39<26:42:25,  3.26it/s]
 16%|█▌        | 58314/371472 [4:38:39<28:40:01,  3.03it/s]
 16%|█▌        | 58315/371472 [4:38:39<28:12:31,  3.08it/s]
 16%|█▌        | 58316/371472 [4:38:40<27:59:50,  3.11it/s]
 16%|█▌        | 58317/371472 [4:38:40<29:27:00,  2.95it/s]
 16%|█▌        | 58318/371472 [4:38:40<29:18:12,  2.97it/s]
 16%|█▌        | 58319/371472 [4:38:41<27:47:26,  3.13it/s]
 16%|█▌        | 58320/371472 [4:38:41<28:30:41,  3.05it/s]
                                                           
{'loss': 3.8825, 'learning_rate': 8.591113792583334e-07, 'epoch': 2.51}

 16%|█▌        | 58320/371472 [4:38:41<28:30:41,  3.05it/s]
 16%|█▌        | 58321/371472 [4:38:41<26:42:08,  3.26it/s]
 16%|█▌        | 58322/371472 [4:38:42<25:48:10,  3.37it/s]
 16%|█▌        | 58323/371472 [4:38:42<24:59:06,  3.48it/s]
 16%|█▌        | 58324/371472 [4:38:42<24:16:23,  3.58it/s]
 16%|█▌        | 58325/371472 [4:38:42<23:45:29,  3.66it/s]
 16%|█▌        | 58326/371472 [4:38:43<23:45:00,  3.66it/s]
 16%|█▌        | 58327/371472 [4:38:43<23:14:19,  3.74it/s]
 16%|█▌        | 58328/371472 [4:38:43<22:31:29,  3.86it/s]
 16%|█▌        | 58329/371472 [4:38:43<24:57:18,  3.49it/s]
 16%|█▌        | 58330/371472 [4:38:44<24:36:10,  3.54it/s]
 16%|█▌        | 58331/371472 [4:38:44<23:49:23,  3.65it/s]
 16%|█▌        | 58332/371472 [4:38:44<24:12:54,  3.59it/s]
 16%|█▌        | 58333/371472 [4:38:45<23:52:21,  3.64it/s]
 16%|█▌        | 58334/371472 [4:38:45<27:11:25,  3.20it/s]
 16%|█▌        | 58335/371472 [4:38:45<26:18:41,  3.31it/s]
 16%|█▌        | 58336/371472 [4:38:46<28:40:09,  3.03it/s]
 16%|█▌        | 58337/371472 [4:38:46<27:30:57,  3.16it/s]
 16%|█▌        | 58338/371472 [4:38:46<25:35:36,  3.40it/s]
 16%|█▌        | 58339/371472 [4:38:46<25:07:06,  3.46it/s]
 16%|█▌        | 58340/371472 [4:38:47<24:48:47,  3.51it/s]
                                                           
{'loss': 4.281, 'learning_rate': 8.590628972828545e-07, 'epoch': 2.51}

 16%|█▌        | 58340/371472 [4:38:47<24:48:47,  3.51it/s]
 16%|█▌        | 58341/371472 [4:38:47<25:56:40,  3.35it/s]
 16%|█▌        | 58342/371472 [4:38:47<24:47:47,  3.51it/s]
 16%|█▌        | 58343/371472 [4:38:48<24:06:31,  3.61it/s]
 16%|█▌        | 58344/371472 [4:38:48<23:14:08,  3.74it/s]
 16%|█▌        | 58345/371472 [4:38:48<25:01:53,  3.47it/s]
 16%|█▌        | 58346/371472 [4:38:48<27:11:26,  3.20it/s]
 16%|█▌        | 58347/371472 [4:38:49<25:50:18,  3.37it/s]
 16%|█▌        | 58348/371472 [4:38:49<24:54:48,  3.49it/s]
 16%|█▌        | 58349/371472 [4:38:49<24:59:11,  3.48it/s]
 16%|█▌        | 58350/371472 [4:38:50<23:42:23,  3.67it/s]
 16%|█▌        | 58351/371472 [4:38:50<25:29:59,  3.41it/s]
 16%|█▌        | 58352/371472 [4:38:50<24:14:42,  3.59it/s]
 16%|█▌        | 58353/371472 [4:38:50<23:45:01,  3.66it/s]
 16%|█▌        | 58354/371472 [4:38:51<23:26:33,  3.71it/s]
 16%|█▌        | 58355/371472 [4:38:51<25:04:04,  3.47it/s]
 16%|█▌        | 58356/371472 [4:38:51<27:13:58,  3.19it/s]
 16%|█▌        | 58357/371472 [4:38:52<26:52:52,  3.24it/s]
 16%|█▌        | 58358/371472 [4:38:52<26:29:06,  3.28it/s]
 16%|█▌        | 58359/371472 [4:38:52<25:20:03,  3.43it/s]
 16%|█▌        | 58360/371472 [4:38:52<25:18:33,  3.44it/s]
                                                           
{'loss': 4.2192, 'learning_rate': 8.590144153073757e-07, 'epoch': 2.51}

 16%|█▌        | 58360/371472 [4:38:52<25:18:33,  3.44it/s]
 16%|█▌        | 58361/371472 [4:38:53<25:39:24,  3.39it/s]
 16%|█▌        | 58362/371472 [4:38:53<24:46:31,  3.51it/s]
 16%|█▌        | 58363/371472 [4:38:53<24:21:59,  3.57it/s]
 16%|█▌        | 58364/371472 [4:38:54<24:16:46,  3.58it/s]
 16%|█▌        | 58365/371472 [4:38:54<24:58:42,  3.48it/s]
 16%|█▌        | 58366/371472 [4:38:54<24:32:46,  3.54it/s]
 16%|█▌        | 58367/371472 [4:38:54<23:54:52,  3.64it/s]
 16%|█▌        | 58368/371472 [4:38:55<24:56:44,  3.49it/s]
 16%|█▌        | 58369/371472 [4:38:55<24:26:13,  3.56it/s]
 16%|█▌        | 58370/371472 [4:38:55<25:43:33,  3.38it/s]
 16%|█▌        | 58371/371472 [4:38:56<25:49:52,  3.37it/s]
 16%|█▌        | 58372/371472 [4:38:56<25:47:34,  3.37it/s]
 16%|█▌        | 58373/371472 [4:38:56<25:51:44,  3.36it/s]
 16%|█▌        | 58374/371472 [4:38:57<25:31:39,  3.41it/s]
 16%|█▌        | 58375/371472 [4:38:57<25:02:20,  3.47it/s]
 16%|█▌        | 58376/371472 [4:38:57<24:50:57,  3.50it/s]
 16%|█▌        | 58377/371472 [4:38:57<24:20:53,  3.57it/s]
 16%|█▌        | 58378/371472 [4:38:58<23:42:09,  3.67it/s]
 16%|█▌        | 58379/371472 [4:38:58<23:22:48,  3.72it/s]
 16%|█▌        | 58380/371472 [4:38:58<24:46:13,  3.51it/s]
                                                           
{'loss': 4.2605, 'learning_rate': 8.58965933331897e-07, 'epoch': 2.51}

 16%|█▌        | 58380/371472 [4:38:58<24:46:13,  3.51it/s]
 16%|█▌        | 58381/371472 [4:38:58<24:35:21,  3.54it/s]
 16%|█▌        | 58382/371472 [4:38:59<24:41:27,  3.52it/s]
 16%|█▌        | 58383/371472 [4:38:59<24:06:02,  3.61it/s]
 16%|█▌        | 58384/371472 [4:38:59<23:44:49,  3.66it/s]
 16%|█▌        | 58385/371472 [4:39:00<23:42:26,  3.67it/s]
 16%|█▌        | 58386/371472 [4:39:00<24:39:47,  3.53it/s]
 16%|█▌        | 58387/371472 [4:39:00<24:23:57,  3.56it/s]
 16%|█▌        | 58388/371472 [4:39:00<24:01:08,  3.62it/s]
 16%|█▌        | 58389/371472 [4:39:01<24:00:31,  3.62it/s]
 16%|█▌        | 58390/371472 [4:39:01<23:21:11,  3.72it/s]
 16%|█▌        | 58391/371472 [4:39:01<24:26:11,  3.56it/s]
 16%|█▌        | 58392/371472 [4:39:02<24:29:18,  3.55it/s]
 16%|█▌        | 58393/371472 [4:39:02<24:33:03,  3.54it/s]
 16%|█▌        | 58394/371472 [4:39:02<24:02:59,  3.62it/s]
 16%|█▌        | 58395/371472 [4:39:02<26:59:40,  3.22it/s]
 16%|█▌        | 58396/371472 [4:39:03<28:43:42,  3.03it/s]
 16%|█▌        | 58397/371472 [4:39:03<28:30:29,  3.05it/s]
 16%|█▌        | 58398/371472 [4:39:03<28:12:03,  3.08it/s]
 16%|█▌        | 58399/371472 [4:39:04<27:04:59,  3.21it/s]
 16%|█▌        | 58400/371472 [4:39:04<25:50:52,  3.36it/s]
                                                           
{'loss': 4.209, 'learning_rate': 8.58917451356418e-07, 'epoch': 2.52}

 16%|█▌        | 58400/371472 [4:39:04<25:50:52,  3.36it/s]
 16%|█▌        | 58401/371472 [4:39:04<24:52:54,  3.50it/s]
 16%|█▌        | 58402/371472 [4:39:05<25:44:52,  3.38it/s]
 16%|█▌        | 58403/371472 [4:39:05<24:52:59,  3.49it/s]
 16%|█▌        | 58404/371472 [4:39:05<26:45:48,  3.25it/s]
 16%|█▌        | 58405/371472 [4:39:06<27:02:28,  3.22it/s]
 16%|█▌        | 58406/371472 [4:39:06<25:41:44,  3.38it/s]
 16%|█▌        | 58407/371472 [4:39:06<26:04:43,  3.33it/s]
 16%|█▌        | 58408/371472 [4:39:06<24:39:25,  3.53it/s]
 16%|█▌        | 58409/371472 [4:39:07<24:00:16,  3.62it/s]
 16%|█▌        | 58410/371472 [4:39:07<24:31:57,  3.54it/s]
 16%|█▌        | 58411/371472 [4:39:07<23:53:02,  3.64it/s]
 16%|█▌        | 58412/371472 [4:39:07<23:18:27,  3.73it/s]
 16%|█▌        | 58413/371472 [4:39:08<22:36:56,  3.85it/s]
 16%|█▌        | 58414/371472 [4:39:08<23:21:45,  3.72it/s]
 16%|█▌        | 58415/371472 [4:39:08<24:06:18,  3.61it/s]
 16%|█▌        | 58416/371472 [4:39:09<24:47:08,  3.51it/s]
 16%|█▌        | 58417/371472 [4:39:09<27:16:31,  3.19it/s]
 16%|█▌        | 58418/371472 [4:39:09<26:05:19,  3.33it/s]
 16%|█▌        | 58419/371472 [4:39:09<25:53:52,  3.36it/s]
 16%|█▌        | 58420/371472 [4:39:10<27:03:40,  3.21it/s]
                                                           
{'loss': 4.2857, 'learning_rate': 8.588689693809389e-07, 'epoch': 2.52}

 16%|█▌        | 58420/371472 [4:39:10<27:03:40,  3.21it/s]
 16%|█▌        | 58421/371472 [4:39:10<27:35:27,  3.15it/s]
 16%|█▌        | 58422/371472 [4:39:10<25:54:44,  3.36it/s]
 16%|█▌        | 58423/371472 [4:39:11<25:07:00,  3.46it/s]
 16%|█▌        | 58424/371472 [4:39:11<24:01:17,  3.62it/s]
 16%|█▌        | 58425/371472 [4:39:11<23:26:55,  3.71it/s]
 16%|█▌        | 58426/371472 [4:39:11<22:46:38,  3.82it/s]
 16%|█▌        | 58427/371472 [4:39:12<24:10:30,  3.60it/s]
 16%|█▌        | 58428/371472 [4:39:12<23:58:47,  3.63it/s]
 16%|█▌        | 58429/371472 [4:39:12<24:18:12,  3.58it/s]
 16%|█▌        | 58430/371472 [4:39:13<24:12:26,  3.59it/s]
 16%|█▌        | 58431/371472 [4:39:13<23:10:06,  3.75it/s]
 16%|█▌        | 58432/371472 [4:39:13<23:04:45,  3.77it/s]
 16%|█▌        | 58433/371472 [4:39:13<22:25:28,  3.88it/s]
 16%|█▌        | 58434/371472 [4:39:14<22:55:45,  3.79it/s]
 16%|█▌        | 58435/371472 [4:39:14<28:10:29,  3.09it/s]
 16%|█▌        | 58436/371472 [4:39:14<25:44:44,  3.38it/s]
 16%|█▌        | 58437/371472 [4:39:15<25:10:58,  3.45it/s]
 16%|█▌        | 58438/371472 [4:39:15<25:07:47,  3.46it/s]
 16%|█▌        | 58439/371472 [4:39:15<24:38:21,  3.53it/s]
 16%|█▌        | 58440/371472 [4:39:15<25:47:54,  3.37it/s]
                                                           
{'loss': 4.1435, 'learning_rate': 8.588204874054601e-07, 'epoch': 2.52}

 16%|█▌        | 58440/371472 [4:39:15<25:47:54,  3.37it/s]
 16%|█▌        | 58441/371472 [4:39:16<25:00:12,  3.48it/s]
 16%|█▌        | 58442/371472 [4:39:16<24:20:02,  3.57it/s]
 16%|█▌        | 58443/371472 [4:39:16<24:39:42,  3.53it/s]
 16%|█▌        | 58444/371472 [4:39:17<24:56:29,  3.49it/s]
 16%|█▌        | 58445/371472 [4:39:17<24:24:20,  3.56it/s]
 16%|█▌        | 58446/371472 [4:39:17<23:49:05,  3.65it/s]
 16%|█▌        | 58447/371472 [4:39:17<24:44:58,  3.51it/s]
 16%|█▌        | 58448/371472 [4:39:18<24:08:51,  3.60it/s]
 16%|█▌        | 58449/371472 [4:39:18<23:31:27,  3.70it/s]
 16%|█▌        | 58450/371472 [4:39:18<24:45:43,  3.51it/s]
 16%|█▌        | 58451/371472 [4:39:18<23:18:59,  3.73it/s]
 16%|█▌        | 58452/371472 [4:39:19<23:24:01,  3.72it/s]
 16%|█▌        | 58453/371472 [4:39:19<23:49:36,  3.65it/s]
 16%|█▌        | 58454/371472 [4:39:19<23:01:01,  3.78it/s]
 16%|█▌        | 58455/371472 [4:39:19<22:17:36,  3.90it/s]
 16%|█▌        | 58456/371472 [4:39:20<22:15:07,  3.91it/s]
 16%|█▌        | 58457/371472 [4:39:20<22:06:07,  3.93it/s]
 16%|█▌        | 58458/371472 [4:39:20<22:08:00,  3.93it/s]
 16%|█▌        | 58459/371472 [4:39:21<24:26:56,  3.56it/s]
 16%|█▌        | 58460/371472 [4:39:21<23:30:15,  3.70it/s]
                                                           
{'loss': 4.3966, 'learning_rate': 8.587720054299813e-07, 'epoch': 2.52}

 16%|█▌        | 58460/371472 [4:39:21<23:30:15,  3.70it/s]
 16%|█▌        | 58461/371472 [4:39:21<23:30:07,  3.70it/s]
 16%|█▌        | 58462/371472 [4:39:21<22:47:45,  3.81it/s]
 16%|█▌        | 58463/371472 [4:39:22<22:18:32,  3.90it/s]
 16%|█▌        | 58464/371472 [4:39:22<22:06:57,  3.93it/s]
 16%|█▌        | 58465/371472 [4:39:22<24:15:53,  3.58it/s]
 16%|█▌        | 58466/371472 [4:39:22<25:22:51,  3.43it/s]
 16%|█▌        | 58467/371472 [4:39:23<24:31:27,  3.55it/s]
 16%|█▌        | 58468/371472 [4:39:23<24:18:14,  3.58it/s]
 16%|█▌        | 58469/371472 [4:39:23<24:51:25,  3.50it/s]
 16%|█▌        | 58470/371472 [4:39:24<23:21:27,  3.72it/s]
 16%|█▌        | 58471/371472 [4:39:24<23:20:11,  3.73it/s]
 16%|█▌        | 58472/371472 [4:39:24<23:41:54,  3.67it/s]
 16%|█▌        | 58473/371472 [4:39:24<24:34:03,  3.54it/s]
 16%|█▌        | 58474/371472 [4:39:25<23:51:18,  3.64it/s]
 16%|█▌        | 58475/371472 [4:39:25<23:13:41,  3.74it/s]
 16%|█▌        | 58476/371472 [4:39:25<26:13:32,  3.32it/s]
 16%|█▌        | 58477/371472 [4:39:26<25:13:26,  3.45it/s]
 16%|█▌        | 58478/371472 [4:39:26<24:35:14,  3.54it/s]
 16%|█▌        | 58479/371472 [4:39:26<24:20:15,  3.57it/s]
 16%|█▌        | 58480/371472 [4:39:26<24:41:16,  3.52it/s]
                                                           
{'loss': 4.1411, 'learning_rate': 8.587235234545023e-07, 'epoch': 2.52}

 16%|█▌        | 58480/371472 [4:39:26<24:41:16,  3.52it/s]
 16%|█▌        | 58481/371472 [4:39:27<24:53:10,  3.49it/s]
 16%|█▌        | 58482/371472 [4:39:27<24:17:08,  3.58it/s]
 16%|█▌        | 58483/371472 [4:39:27<23:29:13,  3.70it/s]
 16%|█▌        | 58484/371472 [4:39:28<25:58:59,  3.35it/s]
 16%|█▌        | 58485/371472 [4:39:28<26:10:21,  3.32it/s]
 16%|█▌        | 58486/371472 [4:39:28<26:14:03,  3.31it/s]
 16%|█▌        | 58487/371472 [4:39:28<25:16:13,  3.44it/s]
 16%|█▌        | 58488/371472 [4:39:29<24:03:54,  3.61it/s]
 16%|█▌        | 58489/371472 [4:39:29<26:03:19,  3.34it/s]
 16%|█▌        | 58490/371472 [4:39:29<25:51:05,  3.36it/s]
 16%|█▌        | 58491/371472 [4:39:30<25:38:40,  3.39it/s]
 16%|█▌        | 58492/371472 [4:39:30<27:03:39,  3.21it/s]
 16%|█▌        | 58493/371472 [4:39:30<25:23:44,  3.42it/s]
 16%|█▌        | 58494/371472 [4:39:30<25:06:18,  3.46it/s]
 16%|█▌        | 58495/371472 [4:39:31<24:28:20,  3.55it/s]
 16%|█▌        | 58496/371472 [4:39:31<25:21:02,  3.43it/s]
 16%|█▌        | 58497/371472 [4:39:31<24:32:53,  3.54it/s]
 16%|█▌        | 58498/371472 [4:39:32<23:58:20,  3.63it/s]
 16%|█▌        | 58499/371472 [4:39:32<24:03:33,  3.61it/s]
 16%|█▌        | 58500/371472 [4:39:32<23:54:46,  3.64it/s]
                                                           
{'loss': 4.2864, 'learning_rate': 8.586750414790234e-07, 'epoch': 2.52}

 16%|█▌        | 58500/371472 [4:39:32<23:54:46,  3.64it/s]
 16%|█▌        | 58501/371472 [4:39:32<23:55:18,  3.63it/s]
 16%|█▌        | 58502/371472 [4:39:33<22:59:52,  3.78it/s]
 16%|█▌        | 58503/371472 [4:39:33<24:13:07,  3.59it/s]
 16%|█▌        | 58504/371472 [4:39:33<23:58:34,  3.63it/s]
 16%|█▌        | 58505/371472 [4:39:34<25:11:22,  3.45it/s]
 16%|█▌        | 58506/371472 [4:39:34<24:45:08,  3.51it/s]
 16%|█▌        | 58507/371472 [4:39:34<24:09:29,  3.60it/s]
 16%|█▌        | 58508/371472 [4:39:34<24:07:59,  3.60it/s]
 16%|█▌        | 58509/371472 [4:39:35<25:05:00,  3.47it/s]
 16%|█▌        | 58510/371472 [4:39:35<24:34:10,  3.54it/s]
 16%|█▌        | 58511/371472 [4:39:35<24:20:27,  3.57it/s]
 16%|█▌        | 58512/371472 [4:39:36<25:55:55,  3.35it/s]
 16%|█▌        | 58513/371472 [4:39:36<26:24:14,  3.29it/s]
 16%|█▌        | 58514/371472 [4:39:36<25:06:27,  3.46it/s]
 16%|█▌        | 58515/371472 [4:39:36<24:20:21,  3.57it/s]
 16%|█▌        | 58516/371472 [4:39:37<24:03:10,  3.61it/s]
 16%|█▌        | 58517/371472 [4:39:37<24:27:50,  3.55it/s]
 16%|█▌        | 58518/371472 [4:39:37<24:48:24,  3.50it/s]
 16%|█▌        | 58519/371472 [4:39:38<24:43:34,  3.52it/s]
 16%|█▌        | 58520/371472 [4:39:38<25:29:27,  3.41it/s]
                                                           
{'loss': 4.035, 'learning_rate': 8.586265595035446e-07, 'epoch': 2.52}

 16%|█▌        | 58520/371472 [4:39:38<25:29:27,  3.41it/s]
 16%|█▌        | 58521/371472 [4:39:38<24:51:32,  3.50it/s]
 16%|█▌        | 58522/371472 [4:39:38<25:30:19,  3.41it/s]
 16%|█▌        | 58523/371472 [4:39:39<24:50:41,  3.50it/s]
 16%|█▌        | 58524/371472 [4:39:39<23:36:30,  3.68it/s]
 16%|█▌        | 58525/371472 [4:39:39<24:02:35,  3.62it/s]
 16%|█▌        | 58526/371472 [4:39:40<24:48:46,  3.50it/s]
 16%|█▌        | 58527/371472 [4:39:40<23:51:12,  3.64it/s]
 16%|█▌        | 58528/371472 [4:39:40<22:56:23,  3.79it/s]
 16%|█▌        | 58529/371472 [4:39:40<24:18:26,  3.58it/s]
 16%|█▌        | 58530/371472 [4:39:41<24:23:28,  3.56it/s]
 16%|█▌        | 58531/371472 [4:39:41<24:12:40,  3.59it/s]
 16%|█▌        | 58532/371472 [4:39:41<23:55:27,  3.63it/s]
 16%|█▌        | 58533/371472 [4:39:41<23:36:55,  3.68it/s]
 16%|█▌        | 58534/371472 [4:39:42<23:37:54,  3.68it/s]
 16%|█▌        | 58535/371472 [4:39:42<22:53:56,  3.80it/s]
 16%|█▌        | 58536/371472 [4:39:42<24:24:26,  3.56it/s]
 16%|█▌        | 58537/371472 [4:39:43<23:18:25,  3.73it/s]
 16%|█▌        | 58538/371472 [4:39:43<23:12:04,  3.75it/s]
 16%|█▌        | 58539/371472 [4:39:43<23:41:27,  3.67it/s]
 16%|█▌        | 58540/371472 [4:39:43<23:21:55,  3.72it/s]
                                                           
{'loss': 4.0988, 'learning_rate': 8.585780775280656e-07, 'epoch': 2.52}

 16%|█▌        | 58540/371472 [4:39:43<23:21:55,  3.72it/s]
 16%|█▌        | 58541/371472 [4:39:44<23:49:03,  3.65it/s]
 16%|█▌        | 58542/371472 [4:39:44<23:31:28,  3.70it/s]
 16%|█▌        | 58543/371472 [4:39:44<24:38:01,  3.53it/s]
 16%|█▌        | 58544/371472 [4:39:44<24:33:11,  3.54it/s]
 16%|█▌        | 58545/371472 [4:39:45<24:37:01,  3.53it/s]
 16%|█▌        | 58546/371472 [4:39:45<25:27:39,  3.41it/s]
 16%|█▌        | 58547/371472 [4:39:45<25:19:28,  3.43it/s]
 16%|█▌        | 58548/371472 [4:39:46<24:49:46,  3.50it/s]
 16%|█▌        | 58549/371472 [4:39:46<25:22:17,  3.43it/s]
 16%|█▌        | 58550/371472 [4:39:46<24:14:52,  3.58it/s]
 16%|█▌        | 58551/371472 [4:39:46<23:51:45,  3.64it/s]
 16%|█▌        | 58552/371472 [4:39:47<25:05:42,  3.46it/s]
 16%|█▌        | 58553/371472 [4:39:47<24:44:36,  3.51it/s]
 16%|█▌        | 58554/371472 [4:39:47<24:23:20,  3.56it/s]
 16%|█▌        | 58555/371472 [4:39:48<24:06:30,  3.61it/s]
 16%|█▌        | 58556/371472 [4:39:48<23:24:35,  3.71it/s]
 16%|█▌        | 58557/371472 [4:39:48<22:44:25,  3.82it/s]
 16%|█▌        | 58558/371472 [4:39:48<23:49:26,  3.65it/s]
 16%|█▌        | 58559/371472 [4:39:49<23:24:27,  3.71it/s]
 16%|█▌        | 58560/371472 [4:39:49<22:53:34,  3.80it/s]
                                                           
{'loss': 4.2534, 'learning_rate': 8.585295955525867e-07, 'epoch': 2.52}

 16%|█▌        | 58560/371472 [4:39:49<22:53:34,  3.80it/s]
 16%|█▌        | 58561/371472 [4:39:49<22:40:28,  3.83it/s]
 16%|█▌        | 58562/371472 [4:39:49<22:42:16,  3.83it/s]
 16%|█▌        | 58563/371472 [4:39:50<23:28:33,  3.70it/s]
 16%|█▌        | 58564/371472 [4:39:50<24:22:27,  3.57it/s]
 16%|█▌        | 58565/371472 [4:39:50<24:06:08,  3.61it/s]
 16%|█▌        | 58566/371472 [4:39:51<24:50:16,  3.50it/s]
 16%|█▌        | 58567/371472 [4:39:51<24:10:28,  3.60it/s]
 16%|█▌        | 58568/371472 [4:39:51<24:10:23,  3.60it/s]
 16%|█▌        | 58569/371472 [4:39:51<24:26:11,  3.56it/s]
 16%|█▌        | 58570/371472 [4:39:52<24:36:09,  3.53it/s]
 16%|█▌        | 58571/371472 [4:39:52<24:38:00,  3.53it/s]
 16%|█▌        | 58572/371472 [4:39:52<24:25:51,  3.56it/s]
 16%|█▌        | 58573/371472 [4:39:53<24:33:33,  3.54it/s]
 16%|█▌        | 58574/371472 [4:39:53<25:51:41,  3.36it/s]
 16%|█▌        | 58575/371472 [4:39:53<24:55:26,  3.49it/s]
 16%|█▌        | 58576/371472 [4:39:53<24:50:44,  3.50it/s]
 16%|█▌        | 58577/371472 [4:39:54<23:54:31,  3.64it/s]
 16%|█▌        | 58578/371472 [4:39:54<24:18:57,  3.57it/s]
 16%|█▌        | 58579/371472 [4:39:54<23:18:36,  3.73it/s]
 16%|█▌        | 58580/371472 [4:39:54<23:12:25,  3.75it/s]
                                                           
{'loss': 4.1708, 'learning_rate': 8.584811135771078e-07, 'epoch': 2.52}

 16%|█▌        | 58580/371472 [4:39:54<23:12:25,  3.75it/s]
 16%|█▌        | 58581/371472 [4:39:55<23:46:42,  3.66it/s]
 16%|█▌        | 58582/371472 [4:39:55<23:22:49,  3.72it/s]
 16%|█▌        | 58583/371472 [4:39:55<23:38:15,  3.68it/s]
 16%|█▌        | 58584/371472 [4:39:56<24:01:32,  3.62it/s]
 16%|█▌        | 58585/371472 [4:39:56<25:35:11,  3.40it/s]
 16%|█▌        | 58586/371472 [4:39:56<25:07:28,  3.46it/s]
 16%|█▌        | 58587/371472 [4:39:56<24:47:19,  3.51it/s]
 16%|█▌        | 58588/371472 [4:39:57<25:57:24,  3.35it/s]
 16%|█▌        | 58589/371472 [4:39:57<26:32:41,  3.27it/s]
 16%|█▌        | 58590/371472 [4:39:57<24:33:08,  3.54it/s]
 16%|█▌        | 58591/371472 [4:39:58<25:45:22,  3.37it/s]
 16%|█▌        | 58592/371472 [4:39:58<25:03:22,  3.47it/s]
 16%|█▌        | 58593/371472 [4:39:58<24:50:33,  3.50it/s]
 16%|█▌        | 58594/371472 [4:39:58<23:41:54,  3.67it/s]
 16%|█▌        | 58595/371472 [4:39:59<22:52:27,  3.80it/s]
 16%|█▌        | 58596/371472 [4:39:59<22:58:12,  3.78it/s]
 16%|█▌        | 58597/371472 [4:39:59<23:44:13,  3.66it/s]
 16%|█▌        | 58598/371472 [4:40:00<24:29:26,  3.55it/s]
 16%|█▌        | 58599/371472 [4:40:00<24:14:06,  3.59it/s]
 16%|█▌        | 58600/371472 [4:40:00<24:05:11,  3.61it/s]
                                                           
{'loss': 4.3406, 'learning_rate': 8.58432631601629e-07, 'epoch': 2.52}

 16%|█▌        | 58600/371472 [4:40:00<24:05:11,  3.61it/s]
 16%|█▌        | 58601/371472 [4:40:00<23:20:52,  3.72it/s]
 16%|█▌        | 58602/371472 [4:40:01<25:11:52,  3.45it/s]
 16%|█▌        | 58603/371472 [4:40:01<24:55:46,  3.49it/s]
 16%|█▌        | 58604/371472 [4:40:01<28:18:04,  3.07it/s]
 16%|█▌        | 58605/371472 [4:40:02<26:31:57,  3.28it/s]
 16%|█▌        | 58606/371472 [4:40:02<24:53:14,  3.49it/s]
 16%|█▌        | 58607/371472 [4:40:02<24:01:12,  3.62it/s]
 16%|█▌        | 58608/371472 [4:40:02<24:43:17,  3.52it/s]
 16%|█▌        | 58609/371472 [4:40:03<24:28:17,  3.55it/s]
 16%|█▌        | 58610/371472 [4:40:03<24:03:36,  3.61it/s]
 16%|█▌        | 58611/371472 [4:40:03<23:59:26,  3.62it/s]
 16%|█▌        | 58612/371472 [4:40:04<26:52:41,  3.23it/s]
 16%|█▌        | 58613/371472 [4:40:04<25:52:42,  3.36it/s]
 16%|█▌        | 58614/371472 [4:40:04<25:00:05,  3.48it/s]
 16%|█▌        | 58615/371472 [4:40:04<25:29:39,  3.41it/s]
 16%|█▌        | 58616/371472 [4:40:05<25:54:46,  3.35it/s]
 16%|█▌        | 58617/371472 [4:40:05<24:49:10,  3.50it/s]
 16%|█▌        | 58618/371472 [4:40:05<23:51:00,  3.64it/s]
 16%|█▌        | 58619/371472 [4:40:06<24:17:41,  3.58it/s]
 16%|█▌        | 58620/371472 [4:40:06<24:19:57,  3.57it/s]
                                                           
{'loss': 4.4411, 'learning_rate': 8.5838414962615e-07, 'epoch': 2.52}

 16%|█▌        | 58620/371472 [4:40:06<24:19:57,  3.57it/s]
 16%|█▌        | 58621/371472 [4:40:06<25:56:55,  3.35it/s]
 16%|█▌        | 58622/371472 [4:40:06<24:15:50,  3.58it/s]
 16%|█▌        | 58623/371472 [4:40:07<25:36:58,  3.39it/s]
 16%|█▌        | 58624/371472 [4:40:07<24:56:12,  3.48it/s]
 16%|█▌        | 58625/371472 [4:40:07<25:20:07,  3.43it/s]
 16%|█▌        | 58626/371472 [4:40:08<24:27:05,  3.55it/s]
 16%|█▌        | 58627/371472 [4:40:08<24:17:12,  3.58it/s]
 16%|█▌        | 58628/371472 [4:40:08<24:14:18,  3.59it/s]
 16%|█▌        | 58629/371472 [4:40:08<23:51:37,  3.64it/s]
 16%|█▌        | 58630/371472 [4:40:09<24:45:54,  3.51it/s]
 16%|█▌        | 58631/371472 [4:40:09<24:55:43,  3.49it/s]
 16%|█▌        | 58632/371472 [4:40:09<25:06:13,  3.46it/s]
 16%|█▌        | 58633/371472 [4:40:10<24:38:58,  3.53it/s]
 16%|█▌        | 58634/371472 [4:40:10<24:24:15,  3.56it/s]
 16%|█▌        | 58635/371472 [4:40:10<24:09:51,  3.60it/s]
 16%|█▌        | 58636/371472 [4:40:10<24:25:46,  3.56it/s]
 16%|█▌        | 58637/371472 [4:40:11<26:06:11,  3.33it/s]
 16%|█▌        | 58638/371472 [4:40:11<25:50:18,  3.36it/s]
 16%|█▌        | 58639/371472 [4:40:11<25:52:37,  3.36it/s]
 16%|█▌        | 58640/371472 [4:40:12<25:35:09,  3.40it/s]
                                                           
{'loss': 4.1217, 'learning_rate': 8.583356676506712e-07, 'epoch': 2.53}

 16%|█▌        | 58640/371472 [4:40:12<25:35:09,  3.40it/s]
 16%|█▌        | 58641/371472 [4:40:12<25:22:48,  3.42it/s]
 16%|█▌        | 58642/371472 [4:40:12<24:47:06,  3.51it/s]
 16%|█▌        | 58643/371472 [4:40:12<24:13:02,  3.59it/s]
 16%|█▌        | 58644/371472 [4:40:13<24:06:38,  3.60it/s]
 16%|█▌        | 58645/371472 [4:40:13<24:02:01,  3.62it/s]
 16%|█▌        | 58646/371472 [4:40:13<23:34:37,  3.69it/s]
 16%|█▌        | 58647/371472 [4:40:14<23:47:31,  3.65it/s]
 16%|█▌        | 58648/371472 [4:40:14<23:17:01,  3.73it/s]
 16%|█▌        | 58649/371472 [4:40:14<22:53:50,  3.79it/s]
 16%|█▌        | 58650/371472 [4:40:14<23:42:12,  3.67it/s]
 16%|█▌        | 58651/371472 [4:40:15<23:37:13,  3.68it/s]
 16%|█▌        | 58652/371472 [4:40:15<23:34:47,  3.69it/s]
 16%|█▌        | 58653/371472 [4:40:15<23:01:17,  3.77it/s]
 16%|█▌        | 58654/371472 [4:40:15<23:10:00,  3.75it/s]
 16%|█▌        | 58655/371472 [4:40:16<23:06:35,  3.76it/s]
 16%|█▌        | 58656/371472 [4:40:16<23:43:55,  3.66it/s]
 16%|█▌        | 58657/371472 [4:40:16<23:36:00,  3.68it/s]
 16%|█▌        | 58658/371472 [4:40:17<25:53:08,  3.36it/s]
 16%|█▌        | 58659/371472 [4:40:17<26:23:22,  3.29it/s]
 16%|█▌        | 58660/371472 [4:40:17<25:41:15,  3.38it/s]
                                                           
{'loss': 4.4278, 'learning_rate': 8.582871856751923e-07, 'epoch': 2.53}

 16%|█▌        | 58660/371472 [4:40:17<25:41:15,  3.38it/s]
 16%|█▌        | 58661/371472 [4:40:17<24:45:18,  3.51it/s]
 16%|█▌        | 58662/371472 [4:40:18<23:47:35,  3.65it/s]
 16%|█▌        | 58663/371472 [4:40:18<24:10:18,  3.59it/s]
 16%|█▌        | 58664/371472 [4:40:18<25:24:31,  3.42it/s]
 16%|█▌        | 58665/371472 [4:40:19<26:43:45,  3.25it/s]
 16%|█▌        | 58666/371472 [4:40:19<26:17:48,  3.30it/s]
 16%|█▌        | 58667/371472 [4:40:19<27:31:07,  3.16it/s]
 16%|█▌        | 58668/371472 [4:40:20<25:48:06,  3.37it/s]
 16%|█▌        | 58669/371472 [4:40:20<24:48:10,  3.50it/s]
 16%|█▌        | 58670/371472 [4:40:20<25:07:01,  3.46it/s]
 16%|█▌        | 58671/371472 [4:40:20<25:06:22,  3.46it/s]
 16%|█▌        | 58672/371472 [4:40:21<26:04:29,  3.33it/s]
 16%|█▌        | 58673/371472 [4:40:21<26:08:17,  3.32it/s]
 16%|█▌        | 58674/371472 [4:40:21<25:32:45,  3.40it/s]
 16%|█▌        | 58675/371472 [4:40:22<25:18:43,  3.43it/s]
 16%|█▌        | 58676/371472 [4:40:22<24:08:30,  3.60it/s]
 16%|█▌        | 58677/371472 [4:40:22<24:17:16,  3.58it/s]
 16%|█▌        | 58678/371472 [4:40:22<23:35:09,  3.68it/s]
 16%|█▌        | 58679/371472 [4:40:23<24:11:29,  3.59it/s]
 16%|█▌        | 58680/371472 [4:40:23<24:55:59,  3.48it/s]
                                                           
{'loss': 4.3738, 'learning_rate': 8.582387036997134e-07, 'epoch': 2.53}

 16%|█▌        | 58680/371472 [4:40:23<24:55:59,  3.48it/s]
 16%|█▌        | 58681/371472 [4:40:23<24:48:19,  3.50it/s]
 16%|█▌        | 58682/371472 [4:40:24<24:41:45,  3.52it/s]
 16%|█▌        | 58683/371472 [4:40:24<26:21:11,  3.30it/s]
 16%|█▌        | 58684/371472 [4:40:24<25:31:46,  3.40it/s]
 16%|█▌        | 58685/371472 [4:40:24<24:38:20,  3.53it/s]
 16%|█▌        | 58686/371472 [4:40:25<23:36:39,  3.68it/s]
 16%|█▌        | 58687/371472 [4:40:25<23:37:02,  3.68it/s]
 16%|█▌        | 58688/371472 [4:40:25<23:29:02,  3.70it/s]
 16%|█▌        | 58689/371472 [4:40:26<25:33:15,  3.40it/s]
 16%|█▌        | 58690/371472 [4:40:26<24:01:13,  3.62it/s]
 16%|█▌        | 58691/371472 [4:40:26<24:13:54,  3.59it/s]
 16%|█▌        | 58692/371472 [4:40:26<23:56:48,  3.63it/s]
 16%|█▌        | 58693/371472 [4:40:27<23:41:11,  3.67it/s]
 16%|█▌        | 58694/371472 [4:40:27<23:09:25,  3.75it/s]
 16%|█▌        | 58695/371472 [4:40:27<22:55:16,  3.79it/s]
 16%|█▌        | 58696/371472 [4:40:27<22:28:42,  3.87it/s]
 16%|█▌        | 58697/371472 [4:40:28<22:30:31,  3.86it/s]
 16%|█▌        | 58698/371472 [4:40:28<22:56:53,  3.79it/s]
 16%|█▌        | 58699/371472 [4:40:28<26:45:18,  3.25it/s]
 16%|█▌        | 58700/371472 [4:40:29<28:18:19,  3.07it/s]
                                                           
{'loss': 4.1657, 'learning_rate': 8.581902217242345e-07, 'epoch': 2.53}

 16%|█▌        | 58700/371472 [4:40:29<28:18:19,  3.07it/s]
 16%|█▌        | 58701/371472 [4:40:29<27:40:58,  3.14it/s]
 16%|█▌        | 58702/371472 [4:40:29<26:54:51,  3.23it/s]
 16%|█▌        | 58703/371472 [4:40:30<25:25:52,  3.42it/s]
 16%|█▌        | 58704/371472 [4:40:30<23:48:52,  3.65it/s]
 16%|█▌        | 58705/371472 [4:40:30<24:31:09,  3.54it/s]
 16%|█▌        | 58706/371472 [4:40:30<24:41:10,  3.52it/s]
 16%|█▌        | 58707/371472 [4:40:31<24:13:29,  3.59it/s]
 16%|█▌        | 58708/371472 [4:40:31<24:18:50,  3.57it/s]
 16%|█▌        | 58709/371472 [4:40:31<23:50:56,  3.64it/s]
 16%|█▌        | 58710/371472 [4:40:31<23:10:06,  3.75it/s]
 16%|█▌        | 58711/371472 [4:40:32<23:13:08,  3.74it/s]
 16%|█▌        | 58712/371472 [4:40:32<23:49:13,  3.65it/s]
 16%|█▌        | 58713/371472 [4:40:32<23:42:25,  3.66it/s]
 16%|█▌        | 58714/371472 [4:40:33<24:39:25,  3.52it/s]
 16%|█▌        | 58715/371472 [4:40:33<25:14:22,  3.44it/s]
 16%|█▌        | 58716/371472 [4:40:33<23:54:58,  3.63it/s]
 16%|█▌        | 58717/371472 [4:40:33<24:15:48,  3.58it/s]
 16%|█▌        | 58718/371472 [4:40:34<25:22:28,  3.42it/s]
 16%|█▌        | 58719/371472 [4:40:34<24:46:06,  3.51it/s]
 16%|█▌        | 58720/371472 [4:40:34<26:16:33,  3.31it/s]
                                                           
{'loss': 4.0269, 'learning_rate': 8.581417397487556e-07, 'epoch': 2.53}

 16%|█▌        | 58720/371472 [4:40:34<26:16:33,  3.31it/s]
 16%|█▌        | 58721/371472 [4:40:35<25:54:35,  3.35it/s]
 16%|█▌        | 58722/371472 [4:40:35<24:41:14,  3.52it/s]
 16%|█▌        | 58723/371472 [4:40:35<24:14:40,  3.58it/s]
 16%|█▌        | 58724/371472 [4:40:35<23:29:50,  3.70it/s]
 16%|█▌        | 58725/371472 [4:40:36<23:38:45,  3.67it/s]
 16%|█▌        | 58726/371472 [4:40:36<23:59:44,  3.62it/s]
 16%|█▌        | 58727/371472 [4:40:36<23:17:31,  3.73it/s]
 16%|█▌        | 58728/371472 [4:40:36<23:25:37,  3.71it/s]
 16%|█▌        | 58729/371472 [4:40:37<23:18:17,  3.73it/s]
 16%|█▌        | 58730/371472 [4:40:37<22:55:12,  3.79it/s]
 16%|█▌        | 58731/371472 [4:40:37<23:18:52,  3.73it/s]
 16%|█▌        | 58732/371472 [4:40:38<23:06:19,  3.76it/s]
 16%|█▌        | 58733/371472 [4:40:38<23:50:55,  3.64it/s]
 16%|█▌        | 58734/371472 [4:40:38<25:26:24,  3.41it/s]
 16%|█▌        | 58735/371472 [4:40:38<24:51:37,  3.49it/s]
 16%|█▌        | 58736/371472 [4:40:39<24:00:46,  3.62it/s]
 16%|█▌        | 58737/371472 [4:40:39<23:03:23,  3.77it/s]
 16%|█▌        | 58738/371472 [4:40:39<23:06:03,  3.76it/s]
 16%|█▌        | 58739/371472 [4:40:39<22:56:34,  3.79it/s]
 16%|█▌        | 58740/371472 [4:40:40<24:38:00,  3.53it/s]
                                                           
{'loss': 4.2034, 'learning_rate': 8.580932577732767e-07, 'epoch': 2.53}

 16%|█▌        | 58740/371472 [4:40:40<24:38:00,  3.53it/s]
 16%|█▌        | 58741/371472 [4:40:40<24:02:49,  3.61it/s]
 16%|█▌        | 58742/371472 [4:40:40<25:56:47,  3.35it/s]
 16%|█▌        | 58743/371472 [4:40:41<26:34:47,  3.27it/s]
 16%|█▌        | 58744/371472 [4:40:41<25:12:56,  3.45it/s]
 16%|█▌        | 58745/371472 [4:40:41<24:36:53,  3.53it/s]
 16%|█▌        | 58746/371472 [4:40:41<23:41:35,  3.67it/s]
 16%|█▌        | 58747/371472 [4:40:42<23:46:39,  3.65it/s]
 16%|█▌        | 58748/371472 [4:40:42<22:57:27,  3.78it/s]
 16%|█▌        | 58749/371472 [4:40:42<22:27:44,  3.87it/s]
 16%|█▌        | 58750/371472 [4:40:42<22:51:15,  3.80it/s]
 16%|█▌        | 58751/371472 [4:40:43<22:59:51,  3.78it/s]
 16%|█▌        | 58752/371472 [4:40:43<23:18:22,  3.73it/s]
 16%|█▌        | 58753/371472 [4:40:43<22:57:35,  3.78it/s]
 16%|█▌        | 58754/371472 [4:40:44<23:49:27,  3.65it/s]
 16%|█▌        | 58755/371472 [4:40:44<24:01:25,  3.62it/s]
 16%|█▌        | 58756/371472 [4:40:44<23:26:13,  3.71it/s]
 16%|█▌        | 58757/371472 [4:40:45<26:15:38,  3.31it/s]
 16%|█▌        | 58758/371472 [4:40:45<25:36:25,  3.39it/s]
 16%|█▌        | 58759/371472 [4:40:45<25:27:52,  3.41it/s]
 16%|█▌        | 58760/371472 [4:40:45<26:25:14,  3.29it/s]
                                                           
{'loss': 4.26, 'learning_rate': 8.580447757977979e-07, 'epoch': 2.53}

 16%|█▌        | 58760/371472 [4:40:45<26:25:14,  3.29it/s]
 16%|█▌        | 58761/371472 [4:40:46<28:02:58,  3.10it/s]
 16%|█▌        | 58762/371472 [4:40:46<26:02:23,  3.34it/s]
 16%|█▌        | 58763/371472 [4:40:46<25:46:20,  3.37it/s]
 16%|█▌        | 58764/371472 [4:40:47<25:46:36,  3.37it/s]
 16%|█▌        | 58765/371472 [4:40:47<24:36:13,  3.53it/s]
 16%|█▌        | 58766/371472 [4:40:47<24:30:50,  3.54it/s]
 16%|█▌        | 58767/371472 [4:40:47<23:48:37,  3.65it/s]
 16%|█▌        | 58768/371472 [4:40:48<23:22:18,  3.72it/s]
 16%|█▌        | 58769/371472 [4:40:48<22:56:36,  3.79it/s]
 16%|█▌        | 58770/371472 [4:40:48<23:17:25,  3.73it/s]
 16%|█▌        | 58771/371472 [4:40:48<23:09:19,  3.75it/s]
 16%|█▌        | 58772/371472 [4:40:49<23:16:53,  3.73it/s]
 16%|█▌        | 58773/371472 [4:40:49<24:08:23,  3.60it/s]
 16%|█▌        | 58774/371472 [4:40:49<25:04:51,  3.46it/s]
 16%|█▌        | 58775/371472 [4:40:50<25:00:02,  3.47it/s]
 16%|█▌        | 58776/371472 [4:40:50<27:34:07,  3.15it/s]
 16%|█▌        | 58777/371472 [4:40:50<26:38:24,  3.26it/s]
 16%|█▌        | 58778/371472 [4:40:51<27:28:22,  3.16it/s]
 16%|█▌        | 58779/371472 [4:40:51<26:16:02,  3.31it/s]
 16%|█▌        | 58780/371472 [4:40:51<24:39:46,  3.52it/s]
                                                           
{'loss': 4.0627, 'learning_rate': 8.579962938223189e-07, 'epoch': 2.53}

 16%|█▌        | 58780/371472 [4:40:51<24:39:46,  3.52it/s]
 16%|█▌        | 58781/371472 [4:40:51<23:56:42,  3.63it/s]
 16%|█▌        | 58782/371472 [4:40:52<23:48:30,  3.65it/s]
 16%|█▌        | 58783/371472 [4:40:52<24:53:58,  3.49it/s]
 16%|█▌        | 58784/371472 [4:40:52<24:51:23,  3.49it/s]
 16%|█▌        | 58785/371472 [4:40:53<27:36:42,  3.15it/s]
 16%|█▌        | 58786/371472 [4:40:53<25:53:09,  3.36it/s]
 16%|█▌        | 58787/371472 [4:40:53<24:43:16,  3.51it/s]
 16%|█▌        | 58788/371472 [4:40:53<24:09:39,  3.59it/s]
 16%|█▌        | 58789/371472 [4:40:54<23:22:42,  3.72it/s]
 16%|█▌        | 58790/371472 [4:40:54<23:11:53,  3.74it/s]
 16%|█▌        | 58791/371472 [4:40:54<23:29:39,  3.70it/s]
 16%|█▌        | 58792/371472 [4:40:55<24:35:08,  3.53it/s]
 16%|█▌        | 58793/371472 [4:40:55<24:46:12,  3.51it/s]
 16%|█▌        | 58794/371472 [4:40:55<23:32:54,  3.69it/s]
 16%|█▌        | 58795/371472 [4:40:55<23:27:05,  3.70it/s]
 16%|█▌        | 58796/371472 [4:40:56<24:33:43,  3.54it/s]
 16%|█▌        | 58797/371472 [4:40:56<24:12:13,  3.59it/s]
 16%|█▌        | 58798/371472 [4:40:56<25:05:45,  3.46it/s]
 16%|█▌        | 58799/371472 [4:40:56<24:47:58,  3.50it/s]
 16%|█▌        | 58800/371472 [4:40:57<24:54:53,  3.49it/s]
                                                           
{'loss': 4.4826, 'learning_rate': 8.579478118468399e-07, 'epoch': 2.53}

 16%|█▌        | 58800/371472 [4:40:57<24:54:53,  3.49it/s]
 16%|█▌        | 58801/371472 [4:40:57<24:52:47,  3.49it/s]
 16%|█▌        | 58802/371472 [4:40:57<24:18:40,  3.57it/s]
 16%|█▌        | 58803/371472 [4:40:58<23:39:01,  3.67it/s]
 16%|█▌        | 58804/371472 [4:40:58<25:26:54,  3.41it/s]
 16%|█▌        | 58805/371472 [4:40:58<25:45:50,  3.37it/s]
 16%|█▌        | 58806/371472 [4:40:59<26:00:39,  3.34it/s]
 16%|█▌        | 58807/371472 [4:40:59<25:57:51,  3.35it/s]
 16%|█▌        | 58808/371472 [4:40:59<25:03:19,  3.47it/s]
 16%|█▌        | 58809/371472 [4:40:59<24:21:13,  3.57it/s]
 16%|█▌        | 58810/371472 [4:41:00<24:47:00,  3.50it/s]
 16%|█▌        | 58811/371472 [4:41:00<26:40:15,  3.26it/s]
 16%|█▌        | 58812/371472 [4:41:00<26:56:06,  3.22it/s]
 16%|█▌        | 58813/371472 [4:41:01<25:19:03,  3.43it/s]
 16%|█▌        | 58814/371472 [4:41:01<24:50:17,  3.50it/s]
 16%|█▌        | 58815/371472 [4:41:01<26:10:39,  3.32it/s]
 16%|█▌        | 58816/371472 [4:41:01<25:54:19,  3.35it/s]
 16%|█▌        | 58817/371472 [4:41:02<25:12:58,  3.44it/s]
 16%|█▌        | 58818/371472 [4:41:02<24:09:20,  3.60it/s]
 16%|█▌        | 58819/371472 [4:41:02<23:00:42,  3.77it/s]
 16%|█▌        | 58820/371472 [4:41:03<23:55:47,  3.63it/s]
                                                           
{'loss': 4.2246, 'learning_rate': 8.578993298713611e-07, 'epoch': 2.53}

 16%|█▌        | 58820/371472 [4:41:03<23:55:47,  3.63it/s]
 16%|█▌        | 58821/371472 [4:41:03<26:13:45,  3.31it/s]
 16%|█▌        | 58822/371472 [4:41:03<24:41:09,  3.52it/s]
 16%|█▌        | 58823/371472 [4:41:03<25:26:03,  3.41it/s]
 16%|█▌        | 58824/371472 [4:41:04<25:28:47,  3.41it/s]
 16%|█▌        | 58825/371472 [4:41:04<24:19:58,  3.57it/s]
 16%|█▌        | 58826/371472 [4:41:04<24:07:14,  3.60it/s]
 16%|█▌        | 58827/371472 [4:41:05<23:58:01,  3.62it/s]
 16%|█▌        | 58828/371472 [4:41:05<24:37:35,  3.53it/s]
 16%|█▌        | 58829/371472 [4:41:05<23:37:04,  3.68it/s]
 16%|█▌        | 58830/371472 [4:41:05<23:30:02,  3.70it/s]
 16%|█▌        | 58831/371472 [4:41:06<25:40:52,  3.38it/s]
 16%|█▌        | 58832/371472 [4:41:06<27:34:08,  3.15it/s]
 16%|█▌        | 58833/371472 [4:41:06<27:36:12,  3.15it/s]
 16%|█▌        | 58834/371472 [4:41:07<27:20:59,  3.18it/s]
 16%|█▌        | 58835/371472 [4:41:07<27:16:31,  3.18it/s]
 16%|█▌        | 58836/371472 [4:41:07<28:16:20,  3.07it/s]
 16%|█▌        | 58837/371472 [4:41:08<28:05:32,  3.09it/s]
 16%|█▌        | 58838/371472 [4:41:08<26:22:06,  3.29it/s]
 16%|█▌        | 58839/371472 [4:41:08<25:17:38,  3.43it/s]
 16%|█▌        | 58840/371472 [4:41:09<26:08:48,  3.32it/s]
                                                           
{'loss': 4.0814, 'learning_rate': 8.578508478958823e-07, 'epoch': 2.53}

 16%|█▌        | 58840/371472 [4:41:09<26:08:48,  3.32it/s]
 16%|█▌        | 58841/371472 [4:41:09<26:18:02,  3.30it/s]
 16%|█▌        | 58842/371472 [4:41:09<26:57:51,  3.22it/s]
 16%|█▌        | 58843/371472 [4:41:09<25:40:56,  3.38it/s]
 16%|█▌        | 58844/371472 [4:41:10<29:16:43,  2.97it/s]
 16%|█▌        | 58845/371472 [4:41:10<26:54:38,  3.23it/s]
 16%|█▌        | 58846/371472 [4:41:10<26:40:57,  3.25it/s]
 16%|█▌        | 58847/371472 [4:41:11<25:25:10,  3.42it/s]
 16%|█▌        | 58848/371472 [4:41:11<24:20:57,  3.57it/s]
 16%|█▌        | 58849/371472 [4:41:11<24:59:52,  3.47it/s]
 16%|█▌        | 58850/371472 [4:41:11<24:08:04,  3.60it/s]
 16%|█▌        | 58851/371472 [4:41:12<23:33:57,  3.68it/s]
 16%|█▌        | 58852/371472 [4:41:12<23:29:39,  3.70it/s]
 16%|█▌        | 58853/371472 [4:41:12<23:30:45,  3.69it/s]
 16%|█▌        | 58854/371472 [4:41:13<23:43:19,  3.66it/s]
 16%|█▌        | 58855/371472 [4:41:13<23:30:13,  3.69it/s]
 16%|█▌        | 58856/371472 [4:41:13<23:27:14,  3.70it/s]
 16%|█▌        | 58857/371472 [4:41:13<23:02:08,  3.77it/s]
 16%|█▌        | 58858/371472 [4:41:14<22:58:08,  3.78it/s]
 16%|█▌        | 58859/371472 [4:41:14<22:34:55,  3.85it/s]
 16%|█▌        | 58860/371472 [4:41:14<22:06:50,  3.93it/s]
                                                           
{'loss': 4.4911, 'learning_rate': 8.578023659204033e-07, 'epoch': 2.54}

 16%|█▌        | 58860/371472 [4:41:14<22:06:50,  3.93it/s]
 16%|█▌        | 58861/371472 [4:41:14<24:26:57,  3.55it/s]
 16%|█▌        | 58862/371472 [4:41:15<23:22:15,  3.72it/s]
 16%|█▌        | 58863/371472 [4:41:15<23:25:54,  3.71it/s]
 16%|█▌        | 58864/371472 [4:41:15<23:27:05,  3.70it/s]
 16%|█▌        | 58865/371472 [4:41:16<24:26:29,  3.55it/s]
 16%|█▌        | 58866/371472 [4:41:16<24:17:46,  3.57it/s]
 16%|█▌        | 58867/371472 [4:41:16<26:47:53,  3.24it/s]
 16%|█▌        | 58868/371472 [4:41:17<27:15:13,  3.19it/s]
 16%|█▌        | 58869/371472 [4:41:17<27:11:49,  3.19it/s]
 16%|█▌        | 58870/371472 [4:41:17<31:01:15,  2.80it/s]
 16%|█▌        | 58871/371472 [4:41:18<29:42:27,  2.92it/s]
 16%|█▌        | 58872/371472 [4:41:18<27:40:40,  3.14it/s]
 16%|█▌        | 58873/371472 [4:41:18<27:38:27,  3.14it/s]
 16%|█▌        | 58874/371472 [4:41:18<25:58:32,  3.34it/s]
 16%|█▌        | 58875/371472 [4:41:19<24:28:07,  3.55it/s]
 16%|█▌        | 58876/371472 [4:41:19<24:10:51,  3.59it/s]
 16%|█▌        | 58877/371472 [4:41:19<24:10:34,  3.59it/s]
 16%|█▌        | 58878/371472 [4:41:19<23:19:26,  3.72it/s]
 16%|█▌        | 58879/371472 [4:41:20<22:37:23,  3.84it/s]
 16%|█▌        | 58880/371472 [4:41:20<22:56:46,  3.78it/s]
                                                           
{'loss': 4.3088, 'learning_rate': 8.577538839449244e-07, 'epoch': 2.54}

 16%|█▌        | 58880/371472 [4:41:20<22:56:46,  3.78it/s]
 16%|█▌        | 58881/371472 [4:41:20<22:42:04,  3.82it/s]
 16%|█▌        | 58882/371472 [4:41:20<22:32:52,  3.85it/s]
 16%|█▌        | 58883/371472 [4:41:21<23:39:46,  3.67it/s]
 16%|█▌        | 58884/371472 [4:41:21<23:51:18,  3.64it/s]
 16%|█▌        | 58885/371472 [4:41:21<25:54:45,  3.35it/s]
 16%|█▌        | 58886/371472 [4:41:22<25:22:23,  3.42it/s]
 16%|█▌        | 58887/371472 [4:41:22<25:14:37,  3.44it/s]
 16%|█▌        | 58888/371472 [4:41:22<24:45:32,  3.51it/s]
 16%|█▌        | 58889/371472 [4:41:23<23:53:22,  3.63it/s]
 16%|█▌        | 58890/371472 [4:41:23<23:28:01,  3.70it/s]
 16%|█▌        | 58891/371472 [4:41:23<24:06:24,  3.60it/s]
 16%|█▌        | 58892/371472 [4:41:23<24:24:44,  3.56it/s]
 16%|█▌        | 58893/371472 [4:41:24<23:26:15,  3.70it/s]
 16%|█▌        | 58894/371472 [4:41:24<23:14:46,  3.74it/s]
 16%|█▌        | 58895/371472 [4:41:24<25:42:45,  3.38it/s]
 16%|█▌        | 58896/371472 [4:41:25<27:26:58,  3.16it/s]
 16%|█▌        | 58897/371472 [4:41:25<26:12:43,  3.31it/s]
 16%|█▌        | 58898/371472 [4:41:25<26:32:36,  3.27it/s]
 16%|█▌        | 58899/371472 [4:41:25<25:15:41,  3.44it/s]
 16%|█▌        | 58900/371472 [4:41:26<24:17:56,  3.57it/s]
                                                           
{'loss': 4.1783, 'learning_rate': 8.577054019694456e-07, 'epoch': 2.54}

 16%|█▌        | 58900/371472 [4:41:26<24:17:56,  3.57it/s]
 16%|█▌        | 58901/371472 [4:41:26<24:19:51,  3.57it/s]
 16%|█▌        | 58902/371472 [4:41:26<24:55:31,  3.48it/s]
 16%|█▌        | 58903/371472 [4:41:27<24:21:42,  3.56it/s]
 16%|█▌        | 58904/371472 [4:41:27<23:54:25,  3.63it/s]
 16%|█▌        | 58905/371472 [4:41:27<23:05:13,  3.76it/s]
 16%|█▌        | 58906/371472 [4:41:27<23:36:08,  3.68it/s]
 16%|█▌        | 58907/371472 [4:41:28<22:32:26,  3.85it/s]
 16%|█▌        | 58908/371472 [4:41:28<24:44:06,  3.51it/s]
 16%|█▌        | 58909/371472 [4:41:28<24:51:14,  3.49it/s]
 16%|█▌        | 58910/371472 [4:41:29<26:40:25,  3.25it/s]
 16%|█▌        | 58911/371472 [4:41:29<25:56:46,  3.35it/s]
 16%|█▌        | 58912/371472 [4:41:29<26:49:07,  3.24it/s]
 16%|█▌        | 58913/371472 [4:41:29<26:37:26,  3.26it/s]
 16%|█▌        | 58914/371472 [4:41:30<26:31:13,  3.27it/s]
 16%|█▌        | 58915/371472 [4:41:30<25:56:02,  3.35it/s]
 16%|█▌        | 58916/371472 [4:41:30<25:21:17,  3.42it/s]
 16%|█▌        | 58917/371472 [4:41:31<30:12:20,  2.87it/s]
 16%|█▌        | 58918/371472 [4:41:31<28:49:06,  3.01it/s]
 16%|█▌        | 58919/371472 [4:41:31<27:13:45,  3.19it/s]
 16%|█▌        | 58920/371472 [4:41:32<25:20:08,  3.43it/s]
                                                           
{'loss': 4.0773, 'learning_rate': 8.576569199939667e-07, 'epoch': 2.54}

 16%|█▌        | 58920/371472 [4:41:32<25:20:08,  3.43it/s]
 16%|█▌        | 58921/371472 [4:41:32<24:47:02,  3.50it/s]
 16%|█▌        | 58922/371472 [4:41:32<23:40:38,  3.67it/s]
 16%|█▌        | 58923/371472 [4:41:32<23:38:08,  3.67it/s]
 16%|█▌        | 58924/371472 [4:41:33<23:20:22,  3.72it/s]
 16%|█▌        | 58925/371472 [4:41:33<24:30:53,  3.54it/s]
 16%|█▌        | 58926/371472 [4:41:33<25:23:16,  3.42it/s]
 16%|█▌        | 58927/371472 [4:41:34<24:58:00,  3.48it/s]
 16%|█▌        | 58928/371472 [4:41:34<24:41:34,  3.52it/s]
 16%|█▌        | 58929/371472 [4:41:34<25:18:50,  3.43it/s]
 16%|█▌        | 58930/371472 [4:41:34<25:01:24,  3.47it/s]
 16%|█▌        | 58931/371472 [4:41:35<24:59:15,  3.47it/s]
 16%|█▌        | 58932/371472 [4:41:35<26:07:57,  3.32it/s]
 16%|█▌        | 58933/371472 [4:41:35<25:00:41,  3.47it/s]
 16%|█▌        | 58934/371472 [4:41:36<24:54:38,  3.49it/s]
 16%|█▌        | 58935/371472 [4:41:36<24:51:22,  3.49it/s]
 16%|█▌        | 58936/371472 [4:41:36<26:43:03,  3.25it/s]
 16%|█▌        | 58937/371472 [4:41:36<25:03:51,  3.46it/s]
 16%|█▌        | 58938/371472 [4:41:37<24:32:25,  3.54it/s]
 16%|█▌        | 58939/371472 [4:41:37<24:56:56,  3.48it/s]
 16%|█▌        | 58940/371472 [4:41:37<24:01:17,  3.61it/s]
                                                           
{'loss': 4.2445, 'learning_rate': 8.576084380184877e-07, 'epoch': 2.54}

 16%|█▌        | 58940/371472 [4:41:37<24:01:17,  3.61it/s]
 16%|█▌        | 58941/371472 [4:41:38<23:08:37,  3.75it/s]
 16%|█▌        | 58942/371472 [4:41:38<24:47:35,  3.50it/s]
 16%|█▌        | 58943/371472 [4:41:38<24:49:05,  3.50it/s]
 16%|█▌        | 58944/371472 [4:41:38<24:22:04,  3.56it/s]
 16%|█▌        | 58945/371472 [4:41:39<24:00:07,  3.62it/s]
 16%|█▌        | 58946/371472 [4:41:39<23:01:39,  3.77it/s]
 16%|█▌        | 58947/371472 [4:41:39<22:52:03,  3.80it/s]
 16%|█▌        | 58948/371472 [4:41:39<24:29:28,  3.54it/s]
 16%|█▌        | 58949/371472 [4:41:40<26:17:33,  3.30it/s]
 16%|█▌        | 58950/371472 [4:41:40<24:35:56,  3.53it/s]
 16%|█▌        | 58951/371472 [4:41:40<24:39:05,  3.52it/s]
 16%|█▌        | 58952/371472 [4:41:41<23:59:17,  3.62it/s]
 16%|█▌        | 58953/371472 [4:41:41<24:00:12,  3.62it/s]
 16%|█▌        | 58954/371472 [4:41:41<23:21:05,  3.72it/s]
 16%|█▌        | 58955/371472 [4:41:41<24:14:41,  3.58it/s]
 16%|█▌        | 58956/371472 [4:41:42<24:03:31,  3.61it/s]
 16%|█▌        | 58957/371472 [4:41:42<25:14:38,  3.44it/s]
 16%|█▌        | 58958/371472 [4:41:42<25:25:26,  3.41it/s]
 16%|█▌        | 58959/371472 [4:41:43<24:18:24,  3.57it/s]
 16%|█▌        | 58960/371472 [4:41:43<23:12:26,  3.74it/s]
                                                           
{'loss': 4.4122, 'learning_rate': 8.575599560430088e-07, 'epoch': 2.54}

 16%|█▌        | 58960/371472 [4:41:43<23:12:26,  3.74it/s]
 16%|█▌        | 58961/371472 [4:41:43<22:31:07,  3.85it/s]
 16%|█▌        | 58962/371472 [4:41:43<23:33:58,  3.68it/s]
 16%|█▌        | 58963/371472 [4:41:44<23:35:21,  3.68it/s]
 16%|█▌        | 58964/371472 [4:41:44<23:50:19,  3.64it/s]
 16%|█▌        | 58965/371472 [4:41:44<25:07:15,  3.46it/s]
 16%|█▌        | 58966/371472 [4:41:45<26:40:42,  3.25it/s]
 16%|█▌        | 58967/371472 [4:41:45<25:40:36,  3.38it/s]
 16%|█▌        | 58968/371472 [4:41:45<24:27:54,  3.55it/s]
 16%|█▌        | 58969/371472 [4:41:45<23:50:20,  3.64it/s]
 16%|█▌        | 58970/371472 [4:41:46<23:07:31,  3.75it/s]
 16%|█▌        | 58971/371472 [4:41:46<23:23:54,  3.71it/s]
 16%|█▌        | 58972/371472 [4:41:46<23:19:12,  3.72it/s]
 16%|█▌        | 58973/371472 [4:41:47<24:50:26,  3.49it/s]
 16%|█▌        | 58974/371472 [4:41:47<24:00:23,  3.62it/s]
 16%|█▌        | 58975/371472 [4:41:47<24:19:21,  3.57it/s]
 16%|█▌        | 58976/371472 [4:41:47<23:48:36,  3.65it/s]
 16%|█▌        | 58977/371472 [4:41:48<23:45:24,  3.65it/s]
 16%|█▌        | 58978/371472 [4:41:48<26:02:26,  3.33it/s]
 16%|█▌        | 58979/371472 [4:41:48<24:35:17,  3.53it/s]
 16%|█▌        | 58980/371472 [4:41:48<24:43:17,  3.51it/s]
                                                           
{'loss': 4.0924, 'learning_rate': 8.5751147406753e-07, 'epoch': 2.54}

 16%|█▌        | 58980/371472 [4:41:48<24:43:17,  3.51it/s]
 16%|█▌        | 58981/371472 [4:41:49<24:57:05,  3.48it/s]
 16%|█▌        | 58982/371472 [4:41:49<24:51:56,  3.49it/s]
 16%|█▌        | 58983/371472 [4:41:49<23:35:57,  3.68it/s]
 16%|█▌        | 58984/371472 [4:41:50<25:47:01,  3.37it/s]
 16%|█▌        | 58985/371472 [4:41:50<24:27:34,  3.55it/s]
 16%|█▌        | 58986/371472 [4:41:50<23:47:53,  3.65it/s]
 16%|█▌        | 58987/371472 [4:41:51<25:57:55,  3.34it/s]
 16%|█▌        | 58988/371472 [4:41:51<25:44:54,  3.37it/s]
 16%|█▌        | 58989/371472 [4:41:51<27:14:43,  3.19it/s]
 16%|█▌        | 58990/371472 [4:41:51<25:21:13,  3.42it/s]
 16%|█▌        | 58991/371472 [4:41:52<24:05:50,  3.60it/s]
 16%|█▌        | 58992/371472 [4:41:52<23:26:40,  3.70it/s]
 16%|█▌        | 58993/371472 [4:41:52<26:06:31,  3.32it/s]
 16%|█▌        | 58994/371472 [4:41:53<25:08:03,  3.45it/s]
 16%|█▌        | 58995/371472 [4:41:53<24:42:22,  3.51it/s]
 16%|█▌        | 58996/371472 [4:41:53<24:23:01,  3.56it/s]
 16%|█▌        | 58997/371472 [4:41:53<27:12:25,  3.19it/s]
 16%|█▌        | 58998/371472 [4:41:54<28:11:07,  3.08it/s]
 16%|█▌        | 58999/371472 [4:41:54<26:20:59,  3.29it/s]
 16%|█▌        | 59000/371472 [4:41:54<24:30:00,  3.54it/s]
                                                           
{'loss': 4.169, 'learning_rate': 8.574629920920512e-07, 'epoch': 2.54}

 16%|█▌        | 59000/371472 [4:41:54<24:30:00,  3.54it/s]
 16%|█▌        | 59001/371472 [4:41:55<25:03:32,  3.46it/s]
 16%|█▌        | 59002/371472 [4:41:55<25:00:26,  3.47it/s]
 16%|█▌        | 59003/371472 [4:41:55<23:59:53,  3.62it/s]
 16%|█▌        | 59004/371472 [4:41:55<25:08:17,  3.45it/s]
 16%|█▌        | 59005/371472 [4:41:56<24:35:19,  3.53it/s]
 16%|█▌        | 59006/371472 [4:41:56<24:15:56,  3.58it/s]
 16%|█▌        | 59007/371472 [4:41:56<24:13:19,  3.58it/s]
 16%|█▌        | 59008/371472 [4:41:57<23:24:28,  3.71it/s]
 16%|█▌        | 59009/371472 [4:41:57<24:43:57,  3.51it/s]
 16%|█▌        | 59010/371472 [4:41:57<23:47:54,  3.65it/s]
 16%|█▌        | 59011/371472 [4:41:57<26:10:26,  3.32it/s]
 16%|█▌        | 59012/371472 [4:41:58<24:46:04,  3.50it/s]
 16%|█▌        | 59013/371472 [4:41:58<24:56:10,  3.48it/s]
 16%|█▌        | 59014/371472 [4:41:58<25:48:40,  3.36it/s]
 16%|█▌        | 59015/371472 [4:41:59<28:59:48,  2.99it/s]
 16%|█▌        | 59016/371472 [4:41:59<27:11:18,  3.19it/s]
 16%|█▌        | 59017/371472 [4:41:59<25:46:38,  3.37it/s]
 16%|█▌        | 59018/371472 [4:42:00<24:46:49,  3.50it/s]
 16%|█▌        | 59019/371472 [4:42:00<23:47:09,  3.65it/s]
 16%|█▌        | 59020/371472 [4:42:00<22:55:17,  3.79it/s]
                                                           
{'loss': 4.268, 'learning_rate': 8.574145101165722e-07, 'epoch': 2.54}

 16%|█▌        | 59020/371472 [4:42:00<22:55:17,  3.79it/s]
 16%|█▌        | 59021/371472 [4:42:00<23:54:43,  3.63it/s]
 16%|█▌        | 59022/371472 [4:42:01<23:23:33,  3.71it/s]
 16%|█▌        | 59023/371472 [4:42:01<27:10:18,  3.19it/s]
 16%|█▌        | 59024/371472 [4:42:01<26:34:31,  3.27it/s]
 16%|█▌        | 59025/371472 [4:42:02<25:43:42,  3.37it/s]
 16%|█▌        | 59026/371472 [4:42:02<24:49:33,  3.50it/s]
 16%|█▌        | 59027/371472 [4:42:02<24:22:47,  3.56it/s]
 16%|█▌        | 59028/371472 [4:42:02<24:06:56,  3.60it/s]
 16%|█▌        | 59029/371472 [4:42:03<24:17:32,  3.57it/s]
 16%|█▌        | 59030/371472 [4:42:03<23:52:00,  3.64it/s]
 16%|█▌        | 59031/371472 [4:42:03<23:30:44,  3.69it/s]
 16%|█▌        | 59032/371472 [4:42:03<25:11:47,  3.44it/s]
 16%|█▌        | 59033/371472 [4:42:04<25:51:13,  3.36it/s]
 16%|█▌        | 59034/371472 [4:42:04<25:17:28,  3.43it/s]
 16%|█▌        | 59035/371472 [4:42:04<24:00:28,  3.61it/s]
 16%|█▌        | 59036/371472 [4:42:05<23:17:51,  3.73it/s]
 16%|█▌        | 59037/371472 [4:42:05<23:56:06,  3.63it/s]
 16%|█▌        | 59038/371472 [4:42:05<23:50:03,  3.64it/s]
 16%|█▌        | 59039/371472 [4:42:05<23:26:02,  3.70it/s]
 16%|█▌        | 59040/371472 [4:42:06<23:11:41,  3.74it/s]
                                                           
{'loss': 4.3032, 'learning_rate': 8.573660281410933e-07, 'epoch': 2.54}

 16%|█▌        | 59040/371472 [4:42:06<23:11:41,  3.74it/s]
 16%|█▌        | 59041/371472 [4:42:06<23:02:11,  3.77it/s]
 16%|█▌        | 59042/371472 [4:42:06<23:35:46,  3.68it/s]
 16%|█▌        | 59043/371472 [4:42:06<22:51:31,  3.80it/s]
 16%|█▌        | 59044/371472 [4:42:07<22:22:07,  3.88it/s]
 16%|█▌        | 59045/371472 [4:42:07<22:16:28,  3.90it/s]
 16%|█▌        | 59046/371472 [4:42:07<22:10:11,  3.91it/s]
 16%|█▌        | 59047/371472 [4:42:08<24:31:19,  3.54it/s]
 16%|█▌        | 59048/371472 [4:42:08<24:33:09,  3.53it/s]
 16%|█▌        | 59049/371472 [4:42:08<24:33:03,  3.53it/s]
 16%|█▌        | 59050/371472 [4:42:08<24:20:34,  3.57it/s]
 16%|█▌        | 59051/371472 [4:42:09<23:28:34,  3.70it/s]
 16%|█▌        | 59052/371472 [4:42:09<22:54:26,  3.79it/s]
 16%|█▌        | 59053/371472 [4:42:09<22:16:50,  3.89it/s]
 16%|█▌        | 59054/371472 [4:42:09<22:55:40,  3.79it/s]
 16%|█▌        | 59055/371472 [4:42:10<24:19:59,  3.57it/s]
 16%|█▌        | 59056/371472 [4:42:10<23:44:50,  3.65it/s]
 16%|█▌        | 59057/371472 [4:42:10<24:12:06,  3.59it/s]
 16%|█▌        | 59058/371472 [4:42:11<24:39:59,  3.52it/s]
 16%|█▌        | 59059/371472 [4:42:11<24:19:50,  3.57it/s]
 16%|█▌        | 59060/371472 [4:42:11<24:47:10,  3.50it/s]
                                                           
{'loss': 4.2648, 'learning_rate': 8.573175461656144e-07, 'epoch': 2.54}

 16%|█▌        | 59060/371472 [4:42:11<24:47:10,  3.50it/s]
 16%|█▌        | 59061/371472 [4:42:11<23:23:34,  3.71it/s]
 16%|█▌        | 59062/371472 [4:42:12<22:55:22,  3.79it/s]
 16%|█▌        | 59063/371472 [4:42:12<22:28:05,  3.86it/s]
 16%|█▌        | 59064/371472 [4:42:12<23:20:40,  3.72it/s]
 16%|█▌        | 59065/371472 [4:42:12<23:57:52,  3.62it/s]
 16%|█▌        | 59066/371472 [4:42:13<26:11:57,  3.31it/s]
 16%|█▌        | 59067/371472 [4:42:13<25:03:18,  3.46it/s]
 16%|█▌        | 59068/371472 [4:42:13<27:20:32,  3.17it/s]
 16%|█▌        | 59069/371472 [4:42:14<27:15:39,  3.18it/s]
 16%|█▌        | 59070/371472 [4:42:14<30:59:12,  2.80it/s]
 16%|█▌        | 59071/371472 [4:42:14<28:17:57,  3.07it/s]
 16%|█▌        | 59072/371472 [4:42:15<26:33:52,  3.27it/s]
 16%|█▌        | 59073/371472 [4:42:15<25:17:08,  3.43it/s]
 16%|█▌        | 59074/371472 [4:42:15<25:10:18,  3.45it/s]
 16%|█▌        | 59075/371472 [4:42:16<25:04:36,  3.46it/s]
 16%|█▌        | 59076/371472 [4:42:16<24:37:22,  3.52it/s]
 16%|█▌        | 59077/371472 [4:42:16<24:09:21,  3.59it/s]
 16%|█▌        | 59078/371472 [4:42:16<25:15:29,  3.44it/s]
 16%|█▌        | 59079/371472 [4:42:17<24:39:33,  3.52it/s]
 16%|█▌        | 59080/371472 [4:42:17<23:36:50,  3.67it/s]
                                                           
{'loss': 4.4249, 'learning_rate': 8.572690641901354e-07, 'epoch': 2.54}

 16%|█▌        | 59080/371472 [4:42:17<23:36:50,  3.67it/s]
 16%|█▌        | 59081/371472 [4:42:17<23:09:35,  3.75it/s]
 16%|█▌        | 59082/371472 [4:42:17<22:52:55,  3.79it/s]
 16%|█▌        | 59083/371472 [4:42:18<22:34:49,  3.84it/s]
 16%|█▌        | 59084/371472 [4:42:18<22:43:46,  3.82it/s]
 16%|█▌        | 59085/371472 [4:42:18<25:30:28,  3.40it/s]
 16%|█▌        | 59086/371472 [4:42:19<25:46:10,  3.37it/s]
 16%|█▌        | 59087/371472 [4:42:19<25:19:22,  3.43it/s]
 16%|█▌        | 59088/371472 [4:42:19<25:11:12,  3.45it/s]
 16%|█▌        | 59089/371472 [4:42:19<24:01:06,  3.61it/s]
 16%|█▌        | 59090/371472 [4:42:20<22:57:12,  3.78it/s]
 16%|█▌        | 59091/371472 [4:42:20<24:08:41,  3.59it/s]
 16%|█▌        | 59092/371472 [4:42:20<23:17:32,  3.73it/s]
 16%|█▌        | 59093/371472 [4:42:21<24:11:40,  3.59it/s]
 16%|█▌        | 59094/371472 [4:42:21<24:49:56,  3.49it/s]
 16%|█▌        | 59095/371472 [4:42:21<24:16:31,  3.57it/s]
 16%|█▌        | 59096/371472 [4:42:21<23:55:59,  3.63it/s]
 16%|█▌        | 59097/371472 [4:42:22<25:23:38,  3.42it/s]
 16%|█▌        | 59098/371472 [4:42:22<24:45:18,  3.51it/s]
 16%|█▌        | 59099/371472 [4:42:22<24:18:54,  3.57it/s]
 16%|█▌        | 59100/371472 [4:42:23<24:30:15,  3.54it/s]
                                                           
{'loss': 4.3171, 'learning_rate': 8.572205822146566e-07, 'epoch': 2.55}

 16%|█▌        | 59100/371472 [4:42:23<24:30:15,  3.54it/s]
 16%|█▌        | 59101/371472 [4:42:23<25:06:47,  3.46it/s]
 16%|█▌        | 59102/371472 [4:42:23<24:39:48,  3.52it/s]
 16%|█▌        | 59103/371472 [4:42:23<24:08:10,  3.59it/s]
 16%|█▌        | 59104/371472 [4:42:24<25:32:08,  3.40it/s]
 16%|█▌        | 59105/371472 [4:42:24<24:10:46,  3.59it/s]
 16%|█▌        | 59106/371472 [4:42:24<24:36:21,  3.53it/s]
 16%|█▌        | 59107/371472 [4:42:25<25:15:58,  3.43it/s]
 16%|█▌        | 59108/371472 [4:42:25<24:11:32,  3.59it/s]
 16%|█▌        | 59109/371472 [4:42:25<23:22:50,  3.71it/s]
 16%|█▌        | 59110/371472 [4:42:25<23:10:15,  3.74it/s]
 16%|█▌        | 59111/371472 [4:42:26<23:54:33,  3.63it/s]
 16%|█▌        | 59112/371472 [4:42:26<23:56:03,  3.63it/s]
 16%|█▌        | 59113/371472 [4:42:26<23:51:46,  3.64it/s]
 16%|█▌        | 59114/371472 [4:42:26<24:11:05,  3.59it/s]
 16%|█▌        | 59115/371472 [4:42:27<24:08:39,  3.59it/s]
 16%|█▌        | 59116/371472 [4:42:27<23:45:07,  3.65it/s]
 16%|█▌        | 59117/371472 [4:42:27<23:18:52,  3.72it/s]
 16%|█▌        | 59118/371472 [4:42:28<24:19:18,  3.57it/s]
 16%|█▌        | 59119/371472 [4:42:28<23:43:56,  3.66it/s]
 16%|█▌        | 59120/371472 [4:42:28<25:15:53,  3.43it/s]
                                                           
{'loss': 4.2584, 'learning_rate': 8.571721002391776e-07, 'epoch': 2.55}

 16%|█▌        | 59120/371472 [4:42:28<25:15:53,  3.43it/s]
 16%|█▌        | 59121/371472 [4:42:28<24:43:22,  3.51it/s]
 16%|█▌        | 59122/371472 [4:42:29<24:16:43,  3.57it/s]
 16%|█▌        | 59123/371472 [4:42:29<24:00:18,  3.61it/s]
 16%|█▌        | 59124/371472 [4:42:29<24:19:01,  3.57it/s]
 16%|█▌        | 59125/371472 [4:42:30<24:15:31,  3.58it/s]
 16%|█▌        | 59126/371472 [4:42:30<23:33:06,  3.68it/s]
 16%|█▌        | 59127/371472 [4:42:30<23:32:28,  3.69it/s]
 16%|█▌        | 59128/371472 [4:42:30<23:38:12,  3.67it/s]
 16%|█▌        | 59129/371472 [4:42:31<23:27:21,  3.70it/s]
 16%|█▌        | 59130/371472 [4:42:31<22:52:34,  3.79it/s]
 16%|█▌        | 59131/371472 [4:42:31<23:39:16,  3.67it/s]
 16%|█▌        | 59132/371472 [4:42:31<23:55:35,  3.63it/s]
 16%|█▌        | 59133/371472 [4:42:32<23:26:51,  3.70it/s]
 16%|█▌        | 59134/371472 [4:42:32<23:25:08,  3.70it/s]
 16%|█▌        | 59135/371472 [4:42:32<23:05:38,  3.76it/s]
 16%|█▌        | 59136/371472 [4:42:32<23:24:44,  3.71it/s]
 16%|█▌        | 59137/371472 [4:42:33<23:48:48,  3.64it/s]
 16%|█▌        | 59138/371472 [4:42:33<23:44:49,  3.65it/s]
 16%|█▌        | 59139/371472 [4:42:33<24:20:53,  3.56it/s]
 16%|█▌        | 59140/371472 [4:42:34<24:47:52,  3.50it/s]
                                                           
{'loss': 4.3728, 'learning_rate': 8.571236182636989e-07, 'epoch': 2.55}

 16%|█▌        | 59140/371472 [4:42:34<24:47:52,  3.50it/s]
 16%|█▌        | 59141/371472 [4:42:34<25:39:51,  3.38it/s]
 16%|█▌        | 59142/371472 [4:42:34<24:37:04,  3.52it/s]
 16%|█▌        | 59143/371472 [4:42:34<23:36:15,  3.68it/s]
 16%|█▌        | 59144/371472 [4:42:35<23:20:58,  3.72it/s]
 16%|█▌        | 59145/371472 [4:42:35<23:05:25,  3.76it/s]
 16%|█▌        | 59146/371472 [4:42:35<24:06:20,  3.60it/s]
 16%|█▌        | 59147/371472 [4:42:36<24:33:32,  3.53it/s]
 16%|█▌        | 59148/371472 [4:42:36<23:49:07,  3.64it/s]
 16%|█▌        | 59149/371472 [4:42:36<25:05:07,  3.46it/s]
 16%|█▌        | 59150/371472 [4:42:36<24:35:04,  3.53it/s]
 16%|█▌        | 59151/371472 [4:42:37<24:38:44,  3.52it/s]
 16%|█▌        | 59152/371472 [4:42:37<25:28:54,  3.40it/s]
 16%|█▌        | 59153/371472 [4:42:37<25:17:02,  3.43it/s]
 16%|█▌        | 59154/371472 [4:42:38<25:22:21,  3.42it/s]
 16%|█▌        | 59155/371472 [4:42:38<25:13:14,  3.44it/s]
 16%|█▌        | 59156/371472 [4:42:38<24:11:50,  3.59it/s]
 16%|█▌        | 59157/371472 [4:42:38<24:26:41,  3.55it/s]
 16%|█▌        | 59158/371472 [4:42:39<24:16:49,  3.57it/s]
 16%|█▌        | 59159/371472 [4:42:39<23:57:36,  3.62it/s]
 16%|█▌        | 59160/371472 [4:42:39<24:16:02,  3.57it/s]
                                                           
{'loss': 4.3094, 'learning_rate': 8.570751362882199e-07, 'epoch': 2.55}

 16%|█▌        | 59160/371472 [4:42:39<24:16:02,  3.57it/s]
 16%|█▌        | 59161/371472 [4:42:39<23:13:35,  3.74it/s]
 16%|█▌        | 59162/371472 [4:42:40<23:27:48,  3.70it/s]
 16%|█▌        | 59163/371472 [4:42:40<23:21:01,  3.72it/s]
 16%|█▌        | 59164/371472 [4:42:40<22:36:39,  3.84it/s]
 16%|█▌        | 59165/371472 [4:42:41<23:40:54,  3.66it/s]
 16%|█▌        | 59166/371472 [4:42:41<24:49:50,  3.49it/s]
 16%|█▌        | 59167/371472 [4:42:41<23:28:09,  3.70it/s]
 16%|█▌        | 59168/371472 [4:42:41<24:17:59,  3.57it/s]
 16%|█▌        | 59169/371472 [4:42:42<22:57:01,  3.78it/s]
 16%|█▌        | 59170/371472 [4:42:42<23:32:10,  3.69it/s]
 16%|█▌        | 59171/371472 [4:42:42<23:19:04,  3.72it/s]
 16%|█▌        | 59172/371472 [4:42:42<23:00:30,  3.77it/s]
 16%|█▌        | 59173/371472 [4:42:43<23:50:47,  3.64it/s]
 16%|█▌        | 59174/371472 [4:42:43<23:08:21,  3.75it/s]
 16%|█▌        | 59175/371472 [4:42:43<22:45:18,  3.81it/s]
 16%|█▌        | 59176/371472 [4:42:44<22:21:34,  3.88it/s]
 16%|█▌        | 59177/371472 [4:42:44<22:09:50,  3.91it/s]
 16%|█▌        | 59178/371472 [4:42:44<22:15:07,  3.90it/s]
 16%|█▌        | 59179/371472 [4:42:44<22:26:10,  3.87it/s]
 16%|█▌        | 59180/371472 [4:42:45<21:54:24,  3.96it/s]
                                                           
{'loss': 3.9504, 'learning_rate': 8.57026654312741e-07, 'epoch': 2.55}

 16%|█▌        | 59180/371472 [4:42:45<21:54:24,  3.96it/s]
 16%|█▌        | 59181/371472 [4:42:45<24:28:52,  3.54it/s]
 16%|█▌        | 59182/371472 [4:42:45<25:32:53,  3.40it/s]
 16%|█▌        | 59183/371472 [4:42:45<24:41:05,  3.51it/s]
 16%|█▌        | 59184/371472 [4:42:46<24:31:04,  3.54it/s]
 16%|█▌        | 59185/371472 [4:42:46<23:37:19,  3.67it/s]
 16%|█▌        | 59186/371472 [4:42:46<26:38:19,  3.26it/s]
 16%|█▌        | 59187/371472 [4:42:47<26:58:18,  3.22it/s]
 16%|█▌        | 59188/371472 [4:42:47<25:31:00,  3.40it/s]
 16%|█▌        | 59189/371472 [4:42:47<24:27:05,  3.55it/s]
 16%|█▌        | 59190/371472 [4:42:47<24:04:46,  3.60it/s]
 16%|█▌        | 59191/371472 [4:42:48<23:12:32,  3.74it/s]
 16%|█▌        | 59192/371472 [4:42:48<22:49:38,  3.80it/s]
 16%|█▌        | 59193/371472 [4:42:48<22:24:14,  3.87it/s]
 16%|█▌        | 59194/371472 [4:42:48<21:52:27,  3.97it/s]
 16%|█▌        | 59195/371472 [4:42:49<21:42:52,  3.99it/s]
 16%|█▌        | 59196/371472 [4:42:49<22:13:59,  3.90it/s]
 16%|█▌        | 59197/371472 [4:42:49<22:35:50,  3.84it/s]
 16%|█▌        | 59198/371472 [4:42:49<22:10:18,  3.91it/s]
 16%|█▌        | 59199/371472 [4:42:50<23:40:08,  3.66it/s]
 16%|█▌        | 59200/371472 [4:42:50<23:12:14,  3.74it/s]
                                                           
{'loss': 4.1956, 'learning_rate': 8.569781723372621e-07, 'epoch': 2.55}

 16%|█▌        | 59200/371472 [4:42:50<23:12:14,  3.74it/s]
 16%|█▌        | 59201/371472 [4:42:50<25:01:20,  3.47it/s]
 16%|█▌        | 59202/371472 [4:42:51<27:51:38,  3.11it/s]
 16%|█▌        | 59203/371472 [4:42:51<25:55:59,  3.34it/s]
 16%|█▌        | 59204/371472 [4:42:51<24:33:16,  3.53it/s]
 16%|█▌        | 59205/371472 [4:42:52<27:33:52,  3.15it/s]
 16%|█▌        | 59206/371472 [4:42:52<26:20:42,  3.29it/s]
 16%|█▌        | 59207/371472 [4:42:52<26:10:32,  3.31it/s]
 16%|█▌        | 59208/371472 [4:42:53<25:23:16,  3.42it/s]
 16%|█▌        | 59209/371472 [4:42:53<24:41:33,  3.51it/s]
 16%|█▌        | 59210/371472 [4:42:53<27:44:38,  3.13it/s]
 16%|█▌        | 59211/371472 [4:42:53<25:41:57,  3.38it/s]
 16%|█▌        | 59212/371472 [4:42:54<24:20:59,  3.56it/s]
 16%|█▌        | 59213/371472 [4:42:54<24:23:45,  3.56it/s]
 16%|█▌        | 59214/371472 [4:42:54<24:01:16,  3.61it/s]
 16%|█▌        | 59215/371472 [4:42:54<23:22:03,  3.71it/s]
 16%|█▌        | 59216/371472 [4:42:55<27:48:33,  3.12it/s]
 16%|█▌        | 59217/371472 [4:42:55<26:02:31,  3.33it/s]
 16%|█▌        | 59218/371472 [4:42:55<25:28:46,  3.40it/s]
 16%|█▌        | 59219/371472 [4:42:56<25:42:57,  3.37it/s]
 16%|█▌        | 59220/371472 [4:42:56<26:23:50,  3.29it/s]
                                                           
{'loss': 4.2037, 'learning_rate': 8.569296903617834e-07, 'epoch': 2.55}

 16%|█▌        | 59220/371472 [4:42:56<26:23:50,  3.29it/s]
 16%|█▌        | 59221/371472 [4:42:56<25:50:39,  3.36it/s]
 16%|█▌        | 59222/371472 [4:42:57<25:36:01,  3.39it/s]
 16%|█▌        | 59223/371472 [4:42:57<24:33:37,  3.53it/s]
 16%|█▌        | 59224/371472 [4:42:57<23:42:05,  3.66it/s]
 16%|█▌        | 59225/371472 [4:42:57<22:44:36,  3.81it/s]
 16%|█▌        | 59226/371472 [4:42:58<24:22:27,  3.56it/s]
 16%|█▌        | 59227/371472 [4:42:58<23:32:48,  3.68it/s]
 16%|█▌        | 59228/371472 [4:42:58<24:00:04,  3.61it/s]
 16%|█▌        | 59229/371472 [4:42:58<23:34:36,  3.68it/s]
 16%|█▌        | 59230/371472 [4:42:59<23:10:45,  3.74it/s]
 16%|█▌        | 59231/371472 [4:42:59<23:08:01,  3.75it/s]
 16%|█▌        | 59232/371472 [4:42:59<23:47:25,  3.65it/s]
 16%|█▌        | 59233/371472 [4:43:00<26:23:03,  3.29it/s]
 16%|█▌        | 59234/371472 [4:43:00<25:13:22,  3.44it/s]
 16%|█▌        | 59235/371472 [4:43:00<24:58:04,  3.47it/s]
 16%|█▌        | 59236/371472 [4:43:01<25:03:35,  3.46it/s]
 16%|█▌        | 59237/371472 [4:43:01<25:39:22,  3.38it/s]
 16%|█▌        | 59238/371472 [4:43:01<26:31:40,  3.27it/s]
 16%|█▌        | 59239/371472 [4:43:01<26:46:32,  3.24it/s]
 16%|█▌        | 59240/371472 [4:43:02<26:02:35,  3.33it/s]
                                                           
{'loss': 4.1132, 'learning_rate': 8.568812083863043e-07, 'epoch': 2.55}

 16%|█▌        | 59240/371472 [4:43:02<26:02:35,  3.33it/s]
 16%|█▌        | 59241/371472 [4:43:02<25:08:58,  3.45it/s]
 16%|█▌        | 59242/371472 [4:43:02<24:17:40,  3.57it/s]
 16%|█▌        | 59243/371472 [4:43:03<25:11:10,  3.44it/s]
 16%|█▌        | 59244/371472 [4:43:03<24:08:31,  3.59it/s]
 16%|█▌        | 59245/371472 [4:43:03<23:39:32,  3.67it/s]
 16%|█▌        | 59246/371472 [4:43:03<22:40:03,  3.83it/s]
 16%|█▌        | 59247/371472 [4:43:04<22:41:06,  3.82it/s]
 16%|█▌        | 59248/371472 [4:43:04<24:49:15,  3.49it/s]
 16%|█▌        | 59249/371472 [4:43:04<23:53:33,  3.63it/s]
 16%|█▌        | 59250/371472 [4:43:05<26:08:43,  3.32it/s]
 16%|█▌        | 59251/371472 [4:43:05<25:13:14,  3.44it/s]
 16%|█▌        | 59252/371472 [4:43:05<26:08:43,  3.32it/s]
 16%|█▌        | 59253/371472 [4:43:05<24:43:09,  3.51it/s]
 16%|█▌        | 59254/371472 [4:43:06<24:43:07,  3.51it/s]
 16%|█▌        | 59255/371472 [4:43:06<24:10:10,  3.59it/s]
 16%|█▌        | 59256/371472 [4:43:06<24:20:24,  3.56it/s]
 16%|█▌        | 59257/371472 [4:43:07<25:09:18,  3.45it/s]
 16%|█▌        | 59258/371472 [4:43:07<24:40:06,  3.52it/s]
 16%|█▌        | 59259/371472 [4:43:07<24:54:33,  3.48it/s]
 16%|█▌        | 59260/371472 [4:43:07<24:27:32,  3.55it/s]
                                                           
{'loss': 4.3493, 'learning_rate': 8.568327264108255e-07, 'epoch': 2.55}

 16%|█▌        | 59260/371472 [4:43:07<24:27:32,  3.55it/s]
 16%|█▌        | 59261/371472 [4:43:08<27:26:17,  3.16it/s]
 16%|█▌        | 59262/371472 [4:43:08<25:50:02,  3.36it/s]
 16%|█▌        | 59263/371472 [4:43:08<25:39:27,  3.38it/s]
 16%|█▌        | 59264/371472 [4:43:09<24:41:27,  3.51it/s]
 16%|█▌        | 59265/371472 [4:43:09<25:27:02,  3.41it/s]
 16%|█▌        | 59266/371472 [4:43:09<25:11:22,  3.44it/s]
 16%|█▌        | 59267/371472 [4:43:10<27:07:30,  3.20it/s]
 16%|█▌        | 59268/371472 [4:43:10<26:29:44,  3.27it/s]
 16%|█▌        | 59269/371472 [4:43:10<25:17:34,  3.43it/s]
 16%|█▌        | 59270/371472 [4:43:10<23:51:34,  3.63it/s]
 16%|█▌        | 59271/371472 [4:43:11<24:02:47,  3.61it/s]
 16%|█▌        | 59272/371472 [4:43:11<23:54:00,  3.63it/s]
 16%|█▌        | 59273/371472 [4:43:11<23:33:24,  3.68it/s]
 16%|█▌        | 59274/371472 [4:43:11<23:04:43,  3.76it/s]
 16%|█▌        | 59275/371472 [4:43:12<22:29:36,  3.86it/s]
 16%|█▌        | 59276/371472 [4:43:12<22:36:54,  3.83it/s]
 16%|█▌        | 59277/371472 [4:43:12<23:24:42,  3.70it/s]
 16%|█▌        | 59278/371472 [4:43:12<24:14:01,  3.58it/s]
 16%|█▌        | 59279/371472 [4:43:13<23:44:57,  3.65it/s]
 16%|█▌        | 59280/371472 [4:43:13<22:44:59,  3.81it/s]
                                                           
{'loss': 4.361, 'learning_rate': 8.567842444353466e-07, 'epoch': 2.55}

 16%|█▌        | 59280/371472 [4:43:13<22:44:59,  3.81it/s]
 16%|█▌        | 59281/371472 [4:43:13<22:51:16,  3.79it/s]
 16%|█▌        | 59282/371472 [4:43:14<23:57:09,  3.62it/s]
 16%|█▌        | 59283/371472 [4:43:14<22:34:26,  3.84it/s]
 16%|█▌        | 59284/371472 [4:43:14<22:59:48,  3.77it/s]
 16%|█▌        | 59285/371472 [4:43:14<23:01:19,  3.77it/s]
 16%|█▌        | 59286/371472 [4:43:15<22:53:13,  3.79it/s]
 16%|█▌        | 59287/371472 [4:43:15<21:57:56,  3.95it/s]
 16%|█▌        | 59288/371472 [4:43:15<23:05:22,  3.76it/s]
 16%|█▌        | 59289/371472 [4:43:15<23:33:48,  3.68it/s]
 16%|█▌        | 59290/371472 [4:43:16<24:04:03,  3.60it/s]
 16%|█▌        | 59291/371472 [4:43:16<23:21:09,  3.71it/s]
 16%|█▌        | 59292/371472 [4:43:16<22:58:45,  3.77it/s]
 16%|█▌        | 59293/371472 [4:43:16<23:18:43,  3.72it/s]
 16%|█▌        | 59294/371472 [4:43:17<24:03:54,  3.60it/s]
 16%|█▌        | 59295/371472 [4:43:17<24:10:28,  3.59it/s]
 16%|█▌        | 59296/371472 [4:43:17<24:35:13,  3.53it/s]
 16%|█▌        | 59297/371472 [4:43:18<23:59:59,  3.61it/s]
 16%|█▌        | 59298/371472 [4:43:18<23:48:48,  3.64it/s]
 16%|█▌        | 59299/371472 [4:43:18<22:52:24,  3.79it/s]
 16%|█▌        | 59300/371472 [4:43:18<23:23:22,  3.71it/s]
                                                           
{'loss': 4.1195, 'learning_rate': 8.567357624598676e-07, 'epoch': 2.55}

 16%|█▌        | 59300/371472 [4:43:18<23:23:22,  3.71it/s]
 16%|█▌        | 59301/371472 [4:43:19<27:39:41,  3.13it/s]
 16%|█▌        | 59302/371472 [4:43:19<26:19:35,  3.29it/s]
 16%|█▌        | 59303/371472 [4:43:19<25:46:57,  3.36it/s]
 16%|█▌        | 59304/371472 [4:43:20<26:15:01,  3.30it/s]
 16%|█▌        | 59305/371472 [4:43:20<26:05:43,  3.32it/s]
 16%|█▌        | 59306/371472 [4:43:20<26:22:36,  3.29it/s]
 16%|█▌        | 59307/371472 [4:43:21<27:12:08,  3.19it/s]
 16%|█▌        | 59308/371472 [4:43:21<25:53:35,  3.35it/s]
 16%|█▌        | 59309/371472 [4:43:21<24:47:16,  3.50it/s]
 16%|█▌        | 59310/371472 [4:43:21<23:52:42,  3.63it/s]
 16%|█▌        | 59311/371472 [4:43:22<23:21:52,  3.71it/s]
 16%|█▌        | 59312/371472 [4:43:22<23:00:57,  3.77it/s]
 16%|█▌        | 59313/371472 [4:43:22<22:26:43,  3.86it/s]
 16%|█▌        | 59314/371472 [4:43:22<22:29:52,  3.85it/s]
 16%|█▌        | 59315/371472 [4:43:23<22:20:35,  3.88it/s]
 16%|█▌        | 59316/371472 [4:43:23<21:59:25,  3.94it/s]
 16%|█▌        | 59317/371472 [4:43:23<23:33:06,  3.68it/s]
 16%|█▌        | 59318/371472 [4:43:24<24:05:39,  3.60it/s]
 16%|█▌        | 59319/371472 [4:43:24<24:55:32,  3.48it/s]
 16%|█▌        | 59320/371472 [4:43:24<23:35:29,  3.68it/s]
                                                           
{'loss': 4.1201, 'learning_rate': 8.566872804843887e-07, 'epoch': 2.56}

 16%|█▌        | 59320/371472 [4:43:24<23:35:29,  3.68it/s]
 16%|█▌        | 59321/371472 [4:43:24<24:53:50,  3.48it/s]
 16%|█▌        | 59322/371472 [4:43:25<24:03:11,  3.60it/s]
 16%|█▌        | 59323/371472 [4:43:25<26:03:12,  3.33it/s]
 16%|█▌        | 59324/371472 [4:43:25<24:38:03,  3.52it/s]
 16%|█▌        | 59325/371472 [4:43:26<23:56:00,  3.62it/s]
 16%|█▌        | 59326/371472 [4:43:26<24:10:24,  3.59it/s]
 16%|█▌        | 59327/371472 [4:43:26<24:48:10,  3.50it/s]
 16%|█▌        | 59328/371472 [4:43:26<25:30:54,  3.40it/s]
 16%|█▌        | 59329/371472 [4:43:27<23:54:40,  3.63it/s]
 16%|█▌        | 59330/371472 [4:43:27<23:06:05,  3.75it/s]
 16%|█▌        | 59331/371472 [4:43:27<23:14:33,  3.73it/s]
 16%|█▌        | 59332/371472 [4:43:27<24:05:24,  3.60it/s]
 16%|█▌        | 59333/371472 [4:43:28<24:23:12,  3.56it/s]
 16%|█▌        | 59334/371472 [4:43:28<24:09:41,  3.59it/s]
 16%|█▌        | 59335/371472 [4:43:28<25:57:00,  3.34it/s]
 16%|█▌        | 59336/371472 [4:43:29<24:44:42,  3.50it/s]
 16%|█▌        | 59337/371472 [4:43:29<24:23:00,  3.56it/s]
 16%|█▌        | 59338/371472 [4:43:29<23:29:37,  3.69it/s]
 16%|█▌        | 59339/371472 [4:43:29<23:10:45,  3.74it/s]
 16%|█▌        | 59340/371472 [4:43:30<23:32:17,  3.68it/s]
                                                           
{'loss': 4.3441, 'learning_rate': 8.566387985089098e-07, 'epoch': 2.56}

 16%|█▌        | 59340/371472 [4:43:30<23:32:17,  3.68it/s]
 16%|█▌        | 59341/371472 [4:43:30<24:39:11,  3.52it/s]
 16%|█▌        | 59342/371472 [4:43:30<24:28:25,  3.54it/s]
 16%|█▌        | 59343/371472 [4:43:31<23:52:02,  3.63it/s]
 16%|█▌        | 59344/371472 [4:43:31<24:04:01,  3.60it/s]
 16%|█▌        | 59345/371472 [4:43:31<24:08:29,  3.59it/s]
 16%|█▌        | 59346/371472 [4:43:31<24:40:43,  3.51it/s]
 16%|█▌        | 59347/371472 [4:43:32<23:48:44,  3.64it/s]
 16%|█▌        | 59348/371472 [4:43:32<26:03:20,  3.33it/s]
 16%|█▌        | 59349/371472 [4:43:32<25:53:35,  3.35it/s]
 16%|█▌        | 59350/371472 [4:43:33<26:03:56,  3.33it/s]
 16%|█▌        | 59351/371472 [4:43:33<26:30:43,  3.27it/s]
 16%|█▌        | 59352/371472 [4:43:33<25:37:16,  3.38it/s]
 16%|█▌        | 59353/371472 [4:43:34<25:43:39,  3.37it/s]
 16%|█▌        | 59354/371472 [4:43:34<25:02:52,  3.46it/s]
 16%|█▌        | 59355/371472 [4:43:34<26:09:44,  3.31it/s]
 16%|█▌        | 59356/371472 [4:43:34<26:10:55,  3.31it/s]
 16%|█▌        | 59357/371472 [4:43:35<25:13:17,  3.44it/s]
 16%|█▌        | 59358/371472 [4:43:35<24:14:33,  3.58it/s]
 16%|█▌        | 59359/371472 [4:43:35<24:54:40,  3.48it/s]
 16%|█▌        | 59360/371472 [4:43:35<24:07:46,  3.59it/s]
                                                           
{'loss': 4.1668, 'learning_rate': 8.56590316533431e-07, 'epoch': 2.56}

 16%|█▌        | 59360/371472 [4:43:35<24:07:46,  3.59it/s]
 16%|█▌        | 59361/371472 [4:43:36<23:49:07,  3.64it/s]
 16%|█▌        | 59362/371472 [4:43:36<23:10:36,  3.74it/s]
 16%|█▌        | 59363/371472 [4:43:36<22:21:13,  3.88it/s]
 16%|█▌        | 59364/371472 [4:43:37<24:58:09,  3.47it/s]
 16%|█▌        | 59365/371472 [4:43:37<23:40:01,  3.66it/s]
 16%|█▌        | 59366/371472 [4:43:37<23:33:12,  3.68it/s]
 16%|█▌        | 59367/371472 [4:43:37<22:27:40,  3.86it/s]
 16%|█▌        | 59368/371472 [4:43:38<22:34:39,  3.84it/s]
 16%|█▌        | 59369/371472 [4:43:38<24:16:46,  3.57it/s]
 16%|█▌        | 59370/371472 [4:43:38<24:12:59,  3.58it/s]
 16%|█▌        | 59371/371472 [4:43:38<24:03:03,  3.60it/s]
 16%|█▌        | 59372/371472 [4:43:39<24:12:48,  3.58it/s]
 16%|█▌        | 59373/371472 [4:43:39<23:26:59,  3.70it/s]
 16%|█▌        | 59374/371472 [4:43:39<25:59:15,  3.34it/s]
 16%|█▌        | 59375/371472 [4:43:40<24:15:32,  3.57it/s]
 16%|█▌        | 59376/371472 [4:43:40<23:22:12,  3.71it/s]
 16%|█▌        | 59377/371472 [4:43:40<23:56:49,  3.62it/s]
 16%|█▌        | 59378/371472 [4:43:40<24:15:52,  3.57it/s]
 16%|█▌        | 59379/371472 [4:43:41<23:57:46,  3.62it/s]
 16%|█▌        | 59380/371472 [4:43:41<24:15:30,  3.57it/s]
                                                           
{'loss': 4.391, 'learning_rate': 8.565418345579521e-07, 'epoch': 2.56}

 16%|█▌        | 59380/371472 [4:43:41<24:15:30,  3.57it/s]
 16%|█▌        | 59381/371472 [4:43:41<24:22:46,  3.56it/s]
 16%|█▌        | 59382/371472 [4:43:42<23:42:13,  3.66it/s]
 16%|█▌        | 59383/371472 [4:43:42<23:14:06,  3.73it/s]
 16%|█▌        | 59384/371472 [4:43:42<24:08:23,  3.59it/s]
 16%|█▌        | 59385/371472 [4:43:42<26:56:52,  3.22it/s]
 16%|█▌        | 59386/371472 [4:43:43<25:55:26,  3.34it/s]
 16%|█▌        | 59387/371472 [4:43:43<25:14:18,  3.43it/s]
 16%|█▌        | 59388/371472 [4:43:43<24:26:18,  3.55it/s]
 16%|█▌        | 59389/371472 [4:43:44<23:37:43,  3.67it/s]
 16%|█▌        | 59390/371472 [4:43:44<24:00:43,  3.61it/s]
 16%|█▌        | 59391/371472 [4:43:44<23:26:30,  3.70it/s]
 16%|█▌        | 59392/371472 [4:43:44<23:26:14,  3.70it/s]
 16%|█▌        | 59393/371472 [4:43:45<25:01:45,  3.46it/s]
 16%|█▌        | 59394/371472 [4:43:45<24:34:46,  3.53it/s]
 16%|█▌        | 59395/371472 [4:43:45<25:01:26,  3.46it/s]
 16%|█▌        | 59396/371472 [4:43:46<24:59:53,  3.47it/s]
 16%|█▌        | 59397/371472 [4:43:46<23:47:58,  3.64it/s]
 16%|█▌        | 59398/371472 [4:43:46<23:51:05,  3.63it/s]
 16%|█▌        | 59399/371472 [4:43:46<23:58:17,  3.62it/s]
 16%|█▌        | 59400/371472 [4:43:47<23:17:01,  3.72it/s]
                                                           
{'loss': 4.1836, 'learning_rate': 8.564933525824732e-07, 'epoch': 2.56}

 16%|█▌        | 59400/371472 [4:43:47<23:17:01,  3.72it/s]
 16%|█▌        | 59401/371472 [4:43:47<24:05:41,  3.60it/s]
 16%|█▌        | 59402/371472 [4:43:47<22:52:02,  3.79it/s]
 16%|█▌        | 59403/371472 [4:43:47<22:29:07,  3.86it/s]
 16%|█▌        | 59404/371472 [4:43:48<22:30:43,  3.85it/s]
 16%|█▌        | 59405/371472 [4:43:48<22:30:10,  3.85it/s]
 16%|█▌        | 59406/371472 [4:43:48<22:25:30,  3.87it/s]
 16%|█▌        | 59407/371472 [4:43:48<22:53:03,  3.79it/s]
 16%|█▌        | 59408/371472 [4:43:49<25:17:14,  3.43it/s]
 16%|█▌        | 59409/371472 [4:43:49<24:55:14,  3.48it/s]
 16%|█▌        | 59410/371472 [4:43:49<27:06:21,  3.20it/s]
 16%|█▌        | 59411/371472 [4:43:50<25:40:15,  3.38it/s]
 16%|█▌        | 59412/371472 [4:43:50<24:12:54,  3.58it/s]
 16%|█▌        | 59413/371472 [4:43:50<23:56:55,  3.62it/s]
 16%|█▌        | 59414/371472 [4:43:50<23:52:21,  3.63it/s]
 16%|█▌        | 59415/371472 [4:43:51<23:31:59,  3.68it/s]
 16%|█▌        | 59416/371472 [4:43:51<23:00:15,  3.77it/s]
 16%|█▌        | 59417/371472 [4:43:51<22:24:48,  3.87it/s]
 16%|█▌        | 59418/371472 [4:43:52<24:12:09,  3.58it/s]
 16%|█▌        | 59419/371472 [4:43:52<24:33:16,  3.53it/s]
 16%|█▌        | 59420/371472 [4:43:52<24:55:36,  3.48it/s]
                                                           
{'loss': 4.0879, 'learning_rate': 8.564448706069943e-07, 'epoch': 2.56}

 16%|█▌        | 59420/371472 [4:43:52<24:55:36,  3.48it/s]
 16%|█▌        | 59421/371472 [4:43:52<24:26:24,  3.55it/s]
 16%|█▌        | 59422/371472 [4:43:53<24:03:10,  3.60it/s]
 16%|█▌        | 59423/371472 [4:43:53<24:08:30,  3.59it/s]
 16%|█▌        | 59424/371472 [4:43:53<23:40:16,  3.66it/s]
 16%|█▌        | 59425/371472 [4:43:54<24:31:33,  3.53it/s]
 16%|█▌        | 59426/371472 [4:43:54<24:24:48,  3.55it/s]
 16%|█▌        | 59427/371472 [4:43:54<23:39:01,  3.67it/s]
 16%|█▌        | 59428/371472 [4:43:54<23:29:36,  3.69it/s]
 16%|█▌        | 59429/371472 [4:43:55<23:15:05,  3.73it/s]
 16%|█▌        | 59430/371472 [4:43:55<24:15:26,  3.57it/s]
 16%|█▌        | 59431/371472 [4:43:55<24:16:20,  3.57it/s]
 16%|█▌        | 59432/371472 [4:43:55<24:28:49,  3.54it/s]
 16%|█▌        | 59433/371472 [4:43:56<23:51:11,  3.63it/s]
 16%|█▌        | 59434/371472 [4:43:56<23:27:12,  3.70it/s]
 16%|█▌        | 59435/371472 [4:43:56<22:55:48,  3.78it/s]
 16%|█▌        | 59436/371472 [4:43:56<22:56:21,  3.78it/s]
 16%|█▌        | 59437/371472 [4:43:57<22:29:49,  3.85it/s]
 16%|█▌        | 59438/371472 [4:43:57<22:34:10,  3.84it/s]
 16%|█▌        | 59439/371472 [4:43:57<21:52:11,  3.96it/s]
 16%|█▌        | 59440/371472 [4:43:57<22:07:06,  3.92it/s]
                                                           
{'loss': 4.187, 'learning_rate': 8.563963886315154e-07, 'epoch': 2.56}

 16%|█▌        | 59440/371472 [4:43:57<22:07:06,  3.92it/s]
 16%|█▌        | 59441/371472 [4:43:58<24:38:01,  3.52it/s]
 16%|█▌        | 59442/371472 [4:43:58<24:00:57,  3.61it/s]
 16%|█▌        | 59443/371472 [4:43:58<24:35:24,  3.52it/s]
 16%|█▌        | 59444/371472 [4:43:59<24:16:58,  3.57it/s]
 16%|█▌        | 59445/371472 [4:43:59<25:28:44,  3.40it/s]
 16%|█▌        | 59446/371472 [4:43:59<25:07:40,  3.45it/s]
 16%|█▌        | 59447/371472 [4:44:00<24:56:40,  3.47it/s]
 16%|█▌        | 59448/371472 [4:44:00<24:33:17,  3.53it/s]
 16%|█▌        | 59449/371472 [4:44:00<24:03:45,  3.60it/s]
 16%|█▌        | 59450/371472 [4:44:00<25:23:02,  3.41it/s]
 16%|█▌        | 59451/371472 [4:44:01<24:13:04,  3.58it/s]
 16%|█▌        | 59452/371472 [4:44:01<24:34:21,  3.53it/s]
 16%|█▌        | 59453/371472 [4:44:01<25:43:17,  3.37it/s]
 16%|█▌        | 59454/371472 [4:44:02<25:08:17,  3.45it/s]
 16%|█▌        | 59455/371472 [4:44:02<27:01:51,  3.21it/s]
 16%|█▌        | 59456/371472 [4:44:02<27:41:09,  3.13it/s]
 16%|█▌        | 59457/371472 [4:44:03<25:54:15,  3.35it/s]
 16%|█▌        | 59458/371472 [4:44:03<26:37:11,  3.26it/s]
 16%|█▌        | 59459/371472 [4:44:03<26:06:49,  3.32it/s]
 16%|█▌        | 59460/371472 [4:44:03<24:47:19,  3.50it/s]
                                                           
{'loss': 4.1479, 'learning_rate': 8.563479066560365e-07, 'epoch': 2.56}

 16%|█▌        | 59460/371472 [4:44:03<24:47:19,  3.50it/s]
 16%|█▌        | 59461/371472 [4:44:04<25:05:25,  3.45it/s]
 16%|█▌        | 59462/371472 [4:44:04<26:58:48,  3.21it/s]
 16%|█▌        | 59463/371472 [4:44:04<26:54:17,  3.22it/s]
 16%|█▌        | 59464/371472 [4:44:05<25:09:30,  3.44it/s]
 16%|█▌        | 59465/371472 [4:44:05<23:44:58,  3.65it/s]
 16%|█▌        | 59466/371472 [4:44:05<22:50:29,  3.79it/s]
 16%|█▌        | 59467/371472 [4:44:05<22:29:12,  3.85it/s]
 16%|█▌        | 59468/371472 [4:44:06<22:20:14,  3.88it/s]
 16%|█▌        | 59469/371472 [4:44:06<23:58:27,  3.62it/s]
 16%|█▌        | 59470/371472 [4:44:06<23:06:51,  3.75it/s]
 16%|█▌        | 59471/371472 [4:44:06<25:18:34,  3.42it/s]
 16%|█▌        | 59472/371472 [4:44:07<24:02:37,  3.60it/s]
 16%|█▌        | 59473/371472 [4:44:07<23:03:25,  3.76it/s]
 16%|█▌        | 59474/371472 [4:44:07<22:53:16,  3.79it/s]
 16%|█▌        | 59475/371472 [4:44:07<22:36:04,  3.83it/s]
 16%|█▌        | 59476/371472 [4:44:08<22:11:38,  3.90it/s]
 16%|█▌        | 59477/371472 [4:44:08<23:05:39,  3.75it/s]
 16%|█▌        | 59478/371472 [4:44:08<23:34:18,  3.68it/s]
 16%|█▌        | 59479/371472 [4:44:09<23:42:13,  3.66it/s]
 16%|█▌        | 59480/371472 [4:44:09<23:04:54,  3.75it/s]
                                                           
{'loss': 4.1809, 'learning_rate': 8.562994246805576e-07, 'epoch': 2.56}

 16%|█▌        | 59480/371472 [4:44:09<23:04:54,  3.75it/s]
 16%|█▌        | 59481/371472 [4:44:09<22:49:38,  3.80it/s]
 16%|█▌        | 59482/371472 [4:44:09<23:39:46,  3.66it/s]
 16%|█▌        | 59483/371472 [4:44:10<23:38:59,  3.66it/s]
 16%|█▌        | 59484/371472 [4:44:10<23:49:00,  3.64it/s]
 16%|█▌        | 59485/371472 [4:44:10<24:09:10,  3.59it/s]
 16%|█▌        | 59486/371472 [4:44:11<25:46:45,  3.36it/s]
 16%|█▌        | 59487/371472 [4:44:11<25:13:24,  3.44it/s]
 16%|█▌        | 59488/371472 [4:44:11<24:07:46,  3.59it/s]
 16%|█▌        | 59489/371472 [4:44:11<23:51:45,  3.63it/s]
 16%|█▌        | 59490/371472 [4:44:12<23:00:23,  3.77it/s]
 16%|█▌        | 59491/371472 [4:44:12<22:03:48,  3.93it/s]
 16%|█▌        | 59492/371472 [4:44:12<23:02:06,  3.76it/s]
 16%|█▌        | 59493/371472 [4:44:12<23:50:03,  3.64it/s]
 16%|█▌        | 59494/371472 [4:44:13<24:10:32,  3.58it/s]
 16%|█▌        | 59495/371472 [4:44:13<23:47:28,  3.64it/s]
 16%|█▌        | 59496/371472 [4:44:13<23:29:19,  3.69it/s]
 16%|█▌        | 59497/371472 [4:44:14<23:29:33,  3.69it/s]
 16%|█▌        | 59498/371472 [4:44:14<24:16:32,  3.57it/s]
 16%|█▌        | 59499/371472 [4:44:14<24:18:24,  3.57it/s]
 16%|█▌        | 59500/371472 [4:44:14<24:28:27,  3.54it/s]
                                                           
{'loss': 4.191, 'learning_rate': 8.562509427050787e-07, 'epoch': 2.56}

 16%|█▌        | 59500/371472 [4:44:14<24:28:27,  3.54it/s]
 16%|█▌        | 59501/371472 [4:44:15<24:59:33,  3.47it/s]
 16%|█▌        | 59502/371472 [4:44:15<27:25:43,  3.16it/s]
 16%|█▌        | 59503/371472 [4:44:15<26:17:11,  3.30it/s]
 16%|█▌        | 59504/371472 [4:44:16<28:32:40,  3.04it/s]
 16%|█▌        | 59505/371472 [4:44:16<27:03:57,  3.20it/s]
 16%|█▌        | 59506/371472 [4:44:16<27:09:42,  3.19it/s]
 16%|█▌        | 59507/371472 [4:44:17<26:34:19,  3.26it/s]
 16%|█▌        | 59508/371472 [4:44:17<25:53:15,  3.35it/s]
 16%|█▌        | 59509/371472 [4:44:17<25:02:31,  3.46it/s]
 16%|█▌        | 59510/371472 [4:44:17<24:13:30,  3.58it/s]
 16%|█▌        | 59511/371472 [4:44:18<24:13:45,  3.58it/s]
 16%|█▌        | 59512/371472 [4:44:18<23:03:32,  3.76it/s]
 16%|█▌        | 59513/371472 [4:44:18<23:56:56,  3.62it/s]
 16%|█▌        | 59514/371472 [4:44:18<23:47:13,  3.64it/s]
 16%|█▌        | 59515/371472 [4:44:19<23:16:03,  3.72it/s]
 16%|█▌        | 59516/371472 [4:44:19<24:03:42,  3.60it/s]
 16%|█▌        | 59517/371472 [4:44:19<23:56:47,  3.62it/s]
 16%|█▌        | 59518/371472 [4:44:20<22:47:37,  3.80it/s]
 16%|█▌        | 59519/371472 [4:44:20<22:29:42,  3.85it/s]
 16%|█▌        | 59520/371472 [4:44:20<24:07:14,  3.59it/s]
                                                           
{'loss': 4.4552, 'learning_rate': 8.562024607295999e-07, 'epoch': 2.56}

 16%|█▌        | 59520/371472 [4:44:20<24:07:14,  3.59it/s]
 16%|█▌        | 59521/371472 [4:44:20<23:12:57,  3.73it/s]
 16%|█▌        | 59522/371472 [4:44:21<22:50:28,  3.79it/s]
 16%|█▌        | 59523/371472 [4:44:21<22:11:10,  3.91it/s]
 16%|█▌        | 59524/371472 [4:44:21<21:38:11,  4.00it/s]
 16%|█▌        | 59525/371472 [4:44:21<21:48:26,  3.97it/s]
 16%|█▌        | 59526/371472 [4:44:22<22:06:52,  3.92it/s]
 16%|█▌        | 59527/371472 [4:44:22<22:06:17,  3.92it/s]
 16%|█▌        | 59528/371472 [4:44:22<22:11:08,  3.91it/s]
 16%|█▌        | 59529/371472 [4:44:22<22:12:44,  3.90it/s]
 16%|█▌        | 59530/371472 [4:44:23<23:22:18,  3.71it/s]
 16%|█▌        | 59531/371472 [4:44:23<25:28:13,  3.40it/s]
 16%|█▌        | 59532/371472 [4:44:23<25:21:19,  3.42it/s]
 16%|█▌        | 59533/371472 [4:44:24<25:16:53,  3.43it/s]
 16%|█▌        | 59534/371472 [4:44:24<25:44:21,  3.37it/s]
 16%|█▌        | 59535/371472 [4:44:24<25:01:43,  3.46it/s]
 16%|█▌        | 59536/371472 [4:44:24<24:22:45,  3.55it/s]
 16%|█▌        | 59537/371472 [4:44:25<23:59:15,  3.61it/s]
 16%|█▌        | 59538/371472 [4:44:25<24:25:58,  3.55it/s]
 16%|█▌        | 59539/371472 [4:44:25<24:12:08,  3.58it/s]
 16%|█▌        | 59540/371472 [4:44:26<24:42:59,  3.51it/s]
                                                           
{'loss': 4.3285, 'learning_rate': 8.56153978754121e-07, 'epoch': 2.56}

 16%|█▌        | 59540/371472 [4:44:26<24:42:59,  3.51it/s]
 16%|█▌        | 59541/371472 [4:44:26<23:46:26,  3.64it/s]
 16%|█▌        | 59542/371472 [4:44:26<23:50:32,  3.63it/s]
 16%|█▌        | 59543/371472 [4:44:26<23:09:50,  3.74it/s]
 16%|█▌        | 59544/371472 [4:44:27<22:32:46,  3.84it/s]
 16%|█▌        | 59545/371472 [4:44:27<21:52:49,  3.96it/s]
 16%|█▌        | 59546/371472 [4:44:27<21:59:32,  3.94it/s]
 16%|█▌        | 59547/371472 [4:44:27<22:04:08,  3.93it/s]
 16%|█▌        | 59548/371472 [4:44:28<22:26:42,  3.86it/s]
 16%|█▌        | 59549/371472 [4:44:28<23:45:25,  3.65it/s]
 16%|█▌        | 59550/371472 [4:44:28<25:10:54,  3.44it/s]
 16%|█▌        | 59551/371472 [4:44:29<24:40:58,  3.51it/s]
 16%|█▌        | 59552/371472 [4:44:29<23:53:29,  3.63it/s]
 16%|█▌        | 59553/371472 [4:44:29<23:33:47,  3.68it/s]
 16%|█▌        | 59554/371472 [4:44:29<24:25:53,  3.55it/s]
 16%|█▌        | 59555/371472 [4:44:30<24:25:07,  3.55it/s]
 16%|█▌        | 59556/371472 [4:44:30<23:46:49,  3.64it/s]
 16%|█▌        | 59557/371472 [4:44:30<22:56:09,  3.78it/s]
 16%|█▌        | 59558/371472 [4:44:30<23:15:49,  3.72it/s]
 16%|█▌        | 59559/371472 [4:44:31<24:01:18,  3.61it/s]
 16%|█▌        | 59560/371472 [4:44:31<23:58:42,  3.61it/s]
                                                           
{'loss': 4.2826, 'learning_rate': 8.56105496778642e-07, 'epoch': 2.57}

 16%|█▌        | 59560/371472 [4:44:31<23:58:42,  3.61it/s]
 16%|█▌        | 59561/371472 [4:44:31<25:41:29,  3.37it/s]
 16%|█▌        | 59562/371472 [4:44:32<24:21:32,  3.56it/s]
 16%|█▌        | 59563/371472 [4:44:32<23:43:35,  3.65it/s]
 16%|█▌        | 59564/371472 [4:44:32<23:30:12,  3.69it/s]
 16%|█▌        | 59565/371472 [4:44:32<23:39:41,  3.66it/s]
 16%|█▌        | 59566/371472 [4:44:33<23:50:41,  3.63it/s]
 16%|█▌        | 59567/371472 [4:44:33<23:39:48,  3.66it/s]
 16%|█▌        | 59568/371472 [4:44:33<23:56:42,  3.62it/s]
 16%|█▌        | 59569/371472 [4:44:34<25:21:10,  3.42it/s]
 16%|█▌        | 59570/371472 [4:44:34<25:24:54,  3.41it/s]
 16%|█▌        | 59571/371472 [4:44:34<24:50:55,  3.49it/s]
 16%|█▌        | 59572/371472 [4:44:34<24:59:44,  3.47it/s]
 16%|█▌        | 59573/371472 [4:44:35<23:30:33,  3.69it/s]
 16%|█▌        | 59574/371472 [4:44:35<22:37:59,  3.83it/s]
 16%|█▌        | 59575/371472 [4:44:35<23:58:38,  3.61it/s]
 16%|█▌        | 59576/371472 [4:44:36<24:58:03,  3.47it/s]
 16%|█▌        | 59577/371472 [4:44:36<25:09:58,  3.44it/s]
 16%|█▌        | 59578/371472 [4:44:36<24:15:26,  3.57it/s]
 16%|█▌        | 59579/371472 [4:44:36<24:01:32,  3.61it/s]
 16%|█▌        | 59580/371472 [4:44:37<23:25:14,  3.70it/s]
                                                           
{'loss': 4.0214, 'learning_rate': 8.560570148031631e-07, 'epoch': 2.57}

 16%|█▌        | 59580/371472 [4:44:37<23:25:14,  3.70it/s]
 16%|█▌        | 59581/371472 [4:44:37<22:57:40,  3.77it/s]
 16%|█▌        | 59582/371472 [4:44:37<22:37:01,  3.83it/s]
 16%|█▌        | 59583/371472 [4:44:37<24:03:22,  3.60it/s]
 16%|█▌        | 59584/371472 [4:44:38<24:00:59,  3.61it/s]
 16%|█▌        | 59585/371472 [4:44:38<23:36:40,  3.67it/s]
 16%|█▌        | 59586/371472 [4:44:38<23:53:30,  3.63it/s]
 16%|█▌        | 59587/371472 [4:44:39<24:04:51,  3.60it/s]
 16%|█▌        | 59588/371472 [4:44:39<23:18:17,  3.72it/s]
 16%|█▌        | 59589/371472 [4:44:39<22:41:44,  3.82it/s]
 16%|█▌        | 59590/371472 [4:44:39<24:41:37,  3.51it/s]
 16%|█▌        | 59591/371472 [4:44:40<24:46:10,  3.50it/s]
 16%|█▌        | 59592/371472 [4:44:40<25:21:33,  3.42it/s]
 16%|█▌        | 59593/371472 [4:44:40<26:29:24,  3.27it/s]
 16%|█▌        | 59594/371472 [4:44:41<25:20:34,  3.42it/s]
 16%|█▌        | 59595/371472 [4:44:41<25:26:02,  3.41it/s]
 16%|█▌        | 59596/371472 [4:44:41<25:11:01,  3.44it/s]
 16%|█▌        | 59597/371472 [4:44:41<24:27:24,  3.54it/s]
 16%|█▌        | 59598/371472 [4:44:42<23:48:10,  3.64it/s]
 16%|█▌        | 59599/371472 [4:44:42<24:39:36,  3.51it/s]
 16%|█▌        | 59600/371472 [4:44:42<25:12:38,  3.44it/s]
                                                           
{'loss': 4.0768, 'learning_rate': 8.560085328276842e-07, 'epoch': 2.57}

 16%|█▌        | 59600/371472 [4:44:42<25:12:38,  3.44it/s]
 16%|█▌        | 59601/371472 [4:44:43<27:39:30,  3.13it/s]
 16%|█▌        | 59602/371472 [4:44:43<26:22:46,  3.28it/s]
 16%|█▌        | 59603/371472 [4:44:43<27:44:42,  3.12it/s]
 16%|█▌        | 59604/371472 [4:44:44<26:22:11,  3.29it/s]
 16%|█▌        | 59605/371472 [4:44:44<24:44:55,  3.50it/s]
 16%|█▌        | 59606/371472 [4:44:44<23:38:35,  3.66it/s]
 16%|█▌        | 59607/371472 [4:44:44<25:14:20,  3.43it/s]
 16%|█▌        | 59608/371472 [4:44:45<24:50:01,  3.49it/s]
 16%|█▌        | 59609/371472 [4:44:45<26:41:03,  3.25it/s]
 16%|█▌        | 59610/371472 [4:44:45<25:29:42,  3.40it/s]
 16%|█▌        | 59611/371472 [4:44:45<24:15:42,  3.57it/s]
 16%|█▌        | 59612/371472 [4:44:46<23:27:12,  3.69it/s]
 16%|█▌        | 59613/371472 [4:44:46<24:15:29,  3.57it/s]
 16%|█▌        | 59614/371472 [4:44:46<24:37:29,  3.52it/s]
 16%|█▌        | 59615/371472 [4:44:47<24:27:33,  3.54it/s]
 16%|█▌        | 59616/371472 [4:44:47<23:43:37,  3.65it/s]
 16%|█▌        | 59617/371472 [4:44:47<23:09:02,  3.74it/s]
 16%|█▌        | 59618/371472 [4:44:47<23:21:45,  3.71it/s]
 16%|█▌        | 59619/371472 [4:44:48<24:17:34,  3.57it/s]
 16%|█▌        | 59620/371472 [4:44:48<27:35:33,  3.14it/s]
                                                           
{'loss': 4.1235, 'learning_rate': 8.559600508522053e-07, 'epoch': 2.57}

 16%|█▌        | 59620/371472 [4:44:48<27:35:33,  3.14it/s]
 16%|█▌        | 59621/371472 [4:44:48<27:11:48,  3.19it/s]
 16%|█▌        | 59622/371472 [4:44:49<25:20:20,  3.42it/s]
 16%|█▌        | 59623/371472 [4:44:49<24:27:37,  3.54it/s]
 16%|█▌        | 59624/371472 [4:44:49<24:16:21,  3.57it/s]
 16%|█▌        | 59625/371472 [4:44:49<24:33:23,  3.53it/s]
 16%|█▌        | 59626/371472 [4:44:50<23:19:54,  3.71it/s]
 16%|█▌        | 59627/371472 [4:44:50<23:11:54,  3.73it/s]
 16%|█▌        | 59628/371472 [4:44:50<23:57:17,  3.62it/s]
 16%|█▌        | 59629/371472 [4:44:51<25:07:01,  3.45it/s]
 16%|█▌        | 59630/371472 [4:44:51<24:50:04,  3.49it/s]
 16%|█▌        | 59631/371472 [4:44:51<25:57:54,  3.34it/s]
 16%|█▌        | 59632/371472 [4:44:52<26:00:28,  3.33it/s]
 16%|█▌        | 59633/371472 [4:44:52<24:53:32,  3.48it/s]
 16%|█▌        | 59634/371472 [4:44:52<25:52:51,  3.35it/s]
 16%|█▌        | 59635/371472 [4:44:52<24:41:54,  3.51it/s]
 16%|█▌        | 59636/371472 [4:44:53<24:16:35,  3.57it/s]
 16%|█▌        | 59637/371472 [4:44:53<23:59:49,  3.61it/s]
 16%|█▌        | 59638/371472 [4:44:53<24:05:00,  3.60it/s]
 16%|█▌        | 59639/371472 [4:44:53<25:09:57,  3.44it/s]
 16%|█▌        | 59640/371472 [4:44:54<24:17:24,  3.57it/s]
                                                           
{'loss': 4.2986, 'learning_rate': 8.559115688767264e-07, 'epoch': 2.57}

 16%|█▌        | 59640/371472 [4:44:54<24:17:24,  3.57it/s]
 16%|█▌        | 59641/371472 [4:44:54<25:03:10,  3.46it/s]
 16%|█▌        | 59642/371472 [4:44:54<23:54:09,  3.62it/s]
 16%|█▌        | 59643/371472 [4:44:55<23:41:11,  3.66it/s]
 16%|█▌        | 59644/371472 [4:44:55<25:57:57,  3.34it/s]
 16%|█▌        | 59645/371472 [4:44:55<24:59:09,  3.47it/s]
 16%|█▌        | 59646/371472 [4:44:55<25:01:32,  3.46it/s]
 16%|█▌        | 59647/371472 [4:44:56<25:31:23,  3.39it/s]
 16%|█▌        | 59648/371472 [4:44:56<24:36:49,  3.52it/s]
 16%|█▌        | 59649/371472 [4:44:56<24:23:31,  3.55it/s]
 16%|█▌        | 59650/371472 [4:44:57<25:18:25,  3.42it/s]
 16%|█▌        | 59651/371472 [4:44:57<24:38:14,  3.52it/s]
 16%|█▌        | 59652/371472 [4:44:57<24:16:41,  3.57it/s]
 16%|█▌        | 59653/371472 [4:44:57<22:53:34,  3.78it/s]
 16%|█▌        | 59654/371472 [4:44:58<23:01:31,  3.76it/s]
 16%|█▌        | 59655/371472 [4:44:58<23:01:35,  3.76it/s]
 16%|█▌        | 59656/371472 [4:44:58<23:13:01,  3.73it/s]
 16%|█▌        | 59657/371472 [4:44:59<24:31:23,  3.53it/s]
 16%|█▌        | 59658/371472 [4:44:59<24:25:14,  3.55it/s]
 16%|█▌        | 59659/371472 [4:44:59<25:41:31,  3.37it/s]
 16%|█▌        | 59660/371472 [4:44:59<24:28:27,  3.54it/s]
                                                           
{'loss': 3.9553, 'learning_rate': 8.558630869012476e-07, 'epoch': 2.57}

 16%|█▌        | 59660/371472 [4:44:59<24:28:27,  3.54it/s]
 16%|█▌        | 59661/371472 [4:45:00<23:26:39,  3.69it/s]
 16%|█▌        | 59662/371472 [4:45:00<22:37:03,  3.83it/s]
 16%|█▌        | 59663/371472 [4:45:00<22:58:17,  3.77it/s]
 16%|█▌        | 59664/371472 [4:45:00<23:14:26,  3.73it/s]
 16%|█▌        | 59665/371472 [4:45:01<24:01:48,  3.60it/s]
 16%|█▌        | 59666/371472 [4:45:01<23:26:58,  3.69it/s]
 16%|█▌        | 59667/371472 [4:45:01<23:08:37,  3.74it/s]
 16%|█▌        | 59668/371472 [4:45:01<22:47:11,  3.80it/s]
 16%|█▌        | 59669/371472 [4:45:02<25:21:12,  3.42it/s]
 16%|█▌        | 59670/371472 [4:45:02<26:06:43,  3.32it/s]
 16%|█▌        | 59671/371472 [4:45:02<26:34:32,  3.26it/s]
 16%|█▌        | 59672/371472 [4:45:03<26:44:50,  3.24it/s]
 16%|█▌        | 59673/371472 [4:45:03<26:16:31,  3.30it/s]
 16%|█▌        | 59674/371472 [4:45:03<26:38:14,  3.25it/s]
 16%|█▌        | 59675/371472 [4:45:04<25:25:51,  3.41it/s]
 16%|█▌        | 59676/371472 [4:45:04<24:16:58,  3.57it/s]
 16%|█▌        | 59677/371472 [4:45:04<24:43:56,  3.50it/s]
 16%|█▌        | 59678/371472 [4:45:04<23:57:12,  3.62it/s]
 16%|█▌        | 59679/371472 [4:45:05<23:25:09,  3.70it/s]
 16%|█▌        | 59680/371472 [4:45:05<25:10:12,  3.44it/s]
                                                           
{'loss': 4.144, 'learning_rate': 8.558146049257686e-07, 'epoch': 2.57}

 16%|█▌        | 59680/371472 [4:45:05<25:10:12,  3.44it/s]
 16%|█▌        | 59681/371472 [4:45:05<24:31:14,  3.53it/s]
 16%|█▌        | 59682/371472 [4:45:06<25:14:45,  3.43it/s]
 16%|█▌        | 59683/371472 [4:45:06<24:55:29,  3.47it/s]
 16%|█▌        | 59684/371472 [4:45:06<24:06:46,  3.59it/s]
 16%|█▌        | 59685/371472 [4:45:06<23:49:07,  3.64it/s]
 16%|█▌        | 59686/371472 [4:45:07<24:15:39,  3.57it/s]
 16%|█▌        | 59687/371472 [4:45:07<24:47:41,  3.49it/s]
 16%|█▌        | 59688/371472 [4:45:07<24:14:10,  3.57it/s]
 16%|█▌        | 59689/371472 [4:45:08<23:33:50,  3.68it/s]
 16%|█▌        | 59690/371472 [4:45:08<23:26:29,  3.69it/s]
 16%|█▌        | 59691/371472 [4:45:08<23:14:04,  3.73it/s]
 16%|█▌        | 59692/371472 [4:45:08<24:01:33,  3.60it/s]
 16%|█▌        | 59693/371472 [4:45:09<23:18:05,  3.72it/s]
 16%|█▌        | 59694/371472 [4:45:09<23:05:26,  3.75it/s]
 16%|█▌        | 59695/371472 [4:45:09<23:50:20,  3.63it/s]
 16%|█▌        | 59696/371472 [4:45:09<23:27:43,  3.69it/s]
 16%|█▌        | 59697/371472 [4:45:10<24:48:23,  3.49it/s]
 16%|█▌        | 59698/371472 [4:45:10<23:32:03,  3.68it/s]
 16%|█▌        | 59699/371472 [4:45:10<25:16:47,  3.43it/s]
 16%|█▌        | 59700/371472 [4:45:11<25:08:18,  3.45it/s]
                                                           
{'loss': 4.1962, 'learning_rate': 8.557661229502897e-07, 'epoch': 2.57}

 16%|█▌        | 59700/371472 [4:45:11<25:08:18,  3.45it/s]
 16%|█▌        | 59701/371472 [4:45:11<24:08:59,  3.59it/s]
 16%|█▌        | 59702/371472 [4:45:11<23:22:01,  3.71it/s]
 16%|█▌        | 59703/371472 [4:45:11<24:43:05,  3.50it/s]
 16%|█▌        | 59704/371472 [4:45:12<24:30:47,  3.53it/s]
 16%|█▌        | 59705/371472 [4:45:12<23:36:23,  3.67it/s]
 16%|█▌        | 59706/371472 [4:45:12<23:18:22,  3.72it/s]
 16%|█▌        | 59707/371472 [4:45:13<24:30:42,  3.53it/s]
 16%|█▌        | 59708/371472 [4:45:13<23:54:54,  3.62it/s]
 16%|█▌        | 59709/371472 [4:45:13<23:09:39,  3.74it/s]
 16%|█▌        | 59710/371472 [4:45:13<24:10:45,  3.58it/s]
 16%|█▌        | 59711/371472 [4:45:14<23:06:54,  3.75it/s]
 16%|█▌        | 59712/371472 [4:45:14<25:07:16,  3.45it/s]
 16%|█▌        | 59713/371472 [4:45:14<24:11:18,  3.58it/s]
 16%|█▌        | 59714/371472 [4:45:14<24:14:38,  3.57it/s]
 16%|█▌        | 59715/371472 [4:45:15<26:03:21,  3.32it/s]
 16%|█▌        | 59716/371472 [4:45:15<24:44:28,  3.50it/s]
 16%|█▌        | 59717/371472 [4:45:15<23:29:16,  3.69it/s]
 16%|█▌        | 59718/371472 [4:45:16<23:33:53,  3.67it/s]
 16%|█▌        | 59719/371472 [4:45:16<23:54:34,  3.62it/s]
 16%|█▌        | 59720/371472 [4:45:16<23:31:04,  3.68it/s]
                                                           
{'loss': 4.3642, 'learning_rate': 8.557176409748109e-07, 'epoch': 2.57}

 16%|█▌        | 59720/371472 [4:45:16<23:31:04,  3.68it/s]
 16%|█▌        | 59721/371472 [4:45:16<24:42:40,  3.50it/s]
 16%|█▌        | 59722/371472 [4:45:17<23:35:31,  3.67it/s]
 16%|█▌        | 59723/371472 [4:45:17<23:37:52,  3.66it/s]
 16%|█▌        | 59724/371472 [4:45:17<23:51:14,  3.63it/s]
 16%|█▌        | 59725/371472 [4:45:18<23:27:44,  3.69it/s]
 16%|█▌        | 59726/371472 [4:45:18<22:54:53,  3.78it/s]
 16%|█▌        | 59727/371472 [4:45:18<23:19:08,  3.71it/s]
 16%|█▌        | 59728/371472 [4:45:18<24:02:32,  3.60it/s]
 16%|█▌        | 59729/371472 [4:45:19<23:50:32,  3.63it/s]
 16%|█▌        | 59730/371472 [4:45:19<25:36:52,  3.38it/s]
 16%|█▌        | 59731/371472 [4:45:19<24:20:25,  3.56it/s]
 16%|█▌        | 59732/371472 [4:45:20<25:01:21,  3.46it/s]
 16%|█▌        | 59733/371472 [4:45:20<25:29:31,  3.40it/s]
 16%|█▌        | 59734/371472 [4:45:20<24:56:22,  3.47it/s]
 16%|█▌        | 59735/371472 [4:45:20<24:53:04,  3.48it/s]
 16%|█▌        | 59736/371472 [4:45:21<24:28:06,  3.54it/s]
 16%|█▌        | 59737/371472 [4:45:21<26:04:04,  3.32it/s]
 16%|█▌        | 59738/371472 [4:45:21<25:41:28,  3.37it/s]
 16%|█▌        | 59739/371472 [4:45:22<26:05:14,  3.32it/s]
 16%|█▌        | 59740/371472 [4:45:22<26:52:53,  3.22it/s]
                                                           
{'loss': 4.0517, 'learning_rate': 8.55669158999332e-07, 'epoch': 2.57}

 16%|█▌        | 59740/371472 [4:45:22<26:52:53,  3.22it/s]
 16%|█▌        | 59741/371472 [4:45:22<25:31:02,  3.39it/s]
 16%|█▌        | 59742/371472 [4:45:22<24:50:53,  3.48it/s]
 16%|█▌        | 59743/371472 [4:45:23<24:56:05,  3.47it/s]
 16%|█▌        | 59744/371472 [4:45:23<25:45:47,  3.36it/s]
 16%|█▌        | 59745/371472 [4:45:23<24:17:02,  3.57it/s]
 16%|█▌        | 59746/371472 [4:45:24<23:42:18,  3.65it/s]
 16%|█▌        | 59747/371472 [4:45:24<23:16:10,  3.72it/s]
 16%|█▌        | 59748/371472 [4:45:24<23:01:14,  3.76it/s]
 16%|█▌        | 59749/371472 [4:45:24<22:27:47,  3.85it/s]
 16%|█▌        | 59750/371472 [4:45:25<23:58:59,  3.61it/s]
 16%|█▌        | 59751/371472 [4:45:25<23:41:48,  3.65it/s]
 16%|█▌        | 59752/371472 [4:45:25<23:19:27,  3.71it/s]
 16%|█▌        | 59753/371472 [4:45:25<23:38:02,  3.66it/s]
 16%|█▌        | 59754/371472 [4:45:26<23:08:56,  3.74it/s]
 16%|█▌        | 59755/371472 [4:45:26<23:19:01,  3.71it/s]
 16%|█▌        | 59756/371472 [4:45:26<22:56:24,  3.77it/s]
 16%|█▌        | 59757/371472 [4:45:26<22:53:06,  3.78it/s]
 16%|█▌        | 59758/371472 [4:45:27<24:09:22,  3.58it/s]
 16%|█▌        | 59759/371472 [4:45:27<26:55:45,  3.22it/s]
 16%|█▌        | 59760/371472 [4:45:27<25:57:31,  3.34it/s]
                                                           
{'loss': 4.0824, 'learning_rate': 8.556206770238531e-07, 'epoch': 2.57}

 16%|█▌        | 59760/371472 [4:45:27<25:57:31,  3.34it/s]
 16%|█▌        | 59761/371472 [4:45:28<24:27:52,  3.54it/s]
 16%|█▌        | 59762/371472 [4:45:28<24:34:56,  3.52it/s]
 16%|█▌        | 59763/371472 [4:45:28<25:46:14,  3.36it/s]
 16%|█▌        | 59764/371472 [4:45:29<24:46:36,  3.49it/s]
 16%|█▌        | 59765/371472 [4:45:29<24:54:21,  3.48it/s]
 16%|█▌        | 59766/371472 [4:45:29<24:18:10,  3.56it/s]
 16%|█▌        | 59767/371472 [4:45:29<23:32:37,  3.68it/s]
 16%|█▌        | 59768/371472 [4:45:30<23:06:13,  3.75it/s]
 16%|█▌        | 59769/371472 [4:45:30<23:27:28,  3.69it/s]
 16%|█▌        | 59770/371472 [4:45:30<23:09:42,  3.74it/s]
 16%|█▌        | 59771/371472 [4:45:30<23:00:35,  3.76it/s]
 16%|█▌        | 59772/371472 [4:45:31<25:48:44,  3.35it/s]
 16%|█▌        | 59773/371472 [4:45:31<25:56:24,  3.34it/s]
 16%|█▌        | 59774/371472 [4:45:31<25:33:42,  3.39it/s]
 16%|█▌        | 59775/371472 [4:45:32<24:34:05,  3.52it/s]
 16%|█▌        | 59776/371472 [4:45:32<24:05:20,  3.59it/s]
 16%|█▌        | 59777/371472 [4:45:32<24:24:47,  3.55it/s]
 16%|█▌        | 59778/371472 [4:45:32<23:53:21,  3.62it/s]
 16%|█▌        | 59779/371472 [4:45:33<23:39:44,  3.66it/s]
 16%|█▌        | 59780/371472 [4:45:33<24:12:28,  3.58it/s]
                                                           
{'loss': 4.178, 'learning_rate': 8.555721950483742e-07, 'epoch': 2.57}

 16%|█▌        | 59780/371472 [4:45:33<24:12:28,  3.58it/s]
 16%|█▌        | 59781/371472 [4:45:33<24:32:27,  3.53it/s]
 16%|█▌        | 59782/371472 [4:45:34<23:58:06,  3.61it/s]
 16%|█▌        | 59783/371472 [4:45:34<24:00:50,  3.61it/s]
 16%|█▌        | 59784/371472 [4:45:34<23:52:14,  3.63it/s]
 16%|█▌        | 59785/371472 [4:45:34<23:34:15,  3.67it/s]
 16%|█▌        | 59786/371472 [4:45:35<27:18:52,  3.17it/s]
 16%|█▌        | 59787/371472 [4:45:35<25:28:02,  3.40it/s]
 16%|█▌        | 59788/371472 [4:45:35<25:02:29,  3.46it/s]
 16%|█▌        | 59789/371472 [4:45:36<28:50:30,  3.00it/s]
 16%|█▌        | 59790/371472 [4:45:36<26:42:13,  3.24it/s]
 16%|█▌        | 59791/371472 [4:45:36<28:02:21,  3.09it/s]
 16%|█▌        | 59792/371472 [4:45:37<26:35:58,  3.25it/s]
 16%|█▌        | 59793/371472 [4:45:37<27:37:40,  3.13it/s]
 16%|█▌        | 59794/371472 [4:45:37<26:52:33,  3.22it/s]
 16%|█▌        | 59795/371472 [4:45:38<25:21:00,  3.42it/s]
 16%|█▌        | 59796/371472 [4:45:38<24:32:34,  3.53it/s]
 16%|█▌        | 59797/371472 [4:45:38<25:11:48,  3.44it/s]
 16%|█▌        | 59798/371472 [4:45:38<24:23:05,  3.55it/s]
 16%|█▌        | 59799/371472 [4:45:39<24:43:55,  3.50it/s]
 16%|█▌        | 59800/371472 [4:45:39<25:15:09,  3.43it/s]
                                                           
{'loss': 4.347, 'learning_rate': 8.555237130728954e-07, 'epoch': 2.58}

 16%|█▌        | 59800/371472 [4:45:39<25:15:09,  3.43it/s]
 16%|█▌        | 59801/371472 [4:45:39<26:18:29,  3.29it/s]
 16%|█▌        | 59802/371472 [4:45:40<24:44:36,  3.50it/s]
 16%|█▌        | 59803/371472 [4:45:40<23:54:03,  3.62it/s]
 16%|█▌        | 59804/371472 [4:45:40<23:41:47,  3.65it/s]
 16%|█▌        | 59805/371472 [4:45:40<23:15:02,  3.72it/s]
 16%|█▌        | 59806/371472 [4:45:41<22:39:32,  3.82it/s]
 16%|█▌        | 59807/371472 [4:45:41<24:33:31,  3.53it/s]
 16%|█▌        | 59808/371472 [4:45:41<23:53:40,  3.62it/s]
 16%|█▌        | 59809/371472 [4:45:41<23:56:11,  3.62it/s]
 16%|█▌        | 59810/371472 [4:45:42<23:31:14,  3.68it/s]
 16%|█▌        | 59811/371472 [4:45:42<24:50:44,  3.48it/s]
 16%|█▌        | 59812/371472 [4:45:42<24:12:26,  3.58it/s]
 16%|█▌        | 59813/371472 [4:45:43<23:53:33,  3.62it/s]
 16%|█▌        | 59814/371472 [4:45:43<24:50:55,  3.48it/s]
 16%|█▌        | 59815/371472 [4:45:43<24:08:05,  3.59it/s]
 16%|█▌        | 59816/371472 [4:45:43<24:35:14,  3.52it/s]
 16%|█▌        | 59817/371472 [4:45:44<23:47:30,  3.64it/s]
 16%|█▌        | 59818/371472 [4:45:44<23:35:22,  3.67it/s]
 16%|█▌        | 59819/371472 [4:45:44<22:54:21,  3.78it/s]
 16%|█▌        | 59820/371472 [4:45:44<22:49:41,  3.79it/s]
                                                           
{'loss': 4.3382, 'learning_rate': 8.554752310974164e-07, 'epoch': 2.58}

 16%|█▌        | 59820/371472 [4:45:44<22:49:41,  3.79it/s]
 16%|█▌        | 59821/371472 [4:45:45<22:55:24,  3.78it/s]
 16%|█▌        | 59822/371472 [4:45:45<22:46:27,  3.80it/s]
 16%|█▌        | 59823/371472 [4:45:45<22:56:55,  3.77it/s]
 16%|█▌        | 59824/371472 [4:45:46<23:26:02,  3.69it/s]
 16%|█▌        | 59825/371472 [4:45:46<22:54:18,  3.78it/s]
 16%|█▌        | 59826/371472 [4:45:46<22:50:42,  3.79it/s]
 16%|█▌        | 59827/371472 [4:45:46<23:26:07,  3.69it/s]
 16%|█▌        | 59828/371472 [4:45:47<23:17:49,  3.72it/s]
 16%|█▌        | 59829/371472 [4:45:47<22:56:42,  3.77it/s]
 16%|█▌        | 59830/371472 [4:45:47<23:52:26,  3.63it/s]
 16%|█▌        | 59831/371472 [4:45:47<23:58:28,  3.61it/s]
 16%|█▌        | 59832/371472 [4:45:48<23:33:52,  3.67it/s]
 16%|█▌        | 59833/371472 [4:45:48<23:55:31,  3.62it/s]
 16%|█▌        | 59834/371472 [4:45:48<24:47:24,  3.49it/s]
 16%|█▌        | 59835/371472 [4:45:49<24:34:11,  3.52it/s]
 16%|█▌        | 59836/371472 [4:45:49<25:58:47,  3.33it/s]
 16%|█▌        | 59837/371472 [4:45:49<27:33:31,  3.14it/s]
 16%|█▌        | 59838/371472 [4:45:50<28:16:21,  3.06it/s]
 16%|█▌        | 59839/371472 [4:45:50<26:52:13,  3.22it/s]
 16%|█▌        | 59840/371472 [4:45:50<26:35:15,  3.26it/s]
                                                           
{'loss': 4.1127, 'learning_rate': 8.554267491219375e-07, 'epoch': 2.58}

 16%|█▌        | 59840/371472 [4:45:50<26:35:15,  3.26it/s]
 16%|█▌        | 59841/371472 [4:45:50<25:37:12,  3.38it/s]
 16%|█▌        | 59842/371472 [4:45:51<24:43:40,  3.50it/s]
 16%|█▌        | 59843/371472 [4:45:51<24:19:53,  3.56it/s]
 16%|█▌        | 59844/371472 [4:45:51<23:56:37,  3.62it/s]
 16%|█▌        | 59845/371472 [4:45:52<24:04:11,  3.60it/s]
 16%|█▌        | 59846/371472 [4:45:52<23:16:50,  3.72it/s]
 16%|█▌        | 59847/371472 [4:45:52<23:54:05,  3.62it/s]
 16%|█▌        | 59848/371472 [4:45:52<25:05:15,  3.45it/s]
 16%|█▌        | 59849/371472 [4:45:53<24:29:48,  3.53it/s]
 16%|█▌        | 59850/371472 [4:45:53<23:49:28,  3.63it/s]
 16%|█▌        | 59851/371472 [4:45:53<23:27:54,  3.69it/s]
 16%|█▌        | 59852/371472 [4:45:53<22:40:54,  3.82it/s]
 16%|█▌        | 59853/371472 [4:45:54<22:50:06,  3.79it/s]
 16%|█▌        | 59854/371472 [4:45:54<23:04:39,  3.75it/s]
 16%|█▌        | 59855/371472 [4:45:54<22:33:48,  3.84it/s]
 16%|█▌        | 59856/371472 [4:45:55<25:28:08,  3.40it/s]
 16%|█▌        | 59857/371472 [4:45:55<24:47:16,  3.49it/s]
 16%|█▌        | 59858/371472 [4:45:55<24:01:14,  3.60it/s]
 16%|█▌        | 59859/371472 [4:45:55<24:40:41,  3.51it/s]
 16%|█▌        | 59860/371472 [4:45:56<23:50:51,  3.63it/s]
                                                           
{'loss': 4.0289, 'learning_rate': 8.553782671464586e-07, 'epoch': 2.58}

 16%|█▌        | 59860/371472 [4:45:56<23:50:51,  3.63it/s]
 16%|█▌        | 59861/371472 [4:45:56<24:33:53,  3.52it/s]
 16%|█▌        | 59862/371472 [4:45:56<24:15:57,  3.57it/s]
 16%|█▌        | 59863/371472 [4:45:57<23:31:12,  3.68it/s]
 16%|█▌        | 59864/371472 [4:45:57<23:34:52,  3.67it/s]
 16%|█▌        | 59865/371472 [4:45:57<24:55:27,  3.47it/s]
 16%|█▌        | 59866/371472 [4:45:57<24:05:19,  3.59it/s]
 16%|█▌        | 59867/371472 [4:45:58<24:42:55,  3.50it/s]
 16%|█▌        | 59868/371472 [4:45:58<26:21:50,  3.28it/s]
 16%|█▌        | 59869/371472 [4:45:58<26:10:35,  3.31it/s]
 16%|█▌        | 59870/371472 [4:45:59<25:49:27,  3.35it/s]
 16%|█▌        | 59871/371472 [4:45:59<25:53:55,  3.34it/s]
 16%|█▌        | 59872/371472 [4:45:59<26:24:22,  3.28it/s]
 16%|█▌        | 59873/371472 [4:46:00<27:02:05,  3.20it/s]
 16%|█▌        | 59874/371472 [4:46:00<26:48:57,  3.23it/s]
 16%|█▌        | 59875/371472 [4:46:00<26:23:39,  3.28it/s]
 16%|█▌        | 59876/371472 [4:46:01<28:27:56,  3.04it/s]
 16%|█▌        | 59877/371472 [4:46:01<26:18:56,  3.29it/s]
 16%|█▌        | 59878/371472 [4:46:01<27:00:43,  3.20it/s]
 16%|█▌        | 59879/371472 [4:46:01<27:14:54,  3.18it/s]
 16%|█▌        | 59880/371472 [4:46:02<28:16:14,  3.06it/s]
                                                           
{'loss': 4.1871, 'learning_rate': 8.553297851709797e-07, 'epoch': 2.58}

 16%|█▌        | 59880/371472 [4:46:02<28:16:14,  3.06it/s]
 16%|█▌        | 59881/371472 [4:46:02<27:27:36,  3.15it/s]
 16%|█▌        | 59882/371472 [4:46:02<26:03:33,  3.32it/s]
 16%|█▌        | 59883/371472 [4:46:03<24:43:57,  3.50it/s]
 16%|█▌        | 59884/371472 [4:46:03<24:22:35,  3.55it/s]
 16%|█▌        | 59885/371472 [4:46:03<26:16:40,  3.29it/s]
 16%|█▌        | 59886/371472 [4:46:03<25:01:09,  3.46it/s]
 16%|█▌        | 59887/371472 [4:46:04<25:04:06,  3.45it/s]
 16%|█▌        | 59888/371472 [4:46:04<25:36:26,  3.38it/s]
 16%|█▌        | 59889/371472 [4:46:04<24:46:18,  3.49it/s]
 16%|█▌        | 59890/371472 [4:46:05<29:59:01,  2.89it/s]
 16%|█▌        | 59891/371472 [4:46:05<28:09:39,  3.07it/s]
 16%|█▌        | 59892/371472 [4:46:05<27:00:48,  3.20it/s]
 16%|█▌        | 59893/371472 [4:46:06<26:35:36,  3.25it/s]
 16%|█▌        | 59894/371472 [4:46:06<25:08:26,  3.44it/s]
 16%|█▌        | 59895/371472 [4:46:06<23:43:51,  3.65it/s]
 16%|█▌        | 59896/371472 [4:46:06<23:10:50,  3.73it/s]
 16%|█▌        | 59897/371472 [4:46:07<22:43:49,  3.81it/s]
 16%|█▌        | 59898/371472 [4:46:07<22:42:10,  3.81it/s]
 16%|█▌        | 59899/371472 [4:46:07<25:55:13,  3.34it/s]
 16%|█▌        | 59900/371472 [4:46:08<24:41:38,  3.50it/s]
                                                           
{'loss': 4.2729, 'learning_rate': 8.552813031955009e-07, 'epoch': 2.58}

 16%|█▌        | 59900/371472 [4:46:08<24:41:38,  3.50it/s]
 16%|█▌        | 59901/371472 [4:46:08<23:39:28,  3.66it/s]
 16%|█▌        | 59902/371472 [4:46:08<24:05:08,  3.59it/s]
 16%|█▌        | 59903/371472 [4:46:08<25:01:01,  3.46it/s]
 16%|█▌        | 59904/371472 [4:46:09<24:00:20,  3.61it/s]
 16%|█▌        | 59905/371472 [4:46:09<25:57:19,  3.33it/s]
 16%|█▌        | 59906/371472 [4:46:09<25:03:09,  3.45it/s]
 16%|█▌        | 59907/371472 [4:46:10<24:42:55,  3.50it/s]
 16%|█▌        | 59908/371472 [4:46:10<24:06:22,  3.59it/s]
 16%|█▌        | 59909/371472 [4:46:10<24:25:27,  3.54it/s]
 16%|█▌        | 59910/371472 [4:46:10<24:25:18,  3.54it/s]
 16%|█▌        | 59911/371472 [4:46:11<24:28:26,  3.54it/s]
 16%|█▌        | 59912/371472 [4:46:11<25:31:00,  3.39it/s]
 16%|█▌        | 59913/371472 [4:46:11<24:49:07,  3.49it/s]
 16%|█▌        | 59914/371472 [4:46:12<24:15:38,  3.57it/s]
 16%|█▌        | 59915/371472 [4:46:12<25:02:11,  3.46it/s]
 16%|█▌        | 59916/371472 [4:46:12<24:33:02,  3.53it/s]
 16%|█▌        | 59917/371472 [4:46:12<24:05:33,  3.59it/s]
 16%|█▌        | 59918/371472 [4:46:13<25:46:48,  3.36it/s]
 16%|█▌        | 59919/371472 [4:46:13<25:38:55,  3.37it/s]
 16%|█▌        | 59920/371472 [4:46:13<25:53:35,  3.34it/s]
                                                           
{'loss': 4.1083, 'learning_rate': 8.55232821220022e-07, 'epoch': 2.58}

 16%|█▌        | 59920/371472 [4:46:13<25:53:35,  3.34it/s]
 16%|█▌        | 59921/371472 [4:46:14<24:20:22,  3.56it/s]
 16%|█▌        | 59922/371472 [4:46:14<24:00:56,  3.60it/s]
 16%|█▌        | 59923/371472 [4:46:14<23:26:16,  3.69it/s]
 16%|█▌        | 59924/371472 [4:46:14<23:49:33,  3.63it/s]
 16%|█▌        | 59925/371472 [4:46:15<24:49:50,  3.49it/s]
 16%|█▌        | 59926/371472 [4:46:15<24:02:22,  3.60it/s]
 16%|█▌        | 59927/371472 [4:46:15<23:15:35,  3.72it/s]
 16%|█▌        | 59928/371472 [4:46:16<24:24:10,  3.55it/s]
 16%|█▌        | 59929/371472 [4:46:16<24:27:42,  3.54it/s]
 16%|█▌        | 59930/371472 [4:46:16<28:00:10,  3.09it/s]
 16%|█▌        | 59931/371472 [4:46:16<26:58:33,  3.21it/s]
 16%|█▌        | 59932/371472 [4:46:17<26:47:04,  3.23it/s]
 16%|█▌        | 59933/371472 [4:46:17<24:52:47,  3.48it/s]
 16%|█▌        | 59934/371472 [4:46:17<24:04:59,  3.59it/s]
 16%|█▌        | 59935/371472 [4:46:18<23:25:01,  3.70it/s]
 16%|█▌        | 59936/371472 [4:46:18<23:05:30,  3.75it/s]
 16%|█▌        | 59937/371472 [4:46:18<24:24:15,  3.55it/s]
 16%|█▌        | 59938/371472 [4:46:18<24:12:39,  3.57it/s]
 16%|█▌        | 59939/371472 [4:46:19<24:08:29,  3.58it/s]
 16%|█▌        | 59940/371472 [4:46:19<23:18:24,  3.71it/s]
                                                           
{'loss': 4.0924, 'learning_rate': 8.55184339244543e-07, 'epoch': 2.58}

 16%|█▌        | 59940/371472 [4:46:19<23:18:24,  3.71it/s]
 16%|█▌        | 59941/371472 [4:46:19<23:08:37,  3.74it/s]
 16%|█▌        | 59942/371472 [4:46:19<22:47:28,  3.80it/s]
 16%|█▌        | 59943/371472 [4:46:20<24:05:48,  3.59it/s]
 16%|█▌        | 59944/371472 [4:46:20<23:58:11,  3.61it/s]
 16%|█▌        | 59945/371472 [4:46:20<25:08:30,  3.44it/s]
 16%|█▌        | 59946/371472 [4:46:21<25:06:02,  3.45it/s]
 16%|█▌        | 59947/371472 [4:46:21<24:40:01,  3.51it/s]
 16%|█▌        | 59948/371472 [4:46:21<24:55:15,  3.47it/s]
 16%|█▌        | 59949/371472 [4:46:22<26:01:38,  3.32it/s]
 16%|█▌        | 59950/371472 [4:46:22<25:47:23,  3.36it/s]
 16%|█▌        | 59951/371472 [4:46:22<25:33:18,  3.39it/s]
 16%|█▌        | 59952/371472 [4:46:22<24:52:03,  3.48it/s]
 16%|█▌        | 59953/371472 [4:46:23<24:31:46,  3.53it/s]
 16%|█▌        | 59954/371472 [4:46:23<24:22:55,  3.55it/s]
 16%|█▌        | 59955/371472 [4:46:23<23:53:52,  3.62it/s]
 16%|█▌        | 59956/371472 [4:46:24<25:19:52,  3.42it/s]
 16%|█▌        | 59957/371472 [4:46:24<24:47:52,  3.49it/s]
 16%|█▌        | 59958/371472 [4:46:24<26:54:47,  3.22it/s]
 16%|█▌        | 59959/371472 [4:46:24<25:50:26,  3.35it/s]
 16%|█▌        | 59960/371472 [4:46:25<25:41:12,  3.37it/s]
                                                           
{'loss': 4.134, 'learning_rate': 8.55135857269064e-07, 'epoch': 2.58}

 16%|█▌        | 59960/371472 [4:46:25<25:41:12,  3.37it/s]
 16%|█▌        | 59961/371472 [4:46:25<25:04:19,  3.45it/s]
 16%|█▌        | 59962/371472 [4:46:25<24:09:41,  3.58it/s]
 16%|█▌        | 59963/371472 [4:46:26<26:00:04,  3.33it/s]
 16%|█▌        | 59964/371472 [4:46:26<24:35:43,  3.52it/s]
 16%|█▌        | 59965/371472 [4:46:26<24:18:43,  3.56it/s]
 16%|█▌        | 59966/371472 [4:46:27<26:41:49,  3.24it/s]
 16%|█▌        | 59967/371472 [4:46:27<25:38:25,  3.37it/s]
 16%|█▌        | 59968/371472 [4:46:27<26:02:36,  3.32it/s]
 16%|█▌        | 59969/371472 [4:46:27<26:13:21,  3.30it/s]
 16%|█▌        | 59970/371472 [4:46:28<26:04:40,  3.32it/s]
 16%|█▌        | 59971/371472 [4:46:28<27:02:00,  3.20it/s]
 16%|█▌        | 59972/371472 [4:46:28<26:04:40,  3.32it/s]
 16%|█▌        | 59973/371472 [4:46:29<26:00:59,  3.33it/s]
 16%|█▌        | 59974/371472 [4:46:29<26:34:45,  3.26it/s]
 16%|█▌        | 59975/371472 [4:46:29<24:59:02,  3.46it/s]
 16%|█▌        | 59976/371472 [4:46:29<24:13:22,  3.57it/s]
 16%|█▌        | 59977/371472 [4:46:30<23:38:44,  3.66it/s]
 16%|█▌        | 59978/371472 [4:46:30<23:54:06,  3.62it/s]
 16%|█▌        | 59979/371472 [4:46:30<27:27:22,  3.15it/s]
 16%|█▌        | 59980/371472 [4:46:31<29:12:36,  2.96it/s]
                                                           
{'loss': 4.1005, 'learning_rate': 8.550873752935852e-07, 'epoch': 2.58}

 16%|█▌        | 59980/371472 [4:46:31<29:12:36,  2.96it/s]
 16%|█▌        | 59981/371472 [4:46:31<27:09:49,  3.19it/s]
 16%|█▌        | 59982/371472 [4:46:31<26:31:04,  3.26it/s]
 16%|█▌        | 59983/371472 [4:46:32<25:35:50,  3.38it/s]
 16%|█▌        | 59984/371472 [4:46:32<24:21:59,  3.55it/s]
 16%|█▌        | 59985/371472 [4:46:32<23:50:44,  3.63it/s]
 16%|█▌        | 59986/371472 [4:46:32<23:45:42,  3.64it/s]
 16%|█▌        | 59987/371472 [4:46:33<24:03:26,  3.60it/s]
 16%|█▌        | 59988/371472 [4:46:33<24:26:21,  3.54it/s]
 16%|█▌        | 59989/371472 [4:46:33<23:25:28,  3.69it/s]
 16%|█▌        | 59990/371472 [4:46:33<23:52:54,  3.62it/s]
 16%|█▌        | 59991/371472 [4:46:34<23:25:50,  3.69it/s]
 16%|█▌        | 59992/371472 [4:46:34<24:21:46,  3.55it/s]
 16%|█▌        | 59993/371472 [4:46:34<25:28:38,  3.40it/s]
 16%|█▌        | 59994/371472 [4:46:35<25:11:47,  3.43it/s]
 16%|█▌        | 59995/371472 [4:46:35<23:46:42,  3.64it/s]
 16%|█▌        | 59996/371472 [4:46:35<24:31:47,  3.53it/s]
 16%|█▌        | 59997/371472 [4:46:36<25:30:51,  3.39it/s]
 16%|█▌        | 59998/371472 [4:46:36<25:54:07,  3.34it/s]
 16%|█▌        | 59999/371472 [4:46:36<25:00:01,  3.46it/s]
 16%|█▌        | 60000/371472 [4:46:36<24:03:37,  3.60it/s]
                                                           
{'loss': 4.0589, 'learning_rate': 8.550388933181064e-07, 'epoch': 2.58}

 16%|█▌        | 60000/371472 [4:46:36<24:03:37,  3.60it/s]
 16%|█▌        | 60001/371472 [4:46:37<23:30:49,  3.68it/s]
 16%|█▌        | 60002/371472 [4:46:37<25:30:40,  3.39it/s]
 16%|█▌        | 60003/371472 [4:46:37<25:15:21,  3.43it/s]
 16%|█▌        | 60004/371472 [4:46:37<23:47:59,  3.64it/s]
 16%|█▌        | 60005/371472 [4:46:38<23:11:53,  3.73it/s]
 16%|█▌        | 60006/371472 [4:46:38<24:50:22,  3.48it/s]
 16%|█▌        | 60007/371472 [4:46:38<25:51:36,  3.35it/s]
 16%|█▌        | 60008/371472 [4:46:39<24:41:15,  3.50it/s]
 16%|█▌        | 60009/371472 [4:46:39<23:30:44,  3.68it/s]
 16%|█▌        | 60010/371472 [4:46:39<25:05:49,  3.45it/s]
 16%|█▌        | 60011/371472 [4:46:39<24:45:40,  3.49it/s]
 16%|█▌        | 60012/371472 [4:46:40<23:51:54,  3.63it/s]
 16%|█▌        | 60013/371472 [4:46:40<23:32:15,  3.68it/s]
 16%|█▌        | 60014/371472 [4:46:40<22:54:11,  3.78it/s]
 16%|█▌        | 60015/371472 [4:46:41<23:17:42,  3.71it/s]
 16%|█▌        | 60016/371472 [4:46:41<22:29:41,  3.85it/s]
 16%|█▌        | 60017/371472 [4:46:41<22:18:36,  3.88it/s]
 16%|█▌        | 60018/371472 [4:46:41<21:39:39,  3.99it/s]
 16%|█▌        | 60019/371472 [4:46:42<22:19:39,  3.87it/s]
 16%|█▌        | 60020/371472 [4:46:42<21:51:55,  3.96it/s]
                                                           
{'loss': 4.3462, 'learning_rate': 8.549904113426275e-07, 'epoch': 2.59}

 16%|█▌        | 60020/371472 [4:46:42<21:51:55,  3.96it/s]
 16%|█▌        | 60021/371472 [4:46:42<23:36:01,  3.67it/s]
 16%|█▌        | 60022/371472 [4:46:42<23:54:04,  3.62it/s]
 16%|█▌        | 60023/371472 [4:46:43<23:10:34,  3.73it/s]
 16%|█▌        | 60024/371472 [4:46:43<22:26:53,  3.85it/s]
 16%|█▌        | 60025/371472 [4:46:43<23:17:37,  3.71it/s]
 16%|█▌        | 60026/371472 [4:46:43<23:43:04,  3.65it/s]
 16%|█▌        | 60027/371472 [4:46:44<25:43:58,  3.36it/s]
 16%|█▌        | 60028/371472 [4:46:44<24:53:21,  3.48it/s]
 16%|█▌        | 60029/371472 [4:46:44<25:50:36,  3.35it/s]
 16%|█▌        | 60030/371472 [4:46:45<25:10:25,  3.44it/s]
 16%|█▌        | 60031/371472 [4:46:45<23:54:44,  3.62it/s]
 16%|█▌        | 60032/371472 [4:46:45<26:27:18,  3.27it/s]
 16%|█▌        | 60033/371472 [4:46:46<25:07:29,  3.44it/s]
 16%|█▌        | 60034/371472 [4:46:46<24:31:12,  3.53it/s]
 16%|█▌        | 60035/371472 [4:46:46<24:42:42,  3.50it/s]
 16%|█▌        | 60036/371472 [4:46:46<23:47:36,  3.64it/s]
 16%|█▌        | 60037/371472 [4:46:47<22:50:17,  3.79it/s]
 16%|█▌        | 60038/371472 [4:46:47<24:44:15,  3.50it/s]
 16%|█▌        | 60039/371472 [4:46:47<28:06:49,  3.08it/s]
 16%|█▌        | 60040/371472 [4:46:48<27:29:18,  3.15it/s]
                                                           
{'loss': 4.1581, 'learning_rate': 8.549419293671486e-07, 'epoch': 2.59}

 16%|█▌        | 60040/371472 [4:46:48<27:29:18,  3.15it/s]
 16%|█▌        | 60041/371472 [4:46:48<25:40:48,  3.37it/s]
 16%|█▌        | 60042/371472 [4:46:48<24:39:41,  3.51it/s]
 16%|█▌        | 60043/371472 [4:46:48<26:13:49,  3.30it/s]
 16%|█▌        | 60044/371472 [4:46:49<26:29:50,  3.26it/s]
 16%|█▌        | 60045/371472 [4:46:49<26:22:51,  3.28it/s]
 16%|█▌        | 60046/371472 [4:46:49<25:09:24,  3.44it/s]
 16%|█▌        | 60047/371472 [4:46:50<24:11:51,  3.57it/s]
 16%|█▌        | 60048/371472 [4:46:50<23:13:34,  3.72it/s]
 16%|█▌        | 60049/371472 [4:46:50<24:16:19,  3.56it/s]
 16%|█▌        | 60050/371472 [4:46:50<24:12:44,  3.57it/s]
 16%|█▌        | 60051/371472 [4:46:51<24:35:11,  3.52it/s]
 16%|█▌        | 60052/371472 [4:46:51<24:50:17,  3.48it/s]
 16%|█▌        | 60053/371472 [4:46:51<28:18:28,  3.06it/s]
 16%|█▌        | 60054/371472 [4:46:52<27:07:57,  3.19it/s]
 16%|█▌        | 60055/371472 [4:46:52<27:51:03,  3.11it/s]
 16%|█▌        | 60056/371472 [4:46:52<26:23:15,  3.28it/s]
 16%|█▌        | 60057/371472 [4:46:53<24:39:22,  3.51it/s]
 16%|█▌        | 60058/371472 [4:46:53<23:59:35,  3.61it/s]
 16%|█▌        | 60059/371472 [4:46:53<24:33:27,  3.52it/s]
 16%|█▌        | 60060/371472 [4:46:53<24:06:25,  3.59it/s]
                                                           
{'loss': 4.3692, 'learning_rate': 8.548934473916696e-07, 'epoch': 2.59}

 16%|█▌        | 60060/371472 [4:46:53<24:06:25,  3.59it/s]
 16%|█▌        | 60061/371472 [4:46:54<23:29:49,  3.68it/s]
 16%|█▌        | 60062/371472 [4:46:54<24:13:02,  3.57it/s]
 16%|█▌        | 60063/371472 [4:46:54<24:18:54,  3.56it/s]
 16%|█▌        | 60064/371472 [4:46:55<25:24:01,  3.41it/s]
 16%|█▌        | 60065/371472 [4:46:55<25:33:31,  3.38it/s]
 16%|█▌        | 60066/371472 [4:46:55<25:02:45,  3.45it/s]
 16%|█▌        | 60067/371472 [4:46:55<25:50:01,  3.35it/s]
 16%|█▌        | 60068/371472 [4:46:56<28:55:30,  2.99it/s]
 16%|█▌        | 60069/371472 [4:46:56<27:09:04,  3.19it/s]
 16%|█▌        | 60070/371472 [4:46:56<25:47:41,  3.35it/s]
 16%|█▌        | 60071/371472 [4:46:57<24:36:23,  3.52it/s]
 16%|█▌        | 60072/371472 [4:46:57<24:34:53,  3.52it/s]
 16%|█▌        | 60073/371472 [4:46:57<24:02:03,  3.60it/s]
 16%|█▌        | 60074/371472 [4:46:57<23:12:40,  3.73it/s]
 16%|█▌        | 60075/371472 [4:46:58<22:46:18,  3.80it/s]
 16%|█▌        | 60076/371472 [4:46:58<22:48:44,  3.79it/s]
 16%|█▌        | 60077/371472 [4:46:58<24:26:06,  3.54it/s]
 16%|█▌        | 60078/371472 [4:46:59<25:48:31,  3.35it/s]
 16%|█▌        | 60079/371472 [4:46:59<26:21:07,  3.28it/s]
 16%|█▌        | 60080/371472 [4:46:59<26:16:58,  3.29it/s]
                                                           
{'loss': 4.0618, 'learning_rate': 8.548449654161908e-07, 'epoch': 2.59}

 16%|█▌        | 60080/371472 [4:46:59<26:16:58,  3.29it/s]
 16%|█▌        | 60081/371472 [4:46:59<25:05:44,  3.45it/s]
 16%|█▌        | 60082/371472 [4:47:00<24:46:50,  3.49it/s]
 16%|█▌        | 60083/371472 [4:47:00<24:06:18,  3.59it/s]
 16%|█▌        | 60084/371472 [4:47:00<23:09:56,  3.73it/s]
 16%|█▌        | 60085/371472 [4:47:01<23:40:59,  3.65it/s]
 16%|█▌        | 60086/371472 [4:47:01<24:10:26,  3.58it/s]
 16%|█▌        | 60087/371472 [4:47:01<24:31:26,  3.53it/s]
 16%|█▌        | 60088/371472 [4:47:01<25:39:42,  3.37it/s]
 16%|█▌        | 60089/371472 [4:47:02<27:32:14,  3.14it/s]
 16%|█▌        | 60090/371472 [4:47:02<25:58:48,  3.33it/s]
 16%|█▌        | 60091/371472 [4:47:02<25:30:23,  3.39it/s]
 16%|█▌        | 60092/371472 [4:47:03<25:23:10,  3.41it/s]
 16%|█▌        | 60093/371472 [4:47:03<25:24:43,  3.40it/s]
 16%|█▌        | 60094/371472 [4:47:03<27:05:50,  3.19it/s]
 16%|█▌        | 60095/371472 [4:47:04<26:29:29,  3.26it/s]
 16%|█▌        | 60096/371472 [4:47:04<25:48:49,  3.35it/s]
 16%|█▌        | 60097/371472 [4:47:04<24:27:31,  3.54it/s]
 16%|█▌        | 60098/371472 [4:47:04<24:03:49,  3.59it/s]
 16%|█▌        | 60099/371472 [4:47:05<23:12:28,  3.73it/s]
 16%|█▌        | 60100/371472 [4:47:05<23:31:22,  3.68it/s]
                                                           
{'loss': 4.3576, 'learning_rate': 8.547964834407119e-07, 'epoch': 2.59}

 16%|█▌        | 60100/371472 [4:47:05<23:31:22,  3.68it/s]
 16%|█▌        | 60101/371472 [4:47:05<22:44:50,  3.80it/s]
 16%|█▌        | 60102/371472 [4:47:05<22:57:24,  3.77it/s]
 16%|█▌        | 60103/371472 [4:47:06<22:37:29,  3.82it/s]
 16%|█▌        | 60104/371472 [4:47:06<22:49:30,  3.79it/s]
 16%|█▌        | 60105/371472 [4:47:06<23:40:12,  3.65it/s]
 16%|█▌        | 60106/371472 [4:47:07<23:11:56,  3.73it/s]
 16%|█▌        | 60107/371472 [4:47:07<24:59:01,  3.46it/s]
 16%|█▌        | 60108/371472 [4:47:07<24:11:13,  3.58it/s]
 16%|█▌        | 60109/371472 [4:47:07<23:46:58,  3.64it/s]
 16%|█▌        | 60110/371472 [4:47:08<25:18:01,  3.42it/s]
 16%|█▌        | 60111/371472 [4:47:08<24:21:22,  3.55it/s]
 16%|█▌        | 60112/371472 [4:47:08<25:28:30,  3.40it/s]
 16%|█▌        | 60113/371472 [4:47:09<25:13:49,  3.43it/s]
 16%|█▌        | 60114/371472 [4:47:09<26:57:30,  3.21it/s]
 16%|█▌        | 60115/371472 [4:47:09<25:53:05,  3.34it/s]
 16%|█▌        | 60116/371472 [4:47:10<25:51:28,  3.34it/s]
 16%|█▌        | 60117/371472 [4:47:10<24:47:24,  3.49it/s]
 16%|█▌        | 60118/371472 [4:47:10<25:07:52,  3.44it/s]
 16%|█▌        | 60119/371472 [4:47:10<24:38:00,  3.51it/s]
 16%|█▌        | 60120/371472 [4:47:11<24:29:10,  3.53it/s]
                                                           
{'loss': 4.3794, 'learning_rate': 8.54748001465233e-07, 'epoch': 2.59}

 16%|█▌        | 60120/371472 [4:47:11<24:29:10,  3.53it/s]
 16%|█▌        | 60121/371472 [4:47:11<25:21:12,  3.41it/s]
 16%|█▌        | 60122/371472 [4:47:11<27:19:50,  3.16it/s]
 16%|█▌        | 60123/371472 [4:47:12<25:30:07,  3.39it/s]
 16%|█▌        | 60124/371472 [4:47:12<25:34:46,  3.38it/s]
 16%|█▌        | 60125/371472 [4:47:12<25:15:28,  3.42it/s]
 16%|█▌        | 60126/371472 [4:47:12<23:43:38,  3.64it/s]
 16%|█▌        | 60127/371472 [4:47:13<25:34:32,  3.38it/s]
 16%|█▌        | 60128/371472 [4:47:13<25:25:36,  3.40it/s]
 16%|█▌        | 60129/371472 [4:47:13<25:49:28,  3.35it/s]
 16%|█▌        | 60130/371472 [4:47:14<24:30:19,  3.53it/s]
 16%|█▌        | 60131/371472 [4:47:14<24:01:25,  3.60it/s]
 16%|█▌        | 60132/371472 [4:47:14<23:19:00,  3.71it/s]
 16%|█▌        | 60133/371472 [4:47:14<22:48:23,  3.79it/s]
 16%|█▌        | 60134/371472 [4:47:15<23:23:42,  3.70it/s]
 16%|█▌        | 60135/371472 [4:47:15<23:43:29,  3.65it/s]
 16%|█▌        | 60136/371472 [4:47:15<23:38:22,  3.66it/s]
 16%|█▌        | 60137/371472 [4:47:15<23:25:29,  3.69it/s]
 16%|█▌        | 60138/371472 [4:47:16<24:35:30,  3.52it/s]
 16%|█▌        | 60139/371472 [4:47:16<24:59:20,  3.46it/s]
 16%|█▌        | 60140/371472 [4:47:16<26:29:19,  3.26it/s]
                                                           
{'loss': 4.1958, 'learning_rate': 8.546995194897541e-07, 'epoch': 2.59}

 16%|█▌        | 60140/371472 [4:47:16<26:29:19,  3.26it/s]
 16%|█▌        | 60141/371472 [4:47:17<25:32:29,  3.39it/s]
 16%|█▌        | 60142/371472 [4:47:17<24:49:59,  3.48it/s]
 16%|█▌        | 60143/371472 [4:47:17<26:00:48,  3.32it/s]
 16%|█▌        | 60144/371472 [4:47:18<24:31:01,  3.53it/s]
 16%|█▌        | 60145/371472 [4:47:18<23:36:43,  3.66it/s]
 16%|█▌        | 60146/371472 [4:47:18<23:34:51,  3.67it/s]
 16%|█▌        | 60147/371472 [4:47:18<23:48:46,  3.63it/s]
 16%|█▌        | 60148/371472 [4:47:19<24:52:52,  3.48it/s]
 16%|█▌        | 60149/371472 [4:47:19<24:56:00,  3.47it/s]
 16%|█▌        | 60150/371472 [4:47:19<24:57:08,  3.47it/s]
 16%|█▌        | 60151/371472 [4:47:19<24:20:23,  3.55it/s]
 16%|█▌        | 60152/371472 [4:47:20<24:26:56,  3.54it/s]
 16%|█▌        | 60153/371472 [4:47:20<24:30:56,  3.53it/s]
 16%|█▌        | 60154/371472 [4:47:20<24:45:11,  3.49it/s]
 16%|█▌        | 60155/371472 [4:47:21<23:41:54,  3.65it/s]
 16%|█▌        | 60156/371472 [4:47:21<23:14:05,  3.72it/s]
 16%|█▌        | 60157/371472 [4:47:21<23:41:17,  3.65it/s]
 16%|█▌        | 60158/371472 [4:47:21<23:22:45,  3.70it/s]
 16%|█▌        | 60159/371472 [4:47:22<22:41:48,  3.81it/s]
 16%|█▌        | 60160/371472 [4:47:22<22:32:15,  3.84it/s]
                                                           
{'loss': 4.2342, 'learning_rate': 8.546510375142752e-07, 'epoch': 2.59}

 16%|█▌        | 60160/371472 [4:47:22<22:32:15,  3.84it/s]
 16%|█▌        | 60161/371472 [4:47:22<22:23:48,  3.86it/s]
 16%|█▌        | 60162/371472 [4:47:22<22:46:56,  3.80it/s]
 16%|█▌        | 60163/371472 [4:47:23<22:58:27,  3.76it/s]
 16%|█▌        | 60164/371472 [4:47:23<23:52:00,  3.62it/s]
 16%|█▌        | 60165/371472 [4:47:23<24:59:33,  3.46it/s]
 16%|█▌        | 60166/371472 [4:47:24<25:18:38,  3.42it/s]
 16%|█▌        | 60167/371472 [4:47:24<25:10:17,  3.44it/s]
 16%|█▌        | 60168/371472 [4:47:24<25:30:10,  3.39it/s]
 16%|█▌        | 60169/371472 [4:47:24<24:08:59,  3.58it/s]
 16%|█▌        | 60170/371472 [4:47:25<24:38:20,  3.51it/s]
 16%|█▌        | 60171/371472 [4:47:25<24:23:59,  3.54it/s]
 16%|█▌        | 60172/371472 [4:47:25<24:25:02,  3.54it/s]
 16%|█▌        | 60173/371472 [4:47:26<25:01:27,  3.46it/s]
 16%|█▌        | 60174/371472 [4:47:26<23:58:26,  3.61it/s]
 16%|█▌        | 60175/371472 [4:47:26<24:27:25,  3.54it/s]
 16%|█▌        | 60176/371472 [4:47:26<25:15:00,  3.42it/s]
 16%|█▌        | 60177/371472 [4:47:27<24:10:19,  3.58it/s]
 16%|█▌        | 60178/371472 [4:47:27<23:50:32,  3.63it/s]
 16%|█▌        | 60179/371472 [4:47:27<23:26:24,  3.69it/s]
 16%|█▌        | 60180/371472 [4:47:28<23:25:17,  3.69it/s]
                                                           
{'loss': 4.2702, 'learning_rate': 8.546025555387964e-07, 'epoch': 2.59}

 16%|█▌        | 60180/371472 [4:47:28<23:25:17,  3.69it/s]
 16%|█▌        | 60181/371472 [4:47:28<24:32:16,  3.52it/s]
 16%|█▌        | 60182/371472 [4:47:28<23:35:28,  3.67it/s]
 16%|█▌        | 60183/371472 [4:47:28<23:47:11,  3.64it/s]
 16%|█▌        | 60184/371472 [4:47:29<23:38:36,  3.66it/s]
 16%|█▌        | 60185/371472 [4:47:29<23:30:59,  3.68it/s]
 16%|█▌        | 60186/371472 [4:47:29<24:52:14,  3.48it/s]
 16%|█▌        | 60187/371472 [4:47:30<25:03:03,  3.45it/s]
 16%|█▌        | 60188/371472 [4:47:30<24:45:11,  3.49it/s]
 16%|█▌        | 60189/371472 [4:47:30<24:29:53,  3.53it/s]
 16%|█▌        | 60190/371472 [4:47:30<25:25:17,  3.40it/s]
 16%|█▌        | 60191/371472 [4:47:31<23:59:57,  3.60it/s]
 16%|█▌        | 60192/371472 [4:47:31<23:11:27,  3.73it/s]
 16%|█▌        | 60193/371472 [4:47:31<24:37:17,  3.51it/s]
 16%|█▌        | 60194/371472 [4:47:32<25:50:37,  3.35it/s]
 16%|█▌        | 60195/371472 [4:47:32<26:56:54,  3.21it/s]
 16%|█▌        | 60196/371472 [4:47:32<27:03:39,  3.20it/s]
 16%|█▌        | 60197/371472 [4:47:32<25:34:46,  3.38it/s]
 16%|█▌        | 60198/371472 [4:47:33<25:24:41,  3.40it/s]
 16%|█▌        | 60199/371472 [4:47:33<25:46:54,  3.35it/s]
 16%|█▌        | 60200/371472 [4:47:33<25:12:06,  3.43it/s]
                                                           
{'loss': 4.0517, 'learning_rate': 8.545540735633173e-07, 'epoch': 2.59}

 16%|█▌        | 60200/371472 [4:47:33<25:12:06,  3.43it/s]
 16%|█▌        | 60201/371472 [4:47:34<24:09:23,  3.58it/s]
 16%|█▌        | 60202/371472 [4:47:34<25:55:56,  3.33it/s]
 16%|█▌        | 60203/371472 [4:47:34<24:53:05,  3.47it/s]
 16%|█▌        | 60204/371472 [4:47:34<24:10:01,  3.58it/s]
 16%|█▌        | 60205/371472 [4:47:35<23:15:23,  3.72it/s]
 16%|█▌        | 60206/371472 [4:47:35<23:32:58,  3.67it/s]
 16%|█▌        | 60207/371472 [4:47:35<23:36:25,  3.66it/s]
 16%|█▌        | 60208/371472 [4:47:35<23:27:59,  3.68it/s]
 16%|█▌        | 60209/371472 [4:47:36<23:45:29,  3.64it/s]
 16%|█▌        | 60210/371472 [4:47:36<22:51:03,  3.78it/s]
 16%|█▌        | 60211/371472 [4:47:36<23:04:58,  3.75it/s]
 16%|█▌        | 60212/371472 [4:47:37<22:38:54,  3.82it/s]
 16%|█▌        | 60213/371472 [4:47:37<22:18:20,  3.88it/s]
 16%|█▌        | 60214/371472 [4:47:37<23:00:07,  3.76it/s]
 16%|█▌        | 60215/371472 [4:47:37<22:41:01,  3.81it/s]
 16%|█▌        | 60216/371472 [4:47:38<25:16:17,  3.42it/s]
 16%|█▌        | 60217/371472 [4:47:38<24:03:27,  3.59it/s]
 16%|█▌        | 60218/371472 [4:47:38<24:17:40,  3.56it/s]
 16%|█▌        | 60219/371472 [4:47:38<24:07:38,  3.58it/s]
 16%|█▌        | 60220/371472 [4:47:39<23:52:14,  3.62it/s]
                                                           
{'loss': 4.1766, 'learning_rate': 8.545055915878385e-07, 'epoch': 2.59}

 16%|█▌        | 60220/371472 [4:47:39<23:52:14,  3.62it/s]
 16%|█▌        | 60221/371472 [4:47:39<24:16:28,  3.56it/s]
 16%|█▌        | 60222/371472 [4:47:39<24:54:19,  3.47it/s]
 16%|█▌        | 60223/371472 [4:47:40<25:12:25,  3.43it/s]
 16%|█▌        | 60224/371472 [4:47:40<23:59:59,  3.60it/s]
 16%|█▌        | 60225/371472 [4:47:40<24:14:54,  3.57it/s]
 16%|█▌        | 60226/371472 [4:47:40<24:01:17,  3.60it/s]
 16%|█▌        | 60227/371472 [4:47:41<23:21:59,  3.70it/s]
 16%|█▌        | 60228/371472 [4:47:41<23:58:22,  3.61it/s]
 16%|█▌        | 60229/371472 [4:47:41<26:12:11,  3.30it/s]
 16%|█▌        | 60230/371472 [4:47:42<25:20:21,  3.41it/s]
 16%|█▌        | 60231/371472 [4:47:42<25:21:46,  3.41it/s]
 16%|█▌        | 60232/371472 [4:47:42<25:15:12,  3.42it/s]
 16%|█▌        | 60233/371472 [4:47:42<24:21:27,  3.55it/s]
 16%|█▌        | 60234/371472 [4:47:43<24:01:34,  3.60it/s]
 16%|█▌        | 60235/371472 [4:47:43<24:13:59,  3.57it/s]
 16%|█▌        | 60236/371472 [4:47:43<25:52:43,  3.34it/s]
 16%|█▌        | 60237/371472 [4:47:44<24:49:28,  3.48it/s]
 16%|█▌        | 60238/371472 [4:47:44<26:39:55,  3.24it/s]
 16%|█▌        | 60239/371472 [4:47:44<25:30:39,  3.39it/s]
 16%|█▌        | 60240/371472 [4:47:45<25:03:34,  3.45it/s]
                                                           
{'loss': 4.0639, 'learning_rate': 8.544571096123596e-07, 'epoch': 2.59}

 16%|█▌        | 60240/371472 [4:47:45<25:03:34,  3.45it/s]
 16%|█▌        | 60241/371472 [4:47:45<24:41:42,  3.50it/s]
 16%|█▌        | 60242/371472 [4:47:45<24:57:47,  3.46it/s]
 16%|█▌        | 60243/371472 [4:47:45<25:16:22,  3.42it/s]
 16%|█▌        | 60244/371472 [4:47:46<25:35:39,  3.38it/s]
 16%|█▌        | 60245/371472 [4:47:46<24:57:14,  3.46it/s]
 16%|█▌        | 60246/371472 [4:47:46<27:56:54,  3.09it/s]
 16%|█▌        | 60247/371472 [4:47:47<26:04:36,  3.32it/s]
 16%|█▌        | 60248/371472 [4:47:47<25:43:59,  3.36it/s]
 16%|█▌        | 60249/371472 [4:47:47<24:21:02,  3.55it/s]
 16%|█▌        | 60250/371472 [4:47:47<24:04:09,  3.59it/s]
 16%|█▌        | 60251/371472 [4:47:48<25:28:27,  3.39it/s]
 16%|█▌        | 60252/371472 [4:47:48<26:02:11,  3.32it/s]
 16%|█▌        | 60253/371472 [4:47:48<25:20:50,  3.41it/s]
 16%|█▌        | 60254/371472 [4:47:49<25:34:18,  3.38it/s]
 16%|█▌        | 60255/371472 [4:47:49<25:19:30,  3.41it/s]
 16%|█▌        | 60256/371472 [4:47:49<24:46:59,  3.49it/s]
 16%|█▌        | 60257/371472 [4:47:50<25:49:33,  3.35it/s]
 16%|█▌        | 60258/371472 [4:47:50<26:01:27,  3.32it/s]
 16%|█▌        | 60259/371472 [4:47:50<25:16:53,  3.42it/s]
 16%|█▌        | 60260/371472 [4:47:50<24:54:33,  3.47it/s]
                                                           
{'loss': 4.3518, 'learning_rate': 8.544086276368808e-07, 'epoch': 2.6}

 16%|█▌        | 60260/371472 [4:47:50<24:54:33,  3.47it/s]
 16%|█▌        | 60261/371472 [4:47:51<23:54:00,  3.62it/s]
 16%|█▌        | 60262/371472 [4:47:51<24:19:30,  3.55it/s]
 16%|█▌        | 60263/371472 [4:47:51<24:17:46,  3.56it/s]
 16%|█▌        | 60264/371472 [4:47:51<23:42:01,  3.65it/s]
 16%|█▌        | 60265/371472 [4:47:52<23:18:01,  3.71it/s]
 16%|█▌        | 60266/371472 [4:47:52<25:46:25,  3.35it/s]
 16%|█▌        | 60267/371472 [4:47:52<26:14:29,  3.29it/s]
 16%|█▌        | 60268/371472 [4:47:53<25:14:16,  3.43it/s]
 16%|█▌        | 60269/371472 [4:47:53<24:35:08,  3.52it/s]
 16%|█▌        | 60270/371472 [4:47:53<24:44:01,  3.50it/s]
 16%|█▌        | 60271/371472 [4:47:54<24:14:04,  3.57it/s]
 16%|█▌        | 60272/371472 [4:47:54<23:49:50,  3.63it/s]
 16%|█▌        | 60273/371472 [4:47:54<22:54:02,  3.77it/s]
 16%|█▌        | 60274/371472 [4:47:54<22:16:25,  3.88it/s]
 16%|█▌        | 60275/371472 [4:47:55<24:07:59,  3.58it/s]
 16%|█▌        | 60276/371472 [4:47:55<23:41:03,  3.65it/s]
 16%|█▌        | 60277/371472 [4:47:55<22:39:27,  3.82it/s]
 16%|█▌        | 60278/371472 [4:47:55<22:05:37,  3.91it/s]
 16%|█▌        | 60279/371472 [4:47:56<22:23:25,  3.86it/s]
 16%|█▌        | 60280/371472 [4:47:56<22:39:08,  3.82it/s]
                                                           
{'loss': 4.4055, 'learning_rate': 8.543601456614018e-07, 'epoch': 2.6}

 16%|█▌        | 60280/371472 [4:47:56<22:39:08,  3.82it/s]
 16%|█▌        | 60281/371472 [4:47:56<22:30:05,  3.84it/s]
 16%|█▌        | 60282/371472 [4:47:56<22:14:46,  3.89it/s]
 16%|█▌        | 60283/371472 [4:47:57<23:36:14,  3.66it/s]
 16%|█▌        | 60284/371472 [4:47:57<24:05:53,  3.59it/s]
 16%|█▌        | 60285/371472 [4:47:57<24:09:04,  3.58it/s]
 16%|█▌        | 60286/371472 [4:47:58<24:23:51,  3.54it/s]
 16%|█▌        | 60287/371472 [4:47:58<24:23:48,  3.54it/s]
 16%|█▌        | 60288/371472 [4:47:58<24:20:18,  3.55it/s]
 16%|█▌        | 60289/371472 [4:47:58<24:24:58,  3.54it/s]
 16%|█▌        | 60290/371472 [4:47:59<25:18:02,  3.42it/s]
 16%|█▌        | 60291/371472 [4:47:59<24:21:32,  3.55it/s]
 16%|█▌        | 60292/371472 [4:47:59<25:16:28,  3.42it/s]
 16%|█▌        | 60293/371472 [4:48:00<24:36:34,  3.51it/s]
 16%|█▌        | 60294/371472 [4:48:00<23:32:27,  3.67it/s]
 16%|█▌        | 60295/371472 [4:48:00<23:32:06,  3.67it/s]
 16%|█▌        | 60296/371472 [4:48:00<23:57:43,  3.61it/s]
 16%|█▌        | 60297/371472 [4:48:01<25:19:51,  3.41it/s]
 16%|█▌        | 60298/371472 [4:48:01<24:43:48,  3.50it/s]
 16%|█▌        | 60299/371472 [4:48:01<23:40:42,  3.65it/s]
 16%|█▌        | 60300/371472 [4:48:01<22:52:34,  3.78it/s]
                                                           
{'loss': 4.3399, 'learning_rate': 8.54311663685923e-07, 'epoch': 2.6}

 16%|█▌        | 60300/371472 [4:48:01<22:52:34,  3.78it/s]
 16%|█▌        | 60301/371472 [4:48:02<23:36:17,  3.66it/s]
 16%|█▌        | 60302/371472 [4:48:02<26:24:21,  3.27it/s]
 16%|█▌        | 60303/371472 [4:48:02<26:01:57,  3.32it/s]
 16%|█▌        | 60304/371472 [4:48:03<25:01:27,  3.45it/s]
 16%|█▌        | 60305/371472 [4:48:03<25:43:20,  3.36it/s]
 16%|█▌        | 60306/371472 [4:48:03<24:37:35,  3.51it/s]
 16%|█▌        | 60307/371472 [4:48:04<24:49:03,  3.48it/s]
 16%|█▌        | 60308/371472 [4:48:04<25:05:38,  3.44it/s]
 16%|█▌        | 60309/371472 [4:48:04<24:10:07,  3.58it/s]
 16%|█▌        | 60310/371472 [4:48:04<23:15:31,  3.72it/s]
 16%|█▌        | 60311/371472 [4:48:05<24:22:59,  3.54it/s]
 16%|█▌        | 60312/371472 [4:48:05<24:11:16,  3.57it/s]
 16%|█▌        | 60313/371472 [4:48:05<24:54:38,  3.47it/s]
 16%|█▌        | 60314/371472 [4:48:06<24:33:23,  3.52it/s]
 16%|█▌        | 60315/371472 [4:48:06<24:19:15,  3.55it/s]
 16%|█▌        | 60316/371472 [4:48:06<23:28:19,  3.68it/s]
 16%|█▌        | 60317/371472 [4:48:06<23:01:43,  3.75it/s]
 16%|█▌        | 60318/371472 [4:48:07<23:59:48,  3.60it/s]
 16%|█▌        | 60319/371472 [4:48:07<24:55:27,  3.47it/s]
 16%|█▌        | 60320/371472 [4:48:07<26:08:11,  3.31it/s]
                                                           
{'loss': 4.1884, 'learning_rate': 8.54263181710444e-07, 'epoch': 2.6}

 16%|█▌        | 60320/371472 [4:48:07<26:08:11,  3.31it/s]
 16%|█▌        | 60321/371472 [4:48:07<24:57:07,  3.46it/s]
 16%|█▌        | 60322/371472 [4:48:08<24:18:35,  3.56it/s]
 16%|█▌        | 60323/371472 [4:48:08<23:56:23,  3.61it/s]
 16%|█▌        | 60324/371472 [4:48:08<24:25:39,  3.54it/s]
 16%|█▌        | 60325/371472 [4:48:09<25:18:07,  3.42it/s]
 16%|█▌        | 60326/371472 [4:48:09<25:12:30,  3.43it/s]
 16%|█▌        | 60327/371472 [4:48:09<25:11:03,  3.43it/s]
 16%|█▌        | 60328/371472 [4:48:09<24:01:14,  3.60it/s]
 16%|█▌        | 60329/371472 [4:48:10<24:06:51,  3.58it/s]
 16%|█▌        | 60330/371472 [4:48:10<26:28:37,  3.26it/s]
 16%|█▌        | 60331/371472 [4:48:10<25:33:42,  3.38it/s]
 16%|█▌        | 60332/371472 [4:48:11<24:27:30,  3.53it/s]
 16%|█▌        | 60333/371472 [4:48:11<23:23:32,  3.69it/s]
 16%|█▌        | 60334/371472 [4:48:11<24:00:15,  3.60it/s]
 16%|█▌        | 60335/371472 [4:48:11<23:40:53,  3.65it/s]
 16%|█▌        | 60336/371472 [4:48:12<25:06:24,  3.44it/s]
 16%|█▌        | 60337/371472 [4:48:12<24:55:56,  3.47it/s]
 16%|█▌        | 60338/371472 [4:48:12<24:57:48,  3.46it/s]
 16%|█▌        | 60339/371472 [4:48:13<24:53:03,  3.47it/s]
 16%|█▌        | 60340/371472 [4:48:13<24:19:29,  3.55it/s]
                                                           
{'loss': 4.3731, 'learning_rate': 8.542146997349652e-07, 'epoch': 2.6}

 16%|█▌        | 60340/371472 [4:48:13<24:19:29,  3.55it/s]
 16%|█▌        | 60341/371472 [4:48:13<23:40:31,  3.65it/s]
 16%|█▌        | 60342/371472 [4:48:13<23:28:14,  3.68it/s]
 16%|█▌        | 60343/371472 [4:48:14<24:43:06,  3.50it/s]
 16%|█▌        | 60344/371472 [4:48:14<24:41:06,  3.50it/s]
 16%|█▌        | 60345/371472 [4:48:14<23:32:21,  3.67it/s]
 16%|█▌        | 60346/371472 [4:48:15<23:12:01,  3.73it/s]
 16%|█▌        | 60347/371472 [4:48:15<23:48:13,  3.63it/s]
 16%|█▌        | 60348/371472 [4:48:15<24:28:23,  3.53it/s]
 16%|█▌        | 60349/371472 [4:48:15<24:12:03,  3.57it/s]
 16%|█▌        | 60350/371472 [4:48:16<24:14:32,  3.56it/s]
 16%|█▌        | 60351/371472 [4:48:16<25:10:57,  3.43it/s]
 16%|█▌        | 60352/371472 [4:48:16<24:24:55,  3.54it/s]
 16%|█▌        | 60353/371472 [4:48:17<25:44:25,  3.36it/s]
 16%|█▌        | 60354/371472 [4:48:17<24:30:35,  3.53it/s]
 16%|█▌        | 60355/371472 [4:48:17<23:20:49,  3.70it/s]
 16%|█▌        | 60356/371472 [4:48:17<23:19:38,  3.70it/s]
 16%|█▌        | 60357/371472 [4:48:18<23:22:47,  3.70it/s]
 16%|█▌        | 60358/371472 [4:48:18<23:26:59,  3.69it/s]
 16%|█▌        | 60359/371472 [4:48:18<23:57:45,  3.61it/s]
 16%|█▌        | 60360/371472 [4:48:18<23:24:41,  3.69it/s]
                                                           
{'loss': 4.5374, 'learning_rate': 8.541662177594862e-07, 'epoch': 2.6}

 16%|█▌        | 60360/371472 [4:48:18<23:24:41,  3.69it/s]
 16%|█▌        | 60361/371472 [4:48:19<23:35:56,  3.66it/s]
 16%|█▌        | 60362/371472 [4:48:19<23:13:21,  3.72it/s]
 16%|█▌        | 60363/371472 [4:48:19<23:25:01,  3.69it/s]
 16%|█▌        | 60364/371472 [4:48:20<23:01:42,  3.75it/s]
 16%|█▋        | 60365/371472 [4:48:20<23:16:24,  3.71it/s]
 16%|█▋        | 60366/371472 [4:48:20<23:40:38,  3.65it/s]
 16%|█▋        | 60367/371472 [4:48:20<23:52:42,  3.62it/s]
 16%|█▋        | 60368/371472 [4:48:21<23:41:13,  3.65it/s]
 16%|█▋        | 60369/371472 [4:48:21<22:53:41,  3.77it/s]
 16%|█▋        | 60370/371472 [4:48:21<23:47:53,  3.63it/s]
 16%|█▋        | 60371/371472 [4:48:21<23:46:06,  3.64it/s]
 16%|█▋        | 60372/371472 [4:48:22<24:25:26,  3.54it/s]
 16%|█▋        | 60373/371472 [4:48:22<24:22:59,  3.54it/s]
 16%|█▋        | 60374/371472 [4:48:22<27:05:29,  3.19it/s]
 16%|█▋        | 60375/371472 [4:48:23<25:35:30,  3.38it/s]
 16%|█▋        | 60376/371472 [4:48:23<26:51:09,  3.22it/s]
 16%|█▋        | 60377/371472 [4:48:23<25:45:42,  3.35it/s]
 16%|█▋        | 60378/371472 [4:48:23<24:01:01,  3.60it/s]
 16%|█▋        | 60379/371472 [4:48:24<23:31:11,  3.67it/s]
 16%|█▋        | 60380/371472 [4:48:24<22:56:44,  3.77it/s]
                                                           
{'loss': 4.1441, 'learning_rate': 8.541177357840074e-07, 'epoch': 2.6}

 16%|█▋        | 60380/371472 [4:48:24<22:56:44,  3.77it/s]
 16%|█▋        | 60381/371472 [4:48:24<22:58:50,  3.76it/s]
 16%|█▋        | 60382/371472 [4:48:25<22:43:41,  3.80it/s]
 16%|█▋        | 60383/371472 [4:48:25<22:34:18,  3.83it/s]
 16%|█▋        | 60384/371472 [4:48:25<25:25:26,  3.40it/s]
 16%|█▋        | 60385/371472 [4:48:25<25:10:29,  3.43it/s]
 16%|█▋        | 60386/371472 [4:48:26<23:53:16,  3.62it/s]
 16%|█▋        | 60387/371472 [4:48:26<23:52:27,  3.62it/s]
 16%|█▋        | 60388/371472 [4:48:26<23:54:38,  3.61it/s]
 16%|█▋        | 60389/371472 [4:48:26<23:20:32,  3.70it/s]
 16%|█▋        | 60390/371472 [4:48:27<24:02:32,  3.59it/s]
 16%|█▋        | 60391/371472 [4:48:27<23:03:05,  3.75it/s]
 16%|█▋        | 60392/371472 [4:48:27<24:54:33,  3.47it/s]
 16%|█▋        | 60393/371472 [4:48:28<23:53:49,  3.62it/s]
 16%|█▋        | 60394/371472 [4:48:28<25:21:56,  3.41it/s]
 16%|█▋        | 60395/371472 [4:48:28<26:27:54,  3.27it/s]
 16%|█▋        | 60396/371472 [4:48:29<27:31:22,  3.14it/s]
 16%|█▋        | 60397/371472 [4:48:29<27:26:50,  3.15it/s]
 16%|█▋        | 60398/371472 [4:48:29<26:58:17,  3.20it/s]
 16%|█▋        | 60399/371472 [4:48:30<28:34:08,  3.02it/s]
 16%|█▋        | 60400/371472 [4:48:30<27:32:58,  3.14it/s]
                                                           
{'loss': 4.2451, 'learning_rate': 8.540692538085285e-07, 'epoch': 2.6}

 16%|█▋        | 60400/371472 [4:48:30<27:32:58,  3.14it/s]
 16%|█▋        | 60401/371472 [4:48:30<26:32:55,  3.25it/s]
 16%|█▋        | 60402/371472 [4:48:30<25:54:16,  3.34it/s]
 16%|█▋        | 60403/371472 [4:48:31<25:44:18,  3.36it/s]
 16%|█▋        | 60404/371472 [4:48:31<25:07:23,  3.44it/s]
 16%|█▋        | 60405/371472 [4:48:31<23:48:04,  3.63it/s]
 16%|█▋        | 60406/371472 [4:48:32<23:40:34,  3.65it/s]
 16%|█▋        | 60407/371472 [4:48:32<24:40:25,  3.50it/s]
 16%|█▋        | 60408/371472 [4:48:32<25:49:32,  3.35it/s]
 16%|█▋        | 60409/371472 [4:48:32<24:56:16,  3.46it/s]
 16%|█▋        | 60410/371472 [4:48:33<25:07:37,  3.44it/s]
 16%|█▋        | 60411/371472 [4:48:33<24:14:07,  3.57it/s]
 16%|█▋        | 60412/371472 [4:48:33<23:55:58,  3.61it/s]
 16%|█▋        | 60413/371472 [4:48:34<23:32:28,  3.67it/s]
 16%|█▋        | 60414/371472 [4:48:34<25:07:01,  3.44it/s]
 16%|█▋        | 60415/371472 [4:48:34<23:44:31,  3.64it/s]
 16%|█▋        | 60416/371472 [4:48:34<24:38:52,  3.51it/s]
 16%|█▋        | 60417/371472 [4:48:35<24:02:21,  3.59it/s]
 16%|█▋        | 60418/371472 [4:48:35<23:59:35,  3.60it/s]
 16%|█▋        | 60419/371472 [4:48:35<26:00:25,  3.32it/s]
 16%|█▋        | 60420/371472 [4:48:36<25:12:59,  3.43it/s]
                                                           
{'loss': 4.172, 'learning_rate': 8.540207718330496e-07, 'epoch': 2.6}

 16%|█▋        | 60420/371472 [4:48:36<25:12:59,  3.43it/s]
 16%|█▋        | 60421/371472 [4:48:36<24:41:13,  3.50it/s]
 16%|█▋        | 60422/371472 [4:48:36<25:44:50,  3.36it/s]
 16%|█▋        | 60423/371472 [4:48:36<25:36:20,  3.37it/s]
 16%|█▋        | 60424/371472 [4:48:37<26:01:04,  3.32it/s]
 16%|█▋        | 60425/371472 [4:48:37<26:18:57,  3.28it/s]
 16%|█▋        | 60426/371472 [4:48:37<26:32:27,  3.26it/s]
 16%|█▋        | 60427/371472 [4:48:38<25:14:09,  3.42it/s]
 16%|█▋        | 60428/371472 [4:48:38<24:34:44,  3.52it/s]
 16%|█▋        | 60429/371472 [4:48:38<24:32:34,  3.52it/s]
 16%|█▋        | 60430/371472 [4:48:38<23:39:12,  3.65it/s]
 16%|█▋        | 60431/371472 [4:48:39<22:54:47,  3.77it/s]
 16%|█▋        | 60432/371472 [4:48:39<23:30:07,  3.68it/s]
 16%|█▋        | 60433/371472 [4:48:39<23:24:23,  3.69it/s]
 16%|█▋        | 60434/371472 [4:48:40<23:44:48,  3.64it/s]
 16%|█▋        | 60435/371472 [4:48:40<24:12:43,  3.57it/s]
 16%|█▋        | 60436/371472 [4:48:40<24:06:22,  3.58it/s]
 16%|█▋        | 60437/371472 [4:48:40<23:31:34,  3.67it/s]
 16%|█▋        | 60438/371472 [4:48:41<24:18:13,  3.55it/s]
 16%|█▋        | 60439/371472 [4:48:41<24:15:57,  3.56it/s]
 16%|█▋        | 60440/371472 [4:48:41<23:29:26,  3.68it/s]
                                                           
{'loss': 4.1974, 'learning_rate': 8.539722898575707e-07, 'epoch': 2.6}

 16%|█▋        | 60440/371472 [4:48:41<23:29:26,  3.68it/s]
 16%|█▋        | 60441/371472 [4:48:42<25:29:20,  3.39it/s]
 16%|█▋        | 60442/371472 [4:48:42<24:40:10,  3.50it/s]
 16%|█▋        | 60443/371472 [4:48:42<24:58:35,  3.46it/s]
 16%|█▋        | 60444/371472 [4:48:42<24:37:05,  3.51it/s]
 16%|█▋        | 60445/371472 [4:48:43<24:24:26,  3.54it/s]
 16%|█▋        | 60446/371472 [4:48:43<24:08:13,  3.58it/s]
 16%|█▋        | 60447/371472 [4:48:43<24:19:33,  3.55it/s]
 16%|█▋        | 60448/371472 [4:48:44<24:14:44,  3.56it/s]
 16%|█▋        | 60449/371472 [4:48:44<23:35:51,  3.66it/s]
 16%|█▋        | 60450/371472 [4:48:44<23:49:18,  3.63it/s]
 16%|█▋        | 60451/371472 [4:48:44<24:42:55,  3.50it/s]
 16%|█▋        | 60452/371472 [4:48:45<24:58:46,  3.46it/s]
 16%|█▋        | 60453/371472 [4:48:45<24:36:37,  3.51it/s]
 16%|█▋        | 60454/371472 [4:48:45<23:31:26,  3.67it/s]
 16%|█▋        | 60455/371472 [4:48:45<23:38:47,  3.65it/s]
 16%|█▋        | 60456/371472 [4:48:46<23:27:19,  3.68it/s]
 16%|█▋        | 60457/371472 [4:48:46<23:28:03,  3.68it/s]
 16%|█▋        | 60458/371472 [4:48:46<24:33:52,  3.52it/s]
 16%|█▋        | 60459/371472 [4:48:47<24:13:24,  3.57it/s]
 16%|█▋        | 60460/371472 [4:48:47<24:39:11,  3.50it/s]
                                                           
{'loss': 4.2203, 'learning_rate': 8.539238078820918e-07, 'epoch': 2.6}

 16%|█▋        | 60460/371472 [4:48:47<24:39:11,  3.50it/s]
 16%|█▋        | 60461/371472 [4:48:47<24:12:04,  3.57it/s]
 16%|█▋        | 60462/371472 [4:48:47<24:15:59,  3.56it/s]
 16%|█▋        | 60463/371472 [4:48:48<23:54:43,  3.61it/s]
 16%|█▋        | 60464/371472 [4:48:48<24:20:23,  3.55it/s]
 16%|█▋        | 60465/371472 [4:48:48<24:32:54,  3.52it/s]
 16%|█▋        | 60466/371472 [4:48:49<24:02:41,  3.59it/s]
 16%|█▋        | 60467/371472 [4:48:49<23:24:03,  3.69it/s]
 16%|█▋        | 60468/371472 [4:48:49<24:14:48,  3.56it/s]
 16%|█▋        | 60469/371472 [4:48:49<24:26:22,  3.53it/s]
 16%|█▋        | 60470/371472 [4:48:50<24:34:03,  3.52it/s]
 16%|█▋        | 60471/371472 [4:48:50<24:26:29,  3.53it/s]
 16%|█▋        | 60472/371472 [4:48:50<24:12:05,  3.57it/s]
 16%|█▋        | 60473/371472 [4:48:51<24:29:11,  3.53it/s]
 16%|█▋        | 60474/371472 [4:48:51<24:44:59,  3.49it/s]
 16%|█▋        | 60475/371472 [4:48:51<26:09:26,  3.30it/s]
 16%|█▋        | 60476/371472 [4:48:52<36:24:33,  2.37it/s]
 16%|█▋        | 60477/371472 [4:48:52<32:30:11,  2.66it/s]
 16%|█▋        | 60478/371472 [4:48:52<30:49:57,  2.80it/s]
 16%|█▋        | 60479/371472 [4:48:53<28:29:06,  3.03it/s]
 16%|█▋        | 60480/371472 [4:48:53<26:56:39,  3.21it/s]
                                                           
{'loss': 4.241, 'learning_rate': 8.53875325906613e-07, 'epoch': 2.6}

 16%|█▋        | 60480/371472 [4:48:53<26:56:39,  3.21it/s]
 16%|█▋        | 60481/371472 [4:48:53<26:03:40,  3.31it/s]
 16%|█▋        | 60482/371472 [4:48:54<25:57:11,  3.33it/s]
 16%|█▋        | 60483/371472 [4:48:54<25:22:51,  3.40it/s]
 16%|█▋        | 60484/371472 [4:48:54<23:54:49,  3.61it/s]
 16%|█▋        | 60485/371472 [4:48:54<23:21:39,  3.70it/s]
 16%|█▋        | 60486/371472 [4:48:55<22:39:05,  3.81it/s]
 16%|█▋        | 60487/371472 [4:48:55<22:18:48,  3.87it/s]
 16%|█▋        | 60488/371472 [4:48:55<24:45:37,  3.49it/s]
 16%|█▋        | 60489/371472 [4:48:55<24:06:49,  3.58it/s]
 16%|█▋        | 60490/371472 [4:48:56<24:05:55,  3.58it/s]
 16%|█▋        | 60491/371472 [4:48:56<23:33:38,  3.67it/s]
 16%|█▋        | 60492/371472 [4:48:56<24:03:14,  3.59it/s]
 16%|█▋        | 60493/371472 [4:48:57<23:50:14,  3.62it/s]
 16%|█▋        | 60494/371472 [4:48:57<25:23:40,  3.40it/s]
 16%|█▋        | 60495/371472 [4:48:57<25:22:14,  3.40it/s]
 16%|█▋        | 60496/371472 [4:48:57<26:27:24,  3.27it/s]
 16%|█▋        | 60497/371472 [4:48:58<25:20:05,  3.41it/s]
 16%|█▋        | 60498/371472 [4:48:58<24:20:32,  3.55it/s]
 16%|█▋        | 60499/371472 [4:48:58<24:28:46,  3.53it/s]
 16%|█▋        | 60500/371472 [4:48:59<23:29:37,  3.68it/s]
                                                           
{'loss': 4.2997, 'learning_rate': 8.53826843931134e-07, 'epoch': 2.61}

 16%|█▋        | 60500/371472 [4:48:59<23:29:37,  3.68it/s]
 16%|█▋        | 60501/371472 [4:48:59<23:55:54,  3.61it/s]
 16%|█▋        | 60502/371472 [4:48:59<26:55:17,  3.21it/s]
 16%|█▋        | 60503/371472 [4:48:59<25:30:04,  3.39it/s]
 16%|█▋        | 60504/371472 [4:49:00<25:44:44,  3.36it/s]
 16%|█▋        | 60505/371472 [4:49:00<25:04:56,  3.44it/s]
 16%|█▋        | 60506/371472 [4:49:00<25:04:01,  3.45it/s]
 16%|█▋        | 60507/371472 [4:49:01<24:26:23,  3.53it/s]
 16%|█▋        | 60508/371472 [4:49:01<23:20:23,  3.70it/s]
 16%|█▋        | 60509/371472 [4:49:01<23:24:28,  3.69it/s]
 16%|█▋        | 60510/371472 [4:49:01<24:25:01,  3.54it/s]
 16%|█▋        | 60511/371472 [4:49:02<24:59:41,  3.46it/s]
 16%|█▋        | 60512/371472 [4:49:02<24:21:45,  3.55it/s]
 16%|█▋        | 60513/371472 [4:49:02<23:27:01,  3.68it/s]
 16%|█▋        | 60514/371472 [4:49:03<24:29:35,  3.53it/s]
 16%|█▋        | 60515/371472 [4:49:03<24:18:43,  3.55it/s]
 16%|█▋        | 60516/371472 [4:49:03<23:48:50,  3.63it/s]
 16%|█▋        | 60517/371472 [4:49:03<24:40:08,  3.50it/s]
 16%|█▋        | 60518/371472 [4:49:04<24:02:23,  3.59it/s]
 16%|█▋        | 60519/371472 [4:49:04<24:08:55,  3.58it/s]
 16%|█▋        | 60520/371472 [4:49:04<24:17:33,  3.56it/s]
                                                           
{'loss': 4.0746, 'learning_rate': 8.537783619556551e-07, 'epoch': 2.61}

 16%|█▋        | 60520/371472 [4:49:04<24:17:33,  3.56it/s]
 16%|█▋        | 60521/371472 [4:49:04<23:19:24,  3.70it/s]
 16%|█▋        | 60522/371472 [4:49:05<25:01:57,  3.45it/s]
 16%|█▋        | 60523/371472 [4:49:05<25:07:08,  3.44it/s]
 16%|█▋        | 60524/371472 [4:49:05<26:32:27,  3.25it/s]
 16%|█▋        | 60525/371472 [4:49:06<25:28:13,  3.39it/s]
 16%|█▋        | 60526/371472 [4:49:06<24:31:26,  3.52it/s]
 16%|█▋        | 60527/371472 [4:49:06<24:21:53,  3.54it/s]
 16%|█▋        | 60528/371472 [4:49:07<24:26:39,  3.53it/s]
 16%|█▋        | 60529/371472 [4:49:07<25:02:03,  3.45it/s]
 16%|█▋        | 60530/371472 [4:49:07<26:11:14,  3.30it/s]
 16%|█▋        | 60531/371472 [4:49:07<25:26:19,  3.40it/s]
 16%|█▋        | 60532/371472 [4:49:08<25:12:03,  3.43it/s]
 16%|█▋        | 60533/371472 [4:49:08<25:33:06,  3.38it/s]
 16%|█▋        | 60534/371472 [4:49:08<25:44:16,  3.36it/s]
 16%|█▋        | 60535/371472 [4:49:09<24:39:53,  3.50it/s]
 16%|█▋        | 60536/371472 [4:49:09<25:20:33,  3.41it/s]
 16%|█▋        | 60537/371472 [4:49:09<27:02:45,  3.19it/s]
 16%|█▋        | 60538/371472 [4:49:10<25:32:29,  3.38it/s]
 16%|█▋        | 60539/371472 [4:49:10<24:49:05,  3.48it/s]
 16%|█▋        | 60540/371472 [4:49:10<23:41:20,  3.65it/s]
                                                           
{'loss': 4.1195, 'learning_rate': 8.537298799801763e-07, 'epoch': 2.61}

 16%|█▋        | 60540/371472 [4:49:10<23:41:20,  3.65it/s]
 16%|█▋        | 60541/371472 [4:49:10<24:57:22,  3.46it/s]
 16%|█▋        | 60542/371472 [4:49:11<29:05:41,  2.97it/s]
 16%|█▋        | 60543/371472 [4:49:11<29:18:44,  2.95it/s]
 16%|█▋        | 60544/371472 [4:49:11<26:55:37,  3.21it/s]
 16%|█▋        | 60545/371472 [4:49:12<25:37:40,  3.37it/s]
 16%|█▋        | 60546/371472 [4:49:12<24:45:01,  3.49it/s]
 16%|█▋        | 60547/371472 [4:49:12<23:29:05,  3.68it/s]
 16%|█▋        | 60548/371472 [4:49:12<23:24:09,  3.69it/s]
 16%|█▋        | 60549/371472 [4:49:13<24:12:05,  3.57it/s]
 16%|█▋        | 60550/371472 [4:49:13<23:18:06,  3.71it/s]
 16%|█▋        | 60551/371472 [4:49:13<25:04:15,  3.44it/s]
 16%|█▋        | 60552/371472 [4:49:14<25:41:06,  3.36it/s]
 16%|█▋        | 60553/371472 [4:49:14<24:24:42,  3.54it/s]
 16%|█▋        | 60554/371472 [4:49:14<24:20:17,  3.55it/s]
 16%|█▋        | 60555/371472 [4:49:14<24:28:53,  3.53it/s]
 16%|█▋        | 60556/371472 [4:49:15<26:00:54,  3.32it/s]
 16%|█▋        | 60557/371472 [4:49:15<25:39:50,  3.37it/s]
 16%|█▋        | 60558/371472 [4:49:15<24:22:26,  3.54it/s]
 16%|█▋        | 60559/371472 [4:49:16<24:32:20,  3.52it/s]
 16%|█▋        | 60560/371472 [4:49:16<23:44:26,  3.64it/s]
                                                           
{'loss': 4.2102, 'learning_rate': 8.536813980046974e-07, 'epoch': 2.61}

 16%|█▋        | 60560/371472 [4:49:16<23:44:26,  3.64it/s]
 16%|█▋        | 60561/371472 [4:49:16<26:16:45,  3.29it/s]
 16%|█▋        | 60562/371472 [4:49:17<26:30:25,  3.26it/s]
 16%|█▋        | 60563/371472 [4:49:17<27:28:21,  3.14it/s]
 16%|█▋        | 60564/371472 [4:49:17<25:28:31,  3.39it/s]
 16%|█▋        | 60565/371472 [4:49:17<26:58:00,  3.20it/s]
 16%|█▋        | 60566/371472 [4:49:18<25:39:44,  3.37it/s]
 16%|█▋        | 60567/371472 [4:49:18<24:50:57,  3.48it/s]
 16%|█▋        | 60568/371472 [4:49:18<24:37:59,  3.51it/s]
 16%|█▋        | 60569/371472 [4:49:19<23:24:31,  3.69it/s]
 16%|█▋        | 60570/371472 [4:49:19<23:57:47,  3.60it/s]
 16%|█▋        | 60571/371472 [4:49:19<25:09:42,  3.43it/s]
 16%|█▋        | 60572/371472 [4:49:19<24:54:20,  3.47it/s]
 16%|█▋        | 60573/371472 [4:49:20<24:56:08,  3.46it/s]
 16%|█▋        | 60574/371472 [4:49:20<24:32:49,  3.52it/s]
 16%|█▋        | 60575/371472 [4:49:20<23:56:42,  3.61it/s]
 16%|█▋        | 60576/371472 [4:49:21<24:49:39,  3.48it/s]
 16%|█▋        | 60577/371472 [4:49:21<25:07:09,  3.44it/s]
 16%|█▋        | 60578/371472 [4:49:21<26:08:23,  3.30it/s]
 16%|█▋        | 60579/371472 [4:49:21<25:15:44,  3.42it/s]
 16%|█▋        | 60580/371472 [4:49:22<24:49:33,  3.48it/s]
                                                           
{'loss': 4.1293, 'learning_rate': 8.536329160292183e-07, 'epoch': 2.61}

 16%|█▋        | 60580/371472 [4:49:22<24:49:33,  3.48it/s]
 16%|█▋        | 60581/371472 [4:49:22<24:19:33,  3.55it/s]
 16%|█▋        | 60582/371472 [4:49:22<23:31:15,  3.67it/s]
 16%|█▋        | 60583/371472 [4:49:23<22:52:16,  3.78it/s]
 16%|█▋        | 60584/371472 [4:49:23<26:12:15,  3.30it/s]
 16%|█▋        | 60585/371472 [4:49:23<25:33:59,  3.38it/s]
 16%|█▋        | 60586/371472 [4:49:23<25:31:11,  3.38it/s]
 16%|█▋        | 60587/371472 [4:49:24<24:21:12,  3.55it/s]
 16%|█▋        | 60588/371472 [4:49:24<24:10:35,  3.57it/s]
 16%|█▋        | 60589/371472 [4:49:24<25:54:46,  3.33it/s]
 16%|█▋        | 60590/371472 [4:49:25<25:25:41,  3.40it/s]
 16%|█▋        | 60591/371472 [4:49:25<24:13:46,  3.56it/s]
 16%|█▋        | 60592/371472 [4:49:25<24:50:47,  3.48it/s]
 16%|█▋        | 60593/371472 [4:49:25<25:24:56,  3.40it/s]
 16%|█▋        | 60594/371472 [4:49:26<25:08:05,  3.44it/s]
 16%|█▋        | 60595/371472 [4:49:26<26:35:25,  3.25it/s]
 16%|█▋        | 60596/371472 [4:49:26<26:11:38,  3.30it/s]
 16%|█▋        | 60597/371472 [4:49:27<24:54:07,  3.47it/s]
 16%|█▋        | 60598/371472 [4:49:27<24:16:32,  3.56it/s]
 16%|█▋        | 60599/371472 [4:49:27<23:14:18,  3.72it/s]
 16%|█▋        | 60600/371472 [4:49:27<23:10:26,  3.73it/s]
                                                           
{'loss': 4.1909, 'learning_rate': 8.535844340537395e-07, 'epoch': 2.61}

 16%|█▋        | 60600/371472 [4:49:27<23:10:26,  3.73it/s]
 16%|█▋        | 60601/371472 [4:49:28<22:47:20,  3.79it/s]
 16%|█▋        | 60602/371472 [4:49:28<24:28:27,  3.53it/s]
 16%|█▋        | 60603/371472 [4:49:28<27:09:47,  3.18it/s]
 16%|█▋        | 60604/371472 [4:49:29<26:50:18,  3.22it/s]
 16%|█▋        | 60605/371472 [4:49:29<27:15:23,  3.17it/s]
 16%|█▋        | 60606/371472 [4:49:29<25:42:45,  3.36it/s]
 16%|█▋        | 60607/371472 [4:49:30<24:27:48,  3.53it/s]
 16%|█▋        | 60608/371472 [4:49:30<25:10:28,  3.43it/s]
 16%|█▋        | 60609/371472 [4:49:30<26:59:09,  3.20it/s]
 16%|█▋        | 60610/371472 [4:49:31<26:13:14,  3.29it/s]
 16%|█▋        | 60611/371472 [4:49:31<25:26:37,  3.39it/s]
 16%|█▋        | 60612/371472 [4:49:31<27:11:23,  3.18it/s]
 16%|█▋        | 60613/371472 [4:49:31<25:31:34,  3.38it/s]
 16%|█▋        | 60614/371472 [4:49:32<24:33:38,  3.52it/s]
 16%|█▋        | 60615/371472 [4:49:32<26:21:04,  3.28it/s]
 16%|█▋        | 60616/371472 [4:49:32<25:57:33,  3.33it/s]
 16%|█▋        | 60617/371472 [4:49:33<24:52:29,  3.47it/s]
 16%|█▋        | 60618/371472 [4:49:33<25:34:39,  3.38it/s]
 16%|█▋        | 60619/371472 [4:49:33<26:45:50,  3.23it/s]
 16%|█▋        | 60620/371472 [4:49:34<26:49:54,  3.22it/s]
                                                           
{'loss': 4.0423, 'learning_rate': 8.535359520782607e-07, 'epoch': 2.61}

 16%|█▋        | 60620/371472 [4:49:34<26:49:54,  3.22it/s]
 16%|█▋        | 60621/371472 [4:49:34<26:39:06,  3.24it/s]
 16%|█▋        | 60622/371472 [4:49:34<24:58:21,  3.46it/s]
 16%|█▋        | 60623/371472 [4:49:34<26:54:28,  3.21it/s]
 16%|█▋        | 60624/371472 [4:49:35<27:49:08,  3.10it/s]
 16%|█▋        | 60625/371472 [4:49:35<26:47:16,  3.22it/s]
 16%|█▋        | 60626/371472 [4:49:35<27:19:15,  3.16it/s]
 16%|█▋        | 60627/371472 [4:49:36<26:51:47,  3.21it/s]
 16%|█▋        | 60628/371472 [4:49:36<27:19:54,  3.16it/s]
 16%|█▋        | 60629/371472 [4:49:36<27:38:00,  3.12it/s]
 16%|█▋        | 60630/371472 [4:49:37<26:46:30,  3.22it/s]
 16%|█▋        | 60631/371472 [4:49:37<26:31:56,  3.25it/s]
 16%|█▋        | 60632/371472 [4:49:37<25:23:01,  3.40it/s]
 16%|█▋        | 60633/371472 [4:49:38<26:50:41,  3.22it/s]
 16%|█▋        | 60634/371472 [4:49:38<26:32:17,  3.25it/s]
 16%|█▋        | 60635/371472 [4:49:38<26:06:27,  3.31it/s]
 16%|█▋        | 60636/371472 [4:49:38<25:42:15,  3.36it/s]
 16%|█▋        | 60637/371472 [4:49:39<24:52:04,  3.47it/s]
 16%|█▋        | 60638/371472 [4:49:39<24:53:44,  3.47it/s]
 16%|█▋        | 60639/371472 [4:49:39<24:19:59,  3.55it/s]
 16%|█▋        | 60640/371472 [4:49:40<23:43:17,  3.64it/s]
                                                           
{'loss': 4.2171, 'learning_rate': 8.534874701027818e-07, 'epoch': 2.61}

 16%|█▋        | 60640/371472 [4:49:40<23:43:17,  3.64it/s]
 16%|█▋        | 60641/371472 [4:49:40<23:05:08,  3.74it/s]
 16%|█▋        | 60642/371472 [4:49:40<23:59:55,  3.60it/s]
 16%|█▋        | 60643/371472 [4:49:40<23:50:24,  3.62it/s]
 16%|█▋        | 60644/371472 [4:49:41<24:43:59,  3.49it/s]
 16%|█▋        | 60645/371472 [4:49:41<24:29:07,  3.53it/s]
 16%|█▋        | 60646/371472 [4:49:41<24:41:39,  3.50it/s]
 16%|█▋        | 60647/371472 [4:49:41<24:07:41,  3.58it/s]
 16%|█▋        | 60648/371472 [4:49:42<23:59:18,  3.60it/s]
 16%|█▋        | 60649/371472 [4:49:42<25:09:48,  3.43it/s]
 16%|█▋        | 60650/371472 [4:49:42<26:16:49,  3.29it/s]
 16%|█▋        | 60651/371472 [4:49:43<25:19:28,  3.41it/s]
 16%|█▋        | 60652/371472 [4:49:43<24:43:02,  3.49it/s]
 16%|█▋        | 60653/371472 [4:49:43<26:19:53,  3.28it/s]
 16%|█▋        | 60654/371472 [4:49:44<25:47:07,  3.35it/s]
 16%|█▋        | 60655/371472 [4:49:44<26:04:56,  3.31it/s]
 16%|█▋        | 60656/371472 [4:49:44<24:35:01,  3.51it/s]
 16%|█▋        | 60657/371472 [4:49:44<24:24:53,  3.54it/s]
 16%|█▋        | 60658/371472 [4:49:45<25:04:17,  3.44it/s]
 16%|█▋        | 60659/371472 [4:49:45<24:02:33,  3.59it/s]
 16%|█▋        | 60660/371472 [4:49:45<23:49:19,  3.62it/s]
                                                           
{'loss': 3.9872, 'learning_rate': 8.534389881273028e-07, 'epoch': 2.61}

 16%|█▋        | 60660/371472 [4:49:45<23:49:19,  3.62it/s]
 16%|█▋        | 60661/371472 [4:49:46<23:49:15,  3.62it/s]
 16%|█▋        | 60662/371472 [4:49:46<23:52:54,  3.62it/s]
 16%|█▋        | 60663/371472 [4:49:46<23:30:06,  3.67it/s]
 16%|█▋        | 60664/371472 [4:49:46<25:08:20,  3.43it/s]
 16%|█▋        | 60665/371472 [4:49:47<24:21:30,  3.54it/s]
 16%|█▋        | 60666/371472 [4:49:47<23:58:37,  3.60it/s]
 16%|█▋        | 60667/371472 [4:49:47<23:58:21,  3.60it/s]
 16%|█▋        | 60668/371472 [4:49:48<25:03:44,  3.44it/s]
 16%|█▋        | 60669/371472 [4:49:48<23:54:58,  3.61it/s]
 16%|█▋        | 60670/371472 [4:49:48<23:46:03,  3.63it/s]
 16%|█▋        | 60671/371472 [4:49:48<23:28:45,  3.68it/s]
 16%|█▋        | 60672/371472 [4:49:49<24:41:01,  3.50it/s]
 16%|█▋        | 60673/371472 [4:49:49<23:35:12,  3.66it/s]
 16%|█▋        | 60674/371472 [4:49:49<24:12:16,  3.57it/s]
 16%|█▋        | 60675/371472 [4:49:49<24:16:46,  3.56it/s]
 16%|█▋        | 60676/371472 [4:49:50<24:05:24,  3.58it/s]
 16%|█▋        | 60677/371472 [4:49:50<23:10:09,  3.73it/s]
 16%|█▋        | 60678/371472 [4:49:50<23:20:20,  3.70it/s]
 16%|█▋        | 60679/371472 [4:49:51<26:54:09,  3.21it/s]
 16%|█▋        | 60680/371472 [4:49:51<25:07:13,  3.44it/s]
                                                           
{'loss': 4.1679, 'learning_rate': 8.53390506151824e-07, 'epoch': 2.61}

 16%|█▋        | 60680/371472 [4:49:51<25:07:13,  3.44it/s]
 16%|█▋        | 60681/371472 [4:49:51<24:16:48,  3.56it/s]
 16%|█▋        | 60682/371472 [4:49:51<23:54:02,  3.61it/s]
 16%|█▋        | 60683/371472 [4:49:52<22:56:11,  3.76it/s]
 16%|█▋        | 60684/371472 [4:49:52<23:02:58,  3.75it/s]
 16%|█▋        | 60685/371472 [4:49:52<23:03:51,  3.74it/s]
 16%|█▋        | 60686/371472 [4:49:53<24:36:50,  3.51it/s]
 16%|█▋        | 60687/371472 [4:49:53<24:44:53,  3.49it/s]
 16%|█▋        | 60688/371472 [4:49:53<23:35:55,  3.66it/s]
 16%|█▋        | 60689/371472 [4:49:53<23:19:09,  3.70it/s]
 16%|█▋        | 60690/371472 [4:49:54<23:35:29,  3.66it/s]
 16%|█▋        | 60691/371472 [4:49:54<24:05:51,  3.58it/s]
 16%|█▋        | 60692/371472 [4:49:54<23:29:27,  3.67it/s]
 16%|█▋        | 60693/371472 [4:49:54<23:06:35,  3.74it/s]
 16%|█▋        | 60694/371472 [4:49:55<24:08:17,  3.58it/s]
 16%|█▋        | 60695/371472 [4:49:55<24:17:28,  3.55it/s]
 16%|█▋        | 60696/371472 [4:49:55<23:44:03,  3.64it/s]
 16%|█▋        | 60697/371472 [4:49:55<23:02:18,  3.75it/s]
 16%|█▋        | 60698/371472 [4:49:56<22:56:03,  3.76it/s]
 16%|█▋        | 60699/371472 [4:49:56<22:13:24,  3.88it/s]
 16%|█▋        | 60700/371472 [4:49:56<22:45:03,  3.79it/s]
                                                           
{'loss': 4.2011, 'learning_rate': 8.53342024176345e-07, 'epoch': 2.61}

 16%|█▋        | 60700/371472 [4:49:56<22:45:03,  3.79it/s]
 16%|█▋        | 60701/371472 [4:49:57<22:48:17,  3.79it/s]
 16%|█▋        | 60702/371472 [4:49:57<22:35:40,  3.82it/s]
 16%|█▋        | 60703/371472 [4:49:57<24:00:54,  3.59it/s]
 16%|█▋        | 60704/371472 [4:49:57<23:55:22,  3.61it/s]
 16%|█▋        | 60705/371472 [4:49:58<24:15:25,  3.56it/s]
 16%|█▋        | 60706/371472 [4:49:58<23:51:23,  3.62it/s]
 16%|█▋        | 60707/371472 [4:49:58<24:24:01,  3.54it/s]
 16%|█▋        | 60708/371472 [4:49:58<23:24:55,  3.69it/s]
 16%|█▋        | 60709/371472 [4:49:59<25:06:20,  3.44it/s]
 16%|█▋        | 60710/371472 [4:49:59<27:24:29,  3.15it/s]
 16%|█▋        | 60711/371472 [4:49:59<26:08:09,  3.30it/s]
 16%|█▋        | 60712/371472 [4:50:00<26:44:44,  3.23it/s]
 16%|█▋        | 60713/371472 [4:50:00<26:06:47,  3.31it/s]
 16%|█▋        | 60714/371472 [4:50:00<25:45:22,  3.35it/s]
 16%|█▋        | 60715/371472 [4:50:01<25:00:31,  3.45it/s]
 16%|█▋        | 60716/371472 [4:50:01<25:29:29,  3.39it/s]
 16%|█▋        | 60717/371472 [4:50:01<24:15:55,  3.56it/s]
 16%|█▋        | 60718/371472 [4:50:01<24:17:00,  3.55it/s]
 16%|█▋        | 60719/371472 [4:50:02<23:34:38,  3.66it/s]
 16%|█▋        | 60720/371472 [4:50:02<23:38:55,  3.65it/s]
                                                           
{'loss': 4.1579, 'learning_rate': 8.532935422008662e-07, 'epoch': 2.62}

 16%|█▋        | 60720/371472 [4:50:02<23:38:55,  3.65it/s]
 16%|█▋        | 60721/371472 [4:50:02<22:58:34,  3.76it/s]
 16%|█▋        | 60722/371472 [4:50:03<23:13:16,  3.72it/s]
 16%|█▋        | 60723/371472 [4:50:03<23:59:51,  3.60it/s]
 16%|█▋        | 60724/371472 [4:50:03<23:12:30,  3.72it/s]
 16%|█▋        | 60725/371472 [4:50:03<23:16:47,  3.71it/s]
 16%|█▋        | 60726/371472 [4:50:04<22:52:33,  3.77it/s]
 16%|█▋        | 60727/371472 [4:50:04<23:41:40,  3.64it/s]
 16%|█▋        | 60728/371472 [4:50:04<23:33:30,  3.66it/s]
 16%|█▋        | 60729/371472 [4:50:04<23:20:27,  3.70it/s]
 16%|█▋        | 60730/371472 [4:50:05<26:05:27,  3.31it/s]
 16%|█▋        | 60731/371472 [4:50:05<24:53:57,  3.47it/s]
 16%|█▋        | 60732/371472 [4:50:05<23:47:38,  3.63it/s]
 16%|█▋        | 60733/371472 [4:50:06<23:56:29,  3.61it/s]
 16%|█▋        | 60734/371472 [4:50:06<23:08:39,  3.73it/s]
 16%|█▋        | 60735/371472 [4:50:06<22:52:06,  3.77it/s]
 16%|█▋        | 60736/371472 [4:50:06<22:43:36,  3.80it/s]
 16%|█▋        | 60737/371472 [4:50:07<22:08:41,  3.90it/s]
 16%|█▋        | 60738/371472 [4:50:07<21:45:20,  3.97it/s]
 16%|█▋        | 60739/371472 [4:50:07<23:03:02,  3.74it/s]
 16%|█▋        | 60740/371472 [4:50:07<22:35:32,  3.82it/s]
                                                           
{'loss': 4.3445, 'learning_rate': 8.532450602253872e-07, 'epoch': 2.62}

 16%|█▋        | 60740/371472 [4:50:07<22:35:32,  3.82it/s]
 16%|█▋        | 60741/371472 [4:50:08<23:07:37,  3.73it/s]
 16%|█▋        | 60742/371472 [4:50:08<23:36:58,  3.65it/s]
 16%|█▋        | 60743/371472 [4:50:08<26:28:18,  3.26it/s]
 16%|█▋        | 60744/371472 [4:50:09<25:46:40,  3.35it/s]
 16%|█▋        | 60745/371472 [4:50:09<25:37:46,  3.37it/s]
 16%|█▋        | 60746/371472 [4:50:09<26:01:16,  3.32it/s]
 16%|█▋        | 60747/371472 [4:50:10<26:47:49,  3.22it/s]
 16%|█▋        | 60748/371472 [4:50:10<25:39:52,  3.36it/s]
 16%|█▋        | 60749/371472 [4:50:10<30:49:23,  2.80it/s]
 16%|█▋        | 60750/371472 [4:50:11<28:26:16,  3.04it/s]
 16%|█▋        | 60751/371472 [4:50:11<27:08:19,  3.18it/s]
 16%|█▋        | 60752/371472 [4:50:11<26:07:24,  3.30it/s]
 16%|█▋        | 60753/371472 [4:50:11<26:05:34,  3.31it/s]
 16%|█▋        | 60754/371472 [4:50:12<26:21:57,  3.27it/s]
 16%|█▋        | 60755/371472 [4:50:12<25:05:14,  3.44it/s]
 16%|█▋        | 60756/371472 [4:50:12<24:48:38,  3.48it/s]
 16%|█▋        | 60757/371472 [4:50:13<25:16:56,  3.41it/s]
 16%|█▋        | 60758/371472 [4:50:13<24:57:25,  3.46it/s]
 16%|█▋        | 60759/371472 [4:50:13<24:51:48,  3.47it/s]
 16%|█▋        | 60760/371472 [4:50:13<25:08:51,  3.43it/s]
                                                           
{'loss': 4.2757, 'learning_rate': 8.531965782499084e-07, 'epoch': 2.62}

 16%|█▋        | 60760/371472 [4:50:13<25:08:51,  3.43it/s]
 16%|█▋        | 60761/371472 [4:50:14<25:31:25,  3.38it/s]
 16%|█▋        | 60762/371472 [4:50:14<24:13:53,  3.56it/s]
 16%|█▋        | 60763/371472 [4:50:14<23:03:17,  3.74it/s]
 16%|█▋        | 60764/371472 [4:50:15<22:43:44,  3.80it/s]
 16%|█▋        | 60765/371472 [4:50:15<22:22:45,  3.86it/s]
 16%|█▋        | 60766/371472 [4:50:15<22:51:20,  3.78it/s]
 16%|█▋        | 60767/371472 [4:50:15<22:50:00,  3.78it/s]
 16%|█▋        | 60768/371472 [4:50:16<22:51:31,  3.78it/s]
 16%|█▋        | 60769/371472 [4:50:16<24:05:19,  3.58it/s]
 16%|█▋        | 60770/371472 [4:50:16<25:21:36,  3.40it/s]
 16%|█▋        | 60771/371472 [4:50:17<26:45:10,  3.23it/s]
 16%|█▋        | 60772/371472 [4:50:17<25:29:40,  3.39it/s]
 16%|█▋        | 60773/371472 [4:50:17<24:41:50,  3.49it/s]
 16%|█▋        | 60774/371472 [4:50:17<25:17:27,  3.41it/s]
 16%|█▋        | 60775/371472 [4:50:18<23:52:26,  3.61it/s]
 16%|█▋        | 60776/371472 [4:50:18<23:59:10,  3.60it/s]
 16%|█▋        | 60777/371472 [4:50:18<23:43:38,  3.64it/s]
 16%|█▋        | 60778/371472 [4:50:18<24:15:44,  3.56it/s]
 16%|█▋        | 60779/371472 [4:50:19<23:27:51,  3.68it/s]
 16%|█▋        | 60780/371472 [4:50:19<23:52:19,  3.62it/s]
                                                           
{'loss': 4.1861, 'learning_rate': 8.531480962744295e-07, 'epoch': 2.62}

 16%|█▋        | 60780/371472 [4:50:19<23:52:19,  3.62it/s]
 16%|█▋        | 60781/371472 [4:50:19<22:53:38,  3.77it/s]
 16%|█▋        | 60782/371472 [4:50:20<24:41:22,  3.50it/s]
 16%|█▋        | 60783/371472 [4:50:20<26:29:51,  3.26it/s]
 16%|█▋        | 60784/371472 [4:50:20<25:54:59,  3.33it/s]
 16%|█▋        | 60785/371472 [4:50:21<25:53:12,  3.33it/s]
 16%|█▋        | 60786/371472 [4:50:21<24:14:14,  3.56it/s]
 16%|█▋        | 60787/371472 [4:50:21<25:17:38,  3.41it/s]
 16%|█▋        | 60788/371472 [4:50:21<25:03:28,  3.44it/s]
 16%|█▋        | 60789/371472 [4:50:22<23:54:24,  3.61it/s]
 16%|█▋        | 60790/371472 [4:50:22<24:33:15,  3.51it/s]
 16%|█▋        | 60791/371472 [4:50:22<24:30:49,  3.52it/s]
 16%|█▋        | 60792/371472 [4:50:22<24:54:20,  3.47it/s]
 16%|█▋        | 60793/371472 [4:50:23<23:59:06,  3.60it/s]
 16%|█▋        | 60794/371472 [4:50:23<22:55:45,  3.76it/s]
 16%|█▋        | 60795/371472 [4:50:23<23:57:15,  3.60it/s]
 16%|█▋        | 60796/371472 [4:50:24<23:03:08,  3.74it/s]
 16%|█▋        | 60797/371472 [4:50:24<25:36:50,  3.37it/s]
 16%|█▋        | 60798/371472 [4:50:24<24:59:19,  3.45it/s]
 16%|█▋        | 60799/371472 [4:50:24<24:12:07,  3.57it/s]
 16%|█▋        | 60800/371472 [4:50:25<24:39:20,  3.50it/s]
                                                           
{'loss': 4.3216, 'learning_rate': 8.530996142989507e-07, 'epoch': 2.62}

 16%|█▋        | 60800/371472 [4:50:25<24:39:20,  3.50it/s]
 16%|█▋        | 60801/371472 [4:50:25<24:09:17,  3.57it/s]
 16%|█▋        | 60802/371472 [4:50:25<24:13:10,  3.56it/s]
 16%|█▋        | 60803/371472 [4:50:26<25:55:13,  3.33it/s]
 16%|█▋        | 60804/371472 [4:50:26<24:09:25,  3.57it/s]
 16%|█▋        | 60805/371472 [4:50:26<23:41:26,  3.64it/s]
 16%|█▋        | 60806/371472 [4:50:26<23:11:48,  3.72it/s]
 16%|█▋        | 60807/371472 [4:50:27<22:59:10,  3.75it/s]
 16%|█▋        | 60808/371472 [4:50:27<23:07:26,  3.73it/s]
 16%|█▋        | 60809/371472 [4:50:27<23:02:44,  3.74it/s]
 16%|█▋        | 60810/371472 [4:50:27<22:59:13,  3.75it/s]
 16%|█▋        | 60811/371472 [4:50:28<22:42:13,  3.80it/s]
 16%|█▋        | 60812/371472 [4:50:28<22:22:22,  3.86it/s]
 16%|█▋        | 60813/371472 [4:50:28<22:41:26,  3.80it/s]
 16%|█▋        | 60814/371472 [4:50:28<22:34:18,  3.82it/s]
 16%|█▋        | 60815/371472 [4:50:29<22:13:31,  3.88it/s]
 16%|█▋        | 60816/371472 [4:50:29<25:25:14,  3.39it/s]
 16%|█▋        | 60817/371472 [4:50:29<24:26:37,  3.53it/s]
 16%|█▋        | 60818/371472 [4:50:30<24:09:27,  3.57it/s]
 16%|█▋        | 60819/371472 [4:50:30<23:13:52,  3.71it/s]
 16%|█▋        | 60820/371472 [4:50:30<23:09:33,  3.73it/s]
                                                           
{'loss': 4.3104, 'learning_rate': 8.530511323234717e-07, 'epoch': 2.62}

 16%|█▋        | 60820/371472 [4:50:30<23:09:33,  3.73it/s]
 16%|█▋        | 60821/371472 [4:50:30<22:56:00,  3.76it/s]
 16%|█▋        | 60822/371472 [4:50:31<22:59:36,  3.75it/s]
 16%|█▋        | 60823/371472 [4:50:31<22:36:11,  3.82it/s]
 16%|█▋        | 60824/371472 [4:50:31<23:43:08,  3.64it/s]
 16%|█▋        | 60825/371472 [4:50:31<23:11:37,  3.72it/s]
 16%|█▋        | 60826/371472 [4:50:32<23:20:21,  3.70it/s]
 16%|█▋        | 60827/371472 [4:50:32<24:25:21,  3.53it/s]
 16%|█▋        | 60828/371472 [4:50:32<23:18:56,  3.70it/s]
 16%|█▋        | 60829/371472 [4:50:33<25:40:52,  3.36it/s]
 16%|█▋        | 60830/371472 [4:50:33<26:17:20,  3.28it/s]
 16%|█▋        | 60831/371472 [4:50:33<25:01:37,  3.45it/s]
 16%|█▋        | 60832/371472 [4:50:34<24:23:20,  3.54it/s]
 16%|█▋        | 60833/371472 [4:50:34<23:59:32,  3.60it/s]
 16%|█▋        | 60834/371472 [4:50:34<24:26:55,  3.53it/s]
 16%|█▋        | 60835/371472 [4:50:34<25:07:58,  3.43it/s]
 16%|█▋        | 60836/371472 [4:50:35<24:07:31,  3.58it/s]
 16%|█▋        | 60837/371472 [4:50:35<24:32:26,  3.52it/s]
 16%|█▋        | 60838/371472 [4:50:35<24:38:46,  3.50it/s]
 16%|█▋        | 60839/371472 [4:50:35<23:31:35,  3.67it/s]
 16%|█▋        | 60840/371472 [4:50:36<22:55:08,  3.76it/s]
                                                           
{'loss': 4.31, 'learning_rate': 8.530026503479928e-07, 'epoch': 2.62}

 16%|█▋        | 60840/371472 [4:50:36<22:55:08,  3.76it/s]
 16%|█▋        | 60841/371472 [4:50:36<22:57:47,  3.76it/s]
 16%|█▋        | 60842/371472 [4:50:36<23:10:59,  3.72it/s]
 16%|█▋        | 60843/371472 [4:50:36<22:33:01,  3.83it/s]
 16%|█▋        | 60844/371472 [4:50:37<22:48:36,  3.78it/s]
 16%|█▋        | 60845/371472 [4:50:37<22:33:43,  3.82it/s]
 16%|█▋        | 60846/371472 [4:50:37<22:28:42,  3.84it/s]
 16%|█▋        | 60847/371472 [4:50:38<22:08:45,  3.90it/s]
 16%|█▋        | 60848/371472 [4:50:38<22:57:51,  3.76it/s]
 16%|█▋        | 60849/371472 [4:50:38<23:29:22,  3.67it/s]
 16%|█▋        | 60850/371472 [4:50:38<23:20:31,  3.70it/s]
 16%|█▋        | 60851/371472 [4:50:39<24:17:35,  3.55it/s]
 16%|█▋        | 60852/371472 [4:50:39<23:37:44,  3.65it/s]
 16%|█▋        | 60853/371472 [4:50:39<24:53:08,  3.47it/s]
 16%|█▋        | 60854/371472 [4:50:40<23:53:06,  3.61it/s]
 16%|█▋        | 60855/371472 [4:50:40<23:20:13,  3.70it/s]
 16%|█▋        | 60856/371472 [4:50:40<23:16:33,  3.71it/s]
 16%|█▋        | 60857/371472 [4:50:40<24:19:58,  3.55it/s]
 16%|█▋        | 60858/371472 [4:50:41<23:41:08,  3.64it/s]
 16%|█▋        | 60859/371472 [4:50:41<23:08:28,  3.73it/s]
 16%|█▋        | 60860/371472 [4:50:41<24:29:13,  3.52it/s]
                                                           
{'loss': 4.2184, 'learning_rate': 8.529541683725139e-07, 'epoch': 2.62}

 16%|█▋        | 60860/371472 [4:50:41<24:29:13,  3.52it/s]
 16%|█▋        | 60861/371472 [4:50:41<24:20:22,  3.54it/s]
 16%|█▋        | 60862/371472 [4:50:42<24:14:15,  3.56it/s]
 16%|█▋        | 60863/371472 [4:50:42<24:23:00,  3.54it/s]
 16%|█▋        | 60864/371472 [4:50:42<24:51:05,  3.47it/s]
 16%|█▋        | 60865/371472 [4:50:43<25:39:26,  3.36it/s]
 16%|█▋        | 60866/371472 [4:50:43<24:43:58,  3.49it/s]
 16%|█▋        | 60867/371472 [4:50:43<24:45:14,  3.49it/s]
 16%|█▋        | 60868/371472 [4:50:43<23:30:57,  3.67it/s]
 16%|█▋        | 60869/371472 [4:50:44<23:20:03,  3.70it/s]
 16%|█▋        | 60870/371472 [4:50:44<23:58:15,  3.60it/s]
 16%|█▋        | 60871/371472 [4:50:44<23:37:55,  3.65it/s]
 16%|█▋        | 60872/371472 [4:50:44<22:41:17,  3.80it/s]
 16%|█▋        | 60873/371472 [4:50:45<26:05:28,  3.31it/s]
 16%|█▋        | 60874/371472 [4:50:45<25:08:04,  3.43it/s]
 16%|█▋        | 60875/371472 [4:50:45<24:25:58,  3.53it/s]
 16%|█▋        | 60876/371472 [4:50:46<24:01:15,  3.59it/s]
 16%|█▋        | 60877/371472 [4:50:46<24:51:13,  3.47it/s]
 16%|█▋        | 60878/371472 [4:50:46<23:52:30,  3.61it/s]
 16%|█▋        | 60879/371472 [4:50:46<23:11:31,  3.72it/s]
 16%|█▋        | 60880/371472 [4:50:47<23:25:51,  3.68it/s]
                                                           
{'loss': 4.0942, 'learning_rate': 8.52905686397035e-07, 'epoch': 2.62}

 16%|█▋        | 60880/371472 [4:50:47<23:25:51,  3.68it/s]
 16%|█▋        | 60881/371472 [4:50:47<22:32:57,  3.83it/s]
 16%|█▋        | 60882/371472 [4:50:47<23:21:24,  3.69it/s]
 16%|█▋        | 60883/371472 [4:50:48<23:45:20,  3.63it/s]
 16%|█▋        | 60884/371472 [4:50:48<23:10:14,  3.72it/s]
 16%|█▋        | 60885/371472 [4:50:48<24:42:21,  3.49it/s]
 16%|█▋        | 60886/371472 [4:50:48<24:31:19,  3.52it/s]
 16%|█▋        | 60887/371472 [4:50:49<25:02:06,  3.45it/s]
 16%|█▋        | 60888/371472 [4:50:49<24:26:28,  3.53it/s]
 16%|█▋        | 60889/371472 [4:50:49<23:38:29,  3.65it/s]
 16%|█▋        | 60890/371472 [4:50:50<23:41:30,  3.64it/s]
 16%|█▋        | 60891/371472 [4:50:50<24:17:01,  3.55it/s]
 16%|█▋        | 60892/371472 [4:50:50<24:09:08,  3.57it/s]
 16%|█▋        | 60893/371472 [4:50:50<23:10:30,  3.72it/s]
 16%|█▋        | 60894/371472 [4:50:51<23:12:25,  3.72it/s]
 16%|█▋        | 60895/371472 [4:50:51<25:16:59,  3.41it/s]
 16%|█▋        | 60896/371472 [4:50:51<23:58:19,  3.60it/s]
 16%|█▋        | 60897/371472 [4:50:51<23:12:12,  3.72it/s]
 16%|█▋        | 60898/371472 [4:50:52<23:23:09,  3.69it/s]
 16%|█▋        | 60899/371472 [4:50:52<23:00:38,  3.75it/s]
 16%|█▋        | 60900/371472 [4:50:52<23:29:40,  3.67it/s]
                                                           
{'loss': 4.3643, 'learning_rate': 8.52857204421556e-07, 'epoch': 2.62}

 16%|█▋        | 60900/371472 [4:50:52<23:29:40,  3.67it/s]
 16%|█▋        | 60901/371472 [4:50:53<23:08:25,  3.73it/s]
 16%|█▋        | 60902/371472 [4:50:53<23:13:30,  3.71it/s]
 16%|█▋        | 60903/371472 [4:50:53<23:49:05,  3.62it/s]
 16%|█▋        | 60904/371472 [4:50:53<23:15:01,  3.71it/s]
 16%|█▋        | 60905/371472 [4:50:54<23:23:46,  3.69it/s]
 16%|█▋        | 60906/371472 [4:50:54<26:16:01,  3.28it/s]
 16%|█▋        | 60907/371472 [4:50:54<27:13:37,  3.17it/s]
 16%|█▋        | 60908/371472 [4:50:55<26:16:50,  3.28it/s]
 16%|█▋        | 60909/371472 [4:50:55<24:39:57,  3.50it/s]
 16%|█▋        | 60910/371472 [4:50:55<24:49:03,  3.48it/s]
 16%|█▋        | 60911/371472 [4:50:55<23:57:53,  3.60it/s]
 16%|█▋        | 60912/371472 [4:50:56<22:59:21,  3.75it/s]
 16%|█▋        | 60913/371472 [4:50:56<23:26:51,  3.68it/s]
 16%|█▋        | 60914/371472 [4:50:56<25:04:15,  3.44it/s]
 16%|█▋        | 60915/371472 [4:50:57<24:15:54,  3.56it/s]
 16%|█▋        | 60916/371472 [4:50:57<23:45:57,  3.63it/s]
 16%|█▋        | 60917/371472 [4:50:57<24:19:49,  3.55it/s]
 16%|█▋        | 60918/371472 [4:50:57<25:54:51,  3.33it/s]
 16%|█▋        | 60919/371472 [4:50:58<24:24:24,  3.53it/s]
 16%|█▋        | 60920/371472 [4:50:58<23:20:36,  3.70it/s]
                                                           
{'loss': 3.9566, 'learning_rate': 8.528087224460773e-07, 'epoch': 2.62}

 16%|█▋        | 60920/371472 [4:50:58<23:20:36,  3.70it/s]
 16%|█▋        | 60921/371472 [4:50:58<23:47:08,  3.63it/s]
 16%|█▋        | 60922/371472 [4:50:59<24:25:44,  3.53it/s]
 16%|█▋        | 60923/371472 [4:50:59<24:27:47,  3.53it/s]
 16%|█▋        | 60924/371472 [4:50:59<23:48:18,  3.62it/s]
 16%|█▋        | 60925/371472 [4:50:59<23:00:09,  3.75it/s]
 16%|█▋        | 60926/371472 [4:51:00<22:47:10,  3.79it/s]
 16%|█▋        | 60927/371472 [4:51:00<24:36:21,  3.51it/s]
 16%|█▋        | 60928/371472 [4:51:00<24:45:20,  3.48it/s]
 16%|█▋        | 60929/371472 [4:51:01<25:24:29,  3.40it/s]
 16%|█▋        | 60930/371472 [4:51:01<27:19:20,  3.16it/s]
 16%|█▋        | 60931/371472 [4:51:01<26:12:02,  3.29it/s]
 16%|█▋        | 60932/371472 [4:51:01<27:07:37,  3.18it/s]
 16%|█▋        | 60933/371472 [4:51:02<25:51:41,  3.34it/s]
 16%|█▋        | 60934/371472 [4:51:02<26:14:10,  3.29it/s]
 16%|█▋        | 60935/371472 [4:51:02<26:27:30,  3.26it/s]
 16%|█▋        | 60936/371472 [4:51:03<25:13:31,  3.42it/s]
 16%|█▋        | 60937/371472 [4:51:03<25:06:38,  3.44it/s]
 16%|█▋        | 60938/371472 [4:51:03<24:28:17,  3.52it/s]
 16%|█▋        | 60939/371472 [4:51:03<24:06:14,  3.58it/s]
 16%|█▋        | 60940/371472 [4:51:04<23:00:12,  3.75it/s]
                                                           
{'loss': 4.2772, 'learning_rate': 8.527602404705984e-07, 'epoch': 2.62}

 16%|█▋        | 60940/371472 [4:51:04<23:00:12,  3.75it/s]
 16%|█▋        | 60941/371472 [4:51:04<23:06:29,  3.73it/s]
 16%|█▋        | 60942/371472 [4:51:04<22:47:12,  3.79it/s]
 16%|█▋        | 60943/371472 [4:51:04<22:23:55,  3.85it/s]
 16%|█▋        | 60944/371472 [4:51:05<21:58:01,  3.93it/s]
 16%|█▋        | 60945/371472 [4:51:05<22:58:08,  3.76it/s]
 16%|█▋        | 60946/371472 [4:51:05<23:51:35,  3.62it/s]
 16%|█▋        | 60947/371472 [4:51:06<24:07:24,  3.58it/s]
 16%|█▋        | 60948/371472 [4:51:06<23:00:17,  3.75it/s]
 16%|█▋        | 60949/371472 [4:51:06<23:06:59,  3.73it/s]
 16%|█▋        | 60950/371472 [4:51:06<22:57:17,  3.76it/s]
 16%|█▋        | 60951/371472 [4:51:07<22:51:06,  3.77it/s]
 16%|█▋        | 60952/371472 [4:51:07<23:50:28,  3.62it/s]
 16%|█▋        | 60953/371472 [4:51:07<23:54:01,  3.61it/s]
 16%|█▋        | 60954/371472 [4:51:07<23:45:13,  3.63it/s]
 16%|█▋        | 60955/371472 [4:51:08<23:16:58,  3.70it/s]
 16%|█▋        | 60956/371472 [4:51:08<24:32:17,  3.52it/s]
 16%|█▋        | 60957/371472 [4:51:08<26:16:04,  3.28it/s]
 16%|█▋        | 60958/371472 [4:51:09<24:38:26,  3.50it/s]
 16%|█▋        | 60959/371472 [4:51:09<25:07:16,  3.43it/s]
 16%|█▋        | 60960/371472 [4:51:09<27:55:06,  3.09it/s]
                                                           
{'loss': 4.1774, 'learning_rate': 8.527117584951193e-07, 'epoch': 2.63}

 16%|█▋        | 60960/371472 [4:51:09<27:55:06,  3.09it/s]
 16%|█▋        | 60961/371472 [4:51:10<26:28:14,  3.26it/s]
 16%|█▋        | 60962/371472 [4:51:10<26:11:49,  3.29it/s]
 16%|█▋        | 60963/371472 [4:51:10<25:28:22,  3.39it/s]
 16%|█▋        | 60964/371472 [4:51:10<24:50:30,  3.47it/s]
 16%|█▋        | 60965/371472 [4:51:11<24:29:29,  3.52it/s]
 16%|█▋        | 60966/371472 [4:51:11<23:15:34,  3.71it/s]
 16%|█▋        | 60967/371472 [4:51:11<22:24:52,  3.85it/s]
 16%|█▋        | 60968/371472 [4:51:11<22:06:39,  3.90it/s]
 16%|█▋        | 60969/371472 [4:51:12<22:44:38,  3.79it/s]
 16%|█▋        | 60970/371472 [4:51:12<23:13:13,  3.71it/s]
 16%|█▋        | 60971/371472 [4:51:12<23:05:30,  3.74it/s]
 16%|█▋        | 60972/371472 [4:51:13<22:45:05,  3.79it/s]
 16%|█▋        | 60973/371472 [4:51:13<23:30:54,  3.67it/s]
 16%|█▋        | 60974/371472 [4:51:13<22:49:33,  3.78it/s]
 16%|█▋        | 60975/371472 [4:51:13<22:15:20,  3.88it/s]
 16%|█▋        | 60976/371472 [4:51:14<23:18:18,  3.70it/s]
 16%|█▋        | 60977/371472 [4:51:14<24:39:52,  3.50it/s]
 16%|█▋        | 60978/371472 [4:51:14<24:42:29,  3.49it/s]
 16%|█▋        | 60979/371472 [4:51:14<24:03:00,  3.59it/s]
 16%|█▋        | 60980/371472 [4:51:15<23:09:12,  3.73it/s]
                                                           
{'loss': 4.1943, 'learning_rate': 8.526632765196405e-07, 'epoch': 2.63}

 16%|█▋        | 60980/371472 [4:51:15<23:09:12,  3.73it/s]
 16%|█▋        | 60981/371472 [4:51:15<23:10:02,  3.72it/s]
 16%|█▋        | 60982/371472 [4:51:15<24:24:43,  3.53it/s]
 16%|█▋        | 60983/371472 [4:51:16<23:54:56,  3.61it/s]
 16%|█▋        | 60984/371472 [4:51:16<22:59:38,  3.75it/s]
 16%|█▋        | 60985/371472 [4:51:16<22:52:09,  3.77it/s]
 16%|█▋        | 60986/371472 [4:51:16<24:38:13,  3.50it/s]
 16%|█▋        | 60987/371472 [4:51:17<24:00:56,  3.59it/s]
 16%|█▋        | 60988/371472 [4:51:17<23:39:47,  3.64it/s]
 16%|█▋        | 60989/371472 [4:51:17<24:39:28,  3.50it/s]
 16%|█▋        | 60990/371472 [4:51:18<24:13:38,  3.56it/s]
 16%|█▋        | 60991/371472 [4:51:18<24:04:31,  3.58it/s]
 16%|█▋        | 60992/371472 [4:51:18<23:56:21,  3.60it/s]
 16%|█▋        | 60993/371472 [4:51:18<26:39:01,  3.24it/s]
 16%|█▋        | 60994/371472 [4:51:19<24:42:17,  3.49it/s]
 16%|█▋        | 60995/371472 [4:51:19<24:53:03,  3.47it/s]
 16%|█▋        | 60996/371472 [4:51:19<26:12:18,  3.29it/s]
 16%|█▋        | 60997/371472 [4:51:20<26:01:27,  3.31it/s]
 16%|█▋        | 60998/371472 [4:51:20<24:55:08,  3.46it/s]
 16%|█▋        | 60999/371472 [4:51:20<24:03:23,  3.59it/s]
 16%|█▋        | 61000/371472 [4:51:20<23:27:28,  3.68it/s]
                                                           
{'loss': 4.1812, 'learning_rate': 8.526147945441618e-07, 'epoch': 2.63}

 16%|█▋        | 61000/371472 [4:51:20<23:27:28,  3.68it/s]
 16%|█▋        | 61001/371472 [4:51:21<22:54:12,  3.77it/s]
 16%|█▋        | 61002/371472 [4:51:21<24:21:46,  3.54it/s]
 16%|█▋        | 61003/371472 [4:51:21<24:42:38,  3.49it/s]
 16%|█▋        | 61004/371472 [4:51:22<25:06:36,  3.43it/s]
 16%|█▋        | 61005/371472 [4:51:22<24:09:21,  3.57it/s]
 16%|█▋        | 61006/371472 [4:51:22<24:42:34,  3.49it/s]
 16%|█▋        | 61007/371472 [4:51:22<24:19:17,  3.55it/s]
 16%|█▋        | 61008/371472 [4:51:23<23:48:14,  3.62it/s]
 16%|█▋        | 61009/371472 [4:51:23<23:44:13,  3.63it/s]
 16%|█▋        | 61010/371472 [4:51:23<23:07:16,  3.73it/s]
 16%|█▋        | 61011/371472 [4:51:23<22:32:27,  3.83it/s]
 16%|█▋        | 61012/371472 [4:51:24<22:17:39,  3.87it/s]
 16%|█▋        | 61013/371472 [4:51:24<23:02:55,  3.74it/s]
 16%|█▋        | 61014/371472 [4:51:24<23:11:55,  3.72it/s]
 16%|█▋        | 61015/371472 [4:51:24<22:32:14,  3.83it/s]
 16%|█▋        | 61016/371472 [4:51:25<22:57:26,  3.76it/s]
 16%|█▋        | 61017/371472 [4:51:25<22:43:23,  3.80it/s]
 16%|█▋        | 61018/371472 [4:51:25<22:15:39,  3.87it/s]
 16%|█▋        | 61019/371472 [4:51:26<21:53:06,  3.94it/s]
 16%|█▋        | 61020/371472 [4:51:26<23:39:54,  3.64it/s]
                                                           
{'loss': 4.3691, 'learning_rate': 8.525663125686828e-07, 'epoch': 2.63}

 16%|█▋        | 61020/371472 [4:51:26<23:39:54,  3.64it/s]
 16%|█▋        | 61021/371472 [4:51:26<23:57:29,  3.60it/s]
 16%|█▋        | 61022/371472 [4:51:26<23:25:47,  3.68it/s]
 16%|█▋        | 61023/371472 [4:51:27<23:24:49,  3.68it/s]
 16%|█▋        | 61024/371472 [4:51:27<23:17:17,  3.70it/s]
 16%|█▋        | 61025/371472 [4:51:27<23:26:16,  3.68it/s]
 16%|█▋        | 61026/371472 [4:51:28<26:09:28,  3.30it/s]
 16%|█▋        | 61027/371472 [4:51:28<24:48:21,  3.48it/s]
 16%|█▋        | 61028/371472 [4:51:28<24:12:09,  3.56it/s]
 16%|█▋        | 61029/371472 [4:51:28<24:44:15,  3.49it/s]
 16%|█▋        | 61030/371472 [4:51:29<24:21:05,  3.54it/s]
 16%|█▋        | 61031/371472 [4:51:29<24:40:56,  3.49it/s]
 16%|█▋        | 61032/371472 [4:51:29<24:22:37,  3.54it/s]
 16%|█▋        | 61033/371472 [4:51:29<23:37:37,  3.65it/s]
 16%|█▋        | 61034/371472 [4:51:30<22:55:45,  3.76it/s]
 16%|█▋        | 61035/371472 [4:51:30<23:02:25,  3.74it/s]
 16%|█▋        | 61036/371472 [4:51:30<23:12:25,  3.72it/s]
 16%|█▋        | 61037/371472 [4:51:31<22:51:13,  3.77it/s]
 16%|█▋        | 61038/371472 [4:51:31<22:43:11,  3.80it/s]
 16%|█▋        | 61039/371472 [4:51:31<23:25:49,  3.68it/s]
 16%|█▋        | 61040/371472 [4:51:31<22:44:22,  3.79it/s]
                                                           
{'loss': 4.3042, 'learning_rate': 8.525178305932038e-07, 'epoch': 2.63}

 16%|█▋        | 61040/371472 [4:51:31<22:44:22,  3.79it/s]
 16%|█▋        | 61041/371472 [4:51:32<23:02:52,  3.74it/s]
 16%|█▋        | 61042/371472 [4:51:32<22:40:50,  3.80it/s]
 16%|█▋        | 61043/371472 [4:51:32<22:58:32,  3.75it/s]
 16%|█▋        | 61044/371472 [4:51:32<24:59:10,  3.45it/s]
 16%|█▋        | 61045/371472 [4:51:33<24:52:23,  3.47it/s]
 16%|█▋        | 61046/371472 [4:51:33<24:57:43,  3.45it/s]
 16%|█▋        | 61047/371472 [4:51:33<26:02:45,  3.31it/s]
 16%|█▋        | 61048/371472 [4:51:34<24:48:20,  3.48it/s]
 16%|█▋        | 61049/371472 [4:51:34<25:07:32,  3.43it/s]
 16%|█▋        | 61050/371472 [4:51:34<23:43:46,  3.63it/s]
 16%|█▋        | 61051/371472 [4:51:34<23:38:39,  3.65it/s]
 16%|█▋        | 61052/371472 [4:51:35<23:08:28,  3.73it/s]
 16%|█▋        | 61053/371472 [4:51:35<22:46:18,  3.79it/s]
 16%|█▋        | 61054/371472 [4:51:35<22:36:54,  3.81it/s]
 16%|█▋        | 61055/371472 [4:51:35<22:08:03,  3.90it/s]
 16%|█▋        | 61056/371472 [4:51:36<21:55:12,  3.93it/s]
 16%|█▋        | 61057/371472 [4:51:36<21:35:15,  3.99it/s]
 16%|█▋        | 61058/371472 [4:51:36<22:53:33,  3.77it/s]
 16%|█▋        | 61059/371472 [4:51:37<23:21:07,  3.69it/s]
 16%|█▋        | 61060/371472 [4:51:37<23:13:50,  3.71it/s]
                                                           
{'loss': 4.2198, 'learning_rate': 8.52469348617725e-07, 'epoch': 2.63}

 16%|█▋        | 61060/371472 [4:51:37<23:13:50,  3.71it/s]
 16%|█▋        | 61061/371472 [4:51:37<33:47:29,  2.55it/s]
 16%|█▋        | 61062/371472 [4:51:38<30:22:25,  2.84it/s]
 16%|█▋        | 61063/371472 [4:51:38<27:41:02,  3.11it/s]
 16%|█▋        | 61064/371472 [4:51:38<25:56:25,  3.32it/s]
 16%|█▋        | 61065/371472 [4:51:38<24:26:56,  3.53it/s]
 16%|█▋        | 61066/371472 [4:51:39<23:58:22,  3.60it/s]
 16%|█▋        | 61067/371472 [4:51:39<24:49:37,  3.47it/s]
 16%|█▋        | 61068/371472 [4:51:39<23:42:17,  3.64it/s]
 16%|█▋        | 61069/371472 [4:51:40<26:12:13,  3.29it/s]
 16%|█▋        | 61070/371472 [4:51:40<26:10:01,  3.30it/s]
 16%|█▋        | 61071/371472 [4:51:40<25:22:50,  3.40it/s]
 16%|█▋        | 61072/371472 [4:51:40<24:08:03,  3.57it/s]
 16%|█▋        | 61073/371472 [4:51:41<23:30:59,  3.67it/s]
 16%|█▋        | 61074/371472 [4:51:41<24:14:03,  3.56it/s]
 16%|█▋        | 61075/371472 [4:51:41<24:15:07,  3.56it/s]
 16%|█▋        | 61076/371472 [4:51:42<25:02:44,  3.44it/s]
 16%|█▋        | 61077/371472 [4:51:42<23:55:22,  3.60it/s]
 16%|█▋        | 61078/371472 [4:51:42<23:53:54,  3.61it/s]
 16%|█▋        | 61079/371472 [4:51:42<23:36:25,  3.65it/s]
 16%|█▋        | 61080/371472 [4:51:43<23:19:30,  3.70it/s]
                                                           
{'loss': 4.1068, 'learning_rate': 8.524208666422461e-07, 'epoch': 2.63}

 16%|█▋        | 61080/371472 [4:51:43<23:19:30,  3.70it/s]
 16%|█▋        | 61081/371472 [4:51:43<22:47:00,  3.78it/s]
 16%|█▋        | 61082/371472 [4:51:43<23:07:01,  3.73it/s]
 16%|█▋        | 61083/371472 [4:51:43<23:14:59,  3.71it/s]
 16%|█▋        | 61084/371472 [4:51:44<22:57:34,  3.76it/s]
 16%|█▋        | 61085/371472 [4:51:44<22:59:16,  3.75it/s]
 16%|█▋        | 61086/371472 [4:51:44<22:45:37,  3.79it/s]
 16%|█▋        | 61087/371472 [4:51:45<22:43:14,  3.79it/s]
 16%|█▋        | 61088/371472 [4:51:45<23:15:44,  3.71it/s]
 16%|█▋        | 61089/371472 [4:51:45<23:18:47,  3.70it/s]
 16%|█▋        | 61090/371472 [4:51:45<25:26:14,  3.39it/s]
 16%|█▋        | 61091/371472 [4:51:46<24:15:22,  3.55it/s]
 16%|█▋        | 61092/371472 [4:51:46<24:43:00,  3.49it/s]
 16%|█▋        | 61093/371472 [4:51:46<25:52:31,  3.33it/s]
 16%|█▋        | 61094/371472 [4:51:47<25:50:18,  3.34it/s]
 16%|█▋        | 61095/371472 [4:51:47<24:22:27,  3.54it/s]
 16%|█▋        | 61096/371472 [4:51:47<24:55:49,  3.46it/s]
 16%|█▋        | 61097/371472 [4:51:47<23:54:39,  3.61it/s]
 16%|█▋        | 61098/371472 [4:51:48<24:11:02,  3.56it/s]
 16%|█▋        | 61099/371472 [4:51:48<27:05:06,  3.18it/s]
 16%|█▋        | 61100/371472 [4:51:48<27:43:50,  3.11it/s]
                                                           
{'loss': 4.1193, 'learning_rate': 8.523723846667672e-07, 'epoch': 2.63}

 16%|█▋        | 61100/371472 [4:51:48<27:43:50,  3.11it/s]
 16%|█▋        | 61101/371472 [4:51:49<26:28:36,  3.26it/s]
 16%|█▋        | 61102/371472 [4:51:49<25:30:52,  3.38it/s]
 16%|█▋        | 61103/371472 [4:51:49<26:23:26,  3.27it/s]
 16%|█▋        | 61104/371472 [4:51:50<25:05:59,  3.43it/s]
 16%|█▋        | 61105/371472 [4:51:50<25:53:30,  3.33it/s]
 16%|█▋        | 61106/371472 [4:51:50<26:31:11,  3.25it/s]
 16%|█▋        | 61107/371472 [4:51:50<25:10:29,  3.42it/s]
 16%|█▋        | 61108/371472 [4:51:51<24:07:35,  3.57it/s]
 16%|█▋        | 61109/371472 [4:51:51<24:40:07,  3.49it/s]
 16%|█▋        | 61110/371472 [4:51:51<24:08:07,  3.57it/s]
 16%|█▋        | 61111/371472 [4:51:52<23:53:44,  3.61it/s]
 16%|█▋        | 61112/371472 [4:51:52<23:42:34,  3.64it/s]
 16%|█▋        | 61113/371472 [4:51:52<25:02:06,  3.44it/s]
 16%|█▋        | 61114/371472 [4:51:52<24:18:20,  3.55it/s]
 16%|█▋        | 61115/371472 [4:51:53<24:58:01,  3.45it/s]
 16%|█▋        | 61116/371472 [4:51:53<24:45:42,  3.48it/s]
 16%|█▋        | 61117/371472 [4:51:53<25:07:29,  3.43it/s]
 16%|█▋        | 61118/371472 [4:51:54<25:20:17,  3.40it/s]
 16%|█▋        | 61119/371472 [4:51:54<25:26:11,  3.39it/s]
 16%|█▋        | 61120/371472 [4:51:54<24:33:00,  3.51it/s]
                                                           
{'loss': 4.4358, 'learning_rate': 8.523239026912882e-07, 'epoch': 2.63}

 16%|█▋        | 61120/371472 [4:51:54<24:33:00,  3.51it/s]
 16%|█▋        | 61121/371472 [4:51:54<23:41:40,  3.64it/s]
 16%|█▋        | 61122/371472 [4:51:55<23:44:28,  3.63it/s]
 16%|█▋        | 61123/371472 [4:51:55<23:05:58,  3.73it/s]
 16%|█▋        | 61124/371472 [4:51:55<24:34:16,  3.51it/s]
 16%|█▋        | 61125/371472 [4:51:56<23:34:33,  3.66it/s]
 16%|█▋        | 61126/371472 [4:51:56<25:29:40,  3.38it/s]
 16%|█▋        | 61127/371472 [4:51:56<24:17:28,  3.55it/s]
 16%|█▋        | 61128/371472 [4:51:56<24:45:13,  3.48it/s]
 16%|█▋        | 61129/371472 [4:51:57<25:10:14,  3.42it/s]
 16%|█▋        | 61130/371472 [4:51:57<25:30:17,  3.38it/s]
 16%|█▋        | 61131/371472 [4:51:57<24:55:02,  3.46it/s]
 16%|█▋        | 61132/371472 [4:51:58<23:59:37,  3.59it/s]
 16%|█▋        | 61133/371472 [4:51:58<23:41:15,  3.64it/s]
 16%|█▋        | 61134/371472 [4:51:58<23:33:06,  3.66it/s]
 16%|█▋        | 61135/371472 [4:51:58<24:25:24,  3.53it/s]
 16%|█▋        | 61136/371472 [4:51:59<23:30:54,  3.67it/s]
 16%|█▋        | 61137/371472 [4:51:59<23:50:50,  3.61it/s]
 16%|█▋        | 61138/371472 [4:51:59<22:44:17,  3.79it/s]
 16%|█▋        | 61139/371472 [4:51:59<23:40:57,  3.64it/s]
 16%|█▋        | 61140/371472 [4:52:00<24:03:45,  3.58it/s]
                                                           
{'loss': 4.2313, 'learning_rate': 8.522754207158094e-07, 'epoch': 2.63}

 16%|█▋        | 61140/371472 [4:52:00<24:03:45,  3.58it/s]
 16%|█▋        | 61141/371472 [4:52:00<23:48:56,  3.62it/s]
 16%|█▋        | 61142/371472 [4:52:00<27:51:05,  3.10it/s]
 16%|█▋        | 61143/371472 [4:52:01<27:45:44,  3.11it/s]
 16%|█▋        | 61144/371472 [4:52:01<26:21:12,  3.27it/s]
 16%|█▋        | 61145/371472 [4:52:01<25:05:40,  3.44it/s]
 16%|█▋        | 61146/371472 [4:52:02<25:50:50,  3.34it/s]
 16%|█▋        | 61147/371472 [4:52:02<24:56:37,  3.46it/s]
 16%|█▋        | 61148/371472 [4:52:02<24:34:16,  3.51it/s]
 16%|█▋        | 61149/371472 [4:52:02<23:52:33,  3.61it/s]
 16%|█▋        | 61150/371472 [4:52:03<23:19:18,  3.70it/s]
 16%|█▋        | 61151/371472 [4:52:03<24:03:23,  3.58it/s]
 16%|█▋        | 61152/371472 [4:52:03<23:41:38,  3.64it/s]
 16%|█▋        | 61153/371472 [4:52:03<23:07:25,  3.73it/s]
 16%|█▋        | 61154/371472 [4:52:04<23:19:07,  3.70it/s]
 16%|█▋        | 61155/371472 [4:52:04<22:41:37,  3.80it/s]
 16%|█▋        | 61156/371472 [4:52:04<22:02:16,  3.91it/s]
 16%|█▋        | 61157/371472 [4:52:05<22:05:44,  3.90it/s]
 16%|█▋        | 61158/371472 [4:52:05<21:59:43,  3.92it/s]
 16%|█▋        | 61159/371472 [4:52:05<22:07:18,  3.90it/s]
 16%|█▋        | 61160/371472 [4:52:05<22:45:11,  3.79it/s]
                                                           
{'loss': 4.2971, 'learning_rate': 8.522269387403306e-07, 'epoch': 2.63}

 16%|█▋        | 61160/371472 [4:52:05<22:45:11,  3.79it/s]
 16%|█▋        | 61161/371472 [4:52:06<22:45:19,  3.79it/s]
 16%|█▋        | 61162/371472 [4:52:06<23:49:37,  3.62it/s]
 16%|█▋        | 61163/371472 [4:52:06<23:12:00,  3.72it/s]
 16%|█▋        | 61164/371472 [4:52:06<22:56:27,  3.76it/s]
 16%|█▋        | 61165/371472 [4:52:07<24:27:53,  3.52it/s]
 16%|█▋        | 61166/371472 [4:52:07<23:27:54,  3.67it/s]
 16%|█▋        | 61167/371472 [4:52:07<23:05:15,  3.73it/s]
 16%|█▋        | 61168/371472 [4:52:07<22:53:07,  3.77it/s]
 16%|█▋        | 61169/371472 [4:52:08<22:43:33,  3.79it/s]
 16%|█▋        | 61170/371472 [4:52:08<24:00:49,  3.59it/s]
 16%|█▋        | 61171/371472 [4:52:08<24:37:28,  3.50it/s]
 16%|█▋        | 61172/371472 [4:52:09<26:50:39,  3.21it/s]
 16%|█▋        | 61173/371472 [4:52:09<24:58:34,  3.45it/s]
 16%|█▋        | 61174/371472 [4:52:09<24:58:24,  3.45it/s]
 16%|█▋        | 61175/371472 [4:52:10<29:48:17,  2.89it/s]
 16%|█▋        | 61176/371472 [4:52:10<28:01:05,  3.08it/s]
 16%|█▋        | 61177/371472 [4:52:10<28:31:45,  3.02it/s]
 16%|█▋        | 61178/371472 [4:52:11<27:28:59,  3.14it/s]
 16%|█▋        | 61179/371472 [4:52:11<26:13:10,  3.29it/s]
 16%|█▋        | 61180/371472 [4:52:11<25:07:43,  3.43it/s]
                                                           
{'loss': 4.2572, 'learning_rate': 8.521784567648516e-07, 'epoch': 2.64}

 16%|█▋        | 61180/371472 [4:52:11<25:07:43,  3.43it/s]
 16%|█▋        | 61181/371472 [4:52:11<24:29:36,  3.52it/s]
 16%|█▋        | 61182/371472 [4:52:12<25:07:29,  3.43it/s]
 16%|█▋        | 61183/371472 [4:52:12<25:10:25,  3.42it/s]
 16%|█▋        | 61184/371472 [4:52:12<25:41:46,  3.35it/s]
 16%|█▋        | 61185/371472 [4:52:13<24:12:57,  3.56it/s]
 16%|█▋        | 61186/371472 [4:52:13<23:28:21,  3.67it/s]
 16%|█▋        | 61187/371472 [4:52:13<25:10:57,  3.42it/s]
 16%|█▋        | 61188/371472 [4:52:13<23:55:27,  3.60it/s]
 16%|█▋        | 61189/371472 [4:52:14<23:34:44,  3.66it/s]
 16%|█▋        | 61190/371472 [4:52:14<23:00:43,  3.75it/s]
 16%|█▋        | 61191/371472 [4:52:14<23:07:30,  3.73it/s]
 16%|█▋        | 61192/371472 [4:52:14<23:45:43,  3.63it/s]
 16%|█▋        | 61193/371472 [4:52:15<24:43:33,  3.49it/s]
 16%|█▋        | 61194/371472 [4:52:15<24:47:37,  3.48it/s]
 16%|█▋        | 61195/371472 [4:52:15<24:15:10,  3.55it/s]
 16%|█▋        | 61196/371472 [4:52:16<24:05:27,  3.58it/s]
 16%|█▋        | 61197/371472 [4:52:16<24:50:46,  3.47it/s]
 16%|█▋        | 61198/371472 [4:52:16<24:20:11,  3.54it/s]
 16%|█▋        | 61199/371472 [4:52:16<24:15:43,  3.55it/s]
 16%|█▋        | 61200/371472 [4:52:17<23:14:09,  3.71it/s]
                                                           
{'loss': 4.2868, 'learning_rate': 8.521299747893727e-07, 'epoch': 2.64}

 16%|█▋        | 61200/371472 [4:52:17<23:14:09,  3.71it/s]
 16%|█▋        | 61201/371472 [4:52:17<25:18:41,  3.41it/s]
 16%|█▋        | 61202/371472 [4:52:17<24:24:26,  3.53it/s]
 16%|█▋        | 61203/371472 [4:52:18<24:02:20,  3.59it/s]
 16%|█▋        | 61204/371472 [4:52:18<24:24:53,  3.53it/s]
 16%|█▋        | 61205/371472 [4:52:18<24:04:51,  3.58it/s]
 16%|█▋        | 61206/371472 [4:52:18<24:29:59,  3.52it/s]
 16%|█▋        | 61207/371472 [4:52:19<23:33:50,  3.66it/s]
 16%|█▋        | 61208/371472 [4:52:19<24:44:14,  3.48it/s]
 16%|█▋        | 61209/371472 [4:52:19<23:57:52,  3.60it/s]
 16%|█▋        | 61210/371472 [4:52:20<25:57:04,  3.32it/s]
 16%|█▋        | 61211/371472 [4:52:20<25:57:04,  3.32it/s]
 16%|█▋        | 61212/371472 [4:52:20<25:16:53,  3.41it/s]
 16%|█▋        | 61213/371472 [4:52:21<25:46:12,  3.34it/s]
 16%|█▋        | 61214/371472 [4:52:21<24:27:23,  3.52it/s]
 16%|█▋        | 61215/371472 [4:52:21<23:32:19,  3.66it/s]
 16%|█▋        | 61216/371472 [4:52:21<23:02:50,  3.74it/s]
 16%|█▋        | 61217/371472 [4:52:22<24:00:52,  3.59it/s]
 16%|█▋        | 61218/371472 [4:52:22<24:55:29,  3.46it/s]
 16%|█▋        | 61219/371472 [4:52:22<24:02:19,  3.59it/s]
 16%|█▋        | 61220/371472 [4:52:22<24:35:12,  3.51it/s]
                                                           
{'loss': 4.1524, 'learning_rate': 8.520814928138938e-07, 'epoch': 2.64}

 16%|█▋        | 61220/371472 [4:52:22<24:35:12,  3.51it/s]
 16%|█▋        | 61221/371472 [4:52:23<24:18:53,  3.54it/s]
 16%|█▋        | 61222/371472 [4:52:23<24:20:57,  3.54it/s]
 16%|█▋        | 61223/371472 [4:52:23<24:34:29,  3.51it/s]
 16%|█▋        | 61224/371472 [4:52:24<27:13:46,  3.16it/s]
 16%|█▋        | 61225/371472 [4:52:24<26:17:30,  3.28it/s]
 16%|█▋        | 61226/371472 [4:52:24<25:35:23,  3.37it/s]
 16%|█▋        | 61227/371472 [4:52:25<24:46:10,  3.48it/s]
 16%|█▋        | 61228/371472 [4:52:25<24:40:01,  3.49it/s]
 16%|█▋        | 61229/371472 [4:52:25<24:11:59,  3.56it/s]
 16%|█▋        | 61230/371472 [4:52:25<23:31:23,  3.66it/s]
 16%|█▋        | 61231/371472 [4:52:26<23:07:15,  3.73it/s]
 16%|█▋        | 61232/371472 [4:52:26<24:25:50,  3.53it/s]
 16%|█▋        | 61233/371472 [4:52:26<25:53:09,  3.33it/s]
 16%|█▋        | 61234/371472 [4:52:27<24:34:33,  3.51it/s]
 16%|█▋        | 61235/371472 [4:52:27<23:35:04,  3.65it/s]
 16%|█▋        | 61236/371472 [4:52:27<23:12:41,  3.71it/s]
 16%|█▋        | 61237/371472 [4:52:27<22:54:29,  3.76it/s]
 16%|█▋        | 61238/371472 [4:52:28<24:39:31,  3.49it/s]
 16%|█▋        | 61239/371472 [4:52:28<24:26:22,  3.53it/s]
 16%|█▋        | 61240/371472 [4:52:28<24:34:31,  3.51it/s]
                                                           
{'loss': 4.267, 'learning_rate': 8.520330108384149e-07, 'epoch': 2.64}

 16%|█▋        | 61240/371472 [4:52:28<24:34:31,  3.51it/s]
 16%|█▋        | 61241/371472 [4:52:28<25:02:01,  3.44it/s]
 16%|█▋        | 61242/371472 [4:52:29<25:15:53,  3.41it/s]
 16%|█▋        | 61243/371472 [4:52:29<24:08:26,  3.57it/s]
 16%|█▋        | 61244/371472 [4:52:29<23:26:23,  3.68it/s]
 16%|█▋        | 61245/371472 [4:52:30<22:49:56,  3.77it/s]
 16%|█▋        | 61246/371472 [4:52:30<22:32:14,  3.82it/s]
 16%|█▋        | 61247/371472 [4:52:30<22:29:23,  3.83it/s]
 16%|█▋        | 61248/371472 [4:52:30<23:11:56,  3.71it/s]
 16%|█▋        | 61249/371472 [4:52:31<23:46:45,  3.62it/s]
 16%|█▋        | 61250/371472 [4:52:31<24:07:49,  3.57it/s]
 16%|█▋        | 61251/371472 [4:52:31<24:16:59,  3.55it/s]
 16%|█▋        | 61252/371472 [4:52:31<23:49:56,  3.62it/s]
 16%|█▋        | 61253/371472 [4:52:32<22:53:01,  3.77it/s]
 16%|█▋        | 61254/371472 [4:52:32<22:24:56,  3.84it/s]
 16%|█▋        | 61255/371472 [4:52:32<23:21:46,  3.69it/s]
 16%|█▋        | 61256/371472 [4:52:33<23:27:18,  3.67it/s]
 16%|█▋        | 61257/371472 [4:52:33<22:52:51,  3.77it/s]
 16%|█▋        | 61258/371472 [4:52:33<22:24:06,  3.85it/s]
 16%|█▋        | 61259/371472 [4:52:33<22:43:06,  3.79it/s]
 16%|█▋        | 61260/371472 [4:52:34<22:38:13,  3.81it/s]
                                                           
{'loss': 4.1479, 'learning_rate': 8.51984528862936e-07, 'epoch': 2.64}

 16%|█▋        | 61260/371472 [4:52:34<22:38:13,  3.81it/s]
 16%|█▋        | 61261/371472 [4:52:34<22:06:49,  3.90it/s]
 16%|█▋        | 61262/371472 [4:52:34<22:38:35,  3.81it/s]
 16%|█▋        | 61263/371472 [4:52:34<23:25:17,  3.68it/s]
 16%|█▋        | 61264/371472 [4:52:35<23:45:17,  3.63it/s]
 16%|█▋        | 61265/371472 [4:52:35<23:00:52,  3.74it/s]
 16%|█▋        | 61266/371472 [4:52:35<22:45:52,  3.79it/s]
 16%|█▋        | 61267/371472 [4:52:35<22:07:26,  3.89it/s]
 16%|█▋        | 61268/371472 [4:52:36<22:32:28,  3.82it/s]
 16%|█▋        | 61269/371472 [4:52:36<23:44:24,  3.63it/s]
 16%|█▋        | 61270/371472 [4:52:36<24:34:14,  3.51it/s]
 16%|█▋        | 61271/371472 [4:52:37<24:53:46,  3.46it/s]
 16%|█▋        | 61272/371472 [4:52:37<23:42:32,  3.63it/s]
 16%|█▋        | 61273/371472 [4:52:37<24:11:13,  3.56it/s]
 16%|█▋        | 61274/371472 [4:52:37<24:34:13,  3.51it/s]
 16%|█▋        | 61275/371472 [4:52:38<24:29:39,  3.52it/s]
 16%|█▋        | 61276/371472 [4:52:38<23:52:14,  3.61it/s]
 16%|█▋        | 61277/371472 [4:52:38<26:53:03,  3.21it/s]
 16%|█▋        | 61278/371472 [4:52:39<25:26:10,  3.39it/s]
 16%|█▋        | 61279/371472 [4:52:39<24:52:05,  3.46it/s]
 16%|█▋        | 61280/371472 [4:52:39<24:40:33,  3.49it/s]
                                                           
{'loss': 4.1027, 'learning_rate': 8.519360468874571e-07, 'epoch': 2.64}

 16%|█▋        | 61280/371472 [4:52:39<24:40:33,  3.49it/s]
 16%|█▋        | 61281/371472 [4:52:39<24:57:45,  3.45it/s]
 16%|█▋        | 61282/371472 [4:52:40<25:09:48,  3.42it/s]
 16%|█▋        | 61283/371472 [4:52:40<24:18:21,  3.54it/s]
 16%|█▋        | 61284/371472 [4:52:40<23:52:23,  3.61it/s]
 16%|█▋        | 61285/371472 [4:52:41<24:55:25,  3.46it/s]
 16%|█▋        | 61286/371472 [4:52:41<23:46:28,  3.62it/s]
 16%|█▋        | 61287/371472 [4:52:41<23:39:48,  3.64it/s]
 16%|█▋        | 61288/371472 [4:52:41<23:43:34,  3.63it/s]
 16%|█▋        | 61289/371472 [4:52:42<23:22:20,  3.69it/s]
 16%|█▋        | 61290/371472 [4:52:42<23:25:11,  3.68it/s]
 16%|█▋        | 61291/371472 [4:52:42<22:55:14,  3.76it/s]
 16%|█▋        | 61292/371472 [4:52:42<23:39:42,  3.64it/s]
 17%|█▋        | 61293/371472 [4:52:43<24:44:08,  3.48it/s]
 17%|█▋        | 61294/371472 [4:52:43<24:14:58,  3.55it/s]
 17%|█▋        | 61295/371472 [4:52:43<24:00:19,  3.59it/s]
 17%|█▋        | 61296/371472 [4:52:44<24:18:27,  3.54it/s]
 17%|█▋        | 61297/371472 [4:52:44<23:27:33,  3.67it/s]
 17%|█▋        | 61298/371472 [4:52:44<22:40:52,  3.80it/s]
 17%|█▋        | 61299/371472 [4:52:44<23:31:09,  3.66it/s]
 17%|█▋        | 61300/371472 [4:52:45<24:59:20,  3.45it/s]
                                                           
{'loss': 4.0376, 'learning_rate': 8.518875649119783e-07, 'epoch': 2.64}

 17%|█▋        | 61300/371472 [4:52:45<24:59:20,  3.45it/s]
 17%|█▋        | 61301/371472 [4:52:45<24:35:26,  3.50it/s]
 17%|█▋        | 61302/371472 [4:52:45<23:27:31,  3.67it/s]
 17%|█▋        | 61303/371472 [4:52:45<22:30:35,  3.83it/s]
 17%|█▋        | 61304/371472 [4:52:46<23:14:58,  3.71it/s]
 17%|█▋        | 61305/371472 [4:52:46<24:28:30,  3.52it/s]
 17%|█▋        | 61306/371472 [4:52:46<23:23:27,  3.68it/s]
 17%|█▋        | 61307/371472 [4:52:47<23:15:05,  3.71it/s]
 17%|█▋        | 61308/371472 [4:52:47<23:45:32,  3.63it/s]
 17%|█▋        | 61309/371472 [4:52:47<23:19:02,  3.69it/s]
 17%|█▋        | 61310/371472 [4:52:47<23:52:11,  3.61it/s]
 17%|█▋        | 61311/371472 [4:52:48<24:58:20,  3.45it/s]
 17%|█▋        | 61312/371472 [4:52:48<27:57:45,  3.08it/s]
 17%|█▋        | 61313/371472 [4:52:48<27:51:54,  3.09it/s]
 17%|█▋        | 61314/371472 [4:52:49<27:12:34,  3.17it/s]
 17%|█▋        | 61315/371472 [4:52:49<29:44:06,  2.90it/s]
 17%|█▋        | 61316/371472 [4:52:49<27:13:26,  3.16it/s]
 17%|█▋        | 61317/371472 [4:52:50<25:13:56,  3.41it/s]
 17%|█▋        | 61318/371472 [4:52:50<24:03:11,  3.58it/s]
 17%|█▋        | 61319/371472 [4:52:50<23:49:31,  3.62it/s]
 17%|█▋        | 61320/371472 [4:52:50<23:17:17,  3.70it/s]
                                                           
{'loss': 4.268, 'learning_rate': 8.518390829364994e-07, 'epoch': 2.64}

 17%|█▋        | 61320/371472 [4:52:50<23:17:17,  3.70it/s]
 17%|█▋        | 61321/371472 [4:52:51<22:25:43,  3.84it/s]
 17%|█▋        | 61322/371472 [4:52:51<22:42:48,  3.79it/s]
 17%|█▋        | 61323/371472 [4:52:51<22:32:40,  3.82it/s]
 17%|█▋        | 61324/371472 [4:52:52<23:43:21,  3.63it/s]
 17%|█▋        | 61325/371472 [4:52:52<23:04:25,  3.73it/s]
 17%|█▋        | 61326/371472 [4:52:52<22:23:59,  3.85it/s]
 17%|█▋        | 61327/371472 [4:52:52<24:20:59,  3.54it/s]
 17%|█▋        | 61328/371472 [4:52:53<23:56:31,  3.60it/s]
 17%|█▋        | 61329/371472 [4:52:53<24:09:08,  3.57it/s]
 17%|█▋        | 61330/371472 [4:52:53<23:40:44,  3.64it/s]
 17%|█▋        | 61331/371472 [4:52:53<22:35:52,  3.81it/s]
 17%|█▋        | 61332/371472 [4:52:54<24:47:56,  3.47it/s]
 17%|█▋        | 61333/371472 [4:52:54<27:09:16,  3.17it/s]
 17%|█▋        | 61334/371472 [4:52:54<25:40:32,  3.36it/s]
 17%|█▋        | 61335/371472 [4:52:55<24:12:25,  3.56it/s]
 17%|█▋        | 61336/371472 [4:52:55<25:14:26,  3.41it/s]
 17%|█▋        | 61337/371472 [4:52:55<24:09:07,  3.57it/s]
 17%|█▋        | 61338/371472 [4:52:55<23:38:16,  3.64it/s]
 17%|█▋        | 61339/371472 [4:52:56<24:43:02,  3.49it/s]
 17%|█▋        | 61340/371472 [4:52:56<27:26:31,  3.14it/s]
                                                           
{'loss': 4.4516, 'learning_rate': 8.517906009610204e-07, 'epoch': 2.64}

 17%|█▋        | 61340/371472 [4:52:56<27:26:31,  3.14it/s]
 17%|█▋        | 61341/371472 [4:52:57<27:55:30,  3.08it/s]
 17%|█▋        | 61342/371472 [4:52:57<27:43:25,  3.11it/s]
 17%|█▋        | 61343/371472 [4:52:57<29:19:44,  2.94it/s]
 17%|█▋        | 61344/371472 [4:52:58<28:51:40,  2.98it/s]
 17%|█▋        | 61345/371472 [4:52:58<27:44:02,  3.11it/s]
 17%|█▋        | 61346/371472 [4:52:58<28:45:17,  3.00it/s]
 17%|█▋        | 61347/371472 [4:52:58<27:15:00,  3.16it/s]
 17%|█▋        | 61348/371472 [4:52:59<27:09:27,  3.17it/s]
 17%|█▋        | 61349/371472 [4:52:59<26:26:32,  3.26it/s]
 17%|█▋        | 61350/371472 [4:52:59<26:36:10,  3.24it/s]
 17%|█▋        | 61351/371472 [4:53:00<25:23:54,  3.39it/s]
 17%|█▋        | 61352/371472 [4:53:00<24:08:55,  3.57it/s]
 17%|█▋        | 61353/371472 [4:53:00<26:39:43,  3.23it/s]
 17%|█▋        | 61354/371472 [4:53:01<25:52:45,  3.33it/s]
 17%|█▋        | 61355/371472 [4:53:01<24:50:34,  3.47it/s]
 17%|█▋        | 61356/371472 [4:53:01<23:33:56,  3.66it/s]
 17%|█▋        | 61357/371472 [4:53:01<23:11:09,  3.72it/s]
 17%|█▋        | 61358/371472 [4:53:02<24:20:13,  3.54it/s]
 17%|█▋        | 61359/371472 [4:53:02<23:56:37,  3.60it/s]
 17%|█▋        | 61360/371472 [4:53:02<24:45:55,  3.48it/s]
                                                           
{'loss': 4.144, 'learning_rate': 8.517421189855415e-07, 'epoch': 2.64}

 17%|█▋        | 61360/371472 [4:53:02<24:45:55,  3.48it/s]
 17%|█▋        | 61361/371472 [4:53:02<23:56:18,  3.60it/s]
 17%|█▋        | 61362/371472 [4:53:03<24:50:18,  3.47it/s]
 17%|█▋        | 61363/371472 [4:53:03<24:28:03,  3.52it/s]
 17%|█▋        | 61364/371472 [4:53:03<23:47:23,  3.62it/s]
 17%|█▋        | 61365/371472 [4:53:04<23:58:30,  3.59it/s]
 17%|█▋        | 61366/371472 [4:53:04<24:57:57,  3.45it/s]
 17%|█▋        | 61367/371472 [4:53:04<24:01:53,  3.58it/s]
 17%|█▋        | 61368/371472 [4:53:04<23:27:19,  3.67it/s]
 17%|█▋        | 61369/371472 [4:53:05<23:25:31,  3.68it/s]
 17%|█▋        | 61370/371472 [4:53:05<23:31:55,  3.66it/s]
 17%|█▋        | 61371/371472 [4:53:05<22:42:05,  3.79it/s]
 17%|█▋        | 61372/371472 [4:53:05<22:48:54,  3.78it/s]
 17%|█▋        | 61373/371472 [4:53:06<24:36:28,  3.50it/s]
 17%|█▋        | 61374/371472 [4:53:06<23:36:56,  3.65it/s]
 17%|█▋        | 61375/371472 [4:53:06<23:23:07,  3.68it/s]
 17%|█▋        | 61376/371472 [4:53:07<23:17:53,  3.70it/s]
 17%|█▋        | 61377/371472 [4:53:07<24:07:03,  3.57it/s]
 17%|█▋        | 61378/371472 [4:53:07<23:28:04,  3.67it/s]
 17%|█▋        | 61379/371472 [4:53:07<23:42:19,  3.63it/s]
 17%|█▋        | 61380/371472 [4:53:08<23:01:49,  3.74it/s]
                                                           
{'loss': 4.213, 'learning_rate': 8.516936370100627e-07, 'epoch': 2.64}

 17%|█▋        | 61380/371472 [4:53:08<23:01:49,  3.74it/s]
 17%|█▋        | 61381/371472 [4:53:08<22:29:27,  3.83it/s]
 17%|█▋        | 61382/371472 [4:53:08<23:07:04,  3.73it/s]
 17%|█▋        | 61383/371472 [4:53:08<24:14:02,  3.55it/s]
 17%|█▋        | 61384/371472 [4:53:09<24:55:41,  3.46it/s]
 17%|█▋        | 61385/371472 [4:53:09<23:45:36,  3.63it/s]
 17%|█▋        | 61386/371472 [4:53:09<24:52:33,  3.46it/s]
 17%|█▋        | 61387/371472 [4:53:10<25:57:21,  3.32it/s]
 17%|█▋        | 61388/371472 [4:53:10<25:35:19,  3.37it/s]
 17%|█▋        | 61389/371472 [4:53:10<24:43:29,  3.48it/s]
 17%|█▋        | 61390/371472 [4:53:10<23:51:07,  3.61it/s]
 17%|█▋        | 61391/371472 [4:53:11<24:52:16,  3.46it/s]
 17%|█▋        | 61392/371472 [4:53:11<25:56:39,  3.32it/s]
 17%|█▋        | 61393/371472 [4:53:11<27:16:05,  3.16it/s]
 17%|█▋        | 61394/371472 [4:53:12<26:12:45,  3.29it/s]
 17%|█▋        | 61395/371472 [4:53:12<25:04:44,  3.43it/s]
 17%|█▋        | 61396/371472 [4:53:12<23:45:43,  3.62it/s]
 17%|█▋        | 61397/371472 [4:53:13<24:11:00,  3.56it/s]
 17%|█▋        | 61398/371472 [4:53:13<23:34:42,  3.65it/s]
 17%|█▋        | 61399/371472 [4:53:13<24:01:48,  3.58it/s]
 17%|█▋        | 61400/371472 [4:53:13<23:37:21,  3.65it/s]
                                                           
{'loss': 4.2411, 'learning_rate': 8.516451550345838e-07, 'epoch': 2.64}

 17%|█▋        | 61400/371472 [4:53:13<23:37:21,  3.65it/s]
 17%|█▋        | 61401/371472 [4:53:14<23:23:45,  3.68it/s]
 17%|█▋        | 61402/371472 [4:53:14<23:10:53,  3.72it/s]
 17%|█▋        | 61403/371472 [4:53:14<23:08:15,  3.72it/s]
 17%|█▋        | 61404/371472 [4:53:14<22:47:57,  3.78it/s]
 17%|█▋        | 61405/371472 [4:53:15<22:41:40,  3.80it/s]
 17%|█▋        | 61406/371472 [4:53:15<23:19:01,  3.69it/s]
 17%|█▋        | 61407/371472 [4:53:15<22:46:14,  3.78it/s]
 17%|█▋        | 61408/371472 [4:53:15<22:16:13,  3.87it/s]
 17%|█▋        | 61409/371472 [4:53:16<25:50:33,  3.33it/s]
 17%|█▋        | 61410/371472 [4:53:16<24:53:48,  3.46it/s]
 17%|█▋        | 61411/371472 [4:53:16<25:37:47,  3.36it/s]
 17%|█▋        | 61412/371472 [4:53:17<25:10:16,  3.42it/s]
 17%|█▋        | 61413/371472 [4:53:17<24:01:33,  3.58it/s]
 17%|█▋        | 61414/371472 [4:53:17<23:49:03,  3.62it/s]
 17%|█▋        | 61415/371472 [4:53:18<23:56:06,  3.60it/s]
 17%|█▋        | 61416/371472 [4:53:18<22:54:43,  3.76it/s]
 17%|█▋        | 61417/371472 [4:53:18<24:16:27,  3.55it/s]
 17%|█▋        | 61418/371472 [4:53:18<23:57:10,  3.60it/s]
 17%|█▋        | 61419/371472 [4:53:19<24:09:34,  3.56it/s]
 17%|█▋        | 61420/371472 [4:53:19<25:19:50,  3.40it/s]
                                                           
{'loss': 4.125, 'learning_rate': 8.515966730591048e-07, 'epoch': 2.65}

 17%|█▋        | 61420/371472 [4:53:19<25:19:50,  3.40it/s]
 17%|█▋        | 61421/371472 [4:53:19<26:20:05,  3.27it/s]
 17%|█▋        | 61422/371472 [4:53:20<25:51:21,  3.33it/s]
 17%|█▋        | 61423/371472 [4:53:20<26:12:20,  3.29it/s]
 17%|█▋        | 61424/371472 [4:53:20<24:23:06,  3.53it/s]
 17%|█▋        | 61425/371472 [4:53:20<23:38:20,  3.64it/s]
 17%|█▋        | 61426/371472 [4:53:21<26:38:55,  3.23it/s]
 17%|█▋        | 61427/371472 [4:53:21<26:14:15,  3.28it/s]
 17%|█▋        | 61428/371472 [4:53:21<26:35:11,  3.24it/s]
 17%|█▋        | 61429/371472 [4:53:22<24:59:46,  3.45it/s]
 17%|█▋        | 61430/371472 [4:53:22<23:54:32,  3.60it/s]
 17%|█▋        | 61431/371472 [4:53:22<24:17:32,  3.55it/s]
 17%|█▋        | 61432/371472 [4:53:22<24:24:56,  3.53it/s]
 17%|█▋        | 61433/371472 [4:53:23<25:34:50,  3.37it/s]
 17%|█▋        | 61434/371472 [4:53:23<24:35:39,  3.50it/s]
 17%|█▋        | 61435/371472 [4:53:23<24:31:01,  3.51it/s]
 17%|█▋        | 61436/371472 [4:53:24<25:48:35,  3.34it/s]
 17%|█▋        | 61437/371472 [4:53:24<25:45:20,  3.34it/s]
 17%|█▋        | 61438/371472 [4:53:24<25:28:39,  3.38it/s]
 17%|█▋        | 61439/371472 [4:53:25<24:46:34,  3.48it/s]
 17%|█▋        | 61440/371472 [4:53:25<24:03:52,  3.58it/s]
                                                           
{'loss': 4.2793, 'learning_rate': 8.51548191083626e-07, 'epoch': 2.65}

 17%|█▋        | 61440/371472 [4:53:25<24:03:52,  3.58it/s]
 17%|█▋        | 61441/371472 [4:53:25<22:55:29,  3.76it/s]
 17%|█▋        | 61442/371472 [4:53:25<22:29:33,  3.83it/s]
 17%|█▋        | 61443/371472 [4:53:26<22:55:32,  3.76it/s]
 17%|█▋        | 61444/371472 [4:53:26<22:37:14,  3.81it/s]
 17%|█▋        | 61445/371472 [4:53:26<24:42:25,  3.49it/s]
 17%|█▋        | 61446/371472 [4:53:26<26:15:56,  3.28it/s]
 17%|█▋        | 61447/371472 [4:53:27<25:31:46,  3.37it/s]
 17%|█▋        | 61448/371472 [4:53:27<25:17:35,  3.40it/s]
 17%|█▋        | 61449/371472 [4:53:27<25:23:22,  3.39it/s]
 17%|█▋        | 61450/371472 [4:53:28<24:17:36,  3.54it/s]
 17%|█▋        | 61451/371472 [4:53:28<24:24:29,  3.53it/s]
 17%|█▋        | 61452/371472 [4:53:28<24:56:14,  3.45it/s]
 17%|█▋        | 61453/371472 [4:53:28<24:47:24,  3.47it/s]
 17%|█▋        | 61454/371472 [4:53:29<24:20:37,  3.54it/s]
 17%|█▋        | 61455/371472 [4:53:29<24:13:13,  3.56it/s]
 17%|█▋        | 61456/371472 [4:53:29<24:36:43,  3.50it/s]
 17%|█▋        | 61457/371472 [4:53:30<24:08:46,  3.57it/s]
 17%|█▋        | 61458/371472 [4:53:30<24:38:22,  3.49it/s]
 17%|█▋        | 61459/371472 [4:53:30<23:42:53,  3.63it/s]
 17%|█▋        | 61460/371472 [4:53:30<24:33:28,  3.51it/s]
                                                           
{'loss': 4.1936, 'learning_rate': 8.514997091081471e-07, 'epoch': 2.65}

 17%|█▋        | 61460/371472 [4:53:30<24:33:28,  3.51it/s]
 17%|█▋        | 61461/371472 [4:53:31<24:26:18,  3.52it/s]
 17%|█▋        | 61462/371472 [4:53:31<24:05:14,  3.58it/s]
 17%|█▋        | 61463/371472 [4:53:31<24:28:57,  3.52it/s]
 17%|█▋        | 61464/371472 [4:53:32<24:31:52,  3.51it/s]
 17%|█▋        | 61465/371472 [4:53:32<24:13:35,  3.55it/s]
 17%|█▋        | 61466/371472 [4:53:32<24:23:53,  3.53it/s]
 17%|█▋        | 61467/371472 [4:53:32<24:12:31,  3.56it/s]
 17%|█▋        | 61468/371472 [4:53:33<23:49:05,  3.62it/s]
 17%|█▋        | 61469/371472 [4:53:33<25:07:10,  3.43it/s]
 17%|█▋        | 61470/371472 [4:53:33<26:04:53,  3.30it/s]
 17%|█▋        | 61471/371472 [4:53:34<24:44:28,  3.48it/s]
 17%|█▋        | 61472/371472 [4:53:34<24:40:50,  3.49it/s]
 17%|█▋        | 61473/371472 [4:53:34<24:29:13,  3.52it/s]
 17%|█▋        | 61474/371472 [4:53:34<23:54:30,  3.60it/s]
 17%|█▋        | 61475/371472 [4:53:35<24:09:57,  3.56it/s]
 17%|█▋        | 61476/371472 [4:53:35<23:49:27,  3.61it/s]
 17%|█▋        | 61477/371472 [4:53:35<27:09:57,  3.17it/s]
 17%|█▋        | 61478/371472 [4:53:36<25:46:23,  3.34it/s]
 17%|█▋        | 61479/371472 [4:53:36<26:16:57,  3.28it/s]
 17%|█▋        | 61480/371472 [4:53:36<25:51:33,  3.33it/s]
                                                           
{'loss': 4.3829, 'learning_rate': 8.514512271326681e-07, 'epoch': 2.65}

 17%|█▋        | 61480/371472 [4:53:36<25:51:33,  3.33it/s]
 17%|█▋        | 61481/371472 [4:53:37<25:18:48,  3.40it/s]
 17%|█▋        | 61482/371472 [4:53:37<24:01:33,  3.58it/s]
 17%|█▋        | 61483/371472 [4:53:37<23:59:29,  3.59it/s]
 17%|█▋        | 61484/371472 [4:53:37<23:35:39,  3.65it/s]
 17%|█▋        | 61485/371472 [4:53:38<23:10:08,  3.72it/s]
 17%|█▋        | 61486/371472 [4:53:38<22:47:12,  3.78it/s]
 17%|█▋        | 61487/371472 [4:53:38<23:01:59,  3.74it/s]
 17%|█▋        | 61488/371472 [4:53:38<24:57:29,  3.45it/s]
 17%|█▋        | 61489/371472 [4:53:39<25:10:14,  3.42it/s]
 17%|█▋        | 61490/371472 [4:53:39<24:33:36,  3.51it/s]
 17%|█▋        | 61491/371472 [4:53:39<24:33:05,  3.51it/s]
 17%|█▋        | 61492/371472 [4:53:40<24:51:25,  3.46it/s]
 17%|█▋        | 61493/371472 [4:53:40<23:59:27,  3.59it/s]
 17%|█▋        | 61494/371472 [4:53:40<24:32:31,  3.51it/s]
 17%|█▋        | 61495/371472 [4:53:40<24:51:04,  3.46it/s]
 17%|█▋        | 61496/371472 [4:53:41<25:07:37,  3.43it/s]
 17%|█▋        | 61497/371472 [4:53:41<24:18:13,  3.54it/s]
 17%|█▋        | 61498/371472 [4:53:41<23:58:55,  3.59it/s]
 17%|█▋        | 61499/371472 [4:53:42<23:45:35,  3.62it/s]
 17%|█▋        | 61500/371472 [4:53:42<22:56:41,  3.75it/s]
                                                           
{'loss': 4.0414, 'learning_rate': 8.514027451571892e-07, 'epoch': 2.65}

 17%|█▋        | 61500/371472 [4:53:42<22:56:41,  3.75it/s]
 17%|█▋        | 61501/371472 [4:53:42<22:24:52,  3.84it/s]
 17%|█▋        | 61502/371472 [4:53:42<23:29:38,  3.66it/s]
 17%|█▋        | 61503/371472 [4:53:43<23:18:03,  3.70it/s]
 17%|█▋        | 61504/371472 [4:53:43<23:02:36,  3.74it/s]
 17%|█▋        | 61505/371472 [4:53:43<23:36:34,  3.65it/s]
 17%|█▋        | 61506/371472 [4:53:43<24:01:50,  3.58it/s]
 17%|█▋        | 61507/371472 [4:53:44<24:49:27,  3.47it/s]
 17%|█▋        | 61508/371472 [4:53:44<23:58:52,  3.59it/s]
 17%|█▋        | 61509/371472 [4:53:44<25:23:39,  3.39it/s]
 17%|█▋        | 61510/371472 [4:53:45<24:39:20,  3.49it/s]
 17%|█▋        | 61511/371472 [4:53:45<24:32:56,  3.51it/s]
 17%|█▋        | 61512/371472 [4:53:45<24:01:31,  3.58it/s]
 17%|█▋        | 61513/371472 [4:53:45<23:10:24,  3.72it/s]
 17%|█▋        | 61514/371472 [4:53:46<22:55:14,  3.76it/s]
 17%|█▋        | 61515/371472 [4:53:46<22:09:12,  3.89it/s]
 17%|█▋        | 61516/371472 [4:53:46<22:54:43,  3.76it/s]
 17%|█▋        | 61517/371472 [4:53:46<23:32:19,  3.66it/s]
 17%|█▋        | 61518/371472 [4:53:47<23:09:19,  3.72it/s]
 17%|█▋        | 61519/371472 [4:53:47<22:50:55,  3.77it/s]
 17%|█▋        | 61520/371472 [4:53:47<24:34:57,  3.50it/s]
                                                           
{'loss': 4.3418, 'learning_rate': 8.513542631817104e-07, 'epoch': 2.65}

 17%|█▋        | 61520/371472 [4:53:47<24:34:57,  3.50it/s]
 17%|█▋        | 61521/371472 [4:53:48<25:31:33,  3.37it/s]
 17%|█▋        | 61522/371472 [4:53:48<24:29:46,  3.51it/s]
 17%|█▋        | 61523/371472 [4:53:48<24:23:55,  3.53it/s]
 17%|█▋        | 61524/371472 [4:53:48<24:36:50,  3.50it/s]
 17%|█▋        | 61525/371472 [4:53:49<25:38:16,  3.36it/s]
 17%|█▋        | 61526/371472 [4:53:49<24:35:50,  3.50it/s]
 17%|█▋        | 61527/371472 [4:53:49<23:21:39,  3.69it/s]
 17%|█▋        | 61528/371472 [4:53:50<25:57:27,  3.32it/s]
 17%|█▋        | 61529/371472 [4:53:50<24:42:56,  3.48it/s]
 17%|█▋        | 61530/371472 [4:53:50<24:21:16,  3.54it/s]
 17%|█▋        | 61531/371472 [4:53:50<24:12:23,  3.56it/s]
 17%|█▋        | 61532/371472 [4:53:51<23:23:59,  3.68it/s]
 17%|█▋        | 61533/371472 [4:53:51<23:04:06,  3.73it/s]
 17%|█▋        | 61534/371472 [4:53:51<22:34:41,  3.81it/s]
 17%|█▋        | 61535/371472 [4:53:52<23:42:16,  3.63it/s]
 17%|█▋        | 61536/371472 [4:53:52<26:24:42,  3.26it/s]
 17%|█▋        | 61537/371472 [4:53:52<26:13:28,  3.28it/s]
 17%|█▋        | 61538/371472 [4:53:52<25:04:02,  3.43it/s]
 17%|█▋        | 61539/371472 [4:53:53<24:39:43,  3.49it/s]
 17%|█▋        | 61540/371472 [4:53:53<24:25:07,  3.53it/s]
                                                           
{'loss': 4.2777, 'learning_rate': 8.513057812062316e-07, 'epoch': 2.65}

 17%|█▋        | 61540/371472 [4:53:53<24:25:07,  3.53it/s]
 17%|█▋        | 61541/371472 [4:53:53<23:46:13,  3.62it/s]
 17%|█▋        | 61542/371472 [4:53:54<23:29:54,  3.66it/s]
 17%|█▋        | 61543/371472 [4:53:54<24:26:03,  3.52it/s]
 17%|█▋        | 61544/371472 [4:53:54<24:24:56,  3.53it/s]
 17%|█▋        | 61545/371472 [4:53:54<25:40:13,  3.35it/s]
 17%|█▋        | 61546/371472 [4:53:55<24:53:55,  3.46it/s]
 17%|█▋        | 61547/371472 [4:53:55<24:22:23,  3.53it/s]
 17%|█▋        | 61548/371472 [4:53:55<23:24:04,  3.68it/s]
 17%|█▋        | 61549/371472 [4:53:56<26:00:18,  3.31it/s]
 17%|█▋        | 61550/371472 [4:53:56<25:55:23,  3.32it/s]
 17%|█▋        | 61551/371472 [4:53:56<26:23:33,  3.26it/s]
 17%|█▋        | 61552/371472 [4:53:57<25:40:44,  3.35it/s]
 17%|█▋        | 61553/371472 [4:53:57<24:01:43,  3.58it/s]
 17%|█▋        | 61554/371472 [4:53:57<23:37:12,  3.64it/s]
 17%|█▋        | 61555/371472 [4:53:57<22:50:10,  3.77it/s]
 17%|█▋        | 61556/371472 [4:53:58<22:44:50,  3.78it/s]
 17%|█▋        | 61557/371472 [4:53:58<23:52:44,  3.61it/s]
 17%|█▋        | 61558/371472 [4:53:58<23:37:47,  3.64it/s]
 17%|█▋        | 61559/371472 [4:53:58<23:45:02,  3.62it/s]
 17%|█▋        | 61560/371472 [4:53:59<24:57:47,  3.45it/s]
                                                           
{'loss': 4.075, 'learning_rate': 8.512572992307526e-07, 'epoch': 2.65}

 17%|█▋        | 61560/371472 [4:53:59<24:57:47,  3.45it/s]
 17%|█▋        | 61561/371472 [4:53:59<25:17:57,  3.40it/s]
 17%|█▋        | 61562/371472 [4:53:59<25:17:07,  3.40it/s]
 17%|█▋        | 61563/371472 [4:54:00<25:30:31,  3.37it/s]
 17%|█▋        | 61564/371472 [4:54:00<25:24:56,  3.39it/s]
 17%|█▋        | 61565/371472 [4:54:00<25:31:00,  3.37it/s]
 17%|█▋        | 61566/371472 [4:54:00<24:23:09,  3.53it/s]
 17%|█▋        | 61567/371472 [4:54:01<23:16:53,  3.70it/s]
 17%|█▋        | 61568/371472 [4:54:01<23:26:17,  3.67it/s]
 17%|█▋        | 61569/371472 [4:54:01<22:56:30,  3.75it/s]
 17%|█▋        | 61570/371472 [4:54:01<23:02:26,  3.74it/s]
 17%|█▋        | 61571/371472 [4:54:02<23:13:01,  3.71it/s]
 17%|█▋        | 61572/371472 [4:54:02<22:58:54,  3.75it/s]
 17%|█▋        | 61573/371472 [4:54:02<24:21:01,  3.54it/s]
 17%|█▋        | 61574/371472 [4:54:03<23:34:23,  3.65it/s]
 17%|█▋        | 61575/371472 [4:54:03<27:07:06,  3.17it/s]
 17%|█▋        | 61576/371472 [4:54:03<25:52:46,  3.33it/s]
 17%|█▋        | 61577/371472 [4:54:04<24:29:52,  3.51it/s]
 17%|█▋        | 61578/371472 [4:54:04<26:15:20,  3.28it/s]
 17%|█▋        | 61579/371472 [4:54:04<27:14:49,  3.16it/s]
 17%|█▋        | 61580/371472 [4:54:05<26:32:59,  3.24it/s]
                                                           
{'loss': 4.2111, 'learning_rate': 8.512088172552737e-07, 'epoch': 2.65}

 17%|█▋        | 61580/371472 [4:54:05<26:32:59,  3.24it/s]
 17%|█▋        | 61581/371472 [4:54:05<26:12:19,  3.28it/s]
 17%|█▋        | 61582/371472 [4:54:05<24:52:15,  3.46it/s]
 17%|█▋        | 61583/371472 [4:54:05<24:46:04,  3.48it/s]
 17%|█▋        | 61584/371472 [4:54:06<24:05:52,  3.57it/s]
 17%|█▋        | 61585/371472 [4:54:06<23:29:58,  3.66it/s]
 17%|█▋        | 61586/371472 [4:54:06<23:37:39,  3.64it/s]
 17%|█▋        | 61587/371472 [4:54:06<25:22:20,  3.39it/s]
 17%|█▋        | 61588/371472 [4:54:07<25:03:37,  3.43it/s]
 17%|█▋        | 61589/371472 [4:54:07<25:11:50,  3.42it/s]
 17%|█▋        | 61590/371472 [4:54:07<24:11:23,  3.56it/s]
 17%|█▋        | 61591/371472 [4:54:08<24:29:24,  3.51it/s]
 17%|█▋        | 61592/371472 [4:54:08<25:00:45,  3.44it/s]
 17%|█▋        | 61593/371472 [4:54:08<27:01:43,  3.18it/s]
 17%|█▋        | 61594/371472 [4:54:09<26:20:02,  3.27it/s]
 17%|█▋        | 61595/371472 [4:54:09<27:25:53,  3.14it/s]
 17%|█▋        | 61596/371472 [4:54:09<25:44:20,  3.34it/s]
 17%|█▋        | 61597/371472 [4:54:09<25:35:35,  3.36it/s]
 17%|█▋        | 61598/371472 [4:54:10<24:53:54,  3.46it/s]
 17%|█▋        | 61599/371472 [4:54:10<23:52:37,  3.60it/s]
 17%|█▋        | 61600/371472 [4:54:10<24:04:22,  3.58it/s]
                                                           
{'loss': 4.0313, 'learning_rate': 8.511603352797948e-07, 'epoch': 2.65}

 17%|█▋        | 61600/371472 [4:54:10<24:04:22,  3.58it/s]
 17%|█▋        | 61601/371472 [4:54:11<23:34:45,  3.65it/s]
 17%|█▋        | 61602/371472 [4:54:11<24:22:22,  3.53it/s]
 17%|█▋        | 61603/371472 [4:54:11<23:50:07,  3.61it/s]
 17%|█▋        | 61604/371472 [4:54:11<23:33:47,  3.65it/s]
 17%|█▋        | 61605/371472 [4:54:12<24:14:19,  3.55it/s]
 17%|█▋        | 61606/371472 [4:54:12<24:06:01,  3.57it/s]
 17%|█▋        | 61607/371472 [4:54:12<24:13:22,  3.55it/s]
 17%|█▋        | 61608/371472 [4:54:13<25:43:56,  3.34it/s]
 17%|█▋        | 61609/371472 [4:54:13<24:32:33,  3.51it/s]
 17%|█▋        | 61610/371472 [4:54:13<23:56:25,  3.60it/s]
 17%|█▋        | 61611/371472 [4:54:13<24:01:35,  3.58it/s]
 17%|█▋        | 61612/371472 [4:54:14<23:51:05,  3.61it/s]
 17%|█▋        | 61613/371472 [4:54:14<23:05:34,  3.73it/s]
 17%|█▋        | 61614/371472 [4:54:14<22:58:20,  3.75it/s]
 17%|█▋        | 61615/371472 [4:54:14<23:49:15,  3.61it/s]
 17%|█▋        | 61616/371472 [4:54:15<24:02:00,  3.58it/s]
 17%|█▋        | 61617/371472 [4:54:15<22:53:18,  3.76it/s]
 17%|█▋        | 61618/371472 [4:54:15<22:17:24,  3.86it/s]
 17%|█▋        | 61619/371472 [4:54:15<22:06:35,  3.89it/s]
 17%|█▋        | 61620/371472 [4:54:16<24:32:22,  3.51it/s]
                                                           
{'loss': 4.1522, 'learning_rate': 8.51111853304316e-07, 'epoch': 2.65}

 17%|█▋        | 61620/371472 [4:54:16<24:32:22,  3.51it/s]
 17%|█▋        | 61621/371472 [4:54:16<24:29:55,  3.51it/s]
 17%|█▋        | 61622/371472 [4:54:16<23:31:09,  3.66it/s]
 17%|█▋        | 61623/371472 [4:54:17<24:21:45,  3.53it/s]
 17%|█▋        | 61624/371472 [4:54:17<24:41:28,  3.49it/s]
 17%|█▋        | 61625/371472 [4:54:17<23:48:37,  3.61it/s]
 17%|█▋        | 61626/371472 [4:54:18<24:41:29,  3.49it/s]
 17%|█▋        | 61627/371472 [4:54:18<24:05:01,  3.57it/s]
 17%|█▋        | 61628/371472 [4:54:18<25:27:11,  3.38it/s]
 17%|█▋        | 61629/371472 [4:54:18<24:53:51,  3.46it/s]
 17%|█▋        | 61630/371472 [4:54:19<25:07:14,  3.43it/s]
 17%|█▋        | 61631/371472 [4:54:19<25:26:29,  3.38it/s]
 17%|█▋        | 61632/371472 [4:54:19<25:40:39,  3.35it/s]
 17%|█▋        | 61633/371472 [4:54:20<25:08:16,  3.42it/s]
 17%|█▋        | 61634/371472 [4:54:20<26:10:29,  3.29it/s]
 17%|█▋        | 61635/371472 [4:54:20<25:03:30,  3.43it/s]
 17%|█▋        | 61636/371472 [4:54:20<25:20:48,  3.40it/s]
 17%|█▋        | 61637/371472 [4:54:21<24:40:41,  3.49it/s]
 17%|█▋        | 61638/371472 [4:54:21<24:03:51,  3.58it/s]
 17%|█▋        | 61639/371472 [4:54:21<24:08:26,  3.57it/s]
 17%|█▋        | 61640/371472 [4:54:22<26:20:29,  3.27it/s]
                                                           
{'loss': 4.1889, 'learning_rate': 8.51063371328837e-07, 'epoch': 2.65}

 17%|█▋        | 61640/371472 [4:54:22<26:20:29,  3.27it/s]
 17%|█▋        | 61641/371472 [4:54:22<25:04:11,  3.43it/s]
 17%|█▋        | 61642/371472 [4:54:22<23:51:21,  3.61it/s]
 17%|█▋        | 61643/371472 [4:54:23<26:30:03,  3.25it/s]
 17%|█▋        | 61644/371472 [4:54:23<25:34:50,  3.36it/s]
 17%|█▋        | 61645/371472 [4:54:23<24:28:00,  3.52it/s]
 17%|█▋        | 61646/371472 [4:54:23<23:48:13,  3.62it/s]
 17%|█▋        | 61647/371472 [4:54:24<23:35:24,  3.65it/s]
 17%|█▋        | 61648/371472 [4:54:24<24:25:11,  3.52it/s]
 17%|█▋        | 61649/371472 [4:54:24<25:37:22,  3.36it/s]
 17%|█▋        | 61650/371472 [4:54:25<25:42:45,  3.35it/s]
 17%|█▋        | 61651/371472 [4:54:25<24:53:41,  3.46it/s]
 17%|█▋        | 61652/371472 [4:54:25<24:18:25,  3.54it/s]
 17%|█▋        | 61653/371472 [4:54:25<23:49:08,  3.61it/s]
 17%|█▋        | 61654/371472 [4:54:26<25:19:20,  3.40it/s]
 17%|█▋        | 61655/371472 [4:54:26<24:00:08,  3.59it/s]
 17%|█▋        | 61656/371472 [4:54:26<25:26:38,  3.38it/s]
 17%|█▋        | 61657/371472 [4:54:26<24:59:30,  3.44it/s]
 17%|█▋        | 61658/371472 [4:54:27<25:18:27,  3.40it/s]
 17%|█▋        | 61659/371472 [4:54:27<24:42:51,  3.48it/s]
 17%|█▋        | 61660/371472 [4:54:27<24:43:49,  3.48it/s]
                                                           
{'loss': 4.0174, 'learning_rate': 8.510148893533581e-07, 'epoch': 2.66}

 17%|█▋        | 61660/371472 [4:54:27<24:43:49,  3.48it/s]
 17%|█▋        | 61661/371472 [4:54:28<25:07:16,  3.43it/s]
 17%|█▋        | 61662/371472 [4:54:28<23:42:52,  3.63it/s]
 17%|█▋        | 61663/371472 [4:54:28<23:32:18,  3.66it/s]
 17%|█▋        | 61664/371472 [4:54:28<23:30:39,  3.66it/s]
 17%|█▋        | 61665/371472 [4:54:29<23:08:04,  3.72it/s]
 17%|█▋        | 61666/371472 [4:54:29<23:53:03,  3.60it/s]
 17%|█▋        | 61667/371472 [4:54:29<23:47:22,  3.62it/s]
 17%|█▋        | 61668/371472 [4:54:30<24:21:27,  3.53it/s]
 17%|█▋        | 61669/371472 [4:54:30<24:04:33,  3.57it/s]
 17%|█▋        | 61670/371472 [4:54:30<24:01:29,  3.58it/s]
 17%|█▋        | 61671/371472 [4:54:30<24:06:04,  3.57it/s]
 17%|█▋        | 61672/371472 [4:54:31<23:41:50,  3.63it/s]
 17%|█▋        | 61673/371472 [4:54:31<24:14:48,  3.55it/s]
 17%|█▋        | 61674/371472 [4:54:31<24:49:47,  3.47it/s]
 17%|█▋        | 61675/371472 [4:54:32<23:57:11,  3.59it/s]
 17%|█▋        | 61676/371472 [4:54:32<23:14:25,  3.70it/s]
 17%|█▋        | 61677/371472 [4:54:32<23:38:00,  3.64it/s]
 17%|█▋        | 61678/371472 [4:54:32<23:07:42,  3.72it/s]
 17%|█▋        | 61679/371472 [4:54:33<23:35:00,  3.65it/s]
 17%|█▋        | 61680/371472 [4:54:33<24:04:53,  3.57it/s]
                                                           
{'loss': 4.1852, 'learning_rate': 8.509664073778793e-07, 'epoch': 2.66}

 17%|█▋        | 61680/371472 [4:54:33<24:04:53,  3.57it/s]
 17%|█▋        | 61681/371472 [4:54:33<25:37:41,  3.36it/s]
 17%|█▋        | 61682/371472 [4:54:33<24:30:14,  3.51it/s]
 17%|█▋        | 61683/371472 [4:54:34<24:15:51,  3.55it/s]
 17%|█▋        | 61684/371472 [4:54:34<25:34:11,  3.37it/s]
 17%|█▋        | 61685/371472 [4:54:34<25:31:16,  3.37it/s]
 17%|█▋        | 61686/371472 [4:54:35<26:03:42,  3.30it/s]
 17%|█▋        | 61687/371472 [4:54:35<24:51:37,  3.46it/s]
 17%|█▋        | 61688/371472 [4:54:35<24:21:01,  3.53it/s]
 17%|█▋        | 61689/371472 [4:54:35<23:35:08,  3.65it/s]
 17%|█▋        | 61690/371472 [4:54:36<22:39:25,  3.80it/s]
 17%|█▋        | 61691/371472 [4:54:36<23:01:19,  3.74it/s]
 17%|█▋        | 61692/371472 [4:54:36<23:08:05,  3.72it/s]
 17%|█▋        | 61693/371472 [4:54:37<24:11:55,  3.56it/s]
 17%|█▋        | 61694/371472 [4:54:37<25:02:41,  3.44it/s]
 17%|█▋        | 61695/371472 [4:54:37<23:50:24,  3.61it/s]
 17%|█▋        | 61696/371472 [4:54:37<22:55:48,  3.75it/s]
 17%|█▋        | 61697/371472 [4:54:38<23:28:31,  3.67it/s]
 17%|█▋        | 61698/371472 [4:54:38<22:59:42,  3.74it/s]
 17%|█▋        | 61699/371472 [4:54:38<22:52:18,  3.76it/s]
 17%|█▋        | 61700/371472 [4:54:38<22:57:09,  3.75it/s]
                                                           
{'loss': 4.2706, 'learning_rate': 8.509179254024005e-07, 'epoch': 2.66}

 17%|█▋        | 61700/371472 [4:54:38<22:57:09,  3.75it/s]
 17%|█▋        | 61701/371472 [4:54:39<31:19:37,  2.75it/s]
 17%|█▋        | 61702/371472 [4:54:39<29:39:21,  2.90it/s]
 17%|█▋        | 61703/371472 [4:54:40<27:44:32,  3.10it/s]
 17%|█▋        | 61704/371472 [4:54:40<25:41:33,  3.35it/s]
 17%|█▋        | 61705/371472 [4:54:40<26:32:51,  3.24it/s]
 17%|█▋        | 61706/371472 [4:54:40<25:15:27,  3.41it/s]
 17%|█▋        | 61707/371472 [4:54:41<24:17:57,  3.54it/s]
 17%|█▋        | 61708/371472 [4:54:41<23:42:46,  3.63it/s]
 17%|█▋        | 61709/371472 [4:54:41<23:07:12,  3.72it/s]
 17%|█▋        | 61710/371472 [4:54:41<22:41:39,  3.79it/s]
 17%|█▋        | 61711/371472 [4:54:42<23:01:59,  3.74it/s]
 17%|█▋        | 61712/371472 [4:54:42<23:23:07,  3.68it/s]
 17%|█▋        | 61713/371472 [4:54:42<23:43:14,  3.63it/s]
 17%|█▋        | 61714/371472 [4:54:43<23:32:35,  3.65it/s]
 17%|█▋        | 61715/371472 [4:54:43<23:18:57,  3.69it/s]
 17%|█▋        | 61716/371472 [4:54:43<22:35:02,  3.81it/s]
 17%|█▋        | 61717/371472 [4:54:43<22:49:01,  3.77it/s]
 17%|█▋        | 61718/371472 [4:54:44<22:42:03,  3.79it/s]
 17%|█▋        | 61719/371472 [4:54:44<21:58:10,  3.92it/s]
 17%|█▋        | 61720/371472 [4:54:44<23:01:52,  3.74it/s]
                                                           
{'loss': 4.218, 'learning_rate': 8.508694434269214e-07, 'epoch': 2.66}

 17%|█▋        | 61720/371472 [4:54:44<23:01:52,  3.74it/s]
 17%|█▋        | 61721/371472 [4:54:44<22:38:28,  3.80it/s]
 17%|█▋        | 61722/371472 [4:54:45<22:38:25,  3.80it/s]
 17%|█▋        | 61723/371472 [4:54:45<22:06:07,  3.89it/s]
 17%|█▋        | 61724/371472 [4:54:45<23:13:42,  3.70it/s]
 17%|█▋        | 61725/371472 [4:54:45<23:34:08,  3.65it/s]
 17%|█▋        | 61726/371472 [4:54:46<24:49:15,  3.47it/s]
 17%|█▋        | 61727/371472 [4:54:46<24:01:03,  3.58it/s]
 17%|█▋        | 61728/371472 [4:54:46<23:21:21,  3.68it/s]
 17%|█▋        | 61729/371472 [4:54:47<23:31:08,  3.66it/s]
 17%|█▋        | 61730/371472 [4:54:47<24:35:32,  3.50it/s]
 17%|█▋        | 61731/371472 [4:54:47<27:31:08,  3.13it/s]
 17%|█▋        | 61732/371472 [4:54:48<26:46:06,  3.21it/s]
 17%|█▋        | 61733/371472 [4:54:48<25:13:59,  3.41it/s]
 17%|█▋        | 61734/371472 [4:54:48<24:21:27,  3.53it/s]
 17%|█▋        | 61735/371472 [4:54:48<24:24:10,  3.53it/s]
 17%|█▋        | 61736/371472 [4:54:49<23:50:23,  3.61it/s]
 17%|█▋        | 61737/371472 [4:54:49<23:48:04,  3.61it/s]
 17%|█▋        | 61738/371472 [4:54:49<23:07:00,  3.72it/s]
 17%|█▋        | 61739/371472 [4:54:49<23:36:39,  3.64it/s]
 17%|█▋        | 61740/371472 [4:54:50<23:05:07,  3.73it/s]
                                                           
{'loss': 4.1876, 'learning_rate': 8.508209614514424e-07, 'epoch': 2.66}

 17%|█▋        | 61740/371472 [4:54:50<23:05:07,  3.73it/s]
 17%|█▋        | 61741/371472 [4:54:50<23:43:25,  3.63it/s]
 17%|█▋        | 61742/371472 [4:54:50<23:44:47,  3.62it/s]
 17%|█▋        | 61743/371472 [4:54:51<25:15:17,  3.41it/s]
 17%|█▋        | 61744/371472 [4:54:51<24:28:02,  3.52it/s]
 17%|█▋        | 61745/371472 [4:54:51<23:27:18,  3.67it/s]
 17%|█▋        | 61746/371472 [4:54:51<23:53:26,  3.60it/s]
 17%|█▋        | 61747/371472 [4:54:52<23:19:06,  3.69it/s]
 17%|█▋        | 61748/371472 [4:54:52<23:10:31,  3.71it/s]
 17%|█▋        | 61749/371472 [4:54:52<23:35:26,  3.65it/s]
 17%|█▋        | 61750/371472 [4:54:52<22:49:00,  3.77it/s]
 17%|█▋        | 61751/371472 [4:54:53<23:16:14,  3.70it/s]
 17%|█▋        | 61752/371472 [4:54:53<23:00:49,  3.74it/s]
 17%|█▋        | 61753/371472 [4:54:53<22:40:52,  3.79it/s]
 17%|█▋        | 61754/371472 [4:54:54<24:32:28,  3.51it/s]
 17%|█▋        | 61755/371472 [4:54:54<24:45:53,  3.47it/s]
 17%|█▋        | 61756/371472 [4:54:54<23:57:29,  3.59it/s]
 17%|█▋        | 61757/371472 [4:54:54<23:56:21,  3.59it/s]
 17%|█▋        | 61758/371472 [4:54:55<23:14:14,  3.70it/s]
 17%|█▋        | 61759/371472 [4:54:55<24:26:44,  3.52it/s]
 17%|█▋        | 61760/371472 [4:54:55<24:34:41,  3.50it/s]
                                                           
{'loss': 4.1555, 'learning_rate': 8.507724794759637e-07, 'epoch': 2.66}

 17%|█▋        | 61760/371472 [4:54:55<24:34:41,  3.50it/s]
 17%|█▋        | 61761/371472 [4:54:56<25:42:45,  3.35it/s]
 17%|█▋        | 61762/371472 [4:54:56<25:53:11,  3.32it/s]
 17%|█▋        | 61763/371472 [4:54:56<26:22:38,  3.26it/s]
 17%|█▋        | 61764/371472 [4:54:57<27:18:35,  3.15it/s]
 17%|█▋        | 61765/371472 [4:54:57<25:44:29,  3.34it/s]
 17%|█▋        | 61766/371472 [4:54:57<25:42:38,  3.35it/s]
 17%|█▋        | 61767/371472 [4:54:58<27:40:45,  3.11it/s]
 17%|█▋        | 61768/371472 [4:54:58<26:18:22,  3.27it/s]
 17%|█▋        | 61769/371472 [4:54:58<25:02:30,  3.44it/s]
 17%|█▋        | 61770/371472 [4:54:58<27:16:16,  3.15it/s]
 17%|█▋        | 61771/371472 [4:54:59<26:09:40,  3.29it/s]
 17%|█▋        | 61772/371472 [4:54:59<26:35:37,  3.23it/s]
 17%|█▋        | 61773/371472 [4:54:59<27:09:30,  3.17it/s]
 17%|█▋        | 61774/371472 [4:55:00<27:14:39,  3.16it/s]
 17%|█▋        | 61775/371472 [4:55:00<25:09:31,  3.42it/s]
 17%|█▋        | 61776/371472 [4:55:00<24:47:10,  3.47it/s]
 17%|█▋        | 61777/371472 [4:55:01<27:03:38,  3.18it/s]
 17%|█▋        | 61778/371472 [4:55:01<27:29:32,  3.13it/s]
 17%|█▋        | 61779/371472 [4:55:01<25:43:23,  3.34it/s]
 17%|█▋        | 61780/371472 [4:55:01<24:00:29,  3.58it/s]
                                                           
{'loss': 3.943, 'learning_rate': 8.507239975004847e-07, 'epoch': 2.66}

 17%|█▋        | 61780/371472 [4:55:01<24:00:29,  3.58it/s]
 17%|█▋        | 61781/371472 [4:55:02<24:19:21,  3.54it/s]
 17%|█▋        | 61782/371472 [4:55:02<24:12:16,  3.55it/s]
 17%|█▋        | 61783/371472 [4:55:02<23:50:41,  3.61it/s]
 17%|█▋        | 61784/371472 [4:55:03<24:15:29,  3.55it/s]
 17%|█▋        | 61785/371472 [4:55:03<24:39:38,  3.49it/s]
 17%|█▋        | 61786/371472 [4:55:03<24:08:21,  3.56it/s]
 17%|█▋        | 61787/371472 [4:55:03<23:38:54,  3.64it/s]
 17%|█▋        | 61788/371472 [4:55:04<23:26:27,  3.67it/s]
 17%|█▋        | 61789/371472 [4:55:04<22:43:41,  3.78it/s]
 17%|█▋        | 61790/371472 [4:55:04<24:24:10,  3.53it/s]
 17%|█▋        | 61791/371472 [4:55:04<24:21:25,  3.53it/s]
 17%|█▋        | 61792/371472 [4:55:05<23:27:58,  3.67it/s]
 17%|█▋        | 61793/371472 [4:55:05<23:17:48,  3.69it/s]
 17%|█▋        | 61794/371472 [4:55:05<23:11:57,  3.71it/s]
 17%|█▋        | 61795/371472 [4:55:05<22:34:39,  3.81it/s]
 17%|█▋        | 61796/371472 [4:55:06<22:58:41,  3.74it/s]
 17%|█▋        | 61797/371472 [4:55:06<24:05:30,  3.57it/s]
 17%|█▋        | 61798/371472 [4:55:06<23:57:18,  3.59it/s]
 17%|█▋        | 61799/371472 [4:55:07<23:34:30,  3.65it/s]
 17%|█▋        | 61800/371472 [4:55:07<23:16:15,  3.70it/s]
                                                           
{'loss': 4.1855, 'learning_rate': 8.506755155250059e-07, 'epoch': 2.66}

 17%|█▋        | 61800/371472 [4:55:07<23:16:15,  3.70it/s]
 17%|█▋        | 61801/371472 [4:55:07<23:34:11,  3.65it/s]
 17%|█▋        | 61802/371472 [4:55:07<24:21:13,  3.53it/s]
 17%|█▋        | 61803/371472 [4:55:08<23:53:50,  3.60it/s]
 17%|█▋        | 61804/371472 [4:55:08<23:24:00,  3.68it/s]
 17%|█▋        | 61805/371472 [4:55:08<23:42:06,  3.63it/s]
 17%|█▋        | 61806/371472 [4:55:09<23:24:31,  3.67it/s]
 17%|█▋        | 61807/371472 [4:55:09<23:39:09,  3.64it/s]
 17%|█▋        | 61808/371472 [4:55:09<23:42:49,  3.63it/s]
 17%|█▋        | 61809/371472 [4:55:09<24:20:14,  3.53it/s]
 17%|█▋        | 61810/371472 [4:55:10<25:33:36,  3.37it/s]
 17%|█▋        | 61811/371472 [4:55:10<24:22:06,  3.53it/s]
 17%|█▋        | 61812/371472 [4:55:10<24:54:41,  3.45it/s]
 17%|█▋        | 61813/371472 [4:55:11<25:50:29,  3.33it/s]
 17%|█▋        | 61814/371472 [4:55:11<26:51:27,  3.20it/s]
 17%|█▋        | 61815/371472 [4:55:11<27:18:44,  3.15it/s]
 17%|█▋        | 61816/371472 [4:55:12<27:26:57,  3.13it/s]
 17%|█▋        | 61817/371472 [4:55:12<26:23:46,  3.26it/s]
 17%|█▋        | 61818/371472 [4:55:12<25:53:54,  3.32it/s]
 17%|█▋        | 61819/371472 [4:55:12<25:25:42,  3.38it/s]
 17%|█▋        | 61820/371472 [4:55:13<24:38:26,  3.49it/s]
                                                           
{'loss': 4.0555, 'learning_rate': 8.50627033549527e-07, 'epoch': 2.66}

 17%|█▋        | 61820/371472 [4:55:13<24:38:26,  3.49it/s]
 17%|█▋        | 61821/371472 [4:55:13<23:25:52,  3.67it/s]
 17%|█▋        | 61822/371472 [4:55:13<25:34:00,  3.36it/s]
 17%|█▋        | 61823/371472 [4:55:14<25:13:19,  3.41it/s]
 17%|█▋        | 61824/371472 [4:55:14<25:53:15,  3.32it/s]
 17%|█▋        | 61825/371472 [4:55:14<25:32:16,  3.37it/s]
 17%|█▋        | 61826/371472 [4:55:15<25:48:28,  3.33it/s]
 17%|█▋        | 61827/371472 [4:55:15<25:35:45,  3.36it/s]
 17%|█▋        | 61828/371472 [4:55:15<27:42:50,  3.10it/s]
 17%|█▋        | 61829/371472 [4:55:15<25:54:14,  3.32it/s]
 17%|█▋        | 61830/371472 [4:55:16<25:01:22,  3.44it/s]
 17%|█▋        | 61831/371472 [4:55:16<25:59:01,  3.31it/s]
 17%|█▋        | 61832/371472 [4:55:16<24:33:06,  3.50it/s]
 17%|█▋        | 61833/371472 [4:55:17<23:53:59,  3.60it/s]
 17%|█▋        | 61834/371472 [4:55:17<23:17:07,  3.69it/s]
 17%|█▋        | 61835/371472 [4:55:17<24:01:25,  3.58it/s]
 17%|█▋        | 61836/371472 [4:55:17<24:03:57,  3.57it/s]
 17%|█▋        | 61837/371472 [4:55:18<24:45:44,  3.47it/s]
 17%|█▋        | 61838/371472 [4:55:18<24:22:23,  3.53it/s]
 17%|█▋        | 61839/371472 [4:55:18<24:31:29,  3.51it/s]
 17%|█▋        | 61840/371472 [4:55:18<23:41:50,  3.63it/s]
                                                           
{'loss': 4.0709, 'learning_rate': 8.505785515740481e-07, 'epoch': 2.66}

 17%|█▋        | 61840/371472 [4:55:18<23:41:50,  3.63it/s]
 17%|█▋        | 61841/371472 [4:55:19<23:01:04,  3.74it/s]
 17%|█▋        | 61842/371472 [4:55:19<23:19:28,  3.69it/s]
 17%|█▋        | 61843/371472 [4:55:19<22:52:39,  3.76it/s]
 17%|█▋        | 61844/371472 [4:55:20<24:08:04,  3.56it/s]
 17%|█▋        | 61845/371472 [4:55:20<23:52:45,  3.60it/s]
 17%|█▋        | 61846/371472 [4:55:20<23:20:12,  3.69it/s]
 17%|█▋        | 61847/371472 [4:55:20<25:03:21,  3.43it/s]
 17%|█▋        | 61848/371472 [4:55:21<26:00:45,  3.31it/s]
 17%|█▋        | 61849/371472 [4:55:21<25:51:27,  3.33it/s]
 17%|█▋        | 61850/371472 [4:55:21<27:38:48,  3.11it/s]
 17%|█▋        | 61851/371472 [4:55:22<27:35:25,  3.12it/s]
 17%|█▋        | 61852/371472 [4:55:22<26:07:49,  3.29it/s]
 17%|█▋        | 61853/371472 [4:55:22<27:56:50,  3.08it/s]
 17%|█▋        | 61854/371472 [4:55:23<25:59:17,  3.31it/s]
 17%|█▋        | 61855/371472 [4:55:23<25:05:13,  3.43it/s]
 17%|█▋        | 61856/371472 [4:55:23<25:05:09,  3.43it/s]
 17%|█▋        | 61857/371472 [4:55:23<24:04:05,  3.57it/s]
 17%|█▋        | 61858/371472 [4:55:24<23:11:34,  3.71it/s]
 17%|█▋        | 61859/371472 [4:55:24<24:06:58,  3.57it/s]
 17%|█▋        | 61860/371472 [4:55:24<23:18:17,  3.69it/s]
                                                           
{'loss': 4.2282, 'learning_rate': 8.505300695985691e-07, 'epoch': 2.66}

 17%|█▋        | 61860/371472 [4:55:24<23:18:17,  3.69it/s]
 17%|█▋        | 61861/371472 [4:55:25<25:38:15,  3.35it/s]
 17%|█▋        | 61862/371472 [4:55:25<25:32:44,  3.37it/s]
 17%|█▋        | 61863/371472 [4:55:25<25:18:57,  3.40it/s]
 17%|█▋        | 61864/371472 [4:55:25<24:22:32,  3.53it/s]
 17%|█▋        | 61865/371472 [4:55:26<24:01:21,  3.58it/s]
 17%|█▋        | 61866/371472 [4:55:26<24:45:19,  3.47it/s]
 17%|█▋        | 61867/371472 [4:55:26<25:01:23,  3.44it/s]
 17%|█▋        | 61868/371472 [4:55:27<24:43:34,  3.48it/s]
 17%|█▋        | 61869/371472 [4:55:27<24:39:40,  3.49it/s]
 17%|█▋        | 61870/371472 [4:55:27<25:57:54,  3.31it/s]
 17%|█▋        | 61871/371472 [4:55:28<24:46:44,  3.47it/s]
 17%|█▋        | 61872/371472 [4:55:28<26:06:31,  3.29it/s]
 17%|█▋        | 61873/371472 [4:55:28<25:47:08,  3.34it/s]
 17%|█▋        | 61874/371472 [4:55:28<25:12:00,  3.41it/s]
 17%|█▋        | 61875/371472 [4:55:29<25:28:39,  3.38it/s]
 17%|█▋        | 61876/371472 [4:55:29<28:06:31,  3.06it/s]
 17%|█▋        | 61877/371472 [4:55:29<26:30:52,  3.24it/s]
 17%|█▋        | 61878/371472 [4:55:30<25:55:49,  3.32it/s]
 17%|█▋        | 61879/371472 [4:55:30<24:57:40,  3.45it/s]
 17%|█▋        | 61880/371472 [4:55:30<25:06:14,  3.43it/s]
                                                           
{'loss': 4.0509, 'learning_rate': 8.504815876230903e-07, 'epoch': 2.67}

 17%|█▋        | 61880/371472 [4:55:30<25:06:14,  3.43it/s]
 17%|█▋        | 61881/371472 [4:55:31<25:16:03,  3.40it/s]
 17%|█▋        | 61882/371472 [4:55:31<24:30:01,  3.51it/s]
 17%|█▋        | 61883/371472 [4:55:31<26:02:59,  3.30it/s]
 17%|█▋        | 61884/371472 [4:55:31<25:13:04,  3.41it/s]
 17%|█▋        | 61885/371472 [4:55:32<24:40:24,  3.49it/s]
 17%|█▋        | 61886/371472 [4:55:32<24:09:16,  3.56it/s]
 17%|█▋        | 61887/371472 [4:55:32<23:51:04,  3.61it/s]
 17%|█▋        | 61888/371472 [4:55:32<23:17:04,  3.69it/s]
 17%|█▋        | 61889/371472 [4:55:33<22:51:26,  3.76it/s]
 17%|█▋        | 61890/371472 [4:55:33<22:47:15,  3.77it/s]
 17%|█▋        | 61891/371472 [4:55:33<23:08:21,  3.72it/s]
 17%|█▋        | 61892/371472 [4:55:34<23:18:56,  3.69it/s]
 17%|█▋        | 61893/371472 [4:55:34<23:22:26,  3.68it/s]
 17%|█▋        | 61894/371472 [4:55:34<23:49:07,  3.61it/s]
 17%|█▋        | 61895/371472 [4:55:34<24:31:07,  3.51it/s]
 17%|█▋        | 61896/371472 [4:55:35<25:23:42,  3.39it/s]
 17%|█▋        | 61897/371472 [4:55:35<26:26:34,  3.25it/s]
 17%|█▋        | 61898/371472 [4:55:35<27:28:22,  3.13it/s]
 17%|█▋        | 61899/371472 [4:55:36<26:31:05,  3.24it/s]
 17%|█▋        | 61900/371472 [4:55:36<26:27:00,  3.25it/s]
                                                           
{'loss': 4.0596, 'learning_rate': 8.504331056476114e-07, 'epoch': 2.67}

 17%|█▋        | 61900/371472 [4:55:36<26:27:00,  3.25it/s]
 17%|█▋        | 61901/371472 [4:55:36<24:51:28,  3.46it/s]
 17%|█▋        | 61902/371472 [4:55:37<25:17:08,  3.40it/s]
 17%|█▋        | 61903/371472 [4:55:37<24:01:23,  3.58it/s]
 17%|█▋        | 61904/371472 [4:55:37<23:22:34,  3.68it/s]
 17%|█▋        | 61905/371472 [4:55:37<24:03:13,  3.57it/s]
 17%|█▋        | 61906/371472 [4:55:38<23:00:20,  3.74it/s]
 17%|█▋        | 61907/371472 [4:55:38<23:56:48,  3.59it/s]
 17%|█▋        | 61908/371472 [4:55:38<24:05:43,  3.57it/s]
 17%|█▋        | 61909/371472 [4:55:39<26:23:49,  3.26it/s]
 17%|█▋        | 61910/371472 [4:55:39<25:06:25,  3.42it/s]
 17%|█▋        | 61911/371472 [4:55:39<23:42:28,  3.63it/s]
 17%|█▋        | 61912/371472 [4:55:39<23:28:33,  3.66it/s]
 17%|█▋        | 61913/371472 [4:55:40<22:44:26,  3.78it/s]
 17%|█▋        | 61914/371472 [4:55:40<23:13:11,  3.70it/s]
 17%|█▋        | 61915/371472 [4:55:40<24:20:16,  3.53it/s]
 17%|█▋        | 61916/371472 [4:55:40<24:02:23,  3.58it/s]
 17%|█▋        | 61917/371472 [4:55:41<23:06:17,  3.72it/s]
 17%|█▋        | 61918/371472 [4:55:41<23:03:39,  3.73it/s]
 17%|█▋        | 61919/371472 [4:55:41<23:52:59,  3.60it/s]
 17%|█▋        | 61920/371472 [4:55:41<23:30:58,  3.66it/s]
                                                           
{'loss': 4.1527, 'learning_rate': 8.503846236721326e-07, 'epoch': 2.67}

 17%|█▋        | 61920/371472 [4:55:41<23:30:58,  3.66it/s]
 17%|█▋        | 61921/371472 [4:55:42<25:03:59,  3.43it/s]
 17%|█▋        | 61922/371472 [4:55:42<25:51:43,  3.32it/s]
 17%|█▋        | 61923/371472 [4:55:42<24:10:45,  3.56it/s]
 17%|█▋        | 61924/371472 [4:55:43<24:02:09,  3.58it/s]
 17%|█▋        | 61925/371472 [4:55:43<23:22:53,  3.68it/s]
 17%|█▋        | 61926/371472 [4:55:43<22:41:37,  3.79it/s]
 17%|█▋        | 61927/371472 [4:55:43<22:30:25,  3.82it/s]
 17%|█▋        | 61928/371472 [4:55:44<22:19:34,  3.85it/s]
 17%|█▋        | 61929/371472 [4:55:44<22:39:00,  3.80it/s]
 17%|█▋        | 61930/371472 [4:55:44<22:10:31,  3.88it/s]
 17%|█▋        | 61931/371472 [4:55:44<22:56:38,  3.75it/s]
 17%|█▋        | 61932/371472 [4:55:45<22:25:53,  3.83it/s]
 17%|█▋        | 61933/371472 [4:55:45<24:18:25,  3.54it/s]
 17%|█▋        | 61934/371472 [4:55:45<23:31:50,  3.65it/s]
 17%|█▋        | 61935/371472 [4:55:46<25:56:08,  3.32it/s]
 17%|█▋        | 61936/371472 [4:55:46<25:14:00,  3.41it/s]
 17%|█▋        | 61937/371472 [4:55:46<24:39:30,  3.49it/s]
 17%|█▋        | 61938/371472 [4:55:46<23:14:45,  3.70it/s]
 17%|█▋        | 61939/371472 [4:55:47<24:05:28,  3.57it/s]
 17%|█▋        | 61940/371472 [4:55:47<26:28:13,  3.25it/s]
                                                           
{'loss': 4.3536, 'learning_rate': 8.503361416966536e-07, 'epoch': 2.67}

 17%|█▋        | 61940/371472 [4:55:47<26:28:13,  3.25it/s]
 17%|█▋        | 61941/371472 [4:55:47<25:13:46,  3.41it/s]
 17%|█▋        | 61942/371472 [4:55:48<24:52:55,  3.46it/s]
 17%|█▋        | 61943/371472 [4:55:48<24:39:08,  3.49it/s]
 17%|█▋        | 61944/371472 [4:55:48<25:11:08,  3.41it/s]
 17%|█▋        | 61945/371472 [4:55:49<25:21:14,  3.39it/s]
 17%|█▋        | 61946/371472 [4:55:49<24:32:28,  3.50it/s]
 17%|█▋        | 61947/371472 [4:55:49<23:45:47,  3.62it/s]
 17%|█▋        | 61948/371472 [4:55:49<23:45:43,  3.62it/s]
 17%|█▋        | 61949/371472 [4:55:50<24:49:28,  3.46it/s]
 17%|█▋        | 61950/371472 [4:55:50<23:36:02,  3.64it/s]
 17%|█▋        | 61951/371472 [4:55:50<23:36:53,  3.64it/s]
 17%|█▋        | 61952/371472 [4:55:50<23:22:20,  3.68it/s]
 17%|█▋        | 61953/371472 [4:55:51<24:31:02,  3.51it/s]
 17%|█▋        | 61954/371472 [4:55:51<23:50:06,  3.61it/s]
 17%|█▋        | 61955/371472 [4:55:51<24:30:52,  3.51it/s]
 17%|█▋        | 61956/371472 [4:55:52<25:39:37,  3.35it/s]
 17%|█▋        | 61957/371472 [4:55:52<24:40:54,  3.48it/s]
 17%|█▋        | 61958/371472 [4:55:52<26:33:08,  3.24it/s]
 17%|█▋        | 61959/371472 [4:55:53<26:17:09,  3.27it/s]
 17%|█▋        | 61960/371472 [4:55:53<26:35:07,  3.23it/s]
                                                           
{'loss': 4.0764, 'learning_rate': 8.502876597211748e-07, 'epoch': 2.67}

 17%|█▋        | 61960/371472 [4:55:53<26:35:07,  3.23it/s]
 17%|█▋        | 61961/371472 [4:55:53<25:19:32,  3.39it/s]
 17%|█▋        | 61962/371472 [4:55:53<24:25:13,  3.52it/s]
 17%|█▋        | 61963/371472 [4:55:54<25:33:57,  3.36it/s]
 17%|█▋        | 61964/371472 [4:55:54<26:21:49,  3.26it/s]
 17%|█▋        | 61965/371472 [4:55:54<25:34:01,  3.36it/s]
 17%|█▋        | 61966/371472 [4:55:55<25:45:38,  3.34it/s]
 17%|█▋        | 61967/371472 [4:55:55<25:23:19,  3.39it/s]
 17%|█▋        | 61968/371472 [4:55:55<24:31:10,  3.51it/s]
 17%|█▋        | 61969/371472 [4:55:55<24:09:48,  3.56it/s]
 17%|█▋        | 61970/371472 [4:55:56<25:14:44,  3.41it/s]
 17%|█▋        | 61971/371472 [4:55:56<24:19:00,  3.54it/s]
 17%|█▋        | 61972/371472 [4:55:56<24:03:51,  3.57it/s]
 17%|█▋        | 61973/371472 [4:55:57<23:05:24,  3.72it/s]
 17%|█▋        | 61974/371472 [4:55:57<24:50:31,  3.46it/s]
 17%|█▋        | 61975/371472 [4:55:57<26:20:31,  3.26it/s]
 17%|█▋        | 61976/371472 [4:55:58<25:22:11,  3.39it/s]
 17%|█▋        | 61977/371472 [4:55:58<26:10:56,  3.28it/s]
 17%|█▋        | 61978/371472 [4:55:58<24:47:14,  3.47it/s]
 17%|█▋        | 61979/371472 [4:55:58<24:40:15,  3.48it/s]
 17%|█▋        | 61980/371472 [4:55:59<23:53:41,  3.60it/s]
                                                           
{'loss': 4.1755, 'learning_rate': 8.502391777456958e-07, 'epoch': 2.67}

 17%|█▋        | 61980/371472 [4:55:59<23:53:41,  3.60it/s]
 17%|█▋        | 61981/371472 [4:55:59<24:24:10,  3.52it/s]
 17%|█▋        | 61982/371472 [4:55:59<24:27:12,  3.52it/s]
 17%|█▋        | 61983/371472 [4:56:00<27:24:05,  3.14it/s]
 17%|█▋        | 61984/371472 [4:56:00<25:48:42,  3.33it/s]
 17%|█▋        | 61985/371472 [4:56:00<25:40:58,  3.35it/s]
 17%|█▋        | 61986/371472 [4:56:00<24:41:01,  3.48it/s]
 17%|█▋        | 61987/371472 [4:56:01<23:43:17,  3.62it/s]
 17%|█▋        | 61988/371472 [4:56:01<24:13:55,  3.55it/s]
 17%|█▋        | 61989/371472 [4:56:01<25:18:08,  3.40it/s]
 17%|█▋        | 61990/371472 [4:56:02<25:26:59,  3.38it/s]
 17%|█▋        | 61991/371472 [4:56:02<26:25:47,  3.25it/s]
 17%|█▋        | 61992/371472 [4:56:02<26:58:29,  3.19it/s]
 17%|█▋        | 61993/371472 [4:56:03<27:31:46,  3.12it/s]
 17%|█▋        | 61994/371472 [4:56:03<25:58:44,  3.31it/s]
 17%|█▋        | 61995/371472 [4:56:03<25:14:08,  3.41it/s]
 17%|█▋        | 61996/371472 [4:56:03<24:27:56,  3.51it/s]
 17%|█▋        | 61997/371472 [4:56:04<25:38:48,  3.35it/s]
 17%|█▋        | 61998/371472 [4:56:04<25:11:57,  3.41it/s]
 17%|█▋        | 61999/371472 [4:56:04<25:04:06,  3.43it/s]
 17%|█▋        | 62000/371472 [4:56:05<24:39:27,  3.49it/s]
                                                           
{'loss': 4.2831, 'learning_rate': 8.50190695770217e-07, 'epoch': 2.67}

 17%|█▋        | 62000/371472 [4:56:05<24:39:27,  3.49it/s]
 17%|█▋        | 62001/371472 [4:56:05<24:09:48,  3.56it/s]
 17%|█▋        | 62002/371472 [4:56:05<24:09:46,  3.56it/s]
 17%|█▋        | 62003/371472 [4:56:05<24:17:11,  3.54it/s]
 17%|█▋        | 62004/371472 [4:56:06<24:05:52,  3.57it/s]
 17%|█▋        | 62005/371472 [4:56:06<23:40:52,  3.63it/s]
 17%|█▋        | 62006/371472 [4:56:06<23:52:28,  3.60it/s]
 17%|█▋        | 62007/371472 [4:56:07<24:04:43,  3.57it/s]
 17%|█▋        | 62008/371472 [4:56:07<24:10:08,  3.56it/s]
 17%|█▋        | 62009/371472 [4:56:07<23:04:41,  3.72it/s]
 17%|█▋        | 62010/371472 [4:56:07<23:40:16,  3.63it/s]
 17%|█▋        | 62011/371472 [4:56:08<23:06:10,  3.72it/s]
 17%|█▋        | 62012/371472 [4:56:08<23:10:18,  3.71it/s]
 17%|█▋        | 62013/371472 [4:56:08<24:25:24,  3.52it/s]
 17%|█▋        | 62014/371472 [4:56:08<24:33:35,  3.50it/s]
 17%|█▋        | 62015/371472 [4:56:09<24:24:21,  3.52it/s]
 17%|█▋        | 62016/371472 [4:56:09<23:57:20,  3.59it/s]
 17%|█▋        | 62017/371472 [4:56:09<23:27:02,  3.67it/s]
 17%|█▋        | 62018/371472 [4:56:10<22:52:23,  3.76it/s]
 17%|█▋        | 62019/371472 [4:56:10<23:22:10,  3.68it/s]
 17%|█▋        | 62020/371472 [4:56:10<23:14:36,  3.70it/s]
                                                           
{'loss': 4.3237, 'learning_rate': 8.50142213794738e-07, 'epoch': 2.67}

 17%|█▋        | 62020/371472 [4:56:10<23:14:36,  3.70it/s]
 17%|█▋        | 62021/371472 [4:56:10<25:06:43,  3.42it/s]
 17%|█▋        | 62022/371472 [4:56:11<24:16:26,  3.54it/s]
 17%|█▋        | 62023/371472 [4:56:11<28:16:18,  3.04it/s]
 17%|█▋        | 62024/371472 [4:56:11<26:04:15,  3.30it/s]
 17%|█▋        | 62025/371472 [4:56:12<25:37:30,  3.35it/s]
 17%|█▋        | 62026/371472 [4:56:12<27:03:00,  3.18it/s]
 17%|█▋        | 62027/371472 [4:56:12<25:55:57,  3.31it/s]
 17%|█▋        | 62028/371472 [4:56:13<25:16:17,  3.40it/s]
 17%|█▋        | 62029/371472 [4:56:13<24:45:58,  3.47it/s]
 17%|█▋        | 62030/371472 [4:56:13<24:46:44,  3.47it/s]
 17%|█▋        | 62031/371472 [4:56:13<26:20:15,  3.26it/s]
 17%|█▋        | 62032/371472 [4:56:14<25:15:42,  3.40it/s]
 17%|█▋        | 62033/371472 [4:56:14<26:59:50,  3.18it/s]
 17%|█▋        | 62034/371472 [4:56:14<25:56:59,  3.31it/s]
 17%|█▋        | 62035/371472 [4:56:15<24:49:36,  3.46it/s]
 17%|█▋        | 62036/371472 [4:56:15<23:56:34,  3.59it/s]
 17%|█▋        | 62037/371472 [4:56:15<25:12:10,  3.41it/s]
 17%|█▋        | 62038/371472 [4:56:15<25:01:07,  3.44it/s]
 17%|█▋        | 62039/371472 [4:56:16<25:00:13,  3.44it/s]
 17%|█▋        | 62040/371472 [4:56:16<24:32:49,  3.50it/s]
                                                           
{'loss': 4.186, 'learning_rate': 8.500937318192591e-07, 'epoch': 2.67}

 17%|█▋        | 62040/371472 [4:56:16<24:32:49,  3.50it/s]
 17%|█▋        | 62041/371472 [4:56:16<25:22:07,  3.39it/s]
 17%|█▋        | 62042/371472 [4:56:17<26:25:27,  3.25it/s]
 17%|█▋        | 62043/371472 [4:56:17<25:51:39,  3.32it/s]
 17%|█▋        | 62044/371472 [4:56:17<26:31:55,  3.24it/s]
 17%|█▋        | 62045/371472 [4:56:18<25:19:20,  3.39it/s]
 17%|█▋        | 62046/371472 [4:56:18<25:20:55,  3.39it/s]
 17%|█▋        | 62047/371472 [4:56:18<24:17:59,  3.54it/s]
 17%|█▋        | 62048/371472 [4:56:18<24:22:08,  3.53it/s]
 17%|█▋        | 62049/371472 [4:56:19<23:29:40,  3.66it/s]
 17%|█▋        | 62050/371472 [4:56:19<23:55:32,  3.59it/s]
 17%|█▋        | 62051/371472 [4:56:19<23:16:11,  3.69it/s]
 17%|█▋        | 62052/371472 [4:56:20<27:03:08,  3.18it/s]
 17%|█▋        | 62053/371472 [4:56:20<26:37:10,  3.23it/s]
 17%|█▋        | 62054/371472 [4:56:20<24:55:29,  3.45it/s]
 17%|█▋        | 62055/371472 [4:56:20<24:54:22,  3.45it/s]
 17%|█▋        | 62056/371472 [4:56:21<24:27:35,  3.51it/s]
 17%|█▋        | 62057/371472 [4:56:21<24:42:09,  3.48it/s]
 17%|█▋        | 62058/371472 [4:56:21<24:35:18,  3.50it/s]
 17%|█▋        | 62059/371472 [4:56:22<25:18:06,  3.40it/s]
 17%|█▋        | 62060/371472 [4:56:22<24:22:56,  3.52it/s]
                                                           
{'loss': 4.3383, 'learning_rate': 8.500452498437803e-07, 'epoch': 2.67}

 17%|█▋        | 62060/371472 [4:56:22<24:22:56,  3.52it/s]
 17%|█▋        | 62061/371472 [4:56:22<24:27:23,  3.51it/s]
 17%|█▋        | 62062/371472 [4:56:22<24:20:10,  3.53it/s]
 17%|█▋        | 62063/371472 [4:56:23<25:04:45,  3.43it/s]
 17%|█▋        | 62064/371472 [4:56:23<23:55:10,  3.59it/s]
 17%|█▋        | 62065/371472 [4:56:23<23:30:20,  3.66it/s]
 17%|█▋        | 62066/371472 [4:56:24<23:46:10,  3.62it/s]
 17%|█▋        | 62067/371472 [4:56:24<22:45:51,  3.78it/s]
 17%|█▋        | 62068/371472 [4:56:24<23:59:27,  3.58it/s]
 17%|█▋        | 62069/371472 [4:56:24<26:07:43,  3.29it/s]
 17%|█▋        | 62070/371472 [4:56:25<25:25:42,  3.38it/s]
 17%|█▋        | 62071/371472 [4:56:25<26:38:59,  3.22it/s]
 17%|█▋        | 62072/371472 [4:56:25<28:03:15,  3.06it/s]
 17%|█▋        | 62073/371472 [4:56:26<26:23:55,  3.26it/s]
 17%|█▋        | 62074/371472 [4:56:26<24:59:32,  3.44it/s]
 17%|█▋        | 62075/371472 [4:56:26<24:51:11,  3.46it/s]
 17%|█▋        | 62076/371472 [4:56:27<24:31:40,  3.50it/s]
 17%|█▋        | 62077/371472 [4:56:27<25:05:40,  3.42it/s]
 17%|█▋        | 62078/371472 [4:56:27<24:48:17,  3.46it/s]
 17%|█▋        | 62079/371472 [4:56:27<26:33:27,  3.24it/s]
 17%|█▋        | 62080/371472 [4:56:28<25:29:18,  3.37it/s]
                                                           
{'loss': 3.7935, 'learning_rate': 8.499967678683015e-07, 'epoch': 2.67}

 17%|█▋        | 62080/371472 [4:56:28<25:29:18,  3.37it/s]
 17%|█▋        | 62081/371472 [4:56:28<24:43:51,  3.48it/s]
 17%|█▋        | 62082/371472 [4:56:28<25:43:46,  3.34it/s]
 17%|█▋        | 62083/371472 [4:56:29<24:57:35,  3.44it/s]
 17%|█▋        | 62084/371472 [4:56:29<23:58:11,  3.59it/s]
 17%|█▋        | 62085/371472 [4:56:29<23:03:07,  3.73it/s]
 17%|█▋        | 62086/371472 [4:56:29<26:01:27,  3.30it/s]
 17%|█▋        | 62087/371472 [4:56:30<25:32:25,  3.36it/s]
 17%|█▋        | 62088/371472 [4:56:30<25:18:36,  3.40it/s]
 17%|█▋        | 62089/371472 [4:56:30<23:51:21,  3.60it/s]
 17%|█▋        | 62090/371472 [4:56:31<24:40:44,  3.48it/s]
 17%|█▋        | 62091/371472 [4:56:31<25:22:00,  3.39it/s]
 17%|█▋        | 62092/371472 [4:56:31<25:02:21,  3.43it/s]
 17%|█▋        | 62093/371472 [4:56:31<24:26:15,  3.52it/s]
 17%|█▋        | 62094/371472 [4:56:32<24:38:28,  3.49it/s]
 17%|█▋        | 62095/371472 [4:56:32<23:44:51,  3.62it/s]
 17%|█▋        | 62096/371472 [4:56:32<22:47:36,  3.77it/s]
 17%|█▋        | 62097/371472 [4:56:32<22:19:18,  3.85it/s]
 17%|█▋        | 62098/371472 [4:56:33<22:54:56,  3.75it/s]
 17%|█▋        | 62099/371472 [4:56:33<24:39:50,  3.48it/s]
 17%|█▋        | 62100/371472 [4:56:33<24:31:30,  3.50it/s]
                                                           
{'loss': 4.1606, 'learning_rate': 8.499482858928224e-07, 'epoch': 2.67}

 17%|█▋        | 62100/371472 [4:56:33<24:31:30,  3.50it/s]
 17%|█▋        | 62101/371472 [4:56:34<24:05:20,  3.57it/s]
 17%|█▋        | 62102/371472 [4:56:34<23:53:46,  3.60it/s]
 17%|█▋        | 62103/371472 [4:56:34<24:24:26,  3.52it/s]
 17%|█▋        | 62104/371472 [4:56:34<23:52:30,  3.60it/s]
 17%|█▋        | 62105/371472 [4:56:35<23:25:42,  3.67it/s]
 17%|█▋        | 62106/371472 [4:56:35<23:22:06,  3.68it/s]
 17%|█▋        | 62107/371472 [4:56:35<23:13:41,  3.70it/s]
 17%|█▋        | 62108/371472 [4:56:36<23:09:07,  3.71it/s]
 17%|█▋        | 62109/371472 [4:56:36<23:41:49,  3.63it/s]
 17%|█▋        | 62110/371472 [4:56:36<24:55:28,  3.45it/s]
 17%|█▋        | 62111/371472 [4:56:36<23:34:27,  3.65it/s]
 17%|█▋        | 62112/371472 [4:56:37<23:49:37,  3.61it/s]
 17%|█▋        | 62113/371472 [4:56:37<23:09:19,  3.71it/s]
 17%|█▋        | 62114/371472 [4:56:37<25:47:25,  3.33it/s]
 17%|█▋        | 62115/371472 [4:56:38<25:37:26,  3.35it/s]
 17%|█▋        | 62116/371472 [4:56:38<25:11:32,  3.41it/s]
 17%|█▋        | 62117/371472 [4:56:38<25:41:58,  3.34it/s]
 17%|█▋        | 62118/371472 [4:56:38<25:03:00,  3.43it/s]
 17%|█▋        | 62119/371472 [4:56:39<25:36:16,  3.36it/s]
 17%|█▋        | 62120/371472 [4:56:39<24:11:39,  3.55it/s]
                                                           
{'loss': 4.2875, 'learning_rate': 8.498998039173435e-07, 'epoch': 2.68}

 17%|█▋        | 62120/371472 [4:56:39<24:11:39,  3.55it/s]
 17%|█▋        | 62121/371472 [4:56:39<23:44:56,  3.62it/s]
 17%|█▋        | 62122/371472 [4:56:40<23:26:32,  3.67it/s]
 17%|█▋        | 62123/371472 [4:56:40<22:54:02,  3.75it/s]
 17%|█▋        | 62124/371472 [4:56:40<24:04:08,  3.57it/s]
 17%|█▋        | 62125/371472 [4:56:40<23:39:04,  3.63it/s]
 17%|█▋        | 62126/371472 [4:56:41<22:52:56,  3.76it/s]
 17%|█▋        | 62127/371472 [4:56:41<23:58:41,  3.58it/s]
 17%|█▋        | 62128/371472 [4:56:41<23:37:15,  3.64it/s]
 17%|█▋        | 62129/371472 [4:56:42<25:58:15,  3.31it/s]
 17%|█▋        | 62130/371472 [4:56:42<25:40:55,  3.35it/s]
 17%|█▋        | 62131/371472 [4:56:42<25:02:57,  3.43it/s]
 17%|█▋        | 62132/371472 [4:56:42<24:11:50,  3.55it/s]
 17%|█▋        | 62133/371472 [4:56:43<23:57:10,  3.59it/s]
 17%|█▋        | 62134/371472 [4:56:43<23:14:23,  3.70it/s]
 17%|█▋        | 62135/371472 [4:56:43<23:24:14,  3.67it/s]
 17%|█▋        | 62136/371472 [4:56:43<23:57:57,  3.59it/s]
 17%|█▋        | 62137/371472 [4:56:44<24:44:31,  3.47it/s]
 17%|█▋        | 62138/371472 [4:56:44<24:22:20,  3.53it/s]
 17%|█▋        | 62139/371472 [4:56:44<25:33:47,  3.36it/s]
 17%|█▋        | 62140/371472 [4:56:45<25:32:44,  3.36it/s]
                                                           
{'loss': 4.3184, 'learning_rate': 8.498513219418647e-07, 'epoch': 2.68}

 17%|█▋        | 62140/371472 [4:56:45<25:32:44,  3.36it/s]
 17%|█▋        | 62141/371472 [4:56:45<27:05:39,  3.17it/s]
 17%|█▋        | 62142/371472 [4:56:45<25:45:53,  3.33it/s]
 17%|█▋        | 62143/371472 [4:56:46<26:40:14,  3.22it/s]
 17%|█▋        | 62144/371472 [4:56:46<25:48:47,  3.33it/s]
 17%|█▋        | 62145/371472 [4:56:46<26:02:56,  3.30it/s]
 17%|█▋        | 62146/371472 [4:56:47<26:57:41,  3.19it/s]
 17%|█▋        | 62147/371472 [4:56:47<26:32:10,  3.24it/s]
 17%|█▋        | 62148/371472 [4:56:47<26:29:42,  3.24it/s]
 17%|█▋        | 62149/371472 [4:56:47<25:44:21,  3.34it/s]
 17%|█▋        | 62150/371472 [4:56:48<26:08:28,  3.29it/s]
 17%|█▋        | 62151/371472 [4:56:48<25:34:47,  3.36it/s]
 17%|█▋        | 62152/371472 [4:56:48<25:07:42,  3.42it/s]
 17%|█▋        | 62153/371472 [4:56:49<24:00:19,  3.58it/s]
 17%|█▋        | 62154/371472 [4:56:49<23:33:21,  3.65it/s]
 17%|█▋        | 62155/371472 [4:56:49<23:10:47,  3.71it/s]
 17%|█▋        | 62156/371472 [4:56:49<22:36:42,  3.80it/s]
 17%|█▋        | 62157/371472 [4:56:50<22:37:52,  3.80it/s]
 17%|█▋        | 62158/371472 [4:56:50<22:55:48,  3.75it/s]
 17%|█▋        | 62159/371472 [4:56:50<22:20:52,  3.84it/s]
 17%|█▋        | 62160/371472 [4:56:50<23:01:52,  3.73it/s]
                                                           
{'loss': 4.2195, 'learning_rate': 8.498028399663858e-07, 'epoch': 2.68}

 17%|█▋        | 62160/371472 [4:56:50<23:01:52,  3.73it/s]
 17%|█▋        | 62161/371472 [4:56:51<22:32:26,  3.81it/s]
 17%|█▋        | 62162/371472 [4:56:51<23:23:47,  3.67it/s]
 17%|█▋        | 62163/371472 [4:56:51<23:08:46,  3.71it/s]
 17%|█▋        | 62164/371472 [4:56:52<26:44:52,  3.21it/s]
 17%|█▋        | 62165/371472 [4:56:52<25:06:45,  3.42it/s]
 17%|█▋        | 62166/371472 [4:56:52<23:55:56,  3.59it/s]
 17%|█▋        | 62167/371472 [4:56:52<25:27:51,  3.37it/s]
 17%|█▋        | 62168/371472 [4:56:53<25:56:37,  3.31it/s]
 17%|█▋        | 62169/371472 [4:56:53<25:46:47,  3.33it/s]
 17%|█▋        | 62170/371472 [4:56:53<25:46:01,  3.33it/s]
 17%|█▋        | 62171/371472 [4:56:54<24:38:31,  3.49it/s]
 17%|█▋        | 62172/371472 [4:56:54<23:57:02,  3.59it/s]
 17%|█▋        | 62173/371472 [4:56:54<23:30:44,  3.65it/s]
 17%|█▋        | 62174/371472 [4:56:54<23:19:26,  3.68it/s]
 17%|█▋        | 62175/371472 [4:56:55<23:29:24,  3.66it/s]
 17%|█▋        | 62176/371472 [4:56:55<23:18:17,  3.69it/s]
 17%|█▋        | 62177/371472 [4:56:55<23:24:23,  3.67it/s]
 17%|█▋        | 62178/371472 [4:56:56<25:03:50,  3.43it/s]
 17%|█▋        | 62179/371472 [4:56:56<24:36:01,  3.49it/s]
 17%|█▋        | 62180/371472 [4:56:56<24:17:37,  3.54it/s]
                                                           
{'loss': 4.3262, 'learning_rate': 8.497543579909069e-07, 'epoch': 2.68}

 17%|█▋        | 62180/371472 [4:56:56<24:17:37,  3.54it/s]
 17%|█▋        | 62181/371472 [4:56:56<26:25:08,  3.25it/s]
 17%|█▋        | 62182/371472 [4:56:57<25:11:03,  3.41it/s]
 17%|█▋        | 62183/371472 [4:56:57<24:25:03,  3.52it/s]
 17%|█▋        | 62184/371472 [4:56:57<23:34:06,  3.65it/s]
 17%|█▋        | 62185/371472 [4:56:58<23:16:39,  3.69it/s]
 17%|█▋        | 62186/371472 [4:56:58<23:00:21,  3.73it/s]
 17%|█▋        | 62187/371472 [4:56:58<23:04:05,  3.72it/s]
 17%|█▋        | 62188/371472 [4:56:58<23:19:26,  3.68it/s]
 17%|█▋        | 62189/371472 [4:56:59<24:18:55,  3.53it/s]
 17%|█▋        | 62190/371472 [4:56:59<24:51:20,  3.46it/s]
 17%|█▋        | 62191/371472 [4:56:59<24:44:06,  3.47it/s]
 17%|█▋        | 62192/371472 [4:56:59<23:56:25,  3.59it/s]
 17%|█▋        | 62193/371472 [4:57:00<23:18:11,  3.69it/s]
 17%|█▋        | 62194/371472 [4:57:00<22:46:05,  3.77it/s]
 17%|█▋        | 62195/371472 [4:57:00<22:52:20,  3.76it/s]
 17%|█▋        | 62196/371472 [4:57:01<23:43:03,  3.62it/s]
 17%|█▋        | 62197/371472 [4:57:01<22:56:42,  3.74it/s]
 17%|█▋        | 62198/371472 [4:57:01<25:04:32,  3.43it/s]
 17%|█▋        | 62199/371472 [4:57:01<26:03:51,  3.30it/s]
 17%|█▋        | 62200/371472 [4:57:02<25:02:21,  3.43it/s]
                                                           
{'loss': 4.2036, 'learning_rate': 8.49705876015428e-07, 'epoch': 2.68}

 17%|█▋        | 62200/371472 [4:57:02<25:02:21,  3.43it/s]
 17%|█▋        | 62201/371472 [4:57:02<24:18:57,  3.53it/s]
 17%|█▋        | 62202/371472 [4:57:02<24:38:40,  3.49it/s]
 17%|█▋        | 62203/371472 [4:57:03<24:37:57,  3.49it/s]
 17%|█▋        | 62204/371472 [4:57:03<24:11:57,  3.55it/s]
 17%|█▋        | 62205/371472 [4:57:03<23:06:44,  3.72it/s]
 17%|█▋        | 62206/371472 [4:57:03<23:28:37,  3.66it/s]
 17%|█▋        | 62207/371472 [4:57:04<23:50:52,  3.60it/s]
 17%|█▋        | 62208/371472 [4:57:04<23:51:55,  3.60it/s]
 17%|█▋        | 62209/371472 [4:57:04<23:53:32,  3.60it/s]
 17%|█▋        | 62210/371472 [4:57:05<24:56:59,  3.44it/s]
 17%|█▋        | 62211/371472 [4:57:05<23:52:42,  3.60it/s]
 17%|█▋        | 62212/371472 [4:57:05<22:45:24,  3.77it/s]
 17%|█▋        | 62213/371472 [4:57:05<23:26:50,  3.66it/s]
 17%|█▋        | 62214/371472 [4:57:06<23:43:23,  3.62it/s]
 17%|█▋        | 62215/371472 [4:57:06<23:57:39,  3.59it/s]
 17%|█▋        | 62216/371472 [4:57:06<23:25:19,  3.67it/s]
 17%|█▋        | 62217/371472 [4:57:06<23:38:13,  3.63it/s]
 17%|█▋        | 62218/371472 [4:57:07<24:34:55,  3.49it/s]
 17%|█▋        | 62219/371472 [4:57:07<24:06:36,  3.56it/s]
 17%|█▋        | 62220/371472 [4:57:07<24:24:05,  3.52it/s]
                                                           
{'loss': 4.1811, 'learning_rate': 8.496573940399492e-07, 'epoch': 2.68}

 17%|█▋        | 62220/371472 [4:57:07<24:24:05,  3.52it/s]
 17%|█▋        | 62221/371472 [4:57:08<24:41:09,  3.48it/s]
 17%|█▋        | 62222/371472 [4:57:08<23:49:33,  3.61it/s]
 17%|█▋        | 62223/371472 [4:57:08<24:35:19,  3.49it/s]
 17%|█▋        | 62224/371472 [4:57:08<25:06:22,  3.42it/s]
 17%|█▋        | 62225/371472 [4:57:09<24:22:24,  3.52it/s]
 17%|█▋        | 62226/371472 [4:57:09<24:28:46,  3.51it/s]
 17%|█▋        | 62227/371472 [4:57:09<23:45:17,  3.62it/s]
 17%|█▋        | 62228/371472 [4:57:10<23:22:20,  3.68it/s]
 17%|█▋        | 62229/371472 [4:57:10<24:25:34,  3.52it/s]
 17%|█▋        | 62230/371472 [4:57:10<23:43:29,  3.62it/s]
 17%|█▋        | 62231/371472 [4:57:10<23:20:44,  3.68it/s]
 17%|█▋        | 62232/371472 [4:57:11<23:36:17,  3.64it/s]
 17%|█▋        | 62233/371472 [4:57:11<25:21:27,  3.39it/s]
 17%|█▋        | 62234/371472 [4:57:11<24:37:12,  3.49it/s]
 17%|█▋        | 62235/371472 [4:57:12<25:19:15,  3.39it/s]
 17%|█▋        | 62236/371472 [4:57:12<24:18:35,  3.53it/s]
 17%|█▋        | 62237/371472 [4:57:12<23:36:01,  3.64it/s]
 17%|█▋        | 62238/371472 [4:57:12<23:26:25,  3.66it/s]
 17%|█▋        | 62239/371472 [4:57:13<22:51:34,  3.76it/s]
 17%|█▋        | 62240/371472 [4:57:13<22:31:03,  3.81it/s]
                                                           
{'loss': 4.2556, 'learning_rate': 8.496089120644702e-07, 'epoch': 2.68}

 17%|█▋        | 62240/371472 [4:57:13<22:31:03,  3.81it/s]
 17%|█▋        | 62241/371472 [4:57:13<23:15:03,  3.69it/s]
 17%|█▋        | 62242/371472 [4:57:13<23:33:08,  3.65it/s]
 17%|█▋        | 62243/371472 [4:57:14<23:24:44,  3.67it/s]
 17%|█▋        | 62244/371472 [4:57:14<22:58:48,  3.74it/s]
 17%|█▋        | 62245/371472 [4:57:14<22:50:28,  3.76it/s]
 17%|█▋        | 62246/371472 [4:57:15<25:17:56,  3.40it/s]
 17%|█▋        | 62247/371472 [4:57:15<25:05:29,  3.42it/s]
 17%|█▋        | 62248/371472 [4:57:15<24:35:07,  3.49it/s]
 17%|█▋        | 62249/371472 [4:57:15<23:59:51,  3.58it/s]
 17%|█▋        | 62250/371472 [4:57:16<24:14:01,  3.54it/s]
 17%|█▋        | 62251/371472 [4:57:16<23:15:05,  3.69it/s]
 17%|█▋        | 62252/371472 [4:57:16<23:15:03,  3.69it/s]
 17%|█▋        | 62253/371472 [4:57:17<24:56:23,  3.44it/s]
 17%|█▋        | 62254/371472 [4:57:17<25:02:18,  3.43it/s]
 17%|█▋        | 62255/371472 [4:57:17<23:55:59,  3.59it/s]
 17%|█▋        | 62256/371472 [4:57:17<24:05:14,  3.57it/s]
 17%|█▋        | 62257/371472 [4:57:18<27:47:59,  3.09it/s]
 17%|█▋        | 62258/371472 [4:57:18<25:47:36,  3.33it/s]
 17%|█▋        | 62259/371472 [4:57:18<25:08:37,  3.42it/s]
 17%|█▋        | 62260/371472 [4:57:19<25:24:47,  3.38it/s]
                                                           
{'loss': 4.1667, 'learning_rate': 8.495604300889914e-07, 'epoch': 2.68}

 17%|█▋        | 62260/371472 [4:57:19<25:24:47,  3.38it/s]
 17%|█▋        | 62261/371472 [4:57:19<30:51:41,  2.78it/s]
 17%|█▋        | 62262/371472 [4:57:19<28:20:00,  3.03it/s]
 17%|█▋        | 62263/371472 [4:57:20<26:55:47,  3.19it/s]
 17%|█▋        | 62264/371472 [4:57:20<27:14:17,  3.15it/s]
 17%|█▋        | 62265/371472 [4:57:20<26:51:13,  3.20it/s]
 17%|█▋        | 62266/371472 [4:57:21<26:06:20,  3.29it/s]
 17%|█▋        | 62267/371472 [4:57:21<26:45:28,  3.21it/s]
 17%|█▋        | 62268/371472 [4:57:21<25:40:32,  3.35it/s]
 17%|█▋        | 62269/371472 [4:57:21<24:47:56,  3.46it/s]
 17%|█▋        | 62270/371472 [4:57:22<25:45:11,  3.34it/s]
 17%|█▋        | 62271/371472 [4:57:22<27:03:55,  3.17it/s]
 17%|█▋        | 62272/371472 [4:57:22<26:21:39,  3.26it/s]
 17%|█▋        | 62273/371472 [4:57:23<25:18:17,  3.39it/s]
 17%|█▋        | 62274/371472 [4:57:23<24:35:44,  3.49it/s]
 17%|█▋        | 62275/371472 [4:57:23<24:32:29,  3.50it/s]
 17%|█▋        | 62276/371472 [4:57:23<23:51:36,  3.60it/s]
 17%|█▋        | 62277/371472 [4:57:24<22:54:17,  3.75it/s]
 17%|█▋        | 62278/371472 [4:57:24<23:11:24,  3.70it/s]
 17%|█▋        | 62279/371472 [4:57:24<22:30:55,  3.81it/s]
 17%|█▋        | 62280/371472 [4:57:25<22:40:53,  3.79it/s]
                                                           
{'loss': 4.0655, 'learning_rate': 8.495119481135124e-07, 'epoch': 2.68}

 17%|█▋        | 62280/371472 [4:57:25<22:40:53,  3.79it/s]
 17%|█▋        | 62281/371472 [4:57:25<23:43:31,  3.62it/s]
 17%|█▋        | 62282/371472 [4:57:25<23:02:25,  3.73it/s]
 17%|█▋        | 62283/371472 [4:57:25<23:16:58,  3.69it/s]
 17%|█▋        | 62284/371472 [4:57:26<24:34:16,  3.50it/s]
 17%|█▋        | 62285/371472 [4:57:26<24:41:35,  3.48it/s]
 17%|█▋        | 62286/371472 [4:57:26<24:34:05,  3.50it/s]
 17%|█▋        | 62287/371472 [4:57:27<24:19:27,  3.53it/s]
 17%|█▋        | 62288/371472 [4:57:27<23:10:36,  3.71it/s]
 17%|█▋        | 62289/371472 [4:57:27<23:07:20,  3.71it/s]
 17%|█▋        | 62290/371472 [4:57:27<23:26:42,  3.66it/s]
 17%|█▋        | 62291/371472 [4:57:28<23:41:29,  3.63it/s]
 17%|█▋        | 62292/371472 [4:57:28<24:13:54,  3.54it/s]
 17%|█▋        | 62293/371472 [4:57:28<24:20:41,  3.53it/s]
 17%|█▋        | 62294/371472 [4:57:29<26:31:31,  3.24it/s]
 17%|█▋        | 62295/371472 [4:57:29<25:17:56,  3.39it/s]
 17%|█▋        | 62296/371472 [4:57:29<23:57:39,  3.58it/s]
 17%|█▋        | 62297/371472 [4:57:29<22:53:03,  3.75it/s]
 17%|█▋        | 62298/371472 [4:57:30<24:02:28,  3.57it/s]
 17%|█▋        | 62299/371472 [4:57:30<23:45:47,  3.61it/s]
 17%|█▋        | 62300/371472 [4:57:30<22:48:19,  3.77it/s]
                                                           
{'loss': 4.0451, 'learning_rate': 8.494634661380336e-07, 'epoch': 2.68}

 17%|█▋        | 62300/371472 [4:57:30<22:48:19,  3.77it/s]
 17%|█▋        | 62301/371472 [4:57:30<23:12:11,  3.70it/s]
 17%|█▋        | 62302/371472 [4:57:31<23:11:22,  3.70it/s]
 17%|█▋        | 62303/371472 [4:57:31<23:26:34,  3.66it/s]
 17%|█▋        | 62304/371472 [4:57:31<23:36:16,  3.64it/s]
 17%|█▋        | 62305/371472 [4:57:31<23:04:49,  3.72it/s]
 17%|█▋        | 62306/371472 [4:57:32<23:40:36,  3.63it/s]
 17%|█▋        | 62307/371472 [4:57:32<22:55:48,  3.75it/s]
 17%|█▋        | 62308/371472 [4:57:32<24:57:36,  3.44it/s]
 17%|█▋        | 62309/371472 [4:57:33<26:07:32,  3.29it/s]
 17%|█▋        | 62310/371472 [4:57:33<25:23:06,  3.38it/s]
 17%|█▋        | 62311/371472 [4:57:33<24:48:37,  3.46it/s]
 17%|█▋        | 62312/371472 [4:57:34<25:55:56,  3.31it/s]
 17%|█▋        | 62313/371472 [4:57:34<26:36:58,  3.23it/s]
 17%|█▋        | 62314/371472 [4:57:34<26:24:15,  3.25it/s]
 17%|█▋        | 62315/371472 [4:57:34<25:22:02,  3.39it/s]
 17%|█▋        | 62316/371472 [4:57:35<25:48:45,  3.33it/s]
 17%|█▋        | 62317/371472 [4:57:35<25:05:45,  3.42it/s]
 17%|█▋        | 62318/371472 [4:57:35<24:59:39,  3.44it/s]
 17%|█▋        | 62319/371472 [4:57:36<27:17:23,  3.15it/s]
 17%|█▋        | 62320/371472 [4:57:36<26:39:07,  3.22it/s]
                                                           
{'loss': 4.3132, 'learning_rate': 8.494149841625546e-07, 'epoch': 2.68}

 17%|█▋        | 62320/371472 [4:57:36<26:39:07,  3.22it/s]
 17%|█▋        | 62321/371472 [4:57:36<25:51:57,  3.32it/s]
 17%|█▋        | 62322/371472 [4:57:37<24:13:58,  3.54it/s]
 17%|█▋        | 62323/371472 [4:57:37<23:33:47,  3.64it/s]
 17%|█▋        | 62324/371472 [4:57:37<23:42:58,  3.62it/s]
 17%|█▋        | 62325/371472 [4:57:37<23:59:03,  3.58it/s]
 17%|█▋        | 62326/371472 [4:57:38<23:35:20,  3.64it/s]
 17%|█▋        | 62327/371472 [4:57:38<23:53:04,  3.60it/s]
 17%|█▋        | 62328/371472 [4:57:38<23:52:13,  3.60it/s]
 17%|█▋        | 62329/371472 [4:57:38<23:02:34,  3.73it/s]
 17%|█▋        | 62330/371472 [4:57:39<25:59:19,  3.30it/s]
 17%|█▋        | 62331/371472 [4:57:39<25:27:42,  3.37it/s]
 17%|█▋        | 62332/371472 [4:57:39<26:54:58,  3.19it/s]
 17%|█▋        | 62333/371472 [4:57:40<26:48:23,  3.20it/s]
 17%|█▋        | 62334/371472 [4:57:40<25:44:35,  3.34it/s]
 17%|█▋        | 62335/371472 [4:57:40<25:23:46,  3.38it/s]
 17%|█▋        | 62336/371472 [4:57:41<25:25:06,  3.38it/s]
 17%|█▋        | 62337/371472 [4:57:41<26:10:52,  3.28it/s]
 17%|█▋        | 62338/371472 [4:57:41<31:03:49,  2.76it/s]
 17%|█▋        | 62339/371472 [4:57:42<27:52:16,  3.08it/s]
 17%|█▋        | 62340/371472 [4:57:42<26:31:52,  3.24it/s]
                                                           
{'loss': 4.3183, 'learning_rate': 8.493665021870758e-07, 'epoch': 2.69}

 17%|█▋        | 62340/371472 [4:57:42<26:31:52,  3.24it/s]
 17%|█▋        | 62341/371472 [4:57:42<25:13:24,  3.40it/s]
 17%|█▋        | 62342/371472 [4:57:42<25:25:25,  3.38it/s]
 17%|█▋        | 62343/371472 [4:57:43<25:09:05,  3.41it/s]
 17%|█▋        | 62344/371472 [4:57:43<24:56:39,  3.44it/s]
 17%|█▋        | 62345/371472 [4:57:43<23:39:28,  3.63it/s]
 17%|█▋        | 62346/371472 [4:57:44<23:00:40,  3.73it/s]
 17%|█▋        | 62347/371472 [4:57:44<22:44:28,  3.78it/s]
 17%|█▋        | 62348/371472 [4:57:44<24:09:54,  3.55it/s]
 17%|█▋        | 62349/371472 [4:57:44<24:50:44,  3.46it/s]
 17%|█▋        | 62350/371472 [4:57:45<23:53:41,  3.59it/s]
 17%|█▋        | 62351/371472 [4:57:45<23:39:40,  3.63it/s]
 17%|█▋        | 62352/371472 [4:57:45<23:33:11,  3.65it/s]
 17%|█▋        | 62353/371472 [4:57:46<24:14:02,  3.54it/s]
 17%|█▋        | 62354/371472 [4:57:46<23:20:14,  3.68it/s]
 17%|█▋        | 62355/371472 [4:57:46<23:01:17,  3.73it/s]
 17%|█▋        | 62356/371472 [4:57:46<25:19:43,  3.39it/s]
 17%|█▋        | 62357/371472 [4:57:47<24:53:27,  3.45it/s]
 17%|█▋        | 62358/371472 [4:57:47<23:44:15,  3.62it/s]
 17%|█▋        | 62359/371472 [4:57:47<23:44:13,  3.62it/s]
 17%|█▋        | 62360/371472 [4:57:47<23:31:17,  3.65it/s]
                                                           
{'loss': 4.0798, 'learning_rate': 8.493180202115968e-07, 'epoch': 2.69}

 17%|█▋        | 62360/371472 [4:57:47<23:31:17,  3.65it/s]
 17%|█▋        | 62361/371472 [4:57:48<25:35:16,  3.36it/s]
 17%|█▋        | 62362/371472 [4:57:48<25:11:30,  3.41it/s]
 17%|█▋        | 62363/371472 [4:57:48<24:46:53,  3.46it/s]
 17%|█▋        | 62364/371472 [4:57:49<23:59:50,  3.58it/s]
 17%|█▋        | 62365/371472 [4:57:49<24:45:37,  3.47it/s]
 17%|█▋        | 62366/371472 [4:57:49<25:11:56,  3.41it/s]
 17%|█▋        | 62367/371472 [4:57:50<24:25:11,  3.52it/s]
 17%|█▋        | 62368/371472 [4:57:50<24:45:42,  3.47it/s]
 17%|█▋        | 62369/371472 [4:57:50<24:07:42,  3.56it/s]
 17%|█▋        | 62370/371472 [4:57:50<23:48:06,  3.61it/s]
 17%|█▋        | 62371/371472 [4:57:51<23:55:01,  3.59it/s]
 17%|█▋        | 62372/371472 [4:57:51<24:27:09,  3.51it/s]
 17%|█▋        | 62373/371472 [4:57:51<24:33:13,  3.50it/s]
 17%|█▋        | 62374/371472 [4:57:51<23:55:08,  3.59it/s]
 17%|█▋        | 62375/371472 [4:57:52<23:35:55,  3.64it/s]
 17%|█▋        | 62376/371472 [4:57:52<23:05:48,  3.72it/s]
 17%|█▋        | 62377/371472 [4:57:52<23:01:11,  3.73it/s]
 17%|█▋        | 62378/371472 [4:57:53<22:47:43,  3.77it/s]
 17%|█▋        | 62379/371472 [4:57:53<22:31:59,  3.81it/s]
 17%|█▋        | 62380/371472 [4:57:53<22:50:49,  3.76it/s]
                                                           
{'loss': 4.362, 'learning_rate': 8.49269538236118e-07, 'epoch': 2.69}

 17%|█▋        | 62380/371472 [4:57:53<22:50:49,  3.76it/s]
 17%|█▋        | 62381/371472 [4:57:53<25:16:27,  3.40it/s]
 17%|█▋        | 62382/371472 [4:57:54<25:07:20,  3.42it/s]
 17%|█▋        | 62383/371472 [4:57:54<24:24:33,  3.52it/s]
 17%|█▋        | 62384/371472 [4:57:54<24:29:37,  3.51it/s]
 17%|█▋        | 62385/371472 [4:57:55<25:21:36,  3.39it/s]
 17%|█▋        | 62386/371472 [4:57:55<25:25:19,  3.38it/s]
 17%|█▋        | 62387/371472 [4:57:55<24:28:54,  3.51it/s]
 17%|█▋        | 62388/371472 [4:57:55<23:35:13,  3.64it/s]
 17%|█▋        | 62389/371472 [4:57:56<24:19:01,  3.53it/s]
 17%|█▋        | 62390/371472 [4:57:56<24:03:36,  3.57it/s]
 17%|█▋        | 62391/371472 [4:57:56<25:21:33,  3.39it/s]
 17%|█▋        | 62392/371472 [4:57:57<24:44:52,  3.47it/s]
 17%|█▋        | 62393/371472 [4:57:57<23:48:37,  3.61it/s]
 17%|█▋        | 62394/371472 [4:57:57<23:08:38,  3.71it/s]
 17%|█▋        | 62395/371472 [4:57:57<22:31:33,  3.81it/s]
 17%|█▋        | 62396/371472 [4:57:58<25:28:15,  3.37it/s]
 17%|█▋        | 62397/371472 [4:57:58<25:19:16,  3.39it/s]
 17%|█▋        | 62398/371472 [4:57:58<24:47:38,  3.46it/s]
 17%|█▋        | 62399/371472 [4:57:59<25:08:47,  3.41it/s]
 17%|█▋        | 62400/371472 [4:57:59<26:00:55,  3.30it/s]
                                                           
{'loss': 4.1945, 'learning_rate': 8.49221056260639e-07, 'epoch': 2.69}

 17%|█▋        | 62400/371472 [4:57:59<26:00:55,  3.30it/s]
 17%|█▋        | 62401/371472 [4:57:59<24:33:16,  3.50it/s]
 17%|█▋        | 62402/371472 [4:57:59<23:42:09,  3.62it/s]
 17%|█▋        | 62403/371472 [4:58:00<23:30:40,  3.65it/s]
 17%|█▋        | 62404/371472 [4:58:00<23:11:04,  3.70it/s]
 17%|█▋        | 62405/371472 [4:58:00<23:01:28,  3.73it/s]
 17%|█▋        | 62406/371472 [4:58:00<23:37:10,  3.63it/s]
 17%|█▋        | 62407/371472 [4:58:01<23:32:36,  3.65it/s]
 17%|█▋        | 62408/371472 [4:58:01<23:32:06,  3.65it/s]
 17%|█▋        | 62409/371472 [4:58:01<23:41:27,  3.62it/s]
 17%|█▋        | 62410/371472 [4:58:02<23:20:31,  3.68it/s]
 17%|█▋        | 62411/371472 [4:58:02<22:39:55,  3.79it/s]
 17%|█▋        | 62412/371472 [4:58:02<23:11:28,  3.70it/s]
 17%|█▋        | 62413/371472 [4:58:02<23:19:16,  3.68it/s]
 17%|█▋        | 62414/371472 [4:58:03<23:38:56,  3.63it/s]
 17%|█▋        | 62415/371472 [4:58:03<23:26:27,  3.66it/s]
 17%|█▋        | 62416/371472 [4:58:03<23:43:14,  3.62it/s]
 17%|█▋        | 62417/371472 [4:58:03<23:21:33,  3.68it/s]
 17%|█▋        | 62418/371472 [4:58:04<23:00:40,  3.73it/s]
 17%|█▋        | 62419/371472 [4:58:04<25:20:45,  3.39it/s]
 17%|█▋        | 62420/371472 [4:58:04<24:09:00,  3.55it/s]
                                                           
{'loss': 4.2235, 'learning_rate': 8.491725742851602e-07, 'epoch': 2.69}

 17%|█▋        | 62420/371472 [4:58:04<24:09:00,  3.55it/s]
 17%|█▋        | 62421/371472 [4:58:05<24:40:59,  3.48it/s]
 17%|█▋        | 62422/371472 [4:58:05<23:46:41,  3.61it/s]
 17%|█▋        | 62423/371472 [4:58:05<23:22:47,  3.67it/s]
 17%|█▋        | 62424/371472 [4:58:05<23:45:02,  3.61it/s]
 17%|█▋        | 62425/371472 [4:58:06<23:50:28,  3.60it/s]
 17%|█▋        | 62426/371472 [4:58:06<26:17:00,  3.27it/s]
 17%|█▋        | 62427/371472 [4:58:06<25:27:14,  3.37it/s]
 17%|█▋        | 62428/371472 [4:58:07<26:51:04,  3.20it/s]
 17%|█▋        | 62429/371472 [4:58:07<25:59:06,  3.30it/s]
 17%|█▋        | 62430/371472 [4:58:07<25:18:37,  3.39it/s]
 17%|█▋        | 62431/371472 [4:58:08<25:18:28,  3.39it/s]
 17%|█▋        | 62432/371472 [4:58:08<24:29:06,  3.51it/s]
 17%|█▋        | 62433/371472 [4:58:08<26:40:56,  3.22it/s]
 17%|█▋        | 62434/371472 [4:58:08<25:09:00,  3.41it/s]
 17%|█▋        | 62435/371472 [4:58:09<25:21:46,  3.38it/s]
 17%|█▋        | 62436/371472 [4:58:09<26:20:29,  3.26it/s]
 17%|█▋        | 62437/371472 [4:58:09<24:28:04,  3.51it/s]
 17%|█▋        | 62438/371472 [4:58:10<23:57:02,  3.58it/s]
 17%|█▋        | 62439/371472 [4:58:10<23:05:53,  3.72it/s]
 17%|█▋        | 62440/371472 [4:58:10<24:12:42,  3.55it/s]
                                                           
{'loss': 4.1094, 'learning_rate': 8.491240923096813e-07, 'epoch': 2.69}

 17%|█▋        | 62440/371472 [4:58:10<24:12:42,  3.55it/s]
 17%|█▋        | 62441/371472 [4:58:11<27:18:42,  3.14it/s]
 17%|█▋        | 62442/371472 [4:58:11<26:17:57,  3.26it/s]
 17%|█▋        | 62443/371472 [4:58:11<26:24:47,  3.25it/s]
 17%|█▋        | 62444/371472 [4:58:11<24:53:59,  3.45it/s]
 17%|█▋        | 62445/371472 [4:58:12<23:44:04,  3.62it/s]
 17%|█▋        | 62446/371472 [4:58:12<24:32:27,  3.50it/s]
 17%|█▋        | 62447/371472 [4:58:12<24:29:11,  3.51it/s]
 17%|█▋        | 62448/371472 [4:58:12<24:10:02,  3.55it/s]
 17%|█▋        | 62449/371472 [4:58:13<23:45:30,  3.61it/s]
 17%|█▋        | 62450/371472 [4:58:13<24:05:12,  3.56it/s]
 17%|█▋        | 62451/371472 [4:58:13<26:12:44,  3.27it/s]
 17%|█▋        | 62452/371472 [4:58:14<25:14:46,  3.40it/s]
 17%|█▋        | 62453/371472 [4:58:14<24:18:42,  3.53it/s]
 17%|█▋        | 62454/371472 [4:58:14<23:43:02,  3.62it/s]
 17%|█▋        | 62455/371472 [4:58:14<23:16:38,  3.69it/s]
 17%|█▋        | 62456/371472 [4:58:15<26:07:42,  3.29it/s]
 17%|█▋        | 62457/371472 [4:58:15<25:25:08,  3.38it/s]
 17%|█▋        | 62458/371472 [4:58:15<24:34:11,  3.49it/s]
 17%|█▋        | 62459/371472 [4:58:16<24:35:58,  3.49it/s]
 17%|█▋        | 62460/371472 [4:58:16<24:12:42,  3.55it/s]
                                                           
{'loss': 4.0557, 'learning_rate': 8.490756103342024e-07, 'epoch': 2.69}

 17%|█▋        | 62460/371472 [4:58:16<24:12:42,  3.55it/s]
 17%|█▋        | 62461/371472 [4:58:16<23:58:57,  3.58it/s]
 17%|█▋        | 62462/371472 [4:58:16<23:33:45,  3.64it/s]
 17%|█▋        | 62463/371472 [4:58:17<23:27:12,  3.66it/s]
 17%|█▋        | 62464/371472 [4:58:17<23:06:31,  3.71it/s]
 17%|█▋        | 62465/371472 [4:58:17<23:12:08,  3.70it/s]
 17%|█▋        | 62466/371472 [4:58:18<22:40:15,  3.79it/s]
 17%|█▋        | 62467/371472 [4:58:18<22:17:28,  3.85it/s]
 17%|█▋        | 62468/371472 [4:58:18<24:11:46,  3.55it/s]
 17%|█▋        | 62469/371472 [4:58:18<24:35:25,  3.49it/s]
 17%|█▋        | 62470/371472 [4:58:19<23:30:36,  3.65it/s]
 17%|█▋        | 62471/371472 [4:58:19<23:49:22,  3.60it/s]
 17%|█▋        | 62472/371472 [4:58:19<24:37:06,  3.49it/s]
 17%|█▋        | 62473/371472 [4:58:19<23:56:53,  3.58it/s]
 17%|█▋        | 62474/371472 [4:58:20<23:46:37,  3.61it/s]
 17%|█▋        | 62475/371472 [4:58:20<28:48:18,  2.98it/s]
 17%|█▋        | 62476/371472 [4:58:21<26:59:19,  3.18it/s]
 17%|█▋        | 62477/371472 [4:58:21<26:02:56,  3.30it/s]
 17%|█▋        | 62478/371472 [4:58:21<24:58:22,  3.44it/s]
 17%|█▋        | 62479/371472 [4:58:21<24:48:58,  3.46it/s]
 17%|█▋        | 62480/371472 [4:58:22<24:18:22,  3.53it/s]
                                                           
{'loss': 4.2701, 'learning_rate': 8.490271283587234e-07, 'epoch': 2.69}

 17%|█▋        | 62480/371472 [4:58:22<24:18:22,  3.53it/s]
 17%|█▋        | 62481/371472 [4:58:22<24:32:29,  3.50it/s]
 17%|█▋        | 62482/371472 [4:58:22<23:50:43,  3.60it/s]
 17%|█▋        | 62483/371472 [4:58:22<24:27:18,  3.51it/s]
 17%|█▋        | 62484/371472 [4:58:23<23:54:54,  3.59it/s]
 17%|█▋        | 62485/371472 [4:58:23<24:12:54,  3.54it/s]
 17%|█▋        | 62486/371472 [4:58:23<24:12:35,  3.55it/s]
 17%|█▋        | 62487/371472 [4:58:24<23:44:24,  3.62it/s]
 17%|█▋        | 62488/371472 [4:58:24<25:25:56,  3.37it/s]
 17%|█▋        | 62489/371472 [4:58:24<28:44:46,  2.99it/s]
 17%|█▋        | 62490/371472 [4:58:25<28:32:52,  3.01it/s]
 17%|█▋        | 62491/371472 [4:58:25<27:33:45,  3.11it/s]
 17%|█▋        | 62492/371472 [4:58:25<25:44:59,  3.33it/s]
 17%|█▋        | 62493/371472 [4:58:25<24:50:21,  3.46it/s]
 17%|█▋        | 62494/371472 [4:58:26<24:16:22,  3.54it/s]
 17%|█▋        | 62495/371472 [4:58:26<24:03:29,  3.57it/s]
 17%|█▋        | 62496/371472 [4:58:26<23:31:48,  3.65it/s]
 17%|█▋        | 62497/371472 [4:58:27<23:15:01,  3.69it/s]
 17%|█▋        | 62498/371472 [4:58:27<23:27:54,  3.66it/s]
 17%|█▋        | 62499/371472 [4:58:27<23:25:55,  3.66it/s]
 17%|█▋        | 62500/371472 [4:58:27<22:57:41,  3.74it/s]
                                                           
{'loss': 4.1211, 'learning_rate': 8.489786463832446e-07, 'epoch': 2.69}

 17%|█▋        | 62500/371472 [4:58:27<22:57:41,  3.74it/s]
 17%|█▋        | 62501/371472 [4:58:28<23:11:31,  3.70it/s]
 17%|█▋        | 62502/371472 [4:58:28<22:37:55,  3.79it/s]
 17%|█▋        | 62503/371472 [4:58:28<22:42:48,  3.78it/s]
 17%|█▋        | 62504/371472 [4:58:28<24:14:25,  3.54it/s]
 17%|█▋        | 62505/371472 [4:58:29<24:01:33,  3.57it/s]
 17%|█▋        | 62506/371472 [4:58:29<24:17:15,  3.53it/s]
 17%|█▋        | 62507/371472 [4:58:29<23:18:38,  3.68it/s]
 17%|█▋        | 62508/371472 [4:58:30<22:58:40,  3.74it/s]
 17%|█▋        | 62509/371472 [4:58:30<23:23:01,  3.67it/s]
 17%|█▋        | 62510/371472 [4:58:30<23:58:22,  3.58it/s]
 17%|█▋        | 62511/371472 [4:58:30<23:39:21,  3.63it/s]
 17%|█▋        | 62512/371472 [4:58:31<24:32:49,  3.50it/s]
 17%|█▋        | 62513/371472 [4:58:31<23:39:40,  3.63it/s]
 17%|█▋        | 62514/371472 [4:58:31<23:03:32,  3.72it/s]
 17%|█▋        | 62515/371472 [4:58:31<22:46:43,  3.77it/s]
 17%|█▋        | 62516/371472 [4:58:32<25:05:25,  3.42it/s]
 17%|█▋        | 62517/371472 [4:58:32<24:57:52,  3.44it/s]
 17%|█▋        | 62518/371472 [4:58:32<24:42:31,  3.47it/s]
 17%|█▋        | 62519/371472 [4:58:33<24:13:11,  3.54it/s]
 17%|█▋        | 62520/371472 [4:58:33<24:17:12,  3.53it/s]
                                                           
{'loss': 4.2872, 'learning_rate': 8.489301644077657e-07, 'epoch': 2.69}

 17%|█▋        | 62520/371472 [4:58:33<24:17:12,  3.53it/s]
 17%|█▋        | 62521/371472 [4:58:33<24:41:42,  3.48it/s]
 17%|█▋        | 62522/371472 [4:58:33<23:56:00,  3.59it/s]
 17%|█▋        | 62523/371472 [4:58:34<23:03:07,  3.72it/s]
 17%|█▋        | 62524/371472 [4:58:34<23:01:03,  3.73it/s]
 17%|█▋        | 62525/371472 [4:58:34<22:23:25,  3.83it/s]
 17%|█▋        | 62526/371472 [4:58:34<22:19:58,  3.84it/s]
 17%|█▋        | 62527/371472 [4:58:35<22:11:19,  3.87it/s]
 17%|█▋        | 62528/371472 [4:58:35<23:01:56,  3.73it/s]
 17%|█▋        | 62529/371472 [4:58:35<22:44:59,  3.77it/s]
 17%|█▋        | 62530/371472 [4:58:36<23:34:31,  3.64it/s]
 17%|█▋        | 62531/371472 [4:58:36<25:02:31,  3.43it/s]
 17%|█▋        | 62532/371472 [4:58:36<24:35:22,  3.49it/s]
 17%|█▋        | 62533/371472 [4:58:37<25:26:32,  3.37it/s]
 17%|█▋        | 62534/371472 [4:58:37<24:25:43,  3.51it/s]
 17%|█▋        | 62535/371472 [4:58:37<25:11:40,  3.41it/s]
 17%|█▋        | 62536/371472 [4:58:37<23:58:47,  3.58it/s]
 17%|█▋        | 62537/371472 [4:58:38<24:57:58,  3.44it/s]
 17%|█▋        | 62538/371472 [4:58:38<24:26:58,  3.51it/s]
 17%|█▋        | 62539/371472 [4:58:38<25:25:04,  3.38it/s]
 17%|█▋        | 62540/371472 [4:58:39<25:21:46,  3.38it/s]
                                                           
{'loss': 4.1406, 'learning_rate': 8.488816824322868e-07, 'epoch': 2.69}

 17%|█▋        | 62540/371472 [4:58:39<25:21:46,  3.38it/s]
 17%|█▋        | 62541/371472 [4:58:39<24:59:25,  3.43it/s]
 17%|█▋        | 62542/371472 [4:58:39<24:05:39,  3.56it/s]
 17%|█▋        | 62543/371472 [4:58:39<25:56:48,  3.31it/s]
 17%|█▋        | 62544/371472 [4:58:40<24:30:19,  3.50it/s]
 17%|█▋        | 62545/371472 [4:58:40<24:23:44,  3.52it/s]
 17%|█▋        | 62546/371472 [4:58:40<25:24:24,  3.38it/s]
 17%|█▋        | 62547/371472 [4:58:41<23:53:33,  3.59it/s]
 17%|█▋        | 62548/371472 [4:58:41<23:23:02,  3.67it/s]
 17%|█▋        | 62549/371472 [4:58:41<23:34:27,  3.64it/s]
 17%|█▋        | 62550/371472 [4:58:41<23:56:17,  3.58it/s]
 17%|█▋        | 62551/371472 [4:58:42<23:22:48,  3.67it/s]
 17%|█▋        | 62552/371472 [4:58:42<24:25:43,  3.51it/s]
 17%|█▋        | 62553/371472 [4:58:42<24:06:48,  3.56it/s]
 17%|█▋        | 62554/371472 [4:58:42<24:40:32,  3.48it/s]
 17%|█▋        | 62555/371472 [4:58:43<24:36:06,  3.49it/s]
 17%|█▋        | 62556/371472 [4:58:43<24:34:50,  3.49it/s]
 17%|█▋        | 62557/371472 [4:58:43<25:43:00,  3.34it/s]
 17%|█▋        | 62558/371472 [4:58:44<25:06:52,  3.42it/s]
 17%|█▋        | 62559/371472 [4:58:44<24:48:35,  3.46it/s]
 17%|█▋        | 62560/371472 [4:58:44<25:25:48,  3.37it/s]
                                                           
{'loss': 4.2378, 'learning_rate': 8.488332004568079e-07, 'epoch': 2.69}

 17%|█▋        | 62560/371472 [4:58:44<25:25:48,  3.37it/s]
 17%|█▋        | 62561/371472 [4:58:45<25:10:58,  3.41it/s]
 17%|█▋        | 62562/371472 [4:58:45<23:49:42,  3.60it/s]
 17%|█▋        | 62563/371472 [4:58:45<23:12:26,  3.70it/s]
 17%|█▋        | 62564/371472 [4:58:45<24:32:51,  3.50it/s]
 17%|█▋        | 62565/371472 [4:58:46<24:23:51,  3.52it/s]
 17%|█▋        | 62566/371472 [4:58:46<23:42:15,  3.62it/s]
 17%|█▋        | 62567/371472 [4:58:46<22:55:20,  3.74it/s]
 17%|█▋        | 62568/371472 [4:58:46<23:28:46,  3.65it/s]
 17%|█▋        | 62569/371472 [4:58:47<22:58:57,  3.73it/s]
 17%|█▋        | 62570/371472 [4:58:47<24:11:58,  3.55it/s]
 17%|█▋        | 62571/371472 [4:58:47<23:50:20,  3.60it/s]
 17%|█▋        | 62572/371472 [4:58:48<22:57:54,  3.74it/s]
 17%|█▋        | 62573/371472 [4:58:48<23:11:09,  3.70it/s]
 17%|█▋        | 62574/371472 [4:58:48<23:42:40,  3.62it/s]
 17%|█▋        | 62575/371472 [4:58:48<26:26:05,  3.25it/s]
 17%|█▋        | 62576/371472 [4:58:49<24:47:20,  3.46it/s]
 17%|█▋        | 62577/371472 [4:58:49<23:53:08,  3.59it/s]
 17%|█▋        | 62578/371472 [4:58:49<25:22:49,  3.38it/s]
 17%|█▋        | 62579/371472 [4:58:50<24:58:53,  3.43it/s]
 17%|█▋        | 62580/371472 [4:58:50<24:36:32,  3.49it/s]
                                                           
{'loss': 4.2389, 'learning_rate': 8.48784718481329e-07, 'epoch': 2.7}

 17%|█▋        | 62580/371472 [4:58:50<24:36:32,  3.49it/s]
 17%|█▋        | 62581/371472 [4:58:50<24:12:19,  3.54it/s]
 17%|█▋        | 62582/371472 [4:58:50<23:36:52,  3.63it/s]
 17%|█▋        | 62583/371472 [4:58:51<24:09:23,  3.55it/s]
 17%|█▋        | 62584/371472 [4:58:51<24:01:32,  3.57it/s]
 17%|█▋        | 62585/371472 [4:58:51<24:11:54,  3.55it/s]
 17%|█▋        | 62586/371472 [4:58:52<23:51:58,  3.60it/s]
 17%|█▋        | 62587/371472 [4:58:52<23:16:01,  3.69it/s]
 17%|█▋        | 62588/371472 [4:58:52<23:08:25,  3.71it/s]
 17%|█▋        | 62589/371472 [4:58:52<22:33:31,  3.80it/s]
 17%|█▋        | 62590/371472 [4:58:53<24:09:02,  3.55it/s]
 17%|█▋        | 62591/371472 [4:58:53<23:49:11,  3.60it/s]
 17%|█▋        | 62592/371472 [4:58:53<24:33:55,  3.49it/s]
 17%|█▋        | 62593/371472 [4:58:53<23:23:42,  3.67it/s]
 17%|█▋        | 62594/371472 [4:58:54<24:00:01,  3.57it/s]
 17%|█▋        | 62595/371472 [4:58:54<24:01:47,  3.57it/s]
 17%|█▋        | 62596/371472 [4:58:54<25:05:45,  3.42it/s]
 17%|█▋        | 62597/371472 [4:58:55<24:02:24,  3.57it/s]
 17%|█▋        | 62598/371472 [4:58:55<23:11:25,  3.70it/s]
 17%|█▋        | 62599/371472 [4:58:55<22:48:40,  3.76it/s]
 17%|█▋        | 62600/371472 [4:58:55<23:16:23,  3.69it/s]
                                                           
{'loss': 4.1908, 'learning_rate': 8.487362365058502e-07, 'epoch': 2.7}

 17%|█▋        | 62600/371472 [4:58:55<23:16:23,  3.69it/s]
 17%|█▋        | 62601/371472 [4:58:56<23:56:44,  3.58it/s]
 17%|█▋        | 62602/371472 [4:58:56<23:11:05,  3.70it/s]
 17%|█▋        | 62603/371472 [4:58:56<23:53:18,  3.59it/s]
 17%|█▋        | 62604/371472 [4:58:56<23:14:09,  3.69it/s]
 17%|█▋        | 62605/371472 [4:58:57<23:26:25,  3.66it/s]
 17%|█▋        | 62606/371472 [4:58:57<24:08:20,  3.55it/s]
 17%|█▋        | 62607/371472 [4:58:57<25:09:51,  3.41it/s]
 17%|█▋        | 62608/371472 [4:58:58<24:04:59,  3.56it/s]
 17%|█▋        | 62609/371472 [4:58:58<23:35:56,  3.64it/s]
 17%|█▋        | 62610/371472 [4:58:58<23:39:58,  3.63it/s]
 17%|█▋        | 62611/371472 [4:58:58<23:29:36,  3.65it/s]
 17%|█▋        | 62612/371472 [4:58:59<23:02:11,  3.72it/s]
 17%|█▋        | 62613/371472 [4:58:59<23:13:17,  3.69it/s]
 17%|█▋        | 62614/371472 [4:58:59<22:38:25,  3.79it/s]
 17%|█▋        | 62615/371472 [4:59:00<25:43:51,  3.33it/s]
 17%|█▋        | 62616/371472 [4:59:00<24:45:03,  3.47it/s]
 17%|█▋        | 62617/371472 [4:59:00<24:01:48,  3.57it/s]
 17%|█▋        | 62618/371472 [4:59:00<22:56:51,  3.74it/s]
 17%|█▋        | 62619/371472 [4:59:01<22:34:30,  3.80it/s]
 17%|█▋        | 62620/371472 [4:59:01<22:38:01,  3.79it/s]
                                                           
{'loss': 4.269, 'learning_rate': 8.486877545303712e-07, 'epoch': 2.7}

 17%|█▋        | 62620/371472 [4:59:01<22:38:01,  3.79it/s]
 17%|█▋        | 62621/371472 [4:59:01<22:40:04,  3.78it/s]
 17%|█▋        | 62622/371472 [4:59:01<22:31:59,  3.81it/s]
 17%|█▋        | 62623/371472 [4:59:02<24:31:43,  3.50it/s]
 17%|█▋        | 62624/371472 [4:59:02<25:02:41,  3.43it/s]
 17%|█▋        | 62625/371472 [4:59:02<25:22:07,  3.38it/s]
 17%|█▋        | 62626/371472 [4:59:03<25:56:14,  3.31it/s]
 17%|█▋        | 62627/371472 [4:59:03<24:42:17,  3.47it/s]
 17%|█▋        | 62628/371472 [4:59:03<24:59:21,  3.43it/s]
 17%|█▋        | 62629/371472 [4:59:03<24:44:21,  3.47it/s]
 17%|█▋        | 62630/371472 [4:59:04<25:51:34,  3.32it/s]
 17%|█▋        | 62631/371472 [4:59:04<25:40:05,  3.34it/s]
 17%|█▋        | 62632/371472 [4:59:04<24:44:21,  3.47it/s]
 17%|█▋        | 62633/371472 [4:59:05<24:15:03,  3.54it/s]
 17%|█▋        | 62634/371472 [4:59:05<24:04:41,  3.56it/s]
 17%|█▋        | 62635/371472 [4:59:05<24:22:03,  3.52it/s]
 17%|█▋        | 62636/371472 [4:59:05<24:06:11,  3.56it/s]
 17%|█▋        | 62637/371472 [4:59:06<25:25:25,  3.37it/s]
 17%|█▋        | 62638/371472 [4:59:06<24:48:22,  3.46it/s]
 17%|█▋        | 62639/371472 [4:59:06<25:47:54,  3.33it/s]
 17%|█▋        | 62640/371472 [4:59:07<25:30:53,  3.36it/s]
                                                           
{'loss': 4.0371, 'learning_rate': 8.486392725548923e-07, 'epoch': 2.7}

 17%|█▋        | 62640/371472 [4:59:07<25:30:53,  3.36it/s]
 17%|█▋        | 62641/371472 [4:59:07<26:33:37,  3.23it/s]
 17%|█▋        | 62642/371472 [4:59:07<25:23:36,  3.38it/s]
 17%|█▋        | 62643/371472 [4:59:08<25:55:12,  3.31it/s]
 17%|█▋        | 62644/371472 [4:59:08<24:15:23,  3.54it/s]
 17%|█▋        | 62645/371472 [4:59:08<24:59:11,  3.43it/s]
 17%|█▋        | 62646/371472 [4:59:08<25:35:30,  3.35it/s]
 17%|█▋        | 62647/371472 [4:59:09<24:27:18,  3.51it/s]
 17%|█▋        | 62648/371472 [4:59:09<23:50:15,  3.60it/s]
 17%|█▋        | 62649/371472 [4:59:09<25:18:15,  3.39it/s]
 17%|█▋        | 62650/371472 [4:59:10<23:57:08,  3.58it/s]
 17%|█▋        | 62651/371472 [4:59:10<24:03:23,  3.57it/s]
 17%|█▋        | 62652/371472 [4:59:10<24:00:58,  3.57it/s]
 17%|█▋        | 62653/371472 [4:59:10<24:50:27,  3.45it/s]
 17%|█▋        | 62654/371472 [4:59:11<24:14:41,  3.54it/s]
 17%|█▋        | 62655/371472 [4:59:11<24:26:41,  3.51it/s]
 17%|█▋        | 62656/371472 [4:59:11<23:48:03,  3.60it/s]
 17%|█▋        | 62657/371472 [4:59:12<23:14:08,  3.69it/s]
 17%|█▋        | 62658/371472 [4:59:12<25:11:50,  3.40it/s]
 17%|█▋        | 62659/371472 [4:59:12<23:50:24,  3.60it/s]
 17%|█▋        | 62660/371472 [4:59:12<24:39:14,  3.48it/s]
                                                           
{'loss': 4.2435, 'learning_rate': 8.485907905794134e-07, 'epoch': 2.7}

 17%|█▋        | 62660/371472 [4:59:12<24:39:14,  3.48it/s]
 17%|█▋        | 62661/371472 [4:59:13<23:25:29,  3.66it/s]
 17%|█▋        | 62662/371472 [4:59:13<24:16:42,  3.53it/s]
 17%|█▋        | 62663/371472 [4:59:13<23:37:15,  3.63it/s]
 17%|█▋        | 62664/371472 [4:59:14<24:48:13,  3.46it/s]
 17%|█▋        | 62665/371472 [4:59:14<23:44:19,  3.61it/s]
 17%|█▋        | 62666/371472 [4:59:14<24:17:42,  3.53it/s]
 17%|█▋        | 62667/371472 [4:59:14<24:00:46,  3.57it/s]
 17%|█▋        | 62668/371472 [4:59:15<24:24:03,  3.52it/s]
 17%|█▋        | 62669/371472 [4:59:15<23:47:19,  3.61it/s]
 17%|█▋        | 62670/371472 [4:59:15<24:19:30,  3.53it/s]
 17%|█▋        | 62671/371472 [4:59:15<23:58:14,  3.58it/s]
 17%|█▋        | 62672/371472 [4:59:16<23:38:18,  3.63it/s]
 17%|█▋        | 62673/371472 [4:59:16<23:50:33,  3.60it/s]
 17%|█▋        | 62674/371472 [4:59:16<24:09:52,  3.55it/s]
 17%|█▋        | 62675/371472 [4:59:17<24:13:21,  3.54it/s]
 17%|█▋        | 62676/371472 [4:59:17<23:53:33,  3.59it/s]
 17%|█▋        | 62677/371472 [4:59:17<25:20:30,  3.38it/s]
 17%|█▋        | 62678/371472 [4:59:17<24:52:46,  3.45it/s]
 17%|█▋        | 62679/371472 [4:59:18<24:37:43,  3.48it/s]
 17%|█▋        | 62680/371472 [4:59:18<24:34:44,  3.49it/s]
                                                           
{'loss': 4.1919, 'learning_rate': 8.485423086039344e-07, 'epoch': 2.7}

 17%|█▋        | 62680/371472 [4:59:18<24:34:44,  3.49it/s]
 17%|█▋        | 62681/371472 [4:59:18<25:24:19,  3.38it/s]
 17%|█▋        | 62682/371472 [4:59:19<24:40:21,  3.48it/s]
 17%|█▋        | 62683/371472 [4:59:19<23:24:14,  3.66it/s]
 17%|█▋        | 62684/371472 [4:59:19<24:00:07,  3.57it/s]
 17%|█▋        | 62685/371472 [4:59:20<25:05:23,  3.42it/s]
 17%|█▋        | 62686/371472 [4:59:20<25:40:31,  3.34it/s]
 17%|█▋        | 62687/371472 [4:59:20<24:42:37,  3.47it/s]
 17%|█▋        | 62688/371472 [4:59:20<25:08:56,  3.41it/s]
 17%|█▋        | 62689/371472 [4:59:21<24:28:27,  3.50it/s]
 17%|█▋        | 62690/371472 [4:59:21<24:47:21,  3.46it/s]
 17%|█▋        | 62691/371472 [4:59:21<24:48:46,  3.46it/s]
 17%|█▋        | 62692/371472 [4:59:21<23:47:09,  3.61it/s]
 17%|█▋        | 62693/371472 [4:59:22<23:00:39,  3.73it/s]
 17%|█▋        | 62694/371472 [4:59:22<22:56:42,  3.74it/s]
 17%|█▋        | 62695/371472 [4:59:22<24:48:03,  3.46it/s]
 17%|█▋        | 62696/371472 [4:59:23<23:50:24,  3.60it/s]
 17%|█▋        | 62697/371472 [4:59:23<24:34:13,  3.49it/s]
 17%|█▋        | 62698/371472 [4:59:23<24:27:43,  3.51it/s]
 17%|█▋        | 62699/371472 [4:59:24<25:42:26,  3.34it/s]
 17%|█▋        | 62700/371472 [4:59:24<24:22:09,  3.52it/s]
                                                           
{'loss': 4.0822, 'learning_rate': 8.484938266284557e-07, 'epoch': 2.7}

 17%|█▋        | 62700/371472 [4:59:24<24:22:09,  3.52it/s]
 17%|█▋        | 62701/371472 [4:59:24<23:46:27,  3.61it/s]
 17%|█▋        | 62702/371472 [4:59:24<24:43:00,  3.47it/s]
 17%|█▋        | 62703/371472 [4:59:25<29:46:51,  2.88it/s]
 17%|█▋        | 62704/371472 [4:59:25<27:43:15,  3.09it/s]
 17%|█▋        | 62705/371472 [4:59:25<26:43:47,  3.21it/s]
 17%|█▋        | 62706/371472 [4:59:26<25:22:54,  3.38it/s]
 17%|█▋        | 62707/371472 [4:59:26<25:22:49,  3.38it/s]
 17%|█▋        | 62708/371472 [4:59:26<23:56:59,  3.58it/s]
 17%|█▋        | 62709/371472 [4:59:26<23:04:18,  3.72it/s]
 17%|█▋        | 62710/371472 [4:59:27<24:27:21,  3.51it/s]
 17%|█▋        | 62711/371472 [4:59:27<25:31:20,  3.36it/s]
 17%|█▋        | 62712/371472 [4:59:27<24:14:14,  3.54it/s]
 17%|█▋        | 62713/371472 [4:59:28<23:44:59,  3.61it/s]
 17%|█▋        | 62714/371472 [4:59:28<24:07:46,  3.55it/s]
 17%|█▋        | 62715/371472 [4:59:28<23:24:32,  3.66it/s]
 17%|█▋        | 62716/371472 [4:59:28<25:17:18,  3.39it/s]
 17%|█▋        | 62717/371472 [4:59:29<24:28:46,  3.50it/s]
 17%|█▋        | 62718/371472 [4:59:29<23:59:13,  3.58it/s]
 17%|█▋        | 62719/371472 [4:59:29<23:29:26,  3.65it/s]
 17%|█▋        | 62720/371472 [4:59:30<22:47:28,  3.76it/s]
                                                           
{'loss': 4.2258, 'learning_rate': 8.484453446529768e-07, 'epoch': 2.7}

 17%|█▋        | 62720/371472 [4:59:30<22:47:28,  3.76it/s]
 17%|█▋        | 62721/371472 [4:59:30<22:58:14,  3.73it/s]
 17%|█▋        | 62722/371472 [4:59:30<22:32:52,  3.80it/s]
 17%|█▋        | 62723/371472 [4:59:30<22:14:37,  3.86it/s]
 17%|█▋        | 62724/371472 [4:59:31<22:40:22,  3.78it/s]
 17%|█▋        | 62725/371472 [4:59:31<23:39:08,  3.63it/s]
 17%|█▋        | 62726/371472 [4:59:31<23:22:38,  3.67it/s]
 17%|█▋        | 62727/371472 [4:59:31<22:49:17,  3.76it/s]
 17%|█▋        | 62728/371472 [4:59:32<22:43:56,  3.77it/s]
 17%|█▋        | 62729/371472 [4:59:32<22:08:52,  3.87it/s]
 17%|█▋        | 62730/371472 [4:59:32<22:24:04,  3.83it/s]
 17%|█▋        | 62731/371472 [4:59:32<24:10:15,  3.55it/s]
 17%|█▋        | 62732/371472 [4:59:33<24:19:49,  3.52it/s]
 17%|█▋        | 62733/371472 [4:59:33<23:47:24,  3.60it/s]
 17%|█▋        | 62734/371472 [4:59:33<23:51:34,  3.59it/s]
 17%|█▋        | 62735/371472 [4:59:34<23:40:28,  3.62it/s]
 17%|█▋        | 62736/371472 [4:59:34<23:27:09,  3.66it/s]
 17%|█▋        | 62737/371472 [4:59:34<22:59:00,  3.73it/s]
 17%|█▋        | 62738/371472 [4:59:34<23:25:12,  3.66it/s]
 17%|█▋        | 62739/371472 [4:59:35<23:32:40,  3.64it/s]
 17%|█▋        | 62740/371472 [4:59:35<23:59:59,  3.57it/s]
                                                           
{'loss': 4.0884, 'learning_rate': 8.483968626774978e-07, 'epoch': 2.7}

 17%|█▋        | 62740/371472 [4:59:35<23:59:59,  3.57it/s]
 17%|█▋        | 62741/371472 [4:59:35<23:32:48,  3.64it/s]
 17%|█▋        | 62742/371472 [4:59:36<24:05:28,  3.56it/s]
 17%|█▋        | 62743/371472 [4:59:36<23:13:20,  3.69it/s]
 17%|█▋        | 62744/371472 [4:59:36<22:43:48,  3.77it/s]
 17%|█▋        | 62745/371472 [4:59:36<21:59:46,  3.90it/s]
 17%|█▋        | 62746/371472 [4:59:37<21:51:04,  3.92it/s]
 17%|█▋        | 62747/371472 [4:59:37<21:57:18,  3.91it/s]
 17%|█▋        | 62748/371472 [4:59:37<23:07:11,  3.71it/s]
 17%|█▋        | 62749/371472 [4:59:37<22:47:50,  3.76it/s]
 17%|█▋        | 62750/371472 [4:59:38<22:45:15,  3.77it/s]
 17%|█▋        | 62751/371472 [4:59:38<22:48:22,  3.76it/s]
 17%|█▋        | 62752/371472 [4:59:38<23:01:06,  3.73it/s]
 17%|█▋        | 62753/371472 [4:59:38<24:28:30,  3.50it/s]
 17%|█▋        | 62754/371472 [4:59:39<24:05:08,  3.56it/s]
 17%|█▋        | 62755/371472 [4:59:39<23:08:22,  3.71it/s]
 17%|█▋        | 62756/371472 [4:59:39<25:18:05,  3.39it/s]
 17%|█▋        | 62757/371472 [4:59:40<24:13:49,  3.54it/s]
 17%|█▋        | 62758/371472 [4:59:40<23:40:16,  3.62it/s]
 17%|█▋        | 62759/371472 [4:59:40<24:51:28,  3.45it/s]
 17%|█▋        | 62760/371472 [4:59:41<26:58:38,  3.18it/s]
                                                           
{'loss': 4.2268, 'learning_rate': 8.483483807020189e-07, 'epoch': 2.7}

 17%|█▋        | 62760/371472 [4:59:41<26:58:38,  3.18it/s]
 17%|█▋        | 62761/371472 [4:59:41<25:50:16,  3.32it/s]
 17%|█▋        | 62762/371472 [4:59:41<24:43:44,  3.47it/s]
 17%|█▋        | 62763/371472 [4:59:41<24:14:34,  3.54it/s]
 17%|█▋        | 62764/371472 [4:59:42<24:20:33,  3.52it/s]
 17%|█▋        | 62765/371472 [4:59:42<23:55:05,  3.59it/s]
 17%|█▋        | 62766/371472 [4:59:42<25:15:05,  3.40it/s]
 17%|█▋        | 62767/371472 [4:59:43<25:14:13,  3.40it/s]
 17%|█▋        | 62768/371472 [4:59:43<24:48:56,  3.46it/s]
 17%|█▋        | 62769/371472 [4:59:43<24:01:18,  3.57it/s]
 17%|█▋        | 62770/371472 [4:59:43<27:48:23,  3.08it/s]
 17%|█▋        | 62771/371472 [4:59:44<26:15:50,  3.26it/s]
 17%|█▋        | 62772/371472 [4:59:44<24:47:52,  3.46it/s]
 17%|█▋        | 62773/371472 [4:59:44<25:13:52,  3.40it/s]
 17%|█▋        | 62774/371472 [4:59:45<24:33:38,  3.49it/s]
 17%|█▋        | 62775/371472 [4:59:45<23:35:11,  3.64it/s]
 17%|█▋        | 62776/371472 [4:59:45<23:15:57,  3.69it/s]
 17%|█▋        | 62777/371472 [4:59:45<24:15:19,  3.54it/s]
 17%|█▋        | 62778/371472 [4:59:46<25:06:58,  3.41it/s]
 17%|█▋        | 62779/371472 [4:59:46<25:04:11,  3.42it/s]
 17%|█▋        | 62780/371472 [4:59:46<24:21:45,  3.52it/s]
                                                           
{'loss': 4.0974, 'learning_rate': 8.482998987265402e-07, 'epoch': 2.7}

 17%|█▋        | 62780/371472 [4:59:46<24:21:45,  3.52it/s]
 17%|█▋        | 62781/371472 [4:59:47<26:31:43,  3.23it/s]
 17%|█▋        | 62782/371472 [4:59:47<26:23:02,  3.25it/s]
 17%|█▋        | 62783/371472 [4:59:47<24:58:26,  3.43it/s]
 17%|█▋        | 62784/371472 [4:59:47<24:58:34,  3.43it/s]
 17%|█▋        | 62785/371472 [4:59:48<25:35:32,  3.35it/s]
 17%|█▋        | 62786/371472 [4:59:48<24:14:45,  3.54it/s]
 17%|█▋        | 62787/371472 [4:59:48<24:37:06,  3.48it/s]
 17%|█▋        | 62788/371472 [4:59:49<24:23:02,  3.52it/s]
 17%|█▋        | 62789/371472 [4:59:49<24:00:45,  3.57it/s]
 17%|█▋        | 62790/371472 [4:59:49<23:51:35,  3.59it/s]
 17%|█▋        | 62791/371472 [4:59:49<22:37:49,  3.79it/s]
 17%|█▋        | 62792/371472 [4:59:50<22:15:49,  3.85it/s]
 17%|█▋        | 62793/371472 [4:59:50<23:18:15,  3.68it/s]
 17%|█▋        | 62794/371472 [4:59:50<25:12:26,  3.40it/s]
 17%|█▋        | 62795/371472 [4:59:51<25:02:11,  3.42it/s]
 17%|█▋        | 62796/371472 [4:59:51<30:16:10,  2.83it/s]
 17%|█▋        | 62797/371472 [4:59:51<29:47:38,  2.88it/s]
 17%|█▋        | 62798/371472 [4:59:52<27:05:44,  3.16it/s]
 17%|█▋        | 62799/371472 [4:59:52<25:33:13,  3.36it/s]
 17%|█▋        | 62800/371472 [4:59:52<25:21:50,  3.38it/s]
                                                           
{'loss': 4.2737, 'learning_rate': 8.482514167510612e-07, 'epoch': 2.7}

 17%|█▋        | 62800/371472 [4:59:52<25:21:50,  3.38it/s]
 17%|█▋        | 62801/371472 [4:59:52<25:01:09,  3.43it/s]
 17%|█▋        | 62802/371472 [4:59:53<25:47:45,  3.32it/s]
 17%|█▋        | 62803/371472 [4:59:53<24:59:02,  3.43it/s]
 17%|█▋        | 62804/371472 [4:59:53<26:10:00,  3.28it/s]
 17%|█▋        | 62805/371472 [4:59:54<25:08:44,  3.41it/s]
 17%|█▋        | 62806/371472 [4:59:54<24:11:04,  3.55it/s]
 17%|█▋        | 62807/371472 [4:59:54<23:42:12,  3.62it/s]
 17%|█▋        | 62808/371472 [4:59:54<24:02:00,  3.57it/s]
 17%|█▋        | 62809/371472 [4:59:55<24:17:52,  3.53it/s]
 17%|█▋        | 62810/371472 [4:59:55<24:20:20,  3.52it/s]
 17%|█▋        | 62811/371472 [4:59:55<24:52:06,  3.45it/s]
 17%|█▋        | 62812/371472 [4:59:56<28:11:09,  3.04it/s]
 17%|█▋        | 62813/371472 [4:59:56<25:43:52,  3.33it/s]
 17%|█▋        | 62814/371472 [4:59:56<26:45:20,  3.20it/s]
 17%|█▋        | 62815/371472 [4:59:57<26:34:44,  3.23it/s]
 17%|█▋        | 62816/371472 [4:59:57<24:48:54,  3.46it/s]
 17%|█▋        | 62817/371472 [4:59:57<24:30:08,  3.50it/s]
 17%|█▋        | 62818/371472 [4:59:57<25:47:29,  3.32it/s]
 17%|█▋        | 62819/371472 [4:59:58<25:28:46,  3.36it/s]
 17%|█▋        | 62820/371472 [4:59:58<25:41:31,  3.34it/s]
                                                           
{'loss': 4.3173, 'learning_rate': 8.482029347755823e-07, 'epoch': 2.71}

 17%|█▋        | 62820/371472 [4:59:58<25:41:31,  3.34it/s]
 17%|█▋        | 62821/371472 [4:59:58<25:31:36,  3.36it/s]
 17%|█▋        | 62822/371472 [4:59:59<24:24:01,  3.51it/s]
 17%|█▋        | 62823/371472 [4:59:59<23:57:58,  3.58it/s]
 17%|█▋        | 62824/371472 [4:59:59<23:54:18,  3.59it/s]
 17%|█▋        | 62825/371472 [4:59:59<23:49:51,  3.60it/s]
 17%|█▋        | 62826/371472 [5:00:00<24:08:54,  3.55it/s]
 17%|█▋        | 62827/371472 [5:00:00<25:15:02,  3.40it/s]
 17%|█▋        | 62828/371472 [5:00:00<24:07:00,  3.55it/s]
 17%|█▋        | 62829/371472 [5:00:01<23:53:24,  3.59it/s]
 17%|█▋        | 62830/371472 [5:00:01<23:59:24,  3.57it/s]
 17%|█▋        | 62831/371472 [5:00:01<23:41:11,  3.62it/s]
 17%|█▋        | 62832/371472 [5:00:01<23:35:50,  3.63it/s]
 17%|█▋        | 62833/371472 [5:00:02<26:01:19,  3.29it/s]
 17%|█▋        | 62834/371472 [5:00:02<24:44:24,  3.47it/s]
 17%|█▋        | 62835/371472 [5:00:02<25:19:48,  3.38it/s]
 17%|█▋        | 62836/371472 [5:00:03<24:16:57,  3.53it/s]
 17%|█▋        | 62837/371472 [5:00:03<23:36:15,  3.63it/s]
 17%|█▋        | 62838/371472 [5:00:03<25:41:51,  3.34it/s]
 17%|█▋        | 62839/371472 [5:00:03<24:55:47,  3.44it/s]
 17%|█▋        | 62840/371472 [5:00:04<24:18:17,  3.53it/s]
                                                           
{'loss': 4.0712, 'learning_rate': 8.481544528001034e-07, 'epoch': 2.71}

 17%|█▋        | 62840/371472 [5:00:04<24:18:17,  3.53it/s]
 17%|█▋        | 62841/371472 [5:00:04<24:10:54,  3.55it/s]
 17%|█▋        | 62842/371472 [5:00:04<26:05:14,  3.29it/s]
 17%|█▋        | 62843/371472 [5:00:05<24:54:02,  3.44it/s]
 17%|█▋        | 62844/371472 [5:00:05<23:55:46,  3.58it/s]
 17%|█▋        | 62845/371472 [5:00:05<23:09:58,  3.70it/s]
 17%|█▋        | 62846/371472 [5:00:05<22:51:37,  3.75it/s]
 17%|█▋        | 62847/371472 [5:00:06<24:30:02,  3.50it/s]
 17%|█▋        | 62848/371472 [5:00:06<24:02:26,  3.57it/s]
 17%|█▋        | 62849/371472 [5:00:06<23:09:21,  3.70it/s]
 17%|█▋        | 62850/371472 [5:00:07<22:49:17,  3.76it/s]
 17%|█▋        | 62851/371472 [5:00:07<22:34:09,  3.80it/s]
 17%|█▋        | 62852/371472 [5:00:07<22:50:46,  3.75it/s]
 17%|█▋        | 62853/371472 [5:00:07<23:09:22,  3.70it/s]
 17%|█▋        | 62854/371472 [5:00:08<22:53:10,  3.75it/s]
 17%|█▋        | 62855/371472 [5:00:08<22:33:22,  3.80it/s]
 17%|█▋        | 62856/371472 [5:00:08<23:14:35,  3.69it/s]
 17%|█▋        | 62857/371472 [5:00:08<24:30:28,  3.50it/s]
 17%|█▋        | 62858/371472 [5:00:09<24:38:15,  3.48it/s]
 17%|█▋        | 62859/371472 [5:00:09<25:10:23,  3.41it/s]
 17%|█▋        | 62860/371472 [5:00:09<26:14:55,  3.27it/s]
                                                           
{'loss': 4.4412, 'learning_rate': 8.481059708246245e-07, 'epoch': 2.71}

 17%|█▋        | 62860/371472 [5:00:09<26:14:55,  3.27it/s]
 17%|█▋        | 62861/371472 [5:00:10<25:10:31,  3.41it/s]
 17%|█▋        | 62862/371472 [5:00:10<24:38:09,  3.48it/s]
 17%|█▋        | 62863/371472 [5:00:10<24:06:05,  3.56it/s]
 17%|█▋        | 62864/371472 [5:00:11<26:08:00,  3.28it/s]
 17%|█▋        | 62865/371472 [5:00:11<24:46:03,  3.46it/s]
 17%|█▋        | 62866/371472 [5:00:11<24:21:08,  3.52it/s]
 17%|█▋        | 62867/371472 [5:00:11<23:34:46,  3.64it/s]
 17%|█▋        | 62868/371472 [5:00:12<24:11:37,  3.54it/s]
 17%|█▋        | 62869/371472 [5:00:12<24:07:41,  3.55it/s]
 17%|█▋        | 62870/371472 [5:00:12<25:45:46,  3.33it/s]
 17%|█▋        | 62871/371472 [5:00:13<25:21:32,  3.38it/s]
 17%|█▋        | 62872/371472 [5:00:13<24:15:29,  3.53it/s]
 17%|█▋        | 62873/371472 [5:00:13<27:05:31,  3.16it/s]
 17%|█▋        | 62874/371472 [5:00:13<25:05:40,  3.42it/s]
 17%|█▋        | 62875/371472 [5:00:14<24:24:54,  3.51it/s]
 17%|█▋        | 62876/371472 [5:00:14<24:06:42,  3.56it/s]
 17%|█▋        | 62877/371472 [5:00:14<25:40:01,  3.34it/s]
 17%|█▋        | 62878/371472 [5:00:15<24:44:56,  3.46it/s]
 17%|█▋        | 62879/371472 [5:00:15<23:49:03,  3.60it/s]
 17%|█▋        | 62880/371472 [5:00:15<25:24:16,  3.37it/s]
                                                           
{'loss': 4.271, 'learning_rate': 8.480574888491456e-07, 'epoch': 2.71}

 17%|█▋        | 62880/371472 [5:00:15<25:24:16,  3.37it/s]
 17%|█▋        | 62881/371472 [5:00:15<24:52:26,  3.45it/s]
 17%|█▋        | 62882/371472 [5:00:16<23:51:44,  3.59it/s]
 17%|█▋        | 62883/371472 [5:00:16<24:00:48,  3.57it/s]
 17%|█▋        | 62884/371472 [5:00:16<25:37:01,  3.35it/s]
 17%|█▋        | 62885/371472 [5:00:17<25:50:38,  3.32it/s]
 17%|█▋        | 62886/371472 [5:00:17<26:26:03,  3.24it/s]
 17%|█▋        | 62887/371472 [5:00:17<28:18:39,  3.03it/s]
 17%|█▋        | 62888/371472 [5:00:18<27:13:16,  3.15it/s]
 17%|█▋        | 62889/371472 [5:00:18<26:18:39,  3.26it/s]
 17%|█▋        | 62890/371472 [5:00:18<25:54:22,  3.31it/s]
 17%|█▋        | 62891/371472 [5:00:18<26:05:32,  3.29it/s]
 17%|█▋        | 62892/371472 [5:00:19<25:14:38,  3.40it/s]
 17%|█▋        | 62893/371472 [5:00:19<24:39:54,  3.48it/s]
 17%|█▋        | 62894/371472 [5:00:19<23:40:26,  3.62it/s]
 17%|█▋        | 62895/371472 [5:00:20<23:35:58,  3.63it/s]
 17%|█▋        | 62896/371472 [5:00:20<23:30:02,  3.65it/s]
 17%|█▋        | 62897/371472 [5:00:20<23:13:32,  3.69it/s]
 17%|█▋        | 62898/371472 [5:00:20<22:58:18,  3.73it/s]
 17%|█▋        | 62899/371472 [5:00:21<22:48:13,  3.76it/s]
 17%|█▋        | 62900/371472 [5:00:21<22:57:28,  3.73it/s]
                                                           
{'loss': 4.1806, 'learning_rate': 8.480090068736667e-07, 'epoch': 2.71}

 17%|█▋        | 62900/371472 [5:00:21<22:57:28,  3.73it/s]
 17%|█▋        | 62901/371472 [5:00:21<24:45:58,  3.46it/s]
 17%|█▋        | 62902/371472 [5:00:21<23:45:33,  3.61it/s]
 17%|█▋        | 62903/371472 [5:00:22<23:30:17,  3.65it/s]
 17%|█▋        | 62904/371472 [5:00:22<23:05:21,  3.71it/s]
 17%|█▋        | 62905/371472 [5:00:22<23:08:06,  3.70it/s]
 17%|█▋        | 62906/371472 [5:00:23<23:11:41,  3.70it/s]
 17%|█▋        | 62907/371472 [5:00:23<23:28:00,  3.65it/s]
 17%|█▋        | 62908/371472 [5:00:23<23:31:14,  3.64it/s]
 17%|█▋        | 62909/371472 [5:00:23<22:49:35,  3.75it/s]
 17%|█▋        | 62910/371472 [5:00:24<23:31:04,  3.64it/s]
 17%|█▋        | 62911/371472 [5:00:24<23:12:51,  3.69it/s]
 17%|█▋        | 62912/371472 [5:00:24<23:07:30,  3.71it/s]
 17%|█▋        | 62913/371472 [5:00:24<24:26:57,  3.51it/s]
 17%|█▋        | 62914/371472 [5:00:25<25:12:26,  3.40it/s]
 17%|█▋        | 62915/371472 [5:00:25<26:22:47,  3.25it/s]
 17%|█▋        | 62916/371472 [5:00:25<26:21:32,  3.25it/s]
 17%|█▋        | 62917/371472 [5:00:26<25:00:39,  3.43it/s]
 17%|█▋        | 62918/371472 [5:00:26<24:17:32,  3.53it/s]
 17%|█▋        | 62919/371472 [5:00:26<26:09:46,  3.28it/s]
 17%|█▋        | 62920/371472 [5:00:27<25:13:03,  3.40it/s]
                                                           
{'loss': 4.0364, 'learning_rate': 8.479605248981878e-07, 'epoch': 2.71}

 17%|█▋        | 62920/371472 [5:00:27<25:13:03,  3.40it/s]
 17%|█▋        | 62921/371472 [5:00:27<24:31:16,  3.50it/s]
 17%|█▋        | 62922/371472 [5:00:27<24:36:43,  3.48it/s]
 17%|█▋        | 62923/371472 [5:00:27<25:11:44,  3.40it/s]
 17%|█▋        | 62924/371472 [5:00:28<24:21:11,  3.52it/s]
 17%|█▋        | 62925/371472 [5:00:28<24:27:33,  3.50it/s]
 17%|█▋        | 62926/371472 [5:00:28<24:40:55,  3.47it/s]
 17%|█▋        | 62927/371472 [5:00:29<24:06:14,  3.56it/s]
 17%|█▋        | 62928/371472 [5:00:29<24:01:59,  3.57it/s]
 17%|█▋        | 62929/371472 [5:00:29<26:02:02,  3.29it/s]
 17%|█▋        | 62930/371472 [5:00:30<26:11:55,  3.27it/s]
 17%|█▋        | 62931/371472 [5:00:30<24:45:18,  3.46it/s]
 17%|█▋        | 62932/371472 [5:00:30<24:23:42,  3.51it/s]
 17%|█▋        | 62933/371472 [5:00:30<23:47:40,  3.60it/s]
 17%|█▋        | 62934/371472 [5:00:31<23:09:44,  3.70it/s]
 17%|█▋        | 62935/371472 [5:00:31<22:57:11,  3.73it/s]
 17%|█▋        | 62936/371472 [5:00:31<23:10:21,  3.70it/s]
 17%|█▋        | 62937/371472 [5:00:31<24:56:41,  3.44it/s]
 17%|█▋        | 62938/371472 [5:00:32<24:23:19,  3.51it/s]
 17%|█▋        | 62939/371472 [5:00:32<23:56:27,  3.58it/s]
 17%|█▋        | 62940/371472 [5:00:32<23:58:00,  3.58it/s]
                                                           
{'loss': 4.1013, 'learning_rate': 8.479120429227089e-07, 'epoch': 2.71}

 17%|█▋        | 62940/371472 [5:00:32<23:58:00,  3.58it/s]
 17%|█▋        | 62941/371472 [5:00:33<24:39:31,  3.48it/s]
 17%|█▋        | 62942/371472 [5:00:33<24:27:42,  3.50it/s]
 17%|█▋        | 62943/371472 [5:00:33<23:43:24,  3.61it/s]
 17%|█▋        | 62944/371472 [5:00:33<23:36:53,  3.63it/s]
 17%|█▋        | 62945/371472 [5:00:34<23:13:06,  3.69it/s]
 17%|█▋        | 62946/371472 [5:00:34<23:13:23,  3.69it/s]
 17%|█▋        | 62947/371472 [5:00:34<23:02:17,  3.72it/s]
 17%|█▋        | 62948/371472 [5:00:34<24:42:53,  3.47it/s]
 17%|█▋        | 62949/371472 [5:00:35<25:33:58,  3.35it/s]
 17%|█▋        | 62950/371472 [5:00:35<24:34:44,  3.49it/s]
 17%|█▋        | 62951/371472 [5:00:35<23:30:08,  3.65it/s]
 17%|█▋        | 62952/371472 [5:00:36<22:50:30,  3.75it/s]
 17%|█▋        | 62953/371472 [5:00:36<30:25:11,  2.82it/s]
 17%|█▋        | 62954/371472 [5:00:36<27:54:31,  3.07it/s]
 17%|█▋        | 62955/371472 [5:00:37<26:08:09,  3.28it/s]
 17%|█▋        | 62956/371472 [5:00:37<24:46:53,  3.46it/s]
 17%|█▋        | 62957/371472 [5:00:37<24:02:29,  3.56it/s]
 17%|█▋        | 62958/371472 [5:00:37<24:07:43,  3.55it/s]
 17%|█▋        | 62959/371472 [5:00:38<24:15:46,  3.53it/s]
 17%|█▋        | 62960/371472 [5:00:38<23:54:55,  3.58it/s]
                                                           
{'loss': 4.0226, 'learning_rate': 8.478635609472301e-07, 'epoch': 2.71}

 17%|█▋        | 62960/371472 [5:00:38<23:54:55,  3.58it/s]
 17%|█▋        | 62961/371472 [5:00:38<24:21:53,  3.52it/s]
 17%|█▋        | 62962/371472 [5:00:39<24:07:39,  3.55it/s]
 17%|█▋        | 62963/371472 [5:00:39<23:33:48,  3.64it/s]
 17%|█▋        | 62964/371472 [5:00:39<23:05:57,  3.71it/s]
 17%|█▋        | 62965/371472 [5:00:39<23:31:24,  3.64it/s]
 17%|█▋        | 62966/371472 [5:00:40<26:03:01,  3.29it/s]
 17%|█▋        | 62967/371472 [5:00:40<25:26:02,  3.37it/s]
 17%|█▋        | 62968/371472 [5:00:40<25:04:57,  3.42it/s]
 17%|█▋        | 62969/371472 [5:00:41<26:16:42,  3.26it/s]
 17%|█▋        | 62970/371472 [5:00:41<25:13:47,  3.40it/s]
 17%|█▋        | 62971/371472 [5:00:41<24:59:58,  3.43it/s]
 17%|█▋        | 62972/371472 [5:00:42<25:16:13,  3.39it/s]
 17%|█▋        | 62973/371472 [5:00:42<26:19:37,  3.25it/s]
 17%|█▋        | 62974/371472 [5:00:42<25:56:43,  3.30it/s]
 17%|█▋        | 62975/371472 [5:00:42<24:22:21,  3.52it/s]
 17%|█▋        | 62976/371472 [5:00:43<26:36:03,  3.22it/s]
 17%|█▋        | 62977/371472 [5:00:43<27:02:26,  3.17it/s]
 17%|█▋        | 62978/371472 [5:00:43<26:50:17,  3.19it/s]
 17%|█▋        | 62979/371472 [5:00:44<25:14:00,  3.40it/s]
 17%|█▋        | 62980/371472 [5:00:44<24:57:52,  3.43it/s]
                                                           
{'loss': 4.1229, 'learning_rate': 8.478150789717512e-07, 'epoch': 2.71}

 17%|█▋        | 62980/371472 [5:00:44<24:57:52,  3.43it/s]
 17%|█▋        | 62981/371472 [5:00:44<25:13:19,  3.40it/s]
 17%|█▋        | 62982/371472 [5:00:44<23:57:27,  3.58it/s]
 17%|█▋        | 62983/371472 [5:00:45<24:41:22,  3.47it/s]
 17%|█▋        | 62984/371472 [5:00:45<24:52:21,  3.45it/s]
 17%|█▋        | 62985/371472 [5:00:45<24:10:06,  3.55it/s]
 17%|█▋        | 62986/371472 [5:00:46<24:34:48,  3.49it/s]
 17%|█▋        | 62987/371472 [5:00:46<24:15:21,  3.53it/s]
 17%|█▋        | 62988/371472 [5:00:46<23:32:52,  3.64it/s]
 17%|█▋        | 62989/371472 [5:00:46<23:53:57,  3.59it/s]
 17%|█▋        | 62990/371472 [5:00:47<23:31:48,  3.64it/s]
 17%|█▋        | 62991/371472 [5:00:47<23:58:03,  3.58it/s]
 17%|█▋        | 62992/371472 [5:00:47<22:41:57,  3.77it/s]
 17%|█▋        | 62993/371472 [5:00:47<22:39:22,  3.78it/s]
 17%|█▋        | 62994/371472 [5:00:48<22:07:22,  3.87it/s]
 17%|█▋        | 62995/371472 [5:00:48<24:25:42,  3.51it/s]
 17%|█▋        | 62996/371472 [5:00:48<25:26:41,  3.37it/s]
 17%|█▋        | 62997/371472 [5:00:49<26:25:48,  3.24it/s]
 17%|█▋        | 62998/371472 [5:00:49<25:13:58,  3.40it/s]
 17%|█▋        | 62999/371472 [5:00:49<23:51:09,  3.59it/s]
 17%|█▋        | 63000/371472 [5:00:50<23:48:22,  3.60it/s]
                                                           
{'loss': 4.1475, 'learning_rate': 8.477665969962722e-07, 'epoch': 2.71}

 17%|█▋        | 63000/371472 [5:00:50<23:48:22,  3.60it/s]
 17%|█▋        | 63001/371472 [5:00:50<24:34:00,  3.49it/s]
 17%|█▋        | 63002/371472 [5:00:50<25:24:57,  3.37it/s]
 17%|█▋        | 63003/371472 [5:00:50<24:33:34,  3.49it/s]
 17%|█▋        | 63004/371472 [5:00:51<23:51:58,  3.59it/s]
 17%|█▋        | 63005/371472 [5:00:51<25:57:31,  3.30it/s]
 17%|█▋        | 63006/371472 [5:00:51<28:17:46,  3.03it/s]
 17%|█▋        | 63007/371472 [5:00:52<27:24:03,  3.13it/s]
 17%|█▋        | 63008/371472 [5:00:52<26:36:16,  3.22it/s]
 17%|█▋        | 63009/371472 [5:00:52<25:22:59,  3.38it/s]
 17%|█▋        | 63010/371472 [5:00:53<25:46:13,  3.32it/s]
 17%|█▋        | 63011/371472 [5:00:53<25:04:36,  3.42it/s]
 17%|█▋        | 63012/371472 [5:00:53<25:12:42,  3.40it/s]
 17%|█▋        | 63013/371472 [5:00:53<25:49:33,  3.32it/s]
 17%|█▋        | 63014/371472 [5:00:54<25:38:12,  3.34it/s]
 17%|█▋        | 63015/371472 [5:00:54<25:35:37,  3.35it/s]
 17%|█▋        | 63016/371472 [5:00:54<24:32:19,  3.49it/s]
 17%|█▋        | 63017/371472 [5:00:55<25:11:41,  3.40it/s]
 17%|█▋        | 63018/371472 [5:00:55<28:38:01,  2.99it/s]
 17%|█▋        | 63019/371472 [5:00:55<27:18:13,  3.14it/s]
 17%|█▋        | 63020/371472 [5:00:56<25:59:10,  3.30it/s]
                                                           
{'loss': 4.1741, 'learning_rate': 8.477181150207933e-07, 'epoch': 2.71}

 17%|█▋        | 63020/371472 [5:00:56<25:59:10,  3.30it/s]
 17%|█▋        | 63021/371472 [5:00:56<25:35:00,  3.35it/s]
 17%|█▋        | 63022/371472 [5:00:56<24:59:50,  3.43it/s]
 17%|█▋        | 63023/371472 [5:00:56<25:35:03,  3.35it/s]
 17%|█▋        | 63024/371472 [5:00:57<27:44:04,  3.09it/s]
 17%|█▋        | 63025/371472 [5:00:57<25:42:53,  3.33it/s]
 17%|█▋        | 63026/371472 [5:00:57<26:31:04,  3.23it/s]
 17%|█▋        | 63027/371472 [5:00:58<27:05:45,  3.16it/s]
 17%|█▋        | 63028/371472 [5:00:58<25:14:41,  3.39it/s]
 17%|█▋        | 63029/371472 [5:00:58<25:10:52,  3.40it/s]
 17%|█▋        | 63030/371472 [5:00:59<24:52:36,  3.44it/s]
 17%|█▋        | 63031/371472 [5:00:59<25:06:13,  3.41it/s]
 17%|█▋        | 63032/371472 [5:00:59<24:16:55,  3.53it/s]
 17%|█▋        | 63033/371472 [5:00:59<24:49:12,  3.45it/s]
 17%|█▋        | 63034/371472 [5:01:00<24:04:42,  3.56it/s]
 17%|█▋        | 63035/371472 [5:01:00<23:53:51,  3.59it/s]
 17%|█▋        | 63036/371472 [5:01:00<23:08:05,  3.70it/s]
 17%|█▋        | 63037/371472 [5:01:01<25:43:44,  3.33it/s]
 17%|█▋        | 63038/371472 [5:01:01<25:13:27,  3.40it/s]
 17%|█▋        | 63039/371472 [5:01:01<24:37:34,  3.48it/s]
 17%|█▋        | 63040/371472 [5:01:01<24:36:59,  3.48it/s]
                                                           
{'loss': 4.3025, 'learning_rate': 8.476696330453145e-07, 'epoch': 2.72}

 17%|█▋        | 63040/371472 [5:01:01<24:36:59,  3.48it/s]
 17%|█▋        | 63041/371472 [5:01:02<24:05:08,  3.56it/s]
 17%|█▋        | 63042/371472 [5:01:02<23:17:13,  3.68it/s]
 17%|█▋        | 63043/371472 [5:01:02<22:50:47,  3.75it/s]
 17%|█▋        | 63044/371472 [5:01:03<23:04:09,  3.71it/s]
 17%|█▋        | 63045/371472 [5:01:03<23:10:23,  3.70it/s]
 17%|█▋        | 63046/371472 [5:01:03<23:30:54,  3.64it/s]
 17%|█▋        | 63047/371472 [5:01:03<23:17:09,  3.68it/s]
 17%|█▋        | 63048/371472 [5:01:04<22:53:43,  3.74it/s]
 17%|█▋        | 63049/371472 [5:01:04<22:49:55,  3.75it/s]
 17%|█▋        | 63050/371472 [5:01:04<27:12:40,  3.15it/s]
 17%|█▋        | 63051/371472 [5:01:05<27:18:56,  3.14it/s]
 17%|█▋        | 63052/371472 [5:01:05<25:33:26,  3.35it/s]
 17%|█▋        | 63053/371472 [5:01:05<25:22:01,  3.38it/s]
 17%|█▋        | 63054/371472 [5:01:05<24:49:58,  3.45it/s]
 17%|█▋        | 63055/371472 [5:01:06<24:10:06,  3.54it/s]
 17%|█▋        | 63056/371472 [5:01:06<25:20:35,  3.38it/s]
 17%|█▋        | 63057/371472 [5:01:06<25:42:06,  3.33it/s]
 17%|█▋        | 63058/371472 [5:01:07<24:48:20,  3.45it/s]
 17%|█▋        | 63059/371472 [5:01:07<24:12:07,  3.54it/s]
 17%|█▋        | 63060/371472 [5:01:07<23:41:37,  3.62it/s]
                                                           
{'loss': 4.2863, 'learning_rate': 8.476211510698355e-07, 'epoch': 2.72}

 17%|█▋        | 63060/371472 [5:01:07<23:41:37,  3.62it/s]
 17%|█▋        | 63061/371472 [5:01:07<23:51:44,  3.59it/s]
 17%|█▋        | 63062/371472 [5:01:08<24:01:28,  3.57it/s]
 17%|█▋        | 63063/371472 [5:01:08<25:10:04,  3.40it/s]
 17%|█▋        | 63064/371472 [5:01:08<24:19:21,  3.52it/s]
 17%|█▋        | 63065/371472 [5:01:09<24:16:32,  3.53it/s]
 17%|█▋        | 63066/371472 [5:01:09<23:46:08,  3.60it/s]
 17%|█▋        | 63067/371472 [5:01:09<22:47:59,  3.76it/s]
 17%|█▋        | 63068/371472 [5:01:09<24:54:04,  3.44it/s]
 17%|█▋        | 63069/371472 [5:01:10<25:38:03,  3.34it/s]
 17%|█▋        | 63070/371472 [5:01:10<24:42:18,  3.47it/s]
 17%|█▋        | 63071/371472 [5:01:10<28:16:53,  3.03it/s]
 17%|█▋        | 63072/371472 [5:01:11<26:00:43,  3.29it/s]
 17%|█▋        | 63073/371472 [5:01:11<24:45:39,  3.46it/s]
 17%|█▋        | 63074/371472 [5:01:11<24:09:30,  3.55it/s]
 17%|█▋        | 63075/371472 [5:01:11<24:47:37,  3.46it/s]
 17%|█▋        | 63076/371472 [5:01:12<24:17:18,  3.53it/s]
 17%|█▋        | 63077/371472 [5:01:12<23:29:20,  3.65it/s]
 17%|█▋        | 63078/371472 [5:01:12<25:23:52,  3.37it/s]
 17%|█▋        | 63079/371472 [5:01:13<24:23:38,  3.51it/s]
 17%|█▋        | 63080/371472 [5:01:13<23:50:01,  3.59it/s]
                                                           
{'loss': 4.1415, 'learning_rate': 8.475726690943567e-07, 'epoch': 2.72}

 17%|█▋        | 63080/371472 [5:01:13<23:50:01,  3.59it/s]
 17%|█▋        | 63081/371472 [5:01:13<24:20:12,  3.52it/s]
 17%|█▋        | 63082/371472 [5:01:14<25:22:52,  3.38it/s]
 17%|█▋        | 63083/371472 [5:01:14<24:21:19,  3.52it/s]
 17%|█▋        | 63084/371472 [5:01:14<24:16:20,  3.53it/s]
 17%|█▋        | 63085/371472 [5:01:14<24:35:00,  3.48it/s]
 17%|█▋        | 63086/371472 [5:01:15<27:03:02,  3.17it/s]
 17%|█▋        | 63087/371472 [5:01:15<25:53:25,  3.31it/s]
 17%|█▋        | 63088/371472 [5:01:15<25:16:12,  3.39it/s]
 17%|█▋        | 63089/371472 [5:01:16<24:47:42,  3.45it/s]
 17%|█▋        | 63090/371472 [5:01:16<24:41:25,  3.47it/s]
 17%|█▋        | 63091/371472 [5:01:16<24:07:00,  3.55it/s]
 17%|█▋        | 63092/371472 [5:01:16<24:45:06,  3.46it/s]
 17%|█▋        | 63093/371472 [5:01:17<25:13:51,  3.40it/s]
 17%|█▋        | 63094/371472 [5:01:17<25:38:50,  3.34it/s]
 17%|█▋        | 63095/371472 [5:01:17<25:53:17,  3.31it/s]
 17%|█▋        | 63096/371472 [5:01:18<24:50:04,  3.45it/s]
 17%|█▋        | 63097/371472 [5:01:18<25:47:08,  3.32it/s]
 17%|█▋        | 63098/371472 [5:01:18<25:56:22,  3.30it/s]
 17%|█▋        | 63099/371472 [5:01:19<26:07:35,  3.28it/s]
 17%|█▋        | 63100/371472 [5:01:19<24:56:28,  3.43it/s]
                                                           
{'loss': 4.1979, 'learning_rate': 8.475241871188778e-07, 'epoch': 2.72}

 17%|█▋        | 63100/371472 [5:01:19<24:56:28,  3.43it/s]
 17%|█▋        | 63101/371472 [5:01:19<24:14:12,  3.53it/s]
 17%|█▋        | 63102/371472 [5:01:19<23:58:22,  3.57it/s]
 17%|█▋        | 63103/371472 [5:01:20<23:38:58,  3.62it/s]
 17%|█▋        | 63104/371472 [5:01:20<23:04:13,  3.71it/s]
 17%|█▋        | 63105/371472 [5:01:20<22:14:52,  3.85it/s]
 17%|█▋        | 63106/371472 [5:01:20<22:14:48,  3.85it/s]
 17%|█▋        | 63107/371472 [5:01:21<22:51:47,  3.75it/s]
 17%|█▋        | 63108/371472 [5:01:21<21:56:53,  3.90it/s]
 17%|█▋        | 63109/371472 [5:01:21<23:08:35,  3.70it/s]
 17%|█▋        | 63110/371472 [5:01:21<23:02:36,  3.72it/s]
 17%|█▋        | 63111/371472 [5:01:22<23:37:23,  3.63it/s]
 17%|█▋        | 63112/371472 [5:01:22<24:06:04,  3.55it/s]
 17%|█▋        | 63113/371472 [5:01:22<23:25:21,  3.66it/s]
 17%|█▋        | 63114/371472 [5:01:23<23:16:16,  3.68it/s]
 17%|█▋        | 63115/371472 [5:01:23<23:34:51,  3.63it/s]
 17%|█▋        | 63116/371472 [5:01:23<24:57:50,  3.43it/s]
 17%|█▋        | 63117/371472 [5:01:23<24:42:15,  3.47it/s]
 17%|█▋        | 63118/371472 [5:01:24<25:42:26,  3.33it/s]
 17%|█▋        | 63119/371472 [5:01:24<26:36:53,  3.22it/s]
 17%|█▋        | 63120/371472 [5:01:24<26:19:51,  3.25it/s]
                                                           
{'loss': 4.2951, 'learning_rate': 8.474757051433988e-07, 'epoch': 2.72}

 17%|█▋        | 63120/371472 [5:01:24<26:19:51,  3.25it/s]
 17%|█▋        | 63121/371472 [5:01:25<24:56:02,  3.44it/s]
 17%|█▋        | 63122/371472 [5:01:25<24:25:48,  3.51it/s]
 17%|█▋        | 63123/371472 [5:01:25<23:54:27,  3.58it/s]
 17%|█▋        | 63124/371472 [5:01:25<23:47:25,  3.60it/s]
 17%|█▋        | 63125/371472 [5:01:26<25:15:01,  3.39it/s]
 17%|█▋        | 63126/371472 [5:01:26<25:55:11,  3.30it/s]
 17%|█▋        | 63127/371472 [5:01:26<25:10:58,  3.40it/s]
 17%|█▋        | 63128/371472 [5:01:27<24:27:37,  3.50it/s]
 17%|█▋        | 63129/371472 [5:01:27<25:34:14,  3.35it/s]
 17%|█▋        | 63130/371472 [5:01:27<26:03:52,  3.29it/s]
 17%|█▋        | 63131/371472 [5:01:28<25:31:44,  3.36it/s]
 17%|█▋        | 63132/371472 [5:01:28<26:18:04,  3.26it/s]
 17%|█▋        | 63133/371472 [5:01:28<27:00:31,  3.17it/s]
 17%|█▋        | 63134/371472 [5:01:29<26:16:49,  3.26it/s]
 17%|█▋        | 63135/371472 [5:01:29<25:14:36,  3.39it/s]
 17%|█▋        | 63136/371472 [5:01:29<24:05:26,  3.56it/s]
 17%|█▋        | 63137/371472 [5:01:29<23:21:29,  3.67it/s]
 17%|█▋        | 63138/371472 [5:01:30<25:06:20,  3.41it/s]
 17%|█▋        | 63139/371472 [5:01:30<24:57:03,  3.43it/s]
 17%|█▋        | 63140/371472 [5:01:30<24:14:52,  3.53it/s]
                                                           
{'loss': 4.0424, 'learning_rate': 8.474272231679199e-07, 'epoch': 2.72}

 17%|█▋        | 63140/371472 [5:01:30<24:14:52,  3.53it/s]
 17%|█▋        | 63141/371472 [5:01:30<24:10:29,  3.54it/s]
 17%|█▋        | 63142/371472 [5:01:31<24:28:59,  3.50it/s]
 17%|█▋        | 63143/371472 [5:01:31<23:48:45,  3.60it/s]
 17%|█▋        | 63144/371472 [5:01:31<23:12:45,  3.69it/s]
 17%|█▋        | 63145/371472 [5:01:32<24:15:17,  3.53it/s]
 17%|█▋        | 63146/371472 [5:01:32<23:59:16,  3.57it/s]
 17%|█▋        | 63147/371472 [5:01:32<23:06:13,  3.71it/s]
 17%|█▋        | 63148/371472 [5:01:32<22:43:37,  3.77it/s]
 17%|█▋        | 63149/371472 [5:01:33<21:52:50,  3.91it/s]
 17%|█▋        | 63150/371472 [5:01:33<22:14:07,  3.85it/s]
 17%|█▋        | 63151/371472 [5:01:33<23:44:08,  3.61it/s]
 17%|█▋        | 63152/371472 [5:01:33<23:11:10,  3.69it/s]
 17%|█▋        | 63153/371472 [5:01:34<23:00:14,  3.72it/s]
 17%|█▋        | 63154/371472 [5:01:34<24:34:01,  3.49it/s]
 17%|█▋        | 63155/371472 [5:01:34<24:08:24,  3.55it/s]
 17%|█▋        | 63156/371472 [5:01:35<24:29:21,  3.50it/s]
 17%|█▋        | 63157/371472 [5:01:35<23:55:10,  3.58it/s]
 17%|█▋        | 63158/371472 [5:01:35<23:09:01,  3.70it/s]
 17%|█▋        | 63159/371472 [5:01:35<23:41:18,  3.62it/s]
 17%|█▋        | 63160/371472 [5:01:36<23:25:59,  3.65it/s]
                                                           
{'loss': 4.2505, 'learning_rate': 8.473787411924411e-07, 'epoch': 2.72}

 17%|█▋        | 63160/371472 [5:01:36<23:25:59,  3.65it/s]
 17%|█▋        | 63161/371472 [5:01:36<22:52:06,  3.74it/s]
 17%|█▋        | 63162/371472 [5:01:36<22:45:02,  3.76it/s]
 17%|█▋        | 63163/371472 [5:01:36<23:26:46,  3.65it/s]
 17%|█▋        | 63164/371472 [5:01:37<25:20:39,  3.38it/s]
 17%|█▋        | 63165/371472 [5:01:37<24:22:10,  3.51it/s]
 17%|█▋        | 63166/371472 [5:01:37<25:30:42,  3.36it/s]
 17%|█▋        | 63167/371472 [5:01:38<25:28:58,  3.36it/s]
 17%|█▋        | 63168/371472 [5:01:38<25:01:30,  3.42it/s]
 17%|█▋        | 63169/371472 [5:01:38<25:09:13,  3.40it/s]
 17%|█▋        | 63170/371472 [5:01:39<24:03:11,  3.56it/s]
 17%|█▋        | 63171/371472 [5:01:39<22:59:32,  3.72it/s]
 17%|█▋        | 63172/371472 [5:01:39<23:11:12,  3.69it/s]
 17%|█▋        | 63173/371472 [5:01:39<23:04:47,  3.71it/s]
 17%|█▋        | 63174/371472 [5:01:40<23:58:00,  3.57it/s]
 17%|█▋        | 63175/371472 [5:01:40<23:51:45,  3.59it/s]
 17%|█▋        | 63176/371472 [5:01:40<22:55:08,  3.74it/s]
 17%|█▋        | 63177/371472 [5:01:40<23:04:32,  3.71it/s]
 17%|█▋        | 63178/371472 [5:01:41<23:38:17,  3.62it/s]
 17%|█▋        | 63179/371472 [5:01:41<25:50:36,  3.31it/s]
 17%|█▋        | 63180/371472 [5:01:41<25:52:17,  3.31it/s]
                                                           
{'loss': 4.4026, 'learning_rate': 8.473302592169622e-07, 'epoch': 2.72}

 17%|█▋        | 63180/371472 [5:01:41<25:52:17,  3.31it/s]
 17%|█▋        | 63181/371472 [5:01:42<25:42:56,  3.33it/s]
 17%|█▋        | 63182/371472 [5:01:42<26:28:24,  3.23it/s]
 17%|█▋        | 63183/371472 [5:01:42<26:56:30,  3.18it/s]
 17%|█▋        | 63184/371472 [5:01:43<26:43:30,  3.20it/s]
 17%|█▋        | 63185/371472 [5:01:43<26:48:03,  3.20it/s]
 17%|█▋        | 63186/371472 [5:01:43<26:04:28,  3.28it/s]
 17%|█▋        | 63187/371472 [5:01:44<25:25:25,  3.37it/s]
 17%|█▋        | 63188/371472 [5:01:44<24:51:54,  3.44it/s]
 17%|█▋        | 63189/371472 [5:01:44<25:32:45,  3.35it/s]
 17%|█▋        | 63190/371472 [5:01:44<25:42:01,  3.33it/s]
 17%|█▋        | 63191/371472 [5:01:45<25:05:09,  3.41it/s]
 17%|█▋        | 63192/371472 [5:01:45<24:37:27,  3.48it/s]
 17%|█▋        | 63193/371472 [5:01:45<24:09:45,  3.54it/s]
 17%|█▋        | 63194/371472 [5:01:46<25:16:14,  3.39it/s]
 17%|█▋        | 63195/371472 [5:01:46<24:36:12,  3.48it/s]
 17%|█▋        | 63196/371472 [5:01:46<23:30:47,  3.64it/s]
 17%|█▋        | 63197/371472 [5:01:46<26:11:13,  3.27it/s]
 17%|█▋        | 63198/371472 [5:01:47<26:12:12,  3.27it/s]
 17%|█▋        | 63199/371472 [5:01:47<25:17:12,  3.39it/s]
 17%|█▋        | 63200/371472 [5:01:47<24:38:07,  3.48it/s]
                                                           
{'loss': 4.0589, 'learning_rate': 8.472817772414833e-07, 'epoch': 2.72}

 17%|█▋        | 63200/371472 [5:01:47<24:38:07,  3.48it/s]
 17%|█▋        | 63201/371472 [5:01:48<24:27:56,  3.50it/s]
 17%|█▋        | 63202/371472 [5:01:48<23:29:16,  3.65it/s]
 17%|█▋        | 63203/371472 [5:01:48<24:19:17,  3.52it/s]
 17%|█▋        | 63204/371472 [5:01:48<24:24:30,  3.51it/s]
 17%|█▋        | 63205/371472 [5:01:49<26:41:47,  3.21it/s]
 17%|█▋        | 63206/371472 [5:01:49<25:01:59,  3.42it/s]
 17%|█▋        | 63207/371472 [5:01:49<25:25:42,  3.37it/s]
 17%|█▋        | 63208/371472 [5:01:50<24:35:10,  3.48it/s]
 17%|█▋        | 63209/371472 [5:01:50<23:24:52,  3.66it/s]
 17%|█▋        | 63210/371472 [5:01:50<23:05:02,  3.71it/s]
 17%|█▋        | 63211/371472 [5:01:50<22:50:46,  3.75it/s]
 17%|█▋        | 63212/371472 [5:01:51<22:40:32,  3.78it/s]
 17%|█▋        | 63213/371472 [5:01:51<22:30:26,  3.80it/s]
 17%|█▋        | 63214/371472 [5:01:51<23:26:11,  3.65it/s]
 17%|█▋        | 63215/371472 [5:01:52<24:32:45,  3.49it/s]
 17%|█▋        | 63216/371472 [5:01:52<25:37:44,  3.34it/s]
 17%|█▋        | 63217/371472 [5:01:52<24:19:28,  3.52it/s]
 17%|█▋        | 63218/371472 [5:01:52<25:09:26,  3.40it/s]
 17%|█▋        | 63219/371472 [5:01:53<24:24:09,  3.51it/s]
 17%|█▋        | 63220/371472 [5:01:53<25:24:39,  3.37it/s]
                                                           
{'loss': 4.1424, 'learning_rate': 8.472332952660044e-07, 'epoch': 2.72}

 17%|█▋        | 63220/371472 [5:01:53<25:24:39,  3.37it/s]
 17%|█▋        | 63221/371472 [5:01:53<25:06:30,  3.41it/s]
 17%|█▋        | 63222/371472 [5:01:54<24:18:46,  3.52it/s]
 17%|█▋        | 63223/371472 [5:01:54<23:44:28,  3.61it/s]
 17%|█▋        | 63224/371472 [5:01:54<23:30:25,  3.64it/s]
 17%|█▋        | 63225/371472 [5:01:54<24:07:15,  3.55it/s]
 17%|█▋        | 63226/371472 [5:01:55<23:14:57,  3.68it/s]
 17%|█▋        | 63227/371472 [5:01:55<23:40:27,  3.62it/s]
 17%|█▋        | 63228/371472 [5:01:55<24:36:09,  3.48it/s]
 17%|█▋        | 63229/371472 [5:01:55<24:19:37,  3.52it/s]
 17%|█▋        | 63230/371472 [5:01:56<24:04:16,  3.56it/s]
 17%|█▋        | 63231/371472 [5:01:56<24:07:13,  3.55it/s]
 17%|█▋        | 63232/371472 [5:01:56<23:14:26,  3.68it/s]
 17%|█▋        | 63233/371472 [5:01:57<22:51:07,  3.75it/s]
 17%|█▋        | 63234/371472 [5:01:57<25:21:48,  3.38it/s]
 17%|█▋        | 63235/371472 [5:01:57<24:42:34,  3.47it/s]
 17%|█▋        | 63236/371472 [5:01:57<24:04:51,  3.56it/s]
 17%|█▋        | 63237/371472 [5:01:58<24:45:56,  3.46it/s]
 17%|█▋        | 63238/371472 [5:01:58<24:44:01,  3.46it/s]
 17%|█▋        | 63239/371472 [5:01:58<25:47:05,  3.32it/s]
 17%|█▋        | 63240/371472 [5:01:59<24:43:16,  3.46it/s]
                                                           
{'loss': 4.256, 'learning_rate': 8.471848132905255e-07, 'epoch': 2.72}

 17%|█▋        | 63240/371472 [5:01:59<24:43:16,  3.46it/s]
 17%|█▋        | 63241/371472 [5:01:59<23:40:48,  3.62it/s]
 17%|█▋        | 63242/371472 [5:01:59<23:54:36,  3.58it/s]
 17%|█▋        | 63243/371472 [5:01:59<23:54:47,  3.58it/s]
 17%|█▋        | 63244/371472 [5:02:00<23:50:20,  3.59it/s]
 17%|█▋        | 63245/371472 [5:02:00<28:12:43,  3.03it/s]
 17%|█▋        | 63246/371472 [5:02:00<25:53:30,  3.31it/s]
 17%|█▋        | 63247/371472 [5:02:01<25:52:18,  3.31it/s]
 17%|█▋        | 63248/371472 [5:02:01<24:55:20,  3.44it/s]
 17%|█▋        | 63249/371472 [5:02:01<24:20:14,  3.52it/s]
 17%|█▋        | 63250/371472 [5:02:02<24:02:18,  3.56it/s]
 17%|█▋        | 63251/371472 [5:02:02<23:22:30,  3.66it/s]
 17%|█▋        | 63252/371472 [5:02:02<22:47:23,  3.76it/s]
 17%|█▋        | 63253/371472 [5:02:02<22:45:16,  3.76it/s]
 17%|█▋        | 63254/371472 [5:02:03<25:01:28,  3.42it/s]
 17%|█▋        | 63255/371472 [5:02:03<24:37:49,  3.48it/s]
 17%|█▋        | 63256/371472 [5:02:03<24:13:15,  3.53it/s]
 17%|█▋        | 63257/371472 [5:02:03<23:14:29,  3.68it/s]
 17%|█▋        | 63258/371472 [5:02:04<24:25:45,  3.50it/s]
 17%|█▋        | 63259/371472 [5:02:04<23:49:39,  3.59it/s]
 17%|█▋        | 63260/371472 [5:02:04<23:49:12,  3.59it/s]
                                                           
{'loss': 4.1204, 'learning_rate': 8.471363313150466e-07, 'epoch': 2.72}

 17%|█▋        | 63260/371472 [5:02:04<23:49:12,  3.59it/s]
 17%|█▋        | 63261/371472 [5:02:05<23:24:51,  3.66it/s]
 17%|█▋        | 63262/371472 [5:02:05<23:27:18,  3.65it/s]
 17%|█▋        | 63263/371472 [5:02:05<23:13:26,  3.69it/s]
 17%|█▋        | 63264/371472 [5:02:05<24:03:32,  3.56it/s]
 17%|█▋        | 63265/371472 [5:02:06<23:32:38,  3.64it/s]
 17%|█▋        | 63266/371472 [5:02:06<22:41:38,  3.77it/s]
 17%|█▋        | 63267/371472 [5:02:06<24:05:34,  3.55it/s]
 17%|█▋        | 63268/371472 [5:02:06<23:22:08,  3.66it/s]
 17%|█▋        | 63269/371472 [5:02:07<23:16:28,  3.68it/s]
 17%|█▋        | 63270/371472 [5:02:07<22:47:11,  3.76it/s]
 17%|█▋        | 63271/371472 [5:02:07<23:43:40,  3.61it/s]
 17%|█▋        | 63272/371472 [5:02:08<23:16:27,  3.68it/s]
 17%|█▋        | 63273/371472 [5:02:08<24:08:37,  3.55it/s]
 17%|█▋        | 63274/371472 [5:02:08<26:34:43,  3.22it/s]
 17%|█▋        | 63275/371472 [5:02:08<24:47:46,  3.45it/s]
 17%|█▋        | 63276/371472 [5:02:09<23:48:54,  3.59it/s]
 17%|█▋        | 63277/371472 [5:02:09<24:45:31,  3.46it/s]
 17%|█▋        | 63278/371472 [5:02:09<23:58:11,  3.57it/s]
 17%|█▋        | 63279/371472 [5:02:10<23:31:43,  3.64it/s]
 17%|█▋        | 63280/371472 [5:02:10<23:48:27,  3.60it/s]
                                                           
{'loss': 4.1596, 'learning_rate': 8.470878493395676e-07, 'epoch': 2.73}

 17%|█▋        | 63280/371472 [5:02:10<23:48:27,  3.60it/s]
 17%|█▋        | 63281/371472 [5:02:10<23:22:00,  3.66it/s]
 17%|█▋        | 63282/371472 [5:02:10<22:48:57,  3.75it/s]
 17%|█▋        | 63283/371472 [5:02:11<23:09:45,  3.70it/s]
 17%|█▋        | 63284/371472 [5:02:11<22:33:22,  3.80it/s]
 17%|█▋        | 63285/371472 [5:02:11<23:19:13,  3.67it/s]
 17%|█▋        | 63286/371472 [5:02:12<26:25:54,  3.24it/s]
 17%|█▋        | 63287/371472 [5:02:12<25:20:36,  3.38it/s]
 17%|█▋        | 63288/371472 [5:02:12<23:59:05,  3.57it/s]
 17%|█▋        | 63289/371472 [5:02:12<23:39:55,  3.62it/s]
 17%|█▋        | 63290/371472 [5:02:13<22:45:14,  3.76it/s]
 17%|█▋        | 63291/371472 [5:02:13<23:35:40,  3.63it/s]
 17%|█▋        | 63292/371472 [5:02:13<24:34:07,  3.48it/s]
 17%|█▋        | 63293/371472 [5:02:13<23:42:22,  3.61it/s]
 17%|█▋        | 63294/371472 [5:02:14<24:32:48,  3.49it/s]
 17%|█▋        | 63295/371472 [5:02:14<24:29:40,  3.49it/s]
 17%|█▋        | 63296/371472 [5:02:14<23:50:36,  3.59it/s]
 17%|█▋        | 63297/371472 [5:02:15<24:41:26,  3.47it/s]
 17%|█▋        | 63298/371472 [5:02:15<23:41:06,  3.61it/s]
 17%|█▋        | 63299/371472 [5:02:15<23:02:15,  3.72it/s]
 17%|█▋        | 63300/371472 [5:02:15<23:05:31,  3.71it/s]
                                                           
{'loss': 4.0859, 'learning_rate': 8.470393673640888e-07, 'epoch': 2.73}

 17%|█▋        | 63300/371472 [5:02:15<23:05:31,  3.71it/s]
 17%|█▋        | 63301/371472 [5:02:16<24:11:13,  3.54it/s]
 17%|█▋        | 63302/371472 [5:02:16<25:58:46,  3.30it/s]
 17%|█▋        | 63303/371472 [5:02:16<24:49:31,  3.45it/s]
 17%|█▋        | 63304/371472 [5:02:17<23:23:01,  3.66it/s]
 17%|█▋        | 63305/371472 [5:02:17<22:27:24,  3.81it/s]
 17%|█▋        | 63306/371472 [5:02:17<22:51:49,  3.74it/s]
 17%|█▋        | 63307/371472 [5:02:17<22:22:38,  3.83it/s]
 17%|█▋        | 63308/371472 [5:02:18<23:40:59,  3.61it/s]
 17%|█▋        | 63309/371472 [5:02:18<23:31:49,  3.64it/s]
 17%|█▋        | 63310/371472 [5:02:18<23:53:40,  3.58it/s]
 17%|█▋        | 63311/371472 [5:02:18<23:13:08,  3.69it/s]
 17%|█▋        | 63312/371472 [5:02:19<22:37:24,  3.78it/s]
 17%|█▋        | 63313/371472 [5:02:19<22:40:50,  3.77it/s]
 17%|█▋        | 63314/371472 [5:02:19<23:23:17,  3.66it/s]
 17%|█▋        | 63315/371472 [5:02:20<23:58:13,  3.57it/s]
 17%|█▋        | 63316/371472 [5:02:20<24:50:42,  3.45it/s]
 17%|█▋        | 63317/371472 [5:02:20<23:56:39,  3.57it/s]
 17%|█▋        | 63318/371472 [5:02:20<24:25:17,  3.51it/s]
 17%|█▋        | 63319/371472 [5:02:21<23:29:48,  3.64it/s]
 17%|█▋        | 63320/371472 [5:02:21<23:37:48,  3.62it/s]
                                                           
{'loss': 4.032, 'learning_rate': 8.4699088538861e-07, 'epoch': 2.73}

 17%|█▋        | 63320/371472 [5:02:21<23:37:48,  3.62it/s]
 17%|█▋        | 63321/371472 [5:02:21<30:01:03,  2.85it/s]
 17%|█▋        | 63322/371472 [5:02:22<27:48:34,  3.08it/s]
 17%|█▋        | 63323/371472 [5:02:22<27:29:29,  3.11it/s]
 17%|█▋        | 63324/371472 [5:02:22<26:56:07,  3.18it/s]
 17%|█▋        | 63325/371472 [5:02:23<27:27:30,  3.12it/s]
 17%|█▋        | 63326/371472 [5:02:23<26:55:56,  3.18it/s]
 17%|█▋        | 63327/371472 [5:02:23<27:38:20,  3.10it/s]
 17%|█▋        | 63328/371472 [5:02:24<26:35:20,  3.22it/s]
 17%|█▋        | 63329/371472 [5:02:24<26:01:43,  3.29it/s]
 17%|█▋        | 63330/371472 [5:02:24<26:19:46,  3.25it/s]
 17%|█▋        | 63331/371472 [5:02:25<25:57:00,  3.30it/s]
 17%|█▋        | 63332/371472 [5:02:25<26:21:03,  3.25it/s]
 17%|█▋        | 63333/371472 [5:02:25<25:06:04,  3.41it/s]
 17%|█▋        | 63334/371472 [5:02:25<24:15:14,  3.53it/s]
 17%|█▋        | 63335/371472 [5:02:26<23:39:14,  3.62it/s]
 17%|█▋        | 63336/371472 [5:02:26<23:47:55,  3.60it/s]
 17%|█▋        | 63337/371472 [5:02:26<23:42:14,  3.61it/s]
 17%|█▋        | 63338/371472 [5:02:26<23:03:07,  3.71it/s]
 17%|█▋        | 63339/371472 [5:02:27<23:23:31,  3.66it/s]
 17%|█▋        | 63340/371472 [5:02:27<24:48:00,  3.45it/s]
                                                           
{'loss': 4.3392, 'learning_rate': 8.469424034131311e-07, 'epoch': 2.73}

 17%|█▋        | 63340/371472 [5:02:27<24:48:00,  3.45it/s]
 17%|█▋        | 63341/371472 [5:02:27<25:07:03,  3.41it/s]
 17%|█▋        | 63342/371472 [5:02:28<27:36:59,  3.10it/s]
 17%|█▋        | 63343/371472 [5:02:28<25:47:38,  3.32it/s]
 17%|█▋        | 63344/371472 [5:02:28<24:57:10,  3.43it/s]
 17%|█▋        | 63345/371472 [5:02:28<23:56:54,  3.57it/s]
 17%|█▋        | 63346/371472 [5:02:29<23:16:24,  3.68it/s]
 17%|█▋        | 63347/371472 [5:02:29<23:13:34,  3.69it/s]
 17%|█▋        | 63348/371472 [5:02:29<24:33:31,  3.49it/s]
 17%|█▋        | 63349/371472 [5:02:30<24:37:53,  3.47it/s]
 17%|█▋        | 63350/371472 [5:02:30<24:18:09,  3.52it/s]
 17%|█▋        | 63351/371472 [5:02:30<25:11:32,  3.40it/s]
 17%|█▋        | 63352/371472 [5:02:30<24:37:10,  3.48it/s]
 17%|█▋        | 63353/371472 [5:02:31<23:39:57,  3.62it/s]
 17%|█▋        | 63354/371472 [5:02:31<22:47:11,  3.76it/s]
 17%|█▋        | 63355/371472 [5:02:31<22:08:05,  3.87it/s]
 17%|█▋        | 63356/371472 [5:02:31<22:21:49,  3.83it/s]
 17%|█▋        | 63357/371472 [5:02:32<23:21:28,  3.66it/s]
 17%|█▋        | 63358/371472 [5:02:32<24:50:10,  3.45it/s]
 17%|█▋        | 63359/371472 [5:02:32<24:09:24,  3.54it/s]
 17%|█▋        | 63360/371472 [5:02:33<26:11:26,  3.27it/s]
                                                           
{'loss': 4.18, 'learning_rate': 8.468939214376521e-07, 'epoch': 2.73}

 17%|█▋        | 63360/371472 [5:02:33<26:11:26,  3.27it/s]
 17%|█▋        | 63361/371472 [5:02:33<25:16:09,  3.39it/s]
 17%|█▋        | 63362/371472 [5:02:33<24:51:54,  3.44it/s]
 17%|█▋        | 63363/371472 [5:02:34<24:23:58,  3.51it/s]
 17%|█▋        | 63364/371472 [5:02:34<23:33:15,  3.63it/s]
 17%|█▋        | 63365/371472 [5:02:34<23:09:06,  3.70it/s]
 17%|█▋        | 63366/371472 [5:02:34<23:55:41,  3.58it/s]
 17%|█▋        | 63367/371472 [5:02:35<23:18:10,  3.67it/s]
 17%|█▋        | 63368/371472 [5:02:35<22:50:53,  3.75it/s]
 17%|█▋        | 63369/371472 [5:02:35<22:48:37,  3.75it/s]
 17%|█▋        | 63370/371472 [5:02:35<22:29:41,  3.80it/s]
 17%|█▋        | 63371/371472 [5:02:36<22:32:26,  3.80it/s]
 17%|█▋        | 63372/371472 [5:02:36<22:33:48,  3.79it/s]
 17%|█▋        | 63373/371472 [5:02:36<24:36:22,  3.48it/s]
 17%|█▋        | 63374/371472 [5:02:37<24:15:16,  3.53it/s]
 17%|█▋        | 63375/371472 [5:02:37<23:44:23,  3.61it/s]
 17%|█▋        | 63376/371472 [5:02:37<23:17:48,  3.67it/s]
 17%|█▋        | 63377/371472 [5:02:37<22:49:01,  3.75it/s]
 17%|█▋        | 63378/371472 [5:02:38<22:25:11,  3.82it/s]
 17%|█▋        | 63379/371472 [5:02:38<23:41:39,  3.61it/s]
 17%|█▋        | 63380/371472 [5:02:38<23:38:40,  3.62it/s]
                                                           
{'loss': 4.2426, 'learning_rate': 8.468454394621732e-07, 'epoch': 2.73}

 17%|█▋        | 63380/371472 [5:02:38<23:38:40,  3.62it/s]
 17%|█▋        | 63381/371472 [5:02:38<23:15:55,  3.68it/s]
 17%|█▋        | 63382/371472 [5:02:39<23:40:27,  3.61it/s]
 17%|█▋        | 63383/371472 [5:02:39<25:41:31,  3.33it/s]
 17%|█▋        | 63384/371472 [5:02:39<25:49:54,  3.31it/s]
 17%|█▋        | 63385/371472 [5:02:40<24:06:22,  3.55it/s]
 17%|█▋        | 63386/371472 [5:02:40<23:17:15,  3.67it/s]
 17%|█▋        | 63387/371472 [5:02:40<22:28:09,  3.81it/s]
 17%|█▋        | 63388/371472 [5:02:40<22:00:53,  3.89it/s]
 17%|█▋        | 63389/371472 [5:02:41<25:10:12,  3.40it/s]
 17%|█▋        | 63390/371472 [5:02:41<24:44:45,  3.46it/s]
 17%|█▋        | 63391/371472 [5:02:41<24:13:59,  3.53it/s]
 17%|█▋        | 63392/371472 [5:02:42<24:23:11,  3.51it/s]
 17%|█▋        | 63393/371472 [5:02:42<24:10:01,  3.54it/s]
 17%|█▋        | 63394/371472 [5:02:42<23:25:14,  3.65it/s]
 17%|█▋        | 63395/371472 [5:02:42<24:02:58,  3.56it/s]
 17%|█▋        | 63396/371472 [5:02:43<25:45:52,  3.32it/s]
 17%|█▋        | 63397/371472 [5:02:43<27:16:16,  3.14it/s]
 17%|█▋        | 63398/371472 [5:02:43<26:40:29,  3.21it/s]
 17%|█▋        | 63399/371472 [5:02:44<25:29:56,  3.36it/s]
 17%|█▋        | 63400/371472 [5:02:44<24:52:39,  3.44it/s]
                                                           
{'loss': 4.1187, 'learning_rate': 8.467969574866943e-07, 'epoch': 2.73}

 17%|█▋        | 63400/371472 [5:02:44<24:52:39,  3.44it/s]
 17%|█▋        | 63401/371472 [5:02:44<23:54:18,  3.58it/s]
 17%|█▋        | 63402/371472 [5:02:44<24:00:20,  3.56it/s]
 17%|█▋        | 63403/371472 [5:02:45<27:00:57,  3.17it/s]
 17%|█▋        | 63404/371472 [5:02:45<25:32:34,  3.35it/s]
 17%|█▋        | 63405/371472 [5:02:45<25:30:20,  3.36it/s]
 17%|█▋        | 63406/371472 [5:02:46<25:24:41,  3.37it/s]
 17%|█▋        | 63407/371472 [5:02:46<24:27:25,  3.50it/s]
 17%|█▋        | 63408/371472 [5:02:46<24:42:42,  3.46it/s]
 17%|█▋        | 63409/371472 [5:02:47<23:26:32,  3.65it/s]
 17%|█▋        | 63410/371472 [5:02:47<23:30:48,  3.64it/s]
 17%|█▋        | 63411/371472 [5:02:47<25:19:47,  3.38it/s]
 17%|█▋        | 63412/371472 [5:02:47<24:32:58,  3.49it/s]
 17%|█▋        | 63413/371472 [5:02:48<25:03:55,  3.41it/s]
 17%|█▋        | 63414/371472 [5:02:48<25:16:16,  3.39it/s]
 17%|█▋        | 63415/371472 [5:02:48<25:31:48,  3.35it/s]
 17%|█▋        | 63416/371472 [5:02:49<24:27:18,  3.50it/s]
 17%|█▋        | 63417/371472 [5:02:49<23:57:33,  3.57it/s]
 17%|█▋        | 63418/371472 [5:02:49<22:54:48,  3.73it/s]
 17%|█▋        | 63419/371472 [5:02:49<25:31:48,  3.35it/s]
 17%|█▋        | 63420/371472 [5:02:50<24:11:04,  3.54it/s]
                                                           
{'loss': 4.1211, 'learning_rate': 8.467484755112155e-07, 'epoch': 2.73}

 17%|█▋        | 63420/371472 [5:02:50<24:11:04,  3.54it/s]
 17%|█▋        | 63421/371472 [5:02:50<23:56:31,  3.57it/s]
 17%|█▋        | 63422/371472 [5:02:50<25:05:14,  3.41it/s]
 17%|█▋        | 63423/371472 [5:02:51<24:59:12,  3.42it/s]
 17%|█▋        | 63424/371472 [5:02:51<24:09:41,  3.54it/s]
 17%|█▋        | 63425/371472 [5:02:51<23:22:31,  3.66it/s]
 17%|█▋        | 63426/371472 [5:02:51<23:14:18,  3.68it/s]
 17%|█▋        | 63427/371472 [5:02:52<23:38:12,  3.62it/s]
 17%|█▋        | 63428/371472 [5:02:52<25:03:34,  3.41it/s]
 17%|█▋        | 63429/371472 [5:02:52<25:05:44,  3.41it/s]
 17%|█▋        | 63430/371472 [5:02:53<24:43:32,  3.46it/s]
 17%|█▋        | 63431/371472 [5:02:53<24:28:52,  3.50it/s]
 17%|█▋        | 63432/371472 [5:02:53<24:17:50,  3.52it/s]
 17%|█▋        | 63433/371472 [5:02:53<23:53:57,  3.58it/s]
 17%|█▋        | 63434/371472 [5:02:54<23:08:08,  3.70it/s]
 17%|█▋        | 63435/371472 [5:02:54<24:54:27,  3.44it/s]
 17%|█▋        | 63436/371472 [5:02:54<23:46:09,  3.60it/s]
 17%|█▋        | 63437/371472 [5:02:55<24:23:39,  3.51it/s]
 17%|█▋        | 63438/371472 [5:02:55<23:25:22,  3.65it/s]
 17%|█▋        | 63439/371472 [5:02:55<23:19:31,  3.67it/s]
 17%|█▋        | 63440/371472 [5:02:55<23:37:40,  3.62it/s]
                                                           
{'loss': 4.1815, 'learning_rate': 8.466999935357365e-07, 'epoch': 2.73}

 17%|█▋        | 63440/371472 [5:02:55<23:37:40,  3.62it/s]
 17%|█▋        | 63441/371472 [5:02:56<23:31:52,  3.64it/s]
 17%|█▋        | 63442/371472 [5:02:56<22:56:16,  3.73it/s]
 17%|█▋        | 63443/371472 [5:02:56<23:28:02,  3.65it/s]
 17%|█▋        | 63444/371472 [5:02:56<24:08:31,  3.54it/s]
 17%|█▋        | 63445/371472 [5:02:57<24:05:57,  3.55it/s]
 17%|█▋        | 63446/371472 [5:02:57<23:41:32,  3.61it/s]
 17%|█▋        | 63447/371472 [5:02:57<23:08:41,  3.70it/s]
 17%|█▋        | 63448/371472 [5:02:58<22:57:39,  3.73it/s]
 17%|█▋        | 63449/371472 [5:02:58<24:23:54,  3.51it/s]
 17%|█▋        | 63450/371472 [5:02:58<23:19:40,  3.67it/s]
 17%|█▋        | 63451/371472 [5:02:58<23:24:16,  3.66it/s]
 17%|█▋        | 63452/371472 [5:02:59<22:30:48,  3.80it/s]
 17%|█▋        | 63453/371472 [5:02:59<23:11:06,  3.69it/s]
 17%|█▋        | 63454/371472 [5:02:59<23:10:45,  3.69it/s]
 17%|█▋        | 63455/371472 [5:02:59<25:07:41,  3.40it/s]
 17%|█▋        | 63456/371472 [5:03:00<24:36:03,  3.48it/s]
 17%|█▋        | 63457/371472 [5:03:00<24:16:36,  3.52it/s]
 17%|█▋        | 63458/371472 [5:03:00<23:52:53,  3.58it/s]
 17%|█▋        | 63459/371472 [5:03:01<23:03:48,  3.71it/s]
 17%|█▋        | 63460/371472 [5:03:01<23:54:35,  3.58it/s]
                                                           
{'loss': 4.1454, 'learning_rate': 8.466515115602577e-07, 'epoch': 2.73}

 17%|█▋        | 63460/371472 [5:03:01<23:54:35,  3.58it/s]
 17%|█▋        | 63461/371472 [5:03:01<25:01:29,  3.42it/s]
 17%|█▋        | 63462/371472 [5:03:01<23:51:42,  3.59it/s]
 17%|█▋        | 63463/371472 [5:03:02<23:23:10,  3.66it/s]
 17%|█▋        | 63464/371472 [5:03:02<26:05:52,  3.28it/s]
 17%|█▋        | 63465/371472 [5:03:02<25:07:19,  3.41it/s]
 17%|█▋        | 63466/371472 [5:03:03<24:03:07,  3.56it/s]
 17%|█▋        | 63467/371472 [5:03:03<25:46:20,  3.32it/s]
 17%|█▋        | 63468/371472 [5:03:03<24:37:52,  3.47it/s]
 17%|█▋        | 63469/371472 [5:03:03<23:40:39,  3.61it/s]
 17%|█▋        | 63470/371472 [5:03:04<23:51:12,  3.59it/s]
 17%|█▋        | 63471/371472 [5:03:04<23:54:37,  3.58it/s]
 17%|█▋        | 63472/371472 [5:03:04<23:29:31,  3.64it/s]
 17%|█▋        | 63473/371472 [5:03:05<23:16:39,  3.68it/s]
 17%|█▋        | 63474/371472 [5:03:05<22:44:59,  3.76it/s]
 17%|█▋        | 63475/371472 [5:03:05<23:53:29,  3.58it/s]
 17%|█▋        | 63476/371472 [5:03:05<23:44:28,  3.60it/s]
 17%|█▋        | 63477/371472 [5:03:06<24:57:51,  3.43it/s]
 17%|█▋        | 63478/371472 [5:03:06<23:43:52,  3.61it/s]
 17%|█▋        | 63479/371472 [5:03:06<24:10:38,  3.54it/s]
 17%|█▋        | 63480/371472 [5:03:07<24:40:23,  3.47it/s]
                                                           
{'loss': 4.381, 'learning_rate': 8.466030295847788e-07, 'epoch': 2.73}

 17%|█▋        | 63480/371472 [5:03:07<24:40:23,  3.47it/s]
 17%|█▋        | 63481/371472 [5:03:07<23:45:40,  3.60it/s]
 17%|█▋        | 63482/371472 [5:03:07<24:56:14,  3.43it/s]
 17%|█▋        | 63483/371472 [5:03:07<24:13:21,  3.53it/s]
 17%|█▋        | 63484/371472 [5:03:08<24:21:13,  3.51it/s]
 17%|█▋        | 63485/371472 [5:03:08<23:46:49,  3.60it/s]
 17%|█▋        | 63486/371472 [5:03:08<24:44:33,  3.46it/s]
 17%|█▋        | 63487/371472 [5:03:09<24:11:22,  3.54it/s]
 17%|█▋        | 63488/371472 [5:03:09<23:53:52,  3.58it/s]
 17%|█▋        | 63489/371472 [5:03:09<23:18:03,  3.67it/s]
 17%|█▋        | 63490/371472 [5:03:09<22:57:18,  3.73it/s]
 17%|█▋        | 63491/371472 [5:03:10<24:59:52,  3.42it/s]
 17%|█▋        | 63492/371472 [5:03:10<23:55:13,  3.58it/s]
 17%|█▋        | 63493/371472 [5:03:10<22:49:21,  3.75it/s]
 17%|█▋        | 63494/371472 [5:03:10<23:12:40,  3.69it/s]
 17%|█▋        | 63495/371472 [5:03:11<22:56:08,  3.73it/s]
 17%|█▋        | 63496/371472 [5:03:11<22:22:31,  3.82it/s]
 17%|█▋        | 63497/371472 [5:03:11<22:26:02,  3.81it/s]
 17%|█▋        | 63498/371472 [5:03:11<22:56:28,  3.73it/s]
 17%|█▋        | 63499/371472 [5:03:12<22:27:42,  3.81it/s]
 17%|█▋        | 63500/371472 [5:03:12<22:57:19,  3.73it/s]
                                                           
{'loss': 4.3725, 'learning_rate': 8.465545476092999e-07, 'epoch': 2.74}

 17%|█▋        | 63500/371472 [5:03:12<22:57:19,  3.73it/s]
 17%|█▋        | 63501/371472 [5:03:12<23:08:11,  3.70it/s]
 17%|█▋        | 63502/371472 [5:03:13<24:04:53,  3.55it/s]
 17%|█▋        | 63503/371472 [5:03:13<25:16:50,  3.38it/s]
 17%|█▋        | 63504/371472 [5:03:13<25:14:57,  3.39it/s]
 17%|█▋        | 63505/371472 [5:03:13<25:01:43,  3.42it/s]
 17%|█▋        | 63506/371472 [5:03:14<23:51:13,  3.59it/s]
 17%|█▋        | 63507/371472 [5:03:14<25:31:35,  3.35it/s]
 17%|█▋        | 63508/371472 [5:03:14<25:54:24,  3.30it/s]
 17%|█▋        | 63509/371472 [5:03:15<25:08:58,  3.40it/s]
 17%|█▋        | 63510/371472 [5:03:15<25:31:24,  3.35it/s]
 17%|█▋        | 63511/371472 [5:03:15<23:45:51,  3.60it/s]
 17%|█▋        | 63512/371472 [5:03:16<24:20:18,  3.51it/s]
 17%|█▋        | 63513/371472 [5:03:16<23:20:41,  3.66it/s]
 17%|█▋        | 63514/371472 [5:03:16<24:17:48,  3.52it/s]
 17%|█▋        | 63515/371472 [5:03:16<23:26:45,  3.65it/s]
 17%|█▋        | 63516/371472 [5:03:17<23:06:45,  3.70it/s]
 17%|█▋        | 63517/371472 [5:03:17<22:35:27,  3.79it/s]
 17%|█▋        | 63518/371472 [5:03:17<24:28:12,  3.50it/s]
 17%|█▋        | 63519/371472 [5:03:17<24:18:43,  3.52it/s]
 17%|█▋        | 63520/371472 [5:03:18<23:21:36,  3.66it/s]
                                                           
{'loss': 4.0545, 'learning_rate': 8.465060656338208e-07, 'epoch': 2.74}

 17%|█▋        | 63520/371472 [5:03:18<23:21:36,  3.66it/s]
 17%|█▋        | 63521/371472 [5:03:18<23:35:53,  3.62it/s]
 17%|█▋        | 63522/371472 [5:03:18<25:33:26,  3.35it/s]
 17%|█▋        | 63523/371472 [5:03:19<26:51:57,  3.18it/s]
 17%|█▋        | 63524/371472 [5:03:19<26:59:22,  3.17it/s]
 17%|█▋        | 63525/371472 [5:03:19<25:50:09,  3.31it/s]
 17%|█▋        | 63526/371472 [5:03:20<26:10:06,  3.27it/s]
 17%|█▋        | 63527/371472 [5:03:20<25:48:41,  3.31it/s]
 17%|█▋        | 63528/371472 [5:03:20<24:21:50,  3.51it/s]
 17%|█▋        | 63529/371472 [5:03:20<23:47:31,  3.60it/s]
 17%|█▋        | 63530/371472 [5:03:21<24:14:06,  3.53it/s]
 17%|█▋        | 63531/371472 [5:03:21<24:00:29,  3.56it/s]
 17%|█▋        | 63532/371472 [5:03:21<23:46:05,  3.60it/s]
 17%|█▋        | 63533/371472 [5:03:21<23:30:25,  3.64it/s]
 17%|█▋        | 63534/371472 [5:03:22<23:10:10,  3.69it/s]
 17%|█▋        | 63535/371472 [5:03:22<23:21:46,  3.66it/s]
 17%|█▋        | 63536/371472 [5:03:22<22:48:25,  3.75it/s]
 17%|█▋        | 63537/371472 [5:03:23<23:54:05,  3.58it/s]
 17%|█▋        | 63538/371472 [5:03:23<23:20:42,  3.66it/s]
 17%|█▋        | 63539/371472 [5:03:23<23:14:44,  3.68it/s]
 17%|█▋        | 63540/371472 [5:03:23<25:04:06,  3.41it/s]
                                                           
{'loss': 4.2509, 'learning_rate': 8.464575836583421e-07, 'epoch': 2.74}

 17%|█▋        | 63540/371472 [5:03:23<25:04:06,  3.41it/s]
 17%|█▋        | 63541/371472 [5:03:24<23:45:06,  3.60it/s]
 17%|█▋        | 63542/371472 [5:03:24<23:46:27,  3.60it/s]
 17%|█▋        | 63543/371472 [5:03:24<23:05:11,  3.71it/s]
 17%|█▋        | 63544/371472 [5:03:24<22:54:21,  3.73it/s]
 17%|█▋        | 63545/371472 [5:03:25<24:27:44,  3.50it/s]
 17%|█▋        | 63546/371472 [5:03:25<23:55:39,  3.57it/s]
 17%|█▋        | 63547/371472 [5:03:25<24:18:54,  3.52it/s]
 17%|█▋        | 63548/371472 [5:03:26<24:40:02,  3.47it/s]
 17%|█▋        | 63549/371472 [5:03:26<25:06:23,  3.41it/s]
 17%|█▋        | 63550/371472 [5:03:26<25:39:19,  3.33it/s]
 17%|█▋        | 63551/371472 [5:03:27<24:58:35,  3.42it/s]
 17%|█▋        | 63552/371472 [5:03:27<24:07:06,  3.55it/s]
 17%|█▋        | 63553/371472 [5:03:27<24:15:36,  3.53it/s]
 17%|█▋        | 63554/371472 [5:03:27<24:04:05,  3.55it/s]
 17%|█▋        | 63555/371472 [5:03:28<24:34:24,  3.48it/s]
 17%|█▋        | 63556/371472 [5:03:28<24:00:11,  3.56it/s]
 17%|█▋        | 63557/371472 [5:03:28<23:45:25,  3.60it/s]
 17%|█▋        | 63558/371472 [5:03:29<25:15:07,  3.39it/s]
 17%|█▋        | 63559/371472 [5:03:29<24:24:48,  3.50it/s]
 17%|█▋        | 63560/371472 [5:03:29<23:31:56,  3.63it/s]
                                                           
{'loss': 4.0918, 'learning_rate': 8.464091016828632e-07, 'epoch': 2.74}

 17%|█▋        | 63560/371472 [5:03:29<23:31:56,  3.63it/s]
 17%|█▋        | 63561/371472 [5:03:29<22:53:22,  3.74it/s]
 17%|█▋        | 63562/371472 [5:03:30<21:52:24,  3.91it/s]
 17%|█▋        | 63563/371472 [5:03:30<23:40:20,  3.61it/s]
 17%|█▋        | 63564/371472 [5:03:30<24:47:56,  3.45it/s]
 17%|█▋        | 63565/371472 [5:03:30<23:23:36,  3.66it/s]
 17%|█▋        | 63566/371472 [5:03:31<24:47:26,  3.45it/s]
 17%|█▋        | 63567/371472 [5:03:31<24:00:49,  3.56it/s]
 17%|█▋        | 63568/371472 [5:03:31<24:21:13,  3.51it/s]
 17%|█▋        | 63569/371472 [5:03:32<25:31:52,  3.35it/s]
 17%|█▋        | 63570/371472 [5:03:32<25:04:40,  3.41it/s]
 17%|█▋        | 63571/371472 [5:03:32<24:21:06,  3.51it/s]
 17%|█▋        | 63572/371472 [5:03:33<26:24:56,  3.24it/s]
 17%|█▋        | 63573/371472 [5:03:33<25:17:12,  3.38it/s]
 17%|█▋        | 63574/371472 [5:03:33<24:12:02,  3.53it/s]
 17%|█▋        | 63575/371472 [5:03:33<24:01:45,  3.56it/s]
 17%|█▋        | 63576/371472 [5:03:34<23:24:47,  3.65it/s]
 17%|█▋        | 63577/371472 [5:03:34<24:59:28,  3.42it/s]
 17%|█▋        | 63578/371472 [5:03:34<25:02:44,  3.41it/s]
 17%|█▋        | 63579/371472 [5:03:34<23:40:45,  3.61it/s]
 17%|█▋        | 63580/371472 [5:03:35<23:39:02,  3.62it/s]
                                                           
{'loss': 4.2106, 'learning_rate': 8.463606197073844e-07, 'epoch': 2.74}

 17%|█▋        | 63580/371472 [5:03:35<23:39:02,  3.62it/s]
 17%|█▋        | 63581/371472 [5:03:35<22:54:53,  3.73it/s]
 17%|█▋        | 63582/371472 [5:03:35<23:49:32,  3.59it/s]
 17%|█▋        | 63583/371472 [5:03:36<23:59:00,  3.57it/s]
 17%|█▋        | 63584/371472 [5:03:36<24:45:38,  3.45it/s]
 17%|█▋        | 63585/371472 [5:03:36<24:35:40,  3.48it/s]
 17%|█▋        | 63586/371472 [5:03:36<24:49:10,  3.45it/s]
 17%|█▋        | 63587/371472 [5:03:37<23:46:26,  3.60it/s]
 17%|█▋        | 63588/371472 [5:03:37<24:34:13,  3.48it/s]
 17%|█▋        | 63589/371472 [5:03:37<24:48:17,  3.45it/s]
 17%|█▋        | 63590/371472 [5:03:38<24:51:45,  3.44it/s]
 17%|█▋        | 63591/371472 [5:03:38<24:17:55,  3.52it/s]
 17%|█▋        | 63592/371472 [5:03:38<23:22:46,  3.66it/s]
 17%|█▋        | 63593/371472 [5:03:38<24:45:23,  3.45it/s]
 17%|█▋        | 63594/371472 [5:03:39<23:51:59,  3.58it/s]
 17%|█▋        | 63595/371472 [5:03:39<23:51:22,  3.58it/s]
 17%|█▋        | 63596/371472 [5:03:39<23:01:54,  3.71it/s]
 17%|█▋        | 63597/371472 [5:03:40<22:42:15,  3.77it/s]
 17%|█▋        | 63598/371472 [5:03:40<22:49:47,  3.75it/s]
 17%|█▋        | 63599/371472 [5:03:40<23:37:12,  3.62it/s]
 17%|█▋        | 63600/371472 [5:03:40<24:46:31,  3.45it/s]
                                                           
{'loss': 4.145, 'learning_rate': 8.463121377319054e-07, 'epoch': 2.74}

 17%|█▋        | 63600/371472 [5:03:40<24:46:31,  3.45it/s]
 17%|█▋        | 63601/371472 [5:03:41<23:59:53,  3.56it/s]
 17%|█▋        | 63602/371472 [5:03:41<23:16:01,  3.68it/s]
 17%|█▋        | 63603/371472 [5:03:41<23:36:37,  3.62it/s]
 17%|█▋        | 63604/371472 [5:03:41<23:49:56,  3.59it/s]
 17%|█▋        | 63605/371472 [5:03:42<23:04:49,  3.71it/s]
 17%|█▋        | 63606/371472 [5:03:42<23:05:08,  3.70it/s]
 17%|█▋        | 63607/371472 [5:03:42<23:15:40,  3.68it/s]
 17%|█▋        | 63608/371472 [5:03:43<22:52:54,  3.74it/s]
 17%|█▋        | 63609/371472 [5:03:43<24:02:04,  3.56it/s]
 17%|█▋        | 63610/371472 [5:03:43<24:16:07,  3.52it/s]
 17%|█▋        | 63611/371472 [5:03:43<23:22:54,  3.66it/s]
 17%|█▋        | 63612/371472 [5:03:44<22:50:53,  3.74it/s]
 17%|█▋        | 63613/371472 [5:03:44<22:59:46,  3.72it/s]
 17%|█▋        | 63614/371472 [5:03:44<22:30:49,  3.80it/s]
 17%|█▋        | 63615/371472 [5:03:44<22:58:58,  3.72it/s]
 17%|█▋        | 63616/371472 [5:03:45<24:33:23,  3.48it/s]
 17%|█▋        | 63617/371472 [5:03:45<24:52:16,  3.44it/s]
 17%|█▋        | 63618/371472 [5:03:45<24:23:39,  3.51it/s]
 17%|█▋        | 63619/371472 [5:03:46<24:05:30,  3.55it/s]
 17%|█▋        | 63620/371472 [5:03:46<23:14:14,  3.68it/s]
                                                           
{'loss': 4.2587, 'learning_rate': 8.462636557564265e-07, 'epoch': 2.74}

 17%|█▋        | 63620/371472 [5:03:46<23:14:14,  3.68it/s]
 17%|█▋        | 63621/371472 [5:03:46<23:45:15,  3.60it/s]
 17%|█▋        | 63622/371472 [5:03:46<24:08:59,  3.54it/s]
 17%|█▋        | 63623/371472 [5:03:47<25:51:03,  3.31it/s]
 17%|█▋        | 63624/371472 [5:03:47<24:43:28,  3.46it/s]
 17%|█▋        | 63625/371472 [5:03:47<24:32:46,  3.48it/s]
 17%|█▋        | 63626/371472 [5:03:48<24:25:33,  3.50it/s]
 17%|█▋        | 63627/371472 [5:03:48<23:22:44,  3.66it/s]
 17%|█▋        | 63628/371472 [5:03:48<23:20:26,  3.66it/s]
 17%|█▋        | 63629/371472 [5:03:48<23:36:13,  3.62it/s]
 17%|█▋        | 63630/371472 [5:03:49<23:00:39,  3.72it/s]
 17%|█▋        | 63631/371472 [5:03:49<22:30:54,  3.80it/s]
 17%|█▋        | 63632/371472 [5:03:49<22:13:11,  3.85it/s]
 17%|█▋        | 63633/371472 [5:03:50<24:15:55,  3.52it/s]
 17%|█▋        | 63634/371472 [5:03:50<23:54:13,  3.58it/s]
 17%|█▋        | 63635/371472 [5:03:50<26:07:38,  3.27it/s]
 17%|█▋        | 63636/371472 [5:03:51<27:13:28,  3.14it/s]
 17%|█▋        | 63637/371472 [5:03:51<25:29:21,  3.35it/s]
 17%|█▋        | 63638/371472 [5:03:51<26:21:18,  3.24it/s]
 17%|█▋        | 63639/371472 [5:03:51<26:00:08,  3.29it/s]
 17%|█▋        | 63640/371472 [5:03:52<24:23:51,  3.50it/s]
                                                           
{'loss': 4.2361, 'learning_rate': 8.462151737809476e-07, 'epoch': 2.74}

 17%|█▋        | 63640/371472 [5:03:52<24:23:51,  3.50it/s]
 17%|█▋        | 63641/371472 [5:03:52<23:28:31,  3.64it/s]
 17%|█▋        | 63642/371472 [5:03:52<22:45:37,  3.76it/s]
 17%|█▋        | 63643/371472 [5:03:52<22:34:02,  3.79it/s]
 17%|█▋        | 63644/371472 [5:03:53<22:24:41,  3.82it/s]
 17%|█▋        | 63645/371472 [5:03:53<22:56:01,  3.73it/s]
 17%|█▋        | 63646/371472 [5:03:53<22:44:09,  3.76it/s]
 17%|█▋        | 63647/371472 [5:03:53<23:30:28,  3.64it/s]
 17%|█▋        | 63648/371472 [5:03:54<23:33:55,  3.63it/s]
 17%|█▋        | 63649/371472 [5:03:54<23:16:22,  3.67it/s]
 17%|█▋        | 63650/371472 [5:03:54<22:48:03,  3.75it/s]
 17%|█▋        | 63651/371472 [5:03:55<24:54:02,  3.43it/s]
 17%|█▋        | 63652/371472 [5:03:55<24:27:17,  3.50it/s]
 17%|█▋        | 63653/371472 [5:03:55<25:38:57,  3.33it/s]
 17%|█▋        | 63654/371472 [5:03:56<25:06:23,  3.41it/s]
 17%|█▋        | 63655/371472 [5:03:56<23:52:56,  3.58it/s]
 17%|█▋        | 63656/371472 [5:03:56<23:25:01,  3.65it/s]
 17%|█▋        | 63657/371472 [5:03:56<24:03:08,  3.55it/s]
 17%|█▋        | 63658/371472 [5:03:57<23:24:22,  3.65it/s]
 17%|█▋        | 63659/371472 [5:03:57<22:42:58,  3.76it/s]
 17%|█▋        | 63660/371472 [5:03:57<22:50:41,  3.74it/s]
                                                           
{'loss': 4.3539, 'learning_rate': 8.461666918054686e-07, 'epoch': 2.74}

 17%|█▋        | 63660/371472 [5:03:57<22:50:41,  3.74it/s]
 17%|█▋        | 63661/371472 [5:03:57<23:56:09,  3.57it/s]
 17%|█▋        | 63662/371472 [5:03:58<23:36:13,  3.62it/s]
 17%|█▋        | 63663/371472 [5:03:58<24:58:55,  3.42it/s]
 17%|█▋        | 63664/371472 [5:03:58<24:35:23,  3.48it/s]
 17%|█▋        | 63665/371472 [5:03:59<23:40:00,  3.61it/s]
 17%|█▋        | 63666/371472 [5:03:59<24:19:42,  3.51it/s]
 17%|█▋        | 63667/371472 [5:03:59<24:51:12,  3.44it/s]
 17%|█▋        | 63668/371472 [5:03:59<24:26:54,  3.50it/s]
 17%|█▋        | 63669/371472 [5:04:00<24:39:59,  3.47it/s]
 17%|█▋        | 63670/371472 [5:04:00<23:44:47,  3.60it/s]
 17%|█▋        | 63671/371472 [5:04:00<25:54:03,  3.30it/s]
 17%|█▋        | 63672/371472 [5:04:01<25:19:52,  3.38it/s]
 17%|█▋        | 63673/371472 [5:04:01<26:50:37,  3.19it/s]
 17%|█▋        | 63674/371472 [5:04:01<26:50:18,  3.19it/s]
 17%|█▋        | 63675/371472 [5:04:02<25:41:22,  3.33it/s]
 17%|█▋        | 63676/371472 [5:04:02<24:31:45,  3.49it/s]
 17%|█▋        | 63677/371472 [5:04:02<23:28:55,  3.64it/s]
 17%|█▋        | 63678/371472 [5:04:02<23:45:38,  3.60it/s]
 17%|█▋        | 63679/371472 [5:04:03<24:10:18,  3.54it/s]
 17%|█▋        | 63680/371472 [5:04:03<23:48:00,  3.59it/s]
                                                           
{'loss': 4.2672, 'learning_rate': 8.461182098299898e-07, 'epoch': 2.74}

 17%|█▋        | 63680/371472 [5:04:03<23:48:00,  3.59it/s]
 17%|█▋        | 63681/371472 [5:04:03<23:38:07,  3.62it/s]
 17%|█▋        | 63682/371472 [5:04:03<23:14:29,  3.68it/s]
 17%|█▋        | 63683/371472 [5:04:04<23:09:21,  3.69it/s]
 17%|█▋        | 63684/371472 [5:04:04<22:27:25,  3.81it/s]
 17%|█▋        | 63685/371472 [5:04:04<23:50:55,  3.58it/s]
 17%|█▋        | 63686/371472 [5:04:05<23:44:04,  3.60it/s]
 17%|█▋        | 63687/371472 [5:04:05<24:27:57,  3.49it/s]
 17%|█▋        | 63688/371472 [5:04:05<26:42:45,  3.20it/s]
 17%|█▋        | 63689/371472 [5:04:05<24:45:39,  3.45it/s]
 17%|█▋        | 63690/371472 [5:04:06<23:33:38,  3.63it/s]
 17%|█▋        | 63691/371472 [5:04:06<23:21:42,  3.66it/s]
 17%|█▋        | 63692/371472 [5:04:06<23:00:21,  3.72it/s]
 17%|█▋        | 63693/371472 [5:04:06<22:45:52,  3.76it/s]
 17%|█▋        | 63694/371472 [5:04:07<23:38:15,  3.62it/s]
 17%|█▋        | 63695/371472 [5:04:07<23:22:35,  3.66it/s]
 17%|█▋        | 63696/371472 [5:04:07<24:33:40,  3.48it/s]
 17%|█▋        | 63697/371472 [5:04:08<23:59:35,  3.56it/s]
 17%|█▋        | 63698/371472 [5:04:08<23:01:44,  3.71it/s]
 17%|█▋        | 63699/371472 [5:04:08<22:47:25,  3.75it/s]
 17%|█▋        | 63700/371472 [5:04:08<23:51:37,  3.58it/s]
                                                           
{'loss': 4.306, 'learning_rate': 8.46069727854511e-07, 'epoch': 2.74}

 17%|█▋        | 63700/371472 [5:04:08<23:51:37,  3.58it/s]
 17%|█▋        | 63701/371472 [5:04:09<23:08:30,  3.69it/s]
 17%|█▋        | 63702/371472 [5:04:09<23:37:56,  3.62it/s]
 17%|█▋        | 63703/371472 [5:04:09<23:09:37,  3.69it/s]
 17%|█▋        | 63704/371472 [5:04:09<22:55:01,  3.73it/s]
 17%|█▋        | 63705/371472 [5:04:10<23:55:21,  3.57it/s]
 17%|█▋        | 63706/371472 [5:04:10<23:45:56,  3.60it/s]
 17%|█▋        | 63707/371472 [5:04:10<23:30:34,  3.64it/s]
 17%|█▋        | 63708/371472 [5:04:11<22:52:51,  3.74it/s]
 17%|█▋        | 63709/371472 [5:04:11<23:46:00,  3.60it/s]
 17%|█▋        | 63710/371472 [5:04:11<23:32:43,  3.63it/s]
 17%|█▋        | 63711/371472 [5:04:11<22:54:08,  3.73it/s]
 17%|█▋        | 63712/371472 [5:04:12<22:18:43,  3.83it/s]
 17%|█▋        | 63713/371472 [5:04:12<23:07:43,  3.70it/s]
 17%|█▋        | 63714/371472 [5:04:12<22:47:04,  3.75it/s]
 17%|█▋        | 63715/371472 [5:04:13<24:03:11,  3.55it/s]
 17%|█▋        | 63716/371472 [5:04:13<22:48:12,  3.75it/s]
 17%|█▋        | 63717/371472 [5:04:13<22:14:58,  3.84it/s]
 17%|█▋        | 63718/371472 [5:04:13<22:03:31,  3.88it/s]
 17%|█▋        | 63719/371472 [5:04:14<22:42:37,  3.76it/s]
 17%|█▋        | 63720/371472 [5:04:14<22:16:13,  3.84it/s]
                                                           
{'loss': 4.2876, 'learning_rate': 8.460212458790321e-07, 'epoch': 2.74}

 17%|█▋        | 63720/371472 [5:04:14<22:16:13,  3.84it/s]
 17%|█▋        | 63721/371472 [5:04:14<22:58:25,  3.72it/s]
 17%|█▋        | 63722/371472 [5:04:14<23:20:46,  3.66it/s]
 17%|█▋        | 63723/371472 [5:04:15<24:12:05,  3.53it/s]
 17%|█▋        | 63724/371472 [5:04:15<23:36:13,  3.62it/s]
 17%|█▋        | 63725/371472 [5:04:15<24:52:59,  3.44it/s]
 17%|█▋        | 63726/371472 [5:04:15<23:31:23,  3.63it/s]
 17%|█▋        | 63727/371472 [5:04:16<25:26:10,  3.36it/s]
 17%|█▋        | 63728/371472 [5:04:16<25:31:27,  3.35it/s]
 17%|█▋        | 63729/371472 [5:04:16<24:18:51,  3.52it/s]
 17%|█▋        | 63730/371472 [5:04:17<23:25:46,  3.65it/s]
 17%|█▋        | 63731/371472 [5:04:17<23:53:19,  3.58it/s]
 17%|█▋        | 63732/371472 [5:04:17<24:22:21,  3.51it/s]
 17%|█▋        | 63733/371472 [5:04:18<24:49:59,  3.44it/s]
 17%|█▋        | 63734/371472 [5:04:18<24:58:17,  3.42it/s]
 17%|█▋        | 63735/371472 [5:04:18<24:32:01,  3.48it/s]
 17%|█▋        | 63736/371472 [5:04:18<24:10:38,  3.54it/s]
 17%|█▋        | 63737/371472 [5:04:19<25:25:13,  3.36it/s]
 17%|█▋        | 63738/371472 [5:04:19<24:22:37,  3.51it/s]
 17%|█▋        | 63739/371472 [5:04:19<25:12:04,  3.39it/s]
 17%|█▋        | 63740/371472 [5:04:20<24:24:46,  3.50it/s]
                                                           
{'loss': 4.1529, 'learning_rate': 8.459727639035531e-07, 'epoch': 2.75}

 17%|█▋        | 63740/371472 [5:04:20<24:24:46,  3.50it/s]
 17%|█▋        | 63741/371472 [5:04:20<26:04:14,  3.28it/s]
 17%|█▋        | 63742/371472 [5:04:20<25:16:14,  3.38it/s]
 17%|█▋        | 63743/371472 [5:04:20<24:36:08,  3.47it/s]
 17%|█▋        | 63744/371472 [5:04:21<24:44:52,  3.45it/s]
 17%|█▋        | 63745/371472 [5:04:21<23:50:43,  3.58it/s]
 17%|█▋        | 63746/371472 [5:04:21<25:02:08,  3.41it/s]
 17%|█▋        | 63747/371472 [5:04:22<25:52:12,  3.30it/s]
 17%|█▋        | 63748/371472 [5:04:22<26:12:19,  3.26it/s]
 17%|█▋        | 63749/371472 [5:04:22<26:16:15,  3.25it/s]
 17%|█▋        | 63750/371472 [5:04:23<24:33:32,  3.48it/s]
 17%|█▋        | 63751/371472 [5:04:23<24:44:30,  3.45it/s]
 17%|█▋        | 63752/371472 [5:04:23<23:44:42,  3.60it/s]
 17%|█▋        | 63753/371472 [5:04:23<23:18:29,  3.67it/s]
 17%|█▋        | 63754/371472 [5:04:24<23:22:43,  3.66it/s]
 17%|█▋        | 63755/371472 [5:04:24<22:52:44,  3.74it/s]
 17%|█▋        | 63756/371472 [5:04:24<22:18:34,  3.83it/s]
 17%|█▋        | 63757/371472 [5:04:24<21:48:15,  3.92it/s]
 17%|█▋        | 63758/371472 [5:04:25<21:43:47,  3.93it/s]
 17%|█▋        | 63759/371472 [5:04:25<22:07:27,  3.86it/s]
 17%|█▋        | 63760/371472 [5:04:25<22:22:59,  3.82it/s]
                                                           
{'loss': 4.1421, 'learning_rate': 8.459242819280742e-07, 'epoch': 2.75}

 17%|█▋        | 63760/371472 [5:04:25<22:22:59,  3.82it/s]
 17%|█▋        | 63761/371472 [5:04:25<24:01:21,  3.56it/s]
 17%|█▋        | 63762/371472 [5:04:26<24:56:39,  3.43it/s]
 17%|█▋        | 63763/371472 [5:04:26<24:30:41,  3.49it/s]
 17%|█▋        | 63764/371472 [5:04:26<23:23:32,  3.65it/s]
 17%|█▋        | 63765/371472 [5:04:27<22:21:05,  3.82it/s]
 17%|█▋        | 63766/371472 [5:04:27<23:13:49,  3.68it/s]
 17%|█▋        | 63767/371472 [5:04:27<22:57:17,  3.72it/s]
 17%|█▋        | 63768/371472 [5:04:27<23:50:31,  3.58it/s]
 17%|█▋        | 63769/371472 [5:04:28<23:37:58,  3.62it/s]
 17%|█▋        | 63770/371472 [5:04:28<22:38:21,  3.78it/s]
 17%|█▋        | 63771/371472 [5:04:28<24:00:41,  3.56it/s]
 17%|█▋        | 63772/371472 [5:04:29<24:45:16,  3.45it/s]
 17%|█▋        | 63773/371472 [5:04:29<24:26:44,  3.50it/s]
 17%|█▋        | 63774/371472 [5:04:29<24:54:12,  3.43it/s]
 17%|█▋        | 63775/371472 [5:04:29<23:34:14,  3.63it/s]
 17%|█▋        | 63776/371472 [5:04:30<23:18:07,  3.67it/s]
 17%|█▋        | 63777/371472 [5:04:30<24:34:54,  3.48it/s]
 17%|█▋        | 63778/371472 [5:04:30<23:51:56,  3.58it/s]
 17%|█▋        | 63779/371472 [5:04:30<24:15:12,  3.52it/s]
 17%|█▋        | 63780/371472 [5:04:31<25:29:28,  3.35it/s]
                                                           
{'loss': 4.208, 'learning_rate': 8.458757999525954e-07, 'epoch': 2.75}

 17%|█▋        | 63780/371472 [5:04:31<25:29:28,  3.35it/s]
 17%|█▋        | 63781/371472 [5:04:31<24:34:14,  3.48it/s]
 17%|█▋        | 63782/371472 [5:04:31<23:56:02,  3.57it/s]
 17%|█▋        | 63783/371472 [5:04:32<23:16:03,  3.67it/s]
 17%|█▋        | 63784/371472 [5:04:32<22:19:12,  3.83it/s]
 17%|█▋        | 63785/371472 [5:04:32<21:46:24,  3.93it/s]
 17%|█▋        | 63786/371472 [5:04:32<24:19:40,  3.51it/s]
 17%|█▋        | 63787/371472 [5:04:33<25:14:20,  3.39it/s]
 17%|█▋        | 63788/371472 [5:04:33<24:09:11,  3.54it/s]
 17%|█▋        | 63789/371472 [5:04:33<25:37:32,  3.34it/s]
 17%|█▋        | 63790/371472 [5:04:34<24:36:25,  3.47it/s]
 17%|█▋        | 63791/371472 [5:04:34<24:06:18,  3.55it/s]
 17%|█▋        | 63792/371472 [5:04:34<24:31:14,  3.49it/s]
 17%|█▋        | 63793/371472 [5:04:34<23:23:17,  3.65it/s]
 17%|█▋        | 63794/371472 [5:04:35<22:57:55,  3.72it/s]
 17%|█▋        | 63795/371472 [5:04:35<25:08:05,  3.40it/s]
 17%|█▋        | 63796/371472 [5:04:35<24:13:28,  3.53it/s]
 17%|█▋        | 63797/371472 [5:04:36<23:25:00,  3.65it/s]
 17%|█▋        | 63798/371472 [5:04:36<23:37:56,  3.62it/s]
 17%|█▋        | 63799/371472 [5:04:36<23:53:22,  3.58it/s]
 17%|█▋        | 63800/371472 [5:04:36<24:27:07,  3.50it/s]
                                                           
{'loss': 4.2952, 'learning_rate': 8.458273179771165e-07, 'epoch': 2.75}

 17%|█▋        | 63800/371472 [5:04:36<24:27:07,  3.50it/s]
 17%|█▋        | 63801/371472 [5:04:37<23:54:13,  3.58it/s]
 17%|█▋        | 63802/371472 [5:04:37<23:14:23,  3.68it/s]
 17%|█▋        | 63803/371472 [5:04:37<22:06:37,  3.87it/s]
 17%|█▋        | 63804/371472 [5:04:37<21:53:13,  3.90it/s]
 17%|█▋        | 63805/371472 [5:04:38<24:43:31,  3.46it/s]
 17%|█▋        | 63806/371472 [5:04:38<25:27:26,  3.36it/s]
 17%|█▋        | 63807/371472 [5:04:38<26:20:34,  3.24it/s]
 17%|█▋        | 63808/371472 [5:04:39<28:04:57,  3.04it/s]
 17%|█▋        | 63809/371472 [5:04:39<26:33:51,  3.22it/s]
 17%|█▋        | 63810/371472 [5:04:39<26:09:44,  3.27it/s]
 17%|█▋        | 63811/371472 [5:04:40<24:35:52,  3.47it/s]
 17%|█▋        | 63812/371472 [5:04:40<24:28:48,  3.49it/s]
 17%|█▋        | 63813/371472 [5:04:40<24:58:04,  3.42it/s]
 17%|█▋        | 63814/371472 [5:04:40<24:45:59,  3.45it/s]
 17%|█▋        | 63815/371472 [5:04:41<26:02:26,  3.28it/s]
 17%|█▋        | 63816/371472 [5:04:41<26:10:56,  3.26it/s]
 17%|█▋        | 63817/371472 [5:04:41<25:05:53,  3.41it/s]
 17%|█▋        | 63818/371472 [5:04:42<26:00:55,  3.28it/s]
 17%|█▋        | 63819/371472 [5:04:42<24:17:38,  3.52it/s]
 17%|█▋        | 63820/371472 [5:04:42<24:19:20,  3.51it/s]
                                                           
{'loss': 4.0587, 'learning_rate': 8.457788360016375e-07, 'epoch': 2.75}

 17%|█▋        | 63820/371472 [5:04:42<24:19:20,  3.51it/s]
 17%|█▋        | 63821/371472 [5:04:42<23:49:22,  3.59it/s]
 17%|█▋        | 63822/371472 [5:04:43<23:09:58,  3.69it/s]
 17%|█▋        | 63823/371472 [5:04:43<25:42:39,  3.32it/s]
 17%|█▋        | 63824/371472 [5:04:43<24:49:28,  3.44it/s]
 17%|█▋        | 63825/371472 [5:04:44<24:40:55,  3.46it/s]
 17%|█▋        | 63826/371472 [5:04:44<23:50:23,  3.58it/s]
 17%|█▋        | 63827/371472 [5:04:44<25:54:20,  3.30it/s]
 17%|█▋        | 63828/371472 [5:04:45<26:06:29,  3.27it/s]
 17%|█▋        | 63829/371472 [5:04:45<24:41:08,  3.46it/s]
 17%|█▋        | 63830/371472 [5:04:45<24:59:50,  3.42it/s]
 17%|█▋        | 63831/371472 [5:04:45<25:03:36,  3.41it/s]
 17%|█▋        | 63832/371472 [5:04:46<24:35:23,  3.48it/s]
 17%|█▋        | 63833/371472 [5:04:46<24:19:18,  3.51it/s]
 17%|█▋        | 63834/371472 [5:04:46<23:51:02,  3.58it/s]
 17%|█▋        | 63835/371472 [5:04:47<24:23:09,  3.50it/s]
 17%|█▋        | 63836/371472 [5:04:47<24:02:06,  3.56it/s]
 17%|█▋        | 63837/371472 [5:04:47<23:04:46,  3.70it/s]
 17%|█▋        | 63838/371472 [5:04:47<22:37:21,  3.78it/s]
 17%|█▋        | 63839/371472 [5:04:48<22:09:09,  3.86it/s]
 17%|█▋        | 63840/371472 [5:04:48<22:14:49,  3.84it/s]
                                                           
{'loss': 4.1058, 'learning_rate': 8.457303540261587e-07, 'epoch': 2.75}

 17%|█▋        | 63840/371472 [5:04:48<22:14:49,  3.84it/s]
 17%|█▋        | 63841/371472 [5:04:48<21:38:46,  3.95it/s]
 17%|█▋        | 63842/371472 [5:04:48<22:38:33,  3.77it/s]
 17%|█▋        | 63843/371472 [5:04:49<22:50:55,  3.74it/s]
 17%|█▋        | 63844/371472 [5:04:49<22:17:31,  3.83it/s]
 17%|█▋        | 63845/371472 [5:04:49<22:53:14,  3.73it/s]
 17%|█▋        | 63846/371472 [5:04:49<23:37:40,  3.62it/s]
 17%|█▋        | 63847/371472 [5:04:50<24:03:12,  3.55it/s]
 17%|█▋        | 63848/371472 [5:04:50<25:49:21,  3.31it/s]
 17%|█▋        | 63849/371472 [5:04:50<24:56:47,  3.43it/s]
 17%|█▋        | 63850/371472 [5:04:51<24:16:51,  3.52it/s]
 17%|█▋        | 63851/371472 [5:04:51<24:13:26,  3.53it/s]
 17%|█▋        | 63852/371472 [5:04:51<23:55:18,  3.57it/s]
 17%|█▋        | 63853/371472 [5:04:52<28:21:54,  3.01it/s]
 17%|█▋        | 63854/371472 [5:04:52<26:20:59,  3.24it/s]
 17%|█▋        | 63855/371472 [5:04:52<25:17:44,  3.38it/s]
 17%|█▋        | 63856/371472 [5:04:52<24:31:50,  3.48it/s]
 17%|█▋        | 63857/371472 [5:04:53<25:28:47,  3.35it/s]
 17%|█▋        | 63858/371472 [5:04:53<24:20:48,  3.51it/s]
 17%|█▋        | 63859/371472 [5:04:53<23:49:43,  3.59it/s]
 17%|█▋        | 63860/371472 [5:04:54<25:30:28,  3.35it/s]
                                                           
{'loss': 4.1121, 'learning_rate': 8.456818720506799e-07, 'epoch': 2.75}

 17%|█▋        | 63860/371472 [5:04:54<25:30:28,  3.35it/s]
 17%|█▋        | 63861/371472 [5:04:54<24:20:17,  3.51it/s]
 17%|█▋        | 63862/371472 [5:04:54<23:55:48,  3.57it/s]
 17%|█▋        | 63863/371472 [5:04:54<23:31:22,  3.63it/s]
 17%|█▋        | 63864/371472 [5:04:55<24:36:35,  3.47it/s]
 17%|█▋        | 63865/371472 [5:04:55<26:21:03,  3.24it/s]
 17%|█▋        | 63866/371472 [5:04:55<28:08:09,  3.04it/s]
 17%|█▋        | 63867/371472 [5:04:56<29:01:32,  2.94it/s]
 17%|█▋        | 63868/371472 [5:04:56<26:55:41,  3.17it/s]
 17%|█▋        | 63869/371472 [5:04:56<26:57:45,  3.17it/s]
 17%|█▋        | 63870/371472 [5:04:57<25:18:38,  3.38it/s]
 17%|█▋        | 63871/371472 [5:04:57<24:54:25,  3.43it/s]
 17%|█▋        | 63872/371472 [5:04:57<24:38:11,  3.47it/s]
 17%|█▋        | 63873/371472 [5:04:57<23:44:06,  3.60it/s]
 17%|█▋        | 63874/371472 [5:04:58<24:05:02,  3.55it/s]
 17%|█▋        | 63875/371472 [5:04:58<24:06:27,  3.54it/s]
 17%|█▋        | 63876/371472 [5:04:58<25:10:56,  3.39it/s]
 17%|█▋        | 63877/371472 [5:04:59<23:44:38,  3.60it/s]
 17%|█▋        | 63878/371472 [5:04:59<24:01:47,  3.56it/s]
 17%|█▋        | 63879/371472 [5:04:59<24:13:10,  3.53it/s]
 17%|█▋        | 63880/371472 [5:04:59<24:23:08,  3.50it/s]
                                                           
{'loss': 4.0427, 'learning_rate': 8.456333900752009e-07, 'epoch': 2.75}

 17%|█▋        | 63880/371472 [5:04:59<24:23:08,  3.50it/s]
 17%|█▋        | 63881/371472 [5:05:00<23:22:25,  3.66it/s]
 17%|█▋        | 63882/371472 [5:05:00<24:00:40,  3.56it/s]
 17%|█▋        | 63883/371472 [5:05:00<24:55:21,  3.43it/s]
 17%|█▋        | 63884/371472 [5:05:01<24:39:38,  3.46it/s]
 17%|█▋        | 63885/371472 [5:05:01<26:26:44,  3.23it/s]
 17%|█▋        | 63886/371472 [5:05:01<26:34:03,  3.22it/s]
 17%|█▋        | 63887/371472 [5:05:02<26:22:07,  3.24it/s]
 17%|█▋        | 63888/371472 [5:05:02<25:07:10,  3.40it/s]
 17%|█▋        | 63889/371472 [5:05:02<24:19:30,  3.51it/s]
 17%|█▋        | 63890/371472 [5:05:02<23:53:20,  3.58it/s]
 17%|█▋        | 63891/371472 [5:05:03<25:06:04,  3.40it/s]
 17%|█▋        | 63892/371472 [5:05:03<28:22:35,  3.01it/s]
 17%|█▋        | 63893/371472 [5:05:03<26:32:10,  3.22it/s]
 17%|█▋        | 63894/371472 [5:05:04<25:10:03,  3.39it/s]
 17%|█▋        | 63895/371472 [5:05:04<24:58:17,  3.42it/s]
 17%|█▋        | 63896/371472 [5:05:04<23:59:44,  3.56it/s]
 17%|█▋        | 63897/371472 [5:05:04<23:56:15,  3.57it/s]
 17%|█▋        | 63898/371472 [5:05:05<24:58:26,  3.42it/s]
 17%|█▋        | 63899/371472 [5:05:05<24:39:13,  3.47it/s]
 17%|█▋        | 63900/371472 [5:05:05<26:51:04,  3.18it/s]
                                                           
{'loss': 3.9421, 'learning_rate': 8.455849080997219e-07, 'epoch': 2.75}

 17%|█▋        | 63900/371472 [5:05:05<26:51:04,  3.18it/s]
 17%|█▋        | 63901/371472 [5:05:06<25:37:33,  3.33it/s]
 17%|█▋        | 63902/371472 [5:05:06<27:00:28,  3.16it/s]
 17%|█▋        | 63903/371472 [5:05:06<24:52:55,  3.43it/s]
 17%|█▋        | 63904/371472 [5:05:07<24:01:06,  3.56it/s]
 17%|█▋        | 63905/371472 [5:05:07<25:10:28,  3.39it/s]
 17%|█▋        | 63906/371472 [5:05:07<24:20:15,  3.51it/s]
 17%|█▋        | 63907/371472 [5:05:07<23:40:44,  3.61it/s]
 17%|█▋        | 63908/371472 [5:05:08<23:22:33,  3.65it/s]
 17%|█▋        | 63909/371472 [5:05:08<24:35:35,  3.47it/s]
 17%|█▋        | 63910/371472 [5:05:08<24:33:11,  3.48it/s]
 17%|█▋        | 63911/371472 [5:05:09<23:44:06,  3.60it/s]
 17%|█▋        | 63912/371472 [5:05:09<23:41:43,  3.61it/s]
 17%|█▋        | 63913/371472 [5:05:09<23:22:24,  3.66it/s]
 17%|█▋        | 63914/371472 [5:05:09<23:30:37,  3.63it/s]
 17%|█▋        | 63915/371472 [5:05:10<23:24:57,  3.65it/s]
 17%|█▋        | 63916/371472 [5:05:10<23:53:17,  3.58it/s]
 17%|█▋        | 63917/371472 [5:05:10<23:59:43,  3.56it/s]
 17%|█▋        | 63918/371472 [5:05:10<22:46:59,  3.75it/s]
 17%|█▋        | 63919/371472 [5:05:11<22:25:08,  3.81it/s]
 17%|█▋        | 63920/371472 [5:05:11<22:15:48,  3.84it/s]
                                                           
{'loss': 4.2178, 'learning_rate': 8.455364261242431e-07, 'epoch': 2.75}

 17%|█▋        | 63920/371472 [5:05:11<22:15:48,  3.84it/s]
 17%|█▋        | 63921/371472 [5:05:11<21:54:00,  3.90it/s]
 17%|█▋        | 63922/371472 [5:05:11<23:24:00,  3.65it/s]
 17%|█▋        | 63923/371472 [5:05:12<22:51:53,  3.74it/s]
 17%|█▋        | 63924/371472 [5:05:12<22:34:17,  3.78it/s]
 17%|█▋        | 63925/371472 [5:05:12<23:22:51,  3.65it/s]
 17%|█▋        | 63926/371472 [5:05:13<22:41:03,  3.77it/s]
 17%|█▋        | 63927/371472 [5:05:13<22:50:36,  3.74it/s]
 17%|█▋        | 63928/371472 [5:05:13<23:31:12,  3.63it/s]
 17%|█▋        | 63929/371472 [5:05:13<23:59:10,  3.56it/s]
 17%|█▋        | 63930/371472 [5:05:14<22:48:35,  3.75it/s]
 17%|█▋        | 63931/371472 [5:05:14<22:00:14,  3.88it/s]
 17%|█▋        | 63932/371472 [5:05:14<21:42:04,  3.94it/s]
 17%|█▋        | 63933/371472 [5:05:14<23:37:22,  3.62it/s]
 17%|█▋        | 63934/371472 [5:05:15<24:13:58,  3.53it/s]
 17%|█▋        | 63935/371472 [5:05:15<23:57:17,  3.57it/s]
 17%|█▋        | 63936/371472 [5:05:15<23:37:19,  3.62it/s]
 17%|█▋        | 63937/371472 [5:05:16<23:38:45,  3.61it/s]
 17%|█▋        | 63938/371472 [5:05:16<23:35:39,  3.62it/s]
 17%|█▋        | 63939/371472 [5:05:16<24:49:06,  3.44it/s]
 17%|█▋        | 63940/371472 [5:05:16<24:50:41,  3.44it/s]
                                                           
{'loss': 4.3995, 'learning_rate': 8.454879441487641e-07, 'epoch': 2.75}

 17%|█▋        | 63940/371472 [5:05:16<24:50:41,  3.44it/s]
 17%|█▋        | 63941/371472 [5:05:17<25:00:32,  3.42it/s]
 17%|█▋        | 63942/371472 [5:05:17<24:14:49,  3.52it/s]
 17%|█▋        | 63943/371472 [5:05:17<24:30:47,  3.48it/s]
 17%|█▋        | 63944/371472 [5:05:18<23:54:55,  3.57it/s]
 17%|█▋        | 63945/371472 [5:05:18<23:50:12,  3.58it/s]
 17%|█▋        | 63946/371472 [5:05:18<23:36:28,  3.62it/s]
 17%|█▋        | 63947/371472 [5:05:18<23:53:31,  3.58it/s]
 17%|█▋        | 63948/371472 [5:05:19<26:19:10,  3.25it/s]
 17%|█▋        | 63949/371472 [5:05:19<24:46:10,  3.45it/s]
 17%|█▋        | 63950/371472 [5:05:19<25:14:25,  3.38it/s]
 17%|█▋        | 63951/371472 [5:05:20<24:50:48,  3.44it/s]
 17%|█▋        | 63952/371472 [5:05:20<23:43:33,  3.60it/s]
 17%|█▋        | 63953/371472 [5:05:20<23:20:56,  3.66it/s]
 17%|█▋        | 63954/371472 [5:05:20<23:32:21,  3.63it/s]
 17%|█▋        | 63955/371472 [5:05:21<22:36:35,  3.78it/s]
 17%|█▋        | 63956/371472 [5:05:21<22:15:01,  3.84it/s]
 17%|█▋        | 63957/371472 [5:05:21<22:36:57,  3.78it/s]
 17%|█▋        | 63958/371472 [5:05:21<22:08:04,  3.86it/s]
 17%|█▋        | 63959/371472 [5:05:22<24:54:12,  3.43it/s]
 17%|█▋        | 63960/371472 [5:05:22<24:49:14,  3.44it/s]
                                                           
{'loss': 3.9356, 'learning_rate': 8.454394621732854e-07, 'epoch': 2.75}

 17%|█▋        | 63960/371472 [5:05:22<24:49:14,  3.44it/s]
 17%|█▋        | 63961/371472 [5:05:22<24:41:15,  3.46it/s]
 17%|█▋        | 63962/371472 [5:05:23<24:55:09,  3.43it/s]
 17%|█▋        | 63963/371472 [5:05:23<24:27:04,  3.49it/s]
 17%|█▋        | 63964/371472 [5:05:23<23:30:00,  3.63it/s]
 17%|█▋        | 63965/371472 [5:05:23<23:07:47,  3.69it/s]
 17%|█▋        | 63966/371472 [5:05:24<22:34:11,  3.78it/s]
 17%|█▋        | 63967/371472 [5:05:24<21:57:02,  3.89it/s]
 17%|█▋        | 63968/371472 [5:05:24<22:59:01,  3.72it/s]
 17%|█▋        | 63969/371472 [5:05:25<24:24:11,  3.50it/s]
 17%|█▋        | 63970/371472 [5:05:25<23:29:24,  3.64it/s]
 17%|█▋        | 63971/371472 [5:05:25<23:31:06,  3.63it/s]
 17%|█▋        | 63972/371472 [5:05:25<22:48:13,  3.75it/s]
 17%|█▋        | 63973/371472 [5:05:26<24:07:39,  3.54it/s]
 17%|█▋        | 63974/371472 [5:05:26<22:52:59,  3.73it/s]
 17%|█▋        | 63975/371472 [5:05:26<23:06:35,  3.70it/s]
 17%|█▋        | 63976/371472 [5:05:26<22:47:17,  3.75it/s]
 17%|█▋        | 63977/371472 [5:05:27<23:11:08,  3.68it/s]
 17%|█▋        | 63978/371472 [5:05:27<22:57:15,  3.72it/s]
 17%|█▋        | 63979/371472 [5:05:27<23:36:34,  3.62it/s]
 17%|█▋        | 63980/371472 [5:05:28<22:59:51,  3.71it/s]
                                                           
{'loss': 4.1646, 'learning_rate': 8.453909801978064e-07, 'epoch': 2.76}

 17%|█▋        | 63980/371472 [5:05:28<22:59:51,  3.71it/s]
 17%|█▋        | 63981/371472 [5:05:28<23:06:19,  3.70it/s]
 17%|█▋        | 63982/371472 [5:05:28<22:59:37,  3.71it/s]
 17%|█▋        | 63983/371472 [5:05:28<24:55:41,  3.43it/s]
 17%|█▋        | 63984/371472 [5:05:29<24:29:22,  3.49it/s]
 17%|█▋        | 63985/371472 [5:05:29<24:56:16,  3.43it/s]
 17%|█▋        | 63986/371472 [5:05:29<24:30:01,  3.49it/s]
 17%|█▋        | 63987/371472 [5:05:30<24:08:27,  3.54it/s]
 17%|█▋        | 63988/371472 [5:05:30<23:35:50,  3.62it/s]
 17%|█▋        | 63989/371472 [5:05:30<23:25:19,  3.65it/s]
 17%|█▋        | 63990/371472 [5:05:30<23:40:06,  3.61it/s]
 17%|█▋        | 63991/371472 [5:05:31<23:16:56,  3.67it/s]
 17%|█▋        | 63992/371472 [5:05:31<22:49:31,  3.74it/s]
 17%|█▋        | 63993/371472 [5:05:31<23:15:31,  3.67it/s]
 17%|█▋        | 63994/371472 [5:05:31<23:14:01,  3.68it/s]
 17%|█▋        | 63995/371472 [5:05:32<23:59:27,  3.56it/s]
 17%|█▋        | 63996/371472 [5:05:32<23:40:54,  3.61it/s]
 17%|█▋        | 63997/371472 [5:05:32<22:52:50,  3.73it/s]
 17%|█▋        | 63998/371472 [5:05:33<23:13:21,  3.68it/s]
 17%|█▋        | 63999/371472 [5:05:33<22:51:50,  3.74it/s]
 17%|█▋        | 64000/371472 [5:05:33<24:33:32,  3.48it/s]
                                                           
{'loss': 3.9561, 'learning_rate': 8.453424982223276e-07, 'epoch': 2.76}

 17%|█▋        | 64000/371472 [5:05:33<24:33:32,  3.48it/s]
 17%|█▋        | 64001/371472 [5:05:33<23:51:01,  3.58it/s]
 17%|█▋        | 64002/371472 [5:05:34<23:24:18,  3.65it/s]
 17%|█▋        | 64003/371472 [5:05:34<24:00:50,  3.56it/s]
 17%|█▋        | 64004/371472 [5:05:34<23:53:14,  3.58it/s]
 17%|█▋        | 64005/371472 [5:05:34<24:31:43,  3.48it/s]
 17%|█▋        | 64006/371472 [5:05:35<24:18:17,  3.51it/s]
 17%|█▋        | 64007/371472 [5:05:35<27:33:32,  3.10it/s]
 17%|█▋        | 64008/371472 [5:05:35<25:43:55,  3.32it/s]
 17%|█▋        | 64009/371472 [5:05:36<25:16:48,  3.38it/s]
 17%|█▋        | 64010/371472 [5:05:36<25:05:11,  3.40it/s]
 17%|█▋        | 64011/371472 [5:05:36<24:09:42,  3.53it/s]
 17%|█▋        | 64012/371472 [5:05:37<25:13:42,  3.39it/s]
 17%|█▋        | 64013/371472 [5:05:37<23:36:22,  3.62it/s]
 17%|█▋        | 64014/371472 [5:05:37<23:11:35,  3.68it/s]
 17%|█▋        | 64015/371472 [5:05:37<22:41:58,  3.76it/s]
 17%|█▋        | 64016/371472 [5:05:38<22:44:27,  3.76it/s]
 17%|█▋        | 64017/371472 [5:05:38<22:51:21,  3.74it/s]
 17%|█▋        | 64018/371472 [5:05:38<22:31:39,  3.79it/s]
 17%|█▋        | 64019/371472 [5:05:38<23:51:45,  3.58it/s]
 17%|█▋        | 64020/371472 [5:05:39<24:16:15,  3.52it/s]
                                                           
{'loss': 4.2556, 'learning_rate': 8.452940162468486e-07, 'epoch': 2.76}

 17%|█▋        | 64020/371472 [5:05:39<24:16:15,  3.52it/s]
 17%|█▋        | 64021/371472 [5:05:39<24:44:15,  3.45it/s]
 17%|█▋        | 64022/371472 [5:05:39<23:26:11,  3.64it/s]
 17%|█▋        | 64023/371472 [5:05:40<25:40:21,  3.33it/s]
 17%|█▋        | 64024/371472 [5:05:40<24:31:13,  3.48it/s]
 17%|█▋        | 64025/371472 [5:05:40<23:40:48,  3.61it/s]
 17%|█▋        | 64026/371472 [5:05:40<22:47:08,  3.75it/s]
 17%|█▋        | 64027/371472 [5:05:41<23:03:16,  3.70it/s]
 17%|█▋        | 64028/371472 [5:05:41<23:49:33,  3.58it/s]
 17%|█▋        | 64029/371472 [5:05:41<24:13:14,  3.53it/s]
 17%|█▋        | 64030/371472 [5:05:42<24:04:55,  3.55it/s]
 17%|█▋        | 64031/371472 [5:05:42<23:11:39,  3.68it/s]
 17%|█▋        | 64032/371472 [5:05:42<24:18:24,  3.51it/s]
 17%|█▋        | 64033/371472 [5:05:42<24:21:35,  3.51it/s]
 17%|█▋        | 64034/371472 [5:05:43<23:59:20,  3.56it/s]
 17%|█▋        | 64035/371472 [5:05:43<24:49:09,  3.44it/s]
 17%|█▋        | 64036/371472 [5:05:43<24:19:26,  3.51it/s]
 17%|█▋        | 64037/371472 [5:05:44<28:10:29,  3.03it/s]
 17%|█▋        | 64038/371472 [5:05:44<26:54:47,  3.17it/s]
 17%|█▋        | 64039/371472 [5:05:44<25:44:20,  3.32it/s]
 17%|█▋        | 64040/371472 [5:05:44<24:03:02,  3.55it/s]
                                                           
{'loss': 4.1118, 'learning_rate': 8.452455342713698e-07, 'epoch': 2.76}

 17%|█▋        | 64040/371472 [5:05:44<24:03:02,  3.55it/s]
 17%|█▋        | 64041/371472 [5:05:45<25:09:04,  3.40it/s]
 17%|█▋        | 64042/371472 [5:05:45<24:46:40,  3.45it/s]
 17%|█▋        | 64043/371472 [5:05:45<25:01:40,  3.41it/s]
 17%|█▋        | 64044/371472 [5:05:46<24:04:35,  3.55it/s]
 17%|█▋        | 64045/371472 [5:05:46<27:21:04,  3.12it/s]
 17%|█▋        | 64046/371472 [5:05:46<26:45:56,  3.19it/s]
 17%|█▋        | 64047/371472 [5:05:47<27:41:57,  3.08it/s]
 17%|█▋        | 64048/371472 [5:05:47<27:21:05,  3.12it/s]
 17%|█▋        | 64049/371472 [5:05:47<25:22:55,  3.36it/s]
 17%|█▋        | 64050/371472 [5:05:47<24:13:42,  3.52it/s]
 17%|█▋        | 64051/371472 [5:05:48<23:16:58,  3.67it/s]
 17%|█▋        | 64052/371472 [5:05:48<22:15:06,  3.84it/s]
 17%|█▋        | 64053/371472 [5:05:48<25:07:32,  3.40it/s]
 17%|█▋        | 64054/371472 [5:05:49<25:05:37,  3.40it/s]
 17%|█▋        | 64055/371472 [5:05:49<24:40:23,  3.46it/s]
 17%|█▋        | 64056/371472 [5:05:49<24:05:14,  3.55it/s]
 17%|█▋        | 64057/371472 [5:05:49<23:48:57,  3.59it/s]
 17%|█▋        | 64058/371472 [5:05:50<23:08:00,  3.69it/s]
 17%|█▋        | 64059/371472 [5:05:50<22:37:41,  3.77it/s]
 17%|█▋        | 64060/371472 [5:05:50<22:48:49,  3.74it/s]
                                                           
{'loss': 4.0717, 'learning_rate': 8.451970522958908e-07, 'epoch': 2.76}

 17%|█▋        | 64060/371472 [5:05:50<22:48:49,  3.74it/s]
 17%|█▋        | 64061/371472 [5:05:51<23:27:10,  3.64it/s]
 17%|█▋        | 64062/371472 [5:05:51<23:23:54,  3.65it/s]
 17%|█▋        | 64063/371472 [5:05:51<23:50:17,  3.58it/s]
 17%|█▋        | 64064/371472 [5:05:51<23:09:34,  3.69it/s]
 17%|█▋        | 64065/371472 [5:05:52<24:29:09,  3.49it/s]
 17%|█▋        | 64066/371472 [5:05:52<24:04:59,  3.55it/s]
 17%|█▋        | 64067/371472 [5:05:52<26:01:04,  3.28it/s]
 17%|█▋        | 64068/371472 [5:05:53<24:55:36,  3.43it/s]
 17%|█▋        | 64069/371472 [5:05:53<23:45:26,  3.59it/s]
 17%|█▋        | 64070/371472 [5:05:53<22:51:13,  3.74it/s]
 17%|█▋        | 64071/371472 [5:05:53<23:25:40,  3.64it/s]
 17%|█▋        | 64072/371472 [5:05:54<25:11:27,  3.39it/s]
 17%|█▋        | 64073/371472 [5:05:54<25:02:00,  3.41it/s]
 17%|█▋        | 64074/371472 [5:05:54<24:01:08,  3.56it/s]
 17%|█▋        | 64075/371472 [5:05:54<23:35:59,  3.62it/s]
 17%|█▋        | 64076/371472 [5:05:55<23:08:40,  3.69it/s]
 17%|█▋        | 64077/371472 [5:05:55<22:14:20,  3.84it/s]
 17%|█▋        | 64078/371472 [5:05:55<24:09:03,  3.54it/s]
 17%|█▋        | 64079/371472 [5:05:56<23:27:39,  3.64it/s]
 17%|█▋        | 64080/371472 [5:05:56<23:38:34,  3.61it/s]
                                                           
{'loss': 4.2172, 'learning_rate': 8.45148570320412e-07, 'epoch': 2.76}

 17%|█▋        | 64080/371472 [5:05:56<23:38:34,  3.61it/s]
 17%|█▋        | 64081/371472 [5:05:56<24:29:26,  3.49it/s]
 17%|█▋        | 64082/371472 [5:05:56<23:57:17,  3.56it/s]
 17%|█▋        | 64083/371472 [5:05:57<24:34:33,  3.47it/s]
 17%|█▋        | 64084/371472 [5:05:57<23:20:28,  3.66it/s]
 17%|█▋        | 64085/371472 [5:05:57<23:03:31,  3.70it/s]
 17%|█▋        | 64086/371472 [5:05:58<23:36:33,  3.62it/s]
 17%|█▋        | 64087/371472 [5:05:58<23:19:34,  3.66it/s]
 17%|█▋        | 64088/371472 [5:05:58<23:21:19,  3.66it/s]
 17%|█▋        | 64089/371472 [5:05:58<24:47:47,  3.44it/s]
 17%|█▋        | 64090/371472 [5:05:59<23:54:53,  3.57it/s]
 17%|█▋        | 64091/371472 [5:05:59<23:43:00,  3.60it/s]
 17%|█▋        | 64092/371472 [5:05:59<23:25:10,  3.65it/s]
 17%|█▋        | 64093/371472 [5:05:59<22:46:34,  3.75it/s]
 17%|█▋        | 64094/371472 [5:06:00<22:08:40,  3.86it/s]
 17%|█▋        | 64095/371472 [5:06:00<22:04:55,  3.87it/s]
 17%|█▋        | 64096/371472 [5:06:00<21:50:56,  3.91it/s]
 17%|█▋        | 64097/371472 [5:06:00<22:22:18,  3.82it/s]
 17%|█▋        | 64098/371472 [5:06:01<22:39:02,  3.77it/s]
 17%|█▋        | 64099/371472 [5:06:01<23:03:33,  3.70it/s]
 17%|█▋        | 64100/371472 [5:06:01<23:26:55,  3.64it/s]
                                                           
{'loss': 4.1552, 'learning_rate': 8.451000883449331e-07, 'epoch': 2.76}

 17%|█▋        | 64100/371472 [5:06:01<23:26:55,  3.64it/s]
 17%|█▋        | 64101/371472 [5:06:02<23:22:34,  3.65it/s]
 17%|█▋        | 64102/371472 [5:06:02<23:26:20,  3.64it/s]
 17%|█▋        | 64103/371472 [5:06:02<26:00:37,  3.28it/s]
 17%|█▋        | 64104/371472 [5:06:02<25:10:36,  3.39it/s]
 17%|█▋        | 64105/371472 [5:06:03<25:08:51,  3.40it/s]
 17%|█▋        | 64106/371472 [5:06:03<24:26:25,  3.49it/s]
 17%|█▋        | 64107/371472 [5:06:03<24:00:52,  3.56it/s]
 17%|█▋        | 64108/371472 [5:06:04<23:46:06,  3.59it/s]
 17%|█▋        | 64109/371472 [5:06:04<23:13:04,  3.68it/s]
 17%|█▋        | 64110/371472 [5:06:04<23:18:24,  3.66it/s]
 17%|█▋        | 64111/371472 [5:06:04<23:32:44,  3.63it/s]
 17%|█▋        | 64112/371472 [5:06:05<23:10:51,  3.68it/s]
 17%|█▋        | 64113/371472 [5:06:05<23:09:12,  3.69it/s]
 17%|█▋        | 64114/371472 [5:06:05<24:25:03,  3.50it/s]
 17%|█▋        | 64115/371472 [5:06:06<26:01:51,  3.28it/s]
 17%|█▋        | 64116/371472 [5:06:06<26:17:30,  3.25it/s]
 17%|█▋        | 64117/371472 [5:06:06<26:59:51,  3.16it/s]
 17%|█▋        | 64118/371472 [5:06:07<26:30:47,  3.22it/s]
 17%|█▋        | 64119/371472 [5:06:07<26:57:28,  3.17it/s]
 17%|█▋        | 64120/371472 [5:06:07<25:19:03,  3.37it/s]
                                                           
{'loss': 4.2209, 'learning_rate': 8.450516063694542e-07, 'epoch': 2.76}

 17%|█▋        | 64120/371472 [5:06:07<25:19:03,  3.37it/s]
 17%|█▋        | 64121/371472 [5:06:07<25:00:49,  3.41it/s]
 17%|█▋        | 64122/371472 [5:06:08<23:33:16,  3.62it/s]
 17%|█▋        | 64123/371472 [5:06:08<23:49:38,  3.58it/s]
 17%|█▋        | 64124/371472 [5:06:08<23:19:41,  3.66it/s]
 17%|█▋        | 64125/371472 [5:06:08<23:20:20,  3.66it/s]
 17%|█▋        | 64126/371472 [5:06:09<23:19:34,  3.66it/s]
 17%|█▋        | 64127/371472 [5:06:09<24:37:16,  3.47it/s]
 17%|█▋        | 64128/371472 [5:06:09<23:48:09,  3.59it/s]
 17%|█▋        | 64129/371472 [5:06:10<24:32:02,  3.48it/s]
 17%|█▋        | 64130/371472 [5:06:10<24:44:06,  3.45it/s]
 17%|█▋        | 64131/371472 [5:06:10<25:51:57,  3.30it/s]
 17%|█▋        | 64132/371472 [5:06:11<25:31:44,  3.34it/s]
 17%|█▋        | 64133/371472 [5:06:11<25:20:50,  3.37it/s]
 17%|█▋        | 64134/371472 [5:06:11<25:50:20,  3.30it/s]
 17%|█▋        | 64135/371472 [5:06:11<24:39:31,  3.46it/s]
 17%|█▋        | 64136/371472 [5:06:12<23:56:15,  3.57it/s]
 17%|█▋        | 64137/371472 [5:06:12<24:08:52,  3.54it/s]
 17%|█▋        | 64138/371472 [5:06:12<26:46:46,  3.19it/s]
 17%|█▋        | 64139/371472 [5:06:13<25:25:31,  3.36it/s]
 17%|█▋        | 64140/371472 [5:06:13<25:46:47,  3.31it/s]
                                                           
{'loss': 4.1111, 'learning_rate': 8.450031243939752e-07, 'epoch': 2.76}

 17%|█▋        | 64140/371472 [5:06:13<25:46:47,  3.31it/s]
 17%|█▋        | 64141/371472 [5:06:13<26:09:08,  3.26it/s]
 17%|█▋        | 64142/371472 [5:06:14<24:52:53,  3.43it/s]
 17%|█▋        | 64143/371472 [5:06:14<24:52:38,  3.43it/s]
 17%|█▋        | 64144/371472 [5:06:14<24:25:26,  3.50it/s]
 17%|█▋        | 64145/371472 [5:06:14<25:30:43,  3.35it/s]
 17%|█▋        | 64146/371472 [5:06:15<25:51:54,  3.30it/s]
 17%|█▋        | 64147/371472 [5:06:15<26:54:33,  3.17it/s]
 17%|█▋        | 64148/371472 [5:06:15<25:21:47,  3.37it/s]
 17%|█▋        | 64149/371472 [5:06:16<25:08:44,  3.39it/s]
 17%|█▋        | 64150/371472 [5:06:16<24:31:45,  3.48it/s]
 17%|█▋        | 64151/371472 [5:06:16<24:43:30,  3.45it/s]
 17%|█▋        | 64152/371472 [5:06:16<24:32:05,  3.48it/s]
 17%|█▋        | 64153/371472 [5:06:17<24:23:49,  3.50it/s]
 17%|█▋        | 64154/371472 [5:06:17<23:14:17,  3.67it/s]
 17%|█▋        | 64155/371472 [5:06:17<27:49:07,  3.07it/s]
 17%|█▋        | 64156/371472 [5:06:18<26:09:37,  3.26it/s]
 17%|█▋        | 64157/371472 [5:06:18<25:18:08,  3.37it/s]
 17%|█▋        | 64158/371472 [5:06:18<24:00:46,  3.55it/s]
 17%|█▋        | 64159/371472 [5:06:18<23:32:11,  3.63it/s]
 17%|█▋        | 64160/371472 [5:06:19<23:00:36,  3.71it/s]
                                                           
{'loss': 4.0866, 'learning_rate': 8.449546424184964e-07, 'epoch': 2.76}

 17%|█▋        | 64160/371472 [5:06:19<23:00:36,  3.71it/s]
 17%|█▋        | 64161/371472 [5:06:19<23:40:31,  3.61it/s]
 17%|█▋        | 64162/371472 [5:06:19<23:27:49,  3.64it/s]
 17%|█▋        | 64163/371472 [5:06:20<23:38:09,  3.61it/s]
 17%|█▋        | 64164/371472 [5:06:20<23:49:23,  3.58it/s]
 17%|█▋        | 64165/371472 [5:06:20<23:27:26,  3.64it/s]
 17%|█▋        | 64166/371472 [5:06:20<24:06:30,  3.54it/s]
 17%|█▋        | 64167/371472 [5:06:21<23:33:02,  3.62it/s]
 17%|█▋        | 64168/371472 [5:06:21<24:19:41,  3.51it/s]
 17%|█▋        | 64169/371472 [5:06:21<23:50:44,  3.58it/s]
 17%|█▋        | 64170/371472 [5:06:21<23:00:30,  3.71it/s]
 17%|█▋        | 64171/371472 [5:06:22<23:54:00,  3.57it/s]
 17%|█▋        | 64172/371472 [5:06:22<22:59:45,  3.71it/s]
 17%|█▋        | 64173/371472 [5:06:22<25:00:37,  3.41it/s]
 17%|█▋        | 64174/371472 [5:06:23<24:50:11,  3.44it/s]
 17%|█▋        | 64175/371472 [5:06:23<23:50:54,  3.58it/s]
 17%|█▋        | 64176/371472 [5:06:23<23:00:17,  3.71it/s]
 17%|█▋        | 64177/371472 [5:06:23<22:23:48,  3.81it/s]
 17%|█▋        | 64178/371472 [5:06:24<23:25:36,  3.64it/s]
 17%|█▋        | 64179/371472 [5:06:24<22:41:26,  3.76it/s]
 17%|█▋        | 64180/371472 [5:06:24<21:58:25,  3.88it/s]
                                                           
{'loss': 4.1659, 'learning_rate': 8.449061604430175e-07, 'epoch': 2.76}

 17%|█▋        | 64180/371472 [5:06:24<21:58:25,  3.88it/s]
 17%|█▋        | 64181/371472 [5:06:24<22:02:02,  3.87it/s]
 17%|█▋        | 64182/371472 [5:06:25<22:43:31,  3.76it/s]
 17%|█▋        | 64183/371472 [5:06:25<22:01:39,  3.88it/s]
 17%|█▋        | 64184/371472 [5:06:25<21:39:29,  3.94it/s]
 17%|█▋        | 64185/371472 [5:06:25<21:45:09,  3.92it/s]
 17%|█▋        | 64186/371472 [5:06:26<21:46:03,  3.92it/s]
 17%|█▋        | 64187/371472 [5:06:26<21:36:05,  3.95it/s]
 17%|█▋        | 64188/371472 [5:06:26<22:34:21,  3.78it/s]
 17%|█▋        | 64189/371472 [5:06:27<23:32:27,  3.63it/s]
 17%|█▋        | 64190/371472 [5:06:27<24:19:36,  3.51it/s]
 17%|█▋        | 64191/371472 [5:06:27<27:13:40,  3.13it/s]
 17%|█▋        | 64192/371472 [5:06:28<28:18:32,  3.02it/s]
 17%|█▋        | 64193/371472 [5:06:28<28:12:27,  3.03it/s]
 17%|█▋        | 64194/371472 [5:06:28<28:48:51,  2.96it/s]
 17%|█▋        | 64195/371472 [5:06:29<28:37:07,  2.98it/s]
 17%|█▋        | 64196/371472 [5:06:29<27:49:01,  3.07it/s]
 17%|█▋        | 64197/371472 [5:06:29<26:15:34,  3.25it/s]
 17%|█▋        | 64198/371472 [5:06:30<25:14:20,  3.38it/s]
 17%|█▋        | 64199/371472 [5:06:30<24:40:09,  3.46it/s]
 17%|█▋        | 64200/371472 [5:06:30<24:21:05,  3.51it/s]
                                                           
{'loss': 4.3124, 'learning_rate': 8.448576784675385e-07, 'epoch': 2.77}

 17%|█▋        | 64200/371472 [5:06:30<24:21:05,  3.51it/s]
 17%|█▋        | 64201/371472 [5:06:30<23:34:32,  3.62it/s]
 17%|█▋        | 64202/371472 [5:06:31<23:02:47,  3.70it/s]
 17%|█▋        | 64203/371472 [5:06:31<23:19:08,  3.66it/s]
 17%|█▋        | 64204/371472 [5:06:31<23:35:00,  3.62it/s]
 17%|█▋        | 64205/371472 [5:06:31<23:39:57,  3.61it/s]
 17%|█▋        | 64206/371472 [5:06:32<23:27:50,  3.64it/s]
 17%|█▋        | 64207/371472 [5:06:32<23:46:16,  3.59it/s]
 17%|█▋        | 64208/371472 [5:06:32<24:06:54,  3.54it/s]
 17%|█▋        | 64209/371472 [5:06:33<24:24:42,  3.50it/s]
 17%|█▋        | 64210/371472 [5:06:33<23:58:17,  3.56it/s]
 17%|█▋        | 64211/371472 [5:06:33<23:12:05,  3.68it/s]
 17%|█▋        | 64212/371472 [5:06:33<22:53:32,  3.73it/s]
 17%|█▋        | 64213/371472 [5:06:34<23:23:49,  3.65it/s]
 17%|█▋        | 64214/371472 [5:06:34<24:06:11,  3.54it/s]
 17%|█▋        | 64215/371472 [5:06:34<23:14:43,  3.67it/s]
 17%|█▋        | 64216/371472 [5:06:34<22:52:59,  3.73it/s]
 17%|█▋        | 64217/371472 [5:06:35<23:21:29,  3.65it/s]
 17%|█▋        | 64218/371472 [5:06:35<23:25:36,  3.64it/s]
 17%|█▋        | 64219/371472 [5:06:35<24:15:13,  3.52it/s]
 17%|█▋        | 64220/371472 [5:06:36<23:38:01,  3.61it/s]
                                                           
{'loss': 4.1531, 'learning_rate': 8.448091964920597e-07, 'epoch': 2.77}

 17%|█▋        | 64220/371472 [5:06:36<23:38:01,  3.61it/s]
 17%|█▋        | 64221/371472 [5:06:36<23:29:12,  3.63it/s]
 17%|█▋        | 64222/371472 [5:06:36<22:44:02,  3.75it/s]
 17%|█▋        | 64223/371472 [5:06:36<22:37:31,  3.77it/s]
 17%|█▋        | 64224/371472 [5:06:37<22:27:14,  3.80it/s]
 17%|█▋        | 64225/371472 [5:06:37<22:51:14,  3.73it/s]
 17%|█▋        | 64226/371472 [5:06:37<23:25:45,  3.64it/s]
 17%|█▋        | 64227/371472 [5:06:37<23:19:14,  3.66it/s]
 17%|█▋        | 64228/371472 [5:06:38<23:25:26,  3.64it/s]
 17%|█▋        | 64229/371472 [5:06:38<23:24:46,  3.65it/s]
 17%|█▋        | 64230/371472 [5:06:38<23:58:46,  3.56it/s]
 17%|█▋        | 64231/371472 [5:06:39<25:23:08,  3.36it/s]
 17%|█▋        | 64232/371472 [5:06:39<26:48:58,  3.18it/s]
 17%|█▋        | 64233/371472 [5:06:39<25:57:11,  3.29it/s]
 17%|█▋        | 64234/371472 [5:06:40<24:35:57,  3.47it/s]
 17%|█▋        | 64235/371472 [5:06:40<23:36:28,  3.62it/s]
 17%|█▋        | 64236/371472 [5:06:40<23:25:13,  3.64it/s]
 17%|█▋        | 64237/371472 [5:06:40<25:09:55,  3.39it/s]
 17%|█▋        | 64238/371472 [5:06:41<26:26:18,  3.23it/s]
 17%|█▋        | 64239/371472 [5:06:41<24:42:34,  3.45it/s]
 17%|█▋        | 64240/371472 [5:06:41<23:42:04,  3.60it/s]
                                                           
{'loss': 4.2296, 'learning_rate': 8.447607145165809e-07, 'epoch': 2.77}

 17%|█▋        | 64240/371472 [5:06:41<23:42:04,  3.60it/s]
 17%|█▋        | 64241/371472 [5:06:41<23:51:28,  3.58it/s]
 17%|█▋        | 64242/371472 [5:06:42<24:05:22,  3.54it/s]
 17%|█▋        | 64243/371472 [5:06:42<24:24:46,  3.50it/s]
 17%|█▋        | 64244/371472 [5:06:42<25:46:34,  3.31it/s]
 17%|█▋        | 64245/371472 [5:06:43<26:48:21,  3.18it/s]
 17%|█▋        | 64246/371472 [5:06:43<25:31:58,  3.34it/s]
 17%|█▋        | 64247/371472 [5:06:43<25:29:54,  3.35it/s]
 17%|█▋        | 64248/371472 [5:06:44<24:44:06,  3.45it/s]
 17%|█▋        | 64249/371472 [5:06:44<24:13:11,  3.52it/s]
 17%|█▋        | 64250/371472 [5:06:44<23:25:47,  3.64it/s]
 17%|█▋        | 64251/371472 [5:06:44<23:03:20,  3.70it/s]
 17%|█▋        | 64252/371472 [5:06:45<24:36:52,  3.47it/s]
 17%|█▋        | 64253/371472 [5:06:45<23:35:41,  3.62it/s]
 17%|█▋        | 64254/371472 [5:06:45<25:16:52,  3.38it/s]
 17%|█▋        | 64255/371472 [5:06:46<24:29:31,  3.48it/s]
 17%|█▋        | 64256/371472 [5:06:46<25:18:09,  3.37it/s]
 17%|█▋        | 64257/371472 [5:06:46<24:35:43,  3.47it/s]
 17%|█▋        | 64258/371472 [5:06:46<24:14:58,  3.52it/s]
 17%|█▋        | 64259/371472 [5:06:47<23:59:01,  3.56it/s]
 17%|█▋        | 64260/371472 [5:06:47<23:23:47,  3.65it/s]
                                                           
{'loss': 4.1856, 'learning_rate': 8.447122325411018e-07, 'epoch': 2.77}

 17%|█▋        | 64260/371472 [5:06:47<23:23:47,  3.65it/s]
 17%|█▋        | 64261/371472 [5:06:47<23:28:32,  3.64it/s]
 17%|█▋        | 64262/371472 [5:06:48<25:48:02,  3.31it/s]
 17%|█▋        | 64263/371472 [5:06:48<25:20:47,  3.37it/s]
 17%|█▋        | 64264/371472 [5:06:48<25:48:12,  3.31it/s]
 17%|█▋        | 64265/371472 [5:06:49<26:22:59,  3.23it/s]
 17%|█▋        | 64266/371472 [5:06:49<26:15:14,  3.25it/s]
 17%|█▋        | 64267/371472 [5:06:49<25:40:27,  3.32it/s]
 17%|█▋        | 64268/371472 [5:06:49<24:41:34,  3.46it/s]
 17%|█▋        | 64269/371472 [5:06:50<24:19:24,  3.51it/s]
 17%|█▋        | 64270/371472 [5:06:50<23:45:23,  3.59it/s]
 17%|█▋        | 64271/371472 [5:06:50<23:32:15,  3.63it/s]
 17%|█▋        | 64272/371472 [5:06:50<23:22:31,  3.65it/s]
 17%|█▋        | 64273/371472 [5:06:51<23:26:24,  3.64it/s]
 17%|█▋        | 64274/371472 [5:06:51<23:50:56,  3.58it/s]
 17%|█▋        | 64275/371472 [5:06:51<23:50:31,  3.58it/s]
 17%|█▋        | 64276/371472 [5:06:52<23:48:32,  3.58it/s]
 17%|█▋        | 64277/371472 [5:06:52<24:46:59,  3.44it/s]
 17%|█▋        | 64278/371472 [5:06:52<23:46:37,  3.59it/s]
 17%|█▋        | 64279/371472 [5:06:52<24:01:44,  3.55it/s]
 17%|█▋        | 64280/371472 [5:06:53<23:12:58,  3.68it/s]
                                                           
{'loss': 4.2284, 'learning_rate': 8.446637505656229e-07, 'epoch': 2.77}

 17%|█▋        | 64280/371472 [5:06:53<23:12:58,  3.68it/s]
 17%|█▋        | 64281/371472 [5:06:53<24:28:12,  3.49it/s]
 17%|█▋        | 64282/371472 [5:06:53<24:08:19,  3.53it/s]
 17%|█▋        | 64283/371472 [5:06:54<23:54:55,  3.57it/s]
 17%|█▋        | 64284/371472 [5:06:54<23:37:19,  3.61it/s]
 17%|█▋        | 64285/371472 [5:06:54<22:55:28,  3.72it/s]
 17%|█▋        | 64286/371472 [5:06:54<23:26:21,  3.64it/s]
 17%|█▋        | 64287/371472 [5:06:55<22:41:21,  3.76it/s]
 17%|█▋        | 64288/371472 [5:06:55<24:13:55,  3.52it/s]
 17%|█▋        | 64289/371472 [5:06:55<24:24:55,  3.49it/s]
 17%|█▋        | 64290/371472 [5:06:55<24:17:50,  3.51it/s]
 17%|█▋        | 64291/371472 [5:06:56<24:12:12,  3.53it/s]
 17%|█▋        | 64292/371472 [5:06:56<24:13:58,  3.52it/s]
 17%|█▋        | 64293/371472 [5:06:56<24:06:18,  3.54it/s]
 17%|█▋        | 64294/371472 [5:06:57<24:40:54,  3.46it/s]
 17%|█▋        | 64295/371472 [5:06:57<24:17:27,  3.51it/s]
 17%|█▋        | 64296/371472 [5:06:57<23:35:37,  3.62it/s]
 17%|█▋        | 64297/371472 [5:06:57<23:21:21,  3.65it/s]
 17%|█▋        | 64298/371472 [5:06:58<22:49:38,  3.74it/s]
 17%|█▋        | 64299/371472 [5:06:58<22:25:19,  3.81it/s]
 17%|█▋        | 64300/371472 [5:06:58<23:47:04,  3.59it/s]
                                                           
{'loss': 4.2686, 'learning_rate': 8.446152685901441e-07, 'epoch': 2.77}

 17%|█▋        | 64300/371472 [5:06:58<23:47:04,  3.59it/s]
 17%|█▋        | 64301/371472 [5:06:59<24:00:34,  3.55it/s]
 17%|█▋        | 64302/371472 [5:06:59<24:15:42,  3.52it/s]
 17%|█▋        | 64303/371472 [5:06:59<23:20:13,  3.66it/s]
 17%|█▋        | 64304/371472 [5:06:59<23:02:45,  3.70it/s]
 17%|█▋        | 64305/371472 [5:07:00<22:50:40,  3.73it/s]
 17%|█▋        | 64306/371472 [5:07:00<22:30:19,  3.79it/s]
 17%|█▋        | 64307/371472 [5:07:00<22:44:19,  3.75it/s]
 17%|█▋        | 64308/371472 [5:07:00<23:37:27,  3.61it/s]
 17%|█▋        | 64309/371472 [5:07:01<24:55:11,  3.42it/s]
 17%|█▋        | 64310/371472 [5:07:01<25:00:15,  3.41it/s]
 17%|█▋        | 64311/371472 [5:07:01<23:40:51,  3.60it/s]
 17%|█▋        | 64312/371472 [5:07:02<23:28:28,  3.63it/s]
 17%|█▋        | 64313/371472 [5:07:02<22:51:04,  3.73it/s]
 17%|█▋        | 64314/371472 [5:07:02<22:22:28,  3.81it/s]
 17%|█▋        | 64315/371472 [5:07:02<22:40:58,  3.76it/s]
 17%|█▋        | 64316/371472 [5:07:03<24:13:11,  3.52it/s]
 17%|█▋        | 64317/371472 [5:07:03<24:41:52,  3.45it/s]
 17%|█▋        | 64318/371472 [5:07:03<23:54:43,  3.57it/s]
 17%|█▋        | 64319/371472 [5:07:04<24:13:47,  3.52it/s]
 17%|█▋        | 64320/371472 [5:07:04<23:24:46,  3.64it/s]
                                                           
{'loss': 4.1992, 'learning_rate': 8.445667866146653e-07, 'epoch': 2.77}

 17%|█▋        | 64320/371472 [5:07:04<23:24:46,  3.64it/s]
 17%|█▋        | 64321/371472 [5:07:04<23:11:33,  3.68it/s]
 17%|█▋        | 64322/371472 [5:07:04<23:58:57,  3.56it/s]
 17%|█▋        | 64323/371472 [5:07:05<23:43:35,  3.60it/s]
 17%|█▋        | 64324/371472 [5:07:05<23:28:31,  3.63it/s]
 17%|█▋        | 64325/371472 [5:07:05<22:42:55,  3.76it/s]
 17%|█▋        | 64326/371472 [5:07:05<22:40:39,  3.76it/s]
 17%|█▋        | 64327/371472 [5:07:06<22:29:32,  3.79it/s]
 17%|█▋        | 64328/371472 [5:07:06<23:09:10,  3.68it/s]
 17%|█▋        | 64329/371472 [5:07:06<24:42:44,  3.45it/s]
 17%|█▋        | 64330/371472 [5:07:07<23:42:36,  3.60it/s]
 17%|█▋        | 64331/371472 [5:07:07<23:51:59,  3.57it/s]
 17%|█▋        | 64332/371472 [5:07:07<23:00:43,  3.71it/s]
 17%|█▋        | 64333/371472 [5:07:07<22:46:13,  3.75it/s]
 17%|█▋        | 64334/371472 [5:07:08<22:41:59,  3.76it/s]
 17%|█▋        | 64335/371472 [5:07:08<25:57:24,  3.29it/s]
 17%|█▋        | 64336/371472 [5:07:08<24:32:57,  3.48it/s]
 17%|█▋        | 64337/371472 [5:07:09<26:32:17,  3.21it/s]
 17%|█▋        | 64338/371472 [5:07:09<27:05:33,  3.15it/s]
 17%|█▋        | 64339/371472 [5:07:09<25:29:09,  3.35it/s]
 17%|█▋        | 64340/371472 [5:07:10<27:19:37,  3.12it/s]
                                                           
{'loss': 4.2428, 'learning_rate': 8.445183046391863e-07, 'epoch': 2.77}

 17%|█▋        | 64340/371472 [5:07:10<27:19:37,  3.12it/s]
 17%|█▋        | 64341/371472 [5:07:10<26:04:00,  3.27it/s]
 17%|█▋        | 64342/371472 [5:07:10<24:50:51,  3.43it/s]
 17%|█▋        | 64343/371472 [5:07:10<23:43:23,  3.60it/s]
 17%|█▋        | 64344/371472 [5:07:11<23:02:07,  3.70it/s]
 17%|█▋        | 64345/371472 [5:07:11<23:12:41,  3.68it/s]
 17%|█▋        | 64346/371472 [5:07:11<22:38:46,  3.77it/s]
 17%|█▋        | 64347/371472 [5:07:11<22:04:34,  3.86it/s]
 17%|█▋        | 64348/371472 [5:07:12<22:24:54,  3.81it/s]
 17%|█▋        | 64349/371472 [5:07:12<23:21:05,  3.65it/s]
 17%|█▋        | 64350/371472 [5:07:12<23:59:07,  3.56it/s]
 17%|█▋        | 64351/371472 [5:07:13<24:10:07,  3.53it/s]
 17%|█▋        | 64352/371472 [5:07:13<24:00:56,  3.55it/s]
 17%|█▋        | 64353/371472 [5:07:13<23:26:01,  3.64it/s]
 17%|█▋        | 64354/371472 [5:07:13<23:36:55,  3.61it/s]
 17%|█▋        | 64355/371472 [5:07:14<24:04:43,  3.54it/s]
 17%|█▋        | 64356/371472 [5:07:14<23:54:52,  3.57it/s]
 17%|█▋        | 64357/371472 [5:07:14<24:48:06,  3.44it/s]
 17%|█▋        | 64358/371472 [5:07:15<27:33:55,  3.09it/s]
 17%|█▋        | 64359/371472 [5:07:15<25:48:06,  3.31it/s]
 17%|█▋        | 64360/371472 [5:07:15<24:58:57,  3.41it/s]
                                                           
{'loss': 4.3385, 'learning_rate': 8.444698226637074e-07, 'epoch': 2.77}

 17%|█▋        | 64360/371472 [5:07:15<24:58:57,  3.41it/s]
 17%|█▋        | 64361/371472 [5:07:15<23:32:05,  3.62it/s]
 17%|█▋        | 64362/371472 [5:07:16<22:37:57,  3.77it/s]
 17%|█▋        | 64363/371472 [5:07:16<24:39:39,  3.46it/s]
 17%|█▋        | 64364/371472 [5:07:16<24:05:57,  3.54it/s]
 17%|█▋        | 64365/371472 [5:07:16<23:17:35,  3.66it/s]
 17%|█▋        | 64366/371472 [5:07:17<23:17:00,  3.66it/s]
 17%|█▋        | 64367/371472 [5:07:17<22:43:35,  3.75it/s]
 17%|█▋        | 64368/371472 [5:07:17<21:50:28,  3.91it/s]
 17%|█▋        | 64369/371472 [5:07:18<22:28:47,  3.79it/s]
 17%|█▋        | 64370/371472 [5:07:18<22:25:50,  3.80it/s]
 17%|█▋        | 64371/371472 [5:07:18<24:52:20,  3.43it/s]
 17%|█▋        | 64372/371472 [5:07:18<26:42:12,  3.19it/s]
 17%|█▋        | 64373/371472 [5:07:19<26:00:09,  3.28it/s]
 17%|█▋        | 64374/371472 [5:07:19<25:46:32,  3.31it/s]
 17%|█▋        | 64375/371472 [5:07:19<27:19:12,  3.12it/s]
 17%|█▋        | 64376/371472 [5:07:20<25:51:14,  3.30it/s]
 17%|█▋        | 64377/371472 [5:07:20<24:56:23,  3.42it/s]
 17%|█▋        | 64378/371472 [5:07:20<27:29:33,  3.10it/s]
 17%|█▋        | 64379/371472 [5:07:21<26:10:19,  3.26it/s]
 17%|█▋        | 64380/371472 [5:07:21<24:39:25,  3.46it/s]
                                                           
{'loss': 4.0539, 'learning_rate': 8.444213406882286e-07, 'epoch': 2.77}

 17%|█▋        | 64380/371472 [5:07:21<24:39:25,  3.46it/s]
 17%|█▋        | 64381/371472 [5:07:21<25:54:32,  3.29it/s]
 17%|█▋        | 64382/371472 [5:07:22<26:06:18,  3.27it/s]
 17%|█▋        | 64383/371472 [5:07:22<25:40:30,  3.32it/s]
 17%|█▋        | 64384/371472 [5:07:22<25:46:52,  3.31it/s]
 17%|█▋        | 64385/371472 [5:07:22<25:51:03,  3.30it/s]
 17%|█▋        | 64386/371472 [5:07:23<25:22:27,  3.36it/s]
 17%|█▋        | 64387/371472 [5:07:23<24:57:44,  3.42it/s]
 17%|█▋        | 64388/371472 [5:07:23<24:35:54,  3.47it/s]
 17%|█▋        | 64389/371472 [5:07:24<25:14:03,  3.38it/s]
 17%|█▋        | 64390/371472 [5:07:24<24:27:07,  3.49it/s]
 17%|█▋        | 64391/371472 [5:07:24<23:37:08,  3.61it/s]
 17%|█▋        | 64392/371472 [5:07:24<23:56:56,  3.56it/s]
 17%|█▋        | 64393/371472 [5:07:25<24:06:05,  3.54it/s]
 17%|█▋        | 64394/371472 [5:07:25<23:37:11,  3.61it/s]
 17%|█▋        | 64395/371472 [5:07:25<24:08:00,  3.53it/s]
 17%|█▋        | 64396/371472 [5:07:26<24:05:26,  3.54it/s]
 17%|█▋        | 64397/371472 [5:07:26<24:07:56,  3.53it/s]
 17%|█▋        | 64398/371472 [5:07:26<24:02:59,  3.55it/s]
 17%|█▋        | 64399/371472 [5:07:26<24:04:08,  3.54it/s]
 17%|█▋        | 64400/371472 [5:07:27<23:02:40,  3.70it/s]
                                                           
{'loss': 4.073, 'learning_rate': 8.443728587127497e-07, 'epoch': 2.77}

 17%|█▋        | 64400/371472 [5:07:27<23:02:40,  3.70it/s]
 17%|█▋        | 64401/371472 [5:07:27<24:15:50,  3.52it/s]
 17%|█▋        | 64402/371472 [5:07:27<25:03:08,  3.40it/s]
 17%|█▋        | 64403/371472 [5:07:28<24:32:40,  3.48it/s]
 17%|█▋        | 64404/371472 [5:07:28<23:31:07,  3.63it/s]
 17%|█▋        | 64405/371472 [5:07:28<23:06:08,  3.69it/s]
 17%|█▋        | 64406/371472 [5:07:28<24:40:28,  3.46it/s]
 17%|█▋        | 64407/371472 [5:07:29<23:58:30,  3.56it/s]
 17%|█▋        | 64408/371472 [5:07:29<25:39:15,  3.32it/s]
 17%|█▋        | 64409/371472 [5:07:29<26:14:33,  3.25it/s]
 17%|█▋        | 64410/371472 [5:07:30<26:45:47,  3.19it/s]
 17%|█▋        | 64411/371472 [5:07:30<26:04:02,  3.27it/s]
 17%|█▋        | 64412/371472 [5:07:30<25:24:51,  3.36it/s]
 17%|█▋        | 64413/371472 [5:07:30<25:26:22,  3.35it/s]
 17%|█▋        | 64414/371472 [5:07:31<25:24:27,  3.36it/s]
 17%|█▋        | 64415/371472 [5:07:31<24:38:41,  3.46it/s]
 17%|█▋        | 64416/371472 [5:07:31<24:01:29,  3.55it/s]
 17%|█▋        | 64417/371472 [5:07:32<24:44:01,  3.45it/s]
 17%|█▋        | 64418/371472 [5:07:32<23:37:57,  3.61it/s]
 17%|█▋        | 64419/371472 [5:07:32<22:45:22,  3.75it/s]
 17%|█▋        | 64420/371472 [5:07:32<24:35:35,  3.47it/s]
                                                           
{'loss': 4.1707, 'learning_rate': 8.443243767372707e-07, 'epoch': 2.77}

 17%|█▋        | 64420/371472 [5:07:32<24:35:35,  3.47it/s]
 17%|█▋        | 64421/371472 [5:07:33<25:41:02,  3.32it/s]
 17%|█▋        | 64422/371472 [5:07:33<24:28:24,  3.49it/s]
 17%|█▋        | 64423/371472 [5:07:33<23:37:23,  3.61it/s]
 17%|█▋        | 64424/371472 [5:07:34<22:59:52,  3.71it/s]
 17%|█▋        | 64425/371472 [5:07:34<22:38:05,  3.77it/s]
 17%|█▋        | 64426/371472 [5:07:34<24:58:35,  3.41it/s]
 17%|█▋        | 64427/371472 [5:07:34<23:44:28,  3.59it/s]
 17%|█▋        | 64428/371472 [5:07:35<23:53:05,  3.57it/s]
 17%|█▋        | 64429/371472 [5:07:35<22:47:50,  3.74it/s]
 17%|█▋        | 64430/371472 [5:07:35<22:27:58,  3.80it/s]
 17%|█▋        | 64431/371472 [5:07:36<27:19:16,  3.12it/s]
 17%|█▋        | 64432/371472 [5:07:36<28:08:40,  3.03it/s]
 17%|█▋        | 64433/371472 [5:07:36<25:52:33,  3.30it/s]
 17%|█▋        | 64434/371472 [5:07:36<24:25:54,  3.49it/s]
 17%|█▋        | 64435/371472 [5:07:37<24:12:37,  3.52it/s]
 17%|█▋        | 64436/371472 [5:07:37<25:29:18,  3.35it/s]
 17%|█▋        | 64437/371472 [5:07:37<24:41:03,  3.46it/s]
 17%|█▋        | 64438/371472 [5:07:38<24:33:26,  3.47it/s]
 17%|█▋        | 64439/371472 [5:07:38<23:21:22,  3.65it/s]
 17%|█▋        | 64440/371472 [5:07:38<23:33:08,  3.62it/s]
                                                           
{'loss': 4.1407, 'learning_rate': 8.442758947617918e-07, 'epoch': 2.78}

 17%|█▋        | 64440/371472 [5:07:38<23:33:08,  3.62it/s]
 17%|█▋        | 64441/371472 [5:07:38<23:40:08,  3.60it/s]
 17%|█▋        | 64442/371472 [5:07:39<23:06:57,  3.69it/s]
 17%|█▋        | 64443/371472 [5:07:39<23:40:23,  3.60it/s]
 17%|█▋        | 64444/371472 [5:07:39<23:46:11,  3.59it/s]
 17%|█▋        | 64445/371472 [5:07:40<23:07:07,  3.69it/s]
 17%|█▋        | 64446/371472 [5:07:40<23:04:21,  3.70it/s]
 17%|█▋        | 64447/371472 [5:07:40<22:44:47,  3.75it/s]
 17%|█▋        | 64448/371472 [5:07:40<22:09:42,  3.85it/s]
 17%|█▋        | 64449/371472 [5:07:41<22:02:35,  3.87it/s]
 17%|█▋        | 64450/371472 [5:07:41<23:48:39,  3.58it/s]
 17%|█▋        | 64451/371472 [5:07:41<24:44:15,  3.45it/s]
 17%|█▋        | 64452/371472 [5:07:42<26:45:42,  3.19it/s]
 17%|█▋        | 64453/371472 [5:07:42<25:50:01,  3.30it/s]
 17%|█▋        | 64454/371472 [5:07:42<24:31:46,  3.48it/s]
 17%|█▋        | 64455/371472 [5:07:42<25:18:01,  3.37it/s]
 17%|█▋        | 64456/371472 [5:07:43<28:53:56,  2.95it/s]
 17%|█▋        | 64457/371472 [5:07:43<32:36:23,  2.62it/s]
 17%|█▋        | 64458/371472 [5:07:44<29:16:05,  2.91it/s]
 17%|█▋        | 64459/371472 [5:07:44<27:13:49,  3.13it/s]
 17%|█▋        | 64460/371472 [5:07:44<26:01:37,  3.28it/s]
                                                           
{'loss': 4.2477, 'learning_rate': 8.442274127863129e-07, 'epoch': 2.78}

 17%|█▋        | 64460/371472 [5:07:44<26:01:37,  3.28it/s]
 17%|█▋        | 64461/371472 [5:07:44<24:56:46,  3.42it/s]
 17%|█▋        | 64462/371472 [5:07:45<23:59:04,  3.56it/s]
 17%|█▋        | 64463/371472 [5:07:45<22:51:44,  3.73it/s]
 17%|█▋        | 64464/371472 [5:07:45<22:12:33,  3.84it/s]
 17%|█▋        | 64465/371472 [5:07:45<23:15:32,  3.67it/s]
 17%|█▋        | 64466/371472 [5:07:46<23:03:54,  3.70it/s]
 17%|█▋        | 64467/371472 [5:07:46<26:19:05,  3.24it/s]
 17%|█▋        | 64468/371472 [5:07:46<24:39:02,  3.46it/s]
 17%|█▋        | 64469/371472 [5:07:47<24:04:00,  3.54it/s]
 17%|█▋        | 64470/371472 [5:07:47<27:24:32,  3.11it/s]
 17%|█▋        | 64471/371472 [5:07:47<26:15:23,  3.25it/s]
 17%|█▋        | 64472/371472 [5:07:48<27:23:18,  3.11it/s]
 17%|█▋        | 64473/371472 [5:07:48<26:51:10,  3.18it/s]
 17%|█▋        | 64474/371472 [5:07:48<25:21:01,  3.36it/s]
 17%|█▋        | 64475/371472 [5:07:48<24:11:10,  3.53it/s]
 17%|█▋        | 64476/371472 [5:07:49<23:41:17,  3.60it/s]
 17%|█▋        | 64477/371472 [5:07:49<22:37:57,  3.77it/s]
 17%|█▋        | 64478/371472 [5:07:49<23:32:44,  3.62it/s]
 17%|█▋        | 64479/371472 [5:07:50<24:20:24,  3.50it/s]
 17%|█▋        | 64480/371472 [5:07:50<23:36:30,  3.61it/s]
                                                           
{'loss': 4.3696, 'learning_rate': 8.441789308108341e-07, 'epoch': 2.78}

 17%|█▋        | 64480/371472 [5:07:50<23:36:30,  3.61it/s]
 17%|█▋        | 64481/371472 [5:07:50<23:12:31,  3.67it/s]
 17%|█▋        | 64482/371472 [5:07:50<23:10:53,  3.68it/s]
 17%|█▋        | 64483/371472 [5:07:51<23:42:39,  3.60it/s]
 17%|█▋        | 64484/371472 [5:07:51<23:47:16,  3.58it/s]
 17%|█▋        | 64485/371472 [5:07:51<23:08:42,  3.68it/s]
 17%|█▋        | 64486/371472 [5:07:51<23:56:23,  3.56it/s]
 17%|█▋        | 64487/371472 [5:07:52<23:19:51,  3.65it/s]
 17%|█▋        | 64488/371472 [5:07:52<25:50:04,  3.30it/s]
 17%|█▋        | 64489/371472 [5:07:52<24:07:59,  3.53it/s]
 17%|█▋        | 64490/371472 [5:07:53<23:33:59,  3.62it/s]
 17%|█▋        | 64491/371472 [5:07:53<24:17:08,  3.51it/s]
 17%|█▋        | 64492/371472 [5:07:53<23:50:47,  3.58it/s]
 17%|█▋        | 64493/371472 [5:07:54<25:46:28,  3.31it/s]
 17%|█▋        | 64494/371472 [5:07:54<25:56:48,  3.29it/s]
 17%|█▋        | 64495/371472 [5:07:54<25:09:04,  3.39it/s]
 17%|█▋        | 64496/371472 [5:07:54<25:17:13,  3.37it/s]
 17%|█▋        | 64497/371472 [5:07:55<24:30:40,  3.48it/s]
 17%|█▋        | 64498/371472 [5:07:55<23:56:44,  3.56it/s]
 17%|█▋        | 64499/371472 [5:07:55<24:38:47,  3.46it/s]
 17%|█▋        | 64500/371472 [5:07:56<24:30:08,  3.48it/s]
                                                           
{'loss': 4.2808, 'learning_rate': 8.441304488353552e-07, 'epoch': 2.78}

 17%|█▋        | 64500/371472 [5:07:56<24:30:08,  3.48it/s]
 17%|█▋        | 64501/371472 [5:07:56<23:35:40,  3.61it/s]
 17%|█▋        | 64502/371472 [5:07:56<23:38:20,  3.61it/s]
 17%|█▋        | 64503/371472 [5:07:56<23:27:55,  3.63it/s]
 17%|█▋        | 64504/371472 [5:07:57<24:09:12,  3.53it/s]
 17%|█▋        | 64505/371472 [5:07:57<25:03:38,  3.40it/s]
 17%|█▋        | 64506/371472 [5:07:57<24:05:21,  3.54it/s]
 17%|█▋        | 64507/371472 [5:07:57<24:19:07,  3.51it/s]
 17%|█▋        | 64508/371472 [5:07:58<24:04:43,  3.54it/s]
 17%|█▋        | 64509/371472 [5:07:58<24:18:37,  3.51it/s]
 17%|█▋        | 64510/371472 [5:07:58<24:22:52,  3.50it/s]
 17%|█▋        | 64511/371472 [5:07:59<24:06:28,  3.54it/s]
 17%|█▋        | 64512/371472 [5:07:59<24:28:12,  3.48it/s]
 17%|█▋        | 64513/371472 [5:07:59<23:30:14,  3.63it/s]
 17%|█▋        | 64514/371472 [5:07:59<23:34:45,  3.62it/s]
 17%|█▋        | 64515/371472 [5:08:00<25:20:47,  3.36it/s]
 17%|█▋        | 64516/371472 [5:08:00<23:55:24,  3.56it/s]
 17%|█▋        | 64517/371472 [5:08:00<23:59:48,  3.55it/s]
 17%|█▋        | 64518/371472 [5:08:01<23:59:23,  3.55it/s]
 17%|█▋        | 64519/371472 [5:08:01<23:06:50,  3.69it/s]
 17%|█▋        | 64520/371472 [5:08:01<22:25:05,  3.80it/s]
                                                           
{'loss': 4.248, 'learning_rate': 8.440819668598762e-07, 'epoch': 2.78}

 17%|█▋        | 64520/371472 [5:08:01<22:25:05,  3.80it/s]
 17%|█▋        | 64521/371472 [5:08:01<23:57:44,  3.56it/s]
 17%|█▋        | 64522/371472 [5:08:02<24:44:38,  3.45it/s]
 17%|█▋        | 64523/371472 [5:08:02<24:54:45,  3.42it/s]
 17%|█▋        | 64524/371472 [5:08:02<24:15:15,  3.52it/s]
 17%|█▋        | 64525/371472 [5:08:03<23:37:02,  3.61it/s]
 17%|█▋        | 64526/371472 [5:08:03<22:32:49,  3.78it/s]
 17%|█▋        | 64527/371472 [5:08:03<23:44:20,  3.59it/s]
 17%|█▋        | 64528/371472 [5:08:03<23:22:31,  3.65it/s]
 17%|█▋        | 64529/371472 [5:08:04<22:56:09,  3.72it/s]
 17%|█▋        | 64530/371472 [5:08:04<22:15:42,  3.83it/s]
 17%|█▋        | 64531/371472 [5:08:04<22:43:31,  3.75it/s]
 17%|█▋        | 64532/371472 [5:08:04<22:27:16,  3.80it/s]
 17%|█▋        | 64533/371472 [5:08:05<22:05:36,  3.86it/s]
 17%|█▋        | 64534/371472 [5:08:05<22:26:40,  3.80it/s]
 17%|█▋        | 64535/371472 [5:08:05<23:39:19,  3.60it/s]
 17%|█▋        | 64536/371472 [5:08:05<22:47:03,  3.74it/s]
 17%|█▋        | 64537/371472 [5:08:06<23:06:00,  3.69it/s]
 17%|█▋        | 64538/371472 [5:08:06<22:58:24,  3.71it/s]
 17%|█▋        | 64539/371472 [5:08:06<23:36:50,  3.61it/s]
 17%|█▋        | 64540/371472 [5:08:07<23:42:28,  3.60it/s]
                                                           
{'loss': 4.3766, 'learning_rate': 8.440334848843974e-07, 'epoch': 2.78}

 17%|█▋        | 64540/371472 [5:08:07<23:42:28,  3.60it/s]
 17%|█▋        | 64541/371472 [5:08:07<22:59:19,  3.71it/s]
 17%|█▋        | 64542/371472 [5:08:07<23:19:10,  3.66it/s]
 17%|█▋        | 64543/371472 [5:08:07<23:12:13,  3.67it/s]
 17%|█▋        | 64544/371472 [5:08:08<23:24:27,  3.64it/s]
 17%|█▋        | 64545/371472 [5:08:08<26:20:36,  3.24it/s]
 17%|█▋        | 64546/371472 [5:08:08<25:24:35,  3.36it/s]
 17%|█▋        | 64547/371472 [5:08:09<25:15:55,  3.37it/s]
 17%|█▋        | 64548/371472 [5:08:09<24:52:54,  3.43it/s]
 17%|█▋        | 64549/371472 [5:08:09<26:17:19,  3.24it/s]
 17%|█▋        | 64550/371472 [5:08:10<28:06:14,  3.03it/s]
 17%|█▋        | 64551/371472 [5:08:10<27:16:36,  3.13it/s]
 17%|█▋        | 64552/371472 [5:08:10<26:18:44,  3.24it/s]
 17%|█▋        | 64553/371472 [5:08:11<33:40:07,  2.53it/s]
 17%|█▋        | 64554/371472 [5:08:11<29:57:50,  2.85it/s]
 17%|█▋        | 64555/371472 [5:08:11<27:44:23,  3.07it/s]
 17%|█▋        | 64556/371472 [5:08:12<25:13:00,  3.38it/s]
 17%|█▋        | 64557/371472 [5:08:12<26:22:16,  3.23it/s]
 17%|█▋        | 64558/371472 [5:08:12<26:36:20,  3.20it/s]
 17%|█▋        | 64559/371472 [5:08:12<25:41:21,  3.32it/s]
 17%|█▋        | 64560/371472 [5:08:13<25:15:57,  3.37it/s]
                                                           
{'loss': 4.157, 'learning_rate': 8.439850029089184e-07, 'epoch': 2.78}

 17%|█▋        | 64560/371472 [5:08:13<25:15:57,  3.37it/s]
 17%|█▋        | 64561/371472 [5:08:13<24:39:33,  3.46it/s]
 17%|█▋        | 64562/371472 [5:08:13<25:39:10,  3.32it/s]
 17%|█▋        | 64563/371472 [5:08:14<25:30:56,  3.34it/s]
 17%|█▋        | 64564/371472 [5:08:14<25:24:37,  3.35it/s]
 17%|█▋        | 64565/371472 [5:08:14<24:34:06,  3.47it/s]
 17%|█▋        | 64566/371472 [5:08:15<24:21:18,  3.50it/s]
 17%|█▋        | 64567/371472 [5:08:15<26:36:50,  3.20it/s]
 17%|█▋        | 64568/371472 [5:08:15<25:22:24,  3.36it/s]
 17%|█▋        | 64569/371472 [5:08:15<25:08:20,  3.39it/s]
 17%|█▋        | 64570/371472 [5:08:16<24:46:26,  3.44it/s]
 17%|█▋        | 64571/371472 [5:08:16<24:50:50,  3.43it/s]
 17%|█▋        | 64572/371472 [5:08:16<24:06:15,  3.54it/s]
 17%|█▋        | 64573/371472 [5:08:17<24:13:05,  3.52it/s]
 17%|█▋        | 64574/371472 [5:08:17<24:49:32,  3.43it/s]
 17%|█▋        | 64575/371472 [5:08:17<26:06:08,  3.27it/s]
 17%|█▋        | 64576/371472 [5:08:18<27:26:20,  3.11it/s]
 17%|█▋        | 64577/371472 [5:08:18<26:55:35,  3.17it/s]
 17%|█▋        | 64578/371472 [5:08:18<25:21:45,  3.36it/s]
 17%|█▋        | 64579/371472 [5:08:18<25:21:39,  3.36it/s]
 17%|█▋        | 64580/371472 [5:08:19<24:53:34,  3.42it/s]
                                                           
{'loss': 4.2217, 'learning_rate': 8.439365209334396e-07, 'epoch': 2.78}

 17%|█▋        | 64580/371472 [5:08:19<24:53:34,  3.42it/s]
 17%|█▋        | 64581/371472 [5:08:19<24:10:13,  3.53it/s]
 17%|█▋        | 64582/371472 [5:08:19<23:17:41,  3.66it/s]
 17%|█▋        | 64583/371472 [5:08:19<23:17:32,  3.66it/s]
 17%|█▋        | 64584/371472 [5:08:20<23:39:36,  3.60it/s]
 17%|█▋        | 64585/371472 [5:08:20<24:04:40,  3.54it/s]
 17%|█▋        | 64586/371472 [5:08:21<28:27:13,  3.00it/s]
 17%|█▋        | 64587/371472 [5:08:21<26:12:28,  3.25it/s]
 17%|█▋        | 64588/371472 [5:08:21<25:22:23,  3.36it/s]
 17%|█▋        | 64589/371472 [5:08:21<24:12:27,  3.52it/s]
 17%|█▋        | 64590/371472 [5:08:22<23:37:23,  3.61it/s]
 17%|█▋        | 64591/371472 [5:08:22<24:05:45,  3.54it/s]
 17%|█▋        | 64592/371472 [5:08:22<25:19:40,  3.37it/s]
 17%|█▋        | 64593/371472 [5:08:22<25:07:16,  3.39it/s]
 17%|█▋        | 64594/371472 [5:08:23<24:24:55,  3.49it/s]
 17%|█▋        | 64595/371472 [5:08:23<23:31:06,  3.62it/s]
 17%|█▋        | 64596/371472 [5:08:23<23:41:21,  3.60it/s]
 17%|█▋        | 64597/371472 [5:08:24<23:06:48,  3.69it/s]
 17%|█▋        | 64598/371472 [5:08:24<23:59:11,  3.55it/s]
 17%|█▋        | 64599/371472 [5:08:24<24:08:40,  3.53it/s]
 17%|█▋        | 64600/371472 [5:08:24<24:30:02,  3.48it/s]
                                                           
{'loss': 4.1429, 'learning_rate': 8.438880389579607e-07, 'epoch': 2.78}

 17%|█▋        | 64600/371472 [5:08:24<24:30:02,  3.48it/s]
 17%|█▋        | 64601/371472 [5:08:25<24:35:01,  3.47it/s]
 17%|█▋        | 64602/371472 [5:08:25<24:33:05,  3.47it/s]
 17%|█▋        | 64603/371472 [5:08:25<23:31:30,  3.62it/s]
 17%|█▋        | 64604/371472 [5:08:26<23:43:08,  3.59it/s]
 17%|█▋        | 64605/371472 [5:08:26<23:27:25,  3.63it/s]
 17%|█▋        | 64606/371472 [5:08:26<23:28:42,  3.63it/s]
 17%|█▋        | 64607/371472 [5:08:26<22:56:57,  3.71it/s]
 17%|█▋        | 64608/371472 [5:08:27<22:36:25,  3.77it/s]
 17%|█▋        | 64609/371472 [5:08:27<22:52:54,  3.73it/s]
 17%|█▋        | 64610/371472 [5:08:27<22:47:49,  3.74it/s]
 17%|█▋        | 64611/371472 [5:08:27<22:24:17,  3.80it/s]
 17%|█▋        | 64612/371472 [5:08:28<23:06:15,  3.69it/s]
 17%|█▋        | 64613/371472 [5:08:28<22:32:31,  3.78it/s]
 17%|█▋        | 64614/371472 [5:08:28<22:57:05,  3.71it/s]
 17%|█▋        | 64615/371472 [5:08:28<22:45:13,  3.75it/s]
 17%|█▋        | 64616/371472 [5:08:29<22:05:25,  3.86it/s]
 17%|█▋        | 64617/371472 [5:08:29<21:50:34,  3.90it/s]
 17%|█▋        | 64618/371472 [5:08:29<21:57:59,  3.88it/s]
 17%|█▋        | 64619/371472 [5:08:29<22:21:35,  3.81it/s]
 17%|█▋        | 64620/371472 [5:08:30<22:56:52,  3.71it/s]
                                                           
{'loss': 4.1362, 'learning_rate': 8.438395569824819e-07, 'epoch': 2.78}

 17%|█▋        | 64620/371472 [5:08:30<22:56:52,  3.71it/s]
 17%|█▋        | 64621/371472 [5:08:30<23:05:03,  3.69it/s]
 17%|█▋        | 64622/371472 [5:08:30<25:44:27,  3.31it/s]
 17%|█▋        | 64623/371472 [5:08:31<24:58:39,  3.41it/s]
 17%|█▋        | 64624/371472 [5:08:31<26:07:03,  3.26it/s]
 17%|█▋        | 64625/371472 [5:08:31<25:29:45,  3.34it/s]
 17%|█▋        | 64626/371472 [5:08:32<24:33:55,  3.47it/s]
 17%|█▋        | 64627/371472 [5:08:32<23:54:11,  3.57it/s]
 17%|█▋        | 64628/371472 [5:08:32<23:15:36,  3.66it/s]
 17%|█▋        | 64629/371472 [5:08:32<24:17:35,  3.51it/s]
 17%|█▋        | 64630/371472 [5:08:33<24:44:45,  3.44it/s]
 17%|█▋        | 64631/371472 [5:08:33<23:58:30,  3.56it/s]
 17%|█▋        | 64632/371472 [5:08:33<23:17:45,  3.66it/s]
 17%|█▋        | 64633/371472 [5:08:33<23:22:42,  3.65it/s]
 17%|█▋        | 64634/371472 [5:08:34<23:12:25,  3.67it/s]
 17%|█▋        | 64635/371472 [5:08:34<22:25:58,  3.80it/s]
 17%|█▋        | 64636/371472 [5:08:34<22:17:34,  3.82it/s]
 17%|█▋        | 64637/371472 [5:08:35<23:40:59,  3.60it/s]
 17%|█▋        | 64638/371472 [5:08:35<22:30:17,  3.79it/s]
 17%|█▋        | 64639/371472 [5:08:35<22:34:06,  3.78it/s]
 17%|█▋        | 64640/371472 [5:08:35<22:12:54,  3.84it/s]
                                                           
{'loss': 4.2166, 'learning_rate': 8.437910750070029e-07, 'epoch': 2.78}

 17%|█▋        | 64640/371472 [5:08:35<22:12:54,  3.84it/s]
 17%|█▋        | 64641/371472 [5:08:36<22:19:22,  3.82it/s]
 17%|█▋        | 64642/371472 [5:08:36<24:44:24,  3.45it/s]
 17%|█▋        | 64643/371472 [5:08:36<24:51:07,  3.43it/s]
 17%|█▋        | 64644/371472 [5:08:36<23:24:45,  3.64it/s]
 17%|█▋        | 64645/371472 [5:08:37<22:58:54,  3.71it/s]
 17%|█▋        | 64646/371472 [5:08:37<22:51:19,  3.73it/s]
 17%|█▋        | 64647/371472 [5:08:37<24:21:14,  3.50it/s]
 17%|█▋        | 64648/371472 [5:08:38<24:12:16,  3.52it/s]
 17%|█▋        | 64649/371472 [5:08:38<25:21:44,  3.36it/s]
 17%|█▋        | 64650/371472 [5:08:38<24:48:36,  3.44it/s]
 17%|█▋        | 64651/371472 [5:08:38<24:21:46,  3.50it/s]
 17%|█▋        | 64652/371472 [5:08:39<23:25:10,  3.64it/s]
 17%|█▋        | 64653/371472 [5:08:39<23:59:57,  3.55it/s]
 17%|█▋        | 64654/371472 [5:08:39<24:02:53,  3.54it/s]
 17%|█▋        | 64655/371472 [5:08:40<24:23:19,  3.49it/s]
 17%|█▋        | 64656/371472 [5:08:40<27:04:11,  3.15it/s]
 17%|█▋        | 64657/371472 [5:08:40<26:14:15,  3.25it/s]
 17%|█▋        | 64658/371472 [5:08:41<24:57:38,  3.41it/s]
 17%|█▋        | 64659/371472 [5:08:41<25:11:44,  3.38it/s]
 17%|█▋        | 64660/371472 [5:08:41<24:35:39,  3.47it/s]
                                                           
{'loss': 4.1578, 'learning_rate': 8.43742593031524e-07, 'epoch': 2.79}

 17%|█▋        | 64660/371472 [5:08:41<24:35:39,  3.47it/s]
 17%|█▋        | 64661/371472 [5:08:41<24:22:28,  3.50it/s]
 17%|█▋        | 64662/371472 [5:08:42<25:13:59,  3.38it/s]
 17%|█▋        | 64663/371472 [5:08:42<23:45:23,  3.59it/s]
 17%|█▋        | 64664/371472 [5:08:42<22:51:02,  3.73it/s]
 17%|█▋        | 64665/371472 [5:08:42<23:35:05,  3.61it/s]
 17%|█▋        | 64666/371472 [5:08:43<23:45:04,  3.59it/s]
 17%|█▋        | 64667/371472 [5:08:43<23:34:28,  3.62it/s]
 17%|█▋        | 64668/371472 [5:08:43<23:41:01,  3.60it/s]
 17%|█▋        | 64669/371472 [5:08:44<23:20:30,  3.65it/s]
 17%|█▋        | 64670/371472 [5:08:44<22:37:36,  3.77it/s]
 17%|█▋        | 64671/371472 [5:08:44<23:35:15,  3.61it/s]
 17%|█▋        | 64672/371472 [5:08:44<25:05:12,  3.40it/s]
 17%|█▋        | 64673/371472 [5:08:45<25:07:15,  3.39it/s]
 17%|█▋        | 64674/371472 [5:08:45<24:39:39,  3.46it/s]
 17%|█▋        | 64675/371472 [5:08:45<23:38:39,  3.60it/s]
 17%|█▋        | 64676/371472 [5:08:46<23:39:39,  3.60it/s]
 17%|█▋        | 64677/371472 [5:08:46<24:50:07,  3.43it/s]
 17%|█▋        | 64678/371472 [5:08:46<24:33:21,  3.47it/s]
 17%|█▋        | 64679/371472 [5:08:47<25:52:14,  3.29it/s]
 17%|█▋        | 64680/371472 [5:08:47<25:21:32,  3.36it/s]
                                                           
{'loss': 4.399, 'learning_rate': 8.436941110560451e-07, 'epoch': 2.79}

 17%|█▋        | 64680/371472 [5:08:47<25:21:32,  3.36it/s]
 17%|█▋        | 64681/371472 [5:08:47<24:28:29,  3.48it/s]
 17%|█▋        | 64682/371472 [5:08:47<24:23:00,  3.49it/s]
 17%|█▋        | 64683/371472 [5:08:48<23:08:52,  3.68it/s]
 17%|█▋        | 64684/371472 [5:08:48<23:32:28,  3.62it/s]
 17%|█▋        | 64685/371472 [5:08:48<23:51:07,  3.57it/s]
 17%|█▋        | 64686/371472 [5:08:48<23:20:48,  3.65it/s]
 17%|█▋        | 64687/371472 [5:08:49<22:38:42,  3.76it/s]
 17%|█▋        | 64688/371472 [5:08:49<22:37:44,  3.77it/s]
 17%|█▋        | 64689/371472 [5:08:49<22:38:47,  3.76it/s]
 17%|█▋        | 64690/371472 [5:08:49<22:40:41,  3.76it/s]
 17%|█▋        | 64691/371472 [5:08:50<22:43:16,  3.75it/s]
 17%|█▋        | 64692/371472 [5:08:50<23:28:10,  3.63it/s]
 17%|█▋        | 64693/371472 [5:08:50<23:53:35,  3.57it/s]
 17%|█▋        | 64694/371472 [5:08:51<24:12:23,  3.52it/s]
 17%|█▋        | 64695/371472 [5:08:51<23:46:29,  3.58it/s]
 17%|█▋        | 64696/371472 [5:08:51<23:07:33,  3.68it/s]
 17%|█▋        | 64697/371472 [5:08:51<22:46:33,  3.74it/s]
 17%|█▋        | 64698/371472 [5:08:52<22:06:15,  3.86it/s]
 17%|█▋        | 64699/371472 [5:08:52<24:00:34,  3.55it/s]
 17%|█▋        | 64700/371472 [5:08:52<24:37:28,  3.46it/s]
                                                           
{'loss': 4.2696, 'learning_rate': 8.436456290805663e-07, 'epoch': 2.79}

 17%|█▋        | 64700/371472 [5:08:52<24:37:28,  3.46it/s]
 17%|█▋        | 64701/371472 [5:08:53<24:26:21,  3.49it/s]
 17%|█▋        | 64702/371472 [5:08:53<23:36:54,  3.61it/s]
 17%|█▋        | 64703/371472 [5:08:53<22:52:05,  3.73it/s]
 17%|█▋        | 64704/371472 [5:08:53<22:21:12,  3.81it/s]
 17%|█▋        | 64705/371472 [5:08:54<22:43:30,  3.75it/s]
 17%|█▋        | 64706/371472 [5:08:54<23:57:42,  3.56it/s]
 17%|█▋        | 64707/371472 [5:08:54<22:49:55,  3.73it/s]
 17%|█▋        | 64708/371472 [5:08:55<25:30:32,  3.34it/s]
 17%|█▋        | 64709/371472 [5:08:55<26:16:27,  3.24it/s]
 17%|█▋        | 64710/371472 [5:08:55<25:05:17,  3.40it/s]
 17%|█▋        | 64711/371472 [5:08:55<23:20:00,  3.65it/s]
 17%|█▋        | 64712/371472 [5:08:56<22:39:47,  3.76it/s]
 17%|█▋        | 64713/371472 [5:08:56<24:04:04,  3.54it/s]
 17%|█▋        | 64714/371472 [5:08:56<23:09:09,  3.68it/s]
 17%|█▋        | 64715/371472 [5:08:56<22:43:15,  3.75it/s]
 17%|█▋        | 64716/371472 [5:08:57<22:32:59,  3.78it/s]
 17%|█▋        | 64717/371472 [5:08:57<23:23:16,  3.64it/s]
 17%|█▋        | 64718/371472 [5:08:57<22:46:09,  3.74it/s]
 17%|█▋        | 64719/371472 [5:08:57<22:25:45,  3.80it/s]
 17%|█▋        | 64720/371472 [5:08:58<24:00:43,  3.55it/s]
                                                           
{'loss': 4.1585, 'learning_rate': 8.435971471050873e-07, 'epoch': 2.79}

 17%|█▋        | 64720/371472 [5:08:58<24:00:43,  3.55it/s]
 17%|█▋        | 64721/371472 [5:08:58<23:20:23,  3.65it/s]
 17%|█▋        | 64722/371472 [5:08:58<24:09:32,  3.53it/s]
 17%|█▋        | 64723/371472 [5:08:59<24:51:15,  3.43it/s]
 17%|█▋        | 64724/371472 [5:08:59<24:51:58,  3.43it/s]
 17%|█▋        | 64725/371472 [5:08:59<25:23:52,  3.35it/s]
 17%|█▋        | 64726/371472 [5:09:00<25:11:39,  3.38it/s]
 17%|█▋        | 64727/371472 [5:09:00<24:02:17,  3.54it/s]
 17%|█▋        | 64728/371472 [5:09:00<23:27:49,  3.63it/s]
 17%|█▋        | 64729/371472 [5:09:00<24:16:11,  3.51it/s]
 17%|█▋        | 64730/371472 [5:09:01<25:27:53,  3.35it/s]
 17%|█▋        | 64731/371472 [5:09:01<25:59:48,  3.28it/s]
 17%|█▋        | 64732/371472 [5:09:01<24:54:17,  3.42it/s]
 17%|█▋        | 64733/371472 [5:09:02<25:36:37,  3.33it/s]
 17%|█▋        | 64734/371472 [5:09:02<24:03:25,  3.54it/s]
 17%|█▋        | 64735/371472 [5:09:02<24:08:17,  3.53it/s]
 17%|█▋        | 64736/371472 [5:09:02<25:01:54,  3.40it/s]
 17%|█▋        | 64737/371472 [5:09:03<24:15:06,  3.51it/s]
 17%|█▋        | 64738/371472 [5:09:03<23:31:05,  3.62it/s]
 17%|█▋        | 64739/371472 [5:09:03<23:14:44,  3.67it/s]
 17%|█▋        | 64740/371472 [5:09:04<25:05:17,  3.40it/s]
                                                           
{'loss': 4.026, 'learning_rate': 8.435486651296084e-07, 'epoch': 2.79}

 17%|█▋        | 64740/371472 [5:09:04<25:05:17,  3.40it/s]
 17%|█▋        | 64741/371472 [5:09:04<26:52:28,  3.17it/s]
 17%|█▋        | 64742/371472 [5:09:04<25:49:06,  3.30it/s]
 17%|█▋        | 64743/371472 [5:09:04<24:31:36,  3.47it/s]
 17%|█▋        | 64744/371472 [5:09:05<23:55:52,  3.56it/s]
 17%|█▋        | 64745/371472 [5:09:05<23:30:21,  3.62it/s]
 17%|█▋        | 64746/371472 [5:09:05<23:22:56,  3.64it/s]
 17%|█▋        | 64747/371472 [5:09:06<22:52:41,  3.72it/s]
 17%|█▋        | 64748/371472 [5:09:06<24:18:43,  3.50it/s]
 17%|█▋        | 64749/371472 [5:09:06<23:42:15,  3.59it/s]
 17%|█▋        | 64750/371472 [5:09:06<23:54:34,  3.56it/s]
 17%|█▋        | 64751/371472 [5:09:07<25:49:41,  3.30it/s]
 17%|█▋        | 64752/371472 [5:09:07<25:10:49,  3.38it/s]
 17%|█▋        | 64753/371472 [5:09:07<24:31:15,  3.47it/s]
 17%|█▋        | 64754/371472 [5:09:08<24:16:52,  3.51it/s]
 17%|█▋        | 64755/371472 [5:09:08<25:04:22,  3.40it/s]
 17%|█▋        | 64756/371472 [5:09:08<24:31:25,  3.47it/s]
 17%|█▋        | 64757/371472 [5:09:08<24:05:05,  3.54it/s]
 17%|█▋        | 64758/371472 [5:09:09<24:26:16,  3.49it/s]
 17%|█▋        | 64759/371472 [5:09:09<23:54:01,  3.56it/s]
 17%|█▋        | 64760/371472 [5:09:09<24:30:54,  3.48it/s]
                                                           
{'loss': 4.2457, 'learning_rate': 8.435001831541296e-07, 'epoch': 2.79}

 17%|█▋        | 64760/371472 [5:09:09<24:30:54,  3.48it/s]
 17%|█▋        | 64761/371472 [5:09:10<23:39:01,  3.60it/s]
 17%|█▋        | 64762/371472 [5:09:10<23:19:44,  3.65it/s]
 17%|█▋        | 64763/371472 [5:09:10<22:32:30,  3.78it/s]
 17%|█▋        | 64764/371472 [5:09:10<21:59:52,  3.87it/s]
 17%|█▋        | 64765/371472 [5:09:11<22:02:25,  3.87it/s]
 17%|█▋        | 64766/371472 [5:09:11<22:46:24,  3.74it/s]
 17%|█▋        | 64767/371472 [5:09:11<22:03:00,  3.86it/s]
 17%|█▋        | 64768/371472 [5:09:11<21:56:43,  3.88it/s]
 17%|█▋        | 64769/371472 [5:09:12<22:41:30,  3.75it/s]
 17%|█▋        | 64770/371472 [5:09:12<23:21:48,  3.65it/s]
 17%|█▋        | 64771/371472 [5:09:12<22:45:48,  3.74it/s]
 17%|█▋        | 64772/371472 [5:09:12<22:44:09,  3.75it/s]
 17%|█▋        | 64773/371472 [5:09:13<22:19:35,  3.82it/s]
 17%|█▋        | 64774/371472 [5:09:13<22:15:03,  3.83it/s]
 17%|█▋        | 64775/371472 [5:09:13<22:26:40,  3.80it/s]
 17%|█▋        | 64776/371472 [5:09:14<24:35:23,  3.46it/s]
 17%|█▋        | 64777/371472 [5:09:14<24:22:18,  3.50it/s]
 17%|█▋        | 64778/371472 [5:09:14<24:55:27,  3.42it/s]
 17%|█▋        | 64779/371472 [5:09:14<25:10:13,  3.38it/s]
 17%|█▋        | 64780/371472 [5:09:15<26:08:24,  3.26it/s]
                                                           
{'loss': 4.2927, 'learning_rate': 8.434517011786507e-07, 'epoch': 2.79}

 17%|█▋        | 64780/371472 [5:09:15<26:08:24,  3.26it/s]
 17%|█▋        | 64781/371472 [5:09:15<24:33:26,  3.47it/s]
 17%|█▋        | 64782/371472 [5:09:15<24:17:28,  3.51it/s]
 17%|█▋        | 64783/371472 [5:09:16<24:24:35,  3.49it/s]
 17%|█▋        | 64784/371472 [5:09:16<24:41:55,  3.45it/s]
 17%|█▋        | 64785/371472 [5:09:16<24:26:22,  3.49it/s]
 17%|█▋        | 64786/371472 [5:09:16<24:08:43,  3.53it/s]
 17%|█▋        | 64787/371472 [5:09:17<23:01:47,  3.70it/s]
 17%|█▋        | 64788/371472 [5:09:17<24:01:20,  3.55it/s]
 17%|█▋        | 64789/371472 [5:09:17<22:55:04,  3.72it/s]
 17%|█▋        | 64790/371472 [5:09:18<23:16:51,  3.66it/s]
 17%|█▋        | 64791/371472 [5:09:18<23:01:11,  3.70it/s]
 17%|█▋        | 64792/371472 [5:09:18<22:38:32,  3.76it/s]
 17%|█▋        | 64793/371472 [5:09:18<23:30:42,  3.62it/s]
 17%|█▋        | 64794/371472 [5:09:19<23:15:21,  3.66it/s]
 17%|█▋        | 64795/371472 [5:09:19<24:36:00,  3.46it/s]
 17%|█▋        | 64796/371472 [5:09:19<24:09:43,  3.53it/s]
 17%|█▋        | 64797/371472 [5:09:20<25:02:49,  3.40it/s]
 17%|█▋        | 64798/371472 [5:09:20<25:08:18,  3.39it/s]
 17%|█▋        | 64799/371472 [5:09:20<27:59:23,  3.04it/s]
 17%|█▋        | 64800/371472 [5:09:20<26:17:44,  3.24it/s]
                                                           
{'loss': 4.2799, 'learning_rate': 8.434032192031717e-07, 'epoch': 2.79}

 17%|█▋        | 64800/371472 [5:09:21<26:17:44,  3.24it/s]
 17%|█▋        | 64801/371472 [5:09:21<25:01:08,  3.40it/s]
 17%|█▋        | 64802/371472 [5:09:21<26:22:35,  3.23it/s]
 17%|█▋        | 64803/371472 [5:09:21<25:20:53,  3.36it/s]
 17%|█▋        | 64804/371472 [5:09:22<24:45:21,  3.44it/s]
 17%|█▋        | 64805/371472 [5:09:22<24:10:27,  3.52it/s]
 17%|█▋        | 64806/371472 [5:09:22<25:04:13,  3.40it/s]
 17%|█▋        | 64807/371472 [5:09:23<24:51:55,  3.43it/s]
 17%|█▋        | 64808/371472 [5:09:23<24:00:17,  3.55it/s]
 17%|█▋        | 64809/371472 [5:09:23<23:37:19,  3.61it/s]
 17%|█▋        | 64810/371472 [5:09:23<23:50:40,  3.57it/s]
 17%|█▋        | 64811/371472 [5:09:24<24:08:43,  3.53it/s]
 17%|█▋        | 64812/371472 [5:09:24<23:47:34,  3.58it/s]
 17%|█▋        | 64813/371472 [5:09:24<23:45:23,  3.59it/s]
 17%|█▋        | 64814/371472 [5:09:24<23:06:03,  3.69it/s]
 17%|█▋        | 64815/371472 [5:09:25<23:05:00,  3.69it/s]
 17%|█▋        | 64816/371472 [5:09:25<23:48:23,  3.58it/s]
 17%|█▋        | 64817/371472 [5:09:25<24:09:43,  3.53it/s]
 17%|█▋        | 64818/371472 [5:09:26<24:27:34,  3.48it/s]
 17%|█▋        | 64819/371472 [5:09:26<25:13:23,  3.38it/s]
 17%|█▋        | 64820/371472 [5:09:26<25:56:49,  3.28it/s]
                                                           
{'loss': 4.1319, 'learning_rate': 8.433547372276928e-07, 'epoch': 2.79}

 17%|█▋        | 64820/371472 [5:09:26<25:56:49,  3.28it/s]
 17%|█▋        | 64821/371472 [5:09:27<25:21:53,  3.36it/s]
 17%|█▋        | 64822/371472 [5:09:27<24:10:17,  3.52it/s]
 17%|█▋        | 64823/371472 [5:09:27<24:37:13,  3.46it/s]
 17%|█▋        | 64824/371472 [5:09:27<24:09:02,  3.53it/s]
 17%|█▋        | 64825/371472 [5:09:28<23:51:34,  3.57it/s]
 17%|█▋        | 64826/371472 [5:09:28<23:01:47,  3.70it/s]
 17%|█▋        | 64827/371472 [5:09:28<23:00:55,  3.70it/s]
 17%|█▋        | 64828/371472 [5:09:28<22:41:18,  3.75it/s]
 17%|█▋        | 64829/371472 [5:09:29<22:22:20,  3.81it/s]
 17%|█▋        | 64830/371472 [5:09:29<23:36:49,  3.61it/s]
 17%|█▋        | 64831/371472 [5:09:29<23:19:32,  3.65it/s]
 17%|█▋        | 64832/371472 [5:09:29<22:23:20,  3.80it/s]
 17%|█▋        | 64833/371472 [5:09:30<22:35:48,  3.77it/s]
 17%|█▋        | 64834/371472 [5:09:30<22:47:48,  3.74it/s]
 17%|█▋        | 64835/371472 [5:09:30<24:45:14,  3.44it/s]
 17%|█▋        | 64836/371472 [5:09:31<24:32:24,  3.47it/s]
 17%|█▋        | 64837/371472 [5:09:31<23:41:30,  3.60it/s]
 17%|█▋        | 64838/371472 [5:09:31<23:25:59,  3.63it/s]
 17%|█▋        | 64839/371472 [5:09:31<23:24:23,  3.64it/s]
 17%|█▋        | 64840/371472 [5:09:32<27:57:30,  3.05it/s]
                                                           
{'loss': 4.1158, 'learning_rate': 8.43306255252214e-07, 'epoch': 2.79}

 17%|█▋        | 64840/371472 [5:09:32<27:57:30,  3.05it/s]
 17%|█▋        | 64841/371472 [5:09:32<27:01:18,  3.15it/s]
 17%|█▋        | 64842/371472 [5:09:32<26:59:51,  3.15it/s]
 17%|█▋        | 64843/371472 [5:09:33<25:57:09,  3.28it/s]
 17%|█▋        | 64844/371472 [5:09:33<24:45:52,  3.44it/s]
 17%|█▋        | 64845/371472 [5:09:33<24:50:43,  3.43it/s]
 17%|█▋        | 64846/371472 [5:09:34<23:44:33,  3.59it/s]
 17%|█▋        | 64847/371472 [5:09:34<23:39:36,  3.60it/s]
 17%|█▋        | 64848/371472 [5:09:34<23:10:33,  3.68it/s]
 17%|█▋        | 64849/371472 [5:09:34<25:20:54,  3.36it/s]
 17%|█▋        | 64850/371472 [5:09:35<24:40:35,  3.45it/s]
 17%|█▋        | 64851/371472 [5:09:35<24:12:04,  3.52it/s]
 17%|█▋        | 64852/371472 [5:09:35<24:01:33,  3.54it/s]
 17%|█▋        | 64853/371472 [5:09:36<25:08:03,  3.39it/s]
 17%|█▋        | 64854/371472 [5:09:36<23:52:10,  3.57it/s]
 17%|█▋        | 64855/371472 [5:09:36<24:50:40,  3.43it/s]
 17%|█▋        | 64856/371472 [5:09:36<24:24:27,  3.49it/s]
 17%|█▋        | 64857/371472 [5:09:37<25:39:08,  3.32it/s]
 17%|█▋        | 64858/371472 [5:09:37<25:51:26,  3.29it/s]
 17%|█▋        | 64859/371472 [5:09:37<24:50:01,  3.43it/s]
 17%|█▋        | 64860/371472 [5:09:38<23:13:03,  3.67it/s]
                                                           
{'loss': 4.2568, 'learning_rate': 8.432577732767352e-07, 'epoch': 2.79}

 17%|█▋        | 64860/371472 [5:09:38<23:13:03,  3.67it/s]
 17%|█▋        | 64861/371472 [5:09:38<22:41:35,  3.75it/s]
 17%|█▋        | 64862/371472 [5:09:38<24:02:13,  3.54it/s]
 17%|█▋        | 64863/371472 [5:09:38<24:21:28,  3.50it/s]
 17%|█▋        | 64864/371472 [5:09:39<25:30:16,  3.34it/s]
 17%|█▋        | 64865/371472 [5:09:39<24:57:48,  3.41it/s]
 17%|█▋        | 64866/371472 [5:09:39<24:12:03,  3.52it/s]
 17%|█▋        | 64867/371472 [5:09:40<23:33:28,  3.62it/s]
 17%|█▋        | 64868/371472 [5:09:40<24:16:23,  3.51it/s]
 17%|█▋        | 64869/371472 [5:09:40<23:30:19,  3.62it/s]
 17%|█▋        | 64870/371472 [5:09:40<24:12:11,  3.52it/s]
 17%|█▋        | 64871/371472 [5:09:41<23:46:16,  3.58it/s]
 17%|█▋        | 64872/371472 [5:09:41<23:50:02,  3.57it/s]
 17%|█▋        | 64873/371472 [5:09:41<23:01:32,  3.70it/s]
 17%|█▋        | 64874/371472 [5:09:41<22:41:34,  3.75it/s]
 17%|█▋        | 64875/371472 [5:09:42<23:51:57,  3.57it/s]
 17%|█▋        | 64876/371472 [5:09:42<23:26:29,  3.63it/s]
 17%|█▋        | 64877/371472 [5:09:42<23:02:03,  3.70it/s]
 17%|█▋        | 64878/371472 [5:09:43<22:30:24,  3.78it/s]
 17%|█▋        | 64879/371472 [5:09:43<23:16:08,  3.66it/s]
 17%|█▋        | 64880/371472 [5:09:43<23:38:28,  3.60it/s]
                                                           
{'loss': 4.2391, 'learning_rate': 8.432092913012562e-07, 'epoch': 2.79}

 17%|█▋        | 64880/371472 [5:09:43<23:38:28,  3.60it/s]
 17%|█▋        | 64881/371472 [5:09:43<22:55:50,  3.71it/s]
 17%|█▋        | 64882/371472 [5:09:44<24:18:05,  3.50it/s]
 17%|█▋        | 64883/371472 [5:09:44<24:07:06,  3.53it/s]
 17%|█▋        | 64884/371472 [5:09:44<23:13:39,  3.67it/s]
 17%|█▋        | 64885/371472 [5:09:45<23:55:37,  3.56it/s]
 17%|█▋        | 64886/371472 [5:09:45<22:40:44,  3.76it/s]
 17%|█▋        | 64887/371472 [5:09:45<22:05:24,  3.86it/s]
 17%|█▋        | 64888/371472 [5:09:45<22:29:33,  3.79it/s]
 17%|█▋        | 64889/371472 [5:09:46<22:38:08,  3.76it/s]
 17%|█▋        | 64890/371472 [5:09:46<23:00:02,  3.70it/s]
 17%|█▋        | 64891/371472 [5:09:46<22:51:45,  3.72it/s]
 17%|█▋        | 64892/371472 [5:09:46<22:34:50,  3.77it/s]
 17%|█▋        | 64893/371472 [5:09:47<23:52:27,  3.57it/s]
 17%|█▋        | 64894/371472 [5:09:47<23:24:40,  3.64it/s]
 17%|█▋        | 64895/371472 [5:09:47<23:51:02,  3.57it/s]
 17%|█▋        | 64896/371472 [5:09:48<23:57:22,  3.55it/s]
 17%|█▋        | 64897/371472 [5:09:48<23:53:42,  3.56it/s]
 17%|█▋        | 64898/371472 [5:09:48<23:41:03,  3.60it/s]
 17%|█▋        | 64899/371472 [5:09:48<24:14:15,  3.51it/s]
 17%|█▋        | 64900/371472 [5:09:49<24:36:15,  3.46it/s]
                                                           
{'loss': 4.167, 'learning_rate': 8.431608093257772e-07, 'epoch': 2.8}

 17%|█▋        | 64900/371472 [5:09:49<24:36:15,  3.46it/s]
 17%|█▋        | 64901/371472 [5:09:49<24:12:15,  3.52it/s]
 17%|█▋        | 64902/371472 [5:09:49<24:49:01,  3.43it/s]
 17%|█▋        | 64903/371472 [5:09:50<24:41:43,  3.45it/s]
 17%|█▋        | 64904/371472 [5:09:50<24:40:29,  3.45it/s]
 17%|█▋        | 64905/371472 [5:09:50<24:17:33,  3.51it/s]
 17%|█▋        | 64906/371472 [5:09:50<23:41:06,  3.60it/s]
 17%|█▋        | 64907/371472 [5:09:51<25:22:39,  3.36it/s]
 17%|█▋        | 64908/371472 [5:09:51<24:19:32,  3.50it/s]
 17%|█▋        | 64909/371472 [5:09:51<23:11:49,  3.67it/s]
 17%|█▋        | 64910/371472 [5:09:51<22:25:02,  3.80it/s]
 17%|█▋        | 64911/371472 [5:09:52<22:08:30,  3.85it/s]
 17%|█▋        | 64912/371472 [5:09:52<21:54:34,  3.89it/s]
 17%|█▋        | 64913/371472 [5:09:52<23:07:48,  3.68it/s]
 17%|█▋        | 64914/371472 [5:09:53<23:16:54,  3.66it/s]
 17%|█▋        | 64915/371472 [5:09:53<26:56:43,  3.16it/s]
 17%|█▋        | 64916/371472 [5:09:53<24:44:42,  3.44it/s]
 17%|█▋        | 64917/371472 [5:09:53<24:00:34,  3.55it/s]
 17%|█▋        | 64918/371472 [5:09:54<23:05:28,  3.69it/s]
 17%|█▋        | 64919/371472 [5:09:54<25:04:24,  3.40it/s]
 17%|█▋        | 64920/371472 [5:09:54<25:46:05,  3.30it/s]
                                                           
{'loss': 4.2472, 'learning_rate': 8.431123273502984e-07, 'epoch': 2.8}

 17%|█▋        | 64920/371472 [5:09:54<25:46:05,  3.30it/s]
 17%|█▋        | 64921/371472 [5:09:55<28:06:18,  3.03it/s]
 17%|█▋        | 64922/371472 [5:09:55<26:01:12,  3.27it/s]
 17%|█▋        | 64923/371472 [5:09:55<25:21:38,  3.36it/s]
 17%|█▋        | 64924/371472 [5:09:56<24:37:29,  3.46it/s]
 17%|█▋        | 64925/371472 [5:09:56<23:33:40,  3.61it/s]
 17%|█▋        | 64926/371472 [5:09:56<23:09:36,  3.68it/s]
 17%|█▋        | 64927/371472 [5:09:56<22:57:52,  3.71it/s]
 17%|█▋        | 64928/371472 [5:09:57<22:52:20,  3.72it/s]
 17%|█▋        | 64929/371472 [5:09:57<23:21:12,  3.65it/s]
 17%|█▋        | 64930/371472 [5:09:57<22:42:54,  3.75it/s]
 17%|█▋        | 64931/371472 [5:09:57<21:59:07,  3.87it/s]
 17%|█▋        | 64932/371472 [5:09:58<23:16:24,  3.66it/s]
 17%|█▋        | 64933/371472 [5:09:58<22:29:49,  3.78it/s]
 17%|█▋        | 64934/371472 [5:09:58<22:18:26,  3.82it/s]
 17%|█▋        | 64935/371472 [5:09:58<22:44:01,  3.75it/s]
 17%|█▋        | 64936/371472 [5:09:59<22:28:17,  3.79it/s]
 17%|█▋        | 64937/371472 [5:09:59<23:03:36,  3.69it/s]
 17%|█▋        | 64938/371472 [5:09:59<24:31:26,  3.47it/s]
 17%|█▋        | 64939/371472 [5:10:00<25:45:57,  3.30it/s]
 17%|█▋        | 64940/371472 [5:10:00<25:54:34,  3.29it/s]
                                                           
{'loss': 4.1453, 'learning_rate': 8.430638453748195e-07, 'epoch': 2.8}

 17%|█▋        | 64940/371472 [5:10:00<25:54:34,  3.29it/s]
 17%|█▋        | 64941/371472 [5:10:00<26:11:23,  3.25it/s]
 17%|█▋        | 64942/371472 [5:10:01<25:21:02,  3.36it/s]
 17%|█▋        | 64943/371472 [5:10:01<25:05:37,  3.39it/s]
 17%|█▋        | 64944/371472 [5:10:01<24:14:04,  3.51it/s]
 17%|█▋        | 64945/371472 [5:10:02<27:08:31,  3.14it/s]
 17%|█▋        | 64946/371472 [5:10:02<25:09:06,  3.39it/s]
 17%|█▋        | 64947/371472 [5:10:02<23:58:39,  3.55it/s]
 17%|█▋        | 64948/371472 [5:10:02<24:55:03,  3.42it/s]
 17%|█▋        | 64949/371472 [5:10:03<24:29:22,  3.48it/s]
 17%|█▋        | 64950/371472 [5:10:03<24:57:44,  3.41it/s]
 17%|█▋        | 64951/371472 [5:10:03<25:49:28,  3.30it/s]
 17%|█▋        | 64952/371472 [5:10:03<24:39:24,  3.45it/s]
 17%|█▋        | 64953/371472 [5:10:04<23:41:58,  3.59it/s]
 17%|█▋        | 64954/371472 [5:10:04<23:07:54,  3.68it/s]
 17%|█▋        | 64955/371472 [5:10:04<22:52:52,  3.72it/s]
 17%|█▋        | 64956/371472 [5:10:05<22:29:56,  3.78it/s]
 17%|█▋        | 64957/371472 [5:10:05<22:41:34,  3.75it/s]
 17%|█▋        | 64958/371472 [5:10:05<22:32:31,  3.78it/s]
 17%|█▋        | 64959/371472 [5:10:05<24:45:43,  3.44it/s]
 17%|█▋        | 64960/371472 [5:10:06<24:46:32,  3.44it/s]
                                                           
{'loss': 4.0949, 'learning_rate': 8.430153633993406e-07, 'epoch': 2.8}

 17%|█▋        | 64960/371472 [5:10:06<24:46:32,  3.44it/s]
 17%|█▋        | 64961/371472 [5:10:06<24:33:58,  3.47it/s]
 17%|█▋        | 64962/371472 [5:10:06<23:47:34,  3.58it/s]
 17%|█▋        | 64963/371472 [5:10:07<24:38:08,  3.46it/s]
 17%|█▋        | 64964/371472 [5:10:07<23:18:32,  3.65it/s]
 17%|█▋        | 64965/371472 [5:10:07<22:58:19,  3.71it/s]
 17%|█▋        | 64966/371472 [5:10:07<22:37:41,  3.76it/s]
 17%|█▋        | 64967/371472 [5:10:08<22:48:56,  3.73it/s]
 17%|█▋        | 64968/371472 [5:10:08<25:00:09,  3.41it/s]
 17%|█▋        | 64969/371472 [5:10:08<24:13:16,  3.52it/s]
 17%|█▋        | 64970/371472 [5:10:09<27:12:26,  3.13it/s]
 17%|█▋        | 64971/371472 [5:10:09<26:14:19,  3.24it/s]
 17%|█▋        | 64972/371472 [5:10:09<25:39:21,  3.32it/s]
 17%|█▋        | 64973/371472 [5:10:09<24:32:10,  3.47it/s]
 17%|█▋        | 64974/371472 [5:10:10<26:04:20,  3.27it/s]
 17%|█▋        | 64975/371472 [5:10:10<24:16:14,  3.51it/s]
 17%|█▋        | 64976/371472 [5:10:10<24:23:20,  3.49it/s]
 17%|█▋        | 64977/371472 [5:10:11<24:19:35,  3.50it/s]
 17%|█▋        | 64978/371472 [5:10:11<23:49:41,  3.57it/s]
 17%|█▋        | 64979/371472 [5:10:11<23:27:04,  3.63it/s]
 17%|█▋        | 64980/371472 [5:10:11<23:21:17,  3.65it/s]
                                                           
{'loss': 4.1396, 'learning_rate': 8.429668814238617e-07, 'epoch': 2.8}

 17%|█▋        | 64980/371472 [5:10:11<23:21:17,  3.65it/s]
 17%|█▋        | 64981/371472 [5:10:12<23:31:48,  3.62it/s]
 17%|█▋        | 64982/371472 [5:10:12<24:39:06,  3.45it/s]
 17%|█▋        | 64983/371472 [5:10:12<24:23:35,  3.49it/s]
 17%|█▋        | 64984/371472 [5:10:13<25:03:52,  3.40it/s]
 17%|█▋        | 64985/371472 [5:10:13<24:33:51,  3.47it/s]
 17%|█▋        | 64986/371472 [5:10:13<24:40:18,  3.45it/s]
 17%|█▋        | 64987/371472 [5:10:13<24:08:53,  3.53it/s]
 17%|█▋        | 64988/371472 [5:10:14<23:05:22,  3.69it/s]
 17%|█▋        | 64989/371472 [5:10:14<23:23:11,  3.64it/s]
 17%|█▋        | 64990/371472 [5:10:14<25:19:59,  3.36it/s]
 17%|█▋        | 64991/371472 [5:10:15<23:55:13,  3.56it/s]
 17%|█▋        | 64992/371472 [5:10:15<23:44:05,  3.59it/s]
 17%|█▋        | 64993/371472 [5:10:15<22:51:50,  3.72it/s]
 17%|█▋        | 64994/371472 [5:10:15<23:24:55,  3.64it/s]
 17%|█▋        | 64995/371472 [5:10:16<22:49:58,  3.73it/s]
 17%|█▋        | 64996/371472 [5:10:16<29:04:28,  2.93it/s]
 17%|█▋        | 64997/371472 [5:10:16<27:17:37,  3.12it/s]
 17%|█▋        | 64998/371472 [5:10:17<25:36:31,  3.32it/s]
 17%|█▋        | 64999/371472 [5:10:17<24:41:40,  3.45it/s]
 17%|█▋        | 65000/371472 [5:10:17<23:23:16,  3.64it/s]
                                                           
{'loss': 4.0352, 'learning_rate': 8.429183994483829e-07, 'epoch': 2.8}

 17%|█▋        | 65000/371472 [5:10:17<23:23:16,  3.64it/s]
 17%|█▋        | 65001/371472 [5:10:17<22:34:45,  3.77it/s]
 17%|█▋        | 65002/371472 [5:10:18<22:59:00,  3.70it/s]
 17%|█▋        | 65003/371472 [5:10:18<23:02:37,  3.69it/s]
 17%|█▋        | 65004/371472 [5:10:18<24:01:38,  3.54it/s]
 17%|█▋        | 65005/371472 [5:10:18<23:05:56,  3.69it/s]
 17%|█▋        | 65006/371472 [5:10:19<23:12:32,  3.67it/s]
 17%|█▋        | 65007/371472 [5:10:19<22:58:43,  3.70it/s]
 18%|█▊        | 65008/371472 [5:10:19<23:02:12,  3.70it/s]
 18%|█▊        | 65009/371472 [5:10:20<23:02:58,  3.69it/s]
 18%|█▊        | 65010/371472 [5:10:20<23:25:30,  3.63it/s]
 18%|█▊        | 65011/371472 [5:10:20<22:54:43,  3.72it/s]
 18%|█▊        | 65012/371472 [5:10:20<23:06:50,  3.68it/s]
 18%|█▊        | 65013/371472 [5:10:21<24:00:47,  3.55it/s]
 18%|█▊        | 65014/371472 [5:10:21<24:25:46,  3.48it/s]
 18%|█▊        | 65015/371472 [5:10:21<23:39:36,  3.60it/s]
 18%|█▊        | 65016/371472 [5:10:21<22:26:59,  3.79it/s]
 18%|█▊        | 65017/371472 [5:10:22<24:04:03,  3.54it/s]
 18%|█▊        | 65018/371472 [5:10:22<24:55:58,  3.41it/s]
 18%|█▊        | 65019/371472 [5:10:22<24:38:03,  3.46it/s]
 18%|█▊        | 65020/371472 [5:10:23<23:54:27,  3.56it/s]
                                                           
{'loss': 4.0997, 'learning_rate': 8.428699174729039e-07, 'epoch': 2.8}

 18%|█▊        | 65020/371472 [5:10:23<23:54:27,  3.56it/s]
 18%|█▊        | 65021/371472 [5:10:23<24:25:56,  3.48it/s]
 18%|█▊        | 65022/371472 [5:10:23<25:28:04,  3.34it/s]
 18%|█▊        | 65023/371472 [5:10:24<25:26:42,  3.35it/s]
 18%|█▊        | 65024/371472 [5:10:24<24:35:24,  3.46it/s]
 18%|█▊        | 65025/371472 [5:10:24<23:34:54,  3.61it/s]
 18%|█▊        | 65026/371472 [5:10:24<24:15:15,  3.51it/s]
 18%|█▊        | 65027/371472 [5:10:25<23:14:30,  3.66it/s]
 18%|█▊        | 65028/371472 [5:10:25<23:29:52,  3.62it/s]
 18%|█▊        | 65029/371472 [5:10:25<22:55:12,  3.71it/s]
 18%|█▊        | 65030/371472 [5:10:25<23:27:27,  3.63it/s]
 18%|█▊        | 65031/371472 [5:10:26<22:43:01,  3.75it/s]
 18%|█▊        | 65032/371472 [5:10:26<22:11:17,  3.84it/s]
 18%|█▊        | 65033/371472 [5:10:26<23:32:26,  3.62it/s]
 18%|█▊        | 65034/371472 [5:10:27<22:47:28,  3.73it/s]
 18%|█▊        | 65035/371472 [5:10:27<22:38:35,  3.76it/s]
 18%|█▊        | 65036/371472 [5:10:27<23:07:44,  3.68it/s]
 18%|█▊        | 65037/371472 [5:10:27<22:35:57,  3.77it/s]
 18%|█▊        | 65038/371472 [5:10:28<23:48:18,  3.58it/s]
 18%|█▊        | 65039/371472 [5:10:28<23:19:27,  3.65it/s]
 18%|█▊        | 65040/371472 [5:10:28<23:27:42,  3.63it/s]
                                                           
{'loss': 4.2631, 'learning_rate': 8.42821435497425e-07, 'epoch': 2.8}

 18%|█▊        | 65040/371472 [5:10:28<23:27:42,  3.63it/s]
 18%|█▊        | 65041/371472 [5:10:28<23:02:48,  3.69it/s]
 18%|█▊        | 65042/371472 [5:10:29<23:46:38,  3.58it/s]
 18%|█▊        | 65043/371472 [5:10:29<23:20:20,  3.65it/s]
 18%|█▊        | 65044/371472 [5:10:29<24:56:13,  3.41it/s]
 18%|█▊        | 65045/371472 [5:10:30<24:13:02,  3.51it/s]
 18%|█▊        | 65046/371472 [5:10:30<24:17:58,  3.50it/s]
 18%|█▊        | 65047/371472 [5:10:30<23:33:11,  3.61it/s]
 18%|█▊        | 65048/371472 [5:10:30<23:53:09,  3.56it/s]
 18%|█▊        | 65049/371472 [5:10:31<23:39:23,  3.60it/s]
 18%|█▊        | 65050/371472 [5:10:31<23:54:10,  3.56it/s]
 18%|█▊        | 65051/371472 [5:10:31<24:12:45,  3.52it/s]
 18%|█▊        | 65052/371472 [5:10:32<24:11:09,  3.52it/s]
 18%|█▊        | 65053/371472 [5:10:32<23:37:19,  3.60it/s]
 18%|█▊        | 65054/371472 [5:10:32<23:50:27,  3.57it/s]
 18%|█▊        | 65055/371472 [5:10:32<23:23:55,  3.64it/s]
 18%|█▊        | 65056/371472 [5:10:33<22:40:12,  3.75it/s]
 18%|█▊        | 65057/371472 [5:10:33<22:07:14,  3.85it/s]
 18%|█▊        | 65058/371472 [5:10:33<22:05:08,  3.85it/s]
 18%|█▊        | 65059/371472 [5:10:33<24:05:59,  3.53it/s]
 18%|█▊        | 65060/371472 [5:10:34<24:07:05,  3.53it/s]
                                                           
{'loss': 4.198, 'learning_rate': 8.427729535219461e-07, 'epoch': 2.8}

 18%|█▊        | 65060/371472 [5:10:34<24:07:05,  3.53it/s]
 18%|█▊        | 65061/371472 [5:10:34<24:29:19,  3.48it/s]
 18%|█▊        | 65062/371472 [5:10:34<23:50:23,  3.57it/s]
 18%|█▊        | 65063/371472 [5:10:35<23:39:32,  3.60it/s]
 18%|█▊        | 65064/371472 [5:10:35<24:18:28,  3.50it/s]
 18%|█▊        | 65065/371472 [5:10:35<23:57:37,  3.55it/s]
 18%|█▊        | 65066/371472 [5:10:35<22:57:37,  3.71it/s]
 18%|█▊        | 65067/371472 [5:10:36<22:29:44,  3.78it/s]
 18%|█▊        | 65068/371472 [5:10:36<22:43:26,  3.75it/s]
 18%|█▊        | 65069/371472 [5:10:36<23:22:58,  3.64it/s]
 18%|█▊        | 65070/371472 [5:10:37<23:42:17,  3.59it/s]
 18%|█▊        | 65071/371472 [5:10:37<22:41:36,  3.75it/s]
 18%|█▊        | 65072/371472 [5:10:37<22:20:39,  3.81it/s]
 18%|█▊        | 65073/371472 [5:10:37<22:54:47,  3.71it/s]
 18%|█▊        | 65074/371472 [5:10:38<23:23:24,  3.64it/s]
 18%|█▊        | 65075/371472 [5:10:38<22:45:39,  3.74it/s]
 18%|█▊        | 65076/371472 [5:10:38<23:04:03,  3.69it/s]
 18%|█▊        | 65077/371472 [5:10:38<25:58:31,  3.28it/s]
 18%|█▊        | 65078/371472 [5:10:39<24:31:53,  3.47it/s]
 18%|█▊        | 65079/371472 [5:10:39<23:49:18,  3.57it/s]
 18%|█▊        | 65080/371472 [5:10:39<23:51:26,  3.57it/s]
                                                           
{'loss': 4.3659, 'learning_rate': 8.427244715464673e-07, 'epoch': 2.8}

 18%|█▊        | 65080/371472 [5:10:39<23:51:26,  3.57it/s]
 18%|█▊        | 65081/371472 [5:10:40<24:55:52,  3.41it/s]
 18%|█▊        | 65082/371472 [5:10:40<24:19:41,  3.50it/s]
 18%|█▊        | 65083/371472 [5:10:40<24:18:15,  3.50it/s]
 18%|█▊        | 65084/371472 [5:10:40<23:20:42,  3.65it/s]
 18%|█▊        | 65085/371472 [5:10:41<23:17:13,  3.65it/s]
 18%|█▊        | 65086/371472 [5:10:41<23:05:58,  3.68it/s]
 18%|█▊        | 65087/371472 [5:10:41<24:32:21,  3.47it/s]
 18%|█▊        | 65088/371472 [5:10:42<23:50:30,  3.57it/s]
 18%|█▊        | 65089/371472 [5:10:42<24:44:07,  3.44it/s]
 18%|█▊        | 65090/371472 [5:10:42<24:10:46,  3.52it/s]
 18%|█▊        | 65091/371472 [5:10:42<23:35:42,  3.61it/s]
 18%|█▊        | 65092/371472 [5:10:43<23:32:31,  3.62it/s]
 18%|█▊        | 65093/371472 [5:10:43<22:42:18,  3.75it/s]
 18%|█▊        | 65094/371472 [5:10:43<22:53:54,  3.72it/s]
 18%|█▊        | 65095/371472 [5:10:43<23:25:40,  3.63it/s]
 18%|█▊        | 65096/371472 [5:10:44<23:18:39,  3.65it/s]
 18%|█▊        | 65097/371472 [5:10:44<23:39:07,  3.60it/s]
 18%|█▊        | 65098/371472 [5:10:44<23:14:24,  3.66it/s]
 18%|█▊        | 65099/371472 [5:10:45<23:31:53,  3.62it/s]
 18%|█▊        | 65100/371472 [5:10:45<23:33:59,  3.61it/s]
                                                           
{'loss': 3.993, 'learning_rate': 8.426759895709883e-07, 'epoch': 2.8}

 18%|█▊        | 65100/371472 [5:10:45<23:33:59,  3.61it/s]
 18%|█▊        | 65101/371472 [5:10:45<27:16:12,  3.12it/s]
 18%|█▊        | 65102/371472 [5:10:46<28:23:06,  3.00it/s]
 18%|█▊        | 65103/371472 [5:10:46<26:24:47,  3.22it/s]
 18%|█▊        | 65104/371472 [5:10:46<25:16:16,  3.37it/s]
 18%|█▊        | 65105/371472 [5:10:46<23:58:34,  3.55it/s]
 18%|█▊        | 65106/371472 [5:10:47<23:41:40,  3.59it/s]
 18%|█▊        | 65107/371472 [5:10:47<24:41:58,  3.45it/s]
 18%|█▊        | 65108/371472 [5:10:47<23:56:48,  3.55it/s]
 18%|█▊        | 65109/371472 [5:10:48<23:32:50,  3.61it/s]
 18%|█▊        | 65110/371472 [5:10:48<22:46:36,  3.74it/s]
 18%|█▊        | 65111/371472 [5:10:48<22:21:49,  3.81it/s]
 18%|█▊        | 65112/371472 [5:10:48<23:17:45,  3.65it/s]
 18%|█▊        | 65113/371472 [5:10:49<24:03:38,  3.54it/s]
 18%|█▊        | 65114/371472 [5:10:49<23:11:09,  3.67it/s]
 18%|█▊        | 65115/371472 [5:10:49<23:56:45,  3.55it/s]
 18%|█▊        | 65116/371472 [5:10:49<24:31:50,  3.47it/s]
 18%|█▊        | 65117/371472 [5:10:50<23:57:28,  3.55it/s]
 18%|█▊        | 65118/371472 [5:10:50<26:29:16,  3.21it/s]
 18%|█▊        | 65119/371472 [5:10:50<26:26:44,  3.22it/s]
 18%|█▊        | 65120/371472 [5:10:51<26:20:56,  3.23it/s]
                                                           
{'loss': 4.1925, 'learning_rate': 8.426275075955095e-07, 'epoch': 2.8}

 18%|█▊        | 65120/371472 [5:10:51<26:20:56,  3.23it/s]
 18%|█▊        | 65121/371472 [5:10:51<25:09:32,  3.38it/s]
 18%|█▊        | 65122/371472 [5:10:51<24:31:30,  3.47it/s]
 18%|█▊        | 65123/371472 [5:10:52<24:21:03,  3.49it/s]
 18%|█▊        | 65124/371472 [5:10:52<23:37:38,  3.60it/s]
 18%|█▊        | 65125/371472 [5:10:52<22:58:16,  3.70it/s]
 18%|█▊        | 65126/371472 [5:10:52<22:41:04,  3.75it/s]
 18%|█▊        | 65127/371472 [5:10:53<22:54:42,  3.71it/s]
 18%|█▊        | 65128/371472 [5:10:53<22:49:55,  3.73it/s]
 18%|█▊        | 65129/371472 [5:10:53<23:23:56,  3.64it/s]
 18%|█▊        | 65130/371472 [5:10:53<22:20:40,  3.81it/s]
 18%|█▊        | 65131/371472 [5:10:54<22:57:02,  3.71it/s]
 18%|█▊        | 65132/371472 [5:10:54<22:57:27,  3.71it/s]
 18%|█▊        | 65133/371472 [5:10:54<22:45:14,  3.74it/s]
 18%|█▊        | 65134/371472 [5:10:54<21:51:56,  3.89it/s]
 18%|█▊        | 65135/371472 [5:10:55<22:37:11,  3.76it/s]
 18%|█▊        | 65136/371472 [5:10:55<22:39:00,  3.76it/s]
 18%|█▊        | 65137/371472 [5:10:55<22:22:48,  3.80it/s]
 18%|█▊        | 65138/371472 [5:10:56<22:48:13,  3.73it/s]
 18%|█▊        | 65139/371472 [5:10:56<22:39:00,  3.76it/s]
 18%|█▊        | 65140/371472 [5:10:56<23:08:28,  3.68it/s]
                                                           
{'loss': 4.4249, 'learning_rate': 8.425790256200306e-07, 'epoch': 2.81}

 18%|█▊        | 65140/371472 [5:10:56<23:08:28,  3.68it/s]
 18%|█▊        | 65141/371472 [5:10:56<22:28:15,  3.79it/s]
 18%|█▊        | 65142/371472 [5:10:57<22:48:14,  3.73it/s]
 18%|█▊        | 65143/371472 [5:10:57<22:28:55,  3.78it/s]
 18%|█▊        | 65144/371472 [5:10:57<22:19:19,  3.81it/s]
 18%|█▊        | 65145/371472 [5:10:57<22:36:35,  3.76it/s]
 18%|█▊        | 65146/371472 [5:10:58<22:06:41,  3.85it/s]
 18%|█▊        | 65147/371472 [5:10:58<21:40:27,  3.93it/s]
 18%|█▊        | 65148/371472 [5:10:58<22:40:56,  3.75it/s]
 18%|█▊        | 65149/371472 [5:10:58<22:35:09,  3.77it/s]
 18%|█▊        | 65150/371472 [5:10:59<23:17:38,  3.65it/s]
 18%|█▊        | 65151/371472 [5:10:59<23:23:09,  3.64it/s]
 18%|█▊        | 65152/371472 [5:10:59<24:06:14,  3.53it/s]
 18%|█▊        | 65153/371472 [5:11:00<23:36:41,  3.60it/s]
 18%|█▊        | 65154/371472 [5:11:00<22:55:29,  3.71it/s]
 18%|█▊        | 65155/371472 [5:11:00<24:25:18,  3.48it/s]
 18%|█▊        | 65156/371472 [5:11:00<23:47:05,  3.58it/s]
 18%|█▊        | 65157/371472 [5:11:01<24:21:46,  3.49it/s]
 18%|█▊        | 65158/371472 [5:11:01<23:38:01,  3.60it/s]
 18%|█▊        | 65159/371472 [5:11:01<24:21:30,  3.49it/s]
 18%|█▊        | 65160/371472 [5:11:02<24:34:12,  3.46it/s]
                                                           
{'loss': 4.1671, 'learning_rate': 8.425305436445517e-07, 'epoch': 2.81}

 18%|█▊        | 65160/371472 [5:11:02<24:34:12,  3.46it/s]
 18%|█▊        | 65161/371472 [5:11:02<23:47:21,  3.58it/s]
 18%|█▊        | 65162/371472 [5:11:02<23:27:00,  3.63it/s]
 18%|█▊        | 65163/371472 [5:11:02<23:16:53,  3.65it/s]
 18%|█▊        | 65164/371472 [5:11:03<23:43:44,  3.59it/s]
 18%|█▊        | 65165/371472 [5:11:03<24:23:47,  3.49it/s]
 18%|█▊        | 65166/371472 [5:11:03<23:44:04,  3.58it/s]
 18%|█▊        | 65167/371472 [5:11:03<23:35:36,  3.61it/s]
 18%|█▊        | 65168/371472 [5:11:04<24:42:47,  3.44it/s]
 18%|█▊        | 65169/371472 [5:11:04<23:18:25,  3.65it/s]
 18%|█▊        | 65170/371472 [5:11:04<23:08:50,  3.68it/s]
 18%|█▊        | 65171/371472 [5:11:05<23:01:40,  3.69it/s]
 18%|█▊        | 65172/371472 [5:11:05<25:34:16,  3.33it/s]
 18%|█▊        | 65173/371472 [5:11:05<24:49:06,  3.43it/s]
 18%|█▊        | 65174/371472 [5:11:06<25:10:20,  3.38it/s]
 18%|█▊        | 65175/371472 [5:11:06<23:59:26,  3.55it/s]
 18%|█▊        | 65176/371472 [5:11:06<25:59:36,  3.27it/s]
 18%|█▊        | 65177/371472 [5:11:06<24:41:33,  3.45it/s]
 18%|█▊        | 65178/371472 [5:11:07<24:42:09,  3.44it/s]
 18%|█▊        | 65179/371472 [5:11:07<27:54:12,  3.05it/s]
 18%|█▊        | 65180/371472 [5:11:07<26:16:53,  3.24it/s]
                                                           
{'loss': 3.9986, 'learning_rate': 8.424820616690727e-07, 'epoch': 2.81}

 18%|█▊        | 65180/371472 [5:11:07<26:16:53,  3.24it/s]
 18%|█▊        | 65181/371472 [5:11:08<25:52:02,  3.29it/s]
 18%|█▊        | 65182/371472 [5:11:08<26:29:42,  3.21it/s]
 18%|█▊        | 65183/371472 [5:11:08<25:27:03,  3.34it/s]
 18%|█▊        | 65184/371472 [5:11:09<25:04:09,  3.39it/s]
 18%|█▊        | 65185/371472 [5:11:09<25:15:22,  3.37it/s]
 18%|█▊        | 65186/371472 [5:11:09<25:12:13,  3.38it/s]
 18%|█▊        | 65187/371472 [5:11:09<25:05:47,  3.39it/s]
 18%|█▊        | 65188/371472 [5:11:10<24:49:29,  3.43it/s]
 18%|█▊        | 65189/371472 [5:11:10<25:12:42,  3.37it/s]
 18%|█▊        | 65190/371472 [5:11:10<24:00:34,  3.54it/s]
 18%|█▊        | 65191/371472 [5:11:10<22:48:40,  3.73it/s]
 18%|█▊        | 65192/371472 [5:11:11<22:20:19,  3.81it/s]
 18%|█▊        | 65193/371472 [5:11:11<22:35:41,  3.77it/s]
 18%|█▊        | 65194/371472 [5:11:11<23:17:33,  3.65it/s]
 18%|█▊        | 65195/371472 [5:11:12<23:47:33,  3.58it/s]
 18%|█▊        | 65196/371472 [5:11:12<23:49:31,  3.57it/s]
 18%|█▊        | 65197/371472 [5:11:12<23:48:59,  3.57it/s]
 18%|█▊        | 65198/371472 [5:11:12<24:06:56,  3.53it/s]
 18%|█▊        | 65199/371472 [5:11:13<23:53:59,  3.56it/s]
 18%|█▊        | 65200/371472 [5:11:13<23:17:02,  3.65it/s]
                                                           
{'loss': 4.22, 'learning_rate': 8.424335796935939e-07, 'epoch': 2.81}

 18%|█▊        | 65200/371472 [5:11:13<23:17:02,  3.65it/s]
 18%|█▊        | 65201/371472 [5:11:13<22:55:56,  3.71it/s]
 18%|█▊        | 65202/371472 [5:11:14<22:46:29,  3.74it/s]
 18%|█▊        | 65203/371472 [5:11:14<24:06:20,  3.53it/s]
 18%|█▊        | 65204/371472 [5:11:14<25:18:40,  3.36it/s]
 18%|█▊        | 65205/371472 [5:11:14<23:51:26,  3.57it/s]
 18%|█▊        | 65206/371472 [5:11:15<22:47:04,  3.73it/s]
 18%|█▊        | 65207/371472 [5:11:15<22:39:06,  3.76it/s]
 18%|█▊        | 65208/371472 [5:11:15<23:20:54,  3.64it/s]
 18%|█▊        | 65209/371472 [5:11:15<22:23:03,  3.80it/s]
 18%|█▊        | 65210/371472 [5:11:16<23:52:36,  3.56it/s]
 18%|█▊        | 65211/371472 [5:11:16<23:54:05,  3.56it/s]
 18%|█▊        | 65212/371472 [5:11:16<23:58:58,  3.55it/s]
 18%|█▊        | 65213/371472 [5:11:17<23:36:51,  3.60it/s]
 18%|█▊        | 65214/371472 [5:11:17<25:14:27,  3.37it/s]
 18%|█▊        | 65215/371472 [5:11:17<24:26:04,  3.48it/s]
 18%|█▊        | 65216/371472 [5:11:17<24:32:25,  3.47it/s]
 18%|█▊        | 65217/371472 [5:11:18<23:39:01,  3.60it/s]
 18%|█▊        | 65218/371472 [5:11:18<22:40:35,  3.75it/s]
 18%|█▊        | 65219/371472 [5:11:18<23:54:40,  3.56it/s]
 18%|█▊        | 65220/371472 [5:11:19<25:00:56,  3.40it/s]
                                                           
{'loss': 4.3503, 'learning_rate': 8.42385097718115e-07, 'epoch': 2.81}

 18%|█▊        | 65220/371472 [5:11:19<25:00:56,  3.40it/s]
 18%|█▊        | 65221/371472 [5:11:19<25:00:02,  3.40it/s]
 18%|█▊        | 65222/371472 [5:11:19<23:43:31,  3.59it/s]
 18%|█▊        | 65223/371472 [5:11:19<23:05:16,  3.68it/s]
 18%|█▊        | 65224/371472 [5:11:20<22:50:32,  3.72it/s]
 18%|█▊        | 65225/371472 [5:11:20<23:02:36,  3.69it/s]
 18%|█▊        | 65226/371472 [5:11:20<24:17:35,  3.50it/s]
 18%|█▊        | 65227/371472 [5:11:21<23:37:14,  3.60it/s]
 18%|█▊        | 65228/371472 [5:11:21<23:52:22,  3.56it/s]
 18%|█▊        | 65229/371472 [5:11:21<30:04:22,  2.83it/s]
 18%|█▊        | 65230/371472 [5:11:22<28:49:36,  2.95it/s]
 18%|█▊        | 65231/371472 [5:11:22<27:03:17,  3.14it/s]
 18%|█▊        | 65232/371472 [5:11:22<26:10:44,  3.25it/s]
 18%|█▊        | 65233/371472 [5:11:23<27:19:13,  3.11it/s]
 18%|█▊        | 65234/371472 [5:11:23<27:40:42,  3.07it/s]
 18%|█▊        | 65235/371472 [5:11:23<26:54:48,  3.16it/s]
 18%|█▊        | 65236/371472 [5:11:23<25:27:58,  3.34it/s]
 18%|█▊        | 65237/371472 [5:11:24<25:24:31,  3.35it/s]
 18%|█▊        | 65238/371472 [5:11:24<25:51:24,  3.29it/s]
 18%|█▊        | 65239/371472 [5:11:24<25:53:28,  3.29it/s]
 18%|█▊        | 65240/371472 [5:11:25<25:39:50,  3.31it/s]
                                                           
{'loss': 4.1263, 'learning_rate': 8.423366157426362e-07, 'epoch': 2.81}

 18%|█▊        | 65240/371472 [5:11:25<25:39:50,  3.31it/s]
 18%|█▊        | 65241/371472 [5:11:25<24:54:47,  3.41it/s]
 18%|█▊        | 65242/371472 [5:11:25<25:34:20,  3.33it/s]
 18%|█▊        | 65243/371472 [5:11:26<25:11:46,  3.38it/s]
 18%|█▊        | 65244/371472 [5:11:26<24:36:44,  3.46it/s]
 18%|█▊        | 65245/371472 [5:11:26<24:30:34,  3.47it/s]
 18%|█▊        | 65246/371472 [5:11:26<23:43:09,  3.59it/s]
 18%|█▊        | 65247/371472 [5:11:27<24:06:49,  3.53it/s]
 18%|█▊        | 65248/371472 [5:11:27<23:28:06,  3.62it/s]
 18%|█▊        | 65249/371472 [5:11:27<23:20:24,  3.64it/s]
 18%|█▊        | 65250/371472 [5:11:27<23:36:15,  3.60it/s]
 18%|█▊        | 65251/371472 [5:11:28<24:20:07,  3.50it/s]
 18%|█▊        | 65252/371472 [5:11:28<23:23:15,  3.64it/s]
 18%|█▊        | 65253/371472 [5:11:28<23:13:53,  3.66it/s]
 18%|█▊        | 65254/371472 [5:11:29<23:37:42,  3.60it/s]
 18%|█▊        | 65255/371472 [5:11:29<24:04:02,  3.53it/s]
 18%|█▊        | 65256/371472 [5:11:29<25:02:15,  3.40it/s]
 18%|█▊        | 65257/371472 [5:11:29<23:56:44,  3.55it/s]
 18%|█▊        | 65258/371472 [5:11:30<23:36:51,  3.60it/s]
 18%|█▊        | 65259/371472 [5:11:30<23:38:05,  3.60it/s]
 18%|█▊        | 65260/371472 [5:11:30<24:35:12,  3.46it/s]
                                                           
{'loss': 4.4143, 'learning_rate': 8.422881337671572e-07, 'epoch': 2.81}

 18%|█▊        | 65260/371472 [5:11:30<24:35:12,  3.46it/s]
 18%|█▊        | 65261/371472 [5:11:31<23:58:22,  3.55it/s]
 18%|█▊        | 65262/371472 [5:11:31<24:32:57,  3.46it/s]
 18%|█▊        | 65263/371472 [5:11:31<24:27:17,  3.48it/s]
 18%|█▊        | 65264/371472 [5:11:31<24:51:03,  3.42it/s]
 18%|█▊        | 65265/371472 [5:11:32<23:32:35,  3.61it/s]
 18%|█▊        | 65266/371472 [5:11:32<25:18:45,  3.36it/s]
 18%|█▊        | 65267/371472 [5:11:32<24:32:12,  3.47it/s]
 18%|█▊        | 65268/371472 [5:11:33<24:19:36,  3.50it/s]
 18%|█▊        | 65269/371472 [5:11:33<24:31:20,  3.47it/s]
 18%|█▊        | 65270/371472 [5:11:33<24:22:48,  3.49it/s]
 18%|█▊        | 65271/371472 [5:11:33<24:36:09,  3.46it/s]
 18%|█▊        | 65272/371472 [5:11:34<24:54:03,  3.42it/s]
 18%|█▊        | 65273/371472 [5:11:34<23:34:21,  3.61it/s]
 18%|█▊        | 65274/371472 [5:11:34<22:36:18,  3.76it/s]
 18%|█▊        | 65275/371472 [5:11:35<23:31:15,  3.62it/s]
 18%|█▊        | 65276/371472 [5:11:35<23:22:37,  3.64it/s]
 18%|█▊        | 65277/371472 [5:11:35<23:32:03,  3.61it/s]
 18%|█▊        | 65278/371472 [5:11:35<23:35:54,  3.60it/s]
 18%|█▊        | 65279/371472 [5:11:36<23:56:34,  3.55it/s]
 18%|█▊        | 65280/371472 [5:11:36<23:42:28,  3.59it/s]
                                                           
{'loss': 4.0707, 'learning_rate': 8.422396517916783e-07, 'epoch': 2.81}

 18%|█▊        | 65280/371472 [5:11:36<23:42:28,  3.59it/s]
 18%|█▊        | 65281/371472 [5:11:36<23:03:04,  3.69it/s]
 18%|█▊        | 65282/371472 [5:11:37<26:25:10,  3.22it/s]
 18%|█▊        | 65283/371472 [5:11:37<26:17:23,  3.24it/s]
 18%|█▊        | 65284/371472 [5:11:37<26:38:07,  3.19it/s]
 18%|█▊        | 65285/371472 [5:11:38<26:51:32,  3.17it/s]
 18%|█▊        | 65286/371472 [5:11:38<25:35:14,  3.32it/s]
 18%|█▊        | 65287/371472 [5:11:38<24:57:57,  3.41it/s]
 18%|█▊        | 65288/371472 [5:11:38<26:25:30,  3.22it/s]
 18%|█▊        | 65289/371472 [5:11:39<26:44:21,  3.18it/s]
 18%|█▊        | 65290/371472 [5:11:39<25:45:15,  3.30it/s]
 18%|█▊        | 65291/371472 [5:11:39<25:05:36,  3.39it/s]
 18%|█▊        | 65292/371472 [5:11:40<24:06:55,  3.53it/s]
 18%|█▊        | 65293/371472 [5:11:40<23:51:06,  3.57it/s]
 18%|█▊        | 65294/371472 [5:11:40<23:52:03,  3.56it/s]
 18%|█▊        | 65295/371472 [5:11:40<23:51:54,  3.56it/s]
 18%|█▊        | 65296/371472 [5:11:41<24:49:19,  3.43it/s]
 18%|█▊        | 65297/371472 [5:11:41<23:55:23,  3.56it/s]
 18%|█▊        | 65298/371472 [5:11:41<23:27:15,  3.63it/s]
 18%|█▊        | 65299/371472 [5:11:41<22:46:25,  3.73it/s]
 18%|█▊        | 65300/371472 [5:11:42<22:53:20,  3.72it/s]
                                                           
{'loss': 4.052, 'learning_rate': 8.421911698161993e-07, 'epoch': 2.81}

 18%|█▊        | 65300/371472 [5:11:42<22:53:20,  3.72it/s]
 18%|█▊        | 65301/371472 [5:11:42<22:51:47,  3.72it/s]
 18%|█▊        | 65302/371472 [5:11:42<22:34:15,  3.77it/s]
 18%|█▊        | 65303/371472 [5:11:43<23:44:24,  3.58it/s]
 18%|█▊        | 65304/371472 [5:11:43<23:14:35,  3.66it/s]
 18%|█▊        | 65305/371472 [5:11:43<23:51:09,  3.57it/s]
 18%|█▊        | 65306/371472 [5:11:43<23:33:05,  3.61it/s]
 18%|█▊        | 65307/371472 [5:11:44<23:59:54,  3.54it/s]
 18%|█▊        | 65308/371472 [5:11:44<24:29:10,  3.47it/s]
 18%|█▊        | 65309/371472 [5:11:44<23:24:02,  3.63it/s]
 18%|█▊        | 65310/371472 [5:11:45<23:33:25,  3.61it/s]
 18%|█▊        | 65311/371472 [5:11:45<22:26:22,  3.79it/s]
 18%|█▊        | 65312/371472 [5:11:45<22:04:52,  3.85it/s]
 18%|█▊        | 65313/371472 [5:11:45<22:51:31,  3.72it/s]
 18%|█▊        | 65314/371472 [5:11:46<23:30:11,  3.62it/s]
 18%|█▊        | 65315/371472 [5:11:46<24:21:14,  3.49it/s]
 18%|█▊        | 65316/371472 [5:11:46<23:49:05,  3.57it/s]
 18%|█▊        | 65317/371472 [5:11:46<23:43:13,  3.59it/s]
 18%|█▊        | 65318/371472 [5:11:47<24:36:09,  3.46it/s]
 18%|█▊        | 65319/371472 [5:11:47<24:02:40,  3.54it/s]
 18%|█▊        | 65320/371472 [5:11:47<23:49:22,  3.57it/s]
                                                           
{'loss': 4.1191, 'learning_rate': 8.421426878407205e-07, 'epoch': 2.81}

 18%|█▊        | 65320/371472 [5:11:47<23:49:22,  3.57it/s]
 18%|█▊        | 65321/371472 [5:11:48<22:51:21,  3.72it/s]
 18%|█▊        | 65322/371472 [5:11:48<24:57:24,  3.41it/s]
 18%|█▊        | 65323/371472 [5:11:48<24:17:23,  3.50it/s]
 18%|█▊        | 65324/371472 [5:11:48<23:38:53,  3.60it/s]
 18%|█▊        | 65325/371472 [5:11:49<24:32:32,  3.47it/s]
 18%|█▊        | 65326/371472 [5:11:49<23:23:34,  3.64it/s]
 18%|█▊        | 65327/371472 [5:11:49<24:37:13,  3.45it/s]
 18%|█▊        | 65328/371472 [5:11:50<24:19:20,  3.50it/s]
 18%|█▊        | 65329/371472 [5:11:50<23:31:15,  3.62it/s]
 18%|█▊        | 65330/371472 [5:11:50<23:00:55,  3.69it/s]
 18%|█▊        | 65331/371472 [5:11:50<22:48:59,  3.73it/s]
 18%|█▊        | 65332/371472 [5:11:51<22:56:23,  3.71it/s]
 18%|█▊        | 65333/371472 [5:11:51<24:37:02,  3.45it/s]
 18%|█▊        | 65334/371472 [5:11:51<23:57:42,  3.55it/s]
 18%|█▊        | 65335/371472 [5:11:51<23:21:50,  3.64it/s]
 18%|█▊        | 65336/371472 [5:11:52<25:12:16,  3.37it/s]
 18%|█▊        | 65337/371472 [5:11:52<24:29:10,  3.47it/s]
 18%|█▊        | 65338/371472 [5:11:52<24:09:34,  3.52it/s]
 18%|█▊        | 65339/371472 [5:11:53<23:24:29,  3.63it/s]
 18%|█▊        | 65340/371472 [5:11:53<23:08:06,  3.68it/s]
                                                           
{'loss': 4.0559, 'learning_rate': 8.420942058652416e-07, 'epoch': 2.81}

 18%|█▊        | 65340/371472 [5:11:53<23:08:06,  3.68it/s]
 18%|█▊        | 65341/371472 [5:11:53<25:12:43,  3.37it/s]
 18%|█▊        | 65342/371472 [5:11:54<24:46:11,  3.43it/s]
 18%|█▊        | 65343/371472 [5:11:54<25:09:58,  3.38it/s]
 18%|█▊        | 65344/371472 [5:11:54<27:38:47,  3.08it/s]
 18%|█▊        | 65345/371472 [5:11:55<28:35:16,  2.97it/s]
 18%|█▊        | 65346/371472 [5:11:55<27:40:27,  3.07it/s]
 18%|█▊        | 65347/371472 [5:11:55<26:04:26,  3.26it/s]
 18%|█▊        | 65348/371472 [5:11:55<25:39:49,  3.31it/s]
 18%|█▊        | 65349/371472 [5:11:56<24:25:39,  3.48it/s]
 18%|█▊        | 65350/371472 [5:11:56<25:17:11,  3.36it/s]
 18%|█▊        | 65351/371472 [5:11:56<24:33:41,  3.46it/s]
 18%|█▊        | 65352/371472 [5:11:57<24:33:33,  3.46it/s]
 18%|█▊        | 65353/371472 [5:11:57<24:32:24,  3.47it/s]
 18%|█▊        | 65354/371472 [5:11:57<23:15:29,  3.66it/s]
 18%|█▊        | 65355/371472 [5:11:57<23:25:15,  3.63it/s]
 18%|█▊        | 65356/371472 [5:11:58<23:03:51,  3.69it/s]
 18%|█▊        | 65357/371472 [5:11:58<23:18:13,  3.65it/s]
 18%|█▊        | 65358/371472 [5:11:58<23:01:37,  3.69it/s]
 18%|█▊        | 65359/371472 [5:11:58<22:37:36,  3.76it/s]
 18%|█▊        | 65360/371472 [5:11:59<22:30:41,  3.78it/s]
                                                           
{'loss': 4.0588, 'learning_rate': 8.420457238897627e-07, 'epoch': 2.82}

 18%|█▊        | 65360/371472 [5:11:59<22:30:41,  3.78it/s]
 18%|█▊        | 65361/371472 [5:11:59<22:38:06,  3.76it/s]
 18%|█▊        | 65362/371472 [5:11:59<23:32:28,  3.61it/s]
 18%|█▊        | 65363/371472 [5:12:00<24:28:21,  3.47it/s]
 18%|█▊        | 65364/371472 [5:12:00<24:15:59,  3.50it/s]
 18%|█▊        | 65365/371472 [5:12:00<24:10:10,  3.52it/s]
 18%|█▊        | 65366/371472 [5:12:01<26:09:39,  3.25it/s]
 18%|█▊        | 65367/371472 [5:12:01<25:55:14,  3.28it/s]
 18%|█▊        | 65368/371472 [5:12:01<26:17:41,  3.23it/s]
 18%|█▊        | 65369/371472 [5:12:01<26:12:52,  3.24it/s]
 18%|█▊        | 65370/371472 [5:12:02<25:43:35,  3.31it/s]
 18%|█▊        | 65371/371472 [5:12:02<25:02:26,  3.40it/s]
 18%|█▊        | 65372/371472 [5:12:02<24:28:30,  3.47it/s]
 18%|█▊        | 65373/371472 [5:12:03<23:33:04,  3.61it/s]
 18%|█▊        | 65374/371472 [5:12:03<22:33:31,  3.77it/s]
 18%|█▊        | 65375/371472 [5:12:03<22:20:09,  3.81it/s]
 18%|█▊        | 65376/371472 [5:12:03<23:00:52,  3.69it/s]
 18%|█▊        | 65377/371472 [5:12:04<24:36:29,  3.46it/s]
 18%|█▊        | 65378/371472 [5:12:04<24:44:15,  3.44it/s]
 18%|█▊        | 65379/371472 [5:12:04<25:19:42,  3.36it/s]
 18%|█▊        | 65380/371472 [5:12:05<24:07:30,  3.52it/s]
                                                           
{'loss': 4.1563, 'learning_rate': 8.419972419142839e-07, 'epoch': 2.82}

 18%|█▊        | 65380/371472 [5:12:05<24:07:30,  3.52it/s]
 18%|█▊        | 65381/371472 [5:12:05<23:24:33,  3.63it/s]
 18%|█▊        | 65382/371472 [5:12:05<23:01:58,  3.69it/s]
 18%|█▊        | 65383/371472 [5:12:05<23:14:21,  3.66it/s]
 18%|█▊        | 65384/371472 [5:12:06<24:40:46,  3.45it/s]
 18%|█▊        | 65385/371472 [5:12:06<24:54:40,  3.41it/s]
 18%|█▊        | 65386/371472 [5:12:06<24:04:37,  3.53it/s]
 18%|█▊        | 65387/371472 [5:12:06<24:27:51,  3.48it/s]
 18%|█▊        | 65388/371472 [5:12:07<23:37:36,  3.60it/s]
 18%|█▊        | 65389/371472 [5:12:07<23:21:56,  3.64it/s]
 18%|█▊        | 65390/371472 [5:12:07<23:33:45,  3.61it/s]
 18%|█▊        | 65391/371472 [5:12:08<22:55:45,  3.71it/s]
 18%|█▊        | 65392/371472 [5:12:08<23:27:22,  3.62it/s]
 18%|█▊        | 65393/371472 [5:12:08<25:09:41,  3.38it/s]
 18%|█▊        | 65394/371472 [5:12:08<24:04:53,  3.53it/s]
 18%|█▊        | 65395/371472 [5:12:09<24:31:32,  3.47it/s]
 18%|█▊        | 65396/371472 [5:12:09<25:52:46,  3.29it/s]
 18%|█▊        | 65397/371472 [5:12:09<24:31:30,  3.47it/s]
 18%|█▊        | 65398/371472 [5:12:10<23:28:28,  3.62it/s]
 18%|█▊        | 65399/371472 [5:12:10<24:14:08,  3.51it/s]
 18%|█▊        | 65400/371472 [5:12:10<25:17:10,  3.36it/s]
                                                           
{'loss': 4.1521, 'learning_rate': 8.419487599388049e-07, 'epoch': 2.82}

 18%|█▊        | 65400/371472 [5:12:10<25:17:10,  3.36it/s]
 18%|█▊        | 65401/371472 [5:12:10<24:44:56,  3.44it/s]
 18%|█▊        | 65402/371472 [5:12:11<23:37:22,  3.60it/s]
 18%|█▊        | 65403/371472 [5:12:11<23:32:47,  3.61it/s]
 18%|█▊        | 65404/371472 [5:12:11<24:12:20,  3.51it/s]
 18%|█▊        | 65405/371472 [5:12:12<24:17:39,  3.50it/s]
 18%|█▊        | 65406/371472 [5:12:12<24:19:03,  3.50it/s]
 18%|█▊        | 65407/371472 [5:12:12<24:15:28,  3.50it/s]
 18%|█▊        | 65408/371472 [5:12:12<23:04:22,  3.68it/s]
 18%|█▊        | 65409/371472 [5:12:13<22:25:50,  3.79it/s]
 18%|█▊        | 65410/371472 [5:12:13<23:29:42,  3.62it/s]
 18%|█▊        | 65411/371472 [5:12:13<23:34:56,  3.61it/s]
 18%|█▊        | 65412/371472 [5:12:14<28:30:43,  2.98it/s]
 18%|█▊        | 65413/371472 [5:12:14<26:12:47,  3.24it/s]
 18%|█▊        | 65414/371472 [5:12:14<26:58:12,  3.15it/s]
 18%|█▊        | 65415/371472 [5:12:15<25:26:26,  3.34it/s]
 18%|█▊        | 65416/371472 [5:12:15<26:08:31,  3.25it/s]
 18%|█▊        | 65417/371472 [5:12:15<24:33:11,  3.46it/s]
 18%|█▊        | 65418/371472 [5:12:15<25:15:12,  3.37it/s]
 18%|█▊        | 65419/371472 [5:12:16<24:06:30,  3.53it/s]
 18%|█▊        | 65420/371472 [5:12:16<25:47:55,  3.30it/s]
                                                           
{'loss': 4.202, 'learning_rate': 8.41900277963326e-07, 'epoch': 2.82}

 18%|█▊        | 65420/371472 [5:12:16<25:47:55,  3.30it/s]
 18%|█▊        | 65421/371472 [5:12:16<25:37:02,  3.32it/s]
 18%|█▊        | 65422/371472 [5:12:17<24:21:10,  3.49it/s]
 18%|█▊        | 65423/371472 [5:12:17<23:35:51,  3.60it/s]
 18%|█▊        | 65424/371472 [5:12:17<23:15:19,  3.66it/s]
 18%|█▊        | 65425/371472 [5:12:17<24:10:13,  3.52it/s]
 18%|█▊        | 65426/371472 [5:12:18<23:58:04,  3.55it/s]
 18%|█▊        | 65427/371472 [5:12:18<24:45:38,  3.43it/s]
 18%|█▊        | 65428/371472 [5:12:18<24:51:04,  3.42it/s]
 18%|█▊        | 65429/371472 [5:12:19<24:15:36,  3.50it/s]
 18%|█▊        | 65430/371472 [5:12:19<23:55:15,  3.55it/s]
 18%|█▊        | 65431/371472 [5:12:19<24:11:31,  3.51it/s]
 18%|█▊        | 65432/371472 [5:12:19<24:06:02,  3.53it/s]
 18%|█▊        | 65433/371472 [5:12:20<23:15:54,  3.65it/s]
 18%|█▊        | 65434/371472 [5:12:20<23:54:59,  3.55it/s]
 18%|█▊        | 65435/371472 [5:12:20<24:22:19,  3.49it/s]
 18%|█▊        | 65436/371472 [5:12:21<24:07:22,  3.52it/s]
 18%|█▊        | 65437/371472 [5:12:21<25:21:22,  3.35it/s]
 18%|█▊        | 65438/371472 [5:12:21<24:44:06,  3.44it/s]
 18%|█▊        | 65439/371472 [5:12:21<24:21:39,  3.49it/s]
 18%|█▊        | 65440/371472 [5:12:22<27:31:03,  3.09it/s]
                                                           
{'loss': 4.1619, 'learning_rate': 8.418517959878471e-07, 'epoch': 2.82}

 18%|█▊        | 65440/371472 [5:12:22<27:31:03,  3.09it/s]
 18%|█▊        | 65441/371472 [5:12:22<25:32:28,  3.33it/s]
 18%|█▊        | 65442/371472 [5:12:22<24:20:26,  3.49it/s]
 18%|█▊        | 65443/371472 [5:12:23<24:49:36,  3.42it/s]
 18%|█▊        | 65444/371472 [5:12:23<23:56:00,  3.55it/s]
 18%|█▊        | 65445/371472 [5:12:23<23:18:50,  3.65it/s]
 18%|█▊        | 65446/371472 [5:12:23<22:32:44,  3.77it/s]
 18%|█▊        | 65447/371472 [5:12:24<24:36:16,  3.45it/s]
 18%|█▊        | 65448/371472 [5:12:24<24:05:33,  3.53it/s]
 18%|█▊        | 65449/371472 [5:12:24<25:09:04,  3.38it/s]
 18%|█▊        | 65450/371472 [5:12:25<24:24:50,  3.48it/s]
 18%|█▊        | 65451/371472 [5:12:25<25:45:47,  3.30it/s]
 18%|█▊        | 65452/371472 [5:12:25<25:44:07,  3.30it/s]
 18%|█▊        | 65453/371472 [5:12:26<25:14:12,  3.37it/s]
 18%|█▊        | 65454/371472 [5:12:26<25:42:41,  3.31it/s]
 18%|█▊        | 65455/371472 [5:12:26<26:26:59,  3.21it/s]
 18%|█▊        | 65456/371472 [5:12:27<27:46:21,  3.06it/s]
 18%|█▊        | 65457/371472 [5:12:27<25:48:58,  3.29it/s]
 18%|█▊        | 65458/371472 [5:12:27<26:52:36,  3.16it/s]
 18%|█▊        | 65459/371472 [5:12:27<25:18:59,  3.36it/s]
 18%|█▊        | 65460/371472 [5:12:28<27:52:02,  3.05it/s]
                                                           
{'loss': 4.2922, 'learning_rate': 8.418033140123683e-07, 'epoch': 2.82}

 18%|█▊        | 65460/371472 [5:12:28<27:52:02,  3.05it/s]
 18%|█▊        | 65461/371472 [5:12:28<26:03:24,  3.26it/s]
 18%|█▊        | 65462/371472 [5:12:28<25:18:57,  3.36it/s]
 18%|█▊        | 65463/371472 [5:12:29<24:49:23,  3.42it/s]
 18%|█▊        | 65464/371472 [5:12:29<24:22:12,  3.49it/s]
 18%|█▊        | 65465/371472 [5:12:29<23:56:16,  3.55it/s]
 18%|█▊        | 65466/371472 [5:12:29<23:34:22,  3.61it/s]
 18%|█▊        | 65467/371472 [5:12:30<23:05:41,  3.68it/s]
 18%|█▊        | 65468/371472 [5:12:30<23:19:32,  3.64it/s]
 18%|█▊        | 65469/371472 [5:12:30<25:16:08,  3.36it/s]
 18%|█▊        | 65470/371472 [5:12:31<24:15:08,  3.50it/s]
 18%|█▊        | 65471/371472 [5:12:31<24:19:28,  3.49it/s]
 18%|█▊        | 65472/371472 [5:12:31<23:51:53,  3.56it/s]
 18%|█▊        | 65473/371472 [5:12:31<23:57:40,  3.55it/s]
 18%|█▊        | 65474/371472 [5:12:32<23:24:50,  3.63it/s]
 18%|█▊        | 65475/371472 [5:12:32<23:10:29,  3.67it/s]
 18%|█▊        | 65476/371472 [5:12:32<24:47:21,  3.43it/s]
 18%|█▊        | 65477/371472 [5:12:33<24:35:35,  3.46it/s]
 18%|█▊        | 65478/371472 [5:12:33<25:19:43,  3.36it/s]
 18%|█▊        | 65479/371472 [5:12:33<24:29:21,  3.47it/s]
 18%|█▊        | 65480/371472 [5:12:33<23:56:58,  3.55it/s]
                                                           
{'loss': 4.2528, 'learning_rate': 8.417548320368894e-07, 'epoch': 2.82}

 18%|█▊        | 65480/371472 [5:12:33<23:56:58,  3.55it/s]
 18%|█▊        | 65481/371472 [5:12:34<23:37:07,  3.60it/s]
 18%|█▊        | 65482/371472 [5:12:34<23:50:14,  3.57it/s]
 18%|█▊        | 65483/371472 [5:12:34<23:08:04,  3.67it/s]
 18%|█▊        | 65484/371472 [5:12:34<23:25:36,  3.63it/s]
 18%|█▊        | 65485/371472 [5:12:35<22:49:55,  3.72it/s]
 18%|█▊        | 65486/371472 [5:12:35<22:08:12,  3.84it/s]
 18%|█▊        | 65487/371472 [5:12:35<22:34:48,  3.76it/s]
 18%|█▊        | 65488/371472 [5:12:36<22:20:56,  3.80it/s]
 18%|█▊        | 65489/371472 [5:12:36<23:43:57,  3.58it/s]
 18%|█▊        | 65490/371472 [5:12:36<22:56:31,  3.70it/s]
 18%|█▊        | 65491/371472 [5:12:36<24:14:03,  3.51it/s]
 18%|█▊        | 65492/371472 [5:12:37<23:14:15,  3.66it/s]
 18%|█▊        | 65493/371472 [5:12:37<22:34:35,  3.76it/s]
 18%|█▊        | 65494/371472 [5:12:37<23:12:49,  3.66it/s]
 18%|█▊        | 65495/371472 [5:12:38<25:18:35,  3.36it/s]
 18%|█▊        | 65496/371472 [5:12:38<24:16:29,  3.50it/s]
 18%|█▊        | 65497/371472 [5:12:38<23:49:37,  3.57it/s]
 18%|█▊        | 65498/371472 [5:12:38<24:51:19,  3.42it/s]
 18%|█▊        | 65499/371472 [5:12:39<23:22:40,  3.64it/s]
 18%|█▊        | 65500/371472 [5:12:39<24:53:31,  3.41it/s]
                                                           
{'loss': 4.2084, 'learning_rate': 8.417063500614105e-07, 'epoch': 2.82}

 18%|█▊        | 65500/371472 [5:12:39<24:53:31,  3.41it/s]
 18%|█▊        | 65501/371472 [5:12:39<26:21:00,  3.23it/s]
 18%|█▊        | 65502/371472 [5:12:40<27:06:40,  3.13it/s]
 18%|█▊        | 65503/371472 [5:12:40<26:21:24,  3.22it/s]
 18%|█▊        | 65504/371472 [5:12:40<24:37:55,  3.45it/s]
 18%|█▊        | 65505/371472 [5:12:40<24:52:55,  3.42it/s]
 18%|█▊        | 65506/371472 [5:12:41<24:27:07,  3.48it/s]
 18%|█▊        | 65507/371472 [5:12:41<23:58:12,  3.55it/s]
 18%|█▊        | 65508/371472 [5:12:41<23:27:10,  3.62it/s]
 18%|█▊        | 65509/371472 [5:12:42<23:19:36,  3.64it/s]
 18%|█▊        | 65510/371472 [5:12:42<24:58:51,  3.40it/s]
 18%|█▊        | 65511/371472 [5:12:42<24:07:59,  3.52it/s]
 18%|█▊        | 65512/371472 [5:12:43<25:31:32,  3.33it/s]
 18%|█▊        | 65513/371472 [5:12:43<23:56:06,  3.55it/s]
 18%|█▊        | 65514/371472 [5:12:43<24:26:12,  3.48it/s]
 18%|█▊        | 65515/371472 [5:12:43<23:44:02,  3.58it/s]
 18%|█▊        | 65516/371472 [5:12:44<23:06:41,  3.68it/s]
 18%|█▊        | 65517/371472 [5:12:44<22:37:39,  3.76it/s]
 18%|█▊        | 65518/371472 [5:12:44<24:11:48,  3.51it/s]
 18%|█▊        | 65519/371472 [5:12:44<23:43:40,  3.58it/s]
 18%|█▊        | 65520/371472 [5:12:45<23:25:08,  3.63it/s]
                                                           
{'loss': 4.2309, 'learning_rate': 8.416578680859316e-07, 'epoch': 2.82}

 18%|█▊        | 65520/371472 [5:12:45<23:25:08,  3.63it/s]
 18%|█▊        | 65521/371472 [5:12:45<23:26:37,  3.63it/s]
 18%|█▊        | 65522/371472 [5:12:45<23:59:18,  3.54it/s]
 18%|█▊        | 65523/371472 [5:12:46<23:43:08,  3.58it/s]
 18%|█▊        | 65524/371472 [5:12:46<23:44:51,  3.58it/s]
 18%|█▊        | 65525/371472 [5:12:46<23:34:04,  3.61it/s]
 18%|█▊        | 65526/371472 [5:12:46<22:41:55,  3.74it/s]
 18%|█▊        | 65527/371472 [5:12:47<23:09:41,  3.67it/s]
 18%|█▊        | 65528/371472 [5:12:47<23:03:37,  3.69it/s]
 18%|█▊        | 65529/371472 [5:12:47<23:10:33,  3.67it/s]
 18%|█▊        | 65530/371472 [5:12:47<23:08:06,  3.67it/s]
 18%|█▊        | 65531/371472 [5:12:48<24:31:04,  3.47it/s]
 18%|█▊        | 65532/371472 [5:12:48<25:32:03,  3.33it/s]
 18%|█▊        | 65533/371472 [5:12:48<25:22:35,  3.35it/s]
 18%|█▊        | 65534/371472 [5:12:49<25:46:51,  3.30it/s]
 18%|█▊        | 65535/371472 [5:12:49<25:29:06,  3.33it/s]
 18%|█▊        | 65536/371472 [5:12:49<24:31:13,  3.47it/s]
 18%|█▊        | 65537/371472 [5:12:50<24:31:23,  3.47it/s]
 18%|█▊        | 65538/371472 [5:12:50<23:55:33,  3.55it/s]
 18%|█▊        | 65539/371472 [5:12:50<23:22:13,  3.64it/s]
 18%|█▊        | 65540/371472 [5:12:50<24:35:16,  3.46it/s]
                                                           
{'loss': 4.2342, 'learning_rate': 8.416093861104526e-07, 'epoch': 2.82}

 18%|█▊        | 65540/371472 [5:12:50<24:35:16,  3.46it/s]
 18%|█▊        | 65541/371472 [5:12:51<26:35:41,  3.20it/s]
 18%|█▊        | 65542/371472 [5:12:51<24:44:57,  3.43it/s]
 18%|█▊        | 65543/371472 [5:12:51<24:08:30,  3.52it/s]
 18%|█▊        | 65544/371472 [5:12:52<24:30:52,  3.47it/s]
 18%|█▊        | 65545/371472 [5:12:52<23:47:45,  3.57it/s]
 18%|█▊        | 65546/371472 [5:12:52<24:38:30,  3.45it/s]
 18%|█▊        | 65547/371472 [5:12:52<25:33:36,  3.32it/s]
 18%|█▊        | 65548/371472 [5:12:53<25:43:01,  3.30it/s]
 18%|█▊        | 65549/371472 [5:12:53<26:01:22,  3.27it/s]
 18%|█▊        | 65550/371472 [5:12:53<26:06:04,  3.26it/s]
 18%|█▊        | 65551/371472 [5:12:54<24:58:54,  3.40it/s]
 18%|█▊        | 65552/371472 [5:12:54<23:47:25,  3.57it/s]
 18%|█▊        | 65553/371472 [5:12:54<23:18:41,  3.65it/s]
 18%|█▊        | 65554/371472 [5:12:54<24:01:44,  3.54it/s]
 18%|█▊        | 65555/371472 [5:12:55<24:26:54,  3.48it/s]
 18%|█▊        | 65556/371472 [5:12:55<27:01:49,  3.14it/s]
 18%|█▊        | 65557/371472 [5:12:56<28:59:05,  2.93it/s]
 18%|█▊        | 65558/371472 [5:12:56<26:24:31,  3.22it/s]
 18%|█▊        | 65559/371472 [5:12:56<27:38:23,  3.07it/s]
 18%|█▊        | 65560/371472 [5:12:56<26:53:13,  3.16it/s]
                                                           
{'loss': 4.0922, 'learning_rate': 8.415609041349737e-07, 'epoch': 2.82}

 18%|█▊        | 65560/371472 [5:12:56<26:53:13,  3.16it/s]
 18%|█▊        | 65561/371472 [5:12:57<28:45:47,  2.95it/s]
 18%|█▊        | 65562/371472 [5:12:57<27:05:07,  3.14it/s]
 18%|█▊        | 65563/371472 [5:12:57<26:29:16,  3.21it/s]
 18%|█▊        | 65564/371472 [5:12:58<25:25:30,  3.34it/s]
 18%|█▊        | 65565/371472 [5:12:58<25:47:02,  3.30it/s]
 18%|█▊        | 65566/371472 [5:12:58<25:06:10,  3.39it/s]
 18%|█▊        | 65567/371472 [5:12:59<25:00:30,  3.40it/s]
 18%|█▊        | 65568/371472 [5:12:59<23:42:10,  3.58it/s]
 18%|█▊        | 65569/371472 [5:12:59<23:08:27,  3.67it/s]
 18%|█▊        | 65570/371472 [5:12:59<24:24:35,  3.48it/s]
 18%|█▊        | 65571/371472 [5:13:00<25:51:59,  3.29it/s]
 18%|█▊        | 65572/371472 [5:13:00<25:34:39,  3.32it/s]
 18%|█▊        | 65573/371472 [5:13:00<24:29:09,  3.47it/s]
 18%|█▊        | 65574/371472 [5:13:01<25:00:13,  3.40it/s]
 18%|█▊        | 65575/371472 [5:13:01<23:51:15,  3.56it/s]
 18%|█▊        | 65576/371472 [5:13:01<22:58:07,  3.70it/s]
 18%|█▊        | 65577/371472 [5:13:01<24:08:38,  3.52it/s]
 18%|█▊        | 65578/371472 [5:13:02<24:17:37,  3.50it/s]
 18%|█▊        | 65579/371472 [5:13:02<23:44:24,  3.58it/s]
 18%|█▊        | 65580/371472 [5:13:02<23:09:58,  3.67it/s]
                                                           
{'loss': 3.9988, 'learning_rate': 8.415124221594949e-07, 'epoch': 2.82}

 18%|█▊        | 65580/371472 [5:13:02<23:09:58,  3.67it/s]
 18%|█▊        | 65581/371472 [5:13:02<23:32:20,  3.61it/s]
 18%|█▊        | 65582/371472 [5:13:03<22:57:27,  3.70it/s]
 18%|█▊        | 65583/371472 [5:13:03<24:25:09,  3.48it/s]
 18%|█▊        | 65584/371472 [5:13:03<25:08:42,  3.38it/s]
 18%|█▊        | 65585/371472 [5:13:04<24:30:00,  3.47it/s]
 18%|█▊        | 65586/371472 [5:13:04<24:21:37,  3.49it/s]
 18%|█▊        | 65587/371472 [5:13:04<23:42:22,  3.58it/s]
 18%|█▊        | 65588/371472 [5:13:04<24:28:06,  3.47it/s]
 18%|█▊        | 65589/371472 [5:13:05<23:36:12,  3.60it/s]
 18%|█▊        | 65590/371472 [5:13:05<25:24:09,  3.34it/s]
 18%|█▊        | 65591/371472 [5:13:05<26:47:31,  3.17it/s]
 18%|█▊        | 65592/371472 [5:13:06<26:49:09,  3.17it/s]
 18%|█▊        | 65593/371472 [5:13:06<25:01:28,  3.40it/s]
 18%|█▊        | 65594/371472 [5:13:06<26:00:47,  3.27it/s]
 18%|█▊        | 65595/371472 [5:13:07<24:33:17,  3.46it/s]
 18%|█▊        | 65596/371472 [5:13:07<24:22:49,  3.48it/s]
 18%|█▊        | 65597/371472 [5:13:07<24:47:30,  3.43it/s]
 18%|█▊        | 65598/371472 [5:13:07<23:40:08,  3.59it/s]
 18%|█▊        | 65599/371472 [5:13:08<23:39:55,  3.59it/s]
 18%|█▊        | 65600/371472 [5:13:08<23:17:59,  3.65it/s]
                                                           
{'loss': 4.2548, 'learning_rate': 8.41463940184016e-07, 'epoch': 2.83}

 18%|█▊        | 65600/371472 [5:13:08<23:17:59,  3.65it/s]
 18%|█▊        | 65601/371472 [5:13:08<23:13:31,  3.66it/s]
 18%|█▊        | 65602/371472 [5:13:09<23:26:07,  3.63it/s]
 18%|█▊        | 65603/371472 [5:13:09<24:44:04,  3.44it/s]
 18%|█▊        | 65604/371472 [5:13:09<24:02:57,  3.53it/s]
 18%|█▊        | 65605/371472 [5:13:09<24:12:55,  3.51it/s]
 18%|█▊        | 65606/371472 [5:13:10<24:06:37,  3.52it/s]
 18%|█▊        | 65607/371472 [5:13:10<24:55:17,  3.41it/s]
 18%|█▊        | 65608/371472 [5:13:10<24:39:11,  3.45it/s]
 18%|█▊        | 65609/371472 [5:13:11<25:04:30,  3.39it/s]
 18%|█▊        | 65610/371472 [5:13:11<24:09:14,  3.52it/s]
 18%|█▊        | 65611/371472 [5:13:11<24:08:26,  3.52it/s]
 18%|█▊        | 65612/371472 [5:13:11<23:22:31,  3.63it/s]
 18%|█▊        | 65613/371472 [5:13:12<22:48:06,  3.73it/s]
 18%|█▊        | 65614/371472 [5:13:12<22:45:45,  3.73it/s]
 18%|█▊        | 65615/371472 [5:13:12<23:03:33,  3.68it/s]
 18%|█▊        | 65616/371472 [5:13:12<23:15:26,  3.65it/s]
 18%|█▊        | 65617/371472 [5:13:13<22:53:33,  3.71it/s]
 18%|█▊        | 65618/371472 [5:13:13<24:45:19,  3.43it/s]
 18%|█▊        | 65619/371472 [5:13:13<24:02:53,  3.53it/s]
 18%|█▊        | 65620/371472 [5:13:14<23:04:32,  3.68it/s]
                                                           
{'loss': 4.024, 'learning_rate': 8.414154582085371e-07, 'epoch': 2.83}

 18%|█▊        | 65620/371472 [5:13:14<23:04:32,  3.68it/s]
 18%|█▊        | 65621/371472 [5:13:14<23:45:29,  3.58it/s]
 18%|█▊        | 65622/371472 [5:13:14<23:39:07,  3.59it/s]
 18%|█▊        | 65623/371472 [5:13:14<23:28:01,  3.62it/s]
 18%|█▊        | 65624/371472 [5:13:15<22:35:49,  3.76it/s]
 18%|█▊        | 65625/371472 [5:13:15<22:35:03,  3.76it/s]
 18%|█▊        | 65626/371472 [5:13:15<22:00:00,  3.86it/s]
 18%|█▊        | 65627/371472 [5:13:15<21:57:30,  3.87it/s]
 18%|█▊        | 65628/371472 [5:13:16<22:50:18,  3.72it/s]
 18%|█▊        | 65629/371472 [5:13:16<22:33:19,  3.77it/s]
 18%|█▊        | 65630/371472 [5:13:16<24:13:14,  3.51it/s]
 18%|█▊        | 65631/371472 [5:13:17<25:03:16,  3.39it/s]
 18%|█▊        | 65632/371472 [5:13:17<24:22:00,  3.49it/s]
 18%|█▊        | 65633/371472 [5:13:17<23:54:46,  3.55it/s]
 18%|█▊        | 65634/371472 [5:13:17<23:49:30,  3.57it/s]
 18%|█▊        | 65635/371472 [5:13:18<23:50:33,  3.56it/s]
 18%|█▊        | 65636/371472 [5:13:18<22:37:38,  3.75it/s]
 18%|█▊        | 65637/371472 [5:13:18<23:11:01,  3.66it/s]
 18%|█▊        | 65638/371472 [5:13:19<24:18:34,  3.49it/s]
 18%|█▊        | 65639/371472 [5:13:19<23:25:29,  3.63it/s]
 18%|█▊        | 65640/371472 [5:13:19<23:42:36,  3.58it/s]
                                                           
{'loss': 4.1746, 'learning_rate': 8.413669762330582e-07, 'epoch': 2.83}

 18%|█▊        | 65640/371472 [5:13:19<23:42:36,  3.58it/s]
 18%|█▊        | 65641/371472 [5:13:19<23:20:38,  3.64it/s]
 18%|█▊        | 65642/371472 [5:13:20<24:04:15,  3.53it/s]
 18%|█▊        | 65643/371472 [5:13:20<23:28:19,  3.62it/s]
 18%|█▊        | 65644/371472 [5:13:20<23:30:51,  3.61it/s]
 18%|█▊        | 65645/371472 [5:13:20<23:50:37,  3.56it/s]
 18%|█▊        | 65646/371472 [5:13:21<23:48:44,  3.57it/s]
 18%|█▊        | 65647/371472 [5:13:21<23:03:03,  3.69it/s]
 18%|█▊        | 65648/371472 [5:13:21<22:54:17,  3.71it/s]
 18%|█▊        | 65649/371472 [5:13:22<23:03:48,  3.68it/s]
 18%|█▊        | 65650/371472 [5:13:22<23:44:01,  3.58it/s]
 18%|█▊        | 65651/371472 [5:13:22<23:18:51,  3.64it/s]
 18%|█▊        | 65652/371472 [5:13:22<22:42:32,  3.74it/s]
 18%|█▊        | 65653/371472 [5:13:23<23:14:30,  3.66it/s]
 18%|█▊        | 65654/371472 [5:13:23<24:15:05,  3.50it/s]
 18%|█▊        | 65655/371472 [5:13:23<23:41:25,  3.59it/s]
 18%|█▊        | 65656/371472 [5:13:24<24:45:10,  3.43it/s]
 18%|█▊        | 65657/371472 [5:13:24<23:43:23,  3.58it/s]
 18%|█▊        | 65658/371472 [5:13:24<22:45:34,  3.73it/s]
 18%|█▊        | 65659/371472 [5:13:24<22:59:21,  3.70it/s]
 18%|█▊        | 65660/371472 [5:13:25<23:44:58,  3.58it/s]
                                                           
{'loss': 4.1492, 'learning_rate': 8.413184942575793e-07, 'epoch': 2.83}

 18%|█▊        | 65660/371472 [5:13:25<23:44:58,  3.58it/s]
 18%|█▊        | 65661/371472 [5:13:25<23:29:31,  3.62it/s]
 18%|█▊        | 65662/371472 [5:13:25<22:52:06,  3.71it/s]
 18%|█▊        | 65663/371472 [5:13:25<22:57:41,  3.70it/s]
 18%|█▊        | 65664/371472 [5:13:26<22:14:11,  3.82it/s]
 18%|█▊        | 65665/371472 [5:13:26<23:59:49,  3.54it/s]
 18%|█▊        | 65666/371472 [5:13:26<24:18:33,  3.49it/s]
 18%|█▊        | 65667/371472 [5:13:27<23:55:42,  3.55it/s]
 18%|█▊        | 65668/371472 [5:13:27<23:07:29,  3.67it/s]
 18%|█▊        | 65669/371472 [5:13:27<22:57:59,  3.70it/s]
 18%|█▊        | 65670/371472 [5:13:27<23:39:56,  3.59it/s]
 18%|█▊        | 65671/371472 [5:13:28<25:45:48,  3.30it/s]
 18%|█▊        | 65672/371472 [5:13:28<25:58:58,  3.27it/s]
 18%|█▊        | 65673/371472 [5:13:28<26:28:55,  3.21it/s]
 18%|█▊        | 65674/371472 [5:13:29<25:43:32,  3.30it/s]
 18%|█▊        | 65675/371472 [5:13:29<26:21:58,  3.22it/s]
 18%|█▊        | 65676/371472 [5:13:29<25:42:48,  3.30it/s]
 18%|█▊        | 65677/371472 [5:13:30<24:24:20,  3.48it/s]
 18%|█▊        | 65678/371472 [5:13:30<24:08:52,  3.52it/s]
 18%|█▊        | 65679/371472 [5:13:30<24:01:21,  3.54it/s]
 18%|█▊        | 65680/371472 [5:13:30<23:12:30,  3.66it/s]
                                                           
{'loss': 4.3199, 'learning_rate': 8.412700122821004e-07, 'epoch': 2.83}

 18%|█▊        | 65680/371472 [5:13:30<23:12:30,  3.66it/s]
 18%|█▊        | 65681/371472 [5:13:31<23:44:48,  3.58it/s]
 18%|█▊        | 65682/371472 [5:13:31<24:33:03,  3.46it/s]
 18%|█▊        | 65683/371472 [5:13:31<27:27:55,  3.09it/s]
 18%|█▊        | 65684/371472 [5:13:32<25:52:27,  3.28it/s]
 18%|█▊        | 65685/371472 [5:13:32<24:04:25,  3.53it/s]
 18%|█▊        | 65686/371472 [5:13:32<24:12:54,  3.51it/s]
 18%|█▊        | 65687/371472 [5:13:32<23:34:08,  3.60it/s]
 18%|█▊        | 65688/371472 [5:13:33<24:15:56,  3.50it/s]
 18%|█▊        | 65689/371472 [5:13:33<23:48:11,  3.57it/s]
 18%|█▊        | 65690/371472 [5:13:33<23:33:32,  3.61it/s]
 18%|█▊        | 65691/371472 [5:13:33<23:10:05,  3.67it/s]
 18%|█▊        | 65692/371472 [5:13:34<22:55:18,  3.71it/s]
 18%|█▊        | 65693/371472 [5:13:34<22:33:25,  3.77it/s]
 18%|█▊        | 65694/371472 [5:13:34<24:12:14,  3.51it/s]
 18%|█▊        | 65695/371472 [5:13:35<25:00:33,  3.40it/s]
 18%|█▊        | 65696/371472 [5:13:35<23:28:22,  3.62it/s]
 18%|█▊        | 65697/371472 [5:13:35<24:03:48,  3.53it/s]
 18%|█▊        | 65698/371472 [5:13:35<23:36:06,  3.60it/s]
 18%|█▊        | 65699/371472 [5:13:36<23:30:51,  3.61it/s]
 18%|█▊        | 65700/371472 [5:13:36<23:01:15,  3.69it/s]
                                                           
{'loss': 4.2033, 'learning_rate': 8.412215303066215e-07, 'epoch': 2.83}

 18%|█▊        | 65700/371472 [5:13:36<23:01:15,  3.69it/s]
 18%|█▊        | 65701/371472 [5:13:36<22:44:25,  3.74it/s]
 18%|█▊        | 65702/371472 [5:13:36<22:17:02,  3.81it/s]
 18%|█▊        | 65703/371472 [5:13:37<21:31:57,  3.94it/s]
 18%|█▊        | 65704/371472 [5:13:37<22:38:08,  3.75it/s]
 18%|█▊        | 65705/371472 [5:13:38<28:47:22,  2.95it/s]
 18%|█▊        | 65706/371472 [5:13:38<28:10:08,  3.02it/s]
 18%|█▊        | 65707/371472 [5:13:38<26:46:58,  3.17it/s]
 18%|█▊        | 65708/371472 [5:13:38<26:25:53,  3.21it/s]
 18%|█▊        | 65709/371472 [5:13:39<27:44:45,  3.06it/s]
 18%|█▊        | 65710/371472 [5:13:39<26:39:05,  3.19it/s]
 18%|█▊        | 65711/371472 [5:13:39<25:44:27,  3.30it/s]
 18%|█▊        | 65712/371472 [5:13:40<25:49:46,  3.29it/s]
 18%|█▊        | 65713/371472 [5:13:40<24:46:43,  3.43it/s]
 18%|█▊        | 65714/371472 [5:13:40<25:49:29,  3.29it/s]
 18%|█▊        | 65715/371472 [5:13:40<24:21:26,  3.49it/s]
 18%|█▊        | 65716/371472 [5:13:41<23:18:21,  3.64it/s]
 18%|█▊        | 65717/371472 [5:13:41<23:30:17,  3.61it/s]
 18%|█▊        | 65718/371472 [5:13:41<22:56:51,  3.70it/s]
 18%|█▊        | 65719/371472 [5:13:42<22:16:30,  3.81it/s]
 18%|█▊        | 65720/371472 [5:13:42<21:45:58,  3.90it/s]
                                                           
{'loss': 4.2661, 'learning_rate': 8.411730483311425e-07, 'epoch': 2.83}

 18%|█▊        | 65720/371472 [5:13:42<21:45:58,  3.90it/s]
 18%|█▊        | 65721/371472 [5:13:42<21:36:08,  3.93it/s]
 18%|█▊        | 65722/371472 [5:13:42<23:01:41,  3.69it/s]
 18%|█▊        | 65723/371472 [5:13:43<23:18:54,  3.64it/s]
 18%|█▊        | 65724/371472 [5:13:43<22:42:59,  3.74it/s]
 18%|█▊        | 65725/371472 [5:13:43<22:20:37,  3.80it/s]
 18%|█▊        | 65726/371472 [5:13:43<23:46:25,  3.57it/s]
 18%|█▊        | 65727/371472 [5:13:44<23:29:25,  3.62it/s]
 18%|█▊        | 65728/371472 [5:13:44<23:43:44,  3.58it/s]
 18%|█▊        | 65729/371472 [5:13:44<24:06:41,  3.52it/s]
 18%|█▊        | 65730/371472 [5:13:45<24:03:12,  3.53it/s]
 18%|█▊        | 65731/371472 [5:13:45<24:50:08,  3.42it/s]
 18%|█▊        | 65732/371472 [5:13:45<24:40:22,  3.44it/s]
 18%|█▊        | 65733/371472 [5:13:45<25:43:59,  3.30it/s]
 18%|█▊        | 65734/371472 [5:13:46<24:44:52,  3.43it/s]
 18%|█▊        | 65735/371472 [5:13:46<23:50:16,  3.56it/s]
 18%|█▊        | 65736/371472 [5:13:46<23:08:53,  3.67it/s]
 18%|█▊        | 65737/371472 [5:13:47<23:08:50,  3.67it/s]
 18%|█▊        | 65738/371472 [5:13:47<22:39:47,  3.75it/s]
 18%|█▊        | 65739/371472 [5:13:47<22:47:38,  3.73it/s]
 18%|█▊        | 65740/371472 [5:13:47<22:16:54,  3.81it/s]
                                                           
{'loss': 4.1234, 'learning_rate': 8.411245663556638e-07, 'epoch': 2.83}

 18%|█▊        | 65740/371472 [5:13:47<22:16:54,  3.81it/s]
 18%|█▊        | 65741/371472 [5:13:48<24:45:13,  3.43it/s]
 18%|█▊        | 65742/371472 [5:13:48<24:47:04,  3.43it/s]
 18%|█▊        | 65743/371472 [5:13:48<26:36:39,  3.19it/s]
 18%|█▊        | 65744/371472 [5:13:49<26:23:35,  3.22it/s]
 18%|█▊        | 65745/371472 [5:13:49<24:52:33,  3.41it/s]
 18%|█▊        | 65746/371472 [5:13:49<24:27:55,  3.47it/s]
 18%|█▊        | 65747/371472 [5:13:49<24:40:24,  3.44it/s]
 18%|█▊        | 65748/371472 [5:13:50<23:25:25,  3.63it/s]
 18%|█▊        | 65749/371472 [5:13:50<22:48:10,  3.72it/s]
 18%|█▊        | 65750/371472 [5:13:50<22:16:11,  3.81it/s]
 18%|█▊        | 65751/371472 [5:13:51<23:36:43,  3.60it/s]
 18%|█▊        | 65752/371472 [5:13:51<23:15:53,  3.65it/s]
 18%|█▊        | 65753/371472 [5:13:51<22:35:33,  3.76it/s]
 18%|█▊        | 65754/371472 [5:13:51<22:19:02,  3.81it/s]
 18%|█▊        | 65755/371472 [5:13:52<21:56:03,  3.87it/s]
 18%|█▊        | 65756/371472 [5:13:52<22:32:46,  3.77it/s]
 18%|█▊        | 65757/371472 [5:13:52<22:06:28,  3.84it/s]
 18%|█▊        | 65758/371472 [5:13:52<23:26:46,  3.62it/s]
 18%|█▊        | 65759/371472 [5:13:53<26:11:05,  3.24it/s]
 18%|█▊        | 65760/371472 [5:13:53<25:40:46,  3.31it/s]
                                                           
{'loss': 3.9953, 'learning_rate': 8.410760843801849e-07, 'epoch': 2.83}

 18%|█▊        | 65760/371472 [5:13:53<25:40:46,  3.31it/s]
 18%|█▊        | 65761/371472 [5:13:53<27:16:40,  3.11it/s]
 18%|█▊        | 65762/371472 [5:13:54<26:21:34,  3.22it/s]
 18%|█▊        | 65763/371472 [5:13:54<25:24:11,  3.34it/s]
 18%|█▊        | 65764/371472 [5:13:54<24:56:33,  3.40it/s]
 18%|█▊        | 65765/371472 [5:13:55<27:30:07,  3.09it/s]
 18%|█▊        | 65766/371472 [5:13:55<26:21:32,  3.22it/s]
 18%|█▊        | 65767/371472 [5:13:55<27:56:22,  3.04it/s]
 18%|█▊        | 65768/371472 [5:13:56<26:35:36,  3.19it/s]
 18%|█▊        | 65769/371472 [5:13:56<27:09:00,  3.13it/s]
 18%|█▊        | 65770/371472 [5:13:56<25:30:29,  3.33it/s]
 18%|█▊        | 65771/371472 [5:13:56<24:19:06,  3.49it/s]
 18%|█▊        | 65772/371472 [5:13:57<24:37:10,  3.45it/s]
 18%|█▊        | 65773/371472 [5:13:57<25:06:10,  3.38it/s]
 18%|█▊        | 65774/371472 [5:13:57<25:09:35,  3.38it/s]
 18%|█▊        | 65775/371472 [5:13:58<24:25:45,  3.48it/s]
 18%|█▊        | 65776/371472 [5:13:58<23:37:44,  3.59it/s]
 18%|█▊        | 65777/371472 [5:13:58<24:29:46,  3.47it/s]
 18%|█▊        | 65778/371472 [5:13:58<23:46:53,  3.57it/s]
 18%|█▊        | 65779/371472 [5:13:59<23:12:52,  3.66it/s]
 18%|█▊        | 65780/371472 [5:13:59<22:26:16,  3.78it/s]
                                                           
{'loss': 3.9306, 'learning_rate': 8.41027602404706e-07, 'epoch': 2.83}

 18%|█▊        | 65780/371472 [5:13:59<22:26:16,  3.78it/s]
 18%|█▊        | 65781/371472 [5:13:59<22:34:56,  3.76it/s]
 18%|█▊        | 65782/371472 [5:14:00<24:59:37,  3.40it/s]
 18%|█▊        | 65783/371472 [5:14:00<27:56:00,  3.04it/s]
 18%|█▊        | 65784/371472 [5:14:00<25:53:08,  3.28it/s]
 18%|█▊        | 65785/371472 [5:14:00<24:42:21,  3.44it/s]
 18%|█▊        | 65786/371472 [5:14:01<24:38:37,  3.45it/s]
 18%|█▊        | 65787/371472 [5:14:01<24:09:35,  3.51it/s]
 18%|█▊        | 65788/371472 [5:14:01<23:27:59,  3.62it/s]
 18%|█▊        | 65789/371472 [5:14:02<23:34:49,  3.60it/s]
 18%|█▊        | 65790/371472 [5:14:02<22:48:35,  3.72it/s]
 18%|█▊        | 65791/371472 [5:14:02<23:53:08,  3.55it/s]
 18%|█▊        | 65792/371472 [5:14:02<22:50:07,  3.72it/s]
 18%|█▊        | 65793/371472 [5:14:03<24:53:24,  3.41it/s]
 18%|█▊        | 65794/371472 [5:14:03<24:14:49,  3.50it/s]
 18%|█▊        | 65795/371472 [5:14:03<24:04:35,  3.53it/s]
 18%|█▊        | 65796/371472 [5:14:04<23:32:23,  3.61it/s]
 18%|█▊        | 65797/371472 [5:14:04<23:34:50,  3.60it/s]
 18%|█▊        | 65798/371472 [5:14:04<23:20:17,  3.64it/s]
 18%|█▊        | 65799/371472 [5:14:04<25:10:29,  3.37it/s]
 18%|█▊        | 65800/371472 [5:14:05<24:08:04,  3.52it/s]
                                                           
{'loss': 4.3457, 'learning_rate': 8.40979120429227e-07, 'epoch': 2.83}

 18%|█▊        | 65800/371472 [5:14:05<24:08:04,  3.52it/s]
 18%|█▊        | 65801/371472 [5:14:05<26:10:02,  3.24it/s]
 18%|█▊        | 65802/371472 [5:14:05<25:21:41,  3.35it/s]
 18%|█▊        | 65803/371472 [5:14:06<24:06:16,  3.52it/s]
 18%|█▊        | 65804/371472 [5:14:06<24:12:42,  3.51it/s]
 18%|█▊        | 65805/371472 [5:14:06<22:49:42,  3.72it/s]
 18%|█▊        | 65806/371472 [5:14:06<22:50:47,  3.72it/s]
 18%|█▊        | 65807/371472 [5:14:07<22:43:21,  3.74it/s]
 18%|█▊        | 65808/371472 [5:14:07<22:47:15,  3.73it/s]
 18%|█▊        | 65809/371472 [5:14:07<22:58:57,  3.69it/s]
 18%|█▊        | 65810/371472 [5:14:07<23:52:58,  3.56it/s]
 18%|█▊        | 65811/371472 [5:14:08<23:33:04,  3.61it/s]
 18%|█▊        | 65812/371472 [5:14:08<24:23:23,  3.48it/s]
 18%|█▊        | 65813/371472 [5:14:08<25:11:51,  3.37it/s]
 18%|█▊        | 65814/371472 [5:14:09<24:36:02,  3.45it/s]
 18%|█▊        | 65815/371472 [5:14:09<24:51:13,  3.42it/s]
 18%|█▊        | 65816/371472 [5:14:09<24:11:51,  3.51it/s]
 18%|█▊        | 65817/371472 [5:14:09<23:12:00,  3.66it/s]
 18%|█▊        | 65818/371472 [5:14:10<23:18:44,  3.64it/s]
 18%|█▊        | 65819/371472 [5:14:10<23:57:52,  3.54it/s]
 18%|█▊        | 65820/371472 [5:14:10<23:22:23,  3.63it/s]
                                                           
{'loss': 4.3391, 'learning_rate': 8.409306384537481e-07, 'epoch': 2.83}

 18%|█▊        | 65820/371472 [5:14:10<23:22:23,  3.63it/s]
 18%|█▊        | 65821/371472 [5:14:11<23:19:41,  3.64it/s]
 18%|█▊        | 65822/371472 [5:14:11<23:51:39,  3.56it/s]
 18%|█▊        | 65823/371472 [5:14:11<22:55:31,  3.70it/s]
 18%|█▊        | 65824/371472 [5:14:11<23:19:52,  3.64it/s]
 18%|█▊        | 65825/371472 [5:14:12<23:33:36,  3.60it/s]
 18%|█▊        | 65826/371472 [5:14:12<25:21:23,  3.35it/s]
 18%|█▊        | 65827/371472 [5:14:12<25:13:15,  3.37it/s]
 18%|█▊        | 65828/371472 [5:14:13<24:58:41,  3.40it/s]
 18%|█▊        | 65829/371472 [5:14:13<24:10:42,  3.51it/s]
 18%|█▊        | 65830/371472 [5:14:13<22:55:56,  3.70it/s]
 18%|█▊        | 65831/371472 [5:14:13<23:56:28,  3.55it/s]
 18%|█▊        | 65832/371472 [5:14:14<24:11:03,  3.51it/s]
 18%|█▊        | 65833/371472 [5:14:14<25:26:17,  3.34it/s]
 18%|█▊        | 65834/371472 [5:14:14<25:32:05,  3.32it/s]
 18%|█▊        | 65835/371472 [5:14:15<23:55:37,  3.55it/s]
 18%|█▊        | 65836/371472 [5:14:15<23:06:09,  3.67it/s]
 18%|█▊        | 65837/371472 [5:14:15<23:21:52,  3.63it/s]
 18%|█▊        | 65838/371472 [5:14:15<25:36:41,  3.31it/s]
 18%|█▊        | 65839/371472 [5:14:16<23:59:25,  3.54it/s]
 18%|█▊        | 65840/371472 [5:14:16<23:23:30,  3.63it/s]
                                                           
{'loss': 4.1781, 'learning_rate': 8.408821564782692e-07, 'epoch': 2.84}

 18%|█▊        | 65840/371472 [5:14:16<23:23:30,  3.63it/s]
 18%|█▊        | 65841/371472 [5:14:16<22:47:05,  3.73it/s]
 18%|█▊        | 65842/371472 [5:14:16<22:29:30,  3.77it/s]
 18%|█▊        | 65843/371472 [5:14:17<22:33:20,  3.76it/s]
 18%|█▊        | 65844/371472 [5:14:17<23:58:46,  3.54it/s]
 18%|█▊        | 65845/371472 [5:14:17<23:01:16,  3.69it/s]
 18%|█▊        | 65846/371472 [5:14:18<22:42:44,  3.74it/s]
 18%|█▊        | 65847/371472 [5:14:18<22:31:34,  3.77it/s]
 18%|█▊        | 65848/371472 [5:14:18<22:48:16,  3.72it/s]
 18%|█▊        | 65849/371472 [5:14:18<23:16:28,  3.65it/s]
 18%|█▊        | 65850/371472 [5:14:19<23:57:07,  3.54it/s]
 18%|█▊        | 65851/371472 [5:14:19<23:25:38,  3.62it/s]
 18%|█▊        | 65852/371472 [5:14:19<23:37:17,  3.59it/s]
 18%|█▊        | 65853/371472 [5:14:20<26:43:13,  3.18it/s]
 18%|█▊        | 65854/371472 [5:14:20<26:38:26,  3.19it/s]
 18%|█▊        | 65855/371472 [5:14:20<25:06:47,  3.38it/s]
 18%|█▊        | 65856/371472 [5:14:20<24:47:48,  3.42it/s]
 18%|█▊        | 65857/371472 [5:14:21<24:29:07,  3.47it/s]
 18%|█▊        | 65858/371472 [5:14:21<25:34:13,  3.32it/s]
 18%|█▊        | 65859/371472 [5:14:21<24:19:09,  3.49it/s]
 18%|█▊        | 65860/371472 [5:14:22<23:15:45,  3.65it/s]
                                                           
{'loss': 4.1102, 'learning_rate': 8.408336745027904e-07, 'epoch': 2.84}

 18%|█▊        | 65860/371472 [5:14:22<23:15:45,  3.65it/s]
 18%|█▊        | 65861/371472 [5:14:22<24:54:13,  3.41it/s]
 18%|█▊        | 65862/371472 [5:14:22<25:00:40,  3.39it/s]
 18%|█▊        | 65863/371472 [5:14:22<24:17:39,  3.49it/s]
 18%|█▊        | 65864/371472 [5:14:23<26:07:35,  3.25it/s]
 18%|█▊        | 65865/371472 [5:14:23<25:33:50,  3.32it/s]
 18%|█▊        | 65866/371472 [5:14:23<24:42:13,  3.44it/s]
 18%|█▊        | 65867/371472 [5:14:24<27:22:37,  3.10it/s]
 18%|█▊        | 65868/371472 [5:14:24<26:21:03,  3.22it/s]
 18%|█▊        | 65869/371472 [5:14:24<25:55:58,  3.27it/s]
 18%|█▊        | 65870/371472 [5:14:25<26:21:03,  3.22it/s]
 18%|█▊        | 65871/371472 [5:14:25<26:23:03,  3.22it/s]
 18%|█▊        | 65872/371472 [5:14:25<25:05:40,  3.38it/s]
 18%|█▊        | 65873/371472 [5:14:26<25:06:10,  3.38it/s]
 18%|█▊        | 65874/371472 [5:14:26<24:58:32,  3.40it/s]
 18%|█▊        | 65875/371472 [5:14:26<24:07:06,  3.52it/s]
 18%|█▊        | 65876/371472 [5:14:26<23:25:31,  3.62it/s]
 18%|█▊        | 65877/371472 [5:14:27<22:18:32,  3.81it/s]
 18%|█▊        | 65878/371472 [5:14:27<23:05:31,  3.68it/s]
 18%|█▊        | 65879/371472 [5:14:27<22:50:32,  3.72it/s]
 18%|█▊        | 65880/371472 [5:14:27<21:53:34,  3.88it/s]
                                                           
{'loss': 4.2409, 'learning_rate': 8.407851925273115e-07, 'epoch': 2.84}

 18%|█▊        | 65880/371472 [5:14:27<21:53:34,  3.88it/s]
 18%|█▊        | 65881/371472 [5:14:28<21:56:51,  3.87it/s]
 18%|█▊        | 65882/371472 [5:14:28<22:39:19,  3.75it/s]
 18%|█▊        | 65883/371472 [5:14:28<23:10:02,  3.66it/s]
 18%|█▊        | 65884/371472 [5:14:29<24:32:20,  3.46it/s]
 18%|█▊        | 65885/371472 [5:14:29<23:23:25,  3.63it/s]
 18%|█▊        | 65886/371472 [5:14:29<23:00:40,  3.69it/s]
 18%|█▊        | 65887/371472 [5:14:29<22:15:32,  3.81it/s]
 18%|█▊        | 65888/371472 [5:14:30<22:08:44,  3.83it/s]
 18%|█▊        | 65889/371472 [5:14:30<21:53:25,  3.88it/s]
 18%|█▊        | 65890/371472 [5:14:30<23:10:15,  3.66it/s]
 18%|█▊        | 65891/371472 [5:14:30<23:11:55,  3.66it/s]
 18%|█▊        | 65892/371472 [5:14:31<24:44:07,  3.43it/s]
 18%|█▊        | 65893/371472 [5:14:31<26:08:56,  3.25it/s]
 18%|█▊        | 65894/371472 [5:14:31<25:31:11,  3.33it/s]
 18%|█▊        | 65895/371472 [5:14:32<26:07:12,  3.25it/s]
 18%|█▊        | 65896/371472 [5:14:32<26:33:37,  3.20it/s]
 18%|█▊        | 65897/371472 [5:14:32<25:16:24,  3.36it/s]
 18%|█▊        | 65898/371472 [5:14:33<24:53:40,  3.41it/s]
 18%|█▊        | 65899/371472 [5:14:33<23:52:16,  3.56it/s]
 18%|█▊        | 65900/371472 [5:14:33<23:04:17,  3.68it/s]
                                                           
{'loss': 4.28, 'learning_rate': 8.407367105518326e-07, 'epoch': 2.84}

 18%|█▊        | 65900/371472 [5:14:33<23:04:17,  3.68it/s]
 18%|█▊        | 65901/371472 [5:14:33<24:42:49,  3.43it/s]
 18%|█▊        | 65902/371472 [5:14:34<23:34:04,  3.60it/s]
 18%|█▊        | 65903/371472 [5:14:34<23:01:10,  3.69it/s]
 18%|█▊        | 65904/371472 [5:14:34<24:06:08,  3.52it/s]
 18%|█▊        | 65905/371472 [5:14:34<24:03:55,  3.53it/s]
 18%|█▊        | 65906/371472 [5:14:35<23:05:21,  3.68it/s]
 18%|█▊        | 65907/371472 [5:14:35<22:50:01,  3.72it/s]
 18%|█▊        | 65908/371472 [5:14:35<23:17:11,  3.64it/s]
 18%|█▊        | 65909/371472 [5:14:36<22:48:20,  3.72it/s]
 18%|█▊        | 65910/371472 [5:14:36<22:37:03,  3.75it/s]
 18%|█▊        | 65911/371472 [5:14:36<22:25:38,  3.78it/s]
 18%|█▊        | 65912/371472 [5:14:36<22:23:17,  3.79it/s]
 18%|█▊        | 65913/371472 [5:14:37<22:03:38,  3.85it/s]
 18%|█▊        | 65914/371472 [5:14:37<25:04:21,  3.39it/s]
 18%|█▊        | 65915/371472 [5:14:37<25:09:51,  3.37it/s]
 18%|█▊        | 65916/371472 [5:14:38<24:26:11,  3.47it/s]
 18%|█▊        | 65917/371472 [5:14:38<23:37:09,  3.59it/s]
 18%|█▊        | 65918/371472 [5:14:38<23:10:21,  3.66it/s]
 18%|█▊        | 65919/371472 [5:14:38<23:05:34,  3.68it/s]
 18%|█▊        | 65920/371472 [5:14:39<22:41:10,  3.74it/s]
                                                           
{'loss': 4.5097, 'learning_rate': 8.406882285763536e-07, 'epoch': 2.84}

 18%|█▊        | 65920/371472 [5:14:39<22:41:10,  3.74it/s]
 18%|█▊        | 65921/371472 [5:14:39<22:12:15,  3.82it/s]
 18%|█▊        | 65922/371472 [5:14:39<23:07:39,  3.67it/s]
 18%|█▊        | 65923/371472 [5:14:39<22:06:03,  3.84it/s]
 18%|█▊        | 65924/371472 [5:14:40<23:44:02,  3.58it/s]
 18%|█▊        | 65925/371472 [5:14:40<22:31:11,  3.77it/s]
 18%|█▊        | 65926/371472 [5:14:40<24:09:19,  3.51it/s]
 18%|█▊        | 65927/371472 [5:14:41<24:07:50,  3.52it/s]
 18%|█▊        | 65928/371472 [5:14:41<23:54:11,  3.55it/s]
 18%|█▊        | 65929/371472 [5:14:41<23:24:37,  3.63it/s]
 18%|█▊        | 65930/371472 [5:14:41<23:18:31,  3.64it/s]
 18%|█▊        | 65931/371472 [5:14:42<25:18:58,  3.35it/s]
 18%|█▊        | 65932/371472 [5:14:42<24:32:01,  3.46it/s]
 18%|█▊        | 65933/371472 [5:14:42<23:24:38,  3.63it/s]
 18%|█▊        | 65934/371472 [5:14:42<23:49:56,  3.56it/s]
 18%|█▊        | 65935/371472 [5:14:43<24:19:07,  3.49it/s]
 18%|█▊        | 65936/371472 [5:14:43<23:58:39,  3.54it/s]
 18%|█▊        | 65937/371472 [5:14:43<24:04:28,  3.53it/s]
 18%|█▊        | 65938/371472 [5:14:44<23:18:42,  3.64it/s]
 18%|█▊        | 65939/371472 [5:14:44<22:31:35,  3.77it/s]
 18%|█▊        | 65940/371472 [5:14:44<22:21:44,  3.80it/s]
                                                           
{'loss': 4.4996, 'learning_rate': 8.406397466008748e-07, 'epoch': 2.84}

 18%|█▊        | 65940/371472 [5:14:44<22:21:44,  3.80it/s]
 18%|█▊        | 65941/371472 [5:14:44<22:45:02,  3.73it/s]
 18%|█▊        | 65942/371472 [5:14:45<22:40:37,  3.74it/s]
 18%|█▊        | 65943/371472 [5:14:45<27:31:39,  3.08it/s]
 18%|█▊        | 65944/371472 [5:14:45<25:56:32,  3.27it/s]
 18%|█▊        | 65945/371472 [5:14:46<25:01:32,  3.39it/s]
 18%|█▊        | 65946/371472 [5:14:46<24:15:18,  3.50it/s]
 18%|█▊        | 65947/371472 [5:14:46<24:00:43,  3.53it/s]
 18%|█▊        | 65948/371472 [5:14:46<23:48:22,  3.56it/s]
 18%|█▊        | 65949/371472 [5:14:47<24:54:27,  3.41it/s]
 18%|█▊        | 65950/371472 [5:14:47<25:14:18,  3.36it/s]
 18%|█▊        | 65951/371472 [5:14:47<24:52:01,  3.41it/s]
 18%|█▊        | 65952/371472 [5:14:48<25:26:50,  3.33it/s]
 18%|█▊        | 65953/371472 [5:14:48<24:47:05,  3.42it/s]
 18%|█▊        | 65954/371472 [5:14:48<23:50:16,  3.56it/s]
 18%|█▊        | 65955/371472 [5:14:48<23:17:29,  3.64it/s]
 18%|█▊        | 65956/371472 [5:14:49<24:51:34,  3.41it/s]
 18%|█▊        | 65957/371472 [5:14:49<23:32:13,  3.61it/s]
 18%|█▊        | 65958/371472 [5:14:49<22:59:06,  3.69it/s]
 18%|█▊        | 65959/371472 [5:14:50<22:47:51,  3.72it/s]
 18%|█▊        | 65960/371472 [5:14:50<22:40:12,  3.74it/s]
                                                           
{'loss': 4.5238, 'learning_rate': 8.405912646253959e-07, 'epoch': 2.84}

 18%|█▊        | 65960/371472 [5:14:50<22:40:12,  3.74it/s]
 18%|█▊        | 65961/371472 [5:14:50<22:56:00,  3.70it/s]
 18%|█▊        | 65962/371472 [5:14:50<22:34:03,  3.76it/s]
 18%|█▊        | 65963/371472 [5:14:51<24:44:45,  3.43it/s]
 18%|█▊        | 65964/371472 [5:14:51<24:58:22,  3.40it/s]
 18%|█▊        | 65965/371472 [5:14:51<24:39:44,  3.44it/s]
 18%|█▊        | 65966/371472 [5:14:52<26:10:05,  3.24it/s]
 18%|█▊        | 65967/371472 [5:14:52<25:14:00,  3.36it/s]
 18%|█▊        | 65968/371472 [5:14:52<24:56:22,  3.40it/s]
 18%|█▊        | 65969/371472 [5:14:53<25:17:37,  3.36it/s]
 18%|█▊        | 65970/371472 [5:14:53<24:04:41,  3.52it/s]
 18%|█▊        | 65971/371472 [5:14:53<23:54:45,  3.55it/s]
 18%|█▊        | 65972/371472 [5:14:53<24:13:21,  3.50it/s]
 18%|█▊        | 65973/371472 [5:14:54<24:08:42,  3.51it/s]
 18%|█▊        | 65974/371472 [5:14:54<23:31:54,  3.61it/s]
 18%|█▊        | 65975/371472 [5:14:54<22:30:50,  3.77it/s]
 18%|█▊        | 65976/371472 [5:14:54<22:36:00,  3.75it/s]
 18%|█▊        | 65977/371472 [5:14:55<22:35:45,  3.76it/s]
 18%|█▊        | 65978/371472 [5:14:55<22:03:22,  3.85it/s]
 18%|█▊        | 65979/371472 [5:14:55<22:02:00,  3.85it/s]
 18%|█▊        | 65980/371472 [5:14:55<22:33:50,  3.76it/s]
                                                           
{'loss': 4.374, 'learning_rate': 8.40542782649917e-07, 'epoch': 2.84}

 18%|█▊        | 65980/371472 [5:14:55<22:33:50,  3.76it/s]
 18%|█▊        | 65981/371472 [5:14:56<23:27:02,  3.62it/s]
 18%|█▊        | 65982/371472 [5:14:56<22:46:28,  3.73it/s]
 18%|█▊        | 65983/371472 [5:14:56<22:19:36,  3.80it/s]
 18%|█▊        | 65984/371472 [5:14:57<23:32:01,  3.61it/s]
 18%|█▊        | 65985/371472 [5:14:57<23:04:09,  3.68it/s]
 18%|█▊        | 65986/371472 [5:14:57<23:08:26,  3.67it/s]
 18%|█▊        | 65987/371472 [5:14:57<22:49:59,  3.72it/s]
 18%|█▊        | 65988/371472 [5:14:58<23:35:48,  3.60it/s]
 18%|█▊        | 65989/371472 [5:14:58<22:49:45,  3.72it/s]
 18%|█▊        | 65990/371472 [5:14:58<23:05:40,  3.67it/s]
 18%|█▊        | 65991/371472 [5:14:58<23:14:56,  3.65it/s]
 18%|█▊        | 65992/371472 [5:14:59<22:44:04,  3.73it/s]
 18%|█▊        | 65993/371472 [5:14:59<23:05:21,  3.68it/s]
 18%|█▊        | 65994/371472 [5:14:59<22:51:19,  3.71it/s]
 18%|█▊        | 65995/371472 [5:14:59<22:28:10,  3.78it/s]
 18%|█▊        | 65996/371472 [5:15:00<24:05:00,  3.52it/s]
 18%|█▊        | 65997/371472 [5:15:00<23:30:52,  3.61it/s]
 18%|█▊        | 65998/371472 [5:15:00<25:06:13,  3.38it/s]
 18%|█▊        | 65999/371472 [5:15:01<25:25:52,  3.34it/s]
 18%|█▊        | 66000/371472 [5:15:01<24:22:53,  3.48it/s]
                                                           
{'loss': 4.3341, 'learning_rate': 8.404943006744381e-07, 'epoch': 2.84}

 18%|█▊        | 66000/371472 [5:15:01<24:22:53,  3.48it/s]
 18%|█▊        | 66001/371472 [5:15:01<25:01:19,  3.39it/s]
 18%|█▊        | 66002/371472 [5:15:02<24:45:08,  3.43it/s]
 18%|█▊        | 66003/371472 [5:15:02<23:50:54,  3.56it/s]
 18%|█▊        | 66004/371472 [5:15:02<23:29:18,  3.61it/s]
 18%|█▊        | 66005/371472 [5:15:02<23:21:24,  3.63it/s]
 18%|█▊        | 66006/371472 [5:15:03<23:18:02,  3.64it/s]
 18%|█▊        | 66007/371472 [5:15:03<23:52:06,  3.55it/s]
 18%|█▊        | 66008/371472 [5:15:03<23:47:29,  3.57it/s]
 18%|█▊        | 66009/371472 [5:15:03<22:58:23,  3.69it/s]
 18%|█▊        | 66010/371472 [5:15:04<22:24:17,  3.79it/s]
 18%|█▊        | 66011/371472 [5:15:04<22:58:27,  3.69it/s]
 18%|█▊        | 66012/371472 [5:15:04<24:52:40,  3.41it/s]
 18%|█▊        | 66013/371472 [5:15:05<24:03:09,  3.53it/s]
 18%|█▊        | 66014/371472 [5:15:05<24:00:14,  3.53it/s]
 18%|█▊        | 66015/371472 [5:15:05<22:35:42,  3.76it/s]
 18%|█▊        | 66016/371472 [5:15:05<22:22:53,  3.79it/s]
 18%|█▊        | 66017/371472 [5:15:06<22:15:30,  3.81it/s]
 18%|█▊        | 66018/371472 [5:15:06<24:08:00,  3.52it/s]
 18%|█▊        | 66019/371472 [5:15:06<22:53:08,  3.71it/s]
 18%|█▊        | 66020/371472 [5:15:06<22:50:08,  3.72it/s]
                                                           
{'loss': 4.2999, 'learning_rate': 8.404458186989593e-07, 'epoch': 2.84}

 18%|█▊        | 66020/371472 [5:15:06<22:50:08,  3.72it/s]
 18%|█▊        | 66021/371472 [5:15:07<23:08:10,  3.67it/s]
 18%|█▊        | 66022/371472 [5:15:07<23:47:14,  3.57it/s]
 18%|█▊        | 66023/371472 [5:15:07<23:24:20,  3.63it/s]
 18%|█▊        | 66024/371472 [5:15:08<23:49:45,  3.56it/s]
 18%|█▊        | 66025/371472 [5:15:08<24:13:25,  3.50it/s]
 18%|█▊        | 66026/371472 [5:15:08<25:16:00,  3.36it/s]
 18%|█▊        | 66027/371472 [5:15:08<24:13:54,  3.50it/s]
 18%|█▊        | 66028/371472 [5:15:09<24:42:38,  3.43it/s]
 18%|█▊        | 66029/371472 [5:15:09<24:26:24,  3.47it/s]
 18%|█▊        | 66030/371472 [5:15:09<24:09:08,  3.51it/s]
 18%|█▊        | 66031/371472 [5:15:10<23:48:37,  3.56it/s]
 18%|█▊        | 66032/371472 [5:15:10<26:48:10,  3.17it/s]
 18%|█▊        | 66033/371472 [5:15:10<25:45:57,  3.29it/s]
 18%|█▊        | 66034/371472 [5:15:11<24:22:00,  3.48it/s]
 18%|█▊        | 66035/371472 [5:15:11<24:46:17,  3.43it/s]
 18%|█▊        | 66036/371472 [5:15:11<24:48:26,  3.42it/s]
 18%|█▊        | 66037/371472 [5:15:11<24:50:38,  3.42it/s]
 18%|█▊        | 66038/371472 [5:15:12<23:25:40,  3.62it/s]
 18%|█▊        | 66039/371472 [5:15:12<24:56:07,  3.40it/s]
 18%|█▊        | 66040/371472 [5:15:12<25:29:38,  3.33it/s]
                                                           
{'loss': 4.0023, 'learning_rate': 8.403973367234803e-07, 'epoch': 2.84}

 18%|█▊        | 66040/371472 [5:15:12<25:29:38,  3.33it/s]
 18%|█▊        | 66041/371472 [5:15:13<24:13:51,  3.50it/s]
 18%|█▊        | 66042/371472 [5:15:13<23:16:32,  3.65it/s]
 18%|█▊        | 66043/371472 [5:15:13<24:02:58,  3.53it/s]
 18%|█▊        | 66044/371472 [5:15:13<23:15:32,  3.65it/s]
 18%|█▊        | 66045/371472 [5:15:14<22:54:47,  3.70it/s]
 18%|█▊        | 66046/371472 [5:15:14<22:34:12,  3.76it/s]
 18%|█▊        | 66047/371472 [5:15:14<22:27:50,  3.78it/s]
 18%|█▊        | 66048/371472 [5:15:14<22:24:21,  3.79it/s]
 18%|█▊        | 66049/371472 [5:15:15<22:02:29,  3.85it/s]
 18%|█▊        | 66050/371472 [5:15:15<21:47:03,  3.89it/s]
 18%|█▊        | 66051/371472 [5:15:15<21:48:26,  3.89it/s]
 18%|█▊        | 66052/371472 [5:15:15<22:18:41,  3.80it/s]
 18%|█▊        | 66053/371472 [5:15:16<27:57:53,  3.03it/s]
 18%|█▊        | 66054/371472 [5:15:16<28:51:41,  2.94it/s]
 18%|█▊        | 66055/371472 [5:15:17<27:52:59,  3.04it/s]
 18%|█▊        | 66056/371472 [5:15:17<26:01:24,  3.26it/s]
 18%|█▊        | 66057/371472 [5:15:17<24:47:03,  3.42it/s]
 18%|█▊        | 66058/371472 [5:15:17<24:13:01,  3.50it/s]
 18%|█▊        | 66059/371472 [5:15:18<24:37:32,  3.45it/s]
 18%|█▊        | 66060/371472 [5:15:18<24:30:11,  3.46it/s]
                                                           
{'loss': 4.3215, 'learning_rate': 8.403488547480014e-07, 'epoch': 2.85}

 18%|█▊        | 66060/371472 [5:15:18<24:30:11,  3.46it/s]
 18%|█▊        | 66061/371472 [5:15:18<24:38:55,  3.44it/s]
 18%|█▊        | 66062/371472 [5:15:19<24:29:08,  3.46it/s]
 18%|█▊        | 66063/371472 [5:15:19<24:22:41,  3.48it/s]
 18%|█▊        | 66064/371472 [5:15:19<23:34:07,  3.60it/s]
 18%|█▊        | 66065/371472 [5:15:19<24:05:58,  3.52it/s]
 18%|█▊        | 66066/371472 [5:15:20<24:42:14,  3.43it/s]
 18%|█▊        | 66067/371472 [5:15:20<24:04:41,  3.52it/s]
 18%|█▊        | 66068/371472 [5:15:20<23:08:37,  3.67it/s]
 18%|█▊        | 66069/371472 [5:15:21<23:51:50,  3.55it/s]
 18%|█▊        | 66070/371472 [5:15:21<22:29:04,  3.77it/s]
 18%|█▊        | 66071/371472 [5:15:21<23:31:20,  3.61it/s]
 18%|█▊        | 66072/371472 [5:15:21<23:05:07,  3.67it/s]
 18%|█▊        | 66073/371472 [5:15:22<25:13:57,  3.36it/s]
 18%|█▊        | 66074/371472 [5:15:22<24:36:31,  3.45it/s]
 18%|█▊        | 66075/371472 [5:15:22<24:05:09,  3.52it/s]
 18%|█▊        | 66076/371472 [5:15:23<24:09:01,  3.51it/s]
 18%|█▊        | 66077/371472 [5:15:23<23:09:17,  3.66it/s]
 18%|█▊        | 66078/371472 [5:15:23<25:39:54,  3.31it/s]
 18%|█▊        | 66079/371472 [5:15:23<26:36:01,  3.19it/s]
 18%|█▊        | 66080/371472 [5:15:24<24:48:43,  3.42it/s]
                                                           
{'loss': 4.4189, 'learning_rate': 8.403003727725225e-07, 'epoch': 2.85}

 18%|█▊        | 66080/371472 [5:15:24<24:48:43,  3.42it/s]
 18%|█▊        | 66081/371472 [5:15:24<25:21:00,  3.35it/s]
 18%|█▊        | 66082/371472 [5:15:24<26:56:02,  3.15it/s]
 18%|█▊        | 66083/371472 [5:15:25<25:11:42,  3.37it/s]
 18%|█▊        | 66084/371472 [5:15:25<24:48:48,  3.42it/s]
 18%|█▊        | 66085/371472 [5:15:25<24:44:05,  3.43it/s]
 18%|█▊        | 66086/371472 [5:15:25<24:09:22,  3.51it/s]
 18%|█▊        | 66087/371472 [5:15:26<24:40:15,  3.44it/s]
 18%|█▊        | 66088/371472 [5:15:26<23:52:31,  3.55it/s]
 18%|█▊        | 66089/371472 [5:15:26<25:37:56,  3.31it/s]
 18%|█▊        | 66090/371472 [5:15:27<25:49:10,  3.29it/s]
 18%|█▊        | 66091/371472 [5:15:27<24:54:53,  3.40it/s]
 18%|█▊        | 66092/371472 [5:15:27<27:45:17,  3.06it/s]
 18%|█▊        | 66093/371472 [5:15:28<27:28:42,  3.09it/s]
 18%|█▊        | 66094/371472 [5:15:28<26:29:23,  3.20it/s]
 18%|█▊        | 66095/371472 [5:15:28<28:03:53,  3.02it/s]
 18%|█▊        | 66096/371472 [5:15:29<26:49:57,  3.16it/s]
 18%|█▊        | 66097/371472 [5:15:29<26:40:36,  3.18it/s]
 18%|█▊        | 66098/371472 [5:15:29<26:23:56,  3.21it/s]
 18%|█▊        | 66099/371472 [5:15:29<24:55:39,  3.40it/s]
 18%|█▊        | 66100/371472 [5:15:30<24:28:05,  3.47it/s]
                                                           
{'loss': 4.0156, 'learning_rate': 8.402518907970436e-07, 'epoch': 2.85}

 18%|█▊        | 66100/371472 [5:15:30<24:28:05,  3.47it/s]
 18%|█▊        | 66101/371472 [5:15:30<24:29:41,  3.46it/s]
 18%|█▊        | 66102/371472 [5:15:30<23:38:30,  3.59it/s]
 18%|█▊        | 66103/371472 [5:15:31<23:50:43,  3.56it/s]
 18%|█▊        | 66104/371472 [5:15:31<23:10:49,  3.66it/s]
 18%|█▊        | 66105/371472 [5:15:31<22:50:45,  3.71it/s]
 18%|█▊        | 66106/371472 [5:15:31<23:14:10,  3.65it/s]
 18%|█▊        | 66107/371472 [5:15:32<22:31:08,  3.77it/s]
 18%|█▊        | 66108/371472 [5:15:32<22:16:50,  3.81it/s]
 18%|█▊        | 66109/371472 [5:15:32<22:34:57,  3.76it/s]
 18%|█▊        | 66110/371472 [5:15:33<24:18:27,  3.49it/s]
 18%|█▊        | 66111/371472 [5:15:33<23:34:07,  3.60it/s]
 18%|█▊        | 66112/371472 [5:15:33<23:35:08,  3.60it/s]
 18%|█▊        | 66113/371472 [5:15:33<23:09:54,  3.66it/s]
 18%|█▊        | 66114/371472 [5:15:34<23:38:49,  3.59it/s]
 18%|█▊        | 66115/371472 [5:15:34<22:55:17,  3.70it/s]
 18%|█▊        | 66116/371472 [5:15:34<23:29:29,  3.61it/s]
 18%|█▊        | 66117/371472 [5:15:34<24:51:09,  3.41it/s]
 18%|█▊        | 66118/371472 [5:15:35<26:32:37,  3.20it/s]
 18%|█▊        | 66119/371472 [5:15:35<27:11:59,  3.12it/s]
 18%|█▊        | 66120/371472 [5:15:35<25:37:46,  3.31it/s]
                                                           
{'loss': 3.8661, 'learning_rate': 8.402034088215648e-07, 'epoch': 2.85}

 18%|█▊        | 66120/371472 [5:15:35<25:37:46,  3.31it/s]
 18%|█▊        | 66121/371472 [5:15:36<25:25:56,  3.34it/s]
 18%|█▊        | 66122/371472 [5:15:36<24:37:59,  3.44it/s]
 18%|█▊        | 66123/371472 [5:15:36<24:04:48,  3.52it/s]
 18%|█▊        | 66124/371472 [5:15:37<23:35:37,  3.59it/s]
 18%|█▊        | 66125/371472 [5:15:37<23:37:23,  3.59it/s]
 18%|█▊        | 66126/371472 [5:15:37<23:11:16,  3.66it/s]
 18%|█▊        | 66127/371472 [5:15:37<23:49:14,  3.56it/s]
 18%|█▊        | 66128/371472 [5:15:38<23:31:21,  3.61it/s]
 18%|█▊        | 66129/371472 [5:15:38<22:40:19,  3.74it/s]
 18%|█▊        | 66130/371472 [5:15:38<22:47:04,  3.72it/s]
 18%|█▊        | 66131/371472 [5:15:38<22:19:40,  3.80it/s]
 18%|█▊        | 66132/371472 [5:15:39<21:54:36,  3.87it/s]
 18%|█▊        | 66133/371472 [5:15:39<22:06:17,  3.84it/s]
 18%|█▊        | 66134/371472 [5:15:39<23:37:54,  3.59it/s]
 18%|█▊        | 66135/371472 [5:15:40<24:46:06,  3.42it/s]
 18%|█▊        | 66136/371472 [5:15:40<24:15:45,  3.50it/s]
 18%|█▊        | 66137/371472 [5:15:40<23:26:59,  3.62it/s]
 18%|█▊        | 66138/371472 [5:15:40<23:05:42,  3.67it/s]
 18%|█▊        | 66139/371472 [5:15:41<23:03:49,  3.68it/s]
 18%|█▊        | 66140/371472 [5:15:41<23:36:36,  3.59it/s]
                                                           
{'loss': 4.1853, 'learning_rate': 8.401549268460858e-07, 'epoch': 2.85}

 18%|█▊        | 66140/371472 [5:15:41<23:36:36,  3.59it/s]
 18%|█▊        | 66141/371472 [5:15:41<24:21:18,  3.48it/s]
 18%|█▊        | 66142/371472 [5:15:41<23:42:56,  3.58it/s]
 18%|█▊        | 66143/371472 [5:15:42<23:54:30,  3.55it/s]
 18%|█▊        | 66144/371472 [5:15:42<23:16:24,  3.64it/s]
 18%|█▊        | 66145/371472 [5:15:42<22:39:44,  3.74it/s]
 18%|█▊        | 66146/371472 [5:15:43<22:07:20,  3.83it/s]
 18%|█▊        | 66147/371472 [5:15:43<22:57:39,  3.69it/s]
 18%|█▊        | 66148/371472 [5:15:43<22:40:52,  3.74it/s]
 18%|█▊        | 66149/371472 [5:15:43<23:03:56,  3.68it/s]
 18%|█▊        | 66150/371472 [5:15:44<23:09:43,  3.66it/s]
 18%|█▊        | 66151/371472 [5:15:44<24:09:27,  3.51it/s]
 18%|█▊        | 66152/371472 [5:15:44<23:59:19,  3.54it/s]
 18%|█▊        | 66153/371472 [5:15:45<24:25:15,  3.47it/s]
 18%|█▊        | 66154/371472 [5:15:45<24:00:58,  3.53it/s]
 18%|█▊        | 66155/371472 [5:15:45<24:41:43,  3.43it/s]
 18%|█▊        | 66156/371472 [5:15:45<25:17:50,  3.35it/s]
 18%|█▊        | 66157/371472 [5:15:46<23:51:03,  3.56it/s]
 18%|█▊        | 66158/371472 [5:15:46<22:49:19,  3.72it/s]
 18%|█▊        | 66159/371472 [5:15:46<23:53:32,  3.55it/s]
 18%|█▊        | 66160/371472 [5:15:46<22:53:28,  3.70it/s]
                                                           
{'loss': 4.0573, 'learning_rate': 8.40106444870607e-07, 'epoch': 2.85}

 18%|█▊        | 66160/371472 [5:15:46<22:53:28,  3.70it/s]
 18%|█▊        | 66161/371472 [5:15:47<23:04:42,  3.67it/s]
 18%|█▊        | 66162/371472 [5:15:47<23:20:58,  3.63it/s]
 18%|█▊        | 66163/371472 [5:15:47<23:03:54,  3.68it/s]
 18%|█▊        | 66164/371472 [5:15:48<23:40:28,  3.58it/s]
 18%|█▊        | 66165/371472 [5:15:48<22:57:54,  3.69it/s]
 18%|█▊        | 66166/371472 [5:15:48<22:05:47,  3.84it/s]
 18%|█▊        | 66167/371472 [5:15:48<22:47:58,  3.72it/s]
 18%|█▊        | 66168/371472 [5:15:49<23:33:34,  3.60it/s]
 18%|█▊        | 66169/371472 [5:15:49<23:58:59,  3.54it/s]
 18%|█▊        | 66170/371472 [5:15:49<23:04:05,  3.68it/s]
 18%|█▊        | 66171/371472 [5:15:49<22:49:48,  3.71it/s]
 18%|█▊        | 66172/371472 [5:15:50<23:22:05,  3.63it/s]
 18%|█▊        | 66173/371472 [5:15:50<22:37:19,  3.75it/s]
 18%|█▊        | 66174/371472 [5:15:50<22:23:52,  3.79it/s]
 18%|█▊        | 66175/371472 [5:15:51<23:28:09,  3.61it/s]
 18%|█▊        | 66176/371472 [5:15:51<23:31:34,  3.60it/s]
 18%|█▊        | 66177/371472 [5:15:51<24:07:10,  3.52it/s]
 18%|█▊        | 66178/371472 [5:15:51<25:43:54,  3.30it/s]
 18%|█▊        | 66179/371472 [5:15:52<24:12:02,  3.50it/s]
 18%|█▊        | 66180/371472 [5:15:52<25:09:13,  3.37it/s]
                                                           
{'loss': 4.1377, 'learning_rate': 8.40057962895128e-07, 'epoch': 2.85}

 18%|█▊        | 66180/371472 [5:15:52<25:09:13,  3.37it/s]
 18%|█▊        | 66181/371472 [5:15:52<24:21:56,  3.48it/s]
 18%|█▊        | 66182/371472 [5:15:53<23:12:28,  3.65it/s]
 18%|█▊        | 66183/371472 [5:15:53<22:26:53,  3.78it/s]
 18%|█▊        | 66184/371472 [5:15:53<22:35:36,  3.75it/s]
 18%|█▊        | 66185/371472 [5:15:53<23:30:16,  3.61it/s]
 18%|█▊        | 66186/371472 [5:15:54<23:00:49,  3.68it/s]
 18%|█▊        | 66187/371472 [5:15:54<24:18:17,  3.49it/s]
 18%|█▊        | 66188/371472 [5:15:54<23:57:32,  3.54it/s]
 18%|█▊        | 66189/371472 [5:15:54<23:41:03,  3.58it/s]
 18%|█▊        | 66190/371472 [5:15:55<22:32:19,  3.76it/s]
 18%|█▊        | 66191/371472 [5:15:55<23:39:48,  3.58it/s]
 18%|█▊        | 66192/371472 [5:15:55<23:51:50,  3.55it/s]
 18%|█▊        | 66193/371472 [5:15:56<25:59:55,  3.26it/s]
 18%|█▊        | 66194/371472 [5:15:56<25:10:43,  3.37it/s]
 18%|█▊        | 66195/371472 [5:15:56<24:39:10,  3.44it/s]
 18%|█▊        | 66196/371472 [5:15:57<24:19:40,  3.49it/s]
 18%|█▊        | 66197/371472 [5:15:57<24:12:33,  3.50it/s]
 18%|█▊        | 66198/371472 [5:15:57<24:52:29,  3.41it/s]
 18%|█▊        | 66199/371472 [5:15:57<25:11:47,  3.37it/s]
 18%|█▊        | 66200/371472 [5:15:58<24:06:49,  3.52it/s]
                                                           
{'loss': 4.17, 'learning_rate': 8.400094809196492e-07, 'epoch': 2.85}

 18%|█▊        | 66200/371472 [5:15:58<24:06:49,  3.52it/s]
 18%|█▊        | 66201/371472 [5:15:58<23:45:26,  3.57it/s]
 18%|█▊        | 66202/371472 [5:15:58<23:44:14,  3.57it/s]
 18%|█▊        | 66203/371472 [5:15:59<24:00:14,  3.53it/s]
 18%|█▊        | 66204/371472 [5:15:59<24:12:08,  3.50it/s]
 18%|█▊        | 66205/371472 [5:15:59<23:45:36,  3.57it/s]
 18%|█▊        | 66206/371472 [5:15:59<24:29:10,  3.46it/s]
 18%|█▊        | 66207/371472 [5:16:00<24:04:16,  3.52it/s]
 18%|█▊        | 66208/371472 [5:16:00<23:10:33,  3.66it/s]
 18%|█▊        | 66209/371472 [5:16:00<22:46:37,  3.72it/s]
 18%|█▊        | 66210/371472 [5:16:00<23:19:38,  3.63it/s]
 18%|█▊        | 66211/371472 [5:16:01<23:03:34,  3.68it/s]
 18%|█▊        | 66212/371472 [5:16:01<24:09:54,  3.51it/s]
 18%|█▊        | 66213/371472 [5:16:01<23:29:55,  3.61it/s]
 18%|█▊        | 66214/371472 [5:16:02<23:36:46,  3.59it/s]
 18%|█▊        | 66215/371472 [5:16:02<23:15:28,  3.65it/s]
 18%|█▊        | 66216/371472 [5:16:02<24:33:40,  3.45it/s]
 18%|█▊        | 66217/371472 [5:16:02<23:36:47,  3.59it/s]
 18%|█▊        | 66218/371472 [5:16:03<23:35:47,  3.59it/s]
 18%|█▊        | 66219/371472 [5:16:03<23:29:18,  3.61it/s]
 18%|█▊        | 66220/371472 [5:16:03<23:57:27,  3.54it/s]
                                                           
{'loss': 4.1114, 'learning_rate': 8.399609989441702e-07, 'epoch': 2.85}

 18%|█▊        | 66220/371472 [5:16:03<23:57:27,  3.54it/s]
 18%|█▊        | 66221/371472 [5:16:04<23:19:27,  3.64it/s]
 18%|█▊        | 66222/371472 [5:16:04<24:04:25,  3.52it/s]
 18%|█▊        | 66223/371472 [5:16:04<24:32:25,  3.46it/s]
 18%|█▊        | 66224/371472 [5:16:04<24:25:24,  3.47it/s]
 18%|█▊        | 66225/371472 [5:16:05<24:24:02,  3.47it/s]
 18%|█▊        | 66226/371472 [5:16:05<24:28:10,  3.47it/s]
 18%|█▊        | 66227/371472 [5:16:05<23:36:28,  3.59it/s]
 18%|█▊        | 66228/371472 [5:16:06<25:10:09,  3.37it/s]
 18%|█▊        | 66229/371472 [5:16:06<24:06:46,  3.52it/s]
 18%|█▊        | 66230/371472 [5:16:06<23:25:19,  3.62it/s]
 18%|█▊        | 66231/371472 [5:16:06<23:55:12,  3.54it/s]
 18%|█▊        | 66232/371472 [5:16:07<23:30:32,  3.61it/s]
 18%|█▊        | 66233/371472 [5:16:07<23:06:10,  3.67it/s]
 18%|█▊        | 66234/371472 [5:16:07<23:00:31,  3.69it/s]
 18%|█▊        | 66235/371472 [5:16:08<24:23:37,  3.48it/s]
 18%|█▊        | 66236/371472 [5:16:08<23:55:00,  3.55it/s]
 18%|█▊        | 66237/371472 [5:16:08<23:17:21,  3.64it/s]
 18%|█▊        | 66238/371472 [5:16:08<23:54:42,  3.55it/s]
 18%|█▊        | 66239/371472 [5:16:09<23:17:04,  3.64it/s]
 18%|█▊        | 66240/371472 [5:16:09<23:18:42,  3.64it/s]
                                                           
{'loss': 4.0018, 'learning_rate': 8.399125169686913e-07, 'epoch': 2.85}

 18%|█▊        | 66240/371472 [5:16:09<23:18:42,  3.64it/s]
 18%|█▊        | 66241/371472 [5:16:09<25:30:11,  3.32it/s]
 18%|█▊        | 66242/371472 [5:16:10<24:54:50,  3.40it/s]
 18%|█▊        | 66243/371472 [5:16:10<25:07:52,  3.37it/s]
 18%|█▊        | 66244/371472 [5:16:10<25:02:48,  3.39it/s]
 18%|█▊        | 66245/371472 [5:16:10<23:44:17,  3.57it/s]
 18%|█▊        | 66246/371472 [5:16:11<23:11:29,  3.66it/s]
 18%|█▊        | 66247/371472 [5:16:11<23:06:03,  3.67it/s]
 18%|█▊        | 66248/371472 [5:16:11<23:04:48,  3.67it/s]
 18%|█▊        | 66249/371472 [5:16:11<23:33:08,  3.60it/s]
 18%|█▊        | 66250/371472 [5:16:12<25:44:09,  3.29it/s]
 18%|█▊        | 66251/371472 [5:16:12<24:40:13,  3.44it/s]
 18%|█▊        | 66252/371472 [5:16:12<24:37:51,  3.44it/s]
 18%|█▊        | 66253/371472 [5:16:13<23:39:46,  3.58it/s]
 18%|█▊        | 66254/371472 [5:16:13<26:06:29,  3.25it/s]
 18%|█▊        | 66255/371472 [5:16:13<25:02:29,  3.39it/s]
 18%|█▊        | 66256/371472 [5:16:13<23:45:41,  3.57it/s]
 18%|█▊        | 66257/371472 [5:16:14<24:19:32,  3.49it/s]
 18%|█▊        | 66258/371472 [5:16:14<23:16:29,  3.64it/s]
 18%|█▊        | 66259/371472 [5:16:14<22:29:32,  3.77it/s]
 18%|█▊        | 66260/371472 [5:16:15<22:50:15,  3.71it/s]
                                                           
{'loss': 4.0871, 'learning_rate': 8.398640349932125e-07, 'epoch': 2.85}

 18%|█▊        | 66260/371472 [5:16:15<22:50:15,  3.71it/s]
 18%|█▊        | 66261/371472 [5:16:15<22:42:26,  3.73it/s]
 18%|█▊        | 66262/371472 [5:16:15<22:45:06,  3.73it/s]
 18%|█▊        | 66263/371472 [5:16:15<24:04:20,  3.52it/s]
 18%|█▊        | 66264/371472 [5:16:16<23:40:17,  3.58it/s]
 18%|█▊        | 66265/371472 [5:16:16<25:08:58,  3.37it/s]
 18%|█▊        | 66266/371472 [5:16:16<24:16:38,  3.49it/s]
 18%|█▊        | 66267/371472 [5:16:17<25:41:40,  3.30it/s]
 18%|█▊        | 66268/371472 [5:16:17<24:47:39,  3.42it/s]
 18%|█▊        | 66269/371472 [5:16:17<23:45:59,  3.57it/s]
 18%|█▊        | 66270/371472 [5:16:17<22:52:27,  3.71it/s]
 18%|█▊        | 66271/371472 [5:16:18<22:41:17,  3.74it/s]
 18%|█▊        | 66272/371472 [5:16:18<23:01:54,  3.68it/s]
 18%|█▊        | 66273/371472 [5:16:18<22:50:16,  3.71it/s]
 18%|█▊        | 66274/371472 [5:16:18<23:09:10,  3.66it/s]
 18%|█▊        | 66275/371472 [5:16:19<23:17:00,  3.64it/s]
 18%|█▊        | 66276/371472 [5:16:19<22:52:41,  3.71it/s]
 18%|█▊        | 66277/371472 [5:16:19<22:37:36,  3.75it/s]
 18%|█▊        | 66278/371472 [5:16:20<22:31:06,  3.76it/s]
 18%|█▊        | 66279/371472 [5:16:20<23:01:04,  3.68it/s]
 18%|█▊        | 66280/371472 [5:16:20<22:47:35,  3.72it/s]
                                                           
{'loss': 4.1926, 'learning_rate': 8.398155530177337e-07, 'epoch': 2.85}

 18%|█▊        | 66280/371472 [5:16:20<22:47:35,  3.72it/s]
 18%|█▊        | 66281/371472 [5:16:20<22:28:01,  3.77it/s]
 18%|█▊        | 66282/371472 [5:16:21<22:05:02,  3.84it/s]
 18%|█▊        | 66283/371472 [5:16:21<26:05:56,  3.25it/s]
 18%|█▊        | 66284/371472 [5:16:21<24:52:53,  3.41it/s]
 18%|█▊        | 66285/371472 [5:16:22<25:45:41,  3.29it/s]
 18%|█▊        | 66286/371472 [5:16:22<25:09:34,  3.37it/s]
 18%|█▊        | 66287/371472 [5:16:22<25:46:21,  3.29it/s]
 18%|█▊        | 66288/371472 [5:16:22<24:39:09,  3.44it/s]
 18%|█▊        | 66289/371472 [5:16:23<24:52:11,  3.41it/s]
 18%|█▊        | 66290/371472 [5:16:23<24:17:14,  3.49it/s]
 18%|█▊        | 66291/371472 [5:16:23<23:48:57,  3.56it/s]
 18%|█▊        | 66292/371472 [5:16:24<25:27:12,  3.33it/s]
 18%|█▊        | 66293/371472 [5:16:24<26:13:11,  3.23it/s]
 18%|█▊        | 66294/371472 [5:16:24<26:28:54,  3.20it/s]
 18%|█▊        | 66295/371472 [5:16:25<26:36:21,  3.19it/s]
 18%|█▊        | 66296/371472 [5:16:25<25:26:35,  3.33it/s]
 18%|█▊        | 66297/371472 [5:16:25<24:29:24,  3.46it/s]
 18%|█▊        | 66298/371472 [5:16:25<26:07:00,  3.25it/s]
 18%|█▊        | 66299/371472 [5:16:26<24:54:35,  3.40it/s]
 18%|█▊        | 66300/371472 [5:16:26<23:43:05,  3.57it/s]
                                                           
{'loss': 4.2544, 'learning_rate': 8.397670710422546e-07, 'epoch': 2.86}

 18%|█▊        | 66300/371472 [5:16:26<23:43:05,  3.57it/s]
 18%|█▊        | 66301/371472 [5:16:26<23:30:27,  3.61it/s]
 18%|█▊        | 66302/371472 [5:16:27<23:19:49,  3.63it/s]
 18%|█▊        | 66303/371472 [5:16:27<23:58:12,  3.54it/s]
 18%|█▊        | 66304/371472 [5:16:27<26:32:06,  3.19it/s]
 18%|█▊        | 66305/371472 [5:16:28<28:22:05,  2.99it/s]
 18%|█▊        | 66306/371472 [5:16:28<26:04:28,  3.25it/s]
 18%|█▊        | 66307/371472 [5:16:28<25:21:08,  3.34it/s]
 18%|█▊        | 66308/371472 [5:16:28<25:56:53,  3.27it/s]
 18%|█▊        | 66309/371472 [5:16:29<26:07:56,  3.24it/s]
 18%|█▊        | 66310/371472 [5:16:29<25:28:22,  3.33it/s]
 18%|█▊        | 66311/371472 [5:16:29<24:45:53,  3.42it/s]
 18%|█▊        | 66312/371472 [5:16:30<24:32:39,  3.45it/s]
 18%|█▊        | 66313/371472 [5:16:30<24:12:23,  3.50it/s]
 18%|█▊        | 66314/371472 [5:16:30<23:37:47,  3.59it/s]
 18%|█▊        | 66315/371472 [5:16:30<24:15:04,  3.50it/s]
 18%|█▊        | 66316/371472 [5:16:31<23:25:41,  3.62it/s]
 18%|█▊        | 66317/371472 [5:16:31<22:30:25,  3.77it/s]
 18%|█▊        | 66318/371472 [5:16:31<23:36:10,  3.59it/s]
 18%|█▊        | 66319/371472 [5:16:32<25:31:30,  3.32it/s]
 18%|█▊        | 66320/371472 [5:16:32<23:47:14,  3.56it/s]
                                                           
{'loss': 4.093, 'learning_rate': 8.397185890667758e-07, 'epoch': 2.86}

 18%|█▊        | 66320/371472 [5:16:32<23:47:14,  3.56it/s]
 18%|█▊        | 66321/371472 [5:16:32<22:53:06,  3.70it/s]
 18%|█▊        | 66322/371472 [5:16:32<22:03:22,  3.84it/s]
 18%|█▊        | 66323/371472 [5:16:33<22:11:31,  3.82it/s]
 18%|█▊        | 66324/371472 [5:16:33<22:01:51,  3.85it/s]
 18%|█▊        | 66325/371472 [5:16:33<21:41:21,  3.91it/s]
 18%|█▊        | 66326/371472 [5:16:33<23:37:36,  3.59it/s]
 18%|█▊        | 66327/371472 [5:16:34<24:02:18,  3.53it/s]
 18%|█▊        | 66328/371472 [5:16:34<24:17:15,  3.49it/s]
 18%|█▊        | 66329/371472 [5:16:34<24:22:23,  3.48it/s]
 18%|█▊        | 66330/371472 [5:16:35<23:42:51,  3.57it/s]
 18%|█▊        | 66331/371472 [5:16:35<23:30:06,  3.61it/s]
 18%|█▊        | 66332/371472 [5:16:35<23:47:29,  3.56it/s]
 18%|█▊        | 66333/371472 [5:16:35<25:35:57,  3.31it/s]
 18%|█▊        | 66334/371472 [5:16:36<28:04:08,  3.02it/s]
 18%|█▊        | 66335/371472 [5:16:36<25:47:42,  3.29it/s]
 18%|█▊        | 66336/371472 [5:16:36<24:50:33,  3.41it/s]
 18%|█▊        | 66337/371472 [5:16:37<24:16:15,  3.49it/s]
 18%|█▊        | 66338/371472 [5:16:37<25:04:17,  3.38it/s]
 18%|█▊        | 66339/371472 [5:16:37<24:25:32,  3.47it/s]
 18%|█▊        | 66340/371472 [5:16:38<24:55:28,  3.40it/s]
                                                           
{'loss': 4.1454, 'learning_rate': 8.396701070912969e-07, 'epoch': 2.86}

 18%|█▊        | 66340/371472 [5:16:38<24:55:28,  3.40it/s]
 18%|█▊        | 66341/371472 [5:16:38<24:28:08,  3.46it/s]
 18%|█▊        | 66342/371472 [5:16:38<25:47:10,  3.29it/s]
 18%|█▊        | 66343/371472 [5:16:38<24:28:20,  3.46it/s]
 18%|█▊        | 66344/371472 [5:16:39<24:22:20,  3.48it/s]
 18%|█▊        | 66345/371472 [5:16:39<24:19:27,  3.48it/s]
 18%|█▊        | 66346/371472 [5:16:39<23:55:13,  3.54it/s]
 18%|█▊        | 66347/371472 [5:16:40<24:34:43,  3.45it/s]
 18%|█▊        | 66348/371472 [5:16:40<23:51:36,  3.55it/s]
 18%|█▊        | 66349/371472 [5:16:40<24:56:06,  3.40it/s]
 18%|█▊        | 66350/371472 [5:16:40<25:13:15,  3.36it/s]
 18%|█▊        | 66351/371472 [5:16:41<24:25:34,  3.47it/s]
 18%|█▊        | 66352/371472 [5:16:41<25:00:20,  3.39it/s]
 18%|█▊        | 66353/371472 [5:16:41<24:51:14,  3.41it/s]
 18%|█▊        | 66354/371472 [5:16:42<23:51:45,  3.55it/s]
 18%|█▊        | 66355/371472 [5:16:42<24:24:28,  3.47it/s]
 18%|█▊        | 66356/371472 [5:16:42<23:16:13,  3.64it/s]
 18%|█▊        | 66357/371472 [5:16:42<23:33:31,  3.60it/s]
 18%|█▊        | 66358/371472 [5:16:43<24:01:09,  3.53it/s]
 18%|█▊        | 66359/371472 [5:16:43<25:03:52,  3.38it/s]
 18%|█▊        | 66360/371472 [5:16:43<25:39:53,  3.30it/s]
                                                           
{'loss': 4.237, 'learning_rate': 8.39621625115818e-07, 'epoch': 2.86}

 18%|█▊        | 66360/371472 [5:16:43<25:39:53,  3.30it/s]
 18%|█▊        | 66361/371472 [5:16:44<24:10:15,  3.51it/s]
 18%|█▊        | 66362/371472 [5:16:44<23:30:24,  3.61it/s]
 18%|█▊        | 66363/371472 [5:16:44<24:09:44,  3.51it/s]
 18%|█▊        | 66364/371472 [5:16:44<24:02:31,  3.53it/s]
 18%|█▊        | 66365/371472 [5:16:45<24:04:02,  3.52it/s]
 18%|█▊        | 66366/371472 [5:16:45<24:31:06,  3.46it/s]
 18%|█▊        | 66367/371472 [5:16:45<25:15:15,  3.36it/s]
 18%|█▊        | 66368/371472 [5:16:46<24:42:59,  3.43it/s]
 18%|█▊        | 66369/371472 [5:16:46<23:22:34,  3.63it/s]
 18%|█▊        | 66370/371472 [5:16:46<24:54:12,  3.40it/s]
 18%|█▊        | 66371/371472 [5:16:46<23:23:58,  3.62it/s]
 18%|█▊        | 66372/371472 [5:16:47<23:24:02,  3.62it/s]
 18%|█▊        | 66373/371472 [5:16:47<22:47:19,  3.72it/s]
 18%|█▊        | 66374/371472 [5:16:47<22:18:22,  3.80it/s]
 18%|█▊        | 66375/371472 [5:16:47<22:52:58,  3.70it/s]
 18%|█▊        | 66376/371472 [5:16:48<23:39:09,  3.58it/s]
 18%|█▊        | 66377/371472 [5:16:48<23:27:17,  3.61it/s]
 18%|█▊        | 66378/371472 [5:16:48<23:41:24,  3.58it/s]
 18%|█▊        | 66379/371472 [5:16:49<24:01:33,  3.53it/s]
 18%|█▊        | 66380/371472 [5:16:49<24:07:05,  3.51it/s]
                                                           
{'loss': 4.1079, 'learning_rate': 8.395731431403391e-07, 'epoch': 2.86}

 18%|█▊        | 66380/371472 [5:16:49<24:07:05,  3.51it/s]
 18%|█▊        | 66381/371472 [5:16:49<23:54:26,  3.54it/s]
 18%|█▊        | 66382/371472 [5:16:49<23:20:05,  3.63it/s]
 18%|█▊        | 66383/371472 [5:16:50<23:16:47,  3.64it/s]
 18%|█▊        | 66384/371472 [5:16:50<24:00:51,  3.53it/s]
 18%|█▊        | 66385/371472 [5:16:50<23:23:23,  3.62it/s]
 18%|█▊        | 66386/371472 [5:16:51<22:30:00,  3.77it/s]
 18%|█▊        | 66387/371472 [5:16:51<22:36:29,  3.75it/s]
 18%|█▊        | 66388/371472 [5:16:51<22:14:33,  3.81it/s]
 18%|█▊        | 66389/371472 [5:16:51<22:43:09,  3.73it/s]
 18%|█▊        | 66390/371472 [5:16:52<23:02:18,  3.68it/s]
 18%|█▊        | 66391/371472 [5:16:52<25:06:05,  3.38it/s]
 18%|█▊        | 66392/371472 [5:16:52<24:27:34,  3.46it/s]
 18%|█▊        | 66393/371472 [5:16:53<24:41:26,  3.43it/s]
 18%|█▊        | 66394/371472 [5:16:53<26:10:44,  3.24it/s]
 18%|█▊        | 66395/371472 [5:16:53<24:29:25,  3.46it/s]
 18%|█▊        | 66396/371472 [5:16:53<25:32:04,  3.32it/s]
 18%|█▊        | 66397/371472 [5:16:54<24:51:27,  3.41it/s]
 18%|█▊        | 66398/371472 [5:16:54<26:05:42,  3.25it/s]
 18%|█▊        | 66399/371472 [5:16:54<25:20:03,  3.34it/s]
 18%|█▊        | 66400/371472 [5:16:55<27:44:54,  3.05it/s]
                                                           
{'loss': 4.1858, 'learning_rate': 8.395246611648603e-07, 'epoch': 2.86}

 18%|█▊        | 66400/371472 [5:16:55<27:44:54,  3.05it/s]
 18%|█▊        | 66401/371472 [5:16:55<26:47:37,  3.16it/s]
 18%|█▊        | 66402/371472 [5:16:55<25:40:08,  3.30it/s]
 18%|█▊        | 66403/371472 [5:16:56<25:07:12,  3.37it/s]
 18%|█▊        | 66404/371472 [5:16:56<24:19:44,  3.48it/s]
 18%|█▊        | 66405/371472 [5:16:56<23:49:40,  3.56it/s]
 18%|█▊        | 66406/371472 [5:16:56<23:33:54,  3.60it/s]
 18%|█▊        | 66407/371472 [5:16:57<22:40:56,  3.74it/s]
 18%|█▊        | 66408/371472 [5:16:57<21:47:43,  3.89it/s]
 18%|█▊        | 66409/371472 [5:16:57<21:35:30,  3.92it/s]
 18%|█▊        | 66410/371472 [5:16:57<23:02:15,  3.68it/s]
 18%|█▊        | 66411/371472 [5:16:58<22:56:30,  3.69it/s]
 18%|█▊        | 66412/371472 [5:16:58<23:13:03,  3.65it/s]
 18%|█▊        | 66413/371472 [5:16:58<23:56:35,  3.54it/s]
 18%|█▊        | 66414/371472 [5:16:59<23:48:49,  3.56it/s]
 18%|█▊        | 66415/371472 [5:16:59<23:49:04,  3.56it/s]
 18%|█▊        | 66416/371472 [5:16:59<24:38:57,  3.44it/s]
 18%|█▊        | 66417/371472 [5:16:59<23:36:34,  3.59it/s]
 18%|█▊        | 66418/371472 [5:17:00<23:00:31,  3.68it/s]
 18%|█▊        | 66419/371472 [5:17:00<22:47:02,  3.72it/s]
 18%|█▊        | 66420/371472 [5:17:00<22:51:30,  3.71it/s]
                                                           
{'loss': 4.2199, 'learning_rate': 8.394761791893814e-07, 'epoch': 2.86}

 18%|█▊        | 66420/371472 [5:17:00<22:51:30,  3.71it/s]
 18%|█▊        | 66421/371472 [5:17:01<25:10:46,  3.37it/s]
 18%|█▊        | 66422/371472 [5:17:01<25:22:56,  3.34it/s]
 18%|█▊        | 66423/371472 [5:17:01<24:43:30,  3.43it/s]
 18%|█▊        | 66424/371472 [5:17:01<24:45:21,  3.42it/s]
 18%|█▊        | 66425/371472 [5:17:02<26:32:46,  3.19it/s]
 18%|█▊        | 66426/371472 [5:17:02<25:03:55,  3.38it/s]
 18%|█▊        | 66427/371472 [5:17:02<26:22:02,  3.21it/s]
 18%|█▊        | 66428/371472 [5:17:03<25:23:23,  3.34it/s]
 18%|█▊        | 66429/371472 [5:17:03<24:55:14,  3.40it/s]
 18%|█▊        | 66430/371472 [5:17:03<24:18:04,  3.49it/s]
 18%|█▊        | 66431/371472 [5:17:04<23:49:45,  3.56it/s]
 18%|█▊        | 66432/371472 [5:17:04<23:48:01,  3.56it/s]
 18%|█▊        | 66433/371472 [5:17:04<23:37:56,  3.59it/s]
 18%|█▊        | 66434/371472 [5:17:04<24:34:15,  3.45it/s]
 18%|█▊        | 66435/371472 [5:17:05<25:24:15,  3.34it/s]
 18%|█▊        | 66436/371472 [5:17:05<24:38:19,  3.44it/s]
 18%|█▊        | 66437/371472 [5:17:05<25:27:19,  3.33it/s]
 18%|█▊        | 66438/371472 [5:17:06<25:12:28,  3.36it/s]
 18%|█▊        | 66439/371472 [5:17:06<25:05:35,  3.38it/s]
 18%|█▊        | 66440/371472 [5:17:06<25:09:02,  3.37it/s]
                                                           
{'loss': 4.1503, 'learning_rate': 8.394276972139023e-07, 'epoch': 2.86}

 18%|█▊        | 66440/371472 [5:17:06<25:09:02,  3.37it/s]
 18%|█▊        | 66441/371472 [5:17:06<24:51:26,  3.41it/s]
 18%|█▊        | 66442/371472 [5:17:07<24:15:55,  3.49it/s]
 18%|█▊        | 66443/371472 [5:17:07<23:48:20,  3.56it/s]
 18%|█▊        | 66444/371472 [5:17:07<23:25:51,  3.62it/s]
 18%|█▊        | 66445/371472 [5:17:08<23:20:51,  3.63it/s]
 18%|█▊        | 66446/371472 [5:17:08<23:02:57,  3.68it/s]
 18%|█▊        | 66447/371472 [5:17:08<24:39:53,  3.44it/s]
 18%|█▊        | 66448/371472 [5:17:08<24:31:19,  3.46it/s]
 18%|█▊        | 66449/371472 [5:17:09<24:12:22,  3.50it/s]
 18%|█▊        | 66450/371472 [5:17:09<25:46:23,  3.29it/s]
 18%|█▊        | 66451/371472 [5:17:09<24:40:39,  3.43it/s]
 18%|█▊        | 66452/371472 [5:17:10<24:17:38,  3.49it/s]
 18%|█▊        | 66453/371472 [5:17:10<23:28:39,  3.61it/s]
 18%|█▊        | 66454/371472 [5:17:10<22:53:50,  3.70it/s]
 18%|█▊        | 66455/371472 [5:17:10<22:36:11,  3.75it/s]
 18%|█▊        | 66456/371472 [5:17:11<22:37:36,  3.74it/s]
 18%|█▊        | 66457/371472 [5:17:11<22:08:56,  3.83it/s]
 18%|█▊        | 66458/371472 [5:17:11<22:31:44,  3.76it/s]
 18%|█▊        | 66459/371472 [5:17:11<24:45:39,  3.42it/s]
 18%|█▊        | 66460/371472 [5:17:12<23:58:46,  3.53it/s]
                                                           
{'loss': 3.92, 'learning_rate': 8.393792152384235e-07, 'epoch': 2.86}

 18%|█▊        | 66460/371472 [5:17:12<23:58:46,  3.53it/s]
 18%|█▊        | 66461/371472 [5:17:12<24:13:35,  3.50it/s]
 18%|█▊        | 66462/371472 [5:17:12<24:01:17,  3.53it/s]
 18%|█▊        | 66463/371472 [5:17:13<23:48:27,  3.56it/s]
 18%|█▊        | 66464/371472 [5:17:13<23:15:13,  3.64it/s]
 18%|█▊        | 66465/371472 [5:17:13<22:51:58,  3.71it/s]
 18%|█▊        | 66466/371472 [5:17:13<22:22:45,  3.79it/s]
 18%|█▊        | 66467/371472 [5:17:14<21:56:04,  3.86it/s]
 18%|█▊        | 66468/371472 [5:17:14<23:14:28,  3.65it/s]
 18%|█▊        | 66469/371472 [5:17:14<23:00:21,  3.68it/s]
 18%|█▊        | 66470/371472 [5:17:14<22:47:17,  3.72it/s]
 18%|█▊        | 66471/371472 [5:17:15<23:44:33,  3.57it/s]
 18%|█▊        | 66472/371472 [5:17:15<26:00:42,  3.26it/s]
 18%|█▊        | 66473/371472 [5:17:15<24:33:44,  3.45it/s]
 18%|█▊        | 66474/371472 [5:17:16<23:30:54,  3.60it/s]
 18%|█▊        | 66475/371472 [5:17:16<23:13:27,  3.65it/s]
 18%|█▊        | 66476/371472 [5:17:16<23:23:18,  3.62it/s]
 18%|█▊        | 66477/371472 [5:17:16<23:53:43,  3.55it/s]
 18%|█▊        | 66478/371472 [5:17:17<23:24:13,  3.62it/s]
 18%|█▊        | 66479/371472 [5:17:17<23:05:06,  3.67it/s]
 18%|█▊        | 66480/371472 [5:17:17<22:53:16,  3.70it/s]
                                                           
{'loss': 4.0939, 'learning_rate': 8.393307332629447e-07, 'epoch': 2.86}

 18%|█▊        | 66480/371472 [5:17:17<22:53:16,  3.70it/s]
 18%|█▊        | 66481/371472 [5:17:18<23:24:17,  3.62it/s]
 18%|█▊        | 66482/371472 [5:17:18<23:06:45,  3.67it/s]
 18%|█▊        | 66483/371472 [5:17:18<22:43:10,  3.73it/s]
 18%|█▊        | 66484/371472 [5:17:18<24:07:17,  3.51it/s]
 18%|█▊        | 66485/371472 [5:17:19<24:21:07,  3.48it/s]
 18%|█▊        | 66486/371472 [5:17:19<24:10:01,  3.51it/s]
 18%|█▊        | 66487/371472 [5:17:19<24:50:52,  3.41it/s]
 18%|█▊        | 66488/371472 [5:17:20<23:57:43,  3.54it/s]
 18%|█▊        | 66489/371472 [5:17:20<24:22:38,  3.48it/s]
 18%|█▊        | 66490/371472 [5:17:20<23:05:32,  3.67it/s]
 18%|█▊        | 66491/371472 [5:17:20<22:33:48,  3.75it/s]
 18%|█▊        | 66492/371472 [5:17:21<23:04:04,  3.67it/s]
 18%|█▊        | 66493/371472 [5:17:21<22:51:14,  3.71it/s]
 18%|█▊        | 66494/371472 [5:17:21<24:09:33,  3.51it/s]
 18%|█▊        | 66495/371472 [5:17:21<23:38:38,  3.58it/s]
 18%|█▊        | 66496/371472 [5:17:22<24:27:12,  3.46it/s]
 18%|█▊        | 66497/371472 [5:17:22<23:18:33,  3.63it/s]
 18%|█▊        | 66498/371472 [5:17:22<22:52:06,  3.70it/s]
 18%|█▊        | 66499/371472 [5:17:23<24:24:42,  3.47it/s]
 18%|█▊        | 66500/371472 [5:17:23<26:06:13,  3.25it/s]
                                                           
{'loss': 4.3083, 'learning_rate': 8.392822512874658e-07, 'epoch': 2.86}

 18%|█▊        | 66500/371472 [5:17:23<26:06:13,  3.25it/s]
 18%|█▊        | 66501/371472 [5:17:23<24:48:48,  3.41it/s]
 18%|█▊        | 66502/371472 [5:17:23<24:21:53,  3.48it/s]
 18%|█▊        | 66503/371472 [5:17:24<23:42:45,  3.57it/s]
 18%|█▊        | 66504/371472 [5:17:24<23:17:20,  3.64it/s]
 18%|█▊        | 66505/371472 [5:17:24<24:35:38,  3.44it/s]
 18%|█▊        | 66506/371472 [5:17:25<23:23:12,  3.62it/s]
 18%|█▊        | 66507/371472 [5:17:25<23:25:34,  3.62it/s]
 18%|█▊        | 66508/371472 [5:17:25<23:32:52,  3.60it/s]
 18%|█▊        | 66509/371472 [5:17:25<23:26:50,  3.61it/s]
 18%|█▊        | 66510/371472 [5:17:26<23:43:06,  3.57it/s]
 18%|█▊        | 66511/371472 [5:17:26<23:11:39,  3.65it/s]
 18%|█▊        | 66512/371472 [5:17:26<24:27:44,  3.46it/s]
 18%|█▊        | 66513/371472 [5:17:27<23:36:15,  3.59it/s]
 18%|█▊        | 66514/371472 [5:17:27<23:28:57,  3.61it/s]
 18%|█▊        | 66515/371472 [5:17:27<22:57:13,  3.69it/s]
 18%|█▊        | 66516/371472 [5:17:27<22:19:46,  3.79it/s]
 18%|█▊        | 66517/371472 [5:17:28<21:46:18,  3.89it/s]
 18%|█▊        | 66518/371472 [5:17:28<21:59:55,  3.85it/s]
 18%|█▊        | 66519/371472 [5:17:28<21:58:04,  3.86it/s]
 18%|█▊        | 66520/371472 [5:17:28<22:25:40,  3.78it/s]
                                                           
{'loss': 4.5096, 'learning_rate': 8.392337693119868e-07, 'epoch': 2.87}

 18%|█▊        | 66520/371472 [5:17:28<22:25:40,  3.78it/s]
 18%|█▊        | 66521/371472 [5:17:29<23:00:37,  3.68it/s]
 18%|█▊        | 66522/371472 [5:17:29<23:24:18,  3.62it/s]
 18%|█▊        | 66523/371472 [5:17:29<24:57:32,  3.39it/s]
 18%|█▊        | 66524/371472 [5:17:30<24:46:13,  3.42it/s]
 18%|█▊        | 66525/371472 [5:17:30<24:50:43,  3.41it/s]
 18%|█▊        | 66526/371472 [5:17:30<24:22:18,  3.48it/s]
 18%|█▊        | 66527/371472 [5:17:30<23:54:46,  3.54it/s]
 18%|█▊        | 66528/371472 [5:17:31<22:53:26,  3.70it/s]
 18%|█▊        | 66529/371472 [5:17:31<23:50:05,  3.55it/s]
 18%|█▊        | 66530/371472 [5:17:31<24:30:22,  3.46it/s]
 18%|█▊        | 66531/371472 [5:17:32<23:30:06,  3.60it/s]
 18%|█▊        | 66532/371472 [5:17:32<25:57:34,  3.26it/s]
 18%|█▊        | 66533/371472 [5:17:32<24:42:18,  3.43it/s]
 18%|█▊        | 66534/371472 [5:17:32<23:52:13,  3.55it/s]
 18%|█▊        | 66535/371472 [5:17:33<24:48:01,  3.42it/s]
 18%|█▊        | 66536/371472 [5:17:33<23:30:02,  3.60it/s]
 18%|█▊        | 66537/371472 [5:17:33<23:44:18,  3.57it/s]
 18%|█▊        | 66538/371472 [5:17:34<22:51:46,  3.70it/s]
 18%|█▊        | 66539/371472 [5:17:34<22:50:40,  3.71it/s]
 18%|█▊        | 66540/371472 [5:17:34<22:25:32,  3.78it/s]
                                                           
{'loss': 4.1628, 'learning_rate': 8.39185287336508e-07, 'epoch': 2.87}

 18%|█▊        | 66540/371472 [5:17:34<22:25:32,  3.78it/s]
 18%|█▊        | 66541/371472 [5:17:34<23:23:18,  3.62it/s]
 18%|█▊        | 66542/371472 [5:17:35<22:43:27,  3.73it/s]
 18%|█▊        | 66543/371472 [5:17:35<22:19:37,  3.79it/s]
 18%|█▊        | 66544/371472 [5:17:35<21:56:34,  3.86it/s]
 18%|█▊        | 66545/371472 [5:17:35<22:48:00,  3.71it/s]
 18%|█▊        | 66546/371472 [5:17:36<24:02:46,  3.52it/s]
 18%|█▊        | 66547/371472 [5:17:36<23:00:21,  3.68it/s]
 18%|█▊        | 66548/371472 [5:17:36<22:44:54,  3.72it/s]
 18%|█▊        | 66549/371472 [5:17:36<22:44:11,  3.73it/s]
 18%|█▊        | 66550/371472 [5:17:37<23:31:48,  3.60it/s]
 18%|█▊        | 66551/371472 [5:17:37<25:29:53,  3.32it/s]
 18%|█▊        | 66552/371472 [5:17:37<25:53:50,  3.27it/s]
 18%|█▊        | 66553/371472 [5:17:38<25:29:37,  3.32it/s]
 18%|█▊        | 66554/371472 [5:17:38<27:21:37,  3.10it/s]
 18%|█▊        | 66555/371472 [5:17:38<28:49:52,  2.94it/s]
 18%|█▊        | 66556/371472 [5:17:39<29:06:27,  2.91it/s]
 18%|█▊        | 66557/371472 [5:17:39<29:41:05,  2.85it/s]
 18%|█▊        | 66558/371472 [5:17:39<27:38:25,  3.06it/s]
 18%|█▊        | 66559/371472 [5:17:40<26:09:14,  3.24it/s]
 18%|█▊        | 66560/371472 [5:17:40<24:28:27,  3.46it/s]
                                                           
{'loss': 4.1477, 'learning_rate': 8.391368053610291e-07, 'epoch': 2.87}

 18%|█▊        | 66560/371472 [5:17:40<24:28:27,  3.46it/s]
 18%|█▊        | 66561/371472 [5:17:40<24:37:17,  3.44it/s]
 18%|█▊        | 66562/371472 [5:17:41<25:22:41,  3.34it/s]
 18%|█▊        | 66563/371472 [5:17:41<25:16:00,  3.35it/s]
 18%|█▊        | 66564/371472 [5:17:41<24:47:46,  3.42it/s]
 18%|█▊        | 66565/371472 [5:17:42<26:06:11,  3.24it/s]
 18%|█▊        | 66566/371472 [5:17:42<25:32:04,  3.32it/s]
 18%|█▊        | 66567/371472 [5:17:42<23:56:40,  3.54it/s]
 18%|█▊        | 66568/371472 [5:17:42<23:39:41,  3.58it/s]
 18%|█▊        | 66569/371472 [5:17:43<23:23:39,  3.62it/s]
 18%|█▊        | 66570/371472 [5:17:43<23:19:47,  3.63it/s]
 18%|█▊        | 66571/371472 [5:17:43<24:30:20,  3.46it/s]
 18%|█▊        | 66572/371472 [5:17:43<23:35:25,  3.59it/s]
 18%|█▊        | 66573/371472 [5:17:44<23:34:07,  3.59it/s]
 18%|█▊        | 66574/371472 [5:17:44<25:15:25,  3.35it/s]
 18%|█▊        | 66575/371472 [5:17:44<23:51:16,  3.55it/s]
 18%|█▊        | 66576/371472 [5:17:45<24:01:28,  3.53it/s]
 18%|█▊        | 66577/371472 [5:17:45<24:07:55,  3.51it/s]
 18%|█▊        | 66578/371472 [5:17:45<23:22:28,  3.62it/s]
 18%|█▊        | 66579/371472 [5:17:45<23:57:17,  3.54it/s]
 18%|█▊        | 66580/371472 [5:17:46<24:07:58,  3.51it/s]
                                                           
{'loss': 3.9537, 'learning_rate': 8.390883233855502e-07, 'epoch': 2.87}

 18%|█▊        | 66580/371472 [5:17:46<24:07:58,  3.51it/s]
 18%|█▊        | 66581/371472 [5:17:46<22:57:20,  3.69it/s]
 18%|█▊        | 66582/371472 [5:17:46<23:18:28,  3.63it/s]
 18%|█▊        | 66583/371472 [5:17:47<23:20:14,  3.63it/s]
 18%|█▊        | 66584/371472 [5:17:47<23:09:10,  3.66it/s]
 18%|█▊        | 66585/371472 [5:17:47<22:15:02,  3.81it/s]
 18%|█▊        | 66586/371472 [5:17:47<24:26:08,  3.47it/s]
 18%|█▊        | 66587/371472 [5:17:48<24:21:14,  3.48it/s]
 18%|█▊        | 66588/371472 [5:17:48<24:47:03,  3.42it/s]
 18%|█▊        | 66589/371472 [5:17:48<24:57:54,  3.39it/s]
 18%|█▊        | 66590/371472 [5:17:49<26:00:57,  3.26it/s]
 18%|█▊        | 66591/371472 [5:17:49<25:31:00,  3.32it/s]
 18%|█▊        | 66592/371472 [5:17:49<25:36:21,  3.31it/s]
 18%|█▊        | 66593/371472 [5:17:49<25:11:11,  3.36it/s]
 18%|█▊        | 66594/371472 [5:17:50<24:09:54,  3.50it/s]
 18%|█▊        | 66595/371472 [5:17:50<24:26:20,  3.47it/s]
 18%|█▊        | 66596/371472 [5:17:50<26:07:41,  3.24it/s]
 18%|█▊        | 66597/371472 [5:17:51<26:09:58,  3.24it/s]
 18%|█▊        | 66598/371472 [5:17:51<25:01:34,  3.38it/s]
 18%|█▊        | 66599/371472 [5:17:51<25:16:40,  3.35it/s]
 18%|█▊        | 66600/371472 [5:17:52<25:06:29,  3.37it/s]
                                                           
{'loss': 4.0073, 'learning_rate': 8.390398414100712e-07, 'epoch': 2.87}

 18%|█▊        | 66600/371472 [5:17:52<25:06:29,  3.37it/s]
 18%|█▊        | 66601/371472 [5:17:52<25:34:51,  3.31it/s]
 18%|█▊        | 66602/371472 [5:17:52<24:24:42,  3.47it/s]
 18%|█▊        | 66603/371472 [5:17:52<23:53:39,  3.54it/s]
 18%|█▊        | 66604/371472 [5:17:53<23:27:43,  3.61it/s]
 18%|█▊        | 66605/371472 [5:17:53<22:34:17,  3.75it/s]
 18%|█▊        | 66606/371472 [5:17:53<22:00:06,  3.85it/s]
 18%|█▊        | 66607/371472 [5:17:53<24:05:21,  3.52it/s]
 18%|█▊        | 66608/371472 [5:17:54<24:15:55,  3.49it/s]
 18%|█▊        | 66609/371472 [5:17:54<23:32:42,  3.60it/s]
 18%|█▊        | 66610/371472 [5:17:54<23:32:21,  3.60it/s]
 18%|█▊        | 66611/371472 [5:17:55<23:08:56,  3.66it/s]
 18%|█▊        | 66612/371472 [5:17:55<25:21:59,  3.34it/s]
 18%|█▊        | 66613/371472 [5:17:55<25:06:06,  3.37it/s]
 18%|█▊        | 66614/371472 [5:17:55<24:13:19,  3.50it/s]
 18%|█▊        | 66615/371472 [5:17:56<23:29:52,  3.60it/s]
 18%|█▊        | 66616/371472 [5:17:56<23:05:04,  3.67it/s]
 18%|█▊        | 66617/371472 [5:17:56<24:20:32,  3.48it/s]
 18%|█▊        | 66618/371472 [5:17:57<24:58:24,  3.39it/s]
 18%|█▊        | 66619/371472 [5:17:57<24:36:40,  3.44it/s]
 18%|█▊        | 66620/371472 [5:17:57<24:07:23,  3.51it/s]
                                                           
{'loss': 4.1379, 'learning_rate': 8.389913594345924e-07, 'epoch': 2.87}

 18%|█▊        | 66620/371472 [5:17:57<24:07:23,  3.51it/s]
 18%|█▊        | 66621/371472 [5:17:57<23:22:45,  3.62it/s]
 18%|█▊        | 66622/371472 [5:17:58<23:27:46,  3.61it/s]
 18%|█▊        | 66623/371472 [5:17:58<24:11:08,  3.50it/s]
 18%|█▊        | 66624/371472 [5:17:58<24:40:35,  3.43it/s]
 18%|█▊        | 66625/371472 [5:17:59<23:57:08,  3.54it/s]
 18%|█▊        | 66626/371472 [5:17:59<24:05:31,  3.51it/s]
 18%|█▊        | 66627/371472 [5:17:59<24:14:26,  3.49it/s]
 18%|█▊        | 66628/371472 [5:17:59<24:16:26,  3.49it/s]
 18%|█▊        | 66629/371472 [5:18:00<23:34:12,  3.59it/s]
 18%|█▊        | 66630/371472 [5:18:00<23:14:34,  3.64it/s]
 18%|█▊        | 66631/371472 [5:18:00<22:49:54,  3.71it/s]
 18%|█▊        | 66632/371472 [5:18:01<23:40:15,  3.58it/s]
 18%|█▊        | 66633/371472 [5:18:01<23:03:01,  3.67it/s]
 18%|█▊        | 66634/371472 [5:18:01<24:03:44,  3.52it/s]
 18%|█▊        | 66635/371472 [5:18:01<23:17:29,  3.64it/s]
 18%|█▊        | 66636/371472 [5:18:02<22:38:06,  3.74it/s]
 18%|█▊        | 66637/371472 [5:18:02<22:39:49,  3.74it/s]
 18%|█▊        | 66638/371472 [5:18:02<22:23:04,  3.78it/s]
 18%|█▊        | 66639/371472 [5:18:02<24:09:48,  3.50it/s]
 18%|█▊        | 66640/371472 [5:18:03<23:46:17,  3.56it/s]
                                                           
{'loss': 4.5399, 'learning_rate': 8.389428774591135e-07, 'epoch': 2.87}

 18%|█▊        | 66640/371472 [5:18:03<23:46:17,  3.56it/s]
 18%|█▊        | 66641/371472 [5:18:03<24:18:32,  3.48it/s]
 18%|█▊        | 66642/371472 [5:18:03<24:33:04,  3.45it/s]
 18%|█▊        | 66643/371472 [5:18:04<26:14:10,  3.23it/s]
 18%|█▊        | 66644/371472 [5:18:04<24:27:02,  3.46it/s]
 18%|█▊        | 66645/371472 [5:18:04<23:43:36,  3.57it/s]
 18%|█▊        | 66646/371472 [5:18:04<22:56:37,  3.69it/s]
 18%|█▊        | 66647/371472 [5:18:05<22:41:32,  3.73it/s]
 18%|█▊        | 66648/371472 [5:18:05<22:20:26,  3.79it/s]
 18%|█▊        | 66649/371472 [5:18:05<22:14:43,  3.81it/s]
 18%|█▊        | 66650/371472 [5:18:06<23:01:11,  3.68it/s]
 18%|█▊        | 66651/371472 [5:18:06<22:39:25,  3.74it/s]
 18%|█▊        | 66652/371472 [5:18:06<22:02:16,  3.84it/s]
 18%|█▊        | 66653/371472 [5:18:06<22:11:38,  3.82it/s]
 18%|█▊        | 66654/371472 [5:18:07<22:40:16,  3.73it/s]
 18%|█▊        | 66655/371472 [5:18:07<23:25:33,  3.61it/s]
 18%|█▊        | 66656/371472 [5:18:07<23:01:41,  3.68it/s]
 18%|█▊        | 66657/371472 [5:18:07<23:32:47,  3.60it/s]
 18%|█▊        | 66658/371472 [5:18:08<24:43:49,  3.42it/s]
 18%|█▊        | 66659/371472 [5:18:08<26:15:02,  3.23it/s]
 18%|█▊        | 66660/371472 [5:18:08<26:42:44,  3.17it/s]
                                                           
{'loss': 4.172, 'learning_rate': 8.388943954836347e-07, 'epoch': 2.87}

 18%|█▊        | 66660/371472 [5:18:08<26:42:44,  3.17it/s]
 18%|█▊        | 66661/371472 [5:18:09<27:45:19,  3.05it/s]
 18%|█▊        | 66662/371472 [5:18:09<25:31:48,  3.32it/s]
 18%|█▊        | 66663/371472 [5:18:09<24:17:12,  3.49it/s]
 18%|█▊        | 66664/371472 [5:18:10<23:12:50,  3.65it/s]
 18%|█▊        | 66665/371472 [5:18:10<23:30:23,  3.60it/s]
 18%|█▊        | 66666/371472 [5:18:10<22:46:23,  3.72it/s]
 18%|█▊        | 66667/371472 [5:18:10<22:56:02,  3.69it/s]
 18%|█▊        | 66668/371472 [5:18:11<23:01:43,  3.68it/s]
 18%|█▊        | 66669/371472 [5:18:11<22:51:15,  3.70it/s]
 18%|█▊        | 66670/371472 [5:18:11<24:22:21,  3.47it/s]
 18%|█▊        | 66671/371472 [5:18:11<23:37:14,  3.58it/s]
 18%|█▊        | 66672/371472 [5:18:12<24:22:52,  3.47it/s]
 18%|█▊        | 66673/371472 [5:18:12<24:38:53,  3.44it/s]
 18%|█▊        | 66674/371472 [5:18:12<26:19:02,  3.22it/s]
 18%|█▊        | 66675/371472 [5:18:13<26:17:11,  3.22it/s]
 18%|█▊        | 66676/371472 [5:18:13<26:10:21,  3.23it/s]
 18%|█▊        | 66677/371472 [5:18:13<25:08:10,  3.37it/s]
 18%|█▊        | 66678/371472 [5:18:14<25:00:42,  3.39it/s]
 18%|█▊        | 66679/371472 [5:18:14<23:58:59,  3.53it/s]
 18%|█▊        | 66680/371472 [5:18:14<24:16:04,  3.49it/s]
                                                           
{'loss': 4.1137, 'learning_rate': 8.388459135081556e-07, 'epoch': 2.87}

 18%|█▊        | 66680/371472 [5:18:14<24:16:04,  3.49it/s]
 18%|█▊        | 66681/371472 [5:18:14<24:13:41,  3.49it/s]
 18%|█▊        | 66682/371472 [5:18:15<23:42:07,  3.57it/s]
 18%|█▊        | 66683/371472 [5:18:15<22:37:34,  3.74it/s]
 18%|█▊        | 66684/371472 [5:18:15<23:07:21,  3.66it/s]
 18%|█▊        | 66685/371472 [5:18:16<24:03:43,  3.52it/s]
 18%|█▊        | 66686/371472 [5:18:16<23:36:20,  3.59it/s]
 18%|█▊        | 66687/371472 [5:18:16<24:08:18,  3.51it/s]
 18%|█▊        | 66688/371472 [5:18:16<23:53:17,  3.54it/s]
 18%|█▊        | 66689/371472 [5:18:17<24:00:57,  3.53it/s]
 18%|█▊        | 66690/371472 [5:18:17<23:53:15,  3.54it/s]
 18%|█▊        | 66691/371472 [5:18:17<23:39:12,  3.58it/s]
 18%|█▊        | 66692/371472 [5:18:18<23:56:26,  3.54it/s]
 18%|█▊        | 66693/371472 [5:18:18<24:14:48,  3.49it/s]
 18%|█▊        | 66694/371472 [5:18:18<24:01:39,  3.52it/s]
 18%|█▊        | 66695/371472 [5:18:18<23:52:04,  3.55it/s]
 18%|█▊        | 66696/371472 [5:18:19<23:14:49,  3.64it/s]
 18%|█▊        | 66697/371472 [5:18:19<23:06:39,  3.66it/s]
 18%|█▊        | 66698/371472 [5:18:19<23:51:09,  3.55it/s]
 18%|█▊        | 66699/371472 [5:18:19<23:45:23,  3.56it/s]
 18%|█▊        | 66700/371472 [5:18:20<22:50:55,  3.71it/s]
                                                           
{'loss': 4.3093, 'learning_rate': 8.387974315326768e-07, 'epoch': 2.87}

 18%|█▊        | 66700/371472 [5:18:20<22:50:55,  3.71it/s]
 18%|█▊        | 66701/371472 [5:18:20<22:34:59,  3.75it/s]
 18%|█▊        | 66702/371472 [5:18:20<22:16:10,  3.80it/s]
 18%|█▊        | 66703/371472 [5:18:20<22:28:30,  3.77it/s]
 18%|█▊        | 66704/371472 [5:18:21<22:54:25,  3.70it/s]
 18%|█▊        | 66705/371472 [5:18:21<23:02:02,  3.68it/s]
 18%|█▊        | 66706/371472 [5:18:21<22:36:23,  3.74it/s]
 18%|█▊        | 66707/371472 [5:18:22<22:06:41,  3.83it/s]
 18%|█▊        | 66708/371472 [5:18:22<22:47:59,  3.71it/s]
 18%|█▊        | 66709/371472 [5:18:22<22:52:45,  3.70it/s]
 18%|█▊        | 66710/371472 [5:18:22<22:40:03,  3.73it/s]
 18%|█▊        | 66711/371472 [5:18:23<23:41:19,  3.57it/s]
 18%|█▊        | 66712/371472 [5:18:23<23:06:11,  3.66it/s]
 18%|█▊        | 66713/371472 [5:18:23<23:16:56,  3.64it/s]
 18%|█▊        | 66714/371472 [5:18:23<23:07:48,  3.66it/s]
 18%|█▊        | 66715/371472 [5:18:24<23:18:08,  3.63it/s]
 18%|█▊        | 66716/371472 [5:18:24<23:00:14,  3.68it/s]
 18%|█▊        | 66717/371472 [5:18:24<23:51:08,  3.55it/s]
 18%|█▊        | 66718/371472 [5:18:25<22:48:22,  3.71it/s]
 18%|█▊        | 66719/371472 [5:18:25<22:51:27,  3.70it/s]
 18%|█▊        | 66720/371472 [5:18:25<23:11:49,  3.65it/s]
                                                           
{'loss': 4.2004, 'learning_rate': 8.387489495571979e-07, 'epoch': 2.87}

 18%|█▊        | 66720/371472 [5:18:25<23:11:49,  3.65it/s]
 18%|█▊        | 66721/371472 [5:18:25<23:12:17,  3.65it/s]
 18%|█▊        | 66722/371472 [5:18:26<22:25:32,  3.77it/s]
 18%|█▊        | 66723/371472 [5:18:26<23:28:01,  3.61it/s]
 18%|█▊        | 66724/371472 [5:18:26<23:46:04,  3.56it/s]
 18%|█▊        | 66725/371472 [5:18:27<24:46:57,  3.42it/s]
 18%|█▊        | 66726/371472 [5:18:27<26:11:29,  3.23it/s]
 18%|█▊        | 66727/371472 [5:18:27<25:02:27,  3.38it/s]
 18%|█▊        | 66728/371472 [5:18:27<24:06:43,  3.51it/s]
 18%|█▊        | 66729/371472 [5:18:28<23:00:12,  3.68it/s]
 18%|█▊        | 66730/371472 [5:18:28<22:02:57,  3.84it/s]
 18%|█▊        | 66731/371472 [5:18:28<22:05:41,  3.83it/s]
 18%|█▊        | 66732/371472 [5:18:28<22:22:22,  3.78it/s]
 18%|█▊        | 66733/371472 [5:18:29<23:10:46,  3.65it/s]
 18%|█▊        | 66734/371472 [5:18:29<24:53:34,  3.40it/s]
 18%|█▊        | 66735/371472 [5:18:29<24:58:59,  3.39it/s]
 18%|█▊        | 66736/371472 [5:18:30<25:17:44,  3.35it/s]
 18%|█▊        | 66737/371472 [5:18:30<24:05:13,  3.51it/s]
 18%|█▊        | 66738/371472 [5:18:30<23:57:12,  3.53it/s]
 18%|█▊        | 66739/371472 [5:18:31<24:07:31,  3.51it/s]
 18%|█▊        | 66740/371472 [5:18:31<23:52:27,  3.55it/s]
                                                           
{'loss': 4.2117, 'learning_rate': 8.387004675817191e-07, 'epoch': 2.87}

 18%|█▊        | 66740/371472 [5:18:31<23:52:27,  3.55it/s]
 18%|█▊        | 66741/371472 [5:18:31<23:07:08,  3.66it/s]
 18%|█▊        | 66742/371472 [5:18:31<24:11:38,  3.50it/s]
 18%|█▊        | 66743/371472 [5:18:32<24:38:11,  3.44it/s]
 18%|█▊        | 66744/371472 [5:18:32<23:43:21,  3.57it/s]
 18%|█▊        | 66745/371472 [5:18:32<24:15:29,  3.49it/s]
 18%|█▊        | 66746/371472 [5:18:32<24:15:24,  3.49it/s]
 18%|█▊        | 66747/371472 [5:18:33<24:35:54,  3.44it/s]
 18%|█▊        | 66748/371472 [5:18:33<23:22:55,  3.62it/s]
 18%|█▊        | 66749/371472 [5:18:33<23:31:11,  3.60it/s]
 18%|█▊        | 66750/371472 [5:18:34<23:13:53,  3.64it/s]
 18%|█▊        | 66751/371472 [5:18:34<23:53:04,  3.54it/s]
 18%|█▊        | 66752/371472 [5:18:34<24:07:35,  3.51it/s]
 18%|█▊        | 66753/371472 [5:18:34<24:07:56,  3.51it/s]
 18%|█▊        | 66754/371472 [5:18:35<24:10:55,  3.50it/s]
 18%|█▊        | 66755/371472 [5:18:35<23:03:55,  3.67it/s]
 18%|█▊        | 66756/371472 [5:18:35<23:08:22,  3.66it/s]
 18%|█▊        | 66757/371472 [5:18:36<24:08:26,  3.51it/s]
 18%|█▊        | 66758/371472 [5:18:36<23:29:00,  3.60it/s]
 18%|█▊        | 66759/371472 [5:18:36<23:00:41,  3.68it/s]
 18%|█▊        | 66760/371472 [5:18:36<22:02:20,  3.84it/s]
                                                           
{'loss': 3.9785, 'learning_rate': 8.386519856062401e-07, 'epoch': 2.88}

 18%|█▊        | 66760/371472 [5:18:36<22:02:20,  3.84it/s]
 18%|█▊        | 66761/371472 [5:18:37<22:13:55,  3.81it/s]
 18%|█▊        | 66762/371472 [5:18:37<22:01:00,  3.84it/s]
 18%|█▊        | 66763/371472 [5:18:37<21:40:30,  3.90it/s]
 18%|█▊        | 66764/371472 [5:18:37<21:51:54,  3.87it/s]
 18%|█▊        | 66765/371472 [5:18:38<21:35:57,  3.92it/s]
 18%|█▊        | 66766/371472 [5:18:38<21:44:55,  3.89it/s]
 18%|█▊        | 66767/371472 [5:18:38<21:42:59,  3.90it/s]
 18%|█▊        | 66768/371472 [5:18:38<22:16:39,  3.80it/s]
 18%|█▊        | 66769/371472 [5:18:39<22:12:11,  3.81it/s]
 18%|█▊        | 66770/371472 [5:18:39<24:20:11,  3.48it/s]
 18%|█▊        | 66771/371472 [5:18:39<23:47:29,  3.56it/s]
 18%|█▊        | 66772/371472 [5:18:40<23:51:29,  3.55it/s]
 18%|█▊        | 66773/371472 [5:18:40<22:42:02,  3.73it/s]
 18%|█▊        | 66774/371472 [5:18:40<22:07:59,  3.82it/s]
 18%|█▊        | 66775/371472 [5:18:40<21:47:47,  3.88it/s]
 18%|█▊        | 66776/371472 [5:18:41<22:41:35,  3.73it/s]
 18%|█▊        | 66777/371472 [5:18:41<24:41:47,  3.43it/s]
 18%|█▊        | 66778/371472 [5:18:41<25:21:19,  3.34it/s]
 18%|█▊        | 66779/371472 [5:18:42<24:58:50,  3.39it/s]
 18%|█▊        | 66780/371472 [5:18:42<23:54:18,  3.54it/s]
                                                           
{'loss': 4.2004, 'learning_rate': 8.386035036307613e-07, 'epoch': 2.88}

 18%|█▊        | 66780/371472 [5:18:42<23:54:18,  3.54it/s]
 18%|█▊        | 66781/371472 [5:18:42<23:02:48,  3.67it/s]
 18%|█▊        | 66782/371472 [5:18:42<22:40:13,  3.73it/s]
 18%|█▊        | 66783/371472 [5:18:43<22:47:31,  3.71it/s]
 18%|█▊        | 66784/371472 [5:18:43<23:31:09,  3.60it/s]
 18%|█▊        | 66785/371472 [5:18:43<23:51:38,  3.55it/s]
 18%|█▊        | 66786/371472 [5:18:43<23:11:30,  3.65it/s]
 18%|█▊        | 66787/371472 [5:18:44<23:02:34,  3.67it/s]
 18%|█▊        | 66788/371472 [5:18:44<22:50:58,  3.70it/s]
 18%|█▊        | 66789/371472 [5:18:44<24:56:20,  3.39it/s]
 18%|█▊        | 66790/371472 [5:18:45<24:37:06,  3.44it/s]
 18%|█▊        | 66791/371472 [5:18:45<23:24:02,  3.62it/s]
 18%|█▊        | 66792/371472 [5:18:45<23:24:39,  3.62it/s]
 18%|█▊        | 66793/371472 [5:18:45<24:51:02,  3.41it/s]
 18%|█▊        | 66794/371472 [5:18:46<26:47:40,  3.16it/s]
 18%|█▊        | 66795/371472 [5:18:46<27:00:10,  3.13it/s]
 18%|█▊        | 66796/371472 [5:18:46<26:37:25,  3.18it/s]
 18%|█▊        | 66797/371472 [5:18:47<25:22:24,  3.34it/s]
 18%|█▊        | 66798/371472 [5:18:47<24:08:47,  3.50it/s]
 18%|█▊        | 66799/371472 [5:18:47<24:01:05,  3.52it/s]
 18%|█▊        | 66800/371472 [5:18:48<24:00:02,  3.53it/s]
                                                           
{'loss': 4.3149, 'learning_rate': 8.385550216552824e-07, 'epoch': 2.88}

 18%|█▊        | 66800/371472 [5:18:48<24:00:02,  3.53it/s]
 18%|█▊        | 66801/371472 [5:18:48<24:37:33,  3.44it/s]
 18%|█▊        | 66802/371472 [5:18:48<26:10:46,  3.23it/s]
 18%|█▊        | 66803/371472 [5:18:48<25:03:35,  3.38it/s]
 18%|█▊        | 66804/371472 [5:18:49<25:18:27,  3.34it/s]
 18%|█▊        | 66805/371472 [5:18:49<24:34:52,  3.44it/s]
 18%|█▊        | 66806/371472 [5:18:49<23:36:08,  3.59it/s]
 18%|█▊        | 66807/371472 [5:18:50<24:30:58,  3.45it/s]
 18%|█▊        | 66808/371472 [5:18:50<23:21:26,  3.62it/s]
 18%|█▊        | 66809/371472 [5:18:50<23:07:20,  3.66it/s]
 18%|█▊        | 66810/371472 [5:18:50<22:11:15,  3.81it/s]
 18%|█▊        | 66811/371472 [5:18:51<21:57:30,  3.85it/s]
 18%|█▊        | 66812/371472 [5:18:51<22:36:00,  3.74it/s]
 18%|█▊        | 66813/371472 [5:18:51<22:40:53,  3.73it/s]
 18%|█▊        | 66814/371472 [5:18:51<23:03:33,  3.67it/s]
 18%|█▊        | 66815/371472 [5:18:52<22:04:45,  3.83it/s]
 18%|█▊        | 66816/371472 [5:18:52<22:02:54,  3.84it/s]
 18%|█▊        | 66817/371472 [5:18:52<23:35:54,  3.59it/s]
 18%|█▊        | 66818/371472 [5:18:52<22:37:41,  3.74it/s]
 18%|█▊        | 66819/371472 [5:18:53<22:44:38,  3.72it/s]
 18%|█▊        | 66820/371472 [5:18:53<22:28:44,  3.76it/s]
                                                           
{'loss': 4.0467, 'learning_rate': 8.385065396798034e-07, 'epoch': 2.88}

 18%|█▊        | 66820/371472 [5:18:53<22:28:44,  3.76it/s]
 18%|█▊        | 66821/371472 [5:18:53<22:50:54,  3.70it/s]
 18%|█▊        | 66822/371472 [5:18:54<22:06:07,  3.83it/s]
 18%|█▊        | 66823/371472 [5:18:54<22:28:51,  3.76it/s]
 18%|█▊        | 66824/371472 [5:18:54<22:15:24,  3.80it/s]
 18%|█▊        | 66825/371472 [5:18:54<22:42:11,  3.73it/s]
 18%|█▊        | 66826/371472 [5:18:55<22:19:46,  3.79it/s]
 18%|█▊        | 66827/371472 [5:18:55<22:00:59,  3.84it/s]
 18%|█▊        | 66828/371472 [5:18:55<23:06:23,  3.66it/s]
 18%|█▊        | 66829/371472 [5:18:55<22:27:01,  3.77it/s]
 18%|█▊        | 66830/371472 [5:18:56<22:20:11,  3.79it/s]
 18%|█▊        | 66831/371472 [5:18:56<22:01:11,  3.84it/s]
 18%|█▊        | 66832/371472 [5:18:56<22:35:57,  3.74it/s]
 18%|█▊        | 66833/371472 [5:18:57<25:12:04,  3.36it/s]
 18%|█▊        | 66834/371472 [5:18:57<24:00:16,  3.53it/s]
 18%|█▊        | 66835/371472 [5:18:57<23:10:36,  3.65it/s]
 18%|█▊        | 66836/371472 [5:18:57<22:42:47,  3.73it/s]
 18%|█▊        | 66837/371472 [5:18:58<23:01:45,  3.67it/s]
 18%|█▊        | 66838/371472 [5:18:58<22:42:57,  3.73it/s]
 18%|█▊        | 66839/371472 [5:18:58<23:29:30,  3.60it/s]
 18%|█▊        | 66840/371472 [5:18:58<23:05:13,  3.67it/s]
                                                           
{'loss': 4.2308, 'learning_rate': 8.384580577043245e-07, 'epoch': 2.88}

 18%|█▊        | 66840/371472 [5:18:58<23:05:13,  3.67it/s]
 18%|█▊        | 66841/371472 [5:18:59<23:31:50,  3.60it/s]
 18%|█▊        | 66842/371472 [5:18:59<24:58:44,  3.39it/s]
 18%|█▊        | 66843/371472 [5:18:59<25:15:43,  3.35it/s]
 18%|█▊        | 66844/371472 [5:19:00<28:15:47,  2.99it/s]
 18%|█▊        | 66845/371472 [5:19:00<26:15:41,  3.22it/s]
 18%|█▊        | 66846/371472 [5:19:00<25:18:01,  3.34it/s]
 18%|█▊        | 66847/371472 [5:19:01<24:42:32,  3.42it/s]
 18%|█▊        | 66848/371472 [5:19:01<24:04:57,  3.51it/s]
 18%|█▊        | 66849/371472 [5:19:01<24:02:17,  3.52it/s]
 18%|█▊        | 66850/371472 [5:19:01<26:15:57,  3.22it/s]
 18%|█▊        | 66851/371472 [5:19:02<25:26:46,  3.33it/s]
 18%|█▊        | 66852/371472 [5:19:02<24:25:54,  3.46it/s]
 18%|█▊        | 66853/371472 [5:19:02<23:31:43,  3.60it/s]
 18%|█▊        | 66854/371472 [5:19:03<23:03:24,  3.67it/s]
 18%|█▊        | 66855/371472 [5:19:03<22:36:00,  3.74it/s]
 18%|█▊        | 66856/371472 [5:19:03<25:10:05,  3.36it/s]
 18%|█▊        | 66857/371472 [5:19:03<23:40:39,  3.57it/s]
 18%|█▊        | 66858/371472 [5:19:04<23:06:42,  3.66it/s]
 18%|█▊        | 66859/371472 [5:19:04<22:43:35,  3.72it/s]
 18%|█▊        | 66860/371472 [5:19:04<22:56:59,  3.69it/s]
                                                           
{'loss': 4.2297, 'learning_rate': 8.384095757288457e-07, 'epoch': 2.88}

 18%|█▊        | 66860/371472 [5:19:04<22:56:59,  3.69it/s]
 18%|█▊        | 66861/371472 [5:19:04<23:34:37,  3.59it/s]
 18%|█▊        | 66862/371472 [5:19:05<22:48:39,  3.71it/s]
 18%|█▊        | 66863/371472 [5:19:05<22:22:28,  3.78it/s]
 18%|█▊        | 66864/371472 [5:19:05<21:55:45,  3.86it/s]
 18%|█▊        | 66865/371472 [5:19:06<22:29:32,  3.76it/s]
 18%|█▊        | 66866/371472 [5:19:06<22:33:36,  3.75it/s]
 18%|█▊        | 66867/371472 [5:19:06<21:53:47,  3.86it/s]
 18%|█▊        | 66868/371472 [5:19:06<22:20:54,  3.79it/s]
 18%|█▊        | 66869/371472 [5:19:07<22:10:57,  3.81it/s]
 18%|█▊        | 66870/371472 [5:19:07<21:42:31,  3.90it/s]
 18%|█▊        | 66871/371472 [5:19:07<22:44:57,  3.72it/s]
 18%|█▊        | 66872/371472 [5:19:07<22:28:53,  3.76it/s]
 18%|█▊        | 66873/371472 [5:19:08<22:38:25,  3.74it/s]
 18%|█▊        | 66874/371472 [5:19:08<22:59:02,  3.68it/s]
 18%|█▊        | 66875/371472 [5:19:08<23:03:15,  3.67it/s]
 18%|█▊        | 66876/371472 [5:19:08<22:49:42,  3.71it/s]
 18%|█▊        | 66877/371472 [5:19:09<22:35:59,  3.74it/s]
 18%|█▊        | 66878/371472 [5:19:09<22:39:34,  3.73it/s]
 18%|█▊        | 66879/371472 [5:19:09<23:07:31,  3.66it/s]
 18%|█▊        | 66880/371472 [5:19:10<23:43:28,  3.57it/s]
                                                           
{'loss': 4.1531, 'learning_rate': 8.383610937533668e-07, 'epoch': 2.88}

 18%|█▊        | 66880/371472 [5:19:10<23:43:28,  3.57it/s]
 18%|█▊        | 66881/371472 [5:19:10<23:11:24,  3.65it/s]
 18%|█▊        | 66882/371472 [5:19:10<24:56:56,  3.39it/s]
 18%|█▊        | 66883/371472 [5:19:10<24:32:24,  3.45it/s]
 18%|█▊        | 66884/371472 [5:19:11<24:20:24,  3.48it/s]
 18%|█▊        | 66885/371472 [5:19:11<23:40:41,  3.57it/s]
 18%|█▊        | 66886/371472 [5:19:11<22:51:20,  3.70it/s]
 18%|█▊        | 66887/371472 [5:19:12<24:13:41,  3.49it/s]
 18%|█▊        | 66888/371472 [5:19:12<25:46:18,  3.28it/s]
 18%|█▊        | 66889/371472 [5:19:12<25:13:21,  3.35it/s]
 18%|█▊        | 66890/371472 [5:19:13<26:05:33,  3.24it/s]
 18%|█▊        | 66891/371472 [5:19:13<24:50:17,  3.41it/s]
 18%|█▊        | 66892/371472 [5:19:13<25:01:07,  3.38it/s]
 18%|█▊        | 66893/371472 [5:19:13<23:24:04,  3.62it/s]
 18%|█▊        | 66894/371472 [5:19:14<24:32:56,  3.45it/s]
 18%|█▊        | 66895/371472 [5:19:14<25:33:26,  3.31it/s]
 18%|█▊        | 66896/371472 [5:19:14<24:59:59,  3.38it/s]
 18%|█▊        | 66897/371472 [5:19:15<25:11:34,  3.36it/s]
 18%|█▊        | 66898/371472 [5:19:15<24:56:27,  3.39it/s]
 18%|█▊        | 66899/371472 [5:19:15<24:48:43,  3.41it/s]
 18%|█▊        | 66900/371472 [5:19:15<25:56:35,  3.26it/s]
                                                           
{'loss': 4.127, 'learning_rate': 8.383126117778878e-07, 'epoch': 2.88}

 18%|█▊        | 66900/371472 [5:19:15<25:56:35,  3.26it/s]
 18%|█▊        | 66901/371472 [5:19:16<25:16:07,  3.35it/s]
 18%|█▊        | 66902/371472 [5:19:16<24:18:11,  3.48it/s]
 18%|█▊        | 66903/371472 [5:19:16<25:45:05,  3.29it/s]
 18%|█▊        | 66904/371472 [5:19:17<25:39:17,  3.30it/s]
 18%|█▊        | 66905/371472 [5:19:17<25:01:32,  3.38it/s]
 18%|█▊        | 66906/371472 [5:19:17<24:27:54,  3.46it/s]
 18%|█▊        | 66907/371472 [5:19:18<25:57:39,  3.26it/s]
 18%|█▊        | 66908/371472 [5:19:18<27:22:14,  3.09it/s]
 18%|█▊        | 66909/371472 [5:19:18<26:31:45,  3.19it/s]
 18%|█▊        | 66910/371472 [5:19:19<26:25:48,  3.20it/s]
 18%|█▊        | 66911/371472 [5:19:19<25:17:30,  3.34it/s]
 18%|█▊        | 66912/371472 [5:19:19<24:03:14,  3.52it/s]
 18%|█▊        | 66913/371472 [5:19:19<25:29:04,  3.32it/s]
 18%|█▊        | 66914/371472 [5:19:20<25:01:22,  3.38it/s]
 18%|█▊        | 66915/371472 [5:19:20<23:40:00,  3.57it/s]
 18%|█▊        | 66916/371472 [5:19:20<23:23:56,  3.62it/s]
 18%|█▊        | 66917/371472 [5:19:20<23:07:31,  3.66it/s]
 18%|█▊        | 66918/371472 [5:19:21<23:35:58,  3.58it/s]
 18%|█▊        | 66919/371472 [5:19:21<23:32:35,  3.59it/s]
 18%|█▊        | 66920/371472 [5:19:21<23:37:46,  3.58it/s]
                                                           
{'loss': 4.2216, 'learning_rate': 8.38264129802409e-07, 'epoch': 2.88}

 18%|█▊        | 66920/371472 [5:19:21<23:37:46,  3.58it/s]
 18%|█▊        | 66921/371472 [5:19:22<24:30:53,  3.45it/s]
 18%|█▊        | 66922/371472 [5:19:22<23:17:53,  3.63it/s]
 18%|█▊        | 66923/371472 [5:19:22<24:08:57,  3.50it/s]
 18%|█▊        | 66924/371472 [5:19:22<24:19:28,  3.48it/s]
 18%|█▊        | 66925/371472 [5:19:23<23:08:05,  3.66it/s]
 18%|█▊        | 66926/371472 [5:19:23<22:34:35,  3.75it/s]
 18%|█▊        | 66927/371472 [5:19:23<22:01:04,  3.84it/s]
 18%|█▊        | 66928/371472 [5:19:23<22:19:17,  3.79it/s]
 18%|█▊        | 66929/371472 [5:19:24<23:17:25,  3.63it/s]
 18%|█▊        | 66930/371472 [5:19:24<23:33:01,  3.59it/s]
 18%|█▊        | 66931/371472 [5:19:24<23:45:06,  3.56it/s]
 18%|█▊        | 66932/371472 [5:19:25<24:44:46,  3.42it/s]
 18%|█▊        | 66933/371472 [5:19:25<23:36:19,  3.58it/s]
 18%|█▊        | 66934/371472 [5:19:25<23:19:52,  3.63it/s]
 18%|█▊        | 66935/371472 [5:19:25<24:14:31,  3.49it/s]
 18%|█▊        | 66936/371472 [5:19:26<22:46:53,  3.71it/s]
 18%|█▊        | 66937/371472 [5:19:26<22:10:44,  3.81it/s]
 18%|█▊        | 66938/371472 [5:19:26<25:37:12,  3.30it/s]
 18%|█▊        | 66939/371472 [5:19:27<25:35:16,  3.31it/s]
 18%|█▊        | 66940/371472 [5:19:27<24:29:37,  3.45it/s]
                                                           
{'loss': 4.1503, 'learning_rate': 8.382156478269301e-07, 'epoch': 2.88}

 18%|█▊        | 66940/371472 [5:19:27<24:29:37,  3.45it/s]
 18%|█▊        | 66941/371472 [5:19:27<24:19:50,  3.48it/s]
 18%|█▊        | 66942/371472 [5:19:27<23:18:25,  3.63it/s]
 18%|█▊        | 66943/371472 [5:19:28<23:00:59,  3.68it/s]
 18%|█▊        | 66944/371472 [5:19:28<22:17:33,  3.79it/s]
 18%|█▊        | 66945/371472 [5:19:28<22:18:19,  3.79it/s]
 18%|█▊        | 66946/371472 [5:19:29<24:46:23,  3.41it/s]
 18%|█▊        | 66947/371472 [5:19:29<24:50:30,  3.41it/s]
 18%|█▊        | 66948/371472 [5:19:29<25:13:15,  3.35it/s]
 18%|█▊        | 66949/371472 [5:19:29<24:38:37,  3.43it/s]
 18%|█▊        | 66950/371472 [5:19:30<23:30:34,  3.60it/s]
 18%|█▊        | 66951/371472 [5:19:30<22:42:23,  3.73it/s]
 18%|█▊        | 66952/371472 [5:19:30<23:46:59,  3.56it/s]
 18%|█▊        | 66953/371472 [5:19:31<24:24:47,  3.46it/s]
 18%|█▊        | 66954/371472 [5:19:31<24:00:45,  3.52it/s]
 18%|█▊        | 66955/371472 [5:19:31<24:15:29,  3.49it/s]
 18%|█▊        | 66956/371472 [5:19:31<23:34:05,  3.59it/s]
 18%|█▊        | 66957/371472 [5:19:32<22:47:03,  3.71it/s]
 18%|█▊        | 66958/371472 [5:19:32<24:49:07,  3.41it/s]
 18%|█▊        | 66959/371472 [5:19:32<23:38:25,  3.58it/s]
 18%|█▊        | 66960/371472 [5:19:33<23:57:37,  3.53it/s]
                                                           
{'loss': 4.1333, 'learning_rate': 8.381671658514512e-07, 'epoch': 2.88}

 18%|█▊        | 66960/371472 [5:19:33<23:57:37,  3.53it/s]
 18%|█▊        | 66961/371472 [5:19:33<23:12:22,  3.64it/s]
 18%|█▊        | 66962/371472 [5:19:33<23:05:17,  3.66it/s]
 18%|█▊        | 66963/371472 [5:19:33<24:35:47,  3.44it/s]
 18%|█▊        | 66964/371472 [5:19:34<24:10:26,  3.50it/s]
 18%|█▊        | 66965/371472 [5:19:34<24:15:05,  3.49it/s]
 18%|█▊        | 66966/371472 [5:19:34<23:57:40,  3.53it/s]
 18%|█▊        | 66967/371472 [5:19:34<22:59:10,  3.68it/s]
 18%|█▊        | 66968/371472 [5:19:35<24:22:17,  3.47it/s]
 18%|█▊        | 66969/371472 [5:19:35<24:25:46,  3.46it/s]
 18%|█▊        | 66970/371472 [5:19:35<25:14:24,  3.35it/s]
 18%|█▊        | 66971/371472 [5:19:36<25:49:35,  3.28it/s]
 18%|█▊        | 66972/371472 [5:19:36<24:47:02,  3.41it/s]
 18%|█▊        | 66973/371472 [5:19:36<23:24:22,  3.61it/s]
 18%|█▊        | 66974/371472 [5:19:37<23:32:37,  3.59it/s]
 18%|█▊        | 66975/371472 [5:19:37<23:38:32,  3.58it/s]
 18%|█▊        | 66976/371472 [5:19:37<22:47:13,  3.71it/s]
 18%|█▊        | 66977/371472 [5:19:37<23:09:26,  3.65it/s]
 18%|█▊        | 66978/371472 [5:19:38<23:01:46,  3.67it/s]
 18%|█▊        | 66979/371472 [5:19:38<24:37:48,  3.43it/s]
 18%|█▊        | 66980/371472 [5:19:38<24:26:00,  3.46it/s]
                                                           
{'loss': 4.2919, 'learning_rate': 8.381186838759722e-07, 'epoch': 2.88}

 18%|█▊        | 66980/371472 [5:19:38<24:26:00,  3.46it/s]
 18%|█▊        | 66981/371472 [5:19:38<24:21:31,  3.47it/s]
 18%|█▊        | 66982/371472 [5:19:39<24:27:58,  3.46it/s]
 18%|█▊        | 66983/371472 [5:19:39<23:43:51,  3.56it/s]
 18%|█▊        | 66984/371472 [5:19:39<23:17:04,  3.63it/s]
 18%|█▊        | 66985/371472 [5:19:40<23:47:33,  3.55it/s]
 18%|█▊        | 66986/371472 [5:19:40<23:12:36,  3.64it/s]
 18%|█▊        | 66987/371472 [5:19:40<24:02:39,  3.52it/s]
 18%|█▊        | 66988/371472 [5:19:40<24:07:58,  3.50it/s]
 18%|█▊        | 66989/371472 [5:19:41<23:36:57,  3.58it/s]
 18%|█▊        | 66990/371472 [5:19:41<22:56:24,  3.69it/s]
 18%|█▊        | 66991/371472 [5:19:41<24:01:52,  3.52it/s]
 18%|█▊        | 66992/371472 [5:19:42<24:09:23,  3.50it/s]
 18%|█▊        | 66993/371472 [5:19:42<23:08:41,  3.65it/s]
 18%|█▊        | 66994/371472 [5:19:42<25:14:06,  3.35it/s]
 18%|█▊        | 66995/371472 [5:19:42<23:53:35,  3.54it/s]
 18%|█▊        | 66996/371472 [5:19:43<22:56:37,  3.69it/s]
 18%|█▊        | 66997/371472 [5:19:43<23:51:24,  3.55it/s]
 18%|█▊        | 66998/371472 [5:19:43<23:14:54,  3.64it/s]
 18%|█▊        | 66999/371472 [5:19:44<23:18:24,  3.63it/s]
 18%|█▊        | 67000/371472 [5:19:44<25:29:35,  3.32it/s]
                                                           
{'loss': 4.2744, 'learning_rate': 8.380702019004934e-07, 'epoch': 2.89}

 18%|█▊        | 67000/371472 [5:19:44<25:29:35,  3.32it/s]
 18%|█▊        | 67001/371472 [5:19:44<25:21:38,  3.33it/s]
 18%|█▊        | 67002/371472 [5:19:44<24:49:41,  3.41it/s]
 18%|█▊        | 67003/371472 [5:19:45<23:27:13,  3.61it/s]
 18%|█▊        | 67004/371472 [5:19:45<23:10:54,  3.65it/s]
 18%|█▊        | 67005/371472 [5:19:45<23:42:26,  3.57it/s]
 18%|█▊        | 67006/371472 [5:19:46<24:38:18,  3.43it/s]
 18%|█▊        | 67007/371472 [5:19:46<24:06:10,  3.51it/s]
 18%|█▊        | 67008/371472 [5:19:46<23:50:39,  3.55it/s]
 18%|█▊        | 67009/371472 [5:19:46<24:31:54,  3.45it/s]
 18%|█▊        | 67010/371472 [5:19:47<25:39:40,  3.30it/s]
 18%|█▊        | 67011/371472 [5:19:47<25:18:57,  3.34it/s]
 18%|█▊        | 67012/371472 [5:19:47<25:09:32,  3.36it/s]
 18%|█▊        | 67013/371472 [5:19:48<25:04:40,  3.37it/s]
 18%|█▊        | 67014/371472 [5:19:48<24:42:07,  3.42it/s]
 18%|█▊        | 67015/371472 [5:19:48<24:45:09,  3.42it/s]
 18%|█▊        | 67016/371472 [5:19:49<31:10:52,  2.71it/s]
 18%|█▊        | 67017/371472 [5:19:49<28:37:00,  2.96it/s]
 18%|█▊        | 67018/371472 [5:19:49<26:32:20,  3.19it/s]
 18%|█▊        | 67019/371472 [5:19:50<25:25:51,  3.33it/s]
 18%|█▊        | 67020/371472 [5:19:50<31:13:06,  2.71it/s]
                                                           
{'loss': 4.3332, 'learning_rate': 8.380217199250146e-07, 'epoch': 2.89}

 18%|█▊        | 67020/371472 [5:19:50<31:13:06,  2.71it/s]
 18%|█▊        | 67021/371472 [5:19:50<29:17:26,  2.89it/s]
 18%|█▊        | 67022/371472 [5:19:51<27:09:15,  3.11it/s]
 18%|█▊        | 67023/371472 [5:19:51<26:01:04,  3.25it/s]
 18%|█▊        | 67024/371472 [5:19:51<24:27:49,  3.46it/s]
 18%|█▊        | 67025/371472 [5:19:51<24:15:31,  3.49it/s]
 18%|█▊        | 67026/371472 [5:19:52<24:14:58,  3.49it/s]
 18%|█▊        | 67027/371472 [5:19:52<24:02:08,  3.52it/s]
 18%|█▊        | 67028/371472 [5:19:52<23:44:54,  3.56it/s]
 18%|█▊        | 67029/371472 [5:19:53<23:23:34,  3.62it/s]
 18%|█▊        | 67030/371472 [5:19:53<24:06:53,  3.51it/s]
 18%|█▊        | 67031/371472 [5:19:53<23:44:56,  3.56it/s]
 18%|█▊        | 67032/371472 [5:19:53<25:39:07,  3.30it/s]
 18%|█▊        | 67033/371472 [5:19:54<26:18:52,  3.21it/s]
 18%|█▊        | 67034/371472 [5:19:54<24:59:21,  3.38it/s]
 18%|█▊        | 67035/371472 [5:19:54<24:08:05,  3.50it/s]
 18%|█▊        | 67036/371472 [5:19:55<23:29:34,  3.60it/s]
 18%|█▊        | 67037/371472 [5:19:55<24:59:12,  3.38it/s]
 18%|█▊        | 67038/371472 [5:19:55<24:47:19,  3.41it/s]
 18%|█▊        | 67039/371472 [5:19:55<23:42:34,  3.57it/s]
 18%|█▊        | 67040/371472 [5:19:56<24:11:10,  3.50it/s]
                                                           
{'loss': 4.237, 'learning_rate': 8.379732379495357e-07, 'epoch': 2.89}

 18%|█▊        | 67040/371472 [5:19:56<24:11:10,  3.50it/s]
 18%|█▊        | 67041/371472 [5:19:56<23:30:14,  3.60it/s]
 18%|█▊        | 67042/371472 [5:19:56<23:41:22,  3.57it/s]
 18%|█▊        | 67043/371472 [5:19:57<24:32:51,  3.44it/s]
 18%|█▊        | 67044/371472 [5:19:57<24:02:18,  3.52it/s]
 18%|█▊        | 67045/371472 [5:19:57<23:51:59,  3.54it/s]
 18%|█▊        | 67046/371472 [5:19:57<23:25:22,  3.61it/s]
 18%|█▊        | 67047/371472 [5:19:58<24:55:14,  3.39it/s]
 18%|█▊        | 67048/371472 [5:19:58<25:13:37,  3.35it/s]
 18%|█▊        | 67049/371472 [5:19:58<24:41:22,  3.43it/s]
 18%|█▊        | 67050/371472 [5:19:59<23:15:49,  3.63it/s]
 18%|█▊        | 67051/371472 [5:19:59<25:49:38,  3.27it/s]
 18%|█▊        | 67052/371472 [5:19:59<25:03:36,  3.37it/s]
 18%|█▊        | 67053/371472 [5:20:00<24:24:12,  3.47it/s]
 18%|█▊        | 67054/371472 [5:20:00<24:47:56,  3.41it/s]
 18%|█▊        | 67055/371472 [5:20:00<25:18:45,  3.34it/s]
 18%|█▊        | 67056/371472 [5:20:00<24:41:53,  3.42it/s]
 18%|█▊        | 67057/371472 [5:20:01<24:47:13,  3.41it/s]
 18%|█▊        | 67058/371472 [5:20:01<24:04:19,  3.51it/s]
 18%|█▊        | 67059/371472 [5:20:01<23:51:09,  3.55it/s]
 18%|█▊        | 67060/371472 [5:20:02<24:24:26,  3.46it/s]
                                                           
{'loss': 4.0655, 'learning_rate': 8.379247559740567e-07, 'epoch': 2.89}

 18%|█▊        | 67060/371472 [5:20:02<24:24:26,  3.46it/s]
 18%|█▊        | 67061/371472 [5:20:02<23:31:01,  3.60it/s]
 18%|█▊        | 67062/371472 [5:20:02<23:12:27,  3.64it/s]
 18%|█▊        | 67063/371472 [5:20:02<23:43:34,  3.56it/s]
 18%|█▊        | 67064/371472 [5:20:03<22:48:36,  3.71it/s]
 18%|█▊        | 67065/371472 [5:20:03<22:55:08,  3.69it/s]
 18%|█▊        | 67066/371472 [5:20:03<22:54:43,  3.69it/s]
 18%|█▊        | 67067/371472 [5:20:03<22:58:01,  3.68it/s]
 18%|█▊        | 67068/371472 [5:20:04<24:17:03,  3.48it/s]
 18%|█▊        | 67069/371472 [5:20:04<23:14:55,  3.64it/s]
 18%|█▊        | 67070/371472 [5:20:04<24:27:24,  3.46it/s]
 18%|█▊        | 67071/371472 [5:20:05<24:07:29,  3.50it/s]
 18%|█▊        | 67072/371472 [5:20:05<23:13:04,  3.64it/s]
 18%|█▊        | 67073/371472 [5:20:05<23:06:13,  3.66it/s]
 18%|█▊        | 67074/371472 [5:20:05<23:05:39,  3.66it/s]
 18%|█▊        | 67075/371472 [5:20:06<23:34:06,  3.59it/s]
 18%|█▊        | 67076/371472 [5:20:06<22:59:27,  3.68it/s]
 18%|█▊        | 67077/371472 [5:20:06<22:35:29,  3.74it/s]
 18%|█▊        | 67078/371472 [5:20:06<22:28:04,  3.76it/s]
 18%|█▊        | 67079/371472 [5:20:07<22:29:40,  3.76it/s]
 18%|█▊        | 67080/371472 [5:20:07<22:07:34,  3.82it/s]
                                                           
{'loss': 4.3082, 'learning_rate': 8.378762739985777e-07, 'epoch': 2.89}

 18%|█▊        | 67080/371472 [5:20:07<22:07:34,  3.82it/s]
 18%|█▊        | 67081/371472 [5:20:07<22:55:24,  3.69it/s]
 18%|█▊        | 67082/371472 [5:20:08<26:11:21,  3.23it/s]
 18%|█▊        | 67083/371472 [5:20:08<27:46:28,  3.04it/s]
 18%|█▊        | 67084/371472 [5:20:08<26:37:20,  3.18it/s]
 18%|█▊        | 67085/371472 [5:20:09<25:11:04,  3.36it/s]
 18%|█▊        | 67086/371472 [5:20:09<24:55:08,  3.39it/s]
 18%|█▊        | 67087/371472 [5:20:09<25:52:39,  3.27it/s]
 18%|█▊        | 67088/371472 [5:20:09<24:55:52,  3.39it/s]
 18%|█▊        | 67089/371472 [5:20:10<24:07:18,  3.51it/s]
 18%|█▊        | 67090/371472 [5:20:10<23:49:30,  3.55it/s]
 18%|█▊        | 67091/371472 [5:20:10<24:33:44,  3.44it/s]
 18%|█▊        | 67092/371472 [5:20:11<23:42:06,  3.57it/s]
 18%|█▊        | 67093/371472 [5:20:11<22:53:13,  3.69it/s]
 18%|█▊        | 67094/371472 [5:20:11<22:55:40,  3.69it/s]
 18%|█▊        | 67095/371472 [5:20:11<22:27:51,  3.76it/s]
 18%|█▊        | 67096/371472 [5:20:12<21:55:22,  3.86it/s]
 18%|█▊        | 67097/371472 [5:20:12<22:43:13,  3.72it/s]
 18%|█▊        | 67098/371472 [5:20:12<22:17:46,  3.79it/s]
 18%|█▊        | 67099/371472 [5:20:12<21:43:50,  3.89it/s]
 18%|█▊        | 67100/371472 [5:20:13<22:46:54,  3.71it/s]
                                                           
{'loss': 4.2381, 'learning_rate': 8.37827792023099e-07, 'epoch': 2.89}

 18%|█▊        | 67100/371472 [5:20:13<22:46:54,  3.71it/s]
 18%|█▊        | 67101/371472 [5:20:13<22:50:11,  3.70it/s]
 18%|█▊        | 67102/371472 [5:20:13<24:28:15,  3.45it/s]
 18%|█▊        | 67103/371472 [5:20:14<26:54:19,  3.14it/s]
 18%|█▊        | 67104/371472 [5:20:14<25:27:01,  3.32it/s]
 18%|█▊        | 67105/371472 [5:20:14<24:35:34,  3.44it/s]
 18%|█▊        | 67106/371472 [5:20:14<23:48:34,  3.55it/s]
 18%|█▊        | 67107/371472 [5:20:15<23:27:27,  3.60it/s]
 18%|█▊        | 67108/371472 [5:20:15<22:41:32,  3.73it/s]
 18%|█▊        | 67109/371472 [5:20:15<25:27:00,  3.32it/s]
 18%|█▊        | 67110/371472 [5:20:16<27:37:44,  3.06it/s]
 18%|█▊        | 67111/371472 [5:20:16<27:31:39,  3.07it/s]
 18%|█▊        | 67112/371472 [5:20:16<26:23:49,  3.20it/s]
 18%|█▊        | 67113/371472 [5:20:17<24:29:42,  3.45it/s]
 18%|█▊        | 67114/371472 [5:20:17<24:02:41,  3.52it/s]
 18%|█▊        | 67115/371472 [5:20:17<23:12:14,  3.64it/s]
 18%|█▊        | 67116/371472 [5:20:17<22:51:38,  3.70it/s]
 18%|█▊        | 67117/371472 [5:20:18<24:12:40,  3.49it/s]
 18%|█▊        | 67118/371472 [5:20:18<23:46:16,  3.56it/s]
 18%|█▊        | 67119/371472 [5:20:18<22:47:22,  3.71it/s]
 18%|█▊        | 67120/371472 [5:20:18<22:39:51,  3.73it/s]
                                                           
{'loss': 4.0887, 'learning_rate': 8.3777931004762e-07, 'epoch': 2.89}

 18%|█▊        | 67120/371472 [5:20:18<22:39:51,  3.73it/s]
 18%|█▊        | 67121/371472 [5:20:19<23:00:46,  3.67it/s]
 18%|█▊        | 67122/371472 [5:20:19<23:50:35,  3.55it/s]
 18%|█▊        | 67123/371472 [5:20:19<23:30:50,  3.60it/s]
 18%|█▊        | 67124/371472 [5:20:20<24:53:43,  3.40it/s]
 18%|█▊        | 67125/371472 [5:20:20<25:34:31,  3.31it/s]
 18%|█▊        | 67126/371472 [5:20:20<25:08:50,  3.36it/s]
 18%|█▊        | 67127/371472 [5:20:21<24:55:08,  3.39it/s]
 18%|█▊        | 67128/371472 [5:20:21<25:06:37,  3.37it/s]
 18%|█▊        | 67129/371472 [5:20:21<25:15:00,  3.35it/s]
 18%|█▊        | 67130/371472 [5:20:21<25:03:17,  3.37it/s]
 18%|█▊        | 67131/371472 [5:20:22<24:05:50,  3.51it/s]
 18%|█▊        | 67132/371472 [5:20:22<23:18:09,  3.63it/s]
 18%|█▊        | 67133/371472 [5:20:22<23:02:33,  3.67it/s]
 18%|█▊        | 67134/371472 [5:20:23<23:56:19,  3.53it/s]
 18%|█▊        | 67135/371472 [5:20:23<24:25:50,  3.46it/s]
 18%|█▊        | 67136/371472 [5:20:23<24:59:41,  3.38it/s]
 18%|█▊        | 67137/371472 [5:20:23<24:49:01,  3.41it/s]
 18%|█▊        | 67138/371472 [5:20:24<24:40:51,  3.43it/s]
 18%|█▊        | 67139/371472 [5:20:24<24:10:34,  3.50it/s]
 18%|█▊        | 67140/371472 [5:20:24<24:10:55,  3.50it/s]
                                                           
{'loss': 4.1576, 'learning_rate': 8.377308280721411e-07, 'epoch': 2.89}

 18%|█▊        | 67140/371472 [5:20:24<24:10:55,  3.50it/s]
 18%|█▊        | 67141/371472 [5:20:25<23:47:39,  3.55it/s]
 18%|█▊        | 67142/371472 [5:20:25<23:56:50,  3.53it/s]
 18%|█▊        | 67143/371472 [5:20:25<25:46:57,  3.28it/s]
 18%|█▊        | 67144/371472 [5:20:25<24:19:28,  3.48it/s]
 18%|█▊        | 67145/371472 [5:20:26<23:42:38,  3.57it/s]
 18%|█▊        | 67146/371472 [5:20:26<22:49:34,  3.70it/s]
 18%|█▊        | 67147/371472 [5:20:26<24:18:00,  3.48it/s]
 18%|█▊        | 67148/371472 [5:20:27<24:27:11,  3.46it/s]
 18%|█▊        | 67149/371472 [5:20:27<24:08:35,  3.50it/s]
 18%|█▊        | 67150/371472 [5:20:27<23:41:05,  3.57it/s]
 18%|█▊        | 67151/371472 [5:20:27<23:22:23,  3.62it/s]
 18%|█▊        | 67152/371472 [5:20:28<23:47:04,  3.55it/s]
 18%|█▊        | 67153/371472 [5:20:28<22:58:22,  3.68it/s]
 18%|█▊        | 67154/371472 [5:20:28<23:06:22,  3.66it/s]
 18%|█▊        | 67155/371472 [5:20:29<25:06:21,  3.37it/s]
 18%|█▊        | 67156/371472 [5:20:29<26:43:34,  3.16it/s]
 18%|█▊        | 67157/371472 [5:20:29<26:20:31,  3.21it/s]
 18%|█▊        | 67158/371472 [5:20:30<26:05:26,  3.24it/s]
 18%|█▊        | 67159/371472 [5:20:30<25:16:57,  3.34it/s]
 18%|█▊        | 67160/371472 [5:20:30<26:06:02,  3.24it/s]
                                                           
{'loss': 4.1743, 'learning_rate': 8.376823460966623e-07, 'epoch': 2.89}

 18%|█▊        | 67160/371472 [5:20:30<26:06:02,  3.24it/s]
 18%|█▊        | 67161/371472 [5:20:30<25:33:26,  3.31it/s]
 18%|█▊        | 67162/371472 [5:20:31<26:09:01,  3.23it/s]
 18%|█▊        | 67163/371472 [5:20:31<24:52:23,  3.40it/s]
 18%|█▊        | 67164/371472 [5:20:31<23:45:53,  3.56it/s]
 18%|█▊        | 67165/371472 [5:20:31<23:20:19,  3.62it/s]
 18%|█▊        | 67166/371472 [5:20:32<22:54:15,  3.69it/s]
 18%|█▊        | 67167/371472 [5:20:32<22:36:04,  3.74it/s]
 18%|█▊        | 67168/371472 [5:20:32<24:00:18,  3.52it/s]
 18%|█▊        | 67169/371472 [5:20:33<23:42:19,  3.57it/s]
 18%|█▊        | 67170/371472 [5:20:33<26:06:36,  3.24it/s]
 18%|█▊        | 67171/371472 [5:20:33<26:26:00,  3.20it/s]
 18%|█▊        | 67172/371472 [5:20:34<25:08:01,  3.36it/s]
 18%|█▊        | 67173/371472 [5:20:34<26:44:50,  3.16it/s]
 18%|█▊        | 67174/371472 [5:20:34<26:56:53,  3.14it/s]
 18%|█▊        | 67175/371472 [5:20:35<25:19:48,  3.34it/s]
 18%|█▊        | 67176/371472 [5:20:35<26:43:19,  3.16it/s]
 18%|█▊        | 67177/371472 [5:20:35<26:53:20,  3.14it/s]
 18%|█▊        | 67178/371472 [5:20:35<25:56:31,  3.26it/s]
 18%|█▊        | 67179/371472 [5:20:36<25:18:29,  3.34it/s]
 18%|█▊        | 67180/371472 [5:20:36<23:56:21,  3.53it/s]
                                                           
{'loss': 4.2787, 'learning_rate': 8.376338641211834e-07, 'epoch': 2.89}

 18%|█▊        | 67180/371472 [5:20:36<23:56:21,  3.53it/s]
 18%|█▊        | 67181/371472 [5:20:36<22:40:10,  3.73it/s]
 18%|█▊        | 67182/371472 [5:20:37<23:35:48,  3.58it/s]
 18%|█▊        | 67183/371472 [5:20:37<24:50:36,  3.40it/s]
 18%|█▊        | 67184/371472 [5:20:37<24:30:32,  3.45it/s]
 18%|█▊        | 67185/371472 [5:20:37<24:36:41,  3.43it/s]
 18%|█▊        | 67186/371472 [5:20:38<25:22:58,  3.33it/s]
 18%|█▊        | 67187/371472 [5:20:38<27:53:52,  3.03it/s]
 18%|█▊        | 67188/371472 [5:20:38<26:22:32,  3.20it/s]
 18%|█▊        | 67189/371472 [5:20:39<25:58:36,  3.25it/s]
 18%|█▊        | 67190/371472 [5:20:39<25:01:41,  3.38it/s]
 18%|█▊        | 67191/371472 [5:20:39<26:02:29,  3.25it/s]
 18%|█▊        | 67192/371472 [5:20:40<25:16:48,  3.34it/s]
 18%|█▊        | 67193/371472 [5:20:40<24:01:29,  3.52it/s]
 18%|█▊        | 67194/371472 [5:20:40<24:05:26,  3.51it/s]
 18%|█▊        | 67195/371472 [5:20:40<23:40:59,  3.57it/s]
 18%|█▊        | 67196/371472 [5:20:41<24:37:07,  3.43it/s]
 18%|█▊        | 67197/371472 [5:20:41<23:37:03,  3.58it/s]
 18%|█▊        | 67198/371472 [5:20:41<26:28:28,  3.19it/s]
 18%|█▊        | 67199/371472 [5:20:42<25:29:31,  3.32it/s]
 18%|█▊        | 67200/371472 [5:20:42<24:24:26,  3.46it/s]
                                                           
{'loss': 4.2371, 'learning_rate': 8.375853821457044e-07, 'epoch': 2.89}

 18%|█▊        | 67200/371472 [5:20:42<24:24:26,  3.46it/s]
 18%|█▊        | 67201/371472 [5:20:42<24:36:25,  3.43it/s]
 18%|█▊        | 67202/371472 [5:20:42<24:20:59,  3.47it/s]
 18%|█▊        | 67203/371472 [5:20:43<23:37:34,  3.58it/s]
 18%|█▊        | 67204/371472 [5:20:43<22:53:04,  3.69it/s]
 18%|█▊        | 67205/371472 [5:20:43<22:38:45,  3.73it/s]
 18%|█▊        | 67206/371472 [5:20:43<21:42:19,  3.89it/s]
 18%|█▊        | 67207/371472 [5:20:44<21:36:53,  3.91it/s]
 18%|█▊        | 67208/371472 [5:20:44<22:40:45,  3.73it/s]
 18%|█▊        | 67209/371472 [5:20:44<22:29:04,  3.76it/s]
 18%|█▊        | 67210/371472 [5:20:45<22:45:16,  3.71it/s]
 18%|█▊        | 67211/371472 [5:20:45<22:45:49,  3.71it/s]
 18%|█▊        | 67212/371472 [5:20:45<22:03:37,  3.83it/s]
 18%|█▊        | 67213/371472 [5:20:45<21:30:59,  3.93it/s]
 18%|█▊        | 67214/371472 [5:20:46<21:15:28,  3.98it/s]
 18%|█▊        | 67215/371472 [5:20:46<21:24:05,  3.95it/s]
 18%|█▊        | 67216/371472 [5:20:46<21:17:14,  3.97it/s]
 18%|█▊        | 67217/371472 [5:20:46<21:41:01,  3.90it/s]
 18%|█▊        | 67218/371472 [5:20:47<22:33:46,  3.75it/s]
 18%|█▊        | 67219/371472 [5:20:47<22:41:02,  3.73it/s]
 18%|█▊        | 67220/371472 [5:20:47<22:57:51,  3.68it/s]
                                                           
{'loss': 4.2381, 'learning_rate': 8.375369001702255e-07, 'epoch': 2.9}

 18%|█▊        | 67220/371472 [5:20:47<22:57:51,  3.68it/s]
 18%|█▊        | 67221/371472 [5:20:47<23:05:47,  3.66it/s]
 18%|█▊        | 67222/371472 [5:20:48<25:04:57,  3.37it/s]
 18%|█▊        | 67223/371472 [5:20:48<24:05:41,  3.51it/s]
 18%|█▊        | 67224/371472 [5:20:48<24:21:05,  3.47it/s]
 18%|█▊        | 67225/371472 [5:20:49<23:33:25,  3.59it/s]
 18%|█▊        | 67226/371472 [5:20:49<23:14:16,  3.64it/s]
 18%|█▊        | 67227/371472 [5:20:49<22:12:08,  3.81it/s]
 18%|█▊        | 67228/371472 [5:20:49<24:39:08,  3.43it/s]
 18%|█▊        | 67229/371472 [5:20:50<23:26:07,  3.61it/s]
 18%|█▊        | 67230/371472 [5:20:50<24:19:32,  3.47it/s]
 18%|█▊        | 67231/371472 [5:20:50<25:25:47,  3.32it/s]
 18%|█▊        | 67232/371472 [5:20:51<26:03:26,  3.24it/s]
 18%|█▊        | 67233/371472 [5:20:51<28:32:52,  2.96it/s]
 18%|█▊        | 67234/371472 [5:20:51<26:39:57,  3.17it/s]
 18%|█▊        | 67235/371472 [5:20:52<26:44:05,  3.16it/s]
 18%|█▊        | 67236/371472 [5:20:52<25:28:54,  3.32it/s]
 18%|█▊        | 67237/371472 [5:20:52<24:14:48,  3.49it/s]
 18%|█▊        | 67238/371472 [5:20:53<27:09:30,  3.11it/s]
 18%|█▊        | 67239/371472 [5:20:53<25:06:23,  3.37it/s]
 18%|█▊        | 67240/371472 [5:20:53<26:15:01,  3.22it/s]
                                                           
{'loss': 4.3043, 'learning_rate': 8.374884181947467e-07, 'epoch': 2.9}

 18%|█▊        | 67240/371472 [5:20:53<26:15:01,  3.22it/s]
 18%|█▊        | 67241/371472 [5:20:54<27:20:05,  3.09it/s]
 18%|█▊        | 67242/371472 [5:20:54<25:24:29,  3.33it/s]
 18%|█▊        | 67243/371472 [5:20:54<24:41:08,  3.42it/s]
 18%|█▊        | 67244/371472 [5:20:54<26:10:45,  3.23it/s]
 18%|█▊        | 67245/371472 [5:20:55<27:06:23,  3.12it/s]
 18%|█▊        | 67246/371472 [5:20:55<25:29:08,  3.32it/s]
 18%|█▊        | 67247/371472 [5:20:55<24:22:42,  3.47it/s]
 18%|█▊        | 67248/371472 [5:20:56<24:35:38,  3.44it/s]
 18%|█▊        | 67249/371472 [5:20:56<23:22:08,  3.62it/s]
 18%|█▊        | 67250/371472 [5:20:56<22:39:38,  3.73it/s]
 18%|█▊        | 67251/371472 [5:20:56<21:59:03,  3.84it/s]
 18%|█▊        | 67252/371472 [5:20:57<22:09:44,  3.81it/s]
 18%|█▊        | 67253/371472 [5:20:57<22:43:14,  3.72it/s]
 18%|█▊        | 67254/371472 [5:20:57<23:27:31,  3.60it/s]
 18%|█▊        | 67255/371472 [5:20:57<23:05:47,  3.66it/s]
 18%|█▊        | 67256/371472 [5:20:58<22:24:48,  3.77it/s]
 18%|█▊        | 67257/371472 [5:20:58<24:59:31,  3.38it/s]
 18%|█▊        | 67258/371472 [5:20:58<25:21:44,  3.33it/s]
 18%|█▊        | 67259/371472 [5:20:59<24:28:39,  3.45it/s]
 18%|█▊        | 67260/371472 [5:20:59<23:13:04,  3.64it/s]
                                                           
{'loss': 4.1704, 'learning_rate': 8.374399362192678e-07, 'epoch': 2.9}

 18%|█▊        | 67260/371472 [5:20:59<23:13:04,  3.64it/s]
 18%|█▊        | 67261/371472 [5:20:59<23:17:32,  3.63it/s]
 18%|█▊        | 67262/371472 [5:20:59<23:39:57,  3.57it/s]
 18%|█▊        | 67263/371472 [5:21:00<22:59:48,  3.67it/s]
 18%|█▊        | 67264/371472 [5:21:00<22:10:09,  3.81it/s]
 18%|█▊        | 67265/371472 [5:21:00<22:56:19,  3.68it/s]
 18%|█▊        | 67266/371472 [5:21:00<23:23:01,  3.61it/s]
 18%|█▊        | 67267/371472 [5:21:01<23:37:50,  3.58it/s]
 18%|█▊        | 67268/371472 [5:21:01<22:48:40,  3.70it/s]
 18%|█▊        | 67269/371472 [5:21:01<24:14:50,  3.48it/s]
 18%|█▊        | 67270/371472 [5:21:02<23:22:08,  3.62it/s]
 18%|█▊        | 67271/371472 [5:21:02<23:44:08,  3.56it/s]
 18%|█▊        | 67272/371472 [5:21:02<25:14:23,  3.35it/s]
 18%|█▊        | 67273/371472 [5:21:03<24:27:16,  3.46it/s]
 18%|█▊        | 67274/371472 [5:21:03<24:25:46,  3.46it/s]
 18%|█▊        | 67275/371472 [5:21:03<25:06:43,  3.36it/s]
 18%|█▊        | 67276/371472 [5:21:03<25:48:48,  3.27it/s]
 18%|█▊        | 67277/371472 [5:21:04<25:36:06,  3.30it/s]
 18%|█▊        | 67278/371472 [5:21:04<25:10:19,  3.36it/s]
 18%|█▊        | 67279/371472 [5:21:04<24:22:42,  3.47it/s]
 18%|█▊        | 67280/371472 [5:21:05<23:37:57,  3.58it/s]
                                                           
{'loss': 4.0632, 'learning_rate': 8.373914542437889e-07, 'epoch': 2.9}

 18%|█▊        | 67280/371472 [5:21:05<23:37:57,  3.58it/s]
 18%|█▊        | 67281/371472 [5:21:05<23:34:31,  3.58it/s]
 18%|█▊        | 67282/371472 [5:21:05<23:29:23,  3.60it/s]
 18%|█▊        | 67283/371472 [5:21:05<22:26:19,  3.77it/s]
 18%|█▊        | 67284/371472 [5:21:06<22:24:16,  3.77it/s]
 18%|█▊        | 67285/371472 [5:21:06<24:53:04,  3.40it/s]
 18%|█▊        | 67286/371472 [5:21:06<24:28:44,  3.45it/s]
 18%|█▊        | 67287/371472 [5:21:07<25:14:26,  3.35it/s]
 18%|█▊        | 67288/371472 [5:21:07<23:59:36,  3.52it/s]
 18%|█▊        | 67289/371472 [5:21:07<23:34:50,  3.58it/s]
 18%|█▊        | 67290/371472 [5:21:07<25:22:21,  3.33it/s]
 18%|█▊        | 67291/371472 [5:21:08<24:47:31,  3.41it/s]
 18%|█▊        | 67292/371472 [5:21:08<24:03:59,  3.51it/s]
 18%|█▊        | 67293/371472 [5:21:08<25:05:36,  3.37it/s]
 18%|█▊        | 67294/371472 [5:21:09<24:37:15,  3.43it/s]
 18%|█▊        | 67295/371472 [5:21:09<24:21:43,  3.47it/s]
 18%|█▊        | 67296/371472 [5:21:09<23:03:27,  3.66it/s]
 18%|█▊        | 67297/371472 [5:21:09<26:14:45,  3.22it/s]
 18%|█▊        | 67298/371472 [5:21:10<25:20:52,  3.33it/s]
 18%|█▊        | 67299/371472 [5:21:10<26:31:11,  3.19it/s]
 18%|█▊        | 67300/371472 [5:21:10<26:20:55,  3.21it/s]
                                                           
{'loss': 4.035, 'learning_rate': 8.3734297226831e-07, 'epoch': 2.9}

 18%|█▊        | 67300/371472 [5:21:10<26:20:55,  3.21it/s]
 18%|█▊        | 67301/371472 [5:21:11<25:23:13,  3.33it/s]
 18%|█▊        | 67302/371472 [5:21:11<25:43:18,  3.28it/s]
 18%|█▊        | 67303/371472 [5:21:11<24:10:44,  3.49it/s]
 18%|█▊        | 67304/371472 [5:21:12<24:45:39,  3.41it/s]
 18%|█▊        | 67305/371472 [5:21:12<23:48:12,  3.55it/s]
 18%|█▊        | 67306/371472 [5:21:12<24:32:55,  3.44it/s]
 18%|█▊        | 67307/371472 [5:21:12<23:18:55,  3.62it/s]
 18%|█▊        | 67308/371472 [5:21:13<22:51:01,  3.70it/s]
 18%|█▊        | 67309/371472 [5:21:13<23:40:41,  3.57it/s]
 18%|█▊        | 67310/371472 [5:21:13<23:14:44,  3.63it/s]
 18%|█▊        | 67311/371472 [5:21:13<23:11:10,  3.64it/s]
 18%|█▊        | 67312/371472 [5:21:14<22:03:31,  3.83it/s]
 18%|█▊        | 67313/371472 [5:21:14<22:32:10,  3.75it/s]
 18%|█▊        | 67314/371472 [5:21:14<23:03:15,  3.66it/s]
 18%|█▊        | 67315/371472 [5:21:15<23:01:15,  3.67it/s]
 18%|█▊        | 67316/371472 [5:21:15<23:29:11,  3.60it/s]
 18%|█▊        | 67317/371472 [5:21:15<23:32:46,  3.59it/s]
 18%|█▊        | 67318/371472 [5:21:15<23:50:37,  3.54it/s]
 18%|█▊        | 67319/371472 [5:21:16<24:44:43,  3.41it/s]
 18%|█▊        | 67320/371472 [5:21:16<24:02:00,  3.52it/s]
                                                           
{'loss': 4.2782, 'learning_rate': 8.372944902928311e-07, 'epoch': 2.9}

 18%|█▊        | 67320/371472 [5:21:16<24:02:00,  3.52it/s]
 18%|█▊        | 67321/371472 [5:21:16<24:04:58,  3.51it/s]
 18%|█▊        | 67322/371472 [5:21:17<24:31:35,  3.44it/s]
 18%|█▊        | 67323/371472 [5:21:17<24:08:24,  3.50it/s]
 18%|█▊        | 67324/371472 [5:21:17<25:16:16,  3.34it/s]
 18%|█▊        | 67325/371472 [5:21:17<25:11:20,  3.35it/s]
 18%|█▊        | 67326/371472 [5:21:18<24:28:14,  3.45it/s]
 18%|█▊        | 67327/371472 [5:21:18<23:45:07,  3.56it/s]
 18%|█▊        | 67328/371472 [5:21:18<23:16:54,  3.63it/s]
 18%|█▊        | 67329/371472 [5:21:19<23:03:38,  3.66it/s]
 18%|█▊        | 67330/371472 [5:21:19<22:55:07,  3.69it/s]
 18%|█▊        | 67331/371472 [5:21:19<23:04:34,  3.66it/s]
 18%|█▊        | 67332/371472 [5:21:19<24:48:29,  3.41it/s]
 18%|█▊        | 67333/371472 [5:21:20<23:42:18,  3.56it/s]
 18%|█▊        | 67334/371472 [5:21:20<23:08:34,  3.65it/s]
 18%|█▊        | 67335/371472 [5:21:20<24:26:52,  3.46it/s]
 18%|█▊        | 67336/371472 [5:21:21<24:06:20,  3.50it/s]
 18%|█▊        | 67337/371472 [5:21:21<27:05:35,  3.12it/s]
 18%|█▊        | 67338/371472 [5:21:21<26:41:28,  3.17it/s]
 18%|█▊        | 67339/371472 [5:21:21<25:25:04,  3.32it/s]
 18%|█▊        | 67340/371472 [5:21:22<25:11:38,  3.35it/s]
                                                           
{'loss': 4.1251, 'learning_rate': 8.372460083173522e-07, 'epoch': 2.9}

 18%|█▊        | 67340/371472 [5:21:22<25:11:38,  3.35it/s]
 18%|█▊        | 67341/371472 [5:21:22<25:59:53,  3.25it/s]
 18%|█▊        | 67342/371472 [5:21:22<25:04:46,  3.37it/s]
 18%|█▊        | 67343/371472 [5:21:23<24:14:48,  3.48it/s]
 18%|█▊        | 67344/371472 [5:21:23<24:45:55,  3.41it/s]
 18%|█▊        | 67345/371472 [5:21:23<23:44:28,  3.56it/s]
 18%|█▊        | 67346/371472 [5:21:23<22:55:54,  3.68it/s]
 18%|█▊        | 67347/371472 [5:21:24<26:05:58,  3.24it/s]
 18%|█▊        | 67348/371472 [5:21:24<25:02:26,  3.37it/s]
 18%|█▊        | 67349/371472 [5:21:24<24:37:11,  3.43it/s]
 18%|█▊        | 67350/371472 [5:21:25<24:30:23,  3.45it/s]
 18%|█▊        | 67351/371472 [5:21:25<26:12:46,  3.22it/s]
 18%|█▊        | 67352/371472 [5:21:25<24:56:23,  3.39it/s]
 18%|█▊        | 67353/371472 [5:21:26<26:04:28,  3.24it/s]
 18%|█▊        | 67354/371472 [5:21:26<25:34:48,  3.30it/s]
 18%|█▊        | 67355/371472 [5:21:26<24:02:37,  3.51it/s]
 18%|█▊        | 67356/371472 [5:21:26<23:38:57,  3.57it/s]
 18%|█▊        | 67357/371472 [5:21:27<23:23:58,  3.61it/s]
 18%|█▊        | 67358/371472 [5:21:27<22:41:33,  3.72it/s]
 18%|█▊        | 67359/371472 [5:21:27<23:02:16,  3.67it/s]
 18%|█▊        | 67360/371472 [5:21:28<22:46:24,  3.71it/s]
                                                           
{'loss': 4.3405, 'learning_rate': 8.371975263418733e-07, 'epoch': 2.9}

 18%|█▊        | 67360/371472 [5:21:28<22:46:24,  3.71it/s]
 18%|█▊        | 67361/371472 [5:21:28<25:25:31,  3.32it/s]
 18%|█▊        | 67362/371472 [5:21:28<24:48:07,  3.41it/s]
 18%|█▊        | 67363/371472 [5:21:28<24:29:04,  3.45it/s]
 18%|█▊        | 67364/371472 [5:21:29<23:46:16,  3.55it/s]
 18%|█▊        | 67365/371472 [5:21:29<23:33:13,  3.59it/s]
 18%|█▊        | 67366/371472 [5:21:29<22:53:47,  3.69it/s]
 18%|█▊        | 67367/371472 [5:21:30<24:52:46,  3.40it/s]
 18%|█▊        | 67368/371472 [5:21:30<23:44:45,  3.56it/s]
 18%|█▊        | 67369/371472 [5:21:30<23:23:55,  3.61it/s]
 18%|█▊        | 67370/371472 [5:21:30<26:14:24,  3.22it/s]
 18%|█▊        | 67371/371472 [5:21:31<25:08:47,  3.36it/s]
 18%|█▊        | 67372/371472 [5:21:31<24:38:32,  3.43it/s]
 18%|█▊        | 67373/371472 [5:21:31<24:16:31,  3.48it/s]
 18%|█▊        | 67374/371472 [5:21:32<24:07:56,  3.50it/s]
 18%|█▊        | 67375/371472 [5:21:32<24:27:20,  3.45it/s]
 18%|█▊        | 67376/371472 [5:21:32<25:11:12,  3.35it/s]
 18%|█▊        | 67377/371472 [5:21:32<24:43:14,  3.42it/s]
 18%|█▊        | 67378/371472 [5:21:33<27:31:12,  3.07it/s]
 18%|█▊        | 67379/371472 [5:21:33<26:39:24,  3.17it/s]
 18%|█▊        | 67380/371472 [5:21:33<26:05:02,  3.24it/s]
                                                           
{'loss': 4.1674, 'learning_rate': 8.371490443663944e-07, 'epoch': 2.9}

 18%|█▊        | 67380/371472 [5:21:33<26:05:02,  3.24it/s]
 18%|█▊        | 67381/371472 [5:21:34<24:17:10,  3.48it/s]
 18%|█▊        | 67382/371472 [5:21:34<23:05:53,  3.66it/s]
 18%|█▊        | 67383/371472 [5:21:34<22:39:05,  3.73it/s]
 18%|█▊        | 67384/371472 [5:21:34<22:10:52,  3.81it/s]
 18%|█▊        | 67385/371472 [5:21:35<23:02:07,  3.67it/s]
 18%|█▊        | 67386/371472 [5:21:35<23:29:13,  3.60it/s]
 18%|█▊        | 67387/371472 [5:21:35<22:35:25,  3.74it/s]
 18%|█▊        | 67388/371472 [5:21:36<22:08:23,  3.82it/s]
 18%|█▊        | 67389/371472 [5:21:36<22:43:33,  3.72it/s]
 18%|█▊        | 67390/371472 [5:21:36<22:03:47,  3.83it/s]
 18%|█▊        | 67391/371472 [5:21:36<22:31:05,  3.75it/s]
 18%|█▊        | 67392/371472 [5:21:37<22:19:57,  3.78it/s]
 18%|█▊        | 67393/371472 [5:21:37<22:48:49,  3.70it/s]
 18%|█▊        | 67394/371472 [5:21:37<22:26:07,  3.76it/s]
 18%|█▊        | 67395/371472 [5:21:37<23:25:16,  3.61it/s]
 18%|█▊        | 67396/371472 [5:21:38<23:17:27,  3.63it/s]
 18%|█▊        | 67397/371472 [5:21:38<22:27:58,  3.76it/s]
 18%|█▊        | 67398/371472 [5:21:38<22:10:54,  3.81it/s]
 18%|█▊        | 67399/371472 [5:21:38<21:58:34,  3.84it/s]
 18%|█▊        | 67400/371472 [5:21:39<22:19:25,  3.78it/s]
                                                           
{'loss': 4.2904, 'learning_rate': 8.371005623909156e-07, 'epoch': 2.9}

 18%|█▊        | 67400/371472 [5:21:39<22:19:25,  3.78it/s]
 18%|█▊        | 67401/371472 [5:21:39<22:45:07,  3.71it/s]
 18%|█▊        | 67402/371472 [5:21:39<24:24:42,  3.46it/s]
 18%|█▊        | 67403/371472 [5:21:40<23:43:54,  3.56it/s]
 18%|█▊        | 67404/371472 [5:21:40<22:58:37,  3.68it/s]
 18%|█▊        | 67405/371472 [5:21:40<22:20:48,  3.78it/s]
 18%|█▊        | 67406/371472 [5:21:40<24:24:34,  3.46it/s]
 18%|█▊        | 67407/371472 [5:21:41<24:29:41,  3.45it/s]
 18%|█▊        | 67408/371472 [5:21:41<23:38:06,  3.57it/s]
 18%|█▊        | 67409/371472 [5:21:41<23:51:44,  3.54it/s]
 18%|█▊        | 67410/371472 [5:21:42<23:53:22,  3.54it/s]
 18%|█▊        | 67411/371472 [5:21:42<23:03:44,  3.66it/s]
 18%|█▊        | 67412/371472 [5:21:42<23:46:47,  3.55it/s]
 18%|█▊        | 67413/371472 [5:21:42<23:26:31,  3.60it/s]
 18%|█▊        | 67414/371472 [5:21:43<25:36:24,  3.30it/s]
 18%|█▊        | 67415/371472 [5:21:43<24:56:31,  3.39it/s]
 18%|█▊        | 67416/371472 [5:21:43<25:50:42,  3.27it/s]
 18%|█▊        | 67417/371472 [5:21:44<25:34:20,  3.30it/s]
 18%|█▊        | 67418/371472 [5:21:44<24:24:58,  3.46it/s]
 18%|█▊        | 67419/371472 [5:21:44<24:19:33,  3.47it/s]
 18%|█▊        | 67420/371472 [5:21:44<23:12:37,  3.64it/s]
                                                           
{'loss': 4.2848, 'learning_rate': 8.370520804154366e-07, 'epoch': 2.9}

 18%|█▊        | 67420/371472 [5:21:44<23:12:37,  3.64it/s]
 18%|█▊        | 67421/371472 [5:21:45<23:23:12,  3.61it/s]
 18%|█▊        | 67422/371472 [5:21:45<23:34:23,  3.58it/s]
 18%|█▊        | 67423/371472 [5:21:45<24:00:55,  3.52it/s]
 18%|█▊        | 67424/371472 [5:21:46<24:02:06,  3.51it/s]
 18%|█▊        | 67425/371472 [5:21:46<23:11:22,  3.64it/s]
 18%|█▊        | 67426/371472 [5:21:46<24:42:13,  3.42it/s]
 18%|█▊        | 67427/371472 [5:21:46<24:17:58,  3.48it/s]
 18%|█▊        | 67428/371472 [5:21:47<25:42:04,  3.29it/s]
 18%|█▊        | 67429/371472 [5:21:47<24:47:36,  3.41it/s]
 18%|█▊        | 67430/371472 [5:21:47<23:36:19,  3.58it/s]
 18%|█▊        | 67431/371472 [5:21:48<23:12:35,  3.64it/s]
 18%|█▊        | 67432/371472 [5:21:48<23:07:13,  3.65it/s]
 18%|█▊        | 67433/371472 [5:21:48<24:33:28,  3.44it/s]
 18%|█▊        | 67434/371472 [5:21:48<24:15:15,  3.48it/s]
 18%|█▊        | 67435/371472 [5:21:49<23:29:32,  3.59it/s]
 18%|█▊        | 67436/371472 [5:21:49<24:04:54,  3.51it/s]
 18%|█▊        | 67437/371472 [5:21:49<22:39:02,  3.73it/s]
 18%|█▊        | 67438/371472 [5:21:50<22:31:32,  3.75it/s]
 18%|█▊        | 67439/371472 [5:21:50<22:20:36,  3.78it/s]
 18%|█▊        | 67440/371472 [5:21:50<22:12:17,  3.80it/s]
                                                           
{'loss': 4.369, 'learning_rate': 8.370035984399577e-07, 'epoch': 2.9}

 18%|█▊        | 67440/371472 [5:21:50<22:12:17,  3.80it/s]
 18%|█▊        | 67441/371472 [5:21:50<22:02:41,  3.83it/s]
 18%|█▊        | 67442/371472 [5:21:51<22:07:58,  3.82it/s]
 18%|█▊        | 67443/371472 [5:21:51<22:00:06,  3.84it/s]
 18%|█▊        | 67444/371472 [5:21:51<22:55:09,  3.68it/s]
 18%|█▊        | 67445/371472 [5:21:51<22:09:26,  3.81it/s]
 18%|█▊        | 67446/371472 [5:21:52<22:15:38,  3.79it/s]
 18%|█▊        | 67447/371472 [5:21:52<22:18:31,  3.79it/s]
 18%|█▊        | 67448/371472 [5:21:52<21:59:14,  3.84it/s]
 18%|█▊        | 67449/371472 [5:21:52<21:58:57,  3.84it/s]
 18%|█▊        | 67450/371472 [5:21:53<22:25:44,  3.77it/s]
 18%|█▊        | 67451/371472 [5:21:53<22:39:00,  3.73it/s]
 18%|█▊        | 67452/371472 [5:21:53<23:07:02,  3.65it/s]
 18%|█▊        | 67453/371472 [5:21:54<23:27:08,  3.60it/s]
 18%|█▊        | 67454/371472 [5:21:54<24:59:33,  3.38it/s]
 18%|█▊        | 67455/371472 [5:21:54<24:28:45,  3.45it/s]
 18%|█▊        | 67456/371472 [5:21:54<25:57:57,  3.25it/s]
 18%|█▊        | 67457/371472 [5:21:55<28:29:57,  2.96it/s]
 18%|█▊        | 67458/371472 [5:21:55<27:01:10,  3.13it/s]
 18%|█▊        | 67459/371472 [5:21:55<25:21:26,  3.33it/s]
 18%|█▊        | 67460/371472 [5:21:56<24:11:48,  3.49it/s]
                                                           
{'loss': 4.2133, 'learning_rate': 8.369551164644788e-07, 'epoch': 2.91}

 18%|█▊        | 67460/371472 [5:21:56<24:11:48,  3.49it/s]
 18%|█▊        | 67461/371472 [5:21:56<24:31:56,  3.44it/s]
 18%|█▊        | 67462/371472 [5:21:56<24:29:34,  3.45it/s]
 18%|█▊        | 67463/371472 [5:21:57<24:41:07,  3.42it/s]
 18%|█▊        | 67464/371472 [5:21:57<24:57:46,  3.38it/s]
 18%|█▊        | 67465/371472 [5:21:57<23:28:00,  3.60it/s]
 18%|█▊        | 67466/371472 [5:21:57<23:46:14,  3.55it/s]
 18%|█▊        | 67467/371472 [5:21:58<23:17:45,  3.62it/s]
 18%|█▊        | 67468/371472 [5:21:58<22:24:24,  3.77it/s]
 18%|█▊        | 67469/371472 [5:21:58<22:37:19,  3.73it/s]
 18%|█▊        | 67470/371472 [5:21:58<22:01:48,  3.83it/s]
 18%|█▊        | 67471/371472 [5:21:59<23:07:51,  3.65it/s]
 18%|█▊        | 67472/371472 [5:21:59<25:31:00,  3.31it/s]
 18%|█▊        | 67473/371472 [5:21:59<26:05:41,  3.24it/s]
 18%|█▊        | 67474/371472 [5:22:00<25:01:47,  3.37it/s]
 18%|█▊        | 67475/371472 [5:22:00<23:42:23,  3.56it/s]
 18%|█▊        | 67476/371472 [5:22:00<23:12:08,  3.64it/s]
 18%|█▊        | 67477/371472 [5:22:01<24:15:48,  3.48it/s]
 18%|█▊        | 67478/371472 [5:22:01<23:43:04,  3.56it/s]
 18%|█▊        | 67479/371472 [5:22:01<23:03:59,  3.66it/s]
 18%|█▊        | 67480/371472 [5:22:01<22:56:51,  3.68it/s]
                                                           
{'loss': 4.4579, 'learning_rate': 8.36906634489e-07, 'epoch': 2.91}

 18%|█▊        | 67480/371472 [5:22:01<22:56:51,  3.68it/s]
 18%|█▊        | 67481/371472 [5:22:02<23:05:16,  3.66it/s]
 18%|█▊        | 67482/371472 [5:22:02<23:28:42,  3.60it/s]
 18%|█▊        | 67483/371472 [5:22:02<23:56:01,  3.53it/s]
 18%|█▊        | 67484/371472 [5:22:02<23:14:46,  3.63it/s]
 18%|█▊        | 67485/371472 [5:22:03<23:30:26,  3.59it/s]
 18%|█▊        | 67486/371472 [5:22:03<23:40:49,  3.57it/s]
 18%|█▊        | 67487/371472 [5:22:03<24:04:55,  3.51it/s]
 18%|█▊        | 67488/371472 [5:22:04<24:45:03,  3.41it/s]
 18%|█▊        | 67489/371472 [5:22:04<23:36:26,  3.58it/s]
 18%|█▊        | 67490/371472 [5:22:04<24:29:33,  3.45it/s]
 18%|█▊        | 67491/371472 [5:22:04<23:52:07,  3.54it/s]
 18%|█▊        | 67492/371472 [5:22:05<23:54:05,  3.53it/s]
 18%|█▊        | 67493/371472 [5:22:05<24:57:30,  3.38it/s]
 18%|█▊        | 67494/371472 [5:22:05<25:25:56,  3.32it/s]
 18%|█▊        | 67495/371472 [5:22:06<24:26:27,  3.45it/s]
 18%|█▊        | 67496/371472 [5:22:06<24:52:24,  3.39it/s]
 18%|█▊        | 67497/371472 [5:22:06<23:44:11,  3.56it/s]
 18%|█▊        | 67498/371472 [5:22:06<24:39:59,  3.42it/s]
 18%|█▊        | 67499/371472 [5:22:07<24:25:34,  3.46it/s]
 18%|█▊        | 67500/371472 [5:22:07<24:21:37,  3.47it/s]
                                                           
{'loss': 4.0013, 'learning_rate': 8.368581525135209e-07, 'epoch': 2.91}

 18%|█▊        | 67500/371472 [5:22:07<24:21:37,  3.47it/s]
 18%|█▊        | 67501/371472 [5:22:07<26:49:57,  3.15it/s]
 18%|█▊        | 67502/371472 [5:22:08<26:13:27,  3.22it/s]
 18%|█▊        | 67503/371472 [5:22:08<25:14:14,  3.35it/s]
 18%|█▊        | 67504/371472 [5:22:08<25:32:20,  3.31it/s]
 18%|█▊        | 67505/371472 [5:22:09<28:02:48,  3.01it/s]
 18%|█▊        | 67506/371472 [5:22:09<26:44:23,  3.16it/s]
 18%|█▊        | 67507/371472 [5:22:09<25:21:11,  3.33it/s]
 18%|█▊        | 67508/371472 [5:22:10<30:02:15,  2.81it/s]
 18%|█▊        | 67509/371472 [5:22:10<27:50:30,  3.03it/s]
 18%|█▊        | 67510/371472 [5:22:10<28:53:01,  2.92it/s]
 18%|█▊        | 67511/371472 [5:22:11<26:57:03,  3.13it/s]
 18%|█▊        | 67512/371472 [5:22:11<25:16:54,  3.34it/s]
 18%|█▊        | 67513/371472 [5:22:11<26:15:56,  3.21it/s]
 18%|█▊        | 67514/371472 [5:22:12<26:36:02,  3.17it/s]
 18%|█▊        | 67515/371472 [5:22:12<26:13:09,  3.22it/s]
 18%|█▊        | 67516/371472 [5:22:12<24:31:01,  3.44it/s]
 18%|█▊        | 67517/371472 [5:22:12<25:35:01,  3.30it/s]
 18%|█▊        | 67518/371472 [5:22:13<25:11:15,  3.35it/s]
 18%|█▊        | 67519/371472 [5:22:13<23:50:54,  3.54it/s]
 18%|█▊        | 67520/371472 [5:22:13<22:51:38,  3.69it/s]
                                                           
{'loss': 4.0972, 'learning_rate': 8.368096705380421e-07, 'epoch': 2.91}

 18%|█▊        | 67520/371472 [5:22:13<22:51:38,  3.69it/s]
 18%|█▊        | 67521/371472 [5:22:13<22:33:50,  3.74it/s]
 18%|█▊        | 67522/371472 [5:22:14<23:33:17,  3.58it/s]
 18%|█▊        | 67523/371472 [5:22:14<22:49:08,  3.70it/s]
 18%|█▊        | 67524/371472 [5:22:14<23:36:35,  3.58it/s]
 18%|█▊        | 67525/371472 [5:22:15<22:59:39,  3.67it/s]
 18%|█▊        | 67526/371472 [5:22:15<22:52:11,  3.69it/s]
 18%|█▊        | 67527/371472 [5:22:15<26:14:06,  3.22it/s]
 18%|█▊        | 67528/371472 [5:22:16<26:20:34,  3.21it/s]
 18%|█▊        | 67529/371472 [5:22:16<25:47:38,  3.27it/s]
 18%|█▊        | 67530/371472 [5:22:16<24:21:20,  3.47it/s]
 18%|█▊        | 67531/371472 [5:22:16<24:04:56,  3.51it/s]
 18%|█▊        | 67532/371472 [5:22:17<22:40:25,  3.72it/s]
 18%|█▊        | 67533/371472 [5:22:17<22:51:19,  3.69it/s]
 18%|█▊        | 67534/371472 [5:22:17<22:10:17,  3.81it/s]
 18%|█▊        | 67535/371472 [5:22:17<21:46:48,  3.88it/s]
 18%|█▊        | 67536/371472 [5:22:18<21:49:18,  3.87it/s]
 18%|█▊        | 67537/371472 [5:22:18<22:54:18,  3.69it/s]
 18%|█▊        | 67538/371472 [5:22:18<22:27:35,  3.76it/s]
 18%|█▊        | 67539/371472 [5:22:18<21:52:52,  3.86it/s]
 18%|█▊        | 67540/371472 [5:22:19<21:27:50,  3.93it/s]
                                                           
{'loss': 4.4095, 'learning_rate': 8.367611885625633e-07, 'epoch': 2.91}

 18%|█▊        | 67540/371472 [5:22:19<21:27:50,  3.93it/s]
 18%|█▊        | 67541/371472 [5:22:19<21:47:33,  3.87it/s]
 18%|█▊        | 67542/371472 [5:22:19<22:16:42,  3.79it/s]
 18%|█▊        | 67543/371472 [5:22:19<21:54:05,  3.85it/s]
 18%|█▊        | 67544/371472 [5:22:20<21:16:41,  3.97it/s]
 18%|█▊        | 67545/371472 [5:22:20<21:16:13,  3.97it/s]
 18%|█▊        | 67546/371472 [5:22:20<21:37:30,  3.90it/s]
 18%|█▊        | 67547/371472 [5:22:21<23:01:25,  3.67it/s]
 18%|█▊        | 67548/371472 [5:22:21<24:31:59,  3.44it/s]
 18%|█▊        | 67549/371472 [5:22:21<24:56:22,  3.39it/s]
 18%|█▊        | 67550/371472 [5:22:21<24:02:26,  3.51it/s]
 18%|█▊        | 67551/371472 [5:22:22<23:25:57,  3.60it/s]
 18%|█▊        | 67552/371472 [5:22:22<23:01:24,  3.67it/s]
 18%|█▊        | 67553/371472 [5:22:22<22:47:22,  3.70it/s]
 18%|█▊        | 67554/371472 [5:22:23<23:01:20,  3.67it/s]
 18%|█▊        | 67555/371472 [5:22:23<22:46:38,  3.71it/s]
 18%|█▊        | 67556/371472 [5:22:23<24:09:49,  3.49it/s]
 18%|█▊        | 67557/371472 [5:22:23<26:22:20,  3.20it/s]
 18%|█▊        | 67558/371472 [5:22:24<24:50:13,  3.40it/s]
 18%|█▊        | 67559/371472 [5:22:24<24:32:07,  3.44it/s]
 18%|█▊        | 67560/371472 [5:22:24<22:58:28,  3.67it/s]
                                                           
{'loss': 4.2958, 'learning_rate': 8.367127065870845e-07, 'epoch': 2.91}

 18%|█▊        | 67560/371472 [5:22:24<22:58:28,  3.67it/s]
 18%|█▊        | 67561/371472 [5:22:25<23:12:29,  3.64it/s]
 18%|█▊        | 67562/371472 [5:22:25<22:53:04,  3.69it/s]
 18%|█▊        | 67563/371472 [5:22:25<22:25:53,  3.76it/s]
 18%|█▊        | 67564/371472 [5:22:25<23:51:35,  3.54it/s]
 18%|█▊        | 67565/371472 [5:22:26<26:19:24,  3.21it/s]
 18%|█▊        | 67566/371472 [5:22:26<25:06:11,  3.36it/s]
 18%|█▊        | 67567/371472 [5:22:26<26:39:41,  3.17it/s]
 18%|█▊        | 67568/371472 [5:22:27<24:47:03,  3.41it/s]
 18%|█▊        | 67569/371472 [5:22:27<24:36:57,  3.43it/s]
 18%|█▊        | 67570/371472 [5:22:27<24:16:25,  3.48it/s]
 18%|█▊        | 67571/371472 [5:22:27<24:23:09,  3.46it/s]
 18%|█▊        | 67572/371472 [5:22:28<22:50:49,  3.69it/s]
 18%|█▊        | 67573/371472 [5:22:28<23:10:59,  3.64it/s]
 18%|█▊        | 67574/371472 [5:22:28<23:09:19,  3.65it/s]
 18%|█▊        | 67575/371472 [5:22:28<22:11:36,  3.80it/s]
 18%|█▊        | 67576/371472 [5:22:29<22:49:03,  3.70it/s]
 18%|█▊        | 67577/371472 [5:22:29<24:45:09,  3.41it/s]
 18%|█▊        | 67578/371472 [5:22:29<24:01:11,  3.51it/s]
 18%|█▊        | 67579/371472 [5:22:30<23:22:59,  3.61it/s]
 18%|█▊        | 67580/371472 [5:22:30<23:41:22,  3.56it/s]
                                                           
{'loss': 4.249, 'learning_rate': 8.366642246116054e-07, 'epoch': 2.91}

 18%|█▊        | 67580/371472 [5:22:30<23:41:22,  3.56it/s]
 18%|█▊        | 67581/371472 [5:22:30<24:27:42,  3.45it/s]
 18%|█▊        | 67582/371472 [5:22:31<25:18:57,  3.33it/s]
 18%|█▊        | 67583/371472 [5:22:31<27:15:18,  3.10it/s]
 18%|█▊        | 67584/371472 [5:22:31<25:48:19,  3.27it/s]
 18%|█▊        | 67585/371472 [5:22:31<24:50:09,  3.40it/s]
 18%|█▊        | 67586/371472 [5:22:32<24:08:30,  3.50it/s]
 18%|█▊        | 67587/371472 [5:22:32<23:38:15,  3.57it/s]
 18%|█▊        | 67588/371472 [5:22:32<23:03:43,  3.66it/s]
 18%|█▊        | 67589/371472 [5:22:33<23:10:42,  3.64it/s]
 18%|█▊        | 67590/371472 [5:22:33<22:58:59,  3.67it/s]
 18%|█▊        | 67591/371472 [5:22:33<22:53:58,  3.69it/s]
 18%|█▊        | 67592/371472 [5:22:33<22:52:48,  3.69it/s]
 18%|█▊        | 67593/371472 [5:22:34<24:21:05,  3.47it/s]
 18%|█▊        | 67594/371472 [5:22:34<25:37:32,  3.29it/s]
 18%|█▊        | 67595/371472 [5:22:34<26:02:31,  3.24it/s]
 18%|█▊        | 67596/371472 [5:22:35<24:16:28,  3.48it/s]
 18%|█▊        | 67597/371472 [5:22:35<24:30:12,  3.44it/s]
 18%|█▊        | 67598/371472 [5:22:35<23:41:56,  3.56it/s]
 18%|█▊        | 67599/371472 [5:22:35<23:46:17,  3.55it/s]
 18%|█▊        | 67600/371472 [5:22:36<23:21:58,  3.61it/s]
                                                           
{'loss': 4.1099, 'learning_rate': 8.366157426361265e-07, 'epoch': 2.91}

 18%|█▊        | 67600/371472 [5:22:36<23:21:58,  3.61it/s]
 18%|█▊        | 67601/371472 [5:22:36<23:52:43,  3.53it/s]
 18%|█▊        | 67602/371472 [5:22:36<23:36:29,  3.58it/s]
 18%|█▊        | 67603/371472 [5:22:37<23:44:09,  3.56it/s]
 18%|█▊        | 67604/371472 [5:22:37<23:58:30,  3.52it/s]
 18%|█▊        | 67605/371472 [5:22:37<23:13:56,  3.63it/s]
 18%|█▊        | 67606/371472 [5:22:37<22:49:49,  3.70it/s]
 18%|█▊        | 67607/371472 [5:22:38<22:58:04,  3.68it/s]
 18%|█▊        | 67608/371472 [5:22:38<22:52:02,  3.69it/s]
 18%|█▊        | 67609/371472 [5:22:38<22:52:46,  3.69it/s]
 18%|█▊        | 67610/371472 [5:22:38<23:12:14,  3.64it/s]
 18%|█▊        | 67611/371472 [5:22:39<22:21:04,  3.78it/s]
 18%|█▊        | 67612/371472 [5:22:39<22:59:21,  3.67it/s]
 18%|█▊        | 67613/371472 [5:22:39<22:35:13,  3.74it/s]
 18%|█▊        | 67614/371472 [5:22:39<22:18:32,  3.78it/s]
 18%|█▊        | 67615/371472 [5:22:40<22:41:18,  3.72it/s]
 18%|█▊        | 67616/371472 [5:22:40<23:44:11,  3.56it/s]
 18%|█▊        | 67617/371472 [5:22:40<24:04:13,  3.51it/s]
 18%|█▊        | 67618/371472 [5:22:41<23:38:13,  3.57it/s]
 18%|█▊        | 67619/371472 [5:22:41<22:42:32,  3.72it/s]
 18%|█▊        | 67620/371472 [5:22:41<22:39:31,  3.72it/s]
                                                           
{'loss': 4.3728, 'learning_rate': 8.365672606606477e-07, 'epoch': 2.91}

 18%|█▊        | 67620/371472 [5:22:41<22:39:31,  3.72it/s]
 18%|█▊        | 67621/371472 [5:22:41<22:20:48,  3.78it/s]
 18%|█▊        | 67622/371472 [5:22:42<25:03:24,  3.37it/s]
 18%|█▊        | 67623/371472 [5:22:42<24:45:28,  3.41it/s]
 18%|█▊        | 67624/371472 [5:22:42<24:09:32,  3.49it/s]
 18%|█▊        | 67625/371472 [5:22:43<24:12:29,  3.49it/s]
 18%|█▊        | 67626/371472 [5:22:43<25:13:16,  3.35it/s]
 18%|█▊        | 67627/371472 [5:22:43<23:43:46,  3.56it/s]
 18%|█▊        | 67628/371472 [5:22:43<23:52:02,  3.54it/s]
 18%|█▊        | 67629/371472 [5:22:44<23:37:44,  3.57it/s]
 18%|█▊        | 67630/371472 [5:22:44<24:33:16,  3.44it/s]
 18%|█▊        | 67631/371472 [5:22:44<26:49:10,  3.15it/s]
 18%|█▊        | 67632/371472 [5:22:45<27:43:16,  3.04it/s]
 18%|█▊        | 67633/371472 [5:22:45<26:56:39,  3.13it/s]
 18%|█▊        | 67634/371472 [5:22:45<26:35:59,  3.17it/s]
 18%|█▊        | 67635/371472 [5:22:46<25:51:43,  3.26it/s]
 18%|█▊        | 67636/371472 [5:22:46<25:00:36,  3.37it/s]
 18%|█▊        | 67637/371472 [5:22:46<28:33:14,  2.96it/s]
 18%|█▊        | 67638/371472 [5:22:47<26:45:34,  3.15it/s]
 18%|█▊        | 67639/371472 [5:22:47<26:04:33,  3.24it/s]
 18%|█▊        | 67640/371472 [5:22:47<25:45:09,  3.28it/s]
                                                           
{'loss': 4.1975, 'learning_rate': 8.365187786851689e-07, 'epoch': 2.91}

 18%|█▊        | 67640/371472 [5:22:47<25:45:09,  3.28it/s]
 18%|█▊        | 67641/371472 [5:22:48<26:07:50,  3.23it/s]
 18%|█▊        | 67642/371472 [5:22:48<27:02:02,  3.12it/s]
 18%|█▊        | 67643/371472 [5:22:48<26:44:07,  3.16it/s]
 18%|█▊        | 67644/371472 [5:22:48<24:58:29,  3.38it/s]
 18%|█▊        | 67645/371472 [5:22:49<25:15:09,  3.34it/s]
 18%|█▊        | 67646/371472 [5:22:49<24:20:28,  3.47it/s]
 18%|█▊        | 67647/371472 [5:22:49<23:54:09,  3.53it/s]
 18%|█▊        | 67648/371472 [5:22:50<22:55:57,  3.68it/s]
 18%|█▊        | 67649/371472 [5:22:50<22:57:22,  3.68it/s]
 18%|█▊        | 67650/371472 [5:22:50<23:09:56,  3.64it/s]
 18%|█▊        | 67651/371472 [5:22:50<24:21:31,  3.46it/s]
 18%|█▊        | 67652/371472 [5:22:51<23:07:03,  3.65it/s]
 18%|█▊        | 67653/371472 [5:22:51<23:30:30,  3.59it/s]
 18%|█▊        | 67654/371472 [5:22:51<23:53:04,  3.53it/s]
 18%|█▊        | 67655/371472 [5:22:52<25:20:03,  3.33it/s]
 18%|█▊        | 67656/371472 [5:22:52<24:18:33,  3.47it/s]
 18%|█▊        | 67657/371472 [5:22:52<24:23:41,  3.46it/s]
 18%|█▊        | 67658/371472 [5:22:52<23:33:01,  3.58it/s]
 18%|█▊        | 67659/371472 [5:22:53<22:20:10,  3.78it/s]
 18%|█▊        | 67660/371472 [5:22:53<22:36:56,  3.73it/s]
                                                           
{'loss': 4.329, 'learning_rate': 8.364702967096899e-07, 'epoch': 2.91}

 18%|█▊        | 67660/371472 [5:22:53<22:36:56,  3.73it/s]
 18%|█▊        | 67661/371472 [5:22:53<24:26:34,  3.45it/s]
 18%|█▊        | 67662/371472 [5:22:53<23:12:56,  3.64it/s]
 18%|█▊        | 67663/371472 [5:22:54<23:02:18,  3.66it/s]
 18%|█▊        | 67664/371472 [5:22:54<22:07:53,  3.81it/s]
 18%|█▊        | 67665/371472 [5:22:54<23:04:29,  3.66it/s]
 18%|█▊        | 67666/371472 [5:22:55<23:21:14,  3.61it/s]
 18%|█▊        | 67667/371472 [5:22:55<22:49:56,  3.70it/s]
 18%|█▊        | 67668/371472 [5:22:55<23:28:30,  3.59it/s]
 18%|█▊        | 67669/371472 [5:22:55<24:02:34,  3.51it/s]
 18%|█▊        | 67670/371472 [5:22:56<23:24:20,  3.61it/s]
 18%|█▊        | 67671/371472 [5:22:56<22:15:27,  3.79it/s]
 18%|█▊        | 67672/371472 [5:22:56<26:04:04,  3.24it/s]
 18%|█▊        | 67673/371472 [5:22:57<24:55:18,  3.39it/s]
 18%|█▊        | 67674/371472 [5:22:57<25:35:08,  3.30it/s]
 18%|█▊        | 67675/371472 [5:22:57<25:22:15,  3.33it/s]
 18%|█▊        | 67676/371472 [5:22:58<25:41:49,  3.28it/s]
 18%|█▊        | 67677/371472 [5:22:58<24:27:09,  3.45it/s]
 18%|█▊        | 67678/371472 [5:22:58<24:40:44,  3.42it/s]
 18%|█▊        | 67679/371472 [5:22:58<24:19:35,  3.47it/s]
 18%|█▊        | 67680/371472 [5:22:59<23:46:06,  3.55it/s]
                                                           
{'loss': 4.2475, 'learning_rate': 8.36421814734211e-07, 'epoch': 2.92}

 18%|█▊        | 67680/371472 [5:22:59<23:46:06,  3.55it/s]
 18%|█▊        | 67681/371472 [5:22:59<23:26:41,  3.60it/s]
 18%|█▊        | 67682/371472 [5:22:59<22:47:34,  3.70it/s]
 18%|█▊        | 67683/371472 [5:22:59<22:55:27,  3.68it/s]
 18%|█▊        | 67684/371472 [5:23:00<24:38:43,  3.42it/s]
 18%|█▊        | 67685/371472 [5:23:00<24:29:44,  3.44it/s]
 18%|█▊        | 67686/371472 [5:23:00<24:22:10,  3.46it/s]
 18%|█▊        | 67687/371472 [5:23:01<23:35:24,  3.58it/s]
 18%|█▊        | 67688/371472 [5:23:01<23:41:45,  3.56it/s]
 18%|█▊        | 67689/371472 [5:23:01<24:07:59,  3.50it/s]
 18%|█▊        | 67690/371472 [5:23:01<22:45:55,  3.71it/s]
 18%|█▊        | 67691/371472 [5:23:02<24:06:53,  3.50it/s]
 18%|█▊        | 67692/371472 [5:23:02<24:17:03,  3.47it/s]
 18%|█▊        | 67693/371472 [5:23:02<23:08:12,  3.65it/s]
 18%|█▊        | 67694/371472 [5:23:03<24:56:47,  3.38it/s]
 18%|█▊        | 67695/371472 [5:23:03<25:02:26,  3.37it/s]
 18%|█▊        | 67696/371472 [5:23:03<25:07:37,  3.36it/s]
 18%|█▊        | 67697/371472 [5:23:03<23:52:20,  3.53it/s]
 18%|█▊        | 67698/371472 [5:23:04<23:53:26,  3.53it/s]
 18%|█▊        | 67699/371472 [5:23:04<23:16:32,  3.63it/s]
 18%|█▊        | 67700/371472 [5:23:04<23:13:05,  3.63it/s]
                                                           
{'loss': 4.1461, 'learning_rate': 8.363733327587321e-07, 'epoch': 2.92}

 18%|█▊        | 67700/371472 [5:23:04<23:13:05,  3.63it/s]
 18%|█▊        | 67701/371472 [5:23:05<22:40:43,  3.72it/s]
 18%|█▊        | 67702/371472 [5:23:05<22:23:36,  3.77it/s]
 18%|█▊        | 67703/371472 [5:23:05<22:21:49,  3.77it/s]
 18%|█▊        | 67704/371472 [5:23:05<21:41:10,  3.89it/s]
 18%|█▊        | 67705/371472 [5:23:06<24:10:22,  3.49it/s]
 18%|█▊        | 67706/371472 [5:23:06<23:24:53,  3.60it/s]
 18%|█▊        | 67707/371472 [5:23:06<25:06:26,  3.36it/s]
 18%|█▊        | 67708/371472 [5:23:07<24:29:14,  3.45it/s]
 18%|█▊        | 67709/371472 [5:23:07<26:07:30,  3.23it/s]
 18%|█▊        | 67710/371472 [5:23:07<25:10:34,  3.35it/s]
 18%|█▊        | 67711/371472 [5:23:07<25:22:24,  3.33it/s]
 18%|█▊        | 67712/371472 [5:23:08<24:11:43,  3.49it/s]
 18%|█▊        | 67713/371472 [5:23:08<23:59:17,  3.52it/s]
 18%|█▊        | 67714/371472 [5:23:08<24:41:20,  3.42it/s]
 18%|█▊        | 67715/371472 [5:23:09<23:48:17,  3.54it/s]
 18%|█▊        | 67716/371472 [5:23:09<23:25:07,  3.60it/s]
 18%|█▊        | 67717/371472 [5:23:09<24:44:22,  3.41it/s]
 18%|█▊        | 67718/371472 [5:23:09<23:46:04,  3.55it/s]
 18%|█▊        | 67719/371472 [5:23:10<22:29:19,  3.75it/s]
 18%|█▊        | 67720/371472 [5:23:10<22:54:45,  3.68it/s]
                                                           
{'loss': 4.0494, 'learning_rate': 8.363248507832531e-07, 'epoch': 2.92}

 18%|█▊        | 67720/371472 [5:23:10<22:54:45,  3.68it/s]
 18%|█▊        | 67721/371472 [5:23:10<22:25:33,  3.76it/s]
 18%|█▊        | 67722/371472 [5:23:10<22:19:10,  3.78it/s]
 18%|█▊        | 67723/371472 [5:23:11<22:58:03,  3.67it/s]
 18%|█▊        | 67724/371472 [5:23:11<23:47:40,  3.55it/s]
 18%|█▊        | 67725/371472 [5:23:11<24:00:53,  3.51it/s]
 18%|█▊        | 67726/371472 [5:23:12<23:28:37,  3.59it/s]
 18%|█▊        | 67727/371472 [5:23:12<24:06:57,  3.50it/s]
 18%|█▊        | 67728/371472 [5:23:12<24:21:11,  3.46it/s]
 18%|█▊        | 67729/371472 [5:23:12<23:12:40,  3.64it/s]
 18%|█▊        | 67730/371472 [5:23:13<22:24:32,  3.77it/s]
 18%|█▊        | 67731/371472 [5:23:13<22:21:12,  3.77it/s]
 18%|█▊        | 67732/371472 [5:23:13<24:15:00,  3.48it/s]
 18%|█▊        | 67733/371472 [5:23:14<23:20:32,  3.61it/s]
 18%|█▊        | 67734/371472 [5:23:14<25:14:21,  3.34it/s]
 18%|█▊        | 67735/371472 [5:23:14<24:24:51,  3.46it/s]
 18%|█▊        | 67736/371472 [5:23:14<23:01:47,  3.66it/s]
 18%|█▊        | 67737/371472 [5:23:15<23:18:24,  3.62it/s]
 18%|█▊        | 67738/371472 [5:23:15<23:23:22,  3.61it/s]
 18%|█▊        | 67739/371472 [5:23:15<23:56:49,  3.52it/s]
 18%|█▊        | 67740/371472 [5:23:15<23:14:29,  3.63it/s]
                                                           
{'loss': 4.1619, 'learning_rate': 8.362763688077743e-07, 'epoch': 2.92}

 18%|█▊        | 67740/371472 [5:23:15<23:14:29,  3.63it/s]
 18%|█▊        | 67741/371472 [5:23:16<23:23:13,  3.61it/s]
 18%|█▊        | 67742/371472 [5:23:16<23:22:56,  3.61it/s]
 18%|█▊        | 67743/371472 [5:23:16<25:09:00,  3.35it/s]
 18%|█▊        | 67744/371472 [5:23:17<24:48:26,  3.40it/s]
 18%|█▊        | 67745/371472 [5:23:17<23:52:23,  3.53it/s]
 18%|█▊        | 67746/371472 [5:23:17<27:44:57,  3.04it/s]
 18%|█▊        | 67747/371472 [5:23:18<25:58:18,  3.25it/s]
 18%|█▊        | 67748/371472 [5:23:18<24:43:35,  3.41it/s]
 18%|█▊        | 67749/371472 [5:23:18<24:33:43,  3.43it/s]
 18%|█▊        | 67750/371472 [5:23:19<25:59:33,  3.25it/s]
 18%|█▊        | 67751/371472 [5:23:19<24:55:45,  3.38it/s]
 18%|█▊        | 67752/371472 [5:23:19<23:46:58,  3.55it/s]
 18%|█▊        | 67753/371472 [5:23:19<23:20:43,  3.61it/s]
 18%|█▊        | 67754/371472 [5:23:20<23:18:38,  3.62it/s]
 18%|█▊        | 67755/371472 [5:23:20<23:05:54,  3.65it/s]
 18%|█▊        | 67756/371472 [5:23:20<24:17:22,  3.47it/s]
 18%|█▊        | 67757/371472 [5:23:20<24:24:36,  3.46it/s]
 18%|█▊        | 67758/371472 [5:23:21<24:54:49,  3.39it/s]
 18%|█▊        | 67759/371472 [5:23:21<25:22:09,  3.33it/s]
 18%|█▊        | 67760/371472 [5:23:21<24:14:36,  3.48it/s]
                                                           
{'loss': 4.1775, 'learning_rate': 8.362278868322954e-07, 'epoch': 2.92}

 18%|█▊        | 67760/371472 [5:23:21<24:14:36,  3.48it/s]
 18%|█▊        | 67761/371472 [5:23:22<25:01:39,  3.37it/s]
 18%|█▊        | 67762/371472 [5:23:22<23:52:45,  3.53it/s]
 18%|█▊        | 67763/371472 [5:23:22<22:51:55,  3.69it/s]
 18%|█▊        | 67764/371472 [5:23:22<23:26:23,  3.60it/s]
 18%|█▊        | 67765/371472 [5:23:23<24:11:33,  3.49it/s]
 18%|█▊        | 67766/371472 [5:23:23<24:00:06,  3.51it/s]
 18%|█▊        | 67767/371472 [5:23:23<23:44:04,  3.55it/s]
 18%|█▊        | 67768/371472 [5:23:24<23:39:55,  3.56it/s]
 18%|█▊        | 67769/371472 [5:23:24<22:33:50,  3.74it/s]
 18%|█▊        | 67770/371472 [5:23:24<22:27:39,  3.76it/s]
 18%|█▊        | 67771/371472 [5:23:24<21:37:34,  3.90it/s]
 18%|█▊        | 67772/371472 [5:23:25<22:19:13,  3.78it/s]
 18%|█▊        | 67773/371472 [5:23:25<22:03:19,  3.82it/s]
 18%|█▊        | 67774/371472 [5:23:25<22:06:52,  3.81it/s]
 18%|█▊        | 67775/371472 [5:23:25<24:11:19,  3.49it/s]
 18%|█▊        | 67776/371472 [5:23:26<24:15:14,  3.48it/s]
 18%|█▊        | 67777/371472 [5:23:26<23:32:26,  3.58it/s]
 18%|█▊        | 67778/371472 [5:23:26<23:32:54,  3.58it/s]
 18%|█▊        | 67779/371472 [5:23:27<22:43:49,  3.71it/s]
 18%|█▊        | 67780/371472 [5:23:27<25:02:33,  3.37it/s]
                                                           
{'loss': 4.0533, 'learning_rate': 8.361794048568166e-07, 'epoch': 2.92}

 18%|█▊        | 67780/371472 [5:23:27<25:02:33,  3.37it/s]
 18%|█▊        | 67781/371472 [5:23:27<25:31:59,  3.30it/s]
 18%|█▊        | 67782/371472 [5:23:27<24:58:49,  3.38it/s]
 18%|█▊        | 67783/371472 [5:23:28<23:33:17,  3.58it/s]
 18%|█▊        | 67784/371472 [5:23:28<25:01:57,  3.37it/s]
 18%|█▊        | 67785/371472 [5:23:28<25:27:16,  3.31it/s]
 18%|█▊        | 67786/371472 [5:23:29<24:40:22,  3.42it/s]
 18%|█▊        | 67787/371472 [5:23:29<24:35:16,  3.43it/s]
 18%|█▊        | 67788/371472 [5:23:29<24:10:43,  3.49it/s]
 18%|█▊        | 67789/371472 [5:23:30<23:58:21,  3.52it/s]
 18%|█▊        | 67790/371472 [5:23:30<22:44:00,  3.71it/s]
 18%|█▊        | 67791/371472 [5:23:30<23:40:49,  3.56it/s]
 18%|█▊        | 67792/371472 [5:23:30<22:37:08,  3.73it/s]
 18%|█▊        | 67793/371472 [5:23:31<22:57:27,  3.67it/s]
 18%|█▊        | 67794/371472 [5:23:31<22:26:15,  3.76it/s]
 18%|█▊        | 67795/371472 [5:23:31<21:43:42,  3.88it/s]
 18%|█▊        | 67796/371472 [5:23:31<21:46:32,  3.87it/s]
 18%|█▊        | 67797/371472 [5:23:32<24:18:39,  3.47it/s]
 18%|█▊        | 67798/371472 [5:23:32<25:06:05,  3.36it/s]
 18%|█▊        | 67799/371472 [5:23:32<25:30:09,  3.31it/s]
 18%|█▊        | 67800/371472 [5:23:33<24:05:01,  3.50it/s]
                                                           
{'loss': 4.1892, 'learning_rate': 8.361309228813376e-07, 'epoch': 2.92}

 18%|█▊        | 67800/371472 [5:23:33<24:05:01,  3.50it/s]
 18%|█▊        | 67801/371472 [5:23:33<23:59:25,  3.52it/s]
 18%|█▊        | 67802/371472 [5:23:33<23:36:22,  3.57it/s]
 18%|█▊        | 67803/371472 [5:23:33<22:44:20,  3.71it/s]
 18%|█▊        | 67804/371472 [5:23:34<23:08:11,  3.65it/s]
 18%|█▊        | 67805/371472 [5:23:34<22:37:32,  3.73it/s]
 18%|█▊        | 67806/371472 [5:23:34<22:32:04,  3.74it/s]
 18%|█▊        | 67807/371472 [5:23:34<23:58:26,  3.52it/s]
 18%|█▊        | 67808/371472 [5:23:35<23:24:42,  3.60it/s]
 18%|█▊        | 67809/371472 [5:23:35<22:33:39,  3.74it/s]
 18%|█▊        | 67810/371472 [5:23:35<22:14:03,  3.79it/s]
 18%|█▊        | 67811/371472 [5:23:36<22:31:44,  3.74it/s]
 18%|█▊        | 67812/371472 [5:23:36<22:25:36,  3.76it/s]
 18%|█▊        | 67813/371472 [5:23:36<25:27:18,  3.31it/s]
 18%|█▊        | 67814/371472 [5:23:36<24:36:26,  3.43it/s]
 18%|█▊        | 67815/371472 [5:23:37<23:32:25,  3.58it/s]
 18%|█▊        | 67816/371472 [5:23:37<23:13:47,  3.63it/s]
 18%|█▊        | 67817/371472 [5:23:37<22:38:41,  3.72it/s]
 18%|█▊        | 67818/371472 [5:23:37<23:07:16,  3.65it/s]
 18%|█▊        | 67819/371472 [5:23:38<23:57:28,  3.52it/s]
 18%|█▊        | 67820/371472 [5:23:38<23:49:55,  3.54it/s]
                                                           
{'loss': 4.1913, 'learning_rate': 8.360824409058587e-07, 'epoch': 2.92}

 18%|█▊        | 67820/371472 [5:23:38<23:49:55,  3.54it/s]
 18%|█▊        | 67821/371472 [5:23:38<23:23:24,  3.61it/s]
 18%|█▊        | 67822/371472 [5:23:39<23:32:22,  3.58it/s]
 18%|█▊        | 67823/371472 [5:23:39<22:44:23,  3.71it/s]
 18%|█▊        | 67824/371472 [5:23:39<23:46:24,  3.55it/s]
 18%|█▊        | 67825/371472 [5:23:39<23:24:33,  3.60it/s]
 18%|█▊        | 67826/371472 [5:23:40<24:44:24,  3.41it/s]
 18%|█▊        | 67827/371472 [5:23:40<24:17:02,  3.47it/s]
 18%|█▊        | 67828/371472 [5:23:40<24:57:54,  3.38it/s]
 18%|█▊        | 67829/371472 [5:23:41<24:25:11,  3.45it/s]
 18%|█▊        | 67830/371472 [5:23:41<24:20:24,  3.47it/s]
 18%|█▊        | 67831/371472 [5:23:41<26:23:21,  3.20it/s]
 18%|█▊        | 67832/371472 [5:23:42<27:07:48,  3.11it/s]
 18%|█▊        | 67833/371472 [5:23:42<25:38:24,  3.29it/s]
 18%|█▊        | 67834/371472 [5:23:42<24:59:24,  3.38it/s]
 18%|█▊        | 67835/371472 [5:23:43<26:18:36,  3.21it/s]
 18%|█▊        | 67836/371472 [5:23:43<27:25:56,  3.07it/s]
 18%|█▊        | 67837/371472 [5:23:43<27:42:05,  3.04it/s]
 18%|█▊        | 67838/371472 [5:23:43<26:22:08,  3.20it/s]
 18%|█▊        | 67839/371472 [5:23:44<25:36:39,  3.29it/s]
 18%|█▊        | 67840/371472 [5:23:44<25:33:54,  3.30it/s]
                                                           
{'loss': 4.0711, 'learning_rate': 8.360339589303798e-07, 'epoch': 2.92}

 18%|█▊        | 67840/371472 [5:23:44<25:33:54,  3.30it/s]
 18%|█▊        | 67841/371472 [5:23:44<24:32:46,  3.44it/s]
 18%|█▊        | 67842/371472 [5:23:45<23:42:37,  3.56it/s]
 18%|█▊        | 67843/371472 [5:23:45<23:22:09,  3.61it/s]
 18%|█▊        | 67844/371472 [5:23:45<22:53:10,  3.69it/s]
 18%|█▊        | 67845/371472 [5:23:45<23:07:57,  3.65it/s]
 18%|█▊        | 67846/371472 [5:23:46<23:55:47,  3.52it/s]
 18%|█▊        | 67847/371472 [5:23:46<25:19:11,  3.33it/s]
 18%|█▊        | 67848/371472 [5:23:46<24:01:18,  3.51it/s]
 18%|█▊        | 67849/371472 [5:23:47<23:16:19,  3.62it/s]
 18%|█▊        | 67850/371472 [5:23:47<22:45:08,  3.71it/s]
 18%|█▊        | 67851/371472 [5:23:47<23:31:20,  3.59it/s]
 18%|█▊        | 67852/371472 [5:23:47<22:40:42,  3.72it/s]
 18%|█▊        | 67853/371472 [5:23:48<23:17:27,  3.62it/s]
 18%|█▊        | 67854/371472 [5:23:48<23:18:07,  3.62it/s]
 18%|█▊        | 67855/371472 [5:23:48<24:38:08,  3.42it/s]
 18%|█▊        | 67856/371472 [5:23:49<24:49:28,  3.40it/s]
 18%|█▊        | 67857/371472 [5:23:49<24:19:04,  3.47it/s]
 18%|█▊        | 67858/371472 [5:23:49<23:13:42,  3.63it/s]
 18%|█▊        | 67859/371472 [5:23:49<22:48:43,  3.70it/s]
 18%|█▊        | 67860/371472 [5:23:50<26:38:01,  3.17it/s]
                                                           
{'loss': 4.2778, 'learning_rate': 8.35985476954901e-07, 'epoch': 2.92}

 18%|█▊        | 67860/371472 [5:23:50<26:38:01,  3.17it/s]
 18%|█▊        | 67861/371472 [5:23:50<26:03:29,  3.24it/s]
 18%|█▊        | 67862/371472 [5:23:50<24:28:54,  3.44it/s]
 18%|█▊        | 67863/371472 [5:23:51<24:07:51,  3.49it/s]
 18%|█▊        | 67864/371472 [5:23:51<24:05:42,  3.50it/s]
 18%|█▊        | 67865/371472 [5:23:51<24:31:36,  3.44it/s]
 18%|█▊        | 67866/371472 [5:23:51<24:34:41,  3.43it/s]
 18%|█▊        | 67867/371472 [5:23:52<24:02:58,  3.51it/s]
 18%|█▊        | 67868/371472 [5:23:52<24:41:56,  3.41it/s]
 18%|█▊        | 67869/371472 [5:23:52<24:18:59,  3.47it/s]
 18%|█▊        | 67870/371472 [5:23:53<23:20:21,  3.61it/s]
 18%|█▊        | 67871/371472 [5:23:53<22:13:27,  3.79it/s]
 18%|█▊        | 67872/371472 [5:23:53<22:36:10,  3.73it/s]
 18%|█▊        | 67873/371472 [5:23:53<21:53:34,  3.85it/s]
 18%|█▊        | 67874/371472 [5:23:54<22:08:17,  3.81it/s]
 18%|█▊        | 67875/371472 [5:23:54<22:01:09,  3.83it/s]
 18%|█▊        | 67876/371472 [5:23:54<22:22:16,  3.77it/s]
 18%|█▊        | 67877/371472 [5:23:54<23:15:14,  3.63it/s]
 18%|█▊        | 67878/371472 [5:23:55<23:28:01,  3.59it/s]
 18%|█▊        | 67879/371472 [5:23:55<23:56:42,  3.52it/s]
 18%|█▊        | 67880/371472 [5:23:55<23:19:36,  3.62it/s]
                                                           
{'loss': 4.3031, 'learning_rate': 8.35936994979422e-07, 'epoch': 2.92}

 18%|█▊        | 67880/371472 [5:23:55<23:19:36,  3.62it/s]
 18%|█▊        | 67881/371472 [5:23:56<23:15:24,  3.63it/s]
 18%|█▊        | 67882/371472 [5:23:56<23:11:54,  3.64it/s]
 18%|█▊        | 67883/371472 [5:23:56<22:55:20,  3.68it/s]
 18%|█▊        | 67884/371472 [5:23:56<23:24:19,  3.60it/s]
 18%|█▊        | 67885/371472 [5:23:57<24:11:26,  3.49it/s]
 18%|█▊        | 67886/371472 [5:23:57<24:24:37,  3.45it/s]
 18%|█▊        | 67887/371472 [5:23:57<23:45:37,  3.55it/s]
 18%|█▊        | 67888/371472 [5:23:58<24:42:54,  3.41it/s]
 18%|█▊        | 67889/371472 [5:23:58<24:34:48,  3.43it/s]
 18%|█▊        | 67890/371472 [5:23:58<23:59:49,  3.51it/s]
 18%|█▊        | 67891/371472 [5:23:58<23:55:22,  3.52it/s]
 18%|█▊        | 67892/371472 [5:23:59<24:16:59,  3.47it/s]
 18%|█▊        | 67893/371472 [5:23:59<25:23:58,  3.32it/s]
 18%|█▊        | 67894/371472 [5:23:59<24:00:15,  3.51it/s]
 18%|█▊        | 67895/371472 [5:24:00<24:15:42,  3.48it/s]
 18%|█▊        | 67896/371472 [5:24:00<24:22:53,  3.46it/s]
 18%|█▊        | 67897/371472 [5:24:00<24:07:50,  3.49it/s]
 18%|█▊        | 67898/371472 [5:24:00<24:49:44,  3.40it/s]
 18%|█▊        | 67899/371472 [5:24:01<24:14:57,  3.48it/s]
 18%|█▊        | 67900/371472 [5:24:01<23:27:47,  3.59it/s]
                                                           
{'loss': 4.032, 'learning_rate': 8.358885130039432e-07, 'epoch': 2.92}

 18%|█▊        | 67900/371472 [5:24:01<23:27:47,  3.59it/s]
 18%|█▊        | 67901/371472 [5:24:01<23:33:20,  3.58it/s]
 18%|█▊        | 67902/371472 [5:24:02<23:18:53,  3.62it/s]
 18%|█▊        | 67903/371472 [5:24:02<23:36:50,  3.57it/s]
 18%|█▊        | 67904/371472 [5:24:02<23:40:50,  3.56it/s]
 18%|█▊        | 67905/371472 [5:24:02<22:42:47,  3.71it/s]
 18%|█▊        | 67906/371472 [5:24:03<23:10:00,  3.64it/s]
 18%|█▊        | 67907/371472 [5:24:03<25:03:30,  3.37it/s]
 18%|█▊        | 67908/371472 [5:24:03<24:16:30,  3.47it/s]
 18%|█▊        | 67909/371472 [5:24:04<27:11:06,  3.10it/s]
 18%|█▊        | 67910/371472 [5:24:04<25:12:24,  3.35it/s]
 18%|█▊        | 67911/371472 [5:24:04<24:51:40,  3.39it/s]
 18%|█▊        | 67912/371472 [5:24:04<24:13:51,  3.48it/s]
 18%|█▊        | 67913/371472 [5:24:05<23:19:45,  3.61it/s]
 18%|█▊        | 67914/371472 [5:24:05<23:16:53,  3.62it/s]
 18%|█▊        | 67915/371472 [5:24:05<22:40:14,  3.72it/s]
 18%|█▊        | 67916/371472 [5:24:05<22:21:50,  3.77it/s]
 18%|█▊        | 67917/371472 [5:24:06<22:28:37,  3.75it/s]
 18%|█▊        | 67918/371472 [5:24:06<21:57:17,  3.84it/s]
 18%|█▊        | 67919/371472 [5:24:06<22:16:34,  3.79it/s]
 18%|█▊        | 67920/371472 [5:24:07<24:30:05,  3.44it/s]
                                                           
{'loss': 4.1971, 'learning_rate': 8.358400310284643e-07, 'epoch': 2.93}

 18%|█▊        | 67920/371472 [5:24:07<24:30:05,  3.44it/s]
 18%|█▊        | 67921/371472 [5:24:07<25:23:31,  3.32it/s]
 18%|█▊        | 67922/371472 [5:24:07<24:33:54,  3.43it/s]
 18%|█▊        | 67923/371472 [5:24:07<23:36:25,  3.57it/s]
 18%|█▊        | 67924/371472 [5:24:08<23:33:09,  3.58it/s]
 18%|█▊        | 67925/371472 [5:24:08<23:41:57,  3.56it/s]
 18%|█▊        | 67926/371472 [5:24:08<23:37:25,  3.57it/s]
 18%|█▊        | 67927/371472 [5:24:09<23:18:31,  3.62it/s]
 18%|█▊        | 67928/371472 [5:24:09<23:16:03,  3.62it/s]
 18%|█▊        | 67929/371472 [5:24:09<24:28:49,  3.44it/s]
 18%|█▊        | 67930/371472 [5:24:09<25:31:59,  3.30it/s]
 18%|█▊        | 67931/371472 [5:24:10<24:58:10,  3.38it/s]
 18%|█▊        | 67932/371472 [5:24:10<24:09:17,  3.49it/s]
 18%|█▊        | 67933/371472 [5:24:10<24:48:49,  3.40it/s]
 18%|█▊        | 67934/371472 [5:24:11<24:52:00,  3.39it/s]
 18%|█▊        | 67935/371472 [5:24:11<23:58:01,  3.52it/s]
 18%|█▊        | 67936/371472 [5:24:11<25:34:27,  3.30it/s]
 18%|█▊        | 67937/371472 [5:24:12<24:44:38,  3.41it/s]
 18%|█▊        | 67938/371472 [5:24:12<25:05:37,  3.36it/s]
 18%|█▊        | 67939/371472 [5:24:12<25:48:01,  3.27it/s]
 18%|█▊        | 67940/371472 [5:24:12<25:05:17,  3.36it/s]
                                                           
{'loss': 4.133, 'learning_rate': 8.357915490529855e-07, 'epoch': 2.93}

 18%|█▊        | 67940/371472 [5:24:12<25:05:17,  3.36it/s]
 18%|█▊        | 67941/371472 [5:24:13<24:09:26,  3.49it/s]
 18%|█▊        | 67942/371472 [5:24:13<22:59:50,  3.67it/s]
 18%|█▊        | 67943/371472 [5:24:13<24:36:09,  3.43it/s]
 18%|█▊        | 67944/371472 [5:24:14<23:42:49,  3.56it/s]
 18%|█▊        | 67945/371472 [5:24:14<22:44:23,  3.71it/s]
 18%|█▊        | 67946/371472 [5:24:14<23:20:23,  3.61it/s]
 18%|█▊        | 67947/371472 [5:24:14<25:18:10,  3.33it/s]
 18%|█▊        | 67948/371472 [5:24:15<26:24:01,  3.19it/s]
 18%|█▊        | 67949/371472 [5:24:15<25:48:07,  3.27it/s]
 18%|█▊        | 67950/371472 [5:24:15<24:41:52,  3.41it/s]
 18%|█▊        | 67951/371472 [5:24:16<23:48:32,  3.54it/s]
 18%|█▊        | 67952/371472 [5:24:16<22:47:10,  3.70it/s]
 18%|█▊        | 67953/371472 [5:24:16<21:55:50,  3.84it/s]
 18%|█▊        | 67954/371472 [5:24:16<22:37:49,  3.73it/s]
 18%|█▊        | 67955/371472 [5:24:17<22:40:21,  3.72it/s]
 18%|█▊        | 67956/371472 [5:24:17<21:57:45,  3.84it/s]
 18%|█▊        | 67957/371472 [5:24:17<22:33:48,  3.74it/s]
 18%|█▊        | 67958/371472 [5:24:17<22:20:19,  3.77it/s]
 18%|█▊        | 67959/371472 [5:24:18<23:22:56,  3.61it/s]
 18%|█▊        | 67960/371472 [5:24:18<23:17:23,  3.62it/s]
                                                           
{'loss': 4.1434, 'learning_rate': 8.357430670775064e-07, 'epoch': 2.93}

 18%|█▊        | 67960/371472 [5:24:18<23:17:23,  3.62it/s]
 18%|█▊        | 67961/371472 [5:24:18<24:22:24,  3.46it/s]
 18%|█▊        | 67962/371472 [5:24:19<24:30:04,  3.44it/s]
 18%|█▊        | 67963/371472 [5:24:19<23:38:50,  3.57it/s]
 18%|█▊        | 67964/371472 [5:24:19<23:28:15,  3.59it/s]
 18%|█▊        | 67965/371472 [5:24:19<23:05:03,  3.65it/s]
 18%|█▊        | 67966/371472 [5:24:20<22:27:34,  3.75it/s]
 18%|█▊        | 67967/371472 [5:24:20<22:43:53,  3.71it/s]
 18%|█▊        | 67968/371472 [5:24:20<24:36:32,  3.43it/s]
 18%|█▊        | 67969/371472 [5:24:21<24:06:53,  3.50it/s]
 18%|█▊        | 67970/371472 [5:24:21<24:44:24,  3.41it/s]
 18%|█▊        | 67971/371472 [5:24:21<23:51:19,  3.53it/s]
 18%|█▊        | 67972/371472 [5:24:21<24:51:31,  3.39it/s]
 18%|█▊        | 67973/371472 [5:24:22<24:04:05,  3.50it/s]
 18%|█▊        | 67974/371472 [5:24:22<23:57:03,  3.52it/s]
 18%|█▊        | 67975/371472 [5:24:22<24:57:25,  3.38it/s]
 18%|█▊        | 67976/371472 [5:24:23<24:36:58,  3.42it/s]
 18%|█▊        | 67977/371472 [5:24:23<24:18:54,  3.47it/s]
 18%|█▊        | 67978/371472 [5:24:23<24:04:56,  3.50it/s]
 18%|█▊        | 67979/371472 [5:24:23<24:11:04,  3.49it/s]
 18%|█▊        | 67980/371472 [5:24:24<25:29:01,  3.31it/s]
                                                           
{'loss': 4.1361, 'learning_rate': 8.356945851020275e-07, 'epoch': 2.93}

 18%|█▊        | 67980/371472 [5:24:24<25:29:01,  3.31it/s]
 18%|█▊        | 67981/371472 [5:24:24<24:30:20,  3.44it/s]
 18%|█▊        | 67982/371472 [5:24:24<23:22:55,  3.61it/s]
 18%|█▊        | 67983/371472 [5:24:25<23:09:22,  3.64it/s]
 18%|█▊        | 67984/371472 [5:24:25<22:23:06,  3.77it/s]
 18%|█▊        | 67985/371472 [5:24:25<21:48:45,  3.86it/s]
 18%|█▊        | 67986/371472 [5:24:25<23:14:48,  3.63it/s]
 18%|█▊        | 67987/371472 [5:24:26<22:29:11,  3.75it/s]
 18%|█▊        | 67988/371472 [5:24:26<22:53:38,  3.68it/s]
 18%|█▊        | 67989/371472 [5:24:26<25:12:47,  3.34it/s]
 18%|█▊        | 67990/371472 [5:24:27<25:43:30,  3.28it/s]
 18%|█▊        | 67991/371472 [5:24:27<26:18:49,  3.20it/s]
 18%|█▊        | 67992/371472 [5:24:27<24:33:20,  3.43it/s]
 18%|█▊        | 67993/371472 [5:24:27<24:18:43,  3.47it/s]
 18%|█▊        | 67994/371472 [5:24:28<24:31:01,  3.44it/s]
 18%|█▊        | 67995/371472 [5:24:28<24:26:26,  3.45it/s]
 18%|█▊        | 67996/371472 [5:24:28<23:54:45,  3.53it/s]
 18%|█▊        | 67997/371472 [5:24:29<23:33:59,  3.58it/s]
 18%|█▊        | 67998/371472 [5:24:29<23:26:13,  3.60it/s]
 18%|█▊        | 67999/371472 [5:24:29<23:04:05,  3.65it/s]
 18%|█▊        | 68000/371472 [5:24:29<22:59:55,  3.67it/s]
                                                           
{'loss': 4.1048, 'learning_rate': 8.356461031265487e-07, 'epoch': 2.93}

 18%|█▊        | 68000/371472 [5:24:29<22:59:55,  3.67it/s]
 18%|█▊        | 68001/371472 [5:24:30<22:43:35,  3.71it/s]
 18%|█▊        | 68002/371472 [5:24:30<23:28:07,  3.59it/s]
 18%|█▊        | 68003/371472 [5:24:30<23:40:36,  3.56it/s]
 18%|█▊        | 68004/371472 [5:24:30<22:57:56,  3.67it/s]
 18%|█▊        | 68005/371472 [5:24:31<22:44:57,  3.71it/s]
 18%|█▊        | 68006/371472 [5:24:31<22:36:24,  3.73it/s]
 18%|█▊        | 68007/371472 [5:24:31<22:40:05,  3.72it/s]
 18%|█▊        | 68008/371472 [5:24:32<23:10:34,  3.64it/s]
 18%|█▊        | 68009/371472 [5:24:32<23:20:08,  3.61it/s]
 18%|█▊        | 68010/371472 [5:24:32<23:39:49,  3.56it/s]
 18%|█▊        | 68011/371472 [5:24:32<23:35:27,  3.57it/s]
 18%|█▊        | 68012/371472 [5:24:33<25:32:58,  3.30it/s]
 18%|█▊        | 68013/371472 [5:24:33<25:40:33,  3.28it/s]
 18%|█▊        | 68014/371472 [5:24:33<25:20:48,  3.33it/s]
 18%|█▊        | 68015/371472 [5:24:34<24:47:14,  3.40it/s]
 18%|█▊        | 68016/371472 [5:24:34<24:11:23,  3.48it/s]
 18%|█▊        | 68017/371472 [5:24:34<24:37:46,  3.42it/s]
 18%|█▊        | 68018/371472 [5:24:34<23:48:21,  3.54it/s]
 18%|█▊        | 68019/371472 [5:24:35<24:06:01,  3.50it/s]
 18%|█▊        | 68020/371472 [5:24:35<28:31:56,  2.95it/s]
                                                           
{'loss': 4.108, 'learning_rate': 8.355976211510697e-07, 'epoch': 2.93}

 18%|█▊        | 68020/371472 [5:24:35<28:31:56,  2.95it/s]
 18%|█▊        | 68021/371472 [5:24:35<27:12:19,  3.10it/s]
 18%|█▊        | 68022/371472 [5:24:36<25:59:32,  3.24it/s]
 18%|█▊        | 68023/371472 [5:24:36<24:51:18,  3.39it/s]
 18%|█▊        | 68024/371472 [5:24:36<23:44:20,  3.55it/s]
 18%|█▊        | 68025/371472 [5:24:37<23:30:32,  3.59it/s]
 18%|█▊        | 68026/371472 [5:24:37<24:01:29,  3.51it/s]
 18%|█▊        | 68027/371472 [5:24:37<24:35:28,  3.43it/s]
 18%|█▊        | 68028/371472 [5:24:37<24:04:51,  3.50it/s]
 18%|█▊        | 68029/371472 [5:24:38<24:59:25,  3.37it/s]
 18%|█▊        | 68030/371472 [5:24:38<24:47:01,  3.40it/s]
 18%|█▊        | 68031/371472 [5:24:38<24:05:36,  3.50it/s]
 18%|█▊        | 68032/371472 [5:24:39<25:42:38,  3.28it/s]
 18%|█▊        | 68033/371472 [5:24:39<25:19:15,  3.33it/s]
 18%|█▊        | 68034/371472 [5:24:39<24:46:17,  3.40it/s]
 18%|█▊        | 68035/371472 [5:24:40<24:43:38,  3.41it/s]
 18%|█▊        | 68036/371472 [5:24:40<23:30:04,  3.59it/s]
 18%|█▊        | 68037/371472 [5:24:40<24:30:41,  3.44it/s]
 18%|█▊        | 68038/371472 [5:24:40<24:25:32,  3.45it/s]
 18%|█▊        | 68039/371472 [5:24:41<23:51:12,  3.53it/s]
 18%|█▊        | 68040/371472 [5:24:41<22:55:09,  3.68it/s]
                                                           
{'loss': 4.3268, 'learning_rate': 8.355491391755909e-07, 'epoch': 2.93}

 18%|█▊        | 68040/371472 [5:24:41<22:55:09,  3.68it/s]
 18%|█▊        | 68041/371472 [5:24:41<22:23:49,  3.76it/s]
 18%|█▊        | 68042/371472 [5:24:41<24:24:38,  3.45it/s]
 18%|█▊        | 68043/371472 [5:24:42<23:07:55,  3.64it/s]
 18%|█▊        | 68044/371472 [5:24:42<23:06:05,  3.65it/s]
 18%|█▊        | 68045/371472 [5:24:42<23:33:55,  3.58it/s]
 18%|█▊        | 68046/371472 [5:24:43<22:55:04,  3.68it/s]
 18%|█▊        | 68047/371472 [5:24:43<22:47:49,  3.70it/s]
 18%|█▊        | 68048/371472 [5:24:43<23:44:33,  3.55it/s]
 18%|█▊        | 68049/371472 [5:24:43<23:54:45,  3.52it/s]
 18%|█▊        | 68050/371472 [5:24:44<23:13:29,  3.63it/s]
 18%|█▊        | 68051/371472 [5:24:44<23:08:54,  3.64it/s]
 18%|█▊        | 68052/371472 [5:24:44<22:18:56,  3.78it/s]
 18%|█▊        | 68053/371472 [5:24:45<25:31:06,  3.30it/s]
 18%|█▊        | 68054/371472 [5:24:45<23:45:16,  3.55it/s]
 18%|█▊        | 68055/371472 [5:24:45<23:14:54,  3.63it/s]
 18%|█▊        | 68056/371472 [5:24:45<22:46:23,  3.70it/s]
 18%|█▊        | 68057/371472 [5:24:46<22:31:20,  3.74it/s]
 18%|█▊        | 68058/371472 [5:24:46<22:01:30,  3.83it/s]
 18%|█▊        | 68059/371472 [5:24:46<22:19:07,  3.78it/s]
 18%|█▊        | 68060/371472 [5:24:46<22:00:36,  3.83it/s]
                                                           
{'loss': 4.0361, 'learning_rate': 8.35500657200112e-07, 'epoch': 2.93}

 18%|█▊        | 68060/371472 [5:24:46<22:00:36,  3.83it/s]
 18%|█▊        | 68061/371472 [5:24:47<21:44:59,  3.88it/s]
 18%|█▊        | 68062/371472 [5:24:47<22:08:29,  3.81it/s]
 18%|█▊        | 68063/371472 [5:24:47<23:22:11,  3.61it/s]
 18%|█▊        | 68064/371472 [5:24:47<22:48:15,  3.70it/s]
 18%|█▊        | 68065/371472 [5:24:48<22:21:44,  3.77it/s]
 18%|█▊        | 68066/371472 [5:24:48<22:05:02,  3.82it/s]
 18%|█▊        | 68067/371472 [5:24:48<22:41:00,  3.72it/s]
 18%|█▊        | 68068/371472 [5:24:48<22:07:20,  3.81it/s]
 18%|█▊        | 68069/371472 [5:24:49<23:32:00,  3.58it/s]
 18%|█▊        | 68070/371472 [5:24:49<24:11:04,  3.48it/s]
 18%|█▊        | 68071/371472 [5:24:49<24:37:32,  3.42it/s]
 18%|█▊        | 68072/371472 [5:24:50<24:35:06,  3.43it/s]
 18%|█▊        | 68073/371472 [5:24:50<24:34:02,  3.43it/s]
 18%|█▊        | 68074/371472 [5:24:50<25:26:43,  3.31it/s]
 18%|█▊        | 68075/371472 [5:24:51<25:56:41,  3.25it/s]
 18%|█▊        | 68076/371472 [5:24:51<24:28:38,  3.44it/s]
 18%|█▊        | 68077/371472 [5:24:51<23:33:29,  3.58it/s]
 18%|█▊        | 68078/371472 [5:24:51<22:24:21,  3.76it/s]
 18%|█▊        | 68079/371472 [5:24:52<22:54:25,  3.68it/s]
 18%|█▊        | 68080/371472 [5:24:52<22:43:25,  3.71it/s]
                                                           
{'loss': 3.9429, 'learning_rate': 8.354521752246331e-07, 'epoch': 2.93}

 18%|█▊        | 68080/371472 [5:24:52<22:43:25,  3.71it/s]
 18%|█▊        | 68081/371472 [5:24:52<23:21:08,  3.61it/s]
 18%|█▊        | 68082/371472 [5:24:52<23:24:49,  3.60it/s]
 18%|█▊        | 68083/371472 [5:24:53<24:29:36,  3.44it/s]
 18%|█▊        | 68084/371472 [5:24:53<24:25:57,  3.45it/s]
 18%|█▊        | 68085/371472 [5:24:53<25:04:57,  3.36it/s]
 18%|█▊        | 68086/371472 [5:24:54<24:14:35,  3.48it/s]
 18%|█▊        | 68087/371472 [5:24:54<22:53:00,  3.68it/s]
 18%|█▊        | 68088/371472 [5:24:54<22:49:21,  3.69it/s]
 18%|█▊        | 68089/371472 [5:24:54<23:32:22,  3.58it/s]
 18%|█▊        | 68090/371472 [5:24:55<23:18:33,  3.62it/s]
 18%|█▊        | 68091/371472 [5:24:55<22:43:05,  3.71it/s]
 18%|█▊        | 68092/371472 [5:24:55<21:59:37,  3.83it/s]
 18%|█▊        | 68093/371472 [5:24:56<22:44:52,  3.70it/s]
 18%|█▊        | 68094/371472 [5:24:56<22:11:43,  3.80it/s]
 18%|█▊        | 68095/371472 [5:24:56<22:12:56,  3.79it/s]
 18%|█▊        | 68096/371472 [5:24:56<22:14:33,  3.79it/s]
 18%|█▊        | 68097/371472 [5:24:57<22:23:57,  3.76it/s]
 18%|█▊        | 68098/371472 [5:24:57<22:17:37,  3.78it/s]
 18%|█▊        | 68099/371472 [5:24:57<21:56:53,  3.84it/s]
 18%|█▊        | 68100/371472 [5:24:57<21:24:42,  3.94it/s]
                                                           
{'loss': 4.4815, 'learning_rate': 8.354036932491542e-07, 'epoch': 2.93}

 18%|█▊        | 68100/371472 [5:24:57<21:24:42,  3.94it/s]
 18%|█▊        | 68101/371472 [5:24:58<21:46:41,  3.87it/s]
 18%|█▊        | 68102/371472 [5:24:58<21:28:52,  3.92it/s]
 18%|█▊        | 68103/371472 [5:24:58<21:27:11,  3.93it/s]
 18%|█▊        | 68104/371472 [5:24:58<22:02:19,  3.82it/s]
 18%|█▊        | 68105/371472 [5:24:59<22:11:26,  3.80it/s]
 18%|█▊        | 68106/371472 [5:24:59<23:44:45,  3.55it/s]
 18%|█▊        | 68107/371472 [5:24:59<23:06:16,  3.65it/s]
 18%|█▊        | 68108/371472 [5:25:00<22:57:26,  3.67it/s]
 18%|█▊        | 68109/371472 [5:25:00<22:32:57,  3.74it/s]
 18%|█▊        | 68110/371472 [5:25:00<25:38:53,  3.29it/s]
 18%|█▊        | 68111/371472 [5:25:00<24:30:02,  3.44it/s]
 18%|█▊        | 68112/371472 [5:25:01<25:09:41,  3.35it/s]
 18%|█▊        | 68113/371472 [5:25:01<24:23:12,  3.46it/s]
 18%|█▊        | 68114/371472 [5:25:01<24:15:29,  3.47it/s]
 18%|█▊        | 68115/371472 [5:25:02<25:16:53,  3.33it/s]
 18%|█▊        | 68116/371472 [5:25:02<23:50:15,  3.53it/s]
 18%|█▊        | 68117/371472 [5:25:02<24:31:03,  3.44it/s]
 18%|█▊        | 68118/371472 [5:25:02<24:33:11,  3.43it/s]
 18%|█▊        | 68119/371472 [5:25:03<24:36:19,  3.42it/s]
 18%|█▊        | 68120/371472 [5:25:03<24:28:24,  3.44it/s]
                                                           
{'loss': 3.9123, 'learning_rate': 8.353552112736753e-07, 'epoch': 2.93}

 18%|█▊        | 68120/371472 [5:25:03<24:28:24,  3.44it/s]
 18%|█▊        | 68121/371472 [5:25:03<23:58:19,  3.52it/s]
 18%|█▊        | 68122/371472 [5:25:04<23:53:07,  3.53it/s]
 18%|█▊        | 68123/371472 [5:25:04<23:39:01,  3.56it/s]
 18%|█▊        | 68124/371472 [5:25:04<23:16:52,  3.62it/s]
 18%|█▊        | 68125/371472 [5:25:04<23:49:12,  3.54it/s]
 18%|█▊        | 68126/371472 [5:25:05<26:45:10,  3.15it/s]
 18%|█▊        | 68127/371472 [5:25:05<25:25:24,  3.31it/s]
 18%|█▊        | 68128/371472 [5:25:05<24:11:46,  3.48it/s]
 18%|█▊        | 68129/371472 [5:25:06<22:51:07,  3.69it/s]
 18%|█▊        | 68130/371472 [5:25:06<22:04:58,  3.82it/s]
 18%|█▊        | 68131/371472 [5:25:06<22:23:55,  3.76it/s]
 18%|█▊        | 68132/371472 [5:25:06<22:18:15,  3.78it/s]
 18%|█▊        | 68133/371472 [5:25:07<22:00:15,  3.83it/s]
 18%|█▊        | 68134/371472 [5:25:07<22:17:45,  3.78it/s]
 18%|█▊        | 68135/371472 [5:25:07<23:17:01,  3.62it/s]
 18%|█▊        | 68136/371472 [5:25:07<22:50:25,  3.69it/s]
 18%|█▊        | 68137/371472 [5:25:08<23:52:24,  3.53it/s]
 18%|█▊        | 68138/371472 [5:25:08<25:55:06,  3.25it/s]
 18%|█▊        | 68139/371472 [5:25:08<25:49:54,  3.26it/s]
 18%|█▊        | 68140/371472 [5:25:09<24:40:49,  3.41it/s]
                                                           
{'loss': 4.309, 'learning_rate': 8.353067292981964e-07, 'epoch': 2.93}

 18%|█▊        | 68140/371472 [5:25:09<24:40:49,  3.41it/s]
 18%|█▊        | 68141/371472 [5:25:09<23:56:59,  3.52it/s]
 18%|█▊        | 68142/371472 [5:25:09<23:08:56,  3.64it/s]
 18%|█▊        | 68143/371472 [5:25:09<22:36:15,  3.73it/s]
 18%|█▊        | 68144/371472 [5:25:10<24:20:30,  3.46it/s]
 18%|█▊        | 68145/371472 [5:25:10<26:54:22,  3.13it/s]
 18%|█▊        | 68146/371472 [5:25:10<25:28:42,  3.31it/s]
 18%|█▊        | 68147/371472 [5:25:11<27:05:17,  3.11it/s]
 18%|█▊        | 68148/371472 [5:25:11<25:19:33,  3.33it/s]
 18%|█▊        | 68149/371472 [5:25:11<24:46:37,  3.40it/s]
 18%|█▊        | 68150/371472 [5:25:12<24:27:20,  3.45it/s]
 18%|█▊        | 68151/371472 [5:25:12<25:26:04,  3.31it/s]
 18%|█▊        | 68152/371472 [5:25:12<24:34:02,  3.43it/s]
 18%|█▊        | 68153/371472 [5:25:12<24:08:13,  3.49it/s]
 18%|█▊        | 68154/371472 [5:25:13<23:01:01,  3.66it/s]
 18%|█▊        | 68155/371472 [5:25:13<22:33:32,  3.73it/s]
 18%|█▊        | 68156/371472 [5:25:13<22:48:00,  3.70it/s]
 18%|█▊        | 68157/371472 [5:25:14<22:36:49,  3.73it/s]
 18%|█▊        | 68158/371472 [5:25:14<23:20:09,  3.61it/s]
 18%|█▊        | 68159/371472 [5:25:14<25:25:28,  3.31it/s]
 18%|█▊        | 68160/371472 [5:25:15<26:15:27,  3.21it/s]
                                                           
{'loss': 4.1525, 'learning_rate': 8.352582473227176e-07, 'epoch': 2.94}

 18%|█▊        | 68160/371472 [5:25:15<26:15:27,  3.21it/s]
 18%|█▊        | 68161/371472 [5:25:15<25:36:17,  3.29it/s]
 18%|█▊        | 68162/371472 [5:25:15<24:08:16,  3.49it/s]
 18%|█▊        | 68163/371472 [5:25:15<24:30:58,  3.44it/s]
 18%|█▊        | 68164/371472 [5:25:16<23:21:59,  3.61it/s]
 18%|█▊        | 68165/371472 [5:25:16<23:07:58,  3.64it/s]
 18%|█▊        | 68166/371472 [5:25:16<23:16:52,  3.62it/s]
 18%|█▊        | 68167/371472 [5:25:16<22:26:27,  3.75it/s]
 18%|█▊        | 68168/371472 [5:25:17<23:37:24,  3.57it/s]
 18%|█▊        | 68169/371472 [5:25:17<24:17:43,  3.47it/s]
 18%|█▊        | 68170/371472 [5:25:17<24:11:41,  3.48it/s]
 18%|█▊        | 68171/371472 [5:25:18<25:12:34,  3.34it/s]
 18%|█▊        | 68172/371472 [5:25:18<24:08:03,  3.49it/s]
 18%|█▊        | 68173/371472 [5:25:18<24:05:07,  3.50it/s]
 18%|█▊        | 68174/371472 [5:25:19<27:12:24,  3.10it/s]
 18%|█▊        | 68175/371472 [5:25:19<28:22:11,  2.97it/s]
 18%|█▊        | 68176/371472 [5:25:19<26:00:33,  3.24it/s]
 18%|█▊        | 68177/371472 [5:25:19<26:00:50,  3.24it/s]
 18%|█▊        | 68178/371472 [5:25:20<25:07:23,  3.35it/s]
 18%|█▊        | 68179/371472 [5:25:20<23:56:43,  3.52it/s]
 18%|█▊        | 68180/371472 [5:25:20<22:51:45,  3.68it/s]
                                                           
{'loss': 4.2099, 'learning_rate': 8.352097653472387e-07, 'epoch': 2.94}

 18%|█▊        | 68180/371472 [5:25:20<22:51:45,  3.68it/s]
 18%|█▊        | 68181/371472 [5:25:21<23:10:45,  3.63it/s]
 18%|█▊        | 68182/371472 [5:25:21<22:17:27,  3.78it/s]
 18%|█▊        | 68183/371472 [5:25:21<22:52:15,  3.68it/s]
 18%|█▊        | 68184/371472 [5:25:21<22:20:34,  3.77it/s]
 18%|█▊        | 68185/371472 [5:25:22<22:34:05,  3.73it/s]
 18%|█▊        | 68186/371472 [5:25:22<23:00:02,  3.66it/s]
 18%|█▊        | 68187/371472 [5:25:22<24:13:35,  3.48it/s]
 18%|█▊        | 68188/371472 [5:25:22<23:50:33,  3.53it/s]
 18%|█▊        | 68189/371472 [5:25:23<23:37:41,  3.57it/s]
 18%|█▊        | 68190/371472 [5:25:23<22:32:44,  3.74it/s]
 18%|█▊        | 68191/371472 [5:25:23<23:22:19,  3.60it/s]
 18%|█▊        | 68192/371472 [5:25:24<23:36:55,  3.57it/s]
 18%|█▊        | 68193/371472 [5:25:24<24:04:12,  3.50it/s]
 18%|█▊        | 68194/371472 [5:25:24<24:16:40,  3.47it/s]
 18%|█▊        | 68195/371472 [5:25:24<24:09:18,  3.49it/s]
 18%|█▊        | 68196/371472 [5:25:25<23:37:36,  3.57it/s]
 18%|█▊        | 68197/371472 [5:25:25<23:44:30,  3.55it/s]
 18%|█▊        | 68198/371472 [5:25:25<23:23:31,  3.60it/s]
 18%|█▊        | 68199/371472 [5:25:26<22:40:09,  3.72it/s]
 18%|█▊        | 68200/371472 [5:25:26<22:03:44,  3.82it/s]
                                                           
{'loss': 4.2891, 'learning_rate': 8.351612833717598e-07, 'epoch': 2.94}

 18%|█▊        | 68200/371472 [5:25:26<22:03:44,  3.82it/s]
 18%|█▊        | 68201/371472 [5:25:26<22:34:39,  3.73it/s]
 18%|█▊        | 68202/371472 [5:25:26<22:40:22,  3.72it/s]
 18%|█▊        | 68203/371472 [5:25:27<24:46:05,  3.40it/s]
 18%|█▊        | 68204/371472 [5:25:27<23:40:47,  3.56it/s]
 18%|█▊        | 68205/371472 [5:25:27<24:10:21,  3.48it/s]
 18%|█▊        | 68206/371472 [5:25:28<24:32:19,  3.43it/s]
 18%|█▊        | 68207/371472 [5:25:28<23:53:30,  3.53it/s]
 18%|█▊        | 68208/371472 [5:25:28<23:51:51,  3.53it/s]
 18%|█▊        | 68209/371472 [5:25:28<23:33:42,  3.58it/s]
 18%|█▊        | 68210/371472 [5:25:29<25:07:06,  3.35it/s]
 18%|█▊        | 68211/371472 [5:25:29<24:53:14,  3.38it/s]
 18%|█▊        | 68212/371472 [5:25:29<23:52:24,  3.53it/s]
 18%|█▊        | 68213/371472 [5:25:30<24:04:24,  3.50it/s]
 18%|█▊        | 68214/371472 [5:25:30<25:44:38,  3.27it/s]
 18%|█▊        | 68215/371472 [5:25:30<25:39:05,  3.28it/s]
 18%|█▊        | 68216/371472 [5:25:31<26:50:49,  3.14it/s]
 18%|█▊        | 68217/371472 [5:25:31<25:56:29,  3.25it/s]
 18%|█▊        | 68218/371472 [5:25:31<26:52:22,  3.13it/s]
 18%|█▊        | 68219/371472 [5:25:31<25:36:45,  3.29it/s]
 18%|█▊        | 68220/371472 [5:25:32<24:51:31,  3.39it/s]
                                                           
{'loss': 3.9832, 'learning_rate': 8.351128013962808e-07, 'epoch': 2.94}

 18%|█▊        | 68220/371472 [5:25:32<24:51:31,  3.39it/s]
 18%|█▊        | 68221/371472 [5:25:32<24:28:09,  3.44it/s]
 18%|█▊        | 68222/371472 [5:25:32<23:33:29,  3.58it/s]
 18%|█▊        | 68223/371472 [5:25:32<23:03:00,  3.65it/s]
 18%|█▊        | 68224/371472 [5:25:33<23:24:18,  3.60it/s]
 18%|█▊        | 68225/371472 [5:25:33<24:31:46,  3.43it/s]
 18%|█▊        | 68226/371472 [5:25:33<23:33:10,  3.58it/s]
 18%|█▊        | 68227/371472 [5:25:34<22:31:54,  3.74it/s]
 18%|█▊        | 68228/371472 [5:25:34<22:59:02,  3.66it/s]
 18%|█▊        | 68229/371472 [5:25:34<23:45:31,  3.55it/s]
 18%|█▊        | 68230/371472 [5:25:34<23:19:06,  3.61it/s]
 18%|█▊        | 68231/371472 [5:25:35<23:21:18,  3.61it/s]
 18%|█▊        | 68232/371472 [5:25:35<25:24:20,  3.32it/s]
 18%|█▊        | 68233/371472 [5:25:35<25:10:26,  3.35it/s]
 18%|█▊        | 68234/371472 [5:25:36<24:19:51,  3.46it/s]
 18%|█▊        | 68235/371472 [5:25:36<23:44:23,  3.55it/s]
 18%|█▊        | 68236/371472 [5:25:36<23:49:04,  3.54it/s]
 18%|█▊        | 68237/371472 [5:25:36<24:25:35,  3.45it/s]
 18%|█▊        | 68238/371472 [5:25:37<23:30:58,  3.58it/s]
 18%|█▊        | 68239/371472 [5:25:37<23:49:05,  3.54it/s]
 18%|█▊        | 68240/371472 [5:25:37<23:22:03,  3.60it/s]
                                                           
{'loss': 4.2352, 'learning_rate': 8.35064319420802e-07, 'epoch': 2.94}

 18%|█▊        | 68240/371472 [5:25:37<23:22:03,  3.60it/s]
 18%|█▊        | 68241/371472 [5:25:38<23:31:51,  3.58it/s]
 18%|█▊        | 68242/371472 [5:25:38<22:42:50,  3.71it/s]
 18%|█▊        | 68243/371472 [5:25:38<25:00:24,  3.37it/s]
 18%|█▊        | 68244/371472 [5:25:38<23:57:04,  3.52it/s]
 18%|█▊        | 68245/371472 [5:25:39<23:25:00,  3.60it/s]
 18%|█▊        | 68246/371472 [5:25:39<23:03:55,  3.65it/s]
 18%|█▊        | 68247/371472 [5:25:39<22:44:55,  3.70it/s]
 18%|█▊        | 68248/371472 [5:25:40<23:08:20,  3.64it/s]
 18%|█▊        | 68249/371472 [5:25:40<22:28:45,  3.75it/s]
 18%|█▊        | 68250/371472 [5:25:40<23:07:34,  3.64it/s]
 18%|█▊        | 68251/371472 [5:25:40<23:30:00,  3.58it/s]
 18%|█▊        | 68252/371472 [5:25:41<24:56:45,  3.38it/s]
 18%|█▊        | 68253/371472 [5:25:41<23:53:43,  3.52it/s]
 18%|█▊        | 68254/371472 [5:25:41<23:01:44,  3.66it/s]
 18%|█▊        | 68255/371472 [5:25:41<22:55:29,  3.67it/s]
 18%|█▊        | 68256/371472 [5:25:42<24:38:46,  3.42it/s]
 18%|█▊        | 68257/371472 [5:25:42<25:17:45,  3.33it/s]
 18%|█▊        | 68258/371472 [5:25:42<23:43:02,  3.55it/s]
 18%|█▊        | 68259/371472 [5:25:43<23:55:00,  3.52it/s]
 18%|█▊        | 68260/371472 [5:25:43<23:44:40,  3.55it/s]
                                                           
{'loss': 4.1817, 'learning_rate': 8.35015837445323e-07, 'epoch': 2.94}

 18%|█▊        | 68260/371472 [5:25:43<23:44:40,  3.55it/s]
 18%|█▊        | 68261/371472 [5:25:43<22:47:23,  3.70it/s]
 18%|█▊        | 68262/371472 [5:25:43<23:21:50,  3.60it/s]
 18%|█▊        | 68263/371472 [5:25:44<23:10:40,  3.63it/s]
 18%|█▊        | 68264/371472 [5:25:44<23:18:51,  3.61it/s]
 18%|█▊        | 68265/371472 [5:25:44<25:57:52,  3.24it/s]
 18%|█▊        | 68266/371472 [5:25:45<25:29:24,  3.30it/s]
 18%|█▊        | 68267/371472 [5:25:45<24:55:44,  3.38it/s]
 18%|█▊        | 68268/371472 [5:25:45<23:55:24,  3.52it/s]
 18%|█▊        | 68269/371472 [5:25:45<23:35:29,  3.57it/s]
 18%|█▊        | 68270/371472 [5:25:46<23:58:12,  3.51it/s]
 18%|█▊        | 68271/371472 [5:25:46<23:21:22,  3.61it/s]
 18%|█▊        | 68272/371472 [5:25:46<22:50:55,  3.69it/s]
 18%|█▊        | 68273/371472 [5:25:47<23:38:52,  3.56it/s]
 18%|█▊        | 68274/371472 [5:25:47<24:54:37,  3.38it/s]
 18%|█▊        | 68275/371472 [5:25:47<24:27:18,  3.44it/s]
 18%|█▊        | 68276/371472 [5:25:48<25:40:50,  3.28it/s]
 18%|█▊        | 68277/371472 [5:25:48<24:03:08,  3.50it/s]
 18%|█▊        | 68278/371472 [5:25:48<22:48:23,  3.69it/s]
 18%|█▊        | 68279/371472 [5:25:48<24:03:05,  3.50it/s]
 18%|█▊        | 68280/371472 [5:25:49<24:25:49,  3.45it/s]
                                                           
{'loss': 4.0247, 'learning_rate': 8.349673554698442e-07, 'epoch': 2.94}

 18%|█▊        | 68280/371472 [5:25:49<24:25:49,  3.45it/s]
 18%|█▊        | 68281/371472 [5:25:49<23:43:08,  3.55it/s]
 18%|█▊        | 68282/371472 [5:25:49<23:04:24,  3.65it/s]
 18%|█▊        | 68283/371472 [5:25:49<23:11:21,  3.63it/s]
 18%|█▊        | 68284/371472 [5:25:50<25:19:42,  3.33it/s]
 18%|█▊        | 68285/371472 [5:25:50<23:46:16,  3.54it/s]
 18%|█▊        | 68286/371472 [5:25:50<24:33:46,  3.43it/s]
 18%|█▊        | 68287/371472 [5:25:51<24:00:26,  3.51it/s]
 18%|█▊        | 68288/371472 [5:25:51<23:49:19,  3.54it/s]
 18%|█▊        | 68289/371472 [5:25:51<23:22:57,  3.60it/s]
 18%|█▊        | 68290/371472 [5:25:51<24:21:31,  3.46it/s]
 18%|█▊        | 68291/371472 [5:25:52<24:34:36,  3.43it/s]
 18%|█▊        | 68292/371472 [5:25:52<23:35:08,  3.57it/s]
 18%|█▊        | 68293/371472 [5:25:52<23:44:52,  3.55it/s]
 18%|█▊        | 68294/371472 [5:25:53<22:38:41,  3.72it/s]
 18%|█▊        | 68295/371472 [5:25:53<23:35:33,  3.57it/s]
 18%|█▊        | 68296/371472 [5:25:53<23:37:34,  3.56it/s]
 18%|█▊        | 68297/371472 [5:25:53<23:52:11,  3.53it/s]
 18%|█▊        | 68298/371472 [5:25:54<26:31:41,  3.17it/s]
 18%|█▊        | 68299/371472 [5:25:54<26:38:22,  3.16it/s]
 18%|█▊        | 68300/371472 [5:25:54<25:17:43,  3.33it/s]
                                                           
{'loss': 4.0533, 'learning_rate': 8.349188734943653e-07, 'epoch': 2.94}

 18%|█▊        | 68300/371472 [5:25:54<25:17:43,  3.33it/s]
 18%|█▊        | 68301/371472 [5:25:55<25:49:29,  3.26it/s]
 18%|█▊        | 68302/371472 [5:25:55<24:24:24,  3.45it/s]
 18%|█▊        | 68303/371472 [5:25:55<23:28:24,  3.59it/s]
 18%|█▊        | 68304/371472 [5:25:56<24:22:58,  3.45it/s]
 18%|█▊        | 68305/371472 [5:25:56<25:00:56,  3.37it/s]
 18%|█▊        | 68306/371472 [5:25:56<23:46:01,  3.54it/s]
 18%|█▊        | 68307/371472 [5:25:56<23:33:27,  3.57it/s]
 18%|█▊        | 68308/371472 [5:25:57<23:29:26,  3.58it/s]
 18%|█▊        | 68309/371472 [5:25:57<22:40:36,  3.71it/s]
 18%|█▊        | 68310/371472 [5:25:57<22:47:37,  3.69it/s]
 18%|█▊        | 68311/371472 [5:25:57<23:02:35,  3.65it/s]
 18%|█▊        | 68312/371472 [5:25:58<23:29:46,  3.58it/s]
 18%|█▊        | 68313/371472 [5:25:58<23:45:29,  3.54it/s]
 18%|█▊        | 68314/371472 [5:25:58<24:57:04,  3.37it/s]
 18%|█▊        | 68315/371472 [5:25:59<24:55:10,  3.38it/s]
 18%|█▊        | 68316/371472 [5:25:59<24:03:15,  3.50it/s]
 18%|█▊        | 68317/371472 [5:25:59<23:27:16,  3.59it/s]
 18%|█▊        | 68318/371472 [5:25:59<22:56:54,  3.67it/s]
 18%|█▊        | 68319/371472 [5:26:00<22:24:20,  3.76it/s]
 18%|█▊        | 68320/371472 [5:26:00<22:35:34,  3.73it/s]
                                                           
{'loss': 4.1722, 'learning_rate': 8.348703915188865e-07, 'epoch': 2.94}

 18%|█▊        | 68320/371472 [5:26:00<22:35:34,  3.73it/s]
 18%|█▊        | 68321/371472 [5:26:00<24:55:26,  3.38it/s]
 18%|█▊        | 68322/371472 [5:26:01<24:35:56,  3.42it/s]
 18%|█▊        | 68323/371472 [5:26:01<25:02:33,  3.36it/s]
 18%|█▊        | 68324/371472 [5:26:01<26:03:41,  3.23it/s]
 18%|█▊        | 68325/371472 [5:26:02<26:07:03,  3.22it/s]
 18%|█▊        | 68326/371472 [5:26:02<24:38:28,  3.42it/s]
 18%|█▊        | 68327/371472 [5:26:02<23:24:36,  3.60it/s]
 18%|█▊        | 68328/371472 [5:26:02<23:09:20,  3.64it/s]
 18%|█▊        | 68329/371472 [5:26:03<25:14:58,  3.33it/s]
 18%|█▊        | 68330/371472 [5:26:03<25:34:16,  3.29it/s]
 18%|█▊        | 68331/371472 [5:26:03<25:03:13,  3.36it/s]
 18%|█▊        | 68332/371472 [5:26:04<24:46:54,  3.40it/s]
 18%|█▊        | 68333/371472 [5:26:04<23:48:34,  3.54it/s]
 18%|█▊        | 68334/371472 [5:26:04<23:01:40,  3.66it/s]
 18%|█▊        | 68335/371472 [5:26:04<23:22:14,  3.60it/s]
 18%|█▊        | 68336/371472 [5:26:05<23:14:42,  3.62it/s]
 18%|█▊        | 68337/371472 [5:26:05<22:54:48,  3.67it/s]
 18%|█▊        | 68338/371472 [5:26:05<23:37:27,  3.56it/s]
 18%|█▊        | 68339/371472 [5:26:06<25:44:31,  3.27it/s]
 18%|█▊        | 68340/371472 [5:26:06<24:11:20,  3.48it/s]
                                                           
{'loss': 4.1471, 'learning_rate': 8.348219095434073e-07, 'epoch': 2.94}

 18%|█▊        | 68340/371472 [5:26:06<24:11:20,  3.48it/s]
 18%|█▊        | 68341/371472 [5:26:06<24:56:32,  3.38it/s]
 18%|█▊        | 68342/371472 [5:26:06<25:56:10,  3.25it/s]
 18%|█▊        | 68343/371472 [5:26:07<25:35:11,  3.29it/s]
 18%|█▊        | 68344/371472 [5:26:07<25:05:58,  3.35it/s]
 18%|█▊        | 68345/371472 [5:26:07<24:05:31,  3.49it/s]
 18%|█▊        | 68346/371472 [5:26:08<23:36:06,  3.57it/s]
 18%|█▊        | 68347/371472 [5:26:08<23:05:26,  3.65it/s]
 18%|█▊        | 68348/371472 [5:26:08<24:07:46,  3.49it/s]
 18%|█▊        | 68349/371472 [5:26:08<24:54:06,  3.38it/s]
 18%|█▊        | 68350/371472 [5:26:09<24:15:04,  3.47it/s]
 18%|█▊        | 68351/371472 [5:26:09<26:21:50,  3.19it/s]
 18%|█▊        | 68352/371472 [5:26:09<26:23:30,  3.19it/s]
 18%|█▊        | 68353/371472 [5:26:10<24:51:35,  3.39it/s]
 18%|█▊        | 68354/371472 [5:26:10<24:23:35,  3.45it/s]
 18%|█▊        | 68355/371472 [5:26:10<26:33:32,  3.17it/s]
 18%|█▊        | 68356/371472 [5:26:11<25:59:28,  3.24it/s]
 18%|█▊        | 68357/371472 [5:26:11<25:43:13,  3.27it/s]
 18%|█▊        | 68358/371472 [5:26:11<25:42:16,  3.28it/s]
 18%|█▊        | 68359/371472 [5:26:11<24:24:34,  3.45it/s]
 18%|█▊        | 68360/371472 [5:26:12<24:16:43,  3.47it/s]
                                                           
{'loss': 4.1911, 'learning_rate': 8.347734275679286e-07, 'epoch': 2.94}

 18%|█▊        | 68360/371472 [5:26:12<24:16:43,  3.47it/s]
 18%|█▊        | 68361/371472 [5:26:12<24:44:29,  3.40it/s]
 18%|█▊        | 68362/371472 [5:26:12<23:28:13,  3.59it/s]
 18%|█▊        | 68363/371472 [5:26:13<22:36:50,  3.72it/s]
 18%|█▊        | 68364/371472 [5:26:13<22:56:29,  3.67it/s]
 18%|█▊        | 68365/371472 [5:26:13<22:35:41,  3.73it/s]
 18%|█▊        | 68366/371472 [5:26:13<23:36:42,  3.57it/s]
 18%|█▊        | 68367/371472 [5:26:14<23:32:42,  3.58it/s]
 18%|█▊        | 68368/371472 [5:26:14<22:37:15,  3.72it/s]
 18%|█▊        | 68369/371472 [5:26:14<22:53:03,  3.68it/s]
 18%|█▊        | 68370/371472 [5:26:15<23:18:06,  3.61it/s]
 18%|█▊        | 68371/371472 [5:26:15<24:27:20,  3.44it/s]
 18%|█▊        | 68372/371472 [5:26:15<23:57:00,  3.52it/s]
 18%|█▊        | 68373/371472 [5:26:15<23:01:17,  3.66it/s]
 18%|█▊        | 68374/371472 [5:26:16<24:42:40,  3.41it/s]
 18%|█▊        | 68375/371472 [5:26:16<23:59:02,  3.51it/s]
 18%|█▊        | 68376/371472 [5:26:16<23:35:58,  3.57it/s]
 18%|█▊        | 68377/371472 [5:26:17<24:20:19,  3.46it/s]
 18%|█▊        | 68378/371472 [5:26:17<23:54:19,  3.52it/s]
 18%|█▊        | 68379/371472 [5:26:17<23:05:51,  3.65it/s]
 18%|█▊        | 68380/371472 [5:26:17<23:22:57,  3.60it/s]
                                                           
{'loss': 4.0995, 'learning_rate': 8.347249455924497e-07, 'epoch': 2.95}

 18%|█▊        | 68380/371472 [5:26:17<23:22:57,  3.60it/s]
 18%|█▊        | 68381/371472 [5:26:18<23:18:47,  3.61it/s]
 18%|█▊        | 68382/371472 [5:26:18<23:07:47,  3.64it/s]
 18%|█▊        | 68383/371472 [5:26:18<23:46:57,  3.54it/s]
 18%|█▊        | 68384/371472 [5:26:18<23:27:58,  3.59it/s]
 18%|█▊        | 68385/371472 [5:26:19<22:33:13,  3.73it/s]
 18%|█▊        | 68386/371472 [5:26:19<24:03:04,  3.50it/s]
 18%|█▊        | 68387/371472 [5:26:19<23:51:28,  3.53it/s]
 18%|█▊        | 68388/371472 [5:26:20<24:35:06,  3.42it/s]
 18%|█▊        | 68389/371472 [5:26:20<23:36:33,  3.57it/s]
 18%|█▊        | 68390/371472 [5:26:20<23:05:31,  3.65it/s]
 18%|█▊        | 68391/371472 [5:26:20<23:01:53,  3.66it/s]
 18%|█▊        | 68392/371472 [5:26:21<22:11:31,  3.79it/s]
 18%|█▊        | 68393/371472 [5:26:21<22:37:44,  3.72it/s]
 18%|█▊        | 68394/371472 [5:26:21<22:27:21,  3.75it/s]
 18%|█▊        | 68395/371472 [5:26:21<22:57:28,  3.67it/s]
 18%|█▊        | 68396/371472 [5:26:22<24:48:01,  3.39it/s]
 18%|█▊        | 68397/371472 [5:26:22<24:04:34,  3.50it/s]
 18%|█▊        | 68398/371472 [5:26:22<23:38:50,  3.56it/s]
 18%|█▊        | 68399/371472 [5:26:23<22:41:47,  3.71it/s]
 18%|█▊        | 68400/371472 [5:26:23<22:58:14,  3.66it/s]
                                                           
{'loss': 4.1429, 'learning_rate': 8.346764636169708e-07, 'epoch': 2.95}

 18%|█▊        | 68400/371472 [5:26:23<22:58:14,  3.66it/s]
 18%|█▊        | 68401/371472 [5:26:23<23:20:29,  3.61it/s]
 18%|█▊        | 68402/371472 [5:26:24<26:08:47,  3.22it/s]
 18%|█▊        | 68403/371472 [5:26:24<25:12:48,  3.34it/s]
 18%|█▊        | 68404/371472 [5:26:24<23:55:16,  3.52it/s]
 18%|█▊        | 68405/371472 [5:26:24<23:18:26,  3.61it/s]
 18%|█▊        | 68406/371472 [5:26:25<22:39:29,  3.72it/s]
 18%|█▊        | 68407/371472 [5:26:25<22:10:30,  3.80it/s]
 18%|█▊        | 68408/371472 [5:26:25<23:20:14,  3.61it/s]
 18%|█▊        | 68409/371472 [5:26:25<22:37:58,  3.72it/s]
 18%|█▊        | 68410/371472 [5:26:26<21:51:53,  3.85it/s]
 18%|█▊        | 68411/371472 [5:26:26<23:41:47,  3.55it/s]
 18%|█▊        | 68412/371472 [5:26:26<23:17:11,  3.62it/s]
 18%|█▊        | 68413/371472 [5:26:27<24:21:33,  3.46it/s]
 18%|█▊        | 68414/371472 [5:26:27<24:02:40,  3.50it/s]
 18%|█▊        | 68415/371472 [5:26:27<24:19:00,  3.46it/s]
 18%|█▊        | 68416/371472 [5:26:27<25:29:40,  3.30it/s]
 18%|█▊        | 68417/371472 [5:26:28<26:29:50,  3.18it/s]
 18%|█▊        | 68418/371472 [5:26:28<25:31:42,  3.30it/s]
 18%|█▊        | 68419/371472 [5:26:28<24:35:13,  3.42it/s]
 18%|█▊        | 68420/371472 [5:26:29<23:11:12,  3.63it/s]
                                                           
{'loss': 4.2546, 'learning_rate': 8.346279816414919e-07, 'epoch': 2.95}

 18%|█▊        | 68420/371472 [5:26:29<23:11:12,  3.63it/s]
 18%|█▊        | 68421/371472 [5:26:29<22:39:04,  3.72it/s]
 18%|█▊        | 68422/371472 [5:26:29<26:07:41,  3.22it/s]
 18%|█▊        | 68423/371472 [5:26:29<24:46:47,  3.40it/s]
 18%|█▊        | 68424/371472 [5:26:30<25:56:36,  3.24it/s]
 18%|█▊        | 68425/371472 [5:26:30<24:46:20,  3.40it/s]
 18%|█▊        | 68426/371472 [5:26:30<23:35:56,  3.57it/s]
 18%|█▊        | 68427/371472 [5:26:31<23:48:58,  3.53it/s]
 18%|█▊        | 68428/371472 [5:26:31<24:45:32,  3.40it/s]
 18%|█▊        | 68429/371472 [5:26:31<23:41:55,  3.55it/s]
 18%|█▊        | 68430/371472 [5:26:31<23:14:28,  3.62it/s]
 18%|█▊        | 68431/371472 [5:26:32<23:53:18,  3.52it/s]
 18%|█▊        | 68432/371472 [5:26:32<24:08:01,  3.49it/s]
 18%|█▊        | 68433/371472 [5:26:32<23:24:45,  3.60it/s]
 18%|█▊        | 68434/371472 [5:26:33<23:19:02,  3.61it/s]
 18%|█▊        | 68435/371472 [5:26:33<23:05:42,  3.64it/s]
 18%|█▊        | 68436/371472 [5:26:33<22:43:59,  3.70it/s]
 18%|█▊        | 68437/371472 [5:26:33<22:13:45,  3.79it/s]
 18%|█▊        | 68438/371472 [5:26:34<24:28:21,  3.44it/s]
 18%|█▊        | 68439/371472 [5:26:34<23:22:59,  3.60it/s]
 18%|█▊        | 68440/371472 [5:26:34<23:59:14,  3.51it/s]
                                                           
{'loss': 4.003, 'learning_rate': 8.345794996660131e-07, 'epoch': 2.95}

 18%|█▊        | 68440/371472 [5:26:34<23:59:14,  3.51it/s]
 18%|█▊        | 68441/371472 [5:26:35<23:53:41,  3.52it/s]
 18%|█▊        | 68442/371472 [5:26:35<23:23:19,  3.60it/s]
 18%|█▊        | 68443/371472 [5:26:35<24:25:06,  3.45it/s]
 18%|█▊        | 68444/371472 [5:26:35<22:54:53,  3.67it/s]
 18%|█▊        | 68445/371472 [5:26:36<22:36:57,  3.72it/s]
 18%|█▊        | 68446/371472 [5:26:36<21:55:21,  3.84it/s]
 18%|█▊        | 68447/371472 [5:26:36<24:31:30,  3.43it/s]
 18%|█▊        | 68448/371472 [5:26:37<23:55:54,  3.52it/s]
 18%|█▊        | 68449/371472 [5:26:37<24:22:30,  3.45it/s]
 18%|█▊        | 68450/371472 [5:26:37<24:36:39,  3.42it/s]
 18%|█▊        | 68451/371472 [5:26:37<25:50:15,  3.26it/s]
 18%|█▊        | 68452/371472 [5:26:38<24:23:10,  3.45it/s]
 18%|█▊        | 68453/371472 [5:26:38<24:14:28,  3.47it/s]
 18%|█▊        | 68454/371472 [5:26:38<24:51:01,  3.39it/s]
 18%|█▊        | 68455/371472 [5:26:39<23:59:03,  3.51it/s]
 18%|█▊        | 68456/371472 [5:26:39<23:51:16,  3.53it/s]
 18%|█▊        | 68457/371472 [5:26:39<22:52:51,  3.68it/s]
 18%|█▊        | 68458/371472 [5:26:39<21:56:25,  3.84it/s]
 18%|█▊        | 68459/371472 [5:26:40<21:17:29,  3.95it/s]
 18%|█▊        | 68460/371472 [5:26:40<21:11:02,  3.97it/s]
                                                           
{'loss': 4.0601, 'learning_rate': 8.345310176905341e-07, 'epoch': 2.95}

 18%|█▊        | 68460/371472 [5:26:40<21:11:02,  3.97it/s]
 18%|█▊        | 68461/371472 [5:26:40<21:31:03,  3.91it/s]
 18%|█▊        | 68462/371472 [5:26:40<22:24:07,  3.76it/s]
 18%|█▊        | 68463/371472 [5:26:41<22:04:15,  3.81it/s]
 18%|█▊        | 68464/371472 [5:26:41<22:25:27,  3.75it/s]
 18%|█▊        | 68465/371472 [5:26:41<23:15:59,  3.62it/s]
 18%|█▊        | 68466/371472 [5:26:41<22:11:59,  3.79it/s]
 18%|█▊        | 68467/371472 [5:26:42<22:57:55,  3.66it/s]
 18%|█▊        | 68468/371472 [5:26:42<22:22:24,  3.76it/s]
 18%|█▊        | 68469/371472 [5:26:42<22:13:39,  3.79it/s]
 18%|█▊        | 68470/371472 [5:26:43<23:46:20,  3.54it/s]
 18%|█▊        | 68471/371472 [5:26:43<23:06:34,  3.64it/s]
 18%|█▊        | 68472/371472 [5:26:43<24:22:25,  3.45it/s]
 18%|█▊        | 68473/371472 [5:26:43<23:30:24,  3.58it/s]
 18%|█▊        | 68474/371472 [5:26:44<23:46:48,  3.54it/s]
 18%|█▊        | 68475/371472 [5:26:44<24:31:04,  3.43it/s]
 18%|█▊        | 68476/371472 [5:26:44<24:44:42,  3.40it/s]
 18%|█▊        | 68477/371472 [5:26:45<25:30:50,  3.30it/s]
 18%|█▊        | 68478/371472 [5:26:45<24:42:34,  3.41it/s]
 18%|█▊        | 68479/371472 [5:26:45<25:07:43,  3.35it/s]
 18%|█▊        | 68480/371472 [5:26:45<24:01:29,  3.50it/s]
                                                           
{'loss': 4.2808, 'learning_rate': 8.344825357150552e-07, 'epoch': 2.95}

 18%|█▊        | 68480/371472 [5:26:45<24:01:29,  3.50it/s]
 18%|█▊        | 68481/371472 [5:26:46<23:34:36,  3.57it/s]
 18%|█▊        | 68482/371472 [5:26:46<23:33:47,  3.57it/s]
 18%|█▊        | 68483/371472 [5:26:46<22:25:08,  3.75it/s]
 18%|█▊        | 68484/371472 [5:26:47<25:31:47,  3.30it/s]
 18%|█▊        | 68485/371472 [5:26:47<25:21:32,  3.32it/s]
 18%|█▊        | 68486/371472 [5:26:47<24:56:57,  3.37it/s]
 18%|█▊        | 68487/371472 [5:26:48<25:12:48,  3.34it/s]
 18%|█▊        | 68488/371472 [5:26:48<24:37:41,  3.42it/s]
 18%|█▊        | 68489/371472 [5:26:48<24:02:04,  3.50it/s]
 18%|█▊        | 68490/371472 [5:26:48<24:14:50,  3.47it/s]
 18%|█▊        | 68491/371472 [5:26:49<24:00:02,  3.51it/s]
 18%|█▊        | 68492/371472 [5:26:49<24:42:55,  3.41it/s]
 18%|█▊        | 68493/371472 [5:26:49<24:04:41,  3.50it/s]
 18%|█▊        | 68494/371472 [5:26:49<23:00:11,  3.66it/s]
 18%|█▊        | 68495/371472 [5:26:50<22:39:13,  3.72it/s]
 18%|█▊        | 68496/371472 [5:26:50<23:19:00,  3.61it/s]
 18%|█▊        | 68497/371472 [5:26:50<22:30:42,  3.74it/s]
 18%|█▊        | 68498/371472 [5:26:50<22:01:39,  3.82it/s]
 18%|█▊        | 68499/371472 [5:26:51<22:01:52,  3.82it/s]
 18%|█▊        | 68500/371472 [5:26:51<21:20:59,  3.94it/s]
                                                           
{'loss': 4.3243, 'learning_rate': 8.344340537395763e-07, 'epoch': 2.95}

 18%|█▊        | 68500/371472 [5:26:51<21:20:59,  3.94it/s]
 18%|█▊        | 68501/371472 [5:26:51<22:09:20,  3.80it/s]
 18%|█▊        | 68502/371472 [5:26:52<22:08:31,  3.80it/s]
 18%|█▊        | 68503/371472 [5:26:52<22:08:53,  3.80it/s]
 18%|█▊        | 68504/371472 [5:26:52<23:15:44,  3.62it/s]
 18%|█▊        | 68505/371472 [5:26:52<23:05:07,  3.65it/s]
 18%|█▊        | 68506/371472 [5:26:53<22:19:16,  3.77it/s]
 18%|█▊        | 68507/371472 [5:26:53<24:26:10,  3.44it/s]
 18%|█▊        | 68508/371472 [5:26:53<23:20:01,  3.61it/s]
 18%|█▊        | 68509/371472 [5:26:54<24:54:30,  3.38it/s]
 18%|█▊        | 68510/371472 [5:26:54<23:59:50,  3.51it/s]
 18%|█▊        | 68511/371472 [5:26:54<25:58:43,  3.24it/s]
 18%|█▊        | 68512/371472 [5:26:55<28:09:17,  2.99it/s]
 18%|█▊        | 68513/371472 [5:26:55<26:08:01,  3.22it/s]
 18%|█▊        | 68514/371472 [5:26:55<25:57:29,  3.24it/s]
 18%|█▊        | 68515/371472 [5:26:55<24:34:48,  3.42it/s]
 18%|█▊        | 68516/371472 [5:26:56<23:47:37,  3.54it/s]
 18%|█▊        | 68517/371472 [5:26:56<22:49:45,  3.69it/s]
 18%|█▊        | 68518/371472 [5:26:56<22:37:53,  3.72it/s]
 18%|█▊        | 68519/371472 [5:26:56<22:21:42,  3.76it/s]
 18%|█▊        | 68520/371472 [5:26:57<24:09:55,  3.48it/s]
                                                           
{'loss': 4.1212, 'learning_rate': 8.343855717640974e-07, 'epoch': 2.95}

 18%|█▊        | 68520/371472 [5:26:57<24:09:55,  3.48it/s]
 18%|█▊        | 68521/371472 [5:26:57<23:40:13,  3.56it/s]
 18%|█▊        | 68522/371472 [5:26:57<24:12:29,  3.48it/s]
 18%|█▊        | 68523/371472 [5:26:58<24:00:57,  3.50it/s]
 18%|█▊        | 68524/371472 [5:26:58<23:20:48,  3.60it/s]
 18%|█▊        | 68525/371472 [5:26:58<24:01:37,  3.50it/s]
 18%|█▊        | 68526/371472 [5:26:58<23:52:06,  3.53it/s]
 18%|█▊        | 68527/371472 [5:26:59<24:58:38,  3.37it/s]
 18%|█▊        | 68528/371472 [5:26:59<24:25:31,  3.45it/s]
 18%|█▊        | 68529/371472 [5:26:59<23:15:08,  3.62it/s]
 18%|█▊        | 68530/371472 [5:27:00<22:18:19,  3.77it/s]
 18%|█▊        | 68531/371472 [5:27:00<22:31:06,  3.74it/s]
 18%|█▊        | 68532/371472 [5:27:00<22:12:19,  3.79it/s]
 18%|█▊        | 68533/371472 [5:27:00<24:10:57,  3.48it/s]
 18%|█▊        | 68534/371472 [5:27:01<24:53:14,  3.38it/s]
 18%|█▊        | 68535/371472 [5:27:01<24:31:28,  3.43it/s]
 18%|█▊        | 68536/371472 [5:27:01<23:57:14,  3.51it/s]
 18%|█▊        | 68537/371472 [5:27:02<23:03:32,  3.65it/s]
 18%|█▊        | 68538/371472 [5:27:02<23:15:30,  3.62it/s]
 18%|█▊        | 68539/371472 [5:27:02<23:24:19,  3.60it/s]
 18%|█▊        | 68540/371472 [5:27:02<26:09:26,  3.22it/s]
                                                           
{'loss': 4.0958, 'learning_rate': 8.343370897886186e-07, 'epoch': 2.95}

 18%|█▊        | 68540/371472 [5:27:02<26:09:26,  3.22it/s]
 18%|█▊        | 68541/371472 [5:27:03<24:43:05,  3.40it/s]
 18%|█▊        | 68542/371472 [5:27:03<25:07:56,  3.35it/s]
 18%|█▊        | 68543/371472 [5:27:03<25:11:05,  3.34it/s]
 18%|█▊        | 68544/371472 [5:27:04<23:56:12,  3.52it/s]
 18%|█▊        | 68545/371472 [5:27:04<23:20:36,  3.60it/s]
 18%|█▊        | 68546/371472 [5:27:04<22:34:40,  3.73it/s]
 18%|█▊        | 68547/371472 [5:27:04<22:28:47,  3.74it/s]
 18%|█▊        | 68548/371472 [5:27:05<23:21:27,  3.60it/s]
 18%|█▊        | 68549/371472 [5:27:05<24:18:36,  3.46it/s]
 18%|█▊        | 68550/371472 [5:27:05<22:53:38,  3.68it/s]
 18%|█▊        | 68551/371472 [5:27:05<22:39:54,  3.71it/s]
 18%|█▊        | 68552/371472 [5:27:06<22:06:44,  3.81it/s]
 18%|█▊        | 68553/371472 [5:27:06<21:51:48,  3.85it/s]
 18%|█▊        | 68554/371472 [5:27:06<22:50:39,  3.68it/s]
 18%|█▊        | 68555/371472 [5:27:07<22:14:35,  3.78it/s]
 18%|█▊        | 68556/371472 [5:27:07<22:10:12,  3.80it/s]
 18%|█▊        | 68557/371472 [5:27:07<21:28:08,  3.92it/s]
 18%|█▊        | 68558/371472 [5:27:07<22:04:52,  3.81it/s]
 18%|█▊        | 68559/371472 [5:27:08<22:10:13,  3.80it/s]
 18%|█▊        | 68560/371472 [5:27:08<22:35:24,  3.72it/s]
                                                           
{'loss': 4.3868, 'learning_rate': 8.342886078131397e-07, 'epoch': 2.95}

 18%|█▊        | 68560/371472 [5:27:08<22:35:24,  3.72it/s]
 18%|█▊        | 68561/371472 [5:27:08<24:17:51,  3.46it/s]
 18%|█▊        | 68562/371472 [5:27:08<24:46:52,  3.40it/s]
 18%|█▊        | 68563/371472 [5:27:09<23:45:51,  3.54it/s]
 18%|█▊        | 68564/371472 [5:27:09<23:44:42,  3.54it/s]
 18%|█▊        | 68565/371472 [5:27:09<25:29:42,  3.30it/s]
 18%|█▊        | 68566/371472 [5:27:10<25:19:41,  3.32it/s]
 18%|█▊        | 68567/371472 [5:27:10<26:37:46,  3.16it/s]
 18%|█▊        | 68568/371472 [5:27:10<27:13:16,  3.09it/s]
 18%|█▊        | 68569/371472 [5:27:11<26:08:24,  3.22it/s]
 18%|█▊        | 68570/371472 [5:27:11<25:17:50,  3.33it/s]
 18%|█▊        | 68571/371472 [5:27:11<25:17:55,  3.33it/s]
 18%|█▊        | 68572/371472 [5:27:11<24:43:11,  3.40it/s]
 18%|█▊        | 68573/371472 [5:27:12<24:24:49,  3.45it/s]
 18%|█▊        | 68574/371472 [5:27:12<25:04:20,  3.36it/s]
 18%|█▊        | 68575/371472 [5:27:12<24:42:23,  3.41it/s]
 18%|█▊        | 68576/371472 [5:27:13<26:36:35,  3.16it/s]
 18%|█▊        | 68577/371472 [5:27:13<25:32:35,  3.29it/s]
 18%|█▊        | 68578/371472 [5:27:13<25:14:38,  3.33it/s]
 18%|█▊        | 68579/371472 [5:27:14<24:39:04,  3.41it/s]
 18%|█▊        | 68580/371472 [5:27:14<23:55:00,  3.52it/s]
                                                           
{'loss': 4.2354, 'learning_rate': 8.342401258376608e-07, 'epoch': 2.95}

 18%|█▊        | 68580/371472 [5:27:14<23:55:00,  3.52it/s]
 18%|█▊        | 68581/371472 [5:27:14<22:47:23,  3.69it/s]
 18%|█▊        | 68582/371472 [5:27:14<24:24:40,  3.45it/s]
 18%|█▊        | 68583/371472 [5:27:15<23:40:41,  3.55it/s]
 18%|█▊        | 68584/371472 [5:27:15<23:01:21,  3.65it/s]
 18%|█▊        | 68585/371472 [5:27:15<22:31:45,  3.73it/s]
 18%|█▊        | 68586/371472 [5:27:15<22:06:30,  3.81it/s]
 18%|█▊        | 68587/371472 [5:27:16<24:24:58,  3.45it/s]
 18%|█▊        | 68588/371472 [5:27:16<24:21:24,  3.45it/s]
 18%|█▊        | 68589/371472 [5:27:16<23:01:35,  3.65it/s]
 18%|█▊        | 68590/371472 [5:27:17<22:18:01,  3.77it/s]
 18%|█▊        | 68591/371472 [5:27:17<22:31:08,  3.74it/s]
 18%|█▊        | 68592/371472 [5:27:17<22:20:52,  3.76it/s]
 18%|█▊        | 68593/371472 [5:27:17<23:45:00,  3.54it/s]
 18%|█▊        | 68594/371472 [5:27:18<23:38:37,  3.56it/s]
 18%|█▊        | 68595/371472 [5:27:18<23:35:25,  3.57it/s]
 18%|█▊        | 68596/371472 [5:27:18<25:09:33,  3.34it/s]
 18%|█▊        | 68597/371472 [5:27:19<24:08:37,  3.48it/s]
 18%|█▊        | 68598/371472 [5:27:19<24:16:24,  3.47it/s]
 18%|█▊        | 68599/371472 [5:27:19<23:31:47,  3.58it/s]
 18%|█▊        | 68600/371472 [5:27:19<23:07:34,  3.64it/s]
                                                           
{'loss': 4.3807, 'learning_rate': 8.341916438621818e-07, 'epoch': 2.95}

 18%|█▊        | 68600/371472 [5:27:19<23:07:34,  3.64it/s]
 18%|█▊        | 68601/371472 [5:27:20<22:25:03,  3.75it/s]
 18%|█▊        | 68602/371472 [5:27:20<22:31:49,  3.73it/s]
 18%|█▊        | 68603/371472 [5:27:20<24:25:53,  3.44it/s]
 18%|█▊        | 68604/371472 [5:27:21<23:56:19,  3.51it/s]
 18%|█▊        | 68605/371472 [5:27:21<23:05:49,  3.64it/s]
 18%|█▊        | 68606/371472 [5:27:21<24:16:22,  3.47it/s]
 18%|█▊        | 68607/371472 [5:27:21<23:28:07,  3.58it/s]
 18%|█▊        | 68608/371472 [5:27:22<23:41:09,  3.55it/s]
 18%|█▊        | 68609/371472 [5:27:22<24:22:40,  3.45it/s]
 18%|█▊        | 68610/371472 [5:27:22<23:14:57,  3.62it/s]
 18%|█▊        | 68611/371472 [5:27:22<22:55:27,  3.67it/s]
 18%|█▊        | 68612/371472 [5:27:23<22:51:28,  3.68it/s]
 18%|█▊        | 68613/371472 [5:27:23<23:16:32,  3.61it/s]
 18%|█▊        | 68614/371472 [5:27:23<23:34:35,  3.57it/s]
 18%|█▊        | 68615/371472 [5:27:24<23:20:35,  3.60it/s]
 18%|█▊        | 68616/371472 [5:27:24<23:12:35,  3.62it/s]
 18%|█▊        | 68617/371472 [5:27:24<24:07:15,  3.49it/s]
 18%|█▊        | 68618/371472 [5:27:25<25:22:45,  3.31it/s]
 18%|█▊        | 68619/371472 [5:27:25<24:29:44,  3.43it/s]
 18%|█▊        | 68620/371472 [5:27:25<23:51:30,  3.53it/s]
                                                           
{'loss': 4.1667, 'learning_rate': 8.34143161886703e-07, 'epoch': 2.96}

 18%|█▊        | 68620/371472 [5:27:25<23:51:30,  3.53it/s]
 18%|█▊        | 68621/371472 [5:27:25<22:50:18,  3.68it/s]
 18%|█▊        | 68622/371472 [5:27:26<22:49:03,  3.69it/s]
 18%|█▊        | 68623/371472 [5:27:26<22:11:12,  3.79it/s]
 18%|█▊        | 68624/371472 [5:27:26<23:20:30,  3.60it/s]
 18%|█▊        | 68625/371472 [5:27:26<22:25:52,  3.75it/s]
 18%|█▊        | 68626/371472 [5:27:27<22:34:23,  3.73it/s]
 18%|█▊        | 68627/371472 [5:27:27<23:54:54,  3.52it/s]
 18%|█▊        | 68628/371472 [5:27:27<24:52:32,  3.38it/s]
 18%|█▊        | 68629/371472 [5:27:28<23:45:31,  3.54it/s]
 18%|█▊        | 68630/371472 [5:27:28<28:11:40,  2.98it/s]
 18%|█▊        | 68631/371472 [5:27:28<27:00:35,  3.11it/s]
 18%|█▊        | 68632/371472 [5:27:29<25:57:43,  3.24it/s]
 18%|█▊        | 68633/371472 [5:27:29<25:06:31,  3.35it/s]
 18%|█▊        | 68634/371472 [5:27:29<28:08:45,  2.99it/s]
 18%|█▊        | 68635/371472 [5:27:30<26:38:19,  3.16it/s]
 18%|█▊        | 68636/371472 [5:27:30<27:13:32,  3.09it/s]
 18%|█▊        | 68637/371472 [5:27:30<28:25:39,  2.96it/s]
 18%|█▊        | 68638/371472 [5:27:30<25:42:09,  3.27it/s]
 18%|█▊        | 68639/371472 [5:27:31<24:43:02,  3.40it/s]
 18%|█▊        | 68640/371472 [5:27:31<24:04:48,  3.49it/s]
                                                           
{'loss': 4.0863, 'learning_rate': 8.340946799112241e-07, 'epoch': 2.96}

 18%|█▊        | 68640/371472 [5:27:31<24:04:48,  3.49it/s]
 18%|█▊        | 68641/371472 [5:27:31<23:36:50,  3.56it/s]
 18%|█▊        | 68642/371472 [5:27:32<22:52:06,  3.68it/s]
 18%|█▊        | 68643/371472 [5:27:32<24:47:48,  3.39it/s]
 18%|█▊        | 68644/371472 [5:27:32<25:44:19,  3.27it/s]
 18%|█▊        | 68645/371472 [5:27:32<25:19:43,  3.32it/s]
 18%|█▊        | 68646/371472 [5:27:33<26:54:28,  3.13it/s]
 18%|█▊        | 68647/371472 [5:27:33<26:32:27,  3.17it/s]
 18%|█▊        | 68648/371472 [5:27:33<24:58:29,  3.37it/s]
 18%|█▊        | 68649/371472 [5:27:34<23:42:20,  3.55it/s]
 18%|█▊        | 68650/371472 [5:27:34<23:10:57,  3.63it/s]
 18%|█▊        | 68651/371472 [5:27:34<23:16:49,  3.61it/s]
 18%|█▊        | 68652/371472 [5:27:34<22:54:19,  3.67it/s]
 18%|█▊        | 68653/371472 [5:27:35<23:04:49,  3.64it/s]
 18%|█▊        | 68654/371472 [5:27:35<22:25:51,  3.75it/s]
 18%|█▊        | 68655/371472 [5:27:35<22:30:33,  3.74it/s]
 18%|█▊        | 68656/371472 [5:27:36<22:47:38,  3.69it/s]
 18%|█▊        | 68657/371472 [5:27:36<22:22:35,  3.76it/s]
 18%|█▊        | 68658/371472 [5:27:36<23:59:16,  3.51it/s]
 18%|█▊        | 68659/371472 [5:27:36<24:12:24,  3.47it/s]
 18%|█▊        | 68660/371472 [5:27:37<25:45:14,  3.27it/s]
                                                           
{'loss': 4.1569, 'learning_rate': 8.340461979357452e-07, 'epoch': 2.96}

 18%|█▊        | 68660/371472 [5:27:37<25:45:14,  3.27it/s]
 18%|█▊        | 68661/371472 [5:27:37<25:11:57,  3.34it/s]
 18%|█▊        | 68662/371472 [5:27:37<24:14:17,  3.47it/s]
 18%|█▊        | 68663/371472 [5:27:38<23:28:37,  3.58it/s]
 18%|█▊        | 68664/371472 [5:27:38<25:37:10,  3.28it/s]
 18%|█▊        | 68665/371472 [5:27:38<25:11:19,  3.34it/s]
 18%|█▊        | 68666/371472 [5:27:39<25:37:52,  3.28it/s]
 18%|█▊        | 68667/371472 [5:27:39<26:05:43,  3.22it/s]
 18%|█▊        | 68668/371472 [5:27:39<25:19:50,  3.32it/s]
 18%|█▊        | 68669/371472 [5:27:39<23:32:32,  3.57it/s]
 18%|█▊        | 68670/371472 [5:27:40<24:22:41,  3.45it/s]
 18%|█▊        | 68671/371472 [5:27:40<26:20:12,  3.19it/s]
 18%|█▊        | 68672/371472 [5:27:40<26:17:27,  3.20it/s]
 18%|█▊        | 68673/371472 [5:27:41<26:04:32,  3.23it/s]
 18%|█▊        | 68674/371472 [5:27:41<26:57:39,  3.12it/s]
 18%|█▊        | 68675/371472 [5:27:41<26:03:19,  3.23it/s]
 18%|█▊        | 68676/371472 [5:27:42<24:53:47,  3.38it/s]
 18%|█▊        | 68677/371472 [5:27:42<25:03:44,  3.36it/s]
 18%|█▊        | 68678/371472 [5:27:42<24:01:25,  3.50it/s]
 18%|█▊        | 68679/371472 [5:27:42<23:01:57,  3.65it/s]
 18%|█▊        | 68680/371472 [5:27:43<23:04:32,  3.64it/s]
                                                           
{'loss': 4.1465, 'learning_rate': 8.339977159602663e-07, 'epoch': 2.96}

 18%|█▊        | 68680/371472 [5:27:43<23:04:32,  3.64it/s]
 18%|█▊        | 68681/371472 [5:27:43<23:08:16,  3.64it/s]
 18%|█▊        | 68682/371472 [5:27:43<23:21:43,  3.60it/s]
 18%|█▊        | 68683/371472 [5:27:43<23:08:28,  3.63it/s]
 18%|█▊        | 68684/371472 [5:27:44<23:05:13,  3.64it/s]
 18%|█▊        | 68685/371472 [5:27:44<22:44:57,  3.70it/s]
 18%|█▊        | 68686/371472 [5:27:44<22:27:34,  3.74it/s]
 18%|█▊        | 68687/371472 [5:27:45<23:37:22,  3.56it/s]
 18%|█▊        | 68688/371472 [5:27:45<24:32:45,  3.43it/s]
 18%|█▊        | 68689/371472 [5:27:45<23:12:11,  3.62it/s]
 18%|█▊        | 68690/371472 [5:27:45<22:57:16,  3.66it/s]
 18%|█▊        | 68691/371472 [5:27:46<23:00:22,  3.66it/s]
 18%|█▊        | 68692/371472 [5:27:46<22:08:01,  3.80it/s]
 18%|█▊        | 68693/371472 [5:27:46<22:21:33,  3.76it/s]
 18%|█▊        | 68694/371472 [5:27:46<22:05:12,  3.81it/s]
 18%|█▊        | 68695/371472 [5:27:47<24:14:58,  3.47it/s]
 18%|█▊        | 68696/371472 [5:27:47<26:30:25,  3.17it/s]
 18%|█▊        | 68697/371472 [5:27:47<25:18:47,  3.32it/s]
 18%|█▊        | 68698/371472 [5:27:48<26:48:33,  3.14it/s]
 18%|█▊        | 68699/371472 [5:27:48<25:12:23,  3.34it/s]
 18%|█▊        | 68700/371472 [5:27:48<24:21:57,  3.45it/s]
                                                           
{'loss': 4.0999, 'learning_rate': 8.339492339847874e-07, 'epoch': 2.96}

 18%|█▊        | 68700/371472 [5:27:48<24:21:57,  3.45it/s]
 18%|█▊        | 68701/371472 [5:27:49<24:22:42,  3.45it/s]
 18%|█▊        | 68702/371472 [5:27:49<23:43:28,  3.54it/s]
 18%|█▊        | 68703/371472 [5:27:49<24:07:21,  3.49it/s]
 18%|█▊        | 68704/371472 [5:27:49<23:37:58,  3.56it/s]
 18%|█▊        | 68705/371472 [5:27:50<23:24:50,  3.59it/s]
 18%|█▊        | 68706/371472 [5:27:50<22:46:40,  3.69it/s]
 18%|█▊        | 68707/371472 [5:27:50<22:27:46,  3.74it/s]
 18%|█▊        | 68708/371472 [5:27:51<25:42:33,  3.27it/s]
 18%|█▊        | 68709/371472 [5:27:51<24:23:27,  3.45it/s]
 18%|█▊        | 68710/371472 [5:27:51<25:04:28,  3.35it/s]
 18%|█▊        | 68711/371472 [5:27:51<23:36:44,  3.56it/s]
 18%|█▊        | 68712/371472 [5:27:52<23:29:52,  3.58it/s]
 18%|█▊        | 68713/371472 [5:27:52<25:11:03,  3.34it/s]
 18%|█▊        | 68714/371472 [5:27:52<24:20:45,  3.45it/s]
 18%|█▊        | 68715/371472 [5:27:53<23:39:05,  3.56it/s]
 18%|█▊        | 68716/371472 [5:27:53<24:50:53,  3.38it/s]
 18%|█▊        | 68717/371472 [5:27:53<24:50:31,  3.39it/s]
 18%|█▊        | 68718/371472 [5:27:53<23:54:46,  3.52it/s]
 18%|█▊        | 68719/371472 [5:27:54<24:27:43,  3.44it/s]
 18%|█▊        | 68720/371472 [5:27:54<24:48:15,  3.39it/s]
                                                           
{'loss': 4.0144, 'learning_rate': 8.339007520093085e-07, 'epoch': 2.96}

 18%|█▊        | 68720/371472 [5:27:54<24:48:15,  3.39it/s]
 18%|█▊        | 68721/371472 [5:27:54<24:24:59,  3.44it/s]
 18%|█▊        | 68722/371472 [5:27:55<27:03:16,  3.11it/s]
 19%|█▊        | 68723/371472 [5:27:55<25:51:25,  3.25it/s]
 19%|█▊        | 68724/371472 [5:27:55<24:41:18,  3.41it/s]
 19%|█▊        | 68725/371472 [5:27:56<24:31:02,  3.43it/s]
 19%|█▊        | 68726/371472 [5:27:56<23:48:44,  3.53it/s]
 19%|█▊        | 68727/371472 [5:27:56<23:37:45,  3.56it/s]
 19%|█▊        | 68728/371472 [5:27:56<23:23:41,  3.59it/s]
 19%|█▊        | 68729/371472 [5:27:57<22:57:04,  3.66it/s]
 19%|█▊        | 68730/371472 [5:27:57<22:22:57,  3.76it/s]
 19%|█▊        | 68731/371472 [5:27:57<23:02:49,  3.65it/s]
 19%|█▊        | 68732/371472 [5:27:57<22:59:04,  3.66it/s]
 19%|█▊        | 68733/371472 [5:27:58<22:38:40,  3.71it/s]
 19%|█▊        | 68734/371472 [5:27:58<22:40:42,  3.71it/s]
 19%|█▊        | 68735/371472 [5:27:58<23:01:13,  3.65it/s]
 19%|█▊        | 68736/371472 [5:27:59<23:00:14,  3.66it/s]
 19%|█▊        | 68737/371472 [5:27:59<22:05:45,  3.81it/s]
 19%|█▊        | 68738/371472 [5:27:59<22:22:05,  3.76it/s]
 19%|█▊        | 68739/371472 [5:27:59<22:43:39,  3.70it/s]
 19%|█▊        | 68740/371472 [5:28:00<22:22:44,  3.76it/s]
                                                           
{'loss': 3.8672, 'learning_rate': 8.338522700338296e-07, 'epoch': 2.96}

 19%|█▊        | 68740/371472 [5:28:00<22:22:44,  3.76it/s]
 19%|█▊        | 68741/371472 [5:28:00<21:57:49,  3.83it/s]
 19%|█▊        | 68742/371472 [5:28:00<21:49:05,  3.85it/s]
 19%|█▊        | 68743/371472 [5:28:00<23:01:27,  3.65it/s]
 19%|█▊        | 68744/371472 [5:28:01<24:15:21,  3.47it/s]
 19%|█▊        | 68745/371472 [5:28:01<23:14:50,  3.62it/s]
 19%|█▊        | 68746/371472 [5:28:01<22:34:53,  3.72it/s]
 19%|█▊        | 68747/371472 [5:28:01<23:04:22,  3.64it/s]
 19%|█▊        | 68748/371472 [5:28:02<23:07:15,  3.64it/s]
 19%|█▊        | 68749/371472 [5:28:02<23:57:16,  3.51it/s]
 19%|█▊        | 68750/371472 [5:28:02<24:25:13,  3.44it/s]
 19%|█▊        | 68751/371472 [5:28:03<23:35:15,  3.56it/s]
 19%|█▊        | 68752/371472 [5:28:03<22:56:53,  3.66it/s]
 19%|█▊        | 68753/371472 [5:28:03<22:45:47,  3.69it/s]
 19%|█▊        | 68754/371472 [5:28:03<23:46:53,  3.54it/s]
 19%|█▊        | 68755/371472 [5:28:04<23:42:33,  3.55it/s]
 19%|█▊        | 68756/371472 [5:28:04<24:33:16,  3.42it/s]
 19%|█▊        | 68757/371472 [5:28:04<25:49:11,  3.26it/s]
 19%|█▊        | 68758/371472 [5:28:05<25:57:54,  3.24it/s]
 19%|█▊        | 68759/371472 [5:28:05<27:12:37,  3.09it/s]
 19%|█▊        | 68760/371472 [5:28:05<26:11:59,  3.21it/s]
                                                           
{'loss': 4.0771, 'learning_rate': 8.338037880583507e-07, 'epoch': 2.96}

 19%|█▊        | 68760/371472 [5:28:05<26:11:59,  3.21it/s]
 19%|█▊        | 68761/371472 [5:28:06<25:13:38,  3.33it/s]
 19%|█▊        | 68762/371472 [5:28:06<24:47:17,  3.39it/s]
 19%|█▊        | 68763/371472 [5:28:06<24:08:15,  3.48it/s]
 19%|█▊        | 68764/371472 [5:28:06<24:04:05,  3.49it/s]
 19%|█▊        | 68765/371472 [5:28:07<23:08:13,  3.63it/s]
 19%|█▊        | 68766/371472 [5:28:07<23:34:19,  3.57it/s]
 19%|█▊        | 68767/371472 [5:28:07<24:06:45,  3.49it/s]
 19%|█▊        | 68768/371472 [5:28:08<24:40:44,  3.41it/s]
 19%|█▊        | 68769/371472 [5:28:08<23:38:56,  3.56it/s]
 19%|█▊        | 68770/371472 [5:28:08<23:16:23,  3.61it/s]
 19%|█▊        | 68771/371472 [5:28:08<22:50:46,  3.68it/s]
 19%|█▊        | 68772/371472 [5:28:09<24:10:41,  3.48it/s]
 19%|█▊        | 68773/371472 [5:28:09<23:34:45,  3.57it/s]
 19%|█▊        | 68774/371472 [5:28:09<23:16:45,  3.61it/s]
 19%|█▊        | 68775/371472 [5:28:10<23:23:48,  3.59it/s]
 19%|█▊        | 68776/371472 [5:28:10<23:14:51,  3.62it/s]
 19%|█▊        | 68777/371472 [5:28:10<23:01:25,  3.65it/s]
 19%|█▊        | 68778/371472 [5:28:10<22:19:58,  3.76it/s]
 19%|█▊        | 68779/371472 [5:28:11<22:54:08,  3.67it/s]
 19%|█▊        | 68780/371472 [5:28:11<22:30:59,  3.73it/s]
                                                           
{'loss': 4.144, 'learning_rate': 8.337553060828718e-07, 'epoch': 2.96}

 19%|█▊        | 68780/371472 [5:28:11<22:30:59,  3.73it/s]
 19%|█▊        | 68781/371472 [5:28:11<23:02:15,  3.65it/s]
 19%|█▊        | 68782/371472 [5:28:11<22:40:20,  3.71it/s]
 19%|█▊        | 68783/371472 [5:28:12<22:42:42,  3.70it/s]
 19%|█▊        | 68784/371472 [5:28:12<23:09:10,  3.63it/s]
 19%|█▊        | 68785/371472 [5:28:12<22:37:53,  3.72it/s]
 19%|█▊        | 68786/371472 [5:28:13<23:02:24,  3.65it/s]
 19%|█▊        | 68787/371472 [5:28:13<24:00:23,  3.50it/s]
 19%|█▊        | 68788/371472 [5:28:13<23:25:28,  3.59it/s]
 19%|█▊        | 68789/371472 [5:28:13<23:36:09,  3.56it/s]
 19%|█▊        | 68790/371472 [5:28:14<23:18:49,  3.61it/s]
 19%|█▊        | 68791/371472 [5:28:14<22:55:47,  3.67it/s]
 19%|█▊        | 68792/371472 [5:28:14<23:10:58,  3.63it/s]
 19%|█▊        | 68793/371472 [5:28:14<22:27:08,  3.74it/s]
 19%|█▊        | 68794/371472 [5:28:15<23:28:41,  3.58it/s]
 19%|█▊        | 68795/371472 [5:28:15<24:03:22,  3.50it/s]
 19%|█▊        | 68796/371472 [5:28:15<25:52:30,  3.25it/s]
 19%|█▊        | 68797/371472 [5:28:16<24:21:19,  3.45it/s]
 19%|█▊        | 68798/371472 [5:28:16<23:19:18,  3.61it/s]
 19%|█▊        | 68799/371472 [5:28:16<23:09:29,  3.63it/s]
 19%|█▊        | 68800/371472 [5:28:16<22:22:56,  3.76it/s]
                                                           
{'loss': 3.9042, 'learning_rate': 8.337068241073929e-07, 'epoch': 2.96}

 19%|█▊        | 68800/371472 [5:28:16<22:22:56,  3.76it/s]
 19%|█▊        | 68801/371472 [5:28:17<22:15:13,  3.78it/s]
 19%|█▊        | 68802/371472 [5:28:17<25:15:59,  3.33it/s]
 19%|█▊        | 68803/371472 [5:28:17<23:36:02,  3.56it/s]
 19%|█▊        | 68804/371472 [5:28:18<24:06:53,  3.49it/s]
 19%|█▊        | 68805/371472 [5:28:18<22:39:01,  3.71it/s]
 19%|█▊        | 68806/371472 [5:28:18<22:21:58,  3.76it/s]
 19%|█▊        | 68807/371472 [5:28:18<24:54:51,  3.37it/s]
 19%|█▊        | 68808/371472 [5:28:19<26:12:38,  3.21it/s]
 19%|█▊        | 68809/371472 [5:28:19<24:13:00,  3.47it/s]
 19%|█▊        | 68810/371472 [5:28:19<23:31:36,  3.57it/s]
 19%|█▊        | 68811/371472 [5:28:20<23:40:27,  3.55it/s]
 19%|█▊        | 68812/371472 [5:28:20<23:18:48,  3.61it/s]
 19%|█▊        | 68813/371472 [5:28:20<25:46:27,  3.26it/s]
 19%|█▊        | 68814/371472 [5:28:21<25:07:54,  3.35it/s]
 19%|█▊        | 68815/371472 [5:28:21<24:33:23,  3.42it/s]
 19%|█▊        | 68816/371472 [5:28:21<24:46:51,  3.39it/s]
 19%|█▊        | 68817/371472 [5:28:21<23:44:16,  3.54it/s]
 19%|█▊        | 68818/371472 [5:28:22<23:53:14,  3.52it/s]
 19%|█▊        | 68819/371472 [5:28:22<24:33:40,  3.42it/s]
 19%|█▊        | 68820/371472 [5:28:22<24:17:44,  3.46it/s]
                                                           
{'loss': 4.2654, 'learning_rate': 8.336583421319141e-07, 'epoch': 2.96}

 19%|█▊        | 68820/371472 [5:28:22<24:17:44,  3.46it/s]
 19%|█▊        | 68821/371472 [5:28:23<24:37:47,  3.41it/s]
 19%|█▊        | 68822/371472 [5:28:23<23:57:45,  3.51it/s]
 19%|█▊        | 68823/371472 [5:28:23<23:34:09,  3.57it/s]
 19%|█▊        | 68824/371472 [5:28:23<22:39:19,  3.71it/s]
 19%|█▊        | 68825/371472 [5:28:24<22:04:29,  3.81it/s]
 19%|█▊        | 68826/371472 [5:28:24<22:04:37,  3.81it/s]
 19%|█▊        | 68827/371472 [5:28:24<24:48:22,  3.39it/s]
 19%|█▊        | 68828/371472 [5:28:25<25:58:13,  3.24it/s]
 19%|█▊        | 68829/371472 [5:28:25<24:44:04,  3.40it/s]
 19%|█▊        | 68830/371472 [5:28:25<23:12:49,  3.62it/s]
 19%|█▊        | 68831/371472 [5:28:25<23:55:54,  3.51it/s]
 19%|█▊        | 68832/371472 [5:28:26<24:38:10,  3.41it/s]
 19%|█▊        | 68833/371472 [5:28:26<26:14:39,  3.20it/s]
 19%|█▊        | 68834/371472 [5:28:26<24:46:24,  3.39it/s]
 19%|█▊        | 68835/371472 [5:28:26<23:19:48,  3.60it/s]
 19%|█▊        | 68836/371472 [5:28:27<23:48:00,  3.53it/s]
 19%|█▊        | 68837/371472 [5:28:27<23:10:38,  3.63it/s]
 19%|█▊        | 68838/371472 [5:28:27<23:07:09,  3.64it/s]
 19%|█▊        | 68839/371472 [5:28:28<23:27:17,  3.58it/s]
 19%|█▊        | 68840/371472 [5:28:28<23:19:43,  3.60it/s]
                                                           
{'loss': 4.2632, 'learning_rate': 8.336098601564352e-07, 'epoch': 2.97}

 19%|█▊        | 68840/371472 [5:28:28<23:19:43,  3.60it/s]
 19%|█▊        | 68841/371472 [5:28:28<23:31:29,  3.57it/s]
 19%|█▊        | 68842/371472 [5:28:28<23:06:01,  3.64it/s]
 19%|█▊        | 68843/371472 [5:28:29<24:46:34,  3.39it/s]
 19%|█▊        | 68844/371472 [5:28:29<25:57:07,  3.24it/s]
 19%|█▊        | 68845/371472 [5:28:29<25:20:06,  3.32it/s]
 19%|█▊        | 68846/371472 [5:28:30<25:06:37,  3.35it/s]
 19%|█▊        | 68847/371472 [5:28:30<24:02:11,  3.50it/s]
 19%|█▊        | 68848/371472 [5:28:30<24:03:11,  3.49it/s]
 19%|█▊        | 68849/371472 [5:28:31<24:09:23,  3.48it/s]
 19%|█▊        | 68850/371472 [5:28:31<23:44:22,  3.54it/s]
 19%|█▊        | 68851/371472 [5:28:31<23:03:57,  3.64it/s]
 19%|█▊        | 68852/371472 [5:28:31<23:27:17,  3.58it/s]
 19%|█▊        | 68853/371472 [5:28:32<28:22:46,  2.96it/s]
 19%|█▊        | 68854/371472 [5:28:32<26:51:24,  3.13it/s]
 19%|█▊        | 68855/371472 [5:28:32<25:24:10,  3.31it/s]
 19%|█▊        | 68856/371472 [5:28:33<24:52:55,  3.38it/s]
 19%|█▊        | 68857/371472 [5:28:33<24:12:25,  3.47it/s]
 19%|█▊        | 68858/371472 [5:28:33<25:14:08,  3.33it/s]
 19%|█▊        | 68859/371472 [5:28:33<24:22:12,  3.45it/s]
 19%|█▊        | 68860/371472 [5:28:34<23:44:47,  3.54it/s]
                                                           
{'loss': 4.1627, 'learning_rate': 8.335613781809561e-07, 'epoch': 2.97}

 19%|█▊        | 68860/371472 [5:28:34<23:44:47,  3.54it/s]
 19%|█▊        | 68861/371472 [5:28:34<22:49:34,  3.68it/s]
 19%|█▊        | 68862/371472 [5:28:34<22:56:46,  3.66it/s]
 19%|█▊        | 68863/371472 [5:28:35<22:43:38,  3.70it/s]
 19%|█▊        | 68864/371472 [5:28:35<22:28:25,  3.74it/s]
 19%|█▊        | 68865/371472 [5:28:35<22:26:51,  3.74it/s]
 19%|█▊        | 68866/371472 [5:28:35<22:05:48,  3.80it/s]
 19%|█▊        | 68867/371472 [5:28:36<21:32:03,  3.90it/s]
 19%|█▊        | 68868/371472 [5:28:36<21:20:42,  3.94it/s]
 19%|█▊        | 68869/371472 [5:28:36<21:13:20,  3.96it/s]
 19%|█▊        | 68870/371472 [5:28:36<21:23:02,  3.93it/s]
 19%|█▊        | 68871/371472 [5:28:37<22:30:39,  3.73it/s]
 19%|█▊        | 68872/371472 [5:28:37<25:35:37,  3.28it/s]
 19%|█▊        | 68873/371472 [5:28:37<25:06:01,  3.35it/s]
 19%|█▊        | 68874/371472 [5:28:38<23:47:33,  3.53it/s]
 19%|█▊        | 68875/371472 [5:28:38<23:04:27,  3.64it/s]
 19%|█▊        | 68876/371472 [5:28:38<22:28:18,  3.74it/s]
 19%|█▊        | 68877/371472 [5:28:38<23:42:36,  3.55it/s]
 19%|█▊        | 68878/371472 [5:28:39<23:19:35,  3.60it/s]
 19%|█▊        | 68879/371472 [5:28:39<23:56:17,  3.51it/s]
 19%|█▊        | 68880/371472 [5:28:39<24:04:43,  3.49it/s]
                                                           
{'loss': 4.2268, 'learning_rate': 8.335128962054773e-07, 'epoch': 2.97}

 19%|█▊        | 68880/371472 [5:28:39<24:04:43,  3.49it/s]
 19%|█▊        | 68881/371472 [5:28:39<23:24:03,  3.59it/s]
 19%|█▊        | 68882/371472 [5:28:40<23:19:32,  3.60it/s]
 19%|█▊        | 68883/371472 [5:28:40<25:07:05,  3.35it/s]
 19%|█▊        | 68884/371472 [5:28:40<25:21:46,  3.31it/s]
 19%|█▊        | 68885/371472 [5:28:41<24:09:49,  3.48it/s]
 19%|█▊        | 68886/371472 [5:28:41<23:31:11,  3.57it/s]
 19%|█▊        | 68887/371472 [5:28:41<22:58:59,  3.66it/s]
 19%|█▊        | 68888/371472 [5:28:42<24:29:03,  3.43it/s]
 19%|█▊        | 68889/371472 [5:28:42<24:06:45,  3.49it/s]
 19%|█▊        | 68890/371472 [5:28:42<23:10:59,  3.63it/s]
 19%|█▊        | 68891/371472 [5:28:42<23:25:25,  3.59it/s]
 19%|█▊        | 68892/371472 [5:28:43<22:45:58,  3.69it/s]
 19%|█▊        | 68893/371472 [5:28:43<22:48:19,  3.69it/s]
 19%|█▊        | 68894/371472 [5:28:43<22:07:57,  3.80it/s]
 19%|█▊        | 68895/371472 [5:28:43<22:58:22,  3.66it/s]
 19%|█▊        | 68896/371472 [5:28:44<25:02:19,  3.36it/s]
 19%|█▊        | 68897/371472 [5:28:44<24:54:53,  3.37it/s]
 19%|█▊        | 68898/371472 [5:28:44<24:08:59,  3.48it/s]
 19%|█▊        | 68899/371472 [5:28:45<23:02:11,  3.65it/s]
 19%|█▊        | 68900/371472 [5:28:45<23:06:04,  3.64it/s]
                                                           
{'loss': 4.0903, 'learning_rate': 8.334644142299985e-07, 'epoch': 2.97}

 19%|█▊        | 68900/371472 [5:28:45<23:06:04,  3.64it/s]
 19%|█▊        | 68901/371472 [5:28:45<23:14:13,  3.62it/s]
 19%|█▊        | 68902/371472 [5:28:45<22:52:14,  3.67it/s]
 19%|█▊        | 68903/371472 [5:28:46<23:33:37,  3.57it/s]
 19%|█▊        | 68904/371472 [5:28:46<23:01:04,  3.65it/s]
 19%|█▊        | 68905/371472 [5:28:46<23:19:39,  3.60it/s]
 19%|█▊        | 68906/371472 [5:28:47<23:47:10,  3.53it/s]
 19%|█▊        | 68907/371472 [5:28:47<22:42:36,  3.70it/s]
 19%|█▊        | 68908/371472 [5:28:47<22:26:54,  3.74it/s]
 19%|█▊        | 68909/371472 [5:28:47<21:58:28,  3.82it/s]
 19%|█▊        | 68910/371472 [5:28:48<22:17:39,  3.77it/s]
 19%|█▊        | 68911/371472 [5:28:48<23:32:21,  3.57it/s]
 19%|█▊        | 68912/371472 [5:28:48<22:41:16,  3.70it/s]
 19%|█▊        | 68913/371472 [5:28:48<23:52:28,  3.52it/s]
 19%|█▊        | 68914/371472 [5:28:49<22:47:17,  3.69it/s]
 19%|█▊        | 68915/371472 [5:28:49<24:18:39,  3.46it/s]
 19%|█▊        | 68916/371472 [5:28:49<23:33:32,  3.57it/s]
 19%|█▊        | 68917/371472 [5:28:50<23:14:12,  3.62it/s]
 19%|█▊        | 68918/371472 [5:28:50<22:21:06,  3.76it/s]
 19%|█▊        | 68919/371472 [5:28:50<23:29:10,  3.58it/s]
 19%|█▊        | 68920/371472 [5:28:50<22:52:33,  3.67it/s]
                                                           
{'loss': 4.4831, 'learning_rate': 8.334159322545196e-07, 'epoch': 2.97}

 19%|█▊        | 68920/371472 [5:28:50<22:52:33,  3.67it/s]
 19%|█▊        | 68921/371472 [5:28:51<22:39:20,  3.71it/s]
 19%|█▊        | 68922/371472 [5:28:51<23:13:18,  3.62it/s]
 19%|█▊        | 68923/371472 [5:28:51<22:51:41,  3.68it/s]
 19%|█▊        | 68924/371472 [5:28:51<22:55:44,  3.67it/s]
 19%|█▊        | 68925/371472 [5:28:52<23:31:16,  3.57it/s]
 19%|█▊        | 68926/371472 [5:28:52<23:41:13,  3.55it/s]
 19%|█▊        | 68927/371472 [5:28:52<23:24:31,  3.59it/s]
 19%|█▊        | 68928/371472 [5:28:53<23:55:16,  3.51it/s]
 19%|█▊        | 68929/371472 [5:28:53<24:51:10,  3.38it/s]
 19%|█▊        | 68930/371472 [5:28:53<24:41:31,  3.40it/s]
 19%|█▊        | 68931/371472 [5:28:53<24:11:35,  3.47it/s]
 19%|█▊        | 68932/371472 [5:28:54<23:26:17,  3.59it/s]
 19%|█▊        | 68933/371472 [5:28:54<24:33:17,  3.42it/s]
 19%|█▊        | 68934/371472 [5:28:54<23:59:08,  3.50it/s]
 19%|█▊        | 68935/371472 [5:28:55<24:05:01,  3.49it/s]
 19%|█▊        | 68936/371472 [5:28:55<23:47:49,  3.53it/s]
 19%|█▊        | 68937/371472 [5:28:55<22:51:11,  3.68it/s]
 19%|█▊        | 68938/371472 [5:28:55<23:16:14,  3.61it/s]
 19%|█▊        | 68939/371472 [5:28:56<22:05:55,  3.80it/s]
 19%|█▊        | 68940/371472 [5:28:56<22:28:00,  3.74it/s]
                                                           
{'loss': 4.0449, 'learning_rate': 8.333674502790407e-07, 'epoch': 2.97}

 19%|█▊        | 68940/371472 [5:28:56<22:28:00,  3.74it/s]
 19%|█▊        | 68941/371472 [5:28:56<22:17:37,  3.77it/s]
 19%|█▊        | 68942/371472 [5:28:56<22:23:14,  3.75it/s]
 19%|█▊        | 68943/371472 [5:28:57<22:20:48,  3.76it/s]
 19%|█▊        | 68944/371472 [5:28:57<22:13:13,  3.78it/s]
 19%|█▊        | 68945/371472 [5:28:57<21:51:49,  3.84it/s]
 19%|█▊        | 68946/371472 [5:28:58<25:02:45,  3.36it/s]
 19%|█▊        | 68947/371472 [5:28:58<23:58:14,  3.51it/s]
 19%|█▊        | 68948/371472 [5:28:58<26:08:00,  3.22it/s]
 19%|█▊        | 68949/371472 [5:28:58<24:41:48,  3.40it/s]
 19%|█▊        | 68950/371472 [5:28:59<23:58:47,  3.50it/s]
 19%|█▊        | 68951/371472 [5:28:59<22:53:48,  3.67it/s]
 19%|█▊        | 68952/371472 [5:28:59<23:59:31,  3.50it/s]
 19%|█▊        | 68953/371472 [5:29:00<23:14:48,  3.61it/s]
 19%|█▊        | 68954/371472 [5:29:00<22:49:51,  3.68it/s]
 19%|█▊        | 68955/371472 [5:29:00<22:41:15,  3.70it/s]
 19%|█▊        | 68956/371472 [5:29:00<22:31:15,  3.73it/s]
 19%|█▊        | 68957/371472 [5:29:01<22:47:22,  3.69it/s]
 19%|█▊        | 68958/371472 [5:29:01<23:29:25,  3.58it/s]
 19%|█▊        | 68959/371472 [5:29:01<23:52:36,  3.52it/s]
 19%|█▊        | 68960/371472 [5:29:02<24:01:53,  3.50it/s]
                                                           
{'loss': 4.0883, 'learning_rate': 8.333189683035618e-07, 'epoch': 2.97}

 19%|█▊        | 68960/371472 [5:29:02<24:01:53,  3.50it/s]
 19%|█▊        | 68961/371472 [5:29:02<23:50:50,  3.52it/s]
 19%|█▊        | 68962/371472 [5:29:02<24:34:56,  3.42it/s]
 19%|█▊        | 68963/371472 [5:29:02<24:06:46,  3.48it/s]
 19%|█▊        | 68964/371472 [5:29:03<23:35:36,  3.56it/s]
 19%|█▊        | 68965/371472 [5:29:03<22:38:45,  3.71it/s]
 19%|█▊        | 68966/371472 [5:29:03<22:16:46,  3.77it/s]
 19%|█▊        | 68967/371472 [5:29:03<22:19:03,  3.77it/s]
 19%|█▊        | 68968/371472 [5:29:04<22:35:25,  3.72it/s]
 19%|█▊        | 68969/371472 [5:29:04<23:24:13,  3.59it/s]
 19%|█▊        | 68970/371472 [5:29:04<22:52:10,  3.67it/s]
 19%|█▊        | 68971/371472 [5:29:05<27:26:03,  3.06it/s]
 19%|█▊        | 68972/371472 [5:29:05<26:00:49,  3.23it/s]
 19%|█▊        | 68973/371472 [5:29:05<24:24:07,  3.44it/s]
 19%|█▊        | 68974/371472 [5:29:05<23:06:41,  3.64it/s]
 19%|█▊        | 68975/371472 [5:29:06<22:23:57,  3.75it/s]
 19%|█▊        | 68976/371472 [5:29:06<22:39:31,  3.71it/s]
 19%|█▊        | 68977/371472 [5:29:06<22:18:08,  3.77it/s]
 19%|█▊        | 68978/371472 [5:29:07<22:23:55,  3.75it/s]
 19%|█▊        | 68979/371472 [5:29:07<21:47:30,  3.86it/s]
 19%|█▊        | 68980/371472 [5:29:07<22:14:13,  3.78it/s]
                                                           
{'loss': 4.1052, 'learning_rate': 8.332704863280829e-07, 'epoch': 2.97}

 19%|█▊        | 68980/371472 [5:29:07<22:14:13,  3.78it/s]
 19%|█▊        | 68981/371472 [5:29:07<21:31:06,  3.90it/s]
 19%|█▊        | 68982/371472 [5:29:07<21:05:56,  3.98it/s]
 19%|█▊        | 68983/371472 [5:29:08<22:53:55,  3.67it/s]
 19%|█▊        | 68984/371472 [5:29:08<23:59:11,  3.50it/s]
 19%|█▊        | 68985/371472 [5:29:09<28:07:17,  2.99it/s]
 19%|█▊        | 68986/371472 [5:29:09<26:39:18,  3.15it/s]
 19%|█▊        | 68987/371472 [5:29:09<25:42:19,  3.27it/s]
 19%|█▊        | 68988/371472 [5:29:09<24:47:10,  3.39it/s]
 19%|█▊        | 68989/371472 [5:29:10<24:34:01,  3.42it/s]
 19%|█▊        | 68990/371472 [5:29:10<23:58:31,  3.50it/s]
 19%|█▊        | 68991/371472 [5:29:10<24:36:19,  3.41it/s]
 19%|█▊        | 68992/371472 [5:29:11<23:54:56,  3.51it/s]
 19%|█▊        | 68993/371472 [5:29:11<25:19:35,  3.32it/s]
 19%|█▊        | 68994/371472 [5:29:11<25:11:01,  3.34it/s]
 19%|█▊        | 68995/371472 [5:29:11<24:42:39,  3.40it/s]
 19%|█▊        | 68996/371472 [5:29:12<24:04:14,  3.49it/s]
 19%|█▊        | 68997/371472 [5:29:12<23:46:17,  3.53it/s]
 19%|█▊        | 68998/371472 [5:29:12<23:55:45,  3.51it/s]
 19%|█▊        | 68999/371472 [5:29:13<23:18:08,  3.61it/s]
 19%|█▊        | 69000/371472 [5:29:13<27:29:24,  3.06it/s]
                                                           
{'loss': 4.0703, 'learning_rate': 8.332220043526039e-07, 'epoch': 2.97}

 19%|█▊        | 69000/371472 [5:29:13<27:29:24,  3.06it/s]
 19%|█▊        | 69001/371472 [5:29:13<28:09:11,  2.98it/s]
 19%|█▊        | 69002/371472 [5:29:14<25:59:42,  3.23it/s]
 19%|█▊        | 69003/371472 [5:29:14<25:29:24,  3.30it/s]
 19%|█▊        | 69004/371472 [5:29:14<25:01:54,  3.36it/s]
 19%|█▊        | 69005/371472 [5:29:14<25:19:22,  3.32it/s]
 19%|█▊        | 69006/371472 [5:29:15<24:13:42,  3.47it/s]
 19%|█▊        | 69007/371472 [5:29:15<24:32:51,  3.42it/s]
 19%|█▊        | 69008/371472 [5:29:15<24:05:37,  3.49it/s]
 19%|█▊        | 69009/371472 [5:29:16<24:15:50,  3.46it/s]
 19%|█▊        | 69010/371472 [5:29:16<23:56:17,  3.51it/s]
 19%|█▊        | 69011/371472 [5:29:16<23:39:57,  3.55it/s]
 19%|█▊        | 69012/371472 [5:29:17<25:44:58,  3.26it/s]
 19%|█▊        | 69013/371472 [5:29:17<24:59:09,  3.36it/s]
 19%|█▊        | 69014/371472 [5:29:17<25:25:35,  3.30it/s]
 19%|█▊        | 69015/371472 [5:29:18<28:54:27,  2.91it/s]
 19%|█▊        | 69016/371472 [5:29:18<27:50:54,  3.02it/s]
 19%|█▊        | 69017/371472 [5:29:18<27:05:40,  3.10it/s]
 19%|█▊        | 69018/371472 [5:29:18<25:34:12,  3.29it/s]
 19%|█▊        | 69019/371472 [5:29:19<24:26:14,  3.44it/s]
 19%|█▊        | 69020/371472 [5:29:19<23:19:27,  3.60it/s]
                                                           
{'loss': 4.2334, 'learning_rate': 8.331735223771251e-07, 'epoch': 2.97}

 19%|█▊        | 69020/371472 [5:29:19<23:19:27,  3.60it/s]
 19%|█▊        | 69021/371472 [5:29:19<25:10:36,  3.34it/s]
 19%|█▊        | 69022/371472 [5:29:20<23:35:05,  3.56it/s]
 19%|█▊        | 69023/371472 [5:29:20<23:30:57,  3.57it/s]
 19%|█▊        | 69024/371472 [5:29:20<23:39:15,  3.55it/s]
 19%|█▊        | 69025/371472 [5:29:20<22:43:30,  3.70it/s]
 19%|█▊        | 69026/371472 [5:29:21<22:50:06,  3.68it/s]
 19%|█▊        | 69027/371472 [5:29:21<23:49:33,  3.53it/s]
 19%|█▊        | 69028/371472 [5:29:21<22:52:32,  3.67it/s]
 19%|█▊        | 69029/371472 [5:29:21<23:05:24,  3.64it/s]
 19%|█▊        | 69030/371472 [5:29:22<22:22:35,  3.75it/s]
 19%|█▊        | 69031/371472 [5:29:22<22:09:06,  3.79it/s]
 19%|█▊        | 69032/371472 [5:29:22<21:47:25,  3.86it/s]
 19%|█▊        | 69033/371472 [5:29:23<24:21:34,  3.45it/s]
 19%|█▊        | 69034/371472 [5:29:23<25:05:28,  3.35it/s]
 19%|█▊        | 69035/371472 [5:29:23<23:55:07,  3.51it/s]
 19%|█▊        | 69036/371472 [5:29:23<23:24:05,  3.59it/s]
 19%|█▊        | 69037/371472 [5:29:24<22:50:55,  3.68it/s]
 19%|█▊        | 69038/371472 [5:29:24<22:01:20,  3.81it/s]
 19%|█▊        | 69039/371472 [5:29:24<22:31:30,  3.73it/s]
 19%|█▊        | 69040/371472 [5:29:24<21:59:39,  3.82it/s]
                                                           
{'loss': 4.1308, 'learning_rate': 8.331250404016462e-07, 'epoch': 2.97}

 19%|█▊        | 69040/371472 [5:29:24<21:59:39,  3.82it/s]
 19%|█▊        | 69041/371472 [5:29:25<24:11:27,  3.47it/s]
 19%|█▊        | 69042/371472 [5:29:25<25:30:25,  3.29it/s]
 19%|█▊        | 69043/371472 [5:29:25<24:18:45,  3.46it/s]
 19%|█▊        | 69044/371472 [5:29:26<24:06:09,  3.49it/s]
 19%|█▊        | 69045/371472 [5:29:26<23:59:55,  3.50it/s]
 19%|█▊        | 69046/371472 [5:29:26<23:10:11,  3.63it/s]
 19%|█▊        | 69047/371472 [5:29:26<22:49:06,  3.68it/s]
 19%|█▊        | 69048/371472 [5:29:27<22:46:05,  3.69it/s]
 19%|█▊        | 69049/371472 [5:29:27<22:27:16,  3.74it/s]
 19%|█▊        | 69050/371472 [5:29:27<22:42:38,  3.70it/s]
 19%|█▊        | 69051/371472 [5:29:28<23:43:57,  3.54it/s]
 19%|█▊        | 69052/371472 [5:29:28<26:28:04,  3.17it/s]
 19%|█▊        | 69053/371472 [5:29:28<25:37:58,  3.28it/s]
 19%|█▊        | 69054/371472 [5:29:29<25:57:18,  3.24it/s]
 19%|█▊        | 69055/371472 [5:29:29<24:57:21,  3.37it/s]
 19%|█▊        | 69056/371472 [5:29:29<24:00:43,  3.50it/s]
 19%|█▊        | 69057/371472 [5:29:29<23:34:04,  3.56it/s]
 19%|█▊        | 69058/371472 [5:29:30<23:45:28,  3.54it/s]
 19%|█▊        | 69059/371472 [5:29:30<22:36:28,  3.72it/s]
 19%|█▊        | 69060/371472 [5:29:30<21:59:06,  3.82it/s]
                                                           
{'loss': 4.23, 'learning_rate': 8.330765584261673e-07, 'epoch': 2.97}

 19%|█▊        | 69060/371472 [5:29:30<21:59:06,  3.82it/s]
 19%|█▊        | 69061/371472 [5:29:30<23:12:53,  3.62it/s]
 19%|█▊        | 69062/371472 [5:29:31<23:33:54,  3.56it/s]
 19%|█▊        | 69063/371472 [5:29:31<23:44:13,  3.54it/s]
 19%|█▊        | 69064/371472 [5:29:31<24:11:32,  3.47it/s]
 19%|█▊        | 69065/371472 [5:29:32<23:00:17,  3.65it/s]
 19%|█▊        | 69066/371472 [5:29:32<23:03:21,  3.64it/s]
 19%|█▊        | 69067/371472 [5:29:32<22:41:38,  3.70it/s]
 19%|█▊        | 69068/371472 [5:29:32<22:03:02,  3.81it/s]
 19%|█▊        | 69069/371472 [5:29:33<21:48:17,  3.85it/s]
 19%|█▊        | 69070/371472 [5:29:33<22:12:03,  3.78it/s]
 19%|█▊        | 69071/371472 [5:29:33<22:30:23,  3.73it/s]
 19%|█▊        | 69072/371472 [5:29:33<22:51:31,  3.67it/s]
 19%|█▊        | 69073/371472 [5:29:34<22:26:20,  3.74it/s]
 19%|█▊        | 69074/371472 [5:29:34<23:29:44,  3.58it/s]
 19%|█▊        | 69075/371472 [5:29:34<24:00:02,  3.50it/s]
 19%|█▊        | 69076/371472 [5:29:35<25:22:52,  3.31it/s]
 19%|█▊        | 69077/371472 [5:29:35<26:41:01,  3.15it/s]
 19%|█▊        | 69078/371472 [5:29:35<27:17:11,  3.08it/s]
 19%|█▊        | 69079/371472 [5:29:36<26:49:49,  3.13it/s]
 19%|█▊        | 69080/371472 [5:29:36<25:53:14,  3.24it/s]
                                                           
{'loss': 3.9961, 'learning_rate': 8.330280764506884e-07, 'epoch': 2.98}

 19%|█▊        | 69080/371472 [5:29:36<25:53:14,  3.24it/s]
 19%|█▊        | 69081/371472 [5:29:36<24:49:56,  3.38it/s]
 19%|█▊        | 69082/371472 [5:29:36<23:46:54,  3.53it/s]
 19%|█▊        | 69083/371472 [5:29:37<24:30:37,  3.43it/s]
 19%|█▊        | 69084/371472 [5:29:37<23:37:43,  3.55it/s]
 19%|█▊        | 69085/371472 [5:29:37<24:21:55,  3.45it/s]
 19%|█▊        | 69086/371472 [5:29:38<23:19:39,  3.60it/s]
 19%|█▊        | 69087/371472 [5:29:38<22:48:18,  3.68it/s]
 19%|█▊        | 69088/371472 [5:29:38<26:14:57,  3.20it/s]
 19%|█▊        | 69089/371472 [5:29:38<24:46:05,  3.39it/s]
 19%|█▊        | 69090/371472 [5:29:39<23:36:39,  3.56it/s]
 19%|█▊        | 69091/371472 [5:29:39<22:33:25,  3.72it/s]
 19%|█▊        | 69092/371472 [5:29:39<23:27:16,  3.58it/s]
 19%|█▊        | 69093/371472 [5:29:40<24:17:19,  3.46it/s]
 19%|█▊        | 69094/371472 [5:29:40<24:16:31,  3.46it/s]
 19%|█▊        | 69095/371472 [5:29:40<23:48:05,  3.53it/s]
 19%|█▊        | 69096/371472 [5:29:40<23:02:52,  3.64it/s]
 19%|█▊        | 69097/371472 [5:29:41<22:27:02,  3.74it/s]
 19%|█▊        | 69098/371472 [5:29:41<21:58:06,  3.82it/s]
 19%|█▊        | 69099/371472 [5:29:41<22:30:32,  3.73it/s]
 19%|█▊        | 69100/371472 [5:29:41<22:13:27,  3.78it/s]
                                                           
{'loss': 4.2471, 'learning_rate': 8.329795944752095e-07, 'epoch': 2.98}

 19%|█▊        | 69100/371472 [5:29:41<22:13:27,  3.78it/s]
 19%|█▊        | 69101/371472 [5:29:42<21:21:31,  3.93it/s]
 19%|█▊        | 69102/371472 [5:29:42<20:49:34,  4.03it/s]
 19%|█▊        | 69103/371472 [5:29:42<22:22:07,  3.75it/s]
 19%|█▊        | 69104/371472 [5:29:42<23:12:27,  3.62it/s]
 19%|█▊        | 69105/371472 [5:29:43<21:54:37,  3.83it/s]
 19%|█▊        | 69106/371472 [5:29:43<22:21:06,  3.76it/s]
 19%|█▊        | 69107/371472 [5:29:43<22:09:57,  3.79it/s]
 19%|█▊        | 69108/371472 [5:29:44<22:03:49,  3.81it/s]
 19%|█▊        | 69109/371472 [5:29:44<22:58:58,  3.65it/s]
 19%|█▊        | 69110/371472 [5:29:44<23:09:58,  3.63it/s]
 19%|█▊        | 69111/371472 [5:29:44<22:54:39,  3.67it/s]
 19%|█▊        | 69112/371472 [5:29:45<23:33:20,  3.57it/s]
 19%|█▊        | 69113/371472 [5:29:45<22:52:53,  3.67it/s]
 19%|█▊        | 69114/371472 [5:29:45<24:02:52,  3.49it/s]
 19%|█▊        | 69115/371472 [5:29:45<23:35:24,  3.56it/s]
 19%|█▊        | 69116/371472 [5:29:46<24:10:55,  3.47it/s]
 19%|█▊        | 69117/371472 [5:29:46<24:05:56,  3.49it/s]
 19%|█▊        | 69118/371472 [5:29:46<23:48:10,  3.53it/s]
 19%|█▊        | 69119/371472 [5:29:47<23:58:35,  3.50it/s]
 19%|█▊        | 69120/371472 [5:29:47<23:33:43,  3.56it/s]
                                                           
{'loss': 4.2375, 'learning_rate': 8.329311124997306e-07, 'epoch': 2.98}

 19%|█▊        | 69120/371472 [5:29:47<23:33:43,  3.56it/s]
 19%|█▊        | 69121/371472 [5:29:47<23:20:30,  3.60it/s]
 19%|█▊        | 69122/371472 [5:29:47<23:43:57,  3.54it/s]
 19%|█▊        | 69123/371472 [5:29:48<23:57:53,  3.50it/s]
 19%|█▊        | 69124/371472 [5:29:48<23:07:46,  3.63it/s]
 19%|█▊        | 69125/371472 [5:29:48<25:25:43,  3.30it/s]
 19%|█▊        | 69126/371472 [5:29:49<25:01:06,  3.36it/s]
 19%|█▊        | 69127/371472 [5:29:49<24:59:50,  3.36it/s]
 19%|█▊        | 69128/371472 [5:29:49<24:11:13,  3.47it/s]
 19%|█▊        | 69129/371472 [5:29:50<28:13:53,  2.97it/s]
 19%|█▊        | 69130/371472 [5:29:50<25:32:48,  3.29it/s]
 19%|█▊        | 69131/371472 [5:29:50<24:53:36,  3.37it/s]
 19%|█▊        | 69132/371472 [5:29:50<23:51:48,  3.52it/s]
 19%|█▊        | 69133/371472 [5:29:51<24:22:31,  3.45it/s]
 19%|█▊        | 69134/371472 [5:29:51<23:10:42,  3.62it/s]
 19%|█▊        | 69135/371472 [5:29:51<22:56:14,  3.66it/s]
 19%|█▊        | 69136/371472 [5:29:52<22:06:48,  3.80it/s]
 19%|█▊        | 69137/371472 [5:29:52<22:20:43,  3.76it/s]
 19%|█▊        | 69138/371472 [5:29:52<22:58:21,  3.66it/s]
 19%|█▊        | 69139/371472 [5:29:52<22:25:42,  3.74it/s]
 19%|█▊        | 69140/371472 [5:29:53<22:09:52,  3.79it/s]
                                                           
{'loss': 4.2749, 'learning_rate': 8.328826305242517e-07, 'epoch': 2.98}

 19%|█▊        | 69140/371472 [5:29:53<22:09:52,  3.79it/s]
 19%|█▊        | 69141/371472 [5:29:53<21:33:56,  3.89it/s]
 19%|█▊        | 69142/371472 [5:29:53<22:18:03,  3.77it/s]
 19%|█▊        | 69143/371472 [5:29:53<22:23:48,  3.75it/s]
 19%|█▊        | 69144/371472 [5:29:54<22:18:22,  3.76it/s]
 19%|█▊        | 69145/371472 [5:29:54<22:01:29,  3.81it/s]
 19%|█▊        | 69146/371472 [5:29:54<23:10:58,  3.62it/s]
 19%|█▊        | 69147/371472 [5:29:55<24:45:46,  3.39it/s]
 19%|█▊        | 69148/371472 [5:29:55<24:42:07,  3.40it/s]
 19%|█▊        | 69149/371472 [5:29:55<24:07:14,  3.48it/s]
 19%|█▊        | 69150/371472 [5:29:55<26:35:41,  3.16it/s]
 19%|█▊        | 69151/371472 [5:29:56<25:56:44,  3.24it/s]
 19%|█▊        | 69152/371472 [5:29:56<24:51:25,  3.38it/s]
 19%|█▊        | 69153/371472 [5:29:56<23:36:11,  3.56it/s]
 19%|█▊        | 69154/371472 [5:29:57<23:25:21,  3.59it/s]
 19%|█▊        | 69155/371472 [5:29:57<23:51:20,  3.52it/s]
 19%|█▊        | 69156/371472 [5:29:57<23:26:25,  3.58it/s]
 19%|█▊        | 69157/371472 [5:29:57<24:15:45,  3.46it/s]
 19%|█▊        | 69158/371472 [5:29:58<24:28:37,  3.43it/s]
 19%|█▊        | 69159/371472 [5:29:58<24:38:16,  3.41it/s]
 19%|█▊        | 69160/371472 [5:29:58<25:38:54,  3.27it/s]
                                                           
{'loss': 4.0304, 'learning_rate': 8.328341485487728e-07, 'epoch': 2.98}

 19%|█▊        | 69160/371472 [5:29:58<25:38:54,  3.27it/s]
 19%|█▊        | 69161/371472 [5:29:59<26:10:43,  3.21it/s]
 19%|█▊        | 69162/371472 [5:29:59<24:59:19,  3.36it/s]
 19%|█▊        | 69163/371472 [5:29:59<24:25:03,  3.44it/s]
 19%|█▊        | 69164/371472 [5:30:00<25:42:08,  3.27it/s]
 19%|█▊        | 69165/371472 [5:30:00<25:20:03,  3.31it/s]
 19%|█▊        | 69166/371472 [5:30:00<24:55:59,  3.37it/s]
 19%|█▊        | 69167/371472 [5:30:00<23:57:28,  3.51it/s]
 19%|█▊        | 69168/371472 [5:30:01<23:54:33,  3.51it/s]
 19%|█▊        | 69169/371472 [5:30:01<25:03:53,  3.35it/s]
 19%|█▊        | 69170/371472 [5:30:01<24:03:36,  3.49it/s]
 19%|█▊        | 69171/371472 [5:30:02<23:59:35,  3.50it/s]
 19%|█▊        | 69172/371472 [5:30:02<23:43:42,  3.54it/s]
 19%|█▊        | 69173/371472 [5:30:02<23:14:40,  3.61it/s]
 19%|█▊        | 69174/371472 [5:30:02<25:28:29,  3.30it/s]
 19%|█▊        | 69175/371472 [5:30:03<25:09:31,  3.34it/s]
 19%|█▊        | 69176/371472 [5:30:03<23:48:16,  3.53it/s]
 19%|█▊        | 69177/371472 [5:30:03<23:47:33,  3.53it/s]
 19%|█▊        | 69178/371472 [5:30:04<23:19:21,  3.60it/s]
 19%|█▊        | 69179/371472 [5:30:04<22:54:22,  3.67it/s]
 19%|█▊        | 69180/371472 [5:30:04<22:41:37,  3.70it/s]
                                                           
{'loss': 4.1121, 'learning_rate': 8.32785666573294e-07, 'epoch': 2.98}

 19%|█▊        | 69180/371472 [5:30:04<22:41:37,  3.70it/s]
 19%|█▊        | 69181/371472 [5:30:04<22:56:57,  3.66it/s]
 19%|█▊        | 69182/371472 [5:30:05<22:15:33,  3.77it/s]
 19%|█▊        | 69183/371472 [5:30:05<21:58:52,  3.82it/s]
 19%|█▊        | 69184/371472 [5:30:05<23:38:56,  3.55it/s]
 19%|█▊        | 69185/371472 [5:30:05<23:06:03,  3.63it/s]
 19%|█▊        | 69186/371472 [5:30:06<22:52:15,  3.67it/s]
 19%|█▊        | 69187/371472 [5:30:06<23:01:08,  3.65it/s]
 19%|█▊        | 69188/371472 [5:30:06<23:09:29,  3.63it/s]
 19%|█▊        | 69189/371472 [5:30:07<23:53:03,  3.52it/s]
 19%|█▊        | 69190/371472 [5:30:07<24:33:20,  3.42it/s]
 19%|█▊        | 69191/371472 [5:30:07<23:23:12,  3.59it/s]
 19%|█▊        | 69192/371472 [5:30:07<24:30:28,  3.43it/s]
 19%|█▊        | 69193/371472 [5:30:08<24:05:02,  3.49it/s]
 19%|█▊        | 69194/371472 [5:30:08<23:46:09,  3.53it/s]
 19%|█▊        | 69195/371472 [5:30:08<24:39:22,  3.41it/s]
 19%|█▊        | 69196/371472 [5:30:09<24:36:14,  3.41it/s]
 19%|█▊        | 69197/371472 [5:30:09<23:13:15,  3.62it/s]
 19%|█▊        | 69198/371472 [5:30:09<24:19:43,  3.45it/s]
 19%|█▊        | 69199/371472 [5:30:09<23:43:11,  3.54it/s]
 19%|█▊        | 69200/371472 [5:30:10<23:52:26,  3.52it/s]
                                                           
{'loss': 4.1717, 'learning_rate': 8.327371845978151e-07, 'epoch': 2.98}

 19%|█▊        | 69200/371472 [5:30:10<23:52:26,  3.52it/s]
 19%|█▊        | 69201/371472 [5:30:10<23:57:26,  3.50it/s]
 19%|█▊        | 69202/371472 [5:30:10<23:23:38,  3.59it/s]
 19%|█▊        | 69203/371472 [5:30:11<23:58:14,  3.50it/s]
 19%|█▊        | 69204/371472 [5:30:11<24:30:41,  3.43it/s]
 19%|█▊        | 69205/371472 [5:30:11<23:22:55,  3.59it/s]
 19%|█▊        | 69206/371472 [5:30:11<22:34:09,  3.72it/s]
 19%|█▊        | 69207/371472 [5:30:12<22:05:40,  3.80it/s]
 19%|█▊        | 69208/371472 [5:30:12<22:40:28,  3.70it/s]
 19%|█▊        | 69209/371472 [5:30:12<23:16:09,  3.61it/s]
 19%|█▊        | 69210/371472 [5:30:12<22:41:51,  3.70it/s]
 19%|█▊        | 69211/371472 [5:30:13<22:32:13,  3.73it/s]
 19%|█▊        | 69212/371472 [5:30:13<23:32:42,  3.57it/s]
 19%|█▊        | 69213/371472 [5:30:13<24:11:20,  3.47it/s]
 19%|█▊        | 69214/371472 [5:30:14<24:50:08,  3.38it/s]
 19%|█▊        | 69215/371472 [5:30:14<26:12:39,  3.20it/s]
 19%|█▊        | 69216/371472 [5:30:14<25:12:56,  3.33it/s]
 19%|█▊        | 69217/371472 [5:30:15<25:33:57,  3.28it/s]
 19%|█▊        | 69218/371472 [5:30:15<25:14:21,  3.33it/s]
 19%|█▊        | 69219/371472 [5:30:15<24:29:53,  3.43it/s]
 19%|█▊        | 69220/371472 [5:30:16<26:22:24,  3.18it/s]
                                                           
{'loss': 3.996, 'learning_rate': 8.326887026223362e-07, 'epoch': 2.98}

 19%|█▊        | 69220/371472 [5:30:16<26:22:24,  3.18it/s]
 19%|█▊        | 69221/371472 [5:30:16<25:38:46,  3.27it/s]
 19%|█▊        | 69222/371472 [5:30:16<24:37:49,  3.41it/s]
 19%|█▊        | 69223/371472 [5:30:16<23:54:50,  3.51it/s]
 19%|█▊        | 69224/371472 [5:30:17<23:16:41,  3.61it/s]
 19%|█▊        | 69225/371472 [5:30:17<22:30:09,  3.73it/s]
 19%|█▊        | 69226/371472 [5:30:17<27:56:09,  3.01it/s]
 19%|█▊        | 69227/371472 [5:30:18<26:23:38,  3.18it/s]
 19%|█▊        | 69228/371472 [5:30:18<24:48:25,  3.38it/s]
 19%|█▊        | 69229/371472 [5:30:18<23:35:26,  3.56it/s]
 19%|█▊        | 69230/371472 [5:30:18<24:31:05,  3.42it/s]
 19%|█▊        | 69231/371472 [5:30:19<24:52:05,  3.38it/s]
 19%|█▊        | 69232/371472 [5:30:19<26:11:07,  3.21it/s]
 19%|█▊        | 69233/371472 [5:30:19<26:23:13,  3.18it/s]
 19%|█▊        | 69234/371472 [5:30:20<27:05:14,  3.10it/s]
 19%|█▊        | 69235/371472 [5:30:20<26:00:05,  3.23it/s]
 19%|█▊        | 69236/371472 [5:30:20<25:54:26,  3.24it/s]
 19%|█▊        | 69237/371472 [5:30:21<25:45:39,  3.26it/s]
 19%|█▊        | 69238/371472 [5:30:21<24:37:10,  3.41it/s]
 19%|█▊        | 69239/371472 [5:30:21<24:28:20,  3.43it/s]
 19%|█▊        | 69240/371472 [5:30:21<23:26:35,  3.58it/s]
                                                           
{'loss': 4.3253, 'learning_rate': 8.326402206468572e-07, 'epoch': 2.98}

 19%|█▊        | 69240/371472 [5:30:21<23:26:35,  3.58it/s]
 19%|█▊        | 69241/371472 [5:30:22<24:56:57,  3.36it/s]
 19%|█▊        | 69242/371472 [5:30:22<24:04:40,  3.49it/s]
 19%|█▊        | 69243/371472 [5:30:22<23:33:12,  3.56it/s]
 19%|█▊        | 69244/371472 [5:30:23<23:17:38,  3.60it/s]
 19%|█▊        | 69245/371472 [5:30:23<23:35:51,  3.56it/s]
 19%|█▊        | 69246/371472 [5:30:23<23:10:42,  3.62it/s]
 19%|█▊        | 69247/371472 [5:30:23<22:38:32,  3.71it/s]
 19%|█▊        | 69248/371472 [5:30:24<23:18:47,  3.60it/s]
 19%|█▊        | 69249/371472 [5:30:24<22:44:31,  3.69it/s]
 19%|█▊        | 69250/371472 [5:30:24<25:05:22,  3.35it/s]
 19%|█▊        | 69251/371472 [5:30:25<25:06:33,  3.34it/s]
 19%|█▊        | 69252/371472 [5:30:25<28:36:18,  2.93it/s]
 19%|█▊        | 69253/371472 [5:30:25<27:14:01,  3.08it/s]
 19%|█▊        | 69254/371472 [5:30:26<26:30:50,  3.17it/s]
 19%|█▊        | 69255/371472 [5:30:26<25:35:39,  3.28it/s]
 19%|█▊        | 69256/371472 [5:30:26<25:46:50,  3.26it/s]
 19%|█▊        | 69257/371472 [5:30:26<24:38:12,  3.41it/s]
 19%|█▊        | 69258/371472 [5:30:27<23:35:57,  3.56it/s]
 19%|█▊        | 69259/371472 [5:30:27<23:43:18,  3.54it/s]
 19%|█▊        | 69260/371472 [5:30:27<22:56:41,  3.66it/s]
                                                           
{'loss': 4.0697, 'learning_rate': 8.325917386713784e-07, 'epoch': 2.98}

 19%|█▊        | 69260/371472 [5:30:27<22:56:41,  3.66it/s]
 19%|█▊        | 69261/371472 [5:30:28<23:06:37,  3.63it/s]
 19%|█▊        | 69262/371472 [5:30:28<23:01:46,  3.65it/s]
 19%|█▊        | 69263/371472 [5:30:28<23:07:36,  3.63it/s]
 19%|█▊        | 69264/371472 [5:30:28<23:09:52,  3.62it/s]
 19%|█▊        | 69265/371472 [5:30:29<23:35:12,  3.56it/s]
 19%|█▊        | 69266/371472 [5:30:29<22:48:18,  3.68it/s]
 19%|█▊        | 69267/371472 [5:30:29<23:02:51,  3.64it/s]
 19%|█▊        | 69268/371472 [5:30:29<23:33:44,  3.56it/s]
 19%|█▊        | 69269/371472 [5:30:30<22:49:24,  3.68it/s]
 19%|█▊        | 69270/371472 [5:30:30<22:14:43,  3.77it/s]
 19%|█▊        | 69271/371472 [5:30:30<22:31:35,  3.73it/s]
 19%|█▊        | 69272/371472 [5:30:31<22:16:12,  3.77it/s]
 19%|█▊        | 69273/371472 [5:30:31<22:46:00,  3.69it/s]
 19%|█▊        | 69274/371472 [5:30:31<22:29:42,  3.73it/s]
 19%|█▊        | 69275/371472 [5:30:31<22:06:30,  3.80it/s]
 19%|█▊        | 69276/371472 [5:30:32<22:31:11,  3.73it/s]
 19%|█▊        | 69277/371472 [5:30:32<22:12:49,  3.78it/s]
 19%|█▊        | 69278/371472 [5:30:32<24:18:18,  3.45it/s]
 19%|█▊        | 69279/371472 [5:30:32<23:45:08,  3.53it/s]
 19%|█▊        | 69280/371472 [5:30:33<24:10:27,  3.47it/s]
                                                           
{'loss': 4.4012, 'learning_rate': 8.325432566958994e-07, 'epoch': 2.98}

 19%|█▊        | 69280/371472 [5:30:33<24:10:27,  3.47it/s]
 19%|█▊        | 69281/371472 [5:30:33<23:35:34,  3.56it/s]
 19%|█▊        | 69282/371472 [5:30:33<22:54:34,  3.66it/s]
 19%|█▊        | 69283/371472 [5:30:34<23:43:37,  3.54it/s]
 19%|█▊        | 69284/371472 [5:30:34<24:01:21,  3.49it/s]
 19%|█▊        | 69285/371472 [5:30:34<24:08:04,  3.48it/s]
 19%|█▊        | 69286/371472 [5:30:34<24:55:11,  3.37it/s]
 19%|█▊        | 69287/371472 [5:30:35<24:19:19,  3.45it/s]
 19%|█▊        | 69288/371472 [5:30:35<24:10:03,  3.47it/s]
 19%|█▊        | 69289/371472 [5:30:35<24:40:23,  3.40it/s]
 19%|█▊        | 69290/371472 [5:30:36<24:32:25,  3.42it/s]
 19%|█▊        | 69291/371472 [5:30:36<23:50:23,  3.52it/s]
 19%|█▊        | 69292/371472 [5:30:36<23:38:19,  3.55it/s]
 19%|█▊        | 69293/371472 [5:30:36<22:57:01,  3.66it/s]
 19%|█▊        | 69294/371472 [5:30:37<22:50:45,  3.67it/s]
 19%|█▊        | 69295/371472 [5:30:37<25:18:42,  3.32it/s]
 19%|█▊        | 69296/371472 [5:30:37<24:42:49,  3.40it/s]
 19%|█▊        | 69297/371472 [5:30:38<24:09:35,  3.47it/s]
 19%|█▊        | 69298/371472 [5:30:38<23:29:23,  3.57it/s]
 19%|█▊        | 69299/371472 [5:30:38<24:05:08,  3.48it/s]
 19%|█▊        | 69300/371472 [5:30:38<23:17:16,  3.60it/s]
                                                           
{'loss': 3.992, 'learning_rate': 8.324947747204205e-07, 'epoch': 2.98}

 19%|█▊        | 69300/371472 [5:30:38<23:17:16,  3.60it/s]
 19%|█▊        | 69301/371472 [5:30:39<23:28:54,  3.57it/s]
 19%|█▊        | 69302/371472 [5:30:39<24:43:09,  3.40it/s]
 19%|█▊        | 69303/371472 [5:30:39<24:38:49,  3.41it/s]
 19%|█▊        | 69304/371472 [5:30:40<24:41:22,  3.40it/s]
 19%|█▊        | 69305/371472 [5:30:40<23:30:56,  3.57it/s]
 19%|█▊        | 69306/371472 [5:30:40<23:34:37,  3.56it/s]
 19%|█▊        | 69307/371472 [5:30:40<22:30:12,  3.73it/s]
 19%|█▊        | 69308/371472 [5:30:41<23:48:37,  3.53it/s]
 19%|█▊        | 69309/371472 [5:30:41<23:31:29,  3.57it/s]
 19%|█▊        | 69310/371472 [5:30:41<24:39:47,  3.40it/s]
 19%|█▊        | 69311/371472 [5:30:42<23:36:46,  3.55it/s]
 19%|█▊        | 69312/371472 [5:30:42<23:59:32,  3.50it/s]
 19%|█▊        | 69313/371472 [5:30:42<23:52:44,  3.51it/s]
 19%|█▊        | 69314/371472 [5:30:42<25:07:14,  3.34it/s]
 19%|█▊        | 69315/371472 [5:30:43<24:21:54,  3.44it/s]
 19%|█▊        | 69316/371472 [5:30:43<24:36:36,  3.41it/s]
 19%|█▊        | 69317/371472 [5:30:43<26:36:12,  3.15it/s]
 19%|█▊        | 69318/371472 [5:30:44<26:42:51,  3.14it/s]
 19%|█▊        | 69319/371472 [5:30:44<25:24:11,  3.30it/s]
 19%|█▊        | 69320/371472 [5:30:44<23:36:58,  3.55it/s]
                                                           
{'loss': 4.241, 'learning_rate': 8.324462927449417e-07, 'epoch': 2.99}

 19%|█▊        | 69320/371472 [5:30:44<23:36:58,  3.55it/s]
 19%|█▊        | 69321/371472 [5:30:45<23:10:14,  3.62it/s]
 19%|█▊        | 69322/371472 [5:30:45<22:28:25,  3.73it/s]
 19%|█▊        | 69323/371472 [5:30:45<22:26:23,  3.74it/s]
 19%|█▊        | 69324/371472 [5:30:45<21:55:56,  3.83it/s]
 19%|█▊        | 69325/371472 [5:30:46<22:52:58,  3.67it/s]
 19%|█▊        | 69326/371472 [5:30:46<22:30:55,  3.73it/s]
 19%|█▊        | 69327/371472 [5:30:46<23:35:26,  3.56it/s]
 19%|█▊        | 69328/371472 [5:30:46<23:26:47,  3.58it/s]
 19%|█▊        | 69329/371472 [5:30:47<22:20:07,  3.76it/s]
 19%|█▊        | 69330/371472 [5:30:47<23:23:08,  3.59it/s]
 19%|█▊        | 69331/371472 [5:30:47<22:24:42,  3.74it/s]
 19%|█▊        | 69332/371472 [5:30:48<23:06:28,  3.63it/s]
 19%|█▊        | 69333/371472 [5:30:48<24:07:44,  3.48it/s]
 19%|█▊        | 69334/371472 [5:30:48<22:57:30,  3.66it/s]
 19%|█▊        | 69335/371472 [5:30:48<22:30:37,  3.73it/s]
 19%|█▊        | 69336/371472 [5:30:49<21:47:36,  3.85it/s]
 19%|█▊        | 69337/371472 [5:30:49<21:32:18,  3.90it/s]
 19%|█▊        | 69338/371472 [5:30:49<22:05:23,  3.80it/s]
 19%|█▊        | 69339/371472 [5:30:49<22:49:44,  3.68it/s]
 19%|█▊        | 69340/371472 [5:30:50<22:12:24,  3.78it/s]
                                                           
{'loss': 4.3471, 'learning_rate': 8.323978107694628e-07, 'epoch': 2.99}

 19%|█▊        | 69340/371472 [5:30:50<22:12:24,  3.78it/s]
 19%|█▊        | 69341/371472 [5:30:50<22:51:17,  3.67it/s]
 19%|█▊        | 69342/371472 [5:30:50<23:07:43,  3.63it/s]
 19%|█▊        | 69343/371472 [5:30:51<23:58:34,  3.50it/s]
 19%|█▊        | 69344/371472 [5:30:51<24:52:37,  3.37it/s]
 19%|█▊        | 69345/371472 [5:30:51<24:30:05,  3.43it/s]
 19%|█▊        | 69346/371472 [5:30:51<23:36:35,  3.55it/s]
 19%|█▊        | 69347/371472 [5:30:52<23:36:48,  3.55it/s]
 19%|█▊        | 69348/371472 [5:30:52<23:38:58,  3.55it/s]
 19%|█▊        | 69349/371472 [5:30:52<25:08:56,  3.34it/s]
 19%|█▊        | 69350/371472 [5:30:53<24:55:05,  3.37it/s]
 19%|█▊        | 69351/371472 [5:30:53<25:33:56,  3.28it/s]
 19%|█▊        | 69352/371472 [5:30:53<24:40:28,  3.40it/s]
 19%|█▊        | 69353/371472 [5:30:53<23:54:17,  3.51it/s]
 19%|█▊        | 69354/371472 [5:30:54<24:12:43,  3.47it/s]
 19%|█▊        | 69355/371472 [5:30:54<23:03:42,  3.64it/s]
 19%|█▊        | 69356/371472 [5:30:54<24:12:46,  3.47it/s]
 19%|█▊        | 69357/371472 [5:30:55<24:00:11,  3.50it/s]
 19%|█▊        | 69358/371472 [5:30:55<23:41:52,  3.54it/s]
 19%|█▊        | 69359/371472 [5:30:55<22:36:31,  3.71it/s]
 19%|█▊        | 69360/371472 [5:30:55<22:46:35,  3.68it/s]
                                                           
{'loss': 4.1748, 'learning_rate': 8.323493287939839e-07, 'epoch': 2.99}

 19%|█▊        | 69360/371472 [5:30:55<22:46:35,  3.68it/s]
 19%|█▊        | 69361/371472 [5:30:56<23:20:24,  3.60it/s]
 19%|█▊        | 69362/371472 [5:30:56<23:16:43,  3.60it/s]
 19%|█▊        | 69363/371472 [5:30:56<24:28:50,  3.43it/s]
 19%|█▊        | 69364/371472 [5:30:57<23:44:28,  3.53it/s]
 19%|█▊        | 69365/371472 [5:30:57<24:34:51,  3.41it/s]
 19%|█▊        | 69366/371472 [5:30:57<23:51:46,  3.52it/s]
 19%|█▊        | 69367/371472 [5:30:57<23:33:45,  3.56it/s]
 19%|█▊        | 69368/371472 [5:30:58<23:21:32,  3.59it/s]
 19%|█▊        | 69369/371472 [5:30:58<22:41:22,  3.70it/s]
 19%|█▊        | 69370/371472 [5:30:58<23:58:20,  3.50it/s]
 19%|█▊        | 69371/371472 [5:30:59<24:40:45,  3.40it/s]
 19%|█▊        | 69372/371472 [5:30:59<24:40:58,  3.40it/s]
 19%|█▊        | 69373/371472 [5:30:59<24:44:49,  3.39it/s]
 19%|█▊        | 69374/371472 [5:30:59<26:15:57,  3.19it/s]
 19%|█▊        | 69375/371472 [5:31:00<25:34:07,  3.28it/s]
 19%|█▊        | 69376/371472 [5:31:00<24:15:00,  3.46it/s]
 19%|█▊        | 69377/371472 [5:31:00<23:40:36,  3.54it/s]
 19%|█▊        | 69378/371472 [5:31:01<24:24:30,  3.44it/s]
 19%|█▊        | 69379/371472 [5:31:01<24:12:51,  3.47it/s]
 19%|█▊        | 69380/371472 [5:31:01<26:15:04,  3.20it/s]
                                                           
{'loss': 4.332, 'learning_rate': 8.323008468185049e-07, 'epoch': 2.99}

 19%|█▊        | 69380/371472 [5:31:01<26:15:04,  3.20it/s]
 19%|█▊        | 69381/371472 [5:31:02<25:26:56,  3.30it/s]
 19%|█▊        | 69382/371472 [5:31:02<27:08:15,  3.09it/s]
 19%|█▊        | 69383/371472 [5:31:02<27:01:31,  3.10it/s]
 19%|█▊        | 69384/371472 [5:31:02<25:17:37,  3.32it/s]
 19%|█▊        | 69385/371472 [5:31:03<25:02:24,  3.35it/s]
 19%|█▊        | 69386/371472 [5:31:03<23:59:46,  3.50it/s]
 19%|█▊        | 69387/371472 [5:31:03<24:41:26,  3.40it/s]
 19%|█▊        | 69388/371472 [5:31:04<25:52:52,  3.24it/s]
 19%|█▊        | 69389/371472 [5:31:04<29:56:42,  2.80it/s]
 19%|█▊        | 69390/371472 [5:31:04<28:24:35,  2.95it/s]
 19%|█▊        | 69391/371472 [5:31:05<27:43:23,  3.03it/s]
 19%|█▊        | 69392/371472 [5:31:05<25:46:27,  3.26it/s]
 19%|█▊        | 69393/371472 [5:31:05<25:44:30,  3.26it/s]
 19%|█▊        | 69394/371472 [5:31:06<24:13:22,  3.46it/s]
 19%|█▊        | 69395/371472 [5:31:06<22:57:49,  3.65it/s]
 19%|█▊        | 69396/371472 [5:31:06<22:57:46,  3.65it/s]
 19%|█▊        | 69397/371472 [5:31:06<23:00:24,  3.65it/s]
 19%|█▊        | 69398/371472 [5:31:07<23:37:33,  3.55it/s]
 19%|█▊        | 69399/371472 [5:31:07<22:58:19,  3.65it/s]
 19%|█▊        | 69400/371472 [5:31:07<23:02:43,  3.64it/s]
                                                           
{'loss': 3.9955, 'learning_rate': 8.322523648430261e-07, 'epoch': 2.99}

 19%|█▊        | 69400/371472 [5:31:07<23:02:43,  3.64it/s]
 19%|█▊        | 69401/371472 [5:31:07<23:51:13,  3.52it/s]
 19%|█▊        | 69402/371472 [5:31:08<23:39:32,  3.55it/s]
 19%|█▊        | 69403/371472 [5:31:08<22:26:05,  3.74it/s]
 19%|█▊        | 69404/371472 [5:31:08<22:04:29,  3.80it/s]
 19%|█▊        | 69405/371472 [5:31:09<22:35:20,  3.71it/s]
 19%|█▊        | 69406/371472 [5:31:09<22:03:52,  3.80it/s]
 19%|█▊        | 69407/371472 [5:31:09<23:12:09,  3.62it/s]
 19%|█▊        | 69408/371472 [5:31:09<23:19:19,  3.60it/s]
 19%|█▊        | 69409/371472 [5:31:10<24:00:47,  3.49it/s]
 19%|█▊        | 69410/371472 [5:31:10<25:47:27,  3.25it/s]
 19%|█▊        | 69411/371472 [5:31:10<24:51:49,  3.37it/s]
 19%|█▊        | 69412/371472 [5:31:11<24:39:40,  3.40it/s]
 19%|█▊        | 69413/371472 [5:31:11<25:06:37,  3.34it/s]
 19%|█▊        | 69414/371472 [5:31:11<24:24:28,  3.44it/s]
 19%|█▊        | 69415/371472 [5:31:11<24:52:00,  3.37it/s]
 19%|█▊        | 69416/371472 [5:31:12<23:47:59,  3.53it/s]
 19%|█▊        | 69417/371472 [5:31:12<23:12:41,  3.61it/s]
 19%|█▊        | 69418/371472 [5:31:12<23:30:43,  3.57it/s]
 19%|█▊        | 69419/371472 [5:31:13<22:34:05,  3.72it/s]
 19%|█▊        | 69420/371472 [5:31:13<22:49:04,  3.68it/s]
                                                           
{'loss': 4.2962, 'learning_rate': 8.322038828675472e-07, 'epoch': 2.99}

 19%|█▊        | 69420/371472 [5:31:13<22:49:04,  3.68it/s]
 19%|█▊        | 69421/371472 [5:31:13<24:42:14,  3.40it/s]
 19%|█▊        | 69422/371472 [5:31:13<24:42:26,  3.40it/s]
 19%|█▊        | 69423/371472 [5:31:14<24:26:15,  3.43it/s]
 19%|█▊        | 69424/371472 [5:31:14<23:14:35,  3.61it/s]
 19%|█▊        | 69425/371472 [5:31:14<22:44:03,  3.69it/s]
 19%|█▊        | 69426/371472 [5:31:14<21:46:19,  3.85it/s]
 19%|█▊        | 69427/371472 [5:31:15<24:02:28,  3.49it/s]
 19%|█▊        | 69428/371472 [5:31:15<22:58:09,  3.65it/s]
 19%|█▊        | 69429/371472 [5:31:15<22:27:40,  3.74it/s]
 19%|█▊        | 69430/371472 [5:31:16<22:41:04,  3.70it/s]
 19%|█▊        | 69431/371472 [5:31:16<22:33:29,  3.72it/s]
 19%|█▊        | 69432/371472 [5:31:16<22:04:08,  3.80it/s]
 19%|█▊        | 69433/371472 [5:31:16<21:31:51,  3.90it/s]
 19%|█▊        | 69434/371472 [5:31:17<21:38:53,  3.88it/s]
 19%|█▊        | 69435/371472 [5:31:17<21:58:37,  3.82it/s]
 19%|█▊        | 69436/371472 [5:31:17<21:45:31,  3.86it/s]
 19%|█▊        | 69437/371472 [5:31:17<21:38:21,  3.88it/s]
 19%|█▊        | 69438/371472 [5:31:18<22:28:25,  3.73it/s]
 19%|█▊        | 69439/371472 [5:31:18<22:55:42,  3.66it/s]
 19%|█▊        | 69440/371472 [5:31:18<24:25:06,  3.44it/s]
                                                           
{'loss': 4.0723, 'learning_rate': 8.321554008920684e-07, 'epoch': 2.99}

 19%|█▊        | 69440/371472 [5:31:18<24:25:06,  3.44it/s]
 19%|█▊        | 69441/371472 [5:31:19<24:15:58,  3.46it/s]
 19%|█▊        | 69442/371472 [5:31:19<24:17:11,  3.45it/s]
 19%|█▊        | 69443/371472 [5:31:19<23:16:27,  3.60it/s]
 19%|█▊        | 69444/371472 [5:31:19<23:11:43,  3.62it/s]
 19%|█▊        | 69445/371472 [5:31:20<23:51:23,  3.52it/s]
 19%|█▊        | 69446/371472 [5:31:20<24:12:05,  3.47it/s]
 19%|█▊        | 69447/371472 [5:31:20<23:24:28,  3.58it/s]
 19%|█▊        | 69448/371472 [5:31:20<22:22:54,  3.75it/s]
 19%|█▊        | 69449/371472 [5:31:21<24:30:56,  3.42it/s]
 19%|█▊        | 69450/371472 [5:31:21<23:31:41,  3.57it/s]
 19%|█▊        | 69451/371472 [5:31:21<23:25:13,  3.58it/s]
 19%|█▊        | 69452/371472 [5:31:22<23:08:16,  3.63it/s]
 19%|█▊        | 69453/371472 [5:31:22<23:39:08,  3.55it/s]
 19%|█▊        | 69454/371472 [5:31:22<24:57:35,  3.36it/s]
 19%|█▊        | 69455/371472 [5:31:23<26:59:22,  3.11it/s]
 19%|█▊        | 69456/371472 [5:31:23<26:49:46,  3.13it/s]
 19%|█▊        | 69457/371472 [5:31:23<26:03:41,  3.22it/s]
 19%|█▊        | 69458/371472 [5:31:23<24:46:14,  3.39it/s]
 19%|█▊        | 69459/371472 [5:31:24<24:21:46,  3.44it/s]
 19%|█▊        | 69460/371472 [5:31:24<23:58:59,  3.50it/s]
                                                           
{'loss': 3.9664, 'learning_rate': 8.321069189165894e-07, 'epoch': 2.99}

 19%|█▊        | 69460/371472 [5:31:24<23:58:59,  3.50it/s]
 19%|█▊        | 69461/371472 [5:31:24<24:40:17,  3.40it/s]
 19%|█▊        | 69462/371472 [5:31:25<24:02:49,  3.49it/s]
 19%|█▊        | 69463/371472 [5:31:25<24:55:09,  3.37it/s]
 19%|█▊        | 69464/371472 [5:31:25<23:56:47,  3.50it/s]
 19%|█▊        | 69465/371472 [5:31:25<23:43:32,  3.54it/s]
 19%|█▊        | 69466/371472 [5:31:26<23:55:56,  3.51it/s]
 19%|█▊        | 69467/371472 [5:31:26<23:42:39,  3.54it/s]
 19%|█▊        | 69468/371472 [5:31:26<24:11:07,  3.47it/s]
 19%|█▊        | 69469/371472 [5:31:27<24:07:53,  3.48it/s]
 19%|█▊        | 69470/371472 [5:31:27<23:33:46,  3.56it/s]
 19%|█▊        | 69471/371472 [5:31:27<22:45:33,  3.69it/s]
 19%|█▊        | 69472/371472 [5:31:27<23:34:03,  3.56it/s]
 19%|█▊        | 69473/371472 [5:31:28<24:28:29,  3.43it/s]
 19%|█▊        | 69474/371472 [5:31:28<24:16:01,  3.46it/s]
 19%|█▊        | 69475/371472 [5:31:28<24:23:59,  3.44it/s]
 19%|█▊        | 69476/371472 [5:31:29<23:46:38,  3.53it/s]
 19%|█▊        | 69477/371472 [5:31:29<23:06:49,  3.63it/s]
 19%|█▊        | 69478/371472 [5:31:29<24:13:37,  3.46it/s]
 19%|█▊        | 69479/371472 [5:31:29<24:28:29,  3.43it/s]
 19%|█▊        | 69480/371472 [5:31:30<23:29:00,  3.57it/s]
                                                           
{'loss': 4.2113, 'learning_rate': 8.320584369411105e-07, 'epoch': 2.99}

 19%|█▊        | 69480/371472 [5:31:30<23:29:00,  3.57it/s]
 19%|█▊        | 69481/371472 [5:31:30<22:44:36,  3.69it/s]
 19%|█▊        | 69482/371472 [5:31:30<22:26:10,  3.74it/s]
 19%|█▊        | 69483/371472 [5:31:31<22:47:58,  3.68it/s]
 19%|█▊        | 69484/371472 [5:31:31<22:21:26,  3.75it/s]
 19%|█▊        | 69485/371472 [5:31:31<25:45:21,  3.26it/s]
 19%|█▊        | 69486/371472 [5:31:31<24:05:50,  3.48it/s]
 19%|█▊        | 69487/371472 [5:31:32<24:29:52,  3.42it/s]
 19%|█▊        | 69488/371472 [5:31:32<24:59:44,  3.36it/s]
 19%|█▊        | 69489/371472 [5:31:32<24:49:37,  3.38it/s]
 19%|█▊        | 69490/371472 [5:31:33<25:23:46,  3.30it/s]
 19%|█▊        | 69491/371472 [5:31:33<24:35:40,  3.41it/s]
 19%|█▊        | 69492/371472 [5:31:33<25:17:50,  3.32it/s]
 19%|█▊        | 69493/371472 [5:31:34<25:04:19,  3.35it/s]
 19%|█▊        | 69494/371472 [5:31:34<34:52:43,  2.40it/s]
 19%|█▊        | 69495/371472 [5:31:35<33:29:07,  2.51it/s]
 19%|█▊        | 69496/371472 [5:31:35<30:09:34,  2.78it/s]
 19%|█▊        | 69497/371472 [5:31:35<27:53:42,  3.01it/s]
 19%|█▊        | 69498/371472 [5:31:35<28:24:49,  2.95it/s]
 19%|█▊        | 69499/371472 [5:31:36<27:08:38,  3.09it/s]
 19%|█▊        | 69500/371472 [5:31:36<25:41:10,  3.27it/s]
                                                           
{'loss': 3.9184, 'learning_rate': 8.320099549656316e-07, 'epoch': 2.99}

 19%|█▊        | 69500/371472 [5:31:36<25:41:10,  3.27it/s]
 19%|█▊        | 69501/371472 [5:31:36<26:00:11,  3.23it/s]
 19%|█▊        | 69502/371472 [5:31:37<24:32:31,  3.42it/s]
 19%|█▊        | 69503/371472 [5:31:37<23:38:09,  3.55it/s]
 19%|█▊        | 69504/371472 [5:31:37<23:47:41,  3.53it/s]
 19%|█▊        | 69505/371472 [5:31:38<26:35:14,  3.15it/s]
 19%|█▊        | 69506/371472 [5:31:38<26:19:30,  3.19it/s]
 19%|█▊        | 69507/371472 [5:31:38<24:36:49,  3.41it/s]
 19%|█▊        | 69508/371472 [5:31:38<25:02:49,  3.35it/s]
 19%|█▊        | 69509/371472 [5:31:39<24:55:28,  3.37it/s]
 19%|█▊        | 69510/371472 [5:31:39<25:00:18,  3.35it/s]
 19%|█▊        | 69511/371472 [5:31:39<23:36:21,  3.55it/s]
 19%|█▊        | 69512/371472 [5:31:40<22:52:38,  3.67it/s]
 19%|█▊        | 69513/371472 [5:31:40<21:55:24,  3.83it/s]
 19%|█▊        | 69514/371472 [5:31:40<23:20:28,  3.59it/s]
 19%|█▊        | 69515/371472 [5:31:40<22:27:02,  3.74it/s]
 19%|█▊        | 69516/371472 [5:31:41<22:43:29,  3.69it/s]
 19%|█▊        | 69517/371472 [5:31:41<22:12:16,  3.78it/s]
 19%|█▊        | 69518/371472 [5:31:41<21:38:51,  3.87it/s]
 19%|█▊        | 69519/371472 [5:31:41<21:40:28,  3.87it/s]
 19%|█▊        | 69520/371472 [5:31:42<22:36:08,  3.71it/s]
                                                           
{'loss': 4.489, 'learning_rate': 8.319614729901528e-07, 'epoch': 2.99}

 19%|█▊        | 69520/371472 [5:31:42<22:36:08,  3.71it/s]
 19%|█▊        | 69521/371472 [5:31:42<22:41:34,  3.70it/s]
 19%|█▊        | 69522/371472 [5:31:42<22:46:35,  3.68it/s]
 19%|█▊        | 69523/371472 [5:31:42<22:51:51,  3.67it/s]
 19%|█▊        | 69524/371472 [5:31:43<23:12:32,  3.61it/s]
 19%|█▊        | 69525/371472 [5:31:43<22:55:27,  3.66it/s]
 19%|█▊        | 69526/371472 [5:31:43<22:18:53,  3.76it/s]
 19%|█▊        | 69527/371472 [5:31:44<22:32:11,  3.72it/s]
 19%|█▊        | 69528/371472 [5:31:44<22:40:16,  3.70it/s]
 19%|█▊        | 69529/371472 [5:31:44<22:51:01,  3.67it/s]
 19%|█▊        | 69530/371472 [5:31:44<22:33:59,  3.72it/s]
 19%|█▊        | 69531/371472 [5:31:45<22:24:08,  3.74it/s]
 19%|█▊        | 69532/371472 [5:31:45<22:37:12,  3.71it/s]
 19%|█▊        | 69533/371472 [5:31:45<23:04:22,  3.64it/s]
 19%|█▊        | 69534/371472 [5:31:45<22:14:52,  3.77it/s]
 19%|█▊        | 69535/371472 [5:31:46<24:29:32,  3.42it/s]
 19%|█▊        | 69536/371472 [5:31:46<25:06:53,  3.34it/s]
 19%|█▊        | 69537/371472 [5:31:46<23:53:10,  3.51it/s]
 19%|█▊        | 69538/371472 [5:31:47<22:28:29,  3.73it/s]
 19%|█▊        | 69539/371472 [5:31:47<22:26:16,  3.74it/s]
 19%|█▊        | 69540/371472 [5:31:47<22:23:52,  3.74it/s]
                                                           
{'loss': 4.3433, 'learning_rate': 8.319129910146738e-07, 'epoch': 3.0}

 19%|█▊        | 69540/371472 [5:31:47<22:23:52,  3.74it/s]
 19%|█▊        | 69541/371472 [5:31:47<22:56:28,  3.66it/s]
 19%|█▊        | 69542/371472 [5:31:48<22:21:01,  3.75it/s]
 19%|█▊        | 69543/371472 [5:31:48<22:06:41,  3.79it/s]
 19%|█▊        | 69544/371472 [5:31:48<23:05:25,  3.63it/s]
 19%|█▊        | 69545/371472 [5:31:48<23:38:44,  3.55it/s]
 19%|█▊        | 69546/371472 [5:31:49<23:37:05,  3.55it/s]
 19%|█▊        | 69547/371472 [5:31:49<30:38:03,  2.74it/s]
 19%|█▊        | 69548/371472 [5:31:50<28:44:12,  2.92it/s]
 19%|█▊        | 69549/371472 [5:31:50<26:49:27,  3.13it/s]
 19%|█▊        | 69550/371472 [5:31:50<25:10:25,  3.33it/s]
 19%|█▊        | 69551/371472 [5:31:50<25:59:37,  3.23it/s]
 19%|█▊        | 69552/371472 [5:31:51<25:11:03,  3.33it/s]
 19%|█▊        | 69553/371472 [5:31:51<23:53:04,  3.51it/s]
 19%|█▊        | 69554/371472 [5:31:51<23:59:48,  3.49it/s]
 19%|█▊        | 69555/371472 [5:31:52<23:52:29,  3.51it/s]
 19%|█▊        | 69556/371472 [5:31:52<24:02:14,  3.49it/s]
 19%|█▊        | 69557/371472 [5:31:52<23:34:48,  3.56it/s]
 19%|█▊        | 69558/371472 [5:31:52<24:53:11,  3.37it/s]
 19%|█▊        | 69559/371472 [5:31:53<28:11:11,  2.98it/s]
 19%|█▊        | 69560/371472 [5:31:53<26:41:59,  3.14it/s]
                                                           
{'loss': 4.1775, 'learning_rate': 8.31864509039195e-07, 'epoch': 3.0}

 19%|█▊        | 69560/371472 [5:31:53<26:41:59,  3.14it/s]
 19%|█▊        | 69561/371472 [5:31:53<25:26:23,  3.30it/s]
 19%|█▊        | 69562/371472 [5:31:54<24:43:35,  3.39it/s]
 19%|█▊        | 69563/371472 [5:31:54<24:11:15,  3.47it/s]
 19%|█▊        | 69564/371472 [5:31:54<25:05:41,  3.34it/s]
 19%|█▊        | 69565/371472 [5:31:55<23:47:46,  3.52it/s]
 19%|█▊        | 69566/371472 [5:31:55<25:17:46,  3.32it/s]
 19%|█▊        | 69567/371472 [5:31:55<23:45:39,  3.53it/s]
 19%|█▊        | 69568/371472 [5:31:55<23:30:38,  3.57it/s]
 19%|█▊        | 69569/371472 [5:31:56<23:09:18,  3.62it/s]
 19%|█▊        | 69570/371472 [5:31:56<22:25:32,  3.74it/s]
 19%|█▊        | 69571/371472 [5:31:56<24:10:11,  3.47it/s]
 19%|█▊        | 69572/371472 [5:31:57<23:11:48,  3.62it/s]
 19%|█▊        | 69573/371472 [5:31:57<22:13:42,  3.77it/s]
 19%|█▊        | 69574/371472 [5:31:57<22:34:42,  3.71it/s]
 19%|█▊        | 69575/371472 [5:31:57<22:23:17,  3.75it/s]
 19%|█▊        | 69576/371472 [5:31:58<22:00:20,  3.81it/s]
 19%|█▊        | 69577/371472 [5:31:58<25:19:42,  3.31it/s]
 19%|█▊        | 69578/371472 [5:31:58<26:36:33,  3.15it/s]
 19%|█▊        | 69579/371472 [5:31:59<25:35:37,  3.28it/s]
 19%|█▊        | 69580/371472 [5:31:59<24:59:23,  3.36it/s]
                                                           
{'loss': 4.1645, 'learning_rate': 8.318160270637161e-07, 'epoch': 3.0}

 19%|█▊        | 69580/371472 [5:31:59<24:59:23,  3.36it/s]
 19%|█▊        | 69581/371472 [5:31:59<23:59:09,  3.50it/s]
 19%|█▊        | 69582/371472 [5:31:59<23:53:02,  3.51it/s]
 19%|█▊        | 69583/371472 [5:32:00<23:25:07,  3.58it/s]
 19%|█▊        | 69584/371472 [5:32:00<22:55:02,  3.66it/s]
 19%|█▊        | 69585/371472 [5:32:00<22:58:16,  3.65it/s]
 19%|█▊        | 69586/371472 [5:32:00<23:05:54,  3.63it/s]
 19%|█▊        | 69587/371472 [5:32:01<22:04:04,  3.80it/s]
 19%|█▊        | 69588/371472 [5:32:01<22:17:33,  3.76it/s]
 19%|█▊        | 69589/371472 [5:32:01<21:39:16,  3.87it/s]
 19%|█▊        | 69590/371472 [5:32:02<22:44:28,  3.69it/s]
 19%|█▊        | 69591/371472 [5:32:02<22:37:02,  3.71it/s]
 19%|█▊        | 69592/371472 [5:32:02<22:01:59,  3.81it/s]
 19%|█▊        | 69593/371472 [5:32:02<21:37:07,  3.88it/s]
 19%|█▊        | 69594/371472 [5:32:03<21:11:05,  3.96it/s]
 19%|█▊        | 69595/371472 [5:32:03<22:06:57,  3.79it/s]
 19%|█▊        | 69596/371472 [5:32:03<22:40:30,  3.70it/s]
 19%|█▊        | 69597/371472 [5:32:03<22:30:46,  3.72it/s]
 19%|█▊        | 69598/371472 [5:32:04<22:05:29,  3.80it/s]
 19%|█▊        | 69599/371472 [5:32:04<23:00:26,  3.64it/s]
 19%|█▊        | 69600/371472 [5:32:04<22:51:30,  3.67it/s]
                                                           
{'loss': 4.0936, 'learning_rate': 8.317675450882371e-07, 'epoch': 3.0}

 19%|█▊        | 69600/371472 [5:32:04<22:51:30,  3.67it/s]
 19%|█▊        | 69601/371472 [5:32:04<23:19:37,  3.59it/s]
 19%|█▊        | 69602/371472 [5:32:05<22:28:17,  3.73it/s]
 19%|█▊        | 69603/371472 [5:32:05<23:25:46,  3.58it/s]
 19%|█▊        | 69604/371472 [5:32:05<22:58:31,  3.65it/s]
 19%|█▊        | 69605/371472 [5:32:06<22:25:40,  3.74it/s]
 19%|█▊        | 69606/371472 [5:32:06<23:11:05,  3.62it/s]
 19%|█▊        | 69607/371472 [5:32:06<22:45:07,  3.69it/s]
 19%|█▊        | 69608/371472 [5:32:06<23:11:33,  3.62it/s]
 19%|█▊        | 69609/371472 [5:32:07<23:36:08,  3.55it/s]
 19%|█▊        | 69610/371472 [5:32:07<23:07:03,  3.63it/s]
 19%|█▊        | 69611/371472 [5:32:07<23:46:09,  3.53it/s]
 19%|█▊        | 69612/371472 [5:32:07<22:50:47,  3.67it/s]
 19%|█▊        | 69613/371472 [5:32:08<23:21:42,  3.59it/s]
 19%|█▊        | 69614/371472 [5:32:08<22:46:02,  3.68it/s]
 19%|█▊        | 69615/371472 [5:32:08<23:46:11,  3.53it/s]
 19%|█▊        | 69616/371472 [5:32:09<22:55:49,  3.66it/s]
 19%|█▊        | 69617/371472 [5:32:09<22:54:46,  3.66it/s]
 19%|█▊        | 69618/371472 [5:32:09<24:11:36,  3.47it/s]
 19%|█▊        | 69619/371472 [5:32:09<23:15:12,  3.61it/s]
 19%|█▊        | 69620/371472 [5:32:10<22:29:45,  3.73it/s]
                                                           
{'loss': 4.243, 'learning_rate': 8.317190631127582e-07, 'epoch': 3.0}

 19%|█▊        | 69620/371472 [5:32:10<22:29:45,  3.73it/s]
 19%|█▊        | 69621/371472 [5:32:10<22:14:46,  3.77it/s]
 19%|█▊        | 69622/371472 [5:32:10<22:52:39,  3.67it/s]
 19%|█▊        | 69623/371472 [5:32:10<22:39:18,  3.70it/s]
 19%|█▊        | 69624/371472 [5:32:11<23:26:12,  3.58it/s]
 19%|█▊        | 69625/371472 [5:32:11<24:42:41,  3.39it/s]
 19%|█▊        | 69626/371472 [5:32:11<23:51:03,  3.52it/s]
 19%|█▊        | 69627/371472 [5:32:12<23:26:36,  3.58it/s]
 19%|█▊        | 69628/371472 [5:32:12<23:18:51,  3.60it/s]
 19%|█▊        | 69629/371472 [5:32:12<23:48:10,  3.52it/s]
 19%|█▊        | 69630/371472 [5:32:12<23:20:26,  3.59it/s]
 19%|█▊        | 69631/371472 [5:32:13<23:16:34,  3.60it/s]
 19%|█▊        | 69632/371472 [5:32:13<22:41:04,  3.70it/s]
 19%|█▊        | 69633/371472 [5:32:13<22:22:39,  3.75it/s]
 19%|█▊        | 69634/371472 [5:32:14<22:05:47,  3.79it/s]
 19%|█▊        | 69635/371472 [5:32:14<22:30:46,  3.72it/s]
 19%|█▊        | 69636/371472 [5:32:14<23:09:15,  3.62it/s]
 19%|█▊        | 69637/371472 [5:32:14<23:24:09,  3.58it/s]
 19%|█▊        | 69638/371472 [5:32:15<23:29:58,  3.57it/s]
 19%|█▊        | 69639/371472 [5:32:15<23:09:35,  3.62it/s]
 19%|█▊        | 69640/371472 [5:32:15<23:26:12,  3.58it/s]
                                                           
{'loss': 4.3322, 'learning_rate': 8.316705811372794e-07, 'epoch': 3.0}

 19%|█▊        | 69640/371472 [5:32:15<23:26:12,  3.58it/s]
 19%|█▊        | 69641/371472 [5:32:16<23:58:04,  3.50it/s]
 19%|█▊        | 69642/371472 [5:32:16<24:15:31,  3.46it/s]
 19%|█▊        | 69643/371472 [5:32:16<23:35:58,  3.55it/s]
 19%|█▊        | 69644/371472 [5:32:16<23:13:56,  3.61it/s]
 19%|█▊        | 69645/371472 [5:32:17<23:41:02,  3.54it/s]
 19%|█▊        | 69646/371472 [5:32:17<22:23:40,  3.74it/s]
 19%|█▊        | 69647/371472 [5:32:17<22:01:15,  3.81it/s]
 19%|█▊        | 69648/371472 [5:32:17<21:27:51,  3.91it/s]
 19%|█▊        | 69649/371472 [5:32:18<22:20:27,  3.75it/s]
 19%|█▊        | 69650/371472 [5:32:18<23:20:08,  3.59it/s]
 19%|█▉        | 69651/371472 [5:32:18<24:42:08,  3.39it/s]Some non-default generation parameters are set in the model config. These should go into a GenerationConfig file (https://huggingface.co/docs/transformers/generation_strategies#save-a-custom-decoding-strategy-with-your-model) instead. This warning will be raised to an exception in v4.41.
Non-default generation parameters: {'max_length': 200, 'early_stopping': True, 'num_beams': 5, 'forced_eos_token_id': 2}
/opt/conda/lib/python3.10/multiprocessing/popen_fork.py:66: RuntimeWarning: os.fork() was called. os.fork() is incompatible with multithreaded code, and JAX is multithreaded, so this will likely lead to a deadlock.
  self.pid = os.fork()

 19%|█▉        | 69652/371472 [5:32:42<617:58:13,  7.37s/it]
 19%|█▉        | 69653/371472 [5:32:43<442:04:09,  5.27s/it]
 19%|█▉        | 69654/371472 [5:32:43<316:56:47,  3.78s/it]
 19%|█▉        | 69655/371472 [5:32:43<229:25:25,  2.74s/it]
 19%|█▉        | 69656/371472 [5:32:43<167:56:41,  2.00s/it]
 19%|█▉        | 69657/371472 [5:32:44<128:01:01,  1.53s/it]
 19%|█▉        | 69658/371472 [5:32:44<97:18:02,  1.16s/it] 
 19%|█▉        | 69659/371472 [5:32:44<75:43:35,  1.11it/s]
 19%|█▉        | 69660/371472 [5:32:45<60:46:46,  1.38it/s]
                                                           
{'loss': 4.1925, 'learning_rate': 8.316220991618005e-07, 'epoch': 3.0}

 19%|█▉        | 69660/371472 [5:32:45<60:46:46,  1.38it/s]
 19%|█▉        | 69661/371472 [5:32:45<50:39:16,  1.66it/s]
 19%|█▉        | 69662/371472 [5:32:45<43:22:36,  1.93it/s]
 19%|█▉        | 69663/371472 [5:32:46<37:42:02,  2.22it/s]
 19%|█▉        | 69664/371472 [5:32:46<32:41:52,  2.56it/s]
 19%|█▉        | 69665/371472 [5:32:46<31:42:58,  2.64it/s]
 19%|█▉        | 69666/371472 [5:32:47<31:02:58,  2.70it/s]
 19%|█▉        | 69667/371472 [5:32:47<29:43:58,  2.82it/s]
 19%|█▉        | 69668/371472 [5:32:47<27:18:30,  3.07it/s]
 19%|█▉        | 69669/371472 [5:32:48<25:29:28,  3.29it/s]
 19%|█▉        | 69670/371472 [5:32:48<24:02:37,  3.49it/s]
 19%|█▉        | 69671/371472 [5:32:48<25:13:16,  3.32it/s]
 19%|█▉        | 69672/371472 [5:32:48<26:01:42,  3.22it/s]
 19%|█▉        | 69673/371472 [5:32:49<25:53:59,  3.24it/s]
 19%|█▉        | 69674/371472 [5:32:49<25:20:53,  3.31it/s]
 19%|█▉        | 69675/371472 [5:32:49<24:38:32,  3.40it/s]
 19%|█▉        | 69676/371472 [5:32:50<25:34:18,  3.28it/s]
 19%|█▉        | 69677/371472 [5:32:50<25:14:00,  3.32it/s]
 19%|█▉        | 69678/371472 [5:32:50<24:10:48,  3.47it/s]
 19%|█▉        | 69679/371472 [5:32:50<24:25:25,  3.43it/s]
 19%|█▉        | 69680/371472 [5:32:51<24:34:15,  3.41it/s]
                                                           
{'loss': 4.1922, 'learning_rate': 8.315736171863215e-07, 'epoch': 3.0}

 19%|█▉        | 69680/371472 [5:32:51<24:34:15,  3.41it/s]
 19%|█▉        | 69681/371472 [5:32:51<26:39:11,  3.15it/s]
 19%|█▉        | 69682/371472 [5:32:51<25:44:31,  3.26it/s]
 19%|█▉        | 69683/371472 [5:32:52<25:13:01,  3.32it/s]
 19%|█▉        | 69684/371472 [5:32:52<24:12:55,  3.46it/s]
 19%|█▉        | 69685/371472 [5:32:52<24:00:11,  3.49it/s]
 19%|█▉        | 69686/371472 [5:32:53<23:54:51,  3.51it/s]
 19%|█▉        | 69687/371472 [5:32:53<23:08:06,  3.62it/s]
 19%|█▉        | 69688/371472 [5:32:53<23:11:54,  3.61it/s]
 19%|█▉        | 69689/371472 [5:32:53<23:18:51,  3.60it/s]
 19%|█▉        | 69690/371472 [5:32:54<23:22:40,  3.59it/s]
 19%|█▉        | 69691/371472 [5:32:54<23:12:29,  3.61it/s]
 19%|█▉        | 69692/371472 [5:32:54<23:14:59,  3.61it/s]
 19%|█▉        | 69693/371472 [5:32:54<22:27:33,  3.73it/s]
 19%|█▉        | 69694/371472 [5:32:55<22:17:11,  3.76it/s]
 19%|█▉        | 69695/371472 [5:32:55<22:03:23,  3.80it/s]
 19%|█▉        | 69696/371472 [5:32:55<23:24:30,  3.58it/s]
 19%|█▉        | 69697/371472 [5:32:56<22:40:36,  3.70it/s]
 19%|█▉        | 69698/371472 [5:32:56<22:21:24,  3.75it/s]
 19%|█▉        | 69699/371472 [5:32:56<23:07:36,  3.62it/s]
 19%|█▉        | 69700/371472 [5:32:56<22:50:53,  3.67it/s]
                                                           
{'loss': 4.2554, 'learning_rate': 8.315251352108427e-07, 'epoch': 3.0}

 19%|█▉        | 69700/371472 [5:32:56<22:50:53,  3.67it/s]
 19%|█▉        | 69701/371472 [5:32:57<23:14:08,  3.61it/s]
 19%|█▉        | 69702/371472 [5:32:57<24:22:03,  3.44it/s]
 19%|█▉        | 69703/371472 [5:32:57<24:13:18,  3.46it/s]
 19%|█▉        | 69704/371472 [5:32:57<23:38:45,  3.54it/s]
 19%|█▉        | 69705/371472 [5:32:58<23:21:56,  3.59it/s]
 19%|█▉        | 69706/371472 [5:32:58<24:02:44,  3.49it/s]
 19%|█▉        | 69707/371472 [5:32:58<24:56:19,  3.36it/s]
 19%|█▉        | 69708/371472 [5:32:59<24:46:11,  3.38it/s]
 19%|█▉        | 69709/371472 [5:32:59<24:17:38,  3.45it/s]
 19%|█▉        | 69710/371472 [5:32:59<24:15:07,  3.46it/s]
 19%|█▉        | 69711/371472 [5:33:00<24:01:40,  3.49it/s]
 19%|█▉        | 69712/371472 [5:33:00<24:22:36,  3.44it/s]
 19%|█▉        | 69713/371472 [5:33:00<24:10:46,  3.47it/s]
 19%|█▉        | 69714/371472 [5:33:00<23:43:32,  3.53it/s]
 19%|█▉        | 69715/371472 [5:33:01<23:07:14,  3.63it/s]
 19%|█▉        | 69716/371472 [5:33:01<22:34:26,  3.71it/s]
 19%|█▉        | 69717/371472 [5:33:01<23:18:46,  3.60it/s]
 19%|█▉        | 69718/371472 [5:33:01<23:19:28,  3.59it/s]
 19%|█▉        | 69719/371472 [5:33:02<23:16:58,  3.60it/s]
 19%|█▉        | 69720/371472 [5:33:02<23:04:24,  3.63it/s]
                                                           
{'loss': 4.001, 'learning_rate': 8.314766532353639e-07, 'epoch': 3.0}

 19%|█▉        | 69720/371472 [5:33:02<23:04:24,  3.63it/s]
 19%|█▉        | 69721/371472 [5:33:02<23:19:08,  3.59it/s]
 19%|█▉        | 69722/371472 [5:33:03<23:09:53,  3.62it/s]
 19%|█▉        | 69723/371472 [5:33:03<25:29:00,  3.29it/s]
 19%|█▉        | 69724/371472 [5:33:03<24:24:38,  3.43it/s]
 19%|█▉        | 69725/371472 [5:33:03<23:29:03,  3.57it/s]
 19%|█▉        | 69726/371472 [5:33:04<25:00:28,  3.35it/s]
 19%|█▉        | 69727/371472 [5:33:04<26:47:19,  3.13it/s]
 19%|█▉        | 69728/371472 [5:33:04<26:35:53,  3.15it/s]
 19%|█▉        | 69729/371472 [5:33:05<25:54:09,  3.24it/s]
 19%|█▉        | 69730/371472 [5:33:05<24:38:01,  3.40it/s]
 19%|█▉        | 69731/371472 [5:33:05<26:32:59,  3.16it/s]
 19%|█▉        | 69732/371472 [5:33:06<28:05:42,  2.98it/s]
 19%|█▉        | 69733/371472 [5:33:06<26:58:06,  3.11it/s]
 19%|█▉        | 69734/371472 [5:33:06<28:04:36,  2.99it/s]
 19%|█▉        | 69735/371472 [5:33:07<26:41:24,  3.14it/s]
 19%|█▉        | 69736/371472 [5:33:07<25:32:43,  3.28it/s]
 19%|█▉        | 69737/371472 [5:33:07<24:40:29,  3.40it/s]
 19%|█▉        | 69738/371472 [5:33:08<23:53:17,  3.51it/s]
 19%|█▉        | 69739/371472 [5:33:08<24:51:06,  3.37it/s]
 19%|█▉        | 69740/371472 [5:33:08<23:35:13,  3.55it/s]
                                                           
{'loss': 4.1319, 'learning_rate': 8.314281712598849e-07, 'epoch': 3.0}

 19%|█▉        | 69740/371472 [5:33:08<23:35:13,  3.55it/s]
 19%|█▉        | 69741/371472 [5:33:08<23:45:22,  3.53it/s]
 19%|█▉        | 69742/371472 [5:33:09<23:47:42,  3.52it/s]
 19%|█▉        | 69743/371472 [5:33:09<24:43:30,  3.39it/s]
 19%|█▉        | 69744/371472 [5:33:09<24:11:22,  3.46it/s]
 19%|█▉        | 69745/371472 [5:33:10<23:32:15,  3.56it/s]
 19%|█▉        | 69746/371472 [5:33:10<23:27:58,  3.57it/s]
 19%|█▉        | 69747/371472 [5:33:10<24:00:16,  3.49it/s]
 19%|█▉        | 69748/371472 [5:33:10<23:00:28,  3.64it/s]
 19%|█▉        | 69749/371472 [5:33:11<24:09:08,  3.47it/s]
 19%|█▉        | 69750/371472 [5:33:11<23:42:47,  3.53it/s]
 19%|█▉        | 69751/371472 [5:33:11<22:56:36,  3.65it/s]
 19%|█▉        | 69752/371472 [5:33:12<24:59:14,  3.35it/s]
 19%|█▉        | 69753/371472 [5:33:12<23:49:23,  3.52it/s]
 19%|█▉        | 69754/371472 [5:33:12<24:10:01,  3.47it/s]
 19%|█▉        | 69755/371472 [5:33:12<22:50:14,  3.67it/s]
 19%|█▉        | 69756/371472 [5:33:13<23:30:16,  3.57it/s]
 19%|█▉        | 69757/371472 [5:33:13<26:13:04,  3.20it/s]
 19%|█▉        | 69758/371472 [5:33:13<25:45:25,  3.25it/s]
 19%|█▉        | 69759/371472 [5:33:14<27:02:35,  3.10it/s]
 19%|█▉        | 69760/371472 [5:33:14<25:15:27,  3.32it/s]
                                                           
{'loss': 4.1174, 'learning_rate': 8.313796892844059e-07, 'epoch': 3.0}

 19%|█▉        | 69760/371472 [5:33:14<25:15:27,  3.32it/s]
 19%|█▉        | 69761/371472 [5:33:14<26:34:02,  3.15it/s]
 19%|█▉        | 69762/371472 [5:33:15<25:39:08,  3.27it/s]
 19%|█▉        | 69763/371472 [5:33:15<24:43:29,  3.39it/s]
 19%|█▉        | 69764/371472 [5:33:15<23:48:47,  3.52it/s]
 19%|█▉        | 69765/371472 [5:33:15<23:03:08,  3.64it/s]
 19%|█▉        | 69766/371472 [5:33:16<23:07:28,  3.62it/s]
 19%|█▉        | 69767/371472 [5:33:16<22:45:02,  3.68it/s]
 19%|█▉        | 69768/371472 [5:33:16<21:47:26,  3.85it/s]
 19%|█▉        | 69769/371472 [5:33:16<22:10:11,  3.78it/s]
 19%|█▉        | 69770/371472 [5:33:17<21:53:50,  3.83it/s]
 19%|█▉        | 69771/371472 [5:33:17<22:12:56,  3.77it/s]
 19%|█▉        | 69772/371472 [5:33:17<22:45:35,  3.68it/s]
 19%|█▉        | 69773/371472 [5:33:17<22:27:11,  3.73it/s]
 19%|█▉        | 69774/371472 [5:33:18<23:00:58,  3.64it/s]
 19%|█▉        | 69775/371472 [5:33:18<25:00:27,  3.35it/s]
 19%|█▉        | 69776/371472 [5:33:18<24:57:52,  3.36it/s]
 19%|█▉        | 69777/371472 [5:33:19<24:10:37,  3.47it/s]
 19%|█▉        | 69778/371472 [5:33:19<25:19:09,  3.31it/s]
 19%|█▉        | 69779/371472 [5:33:19<24:42:42,  3.39it/s]
 19%|█▉        | 69780/371472 [5:33:20<23:23:00,  3.58it/s]
                                                           
{'loss': 4.0008, 'learning_rate': 8.313312073089271e-07, 'epoch': 3.01}

 19%|█▉        | 69780/371472 [5:33:20<23:23:00,  3.58it/s]
 19%|█▉        | 69781/371472 [5:33:20<22:50:39,  3.67it/s]
 19%|█▉        | 69782/371472 [5:33:20<23:10:51,  3.62it/s]
 19%|█▉        | 69783/371472 [5:33:20<24:23:58,  3.43it/s]
 19%|█▉        | 69784/371472 [5:33:21<25:32:45,  3.28it/s]
 19%|█▉        | 69785/371472 [5:33:21<25:12:01,  3.33it/s]
 19%|█▉        | 69786/371472 [5:33:21<24:31:45,  3.42it/s]
 19%|█▉        | 69787/371472 [5:33:22<24:13:27,  3.46it/s]
 19%|█▉        | 69788/371472 [5:33:22<23:28:27,  3.57it/s]
 19%|█▉        | 69789/371472 [5:33:22<26:54:04,  3.12it/s]
 19%|█▉        | 69790/371472 [5:33:23<25:35:50,  3.27it/s]
 19%|█▉        | 69791/371472 [5:33:23<25:04:26,  3.34it/s]
 19%|█▉        | 69792/371472 [5:33:23<25:42:26,  3.26it/s]
 19%|█▉        | 69793/371472 [5:33:23<24:36:24,  3.41it/s]
 19%|█▉        | 69794/371472 [5:33:24<27:33:55,  3.04it/s]
 19%|█▉        | 69795/371472 [5:33:24<26:27:09,  3.17it/s]
 19%|█▉        | 69796/371472 [5:33:24<26:22:02,  3.18it/s]
 19%|█▉        | 69797/371472 [5:33:25<26:10:20,  3.20it/s]
 19%|█▉        | 69798/371472 [5:33:25<25:04:54,  3.34it/s]
 19%|█▉        | 69799/371472 [5:33:25<24:54:58,  3.36it/s]
 19%|█▉        | 69800/371472 [5:33:26<24:37:34,  3.40it/s]
                                                           
{'loss': 4.1544, 'learning_rate': 8.312827253334482e-07, 'epoch': 3.01}

 19%|█▉        | 69800/371472 [5:33:26<24:37:34,  3.40it/s]
 19%|█▉        | 69801/371472 [5:33:26<24:26:11,  3.43it/s]
 19%|█▉        | 69802/371472 [5:33:26<23:49:57,  3.52it/s]
 19%|█▉        | 69803/371472 [5:33:26<22:56:41,  3.65it/s]
 19%|█▉        | 69804/371472 [5:33:27<22:43:32,  3.69it/s]
 19%|█▉        | 69805/371472 [5:33:27<22:21:06,  3.75it/s]
 19%|█▉        | 69806/371472 [5:33:27<23:47:39,  3.52it/s]
 19%|█▉        | 69807/371472 [5:33:27<24:07:41,  3.47it/s]
 19%|█▉        | 69808/371472 [5:33:28<22:44:23,  3.68it/s]
 19%|█▉        | 69809/371472 [5:33:28<22:19:13,  3.75it/s]
 19%|█▉        | 69810/371472 [5:33:28<22:37:49,  3.70it/s]
 19%|█▉        | 69811/371472 [5:33:29<23:53:25,  3.51it/s]
 19%|█▉        | 69812/371472 [5:33:29<24:47:53,  3.38it/s]
 19%|█▉        | 69813/371472 [5:33:29<24:38:35,  3.40it/s]
 19%|█▉        | 69814/371472 [5:33:29<23:12:05,  3.61it/s]
 19%|█▉        | 69815/371472 [5:33:30<23:33:03,  3.56it/s]
 19%|█▉        | 69816/371472 [5:33:30<23:20:01,  3.59it/s]
 19%|█▉        | 69817/371472 [5:33:30<23:36:03,  3.55it/s]
 19%|█▉        | 69818/371472 [5:33:31<23:39:15,  3.54it/s]
 19%|█▉        | 69819/371472 [5:33:31<23:47:16,  3.52it/s]
 19%|█▉        | 69820/371472 [5:33:31<24:51:51,  3.37it/s]
                                                           
{'loss': 4.3267, 'learning_rate': 8.312342433579694e-07, 'epoch': 3.01}

 19%|█▉        | 69820/371472 [5:33:31<24:51:51,  3.37it/s]
 19%|█▉        | 69821/371472 [5:33:31<24:37:56,  3.40it/s]
 19%|█▉        | 69822/371472 [5:33:32<23:29:52,  3.57it/s]
 19%|█▉        | 69823/371472 [5:33:32<22:38:07,  3.70it/s]
 19%|█▉        | 69824/371472 [5:33:32<23:04:10,  3.63it/s]
 19%|█▉        | 69825/371472 [5:33:33<24:16:44,  3.45it/s]
 19%|█▉        | 69826/371472 [5:33:33<23:47:56,  3.52it/s]
 19%|█▉        | 69827/371472 [5:33:33<23:32:13,  3.56it/s]
 19%|█▉        | 69828/371472 [5:33:33<24:04:02,  3.48it/s]
 19%|█▉        | 69829/371472 [5:33:34<24:18:05,  3.45it/s]
 19%|█▉        | 69830/371472 [5:33:34<24:31:18,  3.42it/s]
 19%|█▉        | 69831/371472 [5:33:34<23:06:44,  3.63it/s]
 19%|█▉        | 69832/371472 [5:33:35<26:08:59,  3.20it/s]
 19%|█▉        | 69833/371472 [5:33:35<25:31:39,  3.28it/s]
 19%|█▉        | 69834/371472 [5:33:35<25:28:22,  3.29it/s]
 19%|█▉        | 69835/371472 [5:33:36<24:56:46,  3.36it/s]
 19%|█▉        | 69836/371472 [5:33:36<23:39:53,  3.54it/s]
 19%|█▉        | 69837/371472 [5:33:36<23:37:56,  3.55it/s]
 19%|█▉        | 69838/371472 [5:33:36<23:44:37,  3.53it/s]
 19%|█▉        | 69839/371472 [5:33:37<23:35:31,  3.55it/s]
 19%|█▉        | 69840/371472 [5:33:37<23:08:21,  3.62it/s]
                                                           
{'loss': 4.0394, 'learning_rate': 8.311857613824904e-07, 'epoch': 3.01}

 19%|█▉        | 69840/371472 [5:33:37<23:08:21,  3.62it/s]
 19%|█▉        | 69841/371472 [5:33:37<23:00:58,  3.64it/s]
 19%|█▉        | 69842/371472 [5:33:37<24:16:00,  3.45it/s]
 19%|█▉        | 69843/371472 [5:33:38<23:38:14,  3.54it/s]
 19%|█▉        | 69844/371472 [5:33:38<23:42:30,  3.53it/s]
 19%|█▉        | 69845/371472 [5:33:38<24:18:43,  3.45it/s]
 19%|█▉        | 69846/371472 [5:33:39<23:39:25,  3.54it/s]
 19%|█▉        | 69847/371472 [5:33:39<24:03:39,  3.48it/s]
 19%|█▉        | 69848/371472 [5:33:39<23:19:15,  3.59it/s]
 19%|█▉        | 69849/371472 [5:33:39<22:18:11,  3.76it/s]
 19%|█▉        | 69850/371472 [5:33:40<23:18:12,  3.60it/s]
 19%|█▉        | 69851/371472 [5:33:40<22:18:54,  3.75it/s]
 19%|█▉        | 69852/371472 [5:33:40<23:47:27,  3.52it/s]
 19%|█▉        | 69853/371472 [5:33:41<23:28:02,  3.57it/s]
 19%|█▉        | 69854/371472 [5:33:41<22:35:32,  3.71it/s]
 19%|█▉        | 69855/371472 [5:33:41<22:47:22,  3.68it/s]
 19%|█▉        | 69856/371472 [5:33:41<22:02:47,  3.80it/s]
 19%|█▉        | 69857/371472 [5:33:42<23:04:28,  3.63it/s]
 19%|█▉        | 69858/371472 [5:33:42<23:57:13,  3.50it/s]
 19%|█▉        | 69859/371472 [5:33:42<25:44:06,  3.26it/s]
 19%|█▉        | 69860/371472 [5:33:43<24:06:37,  3.47it/s]
                                                           
{'loss': 4.3174, 'learning_rate': 8.311372794070115e-07, 'epoch': 3.01}

 19%|█▉        | 69860/371472 [5:33:43<24:06:37,  3.47it/s]
 19%|█▉        | 69861/371472 [5:33:43<23:53:59,  3.51it/s]
 19%|█▉        | 69862/371472 [5:33:43<23:10:58,  3.61it/s]
 19%|█▉        | 69863/371472 [5:33:43<22:24:08,  3.74it/s]
 19%|█▉        | 69864/371472 [5:33:44<22:15:16,  3.76it/s]
 19%|█▉        | 69865/371472 [5:33:44<21:51:38,  3.83it/s]
 19%|█▉        | 69866/371472 [5:33:44<21:54:58,  3.82it/s]
 19%|█▉        | 69867/371472 [5:33:44<21:30:46,  3.89it/s]
 19%|█▉        | 69868/371472 [5:33:45<23:32:01,  3.56it/s]
 19%|█▉        | 69869/371472 [5:33:45<22:47:44,  3.68it/s]
 19%|█▉        | 69870/371472 [5:33:45<23:34:51,  3.55it/s]
 19%|█▉        | 69871/371472 [5:33:45<23:52:39,  3.51it/s]
 19%|█▉        | 69872/371472 [5:33:46<23:05:23,  3.63it/s]
 19%|█▉        | 69873/371472 [5:33:46<22:30:57,  3.72it/s]
 19%|█▉        | 69874/371472 [5:33:46<24:47:37,  3.38it/s]
 19%|█▉        | 69875/371472 [5:33:47<23:47:16,  3.52it/s]
 19%|█▉        | 69876/371472 [5:33:47<24:58:18,  3.35it/s]
 19%|█▉        | 69877/371472 [5:33:47<24:54:20,  3.36it/s]
 19%|█▉        | 69878/371472 [5:33:48<24:54:41,  3.36it/s]
 19%|█▉        | 69879/371472 [5:33:48<27:10:45,  3.08it/s]
 19%|█▉        | 69880/371472 [5:33:48<26:44:43,  3.13it/s]
                                                           
{'loss': 4.0971, 'learning_rate': 8.310887974315326e-07, 'epoch': 3.01}

 19%|█▉        | 69880/371472 [5:33:48<26:44:43,  3.13it/s]
 19%|█▉        | 69881/371472 [5:33:49<27:56:28,  3.00it/s]
 19%|█▉        | 69882/371472 [5:33:49<28:55:29,  2.90it/s]
 19%|█▉        | 69883/371472 [5:33:49<27:44:18,  3.02it/s]
 19%|█▉        | 69884/371472 [5:33:50<26:43:25,  3.13it/s]
 19%|█▉        | 69885/371472 [5:33:50<24:40:49,  3.39it/s]
 19%|█▉        | 69886/371472 [5:33:50<24:24:23,  3.43it/s]
 19%|█▉        | 69887/371472 [5:33:50<22:53:41,  3.66it/s]
 19%|█▉        | 69888/371472 [5:33:51<23:32:04,  3.56it/s]
 19%|█▉        | 69889/371472 [5:33:51<22:46:03,  3.68it/s]
 19%|█▉        | 69890/371472 [5:33:51<22:11:27,  3.78it/s]
 19%|█▉        | 69891/371472 [5:33:51<23:47:47,  3.52it/s]
 19%|█▉        | 69892/371472 [5:33:52<23:48:33,  3.52it/s]
 19%|█▉        | 69893/371472 [5:33:52<22:54:47,  3.66it/s]
 19%|█▉        | 69894/371472 [5:33:52<23:52:03,  3.51it/s]
 19%|█▉        | 69895/371472 [5:33:53<23:57:40,  3.50it/s]
 19%|█▉        | 69896/371472 [5:33:53<25:25:43,  3.29it/s]
 19%|█▉        | 69897/371472 [5:33:53<23:45:59,  3.52it/s]
 19%|█▉        | 69898/371472 [5:33:53<23:46:59,  3.52it/s]
 19%|█▉        | 69899/371472 [5:33:54<24:52:03,  3.37it/s]
 19%|█▉        | 69900/371472 [5:33:54<23:43:18,  3.53it/s]
                                                           
{'loss': 4.0695, 'learning_rate': 8.310403154560537e-07, 'epoch': 3.01}

 19%|█▉        | 69900/371472 [5:33:54<23:43:18,  3.53it/s]
 19%|█▉        | 69901/371472 [5:33:54<24:01:18,  3.49it/s]
 19%|█▉        | 69902/371472 [5:33:55<24:46:56,  3.38it/s]
 19%|█▉        | 69903/371472 [5:33:55<25:20:57,  3.30it/s]
 19%|█▉        | 69904/371472 [5:33:55<25:58:46,  3.22it/s]
 19%|█▉        | 69905/371472 [5:33:56<30:05:10,  2.78it/s]
 19%|█▉        | 69906/371472 [5:33:56<29:27:57,  2.84it/s]
 19%|█▉        | 69907/371472 [5:33:56<30:03:50,  2.79it/s]
 19%|█▉        | 69908/371472 [5:33:57<28:51:30,  2.90it/s]
 19%|█▉        | 69909/371472 [5:33:57<28:23:24,  2.95it/s]
 19%|█▉        | 69910/371472 [5:33:57<26:27:45,  3.17it/s]
 19%|█▉        | 69911/371472 [5:33:58<25:02:29,  3.35it/s]
 19%|█▉        | 69912/371472 [5:33:58<23:37:29,  3.55it/s]
 19%|█▉        | 69913/371472 [5:33:58<23:49:42,  3.52it/s]
 19%|█▉        | 69914/371472 [5:33:59<25:39:56,  3.26it/s]
 19%|█▉        | 69915/371472 [5:33:59<25:54:59,  3.23it/s]
 19%|█▉        | 69916/371472 [5:33:59<25:09:54,  3.33it/s]
 19%|█▉        | 69917/371472 [5:33:59<24:00:45,  3.49it/s]
 19%|█▉        | 69918/371472 [5:34:00<22:48:44,  3.67it/s]
 19%|█▉        | 69919/371472 [5:34:00<23:17:05,  3.60it/s]
 19%|█▉        | 69920/371472 [5:34:00<24:08:36,  3.47it/s]
                                                           
{'loss': 4.3721, 'learning_rate': 8.309918334805748e-07, 'epoch': 3.01}

 19%|█▉        | 69920/371472 [5:34:00<24:08:36,  3.47it/s]
 19%|█▉        | 69921/371472 [5:34:01<25:03:53,  3.34it/s]
 19%|█▉        | 69922/371472 [5:34:01<25:30:38,  3.28it/s]
 19%|█▉        | 69923/371472 [5:34:01<25:20:24,  3.31it/s]
 19%|█▉        | 69924/371472 [5:34:01<24:56:06,  3.36it/s]
 19%|█▉        | 69925/371472 [5:34:02<24:41:30,  3.39it/s]
 19%|█▉        | 69926/371472 [5:34:02<24:28:51,  3.42it/s]
 19%|█▉        | 69927/371472 [5:34:02<24:15:16,  3.45it/s]
 19%|█▉        | 69928/371472 [5:34:03<24:53:40,  3.36it/s]
 19%|█▉        | 69929/371472 [5:34:03<25:50:41,  3.24it/s]
 19%|█▉        | 69930/371472 [5:34:03<24:56:22,  3.36it/s]
 19%|█▉        | 69931/371472 [5:34:03<24:07:38,  3.47it/s]
 19%|█▉        | 69932/371472 [5:34:04<24:15:49,  3.45it/s]
 19%|█▉        | 69933/371472 [5:34:04<23:27:57,  3.57it/s]
 19%|█▉        | 69934/371472 [5:34:04<23:48:02,  3.52it/s]
 19%|█▉        | 69935/371472 [5:34:05<23:05:33,  3.63it/s]
 19%|█▉        | 69936/371472 [5:34:05<24:13:36,  3.46it/s]
 19%|█▉        | 69937/371472 [5:34:05<24:08:51,  3.47it/s]
 19%|█▉        | 69938/371472 [5:34:05<23:48:25,  3.52it/s]
 19%|█▉        | 69939/371472 [5:34:06<22:57:28,  3.65it/s]
 19%|█▉        | 69940/371472 [5:34:06<22:42:49,  3.69it/s]
                                                           
{'loss': 4.2357, 'learning_rate': 8.30943351505096e-07, 'epoch': 3.01}

 19%|█▉        | 69940/371472 [5:34:06<22:42:49,  3.69it/s]
 19%|█▉        | 69941/371472 [5:34:06<23:55:57,  3.50it/s]
 19%|█▉        | 69942/371472 [5:34:07<23:39:16,  3.54it/s]
 19%|█▉        | 69943/371472 [5:34:07<23:27:40,  3.57it/s]
 19%|█▉        | 69944/371472 [5:34:07<23:10:07,  3.62it/s]
 19%|█▉        | 69945/371472 [5:34:07<22:30:19,  3.72it/s]
 19%|█▉        | 69946/371472 [5:34:08<22:13:38,  3.77it/s]
 19%|█▉        | 69947/371472 [5:34:08<22:04:28,  3.79it/s]
 19%|█▉        | 69948/371472 [5:34:08<22:13:56,  3.77it/s]
 19%|█▉        | 69949/371472 [5:34:08<22:11:31,  3.77it/s]
 19%|█▉        | 69950/371472 [5:34:09<22:47:48,  3.67it/s]
 19%|█▉        | 69951/371472 [5:34:09<24:54:59,  3.36it/s]
 19%|█▉        | 69952/371472 [5:34:09<25:07:01,  3.33it/s]
 19%|█▉        | 69953/371472 [5:34:10<24:05:27,  3.48it/s]
 19%|█▉        | 69954/371472 [5:34:10<24:01:45,  3.49it/s]
 19%|█▉        | 69955/371472 [5:34:10<25:41:13,  3.26it/s]
 19%|█▉        | 69956/371472 [5:34:11<24:16:43,  3.45it/s]
 19%|█▉        | 69957/371472 [5:34:11<23:19:50,  3.59it/s]
 19%|█▉        | 69958/371472 [5:34:11<22:59:28,  3.64it/s]
 19%|█▉        | 69959/371472 [5:34:11<24:01:26,  3.49it/s]
 19%|█▉        | 69960/371472 [5:34:12<23:30:47,  3.56it/s]
                                                           
{'loss': 4.1923, 'learning_rate': 8.308948695296171e-07, 'epoch': 3.01}

 19%|█▉        | 69960/371472 [5:34:12<23:30:47,  3.56it/s]
 19%|█▉        | 69961/371472 [5:34:12<24:18:03,  3.45it/s]
 19%|█▉        | 69962/371472 [5:34:12<23:21:09,  3.59it/s]
 19%|█▉        | 69963/371472 [5:34:12<22:48:41,  3.67it/s]
 19%|█▉        | 69964/371472 [5:34:13<23:00:34,  3.64it/s]
 19%|█▉        | 69965/371472 [5:34:13<22:58:29,  3.65it/s]
 19%|█▉        | 69966/371472 [5:34:13<23:29:44,  3.56it/s]
 19%|█▉        | 69967/371472 [5:34:14<23:08:10,  3.62it/s]
 19%|█▉        | 69968/371472 [5:34:14<22:50:37,  3.67it/s]
 19%|█▉        | 69969/371472 [5:34:14<22:24:04,  3.74it/s]
 19%|█▉        | 69970/371472 [5:34:14<22:31:18,  3.72it/s]
 19%|█▉        | 69971/371472 [5:34:15<22:03:30,  3.80it/s]
 19%|█▉        | 69972/371472 [5:34:15<22:39:15,  3.70it/s]
 19%|█▉        | 69973/371472 [5:34:15<22:16:30,  3.76it/s]
 19%|█▉        | 69974/371472 [5:34:15<22:08:02,  3.78it/s]
 19%|█▉        | 69975/371472 [5:34:16<22:23:46,  3.74it/s]
 19%|█▉        | 69976/371472 [5:34:16<22:33:58,  3.71it/s]
 19%|█▉        | 69977/371472 [5:34:16<22:18:09,  3.76it/s]
 19%|█▉        | 69978/371472 [5:34:16<22:26:56,  3.73it/s]
 19%|█▉        | 69979/371472 [5:34:17<21:53:46,  3.82it/s]
 19%|█▉        | 69980/371472 [5:34:17<22:41:14,  3.69it/s]
                                                           
{'loss': 4.2256, 'learning_rate': 8.308463875541382e-07, 'epoch': 3.01}

 19%|█▉        | 69980/371472 [5:34:17<22:41:14,  3.69it/s]
 19%|█▉        | 69981/371472 [5:34:17<24:47:02,  3.38it/s]
 19%|█▉        | 69982/371472 [5:34:18<23:17:37,  3.60it/s]
 19%|█▉        | 69983/371472 [5:34:18<23:17:45,  3.59it/s]
 19%|█▉        | 69984/371472 [5:34:18<23:37:18,  3.55it/s]
 19%|█▉        | 69985/371472 [5:34:19<24:56:47,  3.36it/s]
 19%|█▉        | 69986/371472 [5:34:19<23:35:47,  3.55it/s]
 19%|█▉        | 69987/371472 [5:34:19<23:13:19,  3.61it/s]
 19%|█▉        | 69988/371472 [5:34:19<22:34:12,  3.71it/s]
 19%|█▉        | 69989/371472 [5:34:20<24:01:22,  3.49it/s]
 19%|█▉        | 69990/371472 [5:34:20<24:33:09,  3.41it/s]
 19%|█▉        | 69991/371472 [5:34:20<24:28:20,  3.42it/s]
 19%|█▉        | 69992/371472 [5:34:20<24:40:53,  3.39it/s]
 19%|█▉        | 69993/371472 [5:34:21<23:56:39,  3.50it/s]
 19%|█▉        | 69994/371472 [5:34:21<24:21:07,  3.44it/s]
 19%|█▉        | 69995/371472 [5:34:21<24:18:59,  3.44it/s]
 19%|█▉        | 69996/371472 [5:34:22<23:34:40,  3.55it/s]
 19%|█▉        | 69997/371472 [5:34:22<22:51:30,  3.66it/s]
 19%|█▉        | 69998/371472 [5:34:22<22:32:35,  3.71it/s]
 19%|█▉        | 69999/371472 [5:34:22<24:36:29,  3.40it/s]
 19%|█▉        | 70000/371472 [5:34:23<23:36:27,  3.55it/s]
                                                           
{'loss': 4.2484, 'learning_rate': 8.307979055786592e-07, 'epoch': 3.02}

 19%|█▉        | 70000/371472 [5:34:23<23:36:27,  3.55it/s]
 19%|█▉        | 70001/371472 [5:34:23<23:25:57,  3.57it/s]
 19%|█▉        | 70002/371472 [5:34:23<22:15:27,  3.76it/s]
 19%|█▉        | 70003/371472 [5:34:24<23:16:57,  3.60it/s]
 19%|█▉        | 70004/371472 [5:34:24<24:28:02,  3.42it/s]
 19%|█▉        | 70005/371472 [5:34:24<25:04:53,  3.34it/s]
 19%|█▉        | 70006/371472 [5:34:24<23:32:10,  3.56it/s]
 19%|█▉        | 70007/371472 [5:34:25<22:50:48,  3.67it/s]
 19%|█▉        | 70008/371472 [5:34:25<23:14:34,  3.60it/s]
 19%|█▉        | 70009/371472 [5:34:25<23:37:34,  3.54it/s]
 19%|█▉        | 70010/371472 [5:34:26<24:21:47,  3.44it/s]
 19%|█▉        | 70011/371472 [5:34:26<24:13:32,  3.46it/s]
 19%|█▉        | 70012/371472 [5:34:26<26:31:02,  3.16it/s]
 19%|█▉        | 70013/371472 [5:34:27<25:20:56,  3.30it/s]
 19%|█▉        | 70014/371472 [5:34:27<23:43:01,  3.53it/s]
 19%|█▉        | 70015/371472 [5:34:27<26:06:55,  3.21it/s]
 19%|█▉        | 70016/371472 [5:34:27<24:57:25,  3.36it/s]
 19%|█▉        | 70017/371472 [5:34:28<23:59:24,  3.49it/s]
 19%|█▉        | 70018/371472 [5:34:28<23:53:37,  3.50it/s]
 19%|█▉        | 70019/371472 [5:34:28<24:23:28,  3.43it/s]
 19%|█▉        | 70020/371472 [5:34:28<23:21:04,  3.59it/s]
                                                           
{'loss': 4.1018, 'learning_rate': 8.307494236031804e-07, 'epoch': 3.02}

 19%|█▉        | 70020/371472 [5:34:28<23:21:04,  3.59it/s]
 19%|█▉        | 70021/371472 [5:34:29<22:35:27,  3.71it/s]
 19%|█▉        | 70022/371472 [5:34:29<22:16:24,  3.76it/s]
 19%|█▉        | 70023/371472 [5:34:29<23:19:36,  3.59it/s]
 19%|█▉        | 70024/371472 [5:34:30<23:47:28,  3.52it/s]
 19%|█▉        | 70025/371472 [5:34:30<23:37:27,  3.54it/s]
 19%|█▉        | 70026/371472 [5:34:30<23:59:39,  3.49it/s]
 19%|█▉        | 70027/371472 [5:34:30<24:34:38,  3.41it/s]
 19%|█▉        | 70028/371472 [5:34:31<25:33:38,  3.28it/s]
 19%|█▉        | 70029/371472 [5:34:31<26:14:55,  3.19it/s]
 19%|█▉        | 70030/371472 [5:34:31<26:14:10,  3.19it/s]
 19%|█▉        | 70031/371472 [5:34:32<26:06:40,  3.21it/s]
 19%|█▉        | 70032/371472 [5:34:32<25:50:37,  3.24it/s]
 19%|█▉        | 70033/371472 [5:34:32<24:47:52,  3.38it/s]
 19%|█▉        | 70034/371472 [5:34:33<24:13:09,  3.46it/s]
 19%|█▉        | 70035/371472 [5:34:33<23:58:28,  3.49it/s]
 19%|█▉        | 70036/371472 [5:34:33<23:05:22,  3.63it/s]
 19%|█▉        | 70037/371472 [5:34:33<22:46:21,  3.68it/s]
 19%|█▉        | 70038/371472 [5:34:34<22:30:54,  3.72it/s]
 19%|█▉        | 70039/371472 [5:34:34<24:15:58,  3.45it/s]
 19%|█▉        | 70040/371472 [5:34:34<25:12:59,  3.32it/s]
                                                           
{'loss': 4.3796, 'learning_rate': 8.307009416277015e-07, 'epoch': 3.02}

 19%|█▉        | 70040/371472 [5:34:34<25:12:59,  3.32it/s]
 19%|█▉        | 70041/371472 [5:34:35<24:13:41,  3.46it/s]
 19%|█▉        | 70042/371472 [5:34:35<22:49:55,  3.67it/s]
 19%|█▉        | 70043/371472 [5:34:35<22:05:19,  3.79it/s]
 19%|█▉        | 70044/371472 [5:34:35<23:43:32,  3.53it/s]
 19%|█▉        | 70045/371472 [5:34:36<23:55:21,  3.50it/s]
 19%|█▉        | 70046/371472 [5:34:36<23:51:50,  3.51it/s]
 19%|█▉        | 70047/371472 [5:34:36<24:20:12,  3.44it/s]
 19%|█▉        | 70048/371472 [5:34:37<24:31:51,  3.41it/s]
 19%|█▉        | 70049/371472 [5:34:37<23:45:20,  3.52it/s]
 19%|█▉        | 70050/371472 [5:34:37<23:49:49,  3.51it/s]
 19%|█▉        | 70051/371472 [5:34:37<23:20:24,  3.59it/s]
 19%|█▉        | 70052/371472 [5:34:38<22:34:42,  3.71it/s]
 19%|█▉        | 70053/371472 [5:34:38<26:14:13,  3.19it/s]
 19%|█▉        | 70054/371472 [5:34:38<26:26:37,  3.17it/s]
 19%|█▉        | 70055/371472 [5:34:39<24:58:29,  3.35it/s]
 19%|█▉        | 70056/371472 [5:34:39<24:53:37,  3.36it/s]
 19%|█▉        | 70057/371472 [5:34:39<29:04:57,  2.88it/s]
 19%|█▉        | 70058/371472 [5:34:40<26:20:37,  3.18it/s]
 19%|█▉        | 70059/371472 [5:34:40<26:55:00,  3.11it/s]
 19%|█▉        | 70060/371472 [5:34:40<26:09:42,  3.20it/s]
                                                           
{'loss': 4.2395, 'learning_rate': 8.306524596522226e-07, 'epoch': 3.02}

 19%|█▉        | 70060/371472 [5:34:40<26:09:42,  3.20it/s]
 19%|█▉        | 70061/371472 [5:34:41<29:12:27,  2.87it/s]
 19%|█▉        | 70062/371472 [5:34:41<27:30:22,  3.04it/s]
 19%|█▉        | 70063/371472 [5:34:41<29:04:46,  2.88it/s]
 19%|█▉        | 70064/371472 [5:34:42<28:13:55,  2.97it/s]
 19%|█▉        | 70065/371472 [5:34:42<26:38:39,  3.14it/s]
 19%|█▉        | 70066/371472 [5:34:42<24:52:22,  3.37it/s]
 19%|█▉        | 70067/371472 [5:34:42<24:28:04,  3.42it/s]
 19%|█▉        | 70068/371472 [5:34:43<22:55:36,  3.65it/s]
 19%|█▉        | 70069/371472 [5:34:43<22:46:56,  3.67it/s]
 19%|█▉        | 70070/371472 [5:34:43<23:15:13,  3.60it/s]
 19%|█▉        | 70071/371472 [5:34:44<23:12:55,  3.61it/s]
 19%|█▉        | 70072/371472 [5:34:44<23:08:52,  3.62it/s]
 19%|█▉        | 70073/371472 [5:34:44<24:22:16,  3.44it/s]
 19%|█▉        | 70074/371472 [5:34:44<23:33:28,  3.55it/s]
 19%|█▉        | 70075/371472 [5:34:45<23:33:51,  3.55it/s]
 19%|█▉        | 70076/371472 [5:34:45<23:40:17,  3.54it/s]
 19%|█▉        | 70077/371472 [5:34:45<24:57:37,  3.35it/s]
 19%|█▉        | 70078/371472 [5:34:46<24:38:05,  3.40it/s]
 19%|█▉        | 70079/371472 [5:34:46<24:53:41,  3.36it/s]
 19%|█▉        | 70080/371472 [5:34:46<26:27:54,  3.16it/s]
                                                           
{'loss': 3.9913, 'learning_rate': 8.306039776767437e-07, 'epoch': 3.02}

 19%|█▉        | 70080/371472 [5:34:46<26:27:54,  3.16it/s]
 19%|█▉        | 70081/371472 [5:34:47<25:27:13,  3.29it/s]
 19%|█▉        | 70082/371472 [5:34:47<24:20:16,  3.44it/s]
 19%|█▉        | 70083/371472 [5:34:47<26:21:43,  3.18it/s]
 19%|█▉        | 70084/371472 [5:34:47<24:49:58,  3.37it/s]
 19%|█▉        | 70085/371472 [5:34:48<23:58:28,  3.49it/s]
 19%|█▉        | 70086/371472 [5:34:48<24:54:42,  3.36it/s]
 19%|█▉        | 70087/371472 [5:34:48<25:04:29,  3.34it/s]
 19%|█▉        | 70088/371472 [5:34:49<23:48:21,  3.52it/s]
 19%|█▉        | 70089/371472 [5:34:49<24:27:18,  3.42it/s]
 19%|█▉        | 70090/371472 [5:34:49<23:58:15,  3.49it/s]
 19%|█▉        | 70091/371472 [5:34:49<23:48:00,  3.52it/s]
 19%|█▉        | 70092/371472 [5:34:50<25:15:21,  3.31it/s]
 19%|█▉        | 70093/371472 [5:34:50<24:01:57,  3.48it/s]
 19%|█▉        | 70094/371472 [5:34:50<24:03:38,  3.48it/s]
 19%|█▉        | 70095/371472 [5:34:51<24:27:33,  3.42it/s]
 19%|█▉        | 70096/371472 [5:34:51<24:13:26,  3.46it/s]
 19%|█▉        | 70097/371472 [5:34:51<23:12:59,  3.61it/s]
 19%|█▉        | 70098/371472 [5:34:51<23:09:21,  3.62it/s]
 19%|█▉        | 70099/371472 [5:34:52<24:51:06,  3.37it/s]
 19%|█▉        | 70100/371472 [5:34:52<23:54:02,  3.50it/s]
                                                           
{'loss': 4.1971, 'learning_rate': 8.305554957012649e-07, 'epoch': 3.02}

 19%|█▉        | 70100/371472 [5:34:52<23:54:02,  3.50it/s]
 19%|█▉        | 70101/371472 [5:34:52<24:53:15,  3.36it/s]
 19%|█▉        | 70102/371472 [5:34:53<24:08:23,  3.47it/s]
 19%|█▉        | 70103/371472 [5:34:53<23:49:26,  3.51it/s]
 19%|█▉        | 70104/371472 [5:34:53<23:06:15,  3.62it/s]
 19%|█▉        | 70105/371472 [5:34:54<26:03:33,  3.21it/s]
 19%|█▉        | 70106/371472 [5:34:54<25:14:27,  3.32it/s]
 19%|█▉        | 70107/371472 [5:34:54<25:00:15,  3.35it/s]
 19%|█▉        | 70108/371472 [5:34:54<23:53:13,  3.50it/s]
 19%|█▉        | 70109/371472 [5:34:55<23:59:31,  3.49it/s]
 19%|█▉        | 70110/371472 [5:34:55<23:04:59,  3.63it/s]
 19%|█▉        | 70111/371472 [5:34:55<22:44:57,  3.68it/s]
 19%|█▉        | 70112/371472 [5:34:55<23:02:20,  3.63it/s]
 19%|█▉        | 70113/371472 [5:34:56<22:41:16,  3.69it/s]
 19%|█▉        | 70114/371472 [5:34:56<23:10:12,  3.61it/s]
 19%|█▉        | 70115/371472 [5:34:56<23:47:21,  3.52it/s]
 19%|█▉        | 70116/371472 [5:34:57<22:56:38,  3.65it/s]
 19%|█▉        | 70117/371472 [5:34:57<23:58:43,  3.49it/s]
 19%|█▉        | 70118/371472 [5:34:57<24:59:59,  3.35it/s]
 19%|█▉        | 70119/371472 [5:34:58<27:29:24,  3.05it/s]
 19%|█▉        | 70120/371472 [5:34:58<25:40:46,  3.26it/s]
                                                           
{'loss': 4.1074, 'learning_rate': 8.305070137257857e-07, 'epoch': 3.02}

 19%|█▉        | 70120/371472 [5:34:58<25:40:46,  3.26it/s]
 19%|█▉        | 70121/371472 [5:34:58<26:07:25,  3.20it/s]
 19%|█▉        | 70122/371472 [5:34:58<25:28:26,  3.29it/s]
 19%|█▉        | 70123/371472 [5:34:59<23:50:43,  3.51it/s]
 19%|█▉        | 70124/371472 [5:34:59<24:32:00,  3.41it/s]
 19%|█▉        | 70125/371472 [5:34:59<24:28:26,  3.42it/s]
 19%|█▉        | 70126/371472 [5:35:00<23:52:38,  3.51it/s]
 19%|█▉        | 70127/371472 [5:35:00<24:00:54,  3.49it/s]
 19%|█▉        | 70128/371472 [5:35:00<23:31:59,  3.56it/s]
 19%|█▉        | 70129/371472 [5:35:00<24:09:06,  3.47it/s]
 19%|█▉        | 70130/371472 [5:35:01<23:56:32,  3.50it/s]
 19%|█▉        | 70131/371472 [5:35:01<25:11:49,  3.32it/s]
 19%|█▉        | 70132/371472 [5:35:01<25:26:23,  3.29it/s]
 19%|█▉        | 70133/371472 [5:35:02<25:01:03,  3.35it/s]
 19%|█▉        | 70134/371472 [5:35:02<25:45:47,  3.25it/s]
 19%|█▉        | 70135/371472 [5:35:02<27:01:27,  3.10it/s]
 19%|█▉        | 70136/371472 [5:35:03<26:30:56,  3.16it/s]
 19%|█▉        | 70137/371472 [5:35:03<25:21:27,  3.30it/s]
 19%|█▉        | 70138/371472 [5:35:03<26:33:18,  3.15it/s]
 19%|█▉        | 70139/371472 [5:35:04<26:58:55,  3.10it/s]
 19%|█▉        | 70140/371472 [5:35:04<27:28:48,  3.05it/s]
                                                           
{'loss': 4.2932, 'learning_rate': 8.304585317503069e-07, 'epoch': 3.02}

 19%|█▉        | 70140/371472 [5:35:04<27:28:48,  3.05it/s]
 19%|█▉        | 70141/371472 [5:35:04<27:54:22,  3.00it/s]
 19%|█▉        | 70142/371472 [5:35:05<27:38:12,  3.03it/s]
 19%|█▉        | 70143/371472 [5:35:05<26:59:07,  3.10it/s]
 19%|█▉        | 70144/371472 [5:35:05<25:27:13,  3.29it/s]
 19%|█▉        | 70145/371472 [5:35:05<25:43:22,  3.25it/s]
 19%|█▉        | 70146/371472 [5:35:06<25:14:02,  3.32it/s]
 19%|█▉        | 70147/371472 [5:35:06<25:04:31,  3.34it/s]
 19%|█▉        | 70148/371472 [5:35:06<23:39:50,  3.54it/s]
 19%|█▉        | 70149/371472 [5:35:07<23:54:55,  3.50it/s]
 19%|█▉        | 70150/371472 [5:35:07<23:24:11,  3.58it/s]
 19%|█▉        | 70151/371472 [5:35:07<23:42:54,  3.53it/s]
 19%|█▉        | 70152/371472 [5:35:07<24:03:10,  3.48it/s]
 19%|█▉        | 70153/371472 [5:35:08<23:43:45,  3.53it/s]
 19%|█▉        | 70154/371472 [5:35:08<23:32:07,  3.56it/s]
 19%|█▉        | 70155/371472 [5:35:08<25:04:50,  3.34it/s]
 19%|█▉        | 70156/371472 [5:35:09<23:46:21,  3.52it/s]
 19%|█▉        | 70157/371472 [5:35:09<23:15:25,  3.60it/s]
 19%|█▉        | 70158/371472 [5:35:09<24:13:17,  3.46it/s]
 19%|█▉        | 70159/371472 [5:35:09<24:04:00,  3.48it/s]
 19%|█▉        | 70160/371472 [5:35:10<23:51:11,  3.51it/s]
                                                           
{'loss': 4.269, 'learning_rate': 8.304100497748281e-07, 'epoch': 3.02}

 19%|█▉        | 70160/371472 [5:35:10<23:51:11,  3.51it/s]
 19%|█▉        | 70161/371472 [5:35:10<25:52:56,  3.23it/s]
 19%|█▉        | 70162/371472 [5:35:10<25:56:29,  3.23it/s]
 19%|█▉        | 70163/371472 [5:35:11<26:06:39,  3.21it/s]
 19%|█▉        | 70164/371472 [5:35:11<25:21:28,  3.30it/s]
 19%|█▉        | 70165/371472 [5:35:11<25:32:55,  3.28it/s]
 19%|█▉        | 70166/371472 [5:35:12<24:46:42,  3.38it/s]
 19%|█▉        | 70167/371472 [5:35:12<24:30:55,  3.41it/s]
 19%|█▉        | 70168/371472 [5:35:12<25:34:25,  3.27it/s]
 19%|█▉        | 70169/371472 [5:35:12<24:27:02,  3.42it/s]
 19%|█▉        | 70170/371472 [5:35:13<24:03:03,  3.48it/s]
 19%|█▉        | 70171/371472 [5:35:13<23:55:52,  3.50it/s]
 19%|█▉        | 70172/371472 [5:35:13<23:39:35,  3.54it/s]
 19%|█▉        | 70173/371472 [5:35:14<23:09:27,  3.61it/s]
 19%|█▉        | 70174/371472 [5:35:14<23:32:13,  3.56it/s]
 19%|█▉        | 70175/371472 [5:35:14<24:11:03,  3.46it/s]
 19%|█▉        | 70176/371472 [5:35:14<23:23:14,  3.58it/s]
 19%|█▉        | 70177/371472 [5:35:15<24:28:49,  3.42it/s]
 19%|█▉        | 70178/371472 [5:35:15<24:10:20,  3.46it/s]
 19%|█▉        | 70179/371472 [5:35:15<23:20:13,  3.59it/s]
 19%|█▉        | 70180/371472 [5:35:16<23:29:57,  3.56it/s]
                                                           
{'loss': 4.1816, 'learning_rate': 8.303615677993493e-07, 'epoch': 3.02}

 19%|█▉        | 70180/371472 [5:35:16<23:29:57,  3.56it/s]
 19%|█▉        | 70181/371472 [5:35:16<22:40:02,  3.69it/s]
 19%|█▉        | 70182/371472 [5:35:16<22:35:12,  3.71it/s]
 19%|█▉        | 70183/371472 [5:35:16<22:41:35,  3.69it/s]
 19%|█▉        | 70184/371472 [5:35:17<22:44:30,  3.68it/s]
 19%|█▉        | 70185/371472 [5:35:17<22:50:47,  3.66it/s]
 19%|█▉        | 70186/371472 [5:35:17<22:29:49,  3.72it/s]
 19%|█▉        | 70187/371472 [5:35:17<22:05:06,  3.79it/s]
 19%|█▉        | 70188/371472 [5:35:18<23:26:05,  3.57it/s]
 19%|█▉        | 70189/371472 [5:35:18<24:03:59,  3.48it/s]
 19%|█▉        | 70190/371472 [5:35:18<23:59:25,  3.49it/s]
 19%|█▉        | 70191/371472 [5:35:19<23:47:41,  3.52it/s]
 19%|█▉        | 70192/371472 [5:35:19<23:56:26,  3.50it/s]
 19%|█▉        | 70193/371472 [5:35:19<23:23:37,  3.58it/s]
 19%|█▉        | 70194/371472 [5:35:19<24:27:36,  3.42it/s]
 19%|█▉        | 70195/371472 [5:35:20<23:41:36,  3.53it/s]
 19%|█▉        | 70196/371472 [5:35:20<25:22:50,  3.30it/s]
 19%|█▉        | 70197/371472 [5:35:20<24:33:53,  3.41it/s]
 19%|█▉        | 70198/371472 [5:35:21<23:34:25,  3.55it/s]
 19%|█▉        | 70199/371472 [5:35:21<23:15:50,  3.60it/s]
 19%|█▉        | 70200/371472 [5:35:21<24:52:45,  3.36it/s]
                                                           
{'loss': 4.2207, 'learning_rate': 8.303130858238704e-07, 'epoch': 3.02}

 19%|█▉        | 70200/371472 [5:35:21<24:52:45,  3.36it/s]
 19%|█▉        | 70201/371472 [5:35:22<24:59:08,  3.35it/s]
 19%|█▉        | 70202/371472 [5:35:22<23:36:42,  3.54it/s]
 19%|█▉        | 70203/371472 [5:35:22<23:27:34,  3.57it/s]
 19%|█▉        | 70204/371472 [5:35:22<23:26:42,  3.57it/s]
 19%|█▉        | 70205/371472 [5:35:23<23:06:00,  3.62it/s]
 19%|█▉        | 70206/371472 [5:35:23<22:29:50,  3.72it/s]
 19%|█▉        | 70207/371472 [5:35:23<22:37:58,  3.70it/s]
 19%|█▉        | 70208/371472 [5:35:23<22:55:22,  3.65it/s]
 19%|█▉        | 70209/371472 [5:35:24<23:37:09,  3.54it/s]
 19%|█▉        | 70210/371472 [5:35:24<25:37:37,  3.27it/s]
 19%|█▉        | 70211/371472 [5:35:24<25:10:59,  3.32it/s]
 19%|█▉        | 70212/371472 [5:35:25<26:08:26,  3.20it/s]
 19%|█▉        | 70213/371472 [5:35:25<24:48:13,  3.37it/s]
 19%|█▉        | 70214/371472 [5:35:25<24:05:55,  3.47it/s]
 19%|█▉        | 70215/371472 [5:35:25<23:24:02,  3.58it/s]
 19%|█▉        | 70216/371472 [5:35:26<22:13:16,  3.77it/s]
 19%|█▉        | 70217/371472 [5:35:26<23:01:17,  3.63it/s]
 19%|█▉        | 70218/371472 [5:35:26<23:10:59,  3.61it/s]
 19%|█▉        | 70219/371472 [5:35:27<22:58:39,  3.64it/s]
 19%|█▉        | 70220/371472 [5:35:27<23:50:09,  3.51it/s]
                                                           
{'loss': 4.1439, 'learning_rate': 8.302646038483915e-07, 'epoch': 3.02}

 19%|█▉        | 70220/371472 [5:35:27<23:50:09,  3.51it/s]
 19%|█▉        | 70221/371472 [5:35:27<23:37:45,  3.54it/s]
 19%|█▉        | 70222/371472 [5:35:27<23:05:43,  3.62it/s]
 19%|█▉        | 70223/371472 [5:35:28<23:21:37,  3.58it/s]
 19%|█▉        | 70224/371472 [5:35:28<23:25:09,  3.57it/s]
 19%|█▉        | 70225/371472 [5:35:28<23:30:21,  3.56it/s]
 19%|█▉        | 70226/371472 [5:35:29<23:57:20,  3.49it/s]
 19%|█▉        | 70227/371472 [5:35:29<22:58:51,  3.64it/s]
 19%|█▉        | 70228/371472 [5:35:29<23:12:28,  3.61it/s]
 19%|█▉        | 70229/371472 [5:35:29<24:51:36,  3.37it/s]
 19%|█▉        | 70230/371472 [5:35:30<24:11:51,  3.46it/s]
 19%|█▉        | 70231/371472 [5:35:30<24:13:48,  3.45it/s]
 19%|█▉        | 70232/371472 [5:35:30<25:52:13,  3.23it/s]
 19%|█▉        | 70233/371472 [5:35:31<25:36:28,  3.27it/s]
 19%|█▉        | 70234/371472 [5:35:31<25:04:01,  3.34it/s]
 19%|█▉        | 70235/371472 [5:35:31<24:17:51,  3.44it/s]
 19%|█▉        | 70236/371472 [5:35:32<25:37:38,  3.27it/s]
 19%|█▉        | 70237/371472 [5:35:32<26:51:03,  3.12it/s]
 19%|█▉        | 70238/371472 [5:35:32<26:27:16,  3.16it/s]
 19%|█▉        | 70239/371472 [5:35:33<30:30:31,  2.74it/s]
 19%|█▉        | 70240/371472 [5:35:33<27:41:15,  3.02it/s]
                                                           
{'loss': 3.9728, 'learning_rate': 8.302161218729125e-07, 'epoch': 3.03}

 19%|█▉        | 70240/371472 [5:35:33<27:41:15,  3.02it/s]
 19%|█▉        | 70241/371472 [5:35:33<27:26:14,  3.05it/s]
 19%|█▉        | 70242/371472 [5:35:34<26:11:32,  3.19it/s]
 19%|█▉        | 70243/371472 [5:35:34<25:34:46,  3.27it/s]
 19%|█▉        | 70244/371472 [5:35:34<25:34:50,  3.27it/s]
 19%|█▉        | 70245/371472 [5:35:34<25:25:16,  3.29it/s]
 19%|█▉        | 70246/371472 [5:35:35<25:14:56,  3.31it/s]
 19%|█▉        | 70247/371472 [5:35:35<24:52:57,  3.36it/s]
 19%|█▉        | 70248/371472 [5:35:35<26:45:53,  3.13it/s]
 19%|█▉        | 70249/371472 [5:35:36<27:00:08,  3.10it/s]
 19%|█▉        | 70250/371472 [5:35:36<28:18:08,  2.96it/s]
 19%|█▉        | 70251/371472 [5:35:36<27:04:49,  3.09it/s]
 19%|█▉        | 70252/371472 [5:35:37<27:04:23,  3.09it/s]
 19%|█▉        | 70253/371472 [5:35:37<25:54:11,  3.23it/s]
 19%|█▉        | 70254/371472 [5:35:37<25:33:21,  3.27it/s]
 19%|█▉        | 70255/371472 [5:35:38<25:33:24,  3.27it/s]
 19%|█▉        | 70256/371472 [5:35:38<26:05:15,  3.21it/s]
 19%|█▉        | 70257/371472 [5:35:38<26:45:26,  3.13it/s]
 19%|█▉        | 70258/371472 [5:35:39<27:17:05,  3.07it/s]
 19%|█▉        | 70259/371472 [5:35:39<28:59:47,  2.89it/s]
 19%|█▉        | 70260/371472 [5:35:39<27:11:31,  3.08it/s]
                                                           
{'loss': 3.9491, 'learning_rate': 8.301676398974337e-07, 'epoch': 3.03}

 19%|█▉        | 70260/371472 [5:35:39<27:11:31,  3.08it/s]
 19%|█▉        | 70261/371472 [5:35:40<25:21:09,  3.30it/s]
 19%|█▉        | 70262/371472 [5:35:40<24:56:01,  3.36it/s]
 19%|█▉        | 70263/371472 [5:35:40<24:56:48,  3.35it/s]
 19%|█▉        | 70264/371472 [5:35:40<23:23:51,  3.58it/s]
 19%|█▉        | 70265/371472 [5:35:41<22:26:11,  3.73it/s]
 19%|█▉        | 70266/371472 [5:35:41<24:14:20,  3.45it/s]
 19%|█▉        | 70267/371472 [5:35:41<24:53:22,  3.36it/s]
 19%|█▉        | 70268/371472 [5:35:42<25:54:08,  3.23it/s]
 19%|█▉        | 70269/371472 [5:35:42<24:36:18,  3.40it/s]
 19%|█▉        | 70270/371472 [5:35:42<23:37:43,  3.54it/s]
 19%|█▉        | 70271/371472 [5:35:42<23:40:17,  3.53it/s]
 19%|█▉        | 70272/371472 [5:35:43<23:40:38,  3.53it/s]
 19%|█▉        | 70273/371472 [5:35:43<23:22:09,  3.58it/s]
 19%|█▉        | 70274/371472 [5:35:43<24:11:38,  3.46it/s]
 19%|█▉        | 70275/371472 [5:35:44<24:35:19,  3.40it/s]
 19%|█▉        | 70276/371472 [5:35:44<23:56:12,  3.50it/s]
 19%|█▉        | 70277/371472 [5:35:44<23:19:39,  3.59it/s]
 19%|█▉        | 70278/371472 [5:35:44<23:04:26,  3.63it/s]
 19%|█▉        | 70279/371472 [5:35:45<21:52:28,  3.82it/s]
 19%|█▉        | 70280/371472 [5:35:45<21:48:25,  3.84it/s]
                                                           
{'loss': 4.1278, 'learning_rate': 8.301191579219547e-07, 'epoch': 3.03}

 19%|█▉        | 70280/371472 [5:35:45<21:48:25,  3.84it/s]
 19%|█▉        | 70281/371472 [5:35:45<22:23:00,  3.74it/s]
 19%|█▉        | 70282/371472 [5:35:45<22:16:59,  3.75it/s]
 19%|█▉        | 70283/371472 [5:35:46<22:06:02,  3.79it/s]
 19%|█▉        | 70284/371472 [5:35:46<22:06:14,  3.78it/s]
 19%|█▉        | 70285/371472 [5:35:46<22:09:56,  3.77it/s]
 19%|█▉        | 70286/371472 [5:35:46<22:39:35,  3.69it/s]
 19%|█▉        | 70287/371472 [5:35:47<22:39:00,  3.69it/s]
 19%|█▉        | 70288/371472 [5:35:47<22:02:09,  3.80it/s]
 19%|█▉        | 70289/371472 [5:35:47<22:35:46,  3.70it/s]
 19%|█▉        | 70290/371472 [5:35:48<22:26:22,  3.73it/s]
 19%|█▉        | 70291/371472 [5:35:48<22:41:03,  3.69it/s]
 19%|█▉        | 70292/371472 [5:35:48<22:15:23,  3.76it/s]
 19%|█▉        | 70293/371472 [5:35:48<23:48:43,  3.51it/s]
 19%|█▉        | 70294/371472 [5:35:49<24:13:53,  3.45it/s]
 19%|█▉        | 70295/371472 [5:35:49<24:00:58,  3.48it/s]
 19%|█▉        | 70296/371472 [5:35:49<23:13:23,  3.60it/s]
 19%|█▉        | 70297/371472 [5:35:49<22:35:00,  3.70it/s]
 19%|█▉        | 70298/371472 [5:35:50<22:34:02,  3.71it/s]
 19%|█▉        | 70299/371472 [5:35:50<22:09:09,  3.78it/s]
 19%|█▉        | 70300/371472 [5:35:50<22:14:51,  3.76it/s]
                                                           
{'loss': 4.1904, 'learning_rate': 8.300706759464758e-07, 'epoch': 3.03}

 19%|█▉        | 70300/371472 [5:35:50<22:14:51,  3.76it/s]
 19%|█▉        | 70301/371472 [5:35:51<22:49:43,  3.66it/s]
 19%|█▉        | 70302/371472 [5:35:51<22:29:25,  3.72it/s]
 19%|█▉        | 70303/371472 [5:35:51<21:52:26,  3.82it/s]
 19%|█▉        | 70304/371472 [5:35:51<21:49:28,  3.83it/s]
 19%|█▉        | 70305/371472 [5:35:52<23:17:03,  3.59it/s]
 19%|█▉        | 70306/371472 [5:35:52<23:37:18,  3.54it/s]
 19%|█▉        | 70307/371472 [5:35:52<23:32:11,  3.55it/s]
 19%|█▉        | 70308/371472 [5:35:53<24:12:43,  3.46it/s]
 19%|█▉        | 70309/371472 [5:35:53<23:07:07,  3.62it/s]
 19%|█▉        | 70310/371472 [5:35:53<22:34:22,  3.71it/s]
 19%|█▉        | 70311/371472 [5:35:53<22:10:35,  3.77it/s]
 19%|█▉        | 70312/371472 [5:35:54<24:04:54,  3.47it/s]
 19%|█▉        | 70313/371472 [5:35:54<23:27:51,  3.57it/s]
 19%|█▉        | 70314/371472 [5:35:54<23:18:56,  3.59it/s]
 19%|█▉        | 70315/371472 [5:35:54<24:19:25,  3.44it/s]
 19%|█▉        | 70316/371472 [5:35:55<23:40:39,  3.53it/s]
 19%|█▉        | 70317/371472 [5:35:55<22:55:17,  3.65it/s]
 19%|█▉        | 70318/371472 [5:35:55<22:05:58,  3.79it/s]
 19%|█▉        | 70319/371472 [5:35:55<22:04:06,  3.79it/s]
 19%|█▉        | 70320/371472 [5:35:56<22:49:40,  3.66it/s]
                                                           
{'loss': 3.9599, 'learning_rate': 8.30022193970997e-07, 'epoch': 3.03}

 19%|█▉        | 70320/371472 [5:35:56<22:49:40,  3.66it/s]
 19%|█▉        | 70321/371472 [5:35:56<23:24:37,  3.57it/s]
 19%|█▉        | 70322/371472 [5:35:56<24:21:46,  3.43it/s]
 19%|█▉        | 70323/371472 [5:35:57<25:51:37,  3.23it/s]
 19%|█▉        | 70324/371472 [5:35:57<26:47:53,  3.12it/s]
 19%|█▉        | 70325/371472 [5:35:57<26:11:22,  3.19it/s]
 19%|█▉        | 70326/371472 [5:35:58<24:27:16,  3.42it/s]
 19%|█▉        | 70327/371472 [5:35:58<23:22:38,  3.58it/s]
 19%|█▉        | 70328/371472 [5:35:58<22:40:51,  3.69it/s]
 19%|█▉        | 70329/371472 [5:35:58<23:12:42,  3.60it/s]
 19%|█▉        | 70330/371472 [5:35:59<24:18:35,  3.44it/s]
 19%|█▉        | 70331/371472 [5:35:59<23:12:13,  3.61it/s]
 19%|█▉        | 70332/371472 [5:35:59<23:22:43,  3.58it/s]
 19%|█▉        | 70333/371472 [5:36:00<23:22:27,  3.58it/s]
 19%|█▉        | 70334/371472 [5:36:00<22:43:28,  3.68it/s]
 19%|█▉        | 70335/371472 [5:36:00<22:04:21,  3.79it/s]
 19%|█▉        | 70336/371472 [5:36:00<23:00:06,  3.64it/s]
 19%|█▉        | 70337/371472 [5:36:01<26:21:37,  3.17it/s]
 19%|█▉        | 70338/371472 [5:36:01<26:38:39,  3.14it/s]
 19%|█▉        | 70339/371472 [5:36:01<25:30:00,  3.28it/s]
 19%|█▉        | 70340/371472 [5:36:02<24:55:21,  3.36it/s]
                                                           
{'loss': 4.3606, 'learning_rate': 8.299737119955182e-07, 'epoch': 3.03}

 19%|█▉        | 70340/371472 [5:36:02<24:55:21,  3.36it/s]
 19%|█▉        | 70341/371472 [5:36:02<24:41:11,  3.39it/s]
 19%|█▉        | 70342/371472 [5:36:02<23:29:36,  3.56it/s]
 19%|█▉        | 70343/371472 [5:36:02<22:56:40,  3.65it/s]
 19%|█▉        | 70344/371472 [5:36:03<23:20:40,  3.58it/s]
 19%|█▉        | 70345/371472 [5:36:03<22:50:22,  3.66it/s]
 19%|█▉        | 70346/371472 [5:36:03<22:07:01,  3.78it/s]
 19%|█▉        | 70347/371472 [5:36:03<21:48:02,  3.84it/s]
 19%|█▉        | 70348/371472 [5:36:04<21:42:22,  3.85it/s]
 19%|█▉        | 70349/371472 [5:36:04<21:34:51,  3.88it/s]
 19%|█▉        | 70350/371472 [5:36:04<21:05:35,  3.97it/s]
 19%|█▉        | 70351/371472 [5:36:05<22:01:23,  3.80it/s]
 19%|█▉        | 70352/371472 [5:36:05<22:18:52,  3.75it/s]
 19%|█▉        | 70353/371472 [5:36:05<21:42:29,  3.85it/s]
 19%|█▉        | 70354/371472 [5:36:05<23:17:44,  3.59it/s]
 19%|█▉        | 70355/371472 [5:36:06<23:38:07,  3.54it/s]
 19%|█▉        | 70356/371472 [5:36:06<23:49:26,  3.51it/s]
 19%|█▉        | 70357/371472 [5:36:06<25:10:26,  3.32it/s]
 19%|█▉        | 70358/371472 [5:36:07<27:09:44,  3.08it/s]
 19%|█▉        | 70359/371472 [5:36:07<27:46:34,  3.01it/s]
 19%|█▉        | 70360/371472 [5:36:07<27:12:52,  3.07it/s]
                                                           
{'loss': 4.0411, 'learning_rate': 8.299252300200392e-07, 'epoch': 3.03}

 19%|█▉        | 70360/371472 [5:36:07<27:12:52,  3.07it/s]
 19%|█▉        | 70361/371472 [5:36:08<27:09:17,  3.08it/s]
 19%|█▉        | 70362/371472 [5:36:08<27:17:56,  3.06it/s]
 19%|█▉        | 70363/371472 [5:36:08<26:22:25,  3.17it/s]
 19%|█▉        | 70364/371472 [5:36:09<24:58:49,  3.35it/s]
 19%|█▉        | 70365/371472 [5:36:09<24:41:49,  3.39it/s]
 19%|█▉        | 70366/371472 [5:36:09<25:24:04,  3.29it/s]
 19%|█▉        | 70367/371472 [5:36:09<24:53:47,  3.36it/s]
 19%|█▉        | 70368/371472 [5:36:10<24:53:53,  3.36it/s]
 19%|█▉        | 70369/371472 [5:36:10<24:37:11,  3.40it/s]
 19%|█▉        | 70370/371472 [5:36:10<24:48:23,  3.37it/s]
 19%|█▉        | 70371/371472 [5:36:11<24:14:43,  3.45it/s]
 19%|█▉        | 70372/371472 [5:36:11<24:40:44,  3.39it/s]
 19%|█▉        | 70373/371472 [5:36:11<23:50:54,  3.51it/s]
 19%|█▉        | 70374/371472 [5:36:11<25:25:38,  3.29it/s]
 19%|█▉        | 70375/371472 [5:36:12<25:00:15,  3.34it/s]
 19%|█▉        | 70376/371472 [5:36:12<24:37:55,  3.40it/s]
 19%|█▉        | 70377/371472 [5:36:12<24:13:40,  3.45it/s]
 19%|█▉        | 70378/371472 [5:36:13<23:46:56,  3.52it/s]
 19%|█▉        | 70379/371472 [5:36:13<23:01:48,  3.63it/s]
 19%|█▉        | 70380/371472 [5:36:13<22:37:39,  3.70it/s]
                                                           
{'loss': 4.1926, 'learning_rate': 8.298767480445602e-07, 'epoch': 3.03}

 19%|█▉        | 70380/371472 [5:36:13<22:37:39,  3.70it/s]
 19%|█▉        | 70381/371472 [5:36:13<22:36:05,  3.70it/s]
 19%|█▉        | 70382/371472 [5:36:14<23:29:51,  3.56it/s]
 19%|█▉        | 70383/371472 [5:36:14<22:54:23,  3.65it/s]
 19%|█▉        | 70384/371472 [5:36:14<23:09:52,  3.61it/s]
 19%|█▉        | 70385/371472 [5:36:15<23:26:31,  3.57it/s]
 19%|█▉        | 70386/371472 [5:36:15<24:40:37,  3.39it/s]
 19%|█▉        | 70387/371472 [5:36:15<23:55:34,  3.50it/s]
 19%|█▉        | 70388/371472 [5:36:15<23:11:24,  3.61it/s]
 19%|█▉        | 70389/371472 [5:36:16<22:52:53,  3.66it/s]
 19%|█▉        | 70390/371472 [5:36:16<22:48:53,  3.67it/s]
 19%|█▉        | 70391/371472 [5:36:16<23:25:20,  3.57it/s]
 19%|█▉        | 70392/371472 [5:36:16<23:14:01,  3.60it/s]
 19%|█▉        | 70393/371472 [5:36:17<23:05:10,  3.62it/s]
 19%|█▉        | 70394/371472 [5:36:17<22:43:27,  3.68it/s]
 19%|█▉        | 70395/371472 [5:36:17<21:53:35,  3.82it/s]
 19%|█▉        | 70396/371472 [5:36:18<22:03:30,  3.79it/s]
 19%|█▉        | 70397/371472 [5:36:18<23:04:58,  3.62it/s]
 19%|█▉        | 70398/371472 [5:36:18<23:11:01,  3.61it/s]
 19%|█▉        | 70399/371472 [5:36:18<23:57:30,  3.49it/s]
 19%|█▉        | 70400/371472 [5:36:19<24:26:52,  3.42it/s]
                                                           
{'loss': 4.1736, 'learning_rate': 8.298282660690814e-07, 'epoch': 3.03}

 19%|█▉        | 70400/371472 [5:36:19<24:26:52,  3.42it/s]
 19%|█▉        | 70401/371472 [5:36:19<24:14:41,  3.45it/s]
 19%|█▉        | 70402/371472 [5:36:19<23:24:32,  3.57it/s]
 19%|█▉        | 70403/371472 [5:36:20<22:56:05,  3.65it/s]
 19%|█▉        | 70404/371472 [5:36:20<22:26:30,  3.73it/s]
 19%|█▉        | 70405/371472 [5:36:20<22:13:13,  3.76it/s]
 19%|█▉        | 70406/371472 [5:36:20<23:19:33,  3.59it/s]
 19%|█▉        | 70407/371472 [5:36:21<23:03:19,  3.63it/s]
 19%|█▉        | 70408/371472 [5:36:21<23:01:45,  3.63it/s]
 19%|█▉        | 70409/371472 [5:36:21<22:13:10,  3.76it/s]
 19%|█▉        | 70410/371472 [5:36:21<22:01:42,  3.80it/s]
 19%|█▉        | 70411/371472 [5:36:22<22:09:42,  3.77it/s]
 19%|█▉        | 70412/371472 [5:36:22<21:50:27,  3.83it/s]
 19%|█▉        | 70413/371472 [5:36:22<24:03:33,  3.48it/s]
 19%|█▉        | 70414/371472 [5:36:23<22:52:46,  3.66it/s]
 19%|█▉        | 70415/371472 [5:36:23<22:00:28,  3.80it/s]
 19%|█▉        | 70416/371472 [5:36:23<21:43:01,  3.85it/s]
 19%|█▉        | 70417/371472 [5:36:23<25:16:34,  3.31it/s]
 19%|█▉        | 70418/371472 [5:36:24<24:36:26,  3.40it/s]
 19%|█▉        | 70419/371472 [5:36:24<24:16:36,  3.44it/s]
 19%|█▉        | 70420/371472 [5:36:24<23:58:36,  3.49it/s]
                                                           
{'loss': 4.1216, 'learning_rate': 8.297797840936025e-07, 'epoch': 3.03}

 19%|█▉        | 70420/371472 [5:36:24<23:58:36,  3.49it/s]
 19%|█▉        | 70421/371472 [5:36:25<23:27:56,  3.56it/s]
 19%|█▉        | 70422/371472 [5:36:25<23:50:14,  3.51it/s]
 19%|█▉        | 70423/371472 [5:36:25<22:47:35,  3.67it/s]
 19%|█▉        | 70424/371472 [5:36:25<22:34:52,  3.70it/s]
 19%|█▉        | 70425/371472 [5:36:26<22:57:04,  3.64it/s]
 19%|█▉        | 70426/371472 [5:36:26<22:53:37,  3.65it/s]
 19%|█▉        | 70427/371472 [5:36:26<22:40:36,  3.69it/s]
 19%|█▉        | 70428/371472 [5:36:26<23:16:34,  3.59it/s]
 19%|█▉        | 70429/371472 [5:36:27<22:26:34,  3.73it/s]
 19%|█▉        | 70430/371472 [5:36:27<22:36:25,  3.70it/s]
 19%|█▉        | 70431/371472 [5:36:27<22:47:16,  3.67it/s]
 19%|█▉        | 70432/371472 [5:36:27<22:42:54,  3.68it/s]
 19%|█▉        | 70433/371472 [5:36:28<22:14:36,  3.76it/s]
 19%|█▉        | 70434/371472 [5:36:28<21:33:06,  3.88it/s]
 19%|█▉        | 70435/371472 [5:36:28<22:50:34,  3.66it/s]
 19%|█▉        | 70436/371472 [5:36:29<22:06:14,  3.78it/s]
 19%|█▉        | 70437/371472 [5:36:29<21:26:05,  3.90it/s]
 19%|█▉        | 70438/371472 [5:36:29<23:03:15,  3.63it/s]
 19%|█▉        | 70439/371472 [5:36:29<22:55:49,  3.65it/s]
 19%|█▉        | 70440/371472 [5:36:30<23:32:23,  3.55it/s]
                                                           
{'loss': 4.0971, 'learning_rate': 8.297313021181236e-07, 'epoch': 3.03}

 19%|█▉        | 70440/371472 [5:36:30<23:32:23,  3.55it/s]
 19%|█▉        | 70441/371472 [5:36:30<23:34:59,  3.55it/s]
 19%|█▉        | 70442/371472 [5:36:30<22:36:33,  3.70it/s]
 19%|█▉        | 70443/371472 [5:36:31<24:18:15,  3.44it/s]
 19%|█▉        | 70444/371472 [5:36:31<22:58:58,  3.64it/s]
 19%|█▉        | 70445/371472 [5:36:31<22:13:08,  3.76it/s]
 19%|█▉        | 70446/371472 [5:36:31<22:29:56,  3.72it/s]
 19%|█▉        | 70447/371472 [5:36:32<22:08:19,  3.78it/s]
 19%|█▉        | 70448/371472 [5:36:32<23:09:06,  3.61it/s]
 19%|█▉        | 70449/371472 [5:36:32<23:03:24,  3.63it/s]
 19%|█▉        | 70450/371472 [5:36:32<22:05:16,  3.79it/s]
 19%|█▉        | 70451/371472 [5:36:33<22:38:41,  3.69it/s]
 19%|█▉        | 70452/371472 [5:36:33<22:20:32,  3.74it/s]
 19%|█▉        | 70453/371472 [5:36:33<23:52:11,  3.50it/s]
 19%|█▉        | 70454/371472 [5:36:34<24:12:56,  3.45it/s]
 19%|█▉        | 70455/371472 [5:36:34<24:11:20,  3.46it/s]
 19%|█▉        | 70456/371472 [5:36:34<23:21:06,  3.58it/s]
 19%|█▉        | 70457/371472 [5:36:34<22:27:35,  3.72it/s]
 19%|█▉        | 70458/371472 [5:36:35<23:07:57,  3.61it/s]
 19%|█▉        | 70459/371472 [5:36:35<22:20:30,  3.74it/s]
 19%|█▉        | 70460/371472 [5:36:35<22:51:00,  3.66it/s]
                                                           
{'loss': 4.0617, 'learning_rate': 8.296828201426447e-07, 'epoch': 3.03}

 19%|█▉        | 70460/371472 [5:36:35<22:51:00,  3.66it/s]
 19%|█▉        | 70461/371472 [5:36:35<23:00:04,  3.64it/s]
 19%|█▉        | 70462/371472 [5:36:36<23:20:01,  3.58it/s]
 19%|█▉        | 70463/371472 [5:36:36<22:50:24,  3.66it/s]
 19%|█▉        | 70464/371472 [5:36:36<22:43:38,  3.68it/s]
 19%|█▉        | 70465/371472 [5:36:36<21:52:49,  3.82it/s]
 19%|█▉        | 70466/371472 [5:36:37<22:41:59,  3.68it/s]
 19%|█▉        | 70467/371472 [5:36:37<22:22:09,  3.74it/s]
 19%|█▉        | 70468/371472 [5:36:37<22:09:03,  3.77it/s]
 19%|█▉        | 70469/371472 [5:36:38<21:57:53,  3.81it/s]
 19%|█▉        | 70470/371472 [5:36:38<23:49:53,  3.51it/s]
 19%|█▉        | 70471/371472 [5:36:38<23:11:51,  3.60it/s]
 19%|█▉        | 70472/371472 [5:36:38<23:29:07,  3.56it/s]
 19%|█▉        | 70473/371472 [5:36:39<24:30:57,  3.41it/s]
 19%|█▉        | 70474/371472 [5:36:39<24:01:35,  3.48it/s]
 19%|█▉        | 70475/371472 [5:36:39<23:27:45,  3.56it/s]
 19%|█▉        | 70476/371472 [5:36:40<22:46:09,  3.67it/s]
 19%|█▉        | 70477/371472 [5:36:40<22:08:42,  3.78it/s]
 19%|█▉        | 70478/371472 [5:36:40<23:23:18,  3.57it/s]
 19%|█▉        | 70479/371472 [5:36:40<24:07:14,  3.47it/s]
 19%|█▉        | 70480/371472 [5:36:41<24:26:07,  3.42it/s]
                                                           
{'loss': 3.9797, 'learning_rate': 8.296343381671659e-07, 'epoch': 3.04}

 19%|█▉        | 70480/371472 [5:36:41<24:26:07,  3.42it/s]
 19%|█▉        | 70481/371472 [5:36:41<23:49:13,  3.51it/s]
 19%|█▉        | 70482/371472 [5:36:41<24:50:13,  3.37it/s]
 19%|█▉        | 70483/371472 [5:36:42<25:55:11,  3.23it/s]
 19%|█▉        | 70484/371472 [5:36:42<24:23:52,  3.43it/s]
 19%|█▉        | 70485/371472 [5:36:42<23:30:41,  3.56it/s]
 19%|█▉        | 70486/371472 [5:36:42<22:59:10,  3.64it/s]
 19%|█▉        | 70487/371472 [5:36:43<22:43:31,  3.68it/s]
 19%|█▉        | 70488/371472 [5:36:43<22:55:37,  3.65it/s]
 19%|█▉        | 70489/371472 [5:36:43<23:25:42,  3.57it/s]
 19%|█▉        | 70490/371472 [5:36:44<24:02:46,  3.48it/s]
 19%|█▉        | 70491/371472 [5:36:44<24:36:59,  3.40it/s]
 19%|█▉        | 70492/371472 [5:36:44<23:28:53,  3.56it/s]
 19%|█▉        | 70493/371472 [5:36:44<24:46:44,  3.37it/s]
 19%|█▉        | 70494/371472 [5:36:45<23:50:48,  3.51it/s]
 19%|█▉        | 70495/371472 [5:36:45<23:34:08,  3.55it/s]
 19%|█▉        | 70496/371472 [5:36:45<23:26:54,  3.57it/s]
 19%|█▉        | 70497/371472 [5:36:46<23:24:47,  3.57it/s]
 19%|█▉        | 70498/371472 [5:36:46<23:22:50,  3.58it/s]
 19%|█▉        | 70499/371472 [5:36:46<23:25:15,  3.57it/s]
 19%|█▉        | 70500/371472 [5:36:46<22:31:33,  3.71it/s]
                                                           
{'loss': 4.2322, 'learning_rate': 8.295858561916868e-07, 'epoch': 3.04}

 19%|█▉        | 70500/371472 [5:36:46<22:31:33,  3.71it/s]
 19%|█▉        | 70501/371472 [5:36:47<22:32:57,  3.71it/s]
 19%|█▉        | 70502/371472 [5:36:47<22:36:49,  3.70it/s]
 19%|█▉        | 70503/371472 [5:36:47<22:32:45,  3.71it/s]
 19%|█▉        | 70504/371472 [5:36:47<22:28:56,  3.72it/s]
 19%|█▉        | 70505/371472 [5:36:48<23:35:10,  3.54it/s]
 19%|█▉        | 70506/371472 [5:36:48<24:06:10,  3.47it/s]
 19%|█▉        | 70507/371472 [5:36:48<23:39:35,  3.53it/s]
 19%|█▉        | 70508/371472 [5:36:49<23:01:45,  3.63it/s]
 19%|█▉        | 70509/371472 [5:36:49<23:36:47,  3.54it/s]
 19%|█▉        | 70510/371472 [5:36:49<22:36:28,  3.70it/s]
 19%|█▉        | 70511/371472 [5:36:49<23:01:16,  3.63it/s]
 19%|█▉        | 70512/371472 [5:36:50<23:41:09,  3.53it/s]
 19%|█▉        | 70513/371472 [5:36:50<23:24:39,  3.57it/s]
 19%|█▉        | 70514/371472 [5:36:50<22:45:23,  3.67it/s]
 19%|█▉        | 70515/371472 [5:36:51<23:01:27,  3.63it/s]
 19%|█▉        | 70516/371472 [5:36:51<22:24:34,  3.73it/s]
 19%|█▉        | 70517/371472 [5:36:51<23:04:21,  3.62it/s]
 19%|█▉        | 70518/371472 [5:36:51<23:18:28,  3.59it/s]
 19%|█▉        | 70519/371472 [5:36:52<23:33:55,  3.55it/s]
 19%|█▉        | 70520/371472 [5:36:52<23:28:14,  3.56it/s]
                                                           
{'loss': 4.1371, 'learning_rate': 8.29537374216208e-07, 'epoch': 3.04}

 19%|█▉        | 70520/371472 [5:36:52<23:28:14,  3.56it/s]
 19%|█▉        | 70521/371472 [5:36:52<23:29:47,  3.56it/s]
 19%|█▉        | 70522/371472 [5:36:53<24:22:49,  3.43it/s]
 19%|█▉        | 70523/371472 [5:36:53<24:56:03,  3.35it/s]
 19%|█▉        | 70524/371472 [5:36:53<24:09:37,  3.46it/s]
 19%|█▉        | 70525/371472 [5:36:53<23:42:31,  3.53it/s]
 19%|█▉        | 70526/371472 [5:36:54<23:39:05,  3.53it/s]
 19%|█▉        | 70527/371472 [5:36:54<22:25:35,  3.73it/s]
 19%|█▉        | 70528/371472 [5:36:54<22:27:33,  3.72it/s]
 19%|█▉        | 70529/371472 [5:36:54<22:03:54,  3.79it/s]
 19%|█▉        | 70530/371472 [5:36:55<21:36:09,  3.87it/s]
 19%|█▉        | 70531/371472 [5:36:55<22:05:20,  3.78it/s]
 19%|█▉        | 70532/371472 [5:36:55<21:49:02,  3.83it/s]
 19%|█▉        | 70533/371472 [5:36:55<22:04:17,  3.79it/s]
 19%|█▉        | 70534/371472 [5:36:56<22:13:06,  3.76it/s]
 19%|█▉        | 70535/371472 [5:36:56<23:35:05,  3.54it/s]
 19%|█▉        | 70536/371472 [5:36:56<23:01:03,  3.63it/s]
 19%|█▉        | 70537/371472 [5:36:57<22:27:49,  3.72it/s]
 19%|█▉        | 70538/371472 [5:36:57<21:53:58,  3.82it/s]
 19%|█▉        | 70539/371472 [5:36:57<23:10:53,  3.61it/s]
 19%|█▉        | 70540/371472 [5:36:57<22:27:56,  3.72it/s]
                                                           
{'loss': 4.0835, 'learning_rate': 8.294888922407291e-07, 'epoch': 3.04}

 19%|█▉        | 70540/371472 [5:36:57<22:27:56,  3.72it/s]
 19%|█▉        | 70541/371472 [5:36:58<22:13:15,  3.76it/s]
 19%|█▉        | 70542/371472 [5:36:58<25:06:37,  3.33it/s]
 19%|█▉        | 70543/371472 [5:36:58<25:53:43,  3.23it/s]
 19%|█▉        | 70544/371472 [5:36:59<25:36:17,  3.26it/s]
 19%|█▉        | 70545/371472 [5:36:59<25:09:18,  3.32it/s]
 19%|█▉        | 70546/371472 [5:36:59<24:58:55,  3.35it/s]
 19%|█▉        | 70547/371472 [5:37:00<25:18:21,  3.30it/s]
 19%|█▉        | 70548/371472 [5:37:00<24:09:43,  3.46it/s]
 19%|█▉        | 70549/371472 [5:37:00<26:11:15,  3.19it/s]
 19%|█▉        | 70550/371472 [5:37:00<24:49:26,  3.37it/s]
 19%|█▉        | 70551/371472 [5:37:01<23:57:30,  3.49it/s]
 19%|█▉        | 70552/371472 [5:37:01<24:46:32,  3.37it/s]
 19%|█▉        | 70553/371472 [5:37:01<23:35:15,  3.54it/s]
 19%|█▉        | 70554/371472 [5:37:02<23:18:21,  3.59it/s]
 19%|█▉        | 70555/371472 [5:37:02<23:34:19,  3.55it/s]
 19%|█▉        | 70556/371472 [5:37:02<23:15:52,  3.59it/s]
 19%|█▉        | 70557/371472 [5:37:02<23:46:40,  3.52it/s]
 19%|█▉        | 70558/371472 [5:37:03<23:47:58,  3.51it/s]
 19%|█▉        | 70559/371472 [5:37:03<22:50:13,  3.66it/s]
 19%|█▉        | 70560/371472 [5:37:03<21:57:39,  3.81it/s]
                                                           
{'loss': 4.0377, 'learning_rate': 8.294404102652503e-07, 'epoch': 3.04}

 19%|█▉        | 70560/371472 [5:37:03<21:57:39,  3.81it/s]
 19%|█▉        | 70561/371472 [5:37:03<22:47:13,  3.67it/s]
 19%|█▉        | 70562/371472 [5:37:04<22:14:07,  3.76it/s]
 19%|█▉        | 70563/371472 [5:37:04<22:16:13,  3.75it/s]
 19%|█▉        | 70564/371472 [5:37:04<22:50:31,  3.66it/s]
 19%|█▉        | 70565/371472 [5:37:05<23:02:49,  3.63it/s]
 19%|█▉        | 70566/371472 [5:37:05<22:15:34,  3.76it/s]
 19%|█▉        | 70567/371472 [5:37:05<25:08:39,  3.32it/s]
 19%|█▉        | 70568/371472 [5:37:05<25:28:43,  3.28it/s]
 19%|█▉        | 70569/371472 [5:37:06<24:23:18,  3.43it/s]
 19%|█▉        | 70570/371472 [5:37:06<26:04:55,  3.20it/s]
 19%|█▉        | 70571/371472 [5:37:06<24:52:07,  3.36it/s]
 19%|█▉        | 70572/371472 [5:37:07<24:30:56,  3.41it/s]
 19%|█▉        | 70573/371472 [5:37:07<23:49:35,  3.51it/s]
 19%|█▉        | 70574/371472 [5:37:07<22:39:15,  3.69it/s]
 19%|█▉        | 70575/371472 [5:37:07<22:40:43,  3.69it/s]
 19%|█▉        | 70576/371472 [5:37:08<22:55:52,  3.64it/s]
 19%|█▉        | 70577/371472 [5:37:08<26:44:59,  3.12it/s]
 19%|█▉        | 70578/371472 [5:37:08<26:04:44,  3.20it/s]
 19%|█▉        | 70579/371472 [5:37:09<24:18:15,  3.44it/s]
 19%|█▉        | 70580/371472 [5:37:09<23:13:53,  3.60it/s]
                                                           
{'loss': 4.1484, 'learning_rate': 8.293919282897713e-07, 'epoch': 3.04}

 19%|█▉        | 70580/371472 [5:37:09<23:13:53,  3.60it/s]
 19%|█▉        | 70581/371472 [5:37:09<24:16:05,  3.44it/s]
 19%|█▉        | 70582/371472 [5:37:09<24:10:51,  3.46it/s]
 19%|█▉        | 70583/371472 [5:37:10<23:14:58,  3.59it/s]
 19%|█▉        | 70584/371472 [5:37:10<22:28:41,  3.72it/s]
 19%|█▉        | 70585/371472 [5:37:10<23:47:17,  3.51it/s]
 19%|█▉        | 70586/371472 [5:37:11<25:51:10,  3.23it/s]
 19%|█▉        | 70587/371472 [5:37:11<25:41:02,  3.25it/s]
 19%|█▉        | 70588/371472 [5:37:11<24:42:12,  3.38it/s]
 19%|█▉        | 70589/371472 [5:37:12<24:51:15,  3.36it/s]
 19%|█▉        | 70590/371472 [5:37:12<25:20:15,  3.30it/s]
 19%|█▉        | 70591/371472 [5:37:12<23:43:25,  3.52it/s]
 19%|█▉        | 70592/371472 [5:37:12<23:25:42,  3.57it/s]
 19%|█▉        | 70593/371472 [5:37:13<23:06:38,  3.62it/s]
 19%|█▉        | 70594/371472 [5:37:13<23:10:43,  3.61it/s]
 19%|█▉        | 70595/371472 [5:37:13<23:57:22,  3.49it/s]
 19%|█▉        | 70596/371472 [5:37:14<24:30:22,  3.41it/s]
 19%|█▉        | 70597/371472 [5:37:14<24:06:20,  3.47it/s]
 19%|█▉        | 70598/371472 [5:37:14<24:14:42,  3.45it/s]
 19%|█▉        | 70599/371472 [5:37:14<23:46:08,  3.52it/s]
 19%|█▉        | 70600/371472 [5:37:15<26:14:46,  3.18it/s]
                                                           
{'loss': 4.0844, 'learning_rate': 8.293434463142925e-07, 'epoch': 3.04}

 19%|█▉        | 70600/371472 [5:37:15<26:14:46,  3.18it/s]
 19%|█▉        | 70601/371472 [5:37:15<28:44:13,  2.91it/s]
 19%|█▉        | 70602/371472 [5:37:16<28:21:00,  2.95it/s]
 19%|█▉        | 70603/371472 [5:37:16<28:04:01,  2.98it/s]
 19%|█▉        | 70604/371472 [5:37:16<26:12:33,  3.19it/s]
 19%|█▉        | 70605/371472 [5:37:16<25:30:17,  3.28it/s]
 19%|█▉        | 70606/371472 [5:37:17<25:06:18,  3.33it/s]
 19%|█▉        | 70607/371472 [5:37:17<24:49:22,  3.37it/s]
 19%|█▉        | 70608/371472 [5:37:17<25:46:53,  3.24it/s]
 19%|█▉        | 70609/371472 [5:37:18<27:17:59,  3.06it/s]
 19%|█▉        | 70610/371472 [5:37:18<25:40:06,  3.26it/s]
 19%|█▉        | 70611/371472 [5:37:18<25:11:27,  3.32it/s]
 19%|█▉        | 70612/371472 [5:37:18<24:10:45,  3.46it/s]
 19%|█▉        | 70613/371472 [5:37:19<23:38:15,  3.54it/s]
 19%|█▉        | 70614/371472 [5:37:19<23:18:13,  3.59it/s]
 19%|█▉        | 70615/371472 [5:37:19<22:54:56,  3.65it/s]
 19%|█▉        | 70616/371472 [5:37:20<23:40:09,  3.53it/s]
 19%|█▉        | 70617/371472 [5:37:20<22:47:33,  3.67it/s]
 19%|█▉        | 70618/371472 [5:37:20<28:59:32,  2.88it/s]
 19%|█▉        | 70619/371472 [5:37:21<26:25:33,  3.16it/s]
 19%|█▉        | 70620/371472 [5:37:21<26:21:29,  3.17it/s]
                                                           
{'loss': 4.1345, 'learning_rate': 8.292949643388136e-07, 'epoch': 3.04}

 19%|█▉        | 70620/371472 [5:37:21<26:21:29,  3.17it/s]
 19%|█▉        | 70621/371472 [5:37:21<24:38:04,  3.39it/s]
 19%|█▉        | 70622/371472 [5:37:21<23:42:55,  3.52it/s]
 19%|█▉        | 70623/371472 [5:37:22<23:19:17,  3.58it/s]
 19%|█▉        | 70624/371472 [5:37:22<22:43:49,  3.68it/s]
 19%|█▉        | 70625/371472 [5:37:22<23:08:31,  3.61it/s]
 19%|█▉        | 70626/371472 [5:37:23<23:50:41,  3.50it/s]
 19%|█▉        | 70627/371472 [5:37:23<23:46:31,  3.51it/s]
 19%|█▉        | 70628/371472 [5:37:23<23:19:06,  3.58it/s]
 19%|█▉        | 70629/371472 [5:37:23<24:13:25,  3.45it/s]
 19%|█▉        | 70630/371472 [5:37:24<23:05:41,  3.62it/s]
 19%|█▉        | 70631/371472 [5:37:24<22:51:47,  3.66it/s]
 19%|█▉        | 70632/371472 [5:37:24<22:44:49,  3.67it/s]
 19%|█▉        | 70633/371472 [5:37:24<22:18:41,  3.75it/s]
 19%|█▉        | 70634/371472 [5:37:25<23:13:10,  3.60it/s]
 19%|█▉        | 70635/371472 [5:37:25<23:15:49,  3.59it/s]
 19%|█▉        | 70636/371472 [5:37:25<22:38:39,  3.69it/s]
 19%|█▉        | 70637/371472 [5:37:26<21:44:26,  3.84it/s]
 19%|█▉        | 70638/371472 [5:37:26<22:53:24,  3.65it/s]
 19%|█▉        | 70639/371472 [5:37:26<24:03:19,  3.47it/s]
 19%|█▉        | 70640/371472 [5:37:26<23:20:10,  3.58it/s]
                                                           
{'loss': 4.1762, 'learning_rate': 8.292464823633346e-07, 'epoch': 3.04}

 19%|█▉        | 70640/371472 [5:37:26<23:20:10,  3.58it/s]
 19%|█▉        | 70641/371472 [5:37:27<23:03:09,  3.62it/s]
 19%|█▉        | 70642/371472 [5:37:27<22:14:50,  3.76it/s]
 19%|█▉        | 70643/371472 [5:37:27<23:43:37,  3.52it/s]
 19%|█▉        | 70644/371472 [5:37:28<23:32:11,  3.55it/s]
 19%|█▉        | 70645/371472 [5:37:28<24:07:05,  3.46it/s]
 19%|█▉        | 70646/371472 [5:37:28<23:58:31,  3.49it/s]
 19%|█▉        | 70647/371472 [5:37:28<25:22:37,  3.29it/s]
 19%|█▉        | 70648/371472 [5:37:29<24:03:19,  3.47it/s]
 19%|█▉        | 70649/371472 [5:37:29<23:39:29,  3.53it/s]
 19%|█▉        | 70650/371472 [5:37:29<23:55:16,  3.49it/s]
 19%|█▉        | 70651/371472 [5:37:30<23:05:31,  3.62it/s]
 19%|█▉        | 70652/371472 [5:37:30<24:11:31,  3.45it/s]
 19%|█▉        | 70653/371472 [5:37:30<23:37:31,  3.54it/s]
 19%|█▉        | 70654/371472 [5:37:30<22:46:02,  3.67it/s]
 19%|█▉        | 70655/371472 [5:37:31<22:18:37,  3.75it/s]
 19%|█▉        | 70656/371472 [5:37:31<22:05:59,  3.78it/s]
 19%|█▉        | 70657/371472 [5:37:31<22:30:56,  3.71it/s]
 19%|█▉        | 70658/371472 [5:37:31<22:10:33,  3.77it/s]
 19%|█▉        | 70659/371472 [5:37:32<22:21:29,  3.74it/s]
 19%|█▉        | 70660/371472 [5:37:32<22:43:24,  3.68it/s]
                                                           
{'loss': 4.1371, 'learning_rate': 8.291980003878557e-07, 'epoch': 3.04}

 19%|█▉        | 70660/371472 [5:37:32<22:43:24,  3.68it/s]
 19%|█▉        | 70661/371472 [5:37:32<22:17:53,  3.75it/s]
 19%|█▉        | 70662/371472 [5:37:32<22:30:01,  3.71it/s]
 19%|█▉        | 70663/371472 [5:37:33<22:55:43,  3.64it/s]
 19%|█▉        | 70664/371472 [5:37:33<22:09:57,  3.77it/s]
 19%|█▉        | 70665/371472 [5:37:33<21:50:35,  3.83it/s]
 19%|█▉        | 70666/371472 [5:37:34<21:20:24,  3.92it/s]
 19%|█▉        | 70667/371472 [5:37:34<21:40:55,  3.85it/s]
 19%|█▉        | 70668/371472 [5:37:34<23:37:12,  3.54it/s]
 19%|█▉        | 70669/371472 [5:37:34<24:15:36,  3.44it/s]
 19%|█▉        | 70670/371472 [5:37:35<23:58:01,  3.49it/s]
 19%|█▉        | 70671/371472 [5:37:35<24:07:59,  3.46it/s]
 19%|█▉        | 70672/371472 [5:37:35<23:47:46,  3.51it/s]
 19%|█▉        | 70673/371472 [5:37:36<24:46:05,  3.37it/s]
 19%|█▉        | 70674/371472 [5:37:36<24:12:11,  3.45it/s]
 19%|█▉        | 70675/371472 [5:37:36<23:50:37,  3.50it/s]
 19%|█▉        | 70676/371472 [5:37:36<23:52:59,  3.50it/s]
 19%|█▉        | 70677/371472 [5:37:37<24:33:34,  3.40it/s]
 19%|█▉        | 70678/371472 [5:37:37<23:12:58,  3.60it/s]
 19%|█▉        | 70679/371472 [5:37:37<24:34:12,  3.40it/s]
 19%|█▉        | 70680/371472 [5:37:38<23:38:21,  3.53it/s]
                                                           
{'loss': 4.0444, 'learning_rate': 8.291495184123768e-07, 'epoch': 3.04}

 19%|█▉        | 70680/371472 [5:37:38<23:38:21,  3.53it/s]
 19%|█▉        | 70681/371472 [5:37:38<23:39:04,  3.53it/s]
 19%|█▉        | 70682/371472 [5:37:38<22:43:37,  3.68it/s]
 19%|█▉        | 70683/371472 [5:37:38<23:36:15,  3.54it/s]
 19%|█▉        | 70684/371472 [5:37:39<22:59:44,  3.63it/s]
 19%|█▉        | 70685/371472 [5:37:39<23:42:26,  3.52it/s]
 19%|█▉        | 70686/371472 [5:37:39<22:50:55,  3.66it/s]
 19%|█▉        | 70687/371472 [5:37:40<23:10:39,  3.60it/s]
 19%|█▉        | 70688/371472 [5:37:40<23:38:21,  3.53it/s]
 19%|█▉        | 70689/371472 [5:37:40<24:57:28,  3.35it/s]
 19%|█▉        | 70690/371472 [5:37:40<23:57:29,  3.49it/s]
 19%|█▉        | 70691/371472 [5:37:41<24:23:05,  3.43it/s]
 19%|█▉        | 70692/371472 [5:37:41<23:24:06,  3.57it/s]
 19%|█▉        | 70693/371472 [5:37:41<23:04:12,  3.62it/s]
 19%|█▉        | 70694/371472 [5:37:41<22:36:45,  3.69it/s]
 19%|█▉        | 70695/371472 [5:37:42<23:09:16,  3.61it/s]
 19%|█▉        | 70696/371472 [5:37:42<26:22:27,  3.17it/s]
 19%|█▉        | 70697/371472 [5:37:42<25:02:26,  3.34it/s]
 19%|█▉        | 70698/371472 [5:37:43<24:39:01,  3.39it/s]
 19%|█▉        | 70699/371472 [5:37:43<23:16:24,  3.59it/s]
 19%|█▉        | 70700/371472 [5:37:43<23:11:34,  3.60it/s]
                                                           
{'loss': 4.0261, 'learning_rate': 8.29101036436898e-07, 'epoch': 3.05}

 19%|█▉        | 70700/371472 [5:37:43<23:11:34,  3.60it/s]
 19%|█▉        | 70701/371472 [5:37:44<24:44:39,  3.38it/s]
 19%|█▉        | 70702/371472 [5:37:44<24:28:51,  3.41it/s]
 19%|█▉        | 70703/371472 [5:37:44<23:17:52,  3.59it/s]
 19%|█▉        | 70704/371472 [5:37:44<23:21:16,  3.58it/s]
 19%|█▉        | 70705/371472 [5:37:45<22:51:09,  3.66it/s]
 19%|█▉        | 70706/371472 [5:37:45<23:48:33,  3.51it/s]
 19%|█▉        | 70707/371472 [5:37:45<25:16:16,  3.31it/s]
 19%|█▉        | 70708/371472 [5:37:46<25:06:27,  3.33it/s]
 19%|█▉        | 70709/371472 [5:37:46<24:35:02,  3.40it/s]
 19%|█▉        | 70710/371472 [5:37:46<25:34:51,  3.27it/s]
 19%|█▉        | 70711/371472 [5:37:46<24:25:04,  3.42it/s]
 19%|█▉        | 70712/371472 [5:37:47<23:23:05,  3.57it/s]
 19%|█▉        | 70713/371472 [5:37:47<23:08:15,  3.61it/s]
 19%|█▉        | 70714/371472 [5:37:47<23:05:25,  3.62it/s]
 19%|█▉        | 70715/371472 [5:37:48<23:14:41,  3.59it/s]
 19%|█▉        | 70716/371472 [5:37:48<22:47:10,  3.67it/s]
 19%|█▉        | 70717/371472 [5:37:48<22:24:49,  3.73it/s]
 19%|█▉        | 70718/371472 [5:37:48<23:37:30,  3.54it/s]
 19%|█▉        | 70719/371472 [5:37:49<24:15:14,  3.44it/s]
 19%|█▉        | 70720/371472 [5:37:49<24:26:26,  3.42it/s]
                                                           
{'loss': 4.31, 'learning_rate': 8.290525544614192e-07, 'epoch': 3.05}

 19%|█▉        | 70720/371472 [5:37:49<24:26:26,  3.42it/s]
 19%|█▉        | 70721/371472 [5:37:49<22:55:31,  3.64it/s]
 19%|█▉        | 70722/371472 [5:37:50<23:55:53,  3.49it/s]
 19%|█▉        | 70723/371472 [5:37:50<24:05:46,  3.47it/s]
 19%|█▉        | 70724/371472 [5:37:50<24:00:13,  3.48it/s]
 19%|█▉        | 70725/371472 [5:37:50<25:44:21,  3.25it/s]
 19%|█▉        | 70726/371472 [5:37:51<24:08:08,  3.46it/s]
 19%|█▉        | 70727/371472 [5:37:51<23:03:04,  3.62it/s]
 19%|█▉        | 70728/371472 [5:37:51<22:55:06,  3.65it/s]
 19%|█▉        | 70729/371472 [5:37:51<22:14:29,  3.76it/s]
 19%|█▉        | 70730/371472 [5:37:52<25:08:35,  3.32it/s]
 19%|█▉        | 70731/371472 [5:37:52<23:51:59,  3.50it/s]
 19%|█▉        | 70732/371472 [5:37:52<22:50:44,  3.66it/s]
 19%|█▉        | 70733/371472 [5:37:53<22:04:25,  3.78it/s]
 19%|█▉        | 70734/371472 [5:37:53<22:14:34,  3.76it/s]
 19%|█▉        | 70735/371472 [5:37:53<22:22:46,  3.73it/s]
 19%|█▉        | 70736/371472 [5:37:53<21:42:59,  3.85it/s]
 19%|█▉        | 70737/371472 [5:37:54<21:26:28,  3.90it/s]
 19%|█▉        | 70738/371472 [5:37:54<23:55:02,  3.49it/s]
 19%|█▉        | 70739/371472 [5:37:54<23:03:28,  3.62it/s]
 19%|█▉        | 70740/371472 [5:37:54<22:37:55,  3.69it/s]
                                                           
{'loss': 4.0623, 'learning_rate': 8.290040724859403e-07, 'epoch': 3.05}

 19%|█▉        | 70740/371472 [5:37:54<22:37:55,  3.69it/s]
 19%|█▉        | 70741/371472 [5:37:55<21:49:57,  3.83it/s]
 19%|█▉        | 70742/371472 [5:37:55<21:23:07,  3.91it/s]
 19%|█▉        | 70743/371472 [5:37:55<22:19:36,  3.74it/s]
 19%|█▉        | 70744/371472 [5:37:56<24:10:53,  3.45it/s]
 19%|█▉        | 70745/371472 [5:37:56<23:32:15,  3.55it/s]
 19%|█▉        | 70746/371472 [5:37:56<22:41:00,  3.68it/s]
 19%|█▉        | 70747/371472 [5:37:56<22:11:48,  3.76it/s]
 19%|█▉        | 70748/371472 [5:37:57<22:20:21,  3.74it/s]
 19%|█▉        | 70749/371472 [5:37:57<23:07:14,  3.61it/s]
 19%|█▉        | 70750/371472 [5:37:57<22:58:56,  3.63it/s]
 19%|█▉        | 70751/371472 [5:37:57<21:40:52,  3.85it/s]
 19%|█▉        | 70752/371472 [5:37:58<21:48:30,  3.83it/s]
 19%|█▉        | 70753/371472 [5:37:58<21:07:08,  3.96it/s]
 19%|█▉        | 70754/371472 [5:37:58<21:23:27,  3.91it/s]
 19%|█▉        | 70755/371472 [5:37:59<23:00:53,  3.63it/s]
 19%|█▉        | 70756/371472 [5:37:59<23:52:15,  3.50it/s]
 19%|█▉        | 70757/371472 [5:37:59<23:29:40,  3.56it/s]
 19%|█▉        | 70758/371472 [5:37:59<24:17:16,  3.44it/s]
 19%|█▉        | 70759/371472 [5:38:00<23:25:12,  3.57it/s]
 19%|█▉        | 70760/371472 [5:38:00<23:35:40,  3.54it/s]
                                                           
{'loss': 4.2966, 'learning_rate': 8.289555905104612e-07, 'epoch': 3.05}

 19%|█▉        | 70760/371472 [5:38:00<23:35:40,  3.54it/s]
 19%|█▉        | 70761/371472 [5:38:00<22:59:25,  3.63it/s]
 19%|█▉        | 70762/371472 [5:38:01<23:24:05,  3.57it/s]
 19%|█▉        | 70763/371472 [5:38:01<22:37:26,  3.69it/s]
 19%|█▉        | 70764/371472 [5:38:01<23:48:47,  3.51it/s]
 19%|█▉        | 70765/371472 [5:38:01<22:50:22,  3.66it/s]
 19%|█▉        | 70766/371472 [5:38:02<22:40:12,  3.68it/s]
 19%|█▉        | 70767/371472 [5:38:02<22:22:10,  3.73it/s]
 19%|█▉        | 70768/371472 [5:38:02<22:25:46,  3.72it/s]
 19%|█▉        | 70769/371472 [5:38:02<22:35:51,  3.70it/s]
 19%|█▉        | 70770/371472 [5:38:03<22:58:42,  3.64it/s]
 19%|█▉        | 70771/371472 [5:38:03<23:43:45,  3.52it/s]
 19%|█▉        | 70772/371472 [5:38:03<22:52:45,  3.65it/s]
 19%|█▉        | 70773/371472 [5:38:03<22:24:07,  3.73it/s]
 19%|█▉        | 70774/371472 [5:38:04<22:01:42,  3.79it/s]
 19%|█▉        | 70775/371472 [5:38:04<21:55:43,  3.81it/s]
 19%|█▉        | 70776/371472 [5:38:04<22:49:44,  3.66it/s]
 19%|█▉        | 70777/371472 [5:38:05<23:59:57,  3.48it/s]
 19%|█▉        | 70778/371472 [5:38:05<24:47:18,  3.37it/s]
 19%|█▉        | 70779/371472 [5:38:05<24:03:10,  3.47it/s]
 19%|█▉        | 70780/371472 [5:38:05<23:01:03,  3.63it/s]
                                                           
{'loss': 4.2703, 'learning_rate': 8.289071085349824e-07, 'epoch': 3.05}

 19%|█▉        | 70780/371472 [5:38:05<23:01:03,  3.63it/s]
 19%|█▉        | 70781/371472 [5:38:06<23:34:43,  3.54it/s]
 19%|█▉        | 70782/371472 [5:38:06<24:52:46,  3.36it/s]
 19%|█▉        | 70783/371472 [5:38:06<26:53:18,  3.11it/s]
 19%|█▉        | 70784/371472 [5:38:07<25:04:15,  3.33it/s]
 19%|█▉        | 70785/371472 [5:38:07<23:31:02,  3.55it/s]
 19%|█▉        | 70786/371472 [5:38:07<22:51:10,  3.65it/s]
 19%|█▉        | 70787/371472 [5:38:08<25:29:23,  3.28it/s]
 19%|█▉        | 70788/371472 [5:38:08<27:50:04,  3.00it/s]
 19%|█▉        | 70789/371472 [5:38:08<27:15:28,  3.06it/s]
 19%|█▉        | 70790/371472 [5:38:09<28:05:44,  2.97it/s]
 19%|█▉        | 70791/371472 [5:38:09<26:04:30,  3.20it/s]
 19%|█▉        | 70792/371472 [5:38:09<24:14:08,  3.45it/s]
 19%|█▉        | 70793/371472 [5:38:10<26:00:37,  3.21it/s]
 19%|█▉        | 70794/371472 [5:38:10<24:43:32,  3.38it/s]
 19%|█▉        | 70795/371472 [5:38:10<24:15:07,  3.44it/s]
 19%|█▉        | 70796/371472 [5:38:10<23:07:53,  3.61it/s]
 19%|█▉        | 70797/371472 [5:38:11<23:06:37,  3.61it/s]
 19%|█▉        | 70798/371472 [5:38:11<24:35:30,  3.40it/s]
 19%|█▉        | 70799/371472 [5:38:11<25:25:14,  3.29it/s]
 19%|█▉        | 70800/371472 [5:38:11<23:47:03,  3.51it/s]
                                                           
{'loss': 4.2118, 'learning_rate': 8.288586265595036e-07, 'epoch': 3.05}

 19%|█▉        | 70800/371472 [5:38:11<23:47:03,  3.51it/s]
 19%|█▉        | 70801/371472 [5:38:12<23:39:40,  3.53it/s]
 19%|█▉        | 70802/371472 [5:38:12<22:45:10,  3.67it/s]
 19%|█▉        | 70803/371472 [5:38:12<22:08:19,  3.77it/s]
 19%|█▉        | 70804/371472 [5:38:13<22:03:35,  3.79it/s]
 19%|█▉        | 70805/371472 [5:38:13<21:51:12,  3.82it/s]
 19%|█▉        | 70806/371472 [5:38:13<22:13:58,  3.76it/s]
 19%|█▉        | 70807/371472 [5:38:13<22:33:16,  3.70it/s]
 19%|█▉        | 70808/371472 [5:38:14<23:05:04,  3.62it/s]
 19%|█▉        | 70809/371472 [5:38:14<23:31:40,  3.55it/s]
 19%|█▉        | 70810/371472 [5:38:14<23:08:42,  3.61it/s]
 19%|█▉        | 70811/371472 [5:38:14<23:01:35,  3.63it/s]
 19%|█▉        | 70812/371472 [5:38:15<22:44:09,  3.67it/s]
 19%|█▉        | 70813/371472 [5:38:15<23:02:08,  3.63it/s]
 19%|█▉        | 70814/371472 [5:38:15<23:45:12,  3.52it/s]
 19%|█▉        | 70815/371472 [5:38:16<23:20:45,  3.58it/s]
 19%|█▉        | 70816/371472 [5:38:16<22:19:49,  3.74it/s]
 19%|█▉        | 70817/371472 [5:38:16<22:04:47,  3.78it/s]
 19%|█▉        | 70818/371472 [5:38:16<21:56:25,  3.81it/s]
 19%|█▉        | 70819/371472 [5:38:17<22:49:27,  3.66it/s]
 19%|█▉        | 70820/371472 [5:38:17<22:36:10,  3.69it/s]
                                                           
{'loss': 4.1231, 'learning_rate': 8.288101445840246e-07, 'epoch': 3.05}

 19%|█▉        | 70820/371472 [5:38:17<22:36:10,  3.69it/s]
 19%|█▉        | 70821/371472 [5:38:17<24:17:03,  3.44it/s]
 19%|█▉        | 70822/371472 [5:38:17<23:37:53,  3.53it/s]
 19%|█▉        | 70823/371472 [5:38:18<22:46:02,  3.67it/s]
 19%|█▉        | 70824/371472 [5:38:18<22:31:21,  3.71it/s]
 19%|█▉        | 70825/371472 [5:38:18<23:53:54,  3.49it/s]
 19%|█▉        | 70826/371472 [5:38:19<23:29:57,  3.55it/s]
 19%|█▉        | 70827/371472 [5:38:19<23:49:19,  3.51it/s]
 19%|█▉        | 70828/371472 [5:38:19<25:34:27,  3.27it/s]
 19%|█▉        | 70829/371472 [5:38:20<24:30:48,  3.41it/s]
 19%|█▉        | 70830/371472 [5:38:20<24:21:32,  3.43it/s]
 19%|█▉        | 70831/371472 [5:38:20<24:07:36,  3.46it/s]
 19%|█▉        | 70832/371472 [5:38:20<23:54:01,  3.49it/s]
 19%|█▉        | 70833/371472 [5:38:21<24:25:14,  3.42it/s]
 19%|█▉        | 70834/371472 [5:38:21<23:40:41,  3.53it/s]
 19%|█▉        | 70835/371472 [5:38:21<23:48:47,  3.51it/s]
 19%|█▉        | 70836/371472 [5:38:21<23:12:23,  3.60it/s]
 19%|█▉        | 70837/371472 [5:38:22<22:28:53,  3.71it/s]
 19%|█▉        | 70838/371472 [5:38:22<23:15:32,  3.59it/s]
 19%|█▉        | 70839/371472 [5:38:22<24:44:36,  3.37it/s]
 19%|█▉        | 70840/371472 [5:38:23<24:11:26,  3.45it/s]
                                                           
{'loss': 4.0968, 'learning_rate': 8.287616626085457e-07, 'epoch': 3.05}

 19%|█▉        | 70840/371472 [5:38:23<24:11:26,  3.45it/s]
 19%|█▉        | 70841/371472 [5:38:23<25:01:53,  3.34it/s]
 19%|█▉        | 70842/371472 [5:38:23<24:49:56,  3.36it/s]
 19%|█▉        | 70843/371472 [5:38:24<24:09:37,  3.46it/s]
 19%|█▉        | 70844/371472 [5:38:24<25:31:57,  3.27it/s]
 19%|█▉        | 70845/371472 [5:38:24<25:58:50,  3.21it/s]
 19%|█▉        | 70846/371472 [5:38:24<24:57:17,  3.35it/s]
 19%|█▉        | 70847/371472 [5:38:25<24:15:04,  3.44it/s]
 19%|█▉        | 70848/371472 [5:38:25<25:23:15,  3.29it/s]
 19%|█▉        | 70849/371472 [5:38:25<24:43:46,  3.38it/s]
 19%|█▉        | 70850/371472 [5:38:26<24:05:17,  3.47it/s]
 19%|█▉        | 70851/371472 [5:38:26<23:29:52,  3.55it/s]
 19%|█▉        | 70852/371472 [5:38:26<23:22:26,  3.57it/s]
 19%|█▉        | 70853/371472 [5:38:26<22:57:43,  3.64it/s]
 19%|█▉        | 70854/371472 [5:38:27<22:04:11,  3.78it/s]
 19%|█▉        | 70855/371472 [5:38:27<21:54:55,  3.81it/s]
 19%|█▉        | 70856/371472 [5:38:27<21:53:45,  3.81it/s]
 19%|█▉        | 70857/371472 [5:38:27<21:54:18,  3.81it/s]
 19%|█▉        | 70858/371472 [5:38:28<21:32:13,  3.88it/s]
 19%|█▉        | 70859/371472 [5:38:28<21:54:57,  3.81it/s]
 19%|█▉        | 70860/371472 [5:38:28<25:13:23,  3.31it/s]
                                                           
{'loss': 4.1668, 'learning_rate': 8.287131806330669e-07, 'epoch': 3.05}

 19%|█▉        | 70860/371472 [5:38:28<25:13:23,  3.31it/s]
 19%|█▉        | 70861/371472 [5:38:29<26:20:26,  3.17it/s]
 19%|█▉        | 70862/371472 [5:38:29<24:48:29,  3.37it/s]
 19%|█▉        | 70863/371472 [5:38:29<24:56:30,  3.35it/s]
 19%|█▉        | 70864/371472 [5:38:30<25:24:44,  3.29it/s]
 19%|█▉        | 70865/371472 [5:38:30<25:14:41,  3.31it/s]
 19%|█▉        | 70866/371472 [5:38:30<24:20:26,  3.43it/s]
 19%|█▉        | 70867/371472 [5:38:30<25:46:42,  3.24it/s]
 19%|█▉        | 70868/371472 [5:38:31<24:50:29,  3.36it/s]
 19%|█▉        | 70869/371472 [5:38:31<23:37:34,  3.53it/s]
 19%|█▉        | 70870/371472 [5:38:31<22:42:48,  3.68it/s]
 19%|█▉        | 70871/371472 [5:38:32<22:06:53,  3.78it/s]
 19%|█▉        | 70872/371472 [5:38:32<21:53:15,  3.81it/s]
 19%|█▉        | 70873/371472 [5:38:32<22:14:13,  3.75it/s]
 19%|█▉        | 70874/371472 [5:38:32<22:18:24,  3.74it/s]
 19%|█▉        | 70875/371472 [5:38:33<22:20:48,  3.74it/s]
 19%|█▉        | 70876/371472 [5:38:33<22:42:20,  3.68it/s]
 19%|█▉        | 70877/371472 [5:38:33<23:21:41,  3.57it/s]
 19%|█▉        | 70878/371472 [5:38:33<22:46:36,  3.67it/s]
 19%|█▉        | 70879/371472 [5:38:34<22:44:41,  3.67it/s]
 19%|█▉        | 70880/371472 [5:38:34<22:45:37,  3.67it/s]
                                                           
{'loss': 4.217, 'learning_rate': 8.286646986575879e-07, 'epoch': 3.05}

 19%|█▉        | 70880/371472 [5:38:34<22:45:37,  3.67it/s]
 19%|█▉        | 70881/371472 [5:38:34<21:50:06,  3.82it/s]
 19%|█▉        | 70882/371472 [5:38:34<21:32:38,  3.88it/s]
 19%|█▉        | 70883/371472 [5:38:35<21:46:41,  3.83it/s]
 19%|█▉        | 70884/371472 [5:38:35<22:36:40,  3.69it/s]
 19%|█▉        | 70885/371472 [5:38:35<22:08:25,  3.77it/s]
 19%|█▉        | 70886/371472 [5:38:36<22:29:28,  3.71it/s]
 19%|█▉        | 70887/371472 [5:38:36<21:49:44,  3.82it/s]
 19%|█▉        | 70888/371472 [5:38:36<22:30:55,  3.71it/s]
 19%|█▉        | 70889/371472 [5:38:36<22:30:24,  3.71it/s]
 19%|█▉        | 70890/371472 [5:38:37<21:59:52,  3.80it/s]
 19%|█▉        | 70891/371472 [5:38:37<22:46:16,  3.67it/s]
 19%|█▉        | 70892/371472 [5:38:37<23:02:14,  3.62it/s]
 19%|█▉        | 70893/371472 [5:38:37<24:26:11,  3.42it/s]
 19%|█▉        | 70894/371472 [5:38:38<24:55:27,  3.35it/s]
 19%|█▉        | 70895/371472 [5:38:38<26:01:06,  3.21it/s]
 19%|█▉        | 70896/371472 [5:38:38<25:47:20,  3.24it/s]
 19%|█▉        | 70897/371472 [5:38:39<24:54:24,  3.35it/s]
 19%|█▉        | 70898/371472 [5:38:39<25:19:12,  3.30it/s]
 19%|█▉        | 70899/371472 [5:38:39<26:25:30,  3.16it/s]
 19%|█▉        | 70900/371472 [5:38:40<27:59:36,  2.98it/s]
                                                           
{'loss': 4.3483, 'learning_rate': 8.28616216682109e-07, 'epoch': 3.05}

 19%|█▉        | 70900/371472 [5:38:40<27:59:36,  2.98it/s]
 19%|█▉        | 70901/371472 [5:38:40<27:45:35,  3.01it/s]
 19%|█▉        | 70902/371472 [5:38:40<26:45:49,  3.12it/s]
 19%|█▉        | 70903/371472 [5:38:41<25:55:39,  3.22it/s]
 19%|█▉        | 70904/371472 [5:38:41<24:25:19,  3.42it/s]
 19%|█▉        | 70905/371472 [5:38:41<23:32:40,  3.55it/s]
 19%|█▉        | 70906/371472 [5:38:41<23:52:39,  3.50it/s]
 19%|█▉        | 70907/371472 [5:38:42<25:56:59,  3.22it/s]
 19%|█▉        | 70908/371472 [5:38:42<25:48:55,  3.23it/s]
 19%|█▉        | 70909/371472 [5:38:42<25:09:07,  3.32it/s]
 19%|█▉        | 70910/371472 [5:38:43<26:12:57,  3.18it/s]
 19%|█▉        | 70911/371472 [5:38:43<25:54:46,  3.22it/s]
 19%|█▉        | 70912/371472 [5:38:43<25:14:08,  3.31it/s]
 19%|█▉        | 70913/371472 [5:38:44<24:57:34,  3.34it/s]
 19%|█▉        | 70914/371472 [5:38:44<26:26:14,  3.16it/s]
 19%|█▉        | 70915/371472 [5:38:44<24:30:16,  3.41it/s]
 19%|█▉        | 70916/371472 [5:38:45<24:44:57,  3.37it/s]
 19%|█▉        | 70917/371472 [5:38:45<23:46:43,  3.51it/s]
 19%|█▉        | 70918/371472 [5:38:45<25:15:30,  3.31it/s]
 19%|█▉        | 70919/371472 [5:38:45<24:45:21,  3.37it/s]
 19%|█▉        | 70920/371472 [5:38:46<25:15:15,  3.31it/s]
                                                           
{'loss': 3.878, 'learning_rate': 8.285677347066301e-07, 'epoch': 3.05}

 19%|█▉        | 70920/371472 [5:38:46<25:15:15,  3.31it/s]
 19%|█▉        | 70921/371472 [5:38:46<24:44:49,  3.37it/s]
 19%|█▉        | 70922/371472 [5:38:46<24:51:46,  3.36it/s]
 19%|█▉        | 70923/371472 [5:38:47<24:47:46,  3.37it/s]
 19%|█▉        | 70924/371472 [5:38:47<26:10:01,  3.19it/s]
 19%|█▉        | 70925/371472 [5:38:47<26:28:34,  3.15it/s]
 19%|█▉        | 70926/371472 [5:38:48<25:05:17,  3.33it/s]
 19%|█▉        | 70927/371472 [5:38:48<23:32:28,  3.55it/s]
 19%|█▉        | 70928/371472 [5:38:48<22:52:30,  3.65it/s]
 19%|█▉        | 70929/371472 [5:38:48<24:31:21,  3.40it/s]
 19%|█▉        | 70930/371472 [5:38:49<24:48:25,  3.37it/s]
 19%|█▉        | 70931/371472 [5:38:49<24:36:01,  3.39it/s]
 19%|█▉        | 70932/371472 [5:38:49<24:04:12,  3.47it/s]
 19%|█▉        | 70933/371472 [5:38:50<23:56:41,  3.49it/s]
 19%|█▉        | 70934/371472 [5:38:50<23:34:19,  3.54it/s]
 19%|█▉        | 70935/371472 [5:38:50<23:10:20,  3.60it/s]
 19%|█▉        | 70936/371472 [5:38:50<23:42:04,  3.52it/s]
 19%|█▉        | 70937/371472 [5:38:51<23:15:32,  3.59it/s]
 19%|█▉        | 70938/371472 [5:38:51<24:09:41,  3.46it/s]
 19%|█▉        | 70939/371472 [5:38:51<24:38:02,  3.39it/s]
 19%|█▉        | 70940/371472 [5:38:52<23:58:51,  3.48it/s]
                                                           
{'loss': 4.1455, 'learning_rate': 8.285192527311513e-07, 'epoch': 3.06}

 19%|█▉        | 70940/371472 [5:38:52<23:58:51,  3.48it/s]
 19%|█▉        | 70941/371472 [5:38:52<25:11:53,  3.31it/s]
 19%|█▉        | 70942/371472 [5:38:52<24:11:00,  3.45it/s]
 19%|█▉        | 70943/371472 [5:38:52<25:18:06,  3.30it/s]
 19%|█▉        | 70944/371472 [5:38:53<24:12:38,  3.45it/s]
 19%|█▉        | 70945/371472 [5:38:53<24:33:14,  3.40it/s]
 19%|█▉        | 70946/371472 [5:38:53<23:22:30,  3.57it/s]
 19%|█▉        | 70947/371472 [5:38:54<22:07:42,  3.77it/s]
 19%|█▉        | 70948/371472 [5:38:54<21:55:26,  3.81it/s]
 19%|█▉        | 70949/371472 [5:38:54<24:16:35,  3.44it/s]
 19%|█▉        | 70950/371472 [5:38:54<22:50:11,  3.66it/s]
 19%|█▉        | 70951/371472 [5:38:55<22:10:25,  3.76it/s]
 19%|█▉        | 70952/371472 [5:38:55<22:22:42,  3.73it/s]
 19%|█▉        | 70953/371472 [5:38:55<23:36:08,  3.54it/s]
 19%|█▉        | 70954/371472 [5:38:56<24:01:28,  3.47it/s]
 19%|█▉        | 70955/371472 [5:38:56<23:26:47,  3.56it/s]
 19%|█▉        | 70956/371472 [5:38:56<23:46:33,  3.51it/s]
 19%|█▉        | 70957/371472 [5:38:56<24:05:15,  3.47it/s]
 19%|█▉        | 70958/371472 [5:38:57<23:20:22,  3.58it/s]
 19%|█▉        | 70959/371472 [5:38:57<24:39:30,  3.39it/s]
 19%|█▉        | 70960/371472 [5:38:57<24:43:19,  3.38it/s]
                                                           
{'loss': 4.2554, 'learning_rate': 8.284707707556723e-07, 'epoch': 3.06}

 19%|█▉        | 70960/371472 [5:38:57<24:43:19,  3.38it/s]
 19%|█▉        | 70961/371472 [5:38:58<24:30:24,  3.41it/s]
 19%|█▉        | 70962/371472 [5:38:58<23:58:17,  3.48it/s]
 19%|█▉        | 70963/371472 [5:38:58<23:31:36,  3.55it/s]
 19%|█▉        | 70964/371472 [5:38:58<23:09:08,  3.61it/s]
 19%|█▉        | 70965/371472 [5:38:59<26:52:57,  3.11it/s]
 19%|█▉        | 70966/371472 [5:38:59<27:05:15,  3.08it/s]
 19%|█▉        | 70967/371472 [5:38:59<25:29:53,  3.27it/s]
 19%|█▉        | 70968/371472 [5:39:00<25:14:02,  3.31it/s]
 19%|█▉        | 70969/371472 [5:39:00<23:52:52,  3.50it/s]
 19%|█▉        | 70970/371472 [5:39:00<23:14:52,  3.59it/s]
 19%|█▉        | 70971/371472 [5:39:00<24:29:56,  3.41it/s]
 19%|█▉        | 70972/371472 [5:39:01<23:21:25,  3.57it/s]
 19%|█▉        | 70973/371472 [5:39:01<22:34:42,  3.70it/s]
 19%|█▉        | 70974/371472 [5:39:01<23:02:22,  3.62it/s]
 19%|█▉        | 70975/371472 [5:39:02<22:43:27,  3.67it/s]
 19%|█▉        | 70976/371472 [5:39:02<22:27:47,  3.72it/s]
 19%|█▉        | 70977/371472 [5:39:02<21:59:35,  3.80it/s]
 19%|█▉        | 70978/371472 [5:39:02<22:03:51,  3.78it/s]
 19%|█▉        | 70979/371472 [5:39:03<21:46:18,  3.83it/s]
 19%|█▉        | 70980/371472 [5:39:03<21:50:28,  3.82it/s]
                                                           
{'loss': 3.9374, 'learning_rate': 8.284222887801935e-07, 'epoch': 3.06}

 19%|█▉        | 70980/371472 [5:39:03<21:50:28,  3.82it/s]
 19%|█▉        | 70981/371472 [5:39:03<21:38:49,  3.86it/s]
 19%|█▉        | 70982/371472 [5:39:03<22:02:39,  3.79it/s]
 19%|█▉        | 70983/371472 [5:39:04<21:56:28,  3.80it/s]
 19%|█▉        | 70984/371472 [5:39:04<22:12:29,  3.76it/s]
 19%|█▉        | 70985/371472 [5:39:04<22:00:23,  3.79it/s]
 19%|█▉        | 70986/371472 [5:39:04<23:07:21,  3.61it/s]
 19%|█▉        | 70987/371472 [5:39:05<22:18:58,  3.74it/s]
 19%|█▉        | 70988/371472 [5:39:05<22:45:13,  3.67it/s]
 19%|█▉        | 70989/371472 [5:39:05<22:50:59,  3.65it/s]
 19%|█▉        | 70990/371472 [5:39:06<23:18:42,  3.58it/s]
 19%|█▉        | 70991/371472 [5:39:06<24:03:12,  3.47it/s]
 19%|█▉        | 70992/371472 [5:39:06<23:19:47,  3.58it/s]
 19%|█▉        | 70993/371472 [5:39:06<22:49:00,  3.66it/s]
 19%|█▉        | 70994/371472 [5:39:07<22:54:37,  3.64it/s]
 19%|█▉        | 70995/371472 [5:39:07<22:55:29,  3.64it/s]
 19%|█▉        | 70996/371472 [5:39:07<23:14:17,  3.59it/s]
 19%|█▉        | 70997/371472 [5:39:07<22:27:04,  3.72it/s]
 19%|█▉        | 70998/371472 [5:39:08<22:48:24,  3.66it/s]
 19%|█▉        | 70999/371472 [5:39:08<23:36:37,  3.54it/s]
 19%|█▉        | 71000/371472 [5:39:08<24:29:29,  3.41it/s]
                                                           
{'loss': 4.2194, 'learning_rate': 8.283738068047146e-07, 'epoch': 3.06}

 19%|█▉        | 71000/371472 [5:39:08<24:29:29,  3.41it/s]
 19%|█▉        | 71001/371472 [5:39:09<24:19:52,  3.43it/s]
 19%|█▉        | 71002/371472 [5:39:09<25:16:48,  3.30it/s]
 19%|█▉        | 71003/371472 [5:39:09<25:25:36,  3.28it/s]
 19%|█▉        | 71004/371472 [5:39:10<24:56:34,  3.35it/s]
 19%|█▉        | 71005/371472 [5:39:10<28:19:24,  2.95it/s]
 19%|█▉        | 71006/371472 [5:39:10<27:00:18,  3.09it/s]
 19%|█▉        | 71007/371472 [5:39:11<24:59:49,  3.34it/s]
 19%|█▉        | 71008/371472 [5:39:11<23:48:32,  3.51it/s]
 19%|█▉        | 71009/371472 [5:39:11<26:53:46,  3.10it/s]
 19%|█▉        | 71010/371472 [5:39:11<25:31:02,  3.27it/s]
 19%|█▉        | 71011/371472 [5:39:12<25:20:55,  3.29it/s]
 19%|█▉        | 71012/371472 [5:39:12<25:51:51,  3.23it/s]
 19%|█▉        | 71013/371472 [5:39:12<26:59:27,  3.09it/s]
 19%|█▉        | 71014/371472 [5:39:13<24:50:43,  3.36it/s]
 19%|█▉        | 71015/371472 [5:39:13<23:16:39,  3.59it/s]
 19%|█▉        | 71016/371472 [5:39:13<22:04:22,  3.78it/s]
 19%|█▉        | 71017/371472 [5:39:13<21:43:20,  3.84it/s]
 19%|█▉        | 71018/371472 [5:39:14<21:22:37,  3.90it/s]
 19%|█▉        | 71019/371472 [5:39:14<22:03:48,  3.78it/s]
 19%|█▉        | 71020/371472 [5:39:14<22:40:28,  3.68it/s]
                                                           
{'loss': 4.1952, 'learning_rate': 8.283253248292357e-07, 'epoch': 3.06}

 19%|█▉        | 71020/371472 [5:39:14<22:40:28,  3.68it/s]
 19%|█▉        | 71021/371472 [5:39:15<23:28:41,  3.55it/s]
 19%|█▉        | 71022/371472 [5:39:15<25:19:25,  3.30it/s]
 19%|█▉        | 71023/371472 [5:39:15<24:55:05,  3.35it/s]
 19%|█▉        | 71024/371472 [5:39:16<25:54:18,  3.22it/s]
 19%|█▉        | 71025/371472 [5:39:16<25:25:49,  3.28it/s]
 19%|█▉        | 71026/371472 [5:39:16<25:04:11,  3.33it/s]
 19%|█▉        | 71027/371472 [5:39:16<25:06:17,  3.32it/s]
 19%|█▉        | 71028/371472 [5:39:17<24:36:44,  3.39it/s]
 19%|█▉        | 71029/371472 [5:39:17<24:41:53,  3.38it/s]
 19%|█▉        | 71030/371472 [5:39:17<24:57:42,  3.34it/s]
 19%|█▉        | 71031/371472 [5:39:18<25:24:40,  3.28it/s]
 19%|█▉        | 71032/371472 [5:39:18<24:02:43,  3.47it/s]
 19%|█▉        | 71033/371472 [5:39:18<24:35:54,  3.39it/s]
 19%|█▉        | 71034/371472 [5:39:18<23:59:07,  3.48it/s]
 19%|█▉        | 71035/371472 [5:39:19<23:53:46,  3.49it/s]
 19%|█▉        | 71036/371472 [5:39:19<23:22:05,  3.57it/s]
 19%|█▉        | 71037/371472 [5:39:19<23:25:04,  3.56it/s]
 19%|█▉        | 71038/371472 [5:39:20<22:33:31,  3.70it/s]
 19%|█▉        | 71039/371472 [5:39:20<22:32:10,  3.70it/s]
 19%|█▉        | 71040/371472 [5:39:20<24:04:38,  3.47it/s]
                                                           
{'loss': 4.0305, 'learning_rate': 8.282768428537567e-07, 'epoch': 3.06}

 19%|█▉        | 71040/371472 [5:39:20<24:04:38,  3.47it/s]
 19%|█▉        | 71041/371472 [5:39:20<25:33:14,  3.27it/s]
 19%|█▉        | 71042/371472 [5:39:21<24:34:19,  3.40it/s]
 19%|█▉        | 71043/371472 [5:39:21<23:32:03,  3.55it/s]
 19%|█▉        | 71044/371472 [5:39:21<24:10:04,  3.45it/s]
 19%|█▉        | 71045/371472 [5:39:22<23:32:07,  3.55it/s]
 19%|█▉        | 71046/371472 [5:39:22<23:01:32,  3.62it/s]
 19%|█▉        | 71047/371472 [5:39:22<22:37:51,  3.69it/s]
 19%|█▉        | 71048/371472 [5:39:22<23:09:33,  3.60it/s]
 19%|█▉        | 71049/371472 [5:39:23<22:45:16,  3.67it/s]
 19%|█▉        | 71050/371472 [5:39:23<22:30:52,  3.71it/s]
 19%|█▉        | 71051/371472 [5:39:23<22:52:34,  3.65it/s]
 19%|█▉        | 71052/371472 [5:39:23<23:36:00,  3.54it/s]
 19%|█▉        | 71053/371472 [5:39:24<24:22:56,  3.42it/s]
 19%|█▉        | 71054/371472 [5:39:24<23:59:57,  3.48it/s]
 19%|█▉        | 71055/371472 [5:39:24<23:37:00,  3.53it/s]
 19%|█▉        | 71056/371472 [5:39:25<23:17:59,  3.58it/s]
 19%|█▉        | 71057/371472 [5:39:25<23:17:39,  3.58it/s]
 19%|█▉        | 71058/371472 [5:39:25<22:38:05,  3.69it/s]
 19%|█▉        | 71059/371472 [5:39:25<22:21:06,  3.73it/s]
 19%|█▉        | 71060/371472 [5:39:26<22:46:52,  3.66it/s]
                                                           
{'loss': 4.0013, 'learning_rate': 8.282283608782779e-07, 'epoch': 3.06}

 19%|█▉        | 71060/371472 [5:39:26<22:46:52,  3.66it/s]
 19%|█▉        | 71061/371472 [5:39:26<22:36:00,  3.69it/s]
 19%|█▉        | 71062/371472 [5:39:26<23:04:44,  3.62it/s]
 19%|█▉        | 71063/371472 [5:39:27<22:51:03,  3.65it/s]
 19%|█▉        | 71064/371472 [5:39:27<25:04:17,  3.33it/s]
 19%|█▉        | 71065/371472 [5:39:27<24:50:59,  3.36it/s]
 19%|█▉        | 71066/371472 [5:39:27<25:02:59,  3.33it/s]
 19%|█▉        | 71067/371472 [5:39:28<23:39:43,  3.53it/s]
 19%|█▉        | 71068/371472 [5:39:28<22:58:40,  3.63it/s]
 19%|█▉        | 71069/371472 [5:39:28<22:58:30,  3.63it/s]
 19%|█▉        | 71070/371472 [5:39:29<23:21:18,  3.57it/s]
 19%|█▉        | 71071/371472 [5:39:29<23:12:55,  3.59it/s]
 19%|█▉        | 71072/371472 [5:39:29<23:13:25,  3.59it/s]
 19%|█▉        | 71073/371472 [5:39:30<27:20:41,  3.05it/s]
 19%|█▉        | 71074/371472 [5:39:30<26:12:05,  3.18it/s]
 19%|█▉        | 71075/371472 [5:39:30<24:55:22,  3.35it/s]
 19%|█▉        | 71076/371472 [5:39:30<23:42:05,  3.52it/s]
 19%|█▉        | 71077/371472 [5:39:31<23:52:33,  3.49it/s]
 19%|█▉        | 71078/371472 [5:39:31<23:25:04,  3.56it/s]
 19%|█▉        | 71079/371472 [5:39:31<24:35:17,  3.39it/s]
 19%|█▉        | 71080/371472 [5:39:32<24:09:41,  3.45it/s]
                                                           
{'loss': 4.3159, 'learning_rate': 8.28179878902799e-07, 'epoch': 3.06}

 19%|█▉        | 71080/371472 [5:39:32<24:09:41,  3.45it/s]
 19%|█▉        | 71081/371472 [5:39:32<24:36:00,  3.39it/s]
 19%|█▉        | 71082/371472 [5:39:32<24:30:07,  3.41it/s]
 19%|█▉        | 71083/371472 [5:39:32<25:11:49,  3.31it/s]
 19%|█▉        | 71084/371472 [5:39:33<24:19:56,  3.43it/s]
 19%|█▉        | 71085/371472 [5:39:33<23:14:18,  3.59it/s]
 19%|█▉        | 71086/371472 [5:39:33<25:09:25,  3.32it/s]
 19%|█▉        | 71087/371472 [5:39:34<26:07:06,  3.19it/s]
 19%|█▉        | 71088/371472 [5:39:34<26:35:56,  3.14it/s]
 19%|█▉        | 71089/371472 [5:39:34<25:07:03,  3.32it/s]
 19%|█▉        | 71090/371472 [5:39:34<24:27:22,  3.41it/s]
 19%|█▉        | 71091/371472 [5:39:35<23:44:59,  3.51it/s]
 19%|█▉        | 71092/371472 [5:39:35<23:33:35,  3.54it/s]
 19%|█▉        | 71093/371472 [5:39:35<22:56:00,  3.64it/s]
 19%|█▉        | 71094/371472 [5:39:36<23:32:09,  3.55it/s]
 19%|█▉        | 71095/371472 [5:39:36<24:19:45,  3.43it/s]
 19%|█▉        | 71096/371472 [5:39:36<25:27:39,  3.28it/s]
 19%|█▉        | 71097/371472 [5:39:37<25:36:28,  3.26it/s]
 19%|█▉        | 71098/371472 [5:39:37<27:30:15,  3.03it/s]
 19%|█▉        | 71099/371472 [5:39:37<26:09:50,  3.19it/s]
 19%|█▉        | 71100/371472 [5:39:38<26:26:52,  3.15it/s]
                                                           
{'loss': 4.2653, 'learning_rate': 8.281313969273202e-07, 'epoch': 3.06}

 19%|█▉        | 71100/371472 [5:39:38<26:26:52,  3.15it/s]
 19%|█▉        | 71101/371472 [5:39:38<25:19:32,  3.29it/s]
 19%|█▉        | 71102/371472 [5:39:38<24:17:53,  3.43it/s]
 19%|█▉        | 71103/371472 [5:39:38<24:24:48,  3.42it/s]
 19%|█▉        | 71104/371472 [5:39:39<24:04:15,  3.47it/s]
 19%|█▉        | 71105/371472 [5:39:39<23:33:23,  3.54it/s]
 19%|█▉        | 71106/371472 [5:39:39<22:57:12,  3.63it/s]
 19%|█▉        | 71107/371472 [5:39:39<22:28:32,  3.71it/s]
 19%|█▉        | 71108/371472 [5:39:40<22:06:28,  3.77it/s]
 19%|█▉        | 71109/371472 [5:39:40<22:22:34,  3.73it/s]
 19%|█▉        | 71110/371472 [5:39:40<23:11:33,  3.60it/s]
 19%|█▉        | 71111/371472 [5:39:41<23:39:57,  3.53it/s]
 19%|█▉        | 71112/371472 [5:39:41<25:14:03,  3.31it/s]
 19%|█▉        | 71113/371472 [5:39:41<26:12:12,  3.18it/s]
 19%|█▉        | 71114/371472 [5:39:41<24:36:03,  3.39it/s]
 19%|█▉        | 71115/371472 [5:39:42<23:57:54,  3.48it/s]
 19%|█▉        | 71116/371472 [5:39:42<23:09:13,  3.60it/s]
 19%|█▉        | 71117/371472 [5:39:42<24:22:06,  3.42it/s]
 19%|█▉        | 71118/371472 [5:39:43<24:12:19,  3.45it/s]
 19%|█▉        | 71119/371472 [5:39:43<23:09:16,  3.60it/s]
 19%|█▉        | 71120/371472 [5:39:43<22:45:16,  3.67it/s]
                                                           
{'loss': 4.2117, 'learning_rate': 8.280829149518412e-07, 'epoch': 3.06}

 19%|█▉        | 71120/371472 [5:39:43<22:45:16,  3.67it/s]
 19%|█▉        | 71121/371472 [5:39:43<24:00:38,  3.47it/s]
 19%|█▉        | 71122/371472 [5:39:44<23:15:02,  3.59it/s]
 19%|█▉        | 71123/371472 [5:39:44<24:31:40,  3.40it/s]
 19%|█▉        | 71124/371472 [5:39:44<23:35:24,  3.54it/s]
 19%|█▉        | 71125/371472 [5:39:45<22:34:08,  3.70it/s]
 19%|█▉        | 71126/371472 [5:39:45<23:09:43,  3.60it/s]
 19%|█▉        | 71127/371472 [5:39:45<22:36:00,  3.69it/s]
 19%|█▉        | 71128/371472 [5:39:45<22:32:08,  3.70it/s]
 19%|█▉        | 71129/371472 [5:39:46<22:30:22,  3.71it/s]
 19%|█▉        | 71130/371472 [5:39:46<22:35:32,  3.69it/s]
 19%|█▉        | 71131/371472 [5:39:46<22:54:02,  3.64it/s]
 19%|█▉        | 71132/371472 [5:39:46<21:58:37,  3.80it/s]
 19%|█▉        | 71133/371472 [5:39:47<22:40:42,  3.68it/s]
 19%|█▉        | 71134/371472 [5:39:47<23:29:10,  3.55it/s]
 19%|█▉        | 71135/371472 [5:39:47<23:06:18,  3.61it/s]
 19%|█▉        | 71136/371472 [5:39:48<24:02:57,  3.47it/s]
 19%|█▉        | 71137/371472 [5:39:48<23:26:27,  3.56it/s]
 19%|█▉        | 71138/371472 [5:39:48<23:39:14,  3.53it/s]
 19%|█▉        | 71139/371472 [5:39:48<24:57:42,  3.34it/s]
 19%|█▉        | 71140/371472 [5:39:49<25:34:01,  3.26it/s]
                                                           
{'loss': 3.9771, 'learning_rate': 8.280344329763623e-07, 'epoch': 3.06}

 19%|█▉        | 71140/371472 [5:39:49<25:34:01,  3.26it/s]
 19%|█▉        | 71141/371472 [5:39:49<24:50:00,  3.36it/s]
 19%|█▉        | 71142/371472 [5:39:49<24:36:55,  3.39it/s]
 19%|█▉        | 71143/371472 [5:39:50<25:07:19,  3.32it/s]
 19%|█▉        | 71144/371472 [5:39:50<24:32:33,  3.40it/s]
 19%|█▉        | 71145/371472 [5:39:50<23:49:48,  3.50it/s]
 19%|█▉        | 71146/371472 [5:39:51<23:24:19,  3.56it/s]
 19%|█▉        | 71147/371472 [5:39:51<23:21:42,  3.57it/s]
 19%|█▉        | 71148/371472 [5:39:51<29:17:52,  2.85it/s]
 19%|█▉        | 71149/371472 [5:39:52<27:39:15,  3.02it/s]
 19%|█▉        | 71150/371472 [5:39:52<25:53:09,  3.22it/s]
 19%|█▉        | 71151/371472 [5:39:52<25:04:03,  3.33it/s]
 19%|█▉        | 71152/371472 [5:39:52<24:28:21,  3.41it/s]
 19%|█▉        | 71153/371472 [5:39:53<23:45:32,  3.51it/s]
 19%|█▉        | 71154/371472 [5:39:53<24:12:18,  3.45it/s]
 19%|█▉        | 71155/371472 [5:39:53<23:27:40,  3.56it/s]
 19%|█▉        | 71156/371472 [5:39:54<23:06:59,  3.61it/s]
 19%|█▉        | 71157/371472 [5:39:54<23:45:52,  3.51it/s]
 19%|█▉        | 71158/371472 [5:39:54<22:55:42,  3.64it/s]
 19%|█▉        | 71159/371472 [5:39:54<24:40:12,  3.38it/s]
 19%|█▉        | 71160/371472 [5:39:55<23:32:21,  3.54it/s]
                                                           
{'loss': 4.323, 'learning_rate': 8.279859510008834e-07, 'epoch': 3.06}

 19%|█▉        | 71160/371472 [5:39:55<23:32:21,  3.54it/s]
 19%|█▉        | 71161/371472 [5:39:55<23:11:41,  3.60it/s]
 19%|█▉        | 71162/371472 [5:39:55<23:55:19,  3.49it/s]
 19%|█▉        | 71163/371472 [5:39:55<23:21:59,  3.57it/s]
 19%|█▉        | 71164/371472 [5:39:56<23:34:41,  3.54it/s]
 19%|█▉        | 71165/371472 [5:39:56<23:15:54,  3.59it/s]
 19%|█▉        | 71166/371472 [5:39:56<23:17:47,  3.58it/s]
 19%|█▉        | 71167/371472 [5:39:57<23:42:58,  3.52it/s]
 19%|█▉        | 71168/371472 [5:39:57<22:39:27,  3.68it/s]
 19%|█▉        | 71169/371472 [5:39:57<22:35:16,  3.69it/s]
 19%|█▉        | 71170/371472 [5:39:57<22:23:59,  3.72it/s]
 19%|█▉        | 71171/371472 [5:39:58<23:56:43,  3.48it/s]
 19%|█▉        | 71172/371472 [5:39:58<24:38:09,  3.39it/s]
 19%|█▉        | 71173/371472 [5:39:58<24:37:15,  3.39it/s]
 19%|█▉        | 71174/371472 [5:39:59<24:32:32,  3.40it/s]
 19%|█▉        | 71175/371472 [5:39:59<24:19:14,  3.43it/s]
 19%|█▉        | 71176/371472 [5:39:59<24:14:16,  3.44it/s]
 19%|█▉        | 71177/371472 [5:39:59<24:08:20,  3.46it/s]
 19%|█▉        | 71178/371472 [5:40:00<23:17:11,  3.58it/s]
 19%|█▉        | 71179/371472 [5:40:00<24:35:50,  3.39it/s]
 19%|█▉        | 71180/371472 [5:40:00<24:13:10,  3.44it/s]
                                                           
{'loss': 4.0561, 'learning_rate': 8.279374690254045e-07, 'epoch': 3.07}

 19%|█▉        | 71180/371472 [5:40:00<24:13:10,  3.44it/s]
 19%|█▉        | 71181/371472 [5:40:01<24:12:58,  3.44it/s]
 19%|█▉        | 71182/371472 [5:40:01<23:43:41,  3.52it/s]
 19%|█▉        | 71183/371472 [5:40:01<23:14:03,  3.59it/s]
 19%|█▉        | 71184/371472 [5:40:01<22:33:56,  3.70it/s]
 19%|█▉        | 71185/371472 [5:40:02<23:04:50,  3.61it/s]
 19%|█▉        | 71186/371472 [5:40:02<22:54:36,  3.64it/s]
 19%|█▉        | 71187/371472 [5:40:02<25:17:46,  3.30it/s]
 19%|█▉        | 71188/371472 [5:40:03<24:08:18,  3.46it/s]
 19%|█▉        | 71189/371472 [5:40:03<24:17:55,  3.43it/s]
 19%|█▉        | 71190/371472 [5:40:03<24:09:49,  3.45it/s]
 19%|█▉        | 71191/371472 [5:40:03<23:00:49,  3.62it/s]
 19%|█▉        | 71192/371472 [5:40:04<24:06:00,  3.46it/s]
 19%|█▉        | 71193/371472 [5:40:04<24:34:59,  3.39it/s]
 19%|█▉        | 71194/371472 [5:40:04<23:34:00,  3.54it/s]
 19%|█▉        | 71195/371472 [5:40:05<23:19:16,  3.58it/s]
 19%|█▉        | 71196/371472 [5:40:05<23:53:05,  3.49it/s]
 19%|█▉        | 71197/371472 [5:40:05<23:27:21,  3.56it/s]
 19%|█▉        | 71198/371472 [5:40:05<22:43:14,  3.67it/s]
 19%|█▉        | 71199/371472 [5:40:06<22:13:20,  3.75it/s]
 19%|█▉        | 71200/371472 [5:40:06<22:26:05,  3.72it/s]
                                                           
{'loss': 4.0266, 'learning_rate': 8.278889870499256e-07, 'epoch': 3.07}

 19%|█▉        | 71200/371472 [5:40:06<22:26:05,  3.72it/s]
 19%|█▉        | 71201/371472 [5:40:06<23:16:43,  3.58it/s]
 19%|█▉        | 71202/371472 [5:40:07<25:15:36,  3.30it/s]
 19%|█▉        | 71203/371472 [5:40:07<24:40:25,  3.38it/s]
 19%|█▉        | 71204/371472 [5:40:07<25:32:49,  3.26it/s]
 19%|█▉        | 71205/371472 [5:40:08<24:58:56,  3.34it/s]
 19%|█▉        | 71206/371472 [5:40:08<23:58:52,  3.48it/s]
 19%|█▉        | 71207/371472 [5:40:08<23:35:20,  3.54it/s]
 19%|█▉        | 71208/371472 [5:40:08<24:56:38,  3.34it/s]
 19%|█▉        | 71209/371472 [5:40:09<24:40:17,  3.38it/s]
 19%|█▉        | 71210/371472 [5:40:09<23:38:17,  3.53it/s]
 19%|█▉        | 71211/371472 [5:40:09<23:26:53,  3.56it/s]
 19%|█▉        | 71212/371472 [5:40:09<23:48:06,  3.50it/s]
 19%|█▉        | 71213/371472 [5:40:10<23:36:32,  3.53it/s]
 19%|█▉        | 71214/371472 [5:40:10<23:04:07,  3.62it/s]
 19%|█▉        | 71215/371472 [5:40:10<22:53:22,  3.64it/s]
 19%|█▉        | 71216/371472 [5:40:11<23:35:06,  3.54it/s]
 19%|█▉        | 71217/371472 [5:40:11<23:10:32,  3.60it/s]
 19%|█▉        | 71218/371472 [5:40:11<23:43:09,  3.52it/s]
 19%|█▉        | 71219/371472 [5:40:11<23:19:51,  3.57it/s]
 19%|█▉        | 71220/371472 [5:40:12<23:26:30,  3.56it/s]
                                                           
{'loss': 4.2683, 'learning_rate': 8.278405050744467e-07, 'epoch': 3.07}

 19%|█▉        | 71220/371472 [5:40:12<23:26:30,  3.56it/s]
 19%|█▉        | 71221/371472 [5:40:12<23:12:07,  3.59it/s]
 19%|█▉        | 71222/371472 [5:40:12<22:31:46,  3.70it/s]
 19%|█▉        | 71223/371472 [5:40:13<23:16:05,  3.58it/s]
 19%|█▉        | 71224/371472 [5:40:13<23:53:38,  3.49it/s]
 19%|█▉        | 71225/371472 [5:40:13<30:42:58,  2.72it/s]
 19%|█▉        | 71226/371472 [5:40:14<27:46:02,  3.00it/s]
 19%|█▉        | 71227/371472 [5:40:14<25:59:19,  3.21it/s]
 19%|█▉        | 71228/371472 [5:40:14<24:48:18,  3.36it/s]
 19%|█▉        | 71229/371472 [5:40:15<25:39:55,  3.25it/s]
 19%|█▉        | 71230/371472 [5:40:15<24:29:22,  3.41it/s]
 19%|█▉        | 71231/371472 [5:40:15<25:11:31,  3.31it/s]
 19%|█▉        | 71232/371472 [5:40:15<24:25:16,  3.42it/s]
 19%|█▉        | 71233/371472 [5:40:16<23:25:30,  3.56it/s]
 19%|█▉        | 71234/371472 [5:40:16<22:58:34,  3.63it/s]
 19%|█▉        | 71235/371472 [5:40:16<22:13:37,  3.75it/s]
 19%|█▉        | 71236/371472 [5:40:16<22:29:36,  3.71it/s]
 19%|█▉        | 71237/371472 [5:40:17<22:29:09,  3.71it/s]
 19%|█▉        | 71238/371472 [5:40:17<22:00:56,  3.79it/s]
 19%|█▉        | 71239/371472 [5:40:17<23:51:16,  3.50it/s]
 19%|█▉        | 71240/371472 [5:40:18<23:08:33,  3.60it/s]
                                                           
{'loss': 4.1258, 'learning_rate': 8.277920230989679e-07, 'epoch': 3.07}

 19%|█▉        | 71240/371472 [5:40:18<23:08:33,  3.60it/s]
 19%|█▉        | 71241/371472 [5:40:18<23:52:11,  3.49it/s]
 19%|█▉        | 71242/371472 [5:40:18<23:29:50,  3.55it/s]
 19%|█▉        | 71243/371472 [5:40:18<25:01:04,  3.33it/s]
 19%|█▉        | 71244/371472 [5:40:19<24:27:55,  3.41it/s]
 19%|█▉        | 71245/371472 [5:40:19<24:14:41,  3.44it/s]
 19%|█▉        | 71246/371472 [5:40:19<25:27:59,  3.27it/s]
 19%|█▉        | 71247/371472 [5:40:20<24:53:58,  3.35it/s]
 19%|█▉        | 71248/371472 [5:40:20<27:56:06,  2.99it/s]
 19%|█▉        | 71249/371472 [5:40:20<27:35:39,  3.02it/s]
 19%|█▉        | 71250/371472 [5:40:21<26:39:57,  3.13it/s]
 19%|█▉        | 71251/371472 [5:40:21<24:53:41,  3.35it/s]
 19%|█▉        | 71252/371472 [5:40:21<24:09:35,  3.45it/s]
 19%|█▉        | 71253/371472 [5:40:21<24:37:55,  3.39it/s]
 19%|█▉        | 71254/371472 [5:40:22<27:14:51,  3.06it/s]
 19%|█▉        | 71255/371472 [5:40:22<27:09:44,  3.07it/s]
 19%|█▉        | 71256/371472 [5:40:22<25:02:14,  3.33it/s]
 19%|█▉        | 71257/371472 [5:40:23<24:05:14,  3.46it/s]
 19%|█▉        | 71258/371472 [5:40:23<23:33:59,  3.54it/s]
 19%|█▉        | 71259/371472 [5:40:23<23:08:50,  3.60it/s]
 19%|█▉        | 71260/371472 [5:40:24<25:50:57,  3.23it/s]
                                                           
{'loss': 4.164, 'learning_rate': 8.277435411234889e-07, 'epoch': 3.07}

 19%|█▉        | 71260/371472 [5:40:24<25:50:57,  3.23it/s]
 19%|█▉        | 71261/371472 [5:40:24<25:00:16,  3.34it/s]
 19%|█▉        | 71262/371472 [5:40:24<26:32:08,  3.14it/s]
 19%|█▉        | 71263/371472 [5:40:25<25:16:57,  3.30it/s]
 19%|█▉        | 71264/371472 [5:40:25<23:37:33,  3.53it/s]
 19%|█▉        | 71265/371472 [5:40:25<23:03:52,  3.62it/s]
 19%|█▉        | 71266/371472 [5:40:25<25:11:16,  3.31it/s]
 19%|█▉        | 71267/371472 [5:40:26<25:10:24,  3.31it/s]
 19%|█▉        | 71268/371472 [5:40:26<25:04:53,  3.32it/s]
 19%|█▉        | 71269/371472 [5:40:26<24:04:42,  3.46it/s]
 19%|█▉        | 71270/371472 [5:40:27<24:13:32,  3.44it/s]
 19%|█▉        | 71271/371472 [5:40:27<24:10:40,  3.45it/s]
 19%|█▉        | 71272/371472 [5:40:27<23:54:57,  3.49it/s]
 19%|█▉        | 71273/371472 [5:40:27<23:14:01,  3.59it/s]
 19%|█▉        | 71274/371472 [5:40:28<23:13:42,  3.59it/s]
 19%|█▉        | 71275/371472 [5:40:28<22:23:26,  3.72it/s]
 19%|█▉        | 71276/371472 [5:40:28<23:24:07,  3.56it/s]
 19%|█▉        | 71277/371472 [5:40:28<22:33:14,  3.70it/s]
 19%|█▉        | 71278/371472 [5:40:29<24:48:35,  3.36it/s]
 19%|█▉        | 71279/371472 [5:40:29<23:27:17,  3.56it/s]
 19%|█▉        | 71280/371472 [5:40:29<22:56:52,  3.63it/s]
                                                           
{'loss': 4.1158, 'learning_rate': 8.2769505914801e-07, 'epoch': 3.07}

 19%|█▉        | 71280/371472 [5:40:29<22:56:52,  3.63it/s]
 19%|█▉        | 71281/371472 [5:40:30<23:02:21,  3.62it/s]
 19%|█▉        | 71282/371472 [5:40:30<23:02:25,  3.62it/s]
 19%|█▉        | 71283/371472 [5:40:30<22:47:38,  3.66it/s]
 19%|█▉        | 71284/371472 [5:40:30<23:23:11,  3.57it/s]
 19%|█▉        | 71285/371472 [5:40:31<23:59:55,  3.47it/s]
 19%|█▉        | 71286/371472 [5:40:31<23:38:18,  3.53it/s]
 19%|█▉        | 71287/371472 [5:40:31<24:04:43,  3.46it/s]
 19%|█▉        | 71288/371472 [5:40:32<24:18:40,  3.43it/s]
 19%|█▉        | 71289/371472 [5:40:32<24:45:10,  3.37it/s]
 19%|█▉        | 71290/371472 [5:40:32<25:39:44,  3.25it/s]
 19%|█▉        | 71291/371472 [5:40:33<24:55:06,  3.35it/s]
 19%|█▉        | 71292/371472 [5:40:33<24:42:18,  3.38it/s]
 19%|█▉        | 71293/371472 [5:40:33<24:38:34,  3.38it/s]
 19%|█▉        | 71294/371472 [5:40:33<24:10:46,  3.45it/s]
 19%|█▉        | 71295/371472 [5:40:34<24:12:10,  3.45it/s]
 19%|█▉        | 71296/371472 [5:40:34<24:22:29,  3.42it/s]
 19%|█▉        | 71297/371472 [5:40:34<23:28:56,  3.55it/s]
 19%|█▉        | 71298/371472 [5:40:35<23:20:40,  3.57it/s]
 19%|█▉        | 71299/371472 [5:40:35<23:11:00,  3.60it/s]
 19%|█▉        | 71300/371472 [5:40:35<25:20:39,  3.29it/s]
                                                           
{'loss': 4.2193, 'learning_rate': 8.276465771725311e-07, 'epoch': 3.07}

 19%|█▉        | 71300/371472 [5:40:35<25:20:39,  3.29it/s]
 19%|█▉        | 71301/371472 [5:40:35<24:53:15,  3.35it/s]
 19%|█▉        | 71302/371472 [5:40:36<24:22:58,  3.42it/s]
 19%|█▉        | 71303/371472 [5:40:36<25:40:53,  3.25it/s]
 19%|█▉        | 71304/371472 [5:40:36<25:38:35,  3.25it/s]
 19%|█▉        | 71305/371472 [5:40:37<24:43:33,  3.37it/s]
 19%|█▉        | 71306/371472 [5:40:37<24:21:12,  3.42it/s]
 19%|█▉        | 71307/371472 [5:40:37<24:27:12,  3.41it/s]
 19%|█▉        | 71308/371472 [5:40:38<23:49:53,  3.50it/s]
 19%|█▉        | 71309/371472 [5:40:38<23:59:59,  3.47it/s]
 19%|█▉        | 71310/371472 [5:40:38<23:41:15,  3.52it/s]
 19%|█▉        | 71311/371472 [5:40:38<24:06:56,  3.46it/s]
 19%|█▉        | 71312/371472 [5:40:39<24:51:53,  3.35it/s]
 19%|█▉        | 71313/371472 [5:40:39<23:54:34,  3.49it/s]
 19%|█▉        | 71314/371472 [5:40:39<22:54:46,  3.64it/s]
 19%|█▉        | 71315/371472 [5:40:40<23:44:58,  3.51it/s]
 19%|█▉        | 71316/371472 [5:40:40<23:18:39,  3.58it/s]
 19%|█▉        | 71317/371472 [5:40:40<22:20:59,  3.73it/s]
 19%|█▉        | 71318/371472 [5:40:40<23:48:05,  3.50it/s]
 19%|█▉        | 71319/371472 [5:40:41<24:20:03,  3.43it/s]
 19%|█▉        | 71320/371472 [5:40:41<23:06:21,  3.61it/s]
                                                           
{'loss': 3.9963, 'learning_rate': 8.275980951970523e-07, 'epoch': 3.07}

 19%|█▉        | 71320/371472 [5:40:41<23:06:21,  3.61it/s]
 19%|█▉        | 71321/371472 [5:40:41<23:25:24,  3.56it/s]
 19%|█▉        | 71322/371472 [5:40:41<23:22:50,  3.57it/s]
 19%|█▉        | 71323/371472 [5:40:42<23:02:18,  3.62it/s]
 19%|█▉        | 71324/371472 [5:40:42<28:20:48,  2.94it/s]
 19%|█▉        | 71325/371472 [5:40:42<26:21:35,  3.16it/s]
 19%|█▉        | 71326/371472 [5:40:43<26:19:48,  3.17it/s]
 19%|█▉        | 71327/371472 [5:40:43<24:29:54,  3.40it/s]
 19%|█▉        | 71328/371472 [5:40:43<23:27:15,  3.55it/s]
 19%|█▉        | 71329/371472 [5:40:44<22:38:36,  3.68it/s]
 19%|█▉        | 71330/371472 [5:40:44<22:58:27,  3.63it/s]
 19%|█▉        | 71331/371472 [5:40:44<22:19:32,  3.73it/s]
 19%|█▉        | 71332/371472 [5:40:44<23:43:14,  3.51it/s]
 19%|█▉        | 71333/371472 [5:40:45<22:45:26,  3.66it/s]
 19%|█▉        | 71334/371472 [5:40:45<22:59:05,  3.63it/s]
 19%|█▉        | 71335/371472 [5:40:45<22:25:03,  3.72it/s]
 19%|█▉        | 71336/371472 [5:40:45<21:39:11,  3.85it/s]
 19%|█▉        | 71337/371472 [5:40:46<22:09:31,  3.76it/s]
 19%|█▉        | 71338/371472 [5:40:46<22:16:51,  3.74it/s]
 19%|█▉        | 71339/371472 [5:40:46<21:45:05,  3.83it/s]
 19%|█▉        | 71340/371472 [5:40:47<23:30:37,  3.55it/s]
                                                           
{'loss': 4.2502, 'learning_rate': 8.275496132215734e-07, 'epoch': 3.07}

 19%|█▉        | 71340/371472 [5:40:47<23:30:37,  3.55it/s]
 19%|█▉        | 71341/371472 [5:40:47<24:57:14,  3.34it/s]
 19%|█▉        | 71342/371472 [5:40:47<24:08:16,  3.45it/s]
 19%|█▉        | 71343/371472 [5:40:47<23:51:32,  3.49it/s]
 19%|█▉        | 71344/371472 [5:40:48<23:05:17,  3.61it/s]
 19%|█▉        | 71345/371472 [5:40:48<21:57:18,  3.80it/s]
 19%|█▉        | 71346/371472 [5:40:48<21:49:22,  3.82it/s]
 19%|█▉        | 71347/371472 [5:40:48<22:22:49,  3.73it/s]
 19%|█▉        | 71348/371472 [5:40:49<22:23:53,  3.72it/s]
 19%|█▉        | 71349/371472 [5:40:49<22:26:22,  3.72it/s]
 19%|█▉        | 71350/371472 [5:40:49<23:17:58,  3.58it/s]
 19%|█▉        | 71351/371472 [5:40:50<23:00:38,  3.62it/s]
 19%|█▉        | 71352/371472 [5:40:50<22:36:32,  3.69it/s]
 19%|█▉        | 71353/371472 [5:40:50<22:28:56,  3.71it/s]
 19%|█▉        | 71354/371472 [5:40:50<22:09:15,  3.76it/s]
 19%|█▉        | 71355/371472 [5:40:51<22:08:10,  3.77it/s]
 19%|█▉        | 71356/371472 [5:40:51<22:08:08,  3.77it/s]
 19%|█▉        | 71357/371472 [5:40:51<22:27:31,  3.71it/s]
 19%|█▉        | 71358/371472 [5:40:51<22:27:26,  3.71it/s]
 19%|█▉        | 71359/371472 [5:40:52<22:33:14,  3.70it/s]
 19%|█▉        | 71360/371472 [5:40:52<22:29:13,  3.71it/s]
                                                           
{'loss': 4.0821, 'learning_rate': 8.275011312460945e-07, 'epoch': 3.07}

 19%|█▉        | 71360/371472 [5:40:52<22:29:13,  3.71it/s]
 19%|█▉        | 71361/371472 [5:40:52<23:01:56,  3.62it/s]
 19%|█▉        | 71362/371472 [5:40:53<23:40:13,  3.52it/s]
 19%|█▉        | 71363/371472 [5:40:53<24:12:14,  3.44it/s]
 19%|█▉        | 71364/371472 [5:40:53<24:46:21,  3.37it/s]
 19%|█▉        | 71365/371472 [5:40:53<23:11:55,  3.59it/s]
 19%|█▉        | 71366/371472 [5:40:54<24:05:18,  3.46it/s]
 19%|█▉        | 71367/371472 [5:40:54<23:03:14,  3.62it/s]
 19%|█▉        | 71368/371472 [5:40:54<23:41:15,  3.52it/s]
 19%|█▉        | 71369/371472 [5:40:55<22:41:51,  3.67it/s]
 19%|█▉        | 71370/371472 [5:40:55<22:45:31,  3.66it/s]
 19%|█▉        | 71371/371472 [5:40:55<24:04:39,  3.46it/s]
 19%|█▉        | 71372/371472 [5:40:55<24:40:37,  3.38it/s]
 19%|█▉        | 71373/371472 [5:40:56<25:24:56,  3.28it/s]
 19%|█▉        | 71374/371472 [5:40:56<25:16:34,  3.30it/s]
 19%|█▉        | 71375/371472 [5:40:56<26:40:17,  3.13it/s]
 19%|█▉        | 71376/371472 [5:40:57<30:04:57,  2.77it/s]
 19%|█▉        | 71377/371472 [5:40:57<27:19:37,  3.05it/s]
 19%|█▉        | 71378/371472 [5:40:57<25:15:29,  3.30it/s]
 19%|█▉        | 71379/371472 [5:40:58<23:33:04,  3.54it/s]
 19%|█▉        | 71380/371472 [5:40:58<24:22:30,  3.42it/s]
                                                           
{'loss': 4.2623, 'learning_rate': 8.274526492706156e-07, 'epoch': 3.07}

 19%|█▉        | 71380/371472 [5:40:58<24:22:30,  3.42it/s]
 19%|█▉        | 71381/371472 [5:40:58<23:32:59,  3.54it/s]
 19%|█▉        | 71382/371472 [5:40:58<23:11:24,  3.59it/s]
 19%|█▉        | 71383/371472 [5:40:59<22:56:56,  3.63it/s]
 19%|█▉        | 71384/371472 [5:40:59<23:09:39,  3.60it/s]
 19%|█▉        | 71385/371472 [5:40:59<27:59:21,  2.98it/s]
 19%|█▉        | 71386/371472 [5:41:00<26:24:40,  3.16it/s]
 19%|█▉        | 71387/371472 [5:41:00<25:43:08,  3.24it/s]
 19%|█▉        | 71388/371472 [5:41:00<24:08:11,  3.45it/s]
 19%|█▉        | 71389/371472 [5:41:01<24:17:57,  3.43it/s]
 19%|█▉        | 71390/371472 [5:41:01<23:52:24,  3.49it/s]
 19%|█▉        | 71391/371472 [5:41:01<22:54:11,  3.64it/s]
 19%|█▉        | 71392/371472 [5:41:01<22:05:29,  3.77it/s]
 19%|█▉        | 71393/371472 [5:41:02<22:07:09,  3.77it/s]
 19%|█▉        | 71394/371472 [5:41:02<22:13:44,  3.75it/s]
 19%|█▉        | 71395/371472 [5:41:02<22:31:30,  3.70it/s]
 19%|█▉        | 71396/371472 [5:41:02<22:12:44,  3.75it/s]
 19%|█▉        | 71397/371472 [5:41:03<23:12:30,  3.59it/s]
 19%|█▉        | 71398/371472 [5:41:03<23:38:16,  3.53it/s]
 19%|█▉        | 71399/371472 [5:41:03<22:52:35,  3.64it/s]
 19%|█▉        | 71400/371472 [5:41:04<23:09:18,  3.60it/s]
                                                           
{'loss': 4.1051, 'learning_rate': 8.274041672951367e-07, 'epoch': 3.08}

 19%|█▉        | 71400/371472 [5:41:04<23:09:18,  3.60it/s]
 19%|█▉        | 71401/371472 [5:41:04<23:02:39,  3.62it/s]
 19%|█▉        | 71402/371472 [5:41:04<23:12:58,  3.59it/s]
 19%|█▉        | 71403/371472 [5:41:04<22:10:16,  3.76it/s]
 19%|█▉        | 71404/371472 [5:41:05<23:13:07,  3.59it/s]
 19%|█▉        | 71405/371472 [5:41:05<24:10:46,  3.45it/s]
 19%|█▉        | 71406/371472 [5:41:05<23:39:35,  3.52it/s]
 19%|█▉        | 71407/371472 [5:41:06<23:17:20,  3.58it/s]
 19%|█▉        | 71408/371472 [5:41:06<22:29:46,  3.71it/s]
 19%|█▉        | 71409/371472 [5:41:06<22:34:37,  3.69it/s]
 19%|█▉        | 71410/371472 [5:41:06<22:00:34,  3.79it/s]
 19%|█▉        | 71411/371472 [5:41:07<21:56:32,  3.80it/s]
 19%|█▉        | 71412/371472 [5:41:07<21:31:53,  3.87it/s]
 19%|█▉        | 71413/371472 [5:41:07<21:46:20,  3.83it/s]
 19%|█▉        | 71414/371472 [5:41:07<22:20:16,  3.73it/s]
 19%|█▉        | 71415/371472 [5:41:08<23:34:50,  3.53it/s]
 19%|█▉        | 71416/371472 [5:41:08<24:00:52,  3.47it/s]
 19%|█▉        | 71417/371472 [5:41:08<25:32:18,  3.26it/s]
 19%|█▉        | 71418/371472 [5:41:09<26:13:22,  3.18it/s]
 19%|█▉        | 71419/371472 [5:41:09<24:46:46,  3.36it/s]
 19%|█▉        | 71420/371472 [5:41:09<24:16:37,  3.43it/s]
                                                           
{'loss': 4.1241, 'learning_rate': 8.273556853196578e-07, 'epoch': 3.08}

 19%|█▉        | 71420/371472 [5:41:09<24:16:37,  3.43it/s]
 19%|█▉        | 71421/371472 [5:41:10<26:02:24,  3.20it/s]
 19%|█▉        | 71422/371472 [5:41:10<24:41:37,  3.38it/s]
 19%|█▉        | 71423/371472 [5:41:10<24:22:53,  3.42it/s]
 19%|█▉        | 71424/371472 [5:41:10<23:26:25,  3.56it/s]
 19%|█▉        | 71425/371472 [5:41:11<22:36:33,  3.69it/s]
 19%|█▉        | 71426/371472 [5:41:11<21:44:22,  3.83it/s]
 19%|█▉        | 71427/371472 [5:41:11<22:18:10,  3.74it/s]
 19%|█▉        | 71428/371472 [5:41:11<23:02:01,  3.62it/s]
 19%|█▉        | 71429/371472 [5:41:12<22:35:46,  3.69it/s]
 19%|█▉        | 71430/371472 [5:41:12<22:53:41,  3.64it/s]
 19%|█▉        | 71431/371472 [5:41:12<22:31:59,  3.70it/s]
 19%|█▉        | 71432/371472 [5:41:12<22:22:57,  3.72it/s]
 19%|█▉        | 71433/371472 [5:41:13<21:50:39,  3.82it/s]
 19%|█▉        | 71434/371472 [5:41:13<23:08:29,  3.60it/s]
 19%|█▉        | 71435/371472 [5:41:13<23:03:19,  3.61it/s]
 19%|█▉        | 71436/371472 [5:41:14<23:24:10,  3.56it/s]
 19%|█▉        | 71437/371472 [5:41:14<23:33:09,  3.54it/s]
 19%|█▉        | 71438/371472 [5:41:14<23:43:05,  3.51it/s]
 19%|█▉        | 71439/371472 [5:41:14<23:21:18,  3.57it/s]
 19%|█▉        | 71440/371472 [5:41:15<23:37:04,  3.53it/s]
                                                           
{'loss': 4.2241, 'learning_rate': 8.273072033441789e-07, 'epoch': 3.08}

 19%|█▉        | 71440/371472 [5:41:15<23:37:04,  3.53it/s]
 19%|█▉        | 71441/371472 [5:41:15<23:25:37,  3.56it/s]
 19%|█▉        | 71442/371472 [5:41:15<24:13:05,  3.44it/s]
 19%|█▉        | 71443/371472 [5:41:16<24:55:38,  3.34it/s]
 19%|█▉        | 71444/371472 [5:41:16<24:46:34,  3.36it/s]
 19%|█▉        | 71445/371472 [5:41:16<24:32:33,  3.40it/s]
 19%|█▉        | 71446/371472 [5:41:16<23:22:14,  3.57it/s]
 19%|█▉        | 71447/371472 [5:41:17<22:49:26,  3.65it/s]
 19%|█▉        | 71448/371472 [5:41:17<22:27:27,  3.71it/s]
 19%|█▉        | 71449/371472 [5:41:17<24:16:49,  3.43it/s]
 19%|█▉        | 71450/371472 [5:41:18<23:45:47,  3.51it/s]
 19%|█▉        | 71451/371472 [5:41:18<25:02:46,  3.33it/s]
 19%|█▉        | 71452/371472 [5:41:18<27:42:48,  3.01it/s]
 19%|█▉        | 71453/371472 [5:41:19<26:12:36,  3.18it/s]
 19%|█▉        | 71454/371472 [5:41:19<25:47:33,  3.23it/s]
 19%|█▉        | 71455/371472 [5:41:19<25:25:45,  3.28it/s]
 19%|█▉        | 71456/371472 [5:41:19<24:04:57,  3.46it/s]
 19%|█▉        | 71457/371472 [5:41:20<25:37:48,  3.25it/s]
 19%|█▉        | 71458/371472 [5:41:20<26:00:26,  3.20it/s]
 19%|█▉        | 71459/371472 [5:41:20<24:49:38,  3.36it/s]
 19%|█▉        | 71460/371472 [5:41:21<23:51:29,  3.49it/s]
                                                           
{'loss': 4.1199, 'learning_rate': 8.272587213687e-07, 'epoch': 3.08}

 19%|█▉        | 71460/371472 [5:41:21<23:51:29,  3.49it/s]
 19%|█▉        | 71461/371472 [5:41:21<23:12:03,  3.59it/s]
 19%|█▉        | 71462/371472 [5:41:21<25:18:09,  3.29it/s]
 19%|█▉        | 71463/371472 [5:41:22<24:26:24,  3.41it/s]
 19%|█▉        | 71464/371472 [5:41:22<22:55:57,  3.63it/s]
 19%|█▉        | 71465/371472 [5:41:22<22:10:33,  3.76it/s]
 19%|█▉        | 71466/371472 [5:41:22<21:23:37,  3.90it/s]
 19%|█▉        | 71467/371472 [5:41:23<21:52:18,  3.81it/s]
 19%|█▉        | 71468/371472 [5:41:23<22:51:57,  3.64it/s]
 19%|█▉        | 71469/371472 [5:41:23<22:09:39,  3.76it/s]
 19%|█▉        | 71470/371472 [5:41:23<22:31:49,  3.70it/s]
 19%|█▉        | 71471/371472 [5:41:24<22:02:45,  3.78it/s]
 19%|█▉        | 71472/371472 [5:41:24<22:20:45,  3.73it/s]
 19%|█▉        | 71473/371472 [5:41:24<22:34:59,  3.69it/s]
 19%|█▉        | 71474/371472 [5:41:24<24:10:50,  3.45it/s]
 19%|█▉        | 71475/371472 [5:41:25<23:18:29,  3.58it/s]
 19%|█▉        | 71476/371472 [5:41:25<22:12:02,  3.75it/s]
 19%|█▉        | 71477/371472 [5:41:25<25:24:08,  3.28it/s]
 19%|█▉        | 71478/371472 [5:41:26<25:09:32,  3.31it/s]
 19%|█▉        | 71479/371472 [5:41:26<24:31:50,  3.40it/s]
 19%|█▉        | 71480/371472 [5:41:26<23:15:00,  3.58it/s]
                                                           
{'loss': 4.0423, 'learning_rate': 8.272102393932211e-07, 'epoch': 3.08}

 19%|█▉        | 71480/371472 [5:41:26<23:15:00,  3.58it/s]
 19%|█▉        | 71481/371472 [5:41:26<23:28:23,  3.55it/s]
 19%|█▉        | 71482/371472 [5:41:27<22:48:57,  3.65it/s]
 19%|█▉        | 71483/371472 [5:41:27<23:26:54,  3.55it/s]
 19%|█▉        | 71484/371472 [5:41:27<23:30:15,  3.55it/s]
 19%|█▉        | 71485/371472 [5:41:28<24:20:47,  3.42it/s]
 19%|█▉        | 71486/371472 [5:41:28<23:27:40,  3.55it/s]
 19%|█▉        | 71487/371472 [5:41:28<22:56:42,  3.63it/s]
 19%|█▉        | 71488/371472 [5:41:28<22:32:20,  3.70it/s]
 19%|█▉        | 71489/371472 [5:41:29<22:02:30,  3.78it/s]
 19%|█▉        | 71490/371472 [5:41:29<21:33:44,  3.86it/s]
 19%|█▉        | 71491/371472 [5:41:29<21:55:39,  3.80it/s]
 19%|█▉        | 71492/371472 [5:41:30<24:05:55,  3.46it/s]
 19%|█▉        | 71493/371472 [5:41:30<23:52:30,  3.49it/s]
 19%|█▉        | 71494/371472 [5:41:30<23:49:22,  3.50it/s]
 19%|█▉        | 71495/371472 [5:41:30<22:55:04,  3.64it/s]
 19%|█▉        | 71496/371472 [5:41:31<22:56:52,  3.63it/s]
 19%|█▉        | 71497/371472 [5:41:31<23:18:23,  3.58it/s]
 19%|█▉        | 71498/371472 [5:41:31<22:17:38,  3.74it/s]
 19%|█▉        | 71499/371472 [5:41:31<21:40:49,  3.84it/s]
 19%|█▉        | 71500/371472 [5:41:32<21:35:18,  3.86it/s]
                                                           
{'loss': 4.0132, 'learning_rate': 8.271617574177422e-07, 'epoch': 3.08}

 19%|█▉        | 71500/371472 [5:41:32<21:35:18,  3.86it/s]
 19%|█▉        | 71501/371472 [5:41:32<21:22:11,  3.90it/s]
 19%|█▉        | 71502/371472 [5:41:32<21:03:44,  3.96it/s]
 19%|█▉        | 71503/371472 [5:41:33<26:33:09,  3.14it/s]
 19%|█▉        | 71504/371472 [5:41:33<24:48:09,  3.36it/s]
 19%|█▉        | 71505/371472 [5:41:33<24:33:19,  3.39it/s]
 19%|█▉        | 71506/371472 [5:41:33<25:09:18,  3.31it/s]
 19%|█▉        | 71507/371472 [5:41:34<23:22:05,  3.57it/s]
 19%|█▉        | 71508/371472 [5:41:34<23:20:37,  3.57it/s]
 19%|█▉        | 71509/371472 [5:41:34<22:35:04,  3.69it/s]
 19%|█▉        | 71510/371472 [5:41:35<23:43:36,  3.51it/s]
 19%|█▉        | 71511/371472 [5:41:35<22:58:04,  3.63it/s]
 19%|█▉        | 71512/371472 [5:41:35<22:16:01,  3.74it/s]
 19%|█▉        | 71513/371472 [5:41:35<21:32:25,  3.87it/s]
 19%|█▉        | 71514/371472 [5:41:36<23:39:22,  3.52it/s]
 19%|█▉        | 71515/371472 [5:41:36<23:46:55,  3.50it/s]
 19%|█▉        | 71516/371472 [5:41:36<23:38:40,  3.52it/s]
 19%|█▉        | 71517/371472 [5:41:37<24:17:19,  3.43it/s]
 19%|█▉        | 71518/371472 [5:41:37<23:55:28,  3.48it/s]
 19%|█▉        | 71519/371472 [5:41:37<23:46:40,  3.50it/s]
 19%|█▉        | 71520/371472 [5:41:37<22:54:25,  3.64it/s]
                                                           
{'loss': 4.1384, 'learning_rate': 8.271132754422633e-07, 'epoch': 3.08}

 19%|█▉        | 71520/371472 [5:41:37<22:54:25,  3.64it/s]
 19%|█▉        | 71521/371472 [5:41:38<24:57:20,  3.34it/s]
 19%|█▉        | 71522/371472 [5:41:38<23:45:31,  3.51it/s]
 19%|█▉        | 71523/371472 [5:41:38<23:37:03,  3.53it/s]
 19%|█▉        | 71524/371472 [5:41:38<23:16:27,  3.58it/s]
 19%|█▉        | 71525/371472 [5:41:39<23:19:47,  3.57it/s]
 19%|█▉        | 71526/371472 [5:41:39<23:32:52,  3.54it/s]
 19%|█▉        | 71527/371472 [5:41:39<24:29:20,  3.40it/s]
 19%|█▉        | 71528/371472 [5:41:40<23:38:18,  3.52it/s]
 19%|█▉        | 71529/371472 [5:41:40<22:53:46,  3.64it/s]
 19%|█▉        | 71530/371472 [5:41:40<22:26:13,  3.71it/s]
 19%|█▉        | 71531/371472 [5:41:41<28:04:15,  2.97it/s]
 19%|█▉        | 71532/371472 [5:41:41<27:02:26,  3.08it/s]
 19%|█▉        | 71533/371472 [5:41:41<25:27:44,  3.27it/s]
 19%|█▉        | 71534/371472 [5:41:41<25:04:50,  3.32it/s]
 19%|█▉        | 71535/371472 [5:41:42<25:39:31,  3.25it/s]
 19%|█▉        | 71536/371472 [5:41:42<25:49:23,  3.23it/s]
 19%|█▉        | 71537/371472 [5:41:42<26:55:15,  3.09it/s]
 19%|█▉        | 71538/371472 [5:41:43<28:20:55,  2.94it/s]
 19%|█▉        | 71539/371472 [5:41:43<26:16:05,  3.17it/s]
 19%|█▉        | 71540/371472 [5:41:43<25:20:05,  3.29it/s]
                                                           
{'loss': 4.0186, 'learning_rate': 8.270647934667844e-07, 'epoch': 3.08}

 19%|█▉        | 71540/371472 [5:41:43<25:20:05,  3.29it/s]
 19%|█▉        | 71541/371472 [5:41:44<24:53:47,  3.35it/s]
 19%|█▉        | 71542/371472 [5:41:44<25:09:12,  3.31it/s]
 19%|█▉        | 71543/371472 [5:41:44<24:56:25,  3.34it/s]
 19%|█▉        | 71544/371472 [5:41:45<24:44:20,  3.37it/s]
 19%|█▉        | 71545/371472 [5:41:45<24:25:47,  3.41it/s]
 19%|█▉        | 71546/371472 [5:41:45<23:41:28,  3.52it/s]
 19%|█▉        | 71547/371472 [5:41:45<24:00:18,  3.47it/s]
 19%|█▉        | 71548/371472 [5:41:46<23:44:23,  3.51it/s]
 19%|█▉        | 71549/371472 [5:41:46<23:44:09,  3.51it/s]
 19%|█▉        | 71550/371472 [5:41:46<25:29:48,  3.27it/s]
 19%|█▉        | 71551/371472 [5:41:47<25:09:27,  3.31it/s]
 19%|█▉        | 71552/371472 [5:41:47<25:29:32,  3.27it/s]
 19%|█▉        | 71553/371472 [5:41:47<24:27:42,  3.41it/s]
 19%|█▉        | 71554/371472 [5:41:47<23:56:43,  3.48it/s]
 19%|█▉        | 71555/371472 [5:41:48<23:58:54,  3.47it/s]
 19%|█▉        | 71556/371472 [5:41:48<26:03:48,  3.20it/s]
 19%|█▉        | 71557/371472 [5:41:48<25:12:21,  3.31it/s]
 19%|█▉        | 71558/371472 [5:41:49<25:31:32,  3.26it/s]
 19%|█▉        | 71559/371472 [5:41:49<24:09:44,  3.45it/s]
 19%|█▉        | 71560/371472 [5:41:49<23:08:53,  3.60it/s]
                                                           
{'loss': 4.2077, 'learning_rate': 8.270163114913055e-07, 'epoch': 3.08}

 19%|█▉        | 71560/371472 [5:41:49<23:08:53,  3.60it/s]
 19%|█▉        | 71561/371472 [5:41:50<23:20:20,  3.57it/s]
 19%|█▉        | 71562/371472 [5:41:50<22:36:13,  3.69it/s]
 19%|█▉        | 71563/371472 [5:41:50<22:10:00,  3.76it/s]
 19%|█▉        | 71564/371472 [5:41:50<22:40:30,  3.67it/s]
 19%|█▉        | 71565/371472 [5:41:51<23:09:46,  3.60it/s]
 19%|█▉        | 71566/371472 [5:41:51<22:21:38,  3.73it/s]
 19%|█▉        | 71567/371472 [5:41:51<23:46:28,  3.50it/s]
 19%|█▉        | 71568/371472 [5:41:51<23:31:35,  3.54it/s]
 19%|█▉        | 71569/371472 [5:41:52<22:43:37,  3.67it/s]
 19%|█▉        | 71570/371472 [5:41:52<22:46:42,  3.66it/s]
 19%|█▉        | 71571/371472 [5:41:52<23:14:01,  3.59it/s]
 19%|█▉        | 71572/371472 [5:41:53<23:42:51,  3.51it/s]
 19%|█▉        | 71573/371472 [5:41:53<22:51:04,  3.65it/s]
 19%|█▉        | 71574/371472 [5:41:53<22:55:33,  3.63it/s]
 19%|█▉        | 71575/371472 [5:41:53<22:40:45,  3.67it/s]
 19%|█▉        | 71576/371472 [5:41:54<22:45:22,  3.66it/s]
 19%|█▉        | 71577/371472 [5:41:54<23:31:42,  3.54it/s]
 19%|█▉        | 71578/371472 [5:41:54<23:15:59,  3.58it/s]
 19%|█▉        | 71579/371472 [5:41:55<23:49:07,  3.50it/s]
 19%|█▉        | 71580/371472 [5:41:55<23:32:36,  3.54it/s]
                                                           
{'loss': 4.304, 'learning_rate': 8.269678295158266e-07, 'epoch': 3.08}

 19%|█▉        | 71580/371472 [5:41:55<23:32:36,  3.54it/s]
 19%|█▉        | 71581/371472 [5:41:55<25:38:46,  3.25it/s]
 19%|█▉        | 71582/371472 [5:41:55<24:34:32,  3.39it/s]
 19%|█▉        | 71583/371472 [5:41:56<23:42:48,  3.51it/s]
 19%|█▉        | 71584/371472 [5:41:56<22:59:31,  3.62it/s]
 19%|█▉        | 71585/371472 [5:41:56<23:03:40,  3.61it/s]
 19%|█▉        | 71586/371472 [5:41:57<23:17:42,  3.58it/s]
 19%|█▉        | 71587/371472 [5:41:57<22:42:49,  3.67it/s]
 19%|█▉        | 71588/371472 [5:41:57<22:10:35,  3.76it/s]
 19%|█▉        | 71589/371472 [5:41:57<22:03:45,  3.78it/s]
 19%|█▉        | 71590/371472 [5:41:58<22:30:07,  3.70it/s]
 19%|█▉        | 71591/371472 [5:41:58<22:21:24,  3.73it/s]
 19%|█▉        | 71592/371472 [5:41:58<22:57:16,  3.63it/s]
 19%|█▉        | 71593/371472 [5:41:58<24:05:07,  3.46it/s]
 19%|█▉        | 71594/371472 [5:41:59<23:29:20,  3.55it/s]
 19%|█▉        | 71595/371472 [5:41:59<26:10:49,  3.18it/s]
 19%|█▉        | 71596/371472 [5:41:59<24:18:18,  3.43it/s]
 19%|█▉        | 71597/371472 [5:42:00<23:40:13,  3.52it/s]
 19%|█▉        | 71598/371472 [5:42:00<24:22:21,  3.42it/s]
 19%|█▉        | 71599/371472 [5:42:00<27:00:22,  3.08it/s]
 19%|█▉        | 71600/371472 [5:42:01<24:59:46,  3.33it/s]
                                                           
{'loss': 4.227, 'learning_rate': 8.269193475403478e-07, 'epoch': 3.08}

 19%|█▉        | 71600/371472 [5:42:01<24:59:46,  3.33it/s]
 19%|█▉        | 71601/371472 [5:42:01<23:36:26,  3.53it/s]
 19%|█▉        | 71602/371472 [5:42:01<22:39:52,  3.68it/s]
 19%|█▉        | 71603/371472 [5:42:01<26:20:32,  3.16it/s]
 19%|█▉        | 71604/371472 [5:42:02<24:07:47,  3.45it/s]
 19%|█▉        | 71605/371472 [5:42:02<23:29:35,  3.55it/s]
 19%|█▉        | 71606/371472 [5:42:02<22:20:35,  3.73it/s]
 19%|█▉        | 71607/371472 [5:42:02<21:43:45,  3.83it/s]
 19%|█▉        | 71608/371472 [5:42:03<22:06:51,  3.77it/s]
 19%|█▉        | 71609/371472 [5:42:03<21:40:34,  3.84it/s]
 19%|█▉        | 71610/371472 [5:42:03<22:40:24,  3.67it/s]
 19%|█▉        | 71611/371472 [5:42:04<22:24:14,  3.72it/s]
 19%|█▉        | 71612/371472 [5:42:04<21:56:24,  3.80it/s]
 19%|█▉        | 71613/371472 [5:42:04<22:15:32,  3.74it/s]
 19%|█▉        | 71614/371472 [5:42:04<21:49:52,  3.82it/s]
 19%|█▉        | 71615/371472 [5:42:05<23:32:20,  3.54it/s]
 19%|█▉        | 71616/371472 [5:42:05<22:49:11,  3.65it/s]
 19%|█▉        | 71617/371472 [5:42:05<22:41:53,  3.67it/s]
 19%|█▉        | 71618/371472 [5:42:05<21:59:52,  3.79it/s]
 19%|█▉        | 71619/371472 [5:42:06<23:09:34,  3.60it/s]
 19%|█▉        | 71620/371472 [5:42:06<23:41:52,  3.51it/s]
                                                           
{'loss': 4.2034, 'learning_rate': 8.268708655648689e-07, 'epoch': 3.08}

 19%|█▉        | 71620/371472 [5:42:06<23:41:52,  3.51it/s]
 19%|█▉        | 71621/371472 [5:42:06<23:01:05,  3.62it/s]
 19%|█▉        | 71622/371472 [5:42:07<23:18:17,  3.57it/s]
 19%|█▉        | 71623/371472 [5:42:07<23:39:52,  3.52it/s]
 19%|█▉        | 71624/371472 [5:42:07<23:08:18,  3.60it/s]
 19%|█▉        | 71625/371472 [5:42:07<23:22:24,  3.56it/s]
 19%|█▉        | 71626/371472 [5:42:08<25:22:34,  3.28it/s]
 19%|█▉        | 71627/371472 [5:42:08<25:34:08,  3.26it/s]
 19%|█▉        | 71628/371472 [5:42:08<24:50:49,  3.35it/s]
 19%|█▉        | 71629/371472 [5:42:09<23:44:30,  3.51it/s]
 19%|█▉        | 71630/371472 [5:42:09<23:20:33,  3.57it/s]
 19%|█▉        | 71631/371472 [5:42:09<22:56:36,  3.63it/s]
 19%|█▉        | 71632/371472 [5:42:09<25:23:49,  3.28it/s]
 19%|█▉        | 71633/371472 [5:42:10<25:58:43,  3.21it/s]
 19%|█▉        | 71634/371472 [5:42:10<26:48:41,  3.11it/s]
 19%|█▉        | 71635/371472 [5:42:11<27:07:15,  3.07it/s]
 19%|█▉        | 71636/371472 [5:42:11<24:54:00,  3.34it/s]
 19%|█▉        | 71637/371472 [5:42:11<24:14:14,  3.44it/s]
 19%|█▉        | 71638/371472 [5:42:11<23:50:59,  3.49it/s]
 19%|█▉        | 71639/371472 [5:42:12<24:15:12,  3.43it/s]
 19%|█▉        | 71640/371472 [5:42:12<24:24:57,  3.41it/s]
                                                           
{'loss': 4.1402, 'learning_rate': 8.268223835893899e-07, 'epoch': 3.09}

 19%|█▉        | 71640/371472 [5:42:12<24:24:57,  3.41it/s]
 19%|█▉        | 71641/371472 [5:42:12<25:10:09,  3.31it/s]
 19%|█▉        | 71642/371472 [5:42:12<24:16:32,  3.43it/s]
 19%|█▉        | 71643/371472 [5:42:13<23:25:56,  3.55it/s]
 19%|█▉        | 71644/371472 [5:42:13<24:54:03,  3.34it/s]
 19%|█▉        | 71645/371472 [5:42:13<25:41:38,  3.24it/s]
 19%|█▉        | 71646/371472 [5:42:14<25:23:54,  3.28it/s]
 19%|█▉        | 71647/371472 [5:42:14<23:42:13,  3.51it/s]
 19%|█▉        | 71648/371472 [5:42:14<24:05:48,  3.46it/s]
 19%|█▉        | 71649/371472 [5:42:15<24:31:49,  3.40it/s]
 19%|█▉        | 71650/371472 [5:42:15<24:06:05,  3.46it/s]
 19%|█▉        | 71651/371472 [5:42:15<23:24:20,  3.56it/s]
 19%|█▉        | 71652/371472 [5:42:15<22:32:06,  3.70it/s]
 19%|█▉        | 71653/371472 [5:42:16<21:47:13,  3.82it/s]
 19%|█▉        | 71654/371472 [5:42:16<21:56:44,  3.79it/s]
 19%|█▉        | 71655/371472 [5:42:16<21:50:41,  3.81it/s]
 19%|█▉        | 71656/371472 [5:42:16<21:47:19,  3.82it/s]
 19%|█▉        | 71657/371472 [5:42:17<21:46:53,  3.82it/s]
 19%|█▉        | 71658/371472 [5:42:17<23:28:04,  3.55it/s]
 19%|█▉        | 71659/371472 [5:42:17<22:43:53,  3.66it/s]
 19%|█▉        | 71660/371472 [5:42:17<22:42:07,  3.67it/s]
                                                           
{'loss': 4.2338, 'learning_rate': 8.26773901613911e-07, 'epoch': 3.09}

 19%|█▉        | 71660/371472 [5:42:17<22:42:07,  3.67it/s]
 19%|█▉        | 71661/371472 [5:42:18<22:27:56,  3.71it/s]
 19%|█▉        | 71662/371472 [5:42:18<21:40:53,  3.84it/s]
 19%|█▉        | 71663/371472 [5:42:18<22:27:14,  3.71it/s]
 19%|█▉        | 71664/371472 [5:42:19<23:51:30,  3.49it/s]
 19%|█▉        | 71665/371472 [5:42:19<23:40:47,  3.52it/s]
 19%|█▉        | 71666/371472 [5:42:19<23:31:52,  3.54it/s]
 19%|█▉        | 71667/371472 [5:42:19<22:21:33,  3.72it/s]
 19%|█▉        | 71668/371472 [5:42:20<23:06:32,  3.60it/s]
 19%|█▉        | 71669/371472 [5:42:20<22:08:55,  3.76it/s]
 19%|█▉        | 71670/371472 [5:42:20<22:34:58,  3.69it/s]
 19%|█▉        | 71671/371472 [5:42:21<24:58:21,  3.33it/s]
 19%|█▉        | 71672/371472 [5:42:21<23:41:06,  3.52it/s]
 19%|█▉        | 71673/371472 [5:42:21<25:51:31,  3.22it/s]
 19%|█▉        | 71674/371472 [5:42:21<24:11:04,  3.44it/s]
 19%|█▉        | 71675/371472 [5:42:22<24:44:42,  3.37it/s]
 19%|█▉        | 71676/371472 [5:42:22<24:27:13,  3.41it/s]
 19%|█▉        | 71677/371472 [5:42:22<24:39:46,  3.38it/s]
 19%|█▉        | 71678/371472 [5:42:23<23:22:32,  3.56it/s]
 19%|█▉        | 71679/371472 [5:42:23<23:00:03,  3.62it/s]
 19%|█▉        | 71680/371472 [5:42:23<23:04:56,  3.61it/s]
                                                           
{'loss': 4.1142, 'learning_rate': 8.267254196384322e-07, 'epoch': 3.09}

 19%|█▉        | 71680/371472 [5:42:23<23:04:56,  3.61it/s]
 19%|█▉        | 71681/371472 [5:42:23<22:49:40,  3.65it/s]
 19%|█▉        | 71682/371472 [5:42:24<23:49:19,  3.50it/s]
 19%|█▉        | 71683/371472 [5:42:24<22:36:31,  3.68it/s]
 19%|█▉        | 71684/371472 [5:42:24<22:01:41,  3.78it/s]
 19%|█▉        | 71685/371472 [5:42:25<26:02:06,  3.20it/s]
 19%|█▉        | 71686/371472 [5:42:25<25:08:51,  3.31it/s]
 19%|█▉        | 71687/371472 [5:42:25<24:59:06,  3.33it/s]
 19%|█▉        | 71688/371472 [5:42:25<24:16:32,  3.43it/s]
 19%|█▉        | 71689/371472 [5:42:26<23:37:06,  3.53it/s]
 19%|█▉        | 71690/371472 [5:42:26<24:42:18,  3.37it/s]
 19%|█▉        | 71691/371472 [5:42:26<24:46:33,  3.36it/s]
 19%|█▉        | 71692/371472 [5:42:27<23:51:30,  3.49it/s]
 19%|█▉        | 71693/371472 [5:42:27<23:22:22,  3.56it/s]
 19%|█▉        | 71694/371472 [5:42:27<22:51:22,  3.64it/s]
 19%|█▉        | 71695/371472 [5:42:27<22:19:12,  3.73it/s]
 19%|█▉        | 71696/371472 [5:42:28<21:55:36,  3.80it/s]
 19%|█▉        | 71697/371472 [5:42:28<22:20:22,  3.73it/s]
 19%|█▉        | 71698/371472 [5:42:28<22:16:41,  3.74it/s]
 19%|█▉        | 71699/371472 [5:42:28<21:50:19,  3.81it/s]
 19%|█▉        | 71700/371472 [5:42:29<24:31:57,  3.39it/s]
                                                           
{'loss': 4.2268, 'learning_rate': 8.266769376629533e-07, 'epoch': 3.09}

 19%|█▉        | 71700/371472 [5:42:29<24:31:57,  3.39it/s]
 19%|█▉        | 71701/371472 [5:42:29<24:20:34,  3.42it/s]
 19%|█▉        | 71702/371472 [5:42:29<22:55:03,  3.63it/s]
 19%|█▉        | 71703/371472 [5:42:30<23:05:40,  3.61it/s]
 19%|█▉        | 71704/371472 [5:42:30<23:33:50,  3.53it/s]
 19%|█▉        | 71705/371472 [5:42:30<23:43:25,  3.51it/s]
 19%|█▉        | 71706/371472 [5:42:31<24:17:29,  3.43it/s]
 19%|█▉        | 71707/371472 [5:42:31<23:14:31,  3.58it/s]
 19%|█▉        | 71708/371472 [5:42:31<22:45:06,  3.66it/s]
 19%|█▉        | 71709/371472 [5:42:31<22:23:37,  3.72it/s]
 19%|█▉        | 71710/371472 [5:42:32<21:52:18,  3.81it/s]
 19%|█▉        | 71711/371472 [5:42:32<21:35:59,  3.85it/s]
 19%|█▉        | 71712/371472 [5:42:32<20:55:15,  3.98it/s]
 19%|█▉        | 71713/371472 [5:42:32<23:26:50,  3.55it/s]
 19%|█▉        | 71714/371472 [5:42:33<23:18:18,  3.57it/s]
 19%|█▉        | 71715/371472 [5:42:33<23:05:24,  3.61it/s]
 19%|█▉        | 71716/371472 [5:42:33<22:50:17,  3.65it/s]
 19%|█▉        | 71717/371472 [5:42:33<22:02:10,  3.78it/s]
 19%|█▉        | 71718/371472 [5:42:34<22:14:58,  3.74it/s]
 19%|█▉        | 71719/371472 [5:42:34<21:59:31,  3.79it/s]
 19%|█▉        | 71720/371472 [5:42:34<23:51:37,  3.49it/s]
                                                           
{'loss': 4.2228, 'learning_rate': 8.266284556874744e-07, 'epoch': 3.09}

 19%|█▉        | 71720/371472 [5:42:34<23:51:37,  3.49it/s]
 19%|█▉        | 71721/371472 [5:42:35<23:18:41,  3.57it/s]
 19%|█▉        | 71722/371472 [5:42:35<23:40:58,  3.52it/s]
 19%|█▉        | 71723/371472 [5:42:35<23:33:55,  3.53it/s]
 19%|█▉        | 71724/371472 [5:42:35<22:58:26,  3.62it/s]
 19%|█▉        | 71725/371472 [5:42:36<21:57:32,  3.79it/s]
 19%|█▉        | 71726/371472 [5:42:36<22:08:40,  3.76it/s]
 19%|█▉        | 71727/371472 [5:42:36<22:26:52,  3.71it/s]
 19%|█▉        | 71728/371472 [5:42:36<21:49:20,  3.82it/s]
 19%|█▉        | 71729/371472 [5:42:37<23:11:18,  3.59it/s]
 19%|█▉        | 71730/371472 [5:42:37<23:40:56,  3.52it/s]
 19%|█▉        | 71731/371472 [5:42:37<24:59:58,  3.33it/s]
 19%|█▉        | 71732/371472 [5:42:38<24:42:12,  3.37it/s]
 19%|█▉        | 71733/371472 [5:42:38<24:32:56,  3.39it/s]
 19%|█▉        | 71734/371472 [5:42:38<24:08:46,  3.45it/s]
 19%|█▉        | 71735/371472 [5:42:39<23:56:00,  3.48it/s]
 19%|█▉        | 71736/371472 [5:42:39<22:41:30,  3.67it/s]
 19%|█▉        | 71737/371472 [5:42:39<22:30:59,  3.70it/s]
 19%|█▉        | 71738/371472 [5:42:39<22:31:29,  3.70it/s]
 19%|█▉        | 71739/371472 [5:42:40<22:08:22,  3.76it/s]
 19%|█▉        | 71740/371472 [5:42:40<21:27:20,  3.88it/s]
                                                           
{'loss': 4.3599, 'learning_rate': 8.265799737119955e-07, 'epoch': 3.09}

 19%|█▉        | 71740/371472 [5:42:40<21:27:20,  3.88it/s]
 19%|█▉        | 71741/371472 [5:42:40<24:23:29,  3.41it/s]
 19%|█▉        | 71742/371472 [5:42:40<24:21:48,  3.42it/s]
 19%|█▉        | 71743/371472 [5:42:41<24:51:46,  3.35it/s]
 19%|█▉        | 71744/371472 [5:42:41<24:52:21,  3.35it/s]
 19%|█▉        | 71745/371472 [5:42:41<24:00:41,  3.47it/s]
 19%|█▉        | 71746/371472 [5:42:42<23:01:02,  3.62it/s]
 19%|█▉        | 71747/371472 [5:42:42<22:44:00,  3.66it/s]
 19%|█▉        | 71748/371472 [5:42:42<22:09:26,  3.76it/s]
 19%|█▉        | 71749/371472 [5:42:42<22:24:07,  3.72it/s]
 19%|█▉        | 71750/371472 [5:42:43<22:00:03,  3.78it/s]
 19%|█▉        | 71751/371472 [5:42:43<23:42:18,  3.51it/s]
 19%|█▉        | 71752/371472 [5:42:43<23:42:51,  3.51it/s]
 19%|█▉        | 71753/371472 [5:42:43<23:02:10,  3.61it/s]
 19%|█▉        | 71754/371472 [5:42:44<24:01:46,  3.46it/s]
 19%|█▉        | 71755/371472 [5:42:44<24:18:46,  3.42it/s]
 19%|█▉        | 71756/371472 [5:42:44<23:54:09,  3.48it/s]
 19%|█▉        | 71757/371472 [5:42:45<23:32:24,  3.54it/s]
 19%|█▉        | 71758/371472 [5:42:45<23:51:49,  3.49it/s]
 19%|█▉        | 71759/371472 [5:42:45<23:59:33,  3.47it/s]
 19%|█▉        | 71760/371472 [5:42:46<24:11:12,  3.44it/s]
                                                           
{'loss': 4.185, 'learning_rate': 8.265314917365166e-07, 'epoch': 3.09}

 19%|█▉        | 71760/371472 [5:42:46<24:11:12,  3.44it/s]
 19%|█▉        | 71761/371472 [5:42:46<24:08:30,  3.45it/s]
 19%|█▉        | 71762/371472 [5:42:46<24:52:53,  3.35it/s]
 19%|█▉        | 71763/371472 [5:42:46<24:13:41,  3.44it/s]
 19%|█▉        | 71764/371472 [5:42:47<24:14:06,  3.44it/s]
 19%|█▉        | 71765/371472 [5:42:47<24:53:51,  3.34it/s]
 19%|█▉        | 71766/371472 [5:42:47<24:51:51,  3.35it/s]
 19%|█▉        | 71767/371472 [5:42:48<25:25:22,  3.27it/s]
 19%|█▉        | 71768/371472 [5:42:48<25:45:54,  3.23it/s]
 19%|█▉        | 71769/371472 [5:42:48<25:40:27,  3.24it/s]
 19%|█▉        | 71770/371472 [5:42:49<25:07:17,  3.31it/s]
 19%|█▉        | 71771/371472 [5:42:49<24:30:41,  3.40it/s]
 19%|█▉        | 71772/371472 [5:42:49<23:53:39,  3.48it/s]
 19%|█▉        | 71773/371472 [5:42:49<23:16:10,  3.58it/s]
 19%|█▉        | 71774/371472 [5:42:50<22:51:47,  3.64it/s]
 19%|█▉        | 71775/371472 [5:42:50<22:32:11,  3.69it/s]
 19%|█▉        | 71776/371472 [5:42:50<22:38:39,  3.68it/s]
 19%|█▉        | 71777/371472 [5:42:51<24:26:42,  3.41it/s]
 19%|█▉        | 71778/371472 [5:42:51<24:11:24,  3.44it/s]
 19%|█▉        | 71779/371472 [5:42:51<23:53:51,  3.48it/s]
 19%|█▉        | 71780/371472 [5:42:51<23:34:31,  3.53it/s]
                                                           
{'loss': 4.0645, 'learning_rate': 8.264830097610376e-07, 'epoch': 3.09}

 19%|█▉        | 71780/371472 [5:42:51<23:34:31,  3.53it/s]
 19%|█▉        | 71781/371472 [5:42:52<22:36:21,  3.68it/s]
 19%|█▉        | 71782/371472 [5:42:52<23:31:53,  3.54it/s]
 19%|█▉        | 71783/371472 [5:42:52<23:53:03,  3.49it/s]
 19%|█▉        | 71784/371472 [5:42:52<23:08:24,  3.60it/s]
 19%|█▉        | 71785/371472 [5:42:53<24:22:55,  3.41it/s]
 19%|█▉        | 71786/371472 [5:42:53<23:24:04,  3.56it/s]
 19%|█▉        | 71787/371472 [5:42:53<22:31:41,  3.70it/s]
 19%|█▉        | 71788/371472 [5:42:54<21:41:53,  3.84it/s]
 19%|█▉        | 71789/371472 [5:42:54<21:44:12,  3.83it/s]
 19%|█▉        | 71790/371472 [5:42:54<23:07:04,  3.60it/s]
 19%|█▉        | 71791/371472 [5:42:54<23:18:14,  3.57it/s]
 19%|█▉        | 71792/371472 [5:42:55<23:50:17,  3.49it/s]
 19%|█▉        | 71793/371472 [5:42:55<23:13:08,  3.59it/s]
 19%|█▉        | 71794/371472 [5:42:55<22:29:56,  3.70it/s]
 19%|█▉        | 71795/371472 [5:42:55<22:08:33,  3.76it/s]
 19%|█▉        | 71796/371472 [5:42:56<23:34:33,  3.53it/s]
 19%|█▉        | 71797/371472 [5:42:56<23:47:43,  3.50it/s]
 19%|█▉        | 71798/371472 [5:42:56<23:06:16,  3.60it/s]
 19%|█▉        | 71799/371472 [5:42:57<23:35:19,  3.53it/s]
 19%|█▉        | 71800/371472 [5:42:57<25:42:15,  3.24it/s]
                                                           
{'loss': 4.1716, 'learning_rate': 8.264345277855588e-07, 'epoch': 3.09}

 19%|█▉        | 71800/371472 [5:42:57<25:42:15,  3.24it/s]
 19%|█▉        | 71801/371472 [5:42:57<25:18:06,  3.29it/s]
 19%|█▉        | 71802/371472 [5:42:58<25:28:47,  3.27it/s]
 19%|█▉        | 71803/371472 [5:42:58<26:04:55,  3.19it/s]
 19%|█▉        | 71804/371472 [5:42:58<26:30:18,  3.14it/s]
 19%|█▉        | 71805/371472 [5:42:59<24:59:30,  3.33it/s]
 19%|█▉        | 71806/371472 [5:42:59<23:55:21,  3.48it/s]
 19%|█▉        | 71807/371472 [5:42:59<25:22:50,  3.28it/s]
 19%|█▉        | 71808/371472 [5:42:59<27:02:51,  3.08it/s]
 19%|█▉        | 71809/371472 [5:43:00<25:56:22,  3.21it/s]
 19%|█▉        | 71810/371472 [5:43:00<26:09:38,  3.18it/s]
 19%|█▉        | 71811/371472 [5:43:00<24:52:51,  3.35it/s]
 19%|█▉        | 71812/371472 [5:43:01<24:05:16,  3.46it/s]
 19%|█▉        | 71813/371472 [5:43:01<23:35:43,  3.53it/s]
 19%|█▉        | 71814/371472 [5:43:01<23:24:20,  3.56it/s]
 19%|█▉        | 71815/371472 [5:43:02<25:53:42,  3.21it/s]
 19%|█▉        | 71816/371472 [5:43:02<24:30:32,  3.40it/s]
 19%|█▉        | 71817/371472 [5:43:02<24:21:01,  3.42it/s]
 19%|█▉        | 71818/371472 [5:43:02<24:13:45,  3.44it/s]
 19%|█▉        | 71819/371472 [5:43:03<26:21:19,  3.16it/s]
 19%|█▉        | 71820/371472 [5:43:03<25:01:47,  3.33it/s]
                                                           
{'loss': 4.3095, 'learning_rate': 8.263860458100799e-07, 'epoch': 3.09}

 19%|█▉        | 71820/371472 [5:43:03<25:01:47,  3.33it/s]
 19%|█▉        | 71821/371472 [5:43:03<24:19:19,  3.42it/s]
 19%|█▉        | 71822/371472 [5:43:04<24:02:34,  3.46it/s]
 19%|█▉        | 71823/371472 [5:43:04<24:09:00,  3.45it/s]
 19%|█▉        | 71824/371472 [5:43:04<23:26:04,  3.55it/s]
 19%|█▉        | 71825/371472 [5:43:04<23:03:31,  3.61it/s]
 19%|█▉        | 71826/371472 [5:43:05<23:04:37,  3.61it/s]
 19%|█▉        | 71827/371472 [5:43:05<22:34:58,  3.69it/s]
 19%|█▉        | 71828/371472 [5:43:05<22:12:24,  3.75it/s]
 19%|█▉        | 71829/371472 [5:43:05<22:08:22,  3.76it/s]
 19%|█▉        | 71830/371472 [5:43:06<21:50:55,  3.81it/s]
 19%|█▉        | 71831/371472 [5:43:06<22:33:13,  3.69it/s]
 19%|█▉        | 71832/371472 [5:43:06<24:02:52,  3.46it/s]
 19%|█▉        | 71833/371472 [5:43:07<23:27:16,  3.55it/s]
 19%|█▉        | 71834/371472 [5:43:07<22:52:21,  3.64it/s]
 19%|█▉        | 71835/371472 [5:43:07<25:02:14,  3.32it/s]
 19%|█▉        | 71836/371472 [5:43:07<23:59:01,  3.47it/s]
 19%|█▉        | 71837/371472 [5:43:08<23:50:27,  3.49it/s]
 19%|█▉        | 71838/371472 [5:43:08<23:17:01,  3.57it/s]
 19%|█▉        | 71839/371472 [5:43:08<26:00:29,  3.20it/s]
 19%|█▉        | 71840/371472 [5:43:09<24:45:55,  3.36it/s]
                                                           
{'loss': 4.1156, 'learning_rate': 8.26337563834601e-07, 'epoch': 3.09}

 19%|█▉        | 71840/371472 [5:43:09<24:45:55,  3.36it/s]
 19%|█▉        | 71841/371472 [5:43:09<24:12:32,  3.44it/s]
 19%|█▉        | 71842/371472 [5:43:09<24:36:00,  3.38it/s]
 19%|█▉        | 71843/371472 [5:43:10<23:54:02,  3.48it/s]
 19%|█▉        | 71844/371472 [5:43:10<23:07:56,  3.60it/s]
 19%|█▉        | 71845/371472 [5:43:10<22:42:33,  3.67it/s]
 19%|█▉        | 71846/371472 [5:43:10<22:45:49,  3.66it/s]
 19%|█▉        | 71847/371472 [5:43:11<24:29:21,  3.40it/s]
 19%|█▉        | 71848/371472 [5:43:11<23:31:05,  3.54it/s]
 19%|█▉        | 71849/371472 [5:43:11<23:14:58,  3.58it/s]
 19%|█▉        | 71850/371472 [5:43:11<23:57:20,  3.47it/s]
 19%|█▉        | 71851/371472 [5:43:12<23:15:38,  3.58it/s]
 19%|█▉        | 71852/371472 [5:43:12<23:23:23,  3.56it/s]
 19%|█▉        | 71853/371472 [5:43:12<26:06:19,  3.19it/s]
 19%|█▉        | 71854/371472 [5:43:13<24:28:29,  3.40it/s]
 19%|█▉        | 71855/371472 [5:43:13<24:31:18,  3.39it/s]
 19%|█▉        | 71856/371472 [5:43:13<23:05:40,  3.60it/s]
 19%|█▉        | 71857/371472 [5:43:13<22:10:25,  3.75it/s]
 19%|█▉        | 71858/371472 [5:43:14<21:56:49,  3.79it/s]
 19%|█▉        | 71859/371472 [5:43:14<21:35:26,  3.85it/s]
 19%|█▉        | 71860/371472 [5:43:14<22:04:13,  3.77it/s]
                                                           
{'loss': 4.3397, 'learning_rate': 8.262890818591221e-07, 'epoch': 3.1}

 19%|█▉        | 71860/371472 [5:43:14<22:04:13,  3.77it/s]
 19%|█▉        | 71861/371472 [5:43:14<22:03:17,  3.77it/s]
 19%|█▉        | 71862/371472 [5:43:15<24:25:24,  3.41it/s]
 19%|█▉        | 71863/371472 [5:43:15<24:58:28,  3.33it/s]
 19%|█▉        | 71864/371472 [5:43:15<24:09:14,  3.45it/s]
 19%|█▉        | 71865/371472 [5:43:16<25:54:18,  3.21it/s]
 19%|█▉        | 71866/371472 [5:43:16<26:35:25,  3.13it/s]
 19%|█▉        | 71867/371472 [5:43:16<25:34:46,  3.25it/s]
 19%|█▉        | 71868/371472 [5:43:17<27:29:58,  3.03it/s]
 19%|█▉        | 71869/371472 [5:43:17<25:46:33,  3.23it/s]
 19%|█▉        | 71870/371472 [5:43:17<24:40:47,  3.37it/s]
 19%|█▉        | 71871/371472 [5:43:18<23:23:39,  3.56it/s]
 19%|█▉        | 71872/371472 [5:43:18<23:12:14,  3.59it/s]
 19%|█▉        | 71873/371472 [5:43:18<24:06:36,  3.45it/s]
 19%|█▉        | 71874/371472 [5:43:18<23:57:27,  3.47it/s]
 19%|█▉        | 71875/371472 [5:43:19<22:57:04,  3.63it/s]
 19%|█▉        | 71876/371472 [5:43:19<22:25:42,  3.71it/s]
 19%|█▉        | 71877/371472 [5:43:19<22:52:08,  3.64it/s]
 19%|█▉        | 71878/371472 [5:43:19<22:31:30,  3.69it/s]
 19%|█▉        | 71879/371472 [5:43:20<24:34:00,  3.39it/s]
 19%|█▉        | 71880/371472 [5:43:20<23:38:31,  3.52it/s]
                                                           
{'loss': 4.1411, 'learning_rate': 8.262405998836433e-07, 'epoch': 3.1}

 19%|█▉        | 71880/371472 [5:43:20<23:38:31,  3.52it/s]
 19%|█▉        | 71881/371472 [5:43:20<23:25:31,  3.55it/s]
 19%|█▉        | 71882/371472 [5:43:21<26:06:57,  3.19it/s]
 19%|█▉        | 71883/371472 [5:43:21<25:11:50,  3.30it/s]
 19%|█▉        | 71884/371472 [5:43:21<26:01:00,  3.20it/s]
 19%|█▉        | 71885/371472 [5:43:22<24:06:53,  3.45it/s]
 19%|█▉        | 71886/371472 [5:43:22<22:58:03,  3.62it/s]
 19%|█▉        | 71887/371472 [5:43:22<24:16:39,  3.43it/s]
 19%|█▉        | 71888/371472 [5:43:22<24:40:54,  3.37it/s]
 19%|█▉        | 71889/371472 [5:43:23<27:39:12,  3.01it/s]
 19%|█▉        | 71890/371472 [5:43:23<25:44:07,  3.23it/s]
 19%|█▉        | 71891/371472 [5:43:23<25:30:15,  3.26it/s]
 19%|█▉        | 71892/371472 [5:43:24<24:10:55,  3.44it/s]
 19%|█▉        | 71893/371472 [5:43:24<23:15:12,  3.58it/s]
 19%|█▉        | 71894/371472 [5:43:24<23:32:39,  3.53it/s]
 19%|█▉        | 71895/371472 [5:43:25<23:20:35,  3.56it/s]
 19%|█▉        | 71896/371472 [5:43:25<22:15:01,  3.74it/s]
 19%|█▉        | 71897/371472 [5:43:25<21:53:12,  3.80it/s]
 19%|█▉        | 71898/371472 [5:43:25<22:44:16,  3.66it/s]
 19%|█▉        | 71899/371472 [5:43:26<25:16:05,  3.29it/s]
 19%|█▉        | 71900/371472 [5:43:26<24:20:18,  3.42it/s]
                                                           
{'loss': 4.4665, 'learning_rate': 8.261921179081642e-07, 'epoch': 3.1}

 19%|█▉        | 71900/371472 [5:43:26<24:20:18,  3.42it/s]
 19%|█▉        | 71901/371472 [5:43:26<23:09:02,  3.59it/s]
 19%|█▉        | 71902/371472 [5:43:27<23:21:27,  3.56it/s]
 19%|█▉        | 71903/371472 [5:43:27<25:12:54,  3.30it/s]
 19%|█▉        | 71904/371472 [5:43:27<24:32:39,  3.39it/s]
 19%|█▉        | 71905/371472 [5:43:27<23:36:38,  3.52it/s]
 19%|█▉        | 71906/371472 [5:43:28<23:46:24,  3.50it/s]
 19%|█▉        | 71907/371472 [5:43:28<24:02:01,  3.46it/s]
 19%|█▉        | 71908/371472 [5:43:28<25:07:13,  3.31it/s]
 19%|█▉        | 71909/371472 [5:43:29<24:11:20,  3.44it/s]
 19%|█▉        | 71910/371472 [5:43:29<23:48:42,  3.49it/s]
 19%|█▉        | 71911/371472 [5:43:29<24:14:24,  3.43it/s]
 19%|█▉        | 71912/371472 [5:43:29<24:18:27,  3.42it/s]
 19%|█▉        | 71913/371472 [5:43:30<23:21:02,  3.56it/s]
 19%|█▉        | 71914/371472 [5:43:30<23:27:25,  3.55it/s]
 19%|█▉        | 71915/371472 [5:43:30<25:02:40,  3.32it/s]
 19%|█▉        | 71916/371472 [5:43:31<25:22:59,  3.28it/s]
 19%|█▉        | 71917/371472 [5:43:31<24:12:24,  3.44it/s]
 19%|█▉        | 71918/371472 [5:43:31<25:17:09,  3.29it/s]
 19%|█▉        | 71919/371472 [5:43:32<26:54:27,  3.09it/s]
 19%|█▉        | 71920/371472 [5:43:32<25:51:01,  3.22it/s]
                                                           
{'loss': 4.3184, 'learning_rate': 8.261436359326854e-07, 'epoch': 3.1}

 19%|█▉        | 71920/371472 [5:43:32<25:51:01,  3.22it/s]
 19%|█▉        | 71921/371472 [5:43:32<25:49:49,  3.22it/s]
 19%|█▉        | 71922/371472 [5:43:32<24:06:07,  3.45it/s]
 19%|█▉        | 71923/371472 [5:43:33<23:03:05,  3.61it/s]
 19%|█▉        | 71924/371472 [5:43:33<22:12:51,  3.75it/s]
 19%|█▉        | 71925/371472 [5:43:33<22:40:17,  3.67it/s]
 19%|█▉        | 71926/371472 [5:43:34<23:02:39,  3.61it/s]
 19%|█▉        | 71927/371472 [5:43:34<22:41:01,  3.67it/s]
 19%|█▉        | 71928/371472 [5:43:34<22:27:48,  3.70it/s]
 19%|█▉        | 71929/371472 [5:43:34<23:52:24,  3.49it/s]
 19%|█▉        | 71930/371472 [5:43:35<22:43:40,  3.66it/s]
 19%|█▉        | 71931/371472 [5:43:35<24:04:49,  3.46it/s]
 19%|█▉        | 71932/371472 [5:43:35<23:52:28,  3.49it/s]
 19%|█▉        | 71933/371472 [5:43:35<23:10:58,  3.59it/s]
 19%|█▉        | 71934/371472 [5:43:36<23:31:45,  3.54it/s]
 19%|█▉        | 71935/371472 [5:43:36<24:17:44,  3.42it/s]
 19%|█▉        | 71936/371472 [5:43:36<25:00:20,  3.33it/s]
 19%|█▉        | 71937/371472 [5:43:37<24:08:18,  3.45it/s]
 19%|█▉        | 71938/371472 [5:43:37<25:16:54,  3.29it/s]
 19%|█▉        | 71939/371472 [5:43:37<24:02:50,  3.46it/s]
 19%|█▉        | 71940/371472 [5:43:38<24:31:36,  3.39it/s]
                                                           
{'loss': 4.1395, 'learning_rate': 8.260951539572065e-07, 'epoch': 3.1}

 19%|█▉        | 71940/371472 [5:43:38<24:31:36,  3.39it/s]
 19%|█▉        | 71941/371472 [5:43:38<25:07:50,  3.31it/s]
 19%|█▉        | 71942/371472 [5:43:38<24:00:38,  3.47it/s]
 19%|█▉        | 71943/371472 [5:43:38<24:26:40,  3.40it/s]
 19%|█▉        | 71944/371472 [5:43:39<24:44:03,  3.36it/s]
 19%|█▉        | 71945/371472 [5:43:39<23:47:35,  3.50it/s]
 19%|█▉        | 71946/371472 [5:43:39<22:32:52,  3.69it/s]
 19%|█▉        | 71947/371472 [5:43:40<23:58:14,  3.47it/s]
 19%|█▉        | 71948/371472 [5:43:40<24:35:08,  3.38it/s]
 19%|█▉        | 71949/371472 [5:43:40<24:48:52,  3.35it/s]
 19%|█▉        | 71950/371472 [5:43:40<23:16:40,  3.57it/s]
 19%|█▉        | 71951/371472 [5:43:41<23:04:43,  3.61it/s]
 19%|█▉        | 71952/371472 [5:43:41<23:44:15,  3.50it/s]
 19%|█▉        | 71953/371472 [5:43:41<22:52:55,  3.64it/s]
 19%|█▉        | 71954/371472 [5:43:42<22:27:55,  3.70it/s]
 19%|█▉        | 71955/371472 [5:43:42<21:43:29,  3.83it/s]
 19%|█▉        | 71956/371472 [5:43:42<21:33:26,  3.86it/s]
 19%|█▉        | 71957/371472 [5:43:42<21:41:38,  3.84it/s]
 19%|█▉        | 71958/371472 [5:43:42<20:56:02,  3.97it/s]
 19%|█▉        | 71959/371472 [5:43:43<21:25:45,  3.88it/s]
 19%|█▉        | 71960/371472 [5:43:43<20:59:21,  3.96it/s]
                                                           
{'loss': 4.1781, 'learning_rate': 8.260466719817277e-07, 'epoch': 3.1}

 19%|█▉        | 71960/371472 [5:43:43<20:59:21,  3.96it/s]
 19%|█▉        | 71961/371472 [5:43:43<23:07:25,  3.60it/s]
 19%|█▉        | 71962/371472 [5:43:44<23:44:07,  3.51it/s]
 19%|█▉        | 71963/371472 [5:43:44<23:50:22,  3.49it/s]
 19%|█▉        | 71964/371472 [5:43:44<23:20:46,  3.56it/s]
 19%|█▉        | 71965/371472 [5:43:44<22:48:14,  3.65it/s]
 19%|█▉        | 71966/371472 [5:43:45<23:07:17,  3.60it/s]
 19%|█▉        | 71967/371472 [5:43:45<23:00:14,  3.62it/s]
 19%|█▉        | 71968/371472 [5:43:45<24:45:45,  3.36it/s]
 19%|█▉        | 71969/371472 [5:43:46<24:25:50,  3.41it/s]
 19%|█▉        | 71970/371472 [5:43:46<25:02:36,  3.32it/s]
 19%|█▉        | 71971/371472 [5:43:46<24:17:39,  3.42it/s]
 19%|█▉        | 71972/371472 [5:43:47<23:44:08,  3.51it/s]
 19%|█▉        | 71973/371472 [5:43:47<24:05:40,  3.45it/s]
 19%|█▉        | 71974/371472 [5:43:47<23:33:26,  3.53it/s]
 19%|█▉        | 71975/371472 [5:43:47<24:02:21,  3.46it/s]
 19%|█▉        | 71976/371472 [5:43:48<23:55:08,  3.48it/s]
 19%|█▉        | 71977/371472 [5:43:48<24:23:01,  3.41it/s]
 19%|█▉        | 71978/371472 [5:43:48<23:40:23,  3.51it/s]
 19%|█▉        | 71979/371472 [5:43:49<24:01:15,  3.46it/s]
 19%|█▉        | 71980/371472 [5:43:49<23:04:30,  3.61it/s]
                                                           
{'loss': 4.1504, 'learning_rate': 8.259981900062488e-07, 'epoch': 3.1}

 19%|█▉        | 71980/371472 [5:43:49<23:04:30,  3.61it/s]
 19%|█▉        | 71981/371472 [5:43:49<22:19:03,  3.73it/s]
 19%|█▉        | 71982/371472 [5:43:49<22:05:05,  3.77it/s]
 19%|█▉        | 71983/371472 [5:43:50<23:18:17,  3.57it/s]
 19%|█▉        | 71984/371472 [5:43:50<24:23:46,  3.41it/s]
 19%|█▉        | 71985/371472 [5:43:50<23:02:05,  3.61it/s]
 19%|█▉        | 71986/371472 [5:43:50<24:00:09,  3.47it/s]
 19%|█▉        | 71987/371472 [5:43:51<26:56:03,  3.09it/s]
 19%|█▉        | 71988/371472 [5:43:51<25:46:54,  3.23it/s]
 19%|█▉        | 71989/371472 [5:43:51<24:22:01,  3.41it/s]
 19%|█▉        | 71990/371472 [5:43:52<23:51:13,  3.49it/s]
 19%|█▉        | 71991/371472 [5:43:52<22:58:40,  3.62it/s]
 19%|█▉        | 71992/371472 [5:43:52<22:49:09,  3.65it/s]
 19%|█▉        | 71993/371472 [5:43:53<23:11:10,  3.59it/s]
 19%|█▉        | 71994/371472 [5:43:53<22:47:37,  3.65it/s]
 19%|█▉        | 71995/371472 [5:43:53<21:55:42,  3.79it/s]
 19%|█▉        | 71996/371472 [5:43:53<21:53:06,  3.80it/s]
 19%|█▉        | 71997/371472 [5:43:54<22:44:17,  3.66it/s]
 19%|█▉        | 71998/371472 [5:43:54<22:25:05,  3.71it/s]
 19%|█▉        | 71999/371472 [5:43:54<23:19:22,  3.57it/s]
 19%|█▉        | 72000/371472 [5:43:54<22:55:44,  3.63it/s]
                                                           
{'loss': 4.1366, 'learning_rate': 8.2594970803077e-07, 'epoch': 3.1}

 19%|█▉        | 72000/371472 [5:43:54<22:55:44,  3.63it/s]
 19%|█▉        | 72001/371472 [5:43:55<23:15:47,  3.58it/s]
 19%|█▉        | 72002/371472 [5:43:55<26:22:11,  3.15it/s]
 19%|█▉        | 72003/371472 [5:43:55<25:10:29,  3.30it/s]
 19%|█▉        | 72004/371472 [5:43:56<24:56:25,  3.34it/s]
 19%|█▉        | 72005/371472 [5:43:56<25:55:59,  3.21it/s]
 19%|█▉        | 72006/371472 [5:43:56<24:59:14,  3.33it/s]
 19%|█▉        | 72007/371472 [5:43:57<23:59:44,  3.47it/s]
 19%|█▉        | 72008/371472 [5:43:57<26:41:38,  3.12it/s]
 19%|█▉        | 72009/371472 [5:43:57<25:39:24,  3.24it/s]
 19%|█▉        | 72010/371472 [5:43:57<23:56:48,  3.47it/s]
 19%|█▉        | 72011/371472 [5:43:58<23:53:45,  3.48it/s]
 19%|█▉        | 72012/371472 [5:43:58<23:59:26,  3.47it/s]
 19%|█▉        | 72013/371472 [5:43:58<25:00:18,  3.33it/s]
 19%|█▉        | 72014/371472 [5:43:59<24:44:42,  3.36it/s]
 19%|█▉        | 72015/371472 [5:43:59<25:39:09,  3.24it/s]
 19%|█▉        | 72016/371472 [5:43:59<25:11:32,  3.30it/s]
 19%|█▉        | 72017/371472 [5:44:00<23:39:32,  3.52it/s]
 19%|█▉        | 72018/371472 [5:44:00<24:46:33,  3.36it/s]
 19%|█▉        | 72019/371472 [5:44:00<25:41:29,  3.24it/s]
 19%|█▉        | 72020/371472 [5:44:00<25:56:59,  3.21it/s]
                                                           
{'loss': 3.9553, 'learning_rate': 8.259012260552909e-07, 'epoch': 3.1}

 19%|█▉        | 72020/371472 [5:44:00<25:56:59,  3.21it/s]
 19%|█▉        | 72021/371472 [5:44:01<24:47:41,  3.35it/s]
 19%|█▉        | 72022/371472 [5:44:01<24:32:48,  3.39it/s]
 19%|█▉        | 72023/371472 [5:44:01<27:05:35,  3.07it/s]
 19%|█▉        | 72024/371472 [5:44:02<25:31:58,  3.26it/s]
 19%|█▉        | 72025/371472 [5:44:02<25:08:24,  3.31it/s]
 19%|█▉        | 72026/371472 [5:44:02<24:50:33,  3.35it/s]
 19%|█▉        | 72027/371472 [5:44:03<24:19:15,  3.42it/s]
 19%|█▉        | 72028/371472 [5:44:03<24:08:56,  3.44it/s]
 19%|█▉        | 72029/371472 [5:44:03<23:35:00,  3.53it/s]
 19%|█▉        | 72030/371472 [5:44:03<23:06:25,  3.60it/s]
 19%|█▉        | 72031/371472 [5:44:04<22:39:45,  3.67it/s]
 19%|█▉        | 72032/371472 [5:44:04<22:59:32,  3.62it/s]
 19%|█▉        | 72033/371472 [5:44:04<22:29:54,  3.70it/s]
 19%|█▉        | 72034/371472 [5:44:04<23:27:53,  3.54it/s]
 19%|█▉        | 72035/371472 [5:44:05<22:26:12,  3.71it/s]
 19%|█▉        | 72036/371472 [5:44:05<22:17:47,  3.73it/s]
 19%|█▉        | 72037/371472 [5:44:05<22:11:17,  3.75it/s]
 19%|█▉        | 72038/371472 [5:44:05<21:32:43,  3.86it/s]
 19%|█▉        | 72039/371472 [5:44:06<22:43:53,  3.66it/s]
 19%|█▉        | 72040/371472 [5:44:06<23:02:53,  3.61it/s]
                                                           
{'loss': 4.1866, 'learning_rate': 8.25852744079812e-07, 'epoch': 3.1}

 19%|█▉        | 72040/371472 [5:44:06<23:02:53,  3.61it/s]
 19%|█▉        | 72041/371472 [5:44:06<23:08:01,  3.60it/s]
 19%|█▉        | 72042/371472 [5:44:07<23:23:00,  3.56it/s]
 19%|█▉        | 72043/371472 [5:44:07<23:22:04,  3.56it/s]
 19%|█▉        | 72044/371472 [5:44:07<23:12:05,  3.58it/s]
 19%|█▉        | 72045/371472 [5:44:07<22:36:49,  3.68it/s]
 19%|█▉        | 72046/371472 [5:44:08<21:53:14,  3.80it/s]
 19%|█▉        | 72047/371472 [5:44:08<22:40:57,  3.67it/s]
 19%|█▉        | 72048/371472 [5:44:08<23:52:12,  3.48it/s]
 19%|█▉        | 72049/371472 [5:44:09<23:18:13,  3.57it/s]
 19%|█▉        | 72050/371472 [5:44:09<22:45:25,  3.65it/s]
 19%|█▉        | 72051/371472 [5:44:09<23:02:35,  3.61it/s]
 19%|█▉        | 72052/371472 [5:44:09<22:44:23,  3.66it/s]
 19%|█▉        | 72053/371472 [5:44:10<22:42:57,  3.66it/s]
 19%|█▉        | 72054/371472 [5:44:10<22:16:55,  3.73it/s]
 19%|█▉        | 72055/371472 [5:44:10<22:02:11,  3.77it/s]
 19%|█▉        | 72056/371472 [5:44:10<22:40:20,  3.67it/s]
 19%|█▉        | 72057/371472 [5:44:11<22:21:59,  3.72it/s]
 19%|█▉        | 72058/371472 [5:44:11<22:33:02,  3.69it/s]
 19%|█▉        | 72059/371472 [5:44:11<22:26:46,  3.71it/s]
 19%|█▉        | 72060/371472 [5:44:12<24:58:37,  3.33it/s]
                                                           
{'loss': 4.118, 'learning_rate': 8.258042621043332e-07, 'epoch': 3.1}

 19%|█▉        | 72060/371472 [5:44:12<24:58:37,  3.33it/s]
 19%|█▉        | 72061/371472 [5:44:12<24:21:05,  3.42it/s]
 19%|█▉        | 72062/371472 [5:44:12<25:19:20,  3.28it/s]
 19%|█▉        | 72063/371472 [5:44:13<24:58:00,  3.33it/s]
 19%|█▉        | 72064/371472 [5:44:13<24:25:42,  3.40it/s]
 19%|█▉        | 72065/371472 [5:44:13<24:32:46,  3.39it/s]
 19%|█▉        | 72066/371472 [5:44:13<25:23:29,  3.28it/s]
 19%|█▉        | 72067/371472 [5:44:14<26:30:37,  3.14it/s]
 19%|█▉        | 72068/371472 [5:44:14<25:20:25,  3.28it/s]
 19%|█▉        | 72069/371472 [5:44:14<25:08:22,  3.31it/s]
 19%|█▉        | 72070/371472 [5:44:15<24:30:14,  3.39it/s]
 19%|█▉        | 72071/371472 [5:44:15<24:49:49,  3.35it/s]
 19%|█▉        | 72072/371472 [5:44:15<25:05:39,  3.31it/s]
 19%|█▉        | 72073/371472 [5:44:16<24:59:05,  3.33it/s]
 19%|█▉        | 72074/371472 [5:44:16<23:30:08,  3.54it/s]
 19%|█▉        | 72075/371472 [5:44:16<23:13:14,  3.58it/s]
 19%|█▉        | 72076/371472 [5:44:16<22:22:20,  3.72it/s]
 19%|█▉        | 72077/371472 [5:44:17<22:04:52,  3.77it/s]
 19%|█▉        | 72078/371472 [5:44:17<22:34:01,  3.69it/s]
 19%|█▉        | 72079/371472 [5:44:17<21:58:14,  3.79it/s]
 19%|█▉        | 72080/371472 [5:44:17<23:01:51,  3.61it/s]
                                                           
{'loss': 4.0653, 'learning_rate': 8.257557801288542e-07, 'epoch': 3.1}

 19%|█▉        | 72080/371472 [5:44:17<23:01:51,  3.61it/s]
 19%|█▉        | 72081/371472 [5:44:18<24:55:47,  3.34it/s]
 19%|█▉        | 72082/371472 [5:44:18<24:47:58,  3.35it/s]
 19%|█▉        | 72083/371472 [5:44:18<25:06:06,  3.31it/s]
 19%|█▉        | 72084/371472 [5:44:19<25:04:56,  3.32it/s]
 19%|█▉        | 72085/371472 [5:44:19<24:37:03,  3.38it/s]
 19%|█▉        | 72086/371472 [5:44:19<26:35:59,  3.13it/s]
 19%|█▉        | 72087/371472 [5:44:20<25:29:18,  3.26it/s]
 19%|█▉        | 72088/371472 [5:44:20<24:46:33,  3.36it/s]
 19%|█▉        | 72089/371472 [5:44:20<24:11:38,  3.44it/s]
 19%|█▉        | 72090/371472 [5:44:20<23:33:57,  3.53it/s]
 19%|█▉        | 72091/371472 [5:44:21<22:56:49,  3.62it/s]
 19%|█▉        | 72092/371472 [5:44:21<22:09:52,  3.75it/s]
 19%|█▉        | 72093/371472 [5:44:21<22:04:13,  3.77it/s]
 19%|█▉        | 72094/371472 [5:44:21<21:38:02,  3.84it/s]
 19%|█▉        | 72095/371472 [5:44:22<21:35:50,  3.85it/s]
 19%|█▉        | 72096/371472 [5:44:22<22:28:26,  3.70it/s]
 19%|█▉        | 72097/371472 [5:44:22<23:55:39,  3.48it/s]
 19%|█▉        | 72098/371472 [5:44:23<24:59:58,  3.33it/s]
 19%|█▉        | 72099/371472 [5:44:23<23:36:18,  3.52it/s]
 19%|█▉        | 72100/371472 [5:44:23<22:52:11,  3.64it/s]
                                                           
{'loss': 4.1731, 'learning_rate': 8.257072981533754e-07, 'epoch': 3.11}

 19%|█▉        | 72100/371472 [5:44:23<22:52:11,  3.64it/s]
 19%|█▉        | 72101/371472 [5:44:23<22:40:47,  3.67it/s]
 19%|█▉        | 72102/371472 [5:44:24<22:23:22,  3.71it/s]
 19%|█▉        | 72103/371472 [5:44:24<23:21:20,  3.56it/s]
 19%|█▉        | 72104/371472 [5:44:24<23:07:42,  3.60it/s]
 19%|█▉        | 72105/371472 [5:44:25<22:43:24,  3.66it/s]
 19%|█▉        | 72106/371472 [5:44:25<24:16:49,  3.42it/s]
 19%|█▉        | 72107/371472 [5:44:25<26:02:50,  3.19it/s]
 19%|█▉        | 72108/371472 [5:44:26<26:29:11,  3.14it/s]
 19%|█▉        | 72109/371472 [5:44:26<24:55:12,  3.34it/s]
 19%|█▉        | 72110/371472 [5:44:26<25:20:03,  3.28it/s]
 19%|█▉        | 72111/371472 [5:44:26<24:15:42,  3.43it/s]
 19%|█▉        | 72112/371472 [5:44:27<24:26:06,  3.40it/s]
 19%|█▉        | 72113/371472 [5:44:27<23:34:46,  3.53it/s]
 19%|█▉        | 72114/371472 [5:44:27<24:32:08,  3.39it/s]
 19%|█▉        | 72115/371472 [5:44:28<24:19:08,  3.42it/s]
 19%|█▉        | 72116/371472 [5:44:28<23:07:07,  3.60it/s]
 19%|█▉        | 72117/371472 [5:44:28<22:06:28,  3.76it/s]
 19%|█▉        | 72118/371472 [5:44:28<21:53:02,  3.80it/s]
 19%|█▉        | 72119/371472 [5:44:29<22:29:25,  3.70it/s]
 19%|█▉        | 72120/371472 [5:44:29<24:25:56,  3.40it/s]
                                                           
{'loss': 4.2102, 'learning_rate': 8.256588161778965e-07, 'epoch': 3.11}

 19%|█▉        | 72120/371472 [5:44:29<24:25:56,  3.40it/s]
 19%|█▉        | 72121/371472 [5:44:29<24:14:11,  3.43it/s]
 19%|█▉        | 72122/371472 [5:44:30<25:40:07,  3.24it/s]
 19%|█▉        | 72123/371472 [5:44:30<24:31:33,  3.39it/s]
 19%|█▉        | 72124/371472 [5:44:30<23:54:24,  3.48it/s]
 19%|█▉        | 72125/371472 [5:44:30<23:34:30,  3.53it/s]
 19%|█▉        | 72126/371472 [5:44:31<23:53:48,  3.48it/s]
 19%|█▉        | 72127/371472 [5:44:31<24:55:35,  3.34it/s]
 19%|█▉        | 72128/371472 [5:44:31<24:18:11,  3.42it/s]
 19%|█▉        | 72129/371472 [5:44:32<23:28:30,  3.54it/s]
 19%|█▉        | 72130/371472 [5:44:32<24:38:21,  3.37it/s]
 19%|█▉        | 72131/371472 [5:44:32<24:11:27,  3.44it/s]
 19%|█▉        | 72132/371472 [5:44:32<25:04:12,  3.32it/s]
 19%|█▉        | 72133/371472 [5:44:33<26:57:57,  3.08it/s]
 19%|█▉        | 72134/371472 [5:44:33<25:58:50,  3.20it/s]
 19%|█▉        | 72135/371472 [5:44:33<26:19:24,  3.16it/s]
 19%|█▉        | 72136/371472 [5:44:34<24:38:49,  3.37it/s]
 19%|█▉        | 72137/371472 [5:44:34<23:41:38,  3.51it/s]
 19%|█▉        | 72138/371472 [5:44:34<23:49:30,  3.49it/s]
 19%|█▉        | 72139/371472 [5:44:35<23:23:41,  3.55it/s]
 19%|█▉        | 72140/371472 [5:44:35<24:02:24,  3.46it/s]
                                                           
{'loss': 4.0365, 'learning_rate': 8.256103342024177e-07, 'epoch': 3.11}

 19%|█▉        | 72140/371472 [5:44:35<24:02:24,  3.46it/s]
 19%|█▉        | 72141/371472 [5:44:35<24:53:00,  3.34it/s]
 19%|█▉        | 72142/371472 [5:44:35<24:33:15,  3.39it/s]
 19%|█▉        | 72143/371472 [5:44:36<23:32:22,  3.53it/s]
 19%|█▉        | 72144/371472 [5:44:36<23:29:48,  3.54it/s]
 19%|█▉        | 72145/371472 [5:44:36<22:54:27,  3.63it/s]
 19%|█▉        | 72146/371472 [5:44:36<22:17:11,  3.73it/s]
 19%|█▉        | 72147/371472 [5:44:37<25:18:55,  3.28it/s]
 19%|█▉        | 72148/371472 [5:44:37<24:07:45,  3.45it/s]
 19%|█▉        | 72149/371472 [5:44:37<23:15:02,  3.58it/s]
 19%|█▉        | 72150/371472 [5:44:38<22:28:38,  3.70it/s]
 19%|█▉        | 72151/371472 [5:44:38<22:11:04,  3.75it/s]
 19%|█▉        | 72152/371472 [5:44:38<22:04:07,  3.77it/s]
 19%|█▉        | 72153/371472 [5:44:38<22:03:05,  3.77it/s]
 19%|█▉        | 72154/371472 [5:44:39<22:44:00,  3.66it/s]
 19%|█▉        | 72155/371472 [5:44:39<22:52:02,  3.64it/s]
 19%|█▉        | 72156/371472 [5:44:39<22:16:10,  3.73it/s]
 19%|█▉        | 72157/371472 [5:44:39<21:37:39,  3.84it/s]
 19%|█▉        | 72158/371472 [5:44:40<23:35:47,  3.52it/s]
 19%|█▉        | 72159/371472 [5:44:40<22:56:55,  3.62it/s]
 19%|█▉        | 72160/371472 [5:44:40<23:39:33,  3.51it/s]
                                                           
{'loss': 4.0914, 'learning_rate': 8.255618522269386e-07, 'epoch': 3.11}

 19%|█▉        | 72160/371472 [5:44:40<23:39:33,  3.51it/s]
 19%|█▉        | 72161/371472 [5:44:41<23:44:38,  3.50it/s]
 19%|█▉        | 72162/371472 [5:44:41<23:06:26,  3.60it/s]
 19%|█▉        | 72163/371472 [5:44:41<24:03:51,  3.45it/s]
 19%|█▉        | 72164/371472 [5:44:41<22:52:46,  3.63it/s]
 19%|█▉        | 72165/371472 [5:44:42<22:24:30,  3.71it/s]
 19%|█▉        | 72166/371472 [5:44:42<22:12:51,  3.74it/s]
 19%|█▉        | 72167/371472 [5:44:42<22:06:13,  3.76it/s]
 19%|█▉        | 72168/371472 [5:44:43<25:26:16,  3.27it/s]
 19%|█▉        | 72169/371472 [5:44:43<24:30:30,  3.39it/s]
 19%|█▉        | 72170/371472 [5:44:43<24:39:50,  3.37it/s]
 19%|█▉        | 72171/371472 [5:44:44<25:15:35,  3.29it/s]
 19%|█▉        | 72172/371472 [5:44:44<24:04:53,  3.45it/s]
 19%|█▉        | 72173/371472 [5:44:44<23:46:08,  3.50it/s]
 19%|█▉        | 72174/371472 [5:44:44<22:41:42,  3.66it/s]
 19%|█▉        | 72175/371472 [5:44:45<22:03:10,  3.77it/s]
 19%|█▉        | 72176/371472 [5:44:45<21:49:03,  3.81it/s]
 19%|█▉        | 72177/371472 [5:44:45<21:23:28,  3.89it/s]
 19%|█▉        | 72178/371472 [5:44:45<21:39:58,  3.84it/s]
 19%|█▉        | 72179/371472 [5:44:46<21:57:28,  3.79it/s]
 19%|█▉        | 72180/371472 [5:44:46<22:10:06,  3.75it/s]
                                                           
{'loss': 4.2207, 'learning_rate': 8.255133702514598e-07, 'epoch': 3.11}

 19%|█▉        | 72180/371472 [5:44:46<22:10:06,  3.75it/s]
 19%|█▉        | 72181/371472 [5:44:46<22:15:44,  3.73it/s]
 19%|█▉        | 72182/371472 [5:44:46<21:59:13,  3.78it/s]
 19%|█▉        | 72183/371472 [5:44:47<23:39:15,  3.51it/s]
 19%|█▉        | 72184/371472 [5:44:47<22:55:48,  3.63it/s]
 19%|█▉        | 72185/371472 [5:44:47<22:43:41,  3.66it/s]
 19%|█▉        | 72186/371472 [5:44:48<22:23:25,  3.71it/s]
 19%|█▉        | 72187/371472 [5:44:48<22:47:54,  3.65it/s]
 19%|█▉        | 72188/371472 [5:44:48<22:02:46,  3.77it/s]
 19%|█▉        | 72189/371472 [5:44:48<22:24:57,  3.71it/s]
 19%|█▉        | 72190/371472 [5:44:49<22:13:30,  3.74it/s]
 19%|█▉        | 72191/371472 [5:44:49<23:23:51,  3.55it/s]
 19%|█▉        | 72192/371472 [5:44:49<23:34:15,  3.53it/s]
 19%|█▉        | 72193/371472 [5:44:49<22:45:17,  3.65it/s]
 19%|█▉        | 72194/371472 [5:44:50<22:49:26,  3.64it/s]
 19%|█▉        | 72195/371472 [5:44:50<23:04:15,  3.60it/s]
 19%|█▉        | 72196/371472 [5:44:50<23:42:37,  3.51it/s]
 19%|█▉        | 72197/371472 [5:44:51<22:46:33,  3.65it/s]
 19%|█▉        | 72198/371472 [5:44:51<23:11:58,  3.58it/s]
 19%|█▉        | 72199/371472 [5:44:51<24:33:07,  3.39it/s]
 19%|█▉        | 72200/371472 [5:44:51<23:19:13,  3.56it/s]
                                                           
{'loss': 4.2689, 'learning_rate': 8.254648882759809e-07, 'epoch': 3.11}

 19%|█▉        | 72200/371472 [5:44:51<23:19:13,  3.56it/s]
 19%|█▉        | 72201/371472 [5:44:52<23:10:48,  3.59it/s]
 19%|█▉        | 72202/371472 [5:44:52<23:07:46,  3.59it/s]
 19%|█▉        | 72203/371472 [5:44:52<22:29:35,  3.70it/s]
 19%|█▉        | 72204/371472 [5:44:53<24:40:52,  3.37it/s]
 19%|█▉        | 72205/371472 [5:44:53<24:41:14,  3.37it/s]
 19%|█▉        | 72206/371472 [5:44:53<23:12:54,  3.58it/s]
 19%|█▉        | 72207/371472 [5:44:53<22:49:57,  3.64it/s]
 19%|█▉        | 72208/371472 [5:44:54<22:09:05,  3.75it/s]
 19%|█▉        | 72209/371472 [5:44:54<21:58:21,  3.78it/s]
 19%|█▉        | 72210/371472 [5:44:54<23:09:30,  3.59it/s]
 19%|█▉        | 72211/371472 [5:44:54<22:43:08,  3.66it/s]
 19%|█▉        | 72212/371472 [5:44:55<22:12:19,  3.74it/s]
 19%|█▉        | 72213/371472 [5:44:55<21:40:25,  3.84it/s]
 19%|█▉        | 72214/371472 [5:44:55<21:57:00,  3.79it/s]
 19%|█▉        | 72215/371472 [5:44:56<22:40:43,  3.67it/s]
 19%|█▉        | 72216/371472 [5:44:56<23:04:17,  3.60it/s]
 19%|█▉        | 72217/371472 [5:44:56<23:21:48,  3.56it/s]
 19%|█▉        | 72218/371472 [5:44:56<22:38:07,  3.67it/s]
 19%|█▉        | 72219/371472 [5:44:57<22:33:35,  3.68it/s]
 19%|█▉        | 72220/371472 [5:44:57<22:08:41,  3.75it/s]
                                                           
{'loss': 4.0893, 'learning_rate': 8.254164063005021e-07, 'epoch': 3.11}

 19%|█▉        | 72220/371472 [5:44:57<22:08:41,  3.75it/s]
 19%|█▉        | 72221/371472 [5:44:57<21:53:28,  3.80it/s]
 19%|█▉        | 72222/371472 [5:44:57<21:38:56,  3.84it/s]
 19%|█▉        | 72223/371472 [5:44:58<22:27:14,  3.70it/s]
 19%|█▉        | 72224/371472 [5:44:58<23:44:15,  3.50it/s]
 19%|█▉        | 72225/371472 [5:44:58<23:07:53,  3.59it/s]
 19%|█▉        | 72226/371472 [5:44:59<22:17:00,  3.73it/s]
 19%|█▉        | 72227/371472 [5:44:59<22:25:13,  3.71it/s]
 19%|█▉        | 72228/371472 [5:44:59<22:22:36,  3.71it/s]
 19%|█▉        | 72229/371472 [5:44:59<22:41:56,  3.66it/s]
 19%|█▉        | 72230/371472 [5:45:00<22:21:47,  3.72it/s]
 19%|█▉        | 72231/371472 [5:45:00<22:33:44,  3.68it/s]
 19%|█▉        | 72232/371472 [5:45:00<22:13:18,  3.74it/s]
 19%|█▉        | 72233/371472 [5:45:00<23:23:32,  3.55it/s]
 19%|█▉        | 72234/371472 [5:45:01<23:07:11,  3.60it/s]
 19%|█▉        | 72235/371472 [5:45:01<23:44:57,  3.50it/s]
 19%|█▉        | 72236/371472 [5:45:01<23:22:08,  3.56it/s]
 19%|█▉        | 72237/371472 [5:45:02<22:34:23,  3.68it/s]
 19%|█▉        | 72238/371472 [5:45:02<22:20:27,  3.72it/s]
 19%|█▉        | 72239/371472 [5:45:02<21:58:46,  3.78it/s]
 19%|█▉        | 72240/371472 [5:45:02<22:38:17,  3.67it/s]
                                                           
{'loss': 4.086, 'learning_rate': 8.253679243250231e-07, 'epoch': 3.11}

 19%|█▉        | 72240/371472 [5:45:02<22:38:17,  3.67it/s]
 19%|█▉        | 72241/371472 [5:45:03<26:32:34,  3.13it/s]
 19%|█▉        | 72242/371472 [5:45:03<25:47:41,  3.22it/s]
 19%|█▉        | 72243/371472 [5:45:03<24:35:04,  3.38it/s]
 19%|█▉        | 72244/371472 [5:45:04<24:54:18,  3.34it/s]
 19%|█▉        | 72245/371472 [5:45:04<25:10:57,  3.30it/s]
 19%|█▉        | 72246/371472 [5:45:04<25:28:32,  3.26it/s]
 19%|█▉        | 72247/371472 [5:45:05<24:45:49,  3.36it/s]
 19%|█▉        | 72248/371472 [5:45:05<25:43:18,  3.23it/s]
 19%|█▉        | 72249/371472 [5:45:05<25:40:59,  3.24it/s]
 19%|█▉        | 72250/371472 [5:45:06<25:47:08,  3.22it/s]
 19%|█▉        | 72251/371472 [5:45:06<24:27:55,  3.40it/s]
 19%|█▉        | 72252/371472 [5:45:06<23:29:23,  3.54it/s]
 19%|█▉        | 72253/371472 [5:45:06<23:56:05,  3.47it/s]
 19%|█▉        | 72254/371472 [5:45:07<23:00:19,  3.61it/s]
 19%|█▉        | 72255/371472 [5:45:07<22:30:24,  3.69it/s]
 19%|█▉        | 72256/371472 [5:45:07<21:41:06,  3.83it/s]
 19%|█▉        | 72257/371472 [5:45:07<25:33:31,  3.25it/s]
 19%|█▉        | 72258/371472 [5:45:08<24:45:02,  3.36it/s]
 19%|█▉        | 72259/371472 [5:45:08<23:40:48,  3.51it/s]
 19%|█▉        | 72260/371472 [5:45:08<23:44:14,  3.50it/s]
                                                           
{'loss': 4.2711, 'learning_rate': 8.253194423495443e-07, 'epoch': 3.11}

 19%|█▉        | 72260/371472 [5:45:08<23:44:14,  3.50it/s]
 19%|█▉        | 72261/371472 [5:45:09<23:26:43,  3.55it/s]
 19%|█▉        | 72262/371472 [5:45:09<22:42:04,  3.66it/s]
 19%|█▉        | 72263/371472 [5:45:09<22:32:53,  3.69it/s]
 19%|█▉        | 72264/371472 [5:45:09<23:00:45,  3.61it/s]
 19%|█▉        | 72265/371472 [5:45:10<23:28:37,  3.54it/s]
 19%|█▉        | 72266/371472 [5:45:10<23:17:47,  3.57it/s]
 19%|█▉        | 72267/371472 [5:45:10<23:46:00,  3.50it/s]
 19%|█▉        | 72268/371472 [5:45:11<22:45:18,  3.65it/s]
 19%|█▉        | 72269/371472 [5:45:11<22:08:06,  3.75it/s]
 19%|█▉        | 72270/371472 [5:45:11<21:40:04,  3.84it/s]
 19%|█▉        | 72271/371472 [5:45:11<21:49:12,  3.81it/s]
 19%|█▉        | 72272/371472 [5:45:12<21:28:09,  3.87it/s]
 19%|█▉        | 72273/371472 [5:45:12<21:09:18,  3.93it/s]
 19%|█▉        | 72274/371472 [5:45:12<24:00:50,  3.46it/s]
 19%|█▉        | 72275/371472 [5:45:12<23:25:47,  3.55it/s]
 19%|█▉        | 72276/371472 [5:45:13<23:43:45,  3.50it/s]
 19%|█▉        | 72277/371472 [5:45:13<23:42:48,  3.50it/s]
 19%|█▉        | 72278/371472 [5:45:13<22:51:50,  3.63it/s]
 19%|█▉        | 72279/371472 [5:45:13<22:16:42,  3.73it/s]
 19%|█▉        | 72280/371472 [5:45:14<23:04:59,  3.60it/s]
                                                           
{'loss': 4.1362, 'learning_rate': 8.252709603740653e-07, 'epoch': 3.11}

 19%|█▉        | 72280/371472 [5:45:14<23:04:59,  3.60it/s]
 19%|█▉        | 72281/371472 [5:45:14<23:16:48,  3.57it/s]
 19%|█▉        | 72282/371472 [5:45:14<22:40:11,  3.67it/s]
 19%|█▉        | 72283/371472 [5:45:15<22:26:11,  3.70it/s]
 19%|█▉        | 72284/371472 [5:45:15<23:22:49,  3.55it/s]
 19%|█▉        | 72285/371472 [5:45:15<22:34:53,  3.68it/s]
 19%|█▉        | 72286/371472 [5:45:15<23:46:12,  3.50it/s]
 19%|█▉        | 72287/371472 [5:45:16<22:38:28,  3.67it/s]
 19%|█▉        | 72288/371472 [5:45:16<22:19:01,  3.72it/s]
 19%|█▉        | 72289/371472 [5:45:16<21:34:58,  3.85it/s]
 19%|█▉        | 72290/371472 [5:45:16<22:25:58,  3.70it/s]
 19%|█▉        | 72291/371472 [5:45:17<21:46:39,  3.82it/s]
 19%|█▉        | 72292/371472 [5:45:17<21:35:59,  3.85it/s]
 19%|█▉        | 72293/371472 [5:45:17<21:51:15,  3.80it/s]
 19%|█▉        | 72294/371472 [5:45:18<21:39:39,  3.84it/s]
 19%|█▉        | 72295/371472 [5:45:18<21:35:47,  3.85it/s]
 19%|█▉        | 72296/371472 [5:45:18<22:15:22,  3.73it/s]
 19%|█▉        | 72297/371472 [5:45:18<22:22:15,  3.71it/s]
 19%|█▉        | 72298/371472 [5:45:19<22:43:08,  3.66it/s]
 19%|█▉        | 72299/371472 [5:45:19<22:20:52,  3.72it/s]
 19%|█▉        | 72300/371472 [5:45:19<21:24:11,  3.88it/s]
                                                           
{'loss': 4.294, 'learning_rate': 8.252224783985864e-07, 'epoch': 3.11}

 19%|█▉        | 72300/371472 [5:45:19<21:24:11,  3.88it/s]
 19%|█▉        | 72301/371472 [5:45:19<24:15:10,  3.43it/s]
 19%|█▉        | 72302/371472 [5:45:20<23:29:19,  3.54it/s]
 19%|█▉        | 72303/371472 [5:45:20<22:41:04,  3.66it/s]
 19%|█▉        | 72304/371472 [5:45:20<23:20:02,  3.56it/s]
 19%|█▉        | 72305/371472 [5:45:21<23:06:35,  3.60it/s]
 19%|█▉        | 72306/371472 [5:45:21<23:08:57,  3.59it/s]
 19%|█▉        | 72307/371472 [5:45:21<23:29:20,  3.54it/s]
 19%|█▉        | 72308/371472 [5:45:21<23:46:13,  3.50it/s]
 19%|█▉        | 72309/371472 [5:45:22<25:26:13,  3.27it/s]
 19%|█▉        | 72310/371472 [5:45:22<24:55:45,  3.33it/s]
 19%|█▉        | 72311/371472 [5:45:22<24:37:21,  3.37it/s]
 19%|█▉        | 72312/371472 [5:45:23<26:15:35,  3.16it/s]
 19%|█▉        | 72313/371472 [5:45:23<26:11:26,  3.17it/s]
 19%|█▉        | 72314/371472 [5:45:23<24:54:00,  3.34it/s]
 19%|█▉        | 72315/371472 [5:45:24<23:44:48,  3.50it/s]
 19%|█▉        | 72316/371472 [5:45:24<23:52:35,  3.48it/s]
 19%|█▉        | 72317/371472 [5:45:24<23:06:34,  3.60it/s]
 19%|█▉        | 72318/371472 [5:45:24<22:12:20,  3.74it/s]
 19%|█▉        | 72319/371472 [5:45:25<22:49:54,  3.64it/s]
 19%|█▉        | 72320/371472 [5:45:25<22:43:00,  3.66it/s]
                                                           
{'loss': 3.9799, 'learning_rate': 8.251739964231075e-07, 'epoch': 3.11}

 19%|█▉        | 72320/371472 [5:45:25<22:43:00,  3.66it/s]
 19%|█▉        | 72321/371472 [5:45:25<23:10:44,  3.59it/s]
 19%|█▉        | 72322/371472 [5:45:26<24:41:00,  3.37it/s]
 19%|█▉        | 72323/371472 [5:45:26<23:55:47,  3.47it/s]
 19%|█▉        | 72324/371472 [5:45:26<22:49:19,  3.64it/s]
 19%|█▉        | 72325/371472 [5:45:26<22:22:38,  3.71it/s]
 19%|█▉        | 72326/371472 [5:45:27<25:09:25,  3.30it/s]
 19%|█▉        | 72327/371472 [5:45:27<23:50:20,  3.49it/s]
 19%|█▉        | 72328/371472 [5:45:27<22:51:03,  3.64it/s]
 19%|█▉        | 72329/371472 [5:45:27<22:50:16,  3.64it/s]
 19%|█▉        | 72330/371472 [5:45:28<22:19:45,  3.72it/s]
 19%|█▉        | 72331/371472 [5:45:28<22:31:07,  3.69it/s]
 19%|█▉        | 72332/371472 [5:45:28<22:48:04,  3.64it/s]
 19%|█▉        | 72333/371472 [5:45:29<22:14:18,  3.74it/s]
 19%|█▉        | 72334/371472 [5:45:29<22:06:53,  3.76it/s]
 19%|█▉        | 72335/371472 [5:45:29<22:56:20,  3.62it/s]
 19%|█▉        | 72336/371472 [5:45:29<21:56:24,  3.79it/s]
 19%|█▉        | 72337/371472 [5:45:30<22:32:56,  3.68it/s]
 19%|█▉        | 72338/371472 [5:45:30<22:01:01,  3.77it/s]
 19%|█▉        | 72339/371472 [5:45:30<22:33:36,  3.68it/s]
 19%|█▉        | 72340/371472 [5:45:30<23:11:23,  3.58it/s]
                                                           
{'loss': 4.2485, 'learning_rate': 8.251255144476287e-07, 'epoch': 3.12}

 19%|█▉        | 72340/371472 [5:45:30<23:11:23,  3.58it/s]
 19%|█▉        | 72341/371472 [5:45:31<22:41:28,  3.66it/s]
 19%|█▉        | 72342/371472 [5:45:31<23:35:34,  3.52it/s]
 19%|█▉        | 72343/371472 [5:45:31<23:14:24,  3.58it/s]
 19%|█▉        | 72344/371472 [5:45:32<22:56:55,  3.62it/s]
 19%|█▉        | 72345/371472 [5:45:32<23:58:41,  3.47it/s]
 19%|█▉        | 72346/371472 [5:45:32<23:09:13,  3.59it/s]
 19%|█▉        | 72347/371472 [5:45:33<28:17:54,  2.94it/s]
 19%|█▉        | 72348/371472 [5:45:33<26:13:53,  3.17it/s]
 19%|█▉        | 72349/371472 [5:45:33<24:29:19,  3.39it/s]
 19%|█▉        | 72350/371472 [5:45:33<24:37:12,  3.37it/s]
 19%|█▉        | 72351/371472 [5:45:34<23:36:23,  3.52it/s]
 19%|█▉        | 72352/371472 [5:45:34<22:54:52,  3.63it/s]
 19%|█▉        | 72353/371472 [5:45:34<23:32:16,  3.53it/s]
 19%|█▉        | 72354/371472 [5:45:34<23:22:04,  3.56it/s]
 19%|█▉        | 72355/371472 [5:45:35<22:37:40,  3.67it/s]
 19%|█▉        | 72356/371472 [5:45:35<22:24:39,  3.71it/s]
 19%|█▉        | 72357/371472 [5:45:35<22:10:15,  3.75it/s]
 19%|█▉        | 72358/371472 [5:45:36<23:48:48,  3.49it/s]
 19%|█▉        | 72359/371472 [5:45:36<23:32:08,  3.53it/s]
 19%|█▉        | 72360/371472 [5:45:36<23:19:45,  3.56it/s]
                                                           
{'loss': 3.9589, 'learning_rate': 8.250770324721498e-07, 'epoch': 3.12}

 19%|█▉        | 72360/371472 [5:45:36<23:19:45,  3.56it/s]
 19%|█▉        | 72361/371472 [5:45:36<23:51:19,  3.48it/s]
 19%|█▉        | 72362/371472 [5:45:37<22:38:59,  3.67it/s]
 19%|█▉        | 72363/371472 [5:45:37<23:08:11,  3.59it/s]
 19%|█▉        | 72364/371472 [5:45:37<22:33:08,  3.68it/s]
 19%|█▉        | 72365/371472 [5:45:38<22:59:14,  3.61it/s]
 19%|█▉        | 72366/371472 [5:45:38<23:59:07,  3.46it/s]
 19%|█▉        | 72367/371472 [5:45:38<24:42:12,  3.36it/s]
 19%|█▉        | 72368/371472 [5:45:38<24:33:51,  3.38it/s]
 19%|█▉        | 72369/371472 [5:45:39<23:39:47,  3.51it/s]
 19%|█▉        | 72370/371472 [5:45:39<22:52:32,  3.63it/s]
 19%|█▉        | 72371/371472 [5:45:39<23:14:23,  3.58it/s]
 19%|█▉        | 72372/371472 [5:45:40<22:50:28,  3.64it/s]
 19%|█▉        | 72373/371472 [5:45:40<24:00:41,  3.46it/s]
 19%|█▉        | 72374/371472 [5:45:40<24:10:48,  3.44it/s]
 19%|█▉        | 72375/371472 [5:45:40<25:34:14,  3.25it/s]
 19%|█▉        | 72376/371472 [5:45:41<26:10:53,  3.17it/s]
 19%|█▉        | 72377/371472 [5:45:41<25:24:46,  3.27it/s]
 19%|█▉        | 72378/371472 [5:45:41<25:13:13,  3.29it/s]
 19%|█▉        | 72379/371472 [5:45:42<24:16:57,  3.42it/s]
 19%|█▉        | 72380/371472 [5:45:42<23:12:31,  3.58it/s]
                                                           
{'loss': 4.2144, 'learning_rate': 8.250285504966708e-07, 'epoch': 3.12}

 19%|█▉        | 72380/371472 [5:45:42<23:12:31,  3.58it/s]
 19%|█▉        | 72381/371472 [5:45:42<22:39:12,  3.67it/s]
 19%|█▉        | 72382/371472 [5:45:42<22:39:08,  3.67it/s]
 19%|█▉        | 72383/371472 [5:45:43<22:20:24,  3.72it/s]
 19%|█▉        | 72384/371472 [5:45:43<24:57:28,  3.33it/s]
 19%|█▉        | 72385/371472 [5:45:43<24:19:39,  3.42it/s]
 19%|█▉        | 72386/371472 [5:45:44<23:30:34,  3.53it/s]
 19%|█▉        | 72387/371472 [5:45:44<22:37:21,  3.67it/s]
 19%|█▉        | 72388/371472 [5:45:44<22:29:29,  3.69it/s]
 19%|█▉        | 72389/371472 [5:45:44<23:25:38,  3.55it/s]
 19%|█▉        | 72390/371472 [5:45:45<22:45:06,  3.65it/s]
 19%|█▉        | 72391/371472 [5:45:45<22:51:25,  3.63it/s]
 19%|█▉        | 72392/371472 [5:45:45<23:28:36,  3.54it/s]
 19%|█▉        | 72393/371472 [5:45:46<24:20:39,  3.41it/s]
 19%|█▉        | 72394/371472 [5:45:46<23:56:49,  3.47it/s]
 19%|█▉        | 72395/371472 [5:45:46<25:21:49,  3.28it/s]
 19%|█▉        | 72396/371472 [5:45:46<24:26:32,  3.40it/s]
 19%|█▉        | 72397/371472 [5:45:47<24:42:21,  3.36it/s]
 19%|█▉        | 72398/371472 [5:45:47<23:43:49,  3.50it/s]
 19%|█▉        | 72399/371472 [5:45:47<23:19:59,  3.56it/s]
 19%|█▉        | 72400/371472 [5:45:48<22:13:43,  3.74it/s]
                                                           
{'loss': 4.0097, 'learning_rate': 8.24980068521192e-07, 'epoch': 3.12}

 19%|█▉        | 72400/371472 [5:45:48<22:13:43,  3.74it/s]
 19%|█▉        | 72401/371472 [5:45:48<21:29:35,  3.87it/s]
 19%|█▉        | 72402/371472 [5:45:48<21:15:55,  3.91it/s]
 19%|█▉        | 72403/371472 [5:45:48<22:32:06,  3.69it/s]
 19%|█▉        | 72404/371472 [5:45:49<24:27:54,  3.40it/s]
 19%|█▉        | 72405/371472 [5:45:49<25:21:38,  3.28it/s]
 19%|█▉        | 72406/371472 [5:45:49<24:34:43,  3.38it/s]
 19%|█▉        | 72407/371472 [5:45:50<23:38:25,  3.51it/s]
 19%|█▉        | 72408/371472 [5:45:50<24:05:35,  3.45it/s]
 19%|█▉        | 72409/371472 [5:45:50<25:23:59,  3.27it/s]
 19%|█▉        | 72410/371472 [5:45:50<24:07:39,  3.44it/s]
 19%|█▉        | 72411/371472 [5:45:51<25:49:10,  3.22it/s]
 19%|█▉        | 72412/371472 [5:45:51<24:23:22,  3.41it/s]
 19%|█▉        | 72413/371472 [5:45:51<23:30:06,  3.53it/s]
 19%|█▉        | 72414/371472 [5:45:52<22:12:57,  3.74it/s]
 19%|█▉        | 72415/371472 [5:45:52<21:57:35,  3.78it/s]
 19%|█▉        | 72416/371472 [5:45:52<22:32:34,  3.69it/s]
 19%|█▉        | 72417/371472 [5:45:52<22:44:26,  3.65it/s]
 19%|█▉        | 72418/371472 [5:45:53<24:24:01,  3.40it/s]
 19%|█▉        | 72419/371472 [5:45:53<25:29:06,  3.26it/s]
 19%|█▉        | 72420/371472 [5:45:53<23:40:20,  3.51it/s]
                                                           
{'loss': 3.9143, 'learning_rate': 8.24931586545713e-07, 'epoch': 3.12}

 19%|█▉        | 72420/371472 [5:45:53<23:40:20,  3.51it/s]
 19%|█▉        | 72421/371472 [5:45:54<23:18:43,  3.56it/s]
 19%|█▉        | 72422/371472 [5:45:54<23:32:20,  3.53it/s]
 19%|█▉        | 72423/371472 [5:45:54<23:31:14,  3.53it/s]
 19%|█▉        | 72424/371472 [5:45:54<22:33:50,  3.68it/s]
 19%|█▉        | 72425/371472 [5:45:55<21:44:19,  3.82it/s]
 19%|█▉        | 72426/371472 [5:45:55<22:24:38,  3.71it/s]
 19%|█▉        | 72427/371472 [5:45:55<22:10:18,  3.75it/s]
 19%|█▉        | 72428/371472 [5:45:55<21:40:45,  3.83it/s]
 19%|█▉        | 72429/371472 [5:45:56<21:11:21,  3.92it/s]
 19%|█▉        | 72430/371472 [5:45:56<21:47:17,  3.81it/s]
 19%|█▉        | 72431/371472 [5:45:56<23:41:27,  3.51it/s]
 19%|█▉        | 72432/371472 [5:45:57<23:21:30,  3.56it/s]
 19%|█▉        | 72433/371472 [5:45:57<23:11:05,  3.58it/s]
 19%|█▉        | 72434/371472 [5:45:57<22:19:31,  3.72it/s]
 19%|█▉        | 72435/371472 [5:45:57<22:25:09,  3.71it/s]
 19%|█▉        | 72436/371472 [5:45:58<22:08:44,  3.75it/s]
 19%|█▉        | 72437/371472 [5:45:58<21:40:18,  3.83it/s]
 20%|█▉        | 72438/371472 [5:45:58<21:44:43,  3.82it/s]
 20%|█▉        | 72439/371472 [5:45:58<21:47:26,  3.81it/s]
 20%|█▉        | 72440/371472 [5:45:59<21:21:03,  3.89it/s]
                                                           
{'loss': 4.2846, 'learning_rate': 8.248831045702342e-07, 'epoch': 3.12}

 20%|█▉        | 72440/371472 [5:45:59<21:21:03,  3.89it/s]
 20%|█▉        | 72441/371472 [5:45:59<22:10:41,  3.75it/s]
 20%|█▉        | 72442/371472 [5:45:59<22:02:12,  3.77it/s]
 20%|█▉        | 72443/371472 [5:45:59<22:08:15,  3.75it/s]
 20%|█▉        | 72444/371472 [5:46:00<22:16:02,  3.73it/s]
 20%|█▉        | 72445/371472 [5:46:00<22:32:45,  3.68it/s]
 20%|█▉        | 72446/371472 [5:46:00<22:02:12,  3.77it/s]
 20%|█▉        | 72447/371472 [5:46:01<23:29:23,  3.54it/s]
 20%|█▉        | 72448/371472 [5:46:01<22:39:53,  3.66it/s]
 20%|█▉        | 72449/371472 [5:46:01<23:53:49,  3.48it/s]
 20%|█▉        | 72450/371472 [5:46:01<23:48:20,  3.49it/s]
 20%|█▉        | 72451/371472 [5:46:02<22:42:28,  3.66it/s]
 20%|█▉        | 72452/371472 [5:46:02<22:57:57,  3.62it/s]
 20%|█▉        | 72453/371472 [5:46:02<23:26:41,  3.54it/s]
 20%|█▉        | 72454/371472 [5:46:03<23:38:29,  3.51it/s]
 20%|█▉        | 72455/371472 [5:46:03<23:14:35,  3.57it/s]
 20%|█▉        | 72456/371472 [5:46:03<24:10:14,  3.44it/s]
 20%|█▉        | 72457/371472 [5:46:03<23:09:17,  3.59it/s]
 20%|█▉        | 72458/371472 [5:46:04<23:40:58,  3.51it/s]
 20%|█▉        | 72459/371472 [5:46:04<24:34:14,  3.38it/s]
 20%|█▉        | 72460/371472 [5:46:04<24:46:28,  3.35it/s]
                                                           
{'loss': 4.1769, 'learning_rate': 8.248346225947552e-07, 'epoch': 3.12}

 20%|█▉        | 72460/371472 [5:46:04<24:46:28,  3.35it/s]
 20%|█▉        | 72461/371472 [5:46:05<25:09:06,  3.30it/s]
 20%|█▉        | 72462/371472 [5:46:05<24:03:25,  3.45it/s]
 20%|█▉        | 72463/371472 [5:46:05<24:03:20,  3.45it/s]
 20%|█▉        | 72464/371472 [5:46:05<23:47:54,  3.49it/s]
 20%|█▉        | 72465/371472 [5:46:06<23:17:16,  3.57it/s]
 20%|█▉        | 72466/371472 [5:46:06<23:05:04,  3.60it/s]
 20%|█▉        | 72467/371472 [5:46:06<23:17:56,  3.56it/s]
 20%|█▉        | 72468/371472 [5:46:07<23:12:49,  3.58it/s]
 20%|█▉        | 72469/371472 [5:46:07<23:13:01,  3.58it/s]
 20%|█▉        | 72470/371472 [5:46:07<23:51:40,  3.48it/s]
 20%|█▉        | 72471/371472 [5:46:07<25:07:25,  3.31it/s]
 20%|█▉        | 72472/371472 [5:46:08<25:29:06,  3.26it/s]
 20%|█▉        | 72473/371472 [5:46:08<24:53:41,  3.34it/s]
 20%|█▉        | 72474/371472 [5:46:08<25:30:02,  3.26it/s]
 20%|█▉        | 72475/371472 [5:46:09<26:06:17,  3.18it/s]
 20%|█▉        | 72476/371472 [5:46:09<24:33:15,  3.38it/s]
 20%|█▉        | 72477/371472 [5:46:09<23:38:27,  3.51it/s]
 20%|█▉        | 72478/371472 [5:46:09<22:57:32,  3.62it/s]
 20%|█▉        | 72479/371472 [5:46:10<22:42:22,  3.66it/s]
 20%|█▉        | 72480/371472 [5:46:10<22:11:05,  3.74it/s]
                                                           
{'loss': 4.1483, 'learning_rate': 8.247861406192764e-07, 'epoch': 3.12}

 20%|█▉        | 72480/371472 [5:46:10<22:11:05,  3.74it/s]
 20%|█▉        | 72481/371472 [5:46:10<21:36:33,  3.84it/s]
 20%|█▉        | 72482/371472 [5:46:11<21:43:42,  3.82it/s]
 20%|█▉        | 72483/371472 [5:46:11<23:11:44,  3.58it/s]
 20%|█▉        | 72484/371472 [5:46:11<22:42:30,  3.66it/s]
 20%|█▉        | 72485/371472 [5:46:11<23:27:17,  3.54it/s]
 20%|█▉        | 72486/371472 [5:46:12<23:45:18,  3.50it/s]
 20%|█▉        | 72487/371472 [5:46:12<23:00:18,  3.61it/s]
 20%|█▉        | 72488/371472 [5:46:12<23:05:11,  3.60it/s]
 20%|█▉        | 72489/371472 [5:46:12<23:04:32,  3.60it/s]
 20%|█▉        | 72490/371472 [5:46:13<22:58:01,  3.62it/s]
 20%|█▉        | 72491/371472 [5:46:13<22:59:25,  3.61it/s]
 20%|█▉        | 72492/371472 [5:46:13<22:29:28,  3.69it/s]
 20%|█▉        | 72493/371472 [5:46:14<22:02:20,  3.77it/s]
 20%|█▉        | 72494/371472 [5:46:14<22:27:20,  3.70it/s]
 20%|█▉        | 72495/371472 [5:46:14<23:08:44,  3.59it/s]
 20%|█▉        | 72496/371472 [5:46:14<22:44:04,  3.65it/s]
 20%|█▉        | 72497/371472 [5:46:15<22:14:26,  3.73it/s]
 20%|█▉        | 72498/371472 [5:46:15<22:21:21,  3.71it/s]
 20%|█▉        | 72499/371472 [5:46:15<24:04:37,  3.45it/s]
 20%|█▉        | 72500/371472 [5:46:16<23:44:03,  3.50it/s]
                                                           
{'loss': 4.0892, 'learning_rate': 8.247376586437976e-07, 'epoch': 3.12}

 20%|█▉        | 72500/371472 [5:46:16<23:44:03,  3.50it/s]
 20%|█▉        | 72501/371472 [5:46:16<23:45:47,  3.49it/s]
 20%|█▉        | 72502/371472 [5:46:16<23:11:31,  3.58it/s]
 20%|█▉        | 72503/371472 [5:46:16<23:08:11,  3.59it/s]
 20%|█▉        | 72504/371472 [5:46:17<22:49:34,  3.64it/s]
 20%|█▉        | 72505/371472 [5:46:17<22:16:22,  3.73it/s]
 20%|█▉        | 72506/371472 [5:46:17<22:16:55,  3.73it/s]
 20%|█▉        | 72507/371472 [5:46:17<23:23:33,  3.55it/s]
 20%|█▉        | 72508/371472 [5:46:18<24:00:32,  3.46it/s]
 20%|█▉        | 72509/371472 [5:46:18<24:26:15,  3.40it/s]
 20%|█▉        | 72510/371472 [5:46:18<24:25:27,  3.40it/s]
 20%|█▉        | 72511/371472 [5:46:19<24:02:49,  3.45it/s]
 20%|█▉        | 72512/371472 [5:46:19<25:18:29,  3.28it/s]
 20%|█▉        | 72513/371472 [5:46:19<25:31:20,  3.25it/s]
 20%|█▉        | 72514/371472 [5:46:20<24:25:42,  3.40it/s]
 20%|█▉        | 72515/371472 [5:46:20<25:42:52,  3.23it/s]
 20%|█▉        | 72516/371472 [5:46:20<25:26:06,  3.26it/s]
 20%|█▉        | 72517/371472 [5:46:20<23:44:06,  3.50it/s]
 20%|█▉        | 72518/371472 [5:46:21<23:12:11,  3.58it/s]
 20%|█▉        | 72519/371472 [5:46:21<23:38:05,  3.51it/s]
 20%|█▉        | 72520/371472 [5:46:21<24:40:49,  3.36it/s]
                                                           
{'loss': 4.2878, 'learning_rate': 8.246891766683188e-07, 'epoch': 3.12}

 20%|█▉        | 72520/371472 [5:46:21<24:40:49,  3.36it/s]
 20%|█▉        | 72521/371472 [5:46:22<23:17:42,  3.56it/s]
 20%|█▉        | 72522/371472 [5:46:22<24:02:22,  3.45it/s]
 20%|█▉        | 72523/371472 [5:46:22<24:40:43,  3.36it/s]
 20%|█▉        | 72524/371472 [5:46:22<23:17:34,  3.57it/s]
 20%|█▉        | 72525/371472 [5:46:23<24:31:48,  3.39it/s]
 20%|█▉        | 72526/371472 [5:46:23<23:50:14,  3.48it/s]
 20%|█▉        | 72527/371472 [5:46:23<24:12:45,  3.43it/s]
 20%|█▉        | 72528/371472 [5:46:24<23:53:18,  3.48it/s]
 20%|█▉        | 72529/371472 [5:46:24<25:22:55,  3.27it/s]
 20%|█▉        | 72530/371472 [5:46:24<24:05:32,  3.45it/s]
 20%|█▉        | 72531/371472 [5:46:25<24:34:25,  3.38it/s]
 20%|█▉        | 72532/371472 [5:46:25<23:48:59,  3.49it/s]
 20%|█▉        | 72533/371472 [5:46:25<22:59:09,  3.61it/s]
 20%|█▉        | 72534/371472 [5:46:25<22:47:53,  3.64it/s]
 20%|█▉        | 72535/371472 [5:46:26<24:01:48,  3.46it/s]
 20%|█▉        | 72536/371472 [5:46:26<24:52:51,  3.34it/s]
 20%|█▉        | 72537/371472 [5:46:26<24:34:40,  3.38it/s]
 20%|█▉        | 72538/371472 [5:46:27<25:17:11,  3.28it/s]
 20%|█▉        | 72539/371472 [5:46:27<24:27:25,  3.40it/s]
 20%|█▉        | 72540/371472 [5:46:27<23:15:01,  3.57it/s]
                                                           
{'loss': 4.2783, 'learning_rate': 8.246406946928396e-07, 'epoch': 3.12}

 20%|█▉        | 72540/371472 [5:46:27<23:15:01,  3.57it/s]
 20%|█▉        | 72541/371472 [5:46:27<23:23:32,  3.55it/s]
 20%|█▉        | 72542/371472 [5:46:28<22:46:10,  3.65it/s]
 20%|█▉        | 72543/371472 [5:46:28<22:49:28,  3.64it/s]
 20%|█▉        | 72544/371472 [5:46:28<25:16:40,  3.28it/s]
 20%|█▉        | 72545/371472 [5:46:29<24:44:18,  3.36it/s]
 20%|█▉        | 72546/371472 [5:46:29<25:07:24,  3.31it/s]
 20%|█▉        | 72547/371472 [5:46:29<25:58:19,  3.20it/s]
 20%|█▉        | 72548/371472 [5:46:30<25:33:10,  3.25it/s]
 20%|█▉        | 72549/371472 [5:46:30<23:43:42,  3.50it/s]
 20%|█▉        | 72550/371472 [5:46:30<22:29:31,  3.69it/s]
 20%|█▉        | 72551/371472 [5:46:30<23:03:50,  3.60it/s]
 20%|█▉        | 72552/371472 [5:46:31<23:13:56,  3.57it/s]
 20%|█▉        | 72553/371472 [5:46:31<24:02:35,  3.45it/s]
 20%|█▉        | 72554/371472 [5:46:31<25:24:08,  3.27it/s]
 20%|█▉        | 72555/371472 [5:46:32<26:53:52,  3.09it/s]
 20%|█▉        | 72556/371472 [5:46:32<25:32:26,  3.25it/s]
 20%|█▉        | 72557/371472 [5:46:32<24:08:27,  3.44it/s]
 20%|█▉        | 72558/371472 [5:46:32<23:44:54,  3.50it/s]
 20%|█▉        | 72559/371472 [5:46:33<23:08:05,  3.59it/s]
 20%|█▉        | 72560/371472 [5:46:33<22:56:37,  3.62it/s]
                                                           
{'loss': 4.2123, 'learning_rate': 8.245922127173608e-07, 'epoch': 3.13}

 20%|█▉        | 72560/371472 [5:46:33<22:56:37,  3.62it/s]
 20%|█▉        | 72561/371472 [5:46:33<22:02:52,  3.77it/s]
 20%|█▉        | 72562/371472 [5:46:33<21:43:18,  3.82it/s]
 20%|█▉        | 72563/371472 [5:46:34<23:11:10,  3.58it/s]
 20%|█▉        | 72564/371472 [5:46:34<22:09:50,  3.75it/s]
 20%|█▉        | 72565/371472 [5:46:34<22:06:56,  3.75it/s]
 20%|█▉        | 72566/371472 [5:46:35<27:15:20,  3.05it/s]
 20%|█▉        | 72567/371472 [5:46:35<25:24:17,  3.27it/s]
 20%|█▉        | 72568/371472 [5:46:35<24:57:20,  3.33it/s]
 20%|█▉        | 72569/371472 [5:46:36<24:21:31,  3.41it/s]
 20%|█▉        | 72570/371472 [5:46:36<24:09:07,  3.44it/s]
 20%|█▉        | 72571/371472 [5:46:36<24:17:15,  3.42it/s]
 20%|█▉        | 72572/371472 [5:46:36<24:03:42,  3.45it/s]
 20%|█▉        | 72573/371472 [5:46:37<23:39:12,  3.51it/s]
 20%|█▉        | 72574/371472 [5:46:37<24:12:52,  3.43it/s]
 20%|█▉        | 72575/371472 [5:46:37<23:24:35,  3.55it/s]
 20%|█▉        | 72576/371472 [5:46:38<23:07:36,  3.59it/s]
 20%|█▉        | 72577/371472 [5:46:38<22:38:34,  3.67it/s]
 20%|█▉        | 72578/371472 [5:46:38<22:15:06,  3.73it/s]
 20%|█▉        | 72579/371472 [5:46:38<22:31:11,  3.69it/s]
 20%|█▉        | 72580/371472 [5:46:39<22:46:38,  3.65it/s]
                                                           
{'loss': 4.2162, 'learning_rate': 8.245437307418819e-07, 'epoch': 3.13}

 20%|█▉        | 72580/371472 [5:46:39<22:46:38,  3.65it/s]
 20%|█▉        | 72581/371472 [5:46:39<22:53:42,  3.63it/s]
 20%|█▉        | 72582/371472 [5:46:39<24:47:00,  3.35it/s]
 20%|█▉        | 72583/371472 [5:46:40<25:37:07,  3.24it/s]
 20%|█▉        | 72584/371472 [5:46:40<23:56:59,  3.47it/s]
 20%|█▉        | 72585/371472 [5:46:40<23:52:52,  3.48it/s]
 20%|█▉        | 72586/371472 [5:46:40<22:58:41,  3.61it/s]
 20%|█▉        | 72587/371472 [5:46:41<22:49:56,  3.64it/s]
 20%|█▉        | 72588/371472 [5:46:41<24:32:36,  3.38it/s]
 20%|█▉        | 72589/371472 [5:46:41<26:25:39,  3.14it/s]
 20%|█▉        | 72590/371472 [5:46:42<25:54:32,  3.20it/s]
 20%|█▉        | 72591/371472 [5:46:42<24:43:14,  3.36it/s]
 20%|█▉        | 72592/371472 [5:46:42<24:22:25,  3.41it/s]
 20%|█▉        | 72593/371472 [5:46:42<24:06:40,  3.44it/s]
 20%|█▉        | 72594/371472 [5:46:43<23:06:22,  3.59it/s]
 20%|█▉        | 72595/371472 [5:46:43<22:38:38,  3.67it/s]
 20%|█▉        | 72596/371472 [5:46:43<23:21:29,  3.55it/s]
 20%|█▉        | 72597/371472 [5:46:44<22:38:00,  3.67it/s]
 20%|█▉        | 72598/371472 [5:46:44<22:35:58,  3.67it/s]
 20%|█▉        | 72599/371472 [5:46:44<24:31:39,  3.38it/s]
 20%|█▉        | 72600/371472 [5:46:44<23:38:14,  3.51it/s]
                                                           
{'loss': 4.0662, 'learning_rate': 8.244952487664031e-07, 'epoch': 3.13}

 20%|█▉        | 72600/371472 [5:46:44<23:38:14,  3.51it/s]
 20%|█▉        | 72601/371472 [5:46:45<22:40:28,  3.66it/s]
 20%|█▉        | 72602/371472 [5:46:45<24:39:47,  3.37it/s]
 20%|█▉        | 72603/371472 [5:46:45<23:37:47,  3.51it/s]
 20%|█▉        | 72604/371472 [5:46:46<23:43:34,  3.50it/s]
 20%|█▉        | 72605/371472 [5:46:46<23:33:38,  3.52it/s]
 20%|█▉        | 72606/371472 [5:46:46<23:51:50,  3.48it/s]
 20%|█▉        | 72607/371472 [5:46:46<23:44:22,  3.50it/s]
 20%|█▉        | 72608/371472 [5:46:47<23:15:09,  3.57it/s]
 20%|█▉        | 72609/371472 [5:46:47<23:23:26,  3.55it/s]
 20%|█▉        | 72610/371472 [5:46:47<22:19:45,  3.72it/s]
 20%|█▉        | 72611/371472 [5:46:47<22:05:08,  3.76it/s]
 20%|█▉        | 72612/371472 [5:46:48<22:46:42,  3.64it/s]
 20%|█▉        | 72613/371472 [5:46:48<25:10:22,  3.30it/s]
 20%|█▉        | 72614/371472 [5:46:48<25:51:23,  3.21it/s]
 20%|█▉        | 72615/371472 [5:46:49<24:43:11,  3.36it/s]
 20%|█▉        | 72616/371472 [5:46:49<23:16:08,  3.57it/s]
 20%|█▉        | 72617/371472 [5:46:49<22:50:22,  3.63it/s]
 20%|█▉        | 72618/371472 [5:46:50<23:32:05,  3.53it/s]
 20%|█▉        | 72619/371472 [5:46:50<22:58:49,  3.61it/s]
 20%|█▉        | 72620/371472 [5:46:50<22:37:37,  3.67it/s]
                                                           
{'loss': 4.1451, 'learning_rate': 8.244467667909241e-07, 'epoch': 3.13}

 20%|█▉        | 72620/371472 [5:46:50<22:37:37,  3.67it/s]
 20%|█▉        | 72621/371472 [5:46:50<21:59:19,  3.78it/s]
 20%|█▉        | 72622/371472 [5:46:51<22:05:57,  3.76it/s]
 20%|█▉        | 72623/371472 [5:46:51<23:59:43,  3.46it/s]
 20%|█▉        | 72624/371472 [5:46:51<23:39:02,  3.51it/s]
 20%|█▉        | 72625/371472 [5:46:51<24:13:14,  3.43it/s]
 20%|█▉        | 72626/371472 [5:46:52<26:48:45,  3.10it/s]
 20%|█▉        | 72627/371472 [5:46:52<25:33:13,  3.25it/s]
 20%|█▉        | 72628/371472 [5:46:52<25:40:32,  3.23it/s]
 20%|█▉        | 72629/371472 [5:46:53<26:16:49,  3.16it/s]
 20%|█▉        | 72630/371472 [5:46:53<26:06:55,  3.18it/s]
 20%|█▉        | 72631/371472 [5:46:53<25:26:03,  3.26it/s]
 20%|█▉        | 72632/371472 [5:46:54<24:48:42,  3.35it/s]
 20%|█▉        | 72633/371472 [5:46:54<23:59:32,  3.46it/s]
 20%|█▉        | 72634/371472 [5:46:54<23:02:16,  3.60it/s]
 20%|█▉        | 72635/371472 [5:46:54<23:09:07,  3.59it/s]
 20%|█▉        | 72636/371472 [5:46:55<22:46:08,  3.65it/s]
 20%|█▉        | 72637/371472 [5:46:55<22:13:26,  3.74it/s]
 20%|█▉        | 72638/371472 [5:46:55<23:19:59,  3.56it/s]
 20%|█▉        | 72639/371472 [5:46:56<22:56:36,  3.62it/s]
 20%|█▉        | 72640/371472 [5:46:56<24:06:43,  3.44it/s]
                                                           
{'loss': 3.9821, 'learning_rate': 8.243982848154453e-07, 'epoch': 3.13}

 20%|█▉        | 72640/371472 [5:46:56<24:06:43,  3.44it/s]
 20%|█▉        | 72641/371472 [5:46:56<23:34:28,  3.52it/s]
 20%|█▉        | 72642/371472 [5:46:56<22:55:06,  3.62it/s]
 20%|█▉        | 72643/371472 [5:46:57<22:14:30,  3.73it/s]
 20%|█▉        | 72644/371472 [5:46:57<22:46:01,  3.65it/s]
 20%|█▉        | 72645/371472 [5:46:57<27:14:54,  3.05it/s]
 20%|█▉        | 72646/371472 [5:46:58<27:41:48,  3.00it/s]
 20%|█▉        | 72647/371472 [5:46:58<25:48:34,  3.22it/s]
 20%|█▉        | 72648/371472 [5:46:58<24:44:48,  3.35it/s]
 20%|█▉        | 72649/371472 [5:46:59<23:27:45,  3.54it/s]
 20%|█▉        | 72650/371472 [5:46:59<23:35:52,  3.52it/s]
 20%|█▉        | 72651/371472 [5:46:59<23:15:18,  3.57it/s]
 20%|█▉        | 72652/371472 [5:46:59<23:19:29,  3.56it/s]
 20%|█▉        | 72653/371472 [5:47:00<22:53:33,  3.63it/s]
 20%|█▉        | 72654/371472 [5:47:00<22:20:11,  3.72it/s]
 20%|█▉        | 72655/371472 [5:47:00<22:27:36,  3.70it/s]
 20%|█▉        | 72656/371472 [5:47:00<22:15:00,  3.73it/s]
 20%|█▉        | 72657/371472 [5:47:01<22:26:59,  3.70it/s]
 20%|█▉        | 72658/371472 [5:47:01<22:19:53,  3.72it/s]
 20%|█▉        | 72659/371472 [5:47:01<21:48:55,  3.80it/s]
 20%|█▉        | 72660/371472 [5:47:01<21:59:40,  3.77it/s]
                                                           
{'loss': 4.0284, 'learning_rate': 8.243498028399663e-07, 'epoch': 3.13}

 20%|█▉        | 72660/371472 [5:47:01<21:59:40,  3.77it/s]
 20%|█▉        | 72661/371472 [5:47:02<22:29:21,  3.69it/s]
 20%|█▉        | 72662/371472 [5:47:02<22:21:47,  3.71it/s]
 20%|█▉        | 72663/371472 [5:47:02<22:21:59,  3.71it/s]
 20%|█▉        | 72664/371472 [5:47:03<21:41:49,  3.83it/s]
 20%|█▉        | 72665/371472 [5:47:03<22:26:38,  3.70it/s]
 20%|█▉        | 72666/371472 [5:47:03<22:56:10,  3.62it/s]
 20%|█▉        | 72667/371472 [5:47:03<22:11:11,  3.74it/s]
 20%|█▉        | 72668/371472 [5:47:04<21:44:38,  3.82it/s]
 20%|█▉        | 72669/371472 [5:47:04<22:04:30,  3.76it/s]
 20%|█▉        | 72670/371472 [5:47:04<22:37:54,  3.67it/s]
 20%|█▉        | 72671/371472 [5:47:04<22:43:26,  3.65it/s]
 20%|█▉        | 72672/371472 [5:47:05<26:04:20,  3.18it/s]
 20%|█▉        | 72673/371472 [5:47:05<25:23:30,  3.27it/s]
 20%|█▉        | 72674/371472 [5:47:05<24:45:37,  3.35it/s]
 20%|█▉        | 72675/371472 [5:47:06<23:57:58,  3.46it/s]
 20%|█▉        | 72676/371472 [5:47:06<23:07:24,  3.59it/s]
 20%|█▉        | 72677/371472 [5:47:06<23:17:29,  3.56it/s]
 20%|█▉        | 72678/371472 [5:47:07<23:09:28,  3.58it/s]
 20%|█▉        | 72679/371472 [5:47:07<22:42:23,  3.66it/s]
 20%|█▉        | 72680/371472 [5:47:07<23:46:13,  3.49it/s]
                                                           
{'loss': 4.1408, 'learning_rate': 8.243013208644875e-07, 'epoch': 3.13}

 20%|█▉        | 72680/371472 [5:47:07<23:46:13,  3.49it/s]
 20%|█▉        | 72681/371472 [5:47:07<25:06:06,  3.31it/s]
 20%|█▉        | 72682/371472 [5:47:08<23:31:29,  3.53it/s]
 20%|█▉        | 72683/371472 [5:47:08<23:08:15,  3.59it/s]
 20%|█▉        | 72684/371472 [5:47:08<22:33:34,  3.68it/s]
 20%|█▉        | 72685/371472 [5:47:08<22:31:35,  3.68it/s]
 20%|█▉        | 72686/371472 [5:47:09<22:19:53,  3.72it/s]
 20%|█▉        | 72687/371472 [5:47:09<22:18:01,  3.72it/s]
 20%|█▉        | 72688/371472 [5:47:09<23:13:25,  3.57it/s]
 20%|█▉        | 72689/371472 [5:47:10<22:35:59,  3.67it/s]
 20%|█▉        | 72690/371472 [5:47:10<22:42:24,  3.66it/s]
 20%|█▉        | 72691/371472 [5:47:10<21:53:22,  3.79it/s]
 20%|█▉        | 72692/371472 [5:47:10<22:20:30,  3.71it/s]
 20%|█▉        | 72693/371472 [5:47:11<23:16:06,  3.57it/s]
 20%|█▉        | 72694/371472 [5:47:11<24:24:11,  3.40it/s]
 20%|█▉        | 72695/371472 [5:47:11<24:11:24,  3.43it/s]
 20%|█▉        | 72696/371472 [5:47:12<25:07:37,  3.30it/s]
 20%|█▉        | 72697/371472 [5:47:12<24:47:24,  3.35it/s]
 20%|█▉        | 72698/371472 [5:47:12<26:21:03,  3.15it/s]
 20%|█▉        | 72699/371472 [5:47:13<24:46:41,  3.35it/s]
 20%|█▉        | 72700/371472 [5:47:13<26:55:10,  3.08it/s]
                                                           
{'loss': 4.0879, 'learning_rate': 8.242528388890085e-07, 'epoch': 3.13}

 20%|█▉        | 72700/371472 [5:47:13<26:55:10,  3.08it/s]
 20%|█▉        | 72701/371472 [5:47:13<27:19:46,  3.04it/s]
 20%|█▉        | 72702/371472 [5:47:13<25:47:57,  3.22it/s]
 20%|█▉        | 72703/371472 [5:47:14<25:57:30,  3.20it/s]
 20%|█▉        | 72704/371472 [5:47:14<25:12:57,  3.29it/s]
 20%|█▉        | 72705/371472 [5:47:14<24:21:51,  3.41it/s]
 20%|█▉        | 72706/371472 [5:47:15<24:24:20,  3.40it/s]
 20%|█▉        | 72707/371472 [5:47:15<24:24:08,  3.40it/s]
 20%|█▉        | 72708/371472 [5:47:15<23:31:08,  3.53it/s]
 20%|█▉        | 72709/371472 [5:47:16<24:26:33,  3.40it/s]
 20%|█▉        | 72710/371472 [5:47:16<23:28:40,  3.53it/s]
 20%|█▉        | 72711/371472 [5:47:16<24:05:10,  3.45it/s]
 20%|█▉        | 72712/371472 [5:47:16<23:18:09,  3.56it/s]
 20%|█▉        | 72713/371472 [5:47:17<22:35:41,  3.67it/s]
 20%|█▉        | 72714/371472 [5:47:17<22:48:15,  3.64it/s]
 20%|█▉        | 72715/371472 [5:47:17<22:57:42,  3.61it/s]
 20%|█▉        | 72716/371472 [5:47:17<22:36:46,  3.67it/s]
 20%|█▉        | 72717/371472 [5:47:18<22:24:27,  3.70it/s]
 20%|█▉        | 72718/371472 [5:47:18<22:54:03,  3.62it/s]
 20%|█▉        | 72719/371472 [5:47:18<23:14:39,  3.57it/s]
 20%|█▉        | 72720/371472 [5:47:19<22:50:09,  3.63it/s]
                                                           
{'loss': 4.2258, 'learning_rate': 8.242043569135297e-07, 'epoch': 3.13}

 20%|█▉        | 72720/371472 [5:47:19<22:50:09,  3.63it/s]
 20%|█▉        | 72721/371472 [5:47:19<22:25:30,  3.70it/s]
 20%|█▉        | 72722/371472 [5:47:19<24:40:45,  3.36it/s]
 20%|█▉        | 72723/371472 [5:47:19<23:41:32,  3.50it/s]
 20%|█▉        | 72724/371472 [5:47:20<23:29:46,  3.53it/s]
 20%|█▉        | 72725/371472 [5:47:20<23:02:15,  3.60it/s]
 20%|█▉        | 72726/371472 [5:47:20<25:16:13,  3.28it/s]
 20%|█▉        | 72727/371472 [5:47:21<24:51:29,  3.34it/s]
 20%|█▉        | 72728/371472 [5:47:21<25:58:37,  3.19it/s]
 20%|█▉        | 72729/371472 [5:47:21<24:58:19,  3.32it/s]
 20%|█▉        | 72730/371472 [5:47:22<24:43:10,  3.36it/s]
 20%|█▉        | 72731/371472 [5:47:22<24:32:09,  3.38it/s]
 20%|█▉        | 72732/371472 [5:47:22<24:26:10,  3.40it/s]
 20%|█▉        | 72733/371472 [5:47:22<23:11:50,  3.58it/s]
 20%|█▉        | 72734/371472 [5:47:23<22:27:15,  3.70it/s]
 20%|█▉        | 72735/371472 [5:47:23<22:16:38,  3.72it/s]
 20%|█▉        | 72736/371472 [5:47:23<22:16:13,  3.73it/s]
 20%|█▉        | 72737/371472 [5:47:23<23:16:30,  3.57it/s]
 20%|█▉        | 72738/371472 [5:47:24<23:28:02,  3.54it/s]
 20%|█▉        | 72739/371472 [5:47:24<22:38:34,  3.66it/s]
 20%|█▉        | 72740/371472 [5:47:24<24:32:55,  3.38it/s]
                                                           
{'loss': 4.1793, 'learning_rate': 8.241558749380508e-07, 'epoch': 3.13}

 20%|█▉        | 72740/371472 [5:47:24<24:32:55,  3.38it/s]
 20%|█▉        | 72741/371472 [5:47:25<24:05:08,  3.45it/s]
 20%|█▉        | 72742/371472 [5:47:25<22:40:51,  3.66it/s]
 20%|█▉        | 72743/371472 [5:47:25<23:39:16,  3.51it/s]
 20%|█▉        | 72744/371472 [5:47:25<24:08:48,  3.44it/s]
 20%|█▉        | 72745/371472 [5:47:26<24:08:30,  3.44it/s]
 20%|█▉        | 72746/371472 [5:47:26<24:08:21,  3.44it/s]
 20%|█▉        | 72747/371472 [5:47:26<23:22:14,  3.55it/s]
 20%|█▉        | 72748/371472 [5:47:27<23:48:17,  3.49it/s]
 20%|█▉        | 72749/371472 [5:47:27<25:15:37,  3.28it/s]
 20%|█▉        | 72750/371472 [5:47:27<23:43:59,  3.50it/s]
 20%|█▉        | 72751/371472 [5:47:27<23:14:05,  3.57it/s]
 20%|█▉        | 72752/371472 [5:47:28<25:16:19,  3.28it/s]
 20%|█▉        | 72753/371472 [5:47:28<26:17:17,  3.16it/s]
 20%|█▉        | 72754/371472 [5:47:28<25:37:27,  3.24it/s]
 20%|█▉        | 72755/371472 [5:47:29<24:06:55,  3.44it/s]
 20%|█▉        | 72756/371472 [5:47:29<23:03:29,  3.60it/s]
 20%|█▉        | 72757/371472 [5:47:29<23:39:30,  3.51it/s]
 20%|█▉        | 72758/371472 [5:47:29<22:35:31,  3.67it/s]
 20%|█▉        | 72759/371472 [5:47:30<22:54:47,  3.62it/s]
 20%|█▉        | 72760/371472 [5:47:30<22:27:31,  3.69it/s]
                                                           
{'loss': 4.1964, 'learning_rate': 8.24107392962572e-07, 'epoch': 3.13}

 20%|█▉        | 72760/371472 [5:47:30<22:27:31,  3.69it/s]
 20%|█▉        | 72761/371472 [5:47:30<21:44:28,  3.82it/s]
 20%|█▉        | 72762/371472 [5:47:31<24:02:49,  3.45it/s]
 20%|█▉        | 72763/371472 [5:47:31<24:08:32,  3.44it/s]
 20%|█▉        | 72764/371472 [5:47:31<24:56:28,  3.33it/s]
 20%|█▉        | 72765/371472 [5:47:32<25:19:42,  3.28it/s]
 20%|█▉        | 72766/371472 [5:47:32<25:42:50,  3.23it/s]
 20%|█▉        | 72767/371472 [5:47:32<25:03:46,  3.31it/s]
 20%|█▉        | 72768/371472 [5:47:32<24:56:06,  3.33it/s]
 20%|█▉        | 72769/371472 [5:47:33<23:27:22,  3.54it/s]
 20%|█▉        | 72770/371472 [5:47:33<23:39:38,  3.51it/s]
 20%|█▉        | 72771/371472 [5:47:33<24:32:10,  3.38it/s]
 20%|█▉        | 72772/371472 [5:47:34<27:19:54,  3.04it/s]
 20%|█▉        | 72773/371472 [5:47:34<26:38:03,  3.12it/s]
 20%|█▉        | 72774/371472 [5:47:34<25:19:23,  3.28it/s]
 20%|█▉        | 72775/371472 [5:47:35<24:49:22,  3.34it/s]
 20%|█▉        | 72776/371472 [5:47:35<23:06:20,  3.59it/s]
 20%|█▉        | 72777/371472 [5:47:35<23:54:23,  3.47it/s]
 20%|█▉        | 72778/371472 [5:47:35<24:25:22,  3.40it/s]
 20%|█▉        | 72779/371472 [5:47:36<25:20:29,  3.27it/s]
 20%|█▉        | 72780/371472 [5:47:36<23:41:40,  3.50it/s]
                                                           
{'loss': 3.9955, 'learning_rate': 8.24058910987093e-07, 'epoch': 3.13}

 20%|█▉        | 72780/371472 [5:47:36<23:41:40,  3.50it/s]
 20%|█▉        | 72781/371472 [5:47:36<22:53:56,  3.62it/s]
 20%|█▉        | 72782/371472 [5:47:37<24:18:53,  3.41it/s]
 20%|█▉        | 72783/371472 [5:47:37<23:07:58,  3.59it/s]
 20%|█▉        | 72784/371472 [5:47:37<22:23:21,  3.71it/s]
 20%|█▉        | 72785/371472 [5:47:37<22:05:29,  3.76it/s]
 20%|█▉        | 72786/371472 [5:47:38<22:31:06,  3.68it/s]
 20%|█▉        | 72787/371472 [5:47:38<22:28:39,  3.69it/s]
 20%|█▉        | 72788/371472 [5:47:38<24:09:56,  3.43it/s]
 20%|█▉        | 72789/371472 [5:47:38<23:14:41,  3.57it/s]
 20%|█▉        | 72790/371472 [5:47:39<23:08:21,  3.59it/s]
 20%|█▉        | 72791/371472 [5:47:39<23:22:58,  3.55it/s]
 20%|█▉        | 72792/371472 [5:47:39<23:13:19,  3.57it/s]
 20%|█▉        | 72793/371472 [5:47:40<22:45:49,  3.64it/s]
 20%|█▉        | 72794/371472 [5:47:40<22:35:15,  3.67it/s]
 20%|█▉        | 72795/371472 [5:47:40<22:54:31,  3.62it/s]
 20%|█▉        | 72796/371472 [5:47:40<24:35:19,  3.37it/s]
 20%|█▉        | 72797/371472 [5:47:41<24:23:15,  3.40it/s]
 20%|█▉        | 72798/371472 [5:47:41<24:19:22,  3.41it/s]
 20%|█▉        | 72799/371472 [5:47:41<24:21:55,  3.41it/s]
 20%|█▉        | 72800/371472 [5:47:42<22:59:51,  3.61it/s]
                                                           
{'loss': 4.1838, 'learning_rate': 8.240104290116141e-07, 'epoch': 3.14}

 20%|█▉        | 72800/371472 [5:47:42<22:59:51,  3.61it/s]
 20%|█▉        | 72801/371472 [5:47:42<22:33:48,  3.68it/s]
 20%|█▉        | 72802/371472 [5:47:42<24:19:46,  3.41it/s]
 20%|█▉        | 72803/371472 [5:47:42<23:44:51,  3.49it/s]
 20%|█▉        | 72804/371472 [5:47:43<23:15:42,  3.57it/s]
 20%|█▉        | 72805/371472 [5:47:43<23:11:06,  3.58it/s]
 20%|█▉        | 72806/371472 [5:47:43<24:21:58,  3.40it/s]
 20%|█▉        | 72807/371472 [5:47:44<22:50:02,  3.63it/s]
 20%|█▉        | 72808/371472 [5:47:44<25:31:36,  3.25it/s]
 20%|█▉        | 72809/371472 [5:47:44<26:25:53,  3.14it/s]
 20%|█▉        | 72810/371472 [5:47:45<26:03:23,  3.18it/s]
 20%|█▉        | 72811/371472 [5:47:45<24:34:33,  3.38it/s]
 20%|█▉        | 72812/371472 [5:47:45<25:27:11,  3.26it/s]
 20%|█▉        | 72813/371472 [5:47:45<24:39:40,  3.36it/s]
 20%|█▉        | 72814/371472 [5:47:46<24:18:07,  3.41it/s]
 20%|█▉        | 72815/371472 [5:47:46<24:21:20,  3.41it/s]
 20%|█▉        | 72816/371472 [5:47:46<23:28:54,  3.53it/s]
 20%|█▉        | 72817/371472 [5:47:47<22:53:04,  3.63it/s]
 20%|█▉        | 72818/371472 [5:47:47<22:22:52,  3.71it/s]
 20%|█▉        | 72819/371472 [5:47:47<23:02:07,  3.60it/s]
 20%|█▉        | 72820/371472 [5:47:47<22:24:59,  3.70it/s]
                                                           
{'loss': 4.0517, 'learning_rate': 8.239619470361352e-07, 'epoch': 3.14}

 20%|█▉        | 72820/371472 [5:47:47<22:24:59,  3.70it/s]
 20%|█▉        | 72821/371472 [5:47:48<22:33:01,  3.68it/s]
 20%|█▉        | 72822/371472 [5:47:48<23:45:44,  3.49it/s]
 20%|█▉        | 72823/371472 [5:47:48<26:17:06,  3.16it/s]
 20%|█▉        | 72824/371472 [5:47:49<25:26:07,  3.26it/s]
 20%|█▉        | 72825/371472 [5:47:49<25:13:37,  3.29it/s]
 20%|█▉        | 72826/371472 [5:47:49<24:54:55,  3.33it/s]
 20%|█▉        | 72827/371472 [5:47:49<24:04:18,  3.45it/s]
 20%|█▉        | 72828/371472 [5:47:50<25:00:59,  3.32it/s]
 20%|█▉        | 72829/371472 [5:47:50<23:35:56,  3.52it/s]
 20%|█▉        | 72830/371472 [5:47:50<23:42:11,  3.50it/s]
 20%|█▉        | 72831/371472 [5:47:51<22:24:38,  3.70it/s]
 20%|█▉        | 72832/371472 [5:47:51<23:00:03,  3.61it/s]
 20%|█▉        | 72833/371472 [5:47:51<22:29:17,  3.69it/s]
 20%|█▉        | 72834/371472 [5:47:51<24:19:44,  3.41it/s]
 20%|█▉        | 72835/371472 [5:47:52<23:07:59,  3.59it/s]
 20%|█▉        | 72836/371472 [5:47:52<22:39:46,  3.66it/s]
 20%|█▉        | 72837/371472 [5:47:52<23:08:09,  3.59it/s]
 20%|█▉        | 72838/371472 [5:47:53<24:03:27,  3.45it/s]
 20%|█▉        | 72839/371472 [5:47:53<23:17:21,  3.56it/s]
 20%|█▉        | 72840/371472 [5:47:53<22:22:49,  3.71it/s]
                                                           
{'loss': 4.2192, 'learning_rate': 8.239134650606563e-07, 'epoch': 3.14}

 20%|█▉        | 72840/371472 [5:47:53<22:22:49,  3.71it/s]
 20%|█▉        | 72841/371472 [5:47:53<22:15:22,  3.73it/s]
 20%|█▉        | 72842/371472 [5:47:54<22:02:22,  3.76it/s]
 20%|█▉        | 72843/371472 [5:47:54<22:50:15,  3.63it/s]
 20%|█▉        | 72844/371472 [5:47:54<24:39:05,  3.36it/s]
 20%|█▉        | 72845/371472 [5:47:55<23:42:29,  3.50it/s]
 20%|█▉        | 72846/371472 [5:47:55<24:17:39,  3.41it/s]
 20%|█▉        | 72847/371472 [5:47:55<24:05:08,  3.44it/s]
 20%|█▉        | 72848/371472 [5:47:55<23:15:58,  3.57it/s]
 20%|█▉        | 72849/371472 [5:47:56<22:17:18,  3.72it/s]
 20%|█▉        | 72850/371472 [5:47:56<22:05:46,  3.75it/s]
 20%|█▉        | 72851/371472 [5:47:56<21:51:39,  3.79it/s]
 20%|█▉        | 72852/371472 [5:47:56<21:24:23,  3.87it/s]
 20%|█▉        | 72853/371472 [5:47:57<22:12:08,  3.74it/s]
 20%|█▉        | 72854/371472 [5:47:57<22:58:43,  3.61it/s]
 20%|█▉        | 72855/371472 [5:47:57<23:14:50,  3.57it/s]
 20%|█▉        | 72856/371472 [5:47:58<22:43:54,  3.65it/s]
 20%|█▉        | 72857/371472 [5:47:58<22:16:43,  3.72it/s]
 20%|█▉        | 72858/371472 [5:47:58<22:29:23,  3.69it/s]
 20%|█▉        | 72859/371472 [5:47:58<22:57:50,  3.61it/s]
 20%|█▉        | 72860/371472 [5:47:59<23:02:00,  3.60it/s]
                                                           
{'loss': 4.1532, 'learning_rate': 8.238649830851774e-07, 'epoch': 3.14}

 20%|█▉        | 72860/371472 [5:47:59<23:02:00,  3.60it/s]
 20%|█▉        | 72861/371472 [5:47:59<22:05:20,  3.76it/s]
 20%|█▉        | 72862/371472 [5:47:59<22:21:27,  3.71it/s]
 20%|█▉        | 72863/371472 [5:47:59<22:54:22,  3.62it/s]
 20%|█▉        | 72864/371472 [5:48:00<22:27:32,  3.69it/s]
 20%|█▉        | 72865/371472 [5:48:00<22:44:12,  3.65it/s]
 20%|█▉        | 72866/371472 [5:48:00<23:02:22,  3.60it/s]
 20%|█▉        | 72867/371472 [5:48:01<22:26:01,  3.70it/s]
 20%|█▉        | 72868/371472 [5:48:01<22:43:46,  3.65it/s]
 20%|█▉        | 72869/371472 [5:48:01<23:54:29,  3.47it/s]
 20%|█▉        | 72870/371472 [5:48:01<22:55:52,  3.62it/s]
 20%|█▉        | 72871/371472 [5:48:02<22:05:45,  3.75it/s]
 20%|█▉        | 72872/371472 [5:48:02<23:08:56,  3.58it/s]
 20%|█▉        | 72873/371472 [5:48:02<22:38:37,  3.66it/s]
 20%|█▉        | 72874/371472 [5:48:02<22:11:50,  3.74it/s]
 20%|█▉        | 72875/371472 [5:48:03<22:50:09,  3.63it/s]
 20%|█▉        | 72876/371472 [5:48:03<23:25:54,  3.54it/s]
 20%|█▉        | 72877/371472 [5:48:03<23:01:52,  3.60it/s]
 20%|█▉        | 72878/371472 [5:48:04<22:54:59,  3.62it/s]
 20%|█▉        | 72879/371472 [5:48:04<22:46:30,  3.64it/s]
 20%|█▉        | 72880/371472 [5:48:04<22:47:16,  3.64it/s]
                                                           
{'loss': 4.0666, 'learning_rate': 8.238165011096986e-07, 'epoch': 3.14}

 20%|█▉        | 72880/371472 [5:48:04<22:47:16,  3.64it/s]
 20%|█▉        | 72881/371472 [5:48:04<23:04:18,  3.59it/s]
 20%|█▉        | 72882/371472 [5:48:05<22:18:56,  3.72it/s]
 20%|█▉        | 72883/371472 [5:48:05<22:10:33,  3.74it/s]
 20%|█▉        | 72884/371472 [5:48:05<21:51:45,  3.79it/s]
 20%|█▉        | 72885/371472 [5:48:05<23:02:43,  3.60it/s]
 20%|█▉        | 72886/371472 [5:48:06<22:52:51,  3.62it/s]
 20%|█▉        | 72887/371472 [5:48:06<23:39:14,  3.51it/s]
 20%|█▉        | 72888/371472 [5:48:06<22:57:11,  3.61it/s]
 20%|█▉        | 72889/371472 [5:48:07<22:16:51,  3.72it/s]
 20%|█▉        | 72890/371472 [5:48:07<22:13:52,  3.73it/s]
 20%|█▉        | 72891/371472 [5:48:07<22:08:23,  3.75it/s]
 20%|█▉        | 72892/371472 [5:48:07<22:47:55,  3.64it/s]
 20%|█▉        | 72893/371472 [5:48:08<22:24:44,  3.70it/s]
 20%|█▉        | 72894/371472 [5:48:08<23:45:20,  3.49it/s]
 20%|█▉        | 72895/371472 [5:48:08<25:07:42,  3.30it/s]
 20%|█▉        | 72896/371472 [5:48:09<24:35:44,  3.37it/s]
 20%|█▉        | 72897/371472 [5:48:09<25:50:05,  3.21it/s]
 20%|█▉        | 72898/371472 [5:48:09<24:19:10,  3.41it/s]
 20%|█▉        | 72899/371472 [5:48:09<24:17:21,  3.41it/s]
 20%|█▉        | 72900/371472 [5:48:10<24:16:34,  3.42it/s]
                                                           
{'loss': 4.0273, 'learning_rate': 8.237680191342197e-07, 'epoch': 3.14}

 20%|█▉        | 72900/371472 [5:48:10<24:16:34,  3.42it/s]
 20%|█▉        | 72901/371472 [5:48:10<25:38:39,  3.23it/s]
 20%|█▉        | 72902/371472 [5:48:10<25:43:18,  3.22it/s]
 20%|█▉        | 72903/371472 [5:48:11<25:28:04,  3.26it/s]
 20%|█▉        | 72904/371472 [5:48:11<24:04:13,  3.45it/s]
 20%|█▉        | 72905/371472 [5:48:11<23:34:41,  3.52it/s]
 20%|█▉        | 72906/371472 [5:48:12<23:03:28,  3.60it/s]
 20%|█▉        | 72907/371472 [5:48:12<23:24:12,  3.54it/s]
 20%|█▉        | 72908/371472 [5:48:12<22:46:31,  3.64it/s]
 20%|█▉        | 72909/371472 [5:48:12<21:57:03,  3.78it/s]
 20%|█▉        | 72910/371472 [5:48:13<24:01:18,  3.45it/s]
 20%|█▉        | 72911/371472 [5:48:13<23:17:47,  3.56it/s]
 20%|█▉        | 72912/371472 [5:48:13<23:03:39,  3.60it/s]
 20%|█▉        | 72913/371472 [5:48:13<22:57:46,  3.61it/s]
 20%|█▉        | 72914/371472 [5:48:14<22:56:23,  3.62it/s]
 20%|█▉        | 72915/371472 [5:48:14<22:35:07,  3.67it/s]
 20%|█▉        | 72916/371472 [5:48:14<21:48:39,  3.80it/s]
 20%|█▉        | 72917/371472 [5:48:15<22:25:36,  3.70it/s]
 20%|█▉        | 72918/371472 [5:48:15<22:21:30,  3.71it/s]
 20%|█▉        | 72919/371472 [5:48:15<23:29:15,  3.53it/s]
 20%|█▉        | 72920/371472 [5:48:15<23:54:07,  3.47it/s]
                                                           
{'loss': 4.2761, 'learning_rate': 8.237195371587406e-07, 'epoch': 3.14}

 20%|█▉        | 72920/371472 [5:48:15<23:54:07,  3.47it/s]
 20%|█▉        | 72921/371472 [5:48:16<23:40:04,  3.50it/s]
 20%|█▉        | 72922/371472 [5:48:16<22:55:48,  3.62it/s]
 20%|█▉        | 72923/371472 [5:48:16<24:21:23,  3.40it/s]
 20%|█▉        | 72924/371472 [5:48:17<24:39:44,  3.36it/s]
 20%|█▉        | 72925/371472 [5:48:17<26:05:53,  3.18it/s]
 20%|█▉        | 72926/371472 [5:48:17<24:52:46,  3.33it/s]
 20%|█▉        | 72927/371472 [5:48:17<23:59:16,  3.46it/s]
 20%|█▉        | 72928/371472 [5:48:18<24:07:52,  3.44it/s]
 20%|█▉        | 72929/371472 [5:48:18<23:14:28,  3.57it/s]
 20%|█▉        | 72930/371472 [5:48:18<23:57:04,  3.46it/s]
 20%|█▉        | 72931/371472 [5:48:19<23:10:09,  3.58it/s]
 20%|█▉        | 72932/371472 [5:48:19<22:40:09,  3.66it/s]
 20%|█▉        | 72933/371472 [5:48:19<21:52:36,  3.79it/s]
 20%|█▉        | 72934/371472 [5:48:19<22:00:46,  3.77it/s]
 20%|█▉        | 72935/371472 [5:48:20<22:33:28,  3.68it/s]
 20%|█▉        | 72936/371472 [5:48:20<23:28:17,  3.53it/s]
 20%|█▉        | 72937/371472 [5:48:20<23:34:38,  3.52it/s]
 20%|█▉        | 72938/371472 [5:48:21<23:25:57,  3.54it/s]
 20%|█▉        | 72939/371472 [5:48:21<22:57:19,  3.61it/s]
 20%|█▉        | 72940/371472 [5:48:21<22:20:35,  3.71it/s]
                                                           
{'loss': 4.4122, 'learning_rate': 8.236710551832618e-07, 'epoch': 3.14}

 20%|█▉        | 72940/371472 [5:48:21<22:20:35,  3.71it/s]
 20%|█▉        | 72941/371472 [5:48:21<23:13:24,  3.57it/s]
 20%|█▉        | 72942/371472 [5:48:22<22:24:33,  3.70it/s]
 20%|█▉        | 72943/371472 [5:48:22<22:07:14,  3.75it/s]
 20%|█▉        | 72944/371472 [5:48:22<21:44:21,  3.81it/s]
 20%|█▉        | 72945/371472 [5:48:22<23:06:35,  3.59it/s]
 20%|█▉        | 72946/371472 [5:48:23<22:42:19,  3.65it/s]
 20%|█▉        | 72947/371472 [5:48:23<23:59:55,  3.46it/s]
 20%|█▉        | 72948/371472 [5:48:23<24:36:19,  3.37it/s]
 20%|█▉        | 72949/371472 [5:48:24<23:51:08,  3.48it/s]
 20%|█▉        | 72950/371472 [5:48:24<24:08:20,  3.44it/s]
 20%|█▉        | 72951/371472 [5:48:24<23:06:59,  3.59it/s]
 20%|█▉        | 72952/371472 [5:48:24<23:36:01,  3.51it/s]
 20%|█▉        | 72953/371472 [5:48:25<26:25:04,  3.14it/s]
 20%|█▉        | 72954/371472 [5:48:25<27:10:08,  3.05it/s]
 20%|█▉        | 72955/371472 [5:48:25<26:36:55,  3.12it/s]
 20%|█▉        | 72956/371472 [5:48:26<25:18:50,  3.28it/s]
 20%|█▉        | 72957/371472 [5:48:26<24:25:21,  3.40it/s]
 20%|█▉        | 72958/371472 [5:48:26<25:29:22,  3.25it/s]
 20%|█▉        | 72959/371472 [5:48:27<23:39:17,  3.51it/s]
 20%|█▉        | 72960/371472 [5:48:27<23:38:41,  3.51it/s]
                                                           
{'loss': 4.2766, 'learning_rate': 8.23622573207783e-07, 'epoch': 3.14}

 20%|█▉        | 72960/371472 [5:48:27<23:38:41,  3.51it/s]
 20%|█▉        | 72961/371472 [5:48:27<24:59:05,  3.32it/s]
 20%|█▉        | 72962/371472 [5:48:27<24:00:59,  3.45it/s]
 20%|█▉        | 72963/371472 [5:48:28<25:36:23,  3.24it/s]
 20%|█▉        | 72964/371472 [5:48:28<25:57:17,  3.19it/s]
 20%|█▉        | 72965/371472 [5:48:28<25:33:07,  3.25it/s]
 20%|█▉        | 72966/371472 [5:48:29<25:26:46,  3.26it/s]
 20%|█▉        | 72967/371472 [5:48:29<23:59:27,  3.46it/s]
 20%|█▉        | 72968/371472 [5:48:29<26:10:40,  3.17it/s]
 20%|█▉        | 72969/371472 [5:48:30<26:48:16,  3.09it/s]
 20%|█▉        | 72970/371472 [5:48:30<25:59:08,  3.19it/s]
 20%|█▉        | 72971/371472 [5:48:30<25:07:35,  3.30it/s]
 20%|█▉        | 72972/371472 [5:48:31<23:54:48,  3.47it/s]
 20%|█▉        | 72973/371472 [5:48:31<23:28:08,  3.53it/s]
 20%|█▉        | 72974/371472 [5:48:31<22:41:19,  3.65it/s]
 20%|█▉        | 72975/371472 [5:48:31<22:45:33,  3.64it/s]
 20%|█▉        | 72976/371472 [5:48:32<23:50:41,  3.48it/s]
 20%|█▉        | 72977/371472 [5:48:32<23:11:30,  3.58it/s]
 20%|█▉        | 72978/371472 [5:48:32<22:51:09,  3.63it/s]
 20%|█▉        | 72979/371472 [5:48:32<23:03:40,  3.60it/s]
 20%|█▉        | 72980/371472 [5:48:33<23:10:32,  3.58it/s]
                                                           
{'loss': 3.9567, 'learning_rate': 8.23574091232304e-07, 'epoch': 3.14}

 20%|█▉        | 72980/371472 [5:48:33<23:10:32,  3.58it/s]
 20%|█▉        | 72981/371472 [5:48:33<22:54:46,  3.62it/s]
 20%|█▉        | 72982/371472 [5:48:33<23:47:07,  3.49it/s]
 20%|█▉        | 72983/371472 [5:48:34<22:55:34,  3.62it/s]
 20%|█▉        | 72984/371472 [5:48:34<22:06:51,  3.75it/s]
 20%|█▉        | 72985/371472 [5:48:34<21:27:07,  3.87it/s]
 20%|█▉        | 72986/371472 [5:48:34<22:26:31,  3.69it/s]
 20%|█▉        | 72987/371472 [5:48:35<21:43:27,  3.82it/s]
 20%|█▉        | 72988/371472 [5:48:35<21:51:41,  3.79it/s]
 20%|█▉        | 72989/371472 [5:48:35<21:51:05,  3.79it/s]
 20%|█▉        | 72990/371472 [5:48:35<22:23:01,  3.70it/s]
 20%|█▉        | 72991/371472 [5:48:36<23:52:16,  3.47it/s]
 20%|█▉        | 72992/371472 [5:48:36<24:09:49,  3.43it/s]
 20%|█▉        | 72993/371472 [5:48:36<24:13:52,  3.42it/s]
 20%|█▉        | 72994/371472 [5:48:37<23:02:42,  3.60it/s]
 20%|█▉        | 72995/371472 [5:48:37<22:16:02,  3.72it/s]
 20%|█▉        | 72996/371472 [5:48:37<21:40:37,  3.82it/s]
 20%|█▉        | 72997/371472 [5:48:37<21:54:34,  3.78it/s]
 20%|█▉        | 72998/371472 [5:48:38<23:14:27,  3.57it/s]
 20%|█▉        | 72999/371472 [5:48:38<25:11:46,  3.29it/s]
 20%|█▉        | 73000/371472 [5:48:38<24:11:40,  3.43it/s]
                                                           
{'loss': 4.1298, 'learning_rate': 8.235256092568251e-07, 'epoch': 3.14}

 20%|█▉        | 73000/371472 [5:48:38<24:11:40,  3.43it/s]
 20%|█▉        | 73001/371472 [5:48:39<24:06:02,  3.44it/s]
 20%|█▉        | 73002/371472 [5:48:39<23:00:36,  3.60it/s]
 20%|█▉        | 73003/371472 [5:48:39<22:57:58,  3.61it/s]
 20%|█▉        | 73004/371472 [5:48:39<25:03:25,  3.31it/s]
 20%|█▉        | 73005/371472 [5:48:40<23:57:27,  3.46it/s]
 20%|█▉        | 73006/371472 [5:48:40<23:36:28,  3.51it/s]
 20%|█▉        | 73007/371472 [5:48:40<23:25:09,  3.54it/s]
 20%|█▉        | 73008/371472 [5:48:41<23:32:33,  3.52it/s]
 20%|█▉        | 73009/371472 [5:48:41<24:02:09,  3.45it/s]
 20%|█▉        | 73010/371472 [5:48:41<24:34:15,  3.37it/s]
 20%|█▉        | 73011/371472 [5:48:41<23:41:07,  3.50it/s]
 20%|█▉        | 73012/371472 [5:48:42<22:53:47,  3.62it/s]
 20%|█▉        | 73013/371472 [5:48:42<22:57:57,  3.61it/s]
 20%|█▉        | 73014/371472 [5:48:42<25:02:16,  3.31it/s]
 20%|█▉        | 73015/371472 [5:48:43<24:22:08,  3.40it/s]
 20%|█▉        | 73016/371472 [5:48:43<24:00:04,  3.45it/s]
 20%|█▉        | 73017/371472 [5:48:43<22:48:48,  3.63it/s]
 20%|█▉        | 73018/371472 [5:48:43<22:42:07,  3.65it/s]
 20%|█▉        | 73019/371472 [5:48:44<22:26:50,  3.69it/s]
 20%|█▉        | 73020/371472 [5:48:44<22:06:00,  3.75it/s]
                                                           
{'loss': 4.2312, 'learning_rate': 8.234771272813463e-07, 'epoch': 3.15}

 20%|█▉        | 73020/371472 [5:48:44<22:06:00,  3.75it/s]
 20%|█▉        | 73021/371472 [5:48:44<23:52:00,  3.47it/s]
 20%|█▉        | 73022/371472 [5:48:45<25:48:06,  3.21it/s]
 20%|█▉        | 73023/371472 [5:48:45<25:30:59,  3.25it/s]
 20%|█▉        | 73024/371472 [5:48:45<25:14:08,  3.29it/s]
 20%|█▉        | 73025/371472 [5:48:45<24:43:35,  3.35it/s]
 20%|█▉        | 73026/371472 [5:48:46<23:57:24,  3.46it/s]
 20%|█▉        | 73027/371472 [5:48:46<23:04:10,  3.59it/s]
 20%|█▉        | 73028/371472 [5:48:46<23:13:32,  3.57it/s]
 20%|█▉        | 73029/371472 [5:48:47<23:33:03,  3.52it/s]
 20%|█▉        | 73030/371472 [5:48:47<23:51:03,  3.48it/s]
 20%|█▉        | 73031/371472 [5:48:47<23:21:47,  3.55it/s]
 20%|█▉        | 73032/371472 [5:48:47<22:54:24,  3.62it/s]
 20%|█▉        | 73033/371472 [5:48:48<24:36:23,  3.37it/s]
 20%|█▉        | 73034/371472 [5:48:48<23:57:23,  3.46it/s]
 20%|█▉        | 73035/371472 [5:48:48<24:29:26,  3.38it/s]
 20%|█▉        | 73036/371472 [5:48:49<23:35:35,  3.51it/s]
 20%|█▉        | 73037/371472 [5:48:49<22:58:54,  3.61it/s]
 20%|█▉        | 73038/371472 [5:48:49<22:06:42,  3.75it/s]
 20%|█▉        | 73039/371472 [5:48:49<24:18:29,  3.41it/s]
 20%|█▉        | 73040/371472 [5:48:50<23:23:54,  3.54it/s]
                                                           
{'loss': 4.339, 'learning_rate': 8.234286453058674e-07, 'epoch': 3.15}

 20%|█▉        | 73040/371472 [5:48:50<23:23:54,  3.54it/s]
 20%|█▉        | 73041/371472 [5:48:50<23:26:08,  3.54it/s]
 20%|█▉        | 73042/371472 [5:48:50<23:15:32,  3.56it/s]
 20%|█▉        | 73043/371472 [5:48:51<22:24:25,  3.70it/s]
 20%|█▉        | 73044/371472 [5:48:51<22:14:29,  3.73it/s]
 20%|█▉        | 73045/371472 [5:48:51<22:34:56,  3.67it/s]
 20%|█▉        | 73046/371472 [5:48:51<23:04:19,  3.59it/s]
 20%|█▉        | 73047/371472 [5:48:52<25:35:27,  3.24it/s]
 20%|█▉        | 73048/371472 [5:48:52<26:37:52,  3.11it/s]
 20%|█▉        | 73049/371472 [5:48:52<25:05:29,  3.30it/s]
 20%|█▉        | 73050/371472 [5:48:53<23:38:25,  3.51it/s]
 20%|█▉        | 73051/371472 [5:48:53<24:38:31,  3.36it/s]
 20%|█▉        | 73052/371472 [5:48:53<23:57:35,  3.46it/s]
 20%|█▉        | 73053/371472 [5:48:53<23:29:24,  3.53it/s]
 20%|█▉        | 73054/371472 [5:48:54<23:51:42,  3.47it/s]
 20%|█▉        | 73055/371472 [5:48:54<22:54:22,  3.62it/s]
 20%|█▉        | 73056/371472 [5:48:54<22:42:40,  3.65it/s]
 20%|█▉        | 73057/371472 [5:48:55<23:53:22,  3.47it/s]
 20%|█▉        | 73058/371472 [5:48:55<23:41:00,  3.50it/s]
 20%|█▉        | 73059/371472 [5:48:55<23:31:18,  3.52it/s]
 20%|█▉        | 73060/371472 [5:48:55<23:45:08,  3.49it/s]
                                                           
{'loss': 4.1877, 'learning_rate': 8.233801633303884e-07, 'epoch': 3.15}

 20%|█▉        | 73060/371472 [5:48:55<23:45:08,  3.49it/s]
 20%|█▉        | 73061/371472 [5:48:56<26:02:14,  3.18it/s]
 20%|█▉        | 73062/371472 [5:48:56<25:22:04,  3.27it/s]
 20%|█▉        | 73063/371472 [5:48:56<25:44:38,  3.22it/s]
 20%|█▉        | 73064/371472 [5:48:57<24:02:47,  3.45it/s]
 20%|█▉        | 73065/371472 [5:48:57<23:38:07,  3.51it/s]
 20%|█▉        | 73066/371472 [5:48:57<22:32:37,  3.68it/s]
 20%|█▉        | 73067/371472 [5:48:57<21:55:09,  3.78it/s]
 20%|█▉        | 73068/371472 [5:48:58<22:02:24,  3.76it/s]
 20%|█▉        | 73069/371472 [5:48:58<21:59:46,  3.77it/s]
 20%|█▉        | 73070/371472 [5:48:58<23:07:28,  3.58it/s]
 20%|█▉        | 73071/371472 [5:48:59<24:43:12,  3.35it/s]
 20%|█▉        | 73072/371472 [5:48:59<24:16:04,  3.42it/s]
 20%|█▉        | 73073/371472 [5:48:59<24:26:55,  3.39it/s]
 20%|█▉        | 73074/371472 [5:48:59<23:49:46,  3.48it/s]
 20%|█▉        | 73075/371472 [5:49:00<23:46:56,  3.49it/s]
 20%|█▉        | 73076/371472 [5:49:00<23:44:55,  3.49it/s]
 20%|█▉        | 73077/371472 [5:49:00<22:55:05,  3.62it/s]
 20%|█▉        | 73078/371472 [5:49:01<23:45:55,  3.49it/s]
 20%|█▉        | 73079/371472 [5:49:01<23:07:09,  3.59it/s]
 20%|█▉        | 73080/371472 [5:49:01<24:12:42,  3.42it/s]
                                                           
{'loss': 4.1944, 'learning_rate': 8.233316813549095e-07, 'epoch': 3.15}

 20%|█▉        | 73080/371472 [5:49:01<24:12:42,  3.42it/s]
 20%|█▉        | 73081/371472 [5:49:02<24:39:19,  3.36it/s]
 20%|█▉        | 73082/371472 [5:49:02<24:43:40,  3.35it/s]
 20%|█▉        | 73083/371472 [5:49:02<23:35:31,  3.51it/s]
 20%|█▉        | 73084/371472 [5:49:02<22:22:32,  3.70it/s]
 20%|█▉        | 73085/371472 [5:49:03<24:40:39,  3.36it/s]
 20%|█▉        | 73086/371472 [5:49:03<24:26:52,  3.39it/s]
 20%|█▉        | 73087/371472 [5:49:03<23:41:30,  3.50it/s]
 20%|█▉        | 73088/371472 [5:49:03<23:33:25,  3.52it/s]
 20%|█▉        | 73089/371472 [5:49:04<22:54:50,  3.62it/s]
 20%|█▉        | 73090/371472 [5:49:04<22:15:51,  3.72it/s]
 20%|█▉        | 73091/371472 [5:49:04<22:47:46,  3.64it/s]
 20%|█▉        | 73092/371472 [5:49:05<22:35:17,  3.67it/s]
 20%|█▉        | 73093/371472 [5:49:05<23:01:20,  3.60it/s]
 20%|█▉        | 73094/371472 [5:49:05<22:47:38,  3.64it/s]
 20%|█▉        | 73095/371472 [5:49:05<23:50:08,  3.48it/s]
 20%|█▉        | 73096/371472 [5:49:06<22:48:58,  3.63it/s]
 20%|█▉        | 73097/371472 [5:49:06<22:48:49,  3.63it/s]
 20%|█▉        | 73098/371472 [5:49:06<22:31:11,  3.68it/s]
 20%|█▉        | 73099/371472 [5:49:07<22:50:20,  3.63it/s]
 20%|█▉        | 73100/371472 [5:49:07<22:09:05,  3.74it/s]
                                                           
{'loss': 3.9856, 'learning_rate': 8.232831993794307e-07, 'epoch': 3.15}

 20%|█▉        | 73100/371472 [5:49:07<22:09:05,  3.74it/s]
 20%|█▉        | 73101/371472 [5:49:07<22:19:13,  3.71it/s]
 20%|█▉        | 73102/371472 [5:49:07<22:39:10,  3.66it/s]
 20%|█▉        | 73103/371472 [5:49:08<23:14:33,  3.57it/s]
 20%|█▉        | 73104/371472 [5:49:08<22:23:58,  3.70it/s]
 20%|█▉        | 73105/371472 [5:49:08<22:03:39,  3.76it/s]
 20%|█▉        | 73106/371472 [5:49:08<22:28:25,  3.69it/s]
 20%|█▉        | 73107/371472 [5:49:09<23:45:21,  3.49it/s]
 20%|█▉        | 73108/371472 [5:49:09<23:12:49,  3.57it/s]
 20%|█▉        | 73109/371472 [5:49:09<22:34:10,  3.67it/s]
 20%|█▉        | 73110/371472 [5:49:09<22:15:51,  3.72it/s]
 20%|█▉        | 73111/371472 [5:49:10<27:02:11,  3.07it/s]
 20%|█▉        | 73112/371472 [5:49:10<25:43:51,  3.22it/s]
 20%|█▉        | 73113/371472 [5:49:10<24:11:47,  3.43it/s]
 20%|█▉        | 73114/371472 [5:49:11<22:56:20,  3.61it/s]
 20%|█▉        | 73115/371472 [5:49:11<22:56:40,  3.61it/s]
 20%|█▉        | 73116/371472 [5:49:11<23:06:28,  3.59it/s]
 20%|█▉        | 73117/371472 [5:49:12<23:45:47,  3.49it/s]
 20%|█▉        | 73118/371472 [5:49:12<23:32:29,  3.52it/s]
 20%|█▉        | 73119/371472 [5:49:12<24:05:25,  3.44it/s]
 20%|█▉        | 73120/371472 [5:49:13<26:27:25,  3.13it/s]
                                                           
{'loss': 3.9332, 'learning_rate': 8.232347174039518e-07, 'epoch': 3.15}

 20%|█▉        | 73120/371472 [5:49:13<26:27:25,  3.13it/s]
 20%|█▉        | 73121/371472 [5:49:13<25:12:58,  3.29it/s]
 20%|█▉        | 73122/371472 [5:49:13<24:20:33,  3.40it/s]
 20%|█▉        | 73123/371472 [5:49:13<24:12:11,  3.42it/s]
 20%|█▉        | 73124/371472 [5:49:14<24:04:53,  3.44it/s]
 20%|█▉        | 73125/371472 [5:49:14<24:20:28,  3.40it/s]
 20%|█▉        | 73126/371472 [5:49:14<23:41:21,  3.50it/s]
 20%|█▉        | 73127/371472 [5:49:14<22:55:31,  3.61it/s]
 20%|█▉        | 73128/371472 [5:49:15<22:27:03,  3.69it/s]
 20%|█▉        | 73129/371472 [5:49:15<22:01:28,  3.76it/s]
 20%|█▉        | 73130/371472 [5:49:15<22:28:05,  3.69it/s]
 20%|█▉        | 73131/371472 [5:49:16<23:21:20,  3.55it/s]
 20%|█▉        | 73132/371472 [5:49:16<22:30:48,  3.68it/s]
 20%|█▉        | 73133/371472 [5:49:16<22:38:59,  3.66it/s]
 20%|█▉        | 73134/371472 [5:49:16<23:15:57,  3.56it/s]
 20%|█▉        | 73135/371472 [5:49:17<22:48:45,  3.63it/s]
 20%|█▉        | 73136/371472 [5:49:17<23:37:06,  3.51it/s]
 20%|█▉        | 73137/371472 [5:49:17<24:29:00,  3.38it/s]
 20%|█▉        | 73138/371472 [5:49:18<24:30:41,  3.38it/s]
 20%|█▉        | 73139/371472 [5:49:18<24:31:40,  3.38it/s]
 20%|█▉        | 73140/371472 [5:49:18<23:39:20,  3.50it/s]
                                                           
{'loss': 3.9824, 'learning_rate': 8.231862354284729e-07, 'epoch': 3.15}

 20%|█▉        | 73140/371472 [5:49:18<23:39:20,  3.50it/s]
 20%|█▉        | 73141/371472 [5:49:18<23:06:16,  3.59it/s]
 20%|█▉        | 73142/371472 [5:49:19<23:40:00,  3.50it/s]
 20%|█▉        | 73143/371472 [5:49:19<22:40:37,  3.65it/s]
 20%|█▉        | 73144/371472 [5:49:19<23:23:51,  3.54it/s]
 20%|█▉        | 73145/371472 [5:49:20<23:34:06,  3.52it/s]
 20%|█▉        | 73146/371472 [5:49:20<23:43:09,  3.49it/s]
 20%|█▉        | 73147/371472 [5:49:20<22:29:39,  3.68it/s]
 20%|█▉        | 73148/371472 [5:49:20<24:29:26,  3.38it/s]
 20%|█▉        | 73149/371472 [5:49:21<23:50:33,  3.48it/s]
 20%|█▉        | 73150/371472 [5:49:21<22:41:22,  3.65it/s]
 20%|█▉        | 73151/371472 [5:49:21<22:03:54,  3.76it/s]
 20%|█▉        | 73152/371472 [5:49:22<22:54:22,  3.62it/s]
 20%|█▉        | 73153/371472 [5:49:22<23:42:40,  3.49it/s]
 20%|█▉        | 73154/371472 [5:49:22<23:40:25,  3.50it/s]
 20%|█▉        | 73155/371472 [5:49:22<23:52:59,  3.47it/s]
 20%|█▉        | 73156/371472 [5:49:23<23:06:56,  3.58it/s]
 20%|█▉        | 73157/371472 [5:49:23<26:29:04,  3.13it/s]
 20%|█▉        | 73158/371472 [5:49:23<25:29:50,  3.25it/s]
 20%|█▉        | 73159/371472 [5:49:24<26:03:03,  3.18it/s]
 20%|█▉        | 73160/371472 [5:49:24<24:43:50,  3.35it/s]
                                                           
{'loss': 4.0645, 'learning_rate': 8.23137753452994e-07, 'epoch': 3.15}

 20%|█▉        | 73160/371472 [5:49:24<24:43:50,  3.35it/s]
 20%|█▉        | 73161/371472 [5:49:24<24:29:47,  3.38it/s]
 20%|█▉        | 73162/371472 [5:49:25<24:18:00,  3.41it/s]
 20%|█▉        | 73163/371472 [5:49:25<24:19:02,  3.41it/s]
 20%|█▉        | 73164/371472 [5:49:25<23:45:01,  3.49it/s]
 20%|█▉        | 73165/371472 [5:49:25<23:47:35,  3.48it/s]
 20%|█▉        | 73166/371472 [5:49:26<23:52:52,  3.47it/s]
 20%|█▉        | 73167/371472 [5:49:26<23:35:11,  3.51it/s]
 20%|█▉        | 73168/371472 [5:49:26<23:20:33,  3.55it/s]
 20%|█▉        | 73169/371472 [5:49:27<23:41:33,  3.50it/s]
 20%|█▉        | 73170/371472 [5:49:27<22:27:28,  3.69it/s]
 20%|█▉        | 73171/371472 [5:49:27<22:08:56,  3.74it/s]
 20%|█▉        | 73172/371472 [5:49:27<24:46:34,  3.34it/s]
 20%|█▉        | 73173/371472 [5:49:28<23:46:07,  3.49it/s]
 20%|█▉        | 73174/371472 [5:49:28<23:16:39,  3.56it/s]
 20%|█▉        | 73175/371472 [5:49:28<22:49:17,  3.63it/s]
 20%|█▉        | 73176/371472 [5:49:28<23:19:12,  3.55it/s]
 20%|█▉        | 73177/371472 [5:49:29<24:14:50,  3.42it/s]
 20%|█▉        | 73178/371472 [5:49:29<24:57:42,  3.32it/s]
 20%|█▉        | 73179/371472 [5:49:29<24:07:23,  3.43it/s]
 20%|█▉        | 73180/371472 [5:49:30<23:47:14,  3.48it/s]
                                                           
{'loss': 4.3052, 'learning_rate': 8.230892714775151e-07, 'epoch': 3.15}

 20%|█▉        | 73180/371472 [5:49:30<23:47:14,  3.48it/s]
 20%|█▉        | 73181/371472 [5:49:30<23:58:17,  3.46it/s]
 20%|█▉        | 73182/371472 [5:49:30<23:46:31,  3.49it/s]
 20%|█▉        | 73183/371472 [5:49:30<23:13:31,  3.57it/s]
 20%|█▉        | 73184/371472 [5:49:31<22:56:13,  3.61it/s]
 20%|█▉        | 73185/371472 [5:49:31<23:38:29,  3.50it/s]
 20%|█▉        | 73186/371472 [5:49:31<23:13:53,  3.57it/s]
 20%|█▉        | 73187/371472 [5:49:32<22:26:26,  3.69it/s]
 20%|█▉        | 73188/371472 [5:49:32<22:21:25,  3.71it/s]
 20%|█▉        | 73189/371472 [5:49:32<22:12:53,  3.73it/s]
 20%|█▉        | 73190/371472 [5:49:32<22:17:02,  3.72it/s]
 20%|█▉        | 73191/371472 [5:49:33<22:10:03,  3.74it/s]
 20%|█▉        | 73192/371472 [5:49:33<22:18:37,  3.71it/s]
 20%|█▉        | 73193/371472 [5:49:33<24:08:00,  3.43it/s]
 20%|█▉        | 73194/371472 [5:49:34<23:21:46,  3.55it/s]
 20%|█▉        | 73195/371472 [5:49:34<25:59:17,  3.19it/s]
 20%|█▉        | 73196/371472 [5:49:34<25:36:56,  3.23it/s]
 20%|█▉        | 73197/371472 [5:49:34<24:17:00,  3.41it/s]
 20%|█▉        | 73198/371472 [5:49:35<24:11:33,  3.42it/s]
 20%|█▉        | 73199/371472 [5:49:35<23:01:04,  3.60it/s]
 20%|█▉        | 73200/371472 [5:49:35<23:50:32,  3.48it/s]
                                                           
{'loss': 4.2081, 'learning_rate': 8.230407895020362e-07, 'epoch': 3.15}

 20%|█▉        | 73200/371472 [5:49:35<23:50:32,  3.48it/s]
 20%|█▉        | 73201/371472 [5:49:36<23:08:50,  3.58it/s]
 20%|█▉        | 73202/371472 [5:49:36<23:01:47,  3.60it/s]
 20%|█▉        | 73203/371472 [5:49:37<33:24:31,  2.48it/s]
 20%|█▉        | 73204/371472 [5:49:37<30:19:56,  2.73it/s]
 20%|█▉        | 73205/371472 [5:49:37<28:12:32,  2.94it/s]
 20%|█▉        | 73206/371472 [5:49:37<27:19:35,  3.03it/s]
 20%|█▉        | 73207/371472 [5:49:38<25:11:04,  3.29it/s]
 20%|█▉        | 73208/371472 [5:49:38<24:13:01,  3.42it/s]
 20%|█▉        | 73209/371472 [5:49:38<23:29:14,  3.53it/s]
 20%|█▉        | 73210/371472 [5:49:38<23:00:46,  3.60it/s]
 20%|█▉        | 73211/371472 [5:49:39<22:39:59,  3.66it/s]
 20%|█▉        | 73212/371472 [5:49:39<22:56:09,  3.61it/s]
 20%|█▉        | 73213/371472 [5:49:39<22:33:04,  3.67it/s]
 20%|█▉        | 73214/371472 [5:49:40<22:41:11,  3.65it/s]
 20%|█▉        | 73215/371472 [5:49:40<22:20:04,  3.71it/s]
 20%|█▉        | 73216/371472 [5:49:40<23:11:34,  3.57it/s]
 20%|█▉        | 73217/371472 [5:49:40<25:32:56,  3.24it/s]
 20%|█▉        | 73218/371472 [5:49:41<24:10:48,  3.43it/s]
 20%|█▉        | 73219/371472 [5:49:41<23:16:45,  3.56it/s]
 20%|█▉        | 73220/371472 [5:49:41<23:46:22,  3.48it/s]
                                                           
{'loss': 4.3285, 'learning_rate': 8.229923075265573e-07, 'epoch': 3.15}

 20%|█▉        | 73220/371472 [5:49:41<23:46:22,  3.48it/s]
 20%|█▉        | 73221/371472 [5:49:42<22:50:56,  3.63it/s]
 20%|█▉        | 73222/371472 [5:49:42<23:49:33,  3.48it/s]
 20%|█▉        | 73223/371472 [5:49:42<23:37:58,  3.51it/s]
 20%|█▉        | 73224/371472 [5:49:42<23:10:55,  3.57it/s]
 20%|█▉        | 73225/371472 [5:49:43<22:42:04,  3.65it/s]
 20%|█▉        | 73226/371472 [5:49:43<23:39:37,  3.50it/s]
 20%|█▉        | 73227/371472 [5:49:43<22:58:32,  3.61it/s]
 20%|█▉        | 73228/371472 [5:49:43<22:32:16,  3.68it/s]
 20%|█▉        | 73229/371472 [5:49:44<22:58:10,  3.61it/s]
 20%|█▉        | 73230/371472 [5:49:44<22:51:35,  3.62it/s]
 20%|█▉        | 73231/371472 [5:49:44<22:23:03,  3.70it/s]
 20%|█▉        | 73232/371472 [5:49:45<22:43:47,  3.64it/s]
 20%|█▉        | 73233/371472 [5:49:45<25:01:00,  3.31it/s]
 20%|█▉        | 73234/371472 [5:49:45<24:33:15,  3.37it/s]
 20%|█▉        | 73235/371472 [5:49:45<23:47:33,  3.48it/s]
 20%|█▉        | 73236/371472 [5:49:46<23:39:02,  3.50it/s]
 20%|█▉        | 73237/371472 [5:49:46<24:27:05,  3.39it/s]
 20%|█▉        | 73238/371472 [5:49:46<23:10:01,  3.58it/s]
 20%|█▉        | 73239/371472 [5:49:47<22:33:16,  3.67it/s]
 20%|█▉        | 73240/371472 [5:49:47<23:21:30,  3.55it/s]
                                                           
{'loss': 4.1318, 'learning_rate': 8.229438255510784e-07, 'epoch': 3.15}

 20%|█▉        | 73240/371472 [5:49:47<23:21:30,  3.55it/s]
 20%|█▉        | 73241/371472 [5:49:47<22:24:13,  3.70it/s]
 20%|█▉        | 73242/371472 [5:49:47<22:22:31,  3.70it/s]
 20%|█▉        | 73243/371472 [5:49:48<21:59:48,  3.77it/s]
 20%|█▉        | 73244/371472 [5:49:48<21:11:25,  3.91it/s]
 20%|█▉        | 73245/371472 [5:49:48<21:18:51,  3.89it/s]
 20%|█▉        | 73246/371472 [5:49:48<22:37:30,  3.66it/s]
 20%|█▉        | 73247/371472 [5:49:49<23:10:49,  3.57it/s]
 20%|█▉        | 73248/371472 [5:49:49<23:17:42,  3.56it/s]
 20%|█▉        | 73249/371472 [5:49:49<23:03:54,  3.59it/s]
 20%|█▉        | 73250/371472 [5:49:50<22:33:14,  3.67it/s]
 20%|█▉        | 73251/371472 [5:49:50<21:57:44,  3.77it/s]
 20%|█▉        | 73252/371472 [5:49:50<21:34:38,  3.84it/s]
 20%|█▉        | 73253/371472 [5:49:50<22:50:22,  3.63it/s]
 20%|█▉        | 73254/371472 [5:49:51<22:29:54,  3.68it/s]
 20%|█▉        | 73255/371472 [5:49:51<22:06:38,  3.75it/s]
 20%|█▉        | 73256/371472 [5:49:51<21:35:24,  3.84it/s]
 20%|█▉        | 73257/371472 [5:49:51<23:23:10,  3.54it/s]
 20%|█▉        | 73258/371472 [5:49:52<23:44:51,  3.49it/s]
 20%|█▉        | 73259/371472 [5:49:52<22:55:26,  3.61it/s]
 20%|█▉        | 73260/371472 [5:49:52<24:00:44,  3.45it/s]
                                                           
{'loss': 4.1297, 'learning_rate': 8.228953435755996e-07, 'epoch': 3.16}

 20%|█▉        | 73260/371472 [5:49:52<24:00:44,  3.45it/s]
 20%|█▉        | 73261/371472 [5:49:53<24:13:31,  3.42it/s]
 20%|█▉        | 73262/371472 [5:49:53<22:49:53,  3.63it/s]
 20%|█▉        | 73263/371472 [5:49:53<23:10:07,  3.58it/s]
 20%|█▉        | 73264/371472 [5:49:53<22:36:50,  3.66it/s]
 20%|█▉        | 73265/371472 [5:49:54<22:52:59,  3.62it/s]
 20%|█▉        | 73266/371472 [5:49:54<22:43:38,  3.64it/s]
 20%|█▉        | 73267/371472 [5:49:54<21:46:31,  3.80it/s]
 20%|█▉        | 73268/371472 [5:49:54<22:04:53,  3.75it/s]
 20%|█▉        | 73269/371472 [5:49:55<22:35:47,  3.67it/s]
 20%|█▉        | 73270/371472 [5:49:55<22:29:20,  3.68it/s]
 20%|█▉        | 73271/371472 [5:49:55<22:35:29,  3.67it/s]
 20%|█▉        | 73272/371472 [5:49:56<22:39:11,  3.66it/s]
 20%|█▉        | 73273/371472 [5:49:56<23:03:21,  3.59it/s]
 20%|█▉        | 73274/371472 [5:49:56<23:36:41,  3.51it/s]
 20%|█▉        | 73275/371472 [5:49:56<22:36:32,  3.66it/s]
 20%|█▉        | 73276/371472 [5:49:57<21:55:06,  3.78it/s]
 20%|█▉        | 73277/371472 [5:49:57<21:24:39,  3.87it/s]
 20%|█▉        | 73278/371472 [5:49:57<21:06:01,  3.93it/s]
 20%|█▉        | 73279/371472 [5:49:57<21:05:33,  3.93it/s]
 20%|█▉        | 73280/371472 [5:49:58<21:41:23,  3.82it/s]
                                                           
{'loss': 4.1799, 'learning_rate': 8.228468616001207e-07, 'epoch': 3.16}

 20%|█▉        | 73280/371472 [5:49:58<21:41:23,  3.82it/s]
 20%|█▉        | 73281/371472 [5:49:58<22:37:04,  3.66it/s]
 20%|█▉        | 73282/371472 [5:49:58<23:35:33,  3.51it/s]
 20%|█▉        | 73283/371472 [5:49:59<22:52:09,  3.62it/s]
 20%|█▉        | 73284/371472 [5:49:59<23:14:35,  3.56it/s]
 20%|█▉        | 73285/371472 [5:49:59<25:44:27,  3.22it/s]
 20%|█▉        | 73286/371472 [5:50:00<25:58:21,  3.19it/s]
 20%|█▉        | 73287/371472 [5:50:00<24:41:48,  3.35it/s]
 20%|█▉        | 73288/371472 [5:50:00<23:19:36,  3.55it/s]
 20%|█▉        | 73289/371472 [5:50:00<23:10:53,  3.57it/s]
 20%|█▉        | 73290/371472 [5:50:01<23:11:49,  3.57it/s]
 20%|█▉        | 73291/371472 [5:50:01<22:34:58,  3.67it/s]
 20%|█▉        | 73292/371472 [5:50:01<21:48:00,  3.80it/s]
 20%|█▉        | 73293/371472 [5:50:01<22:20:48,  3.71it/s]
 20%|█▉        | 73294/371472 [5:50:02<21:43:00,  3.81it/s]
 20%|█▉        | 73295/371472 [5:50:02<21:35:47,  3.84it/s]
 20%|█▉        | 73296/371472 [5:50:02<21:19:36,  3.88it/s]
 20%|█▉        | 73297/371472 [5:50:02<22:13:40,  3.73it/s]
 20%|█▉        | 73298/371472 [5:50:03<22:53:40,  3.62it/s]
 20%|█▉        | 73299/371472 [5:50:03<22:35:30,  3.67it/s]
 20%|█▉        | 73300/371472 [5:50:03<22:51:48,  3.62it/s]
                                                           
{'loss': 4.1386, 'learning_rate': 8.227983796246417e-07, 'epoch': 3.16}

 20%|█▉        | 73300/371472 [5:50:03<22:51:48,  3.62it/s]
 20%|█▉        | 73301/371472 [5:50:04<22:06:44,  3.75it/s]
 20%|█▉        | 73302/371472 [5:50:04<22:51:34,  3.62it/s]
 20%|█▉        | 73303/371472 [5:50:04<23:38:17,  3.50it/s]
 20%|█▉        | 73304/371472 [5:50:04<24:30:34,  3.38it/s]
 20%|█▉        | 73305/371472 [5:50:05<23:12:12,  3.57it/s]
 20%|█▉        | 73306/371472 [5:50:05<22:34:11,  3.67it/s]
 20%|█▉        | 73307/371472 [5:50:05<23:24:12,  3.54it/s]
 20%|█▉        | 73308/371472 [5:50:06<24:21:30,  3.40it/s]
 20%|█▉        | 73309/371472 [5:50:06<28:26:51,  2.91it/s]
 20%|█▉        | 73310/371472 [5:50:06<26:54:24,  3.08it/s]
 20%|█▉        | 73311/371472 [5:50:07<26:45:35,  3.10it/s]
 20%|█▉        | 73312/371472 [5:50:07<24:41:32,  3.35it/s]
 20%|█▉        | 73313/371472 [5:50:07<24:27:23,  3.39it/s]
 20%|█▉        | 73314/371472 [5:50:08<26:43:01,  3.10it/s]
 20%|█▉        | 73315/371472 [5:50:08<25:26:40,  3.25it/s]
 20%|█▉        | 73316/371472 [5:50:08<24:24:36,  3.39it/s]
 20%|█▉        | 73317/371472 [5:50:08<25:35:47,  3.24it/s]
 20%|█▉        | 73318/371472 [5:50:09<24:31:23,  3.38it/s]
 20%|█▉        | 73319/371472 [5:50:09<24:25:58,  3.39it/s]
 20%|█▉        | 73320/371472 [5:50:09<24:22:39,  3.40it/s]
                                                           
{'loss': 3.901, 'learning_rate': 8.227498976491628e-07, 'epoch': 3.16}

 20%|█▉        | 73320/371472 [5:50:09<24:22:39,  3.40it/s]
 20%|█▉        | 73321/371472 [5:50:10<23:51:51,  3.47it/s]
 20%|█▉        | 73322/371472 [5:50:10<23:18:15,  3.55it/s]
 20%|█▉        | 73323/371472 [5:50:10<23:25:35,  3.54it/s]
 20%|█▉        | 73324/371472 [5:50:10<24:12:47,  3.42it/s]
 20%|█▉        | 73325/371472 [5:50:11<24:35:51,  3.37it/s]
 20%|█▉        | 73326/371472 [5:50:11<24:32:25,  3.37it/s]
 20%|█▉        | 73327/371472 [5:50:11<23:42:06,  3.49it/s]
 20%|█▉        | 73328/371472 [5:50:12<23:16:05,  3.56it/s]
 20%|█▉        | 73329/371472 [5:50:12<23:04:32,  3.59it/s]
 20%|█▉        | 73330/371472 [5:50:12<22:36:40,  3.66it/s]
 20%|█▉        | 73331/371472 [5:50:12<22:52:29,  3.62it/s]
 20%|█▉        | 73332/371472 [5:50:13<23:16:45,  3.56it/s]
 20%|█▉        | 73333/371472 [5:50:13<23:53:14,  3.47it/s]
 20%|█▉        | 73334/371472 [5:50:13<26:06:09,  3.17it/s]
 20%|█▉        | 73335/371472 [5:50:14<26:56:24,  3.07it/s]
 20%|█▉        | 73336/371472 [5:50:14<25:11:35,  3.29it/s]
 20%|█▉        | 73337/371472 [5:50:14<24:25:29,  3.39it/s]
 20%|█▉        | 73338/371472 [5:50:15<24:08:06,  3.43it/s]
 20%|█▉        | 73339/371472 [5:50:15<23:40:36,  3.50it/s]
 20%|█▉        | 73340/371472 [5:50:15<24:14:55,  3.42it/s]
                                                           
{'loss': 4.0359, 'learning_rate': 8.22701415673684e-07, 'epoch': 3.16}

 20%|█▉        | 73340/371472 [5:50:15<24:14:55,  3.42it/s]
 20%|█▉        | 73341/371472 [5:50:15<23:14:04,  3.56it/s]
 20%|█▉        | 73342/371472 [5:50:16<23:15:46,  3.56it/s]
 20%|█▉        | 73343/371472 [5:50:16<23:32:21,  3.52it/s]
 20%|█▉        | 73344/371472 [5:50:16<24:07:39,  3.43it/s]
 20%|█▉        | 73345/371472 [5:50:17<28:42:14,  2.89it/s]
 20%|█▉        | 73346/371472 [5:50:17<27:09:45,  3.05it/s]
 20%|█▉        | 73347/371472 [5:50:17<25:13:52,  3.28it/s]
 20%|█▉        | 73348/371472 [5:50:18<24:34:23,  3.37it/s]
 20%|█▉        | 73349/371472 [5:50:18<25:29:42,  3.25it/s]
 20%|█▉        | 73350/371472 [5:50:18<23:57:52,  3.46it/s]
 20%|█▉        | 73351/371472 [5:50:18<24:04:49,  3.44it/s]
 20%|█▉        | 73352/371472 [5:50:19<23:40:21,  3.50it/s]
 20%|█▉        | 73353/371472 [5:50:19<23:28:18,  3.53it/s]
 20%|█▉        | 73354/371472 [5:50:19<22:27:50,  3.69it/s]
 20%|█▉        | 73355/371472 [5:50:19<22:29:23,  3.68it/s]
 20%|█▉        | 73356/371472 [5:50:20<23:14:53,  3.56it/s]
 20%|█▉        | 73357/371472 [5:50:20<23:52:28,  3.47it/s]
 20%|█▉        | 73358/371472 [5:50:20<23:50:05,  3.47it/s]
 20%|█▉        | 73359/371472 [5:50:21<23:14:07,  3.56it/s]
 20%|█▉        | 73360/371472 [5:50:21<23:06:59,  3.58it/s]
                                                           
{'loss': 4.4535, 'learning_rate': 8.22652933698205e-07, 'epoch': 3.16}

 20%|█▉        | 73360/371472 [5:50:21<23:06:59,  3.58it/s]
 20%|█▉        | 73361/371472 [5:50:21<22:43:29,  3.64it/s]
 20%|█▉        | 73362/371472 [5:50:21<23:44:55,  3.49it/s]
 20%|█▉        | 73363/371472 [5:50:22<23:28:00,  3.53it/s]
 20%|█▉        | 73364/371472 [5:50:22<23:18:59,  3.55it/s]
 20%|█▉        | 73365/371472 [5:50:22<23:13:21,  3.57it/s]
 20%|█▉        | 73366/371472 [5:50:23<23:33:03,  3.52it/s]
 20%|█▉        | 73367/371472 [5:50:23<24:56:55,  3.32it/s]
 20%|█▉        | 73368/371472 [5:50:23<23:38:51,  3.50it/s]
 20%|█▉        | 73369/371472 [5:50:23<23:20:26,  3.55it/s]
 20%|█▉        | 73370/371472 [5:50:24<24:02:19,  3.44it/s]
 20%|█▉        | 73371/371472 [5:50:24<23:07:36,  3.58it/s]
 20%|█▉        | 73372/371472 [5:50:24<24:09:41,  3.43it/s]
 20%|█▉        | 73373/371472 [5:50:25<25:02:31,  3.31it/s]
 20%|█▉        | 73374/371472 [5:50:25<27:12:17,  3.04it/s]
 20%|█▉        | 73375/371472 [5:50:25<26:37:00,  3.11it/s]
 20%|█▉        | 73376/371472 [5:50:26<25:09:23,  3.29it/s]
 20%|█▉        | 73377/371472 [5:50:26<25:41:18,  3.22it/s]
 20%|█▉        | 73378/371472 [5:50:26<25:24:29,  3.26it/s]
 20%|█▉        | 73379/371472 [5:50:27<25:11:13,  3.29it/s]
 20%|█▉        | 73380/371472 [5:50:27<24:09:36,  3.43it/s]
                                                           
{'loss': 4.1214, 'learning_rate': 8.226044517227261e-07, 'epoch': 3.16}

 20%|█▉        | 73380/371472 [5:50:27<24:09:36,  3.43it/s]
 20%|█▉        | 73381/371472 [5:50:27<26:15:38,  3.15it/s]
 20%|█▉        | 73382/371472 [5:50:28<26:51:51,  3.08it/s]
 20%|█▉        | 73383/371472 [5:50:28<26:17:15,  3.15it/s]
 20%|█▉        | 73384/371472 [5:50:28<25:16:02,  3.28it/s]
 20%|█▉        | 73385/371472 [5:50:29<27:35:23,  3.00it/s]
 20%|█▉        | 73386/371472 [5:50:29<26:20:59,  3.14it/s]
 20%|█▉        | 73387/371472 [5:50:29<25:48:42,  3.21it/s]
 20%|█▉        | 73388/371472 [5:50:29<25:05:43,  3.30it/s]
 20%|█▉        | 73389/371472 [5:50:30<24:55:08,  3.32it/s]
 20%|█▉        | 73390/371472 [5:50:30<24:49:30,  3.34it/s]
 20%|█▉        | 73391/371472 [5:50:30<24:30:05,  3.38it/s]
 20%|█▉        | 73392/371472 [5:50:31<23:30:46,  3.52it/s]
 20%|█▉        | 73393/371472 [5:50:31<23:43:28,  3.49it/s]
 20%|█▉        | 73394/371472 [5:50:31<23:02:30,  3.59it/s]
 20%|█▉        | 73395/371472 [5:50:31<22:53:03,  3.62it/s]
 20%|█▉        | 73396/371472 [5:50:32<22:32:53,  3.67it/s]
 20%|█▉        | 73397/371472 [5:50:32<23:57:02,  3.46it/s]
 20%|█▉        | 73398/371472 [5:50:32<23:24:05,  3.54it/s]
 20%|█▉        | 73399/371472 [5:50:32<22:16:16,  3.72it/s]
 20%|█▉        | 73400/371472 [5:50:33<22:46:05,  3.64it/s]
                                                           
{'loss': 4.0811, 'learning_rate': 8.225559697472473e-07, 'epoch': 3.16}

 20%|█▉        | 73400/371472 [5:50:33<22:46:05,  3.64it/s]
 20%|█▉        | 73401/371472 [5:50:33<22:15:06,  3.72it/s]
 20%|█▉        | 73402/371472 [5:50:33<24:01:11,  3.45it/s]
 20%|█▉        | 73403/371472 [5:50:34<23:55:05,  3.46it/s]
 20%|█▉        | 73404/371472 [5:50:34<23:25:38,  3.53it/s]
 20%|█▉        | 73405/371472 [5:50:34<22:51:58,  3.62it/s]
 20%|█▉        | 73406/371472 [5:50:34<23:27:45,  3.53it/s]
 20%|█▉        | 73407/371472 [5:50:35<25:27:13,  3.25it/s]
 20%|█▉        | 73408/371472 [5:50:35<25:15:41,  3.28it/s]
 20%|█▉        | 73409/371472 [5:50:35<24:01:37,  3.45it/s]
 20%|█▉        | 73410/371472 [5:50:36<24:06:12,  3.43it/s]
 20%|█▉        | 73411/371472 [5:50:36<24:47:21,  3.34it/s]
 20%|█▉        | 73412/371472 [5:50:36<25:01:49,  3.31it/s]
 20%|█▉        | 73413/371472 [5:50:37<25:00:02,  3.31it/s]
 20%|█▉        | 73414/371472 [5:50:37<25:24:15,  3.26it/s]
 20%|█▉        | 73415/371472 [5:50:37<24:19:50,  3.40it/s]
 20%|█▉        | 73416/371472 [5:50:37<24:20:38,  3.40it/s]
 20%|█▉        | 73417/371472 [5:50:38<24:14:30,  3.42it/s]
 20%|█▉        | 73418/371472 [5:50:38<24:05:35,  3.44it/s]
 20%|█▉        | 73419/371472 [5:50:38<23:59:36,  3.45it/s]
 20%|█▉        | 73420/371472 [5:50:39<23:29:02,  3.53it/s]
                                                           
{'loss': 4.3156, 'learning_rate': 8.225074877717684e-07, 'epoch': 3.16}

 20%|█▉        | 73420/371472 [5:50:39<23:29:02,  3.53it/s]
 20%|█▉        | 73421/371472 [5:50:39<22:48:59,  3.63it/s]
 20%|█▉        | 73422/371472 [5:50:39<22:43:17,  3.64it/s]
 20%|█▉        | 73423/371472 [5:50:39<23:32:49,  3.52it/s]
 20%|█▉        | 73424/371472 [5:50:40<23:05:53,  3.58it/s]
 20%|█▉        | 73425/371472 [5:50:40<22:45:14,  3.64it/s]
 20%|█▉        | 73426/371472 [5:50:40<23:40:34,  3.50it/s]
 20%|█▉        | 73427/371472 [5:50:41<22:59:10,  3.60it/s]
 20%|█▉        | 73428/371472 [5:50:41<22:35:16,  3.67it/s]
 20%|█▉        | 73429/371472 [5:50:41<22:26:25,  3.69it/s]
 20%|█▉        | 73430/371472 [5:50:41<23:05:49,  3.58it/s]
 20%|█▉        | 73431/371472 [5:50:42<25:27:13,  3.25it/s]
 20%|█▉        | 73432/371472 [5:50:42<25:42:29,  3.22it/s]
 20%|█▉        | 73433/371472 [5:50:42<24:22:04,  3.40it/s]
 20%|█▉        | 73434/371472 [5:50:43<23:02:14,  3.59it/s]
 20%|█▉        | 73435/371472 [5:50:43<23:42:45,  3.49it/s]
 20%|█▉        | 73436/371472 [5:50:43<25:49:07,  3.21it/s]
 20%|█▉        | 73437/371472 [5:50:43<24:32:00,  3.37it/s]
 20%|█▉        | 73438/371472 [5:50:44<23:58:42,  3.45it/s]
 20%|█▉        | 73439/371472 [5:50:44<25:17:07,  3.27it/s]
 20%|█▉        | 73440/371472 [5:50:44<23:59:12,  3.45it/s]
                                                           
{'loss': 4.1207, 'learning_rate': 8.224590057962894e-07, 'epoch': 3.16}

 20%|█▉        | 73440/371472 [5:50:44<23:59:12,  3.45it/s]
 20%|█▉        | 73441/371472 [5:50:45<23:13:54,  3.56it/s]
 20%|█▉        | 73442/371472 [5:50:45<23:44:55,  3.49it/s]
 20%|█▉        | 73443/371472 [5:50:45<23:31:42,  3.52it/s]
 20%|█▉        | 73444/371472 [5:50:45<22:31:46,  3.67it/s]
 20%|█▉        | 73445/371472 [5:50:46<23:17:55,  3.55it/s]
 20%|█▉        | 73446/371472 [5:50:46<22:17:15,  3.71it/s]
 20%|█▉        | 73447/371472 [5:50:46<21:30:30,  3.85it/s]
 20%|█▉        | 73448/371472 [5:50:46<21:44:28,  3.81it/s]
 20%|█▉        | 73449/371472 [5:50:47<21:39:40,  3.82it/s]
 20%|█▉        | 73450/371472 [5:50:47<22:05:48,  3.75it/s]
 20%|█▉        | 73451/371472 [5:50:47<21:50:48,  3.79it/s]
 20%|█▉        | 73452/371472 [5:50:48<21:35:17,  3.83it/s]
 20%|█▉        | 73453/371472 [5:50:48<22:21:22,  3.70it/s]
 20%|█▉        | 73454/371472 [5:50:48<21:35:33,  3.83it/s]
 20%|█▉        | 73455/371472 [5:50:48<23:52:10,  3.47it/s]
 20%|█▉        | 73456/371472 [5:50:49<23:03:39,  3.59it/s]
 20%|█▉        | 73457/371472 [5:50:49<22:30:31,  3.68it/s]
 20%|█▉        | 73458/371472 [5:50:49<23:34:40,  3.51it/s]
 20%|█▉        | 73459/371472 [5:50:50<23:34:32,  3.51it/s]
 20%|█▉        | 73460/371472 [5:50:50<22:42:24,  3.65it/s]
                                                           
{'loss': 3.9015, 'learning_rate': 8.224105238208105e-07, 'epoch': 3.16}

 20%|█▉        | 73460/371472 [5:50:50<22:42:24,  3.65it/s]
 20%|█▉        | 73461/371472 [5:50:50<21:57:04,  3.77it/s]
 20%|█▉        | 73462/371472 [5:50:50<22:18:57,  3.71it/s]
 20%|█▉        | 73463/371472 [5:50:51<22:00:37,  3.76it/s]
 20%|█▉        | 73464/371472 [5:50:51<22:10:50,  3.73it/s]
 20%|█▉        | 73465/371472 [5:50:51<21:33:07,  3.84it/s]
 20%|█▉        | 73466/371472 [5:50:51<21:32:43,  3.84it/s]
 20%|█▉        | 73467/371472 [5:50:52<22:59:53,  3.60it/s]
 20%|█▉        | 73468/371472 [5:50:52<22:35:56,  3.66it/s]
 20%|█▉        | 73469/371472 [5:50:52<23:16:20,  3.56it/s]
 20%|█▉        | 73470/371472 [5:50:53<24:48:25,  3.34it/s]
 20%|█▉        | 73471/371472 [5:50:53<23:43:10,  3.49it/s]
 20%|█▉        | 73472/371472 [5:50:53<22:40:52,  3.65it/s]
 20%|█▉        | 73473/371472 [5:50:53<24:17:36,  3.41it/s]
 20%|█▉        | 73474/371472 [5:50:54<24:26:30,  3.39it/s]
 20%|█▉        | 73475/371472 [5:50:54<23:40:35,  3.50it/s]
 20%|█▉        | 73476/371472 [5:50:54<25:15:16,  3.28it/s]
 20%|█▉        | 73477/371472 [5:50:55<24:29:38,  3.38it/s]
 20%|█▉        | 73478/371472 [5:50:55<26:26:16,  3.13it/s]
 20%|█▉        | 73479/371472 [5:50:55<25:52:45,  3.20it/s]
 20%|█▉        | 73480/371472 [5:50:56<26:48:15,  3.09it/s]
                                                           
{'loss': 4.2393, 'learning_rate': 8.223620418453317e-07, 'epoch': 3.16}

 20%|█▉        | 73480/371472 [5:50:56<26:48:15,  3.09it/s]
 20%|█▉        | 73481/371472 [5:50:56<28:38:42,  2.89it/s]
 20%|█▉        | 73482/371472 [5:50:56<28:16:47,  2.93it/s]
 20%|█▉        | 73483/371472 [5:50:57<26:31:55,  3.12it/s]
 20%|█▉        | 73484/371472 [5:50:57<25:14:25,  3.28it/s]
 20%|█▉        | 73485/371472 [5:50:57<25:28:51,  3.25it/s]
 20%|█▉        | 73486/371472 [5:50:57<24:13:44,  3.42it/s]
 20%|█▉        | 73487/371472 [5:50:58<22:51:47,  3.62it/s]
 20%|█▉        | 73488/371472 [5:50:58<22:05:30,  3.75it/s]
 20%|█▉        | 73489/371472 [5:50:58<22:19:27,  3.71it/s]
 20%|█▉        | 73490/371472 [5:50:58<21:45:44,  3.80it/s]
 20%|█▉        | 73491/371472 [5:50:59<22:43:42,  3.64it/s]
 20%|█▉        | 73492/371472 [5:50:59<22:29:14,  3.68it/s]
 20%|█▉        | 73493/371472 [5:50:59<25:16:38,  3.27it/s]
 20%|█▉        | 73494/371472 [5:51:00<25:40:17,  3.22it/s]
 20%|█▉        | 73495/371472 [5:51:00<24:20:28,  3.40it/s]
 20%|█▉        | 73496/371472 [5:51:00<25:10:17,  3.29it/s]
 20%|█▉        | 73497/371472 [5:51:01<28:10:49,  2.94it/s]
 20%|█▉        | 73498/371472 [5:51:01<26:01:12,  3.18it/s]
 20%|█▉        | 73499/371472 [5:51:01<24:31:58,  3.37it/s]
 20%|█▉        | 73500/371472 [5:51:02<23:39:05,  3.50it/s]
                                                           
{'loss': 4.0271, 'learning_rate': 8.223135598698529e-07, 'epoch': 3.17}

 20%|█▉        | 73500/371472 [5:51:02<23:39:05,  3.50it/s]
 20%|█▉        | 73501/371472 [5:51:02<23:08:30,  3.58it/s]
 20%|█▉        | 73502/371472 [5:51:02<22:10:23,  3.73it/s]
 20%|█▉        | 73503/371472 [5:51:02<22:26:16,  3.69it/s]
 20%|█▉        | 73504/371472 [5:51:03<23:54:21,  3.46it/s]
 20%|█▉        | 73505/371472 [5:51:03<23:34:46,  3.51it/s]
 20%|█▉        | 73506/371472 [5:51:03<23:28:02,  3.53it/s]
 20%|█▉        | 73507/371472 [5:51:04<25:44:53,  3.21it/s]
 20%|█▉        | 73508/371472 [5:51:04<26:35:20,  3.11it/s]
 20%|█▉        | 73509/371472 [5:51:04<25:31:10,  3.24it/s]
 20%|█▉        | 73510/371472 [5:51:04<25:03:28,  3.30it/s]
 20%|█▉        | 73511/371472 [5:51:05<24:14:27,  3.41it/s]
 20%|█▉        | 73512/371472 [5:51:05<25:41:53,  3.22it/s]
 20%|█▉        | 73513/371472 [5:51:05<25:21:25,  3.26it/s]
 20%|█▉        | 73514/371472 [5:51:06<25:42:15,  3.22it/s]
 20%|█▉        | 73515/371472 [5:51:06<24:13:17,  3.42it/s]
 20%|█▉        | 73516/371472 [5:51:06<23:33:21,  3.51it/s]
 20%|█▉        | 73517/371472 [5:51:06<23:11:28,  3.57it/s]
 20%|█▉        | 73518/371472 [5:51:07<23:14:59,  3.56it/s]
 20%|█▉        | 73519/371472 [5:51:07<22:32:46,  3.67it/s]
 20%|█▉        | 73520/371472 [5:51:07<22:36:06,  3.66it/s]
                                                           
{'loss': 4.0875, 'learning_rate': 8.222650778943739e-07, 'epoch': 3.17}

 20%|█▉        | 73520/371472 [5:51:07<22:36:06,  3.66it/s]
 20%|█▉        | 73521/371472 [5:51:08<22:00:20,  3.76it/s]
 20%|█▉        | 73522/371472 [5:51:08<21:50:13,  3.79it/s]
 20%|█▉        | 73523/371472 [5:51:08<21:44:28,  3.81it/s]
 20%|█▉        | 73524/371472 [5:51:08<22:37:28,  3.66it/s]
 20%|█▉        | 73525/371472 [5:51:09<22:25:38,  3.69it/s]
 20%|█▉        | 73526/371472 [5:51:09<22:37:48,  3.66it/s]
 20%|█▉        | 73527/371472 [5:51:09<22:35:29,  3.66it/s]
 20%|█▉        | 73528/371472 [5:51:09<22:27:32,  3.69it/s]
 20%|█▉        | 73529/371472 [5:51:10<24:55:06,  3.32it/s]
 20%|█▉        | 73530/371472 [5:51:10<24:18:31,  3.40it/s]
 20%|█▉        | 73531/371472 [5:51:10<24:48:19,  3.34it/s]
 20%|█▉        | 73532/371472 [5:51:11<24:29:43,  3.38it/s]
 20%|█▉        | 73533/371472 [5:51:11<23:53:04,  3.47it/s]
 20%|█▉        | 73534/371472 [5:51:11<23:48:13,  3.48it/s]
 20%|█▉        | 73535/371472 [5:51:12<23:26:52,  3.53it/s]
 20%|█▉        | 73536/371472 [5:51:12<23:10:02,  3.57it/s]
 20%|█▉        | 73537/371472 [5:51:12<22:36:25,  3.66it/s]
 20%|█▉        | 73538/371472 [5:51:12<21:41:19,  3.82it/s]
 20%|█▉        | 73539/371472 [5:51:13<22:17:13,  3.71it/s]
 20%|█▉        | 73540/371472 [5:51:13<22:06:53,  3.74it/s]
                                                           
{'loss': 4.0711, 'learning_rate': 8.22216595918895e-07, 'epoch': 3.17}

 20%|█▉        | 73540/371472 [5:51:13<22:06:53,  3.74it/s]
 20%|█▉        | 73541/371472 [5:51:13<22:31:15,  3.67it/s]
 20%|█▉        | 73542/371472 [5:51:13<25:01:56,  3.31it/s]
 20%|█▉        | 73543/371472 [5:51:14<23:54:22,  3.46it/s]
 20%|█▉        | 73544/371472 [5:51:14<24:34:16,  3.37it/s]
 20%|█▉        | 73545/371472 [5:51:14<26:31:44,  3.12it/s]
 20%|█▉        | 73546/371472 [5:51:15<25:40:31,  3.22it/s]
 20%|█▉        | 73547/371472 [5:51:15<26:29:10,  3.12it/s]
 20%|█▉        | 73548/371472 [5:51:15<25:41:23,  3.22it/s]
 20%|█▉        | 73549/371472 [5:51:16<24:00:01,  3.45it/s]
 20%|█▉        | 73550/371472 [5:51:16<23:07:32,  3.58it/s]
 20%|█▉        | 73551/371472 [5:51:16<23:37:03,  3.50it/s]
 20%|█▉        | 73552/371472 [5:51:16<23:27:55,  3.53it/s]
 20%|█▉        | 73553/371472 [5:51:17<23:26:05,  3.53it/s]
 20%|█▉        | 73554/371472 [5:51:17<24:31:08,  3.38it/s]
 20%|█▉        | 73555/371472 [5:51:17<23:39:47,  3.50it/s]
 20%|█▉        | 73556/371472 [5:51:18<25:14:44,  3.28it/s]
 20%|█▉        | 73557/371472 [5:51:18<24:48:46,  3.34it/s]
 20%|█▉        | 73558/371472 [5:51:18<24:49:53,  3.33it/s]
 20%|█▉        | 73559/371472 [5:51:19<24:01:38,  3.44it/s]
 20%|█▉        | 73560/371472 [5:51:19<24:15:40,  3.41it/s]
                                                           
{'loss': 4.228, 'learning_rate': 8.221681139434161e-07, 'epoch': 3.17}

 20%|█▉        | 73560/371472 [5:51:19<24:15:40,  3.41it/s]
 20%|█▉        | 73561/371472 [5:51:19<24:17:59,  3.41it/s]
 20%|█▉        | 73562/371472 [5:51:19<23:57:23,  3.45it/s]
 20%|█▉        | 73563/371472 [5:51:20<24:09:01,  3.43it/s]
 20%|█▉        | 73564/371472 [5:51:20<23:24:01,  3.54it/s]
 20%|█▉        | 73565/371472 [5:51:20<22:39:56,  3.65it/s]
 20%|█▉        | 73566/371472 [5:51:20<22:52:12,  3.62it/s]
 20%|█▉        | 73567/371472 [5:51:21<22:02:05,  3.76it/s]
 20%|█▉        | 73568/371472 [5:51:21<22:44:21,  3.64it/s]
 20%|█▉        | 73569/371472 [5:51:21<22:38:36,  3.65it/s]
 20%|█▉        | 73570/371472 [5:51:22<22:13:05,  3.72it/s]
 20%|█▉        | 73571/371472 [5:51:22<22:05:05,  3.75it/s]
 20%|█▉        | 73572/371472 [5:51:22<22:29:54,  3.68it/s]
 20%|█▉        | 73573/371472 [5:51:22<22:11:34,  3.73it/s]
 20%|█▉        | 73574/371472 [5:51:23<23:22:36,  3.54it/s]
 20%|█▉        | 73575/371472 [5:51:23<24:56:58,  3.32it/s]
 20%|█▉        | 73576/371472 [5:51:23<25:48:48,  3.21it/s]
 20%|█▉        | 73577/371472 [5:51:24<25:09:54,  3.29it/s]
 20%|█▉        | 73578/371472 [5:51:24<26:14:44,  3.15it/s]
 20%|█▉        | 73579/371472 [5:51:24<25:05:06,  3.30it/s]
 20%|█▉        | 73580/371472 [5:51:25<25:39:08,  3.23it/s]
                                                           
{'loss': 4.3021, 'learning_rate': 8.221196319679373e-07, 'epoch': 3.17}

 20%|█▉        | 73580/371472 [5:51:25<25:39:08,  3.23it/s]
 20%|█▉        | 73581/371472 [5:51:25<24:22:28,  3.39it/s]
 20%|█▉        | 73582/371472 [5:51:25<23:20:29,  3.55it/s]
 20%|█▉        | 73583/371472 [5:51:25<23:08:42,  3.58it/s]
 20%|█▉        | 73584/371472 [5:51:26<23:15:12,  3.56it/s]
 20%|█▉        | 73585/371472 [5:51:26<24:58:14,  3.31it/s]
 20%|█▉        | 73586/371472 [5:51:26<24:04:02,  3.44it/s]
 20%|█▉        | 73587/371472 [5:51:27<24:12:39,  3.42it/s]
 20%|█▉        | 73588/371472 [5:51:27<23:27:18,  3.53it/s]
 20%|█▉        | 73589/371472 [5:51:27<22:51:21,  3.62it/s]
 20%|█▉        | 73590/371472 [5:51:27<22:52:22,  3.62it/s]
 20%|█▉        | 73591/371472 [5:51:28<22:24:14,  3.69it/s]
 20%|█▉        | 73592/371472 [5:51:28<22:12:35,  3.73it/s]
 20%|█▉        | 73593/371472 [5:51:28<22:19:58,  3.71it/s]
 20%|█▉        | 73594/371472 [5:51:28<22:13:52,  3.72it/s]
 20%|█▉        | 73595/371472 [5:51:29<22:49:50,  3.62it/s]
 20%|█▉        | 73596/371472 [5:51:29<23:06:51,  3.58it/s]
 20%|█▉        | 73597/371472 [5:51:29<22:30:50,  3.68it/s]
 20%|█▉        | 73598/371472 [5:51:30<22:50:58,  3.62it/s]
 20%|█▉        | 73599/371472 [5:51:30<23:21:24,  3.54it/s]
 20%|█▉        | 73600/371472 [5:51:30<23:06:50,  3.58it/s]
                                                           
{'loss': 4.0456, 'learning_rate': 8.220711499924583e-07, 'epoch': 3.17}

 20%|█▉        | 73600/371472 [5:51:30<23:06:50,  3.58it/s]
 20%|█▉        | 73601/371472 [5:51:30<24:06:23,  3.43it/s]
 20%|█▉        | 73602/371472 [5:51:31<24:46:00,  3.34it/s]
 20%|█▉        | 73603/371472 [5:51:31<24:15:10,  3.41it/s]
 20%|█▉        | 73604/371472 [5:51:31<26:22:23,  3.14it/s]
 20%|█▉        | 73605/371472 [5:51:32<24:37:50,  3.36it/s]
 20%|█▉        | 73606/371472 [5:51:32<23:39:56,  3.50it/s]
 20%|█▉        | 73607/371472 [5:51:32<22:57:40,  3.60it/s]
 20%|█▉        | 73608/371472 [5:51:32<22:21:16,  3.70it/s]
 20%|█▉        | 73609/371472 [5:51:33<22:03:20,  3.75it/s]
 20%|█▉        | 73610/371472 [5:51:33<22:24:25,  3.69it/s]
 20%|█▉        | 73611/371472 [5:51:33<22:40:53,  3.65it/s]
 20%|█▉        | 73612/371472 [5:51:34<22:51:36,  3.62it/s]
 20%|█▉        | 73613/371472 [5:51:34<24:55:21,  3.32it/s]
 20%|█▉        | 73614/371472 [5:51:34<23:51:49,  3.47it/s]
 20%|█▉        | 73615/371472 [5:51:34<23:47:01,  3.48it/s]
 20%|█▉        | 73616/371472 [5:51:35<23:45:45,  3.48it/s]
 20%|█▉        | 73617/371472 [5:51:35<23:22:47,  3.54it/s]
 20%|█▉        | 73618/371472 [5:51:35<23:11:06,  3.57it/s]
 20%|█▉        | 73619/371472 [5:51:36<22:13:08,  3.72it/s]
 20%|█▉        | 73620/371472 [5:51:36<21:54:30,  3.78it/s]
                                                           
{'loss': 4.1921, 'learning_rate': 8.220226680169794e-07, 'epoch': 3.17}

 20%|█▉        | 73620/371472 [5:51:36<21:54:30,  3.78it/s]
 20%|█▉        | 73621/371472 [5:51:36<22:29:14,  3.68it/s]
 20%|█▉        | 73622/371472 [5:51:36<23:38:06,  3.50it/s]
 20%|█▉        | 73623/371472 [5:51:37<23:34:57,  3.51it/s]
 20%|█▉        | 73624/371472 [5:51:37<24:49:18,  3.33it/s]
 20%|█▉        | 73625/371472 [5:51:37<24:04:16,  3.44it/s]
 20%|█▉        | 73626/371472 [5:51:38<25:57:40,  3.19it/s]
 20%|█▉        | 73627/371472 [5:51:38<24:56:02,  3.32it/s]
 20%|█▉        | 73628/371472 [5:51:38<24:44:01,  3.34it/s]
 20%|█▉        | 73629/371472 [5:51:38<23:42:37,  3.49it/s]
 20%|█▉        | 73630/371472 [5:51:39<23:23:32,  3.54it/s]
 20%|█▉        | 73631/371472 [5:51:39<22:53:01,  3.62it/s]
 20%|█▉        | 73632/371472 [5:51:39<23:36:25,  3.50it/s]
 20%|█▉        | 73633/371472 [5:51:40<23:32:58,  3.51it/s]
 20%|█▉        | 73634/371472 [5:51:40<22:08:34,  3.74it/s]
 20%|█▉        | 73635/371472 [5:51:40<22:14:26,  3.72it/s]
 20%|█▉        | 73636/371472 [5:51:40<21:46:06,  3.80it/s]
 20%|█▉        | 73637/371472 [5:51:41<25:09:47,  3.29it/s]
 20%|█▉        | 73638/371472 [5:51:41<24:48:28,  3.33it/s]
 20%|█▉        | 73639/371472 [5:51:41<24:14:28,  3.41it/s]
 20%|█▉        | 73640/371472 [5:51:42<25:36:07,  3.23it/s]
                                                           
{'loss': 4.2232, 'learning_rate': 8.219741860415006e-07, 'epoch': 3.17}

 20%|█▉        | 73640/371472 [5:51:42<25:36:07,  3.23it/s]
 20%|█▉        | 73641/371472 [5:51:42<24:47:00,  3.34it/s]
 20%|█▉        | 73642/371472 [5:51:42<23:19:02,  3.55it/s]
 20%|█▉        | 73643/371472 [5:51:42<22:58:49,  3.60it/s]
 20%|█▉        | 73644/371472 [5:51:43<22:10:35,  3.73it/s]
 20%|█▉        | 73645/371472 [5:51:43<21:59:03,  3.76it/s]
 20%|█▉        | 73646/371472 [5:51:43<21:37:28,  3.83it/s]
 20%|█▉        | 73647/371472 [5:51:43<21:43:55,  3.81it/s]
 20%|█▉        | 73648/371472 [5:51:44<22:18:20,  3.71it/s]
 20%|█▉        | 73649/371472 [5:51:44<21:59:49,  3.76it/s]
 20%|█▉        | 73650/371472 [5:51:44<22:14:28,  3.72it/s]
 20%|█▉        | 73651/371472 [5:51:45<22:54:44,  3.61it/s]
 20%|█▉        | 73652/371472 [5:51:45<22:36:12,  3.66it/s]
 20%|█▉        | 73653/371472 [5:51:45<22:53:48,  3.61it/s]
 20%|█▉        | 73654/371472 [5:51:45<23:17:50,  3.55it/s]
 20%|█▉        | 73655/371472 [5:51:46<22:32:11,  3.67it/s]
 20%|█▉        | 73656/371472 [5:51:46<23:47:20,  3.48it/s]
 20%|█▉        | 73657/371472 [5:51:46<23:10:36,  3.57it/s]
 20%|█▉        | 73658/371472 [5:51:47<24:03:49,  3.44it/s]
 20%|█▉        | 73659/371472 [5:51:47<24:21:15,  3.40it/s]
 20%|█▉        | 73660/371472 [5:51:47<24:08:55,  3.43it/s]
                                                           
{'loss': 4.3585, 'learning_rate': 8.219257040660216e-07, 'epoch': 3.17}

 20%|█▉        | 73660/371472 [5:51:47<24:08:55,  3.43it/s]
 20%|█▉        | 73661/371472 [5:51:47<24:54:26,  3.32it/s]
 20%|█▉        | 73662/371472 [5:51:48<23:49:38,  3.47it/s]
 20%|█▉        | 73663/371472 [5:51:48<24:14:44,  3.41it/s]
 20%|█▉        | 73664/371472 [5:51:48<24:01:39,  3.44it/s]
 20%|█▉        | 73665/371472 [5:51:49<23:24:56,  3.53it/s]
 20%|█▉        | 73666/371472 [5:51:49<23:19:44,  3.55it/s]
 20%|█▉        | 73667/371472 [5:51:49<23:25:33,  3.53it/s]
 20%|█▉        | 73668/371472 [5:51:49<24:07:57,  3.43it/s]
 20%|█▉        | 73669/371472 [5:51:50<24:46:25,  3.34it/s]
 20%|█▉        | 73670/371472 [5:51:50<23:18:35,  3.55it/s]
 20%|█▉        | 73671/371472 [5:51:50<22:21:23,  3.70it/s]
 20%|█▉        | 73672/371472 [5:51:51<23:41:50,  3.49it/s]
 20%|█▉        | 73673/371472 [5:51:51<23:30:10,  3.52it/s]
 20%|█▉        | 73674/371472 [5:51:51<23:42:52,  3.49it/s]
 20%|█▉        | 73675/371472 [5:51:52<25:24:30,  3.26it/s]
 20%|█▉        | 73676/371472 [5:51:52<25:05:53,  3.30it/s]
 20%|█▉        | 73677/371472 [5:51:52<24:35:29,  3.36it/s]
 20%|█▉        | 73678/371472 [5:51:52<24:33:21,  3.37it/s]
 20%|█▉        | 73679/371472 [5:51:53<23:51:31,  3.47it/s]
 20%|█▉        | 73680/371472 [5:51:53<23:31:24,  3.52it/s]
                                                           
{'loss': 4.1887, 'learning_rate': 8.218772220905426e-07, 'epoch': 3.17}

 20%|█▉        | 73680/371472 [5:51:53<23:31:24,  3.52it/s]
 20%|█▉        | 73681/371472 [5:51:53<22:54:49,  3.61it/s]
 20%|█▉        | 73682/371472 [5:51:53<22:38:11,  3.65it/s]
 20%|█▉        | 73683/371472 [5:51:54<23:43:07,  3.49it/s]
 20%|█▉        | 73684/371472 [5:51:54<23:23:31,  3.54it/s]
 20%|█▉        | 73685/371472 [5:51:54<23:07:51,  3.58it/s]
 20%|█▉        | 73686/371472 [5:51:55<22:56:55,  3.60it/s]
 20%|█▉        | 73687/371472 [5:51:55<24:15:07,  3.41it/s]
 20%|█▉        | 73688/371472 [5:51:55<23:56:06,  3.46it/s]
 20%|█▉        | 73689/371472 [5:51:55<22:53:26,  3.61it/s]
 20%|█▉        | 73690/371472 [5:51:56<23:10:36,  3.57it/s]
 20%|█▉        | 73691/371472 [5:51:56<22:40:21,  3.65it/s]
 20%|█▉        | 73692/371472 [5:51:56<22:52:44,  3.62it/s]
 20%|█▉        | 73693/371472 [5:51:57<22:53:36,  3.61it/s]
 20%|█▉        | 73694/371472 [5:51:57<21:55:14,  3.77it/s]
 20%|█▉        | 73695/371472 [5:51:57<23:14:08,  3.56it/s]
 20%|█▉        | 73696/371472 [5:51:57<24:00:09,  3.45it/s]
 20%|█▉        | 73697/371472 [5:51:58<23:55:49,  3.46it/s]
 20%|█▉        | 73698/371472 [5:51:58<23:12:14,  3.56it/s]
 20%|█▉        | 73699/371472 [5:51:58<22:43:46,  3.64it/s]
 20%|█▉        | 73700/371472 [5:51:58<22:33:58,  3.67it/s]
                                                           
{'loss': 3.9149, 'learning_rate': 8.218287401150638e-07, 'epoch': 3.17}

 20%|█▉        | 73700/371472 [5:51:58<22:33:58,  3.67it/s]
 20%|█▉        | 73701/371472 [5:51:59<23:48:22,  3.47it/s]
 20%|█▉        | 73702/371472 [5:51:59<22:54:33,  3.61it/s]
 20%|█▉        | 73703/371472 [5:51:59<22:55:47,  3.61it/s]
 20%|█▉        | 73704/371472 [5:52:00<22:33:20,  3.67it/s]
 20%|█▉        | 73705/371472 [5:52:00<21:52:16,  3.78it/s]
 20%|█▉        | 73706/371472 [5:52:00<21:21:28,  3.87it/s]
 20%|█▉        | 73707/371472 [5:52:00<21:16:04,  3.89it/s]
 20%|█▉        | 73708/371472 [5:52:01<22:00:35,  3.76it/s]
 20%|█▉        | 73709/371472 [5:52:01<22:39:01,  3.65it/s]
 20%|█▉        | 73710/371472 [5:52:01<24:15:59,  3.41it/s]
 20%|█▉        | 73711/371472 [5:52:02<24:38:43,  3.36it/s]
 20%|█▉        | 73712/371472 [5:52:02<23:27:27,  3.53it/s]
 20%|█▉        | 73713/371472 [5:52:02<23:12:55,  3.56it/s]
 20%|█▉        | 73714/371472 [5:52:02<22:31:33,  3.67it/s]
 20%|█▉        | 73715/371472 [5:52:03<22:36:27,  3.66it/s]
 20%|█▉        | 73716/371472 [5:52:03<22:58:56,  3.60it/s]
 20%|█▉        | 73717/371472 [5:52:03<22:22:39,  3.70it/s]
 20%|█▉        | 73718/371472 [5:52:03<22:15:36,  3.72it/s]
 20%|█▉        | 73719/371472 [5:52:04<21:46:59,  3.80it/s]
 20%|█▉        | 73720/371472 [5:52:04<23:16:12,  3.55it/s]
                                                           
{'loss': 4.0955, 'learning_rate': 8.21780258139585e-07, 'epoch': 3.18}

 20%|█▉        | 73720/371472 [5:52:04<23:16:12,  3.55it/s]
 20%|█▉        | 73721/371472 [5:52:04<23:30:16,  3.52it/s]
 20%|█▉        | 73722/371472 [5:52:05<23:47:38,  3.48it/s]
 20%|█▉        | 73723/371472 [5:52:05<25:23:01,  3.26it/s]
 20%|█▉        | 73724/371472 [5:52:05<24:35:11,  3.36it/s]
 20%|█▉        | 73725/371472 [5:52:06<24:39:40,  3.35it/s]
 20%|█▉        | 73726/371472 [5:52:06<25:03:02,  3.30it/s]
 20%|█▉        | 73727/371472 [5:52:06<26:59:34,  3.06it/s]
 20%|█▉        | 73728/371472 [5:52:06<25:20:13,  3.26it/s]
 20%|█▉        | 73729/371472 [5:52:07<24:08:55,  3.42it/s]
 20%|█▉        | 73730/371472 [5:52:07<23:57:55,  3.45it/s]
 20%|█▉        | 73731/371472 [5:52:07<23:04:34,  3.58it/s]
 20%|█▉        | 73732/371472 [5:52:08<22:45:14,  3.63it/s]
 20%|█▉        | 73733/371472 [5:52:08<22:17:57,  3.71it/s]
 20%|█▉        | 73734/371472 [5:52:08<21:28:28,  3.85it/s]
 20%|█▉        | 73735/371472 [5:52:08<21:43:27,  3.81it/s]
 20%|█▉        | 73736/371472 [5:52:09<25:20:06,  3.26it/s]
 20%|█▉        | 73737/371472 [5:52:09<25:26:43,  3.25it/s]
 20%|█▉        | 73738/371472 [5:52:09<24:57:32,  3.31it/s]
 20%|█▉        | 73739/371472 [5:52:10<23:34:12,  3.51it/s]
 20%|█▉        | 73740/371472 [5:52:10<23:22:05,  3.54it/s]
                                                           
{'loss': 3.9769, 'learning_rate': 8.21731776164106e-07, 'epoch': 3.18}

 20%|█▉        | 73740/371472 [5:52:10<23:22:05,  3.54it/s]
 20%|█▉        | 73741/371472 [5:52:10<23:12:15,  3.56it/s]
 20%|█▉        | 73742/371472 [5:52:10<22:52:45,  3.61it/s]
 20%|█▉        | 73743/371472 [5:52:11<23:24:31,  3.53it/s]
 20%|█▉        | 73744/371472 [5:52:11<22:44:51,  3.64it/s]
 20%|█▉        | 73745/371472 [5:52:11<22:07:57,  3.74it/s]
 20%|█▉        | 73746/371472 [5:52:11<22:13:25,  3.72it/s]
 20%|█▉        | 73747/371472 [5:52:12<21:53:56,  3.78it/s]
 20%|█▉        | 73748/371472 [5:52:12<22:02:49,  3.75it/s]
 20%|█▉        | 73749/371472 [5:52:12<23:22:09,  3.54it/s]
 20%|█▉        | 73750/371472 [5:52:13<23:04:30,  3.58it/s]
 20%|█▉        | 73751/371472 [5:52:13<24:23:56,  3.39it/s]
 20%|█▉        | 73752/371472 [5:52:13<23:33:47,  3.51it/s]
 20%|█▉        | 73753/371472 [5:52:13<23:49:21,  3.47it/s]
 20%|█▉        | 73754/371472 [5:52:14<23:18:48,  3.55it/s]
 20%|█▉        | 73755/371472 [5:52:14<23:19:11,  3.55it/s]
 20%|█▉        | 73756/371472 [5:52:14<23:10:34,  3.57it/s]
 20%|█▉        | 73757/371472 [5:52:15<23:28:22,  3.52it/s]
 20%|█▉        | 73758/371472 [5:52:15<27:12:07,  3.04it/s]
 20%|█▉        | 73759/371472 [5:52:15<26:25:21,  3.13it/s]
 20%|█▉        | 73760/371472 [5:52:16<24:44:52,  3.34it/s]
                                                           
{'loss': 4.1118, 'learning_rate': 8.216832941886272e-07, 'epoch': 3.18}

 20%|█▉        | 73760/371472 [5:52:16<24:44:52,  3.34it/s]
 20%|█▉        | 73761/371472 [5:52:16<24:10:23,  3.42it/s]
 20%|█▉        | 73762/371472 [5:52:16<26:08:33,  3.16it/s]
 20%|█▉        | 73763/371472 [5:52:16<25:00:33,  3.31it/s]
 20%|█▉        | 73764/371472 [5:52:17<24:27:24,  3.38it/s]
 20%|█▉        | 73765/371472 [5:52:17<23:42:47,  3.49it/s]
 20%|█▉        | 73766/371472 [5:52:17<26:10:10,  3.16it/s]
 20%|█▉        | 73767/371472 [5:52:18<25:43:16,  3.22it/s]
 20%|█▉        | 73768/371472 [5:52:18<24:36:11,  3.36it/s]
 20%|█▉        | 73769/371472 [5:52:18<24:10:49,  3.42it/s]
 20%|█▉        | 73770/371472 [5:52:19<24:08:59,  3.42it/s]
 20%|█▉        | 73771/371472 [5:52:19<23:21:41,  3.54it/s]
 20%|█▉        | 73772/371472 [5:52:19<24:26:49,  3.38it/s]
 20%|█▉        | 73773/371472 [5:52:19<23:48:59,  3.47it/s]
 20%|█▉        | 73774/371472 [5:52:20<23:59:48,  3.45it/s]
 20%|█▉        | 73775/371472 [5:52:20<23:53:44,  3.46it/s]
 20%|█▉        | 73776/371472 [5:52:20<23:54:04,  3.46it/s]
 20%|█▉        | 73777/371472 [5:52:21<22:23:00,  3.69it/s]
 20%|█▉        | 73778/371472 [5:52:21<21:54:26,  3.77it/s]
 20%|█▉        | 73779/371472 [5:52:21<21:41:26,  3.81it/s]
 20%|█▉        | 73780/371472 [5:52:21<23:33:18,  3.51it/s]
                                                           
{'loss': 4.1992, 'learning_rate': 8.216348122131484e-07, 'epoch': 3.18}

 20%|█▉        | 73780/371472 [5:52:21<23:33:18,  3.51it/s]
 20%|█▉        | 73781/371472 [5:52:22<23:38:36,  3.50it/s]
 20%|█▉        | 73782/371472 [5:52:22<26:08:39,  3.16it/s]
 20%|█▉        | 73783/371472 [5:52:22<24:54:28,  3.32it/s]
 20%|█▉        | 73784/371472 [5:52:23<23:26:44,  3.53it/s]
 20%|█▉        | 73785/371472 [5:52:23<24:20:12,  3.40it/s]
 20%|█▉        | 73786/371472 [5:52:23<23:55:49,  3.46it/s]
 20%|█▉        | 73787/371472 [5:52:23<22:54:04,  3.61it/s]
 20%|█▉        | 73788/371472 [5:52:24<22:23:07,  3.69it/s]
 20%|█▉        | 73789/371472 [5:52:24<23:45:11,  3.48it/s]
 20%|█▉        | 73790/371472 [5:52:24<23:21:17,  3.54it/s]
 20%|█▉        | 73791/371472 [5:52:25<24:50:17,  3.33it/s]
 20%|█▉        | 73792/371472 [5:52:25<24:48:39,  3.33it/s]
 20%|█▉        | 73793/371472 [5:52:25<23:45:03,  3.48it/s]
 20%|█▉        | 73794/371472 [5:52:26<25:59:24,  3.18it/s]
 20%|█▉        | 73795/371472 [5:52:26<24:26:04,  3.38it/s]
 20%|█▉        | 73796/371472 [5:52:26<22:58:02,  3.60it/s]
 20%|█▉        | 73797/371472 [5:52:26<24:18:03,  3.40it/s]
 20%|█▉        | 73798/371472 [5:52:27<24:02:11,  3.44it/s]
 20%|█▉        | 73799/371472 [5:52:27<24:39:09,  3.35it/s]
 20%|█▉        | 73800/371472 [5:52:27<26:42:22,  3.10it/s]
                                                           
{'loss': 4.0834, 'learning_rate': 8.215863302376694e-07, 'epoch': 3.18}

 20%|█▉        | 73800/371472 [5:52:27<26:42:22,  3.10it/s]
 20%|█▉        | 73801/371472 [5:52:28<26:05:18,  3.17it/s]
 20%|█▉        | 73802/371472 [5:52:28<24:59:14,  3.31it/s]
 20%|█▉        | 73803/371472 [5:52:28<26:28:47,  3.12it/s]
 20%|█▉        | 73804/371472 [5:52:29<25:51:22,  3.20it/s]
 20%|█▉        | 73805/371472 [5:52:29<26:44:10,  3.09it/s]
 20%|█▉        | 73806/371472 [5:52:29<27:15:21,  3.03it/s]
 20%|█▉        | 73807/371472 [5:52:30<26:25:00,  3.13it/s]
 20%|█▉        | 73808/371472 [5:52:30<26:46:54,  3.09it/s]
 20%|█▉        | 73809/371472 [5:52:30<25:23:10,  3.26it/s]
 20%|█▉        | 73810/371472 [5:52:30<23:56:40,  3.45it/s]
 20%|█▉        | 73811/371472 [5:52:31<22:38:36,  3.65it/s]
 20%|█▉        | 73812/371472 [5:52:31<22:40:08,  3.65it/s]
 20%|█▉        | 73813/371472 [5:52:31<21:59:14,  3.76it/s]
 20%|█▉        | 73814/371472 [5:52:31<21:21:06,  3.87it/s]
 20%|█▉        | 73815/371472 [5:52:32<21:12:39,  3.90it/s]
 20%|█▉        | 73816/371472 [5:52:32<23:26:50,  3.53it/s]
 20%|█▉        | 73817/371472 [5:52:32<23:31:19,  3.52it/s]
 20%|█▉        | 73818/371472 [5:52:33<22:56:20,  3.60it/s]
 20%|█▉        | 73819/371472 [5:52:33<23:20:41,  3.54it/s]
 20%|█▉        | 73820/371472 [5:52:33<23:59:51,  3.45it/s]
                                                           
{'loss': 4.041, 'learning_rate': 8.215378482621904e-07, 'epoch': 3.18}

 20%|█▉        | 73820/371472 [5:52:33<23:59:51,  3.45it/s]
 20%|█▉        | 73821/371472 [5:52:33<25:53:44,  3.19it/s]
 20%|█▉        | 73822/371472 [5:52:34<25:08:42,  3.29it/s]
 20%|█▉        | 73823/371472 [5:52:34<25:45:03,  3.21it/s]
 20%|█▉        | 73824/371472 [5:52:34<24:18:00,  3.40it/s]
 20%|█▉        | 73825/371472 [5:52:35<23:52:20,  3.46it/s]
 20%|█▉        | 73826/371472 [5:52:35<23:26:51,  3.53it/s]
 20%|█▉        | 73827/371472 [5:52:35<23:26:01,  3.53it/s]
 20%|█▉        | 73828/371472 [5:52:35<22:32:22,  3.67it/s]
 20%|█▉        | 73829/371472 [5:52:36<23:07:19,  3.58it/s]
 20%|█▉        | 73830/371472 [5:52:36<23:27:08,  3.53it/s]
 20%|█▉        | 73831/371472 [5:52:36<22:58:35,  3.60it/s]
 20%|█▉        | 73832/371472 [5:52:37<22:28:58,  3.68it/s]
 20%|█▉        | 73833/371472 [5:52:37<22:59:46,  3.60it/s]
 20%|█▉        | 73834/371472 [5:52:37<25:52:13,  3.20it/s]
 20%|█▉        | 73835/371472 [5:52:37<24:30:24,  3.37it/s]
 20%|█▉        | 73836/371472 [5:52:38<23:50:52,  3.47it/s]
 20%|█▉        | 73837/371472 [5:52:38<23:25:33,  3.53it/s]
 20%|█▉        | 73838/371472 [5:52:38<23:30:34,  3.52it/s]
 20%|█▉        | 73839/371472 [5:52:39<22:15:39,  3.71it/s]
 20%|█▉        | 73840/371472 [5:52:39<23:13:29,  3.56it/s]
                                                           
{'loss': 4.1296, 'learning_rate': 8.214893662867116e-07, 'epoch': 3.18}

 20%|█▉        | 73840/371472 [5:52:39<23:13:29,  3.56it/s]
 20%|█▉        | 73841/371472 [5:52:39<22:22:23,  3.70it/s]
 20%|█▉        | 73842/371472 [5:52:39<24:32:50,  3.37it/s]
 20%|█▉        | 73843/371472 [5:52:40<23:30:19,  3.52it/s]
 20%|█▉        | 73844/371472 [5:52:40<22:19:54,  3.70it/s]
 20%|█▉        | 73845/371472 [5:52:40<22:31:27,  3.67it/s]
 20%|█▉        | 73846/371472 [5:52:40<21:57:42,  3.76it/s]
 20%|█▉        | 73847/371472 [5:52:41<21:54:25,  3.77it/s]
 20%|█▉        | 73848/371472 [5:52:41<22:07:26,  3.74it/s]
 20%|█▉        | 73849/371472 [5:52:41<21:45:14,  3.80it/s]
 20%|█▉        | 73850/371472 [5:52:42<22:09:34,  3.73it/s]
 20%|█▉        | 73851/371472 [5:52:42<21:46:40,  3.80it/s]
 20%|█▉        | 73852/371472 [5:52:42<22:17:09,  3.71it/s]
 20%|█▉        | 73853/371472 [5:52:42<23:06:31,  3.58it/s]
 20%|█▉        | 73854/371472 [5:52:43<22:15:41,  3.71it/s]
 20%|█▉        | 73855/371472 [5:52:43<22:01:34,  3.75it/s]
 20%|█▉        | 73856/371472 [5:52:43<21:21:57,  3.87it/s]
 20%|█▉        | 73857/371472 [5:52:43<21:59:58,  3.76it/s]
 20%|█▉        | 73858/371472 [5:52:44<21:46:04,  3.80it/s]
 20%|█▉        | 73859/371472 [5:52:44<21:38:55,  3.82it/s]
 20%|█▉        | 73860/371472 [5:52:44<21:08:24,  3.91it/s]
                                                           
{'loss': 4.1386, 'learning_rate': 8.214408843112327e-07, 'epoch': 3.18}

 20%|█▉        | 73860/371472 [5:52:44<21:08:24,  3.91it/s]
 20%|█▉        | 73861/371472 [5:52:44<21:27:07,  3.85it/s]
 20%|█▉        | 73862/371472 [5:52:45<21:16:46,  3.88it/s]
 20%|█▉        | 73863/371472 [5:52:45<21:32:21,  3.84it/s]
 20%|█▉        | 73864/371472 [5:52:45<21:27:21,  3.85it/s]
 20%|█▉        | 73865/371472 [5:52:45<22:00:00,  3.76it/s]
 20%|█▉        | 73866/371472 [5:52:46<22:50:14,  3.62it/s]
 20%|█▉        | 73867/371472 [5:52:46<23:04:44,  3.58it/s]
 20%|█▉        | 73868/371472 [5:52:46<22:53:06,  3.61it/s]
 20%|█▉        | 73869/371472 [5:52:47<22:19:38,  3.70it/s]
 20%|█▉        | 73870/371472 [5:52:47<21:51:55,  3.78it/s]
 20%|█▉        | 73871/371472 [5:52:47<21:24:16,  3.86it/s]
 20%|█▉        | 73872/371472 [5:52:47<22:42:07,  3.64it/s]
 20%|█▉        | 73873/371472 [5:52:48<22:47:54,  3.63it/s]
 20%|█▉        | 73874/371472 [5:52:48<22:30:22,  3.67it/s]
 20%|█▉        | 73875/371472 [5:52:48<22:52:56,  3.61it/s]
 20%|█▉        | 73876/371472 [5:52:49<23:04:55,  3.58it/s]
 20%|█▉        | 73877/371472 [5:52:49<23:22:25,  3.54it/s]
 20%|█▉        | 73878/371472 [5:52:49<23:49:15,  3.47it/s]
 20%|█▉        | 73879/371472 [5:52:49<23:39:40,  3.49it/s]
 20%|█▉        | 73880/371472 [5:52:50<23:23:59,  3.53it/s]
                                                           
{'loss': 4.5436, 'learning_rate': 8.213924023357539e-07, 'epoch': 3.18}

 20%|█▉        | 73880/371472 [5:52:50<23:23:59,  3.53it/s]
 20%|█▉        | 73881/371472 [5:52:50<30:28:52,  2.71it/s]
 20%|█▉        | 73882/371472 [5:52:51<29:05:53,  2.84it/s]
 20%|█▉        | 73883/371472 [5:52:51<26:59:48,  3.06it/s]
 20%|█▉        | 73884/371472 [5:52:51<25:22:03,  3.26it/s]
 20%|█▉        | 73885/371472 [5:52:51<25:21:48,  3.26it/s]
 20%|█▉        | 73886/371472 [5:52:52<26:07:35,  3.16it/s]
 20%|█▉        | 73887/371472 [5:52:52<26:20:17,  3.14it/s]
 20%|█▉        | 73888/371472 [5:52:52<25:04:57,  3.30it/s]
 20%|█▉        | 73889/371472 [5:52:53<24:13:39,  3.41it/s]
 20%|█▉        | 73890/371472 [5:52:53<24:07:55,  3.43it/s]
 20%|█▉        | 73891/371472 [5:52:53<22:51:24,  3.62it/s]
 20%|█▉        | 73892/371472 [5:52:53<23:27:52,  3.52it/s]
 20%|█▉        | 73893/371472 [5:52:54<22:28:51,  3.68it/s]
 20%|█▉        | 73894/371472 [5:52:54<22:17:22,  3.71it/s]
 20%|█▉        | 73895/371472 [5:52:54<22:37:41,  3.65it/s]
 20%|█▉        | 73896/371472 [5:52:54<22:17:32,  3.71it/s]
 20%|█▉        | 73897/371472 [5:52:55<22:37:50,  3.65it/s]
 20%|█▉        | 73898/371472 [5:52:55<22:10:19,  3.73it/s]
 20%|█▉        | 73899/371472 [5:52:55<23:34:31,  3.51it/s]
 20%|█▉        | 73900/371472 [5:52:56<25:46:11,  3.21it/s]
                                                           
{'loss': 4.0356, 'learning_rate': 8.213439203602749e-07, 'epoch': 3.18}

 20%|█▉        | 73900/371472 [5:52:56<25:46:11,  3.21it/s]
 20%|█▉        | 73901/371472 [5:52:56<25:32:07,  3.24it/s]
 20%|█▉        | 73902/371472 [5:52:56<26:25:59,  3.13it/s]
 20%|█▉        | 73903/371472 [5:52:57<25:18:07,  3.27it/s]
 20%|█▉        | 73904/371472 [5:52:57<23:42:35,  3.49it/s]
 20%|█▉        | 73905/371472 [5:52:57<23:51:57,  3.46it/s]
 20%|█▉        | 73906/371472 [5:52:58<25:16:29,  3.27it/s]
 20%|█▉        | 73907/371472 [5:52:58<24:54:32,  3.32it/s]
 20%|█▉        | 73908/371472 [5:52:58<25:33:15,  3.23it/s]
 20%|█▉        | 73909/371472 [5:52:58<24:38:50,  3.35it/s]
 20%|█▉        | 73910/371472 [5:52:59<24:06:48,  3.43it/s]
 20%|█▉        | 73911/371472 [5:52:59<22:52:04,  3.61it/s]
 20%|█▉        | 73912/371472 [5:52:59<24:10:02,  3.42it/s]
 20%|█▉        | 73913/371472 [5:53:00<23:17:05,  3.55it/s]
 20%|█▉        | 73914/371472 [5:53:00<22:37:41,  3.65it/s]
 20%|█▉        | 73915/371472 [5:53:00<22:49:54,  3.62it/s]
 20%|█▉        | 73916/371472 [5:53:00<23:41:47,  3.49it/s]
 20%|█▉        | 73917/371472 [5:53:01<23:32:47,  3.51it/s]
 20%|█▉        | 73918/371472 [5:53:01<23:36:23,  3.50it/s]
 20%|█▉        | 73919/371472 [5:53:01<23:30:34,  3.52it/s]
 20%|█▉        | 73920/371472 [5:53:01<23:23:51,  3.53it/s]
                                                           
{'loss': 4.2839, 'learning_rate': 8.21295438384796e-07, 'epoch': 3.18}

 20%|█▉        | 73920/371472 [5:53:01<23:23:51,  3.53it/s]
 20%|█▉        | 73921/371472 [5:53:02<23:27:03,  3.52it/s]
 20%|█▉        | 73922/371472 [5:53:02<22:32:06,  3.67it/s]
 20%|█▉        | 73923/371472 [5:53:02<22:08:37,  3.73it/s]
 20%|█▉        | 73924/371472 [5:53:03<22:13:07,  3.72it/s]
 20%|█▉        | 73925/371472 [5:53:03<22:55:35,  3.61it/s]
 20%|█▉        | 73926/371472 [5:53:03<22:18:12,  3.71it/s]
 20%|█▉        | 73927/371472 [5:53:03<23:47:48,  3.47it/s]
 20%|█▉        | 73928/371472 [5:53:04<23:19:16,  3.54it/s]
 20%|█▉        | 73929/371472 [5:53:04<22:09:16,  3.73it/s]
 20%|█▉        | 73930/371472 [5:53:04<21:38:49,  3.82it/s]
 20%|█▉        | 73931/371472 [5:53:04<22:53:35,  3.61it/s]
 20%|█▉        | 73932/371472 [5:53:05<22:22:48,  3.69it/s]
 20%|█▉        | 73933/371472 [5:53:05<24:23:16,  3.39it/s]
 20%|█▉        | 73934/371472 [5:53:05<25:41:41,  3.22it/s]
 20%|█▉        | 73935/371472 [5:53:06<24:24:54,  3.39it/s]
 20%|█▉        | 73936/371472 [5:53:06<24:49:09,  3.33it/s]
 20%|█▉        | 73937/371472 [5:53:06<24:14:05,  3.41it/s]
 20%|█▉        | 73938/371472 [5:53:07<24:05:20,  3.43it/s]
 20%|█▉        | 73939/371472 [5:53:07<23:08:40,  3.57it/s]
 20%|█▉        | 73940/371472 [5:53:07<24:40:27,  3.35it/s]
                                                           
{'loss': 4.2784, 'learning_rate': 8.212469564093171e-07, 'epoch': 3.18}

 20%|█▉        | 73940/371472 [5:53:07<24:40:27,  3.35it/s]
 20%|█▉        | 73941/371472 [5:53:07<24:47:59,  3.33it/s]
 20%|█▉        | 73942/371472 [5:53:08<23:11:43,  3.56it/s]
 20%|█▉        | 73943/371472 [5:53:08<24:25:33,  3.38it/s]
 20%|█▉        | 73944/371472 [5:53:08<24:16:07,  3.41it/s]
 20%|█▉        | 73945/371472 [5:53:09<23:48:47,  3.47it/s]
 20%|█▉        | 73946/371472 [5:53:09<23:10:19,  3.57it/s]
 20%|█▉        | 73947/371472 [5:53:09<23:12:01,  3.56it/s]
 20%|█▉        | 73948/371472 [5:53:09<22:42:37,  3.64it/s]
 20%|█▉        | 73949/371472 [5:53:10<22:25:40,  3.68it/s]
 20%|█▉        | 73950/371472 [5:53:10<23:37:20,  3.50it/s]
 20%|█▉        | 73951/371472 [5:53:10<22:22:39,  3.69it/s]
 20%|█▉        | 73952/371472 [5:53:10<21:55:50,  3.77it/s]
 20%|█▉        | 73953/371472 [5:53:11<21:21:38,  3.87it/s]
 20%|█▉        | 73954/371472 [5:53:11<21:32:42,  3.84it/s]
 20%|█▉        | 73955/371472 [5:53:11<23:29:17,  3.52it/s]
 20%|█▉        | 73956/371472 [5:53:12<23:19:13,  3.54it/s]
 20%|█▉        | 73957/371472 [5:53:12<23:31:19,  3.51it/s]
 20%|█▉        | 73958/371472 [5:53:12<23:28:02,  3.52it/s]
 20%|█▉        | 73959/371472 [5:53:12<23:15:36,  3.55it/s]
 20%|█▉        | 73960/371472 [5:53:13<22:09:42,  3.73it/s]
                                                           
{'loss': 4.1857, 'learning_rate': 8.211984744338382e-07, 'epoch': 3.19}

 20%|█▉        | 73960/371472 [5:53:13<22:09:42,  3.73it/s]
 20%|█▉        | 73961/371472 [5:53:13<22:21:39,  3.70it/s]
 20%|█▉        | 73962/371472 [5:53:13<21:55:03,  3.77it/s]
 20%|█▉        | 73963/371472 [5:53:14<22:38:03,  3.65it/s]
 20%|█▉        | 73964/371472 [5:53:14<22:24:29,  3.69it/s]
 20%|█▉        | 73965/371472 [5:53:14<22:01:10,  3.75it/s]
 20%|█▉        | 73966/371472 [5:53:14<21:25:23,  3.86it/s]
 20%|█▉        | 73967/371472 [5:53:15<21:02:47,  3.93it/s]
 20%|█▉        | 73968/371472 [5:53:15<23:23:27,  3.53it/s]
 20%|█▉        | 73969/371472 [5:53:15<23:21:17,  3.54it/s]
 20%|█▉        | 73970/371472 [5:53:15<22:31:59,  3.67it/s]
 20%|█▉        | 73971/371472 [5:53:16<22:33:19,  3.66it/s]
 20%|█▉        | 73972/371472 [5:53:16<23:29:33,  3.52it/s]
 20%|█▉        | 73973/371472 [5:53:16<24:10:39,  3.42it/s]
 20%|█▉        | 73974/371472 [5:53:17<23:14:19,  3.56it/s]
 20%|█▉        | 73975/371472 [5:53:17<24:15:17,  3.41it/s]
 20%|█▉        | 73976/371472 [5:53:17<23:19:46,  3.54it/s]
 20%|█▉        | 73977/371472 [5:53:17<22:45:23,  3.63it/s]
 20%|█▉        | 73978/371472 [5:53:18<23:31:56,  3.51it/s]
 20%|█▉        | 73979/371472 [5:53:18<23:03:14,  3.58it/s]
 20%|█▉        | 73980/371472 [5:53:18<22:32:33,  3.67it/s]
                                                           
{'loss': 4.0885, 'learning_rate': 8.211499924583593e-07, 'epoch': 3.19}

 20%|█▉        | 73980/371472 [5:53:18<22:32:33,  3.67it/s]
 20%|█▉        | 73981/371472 [5:53:18<22:19:15,  3.70it/s]
 20%|█▉        | 73982/371472 [5:53:19<23:56:13,  3.45it/s]
 20%|█▉        | 73983/371472 [5:53:19<22:57:56,  3.60it/s]
 20%|█▉        | 73984/371472 [5:53:19<23:04:49,  3.58it/s]
 20%|█▉        | 73985/371472 [5:53:20<22:10:59,  3.73it/s]
 20%|█▉        | 73986/371472 [5:53:20<22:54:09,  3.61it/s]
 20%|█▉        | 73987/371472 [5:53:20<22:57:52,  3.60it/s]
 20%|█▉        | 73988/371472 [5:53:21<25:20:51,  3.26it/s]
 20%|█▉        | 73989/371472 [5:53:21<24:34:18,  3.36it/s]
 20%|█▉        | 73990/371472 [5:53:21<24:14:13,  3.41it/s]
 20%|█▉        | 73991/371472 [5:53:21<23:57:47,  3.45it/s]
 20%|█▉        | 73992/371472 [5:53:22<23:29:54,  3.52it/s]
 20%|█▉        | 73993/371472 [5:53:22<23:17:02,  3.55it/s]
 20%|█▉        | 73994/371472 [5:53:22<23:27:51,  3.52it/s]
 20%|█▉        | 73995/371472 [5:53:23<24:07:13,  3.43it/s]
 20%|█▉        | 73996/371472 [5:53:23<24:58:51,  3.31it/s]
 20%|█▉        | 73997/371472 [5:53:23<24:05:06,  3.43it/s]
 20%|█▉        | 73998/371472 [5:53:23<24:40:15,  3.35it/s]
 20%|█▉        | 73999/371472 [5:53:24<24:16:27,  3.40it/s]
 20%|█▉        | 74000/371472 [5:53:24<24:01:34,  3.44it/s]
                                                           
{'loss': 4.1883, 'learning_rate': 8.211015104828804e-07, 'epoch': 3.19}

 20%|█▉        | 74000/371472 [5:53:24<24:01:34,  3.44it/s]
 20%|█▉        | 74001/371472 [5:53:24<24:08:36,  3.42it/s]
 20%|█▉        | 74002/371472 [5:53:25<24:50:51,  3.33it/s]
 20%|█▉        | 74003/371472 [5:53:25<23:42:38,  3.48it/s]
 20%|█▉        | 74004/371472 [5:53:25<24:16:40,  3.40it/s]
 20%|█▉        | 74005/371472 [5:53:26<27:11:15,  3.04it/s]
 20%|█▉        | 74006/371472 [5:53:26<25:45:19,  3.21it/s]
 20%|█▉        | 74007/371472 [5:53:26<24:08:33,  3.42it/s]
 20%|█▉        | 74008/371472 [5:53:26<24:15:38,  3.41it/s]
 20%|█▉        | 74009/371472 [5:53:27<23:15:01,  3.55it/s]
 20%|█▉        | 74010/371472 [5:53:27<25:17:52,  3.27it/s]
 20%|█▉        | 74011/371472 [5:53:27<24:24:01,  3.39it/s]
 20%|█▉        | 74012/371472 [5:53:28<25:46:55,  3.20it/s]
 20%|█▉        | 74013/371472 [5:53:28<24:33:17,  3.37it/s]
 20%|█▉        | 74014/371472 [5:53:28<24:50:34,  3.33it/s]
 20%|█▉        | 74015/371472 [5:53:28<23:37:49,  3.50it/s]
 20%|█▉        | 74016/371472 [5:53:29<22:26:32,  3.68it/s]
 20%|█▉        | 74017/371472 [5:53:29<21:57:18,  3.76it/s]
 20%|█▉        | 74018/371472 [5:53:29<22:02:56,  3.75it/s]
 20%|█▉        | 74019/371472 [5:53:30<23:43:24,  3.48it/s]
 20%|█▉        | 74020/371472 [5:53:30<23:41:28,  3.49it/s]
                                                           
{'loss': 3.9912, 'learning_rate': 8.210530285074016e-07, 'epoch': 3.19}

 20%|█▉        | 74020/371472 [5:53:30<23:41:28,  3.49it/s]
 20%|█▉        | 74021/371472 [5:53:30<24:11:54,  3.41it/s]
 20%|█▉        | 74022/371472 [5:53:30<23:30:05,  3.52it/s]
 20%|█▉        | 74023/371472 [5:53:31<23:12:29,  3.56it/s]
 20%|█▉        | 74024/371472 [5:53:31<23:12:20,  3.56it/s]
 20%|█▉        | 74025/371472 [5:53:31<24:11:07,  3.42it/s]
 20%|█▉        | 74026/371472 [5:53:32<23:15:33,  3.55it/s]
 20%|█▉        | 74027/371472 [5:53:32<22:30:24,  3.67it/s]
 20%|█▉        | 74028/371472 [5:53:32<22:47:54,  3.62it/s]
 20%|█▉        | 74029/371472 [5:53:32<23:21:46,  3.54it/s]
 20%|█▉        | 74030/371472 [5:53:33<22:44:58,  3.63it/s]
 20%|█▉        | 74031/371472 [5:53:33<23:11:29,  3.56it/s]
 20%|█▉        | 74032/371472 [5:53:33<22:11:31,  3.72it/s]
 20%|█▉        | 74033/371472 [5:53:33<21:53:01,  3.78it/s]
 20%|█▉        | 74034/371472 [5:53:34<21:25:39,  3.86it/s]
 20%|█▉        | 74035/371472 [5:53:34<21:49:00,  3.79it/s]
 20%|█▉        | 74036/371472 [5:53:34<21:52:11,  3.78it/s]
 20%|█▉        | 74037/371472 [5:53:35<22:39:39,  3.65it/s]
 20%|█▉        | 74038/371472 [5:53:35<22:57:41,  3.60it/s]
 20%|█▉        | 74039/371472 [5:53:35<22:33:50,  3.66it/s]
 20%|█▉        | 74040/371472 [5:53:35<21:46:37,  3.79it/s]
                                                           
{'loss': 4.3197, 'learning_rate': 8.210045465319227e-07, 'epoch': 3.19}

 20%|█▉        | 74040/371472 [5:53:35<21:46:37,  3.79it/s]
 20%|█▉        | 74041/371472 [5:53:36<23:17:28,  3.55it/s]
 20%|█▉        | 74042/371472 [5:53:36<22:26:48,  3.68it/s]
 20%|█▉        | 74043/371472 [5:53:36<23:26:25,  3.52it/s]
 20%|█▉        | 74044/371472 [5:53:36<22:32:18,  3.67it/s]
 20%|█▉        | 74045/371472 [5:53:37<23:04:02,  3.58it/s]
 20%|█▉        | 74046/371472 [5:53:37<23:24:57,  3.53it/s]
 20%|█▉        | 74047/371472 [5:53:37<22:38:00,  3.65it/s]
 20%|█▉        | 74048/371472 [5:53:38<22:47:56,  3.62it/s]
 20%|█▉        | 74049/371472 [5:53:38<23:52:32,  3.46it/s]
 20%|█▉        | 74050/371472 [5:53:38<24:04:01,  3.43it/s]
 20%|█▉        | 74051/371472 [5:53:38<23:12:58,  3.56it/s]
 20%|█▉        | 74052/371472 [5:53:39<25:40:55,  3.22it/s]
 20%|█▉        | 74053/371472 [5:53:39<25:07:39,  3.29it/s]
 20%|█▉        | 74054/371472 [5:53:39<24:31:43,  3.37it/s]
 20%|█▉        | 74055/371472 [5:53:40<25:14:43,  3.27it/s]
 20%|█▉        | 74056/371472 [5:53:40<24:14:31,  3.41it/s]
 20%|█▉        | 74057/371472 [5:53:40<24:09:41,  3.42it/s]
 20%|█▉        | 74058/371472 [5:53:41<22:51:10,  3.62it/s]
 20%|█▉        | 74059/371472 [5:53:41<22:45:33,  3.63it/s]
 20%|█▉        | 74060/371472 [5:53:41<22:02:35,  3.75it/s]
                                                           
{'loss': 4.183, 'learning_rate': 8.209560645564437e-07, 'epoch': 3.19}

 20%|█▉        | 74060/371472 [5:53:41<22:02:35,  3.75it/s]
 20%|█▉        | 74061/371472 [5:53:41<22:19:29,  3.70it/s]
 20%|█▉        | 74062/371472 [5:53:42<22:13:02,  3.72it/s]
 20%|█▉        | 74063/371472 [5:53:42<21:40:36,  3.81it/s]
 20%|█▉        | 74064/371472 [5:53:42<21:42:10,  3.81it/s]
 20%|█▉        | 74065/371472 [5:53:42<22:17:27,  3.71it/s]
 20%|█▉        | 74066/371472 [5:53:43<22:20:20,  3.70it/s]
 20%|█▉        | 74067/371472 [5:53:43<21:48:50,  3.79it/s]
 20%|█▉        | 74068/371472 [5:53:43<21:28:13,  3.85it/s]
 20%|█▉        | 74069/371472 [5:53:43<20:51:07,  3.96it/s]
 20%|█▉        | 74070/371472 [5:53:44<21:34:10,  3.83it/s]
 20%|█▉        | 74071/371472 [5:53:44<23:54:58,  3.45it/s]
 20%|█▉        | 74072/371472 [5:53:44<23:04:05,  3.58it/s]
 20%|█▉        | 74073/371472 [5:53:45<23:15:29,  3.55it/s]
 20%|█▉        | 74074/371472 [5:53:45<23:37:47,  3.50it/s]
 20%|█▉        | 74075/371472 [5:53:45<23:25:27,  3.53it/s]
 20%|█▉        | 74076/371472 [5:53:45<23:30:35,  3.51it/s]
 20%|█▉        | 74077/371472 [5:53:46<24:52:58,  3.32it/s]
 20%|█▉        | 74078/371472 [5:53:46<23:27:04,  3.52it/s]
 20%|█▉        | 74079/371472 [5:53:46<23:13:50,  3.56it/s]
 20%|█▉        | 74080/371472 [5:53:47<22:46:00,  3.63it/s]
                                                           
{'loss': 4.1738, 'learning_rate': 8.209075825809648e-07, 'epoch': 3.19}

 20%|█▉        | 74080/371472 [5:53:47<22:46:00,  3.63it/s]
 20%|█▉        | 74081/371472 [5:53:47<23:20:54,  3.54it/s]
 20%|█▉        | 74082/371472 [5:53:47<22:55:47,  3.60it/s]
 20%|█▉        | 74083/371472 [5:53:47<22:44:59,  3.63it/s]
 20%|█▉        | 74084/371472 [5:53:48<21:53:03,  3.77it/s]
 20%|█▉        | 74085/371472 [5:53:48<22:28:22,  3.68it/s]
 20%|█▉        | 74086/371472 [5:53:48<22:30:18,  3.67it/s]
 20%|█▉        | 74087/371472 [5:53:49<23:40:25,  3.49it/s]
 20%|█▉        | 74088/371472 [5:53:49<22:52:01,  3.61it/s]
 20%|█▉        | 74089/371472 [5:53:49<22:15:35,  3.71it/s]
 20%|█▉        | 74090/371472 [5:53:49<25:09:13,  3.28it/s]
 20%|█▉        | 74091/371472 [5:53:50<24:24:58,  3.38it/s]
 20%|█▉        | 74092/371472 [5:53:50<23:39:30,  3.49it/s]
 20%|█▉        | 74093/371472 [5:53:50<23:19:09,  3.54it/s]
 20%|█▉        | 74094/371472 [5:53:50<22:49:52,  3.62it/s]
 20%|█▉        | 74095/371472 [5:53:51<23:52:46,  3.46it/s]
 20%|█▉        | 74096/371472 [5:53:51<23:59:26,  3.44it/s]
 20%|█▉        | 74097/371472 [5:53:51<23:31:41,  3.51it/s]
 20%|█▉        | 74098/371472 [5:53:52<24:41:16,  3.35it/s]
 20%|█▉        | 74099/371472 [5:53:52<24:15:38,  3.40it/s]
 20%|█▉        | 74100/371472 [5:53:52<25:30:54,  3.24it/s]
                                                           
{'loss': 4.2608, 'learning_rate': 8.20859100605486e-07, 'epoch': 3.19}

 20%|█▉        | 74100/371472 [5:53:52<25:30:54,  3.24it/s]
 20%|█▉        | 74101/371472 [5:53:53<24:11:02,  3.42it/s]
 20%|█▉        | 74102/371472 [5:53:53<23:30:58,  3.51it/s]
 20%|█▉        | 74103/371472 [5:53:53<23:15:52,  3.55it/s]
 20%|█▉        | 74104/371472 [5:53:53<23:58:23,  3.45it/s]
 20%|█▉        | 74105/371472 [5:53:54<23:37:42,  3.50it/s]
 20%|█▉        | 74106/371472 [5:53:54<22:44:51,  3.63it/s]
 20%|█▉        | 74107/371472 [5:53:54<22:21:07,  3.70it/s]
 20%|█▉        | 74108/371472 [5:53:55<23:45:24,  3.48it/s]
 20%|█▉        | 74109/371472 [5:53:55<22:21:30,  3.69it/s]
 20%|█▉        | 74110/371472 [5:53:55<21:47:37,  3.79it/s]
 20%|█▉        | 74111/371472 [5:53:55<22:21:30,  3.69it/s]
 20%|█▉        | 74112/371472 [5:53:56<22:57:44,  3.60it/s]
 20%|█▉        | 74113/371472 [5:53:56<22:17:51,  3.70it/s]
 20%|█▉        | 74114/371472 [5:53:56<23:16:07,  3.55it/s]
 20%|█▉        | 74115/371472 [5:53:56<24:26:46,  3.38it/s]
 20%|█▉        | 74116/371472 [5:53:57<23:35:17,  3.50it/s]
 20%|█▉        | 74117/371472 [5:53:57<22:55:03,  3.60it/s]
 20%|█▉        | 74118/371472 [5:53:57<23:21:52,  3.54it/s]
 20%|█▉        | 74119/371472 [5:53:58<22:14:29,  3.71it/s]
 20%|█▉        | 74120/371472 [5:53:58<23:36:37,  3.50it/s]
                                                           
{'loss': 4.0824, 'learning_rate': 8.208106186300071e-07, 'epoch': 3.19}

 20%|█▉        | 74120/371472 [5:53:58<23:36:37,  3.50it/s]
 20%|█▉        | 74121/371472 [5:53:58<23:15:27,  3.55it/s]
 20%|█▉        | 74122/371472 [5:53:58<23:14:14,  3.55it/s]
 20%|█▉        | 74123/371472 [5:53:59<24:46:23,  3.33it/s]
 20%|█▉        | 74124/371472 [5:53:59<25:48:27,  3.20it/s]
 20%|█▉        | 74125/371472 [5:53:59<24:32:52,  3.36it/s]
 20%|█▉        | 74126/371472 [5:54:00<23:52:43,  3.46it/s]
 20%|█▉        | 74127/371472 [5:54:00<23:51:08,  3.46it/s]
 20%|█▉        | 74128/371472 [5:54:00<23:28:54,  3.52it/s]
 20%|█▉        | 74129/371472 [5:54:00<22:39:27,  3.65it/s]
 20%|█▉        | 74130/371472 [5:54:01<22:42:56,  3.64it/s]
 20%|█▉        | 74131/371472 [5:54:01<23:09:13,  3.57it/s]
 20%|█▉        | 74132/371472 [5:54:01<23:36:37,  3.50it/s]
 20%|█▉        | 74133/371472 [5:54:02<23:40:04,  3.49it/s]
 20%|█▉        | 74134/371472 [5:54:02<23:17:46,  3.55it/s]
 20%|█▉        | 74135/371472 [5:54:02<24:41:04,  3.35it/s]
 20%|█▉        | 74136/371472 [5:54:02<23:34:06,  3.50it/s]
 20%|█▉        | 74137/371472 [5:54:03<24:21:47,  3.39it/s]
 20%|█▉        | 74138/371472 [5:54:03<23:08:42,  3.57it/s]
 20%|█▉        | 74139/371472 [5:54:03<23:08:59,  3.57it/s]
 20%|█▉        | 74140/371472 [5:54:04<23:55:06,  3.45it/s]
                                                           
{'loss': 4.1715, 'learning_rate': 8.207621366545282e-07, 'epoch': 3.19}

 20%|█▉        | 74140/371472 [5:54:04<23:55:06,  3.45it/s]
 20%|█▉        | 74141/371472 [5:54:04<23:42:56,  3.48it/s]
 20%|█▉        | 74142/371472 [5:54:04<22:50:34,  3.62it/s]
 20%|█▉        | 74143/371472 [5:54:04<22:38:01,  3.65it/s]
 20%|█▉        | 74144/371472 [5:54:05<21:56:51,  3.76it/s]
 20%|█▉        | 74145/371472 [5:54:05<21:10:26,  3.90it/s]
 20%|█▉        | 74146/371472 [5:54:05<21:40:24,  3.81it/s]
 20%|█▉        | 74147/371472 [5:54:05<21:25:32,  3.85it/s]
 20%|█▉        | 74148/371472 [5:54:06<21:37:20,  3.82it/s]
 20%|█▉        | 74149/371472 [5:54:06<22:15:50,  3.71it/s]
 20%|█▉        | 74150/371472 [5:54:06<23:01:55,  3.59it/s]
 20%|█▉        | 74151/371472 [5:54:07<21:52:35,  3.78it/s]
 20%|█▉        | 74152/371472 [5:54:07<21:41:11,  3.81it/s]
 20%|█▉        | 74153/371472 [5:54:07<21:43:50,  3.80it/s]
 20%|█▉        | 74154/371472 [5:54:07<22:30:31,  3.67it/s]
 20%|█▉        | 74155/371472 [5:54:08<24:11:00,  3.42it/s]
 20%|█▉        | 74156/371472 [5:54:08<24:01:10,  3.44it/s]
 20%|█▉        | 74157/371472 [5:54:08<23:31:50,  3.51it/s]
 20%|█▉        | 74158/371472 [5:54:08<22:56:34,  3.60it/s]
 20%|█▉        | 74159/371472 [5:54:09<22:04:34,  3.74it/s]
 20%|█▉        | 74160/371472 [5:54:09<22:30:48,  3.67it/s]
                                                           
{'loss': 4.0035, 'learning_rate': 8.207136546790493e-07, 'epoch': 3.19}

 20%|█▉        | 74160/371472 [5:54:09<22:30:48,  3.67it/s]
 20%|█▉        | 74161/371472 [5:54:09<22:00:28,  3.75it/s]
 20%|█▉        | 74162/371472 [5:54:10<22:33:41,  3.66it/s]
 20%|█▉        | 74163/371472 [5:54:10<22:41:43,  3.64it/s]
 20%|█▉        | 74164/371472 [5:54:10<22:34:38,  3.66it/s]
 20%|█▉        | 74165/371472 [5:54:10<22:18:14,  3.70it/s]
 20%|█▉        | 74166/371472 [5:54:11<23:17:07,  3.55it/s]
 20%|█▉        | 74167/371472 [5:54:11<25:47:07,  3.20it/s]
 20%|█▉        | 74168/371472 [5:54:11<24:21:05,  3.39it/s]
 20%|█▉        | 74169/371472 [5:54:12<25:21:50,  3.26it/s]
 20%|█▉        | 74170/371472 [5:54:12<26:04:42,  3.17it/s]
 20%|█▉        | 74171/371472 [5:54:12<24:55:34,  3.31it/s]
 20%|█▉        | 74172/371472 [5:54:13<24:39:20,  3.35it/s]
 20%|█▉        | 74173/371472 [5:54:13<25:50:36,  3.20it/s]
 20%|█▉        | 74174/371472 [5:54:13<24:18:58,  3.40it/s]
 20%|█▉        | 74175/371472 [5:54:13<23:52:16,  3.46it/s]
 20%|█▉        | 74176/371472 [5:54:14<28:25:45,  2.90it/s]
 20%|█▉        | 74177/371472 [5:54:14<28:00:27,  2.95it/s]
 20%|█▉        | 74178/371472 [5:54:14<26:16:13,  3.14it/s]
 20%|█▉        | 74179/371472 [5:54:15<24:24:55,  3.38it/s]
 20%|█▉        | 74180/371472 [5:54:15<24:49:55,  3.33it/s]
                                                           
{'loss': 4.2476, 'learning_rate': 8.206651727035705e-07, 'epoch': 3.2}

 20%|█▉        | 74180/371472 [5:54:15<24:49:55,  3.33it/s]
 20%|█▉        | 74181/371472 [5:54:15<23:36:01,  3.50it/s]
 20%|█▉        | 74182/371472 [5:54:16<22:28:34,  3.67it/s]
 20%|█▉        | 74183/371472 [5:54:16<22:56:30,  3.60it/s]
 20%|█▉        | 74184/371472 [5:54:16<22:52:51,  3.61it/s]
 20%|█▉        | 74185/371472 [5:54:16<22:41:56,  3.64it/s]
 20%|█▉        | 74186/371472 [5:54:17<22:27:50,  3.68it/s]
 20%|█▉        | 74187/371472 [5:54:17<22:04:37,  3.74it/s]
 20%|█▉        | 74188/371472 [5:54:17<21:50:26,  3.78it/s]
 20%|█▉        | 74189/371472 [5:54:17<21:19:01,  3.87it/s]
 20%|█▉        | 74190/371472 [5:54:18<20:48:24,  3.97it/s]
 20%|█▉        | 74191/371472 [5:54:18<20:13:39,  4.08it/s]
 20%|█▉        | 74192/371472 [5:54:18<21:59:13,  3.76it/s]
 20%|█▉        | 74193/371472 [5:54:18<22:53:40,  3.61it/s]
 20%|█▉        | 74194/371472 [5:54:19<23:09:31,  3.57it/s]
 20%|█▉        | 74195/371472 [5:54:19<23:06:57,  3.57it/s]
 20%|█▉        | 74196/371472 [5:54:19<25:27:12,  3.24it/s]
 20%|█▉        | 74197/371472 [5:54:20<25:08:22,  3.28it/s]
 20%|█▉        | 74198/371472 [5:54:20<25:45:20,  3.21it/s]
 20%|█▉        | 74199/371472 [5:54:20<25:28:08,  3.24it/s]
 20%|█▉        | 74200/371472 [5:54:21<23:43:13,  3.48it/s]
                                                           
{'loss': 4.189, 'learning_rate': 8.206166907280914e-07, 'epoch': 3.2}

 20%|█▉        | 74200/371472 [5:54:21<23:43:13,  3.48it/s]
 20%|█▉        | 74201/371472 [5:54:21<26:32:50,  3.11it/s]
 20%|█▉        | 74202/371472 [5:54:21<26:18:47,  3.14it/s]
 20%|█▉        | 74203/371472 [5:54:22<24:39:11,  3.35it/s]
 20%|█▉        | 74204/371472 [5:54:22<23:55:55,  3.45it/s]
 20%|█▉        | 74205/371472 [5:54:22<23:36:22,  3.50it/s]
 20%|█▉        | 74206/371472 [5:54:22<23:01:10,  3.59it/s]
 20%|█▉        | 74207/371472 [5:54:23<22:03:58,  3.74it/s]
 20%|█▉        | 74208/371472 [5:54:23<23:11:08,  3.56it/s]
 20%|█▉        | 74209/371472 [5:54:23<23:52:56,  3.46it/s]
 20%|█▉        | 74210/371472 [5:54:23<22:45:31,  3.63it/s]
 20%|█▉        | 74211/371472 [5:54:24<23:04:07,  3.58it/s]
 20%|█▉        | 74212/371472 [5:54:24<22:20:06,  3.70it/s]
 20%|█▉        | 74213/371472 [5:54:24<22:35:18,  3.66it/s]
 20%|█▉        | 74214/371472 [5:54:25<22:47:15,  3.62it/s]
 20%|█▉        | 74215/371472 [5:54:25<22:23:35,  3.69it/s]
 20%|█▉        | 74216/371472 [5:54:25<22:25:09,  3.68it/s]
 20%|█▉        | 74217/371472 [5:54:25<23:52:14,  3.46it/s]
 20%|█▉        | 74218/371472 [5:54:26<25:10:21,  3.28it/s]
 20%|█▉        | 74219/371472 [5:54:26<24:02:14,  3.44it/s]
 20%|█▉        | 74220/371472 [5:54:26<23:46:05,  3.47it/s]
                                                           
{'loss': 4.1405, 'learning_rate': 8.205682087526126e-07, 'epoch': 3.2}

 20%|█▉        | 74220/371472 [5:54:26<23:46:05,  3.47it/s]
 20%|█▉        | 74221/371472 [5:54:27<23:23:24,  3.53it/s]
 20%|█▉        | 74222/371472 [5:54:27<22:25:14,  3.68it/s]
 20%|█▉        | 74223/371472 [5:54:27<22:52:30,  3.61it/s]
 20%|█▉        | 74224/371472 [5:54:27<23:08:48,  3.57it/s]
 20%|█▉        | 74225/371472 [5:54:28<21:56:48,  3.76it/s]
 20%|█▉        | 74226/371472 [5:54:28<24:22:46,  3.39it/s]
 20%|█▉        | 74227/371472 [5:54:28<23:58:50,  3.44it/s]
 20%|█▉        | 74228/371472 [5:54:29<23:58:04,  3.44it/s]
 20%|█▉        | 74229/371472 [5:54:29<22:44:02,  3.63it/s]
 20%|█▉        | 74230/371472 [5:54:29<22:56:31,  3.60it/s]
 20%|█▉        | 74231/371472 [5:54:29<21:52:36,  3.77it/s]
 20%|█▉        | 74232/371472 [5:54:30<23:55:05,  3.45it/s]
 20%|█▉        | 74233/371472 [5:54:30<23:36:53,  3.50it/s]
 20%|█▉        | 74234/371472 [5:54:30<25:46:36,  3.20it/s]
 20%|█▉        | 74235/371472 [5:54:31<24:28:33,  3.37it/s]
 20%|█▉        | 74236/371472 [5:54:31<24:58:09,  3.31it/s]
 20%|█▉        | 74237/371472 [5:54:31<24:39:02,  3.35it/s]
 20%|█▉        | 74238/371472 [5:54:32<25:10:14,  3.28it/s]
 20%|█▉        | 74239/371472 [5:54:32<23:54:41,  3.45it/s]
 20%|█▉        | 74240/371472 [5:54:32<23:17:44,  3.54it/s]
                                                           
{'loss': 4.1466, 'learning_rate': 8.205197267771337e-07, 'epoch': 3.2}

 20%|█▉        | 74240/371472 [5:54:32<23:17:44,  3.54it/s]
 20%|█▉        | 74241/371472 [5:54:32<22:20:31,  3.70it/s]
 20%|█▉        | 74242/371472 [5:54:33<23:03:46,  3.58it/s]
 20%|█▉        | 74243/371472 [5:54:33<23:07:54,  3.57it/s]
 20%|█▉        | 74244/371472 [5:54:33<22:15:03,  3.71it/s]
 20%|█▉        | 74245/371472 [5:54:33<22:26:52,  3.68it/s]
 20%|█▉        | 74246/371472 [5:54:34<22:58:52,  3.59it/s]
 20%|█▉        | 74247/371472 [5:54:34<22:51:38,  3.61it/s]
 20%|█▉        | 74248/371472 [5:54:34<24:17:30,  3.40it/s]
 20%|█▉        | 74249/371472 [5:54:35<23:31:04,  3.51it/s]
 20%|█▉        | 74250/371472 [5:54:35<22:38:53,  3.65it/s]
 20%|█▉        | 74251/371472 [5:54:35<22:46:51,  3.62it/s]
 20%|█▉        | 74252/371472 [5:54:35<21:55:43,  3.76it/s]
 20%|█▉        | 74253/371472 [5:54:36<23:10:56,  3.56it/s]
 20%|█▉        | 74254/371472 [5:54:36<27:33:52,  3.00it/s]
 20%|█▉        | 74255/371472 [5:54:36<26:45:24,  3.09it/s]
 20%|█▉        | 74256/371472 [5:54:37<25:31:17,  3.23it/s]
 20%|█▉        | 74257/371472 [5:54:37<25:14:38,  3.27it/s]
 20%|█▉        | 74258/371472 [5:54:37<23:39:23,  3.49it/s]
 20%|█▉        | 74259/371472 [5:54:37<23:48:20,  3.47it/s]
 20%|█▉        | 74260/371472 [5:54:38<24:06:34,  3.42it/s]
                                                           
{'loss': 4.0237, 'learning_rate': 8.204712448016549e-07, 'epoch': 3.2}

 20%|█▉        | 74260/371472 [5:54:38<24:06:34,  3.42it/s]
 20%|█▉        | 74261/371472 [5:54:38<24:16:13,  3.40it/s]
 20%|█▉        | 74262/371472 [5:54:38<25:15:29,  3.27it/s]
 20%|█▉        | 74263/371472 [5:54:39<25:07:38,  3.29it/s]
 20%|█▉        | 74264/371472 [5:54:39<24:26:30,  3.38it/s]
 20%|█▉        | 74265/371472 [5:54:39<23:50:22,  3.46it/s]
 20%|█▉        | 74266/371472 [5:54:40<23:13:57,  3.55it/s]
 20%|█▉        | 74267/371472 [5:54:40<22:21:14,  3.69it/s]
 20%|█▉        | 74268/371472 [5:54:40<22:32:16,  3.66it/s]
 20%|█▉        | 74269/371472 [5:54:40<22:18:59,  3.70it/s]
 20%|█▉        | 74270/371472 [5:54:41<23:00:03,  3.59it/s]
 20%|█▉        | 74271/371472 [5:54:41<22:57:43,  3.60it/s]
 20%|█▉        | 74272/371472 [5:54:41<22:41:50,  3.64it/s]
 20%|█▉        | 74273/371472 [5:54:41<22:17:57,  3.70it/s]
 20%|█▉        | 74274/371472 [5:54:42<22:32:51,  3.66it/s]
 20%|█▉        | 74275/371472 [5:54:42<23:30:55,  3.51it/s]
 20%|█▉        | 74276/371472 [5:54:42<23:05:04,  3.58it/s]
 20%|█▉        | 74277/371472 [5:54:43<21:53:32,  3.77it/s]
 20%|█▉        | 74278/371472 [5:54:43<21:20:50,  3.87it/s]
 20%|█▉        | 74279/371472 [5:54:43<21:40:44,  3.81it/s]
 20%|█▉        | 74280/371472 [5:54:43<21:34:03,  3.83it/s]
                                                           
{'loss': 4.168, 'learning_rate': 8.204227628261759e-07, 'epoch': 3.2}

 20%|█▉        | 74280/371472 [5:54:43<21:34:03,  3.83it/s]
 20%|█▉        | 74281/371472 [5:54:44<23:29:08,  3.52it/s]
 20%|█▉        | 74282/371472 [5:54:44<23:01:55,  3.58it/s]
 20%|█▉        | 74283/371472 [5:54:44<23:06:10,  3.57it/s]
 20%|█▉        | 74284/371472 [5:54:44<23:16:25,  3.55it/s]
 20%|█▉        | 74285/371472 [5:54:45<23:07:11,  3.57it/s]
 20%|█▉        | 74286/371472 [5:54:45<26:09:20,  3.16it/s]
 20%|█▉        | 74287/371472 [5:54:45<25:29:47,  3.24it/s]
 20%|█▉        | 74288/371472 [5:54:46<24:05:07,  3.43it/s]
 20%|█▉        | 74289/371472 [5:54:46<24:05:32,  3.43it/s]
 20%|█▉        | 74290/371472 [5:54:46<24:54:15,  3.31it/s]
 20%|█▉        | 74291/371472 [5:54:47<24:06:04,  3.43it/s]
 20%|█▉        | 74292/371472 [5:54:47<23:24:34,  3.53it/s]
 20%|█▉        | 74293/371472 [5:54:47<23:29:47,  3.51it/s]
 20%|█▉        | 74294/371472 [5:54:47<24:16:30,  3.40it/s]
 20%|██        | 74295/371472 [5:54:48<28:20:16,  2.91it/s]
 20%|██        | 74296/371472 [5:54:48<26:02:47,  3.17it/s]
 20%|██        | 74297/371472 [5:54:48<25:30:20,  3.24it/s]
 20%|██        | 74298/371472 [5:54:49<24:47:37,  3.33it/s]
 20%|██        | 74299/371472 [5:54:49<24:09:03,  3.42it/s]
 20%|██        | 74300/371472 [5:54:49<23:47:18,  3.47it/s]
                                                           
{'loss': 4.1347, 'learning_rate': 8.203742808506972e-07, 'epoch': 3.2}

 20%|██        | 74300/371472 [5:54:49<23:47:18,  3.47it/s]
 20%|██        | 74301/371472 [5:54:50<24:09:49,  3.42it/s]
 20%|██        | 74302/371472 [5:54:50<24:23:08,  3.39it/s]
 20%|██        | 74303/371472 [5:54:50<23:34:46,  3.50it/s]
 20%|██        | 74304/371472 [5:54:50<23:01:10,  3.59it/s]
 20%|██        | 74305/371472 [5:54:51<24:28:05,  3.37it/s]
 20%|██        | 74306/371472 [5:54:51<24:23:39,  3.38it/s]
 20%|██        | 74307/371472 [5:54:51<24:53:05,  3.32it/s]
 20%|██        | 74308/371472 [5:54:52<23:52:48,  3.46it/s]
 20%|██        | 74309/371472 [5:54:52<24:01:47,  3.44it/s]
 20%|██        | 74310/371472 [5:54:52<24:07:02,  3.42it/s]
 20%|██        | 74311/371472 [5:54:52<23:46:04,  3.47it/s]
 20%|██        | 74312/371472 [5:54:53<24:19:19,  3.39it/s]
 20%|██        | 74313/371472 [5:54:53<23:22:38,  3.53it/s]
 20%|██        | 74314/371472 [5:54:53<24:08:05,  3.42it/s]
 20%|██        | 74315/371472 [5:54:54<23:00:12,  3.59it/s]
 20%|██        | 74316/371472 [5:54:54<23:52:40,  3.46it/s]
 20%|██        | 74317/371472 [5:54:54<23:08:21,  3.57it/s]
 20%|██        | 74318/371472 [5:54:54<22:57:26,  3.60it/s]
 20%|██        | 74319/371472 [5:54:55<22:06:09,  3.73it/s]
 20%|██        | 74320/371472 [5:54:55<22:32:08,  3.66it/s]
                                                           
{'loss': 3.9789, 'learning_rate': 8.203257988752181e-07, 'epoch': 3.2}

 20%|██        | 74320/371472 [5:54:55<22:32:08,  3.66it/s]
 20%|██        | 74321/371472 [5:54:55<22:10:49,  3.72it/s]
 20%|██        | 74322/371472 [5:54:56<22:07:54,  3.73it/s]
 20%|██        | 74323/371472 [5:54:56<21:47:10,  3.79it/s]
 20%|██        | 74324/371472 [5:54:56<26:34:02,  3.11it/s]
 20%|██        | 74325/371472 [5:54:56<25:05:39,  3.29it/s]
 20%|██        | 74326/371472 [5:54:57<24:10:54,  3.41it/s]
 20%|██        | 74327/371472 [5:54:57<23:40:06,  3.49it/s]
 20%|██        | 74328/371472 [5:54:57<23:10:30,  3.56it/s]
 20%|██        | 74329/371472 [5:54:58<23:03:35,  3.58it/s]
 20%|██        | 74330/371472 [5:54:58<23:46:42,  3.47it/s]
 20%|██        | 74331/371472 [5:54:58<27:02:54,  3.05it/s]
 20%|██        | 74332/371472 [5:54:59<25:48:25,  3.20it/s]
 20%|██        | 74333/371472 [5:54:59<29:30:45,  2.80it/s]
 20%|██        | 74334/371472 [5:54:59<27:26:08,  3.01it/s]
 20%|██        | 74335/371472 [5:55:00<28:06:05,  2.94it/s]
 20%|██        | 74336/371472 [5:55:00<27:58:24,  2.95it/s]
 20%|██        | 74337/371472 [5:55:00<26:15:44,  3.14it/s]
 20%|██        | 74338/371472 [5:55:01<27:25:06,  3.01it/s]
 20%|██        | 74339/371472 [5:55:01<26:13:18,  3.15it/s]
 20%|██        | 74340/371472 [5:55:01<24:39:12,  3.35it/s]
                                                           
{'loss': 3.9598, 'learning_rate': 8.202773168997392e-07, 'epoch': 3.2}

 20%|██        | 74340/371472 [5:55:01<24:39:12,  3.35it/s]
 20%|██        | 74341/371472 [5:55:01<24:59:27,  3.30it/s]
 20%|██        | 74342/371472 [5:55:02<24:05:07,  3.43it/s]
 20%|██        | 74343/371472 [5:55:02<25:03:33,  3.29it/s]
 20%|██        | 74344/371472 [5:55:02<24:14:52,  3.40it/s]
 20%|██        | 74345/371472 [5:55:03<23:05:32,  3.57it/s]
 20%|██        | 74346/371472 [5:55:03<21:55:02,  3.77it/s]
 20%|██        | 74347/371472 [5:55:03<22:43:31,  3.63it/s]
 20%|██        | 74348/371472 [5:55:03<22:20:46,  3.69it/s]
 20%|██        | 74349/371472 [5:55:04<22:12:00,  3.72it/s]
 20%|██        | 74350/371472 [5:55:04<21:43:26,  3.80it/s]
 20%|██        | 74351/371472 [5:55:04<23:27:28,  3.52it/s]
 20%|██        | 74352/371472 [5:55:05<25:34:06,  3.23it/s]
 20%|██        | 74353/371472 [5:55:05<25:43:58,  3.21it/s]
 20%|██        | 74354/371472 [5:55:05<24:52:16,  3.32it/s]
 20%|██        | 74355/371472 [5:55:06<26:01:06,  3.17it/s]
 20%|██        | 74356/371472 [5:55:06<25:22:07,  3.25it/s]
 20%|██        | 74357/371472 [5:55:06<25:43:51,  3.21it/s]
 20%|██        | 74358/371472 [5:55:06<24:51:35,  3.32it/s]
 20%|██        | 74359/371472 [5:55:07<23:33:32,  3.50it/s]
 20%|██        | 74360/371472 [5:55:07<23:18:52,  3.54it/s]
                                                           
{'loss': 3.911, 'learning_rate': 8.202288349242603e-07, 'epoch': 3.2}

 20%|██        | 74360/371472 [5:55:07<23:18:52,  3.54it/s]
 20%|██        | 74361/371472 [5:55:07<22:35:16,  3.65it/s]
 20%|██        | 74362/371472 [5:55:07<21:50:48,  3.78it/s]
 20%|██        | 74363/371472 [5:55:08<22:16:57,  3.70it/s]
 20%|██        | 74364/371472 [5:55:08<22:29:28,  3.67it/s]
 20%|██        | 74365/371472 [5:55:08<22:34:15,  3.66it/s]
 20%|██        | 74366/371472 [5:55:09<22:14:26,  3.71it/s]
 20%|██        | 74367/371472 [5:55:09<23:03:28,  3.58it/s]
 20%|██        | 74368/371472 [5:55:09<22:46:58,  3.62it/s]
 20%|██        | 74369/371472 [5:55:09<22:03:31,  3.74it/s]
 20%|██        | 74370/371472 [5:55:10<21:42:13,  3.80it/s]
 20%|██        | 74371/371472 [5:55:10<22:01:24,  3.75it/s]
 20%|██        | 74372/371472 [5:55:10<22:29:06,  3.67it/s]
 20%|██        | 74373/371472 [5:55:10<23:13:01,  3.55it/s]
 20%|██        | 74374/371472 [5:55:11<23:12:18,  3.56it/s]
 20%|██        | 74375/371472 [5:55:11<22:18:00,  3.70it/s]
 20%|██        | 74376/371472 [5:55:11<22:12:50,  3.72it/s]
 20%|██        | 74377/371472 [5:55:12<22:16:49,  3.70it/s]
 20%|██        | 74378/371472 [5:55:12<22:28:18,  3.67it/s]
 20%|██        | 74379/371472 [5:55:12<22:09:23,  3.72it/s]
 20%|██        | 74380/371472 [5:55:12<21:30:54,  3.84it/s]
                                                           
{'loss': 4.0397, 'learning_rate': 8.201803529487815e-07, 'epoch': 3.2}

 20%|██        | 74380/371472 [5:55:12<21:30:54,  3.84it/s]
 20%|██        | 74381/371472 [5:55:13<22:55:41,  3.60it/s]
 20%|██        | 74382/371472 [5:55:13<23:22:53,  3.53it/s]
 20%|██        | 74383/371472 [5:55:13<23:16:03,  3.55it/s]
 20%|██        | 74384/371472 [5:55:14<23:34:32,  3.50it/s]
 20%|██        | 74385/371472 [5:55:14<23:32:02,  3.51it/s]
 20%|██        | 74386/371472 [5:55:14<22:33:22,  3.66it/s]
 20%|██        | 74387/371472 [5:55:14<23:11:01,  3.56it/s]
 20%|██        | 74388/371472 [5:55:15<22:54:11,  3.60it/s]
 20%|██        | 74389/371472 [5:55:15<24:12:24,  3.41it/s]
 20%|██        | 74390/371472 [5:55:15<24:18:26,  3.39it/s]
 20%|██        | 74391/371472 [5:55:16<25:59:13,  3.18it/s]
 20%|██        | 74392/371472 [5:55:16<24:44:43,  3.33it/s]
 20%|██        | 74393/371472 [5:55:16<24:52:17,  3.32it/s]
 20%|██        | 74394/371472 [5:55:16<24:47:44,  3.33it/s]
 20%|██        | 74395/371472 [5:55:17<23:48:26,  3.47it/s]
 20%|██        | 74396/371472 [5:55:17<25:19:46,  3.26it/s]
 20%|██        | 74397/371472 [5:55:17<24:28:26,  3.37it/s]
 20%|██        | 74398/371472 [5:55:18<25:01:00,  3.30it/s]
 20%|██        | 74399/371472 [5:55:18<24:33:05,  3.36it/s]
 20%|██        | 74400/371472 [5:55:18<24:25:12,  3.38it/s]
                                                           
{'loss': 4.0569, 'learning_rate': 8.201318709733026e-07, 'epoch': 3.2}

 20%|██        | 74400/371472 [5:55:18<24:25:12,  3.38it/s]
 20%|██        | 74401/371472 [5:55:18<22:57:32,  3.59it/s]
 20%|██        | 74402/371472 [5:55:19<22:54:53,  3.60it/s]
 20%|██        | 74403/371472 [5:55:19<24:23:31,  3.38it/s]
 20%|██        | 74404/371472 [5:55:19<24:03:40,  3.43it/s]
 20%|██        | 74405/371472 [5:55:20<24:09:20,  3.42it/s]
 20%|██        | 74406/371472 [5:55:20<23:42:57,  3.48it/s]
 20%|██        | 74407/371472 [5:55:20<23:32:29,  3.51it/s]
 20%|██        | 74408/371472 [5:55:21<23:36:47,  3.49it/s]
 20%|██        | 74409/371472 [5:55:21<23:04:47,  3.58it/s]
 20%|██        | 74410/371472 [5:55:21<22:06:18,  3.73it/s]
 20%|██        | 74411/371472 [5:55:21<22:57:45,  3.59it/s]
 20%|██        | 74412/371472 [5:55:22<23:02:54,  3.58it/s]
 20%|██        | 74413/371472 [5:55:22<24:11:50,  3.41it/s]
 20%|██        | 74414/371472 [5:55:22<23:54:11,  3.45it/s]
 20%|██        | 74415/371472 [5:55:23<23:36:34,  3.50it/s]
 20%|██        | 74416/371472 [5:55:23<23:42:42,  3.48it/s]
 20%|██        | 74417/371472 [5:55:23<24:00:28,  3.44it/s]
 20%|██        | 74418/371472 [5:55:23<23:03:18,  3.58it/s]
 20%|██        | 74419/371472 [5:55:24<23:25:51,  3.52it/s]
 20%|██        | 74420/371472 [5:55:24<22:36:33,  3.65it/s]
                                                           
{'loss': 4.0304, 'learning_rate': 8.200833889978237e-07, 'epoch': 3.21}

 20%|██        | 74420/371472 [5:55:24<22:36:33,  3.65it/s]
 20%|██        | 74421/371472 [5:55:24<22:28:35,  3.67it/s]
 20%|██        | 74422/371472 [5:55:24<22:12:17,  3.72it/s]
 20%|██        | 74423/371472 [5:55:25<21:33:42,  3.83it/s]
 20%|██        | 74424/371472 [5:55:25<22:08:39,  3.73it/s]
 20%|██        | 74425/371472 [5:55:25<21:26:10,  3.85it/s]
 20%|██        | 74426/371472 [5:55:25<22:22:23,  3.69it/s]
 20%|██        | 74427/371472 [5:55:26<22:35:24,  3.65it/s]
 20%|██        | 74428/371472 [5:55:26<22:58:14,  3.59it/s]
 20%|██        | 74429/371472 [5:55:26<24:57:12,  3.31it/s]
 20%|██        | 74430/371472 [5:55:27<24:30:46,  3.37it/s]
 20%|██        | 74431/371472 [5:55:27<23:56:04,  3.45it/s]
 20%|██        | 74432/371472 [5:55:27<23:26:03,  3.52it/s]
 20%|██        | 74433/371472 [5:55:28<24:20:43,  3.39it/s]
 20%|██        | 74434/371472 [5:55:28<24:07:41,  3.42it/s]
 20%|██        | 74435/371472 [5:55:28<24:14:46,  3.40it/s]
 20%|██        | 74436/371472 [5:55:28<24:15:29,  3.40it/s]
 20%|██        | 74437/371472 [5:55:29<23:25:59,  3.52it/s]
 20%|██        | 74438/371472 [5:55:29<23:22:09,  3.53it/s]
 20%|██        | 74439/371472 [5:55:29<23:44:44,  3.47it/s]
 20%|██        | 74440/371472 [5:55:30<23:45:18,  3.47it/s]
                                                           
{'loss': 4.16, 'learning_rate': 8.200349070223447e-07, 'epoch': 3.21}

 20%|██        | 74440/371472 [5:55:30<23:45:18,  3.47it/s]
 20%|██        | 74441/371472 [5:55:30<25:10:23,  3.28it/s]
 20%|██        | 74442/371472 [5:55:30<24:28:01,  3.37it/s]
 20%|██        | 74443/371472 [5:55:30<24:09:01,  3.42it/s]
 20%|██        | 74444/371472 [5:55:31<23:28:57,  3.51it/s]
 20%|██        | 74445/371472 [5:55:31<22:35:15,  3.65it/s]
 20%|██        | 74446/371472 [5:55:31<25:47:14,  3.20it/s]
 20%|██        | 74447/371472 [5:55:32<27:11:29,  3.03it/s]
 20%|██        | 74448/371472 [5:55:32<25:56:48,  3.18it/s]
 20%|██        | 74449/371472 [5:55:32<24:41:14,  3.34it/s]
 20%|██        | 74450/371472 [5:55:33<24:03:22,  3.43it/s]
 20%|██        | 74451/371472 [5:55:33<22:59:37,  3.59it/s]
 20%|██        | 74452/371472 [5:55:33<21:58:30,  3.75it/s]
 20%|██        | 74453/371472 [5:55:33<21:11:36,  3.89it/s]
 20%|██        | 74454/371472 [5:55:34<22:09:21,  3.72it/s]
 20%|██        | 74455/371472 [5:55:34<23:16:09,  3.55it/s]
 20%|██        | 74456/371472 [5:55:34<22:38:17,  3.64it/s]
 20%|██        | 74457/371472 [5:55:34<23:17:56,  3.54it/s]
 20%|██        | 74458/371472 [5:55:35<22:29:58,  3.67it/s]
 20%|██        | 74459/371472 [5:55:35<23:42:30,  3.48it/s]
 20%|██        | 74460/371472 [5:55:35<22:47:46,  3.62it/s]
                                                           
{'loss': 4.3619, 'learning_rate': 8.199864250468658e-07, 'epoch': 3.21}

 20%|██        | 74460/371472 [5:55:35<22:47:46,  3.62it/s]
 20%|██        | 74461/371472 [5:55:36<22:56:02,  3.60it/s]
 20%|██        | 74462/371472 [5:55:36<23:39:05,  3.49it/s]
 20%|██        | 74463/371472 [5:55:36<23:42:09,  3.48it/s]
 20%|██        | 74464/371472 [5:55:36<23:22:51,  3.53it/s]
 20%|██        | 74465/371472 [5:55:37<23:45:11,  3.47it/s]
 20%|██        | 74466/371472 [5:55:37<23:06:39,  3.57it/s]
 20%|██        | 74467/371472 [5:55:37<22:25:52,  3.68it/s]
 20%|██        | 74468/371472 [5:55:38<22:46:18,  3.62it/s]
 20%|██        | 74469/371472 [5:55:38<22:06:36,  3.73it/s]
 20%|██        | 74470/371472 [5:55:38<23:42:20,  3.48it/s]
 20%|██        | 74471/371472 [5:55:38<23:32:29,  3.50it/s]
 20%|██        | 74472/371472 [5:55:39<22:30:39,  3.66it/s]
 20%|██        | 74473/371472 [5:55:39<22:43:07,  3.63it/s]
 20%|██        | 74474/371472 [5:55:39<22:30:15,  3.67it/s]
 20%|██        | 74475/371472 [5:55:40<23:29:12,  3.51it/s]
 20%|██        | 74476/371472 [5:55:40<23:54:46,  3.45it/s]
 20%|██        | 74477/371472 [5:55:40<24:06:54,  3.42it/s]
 20%|██        | 74478/371472 [5:55:40<23:37:53,  3.49it/s]
 20%|██        | 74479/371472 [5:55:41<27:33:57,  2.99it/s]
 20%|██        | 74480/371472 [5:55:41<25:33:10,  3.23it/s]
                                                           
{'loss': 4.2681, 'learning_rate': 8.19937943071387e-07, 'epoch': 3.21}

 20%|██        | 74480/371472 [5:55:41<25:33:10,  3.23it/s]
 20%|██        | 74481/371472 [5:55:41<23:52:45,  3.45it/s]
 20%|██        | 74482/371472 [5:55:42<23:07:41,  3.57it/s]
 20%|██        | 74483/371472 [5:55:42<22:37:59,  3.64it/s]
 20%|██        | 74484/371472 [5:55:42<22:08:52,  3.72it/s]
 20%|██        | 74485/371472 [5:55:42<23:26:52,  3.52it/s]
 20%|██        | 74486/371472 [5:55:43<23:34:57,  3.50it/s]
 20%|██        | 74487/371472 [5:55:43<22:56:32,  3.60it/s]
 20%|██        | 74488/371472 [5:55:43<22:38:26,  3.64it/s]
 20%|██        | 74489/371472 [5:55:44<22:36:41,  3.65it/s]
 20%|██        | 74490/371472 [5:55:44<22:01:42,  3.74it/s]
 20%|██        | 74491/371472 [5:55:44<21:42:17,  3.80it/s]
 20%|██        | 74492/371472 [5:55:44<22:07:23,  3.73it/s]
 20%|██        | 74493/371472 [5:55:45<23:00:44,  3.58it/s]
 20%|██        | 74494/371472 [5:55:45<22:53:53,  3.60it/s]
 20%|██        | 74495/371472 [5:55:45<23:09:08,  3.56it/s]
 20%|██        | 74496/371472 [5:55:45<23:32:16,  3.50it/s]
 20%|██        | 74497/371472 [5:55:46<23:14:36,  3.55it/s]
 20%|██        | 74498/371472 [5:55:46<23:51:20,  3.46it/s]
 20%|██        | 74499/371472 [5:55:46<24:12:11,  3.41it/s]
 20%|██        | 74500/371472 [5:55:47<22:53:58,  3.60it/s]
                                                           
{'loss': 4.1484, 'learning_rate': 8.198894610959081e-07, 'epoch': 3.21}

 20%|██        | 74500/371472 [5:55:47<22:53:58,  3.60it/s]
 20%|██        | 74501/371472 [5:55:47<23:10:53,  3.56it/s]
 20%|██        | 74502/371472 [5:55:47<23:02:43,  3.58it/s]
 20%|██        | 74503/371472 [5:55:47<22:57:06,  3.59it/s]
 20%|██        | 74504/371472 [5:55:48<21:58:54,  3.75it/s]
 20%|██        | 74505/371472 [5:55:48<22:04:30,  3.74it/s]
 20%|██        | 74506/371472 [5:55:48<22:04:23,  3.74it/s]
 20%|██        | 74507/371472 [5:55:48<22:18:30,  3.70it/s]
 20%|██        | 74508/371472 [5:55:49<23:34:53,  3.50it/s]
 20%|██        | 74509/371472 [5:55:49<23:29:21,  3.51it/s]
 20%|██        | 74510/371472 [5:55:49<23:14:03,  3.55it/s]
 20%|██        | 74511/371472 [5:55:50<25:55:10,  3.18it/s]
 20%|██        | 74512/371472 [5:55:50<24:29:23,  3.37it/s]
 20%|██        | 74513/371472 [5:55:50<25:27:17,  3.24it/s]
 20%|██        | 74514/371472 [5:55:51<26:04:51,  3.16it/s]
 20%|██        | 74515/371472 [5:55:51<24:49:34,  3.32it/s]
 20%|██        | 74516/371472 [5:55:51<26:41:33,  3.09it/s]
 20%|██        | 74517/371472 [5:55:52<25:59:14,  3.17it/s]
 20%|██        | 74518/371472 [5:55:52<27:23:06,  3.01it/s]
 20%|██        | 74519/371472 [5:55:52<25:22:59,  3.25it/s]
 20%|██        | 74520/371472 [5:55:52<24:01:26,  3.43it/s]
                                                           
{'loss': 4.0033, 'learning_rate': 8.198409791204292e-07, 'epoch': 3.21}

 20%|██        | 74520/371472 [5:55:52<24:01:26,  3.43it/s]
 20%|██        | 74521/371472 [5:55:53<24:22:07,  3.38it/s]
 20%|██        | 74522/371472 [5:55:53<23:20:41,  3.53it/s]
 20%|██        | 74523/371472 [5:55:53<23:13:28,  3.55it/s]
 20%|██        | 74524/371472 [5:55:54<23:31:28,  3.51it/s]
 20%|██        | 74525/371472 [5:55:54<22:41:41,  3.63it/s]
 20%|██        | 74526/371472 [5:55:54<22:02:04,  3.74it/s]
 20%|██        | 74527/371472 [5:55:54<21:56:40,  3.76it/s]
 20%|██        | 74528/371472 [5:55:55<22:03:29,  3.74it/s]
 20%|██        | 74529/371472 [5:55:55<21:57:42,  3.76it/s]
 20%|██        | 74530/371472 [5:55:55<22:29:22,  3.67it/s]
 20%|██        | 74531/371472 [5:55:55<22:19:12,  3.70it/s]
 20%|██        | 74532/371472 [5:55:56<23:55:02,  3.45it/s]
 20%|██        | 74533/371472 [5:55:56<23:48:26,  3.46it/s]
 20%|██        | 74534/371472 [5:55:56<24:03:55,  3.43it/s]
 20%|██        | 74535/371472 [5:55:57<24:10:43,  3.41it/s]
 20%|██        | 74536/371472 [5:55:57<25:26:56,  3.24it/s]
 20%|██        | 74537/371472 [5:55:57<25:53:42,  3.19it/s]
 20%|██        | 74538/371472 [5:55:58<24:35:49,  3.35it/s]
 20%|██        | 74539/371472 [5:55:58<24:13:28,  3.40it/s]
 20%|██        | 74540/371472 [5:55:58<24:11:24,  3.41it/s]
                                                           
{'loss': 4.0437, 'learning_rate': 8.197924971449503e-07, 'epoch': 3.21}

 20%|██        | 74540/371472 [5:55:58<24:11:24,  3.41it/s]
 20%|██        | 74541/371472 [5:55:58<23:33:44,  3.50it/s]
 20%|██        | 74542/371472 [5:55:59<23:16:15,  3.54it/s]
 20%|██        | 74543/371472 [5:55:59<24:03:04,  3.43it/s]
 20%|██        | 74544/371472 [5:55:59<23:48:37,  3.46it/s]
 20%|██        | 74545/371472 [5:56:00<24:19:39,  3.39it/s]
 20%|██        | 74546/371472 [5:56:00<23:42:07,  3.48it/s]
 20%|██        | 74547/371472 [5:56:00<23:07:06,  3.57it/s]
 20%|██        | 74548/371472 [5:56:00<22:52:46,  3.60it/s]
 20%|██        | 74549/371472 [5:56:01<22:13:18,  3.71it/s]
 20%|██        | 74550/371472 [5:56:01<23:35:26,  3.50it/s]
 20%|██        | 74551/371472 [5:56:01<24:18:06,  3.39it/s]
 20%|██        | 74552/371472 [5:56:02<23:16:50,  3.54it/s]
 20%|██        | 74553/371472 [5:56:02<23:25:43,  3.52it/s]
 20%|██        | 74554/371472 [5:56:02<22:27:59,  3.67it/s]
 20%|██        | 74555/371472 [5:56:02<21:52:44,  3.77it/s]
 20%|██        | 74556/371472 [5:56:03<22:29:37,  3.67it/s]
 20%|██        | 74557/371472 [5:56:03<22:23:32,  3.68it/s]
 20%|██        | 74558/371472 [5:56:03<22:11:42,  3.72it/s]
 20%|██        | 74559/371472 [5:56:03<21:48:44,  3.78it/s]
 20%|██        | 74560/371472 [5:56:04<21:08:59,  3.90it/s]
                                                           
{'loss': 4.1846, 'learning_rate': 8.197440151694715e-07, 'epoch': 3.21}

 20%|██        | 74560/371472 [5:56:04<21:08:59,  3.90it/s]
 20%|██        | 74561/371472 [5:56:04<21:05:30,  3.91it/s]
 20%|██        | 74562/371472 [5:56:04<21:24:27,  3.85it/s]
 20%|██        | 74563/371472 [5:56:04<21:16:18,  3.88it/s]
 20%|██        | 74564/371472 [5:56:05<24:08:33,  3.42it/s]
 20%|██        | 74565/371472 [5:56:05<24:42:38,  3.34it/s]
 20%|██        | 74566/371472 [5:56:06<26:08:27,  3.15it/s]
 20%|██        | 74567/371472 [5:56:06<24:52:15,  3.32it/s]
 20%|██        | 74568/371472 [5:56:06<23:57:52,  3.44it/s]
 20%|██        | 74569/371472 [5:56:06<22:55:31,  3.60it/s]
 20%|██        | 74570/371472 [5:56:07<22:21:41,  3.69it/s]
 20%|██        | 74571/371472 [5:56:07<21:59:16,  3.75it/s]
 20%|██        | 74572/371472 [5:56:07<21:43:21,  3.80it/s]
 20%|██        | 74573/371472 [5:56:07<22:55:49,  3.60it/s]
 20%|██        | 74574/371472 [5:56:08<24:29:13,  3.37it/s]
 20%|██        | 74575/371472 [5:56:08<25:58:29,  3.18it/s]
 20%|██        | 74576/371472 [5:56:08<27:02:07,  3.05it/s]
 20%|██        | 74577/371472 [5:56:09<26:24:49,  3.12it/s]
 20%|██        | 74578/371472 [5:56:09<25:40:27,  3.21it/s]
 20%|██        | 74579/371472 [5:56:09<24:30:41,  3.36it/s]
 20%|██        | 74580/371472 [5:56:10<23:37:02,  3.49it/s]
                                                           
{'loss': 4.3057, 'learning_rate': 8.196955331939925e-07, 'epoch': 3.21}

 20%|██        | 74580/371472 [5:56:10<23:37:02,  3.49it/s]
 20%|██        | 74581/371472 [5:56:10<23:24:51,  3.52it/s]
 20%|██        | 74582/371472 [5:56:10<23:28:49,  3.51it/s]
 20%|██        | 74583/371472 [5:56:10<22:17:21,  3.70it/s]
 20%|██        | 74584/371472 [5:56:11<21:56:49,  3.76it/s]
 20%|██        | 74585/371472 [5:56:11<22:33:11,  3.66it/s]
 20%|██        | 74586/371472 [5:56:11<22:28:41,  3.67it/s]
 20%|██        | 74587/371472 [5:56:12<31:31:59,  2.62it/s]
 20%|██        | 74588/371472 [5:56:12<29:24:58,  2.80it/s]
 20%|██        | 74589/371472 [5:56:12<29:07:13,  2.83it/s]
 20%|██        | 74590/371472 [5:56:13<26:16:58,  3.14it/s]
 20%|██        | 74591/371472 [5:56:13<24:16:11,  3.40it/s]
 20%|██        | 74592/371472 [5:56:13<22:53:51,  3.60it/s]
 20%|██        | 74593/371472 [5:56:13<24:42:13,  3.34it/s]
 20%|██        | 74594/371472 [5:56:14<23:47:40,  3.47it/s]
 20%|██        | 74595/371472 [5:56:14<26:28:16,  3.12it/s]
 20%|██        | 74596/371472 [5:56:14<24:59:36,  3.30it/s]
 20%|██        | 74597/371472 [5:56:15<23:26:53,  3.52it/s]
 20%|██        | 74598/371472 [5:56:15<25:08:35,  3.28it/s]
 20%|██        | 74599/371472 [5:56:15<25:06:34,  3.28it/s]
 20%|██        | 74600/371472 [5:56:16<27:00:56,  3.05it/s]
                                                           
{'loss': 4.0408, 'learning_rate': 8.196470512185136e-07, 'epoch': 3.21}

 20%|██        | 74600/371472 [5:56:16<27:00:56,  3.05it/s]
 20%|██        | 74601/371472 [5:56:16<25:31:04,  3.23it/s]
 20%|██        | 74602/371472 [5:56:16<24:06:16,  3.42it/s]
 20%|██        | 74603/371472 [5:56:16<23:12:55,  3.55it/s]
 20%|██        | 74604/371472 [5:56:17<23:31:51,  3.50it/s]
 20%|██        | 74605/371472 [5:56:17<23:09:30,  3.56it/s]
 20%|██        | 74606/371472 [5:56:17<23:03:25,  3.58it/s]
 20%|██        | 74607/371472 [5:56:18<22:42:50,  3.63it/s]
 20%|██        | 74608/371472 [5:56:18<22:21:41,  3.69it/s]
 20%|██        | 74609/371472 [5:56:18<24:48:20,  3.32it/s]
 20%|██        | 74610/371472 [5:56:19<24:51:08,  3.32it/s]
 20%|██        | 74611/371472 [5:56:19<23:51:34,  3.46it/s]
 20%|██        | 74612/371472 [5:56:19<24:41:59,  3.34it/s]
 20%|██        | 74613/371472 [5:56:19<23:41:55,  3.48it/s]
 20%|██        | 74614/371472 [5:56:20<23:31:00,  3.51it/s]
 20%|██        | 74615/371472 [5:56:20<23:58:55,  3.44it/s]
 20%|██        | 74616/371472 [5:56:20<23:39:06,  3.49it/s]
 20%|██        | 74617/371472 [5:56:21<23:59:40,  3.44it/s]
 20%|██        | 74618/371472 [5:56:21<23:51:50,  3.46it/s]
 20%|██        | 74619/371472 [5:56:21<22:40:58,  3.64it/s]
 20%|██        | 74620/371472 [5:56:21<22:01:35,  3.74it/s]
                                                           
{'loss': 4.1349, 'learning_rate': 8.195985692430348e-07, 'epoch': 3.21}

 20%|██        | 74620/371472 [5:56:21<22:01:35,  3.74it/s]
 20%|██        | 74621/371472 [5:56:22<22:17:47,  3.70it/s]
 20%|██        | 74622/371472 [5:56:22<23:35:30,  3.50it/s]
 20%|██        | 74623/371472 [5:56:22<22:36:35,  3.65it/s]
 20%|██        | 74624/371472 [5:56:22<22:56:43,  3.59it/s]
 20%|██        | 74625/371472 [5:56:23<23:08:09,  3.56it/s]
 20%|██        | 74626/371472 [5:56:23<22:46:45,  3.62it/s]
 20%|██        | 74627/371472 [5:56:23<23:30:34,  3.51it/s]
 20%|██        | 74628/371472 [5:56:24<22:42:23,  3.63it/s]
 20%|██        | 74629/371472 [5:56:24<22:19:34,  3.69it/s]
 20%|██        | 74630/371472 [5:56:24<22:11:40,  3.72it/s]
 20%|██        | 74631/371472 [5:56:24<22:28:09,  3.67it/s]
 20%|██        | 74632/371472 [5:56:25<22:34:00,  3.65it/s]
 20%|██        | 74633/371472 [5:56:25<22:46:02,  3.62it/s]
 20%|██        | 74634/371472 [5:56:25<22:40:05,  3.64it/s]
 20%|██        | 74635/371472 [5:56:25<22:13:20,  3.71it/s]
 20%|██        | 74636/371472 [5:56:26<25:21:16,  3.25it/s]
 20%|██        | 74637/371472 [5:56:26<23:56:01,  3.45it/s]
 20%|██        | 74638/371472 [5:56:26<23:57:55,  3.44it/s]
 20%|██        | 74639/371472 [5:56:27<23:47:53,  3.46it/s]
 20%|██        | 74640/371472 [5:56:27<24:43:49,  3.33it/s]
                                                           
{'loss': 4.0433, 'learning_rate': 8.195500872675558e-07, 'epoch': 3.21}

 20%|██        | 74640/371472 [5:56:27<24:43:49,  3.33it/s]
 20%|██        | 74641/371472 [5:56:27<24:08:23,  3.42it/s]
 20%|██        | 74642/371472 [5:56:28<23:16:25,  3.54it/s]
 20%|██        | 74643/371472 [5:56:28<23:05:27,  3.57it/s]
 20%|██        | 74644/371472 [5:56:28<23:30:12,  3.51it/s]
 20%|██        | 74645/371472 [5:56:28<24:39:15,  3.34it/s]
 20%|██        | 74646/371472 [5:56:29<25:41:29,  3.21it/s]
 20%|██        | 74647/371472 [5:56:29<24:07:25,  3.42it/s]
 20%|██        | 74648/371472 [5:56:29<24:27:20,  3.37it/s]
 20%|██        | 74649/371472 [5:56:30<24:00:57,  3.43it/s]
 20%|██        | 74650/371472 [5:56:30<24:17:31,  3.39it/s]
 20%|██        | 74651/371472 [5:56:30<24:01:27,  3.43it/s]
 20%|██        | 74652/371472 [5:56:30<23:14:13,  3.55it/s]
 20%|██        | 74653/371472 [5:56:31<22:22:13,  3.69it/s]
 20%|██        | 74654/371472 [5:56:31<21:49:25,  3.78it/s]
 20%|██        | 74655/371472 [5:56:31<22:34:20,  3.65it/s]
 20%|██        | 74656/371472 [5:56:32<24:00:55,  3.43it/s]
 20%|██        | 74657/371472 [5:56:32<23:13:42,  3.55it/s]
 20%|██        | 74658/371472 [5:56:32<22:41:33,  3.63it/s]
 20%|██        | 74659/371472 [5:56:32<22:29:12,  3.67it/s]
 20%|██        | 74660/371472 [5:56:33<22:16:27,  3.70it/s]
                                                           
{'loss': 4.12, 'learning_rate': 8.19501605292077e-07, 'epoch': 3.22}

 20%|██        | 74660/371472 [5:56:33<22:16:27,  3.70it/s]
 20%|██        | 74661/371472 [5:56:33<22:52:01,  3.61it/s]
 20%|██        | 74662/371472 [5:56:33<22:46:22,  3.62it/s]
 20%|██        | 74663/371472 [5:56:33<22:08:45,  3.72it/s]
 20%|██        | 74664/371472 [5:56:34<22:37:04,  3.65it/s]
 20%|██        | 74665/371472 [5:56:34<23:17:58,  3.54it/s]
 20%|██        | 74666/371472 [5:56:34<22:39:42,  3.64it/s]
 20%|██        | 74667/371472 [5:56:35<22:20:45,  3.69it/s]
 20%|██        | 74668/371472 [5:56:35<21:57:09,  3.76it/s]
 20%|██        | 74669/371472 [5:56:35<22:09:59,  3.72it/s]
 20%|██        | 74670/371472 [5:56:35<24:00:54,  3.43it/s]
 20%|██        | 74671/371472 [5:56:36<26:32:55,  3.11it/s]
 20%|██        | 74672/371472 [5:56:36<25:11:29,  3.27it/s]
 20%|██        | 74673/371472 [5:56:36<25:09:06,  3.28it/s]
 20%|██        | 74674/371472 [5:56:37<26:07:58,  3.15it/s]
 20%|██        | 74675/371472 [5:56:37<24:45:51,  3.33it/s]
 20%|██        | 74676/371472 [5:56:37<23:37:38,  3.49it/s]
 20%|██        | 74677/371472 [5:56:37<22:55:23,  3.60it/s]
 20%|██        | 74678/371472 [5:56:38<23:13:05,  3.55it/s]
 20%|██        | 74679/371472 [5:56:38<22:45:49,  3.62it/s]
 20%|██        | 74680/371472 [5:56:38<23:11:23,  3.56it/s]
                                                           
{'loss': 4.1219, 'learning_rate': 8.194531233165981e-07, 'epoch': 3.22}

 20%|██        | 74680/371472 [5:56:38<23:11:23,  3.56it/s]
 20%|██        | 74681/371472 [5:56:39<24:08:24,  3.42it/s]
 20%|██        | 74682/371472 [5:56:39<25:08:22,  3.28it/s]
 20%|██        | 74683/371472 [5:56:39<26:24:07,  3.12it/s]
 20%|██        | 74684/371472 [5:56:40<25:45:27,  3.20it/s]
 20%|██        | 74685/371472 [5:56:40<25:16:52,  3.26it/s]
 20%|██        | 74686/371472 [5:56:40<24:25:01,  3.38it/s]
 20%|██        | 74687/371472 [5:56:40<23:15:09,  3.55it/s]
 20%|██        | 74688/371472 [5:56:41<23:56:29,  3.44it/s]
 20%|██        | 74689/371472 [5:56:41<24:18:30,  3.39it/s]
 20%|██        | 74690/371472 [5:56:41<23:05:36,  3.57it/s]
 20%|██        | 74691/371472 [5:56:42<24:00:02,  3.43it/s]
 20%|██        | 74692/371472 [5:56:42<23:10:51,  3.56it/s]
 20%|██        | 74693/371472 [5:56:42<22:45:47,  3.62it/s]
 20%|██        | 74694/371472 [5:56:42<23:57:30,  3.44it/s]
 20%|██        | 74695/371472 [5:56:43<23:28:02,  3.51it/s]
 20%|██        | 74696/371472 [5:56:43<22:53:34,  3.60it/s]
 20%|██        | 74697/371472 [5:56:43<22:53:54,  3.60it/s]
 20%|██        | 74698/371472 [5:56:44<25:17:19,  3.26it/s]
 20%|██        | 74699/371472 [5:56:44<24:20:22,  3.39it/s]
 20%|██        | 74700/371472 [5:56:44<25:55:28,  3.18it/s]
                                                           
{'loss': 4.2315, 'learning_rate': 8.194046413411191e-07, 'epoch': 3.22}

 20%|██        | 74700/371472 [5:56:44<25:55:28,  3.18it/s]
 20%|██        | 74701/371472 [5:56:45<24:01:31,  3.43it/s]
 20%|██        | 74702/371472 [5:56:45<23:20:48,  3.53it/s]
 20%|██        | 74703/371472 [5:56:45<22:38:16,  3.64it/s]
 20%|██        | 74704/371472 [5:56:45<22:35:03,  3.65it/s]
 20%|██        | 74705/371472 [5:56:46<23:04:15,  3.57it/s]
 20%|██        | 74706/371472 [5:56:46<22:54:38,  3.60it/s]
 20%|██        | 74707/371472 [5:56:46<22:35:58,  3.65it/s]
 20%|██        | 74708/371472 [5:56:46<24:07:27,  3.42it/s]
 20%|██        | 74709/371472 [5:56:47<25:28:05,  3.24it/s]
 20%|██        | 74710/371472 [5:56:47<24:26:28,  3.37it/s]
 20%|██        | 74711/371472 [5:56:47<24:08:54,  3.41it/s]
 20%|██        | 74712/371472 [5:56:48<23:53:25,  3.45it/s]
 20%|██        | 74713/371472 [5:56:48<23:08:14,  3.56it/s]
 20%|██        | 74714/371472 [5:56:48<22:44:54,  3.62it/s]
 20%|██        | 74715/371472 [5:56:49<23:32:57,  3.50it/s]
 20%|██        | 74716/371472 [5:56:49<22:58:41,  3.59it/s]
 20%|██        | 74717/371472 [5:56:49<22:02:13,  3.74it/s]
 20%|██        | 74718/371472 [5:56:49<21:45:55,  3.79it/s]
 20%|██        | 74719/371472 [5:56:50<22:36:34,  3.65it/s]
 20%|██        | 74720/371472 [5:56:50<22:27:05,  3.67it/s]
                                                           
{'loss': 4.139, 'learning_rate': 8.193561593656402e-07, 'epoch': 3.22}

 20%|██        | 74720/371472 [5:56:50<22:27:05,  3.67it/s]
 20%|██        | 74721/371472 [5:56:50<23:47:50,  3.46it/s]
 20%|██        | 74722/371472 [5:56:50<24:12:02,  3.41it/s]
 20%|██        | 74723/371472 [5:56:51<23:27:03,  3.52it/s]
 20%|██        | 74724/371472 [5:56:51<22:37:23,  3.64it/s]
 20%|██        | 74725/371472 [5:56:51<24:10:25,  3.41it/s]
 20%|██        | 74726/371472 [5:56:52<23:08:13,  3.56it/s]
 20%|██        | 74727/371472 [5:56:52<23:18:24,  3.54it/s]
 20%|██        | 74728/371472 [5:56:52<23:42:04,  3.48it/s]
 20%|██        | 74729/371472 [5:56:53<25:51:23,  3.19it/s]
 20%|██        | 74730/371472 [5:56:53<27:39:03,  2.98it/s]
 20%|██        | 74731/371472 [5:56:53<26:28:30,  3.11it/s]
 20%|██        | 74732/371472 [5:56:53<24:46:41,  3.33it/s]
 20%|██        | 74733/371472 [5:56:54<25:16:28,  3.26it/s]
 20%|██        | 74734/371472 [5:56:54<24:02:12,  3.43it/s]
 20%|██        | 74735/371472 [5:56:54<23:07:46,  3.56it/s]
 20%|██        | 74736/371472 [5:56:55<24:39:41,  3.34it/s]
 20%|██        | 74737/371472 [5:56:55<23:06:52,  3.57it/s]
 20%|██        | 74738/371472 [5:56:55<23:12:28,  3.55it/s]
 20%|██        | 74739/371472 [5:56:55<23:10:53,  3.56it/s]
 20%|██        | 74740/371472 [5:56:56<30:59:29,  2.66it/s]
                                                           
{'loss': 4.004, 'learning_rate': 8.193076773901613e-07, 'epoch': 3.22}

 20%|██        | 74740/371472 [5:56:56<30:59:29,  2.66it/s]
 20%|██        | 74741/371472 [5:56:56<27:56:43,  2.95it/s]
 20%|██        | 74742/371472 [5:56:57<26:03:56,  3.16it/s]
 20%|██        | 74743/371472 [5:56:57<25:01:00,  3.29it/s]
 20%|██        | 74744/371472 [5:56:57<24:39:30,  3.34it/s]
 20%|██        | 74745/371472 [5:56:57<23:48:36,  3.46it/s]
 20%|██        | 74746/371472 [5:56:58<23:18:01,  3.54it/s]
 20%|██        | 74747/371472 [5:56:58<22:28:18,  3.67it/s]
 20%|██        | 74748/371472 [5:56:58<22:58:36,  3.59it/s]
 20%|██        | 74749/371472 [5:56:58<22:55:49,  3.59it/s]
 20%|██        | 74750/371472 [5:56:59<21:50:24,  3.77it/s]
 20%|██        | 74751/371472 [5:56:59<21:48:30,  3.78it/s]
 20%|██        | 74752/371472 [5:56:59<23:45:52,  3.47it/s]
 20%|██        | 74753/371472 [5:57:00<22:45:56,  3.62it/s]
 20%|██        | 74754/371472 [5:57:00<22:40:55,  3.63it/s]
 20%|██        | 74755/371472 [5:57:00<23:29:56,  3.51it/s]
 20%|██        | 74756/371472 [5:57:00<22:40:42,  3.63it/s]
 20%|██        | 74757/371472 [5:57:01<24:01:38,  3.43it/s]
 20%|██        | 74758/371472 [5:57:01<22:50:01,  3.61it/s]
 20%|██        | 74759/371472 [5:57:01<23:33:53,  3.50it/s]
 20%|██        | 74760/371472 [5:57:02<23:09:28,  3.56it/s]
                                                           
{'loss': 4.3765, 'learning_rate': 8.192591954146825e-07, 'epoch': 3.22}

 20%|██        | 74760/371472 [5:57:02<23:09:28,  3.56it/s]
 20%|██        | 74761/371472 [5:57:02<22:39:21,  3.64it/s]
 20%|██        | 74762/371472 [5:57:02<23:16:12,  3.54it/s]
 20%|██        | 74763/371472 [5:57:02<22:54:28,  3.60it/s]
 20%|██        | 74764/371472 [5:57:03<21:59:07,  3.75it/s]
 20%|██        | 74765/371472 [5:57:03<21:43:29,  3.79it/s]
 20%|██        | 74766/371472 [5:57:03<21:26:33,  3.84it/s]
 20%|██        | 74767/371472 [5:57:03<21:50:44,  3.77it/s]
 20%|██        | 74768/371472 [5:57:04<22:31:31,  3.66it/s]
 20%|██        | 74769/371472 [5:57:04<21:53:41,  3.76it/s]
 20%|██        | 74770/371472 [5:57:04<21:37:21,  3.81it/s]
 20%|██        | 74771/371472 [5:57:04<21:48:47,  3.78it/s]
 20%|██        | 74772/371472 [5:57:05<21:54:15,  3.76it/s]
 20%|██        | 74773/371472 [5:57:05<22:01:37,  3.74it/s]
 20%|██        | 74774/371472 [5:57:05<23:24:39,  3.52it/s]
 20%|██        | 74775/371472 [5:57:06<22:52:21,  3.60it/s]
 20%|██        | 74776/371472 [5:57:06<24:08:49,  3.41it/s]
 20%|██        | 74777/371472 [5:57:06<23:02:26,  3.58it/s]
 20%|██        | 74778/371472 [5:57:06<22:34:01,  3.65it/s]
 20%|██        | 74779/371472 [5:57:07<22:20:17,  3.69it/s]
 20%|██        | 74780/371472 [5:57:07<21:43:02,  3.79it/s]
                                                           
{'loss': 4.3537, 'learning_rate': 8.192107134392036e-07, 'epoch': 3.22}

 20%|██        | 74780/371472 [5:57:07<21:43:02,  3.79it/s]
 20%|██        | 74781/371472 [5:57:07<21:53:13,  3.77it/s]
 20%|██        | 74782/371472 [5:57:07<21:50:09,  3.77it/s]
 20%|██        | 74783/371472 [5:57:08<22:25:08,  3.68it/s]
 20%|██        | 74784/371472 [5:57:08<22:26:14,  3.67it/s]
 20%|██        | 74785/371472 [5:57:08<22:33:46,  3.65it/s]
 20%|██        | 74786/371472 [5:57:09<22:05:05,  3.73it/s]
 20%|██        | 74787/371472 [5:57:09<21:39:20,  3.81it/s]
 20%|██        | 74788/371472 [5:57:09<22:36:56,  3.64it/s]
 20%|██        | 74789/371472 [5:57:09<21:57:57,  3.75it/s]
 20%|██        | 74790/371472 [5:57:10<21:54:08,  3.76it/s]
 20%|██        | 74791/371472 [5:57:10<21:30:05,  3.83it/s]
 20%|██        | 74792/371472 [5:57:10<22:50:43,  3.61it/s]
 20%|██        | 74793/371472 [5:57:10<22:09:15,  3.72it/s]
 20%|██        | 74794/371472 [5:57:11<24:43:35,  3.33it/s]
 20%|██        | 74795/371472 [5:57:11<23:37:07,  3.49it/s]
 20%|██        | 74796/371472 [5:57:11<23:41:13,  3.48it/s]
 20%|██        | 74797/371472 [5:57:12<23:19:03,  3.53it/s]
 20%|██        | 74798/371472 [5:57:12<23:01:03,  3.58it/s]
 20%|██        | 74799/371472 [5:57:12<22:48:13,  3.61it/s]
 20%|██        | 74800/371472 [5:57:13<24:55:46,  3.31it/s]
                                                           
{'loss': 4.1181, 'learning_rate': 8.191622314637247e-07, 'epoch': 3.22}

 20%|██        | 74800/371472 [5:57:13<24:55:46,  3.31it/s]
 20%|██        | 74801/371472 [5:57:13<24:22:05,  3.38it/s]
 20%|██        | 74802/371472 [5:57:13<23:55:26,  3.44it/s]
 20%|██        | 74803/371472 [5:57:13<23:06:33,  3.57it/s]
 20%|██        | 74804/371472 [5:57:14<23:54:10,  3.45it/s]
 20%|██        | 74805/371472 [5:57:14<23:37:14,  3.49it/s]
 20%|██        | 74806/371472 [5:57:14<25:11:08,  3.27it/s]
 20%|██        | 74807/371472 [5:57:15<23:52:20,  3.45it/s]
 20%|██        | 74808/371472 [5:57:15<24:07:52,  3.41it/s]
 20%|██        | 74809/371472 [5:57:15<23:30:05,  3.51it/s]
 20%|██        | 74810/371472 [5:57:15<23:30:19,  3.51it/s]
 20%|██        | 74811/371472 [5:57:16<22:26:40,  3.67it/s]
 20%|██        | 74812/371472 [5:57:16<22:35:08,  3.65it/s]
 20%|██        | 74813/371472 [5:57:16<22:05:27,  3.73it/s]
 20%|██        | 74814/371472 [5:57:16<22:15:47,  3.70it/s]
 20%|██        | 74815/371472 [5:57:17<21:54:40,  3.76it/s]
 20%|██        | 74816/371472 [5:57:17<22:03:18,  3.74it/s]
 20%|██        | 74817/371472 [5:57:17<23:11:52,  3.55it/s]
 20%|██        | 74818/371472 [5:57:18<22:36:47,  3.64it/s]
 20%|██        | 74819/371472 [5:57:18<22:03:01,  3.74it/s]
 20%|██        | 74820/371472 [5:57:18<22:04:36,  3.73it/s]
                                                           
{'loss': 4.3242, 'learning_rate': 8.191137494882457e-07, 'epoch': 3.22}

 20%|██        | 74820/371472 [5:57:18<22:04:36,  3.73it/s]
 20%|██        | 74821/371472 [5:57:18<23:25:40,  3.52it/s]
 20%|██        | 74822/371472 [5:57:19<23:31:35,  3.50it/s]
 20%|██        | 74823/371472 [5:57:19<24:26:47,  3.37it/s]
 20%|██        | 74824/371472 [5:57:19<23:36:22,  3.49it/s]
 20%|██        | 74825/371472 [5:57:20<22:55:43,  3.59it/s]
 20%|██        | 74826/371472 [5:57:20<24:58:27,  3.30it/s]
 20%|██        | 74827/371472 [5:57:20<25:32:05,  3.23it/s]
 20%|██        | 74828/371472 [5:57:20<24:29:39,  3.36it/s]
 20%|██        | 74829/371472 [5:57:21<24:00:31,  3.43it/s]
 20%|██        | 74830/371472 [5:57:21<23:47:41,  3.46it/s]
 20%|██        | 74831/371472 [5:57:21<23:20:19,  3.53it/s]
 20%|██        | 74832/371472 [5:57:22<24:18:36,  3.39it/s]
 20%|██        | 74833/371472 [5:57:22<23:52:00,  3.45it/s]
 20%|██        | 74834/371472 [5:57:22<23:41:06,  3.48it/s]
 20%|██        | 74835/371472 [5:57:22<23:31:19,  3.50it/s]
 20%|██        | 74836/371472 [5:57:23<22:43:28,  3.63it/s]
 20%|██        | 74837/371472 [5:57:23<24:12:04,  3.40it/s]
 20%|██        | 74838/371472 [5:57:23<23:27:53,  3.51it/s]
 20%|██        | 74839/371472 [5:57:24<22:58:33,  3.59it/s]
 20%|██        | 74840/371472 [5:57:24<24:00:03,  3.43it/s]
                                                           
{'loss': 4.1551, 'learning_rate': 8.190652675127669e-07, 'epoch': 3.22}

 20%|██        | 74840/371472 [5:57:24<24:00:03,  3.43it/s]
 20%|██        | 74841/371472 [5:57:24<24:20:52,  3.38it/s]
 20%|██        | 74842/371472 [5:57:24<23:19:30,  3.53it/s]
 20%|██        | 74843/371472 [5:57:25<24:18:30,  3.39it/s]
 20%|██        | 74844/371472 [5:57:25<24:24:23,  3.38it/s]
 20%|██        | 74845/371472 [5:57:25<25:02:47,  3.29it/s]
 20%|██        | 74846/371472 [5:57:26<24:59:15,  3.30it/s]
 20%|██        | 74847/371472 [5:57:26<25:54:19,  3.18it/s]
 20%|██        | 74848/371472 [5:57:26<24:08:08,  3.41it/s]
 20%|██        | 74849/371472 [5:57:27<23:10:11,  3.56it/s]
 20%|██        | 74850/371472 [5:57:27<22:48:52,  3.61it/s]
 20%|██        | 74851/371472 [5:57:27<21:58:12,  3.75it/s]
 20%|██        | 74852/371472 [5:57:27<22:18:04,  3.69it/s]
 20%|██        | 74853/371472 [5:57:28<21:54:29,  3.76it/s]
 20%|██        | 74854/371472 [5:57:28<21:45:20,  3.79it/s]
 20%|██        | 74855/371472 [5:57:28<23:12:24,  3.55it/s]
 20%|██        | 74856/371472 [5:57:28<23:31:55,  3.50it/s]
 20%|██        | 74857/371472 [5:57:29<22:40:58,  3.63it/s]
 20%|██        | 74858/371472 [5:57:29<23:40:32,  3.48it/s]
 20%|██        | 74859/371472 [5:57:29<25:18:55,  3.25it/s]
 20%|██        | 74860/371472 [5:57:30<24:17:11,  3.39it/s]
                                                           
{'loss': 4.2335, 'learning_rate': 8.19016785537288e-07, 'epoch': 3.22}

 20%|██        | 74860/371472 [5:57:30<24:17:11,  3.39it/s]
 20%|██        | 74861/371472 [5:57:30<23:02:16,  3.58it/s]
 20%|██        | 74862/371472 [5:57:30<25:40:02,  3.21it/s]
 20%|██        | 74863/371472 [5:57:31<24:43:58,  3.33it/s]
 20%|██        | 74864/371472 [5:57:31<24:01:14,  3.43it/s]
 20%|██        | 74865/371472 [5:57:31<24:19:17,  3.39it/s]
 20%|██        | 74866/371472 [5:57:31<24:25:26,  3.37it/s]
 20%|██        | 74867/371472 [5:57:32<23:41:43,  3.48it/s]
 20%|██        | 74868/371472 [5:57:32<23:26:33,  3.51it/s]
 20%|██        | 74869/371472 [5:57:32<22:41:09,  3.63it/s]
 20%|██        | 74870/371472 [5:57:32<22:38:47,  3.64it/s]
 20%|██        | 74871/371472 [5:57:33<22:13:32,  3.71it/s]
 20%|██        | 74872/371472 [5:57:33<22:25:42,  3.67it/s]
 20%|██        | 74873/371472 [5:57:33<23:14:49,  3.54it/s]
 20%|██        | 74874/371472 [5:57:34<24:33:39,  3.35it/s]
 20%|██        | 74875/371472 [5:57:34<24:18:03,  3.39it/s]
 20%|██        | 74876/371472 [5:57:34<23:55:05,  3.44it/s]
 20%|██        | 74877/371472 [5:57:34<23:00:49,  3.58it/s]
 20%|██        | 74878/371472 [5:57:35<22:06:19,  3.73it/s]
 20%|██        | 74879/371472 [5:57:35<23:19:35,  3.53it/s]
 20%|██        | 74880/371472 [5:57:35<22:57:29,  3.59it/s]
                                                           
{'loss': 4.1713, 'learning_rate': 8.189683035618091e-07, 'epoch': 3.23}

 20%|██        | 74880/371472 [5:57:35<22:57:29,  3.59it/s]
 20%|██        | 74881/371472 [5:57:36<22:03:17,  3.74it/s]
 20%|██        | 74882/371472 [5:57:36<24:40:53,  3.34it/s]
 20%|██        | 74883/371472 [5:57:36<24:34:42,  3.35it/s]
 20%|██        | 74884/371472 [5:57:37<24:39:11,  3.34it/s]
 20%|██        | 74885/371472 [5:57:37<24:47:55,  3.32it/s]
 20%|██        | 74886/371472 [5:57:37<24:24:56,  3.37it/s]
 20%|██        | 74887/371472 [5:57:37<23:22:47,  3.52it/s]
 20%|██        | 74888/371472 [5:57:38<23:21:18,  3.53it/s]
 20%|██        | 74889/371472 [5:57:38<22:43:00,  3.63it/s]
 20%|██        | 74890/371472 [5:57:38<25:13:24,  3.27it/s]
 20%|██        | 74891/371472 [5:57:39<23:33:21,  3.50it/s]
 20%|██        | 74892/371472 [5:57:39<23:21:42,  3.53it/s]
 20%|██        | 74893/371472 [5:57:39<22:51:16,  3.60it/s]
 20%|██        | 74894/371472 [5:57:39<23:01:38,  3.58it/s]
 20%|██        | 74895/371472 [5:57:40<23:41:38,  3.48it/s]
 20%|██        | 74896/371472 [5:57:40<22:49:50,  3.61it/s]
 20%|██        | 74897/371472 [5:57:40<22:14:30,  3.70it/s]
 20%|██        | 74898/371472 [5:57:40<23:10:31,  3.55it/s]
 20%|██        | 74899/371472 [5:57:41<24:39:56,  3.34it/s]
 20%|██        | 74900/371472 [5:57:41<25:52:51,  3.18it/s]
                                                           
{'loss': 4.1811, 'learning_rate': 8.189198215863302e-07, 'epoch': 3.23}

 20%|██        | 74900/371472 [5:57:41<25:52:51,  3.18it/s]
 20%|██        | 74901/371472 [5:57:41<25:37:03,  3.22it/s]
 20%|██        | 74902/371472 [5:57:42<25:41:24,  3.21it/s]
 20%|██        | 74903/371472 [5:57:42<25:45:02,  3.20it/s]
 20%|██        | 74904/371472 [5:57:42<25:13:15,  3.27it/s]
 20%|██        | 74905/371472 [5:57:43<24:13:34,  3.40it/s]
 20%|██        | 74906/371472 [5:57:43<27:52:12,  2.96it/s]
 20%|██        | 74907/371472 [5:57:43<26:05:54,  3.16it/s]
 20%|██        | 74908/371472 [5:57:44<25:16:12,  3.26it/s]
 20%|██        | 74909/371472 [5:57:44<24:25:41,  3.37it/s]
 20%|██        | 74910/371472 [5:57:44<24:23:50,  3.38it/s]
 20%|██        | 74911/371472 [5:57:44<23:50:57,  3.45it/s]
 20%|██        | 74912/371472 [5:57:45<23:40:02,  3.48it/s]
 20%|██        | 74913/371472 [5:57:45<23:12:28,  3.55it/s]
 20%|██        | 74914/371472 [5:57:45<23:06:04,  3.57it/s]
 20%|██        | 74915/371472 [5:57:46<23:04:45,  3.57it/s]
 20%|██        | 74916/371472 [5:57:46<22:15:35,  3.70it/s]
 20%|██        | 74917/371472 [5:57:46<22:37:45,  3.64it/s]
 20%|██        | 74918/371472 [5:57:46<22:22:58,  3.68it/s]
 20%|██        | 74919/371472 [5:57:47<22:51:27,  3.60it/s]
 20%|██        | 74920/371472 [5:57:47<22:38:39,  3.64it/s]
                                                           
{'loss': 4.0747, 'learning_rate': 8.188713396108514e-07, 'epoch': 3.23}

 20%|██        | 74920/371472 [5:57:47<22:38:39,  3.64it/s]
 20%|██        | 74921/371472 [5:57:47<23:27:35,  3.51it/s]
 20%|██        | 74922/371472 [5:57:48<23:08:33,  3.56it/s]
 20%|██        | 74923/371472 [5:57:48<22:04:29,  3.73it/s]
 20%|██        | 74924/371472 [5:57:48<22:29:21,  3.66it/s]
 20%|██        | 74925/371472 [5:57:48<24:03:51,  3.42it/s]
 20%|██        | 74926/371472 [5:57:49<23:08:27,  3.56it/s]
 20%|██        | 74927/371472 [5:57:49<22:43:54,  3.62it/s]
 20%|██        | 74928/371472 [5:57:49<24:40:17,  3.34it/s]
 20%|██        | 74929/371472 [5:57:50<26:02:26,  3.16it/s]
 20%|██        | 74930/371472 [5:57:50<24:45:23,  3.33it/s]
 20%|██        | 74931/371472 [5:57:50<24:21:33,  3.38it/s]
 20%|██        | 74932/371472 [5:57:50<23:17:03,  3.54it/s]
 20%|██        | 74933/371472 [5:57:51<22:52:35,  3.60it/s]
 20%|██        | 74934/371472 [5:57:51<23:37:16,  3.49it/s]
 20%|██        | 74935/371472 [5:57:51<22:56:40,  3.59it/s]
 20%|██        | 74936/371472 [5:57:52<23:16:23,  3.54it/s]
 20%|██        | 74937/371472 [5:57:52<22:16:20,  3.70it/s]
 20%|██        | 74938/371472 [5:57:52<22:05:33,  3.73it/s]
 20%|██        | 74939/371472 [5:57:52<22:24:23,  3.68it/s]
 20%|██        | 74940/371472 [5:57:53<23:48:45,  3.46it/s]
                                                           
{'loss': 4.1766, 'learning_rate': 8.188228576353724e-07, 'epoch': 3.23}

 20%|██        | 74940/371472 [5:57:53<23:48:45,  3.46it/s]
 20%|██        | 74941/371472 [5:57:53<23:13:54,  3.55it/s]
 20%|██        | 74942/371472 [5:57:53<23:20:42,  3.53it/s]
 20%|██        | 74943/371472 [5:57:53<22:43:35,  3.62it/s]
 20%|██        | 74944/371472 [5:57:54<22:24:47,  3.68it/s]
 20%|██        | 74945/371472 [5:57:54<21:51:26,  3.77it/s]
 20%|██        | 74946/371472 [5:57:54<21:34:38,  3.82it/s]
 20%|██        | 74947/371472 [5:57:55<22:52:14,  3.60it/s]
 20%|██        | 74948/371472 [5:57:55<23:28:53,  3.51it/s]
 20%|██        | 74949/371472 [5:57:55<23:12:21,  3.55it/s]
 20%|██        | 74950/371472 [5:57:55<22:29:17,  3.66it/s]
 20%|██        | 74951/371472 [5:57:56<23:22:24,  3.52it/s]
 20%|██        | 74952/371472 [5:57:56<23:28:31,  3.51it/s]
 20%|██        | 74953/371472 [5:57:56<22:28:07,  3.67it/s]
 20%|██        | 74954/371472 [5:57:57<22:40:33,  3.63it/s]
 20%|██        | 74955/371472 [5:57:57<23:16:47,  3.54it/s]
 20%|██        | 74956/371472 [5:57:57<22:48:41,  3.61it/s]
 20%|██        | 74957/371472 [5:57:57<22:16:27,  3.70it/s]
 20%|██        | 74958/371472 [5:57:58<24:33:57,  3.35it/s]
 20%|██        | 74959/371472 [5:57:58<25:52:48,  3.18it/s]
 20%|██        | 74960/371472 [5:57:58<24:56:37,  3.30it/s]
                                                           
{'loss': 4.0803, 'learning_rate': 8.187743756598935e-07, 'epoch': 3.23}

 20%|██        | 74960/371472 [5:57:58<24:56:37,  3.30it/s]
 20%|██        | 74961/371472 [5:57:59<24:15:09,  3.40it/s]
 20%|██        | 74962/371472 [5:57:59<23:26:11,  3.51it/s]
 20%|██        | 74963/371472 [5:57:59<25:31:53,  3.23it/s]
 20%|██        | 74964/371472 [5:57:59<24:26:30,  3.37it/s]
 20%|██        | 74965/371472 [5:58:00<23:27:43,  3.51it/s]
 20%|██        | 74966/371472 [5:58:00<23:17:27,  3.54it/s]
 20%|██        | 74967/371472 [5:58:00<22:58:52,  3.58it/s]
 20%|██        | 74968/371472 [5:58:01<26:44:48,  3.08it/s]
 20%|██        | 74969/371472 [5:58:01<26:03:40,  3.16it/s]
 20%|██        | 74970/371472 [5:58:01<25:29:00,  3.23it/s]
 20%|██        | 74971/371472 [5:58:02<25:30:48,  3.23it/s]
 20%|██        | 74972/371472 [5:58:02<24:30:12,  3.36it/s]
 20%|██        | 74973/371472 [5:58:02<23:46:53,  3.46it/s]
 20%|██        | 74974/371472 [5:58:02<24:05:37,  3.42it/s]
 20%|██        | 74975/371472 [5:58:03<25:06:51,  3.28it/s]
 20%|██        | 74976/371472 [5:58:03<24:18:48,  3.39it/s]
 20%|██        | 74977/371472 [5:58:03<23:51:58,  3.45it/s]
 20%|██        | 74978/371472 [5:58:04<23:49:25,  3.46it/s]
 20%|██        | 74979/371472 [5:58:04<22:49:02,  3.61it/s]
 20%|██        | 74980/371472 [5:58:04<22:30:05,  3.66it/s]
                                                           
{'loss': 4.2386, 'learning_rate': 8.187258936844146e-07, 'epoch': 3.23}

 20%|██        | 74980/371472 [5:58:04<22:30:05,  3.66it/s]
 20%|██        | 74981/371472 [5:58:04<22:01:51,  3.74it/s]
 20%|██        | 74982/371472 [5:58:05<23:41:51,  3.48it/s]
 20%|██        | 74983/371472 [5:58:05<23:15:28,  3.54it/s]
 20%|██        | 74984/371472 [5:58:05<23:56:23,  3.44it/s]
 20%|██        | 74985/371472 [5:58:06<23:40:50,  3.48it/s]
 20%|██        | 74986/371472 [5:58:06<22:54:38,  3.59it/s]
 20%|██        | 74987/371472 [5:58:06<23:00:37,  3.58it/s]
 20%|██        | 74988/371472 [5:58:06<22:55:27,  3.59it/s]
 20%|██        | 74989/371472 [5:58:07<22:33:42,  3.65it/s]
 20%|██        | 74990/371472 [5:58:07<24:23:01,  3.38it/s]
 20%|██        | 74991/371472 [5:58:07<23:40:54,  3.48it/s]
 20%|██        | 74992/371472 [5:58:08<23:32:52,  3.50it/s]
 20%|██        | 74993/371472 [5:58:08<23:52:21,  3.45it/s]
 20%|██        | 74994/371472 [5:58:08<23:06:41,  3.56it/s]
 20%|██        | 74995/371472 [5:58:08<23:20:29,  3.53it/s]
 20%|██        | 74996/371472 [5:58:09<22:29:23,  3.66it/s]
 20%|██        | 74997/371472 [5:58:09<23:23:18,  3.52it/s]
 20%|██        | 74998/371472 [5:58:09<22:53:47,  3.60it/s]
 20%|██        | 74999/371472 [5:58:10<22:56:26,  3.59it/s]
 20%|██        | 75000/371472 [5:58:10<22:36:37,  3.64it/s]
                                                           
{'loss': 4.05, 'learning_rate': 8.186774117089357e-07, 'epoch': 3.23}

 20%|██        | 75000/371472 [5:58:10<22:36:37,  3.64it/s]
 20%|██        | 75001/371472 [5:58:10<22:26:27,  3.67it/s]
 20%|██        | 75002/371472 [5:58:10<24:47:59,  3.32it/s]
 20%|██        | 75003/371472 [5:58:11<23:49:10,  3.46it/s]
 20%|██        | 75004/371472 [5:58:11<24:10:19,  3.41it/s]
 20%|██        | 75005/371472 [5:58:11<26:11:32,  3.14it/s]
 20%|██        | 75006/371472 [5:58:12<24:22:52,  3.38it/s]
 20%|██        | 75007/371472 [5:58:12<24:40:58,  3.34it/s]
 20%|██        | 75008/371472 [5:58:12<26:26:40,  3.11it/s]
 20%|██        | 75009/371472 [5:58:13<25:40:06,  3.21it/s]
 20%|██        | 75010/371472 [5:58:13<24:58:00,  3.30it/s]
 20%|██        | 75011/371472 [5:58:13<24:01:28,  3.43it/s]
 20%|██        | 75012/371472 [5:58:13<22:57:14,  3.59it/s]
 20%|██        | 75013/371472 [5:58:14<23:40:36,  3.48it/s]
 20%|██        | 75014/371472 [5:58:14<24:32:24,  3.36it/s]
 20%|██        | 75015/371472 [5:58:14<24:21:06,  3.38it/s]
 20%|██        | 75016/371472 [5:58:15<23:15:51,  3.54it/s]
 20%|██        | 75017/371472 [5:58:15<23:42:07,  3.47it/s]
 20%|██        | 75018/371472 [5:58:15<23:27:14,  3.51it/s]
 20%|██        | 75019/371472 [5:58:15<22:35:22,  3.65it/s]
 20%|██        | 75020/371472 [5:58:16<22:28:38,  3.66it/s]
                                                           
{'loss': 4.1587, 'learning_rate': 8.186289297334568e-07, 'epoch': 3.23}

 20%|██        | 75020/371472 [5:58:16<22:28:38,  3.66it/s]
 20%|██        | 75021/371472 [5:58:16<23:04:24,  3.57it/s]
 20%|██        | 75022/371472 [5:58:16<23:54:10,  3.45it/s]
 20%|██        | 75023/371472 [5:58:17<23:20:43,  3.53it/s]
 20%|██        | 75024/371472 [5:58:17<24:44:36,  3.33it/s]
 20%|██        | 75025/371472 [5:58:17<24:02:44,  3.42it/s]
 20%|██        | 75026/371472 [5:58:17<23:22:14,  3.52it/s]
 20%|██        | 75027/371472 [5:58:18<23:05:06,  3.57it/s]
 20%|██        | 75028/371472 [5:58:18<22:51:39,  3.60it/s]
 20%|██        | 75029/371472 [5:58:18<23:01:23,  3.58it/s]
 20%|██        | 75030/371472 [5:58:18<22:25:51,  3.67it/s]
 20%|██        | 75031/371472 [5:58:19<22:54:27,  3.59it/s]
 20%|██        | 75032/371472 [5:58:19<22:50:42,  3.60it/s]
 20%|██        | 75033/371472 [5:58:19<23:05:23,  3.57it/s]
 20%|██        | 75034/371472 [5:58:20<23:34:48,  3.49it/s]
 20%|██        | 75035/371472 [5:58:20<24:59:04,  3.30it/s]
 20%|██        | 75036/371472 [5:58:20<24:18:04,  3.39it/s]
 20%|██        | 75037/371472 [5:58:21<23:24:33,  3.52it/s]
 20%|██        | 75038/371472 [5:58:21<27:19:26,  3.01it/s]
 20%|██        | 75039/371472 [5:58:21<27:14:30,  3.02it/s]
 20%|██        | 75040/371472 [5:58:22<26:06:56,  3.15it/s]
                                                           
{'loss': 4.2797, 'learning_rate': 8.18580447757978e-07, 'epoch': 3.23}

 20%|██        | 75040/371472 [5:58:22<26:06:56,  3.15it/s]
 20%|██        | 75041/371472 [5:58:22<24:34:19,  3.35it/s]
 20%|██        | 75042/371472 [5:58:22<24:42:45,  3.33it/s]
 20%|██        | 75043/371472 [5:58:22<23:26:47,  3.51it/s]
 20%|██        | 75044/371472 [5:58:23<23:37:39,  3.48it/s]
 20%|██        | 75045/371472 [5:58:23<23:28:03,  3.51it/s]
 20%|██        | 75046/371472 [5:58:23<23:36:42,  3.49it/s]
 20%|██        | 75047/371472 [5:58:24<23:17:44,  3.53it/s]
 20%|██        | 75048/371472 [5:58:24<25:28:27,  3.23it/s]
 20%|██        | 75049/371472 [5:58:24<25:38:18,  3.21it/s]
 20%|██        | 75050/371472 [5:58:24<24:40:57,  3.34it/s]
 20%|██        | 75051/371472 [5:58:25<23:55:44,  3.44it/s]
 20%|██        | 75052/371472 [5:58:25<24:10:56,  3.40it/s]
 20%|██        | 75053/371472 [5:58:25<23:34:19,  3.49it/s]
 20%|██        | 75054/371472 [5:58:26<23:07:53,  3.56it/s]
 20%|██        | 75055/371472 [5:58:26<22:59:00,  3.58it/s]
 20%|██        | 75056/371472 [5:58:26<22:44:24,  3.62it/s]
 20%|██        | 75057/371472 [5:58:26<22:53:02,  3.60it/s]
 20%|██        | 75058/371472 [5:58:27<22:20:32,  3.69it/s]
 20%|██        | 75059/371472 [5:58:27<22:12:31,  3.71it/s]
 20%|██        | 75060/371472 [5:58:27<22:24:16,  3.67it/s]
                                                           
{'loss': 4.1528, 'learning_rate': 8.185319657824991e-07, 'epoch': 3.23}

 20%|██        | 75060/371472 [5:58:27<22:24:16,  3.67it/s]
 20%|██        | 75061/371472 [5:58:27<22:08:40,  3.72it/s]
 20%|██        | 75062/371472 [5:58:28<21:27:49,  3.84it/s]
 20%|██        | 75063/371472 [5:58:28<21:18:20,  3.86it/s]
 20%|██        | 75064/371472 [5:58:28<22:06:01,  3.73it/s]
 20%|██        | 75065/371472 [5:58:29<24:22:40,  3.38it/s]
 20%|██        | 75066/371472 [5:58:29<23:43:28,  3.47it/s]
 20%|██        | 75067/371472 [5:58:29<23:55:47,  3.44it/s]
 20%|██        | 75068/371472 [5:58:29<23:52:45,  3.45it/s]
 20%|██        | 75069/371472 [5:58:30<24:25:41,  3.37it/s]
 20%|██        | 75070/371472 [5:58:30<24:04:40,  3.42it/s]
 20%|██        | 75071/371472 [5:58:30<24:06:04,  3.42it/s]
 20%|██        | 75072/371472 [5:58:31<24:06:32,  3.42it/s]
 20%|██        | 75073/371472 [5:58:31<23:46:15,  3.46it/s]
 20%|██        | 75074/371472 [5:58:31<23:20:49,  3.53it/s]
 20%|██        | 75075/371472 [5:58:32<25:39:12,  3.21it/s]
 20%|██        | 75076/371472 [5:58:32<25:21:54,  3.25it/s]
 20%|██        | 75077/371472 [5:58:32<23:55:57,  3.44it/s]
 20%|██        | 75078/371472 [5:58:32<23:35:59,  3.49it/s]
 20%|██        | 75079/371472 [5:58:33<23:04:21,  3.57it/s]
 20%|██        | 75080/371472 [5:58:33<22:03:46,  3.73it/s]
                                                           
{'loss': 4.2551, 'learning_rate': 8.184834838070201e-07, 'epoch': 3.23}

 20%|██        | 75080/371472 [5:58:33<22:03:46,  3.73it/s]
 20%|██        | 75081/371472 [5:58:33<21:58:59,  3.75it/s]
 20%|██        | 75082/371472 [5:58:33<21:41:23,  3.80it/s]
 20%|██        | 75083/371472 [5:58:34<22:34:13,  3.65it/s]
 20%|██        | 75084/371472 [5:58:34<23:07:11,  3.56it/s]
 20%|██        | 75085/371472 [5:58:34<24:53:51,  3.31it/s]
 20%|██        | 75086/371472 [5:58:35<23:44:33,  3.47it/s]
 20%|██        | 75087/371472 [5:58:35<23:14:10,  3.54it/s]
 20%|██        | 75088/371472 [5:58:35<22:29:31,  3.66it/s]
 20%|██        | 75089/371472 [5:58:35<22:12:39,  3.71it/s]
 20%|██        | 75090/371472 [5:58:36<22:42:51,  3.62it/s]
 20%|██        | 75091/371472 [5:58:36<22:26:22,  3.67it/s]
 20%|██        | 75092/371472 [5:58:36<22:19:55,  3.69it/s]
 20%|██        | 75093/371472 [5:58:37<22:51:10,  3.60it/s]
 20%|██        | 75094/371472 [5:58:37<22:43:46,  3.62it/s]
 20%|██        | 75095/371472 [5:58:37<22:46:26,  3.61it/s]
 20%|██        | 75096/371472 [5:58:37<22:28:55,  3.66it/s]
 20%|██        | 75097/371472 [5:58:38<22:00:15,  3.74it/s]
 20%|██        | 75098/371472 [5:58:38<21:53:03,  3.76it/s]
 20%|██        | 75099/371472 [5:58:38<22:17:08,  3.69it/s]
 20%|██        | 75100/371472 [5:58:39<24:46:12,  3.32it/s]
                                                           
{'loss': 4.0345, 'learning_rate': 8.184350018315412e-07, 'epoch': 3.23}

 20%|██        | 75100/371472 [5:58:39<24:46:12,  3.32it/s]
 20%|██        | 75101/371472 [5:58:39<25:23:20,  3.24it/s]
 20%|██        | 75102/371472 [5:58:39<24:54:49,  3.30it/s]
 20%|██        | 75103/371472 [5:58:39<24:51:43,  3.31it/s]
 20%|██        | 75104/371472 [5:58:40<24:53:17,  3.31it/s]
 20%|██        | 75105/371472 [5:58:40<23:45:21,  3.47it/s]
 20%|██        | 75106/371472 [5:58:40<24:48:37,  3.32it/s]
 20%|██        | 75107/371472 [5:58:41<23:40:59,  3.48it/s]
 20%|██        | 75108/371472 [5:58:41<22:52:59,  3.60it/s]
 20%|██        | 75109/371472 [5:58:41<22:22:05,  3.68it/s]
 20%|██        | 75110/371472 [5:58:41<22:39:24,  3.63it/s]
 20%|██        | 75111/371472 [5:58:42<22:47:43,  3.61it/s]
 20%|██        | 75112/371472 [5:58:42<22:55:12,  3.59it/s]
 20%|██        | 75113/371472 [5:58:42<22:54:09,  3.59it/s]
 20%|██        | 75114/371472 [5:58:43<23:51:47,  3.45it/s]
 20%|██        | 75115/371472 [5:58:43<23:30:27,  3.50it/s]
 20%|██        | 75116/371472 [5:58:43<23:18:15,  3.53it/s]
 20%|██        | 75117/371472 [5:58:43<22:58:19,  3.58it/s]
 20%|██        | 75118/371472 [5:58:44<22:56:02,  3.59it/s]
 20%|██        | 75119/371472 [5:58:44<23:06:56,  3.56it/s]
 20%|██        | 75120/371472 [5:58:44<23:19:55,  3.53it/s]
                                                           
{'loss': 4.0762, 'learning_rate': 8.183865198560624e-07, 'epoch': 3.24}

 20%|██        | 75120/371472 [5:58:44<23:19:55,  3.53it/s]
 20%|██        | 75121/371472 [5:58:44<23:03:33,  3.57it/s]
 20%|██        | 75122/371472 [5:58:45<22:27:09,  3.67it/s]
 20%|██        | 75123/371472 [5:58:45<22:05:59,  3.72it/s]
 20%|██        | 75124/371472 [5:58:45<22:09:13,  3.72it/s]
 20%|██        | 75125/371472 [5:58:46<22:51:47,  3.60it/s]
 20%|██        | 75126/371472 [5:58:46<22:57:20,  3.59it/s]
 20%|██        | 75127/371472 [5:58:46<23:06:14,  3.56it/s]
 20%|██        | 75128/371472 [5:58:46<24:48:16,  3.32it/s]
 20%|██        | 75129/371472 [5:58:47<25:06:20,  3.28it/s]
 20%|██        | 75130/371472 [5:58:47<24:48:03,  3.32it/s]
 20%|██        | 75131/371472 [5:58:47<23:43:18,  3.47it/s]
 20%|██        | 75132/371472 [5:58:48<23:46:15,  3.46it/s]
 20%|██        | 75133/371472 [5:58:48<23:06:21,  3.56it/s]
 20%|██        | 75134/371472 [5:58:48<23:29:15,  3.50it/s]
 20%|██        | 75135/371472 [5:58:48<23:12:50,  3.55it/s]
 20%|██        | 75136/371472 [5:58:49<22:58:06,  3.58it/s]
 20%|██        | 75137/371472 [5:58:49<22:46:06,  3.62it/s]
 20%|██        | 75138/371472 [5:58:49<21:54:33,  3.76it/s]
 20%|██        | 75139/371472 [5:58:50<21:44:04,  3.79it/s]
 20%|██        | 75140/371472 [5:58:50<21:11:10,  3.89it/s]
                                                           
{'loss': 4.0778, 'learning_rate': 8.183380378805835e-07, 'epoch': 3.24}

 20%|██        | 75140/371472 [5:58:50<21:11:10,  3.89it/s]
 20%|██        | 75141/371472 [5:58:50<23:49:08,  3.46it/s]
 20%|██        | 75142/371472 [5:58:50<22:51:26,  3.60it/s]
 20%|██        | 75143/371472 [5:58:51<23:23:40,  3.52it/s]
 20%|██        | 75144/371472 [5:58:51<22:56:32,  3.59it/s]
 20%|██        | 75145/371472 [5:58:51<22:30:17,  3.66it/s]
 20%|██        | 75146/371472 [5:58:51<22:52:34,  3.60it/s]
 20%|██        | 75147/371472 [5:58:52<23:33:27,  3.49it/s]
 20%|██        | 75148/371472 [5:58:52<24:11:51,  3.40it/s]
 20%|██        | 75149/371472 [5:58:52<25:17:23,  3.25it/s]
 20%|██        | 75150/371472 [5:58:53<24:48:35,  3.32it/s]
 20%|██        | 75151/371472 [5:58:53<23:44:49,  3.47it/s]
 20%|██        | 75152/371472 [5:58:53<23:11:11,  3.55it/s]
 20%|██        | 75153/371472 [5:58:54<23:35:00,  3.49it/s]
 20%|██        | 75154/371472 [5:58:54<24:13:21,  3.40it/s]
 20%|██        | 75155/371472 [5:58:54<24:30:58,  3.36it/s]
 20%|██        | 75156/371472 [5:58:54<23:49:36,  3.45it/s]
 20%|██        | 75157/371472 [5:58:55<26:50:21,  3.07it/s]
 20%|██        | 75158/371472 [5:58:55<26:07:38,  3.15it/s]
 20%|██        | 75159/371472 [5:58:56<27:02:02,  3.04it/s]
 20%|██        | 75160/371472 [5:58:56<25:28:01,  3.23it/s]
                                                           
{'loss': 4.2175, 'learning_rate': 8.182895559051046e-07, 'epoch': 3.24}

 20%|██        | 75160/371472 [5:58:56<25:28:01,  3.23it/s]
 20%|██        | 75161/371472 [5:58:56<24:43:53,  3.33it/s]
 20%|██        | 75162/371472 [5:58:56<25:33:16,  3.22it/s]
 20%|██        | 75163/371472 [5:58:57<24:26:00,  3.37it/s]
 20%|██        | 75164/371472 [5:58:57<24:13:41,  3.40it/s]
 20%|██        | 75165/371472 [5:58:57<24:28:26,  3.36it/s]
 20%|██        | 75166/371472 [5:58:58<24:50:41,  3.31it/s]
 20%|██        | 75167/371472 [5:58:58<23:25:41,  3.51it/s]
 20%|██        | 75168/371472 [5:58:58<25:05:23,  3.28it/s]
 20%|██        | 75169/371472 [5:58:58<24:46:17,  3.32it/s]
 20%|██        | 75170/371472 [5:58:59<26:50:33,  3.07it/s]
 20%|██        | 75171/371472 [5:58:59<25:20:01,  3.25it/s]
 20%|██        | 75172/371472 [5:58:59<23:50:27,  3.45it/s]
 20%|██        | 75173/371472 [5:59:00<25:31:02,  3.23it/s]
 20%|██        | 75174/371472 [5:59:00<24:24:21,  3.37it/s]
 20%|██        | 75175/371472 [5:59:00<23:17:07,  3.53it/s]
 20%|██        | 75176/371472 [5:59:00<22:47:19,  3.61it/s]
 20%|██        | 75177/371472 [5:59:01<22:41:47,  3.63it/s]
 20%|██        | 75178/371472 [5:59:01<22:45:35,  3.62it/s]
 20%|██        | 75179/371472 [5:59:01<22:08:43,  3.72it/s]
 20%|██        | 75180/371472 [5:59:02<21:53:03,  3.76it/s]
                                                           
{'loss': 4.0608, 'learning_rate': 8.182410739296257e-07, 'epoch': 3.24}

 20%|██        | 75180/371472 [5:59:02<21:53:03,  3.76it/s]
 20%|██        | 75181/371472 [5:59:02<22:39:59,  3.63it/s]
 20%|██        | 75182/371472 [5:59:02<23:10:14,  3.55it/s]
 20%|██        | 75183/371472 [5:59:02<23:03:54,  3.57it/s]
 20%|██        | 75184/371472 [5:59:03<22:39:21,  3.63it/s]
 20%|██        | 75185/371472 [5:59:03<23:42:01,  3.47it/s]
 20%|██        | 75186/371472 [5:59:03<23:39:14,  3.48it/s]
 20%|██        | 75187/371472 [5:59:04<22:50:15,  3.60it/s]
 20%|██        | 75188/371472 [5:59:04<23:01:11,  3.58it/s]
 20%|██        | 75189/371472 [5:59:04<23:30:34,  3.50it/s]
 20%|██        | 75190/371472 [5:59:04<23:02:59,  3.57it/s]
 20%|██        | 75191/371472 [5:59:05<23:11:24,  3.55it/s]
 20%|██        | 75192/371472 [5:59:05<23:44:37,  3.47it/s]
 20%|██        | 75193/371472 [5:59:05<23:28:48,  3.51it/s]
 20%|██        | 75194/371472 [5:59:06<22:38:08,  3.64it/s]
 20%|██        | 75195/371472 [5:59:06<22:04:57,  3.73it/s]
 20%|██        | 75196/371472 [5:59:06<22:14:05,  3.70it/s]
 20%|██        | 75197/371472 [5:59:06<22:58:29,  3.58it/s]
 20%|██        | 75198/371472 [5:59:07<26:08:59,  3.15it/s]
 20%|██        | 75199/371472 [5:59:07<24:32:05,  3.35it/s]
 20%|██        | 75200/371472 [5:59:07<24:21:55,  3.38it/s]
                                                           
{'loss': 3.9309, 'learning_rate': 8.181925919541468e-07, 'epoch': 3.24}

 20%|██        | 75200/371472 [5:59:07<24:21:55,  3.38it/s]
 20%|██        | 75201/371472 [5:59:08<23:55:00,  3.44it/s]
 20%|██        | 75202/371472 [5:59:08<24:24:31,  3.37it/s]
 20%|██        | 75203/371472 [5:59:08<24:22:23,  3.38it/s]
 20%|██        | 75204/371472 [5:59:09<26:06:01,  3.15it/s]
 20%|██        | 75205/371472 [5:59:09<25:24:47,  3.24it/s]
 20%|██        | 75206/371472 [5:59:09<24:38:48,  3.34it/s]
 20%|██        | 75207/371472 [5:59:09<25:28:21,  3.23it/s]
 20%|██        | 75208/371472 [5:59:10<25:07:24,  3.28it/s]
 20%|██        | 75209/371472 [5:59:10<24:36:14,  3.34it/s]
 20%|██        | 75210/371472 [5:59:10<24:09:43,  3.41it/s]
 20%|██        | 75211/371472 [5:59:11<22:59:38,  3.58it/s]
 20%|██        | 75212/371472 [5:59:11<23:00:07,  3.58it/s]
 20%|██        | 75213/371472 [5:59:11<24:55:16,  3.30it/s]
 20%|██        | 75214/371472 [5:59:11<23:55:11,  3.44it/s]
 20%|██        | 75215/371472 [5:59:12<24:36:57,  3.34it/s]
 20%|██        | 75216/371472 [5:59:12<26:21:10,  3.12it/s]
 20%|██        | 75217/371472 [5:59:12<24:41:17,  3.33it/s]
 20%|██        | 75218/371472 [5:59:13<23:59:12,  3.43it/s]
 20%|██        | 75219/371472 [5:59:13<23:05:34,  3.56it/s]
 20%|██        | 75220/371472 [5:59:13<23:04:41,  3.57it/s]
                                                           
{'loss': 4.2056, 'learning_rate': 8.181441099786679e-07, 'epoch': 3.24}

 20%|██        | 75220/371472 [5:59:13<23:04:41,  3.57it/s]
 20%|██        | 75221/371472 [5:59:14<25:23:32,  3.24it/s]
 20%|██        | 75222/371472 [5:59:14<23:55:58,  3.44it/s]
 20%|██        | 75223/371472 [5:59:14<23:05:01,  3.56it/s]
 20%|██        | 75224/371472 [5:59:14<23:50:20,  3.45it/s]
 20%|██        | 75225/371472 [5:59:15<24:12:28,  3.40it/s]
 20%|██        | 75226/371472 [5:59:15<23:42:34,  3.47it/s]
 20%|██        | 75227/371472 [5:59:15<23:54:33,  3.44it/s]
 20%|██        | 75228/371472 [5:59:16<23:44:07,  3.47it/s]
 20%|██        | 75229/371472 [5:59:16<23:20:16,  3.53it/s]
 20%|██        | 75230/371472 [5:59:16<23:17:37,  3.53it/s]
 20%|██        | 75231/371472 [5:59:16<22:41:57,  3.63it/s]
 20%|██        | 75232/371472 [5:59:17<22:56:40,  3.59it/s]
 20%|██        | 75233/371472 [5:59:17<23:10:50,  3.55it/s]
 20%|██        | 75234/371472 [5:59:17<24:26:31,  3.37it/s]
 20%|██        | 75235/371472 [5:59:18<23:44:30,  3.47it/s]
 20%|██        | 75236/371472 [5:59:18<24:09:50,  3.41it/s]
 20%|██        | 75237/371472 [5:59:18<23:34:45,  3.49it/s]
 20%|██        | 75238/371472 [5:59:18<23:10:04,  3.55it/s]
 20%|██        | 75239/371472 [5:59:19<22:45:40,  3.62it/s]
 20%|██        | 75240/371472 [5:59:19<24:00:19,  3.43it/s]
                                                           
{'loss': 4.0909, 'learning_rate': 8.180956280031889e-07, 'epoch': 3.24}

 20%|██        | 75240/371472 [5:59:19<24:00:19,  3.43it/s]
 20%|██        | 75241/371472 [5:59:19<23:09:46,  3.55it/s]
 20%|██        | 75242/371472 [5:59:19<22:55:23,  3.59it/s]
 20%|██        | 75243/371472 [5:59:20<23:14:43,  3.54it/s]
 20%|██        | 75244/371472 [5:59:20<24:19:18,  3.38it/s]
 20%|██        | 75245/371472 [5:59:20<24:39:44,  3.34it/s]
 20%|██        | 75246/371472 [5:59:21<23:27:49,  3.51it/s]
 20%|██        | 75247/371472 [5:59:21<23:11:35,  3.55it/s]
 20%|██        | 75248/371472 [5:59:21<22:57:30,  3.58it/s]
 20%|██        | 75249/371472 [5:59:21<23:01:32,  3.57it/s]
 20%|██        | 75250/371472 [5:59:22<23:21:29,  3.52it/s]
 20%|██        | 75251/371472 [5:59:22<22:48:11,  3.61it/s]
 20%|██        | 75252/371472 [5:59:22<22:51:42,  3.60it/s]
 20%|██        | 75253/371472 [5:59:23<23:17:23,  3.53it/s]
 20%|██        | 75254/371472 [5:59:23<23:09:25,  3.55it/s]
 20%|██        | 75255/371472 [5:59:23<23:09:58,  3.55it/s]
 20%|██        | 75256/371472 [5:59:23<22:54:50,  3.59it/s]
 20%|██        | 75257/371472 [5:59:24<24:15:36,  3.39it/s]
 20%|██        | 75258/371472 [5:59:24<23:54:19,  3.44it/s]
 20%|██        | 75259/371472 [5:59:24<24:50:42,  3.31it/s]
 20%|██        | 75260/371472 [5:59:25<23:49:28,  3.45it/s]
                                                           
{'loss': 4.293, 'learning_rate': 8.180471460277101e-07, 'epoch': 3.24}

 20%|██        | 75260/371472 [5:59:25<23:49:28,  3.45it/s]
 20%|██        | 75261/371472 [5:59:25<22:47:49,  3.61it/s]
 20%|██        | 75262/371472 [5:59:25<23:59:33,  3.43it/s]
 20%|██        | 75263/371472 [5:59:25<22:51:09,  3.60it/s]
 20%|██        | 75264/371472 [5:59:26<24:01:07,  3.43it/s]
 20%|██        | 75265/371472 [5:59:26<23:29:59,  3.50it/s]
 20%|██        | 75266/371472 [5:59:26<23:05:21,  3.56it/s]
 20%|██        | 75267/371472 [5:59:27<24:23:09,  3.37it/s]
 20%|██        | 75268/371472 [5:59:27<23:52:33,  3.45it/s]
 20%|██        | 75269/371472 [5:59:27<24:23:52,  3.37it/s]
 20%|██        | 75270/371472 [5:59:28<25:39:17,  3.21it/s]
 20%|██        | 75271/371472 [5:59:28<24:38:56,  3.34it/s]
 20%|██        | 75272/371472 [5:59:28<25:41:51,  3.20it/s]
 20%|██        | 75273/371472 [5:59:29<27:16:19,  3.02it/s]
 20%|██        | 75274/371472 [5:59:29<27:00:11,  3.05it/s]
 20%|██        | 75275/371472 [5:59:29<25:57:24,  3.17it/s]
 20%|██        | 75276/371472 [5:59:30<26:33:06,  3.10it/s]
 20%|██        | 75277/371472 [5:59:30<25:37:48,  3.21it/s]
 20%|██        | 75278/371472 [5:59:30<24:03:28,  3.42it/s]
 20%|██        | 75279/371472 [5:59:30<24:30:51,  3.36it/s]
 20%|██        | 75280/371472 [5:59:31<24:27:05,  3.36it/s]
                                                           
{'loss': 3.9907, 'learning_rate': 8.179986640522312e-07, 'epoch': 3.24}

 20%|██        | 75280/371472 [5:59:31<24:27:05,  3.36it/s]
 20%|██        | 75281/371472 [5:59:31<23:17:53,  3.53it/s]
 20%|██        | 75282/371472 [5:59:31<22:44:41,  3.62it/s]
 20%|██        | 75283/371472 [5:59:31<23:20:35,  3.52it/s]
 20%|██        | 75284/371472 [5:59:32<23:15:14,  3.54it/s]
 20%|██        | 75285/371472 [5:59:32<23:33:07,  3.49it/s]
 20%|██        | 75286/371472 [5:59:32<26:11:37,  3.14it/s]
 20%|██        | 75287/371472 [5:59:33<25:26:49,  3.23it/s]
 20%|██        | 75288/371472 [5:59:33<26:45:00,  3.08it/s]
 20%|██        | 75289/371472 [5:59:33<24:55:22,  3.30it/s]
 20%|██        | 75290/371472 [5:59:34<23:56:42,  3.44it/s]
 20%|██        | 75291/371472 [5:59:34<23:42:58,  3.47it/s]
 20%|██        | 75292/371472 [5:59:34<22:25:40,  3.67it/s]
 20%|██        | 75293/371472 [5:59:34<22:40:27,  3.63it/s]
 20%|██        | 75294/371472 [5:59:35<22:56:42,  3.59it/s]
 20%|██        | 75295/371472 [5:59:35<23:19:16,  3.53it/s]
 20%|██        | 75296/371472 [5:59:35<22:39:32,  3.63it/s]
 20%|██        | 75297/371472 [5:59:36<25:12:51,  3.26it/s]
 20%|██        | 75298/371472 [5:59:36<24:08:24,  3.41it/s]
 20%|██        | 75299/371472 [5:59:36<23:48:27,  3.46it/s]
 20%|██        | 75300/371472 [5:59:36<22:51:44,  3.60it/s]
                                                           
{'loss': 4.128, 'learning_rate': 8.179501820767524e-07, 'epoch': 3.24}

 20%|██        | 75300/371472 [5:59:36<22:51:44,  3.60it/s]
 20%|██        | 75301/371472 [5:59:37<22:57:56,  3.58it/s]
 20%|██        | 75302/371472 [5:59:37<22:59:45,  3.58it/s]
 20%|██        | 75303/371472 [5:59:37<25:28:36,  3.23it/s]
 20%|██        | 75304/371472 [5:59:38<24:25:06,  3.37it/s]
 20%|██        | 75305/371472 [5:59:38<23:19:37,  3.53it/s]
 20%|██        | 75306/371472 [5:59:38<23:32:37,  3.49it/s]
 20%|██        | 75307/371472 [5:59:38<23:51:02,  3.45it/s]
 20%|██        | 75308/371472 [5:59:39<23:23:23,  3.52it/s]
 20%|██        | 75309/371472 [5:59:39<22:56:03,  3.59it/s]
 20%|██        | 75310/371472 [5:59:39<23:56:59,  3.43it/s]
 20%|██        | 75311/371472 [5:59:40<23:47:37,  3.46it/s]
 20%|██        | 75312/371472 [5:59:40<23:24:01,  3.52it/s]
 20%|██        | 75313/371472 [5:59:40<23:30:24,  3.50it/s]
 20%|██        | 75314/371472 [5:59:41<24:09:11,  3.41it/s]
 20%|██        | 75315/371472 [5:59:41<24:08:02,  3.41it/s]
 20%|██        | 75316/371472 [5:59:41<24:10:37,  3.40it/s]
 20%|██        | 75317/371472 [5:59:41<23:17:53,  3.53it/s]
 20%|██        | 75318/371472 [5:59:42<22:16:36,  3.69it/s]
 20%|██        | 75319/371472 [5:59:42<24:19:04,  3.38it/s]
 20%|██        | 75320/371472 [5:59:42<24:11:48,  3.40it/s]
                                                           
{'loss': 4.2091, 'learning_rate': 8.179017001012734e-07, 'epoch': 3.24}

 20%|██        | 75320/371472 [5:59:42<24:11:48,  3.40it/s]
 20%|██        | 75321/371472 [5:59:43<25:13:52,  3.26it/s]
 20%|██        | 75322/371472 [5:59:43<24:53:41,  3.30it/s]
 20%|██        | 75323/371472 [5:59:43<24:02:14,  3.42it/s]
 20%|██        | 75324/371472 [5:59:43<23:28:21,  3.50it/s]
 20%|██        | 75325/371472 [5:59:44<22:53:58,  3.59it/s]
 20%|██        | 75326/371472 [5:59:44<22:49:35,  3.60it/s]
 20%|██        | 75327/371472 [5:59:44<22:38:13,  3.63it/s]
 20%|██        | 75328/371472 [5:59:45<26:50:40,  3.06it/s]
 20%|██        | 75329/371472 [5:59:45<25:16:30,  3.25it/s]
 20%|██        | 75330/371472 [5:59:45<24:56:51,  3.30it/s]
 20%|██        | 75331/371472 [5:59:45<23:43:24,  3.47it/s]
 20%|██        | 75332/371472 [5:59:46<23:37:53,  3.48it/s]
 20%|██        | 75333/371472 [5:59:46<23:12:46,  3.54it/s]
 20%|██        | 75334/371472 [5:59:46<22:21:47,  3.68it/s]
 20%|██        | 75335/371472 [5:59:47<21:50:36,  3.77it/s]
 20%|██        | 75336/371472 [5:59:47<21:36:32,  3.81it/s]
 20%|██        | 75337/371472 [5:59:47<23:15:49,  3.54it/s]
 20%|██        | 75338/371472 [5:59:47<24:21:29,  3.38it/s]
 20%|██        | 75339/371472 [5:59:48<25:49:29,  3.19it/s]
 20%|██        | 75340/371472 [5:59:48<25:11:07,  3.27it/s]
                                                           
{'loss': 4.3179, 'learning_rate': 8.178532181257945e-07, 'epoch': 3.25}

 20%|██        | 75340/371472 [5:59:48<25:11:07,  3.27it/s]
 20%|██        | 75341/371472 [5:59:48<24:00:13,  3.43it/s]
 20%|██        | 75342/371472 [5:59:49<23:22:56,  3.52it/s]
 20%|██        | 75343/371472 [5:59:49<23:41:38,  3.47it/s]
 20%|██        | 75344/371472 [5:59:49<23:10:17,  3.55it/s]
 20%|██        | 75345/371472 [5:59:49<23:23:39,  3.52it/s]
 20%|██        | 75346/371472 [5:59:50<25:26:14,  3.23it/s]
 20%|██        | 75347/371472 [5:59:50<24:43:20,  3.33it/s]
 20%|██        | 75348/371472 [5:59:50<24:07:16,  3.41it/s]
 20%|██        | 75349/371472 [5:59:51<27:17:13,  3.01it/s]
 20%|██        | 75350/371472 [5:59:51<26:15:59,  3.13it/s]
 20%|██        | 75351/371472 [5:59:51<25:31:27,  3.22it/s]
 20%|██        | 75352/371472 [5:59:52<24:29:45,  3.36it/s]
 20%|██        | 75353/371472 [5:59:52<23:03:02,  3.57it/s]
 20%|██        | 75354/371472 [5:59:52<22:42:40,  3.62it/s]
 20%|██        | 75355/371472 [5:59:52<22:16:12,  3.69it/s]
 20%|██        | 75356/371472 [5:59:53<23:18:08,  3.53it/s]
 20%|██        | 75357/371472 [5:59:53<24:11:57,  3.40it/s]
 20%|██        | 75358/371472 [5:59:53<24:02:50,  3.42it/s]
 20%|██        | 75359/371472 [5:59:54<25:50:52,  3.18it/s]
 20%|██        | 75360/371472 [5:59:54<26:38:00,  3.09it/s]
                                                           
{'loss': 3.9396, 'learning_rate': 8.178047361503156e-07, 'epoch': 3.25}

 20%|██        | 75360/371472 [5:59:54<26:38:00,  3.09it/s]
 20%|██        | 75361/371472 [5:59:54<25:28:04,  3.23it/s]
 20%|██        | 75362/371472 [5:59:55<24:09:08,  3.41it/s]
 20%|██        | 75363/371472 [5:59:55<23:10:20,  3.55it/s]
 20%|██        | 75364/371472 [5:59:55<24:03:48,  3.42it/s]
 20%|██        | 75365/371472 [5:59:55<23:47:27,  3.46it/s]
 20%|██        | 75366/371472 [5:59:56<23:53:42,  3.44it/s]
 20%|██        | 75367/371472 [5:59:56<23:21:04,  3.52it/s]
 20%|██        | 75368/371472 [5:59:56<24:11:53,  3.40it/s]
 20%|██        | 75369/371472 [5:59:57<23:19:30,  3.53it/s]
 20%|██        | 75370/371472 [5:59:57<22:28:46,  3.66it/s]
 20%|██        | 75371/371472 [5:59:57<24:11:48,  3.40it/s]
 20%|██        | 75372/371472 [5:59:57<23:35:38,  3.49it/s]
 20%|██        | 75373/371472 [5:59:58<23:29:45,  3.50it/s]
 20%|██        | 75374/371472 [5:59:58<24:09:39,  3.40it/s]
 20%|██        | 75375/371472 [5:59:58<24:24:36,  3.37it/s]
 20%|██        | 75376/371472 [5:59:59<23:42:08,  3.47it/s]
 20%|██        | 75377/371472 [5:59:59<23:12:10,  3.54it/s]
 20%|██        | 75378/371472 [5:59:59<23:26:55,  3.51it/s]
 20%|██        | 75379/371472 [5:59:59<24:23:40,  3.37it/s]
 20%|██        | 75380/371472 [6:00:00<23:35:34,  3.49it/s]
                                                           
{'loss': 4.4707, 'learning_rate': 8.177562541748368e-07, 'epoch': 3.25}

 20%|██        | 75380/371472 [6:00:00<23:35:34,  3.49it/s]
 20%|██        | 75381/371472 [6:00:00<23:39:50,  3.48it/s]
 20%|██        | 75382/371472 [6:00:00<22:37:35,  3.63it/s]
 20%|██        | 75383/371472 [6:00:01<23:01:23,  3.57it/s]
 20%|██        | 75384/371472 [6:00:01<22:44:10,  3.62it/s]
 20%|██        | 75385/371472 [6:00:01<26:17:07,  3.13it/s]
 20%|██        | 75386/371472 [6:00:02<26:45:26,  3.07it/s]
 20%|██        | 75387/371472 [6:00:02<26:36:54,  3.09it/s]
 20%|██        | 75388/371472 [6:00:02<26:11:04,  3.14it/s]
 20%|██        | 75389/371472 [6:00:02<24:43:32,  3.33it/s]
 20%|██        | 75390/371472 [6:00:03<23:53:41,  3.44it/s]
 20%|██        | 75391/371472 [6:00:03<24:33:29,  3.35it/s]
 20%|██        | 75392/371472 [6:00:03<23:40:12,  3.47it/s]
 20%|██        | 75393/371472 [6:00:04<24:11:01,  3.40it/s]
 20%|██        | 75394/371472 [6:00:04<23:41:56,  3.47it/s]
 20%|██        | 75395/371472 [6:00:04<24:42:42,  3.33it/s]
 20%|██        | 75396/371472 [6:00:05<24:26:32,  3.36it/s]
 20%|██        | 75397/371472 [6:00:05<23:39:59,  3.48it/s]
 20%|██        | 75398/371472 [6:00:05<22:50:14,  3.60it/s]
 20%|██        | 75399/371472 [6:00:05<23:09:13,  3.55it/s]
 20%|██        | 75400/371472 [6:00:06<22:34:22,  3.64it/s]
                                                           
{'loss': 4.0212, 'learning_rate': 8.177077721993578e-07, 'epoch': 3.25}

 20%|██        | 75400/371472 [6:00:06<22:34:22,  3.64it/s]
 20%|██        | 75401/371472 [6:00:06<22:10:38,  3.71it/s]
 20%|██        | 75402/371472 [6:00:06<22:19:32,  3.68it/s]
 20%|██        | 75403/371472 [6:00:07<26:56:40,  3.05it/s]
 20%|██        | 75404/371472 [6:00:07<27:30:29,  2.99it/s]
 20%|██        | 75405/371472 [6:00:07<26:10:19,  3.14it/s]
 20%|██        | 75406/371472 [6:00:08<24:56:22,  3.30it/s]
 20%|██        | 75407/371472 [6:00:08<24:35:55,  3.34it/s]
 20%|██        | 75408/371472 [6:00:08<24:13:38,  3.39it/s]
 20%|██        | 75409/371472 [6:00:08<23:32:58,  3.49it/s]
 20%|██        | 75410/371472 [6:00:09<22:53:23,  3.59it/s]
 20%|██        | 75411/371472 [6:00:09<22:08:22,  3.71it/s]
 20%|██        | 75412/371472 [6:00:09<22:10:39,  3.71it/s]
 20%|██        | 75413/371472 [6:00:09<22:24:19,  3.67it/s]
 20%|██        | 75414/371472 [6:00:10<22:30:59,  3.65it/s]
 20%|██        | 75415/371472 [6:00:10<21:52:30,  3.76it/s]
 20%|██        | 75416/371472 [6:00:10<23:36:03,  3.48it/s]
 20%|██        | 75417/371472 [6:00:11<23:14:40,  3.54it/s]
 20%|██        | 75418/371472 [6:00:11<22:25:56,  3.67it/s]
 20%|██        | 75419/371472 [6:00:11<22:37:07,  3.64it/s]
 20%|██        | 75420/371472 [6:00:11<22:33:54,  3.64it/s]
                                                           
{'loss': 4.2023, 'learning_rate': 8.17659290223879e-07, 'epoch': 3.25}

 20%|██        | 75420/371472 [6:00:11<22:33:54,  3.64it/s]
 20%|██        | 75421/371472 [6:00:12<22:36:09,  3.64it/s]
 20%|██        | 75422/371472 [6:00:12<22:01:06,  3.73it/s]
 20%|██        | 75423/371472 [6:00:12<21:23:41,  3.84it/s]
 20%|██        | 75424/371472 [6:00:12<21:16:33,  3.87it/s]
 20%|██        | 75425/371472 [6:00:13<25:33:23,  3.22it/s]
 20%|██        | 75426/371472 [6:00:13<24:50:14,  3.31it/s]
 20%|██        | 75427/371472 [6:00:13<24:05:11,  3.41it/s]
 20%|██        | 75428/371472 [6:00:14<23:12:01,  3.54it/s]
 20%|██        | 75429/371472 [6:00:14<24:18:32,  3.38it/s]
 20%|██        | 75430/371472 [6:00:14<25:01:17,  3.29it/s]
 20%|██        | 75431/371472 [6:00:15<25:09:08,  3.27it/s]
 20%|██        | 75432/371472 [6:00:15<24:40:41,  3.33it/s]
 20%|██        | 75433/371472 [6:00:15<23:23:33,  3.52it/s]
 20%|██        | 75434/371472 [6:00:15<23:16:58,  3.53it/s]
 20%|██        | 75435/371472 [6:00:16<22:52:28,  3.59it/s]
 20%|██        | 75436/371472 [6:00:16<23:29:46,  3.50it/s]
 20%|██        | 75437/371472 [6:00:16<24:27:16,  3.36it/s]
 20%|██        | 75438/371472 [6:00:17<23:51:48,  3.45it/s]
 20%|██        | 75439/371472 [6:00:17<24:23:15,  3.37it/s]
 20%|██        | 75440/371472 [6:00:17<24:11:26,  3.40it/s]
                                                           
{'loss': 4.2866, 'learning_rate': 8.176108082484001e-07, 'epoch': 3.25}

 20%|██        | 75440/371472 [6:00:17<24:11:26,  3.40it/s]
 20%|██        | 75441/371472 [6:00:17<23:48:14,  3.45it/s]
 20%|██        | 75442/371472 [6:00:18<23:46:02,  3.46it/s]
 20%|██        | 75443/371472 [6:00:18<23:53:41,  3.44it/s]
 20%|██        | 75444/371472 [6:00:18<23:48:34,  3.45it/s]
 20%|██        | 75445/371472 [6:00:19<25:20:20,  3.25it/s]
 20%|██        | 75446/371472 [6:00:19<23:57:52,  3.43it/s]
 20%|██        | 75447/371472 [6:00:19<24:16:05,  3.39it/s]
 20%|██        | 75448/371472 [6:00:19<23:37:44,  3.48it/s]
 20%|██        | 75449/371472 [6:00:20<22:52:55,  3.59it/s]
 20%|██        | 75450/371472 [6:00:20<22:32:55,  3.65it/s]
 20%|██        | 75451/371472 [6:00:20<23:01:49,  3.57it/s]
 20%|██        | 75452/371472 [6:00:21<22:29:37,  3.66it/s]
 20%|██        | 75453/371472 [6:00:21<24:12:06,  3.40it/s]
 20%|██        | 75454/371472 [6:00:21<24:11:22,  3.40it/s]
 20%|██        | 75455/371472 [6:00:21<24:00:00,  3.43it/s]
 20%|██        | 75456/371472 [6:00:22<23:51:01,  3.45it/s]
 20%|██        | 75457/371472 [6:00:22<25:31:26,  3.22it/s]
 20%|██        | 75458/371472 [6:00:23<28:54:12,  2.84it/s]
 20%|██        | 75459/371472 [6:00:23<28:09:26,  2.92it/s]
 20%|██        | 75460/371472 [6:00:23<28:13:07,  2.91it/s]
                                                           
{'loss': 4.0377, 'learning_rate': 8.17562326272921e-07, 'epoch': 3.25}

 20%|██        | 75460/371472 [6:00:23<28:13:07,  2.91it/s]
 20%|██        | 75461/371472 [6:00:24<26:51:30,  3.06it/s]
 20%|██        | 75462/371472 [6:00:24<25:42:53,  3.20it/s]
 20%|██        | 75463/371472 [6:00:24<26:24:48,  3.11it/s]
 20%|██        | 75464/371472 [6:00:24<25:03:51,  3.28it/s]
 20%|██        | 75465/371472 [6:00:25<25:11:34,  3.26it/s]
 20%|██        | 75466/371472 [6:00:25<24:06:47,  3.41it/s]
 20%|██        | 75467/371472 [6:00:25<23:20:05,  3.52it/s]
 20%|██        | 75468/371472 [6:00:26<23:15:54,  3.53it/s]
 20%|██        | 75469/371472 [6:00:26<23:04:51,  3.56it/s]
 20%|██        | 75470/371472 [6:00:26<22:20:58,  3.68it/s]
 20%|██        | 75471/371472 [6:00:26<22:37:22,  3.63it/s]
 20%|██        | 75472/371472 [6:00:27<22:23:11,  3.67it/s]
 20%|██        | 75473/371472 [6:00:27<21:48:55,  3.77it/s]
 20%|██        | 75474/371472 [6:00:27<22:35:06,  3.64it/s]
 20%|██        | 75475/371472 [6:00:27<22:43:21,  3.62it/s]
 20%|██        | 75476/371472 [6:00:28<22:29:04,  3.66it/s]
 20%|██        | 75477/371472 [6:00:28<24:05:01,  3.41it/s]
 20%|██        | 75478/371472 [6:00:28<24:35:04,  3.34it/s]
 20%|██        | 75479/371472 [6:00:29<23:42:49,  3.47it/s]
 20%|██        | 75480/371472 [6:00:29<24:12:45,  3.40it/s]
                                                           
{'loss': 4.1171, 'learning_rate': 8.175138442974422e-07, 'epoch': 3.25}

 20%|██        | 75480/371472 [6:00:29<24:12:45,  3.40it/s]
 20%|██        | 75481/371472 [6:00:29<25:00:45,  3.29it/s]
 20%|██        | 75482/371472 [6:00:29<23:33:18,  3.49it/s]
 20%|██        | 75483/371472 [6:00:30<22:57:31,  3.58it/s]
 20%|██        | 75484/371472 [6:00:30<23:22:24,  3.52it/s]
 20%|██        | 75485/371472 [6:00:30<23:00:15,  3.57it/s]
 20%|██        | 75486/371472 [6:00:31<23:40:57,  3.47it/s]
 20%|██        | 75487/371472 [6:00:31<23:15:00,  3.54it/s]
 20%|██        | 75488/371472 [6:00:31<22:39:50,  3.63it/s]
 20%|██        | 75489/371472 [6:00:31<22:36:16,  3.64it/s]
 20%|██        | 75490/371472 [6:00:32<22:38:43,  3.63it/s]
 20%|██        | 75491/371472 [6:00:32<22:27:51,  3.66it/s]
 20%|██        | 75492/371472 [6:00:32<22:13:29,  3.70it/s]
 20%|██        | 75493/371472 [6:00:32<22:13:27,  3.70it/s]
 20%|██        | 75494/371472 [6:00:33<23:19:25,  3.52it/s]
 20%|██        | 75495/371472 [6:00:33<26:55:12,  3.05it/s]
 20%|██        | 75496/371472 [6:00:34<25:52:52,  3.18it/s]
 20%|██        | 75497/371472 [6:00:34<24:00:30,  3.42it/s]
 20%|██        | 75498/371472 [6:00:34<24:21:37,  3.37it/s]
 20%|██        | 75499/371472 [6:00:34<23:44:47,  3.46it/s]
 20%|██        | 75500/371472 [6:00:35<23:58:55,  3.43it/s]
                                                           
{'loss': 4.1174, 'learning_rate': 8.174653623219634e-07, 'epoch': 3.25}

 20%|██        | 75500/371472 [6:00:35<23:58:55,  3.43it/s]
 20%|██        | 75501/371472 [6:00:35<23:09:29,  3.55it/s]
 20%|██        | 75502/371472 [6:00:35<23:04:05,  3.56it/s]
 20%|██        | 75503/371472 [6:00:35<23:10:26,  3.55it/s]
 20%|██        | 75504/371472 [6:00:36<22:51:01,  3.60it/s]
 20%|██        | 75505/371472 [6:00:36<22:17:35,  3.69it/s]
 20%|██        | 75506/371472 [6:00:36<21:58:22,  3.74it/s]
 20%|██        | 75507/371472 [6:00:37<22:13:07,  3.70it/s]
 20%|██        | 75508/371472 [6:00:37<22:45:19,  3.61it/s]
 20%|██        | 75509/371472 [6:00:37<22:39:34,  3.63it/s]
 20%|██        | 75510/371472 [6:00:37<23:25:37,  3.51it/s]
 20%|██        | 75511/371472 [6:00:38<23:42:35,  3.47it/s]
 20%|██        | 75512/371472 [6:00:38<23:58:07,  3.43it/s]
 20%|██        | 75513/371472 [6:00:38<24:43:16,  3.33it/s]
 20%|██        | 75514/371472 [6:00:39<24:55:00,  3.30it/s]
 20%|██        | 75515/371472 [6:00:39<25:12:25,  3.26it/s]
 20%|██        | 75516/371472 [6:00:39<24:47:19,  3.32it/s]
 20%|██        | 75517/371472 [6:00:39<23:54:49,  3.44it/s]
 20%|██        | 75518/371472 [6:00:40<23:30:53,  3.50it/s]
 20%|██        | 75519/371472 [6:00:40<24:57:26,  3.29it/s]
 20%|██        | 75520/371472 [6:00:40<23:44:57,  3.46it/s]
                                                           
{'loss': 3.9708, 'learning_rate': 8.174168803464845e-07, 'epoch': 3.25}

 20%|██        | 75520/371472 [6:00:40<23:44:57,  3.46it/s]
 20%|██        | 75521/371472 [6:00:41<23:06:37,  3.56it/s]
 20%|██        | 75522/371472 [6:00:41<22:46:37,  3.61it/s]
 20%|██        | 75523/371472 [6:00:41<21:59:48,  3.74it/s]
 20%|██        | 75524/371472 [6:00:41<22:07:05,  3.72it/s]
 20%|██        | 75525/371472 [6:00:42<22:42:52,  3.62it/s]
 20%|██        | 75526/371472 [6:00:42<23:05:15,  3.56it/s]
 20%|██        | 75527/371472 [6:00:42<23:59:18,  3.43it/s]
 20%|██        | 75528/371472 [6:00:43<25:09:30,  3.27it/s]
 20%|██        | 75529/371472 [6:00:43<25:16:21,  3.25it/s]
 20%|██        | 75530/371472 [6:00:43<24:00:50,  3.42it/s]
 20%|██        | 75531/371472 [6:00:43<23:19:43,  3.52it/s]
 20%|██        | 75532/371472 [6:00:44<23:38:24,  3.48it/s]
 20%|██        | 75533/371472 [6:00:44<22:53:47,  3.59it/s]
 20%|██        | 75534/371472 [6:00:44<22:38:27,  3.63it/s]
 20%|██        | 75535/371472 [6:00:45<22:39:33,  3.63it/s]
 20%|██        | 75536/371472 [6:00:45<22:57:07,  3.58it/s]
 20%|██        | 75537/371472 [6:00:45<22:20:32,  3.68it/s]
 20%|██        | 75538/371472 [6:00:45<23:39:02,  3.48it/s]
 20%|██        | 75539/371472 [6:00:46<23:47:25,  3.46it/s]
 20%|██        | 75540/371472 [6:00:46<23:47:22,  3.46it/s]
                                                           
{'loss': 4.0468, 'learning_rate': 8.173683983710055e-07, 'epoch': 3.25}

 20%|██        | 75540/371472 [6:00:46<23:47:22,  3.46it/s]
 20%|██        | 75541/371472 [6:00:46<25:36:35,  3.21it/s]
 20%|██        | 75542/371472 [6:00:47<24:25:53,  3.36it/s]
 20%|██        | 75543/371472 [6:00:47<23:23:21,  3.51it/s]
 20%|██        | 75544/371472 [6:00:47<23:09:40,  3.55it/s]
 20%|██        | 75545/371472 [6:00:47<22:42:57,  3.62it/s]
 20%|██        | 75546/371472 [6:00:48<23:54:45,  3.44it/s]
 20%|██        | 75547/371472 [6:00:48<23:05:47,  3.56it/s]
 20%|██        | 75548/371472 [6:00:48<23:25:07,  3.51it/s]
 20%|██        | 75549/371472 [6:00:49<23:22:57,  3.52it/s]
 20%|██        | 75550/371472 [6:00:49<25:26:32,  3.23it/s]
 20%|██        | 75551/371472 [6:00:49<25:25:04,  3.23it/s]
 20%|██        | 75552/371472 [6:00:50<24:29:15,  3.36it/s]
 20%|██        | 75553/371472 [6:00:50<24:02:35,  3.42it/s]
 20%|██        | 75554/371472 [6:00:50<23:53:47,  3.44it/s]
 20%|██        | 75555/371472 [6:00:50<23:58:41,  3.43it/s]
 20%|██        | 75556/371472 [6:00:51<23:00:20,  3.57it/s]
 20%|██        | 75557/371472 [6:00:51<23:05:37,  3.56it/s]
 20%|██        | 75558/371472 [6:00:51<23:47:31,  3.45it/s]
 20%|██        | 75559/371472 [6:00:52<23:47:06,  3.46it/s]
 20%|██        | 75560/371472 [6:00:52<24:17:38,  3.38it/s]
                                                           
{'loss': 4.3976, 'learning_rate': 8.173199163955268e-07, 'epoch': 3.25}

 20%|██        | 75560/371472 [6:00:52<24:17:38,  3.38it/s]
 20%|██        | 75561/371472 [6:00:52<24:10:29,  3.40it/s]
 20%|██        | 75562/371472 [6:00:52<23:09:51,  3.55it/s]
 20%|██        | 75563/371472 [6:00:53<22:56:26,  3.58it/s]
 20%|██        | 75564/371472 [6:00:53<22:45:30,  3.61it/s]
 20%|██        | 75565/371472 [6:00:53<22:49:34,  3.60it/s]
 20%|██        | 75566/371472 [6:00:54<23:19:30,  3.52it/s]
 20%|██        | 75567/371472 [6:00:54<23:04:05,  3.56it/s]
 20%|██        | 75568/371472 [6:00:54<24:39:47,  3.33it/s]
 20%|██        | 75569/371472 [6:00:54<24:05:53,  3.41it/s]
 20%|██        | 75570/371472 [6:00:55<24:26:25,  3.36it/s]
 20%|██        | 75571/371472 [6:00:55<23:15:33,  3.53it/s]
 20%|██        | 75572/371472 [6:00:55<23:34:31,  3.49it/s]
 20%|██        | 75573/371472 [6:00:56<23:13:20,  3.54it/s]
 20%|██        | 75574/371472 [6:00:56<24:32:43,  3.35it/s]
 20%|██        | 75575/371472 [6:00:56<23:55:44,  3.43it/s]
 20%|██        | 75576/371472 [6:00:56<24:43:43,  3.32it/s]
 20%|██        | 75577/371472 [6:00:57<24:00:42,  3.42it/s]
 20%|██        | 75578/371472 [6:00:57<23:30:28,  3.50it/s]
 20%|██        | 75579/371472 [6:00:57<23:09:45,  3.55it/s]
 20%|██        | 75580/371472 [6:00:58<24:31:12,  3.35it/s]
                                                           
{'loss': 4.2645, 'learning_rate': 8.172714344200478e-07, 'epoch': 3.26}

 20%|██        | 75580/371472 [6:00:58<24:31:12,  3.35it/s]
 20%|██        | 75581/371472 [6:00:58<27:26:19,  3.00it/s]
 20%|██        | 75582/371472 [6:00:58<26:58:01,  3.05it/s]
 20%|██        | 75583/371472 [6:00:59<26:20:56,  3.12it/s]
 20%|██        | 75584/371472 [6:00:59<24:50:23,  3.31it/s]
 20%|██        | 75585/371472 [6:00:59<23:45:58,  3.46it/s]
 20%|██        | 75586/371472 [6:00:59<22:55:18,  3.59it/s]
 20%|██        | 75587/371472 [6:01:00<22:31:05,  3.65it/s]
 20%|██        | 75588/371472 [6:01:00<24:20:27,  3.38it/s]
 20%|██        | 75589/371472 [6:01:00<23:47:52,  3.45it/s]
 20%|██        | 75590/371472 [6:01:01<23:01:02,  3.57it/s]
 20%|██        | 75591/371472 [6:01:01<22:49:14,  3.60it/s]
 20%|██        | 75592/371472 [6:01:01<23:10:03,  3.55it/s]
 20%|██        | 75593/371472 [6:01:01<22:53:32,  3.59it/s]
 20%|██        | 75594/371472 [6:01:02<22:25:06,  3.67it/s]
 20%|██        | 75595/371472 [6:01:02<23:21:34,  3.52it/s]
 20%|██        | 75596/371472 [6:01:02<22:32:41,  3.65it/s]
 20%|██        | 75597/371472 [6:01:03<22:22:03,  3.67it/s]
 20%|██        | 75598/371472 [6:01:03<23:12:14,  3.54it/s]
 20%|██        | 75599/371472 [6:01:03<23:26:34,  3.51it/s]
 20%|██        | 75600/371472 [6:01:03<22:38:42,  3.63it/s]
                                                           
{'loss': 4.3369, 'learning_rate': 8.172229524445689e-07, 'epoch': 3.26}

 20%|██        | 75600/371472 [6:01:03<22:38:42,  3.63it/s]
 20%|██        | 75601/371472 [6:01:04<24:30:11,  3.35it/s]
 20%|██        | 75602/371472 [6:01:04<24:59:54,  3.29it/s]
 20%|██        | 75603/371472 [6:01:04<23:46:00,  3.46it/s]
 20%|██        | 75604/371472 [6:01:05<23:00:35,  3.57it/s]
 20%|██        | 75605/371472 [6:01:05<22:39:29,  3.63it/s]
 20%|██        | 75606/371472 [6:01:05<22:40:07,  3.63it/s]
 20%|██        | 75607/371472 [6:01:05<23:32:34,  3.49it/s]
 20%|██        | 75608/371472 [6:01:06<22:51:45,  3.59it/s]
 20%|██        | 75609/371472 [6:01:06<23:14:57,  3.53it/s]
 20%|██        | 75610/371472 [6:01:06<22:36:03,  3.64it/s]
 20%|██        | 75611/371472 [6:01:06<22:43:39,  3.62it/s]
 20%|██        | 75612/371472 [6:01:07<22:33:20,  3.64it/s]
 20%|██        | 75613/371472 [6:01:07<21:41:05,  3.79it/s]
 20%|██        | 75614/371472 [6:01:07<22:07:00,  3.72it/s]
 20%|██        | 75615/371472 [6:01:08<23:51:04,  3.45it/s]
 20%|██        | 75616/371472 [6:01:08<24:36:46,  3.34it/s]
 20%|██        | 75617/371472 [6:01:08<24:28:56,  3.36it/s]
 20%|██        | 75618/371472 [6:01:09<24:33:12,  3.35it/s]
 20%|██        | 75619/371472 [6:01:09<23:59:07,  3.43it/s]
 20%|██        | 75620/371472 [6:01:09<23:45:51,  3.46it/s]
                                                           
{'loss': 4.2552, 'learning_rate': 8.171744704690899e-07, 'epoch': 3.26}

 20%|██        | 75620/371472 [6:01:09<23:45:51,  3.46it/s]
 20%|██        | 75621/371472 [6:01:09<23:04:07,  3.56it/s]
 20%|██        | 75622/371472 [6:01:10<22:18:31,  3.68it/s]
 20%|██        | 75623/371472 [6:01:10<23:25:19,  3.51it/s]
 20%|██        | 75624/371472 [6:01:10<23:05:35,  3.56it/s]
 20%|██        | 75625/371472 [6:01:10<22:09:47,  3.71it/s]
 20%|██        | 75626/371472 [6:01:11<21:43:34,  3.78it/s]
 20%|██        | 75627/371472 [6:01:11<21:34:19,  3.81it/s]
 20%|██        | 75628/371472 [6:01:11<21:32:08,  3.82it/s]
 20%|██        | 75629/371472 [6:01:11<21:34:15,  3.81it/s]
 20%|██        | 75630/371472 [6:01:12<22:32:01,  3.65it/s]
 20%|██        | 75631/371472 [6:01:12<23:03:39,  3.56it/s]
 20%|██        | 75632/371472 [6:01:12<23:38:03,  3.48it/s]
 20%|██        | 75633/371472 [6:01:13<23:42:13,  3.47it/s]
 20%|██        | 75634/371472 [6:01:13<23:13:44,  3.54it/s]
 20%|██        | 75635/371472 [6:01:13<23:29:15,  3.50it/s]
 20%|██        | 75636/371472 [6:01:14<24:30:46,  3.35it/s]
 20%|██        | 75637/371472 [6:01:14<23:45:39,  3.46it/s]
 20%|██        | 75638/371472 [6:01:14<24:15:41,  3.39it/s]
 20%|██        | 75639/371472 [6:01:14<25:18:54,  3.25it/s]
 20%|██        | 75640/371472 [6:01:15<24:18:33,  3.38it/s]
                                                           
{'loss': 4.0754, 'learning_rate': 8.171259884936111e-07, 'epoch': 3.26}

 20%|██        | 75640/371472 [6:01:15<24:18:33,  3.38it/s]
 20%|██        | 75641/371472 [6:01:15<23:03:40,  3.56it/s]
 20%|██        | 75642/371472 [6:01:15<22:25:11,  3.67it/s]
 20%|██        | 75643/371472 [6:01:16<22:46:43,  3.61it/s]
 20%|██        | 75644/371472 [6:01:16<23:53:07,  3.44it/s]
 20%|██        | 75645/371472 [6:01:16<23:22:11,  3.52it/s]
 20%|██        | 75646/371472 [6:01:16<23:24:45,  3.51it/s]
 20%|██        | 75647/371472 [6:01:17<22:46:50,  3.61it/s]
 20%|██        | 75648/371472 [6:01:17<22:45:38,  3.61it/s]
 20%|██        | 75649/371472 [6:01:17<21:55:47,  3.75it/s]
 20%|██        | 75650/371472 [6:01:17<21:12:22,  3.87it/s]
 20%|██        | 75651/371472 [6:01:18<21:59:31,  3.74it/s]
 20%|██        | 75652/371472 [6:01:18<21:56:42,  3.74it/s]
 20%|██        | 75653/371472 [6:01:18<22:06:42,  3.72it/s]
 20%|██        | 75654/371472 [6:01:19<22:26:49,  3.66it/s]
 20%|██        | 75655/371472 [6:01:19<22:19:58,  3.68it/s]
 20%|██        | 75656/371472 [6:01:19<22:32:39,  3.64it/s]
 20%|██        | 75657/371472 [6:01:19<23:19:56,  3.52it/s]
 20%|██        | 75658/371472 [6:01:20<22:38:14,  3.63it/s]
 20%|██        | 75659/371472 [6:01:20<22:22:48,  3.67it/s]
 20%|██        | 75660/371472 [6:01:20<22:57:10,  3.58it/s]
                                                           
{'loss': 4.2354, 'learning_rate': 8.170775065181323e-07, 'epoch': 3.26}

 20%|██        | 75660/371472 [6:01:20<22:57:10,  3.58it/s]
 20%|██        | 75661/371472 [6:01:21<24:33:39,  3.35it/s]
 20%|██        | 75662/371472 [6:01:21<23:57:42,  3.43it/s]
 20%|██        | 75663/371472 [6:01:21<23:37:40,  3.48it/s]
 20%|██        | 75664/371472 [6:01:21<22:41:13,  3.62it/s]
 20%|██        | 75665/371472 [6:01:22<22:33:59,  3.64it/s]
 20%|██        | 75666/371472 [6:01:22<22:37:13,  3.63it/s]
 20%|██        | 75667/371472 [6:01:22<23:47:02,  3.45it/s]
 20%|██        | 75668/371472 [6:01:22<22:51:12,  3.60it/s]
 20%|██        | 75669/371472 [6:01:23<22:32:25,  3.65it/s]
 20%|██        | 75670/371472 [6:01:23<23:48:14,  3.45it/s]
 20%|██        | 75671/371472 [6:01:23<24:05:00,  3.41it/s]
 20%|██        | 75672/371472 [6:01:24<23:32:46,  3.49it/s]
 20%|██        | 75673/371472 [6:01:24<23:33:29,  3.49it/s]
 20%|██        | 75674/371472 [6:01:24<23:54:46,  3.44it/s]
 20%|██        | 75675/371472 [6:01:25<24:20:05,  3.38it/s]
 20%|██        | 75676/371472 [6:01:25<25:48:44,  3.18it/s]
 20%|██        | 75677/371472 [6:01:25<25:33:59,  3.21it/s]
 20%|██        | 75678/371472 [6:01:26<25:41:49,  3.20it/s]
 20%|██        | 75679/371472 [6:01:26<25:47:56,  3.18it/s]
 20%|██        | 75680/371472 [6:01:26<26:36:31,  3.09it/s]
                                                           
{'loss': 3.9267, 'learning_rate': 8.170290245426534e-07, 'epoch': 3.26}

 20%|██        | 75680/371472 [6:01:26<26:36:31,  3.09it/s]
 20%|██        | 75681/371472 [6:01:26<25:18:31,  3.25it/s]
 20%|██        | 75682/371472 [6:01:27<24:24:37,  3.37it/s]
 20%|██        | 75683/371472 [6:01:27<24:09:28,  3.40it/s]
 20%|██        | 75684/371472 [6:01:27<23:19:23,  3.52it/s]
 20%|██        | 75685/371472 [6:01:28<22:40:01,  3.62it/s]
 20%|██        | 75686/371472 [6:01:28<23:02:42,  3.57it/s]
 20%|██        | 75687/371472 [6:01:28<22:22:30,  3.67it/s]
 20%|██        | 75688/371472 [6:01:28<23:52:25,  3.44it/s]
 20%|██        | 75689/371472 [6:01:29<23:33:12,  3.49it/s]
 20%|██        | 75690/371472 [6:01:29<23:12:13,  3.54it/s]
 20%|██        | 75691/371472 [6:01:29<23:02:45,  3.57it/s]
 20%|██        | 75692/371472 [6:01:29<22:51:28,  3.59it/s]
 20%|██        | 75693/371472 [6:01:30<22:56:45,  3.58it/s]
 20%|██        | 75694/371472 [6:01:30<22:57:10,  3.58it/s]
 20%|██        | 75695/371472 [6:01:30<23:17:05,  3.53it/s]
 20%|██        | 75696/371472 [6:01:31<22:02:21,  3.73it/s]
 20%|██        | 75697/371472 [6:01:31<22:03:04,  3.73it/s]
 20%|██        | 75698/371472 [6:01:31<23:30:57,  3.49it/s]
 20%|██        | 75699/371472 [6:01:31<22:35:54,  3.64it/s]
 20%|██        | 75700/371472 [6:01:32<24:36:48,  3.34it/s]
                                                           
{'loss': 4.1187, 'learning_rate': 8.169805425671744e-07, 'epoch': 3.26}

 20%|██        | 75700/371472 [6:01:32<24:36:48,  3.34it/s]
 20%|██        | 75701/371472 [6:01:32<24:18:38,  3.38it/s]
 20%|██        | 75702/371472 [6:01:32<23:26:00,  3.51it/s]
 20%|██        | 75703/371472 [6:01:33<23:33:37,  3.49it/s]
 20%|██        | 75704/371472 [6:01:33<26:11:20,  3.14it/s]
 20%|██        | 75705/371472 [6:01:33<24:56:56,  3.29it/s]
 20%|██        | 75706/371472 [6:01:34<23:48:01,  3.45it/s]
 20%|██        | 75707/371472 [6:01:34<23:45:21,  3.46it/s]
 20%|██        | 75708/371472 [6:01:34<22:58:06,  3.58it/s]
 20%|██        | 75709/371472 [6:01:34<23:00:30,  3.57it/s]
 20%|██        | 75710/371472 [6:01:35<22:47:43,  3.60it/s]
 20%|██        | 75711/371472 [6:01:35<22:19:51,  3.68it/s]
 20%|██        | 75712/371472 [6:01:35<22:43:15,  3.62it/s]
 20%|██        | 75713/371472 [6:01:35<22:38:43,  3.63it/s]
 20%|██        | 75714/371472 [6:01:36<23:26:39,  3.50it/s]
 20%|██        | 75715/371472 [6:01:36<24:37:03,  3.34it/s]
 20%|██        | 75716/371472 [6:01:36<24:29:24,  3.35it/s]
 20%|██        | 75717/371472 [6:01:37<23:51:34,  3.44it/s]
 20%|██        | 75718/371472 [6:01:37<23:04:59,  3.56it/s]
 20%|██        | 75719/371472 [6:01:37<23:13:21,  3.54it/s]
 20%|██        | 75720/371472 [6:01:37<22:28:32,  3.66it/s]
                                                           
{'loss': 4.119, 'learning_rate': 8.169320605916955e-07, 'epoch': 3.26}

 20%|██        | 75720/371472 [6:01:37<22:28:32,  3.66it/s]
 20%|██        | 75721/371472 [6:01:38<22:54:53,  3.59it/s]
 20%|██        | 75722/371472 [6:01:38<23:09:26,  3.55it/s]
 20%|██        | 75723/371472 [6:01:38<22:45:52,  3.61it/s]
 20%|██        | 75724/371472 [6:01:39<22:40:21,  3.62it/s]
 20%|██        | 75725/371472 [6:01:39<21:53:47,  3.75it/s]
 20%|██        | 75726/371472 [6:01:39<22:01:18,  3.73it/s]
 20%|██        | 75727/371472 [6:01:39<22:27:21,  3.66it/s]
 20%|██        | 75728/371472 [6:01:40<21:30:50,  3.82it/s]
 20%|██        | 75729/371472 [6:01:40<21:26:49,  3.83it/s]
 20%|██        | 75730/371472 [6:01:40<22:47:46,  3.60it/s]
 20%|██        | 75731/371472 [6:01:40<21:57:49,  3.74it/s]
 20%|██        | 75732/371472 [6:01:41<23:12:46,  3.54it/s]
 20%|██        | 75733/371472 [6:01:41<23:16:52,  3.53it/s]
 20%|██        | 75734/371472 [6:01:41<22:31:57,  3.65it/s]
 20%|██        | 75735/371472 [6:01:42<23:05:02,  3.56it/s]
 20%|██        | 75736/371472 [6:01:42<23:10:40,  3.54it/s]
 20%|██        | 75737/371472 [6:01:42<23:04:14,  3.56it/s]
 20%|██        | 75738/371472 [6:01:42<22:56:46,  3.58it/s]
 20%|██        | 75739/371472 [6:01:43<23:19:04,  3.52it/s]
 20%|██        | 75740/371472 [6:01:43<22:38:11,  3.63it/s]
                                                           
{'loss': 3.9992, 'learning_rate': 8.168835786162167e-07, 'epoch': 3.26}

 20%|██        | 75740/371472 [6:01:43<22:38:11,  3.63it/s]
 20%|██        | 75741/371472 [6:01:43<24:28:26,  3.36it/s]
 20%|██        | 75742/371472 [6:01:44<24:48:16,  3.31it/s]
 20%|██        | 75743/371472 [6:01:44<23:42:47,  3.46it/s]
 20%|██        | 75744/371472 [6:01:44<23:24:27,  3.51it/s]
 20%|██        | 75745/371472 [6:01:44<23:02:09,  3.57it/s]
 20%|██        | 75746/371472 [6:01:45<22:43:47,  3.61it/s]
 20%|██        | 75747/371472 [6:01:45<22:18:25,  3.68it/s]
 20%|██        | 75748/371472 [6:01:45<21:34:22,  3.81it/s]
 20%|██        | 75749/371472 [6:01:46<22:16:29,  3.69it/s]
 20%|██        | 75750/371472 [6:01:46<22:14:50,  3.69it/s]
 20%|██        | 75751/371472 [6:01:46<22:35:12,  3.64it/s]
 20%|██        | 75752/371472 [6:01:46<23:38:13,  3.48it/s]
 20%|██        | 75753/371472 [6:01:47<24:49:13,  3.31it/s]
 20%|██        | 75754/371472 [6:01:47<25:19:55,  3.24it/s]
 20%|██        | 75755/371472 [6:01:47<25:22:35,  3.24it/s]
 20%|██        | 75756/371472 [6:01:48<25:23:15,  3.24it/s]
 20%|██        | 75757/371472 [6:01:48<24:56:42,  3.29it/s]
 20%|██        | 75758/371472 [6:01:48<24:51:03,  3.31it/s]
 20%|██        | 75759/371472 [6:01:48<23:27:29,  3.50it/s]
 20%|██        | 75760/371472 [6:01:49<24:43:59,  3.32it/s]
                                                           
{'loss': 4.1048, 'learning_rate': 8.168350966407378e-07, 'epoch': 3.26}

 20%|██        | 75760/371472 [6:01:49<24:43:59,  3.32it/s]
 20%|██        | 75761/371472 [6:01:49<23:35:03,  3.48it/s]
 20%|██        | 75762/371472 [6:01:49<23:31:35,  3.49it/s]
 20%|██        | 75763/371472 [6:01:50<22:45:30,  3.61it/s]
 20%|██        | 75764/371472 [6:01:50<23:07:29,  3.55it/s]
 20%|██        | 75765/371472 [6:01:50<24:00:46,  3.42it/s]
 20%|██        | 75766/371472 [6:01:51<24:07:18,  3.41it/s]
 20%|██        | 75767/371472 [6:01:51<23:43:49,  3.46it/s]
 20%|██        | 75768/371472 [6:01:51<23:25:43,  3.51it/s]
 20%|██        | 75769/371472 [6:01:51<23:04:27,  3.56it/s]
 20%|██        | 75770/371472 [6:01:52<23:07:07,  3.55it/s]
 20%|██        | 75771/371472 [6:01:52<23:06:47,  3.55it/s]
 20%|██        | 75772/371472 [6:01:52<22:32:23,  3.64it/s]
 20%|██        | 75773/371472 [6:01:52<22:54:17,  3.59it/s]
 20%|██        | 75774/371472 [6:01:53<22:58:17,  3.58it/s]
 20%|██        | 75775/371472 [6:01:53<22:52:02,  3.59it/s]
 20%|██        | 75776/371472 [6:01:53<22:42:28,  3.62it/s]
 20%|██        | 75777/371472 [6:01:54<22:38:08,  3.63it/s]
 20%|██        | 75778/371472 [6:01:54<21:54:05,  3.75it/s]
 20%|██        | 75779/371472 [6:01:54<23:24:30,  3.51it/s]
 20%|██        | 75780/371472 [6:01:54<23:19:25,  3.52it/s]
                                                           
{'loss': 4.1138, 'learning_rate': 8.167866146652588e-07, 'epoch': 3.26}

 20%|██        | 75780/371472 [6:01:54<23:19:25,  3.52it/s]
 20%|██        | 75781/371472 [6:01:55<23:21:39,  3.52it/s]
 20%|██        | 75782/371472 [6:01:55<22:51:26,  3.59it/s]
 20%|██        | 75783/371472 [6:01:55<23:08:12,  3.55it/s]
 20%|██        | 75784/371472 [6:01:56<25:06:22,  3.27it/s]
 20%|██        | 75785/371472 [6:01:56<25:05:02,  3.27it/s]
 20%|██        | 75786/371472 [6:01:56<26:26:59,  3.11it/s]
 20%|██        | 75787/371472 [6:01:57<26:14:27,  3.13it/s]
 20%|██        | 75788/371472 [6:01:57<25:09:51,  3.26it/s]
 20%|██        | 75789/371472 [6:01:57<24:00:29,  3.42it/s]
 20%|██        | 75790/371472 [6:01:57<22:52:27,  3.59it/s]
 20%|██        | 75791/371472 [6:01:58<22:08:20,  3.71it/s]
 20%|██        | 75792/371472 [6:01:58<22:18:13,  3.68it/s]
 20%|██        | 75793/371472 [6:01:58<22:39:26,  3.62it/s]
 20%|██        | 75794/371472 [6:01:58<22:56:21,  3.58it/s]
 20%|██        | 75795/371472 [6:01:59<22:27:32,  3.66it/s]
 20%|██        | 75796/371472 [6:01:59<21:55:33,  3.75it/s]
 20%|██        | 75797/371472 [6:01:59<23:15:06,  3.53it/s]
 20%|██        | 75798/371472 [6:02:00<23:42:01,  3.47it/s]
 20%|██        | 75799/371472 [6:02:00<24:21:55,  3.37it/s]
 20%|██        | 75800/371472 [6:02:00<23:28:16,  3.50it/s]
                                                           
{'loss': 4.3028, 'learning_rate': 8.1673813268978e-07, 'epoch': 3.26}

 20%|██        | 75800/371472 [6:02:00<23:28:16,  3.50it/s]
 20%|██        | 75801/371472 [6:02:00<23:39:56,  3.47it/s]
 20%|██        | 75802/371472 [6:02:01<23:25:13,  3.51it/s]
 20%|██        | 75803/371472 [6:02:01<23:24:04,  3.51it/s]
 20%|██        | 75804/371472 [6:02:01<22:55:11,  3.58it/s]
 20%|██        | 75805/371472 [6:02:02<22:12:46,  3.70it/s]
 20%|██        | 75806/371472 [6:02:02<21:52:53,  3.75it/s]
 20%|██        | 75807/371472 [6:02:02<23:20:48,  3.52it/s]
 20%|██        | 75808/371472 [6:02:02<23:27:06,  3.50it/s]
 20%|██        | 75809/371472 [6:02:03<23:22:36,  3.51it/s]
 20%|██        | 75810/371472 [6:02:03<23:10:37,  3.54it/s]
 20%|██        | 75811/371472 [6:02:03<23:18:09,  3.52it/s]
 20%|██        | 75812/371472 [6:02:04<22:29:48,  3.65it/s]
 20%|██        | 75813/371472 [6:02:04<23:41:40,  3.47it/s]
 20%|██        | 75814/371472 [6:02:04<23:02:48,  3.56it/s]
 20%|██        | 75815/371472 [6:02:04<25:29:54,  3.22it/s]
 20%|██        | 75816/371472 [6:02:05<24:24:12,  3.37it/s]
 20%|██        | 75817/371472 [6:02:05<25:48:07,  3.18it/s]
 20%|██        | 75818/371472 [6:02:05<24:10:15,  3.40it/s]
 20%|██        | 75819/371472 [6:02:06<23:35:36,  3.48it/s]
 20%|██        | 75820/371472 [6:02:06<23:44:13,  3.46it/s]
                                                           
{'loss': 4.0169, 'learning_rate': 8.166896507143011e-07, 'epoch': 3.27}

 20%|██        | 75820/371472 [6:02:06<23:44:13,  3.46it/s]
 20%|██        | 75821/371472 [6:02:06<22:40:38,  3.62it/s]
 20%|██        | 75822/371472 [6:02:06<22:54:13,  3.59it/s]
 20%|██        | 75823/371472 [6:02:07<23:30:10,  3.49it/s]
 20%|██        | 75824/371472 [6:02:07<24:12:39,  3.39it/s]
 20%|██        | 75825/371472 [6:02:07<23:14:28,  3.53it/s]
 20%|██        | 75826/371472 [6:02:08<22:54:36,  3.58it/s]
 20%|██        | 75827/371472 [6:02:08<22:01:25,  3.73it/s]
 20%|██        | 75828/371472 [6:02:08<22:44:29,  3.61it/s]
 20%|██        | 75829/371472 [6:02:08<22:37:33,  3.63it/s]
 20%|██        | 75830/371472 [6:02:09<22:32:49,  3.64it/s]
 20%|██        | 75831/371472 [6:02:09<21:51:26,  3.76it/s]
 20%|██        | 75832/371472 [6:02:09<21:53:10,  3.75it/s]
 20%|██        | 75833/371472 [6:02:09<22:09:57,  3.70it/s]
 20%|██        | 75834/371472 [6:02:10<21:42:12,  3.78it/s]
 20%|██        | 75835/371472 [6:02:10<22:33:45,  3.64it/s]
 20%|██        | 75836/371472 [6:02:10<23:23:22,  3.51it/s]
 20%|██        | 75837/371472 [6:02:11<23:54:22,  3.44it/s]
 20%|██        | 75838/371472 [6:02:11<23:57:13,  3.43it/s]
 20%|██        | 75839/371472 [6:02:11<22:54:41,  3.58it/s]
 20%|██        | 75840/371472 [6:02:11<23:29:49,  3.49it/s]
                                                           
{'loss': 4.1142, 'learning_rate': 8.166411687388221e-07, 'epoch': 3.27}

 20%|██        | 75840/371472 [6:02:11<23:29:49,  3.49it/s]
 20%|██        | 75841/371472 [6:02:12<23:13:29,  3.54it/s]
 20%|██        | 75842/371472 [6:02:12<22:25:09,  3.66it/s]
 20%|██        | 75843/371472 [6:02:12<22:59:14,  3.57it/s]
 20%|██        | 75844/371472 [6:02:13<22:48:45,  3.60it/s]
 20%|██        | 75845/371472 [6:02:13<22:51:43,  3.59it/s]
 20%|██        | 75846/371472 [6:02:13<23:53:33,  3.44it/s]
 20%|██        | 75847/371472 [6:02:13<22:42:55,  3.62it/s]
 20%|██        | 75848/371472 [6:02:14<22:38:52,  3.63it/s]
 20%|██        | 75849/371472 [6:02:14<22:22:52,  3.67it/s]
 20%|██        | 75850/371472 [6:02:14<22:28:37,  3.65it/s]
 20%|██        | 75851/371472 [6:02:15<22:39:18,  3.62it/s]
 20%|██        | 75852/371472 [6:02:15<24:45:38,  3.32it/s]
 20%|██        | 75853/371472 [6:02:15<23:32:54,  3.49it/s]
 20%|██        | 75854/371472 [6:02:15<23:10:09,  3.54it/s]
 20%|██        | 75855/371472 [6:02:16<22:35:17,  3.64it/s]
 20%|██        | 75856/371472 [6:02:16<23:40:15,  3.47it/s]
 20%|██        | 75857/371472 [6:02:16<22:42:39,  3.62it/s]
 20%|██        | 75858/371472 [6:02:17<23:01:24,  3.57it/s]
 20%|██        | 75859/371472 [6:02:17<22:51:50,  3.59it/s]
 20%|██        | 75860/371472 [6:02:17<22:59:56,  3.57it/s]
                                                           
{'loss': 4.0902, 'learning_rate': 8.165926867633432e-07, 'epoch': 3.27}

 20%|██        | 75860/371472 [6:02:17<22:59:56,  3.57it/s]
 20%|██        | 75861/371472 [6:02:17<22:44:36,  3.61it/s]
 20%|██        | 75862/371472 [6:02:18<24:02:47,  3.41it/s]
 20%|██        | 75863/371472 [6:02:18<23:47:08,  3.45it/s]
 20%|██        | 75864/371472 [6:02:18<23:24:37,  3.51it/s]
 20%|██        | 75865/371472 [6:02:19<23:57:44,  3.43it/s]
 20%|██        | 75866/371472 [6:02:19<23:02:43,  3.56it/s]
 20%|██        | 75867/371472 [6:02:19<22:48:14,  3.60it/s]
 20%|██        | 75868/371472 [6:02:19<21:51:57,  3.76it/s]
 20%|██        | 75869/371472 [6:02:20<21:51:34,  3.76it/s]
 20%|██        | 75870/371472 [6:02:20<22:09:20,  3.71it/s]
 20%|██        | 75871/371472 [6:02:20<23:00:17,  3.57it/s]
 20%|██        | 75872/371472 [6:02:20<23:24:08,  3.51it/s]
 20%|██        | 75873/371472 [6:02:21<23:20:14,  3.52it/s]
 20%|██        | 75874/371472 [6:02:21<24:11:50,  3.39it/s]
 20%|██        | 75875/371472 [6:02:21<23:24:24,  3.51it/s]
 20%|██        | 75876/371472 [6:02:22<24:45:41,  3.32it/s]
 20%|██        | 75877/371472 [6:02:22<23:36:14,  3.48it/s]
 20%|██        | 75878/371472 [6:02:22<22:48:18,  3.60it/s]
 20%|██        | 75879/371472 [6:02:22<23:48:03,  3.45it/s]
 20%|██        | 75880/371472 [6:02:23<23:28:35,  3.50it/s]
                                                           
{'loss': 4.2813, 'learning_rate': 8.165442047878644e-07, 'epoch': 3.27}

 20%|██        | 75880/371472 [6:02:23<23:28:35,  3.50it/s]
 20%|██        | 75881/371472 [6:02:23<24:02:13,  3.42it/s]
 20%|██        | 75882/371472 [6:02:23<23:01:19,  3.57it/s]
 20%|██        | 75883/371472 [6:02:24<21:51:58,  3.76it/s]
 20%|██        | 75884/371472 [6:02:24<21:25:17,  3.83it/s]
 20%|██        | 75885/371472 [6:02:24<23:41:00,  3.47it/s]
 20%|██        | 75886/371472 [6:02:24<23:16:29,  3.53it/s]
 20%|██        | 75887/371472 [6:02:25<23:00:51,  3.57it/s]
 20%|██        | 75888/371472 [6:02:25<21:48:20,  3.77it/s]
 20%|██        | 75889/371472 [6:02:25<22:08:49,  3.71it/s]
 20%|██        | 75890/371472 [6:02:25<21:45:46,  3.77it/s]
 20%|██        | 75891/371472 [6:02:26<21:31:52,  3.81it/s]
 20%|██        | 75892/371472 [6:02:26<22:24:13,  3.66it/s]
 20%|██        | 75893/371472 [6:02:26<22:00:29,  3.73it/s]
 20%|██        | 75894/371472 [6:02:27<22:20:43,  3.67it/s]
 20%|██        | 75895/371472 [6:02:27<22:32:48,  3.64it/s]
 20%|██        | 75896/371472 [6:02:27<29:09:55,  2.82it/s]
 20%|██        | 75897/371472 [6:02:28<27:18:38,  3.01it/s]
 20%|██        | 75898/371472 [6:02:28<25:05:27,  3.27it/s]
 20%|██        | 75899/371472 [6:02:28<24:03:27,  3.41it/s]
 20%|██        | 75900/371472 [6:02:28<23:13:07,  3.54it/s]
                                                           
{'loss': 4.2515, 'learning_rate': 8.164957228123855e-07, 'epoch': 3.27}

 20%|██        | 75900/371472 [6:02:28<23:13:07,  3.54it/s]
 20%|██        | 75901/371472 [6:02:29<22:04:30,  3.72it/s]
 20%|██        | 75902/371472 [6:02:29<21:55:36,  3.74it/s]
 20%|██        | 75903/371472 [6:02:29<22:09:29,  3.71it/s]
 20%|██        | 75904/371472 [6:02:29<21:25:08,  3.83it/s]
 20%|██        | 75905/371472 [6:02:30<20:59:47,  3.91it/s]
 20%|██        | 75906/371472 [6:02:30<20:55:18,  3.92it/s]
 20%|██        | 75907/371472 [6:02:30<21:51:36,  3.76it/s]
 20%|██        | 75908/371472 [6:02:31<22:51:40,  3.59it/s]
 20%|██        | 75909/371472 [6:02:31<23:10:04,  3.54it/s]
 20%|██        | 75910/371472 [6:02:31<22:16:17,  3.69it/s]
 20%|██        | 75911/371472 [6:02:31<21:46:11,  3.77it/s]
 20%|██        | 75912/371472 [6:02:32<21:47:10,  3.77it/s]
 20%|██        | 75913/371472 [6:02:32<21:15:05,  3.86it/s]
 20%|██        | 75914/371472 [6:02:32<21:10:38,  3.88it/s]
 20%|██        | 75915/371472 [6:02:32<21:48:05,  3.77it/s]
 20%|██        | 75916/371472 [6:02:33<20:56:59,  3.92it/s]
 20%|██        | 75917/371472 [6:02:33<21:10:41,  3.88it/s]
 20%|██        | 75918/371472 [6:02:33<21:14:47,  3.86it/s]
 20%|██        | 75919/371472 [6:02:33<21:15:11,  3.86it/s]
 20%|██        | 75920/371472 [6:02:34<23:28:52,  3.50it/s]
                                                           
{'loss': 4.1882, 'learning_rate': 8.164472408369066e-07, 'epoch': 3.27}

 20%|██        | 75920/371472 [6:02:34<23:28:52,  3.50it/s]
 20%|██        | 75921/371472 [6:02:34<24:14:43,  3.39it/s]
 20%|██        | 75922/371472 [6:02:34<23:34:51,  3.48it/s]
 20%|██        | 75923/371472 [6:02:35<22:58:17,  3.57it/s]
 20%|██        | 75924/371472 [6:02:35<22:07:44,  3.71it/s]
 20%|██        | 75925/371472 [6:02:35<21:52:54,  3.75it/s]
 20%|██        | 75926/371472 [6:02:35<24:24:50,  3.36it/s]
 20%|██        | 75927/371472 [6:02:36<26:26:46,  3.10it/s]
 20%|██        | 75928/371472 [6:02:36<24:38:05,  3.33it/s]
 20%|██        | 75929/371472 [6:02:36<23:20:38,  3.52it/s]
 20%|██        | 75930/371472 [6:02:37<24:18:20,  3.38it/s]
 20%|██        | 75931/371472 [6:02:37<24:01:09,  3.42it/s]
 20%|██        | 75932/371472 [6:02:37<26:49:21,  3.06it/s]
 20%|██        | 75933/371472 [6:02:38<25:03:26,  3.28it/s]
 20%|██        | 75934/371472 [6:02:38<24:15:06,  3.39it/s]
 20%|██        | 75935/371472 [6:02:38<23:15:28,  3.53it/s]
 20%|██        | 75936/371472 [6:02:38<23:12:48,  3.54it/s]
 20%|██        | 75937/371472 [6:02:39<22:11:17,  3.70it/s]
 20%|██        | 75938/371472 [6:02:39<21:28:42,  3.82it/s]
 20%|██        | 75939/371472 [6:02:39<23:32:22,  3.49it/s]
 20%|██        | 75940/371472 [6:02:40<24:14:48,  3.39it/s]
                                                           
{'loss': 4.1375, 'learning_rate': 8.163987588614277e-07, 'epoch': 3.27}

 20%|██        | 75940/371472 [6:02:40<24:14:48,  3.39it/s]
 20%|██        | 75941/371472 [6:02:40<23:29:23,  3.49it/s]
 20%|██        | 75942/371472 [6:02:40<23:30:06,  3.49it/s]
 20%|██        | 75943/371472 [6:02:40<22:39:20,  3.62it/s]
 20%|██        | 75944/371472 [6:02:41<21:52:00,  3.75it/s]
 20%|██        | 75945/371472 [6:02:41<21:51:01,  3.76it/s]
 20%|██        | 75946/371472 [6:02:41<22:33:19,  3.64it/s]
 20%|██        | 75947/371472 [6:02:41<22:45:18,  3.61it/s]
 20%|██        | 75948/371472 [6:02:42<22:27:37,  3.65it/s]
 20%|██        | 75949/371472 [6:02:42<22:04:22,  3.72it/s]
 20%|██        | 75950/371472 [6:02:42<21:28:45,  3.82it/s]
 20%|██        | 75951/371472 [6:02:42<21:29:34,  3.82it/s]
 20%|██        | 75952/371472 [6:02:43<21:22:15,  3.84it/s]
 20%|██        | 75953/371472 [6:02:43<22:54:11,  3.58it/s]
 20%|██        | 75954/371472 [6:02:43<23:01:45,  3.56it/s]
 20%|██        | 75955/371472 [6:02:44<22:44:22,  3.61it/s]
 20%|██        | 75956/371472 [6:02:44<24:12:52,  3.39it/s]
 20%|██        | 75957/371472 [6:02:44<23:03:41,  3.56it/s]
 20%|██        | 75958/371472 [6:02:44<23:04:37,  3.56it/s]
 20%|██        | 75959/371472 [6:02:45<23:29:56,  3.49it/s]
 20%|██        | 75960/371472 [6:02:45<23:07:56,  3.55it/s]
                                                           
{'loss': 4.1215, 'learning_rate': 8.163502768859489e-07, 'epoch': 3.27}

 20%|██        | 75960/371472 [6:02:45<23:07:56,  3.55it/s]
 20%|██        | 75961/371472 [6:02:45<22:25:44,  3.66it/s]
 20%|██        | 75962/371472 [6:02:46<21:55:49,  3.74it/s]
 20%|██        | 75963/371472 [6:02:46<22:52:21,  3.59it/s]
 20%|██        | 75964/371472 [6:02:46<21:58:07,  3.74it/s]
 20%|██        | 75965/371472 [6:02:46<22:12:27,  3.70it/s]
 20%|██        | 75966/371472 [6:02:47<21:37:52,  3.79it/s]
 20%|██        | 75967/371472 [6:02:47<21:30:36,  3.82it/s]
 20%|██        | 75968/371472 [6:02:47<22:58:05,  3.57it/s]
 20%|██        | 75969/371472 [6:02:48<23:18:01,  3.52it/s]
 20%|██        | 75970/371472 [6:02:48<22:08:48,  3.71it/s]
 20%|██        | 75971/371472 [6:02:48<22:37:18,  3.63it/s]
 20%|██        | 75972/371472 [6:02:48<22:55:16,  3.58it/s]
 20%|██        | 75973/371472 [6:02:49<22:17:22,  3.68it/s]
 20%|██        | 75974/371472 [6:02:49<24:30:30,  3.35it/s]
 20%|██        | 75975/371472 [6:02:49<24:14:59,  3.38it/s]
 20%|██        | 75976/371472 [6:02:50<24:51:26,  3.30it/s]
 20%|██        | 75977/371472 [6:02:50<25:04:39,  3.27it/s]
 20%|██        | 75978/371472 [6:02:50<25:03:33,  3.28it/s]
 20%|██        | 75979/371472 [6:02:50<24:28:47,  3.35it/s]
 20%|██        | 75980/371472 [6:02:51<24:09:55,  3.40it/s]
                                                           
{'loss': 4.1708, 'learning_rate': 8.163017949104699e-07, 'epoch': 3.27}

 20%|██        | 75980/371472 [6:02:51<24:09:55,  3.40it/s]
 20%|██        | 75981/371472 [6:02:51<24:47:33,  3.31it/s]
 20%|██        | 75982/371472 [6:02:51<24:55:21,  3.29it/s]
 20%|██        | 75983/371472 [6:02:52<24:03:15,  3.41it/s]
 20%|██        | 75984/371472 [6:02:52<23:33:44,  3.48it/s]
 20%|██        | 75985/371472 [6:02:52<24:46:00,  3.31it/s]
 20%|██        | 75986/371472 [6:02:53<23:58:40,  3.42it/s]
 20%|██        | 75987/371472 [6:02:53<25:41:11,  3.20it/s]
 20%|██        | 75988/371472 [6:02:53<24:42:36,  3.32it/s]
 20%|██        | 75989/371472 [6:02:53<23:11:04,  3.54it/s]
 20%|██        | 75990/371472 [6:02:54<22:22:11,  3.67it/s]
 20%|██        | 75991/371472 [6:02:54<22:14:47,  3.69it/s]
 20%|██        | 75992/371472 [6:02:54<23:05:00,  3.56it/s]
 20%|██        | 75993/371472 [6:02:54<22:35:22,  3.63it/s]
 20%|██        | 75994/371472 [6:02:55<23:37:49,  3.47it/s]
 20%|██        | 75995/371472 [6:02:55<23:10:42,  3.54it/s]
 20%|██        | 75996/371472 [6:02:55<25:08:06,  3.27it/s]
 20%|██        | 75997/371472 [6:02:56<23:37:35,  3.47it/s]
 20%|██        | 75998/371472 [6:02:56<23:27:54,  3.50it/s]
 20%|██        | 75999/371472 [6:02:56<23:07:08,  3.55it/s]
 20%|██        | 76000/371472 [6:02:57<24:19:31,  3.37it/s]
                                                           
{'loss': 4.1516, 'learning_rate': 8.16253312934991e-07, 'epoch': 3.27}

 20%|██        | 76000/371472 [6:02:57<24:19:31,  3.37it/s]
 20%|██        | 76001/371472 [6:02:57<23:28:29,  3.50it/s]
 20%|██        | 76002/371472 [6:02:57<22:55:37,  3.58it/s]
 20%|██        | 76003/371472 [6:02:57<22:54:12,  3.58it/s]
 20%|██        | 76004/371472 [6:02:58<22:15:44,  3.69it/s]
 20%|██        | 76005/371472 [6:02:58<22:30:39,  3.65it/s]
 20%|██        | 76006/371472 [6:02:58<23:20:25,  3.52it/s]
 20%|██        | 76007/371472 [6:02:58<23:08:52,  3.55it/s]
 20%|██        | 76008/371472 [6:02:59<23:09:36,  3.54it/s]
 20%|██        | 76009/371472 [6:02:59<23:10:04,  3.54it/s]
 20%|██        | 76010/371472 [6:02:59<24:16:59,  3.38it/s]
 20%|██        | 76011/371472 [6:03:00<23:26:07,  3.50it/s]
 20%|██        | 76012/371472 [6:03:00<22:54:39,  3.58it/s]
 20%|██        | 76013/371472 [6:03:00<27:11:56,  3.02it/s]
 20%|██        | 76014/371472 [6:03:01<27:37:32,  2.97it/s]
 20%|██        | 76015/371472 [6:03:01<27:27:25,  2.99it/s]
 20%|██        | 76016/371472 [6:03:01<26:02:26,  3.15it/s]
 20%|██        | 76017/371472 [6:03:02<25:41:20,  3.19it/s]
 20%|██        | 76018/371472 [6:03:02<25:01:49,  3.28it/s]
 20%|██        | 76019/371472 [6:03:02<23:34:04,  3.48it/s]
 20%|██        | 76020/371472 [6:03:03<28:33:00,  2.87it/s]
                                                           
{'loss': 3.9983, 'learning_rate': 8.162048309595121e-07, 'epoch': 3.27}

 20%|██        | 76020/371472 [6:03:03<28:33:00,  2.87it/s]
 20%|██        | 76021/371472 [6:03:03<26:47:58,  3.06it/s]
 20%|██        | 76022/371472 [6:03:03<25:21:03,  3.24it/s]
 20%|██        | 76023/371472 [6:03:03<26:07:18,  3.14it/s]
 20%|██        | 76024/371472 [6:03:04<24:10:16,  3.40it/s]
 20%|██        | 76025/371472 [6:03:04<23:36:23,  3.48it/s]
 20%|██        | 76026/371472 [6:03:04<23:18:27,  3.52it/s]
 20%|██        | 76027/371472 [6:03:05<22:19:34,  3.68it/s]
 20%|██        | 76028/371472 [6:03:05<23:20:58,  3.51it/s]
 20%|██        | 76029/371472 [6:03:05<22:28:45,  3.65it/s]
 20%|██        | 76030/371472 [6:03:05<22:04:03,  3.72it/s]
 20%|██        | 76031/371472 [6:03:06<23:12:31,  3.54it/s]
 20%|██        | 76032/371472 [6:03:06<23:35:17,  3.48it/s]
 20%|██        | 76033/371472 [6:03:06<23:23:08,  3.51it/s]
 20%|██        | 76034/371472 [6:03:07<23:33:02,  3.48it/s]
 20%|██        | 76035/371472 [6:03:07<22:59:24,  3.57it/s]
 20%|██        | 76036/371472 [6:03:07<22:20:01,  3.67it/s]
 20%|██        | 76037/371472 [6:03:07<21:35:12,  3.80it/s]
 20%|██        | 76038/371472 [6:03:08<24:26:06,  3.36it/s]
 20%|██        | 76039/371472 [6:03:08<22:57:07,  3.58it/s]
 20%|██        | 76040/371472 [6:03:08<22:33:08,  3.64it/s]
                                                           
{'loss': 4.249, 'learning_rate': 8.161563489840333e-07, 'epoch': 3.28}

 20%|██        | 76040/371472 [6:03:08<22:33:08,  3.64it/s]
 20%|██        | 76041/371472 [6:03:08<23:25:21,  3.50it/s]
 20%|██        | 76042/371472 [6:03:09<23:16:24,  3.53it/s]
 20%|██        | 76043/371472 [6:03:09<22:59:04,  3.57it/s]
 20%|██        | 76044/371472 [6:03:09<22:33:50,  3.64it/s]
 20%|██        | 76045/371472 [6:03:10<22:09:06,  3.70it/s]
 20%|██        | 76046/371472 [6:03:10<21:28:48,  3.82it/s]
 20%|██        | 76047/371472 [6:03:10<21:57:46,  3.74it/s]
 20%|██        | 76048/371472 [6:03:10<22:06:41,  3.71it/s]
 20%|██        | 76049/371472 [6:03:11<23:40:55,  3.47it/s]
 20%|██        | 76050/371472 [6:03:11<23:59:45,  3.42it/s]
 20%|██        | 76051/371472 [6:03:11<24:04:08,  3.41it/s]
 20%|██        | 76052/371472 [6:03:12<24:36:06,  3.34it/s]
 20%|██        | 76053/371472 [6:03:12<23:32:43,  3.49it/s]
 20%|██        | 76054/371472 [6:03:12<22:52:46,  3.59it/s]
 20%|██        | 76055/371472 [6:03:12<24:57:33,  3.29it/s]
 20%|██        | 76056/371472 [6:03:13<24:36:58,  3.33it/s]
 20%|██        | 76057/371472 [6:03:13<23:22:57,  3.51it/s]
 20%|██        | 76058/371472 [6:03:13<23:29:14,  3.49it/s]
 20%|██        | 76059/371472 [6:03:14<23:19:42,  3.52it/s]
 20%|██        | 76060/371472 [6:03:14<23:35:45,  3.48it/s]
                                                           
{'loss': 3.9864, 'learning_rate': 8.161078670085544e-07, 'epoch': 3.28}

 20%|██        | 76060/371472 [6:03:14<23:35:45,  3.48it/s]
 20%|██        | 76061/371472 [6:03:14<23:40:37,  3.47it/s]
 20%|██        | 76062/371472 [6:03:14<23:19:02,  3.52it/s]
 20%|██        | 76063/371472 [6:03:15<24:51:19,  3.30it/s]
 20%|██        | 76064/371472 [6:03:15<24:16:42,  3.38it/s]
 20%|██        | 76065/371472 [6:03:15<23:17:39,  3.52it/s]
 20%|██        | 76066/371472 [6:03:16<22:39:19,  3.62it/s]
 20%|██        | 76067/371472 [6:03:16<24:58:28,  3.29it/s]
 20%|██        | 76068/371472 [6:03:16<23:59:31,  3.42it/s]
 20%|██        | 76069/371472 [6:03:17<23:55:13,  3.43it/s]
 20%|██        | 76070/371472 [6:03:17<23:19:50,  3.52it/s]
 20%|██        | 76071/371472 [6:03:17<23:43:28,  3.46it/s]
 20%|██        | 76072/371472 [6:03:17<22:28:10,  3.65it/s]
 20%|██        | 76073/371472 [6:03:18<21:54:57,  3.74it/s]
 20%|██        | 76074/371472 [6:03:18<23:08:45,  3.55it/s]
 20%|██        | 76075/371472 [6:03:18<23:53:42,  3.43it/s]
 20%|██        | 76076/371472 [6:03:18<22:47:59,  3.60it/s]
 20%|██        | 76077/371472 [6:03:19<23:06:36,  3.55it/s]
 20%|██        | 76078/371472 [6:03:19<22:27:42,  3.65it/s]
 20%|██        | 76079/371472 [6:03:19<22:14:21,  3.69it/s]
 20%|██        | 76080/371472 [6:03:19<21:30:35,  3.81it/s]
                                                           
{'loss': 4.0451, 'learning_rate': 8.160593850330754e-07, 'epoch': 3.28}

 20%|██        | 76080/371472 [6:03:19<21:30:35,  3.81it/s]
 20%|██        | 76081/371472 [6:03:20<21:47:11,  3.77it/s]
 20%|██        | 76082/371472 [6:03:20<21:19:54,  3.85it/s]
 20%|██        | 76083/371472 [6:03:20<24:52:41,  3.30it/s]
 20%|██        | 76084/371472 [6:03:21<24:27:44,  3.35it/s]
 20%|██        | 76085/371472 [6:03:21<23:25:38,  3.50it/s]
 20%|██        | 76086/371472 [6:03:21<25:52:02,  3.17it/s]
 20%|██        | 76087/371472 [6:03:22<23:59:56,  3.42it/s]
 20%|██        | 76088/371472 [6:03:22<25:07:21,  3.27it/s]
 20%|██        | 76089/371472 [6:03:22<25:27:58,  3.22it/s]
 20%|██        | 76090/371472 [6:03:23<27:29:28,  2.98it/s]
 20%|██        | 76091/371472 [6:03:23<25:38:03,  3.20it/s]
 20%|██        | 76092/371472 [6:03:23<26:31:36,  3.09it/s]
 20%|██        | 76093/371472 [6:03:24<26:08:50,  3.14it/s]
 20%|██        | 76094/371472 [6:03:24<24:49:10,  3.31it/s]
 20%|██        | 76095/371472 [6:03:24<24:18:35,  3.38it/s]
 20%|██        | 76096/371472 [6:03:24<23:13:12,  3.53it/s]
 20%|██        | 76097/371472 [6:03:25<23:34:36,  3.48it/s]
 20%|██        | 76098/371472 [6:03:25<24:28:48,  3.35it/s]
 20%|██        | 76099/371472 [6:03:25<23:52:24,  3.44it/s]
 20%|██        | 76100/371472 [6:03:25<22:44:13,  3.61it/s]
                                                           
{'loss': 4.2359, 'learning_rate': 8.160109030575965e-07, 'epoch': 3.28}

 20%|██        | 76100/371472 [6:03:25<22:44:13,  3.61it/s]
 20%|██        | 76101/371472 [6:03:26<23:48:08,  3.45it/s]
 20%|██        | 76102/371472 [6:03:26<24:17:47,  3.38it/s]
 20%|██        | 76103/371472 [6:03:26<23:57:52,  3.42it/s]
 20%|██        | 76104/371472 [6:03:27<22:40:16,  3.62it/s]
 20%|██        | 76105/371472 [6:03:27<23:14:02,  3.53it/s]
 20%|██        | 76106/371472 [6:03:27<24:38:18,  3.33it/s]
 20%|██        | 76107/371472 [6:03:28<23:23:26,  3.51it/s]
 20%|██        | 76108/371472 [6:03:28<23:50:17,  3.44it/s]
 20%|██        | 76109/371472 [6:03:28<24:00:34,  3.42it/s]
 20%|██        | 76110/371472 [6:03:28<24:13:31,  3.39it/s]
 20%|██        | 76111/371472 [6:03:29<22:49:52,  3.59it/s]
 20%|██        | 76112/371472 [6:03:29<22:48:59,  3.60it/s]
 20%|██        | 76113/371472 [6:03:29<21:45:55,  3.77it/s]
 20%|██        | 76114/371472 [6:03:30<23:47:32,  3.45it/s]
 20%|██        | 76115/371472 [6:03:30<23:32:51,  3.48it/s]
 20%|██        | 76116/371472 [6:03:30<27:11:14,  3.02it/s]
 20%|██        | 76117/371472 [6:03:31<26:55:41,  3.05it/s]
 20%|██        | 76118/371472 [6:03:31<26:29:11,  3.10it/s]
 20%|██        | 76119/371472 [6:03:31<24:07:48,  3.40it/s]
 20%|██        | 76120/371472 [6:03:31<23:41:48,  3.46it/s]
                                                           
{'loss': 4.2358, 'learning_rate': 8.159624210821177e-07, 'epoch': 3.28}

 20%|██        | 76120/371472 [6:03:31<23:41:48,  3.46it/s]
 20%|██        | 76121/371472 [6:03:32<23:37:56,  3.47it/s]
 20%|██        | 76122/371472 [6:03:32<23:02:33,  3.56it/s]
 20%|██        | 76123/371472 [6:03:32<22:31:15,  3.64it/s]
 20%|██        | 76124/371472 [6:03:32<22:34:22,  3.63it/s]
 20%|██        | 76125/371472 [6:03:33<22:24:24,  3.66it/s]
 20%|██        | 76126/371472 [6:03:33<23:19:44,  3.52it/s]
 20%|██        | 76127/371472 [6:03:33<22:16:58,  3.68it/s]
 20%|██        | 76128/371472 [6:03:34<22:09:03,  3.70it/s]
 20%|██        | 76129/371472 [6:03:34<22:16:29,  3.68it/s]
 20%|██        | 76130/371472 [6:03:34<23:53:40,  3.43it/s]
 20%|██        | 76131/371472 [6:03:34<23:20:23,  3.51it/s]
 20%|██        | 76132/371472 [6:03:35<23:45:18,  3.45it/s]
 20%|██        | 76133/371472 [6:03:35<26:27:28,  3.10it/s]
 20%|██        | 76134/371472 [6:03:35<24:16:45,  3.38it/s]
 20%|██        | 76135/371472 [6:03:36<23:20:13,  3.52it/s]
 20%|██        | 76136/371472 [6:03:36<22:05:32,  3.71it/s]
 20%|██        | 76137/371472 [6:03:36<22:18:34,  3.68it/s]
 20%|██        | 76138/371472 [6:03:36<21:48:56,  3.76it/s]
 20%|██        | 76139/371472 [6:03:37<21:44:30,  3.77it/s]
 20%|██        | 76140/371472 [6:03:37<21:54:07,  3.75it/s]
                                                           
{'loss': 4.3616, 'learning_rate': 8.159139391066387e-07, 'epoch': 3.28}

 20%|██        | 76140/371472 [6:03:37<21:54:07,  3.75it/s]
 20%|██        | 76141/371472 [6:03:37<23:43:35,  3.46it/s]
 20%|██        | 76142/371472 [6:03:38<24:08:49,  3.40it/s]
 20%|██        | 76143/371472 [6:03:38<25:46:19,  3.18it/s]
 20%|██        | 76144/371472 [6:03:38<26:11:43,  3.13it/s]
 20%|██        | 76145/371472 [6:03:39<25:56:08,  3.16it/s]
 20%|██        | 76146/371472 [6:03:39<25:40:36,  3.19it/s]
 20%|██        | 76147/371472 [6:03:39<24:20:31,  3.37it/s]
 20%|██        | 76148/371472 [6:03:39<23:59:01,  3.42it/s]
 20%|██        | 76149/371472 [6:03:40<23:17:18,  3.52it/s]
 20%|██        | 76150/371472 [6:03:40<25:14:41,  3.25it/s]
 20%|██        | 76151/371472 [6:03:40<24:07:42,  3.40it/s]
 21%|██        | 76152/371472 [6:03:41<24:17:56,  3.38it/s]
 21%|██        | 76153/371472 [6:03:41<25:47:49,  3.18it/s]
 21%|██        | 76154/371472 [6:03:41<24:38:36,  3.33it/s]
 21%|██        | 76155/371472 [6:03:42<24:14:50,  3.38it/s]
 21%|██        | 76156/371472 [6:03:42<25:03:18,  3.27it/s]
 21%|██        | 76157/371472 [6:03:42<23:15:02,  3.53it/s]
 21%|██        | 76158/371472 [6:03:42<24:26:23,  3.36it/s]
 21%|██        | 76159/371472 [6:03:43<23:38:15,  3.47it/s]
 21%|██        | 76160/371472 [6:03:43<23:36:27,  3.47it/s]
                                                           
{'loss': 4.0616, 'learning_rate': 8.158654571311598e-07, 'epoch': 3.28}

 21%|██        | 76160/371472 [6:03:43<23:36:27,  3.47it/s]
 21%|██        | 76161/371472 [6:03:43<22:23:41,  3.66it/s]
 21%|██        | 76162/371472 [6:03:43<22:21:35,  3.67it/s]
 21%|██        | 76163/371472 [6:03:44<21:53:59,  3.75it/s]
 21%|██        | 76164/371472 [6:03:44<23:24:39,  3.50it/s]
 21%|██        | 76165/371472 [6:03:44<22:52:25,  3.59it/s]
 21%|██        | 76166/371472 [6:03:45<23:12:33,  3.53it/s]
 21%|██        | 76167/371472 [6:03:45<23:01:18,  3.56it/s]
 21%|██        | 76168/371472 [6:03:45<24:55:35,  3.29it/s]
 21%|██        | 76169/371472 [6:03:46<27:46:50,  2.95it/s]
 21%|██        | 76170/371472 [6:03:46<30:32:28,  2.69it/s]
 21%|██        | 76171/371472 [6:03:46<28:21:00,  2.89it/s]
 21%|██        | 76172/371472 [6:03:47<26:39:45,  3.08it/s]
 21%|██        | 76173/371472 [6:03:47<26:20:54,  3.11it/s]
 21%|██        | 76174/371472 [6:03:47<24:50:31,  3.30it/s]
 21%|██        | 76175/371472 [6:03:48<25:30:51,  3.21it/s]
 21%|██        | 76176/371472 [6:03:48<24:56:05,  3.29it/s]
 21%|██        | 76177/371472 [6:03:48<24:30:25,  3.35it/s]
 21%|██        | 76178/371472 [6:03:48<23:19:40,  3.52it/s]
 21%|██        | 76179/371472 [6:03:49<23:57:39,  3.42it/s]
 21%|██        | 76180/371472 [6:03:49<22:40:49,  3.62it/s]
                                                           
{'loss': 3.9489, 'learning_rate': 8.15816975155681e-07, 'epoch': 3.28}

 21%|██        | 76180/371472 [6:03:49<22:40:49,  3.62it/s]
 21%|██        | 76181/371472 [6:03:49<22:32:46,  3.64it/s]
 21%|██        | 76182/371472 [6:03:49<22:09:09,  3.70it/s]
 21%|██        | 76183/371472 [6:03:50<21:55:38,  3.74it/s]
 21%|██        | 76184/371472 [6:03:50<22:40:31,  3.62it/s]
 21%|██        | 76185/371472 [6:03:50<22:18:35,  3.68it/s]
 21%|██        | 76186/371472 [6:03:51<21:40:36,  3.78it/s]
 21%|██        | 76187/371472 [6:03:51<22:08:51,  3.70it/s]
 21%|██        | 76188/371472 [6:03:51<22:07:13,  3.71it/s]
 21%|██        | 76189/371472 [6:03:51<22:19:30,  3.67it/s]
 21%|██        | 76190/371472 [6:03:52<22:48:21,  3.60it/s]
 21%|██        | 76191/371472 [6:03:52<23:16:50,  3.52it/s]
 21%|██        | 76192/371472 [6:03:52<23:12:21,  3.53it/s]
 21%|██        | 76193/371472 [6:03:53<22:29:05,  3.65it/s]
 21%|██        | 76194/371472 [6:03:53<21:45:50,  3.77it/s]
 21%|██        | 76195/371472 [6:03:53<22:17:06,  3.68it/s]
 21%|██        | 76196/371472 [6:03:53<22:07:23,  3.71it/s]
 21%|██        | 76197/371472 [6:03:54<24:26:46,  3.36it/s]
 21%|██        | 76198/371472 [6:03:54<24:42:59,  3.32it/s]
 21%|██        | 76199/371472 [6:03:54<23:16:29,  3.52it/s]
 21%|██        | 76200/371472 [6:03:54<22:48:05,  3.60it/s]
                                                           
{'loss': 4.3266, 'learning_rate': 8.157684931802022e-07, 'epoch': 3.28}

 21%|██        | 76200/371472 [6:03:54<22:48:05,  3.60it/s]
 21%|██        | 76201/371472 [6:03:55<22:49:58,  3.59it/s]
 21%|██        | 76202/371472 [6:03:55<22:28:16,  3.65it/s]
 21%|██        | 76203/371472 [6:03:55<21:49:24,  3.76it/s]
 21%|██        | 76204/371472 [6:03:56<22:45:27,  3.60it/s]
 21%|██        | 76205/371472 [6:03:56<21:58:22,  3.73it/s]
 21%|██        | 76206/371472 [6:03:56<21:52:02,  3.75it/s]
 21%|██        | 76207/371472 [6:03:56<21:14:42,  3.86it/s]
 21%|██        | 76208/371472 [6:03:57<21:08:56,  3.88it/s]
 21%|██        | 76209/371472 [6:03:57<21:24:21,  3.83it/s]
 21%|██        | 76210/371472 [6:03:57<21:38:08,  3.79it/s]
 21%|██        | 76211/371472 [6:03:57<22:26:43,  3.65it/s]
 21%|██        | 76212/371472 [6:03:58<22:26:36,  3.65it/s]
 21%|██        | 76213/371472 [6:03:58<21:59:31,  3.73it/s]
 21%|██        | 76214/371472 [6:03:58<22:16:12,  3.68it/s]
 21%|██        | 76215/371472 [6:03:59<22:40:01,  3.62it/s]
 21%|██        | 76216/371472 [6:03:59<22:35:18,  3.63it/s]
 21%|██        | 76217/371472 [6:03:59<22:30:32,  3.64it/s]
 21%|██        | 76218/371472 [6:03:59<21:57:27,  3.74it/s]
 21%|██        | 76219/371472 [6:04:00<21:50:45,  3.75it/s]
 21%|██        | 76220/371472 [6:04:00<22:28:25,  3.65it/s]
                                                           
{'loss': 4.308, 'learning_rate': 8.157200112047231e-07, 'epoch': 3.28}

 21%|██        | 76220/371472 [6:04:00<22:28:25,  3.65it/s]
 21%|██        | 76221/371472 [6:04:00<24:40:09,  3.32it/s]
 21%|██        | 76222/371472 [6:04:01<25:58:19,  3.16it/s]
 21%|██        | 76223/371472 [6:04:01<24:41:02,  3.32it/s]
 21%|██        | 76224/371472 [6:04:01<23:14:23,  3.53it/s]
 21%|██        | 76225/371472 [6:04:01<23:03:30,  3.56it/s]
 21%|██        | 76226/371472 [6:04:02<23:29:37,  3.49it/s]
 21%|██        | 76227/371472 [6:04:02<24:59:41,  3.28it/s]
 21%|██        | 76228/371472 [6:04:02<26:57:15,  3.04it/s]
 21%|██        | 76229/371472 [6:04:03<25:41:58,  3.19it/s]
 21%|██        | 76230/371472 [6:04:03<25:40:04,  3.20it/s]
 21%|██        | 76231/371472 [6:04:03<23:49:20,  3.44it/s]
 21%|██        | 76232/371472 [6:04:04<24:20:12,  3.37it/s]
 21%|██        | 76233/371472 [6:04:04<25:33:28,  3.21it/s]
 21%|██        | 76234/371472 [6:04:04<24:40:55,  3.32it/s]
 21%|██        | 76235/371472 [6:04:04<24:44:51,  3.31it/s]
 21%|██        | 76236/371472 [6:04:05<24:47:58,  3.31it/s]
 21%|██        | 76237/371472 [6:04:05<23:50:50,  3.44it/s]
 21%|██        | 76238/371472 [6:04:05<25:58:08,  3.16it/s]
 21%|██        | 76239/371472 [6:04:06<23:58:34,  3.42it/s]
 21%|██        | 76240/371472 [6:04:06<23:22:03,  3.51it/s]
                                                           
{'loss': 3.9456, 'learning_rate': 8.156715292292442e-07, 'epoch': 3.28}

 21%|██        | 76240/371472 [6:04:06<23:22:03,  3.51it/s]
 21%|██        | 76241/371472 [6:04:06<24:39:11,  3.33it/s]
 21%|██        | 76242/371472 [6:04:07<25:41:16,  3.19it/s]
 21%|██        | 76243/371472 [6:04:07<24:23:53,  3.36it/s]
 21%|██        | 76244/371472 [6:04:07<23:49:06,  3.44it/s]
 21%|██        | 76245/371472 [6:04:07<23:07:47,  3.55it/s]
 21%|██        | 76246/371472 [6:04:08<22:49:34,  3.59it/s]
 21%|██        | 76247/371472 [6:04:08<24:06:40,  3.40it/s]
 21%|██        | 76248/371472 [6:04:08<23:56:44,  3.42it/s]
 21%|██        | 76249/371472 [6:04:09<24:23:57,  3.36it/s]
 21%|██        | 76250/371472 [6:04:09<23:24:37,  3.50it/s]
 21%|██        | 76251/371472 [6:04:09<24:42:03,  3.32it/s]
 21%|██        | 76252/371472 [6:04:09<24:24:40,  3.36it/s]
 21%|██        | 76253/371472 [6:04:10<24:47:02,  3.31it/s]
 21%|██        | 76254/371472 [6:04:10<24:30:12,  3.35it/s]
 21%|██        | 76255/371472 [6:04:11<28:53:31,  2.84it/s]
 21%|██        | 76256/371472 [6:04:11<28:23:35,  2.89it/s]
 21%|██        | 76257/371472 [6:04:11<25:41:02,  3.19it/s]
 21%|██        | 76258/371472 [6:04:11<23:46:57,  3.45it/s]
 21%|██        | 76259/371472 [6:04:12<23:43:06,  3.46it/s]
 21%|██        | 76260/371472 [6:04:12<22:47:55,  3.60it/s]
                                                           
{'loss': 3.9706, 'learning_rate': 8.156230472537654e-07, 'epoch': 3.28}

 21%|██        | 76260/371472 [6:04:12<22:47:55,  3.60it/s]
 21%|██        | 76261/371472 [6:04:12<23:37:13,  3.47it/s]
 21%|██        | 76262/371472 [6:04:12<22:31:43,  3.64it/s]
 21%|██        | 76263/371472 [6:04:13<22:04:48,  3.71it/s]
 21%|██        | 76264/371472 [6:04:13<22:21:06,  3.67it/s]
 21%|██        | 76265/371472 [6:04:13<21:37:20,  3.79it/s]
 21%|██        | 76266/371472 [6:04:13<21:18:10,  3.85it/s]
 21%|██        | 76267/371472 [6:04:14<20:36:56,  3.98it/s]
 21%|██        | 76268/371472 [6:04:14<20:43:59,  3.96it/s]
 21%|██        | 76269/371472 [6:04:14<20:36:50,  3.98it/s]
 21%|██        | 76270/371472 [6:04:15<22:18:24,  3.68it/s]
 21%|██        | 76271/371472 [6:04:15<22:14:34,  3.69it/s]
 21%|██        | 76272/371472 [6:04:15<21:52:48,  3.75it/s]
 21%|██        | 76273/371472 [6:04:15<21:44:38,  3.77it/s]
 21%|██        | 76274/371472 [6:04:16<23:07:55,  3.54it/s]
 21%|██        | 76275/371472 [6:04:16<22:50:09,  3.59it/s]
 21%|██        | 76276/371472 [6:04:16<22:17:00,  3.68it/s]
 21%|██        | 76277/371472 [6:04:16<21:48:50,  3.76it/s]
 21%|██        | 76278/371472 [6:04:17<22:41:57,  3.61it/s]
 21%|██        | 76279/371472 [6:04:17<22:54:14,  3.58it/s]
 21%|██        | 76280/371472 [6:04:17<22:02:56,  3.72it/s]
                                                           
{'loss': 4.3075, 'learning_rate': 8.155745652782866e-07, 'epoch': 3.29}

 21%|██        | 76280/371472 [6:04:17<22:02:56,  3.72it/s]
 21%|██        | 76281/371472 [6:04:18<24:27:31,  3.35it/s]
 21%|██        | 76282/371472 [6:04:18<24:06:26,  3.40it/s]
 21%|██        | 76283/371472 [6:04:18<23:23:34,  3.51it/s]
 21%|██        | 76284/371472 [6:04:18<22:23:40,  3.66it/s]
 21%|██        | 76285/371472 [6:04:19<21:31:43,  3.81it/s]
 21%|██        | 76286/371472 [6:04:19<20:38:49,  3.97it/s]
 21%|██        | 76287/371472 [6:04:19<21:12:23,  3.87it/s]
 21%|██        | 76288/371472 [6:04:19<22:19:28,  3.67it/s]
 21%|██        | 76289/371472 [6:04:20<23:42:34,  3.46it/s]
 21%|██        | 76290/371472 [6:04:20<24:38:56,  3.33it/s]
 21%|██        | 76291/371472 [6:04:20<23:53:55,  3.43it/s]
 21%|██        | 76292/371472 [6:04:21<24:42:26,  3.32it/s]
 21%|██        | 76293/371472 [6:04:21<23:28:55,  3.49it/s]
 21%|██        | 76294/371472 [6:04:21<23:14:10,  3.53it/s]
 21%|██        | 76295/371472 [6:04:22<23:56:29,  3.42it/s]
 21%|██        | 76296/371472 [6:04:22<24:25:11,  3.36it/s]
 21%|██        | 76297/371472 [6:04:22<23:32:48,  3.48it/s]
 21%|██        | 76298/371472 [6:04:22<22:19:06,  3.67it/s]
 21%|██        | 76299/371472 [6:04:23<22:36:05,  3.63it/s]
 21%|██        | 76300/371472 [6:04:23<22:21:53,  3.67it/s]
                                                           
{'loss': 4.0391, 'learning_rate': 8.155260833028076e-07, 'epoch': 3.29}

 21%|██        | 76300/371472 [6:04:23<22:21:53,  3.67it/s]
 21%|██        | 76301/371472 [6:04:23<21:58:05,  3.73it/s]
 21%|██        | 76302/371472 [6:04:23<21:25:17,  3.83it/s]
 21%|██        | 76303/371472 [6:04:24<21:28:10,  3.82it/s]
 21%|██        | 76304/371472 [6:04:24<21:28:33,  3.82it/s]
 21%|██        | 76305/371472 [6:04:24<21:59:29,  3.73it/s]
 21%|██        | 76306/371472 [6:04:25<23:30:22,  3.49it/s]
 21%|██        | 76307/371472 [6:04:25<24:33:01,  3.34it/s]
 21%|██        | 76308/371472 [6:04:25<23:29:07,  3.49it/s]
 21%|██        | 76309/371472 [6:04:25<23:45:27,  3.45it/s]
 21%|██        | 76310/371472 [6:04:26<22:16:51,  3.68it/s]
 21%|██        | 76311/371472 [6:04:26<22:07:14,  3.71it/s]
 21%|██        | 76312/371472 [6:04:26<21:33:12,  3.80it/s]
 21%|██        | 76313/371472 [6:04:27<23:39:32,  3.47it/s]
 21%|██        | 76314/371472 [6:04:27<24:11:49,  3.39it/s]
 21%|██        | 76315/371472 [6:04:27<23:28:16,  3.49it/s]
 21%|██        | 76316/371472 [6:04:27<22:55:07,  3.58it/s]
 21%|██        | 76317/371472 [6:04:28<23:16:26,  3.52it/s]
 21%|██        | 76318/371472 [6:04:28<23:09:43,  3.54it/s]
 21%|██        | 76319/371472 [6:04:28<22:40:38,  3.62it/s]
 21%|██        | 76320/371472 [6:04:28<22:45:28,  3.60it/s]
                                                           
{'loss': 4.1471, 'learning_rate': 8.154776013273287e-07, 'epoch': 3.29}

 21%|██        | 76320/371472 [6:04:28<22:45:28,  3.60it/s]
 21%|██        | 76321/371472 [6:04:29<23:41:48,  3.46it/s]
 21%|██        | 76322/371472 [6:04:29<23:03:54,  3.55it/s]
 21%|██        | 76323/371472 [6:04:29<23:30:19,  3.49it/s]
 21%|██        | 76324/371472 [6:04:30<24:40:53,  3.32it/s]
 21%|██        | 76325/371472 [6:04:30<24:16:48,  3.38it/s]
 21%|██        | 76326/371472 [6:04:30<24:53:09,  3.29it/s]
 21%|██        | 76327/371472 [6:04:31<24:28:56,  3.35it/s]
 21%|██        | 76328/371472 [6:04:31<23:32:28,  3.48it/s]
 21%|██        | 76329/371472 [6:04:31<24:45:25,  3.31it/s]
 21%|██        | 76330/371472 [6:04:32<25:58:38,  3.16it/s]
 21%|██        | 76331/371472 [6:04:32<24:56:41,  3.29it/s]
 21%|██        | 76332/371472 [6:04:32<23:23:16,  3.51it/s]
 21%|██        | 76333/371472 [6:04:32<23:21:30,  3.51it/s]
 21%|██        | 76334/371472 [6:04:33<22:23:22,  3.66it/s]
 21%|██        | 76335/371472 [6:04:33<21:51:33,  3.75it/s]
 21%|██        | 76336/371472 [6:04:33<23:01:23,  3.56it/s]
 21%|██        | 76337/371472 [6:04:33<23:12:11,  3.53it/s]
 21%|██        | 76338/371472 [6:04:34<23:11:41,  3.53it/s]
 21%|██        | 76339/371472 [6:04:34<23:29:01,  3.49it/s]
 21%|██        | 76340/371472 [6:04:34<22:31:32,  3.64it/s]
                                                           
{'loss': 4.1654, 'learning_rate': 8.154291193518499e-07, 'epoch': 3.29}

 21%|██        | 76340/371472 [6:04:34<22:31:32,  3.64it/s]
 21%|██        | 76341/371472 [6:04:35<22:06:16,  3.71it/s]
 21%|██        | 76342/371472 [6:04:35<22:55:01,  3.58it/s]
 21%|██        | 76343/371472 [6:04:35<22:11:33,  3.69it/s]
 21%|██        | 76344/371472 [6:04:35<21:48:50,  3.76it/s]
 21%|██        | 76345/371472 [6:04:36<22:04:16,  3.71it/s]
 21%|██        | 76346/371472 [6:04:36<21:34:27,  3.80it/s]
 21%|██        | 76347/371472 [6:04:36<21:06:42,  3.88it/s]
 21%|██        | 76348/371472 [6:04:36<22:07:00,  3.71it/s]
 21%|██        | 76349/371472 [6:04:37<22:04:04,  3.71it/s]
 21%|██        | 76350/371472 [6:04:37<22:11:46,  3.69it/s]
 21%|██        | 76351/371472 [6:04:37<21:37:57,  3.79it/s]
 21%|██        | 76352/371472 [6:04:37<21:05:50,  3.89it/s]
 21%|██        | 76353/371472 [6:04:38<20:54:12,  3.92it/s]
 21%|██        | 76354/371472 [6:04:38<22:02:15,  3.72it/s]
 21%|██        | 76355/371472 [6:04:38<23:26:04,  3.50it/s]
 21%|██        | 76356/371472 [6:04:39<22:37:48,  3.62it/s]
 21%|██        | 76357/371472 [6:04:39<22:25:51,  3.65it/s]
 21%|██        | 76358/371472 [6:04:39<23:29:56,  3.49it/s]
 21%|██        | 76359/371472 [6:04:39<23:13:11,  3.53it/s]
 21%|██        | 76360/371472 [6:04:40<23:15:32,  3.52it/s]
                                                           
{'loss': 4.0594, 'learning_rate': 8.153806373763709e-07, 'epoch': 3.29}

 21%|██        | 76360/371472 [6:04:40<23:15:32,  3.52it/s]
 21%|██        | 76361/371472 [6:04:40<22:13:17,  3.69it/s]
 21%|██        | 76362/371472 [6:04:40<21:45:48,  3.77it/s]
 21%|██        | 76363/371472 [6:04:40<21:08:19,  3.88it/s]
 21%|██        | 76364/371472 [6:04:41<22:11:49,  3.69it/s]
 21%|██        | 76365/371472 [6:04:41<24:40:48,  3.32it/s]
 21%|██        | 76366/371472 [6:04:41<24:11:54,  3.39it/s]
 21%|██        | 76367/371472 [6:04:42<23:30:57,  3.49it/s]
 21%|██        | 76368/371472 [6:04:42<24:51:12,  3.30it/s]
 21%|██        | 76369/371472 [6:04:42<23:55:43,  3.43it/s]
 21%|██        | 76370/371472 [6:04:43<23:14:52,  3.53it/s]
 21%|██        | 76371/371472 [6:04:43<22:06:50,  3.71it/s]
 21%|██        | 76372/371472 [6:04:43<22:08:57,  3.70it/s]
 21%|██        | 76373/371472 [6:04:43<23:03:55,  3.55it/s]
 21%|██        | 76374/371472 [6:04:44<23:15:08,  3.53it/s]
 21%|██        | 76375/371472 [6:04:44<22:07:08,  3.71it/s]
 21%|██        | 76376/371472 [6:04:44<23:15:10,  3.53it/s]
 21%|██        | 76377/371472 [6:04:44<22:20:16,  3.67it/s]
 21%|██        | 76378/371472 [6:04:45<22:33:20,  3.63it/s]
 21%|██        | 76379/371472 [6:04:45<23:00:09,  3.56it/s]
 21%|██        | 76380/371472 [6:04:45<23:49:33,  3.44it/s]
                                                           
{'loss': 4.0196, 'learning_rate': 8.15332155400892e-07, 'epoch': 3.29}

 21%|██        | 76380/371472 [6:04:45<23:49:33,  3.44it/s]
 21%|██        | 76381/371472 [6:04:46<24:00:17,  3.41it/s]
 21%|██        | 76382/371472 [6:04:46<22:45:11,  3.60it/s]
 21%|██        | 76383/371472 [6:04:46<23:17:37,  3.52it/s]
 21%|██        | 76384/371472 [6:04:46<23:05:02,  3.55it/s]
 21%|██        | 76385/371472 [6:04:47<24:52:55,  3.29it/s]
 21%|██        | 76386/371472 [6:04:47<24:47:42,  3.31it/s]
 21%|██        | 76387/371472 [6:04:47<24:05:52,  3.40it/s]
 21%|██        | 76388/371472 [6:04:48<24:37:53,  3.33it/s]
 21%|██        | 76389/371472 [6:04:48<23:22:13,  3.51it/s]
 21%|██        | 76390/371472 [6:04:48<23:36:12,  3.47it/s]
 21%|██        | 76391/371472 [6:04:48<23:15:09,  3.53it/s]
 21%|██        | 76392/371472 [6:04:49<23:25:55,  3.50it/s]
 21%|██        | 76393/371472 [6:04:49<23:38:49,  3.47it/s]
 21%|██        | 76394/371472 [6:04:49<22:47:58,  3.60it/s]
 21%|██        | 76395/371472 [6:04:50<21:33:30,  3.80it/s]
 21%|██        | 76396/371472 [6:04:50<21:43:45,  3.77it/s]
 21%|██        | 76397/371472 [6:04:50<22:33:53,  3.63it/s]
 21%|██        | 76398/371472 [6:04:50<22:48:15,  3.59it/s]
 21%|██        | 76399/371472 [6:04:51<22:36:46,  3.62it/s]
 21%|██        | 76400/371472 [6:04:51<22:18:25,  3.67it/s]
                                                           
{'loss': 3.8641, 'learning_rate': 8.152836734254132e-07, 'epoch': 3.29}

 21%|██        | 76400/371472 [6:04:51<22:18:25,  3.67it/s]
 21%|██        | 76401/371472 [6:04:51<23:39:44,  3.46it/s]
 21%|██        | 76402/371472 [6:04:52<22:29:00,  3.65it/s]
 21%|██        | 76403/371472 [6:04:52<22:49:03,  3.59it/s]
 21%|██        | 76404/371472 [6:04:52<22:02:04,  3.72it/s]
 21%|██        | 76405/371472 [6:04:52<22:07:04,  3.71it/s]
 21%|██        | 76406/371472 [6:04:53<23:41:08,  3.46it/s]
 21%|██        | 76407/371472 [6:04:53<25:29:39,  3.21it/s]
 21%|██        | 76408/371472 [6:04:53<24:14:40,  3.38it/s]
 21%|██        | 76409/371472 [6:04:54<23:21:44,  3.51it/s]
 21%|██        | 76410/371472 [6:04:54<22:41:43,  3.61it/s]
 21%|██        | 76411/371472 [6:04:54<23:05:47,  3.55it/s]
 21%|██        | 76412/371472 [6:04:54<22:38:32,  3.62it/s]
 21%|██        | 76413/371472 [6:04:55<21:58:53,  3.73it/s]
 21%|██        | 76414/371472 [6:04:55<21:46:07,  3.77it/s]
 21%|██        | 76415/371472 [6:04:55<21:22:41,  3.83it/s]
 21%|██        | 76416/371472 [6:04:55<21:55:40,  3.74it/s]
 21%|██        | 76417/371472 [6:04:56<22:05:08,  3.71it/s]
 21%|██        | 76418/371472 [6:04:56<21:34:03,  3.80it/s]
 21%|██        | 76419/371472 [6:04:56<21:49:28,  3.76it/s]
 21%|██        | 76420/371472 [6:04:56<21:06:55,  3.88it/s]
                                                           
{'loss': 4.3033, 'learning_rate': 8.152351914499343e-07, 'epoch': 3.29}

 21%|██        | 76420/371472 [6:04:56<21:06:55,  3.88it/s]
 21%|██        | 76421/371472 [6:04:57<22:55:12,  3.58it/s]
 21%|██        | 76422/371472 [6:04:57<22:44:35,  3.60it/s]
 21%|██        | 76423/371472 [6:04:57<22:31:48,  3.64it/s]
 21%|██        | 76424/371472 [6:04:58<21:46:38,  3.76it/s]
 21%|██        | 76425/371472 [6:04:58<23:21:28,  3.51it/s]
 21%|██        | 76426/371472 [6:04:58<23:03:38,  3.55it/s]
 21%|██        | 76427/371472 [6:04:58<23:17:51,  3.52it/s]
 21%|██        | 76428/371472 [6:04:59<22:02:16,  3.72it/s]
 21%|██        | 76429/371472 [6:04:59<22:02:54,  3.72it/s]
 21%|██        | 76430/371472 [6:04:59<22:33:41,  3.63it/s]
 21%|██        | 76431/371472 [6:04:59<21:45:58,  3.77it/s]
 21%|██        | 76432/371472 [6:05:00<22:14:58,  3.68it/s]
 21%|██        | 76433/371472 [6:05:00<22:15:20,  3.68it/s]
 21%|██        | 76434/371472 [6:05:00<23:21:03,  3.51it/s]
 21%|██        | 76435/371472 [6:05:01<22:55:35,  3.57it/s]
 21%|██        | 76436/371472 [6:05:01<22:48:25,  3.59it/s]
 21%|██        | 76437/371472 [6:05:01<22:45:06,  3.60it/s]
 21%|██        | 76438/371472 [6:05:01<22:19:44,  3.67it/s]
 21%|██        | 76439/371472 [6:05:02<21:32:17,  3.81it/s]
 21%|██        | 76440/371472 [6:05:02<22:38:26,  3.62it/s]
                                                           
{'loss': 4.0645, 'learning_rate': 8.151867094744553e-07, 'epoch': 3.29}

 21%|██        | 76440/371472 [6:05:02<22:38:26,  3.62it/s]
 21%|██        | 76441/371472 [6:05:02<22:14:59,  3.68it/s]
 21%|██        | 76442/371472 [6:05:02<21:43:30,  3.77it/s]
 21%|██        | 76443/371472 [6:05:03<21:25:19,  3.83it/s]
 21%|██        | 76444/371472 [6:05:03<21:22:29,  3.83it/s]
 21%|██        | 76445/371472 [6:05:03<21:37:58,  3.79it/s]
 21%|██        | 76446/371472 [6:05:04<21:38:47,  3.79it/s]
 21%|██        | 76447/371472 [6:05:04<23:05:32,  3.55it/s]
 21%|██        | 76448/371472 [6:05:04<23:29:10,  3.49it/s]
 21%|██        | 76449/371472 [6:05:04<22:24:09,  3.66it/s]
 21%|██        | 76450/371472 [6:05:05<25:39:27,  3.19it/s]
 21%|██        | 76451/371472 [6:05:05<25:19:32,  3.24it/s]
 21%|██        | 76452/371472 [6:05:05<25:16:43,  3.24it/s]
 21%|██        | 76453/371472 [6:05:06<26:03:24,  3.15it/s]
 21%|██        | 76454/371472 [6:05:06<24:54:43,  3.29it/s]
 21%|██        | 76455/371472 [6:05:06<23:40:05,  3.46it/s]
 21%|██        | 76456/371472 [6:05:07<23:17:44,  3.52it/s]
 21%|██        | 76457/371472 [6:05:07<22:33:53,  3.63it/s]
 21%|██        | 76458/371472 [6:05:07<24:48:56,  3.30it/s]
 21%|██        | 76459/371472 [6:05:07<23:59:23,  3.42it/s]
 21%|██        | 76460/371472 [6:05:08<25:06:32,  3.26it/s]
                                                           
{'loss': 3.9754, 'learning_rate': 8.151382274989765e-07, 'epoch': 3.29}

 21%|██        | 76460/371472 [6:05:08<25:06:32,  3.26it/s]
 21%|██        | 76461/371472 [6:05:08<24:41:59,  3.32it/s]
 21%|██        | 76462/371472 [6:05:08<24:03:26,  3.41it/s]
 21%|██        | 76463/371472 [6:05:09<23:32:30,  3.48it/s]
 21%|██        | 76464/371472 [6:05:09<22:41:28,  3.61it/s]
 21%|██        | 76465/371472 [6:05:09<22:47:29,  3.60it/s]
 21%|██        | 76466/371472 [6:05:09<22:56:28,  3.57it/s]
 21%|██        | 76467/371472 [6:05:10<22:16:43,  3.68it/s]
 21%|██        | 76468/371472 [6:05:10<22:58:35,  3.57it/s]
 21%|██        | 76469/371472 [6:05:10<23:33:23,  3.48it/s]
 21%|██        | 76470/371472 [6:05:11<23:39:41,  3.46it/s]
 21%|██        | 76471/371472 [6:05:11<22:26:49,  3.65it/s]
 21%|██        | 76472/371472 [6:05:11<22:05:03,  3.71it/s]
 21%|██        | 76473/371472 [6:05:11<21:35:42,  3.79it/s]
 21%|██        | 76474/371472 [6:05:12<21:20:16,  3.84it/s]
 21%|██        | 76475/371472 [6:05:12<20:34:52,  3.98it/s]
 21%|██        | 76476/371472 [6:05:12<21:14:59,  3.86it/s]
 21%|██        | 76477/371472 [6:05:12<23:20:53,  3.51it/s]
 21%|██        | 76478/371472 [6:05:13<23:15:27,  3.52it/s]
 21%|██        | 76479/371472 [6:05:13<25:05:14,  3.27it/s]
 21%|██        | 76480/371472 [6:05:13<23:47:02,  3.45it/s]
                                                           
{'loss': 4.2018, 'learning_rate': 8.150897455234975e-07, 'epoch': 3.29}

 21%|██        | 76480/371472 [6:05:13<23:47:02,  3.45it/s]
 21%|██        | 76481/371472 [6:05:14<23:44:57,  3.45it/s]
 21%|██        | 76482/371472 [6:05:14<22:36:32,  3.62it/s]
 21%|██        | 76483/371472 [6:05:14<21:33:16,  3.80it/s]
 21%|██        | 76484/371472 [6:05:14<24:01:30,  3.41it/s]
 21%|██        | 76485/371472 [6:05:15<23:33:55,  3.48it/s]
 21%|██        | 76486/371472 [6:05:15<22:35:48,  3.63it/s]
 21%|██        | 76487/371472 [6:05:15<23:14:36,  3.53it/s]
 21%|██        | 76488/371472 [6:05:16<22:10:56,  3.69it/s]
 21%|██        | 76489/371472 [6:05:16<21:36:13,  3.79it/s]
 21%|██        | 76490/371472 [6:05:16<21:18:59,  3.84it/s]
 21%|██        | 76491/371472 [6:05:16<21:13:58,  3.86it/s]
 21%|██        | 76492/371472 [6:05:17<21:24:32,  3.83it/s]
 21%|██        | 76493/371472 [6:05:17<21:08:00,  3.88it/s]
 21%|██        | 76494/371472 [6:05:17<22:02:37,  3.72it/s]
 21%|██        | 76495/371472 [6:05:17<22:16:56,  3.68it/s]
 21%|██        | 76496/371472 [6:05:18<22:07:26,  3.70it/s]
 21%|██        | 76497/371472 [6:05:18<21:31:19,  3.81it/s]
 21%|██        | 76498/371472 [6:05:18<23:18:02,  3.52it/s]
 21%|██        | 76499/371472 [6:05:18<22:34:59,  3.63it/s]
 21%|██        | 76500/371472 [6:05:19<22:41:20,  3.61it/s]
                                                           
{'loss': 4.0713, 'learning_rate': 8.150412635480187e-07, 'epoch': 3.29}

 21%|██        | 76500/371472 [6:05:19<22:41:20,  3.61it/s]
 21%|██        | 76501/371472 [6:05:19<23:28:33,  3.49it/s]
 21%|██        | 76502/371472 [6:05:19<23:13:10,  3.53it/s]
 21%|██        | 76503/371472 [6:05:20<23:38:03,  3.47it/s]
 21%|██        | 76504/371472 [6:05:20<23:11:42,  3.53it/s]
 21%|██        | 76505/371472 [6:05:20<22:19:12,  3.67it/s]
 21%|██        | 76506/371472 [6:05:20<22:39:41,  3.62it/s]
 21%|██        | 76507/371472 [6:05:21<25:23:34,  3.23it/s]
 21%|██        | 76508/371472 [6:05:21<24:32:19,  3.34it/s]
 21%|██        | 76509/371472 [6:05:21<24:00:55,  3.41it/s]
 21%|██        | 76510/371472 [6:05:22<24:33:53,  3.34it/s]
 21%|██        | 76511/371472 [6:05:22<24:53:02,  3.29it/s]
 21%|██        | 76512/371472 [6:05:22<23:43:26,  3.45it/s]
 21%|██        | 76513/371472 [6:05:23<22:55:32,  3.57it/s]
 21%|██        | 76514/371472 [6:05:23<23:02:09,  3.56it/s]
 21%|██        | 76515/371472 [6:05:23<22:35:44,  3.63it/s]
 21%|██        | 76516/371472 [6:05:23<22:34:33,  3.63it/s]
 21%|██        | 76517/371472 [6:05:24<22:22:27,  3.66it/s]
 21%|██        | 76518/371472 [6:05:24<21:53:12,  3.74it/s]
 21%|██        | 76519/371472 [6:05:24<21:12:48,  3.86it/s]
 21%|██        | 76520/371472 [6:05:24<21:40:13,  3.78it/s]
                                                           
{'loss': 4.0749, 'learning_rate': 8.149927815725397e-07, 'epoch': 3.3}

 21%|██        | 76520/371472 [6:05:24<21:40:13,  3.78it/s]
 21%|██        | 76521/371472 [6:05:25<22:24:34,  3.66it/s]
 21%|██        | 76522/371472 [6:05:25<23:30:05,  3.49it/s]
 21%|██        | 76523/371472 [6:05:25<23:06:06,  3.55it/s]
 21%|██        | 76524/371472 [6:05:26<22:54:34,  3.58it/s]
 21%|██        | 76525/371472 [6:05:26<22:39:33,  3.62it/s]
 21%|██        | 76526/371472 [6:05:26<21:50:42,  3.75it/s]
 21%|██        | 76527/371472 [6:05:26<22:15:08,  3.68it/s]
 21%|██        | 76528/371472 [6:05:27<22:57:26,  3.57it/s]
 21%|██        | 76529/371472 [6:05:27<23:16:22,  3.52it/s]
 21%|██        | 76530/371472 [6:05:27<24:58:42,  3.28it/s]
 21%|██        | 76531/371472 [6:05:28<24:01:46,  3.41it/s]
 21%|██        | 76532/371472 [6:05:28<23:59:24,  3.42it/s]
 21%|██        | 76533/371472 [6:05:28<24:09:31,  3.39it/s]
 21%|██        | 76534/371472 [6:05:29<25:58:12,  3.15it/s]
 21%|██        | 76535/371472 [6:05:29<24:30:08,  3.34it/s]
 21%|██        | 76536/371472 [6:05:29<24:23:02,  3.36it/s]
 21%|██        | 76537/371472 [6:05:29<24:39:08,  3.32it/s]
 21%|██        | 76538/371472 [6:05:30<25:18:01,  3.24it/s]
 21%|██        | 76539/371472 [6:05:30<23:53:49,  3.43it/s]
 21%|██        | 76540/371472 [6:05:30<22:46:05,  3.60it/s]
                                                           
{'loss': 4.0327, 'learning_rate': 8.149442995970609e-07, 'epoch': 3.3}

 21%|██        | 76540/371472 [6:05:30<22:46:05,  3.60it/s]
 21%|██        | 76541/371472 [6:05:30<22:30:39,  3.64it/s]
 21%|██        | 76542/371472 [6:05:31<21:32:20,  3.80it/s]
 21%|██        | 76543/371472 [6:05:31<21:09:37,  3.87it/s]
 21%|██        | 76544/371472 [6:05:31<20:53:14,  3.92it/s]
 21%|██        | 76545/371472 [6:05:32<22:27:20,  3.65it/s]
 21%|██        | 76546/371472 [6:05:32<21:58:07,  3.73it/s]
 21%|██        | 76547/371472 [6:05:32<22:59:53,  3.56it/s]
 21%|██        | 76548/371472 [6:05:32<22:40:12,  3.61it/s]
 21%|██        | 76549/371472 [6:05:33<22:30:52,  3.64it/s]
 21%|██        | 76550/371472 [6:05:33<22:14:47,  3.68it/s]
 21%|██        | 76551/371472 [6:05:33<23:50:08,  3.44it/s]
 21%|██        | 76552/371472 [6:05:33<23:25:03,  3.50it/s]
 21%|██        | 76553/371472 [6:05:34<23:39:26,  3.46it/s]
 21%|██        | 76554/371472 [6:05:34<23:08:36,  3.54it/s]
 21%|██        | 76555/371472 [6:05:34<22:29:21,  3.64it/s]
 21%|██        | 76556/371472 [6:05:35<22:03:57,  3.71it/s]
 21%|██        | 76557/371472 [6:05:35<21:25:16,  3.82it/s]
 21%|██        | 76558/371472 [6:05:35<23:06:06,  3.55it/s]
 21%|██        | 76559/371472 [6:05:35<22:22:05,  3.66it/s]
 21%|██        | 76560/371472 [6:05:36<21:50:21,  3.75it/s]
                                                           
{'loss': 4.3854, 'learning_rate': 8.14895817621582e-07, 'epoch': 3.3}

 21%|██        | 76560/371472 [6:05:36<21:50:21,  3.75it/s]
 21%|██        | 76561/371472 [6:05:36<21:47:44,  3.76it/s]
 21%|██        | 76562/371472 [6:05:36<22:09:04,  3.70it/s]
 21%|██        | 76563/371472 [6:05:36<21:51:03,  3.75it/s]
 21%|██        | 76564/371472 [6:05:37<22:13:45,  3.69it/s]
 21%|██        | 76565/371472 [6:05:37<22:54:35,  3.58it/s]
 21%|██        | 76566/371472 [6:05:37<22:32:24,  3.63it/s]
 21%|██        | 76567/371472 [6:05:38<22:40:41,  3.61it/s]
 21%|██        | 76568/371472 [6:05:38<22:21:46,  3.66it/s]
 21%|██        | 76569/371472 [6:05:38<22:46:15,  3.60it/s]
 21%|██        | 76570/371472 [6:05:38<23:22:44,  3.50it/s]
 21%|██        | 76571/371472 [6:05:39<22:32:49,  3.63it/s]
 21%|██        | 76572/371472 [6:05:39<22:16:20,  3.68it/s]
 21%|██        | 76573/371472 [6:05:39<22:49:43,  3.59it/s]
 21%|██        | 76574/371472 [6:05:40<22:25:55,  3.65it/s]
 21%|██        | 76575/371472 [6:05:40<21:33:20,  3.80it/s]
 21%|██        | 76576/371472 [6:05:40<21:14:31,  3.86it/s]
 21%|██        | 76577/371472 [6:05:40<22:47:03,  3.60it/s]
 21%|██        | 76578/371472 [6:05:41<22:13:48,  3.68it/s]
 21%|██        | 76579/371472 [6:05:41<22:41:57,  3.61it/s]
 21%|██        | 76580/371472 [6:05:41<21:49:01,  3.75it/s]
                                                           
{'loss': 4.0602, 'learning_rate': 8.148473356461032e-07, 'epoch': 3.3}

 21%|██        | 76580/371472 [6:05:41<21:49:01,  3.75it/s]
 21%|██        | 76581/371472 [6:05:41<21:22:10,  3.83it/s]
 21%|██        | 76582/371472 [6:05:42<22:51:08,  3.58it/s]
 21%|██        | 76583/371472 [6:05:42<22:36:47,  3.62it/s]
 21%|██        | 76584/371472 [6:05:42<22:22:49,  3.66it/s]
 21%|██        | 76585/371472 [6:05:42<21:46:44,  3.76it/s]
 21%|██        | 76586/371472 [6:05:43<21:41:06,  3.78it/s]
 21%|██        | 76587/371472 [6:05:43<22:19:08,  3.67it/s]
 21%|██        | 76588/371472 [6:05:43<21:58:20,  3.73it/s]
 21%|██        | 76589/371472 [6:05:44<23:35:26,  3.47it/s]
 21%|██        | 76590/371472 [6:05:44<22:29:22,  3.64it/s]
 21%|██        | 76591/371472 [6:05:44<23:25:21,  3.50it/s]
 21%|██        | 76592/371472 [6:05:45<25:28:19,  3.22it/s]
 21%|██        | 76593/371472 [6:05:45<24:53:30,  3.29it/s]
 21%|██        | 76594/371472 [6:05:45<23:37:41,  3.47it/s]
 21%|██        | 76595/371472 [6:05:45<22:28:13,  3.65it/s]
 21%|██        | 76596/371472 [6:05:46<22:05:49,  3.71it/s]
 21%|██        | 76597/371472 [6:05:46<21:44:55,  3.77it/s]
 21%|██        | 76598/371472 [6:05:46<24:15:24,  3.38it/s]
 21%|██        | 76599/371472 [6:05:46<23:26:38,  3.49it/s]
 21%|██        | 76600/371472 [6:05:47<23:57:11,  3.42it/s]
                                                           
{'loss': 4.0853, 'learning_rate': 8.147988536706242e-07, 'epoch': 3.3}

 21%|██        | 76600/371472 [6:05:47<23:57:11,  3.42it/s]
 21%|██        | 76601/371472 [6:05:47<23:14:26,  3.52it/s]
 21%|██        | 76602/371472 [6:05:47<22:32:42,  3.63it/s]
 21%|██        | 76603/371472 [6:05:48<22:38:45,  3.62it/s]
 21%|██        | 76604/371472 [6:05:48<23:02:31,  3.55it/s]
 21%|██        | 76605/371472 [6:05:48<24:10:05,  3.39it/s]
 21%|██        | 76606/371472 [6:05:48<23:39:35,  3.46it/s]
 21%|██        | 76607/371472 [6:05:49<23:34:29,  3.47it/s]
 21%|██        | 76608/371472 [6:05:49<22:40:37,  3.61it/s]
 21%|██        | 76609/371472 [6:05:49<22:18:08,  3.67it/s]
 21%|██        | 76610/371472 [6:05:49<21:19:12,  3.84it/s]
 21%|██        | 76611/371472 [6:05:50<20:57:45,  3.91it/s]
 21%|██        | 76612/371472 [6:05:50<23:10:19,  3.53it/s]
 21%|██        | 76613/371472 [6:05:50<24:16:38,  3.37it/s]
 21%|██        | 76614/371472 [6:05:51<26:30:01,  3.09it/s]
 21%|██        | 76615/371472 [6:05:51<24:47:38,  3.30it/s]
 21%|██        | 76616/371472 [6:05:51<23:26:57,  3.49it/s]
 21%|██        | 76617/371472 [6:05:52<23:31:38,  3.48it/s]
 21%|██        | 76618/371472 [6:05:52<22:08:17,  3.70it/s]
 21%|██        | 76619/371472 [6:05:52<22:38:55,  3.62it/s]
 21%|██        | 76620/371472 [6:05:52<22:07:57,  3.70it/s]
                                                           
{'loss': 4.1677, 'learning_rate': 8.147503716951452e-07, 'epoch': 3.3}

 21%|██        | 76620/371472 [6:05:52<22:07:57,  3.70it/s]
 21%|██        | 76621/371472 [6:05:53<23:28:59,  3.49it/s]
 21%|██        | 76622/371472 [6:05:53<22:55:57,  3.57it/s]
 21%|██        | 76623/371472 [6:05:53<22:09:34,  3.70it/s]
 21%|██        | 76624/371472 [6:05:53<22:57:41,  3.57it/s]
 21%|██        | 76625/371472 [6:05:54<23:56:46,  3.42it/s]
 21%|██        | 76626/371472 [6:05:54<23:41:21,  3.46it/s]
 21%|██        | 76627/371472 [6:05:54<24:14:03,  3.38it/s]
 21%|██        | 76628/371472 [6:05:55<23:19:00,  3.51it/s]
 21%|██        | 76629/371472 [6:05:55<22:05:05,  3.71it/s]
 21%|██        | 76630/371472 [6:05:55<21:37:16,  3.79it/s]
 21%|██        | 76631/371472 [6:05:56<23:43:18,  3.45it/s]
 21%|██        | 76632/371472 [6:05:56<23:07:01,  3.54it/s]
 21%|██        | 76633/371472 [6:05:56<23:09:22,  3.54it/s]
 21%|██        | 76634/371472 [6:05:56<23:15:52,  3.52it/s]
 21%|██        | 76635/371472 [6:05:57<22:57:50,  3.57it/s]
 21%|██        | 76636/371472 [6:05:57<22:20:36,  3.67it/s]
 21%|██        | 76637/371472 [6:05:57<21:54:28,  3.74it/s]
 21%|██        | 76638/371472 [6:05:57<23:39:35,  3.46it/s]
 21%|██        | 76639/371472 [6:05:58<22:42:09,  3.61it/s]
 21%|██        | 76640/371472 [6:05:58<22:48:27,  3.59it/s]
                                                           
{'loss': 4.0639, 'learning_rate': 8.147018897196664e-07, 'epoch': 3.3}

 21%|██        | 76640/371472 [6:05:58<22:48:27,  3.59it/s]
 21%|██        | 76641/371472 [6:05:58<23:41:11,  3.46it/s]
 21%|██        | 76642/371472 [6:05:59<23:31:42,  3.48it/s]
 21%|██        | 76643/371472 [6:05:59<23:12:31,  3.53it/s]
 21%|██        | 76644/371472 [6:05:59<22:18:48,  3.67it/s]
 21%|██        | 76645/371472 [6:05:59<21:36:49,  3.79it/s]
 21%|██        | 76646/371472 [6:06:00<21:31:48,  3.80it/s]
 21%|██        | 76647/371472 [6:06:00<21:38:45,  3.78it/s]
 21%|██        | 76648/371472 [6:06:00<21:38:36,  3.78it/s]
 21%|██        | 76649/371472 [6:06:00<22:35:46,  3.62it/s]
 21%|██        | 76650/371472 [6:06:01<22:17:17,  3.67it/s]
 21%|██        | 76651/371472 [6:06:01<22:39:09,  3.62it/s]
 21%|██        | 76652/371472 [6:06:01<25:11:47,  3.25it/s]
 21%|██        | 76653/371472 [6:06:02<24:03:19,  3.40it/s]
 21%|██        | 76654/371472 [6:06:02<23:30:50,  3.48it/s]
 21%|██        | 76655/371472 [6:06:02<24:26:11,  3.35it/s]
 21%|██        | 76656/371472 [6:06:02<23:24:22,  3.50it/s]
 21%|██        | 76657/371472 [6:06:03<22:53:26,  3.58it/s]
 21%|██        | 76658/371472 [6:06:03<23:21:41,  3.51it/s]
 21%|██        | 76659/371472 [6:06:03<23:01:26,  3.56it/s]
 21%|██        | 76660/371472 [6:06:04<22:40:12,  3.61it/s]
                                                           
{'loss': 4.2143, 'learning_rate': 8.146534077441876e-07, 'epoch': 3.3}

 21%|██        | 76660/371472 [6:06:04<22:40:12,  3.61it/s]
 21%|██        | 76661/371472 [6:06:04<23:22:33,  3.50it/s]
 21%|██        | 76662/371472 [6:06:04<24:30:59,  3.34it/s]
 21%|██        | 76663/371472 [6:06:05<23:55:23,  3.42it/s]
 21%|██        | 76664/371472 [6:06:05<24:32:02,  3.34it/s]
 21%|██        | 76665/371472 [6:06:05<24:15:51,  3.37it/s]
 21%|██        | 76666/371472 [6:06:05<23:50:50,  3.43it/s]
 21%|██        | 76667/371472 [6:06:06<23:43:01,  3.45it/s]
 21%|██        | 76668/371472 [6:06:06<23:09:27,  3.54it/s]
 21%|██        | 76669/371472 [6:06:06<22:19:23,  3.67it/s]
 21%|██        | 76670/371472 [6:06:06<22:01:00,  3.72it/s]
 21%|██        | 76671/371472 [6:06:07<22:43:44,  3.60it/s]
 21%|██        | 76672/371472 [6:06:07<23:22:18,  3.50it/s]
 21%|██        | 76673/371472 [6:06:07<22:42:52,  3.61it/s]
 21%|██        | 76674/371472 [6:06:08<22:08:27,  3.70it/s]
 21%|██        | 76675/371472 [6:06:08<21:51:28,  3.75it/s]
 21%|██        | 76676/371472 [6:06:08<22:01:15,  3.72it/s]
 21%|██        | 76677/371472 [6:06:08<24:11:08,  3.39it/s]
 21%|██        | 76678/371472 [6:06:09<27:25:10,  2.99it/s]
 21%|██        | 76679/371472 [6:06:09<26:58:11,  3.04it/s]
 21%|██        | 76680/371472 [6:06:09<25:55:15,  3.16it/s]
                                                           
{'loss': 4.1781, 'learning_rate': 8.146049257687086e-07, 'epoch': 3.3}

 21%|██        | 76680/371472 [6:06:09<25:55:15,  3.16it/s]
 21%|██        | 76681/371472 [6:06:10<25:14:35,  3.24it/s]
 21%|██        | 76682/371472 [6:06:10<24:29:59,  3.34it/s]
 21%|██        | 76683/371472 [6:06:10<24:07:21,  3.39it/s]
 21%|██        | 76684/371472 [6:06:11<23:59:36,  3.41it/s]
 21%|██        | 76685/371472 [6:06:11<24:37:39,  3.32it/s]
 21%|██        | 76686/371472 [6:06:11<23:49:27,  3.44it/s]
 21%|██        | 76687/371472 [6:06:12<23:54:05,  3.43it/s]
 21%|██        | 76688/371472 [6:06:12<23:27:39,  3.49it/s]
 21%|██        | 76689/371472 [6:06:12<22:41:16,  3.61it/s]
 21%|██        | 76690/371472 [6:06:12<22:33:38,  3.63it/s]
 21%|██        | 76691/371472 [6:06:13<23:01:23,  3.56it/s]
 21%|██        | 76692/371472 [6:06:13<22:42:53,  3.60it/s]
 21%|██        | 76693/371472 [6:06:13<22:37:36,  3.62it/s]
 21%|██        | 76694/371472 [6:06:13<21:58:39,  3.73it/s]
 21%|██        | 76695/371472 [6:06:14<22:29:10,  3.64it/s]
 21%|██        | 76696/371472 [6:06:14<22:17:43,  3.67it/s]
 21%|██        | 76697/371472 [6:06:14<21:53:12,  3.74it/s]
 21%|██        | 76698/371472 [6:06:14<21:17:03,  3.85it/s]
 21%|██        | 76699/371472 [6:06:15<21:51:59,  3.74it/s]
 21%|██        | 76700/371472 [6:06:15<21:54:06,  3.74it/s]
                                                           
{'loss': 4.1863, 'learning_rate': 8.145564437932297e-07, 'epoch': 3.3}

 21%|██        | 76700/371472 [6:06:15<21:54:06,  3.74it/s]
 21%|██        | 76701/371472 [6:06:15<22:26:06,  3.65it/s]
 21%|██        | 76702/371472 [6:06:16<22:27:27,  3.65it/s]
 21%|██        | 76703/371472 [6:06:16<22:50:11,  3.59it/s]
 21%|██        | 76704/371472 [6:06:16<22:20:03,  3.67it/s]
 21%|██        | 76705/371472 [6:06:16<21:39:07,  3.78it/s]
 21%|██        | 76706/371472 [6:06:17<22:33:27,  3.63it/s]
 21%|██        | 76707/371472 [6:06:17<23:37:25,  3.47it/s]
 21%|██        | 76708/371472 [6:06:17<22:43:14,  3.60it/s]
 21%|██        | 76709/371472 [6:06:18<24:29:12,  3.34it/s]
 21%|██        | 76710/371472 [6:06:18<25:06:38,  3.26it/s]
 21%|██        | 76711/371472 [6:06:18<24:41:54,  3.32it/s]
 21%|██        | 76712/371472 [6:06:19<26:56:00,  3.04it/s]
 21%|██        | 76713/371472 [6:06:19<25:40:24,  3.19it/s]
 21%|██        | 76714/371472 [6:06:19<24:39:36,  3.32it/s]
 21%|██        | 76715/371472 [6:06:19<23:21:50,  3.50it/s]
 21%|██        | 76716/371472 [6:06:20<22:13:43,  3.68it/s]
 21%|██        | 76717/371472 [6:06:20<22:22:44,  3.66it/s]
 21%|██        | 76718/371472 [6:06:20<22:16:53,  3.67it/s]
 21%|██        | 76719/371472 [6:06:20<23:10:55,  3.53it/s]
 21%|██        | 76720/371472 [6:06:21<22:44:41,  3.60it/s]
                                                           
{'loss': 3.9404, 'learning_rate': 8.145079618177509e-07, 'epoch': 3.3}

 21%|██        | 76720/371472 [6:06:21<22:44:41,  3.60it/s]
 21%|██        | 76721/371472 [6:06:21<22:22:09,  3.66it/s]
 21%|██        | 76722/371472 [6:06:21<22:48:58,  3.59it/s]
 21%|██        | 76723/371472 [6:06:22<22:18:14,  3.67it/s]
 21%|██        | 76724/371472 [6:06:22<22:56:46,  3.57it/s]
 21%|██        | 76725/371472 [6:06:22<22:45:46,  3.60it/s]
 21%|██        | 76726/371472 [6:06:22<23:01:50,  3.55it/s]
 21%|██        | 76727/371472 [6:06:23<23:41:07,  3.46it/s]
 21%|██        | 76728/371472 [6:06:23<22:54:18,  3.57it/s]
 21%|██        | 76729/371472 [6:06:23<23:01:13,  3.56it/s]
 21%|██        | 76730/371472 [6:06:24<22:42:41,  3.60it/s]
 21%|██        | 76731/371472 [6:06:24<22:19:47,  3.67it/s]
 21%|██        | 76732/371472 [6:06:24<21:24:56,  3.82it/s]
 21%|██        | 76733/371472 [6:06:24<21:26:35,  3.82it/s]
 21%|██        | 76734/371472 [6:06:25<20:59:54,  3.90it/s]
 21%|██        | 76735/371472 [6:06:25<20:54:46,  3.91it/s]
 21%|██        | 76736/371472 [6:06:25<20:31:46,  3.99it/s]
 21%|██        | 76737/371472 [6:06:25<20:41:19,  3.96it/s]
 21%|██        | 76738/371472 [6:06:26<20:55:09,  3.91it/s]
 21%|██        | 76739/371472 [6:06:26<22:14:22,  3.68it/s]
 21%|██        | 76740/371472 [6:06:26<21:55:20,  3.73it/s]
                                                           
{'loss': 4.2133, 'learning_rate': 8.14459479842272e-07, 'epoch': 3.31}

 21%|██        | 76740/371472 [6:06:26<21:55:20,  3.73it/s]
 21%|██        | 76741/371472 [6:06:26<22:36:34,  3.62it/s]
 21%|██        | 76742/371472 [6:06:27<22:48:39,  3.59it/s]
 21%|██        | 76743/371472 [6:06:27<22:45:03,  3.60it/s]
 21%|██        | 76744/371472 [6:06:27<22:23:12,  3.66it/s]
 21%|██        | 76745/371472 [6:06:28<23:14:26,  3.52it/s]
 21%|██        | 76746/371472 [6:06:28<25:39:28,  3.19it/s]
 21%|██        | 76747/371472 [6:06:28<24:51:05,  3.29it/s]
 21%|██        | 76748/371472 [6:06:28<23:47:43,  3.44it/s]
 21%|██        | 76749/371472 [6:06:29<22:52:43,  3.58it/s]
 21%|██        | 76750/371472 [6:06:29<23:03:29,  3.55it/s]
 21%|██        | 76751/371472 [6:06:29<23:29:30,  3.48it/s]
 21%|██        | 76752/371472 [6:06:30<22:32:19,  3.63it/s]
 21%|██        | 76753/371472 [6:06:30<22:55:45,  3.57it/s]
 21%|██        | 76754/371472 [6:06:30<22:44:47,  3.60it/s]
 21%|██        | 76755/371472 [6:06:30<22:17:16,  3.67it/s]
 21%|██        | 76756/371472 [6:06:31<21:53:38,  3.74it/s]
 21%|██        | 76757/371472 [6:06:31<21:50:11,  3.75it/s]
 21%|██        | 76758/371472 [6:06:31<24:39:24,  3.32it/s]
 21%|██        | 76759/371472 [6:06:32<26:17:52,  3.11it/s]
 21%|██        | 76760/371472 [6:06:32<24:47:19,  3.30it/s]
                                                           
{'loss': 4.0929, 'learning_rate': 8.14410997866793e-07, 'epoch': 3.31}

 21%|██        | 76760/371472 [6:06:32<24:47:19,  3.30it/s]
 21%|██        | 76761/371472 [6:06:32<25:16:07,  3.24it/s]
 21%|██        | 76762/371472 [6:06:33<24:14:20,  3.38it/s]
 21%|██        | 76763/371472 [6:06:33<23:29:02,  3.49it/s]
 21%|██        | 76764/371472 [6:06:33<23:55:28,  3.42it/s]
 21%|██        | 76765/371472 [6:06:33<23:56:47,  3.42it/s]
 21%|██        | 76766/371472 [6:06:34<23:58:36,  3.41it/s]
 21%|██        | 76767/371472 [6:06:34<23:43:13,  3.45it/s]
 21%|██        | 76768/371472 [6:06:34<24:15:39,  3.37it/s]
 21%|██        | 76769/371472 [6:06:35<24:04:52,  3.40it/s]
 21%|██        | 76770/371472 [6:06:35<22:55:16,  3.57it/s]
 21%|██        | 76771/371472 [6:06:35<26:32:54,  3.08it/s]
 21%|██        | 76772/371472 [6:06:35<25:21:43,  3.23it/s]
 21%|██        | 76773/371472 [6:06:36<25:40:39,  3.19it/s]
 21%|██        | 76774/371472 [6:06:36<23:59:37,  3.41it/s]
 21%|██        | 76775/371472 [6:06:36<23:21:15,  3.51it/s]
 21%|██        | 76776/371472 [6:06:37<23:16:11,  3.52it/s]
 21%|██        | 76777/371472 [6:06:37<22:47:58,  3.59it/s]
 21%|██        | 76778/371472 [6:06:37<23:06:45,  3.54it/s]
 21%|██        | 76779/371472 [6:06:37<22:55:32,  3.57it/s]
 21%|██        | 76780/371472 [6:06:38<23:39:16,  3.46it/s]
                                                           
{'loss': 4.0367, 'learning_rate': 8.143625158913141e-07, 'epoch': 3.31}

 21%|██        | 76780/371472 [6:06:38<23:39:16,  3.46it/s]
 21%|██        | 76781/371472 [6:06:38<23:02:01,  3.55it/s]
 21%|██        | 76782/371472 [6:06:38<22:56:40,  3.57it/s]
 21%|██        | 76783/371472 [6:06:39<22:42:07,  3.61it/s]
 21%|██        | 76784/371472 [6:06:39<22:44:05,  3.60it/s]
 21%|██        | 76785/371472 [6:06:39<22:37:00,  3.62it/s]
 21%|██        | 76786/371472 [6:06:39<22:55:50,  3.57it/s]
 21%|██        | 76787/371472 [6:06:40<22:29:05,  3.64it/s]
 21%|██        | 76788/371472 [6:06:40<21:54:00,  3.74it/s]
 21%|██        | 76789/371472 [6:06:40<23:50:59,  3.43it/s]
 21%|██        | 76790/371472 [6:06:41<23:49:15,  3.44it/s]
 21%|██        | 76791/371472 [6:06:41<23:19:26,  3.51it/s]
 21%|██        | 76792/371472 [6:06:41<23:01:55,  3.55it/s]
 21%|██        | 76793/371472 [6:06:41<22:31:52,  3.63it/s]
 21%|██        | 76794/371472 [6:06:42<23:02:48,  3.55it/s]
 21%|██        | 76795/371472 [6:06:42<23:35:04,  3.47it/s]
 21%|██        | 76796/371472 [6:06:42<23:11:47,  3.53it/s]
 21%|██        | 76797/371472 [6:06:42<22:30:04,  3.64it/s]
 21%|██        | 76798/371472 [6:06:43<21:40:27,  3.78it/s]
 21%|██        | 76799/371472 [6:06:43<23:18:08,  3.51it/s]
 21%|██        | 76800/371472 [6:06:43<23:09:05,  3.54it/s]
                                                           
{'loss': 4.2925, 'learning_rate': 8.143140339158353e-07, 'epoch': 3.31}

 21%|██        | 76800/371472 [6:06:43<23:09:05,  3.54it/s]
 21%|██        | 76801/371472 [6:06:44<23:03:50,  3.55it/s]
 21%|██        | 76802/371472 [6:06:44<22:52:30,  3.58it/s]
 21%|██        | 76803/371472 [6:06:44<24:51:45,  3.29it/s]
 21%|██        | 76804/371472 [6:06:45<24:02:09,  3.41it/s]
 21%|██        | 76805/371472 [6:06:45<24:21:07,  3.36it/s]
 21%|██        | 76806/371472 [6:06:45<23:36:50,  3.47it/s]
 21%|██        | 76807/371472 [6:06:45<23:49:22,  3.44it/s]
 21%|██        | 76808/371472 [6:06:46<24:01:58,  3.41it/s]
 21%|██        | 76809/371472 [6:06:46<23:33:41,  3.47it/s]
 21%|██        | 76810/371472 [6:06:46<23:02:39,  3.55it/s]
 21%|██        | 76811/371472 [6:06:46<22:30:32,  3.64it/s]
 21%|██        | 76812/371472 [6:06:47<22:57:27,  3.57it/s]
 21%|██        | 76813/371472 [6:06:47<22:31:01,  3.63it/s]
 21%|██        | 76814/371472 [6:06:47<21:59:04,  3.72it/s]
 21%|██        | 76815/371472 [6:06:48<21:44:01,  3.77it/s]
 21%|██        | 76816/371472 [6:06:48<22:11:53,  3.69it/s]
 21%|██        | 76817/371472 [6:06:48<22:46:38,  3.59it/s]
 21%|██        | 76818/371472 [6:06:48<22:23:32,  3.66it/s]
 21%|██        | 76819/371472 [6:06:49<22:22:14,  3.66it/s]
 21%|██        | 76820/371472 [6:06:49<23:22:09,  3.50it/s]
                                                           
{'loss': 3.9315, 'learning_rate': 8.142655519403564e-07, 'epoch': 3.31}

 21%|██        | 76820/371472 [6:06:49<23:22:09,  3.50it/s]
 21%|██        | 76821/371472 [6:06:49<24:14:35,  3.38it/s]
 21%|██        | 76822/371472 [6:06:50<24:06:26,  3.40it/s]
 21%|██        | 76823/371472 [6:06:50<26:09:16,  3.13it/s]
 21%|██        | 76824/371472 [6:06:50<24:59:25,  3.28it/s]
 21%|██        | 76825/371472 [6:06:51<27:08:03,  3.02it/s]
 21%|██        | 76826/371472 [6:06:51<26:57:46,  3.04it/s]
 21%|██        | 76827/371472 [6:06:51<25:52:40,  3.16it/s]
 21%|██        | 76828/371472 [6:06:52<25:08:49,  3.25it/s]
 21%|██        | 76829/371472 [6:06:52<24:08:24,  3.39it/s]
 21%|██        | 76830/371472 [6:06:52<23:35:11,  3.47it/s]
 21%|██        | 76831/371472 [6:06:52<25:48:40,  3.17it/s]
 21%|██        | 76832/371472 [6:06:53<25:03:09,  3.27it/s]
 21%|██        | 76833/371472 [6:06:53<24:01:05,  3.41it/s]
 21%|██        | 76834/371472 [6:06:53<24:24:11,  3.35it/s]
 21%|██        | 76835/371472 [6:06:54<24:08:39,  3.39it/s]
 21%|██        | 76836/371472 [6:06:54<23:32:00,  3.48it/s]
 21%|██        | 76837/371472 [6:06:54<22:44:59,  3.60it/s]
 21%|██        | 76838/371472 [6:06:54<22:36:41,  3.62it/s]
 21%|██        | 76839/371472 [6:06:55<22:58:47,  3.56it/s]
 21%|██        | 76840/371472 [6:06:55<22:30:31,  3.64it/s]
                                                           
{'loss': 4.1322, 'learning_rate': 8.142170699648775e-07, 'epoch': 3.31}

 21%|██        | 76840/371472 [6:06:55<22:30:31,  3.64it/s]
 21%|██        | 76841/371472 [6:06:55<22:53:51,  3.57it/s]
 21%|██        | 76842/371472 [6:06:56<24:52:54,  3.29it/s]
 21%|██        | 76843/371472 [6:06:56<24:16:49,  3.37it/s]
 21%|██        | 76844/371472 [6:06:56<23:33:33,  3.47it/s]
 21%|██        | 76845/371472 [6:06:56<22:46:18,  3.59it/s]
 21%|██        | 76846/371472 [6:06:57<22:04:05,  3.71it/s]
 21%|██        | 76847/371472 [6:06:57<21:51:46,  3.74it/s]
 21%|██        | 76848/371472 [6:06:57<23:25:12,  3.49it/s]
 21%|██        | 76849/371472 [6:06:58<22:55:13,  3.57it/s]
 21%|██        | 76850/371472 [6:06:58<22:09:25,  3.69it/s]
 21%|██        | 76851/371472 [6:06:58<21:58:47,  3.72it/s]
 21%|██        | 76852/371472 [6:06:58<22:42:34,  3.60it/s]
 21%|██        | 76853/371472 [6:06:59<22:44:49,  3.60it/s]
 21%|██        | 76854/371472 [6:06:59<22:02:07,  3.71it/s]
 21%|██        | 76855/371472 [6:06:59<22:10:00,  3.69it/s]
 21%|██        | 76856/371472 [6:06:59<23:32:31,  3.48it/s]
 21%|██        | 76857/371472 [6:07:00<22:47:55,  3.59it/s]
 21%|██        | 76858/371472 [6:07:00<22:22:41,  3.66it/s]
 21%|██        | 76859/371472 [6:07:00<21:35:43,  3.79it/s]
 21%|██        | 76860/371472 [6:07:00<21:49:51,  3.75it/s]
                                                           
{'loss': 4.1594, 'learning_rate': 8.141685879893985e-07, 'epoch': 3.31}

 21%|██        | 76860/371472 [6:07:00<21:49:51,  3.75it/s]
 21%|██        | 76861/371472 [6:07:01<22:05:59,  3.70it/s]
 21%|██        | 76862/371472 [6:07:01<21:39:05,  3.78it/s]
 21%|██        | 76863/371472 [6:07:01<21:14:47,  3.85it/s]
 21%|██        | 76864/371472 [6:07:02<21:02:20,  3.89it/s]
 21%|██        | 76865/371472 [6:07:02<22:49:47,  3.58it/s]
 21%|██        | 76866/371472 [6:07:02<22:09:33,  3.69it/s]
 21%|██        | 76867/371472 [6:07:02<22:33:31,  3.63it/s]
 21%|██        | 76868/371472 [6:07:03<22:07:03,  3.70it/s]
 21%|██        | 76869/371472 [6:07:03<23:20:08,  3.51it/s]
 21%|██        | 76870/371472 [6:07:03<24:37:55,  3.32it/s]
 21%|██        | 76871/371472 [6:07:04<23:46:54,  3.44it/s]
 21%|██        | 76872/371472 [6:07:04<22:52:45,  3.58it/s]
 21%|██        | 76873/371472 [6:07:04<23:09:34,  3.53it/s]
 21%|██        | 76874/371472 [6:07:04<23:11:45,  3.53it/s]
 21%|██        | 76875/371472 [6:07:05<23:34:23,  3.47it/s]
 21%|██        | 76876/371472 [6:07:05<24:05:34,  3.40it/s]
 21%|██        | 76877/371472 [6:07:05<26:12:42,  3.12it/s]
 21%|██        | 76878/371472 [6:07:06<24:41:22,  3.31it/s]
 21%|██        | 76879/371472 [6:07:06<24:32:32,  3.33it/s]
 21%|██        | 76880/371472 [6:07:06<23:25:37,  3.49it/s]
                                                           
{'loss': 4.1882, 'learning_rate': 8.141201060139197e-07, 'epoch': 3.31}

 21%|██        | 76880/371472 [6:07:06<23:25:37,  3.49it/s]
 21%|██        | 76881/371472 [6:07:06<23:02:58,  3.55it/s]
 21%|██        | 76882/371472 [6:07:07<23:26:45,  3.49it/s]
 21%|██        | 76883/371472 [6:07:07<22:41:11,  3.61it/s]
 21%|██        | 76884/371472 [6:07:07<23:33:23,  3.47it/s]
 21%|██        | 76885/371472 [6:07:08<23:27:53,  3.49it/s]
 21%|██        | 76886/371472 [6:07:08<23:22:06,  3.50it/s]
 21%|██        | 76887/371472 [6:07:08<26:16:11,  3.11it/s]
 21%|██        | 76888/371472 [6:07:09<24:51:06,  3.29it/s]
 21%|██        | 76889/371472 [6:07:09<23:28:23,  3.49it/s]
 21%|██        | 76890/371472 [6:07:09<23:11:16,  3.53it/s]
 21%|██        | 76891/371472 [6:07:09<24:38:44,  3.32it/s]
 21%|██        | 76892/371472 [6:07:10<23:25:01,  3.49it/s]
 21%|██        | 76893/371472 [6:07:10<23:29:14,  3.48it/s]
 21%|██        | 76894/371472 [6:07:10<26:04:09,  3.14it/s]
 21%|██        | 76895/371472 [6:07:11<27:06:33,  3.02it/s]
 21%|██        | 76896/371472 [6:07:11<26:40:50,  3.07it/s]
 21%|██        | 76897/371472 [6:07:11<25:18:40,  3.23it/s]
 21%|██        | 76898/371472 [6:07:12<24:13:44,  3.38it/s]
 21%|██        | 76899/371472 [6:07:12<24:03:19,  3.40it/s]
 21%|██        | 76900/371472 [6:07:12<24:35:30,  3.33it/s]
                                                           
{'loss': 4.0579, 'learning_rate': 8.140716240384407e-07, 'epoch': 3.31}

 21%|██        | 76900/371472 [6:07:12<24:35:30,  3.33it/s]
 21%|██        | 76901/371472 [6:07:12<24:03:41,  3.40it/s]
 21%|██        | 76902/371472 [6:07:13<23:08:27,  3.54it/s]
 21%|██        | 76903/371472 [6:07:13<24:05:45,  3.40it/s]
 21%|██        | 76904/371472 [6:07:13<24:24:07,  3.35it/s]
 21%|██        | 76905/371472 [6:07:14<24:44:26,  3.31it/s]
 21%|██        | 76906/371472 [6:07:14<23:58:16,  3.41it/s]
 21%|██        | 76907/371472 [6:07:14<22:53:23,  3.57it/s]
 21%|██        | 76908/371472 [6:07:14<22:22:59,  3.66it/s]
 21%|██        | 76909/371472 [6:07:15<22:40:08,  3.61it/s]
 21%|██        | 76910/371472 [6:07:15<22:18:05,  3.67it/s]
 21%|██        | 76911/371472 [6:07:15<22:34:42,  3.62it/s]
 21%|██        | 76912/371472 [6:07:16<24:07:15,  3.39it/s]
 21%|██        | 76913/371472 [6:07:16<23:16:03,  3.52it/s]
 21%|██        | 76914/371472 [6:07:16<23:24:56,  3.49it/s]
 21%|██        | 76915/371472 [6:07:16<22:25:36,  3.65it/s]
 21%|██        | 76916/371472 [6:07:17<21:52:00,  3.74it/s]
 21%|██        | 76917/371472 [6:07:17<21:39:29,  3.78it/s]
 21%|██        | 76918/371472 [6:07:17<22:01:42,  3.71it/s]
 21%|██        | 76919/371472 [6:07:17<21:38:07,  3.78it/s]
 21%|██        | 76920/371472 [6:07:18<21:29:53,  3.81it/s]
                                                           
{'loss': 4.0531, 'learning_rate': 8.140231420629619e-07, 'epoch': 3.31}

 21%|██        | 76920/371472 [6:07:18<21:29:53,  3.81it/s]
 21%|██        | 76921/371472 [6:07:18<23:24:34,  3.50it/s]
 21%|██        | 76922/371472 [6:07:18<23:57:47,  3.41it/s]
 21%|██        | 76923/371472 [6:07:19<25:47:57,  3.17it/s]
 21%|██        | 76924/371472 [6:07:19<24:55:48,  3.28it/s]
 21%|██        | 76925/371472 [6:07:19<23:50:12,  3.43it/s]
 21%|██        | 76926/371472 [6:07:20<23:15:20,  3.52it/s]
 21%|██        | 76927/371472 [6:07:20<22:22:42,  3.66it/s]
 21%|██        | 76928/371472 [6:07:20<22:36:06,  3.62it/s]
 21%|██        | 76929/371472 [6:07:20<22:31:25,  3.63it/s]
 21%|██        | 76930/371472 [6:07:21<23:53:50,  3.42it/s]
 21%|██        | 76931/371472 [6:07:21<23:02:13,  3.55it/s]
 21%|██        | 76932/371472 [6:07:21<23:45:59,  3.44it/s]
 21%|██        | 76933/371472 [6:07:22<23:48:46,  3.44it/s]
 21%|██        | 76934/371472 [6:07:22<23:36:10,  3.47it/s]
 21%|██        | 76935/371472 [6:07:22<23:17:26,  3.51it/s]
 21%|██        | 76936/371472 [6:07:22<23:54:53,  3.42it/s]
 21%|██        | 76937/371472 [6:07:23<22:52:13,  3.58it/s]
 21%|██        | 76938/371472 [6:07:23<22:24:55,  3.65it/s]
 21%|██        | 76939/371472 [6:07:23<22:29:14,  3.64it/s]
 21%|██        | 76940/371472 [6:07:23<21:39:54,  3.78it/s]
                                                           
{'loss': 4.188, 'learning_rate': 8.13974660087483e-07, 'epoch': 3.31}

 21%|██        | 76940/371472 [6:07:23<21:39:54,  3.78it/s]
 21%|██        | 76941/371472 [6:07:24<21:43:34,  3.77it/s]
 21%|██        | 76942/371472 [6:07:24<21:44:35,  3.76it/s]
 21%|██        | 76943/371472 [6:07:24<21:53:25,  3.74it/s]
 21%|██        | 76944/371472 [6:07:25<22:22:41,  3.66it/s]
 21%|██        | 76945/371472 [6:07:25<23:42:03,  3.45it/s]
 21%|██        | 76946/371472 [6:07:25<25:57:36,  3.15it/s]
 21%|██        | 76947/371472 [6:07:25<23:59:37,  3.41it/s]
 21%|██        | 76948/371472 [6:07:26<24:05:31,  3.40it/s]
 21%|██        | 76949/371472 [6:07:26<23:20:49,  3.50it/s]
 21%|██        | 76950/371472 [6:07:26<23:20:30,  3.50it/s]
 21%|██        | 76951/371472 [6:07:27<25:56:37,  3.15it/s]
 21%|██        | 76952/371472 [6:07:27<27:50:06,  2.94it/s]
 21%|██        | 76953/371472 [6:07:27<26:40:16,  3.07it/s]
 21%|██        | 76954/371472 [6:07:28<26:11:32,  3.12it/s]
 21%|██        | 76955/371472 [6:07:28<25:53:28,  3.16it/s]
 21%|██        | 76956/371472 [6:07:28<25:44:17,  3.18it/s]
 21%|██        | 76957/371472 [6:07:29<25:35:08,  3.20it/s]
 21%|██        | 76958/371472 [6:07:29<24:09:39,  3.39it/s]
 21%|██        | 76959/371472 [6:07:29<23:23:23,  3.50it/s]
 21%|██        | 76960/371472 [6:07:29<23:32:39,  3.47it/s]
                                                           
{'loss': 4.1626, 'learning_rate': 8.139261781120042e-07, 'epoch': 3.31}

 21%|██        | 76960/371472 [6:07:29<23:32:39,  3.47it/s]
 21%|██        | 76961/371472 [6:07:30<22:52:12,  3.58it/s]
 21%|██        | 76962/371472 [6:07:30<22:40:50,  3.61it/s]
 21%|██        | 76963/371472 [6:07:30<22:03:01,  3.71it/s]
 21%|██        | 76964/371472 [6:07:31<22:50:56,  3.58it/s]
 21%|██        | 76965/371472 [6:07:31<22:10:59,  3.69it/s]
 21%|██        | 76966/371472 [6:07:31<22:32:51,  3.63it/s]
 21%|██        | 76967/371472 [6:07:31<21:55:46,  3.73it/s]
 21%|██        | 76968/371472 [6:07:32<21:55:00,  3.73it/s]
 21%|██        | 76969/371472 [6:07:32<21:23:00,  3.83it/s]
 21%|██        | 76970/371472 [6:07:32<21:12:44,  3.86it/s]
 21%|██        | 76971/371472 [6:07:32<21:12:27,  3.86it/s]
 21%|██        | 76972/371472 [6:07:33<20:56:17,  3.91it/s]
 21%|██        | 76973/371472 [6:07:33<22:55:00,  3.57it/s]
 21%|██        | 76974/371472 [6:07:33<23:10:06,  3.53it/s]
 21%|██        | 76975/371472 [6:07:33<22:37:52,  3.61it/s]
 21%|██        | 76976/371472 [6:07:34<23:21:09,  3.50it/s]
 21%|██        | 76977/371472 [6:07:34<22:11:24,  3.69it/s]
 21%|██        | 76978/371472 [6:07:34<22:00:24,  3.72it/s]
 21%|██        | 76979/371472 [6:07:35<21:33:07,  3.80it/s]
 21%|██        | 76980/371472 [6:07:35<21:31:59,  3.80it/s]
                                                           
{'loss': 3.9643, 'learning_rate': 8.138776961365252e-07, 'epoch': 3.32}

 21%|██        | 76980/371472 [6:07:35<21:31:59,  3.80it/s]
 21%|██        | 76981/371472 [6:07:35<21:42:53,  3.77it/s]
 21%|██        | 76982/371472 [6:07:35<22:16:44,  3.67it/s]
 21%|██        | 76983/371472 [6:07:36<22:26:35,  3.64it/s]
 21%|██        | 76984/371472 [6:07:36<22:54:59,  3.57it/s]
 21%|██        | 76985/371472 [6:07:36<22:01:05,  3.72it/s]
 21%|██        | 76986/371472 [6:07:36<21:38:21,  3.78it/s]
 21%|██        | 76987/371472 [6:07:37<21:41:46,  3.77it/s]
 21%|██        | 76988/371472 [6:07:37<21:20:04,  3.83it/s]
 21%|██        | 76989/371472 [6:07:37<21:05:36,  3.88it/s]
 21%|██        | 76990/371472 [6:07:37<22:02:32,  3.71it/s]
 21%|██        | 76991/371472 [6:07:38<22:26:49,  3.64it/s]
 21%|██        | 76992/371472 [6:07:38<22:45:08,  3.60it/s]
 21%|██        | 76993/371472 [6:07:38<23:11:29,  3.53it/s]
 21%|██        | 76994/371472 [6:07:39<24:59:39,  3.27it/s]
 21%|██        | 76995/371472 [6:07:39<24:10:33,  3.38it/s]
 21%|██        | 76996/371472 [6:07:39<23:24:31,  3.49it/s]
 21%|██        | 76997/371472 [6:07:40<24:14:43,  3.37it/s]
 21%|██        | 76998/371472 [6:07:40<24:08:44,  3.39it/s]
 21%|██        | 76999/371472 [6:07:40<23:49:12,  3.43it/s]
 21%|██        | 77000/371472 [6:07:40<24:53:05,  3.29it/s]
                                                           
{'loss': 4.1296, 'learning_rate': 8.138292141610463e-07, 'epoch': 3.32}

 21%|██        | 77000/371472 [6:07:40<24:53:05,  3.29it/s]
 21%|██        | 77001/371472 [6:07:41<23:13:49,  3.52it/s]
 21%|██        | 77002/371472 [6:07:41<23:10:06,  3.53it/s]
 21%|██        | 77003/371472 [6:07:41<24:09:55,  3.38it/s]
 21%|██        | 77004/371472 [6:07:42<23:35:12,  3.47it/s]
 21%|██        | 77005/371472 [6:07:42<23:03:53,  3.55it/s]
 21%|██        | 77006/371472 [6:07:42<22:16:59,  3.67it/s]
 21%|██        | 77007/371472 [6:07:42<22:36:38,  3.62it/s]
 21%|██        | 77008/371472 [6:07:43<24:18:08,  3.37it/s]
 21%|██        | 77009/371472 [6:07:43<23:40:10,  3.46it/s]
 21%|██        | 77010/371472 [6:07:43<23:32:04,  3.48it/s]
 21%|██        | 77011/371472 [6:07:44<26:04:42,  3.14it/s]
 21%|██        | 77012/371472 [6:07:44<24:49:11,  3.30it/s]
 21%|██        | 77013/371472 [6:07:44<23:12:35,  3.52it/s]
 21%|██        | 77014/371472 [6:07:44<22:18:44,  3.67it/s]
 21%|██        | 77015/371472 [6:07:45<22:06:59,  3.70it/s]
 21%|██        | 77016/371472 [6:07:45<23:02:28,  3.55it/s]
 21%|██        | 77017/371472 [6:07:45<23:15:07,  3.52it/s]
 21%|██        | 77018/371472 [6:07:46<24:03:38,  3.40it/s]
 21%|██        | 77019/371472 [6:07:46<23:12:00,  3.53it/s]
 21%|██        | 77020/371472 [6:07:46<22:54:06,  3.57it/s]
                                                           
{'loss': 4.1892, 'learning_rate': 8.137807321855674e-07, 'epoch': 3.32}

 21%|██        | 77020/371472 [6:07:46<22:54:06,  3.57it/s]
 21%|██        | 77021/371472 [6:07:46<22:59:39,  3.56it/s]
 21%|██        | 77022/371472 [6:07:47<21:52:45,  3.74it/s]
 21%|██        | 77023/371472 [6:07:47<23:49:07,  3.43it/s]
 21%|██        | 77024/371472 [6:07:47<23:03:26,  3.55it/s]
 21%|██        | 77025/371472 [6:07:48<23:21:12,  3.50it/s]
 21%|██        | 77026/371472 [6:07:48<22:00:24,  3.72it/s]
 21%|██        | 77027/371472 [6:07:48<25:05:11,  3.26it/s]
 21%|██        | 77028/371472 [6:07:49<25:21:56,  3.22it/s]
 21%|██        | 77029/371472 [6:07:49<24:22:17,  3.36it/s]
 21%|██        | 77030/371472 [6:07:49<25:49:27,  3.17it/s]
 21%|██        | 77031/371472 [6:07:49<24:47:30,  3.30it/s]
 21%|██        | 77032/371472 [6:07:50<23:27:08,  3.49it/s]
 21%|██        | 77033/371472 [6:07:50<22:48:11,  3.59it/s]
 21%|██        | 77034/371472 [6:07:50<26:51:48,  3.04it/s]
 21%|██        | 77035/371472 [6:07:51<24:36:21,  3.32it/s]
 21%|██        | 77036/371472 [6:07:51<24:16:38,  3.37it/s]
 21%|██        | 77037/371472 [6:07:51<23:10:57,  3.53it/s]
 21%|██        | 77038/371472 [6:07:51<23:45:01,  3.44it/s]
 21%|██        | 77039/371472 [6:07:52<24:01:41,  3.40it/s]
 21%|██        | 77040/371472 [6:07:52<23:38:21,  3.46it/s]
                                                           
{'loss': 4.1864, 'learning_rate': 8.137322502100886e-07, 'epoch': 3.32}

 21%|██        | 77040/371472 [6:07:52<23:38:21,  3.46it/s]
 21%|██        | 77041/371472 [6:07:52<22:33:06,  3.63it/s]
 21%|██        | 77042/371472 [6:07:53<21:55:37,  3.73it/s]
 21%|██        | 77043/371472 [6:07:53<21:32:28,  3.80it/s]
 21%|██        | 77044/371472 [6:07:53<21:52:09,  3.74it/s]
 21%|██        | 77045/371472 [6:07:53<21:17:53,  3.84it/s]
 21%|██        | 77046/371472 [6:07:54<23:07:31,  3.54it/s]
 21%|██        | 77047/371472 [6:07:54<22:21:43,  3.66it/s]
 21%|██        | 77048/371472 [6:07:54<22:22:17,  3.66it/s]
 21%|██        | 77049/371472 [6:07:54<21:50:38,  3.74it/s]
 21%|██        | 77050/371472 [6:07:55<21:41:57,  3.77it/s]
 21%|██        | 77051/371472 [6:07:55<22:13:04,  3.68it/s]
 21%|██        | 77052/371472 [6:07:55<23:07:40,  3.54it/s]
 21%|██        | 77053/371472 [6:07:56<23:07:38,  3.54it/s]
 21%|██        | 77054/371472 [6:07:56<23:58:37,  3.41it/s]
 21%|██        | 77055/371472 [6:07:56<23:13:29,  3.52it/s]
 21%|██        | 77056/371472 [6:07:56<22:25:36,  3.65it/s]
 21%|██        | 77057/371472 [6:07:57<22:00:53,  3.71it/s]
 21%|██        | 77058/371472 [6:07:57<24:20:17,  3.36it/s]
 21%|██        | 77059/371472 [6:07:57<23:00:39,  3.55it/s]
 21%|██        | 77060/371472 [6:07:57<22:11:15,  3.69it/s]
                                                           
{'loss': 4.311, 'learning_rate': 8.136837682346096e-07, 'epoch': 3.32}

 21%|██        | 77060/371472 [6:07:57<22:11:15,  3.69it/s]
 21%|██        | 77061/371472 [6:07:58<21:36:57,  3.78it/s]
 21%|██        | 77062/371472 [6:07:58<22:16:58,  3.67it/s]
 21%|██        | 77063/371472 [6:07:58<22:36:22,  3.62it/s]
 21%|██        | 77064/371472 [6:07:59<22:39:09,  3.61it/s]
 21%|██        | 77065/371472 [6:07:59<22:51:50,  3.58it/s]
 21%|██        | 77066/371472 [6:07:59<23:21:48,  3.50it/s]
 21%|██        | 77067/371472 [6:08:00<24:37:18,  3.32it/s]
 21%|██        | 77068/371472 [6:08:00<24:09:11,  3.39it/s]
 21%|██        | 77069/371472 [6:08:00<23:12:09,  3.52it/s]
 21%|██        | 77070/371472 [6:08:00<23:21:07,  3.50it/s]
 21%|██        | 77071/371472 [6:08:01<23:46:00,  3.44it/s]
 21%|██        | 77072/371472 [6:08:01<23:03:57,  3.55it/s]
 21%|██        | 77073/371472 [6:08:01<24:20:56,  3.36it/s]
 21%|██        | 77074/371472 [6:08:01<23:01:33,  3.55it/s]
 21%|██        | 77075/371472 [6:08:02<22:44:53,  3.59it/s]
 21%|██        | 77076/371472 [6:08:02<23:30:34,  3.48it/s]
 21%|██        | 77077/371472 [6:08:02<23:23:32,  3.50it/s]
 21%|██        | 77078/371472 [6:08:03<22:45:40,  3.59it/s]
 21%|██        | 77079/371472 [6:08:03<22:57:44,  3.56it/s]
 21%|██        | 77080/371472 [6:08:03<24:07:53,  3.39it/s]
                                                           
{'loss': 4.1749, 'learning_rate': 8.136352862591308e-07, 'epoch': 3.32}

 21%|██        | 77080/371472 [6:08:03<24:07:53,  3.39it/s]
 21%|██        | 77081/371472 [6:08:04<23:44:35,  3.44it/s]
 21%|██        | 77082/371472 [6:08:04<24:14:23,  3.37it/s]
 21%|██        | 77083/371472 [6:08:04<23:12:27,  3.52it/s]
 21%|██        | 77084/371472 [6:08:04<23:22:23,  3.50it/s]
 21%|██        | 77085/371472 [6:08:05<23:12:25,  3.52it/s]
 21%|██        | 77086/371472 [6:08:05<23:05:47,  3.54it/s]
 21%|██        | 77087/371472 [6:08:05<23:36:45,  3.46it/s]
 21%|██        | 77088/371472 [6:08:05<23:03:25,  3.55it/s]
 21%|██        | 77089/371472 [6:08:06<22:21:16,  3.66it/s]
 21%|██        | 77090/371472 [6:08:06<23:55:36,  3.42it/s]
 21%|██        | 77091/371472 [6:08:06<24:30:58,  3.34it/s]
 21%|██        | 77092/371472 [6:08:07<23:41:39,  3.45it/s]
 21%|██        | 77093/371472 [6:08:07<22:38:52,  3.61it/s]
 21%|██        | 77094/371472 [6:08:07<22:05:01,  3.70it/s]
 21%|██        | 77095/371472 [6:08:07<21:54:13,  3.73it/s]
 21%|██        | 77096/371472 [6:08:08<22:11:50,  3.68it/s]
 21%|██        | 77097/371472 [6:08:08<21:55:06,  3.73it/s]
 21%|██        | 77098/371472 [6:08:08<22:38:44,  3.61it/s]
 21%|██        | 77099/371472 [6:08:09<22:29:01,  3.64it/s]
 21%|██        | 77100/371472 [6:08:09<21:53:05,  3.74it/s]
                                                           
{'loss': 3.9428, 'learning_rate': 8.135868042836519e-07, 'epoch': 3.32}

 21%|██        | 77100/371472 [6:08:09<21:53:05,  3.74it/s]
 21%|██        | 77101/371472 [6:08:09<21:19:32,  3.83it/s]
 21%|██        | 77102/371472 [6:08:09<21:32:18,  3.80it/s]
 21%|██        | 77103/371472 [6:08:10<23:42:02,  3.45it/s]
 21%|██        | 77104/371472 [6:08:10<22:41:23,  3.60it/s]
 21%|██        | 77105/371472 [6:08:10<22:13:11,  3.68it/s]
 21%|██        | 77106/371472 [6:08:10<21:44:09,  3.76it/s]
 21%|██        | 77107/371472 [6:08:11<21:55:51,  3.73it/s]
 21%|██        | 77108/371472 [6:08:11<23:34:58,  3.47it/s]
 21%|██        | 77109/371472 [6:08:11<22:09:34,  3.69it/s]
 21%|██        | 77110/371472 [6:08:11<21:29:44,  3.80it/s]
 21%|██        | 77111/371472 [6:08:12<21:49:18,  3.75it/s]
 21%|██        | 77112/371472 [6:08:12<21:23:05,  3.82it/s]
 21%|██        | 77113/371472 [6:08:12<21:00:41,  3.89it/s]
 21%|██        | 77114/371472 [6:08:12<20:21:03,  4.02it/s]
 21%|██        | 77115/371472 [6:08:13<20:47:13,  3.93it/s]
 21%|██        | 77116/371472 [6:08:13<22:00:23,  3.72it/s]
 21%|██        | 77117/371472 [6:08:13<22:01:19,  3.71it/s]
 21%|██        | 77118/371472 [6:08:14<21:45:02,  3.76it/s]
 21%|██        | 77119/371472 [6:08:14<22:02:16,  3.71it/s]
 21%|██        | 77120/371472 [6:08:14<23:37:14,  3.46it/s]
                                                           
{'loss': 4.302, 'learning_rate': 8.135383223081729e-07, 'epoch': 3.32}

 21%|██        | 77120/371472 [6:08:14<23:37:14,  3.46it/s]
 21%|██        | 77121/371472 [6:08:14<23:02:14,  3.55it/s]
 21%|██        | 77122/371472 [6:08:15<22:13:32,  3.68it/s]
 21%|██        | 77123/371472 [6:08:15<22:45:12,  3.59it/s]
 21%|██        | 77124/371472 [6:08:15<23:35:46,  3.47it/s]
 21%|██        | 77125/371472 [6:08:16<25:22:55,  3.22it/s]
 21%|██        | 77126/371472 [6:08:16<24:06:14,  3.39it/s]
 21%|██        | 77127/371472 [6:08:16<25:03:28,  3.26it/s]
 21%|██        | 77128/371472 [6:08:17<24:38:58,  3.32it/s]
 21%|██        | 77129/371472 [6:08:17<25:27:15,  3.21it/s]
 21%|██        | 77130/371472 [6:08:17<24:33:19,  3.33it/s]
 21%|██        | 77131/371472 [6:08:17<24:45:43,  3.30it/s]
 21%|██        | 77132/371472 [6:08:18<23:28:53,  3.48it/s]
 21%|██        | 77133/371472 [6:08:18<23:09:06,  3.53it/s]
 21%|██        | 77134/371472 [6:08:18<24:58:56,  3.27it/s]
 21%|██        | 77135/371472 [6:08:19<23:28:38,  3.48it/s]
 21%|██        | 77136/371472 [6:08:19<23:34:58,  3.47it/s]
 21%|██        | 77137/371472 [6:08:19<22:32:37,  3.63it/s]
 21%|██        | 77138/371472 [6:08:19<22:24:05,  3.65it/s]
 21%|██        | 77139/371472 [6:08:20<22:37:08,  3.61it/s]
 21%|██        | 77140/371472 [6:08:20<22:55:07,  3.57it/s]
                                                           
{'loss': 4.0964, 'learning_rate': 8.13489840332694e-07, 'epoch': 3.32}

 21%|██        | 77140/371472 [6:08:20<22:55:07,  3.57it/s]
 21%|██        | 77141/371472 [6:08:20<22:20:09,  3.66it/s]
 21%|██        | 77142/371472 [6:08:21<25:18:02,  3.23it/s]
 21%|██        | 77143/371472 [6:08:21<25:21:29,  3.22it/s]
 21%|██        | 77144/371472 [6:08:21<24:01:42,  3.40it/s]
 21%|██        | 77145/371472 [6:08:21<23:22:30,  3.50it/s]
 21%|██        | 77146/371472 [6:08:22<23:09:00,  3.53it/s]
 21%|██        | 77147/371472 [6:08:22<23:21:45,  3.50it/s]
 21%|██        | 77148/371472 [6:08:22<23:22:18,  3.50it/s]
 21%|██        | 77149/371472 [6:08:23<24:43:27,  3.31it/s]
 21%|██        | 77150/371472 [6:08:23<23:56:57,  3.41it/s]
 21%|██        | 77151/371472 [6:08:23<23:07:17,  3.54it/s]
 21%|██        | 77152/371472 [6:08:23<23:11:10,  3.53it/s]
 21%|██        | 77153/371472 [6:08:24<23:21:11,  3.50it/s]
 21%|██        | 77154/371472 [6:08:24<22:43:46,  3.60it/s]
 21%|██        | 77155/371472 [6:08:24<22:26:15,  3.64it/s]
 21%|██        | 77156/371472 [6:08:25<21:44:24,  3.76it/s]
 21%|██        | 77157/371472 [6:08:25<23:59:23,  3.41it/s]
 21%|██        | 77158/371472 [6:08:25<22:54:23,  3.57it/s]
 21%|██        | 77159/371472 [6:08:25<22:37:03,  3.61it/s]
 21%|██        | 77160/371472 [6:08:26<21:47:01,  3.75it/s]
                                                           
{'loss': 4.1406, 'learning_rate': 8.134413583572151e-07, 'epoch': 3.32}

 21%|██        | 77160/371472 [6:08:26<21:47:01,  3.75it/s]
 21%|██        | 77161/371472 [6:08:26<22:00:19,  3.72it/s]
 21%|██        | 77162/371472 [6:08:26<21:57:50,  3.72it/s]
 21%|██        | 77163/371472 [6:08:26<22:18:05,  3.67it/s]
 21%|██        | 77164/371472 [6:08:27<23:50:53,  3.43it/s]
 21%|██        | 77165/371472 [6:08:27<24:33:48,  3.33it/s]
 21%|██        | 77166/371472 [6:08:27<23:46:23,  3.44it/s]
 21%|██        | 77167/371472 [6:08:28<23:24:36,  3.49it/s]
 21%|██        | 77168/371472 [6:08:28<22:53:43,  3.57it/s]
 21%|██        | 77169/371472 [6:08:28<22:30:16,  3.63it/s]
 21%|██        | 77170/371472 [6:08:29<24:41:00,  3.31it/s]
 21%|██        | 77171/371472 [6:08:29<26:12:43,  3.12it/s]
 21%|██        | 77172/371472 [6:08:29<25:51:05,  3.16it/s]
 21%|██        | 77173/371472 [6:08:30<25:25:38,  3.22it/s]
 21%|██        | 77174/371472 [6:08:30<25:10:27,  3.25it/s]
 21%|██        | 77175/371472 [6:08:30<24:14:04,  3.37it/s]
 21%|██        | 77176/371472 [6:08:30<23:41:56,  3.45it/s]
 21%|██        | 77177/371472 [6:08:31<24:02:10,  3.40it/s]
 21%|██        | 77178/371472 [6:08:31<25:44:28,  3.18it/s]
 21%|██        | 77179/371472 [6:08:31<24:10:11,  3.38it/s]
 21%|██        | 77180/371472 [6:08:32<23:38:45,  3.46it/s]
                                                           
{'loss': 4.2126, 'learning_rate': 8.133928763817363e-07, 'epoch': 3.32}

 21%|██        | 77180/371472 [6:08:32<23:38:45,  3.46it/s]
 21%|██        | 77181/371472 [6:08:32<23:31:56,  3.47it/s]
 21%|██        | 77182/371472 [6:08:32<23:09:05,  3.53it/s]
 21%|██        | 77183/371472 [6:08:32<22:24:55,  3.65it/s]
 21%|██        | 77184/371472 [6:08:33<22:02:39,  3.71it/s]
 21%|██        | 77185/371472 [6:08:33<22:26:01,  3.64it/s]
 21%|██        | 77186/371472 [6:08:33<22:25:08,  3.65it/s]
 21%|██        | 77187/371472 [6:08:34<28:02:12,  2.92it/s]
 21%|██        | 77188/371472 [6:08:34<26:36:43,  3.07it/s]
 21%|██        | 77189/371472 [6:08:34<25:51:30,  3.16it/s]
 21%|██        | 77190/371472 [6:08:35<24:32:38,  3.33it/s]
 21%|██        | 77191/371472 [6:08:35<24:08:10,  3.39it/s]
 21%|██        | 77192/371472 [6:08:35<23:03:50,  3.54it/s]
 21%|██        | 77193/371472 [6:08:35<24:34:55,  3.33it/s]
 21%|██        | 77194/371472 [6:08:36<23:11:14,  3.53it/s]
 21%|██        | 77195/371472 [6:08:36<22:17:52,  3.67it/s]
 21%|██        | 77196/371472 [6:08:36<21:53:08,  3.74it/s]
 21%|██        | 77197/371472 [6:08:36<22:34:17,  3.62it/s]
 21%|██        | 77198/371472 [6:08:37<23:54:43,  3.42it/s]
 21%|██        | 77199/371472 [6:08:37<23:18:24,  3.51it/s]
 21%|██        | 77200/371472 [6:08:37<22:23:17,  3.65it/s]
                                                           
{'loss': 4.0669, 'learning_rate': 8.133443944062574e-07, 'epoch': 3.33}

 21%|██        | 77200/371472 [6:08:37<22:23:17,  3.65it/s]
 21%|██        | 77201/371472 [6:08:38<22:53:09,  3.57it/s]
 21%|██        | 77202/371472 [6:08:38<22:15:29,  3.67it/s]
 21%|██        | 77203/371472 [6:08:38<22:39:15,  3.61it/s]
 21%|██        | 77204/371472 [6:08:39<25:40:30,  3.18it/s]
 21%|██        | 77205/371472 [6:08:39<25:59:28,  3.14it/s]
 21%|██        | 77206/371472 [6:08:39<26:30:21,  3.08it/s]
 21%|██        | 77207/371472 [6:08:40<24:56:52,  3.28it/s]
 21%|██        | 77208/371472 [6:08:40<24:13:49,  3.37it/s]
 21%|██        | 77209/371472 [6:08:40<23:32:19,  3.47it/s]
 21%|██        | 77210/371472 [6:08:40<22:47:11,  3.59it/s]
 21%|██        | 77211/371472 [6:08:41<21:32:26,  3.79it/s]
 21%|██        | 77212/371472 [6:08:41<22:39:10,  3.61it/s]
 21%|██        | 77213/371472 [6:08:41<23:03:56,  3.54it/s]
 21%|██        | 77214/371472 [6:08:41<22:15:45,  3.67it/s]
 21%|██        | 77215/371472 [6:08:42<21:52:06,  3.74it/s]
 21%|██        | 77216/371472 [6:08:42<22:05:11,  3.70it/s]
 21%|██        | 77217/371472 [6:08:42<22:18:10,  3.66it/s]
 21%|██        | 77218/371472 [6:08:42<21:51:39,  3.74it/s]
 21%|██        | 77219/371472 [6:08:43<22:39:09,  3.61it/s]
 21%|██        | 77220/371472 [6:08:43<22:28:12,  3.64it/s]
                                                           
{'loss': 4.2019, 'learning_rate': 8.132959124307785e-07, 'epoch': 3.33}

 21%|██        | 77220/371472 [6:08:43<22:28:12,  3.64it/s]
 21%|██        | 77221/371472 [6:08:43<22:15:05,  3.67it/s]
 21%|██        | 77222/371472 [6:08:44<21:49:01,  3.75it/s]
 21%|██        | 77223/371472 [6:08:44<24:17:10,  3.37it/s]
 21%|██        | 77224/371472 [6:08:44<27:22:42,  2.99it/s]
 21%|██        | 77225/371472 [6:08:45<25:23:10,  3.22it/s]
 21%|██        | 77226/371472 [6:08:45<24:00:45,  3.40it/s]
 21%|██        | 77227/371472 [6:08:45<28:51:38,  2.83it/s]
 21%|██        | 77228/371472 [6:08:46<28:47:53,  2.84it/s]
 21%|██        | 77229/371472 [6:08:46<26:07:42,  3.13it/s]
 21%|██        | 77230/371472 [6:08:46<24:32:26,  3.33it/s]
 21%|██        | 77231/371472 [6:08:46<24:37:54,  3.32it/s]
 21%|██        | 77232/371472 [6:08:47<24:38:28,  3.32it/s]
 21%|██        | 77233/371472 [6:08:47<24:22:00,  3.35it/s]
 21%|██        | 77234/371472 [6:08:47<23:13:52,  3.52it/s]
 21%|██        | 77235/371472 [6:08:48<22:23:19,  3.65it/s]
 21%|██        | 77236/371472 [6:08:48<24:16:16,  3.37it/s]
 21%|██        | 77237/371472 [6:08:48<23:21:35,  3.50it/s]
 21%|██        | 77238/371472 [6:08:48<23:33:50,  3.47it/s]
 21%|██        | 77239/371472 [6:08:49<22:46:00,  3.59it/s]
 21%|██        | 77240/371472 [6:08:49<21:56:06,  3.73it/s]
                                                           
{'loss': 4.1299, 'learning_rate': 8.132474304552995e-07, 'epoch': 3.33}

 21%|██        | 77240/371472 [6:08:49<21:56:06,  3.73it/s]
 21%|██        | 77241/371472 [6:08:49<22:46:18,  3.59it/s]
 21%|██        | 77242/371472 [6:08:50<23:06:21,  3.54it/s]
 21%|██        | 77243/371472 [6:08:50<22:11:25,  3.68it/s]
 21%|██        | 77244/371472 [6:08:50<22:25:16,  3.65it/s]
 21%|██        | 77245/371472 [6:08:50<22:05:07,  3.70it/s]
 21%|██        | 77246/371472 [6:08:51<21:48:43,  3.75it/s]
 21%|██        | 77247/371472 [6:08:51<23:03:13,  3.55it/s]
 21%|██        | 77248/371472 [6:08:51<23:28:58,  3.48it/s]
 21%|██        | 77249/371472 [6:08:52<23:43:52,  3.44it/s]
 21%|██        | 77250/371472 [6:08:52<22:31:47,  3.63it/s]
 21%|██        | 77251/371472 [6:08:52<22:45:03,  3.59it/s]
 21%|██        | 77252/371472 [6:08:52<21:57:51,  3.72it/s]
 21%|██        | 77253/371472 [6:08:53<22:12:25,  3.68it/s]
 21%|██        | 77254/371472 [6:08:53<21:50:59,  3.74it/s]
 21%|██        | 77255/371472 [6:08:53<21:41:13,  3.77it/s]
 21%|██        | 77256/371472 [6:08:53<22:09:57,  3.69it/s]
 21%|██        | 77257/371472 [6:08:54<23:39:41,  3.45it/s]
 21%|██        | 77258/371472 [6:08:54<22:59:50,  3.55it/s]
 21%|██        | 77259/371472 [6:08:54<22:49:20,  3.58it/s]
 21%|██        | 77260/371472 [6:08:55<22:07:19,  3.69it/s]
                                                           
{'loss': 4.1683, 'learning_rate': 8.131989484798207e-07, 'epoch': 3.33}

 21%|██        | 77260/371472 [6:08:55<22:07:19,  3.69it/s]
 21%|██        | 77261/371472 [6:08:55<22:36:02,  3.62it/s]
 21%|██        | 77262/371472 [6:08:55<21:59:14,  3.72it/s]
 21%|██        | 77263/371472 [6:08:55<22:11:37,  3.68it/s]
 21%|██        | 77264/371472 [6:08:56<21:33:25,  3.79it/s]
 21%|██        | 77265/371472 [6:08:56<21:26:38,  3.81it/s]
 21%|██        | 77266/371472 [6:08:56<22:28:40,  3.64it/s]
 21%|██        | 77267/371472 [6:08:56<22:01:38,  3.71it/s]
 21%|██        | 77268/371472 [6:08:57<22:43:48,  3.60it/s]
 21%|██        | 77269/371472 [6:08:57<21:57:54,  3.72it/s]
 21%|██        | 77270/371472 [6:08:57<23:21:25,  3.50it/s]
 21%|██        | 77271/371472 [6:08:58<23:53:56,  3.42it/s]
 21%|██        | 77272/371472 [6:08:58<22:35:59,  3.62it/s]
 21%|██        | 77273/371472 [6:08:58<24:41:34,  3.31it/s]
 21%|██        | 77274/371472 [6:08:58<23:51:53,  3.42it/s]
 21%|██        | 77275/371472 [6:08:59<23:33:43,  3.47it/s]
 21%|██        | 77276/371472 [6:08:59<23:13:33,  3.52it/s]
 21%|██        | 77277/371472 [6:08:59<24:18:59,  3.36it/s]
 21%|██        | 77278/371472 [6:09:00<22:59:20,  3.55it/s]
 21%|██        | 77279/371472 [6:09:00<22:22:17,  3.65it/s]
 21%|██        | 77280/371472 [6:09:00<23:42:00,  3.45it/s]
                                                           
{'loss': 3.9748, 'learning_rate': 8.131504665043418e-07, 'epoch': 3.33}

 21%|██        | 77280/371472 [6:09:00<23:42:00,  3.45it/s]
 21%|██        | 77281/371472 [6:09:00<23:10:48,  3.53it/s]
 21%|██        | 77282/371472 [6:09:01<23:22:06,  3.50it/s]
 21%|██        | 77283/371472 [6:09:01<23:04:06,  3.54it/s]
 21%|██        | 77284/371472 [6:09:01<22:32:48,  3.62it/s]
 21%|██        | 77285/371472 [6:09:02<22:44:17,  3.59it/s]
 21%|██        | 77286/371472 [6:09:02<22:27:49,  3.64it/s]
 21%|██        | 77287/371472 [6:09:02<21:52:36,  3.74it/s]
 21%|██        | 77288/371472 [6:09:02<21:12:12,  3.85it/s]
 21%|██        | 77289/371472 [6:09:03<26:31:56,  3.08it/s]
 21%|██        | 77290/371472 [6:09:03<25:58:59,  3.15it/s]
 21%|██        | 77291/371472 [6:09:03<25:34:56,  3.19it/s]
 21%|██        | 77292/371472 [6:09:04<23:40:43,  3.45it/s]
 21%|██        | 77293/371472 [6:09:04<24:25:23,  3.35it/s]
 21%|██        | 77294/371472 [6:09:04<24:35:43,  3.32it/s]
 21%|██        | 77295/371472 [6:09:05<25:46:37,  3.17it/s]
 21%|██        | 77296/371472 [6:09:05<24:08:09,  3.39it/s]
 21%|██        | 77297/371472 [6:09:05<22:49:35,  3.58it/s]
 21%|██        | 77298/371472 [6:09:05<22:57:51,  3.56it/s]
 21%|██        | 77299/371472 [6:09:06<23:08:38,  3.53it/s]
 21%|██        | 77300/371472 [6:09:06<23:01:20,  3.55it/s]
                                                           
{'loss': 4.1484, 'learning_rate': 8.131019845288629e-07, 'epoch': 3.33}

 21%|██        | 77300/371472 [6:09:06<23:01:20,  3.55it/s]
 21%|██        | 77301/371472 [6:09:06<23:13:14,  3.52it/s]
 21%|██        | 77302/371472 [6:09:07<23:18:56,  3.50it/s]
 21%|██        | 77303/371472 [6:09:07<22:06:42,  3.70it/s]
 21%|██        | 77304/371472 [6:09:07<21:50:13,  3.74it/s]
 21%|██        | 77305/371472 [6:09:07<21:49:50,  3.74it/s]
 21%|██        | 77306/371472 [6:09:08<22:28:33,  3.64it/s]
 21%|██        | 77307/371472 [6:09:08<22:01:51,  3.71it/s]
 21%|██        | 77308/371472 [6:09:08<24:21:02,  3.36it/s]
 21%|██        | 77309/371472 [6:09:08<23:31:08,  3.47it/s]
 21%|██        | 77310/371472 [6:09:09<24:23:53,  3.35it/s]
 21%|██        | 77311/371472 [6:09:09<24:04:27,  3.39it/s]
 21%|██        | 77312/371472 [6:09:09<23:32:45,  3.47it/s]
 21%|██        | 77313/371472 [6:09:10<24:26:22,  3.34it/s]
 21%|██        | 77314/371472 [6:09:10<23:44:00,  3.44it/s]
 21%|██        | 77315/371472 [6:09:10<23:57:18,  3.41it/s]
 21%|██        | 77316/371472 [6:09:11<24:31:50,  3.33it/s]
 21%|██        | 77317/371472 [6:09:11<24:29:09,  3.34it/s]
 21%|██        | 77318/371472 [6:09:11<23:58:37,  3.41it/s]
 21%|██        | 77319/371472 [6:09:11<23:06:09,  3.54it/s]
 21%|██        | 77320/371472 [6:09:12<22:21:52,  3.65it/s]
                                                           
{'loss': 4.0326, 'learning_rate': 8.13053502553384e-07, 'epoch': 3.33}

 21%|██        | 77320/371472 [6:09:12<22:21:52,  3.65it/s]
 21%|██        | 77321/371472 [6:09:12<24:37:57,  3.32it/s]
 21%|██        | 77322/371472 [6:09:12<25:23:51,  3.22it/s]
 21%|██        | 77323/371472 [6:09:13<23:50:01,  3.43it/s]
 21%|██        | 77324/371472 [6:09:13<24:33:50,  3.33it/s]
 21%|██        | 77325/371472 [6:09:13<23:06:53,  3.53it/s]
 21%|██        | 77326/371472 [6:09:13<22:26:33,  3.64it/s]
 21%|██        | 77327/371472 [6:09:14<22:52:16,  3.57it/s]
 21%|██        | 77328/371472 [6:09:14<22:00:48,  3.71it/s]
 21%|██        | 77329/371472 [6:09:14<21:36:36,  3.78it/s]
 21%|██        | 77330/371472 [6:09:14<21:31:05,  3.80it/s]
 21%|██        | 77331/371472 [6:09:15<21:20:06,  3.83it/s]
 21%|██        | 77332/371472 [6:09:15<20:59:27,  3.89it/s]
 21%|██        | 77333/371472 [6:09:15<20:54:15,  3.91it/s]
 21%|██        | 77334/371472 [6:09:15<21:30:41,  3.80it/s]
 21%|██        | 77335/371472 [6:09:16<22:53:48,  3.57it/s]
 21%|██        | 77336/371472 [6:09:16<23:05:59,  3.54it/s]
 21%|██        | 77337/371472 [6:09:16<24:01:17,  3.40it/s]
 21%|██        | 77338/371472 [6:09:17<23:08:34,  3.53it/s]
 21%|██        | 77339/371472 [6:09:17<22:29:21,  3.63it/s]
 21%|██        | 77340/371472 [6:09:17<21:53:43,  3.73it/s]
                                                           
{'loss': 3.9336, 'learning_rate': 8.130050205779053e-07, 'epoch': 3.33}

 21%|██        | 77340/371472 [6:09:17<21:53:43,  3.73it/s]
 21%|██        | 77341/371472 [6:09:17<23:10:30,  3.53it/s]
 21%|██        | 77342/371472 [6:09:18<23:08:40,  3.53it/s]
 21%|██        | 77343/371472 [6:09:18<22:16:57,  3.67it/s]
 21%|██        | 77344/371472 [6:09:18<22:48:34,  3.58it/s]
 21%|██        | 77345/371472 [6:09:19<23:10:41,  3.52it/s]
 21%|██        | 77346/371472 [6:09:19<25:03:00,  3.26it/s]
 21%|██        | 77347/371472 [6:09:19<23:52:10,  3.42it/s]
 21%|██        | 77348/371472 [6:09:20<25:28:10,  3.21it/s]
 21%|██        | 77349/371472 [6:09:20<25:35:03,  3.19it/s]
 21%|██        | 77350/371472 [6:09:20<25:01:18,  3.27it/s]
 21%|██        | 77351/371472 [6:09:20<23:36:57,  3.46it/s]
 21%|██        | 77352/371472 [6:09:21<23:32:06,  3.47it/s]
 21%|██        | 77353/371472 [6:09:21<22:41:40,  3.60it/s]
 21%|██        | 77354/371472 [6:09:21<22:34:54,  3.62it/s]
 21%|██        | 77355/371472 [6:09:22<22:20:48,  3.66it/s]
 21%|██        | 77356/371472 [6:09:22<22:02:53,  3.71it/s]
 21%|██        | 77357/371472 [6:09:22<22:25:15,  3.64it/s]
 21%|██        | 77358/371472 [6:09:22<23:11:32,  3.52it/s]
 21%|██        | 77359/371472 [6:09:23<22:44:39,  3.59it/s]
 21%|██        | 77360/371472 [6:09:23<22:02:25,  3.71it/s]
                                                           
{'loss': 4.1124, 'learning_rate': 8.129565386024262e-07, 'epoch': 3.33}

 21%|██        | 77360/371472 [6:09:23<22:02:25,  3.71it/s]
 21%|██        | 77361/371472 [6:09:23<22:05:47,  3.70it/s]
 21%|██        | 77362/371472 [6:09:23<22:34:03,  3.62it/s]
 21%|██        | 77363/371472 [6:09:24<22:56:40,  3.56it/s]
 21%|██        | 77364/371472 [6:09:24<23:05:04,  3.54it/s]
 21%|██        | 77365/371472 [6:09:24<21:57:57,  3.72it/s]
 21%|██        | 77366/371472 [6:09:25<22:13:02,  3.68it/s]
 21%|██        | 77367/371472 [6:09:25<22:01:52,  3.71it/s]
 21%|██        | 77368/371472 [6:09:25<22:51:00,  3.58it/s]
 21%|██        | 77369/371472 [6:09:25<22:44:53,  3.59it/s]
 21%|██        | 77370/371472 [6:09:26<22:19:14,  3.66it/s]
 21%|██        | 77371/371472 [6:09:26<21:54:30,  3.73it/s]
 21%|██        | 77372/371472 [6:09:26<22:38:36,  3.61it/s]
 21%|██        | 77373/371472 [6:09:27<23:15:41,  3.51it/s]
 21%|██        | 77374/371472 [6:09:27<22:32:27,  3.62it/s]
 21%|██        | 77375/371472 [6:09:27<22:05:57,  3.70it/s]
 21%|██        | 77376/371472 [6:09:27<21:27:23,  3.81it/s]
 21%|██        | 77377/371472 [6:09:28<22:32:39,  3.62it/s]
 21%|██        | 77378/371472 [6:09:28<21:43:25,  3.76it/s]
 21%|██        | 77379/371472 [6:09:28<23:35:14,  3.46it/s]
 21%|██        | 77380/371472 [6:09:28<23:36:34,  3.46it/s]
                                                           
{'loss': 4.0678, 'learning_rate': 8.129080566269473e-07, 'epoch': 3.33}

 21%|██        | 77380/371472 [6:09:28<23:36:34,  3.46it/s]
 21%|██        | 77381/371472 [6:09:29<24:11:58,  3.38it/s]
 21%|██        | 77382/371472 [6:09:29<27:49:27,  2.94it/s]
 21%|██        | 77383/371472 [6:09:30<26:57:57,  3.03it/s]
 21%|██        | 77384/371472 [6:09:30<26:17:36,  3.11it/s]
 21%|██        | 77385/371472 [6:09:30<24:45:53,  3.30it/s]
 21%|██        | 77386/371472 [6:09:30<25:16:12,  3.23it/s]
 21%|██        | 77387/371472 [6:09:31<24:25:05,  3.35it/s]
 21%|██        | 77388/371472 [6:09:31<24:02:40,  3.40it/s]
 21%|██        | 77389/371472 [6:09:31<22:35:07,  3.62it/s]
 21%|██        | 77390/371472 [6:09:31<22:29:47,  3.63it/s]
 21%|██        | 77391/371472 [6:09:32<23:20:42,  3.50it/s]
 21%|██        | 77392/371472 [6:09:32<22:40:30,  3.60it/s]
 21%|██        | 77393/371472 [6:09:32<22:55:57,  3.56it/s]
 21%|██        | 77394/371472 [6:09:33<22:36:16,  3.61it/s]
 21%|██        | 77395/371472 [6:09:33<24:21:07,  3.35it/s]
 21%|██        | 77396/371472 [6:09:33<24:37:59,  3.32it/s]
 21%|██        | 77397/371472 [6:09:34<25:19:00,  3.23it/s]
 21%|██        | 77398/371472 [6:09:34<24:55:33,  3.28it/s]
 21%|██        | 77399/371472 [6:09:34<24:33:44,  3.33it/s]
 21%|██        | 77400/371472 [6:09:34<23:15:36,  3.51it/s]
                                                           
{'loss': 4.011, 'learning_rate': 8.128595746514684e-07, 'epoch': 3.33}

 21%|██        | 77400/371472 [6:09:34<23:15:36,  3.51it/s]
 21%|██        | 77401/371472 [6:09:35<23:04:41,  3.54it/s]
 21%|██        | 77402/371472 [6:09:35<22:33:16,  3.62it/s]
 21%|██        | 77403/371472 [6:09:35<21:59:07,  3.72it/s]
 21%|██        | 77404/371472 [6:09:36<23:04:51,  3.54it/s]
 21%|██        | 77405/371472 [6:09:36<22:31:55,  3.63it/s]
 21%|██        | 77406/371472 [6:09:36<23:28:46,  3.48it/s]
 21%|██        | 77407/371472 [6:09:36<23:22:40,  3.49it/s]
 21%|██        | 77408/371472 [6:09:37<22:47:56,  3.58it/s]
 21%|██        | 77409/371472 [6:09:37<22:39:01,  3.61it/s]
 21%|██        | 77410/371472 [6:09:37<23:34:13,  3.47it/s]
 21%|██        | 77411/371472 [6:09:37<22:16:25,  3.67it/s]
 21%|██        | 77412/371472 [6:09:38<21:49:26,  3.74it/s]
 21%|██        | 77413/371472 [6:09:38<21:36:12,  3.78it/s]
 21%|██        | 77414/371472 [6:09:38<23:12:41,  3.52it/s]
 21%|██        | 77415/371472 [6:09:39<23:42:09,  3.45it/s]
 21%|██        | 77416/371472 [6:09:39<22:48:41,  3.58it/s]
 21%|██        | 77417/371472 [6:09:39<22:17:06,  3.67it/s]
 21%|██        | 77418/371472 [6:09:39<21:55:32,  3.73it/s]
 21%|██        | 77419/371472 [6:09:40<23:20:52,  3.50it/s]
 21%|██        | 77420/371472 [6:09:40<24:17:21,  3.36it/s]
                                                           
{'loss': 4.171, 'learning_rate': 8.128110926759895e-07, 'epoch': 3.33}

 21%|██        | 77420/371472 [6:09:40<24:17:21,  3.36it/s]
 21%|██        | 77421/371472 [6:09:40<23:46:03,  3.44it/s]
 21%|██        | 77422/371472 [6:09:41<22:30:35,  3.63it/s]
 21%|██        | 77423/371472 [6:09:41<24:09:14,  3.38it/s]
 21%|██        | 77424/371472 [6:09:41<23:48:09,  3.43it/s]
 21%|██        | 77425/371472 [6:09:41<24:16:37,  3.36it/s]
 21%|██        | 77426/371472 [6:09:42<23:47:56,  3.43it/s]
 21%|██        | 77427/371472 [6:09:42<23:35:11,  3.46it/s]
 21%|██        | 77428/371472 [6:09:42<23:14:20,  3.51it/s]
 21%|██        | 77429/371472 [6:09:43<22:35:52,  3.61it/s]
 21%|██        | 77430/371472 [6:09:43<22:22:45,  3.65it/s]
 21%|██        | 77431/371472 [6:09:43<21:53:58,  3.73it/s]
 21%|██        | 77432/371472 [6:09:43<21:32:50,  3.79it/s]
 21%|██        | 77433/371472 [6:09:44<21:23:35,  3.82it/s]
 21%|██        | 77434/371472 [6:09:44<21:35:22,  3.78it/s]
 21%|██        | 77435/371472 [6:09:44<22:47:09,  3.58it/s]
 21%|██        | 77436/371472 [6:09:44<22:04:55,  3.70it/s]
 21%|██        | 77437/371472 [6:09:45<22:10:03,  3.68it/s]
 21%|██        | 77438/371472 [6:09:45<22:53:29,  3.57it/s]
 21%|██        | 77439/371472 [6:09:45<23:10:08,  3.53it/s]
 21%|██        | 77440/371472 [6:09:46<22:22:31,  3.65it/s]
                                                           
{'loss': 4.1553, 'learning_rate': 8.127626107005106e-07, 'epoch': 3.34}

 21%|██        | 77440/371472 [6:09:46<22:22:31,  3.65it/s]
 21%|██        | 77441/371472 [6:09:46<22:05:35,  3.70it/s]
 21%|██        | 77442/371472 [6:09:46<21:56:44,  3.72it/s]
 21%|██        | 77443/371472 [6:09:46<23:59:37,  3.40it/s]
 21%|██        | 77444/371472 [6:09:47<22:53:57,  3.57it/s]
 21%|██        | 77445/371472 [6:09:47<22:47:55,  3.58it/s]
 21%|██        | 77446/371472 [6:09:47<22:38:09,  3.61it/s]
 21%|██        | 77447/371472 [6:09:47<21:59:36,  3.71it/s]
 21%|██        | 77448/371472 [6:09:48<21:36:14,  3.78it/s]
 21%|██        | 77449/371472 [6:09:48<21:19:14,  3.83it/s]
 21%|██        | 77450/371472 [6:09:48<22:49:13,  3.58it/s]
 21%|██        | 77451/371472 [6:09:49<22:41:12,  3.60it/s]
 21%|██        | 77452/371472 [6:09:49<23:38:38,  3.45it/s]
 21%|██        | 77453/371472 [6:09:49<22:51:04,  3.57it/s]
 21%|██        | 77454/371472 [6:09:49<21:55:33,  3.72it/s]
 21%|██        | 77455/371472 [6:09:50<23:08:06,  3.53it/s]
 21%|██        | 77456/371472 [6:09:50<23:22:32,  3.49it/s]
 21%|██        | 77457/371472 [6:09:50<24:58:57,  3.27it/s]
 21%|██        | 77458/371472 [6:09:51<23:15:56,  3.51it/s]
 21%|██        | 77459/371472 [6:09:51<23:29:21,  3.48it/s]
 21%|██        | 77460/371472 [6:09:51<22:29:44,  3.63it/s]
                                                           
{'loss': 4.1368, 'learning_rate': 8.127141287250318e-07, 'epoch': 3.34}

 21%|██        | 77460/371472 [6:09:51<22:29:44,  3.63it/s]
 21%|██        | 77461/371472 [6:09:51<22:13:24,  3.67it/s]
 21%|██        | 77462/371472 [6:09:52<22:10:04,  3.68it/s]
 21%|██        | 77463/371472 [6:09:52<22:41:38,  3.60it/s]
 21%|██        | 77464/371472 [6:09:52<21:48:52,  3.74it/s]
 21%|██        | 77465/371472 [6:09:52<22:03:54,  3.70it/s]
 21%|██        | 77466/371472 [6:09:53<21:25:16,  3.81it/s]
 21%|██        | 77467/371472 [6:09:53<21:40:55,  3.77it/s]
 21%|██        | 77468/371472 [6:09:53<21:42:20,  3.76it/s]
 21%|██        | 77469/371472 [6:09:54<21:09:21,  3.86it/s]
 21%|██        | 77470/371472 [6:09:54<21:09:38,  3.86it/s]
 21%|██        | 77471/371472 [6:09:54<22:02:48,  3.70it/s]
 21%|██        | 77472/371472 [6:09:54<22:41:20,  3.60it/s]
 21%|██        | 77473/371472 [6:09:55<23:45:09,  3.44it/s]
 21%|██        | 77474/371472 [6:09:55<25:06:14,  3.25it/s]
 21%|██        | 77475/371472 [6:09:55<24:42:38,  3.30it/s]
 21%|██        | 77476/371472 [6:09:56<23:40:16,  3.45it/s]
 21%|██        | 77477/371472 [6:09:56<26:16:43,  3.11it/s]
 21%|██        | 77478/371472 [6:09:56<25:29:35,  3.20it/s]
 21%|██        | 77479/371472 [6:09:57<25:25:34,  3.21it/s]
 21%|██        | 77480/371472 [6:09:57<25:28:55,  3.20it/s]
                                                           
{'loss': 3.9005, 'learning_rate': 8.126656467495529e-07, 'epoch': 3.34}

 21%|██        | 77480/371472 [6:09:57<25:28:55,  3.20it/s]
 21%|██        | 77481/371472 [6:09:57<26:01:17,  3.14it/s]
 21%|██        | 77482/371472 [6:09:58<28:09:49,  2.90it/s]
 21%|██        | 77483/371472 [6:09:58<25:54:25,  3.15it/s]
 21%|██        | 77484/371472 [6:09:58<24:45:10,  3.30it/s]
 21%|██        | 77485/371472 [6:09:58<23:43:10,  3.44it/s]
 21%|██        | 77486/371472 [6:09:59<23:14:42,  3.51it/s]
 21%|██        | 77487/371472 [6:09:59<22:55:53,  3.56it/s]
 21%|██        | 77488/371472 [6:09:59<22:07:10,  3.69it/s]
 21%|██        | 77489/371472 [6:10:00<24:14:32,  3.37it/s]
 21%|██        | 77490/371472 [6:10:00<25:11:09,  3.24it/s]
 21%|██        | 77491/371472 [6:10:00<24:19:50,  3.36it/s]
 21%|██        | 77492/371472 [6:10:00<23:55:57,  3.41it/s]
 21%|██        | 77493/371472 [6:10:01<22:52:04,  3.57it/s]
 21%|██        | 77494/371472 [6:10:01<23:47:44,  3.43it/s]
 21%|██        | 77495/371472 [6:10:01<24:20:05,  3.36it/s]
 21%|██        | 77496/371472 [6:10:02<24:04:28,  3.39it/s]
 21%|██        | 77497/371472 [6:10:02<23:32:58,  3.47it/s]
 21%|██        | 77498/371472 [6:10:02<23:13:26,  3.52it/s]
 21%|██        | 77499/371472 [6:10:02<23:10:47,  3.52it/s]
 21%|██        | 77500/371472 [6:10:03<25:05:40,  3.25it/s]
                                                           
{'loss': 4.0312, 'learning_rate': 8.126171647740739e-07, 'epoch': 3.34}

 21%|██        | 77500/371472 [6:10:03<25:05:40,  3.25it/s]
 21%|██        | 77501/371472 [6:10:03<23:20:39,  3.50it/s]
 21%|██        | 77502/371472 [6:10:03<22:47:07,  3.58it/s]
 21%|██        | 77503/371472 [6:10:04<21:45:58,  3.75it/s]
 21%|██        | 77504/371472 [6:10:04<23:22:30,  3.49it/s]
 21%|██        | 77505/371472 [6:10:04<23:33:19,  3.47it/s]
 21%|██        | 77506/371472 [6:10:04<23:01:48,  3.55it/s]
 21%|██        | 77507/371472 [6:10:05<23:50:38,  3.42it/s]
 21%|██        | 77508/371472 [6:10:05<23:00:10,  3.55it/s]
 21%|██        | 77509/371472 [6:10:05<23:58:19,  3.41it/s]
 21%|██        | 77510/371472 [6:10:06<23:52:02,  3.42it/s]
 21%|██        | 77511/371472 [6:10:06<24:35:59,  3.32it/s]
 21%|██        | 77512/371472 [6:10:06<24:08:34,  3.38it/s]
 21%|██        | 77513/371472 [6:10:07<24:32:30,  3.33it/s]
 21%|██        | 77514/371472 [6:10:07<24:07:08,  3.39it/s]
 21%|██        | 77515/371472 [6:10:07<22:59:55,  3.55it/s]
 21%|██        | 77516/371472 [6:10:07<24:12:50,  3.37it/s]
 21%|██        | 77517/371472 [6:10:08<24:40:26,  3.31it/s]
 21%|██        | 77518/371472 [6:10:08<23:58:10,  3.41it/s]
 21%|██        | 77519/371472 [6:10:08<22:50:05,  3.58it/s]
 21%|██        | 77520/371472 [6:10:09<23:08:34,  3.53it/s]
                                                           
{'loss': 4.1016, 'learning_rate': 8.12568682798595e-07, 'epoch': 3.34}

 21%|██        | 77520/371472 [6:10:09<23:08:34,  3.53it/s]
 21%|██        | 77521/371472 [6:10:09<22:48:44,  3.58it/s]
 21%|██        | 77522/371472 [6:10:09<23:37:50,  3.46it/s]
 21%|██        | 77523/371472 [6:10:09<24:47:39,  3.29it/s]
 21%|██        | 77524/371472 [6:10:10<24:40:18,  3.31it/s]
 21%|██        | 77525/371472 [6:10:10<23:49:38,  3.43it/s]
 21%|██        | 77526/371472 [6:10:10<23:43:33,  3.44it/s]
 21%|██        | 77527/371472 [6:10:11<22:47:01,  3.58it/s]
 21%|██        | 77528/371472 [6:10:11<23:00:51,  3.55it/s]
 21%|██        | 77529/371472 [6:10:11<23:39:35,  3.45it/s]
 21%|██        | 77530/371472 [6:10:11<22:48:20,  3.58it/s]
 21%|██        | 77531/371472 [6:10:12<22:31:35,  3.62it/s]
 21%|██        | 77532/371472 [6:10:12<23:07:04,  3.53it/s]
 21%|██        | 77533/371472 [6:10:12<23:09:48,  3.52it/s]
 21%|██        | 77534/371472 [6:10:13<22:33:52,  3.62it/s]
 21%|██        | 77535/371472 [6:10:13<21:50:32,  3.74it/s]
 21%|██        | 77536/371472 [6:10:13<23:15:53,  3.51it/s]
 21%|██        | 77537/371472 [6:10:13<22:56:47,  3.56it/s]
 21%|██        | 77538/371472 [6:10:14<21:47:09,  3.75it/s]
 21%|██        | 77539/371472 [6:10:14<21:54:45,  3.73it/s]
 21%|██        | 77540/371472 [6:10:14<24:29:51,  3.33it/s]
                                                           
{'loss': 4.2076, 'learning_rate': 8.125202008231162e-07, 'epoch': 3.34}

 21%|██        | 77540/371472 [6:10:14<24:29:51,  3.33it/s]
 21%|██        | 77541/371472 [6:10:15<24:20:53,  3.35it/s]
 21%|██        | 77542/371472 [6:10:15<23:06:31,  3.53it/s]
 21%|██        | 77543/371472 [6:10:15<22:10:04,  3.68it/s]
 21%|██        | 77544/371472 [6:10:15<22:04:18,  3.70it/s]
 21%|██        | 77545/371472 [6:10:16<22:34:13,  3.62it/s]
 21%|██        | 77546/371472 [6:10:16<22:16:39,  3.66it/s]
 21%|██        | 77547/371472 [6:10:16<21:18:56,  3.83it/s]
 21%|██        | 77548/371472 [6:10:16<21:49:27,  3.74it/s]
 21%|██        | 77549/371472 [6:10:17<21:37:47,  3.77it/s]
 21%|██        | 77550/371472 [6:10:17<22:29:45,  3.63it/s]
 21%|██        | 77551/371472 [6:10:17<22:25:45,  3.64it/s]
 21%|██        | 77552/371472 [6:10:17<21:43:42,  3.76it/s]
 21%|██        | 77553/371472 [6:10:18<22:13:04,  3.67it/s]
 21%|██        | 77554/371472 [6:10:18<22:42:35,  3.60it/s]
 21%|██        | 77555/371472 [6:10:18<22:48:53,  3.58it/s]
 21%|██        | 77556/371472 [6:10:19<22:14:14,  3.67it/s]
 21%|██        | 77557/371472 [6:10:19<21:44:24,  3.76it/s]
 21%|██        | 77558/371472 [6:10:19<21:19:38,  3.83it/s]
 21%|██        | 77559/371472 [6:10:19<21:08:23,  3.86it/s]
 21%|██        | 77560/371472 [6:10:20<21:01:50,  3.88it/s]
                                                           
{'loss': 4.1423, 'learning_rate': 8.124717188476373e-07, 'epoch': 3.34}

 21%|██        | 77560/371472 [6:10:20<21:01:50,  3.88it/s]
 21%|██        | 77561/371472 [6:10:20<20:51:28,  3.91it/s]
 21%|██        | 77562/371472 [6:10:20<20:57:16,  3.90it/s]
 21%|██        | 77563/371472 [6:10:20<21:42:31,  3.76it/s]
 21%|██        | 77564/371472 [6:10:21<21:40:39,  3.77it/s]
 21%|██        | 77565/371472 [6:10:21<21:11:50,  3.85it/s]
 21%|██        | 77566/371472 [6:10:21<21:04:04,  3.88it/s]
 21%|██        | 77567/371472 [6:10:21<21:34:10,  3.78it/s]
 21%|██        | 77568/371472 [6:10:22<22:35:10,  3.61it/s]
 21%|██        | 77569/371472 [6:10:22<24:37:48,  3.31it/s]
 21%|██        | 77570/371472 [6:10:22<23:55:12,  3.41it/s]
 21%|██        | 77571/371472 [6:10:23<24:25:42,  3.34it/s]
 21%|██        | 77572/371472 [6:10:23<23:57:17,  3.41it/s]
 21%|██        | 77573/371472 [6:10:23<25:14:28,  3.23it/s]
 21%|██        | 77574/371472 [6:10:24<23:33:40,  3.46it/s]
 21%|██        | 77575/371472 [6:10:24<25:14:37,  3.23it/s]
 21%|██        | 77576/371472 [6:10:24<23:35:44,  3.46it/s]
 21%|██        | 77577/371472 [6:10:24<23:15:48,  3.51it/s]
 21%|██        | 77578/371472 [6:10:25<24:25:40,  3.34it/s]
 21%|██        | 77579/371472 [6:10:25<24:56:20,  3.27it/s]
 21%|██        | 77580/371472 [6:10:25<23:19:54,  3.50it/s]
                                                           
{'loss': 4.0852, 'learning_rate': 8.124232368721584e-07, 'epoch': 3.34}

 21%|██        | 77580/371472 [6:10:25<23:19:54,  3.50it/s]
 21%|██        | 77581/371472 [6:10:26<23:23:30,  3.49it/s]
 21%|██        | 77582/371472 [6:10:26<23:15:31,  3.51it/s]
 21%|██        | 77583/371472 [6:10:26<22:33:53,  3.62it/s]
 21%|██        | 77584/371472 [6:10:26<22:09:40,  3.68it/s]
 21%|██        | 77585/371472 [6:10:27<21:56:07,  3.72it/s]
 21%|██        | 77586/371472 [6:10:27<21:26:27,  3.81it/s]
 21%|██        | 77587/371472 [6:10:27<22:09:07,  3.69it/s]
 21%|██        | 77588/371472 [6:10:27<22:40:45,  3.60it/s]
 21%|██        | 77589/371472 [6:10:28<23:25:16,  3.49it/s]
 21%|██        | 77590/371472 [6:10:28<22:27:43,  3.63it/s]
 21%|██        | 77591/371472 [6:10:28<22:42:07,  3.60it/s]
 21%|██        | 77592/371472 [6:10:29<21:54:56,  3.72it/s]
 21%|██        | 77593/371472 [6:10:29<22:08:47,  3.69it/s]
 21%|██        | 77594/371472 [6:10:29<23:34:53,  3.46it/s]
 21%|██        | 77595/371472 [6:10:29<23:46:23,  3.43it/s]
 21%|██        | 77596/371472 [6:10:30<23:47:05,  3.43it/s]
 21%|██        | 77597/371472 [6:10:30<24:51:30,  3.28it/s]
 21%|██        | 77598/371472 [6:10:30<25:04:29,  3.26it/s]
 21%|██        | 77599/371472 [6:10:31<24:01:37,  3.40it/s]
 21%|██        | 77600/371472 [6:10:31<24:26:41,  3.34it/s]
                                                           
{'loss': 4.0709, 'learning_rate': 8.123747548966795e-07, 'epoch': 3.34}

 21%|██        | 77600/371472 [6:10:31<24:26:41,  3.34it/s]
 21%|██        | 77601/371472 [6:10:31<23:42:06,  3.44it/s]
 21%|██        | 77602/371472 [6:10:32<22:35:38,  3.61it/s]
 21%|██        | 77603/371472 [6:10:32<22:16:13,  3.67it/s]
 21%|██        | 77604/371472 [6:10:32<21:41:00,  3.76it/s]
 21%|██        | 77605/371472 [6:10:32<21:25:42,  3.81it/s]
 21%|██        | 77606/371472 [6:10:33<21:33:14,  3.79it/s]
 21%|██        | 77607/371472 [6:10:33<21:11:22,  3.85it/s]
 21%|██        | 77608/371472 [6:10:33<21:40:55,  3.76it/s]
 21%|██        | 77609/371472 [6:10:33<21:20:21,  3.83it/s]
 21%|██        | 77610/371472 [6:10:34<22:30:59,  3.63it/s]
 21%|██        | 77611/371472 [6:10:34<22:15:33,  3.67it/s]
 21%|██        | 77612/371472 [6:10:34<23:21:17,  3.50it/s]
 21%|██        | 77613/371472 [6:10:35<24:37:05,  3.32it/s]
 21%|██        | 77614/371472 [6:10:35<24:13:31,  3.37it/s]
 21%|██        | 77615/371472 [6:10:35<23:29:18,  3.48it/s]
 21%|██        | 77616/371472 [6:10:35<22:36:47,  3.61it/s]
 21%|██        | 77617/371472 [6:10:36<21:44:16,  3.76it/s]
 21%|██        | 77618/371472 [6:10:36<23:25:09,  3.49it/s]
 21%|██        | 77619/371472 [6:10:36<25:02:36,  3.26it/s]
 21%|██        | 77620/371472 [6:10:37<24:03:21,  3.39it/s]
                                                           
{'loss': 4.0597, 'learning_rate': 8.123262729212006e-07, 'epoch': 3.34}

 21%|██        | 77620/371472 [6:10:37<24:03:21,  3.39it/s]
 21%|██        | 77621/371472 [6:10:37<24:46:11,  3.30it/s]
 21%|██        | 77622/371472 [6:10:37<24:07:53,  3.38it/s]
 21%|██        | 77623/371472 [6:10:37<23:37:00,  3.46it/s]
 21%|██        | 77624/371472 [6:10:38<23:43:27,  3.44it/s]
 21%|██        | 77625/371472 [6:10:38<22:38:39,  3.60it/s]
 21%|██        | 77626/371472 [6:10:38<23:43:37,  3.44it/s]
 21%|██        | 77627/371472 [6:10:39<23:13:53,  3.51it/s]
 21%|██        | 77628/371472 [6:10:39<23:22:59,  3.49it/s]
 21%|██        | 77629/371472 [6:10:39<22:32:30,  3.62it/s]
 21%|██        | 77630/371472 [6:10:39<21:48:19,  3.74it/s]
 21%|██        | 77631/371472 [6:10:40<22:57:21,  3.56it/s]
 21%|██        | 77632/371472 [6:10:40<22:34:48,  3.61it/s]
 21%|██        | 77633/371472 [6:10:40<22:06:52,  3.69it/s]
 21%|██        | 77634/371472 [6:10:40<21:23:22,  3.82it/s]
 21%|██        | 77635/371472 [6:10:41<21:14:48,  3.84it/s]
 21%|██        | 77636/371472 [6:10:41<21:03:51,  3.87it/s]
 21%|██        | 77637/371472 [6:10:41<21:52:15,  3.73it/s]
 21%|██        | 77638/371472 [6:10:42<23:55:51,  3.41it/s]
 21%|██        | 77639/371472 [6:10:42<24:10:33,  3.38it/s]
 21%|██        | 77640/371472 [6:10:42<23:50:10,  3.42it/s]
                                                           
{'loss': 4.1672, 'learning_rate': 8.122777909457217e-07, 'epoch': 3.34}

 21%|██        | 77640/371472 [6:10:42<23:50:10,  3.42it/s]
 21%|██        | 77641/371472 [6:10:42<23:29:44,  3.47it/s]
 21%|██        | 77642/371472 [6:10:43<22:35:06,  3.61it/s]
 21%|██        | 77643/371472 [6:10:43<24:35:47,  3.32it/s]
 21%|██        | 77644/371472 [6:10:43<24:57:07,  3.27it/s]
 21%|██        | 77645/371472 [6:10:44<24:01:42,  3.40it/s]
 21%|██        | 77646/371472 [6:10:44<23:59:27,  3.40it/s]
 21%|██        | 77647/371472 [6:10:44<23:21:25,  3.49it/s]
 21%|██        | 77648/371472 [6:10:44<22:57:34,  3.55it/s]
 21%|██        | 77649/371472 [6:10:45<23:20:24,  3.50it/s]
 21%|██        | 77650/371472 [6:10:45<22:59:15,  3.55it/s]
 21%|██        | 77651/371472 [6:10:45<22:24:48,  3.64it/s]
 21%|██        | 77652/371472 [6:10:46<21:22:34,  3.82it/s]
 21%|██        | 77653/371472 [6:10:46<21:33:39,  3.79it/s]
 21%|██        | 77654/371472 [6:10:46<23:12:45,  3.52it/s]
 21%|██        | 77655/371472 [6:10:46<22:49:22,  3.58it/s]
 21%|██        | 77656/371472 [6:10:47<24:02:27,  3.39it/s]
 21%|██        | 77657/371472 [6:10:47<23:17:00,  3.51it/s]
 21%|██        | 77658/371472 [6:10:47<24:20:59,  3.35it/s]
 21%|██        | 77659/371472 [6:10:48<23:24:06,  3.49it/s]
 21%|██        | 77660/371472 [6:10:48<23:03:29,  3.54it/s]
                                                           
{'loss': 4.0025, 'learning_rate': 8.122293089702428e-07, 'epoch': 3.34}

 21%|██        | 77660/371472 [6:10:48<23:03:29,  3.54it/s]
 21%|██        | 77661/371472 [6:10:48<23:49:50,  3.42it/s]
 21%|██        | 77662/371472 [6:10:48<22:57:50,  3.55it/s]
 21%|██        | 77663/371472 [6:10:49<22:16:43,  3.66it/s]
 21%|██        | 77664/371472 [6:10:49<21:42:39,  3.76it/s]
 21%|██        | 77665/371472 [6:10:49<21:44:29,  3.75it/s]
 21%|██        | 77666/371472 [6:10:50<23:44:04,  3.44it/s]
 21%|██        | 77667/371472 [6:10:50<22:36:52,  3.61it/s]
 21%|██        | 77668/371472 [6:10:50<21:28:33,  3.80it/s]
 21%|██        | 77669/371472 [6:10:50<21:28:01,  3.80it/s]
 21%|██        | 77670/371472 [6:10:51<21:19:54,  3.83it/s]
 21%|██        | 77671/371472 [6:10:51<22:48:13,  3.58it/s]
 21%|██        | 77672/371472 [6:10:51<23:05:44,  3.53it/s]
 21%|██        | 77673/371472 [6:10:51<22:52:17,  3.57it/s]
 21%|██        | 77674/371472 [6:10:52<22:43:52,  3.59it/s]
 21%|██        | 77675/371472 [6:10:52<22:29:18,  3.63it/s]
 21%|██        | 77676/371472 [6:10:52<22:47:15,  3.58it/s]
 21%|██        | 77677/371472 [6:10:53<23:18:21,  3.50it/s]
 21%|██        | 77678/371472 [6:10:53<23:22:26,  3.49it/s]
 21%|██        | 77679/371472 [6:10:53<23:48:18,  3.43it/s]
 21%|██        | 77680/371472 [6:10:53<25:13:26,  3.24it/s]
                                                           
{'loss': 4.0862, 'learning_rate': 8.121808269947639e-07, 'epoch': 3.35}

 21%|██        | 77680/371472 [6:10:54<25:13:26,  3.24it/s]
 21%|██        | 77681/371472 [6:10:54<25:53:20,  3.15it/s]
 21%|██        | 77682/371472 [6:10:54<24:02:10,  3.40it/s]
 21%|██        | 77683/371472 [6:10:54<22:59:02,  3.55it/s]
 21%|██        | 77684/371472 [6:10:55<22:32:08,  3.62it/s]
 21%|██        | 77685/371472 [6:10:55<22:43:08,  3.59it/s]
 21%|██        | 77686/371472 [6:10:55<23:34:57,  3.46it/s]
 21%|██        | 77687/371472 [6:10:55<22:26:02,  3.64it/s]
 21%|██        | 77688/371472 [6:10:56<21:42:43,  3.76it/s]
 21%|██        | 77689/371472 [6:10:56<21:45:59,  3.75it/s]
 21%|██        | 77690/371472 [6:10:56<23:37:54,  3.45it/s]
 21%|██        | 77691/371472 [6:10:57<24:09:59,  3.38it/s]
 21%|██        | 77692/371472 [6:10:57<23:30:52,  3.47it/s]
 21%|██        | 77693/371472 [6:10:57<22:52:39,  3.57it/s]
 21%|██        | 77694/371472 [6:10:57<21:59:18,  3.71it/s]
 21%|██        | 77695/371472 [6:10:58<23:17:59,  3.50it/s]
 21%|██        | 77696/371472 [6:10:58<22:41:44,  3.60it/s]
 21%|██        | 77697/371472 [6:10:58<23:11:13,  3.52it/s]
 21%|██        | 77698/371472 [6:10:59<23:02:09,  3.54it/s]
 21%|██        | 77699/371472 [6:10:59<22:21:05,  3.65it/s]
 21%|██        | 77700/371472 [6:10:59<22:33:20,  3.62it/s]
                                                           
{'loss': 4.168, 'learning_rate': 8.12132345019285e-07, 'epoch': 3.35}

 21%|██        | 77700/371472 [6:10:59<22:33:20,  3.62it/s]
 21%|██        | 77701/371472 [6:10:59<22:01:40,  3.70it/s]
 21%|██        | 77702/371472 [6:11:00<21:31:38,  3.79it/s]
 21%|██        | 77703/371472 [6:11:00<24:31:43,  3.33it/s]
 21%|██        | 77704/371472 [6:11:00<23:12:18,  3.52it/s]
 21%|██        | 77705/371472 [6:11:00<22:31:36,  3.62it/s]
 21%|██        | 77706/371472 [6:11:01<22:38:36,  3.60it/s]
 21%|██        | 77707/371472 [6:11:01<22:21:51,  3.65it/s]
 21%|██        | 77708/371472 [6:11:01<22:34:41,  3.61it/s]
 21%|██        | 77709/371472 [6:11:02<21:52:35,  3.73it/s]
 21%|██        | 77710/371472 [6:11:02<21:36:47,  3.78it/s]
 21%|██        | 77711/371472 [6:11:02<21:33:32,  3.78it/s]
 21%|██        | 77712/371472 [6:11:02<22:14:37,  3.67it/s]
 21%|██        | 77713/371472 [6:11:03<21:56:55,  3.72it/s]
 21%|██        | 77714/371472 [6:11:03<21:08:20,  3.86it/s]
 21%|██        | 77715/371472 [6:11:03<23:52:58,  3.42it/s]
 21%|██        | 77716/371472 [6:11:03<23:03:43,  3.54it/s]
 21%|██        | 77717/371472 [6:11:04<22:24:21,  3.64it/s]
 21%|██        | 77718/371472 [6:11:04<21:40:00,  3.77it/s]
 21%|██        | 77719/371472 [6:11:04<21:12:45,  3.85it/s]
 21%|██        | 77720/371472 [6:11:05<22:05:01,  3.69it/s]
                                                           
{'loss': 4.3096, 'learning_rate': 8.120838630438061e-07, 'epoch': 3.35}

 21%|██        | 77720/371472 [6:11:05<22:05:01,  3.69it/s]
 21%|██        | 77721/371472 [6:11:05<22:34:36,  3.61it/s]
 21%|██        | 77722/371472 [6:11:05<21:40:49,  3.76it/s]
 21%|██        | 77723/371472 [6:11:05<21:05:57,  3.87it/s]
 21%|██        | 77724/371472 [6:11:06<22:39:09,  3.60it/s]
 21%|██        | 77725/371472 [6:11:06<24:01:57,  3.40it/s]
 21%|██        | 77726/371472 [6:11:06<23:45:48,  3.43it/s]
 21%|██        | 77727/371472 [6:11:06<22:40:03,  3.60it/s]
 21%|██        | 77728/371472 [6:11:07<22:14:53,  3.67it/s]
 21%|██        | 77729/371472 [6:11:07<22:47:10,  3.58it/s]
 21%|██        | 77730/371472 [6:11:07<22:43:37,  3.59it/s]
 21%|██        | 77731/371472 [6:11:08<22:21:57,  3.65it/s]
 21%|██        | 77732/371472 [6:11:08<22:56:33,  3.56it/s]
 21%|██        | 77733/371472 [6:11:08<23:53:05,  3.42it/s]
 21%|██        | 77734/371472 [6:11:09<24:25:46,  3.34it/s]
 21%|██        | 77735/371472 [6:11:09<25:37:18,  3.18it/s]
 21%|██        | 77736/371472 [6:11:09<23:47:52,  3.43it/s]
 21%|██        | 77737/371472 [6:11:09<25:33:30,  3.19it/s]
 21%|██        | 77738/371472 [6:11:10<23:40:36,  3.45it/s]
 21%|██        | 77739/371472 [6:11:10<22:47:09,  3.58it/s]
 21%|██        | 77740/371472 [6:11:10<23:02:00,  3.54it/s]
                                                           
{'loss': 4.2381, 'learning_rate': 8.120353810683273e-07, 'epoch': 3.35}

 21%|██        | 77740/371472 [6:11:10<23:02:00,  3.54it/s]
 21%|██        | 77741/371472 [6:11:11<25:02:49,  3.26it/s]
 21%|██        | 77742/371472 [6:11:11<26:35:23,  3.07it/s]
 21%|██        | 77743/371472 [6:11:11<27:33:03,  2.96it/s]
 21%|██        | 77744/371472 [6:11:12<27:15:12,  2.99it/s]
 21%|██        | 77745/371472 [6:11:12<25:48:35,  3.16it/s]
 21%|██        | 77746/371472 [6:11:12<24:21:06,  3.35it/s]
 21%|██        | 77747/371472 [6:11:12<23:58:53,  3.40it/s]
 21%|██        | 77748/371472 [6:11:13<24:07:08,  3.38it/s]
 21%|██        | 77749/371472 [6:11:13<23:39:38,  3.45it/s]
 21%|██        | 77750/371472 [6:11:13<23:08:05,  3.53it/s]
 21%|██        | 77751/371472 [6:11:14<22:14:44,  3.67it/s]
 21%|██        | 77752/371472 [6:11:14<23:13:31,  3.51it/s]
 21%|██        | 77753/371472 [6:11:14<23:59:49,  3.40it/s]
 21%|██        | 77754/371472 [6:11:15<24:12:24,  3.37it/s]
 21%|██        | 77755/371472 [6:11:15<23:41:41,  3.44it/s]
 21%|██        | 77756/371472 [6:11:15<24:30:12,  3.33it/s]
 21%|██        | 77757/371472 [6:11:15<23:51:24,  3.42it/s]
 21%|██        | 77758/371472 [6:11:16<23:37:46,  3.45it/s]
 21%|██        | 77759/371472 [6:11:16<25:34:33,  3.19it/s]
 21%|██        | 77760/371472 [6:11:16<24:42:58,  3.30it/s]
                                                           
{'loss': 3.9373, 'learning_rate': 8.119868990928483e-07, 'epoch': 3.35}

 21%|██        | 77760/371472 [6:11:16<24:42:58,  3.30it/s]
 21%|██        | 77761/371472 [6:11:17<23:53:29,  3.41it/s]
 21%|██        | 77762/371472 [6:11:17<22:37:12,  3.61it/s]
 21%|██        | 77763/371472 [6:11:17<22:43:16,  3.59it/s]
 21%|██        | 77764/371472 [6:11:17<22:08:26,  3.68it/s]
 21%|██        | 77765/371472 [6:11:18<22:17:45,  3.66it/s]
 21%|██        | 77766/371472 [6:11:18<22:22:33,  3.65it/s]
 21%|██        | 77767/371472 [6:11:18<22:08:57,  3.68it/s]
 21%|██        | 77768/371472 [6:11:18<21:43:29,  3.76it/s]
 21%|██        | 77769/371472 [6:11:19<22:17:48,  3.66it/s]
 21%|██        | 77770/371472 [6:11:19<22:01:16,  3.70it/s]
 21%|██        | 77771/371472 [6:11:19<22:51:29,  3.57it/s]
 21%|██        | 77772/371472 [6:11:20<22:33:02,  3.62it/s]
 21%|██        | 77773/371472 [6:11:20<21:36:01,  3.78it/s]
 21%|██        | 77774/371472 [6:11:20<22:04:09,  3.70it/s]
 21%|██        | 77775/371472 [6:11:20<22:51:51,  3.57it/s]
 21%|██        | 77776/371472 [6:11:21<22:16:23,  3.66it/s]
 21%|██        | 77777/371472 [6:11:21<21:32:42,  3.79it/s]
 21%|██        | 77778/371472 [6:11:21<22:56:19,  3.56it/s]
 21%|██        | 77779/371472 [6:11:21<22:45:08,  3.59it/s]
 21%|██        | 77780/371472 [6:11:22<23:50:36,  3.42it/s]
                                                           
{'loss': 4.136, 'learning_rate': 8.119384171173694e-07, 'epoch': 3.35}

 21%|██        | 77780/371472 [6:11:22<23:50:36,  3.42it/s]
 21%|██        | 77781/371472 [6:11:22<22:43:14,  3.59it/s]
 21%|██        | 77782/371472 [6:11:22<22:06:27,  3.69it/s]
 21%|██        | 77783/371472 [6:11:23<21:53:19,  3.73it/s]
 21%|██        | 77784/371472 [6:11:23<21:10:11,  3.85it/s]
 21%|██        | 77785/371472 [6:11:23<21:10:03,  3.85it/s]
 21%|██        | 77786/371472 [6:11:23<21:03:44,  3.87it/s]
 21%|██        | 77787/371472 [6:11:24<20:39:48,  3.95it/s]
 21%|██        | 77788/371472 [6:11:24<20:45:27,  3.93it/s]
 21%|██        | 77789/371472 [6:11:24<21:15:47,  3.84it/s]
 21%|██        | 77790/371472 [6:11:24<21:17:44,  3.83it/s]
 21%|██        | 77791/371472 [6:11:25<22:17:52,  3.66it/s]
 21%|██        | 77792/371472 [6:11:25<23:05:20,  3.53it/s]
 21%|██        | 77793/371472 [6:11:25<23:55:38,  3.41it/s]
 21%|██        | 77794/371472 [6:11:26<24:42:56,  3.30it/s]
 21%|██        | 77795/371472 [6:11:26<24:03:08,  3.39it/s]
 21%|██        | 77796/371472 [6:11:26<23:01:40,  3.54it/s]
 21%|██        | 77797/371472 [6:11:26<22:48:57,  3.58it/s]
 21%|██        | 77798/371472 [6:11:27<24:16:57,  3.36it/s]
 21%|██        | 77799/371472 [6:11:27<23:11:29,  3.52it/s]
 21%|██        | 77800/371472 [6:11:27<22:30:40,  3.62it/s]
                                                           
{'loss': 4.0034, 'learning_rate': 8.118899351418905e-07, 'epoch': 3.35}

 21%|██        | 77800/371472 [6:11:27<22:30:40,  3.62it/s]
 21%|██        | 77801/371472 [6:11:28<22:46:44,  3.58it/s]
 21%|██        | 77802/371472 [6:11:28<22:20:24,  3.65it/s]
 21%|██        | 77803/371472 [6:11:28<22:14:17,  3.67it/s]
 21%|██        | 77804/371472 [6:11:28<22:08:42,  3.68it/s]
 21%|██        | 77805/371472 [6:11:29<22:28:09,  3.63it/s]
 21%|██        | 77806/371472 [6:11:29<23:02:29,  3.54it/s]
 21%|██        | 77807/371472 [6:11:29<22:17:00,  3.66it/s]
 21%|██        | 77808/371472 [6:11:29<22:33:41,  3.62it/s]
 21%|██        | 77809/371472 [6:11:30<21:38:11,  3.77it/s]
 21%|██        | 77810/371472 [6:11:30<21:25:33,  3.81it/s]
 21%|██        | 77811/371472 [6:11:30<22:10:22,  3.68it/s]
 21%|██        | 77812/371472 [6:11:31<22:21:11,  3.65it/s]
 21%|██        | 77813/371472 [6:11:31<22:12:08,  3.67it/s]
 21%|██        | 77814/371472 [6:11:31<22:33:44,  3.62it/s]
 21%|██        | 77815/371472 [6:11:31<22:05:06,  3.69it/s]
 21%|██        | 77816/371472 [6:11:32<21:54:28,  3.72it/s]
 21%|██        | 77817/371472 [6:11:32<23:39:03,  3.45it/s]
 21%|██        | 77818/371472 [6:11:32<22:32:32,  3.62it/s]
 21%|██        | 77819/371472 [6:11:33<23:36:45,  3.45it/s]
 21%|██        | 77820/371472 [6:11:33<22:59:55,  3.55it/s]
                                                           
{'loss': 4.0162, 'learning_rate': 8.118414531664117e-07, 'epoch': 3.35}

 21%|██        | 77820/371472 [6:11:33<22:59:55,  3.55it/s]
 21%|██        | 77821/371472 [6:11:33<23:42:32,  3.44it/s]
 21%|██        | 77822/371472 [6:11:33<24:18:27,  3.36it/s]
 21%|██        | 77823/371472 [6:11:34<23:57:23,  3.40it/s]
 21%|██        | 77824/371472 [6:11:34<22:49:48,  3.57it/s]
 21%|██        | 77825/371472 [6:11:34<22:04:06,  3.70it/s]
 21%|██        | 77826/371472 [6:11:34<22:11:43,  3.68it/s]
 21%|██        | 77827/371472 [6:11:35<22:19:41,  3.65it/s]
 21%|██        | 77828/371472 [6:11:35<22:03:32,  3.70it/s]
 21%|██        | 77829/371472 [6:11:35<22:29:30,  3.63it/s]
 21%|██        | 77830/371472 [6:11:36<23:34:20,  3.46it/s]
 21%|██        | 77831/371472 [6:11:36<23:35:12,  3.46it/s]
 21%|██        | 77832/371472 [6:11:36<23:12:31,  3.51it/s]
 21%|██        | 77833/371472 [6:11:36<22:56:14,  3.56it/s]
 21%|██        | 77834/371472 [6:11:37<21:59:25,  3.71it/s]
 21%|██        | 77835/371472 [6:11:37<21:22:06,  3.82it/s]
 21%|██        | 77836/371472 [6:11:37<20:52:38,  3.91it/s]
 21%|██        | 77837/371472 [6:11:37<21:21:28,  3.82it/s]
 21%|██        | 77838/371472 [6:11:38<21:52:25,  3.73it/s]
 21%|██        | 77839/371472 [6:11:38<21:25:34,  3.81it/s]
 21%|██        | 77840/371472 [6:11:38<21:43:20,  3.75it/s]
                                                           
{'loss': 4.0684, 'learning_rate': 8.117929711909328e-07, 'epoch': 3.35}

 21%|██        | 77840/371472 [6:11:38<21:43:20,  3.75it/s]
 21%|██        | 77841/371472 [6:11:39<22:01:51,  3.70it/s]
 21%|██        | 77842/371472 [6:11:39<24:15:37,  3.36it/s]
 21%|██        | 77843/371472 [6:11:39<24:57:10,  3.27it/s]
 21%|██        | 77844/371472 [6:11:39<24:07:04,  3.38it/s]
 21%|██        | 77845/371472 [6:11:40<23:15:25,  3.51it/s]
 21%|██        | 77846/371472 [6:11:40<22:26:39,  3.63it/s]
 21%|██        | 77847/371472 [6:11:40<23:01:00,  3.54it/s]
 21%|██        | 77848/371472 [6:11:41<22:13:53,  3.67it/s]
 21%|██        | 77849/371472 [6:11:41<21:18:46,  3.83it/s]
 21%|██        | 77850/371472 [6:11:41<21:34:44,  3.78it/s]
 21%|██        | 77851/371472 [6:11:41<21:42:42,  3.76it/s]
 21%|██        | 77852/371472 [6:11:42<21:32:31,  3.79it/s]
 21%|██        | 77853/371472 [6:11:42<21:21:52,  3.82it/s]
 21%|██        | 77854/371472 [6:11:42<21:34:34,  3.78it/s]
 21%|██        | 77855/371472 [6:11:42<22:19:40,  3.65it/s]
 21%|██        | 77856/371472 [6:11:43<22:41:52,  3.59it/s]
 21%|██        | 77857/371472 [6:11:43<22:45:47,  3.58it/s]
 21%|██        | 77858/371472 [6:11:43<23:01:03,  3.54it/s]
 21%|██        | 77859/371472 [6:11:44<23:35:19,  3.46it/s]
 21%|██        | 77860/371472 [6:11:44<23:18:42,  3.50it/s]
                                                           
{'loss': 4.2784, 'learning_rate': 8.117444892154539e-07, 'epoch': 3.35}

 21%|██        | 77860/371472 [6:11:44<23:18:42,  3.50it/s]
 21%|██        | 77861/371472 [6:11:44<22:43:08,  3.59it/s]
 21%|██        | 77862/371472 [6:11:44<22:39:03,  3.60it/s]
 21%|██        | 77863/371472 [6:11:45<22:05:17,  3.69it/s]
 21%|██        | 77864/371472 [6:11:45<22:02:22,  3.70it/s]
 21%|██        | 77865/371472 [6:11:45<21:39:36,  3.77it/s]
 21%|██        | 77866/371472 [6:11:45<21:13:02,  3.84it/s]
 21%|██        | 77867/371472 [6:11:46<21:16:38,  3.83it/s]
 21%|██        | 77868/371472 [6:11:46<21:38:17,  3.77it/s]
 21%|██        | 77869/371472 [6:11:46<22:10:39,  3.68it/s]
 21%|██        | 77870/371472 [6:11:47<21:59:41,  3.71it/s]
 21%|██        | 77871/371472 [6:11:47<22:43:07,  3.59it/s]
 21%|██        | 77872/371472 [6:11:47<22:42:55,  3.59it/s]
 21%|██        | 77873/371472 [6:11:47<22:02:50,  3.70it/s]
 21%|██        | 77874/371472 [6:11:48<22:47:38,  3.58it/s]
 21%|██        | 77875/371472 [6:11:48<22:39:38,  3.60it/s]
 21%|██        | 77876/371472 [6:11:48<23:06:38,  3.53it/s]
 21%|██        | 77877/371472 [6:11:48<22:24:27,  3.64it/s]
 21%|██        | 77878/371472 [6:11:49<22:53:52,  3.56it/s]
 21%|██        | 77879/371472 [6:11:49<22:48:06,  3.58it/s]
 21%|██        | 77880/371472 [6:11:49<24:09:10,  3.38it/s]
                                                           
{'loss': 4.1786, 'learning_rate': 8.116960072399749e-07, 'epoch': 3.35}

 21%|██        | 77880/371472 [6:11:49<24:09:10,  3.38it/s]
 21%|██        | 77881/371472 [6:11:50<23:17:15,  3.50it/s]
 21%|██        | 77882/371472 [6:11:50<24:52:46,  3.28it/s]
 21%|██        | 77883/371472 [6:11:50<23:33:35,  3.46it/s]
 21%|██        | 77884/371472 [6:11:50<23:00:31,  3.54it/s]
 21%|██        | 77885/371472 [6:11:51<23:55:30,  3.41it/s]
 21%|██        | 77886/371472 [6:11:51<22:56:52,  3.55it/s]
 21%|██        | 77887/371472 [6:11:51<25:03:11,  3.26it/s]
 21%|██        | 77888/371472 [6:11:52<24:06:39,  3.38it/s]
 21%|██        | 77889/371472 [6:11:52<23:59:52,  3.40it/s]
 21%|██        | 77890/371472 [6:11:52<23:10:36,  3.52it/s]
 21%|██        | 77891/371472 [6:11:53<23:18:52,  3.50it/s]
 21%|██        | 77892/371472 [6:11:53<22:28:05,  3.63it/s]
 21%|██        | 77893/371472 [6:11:53<22:31:59,  3.62it/s]
 21%|██        | 77894/371472 [6:11:53<22:14:24,  3.67it/s]
 21%|██        | 77895/371472 [6:11:54<21:37:20,  3.77it/s]
 21%|██        | 77896/371472 [6:11:54<21:11:11,  3.85it/s]
 21%|██        | 77897/371472 [6:11:54<22:24:26,  3.64it/s]
 21%|██        | 77898/371472 [6:11:54<22:13:08,  3.67it/s]
 21%|██        | 77899/371472 [6:11:55<21:57:56,  3.71it/s]
 21%|██        | 77900/371472 [6:11:55<21:43:33,  3.75it/s]
                                                           
{'loss': 4.1515, 'learning_rate': 8.116475252644961e-07, 'epoch': 3.36}

 21%|██        | 77900/371472 [6:11:55<21:43:33,  3.75it/s]
 21%|██        | 77901/371472 [6:11:55<23:09:06,  3.52it/s]
 21%|██        | 77902/371472 [6:11:56<25:05:22,  3.25it/s]
 21%|██        | 77903/371472 [6:11:56<23:31:37,  3.47it/s]
 21%|██        | 77904/371472 [6:11:56<23:55:54,  3.41it/s]
 21%|██        | 77905/371472 [6:11:56<22:58:31,  3.55it/s]
 21%|██        | 77906/371472 [6:11:57<23:21:30,  3.49it/s]
 21%|██        | 77907/371472 [6:11:57<22:35:38,  3.61it/s]
 21%|██        | 77908/371472 [6:11:57<22:10:27,  3.68it/s]
 21%|██        | 77909/371472 [6:11:58<23:09:53,  3.52it/s]
 21%|██        | 77910/371472 [6:11:58<23:12:43,  3.51it/s]
 21%|██        | 77911/371472 [6:11:58<22:14:42,  3.67it/s]
 21%|██        | 77912/371472 [6:11:58<22:32:26,  3.62it/s]
 21%|██        | 77913/371472 [6:11:59<21:55:22,  3.72it/s]
 21%|██        | 77914/371472 [6:11:59<21:23:50,  3.81it/s]
 21%|██        | 77915/371472 [6:11:59<21:13:28,  3.84it/s]
 21%|██        | 77916/371472 [6:11:59<22:06:36,  3.69it/s]
 21%|██        | 77917/371472 [6:12:00<22:36:09,  3.61it/s]
 21%|██        | 77918/371472 [6:12:00<21:36:13,  3.77it/s]
 21%|██        | 77919/371472 [6:12:00<21:12:43,  3.84it/s]
 21%|██        | 77920/371472 [6:12:00<20:49:29,  3.92it/s]
                                                           
{'loss': 4.2021, 'learning_rate': 8.115990432890172e-07, 'epoch': 3.36}

 21%|██        | 77920/371472 [6:12:00<20:49:29,  3.92it/s]
 21%|██        | 77921/371472 [6:12:01<21:14:31,  3.84it/s]
 21%|██        | 77922/371472 [6:12:01<20:48:59,  3.92it/s]
 21%|██        | 77923/371472 [6:12:01<20:35:34,  3.96it/s]
 21%|██        | 77924/371472 [6:12:02<25:51:33,  3.15it/s]
 21%|██        | 77925/371472 [6:12:02<26:19:32,  3.10it/s]
 21%|██        | 77926/371472 [6:12:02<24:53:38,  3.28it/s]
 21%|██        | 77927/371472 [6:12:03<25:48:37,  3.16it/s]
 21%|██        | 77928/371472 [6:12:03<25:00:16,  3.26it/s]
 21%|██        | 77929/371472 [6:12:03<24:17:09,  3.36it/s]
 21%|██        | 77930/371472 [6:12:03<23:47:14,  3.43it/s]
 21%|██        | 77931/371472 [6:12:04<25:54:12,  3.15it/s]
 21%|██        | 77932/371472 [6:12:04<24:20:19,  3.35it/s]
 21%|██        | 77933/371472 [6:12:04<23:36:42,  3.45it/s]
 21%|██        | 77934/371472 [6:12:05<22:27:53,  3.63it/s]
 21%|██        | 77935/371472 [6:12:05<23:10:49,  3.52it/s]
 21%|██        | 77936/371472 [6:12:05<22:18:26,  3.66it/s]
 21%|██        | 77937/371472 [6:12:05<22:38:05,  3.60it/s]
 21%|██        | 77938/371472 [6:12:06<22:55:25,  3.56it/s]
 21%|██        | 77939/371472 [6:12:06<22:13:45,  3.67it/s]
 21%|██        | 77940/371472 [6:12:06<23:49:41,  3.42it/s]
                                                           
{'loss': 4.1623, 'learning_rate': 8.115505613135383e-07, 'epoch': 3.36}

 21%|██        | 77940/371472 [6:12:06<23:49:41,  3.42it/s]
 21%|██        | 77941/371472 [6:12:07<24:17:10,  3.36it/s]
 21%|██        | 77942/371472 [6:12:07<22:49:03,  3.57it/s]
 21%|██        | 77943/371472 [6:12:07<22:27:37,  3.63it/s]
 21%|██        | 77944/371472 [6:12:07<22:51:32,  3.57it/s]
 21%|██        | 77945/371472 [6:12:08<23:13:46,  3.51it/s]
 21%|██        | 77946/371472 [6:12:08<23:35:58,  3.45it/s]
 21%|██        | 77947/371472 [6:12:08<23:42:58,  3.44it/s]
 21%|██        | 77948/371472 [6:12:09<22:56:03,  3.56it/s]
 21%|██        | 77949/371472 [6:12:09<22:21:58,  3.65it/s]
 21%|██        | 77950/371472 [6:12:09<21:56:26,  3.72it/s]
 21%|██        | 77951/371472 [6:12:09<21:20:38,  3.82it/s]
 21%|██        | 77952/371472 [6:12:10<23:39:17,  3.45it/s]
 21%|██        | 77953/371472 [6:12:10<25:40:34,  3.18it/s]
 21%|██        | 77954/371472 [6:12:10<24:03:57,  3.39it/s]
 21%|██        | 77955/371472 [6:12:11<24:20:29,  3.35it/s]
 21%|██        | 77956/371472 [6:12:11<22:49:46,  3.57it/s]
 21%|██        | 77957/371472 [6:12:11<22:42:36,  3.59it/s]
 21%|██        | 77958/371472 [6:12:11<22:35:05,  3.61it/s]
 21%|██        | 77959/371472 [6:12:12<23:16:40,  3.50it/s]
 21%|██        | 77960/371472 [6:12:12<22:56:52,  3.55it/s]
                                                           
{'loss': 4.0848, 'learning_rate': 8.115020793380594e-07, 'epoch': 3.36}

 21%|██        | 77960/371472 [6:12:12<22:56:52,  3.55it/s]
 21%|██        | 77961/371472 [6:12:12<22:55:11,  3.56it/s]
 21%|██        | 77962/371472 [6:12:13<23:09:05,  3.52it/s]
 21%|██        | 77963/371472 [6:12:13<22:19:29,  3.65it/s]
 21%|██        | 77964/371472 [6:12:13<21:46:51,  3.74it/s]
 21%|██        | 77965/371472 [6:12:13<21:58:04,  3.71it/s]
 21%|██        | 77966/371472 [6:12:14<21:26:58,  3.80it/s]
 21%|██        | 77967/371472 [6:12:14<21:40:54,  3.76it/s]
 21%|██        | 77968/371472 [6:12:14<21:35:32,  3.78it/s]
 21%|██        | 77969/371472 [6:12:14<21:54:09,  3.72it/s]
 21%|██        | 77970/371472 [6:12:15<22:07:54,  3.68it/s]
 21%|██        | 77971/371472 [6:12:15<22:33:56,  3.61it/s]
 21%|██        | 77972/371472 [6:12:15<22:29:40,  3.62it/s]
 21%|██        | 77973/371472 [6:12:15<22:17:06,  3.66it/s]
 21%|██        | 77974/371472 [6:12:16<22:33:10,  3.61it/s]
 21%|██        | 77975/371472 [6:12:16<22:34:36,  3.61it/s]
 21%|██        | 77976/371472 [6:12:16<22:44:58,  3.58it/s]
 21%|██        | 77977/371472 [6:12:17<22:22:20,  3.64it/s]
 21%|██        | 77978/371472 [6:12:17<23:26:13,  3.48it/s]
 21%|██        | 77979/371472 [6:12:17<23:12:43,  3.51it/s]
 21%|██        | 77980/371472 [6:12:17<22:35:56,  3.61it/s]
                                                           
{'loss': 4.214, 'learning_rate': 8.114535973625805e-07, 'epoch': 3.36}

 21%|██        | 77980/371472 [6:12:17<22:35:56,  3.61it/s]
 21%|██        | 77981/371472 [6:12:18<23:03:26,  3.54it/s]
 21%|██        | 77982/371472 [6:12:18<22:05:45,  3.69it/s]
 21%|██        | 77983/371472 [6:12:18<22:43:40,  3.59it/s]
 21%|██        | 77984/371472 [6:12:19<22:46:18,  3.58it/s]
 21%|██        | 77985/371472 [6:12:19<22:13:06,  3.67it/s]
 21%|██        | 77986/371472 [6:12:19<21:36:27,  3.77it/s]
 21%|██        | 77987/371472 [6:12:19<21:36:21,  3.77it/s]
 21%|██        | 77988/371472 [6:12:20<22:45:27,  3.58it/s]
 21%|██        | 77989/371472 [6:12:20<21:41:37,  3.76it/s]
 21%|██        | 77990/371472 [6:12:20<22:00:20,  3.70it/s]
 21%|██        | 77991/371472 [6:12:20<22:47:42,  3.58it/s]
 21%|██        | 77992/371472 [6:12:21<21:49:32,  3.74it/s]
 21%|██        | 77993/371472 [6:12:21<21:17:32,  3.83it/s]
 21%|██        | 77994/371472 [6:12:21<20:44:37,  3.93it/s]
 21%|██        | 77995/371472 [6:12:21<21:02:19,  3.87it/s]
 21%|██        | 77996/371472 [6:12:22<21:53:26,  3.72it/s]
 21%|██        | 77997/371472 [6:12:22<22:04:55,  3.69it/s]
 21%|██        | 77998/371472 [6:12:22<22:17:55,  3.66it/s]
 21%|██        | 77999/371472 [6:12:23<22:01:49,  3.70it/s]
 21%|██        | 78000/371472 [6:12:23<21:31:19,  3.79it/s]
                                                           
{'loss': 4.2203, 'learning_rate': 8.114051153871016e-07, 'epoch': 3.36}

 21%|██        | 78000/371472 [6:12:23<21:31:19,  3.79it/s]
 21%|██        | 78001/371472 [6:12:23<21:51:37,  3.73it/s]
 21%|██        | 78002/371472 [6:12:23<22:16:41,  3.66it/s]
 21%|██        | 78003/371472 [6:12:24<21:49:47,  3.73it/s]
 21%|██        | 78004/371472 [6:12:24<21:58:15,  3.71it/s]
 21%|██        | 78005/371472 [6:12:24<22:28:51,  3.63it/s]
 21%|██        | 78006/371472 [6:12:24<22:08:28,  3.68it/s]
 21%|██        | 78007/371472 [6:12:25<22:39:49,  3.60it/s]
 21%|██        | 78008/371472 [6:12:25<22:03:37,  3.70it/s]
 21%|██        | 78009/371472 [6:12:25<21:06:01,  3.86it/s]
 21%|██        | 78010/371472 [6:12:26<21:25:10,  3.81it/s]
 21%|██        | 78011/371472 [6:12:26<21:51:57,  3.73it/s]
 21%|██        | 78012/371472 [6:12:26<22:33:50,  3.61it/s]
 21%|██        | 78013/371472 [6:12:26<22:46:32,  3.58it/s]
 21%|██        | 78014/371472 [6:12:27<22:54:30,  3.56it/s]
 21%|██        | 78015/371472 [6:12:27<23:13:44,  3.51it/s]
 21%|██        | 78016/371472 [6:12:27<21:56:33,  3.71it/s]
 21%|██        | 78017/371472 [6:12:28<23:07:13,  3.53it/s]
 21%|██        | 78018/371472 [6:12:28<22:43:04,  3.59it/s]
 21%|██        | 78019/371472 [6:12:28<22:40:57,  3.59it/s]
 21%|██        | 78020/371472 [6:12:28<22:23:34,  3.64it/s]
                                                           
{'loss': 4.0898, 'learning_rate': 8.113566334116226e-07, 'epoch': 3.36}

 21%|██        | 78020/371472 [6:12:28<22:23:34,  3.64it/s]
 21%|██        | 78021/371472 [6:12:29<22:32:35,  3.62it/s]
 21%|██        | 78022/371472 [6:12:29<22:02:38,  3.70it/s]
 21%|██        | 78023/371472 [6:12:29<21:26:32,  3.80it/s]
 21%|██        | 78024/371472 [6:12:29<21:36:05,  3.77it/s]
 21%|██        | 78025/371472 [6:12:30<21:41:10,  3.76it/s]
 21%|██        | 78026/371472 [6:12:30<24:19:31,  3.35it/s]
 21%|██        | 78027/371472 [6:12:30<26:13:31,  3.11it/s]
 21%|██        | 78028/371472 [6:12:31<25:11:30,  3.24it/s]
 21%|██        | 78029/371472 [6:12:31<24:02:18,  3.39it/s]
 21%|██        | 78030/371472 [6:12:31<24:42:04,  3.30it/s]
 21%|██        | 78031/371472 [6:12:32<23:43:19,  3.44it/s]
 21%|██        | 78032/371472 [6:12:32<23:34:08,  3.46it/s]
 21%|██        | 78033/371472 [6:12:32<25:06:49,  3.25it/s]
 21%|██        | 78034/371472 [6:12:32<25:56:44,  3.14it/s]
 21%|██        | 78035/371472 [6:12:33<25:05:49,  3.25it/s]
 21%|██        | 78036/371472 [6:12:33<23:10:07,  3.52it/s]
 21%|██        | 78037/371472 [6:12:33<23:23:35,  3.48it/s]
 21%|██        | 78038/371472 [6:12:34<27:19:16,  2.98it/s]
 21%|██        | 78039/371472 [6:12:34<25:22:31,  3.21it/s]
 21%|██        | 78040/371472 [6:12:34<24:22:09,  3.34it/s]
                                                           
{'loss': 4.2142, 'learning_rate': 8.113081514361438e-07, 'epoch': 3.36}

 21%|██        | 78040/371472 [6:12:34<24:22:09,  3.34it/s]
 21%|██        | 78041/371472 [6:12:35<23:18:28,  3.50it/s]
 21%|██        | 78042/371472 [6:12:35<23:01:37,  3.54it/s]
 21%|██        | 78043/371472 [6:12:35<22:16:23,  3.66it/s]
 21%|██        | 78044/371472 [6:12:35<22:18:16,  3.65it/s]
 21%|██        | 78045/371472 [6:12:36<23:40:34,  3.44it/s]
 21%|██        | 78046/371472 [6:12:36<23:59:33,  3.40it/s]
 21%|██        | 78047/371472 [6:12:36<24:12:02,  3.37it/s]
 21%|██        | 78048/371472 [6:12:37<23:33:02,  3.46it/s]
 21%|██        | 78049/371472 [6:12:37<22:32:46,  3.62it/s]
 21%|██        | 78050/371472 [6:12:37<23:28:04,  3.47it/s]
 21%|██        | 78051/371472 [6:12:37<22:20:38,  3.65it/s]
 21%|██        | 78052/371472 [6:12:38<22:05:44,  3.69it/s]
 21%|██        | 78053/371472 [6:12:38<21:55:12,  3.72it/s]
 21%|██        | 78054/371472 [6:12:38<23:05:11,  3.53it/s]
 21%|██        | 78055/371472 [6:12:38<22:26:07,  3.63it/s]
 21%|██        | 78056/371472 [6:12:39<23:09:40,  3.52it/s]
 21%|██        | 78057/371472 [6:12:39<23:22:55,  3.49it/s]
 21%|██        | 78058/371472 [6:12:39<24:03:02,  3.39it/s]
 21%|██        | 78059/371472 [6:12:40<25:10:42,  3.24it/s]
 21%|██        | 78060/371472 [6:12:40<24:25:03,  3.34it/s]
                                                           
{'loss': 4.0743, 'learning_rate': 8.112596694606649e-07, 'epoch': 3.36}

 21%|██        | 78060/371472 [6:12:40<24:25:03,  3.34it/s]
 21%|██        | 78061/371472 [6:12:40<24:00:03,  3.40it/s]
 21%|██        | 78062/371472 [6:12:41<23:45:14,  3.43it/s]
 21%|██        | 78063/371472 [6:12:41<23:24:10,  3.48it/s]
 21%|██        | 78064/371472 [6:12:41<22:40:49,  3.59it/s]
 21%|██        | 78065/371472 [6:12:41<22:34:39,  3.61it/s]
 21%|██        | 78066/371472 [6:12:42<24:05:37,  3.38it/s]
 21%|██        | 78067/371472 [6:12:42<23:47:20,  3.43it/s]
 21%|██        | 78068/371472 [6:12:42<24:17:15,  3.36it/s]
 21%|██        | 78069/371472 [6:12:43<23:12:08,  3.51it/s]
 21%|██        | 78070/371472 [6:12:43<22:31:21,  3.62it/s]
 21%|██        | 78071/371472 [6:12:43<22:45:13,  3.58it/s]
 21%|██        | 78072/371472 [6:12:43<24:09:40,  3.37it/s]
 21%|██        | 78073/371472 [6:12:44<23:03:31,  3.53it/s]
 21%|██        | 78074/371472 [6:12:44<22:59:02,  3.55it/s]
 21%|██        | 78075/371472 [6:12:44<23:42:16,  3.44it/s]
 21%|██        | 78076/371472 [6:12:45<23:00:59,  3.54it/s]
 21%|██        | 78077/371472 [6:12:45<22:48:03,  3.57it/s]
 21%|██        | 78078/371472 [6:12:45<22:37:44,  3.60it/s]
 21%|██        | 78079/371472 [6:12:45<22:44:11,  3.58it/s]
 21%|██        | 78080/371472 [6:12:46<22:28:06,  3.63it/s]
                                                           
{'loss': 3.9457, 'learning_rate': 8.112111874851861e-07, 'epoch': 3.36}

 21%|██        | 78080/371472 [6:12:46<22:28:06,  3.63it/s]
 21%|██        | 78081/371472 [6:12:46<21:46:03,  3.74it/s]
 21%|██        | 78082/371472 [6:12:46<22:36:54,  3.60it/s]
 21%|██        | 78083/371472 [6:12:46<21:45:37,  3.75it/s]
 21%|██        | 78084/371472 [6:12:47<21:12:30,  3.84it/s]
 21%|██        | 78085/371472 [6:12:47<20:52:14,  3.90it/s]
 21%|██        | 78086/371472 [6:12:47<21:03:34,  3.87it/s]
 21%|██        | 78087/371472 [6:12:47<22:03:34,  3.69it/s]
 21%|██        | 78088/371472 [6:12:48<22:39:29,  3.60it/s]
 21%|██        | 78089/371472 [6:12:48<22:29:16,  3.62it/s]
 21%|██        | 78090/371472 [6:12:48<22:49:07,  3.57it/s]
 21%|██        | 78091/371472 [6:12:49<22:40:35,  3.59it/s]
 21%|██        | 78092/371472 [6:12:49<23:01:40,  3.54it/s]
 21%|██        | 78093/371472 [6:12:49<22:16:45,  3.66it/s]
 21%|██        | 78094/371472 [6:12:49<23:23:54,  3.48it/s]
 21%|██        | 78095/371472 [6:12:50<23:03:22,  3.53it/s]
 21%|██        | 78096/371472 [6:12:50<22:01:56,  3.70it/s]
 21%|██        | 78097/371472 [6:12:50<21:40:34,  3.76it/s]
 21%|██        | 78098/371472 [6:12:51<23:15:48,  3.50it/s]
 21%|██        | 78099/371472 [6:12:51<24:20:19,  3.35it/s]
 21%|██        | 78100/371472 [6:12:51<25:10:31,  3.24it/s]
                                                           
{'loss': 4.1495, 'learning_rate': 8.111627055097071e-07, 'epoch': 3.36}

 21%|██        | 78100/371472 [6:12:51<25:10:31,  3.24it/s]
 21%|██        | 78101/371472 [6:12:51<23:52:47,  3.41it/s]
 21%|██        | 78102/371472 [6:12:52<23:29:33,  3.47it/s]
 21%|██        | 78103/371472 [6:12:52<23:49:48,  3.42it/s]
 21%|██        | 78104/371472 [6:12:52<23:11:34,  3.51it/s]
 21%|██        | 78105/371472 [6:12:53<23:46:19,  3.43it/s]
 21%|██        | 78106/371472 [6:12:53<23:13:46,  3.51it/s]
 21%|██        | 78107/371472 [6:12:53<23:05:59,  3.53it/s]
 21%|██        | 78108/371472 [6:12:53<23:21:19,  3.49it/s]
 21%|██        | 78109/371472 [6:12:54<23:35:25,  3.45it/s]
 21%|██        | 78110/371472 [6:12:54<23:19:45,  3.49it/s]
 21%|██        | 78111/371472 [6:12:54<24:22:11,  3.34it/s]
 21%|██        | 78112/371472 [6:12:55<23:43:13,  3.44it/s]
 21%|██        | 78113/371472 [6:12:55<23:02:10,  3.54it/s]
 21%|██        | 78114/371472 [6:12:55<23:13:43,  3.51it/s]
 21%|██        | 78115/371472 [6:12:55<22:48:48,  3.57it/s]
 21%|██        | 78116/371472 [6:12:56<22:59:42,  3.54it/s]
 21%|██        | 78117/371472 [6:12:56<23:14:55,  3.51it/s]
 21%|██        | 78118/371472 [6:12:56<22:36:16,  3.60it/s]
 21%|██        | 78119/371472 [6:12:57<22:42:31,  3.59it/s]
 21%|██        | 78120/371472 [6:12:57<21:26:18,  3.80it/s]
                                                           
{'loss': 4.2278, 'learning_rate': 8.111142235342283e-07, 'epoch': 3.36}

 21%|██        | 78120/371472 [6:12:57<21:26:18,  3.80it/s]
 21%|██        | 78121/371472 [6:12:57<22:36:07,  3.61it/s]
 21%|██        | 78122/371472 [6:12:57<21:32:33,  3.78it/s]
 21%|██        | 78123/371472 [6:12:58<23:16:45,  3.50it/s]
 21%|██        | 78124/371472 [6:12:58<23:05:12,  3.53it/s]
 21%|██        | 78125/371472 [6:12:58<24:42:30,  3.30it/s]
 21%|██        | 78126/371472 [6:12:59<24:02:04,  3.39it/s]
 21%|██        | 78127/371472 [6:12:59<23:07:40,  3.52it/s]
 21%|██        | 78128/371472 [6:12:59<23:02:19,  3.54it/s]
 21%|██        | 78129/371472 [6:12:59<22:49:45,  3.57it/s]
 21%|██        | 78130/371472 [6:13:00<23:44:30,  3.43it/s]
 21%|██        | 78131/371472 [6:13:00<22:38:55,  3.60it/s]
 21%|██        | 78132/371472 [6:13:00<22:18:23,  3.65it/s]
 21%|██        | 78133/371472 [6:13:01<22:18:25,  3.65it/s]
 21%|██        | 78134/371472 [6:13:01<21:49:37,  3.73it/s]
 21%|██        | 78135/371472 [6:13:01<22:27:50,  3.63it/s]
 21%|██        | 78136/371472 [6:13:01<22:27:38,  3.63it/s]
 21%|██        | 78137/371472 [6:13:02<22:26:45,  3.63it/s]
 21%|██        | 78138/371472 [6:13:02<21:35:32,  3.77it/s]
 21%|██        | 78139/371472 [6:13:02<22:17:53,  3.65it/s]
 21%|██        | 78140/371472 [6:13:02<21:15:10,  3.83it/s]
                                                           
{'loss': 4.1487, 'learning_rate': 8.110657415587493e-07, 'epoch': 3.37}

 21%|██        | 78140/371472 [6:13:02<21:15:10,  3.83it/s]
 21%|██        | 78141/371472 [6:13:03<23:32:52,  3.46it/s]
 21%|██        | 78142/371472 [6:13:03<23:38:26,  3.45it/s]
 21%|██        | 78143/371472 [6:13:03<23:02:39,  3.54it/s]
 21%|██        | 78144/371472 [6:13:04<22:12:30,  3.67it/s]
 21%|██        | 78145/371472 [6:13:04<22:22:57,  3.64it/s]
 21%|██        | 78146/371472 [6:13:04<22:31:27,  3.62it/s]
 21%|██        | 78147/371472 [6:13:04<23:45:21,  3.43it/s]
 21%|██        | 78148/371472 [6:13:05<23:48:18,  3.42it/s]
 21%|██        | 78149/371472 [6:13:05<23:23:12,  3.48it/s]
 21%|██        | 78150/371472 [6:13:05<24:11:02,  3.37it/s]
 21%|██        | 78151/371472 [6:13:06<23:39:08,  3.44it/s]
 21%|██        | 78152/371472 [6:13:06<26:36:12,  3.06it/s]
 21%|██        | 78153/371472 [6:13:06<24:24:27,  3.34it/s]
 21%|██        | 78154/371472 [6:13:07<23:58:02,  3.40it/s]
 21%|██        | 78155/371472 [6:13:07<23:26:58,  3.47it/s]
 21%|██        | 78156/371472 [6:13:07<22:46:16,  3.58it/s]
 21%|██        | 78157/371472 [6:13:07<22:14:42,  3.66it/s]
 21%|██        | 78158/371472 [6:13:08<21:56:16,  3.71it/s]
 21%|██        | 78159/371472 [6:13:08<21:32:34,  3.78it/s]
 21%|██        | 78160/371472 [6:13:08<25:05:45,  3.25it/s]
                                                           
{'loss': 3.9095, 'learning_rate': 8.110172595832705e-07, 'epoch': 3.37}

 21%|██        | 78160/371472 [6:13:08<25:05:45,  3.25it/s]
 21%|██        | 78161/371472 [6:13:09<24:31:48,  3.32it/s]
 21%|██        | 78162/371472 [6:13:09<23:01:38,  3.54it/s]
 21%|██        | 78163/371472 [6:13:09<22:46:51,  3.58it/s]
 21%|██        | 78164/371472 [6:13:09<22:01:56,  3.70it/s]
 21%|██        | 78165/371472 [6:13:10<22:56:55,  3.55it/s]
 21%|██        | 78166/371472 [6:13:10<22:26:41,  3.63it/s]
 21%|██        | 78167/371472 [6:13:10<23:04:05,  3.53it/s]
 21%|██        | 78168/371472 [6:13:10<22:35:36,  3.61it/s]
 21%|██        | 78169/371472 [6:13:11<21:44:18,  3.75it/s]
 21%|██        | 78170/371472 [6:13:11<22:21:48,  3.64it/s]
 21%|██        | 78171/371472 [6:13:11<22:40:02,  3.59it/s]
 21%|██        | 78172/371472 [6:13:12<23:10:38,  3.52it/s]
 21%|██        | 78173/371472 [6:13:12<23:11:41,  3.51it/s]
 21%|██        | 78174/371472 [6:13:12<22:51:54,  3.56it/s]
 21%|██        | 78175/371472 [6:13:12<22:42:33,  3.59it/s]
 21%|██        | 78176/371472 [6:13:13<22:47:25,  3.57it/s]
 21%|██        | 78177/371472 [6:13:13<23:20:13,  3.49it/s]
 21%|██        | 78178/371472 [6:13:13<24:12:58,  3.36it/s]
 21%|██        | 78179/371472 [6:13:14<23:49:32,  3.42it/s]
 21%|██        | 78180/371472 [6:13:14<23:08:38,  3.52it/s]
                                                           
{'loss': 4.0588, 'learning_rate': 8.109687776077916e-07, 'epoch': 3.37}

 21%|██        | 78180/371472 [6:13:14<23:08:38,  3.52it/s]
 21%|██        | 78181/371472 [6:13:14<22:46:37,  3.58it/s]
 21%|██        | 78182/371472 [6:13:14<22:49:46,  3.57it/s]
 21%|██        | 78183/371472 [6:13:15<22:53:50,  3.56it/s]
 21%|██        | 78184/371472 [6:13:15<22:38:39,  3.60it/s]
 21%|██        | 78185/371472 [6:13:15<24:00:37,  3.39it/s]
 21%|██        | 78186/371472 [6:13:16<23:06:13,  3.53it/s]
 21%|██        | 78187/371472 [6:13:16<22:58:48,  3.55it/s]
 21%|██        | 78188/371472 [6:13:16<22:50:01,  3.57it/s]
 21%|██        | 78189/371472 [6:13:16<22:04:19,  3.69it/s]
 21%|██        | 78190/371472 [6:13:17<23:22:47,  3.48it/s]
 21%|██        | 78191/371472 [6:13:17<22:24:39,  3.64it/s]
 21%|██        | 78192/371472 [6:13:17<24:37:51,  3.31it/s]
 21%|██        | 78193/371472 [6:13:18<25:09:12,  3.24it/s]
 21%|██        | 78194/371472 [6:13:18<24:40:03,  3.30it/s]
 21%|██        | 78195/371472 [6:13:18<23:17:20,  3.50it/s]
 21%|██        | 78196/371472 [6:13:18<23:38:08,  3.45it/s]
 21%|██        | 78197/371472 [6:13:19<23:39:39,  3.44it/s]
 21%|██        | 78198/371472 [6:13:19<22:30:30,  3.62it/s]
 21%|██        | 78199/371472 [6:13:19<22:05:27,  3.69it/s]
 21%|██        | 78200/371472 [6:13:19<21:50:26,  3.73it/s]
                                                           
{'loss': 4.28, 'learning_rate': 8.109202956323127e-07, 'epoch': 3.37}

 21%|██        | 78200/371472 [6:13:19<21:50:26,  3.73it/s]
 21%|██        | 78201/371472 [6:13:20<22:09:30,  3.68it/s]
 21%|██        | 78202/371472 [6:13:20<22:27:07,  3.63it/s]
 21%|██        | 78203/371472 [6:13:20<21:30:32,  3.79it/s]
 21%|██        | 78204/371472 [6:13:21<22:57:28,  3.55it/s]
 21%|██        | 78205/371472 [6:13:21<23:32:08,  3.46it/s]
 21%|██        | 78206/371472 [6:13:21<23:52:15,  3.41it/s]
 21%|██        | 78207/371472 [6:13:22<25:07:38,  3.24it/s]
 21%|██        | 78208/371472 [6:13:22<23:42:49,  3.44it/s]
 21%|██        | 78209/371472 [6:13:22<24:21:47,  3.34it/s]
 21%|██        | 78210/371472 [6:13:22<23:34:23,  3.46it/s]
 21%|██        | 78211/371472 [6:13:23<23:00:00,  3.54it/s]
 21%|██        | 78212/371472 [6:13:23<25:41:11,  3.17it/s]
 21%|██        | 78213/371472 [6:13:23<26:02:26,  3.13it/s]
 21%|██        | 78214/371472 [6:13:24<24:40:23,  3.30it/s]
 21%|██        | 78215/371472 [6:13:24<23:31:34,  3.46it/s]
 21%|██        | 78216/371472 [6:13:24<22:48:48,  3.57it/s]
 21%|██        | 78217/371472 [6:13:24<23:03:56,  3.53it/s]
 21%|██        | 78218/371472 [6:13:25<23:39:52,  3.44it/s]
 21%|██        | 78219/371472 [6:13:25<22:37:13,  3.60it/s]
 21%|██        | 78220/371472 [6:13:25<22:47:47,  3.57it/s]
                                                           
{'loss': 4.0036, 'learning_rate': 8.108718136568338e-07, 'epoch': 3.37}

 21%|██        | 78220/371472 [6:13:25<22:47:47,  3.57it/s]
 21%|██        | 78221/371472 [6:13:26<23:30:25,  3.47it/s]
 21%|██        | 78222/371472 [6:13:26<22:52:24,  3.56it/s]
 21%|██        | 78223/371472 [6:13:26<22:27:06,  3.63it/s]
 21%|██        | 78224/371472 [6:13:26<22:24:51,  3.63it/s]
 21%|██        | 78225/371472 [6:13:27<22:58:38,  3.55it/s]
 21%|██        | 78226/371472 [6:13:27<23:04:17,  3.53it/s]
 21%|██        | 78227/371472 [6:13:27<24:19:21,  3.35it/s]
 21%|██        | 78228/371472 [6:13:28<26:22:01,  3.09it/s]
 21%|██        | 78229/371472 [6:13:28<25:00:42,  3.26it/s]
 21%|██        | 78230/371472 [6:13:28<24:19:00,  3.35it/s]
 21%|██        | 78231/371472 [6:13:28<23:11:45,  3.51it/s]
 21%|██        | 78232/371472 [6:13:29<22:32:53,  3.61it/s]
 21%|██        | 78233/371472 [6:13:29<22:45:57,  3.58it/s]
 21%|██        | 78234/371472 [6:13:29<22:38:46,  3.60it/s]
 21%|██        | 78235/371472 [6:13:30<22:11:51,  3.67it/s]
 21%|██        | 78236/371472 [6:13:30<23:01:56,  3.54it/s]
 21%|██        | 78237/371472 [6:13:30<22:37:05,  3.60it/s]
 21%|██        | 78238/371472 [6:13:30<23:31:58,  3.46it/s]
 21%|██        | 78239/371472 [6:13:31<24:17:28,  3.35it/s]
 21%|██        | 78240/371472 [6:13:31<24:14:21,  3.36it/s]
                                                           
{'loss': 4.1697, 'learning_rate': 8.108233316813549e-07, 'epoch': 3.37}

 21%|██        | 78240/371472 [6:13:31<24:14:21,  3.36it/s]
 21%|██        | 78241/371472 [6:13:31<27:06:23,  3.00it/s]
 21%|██        | 78242/371472 [6:13:32<27:05:51,  3.01it/s]
 21%|██        | 78243/371472 [6:13:32<26:21:12,  3.09it/s]
 21%|██        | 78244/371472 [6:13:32<25:34:40,  3.18it/s]
 21%|██        | 78245/371472 [6:13:33<25:27:29,  3.20it/s]
 21%|██        | 78246/371472 [6:13:33<25:13:35,  3.23it/s]
 21%|██        | 78247/371472 [6:13:33<24:00:46,  3.39it/s]
 21%|██        | 78248/371472 [6:13:34<23:38:31,  3.45it/s]
 21%|██        | 78249/371472 [6:13:34<23:16:42,  3.50it/s]
 21%|██        | 78250/371472 [6:13:34<24:02:07,  3.39it/s]
 21%|██        | 78251/371472 [6:13:34<23:05:11,  3.53it/s]
 21%|██        | 78252/371472 [6:13:35<22:38:30,  3.60it/s]
 21%|██        | 78253/371472 [6:13:35<21:36:54,  3.77it/s]
 21%|██        | 78254/371472 [6:13:35<21:06:40,  3.86it/s]
 21%|██        | 78255/371472 [6:13:35<21:03:06,  3.87it/s]
 21%|██        | 78256/371472 [6:13:36<20:52:31,  3.90it/s]
 21%|██        | 78257/371472 [6:13:36<21:07:08,  3.86it/s]
 21%|██        | 78258/371472 [6:13:36<22:16:30,  3.66it/s]
 21%|██        | 78259/371472 [6:13:37<22:52:24,  3.56it/s]
 21%|██        | 78260/371472 [6:13:37<22:27:59,  3.63it/s]
                                                           
{'loss': 4.0887, 'learning_rate': 8.107748497058759e-07, 'epoch': 3.37}

 21%|██        | 78260/371472 [6:13:37<22:27:59,  3.63it/s]
 21%|██        | 78261/371472 [6:13:37<22:03:18,  3.69it/s]
 21%|██        | 78262/371472 [6:13:37<22:31:55,  3.61it/s]
 21%|██        | 78263/371472 [6:13:38<22:02:29,  3.70it/s]
 21%|██        | 78264/371472 [6:13:38<21:37:58,  3.76it/s]
 21%|██        | 78265/371472 [6:13:38<21:12:01,  3.84it/s]
 21%|██        | 78266/371472 [6:13:38<21:15:56,  3.83it/s]
 21%|██        | 78267/371472 [6:13:39<22:05:12,  3.69it/s]
 21%|██        | 78268/371472 [6:13:39<23:02:05,  3.54it/s]
 21%|██        | 78269/371472 [6:13:39<23:25:33,  3.48it/s]
 21%|██        | 78270/371472 [6:13:40<22:51:14,  3.56it/s]
 21%|██        | 78271/371472 [6:13:40<23:15:20,  3.50it/s]
 21%|██        | 78272/371472 [6:13:40<22:22:39,  3.64it/s]
 21%|██        | 78273/371472 [6:13:40<22:43:52,  3.58it/s]
 21%|██        | 78274/371472 [6:13:41<22:10:56,  3.67it/s]
 21%|██        | 78275/371472 [6:13:41<25:12:40,  3.23it/s]
 21%|██        | 78276/371472 [6:13:41<25:32:16,  3.19it/s]
 21%|██        | 78277/371472 [6:13:42<24:11:56,  3.37it/s]
 21%|██        | 78278/371472 [6:13:42<23:40:01,  3.44it/s]
 21%|██        | 78279/371472 [6:13:42<22:56:09,  3.55it/s]
 21%|██        | 78280/371472 [6:13:42<22:22:48,  3.64it/s]
                                                           
{'loss': 4.2456, 'learning_rate': 8.107263677303971e-07, 'epoch': 3.37}

 21%|██        | 78280/371472 [6:13:42<22:22:48,  3.64it/s]
 21%|██        | 78281/371472 [6:13:43<21:39:26,  3.76it/s]
 21%|██        | 78282/371472 [6:13:43<22:44:06,  3.58it/s]
 21%|██        | 78283/371472 [6:13:43<23:47:13,  3.42it/s]
 21%|██        | 78284/371472 [6:13:44<23:23:52,  3.48it/s]
 21%|██        | 78285/371472 [6:13:44<22:23:45,  3.64it/s]
 21%|██        | 78286/371472 [6:13:44<24:52:29,  3.27it/s]
 21%|██        | 78287/371472 [6:13:44<23:57:32,  3.40it/s]
 21%|██        | 78288/371472 [6:13:45<23:32:50,  3.46it/s]
 21%|██        | 78289/371472 [6:13:45<23:22:03,  3.49it/s]
 21%|██        | 78290/371472 [6:13:45<22:45:06,  3.58it/s]
 21%|██        | 78291/371472 [6:13:46<22:24:12,  3.64it/s]
 21%|██        | 78292/371472 [6:13:46<21:44:22,  3.75it/s]
 21%|██        | 78293/371472 [6:13:46<21:25:24,  3.80it/s]
 21%|██        | 78294/371472 [6:13:46<21:16:52,  3.83it/s]
 21%|██        | 78295/371472 [6:13:47<21:03:13,  3.87it/s]
 21%|██        | 78296/371472 [6:13:47<21:18:31,  3.82it/s]
 21%|██        | 78297/371472 [6:13:47<20:58:02,  3.88it/s]
 21%|██        | 78298/371472 [6:13:47<20:38:09,  3.95it/s]
 21%|██        | 78299/371472 [6:13:48<21:29:33,  3.79it/s]
 21%|██        | 78300/371472 [6:13:48<21:13:04,  3.84it/s]
                                                           
{'loss': 4.1127, 'learning_rate': 8.106778857549182e-07, 'epoch': 3.37}

 21%|██        | 78300/371472 [6:13:48<21:13:04,  3.84it/s]
 21%|██        | 78301/371472 [6:13:48<20:56:22,  3.89it/s]
 21%|██        | 78302/371472 [6:13:48<21:34:23,  3.77it/s]
 21%|██        | 78303/371472 [6:13:49<22:55:52,  3.55it/s]
 21%|██        | 78304/371472 [6:13:49<24:33:23,  3.32it/s]
 21%|██        | 78305/371472 [6:13:49<24:22:17,  3.34it/s]
 21%|██        | 78306/371472 [6:13:50<23:08:11,  3.52it/s]
 21%|██        | 78307/371472 [6:13:50<22:09:20,  3.68it/s]
 21%|██        | 78308/371472 [6:13:50<21:34:43,  3.77it/s]
 21%|██        | 78309/371472 [6:13:50<22:19:49,  3.65it/s]
 21%|██        | 78310/371472 [6:13:51<21:56:27,  3.71it/s]
 21%|██        | 78311/371472 [6:13:51<21:55:00,  3.72it/s]
 21%|██        | 78312/371472 [6:13:51<21:23:34,  3.81it/s]
 21%|██        | 78313/371472 [6:13:51<21:35:01,  3.77it/s]
 21%|██        | 78314/371472 [6:13:52<25:25:25,  3.20it/s]
 21%|██        | 78315/371472 [6:13:52<23:51:28,  3.41it/s]
 21%|██        | 78316/371472 [6:13:52<22:52:22,  3.56it/s]
 21%|██        | 78317/371472 [6:13:53<21:49:10,  3.73it/s]
 21%|██        | 78318/371472 [6:13:53<22:10:13,  3.67it/s]
 21%|██        | 78319/371472 [6:13:53<21:50:34,  3.73it/s]
 21%|██        | 78320/371472 [6:13:53<21:27:26,  3.80it/s]
                                                           
{'loss': 4.0247, 'learning_rate': 8.106294037794392e-07, 'epoch': 3.37}

 21%|██        | 78320/371472 [6:13:53<21:27:26,  3.80it/s]
 21%|██        | 78321/371472 [6:13:54<21:42:57,  3.75it/s]
 21%|██        | 78322/371472 [6:13:54<24:15:09,  3.36it/s]
 21%|██        | 78323/371472 [6:13:54<23:53:00,  3.41it/s]
 21%|██        | 78324/371472 [6:13:55<24:01:16,  3.39it/s]
 21%|██        | 78325/371472 [6:13:55<23:18:17,  3.49it/s]
 21%|██        | 78326/371472 [6:13:55<23:24:47,  3.48it/s]
 21%|██        | 78327/371472 [6:13:55<22:19:20,  3.65it/s]
 21%|██        | 78328/371472 [6:13:56<22:35:32,  3.60it/s]
 21%|██        | 78329/371472 [6:13:56<22:23:04,  3.64it/s]
 21%|██        | 78330/371472 [6:13:56<22:59:36,  3.54it/s]
 21%|██        | 78331/371472 [6:13:57<22:05:41,  3.69it/s]
 21%|██        | 78332/371472 [6:13:57<21:55:05,  3.72it/s]
 21%|██        | 78333/371472 [6:13:57<22:26:17,  3.63it/s]
 21%|██        | 78334/371472 [6:13:57<21:49:20,  3.73it/s]
 21%|██        | 78335/371472 [6:13:58<22:03:13,  3.69it/s]
 21%|██        | 78336/371472 [6:13:58<22:02:31,  3.69it/s]
 21%|██        | 78337/371472 [6:13:58<22:12:00,  3.67it/s]
 21%|██        | 78338/371472 [6:13:58<22:31:18,  3.62it/s]
 21%|██        | 78339/371472 [6:13:59<21:41:50,  3.75it/s]
 21%|██        | 78340/371472 [6:13:59<23:28:54,  3.47it/s]
                                                           
{'loss': 4.2261, 'learning_rate': 8.105809218039604e-07, 'epoch': 3.37}

 21%|██        | 78340/371472 [6:13:59<23:28:54,  3.47it/s]
 21%|██        | 78341/371472 [6:13:59<22:44:25,  3.58it/s]
 21%|██        | 78342/371472 [6:14:00<22:55:16,  3.55it/s]
 21%|██        | 78343/371472 [6:14:00<22:41:36,  3.59it/s]
 21%|██        | 78344/371472 [6:14:00<22:48:16,  3.57it/s]
 21%|██        | 78345/371472 [6:14:00<25:36:49,  3.18it/s]
 21%|██        | 78346/371472 [6:14:01<24:12:37,  3.36it/s]
 21%|██        | 78347/371472 [6:14:01<24:50:00,  3.28it/s]
 21%|██        | 78348/371472 [6:14:01<23:20:16,  3.49it/s]
 21%|██        | 78349/371472 [6:14:02<24:47:20,  3.28it/s]
 21%|██        | 78350/371472 [6:14:02<23:31:58,  3.46it/s]
 21%|██        | 78351/371472 [6:14:02<23:37:58,  3.45it/s]
 21%|██        | 78352/371472 [6:14:03<23:50:38,  3.41it/s]
 21%|██        | 78353/371472 [6:14:03<24:25:35,  3.33it/s]
 21%|██        | 78354/371472 [6:14:03<25:12:20,  3.23it/s]
 21%|██        | 78355/371472 [6:14:04<26:00:53,  3.13it/s]
 21%|██        | 78356/371472 [6:14:04<24:46:15,  3.29it/s]
 21%|██        | 78357/371472 [6:14:04<23:48:41,  3.42it/s]
 21%|██        | 78358/371472 [6:14:04<23:23:16,  3.48it/s]
 21%|██        | 78359/371472 [6:14:05<23:16:47,  3.50it/s]
 21%|██        | 78360/371472 [6:14:05<24:28:27,  3.33it/s]
                                                           
{'loss': 4.2271, 'learning_rate': 8.105324398284816e-07, 'epoch': 3.38}

 21%|██        | 78360/371472 [6:14:05<24:28:27,  3.33it/s]
 21%|██        | 78361/371472 [6:14:05<23:56:25,  3.40it/s]
 21%|██        | 78362/371472 [6:14:05<23:07:30,  3.52it/s]
 21%|██        | 78363/371472 [6:14:06<23:25:42,  3.48it/s]
 21%|██        | 78364/371472 [6:14:06<23:00:05,  3.54it/s]
 21%|██        | 78365/371472 [6:14:06<22:28:48,  3.62it/s]
 21%|██        | 78366/371472 [6:14:07<22:31:08,  3.62it/s]
 21%|██        | 78367/371472 [6:14:07<22:00:43,  3.70it/s]
 21%|██        | 78368/371472 [6:14:07<22:33:05,  3.61it/s]
 21%|██        | 78369/371472 [6:14:07<22:44:10,  3.58it/s]
 21%|██        | 78370/371472 [6:14:08<24:26:35,  3.33it/s]
 21%|██        | 78371/371472 [6:14:08<24:18:53,  3.35it/s]
 21%|██        | 78372/371472 [6:14:08<24:05:49,  3.38it/s]
 21%|██        | 78373/371472 [6:14:09<23:18:20,  3.49it/s]
 21%|██        | 78374/371472 [6:14:09<23:07:49,  3.52it/s]
 21%|██        | 78375/371472 [6:14:09<22:31:37,  3.61it/s]
 21%|██        | 78376/371472 [6:14:09<22:38:59,  3.59it/s]
 21%|██        | 78377/371472 [6:14:10<23:06:31,  3.52it/s]
 21%|██        | 78378/371472 [6:14:10<23:05:39,  3.53it/s]
 21%|██        | 78379/371472 [6:14:10<22:38:45,  3.60it/s]
 21%|██        | 78380/371472 [6:14:11<24:09:48,  3.37it/s]
                                                           
{'loss': 4.0098, 'learning_rate': 8.104839578530027e-07, 'epoch': 3.38}

 21%|██        | 78380/371472 [6:14:11<24:09:48,  3.37it/s]
 21%|██        | 78381/371472 [6:14:11<24:31:27,  3.32it/s]
 21%|██        | 78382/371472 [6:14:11<23:37:10,  3.45it/s]
 21%|██        | 78383/371472 [6:14:12<25:39:14,  3.17it/s]
 21%|██        | 78384/371472 [6:14:12<26:04:33,  3.12it/s]
 21%|██        | 78385/371472 [6:14:12<24:22:47,  3.34it/s]
 21%|██        | 78386/371472 [6:14:12<23:38:37,  3.44it/s]
 21%|██        | 78387/371472 [6:14:13<23:03:40,  3.53it/s]
 21%|██        | 78388/371472 [6:14:13<22:30:33,  3.62it/s]
 21%|██        | 78389/371472 [6:14:13<23:18:31,  3.49it/s]
 21%|██        | 78390/371472 [6:14:14<23:01:48,  3.54it/s]
 21%|██        | 78391/371472 [6:14:14<22:30:03,  3.62it/s]
 21%|██        | 78392/371472 [6:14:14<22:16:08,  3.66it/s]
 21%|██        | 78393/371472 [6:14:14<21:31:46,  3.78it/s]
 21%|██        | 78394/371472 [6:14:15<21:30:40,  3.78it/s]
 21%|██        | 78395/371472 [6:14:15<21:06:28,  3.86it/s]
 21%|██        | 78396/371472 [6:14:15<21:57:15,  3.71it/s]
 21%|██        | 78397/371472 [6:14:15<21:30:36,  3.78it/s]
 21%|██        | 78398/371472 [6:14:16<22:00:45,  3.70it/s]
 21%|██        | 78399/371472 [6:14:16<22:55:55,  3.55it/s]
 21%|██        | 78400/371472 [6:14:16<22:16:40,  3.65it/s]
                                                           
{'loss': 4.2418, 'learning_rate': 8.104354758775236e-07, 'epoch': 3.38}

 21%|██        | 78400/371472 [6:14:16<22:16:40,  3.65it/s]
 21%|██        | 78401/371472 [6:14:17<23:57:40,  3.40it/s]
 21%|██        | 78402/371472 [6:14:17<22:56:59,  3.55it/s]
 21%|██        | 78403/371472 [6:14:17<27:20:16,  2.98it/s]
 21%|██        | 78404/371472 [6:14:18<25:51:07,  3.15it/s]
 21%|██        | 78405/371472 [6:14:18<24:07:22,  3.37it/s]
 21%|██        | 78406/371472 [6:14:18<23:42:03,  3.43it/s]
 21%|██        | 78407/371472 [6:14:18<23:37:52,  3.44it/s]
 21%|██        | 78408/371472 [6:14:19<22:27:54,  3.62it/s]
 21%|██        | 78409/371472 [6:14:19<22:28:01,  3.62it/s]
 21%|██        | 78410/371472 [6:14:19<22:05:24,  3.69it/s]
 21%|██        | 78411/371472 [6:14:19<22:48:50,  3.57it/s]
 21%|██        | 78412/371472 [6:14:20<24:31:21,  3.32it/s]
 21%|██        | 78413/371472 [6:14:20<26:04:22,  3.12it/s]
 21%|██        | 78414/371472 [6:14:20<24:07:33,  3.37it/s]
 21%|██        | 78415/371472 [6:14:21<22:32:39,  3.61it/s]
 21%|██        | 78416/371472 [6:14:21<22:11:32,  3.67it/s]
 21%|██        | 78417/371472 [6:14:21<22:00:17,  3.70it/s]
 21%|██        | 78418/371472 [6:14:21<21:07:26,  3.85it/s]
 21%|██        | 78419/371472 [6:14:22<21:12:57,  3.84it/s]
 21%|██        | 78420/371472 [6:14:22<20:51:11,  3.90it/s]
                                                           
{'loss': 4.0991, 'learning_rate': 8.103869939020448e-07, 'epoch': 3.38}

 21%|██        | 78420/371472 [6:14:22<20:51:11,  3.90it/s]
 21%|██        | 78421/371472 [6:14:22<21:17:51,  3.82it/s]
 21%|██        | 78422/371472 [6:14:22<21:03:56,  3.86it/s]
 21%|██        | 78423/371472 [6:14:23<23:29:31,  3.47it/s]
 21%|██        | 78424/371472 [6:14:23<23:47:02,  3.42it/s]
 21%|██        | 78425/371472 [6:14:23<22:59:27,  3.54it/s]
 21%|██        | 78426/371472 [6:14:24<23:28:39,  3.47it/s]
 21%|██        | 78427/371472 [6:14:24<22:36:57,  3.60it/s]
 21%|██        | 78428/371472 [6:14:24<22:06:48,  3.68it/s]
 21%|██        | 78429/371472 [6:14:24<23:43:21,  3.43it/s]
 21%|██        | 78430/371472 [6:14:25<22:09:45,  3.67it/s]
 21%|██        | 78431/371472 [6:14:25<21:52:47,  3.72it/s]
 21%|██        | 78432/371472 [6:14:25<21:03:34,  3.87it/s]
 21%|██        | 78433/371472 [6:14:25<21:37:50,  3.76it/s]
 21%|██        | 78434/371472 [6:14:26<22:58:56,  3.54it/s]
 21%|██        | 78435/371472 [6:14:26<22:22:46,  3.64it/s]
 21%|██        | 78436/371472 [6:14:26<22:23:20,  3.64it/s]
 21%|██        | 78437/371472 [6:14:27<23:37:53,  3.44it/s]
 21%|██        | 78438/371472 [6:14:27<23:19:42,  3.49it/s]
 21%|██        | 78439/371472 [6:14:27<23:16:13,  3.50it/s]
 21%|██        | 78440/371472 [6:14:27<22:35:57,  3.60it/s]
                                                           
{'loss': 4.18, 'learning_rate': 8.10338511926566e-07, 'epoch': 3.38}

 21%|██        | 78440/371472 [6:14:27<22:35:57,  3.60it/s]
 21%|██        | 78441/371472 [6:14:28<22:35:11,  3.60it/s]
 21%|██        | 78442/371472 [6:14:28<22:10:43,  3.67it/s]
 21%|██        | 78443/371472 [6:14:28<22:11:08,  3.67it/s]
 21%|██        | 78444/371472 [6:14:29<22:26:44,  3.63it/s]
 21%|██        | 78445/371472 [6:14:29<21:49:44,  3.73it/s]
 21%|██        | 78446/371472 [6:14:29<21:56:12,  3.71it/s]
 21%|██        | 78447/371472 [6:14:29<22:01:26,  3.70it/s]
 21%|██        | 78448/371472 [6:14:30<21:45:33,  3.74it/s]
 21%|██        | 78449/371472 [6:14:30<21:32:55,  3.78it/s]
 21%|██        | 78450/371472 [6:14:30<21:43:30,  3.75it/s]
 21%|██        | 78451/371472 [6:14:30<21:39:41,  3.76it/s]
 21%|██        | 78452/371472 [6:14:31<21:51:10,  3.72it/s]
 21%|██        | 78453/371472 [6:14:31<21:58:50,  3.70it/s]
 21%|██        | 78454/371472 [6:14:31<22:15:42,  3.66it/s]
 21%|██        | 78455/371472 [6:14:32<22:59:06,  3.54it/s]
 21%|██        | 78456/371472 [6:14:32<22:27:31,  3.62it/s]
 21%|██        | 78457/371472 [6:14:32<24:20:08,  3.34it/s]
 21%|██        | 78458/371472 [6:14:32<23:38:40,  3.44it/s]
 21%|██        | 78459/371472 [6:14:33<23:10:00,  3.51it/s]
 21%|██        | 78460/371472 [6:14:33<22:05:08,  3.69it/s]
                                                           
{'loss': 4.0663, 'learning_rate': 8.102900299510871e-07, 'epoch': 3.38}

 21%|██        | 78460/371472 [6:14:33<22:05:08,  3.69it/s]
 21%|██        | 78461/371472 [6:14:33<22:09:28,  3.67it/s]
 21%|██        | 78462/371472 [6:14:34<23:07:49,  3.52it/s]
 21%|██        | 78463/371472 [6:14:34<23:40:47,  3.44it/s]
 21%|██        | 78464/371472 [6:14:34<22:56:42,  3.55it/s]
 21%|██        | 78465/371472 [6:14:34<22:31:12,  3.61it/s]
 21%|██        | 78466/371472 [6:14:35<22:23:09,  3.64it/s]
 21%|██        | 78467/371472 [6:14:35<22:25:21,  3.63it/s]
 21%|██        | 78468/371472 [6:14:35<22:05:00,  3.69it/s]
 21%|██        | 78469/371472 [6:14:36<24:48:08,  3.28it/s]
 21%|██        | 78470/371472 [6:14:36<23:42:27,  3.43it/s]
 21%|██        | 78471/371472 [6:14:36<24:26:54,  3.33it/s]
 21%|██        | 78472/371472 [6:14:36<23:17:46,  3.49it/s]
 21%|██        | 78473/371472 [6:14:37<23:16:55,  3.50it/s]
 21%|██        | 78474/371472 [6:14:37<22:32:58,  3.61it/s]
 21%|██        | 78475/371472 [6:14:37<21:49:50,  3.73it/s]
 21%|██        | 78476/371472 [6:14:38<23:01:04,  3.54it/s]
 21%|██        | 78477/371472 [6:14:38<24:50:56,  3.28it/s]
 21%|██        | 78478/371472 [6:14:38<26:12:04,  3.11it/s]
 21%|██        | 78479/371472 [6:14:39<25:10:24,  3.23it/s]
 21%|██        | 78480/371472 [6:14:39<29:21:30,  2.77it/s]
                                                           
{'loss': 4.3074, 'learning_rate': 8.102415479756081e-07, 'epoch': 3.38}

 21%|██        | 78480/371472 [6:14:39<29:21:30,  2.77it/s]
 21%|██        | 78481/371472 [6:14:39<28:39:59,  2.84it/s]
 21%|██        | 78482/371472 [6:14:40<28:02:43,  2.90it/s]
 21%|██        | 78483/371472 [6:14:40<28:00:33,  2.91it/s]
 21%|██        | 78484/371472 [6:14:40<25:59:52,  3.13it/s]
 21%|██        | 78485/371472 [6:14:41<24:21:12,  3.34it/s]
 21%|██        | 78486/371472 [6:14:41<23:32:10,  3.46it/s]
 21%|██        | 78487/371472 [6:14:41<23:39:33,  3.44it/s]
 21%|██        | 78488/371472 [6:14:41<25:03:59,  3.25it/s]
 21%|██        | 78489/371472 [6:14:42<24:18:28,  3.35it/s]
 21%|██        | 78490/371472 [6:14:42<22:58:41,  3.54it/s]
 21%|██        | 78491/371472 [6:14:42<22:38:54,  3.59it/s]
 21%|██        | 78492/371472 [6:14:42<22:24:52,  3.63it/s]
 21%|██        | 78493/371472 [6:14:43<22:10:40,  3.67it/s]
 21%|██        | 78494/371472 [6:14:43<24:23:52,  3.34it/s]
 21%|██        | 78495/371472 [6:14:43<23:33:42,  3.45it/s]
 21%|██        | 78496/371472 [6:14:44<23:05:15,  3.52it/s]
 21%|██        | 78497/371472 [6:14:44<21:53:20,  3.72it/s]
 21%|██        | 78498/371472 [6:14:44<21:36:11,  3.77it/s]
 21%|██        | 78499/371472 [6:14:45<26:27:33,  3.08it/s]
 21%|██        | 78500/371472 [6:14:45<24:31:21,  3.32it/s]
                                                           
{'loss': 3.9928, 'learning_rate': 8.101930660001293e-07, 'epoch': 3.38}

 21%|██        | 78500/371472 [6:14:45<24:31:21,  3.32it/s]
 21%|██        | 78501/371472 [6:14:45<24:11:54,  3.36it/s]
 21%|██        | 78502/371472 [6:14:45<24:16:22,  3.35it/s]
 21%|██        | 78503/371472 [6:14:46<23:19:48,  3.49it/s]
 21%|██        | 78504/371472 [6:14:46<22:25:28,  3.63it/s]
 21%|██        | 78505/371472 [6:14:46<23:36:08,  3.45it/s]
 21%|██        | 78506/371472 [6:14:47<23:44:01,  3.43it/s]
 21%|██        | 78507/371472 [6:14:47<22:48:32,  3.57it/s]
 21%|██        | 78508/371472 [6:14:47<23:00:26,  3.54it/s]
 21%|██        | 78509/371472 [6:14:47<22:07:38,  3.68it/s]
 21%|██        | 78510/371472 [6:14:48<23:04:18,  3.53it/s]
 21%|██        | 78511/371472 [6:14:48<21:59:54,  3.70it/s]
 21%|██        | 78512/371472 [6:14:48<21:38:22,  3.76it/s]
 21%|██        | 78513/371472 [6:14:48<23:03:07,  3.53it/s]
 21%|██        | 78514/371472 [6:14:49<24:53:42,  3.27it/s]
 21%|██        | 78515/371472 [6:14:49<25:11:46,  3.23it/s]
 21%|██        | 78516/371472 [6:14:49<24:29:36,  3.32it/s]
 21%|██        | 78517/371472 [6:14:50<24:15:50,  3.35it/s]
 21%|██        | 78518/371472 [6:14:50<23:59:18,  3.39it/s]
 21%|██        | 78519/371472 [6:14:50<23:13:42,  3.50it/s]
 21%|██        | 78520/371472 [6:14:51<22:41:17,  3.59it/s]
                                                           
{'loss': 4.0386, 'learning_rate': 8.101445840246503e-07, 'epoch': 3.38}

 21%|██        | 78520/371472 [6:14:51<22:41:17,  3.59it/s]
 21%|██        | 78521/371472 [6:14:51<21:53:59,  3.72it/s]
 21%|██        | 78522/371472 [6:14:51<21:19:06,  3.82it/s]
 21%|██        | 78523/371472 [6:14:51<21:28:25,  3.79it/s]
 21%|██        | 78524/371472 [6:14:52<22:10:38,  3.67it/s]
 21%|██        | 78525/371472 [6:14:52<22:48:00,  3.57it/s]
 21%|██        | 78526/371472 [6:14:52<21:54:01,  3.72it/s]
 21%|██        | 78527/371472 [6:14:52<23:43:26,  3.43it/s]
 21%|██        | 78528/371472 [6:14:53<23:33:19,  3.45it/s]
 21%|██        | 78529/371472 [6:14:53<23:03:19,  3.53it/s]
 21%|██        | 78530/371472 [6:14:53<22:05:56,  3.68it/s]
 21%|██        | 78531/371472 [6:14:54<21:34:45,  3.77it/s]
 21%|██        | 78532/371472 [6:14:54<21:04:49,  3.86it/s]
 21%|██        | 78533/371472 [6:14:54<21:10:14,  3.84it/s]
 21%|██        | 78534/371472 [6:14:54<20:36:45,  3.95it/s]
 21%|██        | 78535/371472 [6:14:55<20:55:53,  3.89it/s]
 21%|██        | 78536/371472 [6:14:55<22:31:27,  3.61it/s]
 21%|██        | 78537/371472 [6:14:55<22:43:16,  3.58it/s]
 21%|██        | 78538/371472 [6:14:55<21:58:42,  3.70it/s]
 21%|██        | 78539/371472 [6:14:56<21:42:00,  3.75it/s]
 21%|██        | 78540/371472 [6:14:56<22:07:23,  3.68it/s]
                                                           
{'loss': 4.1422, 'learning_rate': 8.100961020491715e-07, 'epoch': 3.38}

 21%|██        | 78540/371472 [6:14:56<22:07:23,  3.68it/s]
 21%|██        | 78541/371472 [6:14:56<21:38:08,  3.76it/s]
 21%|██        | 78542/371472 [6:14:57<22:46:08,  3.57it/s]
 21%|██        | 78543/371472 [6:14:57<23:07:30,  3.52it/s]
 21%|██        | 78544/371472 [6:14:57<22:35:48,  3.60it/s]
 21%|██        | 78545/371472 [6:14:57<21:36:21,  3.77it/s]
 21%|██        | 78546/371472 [6:14:58<21:45:08,  3.74it/s]
 21%|██        | 78547/371472 [6:14:58<21:24:09,  3.80it/s]
 21%|██        | 78548/371472 [6:14:58<21:36:19,  3.77it/s]
 21%|██        | 78549/371472 [6:14:58<21:57:13,  3.71it/s]
 21%|██        | 78550/371472 [6:14:59<22:17:18,  3.65it/s]
 21%|██        | 78551/371472 [6:14:59<26:37:16,  3.06it/s]
 21%|██        | 78552/371472 [6:14:59<24:52:18,  3.27it/s]
 21%|██        | 78553/371472 [6:15:00<24:12:43,  3.36it/s]
 21%|██        | 78554/371472 [6:15:00<24:10:52,  3.36it/s]
 21%|██        | 78555/371472 [6:15:00<24:16:10,  3.35it/s]
 21%|██        | 78556/371472 [6:15:01<23:43:08,  3.43it/s]
 21%|██        | 78557/371472 [6:15:01<23:44:37,  3.43it/s]
 21%|██        | 78558/371472 [6:15:01<22:37:51,  3.60it/s]
 21%|██        | 78559/371472 [6:15:01<22:56:01,  3.55it/s]
 21%|██        | 78560/371472 [6:15:02<25:01:30,  3.25it/s]
                                                           
{'loss': 4.1758, 'learning_rate': 8.100476200736925e-07, 'epoch': 3.38}

 21%|██        | 78560/371472 [6:15:02<25:01:30,  3.25it/s]
 21%|██        | 78561/371472 [6:15:02<23:48:34,  3.42it/s]
 21%|██        | 78562/371472 [6:15:02<23:41:33,  3.43it/s]
 21%|██        | 78563/371472 [6:15:03<24:46:32,  3.28it/s]
 21%|██        | 78564/371472 [6:15:03<24:34:50,  3.31it/s]
 21%|██        | 78565/371472 [6:15:03<24:06:21,  3.38it/s]
 21%|██        | 78566/371472 [6:15:03<23:08:08,  3.52it/s]
 21%|██        | 78567/371472 [6:15:04<22:54:12,  3.55it/s]
 21%|██        | 78568/371472 [6:15:04<22:40:24,  3.59it/s]
 21%|██        | 78569/371472 [6:15:04<22:28:51,  3.62it/s]
 21%|██        | 78570/371472 [6:15:05<22:35:51,  3.60it/s]
 21%|██        | 78571/371472 [6:15:05<22:55:39,  3.55it/s]
 21%|██        | 78572/371472 [6:15:05<22:06:19,  3.68it/s]
 21%|██        | 78573/371472 [6:15:05<22:30:51,  3.61it/s]
 21%|██        | 78574/371472 [6:15:06<23:59:48,  3.39it/s]
 21%|██        | 78575/371472 [6:15:06<24:04:46,  3.38it/s]
 21%|██        | 78576/371472 [6:15:06<23:57:04,  3.40it/s]
 21%|██        | 78577/371472 [6:15:07<23:58:09,  3.39it/s]
 21%|██        | 78578/371472 [6:15:07<22:56:49,  3.55it/s]
 21%|██        | 78579/371472 [6:15:07<24:26:14,  3.33it/s]
 21%|██        | 78580/371472 [6:15:07<23:33:47,  3.45it/s]
                                                           
{'loss': 4.0686, 'learning_rate': 8.099991380982137e-07, 'epoch': 3.38}

 21%|██        | 78580/371472 [6:15:07<23:33:47,  3.45it/s]
 21%|██        | 78581/371472 [6:15:08<24:32:49,  3.31it/s]
 21%|██        | 78582/371472 [6:15:08<25:27:17,  3.20it/s]
 21%|██        | 78583/371472 [6:15:08<26:07:17,  3.11it/s]
 21%|██        | 78584/371472 [6:15:09<25:45:05,  3.16it/s]
 21%|██        | 78585/371472 [6:15:09<24:30:27,  3.32it/s]
 21%|██        | 78586/371472 [6:15:09<23:51:34,  3.41it/s]
 21%|██        | 78587/371472 [6:15:10<22:33:43,  3.61it/s]
 21%|██        | 78588/371472 [6:15:10<21:42:38,  3.75it/s]
 21%|██        | 78589/371472 [6:15:10<21:10:49,  3.84it/s]
 21%|██        | 78590/371472 [6:15:10<22:48:35,  3.57it/s]
 21%|██        | 78591/371472 [6:15:11<26:26:45,  3.08it/s]
 21%|██        | 78592/371472 [6:15:11<25:51:00,  3.15it/s]
 21%|██        | 78593/371472 [6:15:11<24:48:57,  3.28it/s]
 21%|██        | 78594/371472 [6:15:12<23:53:12,  3.41it/s]
 21%|██        | 78595/371472 [6:15:12<22:37:27,  3.60it/s]
 21%|██        | 78596/371472 [6:15:12<21:49:00,  3.73it/s]
 21%|██        | 78597/371472 [6:15:12<23:07:29,  3.52it/s]
 21%|██        | 78598/371472 [6:15:13<24:28:20,  3.32it/s]
 21%|██        | 78599/371472 [6:15:13<23:30:52,  3.46it/s]
 21%|██        | 78600/371472 [6:15:13<22:37:20,  3.60it/s]
                                                           
{'loss': 4.2067, 'learning_rate': 8.099506561227349e-07, 'epoch': 3.39}

 21%|██        | 78600/371472 [6:15:13<22:37:20,  3.60it/s]
 21%|██        | 78601/371472 [6:15:14<21:40:13,  3.75it/s]
 21%|██        | 78602/371472 [6:15:14<21:08:28,  3.85it/s]
 21%|██        | 78603/371472 [6:15:14<23:49:35,  3.41it/s]
 21%|██        | 78604/371472 [6:15:14<25:11:44,  3.23it/s]
 21%|██        | 78605/371472 [6:15:15<24:52:59,  3.27it/s]
 21%|██        | 78606/371472 [6:15:15<23:28:44,  3.46it/s]
 21%|██        | 78607/371472 [6:15:15<22:14:21,  3.66it/s]
 21%|██        | 78608/371472 [6:15:16<21:33:08,  3.77it/s]
 21%|██        | 78609/371472 [6:15:16<23:21:43,  3.48it/s]
 21%|██        | 78610/371472 [6:15:16<26:06:33,  3.12it/s]
 21%|██        | 78611/371472 [6:15:17<26:17:06,  3.09it/s]
 21%|██        | 78612/371472 [6:15:17<25:02:51,  3.25it/s]
 21%|██        | 78613/371472 [6:15:17<24:03:25,  3.38it/s]
 21%|██        | 78614/371472 [6:15:17<23:44:52,  3.43it/s]
 21%|██        | 78615/371472 [6:15:18<23:21:31,  3.48it/s]
 21%|██        | 78616/371472 [6:15:18<22:12:47,  3.66it/s]
 21%|██        | 78617/371472 [6:15:18<21:57:11,  3.71it/s]
 21%|██        | 78618/371472 [6:15:18<22:41:39,  3.58it/s]
 21%|██        | 78619/371472 [6:15:19<22:32:50,  3.61it/s]
 21%|██        | 78620/371472 [6:15:19<21:58:56,  3.70it/s]
                                                           
{'loss': 4.0233, 'learning_rate': 8.09902174147256e-07, 'epoch': 3.39}

 21%|██        | 78620/371472 [6:15:19<21:58:56,  3.70it/s]
 21%|██        | 78621/371472 [6:15:19<21:37:44,  3.76it/s]
 21%|██        | 78622/371472 [6:15:20<25:06:37,  3.24it/s]
 21%|██        | 78623/371472 [6:15:20<24:34:20,  3.31it/s]
 21%|██        | 78624/371472 [6:15:20<23:38:36,  3.44it/s]
 21%|██        | 78625/371472 [6:15:21<24:18:58,  3.35it/s]
 21%|██        | 78626/371472 [6:15:21<23:59:58,  3.39it/s]
 21%|██        | 78627/371472 [6:15:21<23:11:56,  3.51it/s]
 21%|██        | 78628/371472 [6:15:21<24:48:51,  3.28it/s]
 21%|██        | 78629/371472 [6:15:22<23:39:37,  3.44it/s]
 21%|██        | 78630/371472 [6:15:22<22:34:36,  3.60it/s]
 21%|██        | 78631/371472 [6:15:22<21:59:27,  3.70it/s]
 21%|██        | 78632/371472 [6:15:22<21:23:31,  3.80it/s]
 21%|██        | 78633/371472 [6:15:23<22:07:33,  3.68it/s]
 21%|██        | 78634/371472 [6:15:23<22:03:35,  3.69it/s]
 21%|██        | 78635/371472 [6:15:23<24:56:44,  3.26it/s]
 21%|██        | 78636/371472 [6:15:24<25:42:53,  3.16it/s]
 21%|██        | 78637/371472 [6:15:24<25:01:45,  3.25it/s]
 21%|██        | 78638/371472 [6:15:24<24:48:54,  3.28it/s]
 21%|██        | 78639/371472 [6:15:25<24:21:52,  3.34it/s]
 21%|██        | 78640/371472 [6:15:25<24:29:39,  3.32it/s]
                                                           
{'loss': 4.0246, 'learning_rate': 8.098536921717769e-07, 'epoch': 3.39}

 21%|██        | 78640/371472 [6:15:25<24:29:39,  3.32it/s]
 21%|██        | 78641/371472 [6:15:25<23:57:48,  3.39it/s]
 21%|██        | 78642/371472 [6:15:25<22:23:07,  3.63it/s]
 21%|██        | 78643/371472 [6:15:26<22:27:21,  3.62it/s]
 21%|██        | 78644/371472 [6:15:26<24:13:13,  3.36it/s]
 21%|██        | 78645/371472 [6:15:26<22:34:33,  3.60it/s]
 21%|██        | 78646/371472 [6:15:27<21:46:07,  3.74it/s]
 21%|██        | 78647/371472 [6:15:27<21:32:11,  3.78it/s]
 21%|██        | 78648/371472 [6:15:27<21:59:11,  3.70it/s]
 21%|██        | 78649/371472 [6:15:27<21:16:47,  3.82it/s]
 21%|██        | 78650/371472 [6:15:28<21:05:47,  3.86it/s]
 21%|██        | 78651/371472 [6:15:28<21:06:53,  3.85it/s]
 21%|██        | 78652/371472 [6:15:28<21:07:07,  3.85it/s]
 21%|██        | 78653/371472 [6:15:28<21:02:34,  3.87it/s]
 21%|██        | 78654/371472 [6:15:29<20:59:19,  3.88it/s]
 21%|██        | 78655/371472 [6:15:29<20:55:44,  3.89it/s]
 21%|██        | 78656/371472 [6:15:29<21:41:30,  3.75it/s]
 21%|██        | 78657/371472 [6:15:29<21:08:39,  3.85it/s]
 21%|██        | 78658/371472 [6:15:30<21:45:14,  3.74it/s]
 21%|██        | 78659/371472 [6:15:30<21:42:59,  3.75it/s]
 21%|██        | 78660/371472 [6:15:30<22:04:51,  3.68it/s]
                                                           
{'loss': 4.0137, 'learning_rate': 8.098052101962981e-07, 'epoch': 3.39}

 21%|██        | 78660/371472 [6:15:30<22:04:51,  3.68it/s]
 21%|██        | 78661/371472 [6:15:30<22:12:25,  3.66it/s]
 21%|██        | 78662/371472 [6:15:31<22:24:36,  3.63it/s]
 21%|██        | 78663/371472 [6:15:31<22:12:01,  3.66it/s]
 21%|██        | 78664/371472 [6:15:31<25:17:40,  3.22it/s]
 21%|██        | 78665/371472 [6:15:32<25:51:39,  3.15it/s]
 21%|██        | 78666/371472 [6:15:32<25:48:51,  3.15it/s]
 21%|██        | 78667/371472 [6:15:32<24:57:24,  3.26it/s]
 21%|██        | 78668/371472 [6:15:33<24:47:56,  3.28it/s]
 21%|██        | 78669/371472 [6:15:33<23:59:21,  3.39it/s]
 21%|██        | 78670/371472 [6:15:33<23:05:14,  3.52it/s]
 21%|██        | 78671/371472 [6:15:33<22:43:18,  3.58it/s]
 21%|██        | 78672/371472 [6:15:34<22:51:17,  3.56it/s]
 21%|██        | 78673/371472 [6:15:34<22:24:15,  3.63it/s]
 21%|██        | 78674/371472 [6:15:34<22:03:48,  3.69it/s]
 21%|██        | 78675/371472 [6:15:35<22:17:39,  3.65it/s]
 21%|██        | 78676/371472 [6:15:35<21:45:47,  3.74it/s]
 21%|██        | 78677/371472 [6:15:35<21:14:53,  3.83it/s]
 21%|██        | 78678/371472 [6:15:35<20:48:16,  3.91it/s]
 21%|██        | 78679/371472 [6:15:36<21:16:35,  3.82it/s]
 21%|██        | 78680/371472 [6:15:36<22:52:53,  3.55it/s]
                                                           
{'loss': 4.1523, 'learning_rate': 8.097567282208192e-07, 'epoch': 3.39}

 21%|██        | 78680/371472 [6:15:36<22:52:53,  3.55it/s]
 21%|██        | 78681/371472 [6:15:36<23:48:05,  3.42it/s]
 21%|██        | 78682/371472 [6:15:37<23:47:51,  3.42it/s]
 21%|██        | 78683/371472 [6:15:37<23:00:02,  3.54it/s]
 21%|██        | 78684/371472 [6:15:37<22:01:28,  3.69it/s]
 21%|██        | 78685/371472 [6:15:37<21:45:37,  3.74it/s]
 21%|██        | 78686/371472 [6:15:38<25:17:47,  3.22it/s]
 21%|██        | 78687/371472 [6:15:38<24:43:29,  3.29it/s]
 21%|██        | 78688/371472 [6:15:38<25:41:23,  3.17it/s]
 21%|██        | 78689/371472 [6:15:39<25:19:31,  3.21it/s]
 21%|██        | 78690/371472 [6:15:39<27:26:39,  2.96it/s]
 21%|██        | 78691/371472 [6:15:39<26:06:41,  3.11it/s]
 21%|██        | 78692/371472 [6:15:40<25:04:22,  3.24it/s]
 21%|██        | 78693/371472 [6:15:40<24:30:08,  3.32it/s]
 21%|██        | 78694/371472 [6:15:40<23:11:11,  3.51it/s]
 21%|██        | 78695/371472 [6:15:40<23:10:48,  3.51it/s]
 21%|██        | 78696/371472 [6:15:41<23:20:06,  3.49it/s]
 21%|██        | 78697/371472 [6:15:41<23:06:45,  3.52it/s]
 21%|██        | 78698/371472 [6:15:41<22:48:11,  3.57it/s]
 21%|██        | 78699/371472 [6:15:41<21:41:47,  3.75it/s]
 21%|██        | 78700/371472 [6:15:42<21:03:56,  3.86it/s]
                                                           
{'loss': 4.0293, 'learning_rate': 8.097082462453403e-07, 'epoch': 3.39}

 21%|██        | 78700/371472 [6:15:42<21:03:56,  3.86it/s]
 21%|██        | 78701/371472 [6:15:42<23:34:32,  3.45it/s]
 21%|██        | 78702/371472 [6:15:42<22:27:18,  3.62it/s]
 21%|██        | 78703/371472 [6:15:43<22:29:35,  3.62it/s]
 21%|██        | 78704/371472 [6:15:43<22:58:24,  3.54it/s]
 21%|██        | 78705/371472 [6:15:43<23:08:59,  3.51it/s]
 21%|██        | 78706/371472 [6:15:43<22:43:05,  3.58it/s]
 21%|██        | 78707/371472 [6:15:44<22:14:12,  3.66it/s]
 21%|██        | 78708/371472 [6:15:44<22:01:32,  3.69it/s]
 21%|██        | 78709/371472 [6:15:44<25:01:02,  3.25it/s]
 21%|██        | 78710/371472 [6:15:45<23:35:57,  3.45it/s]
 21%|██        | 78711/371472 [6:15:45<24:09:10,  3.37it/s]
 21%|██        | 78712/371472 [6:15:45<24:02:10,  3.38it/s]
 21%|██        | 78713/371472 [6:15:45<23:26:07,  3.47it/s]
 21%|██        | 78714/371472 [6:15:46<24:56:51,  3.26it/s]
 21%|██        | 78715/371472 [6:15:46<25:36:52,  3.17it/s]
 21%|██        | 78716/371472 [6:15:46<24:00:04,  3.39it/s]
 21%|██        | 78717/371472 [6:15:47<23:07:52,  3.52it/s]
 21%|██        | 78718/371472 [6:15:47<24:19:05,  3.34it/s]
 21%|██        | 78719/371472 [6:15:47<23:13:53,  3.50it/s]
 21%|██        | 78720/371472 [6:15:48<22:39:38,  3.59it/s]
                                                           
{'loss': 4.1168, 'learning_rate': 8.096597642698614e-07, 'epoch': 3.39}

 21%|██        | 78720/371472 [6:15:48<22:39:38,  3.59it/s]
 21%|██        | 78721/371472 [6:15:48<22:51:16,  3.56it/s]
 21%|██        | 78722/371472 [6:15:48<23:01:41,  3.53it/s]
 21%|██        | 78723/371472 [6:15:48<22:49:21,  3.56it/s]
 21%|██        | 78724/371472 [6:15:49<22:30:30,  3.61it/s]
 21%|██        | 78725/371472 [6:15:49<21:34:30,  3.77it/s]
 21%|██        | 78726/371472 [6:15:49<20:57:12,  3.88it/s]
 21%|██        | 78727/371472 [6:15:49<21:29:04,  3.78it/s]
 21%|██        | 78728/371472 [6:15:50<21:39:35,  3.75it/s]
 21%|██        | 78729/371472 [6:15:50<21:13:59,  3.83it/s]
 21%|██        | 78730/371472 [6:15:50<21:35:47,  3.77it/s]
 21%|██        | 78731/371472 [6:15:50<21:57:10,  3.70it/s]
 21%|██        | 78732/371472 [6:15:51<21:22:00,  3.81it/s]
 21%|██        | 78733/371472 [6:15:51<24:20:20,  3.34it/s]
 21%|██        | 78734/371472 [6:15:51<23:59:56,  3.39it/s]
 21%|██        | 78735/371472 [6:15:52<24:26:29,  3.33it/s]
 21%|██        | 78736/371472 [6:15:52<24:28:46,  3.32it/s]
 21%|██        | 78737/371472 [6:15:52<25:02:26,  3.25it/s]
 21%|██        | 78738/371472 [6:15:53<27:24:14,  2.97it/s]
 21%|██        | 78739/371472 [6:15:53<25:56:33,  3.13it/s]
 21%|██        | 78740/371472 [6:15:53<25:01:34,  3.25it/s]
                                                           
{'loss': 4.0346, 'learning_rate': 8.096112822943826e-07, 'epoch': 3.39}

 21%|██        | 78740/371472 [6:15:53<25:01:34,  3.25it/s]
 21%|██        | 78741/371472 [6:15:54<24:08:53,  3.37it/s]
 21%|██        | 78742/371472 [6:15:54<23:19:54,  3.49it/s]
 21%|██        | 78743/371472 [6:15:54<22:36:41,  3.60it/s]
 21%|██        | 78744/371472 [6:15:54<21:47:17,  3.73it/s]
 21%|██        | 78745/371472 [6:15:55<21:13:50,  3.83it/s]
 21%|██        | 78746/371472 [6:15:55<21:10:32,  3.84it/s]
 21%|██        | 78747/371472 [6:15:55<22:54:55,  3.55it/s]
 21%|██        | 78748/371472 [6:15:55<22:22:29,  3.63it/s]
 21%|██        | 78749/371472 [6:15:56<22:30:48,  3.61it/s]
 21%|██        | 78750/371472 [6:15:56<23:42:24,  3.43it/s]
 21%|██        | 78751/371472 [6:15:56<23:28:12,  3.46it/s]
 21%|██        | 78752/371472 [6:15:57<23:10:51,  3.51it/s]
 21%|██        | 78753/371472 [6:15:57<25:12:40,  3.23it/s]
 21%|██        | 78754/371472 [6:15:57<24:56:44,  3.26it/s]
 21%|██        | 78755/371472 [6:15:58<26:14:20,  3.10it/s]
 21%|██        | 78756/371472 [6:15:58<25:00:05,  3.25it/s]
 21%|██        | 78757/371472 [6:15:58<24:35:59,  3.31it/s]
 21%|██        | 78758/371472 [6:15:58<23:44:13,  3.43it/s]
 21%|██        | 78759/371472 [6:15:59<23:09:03,  3.51it/s]
 21%|██        | 78760/371472 [6:15:59<23:40:33,  3.43it/s]
                                                           
{'loss': 4.0009, 'learning_rate': 8.095628003189037e-07, 'epoch': 3.39}

 21%|██        | 78760/371472 [6:15:59<23:40:33,  3.43it/s]
 21%|██        | 78761/371472 [6:15:59<23:06:14,  3.52it/s]
 21%|██        | 78762/371472 [6:16:00<22:26:40,  3.62it/s]
 21%|██        | 78763/371472 [6:16:00<22:50:20,  3.56it/s]
 21%|██        | 78764/371472 [6:16:00<22:36:13,  3.60it/s]
 21%|██        | 78765/371472 [6:16:00<22:51:52,  3.56it/s]
 21%|██        | 78766/371472 [6:16:01<22:28:00,  3.62it/s]
 21%|██        | 78767/371472 [6:16:01<24:03:41,  3.38it/s]
 21%|██        | 78768/371472 [6:16:01<23:56:57,  3.39it/s]
 21%|██        | 78769/371472 [6:16:02<24:39:47,  3.30it/s]
 21%|██        | 78770/371472 [6:16:02<25:45:07,  3.16it/s]
 21%|██        | 78771/371472 [6:16:02<24:52:40,  3.27it/s]
 21%|██        | 78772/371472 [6:16:03<23:50:22,  3.41it/s]
 21%|██        | 78773/371472 [6:16:03<23:35:13,  3.45it/s]
 21%|██        | 78774/371472 [6:16:03<23:11:06,  3.51it/s]
 21%|██        | 78775/371472 [6:16:03<22:55:05,  3.55it/s]
 21%|██        | 78776/371472 [6:16:04<22:47:36,  3.57it/s]
 21%|██        | 78777/371472 [6:16:04<22:05:55,  3.68it/s]
 21%|██        | 78778/371472 [6:16:04<22:30:27,  3.61it/s]
 21%|██        | 78779/371472 [6:16:04<23:05:52,  3.52it/s]
 21%|██        | 78780/371472 [6:16:05<23:40:34,  3.43it/s]
                                                           
{'loss': 4.0161, 'learning_rate': 8.095143183434246e-07, 'epoch': 3.39}

 21%|██        | 78780/371472 [6:16:05<23:40:34,  3.43it/s]
 21%|██        | 78781/371472 [6:16:05<23:33:05,  3.45it/s]
 21%|██        | 78782/371472 [6:16:05<22:49:44,  3.56it/s]
 21%|██        | 78783/371472 [6:16:06<23:11:50,  3.50it/s]
 21%|██        | 78784/371472 [6:16:06<23:12:42,  3.50it/s]
 21%|██        | 78785/371472 [6:16:06<23:25:03,  3.47it/s]
 21%|██        | 78786/371472 [6:16:06<23:30:28,  3.46it/s]
 21%|██        | 78787/371472 [6:16:07<22:41:57,  3.58it/s]
 21%|██        | 78788/371472 [6:16:07<23:02:20,  3.53it/s]
 21%|██        | 78789/371472 [6:16:07<23:25:51,  3.47it/s]
 21%|██        | 78790/371472 [6:16:08<22:19:50,  3.64it/s]
 21%|██        | 78791/371472 [6:16:08<24:52:32,  3.27it/s]
 21%|██        | 78792/371472 [6:16:08<25:41:50,  3.16it/s]
 21%|██        | 78793/371472 [6:16:09<24:31:16,  3.32it/s]
 21%|██        | 78794/371472 [6:16:09<24:52:40,  3.27it/s]
 21%|██        | 78795/371472 [6:16:09<26:11:12,  3.10it/s]
 21%|██        | 78796/371472 [6:16:10<25:08:25,  3.23it/s]
 21%|██        | 78797/371472 [6:16:10<23:58:18,  3.39it/s]
 21%|██        | 78798/371472 [6:16:10<23:35:10,  3.45it/s]
 21%|██        | 78799/371472 [6:16:10<22:53:22,  3.55it/s]
 21%|██        | 78800/371472 [6:16:11<23:05:22,  3.52it/s]
                                                           
{'loss': 4.1611, 'learning_rate': 8.094658363679458e-07, 'epoch': 3.39}

 21%|██        | 78800/371472 [6:16:11<23:05:22,  3.52it/s]
 21%|██        | 78801/371472 [6:16:11<27:11:31,  2.99it/s]
 21%|██        | 78802/371472 [6:16:11<26:40:16,  3.05it/s]
 21%|██        | 78803/371472 [6:16:12<26:36:07,  3.06it/s]
 21%|██        | 78804/371472 [6:16:12<25:21:55,  3.21it/s]
 21%|██        | 78805/371472 [6:16:12<23:53:08,  3.40it/s]
 21%|██        | 78806/371472 [6:16:13<24:15:06,  3.35it/s]
 21%|██        | 78807/371472 [6:16:13<24:20:58,  3.34it/s]
 21%|██        | 78808/371472 [6:16:13<23:23:37,  3.48it/s]
 21%|██        | 78809/371472 [6:16:13<23:11:26,  3.51it/s]
 21%|██        | 78810/371472 [6:16:14<22:15:54,  3.65it/s]
 21%|██        | 78811/371472 [6:16:14<22:36:06,  3.60it/s]
 21%|██        | 78812/371472 [6:16:14<22:55:31,  3.55it/s]
 21%|██        | 78813/371472 [6:16:15<23:39:24,  3.44it/s]
 21%|██        | 78814/371472 [6:16:15<23:01:16,  3.53it/s]
 21%|██        | 78815/371472 [6:16:15<22:23:52,  3.63it/s]
 21%|██        | 78816/371472 [6:16:15<22:41:29,  3.58it/s]
 21%|██        | 78817/371472 [6:16:16<22:04:33,  3.68it/s]
 21%|██        | 78818/371472 [6:16:16<21:48:47,  3.73it/s]
 21%|██        | 78819/371472 [6:16:16<22:04:26,  3.68it/s]
 21%|██        | 78820/371472 [6:16:16<22:00:59,  3.69it/s]
                                                           
{'loss': 4.1065, 'learning_rate': 8.09417354392467e-07, 'epoch': 3.39}

 21%|██        | 78820/371472 [6:16:16<22:00:59,  3.69it/s]
 21%|██        | 78821/371472 [6:16:17<22:54:08,  3.55it/s]
 21%|██        | 78822/371472 [6:16:17<22:57:59,  3.54it/s]
 21%|██        | 78823/371472 [6:16:17<22:17:15,  3.65it/s]
 21%|██        | 78824/371472 [6:16:18<23:02:01,  3.53it/s]
 21%|██        | 78825/371472 [6:16:18<23:02:48,  3.53it/s]
 21%|██        | 78826/371472 [6:16:18<22:40:29,  3.59it/s]
 21%|██        | 78827/371472 [6:16:18<22:20:21,  3.64it/s]
 21%|██        | 78828/371472 [6:16:19<26:16:27,  3.09it/s]
 21%|██        | 78829/371472 [6:16:19<27:48:35,  2.92it/s]
 21%|██        | 78830/371472 [6:16:19<26:31:33,  3.06it/s]
 21%|██        | 78831/371472 [6:16:20<24:52:03,  3.27it/s]
 21%|██        | 78832/371472 [6:16:20<23:45:42,  3.42it/s]
 21%|██        | 78833/371472 [6:16:20<22:53:29,  3.55it/s]
 21%|██        | 78834/371472 [6:16:21<22:46:45,  3.57it/s]
 21%|██        | 78835/371472 [6:16:21<22:52:53,  3.55it/s]
 21%|██        | 78836/371472 [6:16:21<24:05:24,  3.37it/s]
 21%|██        | 78837/371472 [6:16:21<22:45:44,  3.57it/s]
 21%|██        | 78838/371472 [6:16:22<23:39:28,  3.44it/s]
 21%|██        | 78839/371472 [6:16:22<23:04:18,  3.52it/s]
 21%|██        | 78840/371472 [6:16:22<23:34:02,  3.45it/s]
                                                           
{'loss': 4.0982, 'learning_rate': 8.093688724169881e-07, 'epoch': 3.4}

 21%|██        | 78840/371472 [6:16:22<23:34:02,  3.45it/s]
 21%|██        | 78841/371472 [6:16:23<22:34:29,  3.60it/s]
 21%|██        | 78842/371472 [6:16:23<22:08:05,  3.67it/s]
 21%|██        | 78843/371472 [6:16:23<21:40:28,  3.75it/s]
 21%|██        | 78844/371472 [6:16:23<21:57:08,  3.70it/s]
 21%|██        | 78845/371472 [6:16:24<21:34:32,  3.77it/s]
 21%|██        | 78846/371472 [6:16:24<21:20:28,  3.81it/s]
 21%|██        | 78847/371472 [6:16:24<21:39:25,  3.75it/s]
 21%|██        | 78848/371472 [6:16:24<21:29:54,  3.78it/s]
 21%|██        | 78849/371472 [6:16:25<22:34:22,  3.60it/s]
 21%|██        | 78850/371472 [6:16:25<21:42:54,  3.74it/s]
 21%|██        | 78851/371472 [6:16:25<23:11:51,  3.50it/s]
 21%|██        | 78852/371472 [6:16:26<23:41:12,  3.43it/s]
 21%|██        | 78853/371472 [6:16:26<23:04:08,  3.52it/s]
 21%|██        | 78854/371472 [6:16:26<23:06:00,  3.52it/s]
 21%|██        | 78855/371472 [6:16:26<23:57:49,  3.39it/s]
 21%|██        | 78856/371472 [6:16:27<23:28:38,  3.46it/s]
 21%|██        | 78857/371472 [6:16:27<23:06:32,  3.52it/s]
 21%|██        | 78858/371472 [6:16:27<22:26:23,  3.62it/s]
 21%|██        | 78859/371472 [6:16:27<21:45:47,  3.73it/s]
 21%|██        | 78860/371472 [6:16:28<21:47:48,  3.73it/s]
                                                           
{'loss': 4.2407, 'learning_rate': 8.093203904415091e-07, 'epoch': 3.4}

 21%|██        | 78860/371472 [6:16:28<21:47:48,  3.73it/s]
 21%|██        | 78861/371472 [6:16:28<24:00:27,  3.39it/s]
 21%|██        | 78862/371472 [6:16:28<24:41:02,  3.29it/s]
 21%|██        | 78863/371472 [6:16:29<24:15:06,  3.35it/s]
 21%|██        | 78864/371472 [6:16:29<23:58:58,  3.39it/s]
 21%|██        | 78865/371472 [6:16:29<23:51:09,  3.41it/s]
 21%|██        | 78866/371472 [6:16:30<22:51:53,  3.55it/s]
 21%|██        | 78867/371472 [6:16:30<23:24:47,  3.47it/s]
 21%|██        | 78868/371472 [6:16:30<24:13:19,  3.36it/s]
 21%|██        | 78869/371472 [6:16:30<24:46:55,  3.28it/s]
 21%|██        | 78870/371472 [6:16:31<23:51:28,  3.41it/s]
 21%|██        | 78871/371472 [6:16:31<23:28:38,  3.46it/s]
 21%|██        | 78872/371472 [6:16:31<23:18:10,  3.49it/s]
 21%|██        | 78873/371472 [6:16:32<22:52:00,  3.55it/s]
 21%|██        | 78874/371472 [6:16:32<22:00:35,  3.69it/s]
 21%|██        | 78875/371472 [6:16:32<21:53:13,  3.71it/s]
 21%|██        | 78876/371472 [6:16:32<22:31:20,  3.61it/s]
 21%|██        | 78877/371472 [6:16:33<24:03:45,  3.38it/s]
 21%|██        | 78878/371472 [6:16:33<23:07:21,  3.51it/s]
 21%|██        | 78879/371472 [6:16:33<22:14:39,  3.65it/s]
 21%|██        | 78880/371472 [6:16:33<21:45:09,  3.74it/s]
                                                           
{'loss': 4.1065, 'learning_rate': 8.092719084660303e-07, 'epoch': 3.4}

 21%|██        | 78880/371472 [6:16:33<21:45:09,  3.74it/s]
 21%|██        | 78881/371472 [6:16:34<21:23:35,  3.80it/s]
 21%|██        | 78882/371472 [6:16:34<21:30:41,  3.78it/s]
 21%|██        | 78883/371472 [6:16:34<21:13:33,  3.83it/s]
 21%|██        | 78884/371472 [6:16:35<21:04:00,  3.86it/s]
 21%|██        | 78885/371472 [6:16:35<21:14:10,  3.83it/s]
 21%|██        | 78886/371472 [6:16:35<20:50:20,  3.90it/s]
 21%|██        | 78887/371472 [6:16:35<22:18:16,  3.64it/s]
 21%|██        | 78888/371472 [6:16:36<21:13:12,  3.83it/s]
 21%|██        | 78889/371472 [6:16:36<22:35:12,  3.60it/s]
 21%|██        | 78890/371472 [6:16:36<23:43:59,  3.42it/s]
 21%|██        | 78891/371472 [6:16:36<23:15:22,  3.49it/s]
 21%|██        | 78892/371472 [6:16:37<22:19:20,  3.64it/s]
 21%|██        | 78893/371472 [6:16:37<22:34:19,  3.60it/s]
 21%|██        | 78894/371472 [6:16:37<21:54:57,  3.71it/s]
 21%|██        | 78895/371472 [6:16:38<21:14:07,  3.83it/s]
 21%|██        | 78896/371472 [6:16:38<20:59:08,  3.87it/s]
 21%|██        | 78897/371472 [6:16:38<21:06:29,  3.85it/s]
 21%|██        | 78898/371472 [6:16:38<21:57:48,  3.70it/s]
 21%|██        | 78899/371472 [6:16:39<22:13:00,  3.66it/s]
 21%|██        | 78900/371472 [6:16:39<22:27:36,  3.62it/s]
                                                           
{'loss': 4.0542, 'learning_rate': 8.092234264905514e-07, 'epoch': 3.4}

 21%|██        | 78900/371472 [6:16:39<22:27:36,  3.62it/s]
 21%|██        | 78901/371472 [6:16:39<26:39:33,  3.05it/s]
 21%|██        | 78902/371472 [6:16:40<25:58:00,  3.13it/s]
 21%|██        | 78903/371472 [6:16:40<24:23:18,  3.33it/s]
 21%|██        | 78904/371472 [6:16:40<24:25:00,  3.33it/s]
 21%|██        | 78905/371472 [6:16:41<26:23:18,  3.08it/s]
 21%|██        | 78906/371472 [6:16:41<25:20:01,  3.21it/s]
 21%|██        | 78907/371472 [6:16:41<25:21:10,  3.21it/s]
 21%|██        | 78908/371472 [6:16:42<28:48:47,  2.82it/s]
 21%|██        | 78909/371472 [6:16:42<27:28:44,  2.96it/s]
 21%|██        | 78910/371472 [6:16:42<25:10:51,  3.23it/s]
 21%|██        | 78911/371472 [6:16:42<24:27:50,  3.32it/s]
 21%|██        | 78912/371472 [6:16:43<25:11:28,  3.23it/s]
 21%|██        | 78913/371472 [6:16:43<23:53:23,  3.40it/s]
 21%|██        | 78914/371472 [6:16:43<24:10:46,  3.36it/s]
 21%|██        | 78915/371472 [6:16:44<23:26:19,  3.47it/s]
 21%|██        | 78916/371472 [6:16:44<23:15:54,  3.49it/s]
 21%|██        | 78917/371472 [6:16:44<22:58:41,  3.54it/s]
 21%|██        | 78918/371472 [6:16:45<24:47:11,  3.28it/s]
 21%|██        | 78919/371472 [6:16:45<24:01:16,  3.38it/s]
 21%|██        | 78920/371472 [6:16:45<23:22:07,  3.48it/s]
                                                           
{'loss': 3.9918, 'learning_rate': 8.091749445150725e-07, 'epoch': 3.4}

 21%|██        | 78920/371472 [6:16:45<23:22:07,  3.48it/s]
 21%|██        | 78921/371472 [6:16:45<22:44:33,  3.57it/s]
 21%|██        | 78922/371472 [6:16:46<23:17:06,  3.49it/s]
 21%|██        | 78923/371472 [6:16:46<23:31:45,  3.45it/s]
 21%|██        | 78924/371472 [6:16:46<23:27:58,  3.46it/s]
 21%|██        | 78925/371472 [6:16:47<23:27:30,  3.46it/s]
 21%|██        | 78926/371472 [6:16:47<23:36:12,  3.44it/s]
 21%|██        | 78927/371472 [6:16:47<22:58:52,  3.54it/s]
 21%|██        | 78928/371472 [6:16:47<22:38:26,  3.59it/s]
 21%|██        | 78929/371472 [6:16:48<21:55:17,  3.71it/s]
 21%|██        | 78930/371472 [6:16:48<23:55:58,  3.40it/s]
 21%|██        | 78931/371472 [6:16:48<23:15:22,  3.49it/s]
 21%|██        | 78932/371472 [6:16:48<22:51:33,  3.55it/s]
 21%|██        | 78933/371472 [6:16:49<23:16:57,  3.49it/s]
 21%|██        | 78934/371472 [6:16:49<23:31:27,  3.45it/s]
 21%|██        | 78935/371472 [6:16:49<23:18:36,  3.49it/s]
 21%|██        | 78936/371472 [6:16:50<22:48:51,  3.56it/s]
 21%|██        | 78937/371472 [6:16:50<22:39:13,  3.59it/s]
 21%|██▏       | 78938/371472 [6:16:50<22:04:13,  3.68it/s]
 21%|██▏       | 78939/371472 [6:16:50<22:31:22,  3.61it/s]
 21%|██▏       | 78940/371472 [6:16:51<22:34:32,  3.60it/s]
                                                           
{'loss': 4.2903, 'learning_rate': 8.091264625395935e-07, 'epoch': 3.4}

 21%|██▏       | 78940/371472 [6:16:51<22:34:32,  3.60it/s]
 21%|██▏       | 78941/371472 [6:16:51<22:24:01,  3.63it/s]
 21%|██▏       | 78942/371472 [6:16:51<21:38:59,  3.75it/s]
 21%|██▏       | 78943/371472 [6:16:52<22:12:45,  3.66it/s]
 21%|██▏       | 78944/371472 [6:16:52<22:57:39,  3.54it/s]
 21%|██▏       | 78945/371472 [6:16:52<22:46:38,  3.57it/s]
 21%|██▏       | 78946/371472 [6:16:52<22:46:23,  3.57it/s]
 21%|██▏       | 78947/371472 [6:16:53<22:34:18,  3.60it/s]
 21%|██▏       | 78948/371472 [6:16:53<22:47:25,  3.57it/s]
 21%|██▏       | 78949/371472 [6:16:53<23:09:05,  3.51it/s]
 21%|██▏       | 78950/371472 [6:16:54<23:12:29,  3.50it/s]
 21%|██▏       | 78951/371472 [6:16:54<23:02:20,  3.53it/s]
 21%|██▏       | 78952/371472 [6:16:54<22:33:44,  3.60it/s]
 21%|██▏       | 78953/371472 [6:16:54<21:43:39,  3.74it/s]
 21%|██▏       | 78954/371472 [6:16:55<21:31:20,  3.78it/s]
 21%|██▏       | 78955/371472 [6:16:55<23:00:13,  3.53it/s]
 21%|██▏       | 78956/371472 [6:16:55<22:25:11,  3.62it/s]
 21%|██▏       | 78957/371472 [6:16:55<22:55:20,  3.54it/s]
 21%|██▏       | 78958/371472 [6:16:56<22:30:20,  3.61it/s]
 21%|██▏       | 78959/371472 [6:16:56<24:42:48,  3.29it/s]
 21%|██▏       | 78960/371472 [6:16:56<23:52:06,  3.40it/s]
                                                           
{'loss': 4.0658, 'learning_rate': 8.090779805641147e-07, 'epoch': 3.4}

 21%|██▏       | 78960/371472 [6:16:56<23:52:06,  3.40it/s]
 21%|██▏       | 78961/371472 [6:16:57<24:46:21,  3.28it/s]
 21%|██▏       | 78962/371472 [6:16:57<23:20:56,  3.48it/s]
 21%|██▏       | 78963/371472 [6:16:57<23:27:34,  3.46it/s]
 21%|██▏       | 78964/371472 [6:16:57<22:55:35,  3.54it/s]
 21%|██▏       | 78965/371472 [6:16:58<22:13:58,  3.65it/s]
 21%|██▏       | 78966/371472 [6:16:58<21:33:51,  3.77it/s]
 21%|██▏       | 78967/371472 [6:16:58<22:36:47,  3.59it/s]
 21%|██▏       | 78968/371472 [6:16:59<22:55:18,  3.54it/s]
 21%|██▏       | 78969/371472 [6:16:59<22:13:19,  3.66it/s]
 21%|██▏       | 78970/371472 [6:16:59<21:44:41,  3.74it/s]
 21%|██▏       | 78971/371472 [6:16:59<21:59:32,  3.69it/s]
 21%|██▏       | 78972/371472 [6:17:00<21:29:44,  3.78it/s]
 21%|██▏       | 78973/371472 [6:17:00<23:14:31,  3.50it/s]
 21%|██▏       | 78974/371472 [6:17:00<22:31:00,  3.61it/s]
 21%|██▏       | 78975/371472 [6:17:00<21:42:59,  3.74it/s]
 21%|██▏       | 78976/371472 [6:17:01<22:00:35,  3.69it/s]
 21%|██▏       | 78977/371472 [6:17:01<25:32:20,  3.18it/s]
 21%|██▏       | 78978/371472 [6:17:01<24:11:45,  3.36it/s]
 21%|██▏       | 78979/371472 [6:17:02<22:58:23,  3.54it/s]
 21%|██▏       | 78980/371472 [6:17:02<22:13:05,  3.66it/s]
                                                           
{'loss': 4.1685, 'learning_rate': 8.090294985886359e-07, 'epoch': 3.4}

 21%|██▏       | 78980/371472 [6:17:02<22:13:05,  3.66it/s]
 21%|██▏       | 78981/371472 [6:17:02<22:05:40,  3.68it/s]
 21%|██▏       | 78982/371472 [6:17:02<22:07:54,  3.67it/s]
 21%|██▏       | 78983/371472 [6:17:03<21:30:39,  3.78it/s]
 21%|██▏       | 78984/371472 [6:17:03<23:17:51,  3.49it/s]
 21%|██▏       | 78985/371472 [6:17:03<22:07:15,  3.67it/s]
 21%|██▏       | 78986/371472 [6:17:04<21:56:08,  3.70it/s]
 21%|██▏       | 78987/371472 [6:17:04<21:53:43,  3.71it/s]
 21%|██▏       | 78988/371472 [6:17:04<22:21:01,  3.64it/s]
 21%|██▏       | 78989/371472 [6:17:04<22:15:43,  3.65it/s]
 21%|██▏       | 78990/371472 [6:17:05<22:44:23,  3.57it/s]
 21%|██▏       | 78991/371472 [6:17:05<22:47:01,  3.57it/s]
 21%|██▏       | 78992/371472 [6:17:05<22:08:16,  3.67it/s]
 21%|██▏       | 78993/371472 [6:17:05<21:29:27,  3.78it/s]
 21%|██▏       | 78994/371472 [6:17:06<21:49:46,  3.72it/s]
 21%|██▏       | 78995/371472 [6:17:06<22:17:20,  3.64it/s]
 21%|██▏       | 78996/371472 [6:17:06<21:40:12,  3.75it/s]
 21%|██▏       | 78997/371472 [6:17:07<23:39:50,  3.43it/s]
 21%|██▏       | 78998/371472 [6:17:07<23:40:02,  3.43it/s]
 21%|██▏       | 78999/371472 [6:17:07<22:22:58,  3.63it/s]
 21%|██▏       | 79000/371472 [6:17:07<23:10:03,  3.51it/s]
                                                           
{'loss': 4.1341, 'learning_rate': 8.08981016613157e-07, 'epoch': 3.4}

 21%|██▏       | 79000/371472 [6:17:07<23:10:03,  3.51it/s]
 21%|██▏       | 79001/371472 [6:17:08<24:45:08,  3.28it/s]
 21%|██▏       | 79002/371472 [6:17:08<24:44:41,  3.28it/s]
 21%|██▏       | 79003/371472 [6:17:08<24:05:00,  3.37it/s]
 21%|██▏       | 79004/371472 [6:17:09<22:56:01,  3.54it/s]
 21%|██▏       | 79005/371472 [6:17:09<22:23:04,  3.63it/s]
 21%|██▏       | 79006/371472 [6:17:09<23:24:43,  3.47it/s]
 21%|██▏       | 79007/371472 [6:17:09<22:52:15,  3.55it/s]
 21%|██▏       | 79008/371472 [6:17:10<21:59:15,  3.69it/s]
 21%|██▏       | 79009/371472 [6:17:10<23:18:57,  3.48it/s]
 21%|██▏       | 79010/371472 [6:17:10<23:15:57,  3.49it/s]
 21%|██▏       | 79011/371472 [6:17:11<22:38:25,  3.59it/s]
 21%|██▏       | 79012/371472 [6:17:11<24:26:25,  3.32it/s]
 21%|██▏       | 79013/371472 [6:17:11<23:05:11,  3.52it/s]
 21%|██▏       | 79014/371472 [6:17:11<23:02:05,  3.53it/s]
 21%|██▏       | 79015/371472 [6:17:12<22:45:48,  3.57it/s]
 21%|██▏       | 79016/371472 [6:17:12<23:27:28,  3.46it/s]
 21%|██▏       | 79017/371472 [6:17:12<24:29:08,  3.32it/s]
 21%|██▏       | 79018/371472 [6:17:13<23:28:45,  3.46it/s]
 21%|██▏       | 79019/371472 [6:17:13<24:10:20,  3.36it/s]
 21%|██▏       | 79020/371472 [6:17:13<22:52:21,  3.55it/s]
                                                           
{'loss': 3.9424, 'learning_rate': 8.089325346376779e-07, 'epoch': 3.4}

 21%|██▏       | 79020/371472 [6:17:13<22:52:21,  3.55it/s]
 21%|██▏       | 79021/371472 [6:17:13<22:16:15,  3.65it/s]
 21%|██▏       | 79022/371472 [6:17:14<22:17:41,  3.64it/s]
 21%|██▏       | 79023/371472 [6:17:14<22:51:04,  3.55it/s]
 21%|██▏       | 79024/371472 [6:17:14<22:31:49,  3.61it/s]
 21%|██▏       | 79025/371472 [6:17:15<21:53:29,  3.71it/s]
 21%|██▏       | 79026/371472 [6:17:15<21:40:39,  3.75it/s]
 21%|██▏       | 79027/371472 [6:17:15<21:13:46,  3.83it/s]
 21%|██▏       | 79028/371472 [6:17:15<20:53:09,  3.89it/s]
 21%|██▏       | 79029/371472 [6:17:16<21:11:53,  3.83it/s]
 21%|██▏       | 79030/371472 [6:17:16<22:39:03,  3.59it/s]
 21%|██▏       | 79031/371472 [6:17:16<22:49:55,  3.56it/s]
 21%|██▏       | 79032/371472 [6:17:16<22:44:05,  3.57it/s]
 21%|██▏       | 79033/371472 [6:17:17<22:22:06,  3.63it/s]
 21%|██▏       | 79034/371472 [6:17:17<21:34:32,  3.76it/s]
 21%|██▏       | 79035/371472 [6:17:17<21:58:39,  3.70it/s]
 21%|██▏       | 79036/371472 [6:17:17<21:26:40,  3.79it/s]
 21%|██▏       | 79037/371472 [6:17:18<21:35:42,  3.76it/s]
 21%|██▏       | 79038/371472 [6:17:18<22:29:38,  3.61it/s]
 21%|██▏       | 79039/371472 [6:17:18<24:04:11,  3.37it/s]
 21%|██▏       | 79040/371472 [6:17:19<25:30:26,  3.18it/s]
                                                           
{'loss': 4.1204, 'learning_rate': 8.088840526621991e-07, 'epoch': 3.4}

 21%|██▏       | 79040/371472 [6:17:19<25:30:26,  3.18it/s]
 21%|██▏       | 79041/371472 [6:17:19<24:33:43,  3.31it/s]
 21%|██▏       | 79042/371472 [6:17:19<24:08:31,  3.36it/s]
 21%|██▏       | 79043/371472 [6:17:20<23:40:30,  3.43it/s]
 21%|██▏       | 79044/371472 [6:17:20<23:09:58,  3.51it/s]
 21%|██▏       | 79045/371472 [6:17:20<22:55:19,  3.54it/s]
 21%|██▏       | 79046/371472 [6:17:20<22:12:12,  3.66it/s]
 21%|██▏       | 79047/371472 [6:17:21<21:44:43,  3.74it/s]
 21%|██▏       | 79048/371472 [6:17:21<21:50:36,  3.72it/s]
 21%|██▏       | 79049/371472 [6:17:21<21:50:33,  3.72it/s]
 21%|██▏       | 79050/371472 [6:17:21<21:20:07,  3.81it/s]
 21%|██▏       | 79051/371472 [6:17:22<24:32:11,  3.31it/s]
 21%|██▏       | 79052/371472 [6:17:22<23:57:48,  3.39it/s]
 21%|██▏       | 79053/371472 [6:17:22<24:13:29,  3.35it/s]
 21%|██▏       | 79054/371472 [6:17:23<23:03:02,  3.52it/s]
 21%|██▏       | 79055/371472 [6:17:23<21:56:52,  3.70it/s]
 21%|██▏       | 79056/371472 [6:17:23<23:01:40,  3.53it/s]
 21%|██▏       | 79057/371472 [6:17:23<22:15:47,  3.65it/s]
 21%|██▏       | 79058/371472 [6:17:24<22:42:14,  3.58it/s]
 21%|██▏       | 79059/371472 [6:17:24<22:36:00,  3.59it/s]
 21%|██▏       | 79060/371472 [6:17:24<23:11:35,  3.50it/s]
                                                           
{'loss': 4.1246, 'learning_rate': 8.088355706867202e-07, 'epoch': 3.41}

 21%|██▏       | 79060/371472 [6:17:24<23:11:35,  3.50it/s]
 21%|██▏       | 79061/371472 [6:17:25<22:39:00,  3.59it/s]
 21%|██▏       | 79062/371472 [6:17:25<22:00:16,  3.69it/s]
 21%|██▏       | 79063/371472 [6:17:25<22:30:45,  3.61it/s]
 21%|██▏       | 79064/371472 [6:17:25<21:54:01,  3.71it/s]
 21%|██▏       | 79065/371472 [6:17:26<23:10:54,  3.50it/s]
 21%|██▏       | 79066/371472 [6:17:26<22:04:54,  3.68it/s]
 21%|██▏       | 79067/371472 [6:17:26<22:08:19,  3.67it/s]
 21%|██▏       | 79068/371472 [6:17:27<22:41:33,  3.58it/s]
 21%|██▏       | 79069/371472 [6:17:27<21:37:43,  3.76it/s]
 21%|██▏       | 79070/371472 [6:17:27<22:54:39,  3.55it/s]
 21%|██▏       | 79071/371472 [6:17:27<22:44:50,  3.57it/s]
 21%|██▏       | 79072/371472 [6:17:28<22:51:19,  3.55it/s]
 21%|██▏       | 79073/371472 [6:17:28<21:54:24,  3.71it/s]
 21%|██▏       | 79074/371472 [6:17:28<21:53:48,  3.71it/s]
 21%|██▏       | 79075/371472 [6:17:28<22:59:44,  3.53it/s]
 21%|██▏       | 79076/371472 [6:17:29<22:26:30,  3.62it/s]
 21%|██▏       | 79077/371472 [6:17:29<22:18:56,  3.64it/s]
 21%|██▏       | 79078/371472 [6:17:29<21:58:05,  3.70it/s]
 21%|██▏       | 79079/371472 [6:17:30<23:04:57,  3.52it/s]
 21%|██▏       | 79080/371472 [6:17:30<22:11:23,  3.66it/s]
                                                           
{'loss': 4.1989, 'learning_rate': 8.087870887112413e-07, 'epoch': 3.41}

 21%|██▏       | 79080/371472 [6:17:30<22:11:23,  3.66it/s]
 21%|██▏       | 79081/371472 [6:17:30<22:06:11,  3.67it/s]
 21%|██▏       | 79082/371472 [6:17:30<22:28:20,  3.61it/s]
 21%|██▏       | 79083/371472 [6:17:31<21:28:19,  3.78it/s]
 21%|██▏       | 79084/371472 [6:17:31<22:51:46,  3.55it/s]
 21%|██▏       | 79085/371472 [6:17:31<22:29:01,  3.61it/s]
 21%|██▏       | 79086/371472 [6:17:31<21:40:37,  3.75it/s]
 21%|██▏       | 79087/371472 [6:17:32<22:32:34,  3.60it/s]
 21%|██▏       | 79088/371472 [6:17:32<22:06:45,  3.67it/s]
 21%|██▏       | 79089/371472 [6:17:32<21:41:07,  3.75it/s]
 21%|██▏       | 79090/371472 [6:17:33<21:07:04,  3.85it/s]
 21%|██▏       | 79091/371472 [6:17:33<21:22:08,  3.80it/s]
 21%|██▏       | 79092/371472 [6:17:33<23:02:05,  3.53it/s]
 21%|██▏       | 79093/371472 [6:17:33<23:00:50,  3.53it/s]
 21%|██▏       | 79094/371472 [6:17:34<22:27:23,  3.62it/s]
 21%|██▏       | 79095/371472 [6:17:34<23:14:35,  3.49it/s]
 21%|██▏       | 79096/371472 [6:17:34<22:52:14,  3.55it/s]
 21%|██▏       | 79097/371472 [6:17:35<22:43:02,  3.58it/s]
 21%|██▏       | 79098/371472 [6:17:35<22:11:35,  3.66it/s]
 21%|██▏       | 79099/371472 [6:17:35<23:59:47,  3.38it/s]
 21%|██▏       | 79100/371472 [6:17:35<24:04:14,  3.37it/s]
                                                           
{'loss': 4.139, 'learning_rate': 8.087386067357624e-07, 'epoch': 3.41}

 21%|██▏       | 79100/371472 [6:17:35<24:04:14,  3.37it/s]
 21%|██▏       | 79101/371472 [6:17:36<23:33:49,  3.45it/s]
 21%|██▏       | 79102/371472 [6:17:36<23:30:27,  3.45it/s]
 21%|██▏       | 79103/371472 [6:17:36<23:15:16,  3.49it/s]
 21%|██▏       | 79104/371472 [6:17:37<22:22:47,  3.63it/s]
 21%|██▏       | 79105/371472 [6:17:37<21:38:45,  3.75it/s]
 21%|██▏       | 79106/371472 [6:17:37<22:15:46,  3.65it/s]
 21%|██▏       | 79107/371472 [6:17:37<23:41:03,  3.43it/s]
 21%|██▏       | 79108/371472 [6:17:38<25:00:38,  3.25it/s]
 21%|██▏       | 79109/371472 [6:17:38<24:38:32,  3.30it/s]
 21%|██▏       | 79110/371472 [6:17:38<24:43:21,  3.28it/s]
 21%|██▏       | 79111/371472 [6:17:39<24:25:42,  3.32it/s]
 21%|██▏       | 79112/371472 [6:17:39<24:06:03,  3.37it/s]
 21%|██▏       | 79113/371472 [6:17:39<22:42:48,  3.58it/s]
 21%|██▏       | 79114/371472 [6:17:39<21:53:02,  3.71it/s]
 21%|██▏       | 79115/371472 [6:17:40<22:18:14,  3.64it/s]
 21%|██▏       | 79116/371472 [6:17:40<24:17:53,  3.34it/s]
 21%|██▏       | 79117/371472 [6:17:40<24:10:04,  3.36it/s]
 21%|██▏       | 79118/371472 [6:17:41<23:32:25,  3.45it/s]
 21%|██▏       | 79119/371472 [6:17:41<22:45:05,  3.57it/s]
 21%|██▏       | 79120/371472 [6:17:41<22:59:11,  3.53it/s]
                                                           
{'loss': 4.0823, 'learning_rate': 8.086901247602837e-07, 'epoch': 3.41}

 21%|██▏       | 79120/371472 [6:17:41<22:59:11,  3.53it/s]
 21%|██▏       | 79121/371472 [6:17:41<22:32:54,  3.60it/s]
 21%|██▏       | 79122/371472 [6:17:42<22:07:40,  3.67it/s]
 21%|██▏       | 79123/371472 [6:17:42<21:56:43,  3.70it/s]
 21%|██▏       | 79124/371472 [6:17:42<21:30:59,  3.77it/s]
 21%|██▏       | 79125/371472 [6:17:42<21:48:04,  3.72it/s]
 21%|██▏       | 79126/371472 [6:17:43<21:32:09,  3.77it/s]
 21%|██▏       | 79127/371472 [6:17:43<21:25:26,  3.79it/s]
 21%|██▏       | 79128/371472 [6:17:43<21:49:46,  3.72it/s]
 21%|██▏       | 79129/371472 [6:17:44<22:21:33,  3.63it/s]
 21%|██▏       | 79130/371472 [6:17:44<22:59:37,  3.53it/s]
 21%|██▏       | 79131/371472 [6:17:44<23:12:36,  3.50it/s]
 21%|██▏       | 79132/371472 [6:17:44<22:35:56,  3.59it/s]
 21%|██▏       | 79133/371472 [6:17:45<22:19:24,  3.64it/s]
 21%|██▏       | 79134/371472 [6:17:45<22:05:15,  3.68it/s]
 21%|██▏       | 79135/371472 [6:17:45<22:16:04,  3.65it/s]
 21%|██▏       | 79136/371472 [6:17:45<21:29:37,  3.78it/s]
 21%|██▏       | 79137/371472 [6:17:46<21:48:09,  3.72it/s]
 21%|██▏       | 79138/371472 [6:17:46<22:04:46,  3.68it/s]
 21%|██▏       | 79139/371472 [6:17:46<21:22:16,  3.80it/s]
 21%|██▏       | 79140/371472 [6:17:47<21:09:24,  3.84it/s]
                                                           
{'loss': 4.0169, 'learning_rate': 8.086416427848047e-07, 'epoch': 3.41}

 21%|██▏       | 79140/371472 [6:17:47<21:09:24,  3.84it/s]
 21%|██▏       | 79141/371472 [6:17:47<22:36:03,  3.59it/s]
 21%|██▏       | 79142/371472 [6:17:47<22:46:04,  3.57it/s]
 21%|██▏       | 79143/371472 [6:17:47<23:31:51,  3.45it/s]
 21%|██▏       | 79144/371472 [6:17:48<23:48:42,  3.41it/s]
 21%|██▏       | 79145/371472 [6:17:48<23:34:37,  3.44it/s]
 21%|██▏       | 79146/371472 [6:17:48<23:31:00,  3.45it/s]
 21%|██▏       | 79147/371472 [6:17:49<23:53:24,  3.40it/s]
 21%|██▏       | 79148/371472 [6:17:49<23:46:20,  3.42it/s]
 21%|██▏       | 79149/371472 [6:17:49<23:00:25,  3.53it/s]
 21%|██▏       | 79150/371472 [6:17:49<23:39:11,  3.43it/s]
 21%|██▏       | 79151/371472 [6:17:50<22:30:25,  3.61it/s]
 21%|██▏       | 79152/371472 [6:17:50<25:20:55,  3.20it/s]
 21%|██▏       | 79153/371472 [6:17:50<24:33:59,  3.31it/s]
 21%|██▏       | 79154/371472 [6:17:51<23:28:15,  3.46it/s]
 21%|██▏       | 79155/371472 [6:17:51<22:18:55,  3.64it/s]
 21%|██▏       | 79156/371472 [6:17:51<22:35:17,  3.59it/s]
 21%|██▏       | 79157/371472 [6:17:51<21:56:14,  3.70it/s]
 21%|██▏       | 79158/371472 [6:17:52<23:03:21,  3.52it/s]
 21%|██▏       | 79159/371472 [6:17:52<22:00:59,  3.69it/s]
 21%|██▏       | 79160/371472 [6:17:52<22:03:53,  3.68it/s]
                                                           
{'loss': 4.0076, 'learning_rate': 8.085931608093257e-07, 'epoch': 3.41}

 21%|██▏       | 79160/371472 [6:17:52<22:03:53,  3.68it/s]
 21%|██▏       | 79161/371472 [6:17:53<22:35:16,  3.59it/s]
 21%|██▏       | 79162/371472 [6:17:53<21:56:58,  3.70it/s]
 21%|██▏       | 79163/371472 [6:17:53<21:24:28,  3.79it/s]
 21%|██▏       | 79164/371472 [6:17:53<21:05:20,  3.85it/s]
 21%|██▏       | 79165/371472 [6:17:54<21:40:25,  3.75it/s]
 21%|██▏       | 79166/371472 [6:17:54<21:54:51,  3.71it/s]
 21%|██▏       | 79167/371472 [6:17:54<22:28:28,  3.61it/s]
 21%|██▏       | 79168/371472 [6:17:54<23:47:10,  3.41it/s]
 21%|██▏       | 79169/371472 [6:17:55<22:56:52,  3.54it/s]
 21%|██▏       | 79170/371472 [6:17:55<24:08:00,  3.36it/s]
 21%|██▏       | 79171/371472 [6:17:55<25:35:22,  3.17it/s]
 21%|██▏       | 79172/371472 [6:17:56<24:02:04,  3.38it/s]
 21%|██▏       | 79173/371472 [6:17:56<23:17:42,  3.49it/s]
 21%|██▏       | 79174/371472 [6:17:56<22:35:05,  3.60it/s]
 21%|██▏       | 79175/371472 [6:17:56<22:39:18,  3.58it/s]
 21%|██▏       | 79176/371472 [6:17:57<22:37:32,  3.59it/s]
 21%|██▏       | 79177/371472 [6:17:57<22:01:28,  3.69it/s]
 21%|██▏       | 79178/371472 [6:17:57<21:30:40,  3.77it/s]
 21%|██▏       | 79179/371472 [6:17:58<23:10:01,  3.50it/s]
 21%|██▏       | 79180/371472 [6:17:58<22:55:57,  3.54it/s]
                                                           
{'loss': 4.1152, 'learning_rate': 8.085446788338468e-07, 'epoch': 3.41}

 21%|██▏       | 79180/371472 [6:17:58<22:55:57,  3.54it/s]
 21%|██▏       | 79181/371472 [6:17:58<22:30:26,  3.61it/s]
 21%|██▏       | 79182/371472 [6:17:58<24:01:25,  3.38it/s]
 21%|██▏       | 79183/371472 [6:17:59<23:23:08,  3.47it/s]
 21%|██▏       | 79184/371472 [6:17:59<22:48:00,  3.56it/s]
 21%|██▏       | 79185/371472 [6:17:59<24:44:29,  3.28it/s]
 21%|██▏       | 79186/371472 [6:18:00<25:18:09,  3.21it/s]
 21%|██▏       | 79187/371472 [6:18:00<25:16:46,  3.21it/s]
 21%|██▏       | 79188/371472 [6:18:00<24:46:14,  3.28it/s]
 21%|██▏       | 79189/371472 [6:18:01<24:26:19,  3.32it/s]
 21%|██▏       | 79190/371472 [6:18:01<23:22:52,  3.47it/s]
 21%|██▏       | 79191/371472 [6:18:01<23:36:39,  3.44it/s]
 21%|██▏       | 79192/371472 [6:18:01<24:30:46,  3.31it/s]
 21%|██▏       | 79193/371472 [6:18:02<23:25:44,  3.47it/s]
 21%|██▏       | 79194/371472 [6:18:02<22:58:45,  3.53it/s]
 21%|██▏       | 79195/371472 [6:18:02<24:45:38,  3.28it/s]
 21%|██▏       | 79196/371472 [6:18:03<24:24:15,  3.33it/s]
 21%|██▏       | 79197/371472 [6:18:03<23:49:55,  3.41it/s]
 21%|██▏       | 79198/371472 [6:18:03<22:44:28,  3.57it/s]
 21%|██▏       | 79199/371472 [6:18:03<23:03:03,  3.52it/s]
 21%|██▏       | 79200/371472 [6:18:04<22:06:52,  3.67it/s]
                                                           
{'loss': 4.0021, 'learning_rate': 8.08496196858368e-07, 'epoch': 3.41}

 21%|██▏       | 79200/371472 [6:18:04<22:06:52,  3.67it/s]
 21%|██▏       | 79201/371472 [6:18:04<22:46:22,  3.57it/s]
 21%|██▏       | 79202/371472 [6:18:04<22:53:40,  3.55it/s]
 21%|██▏       | 79203/371472 [6:18:05<23:01:51,  3.53it/s]
 21%|██▏       | 79204/371472 [6:18:05<21:54:30,  3.71it/s]
 21%|██▏       | 79205/371472 [6:18:05<21:40:12,  3.75it/s]
 21%|██▏       | 79206/371472 [6:18:05<21:22:53,  3.80it/s]
 21%|██▏       | 79207/371472 [6:18:06<22:00:42,  3.69it/s]
 21%|██▏       | 79208/371472 [6:18:06<21:50:27,  3.72it/s]
 21%|██▏       | 79209/371472 [6:18:06<22:38:08,  3.59it/s]
 21%|██▏       | 79210/371472 [6:18:07<23:03:36,  3.52it/s]
 21%|██▏       | 79211/371472 [6:18:07<22:23:45,  3.62it/s]
 21%|██▏       | 79212/371472 [6:18:07<22:39:57,  3.58it/s]
 21%|██▏       | 79213/371472 [6:18:07<23:42:07,  3.43it/s]
 21%|██▏       | 79214/371472 [6:18:08<22:39:33,  3.58it/s]
 21%|██▏       | 79215/371472 [6:18:08<22:46:35,  3.56it/s]
 21%|██▏       | 79216/371472 [6:18:08<23:51:13,  3.40it/s]
 21%|██▏       | 79217/371472 [6:18:09<24:31:58,  3.31it/s]
 21%|██▏       | 79218/371472 [6:18:09<23:51:23,  3.40it/s]
 21%|██▏       | 79219/371472 [6:18:09<22:52:06,  3.55it/s]
 21%|██▏       | 79220/371472 [6:18:09<23:04:49,  3.52it/s]
                                                           
{'loss': 4.0888, 'learning_rate': 8.08447714882889e-07, 'epoch': 3.41}

 21%|██▏       | 79220/371472 [6:18:09<23:04:49,  3.52it/s]
 21%|██▏       | 79221/371472 [6:18:10<22:08:45,  3.67it/s]
 21%|██▏       | 79222/371472 [6:18:10<22:11:27,  3.66it/s]
 21%|██▏       | 79223/371472 [6:18:10<21:56:02,  3.70it/s]
 21%|██▏       | 79224/371472 [6:18:10<22:42:17,  3.58it/s]
 21%|██▏       | 79225/371472 [6:18:11<23:03:09,  3.52it/s]
 21%|██▏       | 79226/371472 [6:18:11<22:23:31,  3.63it/s]
 21%|██▏       | 79227/371472 [6:18:11<21:53:05,  3.71it/s]
 21%|██▏       | 79228/371472 [6:18:12<21:28:25,  3.78it/s]
 21%|██▏       | 79229/371472 [6:18:12<21:00:06,  3.87it/s]
 21%|██▏       | 79230/371472 [6:18:12<21:54:44,  3.70it/s]
 21%|██▏       | 79231/371472 [6:18:12<21:28:10,  3.78it/s]
 21%|██▏       | 79232/371472 [6:18:13<21:35:28,  3.76it/s]
 21%|██▏       | 79233/371472 [6:18:13<21:13:55,  3.82it/s]
 21%|██▏       | 79234/371472 [6:18:13<21:18:08,  3.81it/s]
 21%|██▏       | 79235/371472 [6:18:13<22:25:50,  3.62it/s]
 21%|██▏       | 79236/371472 [6:18:14<22:02:04,  3.68it/s]
 21%|██▏       | 79237/371472 [6:18:14<21:26:11,  3.79it/s]
 21%|██▏       | 79238/371472 [6:18:14<21:58:07,  3.70it/s]
 21%|██▏       | 79239/371472 [6:18:15<29:55:20,  2.71it/s]
 21%|██▏       | 79240/371472 [6:18:15<27:16:22,  2.98it/s]
                                                           
{'loss': 4.0184, 'learning_rate': 8.083992329074102e-07, 'epoch': 3.41}

 21%|██▏       | 79240/371472 [6:18:15<27:16:22,  2.98it/s]
 21%|██▏       | 79241/371472 [6:18:15<26:30:39,  3.06it/s]
 21%|██▏       | 79242/371472 [6:18:16<25:10:49,  3.22it/s]
 21%|██▏       | 79243/371472 [6:18:16<24:01:11,  3.38it/s]
 21%|██▏       | 79244/371472 [6:18:16<23:35:30,  3.44it/s]
 21%|██▏       | 79245/371472 [6:18:16<24:11:34,  3.36it/s]
 21%|██▏       | 79246/371472 [6:18:17<23:56:02,  3.39it/s]
 21%|██▏       | 79247/371472 [6:18:17<23:44:43,  3.42it/s]
 21%|██▏       | 79248/371472 [6:18:17<23:16:59,  3.49it/s]
 21%|██▏       | 79249/371472 [6:18:18<22:26:14,  3.62it/s]
 21%|██▏       | 79250/371472 [6:18:18<22:22:51,  3.63it/s]
 21%|██▏       | 79251/371472 [6:18:18<22:01:36,  3.69it/s]
 21%|██▏       | 79252/371472 [6:18:18<21:49:25,  3.72it/s]
 21%|██▏       | 79253/371472 [6:18:19<22:57:16,  3.54it/s]
 21%|██▏       | 79254/371472 [6:18:19<23:02:34,  3.52it/s]
 21%|██▏       | 79255/371472 [6:18:19<22:30:15,  3.61it/s]
 21%|██▏       | 79256/371472 [6:18:20<23:16:27,  3.49it/s]
 21%|██▏       | 79257/371472 [6:18:20<22:53:12,  3.55it/s]
 21%|██▏       | 79258/371472 [6:18:20<22:37:25,  3.59it/s]
 21%|██▏       | 79259/371472 [6:18:20<23:42:45,  3.42it/s]
 21%|██▏       | 79260/371472 [6:18:21<23:09:18,  3.51it/s]
                                                           
{'loss': 4.0808, 'learning_rate': 8.083507509319313e-07, 'epoch': 3.41}

 21%|██▏       | 79260/371472 [6:18:21<23:09:18,  3.51it/s]
 21%|██▏       | 79261/371472 [6:18:21<22:31:42,  3.60it/s]
 21%|██▏       | 79262/371472 [6:18:21<22:02:06,  3.68it/s]
 21%|██▏       | 79263/371472 [6:18:21<21:37:59,  3.75it/s]
 21%|██▏       | 79264/371472 [6:18:22<21:23:24,  3.79it/s]
 21%|██▏       | 79265/371472 [6:18:22<21:29:17,  3.78it/s]
 21%|██▏       | 79266/371472 [6:18:22<21:54:27,  3.71it/s]
 21%|██▏       | 79267/371472 [6:18:22<21:08:39,  3.84it/s]
 21%|██▏       | 79268/371472 [6:18:23<21:32:25,  3.77it/s]
 21%|██▏       | 79269/371472 [6:18:23<21:23:21,  3.79it/s]
 21%|██▏       | 79270/371472 [6:18:23<21:44:51,  3.73it/s]
 21%|██▏       | 79271/371472 [6:18:24<22:12:59,  3.65it/s]
 21%|██▏       | 79272/371472 [6:18:24<21:14:25,  3.82it/s]
 21%|██▏       | 79273/371472 [6:18:24<20:46:46,  3.91it/s]
 21%|██▏       | 79274/371472 [6:18:24<20:54:35,  3.88it/s]
 21%|██▏       | 79275/371472 [6:18:25<21:13:25,  3.82it/s]
 21%|██▏       | 79276/371472 [6:18:25<22:52:01,  3.55it/s]
 21%|██▏       | 79277/371472 [6:18:25<22:40:27,  3.58it/s]
 21%|██▏       | 79278/371472 [6:18:25<22:34:16,  3.60it/s]
 21%|██▏       | 79279/371472 [6:18:26<23:03:22,  3.52it/s]
 21%|██▏       | 79280/371472 [6:18:26<23:31:35,  3.45it/s]
                                                           
{'loss': 4.2175, 'learning_rate': 8.083022689564524e-07, 'epoch': 3.41}

 21%|██▏       | 79280/371472 [6:18:26<23:31:35,  3.45it/s]
 21%|██▏       | 79281/371472 [6:18:26<23:46:31,  3.41it/s]
 21%|██▏       | 79282/371472 [6:18:27<23:09:29,  3.50it/s]
 21%|██▏       | 79283/371472 [6:18:27<23:02:25,  3.52it/s]
 21%|██▏       | 79284/371472 [6:18:27<23:03:05,  3.52it/s]
 21%|██▏       | 79285/371472 [6:18:27<22:43:56,  3.57it/s]
 21%|██▏       | 79286/371472 [6:18:28<22:51:23,  3.55it/s]
 21%|██▏       | 79287/371472 [6:18:28<22:27:04,  3.62it/s]
 21%|██▏       | 79288/371472 [6:18:28<23:42:50,  3.42it/s]
 21%|██▏       | 79289/371472 [6:18:29<24:03:14,  3.37it/s]
 21%|██▏       | 79290/371472 [6:18:29<24:19:20,  3.34it/s]
 21%|██▏       | 79291/371472 [6:18:29<23:44:20,  3.42it/s]
 21%|██▏       | 79292/371472 [6:18:30<24:27:43,  3.32it/s]
 21%|██▏       | 79293/371472 [6:18:30<24:42:18,  3.29it/s]
 21%|██▏       | 79294/371472 [6:18:30<24:34:44,  3.30it/s]
 21%|██▏       | 79295/371472 [6:18:30<24:18:15,  3.34it/s]
 21%|██▏       | 79296/371472 [6:18:31<23:35:30,  3.44it/s]
 21%|██▏       | 79297/371472 [6:18:31<23:18:31,  3.48it/s]
 21%|██▏       | 79298/371472 [6:18:31<23:06:24,  3.51it/s]
 21%|██▏       | 79299/371472 [6:18:32<23:26:46,  3.46it/s]
 21%|██▏       | 79300/371472 [6:18:32<24:26:44,  3.32it/s]
                                                           
{'loss': 4.1338, 'learning_rate': 8.082537869809734e-07, 'epoch': 3.42}

 21%|██▏       | 79300/371472 [6:18:32<24:26:44,  3.32it/s]
 21%|██▏       | 79301/371472 [6:18:32<24:21:40,  3.33it/s]
 21%|██▏       | 79302/371472 [6:18:33<23:45:28,  3.42it/s]
 21%|██▏       | 79303/371472 [6:18:33<23:21:44,  3.47it/s]
 21%|██▏       | 79304/371472 [6:18:33<23:40:10,  3.43it/s]
 21%|██▏       | 79305/371472 [6:18:33<22:45:06,  3.57it/s]
 21%|██▏       | 79306/371472 [6:18:34<22:36:37,  3.59it/s]
 21%|██▏       | 79307/371472 [6:18:34<21:38:40,  3.75it/s]
 21%|██▏       | 79308/371472 [6:18:34<21:52:15,  3.71it/s]
 21%|██▏       | 79309/371472 [6:18:34<20:57:39,  3.87it/s]
 21%|██▏       | 79310/371472 [6:18:35<20:36:40,  3.94it/s]
 21%|██▏       | 79311/371472 [6:18:35<23:01:17,  3.53it/s]
 21%|██▏       | 79312/371472 [6:18:35<23:11:59,  3.50it/s]
 21%|██▏       | 79313/371472 [6:18:36<22:32:30,  3.60it/s]
 21%|██▏       | 79314/371472 [6:18:36<23:09:08,  3.51it/s]
 21%|██▏       | 79315/371472 [6:18:36<22:39:58,  3.58it/s]
 21%|██▏       | 79316/371472 [6:18:36<21:31:23,  3.77it/s]
 21%|██▏       | 79317/371472 [6:18:37<21:00:04,  3.86it/s]
 21%|██▏       | 79318/371472 [6:18:37<21:48:12,  3.72it/s]
 21%|██▏       | 79319/371472 [6:18:37<22:11:33,  3.66it/s]
 21%|██▏       | 79320/371472 [6:18:37<21:52:15,  3.71it/s]
                                                           
{'loss': 4.032, 'learning_rate': 8.082053050054945e-07, 'epoch': 3.42}

 21%|██▏       | 79320/371472 [6:18:37<21:52:15,  3.71it/s]
 21%|██▏       | 79321/371472 [6:18:38<21:54:54,  3.70it/s]
 21%|██▏       | 79322/371472 [6:18:38<22:09:23,  3.66it/s]
 21%|██▏       | 79323/371472 [6:18:38<21:52:42,  3.71it/s]
 21%|██▏       | 79324/371472 [6:18:39<23:14:04,  3.49it/s]
 21%|██▏       | 79325/371472 [6:18:39<23:29:47,  3.45it/s]
 21%|██▏       | 79326/371472 [6:18:39<22:26:25,  3.62it/s]
 21%|██▏       | 79327/371472 [6:18:39<22:09:27,  3.66it/s]
 21%|██▏       | 79328/371472 [6:18:40<24:35:05,  3.30it/s]
 21%|██▏       | 79329/371472 [6:18:40<23:04:54,  3.52it/s]
 21%|██▏       | 79330/371472 [6:18:40<23:28:04,  3.46it/s]
 21%|██▏       | 79331/371472 [6:18:41<22:55:17,  3.54it/s]
 21%|██▏       | 79332/371472 [6:18:41<22:49:11,  3.56it/s]
 21%|██▏       | 79333/371472 [6:18:41<22:46:19,  3.56it/s]
 21%|██▏       | 79334/371472 [6:18:41<24:08:05,  3.36it/s]
 21%|██▏       | 79335/371472 [6:18:42<23:05:45,  3.51it/s]
 21%|██▏       | 79336/371472 [6:18:42<22:09:39,  3.66it/s]
 21%|██▏       | 79337/371472 [6:18:42<22:02:12,  3.68it/s]
 21%|██▏       | 79338/371472 [6:18:42<22:02:45,  3.68it/s]
 21%|██▏       | 79339/371472 [6:18:43<22:29:10,  3.61it/s]
 21%|██▏       | 79340/371472 [6:18:43<21:24:10,  3.79it/s]
                                                           
{'loss': 4.4536, 'learning_rate': 8.081568230300157e-07, 'epoch': 3.42}

 21%|██▏       | 79340/371472 [6:18:43<21:24:10,  3.79it/s]
 21%|██▏       | 79341/371472 [6:18:43<20:43:00,  3.92it/s]
 21%|██▏       | 79342/371472 [6:18:44<21:34:22,  3.76it/s]
 21%|██▏       | 79343/371472 [6:18:44<22:47:03,  3.56it/s]
 21%|██▏       | 79344/371472 [6:18:44<23:39:43,  3.43it/s]
 21%|██▏       | 79345/371472 [6:18:45<31:00:27,  2.62it/s]
 21%|██▏       | 79346/371472 [6:18:45<29:30:59,  2.75it/s]
 21%|██▏       | 79347/371472 [6:18:45<27:30:35,  2.95it/s]
 21%|██▏       | 79348/371472 [6:18:46<27:23:05,  2.96it/s]
 21%|██▏       | 79349/371472 [6:18:46<26:08:27,  3.10it/s]
 21%|██▏       | 79350/371472 [6:18:46<25:57:13,  3.13it/s]
 21%|██▏       | 79351/371472 [6:18:47<26:38:01,  3.05it/s]
 21%|██▏       | 79352/371472 [6:18:47<25:05:38,  3.23it/s]
 21%|██▏       | 79353/371472 [6:18:47<24:28:13,  3.32it/s]
 21%|██▏       | 79354/371472 [6:18:47<23:41:51,  3.42it/s]
 21%|██▏       | 79355/371472 [6:18:48<23:07:13,  3.51it/s]
 21%|██▏       | 79356/371472 [6:18:48<22:36:22,  3.59it/s]
 21%|██▏       | 79357/371472 [6:18:48<22:29:27,  3.61it/s]
 21%|██▏       | 79358/371472 [6:18:48<21:53:31,  3.71it/s]
 21%|██▏       | 79359/371472 [6:18:49<21:51:08,  3.71it/s]
 21%|██▏       | 79360/371472 [6:18:49<23:10:34,  3.50it/s]
                                                           
{'loss': 4.1274, 'learning_rate': 8.081083410545369e-07, 'epoch': 3.42}

 21%|██▏       | 79360/371472 [6:18:49<23:10:34,  3.50it/s]
 21%|██▏       | 79361/371472 [6:18:49<22:04:39,  3.68it/s]
 21%|██▏       | 79362/371472 [6:18:50<23:02:54,  3.52it/s]
 21%|██▏       | 79363/371472 [6:18:50<22:56:57,  3.54it/s]
 21%|██▏       | 79364/371472 [6:18:50<22:30:56,  3.60it/s]
 21%|██▏       | 79365/371472 [6:18:50<21:45:45,  3.73it/s]
 21%|██▏       | 79366/371472 [6:18:51<21:24:00,  3.79it/s]
 21%|██▏       | 79367/371472 [6:18:51<21:24:31,  3.79it/s]
 21%|██▏       | 79368/371472 [6:18:51<21:56:55,  3.70it/s]
 21%|██▏       | 79369/371472 [6:18:51<21:38:49,  3.75it/s]
 21%|██▏       | 79370/371472 [6:18:52<21:50:05,  3.72it/s]
 21%|██▏       | 79371/371472 [6:18:52<21:49:41,  3.72it/s]
 21%|██▏       | 79372/371472 [6:18:52<22:33:02,  3.60it/s]
 21%|██▏       | 79373/371472 [6:18:53<22:29:47,  3.61it/s]
 21%|██▏       | 79374/371472 [6:18:53<22:35:23,  3.59it/s]
 21%|██▏       | 79375/371472 [6:18:53<23:31:04,  3.45it/s]
 21%|██▏       | 79376/371472 [6:18:54<23:46:20,  3.41it/s]
 21%|██▏       | 79377/371472 [6:18:54<22:45:14,  3.57it/s]
 21%|██▏       | 79378/371472 [6:18:54<23:13:29,  3.49it/s]
 21%|██▏       | 79379/371472 [6:18:54<22:43:45,  3.57it/s]
 21%|██▏       | 79380/371472 [6:18:55<24:35:43,  3.30it/s]
                                                           
{'loss': 4.0179, 'learning_rate': 8.080598590790579e-07, 'epoch': 3.42}

 21%|██▏       | 79380/371472 [6:18:55<24:35:43,  3.30it/s]
 21%|██▏       | 79381/371472 [6:18:55<23:58:27,  3.38it/s]
 21%|██▏       | 79382/371472 [6:18:55<24:45:45,  3.28it/s]
 21%|██▏       | 79383/371472 [6:18:56<24:09:27,  3.36it/s]
 21%|██▏       | 79384/371472 [6:18:56<23:24:38,  3.47it/s]
 21%|██▏       | 79385/371472 [6:18:56<23:49:06,  3.41it/s]
 21%|██▏       | 79386/371472 [6:18:56<25:14:06,  3.22it/s]
 21%|██▏       | 79387/371472 [6:18:57<24:30:11,  3.31it/s]
 21%|██▏       | 79388/371472 [6:18:57<23:56:30,  3.39it/s]
 21%|██▏       | 79389/371472 [6:18:57<24:28:53,  3.31it/s]
 21%|██▏       | 79390/371472 [6:18:58<25:30:10,  3.18it/s]
 21%|██▏       | 79391/371472 [6:18:58<23:51:19,  3.40it/s]
 21%|██▏       | 79392/371472 [6:18:58<23:47:49,  3.41it/s]
 21%|██▏       | 79393/371472 [6:18:59<23:37:52,  3.43it/s]
 21%|██▏       | 79394/371472 [6:18:59<23:51:14,  3.40it/s]
 21%|██▏       | 79395/371472 [6:18:59<23:37:46,  3.43it/s]
 21%|██▏       | 79396/371472 [6:18:59<22:43:00,  3.57it/s]
 21%|██▏       | 79397/371472 [6:19:00<23:24:22,  3.47it/s]
 21%|██▏       | 79398/371472 [6:19:00<25:32:45,  3.18it/s]
 21%|██▏       | 79399/371472 [6:19:00<24:39:07,  3.29it/s]
 21%|██▏       | 79400/371472 [6:19:01<23:10:38,  3.50it/s]
                                                           
{'loss': 4.0286, 'learning_rate': 8.08011377103579e-07, 'epoch': 3.42}

 21%|██▏       | 79400/371472 [6:19:01<23:10:38,  3.50it/s]
 21%|██▏       | 79401/371472 [6:19:01<22:19:01,  3.64it/s]
 21%|██▏       | 79402/371472 [6:19:01<22:50:01,  3.55it/s]
 21%|██▏       | 79403/371472 [6:19:01<22:46:05,  3.56it/s]
 21%|██▏       | 79404/371472 [6:19:02<22:18:52,  3.64it/s]
 21%|██▏       | 79405/371472 [6:19:02<22:28:51,  3.61it/s]
 21%|██▏       | 79406/371472 [6:19:02<23:12:31,  3.50it/s]
 21%|██▏       | 79407/371472 [6:19:03<22:41:46,  3.57it/s]
 21%|██▏       | 79408/371472 [6:19:03<23:20:42,  3.48it/s]
 21%|██▏       | 79409/371472 [6:19:03<22:14:50,  3.65it/s]
 21%|██▏       | 79410/371472 [6:19:03<21:43:52,  3.73it/s]
 21%|██▏       | 79411/371472 [6:19:04<21:48:42,  3.72it/s]
 21%|██▏       | 79412/371472 [6:19:04<22:20:51,  3.63it/s]
 21%|██▏       | 79413/371472 [6:19:04<22:17:58,  3.64it/s]
 21%|██▏       | 79414/371472 [6:19:04<21:36:48,  3.75it/s]
 21%|██▏       | 79415/371472 [6:19:05<22:26:27,  3.62it/s]
 21%|██▏       | 79416/371472 [6:19:05<22:54:07,  3.54it/s]
 21%|██▏       | 79417/371472 [6:19:05<22:48:58,  3.56it/s]
 21%|██▏       | 79418/371472 [6:19:06<22:11:43,  3.66it/s]
 21%|██▏       | 79419/371472 [6:19:06<21:53:48,  3.70it/s]
 21%|██▏       | 79420/371472 [6:19:06<23:12:12,  3.50it/s]
                                                           
{'loss': 4.1304, 'learning_rate': 8.079628951281001e-07, 'epoch': 3.42}

 21%|██▏       | 79420/371472 [6:19:06<23:12:12,  3.50it/s]
 21%|██▏       | 79421/371472 [6:19:06<23:35:30,  3.44it/s]
 21%|██▏       | 79422/371472 [6:19:07<24:51:03,  3.26it/s]
 21%|██▏       | 79423/371472 [6:19:07<24:31:03,  3.31it/s]
 21%|██▏       | 79424/371472 [6:19:07<23:13:57,  3.49it/s]
 21%|██▏       | 79425/371472 [6:19:08<23:54:19,  3.39it/s]
 21%|██▏       | 79426/371472 [6:19:08<23:39:38,  3.43it/s]
 21%|██▏       | 79427/371472 [6:19:08<23:13:49,  3.49it/s]
 21%|██▏       | 79428/371472 [6:19:08<22:39:19,  3.58it/s]
 21%|██▏       | 79429/371472 [6:19:09<22:07:54,  3.67it/s]
 21%|██▏       | 79430/371472 [6:19:09<21:12:49,  3.82it/s]
 21%|██▏       | 79431/371472 [6:19:09<20:46:42,  3.90it/s]
 21%|██▏       | 79432/371472 [6:19:09<20:49:30,  3.90it/s]
 21%|██▏       | 79433/371472 [6:19:10<20:42:19,  3.92it/s]
 21%|██▏       | 79434/371472 [6:19:10<21:12:56,  3.82it/s]
 21%|██▏       | 79435/371472 [6:19:10<21:37:56,  3.75it/s]
 21%|██▏       | 79436/371472 [6:19:11<21:32:51,  3.76it/s]
 21%|██▏       | 79437/371472 [6:19:11<21:50:30,  3.71it/s]
 21%|██▏       | 79438/371472 [6:19:11<21:10:57,  3.83it/s]
 21%|██▏       | 79439/371472 [6:19:11<21:58:25,  3.69it/s]
 21%|██▏       | 79440/371472 [6:19:12<22:14:16,  3.65it/s]
                                                           
{'loss': 3.9421, 'learning_rate': 8.079144131526213e-07, 'epoch': 3.42}

 21%|██▏       | 79440/371472 [6:19:12<22:14:16,  3.65it/s]
 21%|██▏       | 79441/371472 [6:19:12<21:59:55,  3.69it/s]
 21%|██▏       | 79442/371472 [6:19:12<24:09:30,  3.36it/s]
 21%|██▏       | 79443/371472 [6:19:12<23:04:59,  3.51it/s]
 21%|██▏       | 79444/371472 [6:19:13<23:56:37,  3.39it/s]
 21%|██▏       | 79445/371472 [6:19:13<24:13:08,  3.35it/s]
 21%|██▏       | 79446/371472 [6:19:13<23:19:44,  3.48it/s]
 21%|██▏       | 79447/371472 [6:19:14<22:35:19,  3.59it/s]
 21%|██▏       | 79448/371472 [6:19:14<21:55:26,  3.70it/s]
 21%|██▏       | 79449/371472 [6:19:14<22:49:19,  3.55it/s]
 21%|██▏       | 79450/371472 [6:19:14<21:57:25,  3.69it/s]
 21%|██▏       | 79451/371472 [6:19:15<23:39:47,  3.43it/s]
 21%|██▏       | 79452/371472 [6:19:15<22:11:01,  3.66it/s]
 21%|██▏       | 79453/371472 [6:19:15<22:30:04,  3.60it/s]
 21%|██▏       | 79454/371472 [6:19:16<22:37:06,  3.59it/s]
 21%|██▏       | 79455/371472 [6:19:16<23:09:38,  3.50it/s]
 21%|██▏       | 79456/371472 [6:19:16<22:01:49,  3.68it/s]
 21%|██▏       | 79457/371472 [6:19:16<22:53:30,  3.54it/s]
 21%|██▏       | 79458/371472 [6:19:17<23:44:55,  3.42it/s]
 21%|██▏       | 79459/371472 [6:19:17<23:03:56,  3.52it/s]
 21%|██▏       | 79460/371472 [6:19:17<22:31:46,  3.60it/s]
                                                           
{'loss': 4.1418, 'learning_rate': 8.078659311771423e-07, 'epoch': 3.42}

 21%|██▏       | 79460/371472 [6:19:17<22:31:46,  3.60it/s]
 21%|██▏       | 79461/371472 [6:19:18<21:44:24,  3.73it/s]
 21%|██▏       | 79462/371472 [6:19:18<21:34:40,  3.76it/s]
 21%|██▏       | 79463/371472 [6:19:18<22:34:46,  3.59it/s]
 21%|██▏       | 79464/371472 [6:19:18<24:28:20,  3.31it/s]
 21%|██▏       | 79465/371472 [6:19:19<25:15:05,  3.21it/s]
 21%|██▏       | 79466/371472 [6:19:19<25:52:08,  3.14it/s]
 21%|██▏       | 79467/371472 [6:19:19<24:45:39,  3.28it/s]
 21%|██▏       | 79468/371472 [6:19:20<26:52:42,  3.02it/s]
 21%|██▏       | 79469/371472 [6:19:20<25:58:41,  3.12it/s]
 21%|██▏       | 79470/371472 [6:19:20<24:17:07,  3.34it/s]
 21%|██▏       | 79471/371472 [6:19:21<23:11:41,  3.50it/s]
 21%|██▏       | 79472/371472 [6:19:21<23:04:43,  3.51it/s]
 21%|██▏       | 79473/371472 [6:19:21<22:20:52,  3.63it/s]
 21%|██▏       | 79474/371472 [6:19:21<21:43:10,  3.73it/s]
 21%|██▏       | 79475/371472 [6:19:22<21:17:52,  3.81it/s]
 21%|██▏       | 79476/371472 [6:19:22<21:18:44,  3.81it/s]
 21%|██▏       | 79477/371472 [6:19:22<21:19:34,  3.80it/s]
 21%|██▏       | 79478/371472 [6:19:22<21:46:27,  3.72it/s]
 21%|██▏       | 79479/371472 [6:19:23<22:30:06,  3.60it/s]
 21%|██▏       | 79480/371472 [6:19:23<23:28:14,  3.46it/s]
                                                           
{'loss': 4.3102, 'learning_rate': 8.078174492016634e-07, 'epoch': 3.42}

 21%|██▏       | 79480/371472 [6:19:23<23:28:14,  3.46it/s]
 21%|██▏       | 79481/371472 [6:19:23<23:21:11,  3.47it/s]
 21%|██▏       | 79482/371472 [6:19:24<23:36:49,  3.43it/s]
 21%|██▏       | 79483/371472 [6:19:24<23:02:05,  3.52it/s]
 21%|██▏       | 79484/371472 [6:19:24<22:07:42,  3.67it/s]
 21%|██▏       | 79485/371472 [6:19:24<22:30:11,  3.60it/s]
 21%|██▏       | 79486/371472 [6:19:25<22:04:19,  3.67it/s]
 21%|██▏       | 79487/371472 [6:19:25<22:08:13,  3.66it/s]
 21%|██▏       | 79488/371472 [6:19:25<21:58:54,  3.69it/s]
 21%|██▏       | 79489/371472 [6:19:26<24:10:38,  3.35it/s]
 21%|██▏       | 79490/371472 [6:19:26<23:04:59,  3.51it/s]
 21%|██▏       | 79491/371472 [6:19:26<24:40:03,  3.29it/s]
 21%|██▏       | 79492/371472 [6:19:26<24:55:45,  3.25it/s]
 21%|██▏       | 79493/371472 [6:19:27<23:41:02,  3.42it/s]
 21%|██▏       | 79494/371472 [6:19:27<24:07:37,  3.36it/s]
 21%|██▏       | 79495/371472 [6:19:27<23:26:25,  3.46it/s]
 21%|██▏       | 79496/371472 [6:19:28<22:50:29,  3.55it/s]
 21%|██▏       | 79497/371472 [6:19:28<25:08:23,  3.23it/s]
 21%|██▏       | 79498/371472 [6:19:28<24:23:22,  3.33it/s]
 21%|██▏       | 79499/371472 [6:19:29<23:44:27,  3.42it/s]
 21%|██▏       | 79500/371472 [6:19:29<23:08:48,  3.50it/s]
                                                           
{'loss': 3.9138, 'learning_rate': 8.077689672261846e-07, 'epoch': 3.42}

 21%|██▏       | 79500/371472 [6:19:29<23:08:48,  3.50it/s]
 21%|██▏       | 79501/371472 [6:19:29<22:13:22,  3.65it/s]
 21%|██▏       | 79502/371472 [6:19:30<26:46:59,  3.03it/s]
 21%|██▏       | 79503/371472 [6:19:30<24:57:03,  3.25it/s]
 21%|██▏       | 79504/371472 [6:19:30<23:30:47,  3.45it/s]
 21%|██▏       | 79505/371472 [6:19:30<23:29:00,  3.45it/s]
 21%|██▏       | 79506/371472 [6:19:31<23:22:35,  3.47it/s]
 21%|██▏       | 79507/371472 [6:19:31<22:25:04,  3.62it/s]
 21%|██▏       | 79508/371472 [6:19:31<23:30:13,  3.45it/s]
 21%|██▏       | 79509/371472 [6:19:31<22:36:48,  3.59it/s]
 21%|██▏       | 79510/371472 [6:19:32<23:22:51,  3.47it/s]
 21%|██▏       | 79511/371472 [6:19:32<22:30:11,  3.60it/s]
 21%|██▏       | 79512/371472 [6:19:32<21:51:14,  3.71it/s]
 21%|██▏       | 79513/371472 [6:19:32<21:08:06,  3.84it/s]
 21%|██▏       | 79514/371472 [6:19:33<23:54:38,  3.39it/s]
 21%|██▏       | 79515/371472 [6:19:33<23:08:35,  3.50it/s]
 21%|██▏       | 79516/371472 [6:19:33<25:58:51,  3.12it/s]
 21%|██▏       | 79517/371472 [6:19:34<24:05:53,  3.37it/s]
 21%|██▏       | 79518/371472 [6:19:34<24:38:49,  3.29it/s]
 21%|██▏       | 79519/371472 [6:19:34<23:31:22,  3.45it/s]
 21%|██▏       | 79520/371472 [6:19:35<22:46:46,  3.56it/s]
                                                           
{'loss': 3.9956, 'learning_rate': 8.077204852507058e-07, 'epoch': 3.43}

 21%|██▏       | 79520/371472 [6:19:35<22:46:46,  3.56it/s]
 21%|██▏       | 79521/371472 [6:19:35<23:39:18,  3.43it/s]
 21%|██▏       | 79522/371472 [6:19:35<24:10:31,  3.35it/s]
 21%|██▏       | 79523/371472 [6:19:36<24:43:05,  3.28it/s]
 21%|██▏       | 79524/371472 [6:19:36<27:54:41,  2.91it/s]
 21%|██▏       | 79525/371472 [6:19:36<27:22:10,  2.96it/s]
 21%|██▏       | 79526/371472 [6:19:37<25:35:14,  3.17it/s]
 21%|██▏       | 79527/371472 [6:19:37<24:03:09,  3.37it/s]
 21%|██▏       | 79528/371472 [6:19:37<24:01:39,  3.38it/s]
 21%|██▏       | 79529/371472 [6:19:37<23:41:15,  3.42it/s]
 21%|██▏       | 79530/371472 [6:19:38<23:22:27,  3.47it/s]
 21%|██▏       | 79531/371472 [6:19:38<23:06:38,  3.51it/s]
 21%|██▏       | 79532/371472 [6:19:38<23:27:26,  3.46it/s]
 21%|██▏       | 79533/371472 [6:19:38<22:44:42,  3.57it/s]
 21%|██▏       | 79534/371472 [6:19:39<22:17:12,  3.64it/s]
 21%|██▏       | 79535/371472 [6:19:39<23:26:36,  3.46it/s]
 21%|██▏       | 79536/371472 [6:19:39<22:22:06,  3.63it/s]
 21%|██▏       | 79537/371472 [6:19:40<22:30:36,  3.60it/s]
 21%|██▏       | 79538/371472 [6:19:40<22:30:37,  3.60it/s]
 21%|██▏       | 79539/371472 [6:19:40<23:14:26,  3.49it/s]
 21%|██▏       | 79540/371472 [6:19:40<22:15:38,  3.64it/s]
                                                           
{'loss': 4.123, 'learning_rate': 8.076720032752267e-07, 'epoch': 3.43}

 21%|██▏       | 79540/371472 [6:19:40<22:15:38,  3.64it/s]
 21%|██▏       | 79541/371472 [6:19:41<21:36:09,  3.75it/s]
 21%|██▏       | 79542/371472 [6:19:41<20:55:28,  3.88it/s]
 21%|██▏       | 79543/371472 [6:19:41<21:07:53,  3.84it/s]
 21%|██▏       | 79544/371472 [6:19:41<20:58:28,  3.87it/s]
 21%|██▏       | 79545/371472 [6:19:42<21:20:29,  3.80it/s]
 21%|██▏       | 79546/371472 [6:19:42<22:03:32,  3.68it/s]
 21%|██▏       | 79547/371472 [6:19:42<21:57:45,  3.69it/s]
 21%|██▏       | 79548/371472 [6:19:43<20:59:51,  3.86it/s]
 21%|██▏       | 79549/371472 [6:19:43<20:44:07,  3.91it/s]
 21%|██▏       | 79550/371472 [6:19:43<20:41:49,  3.92it/s]
 21%|██▏       | 79551/371472 [6:19:43<20:41:38,  3.92it/s]
 21%|██▏       | 79552/371472 [6:19:44<22:24:04,  3.62it/s]
 21%|██▏       | 79553/371472 [6:19:44<23:32:53,  3.44it/s]
 21%|██▏       | 79554/371472 [6:19:44<22:09:31,  3.66it/s]
 21%|██▏       | 79555/371472 [6:19:44<22:29:01,  3.61it/s]
 21%|██▏       | 79556/371472 [6:19:45<22:17:14,  3.64it/s]
 21%|██▏       | 79557/371472 [6:19:45<22:26:48,  3.61it/s]
 21%|██▏       | 79558/371472 [6:19:45<23:35:07,  3.44it/s]
 21%|██▏       | 79559/371472 [6:19:46<22:35:10,  3.59it/s]
 21%|██▏       | 79560/371472 [6:19:46<23:08:04,  3.51it/s]
                                                           
{'loss': 4.0827, 'learning_rate': 8.076235212997478e-07, 'epoch': 3.43}

 21%|██▏       | 79560/371472 [6:19:46<23:08:04,  3.51it/s]
 21%|██▏       | 79561/371472 [6:19:46<27:28:00,  2.95it/s]
 21%|██▏       | 79562/371472 [6:19:47<26:24:27,  3.07it/s]
 21%|██▏       | 79563/371472 [6:19:47<24:36:41,  3.29it/s]
 21%|██▏       | 79564/371472 [6:19:47<24:03:34,  3.37it/s]
 21%|██▏       | 79565/371472 [6:19:47<24:51:14,  3.26it/s]
 21%|██▏       | 79566/371472 [6:19:48<24:02:48,  3.37it/s]
 21%|██▏       | 79567/371472 [6:19:48<23:40:11,  3.43it/s]
 21%|██▏       | 79568/371472 [6:19:48<23:29:12,  3.45it/s]
 21%|██▏       | 79569/371472 [6:19:49<23:55:52,  3.39it/s]
 21%|██▏       | 79570/371472 [6:19:49<24:13:11,  3.35it/s]
 21%|██▏       | 79571/371472 [6:19:49<24:41:43,  3.28it/s]
 21%|██▏       | 79572/371472 [6:19:50<23:36:18,  3.43it/s]
 21%|██▏       | 79573/371472 [6:19:50<23:45:45,  3.41it/s]
 21%|██▏       | 79574/371472 [6:19:50<24:08:42,  3.36it/s]
 21%|██▏       | 79575/371472 [6:19:51<28:21:14,  2.86it/s]
 21%|██▏       | 79576/371472 [6:19:51<27:55:26,  2.90it/s]
 21%|██▏       | 79577/371472 [6:19:51<25:39:06,  3.16it/s]
 21%|██▏       | 79578/371472 [6:19:51<24:36:51,  3.29it/s]
 21%|██▏       | 79579/371472 [6:19:52<24:05:37,  3.37it/s]
 21%|██▏       | 79580/371472 [6:19:52<22:40:34,  3.58it/s]
                                                           
{'loss': 3.9543, 'learning_rate': 8.07575039324269e-07, 'epoch': 3.43}

 21%|██▏       | 79580/371472 [6:19:52<22:40:34,  3.58it/s]
 21%|██▏       | 79581/371472 [6:19:52<21:57:57,  3.69it/s]
 21%|██▏       | 79582/371472 [6:19:52<21:38:07,  3.75it/s]
 21%|██▏       | 79583/371472 [6:19:53<21:42:08,  3.74it/s]
 21%|██▏       | 79584/371472 [6:19:53<21:09:32,  3.83it/s]
 21%|██▏       | 79585/371472 [6:19:53<21:18:56,  3.80it/s]
 21%|██▏       | 79586/371472 [6:19:54<21:34:48,  3.76it/s]
 21%|██▏       | 79587/371472 [6:19:54<21:18:50,  3.80it/s]
 21%|██▏       | 79588/371472 [6:19:54<21:07:01,  3.84it/s]
 21%|██▏       | 79589/371472 [6:19:54<22:27:08,  3.61it/s]
 21%|██▏       | 79590/371472 [6:19:55<21:40:52,  3.74it/s]
 21%|██▏       | 79591/371472 [6:19:55<22:29:53,  3.60it/s]
 21%|██▏       | 79592/371472 [6:19:55<23:39:12,  3.43it/s]
 21%|██▏       | 79593/371472 [6:19:56<24:03:37,  3.37it/s]
 21%|██▏       | 79594/371472 [6:19:56<24:29:49,  3.31it/s]
 21%|██▏       | 79595/371472 [6:19:56<24:17:47,  3.34it/s]
 21%|██▏       | 79596/371472 [6:19:56<23:16:33,  3.48it/s]
 21%|██▏       | 79597/371472 [6:19:57<23:03:04,  3.52it/s]
 21%|██▏       | 79598/371472 [6:19:57<22:26:33,  3.61it/s]
 21%|██▏       | 79599/371472 [6:19:57<21:46:38,  3.72it/s]
 21%|██▏       | 79600/371472 [6:19:57<21:59:34,  3.69it/s]
                                                           
{'loss': 4.219, 'learning_rate': 8.0752655734879e-07, 'epoch': 3.43}

 21%|██▏       | 79600/371472 [6:19:57<21:59:34,  3.69it/s]
 21%|██▏       | 79601/371472 [6:19:58<21:18:54,  3.80it/s]
 21%|██▏       | 79602/371472 [6:19:58<23:17:52,  3.48it/s]
 21%|██▏       | 79603/371472 [6:19:58<23:28:02,  3.45it/s]
 21%|██▏       | 79604/371472 [6:19:59<23:23:37,  3.47it/s]
 21%|██▏       | 79605/371472 [6:19:59<24:52:29,  3.26it/s]
 21%|██▏       | 79606/371472 [6:19:59<23:31:58,  3.45it/s]
 21%|██▏       | 79607/371472 [6:19:59<22:41:35,  3.57it/s]
 21%|██▏       | 79608/371472 [6:20:00<21:53:09,  3.70it/s]
 21%|██▏       | 79609/371472 [6:20:00<22:06:20,  3.67it/s]
 21%|██▏       | 79610/371472 [6:20:00<22:09:29,  3.66it/s]
 21%|██▏       | 79611/371472 [6:20:01<22:04:05,  3.67it/s]
 21%|██▏       | 79612/371472 [6:20:01<22:41:00,  3.57it/s]
 21%|██▏       | 79613/371472 [6:20:01<22:55:37,  3.54it/s]
 21%|██▏       | 79614/371472 [6:20:01<22:24:05,  3.62it/s]
 21%|██▏       | 79615/371472 [6:20:02<22:10:29,  3.66it/s]
 21%|██▏       | 79616/371472 [6:20:02<22:33:00,  3.60it/s]
 21%|██▏       | 79617/371472 [6:20:02<22:44:39,  3.56it/s]
 21%|██▏       | 79618/371472 [6:20:03<23:37:40,  3.43it/s]
 21%|██▏       | 79619/371472 [6:20:03<22:39:12,  3.58it/s]
 21%|██▏       | 79620/371472 [6:20:03<23:13:25,  3.49it/s]
                                                           
{'loss': 4.2555, 'learning_rate': 8.074780753733112e-07, 'epoch': 3.43}

 21%|██▏       | 79620/371472 [6:20:03<23:13:25,  3.49it/s]
 21%|██▏       | 79621/371472 [6:20:03<22:32:36,  3.60it/s]
 21%|██▏       | 79622/371472 [6:20:04<25:08:36,  3.22it/s]
 21%|██▏       | 79623/371472 [6:20:04<23:28:44,  3.45it/s]
 21%|██▏       | 79624/371472 [6:20:04<22:57:03,  3.53it/s]
 21%|██▏       | 79625/371472 [6:20:05<23:24:08,  3.46it/s]
 21%|██▏       | 79626/371472 [6:20:05<24:31:56,  3.30it/s]
 21%|██▏       | 79627/371472 [6:20:05<23:07:15,  3.51it/s]
 21%|██▏       | 79628/371472 [6:20:05<22:21:46,  3.63it/s]
 21%|██▏       | 79629/371472 [6:20:06<22:25:48,  3.61it/s]
 21%|██▏       | 79630/371472 [6:20:06<22:53:04,  3.54it/s]
 21%|██▏       | 79631/371472 [6:20:06<22:23:32,  3.62it/s]
 21%|██▏       | 79632/371472 [6:20:07<23:48:56,  3.40it/s]
 21%|██▏       | 79633/371472 [6:20:07<25:21:24,  3.20it/s]
 21%|██▏       | 79634/371472 [6:20:07<24:29:58,  3.31it/s]
 21%|██▏       | 79635/371472 [6:20:07<23:48:43,  3.40it/s]
 21%|██▏       | 79636/371472 [6:20:08<23:48:47,  3.40it/s]
 21%|██▏       | 79637/371472 [6:20:08<22:57:32,  3.53it/s]
 21%|██▏       | 79638/371472 [6:20:08<23:30:30,  3.45it/s]
 21%|██▏       | 79639/371472 [6:20:09<23:16:51,  3.48it/s]
 21%|██▏       | 79640/371472 [6:20:09<22:30:00,  3.60it/s]
                                                           
{'loss': 4.0652, 'learning_rate': 8.074295933978323e-07, 'epoch': 3.43}

 21%|██▏       | 79640/371472 [6:20:09<22:30:00,  3.60it/s]
 21%|██▏       | 79641/371472 [6:20:09<22:18:55,  3.63it/s]
 21%|██▏       | 79642/371472 [6:20:09<21:43:37,  3.73it/s]
 21%|██▏       | 79643/371472 [6:20:10<21:36:26,  3.75it/s]
 21%|██▏       | 79644/371472 [6:20:10<21:13:40,  3.82it/s]
 21%|██▏       | 79645/371472 [6:20:10<20:58:44,  3.86it/s]
 21%|██▏       | 79646/371472 [6:20:10<21:22:09,  3.79it/s]
 21%|██▏       | 79647/371472 [6:20:11<21:35:32,  3.75it/s]
 21%|██▏       | 79648/371472 [6:20:11<21:18:23,  3.80it/s]
 21%|██▏       | 79649/371472 [6:20:11<21:07:55,  3.84it/s]
 21%|██▏       | 79650/371472 [6:20:11<21:06:31,  3.84it/s]
 21%|██▏       | 79651/371472 [6:20:12<20:41:15,  3.92it/s]
 21%|██▏       | 79652/371472 [6:20:12<20:46:52,  3.90it/s]
 21%|██▏       | 79653/371472 [6:20:12<23:31:26,  3.45it/s]
 21%|██▏       | 79654/371472 [6:20:13<23:46:12,  3.41it/s]
 21%|██▏       | 79655/371472 [6:20:13<22:46:24,  3.56it/s]
 21%|██▏       | 79656/371472 [6:20:13<22:18:59,  3.63it/s]
 21%|██▏       | 79657/371472 [6:20:13<21:35:46,  3.75it/s]
 21%|██▏       | 79658/371472 [6:20:14<21:57:54,  3.69it/s]
 21%|██▏       | 79659/371472 [6:20:14<22:13:52,  3.65it/s]
 21%|██▏       | 79660/371472 [6:20:14<21:33:18,  3.76it/s]
                                                           
{'loss': 4.0591, 'learning_rate': 8.073811114223534e-07, 'epoch': 3.43}

 21%|██▏       | 79660/371472 [6:20:14<21:33:18,  3.76it/s]
 21%|██▏       | 79661/371472 [6:20:14<21:19:06,  3.80it/s]
 21%|██▏       | 79662/371472 [6:20:15<22:13:30,  3.65it/s]
 21%|██▏       | 79663/371472 [6:20:15<24:14:15,  3.34it/s]
 21%|██▏       | 79664/371472 [6:20:15<25:00:42,  3.24it/s]
 21%|██▏       | 79665/371472 [6:20:16<23:42:02,  3.42it/s]
 21%|██▏       | 79666/371472 [6:20:16<24:01:39,  3.37it/s]
 21%|██▏       | 79667/371472 [6:20:16<24:49:31,  3.27it/s]
 21%|██▏       | 79668/371472 [6:20:17<24:00:38,  3.38it/s]
 21%|██▏       | 79669/371472 [6:20:17<23:28:01,  3.45it/s]
 21%|██▏       | 79670/371472 [6:20:17<23:46:28,  3.41it/s]
 21%|██▏       | 79671/371472 [6:20:17<23:02:01,  3.52it/s]
 21%|██▏       | 79672/371472 [6:20:18<22:28:36,  3.61it/s]
 21%|██▏       | 79673/371472 [6:20:18<22:29:07,  3.60it/s]
 21%|██▏       | 79674/371472 [6:20:18<23:30:10,  3.45it/s]
 21%|██▏       | 79675/371472 [6:20:19<22:37:16,  3.58it/s]
 21%|██▏       | 79676/371472 [6:20:19<22:47:47,  3.56it/s]
 21%|██▏       | 79677/371472 [6:20:19<21:40:33,  3.74it/s]
 21%|██▏       | 79678/371472 [6:20:19<21:36:02,  3.75it/s]
 21%|██▏       | 79679/371472 [6:20:20<21:40:32,  3.74it/s]
 21%|██▏       | 79680/371472 [6:20:20<25:13:27,  3.21it/s]
                                                           
{'loss': 4.1497, 'learning_rate': 8.073326294468744e-07, 'epoch': 3.43}

 21%|██▏       | 79680/371472 [6:20:20<25:13:27,  3.21it/s]
 21%|██▏       | 79681/371472 [6:20:20<23:46:26,  3.41it/s]
 21%|██▏       | 79682/371472 [6:20:21<25:02:12,  3.24it/s]
 21%|██▏       | 79683/371472 [6:20:21<24:22:13,  3.33it/s]
 21%|██▏       | 79684/371472 [6:20:21<25:37:22,  3.16it/s]
 21%|██▏       | 79685/371472 [6:20:22<24:43:04,  3.28it/s]
 21%|██▏       | 79686/371472 [6:20:22<25:48:05,  3.14it/s]
 21%|██▏       | 79687/371472 [6:20:22<24:45:16,  3.27it/s]
 21%|██▏       | 79688/371472 [6:20:23<24:56:41,  3.25it/s]
 21%|██▏       | 79689/371472 [6:20:23<23:48:26,  3.40it/s]
 21%|██▏       | 79690/371472 [6:20:23<25:54:42,  3.13it/s]
 21%|██▏       | 79691/371472 [6:20:23<24:34:52,  3.30it/s]
 21%|██▏       | 79692/371472 [6:20:24<23:24:17,  3.46it/s]
 21%|██▏       | 79693/371472 [6:20:24<24:15:23,  3.34it/s]
 21%|██▏       | 79694/371472 [6:20:24<24:18:11,  3.33it/s]
 21%|██▏       | 79695/371472 [6:20:25<23:13:00,  3.49it/s]
 21%|██▏       | 79696/371472 [6:20:25<22:43:00,  3.57it/s]
 21%|██▏       | 79697/371472 [6:20:25<22:15:07,  3.64it/s]
 21%|██▏       | 79698/371472 [6:20:25<24:09:56,  3.35it/s]
 21%|██▏       | 79699/371472 [6:20:26<23:08:31,  3.50it/s]
 21%|██▏       | 79700/371472 [6:20:26<23:09:19,  3.50it/s]
                                                           
{'loss': 3.9374, 'learning_rate': 8.072841474713956e-07, 'epoch': 3.43}

 21%|██▏       | 79700/371472 [6:20:26<23:09:19,  3.50it/s]
 21%|██▏       | 79701/371472 [6:20:26<23:31:48,  3.44it/s]
 21%|██▏       | 79702/371472 [6:20:27<24:53:27,  3.26it/s]
 21%|██▏       | 79703/371472 [6:20:27<23:40:06,  3.42it/s]
 21%|██▏       | 79704/371472 [6:20:27<24:40:02,  3.29it/s]
 21%|██▏       | 79705/371472 [6:20:27<24:12:12,  3.35it/s]
 21%|██▏       | 79706/371472 [6:20:28<24:04:05,  3.37it/s]
 21%|██▏       | 79707/371472 [6:20:28<22:38:45,  3.58it/s]
 21%|██▏       | 79708/371472 [6:20:28<23:17:49,  3.48it/s]
 21%|██▏       | 79709/371472 [6:20:29<23:18:11,  3.48it/s]
 21%|██▏       | 79710/371472 [6:20:29<23:24:02,  3.46it/s]
 21%|██▏       | 79711/371472 [6:20:29<22:57:44,  3.53it/s]
 21%|██▏       | 79712/371472 [6:20:29<23:40:57,  3.42it/s]
 21%|██▏       | 79713/371472 [6:20:30<23:46:46,  3.41it/s]
 21%|██▏       | 79714/371472 [6:20:30<22:23:36,  3.62it/s]
 21%|██▏       | 79715/371472 [6:20:30<22:17:42,  3.64it/s]
 21%|██▏       | 79716/371472 [6:20:31<21:16:19,  3.81it/s]
 21%|██▏       | 79717/371472 [6:20:31<20:58:34,  3.86it/s]
 21%|██▏       | 79718/371472 [6:20:31<21:09:19,  3.83it/s]
 21%|██▏       | 79719/371472 [6:20:31<21:22:26,  3.79it/s]
 21%|██▏       | 79720/371472 [6:20:32<21:54:16,  3.70it/s]
                                                           
{'loss': 4.2275, 'learning_rate': 8.072356654959167e-07, 'epoch': 3.43}

 21%|██▏       | 79720/371472 [6:20:32<21:54:16,  3.70it/s]
 21%|██▏       | 79721/371472 [6:20:32<22:34:52,  3.59it/s]
 21%|██▏       | 79722/371472 [6:20:32<22:31:39,  3.60it/s]
 21%|██▏       | 79723/371472 [6:20:32<22:43:29,  3.57it/s]
 21%|██▏       | 79724/371472 [6:20:33<22:23:46,  3.62it/s]
 21%|██▏       | 79725/371472 [6:20:33<22:01:43,  3.68it/s]
 21%|██▏       | 79726/371472 [6:20:33<22:11:32,  3.65it/s]
 21%|██▏       | 79727/371472 [6:20:34<21:51:18,  3.71it/s]
 21%|██▏       | 79728/371472 [6:20:34<21:11:23,  3.82it/s]
 21%|██▏       | 79729/371472 [6:20:34<20:29:57,  3.95it/s]
 21%|██▏       | 79730/371472 [6:20:34<20:21:09,  3.98it/s]
 21%|██▏       | 79731/371472 [6:20:35<20:31:09,  3.95it/s]
 21%|██▏       | 79732/371472 [6:20:35<20:46:46,  3.90it/s]
 21%|██▏       | 79733/371472 [6:20:35<20:17:14,  3.99it/s]
 21%|██▏       | 79734/371472 [6:20:35<19:56:57,  4.06it/s]
 21%|██▏       | 79735/371472 [6:20:36<20:23:09,  3.98it/s]
 21%|██▏       | 79736/371472 [6:20:36<20:33:58,  3.94it/s]
 21%|██▏       | 79737/371472 [6:20:36<21:44:45,  3.73it/s]
 21%|██▏       | 79738/371472 [6:20:36<21:11:45,  3.82it/s]
 21%|██▏       | 79739/371472 [6:20:37<20:39:31,  3.92it/s]
 21%|██▏       | 79740/371472 [6:20:37<21:09:32,  3.83it/s]
                                                           
{'loss': 4.0602, 'learning_rate': 8.071871835204379e-07, 'epoch': 3.43}

 21%|██▏       | 79740/371472 [6:20:37<21:09:32,  3.83it/s]
 21%|██▏       | 79741/371472 [6:20:37<21:24:36,  3.78it/s]
 21%|██▏       | 79742/371472 [6:20:37<21:09:00,  3.83it/s]
 21%|██▏       | 79743/371472 [6:20:38<22:07:15,  3.66it/s]
 21%|██▏       | 79744/371472 [6:20:38<21:52:10,  3.71it/s]
 21%|██▏       | 79745/371472 [6:20:38<22:05:09,  3.67it/s]
 21%|██▏       | 79746/371472 [6:20:38<21:21:37,  3.79it/s]
 21%|██▏       | 79747/371472 [6:20:39<23:26:00,  3.46it/s]
 21%|██▏       | 79748/371472 [6:20:39<24:55:50,  3.25it/s]
 21%|██▏       | 79749/371472 [6:20:39<24:44:55,  3.27it/s]
 21%|██▏       | 79750/371472 [6:20:40<25:45:56,  3.15it/s]
 21%|██▏       | 79751/371472 [6:20:40<23:58:04,  3.38it/s]
 21%|██▏       | 79752/371472 [6:20:40<23:12:36,  3.49it/s]
 21%|██▏       | 79753/371472 [6:20:41<22:29:17,  3.60it/s]
 21%|██▏       | 79754/371472 [6:20:41<21:42:22,  3.73it/s]
 21%|██▏       | 79755/371472 [6:20:41<22:24:29,  3.62it/s]
 21%|██▏       | 79756/371472 [6:20:41<22:48:21,  3.55it/s]
 21%|██▏       | 79757/371472 [6:20:42<22:44:20,  3.56it/s]
 21%|██▏       | 79758/371472 [6:20:42<22:25:40,  3.61it/s]
 21%|██▏       | 79759/371472 [6:20:42<21:34:28,  3.76it/s]
 21%|██▏       | 79760/371472 [6:20:42<21:17:38,  3.81it/s]
                                                           
{'loss': 4.0096, 'learning_rate': 8.071387015449589e-07, 'epoch': 3.44}

 21%|██▏       | 79760/371472 [6:20:42<21:17:38,  3.81it/s]
 21%|██▏       | 79761/371472 [6:20:43<21:19:46,  3.80it/s]
 21%|██▏       | 79762/371472 [6:20:43<28:19:21,  2.86it/s]
 21%|██▏       | 79763/371472 [6:20:43<25:45:40,  3.15it/s]
 21%|██▏       | 79764/371472 [6:20:44<24:39:09,  3.29it/s]
 21%|██▏       | 79765/371472 [6:20:44<24:23:54,  3.32it/s]
 21%|██▏       | 79766/371472 [6:20:44<24:41:55,  3.28it/s]
 21%|██▏       | 79767/371472 [6:20:45<23:38:55,  3.43it/s]
 21%|██▏       | 79768/371472 [6:20:45<22:15:06,  3.64it/s]
 21%|██▏       | 79769/371472 [6:20:45<21:41:38,  3.74it/s]
 21%|██▏       | 79770/371472 [6:20:45<21:35:16,  3.75it/s]
 21%|██▏       | 79771/371472 [6:20:46<24:33:21,  3.30it/s]
 21%|██▏       | 79772/371472 [6:20:46<24:35:53,  3.29it/s]
 21%|██▏       | 79773/371472 [6:20:46<24:24:16,  3.32it/s]
 21%|██▏       | 79774/371472 [6:20:47<23:28:44,  3.45it/s]
 21%|██▏       | 79775/371472 [6:20:47<23:18:31,  3.48it/s]
 21%|██▏       | 79776/371472 [6:20:47<22:39:40,  3.58it/s]
 21%|██▏       | 79777/371472 [6:20:48<24:02:18,  3.37it/s]
 21%|██▏       | 79778/371472 [6:20:48<26:37:49,  3.04it/s]
 21%|██▏       | 79779/371472 [6:20:48<25:31:10,  3.18it/s]
 21%|██▏       | 79780/371472 [6:20:48<24:13:10,  3.35it/s]
                                                           
{'loss': 4.1275, 'learning_rate': 8.0709021956948e-07, 'epoch': 3.44}

 21%|██▏       | 79780/371472 [6:20:48<24:13:10,  3.35it/s]
 21%|██▏       | 79781/371472 [6:20:49<24:15:37,  3.34it/s]
 21%|██▏       | 79782/371472 [6:20:49<23:25:35,  3.46it/s]
 21%|██▏       | 79783/371472 [6:20:49<23:38:42,  3.43it/s]
 21%|██▏       | 79784/371472 [6:20:50<22:48:20,  3.55it/s]
 21%|██▏       | 79785/371472 [6:20:50<21:57:25,  3.69it/s]
 21%|██▏       | 79786/371472 [6:20:50<21:33:34,  3.76it/s]
 21%|██▏       | 79787/371472 [6:20:50<22:59:57,  3.52it/s]
 21%|██▏       | 79788/371472 [6:20:51<23:59:09,  3.38it/s]
 21%|██▏       | 79789/371472 [6:20:51<22:41:24,  3.57it/s]
 21%|██▏       | 79790/371472 [6:20:51<22:51:07,  3.55it/s]
 21%|██▏       | 79791/371472 [6:20:52<23:06:37,  3.51it/s]
 21%|██▏       | 79792/371472 [6:20:52<23:33:11,  3.44it/s]
 21%|██▏       | 79793/371472 [6:20:52<22:50:34,  3.55it/s]
 21%|██▏       | 79794/371472 [6:20:52<22:37:16,  3.58it/s]
 21%|██▏       | 79795/371472 [6:20:53<23:36:09,  3.43it/s]
 21%|██▏       | 79796/371472 [6:20:53<23:19:02,  3.47it/s]
 21%|██▏       | 79797/371472 [6:20:53<24:23:54,  3.32it/s]
 21%|██▏       | 79798/371472 [6:20:54<23:33:48,  3.44it/s]
 21%|██▏       | 79799/371472 [6:20:54<22:55:52,  3.53it/s]
 21%|██▏       | 79800/371472 [6:20:54<22:47:30,  3.55it/s]
                                                           
{'loss': 4.0328, 'learning_rate': 8.070417375940011e-07, 'epoch': 3.44}

 21%|██▏       | 79800/371472 [6:20:54<22:47:30,  3.55it/s]
 21%|██▏       | 79801/371472 [6:20:54<23:35:29,  3.43it/s]
 21%|██▏       | 79802/371472 [6:20:55<23:46:25,  3.41it/s]
 21%|██▏       | 79803/371472 [6:20:55<22:53:47,  3.54it/s]
 21%|██▏       | 79804/371472 [6:20:55<22:33:28,  3.59it/s]
 21%|██▏       | 79805/371472 [6:20:56<22:49:19,  3.55it/s]
 21%|██▏       | 79806/371472 [6:20:56<22:05:22,  3.67it/s]
 21%|██▏       | 79807/371472 [6:20:56<23:03:00,  3.51it/s]
 21%|██▏       | 79808/371472 [6:20:56<22:16:22,  3.64it/s]
 21%|██▏       | 79809/371472 [6:20:57<23:21:44,  3.47it/s]
 21%|██▏       | 79810/371472 [6:20:57<22:30:05,  3.60it/s]
 21%|██▏       | 79811/371472 [6:20:57<22:14:40,  3.64it/s]
 21%|██▏       | 79812/371472 [6:20:57<21:25:26,  3.78it/s]
 21%|██▏       | 79813/371472 [6:20:58<20:48:00,  3.89it/s]
 21%|██▏       | 79814/371472 [6:20:58<21:16:05,  3.81it/s]
 21%|██▏       | 79815/371472 [6:20:58<21:35:23,  3.75it/s]
 21%|██▏       | 79816/371472 [6:20:59<21:33:26,  3.76it/s]
 21%|██▏       | 79817/371472 [6:20:59<22:23:31,  3.62it/s]
 21%|██▏       | 79818/371472 [6:20:59<23:04:55,  3.51it/s]
 21%|██▏       | 79819/371472 [6:20:59<22:50:14,  3.55it/s]
 21%|██▏       | 79820/371472 [6:21:00<22:08:08,  3.66it/s]
                                                           
{'loss': 4.162, 'learning_rate': 8.069932556185223e-07, 'epoch': 3.44}

 21%|██▏       | 79820/371472 [6:21:00<22:08:08,  3.66it/s]
 21%|██▏       | 79821/371472 [6:21:00<21:51:18,  3.71it/s]
 21%|██▏       | 79822/371472 [6:21:00<21:17:26,  3.81it/s]
 21%|██▏       | 79823/371472 [6:21:00<21:54:44,  3.70it/s]
 21%|██▏       | 79824/371472 [6:21:01<21:32:34,  3.76it/s]
 21%|██▏       | 79825/371472 [6:21:01<21:20:45,  3.80it/s]
 21%|██▏       | 79826/371472 [6:21:01<21:20:53,  3.79it/s]
 21%|██▏       | 79827/371472 [6:21:02<21:59:57,  3.68it/s]
 21%|██▏       | 79828/371472 [6:21:02<24:00:18,  3.37it/s]
 21%|██▏       | 79829/371472 [6:21:02<24:46:33,  3.27it/s]
 21%|██▏       | 79830/371472 [6:21:03<25:11:31,  3.22it/s]
 21%|██▏       | 79831/371472 [6:21:03<25:18:53,  3.20it/s]
 21%|██▏       | 79832/371472 [6:21:03<24:13:20,  3.34it/s]
 21%|██▏       | 79833/371472 [6:21:03<25:04:10,  3.23it/s]
 21%|██▏       | 79834/371472 [6:21:04<23:49:29,  3.40it/s]
 21%|██▏       | 79835/371472 [6:21:04<23:12:41,  3.49it/s]
 21%|██▏       | 79836/371472 [6:21:04<22:32:53,  3.59it/s]
 21%|██▏       | 79837/371472 [6:21:04<21:57:35,  3.69it/s]
 21%|██▏       | 79838/371472 [6:21:05<22:36:33,  3.58it/s]
 21%|██▏       | 79839/371472 [6:21:05<22:36:58,  3.58it/s]
 21%|██▏       | 79840/371472 [6:21:05<22:19:37,  3.63it/s]
                                                           
{'loss': 4.3089, 'learning_rate': 8.069447736430433e-07, 'epoch': 3.44}

 21%|██▏       | 79840/371472 [6:21:05<22:19:37,  3.63it/s]
 21%|██▏       | 79841/371472 [6:21:06<22:39:05,  3.58it/s]
 21%|██▏       | 79842/371472 [6:21:06<22:20:53,  3.62it/s]
 21%|██▏       | 79843/371472 [6:21:06<22:03:37,  3.67it/s]
 21%|██▏       | 79844/371472 [6:21:06<23:28:02,  3.45it/s]
 21%|██▏       | 79845/371472 [6:21:07<24:17:19,  3.34it/s]
 21%|██▏       | 79846/371472 [6:21:07<25:15:21,  3.21it/s]
 21%|██▏       | 79847/371472 [6:21:07<24:07:06,  3.36it/s]
 21%|██▏       | 79848/371472 [6:21:08<23:19:53,  3.47it/s]
 21%|██▏       | 79849/371472 [6:21:08<23:18:52,  3.47it/s]
 21%|██▏       | 79850/371472 [6:21:08<24:03:59,  3.37it/s]
 21%|██▏       | 79851/371472 [6:21:09<24:57:02,  3.25it/s]
 21%|██▏       | 79852/371472 [6:21:09<25:00:24,  3.24it/s]
 21%|██▏       | 79853/371472 [6:21:09<24:24:54,  3.32it/s]
 21%|██▏       | 79854/371472 [6:21:09<23:09:33,  3.50it/s]
 21%|██▏       | 79855/371472 [6:21:10<22:10:13,  3.65it/s]
 21%|██▏       | 79856/371472 [6:21:10<22:53:21,  3.54it/s]
 21%|██▏       | 79857/371472 [6:21:10<22:22:37,  3.62it/s]
 21%|██▏       | 79858/371472 [6:21:11<23:48:17,  3.40it/s]
 21%|██▏       | 79859/371472 [6:21:11<24:00:36,  3.37it/s]
 21%|██▏       | 79860/371472 [6:21:11<23:30:17,  3.45it/s]
                                                           
{'loss': 3.8873, 'learning_rate': 8.068962916675643e-07, 'epoch': 3.44}

 21%|██▏       | 79860/371472 [6:21:11<23:30:17,  3.45it/s]
 21%|██▏       | 79861/371472 [6:21:11<23:15:01,  3.48it/s]
 21%|██▏       | 79862/371472 [6:21:12<22:57:58,  3.53it/s]
 21%|██▏       | 79863/371472 [6:21:12<22:28:12,  3.60it/s]
 21%|██▏       | 79864/371472 [6:21:12<21:39:43,  3.74it/s]
 21%|██▏       | 79865/371472 [6:21:12<20:57:43,  3.86it/s]
 21%|██▏       | 79866/371472 [6:21:13<21:06:47,  3.84it/s]
 22%|██▏       | 79867/371472 [6:21:13<21:08:18,  3.83it/s]
 22%|██▏       | 79868/371472 [6:21:13<20:45:18,  3.90it/s]
 22%|██▏       | 79869/371472 [6:21:14<20:49:48,  3.89it/s]
 22%|██▏       | 79870/371472 [6:21:14<21:25:16,  3.78it/s]
 22%|██▏       | 79871/371472 [6:21:14<21:00:25,  3.86it/s]
 22%|██▏       | 79872/371472 [6:21:14<21:09:37,  3.83it/s]
 22%|██▏       | 79873/371472 [6:21:15<21:11:33,  3.82it/s]
 22%|██▏       | 79874/371472 [6:21:15<21:23:03,  3.79it/s]
 22%|██▏       | 79875/371472 [6:21:15<23:14:41,  3.48it/s]
 22%|██▏       | 79876/371472 [6:21:15<23:01:00,  3.52it/s]
 22%|██▏       | 79877/371472 [6:21:16<23:10:24,  3.50it/s]
 22%|██▏       | 79878/371472 [6:21:16<22:16:13,  3.64it/s]
 22%|██▏       | 79879/371472 [6:21:16<22:02:55,  3.67it/s]
 22%|██▏       | 79880/371472 [6:21:17<22:56:13,  3.53it/s]
                                                           
{'loss': 4.2677, 'learning_rate': 8.068478096920856e-07, 'epoch': 3.44}

 22%|██▏       | 79880/371472 [6:21:17<22:56:13,  3.53it/s]
 22%|██▏       | 79881/371472 [6:21:17<23:49:42,  3.40it/s]
 22%|██▏       | 79882/371472 [6:21:17<23:48:13,  3.40it/s]
 22%|██▏       | 79883/371472 [6:21:17<23:00:04,  3.52it/s]
 22%|██▏       | 79884/371472 [6:21:18<22:36:40,  3.58it/s]
 22%|██▏       | 79885/371472 [6:21:18<24:03:08,  3.37it/s]
 22%|██▏       | 79886/371472 [6:21:18<23:55:49,  3.38it/s]
 22%|██▏       | 79887/371472 [6:21:19<23:28:42,  3.45it/s]
 22%|██▏       | 79888/371472 [6:21:19<22:38:38,  3.58it/s]
 22%|██▏       | 79889/371472 [6:21:19<22:01:42,  3.68it/s]
 22%|██▏       | 79890/371472 [6:21:19<22:18:37,  3.63it/s]
 22%|██▏       | 79891/371472 [6:21:20<22:29:21,  3.60it/s]
 22%|██▏       | 79892/371472 [6:21:20<22:22:08,  3.62it/s]
 22%|██▏       | 79893/371472 [6:21:20<23:07:54,  3.50it/s]
 22%|██▏       | 79894/371472 [6:21:21<23:38:46,  3.43it/s]
 22%|██▏       | 79895/371472 [6:21:21<23:06:55,  3.50it/s]
 22%|██▏       | 79896/371472 [6:21:21<23:07:34,  3.50it/s]
 22%|██▏       | 79897/371472 [6:21:21<24:54:50,  3.25it/s]
 22%|██▏       | 79898/371472 [6:21:22<24:05:14,  3.36it/s]
 22%|██▏       | 79899/371472 [6:21:22<22:50:50,  3.54it/s]
 22%|██▏       | 79900/371472 [6:21:22<22:05:00,  3.67it/s]
                                                           
{'loss': 4.2398, 'learning_rate': 8.067993277166068e-07, 'epoch': 3.44}

 22%|██▏       | 79900/371472 [6:21:22<22:05:00,  3.67it/s]
 22%|██▏       | 79901/371472 [6:21:23<21:42:20,  3.73it/s]
 22%|██▏       | 79902/371472 [6:21:23<20:57:42,  3.86it/s]
 22%|██▏       | 79903/371472 [6:21:23<20:35:18,  3.93it/s]
 22%|██▏       | 79904/371472 [6:21:23<21:00:00,  3.86it/s]
 22%|██▏       | 79905/371472 [6:21:24<20:54:26,  3.87it/s]
 22%|██▏       | 79906/371472 [6:21:24<22:14:20,  3.64it/s]
 22%|██▏       | 79907/371472 [6:21:24<24:01:03,  3.37it/s]
 22%|██▏       | 79908/371472 [6:21:24<23:52:18,  3.39it/s]
 22%|██▏       | 79909/371472 [6:21:25<24:01:24,  3.37it/s]
 22%|██▏       | 79910/371472 [6:21:25<25:36:34,  3.16it/s]
 22%|██▏       | 79911/371472 [6:21:25<25:54:01,  3.13it/s]
 22%|██▏       | 79912/371472 [6:21:26<24:45:02,  3.27it/s]
 22%|██▏       | 79913/371472 [6:21:26<26:27:40,  3.06it/s]
 22%|██▏       | 79914/371472 [6:21:26<24:52:44,  3.26it/s]
 22%|██▏       | 79915/371472 [6:21:27<25:37:17,  3.16it/s]
 22%|██▏       | 79916/371472 [6:21:27<24:41:15,  3.28it/s]
 22%|██▏       | 79917/371472 [6:21:27<23:23:36,  3.46it/s]
 22%|██▏       | 79918/371472 [6:21:28<23:01:39,  3.52it/s]
 22%|██▏       | 79919/371472 [6:21:28<22:00:05,  3.68it/s]
 22%|██▏       | 79920/371472 [6:21:28<21:15:20,  3.81it/s]
                                                           
{'loss': 3.9996, 'learning_rate': 8.067508457411277e-07, 'epoch': 3.44}

 22%|██▏       | 79920/371472 [6:21:28<21:15:20,  3.81it/s]
 22%|██▏       | 79921/371472 [6:21:28<22:57:18,  3.53it/s]
 22%|██▏       | 79922/371472 [6:21:29<22:52:56,  3.54it/s]
 22%|██▏       | 79923/371472 [6:21:29<23:38:01,  3.43it/s]
 22%|██▏       | 79924/371472 [6:21:29<23:48:32,  3.40it/s]
 22%|██▏       | 79925/371472 [6:21:30<24:49:22,  3.26it/s]
 22%|██▏       | 79926/371472 [6:21:30<24:28:00,  3.31it/s]
 22%|██▏       | 79927/371472 [6:21:30<24:25:10,  3.32it/s]
 22%|██▏       | 79928/371472 [6:21:30<23:26:08,  3.46it/s]
 22%|██▏       | 79929/371472 [6:21:31<22:40:06,  3.57it/s]
 22%|██▏       | 79930/371472 [6:21:31<23:14:16,  3.48it/s]
 22%|██▏       | 79931/371472 [6:21:31<22:15:19,  3.64it/s]
 22%|██▏       | 79932/371472 [6:21:32<22:19:46,  3.63it/s]
 22%|██▏       | 79933/371472 [6:21:32<22:37:33,  3.58it/s]
 22%|██▏       | 79934/371472 [6:21:32<22:10:26,  3.65it/s]
 22%|██▏       | 79935/371472 [6:21:32<22:37:26,  3.58it/s]
 22%|██▏       | 79936/371472 [6:21:33<22:15:43,  3.64it/s]
 22%|██▏       | 79937/371472 [6:21:33<23:55:30,  3.38it/s]
 22%|██▏       | 79938/371472 [6:21:33<23:29:27,  3.45it/s]
 22%|██▏       | 79939/371472 [6:21:33<23:00:12,  3.52it/s]
 22%|██▏       | 79940/371472 [6:21:34<22:24:16,  3.61it/s]
                                                           
{'loss': 3.9097, 'learning_rate': 8.067023637656488e-07, 'epoch': 3.44}

 22%|██▏       | 79940/371472 [6:21:34<22:24:16,  3.61it/s]
 22%|██▏       | 79941/371472 [6:21:34<22:05:57,  3.66it/s]
 22%|██▏       | 79942/371472 [6:21:34<22:05:39,  3.67it/s]
 22%|██▏       | 79943/371472 [6:21:35<21:24:43,  3.78it/s]
 22%|██▏       | 79944/371472 [6:21:35<21:45:52,  3.72it/s]
 22%|██▏       | 79945/371472 [6:21:35<21:30:23,  3.77it/s]
 22%|██▏       | 79946/371472 [6:21:35<22:14:50,  3.64it/s]
 22%|██▏       | 79947/371472 [6:21:36<22:15:24,  3.64it/s]
 22%|██▏       | 79948/371472 [6:21:36<22:56:03,  3.53it/s]
 22%|██▏       | 79949/371472 [6:21:36<23:20:55,  3.47it/s]
 22%|██▏       | 79950/371472 [6:21:37<23:14:04,  3.49it/s]
 22%|██▏       | 79951/371472 [6:21:37<21:50:02,  3.71it/s]
 22%|██▏       | 79952/371472 [6:21:37<22:37:34,  3.58it/s]
 22%|██▏       | 79953/371472 [6:21:37<22:01:01,  3.68it/s]
 22%|██▏       | 79954/371472 [6:21:38<21:31:52,  3.76it/s]
 22%|██▏       | 79955/371472 [6:21:38<21:15:35,  3.81it/s]
 22%|██▏       | 79956/371472 [6:21:38<22:13:45,  3.64it/s]
 22%|██▏       | 79957/371472 [6:21:38<22:46:57,  3.55it/s]
 22%|██▏       | 79958/371472 [6:21:39<23:48:07,  3.40it/s]
 22%|██▏       | 79959/371472 [6:21:39<22:51:41,  3.54it/s]
 22%|██▏       | 79960/371472 [6:21:39<22:27:03,  3.61it/s]
                                                           
{'loss': 4.1524, 'learning_rate': 8.066538817901701e-07, 'epoch': 3.44}

 22%|██▏       | 79960/371472 [6:21:39<22:27:03,  3.61it/s]
 22%|██▏       | 79961/371472 [6:21:40<21:56:31,  3.69it/s]
 22%|██▏       | 79962/371472 [6:21:40<22:26:43,  3.61it/s]
 22%|██▏       | 79963/371472 [6:21:40<22:04:45,  3.67it/s]
 22%|██▏       | 79964/371472 [6:21:40<21:57:22,  3.69it/s]
 22%|██▏       | 79965/371472 [6:21:41<21:32:55,  3.76it/s]
 22%|██▏       | 79966/371472 [6:21:41<22:03:45,  3.67it/s]
 22%|██▏       | 79967/371472 [6:21:41<22:10:52,  3.65it/s]
 22%|██▏       | 79968/371472 [6:21:41<21:43:55,  3.73it/s]
 22%|██▏       | 79969/371472 [6:21:42<22:22:29,  3.62it/s]
 22%|██▏       | 79970/371472 [6:21:42<22:18:37,  3.63it/s]
 22%|██▏       | 79971/371472 [6:21:42<21:18:38,  3.80it/s]
 22%|██▏       | 79972/371472 [6:21:43<21:37:40,  3.74it/s]
 22%|██▏       | 79973/371472 [6:21:43<21:37:18,  3.74it/s]
 22%|██▏       | 79974/371472 [6:21:43<22:46:00,  3.56it/s]
 22%|██▏       | 79975/371472 [6:21:43<22:20:02,  3.63it/s]
 22%|██▏       | 79976/371472 [6:21:44<21:40:42,  3.74it/s]
 22%|██▏       | 79977/371472 [6:21:44<21:31:21,  3.76it/s]
 22%|██▏       | 79978/371472 [6:21:44<22:06:45,  3.66it/s]
 22%|██▏       | 79979/371472 [6:21:44<21:38:18,  3.74it/s]
 22%|██▏       | 79980/371472 [6:21:45<22:27:53,  3.60it/s]
                                                           
{'loss': 4.1301, 'learning_rate': 8.066053998146911e-07, 'epoch': 3.44}

 22%|██▏       | 79980/371472 [6:21:45<22:27:53,  3.60it/s]
 22%|██▏       | 79981/371472 [6:21:45<23:40:03,  3.42it/s]
 22%|██▏       | 79982/371472 [6:21:45<22:11:20,  3.65it/s]
 22%|██▏       | 79983/371472 [6:21:46<22:23:22,  3.62it/s]
 22%|██▏       | 79984/371472 [6:21:46<22:03:32,  3.67it/s]
 22%|██▏       | 79985/371472 [6:21:46<21:35:43,  3.75it/s]
 22%|██▏       | 79986/371472 [6:21:46<21:31:16,  3.76it/s]
 22%|██▏       | 79987/371472 [6:21:47<21:01:19,  3.85it/s]
 22%|██▏       | 79988/371472 [6:21:47<21:18:12,  3.80it/s]
 22%|██▏       | 79989/371472 [6:21:47<21:38:34,  3.74it/s]
 22%|██▏       | 79990/371472 [6:21:47<21:47:54,  3.71it/s]
 22%|██▏       | 79991/371472 [6:21:48<22:36:55,  3.58it/s]
 22%|██▏       | 79992/371472 [6:21:48<22:19:43,  3.63it/s]
 22%|██▏       | 79993/371472 [6:21:48<23:06:46,  3.50it/s]
 22%|██▏       | 79994/371472 [6:21:49<22:33:41,  3.59it/s]
 22%|██▏       | 79995/371472 [6:21:49<23:20:44,  3.47it/s]
 22%|██▏       | 79996/371472 [6:21:49<23:40:54,  3.42it/s]
 22%|██▏       | 79997/371472 [6:21:49<23:37:04,  3.43it/s]
 22%|██▏       | 79998/371472 [6:21:50<23:31:54,  3.44it/s]
 22%|██▏       | 79999/371472 [6:21:50<23:26:06,  3.45it/s]
 22%|██▏       | 80000/371472 [6:21:50<22:31:18,  3.59it/s]
                                                           
{'loss': 4.2439, 'learning_rate': 8.065569178392122e-07, 'epoch': 3.45}

 22%|██▏       | 80000/371472 [6:21:50<22:31:18,  3.59it/s]
 22%|██▏       | 80001/371472 [6:21:51<21:40:45,  3.73it/s]
 22%|██▏       | 80002/371472 [6:21:51<22:03:44,  3.67it/s]
 22%|██▏       | 80003/371472 [6:21:51<21:20:05,  3.79it/s]
 22%|██▏       | 80004/371472 [6:21:51<22:49:34,  3.55it/s]
 22%|██▏       | 80005/371472 [6:21:52<22:54:09,  3.54it/s]
 22%|██▏       | 80006/371472 [6:21:52<22:35:07,  3.58it/s]
 22%|██▏       | 80007/371472 [6:21:52<21:43:08,  3.73it/s]
 22%|██▏       | 80008/371472 [6:21:52<21:27:02,  3.77it/s]
 22%|██▏       | 80009/371472 [6:21:53<22:14:03,  3.64it/s]
 22%|██▏       | 80010/371472 [6:21:53<21:44:25,  3.72it/s]
 22%|██▏       | 80011/371472 [6:21:53<21:49:31,  3.71it/s]
 22%|██▏       | 80012/371472 [6:21:53<21:37:33,  3.74it/s]
 22%|██▏       | 80013/371472 [6:21:54<21:26:14,  3.78it/s]
 22%|██▏       | 80014/371472 [6:21:54<21:00:45,  3.85it/s]
 22%|██▏       | 80015/371472 [6:21:54<20:45:07,  3.90it/s]
 22%|██▏       | 80016/371472 [6:21:55<20:38:28,  3.92it/s]
 22%|██▏       | 80017/371472 [6:21:55<20:25:42,  3.96it/s]
 22%|██▏       | 80018/371472 [6:21:55<20:22:31,  3.97it/s]
 22%|██▏       | 80019/371472 [6:21:55<21:21:18,  3.79it/s]
 22%|██▏       | 80020/371472 [6:21:56<21:38:32,  3.74it/s]
                                                           
{'loss': 4.1968, 'learning_rate': 8.065084358637333e-07, 'epoch': 3.45}

 22%|██▏       | 80020/371472 [6:21:56<21:38:32,  3.74it/s]
 22%|██▏       | 80021/371472 [6:21:56<23:26:55,  3.45it/s]
 22%|██▏       | 80022/371472 [6:21:56<23:22:48,  3.46it/s]
 22%|██▏       | 80023/371472 [6:21:56<23:01:55,  3.52it/s]
 22%|██▏       | 80024/371472 [6:21:57<24:28:16,  3.31it/s]
 22%|██▏       | 80025/371472 [6:21:57<24:08:19,  3.35it/s]
 22%|██▏       | 80026/371472 [6:21:57<24:05:35,  3.36it/s]
 22%|██▏       | 80027/371472 [6:21:58<23:14:39,  3.48it/s]
 22%|██▏       | 80028/371472 [6:21:58<22:27:50,  3.60it/s]
 22%|██▏       | 80029/371472 [6:21:58<22:49:05,  3.55it/s]
 22%|██▏       | 80030/371472 [6:21:58<22:09:07,  3.65it/s]
 22%|██▏       | 80031/371472 [6:21:59<23:06:54,  3.50it/s]
 22%|██▏       | 80032/371472 [6:21:59<22:20:20,  3.62it/s]
 22%|██▏       | 80033/371472 [6:21:59<22:20:22,  3.62it/s]
 22%|██▏       | 80034/371472 [6:22:00<26:02:58,  3.11it/s]
 22%|██▏       | 80035/371472 [6:22:00<25:30:10,  3.17it/s]
 22%|██▏       | 80036/371472 [6:22:00<24:40:53,  3.28it/s]
 22%|██▏       | 80037/371472 [6:22:01<23:16:49,  3.48it/s]
 22%|██▏       | 80038/371472 [6:22:01<22:29:49,  3.60it/s]
 22%|██▏       | 80039/371472 [6:22:01<22:36:44,  3.58it/s]
 22%|██▏       | 80040/371472 [6:22:01<21:54:46,  3.69it/s]
                                                           
{'loss': 3.9466, 'learning_rate': 8.064599538882544e-07, 'epoch': 3.45}

 22%|██▏       | 80040/371472 [6:22:01<21:54:46,  3.69it/s]
 22%|██▏       | 80041/371472 [6:22:02<22:00:57,  3.68it/s]
 22%|██▏       | 80042/371472 [6:22:02<22:09:54,  3.65it/s]
 22%|██▏       | 80043/371472 [6:22:02<21:48:46,  3.71it/s]
 22%|██▏       | 80044/371472 [6:22:02<21:22:16,  3.79it/s]
 22%|██▏       | 80045/371472 [6:22:03<20:57:30,  3.86it/s]
 22%|██▏       | 80046/371472 [6:22:03<20:56:31,  3.87it/s]
 22%|██▏       | 80047/371472 [6:22:03<22:10:58,  3.65it/s]
 22%|██▏       | 80048/371472 [6:22:03<21:57:25,  3.69it/s]
 22%|██▏       | 80049/371472 [6:22:04<21:48:11,  3.71it/s]
 22%|██▏       | 80050/371472 [6:22:04<21:07:26,  3.83it/s]
 22%|██▏       | 80051/371472 [6:22:04<23:03:57,  3.51it/s]
 22%|██▏       | 80052/371472 [6:22:05<23:04:47,  3.51it/s]
 22%|██▏       | 80053/371472 [6:22:05<22:32:33,  3.59it/s]
 22%|██▏       | 80054/371472 [6:22:05<25:09:18,  3.22it/s]
 22%|██▏       | 80055/371472 [6:22:06<27:07:46,  2.98it/s]
 22%|██▏       | 80056/371472 [6:22:06<25:33:40,  3.17it/s]
 22%|██▏       | 80057/371472 [6:22:06<24:01:49,  3.37it/s]
 22%|██▏       | 80058/371472 [6:22:06<23:32:37,  3.44it/s]
 22%|██▏       | 80059/371472 [6:22:07<23:55:32,  3.38it/s]
 22%|██▏       | 80060/371472 [6:22:07<23:47:44,  3.40it/s]
                                                           
{'loss': 4.2493, 'learning_rate': 8.064114719127755e-07, 'epoch': 3.45}

 22%|██▏       | 80060/371472 [6:22:07<23:47:44,  3.40it/s]
 22%|██▏       | 80061/371472 [6:22:07<23:59:47,  3.37it/s]
 22%|██▏       | 80062/371472 [6:22:08<24:32:25,  3.30it/s]
 22%|██▏       | 80063/371472 [6:22:08<23:48:51,  3.40it/s]
 22%|██▏       | 80064/371472 [6:22:08<23:17:46,  3.47it/s]
 22%|██▏       | 80065/371472 [6:22:09<23:32:06,  3.44it/s]
 22%|██▏       | 80066/371472 [6:22:09<23:30:01,  3.44it/s]
 22%|██▏       | 80067/371472 [6:22:09<25:00:07,  3.24it/s]
 22%|██▏       | 80068/371472 [6:22:09<23:48:26,  3.40it/s]
 22%|██▏       | 80069/371472 [6:22:10<23:05:06,  3.51it/s]
 22%|██▏       | 80070/371472 [6:22:10<23:23:00,  3.46it/s]
 22%|██▏       | 80071/371472 [6:22:10<22:55:42,  3.53it/s]
 22%|██▏       | 80072/371472 [6:22:11<22:53:50,  3.54it/s]
 22%|██▏       | 80073/371472 [6:22:11<22:39:58,  3.57it/s]
 22%|██▏       | 80074/371472 [6:22:11<22:36:58,  3.58it/s]
 22%|██▏       | 80075/371472 [6:22:11<22:39:59,  3.57it/s]
 22%|██▏       | 80076/371472 [6:22:12<23:20:16,  3.47it/s]
 22%|██▏       | 80077/371472 [6:22:12<22:36:20,  3.58it/s]
 22%|██▏       | 80078/371472 [6:22:12<23:18:48,  3.47it/s]
 22%|██▏       | 80079/371472 [6:22:13<22:39:24,  3.57it/s]
 22%|██▏       | 80080/371472 [6:22:13<23:38:31,  3.42it/s]
                                                           
{'loss': 4.1672, 'learning_rate': 8.063629899372966e-07, 'epoch': 3.45}

 22%|██▏       | 80080/371472 [6:22:13<23:38:31,  3.42it/s]
 22%|██▏       | 80081/371472 [6:22:13<24:36:09,  3.29it/s]
 22%|██▏       | 80082/371472 [6:22:13<23:04:33,  3.51it/s]
 22%|██▏       | 80083/371472 [6:22:14<23:51:38,  3.39it/s]
 22%|██▏       | 80084/371472 [6:22:14<22:59:46,  3.52it/s]
 22%|██▏       | 80085/371472 [6:22:14<24:38:33,  3.28it/s]
 22%|██▏       | 80086/371472 [6:22:15<23:40:08,  3.42it/s]
 22%|██▏       | 80087/371472 [6:22:15<24:30:20,  3.30it/s]
 22%|██▏       | 80088/371472 [6:22:15<23:15:12,  3.48it/s]
 22%|██▏       | 80089/371472 [6:22:15<22:50:36,  3.54it/s]
 22%|██▏       | 80090/371472 [6:22:16<22:18:16,  3.63it/s]
 22%|██▏       | 80091/371472 [6:22:16<21:51:46,  3.70it/s]
 22%|██▏       | 80092/371472 [6:22:16<21:20:36,  3.79it/s]
 22%|██▏       | 80093/371472 [6:22:17<22:13:10,  3.64it/s]
 22%|██▏       | 80094/371472 [6:22:17<21:48:04,  3.71it/s]
 22%|██▏       | 80095/371472 [6:22:17<21:29:00,  3.77it/s]
 22%|██▏       | 80096/371472 [6:22:17<21:33:44,  3.75it/s]
 22%|██▏       | 80097/371472 [6:22:18<22:14:44,  3.64it/s]
 22%|██▏       | 80098/371472 [6:22:18<22:29:13,  3.60it/s]
 22%|██▏       | 80099/371472 [6:22:18<22:11:03,  3.65it/s]
 22%|██▏       | 80100/371472 [6:22:18<22:01:33,  3.67it/s]
                                                           
{'loss': 3.9515, 'learning_rate': 8.063145079618177e-07, 'epoch': 3.45}

 22%|██▏       | 80100/371472 [6:22:18<22:01:33,  3.67it/s]
 22%|██▏       | 80101/371472 [6:22:19<21:33:46,  3.75it/s]
 22%|██▏       | 80102/371472 [6:22:19<22:18:42,  3.63it/s]
 22%|██▏       | 80103/371472 [6:22:19<22:32:58,  3.59it/s]
 22%|██▏       | 80104/371472 [6:22:20<22:11:35,  3.65it/s]
 22%|██▏       | 80105/371472 [6:22:20<22:10:57,  3.65it/s]
 22%|██▏       | 80106/371472 [6:22:20<22:33:16,  3.59it/s]
 22%|██▏       | 80107/371472 [6:22:20<24:07:07,  3.36it/s]
 22%|██▏       | 80108/371472 [6:22:21<22:57:24,  3.53it/s]
 22%|██▏       | 80109/371472 [6:22:21<21:58:57,  3.68it/s]
 22%|██▏       | 80110/371472 [6:22:21<23:06:36,  3.50it/s]
 22%|██▏       | 80111/371472 [6:22:21<22:30:58,  3.59it/s]
 22%|██▏       | 80112/371472 [6:22:22<24:15:38,  3.34it/s]
 22%|██▏       | 80113/371472 [6:22:22<22:44:11,  3.56it/s]
 22%|██▏       | 80114/371472 [6:22:22<23:15:53,  3.48it/s]
 22%|██▏       | 80115/371472 [6:22:23<25:14:29,  3.21it/s]
 22%|██▏       | 80116/371472 [6:22:23<24:34:13,  3.29it/s]
 22%|██▏       | 80117/371472 [6:22:23<25:25:30,  3.18it/s]
 22%|██▏       | 80118/371472 [6:22:24<24:30:41,  3.30it/s]
 22%|██▏       | 80119/371472 [6:22:24<24:18:19,  3.33it/s]
 22%|██▏       | 80120/371472 [6:22:24<24:29:08,  3.31it/s]
                                                           
{'loss': 3.8628, 'learning_rate': 8.062660259863389e-07, 'epoch': 3.45}

 22%|██▏       | 80120/371472 [6:22:24<24:29:08,  3.31it/s]
 22%|██▏       | 80121/371472 [6:22:25<23:46:29,  3.40it/s]
 22%|██▏       | 80122/371472 [6:22:25<23:39:30,  3.42it/s]
 22%|██▏       | 80123/371472 [6:22:25<22:23:04,  3.62it/s]
 22%|██▏       | 80124/371472 [6:22:25<21:59:55,  3.68it/s]
 22%|██▏       | 80125/371472 [6:22:26<21:12:46,  3.82it/s]
 22%|██▏       | 80126/371472 [6:22:26<20:56:11,  3.87it/s]
 22%|██▏       | 80127/371472 [6:22:26<21:54:18,  3.69it/s]
 22%|██▏       | 80128/371472 [6:22:26<23:52:52,  3.39it/s]
 22%|██▏       | 80129/371472 [6:22:27<22:23:48,  3.61it/s]
 22%|██▏       | 80130/371472 [6:22:27<22:13:38,  3.64it/s]
 22%|██▏       | 80131/371472 [6:22:27<22:22:57,  3.62it/s]
 22%|██▏       | 80132/371472 [6:22:28<22:25:26,  3.61it/s]
 22%|██▏       | 80133/371472 [6:22:28<22:28:42,  3.60it/s]
 22%|██▏       | 80134/371472 [6:22:28<23:49:03,  3.40it/s]
 22%|██▏       | 80135/371472 [6:22:28<23:35:01,  3.43it/s]
 22%|██▏       | 80136/371472 [6:22:29<23:01:54,  3.51it/s]
 22%|██▏       | 80137/371472 [6:22:29<22:54:59,  3.53it/s]
 22%|██▏       | 80138/371472 [6:22:29<22:02:34,  3.67it/s]
 22%|██▏       | 80139/371472 [6:22:29<22:32:55,  3.59it/s]
 22%|██▏       | 80140/371472 [6:22:30<22:07:47,  3.66it/s]
                                                           
{'loss': 4.1605, 'learning_rate': 8.062175440108599e-07, 'epoch': 3.45}

 22%|██▏       | 80140/371472 [6:22:30<22:07:47,  3.66it/s]
 22%|██▏       | 80141/371472 [6:22:30<22:53:42,  3.53it/s]
 22%|██▏       | 80142/371472 [6:22:30<23:34:25,  3.43it/s]
 22%|██▏       | 80143/371472 [6:22:31<24:49:25,  3.26it/s]
 22%|██▏       | 80144/371472 [6:22:31<23:07:36,  3.50it/s]
 22%|██▏       | 80145/371472 [6:22:31<22:50:33,  3.54it/s]
 22%|██▏       | 80146/371472 [6:22:32<22:57:17,  3.53it/s]
 22%|██▏       | 80147/371472 [6:22:32<24:07:58,  3.35it/s]
 22%|██▏       | 80148/371472 [6:22:32<24:16:04,  3.33it/s]
 22%|██▏       | 80149/371472 [6:22:32<23:17:46,  3.47it/s]
 22%|██▏       | 80150/371472 [6:22:33<22:36:44,  3.58it/s]
 22%|██▏       | 80151/371472 [6:22:33<22:19:42,  3.62it/s]
 22%|██▏       | 80152/371472 [6:22:33<21:11:15,  3.82it/s]
 22%|██▏       | 80153/371472 [6:22:33<20:58:37,  3.86it/s]
 22%|██▏       | 80154/371472 [6:22:34<21:07:19,  3.83it/s]
 22%|██▏       | 80155/371472 [6:22:34<21:36:09,  3.75it/s]
 22%|██▏       | 80156/371472 [6:22:34<22:43:59,  3.56it/s]
 22%|██▏       | 80157/371472 [6:22:35<23:25:25,  3.45it/s]
 22%|██▏       | 80158/371472 [6:22:35<23:31:52,  3.44it/s]
 22%|██▏       | 80159/371472 [6:22:35<23:31:44,  3.44it/s]
 22%|██▏       | 80160/371472 [6:22:35<23:08:06,  3.50it/s]
                                                           
{'loss': 4.0109, 'learning_rate': 8.061690620353811e-07, 'epoch': 3.45}

 22%|██▏       | 80160/371472 [6:22:35<23:08:06,  3.50it/s]
 22%|██▏       | 80161/371472 [6:22:36<22:51:20,  3.54it/s]
 22%|██▏       | 80162/371472 [6:22:36<22:32:32,  3.59it/s]
 22%|██▏       | 80163/371472 [6:22:36<23:35:38,  3.43it/s]
 22%|██▏       | 80164/371472 [6:22:37<22:56:03,  3.53it/s]
 22%|██▏       | 80165/371472 [6:22:37<24:45:41,  3.27it/s]
 22%|██▏       | 80166/371472 [6:22:37<23:10:24,  3.49it/s]
 22%|██▏       | 80167/371472 [6:22:38<24:53:58,  3.25it/s]
 22%|██▏       | 80168/371472 [6:22:38<23:44:52,  3.41it/s]
 22%|██▏       | 80169/371472 [6:22:38<23:12:56,  3.49it/s]
 22%|██▏       | 80170/371472 [6:22:38<22:40:10,  3.57it/s]
 22%|██▏       | 80171/371472 [6:22:39<22:05:52,  3.66it/s]
 22%|██▏       | 80172/371472 [6:22:39<22:38:47,  3.57it/s]
 22%|██▏       | 80173/371472 [6:22:39<21:53:16,  3.70it/s]
 22%|██▏       | 80174/371472 [6:22:39<21:26:17,  3.77it/s]
 22%|██▏       | 80175/371472 [6:22:40<21:02:17,  3.85it/s]
 22%|██▏       | 80176/371472 [6:22:40<21:47:14,  3.71it/s]
 22%|██▏       | 80177/371472 [6:22:40<21:41:18,  3.73it/s]
 22%|██▏       | 80178/371472 [6:22:40<21:36:45,  3.74it/s]
 22%|██▏       | 80179/371472 [6:22:41<21:07:56,  3.83it/s]
 22%|██▏       | 80180/371472 [6:22:41<24:02:11,  3.37it/s]
                                                           
{'loss': 3.985, 'learning_rate': 8.061205800599021e-07, 'epoch': 3.45}

 22%|██▏       | 80180/371472 [6:22:41<24:02:11,  3.37it/s]
 22%|██▏       | 80181/371472 [6:22:41<22:57:06,  3.53it/s]
 22%|██▏       | 80182/371472 [6:22:42<22:24:19,  3.61it/s]
 22%|██▏       | 80183/371472 [6:22:42<21:52:35,  3.70it/s]
 22%|██▏       | 80184/371472 [6:22:42<22:58:15,  3.52it/s]
 22%|██▏       | 80185/371472 [6:22:42<22:04:18,  3.67it/s]
 22%|██▏       | 80186/371472 [6:22:43<23:37:47,  3.42it/s]
 22%|██▏       | 80187/371472 [6:22:43<23:18:50,  3.47it/s]
 22%|██▏       | 80188/371472 [6:22:43<24:44:12,  3.27it/s]
 22%|██▏       | 80189/371472 [6:22:44<23:18:50,  3.47it/s]
 22%|██▏       | 80190/371472 [6:22:44<22:13:26,  3.64it/s]
 22%|██▏       | 80191/371472 [6:22:44<22:32:42,  3.59it/s]
 22%|██▏       | 80192/371472 [6:22:44<22:33:15,  3.59it/s]
 22%|██▏       | 80193/371472 [6:22:45<22:24:51,  3.61it/s]
 22%|██▏       | 80194/371472 [6:22:45<23:11:08,  3.49it/s]
 22%|██▏       | 80195/371472 [6:22:45<23:39:45,  3.42it/s]
 22%|██▏       | 80196/371472 [6:22:46<22:38:46,  3.57it/s]
 22%|██▏       | 80197/371472 [6:22:46<24:34:46,  3.29it/s]
 22%|██▏       | 80198/371472 [6:22:46<25:41:42,  3.15it/s]
 22%|██▏       | 80199/371472 [6:22:47<24:51:02,  3.26it/s]
 22%|██▏       | 80200/371472 [6:22:47<23:56:45,  3.38it/s]
                                                           
{'loss': 4.147, 'learning_rate': 8.060720980844232e-07, 'epoch': 3.45}

 22%|██▏       | 80200/371472 [6:22:47<23:56:45,  3.38it/s]
 22%|██▏       | 80201/371472 [6:22:47<23:02:01,  3.51it/s]
 22%|██▏       | 80202/371472 [6:22:47<22:42:48,  3.56it/s]
 22%|██▏       | 80203/371472 [6:22:48<22:08:53,  3.65it/s]
 22%|██▏       | 80204/371472 [6:22:48<23:03:54,  3.51it/s]
 22%|██▏       | 80205/371472 [6:22:48<22:58:46,  3.52it/s]
 22%|██▏       | 80206/371472 [6:22:49<23:22:07,  3.46it/s]
 22%|██▏       | 80207/371472 [6:22:49<23:25:25,  3.45it/s]
 22%|██▏       | 80208/371472 [6:22:49<22:54:44,  3.53it/s]
 22%|██▏       | 80209/371472 [6:22:49<21:58:00,  3.68it/s]
 22%|██▏       | 80210/371472 [6:22:50<21:32:41,  3.76it/s]
 22%|██▏       | 80211/371472 [6:22:50<21:53:47,  3.69it/s]
 22%|██▏       | 80212/371472 [6:22:50<21:25:56,  3.77it/s]
 22%|██▏       | 80213/371472 [6:22:50<21:16:04,  3.80it/s]
 22%|██▏       | 80214/371472 [6:22:51<22:21:15,  3.62it/s]
 22%|██▏       | 80215/371472 [6:22:51<22:11:54,  3.64it/s]
 22%|██▏       | 80216/371472 [6:22:51<22:27:43,  3.60it/s]
 22%|██▏       | 80217/371472 [6:22:51<22:14:16,  3.64it/s]
 22%|██▏       | 80218/371472 [6:22:52<22:40:18,  3.57it/s]
 22%|██▏       | 80219/371472 [6:22:52<24:12:01,  3.34it/s]
 22%|██▏       | 80220/371472 [6:22:52<23:34:26,  3.43it/s]
                                                           
{'loss': 4.2112, 'learning_rate': 8.060236161089443e-07, 'epoch': 3.46}

 22%|██▏       | 80220/371472 [6:22:52<23:34:26,  3.43it/s]
 22%|██▏       | 80221/371472 [6:22:53<23:22:57,  3.46it/s]
 22%|██▏       | 80222/371472 [6:22:53<23:37:22,  3.42it/s]
 22%|██▏       | 80223/371472 [6:22:53<23:47:39,  3.40it/s]
 22%|██▏       | 80224/371472 [6:22:54<22:21:46,  3.62it/s]
 22%|██▏       | 80225/371472 [6:22:54<22:09:20,  3.65it/s]
 22%|██▏       | 80226/371472 [6:22:54<21:39:26,  3.74it/s]
 22%|██▏       | 80227/371472 [6:22:54<23:16:01,  3.48it/s]
 22%|██▏       | 80228/371472 [6:22:55<22:25:00,  3.61it/s]
 22%|██▏       | 80229/371472 [6:22:55<22:41:30,  3.57it/s]
 22%|██▏       | 80230/371472 [6:22:55<22:24:17,  3.61it/s]
 22%|██▏       | 80231/371472 [6:22:55<22:02:43,  3.67it/s]
 22%|██▏       | 80232/371472 [6:22:56<22:11:28,  3.65it/s]
 22%|██▏       | 80233/371472 [6:22:56<22:34:21,  3.58it/s]
 22%|██▏       | 80234/371472 [6:22:56<24:16:24,  3.33it/s]
 22%|██▏       | 80235/371472 [6:22:57<23:13:45,  3.48it/s]
 22%|██▏       | 80236/371472 [6:22:57<22:45:50,  3.55it/s]
 22%|██▏       | 80237/371472 [6:22:57<23:00:28,  3.52it/s]
 22%|██▏       | 80238/371472 [6:22:57<22:01:51,  3.67it/s]
 22%|██▏       | 80239/371472 [6:22:58<21:48:57,  3.71it/s]
 22%|██▏       | 80240/371472 [6:22:58<21:36:43,  3.74it/s]
                                                           
{'loss': 4.1059, 'learning_rate': 8.059751341334655e-07, 'epoch': 3.46}

 22%|██▏       | 80240/371472 [6:22:58<21:36:43,  3.74it/s]
 22%|██▏       | 80241/371472 [6:22:58<22:03:31,  3.67it/s]
 22%|██▏       | 80242/371472 [6:22:59<21:54:23,  3.69it/s]
 22%|██▏       | 80243/371472 [6:22:59<22:29:52,  3.60it/s]
 22%|██▏       | 80244/371472 [6:22:59<21:52:29,  3.70it/s]
 22%|██▏       | 80245/371472 [6:22:59<22:24:01,  3.61it/s]
 22%|██▏       | 80246/371472 [6:23:00<23:10:21,  3.49it/s]
 22%|██▏       | 80247/371472 [6:23:00<25:26:22,  3.18it/s]
 22%|██▏       | 80248/371472 [6:23:00<24:45:28,  3.27it/s]
 22%|██▏       | 80249/371472 [6:23:01<23:44:06,  3.41it/s]
 22%|██▏       | 80250/371472 [6:23:01<22:51:06,  3.54it/s]
 22%|██▏       | 80251/371472 [6:23:01<21:58:09,  3.68it/s]
 22%|██▏       | 80252/371472 [6:23:01<21:39:35,  3.73it/s]
 22%|██▏       | 80253/371472 [6:23:02<22:52:04,  3.54it/s]
 22%|██▏       | 80254/371472 [6:23:02<22:42:59,  3.56it/s]
 22%|██▏       | 80255/371472 [6:23:02<22:02:10,  3.67it/s]
 22%|██▏       | 80256/371472 [6:23:02<21:12:05,  3.82it/s]
 22%|██▏       | 80257/371472 [6:23:03<22:02:42,  3.67it/s]
 22%|██▏       | 80258/371472 [6:23:03<21:26:17,  3.77it/s]
 22%|██▏       | 80259/371472 [6:23:03<21:34:33,  3.75it/s]
 22%|██▏       | 80260/371472 [6:23:04<21:40:27,  3.73it/s]
                                                           
{'loss': 4.1683, 'learning_rate': 8.059266521579866e-07, 'epoch': 3.46}

 22%|██▏       | 80260/371472 [6:23:04<21:40:27,  3.73it/s]
 22%|██▏       | 80261/371472 [6:23:04<21:55:31,  3.69it/s]
 22%|██▏       | 80262/371472 [6:23:04<21:37:51,  3.74it/s]
 22%|██▏       | 80263/371472 [6:23:04<21:09:34,  3.82it/s]
 22%|██▏       | 80264/371472 [6:23:05<21:42:20,  3.73it/s]
 22%|██▏       | 80265/371472 [6:23:05<21:11:06,  3.82it/s]
 22%|██▏       | 80266/371472 [6:23:05<21:31:36,  3.76it/s]
 22%|██▏       | 80267/371472 [6:23:05<21:32:47,  3.75it/s]
 22%|██▏       | 80268/371472 [6:23:06<21:20:32,  3.79it/s]
 22%|██▏       | 80269/371472 [6:23:06<21:34:51,  3.75it/s]
 22%|██▏       | 80270/371472 [6:23:06<22:16:41,  3.63it/s]
 22%|██▏       | 80271/371472 [6:23:06<21:07:39,  3.83it/s]
 22%|██▏       | 80272/371472 [6:23:07<21:05:41,  3.83it/s]
 22%|██▏       | 80273/371472 [6:23:07<21:06:08,  3.83it/s]
 22%|██▏       | 80274/371472 [6:23:07<22:55:50,  3.53it/s]
 22%|██▏       | 80275/371472 [6:23:08<22:12:27,  3.64it/s]
 22%|██▏       | 80276/371472 [6:23:08<21:41:15,  3.73it/s]
 22%|██▏       | 80277/371472 [6:23:08<23:05:11,  3.50it/s]
 22%|██▏       | 80278/371472 [6:23:08<22:45:19,  3.55it/s]
 22%|██▏       | 80279/371472 [6:23:09<22:49:22,  3.54it/s]
 22%|██▏       | 80280/371472 [6:23:09<23:06:46,  3.50it/s]
                                                           
{'loss': 4.3456, 'learning_rate': 8.058781701825077e-07, 'epoch': 3.46}

 22%|██▏       | 80280/371472 [6:23:09<23:06:46,  3.50it/s]
 22%|██▏       | 80281/371472 [6:23:09<21:46:46,  3.71it/s]
 22%|██▏       | 80282/371472 [6:23:10<23:39:23,  3.42it/s]
 22%|██▏       | 80283/371472 [6:23:10<23:39:30,  3.42it/s]
 22%|██▏       | 80284/371472 [6:23:10<22:53:13,  3.53it/s]
 22%|██▏       | 80285/371472 [6:23:10<22:35:31,  3.58it/s]
 22%|██▏       | 80286/371472 [6:23:11<22:45:08,  3.56it/s]
 22%|██▏       | 80287/371472 [6:23:11<22:05:15,  3.66it/s]
 22%|██▏       | 80288/371472 [6:23:11<21:42:51,  3.72it/s]
 22%|██▏       | 80289/371472 [6:23:11<21:24:22,  3.78it/s]
 22%|██▏       | 80290/371472 [6:23:12<21:23:14,  3.78it/s]
 22%|██▏       | 80291/371472 [6:23:12<22:09:20,  3.65it/s]
 22%|██▏       | 80292/371472 [6:23:12<23:09:52,  3.49it/s]
 22%|██▏       | 80293/371472 [6:23:13<23:03:02,  3.51it/s]
 22%|██▏       | 80294/371472 [6:23:13<22:41:56,  3.56it/s]
 22%|██▏       | 80295/371472 [6:23:13<21:39:43,  3.73it/s]
 22%|██▏       | 80296/371472 [6:23:13<21:28:00,  3.77it/s]
 22%|██▏       | 80297/371472 [6:23:14<21:54:58,  3.69it/s]
 22%|██▏       | 80298/371472 [6:23:14<21:44:19,  3.72it/s]
 22%|██▏       | 80299/371472 [6:23:14<21:31:05,  3.76it/s]
 22%|██▏       | 80300/371472 [6:23:14<23:19:05,  3.47it/s]
                                                           
{'loss': 4.1346, 'learning_rate': 8.058296882070287e-07, 'epoch': 3.46}

 22%|██▏       | 80300/371472 [6:23:14<23:19:05,  3.47it/s]
 22%|██▏       | 80301/371472 [6:23:15<23:33:47,  3.43it/s]
 22%|██▏       | 80302/371472 [6:23:15<22:30:43,  3.59it/s]
 22%|██▏       | 80303/371472 [6:23:15<22:11:15,  3.65it/s]
 22%|██▏       | 80304/371472 [6:23:16<21:38:48,  3.74it/s]
 22%|██▏       | 80305/371472 [6:23:16<20:59:53,  3.85it/s]
 22%|██▏       | 80306/371472 [6:23:16<20:41:05,  3.91it/s]
 22%|██▏       | 80307/371472 [6:23:16<20:30:54,  3.94it/s]
 22%|██▏       | 80308/371472 [6:23:17<20:53:20,  3.87it/s]
 22%|██▏       | 80309/371472 [6:23:17<23:14:59,  3.48it/s]
 22%|██▏       | 80310/371472 [6:23:17<22:37:10,  3.58it/s]
 22%|██▏       | 80311/371472 [6:23:18<23:35:42,  3.43it/s]
 22%|██▏       | 80312/371472 [6:23:18<22:45:57,  3.55it/s]
 22%|██▏       | 80313/371472 [6:23:18<21:57:35,  3.68it/s]
 22%|██▏       | 80314/371472 [6:23:18<23:35:52,  3.43it/s]
 22%|██▏       | 80315/371472 [6:23:19<22:14:44,  3.64it/s]
 22%|██▏       | 80316/371472 [6:23:19<22:59:03,  3.52it/s]
 22%|██▏       | 80317/371472 [6:23:19<22:51:56,  3.54it/s]
 22%|██▏       | 80318/371472 [6:23:19<21:55:05,  3.69it/s]
 22%|██▏       | 80319/371472 [6:23:20<21:41:37,  3.73it/s]
 22%|██▏       | 80320/371472 [6:23:20<21:19:25,  3.79it/s]
                                                           
{'loss': 4.1153, 'learning_rate': 8.057812062315499e-07, 'epoch': 3.46}

 22%|██▏       | 80320/371472 [6:23:20<21:19:25,  3.79it/s]
 22%|██▏       | 80321/371472 [6:23:20<20:59:05,  3.85it/s]
 22%|██▏       | 80322/371472 [6:23:20<21:02:23,  3.84it/s]
 22%|██▏       | 80323/371472 [6:23:21<20:49:02,  3.88it/s]
 22%|██▏       | 80324/371472 [6:23:21<20:50:05,  3.88it/s]
 22%|██▏       | 80325/371472 [6:23:21<21:07:52,  3.83it/s]
 22%|██▏       | 80326/371472 [6:23:21<20:47:53,  3.89it/s]
 22%|██▏       | 80327/371472 [6:23:22<20:31:37,  3.94it/s]
 22%|██▏       | 80328/371472 [6:23:22<23:29:05,  3.44it/s]
 22%|██▏       | 80329/371472 [6:23:22<23:07:24,  3.50it/s]
 22%|██▏       | 80330/371472 [6:23:23<23:00:20,  3.52it/s]
 22%|██▏       | 80331/371472 [6:23:23<22:36:58,  3.58it/s]
 22%|██▏       | 80332/371472 [6:23:23<21:38:11,  3.74it/s]
 22%|██▏       | 80333/371472 [6:23:23<22:05:42,  3.66it/s]
 22%|██▏       | 80334/371472 [6:23:24<21:41:10,  3.73it/s]
 22%|██▏       | 80335/371472 [6:23:24<21:45:55,  3.72it/s]
 22%|██▏       | 80336/371472 [6:23:24<21:35:10,  3.75it/s]
 22%|██▏       | 80337/371472 [6:23:25<23:27:31,  3.45it/s]
 22%|██▏       | 80338/371472 [6:23:25<24:49:36,  3.26it/s]
 22%|██▏       | 80339/371472 [6:23:25<24:38:35,  3.28it/s]
 22%|██▏       | 80340/371472 [6:23:25<23:42:41,  3.41it/s]
                                                           
{'loss': 3.8168, 'learning_rate': 8.05732724256071e-07, 'epoch': 3.46}

 22%|██▏       | 80340/371472 [6:23:25<23:42:41,  3.41it/s]
 22%|██▏       | 80341/371472 [6:23:26<22:49:25,  3.54it/s]
 22%|██▏       | 80342/371472 [6:23:26<21:49:29,  3.71it/s]
 22%|██▏       | 80343/371472 [6:23:26<21:38:22,  3.74it/s]
 22%|██▏       | 80344/371472 [6:23:27<22:36:25,  3.58it/s]
 22%|██▏       | 80345/371472 [6:23:27<23:54:02,  3.38it/s]
 22%|██▏       | 80346/371472 [6:23:27<24:16:56,  3.33it/s]
 22%|██▏       | 80347/371472 [6:23:27<23:07:23,  3.50it/s]
 22%|██▏       | 80348/371472 [6:23:28<22:38:15,  3.57it/s]
 22%|██▏       | 80349/371472 [6:23:28<21:52:46,  3.70it/s]
 22%|██▏       | 80350/371472 [6:23:28<21:49:56,  3.70it/s]
 22%|██▏       | 80351/371472 [6:23:28<21:39:58,  3.73it/s]
 22%|██▏       | 80352/371472 [6:23:29<22:05:37,  3.66it/s]
 22%|██▏       | 80353/371472 [6:23:29<22:32:30,  3.59it/s]
 22%|██▏       | 80354/371472 [6:23:29<21:48:14,  3.71it/s]
 22%|██▏       | 80355/371472 [6:23:30<22:17:01,  3.63it/s]
 22%|██▏       | 80356/371472 [6:23:30<21:53:21,  3.69it/s]
 22%|██▏       | 80357/371472 [6:23:30<21:16:06,  3.80it/s]
 22%|██▏       | 80358/371472 [6:23:30<20:42:22,  3.91it/s]
 22%|██▏       | 80359/371472 [6:23:31<22:35:04,  3.58it/s]
 22%|██▏       | 80360/371472 [6:23:31<22:59:13,  3.52it/s]
                                                           
{'loss': 4.1554, 'learning_rate': 8.056842422805921e-07, 'epoch': 3.46}

 22%|██▏       | 80360/371472 [6:23:31<22:59:13,  3.52it/s]
 22%|██▏       | 80361/371472 [6:23:31<24:01:15,  3.37it/s]
 22%|██▏       | 80362/371472 [6:23:32<22:54:27,  3.53it/s]
 22%|██▏       | 80363/371472 [6:23:32<22:13:27,  3.64it/s]
 22%|██▏       | 80364/371472 [6:23:32<21:59:48,  3.68it/s]
 22%|██▏       | 80365/371472 [6:23:32<21:59:03,  3.68it/s]
 22%|██▏       | 80366/371472 [6:23:33<21:46:51,  3.71it/s]
 22%|██▏       | 80367/371472 [6:23:33<22:12:42,  3.64it/s]
 22%|██▏       | 80368/371472 [6:23:33<21:39:54,  3.73it/s]
 22%|██▏       | 80369/371472 [6:23:33<21:58:52,  3.68it/s]
 22%|██▏       | 80370/371472 [6:23:34<22:00:01,  3.68it/s]
 22%|██▏       | 80371/371472 [6:23:34<22:09:09,  3.65it/s]
 22%|██▏       | 80372/371472 [6:23:34<21:33:30,  3.75it/s]
 22%|██▏       | 80373/371472 [6:23:34<21:10:31,  3.82it/s]
 22%|██▏       | 80374/371472 [6:23:35<21:56:07,  3.69it/s]
 22%|██▏       | 80375/371472 [6:23:35<22:21:31,  3.62it/s]
 22%|██▏       | 80376/371472 [6:23:35<21:29:19,  3.76it/s]
 22%|██▏       | 80377/371472 [6:23:36<22:49:54,  3.54it/s]
 22%|██▏       | 80378/371472 [6:23:36<22:40:35,  3.57it/s]
 22%|██▏       | 80379/371472 [6:23:36<21:57:29,  3.68it/s]
 22%|██▏       | 80380/371472 [6:23:36<23:08:09,  3.49it/s]
                                                           
{'loss': 3.9205, 'learning_rate': 8.056357603051133e-07, 'epoch': 3.46}

 22%|██▏       | 80380/371472 [6:23:36<23:08:09,  3.49it/s]
 22%|██▏       | 80381/371472 [6:23:37<22:23:33,  3.61it/s]
 22%|██▏       | 80382/371472 [6:23:37<21:30:21,  3.76it/s]
 22%|██▏       | 80383/371472 [6:23:37<22:14:05,  3.64it/s]
 22%|██▏       | 80384/371472 [6:23:38<22:59:37,  3.52it/s]
 22%|██▏       | 80385/371472 [6:23:38<23:21:47,  3.46it/s]
 22%|██▏       | 80386/371472 [6:23:38<24:03:39,  3.36it/s]
 22%|██▏       | 80387/371472 [6:23:38<23:36:46,  3.42it/s]
 22%|██▏       | 80388/371472 [6:23:39<23:10:16,  3.49it/s]
 22%|██▏       | 80389/371472 [6:23:39<26:09:25,  3.09it/s]
 22%|██▏       | 80390/371472 [6:23:39<24:39:25,  3.28it/s]
 22%|██▏       | 80391/371472 [6:23:40<24:15:37,  3.33it/s]
 22%|██▏       | 80392/371472 [6:23:40<23:28:49,  3.44it/s]
 22%|██▏       | 80393/371472 [6:23:40<25:16:36,  3.20it/s]
 22%|██▏       | 80394/371472 [6:23:41<24:33:10,  3.29it/s]
 22%|██▏       | 80395/371472 [6:23:41<23:50:03,  3.39it/s]
 22%|██▏       | 80396/371472 [6:23:41<22:48:20,  3.55it/s]
 22%|██▏       | 80397/371472 [6:23:41<22:25:48,  3.60it/s]
 22%|██▏       | 80398/371472 [6:23:42<23:32:56,  3.43it/s]
 22%|██▏       | 80399/371472 [6:23:42<23:18:03,  3.47it/s]
 22%|██▏       | 80400/371472 [6:23:42<23:48:30,  3.40it/s]
                                                           
{'loss': 4.0034, 'learning_rate': 8.055872783296343e-07, 'epoch': 3.46}

 22%|██▏       | 80400/371472 [6:23:42<23:48:30,  3.40it/s]
 22%|██▏       | 80401/371472 [6:23:43<23:44:32,  3.41it/s]
 22%|██▏       | 80402/371472 [6:23:43<22:47:59,  3.55it/s]
 22%|██▏       | 80403/371472 [6:23:43<22:14:54,  3.63it/s]
 22%|██▏       | 80404/371472 [6:23:43<21:55:04,  3.69it/s]
 22%|██▏       | 80405/371472 [6:23:44<21:19:23,  3.79it/s]
 22%|██▏       | 80406/371472 [6:23:44<28:21:19,  2.85it/s]
 22%|██▏       | 80407/371472 [6:23:44<25:51:29,  3.13it/s]
 22%|██▏       | 80408/371472 [6:23:45<24:38:32,  3.28it/s]
 22%|██▏       | 80409/371472 [6:23:45<23:40:02,  3.42it/s]
 22%|██▏       | 80410/371472 [6:23:45<22:38:00,  3.57it/s]
 22%|██▏       | 80411/371472 [6:23:45<21:51:53,  3.70it/s]
 22%|██▏       | 80412/371472 [6:23:46<24:58:45,  3.24it/s]
 22%|██▏       | 80413/371472 [6:23:46<23:38:16,  3.42it/s]
 22%|██▏       | 80414/371472 [6:23:46<22:03:12,  3.67it/s]
 22%|██▏       | 80415/371472 [6:23:47<22:24:41,  3.61it/s]
 22%|██▏       | 80416/371472 [6:23:47<23:03:23,  3.51it/s]
 22%|██▏       | 80417/371472 [6:23:47<23:42:37,  3.41it/s]
 22%|██▏       | 80418/371472 [6:23:47<22:23:41,  3.61it/s]
 22%|██▏       | 80419/371472 [6:23:48<24:27:22,  3.31it/s]
 22%|██▏       | 80420/371472 [6:23:48<24:39:17,  3.28it/s]
                                                           
{'loss': 4.233, 'learning_rate': 8.055387963541554e-07, 'epoch': 3.46}

 22%|██▏       | 80420/371472 [6:23:48<24:39:17,  3.28it/s]
 22%|██▏       | 80421/371472 [6:23:48<24:01:38,  3.36it/s]
 22%|██▏       | 80422/371472 [6:23:49<23:11:24,  3.49it/s]
 22%|██▏       | 80423/371472 [6:23:49<23:06:14,  3.50it/s]
 22%|██▏       | 80424/371472 [6:23:49<22:42:27,  3.56it/s]
 22%|██▏       | 80425/371472 [6:23:50<22:09:11,  3.65it/s]
 22%|██▏       | 80426/371472 [6:23:50<22:25:21,  3.61it/s]
 22%|██▏       | 80427/371472 [6:23:50<22:31:01,  3.59it/s]
 22%|██▏       | 80428/371472 [6:23:50<24:13:44,  3.34it/s]
 22%|██▏       | 80429/371472 [6:23:51<22:47:25,  3.55it/s]
 22%|██▏       | 80430/371472 [6:23:51<22:38:53,  3.57it/s]
 22%|██▏       | 80431/371472 [6:23:51<23:22:41,  3.46it/s]
 22%|██▏       | 80432/371472 [6:23:52<25:12:53,  3.21it/s]
 22%|██▏       | 80433/371472 [6:23:52<24:18:28,  3.33it/s]
 22%|██▏       | 80434/371472 [6:23:52<23:43:28,  3.41it/s]
 22%|██▏       | 80435/371472 [6:23:52<24:20:48,  3.32it/s]
 22%|██▏       | 80436/371472 [6:23:53<24:14:15,  3.34it/s]
 22%|██▏       | 80437/371472 [6:23:53<23:46:48,  3.40it/s]
 22%|██▏       | 80438/371472 [6:23:53<22:22:31,  3.61it/s]
 22%|██▏       | 80439/371472 [6:23:54<22:01:11,  3.67it/s]
 22%|██▏       | 80440/371472 [6:23:54<23:10:44,  3.49it/s]
                                                           
{'loss': 4.2769, 'learning_rate': 8.054903143786765e-07, 'epoch': 3.46}

 22%|██▏       | 80440/371472 [6:23:54<23:10:44,  3.49it/s]
 22%|██▏       | 80441/371472 [6:23:54<22:36:45,  3.58it/s]
 22%|██▏       | 80442/371472 [6:23:54<22:20:05,  3.62it/s]
 22%|██▏       | 80443/371472 [6:23:55<21:33:14,  3.75it/s]
 22%|██▏       | 80444/371472 [6:23:55<21:23:33,  3.78it/s]
 22%|██▏       | 80445/371472 [6:23:55<20:50:22,  3.88it/s]
 22%|██▏       | 80446/371472 [6:23:55<20:54:02,  3.87it/s]
 22%|██▏       | 80447/371472 [6:23:56<21:09:39,  3.82it/s]
 22%|██▏       | 80448/371472 [6:23:56<21:36:11,  3.74it/s]
 22%|██▏       | 80449/371472 [6:23:56<22:22:43,  3.61it/s]
 22%|██▏       | 80450/371472 [6:23:57<22:22:31,  3.61it/s]
 22%|██▏       | 80451/371472 [6:23:57<25:24:15,  3.18it/s]
 22%|██▏       | 80452/371472 [6:23:57<24:32:17,  3.29it/s]
 22%|██▏       | 80453/371472 [6:23:57<22:54:27,  3.53it/s]
 22%|██▏       | 80454/371472 [6:23:58<22:24:31,  3.61it/s]
 22%|██▏       | 80455/371472 [6:23:58<22:01:07,  3.67it/s]
 22%|██▏       | 80456/371472 [6:23:58<23:25:34,  3.45it/s]
 22%|██▏       | 80457/371472 [6:23:59<23:06:21,  3.50it/s]
 22%|██▏       | 80458/371472 [6:23:59<22:48:43,  3.54it/s]
 22%|██▏       | 80459/371472 [6:23:59<22:23:52,  3.61it/s]
 22%|██▏       | 80460/371472 [6:23:59<22:07:14,  3.65it/s]
                                                           
{'loss': 3.8424, 'learning_rate': 8.054418324031976e-07, 'epoch': 3.47}

 22%|██▏       | 80460/371472 [6:23:59<22:07:14,  3.65it/s]
 22%|██▏       | 80461/371472 [6:24:00<23:49:13,  3.39it/s]
 22%|██▏       | 80462/371472 [6:24:00<22:35:45,  3.58it/s]
 22%|██▏       | 80463/371472 [6:24:00<22:00:39,  3.67it/s]
 22%|██▏       | 80464/371472 [6:24:01<22:26:48,  3.60it/s]
 22%|██▏       | 80465/371472 [6:24:01<22:13:50,  3.64it/s]
 22%|██▏       | 80466/371472 [6:24:01<22:57:56,  3.52it/s]
 22%|██▏       | 80467/371472 [6:24:01<22:48:09,  3.54it/s]
 22%|██▏       | 80468/371472 [6:24:02<22:33:15,  3.58it/s]
 22%|██▏       | 80469/371472 [6:24:02<21:44:29,  3.72it/s]
 22%|██▏       | 80470/371472 [6:24:02<22:13:42,  3.64it/s]
 22%|██▏       | 80471/371472 [6:24:02<21:46:39,  3.71it/s]
 22%|██▏       | 80472/371472 [6:24:03<23:19:29,  3.47it/s]
 22%|██▏       | 80473/371472 [6:24:03<23:40:14,  3.41it/s]
 22%|██▏       | 80474/371472 [6:24:03<25:26:57,  3.18it/s]
 22%|██▏       | 80475/371472 [6:24:04<24:19:42,  3.32it/s]
 22%|██▏       | 80476/371472 [6:24:04<23:31:31,  3.44it/s]
 22%|██▏       | 80477/371472 [6:24:04<23:11:22,  3.49it/s]
 22%|██▏       | 80478/371472 [6:24:05<23:04:26,  3.50it/s]
 22%|██▏       | 80479/371472 [6:24:05<22:53:31,  3.53it/s]
 22%|██▏       | 80480/371472 [6:24:05<22:43:12,  3.56it/s]
                                                           
{'loss': 3.8662, 'learning_rate': 8.053933504277187e-07, 'epoch': 3.47}

 22%|██▏       | 80480/371472 [6:24:05<22:43:12,  3.56it/s]
 22%|██▏       | 80481/371472 [6:24:05<22:32:46,  3.59it/s]
 22%|██▏       | 80482/371472 [6:24:06<22:47:32,  3.55it/s]
 22%|██▏       | 80483/371472 [6:24:06<22:46:56,  3.55it/s]
 22%|██▏       | 80484/371472 [6:24:06<24:27:36,  3.30it/s]
 22%|██▏       | 80485/371472 [6:24:07<23:15:37,  3.47it/s]
 22%|██▏       | 80486/371472 [6:24:07<23:00:41,  3.51it/s]
 22%|██▏       | 80487/371472 [6:24:07<23:59:37,  3.37it/s]
 22%|██▏       | 80488/371472 [6:24:07<23:40:21,  3.41it/s]
 22%|██▏       | 80489/371472 [6:24:08<23:35:37,  3.43it/s]
 22%|██▏       | 80490/371472 [6:24:08<23:51:22,  3.39it/s]
 22%|██▏       | 80491/371472 [6:24:08<22:55:11,  3.53it/s]
 22%|██▏       | 80492/371472 [6:24:09<22:34:16,  3.58it/s]
 22%|██▏       | 80493/371472 [6:24:09<24:10:41,  3.34it/s]
 22%|██▏       | 80494/371472 [6:24:09<25:03:48,  3.22it/s]
 22%|██▏       | 80495/371472 [6:24:09<23:25:17,  3.45it/s]
 22%|██▏       | 80496/371472 [6:24:10<23:22:23,  3.46it/s]
 22%|██▏       | 80497/371472 [6:24:10<24:09:29,  3.35it/s]
 22%|██▏       | 80498/371472 [6:24:10<25:32:33,  3.16it/s]
 22%|██▏       | 80499/371472 [6:24:11<25:34:11,  3.16it/s]
 22%|██▏       | 80500/371472 [6:24:11<24:51:14,  3.25it/s]
                                                           
{'loss': 3.9894, 'learning_rate': 8.053448684522399e-07, 'epoch': 3.47}

 22%|██▏       | 80500/371472 [6:24:11<24:51:14,  3.25it/s]
 22%|██▏       | 80501/371472 [6:24:11<27:25:18,  2.95it/s]
 22%|██▏       | 80502/371472 [6:24:12<26:05:01,  3.10it/s]
 22%|██▏       | 80503/371472 [6:24:12<24:20:09,  3.32it/s]
 22%|██▏       | 80504/371472 [6:24:12<23:44:11,  3.41it/s]
 22%|██▏       | 80505/371472 [6:24:13<22:52:09,  3.53it/s]
 22%|██▏       | 80506/371472 [6:24:13<23:54:16,  3.38it/s]
 22%|██▏       | 80507/371472 [6:24:13<24:03:53,  3.36it/s]
 22%|██▏       | 80508/371472 [6:24:13<24:13:13,  3.34it/s]
 22%|██▏       | 80509/371472 [6:24:14<23:55:52,  3.38it/s]
 22%|██▏       | 80510/371472 [6:24:14<23:27:51,  3.44it/s]
 22%|██▏       | 80511/371472 [6:24:14<22:42:42,  3.56it/s]
 22%|██▏       | 80512/371472 [6:24:15<22:49:01,  3.54it/s]
 22%|██▏       | 80513/371472 [6:24:15<22:21:44,  3.61it/s]
 22%|██▏       | 80514/371472 [6:24:15<23:07:09,  3.50it/s]
 22%|██▏       | 80515/371472 [6:24:15<21:58:39,  3.68it/s]
 22%|██▏       | 80516/371472 [6:24:16<21:03:19,  3.84it/s]
 22%|██▏       | 80517/371472 [6:24:16<21:05:53,  3.83it/s]
 22%|██▏       | 80518/371472 [6:24:16<21:07:21,  3.83it/s]
 22%|██▏       | 80519/371472 [6:24:16<21:26:15,  3.77it/s]
 22%|██▏       | 80520/371472 [6:24:17<22:15:30,  3.63it/s]
                                                           
{'loss': 4.0765, 'learning_rate': 8.05296386476761e-07, 'epoch': 3.47}

 22%|██▏       | 80520/371472 [6:24:17<22:15:30,  3.63it/s]
 22%|██▏       | 80521/371472 [6:24:17<23:15:02,  3.48it/s]
 22%|██▏       | 80522/371472 [6:24:17<23:20:26,  3.46it/s]
 22%|██▏       | 80523/371472 [6:24:18<23:22:24,  3.46it/s]
 22%|██▏       | 80524/371472 [6:24:18<22:44:52,  3.55it/s]
 22%|██▏       | 80525/371472 [6:24:18<22:49:32,  3.54it/s]
 22%|██▏       | 80526/371472 [6:24:18<23:47:02,  3.40it/s]
 22%|██▏       | 80527/371472 [6:24:19<23:47:38,  3.40it/s]
 22%|██▏       | 80528/371472 [6:24:19<23:35:34,  3.43it/s]
 22%|██▏       | 80529/371472 [6:24:19<23:05:13,  3.50it/s]
 22%|██▏       | 80530/371472 [6:24:20<23:16:14,  3.47it/s]
 22%|██▏       | 80531/371472 [6:24:20<23:27:02,  3.45it/s]
 22%|██▏       | 80532/371472 [6:24:20<23:47:52,  3.40it/s]
 22%|██▏       | 80533/371472 [6:24:20<22:52:47,  3.53it/s]
 22%|██▏       | 80534/371472 [6:24:21<21:52:32,  3.69it/s]
 22%|██▏       | 80535/371472 [6:24:21<21:49:07,  3.70it/s]
 22%|██▏       | 80536/371472 [6:24:21<21:33:32,  3.75it/s]
 22%|██▏       | 80537/371472 [6:24:22<21:00:13,  3.85it/s]
 22%|██▏       | 80538/371472 [6:24:22<21:31:42,  3.75it/s]
 22%|██▏       | 80539/371472 [6:24:22<21:30:13,  3.76it/s]
 22%|██▏       | 80540/371472 [6:24:22<21:15:52,  3.80it/s]
                                                           
{'loss': 4.0221, 'learning_rate': 8.052479045012821e-07, 'epoch': 3.47}

 22%|██▏       | 80540/371472 [6:24:22<21:15:52,  3.80it/s]
 22%|██▏       | 80541/371472 [6:24:23<20:58:52,  3.85it/s]
 22%|██▏       | 80542/371472 [6:24:23<20:58:49,  3.85it/s]
 22%|██▏       | 80543/371472 [6:24:23<21:21:21,  3.78it/s]
 22%|██▏       | 80544/371472 [6:24:23<21:27:47,  3.77it/s]
 22%|██▏       | 80545/371472 [6:24:24<21:18:27,  3.79it/s]
 22%|██▏       | 80546/371472 [6:24:24<21:29:38,  3.76it/s]
 22%|██▏       | 80547/371472 [6:24:24<22:46:17,  3.55it/s]
 22%|██▏       | 80548/371472 [6:24:24<22:37:53,  3.57it/s]
 22%|██▏       | 80549/371472 [6:24:25<22:40:09,  3.56it/s]
 22%|██▏       | 80550/371472 [6:24:25<22:17:20,  3.63it/s]
 22%|██▏       | 80551/371472 [6:24:25<25:17:35,  3.20it/s]
 22%|██▏       | 80552/371472 [6:24:26<25:58:41,  3.11it/s]
 22%|██▏       | 80553/371472 [6:24:26<24:57:49,  3.24it/s]
 22%|██▏       | 80554/371472 [6:24:26<24:03:08,  3.36it/s]
 22%|██▏       | 80555/371472 [6:24:27<24:07:33,  3.35it/s]
 22%|██▏       | 80556/371472 [6:24:27<22:50:31,  3.54it/s]
 22%|██▏       | 80557/371472 [6:24:27<21:53:25,  3.69it/s]
 22%|██▏       | 80558/371472 [6:24:27<21:54:01,  3.69it/s]
 22%|██▏       | 80559/371472 [6:24:28<21:39:45,  3.73it/s]
 22%|██▏       | 80560/371472 [6:24:28<21:17:06,  3.80it/s]
                                                           
{'loss': 4.044, 'learning_rate': 8.051994225258031e-07, 'epoch': 3.47}

 22%|██▏       | 80560/371472 [6:24:28<21:17:06,  3.80it/s]
 22%|██▏       | 80561/371472 [6:24:28<21:43:02,  3.72it/s]
 22%|██▏       | 80562/371472 [6:24:28<22:37:53,  3.57it/s]
 22%|██▏       | 80563/371472 [6:24:29<24:47:44,  3.26it/s]
 22%|██▏       | 80564/371472 [6:24:29<23:41:48,  3.41it/s]
 22%|██▏       | 80565/371472 [6:24:30<26:13:54,  3.08it/s]
 22%|██▏       | 80566/371472 [6:24:30<24:28:49,  3.30it/s]
 22%|██▏       | 80567/371472 [6:24:30<24:19:33,  3.32it/s]
 22%|██▏       | 80568/371472 [6:24:30<22:57:21,  3.52it/s]
 22%|██▏       | 80569/371472 [6:24:31<23:32:30,  3.43it/s]
 22%|██▏       | 80570/371472 [6:24:31<23:43:22,  3.41it/s]
 22%|██▏       | 80571/371472 [6:24:31<23:42:38,  3.41it/s]
 22%|██▏       | 80572/371472 [6:24:32<24:23:06,  3.31it/s]
 22%|██▏       | 80573/371472 [6:24:32<23:01:09,  3.51it/s]
 22%|██▏       | 80574/371472 [6:24:32<22:23:49,  3.61it/s]
 22%|██▏       | 80575/371472 [6:24:32<22:24:30,  3.61it/s]
 22%|██▏       | 80576/371472 [6:24:33<21:57:22,  3.68it/s]
 22%|██▏       | 80577/371472 [6:24:33<22:46:17,  3.55it/s]
 22%|██▏       | 80578/371472 [6:24:33<21:50:59,  3.70it/s]
 22%|██▏       | 80579/371472 [6:24:33<23:46:44,  3.40it/s]
 22%|██▏       | 80580/371472 [6:24:34<22:44:04,  3.55it/s]
                                                           
{'loss': 4.0196, 'learning_rate': 8.051509405503242e-07, 'epoch': 3.47}

 22%|██▏       | 80580/371472 [6:24:34<22:44:04,  3.55it/s]
 22%|██▏       | 80581/371472 [6:24:34<22:09:15,  3.65it/s]
 22%|██▏       | 80582/371472 [6:24:34<24:01:25,  3.36it/s]
 22%|██▏       | 80583/371472 [6:24:35<22:58:56,  3.52it/s]
 22%|██▏       | 80584/371472 [6:24:35<23:30:42,  3.44it/s]
 22%|██▏       | 80585/371472 [6:24:35<23:18:10,  3.47it/s]
 22%|██▏       | 80586/371472 [6:24:35<23:28:36,  3.44it/s]
 22%|██▏       | 80587/371472 [6:24:36<22:45:50,  3.55it/s]
 22%|██▏       | 80588/371472 [6:24:36<21:42:49,  3.72it/s]
 22%|██▏       | 80589/371472 [6:24:36<21:15:39,  3.80it/s]
 22%|██▏       | 80590/371472 [6:24:37<23:57:47,  3.37it/s]
 22%|██▏       | 80591/371472 [6:24:37<23:04:05,  3.50it/s]
 22%|██▏       | 80592/371472 [6:24:37<23:02:29,  3.51it/s]
 22%|██▏       | 80593/371472 [6:24:37<22:53:07,  3.53it/s]
 22%|██▏       | 80594/371472 [6:24:38<22:15:02,  3.63it/s]
 22%|██▏       | 80595/371472 [6:24:38<23:51:38,  3.39it/s]
 22%|██▏       | 80596/371472 [6:24:38<23:11:47,  3.48it/s]
 22%|██▏       | 80597/371472 [6:24:39<24:03:04,  3.36it/s]
 22%|██▏       | 80598/371472 [6:24:39<23:04:53,  3.50it/s]
 22%|██▏       | 80599/371472 [6:24:39<24:13:50,  3.33it/s]
 22%|██▏       | 80600/371472 [6:24:40<26:05:05,  3.10it/s]
                                                           
{'loss': 4.1307, 'learning_rate': 8.051024585748454e-07, 'epoch': 3.47}

 22%|██▏       | 80600/371472 [6:24:40<26:05:05,  3.10it/s]
 22%|██▏       | 80601/371472 [6:24:40<24:59:26,  3.23it/s]
 22%|██▏       | 80602/371472 [6:24:40<23:52:39,  3.38it/s]
 22%|██▏       | 80603/371472 [6:24:40<23:23:13,  3.45it/s]
 22%|██▏       | 80604/371472 [6:24:41<23:13:19,  3.48it/s]
 22%|██▏       | 80605/371472 [6:24:41<22:45:59,  3.55it/s]
 22%|██▏       | 80606/371472 [6:24:41<23:05:08,  3.50it/s]
 22%|██▏       | 80607/371472 [6:24:41<22:25:26,  3.60it/s]
 22%|██▏       | 80608/371472 [6:24:42<22:43:33,  3.56it/s]
 22%|██▏       | 80609/371472 [6:24:42<22:10:50,  3.64it/s]
 22%|██▏       | 80610/371472 [6:24:42<21:30:57,  3.76it/s]
 22%|██▏       | 80611/371472 [6:24:43<21:09:07,  3.82it/s]
 22%|██▏       | 80612/371472 [6:24:43<21:49:44,  3.70it/s]
 22%|██▏       | 80613/371472 [6:24:43<21:52:52,  3.69it/s]
 22%|██▏       | 80614/371472 [6:24:43<21:31:51,  3.75it/s]
 22%|██▏       | 80615/371472 [6:24:44<21:56:15,  3.68it/s]
 22%|██▏       | 80616/371472 [6:24:44<22:03:39,  3.66it/s]
 22%|██▏       | 80617/371472 [6:24:44<21:45:17,  3.71it/s]
 22%|██▏       | 80618/371472 [6:24:45<23:14:11,  3.48it/s]
 22%|██▏       | 80619/371472 [6:24:45<22:28:57,  3.59it/s]
 22%|██▏       | 80620/371472 [6:24:45<22:05:30,  3.66it/s]
                                                           
{'loss': 3.9635, 'learning_rate': 8.050539765993665e-07, 'epoch': 3.47}

 22%|██▏       | 80620/371472 [6:24:45<22:05:30,  3.66it/s]
 22%|██▏       | 80621/371472 [6:24:45<21:40:58,  3.73it/s]
 22%|██▏       | 80622/371472 [6:24:46<22:00:35,  3.67it/s]
 22%|██▏       | 80623/371472 [6:24:46<21:31:26,  3.75it/s]
 22%|██▏       | 80624/371472 [6:24:46<22:52:39,  3.53it/s]
 22%|██▏       | 80625/371472 [6:24:46<22:48:15,  3.54it/s]
 22%|██▏       | 80626/371472 [6:24:47<23:17:40,  3.47it/s]
 22%|██▏       | 80627/371472 [6:24:47<23:03:54,  3.50it/s]
 22%|██▏       | 80628/371472 [6:24:47<22:03:17,  3.66it/s]
 22%|██▏       | 80629/371472 [6:24:47<21:18:23,  3.79it/s]
 22%|██▏       | 80630/371472 [6:24:48<21:11:00,  3.81it/s]
 22%|██▏       | 80631/371472 [6:24:48<21:44:54,  3.71it/s]
 22%|██▏       | 80632/371472 [6:24:48<21:52:34,  3.69it/s]
 22%|██▏       | 80633/371472 [6:24:49<21:21:12,  3.78it/s]
 22%|██▏       | 80634/371472 [6:24:49<22:52:00,  3.53it/s]
 22%|██▏       | 80635/371472 [6:24:49<22:31:35,  3.59it/s]
 22%|██▏       | 80636/371472 [6:24:49<23:23:43,  3.45it/s]
 22%|██▏       | 80637/371472 [6:24:50<22:37:13,  3.57it/s]
 22%|██▏       | 80638/371472 [6:24:50<23:26:54,  3.45it/s]
 22%|██▏       | 80639/371472 [6:24:50<23:13:19,  3.48it/s]
 22%|██▏       | 80640/371472 [6:24:51<22:23:12,  3.61it/s]
                                                           
{'loss': 4.1048, 'learning_rate': 8.050054946238876e-07, 'epoch': 3.47}

 22%|██▏       | 80640/371472 [6:24:51<22:23:12,  3.61it/s]
 22%|██▏       | 80641/371472 [6:24:51<25:41:52,  3.14it/s]
 22%|██▏       | 80642/371472 [6:24:51<24:42:53,  3.27it/s]
 22%|██▏       | 80643/371472 [6:24:52<24:34:30,  3.29it/s]
 22%|██▏       | 80644/371472 [6:24:52<24:46:54,  3.26it/s]
 22%|██▏       | 80645/371472 [6:24:52<23:19:29,  3.46it/s]
 22%|██▏       | 80646/371472 [6:24:52<22:18:17,  3.62it/s]
 22%|██▏       | 80647/371472 [6:24:53<22:11:22,  3.64it/s]
 22%|██▏       | 80648/371472 [6:24:53<22:27:53,  3.60it/s]
 22%|██▏       | 80649/371472 [6:24:53<23:33:20,  3.43it/s]
 22%|██▏       | 80650/371472 [6:24:54<22:38:44,  3.57it/s]
 22%|██▏       | 80651/371472 [6:24:54<23:52:14,  3.38it/s]
 22%|██▏       | 80652/371472 [6:24:54<25:46:55,  3.13it/s]
 22%|██▏       | 80653/371472 [6:24:55<25:21:17,  3.19it/s]
 22%|██▏       | 80654/371472 [6:24:55<24:25:03,  3.31it/s]
 22%|██▏       | 80655/371472 [6:24:55<25:22:47,  3.18it/s]
 22%|██▏       | 80656/371472 [6:24:55<24:37:04,  3.28it/s]
 22%|██▏       | 80657/371472 [6:24:56<24:29:25,  3.30it/s]
 22%|██▏       | 80658/371472 [6:24:56<24:02:10,  3.36it/s]
 22%|██▏       | 80659/371472 [6:24:56<24:25:02,  3.31it/s]
 22%|██▏       | 80660/371472 [6:24:57<23:44:30,  3.40it/s]
                                                           
{'loss': 3.9423, 'learning_rate': 8.049570126484087e-07, 'epoch': 3.47}

 22%|██▏       | 80660/371472 [6:24:57<23:44:30,  3.40it/s]
 22%|██▏       | 80661/371472 [6:24:57<24:04:44,  3.35it/s]
 22%|██▏       | 80662/371472 [6:24:57<23:13:14,  3.48it/s]
 22%|██▏       | 80663/371472 [6:24:57<23:01:50,  3.51it/s]
 22%|██▏       | 80664/371472 [6:24:58<23:40:51,  3.41it/s]
 22%|██▏       | 80665/371472 [6:24:58<22:43:32,  3.55it/s]
 22%|██▏       | 80666/371472 [6:24:58<23:30:33,  3.44it/s]
 22%|██▏       | 80667/371472 [6:24:59<23:33:36,  3.43it/s]
 22%|██▏       | 80668/371472 [6:24:59<22:46:25,  3.55it/s]
 22%|██▏       | 80669/371472 [6:24:59<22:53:13,  3.53it/s]
 22%|██▏       | 80670/371472 [6:24:59<22:35:44,  3.57it/s]
 22%|██▏       | 80671/371472 [6:25:00<21:56:35,  3.68it/s]
 22%|██▏       | 80672/371472 [6:25:00<22:15:25,  3.63it/s]
 22%|██▏       | 80673/371472 [6:25:00<21:31:43,  3.75it/s]
 22%|██▏       | 80674/371472 [6:25:00<21:48:56,  3.70it/s]
 22%|██▏       | 80675/371472 [6:25:01<22:40:37,  3.56it/s]
 22%|██▏       | 80676/371472 [6:25:01<22:55:27,  3.52it/s]
 22%|██▏       | 80677/371472 [6:25:01<22:26:46,  3.60it/s]
 22%|██▏       | 80678/371472 [6:25:02<22:28:24,  3.59it/s]
 22%|██▏       | 80679/371472 [6:25:02<22:08:03,  3.65it/s]
 22%|██▏       | 80680/371472 [6:25:02<21:32:00,  3.75it/s]
                                                           
{'loss': 3.9662, 'learning_rate': 8.049085306729297e-07, 'epoch': 3.48}

 22%|██▏       | 80680/371472 [6:25:02<21:32:00,  3.75it/s]
 22%|██▏       | 80681/371472 [6:25:02<21:39:30,  3.73it/s]
 22%|██▏       | 80682/371472 [6:25:03<21:38:32,  3.73it/s]
 22%|██▏       | 80683/371472 [6:25:03<22:47:03,  3.55it/s]
 22%|██▏       | 80684/371472 [6:25:03<21:59:05,  3.67it/s]
 22%|██▏       | 80685/371472 [6:25:03<21:36:06,  3.74it/s]
 22%|██▏       | 80686/371472 [6:25:04<21:56:37,  3.68it/s]
 22%|██▏       | 80687/371472 [6:25:04<23:34:26,  3.43it/s]
 22%|██▏       | 80688/371472 [6:25:04<23:12:51,  3.48it/s]
 22%|██▏       | 80689/371472 [6:25:05<22:30:48,  3.59it/s]
 22%|██▏       | 80690/371472 [6:25:05<22:08:05,  3.65it/s]
 22%|██▏       | 80691/371472 [6:25:05<21:46:40,  3.71it/s]
 22%|██▏       | 80692/371472 [6:25:06<23:04:48,  3.50it/s]
 22%|██▏       | 80693/371472 [6:25:06<22:35:02,  3.58it/s]
 22%|██▏       | 80694/371472 [6:25:06<22:24:31,  3.60it/s]
 22%|██▏       | 80695/371472 [6:25:06<22:10:40,  3.64it/s]
 22%|██▏       | 80696/371472 [6:25:07<21:53:17,  3.69it/s]
 22%|██▏       | 80697/371472 [6:25:07<22:30:49,  3.59it/s]
 22%|██▏       | 80698/371472 [6:25:07<22:06:07,  3.65it/s]
 22%|██▏       | 80699/371472 [6:25:07<22:35:18,  3.58it/s]
 22%|██▏       | 80700/371472 [6:25:08<23:16:46,  3.47it/s]
                                                           
{'loss': 4.0199, 'learning_rate': 8.048600486974509e-07, 'epoch': 3.48}

 22%|██▏       | 80700/371472 [6:25:08<23:16:46,  3.47it/s]
 22%|██▏       | 80701/371472 [6:25:08<23:23:07,  3.45it/s]
 22%|██▏       | 80702/371472 [6:25:08<23:11:50,  3.48it/s]
 22%|██▏       | 80703/371472 [6:25:09<22:45:19,  3.55it/s]
 22%|██▏       | 80704/371472 [6:25:09<22:32:28,  3.58it/s]
 22%|██▏       | 80705/371472 [6:25:09<21:37:07,  3.74it/s]
 22%|██▏       | 80706/371472 [6:25:09<21:01:24,  3.84it/s]
 22%|██▏       | 80707/371472 [6:25:10<21:35:45,  3.74it/s]
 22%|██▏       | 80708/371472 [6:25:10<22:29:36,  3.59it/s]
 22%|██▏       | 80709/371472 [6:25:10<24:25:02,  3.31it/s]
 22%|██▏       | 80710/371472 [6:25:11<24:58:52,  3.23it/s]
 22%|██▏       | 80711/371472 [6:25:11<23:43:18,  3.40it/s]
 22%|██▏       | 80712/371472 [6:25:11<25:04:32,  3.22it/s]
 22%|██▏       | 80713/371472 [6:25:12<24:56:56,  3.24it/s]
 22%|██▏       | 80714/371472 [6:25:12<24:02:11,  3.36it/s]
 22%|██▏       | 80715/371472 [6:25:12<22:47:24,  3.54it/s]
 22%|██▏       | 80716/371472 [6:25:12<24:01:40,  3.36it/s]
 22%|██▏       | 80717/371472 [6:25:13<24:30:26,  3.30it/s]
 22%|██▏       | 80718/371472 [6:25:13<23:26:43,  3.44it/s]
 22%|██▏       | 80719/371472 [6:25:13<22:25:02,  3.60it/s]
 22%|██▏       | 80720/371472 [6:25:13<22:05:59,  3.65it/s]
                                                           
{'loss': 4.1143, 'learning_rate': 8.04811566721972e-07, 'epoch': 3.48}

 22%|██▏       | 80720/371472 [6:25:13<22:05:59,  3.65it/s]
 22%|██▏       | 80721/371472 [6:25:14<23:40:40,  3.41it/s]
 22%|██▏       | 80722/371472 [6:25:14<22:54:28,  3.53it/s]
 22%|██▏       | 80723/371472 [6:25:14<22:14:51,  3.63it/s]
 22%|██▏       | 80724/371472 [6:25:15<21:42:07,  3.72it/s]
 22%|██▏       | 80725/371472 [6:25:15<21:59:49,  3.67it/s]
 22%|██▏       | 80726/371472 [6:25:15<23:06:31,  3.49it/s]
 22%|██▏       | 80727/371472 [6:25:15<23:31:41,  3.43it/s]
 22%|██▏       | 80728/371472 [6:25:16<23:06:02,  3.50it/s]
 22%|██▏       | 80729/371472 [6:25:16<24:02:16,  3.36it/s]
 22%|██▏       | 80730/371472 [6:25:16<26:45:48,  3.02it/s]
 22%|██▏       | 80731/371472 [6:25:17<25:20:18,  3.19it/s]
 22%|██▏       | 80732/371472 [6:25:17<26:01:41,  3.10it/s]
 22%|██▏       | 80733/371472 [6:25:17<24:20:43,  3.32it/s]
 22%|██▏       | 80734/371472 [6:25:18<23:52:31,  3.38it/s]
 22%|██▏       | 80735/371472 [6:25:18<23:48:59,  3.39it/s]
 22%|██▏       | 80736/371472 [6:25:18<24:09:46,  3.34it/s]
 22%|██▏       | 80737/371472 [6:25:19<23:39:50,  3.41it/s]
 22%|██▏       | 80738/371472 [6:25:19<23:20:39,  3.46it/s]
 22%|██▏       | 80739/371472 [6:25:19<23:38:47,  3.42it/s]
 22%|██▏       | 80740/371472 [6:25:19<24:31:34,  3.29it/s]
                                                           
{'loss': 4.2284, 'learning_rate': 8.047630847464931e-07, 'epoch': 3.48}

 22%|██▏       | 80740/371472 [6:25:19<24:31:34,  3.29it/s]
 22%|██▏       | 80741/371472 [6:25:20<23:33:24,  3.43it/s]
 22%|██▏       | 80742/371472 [6:25:20<23:17:20,  3.47it/s]
 22%|██▏       | 80743/371472 [6:25:20<24:14:05,  3.33it/s]
 22%|██▏       | 80744/371472 [6:25:21<23:16:09,  3.47it/s]
 22%|██▏       | 80745/371472 [6:25:21<23:17:13,  3.47it/s]
 22%|██▏       | 80746/371472 [6:25:21<25:09:47,  3.21it/s]
 22%|██▏       | 80747/371472 [6:25:21<23:50:18,  3.39it/s]
 22%|██▏       | 80748/371472 [6:25:22<22:29:25,  3.59it/s]
 22%|██▏       | 80749/371472 [6:25:22<22:55:31,  3.52it/s]
 22%|██▏       | 80750/371472 [6:25:22<24:35:35,  3.28it/s]
 22%|██▏       | 80751/371472 [6:25:23<23:55:16,  3.38it/s]
 22%|██▏       | 80752/371472 [6:25:23<22:57:11,  3.52it/s]
 22%|██▏       | 80753/371472 [6:25:23<22:51:31,  3.53it/s]
 22%|██▏       | 80754/371472 [6:25:23<22:08:14,  3.65it/s]
 22%|██▏       | 80755/371472 [6:25:24<21:16:12,  3.80it/s]
 22%|██▏       | 80756/371472 [6:25:24<21:16:16,  3.80it/s]
 22%|██▏       | 80757/371472 [6:25:24<21:26:01,  3.77it/s]
 22%|██▏       | 80758/371472 [6:25:24<21:46:25,  3.71it/s]
 22%|██▏       | 80759/371472 [6:25:25<21:24:19,  3.77it/s]
 22%|██▏       | 80760/371472 [6:25:25<21:22:07,  3.78it/s]
                                                           
{'loss': 4.204, 'learning_rate': 8.047146027710142e-07, 'epoch': 3.48}

 22%|██▏       | 80760/371472 [6:25:25<21:22:07,  3.78it/s]
 22%|██▏       | 80761/371472 [6:25:25<23:44:28,  3.40it/s]
 22%|██▏       | 80762/371472 [6:25:26<24:53:55,  3.24it/s]
 22%|██▏       | 80763/371472 [6:25:26<23:22:22,  3.45it/s]
 22%|██▏       | 80764/371472 [6:25:26<22:18:58,  3.62it/s]
 22%|██▏       | 80765/371472 [6:25:26<21:50:43,  3.70it/s]
 22%|██▏       | 80766/371472 [6:25:27<22:39:08,  3.56it/s]
 22%|██▏       | 80767/371472 [6:25:27<23:00:51,  3.51it/s]
 22%|██▏       | 80768/371472 [6:25:27<22:48:01,  3.54it/s]
 22%|██▏       | 80769/371472 [6:25:28<24:37:52,  3.28it/s]
 22%|██▏       | 80770/371472 [6:25:28<23:10:08,  3.49it/s]
 22%|██▏       | 80771/371472 [6:25:28<22:25:35,  3.60it/s]
 22%|██▏       | 80772/371472 [6:25:29<23:46:31,  3.40it/s]
 22%|██▏       | 80773/371472 [6:25:29<22:59:23,  3.51it/s]
 22%|██▏       | 80774/371472 [6:25:29<24:09:13,  3.34it/s]
 22%|██▏       | 80775/371472 [6:25:29<24:02:59,  3.36it/s]
 22%|██▏       | 80776/371472 [6:25:30<25:04:21,  3.22it/s]
 22%|██▏       | 80777/371472 [6:25:30<23:51:49,  3.38it/s]
 22%|██▏       | 80778/371472 [6:25:30<24:28:16,  3.30it/s]
 22%|██▏       | 80779/371472 [6:25:31<23:47:48,  3.39it/s]
 22%|██▏       | 80780/371472 [6:25:31<24:50:45,  3.25it/s]
                                                           
{'loss': 3.8848, 'learning_rate': 8.046661207955354e-07, 'epoch': 3.48}

 22%|██▏       | 80780/371472 [6:25:31<24:50:45,  3.25it/s]
 22%|██▏       | 80781/371472 [6:25:31<24:17:21,  3.32it/s]
 22%|██▏       | 80782/371472 [6:25:31<23:51:18,  3.38it/s]
 22%|██▏       | 80783/371472 [6:25:32<22:37:56,  3.57it/s]
 22%|██▏       | 80784/371472 [6:25:32<22:06:14,  3.65it/s]
 22%|██▏       | 80785/371472 [6:25:32<23:27:19,  3.44it/s]
 22%|██▏       | 80786/371472 [6:25:33<22:28:52,  3.59it/s]
 22%|██▏       | 80787/371472 [6:25:33<23:32:08,  3.43it/s]
 22%|██▏       | 80788/371472 [6:25:33<22:43:26,  3.55it/s]
 22%|██▏       | 80789/371472 [6:25:33<22:04:12,  3.66it/s]
 22%|██▏       | 80790/371472 [6:25:34<21:45:17,  3.71it/s]
 22%|██▏       | 80791/371472 [6:25:34<23:33:55,  3.43it/s]
 22%|██▏       | 80792/371472 [6:25:34<22:47:15,  3.54it/s]
 22%|██▏       | 80793/371472 [6:25:35<21:57:05,  3.68it/s]
 22%|██▏       | 80794/371472 [6:25:35<22:09:24,  3.64it/s]
 22%|██▏       | 80795/371472 [6:25:35<22:25:59,  3.60it/s]
 22%|██▏       | 80796/371472 [6:25:35<22:08:20,  3.65it/s]
 22%|██▏       | 80797/371472 [6:25:36<23:33:12,  3.43it/s]
 22%|██▏       | 80798/371472 [6:25:36<23:14:14,  3.47it/s]
 22%|██▏       | 80799/371472 [6:25:36<24:04:14,  3.35it/s]
 22%|██▏       | 80800/371472 [6:25:37<23:29:39,  3.44it/s]
                                                           
{'loss': 4.0762, 'learning_rate': 8.046176388200563e-07, 'epoch': 3.48}

 22%|██▏       | 80800/371472 [6:25:37<23:29:39,  3.44it/s]
 22%|██▏       | 80801/371472 [6:25:37<22:41:27,  3.56it/s]
 22%|██▏       | 80802/371472 [6:25:37<22:30:11,  3.59it/s]
 22%|██▏       | 80803/371472 [6:25:37<22:29:27,  3.59it/s]
 22%|██▏       | 80804/371472 [6:25:38<22:15:12,  3.63it/s]
 22%|██▏       | 80805/371472 [6:25:38<22:21:13,  3.61it/s]
 22%|██▏       | 80806/371472 [6:25:38<23:03:44,  3.50it/s]
 22%|██▏       | 80807/371472 [6:25:39<23:52:32,  3.38it/s]
 22%|██▏       | 80808/371472 [6:25:39<23:41:24,  3.41it/s]
 22%|██▏       | 80809/371472 [6:25:39<23:41:30,  3.41it/s]
 22%|██▏       | 80810/371472 [6:25:39<22:29:27,  3.59it/s]
 22%|██▏       | 80811/371472 [6:25:40<22:30:16,  3.59it/s]
 22%|██▏       | 80812/371472 [6:25:40<22:21:05,  3.61it/s]
 22%|██▏       | 80813/371472 [6:25:40<21:55:17,  3.68it/s]
 22%|██▏       | 80814/371472 [6:25:40<22:10:19,  3.64it/s]
 22%|██▏       | 80815/371472 [6:25:41<21:53:57,  3.69it/s]
 22%|██▏       | 80816/371472 [6:25:41<24:21:04,  3.32it/s]
 22%|██▏       | 80817/371472 [6:25:41<24:40:48,  3.27it/s]
 22%|██▏       | 80818/371472 [6:25:42<23:48:43,  3.39it/s]
 22%|██▏       | 80819/371472 [6:25:42<23:09:40,  3.49it/s]
 22%|██▏       | 80820/371472 [6:25:42<22:57:06,  3.52it/s]
                                                           
{'loss': 4.0738, 'learning_rate': 8.045691568445775e-07, 'epoch': 3.48}

 22%|██▏       | 80820/371472 [6:25:42<22:57:06,  3.52it/s]
 22%|██▏       | 80821/371472 [6:25:43<22:54:15,  3.52it/s]
 22%|██▏       | 80822/371472 [6:25:43<22:16:28,  3.62it/s]
 22%|██▏       | 80823/371472 [6:25:43<22:51:24,  3.53it/s]
 22%|██▏       | 80824/371472 [6:25:43<22:03:12,  3.66it/s]
 22%|██▏       | 80825/371472 [6:25:44<22:42:12,  3.56it/s]
 22%|██▏       | 80826/371472 [6:25:44<22:13:11,  3.63it/s]
 22%|██▏       | 80827/371472 [6:25:44<22:39:23,  3.56it/s]
 22%|██▏       | 80828/371472 [6:25:44<22:48:25,  3.54it/s]
 22%|██▏       | 80829/371472 [6:25:45<23:08:22,  3.49it/s]
 22%|██▏       | 80830/371472 [6:25:45<23:13:42,  3.48it/s]
 22%|██▏       | 80831/371472 [6:25:45<22:30:28,  3.59it/s]
 22%|██▏       | 80832/371472 [6:25:46<22:46:29,  3.54it/s]
 22%|██▏       | 80833/371472 [6:25:46<23:09:10,  3.49it/s]
 22%|██▏       | 80834/371472 [6:25:46<22:13:44,  3.63it/s]
 22%|██▏       | 80835/371472 [6:25:46<21:48:32,  3.70it/s]
 22%|██▏       | 80836/371472 [6:25:47<21:47:23,  3.71it/s]
 22%|██▏       | 80837/371472 [6:25:47<22:29:33,  3.59it/s]
 22%|██▏       | 80838/371472 [6:25:47<22:19:53,  3.62it/s]
 22%|██▏       | 80839/371472 [6:25:47<21:49:57,  3.70it/s]
 22%|██▏       | 80840/371472 [6:25:48<23:11:18,  3.48it/s]
                                                           
{'loss': 4.0487, 'learning_rate': 8.045206748690986e-07, 'epoch': 3.48}

 22%|██▏       | 80840/371472 [6:25:48<23:11:18,  3.48it/s]
 22%|██▏       | 80841/371472 [6:25:48<23:05:57,  3.49it/s]
 22%|██▏       | 80842/371472 [6:25:48<23:21:14,  3.46it/s]
 22%|██▏       | 80843/371472 [6:25:49<22:39:09,  3.56it/s]
 22%|██▏       | 80844/371472 [6:25:49<22:38:52,  3.56it/s]
 22%|██▏       | 80845/371472 [6:25:49<21:41:31,  3.72it/s]
 22%|██▏       | 80846/371472 [6:25:49<22:08:50,  3.65it/s]
 22%|██▏       | 80847/371472 [6:25:50<22:31:49,  3.58it/s]
 22%|██▏       | 80848/371472 [6:25:50<21:57:21,  3.68it/s]
 22%|██▏       | 80849/371472 [6:25:50<25:05:57,  3.22it/s]
 22%|██▏       | 80850/371472 [6:25:51<23:56:05,  3.37it/s]
 22%|██▏       | 80851/371472 [6:25:51<22:45:08,  3.55it/s]
 22%|██▏       | 80852/371472 [6:25:51<21:50:14,  3.70it/s]
 22%|██▏       | 80853/371472 [6:25:52<23:24:23,  3.45it/s]
 22%|██▏       | 80854/371472 [6:25:52<22:53:12,  3.53it/s]
 22%|██▏       | 80855/371472 [6:25:52<27:28:29,  2.94it/s]
 22%|██▏       | 80856/371472 [6:25:53<26:08:13,  3.09it/s]
 22%|██▏       | 80857/371472 [6:25:53<24:36:11,  3.28it/s]
 22%|██▏       | 80858/371472 [6:25:53<24:39:59,  3.27it/s]
 22%|██▏       | 80859/371472 [6:25:53<24:02:34,  3.36it/s]
 22%|██▏       | 80860/371472 [6:25:54<22:38:38,  3.56it/s]
                                                           
{'loss': 4.0359, 'learning_rate': 8.044721928936198e-07, 'epoch': 3.48}

 22%|██▏       | 80860/371472 [6:25:54<22:38:38,  3.56it/s]
 22%|██▏       | 80861/371472 [6:25:54<23:41:58,  3.41it/s]
 22%|██▏       | 80862/371472 [6:25:54<22:29:37,  3.59it/s]
 22%|██▏       | 80863/371472 [6:25:54<21:29:32,  3.76it/s]
 22%|██▏       | 80864/371472 [6:25:55<23:34:38,  3.42it/s]
 22%|██▏       | 80865/371472 [6:25:55<23:34:14,  3.42it/s]
 22%|██▏       | 80866/371472 [6:25:55<22:49:58,  3.54it/s]
 22%|██▏       | 80867/371472 [6:25:56<22:40:43,  3.56it/s]
 22%|██▏       | 80868/371472 [6:25:56<21:25:57,  3.77it/s]
 22%|██▏       | 80869/371472 [6:25:56<22:28:54,  3.59it/s]
 22%|██▏       | 80870/371472 [6:25:56<21:56:49,  3.68it/s]
 22%|██▏       | 80871/371472 [6:25:57<21:14:54,  3.80it/s]
 22%|██▏       | 80872/371472 [6:25:57<22:03:55,  3.66it/s]
 22%|██▏       | 80873/371472 [6:25:57<22:35:09,  3.57it/s]
 22%|██▏       | 80874/371472 [6:25:58<22:08:24,  3.65it/s]
 22%|██▏       | 80875/371472 [6:25:58<21:29:15,  3.76it/s]
 22%|██▏       | 80876/371472 [6:25:58<22:16:55,  3.62it/s]
 22%|██▏       | 80877/371472 [6:25:58<22:57:50,  3.52it/s]
 22%|██▏       | 80878/371472 [6:25:59<22:46:49,  3.54it/s]
 22%|██▏       | 80879/371472 [6:25:59<21:54:02,  3.69it/s]
 22%|██▏       | 80880/371472 [6:25:59<22:26:14,  3.60it/s]
                                                           
{'loss': 3.9768, 'learning_rate': 8.044237109181408e-07, 'epoch': 3.48}

 22%|██▏       | 80880/371472 [6:25:59<22:26:14,  3.60it/s]
 22%|██▏       | 80881/371472 [6:25:59<23:32:37,  3.43it/s]
 22%|██▏       | 80882/371472 [6:26:00<23:48:38,  3.39it/s]
 22%|██▏       | 80883/371472 [6:26:00<23:23:58,  3.45it/s]
 22%|██▏       | 80884/371472 [6:26:00<23:18:20,  3.46it/s]
 22%|██▏       | 80885/371472 [6:26:01<23:50:40,  3.39it/s]
 22%|██▏       | 80886/371472 [6:26:01<24:53:22,  3.24it/s]
 22%|██▏       | 80887/371472 [6:26:01<23:36:51,  3.42it/s]
 22%|██▏       | 80888/371472 [6:26:02<23:27:27,  3.44it/s]
 22%|██▏       | 80889/371472 [6:26:02<22:34:43,  3.57it/s]
 22%|██▏       | 80890/371472 [6:26:02<22:58:58,  3.51it/s]
 22%|██▏       | 80891/371472 [6:26:02<22:35:03,  3.57it/s]
 22%|██▏       | 80892/371472 [6:26:03<22:04:48,  3.66it/s]
 22%|██▏       | 80893/371472 [6:26:03<21:22:57,  3.77it/s]
 22%|██▏       | 80894/371472 [6:26:03<22:26:52,  3.60it/s]
 22%|██▏       | 80895/371472 [6:26:03<21:43:35,  3.72it/s]
 22%|██▏       | 80896/371472 [6:26:04<21:50:33,  3.70it/s]
 22%|██▏       | 80897/371472 [6:26:04<22:04:00,  3.66it/s]
 22%|██▏       | 80898/371472 [6:26:04<25:47:55,  3.13it/s]
 22%|██▏       | 80899/371472 [6:26:05<24:05:21,  3.35it/s]
 22%|██▏       | 80900/371472 [6:26:05<24:01:43,  3.36it/s]
                                                           
{'loss': 4.0637, 'learning_rate': 8.043752289426621e-07, 'epoch': 3.48}

 22%|██▏       | 80900/371472 [6:26:05<24:01:43,  3.36it/s]
 22%|██▏       | 80901/371472 [6:26:05<23:06:20,  3.49it/s]
 22%|██▏       | 80902/371472 [6:26:06<23:54:08,  3.38it/s]
 22%|██▏       | 80903/371472 [6:26:06<26:38:15,  3.03it/s]
 22%|██▏       | 80904/371472 [6:26:06<24:12:59,  3.33it/s]
 22%|██▏       | 80905/371472 [6:26:06<22:49:37,  3.54it/s]
 22%|██▏       | 80906/371472 [6:26:07<22:56:17,  3.52it/s]
 22%|██▏       | 80907/371472 [6:26:07<31:43:38,  2.54it/s]
 22%|██▏       | 80908/371472 [6:26:08<29:44:23,  2.71it/s]
 22%|██▏       | 80909/371472 [6:26:08<28:04:50,  2.87it/s]
 22%|██▏       | 80910/371472 [6:26:08<25:42:54,  3.14it/s]
 22%|██▏       | 80911/371472 [6:26:08<24:23:24,  3.31it/s]
 22%|██▏       | 80912/371472 [6:26:09<23:45:38,  3.40it/s]
 22%|██▏       | 80913/371472 [6:26:09<23:53:29,  3.38it/s]
 22%|██▏       | 80914/371472 [6:26:09<23:17:48,  3.46it/s]
 22%|██▏       | 80915/371472 [6:26:10<23:33:57,  3.42it/s]
 22%|██▏       | 80916/371472 [6:26:10<23:36:51,  3.42it/s]
 22%|██▏       | 80917/371472 [6:26:10<24:28:48,  3.30it/s]
 22%|██▏       | 80918/371472 [6:26:11<23:13:35,  3.47it/s]
 22%|██▏       | 80919/371472 [6:26:11<24:14:41,  3.33it/s]
 22%|██▏       | 80920/371472 [6:26:11<23:12:16,  3.48it/s]
                                                           
{'loss': 3.9452, 'learning_rate': 8.043267469671831e-07, 'epoch': 3.49}

 22%|██▏       | 80920/371472 [6:26:11<23:12:16,  3.48it/s]
 22%|██▏       | 80921/371472 [6:26:11<23:05:09,  3.50it/s]
 22%|██▏       | 80922/371472 [6:26:12<22:22:19,  3.61it/s]
 22%|██▏       | 80923/371472 [6:26:12<23:57:41,  3.37it/s]
 22%|██▏       | 80924/371472 [6:26:12<22:46:37,  3.54it/s]
 22%|██▏       | 80925/371472 [6:26:13<23:17:12,  3.47it/s]
 22%|██▏       | 80926/371472 [6:26:13<22:28:47,  3.59it/s]
 22%|██▏       | 80927/371472 [6:26:13<22:11:50,  3.64it/s]
 22%|██▏       | 80928/371472 [6:26:13<22:26:09,  3.60it/s]
 22%|██▏       | 80929/371472 [6:26:14<24:15:30,  3.33it/s]
 22%|██▏       | 80930/371472 [6:26:14<25:12:19,  3.20it/s]
 22%|██▏       | 80931/371472 [6:26:14<23:07:10,  3.49it/s]
 22%|██▏       | 80932/371472 [6:26:15<22:50:29,  3.53it/s]
 22%|██▏       | 80933/371472 [6:26:15<22:44:02,  3.55it/s]
 22%|██▏       | 80934/371472 [6:26:15<22:05:53,  3.65it/s]
 22%|██▏       | 80935/371472 [6:26:15<21:40:36,  3.72it/s]
 22%|██▏       | 80936/371472 [6:26:16<21:19:52,  3.78it/s]
 22%|██▏       | 80937/371472 [6:26:16<20:59:13,  3.85it/s]
 22%|██▏       | 80938/371472 [6:26:16<20:51:16,  3.87it/s]
 22%|██▏       | 80939/371472 [6:26:16<20:49:30,  3.88it/s]
 22%|██▏       | 80940/371472 [6:26:17<20:52:46,  3.87it/s]
                                                           
{'loss': 3.9939, 'learning_rate': 8.042782649917041e-07, 'epoch': 3.49}

 22%|██▏       | 80940/371472 [6:26:17<20:52:46,  3.87it/s]
 22%|██▏       | 80941/371472 [6:26:17<20:50:39,  3.87it/s]
 22%|██▏       | 80942/371472 [6:26:17<21:25:34,  3.77it/s]
 22%|██▏       | 80943/371472 [6:26:17<22:20:55,  3.61it/s]
 22%|██▏       | 80944/371472 [6:26:18<21:56:05,  3.68it/s]
 22%|██▏       | 80945/371472 [6:26:18<21:24:32,  3.77it/s]
 22%|██▏       | 80946/371472 [6:26:18<21:35:51,  3.74it/s]
 22%|██▏       | 80947/371472 [6:26:18<21:23:00,  3.77it/s]
 22%|██▏       | 80948/371472 [6:26:19<22:29:36,  3.59it/s]
 22%|██▏       | 80949/371472 [6:26:19<21:59:58,  3.67it/s]
 22%|██▏       | 80950/371472 [6:26:19<21:51:47,  3.69it/s]
 22%|██▏       | 80951/371472 [6:26:20<22:43:12,  3.55it/s]
 22%|██▏       | 80952/371472 [6:26:20<21:46:04,  3.71it/s]
 22%|██▏       | 80953/371472 [6:26:20<21:21:47,  3.78it/s]
 22%|██▏       | 80954/371472 [6:26:20<22:07:45,  3.65it/s]
 22%|██▏       | 80955/371472 [6:26:21<21:53:29,  3.69it/s]
 22%|██▏       | 80956/371472 [6:26:21<21:58:29,  3.67it/s]
 22%|██▏       | 80957/371472 [6:26:21<24:09:58,  3.34it/s]
 22%|██▏       | 80958/371472 [6:26:22<23:47:50,  3.39it/s]
 22%|██▏       | 80959/371472 [6:26:22<22:35:06,  3.57it/s]
 22%|██▏       | 80960/371472 [6:26:22<22:12:56,  3.63it/s]
                                                           
{'loss': 4.086, 'learning_rate': 8.042297830162252e-07, 'epoch': 3.49}

 22%|██▏       | 80960/371472 [6:26:22<22:12:56,  3.63it/s]
 22%|██▏       | 80961/371472 [6:26:22<22:27:16,  3.59it/s]
 22%|██▏       | 80962/371472 [6:26:23<22:39:05,  3.56it/s]
 22%|██▏       | 80963/371472 [6:26:23<22:10:18,  3.64it/s]
 22%|██▏       | 80964/371472 [6:26:23<21:17:47,  3.79it/s]
 22%|██▏       | 80965/371472 [6:26:23<20:49:14,  3.88it/s]
 22%|██▏       | 80966/371472 [6:26:24<20:48:52,  3.88it/s]
 22%|██▏       | 80967/371472 [6:26:24<20:41:36,  3.90it/s]
 22%|██▏       | 80968/371472 [6:26:24<21:42:27,  3.72it/s]
 22%|██▏       | 80969/371472 [6:26:25<22:36:31,  3.57it/s]
 22%|██▏       | 80970/371472 [6:26:25<21:46:18,  3.71it/s]
 22%|██▏       | 80971/371472 [6:26:25<21:04:31,  3.83it/s]
 22%|██▏       | 80972/371472 [6:26:25<22:52:41,  3.53it/s]
 22%|██▏       | 80973/371472 [6:26:26<22:20:13,  3.61it/s]
 22%|██▏       | 80974/371472 [6:26:26<23:07:58,  3.49it/s]
 22%|██▏       | 80975/371472 [6:26:26<21:48:12,  3.70it/s]
 22%|██▏       | 80976/371472 [6:26:26<22:53:54,  3.52it/s]
 22%|██▏       | 80977/371472 [6:26:27<22:25:11,  3.60it/s]
 22%|██▏       | 80978/371472 [6:26:27<21:45:14,  3.71it/s]
 22%|██▏       | 80979/371472 [6:26:27<22:11:28,  3.64it/s]
 22%|██▏       | 80980/371472 [6:26:28<22:14:55,  3.63it/s]
                                                           
{'loss': 4.0662, 'learning_rate': 8.041813010407464e-07, 'epoch': 3.49}

 22%|██▏       | 80980/371472 [6:26:28<22:14:55,  3.63it/s]
 22%|██▏       | 80981/371472 [6:26:28<24:00:07,  3.36it/s]
 22%|██▏       | 80982/371472 [6:26:28<23:25:26,  3.44it/s]
 22%|██▏       | 80983/371472 [6:26:28<22:32:23,  3.58it/s]
 22%|██▏       | 80984/371472 [6:26:29<22:50:36,  3.53it/s]
 22%|██▏       | 80985/371472 [6:26:29<22:13:42,  3.63it/s]
 22%|██▏       | 80986/371472 [6:26:29<21:26:57,  3.76it/s]
 22%|██▏       | 80987/371472 [6:26:29<21:15:23,  3.80it/s]
 22%|██▏       | 80988/371472 [6:26:30<21:58:33,  3.67it/s]
 22%|██▏       | 80989/371472 [6:26:30<22:18:58,  3.62it/s]
 22%|██▏       | 80990/371472 [6:26:30<21:29:45,  3.75it/s]
 22%|██▏       | 80991/371472 [6:26:31<21:54:26,  3.68it/s]
 22%|██▏       | 80992/371472 [6:26:31<24:52:27,  3.24it/s]
 22%|██▏       | 80993/371472 [6:26:31<23:22:15,  3.45it/s]
 22%|██▏       | 80994/371472 [6:26:32<22:59:13,  3.51it/s]
 22%|██▏       | 80995/371472 [6:26:32<23:17:15,  3.46it/s]
 22%|██▏       | 80996/371472 [6:26:32<23:31:43,  3.43it/s]
 22%|██▏       | 80997/371472 [6:26:32<23:57:03,  3.37it/s]
 22%|██▏       | 80998/371472 [6:26:33<24:06:23,  3.35it/s]
 22%|██▏       | 80999/371472 [6:26:33<23:20:26,  3.46it/s]
 22%|██▏       | 81000/371472 [6:26:33<22:12:34,  3.63it/s]
                                                           
{'loss': 4.1216, 'learning_rate': 8.041328190652675e-07, 'epoch': 3.49}

 22%|██▏       | 81000/371472 [6:26:33<22:12:34,  3.63it/s]
 22%|██▏       | 81001/371472 [6:26:33<21:24:06,  3.77it/s]
 22%|██▏       | 81002/371472 [6:26:34<20:42:32,  3.90it/s]
 22%|██▏       | 81003/371472 [6:26:34<21:18:41,  3.79it/s]
 22%|██▏       | 81004/371472 [6:26:34<22:27:01,  3.59it/s]
 22%|██▏       | 81005/371472 [6:26:35<24:53:51,  3.24it/s]
 22%|██▏       | 81006/371472 [6:26:35<24:17:16,  3.32it/s]
 22%|██▏       | 81007/371472 [6:26:35<23:14:22,  3.47it/s]
 22%|██▏       | 81008/371472 [6:26:35<22:24:25,  3.60it/s]
 22%|██▏       | 81009/371472 [6:26:36<22:38:58,  3.56it/s]
 22%|██▏       | 81010/371472 [6:26:36<22:02:23,  3.66it/s]
 22%|██▏       | 81011/371472 [6:26:36<22:04:36,  3.65it/s]
 22%|██▏       | 81012/371472 [6:26:37<22:08:23,  3.64it/s]
 22%|██▏       | 81013/371472 [6:26:37<21:44:53,  3.71it/s]
 22%|██▏       | 81014/371472 [6:26:37<21:13:48,  3.80it/s]
 22%|██▏       | 81015/371472 [6:26:37<22:20:46,  3.61it/s]
 22%|██▏       | 81016/371472 [6:26:38<22:02:11,  3.66it/s]
 22%|██▏       | 81017/371472 [6:26:38<21:52:42,  3.69it/s]
 22%|██▏       | 81018/371472 [6:26:38<21:34:23,  3.74it/s]
 22%|██▏       | 81019/371472 [6:26:38<21:53:17,  3.69it/s]
 22%|██▏       | 81020/371472 [6:26:39<22:02:59,  3.66it/s]
                                                           
{'loss': 3.9984, 'learning_rate': 8.040843370897886e-07, 'epoch': 3.49}

 22%|██▏       | 81020/371472 [6:26:39<22:02:59,  3.66it/s]
 22%|██▏       | 81021/371472 [6:26:39<23:42:56,  3.40it/s]
 22%|██▏       | 81022/371472 [6:26:39<23:54:56,  3.37it/s]
 22%|██▏       | 81023/371472 [6:26:40<24:30:10,  3.29it/s]
 22%|██▏       | 81024/371472 [6:26:40<24:10:50,  3.34it/s]
 22%|██▏       | 81025/371472 [6:26:40<22:49:04,  3.54it/s]
 22%|██▏       | 81026/371472 [6:26:41<23:30:25,  3.43it/s]
 22%|██▏       | 81027/371472 [6:26:41<26:25:21,  3.05it/s]
 22%|██▏       | 81028/371472 [6:26:41<25:38:09,  3.15it/s]
 22%|██▏       | 81029/371472 [6:26:42<24:27:40,  3.30it/s]
 22%|██▏       | 81030/371472 [6:26:42<24:07:53,  3.34it/s]
 22%|██▏       | 81031/371472 [6:26:42<23:28:25,  3.44it/s]
 22%|██▏       | 81032/371472 [6:26:42<22:40:14,  3.56it/s]
 22%|██▏       | 81033/371472 [6:26:43<22:03:48,  3.66it/s]
 22%|██▏       | 81034/371472 [6:26:43<23:15:38,  3.47it/s]
 22%|██▏       | 81035/371472 [6:26:43<22:49:25,  3.53it/s]
 22%|██▏       | 81036/371472 [6:26:43<22:53:31,  3.52it/s]
 22%|██▏       | 81037/371472 [6:26:44<21:45:23,  3.71it/s]
 22%|██▏       | 81038/371472 [6:26:44<21:59:17,  3.67it/s]
 22%|██▏       | 81039/371472 [6:26:44<22:06:10,  3.65it/s]
 22%|██▏       | 81040/371472 [6:26:45<21:31:38,  3.75it/s]
                                                           
{'loss': 3.9435, 'learning_rate': 8.040358551143097e-07, 'epoch': 3.49}

 22%|██▏       | 81040/371472 [6:26:45<21:31:38,  3.75it/s]
 22%|██▏       | 81041/371472 [6:26:45<21:25:05,  3.77it/s]
 22%|██▏       | 81042/371472 [6:26:45<21:27:12,  3.76it/s]
 22%|██▏       | 81043/371472 [6:26:45<21:10:20,  3.81it/s]
 22%|██▏       | 81044/371472 [6:26:46<22:13:37,  3.63it/s]
 22%|██▏       | 81045/371472 [6:26:46<22:08:50,  3.64it/s]
 22%|██▏       | 81046/371472 [6:26:46<21:30:10,  3.75it/s]
 22%|██▏       | 81047/371472 [6:26:46<22:24:32,  3.60it/s]
 22%|██▏       | 81048/371472 [6:26:47<23:00:15,  3.51it/s]
 22%|██▏       | 81049/371472 [6:26:47<22:25:23,  3.60it/s]
 22%|██▏       | 81050/371472 [6:26:47<22:57:18,  3.51it/s]
 22%|██▏       | 81051/371472 [6:26:48<22:38:47,  3.56it/s]
 22%|██▏       | 81052/371472 [6:26:48<22:57:42,  3.51it/s]
 22%|██▏       | 81053/371472 [6:26:48<23:43:17,  3.40it/s]
 22%|██▏       | 81054/371472 [6:26:48<22:45:45,  3.54it/s]
 22%|██▏       | 81055/371472 [6:26:49<22:57:34,  3.51it/s]
 22%|██▏       | 81056/371472 [6:26:49<22:07:50,  3.65it/s]
 22%|██▏       | 81057/371472 [6:26:49<21:09:22,  3.81it/s]
 22%|██▏       | 81058/371472 [6:26:50<22:52:28,  3.53it/s]
 22%|██▏       | 81059/371472 [6:26:50<22:48:48,  3.54it/s]
 22%|██▏       | 81060/371472 [6:26:50<22:13:17,  3.63it/s]
                                                           
{'loss': 4.1261, 'learning_rate': 8.039873731388308e-07, 'epoch': 3.49}

 22%|██▏       | 81060/371472 [6:26:50<22:13:17,  3.63it/s]
 22%|██▏       | 81061/371472 [6:26:50<21:44:52,  3.71it/s]
 22%|██▏       | 81062/371472 [6:26:51<21:15:01,  3.80it/s]
 22%|██▏       | 81063/371472 [6:26:51<22:54:06,  3.52it/s]
 22%|██▏       | 81064/371472 [6:26:51<23:28:46,  3.44it/s]
 22%|██▏       | 81065/371472 [6:26:51<23:14:46,  3.47it/s]
 22%|██▏       | 81066/371472 [6:26:52<22:15:55,  3.62it/s]
 22%|██▏       | 81067/371472 [6:26:52<22:37:39,  3.57it/s]
 22%|██▏       | 81068/371472 [6:26:52<24:05:35,  3.35it/s]
 22%|██▏       | 81069/371472 [6:26:53<22:41:23,  3.56it/s]
 22%|██▏       | 81070/371472 [6:26:53<23:13:10,  3.47it/s]
 22%|██▏       | 81071/371472 [6:26:53<22:45:37,  3.54it/s]
 22%|██▏       | 81072/371472 [6:26:53<22:52:33,  3.53it/s]
 22%|██▏       | 81073/371472 [6:26:54<22:46:22,  3.54it/s]
 22%|██▏       | 81074/371472 [6:26:54<22:38:51,  3.56it/s]
 22%|██▏       | 81075/371472 [6:26:54<22:55:59,  3.52it/s]
 22%|██▏       | 81076/371472 [6:26:55<22:59:17,  3.51it/s]
 22%|██▏       | 81077/371472 [6:26:55<22:35:17,  3.57it/s]
 22%|██▏       | 81078/371472 [6:26:55<22:01:30,  3.66it/s]
 22%|██▏       | 81079/371472 [6:26:55<23:14:46,  3.47it/s]
 22%|██▏       | 81080/371472 [6:26:56<22:15:54,  3.62it/s]
                                                           
{'loss': 4.124, 'learning_rate': 8.039388911633519e-07, 'epoch': 3.49}

 22%|██▏       | 81080/371472 [6:26:56<22:15:54,  3.62it/s]
 22%|██▏       | 81081/371472 [6:26:56<21:54:49,  3.68it/s]
 22%|██▏       | 81082/371472 [6:26:56<24:12:33,  3.33it/s]
 22%|██▏       | 81083/371472 [6:26:57<23:03:10,  3.50it/s]
 22%|██▏       | 81084/371472 [6:26:57<21:56:00,  3.68it/s]
 22%|██▏       | 81085/371472 [6:26:57<22:26:14,  3.60it/s]
 22%|██▏       | 81086/371472 [6:26:57<22:31:00,  3.58it/s]
 22%|██▏       | 81087/371472 [6:26:58<24:09:17,  3.34it/s]
 22%|██▏       | 81088/371472 [6:26:58<23:46:39,  3.39it/s]
 22%|██▏       | 81089/371472 [6:26:58<23:44:10,  3.40it/s]
 22%|██▏       | 81090/371472 [6:26:59<22:48:53,  3.54it/s]
 22%|██▏       | 81091/371472 [6:26:59<24:59:09,  3.23it/s]
 22%|██▏       | 81092/371472 [6:26:59<23:06:40,  3.49it/s]
 22%|██▏       | 81093/371472 [6:27:00<25:58:58,  3.10it/s]
 22%|██▏       | 81094/371472 [6:27:00<25:47:55,  3.13it/s]
 22%|██▏       | 81095/371472 [6:27:00<25:30:34,  3.16it/s]
 22%|██▏       | 81096/371472 [6:27:00<24:26:09,  3.30it/s]
 22%|██▏       | 81097/371472 [6:27:01<23:37:39,  3.41it/s]
 22%|██▏       | 81098/371472 [6:27:01<22:13:52,  3.63it/s]
 22%|██▏       | 81099/371472 [6:27:01<21:52:22,  3.69it/s]
 22%|██▏       | 81100/371472 [6:27:02<24:00:46,  3.36it/s]
                                                           
{'loss': 3.9723, 'learning_rate': 8.03890409187873e-07, 'epoch': 3.49}

 22%|██▏       | 81100/371472 [6:27:02<24:00:46,  3.36it/s]
 22%|██▏       | 81101/371472 [6:27:02<22:28:39,  3.59it/s]
 22%|██▏       | 81102/371472 [6:27:02<22:15:37,  3.62it/s]
 22%|██▏       | 81103/371472 [6:27:03<25:29:06,  3.16it/s]
 22%|██▏       | 81104/371472 [6:27:03<24:02:43,  3.35it/s]
 22%|██▏       | 81105/371472 [6:27:03<22:58:06,  3.51it/s]
 22%|██▏       | 81106/371472 [6:27:03<26:36:44,  3.03it/s]
 22%|██▏       | 81107/371472 [6:27:04<25:25:30,  3.17it/s]
 22%|██▏       | 81108/371472 [6:27:04<24:28:52,  3.29it/s]
 22%|██▏       | 81109/371472 [6:27:04<23:03:25,  3.50it/s]
 22%|██▏       | 81110/371472 [6:27:05<23:02:54,  3.50it/s]
 22%|██▏       | 81111/371472 [6:27:05<22:18:17,  3.62it/s]
 22%|██▏       | 81112/371472 [6:27:05<22:59:28,  3.51it/s]
 22%|██▏       | 81113/371472 [6:27:05<22:48:46,  3.54it/s]
 22%|██▏       | 81114/371472 [6:27:06<22:55:42,  3.52it/s]
 22%|██▏       | 81115/371472 [6:27:06<23:41:51,  3.40it/s]
 22%|██▏       | 81116/371472 [6:27:06<23:03:48,  3.50it/s]
 22%|██▏       | 81117/371472 [6:27:07<23:24:10,  3.45it/s]
 22%|██▏       | 81118/371472 [6:27:07<22:37:58,  3.56it/s]
 22%|██▏       | 81119/371472 [6:27:07<21:33:17,  3.74it/s]
 22%|██▏       | 81120/371472 [6:27:07<22:18:28,  3.62it/s]
                                                           
{'loss': 3.957, 'learning_rate': 8.038419272123941e-07, 'epoch': 3.49}

 22%|██▏       | 81120/371472 [6:27:07<22:18:28,  3.62it/s]
 22%|██▏       | 81121/371472 [6:27:08<22:02:11,  3.66it/s]
 22%|██▏       | 81122/371472 [6:27:08<22:28:40,  3.59it/s]
 22%|██▏       | 81123/371472 [6:27:08<22:51:28,  3.53it/s]
 22%|██▏       | 81124/371472 [6:27:08<22:15:11,  3.62it/s]
 22%|██▏       | 81125/371472 [6:27:09<22:28:42,  3.59it/s]
 22%|██▏       | 81126/371472 [6:27:09<21:15:46,  3.79it/s]
 22%|██▏       | 81127/371472 [6:27:09<20:49:34,  3.87it/s]
 22%|██▏       | 81128/371472 [6:27:09<21:15:13,  3.79it/s]
 22%|██▏       | 81129/371472 [6:27:10<21:33:34,  3.74it/s]
 22%|██▏       | 81130/371472 [6:27:10<21:47:25,  3.70it/s]
 22%|██▏       | 81131/371472 [6:27:10<21:37:01,  3.73it/s]
 22%|██▏       | 81132/371472 [6:27:11<22:15:46,  3.62it/s]
 22%|██▏       | 81133/371472 [6:27:11<23:39:14,  3.41it/s]
 22%|██▏       | 81134/371472 [6:27:11<22:57:28,  3.51it/s]
 22%|██▏       | 81135/371472 [6:27:11<22:37:38,  3.56it/s]
 22%|██▏       | 81136/371472 [6:27:12<22:23:35,  3.60it/s]
 22%|██▏       | 81137/371472 [6:27:12<21:59:44,  3.67it/s]
 22%|██▏       | 81138/371472 [6:27:12<21:55:55,  3.68it/s]
 22%|██▏       | 81139/371472 [6:27:13<21:18:39,  3.78it/s]
 22%|██▏       | 81140/371472 [6:27:13<21:46:43,  3.70it/s]
                                                           
{'loss': 3.9559, 'learning_rate': 8.037934452369152e-07, 'epoch': 3.49}

 22%|██▏       | 81140/371472 [6:27:13<21:46:43,  3.70it/s]
 22%|██▏       | 81141/371472 [6:27:13<21:53:35,  3.68it/s]
 22%|██▏       | 81142/371472 [6:27:13<22:36:45,  3.57it/s]
 22%|██▏       | 81143/371472 [6:27:14<22:01:33,  3.66it/s]
 22%|██▏       | 81144/371472 [6:27:14<21:52:24,  3.69it/s]
 22%|██▏       | 81145/371472 [6:27:14<21:42:37,  3.71it/s]
 22%|██▏       | 81146/371472 [6:27:14<22:07:07,  3.65it/s]
 22%|██▏       | 81147/371472 [6:27:15<21:36:05,  3.73it/s]
 22%|██▏       | 81148/371472 [6:27:15<21:43:43,  3.71it/s]
 22%|██▏       | 81149/371472 [6:27:15<21:51:51,  3.69it/s]
 22%|██▏       | 81150/371472 [6:27:16<21:44:17,  3.71it/s]
 22%|██▏       | 81151/371472 [6:27:16<22:57:48,  3.51it/s]
 22%|██▏       | 81152/371472 [6:27:16<22:23:00,  3.60it/s]
 22%|██▏       | 81153/371472 [6:27:16<21:56:36,  3.68it/s]
 22%|██▏       | 81154/371472 [6:27:17<21:44:26,  3.71it/s]
 22%|██▏       | 81155/371472 [6:27:17<21:18:19,  3.79it/s]
 22%|██▏       | 81156/371472 [6:27:17<22:29:21,  3.59it/s]
 22%|██▏       | 81157/371472 [6:27:17<22:24:25,  3.60it/s]
 22%|██▏       | 81158/371472 [6:27:18<22:12:01,  3.63it/s]
 22%|██▏       | 81159/371472 [6:27:18<23:22:26,  3.45it/s]
 22%|██▏       | 81160/371472 [6:27:18<22:50:25,  3.53it/s]
                                                           
{'loss': 4.1893, 'learning_rate': 8.037449632614364e-07, 'epoch': 3.5}

 22%|██▏       | 81160/371472 [6:27:18<22:50:25,  3.53it/s]
 22%|██▏       | 81161/371472 [6:27:19<22:06:36,  3.65it/s]
 22%|██▏       | 81162/371472 [6:27:19<21:36:01,  3.73it/s]
 22%|██▏       | 81163/371472 [6:27:19<22:44:04,  3.55it/s]
 22%|██▏       | 81164/371472 [6:27:19<22:15:18,  3.62it/s]
 22%|██▏       | 81165/371472 [6:27:20<21:48:55,  3.70it/s]
 22%|██▏       | 81166/371472 [6:27:20<21:26:50,  3.76it/s]
 22%|██▏       | 81167/371472 [6:27:20<21:29:35,  3.75it/s]
 22%|██▏       | 81168/371472 [6:27:21<24:01:00,  3.36it/s]
 22%|██▏       | 81169/371472 [6:27:21<23:27:25,  3.44it/s]
 22%|██▏       | 81170/371472 [6:27:21<22:40:21,  3.56it/s]
 22%|██▏       | 81171/371472 [6:27:21<21:57:45,  3.67it/s]
 22%|██▏       | 81172/371472 [6:27:22<22:29:34,  3.59it/s]
 22%|██▏       | 81173/371472 [6:27:22<23:38:41,  3.41it/s]
 22%|██▏       | 81174/371472 [6:27:22<23:07:12,  3.49it/s]
 22%|██▏       | 81175/371472 [6:27:23<23:01:53,  3.50it/s]
 22%|██▏       | 81176/371472 [6:27:23<22:55:20,  3.52it/s]
 22%|██▏       | 81177/371472 [6:27:23<22:34:40,  3.57it/s]
 22%|██▏       | 81178/371472 [6:27:23<22:04:13,  3.65it/s]
 22%|██▏       | 81179/371472 [6:27:24<21:17:08,  3.79it/s]
 22%|██▏       | 81180/371472 [6:27:24<21:46:30,  3.70it/s]
                                                           
{'loss': 4.1786, 'learning_rate': 8.036964812859574e-07, 'epoch': 3.5}

 22%|██▏       | 81180/371472 [6:27:24<21:46:30,  3.70it/s]
 22%|██▏       | 81181/371472 [6:27:24<22:41:56,  3.55it/s]
 22%|██▏       | 81182/371472 [6:27:24<22:55:52,  3.52it/s]
 22%|██▏       | 81183/371472 [6:27:25<22:17:22,  3.62it/s]
 22%|██▏       | 81184/371472 [6:27:25<22:13:22,  3.63it/s]
 22%|██▏       | 81185/371472 [6:27:25<22:05:01,  3.65it/s]
 22%|██▏       | 81186/371472 [6:27:26<22:15:34,  3.62it/s]
 22%|██▏       | 81187/371472 [6:27:26<21:47:48,  3.70it/s]
 22%|██▏       | 81188/371472 [6:27:26<22:25:39,  3.60it/s]
 22%|██▏       | 81189/371472 [6:27:26<22:06:31,  3.65it/s]
 22%|██▏       | 81190/371472 [6:27:27<22:34:49,  3.57it/s]
 22%|██▏       | 81191/371472 [6:27:27<22:44:13,  3.55it/s]
 22%|██▏       | 81192/371472 [6:27:27<22:16:22,  3.62it/s]
 22%|██▏       | 81193/371472 [6:27:27<21:23:00,  3.77it/s]
 22%|██▏       | 81194/371472 [6:27:28<21:45:31,  3.71it/s]
 22%|██▏       | 81195/371472 [6:27:28<22:27:53,  3.59it/s]
 22%|██▏       | 81196/371472 [6:27:28<23:09:20,  3.48it/s]
 22%|██▏       | 81197/371472 [6:27:29<22:17:18,  3.62it/s]
 22%|██▏       | 81198/371472 [6:27:29<22:19:58,  3.61it/s]
 22%|██▏       | 81199/371472 [6:27:29<21:34:31,  3.74it/s]
 22%|██▏       | 81200/371472 [6:27:29<22:38:45,  3.56it/s]
                                                           
{'loss': 4.1742, 'learning_rate': 8.036479993104785e-07, 'epoch': 3.5}

 22%|██▏       | 81200/371472 [6:27:29<22:38:45,  3.56it/s]
 22%|██▏       | 81201/371472 [6:27:30<22:37:56,  3.56it/s]
 22%|██▏       | 81202/371472 [6:27:30<22:25:35,  3.60it/s]
 22%|██▏       | 81203/371472 [6:27:30<21:36:40,  3.73it/s]
 22%|██▏       | 81204/371472 [6:27:30<21:56:25,  3.67it/s]
 22%|██▏       | 81205/371472 [6:27:31<21:32:15,  3.74it/s]
 22%|██▏       | 81206/371472 [6:27:31<20:54:35,  3.86it/s]
 22%|██▏       | 81207/371472 [6:27:31<21:47:16,  3.70it/s]
 22%|██▏       | 81208/371472 [6:27:32<20:51:43,  3.86it/s]
 22%|██▏       | 81209/371472 [6:27:32<20:51:52,  3.86it/s]
 22%|██▏       | 81210/371472 [6:27:32<20:46:11,  3.88it/s]
 22%|██▏       | 81211/371472 [6:27:32<20:30:57,  3.93it/s]
 22%|██▏       | 81212/371472 [6:27:33<20:39:51,  3.90it/s]
 22%|██▏       | 81213/371472 [6:27:33<21:36:38,  3.73it/s]
 22%|██▏       | 81214/371472 [6:27:33<21:28:54,  3.75it/s]
 22%|██▏       | 81215/371472 [6:27:33<23:07:24,  3.49it/s]
 22%|██▏       | 81216/371472 [6:27:34<24:04:34,  3.35it/s]
 22%|██▏       | 81217/371472 [6:27:34<24:04:36,  3.35it/s]
 22%|██▏       | 81218/371472 [6:27:34<23:00:07,  3.51it/s]
 22%|██▏       | 81219/371472 [6:27:35<21:59:46,  3.67it/s]
 22%|██▏       | 81220/371472 [6:27:35<21:13:37,  3.80it/s]
                                                           
{'loss': 4.2267, 'learning_rate': 8.035995173349997e-07, 'epoch': 3.5}

 22%|██▏       | 81220/371472 [6:27:35<21:13:37,  3.80it/s]
 22%|██▏       | 81221/371472 [6:27:35<20:35:12,  3.92it/s]
 22%|██▏       | 81222/371472 [6:27:35<20:12:40,  3.99it/s]
 22%|██▏       | 81223/371472 [6:27:36<20:27:52,  3.94it/s]
 22%|██▏       | 81224/371472 [6:27:36<20:05:28,  4.01it/s]
 22%|██▏       | 81225/371472 [6:27:36<20:39:01,  3.90it/s]
 22%|██▏       | 81226/371472 [6:27:36<20:52:06,  3.86it/s]
 22%|██▏       | 81227/371472 [6:27:37<20:52:14,  3.86it/s]
 22%|██▏       | 81228/371472 [6:27:37<21:44:45,  3.71it/s]
 22%|██▏       | 81229/371472 [6:27:37<20:57:17,  3.85it/s]
 22%|██▏       | 81230/371472 [6:27:37<20:34:24,  3.92it/s]
 22%|██▏       | 81231/371472 [6:27:38<22:47:54,  3.54it/s]
 22%|██▏       | 81232/371472 [6:27:38<23:15:21,  3.47it/s]
 22%|██▏       | 81233/371472 [6:27:38<23:00:28,  3.50it/s]
 22%|██▏       | 81234/371472 [6:27:39<21:55:49,  3.68it/s]
 22%|██▏       | 81235/371472 [6:27:39<21:56:35,  3.67it/s]
 22%|██▏       | 81236/371472 [6:27:39<21:41:20,  3.72it/s]
 22%|██▏       | 81237/371472 [6:27:39<22:01:13,  3.66it/s]
 22%|██▏       | 81238/371472 [6:27:40<22:14:27,  3.62it/s]
 22%|██▏       | 81239/371472 [6:27:40<21:49:00,  3.70it/s]
 22%|██▏       | 81240/371472 [6:27:40<22:29:16,  3.59it/s]
                                                           
{'loss': 4.245, 'learning_rate': 8.035510353595208e-07, 'epoch': 3.5}

 22%|██▏       | 81240/371472 [6:27:40<22:29:16,  3.59it/s]
 22%|██▏       | 81241/371472 [6:27:40<22:36:35,  3.57it/s]
 22%|██▏       | 81242/371472 [6:27:41<23:53:43,  3.37it/s]
 22%|██▏       | 81243/371472 [6:27:41<22:41:42,  3.55it/s]
 22%|██▏       | 81244/371472 [6:27:41<22:50:48,  3.53it/s]
 22%|██▏       | 81245/371472 [6:27:42<22:26:46,  3.59it/s]
 22%|██▏       | 81246/371472 [6:27:42<23:15:17,  3.47it/s]
 22%|██▏       | 81247/371472 [6:27:42<25:01:07,  3.22it/s]
 22%|██▏       | 81248/371472 [6:27:43<23:43:51,  3.40it/s]
 22%|██▏       | 81249/371472 [6:27:43<23:21:03,  3.45it/s]
 22%|██▏       | 81250/371472 [6:27:43<23:05:40,  3.49it/s]
 22%|██▏       | 81251/371472 [6:27:43<22:31:48,  3.58it/s]
 22%|██▏       | 81252/371472 [6:27:44<22:05:47,  3.65it/s]
 22%|██▏       | 81253/371472 [6:27:44<23:51:08,  3.38it/s]
 22%|██▏       | 81254/371472 [6:27:44<24:33:16,  3.28it/s]
 22%|██▏       | 81255/371472 [6:27:45<24:30:28,  3.29it/s]
 22%|██▏       | 81256/371472 [6:27:45<23:13:59,  3.47it/s]
 22%|██▏       | 81257/371472 [6:27:45<23:01:40,  3.50it/s]
 22%|██▏       | 81258/371472 [6:27:45<22:59:15,  3.51it/s]
 22%|██▏       | 81259/371472 [6:27:46<22:33:30,  3.57it/s]
 22%|██▏       | 81260/371472 [6:27:46<22:03:18,  3.66it/s]
                                                           
{'loss': 4.1625, 'learning_rate': 8.035025533840418e-07, 'epoch': 3.5}

 22%|██▏       | 81260/371472 [6:27:46<22:03:18,  3.66it/s]
 22%|██▏       | 81261/371472 [6:27:46<21:41:06,  3.72it/s]
 22%|██▏       | 81262/371472 [6:27:46<21:53:20,  3.68it/s]
 22%|██▏       | 81263/371472 [6:27:47<21:58:10,  3.67it/s]
 22%|██▏       | 81264/371472 [6:27:47<23:09:47,  3.48it/s]
 22%|██▏       | 81265/371472 [6:27:47<22:55:27,  3.52it/s]
 22%|██▏       | 81266/371472 [6:27:48<22:37:30,  3.56it/s]
 22%|██▏       | 81267/371472 [6:27:48<23:41:37,  3.40it/s]
 22%|██▏       | 81268/371472 [6:27:48<24:04:24,  3.35it/s]
 22%|██▏       | 81269/371472 [6:27:49<23:36:43,  3.41it/s]
 22%|██▏       | 81270/371472 [6:27:49<22:19:02,  3.61it/s]
 22%|██▏       | 81271/371472 [6:27:49<21:48:56,  3.70it/s]
 22%|██▏       | 81272/371472 [6:27:49<22:45:22,  3.54it/s]
 22%|██▏       | 81273/371472 [6:27:50<22:15:23,  3.62it/s]
 22%|██▏       | 81274/371472 [6:27:50<24:39:42,  3.27it/s]
 22%|██▏       | 81275/371472 [6:27:50<24:20:13,  3.31it/s]
 22%|██▏       | 81276/371472 [6:27:51<24:42:29,  3.26it/s]
 22%|██▏       | 81277/371472 [6:27:51<25:03:04,  3.22it/s]
 22%|██▏       | 81278/371472 [6:27:51<23:55:45,  3.37it/s]
 22%|██▏       | 81279/371472 [6:27:52<25:17:36,  3.19it/s]
 22%|██▏       | 81280/371472 [6:27:52<24:31:21,  3.29it/s]
                                                           
{'loss': 3.9312, 'learning_rate': 8.03454071408563e-07, 'epoch': 3.5}

 22%|██▏       | 81280/371472 [6:27:52<24:31:21,  3.29it/s]
 22%|██▏       | 81281/371472 [6:27:52<23:21:34,  3.45it/s]
 22%|██▏       | 81282/371472 [6:27:52<23:51:14,  3.38it/s]
 22%|██▏       | 81283/371472 [6:27:53<24:01:27,  3.36it/s]
 22%|██▏       | 81284/371472 [6:27:53<24:00:44,  3.36it/s]
 22%|██▏       | 81285/371472 [6:27:53<23:40:40,  3.40it/s]
 22%|██▏       | 81286/371472 [6:27:54<23:48:55,  3.38it/s]
 22%|██▏       | 81287/371472 [6:27:54<22:39:22,  3.56it/s]
 22%|██▏       | 81288/371472 [6:27:54<22:25:03,  3.60it/s]
 22%|██▏       | 81289/371472 [6:27:54<22:19:04,  3.61it/s]
 22%|██▏       | 81290/371472 [6:27:55<21:53:35,  3.68it/s]
 22%|██▏       | 81291/371472 [6:27:55<22:47:37,  3.54it/s]
 22%|██▏       | 81292/371472 [6:27:55<22:02:13,  3.66it/s]
 22%|██▏       | 81293/371472 [6:27:55<22:35:38,  3.57it/s]
 22%|██▏       | 81294/371472 [6:27:56<23:15:02,  3.47it/s]
 22%|██▏       | 81295/371472 [6:27:56<23:35:20,  3.42it/s]
 22%|██▏       | 81296/371472 [6:27:56<23:07:32,  3.49it/s]
 22%|██▏       | 81297/371472 [6:27:57<22:22:44,  3.60it/s]
 22%|██▏       | 81298/371472 [6:27:57<22:55:53,  3.51it/s]
 22%|██▏       | 81299/371472 [6:27:57<22:05:27,  3.65it/s]
 22%|██▏       | 81300/371472 [6:27:57<21:36:32,  3.73it/s]
                                                           
{'loss': 4.0937, 'learning_rate': 8.034055894330841e-07, 'epoch': 3.5}

 22%|██▏       | 81300/371472 [6:27:57<21:36:32,  3.73it/s]
 22%|██▏       | 81301/371472 [6:27:58<22:15:11,  3.62it/s]
 22%|██▏       | 81302/371472 [6:27:58<22:08:15,  3.64it/s]
 22%|██▏       | 81303/371472 [6:27:58<22:54:05,  3.52it/s]
 22%|██▏       | 81304/371472 [6:27:59<22:48:38,  3.53it/s]
 22%|██▏       | 81305/371472 [6:27:59<22:31:15,  3.58it/s]
 22%|██▏       | 81306/371472 [6:27:59<22:47:29,  3.54it/s]
 22%|██▏       | 81307/371472 [6:27:59<24:03:08,  3.35it/s]
 22%|██▏       | 81308/371472 [6:28:00<23:03:56,  3.49it/s]
 22%|██▏       | 81309/371472 [6:28:00<22:15:47,  3.62it/s]
 22%|██▏       | 81310/371472 [6:28:00<22:06:43,  3.65it/s]
 22%|██▏       | 81311/371472 [6:28:00<21:29:25,  3.75it/s]
 22%|██▏       | 81312/371472 [6:28:01<21:07:20,  3.82it/s]
 22%|██▏       | 81313/371472 [6:28:01<21:10:48,  3.81it/s]
 22%|██▏       | 81314/371472 [6:28:01<21:08:07,  3.81it/s]
 22%|██▏       | 81315/371472 [6:28:02<20:55:02,  3.85it/s]
 22%|██▏       | 81316/371472 [6:28:02<22:42:52,  3.55it/s]
 22%|██▏       | 81317/371472 [6:28:02<23:27:00,  3.44it/s]
 22%|██▏       | 81318/371472 [6:28:02<22:59:35,  3.51it/s]
 22%|██▏       | 81319/371472 [6:28:03<23:40:20,  3.40it/s]
 22%|██▏       | 81320/371472 [6:28:03<23:39:13,  3.41it/s]
                                                           
{'loss': 4.0108, 'learning_rate': 8.033571074576052e-07, 'epoch': 3.5}

 22%|██▏       | 81320/371472 [6:28:03<23:39:13,  3.41it/s]
 22%|██▏       | 81321/371472 [6:28:03<23:01:33,  3.50it/s]
 22%|██▏       | 81322/371472 [6:28:04<22:36:48,  3.56it/s]
 22%|██▏       | 81323/371472 [6:28:04<22:57:06,  3.51it/s]
 22%|██▏       | 81324/371472 [6:28:04<24:02:21,  3.35it/s]
 22%|██▏       | 81325/371472 [6:28:04<24:10:40,  3.33it/s]
 22%|██▏       | 81326/371472 [6:28:05<22:59:12,  3.51it/s]
 22%|██▏       | 81327/371472 [6:28:05<22:16:00,  3.62it/s]
 22%|██▏       | 81328/371472 [6:28:05<23:32:11,  3.42it/s]
 22%|██▏       | 81329/371472 [6:28:06<23:17:48,  3.46it/s]
 22%|██▏       | 81330/371472 [6:28:06<25:14:36,  3.19it/s]
 22%|██▏       | 81331/371472 [6:28:06<23:49:05,  3.38it/s]
 22%|██▏       | 81332/371472 [6:28:06<22:26:03,  3.59it/s]
 22%|██▏       | 81333/371472 [6:28:07<22:19:19,  3.61it/s]
 22%|██▏       | 81334/371472 [6:28:07<21:52:40,  3.68it/s]
 22%|██▏       | 81335/371472 [6:28:07<21:35:06,  3.73it/s]
 22%|██▏       | 81336/371472 [6:28:08<22:18:26,  3.61it/s]
 22%|██▏       | 81337/371472 [6:28:08<22:06:46,  3.64it/s]
 22%|██▏       | 81338/371472 [6:28:08<21:35:33,  3.73it/s]
 22%|██▏       | 81339/371472 [6:28:08<21:44:53,  3.71it/s]
 22%|██▏       | 81340/371472 [6:28:09<23:44:38,  3.39it/s]
                                                           
{'loss': 4.133, 'learning_rate': 8.033086254821262e-07, 'epoch': 3.5}

 22%|██▏       | 81340/371472 [6:28:09<23:44:38,  3.39it/s]
 22%|██▏       | 81341/371472 [6:28:09<22:43:13,  3.55it/s]
 22%|██▏       | 81342/371472 [6:28:09<23:16:41,  3.46it/s]
 22%|██▏       | 81343/371472 [6:28:10<23:05:54,  3.49it/s]
 22%|██▏       | 81344/371472 [6:28:10<22:37:00,  3.56it/s]
 22%|██▏       | 81345/371472 [6:28:10<21:44:58,  3.71it/s]
 22%|██▏       | 81346/371472 [6:28:10<22:28:45,  3.59it/s]
 22%|██▏       | 81347/371472 [6:28:11<21:36:21,  3.73it/s]
 22%|██▏       | 81348/371472 [6:28:11<22:01:32,  3.66it/s]
 22%|██▏       | 81349/371472 [6:28:11<22:23:59,  3.60it/s]
 22%|██▏       | 81350/371472 [6:28:11<21:42:00,  3.71it/s]
 22%|██▏       | 81351/371472 [6:28:12<21:28:12,  3.75it/s]
 22%|██▏       | 81352/371472 [6:28:12<21:45:57,  3.70it/s]
 22%|██▏       | 81353/371472 [6:28:12<21:16:01,  3.79it/s]
 22%|██▏       | 81354/371472 [6:28:12<20:50:59,  3.87it/s]
 22%|██▏       | 81355/371472 [6:28:13<21:30:54,  3.75it/s]
 22%|██▏       | 81356/371472 [6:28:13<21:44:50,  3.71it/s]
 22%|██▏       | 81357/371472 [6:28:13<21:19:26,  3.78it/s]
 22%|██▏       | 81358/371472 [6:28:14<22:32:27,  3.58it/s]
 22%|██▏       | 81359/371472 [6:28:14<23:21:39,  3.45it/s]
 22%|██▏       | 81360/371472 [6:28:14<24:23:05,  3.30it/s]
                                                           
{'loss': 4.1074, 'learning_rate': 8.032601435066474e-07, 'epoch': 3.5}

 22%|██▏       | 81360/371472 [6:28:14<24:23:05,  3.30it/s]
 22%|██▏       | 81361/371472 [6:28:15<24:38:30,  3.27it/s]
 22%|██▏       | 81362/371472 [6:28:15<23:59:48,  3.36it/s]
 22%|██▏       | 81363/371472 [6:28:15<23:22:41,  3.45it/s]
 22%|██▏       | 81364/371472 [6:28:15<23:52:55,  3.37it/s]
 22%|██▏       | 81365/371472 [6:28:16<23:47:37,  3.39it/s]
 22%|██▏       | 81366/371472 [6:28:16<23:39:34,  3.41it/s]
 22%|██▏       | 81367/371472 [6:28:16<24:31:10,  3.29it/s]
 22%|██▏       | 81368/371472 [6:28:17<24:29:37,  3.29it/s]
 22%|██▏       | 81369/371472 [6:28:17<23:57:20,  3.36it/s]
 22%|██▏       | 81370/371472 [6:28:17<24:00:40,  3.36it/s]
 22%|██▏       | 81371/371472 [6:28:17<23:00:05,  3.50it/s]
 22%|██▏       | 81372/371472 [6:28:18<21:57:34,  3.67it/s]
 22%|██▏       | 81373/371472 [6:28:18<22:01:43,  3.66it/s]
 22%|██▏       | 81374/371472 [6:28:18<22:10:54,  3.63it/s]
 22%|██▏       | 81375/371472 [6:28:19<21:41:18,  3.72it/s]
 22%|██▏       | 81376/371472 [6:28:19<21:06:12,  3.82it/s]
 22%|██▏       | 81377/371472 [6:28:19<20:53:04,  3.86it/s]
 22%|██▏       | 81378/371472 [6:28:19<21:25:01,  3.76it/s]
 22%|██▏       | 81379/371472 [6:28:20<21:40:24,  3.72it/s]
 22%|██▏       | 81380/371472 [6:28:20<21:19:29,  3.78it/s]
                                                           
{'loss': 3.9485, 'learning_rate': 8.032116615311685e-07, 'epoch': 3.51}

 22%|██▏       | 81380/371472 [6:28:20<21:19:29,  3.78it/s]
 22%|██▏       | 81381/371472 [6:28:20<21:17:41,  3.78it/s]
 22%|██▏       | 81382/371472 [6:28:20<21:43:33,  3.71it/s]
 22%|██▏       | 81383/371472 [6:28:21<22:08:15,  3.64it/s]
 22%|██▏       | 81384/371472 [6:28:21<22:06:57,  3.64it/s]
 22%|██▏       | 81385/371472 [6:28:21<23:35:33,  3.42it/s]
 22%|██▏       | 81386/371472 [6:28:22<22:25:21,  3.59it/s]
 22%|██▏       | 81387/371472 [6:28:22<21:41:39,  3.71it/s]
 22%|██▏       | 81388/371472 [6:28:22<22:43:01,  3.55it/s]
 22%|██▏       | 81389/371472 [6:28:22<22:23:36,  3.60it/s]
 22%|██▏       | 81390/371472 [6:28:23<22:24:00,  3.60it/s]
 22%|██▏       | 81391/371472 [6:28:23<22:29:24,  3.58it/s]
 22%|██▏       | 81392/371472 [6:28:23<24:25:43,  3.30it/s]
 22%|██▏       | 81393/371472 [6:28:24<25:03:14,  3.22it/s]
 22%|██▏       | 81394/371472 [6:28:24<24:06:35,  3.34it/s]
 22%|██▏       | 81395/371472 [6:28:24<22:44:39,  3.54it/s]
 22%|██▏       | 81396/371472 [6:28:24<22:37:28,  3.56it/s]
 22%|██▏       | 81397/371472 [6:28:25<22:25:10,  3.59it/s]
 22%|██▏       | 81398/371472 [6:28:25<21:43:04,  3.71it/s]
 22%|██▏       | 81399/371472 [6:28:25<22:12:30,  3.63it/s]
 22%|██▏       | 81400/371472 [6:28:25<21:21:57,  3.77it/s]
                                                           
{'loss': 4.1104, 'learning_rate': 8.031631795556897e-07, 'epoch': 3.51}

 22%|██▏       | 81400/371472 [6:28:25<21:21:57,  3.77it/s]
 22%|██▏       | 81401/371472 [6:28:26<21:56:10,  3.67it/s]
 22%|██▏       | 81402/371472 [6:28:26<23:00:08,  3.50it/s]
 22%|██▏       | 81403/371472 [6:28:26<22:22:07,  3.60it/s]
 22%|██▏       | 81404/371472 [6:28:27<22:25:50,  3.59it/s]
 22%|██▏       | 81405/371472 [6:28:27<22:24:56,  3.59it/s]
 22%|██▏       | 81406/371472 [6:28:27<23:14:49,  3.47it/s]
 22%|██▏       | 81407/371472 [6:28:27<23:23:55,  3.44it/s]
 22%|██▏       | 81408/371472 [6:28:28<23:13:27,  3.47it/s]
 22%|██▏       | 81409/371472 [6:28:28<22:34:07,  3.57it/s]
 22%|██▏       | 81410/371472 [6:28:28<23:22:59,  3.45it/s]
 22%|██▏       | 81411/371472 [6:28:29<22:59:56,  3.50it/s]
 22%|██▏       | 81412/371472 [6:28:29<22:00:01,  3.66it/s]
 22%|██▏       | 81413/371472 [6:28:29<22:12:03,  3.63it/s]
 22%|██▏       | 81414/371472 [6:28:29<22:20:42,  3.61it/s]
 22%|██▏       | 81415/371472 [6:28:30<21:32:08,  3.74it/s]
 22%|██▏       | 81416/371472 [6:28:30<21:14:26,  3.79it/s]
 22%|██▏       | 81417/371472 [6:28:30<23:19:33,  3.45it/s]
 22%|██▏       | 81418/371472 [6:28:31<24:38:28,  3.27it/s]
 22%|██▏       | 81419/371472 [6:28:31<23:49:01,  3.38it/s]
 22%|██▏       | 81420/371472 [6:28:31<23:06:01,  3.49it/s]
                                                           
{'loss': 4.1912, 'learning_rate': 8.031146975802107e-07, 'epoch': 3.51}

 22%|██▏       | 81420/371472 [6:28:31<23:06:01,  3.49it/s]
 22%|██▏       | 81421/371472 [6:28:31<23:28:33,  3.43it/s]
 22%|██▏       | 81422/371472 [6:28:32<24:36:14,  3.27it/s]
 22%|██▏       | 81423/371472 [6:28:32<23:11:28,  3.47it/s]
 22%|██▏       | 81424/371472 [6:28:32<22:23:58,  3.60it/s]
 22%|██▏       | 81425/371472 [6:28:33<21:40:38,  3.72it/s]
 22%|██▏       | 81426/371472 [6:28:33<21:39:52,  3.72it/s]
 22%|██▏       | 81427/371472 [6:28:33<21:42:44,  3.71it/s]
 22%|██▏       | 81428/371472 [6:28:33<22:39:21,  3.56it/s]
 22%|██▏       | 81429/371472 [6:28:34<24:15:11,  3.32it/s]
 22%|██▏       | 81430/371472 [6:28:34<23:08:32,  3.48it/s]
 22%|██▏       | 81431/371472 [6:28:34<22:39:22,  3.56it/s]
 22%|██▏       | 81432/371472 [6:28:35<26:31:07,  3.04it/s]
 22%|██▏       | 81433/371472 [6:28:35<26:41:25,  3.02it/s]
 22%|██▏       | 81434/371472 [6:28:35<24:58:06,  3.23it/s]
 22%|██▏       | 81435/371472 [6:28:36<25:36:08,  3.15it/s]
 22%|██▏       | 81436/371472 [6:28:36<25:48:47,  3.12it/s]
 22%|██▏       | 81437/371472 [6:28:36<25:22:34,  3.17it/s]
 22%|██▏       | 81438/371472 [6:28:36<23:40:46,  3.40it/s]
 22%|██▏       | 81439/371472 [6:28:37<23:51:34,  3.38it/s]
 22%|██▏       | 81440/371472 [6:28:37<23:23:44,  3.44it/s]
                                                           
{'loss': 4.0675, 'learning_rate': 8.030662156047318e-07, 'epoch': 3.51}

 22%|██▏       | 81440/371472 [6:28:37<23:23:44,  3.44it/s]
 22%|██▏       | 81441/371472 [6:28:37<24:13:44,  3.33it/s]
 22%|██▏       | 81442/371472 [6:28:38<25:08:49,  3.20it/s]
 22%|██▏       | 81443/371472 [6:28:38<25:47:25,  3.12it/s]
 22%|██▏       | 81444/371472 [6:28:38<26:20:49,  3.06it/s]
 22%|██▏       | 81445/371472 [6:28:39<25:53:11,  3.11it/s]
 22%|██▏       | 81446/371472 [6:28:39<24:52:20,  3.24it/s]
 22%|██▏       | 81447/371472 [6:28:39<23:57:17,  3.36it/s]
 22%|██▏       | 81448/371472 [6:28:40<25:17:00,  3.19it/s]
 22%|██▏       | 81449/371472 [6:28:40<25:48:22,  3.12it/s]
 22%|██▏       | 81450/371472 [6:28:40<24:36:18,  3.27it/s]
 22%|██▏       | 81451/371472 [6:28:40<23:25:19,  3.44it/s]
 22%|██▏       | 81452/371472 [6:28:41<22:22:37,  3.60it/s]
 22%|██▏       | 81453/371472 [6:28:41<22:27:53,  3.59it/s]
 22%|██▏       | 81454/371472 [6:28:41<21:46:13,  3.70it/s]
 22%|██▏       | 81455/371472 [6:28:42<21:23:01,  3.77it/s]
 22%|██▏       | 81456/371472 [6:28:42<21:14:51,  3.79it/s]
 22%|██▏       | 81457/371472 [6:28:42<22:46:48,  3.54it/s]
 22%|██▏       | 81458/371472 [6:28:42<23:40:02,  3.40it/s]
 22%|██▏       | 81459/371472 [6:28:43<22:33:51,  3.57it/s]
 22%|██▏       | 81460/371472 [6:28:43<22:18:49,  3.61it/s]
                                                           
{'loss': 4.0326, 'learning_rate': 8.030177336292529e-07, 'epoch': 3.51}

 22%|██▏       | 81460/371472 [6:28:43<22:18:49,  3.61it/s]
 22%|██▏       | 81461/371472 [6:28:43<23:13:02,  3.47it/s]
 22%|██▏       | 81462/371472 [6:28:44<22:36:12,  3.56it/s]
 22%|██▏       | 81463/371472 [6:28:44<22:37:58,  3.56it/s]
 22%|██▏       | 81464/371472 [6:28:44<24:24:14,  3.30it/s]
 22%|██▏       | 81465/371472 [6:28:44<23:51:57,  3.38it/s]
 22%|██▏       | 81466/371472 [6:28:45<23:18:39,  3.46it/s]
 22%|██▏       | 81467/371472 [6:28:45<22:36:27,  3.56it/s]
 22%|██▏       | 81468/371472 [6:28:45<22:43:33,  3.54it/s]
 22%|██▏       | 81469/371472 [6:28:46<22:28:31,  3.58it/s]
 22%|██▏       | 81470/371472 [6:28:46<22:33:39,  3.57it/s]
 22%|██▏       | 81471/371472 [6:28:46<22:42:23,  3.55it/s]
 22%|██▏       | 81472/371472 [6:28:46<23:03:11,  3.49it/s]
 22%|██▏       | 81473/371472 [6:28:47<23:55:19,  3.37it/s]
 22%|██▏       | 81474/371472 [6:28:47<23:20:05,  3.45it/s]
 22%|██▏       | 81475/371472 [6:28:47<23:07:31,  3.48it/s]
 22%|██▏       | 81476/371472 [6:28:48<24:20:32,  3.31it/s]
 22%|██▏       | 81477/371472 [6:28:48<25:35:35,  3.15it/s]
 22%|██▏       | 81478/371472 [6:28:48<24:46:49,  3.25it/s]
 22%|██▏       | 81479/371472 [6:28:49<24:56:47,  3.23it/s]
 22%|██▏       | 81480/371472 [6:28:49<24:44:26,  3.26it/s]
                                                           
{'loss': 3.8711, 'learning_rate': 8.029692516537739e-07, 'epoch': 3.51}

 22%|██▏       | 81480/371472 [6:28:49<24:44:26,  3.26it/s]
 22%|██▏       | 81481/371472 [6:28:49<24:04:00,  3.35it/s]
 22%|██▏       | 81482/371472 [6:28:49<24:11:58,  3.33it/s]
 22%|██▏       | 81483/371472 [6:28:50<24:14:25,  3.32it/s]
 22%|██▏       | 81484/371472 [6:28:50<23:43:54,  3.39it/s]
 22%|██▏       | 81485/371472 [6:28:50<22:18:01,  3.61it/s]
 22%|██▏       | 81486/371472 [6:28:51<21:38:40,  3.72it/s]
 22%|██▏       | 81487/371472 [6:28:51<22:00:05,  3.66it/s]
 22%|██▏       | 81488/371472 [6:28:51<21:18:01,  3.78it/s]
 22%|██▏       | 81489/371472 [6:28:51<21:53:19,  3.68it/s]
 22%|██▏       | 81490/371472 [6:28:52<21:17:58,  3.78it/s]
 22%|██▏       | 81491/371472 [6:28:52<20:49:08,  3.87it/s]
 22%|██▏       | 81492/371472 [6:28:52<21:46:04,  3.70it/s]
 22%|██▏       | 81493/371472 [6:28:52<23:17:16,  3.46it/s]
 22%|██▏       | 81494/371472 [6:28:53<23:32:45,  3.42it/s]
 22%|██▏       | 81495/371472 [6:28:53<23:04:25,  3.49it/s]
 22%|██▏       | 81496/371472 [6:28:53<22:38:19,  3.56it/s]
 22%|██▏       | 81497/371472 [6:28:54<22:07:56,  3.64it/s]
 22%|██▏       | 81498/371472 [6:28:54<22:09:07,  3.64it/s]
 22%|██▏       | 81499/371472 [6:28:54<22:10:22,  3.63it/s]
 22%|██▏       | 81500/371472 [6:28:54<23:56:17,  3.36it/s]
                                                           
{'loss': 4.0017, 'learning_rate': 8.029207696782951e-07, 'epoch': 3.51}

 22%|██▏       | 81500/371472 [6:28:54<23:56:17,  3.36it/s]
 22%|██▏       | 81501/371472 [6:28:55<24:38:27,  3.27it/s]
 22%|██▏       | 81502/371472 [6:28:55<23:12:18,  3.47it/s]
 22%|██▏       | 81503/371472 [6:28:55<23:57:51,  3.36it/s]
 22%|██▏       | 81504/371472 [6:28:56<23:27:45,  3.43it/s]
 22%|██▏       | 81505/371472 [6:28:56<22:56:03,  3.51it/s]
 22%|██▏       | 81506/371472 [6:28:56<21:58:31,  3.67it/s]
 22%|██▏       | 81507/371472 [6:28:56<21:29:07,  3.75it/s]
 22%|██▏       | 81508/371472 [6:28:57<21:13:00,  3.80it/s]
 22%|██▏       | 81509/371472 [6:28:57<21:43:55,  3.71it/s]
 22%|██▏       | 81510/371472 [6:28:57<22:53:46,  3.52it/s]
 22%|██▏       | 81511/371472 [6:28:58<22:30:53,  3.58it/s]
 22%|██▏       | 81512/371472 [6:28:58<22:06:40,  3.64it/s]
 22%|██▏       | 81513/371472 [6:28:58<22:40:21,  3.55it/s]
 22%|██▏       | 81514/371472 [6:28:58<22:47:50,  3.53it/s]
 22%|██▏       | 81515/371472 [6:28:59<22:00:09,  3.66it/s]
 22%|██▏       | 81516/371472 [6:28:59<23:19:18,  3.45it/s]
 22%|██▏       | 81517/371472 [6:28:59<22:45:04,  3.54it/s]
 22%|██▏       | 81518/371472 [6:28:59<22:44:31,  3.54it/s]
 22%|██▏       | 81519/371472 [6:29:00<22:20:11,  3.61it/s]
 22%|██▏       | 81520/371472 [6:29:00<22:51:21,  3.52it/s]
                                                           
{'loss': 4.1761, 'learning_rate': 8.028722877028163e-07, 'epoch': 3.51}

 22%|██▏       | 81520/371472 [6:29:00<22:51:21,  3.52it/s]
 22%|██▏       | 81521/371472 [6:29:00<24:01:48,  3.35it/s]
 22%|██▏       | 81522/371472 [6:29:01<25:03:58,  3.21it/s]
 22%|██▏       | 81523/371472 [6:29:01<24:32:08,  3.28it/s]
 22%|██▏       | 81524/371472 [6:29:01<23:51:57,  3.37it/s]
 22%|██▏       | 81525/371472 [6:29:02<22:57:22,  3.51it/s]
 22%|██▏       | 81526/371472 [6:29:02<21:56:24,  3.67it/s]
 22%|██▏       | 81527/371472 [6:29:02<22:12:09,  3.63it/s]
 22%|██▏       | 81528/371472 [6:29:02<23:01:32,  3.50it/s]
 22%|██▏       | 81529/371472 [6:29:03<21:41:02,  3.71it/s]
 22%|██▏       | 81530/371472 [6:29:03<24:09:12,  3.33it/s]
 22%|██▏       | 81531/371472 [6:29:03<24:26:59,  3.29it/s]
 22%|██▏       | 81532/371472 [6:29:04<23:35:34,  3.41it/s]
 22%|██▏       | 81533/371472 [6:29:04<23:43:36,  3.39it/s]
 22%|██▏       | 81534/371472 [6:29:04<22:50:59,  3.52it/s]
 22%|██▏       | 81535/371472 [6:29:04<22:20:34,  3.60it/s]
 22%|██▏       | 81536/371472 [6:29:05<22:05:28,  3.65it/s]
 22%|██▏       | 81537/371472 [6:29:05<23:00:03,  3.50it/s]
 22%|██▏       | 81538/371472 [6:29:05<22:44:20,  3.54it/s]
 22%|██▏       | 81539/371472 [6:29:06<23:07:54,  3.48it/s]
 22%|██▏       | 81540/371472 [6:29:06<23:12:02,  3.47it/s]
                                                           
{'loss': 4.0444, 'learning_rate': 8.028238057273374e-07, 'epoch': 3.51}

 22%|██▏       | 81540/371472 [6:29:06<23:12:02,  3.47it/s]
 22%|██▏       | 81541/371472 [6:29:06<23:23:23,  3.44it/s]
 22%|██▏       | 81542/371472 [6:29:06<22:56:28,  3.51it/s]
 22%|██▏       | 81543/371472 [6:29:07<22:10:28,  3.63it/s]
 22%|██▏       | 81544/371472 [6:29:07<21:34:39,  3.73it/s]
 22%|██▏       | 81545/371472 [6:29:07<22:19:36,  3.61it/s]
 22%|██▏       | 81546/371472 [6:29:07<22:26:34,  3.59it/s]
 22%|██▏       | 81547/371472 [6:29:08<22:20:28,  3.60it/s]
 22%|██▏       | 81548/371472 [6:29:08<21:20:47,  3.77it/s]
 22%|██▏       | 81549/371472 [6:29:08<22:39:03,  3.56it/s]
 22%|██▏       | 81550/371472 [6:29:09<22:38:47,  3.56it/s]
 22%|██▏       | 81551/371472 [6:29:09<22:15:23,  3.62it/s]
 22%|██▏       | 81552/371472 [6:29:09<22:11:12,  3.63it/s]
 22%|██▏       | 81553/371472 [6:29:09<21:30:59,  3.74it/s]
 22%|██▏       | 81554/371472 [6:29:10<21:49:30,  3.69it/s]
 22%|██▏       | 81555/371472 [6:29:10<21:09:49,  3.81it/s]
 22%|██▏       | 81556/371472 [6:29:10<21:14:04,  3.79it/s]
 22%|██▏       | 81557/371472 [6:29:10<21:02:40,  3.83it/s]
 22%|██▏       | 81558/371472 [6:29:11<22:57:18,  3.51it/s]
 22%|██▏       | 81559/371472 [6:29:11<22:08:18,  3.64it/s]
 22%|██▏       | 81560/371472 [6:29:11<21:56:19,  3.67it/s]
                                                           
{'loss': 4.0998, 'learning_rate': 8.027753237518584e-07, 'epoch': 3.51}

 22%|██▏       | 81560/371472 [6:29:11<21:56:19,  3.67it/s]
 22%|██▏       | 81561/371472 [6:29:12<24:06:06,  3.34it/s]
 22%|██▏       | 81562/371472 [6:29:12<23:06:50,  3.48it/s]
 22%|██▏       | 81563/371472 [6:29:12<22:04:43,  3.65it/s]
 22%|██▏       | 81564/371472 [6:29:12<21:17:07,  3.78it/s]
 22%|██▏       | 81565/371472 [6:29:13<20:49:25,  3.87it/s]
 22%|██▏       | 81566/371472 [6:29:13<20:48:17,  3.87it/s]
 22%|██▏       | 81567/371472 [6:29:13<22:28:56,  3.58it/s]
 22%|██▏       | 81568/371472 [6:29:13<22:25:59,  3.59it/s]
 22%|██▏       | 81569/371472 [6:29:14<21:59:20,  3.66it/s]
 22%|██▏       | 81570/371472 [6:29:14<21:38:27,  3.72it/s]
 22%|██▏       | 81571/371472 [6:29:14<21:26:10,  3.76it/s]
 22%|██▏       | 81572/371472 [6:29:15<21:27:12,  3.75it/s]
 22%|██▏       | 81573/371472 [6:29:15<22:43:02,  3.54it/s]
 22%|██▏       | 81574/371472 [6:29:15<23:11:43,  3.47it/s]
 22%|██▏       | 81575/371472 [6:29:15<23:48:25,  3.38it/s]
 22%|██▏       | 81576/371472 [6:29:16<22:36:36,  3.56it/s]
 22%|██▏       | 81577/371472 [6:29:16<23:32:05,  3.42it/s]
 22%|██▏       | 81578/371472 [6:29:16<25:54:10,  3.11it/s]
 22%|██▏       | 81579/371472 [6:29:17<24:45:30,  3.25it/s]
 22%|██▏       | 81580/371472 [6:29:17<24:04:28,  3.34it/s]
                                                           
{'loss': 4.1265, 'learning_rate': 8.027268417763795e-07, 'epoch': 3.51}

 22%|██▏       | 81580/371472 [6:29:17<24:04:28,  3.34it/s]
 22%|██▏       | 81581/371472 [6:29:17<23:53:33,  3.37it/s]
 22%|██▏       | 81582/371472 [6:29:18<22:33:43,  3.57it/s]
 22%|██▏       | 81583/371472 [6:29:18<22:02:06,  3.65it/s]
 22%|██▏       | 81584/371472 [6:29:18<24:08:41,  3.34it/s]
 22%|██▏       | 81585/371472 [6:29:18<23:54:10,  3.37it/s]
 22%|██▏       | 81586/371472 [6:29:19<22:30:30,  3.58it/s]
 22%|██▏       | 81587/371472 [6:29:19<22:33:00,  3.57it/s]
 22%|██▏       | 81588/371472 [6:29:19<22:54:39,  3.51it/s]
 22%|██▏       | 81589/371472 [6:29:20<22:40:33,  3.55it/s]
 22%|██▏       | 81590/371472 [6:29:20<23:18:23,  3.45it/s]
 22%|██▏       | 81591/371472 [6:29:20<23:17:02,  3.46it/s]
 22%|██▏       | 81592/371472 [6:29:20<22:15:06,  3.62it/s]
 22%|██▏       | 81593/371472 [6:29:21<22:23:20,  3.60it/s]
 22%|██▏       | 81594/371472 [6:29:21<21:53:23,  3.68it/s]
 22%|██▏       | 81595/371472 [6:29:21<21:17:14,  3.78it/s]
 22%|██▏       | 81596/371472 [6:29:21<21:36:09,  3.73it/s]
 22%|██▏       | 81597/371472 [6:29:22<24:53:32,  3.23it/s]
 22%|██▏       | 81598/371472 [6:29:22<26:10:17,  3.08it/s]
 22%|██▏       | 81599/371472 [6:29:22<25:19:52,  3.18it/s]
 22%|██▏       | 81600/371472 [6:29:23<25:42:07,  3.13it/s]
                                                           
{'loss': 4.1821, 'learning_rate': 8.026783598009007e-07, 'epoch': 3.51}

 22%|██▏       | 81600/371472 [6:29:23<25:42:07,  3.13it/s]
 22%|██▏       | 81601/371472 [6:29:23<24:36:06,  3.27it/s]
 22%|██▏       | 81602/371472 [6:29:23<25:20:28,  3.18it/s]
 22%|██▏       | 81603/371472 [6:29:24<24:48:45,  3.25it/s]
 22%|██▏       | 81604/371472 [6:29:24<23:58:36,  3.36it/s]
 22%|██▏       | 81605/371472 [6:29:24<22:56:53,  3.51it/s]
 22%|██▏       | 81606/371472 [6:29:24<22:02:19,  3.65it/s]
 22%|██▏       | 81607/371472 [6:29:25<21:55:47,  3.67it/s]
 22%|██▏       | 81608/371472 [6:29:25<23:42:14,  3.40it/s]
 22%|██▏       | 81609/371472 [6:29:25<22:52:30,  3.52it/s]
 22%|██▏       | 81610/371472 [6:29:26<22:07:29,  3.64it/s]
 22%|██▏       | 81611/371472 [6:29:26<21:16:06,  3.79it/s]
 22%|██▏       | 81612/371472 [6:29:26<22:16:12,  3.62it/s]
 22%|██▏       | 81613/371472 [6:29:26<22:40:54,  3.55it/s]
 22%|██▏       | 81614/371472 [6:29:27<23:30:22,  3.43it/s]
 22%|██▏       | 81615/371472 [6:29:27<22:49:19,  3.53it/s]
 22%|██▏       | 81616/371472 [6:29:27<22:34:53,  3.57it/s]
 22%|██▏       | 81617/371472 [6:29:28<21:53:58,  3.68it/s]
 22%|██▏       | 81618/371472 [6:29:28<21:18:29,  3.78it/s]
 22%|██▏       | 81619/371472 [6:29:28<22:33:19,  3.57it/s]
 22%|██▏       | 81620/371472 [6:29:28<22:19:36,  3.61it/s]
                                                           
{'loss': 3.9004, 'learning_rate': 8.026298778254218e-07, 'epoch': 3.52}

 22%|██▏       | 81620/371472 [6:29:28<22:19:36,  3.61it/s]
 22%|██▏       | 81621/371472 [6:29:29<21:51:53,  3.68it/s]
 22%|██▏       | 81622/371472 [6:29:29<21:43:04,  3.71it/s]
 22%|██▏       | 81623/371472 [6:29:29<21:36:10,  3.73it/s]
 22%|██▏       | 81624/371472 [6:29:29<21:00:09,  3.83it/s]
 22%|██▏       | 81625/371472 [6:29:30<23:00:11,  3.50it/s]
 22%|██▏       | 81626/371472 [6:29:30<21:59:41,  3.66it/s]
 22%|██▏       | 81627/371472 [6:29:30<21:53:07,  3.68it/s]
 22%|██▏       | 81628/371472 [6:29:31<22:42:58,  3.54it/s]
 22%|██▏       | 81629/371472 [6:29:31<21:46:55,  3.70it/s]
 22%|██▏       | 81630/371472 [6:29:31<21:50:51,  3.69it/s]
 22%|██▏       | 81631/371472 [6:29:31<22:36:39,  3.56it/s]
 22%|██▏       | 81632/371472 [6:29:32<24:32:46,  3.28it/s]
 22%|██▏       | 81633/371472 [6:29:32<27:03:02,  2.98it/s]
 22%|██▏       | 81634/371472 [6:29:32<25:37:11,  3.14it/s]
 22%|██▏       | 81635/371472 [6:29:33<24:55:21,  3.23it/s]
 22%|██▏       | 81636/371472 [6:29:33<24:01:26,  3.35it/s]
 22%|██▏       | 81637/371472 [6:29:33<23:12:31,  3.47it/s]
 22%|██▏       | 81638/371472 [6:29:34<22:24:54,  3.59it/s]
 22%|██▏       | 81639/371472 [6:29:34<22:42:19,  3.55it/s]
 22%|██▏       | 81640/371472 [6:29:34<22:32:55,  3.57it/s]
                                                           
{'loss': 4.1587, 'learning_rate': 8.025813958499427e-07, 'epoch': 3.52}

 22%|██▏       | 81640/371472 [6:29:34<22:32:55,  3.57it/s]
 22%|██▏       | 81641/371472 [6:29:34<21:39:08,  3.72it/s]
 22%|██▏       | 81642/371472 [6:29:35<21:10:16,  3.80it/s]
 22%|██▏       | 81643/371472 [6:29:35<21:40:01,  3.72it/s]
 22%|██▏       | 81644/371472 [6:29:35<22:01:21,  3.66it/s]
 22%|██▏       | 81645/371472 [6:29:35<21:56:10,  3.67it/s]
 22%|██▏       | 81646/371472 [6:29:36<22:35:03,  3.56it/s]
 22%|██▏       | 81647/371472 [6:29:36<23:39:13,  3.40it/s]
 22%|██▏       | 81648/371472 [6:29:36<22:31:15,  3.57it/s]
 22%|██▏       | 81649/371472 [6:29:37<22:43:34,  3.54it/s]
 22%|██▏       | 81650/371472 [6:29:37<21:57:46,  3.67it/s]
 22%|██▏       | 81651/371472 [6:29:37<22:19:03,  3.61it/s]
 22%|██▏       | 81652/371472 [6:29:37<22:27:35,  3.58it/s]
 22%|██▏       | 81653/371472 [6:29:38<22:28:20,  3.58it/s]
 22%|██▏       | 81654/371472 [6:29:38<22:15:12,  3.62it/s]
 22%|██▏       | 81655/371472 [6:29:38<23:05:07,  3.49it/s]
 22%|██▏       | 81656/371472 [6:29:39<22:18:01,  3.61it/s]
 22%|██▏       | 81657/371472 [6:29:39<21:39:10,  3.72it/s]
 22%|██▏       | 81658/371472 [6:29:39<22:15:26,  3.62it/s]
 22%|██▏       | 81659/371472 [6:29:39<22:07:03,  3.64it/s]
 22%|██▏       | 81660/371472 [6:29:40<24:18:51,  3.31it/s]
                                                           
{'loss': 4.0986, 'learning_rate': 8.02532913874464e-07, 'epoch': 3.52}

 22%|██▏       | 81660/371472 [6:29:40<24:18:51,  3.31it/s]
 22%|██▏       | 81661/371472 [6:29:40<24:11:32,  3.33it/s]
 22%|██▏       | 81662/371472 [6:29:40<23:31:30,  3.42it/s]
 22%|██▏       | 81663/371472 [6:29:41<23:12:19,  3.47it/s]
 22%|██▏       | 81664/371472 [6:29:41<24:43:02,  3.26it/s]
 22%|██▏       | 81665/371472 [6:29:41<23:28:30,  3.43it/s]
 22%|██▏       | 81666/371472 [6:29:41<22:58:08,  3.50it/s]
 22%|██▏       | 81667/371472 [6:29:42<22:19:45,  3.61it/s]
 22%|██▏       | 81668/371472 [6:29:42<22:46:02,  3.54it/s]
 22%|██▏       | 81669/371472 [6:29:42<23:11:36,  3.47it/s]
 22%|██▏       | 81670/371472 [6:29:43<22:25:27,  3.59it/s]
 22%|██▏       | 81671/371472 [6:29:43<22:18:07,  3.61it/s]
 22%|██▏       | 81672/371472 [6:29:43<21:56:18,  3.67it/s]
 22%|██▏       | 81673/371472 [6:29:43<21:40:28,  3.71it/s]
 22%|██▏       | 81674/371472 [6:29:44<21:25:35,  3.76it/s]
 22%|██▏       | 81675/371472 [6:29:44<22:33:18,  3.57it/s]
 22%|██▏       | 81676/371472 [6:29:44<22:15:40,  3.62it/s]
 22%|██▏       | 81677/371472 [6:29:44<21:39:41,  3.72it/s]
 22%|██▏       | 81678/371472 [6:29:45<21:04:01,  3.82it/s]
 22%|██▏       | 81679/371472 [6:29:45<22:48:38,  3.53it/s]
 22%|██▏       | 81680/371472 [6:29:45<21:34:07,  3.73it/s]
                                                           
{'loss': 4.1177, 'learning_rate': 8.024844318989851e-07, 'epoch': 3.52}

 22%|██▏       | 81680/371472 [6:29:45<21:34:07,  3.73it/s]
 22%|██▏       | 81681/371472 [6:29:46<21:35:30,  3.73it/s]
 22%|██▏       | 81682/371472 [6:29:46<22:35:37,  3.56it/s]
 22%|██▏       | 81683/371472 [6:29:46<21:55:15,  3.67it/s]
 22%|██▏       | 81684/371472 [6:29:46<21:21:15,  3.77it/s]
 22%|██▏       | 81685/371472 [6:29:47<21:24:25,  3.76it/s]
 22%|██▏       | 81686/371472 [6:29:47<21:45:16,  3.70it/s]
 22%|██▏       | 81687/371472 [6:29:47<22:28:48,  3.58it/s]
 22%|██▏       | 81688/371472 [6:29:47<22:25:11,  3.59it/s]
 22%|██▏       | 81689/371472 [6:29:48<22:17:16,  3.61it/s]
 22%|██▏       | 81690/371472 [6:29:48<22:37:28,  3.56it/s]
 22%|██▏       | 81691/371472 [6:29:48<22:27:35,  3.58it/s]
 22%|██▏       | 81692/371472 [6:29:49<21:37:01,  3.72it/s]
 22%|██▏       | 81693/371472 [6:29:49<23:48:23,  3.38it/s]
 22%|██▏       | 81694/371472 [6:29:49<23:23:20,  3.44it/s]
 22%|██▏       | 81695/371472 [6:29:49<22:29:37,  3.58it/s]
 22%|██▏       | 81696/371472 [6:29:50<22:45:01,  3.54it/s]
 22%|██▏       | 81697/371472 [6:29:50<23:18:22,  3.45it/s]
 22%|██▏       | 81698/371472 [6:29:50<22:01:11,  3.66it/s]
 22%|██▏       | 81699/371472 [6:29:51<22:23:35,  3.59it/s]
 22%|██▏       | 81700/371472 [6:29:51<23:51:31,  3.37it/s]
                                                           
{'loss': 4.1484, 'learning_rate': 8.024359499235062e-07, 'epoch': 3.52}

 22%|██▏       | 81700/371472 [6:29:51<23:51:31,  3.37it/s]
 22%|██▏       | 81701/371472 [6:29:51<22:55:54,  3.51it/s]
 22%|██▏       | 81702/371472 [6:29:51<22:59:33,  3.50it/s]
 22%|██▏       | 81703/371472 [6:29:52<21:57:34,  3.67it/s]
 22%|██▏       | 81704/371472 [6:29:52<22:00:31,  3.66it/s]
 22%|██▏       | 81705/371472 [6:29:52<22:26:49,  3.59it/s]
 22%|██▏       | 81706/371472 [6:29:53<22:20:14,  3.60it/s]
 22%|██▏       | 81707/371472 [6:29:53<24:50:25,  3.24it/s]
 22%|██▏       | 81708/371472 [6:29:53<23:10:55,  3.47it/s]
 22%|██▏       | 81709/371472 [6:29:53<24:38:18,  3.27it/s]
 22%|██▏       | 81710/371472 [6:29:54<23:26:05,  3.43it/s]
 22%|██▏       | 81711/371472 [6:29:54<23:05:46,  3.48it/s]
 22%|██▏       | 81712/371472 [6:29:54<23:45:05,  3.39it/s]
 22%|██▏       | 81713/371472 [6:29:55<22:55:49,  3.51it/s]
 22%|██▏       | 81714/371472 [6:29:55<23:15:51,  3.46it/s]
 22%|██▏       | 81715/371472 [6:29:55<22:29:15,  3.58it/s]
 22%|██▏       | 81716/371472 [6:29:55<23:02:41,  3.49it/s]
 22%|██▏       | 81717/371472 [6:29:56<24:40:57,  3.26it/s]
 22%|██▏       | 81718/371472 [6:29:56<24:10:05,  3.33it/s]
 22%|██▏       | 81719/371472 [6:29:56<23:19:08,  3.45it/s]
 22%|██▏       | 81720/371472 [6:29:57<24:43:29,  3.26it/s]
                                                           
{'loss': 3.9485, 'learning_rate': 8.023874679480272e-07, 'epoch': 3.52}

 22%|██▏       | 81720/371472 [6:29:57<24:43:29,  3.26it/s]
 22%|██▏       | 81721/371472 [6:29:57<26:48:52,  3.00it/s]
 22%|██▏       | 81722/371472 [6:29:57<25:18:35,  3.18it/s]
 22%|██▏       | 81723/371472 [6:29:58<23:49:39,  3.38it/s]
 22%|██▏       | 81724/371472 [6:29:58<23:29:50,  3.43it/s]
 22%|██▏       | 81725/371472 [6:29:58<22:59:39,  3.50it/s]
 22%|██▏       | 81726/371472 [6:29:58<22:54:47,  3.51it/s]
 22%|██▏       | 81727/371472 [6:29:59<22:08:34,  3.63it/s]
 22%|██▏       | 81728/371472 [6:29:59<21:51:39,  3.68it/s]
 22%|██▏       | 81729/371472 [6:29:59<21:43:32,  3.70it/s]
 22%|██▏       | 81730/371472 [6:30:00<21:41:05,  3.71it/s]
 22%|██▏       | 81731/371472 [6:30:00<22:01:43,  3.65it/s]
 22%|██▏       | 81732/371472 [6:30:00<23:09:25,  3.48it/s]
 22%|██▏       | 81733/371472 [6:30:00<22:33:21,  3.57it/s]
 22%|██▏       | 81734/371472 [6:30:01<23:29:30,  3.43it/s]
 22%|██▏       | 81735/371472 [6:30:01<22:45:04,  3.54it/s]
 22%|██▏       | 81736/371472 [6:30:01<23:14:39,  3.46it/s]
 22%|██▏       | 81737/371472 [6:30:01<21:57:46,  3.66it/s]
 22%|██▏       | 81738/371472 [6:30:02<22:02:32,  3.65it/s]
 22%|██▏       | 81739/371472 [6:30:02<23:07:46,  3.48it/s]
 22%|██▏       | 81740/371472 [6:30:02<24:17:19,  3.31it/s]
                                                           
{'loss': 4.1861, 'learning_rate': 8.023389859725485e-07, 'epoch': 3.52}

 22%|██▏       | 81740/371472 [6:30:02<24:17:19,  3.31it/s]
 22%|██▏       | 81741/371472 [6:30:03<24:05:37,  3.34it/s]
 22%|██▏       | 81742/371472 [6:30:03<23:12:39,  3.47it/s]
 22%|██▏       | 81743/371472 [6:30:03<22:48:58,  3.53it/s]
 22%|██▏       | 81744/371472 [6:30:04<22:16:00,  3.61it/s]
 22%|██▏       | 81745/371472 [6:30:04<22:17:28,  3.61it/s]
 22%|██▏       | 81746/371472 [6:30:04<22:04:46,  3.64it/s]
 22%|██▏       | 81747/371472 [6:30:04<21:56:31,  3.67it/s]
 22%|██▏       | 81748/371472 [6:30:05<22:48:10,  3.53it/s]
 22%|██▏       | 81749/371472 [6:30:05<22:44:09,  3.54it/s]
 22%|██▏       | 81750/371472 [6:30:05<21:58:46,  3.66it/s]
 22%|██▏       | 81751/371472 [6:30:05<21:19:29,  3.77it/s]
 22%|██▏       | 81752/371472 [6:30:06<22:39:25,  3.55it/s]
 22%|██▏       | 81753/371472 [6:30:06<24:04:50,  3.34it/s]
 22%|██▏       | 81754/371472 [6:30:06<22:50:20,  3.52it/s]
 22%|██▏       | 81755/371472 [6:30:07<23:05:06,  3.49it/s]
 22%|██▏       | 81756/371472 [6:30:07<24:03:12,  3.35it/s]
 22%|██▏       | 81757/371472 [6:30:07<23:58:55,  3.36it/s]
 22%|██▏       | 81758/371472 [6:30:07<22:24:13,  3.59it/s]
 22%|██▏       | 81759/371472 [6:30:08<22:34:57,  3.56it/s]
 22%|██▏       | 81760/371472 [6:30:08<21:29:13,  3.75it/s]
                                                           
{'loss': 4.1655, 'learning_rate': 8.022905039970695e-07, 'epoch': 3.52}

 22%|██▏       | 81760/371472 [6:30:08<21:29:13,  3.75it/s]
 22%|██▏       | 81761/371472 [6:30:08<23:14:10,  3.46it/s]
 22%|██▏       | 81762/371472 [6:30:09<22:55:42,  3.51it/s]
 22%|██▏       | 81763/371472 [6:30:09<22:23:46,  3.59it/s]
 22%|██▏       | 81764/371472 [6:30:09<23:11:16,  3.47it/s]
 22%|██▏       | 81765/371472 [6:30:09<23:33:00,  3.42it/s]
 22%|██▏       | 81766/371472 [6:30:10<22:45:52,  3.54it/s]
 22%|██▏       | 81767/371472 [6:30:10<23:19:11,  3.45it/s]
 22%|██▏       | 81768/371472 [6:30:10<22:52:35,  3.52it/s]
 22%|██▏       | 81769/371472 [6:30:11<22:18:41,  3.61it/s]
 22%|██▏       | 81770/371472 [6:30:11<22:18:21,  3.61it/s]
 22%|██▏       | 81771/371472 [6:30:11<21:37:26,  3.72it/s]
 22%|██▏       | 81772/371472 [6:30:11<20:50:16,  3.86it/s]
 22%|██▏       | 81773/371472 [6:30:12<21:15:49,  3.78it/s]
 22%|██▏       | 81774/371472 [6:30:12<21:48:45,  3.69it/s]
 22%|██▏       | 81775/371472 [6:30:12<21:57:02,  3.67it/s]
 22%|██▏       | 81776/371472 [6:30:12<21:10:11,  3.80it/s]
 22%|██▏       | 81777/371472 [6:30:13<21:12:24,  3.79it/s]
 22%|██▏       | 81778/371472 [6:30:13<23:10:14,  3.47it/s]
 22%|██▏       | 81779/371472 [6:30:13<22:29:00,  3.58it/s]
 22%|██▏       | 81780/371472 [6:30:14<22:20:04,  3.60it/s]
                                                           
{'loss': 4.0772, 'learning_rate': 8.022420220215906e-07, 'epoch': 3.52}

 22%|██▏       | 81780/371472 [6:30:14<22:20:04,  3.60it/s]
 22%|██▏       | 81781/371472 [6:30:14<21:29:35,  3.74it/s]
 22%|██▏       | 81782/371472 [6:30:14<22:20:47,  3.60it/s]
 22%|██▏       | 81783/371472 [6:30:14<21:53:49,  3.67it/s]
 22%|██▏       | 81784/371472 [6:30:15<21:22:07,  3.77it/s]
 22%|██▏       | 81785/371472 [6:30:15<21:07:29,  3.81it/s]
 22%|██▏       | 81786/371472 [6:30:15<21:15:52,  3.78it/s]
 22%|██▏       | 81787/371472 [6:30:15<21:55:29,  3.67it/s]
 22%|██▏       | 81788/371472 [6:30:16<22:01:06,  3.65it/s]
 22%|██▏       | 81789/371472 [6:30:16<22:02:23,  3.65it/s]
 22%|██▏       | 81790/371472 [6:30:16<21:45:21,  3.70it/s]
 22%|██▏       | 81791/371472 [6:30:17<21:22:12,  3.77it/s]
 22%|██▏       | 81792/371472 [6:30:17<21:45:34,  3.70it/s]
 22%|██▏       | 81793/371472 [6:30:17<21:43:51,  3.70it/s]
 22%|██▏       | 81794/371472 [6:30:17<21:56:28,  3.67it/s]
 22%|██▏       | 81795/371472 [6:30:18<22:08:35,  3.63it/s]
 22%|██▏       | 81796/371472 [6:30:18<21:54:33,  3.67it/s]
 22%|██▏       | 81797/371472 [6:30:18<22:29:20,  3.58it/s]
 22%|██▏       | 81798/371472 [6:30:19<24:10:01,  3.33it/s]
 22%|██▏       | 81799/371472 [6:30:19<24:25:54,  3.29it/s]
 22%|██▏       | 81800/371472 [6:30:19<25:05:39,  3.21it/s]
                                                           
{'loss': 3.9857, 'learning_rate': 8.021935400461117e-07, 'epoch': 3.52}

 22%|██▏       | 81800/371472 [6:30:19<25:05:39,  3.21it/s]
 22%|██▏       | 81801/371472 [6:30:19<24:32:55,  3.28it/s]
 22%|██▏       | 81802/371472 [6:30:20<23:31:39,  3.42it/s]
 22%|██▏       | 81803/371472 [6:30:20<22:57:28,  3.50it/s]
 22%|██▏       | 81804/371472 [6:30:20<22:09:24,  3.63it/s]
 22%|██▏       | 81805/371472 [6:30:21<22:27:07,  3.58it/s]
 22%|██▏       | 81806/371472 [6:30:21<22:44:42,  3.54it/s]
 22%|██▏       | 81807/371472 [6:30:21<21:59:21,  3.66it/s]
 22%|██▏       | 81808/371472 [6:30:21<21:41:56,  3.71it/s]
 22%|██▏       | 81809/371472 [6:30:22<21:05:47,  3.81it/s]
 22%|██▏       | 81810/371472 [6:30:22<22:31:16,  3.57it/s]
 22%|██▏       | 81811/371472 [6:30:22<22:59:20,  3.50it/s]
 22%|██▏       | 81812/371472 [6:30:22<23:04:34,  3.49it/s]
 22%|██▏       | 81813/371472 [6:30:23<22:15:56,  3.61it/s]
 22%|██▏       | 81814/371472 [6:30:23<23:24:22,  3.44it/s]
 22%|██▏       | 81815/371472 [6:30:24<28:16:27,  2.85it/s]
 22%|██▏       | 81816/371472 [6:30:24<26:40:47,  3.02it/s]
 22%|██▏       | 81817/371472 [6:30:24<24:48:53,  3.24it/s]
 22%|██▏       | 81818/371472 [6:30:24<24:15:00,  3.32it/s]
 22%|██▏       | 81819/371472 [6:30:25<23:30:23,  3.42it/s]
 22%|██▏       | 81820/371472 [6:30:25<24:31:16,  3.28it/s]
                                                           
{'loss': 3.828, 'learning_rate': 8.021450580706328e-07, 'epoch': 3.52}

 22%|██▏       | 81820/371472 [6:30:25<24:31:16,  3.28it/s]
 22%|██▏       | 81821/371472 [6:30:25<24:28:30,  3.29it/s]
 22%|██▏       | 81822/371472 [6:30:26<22:52:52,  3.52it/s]
 22%|██▏       | 81823/371472 [6:30:26<22:18:58,  3.61it/s]
 22%|██▏       | 81824/371472 [6:30:26<21:24:23,  3.76it/s]
 22%|██▏       | 81825/371472 [6:30:26<21:28:47,  3.75it/s]
 22%|██▏       | 81826/371472 [6:30:27<21:12:46,  3.79it/s]
 22%|██▏       | 81827/371472 [6:30:27<21:51:50,  3.68it/s]
 22%|██▏       | 81828/371472 [6:30:27<21:26:17,  3.75it/s]
 22%|██▏       | 81829/371472 [6:30:27<22:58:38,  3.50it/s]
 22%|██▏       | 81830/371472 [6:30:28<22:57:52,  3.50it/s]
 22%|██▏       | 81831/371472 [6:30:28<22:47:55,  3.53it/s]
 22%|██▏       | 81832/371472 [6:30:28<22:52:14,  3.52it/s]
 22%|██▏       | 81833/371472 [6:30:29<22:14:14,  3.62it/s]
 22%|██▏       | 81834/371472 [6:30:29<21:20:45,  3.77it/s]
 22%|██▏       | 81835/371472 [6:30:29<20:45:21,  3.88it/s]
 22%|██▏       | 81836/371472 [6:30:29<20:39:06,  3.90it/s]
 22%|██▏       | 81837/371472 [6:30:30<20:40:30,  3.89it/s]
 22%|██▏       | 81838/371472 [6:30:30<21:02:48,  3.82it/s]
 22%|██▏       | 81839/371472 [6:30:30<21:04:10,  3.82it/s]
 22%|██▏       | 81840/371472 [6:30:30<21:27:02,  3.75it/s]
                                                           
{'loss': 4.0148, 'learning_rate': 8.020965760951539e-07, 'epoch': 3.53}

 22%|██▏       | 81840/371472 [6:30:30<21:27:02,  3.75it/s]
 22%|██▏       | 81841/371472 [6:30:31<21:43:18,  3.70it/s]
 22%|██▏       | 81842/371472 [6:30:31<22:07:23,  3.64it/s]
 22%|██▏       | 81843/371472 [6:30:31<21:58:54,  3.66it/s]
 22%|██▏       | 81844/371472 [6:30:31<21:22:17,  3.76it/s]
 22%|██▏       | 81845/371472 [6:30:32<23:17:26,  3.45it/s]
 22%|██▏       | 81846/371472 [6:30:32<22:36:49,  3.56it/s]
 22%|██▏       | 81847/371472 [6:30:32<21:53:07,  3.68it/s]
 22%|██▏       | 81848/371472 [6:30:33<21:39:01,  3.72it/s]
 22%|██▏       | 81849/371472 [6:30:33<22:57:33,  3.50it/s]
 22%|██▏       | 81850/371472 [6:30:33<22:43:20,  3.54it/s]
 22%|██▏       | 81851/371472 [6:30:33<23:38:27,  3.40it/s]
 22%|██▏       | 81852/371472 [6:30:34<23:11:15,  3.47it/s]
 22%|██▏       | 81853/371472 [6:30:34<22:50:27,  3.52it/s]
 22%|██▏       | 81854/371472 [6:30:34<24:46:39,  3.25it/s]
 22%|██▏       | 81855/371472 [6:30:35<24:27:05,  3.29it/s]
 22%|██▏       | 81856/371472 [6:30:35<24:50:48,  3.24it/s]
 22%|██▏       | 81857/371472 [6:30:35<24:39:57,  3.26it/s]
 22%|██▏       | 81858/371472 [6:30:36<24:31:30,  3.28it/s]
 22%|██▏       | 81859/371472 [6:30:36<23:21:50,  3.44it/s]
 22%|██▏       | 81860/371472 [6:30:36<22:31:37,  3.57it/s]
                                                           
{'loss': 4.0338, 'learning_rate': 8.02048094119675e-07, 'epoch': 3.53}

 22%|██▏       | 81860/371472 [6:30:36<22:31:37,  3.57it/s]
 22%|██▏       | 81861/371472 [6:30:36<22:24:11,  3.59it/s]
 22%|██▏       | 81862/371472 [6:30:37<23:01:01,  3.50it/s]
 22%|██▏       | 81863/371472 [6:30:37<23:10:44,  3.47it/s]
 22%|██▏       | 81864/371472 [6:30:37<22:39:44,  3.55it/s]
 22%|██▏       | 81865/371472 [6:30:38<22:49:27,  3.52it/s]
 22%|██▏       | 81866/371472 [6:30:38<23:46:01,  3.38it/s]
 22%|██▏       | 81867/371472 [6:30:38<22:53:33,  3.51it/s]
 22%|██▏       | 81868/371472 [6:30:38<24:06:18,  3.34it/s]
 22%|██▏       | 81869/371472 [6:30:39<23:12:23,  3.47it/s]
 22%|██▏       | 81870/371472 [6:30:39<22:46:17,  3.53it/s]
 22%|██▏       | 81871/371472 [6:30:39<22:22:59,  3.59it/s]
 22%|██▏       | 81872/371472 [6:30:40<22:08:13,  3.63it/s]
 22%|██▏       | 81873/371472 [6:30:40<24:14:53,  3.32it/s]
 22%|██▏       | 81874/371472 [6:30:40<24:16:47,  3.31it/s]
 22%|██▏       | 81875/371472 [6:30:41<26:24:01,  3.05it/s]
 22%|██▏       | 81876/371472 [6:30:41<24:53:56,  3.23it/s]
 22%|██▏       | 81877/371472 [6:30:41<24:21:08,  3.30it/s]
 22%|██▏       | 81878/371472 [6:30:41<23:39:24,  3.40it/s]
 22%|██▏       | 81879/371472 [6:30:42<23:02:04,  3.49it/s]
 22%|██▏       | 81880/371472 [6:30:42<21:46:28,  3.69it/s]
                                                           
{'loss': 4.0018, 'learning_rate': 8.019996121441961e-07, 'epoch': 3.53}

 22%|██▏       | 81880/371472 [6:30:42<21:46:28,  3.69it/s]
 22%|██▏       | 81881/371472 [6:30:42<21:44:27,  3.70it/s]
 22%|██▏       | 81882/371472 [6:30:42<21:14:07,  3.79it/s]
 22%|██▏       | 81883/371472 [6:30:43<22:02:08,  3.65it/s]
 22%|██▏       | 81884/371472 [6:30:43<21:23:36,  3.76it/s]
 22%|██▏       | 81885/371472 [6:30:43<20:59:09,  3.83it/s]
 22%|██▏       | 81886/371472 [6:30:43<20:44:16,  3.88it/s]
 22%|██▏       | 81887/371472 [6:30:44<20:35:28,  3.91it/s]
 22%|██▏       | 81888/371472 [6:30:44<21:19:01,  3.77it/s]
 22%|██▏       | 81889/371472 [6:30:44<21:41:23,  3.71it/s]
 22%|██▏       | 81890/371472 [6:30:45<22:31:05,  3.57it/s]
 22%|██▏       | 81891/371472 [6:30:45<24:20:26,  3.30it/s]
 22%|██▏       | 81892/371472 [6:30:45<23:09:11,  3.47it/s]
 22%|██▏       | 81893/371472 [6:30:45<22:22:37,  3.59it/s]
 22%|██▏       | 81894/371472 [6:30:46<22:20:30,  3.60it/s]
 22%|██▏       | 81895/371472 [6:30:46<22:29:42,  3.58it/s]
 22%|██▏       | 81896/371472 [6:30:46<23:14:51,  3.46it/s]
 22%|██▏       | 81897/371472 [6:30:47<23:31:22,  3.42it/s]
 22%|██▏       | 81898/371472 [6:30:47<23:23:00,  3.44it/s]
 22%|██▏       | 81899/371472 [6:30:47<22:30:58,  3.57it/s]
 22%|██▏       | 81900/371472 [6:30:47<22:34:11,  3.56it/s]
                                                           
{'loss': 4.0669, 'learning_rate': 8.019511301687173e-07, 'epoch': 3.53}

 22%|██▏       | 81900/371472 [6:30:47<22:34:11,  3.56it/s]
 22%|██▏       | 81901/371472 [6:30:48<21:51:41,  3.68it/s]
 22%|██▏       | 81902/371472 [6:30:48<21:46:53,  3.69it/s]
 22%|██▏       | 81903/371472 [6:30:48<22:35:17,  3.56it/s]
 22%|██▏       | 81904/371472 [6:30:49<22:37:57,  3.55it/s]
 22%|██▏       | 81905/371472 [6:30:49<22:02:24,  3.65it/s]
 22%|██▏       | 81906/371472 [6:30:49<22:35:09,  3.56it/s]
 22%|██▏       | 81907/371472 [6:30:49<22:38:33,  3.55it/s]
 22%|██▏       | 81908/371472 [6:30:50<22:08:19,  3.63it/s]
 22%|██▏       | 81909/371472 [6:30:50<22:07:25,  3.64it/s]
 22%|██▏       | 81910/371472 [6:30:50<22:45:51,  3.53it/s]
 22%|██▏       | 81911/371472 [6:30:51<22:42:55,  3.54it/s]
 22%|██▏       | 81912/371472 [6:30:51<21:46:33,  3.69it/s]
 22%|██▏       | 81913/371472 [6:30:51<21:31:05,  3.74it/s]
 22%|██▏       | 81914/371472 [6:30:51<23:03:43,  3.49it/s]
 22%|██▏       | 81915/371472 [6:30:52<22:52:33,  3.52it/s]
 22%|██▏       | 81916/371472 [6:30:52<21:55:32,  3.67it/s]
 22%|██▏       | 81917/371472 [6:30:52<22:46:11,  3.53it/s]
 22%|██▏       | 81918/371472 [6:30:52<23:48:07,  3.38it/s]
 22%|██▏       | 81919/371472 [6:30:53<22:21:22,  3.60it/s]
 22%|██▏       | 81920/371472 [6:30:53<21:59:35,  3.66it/s]
                                                           
{'loss': 4.2146, 'learning_rate': 8.019026481932384e-07, 'epoch': 3.53}

 22%|██▏       | 81920/371472 [6:30:53<21:59:35,  3.66it/s]
 22%|██▏       | 81921/371472 [6:30:53<23:39:28,  3.40it/s]
 22%|██▏       | 81922/371472 [6:30:54<22:54:43,  3.51it/s]
 22%|██▏       | 81923/371472 [6:30:54<23:12:50,  3.46it/s]
 22%|██▏       | 81924/371472 [6:30:54<22:10:55,  3.63it/s]
 22%|██▏       | 81925/371472 [6:30:54<23:17:38,  3.45it/s]
 22%|██▏       | 81926/371472 [6:30:55<22:23:26,  3.59it/s]
 22%|██▏       | 81927/371472 [6:30:55<24:13:14,  3.32it/s]
 22%|██▏       | 81928/371472 [6:30:55<23:12:51,  3.46it/s]
 22%|██▏       | 81929/371472 [6:30:56<24:29:43,  3.28it/s]
 22%|██▏       | 81930/371472 [6:30:56<23:19:10,  3.45it/s]
 22%|██▏       | 81931/371472 [6:30:56<22:25:33,  3.59it/s]
 22%|██▏       | 81932/371472 [6:30:56<22:39:09,  3.55it/s]
 22%|██▏       | 81933/371472 [6:30:57<22:59:51,  3.50it/s]
 22%|██▏       | 81934/371472 [6:30:57<22:47:22,  3.53it/s]
 22%|██▏       | 81935/371472 [6:30:57<22:19:11,  3.60it/s]
 22%|██▏       | 81936/371472 [6:30:58<22:10:47,  3.63it/s]
 22%|██▏       | 81937/371472 [6:30:58<24:36:40,  3.27it/s]
 22%|██▏       | 81938/371472 [6:30:58<23:35:28,  3.41it/s]
 22%|██▏       | 81939/371472 [6:30:59<23:31:41,  3.42it/s]
 22%|██▏       | 81940/371472 [6:30:59<22:45:37,  3.53it/s]
                                                           
{'loss': 4.1122, 'learning_rate': 8.018541662177595e-07, 'epoch': 3.53}

 22%|██▏       | 81940/371472 [6:30:59<22:45:37,  3.53it/s]
 22%|██▏       | 81941/371472 [6:30:59<22:04:32,  3.64it/s]
 22%|██▏       | 81942/371472 [6:30:59<24:24:34,  3.29it/s]
 22%|██▏       | 81943/371472 [6:31:00<23:48:22,  3.38it/s]
 22%|██▏       | 81944/371472 [6:31:00<24:08:52,  3.33it/s]
 22%|██▏       | 81945/371472 [6:31:00<23:44:06,  3.39it/s]
 22%|██▏       | 81946/371472 [6:31:01<23:35:57,  3.41it/s]
 22%|██▏       | 81947/371472 [6:31:01<23:12:00,  3.47it/s]
 22%|██▏       | 81948/371472 [6:31:01<21:58:18,  3.66it/s]
 22%|██▏       | 81949/371472 [6:31:01<21:06:45,  3.81it/s]
 22%|██▏       | 81950/371472 [6:31:02<21:54:21,  3.67it/s]
 22%|██▏       | 81951/371472 [6:31:02<22:57:26,  3.50it/s]
 22%|██▏       | 81952/371472 [6:31:02<23:32:18,  3.42it/s]
 22%|██▏       | 81953/371472 [6:31:02<22:32:33,  3.57it/s]
 22%|██▏       | 81954/371472 [6:31:03<23:20:39,  3.45it/s]
 22%|██▏       | 81955/371472 [6:31:03<22:51:25,  3.52it/s]
 22%|██▏       | 81956/371472 [6:31:03<22:19:56,  3.60it/s]
 22%|██▏       | 81957/371472 [6:31:04<23:13:35,  3.46it/s]
 22%|██▏       | 81958/371472 [6:31:04<23:32:55,  3.42it/s]
 22%|██▏       | 81959/371472 [6:31:04<24:11:26,  3.32it/s]
 22%|██▏       | 81960/371472 [6:31:05<23:20:22,  3.45it/s]
                                                           
{'loss': 4.1816, 'learning_rate': 8.018056842422805e-07, 'epoch': 3.53}

 22%|██▏       | 81960/371472 [6:31:05<23:20:22,  3.45it/s]
 22%|██▏       | 81961/371472 [6:31:05<24:00:46,  3.35it/s]
 22%|██▏       | 81962/371472 [6:31:05<23:11:03,  3.47it/s]
 22%|██▏       | 81963/371472 [6:31:05<22:33:17,  3.57it/s]
 22%|██▏       | 81964/371472 [6:31:06<22:55:37,  3.51it/s]
 22%|██▏       | 81965/371472 [6:31:06<23:01:59,  3.49it/s]
 22%|██▏       | 81966/371472 [6:31:06<21:58:28,  3.66it/s]
 22%|██▏       | 81967/371472 [6:31:06<22:01:40,  3.65it/s]
 22%|██▏       | 81968/371472 [6:31:07<22:24:33,  3.59it/s]
 22%|██▏       | 81969/371472 [6:31:07<23:48:46,  3.38it/s]
 22%|██▏       | 81970/371472 [6:31:07<23:08:04,  3.48it/s]
 22%|██▏       | 81971/371472 [6:31:08<22:35:02,  3.56it/s]
 22%|██▏       | 81972/371472 [6:31:08<22:07:59,  3.63it/s]
 22%|██▏       | 81973/371472 [6:31:08<21:56:47,  3.66it/s]
 22%|██▏       | 81974/371472 [6:31:08<21:56:13,  3.67it/s]
 22%|██▏       | 81975/371472 [6:31:09<22:37:23,  3.55it/s]
 22%|██▏       | 81976/371472 [6:31:09<23:52:33,  3.37it/s]
 22%|██▏       | 81977/371472 [6:31:09<22:58:58,  3.50it/s]
 22%|██▏       | 81978/371472 [6:31:10<23:08:30,  3.47it/s]
 22%|██▏       | 81979/371472 [6:31:10<24:38:14,  3.26it/s]
 22%|██▏       | 81980/371472 [6:31:10<26:12:25,  3.07it/s]
                                                           
{'loss': 4.1509, 'learning_rate': 8.017572022668017e-07, 'epoch': 3.53}

 22%|██▏       | 81980/371472 [6:31:10<26:12:25,  3.07it/s]
 22%|██▏       | 81981/371472 [6:31:11<25:29:10,  3.16it/s]
 22%|██▏       | 81982/371472 [6:31:11<24:01:38,  3.35it/s]
 22%|██▏       | 81983/371472 [6:31:11<23:38:00,  3.40it/s]
 22%|██▏       | 81984/371472 [6:31:11<23:01:33,  3.49it/s]
 22%|██▏       | 81985/371472 [6:31:12<22:28:02,  3.58it/s]
 22%|██▏       | 81986/371472 [6:31:12<22:48:24,  3.53it/s]
 22%|██▏       | 81987/371472 [6:31:12<22:30:05,  3.57it/s]
 22%|██▏       | 81988/371472 [6:31:13<23:59:06,  3.35it/s]
 22%|██▏       | 81989/371472 [6:31:13<22:55:20,  3.51it/s]
 22%|██▏       | 81990/371472 [6:31:13<24:16:41,  3.31it/s]
 22%|██▏       | 81991/371472 [6:31:13<23:30:29,  3.42it/s]
 22%|██▏       | 81992/371472 [6:31:14<22:25:40,  3.59it/s]
 22%|██▏       | 81993/371472 [6:31:14<22:12:38,  3.62it/s]
 22%|██▏       | 81994/371472 [6:31:14<22:07:37,  3.63it/s]
 22%|██▏       | 81995/371472 [6:31:15<22:07:34,  3.63it/s]
 22%|██▏       | 81996/371472 [6:31:15<21:55:07,  3.67it/s]
 22%|██▏       | 81997/371472 [6:31:15<21:44:14,  3.70it/s]
 22%|██▏       | 81998/371472 [6:31:15<22:47:37,  3.53it/s]
 22%|██▏       | 81999/371472 [6:31:16<21:57:52,  3.66it/s]
 22%|██▏       | 82000/371472 [6:31:16<21:48:55,  3.69it/s]
                                                           
{'loss': 4.1564, 'learning_rate': 8.017087202913228e-07, 'epoch': 3.53}

 22%|██▏       | 82000/371472 [6:31:16<21:48:55,  3.69it/s]
 22%|██▏       | 82001/371472 [6:31:16<22:52:11,  3.52it/s]
 22%|██▏       | 82002/371472 [6:31:17<24:45:36,  3.25it/s]
 22%|██▏       | 82003/371472 [6:31:17<25:04:27,  3.21it/s]
 22%|██▏       | 82004/371472 [6:31:17<24:35:01,  3.27it/s]
 22%|██▏       | 82005/371472 [6:31:18<25:23:52,  3.17it/s]
 22%|██▏       | 82006/371472 [6:31:18<24:25:53,  3.29it/s]
 22%|██▏       | 82007/371472 [6:31:18<24:32:44,  3.28it/s]
 22%|██▏       | 82008/371472 [6:31:18<25:04:11,  3.21it/s]
 22%|██▏       | 82009/371472 [6:31:19<24:33:07,  3.27it/s]
 22%|██▏       | 82010/371472 [6:31:19<24:22:54,  3.30it/s]
 22%|██▏       | 82011/371472 [6:31:19<26:51:38,  2.99it/s]
 22%|██▏       | 82012/371472 [6:31:20<24:42:49,  3.25it/s]
 22%|██▏       | 82013/371472 [6:31:20<23:33:15,  3.41it/s]
 22%|██▏       | 82014/371472 [6:31:20<22:56:23,  3.51it/s]
 22%|██▏       | 82015/371472 [6:31:20<22:20:14,  3.60it/s]
 22%|██▏       | 82016/371472 [6:31:21<22:01:51,  3.65it/s]
 22%|██▏       | 82017/371472 [6:31:21<22:20:34,  3.60it/s]
 22%|██▏       | 82018/371472 [6:31:21<21:34:32,  3.73it/s]
 22%|██▏       | 82019/371472 [6:31:22<21:43:41,  3.70it/s]
 22%|██▏       | 82020/371472 [6:31:22<21:01:32,  3.82it/s]
                                                           
{'loss': 4.0108, 'learning_rate': 8.016602383158438e-07, 'epoch': 3.53}

 22%|██▏       | 82020/371472 [6:31:22<21:01:32,  3.82it/s]
 22%|██▏       | 82021/371472 [6:31:22<21:24:05,  3.76it/s]
 22%|██▏       | 82022/371472 [6:31:22<22:04:13,  3.64it/s]
 22%|██▏       | 82023/371472 [6:31:23<21:08:51,  3.80it/s]
 22%|██▏       | 82024/371472 [6:31:23<21:49:12,  3.68it/s]
 22%|██▏       | 82025/371472 [6:31:23<23:33:11,  3.41it/s]
 22%|██▏       | 82026/371472 [6:31:24<23:14:07,  3.46it/s]
 22%|██▏       | 82027/371472 [6:31:24<22:20:51,  3.60it/s]
 22%|██▏       | 82028/371472 [6:31:24<22:14:20,  3.62it/s]
 22%|██▏       | 82029/371472 [6:31:24<21:21:40,  3.76it/s]
 22%|██▏       | 82030/371472 [6:31:25<21:50:54,  3.68it/s]
 22%|██▏       | 82031/371472 [6:31:25<22:29:09,  3.58it/s]
 22%|██▏       | 82032/371472 [6:31:25<22:40:21,  3.55it/s]
 22%|██▏       | 82033/371472 [6:31:25<22:56:01,  3.51it/s]
 22%|██▏       | 82034/371472 [6:31:26<22:20:35,  3.60it/s]
 22%|██▏       | 82035/371472 [6:31:26<21:46:03,  3.69it/s]
 22%|██▏       | 82036/371472 [6:31:26<21:33:53,  3.73it/s]
 22%|██▏       | 82037/371472 [6:31:27<23:37:31,  3.40it/s]
 22%|██▏       | 82038/371472 [6:31:27<23:25:57,  3.43it/s]
 22%|██▏       | 82039/371472 [6:31:27<22:46:13,  3.53it/s]
 22%|██▏       | 82040/371472 [6:31:27<21:49:14,  3.68it/s]
                                                           
{'loss': 4.1146, 'learning_rate': 8.01611756340365e-07, 'epoch': 3.53}

 22%|██▏       | 82040/371472 [6:31:27<21:49:14,  3.68it/s]
 22%|██▏       | 82041/371472 [6:31:28<21:28:09,  3.74it/s]
 22%|██▏       | 82042/371472 [6:31:28<21:13:56,  3.79it/s]
 22%|██▏       | 82043/371472 [6:31:28<21:34:39,  3.73it/s]
 22%|██▏       | 82044/371472 [6:31:28<21:44:12,  3.70it/s]
 22%|██▏       | 82045/371472 [6:31:29<21:27:37,  3.75it/s]
 22%|██▏       | 82046/371472 [6:31:29<21:54:36,  3.67it/s]
 22%|██▏       | 82047/371472 [6:31:29<23:11:12,  3.47it/s]
 22%|██▏       | 82048/371472 [6:31:30<22:34:10,  3.56it/s]
 22%|██▏       | 82049/371472 [6:31:30<22:12:34,  3.62it/s]
 22%|██▏       | 82050/371472 [6:31:30<21:15:15,  3.78it/s]
 22%|██▏       | 82051/371472 [6:31:30<21:05:29,  3.81it/s]
 22%|██▏       | 82052/371472 [6:31:31<22:22:42,  3.59it/s]
 22%|██▏       | 82053/371472 [6:31:31<22:05:20,  3.64it/s]
 22%|██▏       | 82054/371472 [6:31:31<22:47:24,  3.53it/s]
 22%|██▏       | 82055/371472 [6:31:32<23:49:51,  3.37it/s]
 22%|██▏       | 82056/371472 [6:31:32<22:55:35,  3.51it/s]
 22%|██▏       | 82057/371472 [6:31:32<22:03:56,  3.64it/s]
 22%|██▏       | 82058/371472 [6:31:32<24:56:01,  3.22it/s]
 22%|██▏       | 82059/371472 [6:31:33<23:54:32,  3.36it/s]
 22%|██▏       | 82060/371472 [6:31:33<23:32:20,  3.42it/s]
                                                           
{'loss': 4.1704, 'learning_rate': 8.015632743648862e-07, 'epoch': 3.53}

 22%|██▏       | 82060/371472 [6:31:33<23:32:20,  3.42it/s]
 22%|██▏       | 82061/371472 [6:31:33<22:31:21,  3.57it/s]
 22%|██▏       | 82062/371472 [6:31:34<23:35:04,  3.41it/s]
 22%|██▏       | 82063/371472 [6:31:34<22:27:17,  3.58it/s]
 22%|██▏       | 82064/371472 [6:31:34<22:35:12,  3.56it/s]
 22%|██▏       | 82065/371472 [6:31:34<22:57:29,  3.50it/s]
 22%|██▏       | 82066/371472 [6:31:35<22:01:37,  3.65it/s]
 22%|██▏       | 82067/371472 [6:31:35<22:42:12,  3.54it/s]
 22%|██▏       | 82068/371472 [6:31:35<22:19:16,  3.60it/s]
 22%|██▏       | 82069/371472 [6:31:36<22:58:02,  3.50it/s]
 22%|██▏       | 82070/371472 [6:31:36<22:48:34,  3.52it/s]
 22%|██▏       | 82071/371472 [6:31:36<22:00:56,  3.65it/s]
 22%|██▏       | 82072/371472 [6:31:36<21:54:15,  3.67it/s]
 22%|██▏       | 82073/371472 [6:31:37<21:48:25,  3.69it/s]
 22%|██▏       | 82074/371472 [6:31:37<22:02:51,  3.65it/s]
 22%|██▏       | 82075/371472 [6:31:37<23:12:43,  3.46it/s]
 22%|██▏       | 82076/371472 [6:31:37<22:26:51,  3.58it/s]
 22%|██▏       | 82077/371472 [6:31:38<22:21:44,  3.59it/s]
 22%|██▏       | 82078/371472 [6:31:38<22:59:02,  3.50it/s]
 22%|██▏       | 82079/371472 [6:31:38<22:50:37,  3.52it/s]
 22%|██▏       | 82080/371472 [6:31:39<23:08:37,  3.47it/s]
                                                           
{'loss': 3.7886, 'learning_rate': 8.015147923894071e-07, 'epoch': 3.54}

 22%|██▏       | 82080/371472 [6:31:39<23:08:37,  3.47it/s]
 22%|██▏       | 82081/371472 [6:31:39<22:19:48,  3.60it/s]
 22%|██▏       | 82082/371472 [6:31:39<24:02:35,  3.34it/s]
 22%|██▏       | 82083/371472 [6:31:39<23:42:12,  3.39it/s]
 22%|██▏       | 82084/371472 [6:31:40<22:52:54,  3.51it/s]
 22%|██▏       | 82085/371472 [6:31:40<22:13:58,  3.62it/s]
 22%|██▏       | 82086/371472 [6:31:40<21:46:49,  3.69it/s]
 22%|██▏       | 82087/371472 [6:31:41<21:27:08,  3.75it/s]
 22%|██▏       | 82088/371472 [6:31:41<21:13:35,  3.79it/s]
 22%|██▏       | 82089/371472 [6:31:41<21:16:11,  3.78it/s]
 22%|██▏       | 82090/371472 [6:31:41<21:10:25,  3.80it/s]
 22%|██▏       | 82091/371472 [6:31:42<21:20:34,  3.77it/s]
 22%|██▏       | 82092/371472 [6:31:42<20:53:12,  3.85it/s]
 22%|██▏       | 82093/371472 [6:31:42<23:25:43,  3.43it/s]
 22%|██▏       | 82094/371472 [6:31:42<22:55:55,  3.51it/s]
 22%|██▏       | 82095/371472 [6:31:43<22:30:00,  3.57it/s]
 22%|██▏       | 82096/371472 [6:31:43<21:43:50,  3.70it/s]
 22%|██▏       | 82097/371472 [6:31:43<21:56:27,  3.66it/s]
 22%|██▏       | 82098/371472 [6:31:44<22:48:33,  3.52it/s]
 22%|██▏       | 82099/371472 [6:31:44<24:35:25,  3.27it/s]
 22%|██▏       | 82100/371472 [6:31:44<24:12:16,  3.32it/s]
                                                           
{'loss': 4.2163, 'learning_rate': 8.014663104139282e-07, 'epoch': 3.54}

 22%|██▏       | 82100/371472 [6:31:44<24:12:16,  3.32it/s]
 22%|██▏       | 82101/371472 [6:31:44<23:03:42,  3.49it/s]
 22%|██▏       | 82102/371472 [6:31:45<22:26:15,  3.58it/s]
 22%|██▏       | 82103/371472 [6:31:45<22:26:12,  3.58it/s]
 22%|██▏       | 82104/371472 [6:31:45<21:36:06,  3.72it/s]
 22%|██▏       | 82105/371472 [6:31:46<21:39:04,  3.71it/s]
 22%|██▏       | 82106/371472 [6:31:46<22:25:55,  3.58it/s]
 22%|██▏       | 82107/371472 [6:31:46<22:35:52,  3.56it/s]
 22%|██▏       | 82108/371472 [6:31:46<21:35:09,  3.72it/s]
 22%|██▏       | 82109/371472 [6:31:47<21:52:37,  3.67it/s]
 22%|██▏       | 82110/371472 [6:31:47<22:11:21,  3.62it/s]
 22%|██▏       | 82111/371472 [6:31:47<22:27:54,  3.58it/s]
 22%|██▏       | 82112/371472 [6:31:47<21:42:59,  3.70it/s]
 22%|██▏       | 82113/371472 [6:31:48<22:26:06,  3.58it/s]
 22%|██▏       | 82114/371472 [6:31:48<22:23:50,  3.59it/s]
 22%|██▏       | 82115/371472 [6:31:48<22:30:01,  3.57it/s]
 22%|██▏       | 82116/371472 [6:31:49<21:44:26,  3.70it/s]
 22%|██▏       | 82117/371472 [6:31:49<23:07:46,  3.48it/s]
 22%|██▏       | 82118/371472 [6:31:49<22:47:35,  3.53it/s]
 22%|██▏       | 82119/371472 [6:31:49<22:09:26,  3.63it/s]
 22%|██▏       | 82120/371472 [6:31:50<22:14:58,  3.61it/s]
                                                           
{'loss': 4.0676, 'learning_rate': 8.014178284384494e-07, 'epoch': 3.54}

 22%|██▏       | 82120/371472 [6:31:50<22:14:58,  3.61it/s]
 22%|██▏       | 82121/371472 [6:31:50<22:17:31,  3.61it/s]
 22%|██▏       | 82122/371472 [6:31:50<21:38:05,  3.72it/s]
 22%|██▏       | 82123/371472 [6:31:50<21:30:10,  3.74it/s]
 22%|██▏       | 82124/371472 [6:31:51<20:54:07,  3.85it/s]
 22%|██▏       | 82125/371472 [6:31:51<21:24:10,  3.76it/s]
 22%|██▏       | 82126/371472 [6:31:51<21:13:38,  3.79it/s]
 22%|██▏       | 82127/371472 [6:31:52<21:14:02,  3.79it/s]
 22%|██▏       | 82128/371472 [6:31:52<21:13:56,  3.79it/s]
 22%|██▏       | 82129/371472 [6:31:52<21:38:32,  3.71it/s]
 22%|██▏       | 82130/371472 [6:31:52<21:49:39,  3.68it/s]
 22%|██▏       | 82131/371472 [6:31:53<21:54:29,  3.67it/s]
 22%|██▏       | 82132/371472 [6:31:53<21:46:20,  3.69it/s]
 22%|██▏       | 82133/371472 [6:31:53<21:49:27,  3.68it/s]
 22%|██▏       | 82134/371472 [6:31:53<21:26:14,  3.75it/s]
 22%|██▏       | 82135/371472 [6:31:54<21:01:10,  3.82it/s]
 22%|██▏       | 82136/371472 [6:31:54<20:41:11,  3.89it/s]
 22%|██▏       | 82137/371472 [6:31:54<20:28:46,  3.92it/s]
 22%|██▏       | 82138/371472 [6:31:55<24:10:14,  3.33it/s]
 22%|██▏       | 82139/371472 [6:31:55<24:08:10,  3.33it/s]
 22%|██▏       | 82140/371472 [6:31:55<23:09:11,  3.47it/s]
                                                           
{'loss': 4.1845, 'learning_rate': 8.013693464629706e-07, 'epoch': 3.54}

 22%|██▏       | 82140/371472 [6:31:55<23:09:11,  3.47it/s]
 22%|██▏       | 82141/371472 [6:31:55<22:25:04,  3.59it/s]
 22%|██▏       | 82142/371472 [6:31:56<23:07:35,  3.48it/s]
 22%|██▏       | 82143/371472 [6:31:56<23:04:02,  3.48it/s]
 22%|██▏       | 82144/371472 [6:31:56<24:18:50,  3.31it/s]
 22%|██▏       | 82145/371472 [6:31:57<23:50:46,  3.37it/s]
 22%|██▏       | 82146/371472 [6:31:57<22:51:11,  3.52it/s]
 22%|██▏       | 82147/371472 [6:31:57<23:09:14,  3.47it/s]
 22%|██▏       | 82148/371472 [6:31:57<23:45:58,  3.38it/s]
 22%|██▏       | 82149/371472 [6:31:58<24:34:24,  3.27it/s]
 22%|██▏       | 82150/371472 [6:31:58<24:59:39,  3.22it/s]
 22%|██▏       | 82151/371472 [6:31:58<25:06:46,  3.20it/s]
 22%|██▏       | 82152/371472 [6:31:59<23:51:47,  3.37it/s]
 22%|██▏       | 82153/371472 [6:31:59<22:22:36,  3.59it/s]
 22%|██▏       | 82154/371472 [6:31:59<22:08:56,  3.63it/s]
 22%|██▏       | 82155/371472 [6:31:59<22:12:57,  3.62it/s]
 22%|██▏       | 82156/371472 [6:32:00<22:31:39,  3.57it/s]
 22%|██▏       | 82157/371472 [6:32:00<23:45:19,  3.38it/s]
 22%|██▏       | 82158/371472 [6:32:00<23:15:11,  3.46it/s]
 22%|██▏       | 82159/371472 [6:32:01<22:20:04,  3.60it/s]
 22%|██▏       | 82160/371472 [6:32:01<22:57:06,  3.50it/s]
                                                           
{'loss': 4.2671, 'learning_rate': 8.013208644874917e-07, 'epoch': 3.54}

 22%|██▏       | 82160/371472 [6:32:01<22:57:06,  3.50it/s]
 22%|██▏       | 82161/371472 [6:32:01<22:30:14,  3.57it/s]
 22%|██▏       | 82162/371472 [6:32:01<22:35:02,  3.56it/s]
 22%|██▏       | 82163/371472 [6:32:02<23:14:52,  3.46it/s]
 22%|██▏       | 82164/371472 [6:32:02<21:55:09,  3.67it/s]
 22%|██▏       | 82165/371472 [6:32:02<21:09:02,  3.80it/s]
 22%|██▏       | 82166/371472 [6:32:03<20:30:04,  3.92it/s]
 22%|██▏       | 82167/371472 [6:32:03<20:06:43,  4.00it/s]
 22%|██▏       | 82168/371472 [6:32:03<21:07:39,  3.80it/s]
 22%|██▏       | 82169/371472 [6:32:03<21:41:36,  3.70it/s]
 22%|██▏       | 82170/371472 [6:32:04<21:47:45,  3.69it/s]
 22%|██▏       | 82171/371472 [6:32:04<21:11:55,  3.79it/s]
 22%|██▏       | 82172/371472 [6:32:04<21:32:46,  3.73it/s]
 22%|██▏       | 82173/371472 [6:32:04<23:00:27,  3.49it/s]
 22%|██▏       | 82174/371472 [6:32:05<22:12:46,  3.62it/s]
 22%|██▏       | 82175/371472 [6:32:05<22:26:15,  3.58it/s]
 22%|██▏       | 82176/371472 [6:32:05<24:12:05,  3.32it/s]
 22%|██▏       | 82177/371472 [6:32:06<24:07:10,  3.33it/s]
 22%|██▏       | 82178/371472 [6:32:06<22:51:05,  3.52it/s]
 22%|██▏       | 82179/371472 [6:32:06<22:17:06,  3.61it/s]
 22%|██▏       | 82180/371472 [6:32:06<21:11:48,  3.79it/s]
                                                           
{'loss': 3.924, 'learning_rate': 8.012723825120127e-07, 'epoch': 3.54}

 22%|██▏       | 82180/371472 [6:32:06<21:11:48,  3.79it/s]
 22%|██▏       | 82181/371472 [6:32:07<21:27:55,  3.74it/s]
 22%|██▏       | 82182/371472 [6:32:07<21:26:42,  3.75it/s]
 22%|██▏       | 82183/371472 [6:32:07<21:28:14,  3.74it/s]
 22%|██▏       | 82184/371472 [6:32:07<21:50:11,  3.68it/s]
 22%|██▏       | 82185/371472 [6:32:08<23:29:45,  3.42it/s]
 22%|██▏       | 82186/371472 [6:32:08<23:43:08,  3.39it/s]
 22%|██▏       | 82187/371472 [6:32:08<23:56:05,  3.36it/s]
 22%|██▏       | 82188/371472 [6:32:09<23:57:34,  3.35it/s]
 22%|██▏       | 82189/371472 [6:32:09<22:37:00,  3.55it/s]
 22%|██▏       | 82190/371472 [6:32:09<21:57:44,  3.66it/s]
 22%|██▏       | 82191/371472 [6:32:09<22:01:45,  3.65it/s]
 22%|██▏       | 82192/371472 [6:32:10<22:09:35,  3.63it/s]
 22%|██▏       | 82193/371472 [6:32:10<22:24:58,  3.58it/s]
 22%|██▏       | 82194/371472 [6:32:10<21:57:42,  3.66it/s]
 22%|██▏       | 82195/371472 [6:32:11<22:50:57,  3.52it/s]
 22%|██▏       | 82196/371472 [6:32:11<24:54:32,  3.23it/s]
 22%|██▏       | 82197/371472 [6:32:11<23:19:34,  3.44it/s]
 22%|██▏       | 82198/371472 [6:32:12<22:33:58,  3.56it/s]
 22%|██▏       | 82199/371472 [6:32:12<22:10:54,  3.62it/s]
 22%|██▏       | 82200/371472 [6:32:12<21:06:54,  3.81it/s]
                                                           
{'loss': 3.8993, 'learning_rate': 8.012239005365338e-07, 'epoch': 3.54}

 22%|██▏       | 82200/371472 [6:32:12<21:06:54,  3.81it/s]
 22%|██▏       | 82201/371472 [6:32:12<21:27:58,  3.74it/s]
 22%|██▏       | 82202/371472 [6:32:13<20:58:04,  3.83it/s]
 22%|██▏       | 82203/371472 [6:32:13<22:58:47,  3.50it/s]
 22%|██▏       | 82204/371472 [6:32:13<22:45:28,  3.53it/s]
 22%|██▏       | 82205/371472 [6:32:13<22:45:15,  3.53it/s]
 22%|██▏       | 82206/371472 [6:32:14<22:49:38,  3.52it/s]
 22%|██▏       | 82207/371472 [6:32:14<23:00:34,  3.49it/s]
 22%|██▏       | 82208/371472 [6:32:14<23:39:38,  3.40it/s]
 22%|██▏       | 82209/371472 [6:32:15<24:13:44,  3.32it/s]
 22%|██▏       | 82210/371472 [6:32:15<23:21:57,  3.44it/s]
 22%|██▏       | 82211/371472 [6:32:15<22:34:21,  3.56it/s]
 22%|██▏       | 82212/371472 [6:32:15<21:45:04,  3.69it/s]
 22%|██▏       | 82213/371472 [6:32:16<22:44:11,  3.53it/s]
 22%|██▏       | 82214/371472 [6:32:16<22:56:36,  3.50it/s]
 22%|██▏       | 82215/371472 [6:32:16<24:08:31,  3.33it/s]
 22%|██▏       | 82216/371472 [6:32:17<25:00:55,  3.21it/s]
 22%|██▏       | 82217/371472 [6:32:17<23:31:00,  3.42it/s]
 22%|██▏       | 82218/371472 [6:32:17<23:05:37,  3.48it/s]
 22%|██▏       | 82219/371472 [6:32:17<22:57:31,  3.50it/s]
 22%|██▏       | 82220/371472 [6:32:18<23:53:43,  3.36it/s]
                                                           
{'loss': 3.9327, 'learning_rate': 8.011754185610549e-07, 'epoch': 3.54}

 22%|██▏       | 82220/371472 [6:32:18<23:53:43,  3.36it/s]
 22%|██▏       | 82221/371472 [6:32:18<24:38:31,  3.26it/s]
 22%|██▏       | 82222/371472 [6:32:18<25:02:46,  3.21it/s]
 22%|██▏       | 82223/371472 [6:32:19<25:04:45,  3.20it/s]
 22%|██▏       | 82224/371472 [6:32:19<24:35:08,  3.27it/s]
 22%|██▏       | 82225/371472 [6:32:19<24:32:48,  3.27it/s]
 22%|██▏       | 82226/371472 [6:32:20<23:41:16,  3.39it/s]
 22%|██▏       | 82227/371472 [6:32:20<23:51:10,  3.37it/s]
 22%|██▏       | 82228/371472 [6:32:20<24:21:35,  3.30it/s]
 22%|██▏       | 82229/371472 [6:32:21<23:50:16,  3.37it/s]
 22%|██▏       | 82230/371472 [6:32:21<23:56:40,  3.36it/s]
 22%|██▏       | 82231/371472 [6:32:21<23:36:53,  3.40it/s]
 22%|██▏       | 82232/371472 [6:32:21<23:54:56,  3.36it/s]
 22%|██▏       | 82233/371472 [6:32:22<27:05:36,  2.97it/s]
 22%|██▏       | 82234/371472 [6:32:22<25:46:51,  3.12it/s]
 22%|██▏       | 82235/371472 [6:32:22<24:22:07,  3.30it/s]
 22%|██▏       | 82236/371472 [6:32:23<24:33:21,  3.27it/s]
 22%|██▏       | 82237/371472 [6:32:23<24:53:20,  3.23it/s]
 22%|██▏       | 82238/371472 [6:32:23<23:22:12,  3.44it/s]
 22%|██▏       | 82239/371472 [6:32:24<23:57:30,  3.35it/s]
 22%|██▏       | 82240/371472 [6:32:24<25:08:09,  3.20it/s]
                                                           
{'loss': 3.818, 'learning_rate': 8.01126936585576e-07, 'epoch': 3.54}

 22%|██▏       | 82240/371472 [6:32:24<25:08:09,  3.20it/s]
 22%|██▏       | 82241/371472 [6:32:24<24:24:43,  3.29it/s]
 22%|██▏       | 82242/371472 [6:32:25<23:38:34,  3.40it/s]
 22%|██▏       | 82243/371472 [6:32:25<22:04:35,  3.64it/s]
 22%|██▏       | 82244/371472 [6:32:25<22:11:11,  3.62it/s]
 22%|██▏       | 82245/371472 [6:32:25<22:37:17,  3.55it/s]
 22%|██▏       | 82246/371472 [6:32:26<22:10:31,  3.62it/s]
 22%|██▏       | 82247/371472 [6:32:26<24:30:27,  3.28it/s]
 22%|██▏       | 82248/371472 [6:32:26<23:00:01,  3.49it/s]
 22%|██▏       | 82249/371472 [6:32:26<22:50:18,  3.52it/s]
 22%|██▏       | 82250/371472 [6:32:27<23:49:56,  3.37it/s]
 22%|██▏       | 82251/371472 [6:32:27<24:56:25,  3.22it/s]
 22%|██▏       | 82252/371472 [6:32:27<24:00:08,  3.35it/s]
 22%|██▏       | 82253/371472 [6:32:28<23:29:00,  3.42it/s]
 22%|██▏       | 82254/371472 [6:32:28<23:17:06,  3.45it/s]
 22%|██▏       | 82255/371472 [6:32:28<22:40:43,  3.54it/s]
 22%|██▏       | 82256/371472 [6:32:29<22:12:19,  3.62it/s]
 22%|██▏       | 82257/371472 [6:32:29<22:32:09,  3.56it/s]
 22%|██▏       | 82258/371472 [6:32:29<22:25:05,  3.58it/s]
 22%|██▏       | 82259/371472 [6:32:29<22:00:28,  3.65it/s]
 22%|██▏       | 82260/371472 [6:32:30<21:51:46,  3.67it/s]
                                                           
{'loss': 3.9274, 'learning_rate': 8.010784546100971e-07, 'epoch': 3.54}

 22%|██▏       | 82260/371472 [6:32:30<21:51:46,  3.67it/s]
 22%|██▏       | 82261/371472 [6:32:30<22:25:58,  3.58it/s]
 22%|██▏       | 82262/371472 [6:32:30<23:06:10,  3.48it/s]
 22%|██▏       | 82263/371472 [6:32:30<23:00:22,  3.49it/s]
 22%|██▏       | 82264/371472 [6:32:31<22:10:53,  3.62it/s]
 22%|██▏       | 82265/371472 [6:32:31<21:25:47,  3.75it/s]
 22%|██▏       | 82266/371472 [6:32:31<21:05:16,  3.81it/s]
 22%|██▏       | 82267/371472 [6:32:32<22:07:50,  3.63it/s]
 22%|██▏       | 82268/371472 [6:32:32<21:40:00,  3.71it/s]
 22%|██▏       | 82269/371472 [6:32:32<21:55:41,  3.66it/s]
 22%|██▏       | 82270/371472 [6:32:32<22:45:25,  3.53it/s]
 22%|██▏       | 82271/371472 [6:32:33<22:49:37,  3.52it/s]
 22%|██▏       | 82272/371472 [6:32:33<22:05:15,  3.64it/s]
 22%|██▏       | 82273/371472 [6:32:33<22:13:21,  3.61it/s]
 22%|██▏       | 82274/371472 [6:32:33<21:38:25,  3.71it/s]
 22%|██▏       | 82275/371472 [6:32:34<21:26:09,  3.75it/s]
 22%|██▏       | 82276/371472 [6:32:34<22:05:02,  3.64it/s]
 22%|██▏       | 82277/371472 [6:32:34<21:36:08,  3.72it/s]
 22%|██▏       | 82278/371472 [6:32:35<21:15:44,  3.78it/s]
 22%|██▏       | 82279/371472 [6:32:35<21:09:43,  3.80it/s]
 22%|██▏       | 82280/371472 [6:32:35<21:41:44,  3.70it/s]
                                                           
{'loss': 4.0804, 'learning_rate': 8.010299726346183e-07, 'epoch': 3.54}

 22%|██▏       | 82280/371472 [6:32:35<21:41:44,  3.70it/s]
 22%|██▏       | 82281/371472 [6:32:35<24:04:34,  3.34it/s]
 22%|██▏       | 82282/371472 [6:32:36<23:33:15,  3.41it/s]
 22%|██▏       | 82283/371472 [6:32:36<23:46:40,  3.38it/s]
 22%|██▏       | 82284/371472 [6:32:36<25:49:30,  3.11it/s]
 22%|██▏       | 82285/371472 [6:32:37<26:07:29,  3.07it/s]
 22%|██▏       | 82286/371472 [6:32:37<27:40:55,  2.90it/s]
 22%|██▏       | 82287/371472 [6:32:37<25:38:40,  3.13it/s]
 22%|██▏       | 82288/371472 [6:32:38<24:27:54,  3.28it/s]
 22%|██▏       | 82289/371472 [6:32:38<23:07:05,  3.47it/s]
 22%|██▏       | 82290/371472 [6:32:38<22:59:56,  3.49it/s]
 22%|██▏       | 82291/371472 [6:32:38<22:23:58,  3.59it/s]
 22%|██▏       | 82292/371472 [6:32:39<21:50:32,  3.68it/s]
 22%|██▏       | 82293/371472 [6:32:39<21:23:25,  3.76it/s]
 22%|██▏       | 82294/371472 [6:32:39<20:47:48,  3.86it/s]
 22%|██▏       | 82295/371472 [6:32:39<21:34:17,  3.72it/s]
 22%|██▏       | 82296/371472 [6:32:40<23:07:39,  3.47it/s]
 22%|██▏       | 82297/371472 [6:32:40<22:12:40,  3.62it/s]
 22%|██▏       | 82298/371472 [6:32:40<22:15:58,  3.61it/s]
 22%|██▏       | 82299/371472 [6:32:41<22:26:08,  3.58it/s]
 22%|██▏       | 82300/371472 [6:32:41<21:43:53,  3.70it/s]
                                                           
{'loss': 3.9787, 'learning_rate': 8.009814906591394e-07, 'epoch': 3.54}

 22%|██▏       | 82300/371472 [6:32:41<21:43:53,  3.70it/s]
 22%|██▏       | 82301/371472 [6:32:41<21:52:46,  3.67it/s]
 22%|██▏       | 82302/371472 [6:32:41<23:25:42,  3.43it/s]
 22%|██▏       | 82303/371472 [6:32:42<23:07:25,  3.47it/s]
 22%|██▏       | 82304/371472 [6:32:42<23:10:35,  3.47it/s]
 22%|██▏       | 82305/371472 [6:32:42<22:57:40,  3.50it/s]
 22%|██▏       | 82306/371472 [6:32:43<23:02:58,  3.48it/s]
 22%|██▏       | 82307/371472 [6:32:43<23:11:34,  3.46it/s]
 22%|██▏       | 82308/371472 [6:32:43<22:59:07,  3.49it/s]
 22%|██▏       | 82309/371472 [6:32:43<22:58:18,  3.50it/s]
 22%|██▏       | 82310/371472 [6:32:44<22:59:11,  3.49it/s]
 22%|██▏       | 82311/371472 [6:32:44<22:12:14,  3.62it/s]
 22%|██▏       | 82312/371472 [6:32:44<22:20:20,  3.60it/s]
 22%|██▏       | 82313/371472 [6:32:45<22:53:53,  3.51it/s]
 22%|██▏       | 82314/371472 [6:32:45<21:54:17,  3.67it/s]
 22%|██▏       | 82315/371472 [6:32:45<22:18:11,  3.60it/s]
 22%|██▏       | 82316/371472 [6:32:45<22:42:49,  3.54it/s]
 22%|██▏       | 82317/371472 [6:32:46<21:52:44,  3.67it/s]
 22%|██▏       | 82318/371472 [6:32:46<21:06:22,  3.81it/s]
 22%|██▏       | 82319/371472 [6:32:46<21:17:09,  3.77it/s]
 22%|██▏       | 82320/371472 [6:32:46<20:37:16,  3.90it/s]
                                                           
{'loss': 4.2806, 'learning_rate': 8.009330086836605e-07, 'epoch': 3.55}

 22%|██▏       | 82320/371472 [6:32:46<20:37:16,  3.90it/s]
 22%|██▏       | 82321/371472 [6:32:47<20:39:07,  3.89it/s]
 22%|██▏       | 82322/371472 [6:32:47<21:24:08,  3.75it/s]
 22%|██▏       | 82323/371472 [6:32:47<22:18:57,  3.60it/s]
 22%|██▏       | 82324/371472 [6:32:48<23:09:59,  3.47it/s]
 22%|██▏       | 82325/371472 [6:32:48<24:23:07,  3.29it/s]
 22%|██▏       | 82326/371472 [6:32:48<23:55:08,  3.36it/s]
 22%|██▏       | 82327/371472 [6:32:49<23:46:13,  3.38it/s]
 22%|██▏       | 82328/371472 [6:32:49<26:32:12,  3.03it/s]
 22%|██▏       | 82329/371472 [6:32:49<24:54:27,  3.22it/s]
 22%|██▏       | 82330/371472 [6:32:50<25:13:35,  3.18it/s]
 22%|██▏       | 82331/371472 [6:32:50<26:08:47,  3.07it/s]
 22%|██▏       | 82332/371472 [6:32:50<29:44:52,  2.70it/s]
 22%|██▏       | 82333/371472 [6:32:51<27:08:08,  2.96it/s]
 22%|██▏       | 82334/371472 [6:32:51<25:59:17,  3.09it/s]
 22%|██▏       | 82335/371472 [6:32:51<24:22:01,  3.30it/s]
 22%|██▏       | 82336/371472 [6:32:51<24:21:13,  3.30it/s]
 22%|██▏       | 82337/371472 [6:32:52<24:54:45,  3.22it/s]
 22%|██▏       | 82338/371472 [6:32:52<23:31:59,  3.41it/s]
 22%|██▏       | 82339/371472 [6:32:52<23:00:27,  3.49it/s]
 22%|██▏       | 82340/371472 [6:32:53<21:57:13,  3.66it/s]
                                                           
{'loss': 4.0621, 'learning_rate': 8.008845267081815e-07, 'epoch': 3.55}

 22%|██▏       | 82340/371472 [6:32:53<21:57:13,  3.66it/s]
 22%|██▏       | 82341/371472 [6:32:53<21:39:10,  3.71it/s]
 22%|██▏       | 82342/371472 [6:32:53<21:16:42,  3.77it/s]
 22%|██▏       | 82343/371472 [6:32:53<22:22:56,  3.59it/s]
 22%|██▏       | 82344/371472 [6:32:54<21:42:15,  3.70it/s]
 22%|██▏       | 82345/371472 [6:32:54<20:52:19,  3.85it/s]
 22%|██▏       | 82346/371472 [6:32:54<20:12:16,  3.97it/s]
 22%|██▏       | 82347/371472 [6:32:54<20:39:36,  3.89it/s]
 22%|██▏       | 82348/371472 [6:32:55<21:09:51,  3.79it/s]
 22%|██▏       | 82349/371472 [6:32:55<20:42:24,  3.88it/s]
 22%|██▏       | 82350/371472 [6:32:55<20:58:20,  3.83it/s]
 22%|██▏       | 82351/371472 [6:32:55<21:11:23,  3.79it/s]
 22%|██▏       | 82352/371472 [6:32:56<21:29:50,  3.74it/s]
 22%|██▏       | 82353/371472 [6:32:56<21:36:59,  3.72it/s]
 22%|██▏       | 82354/371472 [6:32:56<23:28:10,  3.42it/s]
 22%|██▏       | 82355/371472 [6:32:57<22:42:33,  3.54it/s]
 22%|██▏       | 82356/371472 [6:32:57<24:03:25,  3.34it/s]
 22%|██▏       | 82357/371472 [6:32:57<24:12:13,  3.32it/s]
 22%|██▏       | 82358/371472 [6:32:57<22:57:58,  3.50it/s]
 22%|██▏       | 82359/371472 [6:32:58<23:39:42,  3.39it/s]
 22%|██▏       | 82360/371472 [6:32:58<23:08:30,  3.47it/s]
                                                           
{'loss': 4.116, 'learning_rate': 8.008360447327027e-07, 'epoch': 3.55}

 22%|██▏       | 82360/371472 [6:32:58<23:08:30,  3.47it/s]
 22%|██▏       | 82361/371472 [6:32:58<23:54:08,  3.36it/s]
 22%|██▏       | 82362/371472 [6:32:59<22:58:32,  3.50it/s]
 22%|██▏       | 82363/371472 [6:32:59<22:25:53,  3.58it/s]
 22%|██▏       | 82364/371472 [6:32:59<24:03:13,  3.34it/s]
 22%|██▏       | 82365/371472 [6:33:00<23:39:28,  3.39it/s]
 22%|██▏       | 82366/371472 [6:33:00<22:51:12,  3.51it/s]
 22%|██▏       | 82367/371472 [6:33:00<22:16:22,  3.61it/s]
 22%|██▏       | 82368/371472 [6:33:00<22:55:26,  3.50it/s]
 22%|██▏       | 82369/371472 [6:33:01<25:44:44,  3.12it/s]
 22%|██▏       | 82370/371472 [6:33:01<25:47:47,  3.11it/s]
 22%|██▏       | 82371/371472 [6:33:01<26:37:53,  3.02it/s]
 22%|██▏       | 82372/371472 [6:33:02<24:39:32,  3.26it/s]
 22%|██▏       | 82373/371472 [6:33:02<24:21:12,  3.30it/s]
 22%|██▏       | 82374/371472 [6:33:02<23:31:00,  3.41it/s]
 22%|██▏       | 82375/371472 [6:33:03<22:30:32,  3.57it/s]
 22%|██▏       | 82376/371472 [6:33:03<21:49:13,  3.68it/s]
 22%|██▏       | 82377/371472 [6:33:03<21:42:28,  3.70it/s]
 22%|██▏       | 82378/371472 [6:33:03<21:25:26,  3.75it/s]
 22%|██▏       | 82379/371472 [6:33:04<22:17:33,  3.60it/s]
 22%|██▏       | 82380/371472 [6:33:04<22:12:14,  3.62it/s]
                                                           
{'loss': 4.0408, 'learning_rate': 8.007875627572237e-07, 'epoch': 3.55}

 22%|██▏       | 82380/371472 [6:33:04<22:12:14,  3.62it/s]
 22%|██▏       | 82381/371472 [6:33:04<22:00:00,  3.65it/s]
 22%|██▏       | 82382/371472 [6:33:04<22:58:19,  3.50it/s]
 22%|██▏       | 82383/371472 [6:33:05<22:20:44,  3.59it/s]
 22%|██▏       | 82384/371472 [6:33:05<23:09:40,  3.47it/s]
 22%|██▏       | 82385/371472 [6:33:05<23:07:33,  3.47it/s]
 22%|██▏       | 82386/371472 [6:33:06<23:47:45,  3.37it/s]
 22%|██▏       | 82387/371472 [6:33:06<22:41:48,  3.54it/s]
 22%|██▏       | 82388/371472 [6:33:06<23:33:02,  3.41it/s]
 22%|██▏       | 82389/371472 [6:33:06<22:37:34,  3.55it/s]
 22%|██▏       | 82390/371472 [6:33:07<22:41:22,  3.54it/s]
 22%|██▏       | 82391/371472 [6:33:07<22:45:28,  3.53it/s]
 22%|██▏       | 82392/371472 [6:33:07<21:59:41,  3.65it/s]
 22%|██▏       | 82393/371472 [6:33:08<21:43:47,  3.70it/s]
 22%|██▏       | 82394/371472 [6:33:08<22:03:42,  3.64it/s]
 22%|██▏       | 82395/371472 [6:33:08<21:23:45,  3.75it/s]
 22%|██▏       | 82396/371472 [6:33:08<21:08:15,  3.80it/s]
 22%|██▏       | 82397/371472 [6:33:09<21:30:50,  3.73it/s]
 22%|██▏       | 82398/371472 [6:33:09<20:59:10,  3.83it/s]
 22%|██▏       | 82399/371472 [6:33:09<21:52:12,  3.67it/s]
 22%|██▏       | 82400/371472 [6:33:09<21:49:58,  3.68it/s]
                                                           
{'loss': 4.0807, 'learning_rate': 8.007390807817449e-07, 'epoch': 3.55}

 22%|██▏       | 82400/371472 [6:33:09<21:49:58,  3.68it/s]
 22%|██▏       | 82401/371472 [6:33:10<22:02:15,  3.64it/s]
 22%|██▏       | 82402/371472 [6:33:10<21:47:32,  3.68it/s]
 22%|██▏       | 82403/371472 [6:33:11<29:28:50,  2.72it/s]
 22%|██▏       | 82404/371472 [6:33:11<27:21:48,  2.93it/s]
 22%|██▏       | 82405/371472 [6:33:11<25:34:36,  3.14it/s]
 22%|██▏       | 82406/371472 [6:33:11<24:31:17,  3.27it/s]
 22%|██▏       | 82407/371472 [6:33:12<23:29:45,  3.42it/s]
 22%|██▏       | 82408/371472 [6:33:12<22:49:53,  3.52it/s]
 22%|██▏       | 82409/371472 [6:33:12<22:22:05,  3.59it/s]
 22%|██▏       | 82410/371472 [6:33:12<21:49:35,  3.68it/s]
 22%|██▏       | 82411/371472 [6:33:13<21:24:57,  3.75it/s]
 22%|██▏       | 82412/371472 [6:33:13<21:20:50,  3.76it/s]
 22%|██▏       | 82413/371472 [6:33:13<21:21:11,  3.76it/s]
 22%|██▏       | 82414/371472 [6:33:13<22:09:45,  3.62it/s]
 22%|██▏       | 82415/371472 [6:33:14<21:16:33,  3.77it/s]
 22%|██▏       | 82416/371472 [6:33:14<22:00:56,  3.65it/s]
 22%|██▏       | 82417/371472 [6:33:14<23:13:56,  3.46it/s]
 22%|██▏       | 82418/371472 [6:33:15<22:29:03,  3.57it/s]
 22%|██▏       | 82419/371472 [6:33:15<22:22:30,  3.59it/s]
 22%|██▏       | 82420/371472 [6:33:15<22:23:45,  3.59it/s]
                                                           
{'loss': 4.076, 'learning_rate': 8.00690598806266e-07, 'epoch': 3.55}

 22%|██▏       | 82420/371472 [6:33:15<22:23:45,  3.59it/s]
 22%|██▏       | 82421/371472 [6:33:15<21:58:25,  3.65it/s]
 22%|██▏       | 82422/371472 [6:33:16<23:09:43,  3.47it/s]
 22%|██▏       | 82423/371472 [6:33:16<22:37:13,  3.55it/s]
 22%|██▏       | 82424/371472 [6:33:16<22:37:54,  3.55it/s]
 22%|██▏       | 82425/371472 [6:33:17<22:23:42,  3.59it/s]
 22%|██▏       | 82426/371472 [6:33:17<21:57:07,  3.66it/s]
 22%|██▏       | 82427/371472 [6:33:17<22:17:58,  3.60it/s]
 22%|██▏       | 82428/371472 [6:33:17<21:30:27,  3.73it/s]
 22%|██▏       | 82429/371472 [6:33:18<21:33:05,  3.73it/s]
 22%|██▏       | 82430/371472 [6:33:18<21:04:40,  3.81it/s]
 22%|██▏       | 82431/371472 [6:33:18<21:37:53,  3.71it/s]
 22%|██▏       | 82432/371472 [6:33:18<21:23:24,  3.75it/s]
 22%|██▏       | 82433/371472 [6:33:19<22:20:21,  3.59it/s]
 22%|██▏       | 82434/371472 [6:33:19<22:12:00,  3.62it/s]
 22%|██▏       | 82435/371472 [6:33:19<22:38:06,  3.55it/s]
 22%|██▏       | 82436/371472 [6:33:20<22:14:33,  3.61it/s]
 22%|██▏       | 82437/371472 [6:33:20<22:15:27,  3.61it/s]
 22%|██▏       | 82438/371472 [6:33:20<21:48:03,  3.68it/s]
 22%|██▏       | 82439/371472 [6:33:20<21:52:08,  3.67it/s]
 22%|██▏       | 82440/371472 [6:33:21<21:49:39,  3.68it/s]
                                                           
{'loss': 3.9425, 'learning_rate': 8.006421168307872e-07, 'epoch': 3.55}

 22%|██▏       | 82440/371472 [6:33:21<21:49:39,  3.68it/s]
 22%|██▏       | 82441/371472 [6:33:21<21:47:35,  3.68it/s]
 22%|██▏       | 82442/371472 [6:33:21<21:02:26,  3.82it/s]
 22%|██▏       | 82443/371472 [6:33:21<21:15:19,  3.78it/s]
 22%|██▏       | 82444/371472 [6:33:22<21:42:26,  3.70it/s]
 22%|██▏       | 82445/371472 [6:33:22<21:16:41,  3.77it/s]
 22%|██▏       | 82446/371472 [6:33:22<20:55:02,  3.84it/s]
 22%|██▏       | 82447/371472 [6:33:22<20:56:37,  3.83it/s]
 22%|██▏       | 82448/371472 [6:33:23<20:25:46,  3.93it/s]
 22%|██▏       | 82449/371472 [6:33:23<20:08:55,  3.98it/s]
 22%|██▏       | 82450/371472 [6:33:23<22:25:58,  3.58it/s]
 22%|██▏       | 82451/371472 [6:33:24<21:47:37,  3.68it/s]
 22%|██▏       | 82452/371472 [6:33:24<21:22:01,  3.76it/s]
 22%|██▏       | 82453/371472 [6:33:24<20:45:23,  3.87it/s]
 22%|██▏       | 82454/371472 [6:33:24<21:38:09,  3.71it/s]
 22%|██▏       | 82455/371472 [6:33:25<21:03:35,  3.81it/s]
 22%|██▏       | 82456/371472 [6:33:25<20:57:08,  3.83it/s]
 22%|██▏       | 82457/371472 [6:33:25<21:23:51,  3.75it/s]
 22%|██▏       | 82458/371472 [6:33:25<20:58:14,  3.83it/s]
 22%|██▏       | 82459/371472 [6:33:26<21:09:52,  3.79it/s]
 22%|██▏       | 82460/371472 [6:33:26<21:47:02,  3.69it/s]
                                                           
{'loss': 4.1282, 'learning_rate': 8.005936348553081e-07, 'epoch': 3.55}

 22%|██▏       | 82460/371472 [6:33:26<21:47:02,  3.69it/s]
 22%|██▏       | 82461/371472 [6:33:26<21:31:18,  3.73it/s]
 22%|██▏       | 82462/371472 [6:33:26<21:56:36,  3.66it/s]
 22%|██▏       | 82463/371472 [6:33:27<21:48:59,  3.68it/s]
 22%|██▏       | 82464/371472 [6:33:27<21:17:18,  3.77it/s]
 22%|██▏       | 82465/371472 [6:33:27<22:58:05,  3.50it/s]
 22%|██▏       | 82466/371472 [6:33:28<22:31:55,  3.56it/s]
 22%|██▏       | 82467/371472 [6:33:28<21:51:40,  3.67it/s]
 22%|██▏       | 82468/371472 [6:33:28<22:29:43,  3.57it/s]
 22%|██▏       | 82469/371472 [6:33:28<22:13:11,  3.61it/s]
 22%|██▏       | 82470/371472 [6:33:29<22:16:12,  3.60it/s]
 22%|██▏       | 82471/371472 [6:33:29<21:31:28,  3.73it/s]
 22%|██▏       | 82472/371472 [6:33:29<22:00:28,  3.65it/s]
 22%|██▏       | 82473/371472 [6:33:30<23:10:29,  3.46it/s]
 22%|██▏       | 82474/371472 [6:33:30<22:52:12,  3.51it/s]
 22%|██▏       | 82475/371472 [6:33:30<23:07:49,  3.47it/s]
 22%|██▏       | 82476/371472 [6:33:30<22:25:28,  3.58it/s]
 22%|██▏       | 82477/371472 [6:33:31<23:04:22,  3.48it/s]
 22%|██▏       | 82478/371472 [6:33:31<22:05:19,  3.63it/s]
 22%|██▏       | 82479/371472 [6:33:31<22:27:15,  3.58it/s]
 22%|██▏       | 82480/371472 [6:33:31<21:41:33,  3.70it/s]
                                                           
{'loss': 4.0561, 'learning_rate': 8.005451528798293e-07, 'epoch': 3.55}

 22%|██▏       | 82480/371472 [6:33:31<21:41:33,  3.70it/s]
 22%|██▏       | 82481/371472 [6:33:32<22:50:43,  3.51it/s]
 22%|██▏       | 82482/371472 [6:33:32<24:55:39,  3.22it/s]
 22%|██▏       | 82483/371472 [6:33:32<23:56:57,  3.35it/s]
 22%|██▏       | 82484/371472 [6:33:33<24:32:49,  3.27it/s]
 22%|██▏       | 82485/371472 [6:33:33<23:00:14,  3.49it/s]
 22%|██▏       | 82486/371472 [6:33:33<24:13:34,  3.31it/s]
 22%|██▏       | 82487/371472 [6:33:34<23:32:31,  3.41it/s]
 22%|██▏       | 82488/371472 [6:33:34<23:23:50,  3.43it/s]
 22%|██▏       | 82489/371472 [6:33:34<23:09:55,  3.47it/s]
 22%|██▏       | 82490/371472 [6:33:34<22:25:11,  3.58it/s]
 22%|██▏       | 82491/371472 [6:33:35<21:20:20,  3.76it/s]
 22%|██▏       | 82492/371472 [6:33:35<22:07:27,  3.63it/s]
 22%|██▏       | 82493/371472 [6:33:35<21:42:44,  3.70it/s]
 22%|██▏       | 82494/371472 [6:33:36<21:55:25,  3.66it/s]
 22%|██▏       | 82495/371472 [6:33:36<21:40:57,  3.70it/s]
 22%|██▏       | 82496/371472 [6:33:36<21:23:02,  3.75it/s]
 22%|██▏       | 82497/371472 [6:33:36<23:11:19,  3.46it/s]
 22%|██▏       | 82498/371472 [6:33:37<22:50:13,  3.51it/s]
 22%|██▏       | 82499/371472 [6:33:37<22:44:00,  3.53it/s]
 22%|██▏       | 82500/371472 [6:33:37<22:44:49,  3.53it/s]
                                                           
{'loss': 4.1453, 'learning_rate': 8.004966709043504e-07, 'epoch': 3.55}

 22%|██▏       | 82500/371472 [6:33:37<22:44:49,  3.53it/s]
 22%|██▏       | 82501/371472 [6:33:38<23:08:46,  3.47it/s]
 22%|██▏       | 82502/371472 [6:33:38<22:37:01,  3.55it/s]
 22%|██▏       | 82503/371472 [6:33:38<22:25:22,  3.58it/s]
 22%|██▏       | 82504/371472 [6:33:38<23:21:16,  3.44it/s]
 22%|██▏       | 82505/371472 [6:33:39<22:51:31,  3.51it/s]
 22%|██▏       | 82506/371472 [6:33:39<22:33:18,  3.56it/s]
 22%|██▏       | 82507/371472 [6:33:39<22:02:25,  3.64it/s]
 22%|██▏       | 82508/371472 [6:33:40<23:54:08,  3.36it/s]
 22%|██▏       | 82509/371472 [6:33:40<24:08:37,  3.32it/s]
 22%|██▏       | 82510/371472 [6:33:40<22:55:14,  3.50it/s]
 22%|██▏       | 82511/371472 [6:33:40<23:56:21,  3.35it/s]
 22%|██▏       | 82512/371472 [6:33:41<23:31:23,  3.41it/s]
 22%|██▏       | 82513/371472 [6:33:41<22:46:22,  3.52it/s]
 22%|██▏       | 82514/371472 [6:33:41<22:14:40,  3.61it/s]
 22%|██▏       | 82515/371472 [6:33:42<22:45:28,  3.53it/s]
 22%|██▏       | 82516/371472 [6:33:42<23:19:37,  3.44it/s]
 22%|██▏       | 82517/371472 [6:33:42<22:18:06,  3.60it/s]
 22%|██▏       | 82518/371472 [6:33:42<21:21:59,  3.76it/s]
 22%|██▏       | 82519/371472 [6:33:43<21:07:49,  3.80it/s]
 22%|██▏       | 82520/371472 [6:33:43<21:45:59,  3.69it/s]
                                                           
{'loss': 4.0067, 'learning_rate': 8.004481889288716e-07, 'epoch': 3.55}

 22%|██▏       | 82520/371472 [6:33:43<21:45:59,  3.69it/s]
 22%|██▏       | 82521/371472 [6:33:43<21:28:43,  3.74it/s]
 22%|██▏       | 82522/371472 [6:33:43<22:27:30,  3.57it/s]
 22%|██▏       | 82523/371472 [6:33:44<22:39:25,  3.54it/s]
 22%|██▏       | 82524/371472 [6:33:44<22:40:48,  3.54it/s]
 22%|██▏       | 82525/371472 [6:33:44<23:58:33,  3.35it/s]
 22%|██▏       | 82526/371472 [6:33:45<23:16:42,  3.45it/s]
 22%|██▏       | 82527/371472 [6:33:45<22:47:41,  3.52it/s]
 22%|██▏       | 82528/371472 [6:33:45<21:52:35,  3.67it/s]
 22%|██▏       | 82529/371472 [6:33:45<21:36:03,  3.72it/s]
 22%|██▏       | 82530/371472 [6:33:46<20:56:50,  3.83it/s]
 22%|██▏       | 82531/371472 [6:33:46<21:17:38,  3.77it/s]
 22%|██▏       | 82532/371472 [6:33:46<21:50:35,  3.67it/s]
 22%|██▏       | 82533/371472 [6:33:46<22:04:29,  3.64it/s]
 22%|██▏       | 82534/371472 [6:33:47<21:47:36,  3.68it/s]
 22%|██▏       | 82535/371472 [6:33:47<24:42:20,  3.25it/s]
 22%|██▏       | 82536/371472 [6:33:47<23:28:38,  3.42it/s]
 22%|██▏       | 82537/371472 [6:33:48<22:40:13,  3.54it/s]
 22%|██▏       | 82538/371472 [6:33:48<22:29:19,  3.57it/s]
 22%|██▏       | 82539/371472 [6:33:48<22:17:28,  3.60it/s]
 22%|██▏       | 82540/371472 [6:33:48<22:33:28,  3.56it/s]
                                                           
{'loss': 4.0551, 'learning_rate': 8.003997069533926e-07, 'epoch': 3.56}

 22%|██▏       | 82540/371472 [6:33:48<22:33:28,  3.56it/s]
 22%|██▏       | 82541/371472 [6:33:49<22:32:14,  3.56it/s]
 22%|██▏       | 82542/371472 [6:33:49<22:41:41,  3.54it/s]
 22%|██▏       | 82543/371472 [6:33:49<25:00:00,  3.21it/s]
 22%|██▏       | 82544/371472 [6:33:50<24:52:37,  3.23it/s]
 22%|██▏       | 82545/371472 [6:33:50<23:56:27,  3.35it/s]
 22%|██▏       | 82546/371472 [6:33:50<23:01:06,  3.49it/s]
 22%|██▏       | 82547/371472 [6:33:51<22:23:02,  3.59it/s]
 22%|██▏       | 82548/371472 [6:33:51<21:36:04,  3.72it/s]
 22%|██▏       | 82549/371472 [6:33:51<21:23:46,  3.75it/s]
 22%|██▏       | 82550/371472 [6:33:51<21:26:35,  3.74it/s]
 22%|██▏       | 82551/371472 [6:33:52<22:46:17,  3.52it/s]
 22%|██▏       | 82552/371472 [6:33:52<23:16:00,  3.45it/s]
 22%|██▏       | 82553/371472 [6:33:52<22:30:10,  3.57it/s]
 22%|██▏       | 82554/371472 [6:33:52<22:38:32,  3.54it/s]
 22%|██▏       | 82555/371472 [6:33:53<23:03:29,  3.48it/s]
 22%|██▏       | 82556/371472 [6:33:53<22:22:27,  3.59it/s]
 22%|██▏       | 82557/371472 [6:33:53<23:17:55,  3.44it/s]
 22%|██▏       | 82558/371472 [6:33:54<21:58:58,  3.65it/s]
 22%|██▏       | 82559/371472 [6:33:54<21:52:54,  3.67it/s]
 22%|██▏       | 82560/371472 [6:33:54<22:04:38,  3.64it/s]
                                                           
{'loss': 4.0325, 'learning_rate': 8.003512249779137e-07, 'epoch': 3.56}

 22%|██▏       | 82560/371472 [6:33:54<22:04:38,  3.64it/s]
 22%|██▏       | 82561/371472 [6:33:54<21:38:33,  3.71it/s]
 22%|██▏       | 82562/371472 [6:33:55<21:55:59,  3.66it/s]
 22%|██▏       | 82563/371472 [6:33:55<22:45:53,  3.53it/s]
 22%|██▏       | 82564/371472 [6:33:55<22:49:28,  3.52it/s]
 22%|██▏       | 82565/371472 [6:33:56<23:38:37,  3.39it/s]
 22%|██▏       | 82566/371472 [6:33:56<22:34:08,  3.56it/s]
 22%|██▏       | 82567/371472 [6:33:56<21:28:37,  3.74it/s]
 22%|██▏       | 82568/371472 [6:33:56<20:48:51,  3.86it/s]
 22%|██▏       | 82569/371472 [6:33:57<21:06:07,  3.80it/s]
 22%|██▏       | 82570/371472 [6:33:57<21:02:46,  3.81it/s]
 22%|██▏       | 82571/371472 [6:33:57<22:47:08,  3.52it/s]
 22%|██▏       | 82572/371472 [6:33:57<21:59:55,  3.65it/s]
 22%|██▏       | 82573/371472 [6:33:58<21:13:25,  3.78it/s]
 22%|██▏       | 82574/371472 [6:33:58<22:55:36,  3.50it/s]
 22%|██▏       | 82575/371472 [6:33:58<23:52:01,  3.36it/s]
 22%|██▏       | 82576/371472 [6:33:59<22:38:11,  3.55it/s]
 22%|██▏       | 82577/371472 [6:33:59<21:34:10,  3.72it/s]
 22%|██▏       | 82578/371472 [6:33:59<22:32:49,  3.56it/s]
 22%|██▏       | 82579/371472 [6:33:59<22:09:12,  3.62it/s]
 22%|██▏       | 82580/371472 [6:34:00<23:29:34,  3.42it/s]
                                                           
{'loss': 4.1309, 'learning_rate': 8.003027430024348e-07, 'epoch': 3.56}

 22%|██▏       | 82580/371472 [6:34:00<23:29:34,  3.42it/s]
 22%|██▏       | 82581/371472 [6:34:00<23:09:52,  3.46it/s]
 22%|██▏       | 82582/371472 [6:34:00<22:49:34,  3.52it/s]
 22%|██▏       | 82583/371472 [6:34:01<22:51:18,  3.51it/s]
 22%|██▏       | 82584/371472 [6:34:01<22:04:55,  3.63it/s]
 22%|██▏       | 82585/371472 [6:34:01<21:44:49,  3.69it/s]
 22%|██▏       | 82586/371472 [6:34:01<20:57:57,  3.83it/s]
 22%|██▏       | 82587/371472 [6:34:02<22:08:57,  3.62it/s]
 22%|██▏       | 82588/371472 [6:34:02<22:09:21,  3.62it/s]
 22%|██▏       | 82589/371472 [6:34:02<22:49:32,  3.52it/s]
 22%|██▏       | 82590/371472 [6:34:02<21:57:20,  3.65it/s]
 22%|██▏       | 82591/371472 [6:34:03<22:53:07,  3.51it/s]
 22%|██▏       | 82592/371472 [6:34:03<22:44:35,  3.53it/s]
 22%|██▏       | 82593/371472 [6:34:03<24:54:39,  3.22it/s]
 22%|██▏       | 82594/371472 [6:34:04<25:09:40,  3.19it/s]
 22%|██▏       | 82595/371472 [6:34:04<24:21:52,  3.29it/s]
 22%|██▏       | 82596/371472 [6:34:04<22:44:00,  3.53it/s]
 22%|██▏       | 82597/371472 [6:34:04<22:01:19,  3.64it/s]
 22%|██▏       | 82598/371472 [6:34:05<21:23:53,  3.75it/s]
 22%|██▏       | 82599/371472 [6:34:05<22:39:20,  3.54it/s]
 22%|██▏       | 82600/371472 [6:34:05<22:26:31,  3.58it/s]
                                                           
{'loss': 4.1027, 'learning_rate': 8.00254261026956e-07, 'epoch': 3.56}

 22%|██▏       | 82600/371472 [6:34:05<22:26:31,  3.58it/s]
 22%|██▏       | 82601/371472 [6:34:06<23:16:33,  3.45it/s]
 22%|██▏       | 82602/371472 [6:34:06<21:53:19,  3.67it/s]
 22%|██▏       | 82603/371472 [6:34:06<25:20:27,  3.17it/s]
 22%|██▏       | 82604/371472 [6:34:07<25:23:52,  3.16it/s]
 22%|██▏       | 82605/371472 [6:34:07<24:16:33,  3.31it/s]
 22%|██▏       | 82606/371472 [6:34:07<23:53:58,  3.36it/s]
 22%|██▏       | 82607/371472 [6:34:07<22:50:19,  3.51it/s]
 22%|██▏       | 82608/371472 [6:34:08<22:15:47,  3.60it/s]
 22%|██▏       | 82609/371472 [6:34:08<23:19:26,  3.44it/s]
 22%|██▏       | 82610/371472 [6:34:08<23:39:55,  3.39it/s]
 22%|██▏       | 82611/371472 [6:34:09<24:05:27,  3.33it/s]
 22%|██▏       | 82612/371472 [6:34:09<23:20:13,  3.44it/s]
 22%|██▏       | 82613/371472 [6:34:10<33:18:32,  2.41it/s]
 22%|██▏       | 82614/371472 [6:34:10<29:24:30,  2.73it/s]
 22%|██▏       | 82615/371472 [6:34:10<26:44:50,  3.00it/s]
 22%|██▏       | 82616/371472 [6:34:10<25:02:45,  3.20it/s]
 22%|██▏       | 82617/371472 [6:34:11<23:29:28,  3.42it/s]
 22%|██▏       | 82618/371472 [6:34:11<22:07:49,  3.63it/s]
 22%|██▏       | 82619/371472 [6:34:11<21:33:30,  3.72it/s]
 22%|██▏       | 82620/371472 [6:34:11<20:57:07,  3.83it/s]
                                                           
{'loss': 4.0887, 'learning_rate': 8.00205779051477e-07, 'epoch': 3.56}

 22%|██▏       | 82620/371472 [6:34:11<20:57:07,  3.83it/s]
 22%|██▏       | 82621/371472 [6:34:12<21:26:47,  3.74it/s]
 22%|██▏       | 82622/371472 [6:34:12<21:51:43,  3.67it/s]
 22%|██▏       | 82623/371472 [6:34:12<22:14:32,  3.61it/s]
 22%|██▏       | 82624/371472 [6:34:13<22:42:07,  3.53it/s]
 22%|██▏       | 82625/371472 [6:34:13<21:35:05,  3.72it/s]
 22%|██▏       | 82626/371472 [6:34:13<21:40:51,  3.70it/s]
 22%|██▏       | 82627/371472 [6:34:13<25:12:28,  3.18it/s]
 22%|██▏       | 82628/371472 [6:34:14<23:35:23,  3.40it/s]
 22%|██▏       | 82629/371472 [6:34:14<23:20:42,  3.44it/s]
 22%|██▏       | 82630/371472 [6:34:14<23:05:57,  3.47it/s]
 22%|██▏       | 82631/371472 [6:34:15<23:01:16,  3.49it/s]
 22%|██▏       | 82632/371472 [6:34:15<22:42:22,  3.53it/s]
 22%|██▏       | 82633/371472 [6:34:15<22:41:35,  3.54it/s]
 22%|██▏       | 82634/371472 [6:34:15<23:01:07,  3.49it/s]
 22%|██▏       | 82635/371472 [6:34:16<23:19:03,  3.44it/s]
 22%|██▏       | 82636/371472 [6:34:16<24:57:13,  3.22it/s]
 22%|██▏       | 82637/371472 [6:34:16<23:33:07,  3.41it/s]
 22%|██▏       | 82638/371472 [6:34:17<22:13:28,  3.61it/s]
 22%|██▏       | 82639/371472 [6:34:17<21:44:23,  3.69it/s]
 22%|██▏       | 82640/371472 [6:34:17<23:42:09,  3.38it/s]
                                                           
{'loss': 4.1003, 'learning_rate': 8.001572970759981e-07, 'epoch': 3.56}

 22%|██▏       | 82640/371472 [6:34:17<23:42:09,  3.38it/s]
 22%|██▏       | 82641/371472 [6:34:17<25:10:29,  3.19it/s]
 22%|██▏       | 82642/371472 [6:34:18<24:26:38,  3.28it/s]
 22%|██▏       | 82643/371472 [6:34:18<23:35:43,  3.40it/s]
 22%|██▏       | 82644/371472 [6:34:18<23:40:42,  3.39it/s]
 22%|██▏       | 82645/371472 [6:34:19<22:30:30,  3.56it/s]
 22%|██▏       | 82646/371472 [6:34:19<22:45:30,  3.53it/s]
 22%|██▏       | 82647/371472 [6:34:19<21:47:39,  3.68it/s]
 22%|██▏       | 82648/371472 [6:34:19<21:55:23,  3.66it/s]
 22%|██▏       | 82649/371472 [6:34:20<21:28:12,  3.74it/s]
 22%|██▏       | 82650/371472 [6:34:20<22:16:08,  3.60it/s]
 22%|██▏       | 82651/371472 [6:34:20<22:03:05,  3.64it/s]
 22%|██▏       | 82652/371472 [6:34:21<22:37:53,  3.54it/s]
 22%|██▏       | 82653/371472 [6:34:21<22:07:29,  3.63it/s]
 22%|██▏       | 82654/371472 [6:34:21<22:33:37,  3.56it/s]
 22%|██▏       | 82655/371472 [6:34:21<22:59:37,  3.49it/s]
 22%|██▏       | 82656/371472 [6:34:22<21:37:08,  3.71it/s]
 22%|██▏       | 82657/371472 [6:34:22<22:17:51,  3.60it/s]
 22%|██▏       | 82658/371472 [6:34:22<22:04:45,  3.63it/s]
 22%|██▏       | 82659/371472 [6:34:22<22:28:33,  3.57it/s]
 22%|██▏       | 82660/371472 [6:34:23<22:06:10,  3.63it/s]
                                                           
{'loss': 3.9115, 'learning_rate': 8.001088151005193e-07, 'epoch': 3.56}

 22%|██▏       | 82660/371472 [6:34:23<22:06:10,  3.63it/s]
 22%|██▏       | 82661/371472 [6:34:23<21:25:07,  3.75it/s]
 22%|██▏       | 82662/371472 [6:34:23<21:45:08,  3.69it/s]
 22%|██▏       | 82663/371472 [6:34:24<24:15:56,  3.31it/s]
 22%|██▏       | 82664/371472 [6:34:24<23:03:19,  3.48it/s]
 22%|██▏       | 82665/371472 [6:34:24<23:26:34,  3.42it/s]
 22%|██▏       | 82666/371472 [6:34:24<22:16:52,  3.60it/s]
 22%|██▏       | 82667/371472 [6:34:25<21:35:46,  3.71it/s]
 22%|██▏       | 82668/371472 [6:34:25<22:21:16,  3.59it/s]
 22%|██▏       | 82669/371472 [6:34:25<22:47:00,  3.52it/s]
 22%|██▏       | 82670/371472 [6:34:26<23:19:05,  3.44it/s]
 22%|██▏       | 82671/371472 [6:34:26<22:59:59,  3.49it/s]
 22%|██▏       | 82672/371472 [6:34:26<22:55:10,  3.50it/s]
 22%|██▏       | 82673/371472 [6:34:26<22:11:43,  3.61it/s]
 22%|██▏       | 82674/371472 [6:34:27<21:25:11,  3.75it/s]
 22%|██▏       | 82675/371472 [6:34:27<20:53:26,  3.84it/s]
 22%|██▏       | 82676/371472 [6:34:27<21:12:54,  3.78it/s]
 22%|██▏       | 82677/371472 [6:34:27<22:12:40,  3.61it/s]
 22%|██▏       | 82678/371472 [6:34:28<23:55:09,  3.35it/s]
 22%|██▏       | 82679/371472 [6:34:28<23:31:26,  3.41it/s]
 22%|██▏       | 82680/371472 [6:34:28<23:47:05,  3.37it/s]
                                                           
{'loss': 3.8889, 'learning_rate': 8.000603331250406e-07, 'epoch': 3.56}

 22%|██▏       | 82680/371472 [6:34:28<23:47:05,  3.37it/s]
 22%|██▏       | 82681/371472 [6:34:29<23:03:49,  3.48it/s]
 22%|██▏       | 82682/371472 [6:34:29<22:41:56,  3.53it/s]
 22%|██▏       | 82683/371472 [6:34:29<22:21:12,  3.59it/s]
 22%|██▏       | 82684/371472 [6:34:29<21:46:10,  3.68it/s]
 22%|██▏       | 82685/371472 [6:34:30<22:16:02,  3.60it/s]
 22%|██▏       | 82686/371472 [6:34:30<21:57:49,  3.65it/s]
 22%|██▏       | 82687/371472 [6:34:30<21:24:01,  3.75it/s]
 22%|██▏       | 82688/371472 [6:34:31<21:12:55,  3.78it/s]
 22%|██▏       | 82689/371472 [6:34:31<21:56:39,  3.66it/s]
 22%|██▏       | 82690/371472 [6:34:31<21:30:57,  3.73it/s]
 22%|██▏       | 82691/371472 [6:34:31<21:36:18,  3.71it/s]
 22%|██▏       | 82692/371472 [6:34:32<21:37:45,  3.71it/s]
 22%|██▏       | 82693/371472 [6:34:32<22:08:55,  3.62it/s]
 22%|██▏       | 82694/371472 [6:34:32<22:04:14,  3.63it/s]
 22%|██▏       | 82695/371472 [6:34:32<22:12:52,  3.61it/s]
 22%|██▏       | 82696/371472 [6:34:33<23:01:57,  3.48it/s]
 22%|██▏       | 82697/371472 [6:34:33<22:45:13,  3.53it/s]
 22%|██▏       | 82698/371472 [6:34:33<22:03:42,  3.64it/s]
 22%|██▏       | 82699/371472 [6:34:34<22:41:23,  3.54it/s]
 22%|██▏       | 82700/371472 [6:34:34<22:46:00,  3.52it/s]
                                                           
{'loss': 4.2752, 'learning_rate': 8.000118511495615e-07, 'epoch': 3.56}

 22%|██▏       | 82700/371472 [6:34:34<22:46:00,  3.52it/s]
 22%|██▏       | 82701/371472 [6:34:34<22:31:06,  3.56it/s]
 22%|██▏       | 82702/371472 [6:34:35<23:30:25,  3.41it/s]
 22%|██▏       | 82703/371472 [6:34:35<22:27:56,  3.57it/s]
 22%|██▏       | 82704/371472 [6:34:35<22:49:30,  3.51it/s]
 22%|██▏       | 82705/371472 [6:34:35<22:27:53,  3.57it/s]
 22%|██▏       | 82706/371472 [6:34:36<23:36:23,  3.40it/s]
 22%|██▏       | 82707/371472 [6:34:36<23:27:27,  3.42it/s]
 22%|██▏       | 82708/371472 [6:34:36<23:53:14,  3.36it/s]
 22%|██▏       | 82709/371472 [6:34:36<22:40:02,  3.54it/s]
 22%|██▏       | 82710/371472 [6:34:37<23:00:17,  3.49it/s]
 22%|██▏       | 82711/371472 [6:34:37<22:24:06,  3.58it/s]
 22%|██▏       | 82712/371472 [6:34:37<21:49:33,  3.68it/s]
 22%|██▏       | 82713/371472 [6:34:38<23:02:41,  3.48it/s]
 22%|██▏       | 82714/371472 [6:34:38<22:07:59,  3.62it/s]
 22%|██▏       | 82715/371472 [6:34:38<22:02:15,  3.64it/s]
 22%|██▏       | 82716/371472 [6:34:38<22:08:49,  3.62it/s]
 22%|██▏       | 82717/371472 [6:34:39<22:41:08,  3.54it/s]
 22%|██▏       | 82718/371472 [6:34:39<23:23:19,  3.43it/s]
 22%|██▏       | 82719/371472 [6:34:39<24:30:31,  3.27it/s]
 22%|██▏       | 82720/371472 [6:34:40<23:41:54,  3.38it/s]
                                                           
{'loss': 4.1105, 'learning_rate': 7.999633691740825e-07, 'epoch': 3.56}

 22%|██▏       | 82720/371472 [6:34:40<23:41:54,  3.38it/s]
 22%|██▏       | 82721/371472 [6:34:40<23:21:00,  3.44it/s]
 22%|██▏       | 82722/371472 [6:34:40<22:50:13,  3.51it/s]
 22%|██▏       | 82723/371472 [6:34:41<23:17:00,  3.44it/s]
 22%|██▏       | 82724/371472 [6:34:41<24:12:24,  3.31it/s]
 22%|██▏       | 82725/371472 [6:34:41<23:26:07,  3.42it/s]
 22%|██▏       | 82726/371472 [6:34:41<22:59:54,  3.49it/s]
 22%|██▏       | 82727/371472 [6:34:42<22:19:31,  3.59it/s]
 22%|██▏       | 82728/371472 [6:34:42<21:43:33,  3.69it/s]
 22%|██▏       | 82729/371472 [6:34:42<21:20:42,  3.76it/s]
 22%|██▏       | 82730/371472 [6:34:42<21:21:50,  3.75it/s]
 22%|██▏       | 82731/371472 [6:34:43<21:05:18,  3.80it/s]
 22%|██▏       | 82732/371472 [6:34:43<21:53:16,  3.66it/s]
 22%|██▏       | 82733/371472 [6:34:43<21:36:46,  3.71it/s]
 22%|██▏       | 82734/371472 [6:34:44<22:13:52,  3.61it/s]
 22%|██▏       | 82735/371472 [6:34:44<22:55:50,  3.50it/s]
 22%|██▏       | 82736/371472 [6:34:44<24:07:24,  3.32it/s]
 22%|██▏       | 82737/371472 [6:34:44<22:39:48,  3.54it/s]
 22%|██▏       | 82738/371472 [6:34:45<23:45:45,  3.38it/s]
 22%|██▏       | 82739/371472 [6:34:45<23:24:35,  3.43it/s]
 22%|██▏       | 82740/371472 [6:34:45<22:46:33,  3.52it/s]
                                                           
{'loss': 3.9305, 'learning_rate': 7.999148871986037e-07, 'epoch': 3.56}

 22%|██▏       | 82740/371472 [6:34:45<22:46:33,  3.52it/s]
 22%|██▏       | 82741/371472 [6:34:46<22:47:28,  3.52it/s]
 22%|██▏       | 82742/371472 [6:34:46<21:55:37,  3.66it/s]
 22%|██▏       | 82743/371472 [6:34:46<22:50:32,  3.51it/s]
 22%|██▏       | 82744/371472 [6:34:46<22:34:25,  3.55it/s]
 22%|██▏       | 82745/371472 [6:34:47<22:18:03,  3.60it/s]
 22%|██▏       | 82746/371472 [6:34:47<22:36:57,  3.55it/s]
 22%|██▏       | 82747/371472 [6:34:47<22:39:29,  3.54it/s]
 22%|██▏       | 82748/371472 [6:34:48<24:08:32,  3.32it/s]
 22%|██▏       | 82749/371472 [6:34:48<23:16:11,  3.45it/s]
 22%|██▏       | 82750/371472 [6:34:48<22:14:32,  3.61it/s]
 22%|██▏       | 82751/371472 [6:34:48<22:11:14,  3.61it/s]
 22%|██▏       | 82752/371472 [6:34:49<21:33:22,  3.72it/s]
 22%|██▏       | 82753/371472 [6:34:49<22:10:19,  3.62it/s]
 22%|██▏       | 82754/371472 [6:34:49<22:17:32,  3.60it/s]
 22%|██▏       | 82755/371472 [6:34:49<22:08:42,  3.62it/s]
 22%|██▏       | 82756/371472 [6:34:50<21:26:24,  3.74it/s]
 22%|██▏       | 82757/371472 [6:34:50<21:48:01,  3.68it/s]
 22%|██▏       | 82758/371472 [6:34:50<22:08:00,  3.62it/s]
 22%|██▏       | 82759/371472 [6:34:51<23:15:24,  3.45it/s]
 22%|██▏       | 82760/371472 [6:34:51<22:28:34,  3.57it/s]
                                                           
{'loss': 4.221, 'learning_rate': 7.998664052231247e-07, 'epoch': 3.56}

 22%|██▏       | 82760/371472 [6:34:51<22:28:34,  3.57it/s]
 22%|██▏       | 82761/371472 [6:34:51<22:23:33,  3.58it/s]
 22%|██▏       | 82762/371472 [6:34:51<23:09:11,  3.46it/s]
 22%|██▏       | 82763/371472 [6:34:52<22:01:26,  3.64it/s]
 22%|██▏       | 82764/371472 [6:34:52<22:01:24,  3.64it/s]
 22%|██▏       | 82765/371472 [6:34:52<23:28:00,  3.42it/s]
 22%|██▏       | 82766/371472 [6:34:53<22:54:09,  3.50it/s]
 22%|██▏       | 82767/371472 [6:34:53<22:00:33,  3.64it/s]
 22%|██▏       | 82768/371472 [6:34:53<24:05:36,  3.33it/s]
 22%|██▏       | 82769/371472 [6:34:53<23:25:23,  3.42it/s]
 22%|██▏       | 82770/371472 [6:34:54<23:31:55,  3.41it/s]
 22%|██▏       | 82771/371472 [6:34:54<22:28:05,  3.57it/s]
 22%|██▏       | 82772/371472 [6:34:54<23:30:56,  3.41it/s]
 22%|██▏       | 82773/371472 [6:34:55<22:50:14,  3.51it/s]
 22%|██▏       | 82774/371472 [6:34:55<21:42:58,  3.69it/s]
 22%|██▏       | 82775/371472 [6:34:55<20:59:06,  3.82it/s]
 22%|██▏       | 82776/371472 [6:34:55<22:23:58,  3.58it/s]
 22%|██▏       | 82777/371472 [6:34:56<22:11:06,  3.61it/s]
 22%|██▏       | 82778/371472 [6:34:56<22:31:38,  3.56it/s]
 22%|██▏       | 82779/371472 [6:34:56<22:21:51,  3.59it/s]
 22%|██▏       | 82780/371472 [6:34:57<23:48:18,  3.37it/s]
                                                           
{'loss': 3.8642, 'learning_rate': 7.998179232476459e-07, 'epoch': 3.57}

 22%|██▏       | 82780/371472 [6:34:57<23:48:18,  3.37it/s]
 22%|██▏       | 82781/371472 [6:34:57<24:08:15,  3.32it/s]
 22%|██▏       | 82782/371472 [6:34:57<23:26:23,  3.42it/s]
 22%|██▏       | 82783/371472 [6:34:57<24:06:08,  3.33it/s]
 22%|██▏       | 82784/371472 [6:34:58<23:21:55,  3.43it/s]
 22%|██▏       | 82785/371472 [6:34:58<24:32:49,  3.27it/s]
 22%|██▏       | 82786/371472 [6:34:58<23:45:22,  3.38it/s]
 22%|██▏       | 82787/371472 [6:34:59<22:40:30,  3.54it/s]
 22%|██▏       | 82788/371472 [6:34:59<22:48:47,  3.52it/s]
 22%|██▏       | 82789/371472 [6:34:59<22:40:29,  3.54it/s]
 22%|██▏       | 82790/371472 [6:34:59<22:11:55,  3.61it/s]
 22%|██▏       | 82791/371472 [6:35:00<22:31:18,  3.56it/s]
 22%|██▏       | 82792/371472 [6:35:00<22:11:07,  3.61it/s]
 22%|██▏       | 82793/371472 [6:35:00<22:00:39,  3.64it/s]
 22%|██▏       | 82794/371472 [6:35:01<23:31:20,  3.41it/s]
 22%|██▏       | 82795/371472 [6:35:01<22:49:00,  3.51it/s]
 22%|██▏       | 82796/371472 [6:35:01<22:43:53,  3.53it/s]
 22%|██▏       | 82797/371472 [6:35:01<21:48:36,  3.68it/s]
 22%|██▏       | 82798/371472 [6:35:02<22:36:33,  3.55it/s]
 22%|██▏       | 82799/371472 [6:35:02<21:53:26,  3.66it/s]
 22%|██▏       | 82800/371472 [6:35:02<21:45:15,  3.69it/s]
                                                           
{'loss': 4.0657, 'learning_rate': 7.99769441272167e-07, 'epoch': 3.57}

 22%|██▏       | 82800/371472 [6:35:02<21:45:15,  3.69it/s]
 22%|██▏       | 82801/371472 [6:35:02<21:55:30,  3.66it/s]
 22%|██▏       | 82802/371472 [6:35:03<21:21:20,  3.75it/s]
 22%|██▏       | 82803/371472 [6:35:03<21:54:53,  3.66it/s]
 22%|██▏       | 82804/371472 [6:35:03<21:38:35,  3.70it/s]
 22%|██▏       | 82805/371472 [6:35:04<20:58:40,  3.82it/s]
 22%|██▏       | 82806/371472 [6:35:04<21:13:14,  3.78it/s]
 22%|██▏       | 82807/371472 [6:35:04<21:08:28,  3.79it/s]
 22%|██▏       | 82808/371472 [6:35:04<20:46:48,  3.86it/s]
 22%|██▏       | 82809/371472 [6:35:05<22:04:28,  3.63it/s]
 22%|██▏       | 82810/371472 [6:35:05<21:40:19,  3.70it/s]
 22%|██▏       | 82811/371472 [6:35:05<21:03:40,  3.81it/s]
 22%|██▏       | 82812/371472 [6:35:05<20:32:41,  3.90it/s]
 22%|██▏       | 82813/371472 [6:35:06<20:34:51,  3.90it/s]
 22%|██▏       | 82814/371472 [6:35:06<21:16:49,  3.77it/s]
 22%|██▏       | 82815/371472 [6:35:06<21:06:26,  3.80it/s]
 22%|██▏       | 82816/371472 [6:35:06<21:33:32,  3.72it/s]
 22%|██▏       | 82817/371472 [6:35:07<22:06:08,  3.63it/s]
 22%|██▏       | 82818/371472 [6:35:07<23:47:30,  3.37it/s]
 22%|██▏       | 82819/371472 [6:35:07<24:05:07,  3.33it/s]
 22%|██▏       | 82820/371472 [6:35:08<23:30:48,  3.41it/s]
                                                           
{'loss': 4.0627, 'learning_rate': 7.997209592966882e-07, 'epoch': 3.57}

 22%|██▏       | 82820/371472 [6:35:08<23:30:48,  3.41it/s]
 22%|██▏       | 82821/371472 [6:35:08<22:21:42,  3.59it/s]
 22%|██▏       | 82822/371472 [6:35:08<22:11:10,  3.61it/s]
 22%|██▏       | 82823/371472 [6:35:08<21:30:18,  3.73it/s]
 22%|██▏       | 82824/371472 [6:35:09<20:28:47,  3.92it/s]
 22%|██▏       | 82825/371472 [6:35:09<22:23:54,  3.58it/s]
 22%|██▏       | 82826/371472 [6:35:09<21:40:49,  3.70it/s]
 22%|██▏       | 82827/371472 [6:35:10<21:50:51,  3.67it/s]
 22%|██▏       | 82828/371472 [6:35:10<22:22:27,  3.58it/s]
 22%|██▏       | 82829/371472 [6:35:10<22:14:19,  3.61it/s]
 22%|██▏       | 82830/371472 [6:35:10<22:21:12,  3.59it/s]
 22%|██▏       | 82831/371472 [6:35:11<21:33:51,  3.72it/s]
 22%|██▏       | 82832/371472 [6:35:11<23:41:50,  3.38it/s]
 22%|██▏       | 82833/371472 [6:35:11<23:39:36,  3.39it/s]
 22%|██▏       | 82834/371472 [6:35:12<24:06:01,  3.33it/s]
 22%|██▏       | 82835/371472 [6:35:12<22:58:00,  3.49it/s]
 22%|██▏       | 82836/371472 [6:35:12<23:01:28,  3.48it/s]
 22%|██▏       | 82837/371472 [6:35:12<23:31:52,  3.41it/s]
 22%|██▏       | 82838/371472 [6:35:13<24:11:30,  3.31it/s]
 22%|██▏       | 82839/371472 [6:35:13<26:57:36,  2.97it/s]
 22%|██▏       | 82840/371472 [6:35:14<27:23:22,  2.93it/s]
                                                           
{'loss': 3.9574, 'learning_rate': 7.996724773212091e-07, 'epoch': 3.57}

 22%|██▏       | 82840/371472 [6:35:14<27:23:22,  2.93it/s]
 22%|██▏       | 82841/371472 [6:35:14<26:21:30,  3.04it/s]
 22%|██▏       | 82842/371472 [6:35:14<24:21:52,  3.29it/s]
 22%|██▏       | 82843/371472 [6:35:14<23:29:27,  3.41it/s]
 22%|██▏       | 82844/371472 [6:35:15<23:34:14,  3.40it/s]
 22%|██▏       | 82845/371472 [6:35:15<22:35:20,  3.55it/s]
 22%|██▏       | 82846/371472 [6:35:15<24:19:31,  3.30it/s]
 22%|██▏       | 82847/371472 [6:35:16<23:53:38,  3.36it/s]
 22%|██▏       | 82848/371472 [6:35:16<23:43:04,  3.38it/s]
 22%|██▏       | 82849/371472 [6:35:16<22:33:15,  3.55it/s]
 22%|██▏       | 82850/371472 [6:35:16<25:09:57,  3.19it/s]
 22%|██▏       | 82851/371472 [6:35:17<23:29:09,  3.41it/s]
 22%|██▏       | 82852/371472 [6:35:17<22:48:44,  3.51it/s]
 22%|██▏       | 82853/371472 [6:35:17<22:25:50,  3.57it/s]
 22%|██▏       | 82854/371472 [6:35:17<21:35:34,  3.71it/s]
 22%|██▏       | 82855/371472 [6:35:18<21:43:05,  3.69it/s]
 22%|██▏       | 82856/371472 [6:35:18<21:10:41,  3.79it/s]
 22%|██▏       | 82857/371472 [6:35:18<22:32:28,  3.56it/s]
 22%|██▏       | 82858/371472 [6:35:19<22:45:03,  3.52it/s]
 22%|██▏       | 82859/371472 [6:35:19<24:23:32,  3.29it/s]
 22%|██▏       | 82860/371472 [6:35:19<24:55:16,  3.22it/s]
                                                           
{'loss': 4.0379, 'learning_rate': 7.996239953457303e-07, 'epoch': 3.57}

 22%|██▏       | 82860/371472 [6:35:19<24:55:16,  3.22it/s]
 22%|██▏       | 82861/371472 [6:35:20<24:34:04,  3.26it/s]
 22%|██▏       | 82862/371472 [6:35:20<23:46:35,  3.37it/s]
 22%|██▏       | 82863/371472 [6:35:20<23:44:56,  3.38it/s]
 22%|██▏       | 82864/371472 [6:35:20<24:40:42,  3.25it/s]
 22%|██▏       | 82865/371472 [6:35:21<24:11:47,  3.31it/s]
 22%|██▏       | 82866/371472 [6:35:21<23:52:34,  3.36it/s]
 22%|██▏       | 82867/371472 [6:35:21<23:58:28,  3.34it/s]
 22%|██▏       | 82868/371472 [6:35:22<23:34:44,  3.40it/s]
 22%|██▏       | 82869/371472 [6:35:22<24:13:07,  3.31it/s]
 22%|██▏       | 82870/371472 [6:35:22<23:24:42,  3.42it/s]
 22%|██▏       | 82871/371472 [6:35:23<24:01:26,  3.34it/s]
 22%|██▏       | 82872/371472 [6:35:23<26:29:19,  3.03it/s]
 22%|██▏       | 82873/371472 [6:35:23<25:56:21,  3.09it/s]
 22%|██▏       | 82874/371472 [6:35:24<24:36:47,  3.26it/s]
 22%|██▏       | 82875/371472 [6:35:24<23:17:03,  3.44it/s]
 22%|██▏       | 82876/371472 [6:35:24<22:14:41,  3.60it/s]
 22%|██▏       | 82877/371472 [6:35:24<22:48:35,  3.51it/s]
 22%|██▏       | 82878/371472 [6:35:25<23:08:10,  3.46it/s]
 22%|██▏       | 82879/371472 [6:35:25<22:44:50,  3.52it/s]
 22%|██▏       | 82880/371472 [6:35:25<22:37:18,  3.54it/s]
                                                           
{'loss': 3.9904, 'learning_rate': 7.995755133702514e-07, 'epoch': 3.57}

 22%|██▏       | 82880/371472 [6:35:25<22:37:18,  3.54it/s]
 22%|██▏       | 82881/371472 [6:35:25<22:34:43,  3.55it/s]
 22%|██▏       | 82882/371472 [6:35:26<21:35:32,  3.71it/s]
 22%|██▏       | 82883/371472 [6:35:26<21:52:41,  3.66it/s]
 22%|██▏       | 82884/371472 [6:35:26<21:36:32,  3.71it/s]
 22%|██▏       | 82885/371472 [6:35:27<21:44:48,  3.69it/s]
 22%|██▏       | 82886/371472 [6:35:27<22:11:05,  3.61it/s]
 22%|██▏       | 82887/371472 [6:35:27<21:34:32,  3.72it/s]
 22%|██▏       | 82888/371472 [6:35:27<21:42:41,  3.69it/s]
 22%|██▏       | 82889/371472 [6:35:28<22:16:32,  3.60it/s]
 22%|██▏       | 82890/371472 [6:35:28<21:48:59,  3.67it/s]
 22%|██▏       | 82891/371472 [6:35:28<22:17:07,  3.60it/s]
 22%|██▏       | 82892/371472 [6:35:28<21:43:12,  3.69it/s]
 22%|██▏       | 82893/371472 [6:35:29<21:37:34,  3.71it/s]
 22%|██▏       | 82894/371472 [6:35:29<21:25:25,  3.74it/s]
 22%|██▏       | 82895/371472 [6:35:29<21:15:10,  3.77it/s]
 22%|██▏       | 82896/371472 [6:35:30<23:12:51,  3.45it/s]
 22%|██▏       | 82897/371472 [6:35:30<23:34:46,  3.40it/s]
 22%|██▏       | 82898/371472 [6:35:30<23:45:47,  3.37it/s]
 22%|██▏       | 82899/371472 [6:35:30<22:35:12,  3.55it/s]
 22%|██▏       | 82900/371472 [6:35:31<23:34:53,  3.40it/s]
                                                           
{'loss': 3.9798, 'learning_rate': 7.995270313947726e-07, 'epoch': 3.57}

 22%|██▏       | 82900/371472 [6:35:31<23:34:53,  3.40it/s]
 22%|██▏       | 82901/371472 [6:35:31<24:05:27,  3.33it/s]
 22%|██▏       | 82902/371472 [6:35:31<23:23:25,  3.43it/s]
 22%|██▏       | 82903/371472 [6:35:32<22:58:27,  3.49it/s]
 22%|██▏       | 82904/371472 [6:35:32<22:52:16,  3.50it/s]
 22%|██▏       | 82905/371472 [6:35:32<22:01:13,  3.64it/s]
 22%|██▏       | 82906/371472 [6:35:32<21:48:45,  3.67it/s]
 22%|██▏       | 82907/371472 [6:35:33<21:25:57,  3.74it/s]
 22%|██▏       | 82908/371472 [6:35:33<22:21:52,  3.58it/s]
 22%|██▏       | 82909/371472 [6:35:33<22:03:10,  3.63it/s]
 22%|██▏       | 82910/371472 [6:35:34<22:01:28,  3.64it/s]
 22%|██▏       | 82911/371472 [6:35:34<21:52:29,  3.66it/s]
 22%|██▏       | 82912/371472 [6:35:34<22:13:21,  3.61it/s]
 22%|██▏       | 82913/371472 [6:35:34<21:11:15,  3.78it/s]
 22%|██▏       | 82914/371472 [6:35:35<21:03:50,  3.81it/s]
 22%|██▏       | 82915/371472 [6:35:35<20:43:07,  3.87it/s]
 22%|██▏       | 82916/371472 [6:35:35<21:54:16,  3.66it/s]
 22%|██▏       | 82917/371472 [6:35:35<21:27:46,  3.73it/s]
 22%|██▏       | 82918/371472 [6:35:36<21:10:37,  3.78it/s]
 22%|██▏       | 82919/371472 [6:35:36<21:57:26,  3.65it/s]
 22%|██▏       | 82920/371472 [6:35:36<23:24:48,  3.42it/s]
                                                           
{'loss': 3.9636, 'learning_rate': 7.994785494192936e-07, 'epoch': 3.57}

 22%|██▏       | 82920/371472 [6:35:36<23:24:48,  3.42it/s]
 22%|██▏       | 82921/371472 [6:35:37<23:12:12,  3.45it/s]
 22%|██▏       | 82922/371472 [6:35:37<22:06:33,  3.63it/s]
 22%|██▏       | 82923/371472 [6:35:37<21:57:17,  3.65it/s]
 22%|██▏       | 82924/371472 [6:35:37<22:11:49,  3.61it/s]
 22%|██▏       | 82925/371472 [6:35:38<22:41:37,  3.53it/s]
 22%|██▏       | 82926/371472 [6:35:38<22:33:08,  3.55it/s]
 22%|██▏       | 82927/371472 [6:35:38<22:34:44,  3.55it/s]
 22%|██▏       | 82928/371472 [6:35:39<23:12:30,  3.45it/s]
 22%|██▏       | 82929/371472 [6:35:39<22:38:42,  3.54it/s]
 22%|██▏       | 82930/371472 [6:35:39<24:20:57,  3.29it/s]
 22%|██▏       | 82931/371472 [6:35:39<23:43:21,  3.38it/s]
 22%|██▏       | 82932/371472 [6:35:40<23:01:28,  3.48it/s]
 22%|██▏       | 82933/371472 [6:35:40<22:08:33,  3.62it/s]
 22%|██▏       | 82934/371472 [6:35:40<22:41:41,  3.53it/s]
 22%|██▏       | 82935/371472 [6:35:40<21:44:00,  3.69it/s]
 22%|██▏       | 82936/371472 [6:35:41<21:08:24,  3.79it/s]
 22%|██▏       | 82937/371472 [6:35:41<20:49:42,  3.85it/s]
 22%|██▏       | 82938/371472 [6:35:41<20:42:06,  3.87it/s]
 22%|██▏       | 82939/371472 [6:35:42<24:42:00,  3.24it/s]
 22%|██▏       | 82940/371472 [6:35:42<23:28:44,  3.41it/s]
                                                           
{'loss': 4.0279, 'learning_rate': 7.994300674438148e-07, 'epoch': 3.57}

 22%|██▏       | 82940/371472 [6:35:42<23:28:44,  3.41it/s]
 22%|██▏       | 82941/371472 [6:35:42<23:11:22,  3.46it/s]
 22%|██▏       | 82942/371472 [6:35:42<22:55:17,  3.50it/s]
 22%|██▏       | 82943/371472 [6:35:43<22:38:13,  3.54it/s]
 22%|██▏       | 82944/371472 [6:35:43<22:20:19,  3.59it/s]
 22%|██▏       | 82945/371472 [6:35:43<22:58:31,  3.49it/s]
 22%|██▏       | 82946/371472 [6:35:44<22:16:45,  3.60it/s]
 22%|██▏       | 82947/371472 [6:35:44<22:59:19,  3.49it/s]
 22%|██▏       | 82948/371472 [6:35:44<23:46:11,  3.37it/s]
 22%|██▏       | 82949/371472 [6:35:44<22:55:22,  3.50it/s]
 22%|██▏       | 82950/371472 [6:35:45<23:01:12,  3.48it/s]
 22%|██▏       | 82951/371472 [6:35:45<23:12:25,  3.45it/s]
 22%|██▏       | 82952/371472 [6:35:45<23:50:00,  3.36it/s]
 22%|██▏       | 82953/371472 [6:35:46<23:26:44,  3.42it/s]
 22%|██▏       | 82954/371472 [6:35:46<23:38:45,  3.39it/s]
 22%|██▏       | 82955/371472 [6:35:46<24:37:51,  3.25it/s]
 22%|██▏       | 82956/371472 [6:35:47<24:07:19,  3.32it/s]
 22%|██▏       | 82957/371472 [6:35:47<24:18:41,  3.30it/s]
 22%|██▏       | 82958/371472 [6:35:47<23:20:05,  3.43it/s]
 22%|██▏       | 82959/371472 [6:35:47<22:15:44,  3.60it/s]
 22%|██▏       | 82960/371472 [6:35:48<21:55:48,  3.65it/s]
                                                           
{'loss': 3.9741, 'learning_rate': 7.993815854683359e-07, 'epoch': 3.57}

 22%|██▏       | 82960/371472 [6:35:48<21:55:48,  3.65it/s]
 22%|██▏       | 82961/371472 [6:35:48<21:14:41,  3.77it/s]
 22%|██▏       | 82962/371472 [6:35:48<24:06:55,  3.32it/s]
 22%|██▏       | 82963/371472 [6:35:49<24:10:03,  3.32it/s]
 22%|██▏       | 82964/371472 [6:35:49<22:42:42,  3.53it/s]
 22%|██▏       | 82965/371472 [6:35:49<23:04:58,  3.47it/s]
 22%|██▏       | 82966/371472 [6:35:49<22:46:23,  3.52it/s]
 22%|██▏       | 82967/371472 [6:35:50<22:09:00,  3.62it/s]
 22%|██▏       | 82968/371472 [6:35:50<21:31:54,  3.72it/s]
 22%|██▏       | 82969/371472 [6:35:50<21:46:52,  3.68it/s]
 22%|██▏       | 82970/371472 [6:35:50<22:26:08,  3.57it/s]
 22%|██▏       | 82971/371472 [6:35:51<22:32:03,  3.56it/s]
 22%|██▏       | 82972/371472 [6:35:51<22:53:11,  3.50it/s]
 22%|██▏       | 82973/371472 [6:35:51<22:36:50,  3.54it/s]
 22%|██▏       | 82974/371472 [6:35:52<21:54:12,  3.66it/s]
 22%|██▏       | 82975/371472 [6:35:52<22:18:02,  3.59it/s]
 22%|██▏       | 82976/371472 [6:35:52<23:14:32,  3.45it/s]
 22%|██▏       | 82977/371472 [6:35:52<23:01:17,  3.48it/s]
 22%|██▏       | 82978/371472 [6:35:53<24:11:25,  3.31it/s]
 22%|██▏       | 82979/371472 [6:35:53<23:47:38,  3.37it/s]
 22%|██▏       | 82980/371472 [6:35:53<23:09:41,  3.46it/s]
                                                           
{'loss': 3.9285, 'learning_rate': 7.99333103492857e-07, 'epoch': 3.57}

 22%|██▏       | 82980/371472 [6:35:53<23:09:41,  3.46it/s]
 22%|██▏       | 82981/371472 [6:35:54<22:55:47,  3.49it/s]
 22%|██▏       | 82982/371472 [6:35:54<23:22:59,  3.43it/s]
 22%|██▏       | 82983/371472 [6:35:54<23:07:18,  3.47it/s]
 22%|██▏       | 82984/371472 [6:35:54<22:12:41,  3.61it/s]
 22%|██▏       | 82985/371472 [6:35:55<23:03:19,  3.48it/s]
 22%|██▏       | 82986/371472 [6:35:55<22:08:28,  3.62it/s]
 22%|██▏       | 82987/371472 [6:35:55<21:54:54,  3.66it/s]
 22%|██▏       | 82988/371472 [6:35:56<21:57:17,  3.65it/s]
 22%|██▏       | 82989/371472 [6:35:56<21:30:57,  3.72it/s]
 22%|██▏       | 82990/371472 [6:35:56<20:49:56,  3.85it/s]
 22%|██▏       | 82991/371472 [6:35:56<21:01:11,  3.81it/s]
 22%|██▏       | 82992/371472 [6:35:57<21:48:06,  3.68it/s]
 22%|██▏       | 82993/371472 [6:35:57<22:30:12,  3.56it/s]
 22%|██▏       | 82994/371472 [6:35:57<22:57:35,  3.49it/s]
 22%|██▏       | 82995/371472 [6:35:58<22:18:12,  3.59it/s]
 22%|██▏       | 82996/371472 [6:35:58<21:56:47,  3.65it/s]
 22%|██▏       | 82997/371472 [6:35:58<21:49:07,  3.67it/s]
 22%|██▏       | 82998/371472 [6:35:58<22:16:05,  3.60it/s]
 22%|██▏       | 82999/371472 [6:35:59<21:26:38,  3.74it/s]
 22%|██▏       | 83000/371472 [6:35:59<22:15:51,  3.60it/s]
                                                           
{'loss': 4.0888, 'learning_rate': 7.992846215173781e-07, 'epoch': 3.57}

 22%|██▏       | 83000/371472 [6:35:59<22:15:51,  3.60it/s]
 22%|██▏       | 83001/371472 [6:35:59<23:53:23,  3.35it/s]
 22%|██▏       | 83002/371472 [6:36:00<23:33:53,  3.40it/s]
 22%|██▏       | 83003/371472 [6:36:00<24:36:14,  3.26it/s]
 22%|██▏       | 83004/371472 [6:36:00<23:18:53,  3.44it/s]
 22%|██▏       | 83005/371472 [6:36:00<22:33:03,  3.55it/s]
 22%|██▏       | 83006/371472 [6:36:01<24:13:20,  3.31it/s]
 22%|██▏       | 83007/371472 [6:36:01<23:46:47,  3.37it/s]
 22%|██▏       | 83008/371472 [6:36:01<23:20:42,  3.43it/s]
 22%|██▏       | 83009/371472 [6:36:02<22:32:07,  3.56it/s]
 22%|██▏       | 83010/371472 [6:36:02<22:19:04,  3.59it/s]
 22%|██▏       | 83011/371472 [6:36:02<21:46:07,  3.68it/s]
 22%|██▏       | 83012/371472 [6:36:02<22:12:37,  3.61it/s]
 22%|██▏       | 83013/371472 [6:36:03<21:48:12,  3.67it/s]
 22%|██▏       | 83014/371472 [6:36:03<22:51:31,  3.51it/s]
 22%|██▏       | 83015/371472 [6:36:03<23:21:31,  3.43it/s]
 22%|██▏       | 83016/371472 [6:36:04<23:15:11,  3.45it/s]
 22%|██▏       | 83017/371472 [6:36:04<23:36:17,  3.39it/s]
 22%|██▏       | 83018/371472 [6:36:04<23:25:41,  3.42it/s]
 22%|██▏       | 83019/371472 [6:36:04<23:04:43,  3.47it/s]
 22%|██▏       | 83020/371472 [6:36:05<22:46:49,  3.52it/s]
                                                           
{'loss': 3.9734, 'learning_rate': 7.992361395418992e-07, 'epoch': 3.58}

 22%|██▏       | 83020/371472 [6:36:05<22:46:49,  3.52it/s]
 22%|██▏       | 83021/371472 [6:36:05<23:20:31,  3.43it/s]
 22%|██▏       | 83022/371472 [6:36:05<24:05:05,  3.33it/s]
 22%|██▏       | 83023/371472 [6:36:06<22:50:20,  3.51it/s]
 22%|██▏       | 83024/371472 [6:36:06<22:28:02,  3.57it/s]
 22%|██▏       | 83025/371472 [6:36:06<22:57:59,  3.49it/s]
 22%|██▏       | 83026/371472 [6:36:06<23:13:12,  3.45it/s]
 22%|██▏       | 83027/371472 [6:36:07<22:46:22,  3.52it/s]
 22%|██▏       | 83028/371472 [6:36:07<22:54:11,  3.50it/s]
 22%|██▏       | 83029/371472 [6:36:07<22:59:46,  3.48it/s]
 22%|██▏       | 83030/371472 [6:36:08<23:55:32,  3.35it/s]
 22%|██▏       | 83031/371472 [6:36:08<23:36:07,  3.39it/s]
 22%|██▏       | 83032/371472 [6:36:08<23:23:21,  3.43it/s]
 22%|██▏       | 83033/371472 [6:36:08<23:01:39,  3.48it/s]
 22%|██▏       | 83034/371472 [6:36:09<24:13:39,  3.31it/s]
 22%|██▏       | 83035/371472 [6:36:09<25:12:17,  3.18it/s]
 22%|██▏       | 83036/371472 [6:36:09<23:41:33,  3.38it/s]
 22%|██▏       | 83037/371472 [6:36:10<24:19:11,  3.29it/s]
 22%|██▏       | 83038/371472 [6:36:10<24:26:10,  3.28it/s]
 22%|██▏       | 83039/371472 [6:36:10<25:26:17,  3.15it/s]
 22%|██▏       | 83040/371472 [6:36:11<25:26:57,  3.15it/s]
                                                           
{'loss': 4.2585, 'learning_rate': 7.991876575664203e-07, 'epoch': 3.58}

 22%|██▏       | 83040/371472 [6:36:11<25:26:57,  3.15it/s]
 22%|██▏       | 83041/371472 [6:36:11<24:39:22,  3.25it/s]
 22%|██▏       | 83042/371472 [6:36:11<23:33:53,  3.40it/s]
 22%|██▏       | 83043/371472 [6:36:12<26:24:58,  3.03it/s]
 22%|██▏       | 83044/371472 [6:36:12<25:12:00,  3.18it/s]
 22%|██▏       | 83045/371472 [6:36:12<23:56:48,  3.35it/s]
 22%|██▏       | 83046/371472 [6:36:12<23:33:22,  3.40it/s]
 22%|██▏       | 83047/371472 [6:36:13<26:32:18,  3.02it/s]
 22%|██▏       | 83048/371472 [6:36:13<25:08:45,  3.19it/s]
 22%|██▏       | 83049/371472 [6:36:13<23:29:52,  3.41it/s]
 22%|██▏       | 83050/371472 [6:36:14<25:49:39,  3.10it/s]
 22%|██▏       | 83051/371472 [6:36:14<25:41:47,  3.12it/s]
 22%|██▏       | 83052/371472 [6:36:14<24:23:50,  3.28it/s]
 22%|██▏       | 83053/371472 [6:36:15<23:10:05,  3.46it/s]
 22%|██▏       | 83054/371472 [6:36:15<24:07:08,  3.32it/s]
 22%|██▏       | 83055/371472 [6:36:15<22:50:40,  3.51it/s]
 22%|██▏       | 83056/371472 [6:36:15<22:16:02,  3.60it/s]
 22%|██▏       | 83057/371472 [6:36:16<23:22:31,  3.43it/s]
 22%|██▏       | 83058/371472 [6:36:16<22:39:04,  3.54it/s]
 22%|██▏       | 83059/371472 [6:36:16<22:14:31,  3.60it/s]
 22%|██▏       | 83060/371472 [6:36:17<22:03:27,  3.63it/s]
                                                           
{'loss': 3.9455, 'learning_rate': 7.991391755909414e-07, 'epoch': 3.58}

 22%|██▏       | 83060/371472 [6:36:17<22:03:27,  3.63it/s]
 22%|██▏       | 83061/371472 [6:36:17<22:30:49,  3.56it/s]
 22%|██▏       | 83062/371472 [6:36:17<23:55:35,  3.35it/s]
 22%|██▏       | 83063/371472 [6:36:18<25:22:15,  3.16it/s]
 22%|██▏       | 83064/371472 [6:36:18<24:01:55,  3.33it/s]
 22%|██▏       | 83065/371472 [6:36:18<24:12:55,  3.31it/s]
 22%|██▏       | 83066/371472 [6:36:18<23:50:45,  3.36it/s]
 22%|██▏       | 83067/371472 [6:36:19<23:24:21,  3.42it/s]
 22%|██▏       | 83068/371472 [6:36:19<23:04:17,  3.47it/s]
 22%|██▏       | 83069/371472 [6:36:19<23:19:28,  3.43it/s]
 22%|██▏       | 83070/371472 [6:36:20<23:40:11,  3.38it/s]
 22%|██▏       | 83071/371472 [6:36:20<22:34:47,  3.55it/s]
 22%|██▏       | 83072/371472 [6:36:20<22:48:40,  3.51it/s]
 22%|██▏       | 83073/371472 [6:36:20<23:25:04,  3.42it/s]
 22%|██▏       | 83074/371472 [6:36:21<25:01:43,  3.20it/s]
 22%|██▏       | 83075/371472 [6:36:21<24:13:10,  3.31it/s]
 22%|██▏       | 83076/371472 [6:36:21<24:16:55,  3.30it/s]
 22%|██▏       | 83077/371472 [6:36:22<22:54:23,  3.50it/s]
 22%|██▏       | 83078/371472 [6:36:22<22:27:22,  3.57it/s]
 22%|██▏       | 83079/371472 [6:36:22<22:53:45,  3.50it/s]
 22%|██▏       | 83080/371472 [6:36:22<23:18:48,  3.44it/s]
                                                           
{'loss': 4.0289, 'learning_rate': 7.990906936154625e-07, 'epoch': 3.58}

 22%|██▏       | 83080/371472 [6:36:22<23:18:48,  3.44it/s]
 22%|██▏       | 83081/371472 [6:36:23<22:30:17,  3.56it/s]
 22%|██▏       | 83082/371472 [6:36:23<21:38:24,  3.70it/s]
 22%|██▏       | 83083/371472 [6:36:23<21:21:54,  3.75it/s]
 22%|██▏       | 83084/371472 [6:36:24<21:47:15,  3.68it/s]
 22%|██▏       | 83085/371472 [6:36:24<21:56:13,  3.65it/s]
 22%|██▏       | 83086/371472 [6:36:24<22:28:03,  3.57it/s]
 22%|██▏       | 83087/371472 [6:36:24<24:52:10,  3.22it/s]
 22%|██▏       | 83088/371472 [6:36:25<24:22:52,  3.29it/s]
 22%|██▏       | 83089/371472 [6:36:25<23:18:14,  3.44it/s]
 22%|██▏       | 83090/371472 [6:36:25<23:12:41,  3.45it/s]
 22%|██▏       | 83091/371472 [6:36:26<22:30:17,  3.56it/s]
 22%|██▏       | 83092/371472 [6:36:26<21:49:15,  3.67it/s]
 22%|██▏       | 83093/371472 [6:36:26<21:23:46,  3.74it/s]
 22%|██▏       | 83094/371472 [6:36:26<21:09:41,  3.79it/s]
 22%|██▏       | 83095/371472 [6:36:27<21:10:26,  3.78it/s]
 22%|██▏       | 83096/371472 [6:36:27<21:18:48,  3.76it/s]
 22%|██▏       | 83097/371472 [6:36:27<20:46:52,  3.85it/s]
 22%|██▏       | 83098/371472 [6:36:27<21:55:20,  3.65it/s]
 22%|██▏       | 83099/371472 [6:36:28<23:15:05,  3.45it/s]
 22%|██▏       | 83100/371472 [6:36:28<24:25:32,  3.28it/s]
                                                           
{'loss': 4.2913, 'learning_rate': 7.990422116399835e-07, 'epoch': 3.58}

 22%|██▏       | 83100/371472 [6:36:28<24:25:32,  3.28it/s]
 22%|██▏       | 83101/371472 [6:36:28<24:18:38,  3.29it/s]
 22%|██▏       | 83102/371472 [6:36:29<24:39:47,  3.25it/s]
 22%|██▏       | 83103/371472 [6:36:29<24:50:53,  3.22it/s]
 22%|██▏       | 83104/371472 [6:36:29<24:12:55,  3.31it/s]
 22%|██▏       | 83105/371472 [6:36:30<28:23:11,  2.82it/s]
 22%|██▏       | 83106/371472 [6:36:30<27:10:44,  2.95it/s]
 22%|██▏       | 83107/371472 [6:36:30<27:01:46,  2.96it/s]
 22%|██▏       | 83108/371472 [6:36:31<24:44:32,  3.24it/s]
 22%|██▏       | 83109/371472 [6:36:31<23:30:29,  3.41it/s]
 22%|██▏       | 83110/371472 [6:36:31<23:08:37,  3.46it/s]
 22%|██▏       | 83111/371472 [6:36:31<23:00:31,  3.48it/s]
 22%|██▏       | 83112/371472 [6:36:32<26:04:37,  3.07it/s]
 22%|██▏       | 83113/371472 [6:36:32<25:34:07,  3.13it/s]
 22%|██▏       | 83114/371472 [6:36:32<24:39:49,  3.25it/s]
 22%|██▏       | 83115/371472 [6:36:33<24:09:28,  3.32it/s]
 22%|██▏       | 83116/371472 [6:36:33<23:18:16,  3.44it/s]
 22%|██▏       | 83117/371472 [6:36:33<25:29:15,  3.14it/s]
 22%|██▏       | 83118/371472 [6:36:34<24:03:53,  3.33it/s]
 22%|██▏       | 83119/371472 [6:36:34<24:16:41,  3.30it/s]
 22%|██▏       | 83120/371472 [6:36:34<24:39:33,  3.25it/s]
                                                           
{'loss': 3.8413, 'learning_rate': 7.989937296645047e-07, 'epoch': 3.58}

 22%|██▏       | 83120/371472 [6:36:34<24:39:33,  3.25it/s]
 22%|██▏       | 83121/371472 [6:36:35<23:43:29,  3.38it/s]
 22%|██▏       | 83122/371472 [6:36:35<24:54:21,  3.22it/s]
 22%|██▏       | 83123/371472 [6:36:35<24:10:00,  3.31it/s]
 22%|██▏       | 83124/371472 [6:36:35<22:52:51,  3.50it/s]
 22%|██▏       | 83125/371472 [6:36:36<23:30:10,  3.41it/s]
 22%|██▏       | 83126/371472 [6:36:36<24:27:37,  3.27it/s]
 22%|██▏       | 83127/371472 [6:36:36<23:16:33,  3.44it/s]
 22%|██▏       | 83128/371472 [6:36:37<22:33:00,  3.55it/s]
 22%|██▏       | 83129/371472 [6:36:37<22:48:31,  3.51it/s]
 22%|██▏       | 83130/371472 [6:36:37<23:36:29,  3.39it/s]
 22%|██▏       | 83131/371472 [6:36:38<26:55:33,  2.97it/s]
 22%|██▏       | 83132/371472 [6:36:38<25:03:54,  3.20it/s]
 22%|██▏       | 83133/371472 [6:36:39<33:04:04,  2.42it/s]
 22%|██▏       | 83134/371472 [6:36:39<29:51:42,  2.68it/s]
 22%|██▏       | 83135/371472 [6:36:39<27:07:47,  2.95it/s]
 22%|██▏       | 83136/371472 [6:36:39<24:55:31,  3.21it/s]
 22%|██▏       | 83137/371472 [6:36:40<24:33:12,  3.26it/s]
 22%|██▏       | 83138/371472 [6:36:40<24:06:02,  3.32it/s]
 22%|██▏       | 83139/371472 [6:36:40<23:34:30,  3.40it/s]
 22%|██▏       | 83140/371472 [6:36:40<22:45:01,  3.52it/s]
                                                           
{'loss': 4.0535, 'learning_rate': 7.989452476890258e-07, 'epoch': 3.58}

 22%|██▏       | 83140/371472 [6:36:40<22:45:01,  3.52it/s]
 22%|██▏       | 83141/371472 [6:36:41<23:45:55,  3.37it/s]
 22%|██▏       | 83142/371472 [6:36:41<24:42:47,  3.24it/s]
 22%|██▏       | 83143/371472 [6:36:41<24:43:52,  3.24it/s]
 22%|██▏       | 83144/371472 [6:36:42<24:37:16,  3.25it/s]
 22%|██▏       | 83145/371472 [6:36:42<25:23:28,  3.15it/s]
 22%|██▏       | 83146/371472 [6:36:42<26:28:00,  3.03it/s]
 22%|██▏       | 83147/371472 [6:36:43<24:42:44,  3.24it/s]
 22%|██▏       | 83148/371472 [6:36:43<23:32:10,  3.40it/s]
 22%|██▏       | 83149/371472 [6:36:43<24:32:04,  3.26it/s]
 22%|██▏       | 83150/371472 [6:36:44<24:10:09,  3.31it/s]
 22%|██▏       | 83151/371472 [6:36:44<23:17:30,  3.44it/s]
 22%|██▏       | 83152/371472 [6:36:44<22:37:51,  3.54it/s]
 22%|██▏       | 83153/371472 [6:36:44<23:53:03,  3.35it/s]
 22%|██▏       | 83154/371472 [6:36:45<23:08:18,  3.46it/s]
 22%|██▏       | 83155/371472 [6:36:45<23:17:16,  3.44it/s]
 22%|██▏       | 83156/371472 [6:36:45<23:27:54,  3.41it/s]
 22%|██▏       | 83157/371472 [6:36:46<24:24:15,  3.28it/s]
 22%|██▏       | 83158/371472 [6:36:46<23:51:13,  3.36it/s]
 22%|██▏       | 83159/371472 [6:36:46<23:33:36,  3.40it/s]
 22%|██▏       | 83160/371472 [6:36:47<23:52:50,  3.35it/s]
                                                           
{'loss': 4.0097, 'learning_rate': 7.988967657135469e-07, 'epoch': 3.58}

 22%|██▏       | 83160/371472 [6:36:47<23:52:50,  3.35it/s]
 22%|██▏       | 83161/371472 [6:36:47<22:37:47,  3.54it/s]
 22%|██▏       | 83162/371472 [6:36:47<21:54:13,  3.66it/s]
 22%|██▏       | 83163/371472 [6:36:47<21:49:03,  3.67it/s]
 22%|██▏       | 83164/371472 [6:36:48<21:59:48,  3.64it/s]
 22%|██▏       | 83165/371472 [6:36:48<22:31:27,  3.56it/s]
 22%|██▏       | 83166/371472 [6:36:48<23:01:44,  3.48it/s]
 22%|██▏       | 83167/371472 [6:36:48<22:53:11,  3.50it/s]
 22%|██▏       | 83168/371472 [6:36:49<22:02:59,  3.63it/s]
 22%|██▏       | 83169/371472 [6:36:49<21:16:36,  3.76it/s]
 22%|██▏       | 83170/371472 [6:36:49<22:01:27,  3.64it/s]
 22%|██▏       | 83171/371472 [6:36:50<22:46:24,  3.52it/s]
 22%|██▏       | 83172/371472 [6:36:50<22:17:14,  3.59it/s]
 22%|██▏       | 83173/371472 [6:36:50<21:35:08,  3.71it/s]
 22%|██▏       | 83174/371472 [6:36:50<21:39:44,  3.70it/s]
 22%|██▏       | 83175/371472 [6:36:51<22:27:22,  3.57it/s]
 22%|██▏       | 83176/371472 [6:36:51<25:33:54,  3.13it/s]
 22%|██▏       | 83177/371472 [6:36:51<25:21:09,  3.16it/s]
 22%|██▏       | 83178/371472 [6:36:52<25:00:29,  3.20it/s]
 22%|██▏       | 83179/371472 [6:36:52<23:27:14,  3.41it/s]
 22%|██▏       | 83180/371472 [6:36:52<22:32:54,  3.55it/s]
                                                           
{'loss': 3.9713, 'learning_rate': 7.98848283738068e-07, 'epoch': 3.58}

 22%|██▏       | 83180/371472 [6:36:52<22:32:54,  3.55it/s]
 22%|██▏       | 83181/371472 [6:36:53<24:03:41,  3.33it/s]
 22%|██▏       | 83182/371472 [6:36:53<22:43:14,  3.52it/s]
 22%|██▏       | 83183/371472 [6:36:53<21:45:12,  3.68it/s]
 22%|██▏       | 83184/371472 [6:36:53<21:49:25,  3.67it/s]
 22%|██▏       | 83185/371472 [6:36:54<21:16:27,  3.76it/s]
 22%|██▏       | 83186/371472 [6:36:54<21:33:38,  3.71it/s]
 22%|██▏       | 83187/371472 [6:36:54<20:52:35,  3.84it/s]
 22%|██▏       | 83188/371472 [6:36:54<21:17:02,  3.76it/s]
 22%|██▏       | 83189/371472 [6:36:55<20:54:34,  3.83it/s]
 22%|██▏       | 83190/371472 [6:36:55<20:56:37,  3.82it/s]
 22%|██▏       | 83191/371472 [6:36:55<21:16:29,  3.76it/s]
 22%|██▏       | 83192/371472 [6:36:55<21:09:19,  3.79it/s]
 22%|██▏       | 83193/371472 [6:36:56<20:39:21,  3.88it/s]
 22%|██▏       | 83194/371472 [6:36:56<21:25:19,  3.74it/s]
 22%|██▏       | 83195/371472 [6:36:56<21:15:26,  3.77it/s]
 22%|██▏       | 83196/371472 [6:36:56<21:08:35,  3.79it/s]
 22%|██▏       | 83197/371472 [6:36:57<21:20:10,  3.75it/s]
 22%|██▏       | 83198/371472 [6:36:57<21:19:42,  3.75it/s]
 22%|██▏       | 83199/371472 [6:36:57<23:38:39,  3.39it/s]
 22%|██▏       | 83200/371472 [6:36:58<22:49:16,  3.51it/s]
                                                           
{'loss': 3.8081, 'learning_rate': 7.987998017625892e-07, 'epoch': 3.58}

 22%|██▏       | 83200/371472 [6:36:58<22:49:16,  3.51it/s]
 22%|██▏       | 83201/371472 [6:36:58<22:19:41,  3.59it/s]
 22%|██▏       | 83202/371472 [6:36:58<25:58:32,  3.08it/s]
 22%|██▏       | 83203/371472 [6:36:59<27:05:06,  2.96it/s]
 22%|██▏       | 83204/371472 [6:36:59<25:04:07,  3.19it/s]
 22%|██▏       | 83205/371472 [6:36:59<23:50:23,  3.36it/s]
 22%|██▏       | 83206/371472 [6:36:59<24:08:36,  3.32it/s]
 22%|██▏       | 83207/371472 [6:37:00<23:09:45,  3.46it/s]
 22%|██▏       | 83208/371472 [6:37:00<22:58:39,  3.48it/s]
 22%|██▏       | 83209/371472 [6:37:00<22:20:56,  3.58it/s]
 22%|██▏       | 83210/371472 [6:37:01<23:52:44,  3.35it/s]
 22%|██▏       | 83211/371472 [6:37:01<23:06:50,  3.46it/s]
 22%|██▏       | 83212/371472 [6:37:01<22:10:44,  3.61it/s]
 22%|██▏       | 83213/371472 [6:37:01<21:45:42,  3.68it/s]
 22%|██▏       | 83214/371472 [6:37:02<23:00:41,  3.48it/s]
 22%|██▏       | 83215/371472 [6:37:02<22:02:41,  3.63it/s]
 22%|██▏       | 83216/371472 [6:37:02<22:44:34,  3.52it/s]
 22%|██▏       | 83217/371472 [6:37:03<22:54:40,  3.49it/s]
 22%|██▏       | 83218/371472 [6:37:03<22:31:51,  3.55it/s]
 22%|██▏       | 83219/371472 [6:37:03<21:52:50,  3.66it/s]
 22%|██▏       | 83220/371472 [6:37:03<23:43:31,  3.37it/s]
                                                           
{'loss': 4.1517, 'learning_rate': 7.987513197871102e-07, 'epoch': 3.58}

 22%|██▏       | 83220/371472 [6:37:03<23:43:31,  3.37it/s]
 22%|██▏       | 83221/371472 [6:37:04<23:01:39,  3.48it/s]
 22%|██▏       | 83222/371472 [6:37:04<23:08:45,  3.46it/s]
 22%|██▏       | 83223/371472 [6:37:04<23:05:02,  3.47it/s]
 22%|██▏       | 83224/371472 [6:37:05<22:25:00,  3.57it/s]
 22%|██▏       | 83225/371472 [6:37:05<22:23:51,  3.57it/s]
 22%|██▏       | 83226/371472 [6:37:05<21:56:44,  3.65it/s]
 22%|██▏       | 83227/371472 [6:37:05<21:48:52,  3.67it/s]
 22%|██▏       | 83228/371472 [6:37:06<21:27:50,  3.73it/s]
 22%|██▏       | 83229/371472 [6:37:06<21:51:30,  3.66it/s]
 22%|██▏       | 83230/371472 [6:37:06<21:56:41,  3.65it/s]
 22%|██▏       | 83231/371472 [6:37:06<21:23:39,  3.74it/s]
 22%|██▏       | 83232/371472 [6:37:07<20:59:34,  3.81it/s]
 22%|██▏       | 83233/371472 [6:37:07<21:49:47,  3.67it/s]
 22%|██▏       | 83234/371472 [6:37:07<23:34:17,  3.40it/s]
 22%|██▏       | 83235/371472 [6:37:08<22:27:32,  3.56it/s]
 22%|██▏       | 83236/371472 [6:37:08<22:51:50,  3.50it/s]
 22%|██▏       | 83237/371472 [6:37:08<21:52:25,  3.66it/s]
 22%|██▏       | 83238/371472 [6:37:08<22:30:18,  3.56it/s]
 22%|██▏       | 83239/371472 [6:37:09<22:17:30,  3.59it/s]
 22%|██▏       | 83240/371472 [6:37:09<22:26:13,  3.57it/s]
                                                           
{'loss': 4.1589, 'learning_rate': 7.987028378116313e-07, 'epoch': 3.59}

 22%|██▏       | 83240/371472 [6:37:09<22:26:13,  3.57it/s]
 22%|██▏       | 83241/371472 [6:37:09<22:21:26,  3.58it/s]
 22%|██▏       | 83242/371472 [6:37:10<24:10:43,  3.31it/s]
 22%|██▏       | 83243/371472 [6:37:10<23:47:48,  3.36it/s]
 22%|██▏       | 83244/371472 [6:37:10<22:58:50,  3.48it/s]
 22%|██▏       | 83245/371472 [6:37:10<22:22:37,  3.58it/s]
 22%|██▏       | 83246/371472 [6:37:11<22:41:26,  3.53it/s]
 22%|██▏       | 83247/371472 [6:37:11<23:44:59,  3.37it/s]
 22%|██▏       | 83248/371472 [6:37:11<23:02:28,  3.47it/s]
 22%|██▏       | 83249/371472 [6:37:12<21:55:51,  3.65it/s]
 22%|██▏       | 83250/371472 [6:37:12<21:34:18,  3.71it/s]
 22%|██▏       | 83251/371472 [6:37:12<22:05:20,  3.62it/s]
 22%|██▏       | 83252/371472 [6:37:12<22:15:21,  3.60it/s]
 22%|██▏       | 83253/371472 [6:37:13<21:52:06,  3.66it/s]
 22%|██▏       | 83254/371472 [6:37:13<23:08:07,  3.46it/s]
 22%|██▏       | 83255/371472 [6:37:13<23:13:07,  3.45it/s]
 22%|██▏       | 83256/371472 [6:37:14<22:59:39,  3.48it/s]
 22%|██▏       | 83257/371472 [6:37:14<21:48:15,  3.67it/s]
 22%|██▏       | 83258/371472 [6:37:14<23:59:17,  3.34it/s]
 22%|██▏       | 83259/371472 [6:37:14<22:48:03,  3.51it/s]
 22%|██▏       | 83260/371472 [6:37:15<22:52:47,  3.50it/s]
                                                           
{'loss': 4.0807, 'learning_rate': 7.986543558361524e-07, 'epoch': 3.59}

 22%|██▏       | 83260/371472 [6:37:15<22:52:47,  3.50it/s]
 22%|██▏       | 83261/371472 [6:37:15<22:17:32,  3.59it/s]
 22%|██▏       | 83262/371472 [6:37:15<21:35:30,  3.71it/s]
 22%|██▏       | 83263/371472 [6:37:16<23:18:49,  3.43it/s]
 22%|██▏       | 83264/371472 [6:37:16<22:11:28,  3.61it/s]
 22%|██▏       | 83265/371472 [6:37:16<23:20:18,  3.43it/s]
 22%|██▏       | 83266/371472 [6:37:16<22:27:01,  3.57it/s]
 22%|██▏       | 83267/371472 [6:37:17<21:30:49,  3.72it/s]
 22%|██▏       | 83268/371472 [6:37:17<21:15:19,  3.77it/s]
 22%|██▏       | 83269/371472 [6:37:17<21:07:55,  3.79it/s]
 22%|██▏       | 83270/371472 [6:37:17<22:54:48,  3.49it/s]
 22%|██▏       | 83271/371472 [6:37:18<22:59:25,  3.48it/s]
 22%|██▏       | 83272/371472 [6:37:18<22:24:40,  3.57it/s]
 22%|██▏       | 83273/371472 [6:37:18<24:26:18,  3.28it/s]
 22%|██▏       | 83274/371472 [6:37:19<24:31:22,  3.26it/s]
 22%|██▏       | 83275/371472 [6:37:19<23:04:24,  3.47it/s]
 22%|██▏       | 83276/371472 [6:37:19<22:25:53,  3.57it/s]
 22%|██▏       | 83277/371472 [6:37:20<23:47:53,  3.36it/s]
 22%|██▏       | 83278/371472 [6:37:20<25:15:42,  3.17it/s]
 22%|██▏       | 83279/371472 [6:37:20<24:11:42,  3.31it/s]
 22%|██▏       | 83280/371472 [6:37:20<22:54:47,  3.49it/s]
                                                           
{'loss': 4.1116, 'learning_rate': 7.986058738606736e-07, 'epoch': 3.59}

 22%|██▏       | 83280/371472 [6:37:20<22:54:47,  3.49it/s]
 22%|██▏       | 83281/371472 [6:37:21<22:37:54,  3.54it/s]
 22%|██▏       | 83282/371472 [6:37:21<21:32:05,  3.72it/s]
 22%|██▏       | 83283/371472 [6:37:21<21:52:16,  3.66it/s]
 22%|██▏       | 83284/371472 [6:37:21<21:39:18,  3.70it/s]
 22%|██▏       | 83285/371472 [6:37:22<22:32:42,  3.55it/s]
 22%|██▏       | 83286/371472 [6:37:22<23:18:04,  3.44it/s]
 22%|██▏       | 83287/371472 [6:37:22<23:39:22,  3.38it/s]
 22%|██▏       | 83288/371472 [6:37:23<22:42:26,  3.53it/s]
 22%|██▏       | 83289/371472 [6:37:23<23:51:18,  3.36it/s]
 22%|██▏       | 83290/371472 [6:37:23<24:50:03,  3.22it/s]
 22%|██▏       | 83291/371472 [6:37:24<23:16:12,  3.44it/s]
 22%|██▏       | 83292/371472 [6:37:24<23:14:38,  3.44it/s]
 22%|██▏       | 83293/371472 [6:37:24<22:50:40,  3.50it/s]
 22%|██▏       | 83294/371472 [6:37:24<22:51:11,  3.50it/s]
 22%|██▏       | 83295/371472 [6:37:25<24:42:15,  3.24it/s]
 22%|██▏       | 83296/371472 [6:37:25<24:49:06,  3.23it/s]
 22%|██▏       | 83297/371472 [6:37:25<23:45:06,  3.37it/s]
 22%|██▏       | 83298/371472 [6:37:26<23:20:28,  3.43it/s]
 22%|██▏       | 83299/371472 [6:37:26<22:49:22,  3.51it/s]
 22%|██▏       | 83300/371472 [6:37:26<21:52:19,  3.66it/s]
                                                           
{'loss': 3.9938, 'learning_rate': 7.985573918851946e-07, 'epoch': 3.59}

 22%|██▏       | 83300/371472 [6:37:26<21:52:19,  3.66it/s]
 22%|██▏       | 83301/371472 [6:37:26<21:48:07,  3.67it/s]
 22%|██▏       | 83302/371472 [6:37:27<21:43:47,  3.68it/s]
 22%|██▏       | 83303/371472 [6:37:27<21:50:14,  3.67it/s]
 22%|██▏       | 83304/371472 [6:37:27<21:47:44,  3.67it/s]
 22%|██▏       | 83305/371472 [6:37:27<21:27:30,  3.73it/s]
 22%|██▏       | 83306/371472 [6:37:28<21:06:37,  3.79it/s]
 22%|██▏       | 83307/371472 [6:37:28<20:57:15,  3.82it/s]
 22%|██▏       | 83308/371472 [6:37:28<21:10:12,  3.78it/s]
 22%|██▏       | 83309/371472 [6:37:29<21:07:06,  3.79it/s]
 22%|██▏       | 83310/371472 [6:37:29<23:33:04,  3.40it/s]
 22%|██▏       | 83311/371472 [6:37:29<23:06:43,  3.46it/s]
 22%|██▏       | 83312/371472 [6:37:29<23:14:12,  3.44it/s]
 22%|██▏       | 83313/371472 [6:37:30<22:57:43,  3.49it/s]
 22%|██▏       | 83314/371472 [6:37:30<23:55:49,  3.34it/s]
 22%|██▏       | 83315/371472 [6:37:30<23:45:22,  3.37it/s]
 22%|██▏       | 83316/371472 [6:37:31<24:31:10,  3.26it/s]
 22%|██▏       | 83317/371472 [6:37:31<24:30:45,  3.27it/s]
 22%|██▏       | 83318/371472 [6:37:31<23:35:20,  3.39it/s]
 22%|██▏       | 83319/371472 [6:37:32<23:59:48,  3.34it/s]
 22%|██▏       | 83320/371472 [6:37:32<24:08:41,  3.32it/s]
                                                           
{'loss': 4.0718, 'learning_rate': 7.985089099097158e-07, 'epoch': 3.59}

 22%|██▏       | 83320/371472 [6:37:32<24:08:41,  3.32it/s]
 22%|██▏       | 83321/371472 [6:37:32<23:49:46,  3.36it/s]
 22%|██▏       | 83322/371472 [6:37:32<22:56:03,  3.49it/s]
 22%|██▏       | 83323/371472 [6:37:33<22:13:01,  3.60it/s]
 22%|██▏       | 83324/371472 [6:37:33<21:32:52,  3.71it/s]
 22%|██▏       | 83325/371472 [6:37:33<21:52:45,  3.66it/s]
 22%|██▏       | 83326/371472 [6:37:34<23:18:48,  3.43it/s]
 22%|██▏       | 83327/371472 [6:37:34<23:10:05,  3.45it/s]
 22%|██▏       | 83328/371472 [6:37:34<22:35:04,  3.54it/s]
 22%|██▏       | 83329/371472 [6:37:34<23:14:27,  3.44it/s]
 22%|██▏       | 83330/371472 [6:37:35<23:12:31,  3.45it/s]
 22%|██▏       | 83331/371472 [6:37:35<25:30:42,  3.14it/s]
 22%|██▏       | 83332/371472 [6:37:35<24:22:01,  3.28it/s]
 22%|██▏       | 83333/371472 [6:37:36<23:54:59,  3.35it/s]
 22%|██▏       | 83334/371472 [6:37:36<24:25:12,  3.28it/s]
 22%|██▏       | 83335/371472 [6:37:36<24:22:10,  3.28it/s]
 22%|██▏       | 83336/371472 [6:37:37<24:01:02,  3.33it/s]
 22%|██▏       | 83337/371472 [6:37:37<23:31:41,  3.40it/s]
 22%|██▏       | 83338/371472 [6:37:37<24:54:46,  3.21it/s]
 22%|██▏       | 83339/371472 [6:37:37<24:17:11,  3.30it/s]
 22%|██▏       | 83340/371472 [6:37:38<25:39:39,  3.12it/s]
                                                           
{'loss': 3.8139, 'learning_rate': 7.984604279342369e-07, 'epoch': 3.59}

 22%|██▏       | 83340/371472 [6:37:38<25:39:39,  3.12it/s]
 22%|██▏       | 83341/371472 [6:37:38<26:47:51,  2.99it/s]
 22%|██▏       | 83342/371472 [6:37:38<25:03:40,  3.19it/s]
 22%|██▏       | 83343/371472 [6:37:39<24:35:43,  3.25it/s]
 22%|██▏       | 83344/371472 [6:37:39<23:16:42,  3.44it/s]
 22%|██▏       | 83345/371472 [6:37:39<24:06:40,  3.32it/s]
 22%|██▏       | 83346/371472 [6:37:40<22:36:34,  3.54it/s]
 22%|██▏       | 83347/371472 [6:37:40<21:54:49,  3.65it/s]
 22%|██▏       | 83348/371472 [6:37:40<24:21:10,  3.29it/s]
 22%|██▏       | 83349/371472 [6:37:40<23:19:06,  3.43it/s]
 22%|██▏       | 83350/371472 [6:37:41<22:32:39,  3.55it/s]
 22%|██▏       | 83351/371472 [6:37:41<21:33:15,  3.71it/s]
 22%|██▏       | 83352/371472 [6:37:41<21:18:59,  3.75it/s]
 22%|██▏       | 83353/371472 [6:37:41<20:58:37,  3.82it/s]
 22%|██▏       | 83354/371472 [6:37:42<21:16:42,  3.76it/s]
 22%|██▏       | 83355/371472 [6:37:42<21:38:14,  3.70it/s]
 22%|██▏       | 83356/371472 [6:37:42<22:37:18,  3.54it/s]
 22%|██▏       | 83357/371472 [6:37:43<23:59:09,  3.34it/s]
 22%|██▏       | 83358/371472 [6:37:43<24:24:14,  3.28it/s]
 22%|██▏       | 83359/371472 [6:37:43<24:09:24,  3.31it/s]
 22%|██▏       | 83360/371472 [6:37:44<23:22:40,  3.42it/s]
                                                           
{'loss': 4.0234, 'learning_rate': 7.984119459587579e-07, 'epoch': 3.59}

 22%|██▏       | 83360/371472 [6:37:44<23:22:40,  3.42it/s]
 22%|██▏       | 83361/371472 [6:37:44<22:28:48,  3.56it/s]
 22%|██▏       | 83362/371472 [6:37:44<21:56:36,  3.65it/s]
 22%|██▏       | 83363/371472 [6:37:44<21:13:15,  3.77it/s]
 22%|██▏       | 83364/371472 [6:37:45<22:26:49,  3.57it/s]
 22%|██▏       | 83365/371472 [6:37:45<22:10:17,  3.61it/s]
 22%|██▏       | 83366/371472 [6:37:45<21:56:12,  3.65it/s]
 22%|██▏       | 83367/371472 [6:37:45<21:34:52,  3.71it/s]
 22%|██▏       | 83368/371472 [6:37:46<22:48:39,  3.51it/s]
 22%|██▏       | 83369/371472 [6:37:46<23:31:40,  3.40it/s]
 22%|██▏       | 83370/371472 [6:37:46<23:52:08,  3.35it/s]
 22%|██▏       | 83371/371472 [6:37:47<23:27:59,  3.41it/s]
 22%|██▏       | 83372/371472 [6:37:47<23:30:12,  3.40it/s]
 22%|██▏       | 83373/371472 [6:37:47<22:39:35,  3.53it/s]
 22%|██▏       | 83374/371472 [6:37:47<21:32:52,  3.71it/s]
 22%|██▏       | 83375/371472 [6:37:48<22:16:36,  3.59it/s]
 22%|██▏       | 83376/371472 [6:37:48<21:59:43,  3.64it/s]
 22%|██▏       | 83377/371472 [6:37:48<22:00:09,  3.64it/s]
 22%|██▏       | 83378/371472 [6:37:49<22:24:39,  3.57it/s]
 22%|██▏       | 83379/371472 [6:37:49<22:31:59,  3.55it/s]
 22%|██▏       | 83380/371472 [6:37:49<22:10:42,  3.61it/s]
                                                           
{'loss': 4.1785, 'learning_rate': 7.98363463983279e-07, 'epoch': 3.59}

 22%|██▏       | 83380/371472 [6:37:49<22:10:42,  3.61it/s]
 22%|██▏       | 83381/371472 [6:37:49<22:03:54,  3.63it/s]
 22%|██▏       | 83382/371472 [6:37:50<21:51:15,  3.66it/s]
 22%|██▏       | 83383/371472 [6:37:50<22:07:54,  3.62it/s]
 22%|██▏       | 83384/371472 [6:37:50<23:01:21,  3.48it/s]
 22%|██▏       | 83385/371472 [6:37:51<22:17:46,  3.59it/s]
 22%|██▏       | 83386/371472 [6:37:51<21:48:10,  3.67it/s]
 22%|██▏       | 83387/371472 [6:37:51<23:25:07,  3.42it/s]
 22%|██▏       | 83388/371472 [6:37:51<22:42:10,  3.52it/s]
 22%|██▏       | 83389/371472 [6:37:52<24:44:25,  3.23it/s]
 22%|██▏       | 83390/371472 [6:37:52<23:32:47,  3.40it/s]
 22%|██▏       | 83391/371472 [6:37:52<23:22:57,  3.42it/s]
 22%|██▏       | 83392/371472 [6:37:53<23:13:40,  3.45it/s]
 22%|██▏       | 83393/371472 [6:37:53<22:20:15,  3.58it/s]
 22%|██▏       | 83394/371472 [6:37:53<23:36:25,  3.39it/s]
 22%|██▏       | 83395/371472 [6:37:53<23:45:58,  3.37it/s]
 22%|██▏       | 83396/371472 [6:37:54<22:52:56,  3.50it/s]
 22%|██▏       | 83397/371472 [6:37:54<22:23:03,  3.57it/s]
 22%|██▏       | 83398/371472 [6:37:54<22:39:49,  3.53it/s]
 22%|██▏       | 83399/371472 [6:37:55<23:15:51,  3.44it/s]
 22%|██▏       | 83400/371472 [6:37:55<22:57:09,  3.49it/s]
                                                           
{'loss': 3.8668, 'learning_rate': 7.983149820078002e-07, 'epoch': 3.59}

 22%|██▏       | 83400/371472 [6:37:55<22:57:09,  3.49it/s]
 22%|██▏       | 83401/371472 [6:37:55<22:35:29,  3.54it/s]
 22%|██▏       | 83402/371472 [6:37:55<21:38:23,  3.70it/s]
 22%|██▏       | 83403/371472 [6:37:56<21:49:01,  3.67it/s]
 22%|██▏       | 83404/371472 [6:37:56<21:07:37,  3.79it/s]
 22%|██▏       | 83405/371472 [6:37:56<22:49:47,  3.50it/s]
 22%|██▏       | 83406/371472 [6:37:57<22:42:47,  3.52it/s]
 22%|██▏       | 83407/371472 [6:37:57<22:25:31,  3.57it/s]
 22%|██▏       | 83408/371472 [6:37:57<22:43:45,  3.52it/s]
 22%|██▏       | 83409/371472 [6:37:57<22:35:41,  3.54it/s]
 22%|██▏       | 83410/371472 [6:37:58<22:19:14,  3.58it/s]
 22%|██▏       | 83411/371472 [6:37:58<23:11:02,  3.45it/s]
 22%|██▏       | 83412/371472 [6:37:58<22:42:44,  3.52it/s]
 22%|██▏       | 83413/371472 [6:37:58<22:32:32,  3.55it/s]
 22%|██▏       | 83414/371472 [6:37:59<22:15:38,  3.59it/s]
 22%|██▏       | 83415/371472 [6:37:59<22:02:26,  3.63it/s]
 22%|██▏       | 83416/371472 [6:37:59<22:34:52,  3.54it/s]
 22%|██▏       | 83417/371472 [6:38:00<22:07:48,  3.62it/s]
 22%|██▏       | 83418/371472 [6:38:00<21:43:01,  3.68it/s]
 22%|██▏       | 83419/371472 [6:38:00<22:13:54,  3.60it/s]
 22%|██▏       | 83420/371472 [6:38:00<22:58:41,  3.48it/s]
                                                           
{'loss': 3.9668, 'learning_rate': 7.982665000323212e-07, 'epoch': 3.59}

 22%|██▏       | 83420/371472 [6:38:00<22:58:41,  3.48it/s]
 22%|██▏       | 83421/371472 [6:38:01<22:44:32,  3.52it/s]
 22%|██▏       | 83422/371472 [6:38:01<22:31:43,  3.55it/s]
 22%|██▏       | 83423/371472 [6:38:01<22:07:16,  3.62it/s]
 22%|██▏       | 83424/371472 [6:38:02<22:27:33,  3.56it/s]
 22%|██▏       | 83425/371472 [6:38:02<22:01:54,  3.63it/s]
 22%|██▏       | 83426/371472 [6:38:02<21:51:57,  3.66it/s]
 22%|██▏       | 83427/371472 [6:38:02<22:04:20,  3.63it/s]
 22%|██▏       | 83428/371472 [6:38:03<22:09:58,  3.61it/s]
 22%|██▏       | 83429/371472 [6:38:03<24:04:14,  3.32it/s]
 22%|██▏       | 83430/371472 [6:38:03<23:13:37,  3.44it/s]
 22%|██▏       | 83431/371472 [6:38:04<22:39:30,  3.53it/s]
 22%|██▏       | 83432/371472 [6:38:04<22:13:54,  3.60it/s]
 22%|██▏       | 83433/371472 [6:38:04<22:16:26,  3.59it/s]
 22%|██▏       | 83434/371472 [6:38:04<22:07:25,  3.62it/s]
 22%|██▏       | 83435/371472 [6:38:05<22:20:22,  3.58it/s]
 22%|██▏       | 83436/371472 [6:38:05<22:34:52,  3.54it/s]
 22%|██▏       | 83437/371472 [6:38:05<23:33:23,  3.40it/s]
 22%|██▏       | 83438/371472 [6:38:06<22:36:42,  3.54it/s]
 22%|██▏       | 83439/371472 [6:38:06<23:37:22,  3.39it/s]
 22%|██▏       | 83440/371472 [6:38:06<23:18:12,  3.43it/s]
                                                           
{'loss': 3.9363, 'learning_rate': 7.982180180568424e-07, 'epoch': 3.59}

 22%|██▏       | 83440/371472 [6:38:06<23:18:12,  3.43it/s]
 22%|██▏       | 83441/371472 [6:38:06<22:54:44,  3.49it/s]
 22%|██▏       | 83442/371472 [6:38:07<22:58:52,  3.48it/s]
 22%|██▏       | 83443/371472 [6:38:07<23:46:15,  3.37it/s]
 22%|██▏       | 83444/371472 [6:38:07<23:42:01,  3.38it/s]
 22%|██▏       | 83445/371472 [6:38:08<23:10:46,  3.45it/s]
 22%|██▏       | 83446/371472 [6:38:08<23:26:59,  3.41it/s]
 22%|██▏       | 83447/371472 [6:38:08<22:59:21,  3.48it/s]
 22%|██▏       | 83448/371472 [6:38:08<22:45:39,  3.52it/s]
 22%|██▏       | 83449/371472 [6:38:09<22:32:22,  3.55it/s]
 22%|██▏       | 83450/371472 [6:38:09<21:37:49,  3.70it/s]
 22%|██▏       | 83451/371472 [6:38:09<22:14:48,  3.60it/s]
 22%|██▏       | 83452/371472 [6:38:09<21:35:15,  3.71it/s]
 22%|██▏       | 83453/371472 [6:38:10<21:20:10,  3.75it/s]
 22%|██▏       | 83454/371472 [6:38:10<23:41:19,  3.38it/s]
 22%|██▏       | 83455/371472 [6:38:10<23:06:00,  3.46it/s]
 22%|██▏       | 83456/371472 [6:38:11<23:28:07,  3.41it/s]
 22%|██▏       | 83457/371472 [6:38:11<22:37:03,  3.54it/s]
 22%|██▏       | 83458/371472 [6:38:11<21:58:34,  3.64it/s]
 22%|██▏       | 83459/371472 [6:38:11<21:50:18,  3.66it/s]
 22%|██▏       | 83460/371472 [6:38:12<23:30:26,  3.40it/s]
                                                           
{'loss': 3.9967, 'learning_rate': 7.981695360813635e-07, 'epoch': 3.59}

 22%|██▏       | 83460/371472 [6:38:12<23:30:26,  3.40it/s]
 22%|██▏       | 83461/371472 [6:38:12<22:46:42,  3.51it/s]
 22%|██▏       | 83462/371472 [6:38:12<22:31:00,  3.55it/s]
 22%|██▏       | 83463/371472 [6:38:13<22:01:27,  3.63it/s]
 22%|██▏       | 83464/371472 [6:38:13<22:41:52,  3.52it/s]
 22%|██▏       | 83465/371472 [6:38:13<21:53:38,  3.65it/s]
 22%|██▏       | 83466/371472 [6:38:13<21:56:11,  3.65it/s]
 22%|██▏       | 83467/371472 [6:38:14<21:32:52,  3.71it/s]
 22%|██▏       | 83468/371472 [6:38:14<21:46:55,  3.67it/s]
 22%|██▏       | 83469/371472 [6:38:14<21:22:00,  3.74it/s]
 22%|██▏       | 83470/371472 [6:38:15<22:22:07,  3.58it/s]
 22%|██▏       | 83471/371472 [6:38:15<23:11:59,  3.45it/s]
 22%|██▏       | 83472/371472 [6:38:15<22:35:35,  3.54it/s]
 22%|██▏       | 83473/371472 [6:38:15<22:01:27,  3.63it/s]
 22%|██▏       | 83474/371472 [6:38:16<22:34:16,  3.54it/s]
 22%|██▏       | 83475/371472 [6:38:16<24:16:52,  3.29it/s]
 22%|██▏       | 83476/371472 [6:38:16<24:37:28,  3.25it/s]
 22%|██▏       | 83477/371472 [6:38:17<23:47:45,  3.36it/s]
 22%|██▏       | 83478/371472 [6:38:17<24:46:30,  3.23it/s]
 22%|██▏       | 83479/371472 [6:38:17<23:58:07,  3.34it/s]
 22%|██▏       | 83480/371472 [6:38:18<23:08:34,  3.46it/s]
                                                           
{'loss': 3.844, 'learning_rate': 7.981210541058846e-07, 'epoch': 3.6}

 22%|██▏       | 83480/371472 [6:38:18<23:08:34,  3.46it/s]
 22%|██▏       | 83481/371472 [6:38:18<23:16:18,  3.44it/s]
 22%|██▏       | 83482/371472 [6:38:18<23:33:02,  3.40it/s]
 22%|██▏       | 83483/371472 [6:38:18<24:02:17,  3.33it/s]
 22%|██▏       | 83484/371472 [6:38:19<22:48:14,  3.51it/s]
 22%|██▏       | 83485/371472 [6:38:19<22:42:36,  3.52it/s]
 22%|██▏       | 83486/371472 [6:38:19<22:23:13,  3.57it/s]
 22%|██▏       | 83487/371472 [6:38:19<21:32:10,  3.71it/s]
 22%|██▏       | 83488/371472 [6:38:20<23:19:03,  3.43it/s]
 22%|██▏       | 83489/371472 [6:38:20<23:57:50,  3.34it/s]
 22%|██▏       | 83490/371472 [6:38:20<24:26:53,  3.27it/s]
 22%|██▏       | 83491/371472 [6:38:21<22:38:47,  3.53it/s]
 22%|██▏       | 83492/371472 [6:38:21<22:06:09,  3.62it/s]
 22%|██▏       | 83493/371472 [6:38:21<22:16:26,  3.59it/s]
 22%|██▏       | 83494/371472 [6:38:21<22:04:56,  3.62it/s]
 22%|██▏       | 83495/371472 [6:38:22<22:03:22,  3.63it/s]
 22%|██▏       | 83496/371472 [6:38:22<21:59:53,  3.64it/s]
 22%|██▏       | 83497/371472 [6:38:22<25:26:13,  3.14it/s]
 22%|██▏       | 83498/371472 [6:38:23<24:00:28,  3.33it/s]
 22%|██▏       | 83499/371472 [6:38:23<22:58:07,  3.48it/s]
 22%|██▏       | 83500/371472 [6:38:23<24:42:46,  3.24it/s]
                                                           
{'loss': 3.9268, 'learning_rate': 7.980725721304057e-07, 'epoch': 3.6}

 22%|██▏       | 83500/371472 [6:38:23<24:42:46,  3.24it/s]
 22%|██▏       | 83501/371472 [6:38:24<24:27:44,  3.27it/s]
 22%|██▏       | 83502/371472 [6:38:24<23:40:10,  3.38it/s]
 22%|██▏       | 83503/371472 [6:38:24<22:31:21,  3.55it/s]
 22%|██▏       | 83504/371472 [6:38:24<22:14:53,  3.60it/s]
 22%|██▏       | 83505/371472 [6:38:25<21:57:26,  3.64it/s]
 22%|██▏       | 83506/371472 [6:38:25<21:34:10,  3.71it/s]
 22%|██▏       | 83507/371472 [6:38:25<21:10:41,  3.78it/s]
 22%|██▏       | 83508/371472 [6:38:25<21:36:12,  3.70it/s]
 22%|██▏       | 83509/371472 [6:38:26<21:22:44,  3.74it/s]
 22%|██▏       | 83510/371472 [6:38:26<21:36:38,  3.70it/s]
 22%|██▏       | 83511/371472 [6:38:26<21:13:33,  3.77it/s]
 22%|██▏       | 83512/371472 [6:38:27<20:49:10,  3.84it/s]
 22%|██▏       | 83513/371472 [6:38:27<20:28:55,  3.91it/s]
 22%|██▏       | 83514/371472 [6:38:27<21:26:06,  3.73it/s]
 22%|██▏       | 83515/371472 [6:38:27<20:58:22,  3.81it/s]
 22%|██▏       | 83516/371472 [6:38:28<21:02:59,  3.80it/s]
 22%|██▏       | 83517/371472 [6:38:28<21:43:39,  3.68it/s]
 22%|██▏       | 83518/371472 [6:38:28<21:21:31,  3.74it/s]
 22%|██▏       | 83519/371472 [6:38:28<21:17:37,  3.76it/s]
 22%|██▏       | 83520/371472 [6:38:29<21:10:07,  3.78it/s]
                                                           
{'loss': 4.1531, 'learning_rate': 7.980240901549269e-07, 'epoch': 3.6}

 22%|██▏       | 83520/371472 [6:38:29<21:10:07,  3.78it/s]
 22%|██▏       | 83521/371472 [6:38:29<22:20:48,  3.58it/s]
 22%|██▏       | 83522/371472 [6:38:29<22:01:06,  3.63it/s]
 22%|██▏       | 83523/371472 [6:38:29<21:07:51,  3.79it/s]
 22%|██▏       | 83524/371472 [6:38:30<20:19:59,  3.93it/s]
 22%|██▏       | 83525/371472 [6:38:30<20:19:54,  3.93it/s]
 22%|██▏       | 83526/371472 [6:38:30<20:59:06,  3.81it/s]
 22%|██▏       | 83527/371472 [6:38:31<23:22:59,  3.42it/s]
 22%|██▏       | 83528/371472 [6:38:31<22:26:01,  3.57it/s]
 22%|██▏       | 83529/371472 [6:38:31<22:40:31,  3.53it/s]
 22%|██▏       | 83530/371472 [6:38:32<25:32:55,  3.13it/s]
 22%|██▏       | 83531/371472 [6:38:32<24:48:03,  3.23it/s]
 22%|██▏       | 83532/371472 [6:38:32<23:29:58,  3.40it/s]
 22%|██▏       | 83533/371472 [6:38:32<23:44:28,  3.37it/s]
 22%|██▏       | 83534/371472 [6:38:33<24:59:13,  3.20it/s]
 22%|██▏       | 83535/371472 [6:38:33<23:59:26,  3.33it/s]
 22%|██▏       | 83536/371472 [6:38:33<23:17:01,  3.44it/s]
 22%|██▏       | 83537/371472 [6:38:34<24:12:50,  3.30it/s]
 22%|██▏       | 83538/371472 [6:38:34<23:49:42,  3.36it/s]
 22%|██▏       | 83539/371472 [6:38:34<25:29:23,  3.14it/s]
 22%|██▏       | 83540/371472 [6:38:35<25:10:58,  3.18it/s]
                                                           
{'loss': 3.9779, 'learning_rate': 7.979756081794479e-07, 'epoch': 3.6}

 22%|██▏       | 83540/371472 [6:38:35<25:10:58,  3.18it/s]
 22%|██▏       | 83541/371472 [6:38:35<24:53:11,  3.21it/s]
 22%|██▏       | 83542/371472 [6:38:35<24:54:50,  3.21it/s]
 22%|██▏       | 83543/371472 [6:38:35<24:20:30,  3.29it/s]
 22%|██▏       | 83544/371472 [6:38:36<22:32:50,  3.55it/s]
 22%|██▏       | 83545/371472 [6:38:36<22:38:53,  3.53it/s]
 22%|██▏       | 83546/371472 [6:38:36<22:20:17,  3.58it/s]
 22%|██▏       | 83547/371472 [6:38:37<22:18:57,  3.58it/s]
 22%|██▏       | 83548/371472 [6:38:37<22:11:53,  3.60it/s]
 22%|██▏       | 83549/371472 [6:38:37<21:54:32,  3.65it/s]
 22%|██▏       | 83550/371472 [6:38:37<21:33:34,  3.71it/s]
 22%|██▏       | 83551/371472 [6:38:38<21:34:26,  3.71it/s]
 22%|██▏       | 83552/371472 [6:38:38<21:59:45,  3.64it/s]
 22%|██▏       | 83553/371472 [6:38:38<21:35:38,  3.70it/s]
 22%|██▏       | 83554/371472 [6:38:38<22:03:11,  3.63it/s]
 22%|██▏       | 83555/371472 [6:38:39<22:48:28,  3.51it/s]
 22%|██▏       | 83556/371472 [6:38:39<23:02:39,  3.47it/s]
 22%|██▏       | 83557/371472 [6:38:39<23:05:33,  3.46it/s]
 22%|██▏       | 83558/371472 [6:38:40<23:16:48,  3.44it/s]
 22%|██▏       | 83559/371472 [6:38:40<22:17:18,  3.59it/s]
 22%|██▏       | 83560/371472 [6:38:40<22:46:14,  3.51it/s]
                                                           
{'loss': 3.9095, 'learning_rate': 7.979271262039691e-07, 'epoch': 3.6}

 22%|██▏       | 83560/371472 [6:38:40<22:46:14,  3.51it/s]
 22%|██▏       | 83561/371472 [6:38:40<23:11:24,  3.45it/s]
 22%|██▏       | 83562/371472 [6:38:41<24:12:23,  3.30it/s]
 22%|██▏       | 83563/371472 [6:38:41<24:03:49,  3.32it/s]
 22%|██▏       | 83564/371472 [6:38:41<24:49:33,  3.22it/s]
 22%|██▏       | 83565/371472 [6:38:42<24:07:35,  3.31it/s]
 22%|██▏       | 83566/371472 [6:38:42<23:13:06,  3.44it/s]
 22%|██▏       | 83567/371472 [6:38:42<22:58:54,  3.48it/s]
 22%|██▏       | 83568/371472 [6:38:43<22:41:16,  3.52it/s]
 22%|██▏       | 83569/371472 [6:38:43<22:34:25,  3.54it/s]
 22%|██▏       | 83570/371472 [6:38:43<22:22:23,  3.57it/s]
 22%|██▏       | 83571/371472 [6:38:43<23:21:25,  3.42it/s]
 22%|██▏       | 83572/371472 [6:38:44<23:02:34,  3.47it/s]
 22%|██▏       | 83573/371472 [6:38:44<22:49:37,  3.50it/s]
 22%|██▏       | 83574/371472 [6:38:44<22:01:15,  3.63it/s]
 22%|██▏       | 83575/371472 [6:38:44<21:23:29,  3.74it/s]
 22%|██▏       | 83576/371472 [6:38:45<21:10:59,  3.78it/s]
 22%|██▏       | 83577/371472 [6:38:45<20:59:38,  3.81it/s]
 22%|██▏       | 83578/371472 [6:38:45<22:26:57,  3.56it/s]
 22%|██▏       | 83579/371472 [6:38:46<21:46:41,  3.67it/s]
 22%|██▏       | 83580/371472 [6:38:46<21:01:30,  3.80it/s]
                                                           
{'loss': 3.9255, 'learning_rate': 7.978786442284902e-07, 'epoch': 3.6}

 22%|██▏       | 83580/371472 [6:38:46<21:01:30,  3.80it/s]
 22%|██▏       | 83581/371472 [6:38:46<20:43:31,  3.86it/s]
 23%|██▎       | 83582/371472 [6:38:46<20:57:00,  3.82it/s]
 23%|██▎       | 83583/371472 [6:38:47<20:21:28,  3.93it/s]
 23%|██▎       | 83584/371472 [6:38:47<20:04:11,  3.98it/s]
 23%|██▎       | 83585/371472 [6:38:47<22:49:38,  3.50it/s]
 23%|██▎       | 83586/371472 [6:38:47<21:56:58,  3.64it/s]
 23%|██▎       | 83587/371472 [6:38:48<23:40:45,  3.38it/s]
 23%|██▎       | 83588/371472 [6:38:48<23:24:33,  3.42it/s]
 23%|██▎       | 83589/371472 [6:38:48<22:59:48,  3.48it/s]
 23%|██▎       | 83590/371472 [6:38:49<23:23:57,  3.42it/s]
 23%|██▎       | 83591/371472 [6:38:49<22:26:36,  3.56it/s]
 23%|██▎       | 83592/371472 [6:38:49<22:53:29,  3.49it/s]
 23%|██▎       | 83593/371472 [6:38:50<23:54:45,  3.34it/s]
 23%|██▎       | 83594/371472 [6:38:50<22:39:29,  3.53it/s]
 23%|██▎       | 83595/371472 [6:38:50<22:00:10,  3.63it/s]
 23%|██▎       | 83596/371472 [6:38:50<21:48:46,  3.67it/s]
 23%|██▎       | 83597/371472 [6:38:51<23:18:03,  3.43it/s]
 23%|██▎       | 83598/371472 [6:38:51<22:33:53,  3.54it/s]
 23%|██▎       | 83599/371472 [6:38:51<22:44:45,  3.52it/s]
 23%|██▎       | 83600/371472 [6:38:51<21:44:25,  3.68it/s]
                                                           
{'loss': 3.8338, 'learning_rate': 7.978301622530112e-07, 'epoch': 3.6}

 23%|██▎       | 83600/371472 [6:38:51<21:44:25,  3.68it/s]
 23%|██▎       | 83601/371472 [6:38:52<21:40:45,  3.69it/s]
 23%|██▎       | 83602/371472 [6:38:52<22:08:16,  3.61it/s]
 23%|██▎       | 83603/371472 [6:38:52<23:18:04,  3.43it/s]
 23%|██▎       | 83604/371472 [6:38:53<22:34:52,  3.54it/s]
 23%|██▎       | 83605/371472 [6:38:53<22:04:51,  3.62it/s]
 23%|██▎       | 83606/371472 [6:38:53<22:01:07,  3.63it/s]
 23%|██▎       | 83607/371472 [6:38:53<21:11:29,  3.77it/s]
 23%|██▎       | 83608/371472 [6:38:54<21:48:36,  3.67it/s]
 23%|██▎       | 83609/371472 [6:38:54<24:10:12,  3.31it/s]
 23%|██▎       | 83610/371472 [6:38:54<23:29:15,  3.40it/s]
 23%|██▎       | 83611/371472 [6:38:55<23:09:05,  3.45it/s]
 23%|██▎       | 83612/371472 [6:38:55<22:21:07,  3.58it/s]
 23%|██▎       | 83613/371472 [6:38:55<22:01:54,  3.63it/s]
 23%|██▎       | 83614/371472 [6:38:55<21:42:39,  3.68it/s]
 23%|██▎       | 83615/371472 [6:38:56<21:00:40,  3.81it/s]
 23%|██▎       | 83616/371472 [6:38:56<21:09:22,  3.78it/s]
 23%|██▎       | 83617/371472 [6:38:56<21:41:00,  3.69it/s]
 23%|██▎       | 83618/371472 [6:38:56<21:20:40,  3.75it/s]
 23%|██▎       | 83619/371472 [6:38:57<24:01:59,  3.33it/s]
 23%|██▎       | 83620/371472 [6:38:57<24:00:36,  3.33it/s]
                                                           
{'loss': 4.0991, 'learning_rate': 7.977816802775323e-07, 'epoch': 3.6}

 23%|██▎       | 83620/371472 [6:38:57<24:00:36,  3.33it/s]
 23%|██▎       | 83621/371472 [6:38:57<22:57:16,  3.48it/s]
 23%|██▎       | 83622/371472 [6:38:58<24:14:05,  3.30it/s]
 23%|██▎       | 83623/371472 [6:38:58<23:17:19,  3.43it/s]
 23%|██▎       | 83624/371472 [6:38:58<23:06:42,  3.46it/s]
 23%|██▎       | 83625/371472 [6:38:58<22:31:14,  3.55it/s]
 23%|██▎       | 83626/371472 [6:38:59<22:54:33,  3.49it/s]
 23%|██▎       | 83627/371472 [6:38:59<23:09:26,  3.45it/s]
 23%|██▎       | 83628/371472 [6:38:59<22:10:29,  3.61it/s]
 23%|██▎       | 83629/371472 [6:39:00<23:05:45,  3.46it/s]
 23%|██▎       | 83630/371472 [6:39:00<22:09:01,  3.61it/s]
 23%|██▎       | 83631/371472 [6:39:00<22:01:02,  3.63it/s]
 23%|██▎       | 83632/371472 [6:39:00<21:36:02,  3.70it/s]
 23%|██▎       | 83633/371472 [6:39:01<21:40:44,  3.69it/s]
 23%|██▎       | 83634/371472 [6:39:01<22:22:13,  3.57it/s]
 23%|██▎       | 83635/371472 [6:39:01<23:02:37,  3.47it/s]
 23%|██▎       | 83636/371472 [6:39:02<22:44:32,  3.52it/s]
 23%|██▎       | 83637/371472 [6:39:02<23:56:50,  3.34it/s]
 23%|██▎       | 83638/371472 [6:39:02<24:52:11,  3.21it/s]
 23%|██▎       | 83639/371472 [6:39:02<22:57:56,  3.48it/s]
 23%|██▎       | 83640/371472 [6:39:03<23:33:58,  3.39it/s]
                                                           
{'loss': 4.0504, 'learning_rate': 7.977331983020534e-07, 'epoch': 3.6}

 23%|██▎       | 83640/371472 [6:39:03<23:33:58,  3.39it/s]
 23%|██▎       | 83641/371472 [6:39:03<23:41:38,  3.37it/s]
 23%|██▎       | 83642/371472 [6:39:03<23:25:58,  3.41it/s]
 23%|██▎       | 83643/371472 [6:39:04<22:50:32,  3.50it/s]
 23%|██▎       | 83644/371472 [6:39:04<22:03:04,  3.63it/s]
 23%|██▎       | 83645/371472 [6:39:04<22:44:31,  3.52it/s]
 23%|██▎       | 83646/371472 [6:39:05<23:45:13,  3.37it/s]
 23%|██▎       | 83647/371472 [6:39:05<22:48:46,  3.50it/s]
 23%|██▎       | 83648/371472 [6:39:05<22:33:17,  3.54it/s]
 23%|██▎       | 83649/371472 [6:39:05<23:35:42,  3.39it/s]
 23%|██▎       | 83650/371472 [6:39:06<25:16:15,  3.16it/s]
 23%|██▎       | 83651/371472 [6:39:06<23:50:01,  3.35it/s]
 23%|██▎       | 83652/371472 [6:39:06<22:27:10,  3.56it/s]
 23%|██▎       | 83653/371472 [6:39:07<22:04:31,  3.62it/s]
 23%|██▎       | 83654/371472 [6:39:07<22:25:22,  3.57it/s]
 23%|██▎       | 83655/371472 [6:39:07<22:05:38,  3.62it/s]
 23%|██▎       | 83656/371472 [6:39:07<22:21:15,  3.58it/s]
 23%|██▎       | 83657/371472 [6:39:08<22:46:33,  3.51it/s]
 23%|██▎       | 83658/371472 [6:39:08<22:01:24,  3.63it/s]
 23%|██▎       | 83659/371472 [6:39:08<21:47:27,  3.67it/s]
 23%|██▎       | 83660/371472 [6:39:08<21:06:24,  3.79it/s]
                                                           
{'loss': 4.2887, 'learning_rate': 7.976847163265745e-07, 'epoch': 3.6}

 23%|██▎       | 83660/371472 [6:39:08<21:06:24,  3.79it/s]
 23%|██▎       | 83661/371472 [6:39:09<22:16:47,  3.59it/s]
 23%|██▎       | 83662/371472 [6:39:09<23:03:10,  3.47it/s]
 23%|██▎       | 83663/371472 [6:39:09<22:31:12,  3.55it/s]
 23%|██▎       | 83664/371472 [6:39:10<22:09:39,  3.61it/s]
 23%|██▎       | 83665/371472 [6:39:10<22:37:24,  3.53it/s]
 23%|██▎       | 83666/371472 [6:39:10<22:28:27,  3.56it/s]
 23%|██▎       | 83667/371472 [6:39:10<21:33:35,  3.71it/s]
 23%|██▎       | 83668/371472 [6:39:11<21:44:52,  3.68it/s]
 23%|██▎       | 83669/371472 [6:39:11<22:25:49,  3.56it/s]
 23%|██▎       | 83670/371472 [6:39:11<21:38:43,  3.69it/s]
 23%|██▎       | 83671/371472 [6:39:12<21:59:09,  3.64it/s]
 23%|██▎       | 83672/371472 [6:39:12<22:15:31,  3.59it/s]
 23%|██▎       | 83673/371472 [6:39:12<22:24:12,  3.57it/s]
 23%|██▎       | 83674/371472 [6:39:12<22:47:53,  3.51it/s]
 23%|██▎       | 83675/371472 [6:39:13<21:55:40,  3.65it/s]
 23%|██▎       | 83676/371472 [6:39:13<21:33:47,  3.71it/s]
 23%|██▎       | 83677/371472 [6:39:13<22:16:20,  3.59it/s]
 23%|██▎       | 83678/371472 [6:39:13<22:21:33,  3.58it/s]
 23%|██▎       | 83679/371472 [6:39:14<22:19:25,  3.58it/s]
 23%|██▎       | 83680/371472 [6:39:14<22:50:34,  3.50it/s]
                                                           
{'loss': 4.0872, 'learning_rate': 7.976362343510957e-07, 'epoch': 3.6}

 23%|██▎       | 83680/371472 [6:39:14<22:50:34,  3.50it/s]
 23%|██▎       | 83681/371472 [6:39:14<23:59:52,  3.33it/s]
 23%|██▎       | 83682/371472 [6:39:15<23:20:53,  3.42it/s]
 23%|██▎       | 83683/371472 [6:39:15<21:54:38,  3.65it/s]
 23%|██▎       | 83684/371472 [6:39:15<21:36:26,  3.70it/s]
 23%|██▎       | 83685/371472 [6:39:15<21:33:55,  3.71it/s]
 23%|██▎       | 83686/371472 [6:39:16<22:06:54,  3.61it/s]
 23%|██▎       | 83687/371472 [6:39:16<22:16:57,  3.59it/s]
 23%|██▎       | 83688/371472 [6:39:16<21:45:10,  3.67it/s]
 23%|██▎       | 83689/371472 [6:39:17<21:49:00,  3.66it/s]
 23%|██▎       | 83690/371472 [6:39:17<21:44:17,  3.68it/s]
 23%|██▎       | 83691/371472 [6:39:17<22:10:08,  3.61it/s]
 23%|██▎       | 83692/371472 [6:39:17<22:13:45,  3.60it/s]
 23%|██▎       | 83693/371472 [6:39:18<22:11:39,  3.60it/s]
 23%|██▎       | 83694/371472 [6:39:18<22:44:25,  3.52it/s]
 23%|██▎       | 83695/371472 [6:39:18<22:21:38,  3.57it/s]
 23%|██▎       | 83696/371472 [6:39:18<21:47:17,  3.67it/s]
 23%|██▎       | 83697/371472 [6:39:19<22:13:36,  3.60it/s]
 23%|██▎       | 83698/371472 [6:39:19<22:57:35,  3.48it/s]
 23%|██▎       | 83699/371472 [6:39:19<22:49:43,  3.50it/s]
 23%|██▎       | 83700/371472 [6:39:20<22:54:18,  3.49it/s]
                                                           
{'loss': 4.2421, 'learning_rate': 7.975877523756168e-07, 'epoch': 3.61}

 23%|██▎       | 83700/371472 [6:39:20<22:54:18,  3.49it/s]
 23%|██▎       | 83701/371472 [6:39:20<23:53:49,  3.35it/s]
 23%|██▎       | 83702/371472 [6:39:20<23:39:28,  3.38it/s]
 23%|██▎       | 83703/371472 [6:39:21<22:45:06,  3.51it/s]
 23%|██▎       | 83704/371472 [6:39:21<21:46:02,  3.67it/s]
 23%|██▎       | 83705/371472 [6:39:21<21:40:03,  3.69it/s]
 23%|██▎       | 83706/371472 [6:39:21<22:09:53,  3.61it/s]
 23%|██▎       | 83707/371472 [6:39:22<21:44:15,  3.68it/s]
 23%|██▎       | 83708/371472 [6:39:22<23:45:06,  3.37it/s]
 23%|██▎       | 83709/371472 [6:39:22<22:59:42,  3.48it/s]
 23%|██▎       | 83710/371472 [6:39:22<23:12:07,  3.45it/s]
 23%|██▎       | 83711/371472 [6:39:23<22:00:34,  3.63it/s]
 23%|██▎       | 83712/371472 [6:39:23<21:15:51,  3.76it/s]
 23%|██▎       | 83713/371472 [6:39:23<21:20:40,  3.74it/s]
 23%|██▎       | 83714/371472 [6:39:24<23:36:00,  3.39it/s]
 23%|██▎       | 83715/371472 [6:39:24<24:37:35,  3.25it/s]
 23%|██▎       | 83716/371472 [6:39:24<24:04:13,  3.32it/s]
 23%|██▎       | 83717/371472 [6:39:25<24:14:22,  3.30it/s]
 23%|██▎       | 83718/371472 [6:39:25<23:36:28,  3.39it/s]
 23%|██▎       | 83719/371472 [6:39:25<23:28:43,  3.40it/s]
 23%|██▎       | 83720/371472 [6:39:25<22:34:23,  3.54it/s]
                                                           
{'loss': 4.0565, 'learning_rate': 7.975392704001379e-07, 'epoch': 3.61}

 23%|██▎       | 83720/371472 [6:39:25<22:34:23,  3.54it/s]
 23%|██▎       | 83721/371472 [6:39:26<24:58:30,  3.20it/s]
 23%|██▎       | 83722/371472 [6:39:26<23:17:17,  3.43it/s]
 23%|██▎       | 83723/371472 [6:39:26<22:36:53,  3.53it/s]
 23%|██▎       | 83724/371472 [6:39:27<22:43:11,  3.52it/s]
 23%|██▎       | 83725/371472 [6:39:27<21:45:00,  3.67it/s]
 23%|██▎       | 83726/371472 [6:39:27<21:20:53,  3.74it/s]
 23%|██▎       | 83727/371472 [6:39:27<22:16:18,  3.59it/s]
 23%|██▎       | 83728/371472 [6:39:28<22:54:01,  3.49it/s]
 23%|██▎       | 83729/371472 [6:39:28<25:20:45,  3.15it/s]
 23%|██▎       | 83730/371472 [6:39:28<24:07:31,  3.31it/s]
 23%|██▎       | 83731/371472 [6:39:29<24:43:52,  3.23it/s]
 23%|██▎       | 83732/371472 [6:39:29<24:16:43,  3.29it/s]
 23%|██▎       | 83733/371472 [6:39:29<24:11:24,  3.30it/s]
 23%|██▎       | 83734/371472 [6:39:29<23:32:26,  3.40it/s]
 23%|██▎       | 83735/371472 [6:39:30<22:28:32,  3.56it/s]
 23%|██▎       | 83736/371472 [6:39:30<22:25:30,  3.56it/s]
 23%|██▎       | 83737/371472 [6:39:30<21:59:42,  3.63it/s]
 23%|██▎       | 83738/371472 [6:39:31<21:38:41,  3.69it/s]
 23%|██▎       | 83739/371472 [6:39:31<22:20:22,  3.58it/s]
 23%|██▎       | 83740/371472 [6:39:31<23:40:41,  3.38it/s]
                                                           
{'loss': 4.077, 'learning_rate': 7.974907884246589e-07, 'epoch': 3.61}

 23%|██▎       | 83740/371472 [6:39:31<23:40:41,  3.38it/s]
 23%|██▎       | 83741/371472 [6:39:31<23:12:43,  3.44it/s]
 23%|██▎       | 83742/371472 [6:39:32<23:55:07,  3.34it/s]
 23%|██▎       | 83743/371472 [6:39:32<22:35:03,  3.54it/s]
 23%|██▎       | 83744/371472 [6:39:32<22:12:15,  3.60it/s]
 23%|██▎       | 83745/371472 [6:39:33<22:41:00,  3.52it/s]
 23%|██▎       | 83746/371472 [6:39:33<21:35:18,  3.70it/s]
 23%|██▎       | 83747/371472 [6:39:33<21:31:20,  3.71it/s]
 23%|██▎       | 83748/371472 [6:39:33<21:20:50,  3.74it/s]
 23%|██▎       | 83749/371472 [6:39:34<20:39:33,  3.87it/s]
 23%|██▎       | 83750/371472 [6:39:34<20:56:07,  3.82it/s]
 23%|██▎       | 83751/371472 [6:39:34<20:51:21,  3.83it/s]
 23%|██▎       | 83752/371472 [6:39:34<21:43:45,  3.68it/s]
 23%|██▎       | 83753/371472 [6:39:35<22:44:05,  3.52it/s]
 23%|██▎       | 83754/371472 [6:39:35<22:54:27,  3.49it/s]
 23%|██▎       | 83755/371472 [6:39:35<23:18:18,  3.43it/s]
 23%|██▎       | 83756/371472 [6:39:36<22:02:12,  3.63it/s]
 23%|██▎       | 83757/371472 [6:39:36<21:38:27,  3.69it/s]
 23%|██▎       | 83758/371472 [6:39:36<21:54:40,  3.65it/s]
 23%|██▎       | 83759/371472 [6:39:36<21:59:17,  3.63it/s]
 23%|██▎       | 83760/371472 [6:39:37<21:51:02,  3.66it/s]
                                                           
{'loss': 4.0384, 'learning_rate': 7.974423064491801e-07, 'epoch': 3.61}

 23%|██▎       | 83760/371472 [6:39:37<21:51:02,  3.66it/s]
 23%|██▎       | 83761/371472 [6:39:37<22:36:17,  3.54it/s]
 23%|██▎       | 83762/371472 [6:39:37<22:24:53,  3.57it/s]
 23%|██▎       | 83763/371472 [6:39:38<22:18:56,  3.58it/s]
 23%|██▎       | 83764/371472 [6:39:38<22:55:19,  3.49it/s]
 23%|██▎       | 83765/371472 [6:39:38<22:53:05,  3.49it/s]
 23%|██▎       | 83766/371472 [6:39:38<22:42:58,  3.52it/s]
 23%|██▎       | 83767/371472 [6:39:39<22:12:45,  3.60it/s]
 23%|██▎       | 83768/371472 [6:39:39<22:35:23,  3.54it/s]
 23%|██▎       | 83769/371472 [6:39:39<22:27:28,  3.56it/s]
 23%|██▎       | 83770/371472 [6:39:39<22:07:40,  3.61it/s]
 23%|██▎       | 83771/371472 [6:39:40<21:35:26,  3.70it/s]
 23%|██▎       | 83772/371472 [6:39:40<20:55:24,  3.82it/s]
 23%|██▎       | 83773/371472 [6:39:40<20:42:02,  3.86it/s]
 23%|██▎       | 83774/371472 [6:39:40<21:03:07,  3.80it/s]
 23%|██▎       | 83775/371472 [6:39:41<21:05:27,  3.79it/s]
 23%|██▎       | 83776/371472 [6:39:41<21:21:04,  3.74it/s]
 23%|██▎       | 83777/371472 [6:39:41<21:36:26,  3.70it/s]
 23%|██▎       | 83778/371472 [6:39:42<21:12:39,  3.77it/s]
 23%|██▎       | 83779/371472 [6:39:42<20:57:02,  3.81it/s]
 23%|██▎       | 83780/371472 [6:39:42<20:44:25,  3.85it/s]
                                                           
{'loss': 3.9828, 'learning_rate': 7.973938244737012e-07, 'epoch': 3.61}

 23%|██▎       | 83780/371472 [6:39:42<20:44:25,  3.85it/s]
 23%|██▎       | 83781/371472 [6:39:42<20:27:32,  3.91it/s]
 23%|██▎       | 83782/371472 [6:39:43<21:53:45,  3.65it/s]
 23%|██▎       | 83783/371472 [6:39:43<21:09:17,  3.78it/s]
 23%|██▎       | 83784/371472 [6:39:43<20:29:27,  3.90it/s]
 23%|██▎       | 83785/371472 [6:39:43<20:33:34,  3.89it/s]
 23%|██▎       | 83786/371472 [6:39:44<21:25:00,  3.73it/s]
 23%|██▎       | 83787/371472 [6:39:44<21:59:52,  3.63it/s]
 23%|██▎       | 83788/371472 [6:39:44<22:34:45,  3.54it/s]
 23%|██▎       | 83789/371472 [6:39:45<22:44:20,  3.51it/s]
 23%|██▎       | 83790/371472 [6:39:45<22:40:04,  3.53it/s]
 23%|██▎       | 83791/371472 [6:39:45<22:51:44,  3.50it/s]
 23%|██▎       | 83792/371472 [6:39:45<22:30:07,  3.55it/s]
 23%|██▎       | 83793/371472 [6:39:46<23:06:03,  3.46it/s]
 23%|██▎       | 83794/371472 [6:39:46<23:07:20,  3.46it/s]
 23%|██▎       | 83795/371472 [6:39:46<23:02:59,  3.47it/s]
 23%|██▎       | 83796/371472 [6:39:47<22:40:42,  3.52it/s]
 23%|██▎       | 83797/371472 [6:39:47<22:34:31,  3.54it/s]
 23%|██▎       | 83798/371472 [6:39:47<23:31:50,  3.40it/s]
 23%|██▎       | 83799/371472 [6:39:47<23:16:53,  3.43it/s]
 23%|██▎       | 83800/371472 [6:39:48<22:56:26,  3.48it/s]
                                                           
{'loss': 3.8051, 'learning_rate': 7.973453424982223e-07, 'epoch': 3.61}

 23%|██▎       | 83800/371472 [6:39:48<22:56:26,  3.48it/s]
 23%|██▎       | 83801/371472 [6:39:48<24:02:09,  3.32it/s]
 23%|██▎       | 83802/371472 [6:39:48<24:11:08,  3.30it/s]
 23%|██▎       | 83803/371472 [6:39:49<23:29:07,  3.40it/s]
 23%|██▎       | 83804/371472 [6:39:49<24:07:10,  3.31it/s]
 23%|██▎       | 83805/371472 [6:39:49<25:14:56,  3.16it/s]
 23%|██▎       | 83806/371472 [6:39:50<24:12:50,  3.30it/s]
 23%|██▎       | 83807/371472 [6:39:50<25:46:35,  3.10it/s]
 23%|██▎       | 83808/371472 [6:39:50<24:35:25,  3.25it/s]
 23%|██▎       | 83809/371472 [6:39:50<23:02:29,  3.47it/s]
 23%|██▎       | 83810/371472 [6:39:51<21:55:56,  3.64it/s]
 23%|██▎       | 83811/371472 [6:39:51<22:04:44,  3.62it/s]
 23%|██▎       | 83812/371472 [6:39:51<24:03:59,  3.32it/s]
 23%|██▎       | 83813/371472 [6:39:52<23:25:42,  3.41it/s]
 23%|██▎       | 83814/371472 [6:39:52<23:14:09,  3.44it/s]
 23%|██▎       | 83815/371472 [6:39:52<24:03:09,  3.32it/s]
 23%|██▎       | 83816/371472 [6:39:53<23:52:36,  3.35it/s]
 23%|██▎       | 83817/371472 [6:39:53<22:49:42,  3.50it/s]
 23%|██▎       | 83818/371472 [6:39:53<23:24:41,  3.41it/s]
 23%|██▎       | 83819/371472 [6:39:53<24:44:55,  3.23it/s]
 23%|██▎       | 83820/371472 [6:39:54<24:59:08,  3.20it/s]
                                                           
{'loss': 4.0368, 'learning_rate': 7.972968605227434e-07, 'epoch': 3.61}

 23%|██▎       | 83820/371472 [6:39:54<24:59:08,  3.20it/s]
 23%|██▎       | 83821/371472 [6:39:54<23:48:56,  3.36it/s]
 23%|██▎       | 83822/371472 [6:39:54<23:31:02,  3.40it/s]
 23%|██▎       | 83823/371472 [6:39:55<22:48:56,  3.50it/s]
 23%|██▎       | 83824/371472 [6:39:55<23:54:41,  3.34it/s]
 23%|██▎       | 83825/371472 [6:39:55<24:24:42,  3.27it/s]
 23%|██▎       | 83826/371472 [6:39:55<23:16:11,  3.43it/s]
 23%|██▎       | 83827/371472 [6:39:56<22:18:22,  3.58it/s]
 23%|██▎       | 83828/371472 [6:39:56<21:28:08,  3.72it/s]
 23%|██▎       | 83829/371472 [6:39:56<21:18:44,  3.75it/s]
 23%|██▎       | 83830/371472 [6:39:57<22:39:24,  3.53it/s]
 23%|██▎       | 83831/371472 [6:39:57<22:22:52,  3.57it/s]
 23%|██▎       | 83832/371472 [6:39:57<21:54:53,  3.65it/s]
 23%|██▎       | 83833/371472 [6:39:57<23:58:46,  3.33it/s]
 23%|██▎       | 83834/371472 [6:39:58<24:05:59,  3.32it/s]
 23%|██▎       | 83835/371472 [6:39:58<22:42:32,  3.52it/s]
 23%|██▎       | 83836/371472 [6:39:58<23:10:45,  3.45it/s]
 23%|██▎       | 83837/371472 [6:39:59<24:59:15,  3.20it/s]
 23%|██▎       | 83838/371472 [6:39:59<23:34:30,  3.39it/s]
 23%|██▎       | 83839/371472 [6:39:59<24:42:08,  3.23it/s]
 23%|██▎       | 83840/371472 [6:40:00<23:31:24,  3.40it/s]
                                                           
{'loss': 3.9145, 'learning_rate': 7.972483785472645e-07, 'epoch': 3.61}

 23%|██▎       | 83840/371472 [6:40:00<23:31:24,  3.40it/s]
 23%|██▎       | 83841/371472 [6:40:00<23:17:11,  3.43it/s]
 23%|██▎       | 83842/371472 [6:40:00<22:34:28,  3.54it/s]
 23%|██▎       | 83843/371472 [6:40:00<22:23:22,  3.57it/s]
 23%|██▎       | 83844/371472 [6:40:01<22:09:04,  3.61it/s]
 23%|██▎       | 83845/371472 [6:40:01<21:45:44,  3.67it/s]
 23%|██▎       | 83846/371472 [6:40:01<22:53:42,  3.49it/s]
 23%|██▎       | 83847/371472 [6:40:01<23:05:15,  3.46it/s]
 23%|██▎       | 83848/371472 [6:40:02<23:10:22,  3.45it/s]
 23%|██▎       | 83849/371472 [6:40:02<23:33:42,  3.39it/s]
 23%|██▎       | 83850/371472 [6:40:02<22:12:10,  3.60it/s]
 23%|██▎       | 83851/371472 [6:40:03<23:09:21,  3.45it/s]
 23%|██▎       | 83852/371472 [6:40:03<22:39:59,  3.52it/s]
 23%|██▎       | 83853/371472 [6:40:03<21:37:27,  3.69it/s]
 23%|██▎       | 83854/371472 [6:40:03<21:41:14,  3.68it/s]
 23%|██▎       | 83855/371472 [6:40:04<22:04:50,  3.62it/s]
 23%|██▎       | 83856/371472 [6:40:04<23:18:08,  3.43it/s]
 23%|██▎       | 83857/371472 [6:40:04<22:43:34,  3.52it/s]
 23%|██▎       | 83858/371472 [6:40:05<21:53:21,  3.65it/s]
 23%|██▎       | 83859/371472 [6:40:05<21:37:04,  3.70it/s]
 23%|██▎       | 83860/371472 [6:40:05<24:14:52,  3.29it/s]
                                                           
{'loss': 3.9743, 'learning_rate': 7.971998965717856e-07, 'epoch': 3.61}

 23%|██▎       | 83860/371472 [6:40:05<24:14:52,  3.29it/s]
 23%|██▎       | 83861/371472 [6:40:05<23:43:07,  3.37it/s]
 23%|██▎       | 83862/371472 [6:40:06<23:01:36,  3.47it/s]
 23%|██▎       | 83863/371472 [6:40:06<23:28:26,  3.40it/s]
 23%|██▎       | 83864/371472 [6:40:06<22:56:32,  3.48it/s]
 23%|██▎       | 83865/371472 [6:40:07<22:41:19,  3.52it/s]
 23%|██▎       | 83866/371472 [6:40:07<24:02:42,  3.32it/s]
 23%|██▎       | 83867/371472 [6:40:07<24:31:40,  3.26it/s]
 23%|██▎       | 83868/371472 [6:40:08<23:54:51,  3.34it/s]
 23%|██▎       | 83869/371472 [6:40:08<23:28:17,  3.40it/s]
 23%|██▎       | 83870/371472 [6:40:08<22:47:01,  3.51it/s]
 23%|██▎       | 83871/371472 [6:40:09<25:36:26,  3.12it/s]
 23%|██▎       | 83872/371472 [6:40:09<24:34:40,  3.25it/s]
 23%|██▎       | 83873/371472 [6:40:09<24:01:44,  3.32it/s]
 23%|██▎       | 83874/371472 [6:40:09<24:10:02,  3.31it/s]
 23%|██▎       | 83875/371472 [6:40:10<25:29:24,  3.13it/s]
 23%|██▎       | 83876/371472 [6:40:10<25:51:38,  3.09it/s]
 23%|██▎       | 83877/371472 [6:40:10<24:10:56,  3.30it/s]
 23%|██▎       | 83878/371472 [6:40:11<23:00:36,  3.47it/s]
 23%|██▎       | 83879/371472 [6:40:11<22:02:01,  3.63it/s]
 23%|██▎       | 83880/371472 [6:40:11<22:39:36,  3.53it/s]
                                                           
{'loss': 3.9877, 'learning_rate': 7.971514145963067e-07, 'epoch': 3.61}

 23%|██▎       | 83880/371472 [6:40:11<22:39:36,  3.53it/s]
 23%|██▎       | 83881/371472 [6:40:11<23:41:38,  3.37it/s]
 23%|██▎       | 83882/371472 [6:40:12<24:22:51,  3.28it/s]
 23%|██▎       | 83883/371472 [6:40:12<23:46:55,  3.36it/s]
 23%|██▎       | 83884/371472 [6:40:13<27:29:12,  2.91it/s]
 23%|██▎       | 83885/371472 [6:40:13<26:12:52,  3.05it/s]
 23%|██▎       | 83886/371472 [6:40:13<25:05:54,  3.18it/s]
 23%|██▎       | 83887/371472 [6:40:13<24:15:09,  3.29it/s]
 23%|██▎       | 83888/371472 [6:40:14<23:03:50,  3.46it/s]
 23%|██▎       | 83889/371472 [6:40:14<22:02:02,  3.63it/s]
 23%|██▎       | 83890/371472 [6:40:14<22:47:14,  3.51it/s]
 23%|██▎       | 83891/371472 [6:40:14<22:17:41,  3.58it/s]
 23%|██▎       | 83892/371472 [6:40:15<22:07:05,  3.61it/s]
 23%|██▎       | 83893/371472 [6:40:15<24:05:46,  3.32it/s]
 23%|██▎       | 83894/371472 [6:40:15<22:58:27,  3.48it/s]
 23%|██▎       | 83895/371472 [6:40:16<21:54:35,  3.65it/s]
 23%|██▎       | 83896/371472 [6:40:16<22:28:21,  3.55it/s]
 23%|██▎       | 83897/371472 [6:40:16<22:41:49,  3.52it/s]
 23%|██▎       | 83898/371472 [6:40:16<21:49:16,  3.66it/s]
 23%|██▎       | 83899/371472 [6:40:17<21:43:08,  3.68it/s]
 23%|██▎       | 83900/371472 [6:40:17<21:46:28,  3.67it/s]
                                                           
{'loss': 4.1971, 'learning_rate': 7.971029326208278e-07, 'epoch': 3.61}

 23%|██▎       | 83900/371472 [6:40:17<21:46:28,  3.67it/s]
 23%|██▎       | 83901/371472 [6:40:17<21:17:32,  3.75it/s]
 23%|██▎       | 83902/371472 [6:40:18<22:56:39,  3.48it/s]
 23%|██▎       | 83903/371472 [6:40:18<21:56:03,  3.64it/s]
 23%|██▎       | 83904/371472 [6:40:18<21:06:03,  3.79it/s]
 23%|██▎       | 83905/371472 [6:40:18<21:59:21,  3.63it/s]
 23%|██▎       | 83906/371472 [6:40:19<21:00:21,  3.80it/s]
 23%|██▎       | 83907/371472 [6:40:19<20:51:39,  3.83it/s]
 23%|██▎       | 83908/371472 [6:40:19<20:54:05,  3.82it/s]
 23%|██▎       | 83909/371472 [6:40:19<20:38:12,  3.87it/s]
 23%|██▎       | 83910/371472 [6:40:20<21:34:16,  3.70it/s]
 23%|██▎       | 83911/371472 [6:40:20<21:47:23,  3.67it/s]
 23%|██▎       | 83912/371472 [6:40:20<21:14:20,  3.76it/s]
 23%|██▎       | 83913/371472 [6:40:20<21:27:01,  3.72it/s]
 23%|██▎       | 83914/371472 [6:40:21<21:35:20,  3.70it/s]
 23%|██▎       | 83915/371472 [6:40:21<21:32:10,  3.71it/s]
 23%|██▎       | 83916/371472 [6:40:21<22:00:40,  3.63it/s]
 23%|██▎       | 83917/371472 [6:40:22<23:21:13,  3.42it/s]
 23%|██▎       | 83918/371472 [6:40:22<22:03:09,  3.62it/s]
 23%|██▎       | 83919/371472 [6:40:22<21:44:39,  3.67it/s]
 23%|██▎       | 83920/371472 [6:40:22<21:54:07,  3.65it/s]
                                                           
{'loss': 4.0465, 'learning_rate': 7.970544506453489e-07, 'epoch': 3.61}

 23%|██▎       | 83920/371472 [6:40:22<21:54:07,  3.65it/s]
 23%|██▎       | 83921/371472 [6:40:23<21:55:46,  3.64it/s]
 23%|██▎       | 83922/371472 [6:40:23<22:08:31,  3.61it/s]
 23%|██▎       | 83923/371472 [6:40:23<22:11:11,  3.60it/s]
 23%|██▎       | 83924/371472 [6:40:23<22:14:27,  3.59it/s]
 23%|██▎       | 83925/371472 [6:40:24<21:38:11,  3.69it/s]
 23%|██▎       | 83926/371472 [6:40:24<22:39:04,  3.53it/s]
 23%|██▎       | 83927/371472 [6:40:24<23:25:06,  3.41it/s]
 23%|██▎       | 83928/371472 [6:40:25<23:08:31,  3.45it/s]
 23%|██▎       | 83929/371472 [6:40:25<22:16:11,  3.59it/s]
 23%|██▎       | 83930/371472 [6:40:25<21:59:02,  3.63it/s]
 23%|██▎       | 83931/371472 [6:40:25<21:30:59,  3.71it/s]
 23%|██▎       | 83932/371472 [6:40:26<22:22:13,  3.57it/s]
 23%|██▎       | 83933/371472 [6:40:26<22:20:59,  3.57it/s]
 23%|██▎       | 83934/371472 [6:40:26<22:27:53,  3.56it/s]
 23%|██▎       | 83935/371472 [6:40:27<22:35:23,  3.54it/s]
 23%|██▎       | 83936/371472 [6:40:27<22:23:22,  3.57it/s]
 23%|██▎       | 83937/371472 [6:40:27<22:04:01,  3.62it/s]
 23%|██▎       | 83938/371472 [6:40:27<22:08:56,  3.61it/s]
 23%|██▎       | 83939/371472 [6:40:28<22:15:01,  3.59it/s]
 23%|██▎       | 83940/371472 [6:40:28<22:01:40,  3.63it/s]
                                                           
{'loss': 4.0264, 'learning_rate': 7.9700596866987e-07, 'epoch': 3.62}

 23%|██▎       | 83940/371472 [6:40:28<22:01:40,  3.63it/s]
 23%|██▎       | 83941/371472 [6:40:28<22:41:18,  3.52it/s]
 23%|██▎       | 83942/371472 [6:40:29<23:09:49,  3.45it/s]
 23%|██▎       | 83943/371472 [6:40:29<23:03:35,  3.46it/s]
 23%|██▎       | 83944/371472 [6:40:29<24:13:46,  3.30it/s]
 23%|██▎       | 83945/371472 [6:40:29<22:59:34,  3.47it/s]
 23%|██▎       | 83946/371472 [6:40:30<22:19:49,  3.58it/s]
 23%|██▎       | 83947/371472 [6:40:30<23:18:56,  3.43it/s]
 23%|██▎       | 83948/371472 [6:40:30<23:16:23,  3.43it/s]
 23%|██▎       | 83949/371472 [6:40:31<23:13:51,  3.44it/s]
 23%|██▎       | 83950/371472 [6:40:31<22:20:43,  3.57it/s]
 23%|██▎       | 83951/371472 [6:40:31<21:58:41,  3.63it/s]
 23%|██▎       | 83952/371472 [6:40:31<23:44:59,  3.36it/s]
 23%|██▎       | 83953/371472 [6:40:32<22:54:53,  3.49it/s]
 23%|██▎       | 83954/371472 [6:40:32<22:56:04,  3.48it/s]
 23%|██▎       | 83955/371472 [6:40:32<21:51:41,  3.65it/s]
 23%|██▎       | 83956/371472 [6:40:33<21:44:18,  3.67it/s]
 23%|██▎       | 83957/371472 [6:40:33<21:53:40,  3.65it/s]
 23%|██▎       | 83958/371472 [6:40:33<21:07:35,  3.78it/s]
 23%|██▎       | 83959/371472 [6:40:33<22:14:22,  3.59it/s]
 23%|██▎       | 83960/371472 [6:40:34<21:44:32,  3.67it/s]
                                                           
{'loss': 4.0337, 'learning_rate': 7.969574866943911e-07, 'epoch': 3.62}

 23%|██▎       | 83960/371472 [6:40:34<21:44:32,  3.67it/s]
 23%|██▎       | 83961/371472 [6:40:34<22:14:01,  3.59it/s]
 23%|██▎       | 83962/371472 [6:40:34<22:42:47,  3.52it/s]
 23%|██▎       | 83963/371472 [6:40:34<21:47:36,  3.66it/s]
 23%|██▎       | 83964/371472 [6:40:35<23:04:05,  3.46it/s]
 23%|██▎       | 83965/371472 [6:40:35<23:10:53,  3.45it/s]
 23%|██▎       | 83966/371472 [6:40:35<22:33:53,  3.54it/s]
 23%|██▎       | 83967/371472 [6:40:36<22:22:42,  3.57it/s]
 23%|██▎       | 83968/371472 [6:40:36<22:47:49,  3.50it/s]
 23%|██▎       | 83969/371472 [6:40:36<22:06:27,  3.61it/s]
 23%|██▎       | 83970/371472 [6:40:36<22:57:37,  3.48it/s]
 23%|██▎       | 83971/371472 [6:40:37<23:47:21,  3.36it/s]
 23%|██▎       | 83972/371472 [6:40:37<22:51:06,  3.49it/s]
 23%|██▎       | 83973/371472 [6:40:37<22:07:58,  3.61it/s]
 23%|██▎       | 83974/371472 [6:40:38<21:41:29,  3.68it/s]
 23%|██▎       | 83975/371472 [6:40:38<23:13:12,  3.44it/s]
 23%|██▎       | 83976/371472 [6:40:38<22:50:13,  3.50it/s]
 23%|██▎       | 83977/371472 [6:40:38<23:21:32,  3.42it/s]
 23%|██▎       | 83978/371472 [6:40:39<22:26:44,  3.56it/s]
 23%|██▎       | 83979/371472 [6:40:39<22:39:38,  3.52it/s]
 23%|██▎       | 83980/371472 [6:40:39<21:54:03,  3.65it/s]
                                                           
{'loss': 3.9109, 'learning_rate': 7.969090047189122e-07, 'epoch': 3.62}

 23%|██▎       | 83980/371472 [6:40:39<21:54:03,  3.65it/s]
 23%|██▎       | 83981/371472 [6:40:40<22:24:06,  3.56it/s]
 23%|██▎       | 83982/371472 [6:40:40<22:06:49,  3.61it/s]
 23%|██▎       | 83983/371472 [6:40:40<21:26:38,  3.72it/s]
 23%|██▎       | 83984/371472 [6:40:40<21:57:11,  3.64it/s]
 23%|██▎       | 83985/371472 [6:40:41<22:03:23,  3.62it/s]
 23%|██▎       | 83986/371472 [6:40:41<22:19:21,  3.58it/s]
 23%|██▎       | 83987/371472 [6:40:41<23:36:18,  3.38it/s]
 23%|██▎       | 83988/371472 [6:40:42<25:36:29,  3.12it/s]
 23%|██▎       | 83989/371472 [6:40:42<25:12:06,  3.17it/s]
 23%|██▎       | 83990/371472 [6:40:42<24:09:50,  3.30it/s]
 23%|██▎       | 83991/371472 [6:40:43<23:27:34,  3.40it/s]
 23%|██▎       | 83992/371472 [6:40:43<22:35:31,  3.53it/s]
 23%|██▎       | 83993/371472 [6:40:43<22:47:08,  3.50it/s]
 23%|██▎       | 83994/371472 [6:40:43<23:08:14,  3.45it/s]
 23%|██▎       | 83995/371472 [6:40:44<24:04:06,  3.32it/s]
 23%|██▎       | 83996/371472 [6:40:44<23:55:56,  3.34it/s]
 23%|██▎       | 83997/371472 [6:40:44<23:32:31,  3.39it/s]
 23%|██▎       | 83998/371472 [6:40:45<22:57:53,  3.48it/s]
 23%|██▎       | 83999/371472 [6:40:45<22:35:05,  3.54it/s]
 23%|██▎       | 84000/371472 [6:40:45<22:05:30,  3.61it/s]
                                                           
{'loss': 3.8259, 'learning_rate': 7.968605227434333e-07, 'epoch': 3.62}

 23%|██▎       | 84000/371472 [6:40:45<22:05:30,  3.61it/s]
 23%|██▎       | 84001/371472 [6:40:45<21:27:49,  3.72it/s]
 23%|██▎       | 84002/371472 [6:40:46<21:05:39,  3.79it/s]
 23%|██▎       | 84003/371472 [6:40:46<20:52:39,  3.82it/s]
 23%|██▎       | 84004/371472 [6:40:46<22:31:34,  3.54it/s]
 23%|██▎       | 84005/371472 [6:40:46<22:20:09,  3.58it/s]
 23%|██▎       | 84006/371472 [6:40:47<21:52:23,  3.65it/s]
 23%|██▎       | 84007/371472 [6:40:47<22:24:44,  3.56it/s]
 23%|██▎       | 84008/371472 [6:40:47<21:35:37,  3.70it/s]
 23%|██▎       | 84009/371472 [6:40:47<21:06:46,  3.78it/s]
 23%|██▎       | 84010/371472 [6:40:48<21:41:43,  3.68it/s]
 23%|██▎       | 84011/371472 [6:40:48<21:05:57,  3.78it/s]
 23%|██▎       | 84012/371472 [6:40:48<21:21:15,  3.74it/s]
 23%|██▎       | 84013/371472 [6:40:49<21:16:37,  3.75it/s]
 23%|██▎       | 84014/371472 [6:40:49<21:58:15,  3.63it/s]
 23%|██▎       | 84015/371472 [6:40:49<21:46:45,  3.67it/s]
 23%|██▎       | 84016/371472 [6:40:49<21:53:21,  3.65it/s]
 23%|██▎       | 84017/371472 [6:40:50<22:15:25,  3.59it/s]
 23%|██▎       | 84018/371472 [6:40:50<23:36:33,  3.38it/s]
 23%|██▎       | 84019/371472 [6:40:50<22:41:31,  3.52it/s]
 23%|██▎       | 84020/371472 [6:40:51<21:58:34,  3.63it/s]
                                                           
{'loss': 4.1498, 'learning_rate': 7.968120407679545e-07, 'epoch': 3.62}

 23%|██▎       | 84020/371472 [6:40:51<21:58:34,  3.63it/s]
 23%|██▎       | 84021/371472 [6:40:51<22:34:10,  3.54it/s]
 23%|██▎       | 84022/371472 [6:40:51<21:25:37,  3.73it/s]
 23%|██▎       | 84023/371472 [6:40:51<23:55:13,  3.34it/s]
 23%|██▎       | 84024/371472 [6:40:52<24:34:39,  3.25it/s]
 23%|██▎       | 84025/371472 [6:40:52<24:34:45,  3.25it/s]
 23%|██▎       | 84026/371472 [6:40:52<23:31:55,  3.39it/s]
 23%|██▎       | 84027/371472 [6:40:53<24:27:07,  3.27it/s]
 23%|██▎       | 84028/371472 [6:40:53<23:09:45,  3.45it/s]
 23%|██▎       | 84029/371472 [6:40:53<22:12:09,  3.60it/s]
 23%|██▎       | 84030/371472 [6:40:53<22:15:16,  3.59it/s]
 23%|██▎       | 84031/371472 [6:40:54<24:34:31,  3.25it/s]
 23%|██▎       | 84032/371472 [6:40:54<24:19:16,  3.28it/s]
 23%|██▎       | 84033/371472 [6:40:54<23:58:48,  3.33it/s]
 23%|██▎       | 84034/371472 [6:40:55<24:49:04,  3.22it/s]
 23%|██▎       | 84035/371472 [6:40:55<24:49:18,  3.22it/s]
 23%|██▎       | 84036/371472 [6:40:55<25:30:21,  3.13it/s]
 23%|██▎       | 84037/371472 [6:40:56<26:20:17,  3.03it/s]
 23%|██▎       | 84038/371472 [6:40:56<25:52:59,  3.08it/s]
 23%|██▎       | 84039/371472 [6:40:56<25:00:10,  3.19it/s]
 23%|██▎       | 84040/371472 [6:40:57<23:41:29,  3.37it/s]
                                                           
{'loss': 4.1478, 'learning_rate': 7.967635587924755e-07, 'epoch': 3.62}

 23%|██▎       | 84040/371472 [6:40:57<23:41:29,  3.37it/s]
 23%|██▎       | 84041/371472 [6:40:57<23:10:23,  3.45it/s]
 23%|██▎       | 84042/371472 [6:40:57<23:25:56,  3.41it/s]
 23%|██▎       | 84043/371472 [6:40:57<22:42:11,  3.52it/s]
 23%|██▎       | 84044/371472 [6:40:58<22:30:50,  3.55it/s]
 23%|██▎       | 84045/371472 [6:40:58<22:06:30,  3.61it/s]
 23%|██▎       | 84046/371472 [6:40:58<23:18:17,  3.43it/s]
 23%|██▎       | 84047/371472 [6:40:59<22:42:08,  3.52it/s]
 23%|██▎       | 84048/371472 [6:40:59<22:58:48,  3.47it/s]
 23%|██▎       | 84049/371472 [6:40:59<22:44:06,  3.51it/s]
 23%|██▎       | 84050/371472 [6:40:59<23:28:10,  3.40it/s]
 23%|██▎       | 84051/371472 [6:41:00<23:58:17,  3.33it/s]
 23%|██▎       | 84052/371472 [6:41:00<22:28:26,  3.55it/s]
 23%|██▎       | 84053/371472 [6:41:00<22:49:51,  3.50it/s]
 23%|██▎       | 84054/371472 [6:41:01<22:19:17,  3.58it/s]
 23%|██▎       | 84055/371472 [6:41:01<22:28:49,  3.55it/s]
 23%|██▎       | 84056/371472 [6:41:01<22:52:34,  3.49it/s]
 23%|██▎       | 84057/371472 [6:41:01<22:43:59,  3.51it/s]
 23%|██▎       | 84058/371472 [6:41:02<25:15:23,  3.16it/s]
 23%|██▎       | 84059/371472 [6:41:02<24:44:02,  3.23it/s]
 23%|██▎       | 84060/371472 [6:41:02<24:17:57,  3.29it/s]
                                                           
{'loss': 3.9209, 'learning_rate': 7.967150768169967e-07, 'epoch': 3.62}

 23%|██▎       | 84060/371472 [6:41:02<24:17:57,  3.29it/s]
 23%|██▎       | 84061/371472 [6:41:03<23:41:03,  3.37it/s]
 23%|██▎       | 84062/371472 [6:41:03<22:49:52,  3.50it/s]
 23%|██▎       | 84063/371472 [6:41:03<23:18:02,  3.43it/s]
 23%|██▎       | 84064/371472 [6:41:04<24:27:38,  3.26it/s]
 23%|██▎       | 84065/371472 [6:41:04<23:22:45,  3.41it/s]
 23%|██▎       | 84066/371472 [6:41:04<22:17:51,  3.58it/s]
 23%|██▎       | 84067/371472 [6:41:04<22:25:13,  3.56it/s]
 23%|██▎       | 84068/371472 [6:41:05<21:59:45,  3.63it/s]
 23%|██▎       | 84069/371472 [6:41:05<21:27:37,  3.72it/s]
 23%|██▎       | 84070/371472 [6:41:05<21:19:44,  3.74it/s]
 23%|██▎       | 84071/371472 [6:41:05<21:52:33,  3.65it/s]
 23%|██▎       | 84072/371472 [6:41:06<21:02:06,  3.80it/s]
 23%|██▎       | 84073/371472 [6:41:06<20:43:54,  3.85it/s]
 23%|██▎       | 84074/371472 [6:41:06<20:35:22,  3.88it/s]
 23%|██▎       | 84075/371472 [6:41:07<22:01:29,  3.62it/s]
 23%|██▎       | 84076/371472 [6:41:07<21:21:42,  3.74it/s]
 23%|██▎       | 84077/371472 [6:41:07<21:13:33,  3.76it/s]
 23%|██▎       | 84078/371472 [6:41:07<21:06:59,  3.78it/s]
 23%|██▎       | 84079/371472 [6:41:08<21:11:50,  3.77it/s]
 23%|██▎       | 84080/371472 [6:41:08<21:55:17,  3.64it/s]
                                                           
{'loss': 3.9723, 'learning_rate': 7.966665948415178e-07, 'epoch': 3.62}

 23%|██▎       | 84080/371472 [6:41:08<21:55:17,  3.64it/s]
 23%|██▎       | 84081/371472 [6:41:08<21:53:07,  3.65it/s]
 23%|██▎       | 84082/371472 [6:41:08<21:52:31,  3.65it/s]
 23%|██▎       | 84083/371472 [6:41:09<22:29:16,  3.55it/s]
 23%|██▎       | 84084/371472 [6:41:09<21:41:41,  3.68it/s]
 23%|██▎       | 84085/371472 [6:41:09<21:09:28,  3.77it/s]
 23%|██▎       | 84086/371472 [6:41:10<21:25:36,  3.73it/s]
 23%|██▎       | 84087/371472 [6:41:10<21:53:22,  3.65it/s]
 23%|██▎       | 84088/371472 [6:41:10<24:13:23,  3.30it/s]
 23%|██▎       | 84089/371472 [6:41:10<23:03:51,  3.46it/s]
 23%|██▎       | 84090/371472 [6:41:11<22:54:02,  3.49it/s]
 23%|██▎       | 84091/371472 [6:41:11<22:48:48,  3.50it/s]
 23%|██▎       | 84092/371472 [6:41:11<22:47:51,  3.50it/s]
 23%|██▎       | 84093/371472 [6:41:12<22:52:53,  3.49it/s]
 23%|██▎       | 84094/371472 [6:41:12<21:59:47,  3.63it/s]
 23%|██▎       | 84095/371472 [6:41:12<23:20:36,  3.42it/s]
 23%|██▎       | 84096/371472 [6:41:12<22:48:26,  3.50it/s]
 23%|██▎       | 84097/371472 [6:41:13<25:07:58,  3.18it/s]
 23%|██▎       | 84098/371472 [6:41:13<23:14:36,  3.43it/s]
 23%|██▎       | 84099/371472 [6:41:13<23:34:45,  3.39it/s]
 23%|██▎       | 84100/371472 [6:41:14<22:55:28,  3.48it/s]
                                                           
{'loss': 3.8666, 'learning_rate': 7.96618112866039e-07, 'epoch': 3.62}

 23%|██▎       | 84100/371472 [6:41:14<22:55:28,  3.48it/s]
 23%|██▎       | 84101/371472 [6:41:14<22:36:02,  3.53it/s]
 23%|██▎       | 84102/371472 [6:41:14<22:52:49,  3.49it/s]
 23%|██▎       | 84103/371472 [6:41:14<22:23:10,  3.57it/s]
 23%|██▎       | 84104/371472 [6:41:15<21:43:15,  3.68it/s]
 23%|██▎       | 84105/371472 [6:41:15<21:52:48,  3.65it/s]
 23%|██▎       | 84106/371472 [6:41:15<21:50:59,  3.65it/s]
 23%|██▎       | 84107/371472 [6:41:15<21:16:41,  3.75it/s]
 23%|██▎       | 84108/371472 [6:41:16<21:40:52,  3.68it/s]
 23%|██▎       | 84109/371472 [6:41:16<21:08:07,  3.78it/s]
 23%|██▎       | 84110/371472 [6:41:16<22:12:24,  3.59it/s]
 23%|██▎       | 84111/371472 [6:41:17<22:00:25,  3.63it/s]
 23%|██▎       | 84112/371472 [6:41:17<24:53:26,  3.21it/s]
 23%|██▎       | 84113/371472 [6:41:17<24:03:18,  3.32it/s]
 23%|██▎       | 84114/371472 [6:41:18<25:32:40,  3.12it/s]
 23%|██▎       | 84115/371472 [6:41:18<26:14:41,  3.04it/s]
 23%|██▎       | 84116/371472 [6:41:18<25:13:03,  3.17it/s]
 23%|██▎       | 84117/371472 [6:41:19<23:56:52,  3.33it/s]
 23%|██▎       | 84118/371472 [6:41:19<23:45:23,  3.36it/s]
 23%|██▎       | 84119/371472 [6:41:19<23:06:32,  3.45it/s]
 23%|██▎       | 84120/371472 [6:41:19<23:56:09,  3.33it/s]
                                                           
{'loss': 3.7975, 'learning_rate': 7.965696308905599e-07, 'epoch': 3.62}

 23%|██▎       | 84120/371472 [6:41:19<23:56:09,  3.33it/s]
 23%|██▎       | 84121/371472 [6:41:20<23:11:12,  3.44it/s]
 23%|██▎       | 84122/371472 [6:41:20<22:57:05,  3.48it/s]
 23%|██▎       | 84123/371472 [6:41:20<22:10:02,  3.60it/s]
 23%|██▎       | 84124/371472 [6:41:20<21:44:47,  3.67it/s]
 23%|██▎       | 84125/371472 [6:41:21<21:52:55,  3.65it/s]
 23%|██▎       | 84126/371472 [6:41:21<22:02:00,  3.62it/s]
 23%|██▎       | 84127/371472 [6:41:21<21:41:28,  3.68it/s]
 23%|██▎       | 84128/371472 [6:41:22<21:05:04,  3.79it/s]
 23%|██▎       | 84129/371472 [6:41:22<20:52:59,  3.82it/s]
 23%|██▎       | 84130/371472 [6:41:22<21:58:12,  3.63it/s]
 23%|██▎       | 84131/371472 [6:41:22<22:03:01,  3.62it/s]
 23%|██▎       | 84132/371472 [6:41:23<21:35:00,  3.70it/s]
 23%|██▎       | 84133/371472 [6:41:23<21:01:39,  3.80it/s]
 23%|██▎       | 84134/371472 [6:41:23<20:28:37,  3.90it/s]
 23%|██▎       | 84135/371472 [6:41:23<22:26:40,  3.56it/s]
 23%|██▎       | 84136/371472 [6:41:24<22:10:22,  3.60it/s]
 23%|██▎       | 84137/371472 [6:41:24<22:35:28,  3.53it/s]
 23%|██▎       | 84138/371472 [6:41:24<22:55:57,  3.48it/s]
 23%|██▎       | 84139/371472 [6:41:25<22:18:08,  3.58it/s]
 23%|██▎       | 84140/371472 [6:41:25<21:50:20,  3.65it/s]
                                                           
{'loss': 4.0348, 'learning_rate': 7.965211489150811e-07, 'epoch': 3.62}

 23%|██▎       | 84140/371472 [6:41:25<21:50:20,  3.65it/s]
 23%|██▎       | 84141/371472 [6:41:25<21:23:56,  3.73it/s]
 23%|██▎       | 84142/371472 [6:41:25<23:13:59,  3.44it/s]
 23%|██▎       | 84143/371472 [6:41:26<23:29:16,  3.40it/s]
 23%|██▎       | 84144/371472 [6:41:26<23:29:49,  3.40it/s]
 23%|██▎       | 84145/371472 [6:41:26<23:13:19,  3.44it/s]
 23%|██▎       | 84146/371472 [6:41:27<23:24:50,  3.41it/s]
 23%|██▎       | 84147/371472 [6:41:27<22:41:24,  3.52it/s]
 23%|██▎       | 84148/371472 [6:41:27<22:49:44,  3.50it/s]
 23%|██▎       | 84149/371472 [6:41:27<22:09:45,  3.60it/s]
 23%|██▎       | 84150/371472 [6:41:28<23:47:09,  3.36it/s]
 23%|██▎       | 84151/371472 [6:41:28<22:39:12,  3.52it/s]
 23%|██▎       | 84152/371472 [6:41:28<22:42:59,  3.51it/s]
 23%|██▎       | 84153/371472 [6:41:29<23:24:09,  3.41it/s]
 23%|██▎       | 84154/371472 [6:41:29<22:27:42,  3.55it/s]
 23%|██▎       | 84155/371472 [6:41:29<23:28:30,  3.40it/s]
 23%|██▎       | 84156/371472 [6:41:29<22:46:27,  3.50it/s]
 23%|██▎       | 84157/371472 [6:41:30<23:01:57,  3.47it/s]
 23%|██▎       | 84158/371472 [6:41:30<22:55:16,  3.48it/s]
 23%|██▎       | 84159/371472 [6:41:30<23:01:12,  3.47it/s]
 23%|██▎       | 84160/371472 [6:41:31<22:59:06,  3.47it/s]
                                                           
{'loss': 4.156, 'learning_rate': 7.964726669396022e-07, 'epoch': 3.62}

 23%|██▎       | 84160/371472 [6:41:31<22:59:06,  3.47it/s]
 23%|██▎       | 84161/371472 [6:41:31<23:08:06,  3.45it/s]
 23%|██▎       | 84162/371472 [6:41:31<25:28:39,  3.13it/s]
 23%|██▎       | 84163/371472 [6:41:32<24:42:31,  3.23it/s]
 23%|██▎       | 84164/371472 [6:41:32<24:25:53,  3.27it/s]
 23%|██▎       | 84165/371472 [6:41:32<23:45:32,  3.36it/s]
 23%|██▎       | 84166/371472 [6:41:33<25:03:35,  3.18it/s]
 23%|██▎       | 84167/371472 [6:41:33<24:47:35,  3.22it/s]
 23%|██▎       | 84168/371472 [6:41:33<26:24:55,  3.02it/s]
 23%|██▎       | 84169/371472 [6:41:34<25:10:18,  3.17it/s]
 23%|██▎       | 84170/371472 [6:41:34<23:50:54,  3.35it/s]
 23%|██▎       | 84171/371472 [6:41:34<23:24:20,  3.41it/s]
 23%|██▎       | 84172/371472 [6:41:34<23:10:38,  3.44it/s]
 23%|██▎       | 84173/371472 [6:41:35<22:57:06,  3.48it/s]
 23%|██▎       | 84174/371472 [6:41:35<23:21:29,  3.42it/s]
 23%|██▎       | 84175/371472 [6:41:35<24:45:43,  3.22it/s]
 23%|██▎       | 84176/371472 [6:41:36<23:25:43,  3.41it/s]
 23%|██▎       | 84177/371472 [6:41:36<22:11:35,  3.60it/s]
 23%|██▎       | 84178/371472 [6:41:36<22:39:16,  3.52it/s]
 23%|██▎       | 84179/371472 [6:41:36<23:13:39,  3.44it/s]
 23%|██▎       | 84180/371472 [6:41:37<22:42:30,  3.51it/s]
                                                           
{'loss': 4.0054, 'learning_rate': 7.964241849641233e-07, 'epoch': 3.63}

 23%|██▎       | 84180/371472 [6:41:37<22:42:30,  3.51it/s]
 23%|██▎       | 84181/371472 [6:41:37<21:59:16,  3.63it/s]
 23%|██▎       | 84182/371472 [6:41:37<21:56:23,  3.64it/s]
 23%|██▎       | 84183/371472 [6:41:37<21:24:38,  3.73it/s]
 23%|██▎       | 84184/371472 [6:41:38<23:15:43,  3.43it/s]
 23%|██▎       | 84185/371472 [6:41:38<22:49:50,  3.50it/s]
 23%|██▎       | 84186/371472 [6:41:38<22:47:14,  3.50it/s]
 23%|██▎       | 84187/371472 [6:41:39<21:34:32,  3.70it/s]
 23%|██▎       | 84188/371472 [6:41:39<22:33:55,  3.54it/s]
 23%|██▎       | 84189/371472 [6:41:39<22:32:38,  3.54it/s]
 23%|██▎       | 84190/371472 [6:41:39<22:45:23,  3.51it/s]
 23%|██▎       | 84191/371472 [6:41:40<22:06:32,  3.61it/s]
 23%|██▎       | 84192/371472 [6:41:40<21:21:45,  3.74it/s]
 23%|██▎       | 84193/371472 [6:41:40<21:20:03,  3.74it/s]
 23%|██▎       | 84194/371472 [6:41:41<22:05:57,  3.61it/s]
 23%|██▎       | 84195/371472 [6:41:41<21:22:21,  3.73it/s]
 23%|██▎       | 84196/371472 [6:41:41<22:01:58,  3.62it/s]
 23%|██▎       | 84197/371472 [6:41:41<22:30:54,  3.54it/s]
 23%|██▎       | 84198/371472 [6:41:42<22:55:15,  3.48it/s]
 23%|██▎       | 84199/371472 [6:41:42<24:38:46,  3.24it/s]
 23%|██▎       | 84200/371472 [6:41:42<23:21:15,  3.42it/s]
                                                           
{'loss': 4.2446, 'learning_rate': 7.963757029886444e-07, 'epoch': 3.63}

 23%|██▎       | 84200/371472 [6:41:42<23:21:15,  3.42it/s]
 23%|██▎       | 84201/371472 [6:41:43<22:52:34,  3.49it/s]
 23%|██▎       | 84202/371472 [6:41:43<22:00:23,  3.63it/s]
 23%|██▎       | 84203/371472 [6:41:43<20:55:26,  3.81it/s]
 23%|██▎       | 84204/371472 [6:41:43<20:22:28,  3.92it/s]
 23%|██▎       | 84205/371472 [6:41:44<20:12:50,  3.95it/s]
 23%|██▎       | 84206/371472 [6:41:44<21:52:11,  3.65it/s]
 23%|██▎       | 84207/371472 [6:41:44<21:30:21,  3.71it/s]
 23%|██▎       | 84208/371472 [6:41:44<22:45:39,  3.51it/s]
 23%|██▎       | 84209/371472 [6:41:45<22:47:00,  3.50it/s]
 23%|██▎       | 84210/371472 [6:41:45<22:03:21,  3.62it/s]
 23%|██▎       | 84211/371472 [6:41:45<21:33:50,  3.70it/s]
 23%|██▎       | 84212/371472 [6:41:45<22:08:36,  3.60it/s]
 23%|██▎       | 84213/371472 [6:41:46<21:59:24,  3.63it/s]
 23%|██▎       | 84214/371472 [6:41:46<21:58:43,  3.63it/s]
 23%|██▎       | 84215/371472 [6:41:46<22:20:38,  3.57it/s]
 23%|██▎       | 84216/371472 [6:41:47<21:20:15,  3.74it/s]
 23%|██▎       | 84217/371472 [6:41:47<22:16:56,  3.58it/s]
 23%|██▎       | 84218/371472 [6:41:47<23:22:27,  3.41it/s]
 23%|██▎       | 84219/371472 [6:41:48<25:19:07,  3.15it/s]
 23%|██▎       | 84220/371472 [6:41:48<23:48:44,  3.35it/s]
                                                           
{'loss': 4.0446, 'learning_rate': 7.963272210131656e-07, 'epoch': 3.63}

 23%|██▎       | 84220/371472 [6:41:48<23:48:44,  3.35it/s]
 23%|██▎       | 84221/371472 [6:41:48<23:55:33,  3.33it/s]
 23%|██▎       | 84222/371472 [6:41:48<23:36:52,  3.38it/s]
 23%|██▎       | 84223/371472 [6:41:49<22:32:53,  3.54it/s]
 23%|██▎       | 84224/371472 [6:41:49<21:57:10,  3.63it/s]
 23%|██▎       | 84225/371472 [6:41:49<23:45:08,  3.36it/s]
 23%|██▎       | 84226/371472 [6:41:50<23:24:09,  3.41it/s]
 23%|██▎       | 84227/371472 [6:41:50<23:41:43,  3.37it/s]
 23%|██▎       | 84228/371472 [6:41:50<24:17:13,  3.29it/s]
 23%|██▎       | 84229/371472 [6:41:50<22:54:11,  3.48it/s]
 23%|██▎       | 84230/371472 [6:41:51<21:53:40,  3.64it/s]
 23%|██▎       | 84231/371472 [6:41:51<21:21:54,  3.73it/s]
 23%|██▎       | 84232/371472 [6:41:51<20:48:00,  3.84it/s]
 23%|██▎       | 84233/371472 [6:41:51<21:01:30,  3.79it/s]
 23%|██▎       | 84234/371472 [6:41:52<23:24:34,  3.41it/s]
 23%|██▎       | 84235/371472 [6:41:52<22:16:08,  3.58it/s]
 23%|██▎       | 84236/371472 [6:41:52<21:50:27,  3.65it/s]
 23%|██▎       | 84237/371472 [6:41:53<21:42:42,  3.67it/s]
 23%|██▎       | 84238/371472 [6:41:53<21:25:00,  3.73it/s]
 23%|██▎       | 84239/371472 [6:41:53<21:26:14,  3.72it/s]
 23%|██▎       | 84240/371472 [6:41:53<21:31:27,  3.71it/s]
                                                           
{'loss': 4.0529, 'learning_rate': 7.962787390376866e-07, 'epoch': 3.63}

 23%|██▎       | 84240/371472 [6:41:53<21:31:27,  3.71it/s]
 23%|██▎       | 84241/371472 [6:41:54<20:58:31,  3.80it/s]
 23%|██▎       | 84242/371472 [6:41:54<20:49:32,  3.83it/s]
 23%|██▎       | 84243/371472 [6:41:54<22:11:01,  3.60it/s]
 23%|██▎       | 84244/371472 [6:41:54<21:26:50,  3.72it/s]
 23%|██▎       | 84245/371472 [6:41:55<21:06:25,  3.78it/s]
 23%|██▎       | 84246/371472 [6:41:55<22:51:31,  3.49it/s]
 23%|██▎       | 84247/371472 [6:41:55<25:05:37,  3.18it/s]
 23%|██▎       | 84248/371472 [6:41:56<23:42:55,  3.36it/s]
 23%|██▎       | 84249/371472 [6:41:56<23:36:46,  3.38it/s]
 23%|██▎       | 84250/371472 [6:41:56<23:29:50,  3.40it/s]
 23%|██▎       | 84251/371472 [6:41:57<23:24:18,  3.41it/s]
 23%|██▎       | 84252/371472 [6:41:57<23:06:36,  3.45it/s]
 23%|██▎       | 84253/371472 [6:41:57<22:10:52,  3.60it/s]
 23%|██▎       | 84254/371472 [6:41:57<21:55:43,  3.64it/s]
 23%|██▎       | 84255/371472 [6:41:58<21:41:56,  3.68it/s]
 23%|██▎       | 84256/371472 [6:41:58<21:23:38,  3.73it/s]
 23%|██▎       | 84257/371472 [6:41:58<23:11:07,  3.44it/s]
 23%|██▎       | 84258/371472 [6:41:59<27:10:15,  2.94it/s]
 23%|██▎       | 84259/371472 [6:41:59<25:29:46,  3.13it/s]
 23%|██▎       | 84260/371472 [6:41:59<24:22:26,  3.27it/s]
                                                           
{'loss': 3.8629, 'learning_rate': 7.962302570622075e-07, 'epoch': 3.63}

 23%|██▎       | 84260/371472 [6:41:59<24:22:26,  3.27it/s]
 23%|██▎       | 84261/371472 [6:42:00<23:37:08,  3.38it/s]
 23%|██▎       | 84262/371472 [6:42:00<23:49:23,  3.35it/s]
 23%|██▎       | 84263/371472 [6:42:00<23:08:31,  3.45it/s]
 23%|██▎       | 84264/371472 [6:42:00<23:16:34,  3.43it/s]
 23%|██▎       | 84265/371472 [6:42:01<23:23:13,  3.41it/s]
 23%|██▎       | 84266/371472 [6:42:01<23:29:44,  3.40it/s]
 23%|██▎       | 84267/371472 [6:42:01<22:31:11,  3.54it/s]
 23%|██▎       | 84268/371472 [6:42:02<23:08:51,  3.45it/s]
 23%|██▎       | 84269/371472 [6:42:02<22:35:39,  3.53it/s]
 23%|██▎       | 84270/371472 [6:42:02<22:54:13,  3.48it/s]
 23%|██▎       | 84271/371472 [6:42:02<22:59:37,  3.47it/s]
 23%|██▎       | 84272/371472 [6:42:03<24:12:42,  3.29it/s]
 23%|██▎       | 84273/371472 [6:42:03<23:20:55,  3.42it/s]
 23%|██▎       | 84274/371472 [6:42:03<22:44:18,  3.51it/s]
 23%|██▎       | 84275/371472 [6:42:04<27:08:53,  2.94it/s]
 23%|██▎       | 84276/371472 [6:42:04<26:06:25,  3.06it/s]
 23%|██▎       | 84277/371472 [6:42:04<25:16:57,  3.16it/s]
 23%|██▎       | 84278/371472 [6:42:05<24:31:24,  3.25it/s]
 23%|██▎       | 84279/371472 [6:42:05<24:03:36,  3.32it/s]
 23%|██▎       | 84280/371472 [6:42:05<22:56:09,  3.48it/s]
                                                           
{'loss': 3.9902, 'learning_rate': 7.961817750867288e-07, 'epoch': 3.63}

 23%|██▎       | 84280/371472 [6:42:05<22:56:09,  3.48it/s]
 23%|██▎       | 84281/371472 [6:42:05<23:11:17,  3.44it/s]
 23%|██▎       | 84282/371472 [6:42:06<23:38:33,  3.37it/s]
 23%|██▎       | 84283/371472 [6:42:06<23:16:41,  3.43it/s]
 23%|██▎       | 84284/371472 [6:42:06<23:00:32,  3.47it/s]
 23%|██▎       | 84285/371472 [6:42:07<22:52:41,  3.49it/s]
 23%|██▎       | 84286/371472 [6:42:07<25:31:36,  3.13it/s]
 23%|██▎       | 84287/371472 [6:42:07<25:08:21,  3.17it/s]
 23%|██▎       | 84288/371472 [6:42:08<23:51:59,  3.34it/s]
 23%|██▎       | 84289/371472 [6:42:08<22:36:27,  3.53it/s]
 23%|██▎       | 84290/371472 [6:42:08<22:02:49,  3.62it/s]
 23%|██▎       | 84291/371472 [6:42:08<21:45:23,  3.67it/s]
 23%|██▎       | 84292/371472 [6:42:09<20:56:34,  3.81it/s]
 23%|██▎       | 84293/371472 [6:42:09<21:20:14,  3.74it/s]
 23%|██▎       | 84294/371472 [6:42:09<21:49:36,  3.65it/s]
 23%|██▎       | 84295/371472 [6:42:09<21:43:19,  3.67it/s]
 23%|██▎       | 84296/371472 [6:42:10<24:02:37,  3.32it/s]
 23%|██▎       | 84297/371472 [6:42:10<23:33:28,  3.39it/s]
 23%|██▎       | 84298/371472 [6:42:10<23:12:45,  3.44it/s]
 23%|██▎       | 84299/371472 [6:42:11<24:09:01,  3.30it/s]
 23%|██▎       | 84300/371472 [6:42:11<23:13:48,  3.43it/s]
                                                           
{'loss': 3.8487, 'learning_rate': 7.9613329311125e-07, 'epoch': 3.63}

 23%|██▎       | 84300/371472 [6:42:11<23:13:48,  3.43it/s]
 23%|██▎       | 84301/371472 [6:42:11<23:41:31,  3.37it/s]
 23%|██▎       | 84302/371472 [6:42:12<22:45:52,  3.50it/s]
 23%|██▎       | 84303/371472 [6:42:12<23:33:48,  3.39it/s]
 23%|██▎       | 84304/371472 [6:42:12<25:23:00,  3.14it/s]
 23%|██▎       | 84305/371472 [6:42:12<24:51:56,  3.21it/s]
 23%|██▎       | 84306/371472 [6:42:13<23:57:47,  3.33it/s]
 23%|██▎       | 84307/371472 [6:42:13<24:37:48,  3.24it/s]
 23%|██▎       | 84308/371472 [6:42:13<25:07:19,  3.18it/s]
 23%|██▎       | 84309/371472 [6:42:14<23:56:55,  3.33it/s]
 23%|██▎       | 84310/371472 [6:42:14<23:27:43,  3.40it/s]
 23%|██▎       | 84311/371472 [6:42:14<23:41:35,  3.37it/s]
 23%|██▎       | 84312/371472 [6:42:15<24:14:32,  3.29it/s]
 23%|██▎       | 84313/371472 [6:42:15<23:42:24,  3.36it/s]
 23%|██▎       | 84314/371472 [6:42:15<23:31:21,  3.39it/s]
 23%|██▎       | 84315/371472 [6:42:15<22:50:28,  3.49it/s]
 23%|██▎       | 84316/371472 [6:42:16<23:24:25,  3.41it/s]
 23%|██▎       | 84317/371472 [6:42:16<24:50:19,  3.21it/s]
 23%|██▎       | 84318/371472 [6:42:16<23:26:38,  3.40it/s]
 23%|██▎       | 84319/371472 [6:42:17<22:47:02,  3.50it/s]
 23%|██▎       | 84320/371472 [6:42:17<22:51:29,  3.49it/s]
                                                           
{'loss': 3.9716, 'learning_rate': 7.960848111357711e-07, 'epoch': 3.63}

 23%|██▎       | 84320/371472 [6:42:17<22:51:29,  3.49it/s]
 23%|██▎       | 84321/371472 [6:42:17<22:13:44,  3.59it/s]
 23%|██▎       | 84322/371472 [6:42:17<22:23:03,  3.56it/s]
 23%|██▎       | 84323/371472 [6:42:18<24:57:01,  3.20it/s]
 23%|██▎       | 84324/371472 [6:42:18<24:38:22,  3.24it/s]
 23%|██▎       | 84325/371472 [6:42:18<23:45:46,  3.36it/s]
 23%|██▎       | 84326/371472 [6:42:19<23:26:41,  3.40it/s]
 23%|██▎       | 84327/371472 [6:42:19<22:11:25,  3.59it/s]
 23%|██▎       | 84328/371472 [6:42:19<22:31:43,  3.54it/s]
 23%|██▎       | 84329/371472 [6:42:19<21:46:22,  3.66it/s]
 23%|██▎       | 84330/371472 [6:42:20<21:00:14,  3.80it/s]
 23%|██▎       | 84331/371472 [6:42:20<21:06:13,  3.78it/s]
 23%|██▎       | 84332/371472 [6:42:20<22:09:20,  3.60it/s]
 23%|██▎       | 84333/371472 [6:42:21<22:01:11,  3.62it/s]
 23%|██▎       | 84334/371472 [6:42:21<21:43:55,  3.67it/s]
 23%|██▎       | 84335/371472 [6:42:21<23:12:03,  3.44it/s]
 23%|██▎       | 84336/371472 [6:42:21<23:07:34,  3.45it/s]
 23%|██▎       | 84337/371472 [6:42:22<22:45:57,  3.50it/s]
 23%|██▎       | 84338/371472 [6:42:22<22:54:45,  3.48it/s]
 23%|██▎       | 84339/371472 [6:42:22<23:53:06,  3.34it/s]
 23%|██▎       | 84340/371472 [6:42:23<23:06:08,  3.45it/s]
                                                           
{'loss': 3.9602, 'learning_rate': 7.960363291602921e-07, 'epoch': 3.63}

 23%|██▎       | 84340/371472 [6:42:23<23:06:08,  3.45it/s]
 23%|██▎       | 84341/371472 [6:42:23<23:49:33,  3.35it/s]
 23%|██▎       | 84342/371472 [6:42:23<24:13:06,  3.29it/s]
 23%|██▎       | 84343/371472 [6:42:24<23:15:35,  3.43it/s]
 23%|██▎       | 84344/371472 [6:42:24<22:01:28,  3.62it/s]
 23%|██▎       | 84345/371472 [6:42:24<21:46:32,  3.66it/s]
 23%|██▎       | 84346/371472 [6:42:24<22:43:28,  3.51it/s]
 23%|██▎       | 84347/371472 [6:42:25<23:05:56,  3.45it/s]
 23%|██▎       | 84348/371472 [6:42:25<22:01:32,  3.62it/s]
 23%|██▎       | 84349/371472 [6:42:25<21:24:03,  3.73it/s]
 23%|██▎       | 84350/371472 [6:42:25<21:03:58,  3.79it/s]
 23%|██▎       | 84351/371472 [6:42:26<21:10:31,  3.77it/s]
 23%|██▎       | 84352/371472 [6:42:26<22:59:53,  3.47it/s]
 23%|██▎       | 84353/371472 [6:42:26<22:57:26,  3.47it/s]
 23%|██▎       | 84354/371472 [6:42:27<22:45:51,  3.50it/s]
 23%|██▎       | 84355/371472 [6:42:27<27:55:46,  2.86it/s]
 23%|██▎       | 84356/371472 [6:42:27<27:50:29,  2.86it/s]
 23%|██▎       | 84357/371472 [6:42:28<26:17:38,  3.03it/s]
 23%|██▎       | 84358/371472 [6:42:28<24:27:21,  3.26it/s]
 23%|██▎       | 84359/371472 [6:42:28<24:06:16,  3.31it/s]
 23%|██▎       | 84360/371472 [6:42:29<25:42:14,  3.10it/s]
                                                           
{'loss': 3.9671, 'learning_rate': 7.959878471848132e-07, 'epoch': 3.63}

 23%|██▎       | 84360/371472 [6:42:29<25:42:14,  3.10it/s]
 23%|██▎       | 84361/371472 [6:42:29<24:23:29,  3.27it/s]
 23%|██▎       | 84362/371472 [6:42:29<23:46:23,  3.35it/s]
 23%|██▎       | 84363/371472 [6:42:29<23:41:55,  3.37it/s]
 23%|██▎       | 84364/371472 [6:42:30<23:03:06,  3.46it/s]
 23%|██▎       | 84365/371472 [6:42:30<22:39:19,  3.52it/s]
 23%|██▎       | 84366/371472 [6:42:30<22:37:37,  3.52it/s]
 23%|██▎       | 84367/371472 [6:42:31<22:48:25,  3.50it/s]
 23%|██▎       | 84368/371472 [6:42:31<22:52:25,  3.49it/s]
 23%|██▎       | 84369/371472 [6:42:31<24:14:10,  3.29it/s]
 23%|██▎       | 84370/371472 [6:42:31<23:12:35,  3.44it/s]
 23%|██▎       | 84371/371472 [6:42:32<22:07:12,  3.61it/s]
 23%|██▎       | 84372/371472 [6:42:32<22:11:31,  3.59it/s]
 23%|██▎       | 84373/371472 [6:42:32<23:01:46,  3.46it/s]
 23%|██▎       | 84374/371472 [6:42:33<23:26:09,  3.40it/s]
 23%|██▎       | 84375/371472 [6:42:33<23:42:58,  3.36it/s]
 23%|██▎       | 84376/371472 [6:42:33<24:18:36,  3.28it/s]
 23%|██▎       | 84377/371472 [6:42:34<23:36:55,  3.38it/s]
 23%|██▎       | 84378/371472 [6:42:34<24:17:52,  3.28it/s]
 23%|██▎       | 84379/371472 [6:42:34<23:11:54,  3.44it/s]
 23%|██▎       | 84380/371472 [6:42:34<23:04:04,  3.46it/s]
                                                           
{'loss': 3.8171, 'learning_rate': 7.959393652093343e-07, 'epoch': 3.63}

 23%|██▎       | 84380/371472 [6:42:34<23:04:04,  3.46it/s]
 23%|██▎       | 84381/371472 [6:42:35<24:54:25,  3.20it/s]
 23%|██▎       | 84382/371472 [6:42:35<23:41:40,  3.37it/s]
 23%|██▎       | 84383/371472 [6:42:35<24:09:57,  3.30it/s]
 23%|██▎       | 84384/371472 [6:42:36<23:29:03,  3.40it/s]
 23%|██▎       | 84385/371472 [6:42:36<25:35:36,  3.12it/s]
 23%|██▎       | 84386/371472 [6:42:36<23:53:05,  3.34it/s]
 23%|██▎       | 84387/371472 [6:42:36<22:57:13,  3.47it/s]
 23%|██▎       | 84388/371472 [6:42:37<24:09:54,  3.30it/s]
 23%|██▎       | 84389/371472 [6:42:37<24:33:00,  3.25it/s]
 23%|██▎       | 84390/371472 [6:42:37<24:40:11,  3.23it/s]
 23%|██▎       | 84391/371472 [6:42:38<23:18:13,  3.42it/s]
 23%|██▎       | 84392/371472 [6:42:38<22:09:32,  3.60it/s]
 23%|██▎       | 84393/371472 [6:42:38<22:14:56,  3.58it/s]
 23%|██▎       | 84394/371472 [6:42:39<22:59:16,  3.47it/s]
 23%|██▎       | 84395/371472 [6:42:39<22:15:28,  3.58it/s]
 23%|██▎       | 84396/371472 [6:42:39<22:22:04,  3.57it/s]
 23%|██▎       | 84397/371472 [6:42:39<22:30:23,  3.54it/s]
 23%|██▎       | 84398/371472 [6:42:40<22:33:33,  3.53it/s]
 23%|██▎       | 84399/371472 [6:42:40<21:43:12,  3.67it/s]
 23%|██▎       | 84400/371472 [6:42:40<21:55:19,  3.64it/s]
                                                           
{'loss': 3.9961, 'learning_rate': 7.958908832338555e-07, 'epoch': 3.64}

 23%|██▎       | 84400/371472 [6:42:40<21:55:19,  3.64it/s]
 23%|██▎       | 84401/371472 [6:42:41<23:57:40,  3.33it/s]
 23%|██▎       | 84402/371472 [6:42:41<22:49:44,  3.49it/s]
 23%|██▎       | 84403/371472 [6:42:41<25:05:52,  3.18it/s]
 23%|██▎       | 84404/371472 [6:42:41<24:25:30,  3.26it/s]
 23%|██▎       | 84405/371472 [6:42:42<23:24:05,  3.41it/s]
 23%|██▎       | 84406/371472 [6:42:42<23:22:33,  3.41it/s]
 23%|██▎       | 84407/371472 [6:42:42<23:44:56,  3.36it/s]
 23%|██▎       | 84408/371472 [6:42:43<23:56:15,  3.33it/s]
 23%|██▎       | 84409/371472 [6:42:43<23:20:44,  3.42it/s]
 23%|██▎       | 84410/371472 [6:42:43<21:51:04,  3.65it/s]
 23%|██▎       | 84411/371472 [6:42:43<21:28:14,  3.71it/s]
 23%|██▎       | 84412/371472 [6:42:44<22:25:45,  3.56it/s]
 23%|██▎       | 84413/371472 [6:42:44<24:20:50,  3.28it/s]
 23%|██▎       | 84414/371472 [6:42:44<23:26:59,  3.40it/s]
 23%|██▎       | 84415/371472 [6:42:45<23:14:01,  3.43it/s]
 23%|██▎       | 84416/371472 [6:42:45<22:17:30,  3.58it/s]
 23%|██▎       | 84417/371472 [6:42:45<24:24:37,  3.27it/s]
 23%|██▎       | 84418/371472 [6:42:46<25:20:58,  3.15it/s]
 23%|██▎       | 84419/371472 [6:42:46<25:22:04,  3.14it/s]
 23%|██▎       | 84420/371472 [6:42:46<23:29:25,  3.39it/s]
                                                           
{'loss': 4.049, 'learning_rate': 7.958424012583765e-07, 'epoch': 3.64}

 23%|██▎       | 84420/371472 [6:42:46<23:29:25,  3.39it/s]
 23%|██▎       | 84421/371472 [6:42:46<23:04:58,  3.45it/s]
 23%|██▎       | 84422/371472 [6:42:47<23:20:01,  3.42it/s]
 23%|██▎       | 84423/371472 [6:42:47<22:51:08,  3.49it/s]
 23%|██▎       | 84424/371472 [6:42:47<23:32:05,  3.39it/s]
 23%|██▎       | 84425/371472 [6:42:48<24:05:10,  3.31it/s]
 23%|██▎       | 84426/371472 [6:42:48<23:18:09,  3.42it/s]
 23%|██▎       | 84427/371472 [6:42:48<23:25:21,  3.40it/s]
 23%|██▎       | 84428/371472 [6:42:49<24:08:28,  3.30it/s]
 23%|██▎       | 84429/371472 [6:42:49<23:30:16,  3.39it/s]
 23%|██▎       | 84430/371472 [6:42:49<22:50:53,  3.49it/s]
 23%|██▎       | 84431/371472 [6:42:49<23:07:36,  3.45it/s]
 23%|██▎       | 84432/371472 [6:42:50<23:21:25,  3.41it/s]
 23%|██▎       | 84433/371472 [6:42:50<22:37:27,  3.52it/s]
 23%|██▎       | 84434/371472 [6:42:50<22:18:48,  3.57it/s]
 23%|██▎       | 84435/371472 [6:42:50<21:54:47,  3.64it/s]
 23%|██▎       | 84436/371472 [6:42:51<22:06:28,  3.61it/s]
 23%|██▎       | 84437/371472 [6:42:51<22:27:41,  3.55it/s]
 23%|██▎       | 84438/371472 [6:42:51<22:55:30,  3.48it/s]
 23%|██▎       | 84439/371472 [6:42:52<23:01:43,  3.46it/s]
 23%|██▎       | 84440/371472 [6:42:52<23:09:36,  3.44it/s]
                                                           
{'loss': 4.0956, 'learning_rate': 7.957939192828977e-07, 'epoch': 3.64}

 23%|██▎       | 84440/371472 [6:42:52<23:09:36,  3.44it/s]
 23%|██▎       | 84441/371472 [6:42:52<22:36:50,  3.53it/s]
 23%|██▎       | 84442/371472 [6:42:52<23:07:41,  3.45it/s]
 23%|██▎       | 84443/371472 [6:42:53<23:51:26,  3.34it/s]
 23%|██▎       | 84444/371472 [6:42:53<23:25:14,  3.40it/s]
 23%|██▎       | 84445/371472 [6:42:53<22:11:32,  3.59it/s]
 23%|██▎       | 84446/371472 [6:42:54<21:48:30,  3.66it/s]
 23%|██▎       | 84447/371472 [6:42:54<22:12:29,  3.59it/s]
 23%|██▎       | 84448/371472 [6:42:54<22:14:29,  3.58it/s]
 23%|██▎       | 84449/371472 [6:42:55<23:56:13,  3.33it/s]
 23%|██▎       | 84450/371472 [6:42:55<23:05:47,  3.45it/s]
 23%|██▎       | 84451/371472 [6:42:55<23:27:41,  3.40it/s]
 23%|██▎       | 84452/371472 [6:42:55<22:18:08,  3.57it/s]
 23%|██▎       | 84453/371472 [6:42:56<21:32:20,  3.70it/s]
 23%|██▎       | 84454/371472 [6:42:56<21:08:04,  3.77it/s]
 23%|██▎       | 84455/371472 [6:42:56<21:00:50,  3.79it/s]
 23%|██▎       | 84456/371472 [6:42:56<21:12:02,  3.76it/s]
 23%|██▎       | 84457/371472 [6:42:57<21:04:02,  3.78it/s]
 23%|██▎       | 84458/371472 [6:42:57<20:49:01,  3.83it/s]
 23%|██▎       | 84459/371472 [6:42:57<20:50:34,  3.83it/s]
 23%|██▎       | 84460/371472 [6:42:57<21:07:37,  3.77it/s]
                                                           
{'loss': 3.9901, 'learning_rate': 7.957454373074188e-07, 'epoch': 3.64}

 23%|██▎       | 84460/371472 [6:42:57<21:07:37,  3.77it/s]
 23%|██▎       | 84461/371472 [6:42:58<22:52:21,  3.49it/s]
 23%|██▎       | 84462/371472 [6:42:58<22:17:32,  3.58it/s]
 23%|██▎       | 84463/371472 [6:42:58<22:40:25,  3.52it/s]
 23%|██▎       | 84464/371472 [6:42:59<23:12:30,  3.44it/s]
 23%|██▎       | 84465/371472 [6:42:59<22:26:31,  3.55it/s]
 23%|██▎       | 84466/371472 [6:42:59<23:24:36,  3.41it/s]
 23%|██▎       | 84467/371472 [6:43:00<23:42:53,  3.36it/s]
 23%|██▎       | 84468/371472 [6:43:00<22:33:12,  3.53it/s]
 23%|██▎       | 84469/371472 [6:43:00<23:00:13,  3.47it/s]
 23%|██▎       | 84470/371472 [6:43:00<22:41:18,  3.51it/s]
 23%|██▎       | 84471/371472 [6:43:01<22:54:47,  3.48it/s]
 23%|██▎       | 84472/371472 [6:43:01<25:50:56,  3.08it/s]
 23%|██▎       | 84473/371472 [6:43:01<24:17:04,  3.28it/s]
 23%|██▎       | 84474/371472 [6:43:02<23:22:08,  3.41it/s]
 23%|██▎       | 84475/371472 [6:43:02<23:23:41,  3.41it/s]
 23%|██▎       | 84476/371472 [6:43:02<23:34:46,  3.38it/s]
 23%|██▎       | 84477/371472 [6:43:02<22:49:17,  3.49it/s]
 23%|██▎       | 84478/371472 [6:43:03<23:35:40,  3.38it/s]
 23%|██▎       | 84479/371472 [6:43:03<23:28:25,  3.40it/s]
 23%|██▎       | 84480/371472 [6:43:03<22:48:33,  3.50it/s]
                                                           
{'loss': 3.8085, 'learning_rate': 7.9569695533194e-07, 'epoch': 3.64}

 23%|██▎       | 84480/371472 [6:43:03<22:48:33,  3.50it/s]
 23%|██▎       | 84481/371472 [6:43:04<24:56:16,  3.20it/s]
 23%|██▎       | 84482/371472 [6:43:04<24:07:30,  3.30it/s]
 23%|██▎       | 84483/371472 [6:43:04<23:47:27,  3.35it/s]
 23%|██▎       | 84484/371472 [6:43:05<22:55:41,  3.48it/s]
 23%|██▎       | 84485/371472 [6:43:05<22:11:25,  3.59it/s]
 23%|██▎       | 84486/371472 [6:43:05<22:22:24,  3.56it/s]
 23%|██▎       | 84487/371472 [6:43:05<21:48:48,  3.65it/s]
 23%|██▎       | 84488/371472 [6:43:06<21:58:19,  3.63it/s]
 23%|██▎       | 84489/371472 [6:43:06<22:00:54,  3.62it/s]
 23%|██▎       | 84490/371472 [6:43:06<21:46:31,  3.66it/s]
 23%|██▎       | 84491/371472 [6:43:06<22:02:41,  3.62it/s]
 23%|██▎       | 84492/371472 [6:43:07<22:06:00,  3.61it/s]
 23%|██▎       | 84493/371472 [6:43:07<24:57:12,  3.19it/s]
 23%|██▎       | 84494/371472 [6:43:07<24:38:05,  3.24it/s]
 23%|██▎       | 84495/371472 [6:43:08<24:19:59,  3.28it/s]
 23%|██▎       | 84496/371472 [6:43:08<23:54:31,  3.33it/s]
 23%|██▎       | 84497/371472 [6:43:08<23:31:12,  3.39it/s]
 23%|██▎       | 84498/371472 [6:43:09<22:45:32,  3.50it/s]
 23%|██▎       | 84499/371472 [6:43:09<23:08:46,  3.44it/s]
 23%|██▎       | 84500/371472 [6:43:09<22:44:36,  3.50it/s]
                                                           
{'loss': 4.0237, 'learning_rate': 7.956484733564609e-07, 'epoch': 3.64}

 23%|██▎       | 84500/371472 [6:43:09<22:44:36,  3.50it/s]
 23%|██▎       | 84501/371472 [6:43:09<21:27:29,  3.71it/s]
 23%|██▎       | 84502/371472 [6:43:10<21:57:56,  3.63it/s]
 23%|██▎       | 84503/371472 [6:43:10<21:24:13,  3.72it/s]
 23%|██▎       | 84504/371472 [6:43:10<21:06:26,  3.78it/s]
 23%|██▎       | 84505/371472 [6:43:10<21:03:11,  3.79it/s]
 23%|██▎       | 84506/371472 [6:43:11<22:37:15,  3.52it/s]
 23%|██▎       | 84507/371472 [6:43:11<23:18:54,  3.42it/s]
 23%|██▎       | 84508/371472 [6:43:11<24:00:52,  3.32it/s]
 23%|██▎       | 84509/371472 [6:43:12<23:56:24,  3.33it/s]
 23%|██▎       | 84510/371472 [6:43:12<22:38:27,  3.52it/s]
 23%|██▎       | 84511/371472 [6:43:12<23:41:01,  3.37it/s]
 23%|██▎       | 84512/371472 [6:43:12<22:42:48,  3.51it/s]
 23%|██▎       | 84513/371472 [6:43:13<21:52:27,  3.64it/s]
 23%|██▎       | 84514/371472 [6:43:13<21:58:36,  3.63it/s]
 23%|██▎       | 84515/371472 [6:43:13<21:46:30,  3.66it/s]
 23%|██▎       | 84516/371472 [6:43:14<22:14:40,  3.58it/s]
 23%|██▎       | 84517/371472 [6:43:14<21:54:44,  3.64it/s]
 23%|██▎       | 84518/371472 [6:43:14<22:19:36,  3.57it/s]
 23%|██▎       | 84519/371472 [6:43:14<21:44:35,  3.67it/s]
 23%|██▎       | 84520/371472 [6:43:15<21:27:34,  3.71it/s]
                                                           
{'loss': 3.8252, 'learning_rate': 7.955999913809821e-07, 'epoch': 3.64}

 23%|██▎       | 84520/371472 [6:43:15<21:27:34,  3.71it/s]
 23%|██▎       | 84521/371472 [6:43:15<21:28:38,  3.71it/s]
 23%|██▎       | 84522/371472 [6:43:15<20:58:29,  3.80it/s]
 23%|██▎       | 84523/371472 [6:43:15<21:52:03,  3.65it/s]
 23%|██▎       | 84524/371472 [6:43:16<23:01:48,  3.46it/s]
 23%|██▎       | 84525/371472 [6:43:16<22:47:41,  3.50it/s]
 23%|██▎       | 84526/371472 [6:43:16<22:07:58,  3.60it/s]
 23%|██▎       | 84527/371472 [6:43:17<21:28:04,  3.71it/s]
 23%|██▎       | 84528/371472 [6:43:17<21:40:54,  3.68it/s]
 23%|██▎       | 84529/371472 [6:43:17<22:20:57,  3.57it/s]
 23%|██▎       | 84530/371472 [6:43:17<21:53:59,  3.64it/s]
 23%|██▎       | 84531/371472 [6:43:18<21:41:10,  3.68it/s]
 23%|██▎       | 84532/371472 [6:43:18<21:21:05,  3.73it/s]
 23%|██▎       | 84533/371472 [6:43:18<21:09:56,  3.77it/s]
 23%|██▎       | 84534/371472 [6:43:19<22:21:11,  3.57it/s]
 23%|██▎       | 84535/371472 [6:43:19<22:57:24,  3.47it/s]
 23%|██▎       | 84536/371472 [6:43:19<22:28:24,  3.55it/s]
 23%|██▎       | 84537/371472 [6:43:19<22:24:10,  3.56it/s]
 23%|██▎       | 84538/371472 [6:43:20<21:34:39,  3.69it/s]
 23%|██▎       | 84539/371472 [6:43:20<23:35:02,  3.38it/s]
 23%|██▎       | 84540/371472 [6:43:20<22:00:55,  3.62it/s]
                                                           
{'loss': 3.9908, 'learning_rate': 7.955515094055032e-07, 'epoch': 3.64}

 23%|██▎       | 84540/371472 [6:43:20<22:00:55,  3.62it/s]
 23%|██▎       | 84541/371472 [6:43:20<22:21:39,  3.56it/s]
 23%|██▎       | 84542/371472 [6:43:21<21:52:20,  3.64it/s]
 23%|██▎       | 84543/371472 [6:43:21<21:17:09,  3.74it/s]
 23%|██▎       | 84544/371472 [6:43:21<22:33:01,  3.53it/s]
 23%|██▎       | 84545/371472 [6:43:22<22:06:23,  3.61it/s]
 23%|██▎       | 84546/371472 [6:43:22<21:20:18,  3.74it/s]
 23%|██▎       | 84547/371472 [6:43:22<23:00:43,  3.46it/s]
 23%|██▎       | 84548/371472 [6:43:23<24:16:14,  3.28it/s]
 23%|██▎       | 84549/371472 [6:43:23<23:39:22,  3.37it/s]
 23%|██▎       | 84550/371472 [6:43:23<24:11:51,  3.29it/s]
 23%|██▎       | 84551/371472 [6:43:23<22:49:15,  3.49it/s]
 23%|██▎       | 84552/371472 [6:43:24<23:35:12,  3.38it/s]
 23%|██▎       | 84553/371472 [6:43:24<22:53:23,  3.48it/s]
 23%|██▎       | 84554/371472 [6:43:24<22:38:15,  3.52it/s]
 23%|██▎       | 84555/371472 [6:43:24<22:02:04,  3.62it/s]
 23%|██▎       | 84556/371472 [6:43:25<22:43:24,  3.51it/s]
 23%|██▎       | 84557/371472 [6:43:25<23:35:16,  3.38it/s]
 23%|██▎       | 84558/371472 [6:43:25<22:54:00,  3.48it/s]
 23%|██▎       | 84559/371472 [6:43:26<23:01:03,  3.46it/s]
 23%|██▎       | 84560/371472 [6:43:26<22:56:38,  3.47it/s]
                                                           
{'loss': 3.9034, 'learning_rate': 7.955030274300244e-07, 'epoch': 3.64}

 23%|██▎       | 84560/371472 [6:43:26<22:56:38,  3.47it/s]
 23%|██▎       | 84561/371472 [6:43:26<22:41:26,  3.51it/s]
 23%|██▎       | 84562/371472 [6:43:27<22:42:35,  3.51it/s]
 23%|██▎       | 84563/371472 [6:43:27<22:18:10,  3.57it/s]
 23%|██▎       | 84564/371472 [6:43:27<22:34:22,  3.53it/s]
 23%|██▎       | 84565/371472 [6:43:27<21:53:47,  3.64it/s]
 23%|██▎       | 84566/371472 [6:43:28<21:16:53,  3.74it/s]
 23%|██▎       | 84567/371472 [6:43:28<20:41:26,  3.85it/s]
 23%|██▎       | 84568/371472 [6:43:28<21:27:14,  3.71it/s]
 23%|██▎       | 84569/371472 [6:43:28<22:08:08,  3.60it/s]
 23%|██▎       | 84570/371472 [6:43:29<21:52:36,  3.64it/s]
 23%|██▎       | 84571/371472 [6:43:29<24:38:13,  3.23it/s]
 23%|██▎       | 84572/371472 [6:43:29<24:51:26,  3.21it/s]
 23%|██▎       | 84573/371472 [6:43:30<23:37:48,  3.37it/s]
 23%|██▎       | 84574/371472 [6:43:30<24:31:23,  3.25it/s]
 23%|██▎       | 84575/371472 [6:43:30<23:55:11,  3.33it/s]
 23%|██▎       | 84576/371472 [6:43:31<22:50:11,  3.49it/s]
 23%|██▎       | 84577/371472 [6:43:31<22:24:03,  3.56it/s]
 23%|██▎       | 84578/371472 [6:43:31<21:56:08,  3.63it/s]
 23%|██▎       | 84579/371472 [6:43:31<23:51:48,  3.34it/s]
 23%|██▎       | 84580/371472 [6:43:32<23:31:30,  3.39it/s]
                                                           
{'loss': 3.8876, 'learning_rate': 7.954545454545454e-07, 'epoch': 3.64}

 23%|██▎       | 84580/371472 [6:43:32<23:31:30,  3.39it/s]
 23%|██▎       | 84581/371472 [6:43:32<22:54:37,  3.48it/s]
 23%|██▎       | 84582/371472 [6:43:32<22:39:09,  3.52it/s]
 23%|██▎       | 84583/371472 [6:43:33<22:34:06,  3.53it/s]
 23%|██▎       | 84584/371472 [6:43:33<22:45:13,  3.50it/s]
 23%|██▎       | 84585/371472 [6:43:33<21:51:46,  3.65it/s]
 23%|██▎       | 84586/371472 [6:43:33<22:34:21,  3.53it/s]
 23%|██▎       | 84587/371472 [6:43:34<22:27:42,  3.55it/s]
 23%|██▎       | 84588/371472 [6:43:34<22:12:58,  3.59it/s]
 23%|██▎       | 84589/371472 [6:43:34<22:10:54,  3.59it/s]
 23%|██▎       | 84590/371472 [6:43:34<21:48:44,  3.65it/s]
 23%|██▎       | 84591/371472 [6:43:35<21:55:53,  3.63it/s]
 23%|██▎       | 84592/371472 [6:43:35<22:05:48,  3.61it/s]
 23%|██▎       | 84593/371472 [6:43:35<21:47:55,  3.66it/s]
 23%|██▎       | 84594/371472 [6:43:36<21:53:25,  3.64it/s]
 23%|██▎       | 84595/371472 [6:43:36<22:49:09,  3.49it/s]
 23%|██▎       | 84596/371472 [6:43:36<23:16:54,  3.42it/s]
 23%|██▎       | 84597/371472 [6:43:37<24:40:17,  3.23it/s]
 23%|██▎       | 84598/371472 [6:43:37<23:25:54,  3.40it/s]
 23%|██▎       | 84599/371472 [6:43:37<25:02:24,  3.18it/s]
 23%|██▎       | 84600/371472 [6:43:37<23:59:09,  3.32it/s]
                                                           
{'loss': 4.1822, 'learning_rate': 7.954060634790666e-07, 'epoch': 3.64}

 23%|██▎       | 84600/371472 [6:43:37<23:59:09,  3.32it/s]
 23%|██▎       | 84601/371472 [6:43:38<24:16:21,  3.28it/s]
 23%|██▎       | 84602/371472 [6:43:38<23:59:53,  3.32it/s]
 23%|██▎       | 84603/371472 [6:43:38<23:34:16,  3.38it/s]
 23%|██▎       | 84604/371472 [6:43:39<22:19:42,  3.57it/s]
 23%|██▎       | 84605/371472 [6:43:39<22:01:48,  3.62it/s]
 23%|██▎       | 84606/371472 [6:43:39<22:18:44,  3.57it/s]
 23%|██▎       | 84607/371472 [6:43:39<21:29:52,  3.71it/s]
 23%|██▎       | 84608/371472 [6:43:40<22:46:53,  3.50it/s]
 23%|██▎       | 84609/371472 [6:43:40<25:17:32,  3.15it/s]
 23%|██▎       | 84610/371472 [6:43:40<25:17:00,  3.15it/s]
 23%|██▎       | 84611/371472 [6:43:41<24:10:40,  3.30it/s]
 23%|██▎       | 84612/371472 [6:43:41<23:40:51,  3.36it/s]
 23%|██▎       | 84613/371472 [6:43:41<22:32:36,  3.53it/s]
 23%|██▎       | 84614/371472 [6:43:41<22:48:15,  3.49it/s]
 23%|██▎       | 84615/371472 [6:43:42<23:02:16,  3.46it/s]
 23%|██▎       | 84616/371472 [6:43:42<23:00:06,  3.46it/s]
 23%|██▎       | 84617/371472 [6:43:42<22:08:47,  3.60it/s]
 23%|██▎       | 84618/371472 [6:43:43<21:53:16,  3.64it/s]
 23%|██▎       | 84619/371472 [6:43:43<22:04:28,  3.61it/s]
 23%|██▎       | 84620/371472 [6:43:43<21:29:35,  3.71it/s]
                                                           
{'loss': 3.8962, 'learning_rate': 7.953575815035876e-07, 'epoch': 3.64}

 23%|██▎       | 84620/371472 [6:43:43<21:29:35,  3.71it/s]
 23%|██▎       | 84621/371472 [6:43:43<21:31:33,  3.70it/s]
 23%|██▎       | 84622/371472 [6:43:44<21:25:32,  3.72it/s]
 23%|██▎       | 84623/371472 [6:43:44<21:46:23,  3.66it/s]
 23%|██▎       | 84624/371472 [6:43:44<21:16:30,  3.75it/s]
 23%|██▎       | 84625/371472 [6:43:44<21:25:28,  3.72it/s]
 23%|██▎       | 84626/371472 [6:43:45<21:00:45,  3.79it/s]
 23%|██▎       | 84627/371472 [6:43:45<20:58:02,  3.80it/s]
 23%|██▎       | 84628/371472 [6:43:45<21:18:36,  3.74it/s]
 23%|██▎       | 84629/371472 [6:43:45<21:12:12,  3.76it/s]
 23%|██▎       | 84630/371472 [6:43:46<21:36:56,  3.69it/s]
 23%|██▎       | 84631/371472 [6:43:46<21:21:42,  3.73it/s]
 23%|██▎       | 84632/371472 [6:43:46<22:28:03,  3.55it/s]
 23%|██▎       | 84633/371472 [6:43:47<22:42:13,  3.51it/s]
 23%|██▎       | 84634/371472 [6:43:47<27:00:48,  2.95it/s]
 23%|██▎       | 84635/371472 [6:43:47<25:13:54,  3.16it/s]
 23%|██▎       | 84636/371472 [6:43:48<23:55:51,  3.33it/s]
 23%|██▎       | 84637/371472 [6:43:48<23:21:18,  3.41it/s]
 23%|██▎       | 84638/371472 [6:43:48<23:15:45,  3.43it/s]
 23%|██▎       | 84639/371472 [6:43:48<22:09:06,  3.60it/s]
 23%|██▎       | 84640/371472 [6:43:49<22:45:16,  3.50it/s]
                                                           
{'loss': 3.9814, 'learning_rate': 7.953090995281087e-07, 'epoch': 3.65}

 23%|██▎       | 84640/371472 [6:43:49<22:45:16,  3.50it/s]
 23%|██▎       | 84641/371472 [6:43:49<22:40:14,  3.51it/s]
 23%|██▎       | 84642/371472 [6:43:49<23:00:38,  3.46it/s]
 23%|██▎       | 84643/371472 [6:43:50<22:52:11,  3.48it/s]
 23%|██▎       | 84644/371472 [6:43:50<23:57:15,  3.33it/s]
 23%|██▎       | 84645/371472 [6:43:50<23:04:56,  3.45it/s]
 23%|██▎       | 84646/371472 [6:43:50<22:44:01,  3.50it/s]
 23%|██▎       | 84647/371472 [6:43:51<23:02:50,  3.46it/s]
 23%|██▎       | 84648/371472 [6:43:51<22:54:00,  3.48it/s]
 23%|██▎       | 84649/371472 [6:43:51<24:07:30,  3.30it/s]
 23%|██▎       | 84650/371472 [6:43:52<23:02:17,  3.46it/s]
 23%|██▎       | 84651/371472 [6:43:52<22:02:14,  3.62it/s]
 23%|██▎       | 84652/371472 [6:43:52<22:26:58,  3.55it/s]
 23%|██▎       | 84653/371472 [6:43:52<21:59:56,  3.62it/s]
 23%|██▎       | 84654/371472 [6:43:53<22:15:46,  3.58it/s]
 23%|██▎       | 84655/371472 [6:43:53<22:11:32,  3.59it/s]
 23%|██▎       | 84656/371472 [6:43:53<23:52:59,  3.34it/s]
 23%|██▎       | 84657/371472 [6:43:54<23:13:07,  3.43it/s]
 23%|██▎       | 84658/371472 [6:43:54<23:34:16,  3.38it/s]
 23%|██▎       | 84659/371472 [6:43:54<22:29:37,  3.54it/s]
 23%|██▎       | 84660/371472 [6:43:54<21:37:14,  3.68it/s]
                                                           
{'loss': 3.759, 'learning_rate': 7.952606175526298e-07, 'epoch': 3.65}

 23%|██▎       | 84660/371472 [6:43:54<21:37:14,  3.68it/s]
 23%|██▎       | 84661/371472 [6:43:55<23:03:50,  3.45it/s]
 23%|██▎       | 84662/371472 [6:43:55<23:49:57,  3.34it/s]
 23%|██▎       | 84663/371472 [6:43:55<22:48:55,  3.49it/s]
 23%|██▎       | 84664/371472 [6:43:56<22:17:12,  3.57it/s]
 23%|██▎       | 84665/371472 [6:43:56<23:47:51,  3.35it/s]
 23%|██▎       | 84666/371472 [6:43:56<22:34:15,  3.53it/s]
 23%|██▎       | 84667/371472 [6:43:57<22:42:58,  3.51it/s]
 23%|██▎       | 84668/371472 [6:43:57<22:13:17,  3.59it/s]
 23%|██▎       | 84669/371472 [6:43:57<22:03:15,  3.61it/s]
 23%|██▎       | 84670/371472 [6:43:57<23:57:51,  3.32it/s]
 23%|██▎       | 84671/371472 [6:43:58<22:55:53,  3.47it/s]
 23%|██▎       | 84672/371472 [6:43:58<21:46:51,  3.66it/s]
 23%|██▎       | 84673/371472 [6:43:58<21:53:19,  3.64it/s]
 23%|██▎       | 84674/371472 [6:43:58<21:04:18,  3.78it/s]
 23%|██▎       | 84675/371472 [6:43:59<22:02:26,  3.61it/s]
 23%|██▎       | 84676/371472 [6:43:59<21:02:11,  3.79it/s]
 23%|██▎       | 84677/371472 [6:43:59<20:54:13,  3.81it/s]
 23%|██▎       | 84678/371472 [6:44:00<21:46:21,  3.66it/s]
 23%|██▎       | 84679/371472 [6:44:00<21:54:33,  3.64it/s]
 23%|██▎       | 84680/371472 [6:44:00<21:08:27,  3.77it/s]
                                                           
{'loss': 3.8853, 'learning_rate': 7.95212135577151e-07, 'epoch': 3.65}

 23%|██▎       | 84680/371472 [6:44:00<21:08:27,  3.77it/s]
 23%|██▎       | 84681/371472 [6:44:00<21:26:37,  3.72it/s]
 23%|██▎       | 84682/371472 [6:44:01<24:05:57,  3.31it/s]
 23%|██▎       | 84683/371472 [6:44:01<23:15:07,  3.43it/s]
 23%|██▎       | 84684/371472 [6:44:01<22:08:21,  3.60it/s]
 23%|██▎       | 84685/371472 [6:44:02<22:57:29,  3.47it/s]
 23%|██▎       | 84686/371472 [6:44:02<22:05:02,  3.61it/s]
 23%|██▎       | 84687/371472 [6:44:02<22:10:15,  3.59it/s]
 23%|██▎       | 84688/371472 [6:44:02<22:36:52,  3.52it/s]
 23%|██▎       | 84689/371472 [6:44:03<22:14:12,  3.58it/s]
 23%|██▎       | 84690/371472 [6:44:03<21:23:25,  3.72it/s]
 23%|██▎       | 84691/371472 [6:44:03<22:23:57,  3.56it/s]
 23%|██▎       | 84692/371472 [6:44:04<23:41:57,  3.36it/s]
 23%|██▎       | 84693/371472 [6:44:04<23:58:52,  3.32it/s]
 23%|██▎       | 84694/371472 [6:44:04<23:40:10,  3.37it/s]
 23%|██▎       | 84695/371472 [6:44:05<26:21:32,  3.02it/s]
 23%|██▎       | 84696/371472 [6:44:05<25:02:51,  3.18it/s]
 23%|██▎       | 84697/371472 [6:44:05<25:33:40,  3.12it/s]
 23%|██▎       | 84698/371472 [6:44:05<24:54:23,  3.20it/s]
 23%|██▎       | 84699/371472 [6:44:06<27:28:07,  2.90it/s]
 23%|██▎       | 84700/371472 [6:44:06<25:13:33,  3.16it/s]
                                                           
{'loss': 3.8057, 'learning_rate': 7.951636536016721e-07, 'epoch': 3.65}

 23%|██▎       | 84700/371472 [6:44:06<25:13:33,  3.16it/s]
 23%|██▎       | 84701/371472 [6:44:06<25:10:40,  3.16it/s]
 23%|██▎       | 84702/371472 [6:44:07<23:28:07,  3.39it/s]
 23%|██▎       | 84703/371472 [6:44:07<23:31:04,  3.39it/s]
 23%|██▎       | 84704/371472 [6:44:07<24:48:28,  3.21it/s]
 23%|██▎       | 84705/371472 [6:44:08<23:54:54,  3.33it/s]
 23%|██▎       | 84706/371472 [6:44:08<22:39:05,  3.52it/s]
 23%|██▎       | 84707/371472 [6:44:08<23:12:28,  3.43it/s]
 23%|██▎       | 84708/371472 [6:44:08<23:30:16,  3.39it/s]
 23%|██▎       | 84709/371472 [6:44:09<22:24:24,  3.56it/s]
 23%|██▎       | 84710/371472 [6:44:09<21:29:03,  3.71it/s]
 23%|██▎       | 84711/371472 [6:44:09<20:52:22,  3.82it/s]
 23%|██▎       | 84712/371472 [6:44:09<20:26:12,  3.90it/s]
 23%|██▎       | 84713/371472 [6:44:10<21:03:47,  3.78it/s]
 23%|██▎       | 84714/371472 [6:44:10<20:39:32,  3.86it/s]
 23%|██▎       | 84715/371472 [6:44:10<20:11:00,  3.95it/s]
 23%|██▎       | 84716/371472 [6:44:10<20:39:53,  3.85it/s]
 23%|██▎       | 84717/371472 [6:44:11<20:50:32,  3.82it/s]
 23%|██▎       | 84718/371472 [6:44:11<21:44:52,  3.66it/s]
 23%|██▎       | 84719/371472 [6:44:11<21:37:31,  3.68it/s]
 23%|██▎       | 84720/371472 [6:44:12<22:37:34,  3.52it/s]
                                                           
{'loss': 4.0741, 'learning_rate': 7.951151716261931e-07, 'epoch': 3.65}

 23%|██▎       | 84720/371472 [6:44:12<22:37:34,  3.52it/s]
 23%|██▎       | 84721/371472 [6:44:12<21:56:01,  3.63it/s]
 23%|██▎       | 84722/371472 [6:44:12<22:09:50,  3.59it/s]
 23%|██▎       | 84723/371472 [6:44:12<21:25:30,  3.72it/s]
 23%|██▎       | 84724/371472 [6:44:13<23:45:21,  3.35it/s]
 23%|██▎       | 84725/371472 [6:44:13<23:57:47,  3.32it/s]
 23%|██▎       | 84726/371472 [6:44:13<24:38:38,  3.23it/s]
 23%|██▎       | 84727/371472 [6:44:14<23:56:56,  3.33it/s]
 23%|██▎       | 84728/371472 [6:44:14<22:55:00,  3.48it/s]
 23%|██▎       | 84729/371472 [6:44:14<22:13:29,  3.58it/s]
 23%|██▎       | 84730/371472 [6:44:15<23:03:43,  3.45it/s]
 23%|██▎       | 84731/371472 [6:44:15<23:30:54,  3.39it/s]
 23%|██▎       | 84732/371472 [6:44:15<22:39:09,  3.52it/s]
 23%|██▎       | 84733/371472 [6:44:15<23:25:23,  3.40it/s]
 23%|██▎       | 84734/371472 [6:44:16<23:36:01,  3.37it/s]
 23%|██▎       | 84735/371472 [6:44:16<22:25:41,  3.55it/s]
 23%|██▎       | 84736/371472 [6:44:16<23:14:07,  3.43it/s]
 23%|██▎       | 84737/371472 [6:44:17<22:39:15,  3.52it/s]
 23%|██▎       | 84738/371472 [6:44:17<22:23:49,  3.56it/s]
 23%|██▎       | 84739/371472 [6:44:17<21:32:55,  3.70it/s]
 23%|██▎       | 84740/371472 [6:44:17<21:12:50,  3.75it/s]
                                                           
{'loss': 3.9503, 'learning_rate': 7.950666896507143e-07, 'epoch': 3.65}

 23%|██▎       | 84740/371472 [6:44:17<21:12:50,  3.75it/s]
 23%|██▎       | 84741/371472 [6:44:18<20:39:50,  3.85it/s]
 23%|██▎       | 84742/371472 [6:44:18<20:48:21,  3.83it/s]
 23%|██▎       | 84743/371472 [6:44:18<20:23:35,  3.91it/s]
 23%|██▎       | 84744/371472 [6:44:18<21:46:27,  3.66it/s]
 23%|██▎       | 84745/371472 [6:44:19<21:34:22,  3.69it/s]
 23%|██▎       | 84746/371472 [6:44:19<21:38:41,  3.68it/s]
 23%|██▎       | 84747/371472 [6:44:19<22:01:45,  3.62it/s]
 23%|██▎       | 84748/371472 [6:44:19<22:31:10,  3.54it/s]
 23%|██▎       | 84749/371472 [6:44:20<22:12:59,  3.58it/s]
 23%|██▎       | 84750/371472 [6:44:20<22:49:29,  3.49it/s]
 23%|██▎       | 84751/371472 [6:44:20<22:54:55,  3.48it/s]
 23%|██▎       | 84752/371472 [6:44:21<22:33:59,  3.53it/s]
 23%|██▎       | 84753/371472 [6:44:21<22:18:55,  3.57it/s]
 23%|██▎       | 84754/371472 [6:44:21<21:56:16,  3.63it/s]
 23%|██▎       | 84755/371472 [6:44:21<21:34:14,  3.69it/s]
 23%|██▎       | 84756/371472 [6:44:22<21:03:02,  3.78it/s]
 23%|██▎       | 84757/371472 [6:44:22<21:21:02,  3.73it/s]
 23%|██▎       | 84758/371472 [6:44:22<21:10:55,  3.76it/s]
 23%|██▎       | 84759/371472 [6:44:23<23:16:35,  3.42it/s]
 23%|██▎       | 84760/371472 [6:44:23<23:05:01,  3.45it/s]
                                                           
{'loss': 3.9285, 'learning_rate': 7.950182076752354e-07, 'epoch': 3.65}

 23%|██▎       | 84760/371472 [6:44:23<23:05:01,  3.45it/s]
 23%|██▎       | 84761/371472 [6:44:23<22:34:00,  3.53it/s]
 23%|██▎       | 84762/371472 [6:44:23<24:37:43,  3.23it/s]
 23%|██▎       | 84763/371472 [6:44:24<23:48:09,  3.35it/s]
 23%|██▎       | 84764/371472 [6:44:24<23:13:05,  3.43it/s]
 23%|██▎       | 84765/371472 [6:44:24<22:52:47,  3.48it/s]
 23%|██▎       | 84766/371472 [6:44:25<21:57:40,  3.63it/s]
 23%|██▎       | 84767/371472 [6:44:25<21:15:27,  3.75it/s]
 23%|██▎       | 84768/371472 [6:44:25<21:27:49,  3.71it/s]
 23%|██▎       | 84769/371472 [6:44:25<23:02:59,  3.46it/s]
 23%|██▎       | 84770/371472 [6:44:26<22:56:45,  3.47it/s]
 23%|██▎       | 84771/371472 [6:44:26<22:45:45,  3.50it/s]
 23%|██▎       | 84772/371472 [6:44:26<22:44:03,  3.50it/s]
 23%|██▎       | 84773/371472 [6:44:27<23:56:15,  3.33it/s]
 23%|██▎       | 84774/371472 [6:44:27<23:00:46,  3.46it/s]
 23%|██▎       | 84775/371472 [6:44:27<21:58:55,  3.62it/s]
 23%|██▎       | 84776/371472 [6:44:27<21:57:15,  3.63it/s]
 23%|██▎       | 84777/371472 [6:44:28<23:12:03,  3.43it/s]
 23%|██▎       | 84778/371472 [6:44:28<22:51:19,  3.48it/s]
 23%|██▎       | 84779/371472 [6:44:28<22:46:22,  3.50it/s]
 23%|██▎       | 84780/371472 [6:44:29<22:26:59,  3.55it/s]
                                                           
{'loss': 3.9181, 'learning_rate': 7.949697256997566e-07, 'epoch': 3.65}

 23%|██▎       | 84780/371472 [6:44:29<22:26:59,  3.55it/s]
 23%|██▎       | 84781/371472 [6:44:29<21:40:01,  3.68it/s]
 23%|██▎       | 84782/371472 [6:44:29<23:02:18,  3.46it/s]
 23%|██▎       | 84783/371472 [6:44:29<23:09:24,  3.44it/s]
 23%|██▎       | 84784/371472 [6:44:30<22:36:36,  3.52it/s]
 23%|██▎       | 84785/371472 [6:44:30<21:25:28,  3.72it/s]
 23%|██▎       | 84786/371472 [6:44:30<21:24:42,  3.72it/s]
 23%|██▎       | 84787/371472 [6:44:30<21:50:45,  3.65it/s]
 23%|██▎       | 84788/371472 [6:44:31<22:06:03,  3.60it/s]
 23%|██▎       | 84789/371472 [6:44:31<21:23:44,  3.72it/s]
 23%|██▎       | 84790/371472 [6:44:31<22:49:40,  3.49it/s]
 23%|██▎       | 84791/371472 [6:44:32<22:06:45,  3.60it/s]
 23%|██▎       | 84792/371472 [6:44:32<22:00:53,  3.62it/s]
 23%|██▎       | 84793/371472 [6:44:32<21:25:43,  3.72it/s]
 23%|██▎       | 84794/371472 [6:44:32<21:23:17,  3.72it/s]
 23%|██▎       | 84795/371472 [6:44:33<22:19:24,  3.57it/s]
 23%|██▎       | 84796/371472 [6:44:33<22:11:55,  3.59it/s]
 23%|██▎       | 84797/371472 [6:44:33<22:20:42,  3.56it/s]
 23%|██▎       | 84798/371472 [6:44:34<23:08:22,  3.44it/s]
 23%|██▎       | 84799/371472 [6:44:34<22:56:01,  3.47it/s]
 23%|██▎       | 84800/371472 [6:44:34<22:43:37,  3.50it/s]
                                                           
{'loss': 3.9765, 'learning_rate': 7.949212437242775e-07, 'epoch': 3.65}

 23%|██▎       | 84800/371472 [6:44:34<22:43:37,  3.50it/s]
 23%|██▎       | 84801/371472 [6:44:34<22:21:58,  3.56it/s]
 23%|██▎       | 84802/371472 [6:44:35<23:17:47,  3.42it/s]
 23%|██▎       | 84803/371472 [6:44:35<23:55:41,  3.33it/s]
 23%|██▎       | 84804/371472 [6:44:35<23:52:39,  3.33it/s]
 23%|██▎       | 84805/371472 [6:44:36<23:55:57,  3.33it/s]
 23%|██▎       | 84806/371472 [6:44:36<25:04:46,  3.18it/s]
 23%|██▎       | 84807/371472 [6:44:36<24:11:06,  3.29it/s]
 23%|██▎       | 84808/371472 [6:44:37<23:40:05,  3.36it/s]
 23%|██▎       | 84809/371472 [6:44:37<24:23:49,  3.26it/s]
 23%|██▎       | 84810/371472 [6:44:37<25:06:08,  3.17it/s]
 23%|██▎       | 84811/371472 [6:44:37<24:13:14,  3.29it/s]
 23%|██▎       | 84812/371472 [6:44:38<23:20:32,  3.41it/s]
 23%|██▎       | 84813/371472 [6:44:38<24:29:11,  3.25it/s]
 23%|██▎       | 84814/371472 [6:44:38<23:42:30,  3.36it/s]
 23%|██▎       | 84815/371472 [6:44:39<24:10:59,  3.29it/s]
 23%|██▎       | 84816/371472 [6:44:39<22:45:51,  3.50it/s]
 23%|██▎       | 84817/371472 [6:44:39<22:12:11,  3.59it/s]
 23%|██▎       | 84818/371472 [6:44:39<22:24:22,  3.55it/s]
 23%|██▎       | 84819/371472 [6:44:40<21:19:54,  3.73it/s]
 23%|██▎       | 84820/371472 [6:44:40<21:09:21,  3.76it/s]
                                                           
{'loss': 4.0099, 'learning_rate': 7.948727617487987e-07, 'epoch': 3.65}

 23%|██▎       | 84820/371472 [6:44:40<21:09:21,  3.76it/s]
 23%|██▎       | 84821/371472 [6:44:40<21:58:09,  3.62it/s]
 23%|██▎       | 84822/371472 [6:44:41<21:48:06,  3.65it/s]
 23%|██▎       | 84823/371472 [6:44:41<23:36:22,  3.37it/s]
 23%|██▎       | 84824/371472 [6:44:41<22:27:49,  3.54it/s]
 23%|██▎       | 84825/371472 [6:44:41<21:36:03,  3.69it/s]
 23%|██▎       | 84826/371472 [6:44:42<21:53:56,  3.64it/s]
 23%|██▎       | 84827/371472 [6:44:42<24:01:59,  3.31it/s]
 23%|██▎       | 84828/371472 [6:44:42<23:19:01,  3.41it/s]
 23%|██▎       | 84829/371472 [6:44:43<23:29:08,  3.39it/s]
 23%|██▎       | 84830/371472 [6:44:43<24:14:05,  3.29it/s]
 23%|██▎       | 84831/371472 [6:44:43<23:45:04,  3.35it/s]
 23%|██▎       | 84832/371472 [6:44:44<23:35:32,  3.37it/s]
 23%|██▎       | 84833/371472 [6:44:44<25:58:03,  3.07it/s]
 23%|██▎       | 84834/371472 [6:44:44<24:35:04,  3.24it/s]
 23%|██▎       | 84835/371472 [6:44:44<23:18:41,  3.42it/s]
 23%|██▎       | 84836/371472 [6:44:45<23:21:50,  3.41it/s]
 23%|██▎       | 84837/371472 [6:44:45<24:50:10,  3.21it/s]
 23%|██▎       | 84838/371472 [6:44:45<23:56:40,  3.33it/s]
 23%|██▎       | 84839/371472 [6:44:46<23:48:39,  3.34it/s]
 23%|██▎       | 84840/371472 [6:44:46<22:51:49,  3.48it/s]
                                                           
{'loss': 3.8433, 'learning_rate': 7.948242797733199e-07, 'epoch': 3.65}

 23%|██▎       | 84840/371472 [6:44:46<22:51:49,  3.48it/s]
 23%|██▎       | 84841/371472 [6:44:46<23:53:07,  3.33it/s]
 23%|██▎       | 84842/371472 [6:44:47<23:04:45,  3.45it/s]
 23%|██▎       | 84843/371472 [6:44:47<22:55:48,  3.47it/s]
 23%|██▎       | 84844/371472 [6:44:47<22:17:43,  3.57it/s]
 23%|██▎       | 84845/371472 [6:44:47<23:48:40,  3.34it/s]
 23%|██▎       | 84846/371472 [6:44:48<24:18:00,  3.28it/s]
 23%|██▎       | 84847/371472 [6:44:48<22:55:19,  3.47it/s]
 23%|██▎       | 84848/371472 [6:44:48<22:50:38,  3.49it/s]
 23%|██▎       | 84849/371472 [6:44:49<23:12:26,  3.43it/s]
 23%|██▎       | 84850/371472 [6:44:49<22:59:03,  3.46it/s]
 23%|██▎       | 84851/371472 [6:44:49<23:46:37,  3.35it/s]
 23%|██▎       | 84852/371472 [6:44:49<24:23:17,  3.26it/s]
 23%|██▎       | 84853/371472 [6:44:50<22:46:00,  3.50it/s]
 23%|██▎       | 84854/371472 [6:44:50<24:42:14,  3.22it/s]
 23%|██▎       | 84855/371472 [6:44:50<23:24:04,  3.40it/s]
 23%|██▎       | 84856/371472 [6:44:51<22:29:23,  3.54it/s]
 23%|██▎       | 84857/371472 [6:44:51<21:58:48,  3.62it/s]
 23%|██▎       | 84858/371472 [6:44:51<21:44:51,  3.66it/s]
 23%|██▎       | 84859/371472 [6:44:51<21:09:32,  3.76it/s]
 23%|██▎       | 84860/371472 [6:44:52<20:26:04,  3.90it/s]
                                                           
{'loss': 4.1787, 'learning_rate': 7.94775797797841e-07, 'epoch': 3.66}

 23%|██▎       | 84860/371472 [6:44:52<20:26:04,  3.90it/s]
 23%|██▎       | 84861/371472 [6:44:52<21:18:17,  3.74it/s]
 23%|██▎       | 84862/371472 [6:44:52<21:00:42,  3.79it/s]
 23%|██▎       | 84863/371472 [6:44:53<23:09:38,  3.44it/s]
 23%|██▎       | 84864/371472 [6:44:53<23:07:48,  3.44it/s]
 23%|██▎       | 84865/371472 [6:44:53<23:29:15,  3.39it/s]
 23%|██▎       | 84866/371472 [6:44:53<22:43:14,  3.50it/s]
 23%|██▎       | 84867/371472 [6:44:54<22:28:28,  3.54it/s]
 23%|██▎       | 84868/371472 [6:44:54<23:18:11,  3.42it/s]
 23%|██▎       | 84869/371472 [6:44:54<22:38:56,  3.52it/s]
 23%|██▎       | 84870/371472 [6:44:54<22:15:48,  3.58it/s]
 23%|██▎       | 84871/371472 [6:44:55<22:48:45,  3.49it/s]
 23%|██▎       | 84872/371472 [6:44:55<22:56:20,  3.47it/s]
 23%|██▎       | 84873/371472 [6:44:55<21:44:05,  3.66it/s]
 23%|██▎       | 84874/371472 [6:44:56<21:29:03,  3.71it/s]
 23%|██▎       | 84875/371472 [6:44:56<21:07:06,  3.77it/s]
 23%|██▎       | 84876/371472 [6:44:56<21:52:47,  3.64it/s]
 23%|██▎       | 84877/371472 [6:44:56<21:25:36,  3.72it/s]
 23%|██▎       | 84878/371472 [6:44:57<22:19:34,  3.57it/s]
 23%|██▎       | 84879/371472 [6:44:57<21:40:30,  3.67it/s]
 23%|██▎       | 84880/371472 [6:44:57<21:49:17,  3.65it/s]
                                                           
{'loss': 3.6115, 'learning_rate': 7.947273158223619e-07, 'epoch': 3.66}

 23%|██▎       | 84880/371472 [6:44:57<21:49:17,  3.65it/s]
 23%|██▎       | 84881/371472 [6:44:57<21:28:49,  3.71it/s]
 23%|██▎       | 84882/371472 [6:44:58<21:15:57,  3.74it/s]
 23%|██▎       | 84883/371472 [6:44:58<21:26:02,  3.71it/s]
 23%|██▎       | 84884/371472 [6:44:58<21:42:59,  3.67it/s]
 23%|██▎       | 84885/371472 [6:44:59<21:19:41,  3.73it/s]
 23%|██▎       | 84886/371472 [6:44:59<20:34:10,  3.87it/s]
 23%|██▎       | 84887/371472 [6:44:59<20:51:49,  3.82it/s]
 23%|██▎       | 84888/371472 [6:44:59<20:42:44,  3.84it/s]
 23%|██▎       | 84889/371472 [6:45:00<20:50:20,  3.82it/s]
 23%|██▎       | 84890/371472 [6:45:00<21:23:09,  3.72it/s]
 23%|██▎       | 84891/371472 [6:45:00<21:55:10,  3.63it/s]
 23%|██▎       | 84892/371472 [6:45:00<22:15:26,  3.58it/s]
 23%|██▎       | 84893/371472 [6:45:01<21:46:47,  3.66it/s]
 23%|██▎       | 84894/371472 [6:45:01<21:23:31,  3.72it/s]
 23%|██▎       | 84895/371472 [6:45:01<21:21:03,  3.73it/s]
 23%|██▎       | 84896/371472 [6:45:02<21:39:54,  3.67it/s]
 23%|██▎       | 84897/371472 [6:45:02<21:21:02,  3.73it/s]
 23%|██▎       | 84898/371472 [6:45:02<22:34:27,  3.53it/s]
 23%|██▎       | 84899/371472 [6:45:02<22:01:29,  3.61it/s]
 23%|██▎       | 84900/371472 [6:45:03<21:01:20,  3.79it/s]
                                                           
{'loss': 4.1178, 'learning_rate': 7.946788338468831e-07, 'epoch': 3.66}

 23%|██▎       | 84900/371472 [6:45:03<21:01:20,  3.79it/s]
 23%|██▎       | 84901/371472 [6:45:03<22:07:00,  3.60it/s]
 23%|██▎       | 84902/371472 [6:45:03<22:26:42,  3.55it/s]
 23%|██▎       | 84903/371472 [6:45:03<22:32:26,  3.53it/s]
 23%|██▎       | 84904/371472 [6:45:04<22:08:12,  3.60it/s]
 23%|██▎       | 84905/371472 [6:45:04<21:21:19,  3.73it/s]
 23%|██▎       | 84906/371472 [6:45:04<22:45:05,  3.50it/s]
 23%|██▎       | 84907/371472 [6:45:05<22:30:14,  3.54it/s]
 23%|██▎       | 84908/371472 [6:45:05<22:56:33,  3.47it/s]
 23%|██▎       | 84909/371472 [6:45:05<22:01:04,  3.62it/s]
 23%|██▎       | 84910/371472 [6:45:05<22:00:14,  3.62it/s]
 23%|██▎       | 84911/371472 [6:45:06<21:28:26,  3.71it/s]
 23%|██▎       | 84912/371472 [6:45:06<21:36:20,  3.68it/s]
 23%|██▎       | 84913/371472 [6:45:06<21:27:46,  3.71it/s]
 23%|██▎       | 84914/371472 [6:45:07<21:36:11,  3.68it/s]
 23%|██▎       | 84915/371472 [6:45:07<22:10:27,  3.59it/s]
 23%|██▎       | 84916/371472 [6:45:07<22:15:29,  3.58it/s]
 23%|██▎       | 84917/371472 [6:45:07<21:26:56,  3.71it/s]
 23%|██▎       | 84918/371472 [6:45:08<22:05:41,  3.60it/s]
 23%|██▎       | 84919/371472 [6:45:08<22:35:13,  3.52it/s]
 23%|██▎       | 84920/371472 [6:45:08<22:21:08,  3.56it/s]
                                                           
{'loss': 4.0226, 'learning_rate': 7.946303518714042e-07, 'epoch': 3.66}

 23%|██▎       | 84920/371472 [6:45:08<22:21:08,  3.56it/s]
 23%|██▎       | 84921/371472 [6:45:08<22:25:46,  3.55it/s]
 23%|██▎       | 84922/371472 [6:45:09<22:00:53,  3.62it/s]
 23%|██▎       | 84923/371472 [6:45:09<21:51:40,  3.64it/s]
 23%|██▎       | 84924/371472 [6:45:09<21:34:00,  3.69it/s]
 23%|██▎       | 84925/371472 [6:45:10<21:13:07,  3.75it/s]
 23%|██▎       | 84926/371472 [6:45:10<21:12:05,  3.75it/s]
 23%|██▎       | 84927/371472 [6:45:10<21:54:23,  3.63it/s]
 23%|██▎       | 84928/371472 [6:45:10<22:02:29,  3.61it/s]
 23%|██▎       | 84929/371472 [6:45:11<21:23:02,  3.72it/s]
 23%|██▎       | 84930/371472 [6:45:11<21:30:41,  3.70it/s]
 23%|██▎       | 84931/371472 [6:45:11<20:57:50,  3.80it/s]
 23%|██▎       | 84932/371472 [6:45:11<21:43:09,  3.66it/s]
 23%|██▎       | 84933/371472 [6:45:12<23:39:07,  3.37it/s]
 23%|██▎       | 84934/371472 [6:45:12<22:55:37,  3.47it/s]
 23%|██▎       | 84935/371472 [6:45:12<22:57:11,  3.47it/s]
 23%|██▎       | 84936/371472 [6:45:13<22:32:47,  3.53it/s]
 23%|██▎       | 84937/371472 [6:45:13<22:07:15,  3.60it/s]
 23%|██▎       | 84938/371472 [6:45:13<21:24:51,  3.72it/s]
 23%|██▎       | 84939/371472 [6:45:13<21:19:53,  3.73it/s]
 23%|██▎       | 84940/371472 [6:45:14<24:24:37,  3.26it/s]
                                                           
{'loss': 4.1416, 'learning_rate': 7.945818698959253e-07, 'epoch': 3.66}

 23%|██▎       | 84940/371472 [6:45:14<24:24:37,  3.26it/s]
 23%|██▎       | 84941/371472 [6:45:14<23:56:13,  3.33it/s]
 23%|██▎       | 84942/371472 [6:45:14<23:09:45,  3.44it/s]
 23%|██▎       | 84943/371472 [6:45:15<23:48:00,  3.34it/s]
 23%|██▎       | 84944/371472 [6:45:15<22:33:59,  3.53it/s]
 23%|██▎       | 84945/371472 [6:45:15<21:37:44,  3.68it/s]
 23%|██▎       | 84946/371472 [6:45:15<23:05:55,  3.45it/s]
 23%|██▎       | 84947/371472 [6:45:16<21:38:52,  3.68it/s]
 23%|██▎       | 84948/371472 [6:45:16<21:08:25,  3.76it/s]
 23%|██▎       | 84949/371472 [6:45:16<20:52:16,  3.81it/s]
 23%|██▎       | 84950/371472 [6:45:16<20:57:27,  3.80it/s]
 23%|██▎       | 84951/371472 [6:45:17<24:11:28,  3.29it/s]
 23%|██▎       | 84952/371472 [6:45:17<23:37:24,  3.37it/s]
 23%|██▎       | 84953/371472 [6:45:17<22:58:35,  3.46it/s]
 23%|██▎       | 84954/371472 [6:45:18<23:12:07,  3.43it/s]
 23%|██▎       | 84955/371472 [6:45:18<22:26:06,  3.55it/s]
 23%|██▎       | 84956/371472 [6:45:18<23:26:33,  3.40it/s]
 23%|██▎       | 84957/371472 [6:45:19<23:33:15,  3.38it/s]
 23%|██▎       | 84958/371472 [6:45:19<24:33:29,  3.24it/s]
 23%|██▎       | 84959/371472 [6:45:19<25:28:30,  3.12it/s]
 23%|██▎       | 84960/371472 [6:45:20<24:24:14,  3.26it/s]
                                                           
{'loss': 3.9804, 'learning_rate': 7.945333879204464e-07, 'epoch': 3.66}

 23%|██▎       | 84960/371472 [6:45:20<24:24:14,  3.26it/s]
 23%|██▎       | 84961/371472 [6:45:20<22:55:30,  3.47it/s]
 23%|██▎       | 84962/371472 [6:45:20<22:17:17,  3.57it/s]
 23%|██▎       | 84963/371472 [6:45:20<23:27:32,  3.39it/s]
 23%|██▎       | 84964/371472 [6:45:21<22:22:57,  3.56it/s]
 23%|██▎       | 84965/371472 [6:45:21<21:57:37,  3.62it/s]
 23%|██▎       | 84966/371472 [6:45:21<22:00:12,  3.62it/s]
 23%|██▎       | 84967/371472 [6:45:22<22:47:14,  3.49it/s]
 23%|██▎       | 84968/371472 [6:45:22<22:31:02,  3.53it/s]
 23%|██▎       | 84969/371472 [6:45:22<21:46:35,  3.65it/s]
 23%|██▎       | 84970/371472 [6:45:22<21:57:06,  3.63it/s]
 23%|██▎       | 84971/371472 [6:45:23<22:07:52,  3.60it/s]
 23%|██▎       | 84972/371472 [6:45:23<22:00:33,  3.62it/s]
 23%|██▎       | 84973/371472 [6:45:23<21:40:11,  3.67it/s]
 23%|██▎       | 84974/371472 [6:45:23<22:16:50,  3.57it/s]
 23%|██▎       | 84975/371472 [6:45:24<22:51:56,  3.48it/s]
 23%|██▎       | 84976/371472 [6:45:24<24:40:47,  3.22it/s]
 23%|██▎       | 84977/371472 [6:45:24<23:57:15,  3.32it/s]
 23%|██▎       | 84978/371472 [6:45:25<23:38:44,  3.37it/s]
 23%|██▎       | 84979/371472 [6:45:25<22:52:48,  3.48it/s]
 23%|██▎       | 84980/371472 [6:45:25<22:24:09,  3.55it/s]
                                                           
{'loss': 4.0505, 'learning_rate': 7.944849059449676e-07, 'epoch': 3.66}

 23%|██▎       | 84980/371472 [6:45:25<22:24:09,  3.55it/s]
 23%|██▎       | 84981/371472 [6:45:25<22:18:41,  3.57it/s]
 23%|██▎       | 84982/371472 [6:45:26<22:03:18,  3.61it/s]
 23%|██▎       | 84983/371472 [6:45:26<22:02:04,  3.61it/s]
 23%|██▎       | 84984/371472 [6:45:26<21:54:38,  3.63it/s]
 23%|██▎       | 84985/371472 [6:45:27<21:55:44,  3.63it/s]
 23%|██▎       | 84986/371472 [6:45:27<22:05:33,  3.60it/s]
 23%|██▎       | 84987/371472 [6:45:27<22:16:41,  3.57it/s]
 23%|██▎       | 84988/371472 [6:45:27<22:12:34,  3.58it/s]
 23%|██▎       | 84989/371472 [6:45:28<21:45:33,  3.66it/s]
 23%|██▎       | 84990/371472 [6:45:28<23:11:23,  3.43it/s]
 23%|██▎       | 84991/371472 [6:45:28<23:10:56,  3.43it/s]
 23%|██▎       | 84992/371472 [6:45:29<23:03:11,  3.45it/s]
 23%|██▎       | 84993/371472 [6:45:29<25:32:31,  3.12it/s]
 23%|██▎       | 84994/371472 [6:45:29<24:52:22,  3.20it/s]
 23%|██▎       | 84995/371472 [6:45:30<24:11:40,  3.29it/s]
 23%|██▎       | 84996/371472 [6:45:30<23:24:43,  3.40it/s]
 23%|██▎       | 84997/371472 [6:45:30<22:19:39,  3.56it/s]
 23%|██▎       | 84998/371472 [6:45:30<24:50:06,  3.20it/s]
 23%|██▎       | 84999/371472 [6:45:31<23:59:17,  3.32it/s]
 23%|██▎       | 85000/371472 [6:45:31<24:48:08,  3.21it/s]
                                                           
{'loss': 3.7466, 'learning_rate': 7.944364239694886e-07, 'epoch': 3.66}

 23%|██▎       | 85000/371472 [6:45:31<24:48:08,  3.21it/s]
 23%|██▎       | 85001/371472 [6:45:31<23:00:52,  3.46it/s]
 23%|██▎       | 85002/371472 [6:45:32<22:25:32,  3.55it/s]
 23%|██▎       | 85003/371472 [6:45:32<23:14:20,  3.42it/s]
 23%|██▎       | 85004/371472 [6:45:32<23:04:22,  3.45it/s]
 23%|██▎       | 85005/371472 [6:45:32<23:06:42,  3.44it/s]
 23%|██▎       | 85006/371472 [6:45:33<22:04:36,  3.60it/s]
 23%|██▎       | 85007/371472 [6:45:33<21:24:11,  3.72it/s]
 23%|██▎       | 85008/371472 [6:45:33<21:13:04,  3.75it/s]
 23%|██▎       | 85009/371472 [6:45:34<21:30:09,  3.70it/s]
 23%|██▎       | 85010/371472 [6:45:34<21:23:18,  3.72it/s]
 23%|██▎       | 85011/371472 [6:45:34<22:54:56,  3.47it/s]
 23%|██▎       | 85012/371472 [6:45:34<24:14:11,  3.28it/s]
 23%|██▎       | 85013/371472 [6:45:35<23:33:39,  3.38it/s]
 23%|██▎       | 85014/371472 [6:45:35<22:56:35,  3.47it/s]
 23%|██▎       | 85015/371472 [6:45:35<22:48:09,  3.49it/s]
 23%|██▎       | 85016/371472 [6:45:36<23:06:04,  3.44it/s]
 23%|██▎       | 85017/371472 [6:45:36<22:21:09,  3.56it/s]
 23%|██▎       | 85018/371472 [6:45:36<22:15:18,  3.58it/s]
 23%|██▎       | 85019/371472 [6:45:36<21:37:01,  3.68it/s]
 23%|██▎       | 85020/371472 [6:45:37<21:38:01,  3.68it/s]
                                                           
{'loss': 3.9504, 'learning_rate': 7.943879419940097e-07, 'epoch': 3.66}

 23%|██▎       | 85020/371472 [6:45:37<21:38:01,  3.68it/s]
 23%|██▎       | 85021/371472 [6:45:37<23:40:31,  3.36it/s]
 23%|██▎       | 85022/371472 [6:45:37<23:13:36,  3.43it/s]
 23%|██▎       | 85023/371472 [6:45:38<22:02:19,  3.61it/s]
 23%|██▎       | 85024/371472 [6:45:38<21:07:06,  3.77it/s]
 23%|██▎       | 85025/371472 [6:45:38<21:59:07,  3.62it/s]
 23%|██▎       | 85026/371472 [6:45:38<22:51:40,  3.48it/s]
 23%|██▎       | 85027/371472 [6:45:39<23:32:48,  3.38it/s]
 23%|██▎       | 85028/371472 [6:45:39<24:20:26,  3.27it/s]
 23%|██▎       | 85029/371472 [6:45:39<24:19:36,  3.27it/s]
 23%|██▎       | 85030/371472 [6:45:40<23:10:28,  3.43it/s]
 23%|██▎       | 85031/371472 [6:45:40<22:50:48,  3.48it/s]
 23%|██▎       | 85032/371472 [6:45:40<21:48:01,  3.65it/s]
 23%|██▎       | 85033/371472 [6:45:40<22:36:39,  3.52it/s]
 23%|██▎       | 85034/371472 [6:45:41<22:13:36,  3.58it/s]
 23%|██▎       | 85035/371472 [6:45:41<22:22:24,  3.56it/s]
 23%|██▎       | 85036/371472 [6:45:41<22:02:03,  3.61it/s]
 23%|██▎       | 85037/371472 [6:45:42<21:47:26,  3.65it/s]
 23%|██▎       | 85038/371472 [6:45:42<21:40:07,  3.67it/s]
 23%|██▎       | 85039/371472 [6:45:42<21:26:24,  3.71it/s]
 23%|██▎       | 85040/371472 [6:45:42<23:03:12,  3.45it/s]
                                                           
{'loss': 4.1651, 'learning_rate': 7.943394600185308e-07, 'epoch': 3.66}

 23%|██▎       | 85040/371472 [6:45:42<23:03:12,  3.45it/s]
 23%|██▎       | 85041/371472 [6:45:43<22:27:01,  3.54it/s]
 23%|██▎       | 85042/371472 [6:45:43<21:57:20,  3.62it/s]
 23%|██▎       | 85043/371472 [6:45:43<21:35:26,  3.69it/s]
 23%|██▎       | 85044/371472 [6:45:43<22:11:18,  3.59it/s]
 23%|██▎       | 85045/371472 [6:45:44<22:10:23,  3.59it/s]
 23%|██▎       | 85046/371472 [6:45:44<22:21:30,  3.56it/s]
 23%|██▎       | 85047/371472 [6:45:44<21:38:51,  3.68it/s]
 23%|██▎       | 85048/371472 [6:45:45<21:15:54,  3.74it/s]
 23%|██▎       | 85049/371472 [6:45:45<22:29:31,  3.54it/s]
 23%|██▎       | 85050/371472 [6:45:45<22:11:38,  3.58it/s]
 23%|██▎       | 85051/371472 [6:45:45<22:24:54,  3.55it/s]
 23%|██▎       | 85052/371472 [6:45:46<23:10:01,  3.43it/s]
 23%|██▎       | 85053/371472 [6:45:46<22:52:44,  3.48it/s]
 23%|██▎       | 85054/371472 [6:45:46<23:26:51,  3.39it/s]
 23%|██▎       | 85055/371472 [6:45:47<23:01:35,  3.46it/s]
 23%|██▎       | 85056/371472 [6:45:47<22:24:08,  3.55it/s]
 23%|██▎       | 85057/371472 [6:45:47<23:34:54,  3.37it/s]
 23%|██▎       | 85058/371472 [6:45:47<23:43:56,  3.35it/s]
 23%|██▎       | 85059/371472 [6:45:48<23:11:28,  3.43it/s]
 23%|██▎       | 85060/371472 [6:45:48<22:05:17,  3.60it/s]
                                                           
{'loss': 4.0615, 'learning_rate': 7.94290978043052e-07, 'epoch': 3.66}

 23%|██▎       | 85060/371472 [6:45:48<22:05:17,  3.60it/s]
 23%|██▎       | 85061/371472 [6:45:48<22:13:24,  3.58it/s]
 23%|██▎       | 85062/371472 [6:45:49<22:03:33,  3.61it/s]
 23%|██▎       | 85063/371472 [6:45:49<22:51:34,  3.48it/s]
 23%|██▎       | 85064/371472 [6:45:49<23:04:50,  3.45it/s]
 23%|██▎       | 85065/371472 [6:45:49<22:17:06,  3.57it/s]
 23%|██▎       | 85066/371472 [6:45:50<25:01:00,  3.18it/s]
 23%|██▎       | 85067/371472 [6:45:50<26:33:52,  2.99it/s]
 23%|██▎       | 85068/371472 [6:45:51<27:41:19,  2.87it/s]
 23%|██▎       | 85069/371472 [6:45:51<26:15:47,  3.03it/s]
 23%|██▎       | 85070/371472 [6:45:51<24:52:26,  3.20it/s]
 23%|██▎       | 85071/371472 [6:45:51<24:09:45,  3.29it/s]
 23%|██▎       | 85072/371472 [6:45:52<23:27:42,  3.39it/s]
 23%|██▎       | 85073/371472 [6:45:52<22:21:50,  3.56it/s]
 23%|██▎       | 85074/371472 [6:45:52<21:41:06,  3.67it/s]
 23%|██▎       | 85075/371472 [6:45:52<21:09:44,  3.76it/s]
 23%|██▎       | 85076/371472 [6:45:53<23:18:02,  3.41it/s]
 23%|██▎       | 85077/371472 [6:45:53<23:00:46,  3.46it/s]
 23%|██▎       | 85078/371472 [6:45:53<22:11:27,  3.58it/s]
 23%|██▎       | 85079/371472 [6:45:54<21:31:04,  3.70it/s]
 23%|██▎       | 85080/371472 [6:45:54<21:18:53,  3.73it/s]
                                                           
{'loss': 3.938, 'learning_rate': 7.942424960675731e-07, 'epoch': 3.66}

 23%|██▎       | 85080/371472 [6:45:54<21:18:53,  3.73it/s]
 23%|██▎       | 85081/371472 [6:45:54<22:26:25,  3.55it/s]
 23%|██▎       | 85082/371472 [6:45:54<22:28:14,  3.54it/s]
 23%|██▎       | 85083/371472 [6:45:55<23:26:30,  3.39it/s]
 23%|██▎       | 85084/371472 [6:45:55<25:01:58,  3.18it/s]
 23%|██▎       | 85085/371472 [6:45:55<23:22:14,  3.40it/s]
 23%|██▎       | 85086/371472 [6:45:56<22:11:15,  3.59it/s]
 23%|██▎       | 85087/371472 [6:45:56<23:03:28,  3.45it/s]
 23%|██▎       | 85088/371472 [6:45:56<22:41:23,  3.51it/s]
 23%|██▎       | 85089/371472 [6:45:57<23:18:45,  3.41it/s]
 23%|██▎       | 85090/371472 [6:45:57<23:05:38,  3.44it/s]
 23%|██▎       | 85091/371472 [6:45:57<22:46:05,  3.49it/s]
 23%|██▎       | 85092/371472 [6:45:57<23:24:53,  3.40it/s]
 23%|██▎       | 85093/371472 [6:45:58<22:54:16,  3.47it/s]
 23%|██▎       | 85094/371472 [6:45:58<22:45:25,  3.50it/s]
 23%|██▎       | 85095/371472 [6:45:58<22:36:52,  3.52it/s]
 23%|██▎       | 85096/371472 [6:45:59<22:55:05,  3.47it/s]
 23%|██▎       | 85097/371472 [6:45:59<22:53:53,  3.47it/s]
 23%|██▎       | 85098/371472 [6:45:59<23:33:54,  3.38it/s]
 23%|██▎       | 85099/371472 [6:45:59<24:07:39,  3.30it/s]
 23%|██▎       | 85100/371472 [6:46:00<23:52:11,  3.33it/s]
                                                           
{'loss': 3.7943, 'learning_rate': 7.941940140920942e-07, 'epoch': 3.67}

 23%|██▎       | 85100/371472 [6:46:00<23:52:11,  3.33it/s]
 23%|██▎       | 85101/371472 [6:46:00<22:55:42,  3.47it/s]
 23%|██▎       | 85102/371472 [6:46:00<22:00:27,  3.61it/s]
 23%|██▎       | 85103/371472 [6:46:01<22:10:34,  3.59it/s]
 23%|██▎       | 85104/371472 [6:46:01<22:12:57,  3.58it/s]
 23%|██▎       | 85105/371472 [6:46:01<22:48:28,  3.49it/s]
 23%|██▎       | 85106/371472 [6:46:01<22:28:20,  3.54it/s]
 23%|██▎       | 85107/371472 [6:46:02<21:56:38,  3.62it/s]
 23%|██▎       | 85108/371472 [6:46:02<21:27:50,  3.71it/s]
 23%|██▎       | 85109/371472 [6:46:02<22:54:22,  3.47it/s]
 23%|██▎       | 85110/371472 [6:46:03<22:26:35,  3.54it/s]
 23%|██▎       | 85111/371472 [6:46:03<21:56:41,  3.62it/s]
 23%|██▎       | 85112/371472 [6:46:03<21:42:53,  3.66it/s]
 23%|██▎       | 85113/371472 [6:46:03<22:23:45,  3.55it/s]
 23%|██▎       | 85114/371472 [6:46:04<22:33:48,  3.53it/s]
 23%|██▎       | 85115/371472 [6:46:04<21:35:35,  3.68it/s]
 23%|██▎       | 85116/371472 [6:46:04<21:54:48,  3.63it/s]
 23%|██▎       | 85117/371472 [6:46:04<20:57:00,  3.80it/s]
 23%|██▎       | 85118/371472 [6:46:05<20:52:08,  3.81it/s]
 23%|██▎       | 85119/371472 [6:46:05<20:37:09,  3.86it/s]
 23%|██▎       | 85120/371472 [6:46:05<21:37:43,  3.68it/s]
                                                           
{'loss': 4.0416, 'learning_rate': 7.941455321166153e-07, 'epoch': 3.67}

 23%|██▎       | 85120/371472 [6:46:05<21:37:43,  3.68it/s]
 23%|██▎       | 85121/371472 [6:46:05<21:22:41,  3.72it/s]
 23%|██▎       | 85122/371472 [6:46:06<22:09:34,  3.59it/s]
 23%|██▎       | 85123/371472 [6:46:06<22:42:52,  3.50it/s]
 23%|██▎       | 85124/371472 [6:46:06<22:38:42,  3.51it/s]
 23%|██▎       | 85125/371472 [6:46:07<22:24:09,  3.55it/s]
 23%|██▎       | 85126/371472 [6:46:07<22:25:24,  3.55it/s]
 23%|██▎       | 85127/371472 [6:46:07<22:08:05,  3.59it/s]
 23%|██▎       | 85128/371472 [6:46:08<23:39:02,  3.36it/s]
 23%|██▎       | 85129/371472 [6:46:08<24:24:24,  3.26it/s]
 23%|██▎       | 85130/371472 [6:46:08<25:16:33,  3.15it/s]
 23%|██▎       | 85131/371472 [6:46:08<24:12:15,  3.29it/s]
 23%|██▎       | 85132/371472 [6:46:09<23:50:08,  3.34it/s]
 23%|██▎       | 85133/371472 [6:46:09<22:57:46,  3.46it/s]
 23%|██▎       | 85134/371472 [6:46:09<22:50:55,  3.48it/s]
 23%|██▎       | 85135/371472 [6:46:10<22:16:25,  3.57it/s]
 23%|██▎       | 85136/371472 [6:46:10<22:10:48,  3.59it/s]
 23%|██▎       | 85137/371472 [6:46:10<23:30:56,  3.38it/s]
 23%|██▎       | 85138/371472 [6:46:10<23:22:26,  3.40it/s]
 23%|██▎       | 85139/371472 [6:46:11<23:07:05,  3.44it/s]
 23%|██▎       | 85140/371472 [6:46:11<23:27:57,  3.39it/s]
                                                           
{'loss': 3.9876, 'learning_rate': 7.940970501411364e-07, 'epoch': 3.67}

 23%|██▎       | 85140/371472 [6:46:11<23:27:57,  3.39it/s]
 23%|██▎       | 85141/371472 [6:46:11<23:11:52,  3.43it/s]
 23%|██▎       | 85142/371472 [6:46:12<24:47:13,  3.21it/s]
 23%|██▎       | 85143/371472 [6:46:12<23:21:14,  3.41it/s]
 23%|██▎       | 85144/371472 [6:46:12<22:04:45,  3.60it/s]
 23%|██▎       | 85145/371472 [6:46:12<21:26:51,  3.71it/s]
 23%|██▎       | 85146/371472 [6:46:13<22:08:30,  3.59it/s]
 23%|██▎       | 85147/371472 [6:46:13<21:23:57,  3.72it/s]
 23%|██▎       | 85148/371472 [6:46:13<21:39:57,  3.67it/s]
 23%|██▎       | 85149/371472 [6:46:14<21:19:44,  3.73it/s]
 23%|██▎       | 85150/371472 [6:46:14<21:51:54,  3.64it/s]
 23%|██▎       | 85151/371472 [6:46:14<21:17:03,  3.74it/s]
 23%|██▎       | 85152/371472 [6:46:14<21:44:34,  3.66it/s]
 23%|██▎       | 85153/371472 [6:46:15<21:09:07,  3.76it/s]
 23%|██▎       | 85154/371472 [6:46:15<21:24:01,  3.72it/s]
 23%|██▎       | 85155/371472 [6:46:15<21:37:51,  3.68it/s]
 23%|██▎       | 85156/371472 [6:46:15<22:26:14,  3.54it/s]
 23%|██▎       | 85157/371472 [6:46:16<22:37:37,  3.51it/s]
 23%|██▎       | 85158/371472 [6:46:16<22:55:34,  3.47it/s]
 23%|██▎       | 85159/371472 [6:46:16<22:17:54,  3.57it/s]
 23%|██▎       | 85160/371472 [6:46:17<22:29:07,  3.54it/s]
                                                           
{'loss': 3.9365, 'learning_rate': 7.940485681656574e-07, 'epoch': 3.67}

 23%|██▎       | 85160/371472 [6:46:17<22:29:07,  3.54it/s]
 23%|██▎       | 85161/371472 [6:46:17<22:15:52,  3.57it/s]
 23%|██▎       | 85162/371472 [6:46:17<22:36:45,  3.52it/s]
 23%|██▎       | 85163/371472 [6:46:17<21:22:59,  3.72it/s]
 23%|██▎       | 85164/371472 [6:46:18<21:43:21,  3.66it/s]
 23%|██▎       | 85165/371472 [6:46:18<21:29:06,  3.70it/s]
 23%|██▎       | 85166/371472 [6:46:18<22:44:09,  3.50it/s]
 23%|██▎       | 85167/371472 [6:46:19<21:53:07,  3.63it/s]
 23%|██▎       | 85168/371472 [6:46:19<22:57:03,  3.47it/s]
 23%|██▎       | 85169/371472 [6:46:19<23:32:45,  3.38it/s]
 23%|██▎       | 85170/371472 [6:46:19<23:35:58,  3.37it/s]
 23%|██▎       | 85171/371472 [6:46:20<23:15:12,  3.42it/s]
 23%|██▎       | 85172/371472 [6:46:20<22:39:39,  3.51it/s]
 23%|██▎       | 85173/371472 [6:46:20<22:33:54,  3.52it/s]
 23%|██▎       | 85174/371472 [6:46:21<22:20:20,  3.56it/s]
 23%|██▎       | 85175/371472 [6:46:21<22:08:42,  3.59it/s]
 23%|██▎       | 85176/371472 [6:46:21<23:58:55,  3.32it/s]
 23%|██▎       | 85177/371472 [6:46:21<23:07:16,  3.44it/s]
 23%|██▎       | 85178/371472 [6:46:22<22:27:56,  3.54it/s]
 23%|██▎       | 85179/371472 [6:46:22<21:41:54,  3.67it/s]
 23%|██▎       | 85180/371472 [6:46:22<21:34:19,  3.69it/s]
                                                           
{'loss': 3.9608, 'learning_rate': 7.940000861901785e-07, 'epoch': 3.67}

 23%|██▎       | 85180/371472 [6:46:22<21:34:19,  3.69it/s]
 23%|██▎       | 85181/371472 [6:46:23<24:47:52,  3.21it/s]
 23%|██▎       | 85182/371472 [6:46:23<24:36:20,  3.23it/s]
 23%|██▎       | 85183/371472 [6:46:23<25:16:02,  3.15it/s]
 23%|██▎       | 85184/371472 [6:46:24<26:29:42,  3.00it/s]
 23%|██▎       | 85185/371472 [6:46:24<24:56:21,  3.19it/s]
 23%|██▎       | 85186/371472 [6:46:24<23:52:07,  3.33it/s]
 23%|██▎       | 85187/371472 [6:46:24<22:55:24,  3.47it/s]
 23%|██▎       | 85188/371472 [6:46:25<24:35:03,  3.23it/s]
 23%|██▎       | 85189/371472 [6:46:25<23:48:44,  3.34it/s]
 23%|██▎       | 85190/371472 [6:46:25<23:22:39,  3.40it/s]
 23%|██▎       | 85191/371472 [6:46:26<23:01:02,  3.45it/s]
 23%|██▎       | 85192/371472 [6:46:26<22:14:41,  3.57it/s]
 23%|██▎       | 85193/371472 [6:46:26<22:08:07,  3.59it/s]
 23%|██▎       | 85194/371472 [6:46:26<22:35:41,  3.52it/s]
 23%|██▎       | 85195/371472 [6:46:27<22:20:11,  3.56it/s]
 23%|██▎       | 85196/371472 [6:46:27<21:55:01,  3.63it/s]
 23%|██▎       | 85197/371472 [6:46:27<23:47:45,  3.34it/s]
 23%|██▎       | 85198/371472 [6:46:28<24:19:51,  3.27it/s]
 23%|██▎       | 85199/371472 [6:46:28<23:50:32,  3.34it/s]
 23%|██▎       | 85200/371472 [6:46:28<24:31:36,  3.24it/s]
                                                           
{'loss': 3.8254, 'learning_rate': 7.939516042146996e-07, 'epoch': 3.67}

 23%|██▎       | 85200/371472 [6:46:28<24:31:36,  3.24it/s]
 23%|██▎       | 85201/371472 [6:46:29<23:55:25,  3.32it/s]
 23%|██▎       | 85202/371472 [6:46:29<22:34:42,  3.52it/s]
 23%|██▎       | 85203/371472 [6:46:29<22:53:41,  3.47it/s]
 23%|██▎       | 85204/371472 [6:46:29<23:06:56,  3.44it/s]
 23%|██▎       | 85205/371472 [6:46:30<22:56:00,  3.47it/s]
 23%|██▎       | 85206/371472 [6:46:30<22:55:16,  3.47it/s]
 23%|██▎       | 85207/371472 [6:46:30<22:28:05,  3.54it/s]
 23%|██▎       | 85208/371472 [6:46:31<21:47:57,  3.65it/s]
 23%|██▎       | 85209/371472 [6:46:31<22:22:29,  3.55it/s]
 23%|██▎       | 85210/371472 [6:46:31<22:44:24,  3.50it/s]
 23%|██▎       | 85211/371472 [6:46:31<22:36:39,  3.52it/s]
 23%|██▎       | 85212/371472 [6:46:32<22:45:58,  3.49it/s]
 23%|██▎       | 85213/371472 [6:46:32<24:33:05,  3.24it/s]
 23%|██▎       | 85214/371472 [6:46:32<24:25:24,  3.26it/s]
 23%|██▎       | 85215/371472 [6:46:33<28:23:51,  2.80it/s]
 23%|██▎       | 85216/371472 [6:46:33<26:17:27,  3.02it/s]
 23%|██▎       | 85217/371472 [6:46:33<26:43:56,  2.97it/s]
 23%|██▎       | 85218/371472 [6:46:34<25:19:11,  3.14it/s]
 23%|██▎       | 85219/371472 [6:46:34<24:23:21,  3.26it/s]
 23%|██▎       | 85220/371472 [6:46:34<24:45:42,  3.21it/s]
                                                           
{'loss': 3.8515, 'learning_rate': 7.939031222392209e-07, 'epoch': 3.67}

 23%|██▎       | 85220/371472 [6:46:34<24:45:42,  3.21it/s]
 23%|██▎       | 85221/371472 [6:46:35<24:28:37,  3.25it/s]
 23%|██▎       | 85222/371472 [6:46:35<23:39:22,  3.36it/s]
 23%|██▎       | 85223/371472 [6:46:35<23:17:59,  3.41it/s]
 23%|██▎       | 85224/371472 [6:46:35<23:45:54,  3.35it/s]
 23%|██▎       | 85225/371472 [6:46:36<22:57:52,  3.46it/s]
 23%|██▎       | 85226/371472 [6:46:36<22:42:19,  3.50it/s]
 23%|██▎       | 85227/371472 [6:46:36<22:15:26,  3.57it/s]
 23%|██▎       | 85228/371472 [6:46:37<22:43:49,  3.50it/s]
 23%|██▎       | 85229/371472 [6:46:37<23:02:53,  3.45it/s]
 23%|██▎       | 85230/371472 [6:46:37<24:56:28,  3.19it/s]
 23%|██▎       | 85231/371472 [6:46:38<25:06:13,  3.17it/s]
 23%|██▎       | 85232/371472 [6:46:38<24:14:43,  3.28it/s]
 23%|██▎       | 85233/371472 [6:46:38<23:10:37,  3.43it/s]
 23%|██▎       | 85234/371472 [6:46:38<23:45:22,  3.35it/s]
 23%|██▎       | 85235/371472 [6:46:39<22:45:28,  3.49it/s]
 23%|██▎       | 85236/371472 [6:46:39<23:40:51,  3.36it/s]
 23%|██▎       | 85237/371472 [6:46:39<23:54:33,  3.33it/s]
 23%|██▎       | 85238/371472 [6:46:40<23:00:23,  3.46it/s]
 23%|██▎       | 85239/371472 [6:46:40<23:04:51,  3.44it/s]
 23%|██▎       | 85240/371472 [6:46:40<22:16:22,  3.57it/s]
                                                           
{'loss': 4.2451, 'learning_rate': 7.93854640263742e-07, 'epoch': 3.67}

 23%|██▎       | 85240/371472 [6:46:40<22:16:22,  3.57it/s]
 23%|██▎       | 85241/371472 [6:46:40<21:28:17,  3.70it/s]
 23%|██▎       | 85242/371472 [6:46:41<22:18:49,  3.56it/s]
 23%|██▎       | 85243/371472 [6:46:41<22:02:40,  3.61it/s]
 23%|██▎       | 85244/371472 [6:46:41<23:05:53,  3.44it/s]
 23%|██▎       | 85245/371472 [6:46:42<23:23:33,  3.40it/s]
 23%|██▎       | 85246/371472 [6:46:42<24:47:00,  3.21it/s]
 23%|██▎       | 85247/371472 [6:46:42<24:10:15,  3.29it/s]
 23%|██▎       | 85248/371472 [6:46:43<23:50:18,  3.34it/s]
 23%|██▎       | 85249/371472 [6:46:43<24:26:59,  3.25it/s]
 23%|██▎       | 85250/371472 [6:46:43<23:28:18,  3.39it/s]
 23%|██▎       | 85251/371472 [6:46:43<25:42:12,  3.09it/s]
 23%|██▎       | 85252/371472 [6:46:44<23:49:27,  3.34it/s]
 23%|██▎       | 85253/371472 [6:46:44<22:20:29,  3.56it/s]
 23%|██▎       | 85254/371472 [6:46:44<23:10:25,  3.43it/s]
 23%|██▎       | 85255/371472 [6:46:45<25:12:24,  3.15it/s]
 23%|██▎       | 85256/371472 [6:46:45<24:06:38,  3.30it/s]
 23%|██▎       | 85257/371472 [6:46:45<22:35:56,  3.52it/s]
 23%|██▎       | 85258/371472 [6:46:45<23:16:12,  3.42it/s]
 23%|██▎       | 85259/371472 [6:46:46<22:40:21,  3.51it/s]
 23%|██▎       | 85260/371472 [6:46:46<22:53:33,  3.47it/s]
                                                           
{'loss': 3.9635, 'learning_rate': 7.938061582882629e-07, 'epoch': 3.67}

 23%|██▎       | 85260/371472 [6:46:46<22:53:33,  3.47it/s]
 23%|██▎       | 85261/371472 [6:46:46<22:19:17,  3.56it/s]
 23%|██▎       | 85262/371472 [6:46:47<22:05:29,  3.60it/s]
 23%|██▎       | 85263/371472 [6:46:47<21:37:29,  3.68it/s]
 23%|██▎       | 85264/371472 [6:46:47<22:15:26,  3.57it/s]
 23%|██▎       | 85265/371472 [6:46:47<22:34:31,  3.52it/s]
 23%|██▎       | 85266/371472 [6:46:48<21:47:23,  3.65it/s]
 23%|██▎       | 85267/371472 [6:46:48<21:30:48,  3.70it/s]
 23%|██▎       | 85268/371472 [6:46:48<23:05:35,  3.44it/s]
 23%|██▎       | 85269/371472 [6:46:49<23:29:27,  3.38it/s]
 23%|██▎       | 85270/371472 [6:46:49<22:53:16,  3.47it/s]
 23%|██▎       | 85271/371472 [6:46:49<22:55:32,  3.47it/s]
 23%|██▎       | 85272/371472 [6:46:49<21:55:49,  3.63it/s]
 23%|██▎       | 85273/371472 [6:46:50<21:41:51,  3.66it/s]
 23%|██▎       | 85274/371472 [6:46:50<21:50:45,  3.64it/s]
 23%|██▎       | 85275/371472 [6:46:50<21:22:31,  3.72it/s]
 23%|██▎       | 85276/371472 [6:46:51<24:05:43,  3.30it/s]
 23%|██▎       | 85277/371472 [6:46:51<24:04:00,  3.30it/s]
 23%|██▎       | 85278/371472 [6:46:51<22:42:36,  3.50it/s]
 23%|██▎       | 85279/371472 [6:46:51<21:48:39,  3.64it/s]
 23%|██▎       | 85280/371472 [6:46:52<21:50:46,  3.64it/s]
                                                           
{'loss': 4.0323, 'learning_rate': 7.937576763127841e-07, 'epoch': 3.67}

 23%|██▎       | 85280/371472 [6:46:52<21:50:46,  3.64it/s]
 23%|██▎       | 85281/371472 [6:46:52<22:35:24,  3.52it/s]
 23%|██▎       | 85282/371472 [6:46:52<22:18:40,  3.56it/s]
 23%|██▎       | 85283/371472 [6:46:53<21:53:02,  3.63it/s]
 23%|██▎       | 85284/371472 [6:46:53<23:54:36,  3.32it/s]
 23%|██▎       | 85285/371472 [6:46:53<22:54:44,  3.47it/s]
 23%|██▎       | 85286/371472 [6:46:53<21:45:43,  3.65it/s]
 23%|██▎       | 85287/371472 [6:46:54<21:47:21,  3.65it/s]
 23%|██▎       | 85288/371472 [6:46:54<21:59:11,  3.62it/s]
 23%|██▎       | 85289/371472 [6:46:54<21:35:44,  3.68it/s]
 23%|██▎       | 85290/371472 [6:46:54<22:28:52,  3.54it/s]
 23%|██▎       | 85291/371472 [6:46:55<22:26:44,  3.54it/s]
 23%|██▎       | 85292/371472 [6:46:55<22:36:39,  3.52it/s]
 23%|██▎       | 85293/371472 [6:46:55<22:59:21,  3.46it/s]
 23%|██▎       | 85294/371472 [6:46:56<23:20:31,  3.41it/s]
 23%|██▎       | 85295/371472 [6:46:56<25:25:57,  3.13it/s]
 23%|██▎       | 85296/371472 [6:46:56<24:27:08,  3.25it/s]
 23%|██▎       | 85297/371472 [6:46:57<24:46:03,  3.21it/s]
 23%|██▎       | 85298/371472 [6:46:57<25:00:17,  3.18it/s]
 23%|██▎       | 85299/371472 [6:46:57<24:38:29,  3.23it/s]
 23%|██▎       | 85300/371472 [6:46:58<24:41:40,  3.22it/s]
                                                           
{'loss': 3.9351, 'learning_rate': 7.937091943373054e-07, 'epoch': 3.67}

 23%|██▎       | 85300/371472 [6:46:58<24:41:40,  3.22it/s]
 23%|██▎       | 85301/371472 [6:46:58<23:56:44,  3.32it/s]
 23%|██▎       | 85302/371472 [6:46:58<23:35:47,  3.37it/s]
 23%|██▎       | 85303/371472 [6:46:58<23:15:06,  3.42it/s]
 23%|██▎       | 85304/371472 [6:46:59<22:37:22,  3.51it/s]
 23%|██▎       | 85305/371472 [6:46:59<22:05:52,  3.60it/s]
 23%|██▎       | 85306/371472 [6:46:59<22:11:23,  3.58it/s]
 23%|██▎       | 85307/371472 [6:46:59<21:10:35,  3.75it/s]
 23%|██▎       | 85308/371472 [6:47:00<21:31:33,  3.69it/s]
 23%|██▎       | 85309/371472 [6:47:00<20:48:13,  3.82it/s]
 23%|██▎       | 85310/371472 [6:47:00<20:57:12,  3.79it/s]
 23%|██▎       | 85311/371472 [6:47:01<21:21:09,  3.72it/s]
 23%|██▎       | 85312/371472 [6:47:01<21:42:35,  3.66it/s]
 23%|██▎       | 85313/371472 [6:47:01<22:07:10,  3.59it/s]
 23%|██▎       | 85314/371472 [6:47:01<22:43:16,  3.50it/s]
 23%|██▎       | 85315/371472 [6:47:02<22:12:33,  3.58it/s]
 23%|██▎       | 85316/371472 [6:47:02<21:29:52,  3.70it/s]
 23%|██▎       | 85317/371472 [6:47:02<21:06:56,  3.76it/s]
 23%|██▎       | 85318/371472 [6:47:02<20:44:43,  3.83it/s]
 23%|██▎       | 85319/371472 [6:47:03<20:42:33,  3.84it/s]
 23%|██▎       | 85320/371472 [6:47:03<20:24:23,  3.90it/s]
                                                           
{'loss': 4.14, 'learning_rate': 7.936607123618263e-07, 'epoch': 3.67}

 23%|██▎       | 85320/371472 [6:47:03<20:24:23,  3.90it/s]
 23%|██▎       | 85321/371472 [6:47:03<19:54:23,  3.99it/s]
 23%|██▎       | 85322/371472 [6:47:03<20:34:54,  3.86it/s]
 23%|██▎       | 85323/371472 [6:47:04<20:25:33,  3.89it/s]
 23%|██▎       | 85324/371472 [6:47:04<20:24:00,  3.90it/s]
 23%|██▎       | 85325/371472 [6:47:04<20:34:01,  3.86it/s]
 23%|██▎       | 85326/371472 [6:47:05<21:02:11,  3.78it/s]
 23%|██▎       | 85327/371472 [6:47:05<25:05:26,  3.17it/s]
 23%|██▎       | 85328/371472 [6:47:05<24:15:44,  3.28it/s]
 23%|██▎       | 85329/371472 [6:47:06<24:03:00,  3.30it/s]
 23%|██▎       | 85330/371472 [6:47:06<23:27:32,  3.39it/s]
 23%|██▎       | 85331/371472 [6:47:06<22:36:06,  3.52it/s]
 23%|██▎       | 85332/371472 [6:47:06<22:24:29,  3.55it/s]
 23%|██▎       | 85333/371472 [6:47:07<22:11:00,  3.58it/s]
 23%|██▎       | 85334/371472 [6:47:07<23:31:29,  3.38it/s]
 23%|██▎       | 85335/371472 [6:47:07<23:43:33,  3.35it/s]
 23%|██▎       | 85336/371472 [6:47:08<23:51:46,  3.33it/s]
 23%|██▎       | 85337/371472 [6:47:08<23:07:55,  3.44it/s]
 23%|██▎       | 85338/371472 [6:47:08<23:09:27,  3.43it/s]
 23%|██▎       | 85339/371472 [6:47:08<23:43:59,  3.35it/s]
 23%|██▎       | 85340/371472 [6:47:09<22:55:09,  3.47it/s]
                                                           
{'loss': 3.8565, 'learning_rate': 7.936122303863474e-07, 'epoch': 3.68}

 23%|██▎       | 85340/371472 [6:47:09<22:55:09,  3.47it/s]
 23%|██▎       | 85341/371472 [6:47:09<22:14:42,  3.57it/s]
 23%|██▎       | 85342/371472 [6:47:09<22:12:55,  3.58it/s]
 23%|██▎       | 85343/371472 [6:47:10<22:04:39,  3.60it/s]
 23%|██▎       | 85344/371472 [6:47:10<22:37:31,  3.51it/s]
 23%|██▎       | 85345/371472 [6:47:10<22:06:34,  3.59it/s]
 23%|██▎       | 85346/371472 [6:47:10<23:25:33,  3.39it/s]
 23%|██▎       | 85347/371472 [6:47:11<22:17:55,  3.56it/s]
 23%|██▎       | 85348/371472 [6:47:11<24:25:01,  3.26it/s]
 23%|██▎       | 85349/371472 [6:47:11<23:37:56,  3.36it/s]
 23%|██▎       | 85350/371472 [6:47:12<23:33:06,  3.37it/s]
 23%|██▎       | 85351/371472 [6:47:12<23:38:01,  3.36it/s]
 23%|██▎       | 85352/371472 [6:47:12<22:36:27,  3.52it/s]
 23%|██▎       | 85353/371472 [6:47:12<21:50:44,  3.64it/s]
 23%|██▎       | 85354/371472 [6:47:13<21:44:31,  3.66it/s]
 23%|██▎       | 85355/371472 [6:47:13<21:01:13,  3.78it/s]
 23%|██▎       | 85356/371472 [6:47:13<21:50:42,  3.64it/s]
 23%|██▎       | 85357/371472 [6:47:14<23:12:15,  3.43it/s]
 23%|██▎       | 85358/371472 [6:47:14<23:01:05,  3.45it/s]
 23%|██▎       | 85359/371472 [6:47:14<22:56:16,  3.46it/s]
 23%|██▎       | 85360/371472 [6:47:14<22:19:33,  3.56it/s]
                                                           
{'loss': 3.9187, 'learning_rate': 7.935637484108686e-07, 'epoch': 3.68}

 23%|██▎       | 85360/371472 [6:47:14<22:19:33,  3.56it/s]
 23%|██▎       | 85361/371472 [6:47:15<23:06:00,  3.44it/s]
 23%|██▎       | 85362/371472 [6:47:15<23:06:49,  3.44it/s]
 23%|██▎       | 85363/371472 [6:47:15<22:06:05,  3.60it/s]
 23%|██▎       | 85364/371472 [6:47:16<23:10:09,  3.43it/s]
 23%|██▎       | 85365/371472 [6:47:16<23:08:25,  3.43it/s]
 23%|██▎       | 85366/371472 [6:47:16<22:42:13,  3.50it/s]
 23%|██▎       | 85367/371472 [6:47:16<23:01:53,  3.45it/s]
 23%|██▎       | 85368/371472 [6:47:17<22:10:44,  3.58it/s]
 23%|██▎       | 85369/371472 [6:47:17<21:31:35,  3.69it/s]
 23%|██▎       | 85370/371472 [6:47:17<20:53:38,  3.80it/s]
 23%|██▎       | 85371/371472 [6:47:17<21:13:31,  3.74it/s]
 23%|██▎       | 85372/371472 [6:47:18<21:11:07,  3.75it/s]
 23%|██▎       | 85373/371472 [6:47:18<20:45:21,  3.83it/s]
 23%|██▎       | 85374/371472 [6:47:18<21:13:27,  3.74it/s]
 23%|██▎       | 85375/371472 [6:47:19<21:47:41,  3.65it/s]
 23%|██▎       | 85376/371472 [6:47:19<21:32:47,  3.69it/s]
 23%|██▎       | 85377/371472 [6:47:19<21:19:28,  3.73it/s]
 23%|██▎       | 85378/371472 [6:47:19<20:54:04,  3.80it/s]
 23%|██▎       | 85379/371472 [6:47:20<22:21:47,  3.55it/s]
 23%|██▎       | 85380/371472 [6:47:20<22:15:20,  3.57it/s]
                                                           
{'loss': 4.1863, 'learning_rate': 7.935152664353897e-07, 'epoch': 3.68}

 23%|██▎       | 85380/371472 [6:47:20<22:15:20,  3.57it/s]
 23%|██▎       | 85381/371472 [6:47:20<22:24:06,  3.55it/s]
 23%|██▎       | 85382/371472 [6:47:20<21:49:07,  3.64it/s]
 23%|██▎       | 85383/371472 [6:47:21<21:50:24,  3.64it/s]
 23%|██▎       | 85384/371472 [6:47:21<21:31:27,  3.69it/s]
 23%|██▎       | 85385/371472 [6:47:21<21:44:46,  3.65it/s]
 23%|██▎       | 85386/371472 [6:47:22<22:17:16,  3.57it/s]
 23%|██▎       | 85387/371472 [6:47:22<22:38:06,  3.51it/s]
 23%|██▎       | 85388/371472 [6:47:22<21:42:46,  3.66it/s]
 23%|██▎       | 85389/371472 [6:47:22<21:52:19,  3.63it/s]
 23%|██▎       | 85390/371472 [6:47:23<22:43:47,  3.50it/s]
 23%|██▎       | 85391/371472 [6:47:23<23:33:21,  3.37it/s]
 23%|██▎       | 85392/371472 [6:47:23<22:15:55,  3.57it/s]
 23%|██▎       | 85393/371472 [6:47:24<22:53:04,  3.47it/s]
 23%|██▎       | 85394/371472 [6:47:24<23:14:54,  3.42it/s]
 23%|██▎       | 85395/371472 [6:47:24<24:28:37,  3.25it/s]
 23%|██▎       | 85396/371472 [6:47:24<23:52:21,  3.33it/s]
 23%|██▎       | 85397/371472 [6:47:25<23:29:58,  3.38it/s]
 23%|██▎       | 85398/371472 [6:47:25<22:54:21,  3.47it/s]
 23%|██▎       | 85399/371472 [6:47:25<22:19:15,  3.56it/s]
 23%|██▎       | 85400/371472 [6:47:26<22:36:29,  3.51it/s]
                                                           
{'loss': 4.061, 'learning_rate': 7.934667844599107e-07, 'epoch': 3.68}

 23%|██▎       | 85400/371472 [6:47:26<22:36:29,  3.51it/s]
 23%|██▎       | 85401/371472 [6:47:26<22:07:40,  3.59it/s]
 23%|██▎       | 85402/371472 [6:47:26<22:14:18,  3.57it/s]
 23%|██▎       | 85403/371472 [6:47:26<23:23:06,  3.40it/s]
 23%|██▎       | 85404/371472 [6:47:27<22:08:46,  3.59it/s]
 23%|██▎       | 85405/371472 [6:47:27<22:28:01,  3.54it/s]
 23%|██▎       | 85406/371472 [6:47:27<23:29:18,  3.38it/s]
 23%|██▎       | 85407/371472 [6:47:28<23:24:38,  3.39it/s]
 23%|██▎       | 85408/371472 [6:47:28<22:52:38,  3.47it/s]
 23%|██▎       | 85409/371472 [6:47:28<22:53:24,  3.47it/s]
 23%|██▎       | 85410/371472 [6:47:28<23:21:21,  3.40it/s]
 23%|██▎       | 85411/371472 [6:47:29<24:31:45,  3.24it/s]
 23%|██▎       | 85412/371472 [6:47:29<23:51:43,  3.33it/s]
 23%|██▎       | 85413/371472 [6:47:29<23:52:01,  3.33it/s]
 23%|██▎       | 85414/371472 [6:47:30<23:03:49,  3.45it/s]
 23%|██▎       | 85415/371472 [6:47:30<22:51:26,  3.48it/s]
 23%|██▎       | 85416/371472 [6:47:30<21:42:23,  3.66it/s]
 23%|██▎       | 85417/371472 [6:47:30<21:23:12,  3.72it/s]
 23%|██▎       | 85418/371472 [6:47:31<25:45:58,  3.08it/s]
 23%|██▎       | 85419/371472 [6:47:31<24:04:19,  3.30it/s]
 23%|██▎       | 85420/371472 [6:47:32<24:48:51,  3.20it/s]
                                                           
{'loss': 3.716, 'learning_rate': 7.934183024844318e-07, 'epoch': 3.68}

 23%|██▎       | 85420/371472 [6:47:32<24:48:51,  3.20it/s]
 23%|██▎       | 85421/371472 [6:47:32<24:18:50,  3.27it/s]
 23%|██▎       | 85422/371472 [6:47:32<23:31:16,  3.38it/s]
 23%|██▎       | 85423/371472 [6:47:32<23:25:27,  3.39it/s]
 23%|██▎       | 85424/371472 [6:47:33<23:26:27,  3.39it/s]
 23%|██▎       | 85425/371472 [6:47:33<22:51:02,  3.48it/s]
 23%|██▎       | 85426/371472 [6:47:33<22:22:35,  3.55it/s]
 23%|██▎       | 85427/371472 [6:47:34<23:48:43,  3.34it/s]
 23%|██▎       | 85428/371472 [6:47:34<24:41:05,  3.22it/s]
 23%|██▎       | 85429/371472 [6:47:34<24:10:23,  3.29it/s]
 23%|██▎       | 85430/371472 [6:47:34<23:01:57,  3.45it/s]
 23%|██▎       | 85431/371472 [6:47:35<22:17:55,  3.56it/s]
 23%|██▎       | 85432/371472 [6:47:35<22:11:16,  3.58it/s]
 23%|██▎       | 85433/371472 [6:47:35<23:08:14,  3.43it/s]
 23%|██▎       | 85434/371472 [6:47:36<23:42:21,  3.35it/s]
 23%|██▎       | 85435/371472 [6:47:36<22:48:53,  3.48it/s]
 23%|██▎       | 85436/371472 [6:47:36<23:13:56,  3.42it/s]
 23%|██▎       | 85437/371472 [6:47:36<22:58:20,  3.46it/s]
 23%|██▎       | 85438/371472 [6:47:37<22:14:00,  3.57it/s]
 23%|██▎       | 85439/371472 [6:47:37<22:20:03,  3.56it/s]
 23%|██▎       | 85440/371472 [6:47:37<21:51:12,  3.64it/s]
                                                           
{'loss': 4.04, 'learning_rate': 7.93369820508953e-07, 'epoch': 3.68}

 23%|██▎       | 85440/371472 [6:47:37<21:51:12,  3.64it/s]
 23%|██▎       | 85441/371472 [6:47:38<21:27:24,  3.70it/s]
 23%|██▎       | 85442/371472 [6:47:38<21:57:00,  3.62it/s]
 23%|██▎       | 85443/371472 [6:47:38<21:53:15,  3.63it/s]
 23%|██▎       | 85444/371472 [6:47:38<22:09:36,  3.59it/s]
 23%|██▎       | 85445/371472 [6:47:39<23:34:53,  3.37it/s]
 23%|██▎       | 85446/371472 [6:47:39<23:11:08,  3.43it/s]
 23%|██▎       | 85447/371472 [6:47:39<22:35:46,  3.52it/s]
 23%|██▎       | 85448/371472 [6:47:40<22:16:06,  3.57it/s]
 23%|██▎       | 85449/371472 [6:47:40<22:35:23,  3.52it/s]
 23%|██▎       | 85450/371472 [6:47:40<22:44:27,  3.49it/s]
 23%|██▎       | 85451/371472 [6:47:40<22:10:10,  3.58it/s]
 23%|██▎       | 85452/371472 [6:47:41<21:51:14,  3.64it/s]
 23%|██▎       | 85453/371472 [6:47:41<21:04:33,  3.77it/s]
 23%|██▎       | 85454/371472 [6:47:41<20:54:42,  3.80it/s]
 23%|██▎       | 85455/371472 [6:47:41<22:49:00,  3.48it/s]
 23%|██▎       | 85456/371472 [6:47:42<22:37:13,  3.51it/s]
 23%|██▎       | 85457/371472 [6:47:42<22:20:53,  3.56it/s]
 23%|██▎       | 85458/371472 [6:47:42<22:06:13,  3.59it/s]
 23%|██▎       | 85459/371472 [6:47:43<22:51:12,  3.48it/s]
 23%|██▎       | 85460/371472 [6:47:43<22:08:59,  3.59it/s]
                                                           
{'loss': 3.9894, 'learning_rate': 7.93321338533474e-07, 'epoch': 3.68}

 23%|██▎       | 85460/371472 [6:47:43<22:08:59,  3.59it/s]
 23%|██▎       | 85461/371472 [6:47:43<21:28:13,  3.70it/s]
 23%|██▎       | 85462/371472 [6:47:43<22:05:02,  3.60it/s]
 23%|██▎       | 85463/371472 [6:47:44<21:28:37,  3.70it/s]
 23%|██▎       | 85464/371472 [6:47:44<21:11:36,  3.75it/s]
 23%|██▎       | 85465/371472 [6:47:44<21:48:29,  3.64it/s]
 23%|██▎       | 85466/371472 [6:47:44<22:02:47,  3.60it/s]
 23%|██▎       | 85467/371472 [6:47:45<21:45:32,  3.65it/s]
 23%|██▎       | 85468/371472 [6:47:45<22:49:45,  3.48it/s]
 23%|██▎       | 85469/371472 [6:47:45<23:07:48,  3.43it/s]
 23%|██▎       | 85470/371472 [6:47:46<24:23:44,  3.26it/s]
 23%|██▎       | 85471/371472 [6:47:46<23:03:36,  3.45it/s]
 23%|██▎       | 85472/371472 [6:47:46<22:41:19,  3.50it/s]
 23%|██▎       | 85473/371472 [6:47:47<23:17:43,  3.41it/s]
 23%|██▎       | 85474/371472 [6:47:47<24:07:59,  3.29it/s]
 23%|██▎       | 85475/371472 [6:47:47<23:44:45,  3.35it/s]
 23%|██▎       | 85476/371472 [6:47:47<24:19:55,  3.26it/s]
 23%|██▎       | 85477/371472 [6:47:48<23:45:05,  3.34it/s]
 23%|██▎       | 85478/371472 [6:47:48<22:37:19,  3.51it/s]
 23%|██▎       | 85479/371472 [6:47:48<23:30:31,  3.38it/s]
 23%|██▎       | 85480/371472 [6:47:49<22:20:42,  3.56it/s]
                                                           
{'loss': 3.9257, 'learning_rate': 7.932728565579952e-07, 'epoch': 3.68}

 23%|██▎       | 85480/371472 [6:47:49<22:20:42,  3.56it/s]
 23%|██▎       | 85481/371472 [6:47:49<22:21:55,  3.55it/s]
 23%|██▎       | 85482/371472 [6:47:49<21:52:42,  3.63it/s]
 23%|██▎       | 85483/371472 [6:47:49<21:12:03,  3.75it/s]
 23%|██▎       | 85484/371472 [6:47:50<22:11:39,  3.58it/s]
 23%|██▎       | 85485/371472 [6:47:50<23:09:58,  3.43it/s]
 23%|██▎       | 85486/371472 [6:47:50<22:31:04,  3.53it/s]
 23%|██▎       | 85487/371472 [6:47:51<21:49:23,  3.64it/s]
 23%|██▎       | 85488/371472 [6:47:51<21:40:29,  3.67it/s]
 23%|██▎       | 85489/371472 [6:47:51<21:41:56,  3.66it/s]
 23%|██▎       | 85490/371472 [6:47:51<21:39:02,  3.67it/s]
 23%|██▎       | 85491/371472 [6:47:52<23:14:53,  3.42it/s]
 23%|██▎       | 85492/371472 [6:47:52<22:25:30,  3.54it/s]
 23%|██▎       | 85493/371472 [6:47:52<23:12:34,  3.42it/s]
 23%|██▎       | 85494/371472 [6:47:53<23:20:32,  3.40it/s]
 23%|██▎       | 85495/371472 [6:47:53<22:20:11,  3.56it/s]
 23%|██▎       | 85496/371472 [6:47:53<21:51:18,  3.63it/s]
 23%|██▎       | 85497/371472 [6:47:53<20:58:41,  3.79it/s]
 23%|██▎       | 85498/371472 [6:47:54<20:28:08,  3.88it/s]
 23%|██▎       | 85499/371472 [6:47:54<23:48:53,  3.34it/s]
 23%|██▎       | 85500/371472 [6:47:54<22:44:02,  3.49it/s]
                                                           
{'loss': 4.038, 'learning_rate': 7.932243745825163e-07, 'epoch': 3.68}

 23%|██▎       | 85500/371472 [6:47:54<22:44:02,  3.49it/s]
 23%|██▎       | 85501/371472 [6:47:54<22:30:22,  3.53it/s]
 23%|██▎       | 85502/371472 [6:47:55<23:27:51,  3.39it/s]
 23%|██▎       | 85503/371472 [6:47:55<22:31:14,  3.53it/s]
 23%|██▎       | 85504/371472 [6:47:55<21:36:10,  3.68it/s]
 23%|██▎       | 85505/371472 [6:47:56<20:59:15,  3.78it/s]
 23%|██▎       | 85506/371472 [6:47:56<21:19:49,  3.72it/s]
 23%|██▎       | 85507/371472 [6:47:56<20:50:22,  3.81it/s]
 23%|██▎       | 85508/371472 [6:47:56<20:43:19,  3.83it/s]
 23%|██▎       | 85509/371472 [6:47:57<21:02:20,  3.78it/s]
 23%|██▎       | 85510/371472 [6:47:57<21:37:30,  3.67it/s]
 23%|██▎       | 85511/371472 [6:47:57<21:30:06,  3.69it/s]
 23%|██▎       | 85512/371472 [6:47:58<23:38:34,  3.36it/s]
 23%|██▎       | 85513/371472 [6:47:58<23:51:53,  3.33it/s]
 23%|██▎       | 85514/371472 [6:47:58<24:43:00,  3.21it/s]
 23%|██▎       | 85515/371472 [6:47:58<24:00:59,  3.31it/s]
 23%|██▎       | 85516/371472 [6:47:59<23:28:40,  3.38it/s]
 23%|██▎       | 85517/371472 [6:47:59<23:48:24,  3.34it/s]
 23%|██▎       | 85518/371472 [6:47:59<23:15:00,  3.42it/s]
 23%|██▎       | 85519/371472 [6:48:00<23:08:25,  3.43it/s]
 23%|██▎       | 85520/371472 [6:48:00<22:05:36,  3.60it/s]
                                                           
{'loss': 4.2045, 'learning_rate': 7.931758926070374e-07, 'epoch': 3.68}

 23%|██▎       | 85520/371472 [6:48:00<22:05:36,  3.60it/s]
 23%|██▎       | 85521/371472 [6:48:00<28:24:22,  2.80it/s]
 23%|██▎       | 85522/371472 [6:48:01<25:29:30,  3.12it/s]
 23%|██▎       | 85523/371472 [6:48:01<24:09:14,  3.29it/s]
 23%|██▎       | 85524/371472 [6:48:01<23:13:13,  3.42it/s]
 23%|██▎       | 85525/371472 [6:48:01<23:27:16,  3.39it/s]
 23%|██▎       | 85526/371472 [6:48:02<23:05:41,  3.44it/s]
 23%|██▎       | 85527/371472 [6:48:02<23:02:02,  3.45it/s]
 23%|██▎       | 85528/371472 [6:48:02<22:47:06,  3.49it/s]
 23%|██▎       | 85529/371472 [6:48:03<22:22:33,  3.55it/s]
 23%|██▎       | 85530/371472 [6:48:03<22:03:49,  3.60it/s]
 23%|██▎       | 85531/371472 [6:48:03<21:38:34,  3.67it/s]
 23%|██▎       | 85532/371472 [6:48:03<24:02:22,  3.30it/s]
 23%|██▎       | 85533/371472 [6:48:04<22:15:07,  3.57it/s]
 23%|██▎       | 85534/371472 [6:48:04<21:31:16,  3.69it/s]
 23%|██▎       | 85535/371472 [6:48:04<22:07:09,  3.59it/s]
 23%|██▎       | 85536/371472 [6:48:05<21:46:32,  3.65it/s]
 23%|██▎       | 85537/371472 [6:48:05<21:16:06,  3.73it/s]
 23%|██▎       | 85538/371472 [6:48:05<23:39:19,  3.36it/s]
 23%|██▎       | 85539/371472 [6:48:05<22:40:50,  3.50it/s]
 23%|██▎       | 85540/371472 [6:48:06<21:45:36,  3.65it/s]
                                                           
{'loss': 3.9042, 'learning_rate': 7.931274106315584e-07, 'epoch': 3.68}

 23%|██▎       | 85540/371472 [6:48:06<21:45:36,  3.65it/s]
 23%|██▎       | 85541/371472 [6:48:06<21:12:27,  3.75it/s]
 23%|██▎       | 85542/371472 [6:48:06<21:16:24,  3.73it/s]
 23%|██▎       | 85543/371472 [6:48:06<21:54:06,  3.63it/s]
 23%|██▎       | 85544/371472 [6:48:07<21:29:41,  3.70it/s]
 23%|██▎       | 85545/371472 [6:48:07<23:20:41,  3.40it/s]
 23%|██▎       | 85546/371472 [6:48:07<22:01:08,  3.61it/s]
 23%|██▎       | 85547/371472 [6:48:08<21:21:38,  3.72it/s]
 23%|██▎       | 85548/371472 [6:48:08<24:43:13,  3.21it/s]
 23%|██▎       | 85549/371472 [6:48:08<24:06:03,  3.30it/s]
 23%|██▎       | 85550/371472 [6:48:08<22:41:07,  3.50it/s]
 23%|██▎       | 85551/371472 [6:48:09<22:26:53,  3.54it/s]
 23%|██▎       | 85552/371472 [6:48:09<23:44:07,  3.35it/s]
 23%|██▎       | 85553/371472 [6:48:09<23:27:35,  3.39it/s]
 23%|██▎       | 85554/371472 [6:48:10<22:22:14,  3.55it/s]
 23%|██▎       | 85555/371472 [6:48:10<22:46:30,  3.49it/s]
 23%|██▎       | 85556/371472 [6:48:10<22:34:39,  3.52it/s]
 23%|██▎       | 85557/371472 [6:48:11<23:44:27,  3.35it/s]
 23%|██▎       | 85558/371472 [6:48:11<23:13:30,  3.42it/s]
 23%|██▎       | 85559/371472 [6:48:11<22:18:26,  3.56it/s]
 23%|██▎       | 85560/371472 [6:48:11<23:16:17,  3.41it/s]
                                                           
{'loss': 4.0177, 'learning_rate': 7.930789286560796e-07, 'epoch': 3.69}

 23%|██▎       | 85560/371472 [6:48:11<23:16:17,  3.41it/s]
 23%|██▎       | 85561/371472 [6:48:12<24:20:55,  3.26it/s]
 23%|██▎       | 85562/371472 [6:48:12<23:26:35,  3.39it/s]
 23%|██▎       | 85563/371472 [6:48:12<24:46:17,  3.21it/s]
 23%|██▎       | 85564/371472 [6:48:13<25:20:09,  3.13it/s]
 23%|██▎       | 85565/371472 [6:48:13<24:56:23,  3.18it/s]
 23%|██▎       | 85566/371472 [6:48:13<24:28:07,  3.25it/s]
 23%|██▎       | 85567/371472 [6:48:14<25:59:13,  3.06it/s]
 23%|██▎       | 85568/371472 [6:48:14<26:05:11,  3.04it/s]
 23%|██▎       | 85569/371472 [6:48:14<25:42:18,  3.09it/s]
 23%|██▎       | 85570/371472 [6:48:15<24:10:16,  3.29it/s]
 23%|██▎       | 85571/371472 [6:48:15<23:16:50,  3.41it/s]
 23%|██▎       | 85572/371472 [6:48:15<23:31:04,  3.38it/s]
 23%|██▎       | 85573/371472 [6:48:15<23:09:07,  3.43it/s]
 23%|██▎       | 85574/371472 [6:48:16<23:04:41,  3.44it/s]
 23%|██▎       | 85575/371472 [6:48:16<22:43:56,  3.49it/s]
 23%|██▎       | 85576/371472 [6:48:16<22:44:31,  3.49it/s]
 23%|██▎       | 85577/371472 [6:48:17<22:07:48,  3.59it/s]
 23%|██▎       | 85578/371472 [6:48:17<22:22:17,  3.55it/s]
 23%|██▎       | 85579/371472 [6:48:17<22:44:10,  3.49it/s]
 23%|██▎       | 85580/371472 [6:48:17<22:27:33,  3.54it/s]
                                                           
{'loss': 3.7278, 'learning_rate': 7.930304466806007e-07, 'epoch': 3.69}

 23%|██▎       | 85580/371472 [6:48:17<22:27:33,  3.54it/s]
 23%|██▎       | 85581/371472 [6:48:18<24:44:00,  3.21it/s]
 23%|██▎       | 85582/371472 [6:48:18<24:29:10,  3.24it/s]
 23%|██▎       | 85583/371472 [6:48:18<25:26:36,  3.12it/s]
 23%|██▎       | 85584/371472 [6:48:19<23:29:41,  3.38it/s]
 23%|██▎       | 85585/371472 [6:48:19<23:26:41,  3.39it/s]
 23%|██▎       | 85586/371472 [6:48:19<23:33:42,  3.37it/s]
 23%|██▎       | 85587/371472 [6:48:19<22:17:51,  3.56it/s]
 23%|██▎       | 85588/371472 [6:48:20<21:51:21,  3.63it/s]
 23%|██▎       | 85589/371472 [6:48:20<21:58:41,  3.61it/s]
 23%|██▎       | 85590/371472 [6:48:20<23:02:39,  3.45it/s]
 23%|██▎       | 85591/371472 [6:48:21<23:41:20,  3.35it/s]
 23%|██▎       | 85592/371472 [6:48:21<22:51:38,  3.47it/s]
 23%|██▎       | 85593/371472 [6:48:21<21:53:19,  3.63it/s]
 23%|██▎       | 85594/371472 [6:48:21<21:08:54,  3.75it/s]
 23%|██▎       | 85595/371472 [6:48:22<21:59:00,  3.61it/s]
 23%|██▎       | 85596/371472 [6:48:22<22:00:15,  3.61it/s]
 23%|██▎       | 85597/371472 [6:48:22<21:27:31,  3.70it/s]
 23%|██▎       | 85598/371472 [6:48:23<21:46:00,  3.65it/s]
 23%|██▎       | 85599/371472 [6:48:23<21:45:39,  3.65it/s]
 23%|██▎       | 85600/371472 [6:48:23<22:20:19,  3.55it/s]
                                                           
{'loss': 3.944, 'learning_rate': 7.929819647051219e-07, 'epoch': 3.69}

 23%|██▎       | 85600/371472 [6:48:23<22:20:19,  3.55it/s]
 23%|██▎       | 85601/371472 [6:48:24<24:37:49,  3.22it/s]
 23%|██▎       | 85602/371472 [6:48:24<23:56:22,  3.32it/s]
 23%|██▎       | 85603/371472 [6:48:24<23:17:18,  3.41it/s]
 23%|██▎       | 85604/371472 [6:48:24<22:42:26,  3.50it/s]
 23%|██▎       | 85605/371472 [6:48:25<22:04:37,  3.60it/s]
 23%|██▎       | 85606/371472 [6:48:25<21:56:24,  3.62it/s]
 23%|██▎       | 85607/371472 [6:48:25<24:09:35,  3.29it/s]
 23%|██▎       | 85608/371472 [6:48:26<23:54:29,  3.32it/s]
 23%|██▎       | 85609/371472 [6:48:26<23:20:03,  3.40it/s]
 23%|██▎       | 85610/371472 [6:48:26<22:24:10,  3.54it/s]
 23%|██▎       | 85611/371472 [6:48:26<21:58:06,  3.61it/s]
 23%|██▎       | 85612/371472 [6:48:27<21:52:41,  3.63it/s]
 23%|██▎       | 85613/371472 [6:48:27<22:48:23,  3.48it/s]
 23%|██▎       | 85614/371472 [6:48:27<21:48:28,  3.64it/s]
 23%|██▎       | 85615/371472 [6:48:27<21:13:25,  3.74it/s]
 23%|██▎       | 85616/371472 [6:48:28<21:57:30,  3.62it/s]
 23%|██▎       | 85617/371472 [6:48:28<22:27:58,  3.53it/s]
 23%|██▎       | 85618/371472 [6:48:28<21:58:59,  3.61it/s]
 23%|██▎       | 85619/371472 [6:48:28<21:01:55,  3.78it/s]
 23%|██▎       | 85620/371472 [6:48:29<21:12:03,  3.75it/s]
                                                           
{'loss': 3.8217, 'learning_rate': 7.929334827296429e-07, 'epoch': 3.69}

 23%|██▎       | 85620/371472 [6:48:29<21:12:03,  3.75it/s]
 23%|██▎       | 85621/371472 [6:48:29<25:40:35,  3.09it/s]
 23%|██▎       | 85622/371472 [6:48:30<25:09:54,  3.16it/s]
 23%|██▎       | 85623/371472 [6:48:30<23:44:55,  3.34it/s]
 23%|██▎       | 85624/371472 [6:48:30<22:42:27,  3.50it/s]
 23%|██▎       | 85625/371472 [6:48:30<22:08:45,  3.59it/s]
 23%|██▎       | 85626/371472 [6:48:31<22:57:28,  3.46it/s]
 23%|██▎       | 85627/371472 [6:48:31<22:40:20,  3.50it/s]
 23%|██▎       | 85628/371472 [6:48:31<21:54:11,  3.63it/s]
 23%|██▎       | 85629/371472 [6:48:31<22:24:55,  3.54it/s]
 23%|██▎       | 85630/371472 [6:48:32<21:53:49,  3.63it/s]
 23%|██▎       | 85631/371472 [6:48:32<21:50:31,  3.64it/s]
 23%|██▎       | 85632/371472 [6:48:32<23:15:06,  3.41it/s]
 23%|██▎       | 85633/371472 [6:48:33<22:16:41,  3.56it/s]
 23%|██▎       | 85634/371472 [6:48:33<21:32:56,  3.68it/s]
 23%|██▎       | 85635/371472 [6:48:33<20:46:05,  3.82it/s]
 23%|██▎       | 85636/371472 [6:48:33<21:44:30,  3.65it/s]
 23%|██▎       | 85637/371472 [6:48:34<21:21:20,  3.72it/s]
 23%|██▎       | 85638/371472 [6:48:34<21:28:36,  3.70it/s]
 23%|██▎       | 85639/371472 [6:48:34<22:08:43,  3.59it/s]
 23%|██▎       | 85640/371472 [6:48:34<21:26:23,  3.70it/s]
                                                           
{'loss': 3.9619, 'learning_rate': 7.92885000754164e-07, 'epoch': 3.69}

 23%|██▎       | 85640/371472 [6:48:34<21:26:23,  3.70it/s]
 23%|██▎       | 85641/371472 [6:48:35<23:26:59,  3.39it/s]
 23%|██▎       | 85642/371472 [6:48:35<22:42:41,  3.50it/s]
 23%|██▎       | 85643/371472 [6:48:35<24:09:22,  3.29it/s]
 23%|██▎       | 85644/371472 [6:48:36<24:40:54,  3.22it/s]
 23%|██▎       | 85645/371472 [6:48:36<24:12:27,  3.28it/s]
 23%|██▎       | 85646/371472 [6:48:36<23:14:25,  3.42it/s]
 23%|██▎       | 85647/371472 [6:48:37<22:12:30,  3.58it/s]
 23%|██▎       | 85648/371472 [6:48:37<22:03:04,  3.60it/s]
 23%|██▎       | 85649/371472 [6:48:37<21:40:53,  3.66it/s]
 23%|██▎       | 85650/371472 [6:48:37<21:24:24,  3.71it/s]
 23%|██▎       | 85651/371472 [6:48:38<21:13:57,  3.74it/s]
 23%|██▎       | 85652/371472 [6:48:38<20:58:15,  3.79it/s]
 23%|██▎       | 85653/371472 [6:48:38<20:41:05,  3.84it/s]
 23%|██▎       | 85654/371472 [6:48:38<21:51:21,  3.63it/s]
 23%|██▎       | 85655/371472 [6:48:39<21:17:03,  3.73it/s]
 23%|██▎       | 85656/371472 [6:48:39<21:18:19,  3.73it/s]
 23%|██▎       | 85657/371472 [6:48:39<21:29:17,  3.69it/s]
 23%|██▎       | 85658/371472 [6:48:40<22:48:12,  3.48it/s]
 23%|██▎       | 85659/371472 [6:48:40<23:37:48,  3.36it/s]
 23%|██▎       | 85660/371472 [6:48:40<22:38:37,  3.51it/s]
                                                           
{'loss': 3.9583, 'learning_rate': 7.928365187786851e-07, 'epoch': 3.69}

 23%|██▎       | 85660/371472 [6:48:40<22:38:37,  3.51it/s]
 23%|██▎       | 85661/371472 [6:48:40<22:03:32,  3.60it/s]
 23%|██▎       | 85662/371472 [6:48:41<21:26:52,  3.70it/s]
 23%|██▎       | 85663/371472 [6:48:41<23:04:21,  3.44it/s]
 23%|██▎       | 85664/371472 [6:48:41<22:35:17,  3.51it/s]
 23%|██▎       | 85665/371472 [6:48:41<22:11:41,  3.58it/s]
 23%|██▎       | 85666/371472 [6:48:42<22:07:20,  3.59it/s]
 23%|██▎       | 85667/371472 [6:48:42<23:01:29,  3.45it/s]
 23%|██▎       | 85668/371472 [6:48:42<22:29:03,  3.53it/s]
 23%|██▎       | 85669/371472 [6:48:43<24:33:12,  3.23it/s]
 23%|██▎       | 85670/371472 [6:48:43<24:01:05,  3.31it/s]
 23%|██▎       | 85671/371472 [6:48:43<22:51:27,  3.47it/s]
 23%|██▎       | 85672/371472 [6:48:44<22:16:22,  3.56it/s]
 23%|██▎       | 85673/371472 [6:48:44<22:24:43,  3.54it/s]
 23%|██▎       | 85674/371472 [6:48:44<22:07:09,  3.59it/s]
 23%|██▎       | 85675/371472 [6:48:44<21:48:00,  3.64it/s]
 23%|██▎       | 85676/371472 [6:48:45<21:14:59,  3.74it/s]
 23%|██▎       | 85677/371472 [6:48:45<22:19:23,  3.56it/s]
 23%|██▎       | 85678/371472 [6:48:45<22:19:33,  3.56it/s]
 23%|██▎       | 85679/371472 [6:48:45<22:49:38,  3.48it/s]
 23%|██▎       | 85680/371472 [6:48:46<22:49:34,  3.48it/s]
                                                           
{'loss': 3.8675, 'learning_rate': 7.927880368032063e-07, 'epoch': 3.69}

 23%|██▎       | 85680/371472 [6:48:46<22:49:34,  3.48it/s]
 23%|██▎       | 85681/371472 [6:48:46<22:16:40,  3.56it/s]
 23%|██▎       | 85682/371472 [6:48:46<23:29:44,  3.38it/s]
 23%|██▎       | 85683/371472 [6:48:47<22:36:56,  3.51it/s]
 23%|██▎       | 85684/371472 [6:48:47<22:42:24,  3.50it/s]
 23%|██▎       | 85685/371472 [6:48:47<22:20:17,  3.55it/s]
 23%|██▎       | 85686/371472 [6:48:47<21:35:53,  3.68it/s]
 23%|██▎       | 85687/371472 [6:48:48<22:30:44,  3.53it/s]
 23%|██▎       | 85688/371472 [6:48:48<22:09:00,  3.58it/s]
 23%|██▎       | 85689/371472 [6:48:48<24:22:07,  3.26it/s]
 23%|██▎       | 85690/371472 [6:48:49<24:31:51,  3.24it/s]
 23%|██▎       | 85691/371472 [6:48:49<24:16:02,  3.27it/s]
 23%|██▎       | 85692/371472 [6:48:49<23:53:55,  3.32it/s]
 23%|██▎       | 85693/371472 [6:48:50<24:18:33,  3.27it/s]
 23%|██▎       | 85694/371472 [6:48:50<23:02:14,  3.45it/s]
 23%|██▎       | 85695/371472 [6:48:50<21:52:53,  3.63it/s]
 23%|██▎       | 85696/371472 [6:48:50<22:00:11,  3.61it/s]
 23%|██▎       | 85697/371472 [6:48:51<23:02:51,  3.44it/s]
 23%|██▎       | 85698/371472 [6:48:51<22:30:28,  3.53it/s]
 23%|██▎       | 85699/371472 [6:48:51<22:24:14,  3.54it/s]
 23%|██▎       | 85700/371472 [6:48:52<22:45:59,  3.49it/s]
                                                           
{'loss': 4.0699, 'learning_rate': 7.927395548277273e-07, 'epoch': 3.69}

 23%|██▎       | 85700/371472 [6:48:52<22:45:59,  3.49it/s]
 23%|██▎       | 85701/371472 [6:48:52<23:34:53,  3.37it/s]
 23%|██▎       | 85702/371472 [6:48:52<23:21:14,  3.40it/s]
 23%|██▎       | 85703/371472 [6:48:52<22:23:13,  3.55it/s]
 23%|██▎       | 85704/371472 [6:48:53<22:55:58,  3.46it/s]
 23%|██▎       | 85705/371472 [6:48:53<23:20:11,  3.40it/s]
 23%|██▎       | 85706/371472 [6:48:53<23:35:04,  3.37it/s]
 23%|██▎       | 85707/371472 [6:48:54<23:17:22,  3.41it/s]
 23%|██▎       | 85708/371472 [6:48:54<22:48:32,  3.48it/s]
 23%|██▎       | 85709/371472 [6:48:54<23:37:56,  3.36it/s]
 23%|██▎       | 85710/371472 [6:48:54<22:39:56,  3.50it/s]
 23%|██▎       | 85711/371472 [6:48:55<22:28:52,  3.53it/s]
 23%|██▎       | 85712/371472 [6:48:55<21:44:21,  3.65it/s]
 23%|██▎       | 85713/371472 [6:48:55<21:51:30,  3.63it/s]
 23%|██▎       | 85714/371472 [6:48:56<21:45:31,  3.65it/s]
 23%|██▎       | 85715/371472 [6:48:56<21:20:34,  3.72it/s]
 23%|██▎       | 85716/371472 [6:48:56<21:01:23,  3.78it/s]
 23%|██▎       | 85717/371472 [6:48:56<21:42:36,  3.66it/s]
 23%|██▎       | 85718/371472 [6:48:57<21:11:34,  3.75it/s]
 23%|██▎       | 85719/371472 [6:48:57<20:42:00,  3.83it/s]
 23%|██▎       | 85720/371472 [6:48:57<21:08:52,  3.75it/s]
                                                           
{'loss': 4.1263, 'learning_rate': 7.926910728522484e-07, 'epoch': 3.69}

 23%|██▎       | 85720/371472 [6:48:57<21:08:52,  3.75it/s]
 23%|██▎       | 85721/371472 [6:48:57<22:49:40,  3.48it/s]
 23%|██▎       | 85722/371472 [6:48:58<21:55:44,  3.62it/s]
 23%|██▎       | 85723/371472 [6:48:58<21:37:01,  3.67it/s]
 23%|██▎       | 85724/371472 [6:48:58<22:26:44,  3.54it/s]
 23%|██▎       | 85725/371472 [6:48:59<21:42:22,  3.66it/s]
 23%|██▎       | 85726/371472 [6:48:59<22:27:03,  3.54it/s]
 23%|██▎       | 85727/371472 [6:48:59<22:03:35,  3.60it/s]
 23%|██▎       | 85728/371472 [6:48:59<22:01:32,  3.60it/s]
 23%|██▎       | 85729/371472 [6:49:00<22:07:52,  3.59it/s]
 23%|██▎       | 85730/371472 [6:49:00<22:33:01,  3.52it/s]
 23%|██▎       | 85731/371472 [6:49:00<23:23:38,  3.39it/s]
 23%|██▎       | 85732/371472 [6:49:01<22:13:21,  3.57it/s]
 23%|██▎       | 85733/371472 [6:49:01<21:46:40,  3.64it/s]
 23%|██▎       | 85734/371472 [6:49:01<21:56:30,  3.62it/s]
 23%|██▎       | 85735/371472 [6:49:01<23:00:50,  3.45it/s]
 23%|██▎       | 85736/371472 [6:49:02<22:26:58,  3.54it/s]
 23%|██▎       | 85737/371472 [6:49:02<23:41:04,  3.35it/s]
 23%|██▎       | 85738/371472 [6:49:02<23:02:18,  3.45it/s]
 23%|██▎       | 85739/371472 [6:49:03<23:10:22,  3.43it/s]
 23%|██▎       | 85740/371472 [6:49:03<22:37:44,  3.51it/s]
                                                           
{'loss': 3.924, 'learning_rate': 7.926425908767696e-07, 'epoch': 3.69}

 23%|██▎       | 85740/371472 [6:49:03<22:37:44,  3.51it/s]
 23%|██▎       | 85741/371472 [6:49:03<25:12:51,  3.15it/s]
 23%|██▎       | 85742/371472 [6:49:03<23:40:28,  3.35it/s]
 23%|██▎       | 85743/371472 [6:49:04<23:35:58,  3.36it/s]
 23%|██▎       | 85744/371472 [6:49:04<22:25:09,  3.54it/s]
 23%|██▎       | 85745/371472 [6:49:04<23:25:57,  3.39it/s]
 23%|██▎       | 85746/371472 [6:49:05<23:58:45,  3.31it/s]
 23%|██▎       | 85747/371472 [6:49:05<24:30:44,  3.24it/s]
 23%|██▎       | 85748/371472 [6:49:05<23:24:19,  3.39it/s]
 23%|██▎       | 85749/371472 [6:49:06<24:21:13,  3.26it/s]
 23%|██▎       | 85750/371472 [6:49:06<24:05:24,  3.29it/s]
 23%|██▎       | 85751/371472 [6:49:06<24:08:08,  3.29it/s]
 23%|██▎       | 85752/371472 [6:49:06<23:27:25,  3.38it/s]
 23%|██▎       | 85753/371472 [6:49:07<22:31:06,  3.52it/s]
 23%|██▎       | 85754/371472 [6:49:07<22:26:02,  3.54it/s]
 23%|██▎       | 85755/371472 [6:49:07<21:40:26,  3.66it/s]
 23%|██▎       | 85756/371472 [6:49:08<22:51:50,  3.47it/s]
 23%|██▎       | 85757/371472 [6:49:08<22:42:18,  3.50it/s]
 23%|██▎       | 85758/371472 [6:49:08<23:11:56,  3.42it/s]
 23%|██▎       | 85759/371472 [6:49:08<22:40:43,  3.50it/s]
 23%|██▎       | 85760/371472 [6:49:09<22:19:23,  3.56it/s]
                                                           
{'loss': 4.0332, 'learning_rate': 7.925941089012907e-07, 'epoch': 3.69}

 23%|██▎       | 85760/371472 [6:49:09<22:19:23,  3.56it/s]
 23%|██▎       | 85761/371472 [6:49:09<23:56:16,  3.32it/s]
 23%|██▎       | 85762/371472 [6:49:09<22:35:25,  3.51it/s]
 23%|██▎       | 85763/371472 [6:49:10<21:26:31,  3.70it/s]
 23%|██▎       | 85764/371472 [6:49:10<22:09:26,  3.58it/s]
 23%|██▎       | 85765/371472 [6:49:10<23:50:45,  3.33it/s]
 23%|██▎       | 85766/371472 [6:49:10<22:36:27,  3.51it/s]
 23%|██▎       | 85767/371472 [6:49:11<22:36:03,  3.51it/s]
 23%|██▎       | 85768/371472 [6:49:11<22:06:18,  3.59it/s]
 23%|██▎       | 85769/371472 [6:49:11<22:36:19,  3.51it/s]
 23%|██▎       | 85770/371472 [6:49:12<22:36:59,  3.51it/s]
 23%|██▎       | 85771/371472 [6:49:12<21:27:52,  3.70it/s]
 23%|██▎       | 85772/371472 [6:49:12<21:25:04,  3.71it/s]
 23%|██▎       | 85773/371472 [6:49:12<21:07:46,  3.76it/s]
 23%|██▎       | 85774/371472 [6:49:13<21:33:36,  3.68it/s]
 23%|██▎       | 85775/371472 [6:49:13<21:10:16,  3.75it/s]
 23%|██▎       | 85776/371472 [6:49:13<21:14:41,  3.74it/s]
 23%|██▎       | 85777/371472 [6:49:13<22:43:49,  3.49it/s]
 23%|██▎       | 85778/371472 [6:49:14<21:56:26,  3.62it/s]
 23%|██▎       | 85779/371472 [6:49:14<21:19:33,  3.72it/s]
 23%|██▎       | 85780/371472 [6:49:14<21:25:19,  3.70it/s]
                                                           
{'loss': 3.9763, 'learning_rate': 7.925456269258117e-07, 'epoch': 3.69}

 23%|██▎       | 85780/371472 [6:49:14<21:25:19,  3.70it/s]
 23%|██▎       | 85781/371472 [6:49:15<20:49:45,  3.81it/s]
 23%|██▎       | 85782/371472 [6:49:15<21:19:20,  3.72it/s]
 23%|██▎       | 85783/371472 [6:49:15<20:37:40,  3.85it/s]
 23%|██▎       | 85784/371472 [6:49:15<21:15:33,  3.73it/s]
 23%|██▎       | 85785/371472 [6:49:16<21:34:33,  3.68it/s]
 23%|██▎       | 85786/371472 [6:49:16<20:59:39,  3.78it/s]
 23%|██▎       | 85787/371472 [6:49:16<23:01:39,  3.45it/s]
 23%|██▎       | 85788/371472 [6:49:16<22:25:31,  3.54it/s]
 23%|██▎       | 85789/371472 [6:49:17<22:40:40,  3.50it/s]
 23%|██▎       | 85790/371472 [6:49:17<21:55:17,  3.62it/s]
 23%|██▎       | 85791/371472 [6:49:18<31:03:18,  2.56it/s]
 23%|██▎       | 85792/371472 [6:49:18<28:06:33,  2.82it/s]
 23%|██▎       | 85793/371472 [6:49:18<26:38:44,  2.98it/s]
 23%|██▎       | 85794/371472 [6:49:19<26:32:28,  2.99it/s]
 23%|██▎       | 85795/371472 [6:49:19<24:48:44,  3.20it/s]
 23%|██▎       | 85796/371472 [6:49:19<24:15:52,  3.27it/s]
 23%|██▎       | 85797/371472 [6:49:19<24:50:24,  3.19it/s]
 23%|██▎       | 85798/371472 [6:49:20<22:58:38,  3.45it/s]
 23%|██▎       | 85799/371472 [6:49:20<22:35:36,  3.51it/s]
 23%|██▎       | 85800/371472 [6:49:20<23:26:05,  3.39it/s]
                                                           
{'loss': 3.9511, 'learning_rate': 7.924971449503328e-07, 'epoch': 3.7}

 23%|██▎       | 85800/371472 [6:49:20<23:26:05,  3.39it/s]
 23%|██▎       | 85801/371472 [6:49:21<23:48:31,  3.33it/s]
 23%|██▎       | 85802/371472 [6:49:21<23:32:59,  3.37it/s]
 23%|██▎       | 85803/371472 [6:49:21<22:37:46,  3.51it/s]
 23%|██▎       | 85804/371472 [6:49:21<21:53:50,  3.62it/s]
 23%|██▎       | 85805/371472 [6:49:22<21:24:42,  3.71it/s]
 23%|██▎       | 85806/371472 [6:49:22<20:40:51,  3.84it/s]
 23%|██▎       | 85807/371472 [6:49:22<20:11:17,  3.93it/s]
 23%|██▎       | 85808/371472 [6:49:22<20:27:19,  3.88it/s]
 23%|██▎       | 85809/371472 [6:49:23<20:14:09,  3.92it/s]
 23%|██▎       | 85810/371472 [6:49:23<23:31:00,  3.37it/s]
 23%|██▎       | 85811/371472 [6:49:23<22:45:58,  3.49it/s]
 23%|██▎       | 85812/371472 [6:49:24<21:48:13,  3.64it/s]
 23%|██▎       | 85813/371472 [6:49:24<23:15:46,  3.41it/s]
 23%|██▎       | 85814/371472 [6:49:24<22:26:14,  3.54it/s]
 23%|██▎       | 85815/371472 [6:49:24<22:57:58,  3.46it/s]
 23%|██▎       | 85816/371472 [6:49:25<21:42:15,  3.66it/s]
 23%|██▎       | 85817/371472 [6:49:25<21:52:55,  3.63it/s]
 23%|██▎       | 85818/371472 [6:49:25<22:30:44,  3.52it/s]
 23%|██▎       | 85819/371472 [6:49:26<21:58:37,  3.61it/s]
 23%|██▎       | 85820/371472 [6:49:26<22:05:30,  3.59it/s]
                                                           
{'loss': 3.9879, 'learning_rate': 7.92448662974854e-07, 'epoch': 3.7}

 23%|██▎       | 85820/371472 [6:49:26<22:05:30,  3.59it/s]
 23%|██▎       | 85821/371472 [6:49:26<21:05:01,  3.76it/s]
 23%|██▎       | 85822/371472 [6:49:26<21:03:20,  3.77it/s]
 23%|██▎       | 85823/371472 [6:49:27<22:19:56,  3.55it/s]
 23%|██▎       | 85824/371472 [6:49:27<21:27:50,  3.70it/s]
 23%|██▎       | 85825/371472 [6:49:27<21:37:01,  3.67it/s]
 23%|██▎       | 85826/371472 [6:49:27<21:07:17,  3.76it/s]
 23%|██▎       | 85827/371472 [6:49:28<20:48:04,  3.81it/s]
 23%|██▎       | 85828/371472 [6:49:28<20:26:07,  3.88it/s]
 23%|██▎       | 85829/371472 [6:49:28<20:59:03,  3.78it/s]
 23%|██▎       | 85830/371472 [6:49:28<22:05:33,  3.59it/s]
 23%|██▎       | 85831/371472 [6:49:29<21:46:35,  3.64it/s]
 23%|██▎       | 85832/371472 [6:49:29<22:43:23,  3.49it/s]
 23%|██▎       | 85833/371472 [6:49:29<23:50:25,  3.33it/s]
 23%|██▎       | 85834/371472 [6:49:30<24:46:30,  3.20it/s]
 23%|██▎       | 85835/371472 [6:49:30<24:17:21,  3.27it/s]
 23%|██▎       | 85836/371472 [6:49:30<23:37:35,  3.36it/s]
 23%|██▎       | 85837/371472 [6:49:31<22:57:49,  3.46it/s]
 23%|██▎       | 85838/371472 [6:49:31<23:19:38,  3.40it/s]
 23%|██▎       | 85839/371472 [6:49:31<22:53:20,  3.47it/s]
 23%|██▎       | 85840/371472 [6:49:31<22:38:38,  3.50it/s]
                                                           
{'loss': 3.9871, 'learning_rate': 7.924001809993752e-07, 'epoch': 3.7}

 23%|██▎       | 85840/371472 [6:49:31<22:38:38,  3.50it/s]
 23%|██▎       | 85841/371472 [6:49:32<23:03:42,  3.44it/s]
 23%|██▎       | 85842/371472 [6:49:32<24:20:01,  3.26it/s]
 23%|██▎       | 85843/371472 [6:49:32<23:08:22,  3.43it/s]
 23%|██▎       | 85844/371472 [6:49:33<24:29:33,  3.24it/s]
 23%|██▎       | 85845/371472 [6:49:33<23:30:23,  3.38it/s]
 23%|██▎       | 85846/371472 [6:49:33<24:48:46,  3.20it/s]
 23%|██▎       | 85847/371472 [6:49:34<24:40:28,  3.22it/s]
 23%|██▎       | 85848/371472 [6:49:34<23:27:03,  3.38it/s]
 23%|██▎       | 85849/371472 [6:49:34<22:35:02,  3.51it/s]
 23%|██▎       | 85850/371472 [6:49:34<22:56:15,  3.46it/s]
 23%|██▎       | 85851/371472 [6:49:35<24:13:36,  3.27it/s]
 23%|██▎       | 85852/371472 [6:49:35<22:56:29,  3.46it/s]
 23%|██▎       | 85853/371472 [6:49:35<23:37:26,  3.36it/s]
 23%|██▎       | 85854/371472 [6:49:36<23:14:36,  3.41it/s]
 23%|██▎       | 85855/371472 [6:49:36<22:59:41,  3.45it/s]
 23%|██▎       | 85856/371472 [6:49:36<22:43:51,  3.49it/s]
 23%|██▎       | 85857/371472 [6:49:36<22:22:21,  3.55it/s]
 23%|██▎       | 85858/371472 [6:49:37<22:04:51,  3.59it/s]
 23%|██▎       | 85859/371472 [6:49:37<22:29:20,  3.53it/s]
 23%|██▎       | 85860/371472 [6:49:37<22:42:15,  3.49it/s]
                                                           
{'loss': 4.0096, 'learning_rate': 7.923516990238962e-07, 'epoch': 3.7}

 23%|██▎       | 85860/371472 [6:49:37<22:42:15,  3.49it/s]
 23%|██▎       | 85861/371472 [6:49:38<22:32:10,  3.52it/s]
 23%|██▎       | 85862/371472 [6:49:38<22:22:30,  3.55it/s]
 23%|██▎       | 85863/371472 [6:49:38<22:42:24,  3.49it/s]
 23%|██▎       | 85864/371472 [6:49:38<22:28:00,  3.53it/s]
 23%|██▎       | 85865/371472 [6:49:39<23:20:25,  3.40it/s]
 23%|██▎       | 85866/371472 [6:49:39<22:33:48,  3.52it/s]
 23%|██▎       | 85867/371472 [6:49:39<21:49:32,  3.63it/s]
 23%|██▎       | 85868/371472 [6:49:40<23:21:48,  3.40it/s]
 23%|██▎       | 85869/371472 [6:49:40<24:53:10,  3.19it/s]
 23%|██▎       | 85870/371472 [6:49:40<24:12:24,  3.28it/s]
 23%|██▎       | 85871/371472 [6:49:40<22:39:39,  3.50it/s]
 23%|██▎       | 85872/371472 [6:49:41<21:51:14,  3.63it/s]
 23%|██▎       | 85873/371472 [6:49:41<23:25:56,  3.39it/s]
 23%|██▎       | 85874/371472 [6:49:41<22:25:11,  3.54it/s]
 23%|██▎       | 85875/371472 [6:49:42<22:48:37,  3.48it/s]
 23%|██▎       | 85876/371472 [6:49:42<22:50:21,  3.47it/s]
 23%|██▎       | 85877/371472 [6:49:42<21:53:37,  3.62it/s]
 23%|██▎       | 85878/371472 [6:49:43<23:16:04,  3.41it/s]
 23%|██▎       | 85879/371472 [6:49:43<22:44:41,  3.49it/s]
 23%|██▎       | 85880/371472 [6:49:43<23:51:47,  3.32it/s]
                                                           
{'loss': 3.8202, 'learning_rate': 7.923032170484173e-07, 'epoch': 3.7}

 23%|██▎       | 85880/371472 [6:49:43<23:51:47,  3.32it/s]
 23%|██▎       | 85881/371472 [6:49:43<24:31:31,  3.23it/s]
 23%|██▎       | 85882/371472 [6:49:44<23:51:12,  3.33it/s]
 23%|██▎       | 85883/371472 [6:49:44<23:53:16,  3.32it/s]
 23%|██▎       | 85884/371472 [6:49:44<22:58:29,  3.45it/s]
 23%|██▎       | 85885/371472 [6:49:45<22:08:38,  3.58it/s]
 23%|██▎       | 85886/371472 [6:49:45<22:44:38,  3.49it/s]
 23%|██▎       | 85887/371472 [6:49:45<22:09:18,  3.58it/s]
 23%|██▎       | 85888/371472 [6:49:45<23:07:55,  3.43it/s]
 23%|██▎       | 85889/371472 [6:49:46<22:38:45,  3.50it/s]
 23%|██▎       | 85890/371472 [6:49:46<22:04:07,  3.59it/s]
 23%|██▎       | 85891/371472 [6:49:46<21:30:29,  3.69it/s]
 23%|██▎       | 85892/371472 [6:49:46<21:01:45,  3.77it/s]
 23%|██▎       | 85893/371472 [6:49:47<20:46:09,  3.82it/s]
 23%|██▎       | 85894/371472 [6:49:47<20:50:23,  3.81it/s]
 23%|██▎       | 85895/371472 [6:49:47<21:19:58,  3.72it/s]
 23%|██▎       | 85896/371472 [6:49:48<21:56:02,  3.62it/s]
 23%|██▎       | 85897/371472 [6:49:48<21:40:02,  3.66it/s]
 23%|██▎       | 85898/371472 [6:49:48<21:22:20,  3.71it/s]
 23%|██▎       | 85899/371472 [6:49:48<21:50:51,  3.63it/s]
 23%|██▎       | 85900/371472 [6:49:49<21:24:57,  3.70it/s]
                                                           
{'loss': 3.9721, 'learning_rate': 7.922547350729384e-07, 'epoch': 3.7}

 23%|██▎       | 85900/371472 [6:49:49<21:24:57,  3.70it/s]
 23%|██▎       | 85901/371472 [6:49:49<21:09:06,  3.75it/s]
 23%|██▎       | 85902/371472 [6:49:49<21:32:57,  3.68it/s]
 23%|██▎       | 85903/371472 [6:49:49<20:55:54,  3.79it/s]
 23%|██▎       | 85904/371472 [6:49:50<21:23:11,  3.71it/s]
 23%|██▎       | 85905/371472 [6:49:50<20:59:21,  3.78it/s]
 23%|██▎       | 85906/371472 [6:49:50<20:59:17,  3.78it/s]
 23%|██▎       | 85907/371472 [6:49:51<21:15:41,  3.73it/s]
 23%|██▎       | 85908/371472 [6:49:51<20:56:38,  3.79it/s]
 23%|██▎       | 85909/371472 [6:49:51<20:40:21,  3.84it/s]
 23%|██▎       | 85910/371472 [6:49:51<20:49:02,  3.81it/s]
 23%|██▎       | 85911/371472 [6:49:52<20:30:55,  3.87it/s]
 23%|██▎       | 85912/371472 [6:49:52<21:55:18,  3.62it/s]
 23%|██▎       | 85913/371472 [6:49:52<22:02:54,  3.60it/s]
 23%|██▎       | 85914/371472 [6:49:52<21:52:37,  3.63it/s]
 23%|██▎       | 85915/371472 [6:49:53<22:05:36,  3.59it/s]
 23%|██▎       | 85916/371472 [6:49:53<23:07:02,  3.43it/s]
 23%|██▎       | 85917/371472 [6:49:53<22:32:35,  3.52it/s]
 23%|██▎       | 85918/371472 [6:49:54<22:34:49,  3.51it/s]
 23%|██▎       | 85919/371472 [6:49:54<22:32:12,  3.52it/s]
 23%|██▎       | 85920/371472 [6:49:54<21:51:55,  3.63it/s]
                                                           
{'loss': 3.9915, 'learning_rate': 7.922062530974595e-07, 'epoch': 3.7}

 23%|██▎       | 85920/371472 [6:49:54<21:51:55,  3.63it/s]
 23%|██▎       | 85921/371472 [6:49:54<22:46:20,  3.48it/s]
 23%|██▎       | 85922/371472 [6:49:55<22:03:55,  3.59it/s]
 23%|██▎       | 85923/371472 [6:49:55<22:01:59,  3.60it/s]
 23%|██▎       | 85924/371472 [6:49:55<22:34:34,  3.51it/s]
 23%|██▎       | 85925/371472 [6:49:56<22:31:13,  3.52it/s]
 23%|██▎       | 85926/371472 [6:49:56<23:45:50,  3.34it/s]
 23%|██▎       | 85927/371472 [6:49:56<23:24:53,  3.39it/s]
 23%|██▎       | 85928/371472 [6:49:56<23:36:09,  3.36it/s]
 23%|██▎       | 85929/371472 [6:49:57<23:24:26,  3.39it/s]
 23%|██▎       | 85930/371472 [6:49:57<22:34:58,  3.51it/s]
 23%|██▎       | 85931/371472 [6:49:57<22:52:10,  3.47it/s]
 23%|██▎       | 85932/371472 [6:49:58<22:29:30,  3.53it/s]
 23%|██▎       | 85933/371472 [6:49:58<22:16:37,  3.56it/s]
 23%|██▎       | 85934/371472 [6:49:58<22:45:41,  3.48it/s]
 23%|██▎       | 85935/371472 [6:49:58<22:48:14,  3.48it/s]
 23%|██▎       | 85936/371472 [6:49:59<22:07:41,  3.58it/s]
 23%|██▎       | 85937/371472 [6:49:59<22:10:58,  3.58it/s]
 23%|██▎       | 85938/371472 [6:49:59<21:47:16,  3.64it/s]
 23%|██▎       | 85939/371472 [6:50:00<23:12:36,  3.42it/s]
 23%|██▎       | 85940/371472 [6:50:00<22:35:35,  3.51it/s]
                                                           
{'loss': 4.0234, 'learning_rate': 7.921577711219806e-07, 'epoch': 3.7}

 23%|██▎       | 85940/371472 [6:50:00<22:35:35,  3.51it/s]
 23%|██▎       | 85941/371472 [6:50:00<22:05:51,  3.59it/s]
 23%|██▎       | 85942/371472 [6:50:00<23:03:43,  3.44it/s]
 23%|██▎       | 85943/371472 [6:50:01<23:08:53,  3.43it/s]
 23%|██▎       | 85944/371472 [6:50:01<22:42:39,  3.49it/s]
 23%|██▎       | 85945/371472 [6:50:01<25:27:00,  3.12it/s]
 23%|██▎       | 85946/371472 [6:50:02<24:21:03,  3.26it/s]
 23%|██▎       | 85947/371472 [6:50:02<24:33:58,  3.23it/s]
 23%|██▎       | 85948/371472 [6:50:02<23:59:31,  3.31it/s]
 23%|██▎       | 85949/371472 [6:50:03<22:23:07,  3.54it/s]
 23%|██▎       | 85950/371472 [6:50:03<21:28:43,  3.69it/s]
 23%|██▎       | 85951/371472 [6:50:03<21:44:34,  3.65it/s]
 23%|██▎       | 85952/371472 [6:50:03<22:45:02,  3.49it/s]
 23%|██▎       | 85953/371472 [6:50:04<23:46:14,  3.34it/s]
 23%|██▎       | 85954/371472 [6:50:04<22:07:29,  3.58it/s]
 23%|██▎       | 85955/371472 [6:50:04<22:28:48,  3.53it/s]
 23%|██▎       | 85956/371472 [6:50:04<21:25:45,  3.70it/s]
 23%|██▎       | 85957/371472 [6:50:05<21:14:27,  3.73it/s]
 23%|██▎       | 85958/371472 [6:50:05<21:12:35,  3.74it/s]
 23%|██▎       | 85959/371472 [6:50:05<21:50:21,  3.63it/s]
 23%|██▎       | 85960/371472 [6:50:05<20:59:06,  3.78it/s]
                                                           
{'loss': 3.8978, 'learning_rate': 7.921092891465017e-07, 'epoch': 3.7}

 23%|██▎       | 85960/371472 [6:50:06<20:59:06,  3.78it/s]
 23%|██▎       | 85961/371472 [6:50:06<22:43:37,  3.49it/s]
 23%|██▎       | 85962/371472 [6:50:06<21:46:17,  3.64it/s]
 23%|██▎       | 85963/371472 [6:50:06<23:43:42,  3.34it/s]
 23%|██▎       | 85964/371472 [6:50:07<23:12:35,  3.42it/s]
 23%|██▎       | 85965/371472 [6:50:07<23:02:18,  3.44it/s]
 23%|██▎       | 85966/371472 [6:50:07<22:17:50,  3.56it/s]
 23%|██▎       | 85967/371472 [6:50:08<22:12:32,  3.57it/s]
 23%|██▎       | 85968/371472 [6:50:08<21:53:00,  3.62it/s]
 23%|██▎       | 85969/371472 [6:50:08<22:00:43,  3.60it/s]
 23%|██▎       | 85970/371472 [6:50:08<21:55:37,  3.62it/s]
 23%|██▎       | 85971/371472 [6:50:09<21:46:32,  3.64it/s]
 23%|██▎       | 85972/371472 [6:50:09<21:56:52,  3.61it/s]
 23%|██▎       | 85973/371472 [6:50:09<21:15:18,  3.73it/s]
 23%|██▎       | 85974/371472 [6:50:09<20:20:50,  3.90it/s]
 23%|██▎       | 85975/371472 [6:50:10<21:26:56,  3.70it/s]
 23%|██▎       | 85976/371472 [6:50:10<21:38:10,  3.67it/s]
 23%|██▎       | 85977/371472 [6:50:10<22:34:53,  3.51it/s]
 23%|██▎       | 85978/371472 [6:50:11<22:17:10,  3.56it/s]
 23%|██▎       | 85979/371472 [6:50:11<22:42:13,  3.49it/s]
 23%|██▎       | 85980/371472 [6:50:11<21:37:43,  3.67it/s]
                                                           
{'loss': 3.907, 'learning_rate': 7.920608071710229e-07, 'epoch': 3.7}

 23%|██▎       | 85980/371472 [6:50:11<21:37:43,  3.67it/s]
 23%|██▎       | 85981/371472 [6:50:11<22:17:28,  3.56it/s]
 23%|██▎       | 85982/371472 [6:50:12<22:26:17,  3.53it/s]
 23%|██▎       | 85983/371472 [6:50:12<22:00:54,  3.60it/s]
 23%|██▎       | 85984/371472 [6:50:12<22:19:40,  3.55it/s]
 23%|██▎       | 85985/371472 [6:50:13<22:03:19,  3.60it/s]
 23%|██▎       | 85986/371472 [6:50:13<21:28:13,  3.69it/s]
 23%|██▎       | 85987/371472 [6:50:13<21:09:22,  3.75it/s]
 23%|██▎       | 85988/371472 [6:50:13<20:26:35,  3.88it/s]
 23%|██▎       | 85989/371472 [6:50:14<21:14:01,  3.73it/s]
 23%|██▎       | 85990/371472 [6:50:14<21:13:39,  3.74it/s]
 23%|██▎       | 85991/371472 [6:50:14<22:12:10,  3.57it/s]
 23%|██▎       | 85992/371472 [6:50:14<21:53:23,  3.62it/s]
 23%|██▎       | 85993/371472 [6:50:15<20:51:23,  3.80it/s]
 23%|██▎       | 85994/371472 [6:50:15<20:25:31,  3.88it/s]
 23%|██▎       | 85995/371472 [6:50:15<22:28:27,  3.53it/s]
 23%|██▎       | 85996/371472 [6:50:15<22:00:09,  3.60it/s]
 23%|██▎       | 85997/371472 [6:50:16<21:27:09,  3.70it/s]
 23%|██▎       | 85998/371472 [6:50:16<21:51:58,  3.63it/s]
 23%|██▎       | 85999/371472 [6:50:16<22:20:54,  3.55it/s]
 23%|██▎       | 86000/371472 [6:50:17<21:48:59,  3.63it/s]
                                                           
{'loss': 4.0054, 'learning_rate': 7.920123251955439e-07, 'epoch': 3.7}

 23%|██▎       | 86000/371472 [6:50:17<21:48:59,  3.63it/s]
 23%|██▎       | 86001/371472 [6:50:17<20:57:29,  3.78it/s]
 23%|██▎       | 86002/371472 [6:50:17<21:28:52,  3.69it/s]
 23%|██▎       | 86003/371472 [6:50:17<20:57:29,  3.78it/s]
 23%|██▎       | 86004/371472 [6:50:18<20:25:03,  3.88it/s]
 23%|██▎       | 86005/371472 [6:50:18<21:56:39,  3.61it/s]
 23%|██▎       | 86006/371472 [6:50:18<23:20:35,  3.40it/s]
 23%|██▎       | 86007/371472 [6:50:19<22:54:59,  3.46it/s]
 23%|██▎       | 86008/371472 [6:50:19<22:19:23,  3.55it/s]
 23%|██▎       | 86009/371472 [6:50:19<23:39:31,  3.35it/s]
 23%|██▎       | 86010/371472 [6:50:19<23:27:09,  3.38it/s]
 23%|██▎       | 86011/371472 [6:50:20<22:37:45,  3.50it/s]
 23%|██▎       | 86012/371472 [6:50:20<23:33:07,  3.37it/s]
 23%|██▎       | 86013/371472 [6:50:20<24:47:52,  3.20it/s]
 23%|██▎       | 86014/371472 [6:50:21<23:23:11,  3.39it/s]
 23%|██▎       | 86015/371472 [6:50:21<22:42:12,  3.49it/s]
 23%|██▎       | 86016/371472 [6:50:21<22:54:09,  3.46it/s]
 23%|██▎       | 86017/371472 [6:50:21<21:46:15,  3.64it/s]
 23%|██▎       | 86018/371472 [6:50:22<21:31:04,  3.68it/s]
 23%|██▎       | 86019/371472 [6:50:22<22:41:30,  3.49it/s]
 23%|██▎       | 86020/371472 [6:50:22<23:10:22,  3.42it/s]
                                                           
{'loss': 4.0066, 'learning_rate': 7.91963843220065e-07, 'epoch': 3.71}

 23%|██▎       | 86020/371472 [6:50:22<23:10:22,  3.42it/s]
 23%|██▎       | 86021/371472 [6:50:23<23:32:33,  3.37it/s]
 23%|██▎       | 86022/371472 [6:50:23<22:14:03,  3.57it/s]
 23%|██▎       | 86023/371472 [6:50:23<21:31:14,  3.68it/s]
 23%|██▎       | 86024/371472 [6:50:23<21:22:25,  3.71it/s]
 23%|██▎       | 86025/371472 [6:50:24<21:49:11,  3.63it/s]
 23%|██▎       | 86026/371472 [6:50:24<22:28:39,  3.53it/s]
 23%|██▎       | 86027/371472 [6:50:24<21:35:37,  3.67it/s]
 23%|██▎       | 86028/371472 [6:50:24<21:05:23,  3.76it/s]
 23%|██▎       | 86029/371472 [6:50:25<21:53:00,  3.62it/s]
 23%|██▎       | 86030/371472 [6:50:25<24:16:43,  3.27it/s]
 23%|██▎       | 86031/371472 [6:50:25<23:07:23,  3.43it/s]
 23%|██▎       | 86032/371472 [6:50:26<22:21:26,  3.55it/s]
 23%|██▎       | 86033/371472 [6:50:26<23:29:59,  3.37it/s]
 23%|██▎       | 86034/371472 [6:50:26<23:13:36,  3.41it/s]
 23%|██▎       | 86035/371472 [6:50:27<23:22:48,  3.39it/s]
 23%|██▎       | 86036/371472 [6:50:27<23:38:46,  3.35it/s]
 23%|██▎       | 86037/371472 [6:50:27<23:04:19,  3.44it/s]
 23%|██▎       | 86038/371472 [6:50:27<24:04:07,  3.29it/s]
 23%|██▎       | 86039/371472 [6:50:28<23:31:45,  3.37it/s]
 23%|██▎       | 86040/371472 [6:50:28<23:47:43,  3.33it/s]
                                                           
{'loss': 3.9255, 'learning_rate': 7.91915361244586e-07, 'epoch': 3.71}

 23%|██▎       | 86040/371472 [6:50:28<23:47:43,  3.33it/s]
 23%|██▎       | 86041/371472 [6:50:28<23:14:29,  3.41it/s]
 23%|██▎       | 86042/371472 [6:50:29<23:28:53,  3.38it/s]
 23%|██▎       | 86043/371472 [6:50:29<23:16:53,  3.41it/s]
 23%|██▎       | 86044/371472 [6:50:29<22:32:40,  3.52it/s]
 23%|██▎       | 86045/371472 [6:50:29<22:31:51,  3.52it/s]
 23%|██▎       | 86046/371472 [6:50:30<22:50:59,  3.47it/s]
 23%|██▎       | 86047/371472 [6:50:30<21:51:18,  3.63it/s]
 23%|██▎       | 86048/371472 [6:50:30<21:09:45,  3.75it/s]
 23%|██▎       | 86049/371472 [6:50:31<21:19:15,  3.72it/s]
 23%|██▎       | 86050/371472 [6:50:31<20:49:21,  3.81it/s]
 23%|██▎       | 86051/371472 [6:50:31<20:56:51,  3.78it/s]
 23%|██▎       | 86052/371472 [6:50:31<21:29:04,  3.69it/s]
 23%|██▎       | 86053/371472 [6:50:32<22:46:17,  3.48it/s]
 23%|██▎       | 86054/371472 [6:50:32<22:06:31,  3.59it/s]
 23%|██▎       | 86055/371472 [6:50:32<24:15:41,  3.27it/s]
 23%|██▎       | 86056/371472 [6:50:33<24:31:14,  3.23it/s]
 23%|██▎       | 86057/371472 [6:50:33<23:14:02,  3.41it/s]
 23%|██▎       | 86058/371472 [6:50:33<22:57:13,  3.45it/s]
 23%|██▎       | 86059/371472 [6:50:33<23:46:00,  3.34it/s]
 23%|██▎       | 86060/371472 [6:50:34<23:37:16,  3.36it/s]
                                                           
{'loss': 3.7505, 'learning_rate': 7.918668792691073e-07, 'epoch': 3.71}

 23%|██▎       | 86060/371472 [6:50:34<23:37:16,  3.36it/s]
 23%|██▎       | 86061/371472 [6:50:34<24:19:06,  3.26it/s]
 23%|██▎       | 86062/371472 [6:50:34<23:41:42,  3.35it/s]
 23%|██▎       | 86063/371472 [6:50:35<22:59:37,  3.45it/s]
 23%|██▎       | 86064/371472 [6:50:35<22:28:41,  3.53it/s]
 23%|██▎       | 86065/371472 [6:50:35<23:31:00,  3.37it/s]
 23%|██▎       | 86066/371472 [6:50:36<26:29:56,  2.99it/s]
 23%|██▎       | 86067/371472 [6:50:36<24:47:59,  3.20it/s]
 23%|██▎       | 86068/371472 [6:50:36<24:34:43,  3.23it/s]
 23%|██▎       | 86069/371472 [6:50:36<23:01:11,  3.44it/s]
 23%|██▎       | 86070/371472 [6:50:37<22:57:00,  3.45it/s]
 23%|██▎       | 86071/371472 [6:50:37<22:38:26,  3.50it/s]
 23%|██▎       | 86072/371472 [6:50:37<22:29:10,  3.53it/s]
 23%|██▎       | 86073/371472 [6:50:38<22:17:18,  3.56it/s]
 23%|██▎       | 86074/371472 [6:50:38<21:34:10,  3.68it/s]
 23%|██▎       | 86075/371472 [6:50:38<21:30:13,  3.69it/s]
 23%|██▎       | 86076/371472 [6:50:38<21:58:32,  3.61it/s]
 23%|██▎       | 86077/371472 [6:50:39<23:48:05,  3.33it/s]
 23%|██▎       | 86078/371472 [6:50:39<22:46:15,  3.48it/s]
 23%|██▎       | 86079/371472 [6:50:39<21:41:09,  3.66it/s]
 23%|██▎       | 86080/371472 [6:50:40<21:18:25,  3.72it/s]
                                                           
{'loss': 3.9397, 'learning_rate': 7.918183972936283e-07, 'epoch': 3.71}

 23%|██▎       | 86080/371472 [6:50:40<21:18:25,  3.72it/s]
 23%|██▎       | 86081/371472 [6:50:40<21:48:41,  3.63it/s]
 23%|██▎       | 86082/371472 [6:50:40<21:57:08,  3.61it/s]
 23%|██▎       | 86083/371472 [6:50:40<21:53:28,  3.62it/s]
 23%|██▎       | 86084/371472 [6:50:41<23:03:25,  3.44it/s]
 23%|██▎       | 86085/371472 [6:50:41<22:11:06,  3.57it/s]
 23%|██▎       | 86086/371472 [6:50:41<21:48:00,  3.64it/s]
 23%|██▎       | 86087/371472 [6:50:41<22:07:50,  3.58it/s]
 23%|██▎       | 86088/371472 [6:50:42<21:43:33,  3.65it/s]
 23%|██▎       | 86089/371472 [6:50:42<22:14:34,  3.56it/s]
 23%|██▎       | 86090/371472 [6:50:42<21:16:12,  3.73it/s]
 23%|██▎       | 86091/371472 [6:50:43<21:41:41,  3.65it/s]
 23%|██▎       | 86092/371472 [6:50:43<21:07:47,  3.75it/s]
 23%|██▎       | 86093/371472 [6:50:43<21:00:17,  3.77it/s]
 23%|██▎       | 86094/371472 [6:50:43<21:59:18,  3.61it/s]
 23%|██▎       | 86095/371472 [6:50:44<21:57:53,  3.61it/s]
 23%|██▎       | 86096/371472 [6:50:44<22:27:47,  3.53it/s]
 23%|██▎       | 86097/371472 [6:50:44<21:39:30,  3.66it/s]
 23%|██▎       | 86098/371472 [6:50:44<21:48:33,  3.63it/s]
 23%|██▎       | 86099/371472 [6:50:45<22:00:16,  3.60it/s]
 23%|██▎       | 86100/371472 [6:50:45<21:20:45,  3.71it/s]
                                                           
{'loss': 3.9661, 'learning_rate': 7.917699153181495e-07, 'epoch': 3.71}

 23%|██▎       | 86100/371472 [6:50:45<21:20:45,  3.71it/s]
 23%|██▎       | 86101/371472 [6:50:45<22:04:31,  3.59it/s]
 23%|██▎       | 86102/371472 [6:50:46<21:50:07,  3.63it/s]
 23%|██▎       | 86103/371472 [6:50:46<21:11:26,  3.74it/s]
 23%|██▎       | 86104/371472 [6:50:46<22:04:02,  3.59it/s]
 23%|██▎       | 86105/371472 [6:50:46<21:36:42,  3.67it/s]
 23%|██▎       | 86106/371472 [6:50:47<20:46:59,  3.81it/s]
 23%|██▎       | 86107/371472 [6:50:47<21:04:40,  3.76it/s]
 23%|██▎       | 86108/371472 [6:50:47<26:09:49,  3.03it/s]
 23%|██▎       | 86109/371472 [6:50:48<23:52:59,  3.32it/s]
 23%|██▎       | 86110/371472 [6:50:48<24:08:12,  3.28it/s]
 23%|██▎       | 86111/371472 [6:50:48<24:30:21,  3.23it/s]
 23%|██▎       | 86112/371472 [6:50:49<23:43:12,  3.34it/s]
 23%|██▎       | 86113/371472 [6:50:49<24:35:37,  3.22it/s]
 23%|██▎       | 86114/371472 [6:50:49<23:11:25,  3.42it/s]
 23%|██▎       | 86115/371472 [6:50:49<23:15:55,  3.41it/s]
 23%|██▎       | 86116/371472 [6:50:50<23:03:05,  3.44it/s]
 23%|██▎       | 86117/371472 [6:50:50<22:15:45,  3.56it/s]
 23%|██▎       | 86118/371472 [6:50:50<23:06:29,  3.43it/s]
 23%|██▎       | 86119/371472 [6:50:51<22:21:38,  3.54it/s]
 23%|██▎       | 86120/371472 [6:50:51<21:58:06,  3.61it/s]
                                                           
{'loss': 4.1445, 'learning_rate': 7.917214333426706e-07, 'epoch': 3.71}

 23%|██▎       | 86120/371472 [6:50:51<21:58:06,  3.61it/s]
 23%|██▎       | 86121/371472 [6:50:51<21:35:57,  3.67it/s]
 23%|██▎       | 86122/371472 [6:50:51<21:52:17,  3.62it/s]
 23%|██▎       | 86123/371472 [6:50:52<22:08:39,  3.58it/s]
 23%|██▎       | 86124/371472 [6:50:52<21:17:00,  3.72it/s]
 23%|██▎       | 86125/371472 [6:50:52<21:06:53,  3.75it/s]
 23%|██▎       | 86126/371472 [6:50:52<22:07:15,  3.58it/s]
 23%|██▎       | 86127/371472 [6:50:53<21:51:41,  3.63it/s]
 23%|██▎       | 86128/371472 [6:50:53<21:13:49,  3.73it/s]
 23%|██▎       | 86129/371472 [6:50:53<21:25:46,  3.70it/s]
 23%|██▎       | 86130/371472 [6:50:54<22:21:06,  3.55it/s]
 23%|██▎       | 86131/371472 [6:50:54<22:15:08,  3.56it/s]
 23%|██▎       | 86132/371472 [6:50:54<21:50:11,  3.63it/s]
 23%|██▎       | 86133/371472 [6:50:54<21:38:19,  3.66it/s]
 23%|██▎       | 86134/371472 [6:50:55<21:25:45,  3.70it/s]
 23%|██▎       | 86135/371472 [6:50:55<22:06:37,  3.58it/s]
 23%|██▎       | 86136/371472 [6:50:55<24:52:12,  3.19it/s]
 23%|██▎       | 86137/371472 [6:50:56<23:55:31,  3.31it/s]
 23%|██▎       | 86138/371472 [6:50:56<23:58:33,  3.31it/s]
 23%|██▎       | 86139/371472 [6:50:56<24:11:07,  3.28it/s]
 23%|██▎       | 86140/371472 [6:50:57<24:53:12,  3.18it/s]
                                                           
{'loss': 3.8973, 'learning_rate': 7.916729513671916e-07, 'epoch': 3.71}

 23%|██▎       | 86140/371472 [6:50:57<24:53:12,  3.18it/s]
 23%|██▎       | 86141/371472 [6:50:57<23:37:31,  3.35it/s]
 23%|██▎       | 86142/371472 [6:50:57<23:25:50,  3.38it/s]
 23%|██▎       | 86143/371472 [6:50:58<26:03:42,  3.04it/s]
 23%|██▎       | 86144/371472 [6:50:58<24:28:10,  3.24it/s]
 23%|██▎       | 86145/371472 [6:50:58<23:45:33,  3.34it/s]
 23%|██▎       | 86146/371472 [6:50:58<23:48:38,  3.33it/s]
 23%|██▎       | 86147/371472 [6:50:59<22:42:11,  3.49it/s]
 23%|██▎       | 86148/371472 [6:50:59<21:47:26,  3.64it/s]
 23%|██▎       | 86149/371472 [6:50:59<21:47:12,  3.64it/s]
 23%|██▎       | 86150/371472 [6:50:59<21:05:09,  3.76it/s]
 23%|██▎       | 86151/371472 [6:51:00<21:11:18,  3.74it/s]
 23%|██▎       | 86152/371472 [6:51:00<20:39:52,  3.84it/s]
 23%|██▎       | 86153/371472 [6:51:00<21:30:27,  3.68it/s]
 23%|██▎       | 86154/371472 [6:51:00<21:38:07,  3.66it/s]
 23%|██▎       | 86155/371472 [6:51:01<21:44:24,  3.65it/s]
 23%|██▎       | 86156/371472 [6:51:01<21:22:01,  3.71it/s]
 23%|██▎       | 86157/371472 [6:51:01<22:06:07,  3.59it/s]
 23%|██▎       | 86158/371472 [6:51:02<24:36:46,  3.22it/s]
 23%|██▎       | 86159/371472 [6:51:02<22:54:13,  3.46it/s]
 23%|██▎       | 86160/371472 [6:51:02<22:16:35,  3.56it/s]
                                                           
{'loss': 3.9122, 'learning_rate': 7.916244693917127e-07, 'epoch': 3.71}

 23%|██▎       | 86160/371472 [6:51:02<22:16:35,  3.56it/s]
 23%|██▎       | 86161/371472 [6:51:02<21:33:07,  3.68it/s]
 23%|██▎       | 86162/371472 [6:51:03<21:58:18,  3.61it/s]
 23%|██▎       | 86163/371472 [6:51:03<21:04:47,  3.76it/s]
 23%|██▎       | 86164/371472 [6:51:03<20:58:49,  3.78it/s]
 23%|██▎       | 86165/371472 [6:51:04<22:03:39,  3.59it/s]
 23%|██▎       | 86166/371472 [6:51:04<22:55:31,  3.46it/s]
 23%|██▎       | 86167/371472 [6:51:04<21:56:25,  3.61it/s]
 23%|██▎       | 86168/371472 [6:51:04<21:24:51,  3.70it/s]
 23%|██▎       | 86169/371472 [6:51:05<21:25:59,  3.70it/s]
 23%|██▎       | 86170/371472 [6:51:05<21:15:20,  3.73it/s]
 23%|██▎       | 86171/371472 [6:51:05<20:55:09,  3.79it/s]
 23%|██▎       | 86172/371472 [6:51:05<20:40:54,  3.83it/s]
 23%|██▎       | 86173/371472 [6:51:06<21:57:11,  3.61it/s]
 23%|██▎       | 86174/371472 [6:51:06<21:49:57,  3.63it/s]
 23%|██▎       | 86175/371472 [6:51:06<21:50:43,  3.63it/s]
 23%|██▎       | 86176/371472 [6:51:07<21:53:16,  3.62it/s]
 23%|██▎       | 86177/371472 [6:51:07<21:04:09,  3.76it/s]
 23%|██▎       | 86178/371472 [6:51:07<21:31:25,  3.68it/s]
 23%|██▎       | 86179/371472 [6:51:07<21:07:36,  3.75it/s]
 23%|██▎       | 86180/371472 [6:51:08<21:26:47,  3.70it/s]
                                                           
{'loss': 4.002, 'learning_rate': 7.915759874162339e-07, 'epoch': 3.71}

 23%|██▎       | 86180/371472 [6:51:08<21:26:47,  3.70it/s]
 23%|██▎       | 86181/371472 [6:51:08<21:10:39,  3.74it/s]
 23%|██▎       | 86182/371472 [6:51:08<25:47:45,  3.07it/s]
 23%|██▎       | 86183/371472 [6:51:09<24:48:48,  3.19it/s]
 23%|██▎       | 86184/371472 [6:51:09<23:34:58,  3.36it/s]
 23%|██▎       | 86185/371472 [6:51:09<22:23:55,  3.54it/s]
 23%|██▎       | 86186/371472 [6:51:09<21:55:51,  3.61it/s]
 23%|██▎       | 86187/371472 [6:51:10<22:23:10,  3.54it/s]
 23%|██▎       | 86188/371472 [6:51:10<21:50:47,  3.63it/s]
 23%|██▎       | 86189/371472 [6:51:10<23:00:15,  3.44it/s]
 23%|██▎       | 86190/371472 [6:51:11<22:27:20,  3.53it/s]
 23%|██▎       | 86191/371472 [6:51:11<22:18:56,  3.55it/s]
 23%|██▎       | 86192/371472 [6:51:11<22:15:22,  3.56it/s]
 23%|██▎       | 86193/371472 [6:51:11<21:30:44,  3.68it/s]
 23%|██▎       | 86194/371472 [6:51:12<22:43:15,  3.49it/s]
 23%|██▎       | 86195/371472 [6:51:12<22:10:24,  3.57it/s]
 23%|██▎       | 86196/371472 [6:51:12<22:46:12,  3.48it/s]
 23%|██▎       | 86197/371472 [6:51:12<22:33:57,  3.51it/s]
 23%|██▎       | 86198/371472 [6:51:13<23:44:23,  3.34it/s]
 23%|██▎       | 86199/371472 [6:51:13<23:03:22,  3.44it/s]
 23%|██▎       | 86200/371472 [6:51:13<22:39:15,  3.50it/s]
                                                           
{'loss': 3.9136, 'learning_rate': 7.91527505440755e-07, 'epoch': 3.71}

 23%|██▎       | 86200/371472 [6:51:13<22:39:15,  3.50it/s]
 23%|██▎       | 86201/371472 [6:51:14<22:52:28,  3.46it/s]
 23%|██▎       | 86202/371472 [6:51:14<22:18:46,  3.55it/s]
 23%|██▎       | 86203/371472 [6:51:14<21:41:44,  3.65it/s]
 23%|██▎       | 86204/371472 [6:51:15<23:35:41,  3.36it/s]
 23%|██▎       | 86205/371472 [6:51:15<23:12:55,  3.41it/s]
 23%|██▎       | 86206/371472 [6:51:15<24:39:58,  3.21it/s]
 23%|██▎       | 86207/371472 [6:51:15<23:31:20,  3.37it/s]
 23%|██▎       | 86208/371472 [6:51:16<22:55:01,  3.46it/s]
 23%|██▎       | 86209/371472 [6:51:16<26:41:27,  2.97it/s]
 23%|██▎       | 86210/371472 [6:51:16<24:54:09,  3.18it/s]
 23%|██▎       | 86211/371472 [6:51:17<23:36:48,  3.36it/s]
 23%|██▎       | 86212/371472 [6:51:17<22:27:41,  3.53it/s]
 23%|██▎       | 86213/371472 [6:51:17<21:48:55,  3.63it/s]
 23%|██▎       | 86214/371472 [6:51:17<22:24:01,  3.54it/s]
 23%|██▎       | 86215/371472 [6:51:18<21:53:21,  3.62it/s]
 23%|██▎       | 86216/371472 [6:51:18<21:10:01,  3.74it/s]
 23%|██▎       | 86217/371472 [6:51:18<22:04:47,  3.59it/s]
 23%|██▎       | 86218/371472 [6:51:19<21:49:29,  3.63it/s]
 23%|██▎       | 86219/371472 [6:51:19<23:57:59,  3.31it/s]
 23%|██▎       | 86220/371472 [6:51:19<23:48:57,  3.33it/s]
                                                           
{'loss': 3.8946, 'learning_rate': 7.914790234652761e-07, 'epoch': 3.71}

 23%|██▎       | 86220/371472 [6:51:19<23:48:57,  3.33it/s]
 23%|██▎       | 86221/371472 [6:51:20<23:34:01,  3.36it/s]
 23%|██▎       | 86222/371472 [6:51:20<24:17:20,  3.26it/s]
 23%|██▎       | 86223/371472 [6:51:20<23:52:11,  3.32it/s]
 23%|██▎       | 86224/371472 [6:51:20<23:17:06,  3.40it/s]
 23%|██▎       | 86225/371472 [6:51:21<22:28:16,  3.53it/s]
 23%|██▎       | 86226/371472 [6:51:21<23:42:27,  3.34it/s]
 23%|██▎       | 86227/371472 [6:51:21<23:57:46,  3.31it/s]
 23%|██▎       | 86228/371472 [6:51:22<25:14:19,  3.14it/s]
 23%|██▎       | 86229/371472 [6:51:22<24:46:14,  3.20it/s]
 23%|██▎       | 86230/371472 [6:51:22<24:23:03,  3.25it/s]
 23%|██▎       | 86231/371472 [6:51:23<22:38:49,  3.50it/s]
 23%|██▎       | 86232/371472 [6:51:23<23:08:17,  3.42it/s]
 23%|██▎       | 86233/371472 [6:51:23<23:40:46,  3.35it/s]
 23%|██▎       | 86234/371472 [6:51:23<22:10:13,  3.57it/s]
 23%|██▎       | 86235/371472 [6:51:24<22:21:15,  3.54it/s]
 23%|██▎       | 86236/371472 [6:51:24<22:22:07,  3.54it/s]
 23%|██▎       | 86237/371472 [6:51:24<23:40:49,  3.35it/s]
 23%|██▎       | 86238/371472 [6:51:25<23:02:38,  3.44it/s]
 23%|██▎       | 86239/371472 [6:51:25<22:45:34,  3.48it/s]
 23%|██▎       | 86240/371472 [6:51:25<22:23:34,  3.54it/s]
                                                           
{'loss': 3.9535, 'learning_rate': 7.914305414897972e-07, 'epoch': 3.71}

 23%|██▎       | 86240/371472 [6:51:25<22:23:34,  3.54it/s]
 23%|██▎       | 86241/371472 [6:51:25<22:39:49,  3.50it/s]
 23%|██▎       | 86242/371472 [6:51:26<21:32:09,  3.68it/s]
 23%|██▎       | 86243/371472 [6:51:26<21:30:16,  3.68it/s]
 23%|██▎       | 86244/371472 [6:51:26<22:26:08,  3.53it/s]
 23%|██▎       | 86245/371472 [6:51:27<24:14:17,  3.27it/s]
 23%|██▎       | 86246/371472 [6:51:27<23:35:43,  3.36it/s]
 23%|██▎       | 86247/371472 [6:51:27<23:03:33,  3.44it/s]
 23%|██▎       | 86248/371472 [6:51:27<22:29:49,  3.52it/s]
 23%|██▎       | 86249/371472 [6:51:28<21:49:49,  3.63it/s]
 23%|██▎       | 86250/371472 [6:51:28<21:04:40,  3.76it/s]
 23%|██▎       | 86251/371472 [6:51:28<21:24:27,  3.70it/s]
 23%|██▎       | 86252/371472 [6:51:28<20:46:50,  3.81it/s]
 23%|██▎       | 86253/371472 [6:51:29<22:08:40,  3.58it/s]
 23%|██▎       | 86254/371472 [6:51:29<22:12:42,  3.57it/s]
 23%|██▎       | 86255/371472 [6:51:29<22:28:55,  3.52it/s]
 23%|██▎       | 86256/371472 [6:51:30<21:46:08,  3.64it/s]
 23%|██▎       | 86257/371472 [6:51:30<22:30:28,  3.52it/s]
 23%|██▎       | 86258/371472 [6:51:30<21:30:11,  3.68it/s]
 23%|██▎       | 86259/371472 [6:51:30<22:06:29,  3.58it/s]
 23%|██▎       | 86260/371472 [6:51:31<24:44:28,  3.20it/s]
                                                           
{'loss': 3.8481, 'learning_rate': 7.913820595143183e-07, 'epoch': 3.72}

 23%|██▎       | 86260/371472 [6:51:31<24:44:28,  3.20it/s]
 23%|██▎       | 86261/371472 [6:51:31<23:35:32,  3.36it/s]
 23%|██▎       | 86262/371472 [6:51:31<23:02:17,  3.44it/s]
 23%|██▎       | 86263/371472 [6:51:32<22:29:32,  3.52it/s]
 23%|██▎       | 86264/371472 [6:51:32<23:33:59,  3.36it/s]
 23%|██▎       | 86265/371472 [6:51:32<22:46:58,  3.48it/s]
 23%|██▎       | 86266/371472 [6:51:32<21:44:00,  3.65it/s]
 23%|██▎       | 86267/371472 [6:51:33<21:59:12,  3.60it/s]
 23%|██▎       | 86268/371472 [6:51:33<22:28:33,  3.52it/s]
 23%|██▎       | 86269/371472 [6:51:33<22:25:58,  3.53it/s]
 23%|██▎       | 86270/371472 [6:51:34<22:38:21,  3.50it/s]
 23%|██▎       | 86271/371472 [6:51:34<22:05:17,  3.59it/s]
 23%|██▎       | 86272/371472 [6:51:34<24:48:21,  3.19it/s]
 23%|██▎       | 86273/371472 [6:51:35<23:43:17,  3.34it/s]
 23%|██▎       | 86274/371472 [6:51:35<23:27:35,  3.38it/s]
 23%|██▎       | 86275/371472 [6:51:35<23:03:42,  3.44it/s]
 23%|██▎       | 86276/371472 [6:51:35<21:44:08,  3.64it/s]
 23%|██▎       | 86277/371472 [6:51:36<21:29:00,  3.69it/s]
 23%|██▎       | 86278/371472 [6:51:36<21:04:48,  3.76it/s]
 23%|██▎       | 86279/371472 [6:51:36<21:13:43,  3.73it/s]
 23%|██▎       | 86280/371472 [6:51:36<22:41:02,  3.49it/s]
                                                           
{'loss': 4.0469, 'learning_rate': 7.913335775388394e-07, 'epoch': 3.72}

 23%|██▎       | 86280/371472 [6:51:36<22:41:02,  3.49it/s]
 23%|██▎       | 86281/371472 [6:51:37<22:42:21,  3.49it/s]
 23%|██▎       | 86282/371472 [6:51:37<22:26:25,  3.53it/s]
 23%|██▎       | 86283/371472 [6:51:37<23:38:54,  3.35it/s]
 23%|██▎       | 86284/371472 [6:51:38<24:09:56,  3.28it/s]
 23%|██▎       | 86285/371472 [6:51:38<24:06:32,  3.29it/s]
 23%|██▎       | 86286/371472 [6:51:38<25:22:39,  3.12it/s]
 23%|██▎       | 86287/371472 [6:51:39<24:55:07,  3.18it/s]
 23%|██▎       | 86288/371472 [6:51:39<23:18:40,  3.40it/s]
 23%|██▎       | 86289/371472 [6:51:39<21:51:47,  3.62it/s]
 23%|██▎       | 86290/371472 [6:51:39<21:23:29,  3.70it/s]
 23%|██▎       | 86291/371472 [6:51:40<26:05:14,  3.04it/s]
 23%|██▎       | 86292/371472 [6:51:40<23:54:04,  3.31it/s]
 23%|██▎       | 86293/371472 [6:51:40<22:58:12,  3.45it/s]
 23%|██▎       | 86294/371472 [6:51:41<25:24:47,  3.12it/s]
 23%|██▎       | 86295/371472 [6:51:41<24:50:37,  3.19it/s]
 23%|██▎       | 86296/371472 [6:51:41<24:03:05,  3.29it/s]
 23%|██▎       | 86297/371472 [6:51:42<22:40:35,  3.49it/s]
 23%|██▎       | 86298/371472 [6:51:42<22:18:27,  3.55it/s]
 23%|██▎       | 86299/371472 [6:51:42<22:28:55,  3.52it/s]
 23%|██▎       | 86300/371472 [6:51:42<21:51:37,  3.62it/s]
                                                           
{'loss': 3.9189, 'learning_rate': 7.912850955633605e-07, 'epoch': 3.72}

 23%|██▎       | 86300/371472 [6:51:42<21:51:37,  3.62it/s]
 23%|██▎       | 86301/371472 [6:51:43<21:26:03,  3.70it/s]
 23%|██▎       | 86302/371472 [6:51:43<22:33:19,  3.51it/s]
 23%|██▎       | 86303/371472 [6:51:43<21:54:44,  3.62it/s]
 23%|██▎       | 86304/371472 [6:51:43<21:48:33,  3.63it/s]
 23%|██▎       | 86305/371472 [6:51:44<23:15:42,  3.41it/s]
 23%|██▎       | 86306/371472 [6:51:44<24:19:42,  3.26it/s]
 23%|██▎       | 86307/371472 [6:51:44<23:31:37,  3.37it/s]
 23%|██▎       | 86308/371472 [6:51:45<25:17:05,  3.13it/s]
 23%|██▎       | 86309/371472 [6:51:45<24:19:11,  3.26it/s]
 23%|██▎       | 86310/371472 [6:51:45<23:35:17,  3.36it/s]
 23%|██▎       | 86311/371472 [6:51:46<22:35:00,  3.51it/s]
 23%|██▎       | 86312/371472 [6:51:46<21:49:01,  3.63it/s]
 23%|██▎       | 86313/371472 [6:51:46<21:48:03,  3.63it/s]
 23%|██▎       | 86314/371472 [6:51:46<23:50:35,  3.32it/s]
 23%|██▎       | 86315/371472 [6:51:47<24:40:43,  3.21it/s]
 23%|██▎       | 86316/371472 [6:51:47<23:32:06,  3.37it/s]
 23%|██▎       | 86317/371472 [6:51:47<23:51:00,  3.32it/s]
 23%|██▎       | 86318/371472 [6:51:48<23:45:35,  3.33it/s]
 23%|██▎       | 86319/371472 [6:51:48<23:23:39,  3.39it/s]
 23%|██▎       | 86320/371472 [6:51:48<22:49:52,  3.47it/s]
                                                           
{'loss': 3.9028, 'learning_rate': 7.912366135878816e-07, 'epoch': 3.72}

 23%|██▎       | 86320/371472 [6:51:48<22:49:52,  3.47it/s]
 23%|██▎       | 86321/371472 [6:51:49<23:26:01,  3.38it/s]
 23%|██▎       | 86322/371472 [6:51:49<22:22:38,  3.54it/s]
 23%|██▎       | 86323/371472 [6:51:49<23:13:58,  3.41it/s]
 23%|██▎       | 86324/371472 [6:51:49<22:29:16,  3.52it/s]
 23%|██▎       | 86325/371472 [6:51:50<21:59:48,  3.60it/s]
 23%|██▎       | 86326/371472 [6:51:50<20:55:40,  3.78it/s]
 23%|██▎       | 86327/371472 [6:51:50<21:04:27,  3.76it/s]
 23%|██▎       | 86328/371472 [6:51:50<20:55:59,  3.78it/s]
 23%|██▎       | 86329/371472 [6:51:51<20:50:47,  3.80it/s]
 23%|██▎       | 86330/371472 [6:51:51<21:14:29,  3.73it/s]
 23%|██▎       | 86331/371472 [6:51:51<20:49:22,  3.80it/s]
 23%|██▎       | 86332/371472 [6:51:51<20:37:18,  3.84it/s]
 23%|██▎       | 86333/371472 [6:51:52<20:26:59,  3.87it/s]
 23%|██▎       | 86334/371472 [6:51:52<21:09:39,  3.74it/s]
 23%|██▎       | 86335/371472 [6:51:52<21:57:36,  3.61it/s]
 23%|██▎       | 86336/371472 [6:51:53<23:00:02,  3.44it/s]
 23%|██▎       | 86337/371472 [6:51:53<22:17:53,  3.55it/s]
 23%|██▎       | 86338/371472 [6:51:53<22:35:53,  3.50it/s]
 23%|██▎       | 86339/371472 [6:51:54<24:31:23,  3.23it/s]
 23%|██▎       | 86340/371472 [6:51:54<24:55:39,  3.18it/s]
                                                           
{'loss': 3.9573, 'learning_rate': 7.911881316124027e-07, 'epoch': 3.72}

 23%|██▎       | 86340/371472 [6:51:54<24:55:39,  3.18it/s]
 23%|██▎       | 86341/371472 [6:51:54<23:55:16,  3.31it/s]
 23%|██▎       | 86342/371472 [6:51:55<28:14:12,  2.80it/s]
 23%|██▎       | 86343/371472 [6:51:55<25:38:06,  3.09it/s]
 23%|██▎       | 86344/371472 [6:51:55<25:26:39,  3.11it/s]
 23%|██▎       | 86345/371472 [6:51:56<25:58:23,  3.05it/s]
 23%|██▎       | 86346/371472 [6:51:56<25:51:52,  3.06it/s]
 23%|██▎       | 86347/371472 [6:51:56<24:12:54,  3.27it/s]
 23%|██▎       | 86348/371472 [6:51:56<23:17:21,  3.40it/s]
 23%|██▎       | 86349/371472 [6:51:57<23:36:26,  3.35it/s]
 23%|██▎       | 86350/371472 [6:51:57<23:41:10,  3.34it/s]
 23%|██▎       | 86351/371472 [6:51:57<23:25:05,  3.38it/s]
 23%|██▎       | 86352/371472 [6:51:58<24:38:35,  3.21it/s]
 23%|██▎       | 86353/371472 [6:51:58<24:24:56,  3.24it/s]
 23%|██▎       | 86354/371472 [6:51:58<24:04:30,  3.29it/s]
 23%|██▎       | 86355/371472 [6:51:58<23:28:33,  3.37it/s]
 23%|██▎       | 86356/371472 [6:51:59<22:34:43,  3.51it/s]
 23%|██▎       | 86357/371472 [6:51:59<21:52:18,  3.62it/s]
 23%|██▎       | 86358/371472 [6:51:59<21:40:01,  3.66it/s]
 23%|██▎       | 86359/371472 [6:52:00<28:40:36,  2.76it/s]
 23%|██▎       | 86360/371472 [6:52:00<27:10:11,  2.91it/s]
                                                           
{'loss': 3.8091, 'learning_rate': 7.911396496369239e-07, 'epoch': 3.72}

 23%|██▎       | 86360/371472 [6:52:00<27:10:11,  2.91it/s]
 23%|██▎       | 86361/371472 [6:52:00<25:20:33,  3.13it/s]
 23%|██▎       | 86362/371472 [6:52:01<24:07:26,  3.28it/s]
 23%|██▎       | 86363/371472 [6:52:01<25:59:52,  3.05it/s]
 23%|██▎       | 86364/371472 [6:52:01<24:38:13,  3.21it/s]
 23%|██▎       | 86365/371472 [6:52:02<25:40:53,  3.08it/s]
 23%|██▎       | 86366/371472 [6:52:02<24:58:50,  3.17it/s]
 23%|██▎       | 86367/371472 [6:52:02<23:39:48,  3.35it/s]
 23%|██▎       | 86368/371472 [6:52:03<23:21:58,  3.39it/s]
 23%|██▎       | 86369/371472 [6:52:03<22:59:43,  3.44it/s]
 23%|██▎       | 86370/371472 [6:52:03<22:42:55,  3.49it/s]
 23%|██▎       | 86371/371472 [6:52:03<22:37:38,  3.50it/s]
 23%|██▎       | 86372/371472 [6:52:04<21:58:32,  3.60it/s]
 23%|██▎       | 86373/371472 [6:52:04<21:32:11,  3.68it/s]
 23%|██▎       | 86374/371472 [6:52:04<22:10:53,  3.57it/s]
 23%|██▎       | 86375/371472 [6:52:04<21:23:45,  3.70it/s]
 23%|██▎       | 86376/371472 [6:52:05<21:35:04,  3.67it/s]
 23%|██▎       | 86377/371472 [6:52:05<20:41:38,  3.83it/s]
 23%|██▎       | 86378/371472 [6:52:05<21:02:31,  3.76it/s]
 23%|██▎       | 86379/371472 [6:52:05<21:05:13,  3.76it/s]
 23%|██▎       | 86380/371472 [6:52:06<21:23:07,  3.70it/s]
                                                           
{'loss': 3.5977, 'learning_rate': 7.91091167661445e-07, 'epoch': 3.72}

 23%|██▎       | 86380/371472 [6:52:06<21:23:07,  3.70it/s]
 23%|██▎       | 86381/371472 [6:52:06<21:57:53,  3.61it/s]
 23%|██▎       | 86382/371472 [6:52:06<21:18:09,  3.72it/s]
 23%|██▎       | 86383/371472 [6:52:07<21:16:08,  3.72it/s]
 23%|██▎       | 86384/371472 [6:52:07<21:30:19,  3.68it/s]
 23%|██▎       | 86385/371472 [6:52:07<21:21:49,  3.71it/s]
 23%|██▎       | 86386/371472 [6:52:07<21:55:28,  3.61it/s]
 23%|██▎       | 86387/371472 [6:52:08<24:27:10,  3.24it/s]
 23%|██▎       | 86388/371472 [6:52:08<23:08:42,  3.42it/s]
 23%|██▎       | 86389/371472 [6:52:08<23:46:11,  3.33it/s]
 23%|██▎       | 86390/371472 [6:52:09<23:14:00,  3.41it/s]
 23%|██▎       | 86391/371472 [6:52:09<22:46:59,  3.48it/s]
 23%|██▎       | 86392/371472 [6:52:09<21:53:08,  3.62it/s]
 23%|██▎       | 86393/371472 [6:52:09<21:18:45,  3.72it/s]
 23%|██▎       | 86394/371472 [6:52:10<21:31:16,  3.68it/s]
 23%|██▎       | 86395/371472 [6:52:10<23:28:40,  3.37it/s]
 23%|██▎       | 86396/371472 [6:52:10<23:10:15,  3.42it/s]
 23%|██▎       | 86397/371472 [6:52:11<23:05:18,  3.43it/s]
 23%|██▎       | 86398/371472 [6:52:11<22:22:23,  3.54it/s]
 23%|██▎       | 86399/371472 [6:52:11<22:15:24,  3.56it/s]
 23%|██▎       | 86400/371472 [6:52:11<22:20:39,  3.54it/s]
                                                           
{'loss': 3.75, 'learning_rate': 7.91042685685966e-07, 'epoch': 3.72}

 23%|██▎       | 86400/371472 [6:52:11<22:20:39,  3.54it/s]
 23%|██▎       | 86401/371472 [6:52:12<21:55:30,  3.61it/s]
 23%|██▎       | 86402/371472 [6:52:12<21:47:55,  3.63it/s]
 23%|██▎       | 86403/371472 [6:52:12<20:55:55,  3.78it/s]
 23%|██▎       | 86404/371472 [6:52:13<21:58:52,  3.60it/s]
 23%|██▎       | 86405/371472 [6:52:13<22:20:58,  3.54it/s]
 23%|██▎       | 86406/371472 [6:52:13<22:39:28,  3.49it/s]
 23%|██▎       | 86407/371472 [6:52:13<21:55:52,  3.61it/s]
 23%|██▎       | 86408/371472 [6:52:14<22:24:31,  3.53it/s]
 23%|██▎       | 86409/371472 [6:52:14<22:35:47,  3.50it/s]
 23%|██▎       | 86410/371472 [6:52:14<22:12:35,  3.57it/s]
 23%|██▎       | 86411/371472 [6:52:15<22:20:29,  3.54it/s]
 23%|██▎       | 86412/371472 [6:52:15<23:38:17,  3.35it/s]
 23%|██▎       | 86413/371472 [6:52:15<23:13:32,  3.41it/s]
 23%|██▎       | 86414/371472 [6:52:16<25:01:51,  3.16it/s]
 23%|██▎       | 86415/371472 [6:52:16<24:02:38,  3.29it/s]
 23%|██▎       | 86416/371472 [6:52:16<23:05:26,  3.43it/s]
 23%|██▎       | 86417/371472 [6:52:16<23:06:05,  3.43it/s]
 23%|██▎       | 86418/371472 [6:52:17<22:11:26,  3.57it/s]
 23%|██▎       | 86419/371472 [6:52:17<23:45:22,  3.33it/s]
 23%|██▎       | 86420/371472 [6:52:17<22:58:27,  3.45it/s]
                                                           
{'loss': 4.0414, 'learning_rate': 7.909942037104871e-07, 'epoch': 3.72}

 23%|██▎       | 86420/371472 [6:52:17<22:58:27,  3.45it/s]
 23%|██▎       | 86421/371472 [6:52:17<21:48:17,  3.63it/s]
 23%|██▎       | 86422/371472 [6:52:18<22:02:07,  3.59it/s]
 23%|██▎       | 86423/371472 [6:52:18<22:21:29,  3.54it/s]
 23%|██▎       | 86424/371472 [6:52:18<22:10:39,  3.57it/s]
 23%|██▎       | 86425/371472 [6:52:19<21:17:39,  3.72it/s]
 23%|██▎       | 86426/371472 [6:52:19<21:28:28,  3.69it/s]
 23%|██▎       | 86427/371472 [6:52:19<20:49:24,  3.80it/s]
 23%|██▎       | 86428/371472 [6:52:19<20:22:27,  3.89it/s]
 23%|██▎       | 86429/371472 [6:52:20<20:05:38,  3.94it/s]
 23%|██▎       | 86430/371472 [6:52:20<20:36:13,  3.84it/s]
 23%|██▎       | 86431/371472 [6:52:20<21:14:28,  3.73it/s]
 23%|██▎       | 86432/371472 [6:52:20<21:04:28,  3.76it/s]
 23%|██▎       | 86433/371472 [6:52:21<22:07:48,  3.58it/s]
 23%|██▎       | 86434/371472 [6:52:21<22:03:51,  3.59it/s]
 23%|██▎       | 86435/371472 [6:52:21<21:19:23,  3.71it/s]
 23%|██▎       | 86436/371472 [6:52:21<21:23:58,  3.70it/s]
 23%|██▎       | 86437/371472 [6:52:22<22:27:17,  3.53it/s]
 23%|██▎       | 86438/371472 [6:52:22<21:51:17,  3.62it/s]
 23%|██▎       | 86439/371472 [6:52:22<21:59:27,  3.60it/s]
 23%|██▎       | 86440/371472 [6:52:23<21:16:42,  3.72it/s]
                                                           
{'loss': 3.8814, 'learning_rate': 7.909457217350082e-07, 'epoch': 3.72}

 23%|██▎       | 86440/371472 [6:52:23<21:16:42,  3.72it/s]
 23%|██▎       | 86441/371472 [6:52:23<23:01:26,  3.44it/s]
 23%|██▎       | 86442/371472 [6:52:23<25:06:44,  3.15it/s]
 23%|██▎       | 86443/371472 [6:52:24<26:22:05,  3.00it/s]
 23%|██▎       | 86444/371472 [6:52:24<25:08:56,  3.15it/s]
 23%|██▎       | 86445/371472 [6:52:24<23:45:16,  3.33it/s]
 23%|██▎       | 86446/371472 [6:52:24<22:45:04,  3.48it/s]
 23%|██▎       | 86447/371472 [6:52:25<21:23:15,  3.70it/s]
 23%|██▎       | 86448/371472 [6:52:25<21:12:59,  3.73it/s]
 23%|██▎       | 86449/371472 [6:52:25<22:56:44,  3.45it/s]
 23%|██▎       | 86450/371472 [6:52:26<24:07:05,  3.28it/s]
 23%|██▎       | 86451/371472 [6:52:26<25:15:37,  3.13it/s]
 23%|██▎       | 86452/371472 [6:52:26<23:29:29,  3.37it/s]
 23%|██▎       | 86453/371472 [6:52:27<22:31:54,  3.51it/s]
 23%|██▎       | 86454/371472 [6:52:27<22:48:41,  3.47it/s]
 23%|██▎       | 86455/371472 [6:52:27<22:54:36,  3.46it/s]
 23%|██▎       | 86456/371472 [6:52:27<23:53:02,  3.31it/s]
 23%|██▎       | 86457/371472 [6:52:28<23:36:55,  3.35it/s]
 23%|██▎       | 86458/371472 [6:52:28<23:26:22,  3.38it/s]
 23%|██▎       | 86459/371472 [6:52:28<23:19:05,  3.40it/s]
 23%|██▎       | 86460/371472 [6:52:29<22:25:32,  3.53it/s]
                                                           
{'loss': 3.775, 'learning_rate': 7.908972397595294e-07, 'epoch': 3.72}

 23%|██▎       | 86460/371472 [6:52:29<22:25:32,  3.53it/s]
 23%|██▎       | 86461/371472 [6:52:29<22:50:04,  3.47it/s]
 23%|██▎       | 86462/371472 [6:52:29<22:00:23,  3.60it/s]
 23%|██▎       | 86463/371472 [6:52:29<22:06:22,  3.58it/s]
 23%|██▎       | 86464/371472 [6:52:30<23:54:05,  3.31it/s]
 23%|██▎       | 86465/371472 [6:52:30<25:02:31,  3.16it/s]
 23%|██▎       | 86466/371472 [6:52:30<23:46:33,  3.33it/s]
 23%|██▎       | 86467/371472 [6:52:31<24:09:50,  3.28it/s]
 23%|██▎       | 86468/371472 [6:52:31<23:17:48,  3.40it/s]
 23%|██▎       | 86469/371472 [6:52:31<22:46:47,  3.48it/s]
 23%|██▎       | 86470/371472 [6:52:31<21:53:50,  3.62it/s]
 23%|██▎       | 86471/371472 [6:52:32<21:01:32,  3.77it/s]
 23%|██▎       | 86472/371472 [6:52:32<21:17:13,  3.72it/s]
 23%|██▎       | 86473/371472 [6:52:32<21:40:51,  3.65it/s]
 23%|██▎       | 86474/371472 [6:52:33<21:07:12,  3.75it/s]
 23%|██▎       | 86475/371472 [6:52:33<21:14:52,  3.73it/s]
 23%|██▎       | 86476/371472 [6:52:33<21:46:58,  3.63it/s]
 23%|██▎       | 86477/371472 [6:52:33<22:02:33,  3.59it/s]
 23%|██▎       | 86478/371472 [6:52:34<21:20:28,  3.71it/s]
 23%|██▎       | 86479/371472 [6:52:34<21:42:32,  3.65it/s]
 23%|██▎       | 86480/371472 [6:52:34<21:02:46,  3.76it/s]
                                                           
{'loss': 3.9186, 'learning_rate': 7.908487577840505e-07, 'epoch': 3.72}

 23%|██▎       | 86480/371472 [6:52:34<21:02:46,  3.76it/s]
 23%|██▎       | 86481/371472 [6:52:34<20:31:49,  3.86it/s]
 23%|██▎       | 86482/371472 [6:52:35<20:56:04,  3.78it/s]
 23%|██▎       | 86483/371472 [6:52:35<22:10:31,  3.57it/s]
 23%|██▎       | 86484/371472 [6:52:35<22:10:41,  3.57it/s]
 23%|██▎       | 86485/371472 [6:52:36<21:48:34,  3.63it/s]
 23%|██▎       | 86486/371472 [6:52:36<21:33:20,  3.67it/s]
 23%|██▎       | 86487/371472 [6:52:36<21:00:36,  3.77it/s]
 23%|██▎       | 86488/371472 [6:52:36<20:47:56,  3.81it/s]
 23%|██▎       | 86489/371472 [6:52:37<21:03:30,  3.76it/s]
 23%|██▎       | 86490/371472 [6:52:37<20:32:57,  3.85it/s]
 23%|██▎       | 86491/371472 [6:52:37<20:40:55,  3.83it/s]
 23%|██▎       | 86492/371472 [6:52:37<20:52:14,  3.79it/s]
 23%|██▎       | 86493/371472 [6:52:38<21:29:41,  3.68it/s]
 23%|██▎       | 86494/371472 [6:52:38<23:13:32,  3.41it/s]
 23%|██▎       | 86495/371472 [6:52:38<23:21:42,  3.39it/s]
 23%|██▎       | 86496/371472 [6:52:39<24:08:50,  3.28it/s]
 23%|██▎       | 86497/371472 [6:52:39<23:53:50,  3.31it/s]
 23%|██▎       | 86498/371472 [6:52:39<22:42:54,  3.48it/s]
 23%|██▎       | 86499/371472 [6:52:39<23:04:02,  3.43it/s]
 23%|██▎       | 86500/371472 [6:52:40<22:42:38,  3.49it/s]
                                                           
{'loss': 4.0321, 'learning_rate': 7.908002758085716e-07, 'epoch': 3.73}

 23%|██▎       | 86500/371472 [6:52:40<22:42:38,  3.49it/s]
 23%|██▎       | 86501/371472 [6:52:40<22:28:59,  3.52it/s]
 23%|██▎       | 86502/371472 [6:52:40<23:22:07,  3.39it/s]
 23%|██▎       | 86503/371472 [6:52:41<26:04:03,  3.04it/s]
 23%|██▎       | 86504/371472 [6:52:41<24:08:15,  3.28it/s]
 23%|██▎       | 86505/371472 [6:52:41<24:18:58,  3.26it/s]
 23%|██▎       | 86506/371472 [6:52:42<23:12:38,  3.41it/s]
 23%|██▎       | 86507/371472 [6:52:42<22:18:05,  3.55it/s]
 23%|██▎       | 86508/371472 [6:52:42<23:34:51,  3.36it/s]
 23%|██▎       | 86509/371472 [6:52:42<23:06:45,  3.42it/s]
 23%|██▎       | 86510/371472 [6:52:43<23:26:44,  3.38it/s]
 23%|██▎       | 86511/371472 [6:52:43<23:17:22,  3.40it/s]
 23%|██▎       | 86512/371472 [6:52:43<22:31:50,  3.51it/s]
 23%|██▎       | 86513/371472 [6:52:44<23:54:15,  3.31it/s]
 23%|██▎       | 86514/371472 [6:52:44<22:45:34,  3.48it/s]
 23%|██▎       | 86515/371472 [6:52:44<23:16:15,  3.40it/s]
 23%|██▎       | 86516/371472 [6:52:44<23:04:44,  3.43it/s]
 23%|██▎       | 86517/371472 [6:52:45<22:09:30,  3.57it/s]
 23%|██▎       | 86518/371472 [6:52:45<21:58:00,  3.60it/s]
 23%|██▎       | 86519/371472 [6:52:45<22:04:43,  3.59it/s]
 23%|██▎       | 86520/371472 [6:52:46<22:31:38,  3.51it/s]
                                                           
{'loss': 3.9766, 'learning_rate': 7.907517938330927e-07, 'epoch': 3.73}

 23%|██▎       | 86520/371472 [6:52:46<22:31:38,  3.51it/s]
 23%|██▎       | 86521/371472 [6:52:46<21:44:26,  3.64it/s]
 23%|██▎       | 86522/371472 [6:52:46<21:37:11,  3.66it/s]
 23%|██▎       | 86523/371472 [6:52:46<21:45:05,  3.64it/s]
 23%|██▎       | 86524/371472 [6:52:47<22:38:12,  3.50it/s]
 23%|██▎       | 86525/371472 [6:52:47<22:24:06,  3.53it/s]
 23%|██▎       | 86526/371472 [6:52:47<22:03:16,  3.59it/s]
 23%|██▎       | 86527/371472 [6:52:48<22:39:19,  3.49it/s]
 23%|██▎       | 86528/371472 [6:52:48<21:29:11,  3.68it/s]
 23%|██▎       | 86529/371472 [6:52:48<21:02:04,  3.76it/s]
 23%|██▎       | 86530/371472 [6:52:48<22:07:39,  3.58it/s]
 23%|██▎       | 86531/371472 [6:52:49<22:34:11,  3.51it/s]
 23%|██▎       | 86532/371472 [6:52:49<22:40:11,  3.49it/s]
 23%|██▎       | 86533/371472 [6:52:49<21:35:53,  3.66it/s]
 23%|██▎       | 86534/371472 [6:52:50<22:42:56,  3.48it/s]
 23%|██▎       | 86535/371472 [6:52:50<22:24:21,  3.53it/s]
 23%|██▎       | 86536/371472 [6:52:50<23:28:34,  3.37it/s]
 23%|██▎       | 86537/371472 [6:52:50<23:03:51,  3.43it/s]
 23%|██▎       | 86538/371472 [6:52:51<22:48:21,  3.47it/s]
 23%|██▎       | 86539/371472 [6:52:51<22:32:40,  3.51it/s]
 23%|██▎       | 86540/371472 [6:52:51<22:29:04,  3.52it/s]
                                                           
{'loss': 3.8738, 'learning_rate': 7.907033118576137e-07, 'epoch': 3.73}

 23%|██▎       | 86540/371472 [6:52:51<22:29:04,  3.52it/s]
 23%|██▎       | 86541/371472 [6:52:51<22:01:54,  3.59it/s]
 23%|██▎       | 86542/371472 [6:52:52<24:41:59,  3.20it/s]
 23%|██▎       | 86543/371472 [6:52:52<24:20:46,  3.25it/s]
 23%|██▎       | 86544/371472 [6:52:52<22:51:33,  3.46it/s]
 23%|██▎       | 86545/371472 [6:52:53<22:35:02,  3.50it/s]
 23%|██▎       | 86546/371472 [6:52:53<23:45:44,  3.33it/s]
 23%|██▎       | 86547/371472 [6:52:53<24:18:07,  3.26it/s]
 23%|██▎       | 86548/371472 [6:52:54<23:49:04,  3.32it/s]
 23%|██▎       | 86549/371472 [6:52:54<24:23:42,  3.24it/s]
 23%|██▎       | 86550/371472 [6:52:54<24:04:39,  3.29it/s]
 23%|██▎       | 86551/371472 [6:52:55<23:35:58,  3.35it/s]
 23%|██▎       | 86552/371472 [6:52:55<22:41:31,  3.49it/s]
 23%|██▎       | 86553/371472 [6:52:55<22:07:52,  3.58it/s]
 23%|██▎       | 86554/371472 [6:52:55<22:40:31,  3.49it/s]
 23%|██▎       | 86555/371472 [6:52:56<22:27:52,  3.52it/s]
 23%|██▎       | 86556/371472 [6:52:56<22:17:28,  3.55it/s]
 23%|██▎       | 86557/371472 [6:52:56<21:34:21,  3.67it/s]
 23%|██▎       | 86558/371472 [6:52:57<23:22:31,  3.39it/s]
 23%|██▎       | 86559/371472 [6:52:57<22:14:40,  3.56it/s]
 23%|██▎       | 86560/371472 [6:52:57<21:50:36,  3.62it/s]
                                                           
{'loss': 3.8979, 'learning_rate': 7.90654829882135e-07, 'epoch': 3.73}

 23%|██▎       | 86560/371472 [6:52:57<21:50:36,  3.62it/s]
 23%|██▎       | 86561/371472 [6:52:57<21:56:57,  3.61it/s]
 23%|██▎       | 86562/371472 [6:52:58<22:25:28,  3.53it/s]
 23%|██▎       | 86563/371472 [6:52:58<22:11:55,  3.57it/s]
 23%|██▎       | 86564/371472 [6:52:58<22:07:43,  3.58it/s]
 23%|██▎       | 86565/371472 [6:52:58<22:14:21,  3.56it/s]
 23%|██▎       | 86566/371472 [6:52:59<21:34:45,  3.67it/s]
 23%|██▎       | 86567/371472 [6:52:59<22:46:45,  3.47it/s]
 23%|██▎       | 86568/371472 [6:52:59<22:01:17,  3.59it/s]
 23%|██▎       | 86569/371472 [6:53:00<21:00:49,  3.77it/s]
 23%|██▎       | 86570/371472 [6:53:00<20:56:06,  3.78it/s]
 23%|██▎       | 86571/371472 [6:53:00<21:14:29,  3.73it/s]
 23%|██▎       | 86572/371472 [6:53:00<23:41:11,  3.34it/s]
 23%|██▎       | 86573/371472 [6:53:01<22:44:55,  3.48it/s]
 23%|██▎       | 86574/371472 [6:53:01<21:40:29,  3.65it/s]
 23%|██▎       | 86575/371472 [6:53:01<21:36:21,  3.66it/s]
 23%|██▎       | 86576/371472 [6:53:02<22:27:33,  3.52it/s]
 23%|██▎       | 86577/371472 [6:53:02<23:03:25,  3.43it/s]
 23%|██▎       | 86578/371472 [6:53:02<23:45:22,  3.33it/s]
 23%|██▎       | 86579/371472 [6:53:02<24:06:16,  3.28it/s]
 23%|██▎       | 86580/371472 [6:53:03<22:46:08,  3.48it/s]
                                                           
{'loss': 3.818, 'learning_rate': 7.90606347906656e-07, 'epoch': 3.73}

 23%|██▎       | 86580/371472 [6:53:03<22:46:08,  3.48it/s]
 23%|██▎       | 86581/371472 [6:53:03<22:11:53,  3.56it/s]
 23%|██▎       | 86582/371472 [6:53:03<21:54:21,  3.61it/s]
 23%|██▎       | 86583/371472 [6:53:04<21:52:17,  3.62it/s]
 23%|██▎       | 86584/371472 [6:53:04<21:28:29,  3.69it/s]
 23%|██▎       | 86585/371472 [6:53:04<21:47:09,  3.63it/s]
 23%|██▎       | 86586/371472 [6:53:04<21:26:47,  3.69it/s]
 23%|██▎       | 86587/371472 [6:53:05<20:52:45,  3.79it/s]
 23%|██▎       | 86588/371472 [6:53:05<20:52:57,  3.79it/s]
 23%|██▎       | 86589/371472 [6:53:05<20:30:43,  3.86it/s]
 23%|██▎       | 86590/371472 [6:53:05<20:18:49,  3.90it/s]
 23%|██▎       | 86591/371472 [6:53:06<19:37:08,  4.03it/s]
 23%|██▎       | 86592/371472 [6:53:06<21:01:04,  3.77it/s]
 23%|██▎       | 86593/371472 [6:53:06<22:26:31,  3.53it/s]
 23%|██▎       | 86594/371472 [6:53:06<21:51:47,  3.62it/s]
 23%|██▎       | 86595/371472 [6:53:07<21:23:47,  3.70it/s]
 23%|██▎       | 86596/371472 [6:53:07<21:20:10,  3.71it/s]
 23%|██▎       | 86597/371472 [6:53:07<21:54:11,  3.61it/s]
 23%|██▎       | 86598/371472 [6:53:08<21:03:50,  3.76it/s]
 23%|██▎       | 86599/371472 [6:53:08<21:12:29,  3.73it/s]
 23%|██▎       | 86600/371472 [6:53:08<21:46:08,  3.64it/s]
                                                           
{'loss': 4.043, 'learning_rate': 7.905578659311771e-07, 'epoch': 3.73}

 23%|██▎       | 86600/371472 [6:53:08<21:46:08,  3.64it/s]
 23%|██▎       | 86601/371472 [6:53:08<21:41:42,  3.65it/s]
 23%|██▎       | 86602/371472 [6:53:09<21:03:35,  3.76it/s]
 23%|██▎       | 86603/371472 [6:53:09<21:40:16,  3.65it/s]
 23%|██▎       | 86604/371472 [6:53:09<21:13:44,  3.73it/s]
 23%|██▎       | 86605/371472 [6:53:09<22:03:29,  3.59it/s]
 23%|██▎       | 86606/371472 [6:53:10<21:30:38,  3.68it/s]
 23%|██▎       | 86607/371472 [6:53:10<21:02:51,  3.76it/s]
 23%|██▎       | 86608/371472 [6:53:10<20:33:51,  3.85it/s]
 23%|██▎       | 86609/371472 [6:53:10<20:04:20,  3.94it/s]
 23%|██▎       | 86610/371472 [6:53:11<20:07:38,  3.93it/s]
 23%|██▎       | 86611/371472 [6:53:11<19:57:07,  3.97it/s]
 23%|██▎       | 86612/371472 [6:53:11<20:35:27,  3.84it/s]
 23%|██▎       | 86613/371472 [6:53:11<20:30:10,  3.86it/s]
 23%|██▎       | 86614/371472 [6:53:12<20:55:06,  3.78it/s]
 23%|██▎       | 86615/371472 [6:53:12<21:24:38,  3.70it/s]
 23%|██▎       | 86616/371472 [6:53:12<22:22:43,  3.54it/s]
 23%|██▎       | 86617/371472 [6:53:13<22:20:15,  3.54it/s]
 23%|██▎       | 86618/371472 [6:53:13<23:07:10,  3.42it/s]
 23%|██▎       | 86619/371472 [6:53:13<21:38:35,  3.66it/s]
 23%|██▎       | 86620/371472 [6:53:13<20:58:03,  3.77it/s]
                                                           
{'loss': 3.9054, 'learning_rate': 7.905093839556982e-07, 'epoch': 3.73}

 23%|██▎       | 86620/371472 [6:53:13<20:58:03,  3.77it/s]
 23%|██▎       | 86621/371472 [6:53:14<21:23:58,  3.70it/s]
 23%|██▎       | 86622/371472 [6:53:14<23:45:27,  3.33it/s]
 23%|██▎       | 86623/371472 [6:53:14<22:39:15,  3.49it/s]
 23%|██▎       | 86624/371472 [6:53:15<22:34:21,  3.51it/s]
 23%|██▎       | 86625/371472 [6:53:15<21:56:59,  3.60it/s]
 23%|██▎       | 86626/371472 [6:53:15<22:20:18,  3.54it/s]
 23%|██▎       | 86627/371472 [6:53:15<21:58:17,  3.60it/s]
 23%|██▎       | 86628/371472 [6:53:16<23:19:09,  3.39it/s]
 23%|██▎       | 86629/371472 [6:53:16<25:19:02,  3.13it/s]
 23%|██▎       | 86630/371472 [6:53:16<25:33:10,  3.10it/s]
 23%|██▎       | 86631/371472 [6:53:17<24:49:57,  3.19it/s]
 23%|██▎       | 86632/371472 [6:53:17<23:33:57,  3.36it/s]
 23%|██▎       | 86633/371472 [6:53:17<23:01:53,  3.44it/s]
 23%|██▎       | 86634/371472 [6:53:18<22:10:35,  3.57it/s]
 23%|██▎       | 86635/371472 [6:53:18<21:08:52,  3.74it/s]
 23%|██▎       | 86636/371472 [6:53:18<21:23:41,  3.70it/s]
 23%|██▎       | 86637/371472 [6:53:18<21:47:50,  3.63it/s]
 23%|██▎       | 86638/371472 [6:53:19<22:49:00,  3.47it/s]
 23%|██▎       | 86639/371472 [6:53:19<21:56:03,  3.61it/s]
 23%|██▎       | 86640/371472 [6:53:19<22:34:43,  3.50it/s]
                                                           
{'loss': 3.9729, 'learning_rate': 7.904609019802194e-07, 'epoch': 3.73}

 23%|██▎       | 86640/371472 [6:53:19<22:34:43,  3.50it/s]
 23%|██▎       | 86641/371472 [6:53:19<22:03:12,  3.59it/s]
 23%|██▎       | 86642/371472 [6:53:20<21:59:44,  3.60it/s]
 23%|██▎       | 86643/371472 [6:53:20<22:03:49,  3.59it/s]
 23%|██▎       | 86644/371472 [6:53:20<21:02:34,  3.76it/s]
 23%|██▎       | 86645/371472 [6:53:21<24:17:46,  3.26it/s]
 23%|██▎       | 86646/371472 [6:53:21<24:56:25,  3.17it/s]
 23%|██▎       | 86647/371472 [6:53:21<25:29:47,  3.10it/s]
 23%|██▎       | 86648/371472 [6:53:22<24:05:29,  3.28it/s]
 23%|██▎       | 86649/371472 [6:53:22<23:52:12,  3.31it/s]
 23%|██▎       | 86650/371472 [6:53:22<24:23:32,  3.24it/s]
 23%|██▎       | 86651/371472 [6:53:23<23:47:59,  3.32it/s]
 23%|██▎       | 86652/371472 [6:53:23<23:02:35,  3.43it/s]
 23%|██▎       | 86653/371472 [6:53:23<22:37:10,  3.50it/s]
 23%|██▎       | 86654/371472 [6:53:23<23:26:25,  3.38it/s]
 23%|██▎       | 86655/371472 [6:53:24<22:52:32,  3.46it/s]
 23%|██▎       | 86656/371472 [6:53:24<22:39:32,  3.49it/s]
 23%|██▎       | 86657/371472 [6:53:24<22:09:46,  3.57it/s]
 23%|██▎       | 86658/371472 [6:53:25<22:43:01,  3.48it/s]
 23%|██▎       | 86659/371472 [6:53:25<21:40:18,  3.65it/s]
 23%|██▎       | 86660/371472 [6:53:25<21:30:23,  3.68it/s]
                                                           
{'loss': 3.903, 'learning_rate': 7.904124200047404e-07, 'epoch': 3.73}

 23%|██▎       | 86660/371472 [6:53:25<21:30:23,  3.68it/s]
 23%|██▎       | 86661/371472 [6:53:25<21:10:05,  3.74it/s]
 23%|██▎       | 86662/371472 [6:53:26<21:01:46,  3.76it/s]
 23%|██▎       | 86663/371472 [6:53:26<21:20:56,  3.71it/s]
 23%|██▎       | 86664/371472 [6:53:26<21:17:45,  3.71it/s]
 23%|██▎       | 86665/371472 [6:53:26<21:29:23,  3.68it/s]
 23%|██▎       | 86666/371472 [6:53:27<20:55:43,  3.78it/s]
 23%|██▎       | 86667/371472 [6:53:27<20:50:52,  3.79it/s]
 23%|██▎       | 86668/371472 [6:53:27<20:46:32,  3.81it/s]
 23%|██▎       | 86669/371472 [6:53:27<21:25:03,  3.69it/s]
 23%|██▎       | 86670/371472 [6:53:28<21:16:15,  3.72it/s]
 23%|██▎       | 86671/371472 [6:53:28<24:00:57,  3.29it/s]
 23%|██▎       | 86672/371472 [6:53:28<23:30:00,  3.37it/s]
 23%|██▎       | 86673/371472 [6:53:29<24:26:42,  3.24it/s]
 23%|██▎       | 86674/371472 [6:53:29<23:36:22,  3.35it/s]
 23%|██▎       | 86675/371472 [6:53:29<22:17:41,  3.55it/s]
 23%|██▎       | 86676/371472 [6:53:29<21:46:06,  3.63it/s]
 23%|██▎       | 86677/371472 [6:53:30<22:09:16,  3.57it/s]
 23%|██▎       | 86678/371472 [6:53:30<21:45:44,  3.64it/s]
 23%|██▎       | 86679/371472 [6:53:30<22:44:39,  3.48it/s]
 23%|██▎       | 86680/371472 [6:53:31<22:31:22,  3.51it/s]
                                                           
{'loss': 3.9281, 'learning_rate': 7.903639380292615e-07, 'epoch': 3.73}

 23%|██▎       | 86680/371472 [6:53:31<22:31:22,  3.51it/s]
 23%|██▎       | 86681/371472 [6:53:31<21:39:53,  3.65it/s]
 23%|██▎       | 86682/371472 [6:53:31<22:43:07,  3.48it/s]
 23%|██▎       | 86683/371472 [6:53:31<22:09:58,  3.57it/s]
 23%|██▎       | 86684/371472 [6:53:32<21:57:23,  3.60it/s]
 23%|██▎       | 86685/371472 [6:53:32<21:23:08,  3.70it/s]
 23%|██▎       | 86686/371472 [6:53:32<21:12:10,  3.73it/s]
 23%|██▎       | 86687/371472 [6:53:33<21:01:15,  3.76it/s]
 23%|██▎       | 86688/371472 [6:53:33<21:49:12,  3.63it/s]
 23%|██▎       | 86689/371472 [6:53:33<22:36:18,  3.50it/s]
 23%|██▎       | 86690/371472 [6:53:33<22:08:23,  3.57it/s]
 23%|██▎       | 86691/371472 [6:53:34<23:09:10,  3.42it/s]
 23%|██▎       | 86692/371472 [6:53:34<24:45:07,  3.20it/s]
 23%|██▎       | 86693/371472 [6:53:34<23:27:02,  3.37it/s]
 23%|██▎       | 86694/371472 [6:53:35<22:30:07,  3.52it/s]
 23%|██▎       | 86695/371472 [6:53:35<22:53:51,  3.45it/s]
 23%|██▎       | 86696/371472 [6:53:35<21:58:49,  3.60it/s]
 23%|██▎       | 86697/371472 [6:53:35<22:40:46,  3.49it/s]
 23%|██▎       | 86698/371472 [6:53:36<22:05:49,  3.58it/s]
 23%|██▎       | 86699/371472 [6:53:36<21:59:17,  3.60it/s]
 23%|██▎       | 86700/371472 [6:53:36<21:37:39,  3.66it/s]
                                                           
{'loss': 3.9402, 'learning_rate': 7.903154560537826e-07, 'epoch': 3.73}

 23%|██▎       | 86700/371472 [6:53:36<21:37:39,  3.66it/s]
 23%|██▎       | 86701/371472 [6:53:37<21:50:21,  3.62it/s]
 23%|██▎       | 86702/371472 [6:53:37<21:09:27,  3.74it/s]
 23%|██▎       | 86703/371472 [6:53:37<21:02:10,  3.76it/s]
 23%|██▎       | 86704/371472 [6:53:37<21:21:27,  3.70it/s]
 23%|██▎       | 86705/371472 [6:53:38<25:01:15,  3.16it/s]
 23%|██▎       | 86706/371472 [6:53:38<23:30:26,  3.36it/s]
 23%|██▎       | 86707/371472 [6:53:38<23:11:39,  3.41it/s]
 23%|██▎       | 86708/371472 [6:53:39<22:16:53,  3.55it/s]
 23%|██▎       | 86709/371472 [6:53:39<22:06:36,  3.58it/s]
 23%|██▎       | 86710/371472 [6:53:39<22:31:44,  3.51it/s]
 23%|██▎       | 86711/371472 [6:53:39<22:16:40,  3.55it/s]
 23%|██▎       | 86712/371472 [6:53:40<21:42:49,  3.64it/s]
 23%|██▎       | 86713/371472 [6:53:40<21:18:44,  3.71it/s]
 23%|██▎       | 86714/371472 [6:53:40<21:03:36,  3.76it/s]
 23%|██▎       | 86715/371472 [6:53:40<20:37:40,  3.83it/s]
 23%|██▎       | 86716/371472 [6:53:41<20:50:25,  3.80it/s]
 23%|██▎       | 86717/371472 [6:53:41<21:16:13,  3.72it/s]
 23%|██▎       | 86718/371472 [6:53:41<21:25:36,  3.69it/s]
 23%|██▎       | 86719/371472 [6:53:41<21:05:19,  3.75it/s]
 23%|██▎       | 86720/371472 [6:53:42<21:59:37,  3.60it/s]
                                                           
{'loss': 3.896, 'learning_rate': 7.902669740783038e-07, 'epoch': 3.74}

 23%|██▎       | 86720/371472 [6:53:42<21:59:37,  3.60it/s]
 23%|██▎       | 86721/371472 [6:53:42<21:24:48,  3.69it/s]
 23%|██▎       | 86722/371472 [6:53:42<20:58:11,  3.77it/s]
 23%|██▎       | 86723/371472 [6:53:43<20:56:17,  3.78it/s]
 23%|██▎       | 86724/371472 [6:53:43<20:57:42,  3.77it/s]
 23%|██▎       | 86725/371472 [6:53:43<21:47:55,  3.63it/s]
 23%|██▎       | 86726/371472 [6:53:43<22:20:54,  3.54it/s]
 23%|██▎       | 86727/371472 [6:53:44<22:11:41,  3.56it/s]
 23%|██▎       | 86728/371472 [6:53:44<22:17:30,  3.55it/s]
 23%|██▎       | 86729/371472 [6:53:44<21:38:59,  3.65it/s]
 23%|██▎       | 86730/371472 [6:53:44<21:16:48,  3.72it/s]
 23%|██▎       | 86731/371472 [6:53:45<21:37:22,  3.66it/s]
 23%|██▎       | 86732/371472 [6:53:45<21:33:59,  3.67it/s]
 23%|██▎       | 86733/371472 [6:53:45<21:35:20,  3.66it/s]
 23%|██▎       | 86734/371472 [6:53:46<22:44:58,  3.48it/s]
 23%|██▎       | 86735/371472 [6:53:46<22:13:03,  3.56it/s]
 23%|██▎       | 86736/371472 [6:53:46<22:32:47,  3.51it/s]
 23%|██▎       | 86737/371472 [6:53:46<22:44:04,  3.48it/s]
 23%|██▎       | 86738/371472 [6:53:47<22:29:12,  3.52it/s]
 23%|██▎       | 86739/371472 [6:53:47<22:09:27,  3.57it/s]
 23%|██▎       | 86740/371472 [6:53:47<21:59:41,  3.60it/s]
                                                           
{'loss': 4.0376, 'learning_rate': 7.902184921028249e-07, 'epoch': 3.74}

 23%|██▎       | 86740/371472 [6:53:47<21:59:41,  3.60it/s]
 23%|██▎       | 86741/371472 [6:53:48<22:41:19,  3.49it/s]
 23%|██▎       | 86742/371472 [6:53:48<21:50:15,  3.62it/s]
 23%|██▎       | 86743/371472 [6:53:48<22:21:56,  3.54it/s]
 23%|██▎       | 86744/371472 [6:53:48<22:55:43,  3.45it/s]
 23%|██▎       | 86745/371472 [6:53:49<22:34:12,  3.50it/s]
 23%|██▎       | 86746/371472 [6:53:49<22:18:18,  3.55it/s]
 23%|██▎       | 86747/371472 [6:53:49<21:38:14,  3.66it/s]
 23%|██▎       | 86748/371472 [6:53:50<22:54:34,  3.45it/s]
 23%|██▎       | 86749/371472 [6:53:50<23:38:25,  3.35it/s]
 23%|██▎       | 86750/371472 [6:53:50<22:30:46,  3.51it/s]
 23%|██▎       | 86751/371472 [6:53:50<21:52:32,  3.62it/s]
 23%|██▎       | 86752/371472 [6:53:51<21:36:44,  3.66it/s]
 23%|██▎       | 86753/371472 [6:53:51<21:02:23,  3.76it/s]
 23%|██▎       | 86754/371472 [6:53:51<21:48:29,  3.63it/s]
 23%|██▎       | 86755/371472 [6:53:51<21:15:10,  3.72it/s]
 23%|██▎       | 86756/371472 [6:53:52<21:45:31,  3.63it/s]
 23%|██▎       | 86757/371472 [6:53:52<21:21:16,  3.70it/s]
 23%|██▎       | 86758/371472 [6:53:52<21:03:58,  3.75it/s]
 23%|██▎       | 86759/371472 [6:53:53<20:46:09,  3.81it/s]
 23%|██▎       | 86760/371472 [6:53:53<20:53:35,  3.79it/s]
                                                           
{'loss': 3.6785, 'learning_rate': 7.90170010127346e-07, 'epoch': 3.74}

 23%|██▎       | 86760/371472 [6:53:53<20:53:35,  3.79it/s]
 23%|██▎       | 86761/371472 [6:53:53<21:13:41,  3.73it/s]
 23%|██▎       | 86762/371472 [6:53:53<20:46:29,  3.81it/s]
 23%|██▎       | 86763/371472 [6:53:54<20:55:58,  3.78it/s]
 23%|██▎       | 86764/371472 [6:53:54<20:37:27,  3.83it/s]
 23%|██▎       | 86765/371472 [6:53:54<21:28:59,  3.68it/s]
 23%|██▎       | 86766/371472 [6:53:54<21:35:02,  3.66it/s]
 23%|██▎       | 86767/371472 [6:53:55<23:08:52,  3.42it/s]
 23%|██▎       | 86768/371472 [6:53:55<22:21:55,  3.54it/s]
 23%|██▎       | 86769/371472 [6:53:55<22:02:05,  3.59it/s]
 23%|██▎       | 86770/371472 [6:53:56<21:25:28,  3.69it/s]
 23%|██▎       | 86771/371472 [6:53:56<21:04:25,  3.75it/s]
 23%|██▎       | 86772/371472 [6:53:56<21:13:12,  3.73it/s]
 23%|██▎       | 86773/371472 [6:53:56<22:12:56,  3.56it/s]
 23%|██▎       | 86774/371472 [6:53:57<22:58:00,  3.44it/s]
 23%|██▎       | 86775/371472 [6:53:57<22:11:31,  3.56it/s]
 23%|██▎       | 86776/371472 [6:53:57<21:53:09,  3.61it/s]
 23%|██▎       | 86777/371472 [6:53:58<22:49:30,  3.46it/s]
 23%|██▎       | 86778/371472 [6:53:58<26:09:06,  3.02it/s]
 23%|██▎       | 86779/371472 [6:53:58<25:35:35,  3.09it/s]
 23%|██▎       | 86780/371472 [6:53:59<23:41:47,  3.34it/s]
                                                           
{'loss': 3.961, 'learning_rate': 7.90121528151867e-07, 'epoch': 3.74}

 23%|██▎       | 86780/371472 [6:53:59<23:41:47,  3.34it/s]
 23%|██▎       | 86781/371472 [6:53:59<23:53:58,  3.31it/s]
 23%|██▎       | 86782/371472 [6:53:59<23:54:39,  3.31it/s]
 23%|██▎       | 86783/371472 [6:53:59<22:34:59,  3.50it/s]
 23%|██▎       | 86784/371472 [6:54:00<22:44:08,  3.48it/s]
 23%|██▎       | 86785/371472 [6:54:00<21:39:41,  3.65it/s]
 23%|██▎       | 86786/371472 [6:54:00<21:34:53,  3.66it/s]
 23%|██▎       | 86787/371472 [6:54:01<23:01:25,  3.43it/s]
 23%|██▎       | 86788/371472 [6:54:01<22:53:37,  3.45it/s]
 23%|██▎       | 86789/371472 [6:54:01<23:37:38,  3.35it/s]
 23%|██▎       | 86790/371472 [6:54:01<22:08:16,  3.57it/s]
 23%|██▎       | 86791/371472 [6:54:02<21:35:39,  3.66it/s]
 23%|██▎       | 86792/371472 [6:54:02<22:05:47,  3.58it/s]
 23%|██▎       | 86793/371472 [6:54:02<21:29:17,  3.68it/s]
 23%|██▎       | 86794/371472 [6:54:02<21:18:59,  3.71it/s]
 23%|██▎       | 86795/371472 [6:54:03<21:14:59,  3.72it/s]
 23%|██▎       | 86796/371472 [6:54:03<21:17:00,  3.72it/s]
 23%|██▎       | 86797/371472 [6:54:03<21:55:29,  3.61it/s]
 23%|██▎       | 86798/371472 [6:54:04<22:23:30,  3.53it/s]
 23%|██▎       | 86799/371472 [6:54:04<23:07:47,  3.42it/s]
 23%|██▎       | 86800/371472 [6:54:04<22:01:12,  3.59it/s]
                                                           
{'loss': 4.054, 'learning_rate': 7.900730461763881e-07, 'epoch': 3.74}

 23%|██▎       | 86800/371472 [6:54:04<22:01:12,  3.59it/s]
 23%|██▎       | 86801/371472 [6:54:04<22:06:07,  3.58it/s]
 23%|██▎       | 86802/371472 [6:54:05<22:21:17,  3.54it/s]
 23%|██▎       | 86803/371472 [6:54:05<21:38:08,  3.65it/s]
 23%|██▎       | 86804/371472 [6:54:05<20:56:19,  3.78it/s]
 23%|██▎       | 86805/371472 [6:54:05<20:27:17,  3.87it/s]
 23%|██▎       | 86806/371472 [6:54:06<21:39:31,  3.65it/s]
 23%|██▎       | 86807/371472 [6:54:06<21:49:38,  3.62it/s]
 23%|██▎       | 86808/371472 [6:54:06<21:28:25,  3.68it/s]
 23%|██▎       | 86809/371472 [6:54:07<22:38:28,  3.49it/s]
 23%|██▎       | 86810/371472 [6:54:07<22:29:22,  3.52it/s]
 23%|██▎       | 86811/371472 [6:54:07<24:18:10,  3.25it/s]
 23%|██▎       | 86812/371472 [6:54:08<23:39:25,  3.34it/s]
 23%|██▎       | 86813/371472 [6:54:08<22:09:40,  3.57it/s]
 23%|██▎       | 86814/371472 [6:54:08<21:49:34,  3.62it/s]
 23%|██▎       | 86815/371472 [6:54:08<22:34:37,  3.50it/s]
 23%|██▎       | 86816/371472 [6:54:09<25:07:10,  3.15it/s]
 23%|██▎       | 86817/371472 [6:54:09<24:14:59,  3.26it/s]
 23%|██▎       | 86818/371472 [6:54:09<23:08:48,  3.42it/s]
 23%|██▎       | 86819/371472 [6:54:10<22:03:41,  3.58it/s]
 23%|██▎       | 86820/371472 [6:54:10<23:57:19,  3.30it/s]
                                                           
{'loss': 3.9651, 'learning_rate': 7.900245642009092e-07, 'epoch': 3.74}

 23%|██▎       | 86820/371472 [6:54:10<23:57:19,  3.30it/s]
 23%|██▎       | 86821/371472 [6:54:10<23:29:22,  3.37it/s]
 23%|██▎       | 86822/371472 [6:54:10<22:56:41,  3.45it/s]
 23%|██▎       | 86823/371472 [6:54:11<23:42:09,  3.34it/s]
 23%|██▎       | 86824/371472 [6:54:11<23:00:43,  3.44it/s]
 23%|██▎       | 86825/371472 [6:54:11<22:20:08,  3.54it/s]
 23%|██▎       | 86826/371472 [6:54:12<21:32:57,  3.67it/s]
 23%|██▎       | 86827/371472 [6:54:12<22:40:43,  3.49it/s]
 23%|██▎       | 86828/371472 [6:54:12<22:29:24,  3.52it/s]
 23%|██▎       | 86829/371472 [6:54:12<23:40:32,  3.34it/s]
 23%|██▎       | 86830/371472 [6:54:13<22:52:25,  3.46it/s]
 23%|██▎       | 86831/371472 [6:54:13<22:14:51,  3.55it/s]
 23%|██▎       | 86832/371472 [6:54:13<21:08:09,  3.74it/s]
 23%|██▎       | 86833/371472 [6:54:14<21:25:24,  3.69it/s]
 23%|██▎       | 86834/371472 [6:54:14<21:08:14,  3.74it/s]
 23%|██▎       | 86835/371472 [6:54:14<20:38:36,  3.83it/s]
 23%|██▎       | 86836/371472 [6:54:14<23:48:14,  3.32it/s]
 23%|██▎       | 86837/371472 [6:54:15<23:04:35,  3.43it/s]
 23%|██▎       | 86838/371472 [6:54:15<23:12:28,  3.41it/s]
 23%|██▎       | 86839/371472 [6:54:15<22:31:58,  3.51it/s]
 23%|██▎       | 86840/371472 [6:54:16<23:50:28,  3.32it/s]
                                                           
{'loss': 4.0509, 'learning_rate': 7.899760822254304e-07, 'epoch': 3.74}

 23%|██▎       | 86840/371472 [6:54:16<23:50:28,  3.32it/s]
 23%|██▎       | 86841/371472 [6:54:16<23:02:48,  3.43it/s]
 23%|██▎       | 86842/371472 [6:54:16<21:53:37,  3.61it/s]
 23%|██▎       | 86843/371472 [6:54:16<22:14:44,  3.55it/s]
 23%|██▎       | 86844/371472 [6:54:17<22:28:50,  3.52it/s]
 23%|██▎       | 86845/371472 [6:54:17<22:08:50,  3.57it/s]
 23%|██▎       | 86846/371472 [6:54:17<22:12:40,  3.56it/s]
 23%|██▎       | 86847/371472 [6:54:18<21:34:34,  3.66it/s]
 23%|██▎       | 86848/371472 [6:54:18<20:38:03,  3.83it/s]
 23%|██▎       | 86849/371472 [6:54:18<20:37:16,  3.83it/s]
 23%|██▎       | 86850/371472 [6:54:18<21:44:57,  3.64it/s]
 23%|██▎       | 86851/371472 [6:54:19<21:57:01,  3.60it/s]
 23%|██▎       | 86852/371472 [6:54:19<21:14:43,  3.72it/s]
 23%|██▎       | 86853/371472 [6:54:19<21:29:16,  3.68it/s]
 23%|██▎       | 86854/371472 [6:54:19<23:28:26,  3.37it/s]
 23%|██▎       | 86855/371472 [6:54:20<23:06:22,  3.42it/s]
 23%|██▎       | 86856/371472 [6:54:20<24:02:36,  3.29it/s]
 23%|██▎       | 86857/371472 [6:54:20<25:02:04,  3.16it/s]
 23%|██▎       | 86858/371472 [6:54:21<24:09:22,  3.27it/s]
 23%|██▎       | 86859/371472 [6:54:21<23:24:05,  3.38it/s]
 23%|██▎       | 86860/371472 [6:54:21<24:13:41,  3.26it/s]
                                                           
{'loss': 3.9688, 'learning_rate': 7.899276002499515e-07, 'epoch': 3.74}

 23%|██▎       | 86860/371472 [6:54:21<24:13:41,  3.26it/s]
 23%|██▎       | 86861/371472 [6:54:22<23:32:55,  3.36it/s]
 23%|██▎       | 86862/371472 [6:54:22<22:51:44,  3.46it/s]
 23%|██▎       | 86863/371472 [6:54:22<23:48:14,  3.32it/s]
 23%|██▎       | 86864/371472 [6:54:23<26:46:23,  2.95it/s]
 23%|██▎       | 86865/371472 [6:54:23<25:00:07,  3.16it/s]
 23%|██▎       | 86866/371472 [6:54:23<28:01:48,  2.82it/s]
 23%|██▎       | 86867/371472 [6:54:24<26:27:19,  2.99it/s]
 23%|██▎       | 86868/371472 [6:54:24<26:32:00,  2.98it/s]
 23%|██▎       | 86869/371472 [6:54:24<24:50:02,  3.18it/s]
 23%|██▎       | 86870/371472 [6:54:24<23:07:14,  3.42it/s]
 23%|██▎       | 86871/371472 [6:54:25<22:06:30,  3.58it/s]
 23%|██▎       | 86872/371472 [6:54:25<21:41:04,  3.65it/s]
 23%|██▎       | 86873/371472 [6:54:25<21:11:12,  3.73it/s]
 23%|██▎       | 86874/371472 [6:54:26<22:29:41,  3.51it/s]
 23%|██▎       | 86875/371472 [6:54:26<21:39:15,  3.65it/s]
 23%|██▎       | 86876/371472 [6:54:26<21:48:53,  3.62it/s]
 23%|██▎       | 86877/371472 [6:54:26<21:21:36,  3.70it/s]
 23%|██▎       | 86878/371472 [6:54:27<20:39:40,  3.83it/s]
 23%|██▎       | 86879/371472 [6:54:27<20:54:14,  3.78it/s]
 23%|██▎       | 86880/371472 [6:54:27<21:42:19,  3.64it/s]
                                                           
{'loss': 4.0626, 'learning_rate': 7.898791182744726e-07, 'epoch': 3.74}

 23%|██▎       | 86880/371472 [6:54:27<21:42:19,  3.64it/s]
 23%|██▎       | 86881/371472 [6:54:27<21:23:13,  3.70it/s]
 23%|██▎       | 86882/371472 [6:54:28<21:00:34,  3.76it/s]
 23%|██▎       | 86883/371472 [6:54:28<23:47:04,  3.32it/s]
 23%|██▎       | 86884/371472 [6:54:28<23:16:44,  3.40it/s]
 23%|██▎       | 86885/371472 [6:54:29<22:22:58,  3.53it/s]
 23%|██▎       | 86886/371472 [6:54:29<23:11:42,  3.41it/s]
 23%|██▎       | 86887/371472 [6:54:29<25:03:37,  3.15it/s]
 23%|██▎       | 86888/371472 [6:54:30<23:27:25,  3.37it/s]
 23%|██▎       | 86889/371472 [6:54:30<23:35:03,  3.35it/s]
 23%|██▎       | 86890/371472 [6:54:30<24:17:41,  3.25it/s]
 23%|██▎       | 86891/371472 [6:54:30<24:51:19,  3.18it/s]
 23%|██▎       | 86892/371472 [6:54:31<23:50:04,  3.32it/s]
 23%|██▎       | 86893/371472 [6:54:31<24:26:48,  3.23it/s]
 23%|██▎       | 86894/371472 [6:54:31<22:34:39,  3.50it/s]
 23%|██▎       | 86895/371472 [6:54:32<24:01:52,  3.29it/s]
 23%|██▎       | 86896/371472 [6:54:32<23:05:16,  3.42it/s]
 23%|██▎       | 86897/371472 [6:54:32<24:22:55,  3.24it/s]
 23%|██▎       | 86898/371472 [6:54:33<24:34:29,  3.22it/s]
 23%|██▎       | 86899/371472 [6:54:33<23:13:28,  3.40it/s]
 23%|██▎       | 86900/371472 [6:54:33<22:20:21,  3.54it/s]
                                                           
{'loss': 3.946, 'learning_rate': 7.898306362989937e-07, 'epoch': 3.74}

 23%|██▎       | 86900/371472 [6:54:33<22:20:21,  3.54it/s]
 23%|██▎       | 86901/371472 [6:54:33<23:19:54,  3.39it/s]
 23%|██▎       | 86902/371472 [6:54:34<23:38:41,  3.34it/s]
 23%|██▎       | 86903/371472 [6:54:34<23:03:21,  3.43it/s]
 23%|██▎       | 86904/371472 [6:54:34<22:24:51,  3.53it/s]
 23%|██▎       | 86905/371472 [6:54:35<21:39:08,  3.65it/s]
 23%|██▎       | 86906/371472 [6:54:35<21:20:42,  3.70it/s]
 23%|██▎       | 86907/371472 [6:54:35<21:29:36,  3.68it/s]
 23%|██▎       | 86908/371472 [6:54:35<21:37:57,  3.65it/s]
 23%|██▎       | 86909/371472 [6:54:36<22:55:04,  3.45it/s]
 23%|██▎       | 86910/371472 [6:54:36<22:49:18,  3.46it/s]
 23%|██▎       | 86911/371472 [6:54:36<22:59:52,  3.44it/s]
 23%|██▎       | 86912/371472 [6:54:37<22:51:45,  3.46it/s]
 23%|██▎       | 86913/371472 [6:54:37<22:33:52,  3.50it/s]
 23%|██▎       | 86914/371472 [6:54:37<22:05:36,  3.58it/s]
 23%|██▎       | 86915/371472 [6:54:37<21:29:13,  3.68it/s]
 23%|██▎       | 86916/371472 [6:54:38<23:35:39,  3.35it/s]
 23%|██▎       | 86917/371472 [6:54:38<24:27:25,  3.23it/s]
 23%|██▎       | 86918/371472 [6:54:38<23:38:12,  3.34it/s]
 23%|██▎       | 86919/371472 [6:54:39<23:14:36,  3.40it/s]
 23%|██▎       | 86920/371472 [6:54:39<23:07:17,  3.42it/s]
                                                           
{'loss': 3.9239, 'learning_rate': 7.897821543235148e-07, 'epoch': 3.74}

 23%|██▎       | 86920/371472 [6:54:39<23:07:17,  3.42it/s]
 23%|██▎       | 86921/371472 [6:54:39<22:21:16,  3.54it/s]
 23%|██▎       | 86922/371472 [6:54:39<22:16:17,  3.55it/s]
 23%|██▎       | 86923/371472 [6:54:40<23:01:29,  3.43it/s]
 23%|██▎       | 86924/371472 [6:54:40<22:12:26,  3.56it/s]
 23%|██▎       | 86925/371472 [6:54:40<22:04:20,  3.58it/s]
 23%|██▎       | 86926/371472 [6:54:41<22:16:57,  3.55it/s]
 23%|██▎       | 86927/371472 [6:54:41<23:32:43,  3.36it/s]
 23%|██▎       | 86928/371472 [6:54:41<22:15:28,  3.55it/s]
 23%|██▎       | 86929/371472 [6:54:41<21:25:40,  3.69it/s]
 23%|██▎       | 86930/371472 [6:54:42<21:43:18,  3.64it/s]
 23%|██▎       | 86931/371472 [6:54:42<21:42:37,  3.64it/s]
 23%|██▎       | 86932/371472 [6:54:42<21:39:50,  3.65it/s]
 23%|██▎       | 86933/371472 [6:54:42<21:37:56,  3.65it/s]
 23%|██▎       | 86934/371472 [6:54:43<21:32:37,  3.67it/s]
 23%|██▎       | 86935/371472 [6:54:43<21:36:03,  3.66it/s]
 23%|██▎       | 86936/371472 [6:54:43<21:25:09,  3.69it/s]
 23%|██▎       | 86937/371472 [6:54:44<22:06:27,  3.58it/s]
 23%|██▎       | 86938/371472 [6:54:44<21:41:55,  3.64it/s]
 23%|██▎       | 86939/371472 [6:54:44<21:56:18,  3.60it/s]
 23%|██▎       | 86940/371472 [6:54:44<21:40:04,  3.65it/s]
                                                           
{'loss': 3.8131, 'learning_rate': 7.897336723480359e-07, 'epoch': 3.74}

 23%|██▎       | 86940/371472 [6:54:44<21:40:04,  3.65it/s]
 23%|██▎       | 86941/371472 [6:54:45<22:19:00,  3.54it/s]
 23%|██▎       | 86942/371472 [6:54:45<22:52:34,  3.45it/s]
 23%|██▎       | 86943/371472 [6:54:45<22:56:07,  3.45it/s]
 23%|██▎       | 86944/371472 [6:54:46<23:30:07,  3.36it/s]
 23%|██▎       | 86945/371472 [6:54:46<23:25:33,  3.37it/s]
 23%|██▎       | 86946/371472 [6:54:46<23:30:03,  3.36it/s]
 23%|██▎       | 86947/371472 [6:54:46<22:55:38,  3.45it/s]
 23%|██▎       | 86948/371472 [6:54:47<22:08:19,  3.57it/s]
 23%|██▎       | 86949/371472 [6:54:47<21:47:56,  3.63it/s]
 23%|██▎       | 86950/371472 [6:54:47<20:51:54,  3.79it/s]
 23%|██▎       | 86951/371472 [6:54:48<21:20:22,  3.70it/s]
 23%|██▎       | 86952/371472 [6:54:48<22:20:39,  3.54it/s]
 23%|██▎       | 86953/371472 [6:54:48<21:32:02,  3.67it/s]
 23%|██▎       | 86954/371472 [6:54:48<22:06:21,  3.58it/s]
 23%|██▎       | 86955/371472 [6:54:49<21:39:29,  3.65it/s]
 23%|██▎       | 86956/371472 [6:54:49<23:52:46,  3.31it/s]
 23%|██▎       | 86957/371472 [6:54:49<22:37:02,  3.49it/s]
 23%|██▎       | 86958/371472 [6:54:50<22:11:05,  3.56it/s]
 23%|██▎       | 86959/371472 [6:54:50<22:14:56,  3.55it/s]
 23%|██▎       | 86960/371472 [6:54:50<21:29:39,  3.68it/s]
                                                           
{'loss': 3.8613, 'learning_rate': 7.89685190372557e-07, 'epoch': 3.75}

 23%|██▎       | 86960/371472 [6:54:50<21:29:39,  3.68it/s]
 23%|██▎       | 86961/371472 [6:54:50<21:55:46,  3.60it/s]
 23%|██▎       | 86962/371472 [6:54:51<22:01:59,  3.59it/s]
 23%|██▎       | 86963/371472 [6:54:51<22:14:58,  3.55it/s]
 23%|██▎       | 86964/371472 [6:54:51<23:47:58,  3.32it/s]
 23%|██▎       | 86965/371472 [6:54:52<23:19:55,  3.39it/s]
 23%|██▎       | 86966/371472 [6:54:52<23:01:15,  3.43it/s]
 23%|██▎       | 86967/371472 [6:54:52<23:04:38,  3.42it/s]
 23%|██▎       | 86968/371472 [6:54:52<23:27:54,  3.37it/s]
 23%|██▎       | 86969/371472 [6:54:53<23:14:23,  3.40it/s]
 23%|██▎       | 86970/371472 [6:54:53<23:00:59,  3.43it/s]
 23%|██▎       | 86971/371472 [6:54:53<23:49:51,  3.32it/s]
 23%|██▎       | 86972/371472 [6:54:54<24:35:24,  3.21it/s]
 23%|██▎       | 86973/371472 [6:54:54<23:58:19,  3.30it/s]
 23%|██▎       | 86974/371472 [6:54:54<22:51:44,  3.46it/s]
 23%|██▎       | 86975/371472 [6:54:55<23:53:49,  3.31it/s]
 23%|██▎       | 86976/371472 [6:54:55<23:44:47,  3.33it/s]
 23%|██▎       | 86977/371472 [6:54:55<22:40:33,  3.49it/s]
 23%|██▎       | 86978/371472 [6:54:55<21:34:37,  3.66it/s]
 23%|██▎       | 86979/371472 [6:54:56<20:54:57,  3.78it/s]
 23%|██▎       | 86980/371472 [6:54:56<21:23:55,  3.69it/s]
                                                           
{'loss': 3.9029, 'learning_rate': 7.89636708397078e-07, 'epoch': 3.75}

 23%|██▎       | 86980/371472 [6:54:56<21:23:55,  3.69it/s]
 23%|██▎       | 86981/371472 [6:54:56<22:18:09,  3.54it/s]
 23%|██▎       | 86982/371472 [6:54:56<22:29:02,  3.51it/s]
 23%|██▎       | 86983/371472 [6:54:57<22:17:32,  3.54it/s]
 23%|██▎       | 86984/371472 [6:54:57<21:54:44,  3.61it/s]
 23%|██▎       | 86985/371472 [6:54:57<21:17:33,  3.71it/s]
 23%|██▎       | 86986/371472 [6:54:58<22:34:36,  3.50it/s]
 23%|██▎       | 86987/371472 [6:54:58<23:34:10,  3.35it/s]
 23%|██▎       | 86988/371472 [6:54:58<22:50:00,  3.46it/s]
 23%|██▎       | 86989/371472 [6:54:58<22:52:21,  3.45it/s]
 23%|██▎       | 86990/371472 [6:54:59<23:31:47,  3.36it/s]
 23%|██▎       | 86991/371472 [6:54:59<23:13:38,  3.40it/s]
 23%|██▎       | 86992/371472 [6:54:59<22:11:16,  3.56it/s]
 23%|██▎       | 86993/371472 [6:55:00<21:19:08,  3.71it/s]
 23%|██▎       | 86994/371472 [6:55:00<21:14:07,  3.72it/s]
 23%|██▎       | 86995/371472 [6:55:00<21:49:55,  3.62it/s]
 23%|██▎       | 86996/371472 [6:55:00<22:20:02,  3.54it/s]
 23%|██▎       | 86997/371472 [6:55:01<23:29:45,  3.36it/s]
 23%|██▎       | 86998/371472 [6:55:01<23:40:11,  3.34it/s]
 23%|██▎       | 86999/371472 [6:55:01<24:07:45,  3.27it/s]
 23%|██▎       | 87000/371472 [6:55:02<23:47:58,  3.32it/s]
                                                           
{'loss': 3.8923, 'learning_rate': 7.895882264215993e-07, 'epoch': 3.75}

 23%|██▎       | 87000/371472 [6:55:02<23:47:58,  3.32it/s]
 23%|██▎       | 87001/371472 [6:55:02<23:09:30,  3.41it/s]
 23%|██▎       | 87002/371472 [6:55:02<22:34:05,  3.50it/s]
 23%|██▎       | 87003/371472 [6:55:02<22:19:13,  3.54it/s]
 23%|██▎       | 87004/371472 [6:55:03<21:34:13,  3.66it/s]
 23%|██▎       | 87005/371472 [6:55:03<21:09:58,  3.73it/s]
 23%|██▎       | 87006/371472 [6:55:03<21:16:14,  3.71it/s]
 23%|██▎       | 87007/371472 [6:55:04<21:07:20,  3.74it/s]
 23%|██▎       | 87008/371472 [6:55:04<22:21:40,  3.53it/s]
 23%|██▎       | 87009/371472 [6:55:04<21:30:07,  3.67it/s]
 23%|██▎       | 87010/371472 [6:55:04<21:43:42,  3.64it/s]
 23%|██▎       | 87011/371472 [6:55:05<23:57:35,  3.30it/s]
 23%|██▎       | 87012/371472 [6:55:05<22:33:33,  3.50it/s]
 23%|██▎       | 87013/371472 [6:55:05<21:48:47,  3.62it/s]
 23%|██▎       | 87014/371472 [6:55:05<21:37:14,  3.65it/s]
 23%|██▎       | 87015/371472 [6:55:06<23:34:22,  3.35it/s]
 23%|██▎       | 87016/371472 [6:55:06<22:46:55,  3.47it/s]
 23%|██▎       | 87017/371472 [6:55:06<24:08:23,  3.27it/s]
 23%|██▎       | 87018/371472 [6:55:07<23:35:29,  3.35it/s]
 23%|██▎       | 87019/371472 [6:55:07<23:05:10,  3.42it/s]
 23%|██▎       | 87020/371472 [6:55:07<24:35:46,  3.21it/s]
                                                           
{'loss': 3.7386, 'learning_rate': 7.895397444461204e-07, 'epoch': 3.75}

 23%|██▎       | 87020/371472 [6:55:07<24:35:46,  3.21it/s]
 23%|██▎       | 87021/371472 [6:55:08<24:11:23,  3.27it/s]
 23%|██▎       | 87022/371472 [6:55:08<23:36:18,  3.35it/s]
 23%|██▎       | 87023/371472 [6:55:08<23:44:00,  3.33it/s]
 23%|██▎       | 87024/371472 [6:55:09<23:55:47,  3.30it/s]
 23%|██▎       | 87025/371472 [6:55:09<22:28:56,  3.51it/s]
 23%|██▎       | 87026/371472 [6:55:09<21:53:27,  3.61it/s]
 23%|██▎       | 87027/371472 [6:55:09<23:33:25,  3.35it/s]
 23%|██▎       | 87028/371472 [6:55:10<22:38:32,  3.49it/s]
 23%|██▎       | 87029/371472 [6:55:10<21:52:06,  3.61it/s]
 23%|██▎       | 87030/371472 [6:55:10<21:29:14,  3.68it/s]
 23%|██▎       | 87031/371472 [6:55:10<22:23:53,  3.53it/s]
 23%|██▎       | 87032/371472 [6:55:11<22:20:25,  3.54it/s]
 23%|██▎       | 87033/371472 [6:55:11<22:04:55,  3.58it/s]
 23%|██▎       | 87034/371472 [6:55:11<22:56:25,  3.44it/s]
 23%|██▎       | 87035/371472 [6:55:12<22:19:43,  3.54it/s]
 23%|██▎       | 87036/371472 [6:55:12<21:50:14,  3.62it/s]
 23%|██▎       | 87037/371472 [6:55:12<24:11:03,  3.27it/s]
 23%|██▎       | 87038/371472 [6:55:13<24:19:06,  3.25it/s]
 23%|██▎       | 87039/371472 [6:55:13<23:04:05,  3.43it/s]
 23%|██▎       | 87040/371472 [6:55:13<24:08:32,  3.27it/s]
                                                           
{'loss': 3.8649, 'learning_rate': 7.894912624706413e-07, 'epoch': 3.75}

 23%|██▎       | 87040/371472 [6:55:13<24:08:32,  3.27it/s]
 23%|██▎       | 87041/371472 [6:55:14<24:48:42,  3.18it/s]
 23%|██▎       | 87042/371472 [6:55:14<24:48:05,  3.19it/s]
 23%|██▎       | 87043/371472 [6:55:14<27:33:19,  2.87it/s]
 23%|██▎       | 87044/371472 [6:55:15<25:21:12,  3.12it/s]
 23%|██▎       | 87045/371472 [6:55:15<25:59:02,  3.04it/s]
 23%|██▎       | 87046/371472 [6:55:15<24:33:10,  3.22it/s]
 23%|██▎       | 87047/371472 [6:55:15<23:22:44,  3.38it/s]
 23%|██▎       | 87048/371472 [6:55:16<24:04:43,  3.28it/s]
 23%|██▎       | 87049/371472 [6:55:16<23:30:13,  3.36it/s]
 23%|██▎       | 87050/371472 [6:55:16<22:26:44,  3.52it/s]
 23%|██▎       | 87051/371472 [6:55:17<22:14:43,  3.55it/s]
 23%|██▎       | 87052/371472 [6:55:17<22:04:26,  3.58it/s]
 23%|██▎       | 87053/371472 [6:55:17<21:45:03,  3.63it/s]
 23%|██▎       | 87054/371472 [6:55:17<21:11:24,  3.73it/s]
 23%|██▎       | 87055/371472 [6:55:18<23:39:08,  3.34it/s]
 23%|██▎       | 87056/371472 [6:55:18<26:46:17,  2.95it/s]
 23%|██▎       | 87057/371472 [6:55:18<25:19:32,  3.12it/s]
 23%|██▎       | 87058/371472 [6:55:19<23:34:05,  3.35it/s]
 23%|██▎       | 87059/371472 [6:55:19<22:20:45,  3.54it/s]
 23%|██▎       | 87060/371472 [6:55:19<21:29:31,  3.68it/s]
                                                           
{'loss': 3.9059, 'learning_rate': 7.894427804951625e-07, 'epoch': 3.75}

 23%|██▎       | 87060/371472 [6:55:19<21:29:31,  3.68it/s]
 23%|██▎       | 87061/371472 [6:55:19<22:08:03,  3.57it/s]
 23%|██▎       | 87062/371472 [6:55:20<22:13:49,  3.55it/s]
 23%|██▎       | 87063/371472 [6:55:20<22:17:55,  3.54it/s]
 23%|██▎       | 87064/371472 [6:55:20<21:36:22,  3.66it/s]
 23%|██▎       | 87065/371472 [6:55:20<20:59:36,  3.76it/s]
 23%|██▎       | 87066/371472 [6:55:21<20:59:24,  3.76it/s]
 23%|██▎       | 87067/371472 [6:55:21<22:00:12,  3.59it/s]
 23%|██▎       | 87068/371472 [6:55:21<21:36:16,  3.66it/s]
 23%|██▎       | 87069/371472 [6:55:22<22:14:28,  3.55it/s]
 23%|██▎       | 87070/371472 [6:55:22<22:34:16,  3.50it/s]
 23%|██▎       | 87071/371472 [6:55:22<21:40:59,  3.64it/s]
 23%|██▎       | 87072/371472 [6:55:22<22:19:40,  3.54it/s]
 23%|██▎       | 87073/371472 [6:55:23<23:00:25,  3.43it/s]
 23%|██▎       | 87074/371472 [6:55:23<22:52:28,  3.45it/s]
 23%|██▎       | 87075/371472 [6:55:23<23:55:34,  3.30it/s]
 23%|██▎       | 87076/371472 [6:55:24<23:02:35,  3.43it/s]
 23%|██▎       | 87077/371472 [6:55:24<22:02:42,  3.58it/s]
 23%|██▎       | 87078/371472 [6:55:24<23:00:33,  3.43it/s]
 23%|██▎       | 87079/371472 [6:55:24<21:38:50,  3.65it/s]
 23%|██▎       | 87080/371472 [6:55:25<22:12:30,  3.56it/s]
                                                           
{'loss': 3.8373, 'learning_rate': 7.893942985196836e-07, 'epoch': 3.75}

 23%|██▎       | 87080/371472 [6:55:25<22:12:30,  3.56it/s]
 23%|██▎       | 87081/371472 [6:55:25<21:30:25,  3.67it/s]
 23%|██▎       | 87082/371472 [6:55:25<21:26:56,  3.68it/s]
 23%|██▎       | 87083/371472 [6:55:26<24:06:44,  3.28it/s]
 23%|██▎       | 87084/371472 [6:55:26<23:41:11,  3.34it/s]
 23%|██▎       | 87085/371472 [6:55:26<23:06:27,  3.42it/s]
 23%|██▎       | 87086/371472 [6:55:27<23:26:22,  3.37it/s]
 23%|██▎       | 87087/371472 [6:55:27<22:18:17,  3.54it/s]
 23%|██▎       | 87088/371472 [6:55:27<22:09:28,  3.57it/s]
 23%|██▎       | 87089/371472 [6:55:27<21:36:45,  3.66it/s]
 23%|██▎       | 87090/371472 [6:55:28<21:37:16,  3.65it/s]
 23%|██▎       | 87091/371472 [6:55:28<20:47:10,  3.80it/s]
 23%|██▎       | 87092/371472 [6:55:28<20:57:46,  3.77it/s]
 23%|██▎       | 87093/371472 [6:55:28<21:19:50,  3.70it/s]
 23%|██▎       | 87094/371472 [6:55:29<21:54:19,  3.61it/s]
 23%|██▎       | 87095/371472 [6:55:29<22:07:55,  3.57it/s]
 23%|██▎       | 87096/371472 [6:55:29<21:40:47,  3.64it/s]
 23%|██▎       | 87097/371472 [6:55:30<21:37:54,  3.65it/s]
 23%|██▎       | 87098/371472 [6:55:30<21:28:34,  3.68it/s]
 23%|██▎       | 87099/371472 [6:55:30<22:26:35,  3.52it/s]
 23%|██▎       | 87100/371472 [6:55:30<22:09:42,  3.56it/s]
                                                           
{'loss': 4.1028, 'learning_rate': 7.893458165442048e-07, 'epoch': 3.75}

 23%|██▎       | 87100/371472 [6:55:30<22:09:42,  3.56it/s]
 23%|██▎       | 87101/371472 [6:55:31<21:20:55,  3.70it/s]
 23%|██▎       | 87102/371472 [6:55:31<23:49:33,  3.32it/s]
 23%|██▎       | 87103/371472 [6:55:31<24:00:42,  3.29it/s]
 23%|██▎       | 87104/371472 [6:55:32<23:46:51,  3.32it/s]
 23%|██▎       | 87105/371472 [6:55:32<22:41:11,  3.48it/s]
 23%|██▎       | 87106/371472 [6:55:32<21:57:23,  3.60it/s]
 23%|██▎       | 87107/371472 [6:55:32<21:31:55,  3.67it/s]
 23%|██▎       | 87108/371472 [6:55:33<21:22:10,  3.70it/s]
 23%|██▎       | 87109/371472 [6:55:33<20:52:40,  3.78it/s]
 23%|██▎       | 87110/371472 [6:55:33<21:20:01,  3.70it/s]
 23%|██▎       | 87111/371472 [6:55:33<22:55:16,  3.45it/s]
 23%|██▎       | 87112/371472 [6:55:34<23:02:25,  3.43it/s]
 23%|██▎       | 87113/371472 [6:55:34<24:04:37,  3.28it/s]
 23%|██▎       | 87114/371472 [6:55:34<24:02:04,  3.29it/s]
 23%|██▎       | 87115/371472 [6:55:35<23:07:22,  3.42it/s]
 23%|██▎       | 87116/371472 [6:55:35<22:33:03,  3.50it/s]
 23%|██▎       | 87117/371472 [6:55:35<22:58:54,  3.44it/s]
 23%|██▎       | 87118/371472 [6:55:36<22:31:14,  3.51it/s]
 23%|██▎       | 87119/371472 [6:55:36<22:20:18,  3.54it/s]
 23%|██▎       | 87120/371472 [6:55:36<22:27:12,  3.52it/s]
                                                           
{'loss': 3.7742, 'learning_rate': 7.892973345687258e-07, 'epoch': 3.75}

 23%|██▎       | 87120/371472 [6:55:36<22:27:12,  3.52it/s]
 23%|██▎       | 87121/371472 [6:55:36<23:01:24,  3.43it/s]
 23%|██▎       | 87122/371472 [6:55:37<22:00:21,  3.59it/s]
 23%|██▎       | 87123/371472 [6:55:37<21:50:37,  3.62it/s]
 23%|██▎       | 87124/371472 [6:55:37<21:05:32,  3.74it/s]
 23%|██▎       | 87125/371472 [6:55:37<21:07:32,  3.74it/s]
 23%|██▎       | 87126/371472 [6:55:38<20:49:56,  3.79it/s]
 23%|██▎       | 87127/371472 [6:55:38<21:11:12,  3.73it/s]
 23%|██▎       | 87128/371472 [6:55:38<22:40:02,  3.48it/s]
 23%|██▎       | 87129/371472 [6:55:39<23:23:54,  3.38it/s]
 23%|██▎       | 87130/371472 [6:55:39<22:56:21,  3.44it/s]
 23%|██▎       | 87131/371472 [6:55:39<22:36:28,  3.49it/s]
 23%|██▎       | 87132/371472 [6:55:40<24:05:33,  3.28it/s]
 23%|██▎       | 87133/371472 [6:55:40<23:20:16,  3.38it/s]
 23%|██▎       | 87134/371472 [6:55:40<21:55:13,  3.60it/s]
 23%|██▎       | 87135/371472 [6:55:40<22:12:31,  3.56it/s]
 23%|██▎       | 87136/371472 [6:55:41<21:29:42,  3.67it/s]
 23%|██▎       | 87137/371472 [6:55:41<21:51:46,  3.61it/s]
 23%|██▎       | 87138/371472 [6:55:41<21:21:16,  3.70it/s]
 23%|██▎       | 87139/371472 [6:55:41<23:25:09,  3.37it/s]
 23%|██▎       | 87140/371472 [6:55:42<25:36:28,  3.08it/s]
                                                           
{'loss': 3.928, 'learning_rate': 7.89248852593247e-07, 'epoch': 3.75}

 23%|██▎       | 87140/371472 [6:55:42<25:36:28,  3.08it/s]
 23%|██▎       | 87141/371472 [6:55:42<24:13:54,  3.26it/s]
 23%|██▎       | 87142/371472 [6:55:42<24:35:35,  3.21it/s]
 23%|██▎       | 87143/371472 [6:55:43<23:47:48,  3.32it/s]
 23%|██▎       | 87144/371472 [6:55:43<23:32:56,  3.35it/s]
 23%|██▎       | 87145/371472 [6:55:43<23:55:53,  3.30it/s]
 23%|██▎       | 87146/371472 [6:55:44<22:44:49,  3.47it/s]
 23%|██▎       | 87147/371472 [6:55:44<22:35:34,  3.50it/s]
 23%|██▎       | 87148/371472 [6:55:44<22:50:31,  3.46it/s]
 23%|██▎       | 87149/371472 [6:55:44<22:30:49,  3.51it/s]
 23%|██▎       | 87150/371472 [6:55:45<22:48:31,  3.46it/s]
 23%|██▎       | 87151/371472 [6:55:45<22:52:29,  3.45it/s]
 23%|██▎       | 87152/371472 [6:55:45<22:31:55,  3.51it/s]
 23%|██▎       | 87153/371472 [6:55:46<23:58:08,  3.29it/s]
 23%|██▎       | 87154/371472 [6:55:46<23:21:31,  3.38it/s]
 23%|██▎       | 87155/371472 [6:55:46<22:21:48,  3.53it/s]
 23%|██▎       | 87156/371472 [6:55:46<21:52:38,  3.61it/s]
 23%|██▎       | 87157/371472 [6:55:47<21:12:12,  3.72it/s]
 23%|██▎       | 87158/371472 [6:55:47<21:25:34,  3.69it/s]
 23%|██▎       | 87159/371472 [6:55:47<21:26:21,  3.68it/s]
 23%|██▎       | 87160/371472 [6:55:48<22:23:26,  3.53it/s]
                                                           
{'loss': 3.9705, 'learning_rate': 7.892003706177681e-07, 'epoch': 3.75}

 23%|██▎       | 87160/371472 [6:55:48<22:23:26,  3.53it/s]
 23%|██▎       | 87161/371472 [6:55:48<21:16:32,  3.71it/s]
 23%|██▎       | 87162/371472 [6:55:48<20:41:16,  3.82it/s]
 23%|██▎       | 87163/371472 [6:55:48<21:51:23,  3.61it/s]
 23%|██▎       | 87164/371472 [6:55:49<21:43:54,  3.63it/s]
 23%|██▎       | 87165/371472 [6:55:49<22:36:45,  3.49it/s]
 23%|██▎       | 87166/371472 [6:55:49<22:20:34,  3.53it/s]
 23%|██▎       | 87167/371472 [6:55:49<21:47:15,  3.62it/s]
 23%|██▎       | 87168/371472 [6:55:50<21:05:56,  3.74it/s]
 23%|██▎       | 87169/371472 [6:55:50<21:40:13,  3.64it/s]
 23%|██▎       | 87170/371472 [6:55:50<21:29:17,  3.68it/s]
 23%|██▎       | 87171/371472 [6:55:51<22:06:37,  3.57it/s]
 23%|██▎       | 87172/371472 [6:55:51<21:49:15,  3.62it/s]
 23%|██▎       | 87173/371472 [6:55:51<23:16:28,  3.39it/s]
 23%|██▎       | 87174/371472 [6:55:51<22:51:09,  3.46it/s]
 23%|██▎       | 87175/371472 [6:55:52<22:12:46,  3.56it/s]
 23%|██▎       | 87176/371472 [6:55:52<21:23:07,  3.69it/s]
 23%|██▎       | 87177/371472 [6:55:52<20:47:58,  3.80it/s]
 23%|██▎       | 87178/371472 [6:55:52<20:32:25,  3.84it/s]
 23%|██▎       | 87179/371472 [6:55:53<21:41:40,  3.64it/s]
 23%|██▎       | 87180/371472 [6:55:53<21:05:04,  3.75it/s]
                                                           
{'loss': 3.8655, 'learning_rate': 7.891518886422892e-07, 'epoch': 3.76}

 23%|██▎       | 87180/371472 [6:55:53<21:05:04,  3.75it/s]
 23%|██▎       | 87181/371472 [6:55:53<21:18:16,  3.71it/s]
 23%|██▎       | 87182/371472 [6:55:54<20:45:13,  3.81it/s]
 23%|██▎       | 87183/371472 [6:55:54<23:01:25,  3.43it/s]
 23%|██▎       | 87184/371472 [6:55:54<22:47:18,  3.47it/s]
 23%|██▎       | 87185/371472 [6:55:55<23:49:07,  3.32it/s]
 23%|██▎       | 87186/371472 [6:55:55<22:31:33,  3.51it/s]
 23%|██▎       | 87187/371472 [6:55:55<23:11:11,  3.41it/s]
 23%|██▎       | 87188/371472 [6:55:55<23:03:02,  3.43it/s]
 23%|██▎       | 87189/371472 [6:55:56<24:12:09,  3.26it/s]
 23%|██▎       | 87190/371472 [6:55:56<24:05:53,  3.28it/s]
 23%|██▎       | 87191/371472 [6:55:56<23:59:27,  3.29it/s]
 23%|██▎       | 87192/371472 [6:55:57<23:52:20,  3.31it/s]
 23%|██▎       | 87193/371472 [6:55:57<23:49:37,  3.31it/s]
 23%|██▎       | 87194/371472 [6:55:57<24:35:29,  3.21it/s]
 23%|██▎       | 87195/371472 [6:55:58<23:28:42,  3.36it/s]
 23%|██▎       | 87196/371472 [6:55:58<23:38:25,  3.34it/s]
 23%|██▎       | 87197/371472 [6:55:58<23:06:44,  3.42it/s]
 23%|██▎       | 87198/371472 [6:55:58<22:52:02,  3.45it/s]
 23%|██▎       | 87199/371472 [6:55:59<22:05:18,  3.57it/s]
 23%|██▎       | 87200/371472 [6:55:59<22:29:09,  3.51it/s]
                                                           
{'loss': 3.8469, 'learning_rate': 7.891034066668102e-07, 'epoch': 3.76}

 23%|██▎       | 87200/371472 [6:55:59<22:29:09,  3.51it/s]
 23%|██▎       | 87201/371472 [6:55:59<21:53:27,  3.61it/s]
 23%|██▎       | 87202/371472 [6:55:59<21:20:41,  3.70it/s]
 23%|██▎       | 87203/371472 [6:56:00<21:11:06,  3.73it/s]
 23%|██▎       | 87204/371472 [6:56:00<20:55:36,  3.77it/s]
 23%|██▎       | 87205/371472 [6:56:00<22:03:39,  3.58it/s]
 23%|██▎       | 87206/371472 [6:56:01<21:26:57,  3.68it/s]
 23%|██▎       | 87207/371472 [6:56:01<21:18:57,  3.70it/s]
 23%|██▎       | 87208/371472 [6:56:01<21:56:13,  3.60it/s]
 23%|██▎       | 87209/371472 [6:56:01<21:52:23,  3.61it/s]
 23%|██▎       | 87210/371472 [6:56:02<22:13:52,  3.55it/s]
 23%|██▎       | 87211/371472 [6:56:02<22:22:15,  3.53it/s]
 23%|██▎       | 87212/371472 [6:56:02<22:15:07,  3.55it/s]
 23%|██▎       | 87213/371472 [6:56:03<24:24:18,  3.24it/s]
 23%|██▎       | 87214/371472 [6:56:03<23:37:42,  3.34it/s]
 23%|██▎       | 87215/371472 [6:56:03<23:56:42,  3.30it/s]
 23%|██▎       | 87216/371472 [6:56:04<25:34:50,  3.09it/s]
 23%|██▎       | 87217/371472 [6:56:04<24:32:41,  3.22it/s]
 23%|██▎       | 87218/371472 [6:56:04<22:58:55,  3.44it/s]
 23%|██▎       | 87219/371472 [6:56:04<23:37:37,  3.34it/s]
 23%|██▎       | 87220/371472 [6:56:05<22:48:15,  3.46it/s]
                                                           
{'loss': 4.0724, 'learning_rate': 7.890549246913314e-07, 'epoch': 3.76}

 23%|██▎       | 87220/371472 [6:56:05<22:48:15,  3.46it/s]
 23%|██▎       | 87221/371472 [6:56:05<22:35:15,  3.50it/s]
 23%|██▎       | 87222/371472 [6:56:05<22:29:32,  3.51it/s]
 23%|██▎       | 87223/371472 [6:56:06<23:11:01,  3.41it/s]
 23%|██▎       | 87224/371472 [6:56:06<21:38:48,  3.65it/s]
 23%|██▎       | 87225/371472 [6:56:06<21:16:26,  3.71it/s]
 23%|██▎       | 87226/371472 [6:56:06<20:56:42,  3.77it/s]
 23%|██▎       | 87227/371472 [6:56:07<20:47:42,  3.80it/s]
 23%|██▎       | 87228/371472 [6:56:07<20:43:51,  3.81it/s]
 23%|██▎       | 87229/371472 [6:56:07<22:22:31,  3.53it/s]
 23%|██▎       | 87230/371472 [6:56:07<21:58:56,  3.59it/s]
 23%|██▎       | 87231/371472 [6:56:08<23:01:24,  3.43it/s]
 23%|██▎       | 87232/371472 [6:56:08<22:52:35,  3.45it/s]
 23%|██▎       | 87233/371472 [6:56:08<23:29:30,  3.36it/s]
 23%|██▎       | 87234/371472 [6:56:09<23:00:57,  3.43it/s]
 23%|██▎       | 87235/371472 [6:56:09<22:09:32,  3.56it/s]
 23%|██▎       | 87236/371472 [6:56:09<21:40:30,  3.64it/s]
 23%|██▎       | 87237/371472 [6:56:09<20:54:13,  3.78it/s]
 23%|██▎       | 87238/371472 [6:56:10<20:53:45,  3.78it/s]
 23%|██▎       | 87239/371472 [6:56:10<21:49:02,  3.62it/s]
 23%|██▎       | 87240/371472 [6:56:10<22:12:27,  3.56it/s]
                                                           
{'loss': 4.0248, 'learning_rate': 7.890064427158525e-07, 'epoch': 3.76}

 23%|██▎       | 87240/371472 [6:56:10<22:12:27,  3.56it/s]
 23%|██▎       | 87241/371472 [6:56:10<22:05:40,  3.57it/s]
 23%|██▎       | 87242/371472 [6:56:11<22:09:05,  3.56it/s]
 23%|██▎       | 87243/371472 [6:56:11<23:18:54,  3.39it/s]
 23%|██▎       | 87244/371472 [6:56:11<23:42:28,  3.33it/s]
 23%|██▎       | 87245/371472 [6:56:12<23:21:59,  3.38it/s]
 23%|██▎       | 87246/371472 [6:56:12<23:30:55,  3.36it/s]
 23%|██▎       | 87247/371472 [6:56:12<23:08:10,  3.41it/s]
 23%|██▎       | 87248/371472 [6:56:13<23:23:45,  3.37it/s]
 23%|██▎       | 87249/371472 [6:56:13<24:41:18,  3.20it/s]
 23%|██▎       | 87250/371472 [6:56:13<23:45:57,  3.32it/s]
 23%|██▎       | 87251/371472 [6:56:13<23:05:16,  3.42it/s]
 23%|██▎       | 87252/371472 [6:56:14<22:21:13,  3.53it/s]
 23%|██▎       | 87253/371472 [6:56:14<22:41:14,  3.48it/s]
 23%|██▎       | 87254/371472 [6:56:14<21:49:13,  3.62it/s]
 23%|██▎       | 87255/371472 [6:56:15<21:05:08,  3.74it/s]
 23%|██▎       | 87256/371472 [6:56:15<20:40:01,  3.82it/s]
 23%|██▎       | 87257/371472 [6:56:15<20:46:48,  3.80it/s]
 23%|██▎       | 87258/371472 [6:56:15<20:46:12,  3.80it/s]
 23%|██▎       | 87259/371472 [6:56:16<23:05:49,  3.42it/s]
 23%|██▎       | 87260/371472 [6:56:16<22:13:10,  3.55it/s]
                                                           
{'loss': 3.7624, 'learning_rate': 7.889579607403737e-07, 'epoch': 3.76}

 23%|██▎       | 87260/371472 [6:56:16<22:13:10,  3.55it/s]
 23%|██▎       | 87261/371472 [6:56:16<22:44:38,  3.47it/s]
 23%|██▎       | 87262/371472 [6:56:16<21:56:56,  3.60it/s]
 23%|██▎       | 87263/371472 [6:56:17<22:16:21,  3.54it/s]
 23%|██▎       | 87264/371472 [6:56:17<22:17:32,  3.54it/s]
 23%|██▎       | 87265/371472 [6:56:17<22:21:05,  3.53it/s]
 23%|██▎       | 87266/371472 [6:56:18<23:33:46,  3.35it/s]
 23%|██▎       | 87267/371472 [6:56:18<22:09:49,  3.56it/s]
 23%|██▎       | 87268/371472 [6:56:18<22:15:50,  3.55it/s]
 23%|██▎       | 87269/371472 [6:56:19<22:43:09,  3.47it/s]
 23%|██▎       | 87270/371472 [6:56:19<22:44:33,  3.47it/s]
 23%|██▎       | 87271/371472 [6:56:19<22:59:43,  3.43it/s]
 23%|██▎       | 87272/371472 [6:56:19<23:10:23,  3.41it/s]
 23%|██▎       | 87273/371472 [6:56:20<23:16:06,  3.39it/s]
 23%|██▎       | 87274/371472 [6:56:20<24:10:24,  3.27it/s]
 23%|██▎       | 87275/371472 [6:56:20<23:57:09,  3.30it/s]
 23%|██▎       | 87276/371472 [6:56:21<27:33:59,  2.86it/s]
 23%|██▎       | 87277/371472 [6:56:21<27:33:54,  2.86it/s]
 23%|██▎       | 87278/371472 [6:56:21<25:26:56,  3.10it/s]
 23%|██▎       | 87279/371472 [6:56:22<23:41:17,  3.33it/s]
 23%|██▎       | 87280/371472 [6:56:22<24:03:20,  3.28it/s]
                                                           
{'loss': 3.872, 'learning_rate': 7.889094787648947e-07, 'epoch': 3.76}

 23%|██▎       | 87280/371472 [6:56:22<24:03:20,  3.28it/s]
 23%|██▎       | 87281/371472 [6:56:22<24:56:33,  3.16it/s]
 23%|██▎       | 87282/371472 [6:56:23<24:35:59,  3.21it/s]
 23%|██▎       | 87283/371472 [6:56:23<24:29:29,  3.22it/s]
 23%|██▎       | 87284/371472 [6:56:23<23:53:27,  3.30it/s]
 23%|██▎       | 87285/371472 [6:56:23<22:25:07,  3.52it/s]
 23%|██▎       | 87286/371472 [6:56:24<23:12:36,  3.40it/s]
 23%|██▎       | 87287/371472 [6:56:24<22:47:04,  3.46it/s]
 23%|██▎       | 87288/371472 [6:56:24<22:33:14,  3.50it/s]
 23%|██▎       | 87289/371472 [6:56:25<23:01:19,  3.43it/s]
 23%|██▎       | 87290/371472 [6:56:25<22:59:16,  3.43it/s]
 23%|██▎       | 87291/371472 [6:56:25<22:43:48,  3.47it/s]
 23%|██▎       | 87292/371472 [6:56:25<23:19:17,  3.38it/s]
 23%|██▎       | 87293/371472 [6:56:26<22:18:27,  3.54it/s]
 23%|██▎       | 87294/371472 [6:56:26<22:29:10,  3.51it/s]
 23%|██▎       | 87295/371472 [6:56:26<24:23:09,  3.24it/s]
 24%|██▎       | 87296/371472 [6:56:27<23:45:18,  3.32it/s]
 24%|██▎       | 87297/371472 [6:56:27<23:28:28,  3.36it/s]
 24%|██▎       | 87298/371472 [6:56:27<22:23:54,  3.52it/s]
 24%|██▎       | 87299/371472 [6:56:27<21:16:12,  3.71it/s]
 24%|██▎       | 87300/371472 [6:56:28<20:44:53,  3.80it/s]
                                                           
{'loss': 3.9052, 'learning_rate': 7.888609967894158e-07, 'epoch': 3.76}

 24%|██▎       | 87300/371472 [6:56:28<20:44:53,  3.80it/s]
 24%|██▎       | 87301/371472 [6:56:28<21:07:06,  3.74it/s]
 24%|██▎       | 87302/371472 [6:56:28<22:31:05,  3.51it/s]
 24%|██▎       | 87303/371472 [6:56:29<21:51:57,  3.61it/s]
 24%|██▎       | 87304/371472 [6:56:29<21:17:19,  3.71it/s]
 24%|██▎       | 87305/371472 [6:56:29<20:40:07,  3.82it/s]
 24%|██▎       | 87306/371472 [6:56:29<23:13:22,  3.40it/s]
 24%|██▎       | 87307/371472 [6:56:30<22:39:04,  3.48it/s]
 24%|██▎       | 87308/371472 [6:56:30<22:11:35,  3.56it/s]
 24%|██▎       | 87309/371472 [6:56:30<21:46:16,  3.63it/s]
 24%|██▎       | 87310/371472 [6:56:31<22:37:59,  3.49it/s]
 24%|██▎       | 87311/371472 [6:56:31<24:10:31,  3.27it/s]
 24%|██▎       | 87312/371472 [6:56:31<23:34:20,  3.35it/s]
 24%|██▎       | 87313/371472 [6:56:31<22:46:09,  3.47it/s]
 24%|██▎       | 87314/371472 [6:56:32<23:11:36,  3.40it/s]
 24%|██▎       | 87315/371472 [6:56:32<22:21:53,  3.53it/s]
 24%|██▎       | 87316/371472 [6:56:32<23:22:12,  3.38it/s]
 24%|██▎       | 87317/371472 [6:56:33<22:54:04,  3.45it/s]
 24%|██▎       | 87318/371472 [6:56:33<21:36:23,  3.65it/s]
 24%|██▎       | 87319/371472 [6:56:33<20:47:06,  3.80it/s]
 24%|██▎       | 87320/371472 [6:56:33<21:24:49,  3.69it/s]
                                                           
{'loss': 4.0138, 'learning_rate': 7.888125148139369e-07, 'epoch': 3.76}

 24%|██▎       | 87320/371472 [6:56:33<21:24:49,  3.69it/s]
 24%|██▎       | 87321/371472 [6:56:34<23:36:58,  3.34it/s]
 24%|██▎       | 87322/371472 [6:56:34<24:36:09,  3.21it/s]
 24%|██▎       | 87323/371472 [6:56:34<24:10:46,  3.26it/s]
 24%|██▎       | 87324/371472 [6:56:35<23:38:23,  3.34it/s]
 24%|██▎       | 87325/371472 [6:56:35<22:11:54,  3.56it/s]
 24%|██▎       | 87326/371472 [6:56:35<21:46:23,  3.63it/s]
 24%|██▎       | 87327/371472 [6:56:35<21:31:54,  3.67it/s]
 24%|██▎       | 87328/371472 [6:56:36<20:54:29,  3.78it/s]
 24%|██▎       | 87329/371472 [6:56:36<20:27:59,  3.86it/s]
 24%|██▎       | 87330/371472 [6:56:36<20:54:14,  3.78it/s]
 24%|██▎       | 87331/371472 [6:56:37<23:18:20,  3.39it/s]
 24%|██▎       | 87332/371472 [6:56:37<22:47:05,  3.46it/s]
 24%|██▎       | 87333/371472 [6:56:37<22:05:04,  3.57it/s]
 24%|██▎       | 87334/371472 [6:56:37<21:23:26,  3.69it/s]
 24%|██▎       | 87335/371472 [6:56:38<21:09:48,  3.73it/s]
 24%|██▎       | 87336/371472 [6:56:38<21:23:06,  3.69it/s]
 24%|██▎       | 87337/371472 [6:56:38<23:29:46,  3.36it/s]
 24%|██▎       | 87338/371472 [6:56:39<23:10:54,  3.40it/s]
 24%|██▎       | 87339/371472 [6:56:39<23:05:08,  3.42it/s]
 24%|██▎       | 87340/371472 [6:56:39<22:22:01,  3.53it/s]
                                                           
{'loss': 3.5288, 'learning_rate': 7.88764032838458e-07, 'epoch': 3.76}

 24%|██▎       | 87340/371472 [6:56:39<22:22:01,  3.53it/s]
 24%|██▎       | 87341/371472 [6:56:39<21:52:15,  3.61it/s]
 24%|██▎       | 87342/371472 [6:56:40<21:33:32,  3.66it/s]
 24%|██▎       | 87343/371472 [6:56:40<21:32:58,  3.66it/s]
 24%|██▎       | 87344/371472 [6:56:40<21:46:43,  3.62it/s]
 24%|██▎       | 87345/371472 [6:56:40<21:09:18,  3.73it/s]
 24%|██▎       | 87346/371472 [6:56:41<21:03:49,  3.75it/s]
 24%|██▎       | 87347/371472 [6:56:41<20:48:21,  3.79it/s]
 24%|██▎       | 87348/371472 [6:56:41<20:07:45,  3.92it/s]
 24%|██▎       | 87349/371472 [6:56:41<20:08:59,  3.92it/s]
 24%|██▎       | 87350/371472 [6:56:42<20:31:12,  3.85it/s]
 24%|██▎       | 87351/371472 [6:56:42<20:23:39,  3.87it/s]
 24%|██▎       | 87352/371472 [6:56:42<19:58:13,  3.95it/s]
 24%|██▎       | 87353/371472 [6:56:42<20:31:11,  3.85it/s]
 24%|██▎       | 87354/371472 [6:56:43<22:22:42,  3.53it/s]
 24%|██▎       | 87355/371472 [6:56:43<22:45:21,  3.47it/s]
 24%|██▎       | 87356/371472 [6:56:43<22:13:11,  3.55it/s]
 24%|██▎       | 87357/371472 [6:56:44<22:34:00,  3.50it/s]
 24%|██▎       | 87358/371472 [6:56:44<21:54:25,  3.60it/s]
 24%|██▎       | 87359/371472 [6:56:44<22:11:46,  3.56it/s]
 24%|██▎       | 87360/371472 [6:56:45<23:12:30,  3.40it/s]
                                                           
{'loss': 3.7521, 'learning_rate': 7.887155508629791e-07, 'epoch': 3.76}

 24%|██▎       | 87360/371472 [6:56:45<23:12:30,  3.40it/s]
 24%|██▎       | 87361/371472 [6:56:45<24:04:11,  3.28it/s]
 24%|██▎       | 87362/371472 [6:56:45<23:37:55,  3.34it/s]
 24%|██▎       | 87363/371472 [6:56:46<26:01:17,  3.03it/s]
 24%|██▎       | 87364/371472 [6:56:46<25:06:44,  3.14it/s]
 24%|██▎       | 87365/371472 [6:56:46<23:50:01,  3.31it/s]
 24%|██▎       | 87366/371472 [6:56:46<22:55:07,  3.44it/s]
 24%|██▎       | 87367/371472 [6:56:47<22:36:27,  3.49it/s]
 24%|██▎       | 87368/371472 [6:56:47<22:21:46,  3.53it/s]
 24%|██▎       | 87369/371472 [6:56:47<22:08:46,  3.56it/s]
 24%|██▎       | 87370/371472 [6:56:47<22:05:28,  3.57it/s]
 24%|██▎       | 87371/371472 [6:56:48<21:55:40,  3.60it/s]
 24%|██▎       | 87372/371472 [6:56:48<21:49:09,  3.62it/s]
 24%|██▎       | 87373/371472 [6:56:48<22:09:38,  3.56it/s]
 24%|██▎       | 87374/371472 [6:56:49<24:01:37,  3.28it/s]
 24%|██▎       | 87375/371472 [6:56:49<22:55:29,  3.44it/s]
 24%|██▎       | 87376/371472 [6:56:49<22:28:19,  3.51it/s]
 24%|██▎       | 87377/371472 [6:56:50<22:32:40,  3.50it/s]
 24%|██▎       | 87378/371472 [6:56:50<22:34:26,  3.50it/s]
 24%|██▎       | 87379/371472 [6:56:50<21:43:35,  3.63it/s]
 24%|██▎       | 87380/371472 [6:56:50<21:09:01,  3.73it/s]
                                                           
{'loss': 4.0931, 'learning_rate': 7.886670688875003e-07, 'epoch': 3.76}

 24%|██▎       | 87380/371472 [6:56:50<21:09:01,  3.73it/s]
 24%|██▎       | 87381/371472 [6:56:51<21:32:41,  3.66it/s]
 24%|██▎       | 87382/371472 [6:56:51<21:18:50,  3.70it/s]
 24%|██▎       | 87383/371472 [6:56:51<22:09:24,  3.56it/s]
 24%|██▎       | 87384/371472 [6:56:51<22:37:08,  3.49it/s]
 24%|██▎       | 87385/371472 [6:56:52<22:06:17,  3.57it/s]
 24%|██▎       | 87386/371472 [6:56:52<21:12:48,  3.72it/s]
 24%|██▎       | 87387/371472 [6:56:52<21:52:03,  3.61it/s]
 24%|██▎       | 87388/371472 [6:56:53<23:16:05,  3.39it/s]
 24%|██▎       | 87389/371472 [6:56:53<22:43:44,  3.47it/s]
 24%|██▎       | 87390/371472 [6:56:53<22:25:21,  3.52it/s]
 24%|██▎       | 87391/371472 [6:56:53<21:50:05,  3.61it/s]
 24%|██▎       | 87392/371472 [6:56:54<22:03:12,  3.58it/s]
 24%|██▎       | 87393/371472 [6:56:54<22:28:42,  3.51it/s]
 24%|██▎       | 87394/371472 [6:56:54<21:40:39,  3.64it/s]
 24%|██▎       | 87395/371472 [6:56:55<22:16:25,  3.54it/s]
 24%|██▎       | 87396/371472 [6:56:55<22:25:46,  3.52it/s]
 24%|██▎       | 87397/371472 [6:56:55<22:54:44,  3.44it/s]
 24%|██▎       | 87398/371472 [6:56:55<22:10:50,  3.56it/s]
 24%|██▎       | 87399/371472 [6:56:56<21:53:27,  3.60it/s]
 24%|██▎       | 87400/371472 [6:56:56<23:04:20,  3.42it/s]
                                                           
{'loss': 3.9274, 'learning_rate': 7.886185869120214e-07, 'epoch': 3.76}

 24%|██▎       | 87400/371472 [6:56:56<23:04:20,  3.42it/s]
 24%|██▎       | 87401/371472 [6:56:56<23:03:09,  3.42it/s]
 24%|██▎       | 87402/371472 [6:56:57<22:04:07,  3.58it/s]
 24%|██▎       | 87403/371472 [6:56:57<22:20:21,  3.53it/s]
 24%|██▎       | 87404/371472 [6:56:57<24:15:31,  3.25it/s]
 24%|██▎       | 87405/371472 [6:56:57<23:47:37,  3.32it/s]
 24%|██▎       | 87406/371472 [6:56:58<23:08:13,  3.41it/s]
 24%|██▎       | 87407/371472 [6:56:58<23:36:44,  3.34it/s]
 24%|██▎       | 87408/371472 [6:56:58<23:32:17,  3.35it/s]
 24%|██▎       | 87409/371472 [6:56:59<23:25:42,  3.37it/s]
 24%|██▎       | 87410/371472 [6:56:59<22:52:45,  3.45it/s]
 24%|██▎       | 87411/371472 [6:56:59<23:47:24,  3.32it/s]
 24%|██▎       | 87412/371472 [6:57:00<25:31:20,  3.09it/s]
 24%|██▎       | 87413/371472 [6:57:00<25:36:36,  3.08it/s]
 24%|██▎       | 87414/371472 [6:57:00<25:11:41,  3.13it/s]
 24%|██▎       | 87415/371472 [6:57:01<24:48:50,  3.18it/s]
 24%|██▎       | 87416/371472 [6:57:01<26:31:54,  2.97it/s]
 24%|██▎       | 87417/371472 [6:57:01<24:42:18,  3.19it/s]
 24%|██▎       | 87418/371472 [6:57:01<24:11:18,  3.26it/s]
 24%|██▎       | 87419/371472 [6:57:02<22:51:31,  3.45it/s]
 24%|██▎       | 87420/371472 [6:57:02<21:54:52,  3.60it/s]
                                                           
{'loss': 3.9735, 'learning_rate': 7.885701049365423e-07, 'epoch': 3.77}

 24%|██▎       | 87420/371472 [6:57:02<21:54:52,  3.60it/s]
 24%|██▎       | 87421/371472 [6:57:02<21:24:11,  3.69it/s]
 24%|██▎       | 87422/371472 [6:57:02<20:42:34,  3.81it/s]
 24%|██▎       | 87423/371472 [6:57:03<20:30:23,  3.85it/s]
 24%|██▎       | 87424/371472 [6:57:03<21:15:33,  3.71it/s]
 24%|██▎       | 87425/371472 [6:57:03<21:01:53,  3.75it/s]
 24%|██▎       | 87426/371472 [6:57:04<21:05:19,  3.74it/s]
 24%|██▎       | 87427/371472 [6:57:04<22:26:37,  3.52it/s]
 24%|██▎       | 87428/371472 [6:57:04<21:39:58,  3.64it/s]
 24%|██▎       | 87429/371472 [6:57:04<20:59:19,  3.76it/s]
 24%|██▎       | 87430/371472 [6:57:05<22:12:49,  3.55it/s]
 24%|██▎       | 87431/371472 [6:57:05<23:36:52,  3.34it/s]
 24%|██▎       | 87432/371472 [6:57:05<22:18:44,  3.54it/s]
 24%|██▎       | 87433/371472 [6:57:06<21:24:18,  3.69it/s]
 24%|██▎       | 87434/371472 [6:57:06<21:19:18,  3.70it/s]
 24%|██▎       | 87435/371472 [6:57:06<20:56:48,  3.77it/s]
 24%|██▎       | 87436/371472 [6:57:06<21:08:46,  3.73it/s]
 24%|██▎       | 87437/371472 [6:57:07<22:27:24,  3.51it/s]
 24%|██▎       | 87438/371472 [6:57:07<22:04:13,  3.57it/s]
 24%|██▎       | 87439/371472 [6:57:07<21:37:00,  3.65it/s]
 24%|██▎       | 87440/371472 [6:57:07<21:14:17,  3.71it/s]
                                                           
{'loss': 4.0142, 'learning_rate': 7.885216229610635e-07, 'epoch': 3.77}

 24%|██▎       | 87440/371472 [6:57:07<21:14:17,  3.71it/s]
 24%|██▎       | 87441/371472 [6:57:08<20:32:10,  3.84it/s]
 24%|██▎       | 87442/371472 [6:57:08<20:48:35,  3.79it/s]
 24%|██▎       | 87443/371472 [6:57:08<21:55:15,  3.60it/s]
 24%|██▎       | 87444/371472 [6:57:09<22:17:42,  3.54it/s]
 24%|██▎       | 87445/371472 [6:57:09<24:47:08,  3.18it/s]
 24%|██▎       | 87446/371472 [6:57:09<23:34:04,  3.35it/s]
 24%|██▎       | 87447/371472 [6:57:10<23:50:30,  3.31it/s]
 24%|██▎       | 87448/371472 [6:57:10<23:03:03,  3.42it/s]
 24%|██▎       | 87449/371472 [6:57:10<23:22:58,  3.37it/s]
 24%|██▎       | 87450/371472 [6:57:10<22:29:09,  3.51it/s]
 24%|██▎       | 87451/371472 [6:57:11<22:59:53,  3.43it/s]
 24%|██▎       | 87452/371472 [6:57:11<23:30:13,  3.36it/s]
 24%|██▎       | 87453/371472 [6:57:11<23:06:38,  3.41it/s]
 24%|██▎       | 87454/371472 [6:57:12<24:28:41,  3.22it/s]
 24%|██▎       | 87455/371472 [6:57:12<23:15:35,  3.39it/s]
 24%|██▎       | 87456/371472 [6:57:12<22:29:02,  3.51it/s]
 24%|██▎       | 87457/371472 [6:57:12<21:53:08,  3.60it/s]
 24%|██▎       | 87458/371472 [6:57:13<22:30:56,  3.50it/s]
 24%|██▎       | 87459/371472 [6:57:13<21:43:14,  3.63it/s]
 24%|██▎       | 87460/371472 [6:57:13<22:04:40,  3.57it/s]
                                                           
{'loss': 3.7194, 'learning_rate': 7.884731409855847e-07, 'epoch': 3.77}

 24%|██▎       | 87460/371472 [6:57:13<22:04:40,  3.57it/s]
 24%|██▎       | 87461/371472 [6:57:13<21:26:25,  3.68it/s]
 24%|██▎       | 87462/371472 [6:57:14<21:51:11,  3.61it/s]
 24%|██▎       | 87463/371472 [6:57:14<21:04:34,  3.74it/s]
 24%|██▎       | 87464/371472 [6:57:14<20:55:11,  3.77it/s]
 24%|██▎       | 87465/371472 [6:57:15<21:20:13,  3.70it/s]
 24%|██▎       | 87466/371472 [6:57:15<21:59:59,  3.59it/s]
 24%|██▎       | 87467/371472 [6:57:15<21:49:56,  3.61it/s]
 24%|██▎       | 87468/371472 [6:57:15<21:21:41,  3.69it/s]
 24%|██▎       | 87469/371472 [6:57:16<21:05:28,  3.74it/s]
 24%|██▎       | 87470/371472 [6:57:16<21:01:09,  3.75it/s]
 24%|██▎       | 87471/371472 [6:57:16<22:16:58,  3.54it/s]
 24%|██▎       | 87472/371472 [6:57:16<22:03:37,  3.58it/s]
 24%|██▎       | 87473/371472 [6:57:17<22:28:46,  3.51it/s]
 24%|██▎       | 87474/371472 [6:57:17<21:30:12,  3.67it/s]
 24%|██▎       | 87475/371472 [6:57:17<22:50:26,  3.45it/s]
 24%|██▎       | 87476/371472 [6:57:18<22:41:15,  3.48it/s]
 24%|██▎       | 87477/371472 [6:57:18<22:12:13,  3.55it/s]
 24%|██▎       | 87478/371472 [6:57:18<22:24:26,  3.52it/s]
 24%|██▎       | 87479/371472 [6:57:19<26:37:44,  2.96it/s]
 24%|██▎       | 87480/371472 [6:57:19<25:31:27,  3.09it/s]
                                                           
{'loss': 3.8846, 'learning_rate': 7.884246590101058e-07, 'epoch': 3.77}

 24%|██▎       | 87480/371472 [6:57:19<25:31:27,  3.09it/s]
 24%|██▎       | 87481/371472 [6:57:19<23:45:35,  3.32it/s]
 24%|██▎       | 87482/371472 [6:57:19<23:10:32,  3.40it/s]
 24%|██▎       | 87483/371472 [6:57:20<23:02:57,  3.42it/s]
 24%|██▎       | 87484/371472 [6:57:20<21:52:25,  3.61it/s]
 24%|██▎       | 87485/371472 [6:57:20<21:33:29,  3.66it/s]
 24%|██▎       | 87486/371472 [6:57:21<22:14:37,  3.55it/s]
 24%|██▎       | 87487/371472 [6:57:21<21:01:35,  3.75it/s]
 24%|██▎       | 87488/371472 [6:57:21<20:59:15,  3.76it/s]
 24%|██▎       | 87489/371472 [6:57:21<22:06:53,  3.57it/s]
 24%|██▎       | 87490/371472 [6:57:22<21:55:26,  3.60it/s]
 24%|██▎       | 87491/371472 [6:57:22<22:52:32,  3.45it/s]
 24%|██▎       | 87492/371472 [6:57:22<22:03:37,  3.58it/s]
 24%|██▎       | 87493/371472 [6:57:23<22:53:37,  3.45it/s]
 24%|██▎       | 87494/371472 [6:57:23<22:01:41,  3.58it/s]
 24%|██▎       | 87495/371472 [6:57:23<21:51:55,  3.61it/s]
 24%|██▎       | 87496/371472 [6:57:23<22:22:53,  3.52it/s]
 24%|██▎       | 87497/371472 [6:57:24<22:53:55,  3.44it/s]
 24%|██▎       | 87498/371472 [6:57:24<22:47:47,  3.46it/s]
 24%|██▎       | 87499/371472 [6:57:24<21:56:09,  3.60it/s]
 24%|██▎       | 87500/371472 [6:57:25<22:55:34,  3.44it/s]
                                                           
{'loss': 3.9781, 'learning_rate': 7.883761770346268e-07, 'epoch': 3.77}

 24%|██▎       | 87500/371472 [6:57:25<22:55:34,  3.44it/s]
 24%|██▎       | 87501/371472 [6:57:25<22:15:47,  3.54it/s]
 24%|██▎       | 87502/371472 [6:57:25<21:51:27,  3.61it/s]
 24%|██▎       | 87503/371472 [6:57:25<22:03:11,  3.58it/s]
 24%|██▎       | 87504/371472 [6:57:26<24:28:16,  3.22it/s]
 24%|██▎       | 87505/371472 [6:57:26<23:46:31,  3.32it/s]
 24%|██▎       | 87506/371472 [6:57:26<24:59:34,  3.16it/s]
 24%|██▎       | 87507/371472 [6:57:27<23:48:08,  3.31it/s]
 24%|██▎       | 87508/371472 [6:57:27<23:01:17,  3.43it/s]
 24%|██▎       | 87509/371472 [6:57:27<23:23:04,  3.37it/s]
 24%|██▎       | 87510/371472 [6:57:27<22:49:47,  3.46it/s]
 24%|██▎       | 87511/371472 [6:57:28<22:42:21,  3.47it/s]
 24%|██▎       | 87512/371472 [6:57:28<23:57:04,  3.29it/s]
 24%|██▎       | 87513/371472 [6:57:28<24:15:52,  3.25it/s]
 24%|██▎       | 87514/371472 [6:57:29<23:23:04,  3.37it/s]
 24%|██▎       | 87515/371472 [6:57:29<22:09:45,  3.56it/s]
 24%|██▎       | 87516/371472 [6:57:29<21:34:29,  3.66it/s]
 24%|██▎       | 87517/371472 [6:57:30<22:47:35,  3.46it/s]
 24%|██▎       | 87518/371472 [6:57:30<22:24:57,  3.52it/s]
 24%|██▎       | 87519/371472 [6:57:30<21:39:47,  3.64it/s]
 24%|██▎       | 87520/371472 [6:57:30<22:11:27,  3.55it/s]
                                                           
{'loss': 3.6471, 'learning_rate': 7.88327695059148e-07, 'epoch': 3.77}

 24%|██▎       | 87520/371472 [6:57:30<22:11:27,  3.55it/s]
 24%|██▎       | 87521/371472 [6:57:31<21:46:24,  3.62it/s]
 24%|██▎       | 87522/371472 [6:57:31<21:24:09,  3.69it/s]
 24%|██▎       | 87523/371472 [6:57:31<21:56:02,  3.60it/s]
 24%|██▎       | 87524/371472 [6:57:31<21:56:29,  3.59it/s]
 24%|██▎       | 87525/371472 [6:57:32<23:04:20,  3.42it/s]
 24%|██▎       | 87526/371472 [6:57:32<22:01:00,  3.58it/s]
 24%|██▎       | 87527/371472 [6:57:32<21:42:18,  3.63it/s]
 24%|██▎       | 87528/371472 [6:57:33<21:08:46,  3.73it/s]
 24%|██▎       | 87529/371472 [6:57:33<21:10:32,  3.72it/s]
 24%|██▎       | 87530/371472 [6:57:33<20:19:48,  3.88it/s]
 24%|██▎       | 87531/371472 [6:57:33<20:20:19,  3.88it/s]
 24%|██▎       | 87532/371472 [6:57:34<20:08:15,  3.92it/s]
 24%|██▎       | 87533/371472 [6:57:34<19:30:52,  4.04it/s]
 24%|██▎       | 87534/371472 [6:57:34<19:27:33,  4.05it/s]
 24%|██▎       | 87535/371472 [6:57:34<20:58:11,  3.76it/s]
 24%|██▎       | 87536/371472 [6:57:35<21:22:39,  3.69it/s]
 24%|██▎       | 87537/371472 [6:57:35<25:23:50,  3.11it/s]
 24%|██▎       | 87538/371472 [6:57:35<23:32:35,  3.35it/s]
 24%|██▎       | 87539/371472 [6:57:36<22:39:55,  3.48it/s]
 24%|██▎       | 87540/371472 [6:57:36<21:51:49,  3.61it/s]
                                                           
{'loss': 4.0283, 'learning_rate': 7.882792130836691e-07, 'epoch': 3.77}

 24%|██▎       | 87540/371472 [6:57:36<21:51:49,  3.61it/s]
 24%|██▎       | 87541/371472 [6:57:36<21:39:14,  3.64it/s]
 24%|██▎       | 87542/371472 [6:57:36<23:08:02,  3.41it/s]
 24%|██▎       | 87543/371472 [6:57:37<22:05:14,  3.57it/s]
 24%|██▎       | 87544/371472 [6:57:37<21:32:59,  3.66it/s]
 24%|██▎       | 87545/371472 [6:57:37<21:31:16,  3.66it/s]
 24%|██▎       | 87546/371472 [6:57:37<20:54:25,  3.77it/s]
 24%|██▎       | 87547/371472 [6:57:38<20:35:45,  3.83it/s]
 24%|██▎       | 87548/371472 [6:57:38<20:18:59,  3.88it/s]
 24%|██▎       | 87549/371472 [6:57:38<21:03:50,  3.74it/s]
 24%|██▎       | 87550/371472 [6:57:39<21:36:44,  3.65it/s]
 24%|██▎       | 87551/371472 [6:57:39<22:30:58,  3.50it/s]
 24%|██▎       | 87552/371472 [6:57:39<21:36:05,  3.65it/s]
 24%|██▎       | 87553/371472 [6:57:39<21:31:32,  3.66it/s]
 24%|██▎       | 87554/371472 [6:57:40<22:49:28,  3.46it/s]
 24%|██▎       | 87555/371472 [6:57:40<21:59:34,  3.59it/s]
 24%|██▎       | 87556/371472 [6:57:40<21:12:08,  3.72it/s]
 24%|██▎       | 87557/371472 [6:57:40<20:59:56,  3.76it/s]
 24%|██▎       | 87558/371472 [6:57:41<21:21:57,  3.69it/s]
 24%|██▎       | 87559/371472 [6:57:41<21:08:15,  3.73it/s]
 24%|██▎       | 87560/371472 [6:57:41<22:47:57,  3.46it/s]
                                                           
{'loss': 3.8996, 'learning_rate': 7.882307311081902e-07, 'epoch': 3.77}

 24%|██▎       | 87560/371472 [6:57:41<22:47:57,  3.46it/s]
 24%|██▎       | 87561/371472 [6:57:42<22:39:10,  3.48it/s]
 24%|██▎       | 87562/371472 [6:57:42<23:15:11,  3.39it/s]
 24%|██▎       | 87563/371472 [6:57:42<22:09:52,  3.56it/s]
 24%|██▎       | 87564/371472 [6:57:42<21:41:03,  3.64it/s]
 24%|██▎       | 87565/371472 [6:57:43<21:41:22,  3.64it/s]
 24%|██▎       | 87566/371472 [6:57:43<23:13:04,  3.40it/s]
 24%|██▎       | 87567/371472 [6:57:43<22:36:09,  3.49it/s]
 24%|██▎       | 87568/371472 [6:57:44<22:45:08,  3.47it/s]
 24%|██▎       | 87569/371472 [6:57:44<22:51:15,  3.45it/s]
 24%|██▎       | 87570/371472 [6:57:44<22:02:13,  3.58it/s]
 24%|██▎       | 87571/371472 [6:57:44<21:32:28,  3.66it/s]
 24%|██▎       | 87572/371472 [6:57:45<21:21:10,  3.69it/s]
 24%|██▎       | 87573/371472 [6:57:45<23:32:32,  3.35it/s]
 24%|██▎       | 87574/371472 [6:57:45<23:56:10,  3.29it/s]
 24%|██▎       | 87575/371472 [6:57:46<23:56:53,  3.29it/s]
 24%|██▎       | 87576/371472 [6:57:46<23:28:48,  3.36it/s]
 24%|██▎       | 87577/371472 [6:57:46<23:54:14,  3.30it/s]
 24%|██▎       | 87578/371472 [6:57:47<23:17:53,  3.38it/s]
 24%|██▎       | 87579/371472 [6:57:47<23:00:13,  3.43it/s]
 24%|██▎       | 87580/371472 [6:57:47<21:53:24,  3.60it/s]
                                                           
{'loss': 3.6923, 'learning_rate': 7.881822491327112e-07, 'epoch': 3.77}

 24%|██▎       | 87580/371472 [6:57:47<21:53:24,  3.60it/s]
 24%|██▎       | 87581/371472 [6:57:47<21:21:09,  3.69it/s]
 24%|██▎       | 87582/371472 [6:57:48<22:37:29,  3.49it/s]
 24%|██▎       | 87583/371472 [6:57:48<24:05:12,  3.27it/s]
 24%|██▎       | 87584/371472 [6:57:48<23:57:40,  3.29it/s]
 24%|██▎       | 87585/371472 [6:57:49<23:20:13,  3.38it/s]
 24%|██▎       | 87586/371472 [6:57:49<23:45:17,  3.32it/s]
 24%|██▎       | 87587/371472 [6:57:49<23:02:56,  3.42it/s]
 24%|██▎       | 87588/371472 [6:57:49<22:05:06,  3.57it/s]
 24%|██▎       | 87589/371472 [6:57:50<21:39:03,  3.64it/s]
 24%|██▎       | 87590/371472 [6:57:50<21:48:32,  3.62it/s]
 24%|██▎       | 87591/371472 [6:57:50<21:22:47,  3.69it/s]
 24%|██▎       | 87592/371472 [6:57:50<21:26:55,  3.68it/s]
 24%|██▎       | 87593/371472 [6:57:51<21:34:07,  3.66it/s]
 24%|██▎       | 87594/371472 [6:57:51<21:32:41,  3.66it/s]
 24%|██▎       | 87595/371472 [6:57:51<22:42:41,  3.47it/s]
 24%|██▎       | 87596/371472 [6:57:52<22:12:16,  3.55it/s]
 24%|██▎       | 87597/371472 [6:57:52<21:31:23,  3.66it/s]
 24%|██▎       | 87598/371472 [6:57:52<21:02:51,  3.75it/s]
 24%|██▎       | 87599/371472 [6:57:53<24:11:25,  3.26it/s]
 24%|██▎       | 87600/371472 [6:57:53<23:53:52,  3.30it/s]
                                                           
{'loss': 3.7923, 'learning_rate': 7.881337671572324e-07, 'epoch': 3.77}

 24%|██▎       | 87600/371472 [6:57:53<23:53:52,  3.30it/s]
 24%|██▎       | 87601/371472 [6:57:53<24:45:31,  3.18it/s]
 24%|██▎       | 87602/371472 [6:57:53<24:06:23,  3.27it/s]
 24%|██▎       | 87603/371472 [6:57:54<23:43:50,  3.32it/s]
 24%|██▎       | 87604/371472 [6:57:54<23:51:52,  3.30it/s]
 24%|██▎       | 87605/371472 [6:57:54<23:03:51,  3.42it/s]
 24%|██▎       | 87606/371472 [6:57:55<22:15:53,  3.54it/s]
 24%|██▎       | 87607/371472 [6:57:55<22:40:28,  3.48it/s]
 24%|██▎       | 87608/371472 [6:57:55<22:07:19,  3.56it/s]
 24%|██▎       | 87609/371472 [6:57:55<22:27:06,  3.51it/s]
 24%|██▎       | 87610/371472 [6:57:56<21:51:26,  3.61it/s]
 24%|██▎       | 87611/371472 [6:57:56<21:57:08,  3.59it/s]
 24%|██▎       | 87612/371472 [6:57:56<21:19:41,  3.70it/s]
 24%|██▎       | 87613/371472 [6:57:56<20:57:20,  3.76it/s]
 24%|██▎       | 87614/371472 [6:57:57<22:18:21,  3.53it/s]
 24%|██▎       | 87615/371472 [6:57:57<21:42:25,  3.63it/s]
 24%|██▎       | 87616/371472 [6:57:57<21:29:17,  3.67it/s]
 24%|██▎       | 87617/371472 [6:57:58<21:25:08,  3.68it/s]
 24%|██▎       | 87618/371472 [6:57:58<22:10:46,  3.55it/s]
 24%|██▎       | 87619/371472 [6:57:58<21:57:06,  3.59it/s]
 24%|██▎       | 87620/371472 [6:57:58<21:21:19,  3.69it/s]
                                                           
{'loss': 4.0788, 'learning_rate': 7.880852851817535e-07, 'epoch': 3.77}

 24%|██▎       | 87620/371472 [6:57:58<21:21:19,  3.69it/s]
 24%|██▎       | 87621/371472 [6:57:59<23:51:48,  3.30it/s]
 24%|██▎       | 87622/371472 [6:57:59<22:44:32,  3.47it/s]
 24%|██▎       | 87623/371472 [6:57:59<21:35:11,  3.65it/s]
 24%|██▎       | 87624/371472 [6:58:00<21:09:35,  3.73it/s]
 24%|██▎       | 87625/371472 [6:58:00<22:29:40,  3.51it/s]
 24%|██▎       | 87626/371472 [6:58:00<22:26:02,  3.51it/s]
 24%|██▎       | 87627/371472 [6:58:00<22:47:53,  3.46it/s]
 24%|██▎       | 87628/371472 [6:58:01<22:37:07,  3.49it/s]
 24%|██▎       | 87629/371472 [6:58:01<22:51:09,  3.45it/s]
 24%|██▎       | 87630/371472 [6:58:01<21:58:18,  3.59it/s]
 24%|██▎       | 87631/371472 [6:58:02<22:51:48,  3.45it/s]
 24%|██▎       | 87632/371472 [6:58:02<23:42:29,  3.33it/s]
 24%|██▎       | 87633/371472 [6:58:02<22:29:37,  3.51it/s]
 24%|██▎       | 87634/371472 [6:58:02<22:34:53,  3.49it/s]
 24%|██▎       | 87635/371472 [6:58:03<22:08:02,  3.56it/s]
 24%|██▎       | 87636/371472 [6:58:03<22:56:02,  3.44it/s]
 24%|██▎       | 87637/371472 [6:58:03<22:31:33,  3.50it/s]
 24%|██▎       | 87638/371472 [6:58:04<23:27:55,  3.36it/s]
 24%|██▎       | 87639/371472 [6:58:04<23:30:24,  3.35it/s]
 24%|██▎       | 87640/371472 [6:58:04<22:41:19,  3.47it/s]
                                                           
{'loss': 4.1749, 'learning_rate': 7.880368032062747e-07, 'epoch': 3.77}

 24%|██▎       | 87640/371472 [6:58:04<22:41:19,  3.47it/s]
 24%|██▎       | 87641/371472 [6:58:04<22:38:00,  3.48it/s]
 24%|██▎       | 87642/371472 [6:58:05<22:44:32,  3.47it/s]
 24%|██▎       | 87643/371472 [6:58:05<22:39:36,  3.48it/s]
 24%|██▎       | 87644/371472 [6:58:05<22:56:28,  3.44it/s]
 24%|██▎       | 87645/371472 [6:58:06<23:24:37,  3.37it/s]
 24%|██▎       | 87646/371472 [6:58:06<24:00:06,  3.28it/s]
 24%|██▎       | 87647/371472 [6:58:06<24:03:33,  3.28it/s]
 24%|██▎       | 87648/371472 [6:58:07<23:21:50,  3.37it/s]
 24%|██▎       | 87649/371472 [6:58:07<22:27:54,  3.51it/s]
 24%|██▎       | 87650/371472 [6:58:07<23:17:01,  3.39it/s]
 24%|██▎       | 87651/371472 [6:58:08<24:49:42,  3.18it/s]
 24%|██▎       | 87652/371472 [6:58:08<25:30:50,  3.09it/s]
 24%|██▎       | 87653/371472 [6:58:08<24:06:12,  3.27it/s]
 24%|██▎       | 87654/371472 [6:58:08<23:47:37,  3.31it/s]
 24%|██▎       | 87655/371472 [6:58:09<22:40:58,  3.48it/s]
 24%|██▎       | 87656/371472 [6:58:09<21:32:41,  3.66it/s]
 24%|██▎       | 87657/371472 [6:58:09<20:59:33,  3.76it/s]
 24%|██▎       | 87658/371472 [6:58:09<21:59:23,  3.59it/s]
 24%|██▎       | 87659/371472 [6:58:10<22:26:12,  3.51it/s]
 24%|██▎       | 87660/371472 [6:58:10<23:07:17,  3.41it/s]
                                                           
{'loss': 3.9226, 'learning_rate': 7.879883212307957e-07, 'epoch': 3.78}

 24%|██▎       | 87660/371472 [6:58:10<23:07:17,  3.41it/s]
 24%|██▎       | 87661/371472 [6:58:10<22:48:50,  3.46it/s]
 24%|██▎       | 87662/371472 [6:58:11<22:26:14,  3.51it/s]
 24%|██▎       | 87663/371472 [6:58:11<22:42:12,  3.47it/s]
 24%|██▎       | 87664/371472 [6:58:11<22:26:37,  3.51it/s]
 24%|██▎       | 87665/371472 [6:58:11<21:34:12,  3.65it/s]
 24%|██▎       | 87666/371472 [6:58:12<21:00:03,  3.75it/s]
 24%|██▎       | 87667/371472 [6:58:12<22:52:33,  3.45it/s]
 24%|██▎       | 87668/371472 [6:58:12<21:38:44,  3.64it/s]
 24%|██▎       | 87669/371472 [6:58:13<23:39:20,  3.33it/s]
 24%|██▎       | 87670/371472 [6:58:13<23:05:16,  3.41it/s]
 24%|██▎       | 87671/371472 [6:58:13<21:49:56,  3.61it/s]
 24%|██▎       | 87672/371472 [6:58:13<21:29:51,  3.67it/s]
 24%|██▎       | 87673/371472 [6:58:14<20:58:16,  3.76it/s]
 24%|██▎       | 87674/371472 [6:58:14<21:07:21,  3.73it/s]
 24%|██▎       | 87675/371472 [6:58:14<20:53:59,  3.77it/s]
 24%|██▎       | 87676/371472 [6:58:15<21:19:03,  3.70it/s]
 24%|██▎       | 87677/371472 [6:58:15<21:03:20,  3.74it/s]
 24%|██▎       | 87678/371472 [6:58:15<20:48:48,  3.79it/s]
 24%|██▎       | 87679/371472 [6:58:15<21:05:06,  3.74it/s]
 24%|██▎       | 87680/371472 [6:58:16<22:57:44,  3.43it/s]
                                                           
{'loss': 3.8808, 'learning_rate': 7.879398392553168e-07, 'epoch': 3.78}

 24%|██▎       | 87680/371472 [6:58:16<22:57:44,  3.43it/s]
 24%|██▎       | 87681/371472 [6:58:16<22:36:36,  3.49it/s]
 24%|██▎       | 87682/371472 [6:58:16<21:48:59,  3.61it/s]
 24%|██▎       | 87683/371472 [6:58:16<21:56:33,  3.59it/s]
 24%|██▎       | 87684/371472 [6:58:17<22:17:16,  3.54it/s]
 24%|██▎       | 87685/371472 [6:58:17<21:27:13,  3.67it/s]
 24%|██▎       | 87686/371472 [6:58:17<21:48:32,  3.61it/s]
 24%|██▎       | 87687/371472 [6:58:18<22:17:40,  3.54it/s]
 24%|██▎       | 87688/371472 [6:58:18<21:48:49,  3.61it/s]
 24%|██▎       | 87689/371472 [6:58:18<21:20:03,  3.69it/s]
 24%|██▎       | 87690/371472 [6:58:18<22:14:27,  3.54it/s]
 24%|██▎       | 87691/371472 [6:58:19<22:10:01,  3.56it/s]
 24%|██▎       | 87692/371472 [6:58:19<21:47:20,  3.62it/s]
 24%|██▎       | 87693/371472 [6:58:19<21:26:15,  3.68it/s]
 24%|██▎       | 87694/371472 [6:58:19<20:54:56,  3.77it/s]
 24%|██▎       | 87695/371472 [6:58:20<22:43:32,  3.47it/s]
 24%|██▎       | 87696/371472 [6:58:20<22:49:58,  3.45it/s]
 24%|██▎       | 87697/371472 [6:58:20<22:38:35,  3.48it/s]
 24%|██▎       | 87698/371472 [6:58:21<23:16:33,  3.39it/s]
 24%|██▎       | 87699/371472 [6:58:21<24:13:19,  3.25it/s]
 24%|██▎       | 87700/371472 [6:58:21<23:16:11,  3.39it/s]
                                                           
{'loss': 3.9336, 'learning_rate': 7.878913572798379e-07, 'epoch': 3.78}

 24%|██▎       | 87700/371472 [6:58:21<23:16:11,  3.39it/s]
 24%|██▎       | 87701/371472 [6:58:22<23:04:51,  3.42it/s]
 24%|██▎       | 87702/371472 [6:58:22<22:35:45,  3.49it/s]
 24%|██▎       | 87703/371472 [6:58:22<22:15:19,  3.54it/s]
 24%|██▎       | 87704/371472 [6:58:22<22:24:08,  3.52it/s]
 24%|██▎       | 87705/371472 [6:58:23<22:01:41,  3.58it/s]
 24%|██▎       | 87706/371472 [6:58:23<21:55:15,  3.60it/s]
 24%|██▎       | 87707/371472 [6:58:23<21:13:36,  3.71it/s]
 24%|██▎       | 87708/371472 [6:58:24<22:59:36,  3.43it/s]
 24%|██▎       | 87709/371472 [6:58:24<24:33:10,  3.21it/s]
 24%|██▎       | 87710/371472 [6:58:24<23:58:59,  3.29it/s]
 24%|██▎       | 87711/371472 [6:58:24<23:14:59,  3.39it/s]
 24%|██▎       | 87712/371472 [6:58:25<23:04:47,  3.42it/s]
 24%|██▎       | 87713/371472 [6:58:25<22:05:46,  3.57it/s]
 24%|██▎       | 87714/371472 [6:58:25<21:41:50,  3.63it/s]
 24%|██▎       | 87715/371472 [6:58:26<21:37:32,  3.64it/s]
 24%|██▎       | 87716/371472 [6:58:26<21:57:59,  3.59it/s]
 24%|██▎       | 87717/371472 [6:58:26<21:47:17,  3.62it/s]
 24%|██▎       | 87718/371472 [6:58:26<20:51:53,  3.78it/s]
 24%|██▎       | 87719/371472 [6:58:27<21:02:25,  3.75it/s]
 24%|██▎       | 87720/371472 [6:58:27<20:29:10,  3.85it/s]
                                                           
{'loss': 3.9363, 'learning_rate': 7.87842875304359e-07, 'epoch': 3.78}

 24%|██▎       | 87720/371472 [6:58:27<20:29:10,  3.85it/s]
 24%|██▎       | 87721/371472 [6:58:27<21:54:59,  3.60it/s]
 24%|██▎       | 87722/371472 [6:58:27<21:35:17,  3.65it/s]
 24%|██▎       | 87723/371472 [6:58:28<22:57:56,  3.43it/s]
 24%|██▎       | 87724/371472 [6:58:28<22:16:22,  3.54it/s]
 24%|██▎       | 87725/371472 [6:58:28<22:58:04,  3.43it/s]
 24%|██▎       | 87726/371472 [6:58:29<22:49:17,  3.45it/s]
 24%|██▎       | 87727/371472 [6:58:29<24:15:54,  3.25it/s]
 24%|██▎       | 87728/371472 [6:58:29<26:25:37,  2.98it/s]
 24%|██▎       | 87729/371472 [6:58:30<24:02:33,  3.28it/s]
 24%|██▎       | 87730/371472 [6:58:30<24:42:23,  3.19it/s]
 24%|██▎       | 87731/371472 [6:58:30<23:34:02,  3.34it/s]
 24%|██▎       | 87732/371472 [6:58:31<23:54:48,  3.30it/s]
 24%|██▎       | 87733/371472 [6:58:31<23:42:40,  3.32it/s]
 24%|██▎       | 87734/371472 [6:58:31<23:37:42,  3.34it/s]
 24%|██▎       | 87735/371472 [6:58:31<22:54:49,  3.44it/s]
 24%|██▎       | 87736/371472 [6:58:32<23:08:06,  3.41it/s]
 24%|██▎       | 87737/371472 [6:58:32<23:23:38,  3.37it/s]
 24%|██▎       | 87738/371472 [6:58:32<23:11:36,  3.40it/s]
 24%|██▎       | 87739/371472 [6:58:33<23:09:29,  3.40it/s]
 24%|██▎       | 87740/371472 [6:58:33<22:11:17,  3.55it/s]
                                                           
{'loss': 3.7732, 'learning_rate': 7.877943933288801e-07, 'epoch': 3.78}

 24%|██▎       | 87740/371472 [6:58:33<22:11:17,  3.55it/s]
 24%|██▎       | 87741/371472 [6:58:33<22:16:17,  3.54it/s]
 24%|██▎       | 87742/371472 [6:58:33<22:25:33,  3.51it/s]
 24%|██▎       | 87743/371472 [6:58:34<22:32:40,  3.50it/s]
 24%|██▎       | 87744/371472 [6:58:34<21:37:14,  3.65it/s]
 24%|██▎       | 87745/371472 [6:58:34<21:30:17,  3.66it/s]
 24%|██▎       | 87746/371472 [6:58:34<21:15:24,  3.71it/s]
 24%|██▎       | 87747/371472 [6:58:35<22:02:59,  3.57it/s]
 24%|██▎       | 87748/371472 [6:58:35<21:09:51,  3.72it/s]
 24%|██▎       | 87749/371472 [6:58:35<21:21:30,  3.69it/s]
 24%|██▎       | 87750/371472 [6:58:36<21:38:04,  3.64it/s]
 24%|██▎       | 87751/371472 [6:58:36<21:57:36,  3.59it/s]
 24%|██▎       | 87752/371472 [6:58:36<21:41:27,  3.63it/s]
 24%|██▎       | 87753/371472 [6:58:36<21:49:05,  3.61it/s]
 24%|██▎       | 87754/371472 [6:58:37<21:34:54,  3.65it/s]
 24%|██▎       | 87755/371472 [6:58:37<22:30:29,  3.50it/s]
 24%|██▎       | 87756/371472 [6:58:37<22:18:26,  3.53it/s]
 24%|██▎       | 87757/371472 [6:58:38<22:17:34,  3.54it/s]
 24%|██▎       | 87758/371472 [6:58:38<22:03:02,  3.57it/s]
 24%|██▎       | 87759/371472 [6:58:38<20:55:03,  3.77it/s]
 24%|██▎       | 87760/371472 [6:58:38<20:55:24,  3.77it/s]
                                                           
{'loss': 3.9161, 'learning_rate': 7.877459113534013e-07, 'epoch': 3.78}

 24%|██▎       | 87760/371472 [6:58:38<20:55:24,  3.77it/s]
 24%|██▎       | 87761/371472 [6:58:39<21:06:56,  3.73it/s]
 24%|██▎       | 87762/371472 [6:58:39<21:46:35,  3.62it/s]
 24%|██▎       | 87763/371472 [6:58:39<21:41:05,  3.63it/s]
 24%|██▎       | 87764/371472 [6:58:39<21:03:31,  3.74it/s]
 24%|██▎       | 87765/371472 [6:58:40<21:01:26,  3.75it/s]
 24%|██▎       | 87766/371472 [6:58:40<20:39:41,  3.81it/s]
 24%|██▎       | 87767/371472 [6:58:40<20:40:52,  3.81it/s]
 24%|██▎       | 87768/371472 [6:58:40<20:40:00,  3.81it/s]
 24%|██▎       | 87769/371472 [6:58:41<19:58:30,  3.95it/s]
 24%|██▎       | 87770/371472 [6:58:41<21:38:45,  3.64it/s]
 24%|██▎       | 87771/371472 [6:58:41<22:00:54,  3.58it/s]
 24%|██▎       | 87772/371472 [6:58:42<21:41:53,  3.63it/s]
 24%|██▎       | 87773/371472 [6:58:42<21:24:50,  3.68it/s]
 24%|██▎       | 87774/371472 [6:58:42<21:42:47,  3.63it/s]
 24%|██▎       | 87775/371472 [6:58:42<21:51:17,  3.61it/s]
 24%|██▎       | 87776/371472 [6:58:43<21:51:16,  3.61it/s]
 24%|██▎       | 87777/371472 [6:58:43<21:55:57,  3.59it/s]
 24%|██▎       | 87778/371472 [6:58:43<22:03:15,  3.57it/s]
 24%|██▎       | 87779/371472 [6:58:44<22:24:28,  3.52it/s]
 24%|██▎       | 87780/371472 [6:58:44<22:15:14,  3.54it/s]
                                                           
{'loss': 3.738, 'learning_rate': 7.876974293779224e-07, 'epoch': 3.78}

 24%|██▎       | 87780/371472 [6:58:44<22:15:14,  3.54it/s]
 24%|██▎       | 87781/371472 [6:58:44<22:04:31,  3.57it/s]
 24%|██▎       | 87782/371472 [6:58:44<21:23:05,  3.69it/s]
 24%|██▎       | 87783/371472 [6:58:45<21:00:12,  3.75it/s]
 24%|██▎       | 87784/371472 [6:58:45<21:08:35,  3.73it/s]
 24%|██▎       | 87785/371472 [6:58:45<21:04:31,  3.74it/s]
 24%|██▎       | 87786/371472 [6:58:45<21:44:39,  3.62it/s]
 24%|██▎       | 87787/371472 [6:58:46<21:30:51,  3.66it/s]
 24%|██▎       | 87788/371472 [6:58:46<20:50:04,  3.78it/s]
 24%|██▎       | 87789/371472 [6:58:46<21:04:36,  3.74it/s]
 24%|██▎       | 87790/371472 [6:58:46<20:25:53,  3.86it/s]
 24%|██▎       | 87791/371472 [6:58:47<20:51:29,  3.78it/s]
 24%|██▎       | 87792/371472 [6:58:47<21:51:40,  3.60it/s]
 24%|██▎       | 87793/371472 [6:58:47<22:30:59,  3.50it/s]
 24%|██▎       | 87794/371472 [6:58:48<24:14:28,  3.25it/s]
 24%|██▎       | 87795/371472 [6:58:48<25:18:05,  3.11it/s]
 24%|██▎       | 87796/371472 [6:58:48<24:14:18,  3.25it/s]
 24%|██▎       | 87797/371472 [6:58:49<22:45:48,  3.46it/s]
 24%|██▎       | 87798/371472 [6:58:49<23:59:14,  3.28it/s]
 24%|██▎       | 87799/371472 [6:58:49<24:46:09,  3.18it/s]
 24%|██▎       | 87800/371472 [6:58:50<24:21:51,  3.23it/s]
                                                           
{'loss': 3.8053, 'learning_rate': 7.876489474024434e-07, 'epoch': 3.78}

 24%|██▎       | 87800/371472 [6:58:50<24:21:51,  3.23it/s]
 24%|██▎       | 87801/371472 [6:58:50<24:01:46,  3.28it/s]
 24%|██▎       | 87802/371472 [6:58:50<23:34:23,  3.34it/s]
 24%|██▎       | 87803/371472 [6:58:50<22:40:00,  3.48it/s]
 24%|██▎       | 87804/371472 [6:58:51<23:33:55,  3.34it/s]
 24%|██▎       | 87805/371472 [6:58:51<25:21:27,  3.11it/s]
 24%|██▎       | 87806/371472 [6:58:51<23:59:25,  3.28it/s]
 24%|██▎       | 87807/371472 [6:58:52<24:35:56,  3.20it/s]
 24%|██▎       | 87808/371472 [6:58:52<23:20:05,  3.38it/s]
 24%|██▎       | 87809/371472 [6:58:52<22:45:31,  3.46it/s]
 24%|██▎       | 87810/371472 [6:58:53<23:39:11,  3.33it/s]
 24%|██▎       | 87811/371472 [6:58:53<24:23:29,  3.23it/s]
 24%|██▎       | 87812/371472 [6:58:53<23:23:59,  3.37it/s]
 24%|██▎       | 87813/371472 [6:58:53<22:47:05,  3.46it/s]
 24%|██▎       | 87814/371472 [6:58:54<21:50:26,  3.61it/s]
 24%|██▎       | 87815/371472 [6:58:54<21:55:07,  3.59it/s]
 24%|██▎       | 87816/371472 [6:58:54<21:32:33,  3.66it/s]
 24%|██▎       | 87817/371472 [6:58:55<22:23:35,  3.52it/s]
 24%|██▎       | 87818/371472 [6:58:55<22:15:42,  3.54it/s]
 24%|██▎       | 87819/371472 [6:58:55<23:23:15,  3.37it/s]
 24%|██▎       | 87820/371472 [6:58:55<23:23:24,  3.37it/s]
                                                           
{'loss': 3.9258, 'learning_rate': 7.876004654269644e-07, 'epoch': 3.78}

 24%|██▎       | 87820/371472 [6:58:55<23:23:24,  3.37it/s]
 24%|██▎       | 87821/371472 [6:58:56<22:08:08,  3.56it/s]
 24%|██▎       | 87822/371472 [6:58:56<22:01:42,  3.58it/s]
 24%|██▎       | 87823/371472 [6:58:56<22:46:34,  3.46it/s]
 24%|██▎       | 87824/371472 [6:58:57<22:24:59,  3.51it/s]
 24%|██▎       | 87825/371472 [6:58:57<21:23:45,  3.68it/s]
 24%|██▎       | 87826/371472 [6:58:57<23:31:25,  3.35it/s]
 24%|██▎       | 87827/371472 [6:58:57<22:21:17,  3.52it/s]
 24%|██▎       | 87828/371472 [6:58:58<22:25:26,  3.51it/s]
 24%|██▎       | 87829/371472 [6:58:58<21:43:26,  3.63it/s]
 24%|██▎       | 87830/371472 [6:58:58<21:37:32,  3.64it/s]
 24%|██▎       | 87831/371472 [6:58:58<21:21:57,  3.69it/s]
 24%|██▎       | 87832/371472 [6:58:59<21:19:54,  3.69it/s]
 24%|██▎       | 87833/371472 [6:58:59<21:15:28,  3.71it/s]
 24%|██▎       | 87834/371472 [6:58:59<26:51:37,  2.93it/s]
 24%|██▎       | 87835/371472 [6:59:00<26:01:56,  3.03it/s]
 24%|██▎       | 87836/371472 [6:59:00<24:36:33,  3.20it/s]
 24%|██▎       | 87837/371472 [6:59:00<23:34:05,  3.34it/s]
 24%|██▎       | 87838/371472 [6:59:01<22:25:02,  3.51it/s]
 24%|██▎       | 87839/371472 [6:59:01<22:35:12,  3.49it/s]
 24%|██▎       | 87840/371472 [6:59:01<22:56:41,  3.43it/s]
                                                           
{'loss': 3.8916, 'learning_rate': 7.875519834514857e-07, 'epoch': 3.78}

 24%|██▎       | 87840/371472 [6:59:01<22:56:41,  3.43it/s]
 24%|██▎       | 87841/371472 [6:59:01<22:18:57,  3.53it/s]
 24%|██▎       | 87842/371472 [6:59:02<23:17:22,  3.38it/s]
 24%|██▎       | 87843/371472 [6:59:02<23:08:07,  3.41it/s]
 24%|██▎       | 87844/371472 [6:59:02<22:42:31,  3.47it/s]
 24%|██▎       | 87845/371472 [6:59:03<23:59:52,  3.28it/s]
 24%|██▎       | 87846/371472 [6:59:03<23:16:54,  3.38it/s]
 24%|██▎       | 87847/371472 [6:59:03<23:02:48,  3.42it/s]
 24%|██▎       | 87848/371472 [6:59:04<23:08:15,  3.41it/s]
 24%|██▎       | 87849/371472 [6:59:04<23:19:58,  3.38it/s]
 24%|██▎       | 87850/371472 [6:59:04<22:33:27,  3.49it/s]
 24%|██▎       | 87851/371472 [6:59:04<22:24:25,  3.52it/s]
 24%|██▎       | 87852/371472 [6:59:05<22:39:10,  3.48it/s]
 24%|██▎       | 87853/371472 [6:59:05<23:54:56,  3.29it/s]
 24%|██▎       | 87854/371472 [6:59:05<22:36:40,  3.48it/s]
 24%|██▎       | 87855/371472 [6:59:06<21:22:23,  3.69it/s]
 24%|██▎       | 87856/371472 [6:59:06<20:54:10,  3.77it/s]
 24%|██▎       | 87857/371472 [6:59:06<21:53:17,  3.60it/s]
 24%|██▎       | 87858/371472 [6:59:06<22:27:35,  3.51it/s]
 24%|██▎       | 87859/371472 [6:59:07<22:29:03,  3.50it/s]
 24%|██▎       | 87860/371472 [6:59:07<22:01:37,  3.58it/s]
                                                           
{'loss': 3.6987, 'learning_rate': 7.875035014760068e-07, 'epoch': 3.78}

 24%|██▎       | 87860/371472 [6:59:07<22:01:37,  3.58it/s]
 24%|██▎       | 87861/371472 [6:59:07<22:16:25,  3.54it/s]
 24%|██▎       | 87862/371472 [6:59:07<21:27:45,  3.67it/s]
 24%|██▎       | 87863/371472 [6:59:08<22:48:52,  3.45it/s]
 24%|██▎       | 87864/371472 [6:59:08<21:44:07,  3.62it/s]
 24%|██▎       | 87865/371472 [6:59:08<23:57:33,  3.29it/s]
 24%|██▎       | 87866/371472 [6:59:09<23:01:36,  3.42it/s]
 24%|██▎       | 87867/371472 [6:59:09<22:34:20,  3.49it/s]
 24%|██▎       | 87868/371472 [6:59:09<21:38:57,  3.64it/s]
 24%|██▎       | 87869/371472 [6:59:09<21:27:50,  3.67it/s]
 24%|██▎       | 87870/371472 [6:59:10<23:14:58,  3.39it/s]
 24%|██▎       | 87871/371472 [6:59:10<22:22:22,  3.52it/s]
 24%|██▎       | 87872/371472 [6:59:10<23:31:52,  3.35it/s]
 24%|██▎       | 87873/371472 [6:59:11<23:34:47,  3.34it/s]
 24%|██▎       | 87874/371472 [6:59:11<22:20:00,  3.53it/s]
 24%|██▎       | 87875/371472 [6:59:11<21:55:44,  3.59it/s]
 24%|██▎       | 87876/371472 [6:59:12<23:07:18,  3.41it/s]
 24%|██▎       | 87877/371472 [6:59:12<23:17:32,  3.38it/s]
 24%|██▎       | 87878/371472 [6:59:12<23:28:54,  3.35it/s]
 24%|██▎       | 87879/371472 [6:59:12<22:55:40,  3.44it/s]
 24%|██▎       | 87880/371472 [6:59:13<21:40:25,  3.63it/s]
                                                           
{'loss': 3.9392, 'learning_rate': 7.874550195005278e-07, 'epoch': 3.79}

 24%|██▎       | 87880/371472 [6:59:13<21:40:25,  3.63it/s]
 24%|██▎       | 87881/371472 [6:59:13<22:44:00,  3.47it/s]
 24%|██▎       | 87882/371472 [6:59:13<22:31:43,  3.50it/s]
 24%|██▎       | 87883/371472 [6:59:14<23:01:03,  3.42it/s]
 24%|██▎       | 87884/371472 [6:59:14<23:29:35,  3.35it/s]
 24%|██▎       | 87885/371472 [6:59:14<23:36:30,  3.34it/s]
 24%|██▎       | 87886/371472 [6:59:14<22:56:05,  3.43it/s]
 24%|██▎       | 87887/371472 [6:59:15<23:12:35,  3.39it/s]
 24%|██▎       | 87888/371472 [6:59:15<21:42:01,  3.63it/s]
 24%|██▎       | 87889/371472 [6:59:15<20:44:37,  3.80it/s]
 24%|██▎       | 87890/371472 [6:59:15<20:50:54,  3.78it/s]
 24%|██▎       | 87891/371472 [6:59:16<21:17:10,  3.70it/s]
 24%|██▎       | 87892/371472 [6:59:16<21:18:33,  3.70it/s]
 24%|██▎       | 87893/371472 [6:59:16<22:20:51,  3.52it/s]
 24%|██▎       | 87894/371472 [6:59:17<21:50:20,  3.61it/s]
 24%|██▎       | 87895/371472 [6:59:17<21:04:33,  3.74it/s]
 24%|██▎       | 87896/371472 [6:59:17<23:35:02,  3.34it/s]
 24%|██▎       | 87897/371472 [6:59:18<23:04:03,  3.41it/s]
 24%|██▎       | 87898/371472 [6:59:18<23:16:14,  3.38it/s]
 24%|██▎       | 87899/371472 [6:59:18<22:18:15,  3.53it/s]
 24%|██▎       | 87900/371472 [6:59:18<22:19:10,  3.53it/s]
                                                           
{'loss': 3.8059, 'learning_rate': 7.87406537525049e-07, 'epoch': 3.79}

 24%|██▎       | 87900/371472 [6:59:18<22:19:10,  3.53it/s]
 24%|██▎       | 87901/371472 [6:59:19<23:59:53,  3.28it/s]
 24%|██▎       | 87902/371472 [6:59:19<23:25:33,  3.36it/s]
 24%|██▎       | 87903/371472 [6:59:19<22:57:58,  3.43it/s]
 24%|██▎       | 87904/371472 [6:59:20<23:16:40,  3.38it/s]
 24%|██▎       | 87905/371472 [6:59:20<23:11:21,  3.40it/s]
 24%|██▎       | 87906/371472 [6:59:20<21:52:48,  3.60it/s]
 24%|██▎       | 87907/371472 [6:59:20<23:04:24,  3.41it/s]
 24%|██▎       | 87908/371472 [6:59:21<23:06:26,  3.41it/s]
 24%|██▎       | 87909/371472 [6:59:21<26:10:01,  3.01it/s]
 24%|██▎       | 87910/371472 [6:59:21<24:49:23,  3.17it/s]
 24%|██▎       | 87911/371472 [6:59:22<24:37:54,  3.20it/s]
 24%|██▎       | 87912/371472 [6:59:22<25:04:36,  3.14it/s]
 24%|██▎       | 87913/371472 [6:59:22<24:14:12,  3.25it/s]
 24%|██▎       | 87914/371472 [6:59:23<25:29:42,  3.09it/s]
 24%|██▎       | 87915/371472 [6:59:23<23:36:35,  3.34it/s]
 24%|██▎       | 87916/371472 [6:59:23<23:45:12,  3.32it/s]
 24%|██▎       | 87917/371472 [6:59:24<23:01:20,  3.42it/s]
 24%|██▎       | 87918/371472 [6:59:24<22:54:42,  3.44it/s]
 24%|██▎       | 87919/371472 [6:59:24<23:19:05,  3.38it/s]
 24%|██▎       | 87920/371472 [6:59:24<22:04:48,  3.57it/s]
                                                           
{'loss': 3.7662, 'learning_rate': 7.873580555495701e-07, 'epoch': 3.79}

 24%|██▎       | 87920/371472 [6:59:24<22:04:48,  3.57it/s]
 24%|██▎       | 87921/371472 [6:59:25<21:16:02,  3.70it/s]
 24%|██▎       | 87922/371472 [6:59:25<22:19:05,  3.53it/s]
 24%|██▎       | 87923/371472 [6:59:25<21:11:45,  3.72it/s]
 24%|██▎       | 87924/371472 [6:59:25<21:02:23,  3.74it/s]
 24%|██▎       | 87925/371472 [6:59:26<22:34:01,  3.49it/s]
 24%|██▎       | 87926/371472 [6:59:26<23:07:43,  3.41it/s]
 24%|██▎       | 87927/371472 [6:59:26<23:47:22,  3.31it/s]
 24%|██▎       | 87928/371472 [6:59:27<24:02:51,  3.28it/s]
 24%|██▎       | 87929/371472 [6:59:27<24:04:41,  3.27it/s]
 24%|██▎       | 87930/371472 [6:59:27<23:54:34,  3.29it/s]
 24%|██▎       | 87931/371472 [6:59:28<22:42:58,  3.47it/s]
 24%|██▎       | 87932/371472 [6:59:28<21:36:30,  3.64it/s]
 24%|██▎       | 87933/371472 [6:59:28<21:02:50,  3.74it/s]
 24%|██▎       | 87934/371472 [6:59:28<21:47:06,  3.62it/s]
 24%|██▎       | 87935/371472 [6:59:29<21:39:27,  3.64it/s]
 24%|██▎       | 87936/371472 [6:59:29<20:51:42,  3.78it/s]
 24%|██▎       | 87937/371472 [6:59:29<22:02:48,  3.57it/s]
 24%|██▎       | 87938/371472 [6:59:29<21:29:44,  3.66it/s]
 24%|██▎       | 87939/371472 [6:59:30<21:07:39,  3.73it/s]
 24%|██▎       | 87940/371472 [6:59:30<22:09:02,  3.56it/s]
                                                           
{'loss': 3.9632, 'learning_rate': 7.873095735740912e-07, 'epoch': 3.79}

 24%|██▎       | 87940/371472 [6:59:30<22:09:02,  3.56it/s]
 24%|██▎       | 87941/371472 [6:59:30<22:25:45,  3.51it/s]
 24%|██▎       | 87942/371472 [6:59:31<23:19:26,  3.38it/s]
 24%|██▎       | 87943/371472 [6:59:31<23:02:58,  3.42it/s]
 24%|██▎       | 87944/371472 [6:59:31<21:54:51,  3.59it/s]
 24%|██▎       | 87945/371472 [6:59:31<22:45:04,  3.46it/s]
 24%|██▎       | 87946/371472 [6:59:32<22:31:24,  3.50it/s]
 24%|██▎       | 87947/371472 [6:59:32<23:03:38,  3.42it/s]
 24%|██▎       | 87948/371472 [6:59:32<23:45:30,  3.31it/s]
 24%|██▎       | 87949/371472 [6:59:33<22:40:54,  3.47it/s]
 24%|██▎       | 87950/371472 [6:59:33<21:43:25,  3.63it/s]
 24%|██▎       | 87951/371472 [6:59:33<21:45:49,  3.62it/s]
 24%|██▎       | 87952/371472 [6:59:33<21:45:29,  3.62it/s]
 24%|██▎       | 87953/371472 [6:59:34<21:57:37,  3.59it/s]
 24%|██▎       | 87954/371472 [6:59:34<23:38:12,  3.33it/s]
 24%|██▎       | 87955/371472 [6:59:34<22:18:27,  3.53it/s]
 24%|██▎       | 87956/371472 [6:59:35<22:32:52,  3.49it/s]
 24%|██▎       | 87957/371472 [6:59:35<23:31:11,  3.35it/s]
 24%|██▎       | 87958/371472 [6:59:35<22:06:43,  3.56it/s]
 24%|██▎       | 87959/371472 [6:59:35<22:02:14,  3.57it/s]
 24%|██▎       | 87960/371472 [6:59:36<22:15:28,  3.54it/s]
                                                           
{'loss': 3.9151, 'learning_rate': 7.872610915986122e-07, 'epoch': 3.79}

 24%|██▎       | 87960/371472 [6:59:36<22:15:28,  3.54it/s]
 24%|██▎       | 87961/371472 [6:59:36<21:38:11,  3.64it/s]
 24%|██▎       | 87962/371472 [6:59:36<21:31:45,  3.66it/s]
 24%|██▎       | 87963/371472 [6:59:37<21:24:54,  3.68it/s]
 24%|██▎       | 87964/371472 [6:59:37<21:40:50,  3.63it/s]
 24%|██▎       | 87965/371472 [6:59:37<21:28:48,  3.67it/s]
 24%|██▎       | 87966/371472 [6:59:37<21:37:41,  3.64it/s]
 24%|██▎       | 87967/371472 [6:59:38<21:17:58,  3.70it/s]
 24%|██▎       | 87968/371472 [6:59:38<21:52:26,  3.60it/s]
 24%|██▎       | 87969/371472 [6:59:38<22:08:37,  3.56it/s]
 24%|██▎       | 87970/371472 [6:59:38<22:14:47,  3.54it/s]
 24%|██▎       | 87971/371472 [6:59:39<22:26:44,  3.51it/s]
 24%|██▎       | 87972/371472 [6:59:39<21:46:14,  3.62it/s]
 24%|██▎       | 87973/371472 [6:59:39<22:20:35,  3.52it/s]
 24%|██▎       | 87974/371472 [6:59:40<26:31:59,  2.97it/s]
 24%|██▎       | 87975/371472 [6:59:40<24:47:13,  3.18it/s]
 24%|██▎       | 87976/371472 [6:59:40<23:00:21,  3.42it/s]
 24%|██▎       | 87977/371472 [6:59:41<22:17:01,  3.53it/s]
 24%|██▎       | 87978/371472 [6:59:41<23:45:05,  3.32it/s]
 24%|██▎       | 87979/371472 [6:59:41<22:16:15,  3.54it/s]
 24%|██▎       | 87980/371472 [6:59:42<24:30:49,  3.21it/s]
                                                           
{'loss': 3.8365, 'learning_rate': 7.872126096231334e-07, 'epoch': 3.79}

 24%|██▎       | 87980/371472 [6:59:42<24:30:49,  3.21it/s]
 24%|██▎       | 87981/371472 [6:59:42<24:34:49,  3.20it/s]
 24%|██▎       | 87982/371472 [6:59:42<23:51:22,  3.30it/s]
 24%|██▎       | 87983/371472 [6:59:42<22:31:48,  3.50it/s]
 24%|██▎       | 87984/371472 [6:59:43<22:18:07,  3.53it/s]
 24%|██▎       | 87985/371472 [6:59:43<21:05:27,  3.73it/s]
 24%|██▎       | 87986/371472 [6:59:43<20:30:53,  3.84it/s]
 24%|██▎       | 87987/371472 [6:59:43<21:35:53,  3.65it/s]
 24%|██▎       | 87988/371472 [6:59:44<21:43:37,  3.62it/s]
 24%|██▎       | 87989/371472 [6:59:44<21:40:45,  3.63it/s]
 24%|██▎       | 87990/371472 [6:59:44<21:36:45,  3.64it/s]
 24%|██▎       | 87991/371472 [6:59:45<21:22:01,  3.69it/s]
 24%|██▎       | 87992/371472 [6:59:45<21:27:27,  3.67it/s]
 24%|██▎       | 87993/371472 [6:59:45<22:06:18,  3.56it/s]
 24%|██▎       | 87994/371472 [6:59:45<21:55:46,  3.59it/s]
 24%|██▎       | 87995/371472 [6:59:46<21:43:01,  3.63it/s]
 24%|██▎       | 87996/371472 [6:59:46<20:58:29,  3.75it/s]
 24%|██▎       | 87997/371472 [6:59:46<21:06:46,  3.73it/s]
 24%|██▎       | 87998/371472 [6:59:46<20:47:06,  3.79it/s]
 24%|██▎       | 87999/371472 [6:59:47<20:28:40,  3.85it/s]
 24%|██▎       | 88000/371472 [6:59:47<27:27:59,  2.87it/s]
                                                           
{'loss': 3.7737, 'learning_rate': 7.871641276476546e-07, 'epoch': 3.79}

 24%|██▎       | 88000/371472 [6:59:47<27:27:59,  2.87it/s]
 24%|██▎       | 88001/371472 [6:59:47<25:16:12,  3.12it/s]
 24%|██▎       | 88002/371472 [6:59:48<23:32:02,  3.35it/s]
 24%|██▎       | 88003/371472 [6:59:48<22:26:45,  3.51it/s]
 24%|██▎       | 88004/371472 [6:59:48<23:12:36,  3.39it/s]
 24%|██▎       | 88005/371472 [6:59:49<22:31:08,  3.50it/s]
 24%|██▎       | 88006/371472 [6:59:49<22:09:23,  3.55it/s]
 24%|██▎       | 88007/371472 [6:59:49<23:10:43,  3.40it/s]
 24%|██▎       | 88008/371472 [6:59:49<24:19:54,  3.24it/s]
 24%|██▎       | 88009/371472 [6:59:50<23:56:58,  3.29it/s]
 24%|██▎       | 88010/371472 [6:59:50<23:22:55,  3.37it/s]
 24%|██▎       | 88011/371472 [6:59:50<22:36:17,  3.48it/s]
 24%|██▎       | 88012/371472 [6:59:51<22:08:50,  3.56it/s]
 24%|██▎       | 88013/371472 [6:59:51<22:06:00,  3.56it/s]
 24%|██▎       | 88014/371472 [6:59:51<23:57:26,  3.29it/s]
 24%|██▎       | 88015/371472 [6:59:51<23:17:50,  3.38it/s]
 24%|██▎       | 88016/371472 [6:59:52<23:15:10,  3.39it/s]
 24%|██▎       | 88017/371472 [6:59:52<23:43:38,  3.32it/s]
 24%|██▎       | 88018/371472 [6:59:52<24:02:36,  3.27it/s]
 24%|██▎       | 88019/371472 [6:59:53<23:15:59,  3.38it/s]
 24%|██▎       | 88020/371472 [6:59:53<23:02:38,  3.42it/s]
                                                           
{'loss': 3.7817, 'learning_rate': 7.871156456721756e-07, 'epoch': 3.79}

 24%|██▎       | 88020/371472 [6:59:53<23:02:38,  3.42it/s]
 24%|██▎       | 88021/371472 [6:59:53<22:49:12,  3.45it/s]
 24%|██▎       | 88022/371472 [6:59:54<24:31:20,  3.21it/s]
 24%|██▎       | 88023/371472 [6:59:54<23:36:22,  3.34it/s]
 24%|██▎       | 88024/371472 [6:59:54<22:35:51,  3.48it/s]
 24%|██▎       | 88025/371472 [6:59:54<21:36:27,  3.64it/s]
 24%|██▎       | 88026/371472 [6:59:55<24:21:21,  3.23it/s]
 24%|██▎       | 88027/371472 [6:59:55<24:45:10,  3.18it/s]
 24%|██▎       | 88028/371472 [6:59:55<23:11:09,  3.40it/s]
 24%|██▎       | 88029/371472 [6:59:56<22:17:53,  3.53it/s]
 24%|██▎       | 88030/371472 [6:59:56<21:38:31,  3.64it/s]
 24%|██▎       | 88031/371472 [6:59:56<23:01:18,  3.42it/s]
 24%|██▎       | 88032/371472 [6:59:56<22:13:33,  3.54it/s]
 24%|██▎       | 88033/371472 [6:59:57<22:13:30,  3.54it/s]
 24%|██▎       | 88034/371472 [6:59:57<22:11:53,  3.55it/s]
 24%|██▎       | 88035/371472 [6:59:57<22:11:04,  3.55it/s]
 24%|██▎       | 88036/371472 [6:59:58<21:57:09,  3.59it/s]
 24%|██▎       | 88037/371472 [6:59:58<22:08:41,  3.56it/s]
 24%|██▎       | 88038/371472 [6:59:58<22:42:22,  3.47it/s]
 24%|██▎       | 88039/371472 [6:59:58<21:52:40,  3.60it/s]
 24%|██▎       | 88040/371472 [6:59:59<21:28:07,  3.67it/s]
                                                           
{'loss': 3.7157, 'learning_rate': 7.870671636966967e-07, 'epoch': 3.79}

 24%|██▎       | 88040/371472 [6:59:59<21:28:07,  3.67it/s]
 24%|██▎       | 88041/371472 [6:59:59<21:02:03,  3.74it/s]
 24%|██▎       | 88042/371472 [6:59:59<23:30:12,  3.35it/s]
 24%|██▎       | 88043/371472 [7:00:00<22:42:36,  3.47it/s]
 24%|██▎       | 88044/371472 [7:00:00<24:24:12,  3.23it/s]
 24%|██▎       | 88045/371472 [7:00:00<23:25:52,  3.36it/s]
 24%|██▎       | 88046/371472 [7:00:00<23:03:17,  3.41it/s]
 24%|██▎       | 88047/371472 [7:00:01<25:08:31,  3.13it/s]
 24%|██▎       | 88048/371472 [7:00:01<24:24:55,  3.22it/s]
 24%|██▎       | 88049/371472 [7:00:01<23:36:04,  3.34it/s]
 24%|██▎       | 88050/371472 [7:00:02<22:56:47,  3.43it/s]
 24%|██▎       | 88051/371472 [7:00:02<22:51:23,  3.44it/s]
 24%|██▎       | 88052/371472 [7:00:02<22:07:00,  3.56it/s]
 24%|██▎       | 88053/371472 [7:00:03<21:33:49,  3.65it/s]
 24%|██▎       | 88054/371472 [7:00:03<20:42:52,  3.80it/s]
 24%|██▎       | 88055/371472 [7:00:03<21:20:22,  3.69it/s]
 24%|██▎       | 88056/371472 [7:00:03<21:31:54,  3.66it/s]
 24%|██▎       | 88057/371472 [7:00:04<20:52:29,  3.77it/s]
 24%|██▎       | 88058/371472 [7:00:04<22:27:12,  3.51it/s]
 24%|██▎       | 88059/371472 [7:00:04<21:20:46,  3.69it/s]
 24%|██▎       | 88060/371472 [7:00:04<21:03:12,  3.74it/s]
                                                           
{'loss': 3.7524, 'learning_rate': 7.870186817212178e-07, 'epoch': 3.79}

 24%|██▎       | 88060/371472 [7:00:04<21:03:12,  3.74it/s]
 24%|██▎       | 88061/371472 [7:00:05<20:29:59,  3.84it/s]
 24%|██▎       | 88062/371472 [7:00:05<20:33:28,  3.83it/s]
 24%|██▎       | 88063/371472 [7:00:05<21:00:58,  3.75it/s]
 24%|██▎       | 88064/371472 [7:00:05<20:41:49,  3.80it/s]
 24%|██▎       | 88065/371472 [7:00:06<20:50:53,  3.78it/s]
 24%|██▎       | 88066/371472 [7:00:06<24:38:42,  3.19it/s]
 24%|██▎       | 88067/371472 [7:00:06<24:00:42,  3.28it/s]
 24%|██▎       | 88068/371472 [7:00:07<23:39:16,  3.33it/s]
 24%|██▎       | 88069/371472 [7:00:07<23:22:59,  3.37it/s]
 24%|██▎       | 88070/371472 [7:00:07<22:20:54,  3.52it/s]
 24%|██▎       | 88071/371472 [7:00:08<23:24:35,  3.36it/s]
 24%|██▎       | 88072/371472 [7:00:08<22:14:27,  3.54it/s]
 24%|██▎       | 88073/371472 [7:00:08<21:29:13,  3.66it/s]
 24%|██▎       | 88074/371472 [7:00:08<22:09:34,  3.55it/s]
 24%|██▎       | 88075/371472 [7:00:09<21:59:46,  3.58it/s]
 24%|██▎       | 88076/371472 [7:00:09<22:41:13,  3.47it/s]
 24%|██▎       | 88077/371472 [7:00:09<23:35:56,  3.34it/s]
 24%|██▎       | 88078/371472 [7:00:10<23:01:03,  3.42it/s]
 24%|██▎       | 88079/371472 [7:00:10<24:57:35,  3.15it/s]
 24%|██▎       | 88080/371472 [7:00:10<24:21:35,  3.23it/s]
                                                           
{'loss': 3.8023, 'learning_rate': 7.86970199745739e-07, 'epoch': 3.79}

 24%|██▎       | 88080/371472 [7:00:10<24:21:35,  3.23it/s]
 24%|██▎       | 88081/371472 [7:00:11<23:24:15,  3.36it/s]
 24%|██▎       | 88082/371472 [7:00:11<22:29:10,  3.50it/s]
 24%|██▎       | 88083/371472 [7:00:11<22:07:15,  3.56it/s]
 24%|██▎       | 88084/371472 [7:00:11<21:15:18,  3.70it/s]
 24%|██▎       | 88085/371472 [7:00:12<21:47:00,  3.61it/s]
 24%|██▎       | 88086/371472 [7:00:12<21:29:52,  3.66it/s]
 24%|██▎       | 88087/371472 [7:00:12<21:13:41,  3.71it/s]
 24%|██▎       | 88088/371472 [7:00:12<21:34:02,  3.65it/s]
 24%|██▎       | 88089/371472 [7:00:13<21:21:16,  3.69it/s]
 24%|██▎       | 88090/371472 [7:00:13<21:26:18,  3.67it/s]
 24%|██▎       | 88091/371472 [7:00:13<22:23:57,  3.51it/s]
 24%|██▎       | 88092/371472 [7:00:14<22:34:47,  3.49it/s]
 24%|██▎       | 88093/371472 [7:00:14<22:30:02,  3.50it/s]
 24%|██▎       | 88094/371472 [7:00:14<23:00:36,  3.42it/s]
 24%|██▎       | 88095/371472 [7:00:14<21:49:26,  3.61it/s]
 24%|██▎       | 88096/371472 [7:00:15<21:33:02,  3.65it/s]
 24%|██▎       | 88097/371472 [7:00:15<21:16:40,  3.70it/s]
 24%|██▎       | 88098/371472 [7:00:15<21:19:37,  3.69it/s]
 24%|██▎       | 88099/371472 [7:00:15<21:32:12,  3.65it/s]
 24%|██▎       | 88100/371472 [7:00:16<21:29:53,  3.66it/s]
                                                           
{'loss': 3.7815, 'learning_rate': 7.8692171777026e-07, 'epoch': 3.79}

 24%|██▎       | 88100/371472 [7:00:16<21:29:53,  3.66it/s]
 24%|██▎       | 88101/371472 [7:00:16<21:21:58,  3.68it/s]
 24%|██▎       | 88102/371472 [7:00:16<20:56:48,  3.76it/s]
 24%|██▎       | 88103/371472 [7:00:17<21:47:01,  3.61it/s]
 24%|██▎       | 88104/371472 [7:00:17<22:36:34,  3.48it/s]
 24%|██▎       | 88105/371472 [7:00:17<22:42:10,  3.47it/s]
 24%|██▎       | 88106/371472 [7:00:17<21:28:15,  3.67it/s]
 24%|██▎       | 88107/371472 [7:00:18<22:58:00,  3.43it/s]
 24%|██▎       | 88108/371472 [7:00:18<21:37:43,  3.64it/s]
 24%|██▎       | 88109/371472 [7:00:18<21:50:11,  3.60it/s]
 24%|██▎       | 88110/371472 [7:00:18<21:13:48,  3.71it/s]
 24%|██▎       | 88111/371472 [7:00:19<22:20:39,  3.52it/s]
 24%|██▎       | 88112/371472 [7:00:19<21:55:33,  3.59it/s]
 24%|██▎       | 88113/371472 [7:00:19<21:07:02,  3.73it/s]
 24%|██▎       | 88114/371472 [7:00:20<21:42:20,  3.63it/s]
 24%|██▎       | 88115/371472 [7:00:20<21:45:20,  3.62it/s]
 24%|██▎       | 88116/371472 [7:00:20<23:59:30,  3.28it/s]
 24%|██▎       | 88117/371472 [7:00:21<23:24:25,  3.36it/s]
 24%|██▎       | 88118/371472 [7:00:21<22:23:27,  3.52it/s]
 24%|██▎       | 88119/371472 [7:00:21<21:36:52,  3.64it/s]
 24%|██▎       | 88120/371472 [7:00:21<22:12:19,  3.54it/s]
                                                           
{'loss': 4.0132, 'learning_rate': 7.868732357947811e-07, 'epoch': 3.8}

 24%|██▎       | 88120/371472 [7:00:21<22:12:19,  3.54it/s]
 24%|██▎       | 88121/371472 [7:00:22<22:20:52,  3.52it/s]
 24%|██▎       | 88122/371472 [7:00:22<22:23:36,  3.51it/s]
 24%|██▎       | 88123/371472 [7:00:22<22:13:55,  3.54it/s]
 24%|██▎       | 88124/371472 [7:00:23<24:38:05,  3.19it/s]
 24%|██▎       | 88125/371472 [7:00:23<23:30:30,  3.35it/s]
 24%|██▎       | 88126/371472 [7:00:23<22:27:11,  3.51it/s]
 24%|██▎       | 88127/371472 [7:00:23<22:24:12,  3.51it/s]
 24%|██▎       | 88128/371472 [7:00:24<22:33:25,  3.49it/s]
 24%|██▎       | 88129/371472 [7:00:24<21:40:39,  3.63it/s]
 24%|██▎       | 88130/371472 [7:00:24<21:52:09,  3.60it/s]
 24%|██▎       | 88131/371472 [7:00:24<21:59:34,  3.58it/s]
 24%|██▎       | 88132/371472 [7:00:25<21:59:30,  3.58it/s]
 24%|██▎       | 88133/371472 [7:00:25<22:30:48,  3.50it/s]
 24%|██▎       | 88134/371472 [7:00:25<22:44:51,  3.46it/s]
 24%|██▎       | 88135/371472 [7:00:26<22:15:05,  3.54it/s]
 24%|██▎       | 88136/371472 [7:00:26<22:56:44,  3.43it/s]
 24%|██▎       | 88137/371472 [7:00:26<23:56:31,  3.29it/s]
 24%|██▎       | 88138/371472 [7:00:27<23:20:31,  3.37it/s]
 24%|██▎       | 88139/371472 [7:00:27<22:48:05,  3.45it/s]
 24%|██▎       | 88140/371472 [7:00:27<22:33:14,  3.49it/s]
                                                           
{'loss': 3.9462, 'learning_rate': 7.868247538193023e-07, 'epoch': 3.8}

 24%|██▎       | 88140/371472 [7:00:27<22:33:14,  3.49it/s]
 24%|██▎       | 88141/371472 [7:00:27<22:27:48,  3.50it/s]
 24%|██▎       | 88142/371472 [7:00:28<23:17:14,  3.38it/s]
 24%|██▎       | 88143/371472 [7:00:28<22:44:20,  3.46it/s]
 24%|██▎       | 88144/371472 [7:00:28<23:19:43,  3.37it/s]
 24%|██▎       | 88145/371472 [7:00:29<21:56:50,  3.59it/s]
 24%|██▎       | 88146/371472 [7:00:29<22:24:42,  3.51it/s]
 24%|██▎       | 88147/371472 [7:00:29<22:24:13,  3.51it/s]
 24%|██▎       | 88148/371472 [7:00:29<22:54:44,  3.43it/s]
 24%|██▎       | 88149/371472 [7:00:30<23:11:47,  3.39it/s]
 24%|██▎       | 88150/371472 [7:00:30<22:37:03,  3.48it/s]
 24%|██▎       | 88151/371472 [7:00:30<24:34:01,  3.20it/s]
 24%|██▎       | 88152/371472 [7:00:31<23:04:27,  3.41it/s]
 24%|██▎       | 88153/371472 [7:00:31<22:10:29,  3.55it/s]
 24%|██▎       | 88154/371472 [7:00:31<23:15:37,  3.38it/s]
 24%|██▎       | 88155/371472 [7:00:31<23:11:53,  3.39it/s]
 24%|██▎       | 88156/371472 [7:00:32<24:54:07,  3.16it/s]
 24%|██▎       | 88157/371472 [7:00:32<23:29:26,  3.35it/s]
 24%|██▎       | 88158/371472 [7:00:32<23:45:10,  3.31it/s]
 24%|██▎       | 88159/371472 [7:00:33<22:23:54,  3.51it/s]
 24%|██▎       | 88160/371472 [7:00:33<21:29:02,  3.66it/s]
                                                           
{'loss': 3.7257, 'learning_rate': 7.867762718438234e-07, 'epoch': 3.8}

 24%|██▎       | 88160/371472 [7:00:33<21:29:02,  3.66it/s]
 24%|██▎       | 88161/371472 [7:00:33<22:14:54,  3.54it/s]
 24%|██▎       | 88162/371472 [7:00:33<22:15:29,  3.54it/s]
 24%|██▎       | 88163/371472 [7:00:34<21:25:48,  3.67it/s]
 24%|██▎       | 88164/371472 [7:00:34<21:02:33,  3.74it/s]
 24%|██▎       | 88165/371472 [7:00:34<21:13:10,  3.71it/s]
 24%|██▎       | 88166/371472 [7:00:35<21:18:15,  3.69it/s]
 24%|██▎       | 88167/371472 [7:00:35<22:16:37,  3.53it/s]
 24%|██▎       | 88168/371472 [7:00:35<21:39:28,  3.63it/s]
 24%|██▎       | 88169/371472 [7:00:35<21:49:38,  3.61it/s]
 24%|██▎       | 88170/371472 [7:00:36<21:24:15,  3.68it/s]
 24%|██▎       | 88171/371472 [7:00:36<21:07:51,  3.72it/s]
 24%|██▎       | 88172/371472 [7:00:36<21:16:52,  3.70it/s]
 24%|██▎       | 88173/371472 [7:00:36<21:07:30,  3.73it/s]
 24%|██▎       | 88174/371472 [7:00:37<22:02:30,  3.57it/s]
 24%|██▎       | 88175/371472 [7:00:37<21:32:33,  3.65it/s]
 24%|██▎       | 88176/371472 [7:00:37<21:34:32,  3.65it/s]
 24%|██▎       | 88177/371472 [7:00:38<21:41:02,  3.63it/s]
 24%|██▎       | 88178/371472 [7:00:38<22:39:36,  3.47it/s]
 24%|██▎       | 88179/371472 [7:00:38<22:02:45,  3.57it/s]
 24%|██▎       | 88180/371472 [7:00:38<22:23:09,  3.52it/s]
                                                           
{'loss': 3.9017, 'learning_rate': 7.867277898683444e-07, 'epoch': 3.8}

 24%|██▎       | 88180/371472 [7:00:38<22:23:09,  3.52it/s]
 24%|██▎       | 88181/371472 [7:00:39<21:29:52,  3.66it/s]
 24%|██▎       | 88182/371472 [7:00:39<21:29:41,  3.66it/s]
 24%|██▎       | 88183/371472 [7:00:39<21:01:13,  3.74it/s]
 24%|██▎       | 88184/371472 [7:00:40<21:16:40,  3.70it/s]
 24%|██▎       | 88185/371472 [7:00:40<21:48:39,  3.61it/s]
 24%|██▎       | 88186/371472 [7:00:40<21:22:46,  3.68it/s]
 24%|██▎       | 88187/371472 [7:00:40<21:40:52,  3.63it/s]
 24%|██▎       | 88188/371472 [7:00:41<23:06:12,  3.41it/s]
 24%|██▎       | 88189/371472 [7:00:41<23:18:55,  3.38it/s]
 24%|██▎       | 88190/371472 [7:00:41<21:52:55,  3.60it/s]
 24%|██▎       | 88191/371472 [7:00:41<21:28:43,  3.66it/s]
 24%|██▎       | 88192/371472 [7:00:42<21:03:50,  3.74it/s]
 24%|██▎       | 88193/371472 [7:00:42<21:13:44,  3.71it/s]
 24%|██▎       | 88194/371472 [7:00:42<21:15:51,  3.70it/s]
 24%|██▎       | 88195/371472 [7:00:43<20:49:43,  3.78it/s]
 24%|██▎       | 88196/371472 [7:00:43<20:37:24,  3.82it/s]
 24%|██▎       | 88197/371472 [7:00:43<20:03:44,  3.92it/s]
 24%|██▎       | 88198/371472 [7:00:43<20:20:07,  3.87it/s]
 24%|██▎       | 88199/371472 [7:00:44<21:34:49,  3.65it/s]
 24%|██▎       | 88200/371472 [7:00:44<21:45:43,  3.62it/s]
                                                           
{'loss': 3.7896, 'learning_rate': 7.866793078928655e-07, 'epoch': 3.8}

 24%|██▎       | 88200/371472 [7:00:44<21:45:43,  3.62it/s]
 24%|██▎       | 88201/371472 [7:00:44<21:33:51,  3.65it/s]
 24%|██▎       | 88202/371472 [7:00:44<21:27:13,  3.67it/s]
 24%|██▎       | 88203/371472 [7:00:45<22:29:18,  3.50it/s]
 24%|██▎       | 88204/371472 [7:00:45<22:17:33,  3.53it/s]
 24%|██▎       | 88205/371472 [7:00:45<22:28:31,  3.50it/s]
 24%|██▎       | 88206/371472 [7:00:46<22:14:47,  3.54it/s]
 24%|██▎       | 88207/371472 [7:00:46<21:23:05,  3.68it/s]
 24%|██▎       | 88208/371472 [7:00:46<21:27:02,  3.67it/s]
 24%|██▎       | 88209/371472 [7:00:46<21:16:55,  3.70it/s]
 24%|██▎       | 88210/371472 [7:00:47<22:34:30,  3.49it/s]
 24%|██▎       | 88211/371472 [7:00:47<22:34:59,  3.48it/s]
 24%|██▎       | 88212/371472 [7:00:47<23:43:14,  3.32it/s]
 24%|██▎       | 88213/371472 [7:00:48<22:25:38,  3.51it/s]
 24%|██▎       | 88214/371472 [7:00:48<22:27:58,  3.50it/s]
 24%|██▎       | 88215/371472 [7:00:48<23:44:16,  3.31it/s]
 24%|██▎       | 88216/371472 [7:00:49<24:41:30,  3.19it/s]
 24%|██▎       | 88217/371472 [7:00:49<25:56:14,  3.03it/s]
 24%|██▎       | 88218/371472 [7:00:49<24:49:09,  3.17it/s]
 24%|██▎       | 88219/371472 [7:00:49<23:23:01,  3.36it/s]
 24%|██▎       | 88220/371472 [7:00:50<23:01:44,  3.42it/s]
                                                           
{'loss': 3.5694, 'learning_rate': 7.866308259173867e-07, 'epoch': 3.8}

 24%|██▎       | 88220/371472 [7:00:50<23:01:44,  3.42it/s]
 24%|██▎       | 88221/371472 [7:00:50<22:22:59,  3.52it/s]
 24%|██▎       | 88222/371472 [7:00:50<22:17:27,  3.53it/s]
 24%|██▎       | 88223/371472 [7:00:51<22:22:30,  3.52it/s]
 24%|██▎       | 88224/371472 [7:00:51<24:36:59,  3.20it/s]
 24%|██▍       | 88225/371472 [7:00:51<25:23:16,  3.10it/s]
 24%|██▍       | 88226/371472 [7:00:52<23:53:53,  3.29it/s]
 24%|██▍       | 88227/371472 [7:00:52<23:02:57,  3.41it/s]
 24%|██▍       | 88228/371472 [7:00:52<22:27:51,  3.50it/s]
 24%|██▍       | 88229/371472 [7:00:52<21:36:07,  3.64it/s]
 24%|██▍       | 88230/371472 [7:00:53<22:46:31,  3.45it/s]
 24%|██▍       | 88231/371472 [7:00:53<23:44:32,  3.31it/s]
 24%|██▍       | 88232/371472 [7:00:53<23:22:38,  3.37it/s]
 24%|██▍       | 88233/371472 [7:00:54<28:43:16,  2.74it/s]
 24%|██▍       | 88234/371472 [7:00:54<27:01:59,  2.91it/s]
 24%|██▍       | 88235/371472 [7:00:54<26:58:21,  2.92it/s]
 24%|██▍       | 88236/371472 [7:00:55<24:35:31,  3.20it/s]
 24%|██▍       | 88237/371472 [7:00:55<24:16:18,  3.24it/s]
 24%|██▍       | 88238/371472 [7:00:55<23:40:13,  3.32it/s]
 24%|██▍       | 88239/371472 [7:00:56<24:16:40,  3.24it/s]
 24%|██▍       | 88240/371472 [7:00:56<23:05:39,  3.41it/s]
                                                           
{'loss': 3.8739, 'learning_rate': 7.865823439419076e-07, 'epoch': 3.8}

 24%|██▍       | 88240/371472 [7:00:56<23:05:39,  3.41it/s]
 24%|██▍       | 88241/371472 [7:00:56<22:41:01,  3.47it/s]
 24%|██▍       | 88242/371472 [7:00:56<22:48:38,  3.45it/s]
 24%|██▍       | 88243/371472 [7:00:57<22:39:26,  3.47it/s]
 24%|██▍       | 88244/371472 [7:00:57<21:58:34,  3.58it/s]
 24%|██▍       | 88245/371472 [7:00:57<21:37:55,  3.64it/s]
 24%|██▍       | 88246/371472 [7:00:57<21:02:30,  3.74it/s]
 24%|██▍       | 88247/371472 [7:00:58<21:19:31,  3.69it/s]
 24%|██▍       | 88248/371472 [7:00:58<21:49:02,  3.61it/s]
 24%|██▍       | 88249/371472 [7:00:58<21:48:45,  3.61it/s]
 24%|██▍       | 88250/371472 [7:00:59<21:29:09,  3.66it/s]
 24%|██▍       | 88251/371472 [7:00:59<20:45:36,  3.79it/s]
 24%|██▍       | 88252/371472 [7:00:59<21:46:05,  3.61it/s]
 24%|██▍       | 88253/371472 [7:00:59<20:58:32,  3.75it/s]
 24%|██▍       | 88254/371472 [7:01:00<22:28:52,  3.50it/s]
 24%|██▍       | 88255/371472 [7:01:00<21:51:48,  3.60it/s]
 24%|██▍       | 88256/371472 [7:01:00<21:31:32,  3.65it/s]
 24%|██▍       | 88257/371472 [7:01:01<23:17:13,  3.38it/s]
 24%|██▍       | 88258/371472 [7:01:01<23:32:05,  3.34it/s]
 24%|██▍       | 88259/371472 [7:01:01<22:59:49,  3.42it/s]
 24%|██▍       | 88260/371472 [7:01:01<22:02:52,  3.57it/s]
                                                           
{'loss': 3.9219, 'learning_rate': 7.865338619664289e-07, 'epoch': 3.8}

 24%|██▍       | 88260/371472 [7:01:01<22:02:52,  3.57it/s]
 24%|██▍       | 88261/371472 [7:01:02<22:05:49,  3.56it/s]
 24%|██▍       | 88262/371472 [7:01:02<22:09:57,  3.55it/s]
 24%|██▍       | 88263/371472 [7:01:02<21:29:39,  3.66it/s]
 24%|██▍       | 88264/371472 [7:01:03<23:46:28,  3.31it/s]
 24%|██▍       | 88265/371472 [7:01:03<23:31:02,  3.35it/s]
 24%|██▍       | 88266/371472 [7:01:03<22:19:45,  3.52it/s]
 24%|██▍       | 88267/371472 [7:01:03<22:05:28,  3.56it/s]
 24%|██▍       | 88268/371472 [7:01:04<22:24:20,  3.51it/s]
 24%|██▍       | 88269/371472 [7:01:04<21:42:19,  3.62it/s]
 24%|██▍       | 88270/371472 [7:01:04<21:48:21,  3.61it/s]
 24%|██▍       | 88271/371472 [7:01:04<21:16:34,  3.70it/s]
 24%|██▍       | 88272/371472 [7:01:05<21:05:18,  3.73it/s]
 24%|██▍       | 88273/371472 [7:01:05<20:52:56,  3.77it/s]
 24%|██▍       | 88274/371472 [7:01:05<21:19:34,  3.69it/s]
 24%|██▍       | 88275/371472 [7:01:06<20:56:47,  3.76it/s]
 24%|██▍       | 88276/371472 [7:01:06<20:49:06,  3.78it/s]
 24%|██▍       | 88277/371472 [7:01:06<22:27:46,  3.50it/s]
 24%|██▍       | 88278/371472 [7:01:06<23:37:45,  3.33it/s]
 24%|██▍       | 88279/371472 [7:01:07<23:26:51,  3.35it/s]
 24%|██▍       | 88280/371472 [7:01:07<22:45:45,  3.46it/s]
                                                           
{'loss': 4.0126, 'learning_rate': 7.8648537999095e-07, 'epoch': 3.8}

 24%|██▍       | 88280/371472 [7:01:07<22:45:45,  3.46it/s]
 24%|██▍       | 88281/371472 [7:01:07<22:08:04,  3.55it/s]
 24%|██▍       | 88282/371472 [7:01:08<21:50:11,  3.60it/s]
 24%|██▍       | 88283/371472 [7:01:08<22:49:21,  3.45it/s]
 24%|██▍       | 88284/371472 [7:01:08<22:07:00,  3.56it/s]
 24%|██▍       | 88285/371472 [7:01:08<22:23:35,  3.51it/s]
 24%|██▍       | 88286/371472 [7:01:09<21:44:20,  3.62it/s]
 24%|██▍       | 88287/371472 [7:01:09<20:56:55,  3.76it/s]
 24%|██▍       | 88288/371472 [7:01:09<21:33:52,  3.65it/s]
 24%|██▍       | 88289/371472 [7:01:10<21:34:48,  3.65it/s]
 24%|██▍       | 88290/371472 [7:01:10<22:13:35,  3.54it/s]
 24%|██▍       | 88291/371472 [7:01:10<21:31:36,  3.65it/s]
 24%|██▍       | 88292/371472 [7:01:10<21:17:09,  3.70it/s]
 24%|██▍       | 88293/371472 [7:01:11<20:45:18,  3.79it/s]
 24%|██▍       | 88294/371472 [7:01:11<21:39:12,  3.63it/s]
 24%|██▍       | 88295/371472 [7:01:11<22:19:22,  3.52it/s]
 24%|██▍       | 88296/371472 [7:01:11<22:02:51,  3.57it/s]
 24%|██▍       | 88297/371472 [7:01:12<21:33:02,  3.65it/s]
 24%|██▍       | 88298/371472 [7:01:12<21:45:36,  3.61it/s]
 24%|██▍       | 88299/371472 [7:01:12<22:12:28,  3.54it/s]
 24%|██▍       | 88300/371472 [7:01:13<22:20:56,  3.52it/s]
                                                           
{'loss': 3.8891, 'learning_rate': 7.864368980154712e-07, 'epoch': 3.8}

 24%|██▍       | 88300/371472 [7:01:13<22:20:56,  3.52it/s]
 24%|██▍       | 88301/371472 [7:01:13<22:19:25,  3.52it/s]
 24%|██▍       | 88302/371472 [7:01:13<23:57:08,  3.28it/s]
 24%|██▍       | 88303/371472 [7:01:13<22:51:26,  3.44it/s]
 24%|██▍       | 88304/371472 [7:01:14<23:33:06,  3.34it/s]
 24%|██▍       | 88305/371472 [7:01:14<23:04:12,  3.41it/s]
 24%|██▍       | 88306/371472 [7:01:14<22:56:29,  3.43it/s]
 24%|██▍       | 88307/371472 [7:01:15<22:21:50,  3.52it/s]
 24%|██▍       | 88308/371472 [7:01:15<22:17:08,  3.53it/s]
 24%|██▍       | 88309/371472 [7:01:15<21:43:58,  3.62it/s]
 24%|██▍       | 88310/371472 [7:01:15<22:08:07,  3.55it/s]
 24%|██▍       | 88311/371472 [7:01:16<24:00:43,  3.28it/s]
 24%|██▍       | 88312/371472 [7:01:16<23:06:54,  3.40it/s]
 24%|██▍       | 88313/371472 [7:01:16<23:19:21,  3.37it/s]
 24%|██▍       | 88314/371472 [7:01:17<22:36:02,  3.48it/s]
 24%|██▍       | 88315/371472 [7:01:17<21:23:53,  3.68it/s]
 24%|██▍       | 88316/371472 [7:01:17<21:30:38,  3.66it/s]
 24%|██▍       | 88317/371472 [7:01:17<21:28:53,  3.66it/s]
 24%|██▍       | 88318/371472 [7:01:18<21:54:45,  3.59it/s]
 24%|██▍       | 88319/371472 [7:01:18<21:51:39,  3.60it/s]
 24%|██▍       | 88320/371472 [7:01:18<21:49:59,  3.60it/s]
                                                           
{'loss': 3.9425, 'learning_rate': 7.863884160399921e-07, 'epoch': 3.8}

 24%|██▍       | 88320/371472 [7:01:18<21:49:59,  3.60it/s]
 24%|██▍       | 88321/371472 [7:01:19<21:29:02,  3.66it/s]
 24%|██▍       | 88322/371472 [7:01:19<22:18:25,  3.53it/s]
 24%|██▍       | 88323/371472 [7:01:19<22:48:14,  3.45it/s]
 24%|██▍       | 88324/371472 [7:01:19<22:50:11,  3.44it/s]
 24%|██▍       | 88325/371472 [7:01:20<22:24:44,  3.51it/s]
 24%|██▍       | 88326/371472 [7:01:20<21:59:41,  3.58it/s]
 24%|██▍       | 88327/371472 [7:01:20<21:44:30,  3.62it/s]
 24%|██▍       | 88328/371472 [7:01:21<21:17:30,  3.69it/s]
 24%|██▍       | 88329/371472 [7:01:21<22:39:34,  3.47it/s]
 24%|██▍       | 88330/371472 [7:01:21<23:13:08,  3.39it/s]
 24%|██▍       | 88331/371472 [7:01:21<22:15:50,  3.53it/s]
 24%|██▍       | 88332/371472 [7:01:22<22:07:23,  3.56it/s]
 24%|██▍       | 88333/371472 [7:01:22<21:31:05,  3.66it/s]
 24%|██▍       | 88334/371472 [7:01:22<20:51:51,  3.77it/s]
 24%|██▍       | 88335/371472 [7:01:22<21:36:20,  3.64it/s]
 24%|██▍       | 88336/371472 [7:01:23<21:17:33,  3.69it/s]
 24%|██▍       | 88337/371472 [7:01:23<21:09:17,  3.72it/s]
 24%|██▍       | 88338/371472 [7:01:23<21:11:40,  3.71it/s]
 24%|██▍       | 88339/371472 [7:01:24<20:54:32,  3.76it/s]
 24%|██▍       | 88340/371472 [7:01:24<20:34:53,  3.82it/s]
                                                           
{'loss': 4.0016, 'learning_rate': 7.863399340645134e-07, 'epoch': 3.8}

 24%|██▍       | 88340/371472 [7:01:24<20:34:53,  3.82it/s]
 24%|██▍       | 88341/371472 [7:01:24<22:46:53,  3.45it/s]
 24%|██▍       | 88342/371472 [7:01:24<22:23:36,  3.51it/s]
 24%|██▍       | 88343/371472 [7:01:25<21:49:02,  3.60it/s]
 24%|██▍       | 88344/371472 [7:01:25<22:06:42,  3.56it/s]
 24%|██▍       | 88345/371472 [7:01:25<23:25:17,  3.36it/s]
 24%|██▍       | 88346/371472 [7:01:26<21:48:26,  3.61it/s]
 24%|██▍       | 88347/371472 [7:01:26<23:54:50,  3.29it/s]
 24%|██▍       | 88348/371472 [7:01:26<22:30:41,  3.49it/s]
 24%|██▍       | 88349/371472 [7:01:26<22:17:48,  3.53it/s]
 24%|██▍       | 88350/371472 [7:01:27<22:00:35,  3.57it/s]
 24%|██▍       | 88351/371472 [7:01:27<22:06:43,  3.56it/s]
 24%|██▍       | 88352/371472 [7:01:27<22:48:03,  3.45it/s]
 24%|██▍       | 88353/371472 [7:01:28<23:47:55,  3.30it/s]
 24%|██▍       | 88354/371472 [7:01:28<23:19:40,  3.37it/s]
 24%|██▍       | 88355/371472 [7:01:28<23:00:33,  3.42it/s]
 24%|██▍       | 88356/371472 [7:01:28<22:48:04,  3.45it/s]
 24%|██▍       | 88357/371472 [7:01:29<23:10:15,  3.39it/s]
 24%|██▍       | 88358/371472 [7:01:29<23:09:09,  3.40it/s]
 24%|██▍       | 88359/371472 [7:01:29<23:21:45,  3.37it/s]
 24%|██▍       | 88360/371472 [7:01:30<22:19:59,  3.52it/s]
                                                           
{'loss': 3.8384, 'learning_rate': 7.862914520890344e-07, 'epoch': 3.81}

 24%|██▍       | 88360/371472 [7:01:30<22:19:59,  3.52it/s]
 24%|██▍       | 88361/371472 [7:01:30<21:47:15,  3.61it/s]
 24%|██▍       | 88362/371472 [7:01:30<21:19:20,  3.69it/s]
 24%|██▍       | 88363/371472 [7:01:30<20:33:55,  3.82it/s]
 24%|██▍       | 88364/371472 [7:01:31<22:17:20,  3.53it/s]
 24%|██▍       | 88365/371472 [7:01:31<24:11:36,  3.25it/s]
 24%|██▍       | 88366/371472 [7:01:31<23:10:31,  3.39it/s]
 24%|██▍       | 88367/371472 [7:01:32<23:15:59,  3.38it/s]
 24%|██▍       | 88368/371472 [7:01:32<22:07:08,  3.56it/s]
 24%|██▍       | 88369/371472 [7:01:32<21:04:08,  3.73it/s]
 24%|██▍       | 88370/371472 [7:01:32<21:46:11,  3.61it/s]
 24%|██▍       | 88371/371472 [7:01:33<22:47:19,  3.45it/s]
 24%|██▍       | 88372/371472 [7:01:33<21:35:41,  3.64it/s]
 24%|██▍       | 88373/371472 [7:01:33<21:43:48,  3.62it/s]
 24%|██▍       | 88374/371472 [7:01:34<21:00:47,  3.74it/s]
 24%|██▍       | 88375/371472 [7:01:34<21:09:07,  3.72it/s]
 24%|██▍       | 88376/371472 [7:01:34<21:34:25,  3.65it/s]
 24%|██▍       | 88377/371472 [7:01:34<22:07:59,  3.55it/s]
 24%|██▍       | 88378/371472 [7:01:35<22:24:56,  3.51it/s]
 24%|██▍       | 88379/371472 [7:01:35<21:37:13,  3.64it/s]
 24%|██▍       | 88380/371472 [7:01:35<21:58:23,  3.58it/s]
                                                           
{'loss': 4.0418, 'learning_rate': 7.862429701135556e-07, 'epoch': 3.81}

 24%|██▍       | 88380/371472 [7:01:35<21:58:23,  3.58it/s]
 24%|██▍       | 88381/371472 [7:01:35<22:06:49,  3.56it/s]
 24%|██▍       | 88382/371472 [7:01:36<22:31:14,  3.49it/s]
 24%|██▍       | 88383/371472 [7:01:36<22:54:20,  3.43it/s]
 24%|██▍       | 88384/371472 [7:01:36<22:39:35,  3.47it/s]
 24%|██▍       | 88385/371472 [7:01:37<22:28:25,  3.50it/s]
 24%|██▍       | 88386/371472 [7:01:37<21:46:11,  3.61it/s]
 24%|██▍       | 88387/371472 [7:01:37<21:02:46,  3.74it/s]
 24%|██▍       | 88388/371472 [7:01:37<22:03:29,  3.56it/s]
 24%|██▍       | 88389/371472 [7:01:38<21:25:29,  3.67it/s]
 24%|██▍       | 88390/371472 [7:01:38<21:46:28,  3.61it/s]
 24%|██▍       | 88391/371472 [7:01:38<22:06:31,  3.56it/s]
 24%|██▍       | 88392/371472 [7:01:39<22:05:55,  3.56it/s]
 24%|██▍       | 88393/371472 [7:01:39<24:24:42,  3.22it/s]
 24%|██▍       | 88394/371472 [7:01:39<22:55:22,  3.43it/s]
 24%|██▍       | 88395/371472 [7:01:40<24:53:50,  3.16it/s]
 24%|██▍       | 88396/371472 [7:01:40<24:54:20,  3.16it/s]
 24%|██▍       | 88397/371472 [7:01:40<23:47:25,  3.31it/s]
 24%|██▍       | 88398/371472 [7:01:40<24:02:01,  3.27it/s]
 24%|██▍       | 88399/371472 [7:01:41<22:58:26,  3.42it/s]
 24%|██▍       | 88400/371472 [7:01:41<22:52:00,  3.44it/s]
                                                           
{'loss': 3.6954, 'learning_rate': 7.861944881380766e-07, 'epoch': 3.81}

 24%|██▍       | 88400/371472 [7:01:41<22:52:00,  3.44it/s]
 24%|██▍       | 88401/371472 [7:01:41<22:51:05,  3.44it/s]
 24%|██▍       | 88402/371472 [7:01:42<22:51:32,  3.44it/s]
 24%|██▍       | 88403/371472 [7:01:42<23:09:50,  3.39it/s]
 24%|██▍       | 88404/371472 [7:01:42<23:50:31,  3.30it/s]
 24%|██▍       | 88405/371472 [7:01:43<23:26:08,  3.36it/s]
 24%|██▍       | 88406/371472 [7:01:43<22:46:31,  3.45it/s]
 24%|██▍       | 88407/371472 [7:01:43<22:51:46,  3.44it/s]
 24%|██▍       | 88408/371472 [7:01:43<25:40:09,  3.06it/s]
 24%|██▍       | 88409/371472 [7:01:44<25:38:33,  3.07it/s]
 24%|██▍       | 88410/371472 [7:01:44<24:36:21,  3.20it/s]
 24%|██▍       | 88411/371472 [7:01:44<23:44:45,  3.31it/s]
 24%|██▍       | 88412/371472 [7:01:45<22:50:37,  3.44it/s]
 24%|██▍       | 88413/371472 [7:01:45<22:16:56,  3.53it/s]
 24%|██▍       | 88414/371472 [7:01:45<21:57:50,  3.58it/s]
 24%|██▍       | 88415/371472 [7:01:46<22:58:39,  3.42it/s]
 24%|██▍       | 88416/371472 [7:01:46<22:37:17,  3.48it/s]
 24%|██▍       | 88417/371472 [7:01:46<21:59:46,  3.57it/s]
 24%|██▍       | 88418/371472 [7:01:46<22:18:42,  3.52it/s]
 24%|██▍       | 88419/371472 [7:01:47<21:48:04,  3.61it/s]
 24%|██▍       | 88420/371472 [7:01:47<21:36:49,  3.64it/s]
                                                           
{'loss': 3.8187, 'learning_rate': 7.861460061625977e-07, 'epoch': 3.81}

 24%|██▍       | 88420/371472 [7:01:47<21:36:49,  3.64it/s]
 24%|██▍       | 88421/371472 [7:01:47<21:40:09,  3.63it/s]
 24%|██▍       | 88422/371472 [7:01:47<22:08:57,  3.55it/s]
 24%|██▍       | 88423/371472 [7:01:48<22:52:36,  3.44it/s]
 24%|██▍       | 88424/371472 [7:01:48<22:24:17,  3.51it/s]
 24%|██▍       | 88425/371472 [7:01:48<22:45:07,  3.46it/s]
 24%|██▍       | 88426/371472 [7:01:49<21:57:44,  3.58it/s]
 24%|██▍       | 88427/371472 [7:01:49<21:55:30,  3.59it/s]
 24%|██▍       | 88428/371472 [7:01:49<23:43:26,  3.31it/s]
 24%|██▍       | 88429/371472 [7:01:50<23:28:17,  3.35it/s]
 24%|██▍       | 88430/371472 [7:01:50<22:20:03,  3.52it/s]
 24%|██▍       | 88431/371472 [7:01:50<22:39:49,  3.47it/s]
 24%|██▍       | 88432/371472 [7:01:50<21:42:18,  3.62it/s]
 24%|██▍       | 88433/371472 [7:01:51<22:01:33,  3.57it/s]
 24%|██▍       | 88434/371472 [7:01:51<22:04:45,  3.56it/s]
 24%|██▍       | 88435/371472 [7:01:51<21:43:37,  3.62it/s]
 24%|██▍       | 88436/371472 [7:01:51<21:31:52,  3.65it/s]
 24%|██▍       | 88437/371472 [7:01:52<20:49:40,  3.77it/s]
 24%|██▍       | 88438/371472 [7:01:52<21:31:09,  3.65it/s]
 24%|██▍       | 88439/371472 [7:01:52<20:59:28,  3.75it/s]
 24%|██▍       | 88440/371472 [7:01:52<21:15:57,  3.70it/s]
                                                           
{'loss': 3.8867, 'learning_rate': 7.860975241871188e-07, 'epoch': 3.81}

 24%|██▍       | 88440/371472 [7:01:52<21:15:57,  3.70it/s]
 24%|██▍       | 88441/371472 [7:01:53<22:51:29,  3.44it/s]
 24%|██▍       | 88442/371472 [7:01:53<24:33:23,  3.20it/s]
 24%|██▍       | 88443/371472 [7:01:53<24:22:57,  3.22it/s]
 24%|██▍       | 88444/371472 [7:01:54<24:01:35,  3.27it/s]
 24%|██▍       | 88445/371472 [7:01:54<22:38:29,  3.47it/s]
 24%|██▍       | 88446/371472 [7:01:54<21:42:44,  3.62it/s]
 24%|██▍       | 88447/371472 [7:01:55<25:01:22,  3.14it/s]
 24%|██▍       | 88448/371472 [7:01:55<24:14:47,  3.24it/s]
 24%|██▍       | 88449/371472 [7:01:55<24:10:12,  3.25it/s]
 24%|██▍       | 88450/371472 [7:01:56<22:36:09,  3.48it/s]
 24%|██▍       | 88451/371472 [7:01:56<21:44:25,  3.62it/s]
 24%|██▍       | 88452/371472 [7:01:56<21:50:44,  3.60it/s]
 24%|██▍       | 88453/371472 [7:01:56<23:15:37,  3.38it/s]
 24%|██▍       | 88454/371472 [7:01:57<24:09:33,  3.25it/s]
 24%|██▍       | 88455/371472 [7:01:57<22:36:01,  3.48it/s]
 24%|██▍       | 88456/371472 [7:01:57<23:18:31,  3.37it/s]
 24%|██▍       | 88457/371472 [7:01:58<23:32:02,  3.34it/s]
 24%|██▍       | 88458/371472 [7:01:58<22:34:58,  3.48it/s]
 24%|██▍       | 88459/371472 [7:01:58<21:46:52,  3.61it/s]
 24%|██▍       | 88460/371472 [7:01:58<22:02:33,  3.57it/s]
                                                           
{'loss': 3.9452, 'learning_rate': 7.8604904221164e-07, 'epoch': 3.81}

 24%|██▍       | 88460/371472 [7:01:58<22:02:33,  3.57it/s]
 24%|██▍       | 88461/371472 [7:01:59<22:12:41,  3.54it/s]
 24%|██▍       | 88462/371472 [7:01:59<21:40:50,  3.63it/s]
 24%|██▍       | 88463/371472 [7:01:59<21:31:05,  3.65it/s]
 24%|██▍       | 88464/371472 [7:01:59<21:52:59,  3.59it/s]
 24%|██▍       | 88465/371472 [7:02:00<21:28:43,  3.66it/s]
 24%|██▍       | 88466/371472 [7:02:00<21:26:29,  3.67it/s]
 24%|██▍       | 88467/371472 [7:02:00<23:02:56,  3.41it/s]
 24%|██▍       | 88468/371472 [7:02:01<22:49:01,  3.45it/s]
 24%|██▍       | 88469/371472 [7:02:01<23:32:42,  3.34it/s]
 24%|██▍       | 88470/371472 [7:02:01<22:57:37,  3.42it/s]
 24%|██▍       | 88471/371472 [7:02:01<21:42:41,  3.62it/s]
 24%|██▍       | 88472/371472 [7:02:02<21:59:14,  3.58it/s]
 24%|██▍       | 88473/371472 [7:02:02<21:06:16,  3.72it/s]
 24%|██▍       | 88474/371472 [7:02:02<21:39:18,  3.63it/s]
 24%|██▍       | 88475/371472 [7:02:03<22:53:56,  3.43it/s]
 24%|██▍       | 88476/371472 [7:02:03<22:45:05,  3.46it/s]
 24%|██▍       | 88477/371472 [7:02:03<23:27:07,  3.35it/s]
 24%|██▍       | 88478/371472 [7:02:04<23:32:55,  3.34it/s]
 24%|██▍       | 88479/371472 [7:02:04<22:55:08,  3.43it/s]
 24%|██▍       | 88480/371472 [7:02:04<22:34:06,  3.48it/s]
                                                           
{'loss': 3.8708, 'learning_rate': 7.86000560236161e-07, 'epoch': 3.81}

 24%|██▍       | 88480/371472 [7:02:04<22:34:06,  3.48it/s]
 24%|██▍       | 88481/371472 [7:02:04<21:55:41,  3.58it/s]
 24%|██▍       | 88482/371472 [7:02:05<21:52:02,  3.59it/s]
 24%|██▍       | 88483/371472 [7:02:05<22:21:21,  3.52it/s]
 24%|██▍       | 88484/371472 [7:02:05<22:35:00,  3.48it/s]
 24%|██▍       | 88485/371472 [7:02:06<22:40:09,  3.47it/s]
 24%|██▍       | 88486/371472 [7:02:06<22:04:35,  3.56it/s]
 24%|██▍       | 88487/371472 [7:02:06<21:56:05,  3.58it/s]
 24%|██▍       | 88488/371472 [7:02:06<21:05:09,  3.73it/s]
 24%|██▍       | 88489/371472 [7:02:07<20:58:55,  3.75it/s]
 24%|██▍       | 88490/371472 [7:02:07<23:09:49,  3.39it/s]
 24%|██▍       | 88491/371472 [7:02:07<23:19:54,  3.37it/s]
 24%|██▍       | 88492/371472 [7:02:07<22:33:52,  3.48it/s]
 24%|██▍       | 88493/371472 [7:02:08<21:55:46,  3.58it/s]
 24%|██▍       | 88494/371472 [7:02:08<21:49:15,  3.60it/s]
 24%|██▍       | 88495/371472 [7:02:08<22:00:45,  3.57it/s]
 24%|██▍       | 88496/371472 [7:02:09<22:02:01,  3.57it/s]
 24%|██▍       | 88497/371472 [7:02:09<22:31:02,  3.49it/s]
 24%|██▍       | 88498/371472 [7:02:09<21:42:08,  3.62it/s]
 24%|██▍       | 88499/371472 [7:02:10<23:53:09,  3.29it/s]
 24%|██▍       | 88500/371472 [7:02:10<23:52:50,  3.29it/s]
                                                           
{'loss': 3.834, 'learning_rate': 7.859520782606821e-07, 'epoch': 3.81}

 24%|██▍       | 88500/371472 [7:02:10<23:52:50,  3.29it/s]
 24%|██▍       | 88501/371472 [7:02:10<23:19:00,  3.37it/s]
 24%|██▍       | 88502/371472 [7:02:10<23:26:13,  3.35it/s]
 24%|██▍       | 88503/371472 [7:02:11<23:45:50,  3.31it/s]
 24%|██▍       | 88504/371472 [7:02:11<22:56:40,  3.43it/s]
 24%|██▍       | 88505/371472 [7:02:11<24:36:00,  3.20it/s]
 24%|██▍       | 88506/371472 [7:02:12<23:07:06,  3.40it/s]
 24%|██▍       | 88507/371472 [7:02:12<22:09:35,  3.55it/s]
 24%|██▍       | 88508/371472 [7:02:12<22:04:25,  3.56it/s]
 24%|██▍       | 88509/371472 [7:02:12<22:31:08,  3.49it/s]
 24%|██▍       | 88510/371472 [7:02:13<22:04:20,  3.56it/s]
 24%|██▍       | 88511/371472 [7:02:13<22:01:30,  3.57it/s]
 24%|██▍       | 88512/371472 [7:02:13<24:49:16,  3.17it/s]
 24%|██▍       | 88513/371472 [7:02:14<23:06:01,  3.40it/s]
 24%|██▍       | 88514/371472 [7:02:14<21:55:47,  3.58it/s]
 24%|██▍       | 88515/371472 [7:02:14<22:12:20,  3.54it/s]
 24%|██▍       | 88516/371472 [7:02:15<24:11:54,  3.25it/s]
 24%|██▍       | 88517/371472 [7:02:15<25:06:32,  3.13it/s]
 24%|██▍       | 88518/371472 [7:02:15<24:36:36,  3.19it/s]
 24%|██▍       | 88519/371472 [7:02:15<23:14:14,  3.38it/s]
 24%|██▍       | 88520/371472 [7:02:16<24:11:25,  3.25it/s]
                                                           
{'loss': 3.9532, 'learning_rate': 7.859035962852033e-07, 'epoch': 3.81}

 24%|██▍       | 88520/371472 [7:02:16<24:11:25,  3.25it/s]
 24%|██▍       | 88521/371472 [7:02:16<23:24:36,  3.36it/s]
 24%|██▍       | 88522/371472 [7:02:16<22:27:39,  3.50it/s]
 24%|██▍       | 88523/371472 [7:02:17<22:50:18,  3.44it/s]
 24%|██▍       | 88524/371472 [7:02:17<22:42:09,  3.46it/s]
 24%|██▍       | 88525/371472 [7:02:17<22:16:39,  3.53it/s]
 24%|██▍       | 88526/371472 [7:02:17<22:22:10,  3.51it/s]
 24%|██▍       | 88527/371472 [7:02:18<21:26:33,  3.67it/s]
 24%|██▍       | 88528/371472 [7:02:18<22:44:57,  3.45it/s]
 24%|██▍       | 88529/371472 [7:02:18<23:02:15,  3.41it/s]
 24%|██▍       | 88530/371472 [7:02:19<22:43:00,  3.46it/s]
 24%|██▍       | 88531/371472 [7:02:19<21:58:00,  3.58it/s]
 24%|██▍       | 88532/371472 [7:02:19<24:42:07,  3.18it/s]
 24%|██▍       | 88533/371472 [7:02:19<23:27:06,  3.35it/s]
 24%|██▍       | 88534/371472 [7:02:20<23:22:02,  3.36it/s]
 24%|██▍       | 88535/371472 [7:02:20<23:14:09,  3.38it/s]
 24%|██▍       | 88536/371472 [7:02:20<23:04:26,  3.41it/s]
 24%|██▍       | 88537/371472 [7:02:21<23:02:05,  3.41it/s]
 24%|██▍       | 88538/371472 [7:02:21<22:29:53,  3.49it/s]
 24%|██▍       | 88539/371472 [7:02:21<22:51:49,  3.44it/s]
 24%|██▍       | 88540/371472 [7:02:22<22:46:11,  3.45it/s]
                                                           
{'loss': 3.7738, 'learning_rate': 7.858551143097245e-07, 'epoch': 3.81}

 24%|██▍       | 88540/371472 [7:02:22<22:46:11,  3.45it/s]
 24%|██▍       | 88541/371472 [7:02:22<24:46:56,  3.17it/s]
 24%|██▍       | 88542/371472 [7:02:22<23:40:49,  3.32it/s]
 24%|██▍       | 88543/371472 [7:02:22<22:52:12,  3.44it/s]
 24%|██▍       | 88544/371472 [7:02:23<23:46:10,  3.31it/s]
 24%|██▍       | 88545/371472 [7:02:23<23:27:40,  3.35it/s]
 24%|██▍       | 88546/371472 [7:02:23<24:55:13,  3.15it/s]
 24%|██▍       | 88547/371472 [7:02:24<25:45:22,  3.05it/s]
 24%|██▍       | 88548/371472 [7:02:24<24:33:53,  3.20it/s]
 24%|██▍       | 88549/371472 [7:02:24<22:56:38,  3.43it/s]
 24%|██▍       | 88550/371472 [7:02:25<23:00:29,  3.42it/s]
 24%|██▍       | 88551/371472 [7:02:25<22:13:49,  3.54it/s]
 24%|██▍       | 88552/371472 [7:02:25<21:27:58,  3.66it/s]
 24%|██▍       | 88553/371472 [7:02:25<21:26:08,  3.67it/s]
 24%|██▍       | 88554/371472 [7:02:26<21:22:41,  3.68it/s]
 24%|██▍       | 88555/371472 [7:02:26<21:24:02,  3.67it/s]
 24%|██▍       | 88556/371472 [7:02:26<21:32:53,  3.65it/s]
 24%|██▍       | 88557/371472 [7:02:26<21:30:20,  3.65it/s]
 24%|██▍       | 88558/371472 [7:02:27<22:27:26,  3.50it/s]
 24%|██▍       | 88559/371472 [7:02:27<22:42:05,  3.46it/s]
 24%|██▍       | 88560/371472 [7:02:27<22:35:21,  3.48it/s]
                                                           
{'loss': 3.7843, 'learning_rate': 7.858066323342454e-07, 'epoch': 3.81}

 24%|██▍       | 88560/371472 [7:02:27<22:35:21,  3.48it/s]
 24%|██▍       | 88561/371472 [7:02:28<22:04:52,  3.56it/s]
 24%|██▍       | 88562/371472 [7:02:28<21:24:52,  3.67it/s]
 24%|██▍       | 88563/371472 [7:02:28<22:06:29,  3.55it/s]
 24%|██▍       | 88564/371472 [7:02:28<22:29:28,  3.49it/s]
 24%|██▍       | 88565/371472 [7:02:29<22:37:29,  3.47it/s]
 24%|██▍       | 88566/371472 [7:02:29<22:16:03,  3.53it/s]
 24%|██▍       | 88567/371472 [7:02:29<23:03:47,  3.41it/s]
 24%|██▍       | 88568/371472 [7:02:30<23:01:47,  3.41it/s]
 24%|██▍       | 88569/371472 [7:02:30<22:54:06,  3.43it/s]
 24%|██▍       | 88570/371472 [7:02:30<22:19:57,  3.52it/s]
 24%|██▍       | 88571/371472 [7:02:30<21:02:31,  3.73it/s]
 24%|██▍       | 88572/371472 [7:02:31<21:33:43,  3.64it/s]
 24%|██▍       | 88573/371472 [7:02:31<21:19:30,  3.69it/s]
 24%|██▍       | 88574/371472 [7:02:31<20:54:15,  3.76it/s]
 24%|██▍       | 88575/371472 [7:02:31<20:30:57,  3.83it/s]
 24%|██▍       | 88576/371472 [7:02:32<20:18:03,  3.87it/s]
 24%|██▍       | 88577/371472 [7:02:32<21:39:53,  3.63it/s]
 24%|██▍       | 88578/371472 [7:02:32<21:27:56,  3.66it/s]
 24%|██▍       | 88579/371472 [7:02:33<23:13:24,  3.38it/s]
 24%|██▍       | 88580/371472 [7:02:33<22:15:05,  3.53it/s]
                                                           
{'loss': 3.7998, 'learning_rate': 7.857581503587665e-07, 'epoch': 3.82}

 24%|██▍       | 88580/371472 [7:02:33<22:15:05,  3.53it/s]
 24%|██▍       | 88581/371472 [7:02:33<22:46:18,  3.45it/s]
 24%|██▍       | 88582/371472 [7:02:33<21:52:42,  3.59it/s]
 24%|██▍       | 88583/371472 [7:02:34<21:56:20,  3.58it/s]
 24%|██▍       | 88584/371472 [7:02:34<22:16:08,  3.53it/s]
 24%|██▍       | 88585/371472 [7:02:34<22:35:49,  3.48it/s]
 24%|██▍       | 88586/371472 [7:02:35<24:31:54,  3.20it/s]
 24%|██▍       | 88587/371472 [7:02:35<24:39:45,  3.19it/s]
 24%|██▍       | 88588/371472 [7:02:35<23:14:59,  3.38it/s]
 24%|██▍       | 88589/371472 [7:02:36<22:51:22,  3.44it/s]
 24%|██▍       | 88590/371472 [7:02:36<22:17:17,  3.53it/s]
 24%|██▍       | 88591/371472 [7:02:36<21:42:33,  3.62it/s]
 24%|██▍       | 88592/371472 [7:02:36<23:30:51,  3.34it/s]
 24%|██▍       | 88593/371472 [7:02:37<23:23:53,  3.36it/s]
 24%|██▍       | 88594/371472 [7:02:37<22:30:03,  3.49it/s]
 24%|██▍       | 88595/371472 [7:02:37<22:48:59,  3.44it/s]
 24%|██▍       | 88596/371472 [7:02:38<22:39:17,  3.47it/s]
 24%|██▍       | 88597/371472 [7:02:38<21:45:23,  3.61it/s]
 24%|██▍       | 88598/371472 [7:02:38<21:53:05,  3.59it/s]
 24%|██▍       | 88599/371472 [7:02:38<23:31:31,  3.34it/s]
 24%|██▍       | 88600/371472 [7:02:39<23:05:30,  3.40it/s]
                                                           
{'loss': 3.6708, 'learning_rate': 7.857096683832877e-07, 'epoch': 3.82}

 24%|██▍       | 88600/371472 [7:02:39<23:05:30,  3.40it/s]
 24%|██▍       | 88601/371472 [7:02:39<22:26:31,  3.50it/s]
 24%|██▍       | 88602/371472 [7:02:39<21:40:07,  3.63it/s]
 24%|██▍       | 88603/371472 [7:02:40<22:21:04,  3.52it/s]
 24%|██▍       | 88604/371472 [7:02:40<21:27:30,  3.66it/s]
 24%|██▍       | 88605/371472 [7:02:40<20:46:35,  3.78it/s]
 24%|██▍       | 88606/371472 [7:02:40<20:49:48,  3.77it/s]
 24%|██▍       | 88607/371472 [7:02:41<20:39:03,  3.80it/s]
 24%|██▍       | 88608/371472 [7:02:41<20:29:54,  3.83it/s]
 24%|██▍       | 88609/371472 [7:02:41<22:29:08,  3.49it/s]
 24%|██▍       | 88610/371472 [7:02:41<21:43:54,  3.62it/s]
 24%|██▍       | 88611/371472 [7:02:42<22:05:44,  3.56it/s]
 24%|██▍       | 88612/371472 [7:02:42<21:31:15,  3.65it/s]
 24%|██▍       | 88613/371472 [7:02:42<21:13:49,  3.70it/s]
 24%|██▍       | 88614/371472 [7:02:43<22:06:33,  3.55it/s]
 24%|██▍       | 88615/371472 [7:02:43<21:59:39,  3.57it/s]
 24%|██▍       | 88616/371472 [7:02:43<21:40:46,  3.62it/s]
 24%|██▍       | 88617/371472 [7:02:43<22:01:03,  3.57it/s]
 24%|██▍       | 88618/371472 [7:02:44<21:24:07,  3.67it/s]
 24%|██▍       | 88619/371472 [7:02:44<21:26:05,  3.67it/s]
 24%|██▍       | 88620/371472 [7:02:44<20:51:07,  3.77it/s]
                                                           
{'loss': 4.0309, 'learning_rate': 7.856611864078089e-07, 'epoch': 3.82}

 24%|██▍       | 88620/371472 [7:02:44<20:51:07,  3.77it/s]
 24%|██▍       | 88621/371472 [7:02:44<21:02:05,  3.74it/s]
 24%|██▍       | 88622/371472 [7:02:45<20:30:27,  3.83it/s]
 24%|██▍       | 88623/371472 [7:02:45<24:07:18,  3.26it/s]
 24%|██▍       | 88624/371472 [7:02:45<23:17:10,  3.37it/s]
 24%|██▍       | 88625/371472 [7:02:46<22:24:54,  3.51it/s]
 24%|██▍       | 88626/371472 [7:02:46<22:01:48,  3.57it/s]
 24%|██▍       | 88627/371472 [7:02:46<25:55:57,  3.03it/s]
 24%|██▍       | 88628/371472 [7:02:47<24:25:40,  3.22it/s]
 24%|██▍       | 88629/371472 [7:02:47<24:13:51,  3.24it/s]
 24%|██▍       | 88630/371472 [7:02:47<23:05:40,  3.40it/s]
 24%|██▍       | 88631/371472 [7:02:47<21:58:47,  3.57it/s]
 24%|██▍       | 88632/371472 [7:02:48<21:22:37,  3.68it/s]
 24%|██▍       | 88633/371472 [7:02:48<23:30:22,  3.34it/s]
 24%|██▍       | 88634/371472 [7:02:48<26:23:44,  2.98it/s]
 24%|██▍       | 88635/371472 [7:02:49<26:21:22,  2.98it/s]
 24%|██▍       | 88636/371472 [7:02:49<25:03:41,  3.13it/s]
 24%|██▍       | 88637/371472 [7:02:49<24:02:49,  3.27it/s]
 24%|██▍       | 88638/371472 [7:02:50<22:35:09,  3.48it/s]
 24%|██▍       | 88639/371472 [7:02:50<22:11:29,  3.54it/s]
 24%|██▍       | 88640/371472 [7:02:50<21:35:22,  3.64it/s]
                                                           
{'loss': 3.959, 'learning_rate': 7.856127044323299e-07, 'epoch': 3.82}

 24%|██▍       | 88640/371472 [7:02:50<21:35:22,  3.64it/s]
 24%|██▍       | 88641/371472 [7:02:50<21:56:17,  3.58it/s]
 24%|██▍       | 88642/371472 [7:02:51<21:59:52,  3.57it/s]
 24%|██▍       | 88643/371472 [7:02:51<21:56:48,  3.58it/s]
 24%|██▍       | 88644/371472 [7:02:51<22:03:29,  3.56it/s]
 24%|██▍       | 88645/371472 [7:02:51<21:20:21,  3.68it/s]
 24%|██▍       | 88646/371472 [7:02:52<22:50:36,  3.44it/s]
 24%|██▍       | 88647/371472 [7:02:52<22:33:43,  3.48it/s]
 24%|██▍       | 88648/371472 [7:02:52<22:00:09,  3.57it/s]
 24%|██▍       | 88649/371472 [7:02:53<21:28:02,  3.66it/s]
 24%|██▍       | 88650/371472 [7:02:53<22:24:25,  3.51it/s]
 24%|██▍       | 88651/371472 [7:02:53<21:55:25,  3.58it/s]
 24%|██▍       | 88652/371472 [7:02:54<22:52:58,  3.43it/s]
 24%|██▍       | 88653/371472 [7:02:54<21:47:11,  3.61it/s]
 24%|██▍       | 88654/371472 [7:02:54<21:07:42,  3.72it/s]
 24%|██▍       | 88655/371472 [7:02:54<20:55:19,  3.75it/s]
 24%|██▍       | 88656/371472 [7:02:55<20:45:13,  3.79it/s]
 24%|██▍       | 88657/371472 [7:02:55<20:09:15,  3.90it/s]
 24%|██▍       | 88658/371472 [7:02:55<20:42:44,  3.79it/s]
 24%|██▍       | 88659/371472 [7:02:55<20:23:12,  3.85it/s]
 24%|██▍       | 88660/371472 [7:02:56<20:01:56,  3.92it/s]
                                                           
{'loss': 3.9605, 'learning_rate': 7.85564222456851e-07, 'epoch': 3.82}

 24%|██▍       | 88660/371472 [7:02:56<20:01:56,  3.92it/s]
 24%|██▍       | 88661/371472 [7:02:56<20:15:24,  3.88it/s]
 24%|██▍       | 88662/371472 [7:02:56<20:14:49,  3.88it/s]
 24%|██▍       | 88663/371472 [7:02:56<20:01:42,  3.92it/s]
 24%|██▍       | 88664/371472 [7:02:57<20:13:30,  3.88it/s]
 24%|██▍       | 88665/371472 [7:02:57<20:22:19,  3.86it/s]
 24%|██▍       | 88666/371472 [7:02:57<22:40:30,  3.46it/s]
 24%|██▍       | 88667/371472 [7:02:57<22:12:57,  3.54it/s]
 24%|██▍       | 88668/371472 [7:02:58<20:59:23,  3.74it/s]
 24%|██▍       | 88669/371472 [7:02:58<21:20:07,  3.68it/s]
 24%|██▍       | 88670/371472 [7:02:58<22:16:18,  3.53it/s]
 24%|██▍       | 88671/371472 [7:02:59<21:42:45,  3.62it/s]
 24%|██▍       | 88672/371472 [7:02:59<21:41:49,  3.62it/s]
 24%|██▍       | 88673/371472 [7:02:59<21:35:32,  3.64it/s]
 24%|██▍       | 88674/371472 [7:02:59<21:02:25,  3.73it/s]
 24%|██▍       | 88675/371472 [7:03:00<23:04:29,  3.40it/s]
 24%|██▍       | 88676/371472 [7:03:00<22:57:24,  3.42it/s]
 24%|██▍       | 88677/371472 [7:03:00<22:48:08,  3.45it/s]
 24%|██▍       | 88678/371472 [7:03:01<21:57:46,  3.58it/s]
 24%|██▍       | 88679/371472 [7:03:01<22:10:47,  3.54it/s]
 24%|██▍       | 88680/371472 [7:03:01<22:14:31,  3.53it/s]
                                                           
{'loss': 3.8793, 'learning_rate': 7.855157404813722e-07, 'epoch': 3.82}

 24%|██▍       | 88680/371472 [7:03:01<22:14:31,  3.53it/s]
 24%|██▍       | 88681/371472 [7:03:02<24:36:40,  3.19it/s]
 24%|██▍       | 88682/371472 [7:03:02<24:42:01,  3.18it/s]
 24%|██▍       | 88683/371472 [7:03:02<23:48:44,  3.30it/s]
 24%|██▍       | 88684/371472 [7:03:02<23:29:40,  3.34it/s]
 24%|██▍       | 88685/371472 [7:03:03<24:20:26,  3.23it/s]
 24%|██▍       | 88686/371472 [7:03:03<23:42:34,  3.31it/s]
 24%|██▍       | 88687/371472 [7:03:03<23:21:39,  3.36it/s]
 24%|██▍       | 88688/371472 [7:03:04<21:59:37,  3.57it/s]
 24%|██▍       | 88689/371472 [7:03:04<22:48:35,  3.44it/s]
 24%|██▍       | 88690/371472 [7:03:04<21:57:15,  3.58it/s]
 24%|██▍       | 88691/371472 [7:03:04<21:23:38,  3.67it/s]
 24%|██▍       | 88692/371472 [7:03:05<20:53:14,  3.76it/s]
 24%|██▍       | 88693/371472 [7:03:05<21:13:32,  3.70it/s]
 24%|██▍       | 88694/371472 [7:03:05<20:28:37,  3.84it/s]
 24%|██▍       | 88695/371472 [7:03:05<20:51:29,  3.77it/s]
 24%|██▍       | 88696/371472 [7:03:06<21:46:28,  3.61it/s]
 24%|██▍       | 88697/371472 [7:03:06<24:47:52,  3.17it/s]
 24%|██▍       | 88698/371472 [7:03:06<24:53:56,  3.15it/s]
 24%|██▍       | 88699/371472 [7:03:07<23:21:08,  3.36it/s]
 24%|██▍       | 88700/371472 [7:03:07<22:47:01,  3.45it/s]
                                                           
{'loss': 3.8449, 'learning_rate': 7.854672585058931e-07, 'epoch': 3.82}

 24%|██▍       | 88700/371472 [7:03:07<22:47:01,  3.45it/s]
 24%|██▍       | 88701/371472 [7:03:07<23:18:21,  3.37it/s]
 24%|██▍       | 88702/371472 [7:03:08<22:09:57,  3.54it/s]
 24%|██▍       | 88703/371472 [7:03:08<21:07:30,  3.72it/s]
 24%|██▍       | 88704/371472 [7:03:08<21:29:33,  3.65it/s]
 24%|██▍       | 88705/371472 [7:03:08<21:10:38,  3.71it/s]
 24%|██▍       | 88706/371472 [7:03:09<20:56:49,  3.75it/s]
 24%|██▍       | 88707/371472 [7:03:09<20:21:20,  3.86it/s]
 24%|██▍       | 88708/371472 [7:03:09<20:59:08,  3.74it/s]
 24%|██▍       | 88709/371472 [7:03:09<20:55:24,  3.75it/s]
 24%|██▍       | 88710/371472 [7:03:10<22:05:09,  3.56it/s]
 24%|██▍       | 88711/371472 [7:03:10<21:38:49,  3.63it/s]
 24%|██▍       | 88712/371472 [7:03:10<21:51:43,  3.59it/s]
 24%|██▍       | 88713/371472 [7:03:10<21:37:48,  3.63it/s]
 24%|██▍       | 88714/371472 [7:03:11<24:28:06,  3.21it/s]
 24%|██▍       | 88715/371472 [7:03:11<24:07:53,  3.25it/s]
 24%|██▍       | 88716/371472 [7:03:12<24:55:44,  3.15it/s]
 24%|██▍       | 88717/371472 [7:03:12<23:37:18,  3.33it/s]
 24%|██▍       | 88718/371472 [7:03:12<22:28:09,  3.50it/s]
 24%|██▍       | 88719/371472 [7:03:12<22:03:45,  3.56it/s]
 24%|██▍       | 88720/371472 [7:03:13<21:01:05,  3.74it/s]
                                                           
{'loss': 3.7767, 'learning_rate': 7.854187765304143e-07, 'epoch': 3.82}

 24%|██▍       | 88720/371472 [7:03:13<21:01:05,  3.74it/s]
 24%|██▍       | 88721/371472 [7:03:13<20:58:18,  3.75it/s]
 24%|██▍       | 88722/371472 [7:03:13<20:42:30,  3.79it/s]
 24%|██▍       | 88723/371472 [7:03:13<20:25:35,  3.85it/s]
 24%|██▍       | 88724/371472 [7:03:14<23:36:51,  3.33it/s]
 24%|██▍       | 88725/371472 [7:03:14<22:50:17,  3.44it/s]
 24%|██▍       | 88726/371472 [7:03:14<22:12:02,  3.54it/s]
 24%|██▍       | 88727/371472 [7:03:14<21:20:10,  3.68it/s]
 24%|██▍       | 88728/371472 [7:03:15<21:27:31,  3.66it/s]
 24%|██▍       | 88729/371472 [7:03:15<21:14:55,  3.70it/s]
 24%|██▍       | 88730/371472 [7:03:15<21:32:27,  3.65it/s]
 24%|██▍       | 88731/371472 [7:03:16<21:11:51,  3.71it/s]
 24%|██▍       | 88732/371472 [7:03:16<21:59:08,  3.57it/s]
 24%|██▍       | 88733/371472 [7:03:16<22:16:00,  3.53it/s]
 24%|██▍       | 88734/371472 [7:03:17<24:00:41,  3.27it/s]
 24%|██▍       | 88735/371472 [7:03:17<22:49:31,  3.44it/s]
 24%|██▍       | 88736/371472 [7:03:17<22:09:29,  3.54it/s]
 24%|██▍       | 88737/371472 [7:03:17<22:08:52,  3.55it/s]
 24%|██▍       | 88738/371472 [7:03:18<22:15:25,  3.53it/s]
 24%|██▍       | 88739/371472 [7:03:18<22:01:42,  3.57it/s]
 24%|██▍       | 88740/371472 [7:03:18<22:11:07,  3.54it/s]
                                                           
{'loss': 3.8814, 'learning_rate': 7.853702945549354e-07, 'epoch': 3.82}

 24%|██▍       | 88740/371472 [7:03:18<22:11:07,  3.54it/s]
 24%|██▍       | 88741/371472 [7:03:18<21:30:02,  3.65it/s]
 24%|██▍       | 88742/371472 [7:03:19<21:12:37,  3.70it/s]
 24%|██▍       | 88743/371472 [7:03:19<20:53:43,  3.76it/s]
 24%|██▍       | 88744/371472 [7:03:19<21:08:41,  3.71it/s]
 24%|██▍       | 88745/371472 [7:03:19<20:45:51,  3.78it/s]
 24%|██▍       | 88746/371472 [7:03:20<21:37:26,  3.63it/s]
 24%|██▍       | 88747/371472 [7:03:20<22:27:54,  3.50it/s]
 24%|██▍       | 88748/371472 [7:03:20<25:17:29,  3.11it/s]
 24%|██▍       | 88749/371472 [7:03:21<23:51:42,  3.29it/s]
 24%|██▍       | 88750/371472 [7:03:21<22:53:33,  3.43it/s]
 24%|██▍       | 88751/371472 [7:03:21<22:26:50,  3.50it/s]
 24%|██▍       | 88752/371472 [7:03:22<22:55:11,  3.43it/s]
 24%|██▍       | 88753/371472 [7:03:22<22:39:17,  3.47it/s]
 24%|██▍       | 88754/371472 [7:03:22<21:59:06,  3.57it/s]
 24%|██▍       | 88755/371472 [7:03:22<21:39:32,  3.63it/s]
 24%|██▍       | 88756/371472 [7:03:23<21:18:29,  3.69it/s]
 24%|██▍       | 88757/371472 [7:03:23<21:38:52,  3.63it/s]
 24%|██▍       | 88758/371472 [7:03:23<20:53:56,  3.76it/s]
 24%|██▍       | 88759/371472 [7:03:23<20:55:34,  3.75it/s]
 24%|██▍       | 88760/371472 [7:03:24<21:12:17,  3.70it/s]
                                                           
{'loss': 4.0609, 'learning_rate': 7.853218125794565e-07, 'epoch': 3.82}

 24%|██▍       | 88760/371472 [7:03:24<21:12:17,  3.70it/s]
 24%|██▍       | 88761/371472 [7:03:24<21:01:13,  3.74it/s]
 24%|██▍       | 88762/371472 [7:03:24<21:17:27,  3.69it/s]
 24%|██▍       | 88763/371472 [7:03:25<21:41:56,  3.62it/s]
 24%|██▍       | 88764/371472 [7:03:25<21:44:59,  3.61it/s]
 24%|██▍       | 88765/371472 [7:03:25<21:36:30,  3.63it/s]
 24%|██▍       | 88766/371472 [7:03:25<23:15:12,  3.38it/s]
 24%|██▍       | 88767/371472 [7:03:26<22:28:23,  3.49it/s]
 24%|██▍       | 88768/371472 [7:03:26<21:59:06,  3.57it/s]
 24%|██▍       | 88769/371472 [7:03:26<21:32:30,  3.65it/s]
 24%|██▍       | 88770/371472 [7:03:27<21:33:05,  3.64it/s]
 24%|██▍       | 88771/371472 [7:03:27<21:12:28,  3.70it/s]
 24%|██▍       | 88772/371472 [7:03:27<21:07:42,  3.72it/s]
 24%|██▍       | 88773/371472 [7:03:27<20:38:14,  3.81it/s]
 24%|██▍       | 88774/371472 [7:03:28<20:44:03,  3.79it/s]
 24%|██▍       | 88775/371472 [7:03:28<21:22:43,  3.67it/s]
 24%|██▍       | 88776/371472 [7:03:28<22:07:08,  3.55it/s]
 24%|██▍       | 88777/371472 [7:03:28<22:07:46,  3.55it/s]
 24%|██▍       | 88778/371472 [7:03:29<21:52:27,  3.59it/s]
 24%|██▍       | 88779/371472 [7:03:29<21:45:45,  3.61it/s]
 24%|██▍       | 88780/371472 [7:03:29<21:47:06,  3.60it/s]
                                                           
{'loss': 3.9216, 'learning_rate': 7.852733306039776e-07, 'epoch': 3.82}

 24%|██▍       | 88780/371472 [7:03:29<21:47:06,  3.60it/s]
 24%|██▍       | 88781/371472 [7:03:30<23:47:21,  3.30it/s]
 24%|██▍       | 88782/371472 [7:03:30<22:57:38,  3.42it/s]
 24%|██▍       | 88783/371472 [7:03:30<22:03:06,  3.56it/s]
 24%|██▍       | 88784/371472 [7:03:31<24:12:26,  3.24it/s]
 24%|██▍       | 88785/371472 [7:03:31<24:48:22,  3.17it/s]
 24%|██▍       | 88786/371472 [7:03:31<23:35:44,  3.33it/s]
 24%|██▍       | 88787/371472 [7:03:31<23:11:24,  3.39it/s]
 24%|██▍       | 88788/371472 [7:03:32<22:01:55,  3.56it/s]
 24%|██▍       | 88789/371472 [7:03:32<21:37:18,  3.63it/s]
 24%|██▍       | 88790/371472 [7:03:32<23:36:00,  3.33it/s]
 24%|██▍       | 88791/371472 [7:03:33<23:28:35,  3.34it/s]
 24%|██▍       | 88792/371472 [7:03:33<23:05:11,  3.40it/s]
 24%|██▍       | 88793/371472 [7:03:33<22:41:10,  3.46it/s]
 24%|██▍       | 88794/371472 [7:03:33<23:26:11,  3.35it/s]
 24%|██▍       | 88795/371472 [7:03:34<26:07:24,  3.01it/s]
 24%|██▍       | 88796/371472 [7:03:34<28:41:51,  2.74it/s]
 24%|██▍       | 88797/371472 [7:03:35<27:14:06,  2.88it/s]
 24%|██▍       | 88798/371472 [7:03:35<26:42:44,  2.94it/s]
 24%|██▍       | 88799/371472 [7:03:35<25:54:24,  3.03it/s]
 24%|██▍       | 88800/371472 [7:03:36<25:05:16,  3.13it/s]
                                                           
{'loss': 3.6541, 'learning_rate': 7.852248486284988e-07, 'epoch': 3.82}

 24%|██▍       | 88800/371472 [7:03:36<25:05:16,  3.13it/s]
 24%|██▍       | 88801/371472 [7:03:36<23:41:57,  3.31it/s]
 24%|██▍       | 88802/371472 [7:03:36<24:17:22,  3.23it/s]
 24%|██▍       | 88803/371472 [7:03:36<22:37:48,  3.47it/s]
 24%|██▍       | 88804/371472 [7:03:37<23:22:28,  3.36it/s]
 24%|██▍       | 88805/371472 [7:03:37<23:21:14,  3.36it/s]
 24%|██▍       | 88806/371472 [7:03:37<22:02:15,  3.56it/s]
 24%|██▍       | 88807/371472 [7:03:37<21:09:36,  3.71it/s]
 24%|██▍       | 88808/371472 [7:03:38<22:50:49,  3.44it/s]
 24%|██▍       | 88809/371472 [7:03:38<23:58:14,  3.28it/s]
 24%|██▍       | 88810/371472 [7:03:38<23:08:34,  3.39it/s]
 24%|██▍       | 88811/371472 [7:03:39<22:53:03,  3.43it/s]
 24%|██▍       | 88812/371472 [7:03:39<23:00:03,  3.41it/s]
 24%|██▍       | 88813/371472 [7:03:39<23:49:24,  3.30it/s]
 24%|██▍       | 88814/371472 [7:03:40<23:16:20,  3.37it/s]
 24%|██▍       | 88815/371472 [7:03:40<22:39:34,  3.47it/s]
 24%|██▍       | 88816/371472 [7:03:40<22:17:28,  3.52it/s]
 24%|██▍       | 88817/371472 [7:03:40<23:53:20,  3.29it/s]
 24%|██▍       | 88818/371472 [7:03:41<22:57:24,  3.42it/s]
 24%|██▍       | 88819/371472 [7:03:41<21:52:06,  3.59it/s]
 24%|██▍       | 88820/371472 [7:03:41<21:59:30,  3.57it/s]
                                                           
{'loss': 3.8322, 'learning_rate': 7.851763666530198e-07, 'epoch': 3.83}

 24%|██▍       | 88820/371472 [7:03:41<21:59:30,  3.57it/s]
 24%|██▍       | 88821/371472 [7:03:42<21:26:49,  3.66it/s]
 24%|██▍       | 88822/371472 [7:03:42<21:23:05,  3.67it/s]
 24%|██▍       | 88823/371472 [7:03:42<20:52:07,  3.76it/s]
 24%|██▍       | 88824/371472 [7:03:42<21:13:20,  3.70it/s]
 24%|██▍       | 88825/371472 [7:03:43<22:24:37,  3.50it/s]
 24%|██▍       | 88826/371472 [7:03:43<22:52:38,  3.43it/s]
 24%|██▍       | 88827/371472 [7:03:43<21:55:46,  3.58it/s]
 24%|██▍       | 88828/371472 [7:03:43<21:01:04,  3.74it/s]
 24%|██▍       | 88829/371472 [7:03:44<21:45:25,  3.61it/s]
 24%|██▍       | 88830/371472 [7:03:44<21:42:49,  3.62it/s]
 24%|██▍       | 88831/371472 [7:03:44<21:09:16,  3.71it/s]
 24%|██▍       | 88832/371472 [7:03:45<21:15:36,  3.69it/s]
 24%|██▍       | 88833/371472 [7:03:45<20:54:54,  3.75it/s]
 24%|██▍       | 88834/371472 [7:03:45<23:12:56,  3.38it/s]
 24%|██▍       | 88835/371472 [7:03:45<22:31:39,  3.49it/s]
 24%|██▍       | 88836/371472 [7:03:46<21:25:22,  3.66it/s]
 24%|██▍       | 88837/371472 [7:03:46<24:01:38,  3.27it/s]
 24%|██▍       | 88838/371472 [7:03:46<23:30:35,  3.34it/s]
 24%|██▍       | 88839/371472 [7:03:47<23:34:55,  3.33it/s]
 24%|██▍       | 88840/371472 [7:03:47<22:17:34,  3.52it/s]
                                                           
{'loss': 3.7899, 'learning_rate': 7.85127884677541e-07, 'epoch': 3.83}

 24%|██▍       | 88840/371472 [7:03:47<22:17:34,  3.52it/s]
 24%|██▍       | 88841/371472 [7:03:47<22:07:27,  3.55it/s]
 24%|██▍       | 88842/371472 [7:03:47<21:16:00,  3.69it/s]
 24%|██▍       | 88843/371472 [7:03:48<22:33:52,  3.48it/s]
 24%|██▍       | 88844/371472 [7:03:48<23:33:47,  3.33it/s]
 24%|██▍       | 88845/371472 [7:03:48<23:41:22,  3.31it/s]
 24%|██▍       | 88846/371472 [7:03:49<23:40:59,  3.31it/s]
 24%|██▍       | 88847/371472 [7:03:49<22:55:21,  3.42it/s]
 24%|██▍       | 88848/371472 [7:03:49<21:55:53,  3.58it/s]
 24%|██▍       | 88849/371472 [7:03:49<21:53:01,  3.59it/s]
 24%|██▍       | 88850/371472 [7:03:50<22:02:50,  3.56it/s]
 24%|██▍       | 88851/371472 [7:03:50<21:39:35,  3.62it/s]
 24%|██▍       | 88852/371472 [7:03:50<21:20:46,  3.68it/s]
 24%|██▍       | 88853/371472 [7:03:51<20:50:50,  3.77it/s]
 24%|██▍       | 88854/371472 [7:03:51<22:00:49,  3.57it/s]
 24%|██▍       | 88855/371472 [7:03:51<22:03:42,  3.56it/s]
 24%|██▍       | 88856/371472 [7:03:51<22:17:46,  3.52it/s]
 24%|██▍       | 88857/371472 [7:03:52<22:00:31,  3.57it/s]
 24%|██▍       | 88858/371472 [7:03:52<21:58:55,  3.57it/s]
 24%|██▍       | 88859/371472 [7:03:52<21:13:56,  3.70it/s]
 24%|██▍       | 88860/371472 [7:03:53<21:35:36,  3.64it/s]
                                                           
{'loss': 3.7304, 'learning_rate': 7.85079402702062e-07, 'epoch': 3.83}

 24%|██▍       | 88860/371472 [7:03:53<21:35:36,  3.64it/s]
 24%|██▍       | 88861/371472 [7:03:53<21:12:59,  3.70it/s]
 24%|██▍       | 88862/371472 [7:03:53<20:37:49,  3.81it/s]
 24%|██▍       | 88863/371472 [7:03:53<21:02:57,  3.73it/s]
 24%|██▍       | 88864/371472 [7:03:54<21:56:40,  3.58it/s]
 24%|██▍       | 88865/371472 [7:03:54<21:04:34,  3.72it/s]
 24%|██▍       | 88866/371472 [7:03:54<20:34:48,  3.81it/s]
 24%|██▍       | 88867/371472 [7:03:54<21:04:54,  3.72it/s]
 24%|██▍       | 88868/371472 [7:03:55<20:59:15,  3.74it/s]
 24%|██▍       | 88869/371472 [7:03:55<22:04:54,  3.56it/s]
 24%|██▍       | 88870/371472 [7:03:55<21:01:14,  3.73it/s]
 24%|██▍       | 88871/371472 [7:03:55<20:13:24,  3.88it/s]
 24%|██▍       | 88872/371472 [7:03:56<20:18:43,  3.86it/s]
 24%|██▍       | 88873/371472 [7:03:56<22:36:29,  3.47it/s]
 24%|██▍       | 88874/371472 [7:03:56<21:37:26,  3.63it/s]
 24%|██▍       | 88875/371472 [7:03:57<22:11:41,  3.54it/s]
 24%|██▍       | 88876/371472 [7:03:57<23:32:41,  3.33it/s]
 24%|██▍       | 88877/371472 [7:03:57<23:00:37,  3.41it/s]
 24%|██▍       | 88878/371472 [7:03:57<22:07:35,  3.55it/s]
 24%|██▍       | 88879/371472 [7:03:58<22:34:31,  3.48it/s]
 24%|██▍       | 88880/371472 [7:03:58<22:04:16,  3.56it/s]
                                                           
{'loss': 3.9979, 'learning_rate': 7.850309207265832e-07, 'epoch': 3.83}

 24%|██▍       | 88880/371472 [7:03:58<22:04:16,  3.56it/s]
 24%|██▍       | 88881/371472 [7:03:58<22:35:21,  3.47it/s]
 24%|██▍       | 88882/371472 [7:03:59<22:17:40,  3.52it/s]
 24%|██▍       | 88883/371472 [7:03:59<21:38:26,  3.63it/s]
 24%|██▍       | 88884/371472 [7:03:59<21:55:12,  3.58it/s]
 24%|██▍       | 88885/371472 [7:03:59<22:30:48,  3.49it/s]
 24%|██▍       | 88886/371472 [7:04:00<22:47:18,  3.44it/s]
 24%|██▍       | 88887/371472 [7:04:00<22:59:04,  3.42it/s]
 24%|██▍       | 88888/371472 [7:04:00<23:13:58,  3.38it/s]
 24%|██▍       | 88889/371472 [7:04:01<22:43:36,  3.45it/s]
 24%|██▍       | 88890/371472 [7:04:01<23:19:14,  3.37it/s]
 24%|██▍       | 88891/371472 [7:04:01<23:15:46,  3.37it/s]
 24%|██▍       | 88892/371472 [7:04:02<22:22:51,  3.51it/s]
 24%|██▍       | 88893/371472 [7:04:02<21:31:15,  3.65it/s]
 24%|██▍       | 88894/371472 [7:04:02<21:11:37,  3.70it/s]
 24%|██▍       | 88895/371472 [7:04:02<20:27:32,  3.84it/s]
 24%|██▍       | 88896/371472 [7:04:03<20:10:06,  3.89it/s]
 24%|██▍       | 88897/371472 [7:04:03<19:49:49,  3.96it/s]
 24%|██▍       | 88898/371472 [7:04:03<19:48:36,  3.96it/s]
 24%|██▍       | 88899/371472 [7:04:03<22:20:59,  3.51it/s]
 24%|██▍       | 88900/371472 [7:04:04<21:28:48,  3.65it/s]
                                                           
{'loss': 3.8461, 'learning_rate': 7.849824387511043e-07, 'epoch': 3.83}

 24%|██▍       | 88900/371472 [7:04:04<21:28:48,  3.65it/s]
 24%|██▍       | 88901/371472 [7:04:04<24:40:14,  3.18it/s]
 24%|██▍       | 88902/371472 [7:04:04<23:15:50,  3.37it/s]
 24%|██▍       | 88903/371472 [7:04:05<22:48:31,  3.44it/s]
 24%|██▍       | 88904/371472 [7:04:05<21:45:23,  3.61it/s]
 24%|██▍       | 88905/371472 [7:04:05<21:05:33,  3.72it/s]
 24%|██▍       | 88906/371472 [7:04:05<21:10:16,  3.71it/s]
 24%|██▍       | 88907/371472 [7:04:06<23:21:48,  3.36it/s]
 24%|██▍       | 88908/371472 [7:04:06<23:33:16,  3.33it/s]
 24%|██▍       | 88909/371472 [7:04:06<22:14:31,  3.53it/s]
 24%|██▍       | 88910/371472 [7:04:07<22:15:30,  3.53it/s]
 24%|██▍       | 88911/371472 [7:04:07<22:18:51,  3.52it/s]
 24%|██▍       | 88912/371472 [7:04:07<21:26:44,  3.66it/s]
 24%|██▍       | 88913/371472 [7:04:07<21:36:09,  3.63it/s]
 24%|██▍       | 88914/371472 [7:04:08<21:23:14,  3.67it/s]
 24%|██▍       | 88915/371472 [7:04:08<20:35:20,  3.81it/s]
 24%|██▍       | 88916/371472 [7:04:08<20:37:00,  3.81it/s]
 24%|██▍       | 88917/371472 [7:04:08<21:30:13,  3.65it/s]
 24%|██▍       | 88918/371472 [7:04:09<21:27:19,  3.66it/s]
 24%|██▍       | 88919/371472 [7:04:09<21:21:33,  3.67it/s]
 24%|██▍       | 88920/371472 [7:04:09<21:25:59,  3.66it/s]
                                                           
{'loss': 3.843, 'learning_rate': 7.849339567756255e-07, 'epoch': 3.83}

 24%|██▍       | 88920/371472 [7:04:09<21:25:59,  3.66it/s]
 24%|██▍       | 88921/371472 [7:04:09<21:06:22,  3.72it/s]
 24%|██▍       | 88922/371472 [7:04:10<21:24:36,  3.67it/s]
 24%|██▍       | 88923/371472 [7:04:10<20:48:27,  3.77it/s]
 24%|██▍       | 88924/371472 [7:04:10<21:45:42,  3.61it/s]
 24%|██▍       | 88925/371472 [7:04:11<20:44:50,  3.78it/s]
 24%|██▍       | 88926/371472 [7:04:11<22:52:01,  3.43it/s]
 24%|██▍       | 88927/371472 [7:04:11<22:25:55,  3.50it/s]
 24%|██▍       | 88928/371472 [7:04:11<22:29:34,  3.49it/s]
 24%|██▍       | 88929/371472 [7:04:12<21:19:15,  3.68it/s]
 24%|██▍       | 88930/371472 [7:04:12<21:48:18,  3.60it/s]
 24%|██▍       | 88931/371472 [7:04:12<21:21:22,  3.67it/s]
 24%|██▍       | 88932/371472 [7:04:13<21:38:41,  3.63it/s]
 24%|██▍       | 88933/371472 [7:04:13<21:33:01,  3.64it/s]
 24%|██▍       | 88934/371472 [7:04:13<21:17:28,  3.69it/s]
 24%|██▍       | 88935/371472 [7:04:13<20:58:51,  3.74it/s]
 24%|██▍       | 88936/371472 [7:04:14<21:33:20,  3.64it/s]
 24%|██▍       | 88937/371472 [7:04:14<23:18:11,  3.37it/s]
 24%|██▍       | 88938/371472 [7:04:14<22:21:59,  3.51it/s]
 24%|██▍       | 88939/371472 [7:04:14<22:03:53,  3.56it/s]
 24%|██▍       | 88940/371472 [7:04:15<21:38:40,  3.63it/s]
                                                           
{'loss': 3.9031, 'learning_rate': 7.848854748001465e-07, 'epoch': 3.83}

 24%|██▍       | 88940/371472 [7:04:15<21:38:40,  3.63it/s]
 24%|██▍       | 88941/371472 [7:04:15<22:52:25,  3.43it/s]
 24%|██▍       | 88942/371472 [7:04:15<21:40:00,  3.62it/s]
 24%|██▍       | 88943/371472 [7:04:16<21:15:25,  3.69it/s]
 24%|██▍       | 88944/371472 [7:04:16<20:59:34,  3.74it/s]
 24%|██▍       | 88945/371472 [7:04:16<21:08:24,  3.71it/s]
 24%|██▍       | 88946/371472 [7:04:16<21:11:34,  3.70it/s]
 24%|██▍       | 88947/371472 [7:04:17<21:19:36,  3.68it/s]
 24%|██▍       | 88948/371472 [7:04:17<20:53:13,  3.76it/s]
 24%|██▍       | 88949/371472 [7:04:17<23:02:20,  3.41it/s]
 24%|██▍       | 88950/371472 [7:04:18<22:36:09,  3.47it/s]
 24%|██▍       | 88951/371472 [7:04:18<23:08:11,  3.39it/s]
 24%|██▍       | 88952/371472 [7:04:18<21:48:26,  3.60it/s]
 24%|██▍       | 88953/371472 [7:04:18<21:25:58,  3.66it/s]
 24%|██▍       | 88954/371472 [7:04:19<22:26:49,  3.50it/s]
 24%|██▍       | 88955/371472 [7:04:19<21:36:29,  3.63it/s]
 24%|██▍       | 88956/371472 [7:04:19<21:44:21,  3.61it/s]
 24%|██▍       | 88957/371472 [7:04:20<22:29:41,  3.49it/s]
 24%|██▍       | 88958/371472 [7:04:20<22:43:06,  3.45it/s]
 24%|██▍       | 88959/371472 [7:04:20<22:28:26,  3.49it/s]
 24%|██▍       | 88960/371472 [7:04:20<21:23:50,  3.67it/s]
                                                           
{'loss': 3.9929, 'learning_rate': 7.848369928246675e-07, 'epoch': 3.83}

 24%|██▍       | 88960/371472 [7:04:20<21:23:50,  3.67it/s]
 24%|██▍       | 88961/371472 [7:04:21<21:00:08,  3.74it/s]
 24%|██▍       | 88962/371472 [7:04:21<20:45:19,  3.78it/s]
 24%|██▍       | 88963/371472 [7:04:21<21:05:18,  3.72it/s]
 24%|██▍       | 88964/371472 [7:04:21<21:17:08,  3.69it/s]
 24%|██▍       | 88965/371472 [7:04:22<22:10:56,  3.54it/s]
 24%|██▍       | 88966/371472 [7:04:22<22:32:39,  3.48it/s]
 24%|██▍       | 88967/371472 [7:04:22<22:40:17,  3.46it/s]
 24%|██▍       | 88968/371472 [7:04:23<23:37:47,  3.32it/s]
 24%|██▍       | 88969/371472 [7:04:23<22:58:30,  3.42it/s]
 24%|██▍       | 88970/371472 [7:04:23<22:28:28,  3.49it/s]
 24%|██▍       | 88971/371472 [7:04:24<25:26:31,  3.08it/s]
 24%|██▍       | 88972/371472 [7:04:24<23:15:41,  3.37it/s]
 24%|██▍       | 88973/371472 [7:04:24<23:23:33,  3.35it/s]
 24%|██▍       | 88974/371472 [7:04:24<23:15:41,  3.37it/s]
 24%|██▍       | 88975/371472 [7:04:25<23:00:27,  3.41it/s]
 24%|██▍       | 88976/371472 [7:04:25<24:16:41,  3.23it/s]
 24%|██▍       | 88977/371472 [7:04:25<23:12:08,  3.38it/s]
 24%|██▍       | 88978/371472 [7:04:26<22:15:04,  3.53it/s]
 24%|██▍       | 88979/371472 [7:04:26<21:41:27,  3.62it/s]
 24%|██▍       | 88980/371472 [7:04:26<24:06:34,  3.25it/s]
                                                           
{'loss': 3.7308, 'learning_rate': 7.847885108491887e-07, 'epoch': 3.83}

 24%|██▍       | 88980/371472 [7:04:26<24:06:34,  3.25it/s]
 24%|██▍       | 88981/371472 [7:04:27<24:09:26,  3.25it/s]
 24%|██▍       | 88982/371472 [7:04:27<24:01:46,  3.27it/s]
 24%|██▍       | 88983/371472 [7:04:27<24:19:32,  3.23it/s]
 24%|██▍       | 88984/371472 [7:04:27<25:18:30,  3.10it/s]
 24%|██▍       | 88985/371472 [7:04:28<24:45:27,  3.17it/s]
 24%|██▍       | 88986/371472 [7:04:28<23:07:19,  3.39it/s]
 24%|██▍       | 88987/371472 [7:04:28<24:36:57,  3.19it/s]
 24%|██▍       | 88988/371472 [7:04:29<23:15:33,  3.37it/s]
 24%|██▍       | 88989/371472 [7:04:29<22:21:41,  3.51it/s]
 24%|██▍       | 88990/371472 [7:04:29<24:06:11,  3.26it/s]
 24%|██▍       | 88991/371472 [7:04:30<23:25:25,  3.35it/s]
 24%|██▍       | 88992/371472 [7:04:30<22:20:08,  3.51it/s]
 24%|██▍       | 88993/371472 [7:04:30<21:39:52,  3.62it/s]
 24%|██▍       | 88994/371472 [7:04:30<22:22:03,  3.51it/s]
 24%|██▍       | 88995/371472 [7:04:31<22:29:06,  3.49it/s]
 24%|██▍       | 88996/371472 [7:04:31<24:31:06,  3.20it/s]
 24%|██▍       | 88997/371472 [7:04:31<25:25:18,  3.09it/s]
 24%|██▍       | 88998/371472 [7:04:32<24:48:36,  3.16it/s]
 24%|██▍       | 88999/371472 [7:04:32<23:14:07,  3.38it/s]
 24%|██▍       | 89000/371472 [7:04:32<23:36:29,  3.32it/s]
                                                           
{'loss': 3.9517, 'learning_rate': 7.847400288737098e-07, 'epoch': 3.83}

 24%|██▍       | 89000/371472 [7:04:32<23:36:29,  3.32it/s]
 24%|██▍       | 89001/371472 [7:04:33<23:12:46,  3.38it/s]
 24%|██▍       | 89002/371472 [7:04:33<22:22:27,  3.51it/s]
 24%|██▍       | 89003/371472 [7:04:33<23:30:28,  3.34it/s]
 24%|██▍       | 89004/371472 [7:04:33<22:45:06,  3.45it/s]
 24%|██▍       | 89005/371472 [7:04:34<23:08:56,  3.39it/s]
 24%|██▍       | 89006/371472 [7:04:34<22:15:01,  3.53it/s]
 24%|██▍       | 89007/371472 [7:04:34<22:37:04,  3.47it/s]
 24%|██▍       | 89008/371472 [7:04:34<21:42:08,  3.62it/s]
 24%|██▍       | 89009/371472 [7:04:35<21:03:36,  3.73it/s]
 24%|██▍       | 89010/371472 [7:04:35<22:33:50,  3.48it/s]
 24%|██▍       | 89011/371472 [7:04:35<21:29:18,  3.65it/s]
 24%|██▍       | 89012/371472 [7:04:36<21:29:30,  3.65it/s]
 24%|██▍       | 89013/371472 [7:04:36<21:24:27,  3.67it/s]
 24%|██▍       | 89014/371472 [7:04:36<22:32:43,  3.48it/s]
 24%|██▍       | 89015/371472 [7:04:36<21:33:14,  3.64it/s]
 24%|██▍       | 89016/371472 [7:04:37<21:39:37,  3.62it/s]
 24%|██▍       | 89017/371472 [7:04:37<23:38:33,  3.32it/s]
 24%|██▍       | 89018/371472 [7:04:37<23:05:33,  3.40it/s]
 24%|██▍       | 89019/371472 [7:04:38<23:32:39,  3.33it/s]
 24%|██▍       | 89020/371472 [7:04:38<24:04:32,  3.26it/s]
                                                           
{'loss': 3.6881, 'learning_rate': 7.846915468982309e-07, 'epoch': 3.83}

 24%|██▍       | 89020/371472 [7:04:38<24:04:32,  3.26it/s]
 24%|██▍       | 89021/371472 [7:04:38<25:22:07,  3.09it/s]
 24%|██▍       | 89022/371472 [7:04:39<23:34:14,  3.33it/s]
 24%|██▍       | 89023/371472 [7:04:39<24:13:16,  3.24it/s]
 24%|██▍       | 89024/371472 [7:04:39<23:27:37,  3.34it/s]
 24%|██▍       | 89025/371472 [7:04:39<23:27:58,  3.34it/s]
 24%|██▍       | 89026/371472 [7:04:40<22:07:49,  3.55it/s]
 24%|██▍       | 89027/371472 [7:04:40<22:01:25,  3.56it/s]
 24%|██▍       | 89028/371472 [7:04:40<22:51:52,  3.43it/s]
 24%|██▍       | 89029/371472 [7:04:41<22:45:09,  3.45it/s]
 24%|██▍       | 89030/371472 [7:04:41<23:52:42,  3.29it/s]
 24%|██▍       | 89031/371472 [7:04:41<23:07:00,  3.39it/s]
 24%|██▍       | 89032/371472 [7:04:41<22:43:50,  3.45it/s]
 24%|██▍       | 89033/371472 [7:04:42<21:46:46,  3.60it/s]
 24%|██▍       | 89034/371472 [7:04:42<21:45:02,  3.61it/s]
 24%|██▍       | 89035/371472 [7:04:42<22:34:52,  3.47it/s]
 24%|██▍       | 89036/371472 [7:04:43<21:40:13,  3.62it/s]
 24%|██▍       | 89037/371472 [7:04:43<21:03:57,  3.72it/s]
 24%|██▍       | 89038/371472 [7:04:43<20:48:41,  3.77it/s]
 24%|██▍       | 89039/371472 [7:04:43<21:45:51,  3.60it/s]
 24%|██▍       | 89040/371472 [7:04:44<22:27:25,  3.49it/s]
                                                           
{'loss': 3.919, 'learning_rate': 7.84643064922752e-07, 'epoch': 3.84}

 24%|██▍       | 89040/371472 [7:04:44<22:27:25,  3.49it/s]
 24%|██▍       | 89041/371472 [7:04:44<21:48:02,  3.60it/s]
 24%|██▍       | 89042/371472 [7:04:44<21:20:15,  3.68it/s]
 24%|██▍       | 89043/371472 [7:04:45<22:48:18,  3.44it/s]
 24%|██▍       | 89044/371472 [7:04:45<21:47:35,  3.60it/s]
 24%|██▍       | 89045/371472 [7:04:45<21:31:34,  3.64it/s]
 24%|██▍       | 89046/371472 [7:04:45<21:54:50,  3.58it/s]
 24%|██▍       | 89047/371472 [7:04:46<20:54:44,  3.75it/s]
 24%|██▍       | 89048/371472 [7:04:46<21:44:35,  3.61it/s]
 24%|██▍       | 89049/371472 [7:04:46<21:52:36,  3.59it/s]
 24%|██▍       | 89050/371472 [7:04:47<24:43:09,  3.17it/s]
 24%|██▍       | 89051/371472 [7:04:47<23:10:15,  3.39it/s]
 24%|██▍       | 89052/371472 [7:04:47<22:36:19,  3.47it/s]
 24%|██▍       | 89053/371472 [7:04:47<21:53:35,  3.58it/s]
 24%|██▍       | 89054/371472 [7:04:48<21:13:06,  3.70it/s]
 24%|██▍       | 89055/371472 [7:04:48<20:43:08,  3.79it/s]
 24%|██▍       | 89056/371472 [7:04:48<21:34:03,  3.64it/s]
 24%|██▍       | 89057/371472 [7:04:48<21:16:05,  3.69it/s]
 24%|██▍       | 89058/371472 [7:04:49<21:03:31,  3.73it/s]
 24%|██▍       | 89059/371472 [7:04:49<21:07:32,  3.71it/s]
 24%|██▍       | 89060/371472 [7:04:49<21:27:18,  3.66it/s]
                                                           
{'loss': 4.0234, 'learning_rate': 7.845945829472732e-07, 'epoch': 3.84}

 24%|██▍       | 89060/371472 [7:04:49<21:27:18,  3.66it/s]
 24%|██▍       | 89061/371472 [7:04:49<20:50:38,  3.76it/s]
 24%|██▍       | 89062/371472 [7:04:50<20:58:51,  3.74it/s]
 24%|██▍       | 89063/371472 [7:04:50<25:31:40,  3.07it/s]
 24%|██▍       | 89064/371472 [7:04:51<25:29:56,  3.08it/s]
 24%|██▍       | 89065/371472 [7:04:51<26:20:08,  2.98it/s]
 24%|██▍       | 89066/371472 [7:04:51<24:54:15,  3.15it/s]
 24%|██▍       | 89067/371472 [7:04:51<24:11:46,  3.24it/s]
 24%|██▍       | 89068/371472 [7:04:52<23:47:10,  3.30it/s]
 24%|██▍       | 89069/371472 [7:04:52<22:50:44,  3.43it/s]
 24%|██▍       | 89070/371472 [7:04:52<23:16:06,  3.37it/s]
 24%|██▍       | 89071/371472 [7:04:53<23:26:16,  3.35it/s]
 24%|██▍       | 89072/371472 [7:04:53<24:01:51,  3.26it/s]
 24%|██▍       | 89073/371472 [7:04:53<23:17:21,  3.37it/s]
 24%|██▍       | 89074/371472 [7:04:54<22:55:06,  3.42it/s]
 24%|██▍       | 89075/371472 [7:04:54<22:54:38,  3.42it/s]
 24%|██▍       | 89076/371472 [7:04:54<23:41:18,  3.31it/s]
 24%|██▍       | 89077/371472 [7:04:54<22:19:57,  3.51it/s]
 24%|██▍       | 89078/371472 [7:04:55<21:48:14,  3.60it/s]
 24%|██▍       | 89079/371472 [7:04:55<22:19:18,  3.51it/s]
 24%|██▍       | 89080/371472 [7:04:55<22:43:27,  3.45it/s]
                                                           
{'loss': 3.8104, 'learning_rate': 7.845461009717942e-07, 'epoch': 3.84}

 24%|██▍       | 89080/371472 [7:04:55<22:43:27,  3.45it/s]
 24%|██▍       | 89081/371472 [7:04:56<22:28:24,  3.49it/s]
 24%|██▍       | 89082/371472 [7:04:56<22:10:29,  3.54it/s]
 24%|██▍       | 89083/371472 [7:04:56<21:32:32,  3.64it/s]
 24%|██▍       | 89084/371472 [7:04:56<21:53:16,  3.58it/s]
 24%|██▍       | 89085/371472 [7:04:57<21:24:05,  3.67it/s]
 24%|██▍       | 89086/371472 [7:04:57<20:37:31,  3.80it/s]
 24%|██▍       | 89087/371472 [7:04:57<21:12:19,  3.70it/s]
 24%|██▍       | 89088/371472 [7:04:57<22:38:44,  3.46it/s]
 24%|██▍       | 89089/371472 [7:04:58<23:15:59,  3.37it/s]
 24%|██▍       | 89090/371472 [7:04:58<22:50:04,  3.44it/s]
 24%|██▍       | 89091/371472 [7:04:58<24:49:09,  3.16it/s]
 24%|██▍       | 89092/371472 [7:04:59<24:06:36,  3.25it/s]
 24%|██▍       | 89093/371472 [7:04:59<23:12:15,  3.38it/s]
 24%|██▍       | 89094/371472 [7:04:59<22:52:06,  3.43it/s]
 24%|██▍       | 89095/371472 [7:05:00<22:20:37,  3.51it/s]
 24%|██▍       | 89096/371472 [7:05:00<21:45:51,  3.60it/s]
 24%|██▍       | 89097/371472 [7:05:00<20:50:37,  3.76it/s]
 24%|██▍       | 89098/371472 [7:05:00<20:41:14,  3.79it/s]
 24%|██▍       | 89099/371472 [7:05:01<21:52:07,  3.59it/s]
 24%|██▍       | 89100/371472 [7:05:01<21:03:51,  3.72it/s]
                                                           
{'loss': 3.9132, 'learning_rate': 7.844976189963153e-07, 'epoch': 3.84}

 24%|██▍       | 89100/371472 [7:05:01<21:03:51,  3.72it/s]
 24%|██▍       | 89101/371472 [7:05:01<21:25:44,  3.66it/s]
 24%|██▍       | 89102/371472 [7:05:01<20:50:55,  3.76it/s]
 24%|██▍       | 89103/371472 [7:05:02<20:50:39,  3.76it/s]
 24%|██▍       | 89104/371472 [7:05:02<21:27:14,  3.66it/s]
 24%|██▍       | 89105/371472 [7:05:02<22:01:45,  3.56it/s]
 24%|██▍       | 89106/371472 [7:05:03<22:50:21,  3.43it/s]
 24%|██▍       | 89107/371472 [7:05:03<22:18:37,  3.52it/s]
 24%|██▍       | 89108/371472 [7:05:03<21:57:18,  3.57it/s]
 24%|██▍       | 89109/371472 [7:05:03<21:38:08,  3.63it/s]
 24%|██▍       | 89110/371472 [7:05:04<21:10:22,  3.70it/s]
 24%|██▍       | 89111/371472 [7:05:04<22:03:19,  3.56it/s]
 24%|██▍       | 89112/371472 [7:05:04<21:31:44,  3.64it/s]
 24%|██▍       | 89113/371472 [7:05:04<22:34:39,  3.47it/s]
 24%|██▍       | 89114/371472 [7:05:05<22:44:08,  3.45it/s]
 24%|██▍       | 89115/371472 [7:05:05<21:32:53,  3.64it/s]
 24%|██▍       | 89116/371472 [7:05:05<20:55:45,  3.75it/s]
 24%|██▍       | 89117/371472 [7:05:06<21:20:44,  3.67it/s]
 24%|██▍       | 89118/371472 [7:05:06<21:08:38,  3.71it/s]
 24%|██▍       | 89119/371472 [7:05:06<21:14:43,  3.69it/s]
 24%|██▍       | 89120/371472 [7:05:06<20:28:33,  3.83it/s]
                                                           
{'loss': 3.9795, 'learning_rate': 7.844491370208364e-07, 'epoch': 3.84}

 24%|██▍       | 89120/371472 [7:05:06<20:28:33,  3.83it/s]
 24%|██▍       | 89121/371472 [7:05:07<20:17:54,  3.86it/s]
 24%|██▍       | 89122/371472 [7:05:07<21:00:07,  3.73it/s]
 24%|██▍       | 89123/371472 [7:05:07<22:13:13,  3.53it/s]
 24%|██▍       | 89124/371472 [7:05:08<23:02:34,  3.40it/s]
 24%|██▍       | 89125/371472 [7:05:08<22:11:48,  3.53it/s]
 24%|██▍       | 89126/371472 [7:05:08<22:19:23,  3.51it/s]
 24%|██▍       | 89127/371472 [7:05:08<21:52:09,  3.59it/s]
 24%|██▍       | 89128/371472 [7:05:09<22:44:06,  3.45it/s]
 24%|██▍       | 89129/371472 [7:05:09<22:58:32,  3.41it/s]
 24%|██▍       | 89130/371472 [7:05:09<22:27:46,  3.49it/s]
 24%|██▍       | 89131/371472 [7:05:09<22:20:02,  3.51it/s]
 24%|██▍       | 89132/371472 [7:05:10<22:20:24,  3.51it/s]
 24%|██▍       | 89133/371472 [7:05:10<23:33:54,  3.33it/s]
 24%|██▍       | 89134/371472 [7:05:10<23:01:42,  3.41it/s]
 24%|██▍       | 89135/371472 [7:05:11<23:04:36,  3.40it/s]
 24%|██▍       | 89136/371472 [7:05:11<22:59:46,  3.41it/s]
 24%|██▍       | 89137/371472 [7:05:11<23:00:52,  3.41it/s]
 24%|██▍       | 89138/371472 [7:05:12<22:35:37,  3.47it/s]
 24%|██▍       | 89139/371472 [7:05:12<22:30:03,  3.49it/s]
 24%|██▍       | 89140/371472 [7:05:12<24:18:31,  3.23it/s]
                                                           
{'loss': 3.9139, 'learning_rate': 7.844006550453576e-07, 'epoch': 3.84}

 24%|██▍       | 89140/371472 [7:05:12<24:18:31,  3.23it/s]
 24%|██▍       | 89141/371472 [7:05:12<23:00:36,  3.41it/s]
 24%|██▍       | 89142/371472 [7:05:13<22:33:02,  3.48it/s]
 24%|██▍       | 89143/371472 [7:05:13<22:36:56,  3.47it/s]
 24%|██▍       | 89144/371472 [7:05:13<21:29:54,  3.65it/s]
 24%|██▍       | 89145/371472 [7:05:14<22:26:57,  3.49it/s]
 24%|██▍       | 89146/371472 [7:05:14<21:25:09,  3.66it/s]
 24%|██▍       | 89147/371472 [7:05:14<21:05:27,  3.72it/s]
 24%|██▍       | 89148/371472 [7:05:14<21:46:13,  3.60it/s]
 24%|██▍       | 89149/371472 [7:05:15<21:32:14,  3.64it/s]
 24%|██▍       | 89150/371472 [7:05:15<21:02:14,  3.73it/s]
 24%|██▍       | 89151/371472 [7:05:15<24:56:10,  3.14it/s]
 24%|██▍       | 89152/371472 [7:05:16<23:45:32,  3.30it/s]
 24%|██▍       | 89153/371472 [7:05:16<23:14:11,  3.37it/s]
 24%|██▍       | 89154/371472 [7:05:16<23:31:42,  3.33it/s]
 24%|██▍       | 89155/371472 [7:05:16<22:32:33,  3.48it/s]
 24%|██▍       | 89156/371472 [7:05:17<22:04:09,  3.55it/s]
 24%|██▍       | 89157/371472 [7:05:17<22:25:05,  3.50it/s]
 24%|██▍       | 89158/371472 [7:05:17<22:57:59,  3.41it/s]
 24%|██▍       | 89159/371472 [7:05:18<23:13:12,  3.38it/s]
 24%|██▍       | 89160/371472 [7:05:18<24:51:00,  3.16it/s]
                                                           
{'loss': 4.0388, 'learning_rate': 7.843521730698787e-07, 'epoch': 3.84}

 24%|██▍       | 89160/371472 [7:05:18<24:51:00,  3.16it/s]
 24%|██▍       | 89161/371472 [7:05:18<24:11:06,  3.24it/s]
 24%|██▍       | 89162/371472 [7:05:19<22:58:00,  3.41it/s]
 24%|██▍       | 89163/371472 [7:05:19<21:47:39,  3.60it/s]
 24%|██▍       | 89164/371472 [7:05:19<22:06:35,  3.55it/s]
 24%|██▍       | 89165/371472 [7:05:19<21:52:33,  3.58it/s]
 24%|██▍       | 89166/371472 [7:05:20<21:12:44,  3.70it/s]
 24%|██▍       | 89167/371472 [7:05:20<21:37:10,  3.63it/s]
 24%|██▍       | 89168/371472 [7:05:20<21:06:13,  3.72it/s]
 24%|██▍       | 89169/371472 [7:05:20<20:38:03,  3.80it/s]
 24%|██▍       | 89170/371472 [7:05:21<21:18:25,  3.68it/s]
 24%|██▍       | 89171/371472 [7:05:21<21:38:00,  3.62it/s]
 24%|██▍       | 89172/371472 [7:05:21<22:48:22,  3.44it/s]
 24%|██▍       | 89173/371472 [7:05:22<21:45:39,  3.60it/s]
 24%|██▍       | 89174/371472 [7:05:22<20:55:33,  3.75it/s]
 24%|██▍       | 89175/371472 [7:05:22<21:22:40,  3.67it/s]
 24%|██▍       | 89176/371472 [7:05:22<21:23:49,  3.66it/s]
 24%|██▍       | 89177/371472 [7:05:23<21:30:25,  3.65it/s]
 24%|██▍       | 89178/371472 [7:05:23<20:54:02,  3.75it/s]
 24%|██▍       | 89179/371472 [7:05:23<22:46:58,  3.44it/s]
 24%|██▍       | 89180/371472 [7:05:23<22:41:14,  3.46it/s]
                                                           
{'loss': 3.8791, 'learning_rate': 7.843036910943998e-07, 'epoch': 3.84}

 24%|██▍       | 89180/371472 [7:05:23<22:41:14,  3.46it/s]
 24%|██▍       | 89181/371472 [7:05:24<22:12:22,  3.53it/s]
 24%|██▍       | 89182/371472 [7:05:24<22:13:45,  3.53it/s]
 24%|██▍       | 89183/371472 [7:05:24<21:25:32,  3.66it/s]
 24%|██▍       | 89184/371472 [7:05:25<21:32:18,  3.64it/s]
 24%|██▍       | 89185/371472 [7:05:25<21:04:15,  3.72it/s]
 24%|██▍       | 89186/371472 [7:05:25<20:55:11,  3.75it/s]
 24%|██▍       | 89187/371472 [7:05:25<21:32:24,  3.64it/s]
 24%|██▍       | 89188/371472 [7:05:26<20:59:19,  3.74it/s]
 24%|██▍       | 89189/371472 [7:05:26<21:06:12,  3.72it/s]
 24%|██▍       | 89190/371472 [7:05:26<21:34:54,  3.63it/s]
 24%|██▍       | 89191/371472 [7:05:26<20:45:57,  3.78it/s]
 24%|██▍       | 89192/371472 [7:05:27<20:24:42,  3.84it/s]
 24%|██▍       | 89193/371472 [7:05:27<22:30:53,  3.48it/s]
 24%|██▍       | 89194/371472 [7:05:27<22:33:41,  3.48it/s]
 24%|██▍       | 89195/371472 [7:05:28<21:46:47,  3.60it/s]
 24%|██▍       | 89196/371472 [7:05:28<21:47:03,  3.60it/s]
 24%|██▍       | 89197/371472 [7:05:28<23:18:34,  3.36it/s]
 24%|██▍       | 89198/371472 [7:05:28<22:19:07,  3.51it/s]
 24%|██▍       | 89199/371472 [7:05:29<22:09:48,  3.54it/s]
 24%|██▍       | 89200/371472 [7:05:29<21:41:07,  3.62it/s]
                                                           
{'loss': 3.9315, 'learning_rate': 7.842552091189208e-07, 'epoch': 3.84}

 24%|██▍       | 89200/371472 [7:05:29<21:41:07,  3.62it/s]
 24%|██▍       | 89201/371472 [7:05:29<21:12:40,  3.70it/s]
 24%|██▍       | 89202/371472 [7:05:30<21:39:21,  3.62it/s]
 24%|██▍       | 89203/371472 [7:05:30<21:28:53,  3.65it/s]
 24%|██▍       | 89204/371472 [7:05:30<21:11:47,  3.70it/s]
 24%|██▍       | 89205/371472 [7:05:30<20:32:32,  3.82it/s]
 24%|██▍       | 89206/371472 [7:05:31<20:40:38,  3.79it/s]
 24%|██▍       | 89207/371472 [7:05:31<21:46:17,  3.60it/s]
 24%|██▍       | 89208/371472 [7:05:31<22:50:47,  3.43it/s]
 24%|██▍       | 89209/371472 [7:05:32<23:17:06,  3.37it/s]
 24%|██▍       | 89210/371472 [7:05:32<23:03:54,  3.40it/s]
 24%|██▍       | 89211/371472 [7:05:32<24:06:56,  3.25it/s]
 24%|██▍       | 89212/371472 [7:05:32<23:05:26,  3.40it/s]
 24%|██▍       | 89213/371472 [7:05:33<22:47:03,  3.44it/s]
 24%|██▍       | 89214/371472 [7:05:33<22:23:14,  3.50it/s]
 24%|██▍       | 89215/371472 [7:05:33<21:56:05,  3.57it/s]
 24%|██▍       | 89216/371472 [7:05:33<20:52:12,  3.76it/s]
 24%|██▍       | 89217/371472 [7:05:34<22:04:51,  3.55it/s]
 24%|██▍       | 89218/371472 [7:05:34<20:54:33,  3.75it/s]
 24%|██▍       | 89219/371472 [7:05:34<20:36:02,  3.81it/s]
 24%|██▍       | 89220/371472 [7:05:35<23:04:42,  3.40it/s]
                                                           
{'loss': 3.7865, 'learning_rate': 7.84206727143442e-07, 'epoch': 3.84}

 24%|██▍       | 89220/371472 [7:05:35<23:04:42,  3.40it/s]
 24%|██▍       | 89221/371472 [7:05:35<23:39:09,  3.31it/s]
 24%|██▍       | 89222/371472 [7:05:35<22:44:08,  3.45it/s]
 24%|██▍       | 89223/371472 [7:05:36<22:32:25,  3.48it/s]
 24%|██▍       | 89224/371472 [7:05:36<23:02:47,  3.40it/s]
 24%|██▍       | 89225/371472 [7:05:36<22:47:18,  3.44it/s]
 24%|██▍       | 89226/371472 [7:05:36<22:52:30,  3.43it/s]
 24%|██▍       | 89227/371472 [7:05:37<22:06:29,  3.55it/s]
 24%|██▍       | 89228/371472 [7:05:37<21:13:32,  3.69it/s]
 24%|██▍       | 89229/371472 [7:05:37<23:21:12,  3.36it/s]
 24%|██▍       | 89230/371472 [7:05:38<22:19:07,  3.51it/s]
 24%|██▍       | 89231/371472 [7:05:38<21:41:03,  3.62it/s]
 24%|██▍       | 89232/371472 [7:05:38<21:21:12,  3.67it/s]
 24%|██▍       | 89233/371472 [7:05:38<21:35:17,  3.63it/s]
 24%|██▍       | 89234/371472 [7:05:39<22:00:57,  3.56it/s]
 24%|██▍       | 89235/371472 [7:05:39<22:12:53,  3.53it/s]
 24%|██▍       | 89236/371472 [7:05:39<22:25:54,  3.49it/s]
 24%|██▍       | 89237/371472 [7:05:39<21:57:32,  3.57it/s]
 24%|██▍       | 89238/371472 [7:05:40<22:24:30,  3.50it/s]
 24%|██▍       | 89239/371472 [7:05:40<21:53:02,  3.58it/s]
 24%|██▍       | 89240/371472 [7:05:40<21:51:50,  3.59it/s]
                                                           
{'loss': 3.8102, 'learning_rate': 7.84158245167963e-07, 'epoch': 3.84}

 24%|██▍       | 89240/371472 [7:05:40<21:51:50,  3.59it/s]
 24%|██▍       | 89241/371472 [7:05:41<21:39:58,  3.62it/s]
 24%|██▍       | 89242/371472 [7:05:41<22:09:03,  3.54it/s]
 24%|██▍       | 89243/371472 [7:05:41<21:35:31,  3.63it/s]
 24%|██▍       | 89244/371472 [7:05:41<21:51:04,  3.59it/s]
 24%|██▍       | 89245/371472 [7:05:42<23:22:35,  3.35it/s]
 24%|██▍       | 89246/371472 [7:05:42<22:06:31,  3.55it/s]
 24%|██▍       | 89247/371472 [7:05:42<21:43:28,  3.61it/s]
 24%|██▍       | 89248/371472 [7:05:43<22:40:51,  3.46it/s]
 24%|██▍       | 89249/371472 [7:05:43<22:01:13,  3.56it/s]
 24%|██▍       | 89250/371472 [7:05:43<22:39:28,  3.46it/s]
 24%|██▍       | 89251/371472 [7:05:43<22:09:25,  3.54it/s]
 24%|██▍       | 89252/371472 [7:05:44<22:53:58,  3.42it/s]
 24%|██▍       | 89253/371472 [7:05:44<22:30:18,  3.48it/s]
 24%|██▍       | 89254/371472 [7:05:44<22:15:04,  3.52it/s]
 24%|██▍       | 89255/371472 [7:05:45<22:07:50,  3.54it/s]
 24%|██▍       | 89256/371472 [7:05:45<24:52:34,  3.15it/s]
 24%|██▍       | 89257/371472 [7:05:45<23:34:01,  3.33it/s]
 24%|██▍       | 89258/371472 [7:05:46<23:08:03,  3.39it/s]
 24%|██▍       | 89259/371472 [7:05:46<22:12:33,  3.53it/s]
 24%|██▍       | 89260/371472 [7:05:46<22:48:33,  3.44it/s]
                                                           
{'loss': 3.8697, 'learning_rate': 7.841097631924842e-07, 'epoch': 3.84}

 24%|██▍       | 89260/371472 [7:05:46<22:48:33,  3.44it/s]
 24%|██▍       | 89261/371472 [7:05:46<22:08:12,  3.54it/s]
 24%|██▍       | 89262/371472 [7:05:47<21:21:52,  3.67it/s]
 24%|██▍       | 89263/371472 [7:05:47<21:24:45,  3.66it/s]
 24%|██▍       | 89264/371472 [7:05:47<20:58:03,  3.74it/s]
 24%|██▍       | 89265/371472 [7:05:47<21:23:02,  3.67it/s]
 24%|██▍       | 89266/371472 [7:05:48<21:35:39,  3.63it/s]
 24%|██▍       | 89267/371472 [7:05:48<21:43:52,  3.61it/s]
 24%|██▍       | 89268/371472 [7:05:48<22:11:51,  3.53it/s]
 24%|██▍       | 89269/371472 [7:05:49<22:32:59,  3.48it/s]
 24%|██▍       | 89270/371472 [7:05:49<21:54:16,  3.58it/s]
 24%|██▍       | 89271/371472 [7:05:49<21:41:35,  3.61it/s]
 24%|██▍       | 89272/371472 [7:05:49<22:03:22,  3.55it/s]
 24%|██▍       | 89273/371472 [7:05:50<24:00:06,  3.27it/s]
 24%|██▍       | 89274/371472 [7:05:50<23:58:39,  3.27it/s]
 24%|██▍       | 89275/371472 [7:05:50<23:23:47,  3.35it/s]
 24%|██▍       | 89276/371472 [7:05:51<23:10:08,  3.38it/s]
 24%|██▍       | 89277/371472 [7:05:51<21:58:26,  3.57it/s]
 24%|██▍       | 89278/371472 [7:05:51<21:44:22,  3.61it/s]
 24%|██▍       | 89279/371472 [7:05:51<21:12:54,  3.69it/s]
 24%|██▍       | 89280/371472 [7:05:52<21:36:47,  3.63it/s]
                                                           
{'loss': 3.7959, 'learning_rate': 7.840612812170053e-07, 'epoch': 3.85}

 24%|██▍       | 89280/371472 [7:05:52<21:36:47,  3.63it/s]
 24%|██▍       | 89281/371472 [7:05:52<21:46:37,  3.60it/s]
 24%|██▍       | 89282/371472 [7:05:52<21:17:22,  3.68it/s]
 24%|██▍       | 89283/371472 [7:05:52<21:09:23,  3.71it/s]
 24%|██▍       | 89284/371472 [7:05:53<21:05:36,  3.72it/s]
 24%|██▍       | 89285/371472 [7:05:53<20:58:22,  3.74it/s]
 24%|██▍       | 89286/371472 [7:05:53<21:47:28,  3.60it/s]
 24%|██▍       | 89287/371472 [7:05:54<21:34:28,  3.63it/s]
 24%|██▍       | 89288/371472 [7:05:54<21:36:07,  3.63it/s]
 24%|██▍       | 89289/371472 [7:05:54<22:02:19,  3.56it/s]
 24%|██▍       | 89290/371472 [7:05:54<20:54:42,  3.75it/s]
 24%|██▍       | 89291/371472 [7:05:55<22:43:32,  3.45it/s]
 24%|██▍       | 89292/371472 [7:05:55<22:04:51,  3.55it/s]
 24%|██▍       | 89293/371472 [7:05:55<21:14:42,  3.69it/s]
 24%|██▍       | 89294/371472 [7:05:56<21:25:51,  3.66it/s]
 24%|██▍       | 89295/371472 [7:05:56<21:19:26,  3.68it/s]
 24%|██▍       | 89296/371472 [7:05:56<21:03:02,  3.72it/s]
 24%|██▍       | 89297/371472 [7:05:56<20:58:07,  3.74it/s]
 24%|██▍       | 89298/371472 [7:05:57<21:59:50,  3.56it/s]
 24%|██▍       | 89299/371472 [7:05:57<22:34:29,  3.47it/s]
 24%|██▍       | 89300/371472 [7:05:57<22:16:11,  3.52it/s]
                                                           
{'loss': 4.142, 'learning_rate': 7.840127992415264e-07, 'epoch': 3.85}

 24%|██▍       | 89300/371472 [7:05:57<22:16:11,  3.52it/s]
 24%|██▍       | 89301/371472 [7:05:57<21:40:20,  3.62it/s]
 24%|██▍       | 89302/371472 [7:05:58<23:34:14,  3.33it/s]
 24%|██▍       | 89303/371472 [7:05:58<23:05:15,  3.39it/s]
 24%|██▍       | 89304/371472 [7:05:58<24:13:21,  3.24it/s]
 24%|██▍       | 89305/371472 [7:05:59<22:45:59,  3.44it/s]
 24%|██▍       | 89306/371472 [7:05:59<21:48:29,  3.59it/s]
 24%|██▍       | 89307/371472 [7:05:59<21:18:16,  3.68it/s]
 24%|██▍       | 89308/371472 [7:06:00<22:49:30,  3.43it/s]
 24%|██▍       | 89309/371472 [7:06:00<22:37:59,  3.46it/s]
 24%|██▍       | 89310/371472 [7:06:00<23:51:22,  3.29it/s]
 24%|██▍       | 89311/371472 [7:06:00<23:18:12,  3.36it/s]
 24%|██▍       | 89312/371472 [7:06:01<23:43:48,  3.30it/s]
 24%|██▍       | 89313/371472 [7:06:01<23:18:28,  3.36it/s]
 24%|██▍       | 89314/371472 [7:06:01<22:40:54,  3.46it/s]
 24%|██▍       | 89315/371472 [7:06:02<21:27:42,  3.65it/s]
 24%|██▍       | 89316/371472 [7:06:02<20:39:24,  3.79it/s]
 24%|██▍       | 89317/371472 [7:06:02<20:57:01,  3.74it/s]
 24%|██▍       | 89318/371472 [7:06:02<20:31:15,  3.82it/s]
 24%|██▍       | 89319/371472 [7:06:03<20:53:50,  3.75it/s]
 24%|██▍       | 89320/371472 [7:06:03<21:29:18,  3.65it/s]
                                                           
{'loss': 3.6295, 'learning_rate': 7.839643172660475e-07, 'epoch': 3.85}

 24%|██▍       | 89320/371472 [7:06:03<21:29:18,  3.65it/s]
 24%|██▍       | 89321/371472 [7:06:03<21:20:52,  3.67it/s]
 24%|██▍       | 89322/371472 [7:06:03<21:23:09,  3.66it/s]
 24%|██▍       | 89323/371472 [7:06:04<21:56:29,  3.57it/s]
 24%|██▍       | 89324/371472 [7:06:04<22:42:09,  3.45it/s]
 24%|██▍       | 89325/371472 [7:06:04<22:06:44,  3.54it/s]
 24%|██▍       | 89326/371472 [7:06:05<22:15:38,  3.52it/s]
 24%|██▍       | 89327/371472 [7:06:05<21:05:29,  3.72it/s]
 24%|██▍       | 89328/371472 [7:06:05<22:54:06,  3.42it/s]
 24%|██▍       | 89329/371472 [7:06:05<22:50:02,  3.43it/s]
 24%|██▍       | 89330/371472 [7:06:06<22:44:12,  3.45it/s]
 24%|██▍       | 89331/371472 [7:06:06<23:03:48,  3.40it/s]
 24%|██▍       | 89332/371472 [7:06:06<22:45:18,  3.44it/s]
 24%|██▍       | 89333/371472 [7:06:07<21:51:44,  3.58it/s]
 24%|██▍       | 89334/371472 [7:06:07<21:46:00,  3.60it/s]
 24%|██▍       | 89335/371472 [7:06:07<22:13:55,  3.53it/s]
 24%|██▍       | 89336/371472 [7:06:07<21:39:47,  3.62it/s]
 24%|██▍       | 89337/371472 [7:06:08<23:15:50,  3.37it/s]
 24%|██▍       | 89338/371472 [7:06:08<22:53:37,  3.42it/s]
 24%|██▍       | 89339/371472 [7:06:08<23:52:03,  3.28it/s]
 24%|██▍       | 89340/371472 [7:06:09<22:41:51,  3.45it/s]
                                                           
{'loss': 3.7501, 'learning_rate': 7.839158352905686e-07, 'epoch': 3.85}

 24%|██▍       | 89340/371472 [7:06:09<22:41:51,  3.45it/s]
 24%|██▍       | 89341/371472 [7:06:09<22:50:29,  3.43it/s]
 24%|██▍       | 89342/371472 [7:06:09<23:19:37,  3.36it/s]
 24%|██▍       | 89343/371472 [7:06:10<22:43:24,  3.45it/s]
 24%|██▍       | 89344/371472 [7:06:10<22:10:23,  3.53it/s]
 24%|██▍       | 89345/371472 [7:06:10<21:36:12,  3.63it/s]
 24%|██▍       | 89346/371472 [7:06:10<21:08:25,  3.71it/s]
 24%|██▍       | 89347/371472 [7:06:11<20:59:45,  3.73it/s]
 24%|██▍       | 89348/371472 [7:06:11<23:15:25,  3.37it/s]
 24%|██▍       | 89349/371472 [7:06:11<22:36:34,  3.47it/s]
 24%|██▍       | 89350/371472 [7:06:11<22:47:52,  3.44it/s]
 24%|██▍       | 89351/371472 [7:06:12<24:36:54,  3.18it/s]
 24%|██▍       | 89352/371472 [7:06:12<24:10:16,  3.24it/s]
 24%|██▍       | 89353/371472 [7:06:12<23:04:09,  3.40it/s]
 24%|██▍       | 89354/371472 [7:06:13<22:26:06,  3.49it/s]
 24%|██▍       | 89355/371472 [7:06:13<21:43:42,  3.61it/s]
 24%|██▍       | 89356/371472 [7:06:13<21:58:00,  3.57it/s]
 24%|██▍       | 89357/371472 [7:06:14<22:57:34,  3.41it/s]
 24%|██▍       | 89358/371472 [7:06:14<24:38:36,  3.18it/s]
 24%|██▍       | 89359/371472 [7:06:14<24:18:17,  3.22it/s]
 24%|██▍       | 89360/371472 [7:06:14<22:46:22,  3.44it/s]
                                                           
{'loss': 4.1259, 'learning_rate': 7.838673533150897e-07, 'epoch': 3.85}

 24%|██▍       | 89360/371472 [7:06:14<22:46:22,  3.44it/s]
 24%|██▍       | 89361/371472 [7:06:15<22:14:01,  3.52it/s]
 24%|██▍       | 89362/371472 [7:06:15<21:32:11,  3.64it/s]
 24%|██▍       | 89363/371472 [7:06:15<21:21:39,  3.67it/s]
 24%|██▍       | 89364/371472 [7:06:16<22:11:44,  3.53it/s]
 24%|██▍       | 89365/371472 [7:06:16<22:44:51,  3.44it/s]
 24%|██▍       | 89366/371472 [7:06:16<23:29:46,  3.34it/s]
 24%|██▍       | 89367/371472 [7:06:16<22:42:21,  3.45it/s]
 24%|██▍       | 89368/371472 [7:06:17<24:44:58,  3.17it/s]
 24%|██▍       | 89369/371472 [7:06:17<22:57:11,  3.41it/s]
 24%|██▍       | 89370/371472 [7:06:17<24:12:58,  3.24it/s]
 24%|██▍       | 89371/371472 [7:06:18<22:35:27,  3.47it/s]
 24%|██▍       | 89372/371472 [7:06:18<22:51:33,  3.43it/s]
 24%|██▍       | 89373/371472 [7:06:18<22:38:54,  3.46it/s]
 24%|██▍       | 89374/371472 [7:06:19<22:33:00,  3.47it/s]
 24%|██▍       | 89375/371472 [7:06:19<21:27:16,  3.65it/s]
 24%|██▍       | 89376/371472 [7:06:19<23:03:50,  3.40it/s]
 24%|██▍       | 89377/371472 [7:06:19<24:06:51,  3.25it/s]
 24%|██▍       | 89378/371472 [7:06:20<23:25:42,  3.34it/s]
 24%|██▍       | 89379/371472 [7:06:20<22:49:10,  3.43it/s]
 24%|██▍       | 89380/371472 [7:06:20<22:00:16,  3.56it/s]
                                                           
{'loss': 3.7878, 'learning_rate': 7.838188713396108e-07, 'epoch': 3.85}

 24%|██▍       | 89380/371472 [7:06:20<22:00:16,  3.56it/s]
 24%|██▍       | 89381/371472 [7:06:21<22:15:18,  3.52it/s]
 24%|██▍       | 89382/371472 [7:06:21<23:31:46,  3.33it/s]
 24%|██▍       | 89383/371472 [7:06:21<22:58:41,  3.41it/s]
 24%|██▍       | 89384/371472 [7:06:21<23:02:59,  3.40it/s]
 24%|██▍       | 89385/371472 [7:06:22<23:42:44,  3.30it/s]
 24%|██▍       | 89386/371472 [7:06:22<22:09:15,  3.54it/s]
 24%|██▍       | 89387/371472 [7:06:22<22:11:43,  3.53it/s]
 24%|██▍       | 89388/371472 [7:06:23<21:34:30,  3.63it/s]
 24%|██▍       | 89389/371472 [7:06:23<20:35:33,  3.81it/s]
 24%|██▍       | 89390/371472 [7:06:23<20:36:02,  3.80it/s]
 24%|██▍       | 89391/371472 [7:06:23<22:12:18,  3.53it/s]
 24%|██▍       | 89392/371472 [7:06:24<21:06:45,  3.71it/s]
 24%|██▍       | 89393/371472 [7:06:24<21:01:22,  3.73it/s]
 24%|██▍       | 89394/371472 [7:06:24<21:03:33,  3.72it/s]
 24%|██▍       | 89395/371472 [7:06:24<20:19:45,  3.85it/s]
 24%|██▍       | 89396/371472 [7:06:25<22:36:54,  3.46it/s]
 24%|██▍       | 89397/371472 [7:06:25<21:42:17,  3.61it/s]
 24%|██▍       | 89398/371472 [7:06:25<20:55:00,  3.75it/s]
 24%|██▍       | 89399/371472 [7:06:26<22:44:19,  3.45it/s]
 24%|██▍       | 89400/371472 [7:06:26<22:04:52,  3.55it/s]
                                                           
{'loss': 3.8972, 'learning_rate': 7.837703893641319e-07, 'epoch': 3.85}

 24%|██▍       | 89400/371472 [7:06:26<22:04:52,  3.55it/s]
 24%|██▍       | 89401/371472 [7:06:26<21:17:59,  3.68it/s]
 24%|██▍       | 89402/371472 [7:06:26<21:40:37,  3.61it/s]
 24%|██▍       | 89403/371472 [7:06:27<21:12:28,  3.69it/s]
 24%|██▍       | 89404/371472 [7:06:27<22:12:21,  3.53it/s]
 24%|██▍       | 89405/371472 [7:06:27<23:20:24,  3.36it/s]
 24%|██▍       | 89406/371472 [7:06:28<21:58:37,  3.57it/s]
 24%|██▍       | 89407/371472 [7:06:28<23:01:10,  3.40it/s]
 24%|██▍       | 89408/371472 [7:06:28<22:16:19,  3.52it/s]
 24%|██▍       | 89409/371472 [7:06:28<23:23:55,  3.35it/s]
 24%|██▍       | 89410/371472 [7:06:29<22:13:37,  3.53it/s]
 24%|██▍       | 89411/371472 [7:06:29<21:29:47,  3.64it/s]
 24%|██▍       | 89412/371472 [7:06:29<22:30:40,  3.48it/s]
 24%|██▍       | 89413/371472 [7:06:30<23:15:21,  3.37it/s]
 24%|██▍       | 89414/371472 [7:06:30<22:13:05,  3.53it/s]
 24%|██▍       | 89415/371472 [7:06:30<22:12:23,  3.53it/s]
 24%|██▍       | 89416/371472 [7:06:30<22:15:13,  3.52it/s]
 24%|██▍       | 89417/371472 [7:06:31<22:21:43,  3.50it/s]
 24%|██▍       | 89418/371472 [7:06:31<22:42:22,  3.45it/s]
 24%|██▍       | 89419/371472 [7:06:31<21:55:43,  3.57it/s]
 24%|██▍       | 89420/371472 [7:06:32<22:01:28,  3.56it/s]
                                                           
{'loss': 3.8955, 'learning_rate': 7.837219073886531e-07, 'epoch': 3.85}

 24%|██▍       | 89420/371472 [7:06:32<22:01:28,  3.56it/s]
 24%|██▍       | 89421/371472 [7:06:32<23:24:47,  3.35it/s]
 24%|██▍       | 89422/371472 [7:06:32<22:52:36,  3.42it/s]
 24%|██▍       | 89423/371472 [7:06:32<23:00:23,  3.41it/s]
 24%|██▍       | 89424/371472 [7:06:33<22:39:31,  3.46it/s]
 24%|██▍       | 89425/371472 [7:06:33<22:12:16,  3.53it/s]
 24%|██▍       | 89426/371472 [7:06:33<23:07:30,  3.39it/s]
 24%|██▍       | 89427/371472 [7:06:34<22:25:39,  3.49it/s]
 24%|██▍       | 89428/371472 [7:06:34<21:21:56,  3.67it/s]
 24%|██▍       | 89429/371472 [7:06:34<21:02:23,  3.72it/s]
 24%|██▍       | 89430/371472 [7:06:34<20:34:21,  3.81it/s]
 24%|██▍       | 89431/371472 [7:06:35<20:32:45,  3.81it/s]
 24%|██▍       | 89432/371472 [7:06:35<22:25:19,  3.49it/s]
 24%|██▍       | 89433/371472 [7:06:35<22:17:13,  3.52it/s]
 24%|██▍       | 89434/371472 [7:06:35<22:00:51,  3.56it/s]
 24%|██▍       | 89435/371472 [7:06:36<21:57:08,  3.57it/s]
 24%|██▍       | 89436/371472 [7:06:36<22:09:07,  3.54it/s]
 24%|██▍       | 89437/371472 [7:06:36<23:23:43,  3.35it/s]
 24%|██▍       | 89438/371472 [7:06:37<22:35:14,  3.47it/s]
 24%|██▍       | 89439/371472 [7:06:37<21:58:58,  3.56it/s]
 24%|██▍       | 89440/371472 [7:06:37<21:38:22,  3.62it/s]
                                                           
{'loss': 3.7758, 'learning_rate': 7.836734254131742e-07, 'epoch': 3.85}

 24%|██▍       | 89440/371472 [7:06:37<21:38:22,  3.62it/s]
 24%|██▍       | 89441/371472 [7:06:37<21:31:02,  3.64it/s]
 24%|██▍       | 89442/371472 [7:06:38<20:36:38,  3.80it/s]
 24%|██▍       | 89443/371472 [7:06:38<22:02:12,  3.56it/s]
 24%|██▍       | 89444/371472 [7:06:38<22:35:50,  3.47it/s]
 24%|██▍       | 89445/371472 [7:06:39<22:26:05,  3.49it/s]
 24%|██▍       | 89446/371472 [7:06:39<23:11:15,  3.38it/s]
 24%|██▍       | 89447/371472 [7:06:39<23:03:38,  3.40it/s]
 24%|██▍       | 89448/371472 [7:06:39<22:07:03,  3.54it/s]
 24%|██▍       | 89449/371472 [7:06:40<22:25:09,  3.49it/s]
 24%|██▍       | 89450/371472 [7:06:40<21:47:44,  3.59it/s]
 24%|██▍       | 89451/371472 [7:06:40<21:13:24,  3.69it/s]
 24%|██▍       | 89452/371472 [7:06:41<21:38:17,  3.62it/s]
 24%|██▍       | 89453/371472 [7:06:41<21:52:45,  3.58it/s]
 24%|██▍       | 89454/371472 [7:06:41<21:57:06,  3.57it/s]
 24%|██▍       | 89455/371472 [7:06:41<22:15:20,  3.52it/s]
 24%|██▍       | 89456/371472 [7:06:42<21:35:32,  3.63it/s]
 24%|██▍       | 89457/371472 [7:06:42<21:33:17,  3.63it/s]
 24%|██▍       | 89458/371472 [7:06:42<22:14:11,  3.52it/s]
 24%|██▍       | 89459/371472 [7:06:43<21:37:06,  3.62it/s]
 24%|██▍       | 89460/371472 [7:06:43<21:29:15,  3.65it/s]
                                                           
{'loss': 3.7494, 'learning_rate': 7.836249434376952e-07, 'epoch': 3.85}

 24%|██▍       | 89460/371472 [7:06:43<21:29:15,  3.65it/s]
 24%|██▍       | 89461/371472 [7:06:43<22:58:04,  3.41it/s]
 24%|██▍       | 89462/371472 [7:06:43<22:33:40,  3.47it/s]
 24%|██▍       | 89463/371472 [7:06:44<22:45:57,  3.44it/s]
 24%|██▍       | 89464/371472 [7:06:44<22:24:08,  3.50it/s]
 24%|██▍       | 89465/371472 [7:06:44<21:45:57,  3.60it/s]
 24%|██▍       | 89466/371472 [7:06:45<22:33:19,  3.47it/s]
 24%|██▍       | 89467/371472 [7:06:45<22:27:37,  3.49it/s]
 24%|██▍       | 89468/371472 [7:06:45<21:48:55,  3.59it/s]
 24%|██▍       | 89469/371472 [7:06:45<21:33:59,  3.63it/s]
 24%|██▍       | 89470/371472 [7:06:46<21:43:57,  3.60it/s]
 24%|██▍       | 89471/371472 [7:06:46<21:45:18,  3.60it/s]
 24%|██▍       | 89472/371472 [7:06:46<21:23:43,  3.66it/s]
 24%|██▍       | 89473/371472 [7:06:46<21:49:54,  3.59it/s]
 24%|██▍       | 89474/371472 [7:06:47<22:39:42,  3.46it/s]
 24%|██▍       | 89475/371472 [7:06:47<22:10:13,  3.53it/s]
 24%|██▍       | 89476/371472 [7:06:47<22:49:03,  3.43it/s]
 24%|██▍       | 89477/371472 [7:06:48<21:52:20,  3.58it/s]
 24%|██▍       | 89478/371472 [7:06:48<21:09:05,  3.70it/s]
 24%|██▍       | 89479/371472 [7:06:48<21:25:22,  3.66it/s]
 24%|██▍       | 89480/371472 [7:06:48<22:22:25,  3.50it/s]
                                                           
{'loss': 3.8453, 'learning_rate': 7.835764614622163e-07, 'epoch': 3.85}

 24%|██▍       | 89480/371472 [7:06:48<22:22:25,  3.50it/s]
 24%|██▍       | 89481/371472 [7:06:49<21:40:13,  3.61it/s]
 24%|██▍       | 89482/371472 [7:06:49<22:06:03,  3.54it/s]
 24%|██▍       | 89483/371472 [7:06:49<21:20:04,  3.67it/s]
 24%|██▍       | 89484/371472 [7:06:49<20:52:49,  3.75it/s]
 24%|██▍       | 89485/371472 [7:06:50<21:07:50,  3.71it/s]
 24%|██▍       | 89486/371472 [7:06:50<21:39:55,  3.62it/s]
 24%|██▍       | 89487/371472 [7:06:50<21:41:12,  3.61it/s]
 24%|██▍       | 89488/371472 [7:06:51<21:39:36,  3.62it/s]
 24%|██▍       | 89489/371472 [7:06:51<22:26:45,  3.49it/s]
 24%|██▍       | 89490/371472 [7:06:51<22:24:14,  3.50it/s]
 24%|██▍       | 89491/371472 [7:06:51<22:18:46,  3.51it/s]
 24%|██▍       | 89492/371472 [7:06:52<21:58:21,  3.56it/s]
 24%|██▍       | 89493/371472 [7:06:52<21:34:47,  3.63it/s]
 24%|██▍       | 89494/371472 [7:06:52<22:43:07,  3.45it/s]
 24%|██▍       | 89495/371472 [7:06:53<21:38:40,  3.62it/s]
 24%|██▍       | 89496/371472 [7:06:53<21:07:03,  3.71it/s]
 24%|██▍       | 89497/371472 [7:06:53<20:52:34,  3.75it/s]
 24%|██▍       | 89498/371472 [7:06:53<21:11:43,  3.70it/s]
 24%|██▍       | 89499/371472 [7:06:54<20:44:36,  3.78it/s]
 24%|██▍       | 89500/371472 [7:06:54<20:31:26,  3.82it/s]
                                                           
{'loss': 3.7828, 'learning_rate': 7.835279794867374e-07, 'epoch': 3.85}

 24%|██▍       | 89500/371472 [7:06:54<20:31:26,  3.82it/s]
 24%|██▍       | 89501/371472 [7:06:54<25:05:12,  3.12it/s]
 24%|██▍       | 89502/371472 [7:06:55<24:13:56,  3.23it/s]
 24%|██▍       | 89503/371472 [7:06:55<22:57:50,  3.41it/s]
 24%|██▍       | 89504/371472 [7:06:55<23:43:31,  3.30it/s]
 24%|██▍       | 89505/371472 [7:06:55<22:35:24,  3.47it/s]
 24%|██▍       | 89506/371472 [7:06:56<23:27:21,  3.34it/s]
 24%|██▍       | 89507/371472 [7:06:56<22:22:25,  3.50it/s]
 24%|██▍       | 89508/371472 [7:06:56<21:42:34,  3.61it/s]
 24%|██▍       | 89509/371472 [7:06:57<22:06:45,  3.54it/s]
 24%|██▍       | 89510/371472 [7:06:57<22:08:38,  3.54it/s]
 24%|██▍       | 89511/371472 [7:06:57<22:13:47,  3.52it/s]
 24%|██▍       | 89512/371472 [7:06:57<22:08:17,  3.54it/s]
 24%|██▍       | 89513/371472 [7:06:58<22:36:39,  3.46it/s]
 24%|██▍       | 89514/371472 [7:06:58<21:25:41,  3.66it/s]
 24%|██▍       | 89515/371472 [7:06:58<22:34:44,  3.47it/s]
 24%|██▍       | 89516/371472 [7:06:59<24:41:05,  3.17it/s]
 24%|██▍       | 89517/371472 [7:06:59<23:46:53,  3.29it/s]
 24%|██▍       | 89518/371472 [7:06:59<24:12:56,  3.23it/s]
 24%|██▍       | 89519/371472 [7:07:00<23:10:18,  3.38it/s]
 24%|██▍       | 89520/371472 [7:07:00<22:43:12,  3.45it/s]
                                                           
{'loss': 3.6256, 'learning_rate': 7.834794975112586e-07, 'epoch': 3.86}

 24%|██▍       | 89520/371472 [7:07:00<22:43:12,  3.45it/s]
 24%|██▍       | 89521/371472 [7:07:00<22:06:19,  3.54it/s]
 24%|██▍       | 89522/371472 [7:07:00<21:29:53,  3.64it/s]
 24%|██▍       | 89523/371472 [7:07:01<22:34:38,  3.47it/s]
 24%|██▍       | 89524/371472 [7:07:01<22:03:15,  3.55it/s]
 24%|██▍       | 89525/371472 [7:07:01<21:57:25,  3.57it/s]
 24%|██▍       | 89526/371472 [7:07:02<22:18:10,  3.51it/s]
 24%|██▍       | 89527/371472 [7:07:02<22:37:58,  3.46it/s]
 24%|██▍       | 89528/371472 [7:07:02<22:25:49,  3.49it/s]
 24%|██▍       | 89529/371472 [7:07:02<21:48:22,  3.59it/s]
 24%|██▍       | 89530/371472 [7:07:03<20:42:46,  3.78it/s]
 24%|██▍       | 89531/371472 [7:07:03<20:17:18,  3.86it/s]
 24%|██▍       | 89532/371472 [7:07:03<23:09:42,  3.38it/s]
 24%|██▍       | 89533/371472 [7:07:04<23:51:44,  3.28it/s]
 24%|██▍       | 89534/371472 [7:07:04<24:10:06,  3.24it/s]
 24%|██▍       | 89535/371472 [7:07:04<23:02:39,  3.40it/s]
 24%|██▍       | 89536/371472 [7:07:04<22:48:06,  3.43it/s]
 24%|██▍       | 89537/371472 [7:07:05<21:55:57,  3.57it/s]
 24%|██▍       | 89538/371472 [7:07:05<21:27:37,  3.65it/s]
 24%|██▍       | 89539/371472 [7:07:05<21:46:02,  3.60it/s]
 24%|██▍       | 89540/371472 [7:07:05<21:55:23,  3.57it/s]
                                                           
{'loss': 3.9478, 'learning_rate': 7.834310155357797e-07, 'epoch': 3.86}

 24%|██▍       | 89540/371472 [7:07:05<21:55:23,  3.57it/s]
 24%|██▍       | 89541/371472 [7:07:06<21:36:52,  3.62it/s]
 24%|██▍       | 89542/371472 [7:07:06<22:20:19,  3.51it/s]
 24%|██▍       | 89543/371472 [7:07:06<22:30:39,  3.48it/s]
 24%|██▍       | 89544/371472 [7:07:07<21:32:16,  3.64it/s]
 24%|██▍       | 89545/371472 [7:07:07<22:10:56,  3.53it/s]
 24%|██▍       | 89546/371472 [7:07:07<21:57:38,  3.57it/s]
 24%|██▍       | 89547/371472 [7:07:07<21:53:29,  3.58it/s]
 24%|██▍       | 89548/371472 [7:07:08<21:13:24,  3.69it/s]
 24%|██▍       | 89549/371472 [7:07:08<21:13:03,  3.69it/s]
 24%|██▍       | 89550/371472 [7:07:08<21:01:44,  3.72it/s]
 24%|██▍       | 89551/371472 [7:07:09<20:55:12,  3.74it/s]
 24%|██▍       | 89552/371472 [7:07:09<22:07:28,  3.54it/s]
 24%|██▍       | 89553/371472 [7:07:09<22:52:33,  3.42it/s]
 24%|██▍       | 89554/371472 [7:07:09<22:18:05,  3.51it/s]
 24%|██▍       | 89555/371472 [7:07:10<22:05:22,  3.55it/s]
 24%|██▍       | 89556/371472 [7:07:10<21:33:12,  3.63it/s]
 24%|██▍       | 89557/371472 [7:07:10<22:52:09,  3.42it/s]
 24%|██▍       | 89558/371472 [7:07:11<22:17:46,  3.51it/s]
 24%|██▍       | 89559/371472 [7:07:11<21:40:36,  3.61it/s]
 24%|██▍       | 89560/371472 [7:07:11<24:27:42,  3.20it/s]
                                                           
{'loss': 3.8812, 'learning_rate': 7.833825335603008e-07, 'epoch': 3.86}

 24%|██▍       | 89560/371472 [7:07:11<24:27:42,  3.20it/s]
 24%|██▍       | 89561/371472 [7:07:11<23:17:34,  3.36it/s]
 24%|██▍       | 89562/371472 [7:07:12<22:28:16,  3.48it/s]
 24%|██▍       | 89563/371472 [7:07:12<22:28:31,  3.48it/s]
 24%|██▍       | 89564/371472 [7:07:12<21:41:15,  3.61it/s]
 24%|██▍       | 89565/371472 [7:07:13<21:36:35,  3.62it/s]
 24%|██▍       | 89566/371472 [7:07:13<21:27:06,  3.65it/s]
 24%|██▍       | 89567/371472 [7:07:13<21:51:50,  3.58it/s]
 24%|██▍       | 89568/371472 [7:07:13<21:17:09,  3.68it/s]
 24%|██▍       | 89569/371472 [7:07:14<21:10:59,  3.70it/s]
 24%|██▍       | 89570/371472 [7:07:14<20:41:16,  3.79it/s]
 24%|██▍       | 89571/371472 [7:07:14<21:06:59,  3.71it/s]
 24%|██▍       | 89572/371472 [7:07:14<21:01:51,  3.72it/s]
 24%|██▍       | 89573/371472 [7:07:15<21:06:16,  3.71it/s]
 24%|██▍       | 89574/371472 [7:07:15<21:06:12,  3.71it/s]
 24%|██▍       | 89575/371472 [7:07:15<21:27:32,  3.65it/s]
 24%|██▍       | 89576/371472 [7:07:16<21:46:11,  3.60it/s]
 24%|██▍       | 89577/371472 [7:07:16<20:50:40,  3.76it/s]
 24%|██▍       | 89578/371472 [7:07:16<23:22:27,  3.35it/s]
 24%|██▍       | 89579/371472 [7:07:16<23:21:21,  3.35it/s]
 24%|██▍       | 89580/371472 [7:07:17<23:24:29,  3.35it/s]
                                                           
{'loss': 3.8641, 'learning_rate': 7.833340515848219e-07, 'epoch': 3.86}

 24%|██▍       | 89580/371472 [7:07:17<23:24:29,  3.35it/s]
 24%|██▍       | 89581/371472 [7:07:17<22:30:53,  3.48it/s]
 24%|██▍       | 89582/371472 [7:07:17<22:32:52,  3.47it/s]
 24%|██▍       | 89583/371472 [7:07:18<23:09:20,  3.38it/s]
 24%|██▍       | 89584/371472 [7:07:18<24:34:02,  3.19it/s]
 24%|██▍       | 89585/371472 [7:07:18<23:29:04,  3.33it/s]
 24%|██▍       | 89586/371472 [7:07:18<22:22:19,  3.50it/s]
 24%|██▍       | 89587/371472 [7:07:19<21:19:47,  3.67it/s]
 24%|██▍       | 89588/371472 [7:07:19<23:50:55,  3.28it/s]
 24%|██▍       | 89589/371472 [7:07:19<25:10:30,  3.11it/s]
 24%|██▍       | 89590/371472 [7:07:20<23:33:29,  3.32it/s]
 24%|██▍       | 89591/371472 [7:07:20<22:25:26,  3.49it/s]
 24%|██▍       | 89592/371472 [7:07:20<22:19:42,  3.51it/s]
 24%|██▍       | 89593/371472 [7:07:21<22:28:18,  3.48it/s]
 24%|██▍       | 89594/371472 [7:07:21<21:38:39,  3.62it/s]
 24%|██▍       | 89595/371472 [7:07:21<23:49:27,  3.29it/s]
 24%|██▍       | 89596/371472 [7:07:21<23:23:40,  3.35it/s]
 24%|██▍       | 89597/371472 [7:07:22<22:26:37,  3.49it/s]
 24%|██▍       | 89598/371472 [7:07:22<21:56:11,  3.57it/s]
 24%|██▍       | 89599/371472 [7:07:22<22:22:33,  3.50it/s]
 24%|██▍       | 89600/371472 [7:07:23<21:43:46,  3.60it/s]
                                                           
{'loss': 3.7482, 'learning_rate': 7.832855696093428e-07, 'epoch': 3.86}

 24%|██▍       | 89600/371472 [7:07:23<21:43:46,  3.60it/s]
 24%|██▍       | 89601/371472 [7:07:23<21:05:50,  3.71it/s]
 24%|██▍       | 89602/371472 [7:07:23<20:47:29,  3.77it/s]
 24%|██▍       | 89603/371472 [7:07:23<20:29:43,  3.82it/s]
 24%|██▍       | 89604/371472 [7:07:24<20:04:04,  3.90it/s]
 24%|██▍       | 89605/371472 [7:07:24<19:40:42,  3.98it/s]
 24%|██▍       | 89606/371472 [7:07:24<20:12:13,  3.88it/s]
 24%|██▍       | 89607/371472 [7:07:24<20:08:29,  3.89it/s]
 24%|██▍       | 89608/371472 [7:07:25<21:21:22,  3.67it/s]
 24%|██▍       | 89609/371472 [7:07:25<21:06:51,  3.71it/s]
 24%|██▍       | 89610/371472 [7:07:25<20:38:57,  3.79it/s]
 24%|██▍       | 89611/371472 [7:07:25<22:47:08,  3.44it/s]
 24%|██▍       | 89612/371472 [7:07:26<23:12:53,  3.37it/s]
 24%|██▍       | 89613/371472 [7:07:26<22:54:39,  3.42it/s]
 24%|██▍       | 89614/371472 [7:07:26<22:08:45,  3.54it/s]
 24%|██▍       | 89615/371472 [7:07:27<21:50:02,  3.59it/s]
 24%|██▍       | 89616/371472 [7:07:27<22:37:52,  3.46it/s]
 24%|██▍       | 89617/371472 [7:07:27<22:48:05,  3.43it/s]
 24%|██▍       | 89618/371472 [7:07:28<25:52:59,  3.02it/s]
 24%|██▍       | 89619/371472 [7:07:28<24:30:16,  3.20it/s]
 24%|██▍       | 89620/371472 [7:07:28<24:50:55,  3.15it/s]
                                                           
{'loss': 3.9785, 'learning_rate': 7.832370876338641e-07, 'epoch': 3.86}

 24%|██▍       | 89620/371472 [7:07:28<24:50:55,  3.15it/s]
 24%|██▍       | 89621/371472 [7:07:28<23:32:10,  3.33it/s]
 24%|██▍       | 89622/371472 [7:07:29<22:45:36,  3.44it/s]
 24%|██▍       | 89623/371472 [7:07:29<23:59:31,  3.26it/s]
 24%|██▍       | 89624/371472 [7:07:29<23:19:46,  3.36it/s]
 24%|██▍       | 89625/371472 [7:07:30<22:19:42,  3.51it/s]
 24%|██▍       | 89626/371472 [7:07:30<23:13:18,  3.37it/s]
 24%|██▍       | 89627/371472 [7:07:30<22:04:44,  3.55it/s]
 24%|██▍       | 89628/371472 [7:07:31<22:42:44,  3.45it/s]
 24%|██▍       | 89629/371472 [7:07:31<21:50:03,  3.59it/s]
 24%|██▍       | 89630/371472 [7:07:31<21:40:50,  3.61it/s]
 24%|██▍       | 89631/371472 [7:07:31<21:44:15,  3.60it/s]
 24%|██▍       | 89632/371472 [7:07:32<22:05:16,  3.54it/s]
 24%|██▍       | 89633/371472 [7:07:32<21:31:58,  3.64it/s]
 24%|██▍       | 89634/371472 [7:07:32<21:22:58,  3.66it/s]
 24%|██▍       | 89635/371472 [7:07:32<20:47:29,  3.77it/s]
 24%|██▍       | 89636/371472 [7:07:33<20:23:11,  3.84it/s]
 24%|██▍       | 89637/371472 [7:07:33<21:51:26,  3.58it/s]
 24%|██▍       | 89638/371472 [7:07:33<22:22:39,  3.50it/s]
 24%|██▍       | 89639/371472 [7:07:34<21:43:36,  3.60it/s]
 24%|██▍       | 89640/371472 [7:07:34<21:37:48,  3.62it/s]
                                                           
{'loss': 3.7922, 'learning_rate': 7.831886056583852e-07, 'epoch': 3.86}

 24%|██▍       | 89640/371472 [7:07:34<21:37:48,  3.62it/s]
 24%|██▍       | 89641/371472 [7:07:34<22:00:33,  3.56it/s]
 24%|██▍       | 89642/371472 [7:07:34<21:16:59,  3.68it/s]
 24%|██▍       | 89643/371472 [7:07:35<21:16:41,  3.68it/s]
 24%|██▍       | 89644/371472 [7:07:35<21:36:59,  3.62it/s]
 24%|██▍       | 89645/371472 [7:07:35<20:59:23,  3.73it/s]
 24%|██▍       | 89646/371472 [7:07:35<21:28:03,  3.65it/s]
 24%|██▍       | 89647/371472 [7:07:36<22:04:29,  3.55it/s]
 24%|██▍       | 89648/371472 [7:07:36<23:54:52,  3.27it/s]
 24%|██▍       | 89649/371472 [7:07:36<22:34:13,  3.47it/s]
 24%|██▍       | 89650/371472 [7:07:37<22:20:20,  3.50it/s]
 24%|██▍       | 89651/371472 [7:07:37<21:05:09,  3.71it/s]
 24%|██▍       | 89652/371472 [7:07:37<21:37:48,  3.62it/s]
 24%|██▍       | 89653/371472 [7:07:38<24:14:42,  3.23it/s]
 24%|██▍       | 89654/371472 [7:07:38<23:19:35,  3.36it/s]
 24%|██▍       | 89655/371472 [7:07:38<21:53:06,  3.58it/s]
 24%|██▍       | 89656/371472 [7:07:38<21:48:18,  3.59it/s]
 24%|██▍       | 89657/371472 [7:07:39<23:02:07,  3.40it/s]
 24%|██▍       | 89658/371472 [7:07:39<22:09:28,  3.53it/s]
 24%|██▍       | 89659/371472 [7:07:39<23:44:01,  3.30it/s]
 24%|██▍       | 89660/371472 [7:07:39<22:17:53,  3.51it/s]
                                                           
{'loss': 3.7549, 'learning_rate': 7.831401236829063e-07, 'epoch': 3.86}

 24%|██▍       | 89660/371472 [7:07:39<22:17:53,  3.51it/s]
 24%|██▍       | 89661/371472 [7:07:40<22:16:38,  3.51it/s]
 24%|██▍       | 89662/371472 [7:07:40<21:53:22,  3.58it/s]
 24%|██▍       | 89663/371472 [7:07:40<21:18:02,  3.68it/s]
 24%|██▍       | 89664/371472 [7:07:41<21:23:15,  3.66it/s]
 24%|██▍       | 89665/371472 [7:07:41<22:37:59,  3.46it/s]
 24%|██▍       | 89666/371472 [7:07:41<22:33:58,  3.47it/s]
 24%|██▍       | 89667/371472 [7:07:41<22:02:10,  3.55it/s]
 24%|██▍       | 89668/371472 [7:07:42<24:15:52,  3.23it/s]
 24%|██▍       | 89669/371472 [7:07:42<24:14:44,  3.23it/s]
 24%|██▍       | 89670/371472 [7:07:42<23:11:33,  3.38it/s]
 24%|██▍       | 89671/371472 [7:07:43<22:38:47,  3.46it/s]
 24%|██▍       | 89672/371472 [7:07:43<22:03:42,  3.55it/s]
 24%|██▍       | 89673/371472 [7:07:43<21:55:37,  3.57it/s]
 24%|██▍       | 89674/371472 [7:07:43<21:30:02,  3.64it/s]
 24%|██▍       | 89675/371472 [7:07:44<21:51:37,  3.58it/s]
 24%|██▍       | 89676/371472 [7:07:44<21:19:15,  3.67it/s]
 24%|██▍       | 89677/371472 [7:07:44<20:54:24,  3.74it/s]
 24%|██▍       | 89678/371472 [7:07:45<21:16:02,  3.68it/s]
 24%|██▍       | 89679/371472 [7:07:45<23:10:18,  3.38it/s]
 24%|██▍       | 89680/371472 [7:07:45<22:34:12,  3.47it/s]
                                                           
{'loss': 3.8124, 'learning_rate': 7.830916417074274e-07, 'epoch': 3.86}

 24%|██▍       | 89680/371472 [7:07:45<22:34:12,  3.47it/s]
 24%|██▍       | 89681/371472 [7:07:45<22:03:17,  3.55it/s]
 24%|██▍       | 89682/371472 [7:07:46<22:09:15,  3.53it/s]
 24%|██▍       | 89683/371472 [7:07:46<21:21:47,  3.66it/s]
 24%|██▍       | 89684/371472 [7:07:46<21:11:25,  3.69it/s]
 24%|██▍       | 89685/371472 [7:07:47<21:26:24,  3.65it/s]
 24%|██▍       | 89686/371472 [7:07:47<22:36:34,  3.46it/s]
 24%|██▍       | 89687/371472 [7:07:47<21:51:42,  3.58it/s]
 24%|██▍       | 89688/371472 [7:07:47<21:58:38,  3.56it/s]
 24%|██▍       | 89689/371472 [7:07:48<23:37:03,  3.31it/s]
 24%|██▍       | 89690/371472 [7:07:48<25:32:36,  3.06it/s]
 24%|██▍       | 89691/371472 [7:07:48<25:09:25,  3.11it/s]
 24%|██▍       | 89692/371472 [7:07:49<23:40:38,  3.31it/s]
 24%|██▍       | 89693/371472 [7:07:49<25:26:43,  3.08it/s]
 24%|██▍       | 89694/371472 [7:07:49<25:47:31,  3.03it/s]
 24%|██▍       | 89695/371472 [7:07:50<23:32:27,  3.32it/s]
 24%|██▍       | 89696/371472 [7:07:50<22:36:53,  3.46it/s]
 24%|██▍       | 89697/371472 [7:07:50<21:25:09,  3.65it/s]
 24%|██▍       | 89698/371472 [7:07:50<21:14:34,  3.68it/s]
 24%|██▍       | 89699/371472 [7:07:51<21:55:56,  3.57it/s]
 24%|██▍       | 89700/371472 [7:07:51<23:24:14,  3.34it/s]
                                                           
{'loss': 3.6733, 'learning_rate': 7.830431597319485e-07, 'epoch': 3.86}

 24%|██▍       | 89700/371472 [7:07:51<23:24:14,  3.34it/s]
 24%|██▍       | 89701/371472 [7:07:51<23:01:57,  3.40it/s]
 24%|██▍       | 89702/371472 [7:07:52<21:57:49,  3.56it/s]
 24%|██▍       | 89703/371472 [7:07:52<21:31:29,  3.64it/s]
 24%|██▍       | 89704/371472 [7:07:52<21:38:21,  3.62it/s]
 24%|██▍       | 89705/371472 [7:07:52<21:04:09,  3.71it/s]
 24%|██▍       | 89706/371472 [7:07:53<20:40:54,  3.78it/s]
 24%|██▍       | 89707/371472 [7:07:53<20:30:15,  3.82it/s]
 24%|██▍       | 89708/371472 [7:07:53<20:15:53,  3.86it/s]
 24%|██▍       | 89709/371472 [7:07:53<20:50:08,  3.76it/s]
 24%|██▍       | 89710/371472 [7:07:54<21:00:13,  3.73it/s]
 24%|██▍       | 89711/371472 [7:07:54<20:57:27,  3.73it/s]
 24%|██▍       | 89712/371472 [7:07:54<20:42:25,  3.78it/s]
 24%|██▍       | 89713/371472 [7:07:55<21:52:19,  3.58it/s]
 24%|██▍       | 89714/371472 [7:07:55<22:45:29,  3.44it/s]
 24%|██▍       | 89715/371472 [7:07:55<22:15:05,  3.52it/s]
 24%|██▍       | 89716/371472 [7:07:55<21:52:08,  3.58it/s]
 24%|██▍       | 89717/371472 [7:07:56<21:18:42,  3.67it/s]
 24%|██▍       | 89718/371472 [7:07:56<20:48:33,  3.76it/s]
 24%|██▍       | 89719/371472 [7:07:56<20:33:21,  3.81it/s]
 24%|██▍       | 89720/371472 [7:07:56<20:26:36,  3.83it/s]
                                                           
{'loss': 3.85, 'learning_rate': 7.829946777564696e-07, 'epoch': 3.86}

 24%|██▍       | 89720/371472 [7:07:56<20:26:36,  3.83it/s]
 24%|██▍       | 89721/371472 [7:07:57<22:40:12,  3.45it/s]
 24%|██▍       | 89722/371472 [7:07:57<23:56:24,  3.27it/s]
 24%|██▍       | 89723/371472 [7:07:57<24:07:41,  3.24it/s]
 24%|██▍       | 89724/371472 [7:07:58<23:57:39,  3.27it/s]
 24%|██▍       | 89725/371472 [7:07:58<23:34:30,  3.32it/s]
 24%|██▍       | 89726/371472 [7:07:58<23:56:44,  3.27it/s]
 24%|██▍       | 89727/371472 [7:07:59<22:43:57,  3.44it/s]
 24%|██▍       | 89728/371472 [7:07:59<21:53:34,  3.57it/s]
 24%|██▍       | 89729/371472 [7:07:59<21:04:48,  3.71it/s]
 24%|██▍       | 89730/371472 [7:07:59<21:33:28,  3.63it/s]
 24%|██▍       | 89731/371472 [7:08:00<21:09:07,  3.70it/s]
 24%|██▍       | 89732/371472 [7:08:00<21:17:14,  3.68it/s]
 24%|██▍       | 89733/371472 [7:08:00<20:50:28,  3.76it/s]
 24%|██▍       | 89734/371472 [7:08:00<21:12:00,  3.69it/s]
 24%|██▍       | 89735/371472 [7:08:01<21:36:48,  3.62it/s]
 24%|██▍       | 89736/371472 [7:08:01<21:56:11,  3.57it/s]
 24%|██▍       | 89737/371472 [7:08:01<21:34:35,  3.63it/s]
 24%|██▍       | 89738/371472 [7:08:02<21:54:59,  3.57it/s]
 24%|██▍       | 89739/371472 [7:08:02<22:22:22,  3.50it/s]
 24%|██▍       | 89740/371472 [7:08:02<22:37:14,  3.46it/s]
                                                           
{'loss': 3.8004, 'learning_rate': 7.829461957809907e-07, 'epoch': 3.87}

 24%|██▍       | 89740/371472 [7:08:02<22:37:14,  3.46it/s]
 24%|██▍       | 89741/371472 [7:08:02<23:10:12,  3.38it/s]
 24%|██▍       | 89742/371472 [7:08:03<22:53:20,  3.42it/s]
 24%|██▍       | 89743/371472 [7:08:03<22:21:49,  3.50it/s]
 24%|██▍       | 89744/371472 [7:08:03<22:17:37,  3.51it/s]
 24%|██▍       | 89745/371472 [7:08:04<21:46:24,  3.59it/s]
 24%|██▍       | 89746/371472 [7:08:04<20:53:33,  3.75it/s]
 24%|██▍       | 89747/371472 [7:08:04<20:30:18,  3.82it/s]
 24%|██▍       | 89748/371472 [7:08:04<20:50:53,  3.75it/s]
 24%|██▍       | 89749/371472 [7:08:05<22:41:58,  3.45it/s]
 24%|██▍       | 89750/371472 [7:08:05<22:06:20,  3.54it/s]
 24%|██▍       | 89751/371472 [7:08:05<22:31:59,  3.47it/s]
 24%|██▍       | 89752/371472 [7:08:06<22:09:42,  3.53it/s]
 24%|██▍       | 89753/371472 [7:08:06<21:25:31,  3.65it/s]
 24%|██▍       | 89754/371472 [7:08:06<20:39:37,  3.79it/s]
 24%|██▍       | 89755/371472 [7:08:06<20:41:08,  3.78it/s]
 24%|██▍       | 89756/371472 [7:08:07<20:26:18,  3.83it/s]
 24%|██▍       | 89757/371472 [7:08:07<20:34:04,  3.80it/s]
 24%|██▍       | 89758/371472 [7:08:07<21:05:44,  3.71it/s]
 24%|██▍       | 89759/371472 [7:08:07<20:58:15,  3.73it/s]
 24%|██▍       | 89760/371472 [7:08:08<20:59:27,  3.73it/s]
                                                           
{'loss': 3.9266, 'learning_rate': 7.828977138055118e-07, 'epoch': 3.87}

 24%|██▍       | 89760/371472 [7:08:08<20:59:27,  3.73it/s]
 24%|██▍       | 89761/371472 [7:08:08<21:31:37,  3.64it/s]
 24%|██▍       | 89762/371472 [7:08:08<24:31:15,  3.19it/s]
 24%|██▍       | 89763/371472 [7:08:09<23:27:47,  3.34it/s]
 24%|██▍       | 89764/371472 [7:08:09<23:34:45,  3.32it/s]
 24%|██▍       | 89765/371472 [7:08:09<23:48:56,  3.29it/s]
 24%|██▍       | 89766/371472 [7:08:09<22:37:20,  3.46it/s]
 24%|██▍       | 89767/371472 [7:08:10<21:52:48,  3.58it/s]
 24%|██▍       | 89768/371472 [7:08:10<22:00:35,  3.56it/s]
 24%|██▍       | 89769/371472 [7:08:10<21:59:08,  3.56it/s]
 24%|██▍       | 89770/371472 [7:08:11<21:51:22,  3.58it/s]
 24%|██▍       | 89771/371472 [7:08:11<21:24:05,  3.66it/s]
 24%|██▍       | 89772/371472 [7:08:11<21:12:08,  3.69it/s]
 24%|██▍       | 89773/371472 [7:08:11<22:51:46,  3.42it/s]
 24%|██▍       | 89774/371472 [7:08:12<22:53:34,  3.42it/s]
 24%|██▍       | 89775/371472 [7:08:12<22:22:01,  3.50it/s]
 24%|██▍       | 89776/371472 [7:08:12<21:05:21,  3.71it/s]
 24%|██▍       | 89777/371472 [7:08:13<21:32:55,  3.63it/s]
 24%|██▍       | 89778/371472 [7:08:13<21:35:52,  3.62it/s]
 24%|██▍       | 89779/371472 [7:08:13<21:16:48,  3.68it/s]
 24%|██▍       | 89780/371472 [7:08:13<20:59:46,  3.73it/s]
                                                           
{'loss': 3.7967, 'learning_rate': 7.828492318300329e-07, 'epoch': 3.87}

 24%|██▍       | 89780/371472 [7:08:13<20:59:46,  3.73it/s]
 24%|██▍       | 89781/371472 [7:08:14<20:45:28,  3.77it/s]
 24%|██▍       | 89782/371472 [7:08:14<20:26:31,  3.83it/s]
 24%|██▍       | 89783/371472 [7:08:14<20:10:53,  3.88it/s]
 24%|██▍       | 89784/371472 [7:08:14<20:12:26,  3.87it/s]
 24%|██▍       | 89785/371472 [7:08:15<20:42:27,  3.78it/s]
 24%|██▍       | 89786/371472 [7:08:15<21:38:36,  3.62it/s]
 24%|██▍       | 89787/371472 [7:08:15<21:22:06,  3.66it/s]
 24%|██▍       | 89788/371472 [7:08:15<21:42:14,  3.61it/s]
 24%|██▍       | 89789/371472 [7:08:16<21:11:03,  3.69it/s]
 24%|██▍       | 89790/371472 [7:08:16<21:18:45,  3.67it/s]
 24%|██▍       | 89791/371472 [7:08:16<21:23:54,  3.66it/s]
 24%|██▍       | 89792/371472 [7:08:17<20:45:31,  3.77it/s]
 24%|██▍       | 89793/371472 [7:08:17<20:24:16,  3.83it/s]
 24%|██▍       | 89794/371472 [7:08:17<20:10:28,  3.88it/s]
 24%|██▍       | 89795/371472 [7:08:17<21:10:21,  3.70it/s]
 24%|██▍       | 89796/371472 [7:08:18<22:46:21,  3.44it/s]
 24%|██▍       | 89797/371472 [7:08:18<24:10:54,  3.24it/s]
 24%|██▍       | 89798/371472 [7:08:18<23:34:06,  3.32it/s]
 24%|██▍       | 89799/371472 [7:08:19<22:46:38,  3.44it/s]
 24%|██▍       | 89800/371472 [7:08:19<22:00:18,  3.56it/s]
                                                           
{'loss': 3.8047, 'learning_rate': 7.828007498545541e-07, 'epoch': 3.87}

 24%|██▍       | 89800/371472 [7:08:19<22:00:18,  3.56it/s]
 24%|██▍       | 89801/371472 [7:08:19<21:50:21,  3.58it/s]
 24%|██▍       | 89802/371472 [7:08:19<21:08:54,  3.70it/s]
 24%|██▍       | 89803/371472 [7:08:20<20:57:26,  3.73it/s]
 24%|██▍       | 89804/371472 [7:08:20<21:01:44,  3.72it/s]
 24%|██▍       | 89805/371472 [7:08:20<21:09:32,  3.70it/s]
 24%|██▍       | 89806/371472 [7:08:20<21:22:38,  3.66it/s]
 24%|██▍       | 89807/371472 [7:08:21<21:05:56,  3.71it/s]
 24%|██▍       | 89808/371472 [7:08:21<21:22:06,  3.66it/s]
 24%|██▍       | 89809/371472 [7:08:21<23:17:27,  3.36it/s]
 24%|██▍       | 89810/371472 [7:08:22<23:51:27,  3.28it/s]
 24%|██▍       | 89811/371472 [7:08:22<22:50:08,  3.43it/s]
 24%|██▍       | 89812/371472 [7:08:22<22:05:33,  3.54it/s]
 24%|██▍       | 89813/371472 [7:08:22<21:44:09,  3.60it/s]
 24%|██▍       | 89814/371472 [7:08:23<23:24:26,  3.34it/s]
 24%|██▍       | 89815/371472 [7:08:23<22:44:02,  3.44it/s]
 24%|██▍       | 89816/371472 [7:08:23<22:43:36,  3.44it/s]
 24%|██▍       | 89817/371472 [7:08:24<22:57:08,  3.41it/s]
 24%|██▍       | 89818/371472 [7:08:24<24:11:30,  3.23it/s]
 24%|██▍       | 89819/371472 [7:08:24<23:58:34,  3.26it/s]
 24%|██▍       | 89820/371472 [7:08:25<22:44:11,  3.44it/s]
                                                           
{'loss': 3.9963, 'learning_rate': 7.827522678790752e-07, 'epoch': 3.87}

 24%|██▍       | 89820/371472 [7:08:25<22:44:11,  3.44it/s]
 24%|██▍       | 89821/371472 [7:08:25<21:52:43,  3.58it/s]
 24%|██▍       | 89822/371472 [7:08:25<21:27:25,  3.65it/s]
 24%|██▍       | 89823/371472 [7:08:25<21:40:36,  3.61it/s]
 24%|██▍       | 89824/371472 [7:08:26<21:56:03,  3.57it/s]
 24%|██▍       | 89825/371472 [7:08:26<21:13:05,  3.69it/s]
 24%|██▍       | 89826/371472 [7:08:26<21:47:56,  3.59it/s]
 24%|██▍       | 89827/371472 [7:08:26<21:37:15,  3.62it/s]
 24%|██▍       | 89828/371472 [7:08:27<21:34:06,  3.63it/s]
 24%|██▍       | 89829/371472 [7:08:27<21:29:14,  3.64it/s]
 24%|██▍       | 89830/371472 [7:08:27<21:54:20,  3.57it/s]
 24%|██▍       | 89831/371472 [7:08:28<21:01:06,  3.72it/s]
 24%|██▍       | 89832/371472 [7:08:28<21:06:05,  3.71it/s]
 24%|██▍       | 89833/371472 [7:08:28<20:42:23,  3.78it/s]
 24%|██▍       | 89834/371472 [7:08:28<20:52:11,  3.75it/s]
 24%|██▍       | 89835/371472 [7:08:29<23:24:01,  3.34it/s]
 24%|██▍       | 89836/371472 [7:08:29<22:00:27,  3.55it/s]
 24%|██▍       | 89837/371472 [7:08:29<21:32:26,  3.63it/s]
 24%|██▍       | 89838/371472 [7:08:30<23:23:04,  3.35it/s]
 24%|██▍       | 89839/371472 [7:08:30<25:21:52,  3.08it/s]
 24%|██▍       | 89840/371472 [7:08:30<24:19:43,  3.22it/s]
                                                           
{'loss': 4.0488, 'learning_rate': 7.827037859035962e-07, 'epoch': 3.87}

 24%|██▍       | 89840/371472 [7:08:30<24:19:43,  3.22it/s]
 24%|██▍       | 89841/371472 [7:08:31<25:04:21,  3.12it/s]
 24%|██▍       | 89842/371472 [7:08:31<24:15:44,  3.22it/s]
 24%|██▍       | 89843/371472 [7:08:31<23:15:55,  3.36it/s]
 24%|██▍       | 89844/371472 [7:08:31<24:31:06,  3.19it/s]
 24%|██▍       | 89845/371472 [7:08:32<23:51:30,  3.28it/s]
 24%|██▍       | 89846/371472 [7:08:32<22:39:01,  3.45it/s]
 24%|██▍       | 89847/371472 [7:08:32<21:20:25,  3.67it/s]
 24%|██▍       | 89848/371472 [7:08:33<21:50:40,  3.58it/s]
 24%|██▍       | 89849/371472 [7:08:33<21:29:56,  3.64it/s]
 24%|██▍       | 89850/371472 [7:08:33<20:32:02,  3.81it/s]
 24%|██▍       | 89851/371472 [7:08:33<22:23:23,  3.49it/s]
 24%|██▍       | 89852/371472 [7:08:34<22:36:29,  3.46it/s]
 24%|██▍       | 89853/371472 [7:08:34<23:59:12,  3.26it/s]
 24%|██▍       | 89854/371472 [7:08:34<23:29:10,  3.33it/s]
 24%|██▍       | 89855/371472 [7:08:35<22:41:57,  3.45it/s]
 24%|██▍       | 89856/371472 [7:08:35<22:16:13,  3.51it/s]
 24%|██▍       | 89857/371472 [7:08:35<22:39:35,  3.45it/s]
 24%|██▍       | 89858/371472 [7:08:36<24:55:10,  3.14it/s]
 24%|██▍       | 89859/371472 [7:08:36<24:28:32,  3.20it/s]
 24%|██▍       | 89860/371472 [7:08:36<22:53:35,  3.42it/s]
                                                           
{'loss': 3.8202, 'learning_rate': 7.826553039281173e-07, 'epoch': 3.87}

 24%|██▍       | 89860/371472 [7:08:36<22:53:35,  3.42it/s]
 24%|██▍       | 89861/371472 [7:08:36<22:24:47,  3.49it/s]
 24%|██▍       | 89862/371472 [7:08:37<21:49:13,  3.58it/s]
 24%|██▍       | 89863/371472 [7:08:37<21:30:34,  3.64it/s]
 24%|██▍       | 89864/371472 [7:08:37<21:14:01,  3.68it/s]
 24%|██▍       | 89865/371472 [7:08:37<20:49:14,  3.76it/s]
 24%|██▍       | 89866/371472 [7:08:38<20:13:52,  3.87it/s]
 24%|██▍       | 89867/371472 [7:08:38<21:42:07,  3.60it/s]
 24%|██▍       | 89868/371472 [7:08:38<21:26:26,  3.65it/s]
 24%|██▍       | 89869/371472 [7:08:39<21:40:13,  3.61it/s]
 24%|██▍       | 89870/371472 [7:08:39<21:16:51,  3.68it/s]
 24%|██▍       | 89871/371472 [7:08:39<22:29:12,  3.48it/s]
 24%|██▍       | 89872/371472 [7:08:39<22:19:52,  3.50it/s]
 24%|██▍       | 89873/371472 [7:08:40<22:51:17,  3.42it/s]
 24%|██▍       | 89874/371472 [7:08:40<22:21:31,  3.50it/s]
 24%|██▍       | 89875/371472 [7:08:40<21:48:41,  3.59it/s]
 24%|██▍       | 89876/371472 [7:08:40<21:27:39,  3.64it/s]
 24%|██▍       | 89877/371472 [7:08:41<21:00:07,  3.72it/s]
 24%|██▍       | 89878/371472 [7:08:41<21:19:13,  3.67it/s]
 24%|██▍       | 89879/371472 [7:08:41<22:10:39,  3.53it/s]
 24%|██▍       | 89880/371472 [7:08:42<22:34:33,  3.46it/s]
                                                           
{'loss': 3.8694, 'learning_rate': 7.826068219526385e-07, 'epoch': 3.87}

 24%|██▍       | 89880/371472 [7:08:42<22:34:33,  3.46it/s]
 24%|██▍       | 89881/371472 [7:08:42<22:47:39,  3.43it/s]
 24%|██▍       | 89882/371472 [7:08:42<22:54:03,  3.42it/s]
 24%|██▍       | 89883/371472 [7:08:42<22:02:54,  3.55it/s]
 24%|██▍       | 89884/371472 [7:08:43<22:45:23,  3.44it/s]
 24%|██▍       | 89885/371472 [7:08:43<22:01:31,  3.55it/s]
 24%|██▍       | 89886/371472 [7:08:44<26:23:39,  2.96it/s]
 24%|██▍       | 89887/371472 [7:08:44<26:54:29,  2.91it/s]
 24%|██▍       | 89888/371472 [7:08:44<27:49:18,  2.81it/s]
 24%|██▍       | 89889/371472 [7:08:45<25:44:05,  3.04it/s]
 24%|██▍       | 89890/371472 [7:08:45<25:19:22,  3.09it/s]
 24%|██▍       | 89891/371472 [7:08:45<23:49:15,  3.28it/s]
 24%|██▍       | 89892/371472 [7:08:45<22:33:49,  3.47it/s]
 24%|██▍       | 89893/371472 [7:08:46<22:54:50,  3.41it/s]
 24%|██▍       | 89894/371472 [7:08:46<22:03:46,  3.55it/s]
 24%|██▍       | 89895/371472 [7:08:46<21:31:47,  3.63it/s]
 24%|██▍       | 89896/371472 [7:08:46<20:54:55,  3.74it/s]
 24%|██▍       | 89897/371472 [7:08:47<21:00:00,  3.72it/s]
 24%|██▍       | 89898/371472 [7:08:47<20:25:22,  3.83it/s]
 24%|██▍       | 89899/371472 [7:08:47<21:08:57,  3.70it/s]
 24%|██▍       | 89900/371472 [7:08:47<20:31:32,  3.81it/s]
                                                           
{'loss': 3.8098, 'learning_rate': 7.825583399771595e-07, 'epoch': 3.87}

 24%|██▍       | 89900/371472 [7:08:47<20:31:32,  3.81it/s]
 24%|██▍       | 89901/371472 [7:08:48<20:56:09,  3.74it/s]
 24%|██▍       | 89902/371472 [7:08:48<21:02:32,  3.72it/s]
 24%|██▍       | 89903/371472 [7:08:48<23:08:56,  3.38it/s]
 24%|██▍       | 89904/371472 [7:08:49<24:28:02,  3.20it/s]
 24%|██▍       | 89905/371472 [7:08:49<24:12:25,  3.23it/s]
 24%|██▍       | 89906/371472 [7:08:49<23:04:34,  3.39it/s]
 24%|██▍       | 89907/371472 [7:08:50<22:56:45,  3.41it/s]
 24%|██▍       | 89908/371472 [7:08:50<22:31:27,  3.47it/s]
 24%|██▍       | 89909/371472 [7:08:50<22:58:54,  3.40it/s]
 24%|██▍       | 89910/371472 [7:08:50<22:55:46,  3.41it/s]
 24%|██▍       | 89911/371472 [7:08:51<22:07:22,  3.54it/s]
 24%|██▍       | 89912/371472 [7:08:51<21:58:43,  3.56it/s]
 24%|██▍       | 89913/371472 [7:08:51<23:00:50,  3.40it/s]
 24%|██▍       | 89914/371472 [7:08:52<22:10:57,  3.53it/s]
 24%|██▍       | 89915/371472 [7:08:52<23:00:26,  3.40it/s]
 24%|██▍       | 89916/371472 [7:08:52<23:28:31,  3.33it/s]
 24%|██▍       | 89917/371472 [7:08:52<22:16:21,  3.51it/s]
 24%|██▍       | 89918/371472 [7:08:53<22:03:23,  3.55it/s]
 24%|██▍       | 89919/371472 [7:08:53<22:22:35,  3.50it/s]
 24%|██▍       | 89920/371472 [7:08:53<22:09:23,  3.53it/s]
                                                           
{'loss': 3.7308, 'learning_rate': 7.825098580016807e-07, 'epoch': 3.87}

 24%|██▍       | 89920/371472 [7:08:53<22:09:23,  3.53it/s]
 24%|██▍       | 89921/371472 [7:08:54<21:50:36,  3.58it/s]
 24%|██▍       | 89922/371472 [7:08:54<23:42:01,  3.30it/s]
 24%|██▍       | 89923/371472 [7:08:54<24:58:48,  3.13it/s]
 24%|██▍       | 89924/371472 [7:08:55<23:57:06,  3.27it/s]
 24%|██▍       | 89925/371472 [7:08:55<22:41:46,  3.45it/s]
 24%|██▍       | 89926/371472 [7:08:55<21:58:31,  3.56it/s]
 24%|██▍       | 89927/371472 [7:08:55<21:05:39,  3.71it/s]
 24%|██▍       | 89928/371472 [7:08:56<20:18:44,  3.85it/s]
 24%|██▍       | 89929/371472 [7:08:56<21:50:29,  3.58it/s]
 24%|██▍       | 89930/371472 [7:08:56<22:44:28,  3.44it/s]
 24%|██▍       | 89931/371472 [7:08:56<21:35:10,  3.62it/s]
 24%|██▍       | 89932/371472 [7:08:57<21:32:37,  3.63it/s]
 24%|██▍       | 89933/371472 [7:08:57<20:55:30,  3.74it/s]
 24%|██▍       | 89934/371472 [7:08:57<21:24:35,  3.65it/s]
 24%|██▍       | 89935/371472 [7:08:58<21:55:55,  3.57it/s]
 24%|██▍       | 89936/371472 [7:08:58<21:17:48,  3.67it/s]
 24%|██▍       | 89937/371472 [7:08:58<21:46:12,  3.59it/s]
 24%|██▍       | 89938/371472 [7:08:58<22:02:42,  3.55it/s]
 24%|██▍       | 89939/371472 [7:08:59<22:24:21,  3.49it/s]
 24%|██▍       | 89940/371472 [7:08:59<21:31:03,  3.63it/s]
                                                           
{'loss': 3.7651, 'learning_rate': 7.824613760262018e-07, 'epoch': 3.87}

 24%|██▍       | 89940/371472 [7:08:59<21:31:03,  3.63it/s]
 24%|██▍       | 89941/371472 [7:08:59<21:15:28,  3.68it/s]
 24%|██▍       | 89942/371472 [7:08:59<21:17:29,  3.67it/s]
 24%|██▍       | 89943/371472 [7:09:00<23:07:02,  3.38it/s]
 24%|██▍       | 89944/371472 [7:09:00<22:32:21,  3.47it/s]
 24%|██▍       | 89945/371472 [7:09:00<22:02:43,  3.55it/s]
 24%|██▍       | 89946/371472 [7:09:01<21:59:19,  3.56it/s]
 24%|██▍       | 89947/371472 [7:09:01<21:16:49,  3.67it/s]
 24%|██▍       | 89948/371472 [7:09:01<21:47:06,  3.59it/s]
 24%|██▍       | 89949/371472 [7:09:01<21:02:40,  3.72it/s]
 24%|██▍       | 89950/371472 [7:09:02<20:45:52,  3.77it/s]
 24%|██▍       | 89951/371472 [7:09:02<22:29:06,  3.48it/s]
 24%|██▍       | 89952/371472 [7:09:02<22:25:14,  3.49it/s]
 24%|██▍       | 89953/371472 [7:09:03<22:16:11,  3.51it/s]
 24%|██▍       | 89954/371472 [7:09:03<22:01:46,  3.55it/s]
 24%|██▍       | 89955/371472 [7:09:03<21:20:15,  3.66it/s]
 24%|██▍       | 89956/371472 [7:09:03<21:14:16,  3.68it/s]
 24%|██▍       | 89957/371472 [7:09:04<21:04:23,  3.71it/s]
 24%|██▍       | 89958/371472 [7:09:04<21:34:35,  3.62it/s]
 24%|██▍       | 89959/371472 [7:09:04<21:04:11,  3.71it/s]
 24%|██▍       | 89960/371472 [7:09:04<20:40:21,  3.78it/s]
                                                           
{'loss': 3.9445, 'learning_rate': 7.824128940507229e-07, 'epoch': 3.87}

 24%|██▍       | 89960/371472 [7:09:04<20:40:21,  3.78it/s]
 24%|██▍       | 89961/371472 [7:09:05<20:49:43,  3.75it/s]
 24%|██▍       | 89962/371472 [7:09:05<21:59:32,  3.56it/s]
 24%|██▍       | 89963/371472 [7:09:05<22:11:51,  3.52it/s]
 24%|██▍       | 89964/371472 [7:09:06<22:37:31,  3.46it/s]
 24%|██▍       | 89965/371472 [7:09:06<23:11:03,  3.37it/s]
 24%|██▍       | 89966/371472 [7:09:06<22:31:32,  3.47it/s]
 24%|██▍       | 89967/371472 [7:09:07<23:58:41,  3.26it/s]
 24%|██▍       | 89968/371472 [7:09:07<23:22:21,  3.35it/s]
 24%|██▍       | 89969/371472 [7:09:07<24:01:50,  3.25it/s]
 24%|██▍       | 89970/371472 [7:09:07<22:58:00,  3.40it/s]
 24%|██▍       | 89971/371472 [7:09:08<22:02:48,  3.55it/s]
 24%|██▍       | 89972/371472 [7:09:08<22:44:08,  3.44it/s]
 24%|██▍       | 89973/371472 [7:09:08<23:25:00,  3.34it/s]
 24%|██▍       | 89974/371472 [7:09:09<22:08:48,  3.53it/s]
 24%|██▍       | 89975/371472 [7:09:09<21:36:36,  3.62it/s]
 24%|██▍       | 89976/371472 [7:09:09<21:20:15,  3.66it/s]
 24%|██▍       | 89977/371472 [7:09:09<21:34:23,  3.62it/s]
 24%|██▍       | 89978/371472 [7:09:10<21:54:47,  3.57it/s]
 24%|██▍       | 89979/371472 [7:09:10<23:40:59,  3.30it/s]
 24%|██▍       | 89980/371472 [7:09:10<23:52:45,  3.27it/s]
                                                           
{'loss': 3.6094, 'learning_rate': 7.823644120752439e-07, 'epoch': 3.88}

 24%|██▍       | 89980/371472 [7:09:10<23:52:45,  3.27it/s]
 24%|██▍       | 89981/371472 [7:09:11<23:44:31,  3.29it/s]
 24%|██▍       | 89982/371472 [7:09:11<23:36:56,  3.31it/s]
 24%|██▍       | 89983/371472 [7:09:11<22:42:02,  3.44it/s]
 24%|██▍       | 89984/371472 [7:09:11<21:58:26,  3.56it/s]
 24%|██▍       | 89985/371472 [7:09:12<21:21:23,  3.66it/s]
 24%|██▍       | 89986/371472 [7:09:12<21:40:48,  3.61it/s]
 24%|██▍       | 89987/371472 [7:09:12<20:56:38,  3.73it/s]
 24%|██▍       | 89988/371472 [7:09:13<21:10:11,  3.69it/s]
 24%|██▍       | 89989/371472 [7:09:13<21:54:51,  3.57it/s]
 24%|██▍       | 89990/371472 [7:09:13<21:50:07,  3.58it/s]
 24%|██▍       | 89991/371472 [7:09:13<21:33:18,  3.63it/s]
 24%|██▍       | 89992/371472 [7:09:14<22:03:57,  3.54it/s]
 24%|██▍       | 89993/371472 [7:09:14<21:39:48,  3.61it/s]
 24%|██▍       | 89994/371472 [7:09:14<21:17:26,  3.67it/s]
 24%|██▍       | 89995/371472 [7:09:14<21:00:46,  3.72it/s]
 24%|██▍       | 89996/371472 [7:09:15<20:58:25,  3.73it/s]
 24%|██▍       | 89997/371472 [7:09:15<20:18:25,  3.85it/s]
 24%|██▍       | 89998/371472 [7:09:15<22:28:22,  3.48it/s]
 24%|██▍       | 89999/371472 [7:09:16<22:14:55,  3.51it/s]
 24%|██▍       | 90000/371472 [7:09:16<23:56:23,  3.27it/s]
                                                           
{'loss': 3.7239, 'learning_rate': 7.823159300997651e-07, 'epoch': 3.88}

 24%|██▍       | 90000/371472 [7:09:16<23:56:23,  3.27it/s]
 24%|██▍       | 90001/371472 [7:09:16<22:55:20,  3.41it/s]
 24%|██▍       | 90002/371472 [7:09:16<22:44:52,  3.44it/s]
 24%|██▍       | 90003/371472 [7:09:17<22:25:10,  3.49it/s]
 24%|██▍       | 90004/371472 [7:09:17<21:52:18,  3.57it/s]
 24%|██▍       | 90005/371472 [7:09:17<21:09:56,  3.69it/s]
 24%|██▍       | 90006/371472 [7:09:18<21:08:26,  3.70it/s]
 24%|██▍       | 90007/371472 [7:09:18<21:14:35,  3.68it/s]
 24%|██▍       | 90008/371472 [7:09:18<21:06:22,  3.70it/s]
 24%|██▍       | 90009/371472 [7:09:19<25:20:25,  3.09it/s]
 24%|██▍       | 90010/371472 [7:09:19<24:09:46,  3.24it/s]
 24%|██▍       | 90011/371472 [7:09:19<24:23:49,  3.20it/s]
 24%|██▍       | 90012/371472 [7:09:19<23:23:43,  3.34it/s]
 24%|██▍       | 90013/371472 [7:09:20<22:33:24,  3.47it/s]
 24%|██▍       | 90014/371472 [7:09:20<22:20:08,  3.50it/s]
 24%|██▍       | 90015/371472 [7:09:20<21:38:35,  3.61it/s]
 24%|██▍       | 90016/371472 [7:09:20<21:28:25,  3.64it/s]
 24%|██▍       | 90017/371472 [7:09:21<20:54:39,  3.74it/s]
 24%|██▍       | 90018/371472 [7:09:21<21:05:54,  3.71it/s]
 24%|██▍       | 90019/371472 [7:09:21<21:57:04,  3.56it/s]
 24%|██▍       | 90020/371472 [7:09:22<25:10:35,  3.11it/s]
                                                           
{'loss': 3.8739, 'learning_rate': 7.822674481242861e-07, 'epoch': 3.88}

 24%|██▍       | 90020/371472 [7:09:22<25:10:35,  3.11it/s]
 24%|██▍       | 90021/371472 [7:09:22<24:17:02,  3.22it/s]
 24%|██▍       | 90022/371472 [7:09:22<26:21:24,  2.97it/s]
 24%|██▍       | 90023/371472 [7:09:23<25:02:32,  3.12it/s]
 24%|██▍       | 90024/371472 [7:09:23<23:38:38,  3.31it/s]
 24%|██▍       | 90025/371472 [7:09:23<25:11:00,  3.10it/s]
 24%|██▍       | 90026/371472 [7:09:24<24:51:03,  3.15it/s]
 24%|██▍       | 90027/371472 [7:09:24<26:51:41,  2.91it/s]
 24%|██▍       | 90028/371472 [7:09:24<26:03:07,  3.00it/s]
 24%|██▍       | 90029/371472 [7:09:25<24:59:14,  3.13it/s]
 24%|██▍       | 90030/371472 [7:09:25<23:24:18,  3.34it/s]
 24%|██▍       | 90031/371472 [7:09:25<22:29:15,  3.48it/s]
 24%|██▍       | 90032/371472 [7:09:25<22:18:47,  3.50it/s]
 24%|██▍       | 90033/371472 [7:09:26<21:54:38,  3.57it/s]
 24%|██▍       | 90034/371472 [7:09:26<22:07:45,  3.53it/s]
 24%|██▍       | 90035/371472 [7:09:26<21:48:41,  3.58it/s]
 24%|██▍       | 90036/371472 [7:09:27<21:49:42,  3.58it/s]
 24%|██▍       | 90037/371472 [7:09:27<26:03:43,  3.00it/s]
 24%|██▍       | 90038/371472 [7:09:27<24:51:20,  3.15it/s]
 24%|██▍       | 90039/371472 [7:09:28<23:41:46,  3.30it/s]
 24%|██▍       | 90040/371472 [7:09:28<23:26:04,  3.34it/s]
                                                           
{'loss': 3.4923, 'learning_rate': 7.822189661488073e-07, 'epoch': 3.88}

 24%|██▍       | 90040/371472 [7:09:28<23:26:04,  3.34it/s]
 24%|██▍       | 90041/371472 [7:09:28<22:43:43,  3.44it/s]
 24%|██▍       | 90042/371472 [7:09:28<22:24:25,  3.49it/s]
 24%|██▍       | 90043/371472 [7:09:29<22:46:46,  3.43it/s]
 24%|██▍       | 90044/371472 [7:09:29<23:03:02,  3.39it/s]
 24%|██▍       | 90045/371472 [7:09:29<21:49:43,  3.58it/s]
 24%|██▍       | 90046/371472 [7:09:30<22:41:06,  3.45it/s]
 24%|██▍       | 90047/371472 [7:09:30<22:38:44,  3.45it/s]
 24%|██▍       | 90048/371472 [7:09:30<22:20:58,  3.50it/s]
 24%|██▍       | 90049/371472 [7:09:30<21:43:52,  3.60it/s]
 24%|██▍       | 90050/371472 [7:09:31<21:12:22,  3.69it/s]
 24%|██▍       | 90051/371472 [7:09:31<21:01:59,  3.72it/s]
 24%|██▍       | 90052/371472 [7:09:31<20:34:51,  3.80it/s]
 24%|██▍       | 90053/371472 [7:09:31<20:38:00,  3.79it/s]
 24%|██▍       | 90054/371472 [7:09:32<20:25:19,  3.83it/s]
 24%|██▍       | 90055/371472 [7:09:32<20:45:34,  3.77it/s]
 24%|██▍       | 90056/371472 [7:09:32<20:39:54,  3.78it/s]
 24%|██▍       | 90057/371472 [7:09:33<21:47:50,  3.59it/s]
 24%|██▍       | 90058/371472 [7:09:33<21:35:03,  3.62it/s]
 24%|██▍       | 90059/371472 [7:09:33<23:54:05,  3.27it/s]
 24%|██▍       | 90060/371472 [7:09:33<23:16:22,  3.36it/s]
                                                           
{'loss': 3.7335, 'learning_rate': 7.821704841733284e-07, 'epoch': 3.88}

 24%|██▍       | 90060/371472 [7:09:33<23:16:22,  3.36it/s]
 24%|██▍       | 90061/371472 [7:09:34<22:58:17,  3.40it/s]
 24%|██▍       | 90062/371472 [7:09:34<22:37:28,  3.46it/s]
 24%|██▍       | 90063/371472 [7:09:34<21:37:05,  3.62it/s]
 24%|██▍       | 90064/371472 [7:09:35<22:14:35,  3.51it/s]
 24%|██▍       | 90065/371472 [7:09:35<22:33:16,  3.47it/s]
 24%|██▍       | 90066/371472 [7:09:35<21:33:13,  3.63it/s]
 24%|██▍       | 90067/371472 [7:09:35<21:13:13,  3.68it/s]
 24%|██▍       | 90068/371472 [7:09:36<22:12:05,  3.52it/s]
 24%|██▍       | 90069/371472 [7:09:36<21:29:54,  3.64it/s]
 24%|██▍       | 90070/371472 [7:09:36<21:22:41,  3.66it/s]
 24%|██▍       | 90071/371472 [7:09:36<20:44:31,  3.77it/s]
 24%|██▍       | 90072/371472 [7:09:37<20:25:52,  3.83it/s]
 24%|██▍       | 90073/371472 [7:09:37<20:08:21,  3.88it/s]
 24%|██▍       | 90074/371472 [7:09:37<22:41:26,  3.44it/s]
 24%|██▍       | 90075/371472 [7:09:38<22:36:58,  3.46it/s]
 24%|██▍       | 90076/371472 [7:09:38<22:00:04,  3.55it/s]
 24%|██▍       | 90077/371472 [7:09:38<21:12:58,  3.68it/s]
 24%|██▍       | 90078/371472 [7:09:38<21:37:16,  3.62it/s]
 24%|██▍       | 90079/371472 [7:09:39<21:19:41,  3.66it/s]
 24%|██▍       | 90080/371472 [7:09:39<22:44:53,  3.44it/s]
                                                           
{'loss': 3.8102, 'learning_rate': 7.821220021978496e-07, 'epoch': 3.88}

 24%|██▍       | 90080/371472 [7:09:39<22:44:53,  3.44it/s]
 24%|██▍       | 90081/371472 [7:09:39<22:16:33,  3.51it/s]
 24%|██▍       | 90082/371472 [7:09:40<21:25:50,  3.65it/s]
 24%|██▍       | 90083/371472 [7:09:40<21:34:22,  3.62it/s]
 24%|██▍       | 90084/371472 [7:09:40<21:21:48,  3.66it/s]
 24%|██▍       | 90085/371472 [7:09:40<20:45:12,  3.77it/s]
 24%|██▍       | 90086/371472 [7:09:41<21:00:29,  3.72it/s]
 24%|██▍       | 90087/371472 [7:09:41<20:40:13,  3.78it/s]
 24%|██▍       | 90088/371472 [7:09:41<20:39:49,  3.78it/s]
 24%|██▍       | 90089/371472 [7:09:41<21:00:35,  3.72it/s]
 24%|██▍       | 90090/371472 [7:09:42<21:18:13,  3.67it/s]
 24%|██▍       | 90091/371472 [7:09:42<21:04:50,  3.71it/s]
 24%|██▍       | 90092/371472 [7:09:42<20:51:51,  3.75it/s]
 24%|██▍       | 90093/371472 [7:09:42<21:55:49,  3.56it/s]
 24%|██▍       | 90094/371472 [7:09:43<22:06:28,  3.54it/s]
 24%|██▍       | 90095/371472 [7:09:43<22:20:28,  3.50it/s]
 24%|██▍       | 90096/371472 [7:09:43<23:05:12,  3.39it/s]
 24%|██▍       | 90097/371472 [7:09:44<24:31:31,  3.19it/s]
 24%|██▍       | 90098/371472 [7:09:44<23:38:10,  3.31it/s]
 24%|██▍       | 90099/371472 [7:09:44<23:05:45,  3.38it/s]
 24%|██▍       | 90100/371472 [7:09:45<23:12:25,  3.37it/s]
                                                           
{'loss': 3.7155, 'learning_rate': 7.820735202223706e-07, 'epoch': 3.88}

 24%|██▍       | 90100/371472 [7:09:45<23:12:25,  3.37it/s]
 24%|██▍       | 90101/371472 [7:09:45<22:46:27,  3.43it/s]
 24%|██▍       | 90102/371472 [7:09:45<21:46:26,  3.59it/s]
 24%|██▍       | 90103/371472 [7:09:45<21:11:24,  3.69it/s]
 24%|██▍       | 90104/371472 [7:09:46<20:48:54,  3.75it/s]
 24%|██▍       | 90105/371472 [7:09:46<22:19:53,  3.50it/s]
 24%|██▍       | 90106/371472 [7:09:46<24:23:01,  3.21it/s]
 24%|██▍       | 90107/371472 [7:09:47<23:44:53,  3.29it/s]
 24%|██▍       | 90108/371472 [7:09:47<25:59:15,  3.01it/s]
 24%|██▍       | 90109/371472 [7:09:47<24:33:01,  3.18it/s]
 24%|██▍       | 90110/371472 [7:09:48<23:19:48,  3.35it/s]
 24%|██▍       | 90111/371472 [7:09:48<23:34:01,  3.32it/s]
 24%|██▍       | 90112/371472 [7:09:48<22:43:30,  3.44it/s]
 24%|██▍       | 90113/371472 [7:09:48<22:34:27,  3.46it/s]
 24%|██▍       | 90114/371472 [7:09:49<23:43:24,  3.29it/s]
 24%|██▍       | 90115/371472 [7:09:49<25:22:12,  3.08it/s]
 24%|██▍       | 90116/371472 [7:09:49<24:22:31,  3.21it/s]
 24%|██▍       | 90117/371472 [7:09:50<23:08:01,  3.38it/s]
 24%|██▍       | 90118/371472 [7:09:50<22:28:58,  3.48it/s]
 24%|██▍       | 90119/371472 [7:09:50<22:17:56,  3.50it/s]
 24%|██▍       | 90120/371472 [7:09:50<21:04:34,  3.71it/s]
                                                           
{'loss': 3.7802, 'learning_rate': 7.820250382468916e-07, 'epoch': 3.88}

 24%|██▍       | 90120/371472 [7:09:50<21:04:34,  3.71it/s]
 24%|██▍       | 90121/371472 [7:09:51<22:11:27,  3.52it/s]
 24%|██▍       | 90122/371472 [7:09:51<21:30:51,  3.63it/s]
 24%|██▍       | 90123/371472 [7:09:51<20:57:31,  3.73it/s]
 24%|██▍       | 90124/371472 [7:09:52<22:39:14,  3.45it/s]
 24%|██▍       | 90125/371472 [7:09:52<22:38:41,  3.45it/s]
 24%|██▍       | 90126/371472 [7:09:52<21:46:33,  3.59it/s]
 24%|██▍       | 90127/371472 [7:09:52<20:58:35,  3.73it/s]
 24%|██▍       | 90128/371472 [7:09:53<21:11:31,  3.69it/s]
 24%|██▍       | 90129/371472 [7:09:53<21:23:04,  3.65it/s]
 24%|██▍       | 90130/371472 [7:09:53<21:19:45,  3.66it/s]
 24%|██▍       | 90131/371472 [7:09:54<21:21:24,  3.66it/s]
 24%|██▍       | 90132/371472 [7:09:54<21:22:01,  3.66it/s]
 24%|██▍       | 90133/371472 [7:09:54<22:25:38,  3.48it/s]
 24%|██▍       | 90134/371472 [7:09:54<22:31:59,  3.47it/s]
 24%|██▍       | 90135/371472 [7:09:55<21:39:10,  3.61it/s]
 24%|██▍       | 90136/371472 [7:09:55<21:35:01,  3.62it/s]
 24%|██▍       | 90137/371472 [7:09:55<21:07:35,  3.70it/s]
 24%|██▍       | 90138/371472 [7:09:56<22:43:54,  3.44it/s]
 24%|██▍       | 90139/371472 [7:09:56<22:25:30,  3.48it/s]
 24%|██▍       | 90140/371472 [7:09:56<22:50:52,  3.42it/s]
                                                           
{'loss': 3.7528, 'learning_rate': 7.819765562714128e-07, 'epoch': 3.88}

 24%|██▍       | 90140/371472 [7:09:56<22:50:52,  3.42it/s]
 24%|██▍       | 90141/371472 [7:09:56<22:15:11,  3.51it/s]
 24%|██▍       | 90142/371472 [7:09:57<21:53:52,  3.57it/s]
 24%|██▍       | 90143/371472 [7:09:57<22:01:18,  3.55it/s]
 24%|██▍       | 90144/371472 [7:09:57<21:53:22,  3.57it/s]
 24%|██▍       | 90145/371472 [7:09:57<21:51:11,  3.58it/s]
 24%|██▍       | 90146/371472 [7:09:58<22:43:40,  3.44it/s]
 24%|██▍       | 90147/371472 [7:09:58<21:36:27,  3.62it/s]
 24%|██▍       | 90148/371472 [7:09:58<21:48:24,  3.58it/s]
 24%|██▍       | 90149/371472 [7:09:59<23:26:49,  3.33it/s]
 24%|██▍       | 90150/371472 [7:09:59<22:37:25,  3.45it/s]
 24%|██▍       | 90151/371472 [7:09:59<21:49:57,  3.58it/s]
 24%|██▍       | 90152/371472 [7:09:59<20:54:28,  3.74it/s]
 24%|██▍       | 90153/371472 [7:10:00<20:48:27,  3.76it/s]
 24%|██▍       | 90154/371472 [7:10:00<21:05:57,  3.70it/s]
 24%|██▍       | 90155/371472 [7:10:00<21:56:11,  3.56it/s]
 24%|██▍       | 90156/371472 [7:10:01<21:31:36,  3.63it/s]
 24%|██▍       | 90157/371472 [7:10:01<20:47:00,  3.76it/s]
 24%|██▍       | 90158/371472 [7:10:01<21:09:14,  3.69it/s]
 24%|██▍       | 90159/371472 [7:10:01<22:21:57,  3.49it/s]
 24%|██▍       | 90160/371472 [7:10:02<22:28:57,  3.48it/s]
                                                           
{'loss': 3.9415, 'learning_rate': 7.81928074295934e-07, 'epoch': 3.88}

 24%|██▍       | 90160/371472 [7:10:02<22:28:57,  3.48it/s]
 24%|██▍       | 90161/371472 [7:10:02<24:00:14,  3.26it/s]
 24%|██▍       | 90162/371472 [7:10:02<23:17:39,  3.35it/s]
 24%|██▍       | 90163/371472 [7:10:03<22:22:26,  3.49it/s]
 24%|██▍       | 90164/371472 [7:10:03<22:14:59,  3.51it/s]
 24%|██▍       | 90165/371472 [7:10:03<21:35:50,  3.62it/s]
 24%|██▍       | 90166/371472 [7:10:03<21:52:07,  3.57it/s]
 24%|██▍       | 90167/371472 [7:10:04<23:44:27,  3.29it/s]
 24%|██▍       | 90168/371472 [7:10:04<23:12:56,  3.37it/s]
 24%|██▍       | 90169/371472 [7:10:04<22:23:47,  3.49it/s]
 24%|██▍       | 90170/371472 [7:10:05<21:19:16,  3.66it/s]
 24%|██▍       | 90171/371472 [7:10:05<21:38:52,  3.61it/s]
 24%|██▍       | 90172/371472 [7:10:05<20:46:50,  3.76it/s]
 24%|██▍       | 90173/371472 [7:10:05<20:48:29,  3.76it/s]
 24%|██▍       | 90174/371472 [7:10:06<20:42:02,  3.77it/s]
 24%|██▍       | 90175/371472 [7:10:06<20:31:16,  3.81it/s]
 24%|██▍       | 90176/371472 [7:10:06<20:39:34,  3.78it/s]
 24%|██▍       | 90177/371472 [7:10:06<21:52:09,  3.57it/s]
 24%|██▍       | 90178/371472 [7:10:07<22:16:55,  3.51it/s]
 24%|██▍       | 90179/371472 [7:10:07<21:45:34,  3.59it/s]
 24%|██▍       | 90180/371472 [7:10:07<20:55:19,  3.73it/s]
                                                           
{'loss': 3.947, 'learning_rate': 7.818795923204551e-07, 'epoch': 3.88}

 24%|██▍       | 90180/371472 [7:10:07<20:55:19,  3.73it/s]
 24%|██▍       | 90181/371472 [7:10:07<20:35:18,  3.80it/s]
 24%|██▍       | 90182/371472 [7:10:08<21:52:21,  3.57it/s]
 24%|██▍       | 90183/371472 [7:10:08<21:43:14,  3.60it/s]
 24%|██▍       | 90184/371472 [7:10:08<21:35:20,  3.62it/s]
 24%|██▍       | 90185/371472 [7:10:09<21:02:36,  3.71it/s]
 24%|██▍       | 90186/371472 [7:10:09<20:56:43,  3.73it/s]
 24%|██▍       | 90187/371472 [7:10:09<21:23:00,  3.65it/s]
 24%|██▍       | 90188/371472 [7:10:09<22:11:18,  3.52it/s]
 24%|██▍       | 90189/371472 [7:10:10<23:05:54,  3.38it/s]
 24%|██▍       | 90190/371472 [7:10:10<22:54:59,  3.41it/s]
 24%|██▍       | 90191/371472 [7:10:10<23:58:01,  3.26it/s]
 24%|██▍       | 90192/371472 [7:10:11<23:06:31,  3.38it/s]
 24%|██▍       | 90193/371472 [7:10:11<22:04:02,  3.54it/s]
 24%|██▍       | 90194/371472 [7:10:11<22:02:39,  3.54it/s]
 24%|██▍       | 90195/371472 [7:10:11<21:42:43,  3.60it/s]
 24%|██▍       | 90196/371472 [7:10:12<21:39:13,  3.61it/s]
 24%|██▍       | 90197/371472 [7:10:12<21:55:38,  3.56it/s]
 24%|██▍       | 90198/371472 [7:10:12<21:13:09,  3.68it/s]
 24%|██▍       | 90199/371472 [7:10:13<21:00:13,  3.72it/s]
 24%|██▍       | 90200/371472 [7:10:13<21:28:12,  3.64it/s]
                                                           
{'loss': 3.639, 'learning_rate': 7.818311103449761e-07, 'epoch': 3.89}

 24%|██▍       | 90200/371472 [7:10:13<21:28:12,  3.64it/s]
 24%|██▍       | 90201/371472 [7:10:13<22:58:49,  3.40it/s]
 24%|██▍       | 90202/371472 [7:10:13<23:19:30,  3.35it/s]
 24%|██▍       | 90203/371472 [7:10:14<22:38:03,  3.45it/s]
 24%|██▍       | 90204/371472 [7:10:14<21:38:49,  3.61it/s]
 24%|██▍       | 90205/371472 [7:10:14<21:21:34,  3.66it/s]
 24%|██▍       | 90206/371472 [7:10:15<22:41:30,  3.44it/s]
 24%|██▍       | 90207/371472 [7:10:15<22:08:28,  3.53it/s]
 24%|██▍       | 90208/371472 [7:10:15<24:41:25,  3.16it/s]
 24%|██▍       | 90209/371472 [7:10:16<24:04:35,  3.24it/s]
 24%|██▍       | 90210/371472 [7:10:16<22:28:36,  3.48it/s]
 24%|██▍       | 90211/371472 [7:10:16<21:23:34,  3.65it/s]
 24%|██▍       | 90212/371472 [7:10:16<20:58:56,  3.72it/s]
 24%|██▍       | 90213/371472 [7:10:17<21:25:34,  3.65it/s]
 24%|██▍       | 90214/371472 [7:10:17<21:21:19,  3.66it/s]
 24%|██▍       | 90215/371472 [7:10:17<21:38:50,  3.61it/s]
 24%|██▍       | 90216/371472 [7:10:17<22:32:09,  3.47it/s]
 24%|██▍       | 90217/371472 [7:10:18<21:51:41,  3.57it/s]
 24%|██▍       | 90218/371472 [7:10:18<21:58:12,  3.56it/s]
 24%|██▍       | 90219/371472 [7:10:18<22:19:23,  3.50it/s]
 24%|██▍       | 90220/371472 [7:10:19<22:38:08,  3.45it/s]
                                                           
{'loss': 4.0083, 'learning_rate': 7.817826283694972e-07, 'epoch': 3.89}

 24%|██▍       | 90220/371472 [7:10:19<22:38:08,  3.45it/s]
 24%|██▍       | 90221/371472 [7:10:19<22:37:07,  3.45it/s]
 24%|██▍       | 90222/371472 [7:10:19<22:13:18,  3.52it/s]
 24%|██▍       | 90223/371472 [7:10:19<22:04:14,  3.54it/s]
 24%|██▍       | 90224/371472 [7:10:20<22:17:39,  3.50it/s]
 24%|██▍       | 90225/371472 [7:10:20<24:51:29,  3.14it/s]
 24%|██▍       | 90226/371472 [7:10:20<23:46:13,  3.29it/s]
 24%|██▍       | 90227/371472 [7:10:21<22:40:50,  3.44it/s]
 24%|██▍       | 90228/371472 [7:10:21<22:12:10,  3.52it/s]
 24%|██▍       | 90229/371472 [7:10:21<21:45:28,  3.59it/s]
 24%|██▍       | 90230/371472 [7:10:21<21:27:26,  3.64it/s]
 24%|██▍       | 90231/371472 [7:10:22<22:09:13,  3.53it/s]
 24%|██▍       | 90232/371472 [7:10:22<21:43:58,  3.59it/s]
 24%|██▍       | 90233/371472 [7:10:22<21:58:28,  3.56it/s]
 24%|██▍       | 90234/371472 [7:10:23<22:20:39,  3.50it/s]
 24%|██▍       | 90235/371472 [7:10:23<21:38:48,  3.61it/s]
 24%|██▍       | 90236/371472 [7:10:23<21:25:16,  3.65it/s]
 24%|██▍       | 90237/371472 [7:10:23<21:15:15,  3.68it/s]
 24%|██▍       | 90238/371472 [7:10:24<21:20:25,  3.66it/s]
 24%|██▍       | 90239/371472 [7:10:24<22:26:15,  3.48it/s]
 24%|██▍       | 90240/371472 [7:10:24<21:34:33,  3.62it/s]
                                                           
{'loss': 3.925, 'learning_rate': 7.817341463940184e-07, 'epoch': 3.89}

 24%|██▍       | 90240/371472 [7:10:24<21:34:33,  3.62it/s]
 24%|██▍       | 90241/371472 [7:10:25<21:39:33,  3.61it/s]
 24%|██▍       | 90242/371472 [7:10:25<21:57:05,  3.56it/s]
 24%|██▍       | 90243/371472 [7:10:25<22:54:32,  3.41it/s]
 24%|██▍       | 90244/371472 [7:10:25<22:27:34,  3.48it/s]
 24%|██▍       | 90245/371472 [7:10:26<22:47:51,  3.43it/s]
 24%|██▍       | 90246/371472 [7:10:26<21:37:17,  3.61it/s]
 24%|██▍       | 90247/371472 [7:10:26<22:13:52,  3.51it/s]
 24%|██▍       | 90248/371472 [7:10:27<23:39:58,  3.30it/s]
 24%|██▍       | 90249/371472 [7:10:27<22:40:36,  3.44it/s]
 24%|██▍       | 90250/371472 [7:10:27<23:04:04,  3.39it/s]
 24%|██▍       | 90251/371472 [7:10:27<22:48:38,  3.42it/s]
 24%|██▍       | 90252/371472 [7:10:28<21:56:59,  3.56it/s]
 24%|██▍       | 90253/371472 [7:10:28<21:09:28,  3.69it/s]
 24%|██▍       | 90254/371472 [7:10:28<22:48:48,  3.42it/s]
 24%|██▍       | 90255/371472 [7:10:29<23:57:18,  3.26it/s]
 24%|██▍       | 90256/371472 [7:10:29<22:21:22,  3.49it/s]
 24%|██▍       | 90257/371472 [7:10:29<22:18:09,  3.50it/s]
 24%|██▍       | 90258/371472 [7:10:30<25:50:33,  3.02it/s]
 24%|██▍       | 90259/371472 [7:10:30<26:07:36,  2.99it/s]
 24%|██▍       | 90260/371472 [7:10:30<24:04:49,  3.24it/s]
                                                           
{'loss': 3.8864, 'learning_rate': 7.816856644185395e-07, 'epoch': 3.89}

 24%|██▍       | 90260/371472 [7:10:30<24:04:49,  3.24it/s]
 24%|██▍       | 90261/371472 [7:10:30<23:21:25,  3.34it/s]
 24%|██▍       | 90262/371472 [7:10:31<22:39:17,  3.45it/s]
 24%|██▍       | 90263/371472 [7:10:31<22:21:13,  3.49it/s]
 24%|██▍       | 90264/371472 [7:10:31<22:05:20,  3.54it/s]
 24%|██▍       | 90265/371472 [7:10:32<22:11:52,  3.52it/s]
 24%|██▍       | 90266/371472 [7:10:32<22:03:49,  3.54it/s]
 24%|██▍       | 90267/371472 [7:10:32<21:11:40,  3.69it/s]
 24%|██▍       | 90268/371472 [7:10:32<22:42:26,  3.44it/s]
 24%|██▍       | 90269/371472 [7:10:33<21:20:43,  3.66it/s]
 24%|██▍       | 90270/371472 [7:10:33<21:59:02,  3.55it/s]
 24%|██▍       | 90271/371472 [7:10:33<21:17:42,  3.67it/s]
 24%|██▍       | 90272/371472 [7:10:34<22:55:07,  3.41it/s]
 24%|██▍       | 90273/371472 [7:10:34<22:30:55,  3.47it/s]
 24%|██▍       | 90274/371472 [7:10:34<21:37:45,  3.61it/s]
 24%|██▍       | 90275/371472 [7:10:34<22:00:21,  3.55it/s]
 24%|██▍       | 90276/371472 [7:10:35<21:21:39,  3.66it/s]
 24%|██▍       | 90277/371472 [7:10:35<20:43:24,  3.77it/s]
 24%|██▍       | 90278/371472 [7:10:35<21:39:01,  3.61it/s]
 24%|██▍       | 90279/371472 [7:10:36<22:48:36,  3.42it/s]
 24%|██▍       | 90280/371472 [7:10:36<21:36:29,  3.61it/s]
                                                           
{'loss': 3.8101, 'learning_rate': 7.816371824430605e-07, 'epoch': 3.89}

 24%|██▍       | 90280/371472 [7:10:36<21:36:29,  3.61it/s]
 24%|██▍       | 90281/371472 [7:10:36<21:50:08,  3.58it/s]
 24%|██▍       | 90282/371472 [7:10:36<22:19:46,  3.50it/s]
 24%|██▍       | 90283/371472 [7:10:37<22:58:07,  3.40it/s]
 24%|██▍       | 90284/371472 [7:10:37<22:37:37,  3.45it/s]
 24%|██▍       | 90285/371472 [7:10:37<21:53:31,  3.57it/s]
 24%|██▍       | 90286/371472 [7:10:37<21:25:02,  3.65it/s]
 24%|██▍       | 90287/371472 [7:10:38<22:02:30,  3.54it/s]
 24%|██▍       | 90288/371472 [7:10:38<21:48:53,  3.58it/s]
 24%|██▍       | 90289/371472 [7:10:38<21:56:16,  3.56it/s]
 24%|██▍       | 90290/371472 [7:10:39<23:16:57,  3.35it/s]
 24%|██▍       | 90291/371472 [7:10:39<22:24:27,  3.49it/s]
 24%|██▍       | 90292/371472 [7:10:39<21:46:50,  3.59it/s]
 24%|██▍       | 90293/371472 [7:10:39<21:20:26,  3.66it/s]
 24%|██▍       | 90294/371472 [7:10:40<21:42:06,  3.60it/s]
 24%|██▍       | 90295/371472 [7:10:40<22:20:06,  3.50it/s]
 24%|██▍       | 90296/371472 [7:10:40<23:24:37,  3.34it/s]
 24%|██▍       | 90297/371472 [7:10:41<25:07:02,  3.11it/s]
 24%|██▍       | 90298/371472 [7:10:41<24:12:36,  3.23it/s]
 24%|██▍       | 90299/371472 [7:10:41<23:15:21,  3.36it/s]
 24%|██▍       | 90300/371472 [7:10:42<22:03:35,  3.54it/s]
                                                           
{'loss': 3.9873, 'learning_rate': 7.815887004675817e-07, 'epoch': 3.89}

 24%|██▍       | 90300/371472 [7:10:42<22:03:35,  3.54it/s]
 24%|██▍       | 90301/371472 [7:10:42<21:29:21,  3.63it/s]
 24%|██▍       | 90302/371472 [7:10:42<20:39:57,  3.78it/s]
 24%|██▍       | 90303/371472 [7:10:42<21:42:08,  3.60it/s]
 24%|██▍       | 90304/371472 [7:10:43<21:09:43,  3.69it/s]
 24%|██▍       | 90305/371472 [7:10:43<21:29:36,  3.63it/s]
 24%|██▍       | 90306/371472 [7:10:43<22:17:20,  3.50it/s]
 24%|██▍       | 90307/371472 [7:10:43<22:27:57,  3.48it/s]
 24%|██▍       | 90308/371472 [7:10:44<22:03:13,  3.54it/s]
 24%|██▍       | 90309/371472 [7:10:44<22:34:12,  3.46it/s]
 24%|██▍       | 90310/371472 [7:10:44<21:48:25,  3.58it/s]
 24%|██▍       | 90311/371472 [7:10:45<23:07:47,  3.38it/s]
 24%|██▍       | 90312/371472 [7:10:45<22:16:27,  3.51it/s]
 24%|██▍       | 90313/371472 [7:10:45<22:17:02,  3.50it/s]
 24%|██▍       | 90314/371472 [7:10:45<22:17:30,  3.50it/s]
 24%|██▍       | 90315/371472 [7:10:46<21:27:58,  3.64it/s]
 24%|██▍       | 90316/371472 [7:10:46<21:37:47,  3.61it/s]
 24%|██▍       | 90317/371472 [7:10:46<21:04:36,  3.71it/s]
 24%|██▍       | 90318/371472 [7:10:47<21:18:17,  3.67it/s]
 24%|██▍       | 90319/371472 [7:10:47<22:34:19,  3.46it/s]
 24%|██▍       | 90320/371472 [7:10:47<22:05:11,  3.54it/s]
                                                           
{'loss': 3.7457, 'learning_rate': 7.815402184921028e-07, 'epoch': 3.89}

 24%|██▍       | 90320/371472 [7:10:47<22:05:11,  3.54it/s]
 24%|██▍       | 90321/371472 [7:10:47<24:02:11,  3.25it/s]
 24%|██▍       | 90322/371472 [7:10:48<23:25:06,  3.33it/s]
 24%|██▍       | 90323/371472 [7:10:48<25:22:52,  3.08it/s]
 24%|██▍       | 90324/371472 [7:10:48<24:31:59,  3.18it/s]
 24%|██▍       | 90325/371472 [7:10:49<24:23:07,  3.20it/s]
 24%|██▍       | 90326/371472 [7:10:49<23:50:30,  3.28it/s]
 24%|██▍       | 90327/371472 [7:10:49<23:51:43,  3.27it/s]
 24%|██▍       | 90328/371472 [7:10:50<23:43:44,  3.29it/s]
 24%|██▍       | 90329/371472 [7:10:50<22:14:54,  3.51it/s]
 24%|██▍       | 90330/371472 [7:10:50<23:08:27,  3.37it/s]
 24%|██▍       | 90331/371472 [7:10:50<22:24:33,  3.48it/s]
 24%|██▍       | 90332/371472 [7:10:51<21:25:42,  3.64it/s]
 24%|██▍       | 90333/371472 [7:10:51<21:00:45,  3.72it/s]
 24%|██▍       | 90334/371472 [7:10:51<20:34:36,  3.80it/s]
 24%|██▍       | 90335/371472 [7:10:52<21:28:41,  3.64it/s]
 24%|██▍       | 90336/371472 [7:10:52<21:03:20,  3.71it/s]
 24%|██▍       | 90337/371472 [7:10:52<20:43:21,  3.77it/s]
 24%|██▍       | 90338/371472 [7:10:52<21:04:25,  3.71it/s]
 24%|██▍       | 90339/371472 [7:10:53<20:59:26,  3.72it/s]
 24%|██▍       | 90340/371472 [7:10:53<21:53:29,  3.57it/s]
                                                           
{'loss': 3.925, 'learning_rate': 7.814917365166239e-07, 'epoch': 3.89}

 24%|██▍       | 90340/371472 [7:10:53<21:53:29,  3.57it/s]
 24%|██▍       | 90341/371472 [7:10:53<21:55:27,  3.56it/s]
 24%|██▍       | 90342/371472 [7:10:53<22:23:35,  3.49it/s]
 24%|██▍       | 90343/371472 [7:10:54<21:23:26,  3.65it/s]
 24%|██▍       | 90344/371472 [7:10:54<21:02:13,  3.71it/s]
 24%|██▍       | 90345/371472 [7:10:54<21:52:35,  3.57it/s]
 24%|██▍       | 90346/371472 [7:10:55<20:54:43,  3.73it/s]
 24%|██▍       | 90347/371472 [7:10:55<20:16:08,  3.85it/s]
 24%|██▍       | 90348/371472 [7:10:55<20:36:43,  3.79it/s]
 24%|██▍       | 90349/371472 [7:10:55<21:40:21,  3.60it/s]
 24%|██▍       | 90350/371472 [7:10:56<21:05:02,  3.70it/s]
 24%|██▍       | 90351/371472 [7:10:56<21:38:59,  3.61it/s]
 24%|██▍       | 90352/371472 [7:10:56<22:10:54,  3.52it/s]
 24%|██▍       | 90353/371472 [7:10:56<22:10:35,  3.52it/s]
 24%|██▍       | 90354/371472 [7:10:57<22:05:56,  3.53it/s]
 24%|██▍       | 90355/371472 [7:10:57<22:59:55,  3.40it/s]
 24%|██▍       | 90356/371472 [7:10:57<22:17:00,  3.50it/s]
 24%|██▍       | 90357/371472 [7:10:58<22:45:46,  3.43it/s]
 24%|██▍       | 90358/371472 [7:10:58<22:31:26,  3.47it/s]
 24%|██▍       | 90359/371472 [7:10:58<22:10:09,  3.52it/s]
 24%|██▍       | 90360/371472 [7:10:58<21:30:53,  3.63it/s]
                                                           
{'loss': 3.6213, 'learning_rate': 7.814432545411449e-07, 'epoch': 3.89}

 24%|██▍       | 90360/371472 [7:10:58<21:30:53,  3.63it/s]
 24%|██▍       | 90361/371472 [7:10:59<21:25:54,  3.64it/s]
 24%|██▍       | 90362/371472 [7:10:59<21:03:16,  3.71it/s]
 24%|██▍       | 90363/371472 [7:10:59<20:29:51,  3.81it/s]
 24%|██▍       | 90364/371472 [7:10:59<19:41:25,  3.97it/s]
 24%|██▍       | 90365/371472 [7:11:00<21:40:05,  3.60it/s]
 24%|██▍       | 90366/371472 [7:11:00<21:54:36,  3.56it/s]
 24%|██▍       | 90367/371472 [7:11:00<20:44:47,  3.76it/s]
 24%|██▍       | 90368/371472 [7:11:01<20:53:55,  3.74it/s]
 24%|██▍       | 90369/371472 [7:11:01<23:57:59,  3.26it/s]
 24%|██▍       | 90370/371472 [7:11:01<24:56:40,  3.13it/s]
 24%|██▍       | 90371/371472 [7:11:02<25:28:49,  3.06it/s]
 24%|██▍       | 90372/371472 [7:11:02<24:23:18,  3.20it/s]
 24%|██▍       | 90373/371472 [7:11:02<24:28:29,  3.19it/s]
 24%|██▍       | 90374/371472 [7:11:03<23:00:11,  3.39it/s]
 24%|██▍       | 90375/371472 [7:11:03<23:50:37,  3.27it/s]
 24%|██▍       | 90376/371472 [7:11:03<23:30:07,  3.32it/s]
 24%|██▍       | 90377/371472 [7:11:03<23:27:09,  3.33it/s]
 24%|██▍       | 90378/371472 [7:11:04<23:34:14,  3.31it/s]
 24%|██▍       | 90379/371472 [7:11:04<22:32:54,  3.46it/s]
 24%|██▍       | 90380/371472 [7:11:04<22:16:12,  3.51it/s]
                                                           
{'loss': 3.6758, 'learning_rate': 7.813947725656661e-07, 'epoch': 3.89}

 24%|██▍       | 90380/371472 [7:11:04<22:16:12,  3.51it/s]
 24%|██▍       | 90381/371472 [7:11:05<22:36:16,  3.45it/s]
 24%|██▍       | 90382/371472 [7:11:05<23:11:57,  3.37it/s]
 24%|██▍       | 90383/371472 [7:11:05<22:51:49,  3.42it/s]
 24%|██▍       | 90384/371472 [7:11:05<22:37:28,  3.45it/s]
 24%|██▍       | 90385/371472 [7:11:06<23:02:37,  3.39it/s]
 24%|██▍       | 90386/371472 [7:11:06<22:26:08,  3.48it/s]
 24%|██▍       | 90387/371472 [7:11:06<21:51:57,  3.57it/s]
 24%|██▍       | 90388/371472 [7:11:07<21:17:06,  3.67it/s]
 24%|██▍       | 90389/371472 [7:11:07<21:42:30,  3.60it/s]
 24%|██▍       | 90390/371472 [7:11:07<21:31:29,  3.63it/s]
 24%|██▍       | 90391/371472 [7:11:07<22:30:38,  3.47it/s]
 24%|██▍       | 90392/371472 [7:11:08<22:24:16,  3.48it/s]
 24%|██▍       | 90393/371472 [7:11:08<23:54:25,  3.27it/s]
 24%|██▍       | 90394/371472 [7:11:08<23:06:51,  3.38it/s]
 24%|██▍       | 90395/371472 [7:11:09<22:17:09,  3.50it/s]
 24%|██▍       | 90396/371472 [7:11:09<22:41:05,  3.44it/s]
 24%|██▍       | 90397/371472 [7:11:09<24:12:14,  3.23it/s]
 24%|██▍       | 90398/371472 [7:11:10<24:42:38,  3.16it/s]
 24%|██▍       | 90399/371472 [7:11:10<24:14:22,  3.22it/s]
 24%|██▍       | 90400/371472 [7:11:10<22:50:49,  3.42it/s]
                                                           
{'loss': 3.7121, 'learning_rate': 7.813462905901872e-07, 'epoch': 3.89}

 24%|██▍       | 90400/371472 [7:11:10<22:50:49,  3.42it/s]
 24%|██▍       | 90401/371472 [7:11:10<22:37:38,  3.45it/s]
 24%|██▍       | 90402/371472 [7:11:11<22:45:09,  3.43it/s]
 24%|██▍       | 90403/371472 [7:11:11<21:36:25,  3.61it/s]
 24%|██▍       | 90404/371472 [7:11:11<21:21:15,  3.66it/s]
 24%|██▍       | 90405/371472 [7:11:11<20:56:35,  3.73it/s]
 24%|██▍       | 90406/371472 [7:11:12<20:04:05,  3.89it/s]
 24%|██▍       | 90407/371472 [7:11:12<20:36:01,  3.79it/s]
 24%|██▍       | 90408/371472 [7:11:12<20:08:30,  3.88it/s]
 24%|██▍       | 90409/371472 [7:11:13<21:40:56,  3.60it/s]
 24%|██▍       | 90410/371472 [7:11:13<20:51:30,  3.74it/s]
 24%|██▍       | 90411/371472 [7:11:13<21:06:41,  3.70it/s]
 24%|██▍       | 90412/371472 [7:11:13<22:19:16,  3.50it/s]
 24%|██▍       | 90413/371472 [7:11:14<22:15:28,  3.51it/s]
 24%|██▍       | 90414/371472 [7:11:14<23:03:13,  3.39it/s]
 24%|██▍       | 90415/371472 [7:11:14<23:18:28,  3.35it/s]
 24%|██▍       | 90416/371472 [7:11:15<22:41:38,  3.44it/s]
 24%|██▍       | 90417/371472 [7:11:15<22:15:57,  3.51it/s]
 24%|██▍       | 90418/371472 [7:11:15<22:07:21,  3.53it/s]
 24%|██▍       | 90419/371472 [7:11:15<21:41:04,  3.60it/s]
 24%|██▍       | 90420/371472 [7:11:16<21:33:23,  3.62it/s]
                                                           
{'loss': 3.8724, 'learning_rate': 7.812978086147084e-07, 'epoch': 3.89}

 24%|██▍       | 90420/371472 [7:11:16<21:33:23,  3.62it/s]
 24%|██▍       | 90421/371472 [7:11:16<21:19:06,  3.66it/s]
 24%|██▍       | 90422/371472 [7:11:16<21:01:48,  3.71it/s]
 24%|██▍       | 90423/371472 [7:11:16<20:48:51,  3.75it/s]
 24%|██▍       | 90424/371472 [7:11:17<22:08:58,  3.52it/s]
 24%|██▍       | 90425/371472 [7:11:17<21:46:28,  3.59it/s]
 24%|██▍       | 90426/371472 [7:11:17<21:41:12,  3.60it/s]
 24%|██▍       | 90427/371472 [7:11:18<21:38:52,  3.61it/s]
 24%|██▍       | 90428/371472 [7:11:18<22:59:13,  3.40it/s]
 24%|██▍       | 90429/371472 [7:11:18<21:40:16,  3.60it/s]
 24%|██▍       | 90430/371472 [7:11:18<21:01:50,  3.71it/s]
 24%|██▍       | 90431/371472 [7:11:19<20:56:13,  3.73it/s]
 24%|██▍       | 90432/371472 [7:11:19<22:05:52,  3.53it/s]
 24%|██▍       | 90433/371472 [7:11:19<21:44:11,  3.59it/s]
 24%|██▍       | 90434/371472 [7:11:20<21:44:17,  3.59it/s]
 24%|██▍       | 90435/371472 [7:11:20<21:00:50,  3.71it/s]
 24%|██▍       | 90436/371472 [7:11:20<22:58:39,  3.40it/s]
 24%|██▍       | 90437/371472 [7:11:20<23:14:24,  3.36it/s]
 24%|██▍       | 90438/371472 [7:11:21<24:49:54,  3.14it/s]
 24%|██▍       | 90439/371472 [7:11:21<25:56:54,  3.01it/s]
 24%|██▍       | 90440/371472 [7:11:22<25:18:43,  3.08it/s]
                                                           
{'loss': 3.8405, 'learning_rate': 7.812493266392294e-07, 'epoch': 3.9}

 24%|██▍       | 90440/371472 [7:11:22<25:18:43,  3.08it/s]
 24%|██▍       | 90441/371472 [7:11:22<23:19:17,  3.35it/s]
 24%|██▍       | 90442/371472 [7:11:22<24:25:43,  3.20it/s]
 24%|██▍       | 90443/371472 [7:11:22<23:20:49,  3.34it/s]
 24%|██▍       | 90444/371472 [7:11:23<23:16:57,  3.35it/s]
 24%|██▍       | 90445/371472 [7:11:23<22:43:27,  3.44it/s]
 24%|██▍       | 90446/371472 [7:11:23<22:04:04,  3.54it/s]
 24%|██▍       | 90447/371472 [7:11:23<22:20:42,  3.49it/s]
 24%|██▍       | 90448/371472 [7:11:24<23:02:33,  3.39it/s]
 24%|██▍       | 90449/371472 [7:11:24<23:43:45,  3.29it/s]
 24%|██▍       | 90450/371472 [7:11:24<23:28:02,  3.33it/s]
 24%|██▍       | 90451/371472 [7:11:25<22:20:43,  3.49it/s]
 24%|██▍       | 90452/371472 [7:11:25<21:50:18,  3.57it/s]
 24%|██▍       | 90453/371472 [7:11:25<21:08:19,  3.69it/s]
 24%|██▍       | 90454/371472 [7:11:25<20:41:50,  3.77it/s]
 24%|██▍       | 90455/371472 [7:11:26<20:44:16,  3.76it/s]
 24%|██▍       | 90456/371472 [7:11:26<22:11:55,  3.52it/s]
 24%|██▍       | 90457/371472 [7:11:26<22:55:57,  3.40it/s]
 24%|██▍       | 90458/371472 [7:11:27<21:59:23,  3.55it/s]
 24%|██▍       | 90459/371472 [7:11:27<22:13:46,  3.51it/s]
 24%|██▍       | 90460/371472 [7:11:27<22:24:06,  3.48it/s]
                                                           
{'loss': 3.8385, 'learning_rate': 7.812008446637506e-07, 'epoch': 3.9}

 24%|██▍       | 90460/371472 [7:11:27<22:24:06,  3.48it/s]
 24%|██▍       | 90461/371472 [7:11:27<22:31:16,  3.47it/s]
 24%|██▍       | 90462/371472 [7:11:28<23:26:09,  3.33it/s]
 24%|██▍       | 90463/371472 [7:11:28<24:19:53,  3.21it/s]
 24%|██▍       | 90464/371472 [7:11:28<23:56:37,  3.26it/s]
 24%|██▍       | 90465/371472 [7:11:29<23:22:17,  3.34it/s]
 24%|██▍       | 90466/371472 [7:11:29<23:02:52,  3.39it/s]
 24%|██▍       | 90467/371472 [7:11:29<22:11:54,  3.52it/s]
 24%|██▍       | 90468/371472 [7:11:30<22:14:25,  3.51it/s]
 24%|██▍       | 90469/371472 [7:11:30<22:00:59,  3.55it/s]
 24%|██▍       | 90470/371472 [7:11:30<21:58:09,  3.55it/s]
 24%|██▍       | 90471/371472 [7:11:30<24:01:43,  3.25it/s]
 24%|██▍       | 90472/371472 [7:11:31<23:27:35,  3.33it/s]
 24%|██▍       | 90473/371472 [7:11:31<22:49:46,  3.42it/s]
 24%|██▍       | 90474/371472 [7:11:31<22:09:21,  3.52it/s]
 24%|██▍       | 90475/371472 [7:11:32<21:27:01,  3.64it/s]
 24%|██▍       | 90476/371472 [7:11:32<21:14:12,  3.68it/s]
 24%|██▍       | 90477/371472 [7:11:32<21:32:18,  3.62it/s]
 24%|██▍       | 90478/371472 [7:11:32<22:39:19,  3.45it/s]
 24%|██▍       | 90479/371472 [7:11:33<23:39:34,  3.30it/s]
 24%|██▍       | 90480/371472 [7:11:33<23:07:38,  3.37it/s]
                                                           
{'loss': 3.7286, 'learning_rate': 7.811523626882716e-07, 'epoch': 3.9}

 24%|██▍       | 90480/371472 [7:11:33<23:07:38,  3.37it/s]
 24%|██▍       | 90481/371472 [7:11:33<22:38:15,  3.45it/s]
 24%|██▍       | 90482/371472 [7:11:34<21:42:27,  3.60it/s]
 24%|██▍       | 90483/371472 [7:11:34<21:40:59,  3.60it/s]
 24%|██▍       | 90484/371472 [7:11:34<22:16:41,  3.50it/s]
 24%|██▍       | 90485/371472 [7:11:34<21:51:55,  3.57it/s]
 24%|██▍       | 90486/371472 [7:11:35<21:26:05,  3.64it/s]
 24%|██▍       | 90487/371472 [7:11:35<22:53:22,  3.41it/s]
 24%|██▍       | 90488/371472 [7:11:35<23:27:23,  3.33it/s]
 24%|██▍       | 90489/371472 [7:11:36<23:16:48,  3.35it/s]
 24%|██▍       | 90490/371472 [7:11:36<23:17:13,  3.35it/s]
 24%|██▍       | 90491/371472 [7:11:36<23:21:39,  3.34it/s]
 24%|██▍       | 90492/371472 [7:11:36<22:25:39,  3.48it/s]
 24%|██▍       | 90493/371472 [7:11:37<21:15:38,  3.67it/s]
 24%|██▍       | 90494/371472 [7:11:37<21:10:56,  3.68it/s]
 24%|██▍       | 90495/371472 [7:11:37<21:51:45,  3.57it/s]
 24%|██▍       | 90496/371472 [7:11:38<23:09:03,  3.37it/s]
 24%|██▍       | 90497/371472 [7:11:38<24:04:56,  3.24it/s]
 24%|██▍       | 90498/371472 [7:11:38<23:18:11,  3.35it/s]
 24%|██▍       | 90499/371472 [7:11:39<24:35:29,  3.17it/s]
 24%|██▍       | 90500/371472 [7:11:39<23:23:15,  3.34it/s]
                                                           
{'loss': 3.7813, 'learning_rate': 7.811038807127927e-07, 'epoch': 3.9}

 24%|██▍       | 90500/371472 [7:11:39<23:23:15,  3.34it/s]
 24%|██▍       | 90501/371472 [7:11:39<22:23:46,  3.48it/s]
 24%|██▍       | 90502/371472 [7:11:39<22:51:32,  3.41it/s]
 24%|██▍       | 90503/371472 [7:11:40<23:00:06,  3.39it/s]
 24%|██▍       | 90504/371472 [7:11:40<22:57:04,  3.40it/s]
 24%|██▍       | 90505/371472 [7:11:40<22:33:14,  3.46it/s]
 24%|██▍       | 90506/371472 [7:11:41<22:42:49,  3.44it/s]
 24%|██▍       | 90507/371472 [7:11:41<21:56:40,  3.56it/s]
 24%|██▍       | 90508/371472 [7:11:41<21:33:17,  3.62it/s]
 24%|██▍       | 90509/371472 [7:11:41<20:57:17,  3.72it/s]
 24%|██▍       | 90510/371472 [7:11:42<23:35:30,  3.31it/s]
 24%|██▍       | 90511/371472 [7:11:42<24:35:58,  3.17it/s]
 24%|██▍       | 90512/371472 [7:11:42<23:41:07,  3.30it/s]
 24%|██▍       | 90513/371472 [7:11:43<22:24:12,  3.48it/s]
 24%|██▍       | 90514/371472 [7:11:43<22:35:59,  3.45it/s]
 24%|██▍       | 90515/371472 [7:11:43<23:32:01,  3.32it/s]
 24%|██▍       | 90516/371472 [7:11:44<23:08:23,  3.37it/s]
 24%|██▍       | 90517/371472 [7:11:44<22:37:19,  3.45it/s]
 24%|██▍       | 90518/371472 [7:11:44<24:08:30,  3.23it/s]
 24%|██▍       | 90519/371472 [7:11:44<24:15:52,  3.22it/s]
 24%|██▍       | 90520/371472 [7:11:45<22:47:31,  3.42it/s]
                                                           
{'loss': 3.8708, 'learning_rate': 7.810553987373138e-07, 'epoch': 3.9}

 24%|██▍       | 90520/371472 [7:11:45<22:47:31,  3.42it/s]
 24%|██▍       | 90521/371472 [7:11:45<23:49:41,  3.28it/s]
 24%|██▍       | 90522/371472 [7:11:45<22:29:37,  3.47it/s]
 24%|██▍       | 90523/371472 [7:11:46<22:28:17,  3.47it/s]
 24%|██▍       | 90524/371472 [7:11:46<22:21:02,  3.49it/s]
 24%|██▍       | 90525/371472 [7:11:46<22:26:19,  3.48it/s]
 24%|██▍       | 90526/371472 [7:11:46<21:39:30,  3.60it/s]
 24%|██▍       | 90527/371472 [7:11:47<21:15:20,  3.67it/s]
 24%|██▍       | 90528/371472 [7:11:47<20:20:53,  3.84it/s]
 24%|██▍       | 90529/371472 [7:11:47<21:18:16,  3.66it/s]
 24%|██▍       | 90530/371472 [7:11:47<20:53:54,  3.73it/s]
 24%|██▍       | 90531/371472 [7:11:48<20:56:49,  3.73it/s]
 24%|██▍       | 90532/371472 [7:11:48<20:43:43,  3.76it/s]
 24%|██▍       | 90533/371472 [7:11:48<20:37:11,  3.78it/s]
 24%|██▍       | 90534/371472 [7:11:49<20:27:56,  3.81it/s]
 24%|██▍       | 90535/371472 [7:11:49<22:17:29,  3.50it/s]
 24%|██▍       | 90536/371472 [7:11:49<21:57:48,  3.55it/s]
 24%|██▍       | 90537/371472 [7:11:49<23:34:37,  3.31it/s]
 24%|██▍       | 90538/371472 [7:11:50<22:16:03,  3.50it/s]
 24%|██▍       | 90539/371472 [7:11:50<23:05:41,  3.38it/s]
 24%|██▍       | 90540/371472 [7:11:50<21:33:49,  3.62it/s]
                                                           
{'loss': 3.9136, 'learning_rate': 7.810069167618349e-07, 'epoch': 3.9}

 24%|██▍       | 90540/371472 [7:11:50<21:33:49,  3.62it/s]
 24%|██▍       | 90541/371472 [7:11:51<21:47:06,  3.58it/s]
 24%|██▍       | 90542/371472 [7:11:51<22:37:15,  3.45it/s]
 24%|██▍       | 90543/371472 [7:11:51<22:01:23,  3.54it/s]
 24%|██▍       | 90544/371472 [7:11:51<21:01:05,  3.71it/s]
 24%|██▍       | 90545/371472 [7:11:52<25:29:49,  3.06it/s]
 24%|██▍       | 90546/371472 [7:11:52<24:02:34,  3.25it/s]
 24%|██▍       | 90547/371472 [7:11:53<26:10:13,  2.98it/s]
 24%|██▍       | 90548/371472 [7:11:53<26:09:42,  2.98it/s]
 24%|██▍       | 90549/371472 [7:11:53<24:38:38,  3.17it/s]
 24%|██▍       | 90550/371472 [7:11:53<22:55:14,  3.40it/s]
 24%|██▍       | 90551/371472 [7:11:54<22:11:58,  3.52it/s]
 24%|██▍       | 90552/371472 [7:11:54<21:42:29,  3.59it/s]
 24%|██▍       | 90553/371472 [7:11:54<22:28:08,  3.47it/s]
 24%|██▍       | 90554/371472 [7:11:54<22:45:14,  3.43it/s]
 24%|██▍       | 90555/371472 [7:11:55<22:59:36,  3.39it/s]
 24%|██▍       | 90556/371472 [7:11:55<22:30:17,  3.47it/s]
 24%|██▍       | 90557/371472 [7:11:55<22:22:26,  3.49it/s]
 24%|██▍       | 90558/371472 [7:11:56<21:29:44,  3.63it/s]
 24%|██▍       | 90559/371472 [7:11:56<21:18:50,  3.66it/s]
 24%|██▍       | 90560/371472 [7:11:56<20:28:17,  3.81it/s]
                                                           
{'loss': 3.8608, 'learning_rate': 7.809584347863561e-07, 'epoch': 3.9}

 24%|██▍       | 90560/371472 [7:11:56<20:28:17,  3.81it/s]
 24%|██▍       | 90561/371472 [7:11:56<20:21:39,  3.83it/s]
 24%|██▍       | 90562/371472 [7:11:57<20:22:18,  3.83it/s]
 24%|██▍       | 90563/371472 [7:11:57<20:17:37,  3.85it/s]
 24%|██▍       | 90564/371472 [7:11:57<20:36:18,  3.79it/s]
 24%|██▍       | 90565/371472 [7:11:57<21:08:24,  3.69it/s]
 24%|██▍       | 90566/371472 [7:11:58<20:50:08,  3.74it/s]
 24%|██▍       | 90567/371472 [7:11:58<20:44:10,  3.76it/s]
 24%|██▍       | 90568/371472 [7:11:58<21:19:34,  3.66it/s]
 24%|██▍       | 90569/371472 [7:11:59<21:52:00,  3.57it/s]
 24%|██▍       | 90570/371472 [7:11:59<21:05:07,  3.70it/s]
 24%|██▍       | 90571/371472 [7:11:59<22:04:42,  3.53it/s]
 24%|██▍       | 90572/371472 [7:11:59<22:31:24,  3.46it/s]
 24%|██▍       | 90573/371472 [7:12:00<22:41:38,  3.44it/s]
 24%|██▍       | 90574/371472 [7:12:00<22:42:01,  3.44it/s]
 24%|██▍       | 90575/371472 [7:12:00<22:48:59,  3.42it/s]
 24%|██▍       | 90576/371472 [7:12:01<21:57:23,  3.55it/s]
 24%|██▍       | 90577/371472 [7:12:01<21:14:21,  3.67it/s]
 24%|██▍       | 90578/371472 [7:12:01<21:52:04,  3.57it/s]
 24%|██▍       | 90579/371472 [7:12:01<22:12:56,  3.51it/s]
 24%|██▍       | 90580/371472 [7:12:02<22:44:15,  3.43it/s]
                                                           
{'loss': 3.8121, 'learning_rate': 7.809099528108771e-07, 'epoch': 3.9}

 24%|██▍       | 90580/371472 [7:12:02<22:44:15,  3.43it/s]
 24%|██▍       | 90581/371472 [7:12:02<22:12:27,  3.51it/s]
 24%|██▍       | 90582/371472 [7:12:02<21:14:20,  3.67it/s]
 24%|██▍       | 90583/371472 [7:12:02<21:01:42,  3.71it/s]
 24%|██▍       | 90584/371472 [7:12:03<22:44:19,  3.43it/s]
 24%|██▍       | 90585/371472 [7:12:03<24:53:06,  3.14it/s]
 24%|██▍       | 90586/371472 [7:12:04<25:01:00,  3.12it/s]
 24%|██▍       | 90587/371472 [7:12:04<23:32:39,  3.31it/s]
 24%|██▍       | 90588/371472 [7:12:04<23:09:37,  3.37it/s]
 24%|██▍       | 90589/371472 [7:12:04<21:36:51,  3.61it/s]
 24%|██▍       | 90590/371472 [7:12:05<22:04:37,  3.53it/s]
 24%|██▍       | 90591/371472 [7:12:05<22:57:05,  3.40it/s]
 24%|██▍       | 90592/371472 [7:12:05<22:46:59,  3.42it/s]
 24%|██▍       | 90593/371472 [7:12:05<22:20:07,  3.49it/s]
 24%|██▍       | 90594/371472 [7:12:06<21:42:43,  3.59it/s]
 24%|██▍       | 90595/371472 [7:12:06<22:05:03,  3.53it/s]
 24%|██▍       | 90596/371472 [7:12:06<22:00:39,  3.54it/s]
 24%|██▍       | 90597/371472 [7:12:07<21:58:01,  3.55it/s]
 24%|██▍       | 90598/371472 [7:12:07<21:28:06,  3.63it/s]
 24%|██▍       | 90599/371472 [7:12:07<21:59:53,  3.55it/s]
 24%|██▍       | 90600/371472 [7:12:07<21:06:26,  3.70it/s]
                                                           
{'loss': 3.8127, 'learning_rate': 7.808614708353982e-07, 'epoch': 3.9}

 24%|██▍       | 90600/371472 [7:12:07<21:06:26,  3.70it/s]
 24%|██▍       | 90601/371472 [7:12:08<21:11:45,  3.68it/s]
 24%|██▍       | 90602/371472 [7:12:08<21:37:02,  3.61it/s]
 24%|██▍       | 90603/371472 [7:12:08<20:59:58,  3.72it/s]
 24%|██▍       | 90604/371472 [7:12:08<21:04:10,  3.70it/s]
 24%|██▍       | 90605/371472 [7:12:09<21:17:19,  3.66it/s]
 24%|██▍       | 90606/371472 [7:12:09<21:08:51,  3.69it/s]
 24%|██▍       | 90607/371472 [7:12:09<21:07:50,  3.69it/s]
 24%|██▍       | 90608/371472 [7:12:10<20:54:22,  3.73it/s]
 24%|██▍       | 90609/371472 [7:12:10<20:27:46,  3.81it/s]
 24%|██▍       | 90610/371472 [7:12:10<21:32:12,  3.62it/s]
 24%|██▍       | 90611/371472 [7:12:10<23:08:14,  3.37it/s]
 24%|██▍       | 90612/371472 [7:12:11<22:47:27,  3.42it/s]
 24%|██▍       | 90613/371472 [7:12:11<22:45:23,  3.43it/s]
 24%|██▍       | 90614/371472 [7:12:11<23:56:10,  3.26it/s]
 24%|██▍       | 90615/371472 [7:12:12<23:54:37,  3.26it/s]
 24%|██▍       | 90616/371472 [7:12:12<22:23:05,  3.49it/s]
 24%|██▍       | 90617/371472 [7:12:12<21:41:23,  3.60it/s]
 24%|██▍       | 90618/371472 [7:12:12<22:45:26,  3.43it/s]
 24%|██▍       | 90619/371472 [7:12:13<23:17:02,  3.35it/s]
 24%|██▍       | 90620/371472 [7:12:13<22:03:44,  3.54it/s]
                                                           
{'loss': 3.7044, 'learning_rate': 7.808129888599194e-07, 'epoch': 3.9}

 24%|██▍       | 90620/371472 [7:12:13<22:03:44,  3.54it/s]
 24%|██▍       | 90621/371472 [7:12:13<23:50:51,  3.27it/s]
 24%|██▍       | 90622/371472 [7:12:14<24:18:01,  3.21it/s]
 24%|██▍       | 90623/371472 [7:12:14<23:52:50,  3.27it/s]
 24%|██▍       | 90624/371472 [7:12:14<24:47:13,  3.15it/s]
 24%|██▍       | 90625/371472 [7:12:15<23:12:15,  3.36it/s]
 24%|██▍       | 90626/371472 [7:12:15<22:17:59,  3.50it/s]
 24%|██▍       | 90627/371472 [7:12:15<22:19:22,  3.49it/s]
 24%|██▍       | 90628/371472 [7:12:16<23:46:43,  3.28it/s]
 24%|██▍       | 90629/371472 [7:12:16<22:51:01,  3.41it/s]
 24%|██▍       | 90630/371472 [7:12:16<21:46:18,  3.58it/s]
 24%|██▍       | 90631/371472 [7:12:16<22:03:30,  3.54it/s]
 24%|██▍       | 90632/371472 [7:12:17<21:28:04,  3.63it/s]
 24%|██▍       | 90633/371472 [7:12:17<21:43:05,  3.59it/s]
 24%|██▍       | 90634/371472 [7:12:17<22:46:34,  3.43it/s]
 24%|██▍       | 90635/371472 [7:12:18<23:40:36,  3.29it/s]
 24%|██▍       | 90636/371472 [7:12:18<24:14:07,  3.22it/s]
 24%|██▍       | 90637/371472 [7:12:18<22:56:08,  3.40it/s]
 24%|██▍       | 90638/371472 [7:12:18<23:14:50,  3.36it/s]
 24%|██▍       | 90639/371472 [7:12:19<24:12:30,  3.22it/s]
 24%|██▍       | 90640/371472 [7:12:19<24:12:28,  3.22it/s]
                                                           
{'loss': 3.7509, 'learning_rate': 7.807645068844405e-07, 'epoch': 3.9}

 24%|██▍       | 90640/371472 [7:12:19<24:12:28,  3.22it/s]
 24%|██▍       | 90641/371472 [7:12:19<23:41:51,  3.29it/s]
 24%|██▍       | 90642/371472 [7:12:20<22:50:24,  3.42it/s]
 24%|██▍       | 90643/371472 [7:12:20<21:22:11,  3.65it/s]
 24%|██▍       | 90644/371472 [7:12:20<20:51:50,  3.74it/s]
 24%|██▍       | 90645/371472 [7:12:20<20:37:52,  3.78it/s]
 24%|██▍       | 90646/371472 [7:12:21<21:21:35,  3.65it/s]
 24%|██▍       | 90647/371472 [7:12:21<22:33:54,  3.46it/s]
 24%|██▍       | 90648/371472 [7:12:21<22:19:16,  3.49it/s]
 24%|██▍       | 90649/371472 [7:12:22<22:08:23,  3.52it/s]
 24%|██▍       | 90650/371472 [7:12:22<22:38:12,  3.45it/s]
 24%|██▍       | 90651/371472 [7:12:22<22:05:54,  3.53it/s]
 24%|██▍       | 90652/371472 [7:12:22<22:11:37,  3.51it/s]
 24%|██▍       | 90653/371472 [7:12:23<21:30:50,  3.63it/s]
 24%|██▍       | 90654/371472 [7:12:23<21:44:39,  3.59it/s]
 24%|██▍       | 90655/371472 [7:12:23<22:11:48,  3.51it/s]
 24%|██▍       | 90656/371472 [7:12:24<21:58:46,  3.55it/s]
 24%|██▍       | 90657/371472 [7:12:24<20:59:31,  3.72it/s]
 24%|██▍       | 90658/371472 [7:12:24<20:32:23,  3.80it/s]
 24%|██▍       | 90659/371472 [7:12:24<21:59:55,  3.55it/s]
 24%|██▍       | 90660/371472 [7:12:25<21:13:15,  3.68it/s]
                                                           
{'loss': 3.7746, 'learning_rate': 7.807160249089615e-07, 'epoch': 3.9}

 24%|██▍       | 90660/371472 [7:12:25<21:13:15,  3.68it/s]
 24%|██▍       | 90661/371472 [7:12:25<21:30:22,  3.63it/s]
 24%|██▍       | 90662/371472 [7:12:25<21:10:08,  3.68it/s]
 24%|██▍       | 90663/371472 [7:12:25<20:40:50,  3.77it/s]
 24%|██▍       | 90664/371472 [7:12:26<20:51:53,  3.74it/s]
 24%|██▍       | 90665/371472 [7:12:26<20:54:03,  3.73it/s]
 24%|██▍       | 90666/371472 [7:12:26<20:35:47,  3.79it/s]
 24%|██▍       | 90667/371472 [7:12:26<20:32:42,  3.80it/s]
 24%|██▍       | 90668/371472 [7:12:27<20:26:01,  3.82it/s]
 24%|██▍       | 90669/371472 [7:12:27<21:09:55,  3.69it/s]
 24%|██▍       | 90670/371472 [7:12:27<22:21:36,  3.49it/s]
 24%|██▍       | 90671/371472 [7:12:28<22:15:45,  3.50it/s]
 24%|██▍       | 90672/371472 [7:12:28<23:19:17,  3.34it/s]
 24%|██▍       | 90673/371472 [7:12:28<22:43:11,  3.43it/s]
 24%|██▍       | 90674/371472 [7:12:29<23:29:36,  3.32it/s]
 24%|██▍       | 90675/371472 [7:12:29<23:06:34,  3.38it/s]
 24%|██▍       | 90676/371472 [7:12:29<25:05:31,  3.11it/s]
 24%|██▍       | 90677/371472 [7:12:29<24:48:21,  3.14it/s]
 24%|██▍       | 90678/371472 [7:12:30<24:35:18,  3.17it/s]
 24%|██▍       | 90679/371472 [7:12:30<23:39:40,  3.30it/s]
 24%|██▍       | 90680/371472 [7:12:30<22:52:52,  3.41it/s]
                                                           
{'loss': 3.7436, 'learning_rate': 7.806675429334827e-07, 'epoch': 3.91}

 24%|██▍       | 90680/371472 [7:12:30<22:52:52,  3.41it/s]
 24%|██▍       | 90681/371472 [7:12:31<23:10:24,  3.37it/s]
 24%|██▍       | 90682/371472 [7:12:31<23:05:29,  3.38it/s]
 24%|██▍       | 90683/371472 [7:12:31<23:24:25,  3.33it/s]
 24%|██▍       | 90684/371472 [7:12:32<23:19:45,  3.34it/s]
 24%|██▍       | 90685/371472 [7:12:32<22:41:10,  3.44it/s]
 24%|██▍       | 90686/371472 [7:12:32<24:39:43,  3.16it/s]
 24%|██▍       | 90687/371472 [7:12:32<23:00:01,  3.39it/s]
 24%|██▍       | 90688/371472 [7:12:33<22:23:05,  3.48it/s]
 24%|██▍       | 90689/371472 [7:12:33<22:13:46,  3.51it/s]
 24%|██▍       | 90690/371472 [7:12:33<21:40:17,  3.60it/s]
 24%|██▍       | 90691/371472 [7:12:34<21:41:47,  3.59it/s]
 24%|██▍       | 90692/371472 [7:12:34<21:17:12,  3.66it/s]
 24%|██▍       | 90693/371472 [7:12:34<21:03:21,  3.70it/s]
 24%|██▍       | 90694/371472 [7:12:34<20:41:41,  3.77it/s]
 24%|██▍       | 90695/371472 [7:12:35<21:07:24,  3.69it/s]
 24%|██▍       | 90696/371472 [7:12:35<22:54:33,  3.40it/s]
 24%|██▍       | 90697/371472 [7:12:35<22:45:08,  3.43it/s]
 24%|██▍       | 90698/371472 [7:12:36<22:21:55,  3.49it/s]
 24%|██▍       | 90699/371472 [7:12:36<22:36:11,  3.45it/s]
 24%|██▍       | 90700/371472 [7:12:36<22:08:17,  3.52it/s]
                                                           
{'loss': 3.6755, 'learning_rate': 7.806190609580039e-07, 'epoch': 3.91}

 24%|██▍       | 90700/371472 [7:12:36<22:08:17,  3.52it/s]
 24%|██▍       | 90701/371472 [7:12:36<21:35:39,  3.61it/s]
 24%|██▍       | 90702/371472 [7:12:37<22:14:34,  3.51it/s]
 24%|██▍       | 90703/371472 [7:12:37<21:56:32,  3.55it/s]
 24%|██▍       | 90704/371472 [7:12:37<22:13:21,  3.51it/s]
 24%|██▍       | 90705/371472 [7:12:37<21:57:57,  3.55it/s]
 24%|██▍       | 90706/371472 [7:12:38<21:32:29,  3.62it/s]
 24%|██▍       | 90707/371472 [7:12:38<21:11:46,  3.68it/s]
 24%|██▍       | 90708/371472 [7:12:38<21:57:18,  3.55it/s]
 24%|██▍       | 90709/371472 [7:12:39<21:43:26,  3.59it/s]
 24%|██▍       | 90710/371472 [7:12:39<21:07:05,  3.69it/s]
 24%|██▍       | 90711/371472 [7:12:39<21:25:38,  3.64it/s]
 24%|██▍       | 90712/371472 [7:12:39<21:14:39,  3.67it/s]
 24%|██▍       | 90713/371472 [7:12:40<22:04:41,  3.53it/s]
 24%|██▍       | 90714/371472 [7:12:40<21:02:36,  3.71it/s]
 24%|██▍       | 90715/371472 [7:12:40<20:25:21,  3.82it/s]
 24%|██▍       | 90716/371472 [7:12:41<22:14:34,  3.51it/s]
 24%|██▍       | 90717/371472 [7:12:41<22:07:39,  3.52it/s]
 24%|██▍       | 90718/371472 [7:12:41<21:17:11,  3.66it/s]
 24%|██▍       | 90719/371472 [7:12:41<21:07:46,  3.69it/s]
 24%|██▍       | 90720/371472 [7:12:42<21:35:10,  3.61it/s]
                                                           
{'loss': 3.7125, 'learning_rate': 7.80570578982525e-07, 'epoch': 3.91}

 24%|██▍       | 90720/371472 [7:12:42<21:35:10,  3.61it/s]
 24%|██▍       | 90721/371472 [7:12:42<23:04:03,  3.38it/s]
 24%|██▍       | 90722/371472 [7:12:42<23:02:46,  3.38it/s]
 24%|██▍       | 90723/371472 [7:12:42<21:58:20,  3.55it/s]
 24%|██▍       | 90724/371472 [7:12:43<22:18:02,  3.50it/s]
 24%|██▍       | 90725/371472 [7:12:43<22:11:44,  3.51it/s]
 24%|██▍       | 90726/371472 [7:12:43<21:20:46,  3.65it/s]
 24%|██▍       | 90727/371472 [7:12:44<20:56:58,  3.72it/s]
 24%|██▍       | 90728/371472 [7:12:44<22:01:49,  3.54it/s]
 24%|██▍       | 90729/371472 [7:12:44<22:23:12,  3.48it/s]
 24%|██▍       | 90730/371472 [7:12:44<21:44:36,  3.59it/s]
 24%|██▍       | 90731/371472 [7:12:45<21:51:09,  3.57it/s]
 24%|██▍       | 90732/371472 [7:12:45<21:51:28,  3.57it/s]
 24%|██▍       | 90733/371472 [7:12:45<21:00:46,  3.71it/s]
 24%|██▍       | 90734/371472 [7:12:46<21:15:34,  3.67it/s]
 24%|██▍       | 90735/371472 [7:12:46<21:50:53,  3.57it/s]
 24%|██▍       | 90736/371472 [7:12:46<21:11:41,  3.68it/s]
 24%|██▍       | 90737/371472 [7:12:46<21:19:04,  3.66it/s]
 24%|██▍       | 90738/371472 [7:12:47<23:12:10,  3.36it/s]
 24%|██▍       | 90739/371472 [7:12:47<23:43:12,  3.29it/s]
 24%|██▍       | 90740/371472 [7:12:47<22:42:58,  3.43it/s]
                                                           
{'loss': 3.9075, 'learning_rate': 7.805220970070459e-07, 'epoch': 3.91}

 24%|██▍       | 90740/371472 [7:12:47<22:42:58,  3.43it/s]
 24%|██▍       | 90741/371472 [7:12:48<23:16:38,  3.35it/s]
 24%|██▍       | 90742/371472 [7:12:48<22:20:29,  3.49it/s]
 24%|██▍       | 90743/371472 [7:12:48<21:11:45,  3.68it/s]
 24%|██▍       | 90744/371472 [7:12:48<21:28:17,  3.63it/s]
 24%|██▍       | 90745/371472 [7:12:49<21:08:45,  3.69it/s]
 24%|██▍       | 90746/371472 [7:12:49<20:21:22,  3.83it/s]
 24%|██▍       | 90747/371472 [7:12:49<20:47:47,  3.75it/s]
 24%|██▍       | 90748/371472 [7:12:49<21:40:55,  3.60it/s]
 24%|██▍       | 90749/371472 [7:12:50<20:50:32,  3.74it/s]
 24%|██▍       | 90750/371472 [7:12:50<20:49:09,  3.75it/s]
 24%|██▍       | 90751/371472 [7:12:50<20:52:57,  3.73it/s]
 24%|██▍       | 90752/371472 [7:12:51<21:10:20,  3.68it/s]
 24%|██▍       | 90753/371472 [7:12:51<21:37:02,  3.61it/s]
 24%|██▍       | 90754/371472 [7:12:51<21:23:54,  3.64it/s]
 24%|██▍       | 90755/371472 [7:12:51<23:11:12,  3.36it/s]
 24%|██▍       | 90756/371472 [7:12:52<22:55:48,  3.40it/s]
 24%|██▍       | 90757/371472 [7:12:52<22:12:14,  3.51it/s]
 24%|██▍       | 90758/371472 [7:12:52<21:58:23,  3.55it/s]
 24%|██▍       | 90759/371472 [7:12:53<23:02:22,  3.38it/s]
 24%|██▍       | 90760/371472 [7:12:53<23:19:33,  3.34it/s]
                                                           
{'loss': 3.9323, 'learning_rate': 7.804736150315671e-07, 'epoch': 3.91}

 24%|██▍       | 90760/371472 [7:12:53<23:19:33,  3.34it/s]
 24%|██▍       | 90761/371472 [7:12:53<22:43:48,  3.43it/s]
 24%|██▍       | 90762/371472 [7:12:53<21:50:08,  3.57it/s]
 24%|██▍       | 90763/371472 [7:12:54<22:28:25,  3.47it/s]
 24%|██▍       | 90764/371472 [7:12:54<22:17:43,  3.50it/s]
 24%|██▍       | 90765/371472 [7:12:54<22:32:37,  3.46it/s]
 24%|██▍       | 90766/371472 [7:12:55<23:42:04,  3.29it/s]
 24%|██▍       | 90767/371472 [7:12:55<22:57:03,  3.40it/s]
 24%|██▍       | 90768/371472 [7:12:55<23:16:26,  3.35it/s]
 24%|██▍       | 90769/371472 [7:12:56<22:55:06,  3.40it/s]
 24%|██▍       | 90770/371472 [7:12:56<22:31:26,  3.46it/s]
 24%|██▍       | 90771/371472 [7:12:56<22:00:12,  3.54it/s]
 24%|██▍       | 90772/371472 [7:12:56<23:03:52,  3.38it/s]
 24%|██▍       | 90773/371472 [7:12:57<23:56:21,  3.26it/s]
 24%|██▍       | 90774/371472 [7:12:57<23:30:58,  3.32it/s]
 24%|██▍       | 90775/371472 [7:12:57<22:14:47,  3.50it/s]
 24%|██▍       | 90776/371472 [7:12:58<22:27:44,  3.47it/s]
 24%|██▍       | 90777/371472 [7:12:58<23:10:12,  3.37it/s]
 24%|██▍       | 90778/371472 [7:12:58<24:00:48,  3.25it/s]
 24%|██▍       | 90779/371472 [7:12:59<25:02:09,  3.11it/s]
 24%|██▍       | 90780/371472 [7:12:59<23:06:45,  3.37it/s]
                                                           
{'loss': 3.6171, 'learning_rate': 7.804251330560883e-07, 'epoch': 3.91}

 24%|██▍       | 90780/371472 [7:12:59<23:06:45,  3.37it/s]
 24%|██▍       | 90781/371472 [7:12:59<23:55:51,  3.26it/s]
 24%|██▍       | 90782/371472 [7:12:59<23:02:57,  3.38it/s]
 24%|██▍       | 90783/371472 [7:13:00<22:32:47,  3.46it/s]
 24%|██▍       | 90784/371472 [7:13:00<21:33:41,  3.62it/s]
 24%|██▍       | 90785/371472 [7:13:00<23:15:59,  3.35it/s]
 24%|██▍       | 90786/371472 [7:13:01<22:53:05,  3.41it/s]
 24%|██▍       | 90787/371472 [7:13:01<22:37:55,  3.45it/s]
 24%|██▍       | 90788/371472 [7:13:01<22:31:59,  3.46it/s]
 24%|██▍       | 90789/371472 [7:13:01<24:39:15,  3.16it/s]
 24%|██▍       | 90790/371472 [7:13:02<23:44:54,  3.28it/s]
 24%|██▍       | 90791/371472 [7:13:02<24:58:01,  3.12it/s]
 24%|██▍       | 90792/371472 [7:13:02<23:45:53,  3.28it/s]
 24%|██▍       | 90793/371472 [7:13:03<23:51:28,  3.27it/s]
 24%|██▍       | 90794/371472 [7:13:03<23:25:22,  3.33it/s]
 24%|██▍       | 90795/371472 [7:13:03<23:09:56,  3.37it/s]
 24%|██▍       | 90796/371472 [7:13:04<23:03:03,  3.38it/s]
 24%|██▍       | 90797/371472 [7:13:04<22:08:19,  3.52it/s]
 24%|██▍       | 90798/371472 [7:13:04<23:09:55,  3.37it/s]
 24%|██▍       | 90799/371472 [7:13:04<22:00:32,  3.54it/s]
 24%|██▍       | 90800/371472 [7:13:05<22:38:52,  3.44it/s]
                                                           
{'loss': 3.712, 'learning_rate': 7.803766510806094e-07, 'epoch': 3.91}

 24%|██▍       | 90800/371472 [7:13:05<22:38:52,  3.44it/s]
 24%|██▍       | 90801/371472 [7:13:05<21:56:16,  3.55it/s]
 24%|██▍       | 90802/371472 [7:13:05<21:52:13,  3.56it/s]
 24%|██▍       | 90803/371472 [7:13:05<20:49:48,  3.74it/s]
 24%|██▍       | 90804/371472 [7:13:06<20:48:48,  3.75it/s]
 24%|██▍       | 90805/371472 [7:13:06<21:28:12,  3.63it/s]
 24%|██▍       | 90806/371472 [7:13:06<20:52:42,  3.73it/s]
 24%|██▍       | 90807/371472 [7:13:07<22:58:56,  3.39it/s]
 24%|██▍       | 90808/371472 [7:13:07<22:33:18,  3.46it/s]
 24%|██▍       | 90809/371472 [7:13:07<21:53:26,  3.56it/s]
 24%|██▍       | 90810/371472 [7:13:08<25:46:24,  3.02it/s]
 24%|██▍       | 90811/371472 [7:13:08<24:08:12,  3.23it/s]
 24%|██▍       | 90812/371472 [7:13:08<23:10:01,  3.37it/s]
 24%|██▍       | 90813/371472 [7:13:08<23:42:42,  3.29it/s]
 24%|██▍       | 90814/371472 [7:13:09<24:05:39,  3.24it/s]
 24%|██▍       | 90815/371472 [7:13:09<22:41:01,  3.44it/s]
 24%|██▍       | 90816/371472 [7:13:09<22:05:03,  3.53it/s]
 24%|██▍       | 90817/371472 [7:13:10<22:11:24,  3.51it/s]
 24%|██▍       | 90818/371472 [7:13:10<22:01:16,  3.54it/s]
 24%|██▍       | 90819/371472 [7:13:10<20:58:29,  3.72it/s]
 24%|██▍       | 90820/371472 [7:13:10<20:38:20,  3.78it/s]
                                                           
{'loss': 3.8687, 'learning_rate': 7.803281691051304e-07, 'epoch': 3.91}

 24%|██▍       | 90820/371472 [7:13:10<20:38:20,  3.78it/s]
 24%|██▍       | 90821/371472 [7:13:11<20:26:20,  3.81it/s]
 24%|██▍       | 90822/371472 [7:13:11<22:51:38,  3.41it/s]
 24%|██▍       | 90823/371472 [7:13:11<22:34:51,  3.45it/s]
 24%|██▍       | 90824/371472 [7:13:12<21:38:15,  3.60it/s]
 24%|██▍       | 90825/371472 [7:13:12<23:35:00,  3.31it/s]
 24%|██▍       | 90826/371472 [7:13:12<22:41:05,  3.44it/s]
 24%|██▍       | 90827/371472 [7:13:12<22:04:05,  3.53it/s]
 24%|██▍       | 90828/371472 [7:13:13<22:53:13,  3.41it/s]
 24%|██▍       | 90829/371472 [7:13:13<22:52:32,  3.41it/s]
 24%|██▍       | 90830/371472 [7:13:13<21:56:22,  3.55it/s]
 24%|██▍       | 90831/371472 [7:13:14<22:08:43,  3.52it/s]
 24%|██▍       | 90832/371472 [7:13:14<21:12:48,  3.67it/s]
 24%|██▍       | 90833/371472 [7:13:14<21:24:29,  3.64it/s]
 24%|██▍       | 90834/371472 [7:13:14<20:18:03,  3.84it/s]
 24%|██▍       | 90835/371472 [7:13:15<20:07:03,  3.87it/s]
 24%|██▍       | 90836/371472 [7:13:15<21:35:51,  3.61it/s]
 24%|██▍       | 90837/371472 [7:13:15<23:43:20,  3.29it/s]
 24%|██▍       | 90838/371472 [7:13:16<23:05:27,  3.38it/s]
 24%|██▍       | 90839/371472 [7:13:16<22:21:00,  3.49it/s]
 24%|██▍       | 90840/371472 [7:13:16<21:44:20,  3.59it/s]
                                                           
{'loss': 3.7504, 'learning_rate': 7.802796871296516e-07, 'epoch': 3.91}

 24%|██▍       | 90840/371472 [7:13:16<21:44:20,  3.59it/s]
 24%|██▍       | 90841/371472 [7:13:16<21:18:18,  3.66it/s]
 24%|██▍       | 90842/371472 [7:13:17<20:31:21,  3.80it/s]
 24%|██▍       | 90843/371472 [7:13:17<20:19:59,  3.83it/s]
 24%|██▍       | 90844/371472 [7:13:17<21:39:14,  3.60it/s]
 24%|██▍       | 90845/371472 [7:13:17<22:02:50,  3.54it/s]
 24%|██▍       | 90846/371472 [7:13:18<21:35:20,  3.61it/s]
 24%|██▍       | 90847/371472 [7:13:18<21:20:12,  3.65it/s]
 24%|██▍       | 90848/371472 [7:13:18<23:03:18,  3.38it/s]
 24%|██▍       | 90849/371472 [7:13:19<22:57:40,  3.39it/s]
 24%|██▍       | 90850/371472 [7:13:19<22:17:13,  3.50it/s]
 24%|██▍       | 90851/371472 [7:13:19<21:45:32,  3.58it/s]
 24%|██▍       | 90852/371472 [7:13:19<21:32:25,  3.62it/s]
 24%|██▍       | 90853/371472 [7:13:20<21:52:51,  3.56it/s]
 24%|██▍       | 90854/371472 [7:13:20<22:45:17,  3.43it/s]
 24%|██▍       | 90855/371472 [7:13:20<24:34:16,  3.17it/s]
 24%|██▍       | 90856/371472 [7:13:21<23:12:03,  3.36it/s]
 24%|██▍       | 90857/371472 [7:13:21<22:13:44,  3.51it/s]
 24%|██▍       | 90858/371472 [7:13:21<22:44:02,  3.43it/s]
 24%|██▍       | 90859/371472 [7:13:21<21:53:56,  3.56it/s]
 24%|██▍       | 90860/371472 [7:13:22<21:30:21,  3.62it/s]
                                                           
{'loss': 3.818, 'learning_rate': 7.802312051541725e-07, 'epoch': 3.91}

 24%|██▍       | 90860/371472 [7:13:22<21:30:21,  3.62it/s]
 24%|██▍       | 90861/371472 [7:13:22<21:37:24,  3.60it/s]
 24%|██▍       | 90862/371472 [7:13:22<21:19:25,  3.66it/s]
 24%|██▍       | 90863/371472 [7:13:23<22:13:31,  3.51it/s]
 24%|██▍       | 90864/371472 [7:13:23<21:37:35,  3.60it/s]
 24%|██▍       | 90865/371472 [7:13:23<21:53:32,  3.56it/s]
 24%|██▍       | 90866/371472 [7:13:23<23:43:33,  3.29it/s]
 24%|██▍       | 90867/371472 [7:13:24<22:07:40,  3.52it/s]
 24%|██▍       | 90868/371472 [7:13:24<21:44:11,  3.59it/s]
 24%|██▍       | 90869/371472 [7:13:24<22:03:44,  3.53it/s]
 24%|██▍       | 90870/371472 [7:13:25<22:25:19,  3.48it/s]
 24%|██▍       | 90871/371472 [7:13:25<21:48:46,  3.57it/s]
 24%|██▍       | 90872/371472 [7:13:25<21:44:58,  3.58it/s]
 24%|██▍       | 90873/371472 [7:13:25<21:04:58,  3.70it/s]
 24%|██▍       | 90874/371472 [7:13:26<21:06:25,  3.69it/s]
 24%|██▍       | 90875/371472 [7:13:26<20:30:35,  3.80it/s]
 24%|██▍       | 90876/371472 [7:13:26<21:06:25,  3.69it/s]
 24%|██▍       | 90877/371472 [7:13:26<21:56:31,  3.55it/s]
 24%|██▍       | 90878/371472 [7:13:27<22:14:56,  3.50it/s]
 24%|██▍       | 90879/371472 [7:13:27<22:08:08,  3.52it/s]
 24%|██▍       | 90880/371472 [7:13:27<22:22:19,  3.48it/s]
                                                           
{'loss': 3.8207, 'learning_rate': 7.801827231786937e-07, 'epoch': 3.91}

 24%|██▍       | 90880/371472 [7:13:27<22:22:19,  3.48it/s]
 24%|██▍       | 90881/371472 [7:13:28<22:25:03,  3.48it/s]
 24%|██▍       | 90882/371472 [7:13:28<23:04:51,  3.38it/s]
 24%|██▍       | 90883/371472 [7:13:28<23:03:19,  3.38it/s]
 24%|██▍       | 90884/371472 [7:13:29<22:59:56,  3.39it/s]
 24%|██▍       | 90885/371472 [7:13:29<22:41:34,  3.43it/s]
 24%|██▍       | 90886/371472 [7:13:29<23:19:37,  3.34it/s]
 24%|██▍       | 90887/371472 [7:13:29<22:19:25,  3.49it/s]
 24%|██▍       | 90888/371472 [7:13:30<23:04:37,  3.38it/s]
 24%|██▍       | 90889/371472 [7:13:30<21:59:52,  3.54it/s]
 24%|██▍       | 90890/371472 [7:13:30<21:44:35,  3.58it/s]
 24%|██▍       | 90891/371472 [7:13:31<22:18:34,  3.49it/s]
 24%|██▍       | 90892/371472 [7:13:31<22:02:30,  3.54it/s]
 24%|██▍       | 90893/371472 [7:13:31<21:31:09,  3.62it/s]
 24%|██▍       | 90894/371472 [7:13:31<21:41:30,  3.59it/s]
 24%|██▍       | 90895/371472 [7:13:32<22:11:29,  3.51it/s]
 24%|██▍       | 90896/371472 [7:13:32<21:34:57,  3.61it/s]
 24%|██▍       | 90897/371472 [7:13:32<21:07:30,  3.69it/s]
 24%|██▍       | 90898/371472 [7:13:32<20:50:04,  3.74it/s]
 24%|██▍       | 90899/371472 [7:13:33<20:18:52,  3.84it/s]
 24%|██▍       | 90900/371472 [7:13:33<20:03:18,  3.89it/s]
                                                           
{'loss': 3.8593, 'learning_rate': 7.801342412032148e-07, 'epoch': 3.92}

 24%|██▍       | 90900/371472 [7:13:33<20:03:18,  3.89it/s]
 24%|██▍       | 90901/371472 [7:13:33<20:22:38,  3.82it/s]
 24%|██▍       | 90902/371472 [7:13:34<22:05:54,  3.53it/s]
 24%|██▍       | 90903/371472 [7:13:34<21:32:53,  3.62it/s]
 24%|██▍       | 90904/371472 [7:13:34<21:19:18,  3.66it/s]
 24%|██▍       | 90905/371472 [7:13:34<22:52:09,  3.41it/s]
 24%|██▍       | 90906/371472 [7:13:35<22:04:27,  3.53it/s]
 24%|██▍       | 90907/371472 [7:13:35<21:25:21,  3.64it/s]
 24%|██▍       | 90908/371472 [7:13:35<21:52:32,  3.56it/s]
 24%|██▍       | 90909/371472 [7:13:35<21:50:30,  3.57it/s]
 24%|██▍       | 90910/371472 [7:13:36<21:23:30,  3.64it/s]
 24%|██▍       | 90911/371472 [7:13:36<21:45:58,  3.58it/s]
 24%|██▍       | 90912/371472 [7:13:36<21:40:19,  3.60it/s]
 24%|██▍       | 90913/371472 [7:13:37<20:53:56,  3.73it/s]
 24%|██▍       | 90914/371472 [7:13:37<22:12:40,  3.51it/s]
 24%|██▍       | 90915/371472 [7:13:37<22:49:41,  3.41it/s]
 24%|██▍       | 90916/371472 [7:13:37<21:50:20,  3.57it/s]
 24%|██▍       | 90917/371472 [7:13:38<22:49:53,  3.41it/s]
 24%|██▍       | 90918/371472 [7:13:38<22:18:12,  3.49it/s]
 24%|██▍       | 90919/371472 [7:13:38<23:29:14,  3.32it/s]
 24%|██▍       | 90920/371472 [7:13:39<23:34:41,  3.31it/s]
                                                           
{'loss': 3.8238, 'learning_rate': 7.80085759227736e-07, 'epoch': 3.92}

 24%|██▍       | 90920/371472 [7:13:39<23:34:41,  3.31it/s]
 24%|██▍       | 90921/371472 [7:13:39<23:25:11,  3.33it/s]
 24%|██▍       | 90922/371472 [7:13:39<22:09:08,  3.52it/s]
 24%|██▍       | 90923/371472 [7:13:39<21:49:37,  3.57it/s]
 24%|██▍       | 90924/371472 [7:13:40<21:24:01,  3.64it/s]
 24%|██▍       | 90925/371472 [7:13:40<20:57:44,  3.72it/s]
 24%|██▍       | 90926/371472 [7:13:40<21:54:00,  3.56it/s]
 24%|██▍       | 90927/371472 [7:13:41<21:59:24,  3.54it/s]
 24%|██▍       | 90928/371472 [7:13:41<21:01:23,  3.71it/s]
 24%|██▍       | 90929/371472 [7:13:41<21:19:49,  3.65it/s]
 24%|██▍       | 90930/371472 [7:13:41<21:17:16,  3.66it/s]
 24%|██▍       | 90931/371472 [7:13:42<23:18:19,  3.34it/s]
 24%|██▍       | 90932/371472 [7:13:42<22:29:10,  3.47it/s]
 24%|██▍       | 90933/371472 [7:13:42<22:13:05,  3.51it/s]
 24%|██▍       | 90934/371472 [7:13:43<21:54:48,  3.56it/s]
 24%|██▍       | 90935/371472 [7:13:43<21:45:31,  3.58it/s]
 24%|██▍       | 90936/371472 [7:13:43<21:17:47,  3.66it/s]
 24%|██▍       | 90937/371472 [7:13:43<21:38:07,  3.60it/s]
 24%|██▍       | 90938/371472 [7:13:44<22:23:18,  3.48it/s]
 24%|██▍       | 90939/371472 [7:13:44<22:05:18,  3.53it/s]
 24%|██▍       | 90940/371472 [7:13:44<22:53:46,  3.40it/s]
                                                           
{'loss': 3.8924, 'learning_rate': 7.800372772522571e-07, 'epoch': 3.92}

 24%|██▍       | 90940/371472 [7:13:44<22:53:46,  3.40it/s]
 24%|██▍       | 90941/371472 [7:13:45<22:46:00,  3.42it/s]
 24%|██▍       | 90942/371472 [7:13:45<25:48:23,  3.02it/s]
 24%|██▍       | 90943/371472 [7:13:45<25:23:02,  3.07it/s]
 24%|██▍       | 90944/371472 [7:13:46<25:21:11,  3.07it/s]
 24%|██▍       | 90945/371472 [7:13:46<23:40:10,  3.29it/s]
 24%|██▍       | 90946/371472 [7:13:46<22:49:21,  3.41it/s]
 24%|██▍       | 90947/371472 [7:13:47<23:58:44,  3.25it/s]
 24%|██▍       | 90948/371472 [7:13:47<22:54:48,  3.40it/s]
 24%|██▍       | 90949/371472 [7:13:47<22:05:31,  3.53it/s]
 24%|██▍       | 90950/371472 [7:13:47<21:44:20,  3.58it/s]
 24%|██▍       | 90951/371472 [7:13:48<21:53:26,  3.56it/s]
 24%|██▍       | 90952/371472 [7:13:48<21:07:21,  3.69it/s]
 24%|██▍       | 90953/371472 [7:13:48<22:41:28,  3.43it/s]
 24%|██▍       | 90954/371472 [7:13:49<24:29:33,  3.18it/s]
 24%|██▍       | 90955/371472 [7:13:49<23:23:43,  3.33it/s]
 24%|██▍       | 90956/371472 [7:13:49<23:36:04,  3.30it/s]
 24%|██▍       | 90957/371472 [7:13:49<22:38:40,  3.44it/s]
 24%|██▍       | 90958/371472 [7:13:50<22:35:01,  3.45it/s]
 24%|██▍       | 90959/371472 [7:13:50<23:10:43,  3.36it/s]
 24%|██▍       | 90960/371472 [7:13:50<22:02:41,  3.53it/s]
                                                           
{'loss': 3.7231, 'learning_rate': 7.799887952767782e-07, 'epoch': 3.92}

 24%|██▍       | 90960/371472 [7:13:50<22:02:41,  3.53it/s]
 24%|██▍       | 90961/371472 [7:13:51<21:40:35,  3.59it/s]
 24%|██▍       | 90962/371472 [7:13:51<22:53:47,  3.40it/s]
 24%|██▍       | 90963/371472 [7:13:51<22:04:14,  3.53it/s]
 24%|██▍       | 90964/371472 [7:13:51<22:17:49,  3.49it/s]
 24%|██▍       | 90965/371472 [7:13:52<23:16:34,  3.35it/s]
 24%|██▍       | 90966/371472 [7:13:52<22:26:22,  3.47it/s]
 24%|██▍       | 90967/371472 [7:13:52<23:16:21,  3.35it/s]
 24%|██▍       | 90968/371472 [7:13:53<22:21:41,  3.48it/s]
 24%|██▍       | 90969/371472 [7:13:53<22:30:56,  3.46it/s]
 24%|██▍       | 90970/371472 [7:13:53<22:29:12,  3.47it/s]
 24%|██▍       | 90971/371472 [7:13:53<21:27:56,  3.63it/s]
 24%|██▍       | 90972/371472 [7:13:54<21:02:26,  3.70it/s]
 24%|██▍       | 90973/371472 [7:13:54<21:27:04,  3.63it/s]
 24%|██▍       | 90974/371472 [7:13:54<22:33:53,  3.45it/s]
 24%|██▍       | 90975/371472 [7:13:55<23:02:00,  3.38it/s]
 24%|██▍       | 90976/371472 [7:13:55<22:56:10,  3.40it/s]
 24%|██▍       | 90977/371472 [7:13:55<22:27:09,  3.47it/s]
 24%|██▍       | 90978/371472 [7:13:55<22:09:17,  3.52it/s]
 24%|██▍       | 90979/371472 [7:13:56<21:31:27,  3.62it/s]
 24%|██▍       | 90980/371472 [7:13:56<21:13:03,  3.67it/s]
                                                           
{'loss': 3.8398, 'learning_rate': 7.799403133012992e-07, 'epoch': 3.92}

 24%|██▍       | 90980/371472 [7:13:56<21:13:03,  3.67it/s]
 24%|██▍       | 90981/371472 [7:13:56<22:09:01,  3.52it/s]
 24%|██▍       | 90982/371472 [7:13:57<23:25:49,  3.33it/s]
 24%|██▍       | 90983/371472 [7:13:57<23:18:14,  3.34it/s]
 24%|██▍       | 90984/371472 [7:13:57<22:32:15,  3.46it/s]
 24%|██▍       | 90985/371472 [7:13:57<21:27:45,  3.63it/s]
 24%|██▍       | 90986/371472 [7:13:58<22:11:04,  3.51it/s]
 24%|██▍       | 90987/371472 [7:13:58<21:47:53,  3.57it/s]
 24%|██▍       | 90988/371472 [7:13:58<21:29:35,  3.62it/s]
 24%|██▍       | 90989/371472 [7:13:58<20:46:02,  3.75it/s]
 24%|██▍       | 90990/371472 [7:13:59<20:08:57,  3.87it/s]
 24%|██▍       | 90991/371472 [7:13:59<19:53:19,  3.92it/s]
 24%|██▍       | 90992/371472 [7:13:59<19:49:05,  3.93it/s]
 24%|██▍       | 90993/371472 [7:13:59<19:46:44,  3.94it/s]
 24%|██▍       | 90994/371472 [7:14:00<19:52:53,  3.92it/s]
 24%|██▍       | 90995/371472 [7:14:00<20:18:23,  3.84it/s]
 24%|██▍       | 90996/371472 [7:14:00<21:53:28,  3.56it/s]
 24%|██▍       | 90997/371472 [7:14:01<23:35:24,  3.30it/s]
 24%|██▍       | 90998/371472 [7:14:01<22:26:41,  3.47it/s]
 24%|██▍       | 90999/371472 [7:14:01<21:34:17,  3.61it/s]
 24%|██▍       | 91000/371472 [7:14:02<23:31:59,  3.31it/s]
                                                           
{'loss': 3.6378, 'learning_rate': 7.798918313258204e-07, 'epoch': 3.92}

 24%|██▍       | 91000/371472 [7:14:02<23:31:59,  3.31it/s]
 24%|██▍       | 91001/371472 [7:14:02<23:21:30,  3.34it/s]
 24%|██▍       | 91002/371472 [7:14:02<22:26:20,  3.47it/s]
 24%|██▍       | 91003/371472 [7:14:02<23:10:15,  3.36it/s]
 24%|██▍       | 91004/371472 [7:14:03<22:17:36,  3.49it/s]
 24%|██▍       | 91005/371472 [7:14:03<22:00:41,  3.54it/s]
 24%|██▍       | 91006/371472 [7:14:03<21:27:41,  3.63it/s]
 24%|██▍       | 91007/371472 [7:14:03<21:15:47,  3.66it/s]
 24%|██▍       | 91008/371472 [7:14:04<21:26:07,  3.63it/s]
 24%|██▍       | 91009/371472 [7:14:04<20:44:44,  3.76it/s]
 24%|██▍       | 91010/371472 [7:14:04<22:37:39,  3.44it/s]
 25%|██▍       | 91011/371472 [7:14:05<22:44:17,  3.43it/s]
 25%|██▍       | 91012/371472 [7:14:05<22:46:44,  3.42it/s]
 25%|██▍       | 91013/371472 [7:14:05<22:02:22,  3.53it/s]
 25%|██▍       | 91014/371472 [7:14:05<21:31:51,  3.62it/s]
 25%|██▍       | 91015/371472 [7:14:06<21:33:45,  3.61it/s]
 25%|██▍       | 91016/371472 [7:14:06<23:29:37,  3.32it/s]
 25%|██▍       | 91017/371472 [7:14:06<23:51:55,  3.26it/s]
 25%|██▍       | 91018/371472 [7:14:07<23:08:50,  3.37it/s]
 25%|██▍       | 91019/371472 [7:14:07<24:43:50,  3.15it/s]
 25%|██▍       | 91020/371472 [7:14:07<24:11:23,  3.22it/s]
                                                           
{'loss': 4.0435, 'learning_rate': 7.798433493503415e-07, 'epoch': 3.92}

 25%|██▍       | 91020/371472 [7:14:07<24:11:23,  3.22it/s]
 25%|██▍       | 91021/371472 [7:14:08<23:34:27,  3.30it/s]
 25%|██▍       | 91022/371472 [7:14:08<22:37:23,  3.44it/s]
 25%|██▍       | 91023/371472 [7:14:08<23:02:33,  3.38it/s]
 25%|██▍       | 91024/371472 [7:14:08<22:17:09,  3.50it/s]
 25%|██▍       | 91025/371472 [7:14:09<21:26:48,  3.63it/s]
 25%|██▍       | 91026/371472 [7:14:09<21:16:20,  3.66it/s]
 25%|██▍       | 91027/371472 [7:14:09<20:39:24,  3.77it/s]
 25%|██▍       | 91028/371472 [7:14:10<22:23:07,  3.48it/s]
 25%|██▍       | 91029/371472 [7:14:10<22:07:19,  3.52it/s]
 25%|██▍       | 91030/371472 [7:14:10<22:39:30,  3.44it/s]
 25%|██▍       | 91031/371472 [7:14:10<22:43:39,  3.43it/s]
 25%|██▍       | 91032/371472 [7:14:11<22:32:35,  3.46it/s]
 25%|██▍       | 91033/371472 [7:14:11<21:44:33,  3.58it/s]
 25%|██▍       | 91034/371472 [7:14:11<22:17:26,  3.49it/s]
 25%|██▍       | 91035/371472 [7:14:12<23:07:57,  3.37it/s]
 25%|██▍       | 91036/371472 [7:14:12<22:28:48,  3.47it/s]
 25%|██▍       | 91037/371472 [7:14:12<23:32:15,  3.31it/s]
 25%|██▍       | 91038/371472 [7:14:13<23:42:57,  3.28it/s]
 25%|██▍       | 91039/371472 [7:14:13<23:12:01,  3.36it/s]
 25%|██▍       | 91040/371472 [7:14:13<22:00:32,  3.54it/s]
                                                           
{'loss': 3.9161, 'learning_rate': 7.797948673748626e-07, 'epoch': 3.92}

 25%|██▍       | 91040/371472 [7:14:13<22:00:32,  3.54it/s]
 25%|██▍       | 91041/371472 [7:14:13<22:23:25,  3.48it/s]
 25%|██▍       | 91042/371472 [7:14:14<22:17:41,  3.49it/s]
 25%|██▍       | 91043/371472 [7:14:14<21:53:07,  3.56it/s]
 25%|██▍       | 91044/371472 [7:14:14<21:05:24,  3.69it/s]
 25%|██▍       | 91045/371472 [7:14:14<22:24:23,  3.48it/s]
 25%|██▍       | 91046/371472 [7:14:15<21:36:36,  3.60it/s]
 25%|██▍       | 91047/371472 [7:14:15<21:46:11,  3.58it/s]
 25%|██▍       | 91048/371472 [7:14:15<22:21:45,  3.48it/s]
 25%|██▍       | 91049/371472 [7:14:16<21:26:58,  3.63it/s]
 25%|██▍       | 91050/371472 [7:14:16<20:54:18,  3.73it/s]
 25%|██▍       | 91051/371472 [7:14:16<21:00:51,  3.71it/s]
 25%|██▍       | 91052/371472 [7:14:16<21:39:05,  3.60it/s]
 25%|██▍       | 91053/371472 [7:14:17<21:19:21,  3.65it/s]
 25%|██▍       | 91054/371472 [7:14:17<21:33:22,  3.61it/s]
 25%|██▍       | 91055/371472 [7:14:17<22:05:04,  3.53it/s]
 25%|██▍       | 91056/371472 [7:14:18<22:31:13,  3.46it/s]
 25%|██▍       | 91057/371472 [7:14:18<21:37:24,  3.60it/s]
 25%|██▍       | 91058/371472 [7:14:18<21:35:45,  3.61it/s]
 25%|██▍       | 91059/371472 [7:14:18<24:28:42,  3.18it/s]
 25%|██▍       | 91060/371472 [7:14:19<23:14:24,  3.35it/s]
                                                           
{'loss': 3.929, 'learning_rate': 7.797463853993837e-07, 'epoch': 3.92}

 25%|██▍       | 91060/371472 [7:14:19<23:14:24,  3.35it/s]
 25%|██▍       | 91061/371472 [7:14:19<24:00:20,  3.24it/s]
 25%|██▍       | 91062/371472 [7:14:19<23:03:26,  3.38it/s]
 25%|██▍       | 91063/371472 [7:14:20<22:44:40,  3.42it/s]
 25%|██▍       | 91064/371472 [7:14:20<21:54:14,  3.56it/s]
 25%|██▍       | 91065/371472 [7:14:20<22:26:57,  3.47it/s]
 25%|██▍       | 91066/371472 [7:14:20<22:41:51,  3.43it/s]
 25%|██▍       | 91067/371472 [7:14:21<21:54:01,  3.56it/s]
 25%|██▍       | 91068/371472 [7:14:21<22:14:23,  3.50it/s]
 25%|██▍       | 91069/371472 [7:14:21<21:34:40,  3.61it/s]
 25%|██▍       | 91070/371472 [7:14:22<21:58:24,  3.54it/s]
 25%|██▍       | 91071/371472 [7:14:22<21:14:36,  3.67it/s]
 25%|██▍       | 91072/371472 [7:14:22<20:53:43,  3.73it/s]
 25%|██▍       | 91073/371472 [7:14:22<20:30:19,  3.80it/s]
 25%|██▍       | 91074/371472 [7:14:23<22:49:58,  3.41it/s]
 25%|██▍       | 91075/371472 [7:14:23<22:16:37,  3.50it/s]
 25%|██▍       | 91076/371472 [7:14:23<22:33:19,  3.45it/s]
 25%|██▍       | 91077/371472 [7:14:24<21:57:46,  3.55it/s]
 25%|██▍       | 91078/371472 [7:14:24<21:15:06,  3.66it/s]
 25%|██▍       | 91079/371472 [7:14:24<21:20:45,  3.65it/s]
 25%|██▍       | 91080/371472 [7:14:24<21:51:21,  3.56it/s]
                                                           
{'loss': 3.8256, 'learning_rate': 7.796979034239049e-07, 'epoch': 3.92}

 25%|██▍       | 91080/371472 [7:14:24<21:51:21,  3.56it/s]
 25%|██▍       | 91081/371472 [7:14:25<22:14:04,  3.50it/s]
 25%|██▍       | 91082/371472 [7:14:25<22:14:47,  3.50it/s]
 25%|██▍       | 91083/371472 [7:14:25<22:30:11,  3.46it/s]
 25%|██▍       | 91084/371472 [7:14:26<22:17:18,  3.49it/s]
 25%|██▍       | 91085/371472 [7:14:26<24:14:42,  3.21it/s]
 25%|██▍       | 91086/371472 [7:14:26<23:12:43,  3.36it/s]
 25%|██▍       | 91087/371472 [7:14:26<22:56:21,  3.40it/s]
 25%|██▍       | 91088/371472 [7:14:27<24:17:05,  3.21it/s]
 25%|██▍       | 91089/371472 [7:14:27<24:26:12,  3.19it/s]
 25%|██▍       | 91090/371472 [7:14:27<23:32:11,  3.31it/s]
 25%|██▍       | 91091/371472 [7:14:28<23:16:37,  3.35it/s]
 25%|██▍       | 91092/371472 [7:14:28<22:39:51,  3.44it/s]
 25%|██▍       | 91093/371472 [7:14:28<22:25:00,  3.47it/s]
 25%|██▍       | 91094/371472 [7:14:29<22:34:31,  3.45it/s]
 25%|██▍       | 91095/371472 [7:14:29<22:32:20,  3.46it/s]
 25%|██▍       | 91096/371472 [7:14:29<21:16:48,  3.66it/s]
 25%|██▍       | 91097/371472 [7:14:29<21:15:28,  3.66it/s]
 25%|██▍       | 91098/371472 [7:14:30<24:07:09,  3.23it/s]
 25%|██▍       | 91099/371472 [7:14:30<22:59:22,  3.39it/s]
 25%|██▍       | 91100/371472 [7:14:30<22:27:58,  3.47it/s]
                                                           
{'loss': 3.7158, 'learning_rate': 7.79649421448426e-07, 'epoch': 3.92}

 25%|██▍       | 91100/371472 [7:14:30<22:27:58,  3.47it/s]
 25%|██▍       | 91101/371472 [7:14:31<22:01:42,  3.54it/s]
 25%|██▍       | 91102/371472 [7:14:31<22:51:36,  3.41it/s]
 25%|██▍       | 91103/371472 [7:14:31<24:30:25,  3.18it/s]
 25%|██▍       | 91104/371472 [7:14:32<24:22:00,  3.20it/s]
 25%|██▍       | 91105/371472 [7:14:32<24:18:10,  3.20it/s]
 25%|██▍       | 91106/371472 [7:14:32<23:56:48,  3.25it/s]
 25%|██▍       | 91107/371472 [7:14:32<23:45:17,  3.28it/s]
 25%|██▍       | 91108/371472 [7:14:33<22:59:33,  3.39it/s]
 25%|██▍       | 91109/371472 [7:14:33<22:17:43,  3.49it/s]
 25%|██▍       | 91110/371472 [7:14:33<21:41:33,  3.59it/s]
 25%|██▍       | 91111/371472 [7:14:34<22:04:53,  3.53it/s]
 25%|██▍       | 91112/371472 [7:14:34<23:24:51,  3.33it/s]
 25%|██▍       | 91113/371472 [7:14:34<22:48:46,  3.41it/s]
 25%|██▍       | 91114/371472 [7:14:34<22:24:48,  3.47it/s]
 25%|██▍       | 91115/371472 [7:14:35<22:21:32,  3.48it/s]
 25%|██▍       | 91116/371472 [7:14:35<21:41:18,  3.59it/s]
 25%|██▍       | 91117/371472 [7:14:35<21:49:35,  3.57it/s]
 25%|██▍       | 91118/371472 [7:14:35<21:26:31,  3.63it/s]
 25%|██▍       | 91119/371472 [7:14:36<21:16:38,  3.66it/s]
 25%|██▍       | 91120/371472 [7:14:36<21:29:19,  3.62it/s]
                                                           
{'loss': 3.684, 'learning_rate': 7.796009394729469e-07, 'epoch': 3.92}

 25%|██▍       | 91120/371472 [7:14:36<21:29:19,  3.62it/s]
 25%|██▍       | 91121/371472 [7:14:36<21:42:08,  3.59it/s]
 25%|██▍       | 91122/371472 [7:14:37<21:40:35,  3.59it/s]
 25%|██▍       | 91123/371472 [7:14:37<21:14:52,  3.67it/s]
 25%|██▍       | 91124/371472 [7:14:37<21:03:29,  3.70it/s]
 25%|██▍       | 91125/371472 [7:14:37<21:16:19,  3.66it/s]
 25%|██▍       | 91126/371472 [7:14:38<21:55:43,  3.55it/s]
 25%|██▍       | 91127/371472 [7:14:38<22:24:54,  3.47it/s]
 25%|██▍       | 91128/371472 [7:14:38<22:37:25,  3.44it/s]
 25%|██▍       | 91129/371472 [7:14:39<22:31:52,  3.46it/s]
 25%|██▍       | 91130/371472 [7:14:39<21:44:31,  3.58it/s]
 25%|██▍       | 91131/371472 [7:14:39<20:57:34,  3.72it/s]
 25%|██▍       | 91132/371472 [7:14:39<21:36:55,  3.60it/s]
 25%|██▍       | 91133/371472 [7:14:40<21:54:30,  3.55it/s]
 25%|██▍       | 91134/371472 [7:14:40<21:55:25,  3.55it/s]
 25%|██▍       | 91135/371472 [7:14:40<21:37:52,  3.60it/s]
 25%|██▍       | 91136/371472 [7:14:40<21:16:27,  3.66it/s]
 25%|██▍       | 91137/371472 [7:14:41<22:00:07,  3.54it/s]
 25%|██▍       | 91138/371472 [7:14:41<21:38:22,  3.60it/s]
 25%|██▍       | 91139/371472 [7:14:41<22:35:00,  3.45it/s]
 25%|██▍       | 91140/371472 [7:14:42<24:45:04,  3.15it/s]
                                                           
{'loss': 3.6719, 'learning_rate': 7.795524574974681e-07, 'epoch': 3.93}

 25%|██▍       | 91140/371472 [7:14:42<24:45:04,  3.15it/s]
 25%|██▍       | 91141/371472 [7:14:42<23:55:56,  3.25it/s]
 25%|██▍       | 91142/371472 [7:14:42<23:46:25,  3.28it/s]
 25%|██▍       | 91143/371472 [7:14:43<23:33:11,  3.31it/s]
 25%|██▍       | 91144/371472 [7:14:43<23:00:23,  3.38it/s]
 25%|██▍       | 91145/371472 [7:14:43<22:40:17,  3.43it/s]
 25%|██▍       | 91146/371472 [7:14:43<21:31:23,  3.62it/s]
 25%|██▍       | 91147/371472 [7:14:44<21:27:58,  3.63it/s]
 25%|██▍       | 91148/371472 [7:14:44<21:49:02,  3.57it/s]
 25%|██▍       | 91149/371472 [7:14:44<21:21:29,  3.65it/s]
 25%|██▍       | 91150/371472 [7:14:45<20:43:05,  3.76it/s]
 25%|██▍       | 91151/371472 [7:14:45<20:25:15,  3.81it/s]
 25%|██▍       | 91152/371472 [7:14:45<20:37:27,  3.78it/s]
 25%|██▍       | 91153/371472 [7:14:45<20:54:42,  3.72it/s]
 25%|██▍       | 91154/371472 [7:14:46<22:28:17,  3.47it/s]
 25%|██▍       | 91155/371472 [7:14:46<22:42:23,  3.43it/s]
 25%|██▍       | 91156/371472 [7:14:46<22:20:46,  3.48it/s]
 25%|██▍       | 91157/371472 [7:14:46<21:16:45,  3.66it/s]
 25%|██▍       | 91158/371472 [7:14:47<21:12:31,  3.67it/s]
 25%|██▍       | 91159/371472 [7:14:47<21:59:45,  3.54it/s]
 25%|██▍       | 91160/371472 [7:14:47<22:27:38,  3.47it/s]
                                                           
{'loss': 3.9501, 'learning_rate': 7.795039755219893e-07, 'epoch': 3.93}

 25%|██▍       | 91160/371472 [7:14:47<22:27:38,  3.47it/s]
 25%|██▍       | 91161/371472 [7:14:48<21:50:16,  3.57it/s]
 25%|██▍       | 91162/371472 [7:14:48<21:55:31,  3.55it/s]
 25%|██▍       | 91163/371472 [7:14:48<21:18:14,  3.65it/s]
 25%|██▍       | 91164/371472 [7:14:48<22:22:02,  3.48it/s]
 25%|██▍       | 91165/371472 [7:14:49<22:05:31,  3.52it/s]
 25%|██▍       | 91166/371472 [7:14:49<22:35:26,  3.45it/s]
 25%|██▍       | 91167/371472 [7:14:49<22:11:15,  3.51it/s]
 25%|██▍       | 91168/371472 [7:14:50<21:48:19,  3.57it/s]
 25%|██▍       | 91169/371472 [7:14:50<21:41:43,  3.59it/s]
 25%|██▍       | 91170/371472 [7:14:50<22:32:22,  3.45it/s]
 25%|██▍       | 91171/371472 [7:14:50<21:51:05,  3.56it/s]
 25%|██▍       | 91172/371472 [7:14:51<21:26:14,  3.63it/s]
 25%|██▍       | 91173/371472 [7:14:51<20:43:32,  3.76it/s]
 25%|██▍       | 91174/371472 [7:14:51<20:47:45,  3.74it/s]
 25%|██▍       | 91175/371472 [7:14:51<20:24:09,  3.82it/s]
 25%|██▍       | 91176/371472 [7:14:52<21:21:50,  3.64it/s]
 25%|██▍       | 91177/371472 [7:14:52<21:21:29,  3.65it/s]
 25%|██▍       | 91178/371472 [7:14:52<21:43:14,  3.58it/s]
 25%|██▍       | 91179/371472 [7:14:53<21:30:10,  3.62it/s]
 25%|██▍       | 91180/371472 [7:14:53<21:14:14,  3.67it/s]
                                                           
{'loss': 3.8401, 'learning_rate': 7.794554935465103e-07, 'epoch': 3.93}

 25%|██▍       | 91180/371472 [7:14:53<21:14:14,  3.67it/s]
 25%|██▍       | 91181/371472 [7:14:53<21:35:50,  3.60it/s]
 25%|██▍       | 91182/371472 [7:14:53<22:37:49,  3.44it/s]
 25%|██▍       | 91183/371472 [7:14:54<21:52:39,  3.56it/s]
 25%|██▍       | 91184/371472 [7:14:54<22:40:50,  3.43it/s]
 25%|██▍       | 91185/371472 [7:14:54<22:28:51,  3.46it/s]
 25%|██▍       | 91186/371472 [7:14:55<21:46:23,  3.58it/s]
 25%|██▍       | 91187/371472 [7:14:55<22:03:31,  3.53it/s]
 25%|██▍       | 91188/371472 [7:14:55<22:54:25,  3.40it/s]
 25%|██▍       | 91189/371472 [7:14:56<23:28:54,  3.32it/s]
 25%|██▍       | 91190/371472 [7:14:56<23:17:28,  3.34it/s]
 25%|██▍       | 91191/371472 [7:14:56<24:15:56,  3.21it/s]
 25%|██▍       | 91192/371472 [7:14:56<23:24:54,  3.33it/s]
 25%|██▍       | 91193/371472 [7:14:57<22:13:12,  3.50it/s]
 25%|██▍       | 91194/371472 [7:14:57<22:12:28,  3.51it/s]
 25%|██▍       | 91195/371472 [7:14:57<21:41:25,  3.59it/s]
 25%|██▍       | 91196/371472 [7:14:58<22:28:45,  3.46it/s]
 25%|██▍       | 91197/371472 [7:14:58<22:12:32,  3.51it/s]
 25%|██▍       | 91198/371472 [7:14:58<21:26:57,  3.63it/s]
 25%|██▍       | 91199/371472 [7:14:58<22:38:38,  3.44it/s]
 25%|██▍       | 91200/371472 [7:14:59<22:20:47,  3.48it/s]
                                                           
{'loss': 3.7076, 'learning_rate': 7.794070115710314e-07, 'epoch': 3.93}

 25%|██▍       | 91200/371472 [7:14:59<22:20:47,  3.48it/s]
 25%|██▍       | 91201/371472 [7:14:59<22:05:05,  3.53it/s]
 25%|██▍       | 91202/371472 [7:14:59<23:06:14,  3.37it/s]
 25%|██▍       | 91203/371472 [7:15:00<23:10:49,  3.36it/s]
 25%|██▍       | 91204/371472 [7:15:00<22:44:05,  3.42it/s]
 25%|██▍       | 91205/371472 [7:15:00<22:09:42,  3.51it/s]
 25%|██▍       | 91206/371472 [7:15:00<21:20:08,  3.65it/s]
 25%|██▍       | 91207/371472 [7:15:01<21:49:42,  3.57it/s]
 25%|██▍       | 91208/371472 [7:15:01<21:56:13,  3.55it/s]
 25%|██▍       | 91209/371472 [7:15:01<21:43:26,  3.58it/s]
 25%|██▍       | 91210/371472 [7:15:02<21:31:25,  3.62it/s]
 25%|██▍       | 91211/371472 [7:15:02<22:50:46,  3.41it/s]
 25%|██▍       | 91212/371472 [7:15:02<22:03:16,  3.53it/s]
 25%|██▍       | 91213/371472 [7:15:02<22:26:27,  3.47it/s]
 25%|██▍       | 91214/371472 [7:15:03<21:32:02,  3.62it/s]
 25%|██▍       | 91215/371472 [7:15:03<21:51:07,  3.56it/s]
 25%|██▍       | 91216/371472 [7:15:03<21:10:24,  3.68it/s]
 25%|██▍       | 91217/371472 [7:15:03<21:05:37,  3.69it/s]
 25%|██▍       | 91218/371472 [7:15:04<20:23:01,  3.82it/s]
 25%|██▍       | 91219/371472 [7:15:04<21:03:24,  3.70it/s]
 25%|██▍       | 91220/371472 [7:15:04<21:10:46,  3.68it/s]
                                                           
{'loss': 3.7346, 'learning_rate': 7.793585295955526e-07, 'epoch': 3.93}

 25%|██▍       | 91220/371472 [7:15:04<21:10:46,  3.68it/s]
 25%|██▍       | 91221/371472 [7:15:05<20:39:03,  3.77it/s]
 25%|██▍       | 91222/371472 [7:15:05<20:06:36,  3.87it/s]
 25%|██▍       | 91223/371472 [7:15:05<21:27:12,  3.63it/s]
 25%|██▍       | 91224/371472 [7:15:05<20:44:06,  3.75it/s]
 25%|██▍       | 91225/371472 [7:15:06<21:05:02,  3.69it/s]
 25%|██▍       | 91226/371472 [7:15:06<21:24:00,  3.64it/s]
 25%|██▍       | 91227/371472 [7:15:06<21:12:46,  3.67it/s]
 25%|██▍       | 91228/371472 [7:15:06<22:55:21,  3.40it/s]
 25%|██▍       | 91229/371472 [7:15:07<22:46:26,  3.42it/s]
 25%|██▍       | 91230/371472 [7:15:07<22:11:58,  3.51it/s]
 25%|██▍       | 91231/371472 [7:15:07<21:13:42,  3.67it/s]
 25%|██▍       | 91232/371472 [7:15:08<21:40:17,  3.59it/s]
 25%|██▍       | 91233/371472 [7:15:08<21:05:44,  3.69it/s]
 25%|██▍       | 91234/371472 [7:15:08<20:42:44,  3.76it/s]
 25%|██▍       | 91235/371472 [7:15:08<20:45:52,  3.75it/s]
 25%|██▍       | 91236/371472 [7:15:09<20:44:43,  3.75it/s]
 25%|██▍       | 91237/371472 [7:15:09<21:49:13,  3.57it/s]
 25%|██▍       | 91238/371472 [7:15:09<21:03:36,  3.70it/s]
 25%|██▍       | 91239/371472 [7:15:10<22:28:57,  3.46it/s]
 25%|██▍       | 91240/371472 [7:15:10<21:20:41,  3.65it/s]
                                                           
{'loss': 3.7959, 'learning_rate': 7.793100476200737e-07, 'epoch': 3.93}

 25%|██▍       | 91240/371472 [7:15:10<21:20:41,  3.65it/s]
 25%|██▍       | 91241/371472 [7:15:10<21:18:47,  3.65it/s]
 25%|██▍       | 91242/371472 [7:15:10<20:46:11,  3.75it/s]
 25%|██▍       | 91243/371472 [7:15:11<21:48:06,  3.57it/s]
 25%|██▍       | 91244/371472 [7:15:11<21:22:44,  3.64it/s]
 25%|██▍       | 91245/371472 [7:15:11<22:47:33,  3.42it/s]
 25%|██▍       | 91246/371472 [7:15:11<21:28:38,  3.62it/s]
 25%|██▍       | 91247/371472 [7:15:12<22:46:48,  3.42it/s]
 25%|██▍       | 91248/371472 [7:15:12<22:40:35,  3.43it/s]
 25%|██▍       | 91249/371472 [7:15:12<21:43:30,  3.58it/s]
 25%|██▍       | 91250/371472 [7:15:13<21:24:15,  3.64it/s]
 25%|██▍       | 91251/371472 [7:15:13<22:24:28,  3.47it/s]
 25%|██▍       | 91252/371472 [7:15:13<21:52:40,  3.56it/s]
 25%|██▍       | 91253/371472 [7:15:13<20:54:26,  3.72it/s]
 25%|██▍       | 91254/371472 [7:15:14<22:24:52,  3.47it/s]
 25%|██▍       | 91255/371472 [7:15:14<22:14:23,  3.50it/s]
 25%|██▍       | 91256/371472 [7:15:14<21:23:10,  3.64it/s]
 25%|██▍       | 91257/371472 [7:15:14<20:36:41,  3.78it/s]
 25%|██▍       | 91258/371472 [7:15:15<23:47:01,  3.27it/s]
 25%|██▍       | 91259/371472 [7:15:15<22:47:23,  3.42it/s]
 25%|██▍       | 91260/371472 [7:15:15<21:35:09,  3.61it/s]
                                                           
{'loss': 3.7263, 'learning_rate': 7.792615656445947e-07, 'epoch': 3.93}

 25%|██▍       | 91260/371472 [7:15:15<21:35:09,  3.61it/s]
 25%|██▍       | 91261/371472 [7:15:16<21:04:47,  3.69it/s]
 25%|██▍       | 91262/371472 [7:15:16<21:07:39,  3.68it/s]
 25%|██▍       | 91263/371472 [7:15:16<20:31:04,  3.79it/s]
 25%|██▍       | 91264/371472 [7:15:16<20:12:23,  3.85it/s]
 25%|██▍       | 91265/371472 [7:15:17<21:12:54,  3.67it/s]
 25%|██▍       | 91266/371472 [7:15:17<25:14:32,  3.08it/s]
 25%|██▍       | 91267/371472 [7:15:17<24:24:28,  3.19it/s]
 25%|██▍       | 91268/371472 [7:15:18<23:26:44,  3.32it/s]
 25%|██▍       | 91269/371472 [7:15:18<22:54:37,  3.40it/s]
 25%|██▍       | 91270/371472 [7:15:18<22:47:42,  3.41it/s]
 25%|██▍       | 91271/371472 [7:15:19<21:50:43,  3.56it/s]
 25%|██▍       | 91272/371472 [7:15:19<21:40:58,  3.59it/s]
 25%|██▍       | 91273/371472 [7:15:19<21:13:25,  3.67it/s]
 25%|██▍       | 91274/371472 [7:15:19<21:25:40,  3.63it/s]
 25%|██▍       | 91275/371472 [7:15:20<23:21:34,  3.33it/s]
 25%|██▍       | 91276/371472 [7:15:20<22:50:19,  3.41it/s]
 25%|██▍       | 91277/371472 [7:15:20<21:48:57,  3.57it/s]
 25%|██▍       | 91278/371472 [7:15:20<20:59:10,  3.71it/s]
 25%|██▍       | 91279/371472 [7:15:21<20:52:47,  3.73it/s]
 25%|██▍       | 91280/371472 [7:15:21<20:16:00,  3.84it/s]
                                                           
{'loss': 3.7003, 'learning_rate': 7.792130836691158e-07, 'epoch': 3.93}

 25%|██▍       | 91280/371472 [7:15:21<20:16:00,  3.84it/s]
 25%|██▍       | 91281/371472 [7:15:21<20:30:47,  3.79it/s]
 25%|██▍       | 91282/371472 [7:15:22<20:17:29,  3.84it/s]
 25%|██▍       | 91283/371472 [7:15:22<21:44:09,  3.58it/s]
 25%|██▍       | 91284/371472 [7:15:22<21:50:57,  3.56it/s]
 25%|██▍       | 91285/371472 [7:15:22<21:51:23,  3.56it/s]
 25%|██▍       | 91286/371472 [7:15:23<20:48:05,  3.74it/s]
 25%|██▍       | 91287/371472 [7:15:23<20:39:56,  3.77it/s]
 25%|██▍       | 91288/371472 [7:15:23<22:14:30,  3.50it/s]
 25%|██▍       | 91289/371472 [7:15:23<21:30:40,  3.62it/s]
 25%|██▍       | 91290/371472 [7:15:24<21:43:01,  3.58it/s]
 25%|██▍       | 91291/371472 [7:15:24<22:32:17,  3.45it/s]
 25%|██▍       | 91292/371472 [7:15:24<21:48:08,  3.57it/s]
 25%|██▍       | 91293/371472 [7:15:25<21:04:11,  3.69it/s]
 25%|██▍       | 91294/371472 [7:15:25<22:01:00,  3.53it/s]
 25%|██▍       | 91295/371472 [7:15:25<22:59:33,  3.38it/s]
 25%|██▍       | 91296/371472 [7:15:25<21:57:27,  3.54it/s]
 25%|██▍       | 91297/371472 [7:15:26<21:22:42,  3.64it/s]
 25%|██▍       | 91298/371472 [7:15:26<21:33:08,  3.61it/s]
 25%|██▍       | 91299/371472 [7:15:26<21:12:12,  3.67it/s]
 25%|██▍       | 91300/371472 [7:15:27<21:14:32,  3.66it/s]
                                                           
{'loss': 3.7147, 'learning_rate': 7.79164601693637e-07, 'epoch': 3.93}

 25%|██▍       | 91300/371472 [7:15:27<21:14:32,  3.66it/s]
 25%|██▍       | 91301/371472 [7:15:27<22:23:23,  3.48it/s]
 25%|██▍       | 91302/371472 [7:15:27<23:20:43,  3.33it/s]
 25%|██▍       | 91303/371472 [7:15:28<23:09:28,  3.36it/s]
 25%|██▍       | 91304/371472 [7:15:28<22:04:44,  3.52it/s]
 25%|██▍       | 91305/371472 [7:15:28<22:06:05,  3.52it/s]
 25%|██▍       | 91306/371472 [7:15:28<21:58:45,  3.54it/s]
 25%|██▍       | 91307/371472 [7:15:29<21:21:19,  3.64it/s]
 25%|██▍       | 91308/371472 [7:15:29<20:41:32,  3.76it/s]
 25%|██▍       | 91309/371472 [7:15:29<21:29:08,  3.62it/s]
 25%|██▍       | 91310/371472 [7:15:29<21:24:19,  3.64it/s]
 25%|██▍       | 91311/371472 [7:15:30<21:50:34,  3.56it/s]
 25%|██▍       | 91312/371472 [7:15:30<22:33:24,  3.45it/s]
 25%|██▍       | 91313/371472 [7:15:30<21:53:28,  3.55it/s]
 25%|██▍       | 91314/371472 [7:15:31<22:04:31,  3.53it/s]
 25%|██▍       | 91315/371472 [7:15:31<21:39:49,  3.59it/s]
 25%|██▍       | 91316/371472 [7:15:31<21:49:34,  3.57it/s]
 25%|██▍       | 91317/371472 [7:15:32<24:50:56,  3.13it/s]
 25%|██▍       | 91318/371472 [7:15:32<25:53:39,  3.01it/s]
 25%|██▍       | 91319/371472 [7:15:32<24:26:49,  3.18it/s]
 25%|██▍       | 91320/371472 [7:15:32<23:08:38,  3.36it/s]
                                                           
{'loss': 3.917, 'learning_rate': 7.791161197181582e-07, 'epoch': 3.93}

 25%|██▍       | 91320/371472 [7:15:32<23:08:38,  3.36it/s]
 25%|██▍       | 91321/371472 [7:15:33<22:33:34,  3.45it/s]
 25%|██▍       | 91322/371472 [7:15:33<23:00:12,  3.38it/s]
 25%|██▍       | 91323/371472 [7:15:33<22:13:35,  3.50it/s]
 25%|██▍       | 91324/371472 [7:15:34<21:49:09,  3.57it/s]
 25%|██▍       | 91325/371472 [7:15:34<21:33:48,  3.61it/s]
 25%|██▍       | 91326/371472 [7:15:34<22:54:51,  3.40it/s]
 25%|██▍       | 91327/371472 [7:15:34<21:38:45,  3.60it/s]
 25%|██▍       | 91328/371472 [7:15:35<22:39:22,  3.43it/s]
 25%|██▍       | 91329/371472 [7:15:35<21:48:48,  3.57it/s]
 25%|██▍       | 91330/371472 [7:15:35<20:52:12,  3.73it/s]
 25%|██▍       | 91331/371472 [7:15:35<20:58:59,  3.71it/s]
 25%|██▍       | 91332/371472 [7:15:36<20:58:55,  3.71it/s]
 25%|██▍       | 91333/371472 [7:15:36<20:22:50,  3.82it/s]
 25%|██▍       | 91334/371472 [7:15:36<20:44:46,  3.75it/s]
 25%|██▍       | 91335/371472 [7:15:37<21:01:16,  3.70it/s]
 25%|██▍       | 91336/371472 [7:15:37<20:41:55,  3.76it/s]
 25%|██▍       | 91337/371472 [7:15:37<20:49:44,  3.74it/s]
 25%|██▍       | 91338/371472 [7:15:37<21:04:44,  3.69it/s]
 25%|██▍       | 91339/371472 [7:15:38<21:58:06,  3.54it/s]
 25%|██▍       | 91340/371472 [7:15:38<21:21:20,  3.64it/s]
                                                           
{'loss': 3.83, 'learning_rate': 7.790676377426792e-07, 'epoch': 3.93}

 25%|██▍       | 91340/371472 [7:15:38<21:21:20,  3.64it/s]
 25%|██▍       | 91341/371472 [7:15:38<21:55:53,  3.55it/s]
 25%|██▍       | 91342/371472 [7:15:38<21:14:18,  3.66it/s]
 25%|██▍       | 91343/371472 [7:15:39<21:47:12,  3.57it/s]
 25%|██▍       | 91344/371472 [7:15:39<21:00:06,  3.71it/s]
 25%|██▍       | 91345/371472 [7:15:39<21:09:05,  3.68it/s]
 25%|██▍       | 91346/371472 [7:15:40<20:45:53,  3.75it/s]
 25%|██▍       | 91347/371472 [7:15:40<22:07:54,  3.52it/s]
 25%|██▍       | 91348/371472 [7:15:40<21:32:55,  3.61it/s]
 25%|██▍       | 91349/371472 [7:15:40<21:44:43,  3.58it/s]
 25%|██▍       | 91350/371472 [7:15:41<22:28:52,  3.46it/s]
 25%|██▍       | 91351/371472 [7:15:41<23:09:41,  3.36it/s]
 25%|██▍       | 91352/371472 [7:15:41<22:34:51,  3.45it/s]
 25%|██▍       | 91353/371472 [7:15:42<22:00:22,  3.54it/s]
 25%|██▍       | 91354/371472 [7:15:42<21:22:15,  3.64it/s]
 25%|██▍       | 91355/371472 [7:15:42<22:24:58,  3.47it/s]
 25%|██▍       | 91356/371472 [7:15:42<21:47:35,  3.57it/s]
 25%|██▍       | 91357/371472 [7:15:43<21:35:50,  3.60it/s]
 25%|██▍       | 91358/371472 [7:15:43<21:08:13,  3.68it/s]
 25%|██▍       | 91359/371472 [7:15:43<22:10:55,  3.51it/s]
 25%|██▍       | 91360/371472 [7:15:44<22:39:13,  3.43it/s]
                                                           
{'loss': 3.6783, 'learning_rate': 7.790191557672003e-07, 'epoch': 3.94}

 25%|██▍       | 91360/371472 [7:15:44<22:39:13,  3.43it/s]
 25%|██▍       | 91361/371472 [7:15:44<22:44:26,  3.42it/s]
 25%|██▍       | 91362/371472 [7:15:44<22:17:33,  3.49it/s]
 25%|██▍       | 91363/371472 [7:15:44<21:49:19,  3.57it/s]
 25%|██▍       | 91364/371472 [7:15:45<21:21:57,  3.64it/s]
 25%|██▍       | 91365/371472 [7:15:45<21:15:29,  3.66it/s]
 25%|██▍       | 91366/371472 [7:15:45<20:33:20,  3.79it/s]
 25%|██▍       | 91367/371472 [7:15:45<21:39:16,  3.59it/s]
 25%|██▍       | 91368/371472 [7:15:46<21:24:54,  3.63it/s]
 25%|██▍       | 91369/371472 [7:15:46<21:45:24,  3.58it/s]
 25%|██▍       | 91370/371472 [7:15:46<22:21:59,  3.48it/s]
 25%|██▍       | 91371/371472 [7:15:47<22:03:42,  3.53it/s]
 25%|██▍       | 91372/371472 [7:15:47<21:43:29,  3.58it/s]
 25%|██▍       | 91373/371472 [7:15:47<21:29:35,  3.62it/s]
 25%|██▍       | 91374/371472 [7:15:48<24:10:04,  3.22it/s]
 25%|██▍       | 91375/371472 [7:15:48<24:34:24,  3.17it/s]
 25%|██▍       | 91376/371472 [7:15:48<23:36:45,  3.30it/s]
 25%|██▍       | 91377/371472 [7:15:48<24:31:00,  3.17it/s]
 25%|██▍       | 91378/371472 [7:15:49<24:52:40,  3.13it/s]
 25%|██▍       | 91379/371472 [7:15:49<23:20:22,  3.33it/s]
 25%|██▍       | 91380/371472 [7:15:49<22:24:31,  3.47it/s]
                                                           
{'loss': 4.1309, 'learning_rate': 7.789706737917213e-07, 'epoch': 3.94}

 25%|██▍       | 91380/371472 [7:15:49<22:24:31,  3.47it/s]
 25%|██▍       | 91381/371472 [7:15:50<22:13:22,  3.50it/s]
 25%|██▍       | 91382/371472 [7:15:50<23:59:55,  3.24it/s]
 25%|██▍       | 91383/371472 [7:15:50<22:58:43,  3.39it/s]
 25%|██▍       | 91384/371472 [7:15:51<25:14:30,  3.08it/s]
 25%|██▍       | 91385/371472 [7:15:51<24:12:58,  3.21it/s]
 25%|██▍       | 91386/371472 [7:15:51<24:24:47,  3.19it/s]
 25%|██▍       | 91387/371472 [7:15:52<24:36:17,  3.16it/s]
 25%|██▍       | 91388/371472 [7:15:52<22:46:23,  3.42it/s]
 25%|██▍       | 91389/371472 [7:15:52<22:01:32,  3.53it/s]
 25%|██▍       | 91390/371472 [7:15:52<21:43:48,  3.58it/s]
 25%|██▍       | 91391/371472 [7:15:53<22:17:10,  3.49it/s]
 25%|██▍       | 91392/371472 [7:15:53<21:32:34,  3.61it/s]
 25%|██▍       | 91393/371472 [7:15:53<23:05:21,  3.37it/s]
 25%|██▍       | 91394/371472 [7:15:54<23:55:26,  3.25it/s]
 25%|██▍       | 91395/371472 [7:15:54<22:34:22,  3.45it/s]
 25%|██▍       | 91396/371472 [7:15:54<21:53:34,  3.55it/s]
 25%|██▍       | 91397/371472 [7:15:54<21:09:02,  3.68it/s]
 25%|██▍       | 91398/371472 [7:15:55<21:08:00,  3.68it/s]
 25%|██▍       | 91399/371472 [7:15:55<20:49:33,  3.74it/s]
 25%|██▍       | 91400/371472 [7:15:55<22:00:06,  3.54it/s]
                                                           
{'loss': 3.6555, 'learning_rate': 7.789221918162424e-07, 'epoch': 3.94}

 25%|██▍       | 91400/371472 [7:15:55<22:00:06,  3.54it/s]
 25%|██▍       | 91401/371472 [7:15:55<21:04:00,  3.69it/s]
 25%|██▍       | 91402/371472 [7:15:56<20:29:12,  3.80it/s]
 25%|██▍       | 91403/371472 [7:15:56<22:36:41,  3.44it/s]
 25%|██▍       | 91404/371472 [7:15:56<21:58:15,  3.54it/s]
 25%|██▍       | 91405/371472 [7:15:57<22:05:33,  3.52it/s]
 25%|██▍       | 91406/371472 [7:15:57<21:34:03,  3.61it/s]
 25%|██▍       | 91407/371472 [7:15:57<22:26:16,  3.47it/s]
 25%|██▍       | 91408/371472 [7:15:57<21:53:25,  3.55it/s]
 25%|██▍       | 91409/371472 [7:15:58<22:00:54,  3.53it/s]
 25%|██▍       | 91410/371472 [7:15:58<22:16:37,  3.49it/s]
 25%|██▍       | 91411/371472 [7:15:58<23:26:23,  3.32it/s]
 25%|██▍       | 91412/371472 [7:15:59<22:40:24,  3.43it/s]
 25%|██▍       | 91413/371472 [7:15:59<21:45:17,  3.58it/s]
 25%|██▍       | 91414/371472 [7:15:59<20:59:13,  3.71it/s]
 25%|██▍       | 91415/371472 [7:15:59<21:26:45,  3.63it/s]
 25%|██▍       | 91416/371472 [7:16:00<21:39:10,  3.59it/s]
 25%|██▍       | 91417/371472 [7:16:00<21:41:49,  3.59it/s]
 25%|██▍       | 91418/371472 [7:16:00<21:39:58,  3.59it/s]
 25%|██▍       | 91419/371472 [7:16:00<21:17:18,  3.65it/s]
 25%|██▍       | 91420/371472 [7:16:01<21:03:09,  3.70it/s]
                                                           
{'loss': 3.735, 'learning_rate': 7.788737098407636e-07, 'epoch': 3.94}

 25%|██▍       | 91420/371472 [7:16:01<21:03:09,  3.70it/s]
 25%|██▍       | 91421/371472 [7:16:01<23:12:39,  3.35it/s]
 25%|██▍       | 91422/371472 [7:16:01<22:45:57,  3.42it/s]
 25%|██▍       | 91423/371472 [7:16:02<23:37:28,  3.29it/s]
 25%|██▍       | 91424/371472 [7:16:02<23:46:52,  3.27it/s]
 25%|██▍       | 91425/371472 [7:16:02<23:02:38,  3.38it/s]
 25%|██▍       | 91426/371472 [7:16:03<21:45:54,  3.57it/s]
 25%|██▍       | 91427/371472 [7:16:03<23:37:31,  3.29it/s]
 25%|██▍       | 91428/371472 [7:16:03<23:07:50,  3.36it/s]
 25%|██▍       | 91429/371472 [7:16:03<21:45:43,  3.57it/s]
 25%|██▍       | 91430/371472 [7:16:04<21:41:27,  3.59it/s]
 25%|██▍       | 91431/371472 [7:16:04<22:46:11,  3.42it/s]
 25%|██▍       | 91432/371472 [7:16:04<22:21:14,  3.48it/s]
 25%|██▍       | 91433/371472 [7:16:05<21:46:09,  3.57it/s]
 25%|██▍       | 91434/371472 [7:16:05<21:31:36,  3.61it/s]
 25%|██▍       | 91435/371472 [7:16:05<20:45:47,  3.75it/s]
 25%|██▍       | 91436/371472 [7:16:05<21:59:31,  3.54it/s]
 25%|██▍       | 91437/371472 [7:16:06<23:44:29,  3.28it/s]
 25%|██▍       | 91438/371472 [7:16:06<22:46:36,  3.42it/s]
 25%|██▍       | 91439/371472 [7:16:06<22:06:03,  3.52it/s]
 25%|██▍       | 91440/371472 [7:16:07<22:20:56,  3.48it/s]
                                                           
{'loss': 3.7647, 'learning_rate': 7.788252278652847e-07, 'epoch': 3.94}

 25%|██▍       | 91440/371472 [7:16:07<22:20:56,  3.48it/s]
 25%|██▍       | 91441/371472 [7:16:07<21:34:59,  3.60it/s]
 25%|██▍       | 91442/371472 [7:16:07<20:55:10,  3.72it/s]
 25%|██▍       | 91443/371472 [7:16:07<21:37:23,  3.60it/s]
 25%|██▍       | 91444/371472 [7:16:08<22:26:47,  3.47it/s]
 25%|██▍       | 91445/371472 [7:16:08<21:53:18,  3.55it/s]
 25%|██▍       | 91446/371472 [7:16:08<21:25:24,  3.63it/s]
 25%|██▍       | 91447/371472 [7:16:08<20:51:27,  3.73it/s]
 25%|██▍       | 91448/371472 [7:16:09<26:32:27,  2.93it/s]
 25%|██▍       | 91449/371472 [7:16:09<25:07:42,  3.10it/s]
 25%|██▍       | 91450/371472 [7:16:09<23:09:53,  3.36it/s]
 25%|██▍       | 91451/371472 [7:16:10<21:48:12,  3.57it/s]
 25%|██▍       | 91452/371472 [7:16:10<20:57:36,  3.71it/s]
 25%|██▍       | 91453/371472 [7:16:10<21:15:06,  3.66it/s]
 25%|██▍       | 91454/371472 [7:16:11<20:46:25,  3.74it/s]
 25%|██▍       | 91455/371472 [7:16:11<20:42:43,  3.76it/s]
 25%|██▍       | 91456/371472 [7:16:11<20:29:01,  3.80it/s]
 25%|██▍       | 91457/371472 [7:16:11<21:22:23,  3.64it/s]
 25%|██▍       | 91458/371472 [7:16:12<22:13:20,  3.50it/s]
 25%|██▍       | 91459/371472 [7:16:12<22:21:37,  3.48it/s]
 25%|██▍       | 91460/371472 [7:16:12<22:27:01,  3.46it/s]
                                                           
{'loss': 3.8945, 'learning_rate': 7.787767458898059e-07, 'epoch': 3.94}

 25%|██▍       | 91460/371472 [7:16:12<22:27:01,  3.46it/s]
 25%|██▍       | 91461/371472 [7:16:13<23:31:51,  3.31it/s]
 25%|██▍       | 91462/371472 [7:16:13<24:43:11,  3.15it/s]
 25%|██▍       | 91463/371472 [7:16:13<27:26:15,  2.83it/s]
 25%|██▍       | 91464/371472 [7:16:14<24:55:22,  3.12it/s]
 25%|██▍       | 91465/371472 [7:16:14<24:24:48,  3.19it/s]
 25%|██▍       | 91466/371472 [7:16:14<23:40:10,  3.29it/s]
 25%|██▍       | 91467/371472 [7:16:14<22:49:53,  3.41it/s]
 25%|██▍       | 91468/371472 [7:16:15<22:13:24,  3.50it/s]
 25%|██▍       | 91469/371472 [7:16:15<22:32:19,  3.45it/s]
 25%|██▍       | 91470/371472 [7:16:15<23:52:06,  3.26it/s]
 25%|██▍       | 91471/371472 [7:16:16<22:37:08,  3.44it/s]
 25%|██▍       | 91472/371472 [7:16:16<22:14:44,  3.50it/s]
 25%|██▍       | 91473/371472 [7:16:16<22:00:02,  3.54it/s]
 25%|██▍       | 91474/371472 [7:16:16<22:35:28,  3.44it/s]
 25%|██▍       | 91475/371472 [7:16:17<22:40:57,  3.43it/s]
 25%|██▍       | 91476/371472 [7:16:17<22:23:19,  3.47it/s]
 25%|██▍       | 91477/371472 [7:16:17<21:39:41,  3.59it/s]
 25%|██▍       | 91478/371472 [7:16:18<21:01:46,  3.70it/s]
 25%|██▍       | 91479/371472 [7:16:18<22:24:39,  3.47it/s]
 25%|██▍       | 91480/371472 [7:16:18<22:35:29,  3.44it/s]
                                                           
{'loss': 3.9107, 'learning_rate': 7.787282639143269e-07, 'epoch': 3.94}

 25%|██▍       | 91480/371472 [7:16:18<22:35:29,  3.44it/s]
 25%|██▍       | 91481/371472 [7:16:18<23:04:58,  3.37it/s]
 25%|██▍       | 91482/371472 [7:16:19<24:12:07,  3.21it/s]
 25%|██▍       | 91483/371472 [7:16:19<23:11:19,  3.35it/s]
 25%|██▍       | 91484/371472 [7:16:19<21:47:28,  3.57it/s]
 25%|██▍       | 91485/371472 [7:16:20<21:00:57,  3.70it/s]
 25%|██▍       | 91486/371472 [7:16:20<21:30:49,  3.62it/s]
 25%|██▍       | 91487/371472 [7:16:20<21:28:03,  3.62it/s]
 25%|██▍       | 91488/371472 [7:16:20<22:56:57,  3.39it/s]
 25%|██▍       | 91489/371472 [7:16:21<22:50:07,  3.41it/s]
 25%|██▍       | 91490/371472 [7:16:21<23:08:54,  3.36it/s]
 25%|██▍       | 91491/371472 [7:16:21<25:47:01,  3.02it/s]
 25%|██▍       | 91492/371472 [7:16:22<25:22:10,  3.07it/s]
 25%|██▍       | 91493/371472 [7:16:22<24:01:26,  3.24it/s]
 25%|██▍       | 91494/371472 [7:16:22<23:59:58,  3.24it/s]
 25%|██▍       | 91495/371472 [7:16:23<22:21:19,  3.48it/s]
 25%|██▍       | 91496/371472 [7:16:23<21:32:12,  3.61it/s]
 25%|██▍       | 91497/371472 [7:16:23<20:52:16,  3.73it/s]
 25%|██▍       | 91498/371472 [7:16:23<20:40:50,  3.76it/s]
 25%|██▍       | 91499/371472 [7:16:24<20:10:55,  3.85it/s]
 25%|██▍       | 91500/371472 [7:16:24<20:34:38,  3.78it/s]
                                                           
{'loss': 3.7594, 'learning_rate': 7.78679781938848e-07, 'epoch': 3.94}

 25%|██▍       | 91500/371472 [7:16:24<20:34:38,  3.78it/s]
 25%|██▍       | 91501/371472 [7:16:24<21:24:46,  3.63it/s]
 25%|██▍       | 91502/371472 [7:16:24<20:51:19,  3.73it/s]
 25%|██▍       | 91503/371472 [7:16:25<21:24:08,  3.63it/s]
 25%|██▍       | 91504/371472 [7:16:25<22:47:15,  3.41it/s]
 25%|██▍       | 91505/371472 [7:16:25<23:25:19,  3.32it/s]
 25%|██▍       | 91506/371472 [7:16:26<24:36:36,  3.16it/s]
 25%|██▍       | 91507/371472 [7:16:26<23:20:34,  3.33it/s]
 25%|██▍       | 91508/371472 [7:16:26<22:37:21,  3.44it/s]
 25%|██▍       | 91509/371472 [7:16:27<24:12:54,  3.21it/s]
 25%|██▍       | 91510/371472 [7:16:27<23:37:24,  3.29it/s]
 25%|██▍       | 91511/371472 [7:16:27<22:05:47,  3.52it/s]
 25%|██▍       | 91512/371472 [7:16:27<21:41:30,  3.59it/s]
 25%|██▍       | 91513/371472 [7:16:28<22:08:59,  3.51it/s]
 25%|██▍       | 91514/371472 [7:16:28<21:12:03,  3.67it/s]
 25%|██▍       | 91515/371472 [7:16:28<20:54:57,  3.72it/s]
 25%|██▍       | 91516/371472 [7:16:29<21:52:37,  3.55it/s]
 25%|██▍       | 91517/371472 [7:16:29<22:11:40,  3.50it/s]
 25%|██▍       | 91518/371472 [7:16:29<21:35:08,  3.60it/s]
 25%|██▍       | 91519/371472 [7:16:29<23:20:10,  3.33it/s]
 25%|██▍       | 91520/371472 [7:16:30<22:47:58,  3.41it/s]
                                                           
{'loss': 3.9104, 'learning_rate': 7.786312999633691e-07, 'epoch': 3.94}

 25%|██▍       | 91520/371472 [7:16:30<22:47:58,  3.41it/s]
 25%|██▍       | 91521/371472 [7:16:30<22:25:23,  3.47it/s]
 25%|██▍       | 91522/371472 [7:16:30<21:31:20,  3.61it/s]
 25%|██▍       | 91523/371472 [7:16:31<21:33:16,  3.61it/s]
 25%|██▍       | 91524/371472 [7:16:31<22:55:22,  3.39it/s]
 25%|██▍       | 91525/371472 [7:16:31<22:52:37,  3.40it/s]
 25%|██▍       | 91526/371472 [7:16:31<21:50:25,  3.56it/s]
 25%|██▍       | 91527/371472 [7:16:32<22:10:20,  3.51it/s]
 25%|██▍       | 91528/371472 [7:16:32<21:41:19,  3.59it/s]
 25%|██▍       | 91529/371472 [7:16:32<21:42:51,  3.58it/s]
 25%|██▍       | 91530/371472 [7:16:33<21:23:40,  3.63it/s]
 25%|██▍       | 91531/371472 [7:16:33<21:28:43,  3.62it/s]
 25%|██▍       | 91532/371472 [7:16:33<22:36:29,  3.44it/s]
 25%|██▍       | 91533/371472 [7:16:33<22:04:33,  3.52it/s]
 25%|██▍       | 91534/371472 [7:16:34<22:27:13,  3.46it/s]
 25%|██▍       | 91535/371472 [7:16:34<24:16:58,  3.20it/s]
 25%|██▍       | 91536/371472 [7:16:34<23:08:29,  3.36it/s]
 25%|██▍       | 91537/371472 [7:16:35<22:20:51,  3.48it/s]
 25%|██▍       | 91538/371472 [7:16:35<23:12:32,  3.35it/s]
 25%|██▍       | 91539/371472 [7:16:35<22:48:15,  3.41it/s]
 25%|██▍       | 91540/371472 [7:16:35<22:21:31,  3.48it/s]
                                                           
{'loss': 3.777, 'learning_rate': 7.785828179878903e-07, 'epoch': 3.94}

 25%|██▍       | 91540/371472 [7:16:35<22:21:31,  3.48it/s]
 25%|██▍       | 91541/371472 [7:16:36<23:17:19,  3.34it/s]
 25%|██▍       | 91542/371472 [7:16:36<23:30:09,  3.31it/s]
 25%|██▍       | 91543/371472 [7:16:36<24:23:56,  3.19it/s]
 25%|██▍       | 91544/371472 [7:16:37<23:44:04,  3.28it/s]
 25%|██▍       | 91545/371472 [7:16:37<22:21:35,  3.48it/s]
 25%|██▍       | 91546/371472 [7:16:37<23:54:34,  3.25it/s]
 25%|██▍       | 91547/371472 [7:16:38<24:25:20,  3.18it/s]
 25%|██▍       | 91548/371472 [7:16:38<25:27:42,  3.05it/s]
 25%|██▍       | 91549/371472 [7:16:38<24:09:36,  3.22it/s]
 25%|██▍       | 91550/371472 [7:16:39<23:07:13,  3.36it/s]
 25%|██▍       | 91551/371472 [7:16:39<24:48:03,  3.14it/s]
 25%|██▍       | 91552/371472 [7:16:39<23:45:00,  3.27it/s]
 25%|██▍       | 91553/371472 [7:16:39<22:41:38,  3.43it/s]
 25%|██▍       | 91554/371472 [7:16:40<21:34:44,  3.60it/s]
 25%|██▍       | 91555/371472 [7:16:40<20:43:10,  3.75it/s]
 25%|██▍       | 91556/371472 [7:16:40<21:30:01,  3.62it/s]
 25%|██▍       | 91557/371472 [7:16:40<20:50:19,  3.73it/s]
 25%|██▍       | 91558/371472 [7:16:41<21:49:19,  3.56it/s]
 25%|██▍       | 91559/371472 [7:16:41<21:48:23,  3.57it/s]
 25%|██▍       | 91560/371472 [7:16:41<20:58:33,  3.71it/s]
                                                           
{'loss': 3.76, 'learning_rate': 7.785343360124113e-07, 'epoch': 3.94}

 25%|██▍       | 91560/371472 [7:16:41<20:58:33,  3.71it/s]
 25%|██▍       | 91561/371472 [7:16:42<20:47:34,  3.74it/s]
 25%|██▍       | 91562/371472 [7:16:42<20:15:48,  3.84it/s]
 25%|██▍       | 91563/371472 [7:16:42<20:08:49,  3.86it/s]
 25%|██▍       | 91564/371472 [7:16:42<19:57:32,  3.90it/s]
 25%|██▍       | 91565/371472 [7:16:43<20:08:25,  3.86it/s]
 25%|██▍       | 91566/371472 [7:16:43<20:59:10,  3.70it/s]
 25%|██▍       | 91567/371472 [7:16:43<21:44:13,  3.58it/s]
 25%|██▍       | 91568/371472 [7:16:43<20:51:35,  3.73it/s]
 25%|██▍       | 91569/371472 [7:16:44<20:51:09,  3.73it/s]
 25%|██▍       | 91570/371472 [7:16:44<20:49:00,  3.73it/s]
 25%|██▍       | 91571/371472 [7:16:44<20:55:27,  3.72it/s]
 25%|██▍       | 91572/371472 [7:16:45<21:46:54,  3.57it/s]
 25%|██▍       | 91573/371472 [7:16:45<21:23:35,  3.63it/s]
 25%|██▍       | 91574/371472 [7:16:45<21:05:02,  3.69it/s]
 25%|██▍       | 91575/371472 [7:16:45<21:04:21,  3.69it/s]
 25%|██▍       | 91576/371472 [7:16:46<21:33:10,  3.61it/s]
 25%|██▍       | 91577/371472 [7:16:46<20:46:51,  3.74it/s]
 25%|██▍       | 91578/371472 [7:16:46<20:25:27,  3.81it/s]
 25%|██▍       | 91579/371472 [7:16:46<20:03:40,  3.88it/s]
 25%|██▍       | 91580/371472 [7:16:47<20:17:55,  3.83it/s]
                                                           
{'loss': 3.7582, 'learning_rate': 7.784858540369325e-07, 'epoch': 3.94}

 25%|██▍       | 91580/371472 [7:16:47<20:17:55,  3.83it/s]
 25%|██▍       | 91581/371472 [7:16:47<20:14:29,  3.84it/s]
 25%|██▍       | 91582/371472 [7:16:47<20:13:12,  3.85it/s]
 25%|██▍       | 91583/371472 [7:16:47<19:52:40,  3.91it/s]
 25%|██▍       | 91584/371472 [7:16:48<20:22:54,  3.81it/s]
 25%|██▍       | 91585/371472 [7:16:48<19:59:15,  3.89it/s]
 25%|██▍       | 91586/371472 [7:16:48<20:22:00,  3.82it/s]
 25%|██▍       | 91587/371472 [7:16:49<22:21:23,  3.48it/s]
 25%|██▍       | 91588/371472 [7:16:49<22:55:31,  3.39it/s]
 25%|██▍       | 91589/371472 [7:16:49<22:28:32,  3.46it/s]
 25%|██▍       | 91590/371472 [7:16:49<21:10:39,  3.67it/s]
 25%|██▍       | 91591/371472 [7:16:50<20:48:16,  3.74it/s]
 25%|██▍       | 91592/371472 [7:16:50<21:38:20,  3.59it/s]
 25%|██▍       | 91593/371472 [7:16:50<20:58:49,  3.71it/s]
 25%|██▍       | 91594/371472 [7:16:51<22:37:26,  3.44it/s]
 25%|██▍       | 91595/371472 [7:16:51<21:52:02,  3.56it/s]
 25%|██▍       | 91596/371472 [7:16:51<21:08:04,  3.68it/s]
 25%|██▍       | 91597/371472 [7:16:51<22:04:53,  3.52it/s]
 25%|██▍       | 91598/371472 [7:16:52<21:56:07,  3.54it/s]
 25%|██▍       | 91599/371472 [7:16:52<21:51:52,  3.56it/s]
 25%|██▍       | 91600/371472 [7:16:52<22:41:46,  3.43it/s]
                                                           
{'loss': 3.845, 'learning_rate': 7.784373720614536e-07, 'epoch': 3.95}

 25%|██▍       | 91600/371472 [7:16:52<22:41:46,  3.43it/s]
 25%|██▍       | 91601/371472 [7:16:53<22:27:01,  3.46it/s]
 25%|██▍       | 91602/371472 [7:16:53<22:39:25,  3.43it/s]
 25%|██▍       | 91603/371472 [7:16:53<24:05:51,  3.23it/s]
 25%|██▍       | 91604/371472 [7:16:53<22:27:04,  3.46it/s]
 25%|██▍       | 91605/371472 [7:16:54<22:22:26,  3.47it/s]
 25%|██▍       | 91606/371472 [7:16:54<22:10:54,  3.50it/s]
 25%|██▍       | 91607/371472 [7:16:54<21:45:01,  3.57it/s]
 25%|██▍       | 91608/371472 [7:16:54<21:00:42,  3.70it/s]
 25%|██▍       | 91609/371472 [7:16:55<20:47:40,  3.74it/s]
 25%|██▍       | 91610/371472 [7:16:55<21:26:50,  3.62it/s]
 25%|██▍       | 91611/371472 [7:16:55<20:46:50,  3.74it/s]
 25%|██▍       | 91612/371472 [7:16:56<20:21:29,  3.82it/s]
 25%|██▍       | 91613/371472 [7:16:56<19:46:23,  3.93it/s]
 25%|██▍       | 91614/371472 [7:16:56<20:27:07,  3.80it/s]
 25%|██▍       | 91615/371472 [7:16:56<20:47:33,  3.74it/s]
 25%|██▍       | 91616/371472 [7:16:57<20:56:29,  3.71it/s]
 25%|██▍       | 91617/371472 [7:16:57<20:52:01,  3.73it/s]
 25%|██▍       | 91618/371472 [7:16:57<21:12:50,  3.66it/s]
 25%|██▍       | 91619/371472 [7:16:58<24:19:16,  3.20it/s]
 25%|██▍       | 91620/371472 [7:16:58<25:05:24,  3.10it/s]
                                                           
{'loss': 3.8376, 'learning_rate': 7.783888900859747e-07, 'epoch': 3.95}

 25%|██▍       | 91620/371472 [7:16:58<25:05:24,  3.10it/s]
 25%|██▍       | 91621/371472 [7:16:58<24:20:33,  3.19it/s]
 25%|██▍       | 91622/371472 [7:16:58<23:06:45,  3.36it/s]
 25%|██▍       | 91623/371472 [7:16:59<22:09:39,  3.51it/s]
 25%|██▍       | 91624/371472 [7:16:59<22:04:05,  3.52it/s]
 25%|██▍       | 91625/371472 [7:16:59<21:21:41,  3.64it/s]
 25%|██▍       | 91626/371472 [7:17:00<21:04:58,  3.69it/s]
 25%|██▍       | 91627/371472 [7:17:00<21:21:06,  3.64it/s]
 25%|██▍       | 91628/371472 [7:17:00<20:47:54,  3.74it/s]
 25%|██▍       | 91629/371472 [7:17:00<22:11:33,  3.50it/s]
 25%|██▍       | 91630/371472 [7:17:01<21:50:12,  3.56it/s]
 25%|██▍       | 91631/371472 [7:17:01<21:12:06,  3.67it/s]
 25%|██▍       | 91632/371472 [7:17:01<21:04:12,  3.69it/s]
 25%|██▍       | 91633/371472 [7:17:01<20:20:14,  3.82it/s]
 25%|██▍       | 91634/371472 [7:17:02<22:21:13,  3.48it/s]
 25%|██▍       | 91635/371472 [7:17:02<21:46:21,  3.57it/s]
 25%|██▍       | 91636/371472 [7:17:02<22:46:01,  3.41it/s]
 25%|██▍       | 91637/371472 [7:17:03<22:31:57,  3.45it/s]
 25%|██▍       | 91638/371472 [7:17:03<23:01:23,  3.38it/s]
 25%|██▍       | 91639/371472 [7:17:03<22:04:40,  3.52it/s]
 25%|██▍       | 91640/371472 [7:17:03<22:41:13,  3.43it/s]
                                                           
{'loss': 3.6206, 'learning_rate': 7.783404081104957e-07, 'epoch': 3.95}

 25%|██▍       | 91640/371472 [7:17:03<22:41:13,  3.43it/s]
 25%|██▍       | 91641/371472 [7:17:04<22:51:54,  3.40it/s]
 25%|██▍       | 91642/371472 [7:17:04<22:14:04,  3.50it/s]
 25%|██▍       | 91643/371472 [7:17:04<22:11:14,  3.50it/s]
 25%|██▍       | 91644/371472 [7:17:05<22:50:05,  3.40it/s]
 25%|██▍       | 91645/371472 [7:17:05<22:43:12,  3.42it/s]
 25%|██▍       | 91646/371472 [7:17:05<22:07:04,  3.51it/s]
 25%|██▍       | 91647/371472 [7:17:05<22:02:14,  3.53it/s]
 25%|██▍       | 91648/371472 [7:17:06<21:37:57,  3.59it/s]
 25%|██▍       | 91649/371472 [7:17:06<21:43:21,  3.58it/s]
 25%|██▍       | 91650/371472 [7:17:06<21:41:55,  3.58it/s]
 25%|██▍       | 91651/371472 [7:17:07<21:23:34,  3.63it/s]
 25%|██▍       | 91652/371472 [7:17:07<21:18:54,  3.65it/s]
 25%|██▍       | 91653/371472 [7:17:07<21:35:24,  3.60it/s]
 25%|██▍       | 91654/371472 [7:17:07<21:09:17,  3.67it/s]
 25%|██▍       | 91655/371472 [7:17:08<22:22:13,  3.47it/s]
 25%|██▍       | 91656/371472 [7:17:08<23:42:53,  3.28it/s]
 25%|██▍       | 91657/371472 [7:17:08<23:19:48,  3.33it/s]
 25%|██▍       | 91658/371472 [7:17:09<22:44:05,  3.42it/s]
 25%|██▍       | 91659/371472 [7:17:09<22:39:54,  3.43it/s]
 25%|██▍       | 91660/371472 [7:17:09<22:11:59,  3.50it/s]
                                                           
{'loss': 3.7836, 'learning_rate': 7.782919261350168e-07, 'epoch': 3.95}

 25%|██▍       | 91660/371472 [7:17:09<22:11:59,  3.50it/s]
 25%|██▍       | 91661/371472 [7:17:09<22:29:17,  3.46it/s]
 25%|██▍       | 91662/371472 [7:17:10<21:48:49,  3.56it/s]
 25%|██▍       | 91663/371472 [7:17:10<22:01:03,  3.53it/s]
 25%|██▍       | 91664/371472 [7:17:10<21:19:11,  3.65it/s]
 25%|██▍       | 91665/371472 [7:17:11<21:31:37,  3.61it/s]
 25%|██▍       | 91666/371472 [7:17:11<20:50:57,  3.73it/s]
 25%|██▍       | 91667/371472 [7:17:11<21:01:36,  3.70it/s]
 25%|██▍       | 91668/371472 [7:17:11<20:30:59,  3.79it/s]
 25%|██▍       | 91669/371472 [7:17:12<22:32:03,  3.45it/s]
 25%|██▍       | 91670/371472 [7:17:12<21:35:18,  3.60it/s]
 25%|██▍       | 91671/371472 [7:17:12<22:58:45,  3.38it/s]
 25%|██▍       | 91672/371472 [7:17:13<22:10:03,  3.51it/s]
 25%|██▍       | 91673/371472 [7:17:13<22:43:13,  3.42it/s]
 25%|██▍       | 91674/371472 [7:17:13<21:40:04,  3.59it/s]
 25%|██▍       | 91675/371472 [7:17:13<22:34:09,  3.44it/s]
 25%|██▍       | 91676/371472 [7:17:14<22:05:13,  3.52it/s]
 25%|██▍       | 91677/371472 [7:17:14<22:04:31,  3.52it/s]
 25%|██▍       | 91678/371472 [7:17:14<21:53:09,  3.55it/s]
 25%|██▍       | 91679/371472 [7:17:15<21:24:11,  3.63it/s]
 25%|██▍       | 91680/371472 [7:17:15<20:40:56,  3.76it/s]
                                                           
{'loss': 4.0539, 'learning_rate': 7.78243444159538e-07, 'epoch': 3.95}

 25%|██▍       | 91680/371472 [7:17:15<20:40:56,  3.76it/s]
 25%|██▍       | 91681/371472 [7:17:15<20:18:28,  3.83it/s]
 25%|██▍       | 91682/371472 [7:17:15<22:06:10,  3.52it/s]
 25%|██▍       | 91683/371472 [7:17:16<21:49:30,  3.56it/s]
 25%|██▍       | 91684/371472 [7:17:16<22:20:31,  3.48it/s]
 25%|██▍       | 91685/371472 [7:17:16<23:37:10,  3.29it/s]
 25%|██▍       | 91686/371472 [7:17:17<22:50:33,  3.40it/s]
 25%|██▍       | 91687/371472 [7:17:17<22:39:23,  3.43it/s]
 25%|██▍       | 91688/371472 [7:17:17<23:24:39,  3.32it/s]
 25%|██▍       | 91689/371472 [7:17:17<24:05:48,  3.23it/s]
 25%|██▍       | 91690/371472 [7:17:18<22:36:37,  3.44it/s]
 25%|██▍       | 91691/371472 [7:17:18<22:26:16,  3.46it/s]
 25%|██▍       | 91692/371472 [7:17:18<23:42:36,  3.28it/s]
 25%|██▍       | 91693/371472 [7:17:19<23:18:12,  3.33it/s]
 25%|██▍       | 91694/371472 [7:17:19<22:13:46,  3.50it/s]
 25%|██▍       | 91695/371472 [7:17:19<21:23:05,  3.63it/s]
 25%|██▍       | 91696/371472 [7:17:19<21:12:14,  3.67it/s]
 25%|██▍       | 91697/371472 [7:17:20<21:27:33,  3.62it/s]
 25%|██▍       | 91698/371472 [7:17:20<20:51:54,  3.72it/s]
 25%|██▍       | 91699/371472 [7:17:20<20:48:33,  3.73it/s]
 25%|██▍       | 91700/371472 [7:17:20<20:30:23,  3.79it/s]
                                                           
{'loss': 3.8973, 'learning_rate': 7.781949621840592e-07, 'epoch': 3.95}

 25%|██▍       | 91700/371472 [7:17:20<20:30:23,  3.79it/s]
 25%|██▍       | 91701/371472 [7:17:21<21:32:34,  3.61it/s]
 25%|██▍       | 91702/371472 [7:17:21<21:56:05,  3.54it/s]
 25%|██▍       | 91703/371472 [7:17:21<21:48:19,  3.56it/s]
 25%|██▍       | 91704/371472 [7:17:22<21:15:04,  3.66it/s]
 25%|██▍       | 91705/371472 [7:17:22<21:07:06,  3.68it/s]
 25%|██▍       | 91706/371472 [7:17:22<21:43:43,  3.58it/s]
 25%|██▍       | 91707/371472 [7:17:22<21:18:14,  3.65it/s]
 25%|██▍       | 91708/371472 [7:17:23<22:23:02,  3.47it/s]
 25%|██▍       | 91709/371472 [7:17:23<23:09:27,  3.36it/s]
 25%|██▍       | 91710/371472 [7:17:23<22:14:18,  3.49it/s]
 25%|██▍       | 91711/371472 [7:17:24<21:33:15,  3.61it/s]
 25%|██▍       | 91712/371472 [7:17:24<20:45:13,  3.74it/s]
 25%|██▍       | 91713/371472 [7:17:24<20:26:09,  3.80it/s]
 25%|██▍       | 91714/371472 [7:17:24<22:08:51,  3.51it/s]
 25%|██▍       | 91715/371472 [7:17:25<24:21:15,  3.19it/s]
 25%|██▍       | 91716/371472 [7:17:25<22:49:10,  3.41it/s]
 25%|██▍       | 91717/371472 [7:17:25<22:04:22,  3.52it/s]
 25%|██▍       | 91718/371472 [7:17:26<21:19:50,  3.64it/s]
 25%|██▍       | 91719/371472 [7:17:26<23:36:43,  3.29it/s]
 25%|██▍       | 91720/371472 [7:17:26<23:14:24,  3.34it/s]
                                                           
{'loss': 3.7282, 'learning_rate': 7.781464802085802e-07, 'epoch': 3.95}

 25%|██▍       | 91720/371472 [7:17:26<23:14:24,  3.34it/s]
 25%|██▍       | 91721/371472 [7:17:27<23:06:03,  3.36it/s]
 25%|██▍       | 91722/371472 [7:17:27<27:10:37,  2.86it/s]
 25%|██▍       | 91723/371472 [7:17:27<25:28:07,  3.05it/s]
 25%|██▍       | 91724/371472 [7:17:28<23:24:22,  3.32it/s]
 25%|██▍       | 91725/371472 [7:17:28<22:58:54,  3.38it/s]
 25%|██▍       | 91726/371472 [7:17:28<21:53:57,  3.55it/s]
 25%|██▍       | 91727/371472 [7:17:28<22:19:48,  3.48it/s]
 25%|██▍       | 91728/371472 [7:17:29<22:03:53,  3.52it/s]
 25%|██▍       | 91729/371472 [7:17:29<22:41:15,  3.43it/s]
 25%|██▍       | 91730/371472 [7:17:29<21:50:36,  3.56it/s]
 25%|██▍       | 91731/371472 [7:17:29<22:05:45,  3.52it/s]
 25%|██▍       | 91732/371472 [7:17:30<21:38:39,  3.59it/s]
 25%|██▍       | 91733/371472 [7:17:30<21:44:59,  3.57it/s]
 25%|██▍       | 91734/371472 [7:17:30<22:13:54,  3.50it/s]
 25%|██▍       | 91735/371472 [7:17:31<21:19:42,  3.64it/s]
 25%|██▍       | 91736/371472 [7:17:31<21:21:57,  3.64it/s]
 25%|██▍       | 91737/371472 [7:17:31<20:42:29,  3.75it/s]
 25%|██▍       | 91738/371472 [7:17:31<20:33:24,  3.78it/s]
 25%|██▍       | 91739/371472 [7:17:32<20:27:30,  3.80it/s]
 25%|██▍       | 91740/371472 [7:17:32<20:58:58,  3.70it/s]
                                                           
{'loss': 3.8039, 'learning_rate': 7.780979982331013e-07, 'epoch': 3.95}

 25%|██▍       | 91740/371472 [7:17:32<20:58:58,  3.70it/s]
 25%|██▍       | 91741/371472 [7:17:32<21:35:02,  3.60it/s]
 25%|██▍       | 91742/371472 [7:17:32<21:22:12,  3.64it/s]
 25%|██▍       | 91743/371472 [7:17:33<21:24:15,  3.63it/s]
 25%|██▍       | 91744/371472 [7:17:33<22:07:26,  3.51it/s]
 25%|██▍       | 91745/371472 [7:17:33<22:33:21,  3.44it/s]
 25%|██▍       | 91746/371472 [7:17:34<22:31:25,  3.45it/s]
 25%|██▍       | 91747/371472 [7:17:34<21:59:16,  3.53it/s]
 25%|██▍       | 91748/371472 [7:17:34<23:21:28,  3.33it/s]
 25%|██▍       | 91749/371472 [7:17:35<23:04:46,  3.37it/s]
 25%|██▍       | 91750/371472 [7:17:35<25:21:13,  3.06it/s]
 25%|██▍       | 91751/371472 [7:17:35<24:18:25,  3.20it/s]
 25%|██▍       | 91752/371472 [7:17:35<22:39:44,  3.43it/s]
 25%|██▍       | 91753/371472 [7:17:36<22:37:26,  3.43it/s]
 25%|██▍       | 91754/371472 [7:17:36<22:39:58,  3.43it/s]
 25%|██▍       | 91755/371472 [7:17:36<22:08:58,  3.51it/s]
 25%|██▍       | 91756/371472 [7:17:37<21:59:04,  3.53it/s]
 25%|██▍       | 91757/371472 [7:17:37<21:55:40,  3.54it/s]
 25%|██▍       | 91758/371472 [7:17:37<22:13:24,  3.50it/s]
 25%|██▍       | 91759/371472 [7:17:37<22:07:15,  3.51it/s]
 25%|██▍       | 91760/371472 [7:17:38<21:30:25,  3.61it/s]
                                                           
{'loss': 3.8443, 'learning_rate': 7.780495162576224e-07, 'epoch': 3.95}

 25%|██▍       | 91760/371472 [7:17:38<21:30:25,  3.61it/s]
 25%|██▍       | 91761/371472 [7:17:38<22:14:44,  3.49it/s]
 25%|██▍       | 91762/371472 [7:17:38<22:47:25,  3.41it/s]
 25%|██▍       | 91763/371472 [7:17:39<21:57:32,  3.54it/s]
 25%|██▍       | 91764/371472 [7:17:39<22:34:52,  3.44it/s]
 25%|██▍       | 91765/371472 [7:17:39<22:18:52,  3.48it/s]
 25%|██▍       | 91766/371472 [7:17:39<22:54:33,  3.39it/s]
 25%|██▍       | 91767/371472 [7:17:40<21:56:18,  3.54it/s]
 25%|██▍       | 91768/371472 [7:17:40<21:29:19,  3.62it/s]
 25%|██▍       | 91769/371472 [7:17:40<21:40:32,  3.58it/s]
 25%|██▍       | 91770/371472 [7:17:41<21:10:53,  3.67it/s]
 25%|██▍       | 91771/371472 [7:17:41<24:28:52,  3.17it/s]
 25%|██▍       | 91772/371472 [7:17:41<24:08:47,  3.22it/s]
 25%|██▍       | 91773/371472 [7:17:42<23:20:31,  3.33it/s]
 25%|██▍       | 91774/371472 [7:17:42<21:56:26,  3.54it/s]
 25%|██▍       | 91775/371472 [7:17:42<24:36:01,  3.16it/s]
 25%|██▍       | 91776/371472 [7:17:42<23:50:13,  3.26it/s]
 25%|██▍       | 91777/371472 [7:17:43<23:51:02,  3.26it/s]
 25%|██▍       | 91778/371472 [7:17:43<22:56:36,  3.39it/s]
 25%|██▍       | 91779/371472 [7:17:43<21:48:43,  3.56it/s]
 25%|██▍       | 91780/371472 [7:17:44<22:01:06,  3.53it/s]
                                                           
{'loss': 3.8807, 'learning_rate': 7.780010342821435e-07, 'epoch': 3.95}

 25%|██▍       | 91780/371472 [7:17:44<22:01:06,  3.53it/s]
 25%|██▍       | 91781/371472 [7:17:44<21:55:15,  3.54it/s]
 25%|██▍       | 91782/371472 [7:17:44<22:07:31,  3.51it/s]
 25%|██▍       | 91783/371472 [7:17:44<22:31:29,  3.45it/s]
 25%|██▍       | 91784/371472 [7:17:45<23:43:23,  3.27it/s]
 25%|██▍       | 91785/371472 [7:17:45<23:08:10,  3.36it/s]
 25%|██▍       | 91786/371472 [7:17:45<22:16:01,  3.49it/s]
 25%|██▍       | 91787/371472 [7:17:46<22:36:01,  3.44it/s]
 25%|██▍       | 91788/371472 [7:17:46<22:32:38,  3.45it/s]
 25%|██▍       | 91789/371472 [7:17:46<22:39:00,  3.43it/s]
 25%|██▍       | 91790/371472 [7:17:46<21:46:10,  3.57it/s]
 25%|██▍       | 91791/371472 [7:17:47<21:14:49,  3.66it/s]
 25%|██▍       | 91792/371472 [7:17:47<21:39:18,  3.59it/s]
 25%|██▍       | 91793/371472 [7:17:47<21:53:35,  3.55it/s]
 25%|██▍       | 91794/371472 [7:17:48<21:18:52,  3.64it/s]
 25%|██▍       | 91795/371472 [7:17:48<21:35:28,  3.60it/s]
 25%|██▍       | 91796/371472 [7:17:48<23:29:20,  3.31it/s]
 25%|██▍       | 91797/371472 [7:17:48<23:40:40,  3.28it/s]
 25%|██▍       | 91798/371472 [7:17:49<24:03:56,  3.23it/s]
 25%|██▍       | 91799/371472 [7:17:49<23:18:07,  3.33it/s]
 25%|██▍       | 91800/371472 [7:17:49<22:17:49,  3.48it/s]
                                                           
{'loss': 3.641, 'learning_rate': 7.779525523066645e-07, 'epoch': 3.95}

 25%|██▍       | 91800/371472 [7:17:49<22:17:49,  3.48it/s]
 25%|██▍       | 91801/371472 [7:17:50<22:03:28,  3.52it/s]
 25%|██▍       | 91802/371472 [7:17:50<22:13:52,  3.49it/s]
 25%|██▍       | 91803/371472 [7:17:50<22:24:46,  3.47it/s]
 25%|██▍       | 91804/371472 [7:17:50<21:35:34,  3.60it/s]
 25%|██▍       | 91805/371472 [7:17:51<21:57:39,  3.54it/s]
 25%|██▍       | 91806/371472 [7:17:51<21:47:44,  3.56it/s]
 25%|██▍       | 91807/371472 [7:17:51<21:47:23,  3.57it/s]
 25%|██▍       | 91808/371472 [7:17:52<21:30:33,  3.61it/s]
 25%|██▍       | 91809/371472 [7:17:52<22:36:44,  3.44it/s]
 25%|██▍       | 91810/371472 [7:17:52<22:41:37,  3.42it/s]
 25%|██▍       | 91811/371472 [7:17:52<21:51:48,  3.55it/s]
 25%|██▍       | 91812/371472 [7:17:53<21:35:41,  3.60it/s]
 25%|██▍       | 91813/371472 [7:17:53<21:42:26,  3.58it/s]
 25%|██▍       | 91814/371472 [7:17:53<21:06:44,  3.68it/s]
 25%|██▍       | 91815/371472 [7:17:54<20:44:13,  3.75it/s]
 25%|██▍       | 91816/371472 [7:17:54<20:19:55,  3.82it/s]
 25%|██▍       | 91817/371472 [7:17:54<20:39:29,  3.76it/s]
 25%|██▍       | 91818/371472 [7:17:54<21:04:13,  3.69it/s]
 25%|██▍       | 91819/371472 [7:17:55<21:30:04,  3.61it/s]
 25%|██▍       | 91820/371472 [7:17:55<20:58:11,  3.70it/s]
                                                           
{'loss': 3.9185, 'learning_rate': 7.779040703311857e-07, 'epoch': 3.95}

 25%|██▍       | 91820/371472 [7:17:55<20:58:11,  3.70it/s]
 25%|██▍       | 91821/371472 [7:17:55<21:33:27,  3.60it/s]
 25%|██▍       | 91822/371472 [7:17:56<27:33:24,  2.82it/s]
 25%|██▍       | 91823/371472 [7:17:56<26:01:15,  2.99it/s]
 25%|██▍       | 91824/371472 [7:17:56<24:04:33,  3.23it/s]
 25%|██▍       | 91825/371472 [7:17:56<22:43:51,  3.42it/s]
 25%|██▍       | 91826/371472 [7:17:57<22:12:02,  3.50it/s]
 25%|██▍       | 91827/371472 [7:17:57<21:23:22,  3.63it/s]
 25%|██▍       | 91828/371472 [7:17:57<21:44:59,  3.57it/s]
 25%|██▍       | 91829/371472 [7:17:58<21:25:07,  3.63it/s]
 25%|██▍       | 91830/371472 [7:17:58<21:26:57,  3.62it/s]
 25%|██▍       | 91831/371472 [7:17:58<21:39:12,  3.59it/s]
 25%|██▍       | 91832/371472 [7:17:58<21:38:36,  3.59it/s]
 25%|██▍       | 91833/371472 [7:17:59<20:57:14,  3.71it/s]
 25%|██▍       | 91834/371472 [7:17:59<21:31:45,  3.61it/s]
 25%|██▍       | 91835/371472 [7:17:59<22:26:09,  3.46it/s]
 25%|██▍       | 91836/371472 [7:18:00<22:40:56,  3.42it/s]
 25%|██▍       | 91837/371472 [7:18:00<24:16:20,  3.20it/s]
 25%|██▍       | 91838/371472 [7:18:00<23:33:45,  3.30it/s]
 25%|██▍       | 91839/371472 [7:18:00<22:28:40,  3.46it/s]
 25%|██▍       | 91840/371472 [7:18:01<22:22:05,  3.47it/s]
                                                           
{'loss': 3.8025, 'learning_rate': 7.778555883557069e-07, 'epoch': 3.96}

 25%|██▍       | 91840/371472 [7:18:01<22:22:05,  3.47it/s]
 25%|██▍       | 91841/371472 [7:18:01<21:29:03,  3.62it/s]
 25%|██▍       | 91842/371472 [7:18:01<21:43:24,  3.58it/s]
 25%|██▍       | 91843/371472 [7:18:02<21:18:25,  3.65it/s]
 25%|██▍       | 91844/371472 [7:18:02<22:17:09,  3.49it/s]
 25%|██▍       | 91845/371472 [7:18:02<22:14:49,  3.49it/s]
 25%|██▍       | 91846/371472 [7:18:02<22:29:33,  3.45it/s]
 25%|██▍       | 91847/371472 [7:18:03<23:24:57,  3.32it/s]
 25%|██▍       | 91848/371472 [7:18:03<23:44:46,  3.27it/s]
 25%|██▍       | 91849/371472 [7:18:03<22:35:36,  3.44it/s]
 25%|██▍       | 91850/371472 [7:18:04<21:53:30,  3.55it/s]
 25%|██▍       | 91851/371472 [7:18:04<20:51:29,  3.72it/s]
 25%|██▍       | 91852/371472 [7:18:04<21:35:50,  3.60it/s]
 25%|██▍       | 91853/371472 [7:18:04<21:37:09,  3.59it/s]
 25%|██▍       | 91854/371472 [7:18:05<21:11:43,  3.66it/s]
 25%|██▍       | 91855/371472 [7:18:05<20:37:19,  3.77it/s]
 25%|██▍       | 91856/371472 [7:18:05<20:27:57,  3.80it/s]
 25%|██▍       | 91857/371472 [7:18:05<20:56:19,  3.71it/s]
 25%|██▍       | 91858/371472 [7:18:06<21:28:22,  3.62it/s]
 25%|██▍       | 91859/371472 [7:18:06<20:53:21,  3.72it/s]
 25%|██▍       | 91860/371472 [7:18:06<21:46:36,  3.57it/s]
                                                           
{'loss': 3.7172, 'learning_rate': 7.77807106380228e-07, 'epoch': 3.96}

 25%|██▍       | 91860/371472 [7:18:06<21:46:36,  3.57it/s]
 25%|██▍       | 91861/371472 [7:18:07<24:00:17,  3.24it/s]
 25%|██▍       | 91862/371472 [7:18:07<22:28:07,  3.46it/s]
 25%|██▍       | 91863/371472 [7:18:07<21:32:20,  3.61it/s]
 25%|██▍       | 91864/371472 [7:18:07<20:37:36,  3.77it/s]
 25%|██▍       | 91865/371472 [7:18:08<20:40:48,  3.76it/s]
 25%|██▍       | 91866/371472 [7:18:08<21:14:05,  3.66it/s]
 25%|██▍       | 91867/371472 [7:18:08<22:16:03,  3.49it/s]
 25%|██▍       | 91868/371472 [7:18:09<23:31:27,  3.30it/s]
 25%|██▍       | 91869/371472 [7:18:09<23:59:00,  3.24it/s]
 25%|██▍       | 91870/371472 [7:18:09<23:28:34,  3.31it/s]
 25%|██▍       | 91871/371472 [7:18:10<22:24:47,  3.47it/s]
 25%|██▍       | 91872/371472 [7:18:10<22:50:12,  3.40it/s]
 25%|██▍       | 91873/371472 [7:18:10<22:12:53,  3.50it/s]
 25%|██▍       | 91874/371472 [7:18:10<21:57:52,  3.54it/s]
 25%|██▍       | 91875/371472 [7:18:11<21:22:16,  3.63it/s]
 25%|██▍       | 91876/371472 [7:18:11<22:14:37,  3.49it/s]
 25%|██▍       | 91877/371472 [7:18:11<22:08:41,  3.51it/s]
 25%|██▍       | 91878/371472 [7:18:11<21:27:33,  3.62it/s]
 25%|██▍       | 91879/371472 [7:18:12<20:36:05,  3.77it/s]
 25%|██▍       | 91880/371472 [7:18:12<20:53:56,  3.72it/s]
                                                           
{'loss': 3.6519, 'learning_rate': 7.77758624404749e-07, 'epoch': 3.96}

 25%|██▍       | 91880/371472 [7:18:12<20:53:56,  3.72it/s]
 25%|██▍       | 91881/371472 [7:18:12<20:51:39,  3.72it/s]
 25%|██▍       | 91882/371472 [7:18:13<21:45:52,  3.57it/s]
 25%|██▍       | 91883/371472 [7:18:13<21:17:48,  3.65it/s]
 25%|██▍       | 91884/371472 [7:18:13<22:43:39,  3.42it/s]
 25%|██▍       | 91885/371472 [7:18:13<22:51:20,  3.40it/s]
 25%|██▍       | 91886/371472 [7:18:14<22:02:37,  3.52it/s]
 25%|██▍       | 91887/371472 [7:18:14<25:47:16,  3.01it/s]
 25%|██▍       | 91888/371472 [7:18:14<24:53:54,  3.12it/s]
 25%|██▍       | 91889/371472 [7:18:15<23:50:10,  3.26it/s]
 25%|██▍       | 91890/371472 [7:18:15<23:05:09,  3.36it/s]
 25%|██▍       | 91891/371472 [7:18:15<23:28:58,  3.31it/s]
 25%|██▍       | 91892/371472 [7:18:16<22:47:44,  3.41it/s]
 25%|██▍       | 91893/371472 [7:18:16<22:33:49,  3.44it/s]
 25%|██▍       | 91894/371472 [7:18:16<24:10:56,  3.21it/s]
 25%|██▍       | 91895/371472 [7:18:17<23:18:37,  3.33it/s]
 25%|██▍       | 91896/371472 [7:18:17<22:24:00,  3.47it/s]
 25%|██▍       | 91897/371472 [7:18:17<22:04:18,  3.52it/s]
 25%|██▍       | 91898/371472 [7:18:17<21:55:10,  3.54it/s]
 25%|██▍       | 91899/371472 [7:18:18<21:30:28,  3.61it/s]
 25%|██▍       | 91900/371472 [7:18:18<21:14:29,  3.66it/s]
                                                           
{'loss': 3.7237, 'learning_rate': 7.777101424292701e-07, 'epoch': 3.96}

 25%|██▍       | 91900/371472 [7:18:18<21:14:29,  3.66it/s]
 25%|██▍       | 91901/371472 [7:18:18<22:48:56,  3.40it/s]
 25%|██▍       | 91902/371472 [7:18:19<24:13:44,  3.21it/s]
 25%|██▍       | 91903/371472 [7:18:19<25:03:46,  3.10it/s]
 25%|██▍       | 91904/371472 [7:18:19<25:08:35,  3.09it/s]
 25%|██▍       | 91905/371472 [7:18:20<24:56:48,  3.11it/s]
 25%|██▍       | 91906/371472 [7:18:20<23:32:33,  3.30it/s]
 25%|██▍       | 91907/371472 [7:18:20<22:41:49,  3.42it/s]
 25%|██▍       | 91908/371472 [7:18:20<21:57:24,  3.54it/s]
 25%|██▍       | 91909/371472 [7:18:21<21:32:40,  3.60it/s]
 25%|██▍       | 91910/371472 [7:18:21<21:22:40,  3.63it/s]
 25%|██▍       | 91911/371472 [7:18:21<21:26:34,  3.62it/s]
 25%|██▍       | 91912/371472 [7:18:21<20:50:57,  3.72it/s]
 25%|██▍       | 91913/371472 [7:18:22<20:33:13,  3.78it/s]
 25%|██▍       | 91914/371472 [7:18:22<20:17:21,  3.83it/s]
 25%|██▍       | 91915/371472 [7:18:22<21:25:09,  3.63it/s]
 25%|██▍       | 91916/371472 [7:18:23<21:45:28,  3.57it/s]
 25%|██▍       | 91917/371472 [7:18:23<21:14:20,  3.66it/s]
 25%|██▍       | 91918/371472 [7:18:23<21:27:36,  3.62it/s]
 25%|██▍       | 91919/371472 [7:18:23<21:08:56,  3.67it/s]
 25%|██▍       | 91920/371472 [7:18:24<21:39:24,  3.59it/s]
                                                           
{'loss': 3.8187, 'learning_rate': 7.776616604537913e-07, 'epoch': 3.96}

 25%|██▍       | 91920/371472 [7:18:24<21:39:24,  3.59it/s]
 25%|██▍       | 91921/371472 [7:18:24<21:29:47,  3.61it/s]
 25%|██▍       | 91922/371472 [7:18:24<21:11:32,  3.66it/s]
 25%|██▍       | 91923/371472 [7:18:24<20:55:08,  3.71it/s]
 25%|██▍       | 91924/371472 [7:18:25<21:20:55,  3.64it/s]
 25%|██▍       | 91925/371472 [7:18:25<20:53:17,  3.72it/s]
 25%|██▍       | 91926/371472 [7:18:25<20:08:06,  3.86it/s]
 25%|██▍       | 91927/371472 [7:18:25<20:00:15,  3.88it/s]
 25%|██▍       | 91928/371472 [7:18:26<21:29:26,  3.61it/s]
 25%|██▍       | 91929/371472 [7:18:26<23:15:38,  3.34it/s]
 25%|██▍       | 91930/371472 [7:18:26<22:40:54,  3.42it/s]
 25%|██▍       | 91931/371472 [7:18:27<24:30:43,  3.17it/s]
 25%|██▍       | 91932/371472 [7:18:27<26:16:01,  2.96it/s]
 25%|██▍       | 91933/371472 [7:18:27<26:19:17,  2.95it/s]
 25%|██▍       | 91934/371472 [7:18:28<24:33:20,  3.16it/s]
 25%|██▍       | 91935/371472 [7:18:28<23:53:05,  3.25it/s]
 25%|██▍       | 91936/371472 [7:18:28<23:54:00,  3.25it/s]
 25%|██▍       | 91937/371472 [7:18:29<23:26:15,  3.31it/s]
 25%|██▍       | 91938/371472 [7:18:29<23:25:17,  3.32it/s]
 25%|██▍       | 91939/371472 [7:18:29<22:28:43,  3.45it/s]
 25%|██▍       | 91940/371472 [7:18:29<22:42:51,  3.42it/s]
                                                           
{'loss': 3.6389, 'learning_rate': 7.776131784783123e-07, 'epoch': 3.96}

 25%|██▍       | 91940/371472 [7:18:30<22:42:51,  3.42it/s]
 25%|██▍       | 91941/371472 [7:18:30<22:21:37,  3.47it/s]
 25%|██▍       | 91942/371472 [7:18:30<22:05:09,  3.52it/s]
 25%|██▍       | 91943/371472 [7:18:30<21:53:15,  3.55it/s]
 25%|██▍       | 91944/371472 [7:18:31<21:58:20,  3.53it/s]
 25%|██▍       | 91945/371472 [7:18:31<24:02:31,  3.23it/s]
 25%|██▍       | 91946/371472 [7:18:31<23:29:29,  3.31it/s]
 25%|██▍       | 91947/371472 [7:18:32<23:20:02,  3.33it/s]
 25%|██▍       | 91948/371472 [7:18:32<22:01:34,  3.53it/s]
 25%|██▍       | 91949/371472 [7:18:32<21:44:09,  3.57it/s]
 25%|██▍       | 91950/371472 [7:18:32<21:35:52,  3.60it/s]
 25%|██▍       | 91951/371472 [7:18:33<21:55:49,  3.54it/s]
 25%|██▍       | 91952/371472 [7:18:33<21:48:39,  3.56it/s]
 25%|██▍       | 91953/371472 [7:18:33<21:26:12,  3.62it/s]
 25%|██▍       | 91954/371472 [7:18:33<21:02:11,  3.69it/s]
 25%|██▍       | 91955/371472 [7:18:34<20:47:38,  3.73it/s]
 25%|██▍       | 91956/371472 [7:18:34<21:39:23,  3.59it/s]
 25%|██▍       | 91957/371472 [7:18:34<21:54:03,  3.55it/s]
 25%|██▍       | 91958/371472 [7:18:35<21:56:00,  3.54it/s]
 25%|██▍       | 91959/371472 [7:18:35<22:32:31,  3.44it/s]
 25%|██▍       | 91960/371472 [7:18:35<21:33:40,  3.60it/s]
                                                           
{'loss': 3.8033, 'learning_rate': 7.775646965028335e-07, 'epoch': 3.96}

 25%|██▍       | 91960/371472 [7:18:35<21:33:40,  3.60it/s]
 25%|██▍       | 91961/371472 [7:18:35<21:06:38,  3.68it/s]
 25%|██▍       | 91962/371472 [7:18:36<21:26:47,  3.62it/s]
 25%|██▍       | 91963/371472 [7:18:36<20:57:45,  3.70it/s]
 25%|██▍       | 91964/371472 [7:18:36<23:39:17,  3.28it/s]
 25%|██▍       | 91965/371472 [7:18:37<22:45:12,  3.41it/s]
 25%|██▍       | 91966/371472 [7:18:37<22:30:14,  3.45it/s]
 25%|██▍       | 91967/371472 [7:18:37<23:06:51,  3.36it/s]
 25%|██▍       | 91968/371472 [7:18:37<22:06:40,  3.51it/s]
 25%|██▍       | 91969/371472 [7:18:38<22:28:54,  3.45it/s]
 25%|██▍       | 91970/371472 [7:18:38<22:53:32,  3.39it/s]
 25%|██▍       | 91971/371472 [7:18:38<23:30:53,  3.30it/s]
 25%|██▍       | 91972/371472 [7:18:39<22:10:34,  3.50it/s]
 25%|██▍       | 91973/371472 [7:18:39<21:23:28,  3.63it/s]
 25%|██▍       | 91974/371472 [7:18:39<21:02:19,  3.69it/s]
 25%|██▍       | 91975/371472 [7:18:39<20:42:29,  3.75it/s]
 25%|██▍       | 91976/371472 [7:18:40<20:40:24,  3.76it/s]
 25%|██▍       | 91977/371472 [7:18:40<21:31:19,  3.61it/s]
 25%|██▍       | 91978/371472 [7:18:40<20:32:16,  3.78it/s]
 25%|██▍       | 91979/371472 [7:18:40<20:10:57,  3.85it/s]
 25%|██▍       | 91980/371472 [7:18:41<19:59:03,  3.88it/s]
                                                           
{'loss': 3.7367, 'learning_rate': 7.775162145273546e-07, 'epoch': 3.96}

 25%|██▍       | 91980/371472 [7:18:41<19:59:03,  3.88it/s]
 25%|██▍       | 91981/371472 [7:18:41<20:33:06,  3.78it/s]
 25%|██▍       | 91982/371472 [7:18:41<20:21:56,  3.81it/s]
 25%|██▍       | 91983/371472 [7:18:41<20:22:06,  3.81it/s]
 25%|██▍       | 91984/371472 [7:18:42<20:32:51,  3.78it/s]
 25%|██▍       | 91985/371472 [7:18:42<20:57:44,  3.70it/s]
 25%|██▍       | 91986/371472 [7:18:42<22:31:46,  3.45it/s]
 25%|██▍       | 91987/371472 [7:18:43<24:42:36,  3.14it/s]
 25%|██▍       | 91988/371472 [7:18:43<22:49:23,  3.40it/s]
 25%|██▍       | 91989/371472 [7:18:43<22:10:20,  3.50it/s]
 25%|██▍       | 91990/371472 [7:18:44<21:14:44,  3.65it/s]
 25%|██▍       | 91991/371472 [7:18:44<21:09:55,  3.67it/s]
 25%|██▍       | 91992/371472 [7:18:44<20:54:23,  3.71it/s]
 25%|██▍       | 91993/371472 [7:18:44<20:41:09,  3.75it/s]
 25%|██▍       | 91994/371472 [7:18:45<20:12:32,  3.84it/s]
 25%|██▍       | 91995/371472 [7:18:45<20:42:27,  3.75it/s]
 25%|██▍       | 91996/371472 [7:18:45<21:13:46,  3.66it/s]
 25%|██▍       | 91997/371472 [7:18:45<20:50:58,  3.72it/s]
 25%|██▍       | 91998/371472 [7:18:46<22:45:02,  3.41it/s]
 25%|██▍       | 91999/371472 [7:18:46<23:20:49,  3.33it/s]
 25%|██▍       | 92000/371472 [7:18:46<21:54:33,  3.54it/s]
                                                           
{'loss': 3.5215, 'learning_rate': 7.774677325518757e-07, 'epoch': 3.96}

 25%|██▍       | 92000/371472 [7:18:46<21:54:33,  3.54it/s]
 25%|██▍       | 92001/371472 [7:18:47<21:40:51,  3.58it/s]
 25%|██▍       | 92002/371472 [7:18:47<23:02:53,  3.37it/s]
 25%|██▍       | 92003/371472 [7:18:47<23:45:51,  3.27it/s]
 25%|██▍       | 92004/371472 [7:18:48<22:56:10,  3.38it/s]
 25%|██▍       | 92005/371472 [7:18:48<21:38:49,  3.59it/s]
 25%|██▍       | 92006/371472 [7:18:48<21:45:17,  3.57it/s]
 25%|██▍       | 92007/371472 [7:18:48<21:39:59,  3.58it/s]
 25%|██▍       | 92008/371472 [7:18:49<20:42:48,  3.75it/s]
 25%|██▍       | 92009/371472 [7:18:49<21:09:38,  3.67it/s]
 25%|██▍       | 92010/371472 [7:18:49<20:37:04,  3.77it/s]
 25%|██▍       | 92011/371472 [7:18:49<21:11:30,  3.66it/s]
 25%|██▍       | 92012/371472 [7:18:50<21:03:05,  3.69it/s]
 25%|██▍       | 92013/371472 [7:18:50<21:39:17,  3.58it/s]
 25%|██▍       | 92014/371472 [7:18:50<22:22:42,  3.47it/s]
 25%|██▍       | 92015/371472 [7:18:51<21:57:18,  3.54it/s]
 25%|██▍       | 92016/371472 [7:18:51<22:29:57,  3.45it/s]
 25%|██▍       | 92017/371472 [7:18:51<21:43:31,  3.57it/s]
 25%|██▍       | 92018/371472 [7:18:51<20:50:38,  3.72it/s]
 25%|██▍       | 92019/371472 [7:18:52<20:40:08,  3.76it/s]
 25%|██▍       | 92020/371472 [7:18:52<21:14:20,  3.65it/s]
                                                           
{'loss': 3.7358, 'learning_rate': 7.774192505763967e-07, 'epoch': 3.96}

 25%|██▍       | 92020/371472 [7:18:52<21:14:20,  3.65it/s]
 25%|██▍       | 92021/371472 [7:18:52<22:21:07,  3.47it/s]
 25%|██▍       | 92022/371472 [7:18:52<22:31:21,  3.45it/s]
 25%|██▍       | 92023/371472 [7:18:53<22:57:38,  3.38it/s]
 25%|██▍       | 92024/371472 [7:18:53<22:01:21,  3.52it/s]
 25%|██▍       | 92025/371472 [7:18:53<23:57:30,  3.24it/s]
 25%|██▍       | 92026/371472 [7:18:54<25:36:12,  3.03it/s]
 25%|██▍       | 92027/371472 [7:18:54<23:33:56,  3.29it/s]
 25%|██▍       | 92028/371472 [7:18:54<22:15:47,  3.49it/s]
 25%|██▍       | 92029/371472 [7:18:55<21:53:01,  3.55it/s]
 25%|██▍       | 92030/371472 [7:18:55<20:50:01,  3.73it/s]
 25%|██▍       | 92031/371472 [7:18:55<20:41:39,  3.75it/s]
 25%|██▍       | 92032/371472 [7:18:55<20:31:13,  3.78it/s]
 25%|██▍       | 92033/371472 [7:18:56<19:52:00,  3.91it/s]
 25%|██▍       | 92034/371472 [7:18:56<19:40:11,  3.95it/s]
 25%|██▍       | 92035/371472 [7:18:56<19:29:29,  3.98it/s]
 25%|██▍       | 92036/371472 [7:18:56<19:54:03,  3.90it/s]
 25%|██▍       | 92037/371472 [7:18:57<19:40:31,  3.95it/s]
 25%|██▍       | 92038/371472 [7:18:57<20:29:48,  3.79it/s]
 25%|██▍       | 92039/371472 [7:18:57<21:03:09,  3.69it/s]
 25%|██▍       | 92040/371472 [7:18:57<21:07:46,  3.67it/s]
                                                           
{'loss': 3.8196, 'learning_rate': 7.773707686009179e-07, 'epoch': 3.96}

 25%|██▍       | 92040/371472 [7:18:57<21:07:46,  3.67it/s]
 25%|██▍       | 92041/371472 [7:18:58<21:28:03,  3.62it/s]
 25%|██▍       | 92042/371472 [7:18:58<20:41:30,  3.75it/s]
 25%|██▍       | 92043/371472 [7:18:58<22:35:09,  3.44it/s]
 25%|██▍       | 92044/371472 [7:18:59<21:41:35,  3.58it/s]
 25%|██▍       | 92045/371472 [7:18:59<21:50:20,  3.55it/s]
 25%|██▍       | 92046/371472 [7:18:59<22:33:06,  3.44it/s]
 25%|██▍       | 92047/371472 [7:18:59<21:53:01,  3.55it/s]
 25%|██▍       | 92048/371472 [7:19:00<22:30:16,  3.45it/s]
 25%|██▍       | 92049/371472 [7:19:00<22:07:58,  3.51it/s]
 25%|██▍       | 92050/371472 [7:19:00<21:31:56,  3.60it/s]
 25%|██▍       | 92051/371472 [7:19:01<21:59:23,  3.53it/s]
 25%|██▍       | 92052/371472 [7:19:01<23:08:24,  3.35it/s]
 25%|██▍       | 92053/371472 [7:19:01<21:48:04,  3.56it/s]
 25%|██▍       | 92054/371472 [7:19:01<23:39:48,  3.28it/s]
 25%|██▍       | 92055/371472 [7:19:02<23:42:45,  3.27it/s]
 25%|██▍       | 92056/371472 [7:19:02<22:29:07,  3.45it/s]
 25%|██▍       | 92057/371472 [7:19:02<21:36:31,  3.59it/s]
 25%|██▍       | 92058/371472 [7:19:03<22:06:08,  3.51it/s]
 25%|██▍       | 92059/371472 [7:19:03<21:42:29,  3.58it/s]
 25%|██▍       | 92060/371472 [7:19:03<20:46:21,  3.74it/s]
                                                           
{'loss': 3.8156, 'learning_rate': 7.77322286625439e-07, 'epoch': 3.97}

 25%|██▍       | 92060/371472 [7:19:03<20:46:21,  3.74it/s]
 25%|██▍       | 92061/371472 [7:19:03<20:14:32,  3.83it/s]
 25%|██▍       | 92062/371472 [7:19:04<20:11:55,  3.84it/s]
 25%|██▍       | 92063/371472 [7:19:04<19:57:51,  3.89it/s]
 25%|██▍       | 92064/371472 [7:19:04<21:11:16,  3.66it/s]
 25%|██▍       | 92065/371472 [7:19:04<22:20:28,  3.47it/s]
 25%|██▍       | 92066/371472 [7:19:05<21:37:10,  3.59it/s]
 25%|██▍       | 92067/371472 [7:19:05<23:14:09,  3.34it/s]
 25%|██▍       | 92068/371472 [7:19:05<22:57:27,  3.38it/s]
 25%|██▍       | 92069/371472 [7:19:06<22:16:25,  3.48it/s]
 25%|██▍       | 92070/371472 [7:19:06<21:35:34,  3.59it/s]
 25%|██▍       | 92071/371472 [7:19:06<22:10:06,  3.50it/s]
 25%|██▍       | 92072/371472 [7:19:07<22:38:37,  3.43it/s]
 25%|██▍       | 92073/371472 [7:19:07<21:58:59,  3.53it/s]
 25%|██▍       | 92074/371472 [7:19:07<21:28:55,  3.61it/s]
 25%|██▍       | 92075/371472 [7:19:07<21:05:13,  3.68it/s]
 25%|██▍       | 92076/371472 [7:19:08<21:08:05,  3.67it/s]
 25%|██▍       | 92077/371472 [7:19:08<21:16:01,  3.65it/s]
 25%|██▍       | 92078/371472 [7:19:08<21:02:02,  3.69it/s]
 25%|██▍       | 92079/371472 [7:19:08<21:03:49,  3.68it/s]
 25%|██▍       | 92080/371472 [7:19:09<20:40:54,  3.75it/s]
                                                           
{'loss': 3.7631, 'learning_rate': 7.772738046499602e-07, 'epoch': 3.97}

 25%|██▍       | 92080/371472 [7:19:09<20:40:54,  3.75it/s]
 25%|██▍       | 92081/371472 [7:19:09<20:28:55,  3.79it/s]
 25%|██▍       | 92082/371472 [7:19:09<19:45:33,  3.93it/s]
 25%|██▍       | 92083/371472 [7:19:09<19:29:16,  3.98it/s]
 25%|██▍       | 92084/371472 [7:19:10<20:59:41,  3.70it/s]
 25%|██▍       | 92085/371472 [7:19:10<21:09:45,  3.67it/s]
 25%|██▍       | 92086/371472 [7:19:10<21:13:24,  3.66it/s]
 25%|██▍       | 92087/371472 [7:19:10<20:34:14,  3.77it/s]
 25%|██▍       | 92088/371472 [7:19:11<21:07:29,  3.67it/s]
 25%|██▍       | 92089/371472 [7:19:11<21:25:42,  3.62it/s]
 25%|██▍       | 92090/371472 [7:19:11<21:10:02,  3.67it/s]
 25%|██▍       | 92091/371472 [7:19:12<23:05:25,  3.36it/s]
 25%|██▍       | 92092/371472 [7:19:12<22:12:01,  3.50it/s]
 25%|██▍       | 92093/371472 [7:19:12<21:29:32,  3.61it/s]
 25%|██▍       | 92094/371472 [7:19:13<24:09:30,  3.21it/s]
 25%|██▍       | 92095/371472 [7:19:13<22:41:24,  3.42it/s]
 25%|██▍       | 92096/371472 [7:19:13<22:49:33,  3.40it/s]
 25%|██▍       | 92097/371472 [7:19:13<21:41:15,  3.58it/s]
 25%|██▍       | 92098/371472 [7:19:14<20:50:23,  3.72it/s]
 25%|██▍       | 92099/371472 [7:19:14<22:08:17,  3.51it/s]
 25%|██▍       | 92100/371472 [7:19:14<21:24:09,  3.63it/s]
                                                           
{'loss': 3.7843, 'learning_rate': 7.772253226744812e-07, 'epoch': 3.97}

 25%|██▍       | 92100/371472 [7:19:14<21:24:09,  3.63it/s]
 25%|██▍       | 92101/371472 [7:19:14<21:14:26,  3.65it/s]
 25%|██▍       | 92102/371472 [7:19:15<21:42:57,  3.57it/s]
 25%|██▍       | 92103/371472 [7:19:15<21:07:07,  3.67it/s]
 25%|██▍       | 92104/371472 [7:19:15<20:09:10,  3.85it/s]
 25%|██▍       | 92105/371472 [7:19:15<19:54:09,  3.90it/s]
 25%|██▍       | 92106/371472 [7:19:16<21:43:13,  3.57it/s]
 25%|██▍       | 92107/371472 [7:19:16<21:19:36,  3.64it/s]
 25%|██▍       | 92108/371472 [7:19:16<21:07:23,  3.67it/s]
 25%|██▍       | 92109/371472 [7:19:17<21:24:00,  3.63it/s]
 25%|██▍       | 92110/371472 [7:19:17<20:41:58,  3.75it/s]
 25%|██▍       | 92111/371472 [7:19:17<20:37:41,  3.76it/s]
 25%|██▍       | 92112/371472 [7:19:17<20:44:28,  3.74it/s]
 25%|██▍       | 92113/371472 [7:19:18<21:10:39,  3.66it/s]
 25%|██▍       | 92114/371472 [7:19:18<20:34:29,  3.77it/s]
 25%|██▍       | 92115/371472 [7:19:18<20:51:58,  3.72it/s]
 25%|██▍       | 92116/371472 [7:19:18<20:26:45,  3.80it/s]
 25%|██▍       | 92117/371472 [7:19:19<21:32:28,  3.60it/s]
 25%|██▍       | 92118/371472 [7:19:19<21:11:54,  3.66it/s]
 25%|██▍       | 92119/371472 [7:19:19<21:00:17,  3.69it/s]
 25%|██▍       | 92120/371472 [7:19:20<20:50:15,  3.72it/s]
                                                           
{'loss': 3.8394, 'learning_rate': 7.771768406990023e-07, 'epoch': 3.97}

 25%|██▍       | 92120/371472 [7:19:20<20:50:15,  3.72it/s]
 25%|██▍       | 92121/371472 [7:19:20<21:26:42,  3.62it/s]
 25%|██▍       | 92122/371472 [7:19:20<21:37:37,  3.59it/s]
 25%|██▍       | 92123/371472 [7:19:21<23:31:09,  3.30it/s]
 25%|██▍       | 92124/371472 [7:19:21<22:31:24,  3.45it/s]
 25%|██▍       | 92125/371472 [7:19:21<23:15:15,  3.34it/s]
 25%|██▍       | 92126/371472 [7:19:21<22:50:02,  3.40it/s]
 25%|██▍       | 92127/371472 [7:19:22<22:43:54,  3.41it/s]
 25%|██▍       | 92128/371472 [7:19:22<24:45:39,  3.13it/s]
 25%|██▍       | 92129/371472 [7:19:22<24:56:04,  3.11it/s]
 25%|██▍       | 92130/371472 [7:19:23<25:46:13,  3.01it/s]
 25%|██▍       | 92131/371472 [7:19:23<24:04:56,  3.22it/s]
 25%|██▍       | 92132/371472 [7:19:23<22:39:01,  3.43it/s]
 25%|██▍       | 92133/371472 [7:19:24<23:39:17,  3.28it/s]
 25%|██▍       | 92134/371472 [7:19:24<24:50:27,  3.12it/s]
 25%|██▍       | 92135/371472 [7:19:24<23:29:58,  3.30it/s]
 25%|██▍       | 92136/371472 [7:19:24<23:08:52,  3.35it/s]
 25%|██▍       | 92137/371472 [7:19:25<21:47:03,  3.56it/s]
 25%|██▍       | 92138/371472 [7:19:25<22:32:24,  3.44it/s]
 25%|██▍       | 92139/371472 [7:19:25<22:02:12,  3.52it/s]
 25%|██▍       | 92140/371472 [7:19:26<22:02:35,  3.52it/s]
                                                           
{'loss': 3.8936, 'learning_rate': 7.771283587235234e-07, 'epoch': 3.97}

 25%|██▍       | 92140/371472 [7:19:26<22:02:35,  3.52it/s]
 25%|██▍       | 92141/371472 [7:19:26<23:10:11,  3.35it/s]
 25%|██▍       | 92142/371472 [7:19:26<22:23:15,  3.47it/s]
 25%|██▍       | 92143/371472 [7:19:27<22:53:58,  3.39it/s]
 25%|██▍       | 92144/371472 [7:19:27<22:37:50,  3.43it/s]
 25%|██▍       | 92145/371472 [7:19:27<23:28:20,  3.31it/s]
 25%|██▍       | 92146/371472 [7:19:27<23:49:23,  3.26it/s]
 25%|██▍       | 92147/371472 [7:19:28<23:08:37,  3.35it/s]
 25%|██▍       | 92148/371472 [7:19:28<22:03:15,  3.52it/s]
 25%|██▍       | 92149/371472 [7:19:28<22:21:30,  3.47it/s]
 25%|██▍       | 92150/371472 [7:19:29<22:27:21,  3.46it/s]
 25%|██▍       | 92151/371472 [7:19:29<22:45:43,  3.41it/s]
 25%|██▍       | 92152/371472 [7:19:29<22:50:57,  3.40it/s]
 25%|██▍       | 92153/371472 [7:19:29<22:03:30,  3.52it/s]
 25%|██▍       | 92154/371472 [7:19:30<21:13:44,  3.65it/s]
 25%|██▍       | 92155/371472 [7:19:30<20:57:52,  3.70it/s]
 25%|██▍       | 92156/371472 [7:19:30<22:08:15,  3.50it/s]
 25%|██▍       | 92157/371472 [7:19:30<21:27:23,  3.62it/s]
 25%|██▍       | 92158/371472 [7:19:31<20:55:40,  3.71it/s]
 25%|██▍       | 92159/371472 [7:19:31<20:50:56,  3.72it/s]
 25%|██▍       | 92160/371472 [7:19:31<20:50:30,  3.72it/s]
                                                           
{'loss': 3.8979, 'learning_rate': 7.770798767480445e-07, 'epoch': 3.97}

 25%|██▍       | 92160/371472 [7:19:31<20:50:30,  3.72it/s]
 25%|██▍       | 92161/371472 [7:19:32<20:08:51,  3.85it/s]
 25%|██▍       | 92162/371472 [7:19:32<19:36:32,  3.96it/s]
 25%|██▍       | 92163/371472 [7:19:32<19:33:24,  3.97it/s]
 25%|██▍       | 92164/371472 [7:19:32<21:25:48,  3.62it/s]
 25%|██▍       | 92165/371472 [7:19:33<21:28:47,  3.61it/s]
 25%|██▍       | 92166/371472 [7:19:33<21:20:11,  3.64it/s]
 25%|██▍       | 92167/371472 [7:19:33<21:03:58,  3.68it/s]
 25%|██▍       | 92168/371472 [7:19:33<20:39:06,  3.76it/s]
 25%|██▍       | 92169/371472 [7:19:34<20:23:59,  3.80it/s]
 25%|██▍       | 92170/371472 [7:19:34<21:27:09,  3.62it/s]
 25%|██▍       | 92171/371472 [7:19:34<21:27:18,  3.62it/s]
 25%|██▍       | 92172/371472 [7:19:35<21:03:48,  3.68it/s]
 25%|██▍       | 92173/371472 [7:19:35<20:35:27,  3.77it/s]
 25%|██▍       | 92174/371472 [7:19:35<21:32:40,  3.60it/s]
 25%|██▍       | 92175/371472 [7:19:35<21:31:02,  3.61it/s]
 25%|██▍       | 92176/371472 [7:19:36<21:30:24,  3.61it/s]
 25%|██▍       | 92177/371472 [7:19:36<23:09:21,  3.35it/s]
 25%|██▍       | 92178/371472 [7:19:36<22:01:56,  3.52it/s]
 25%|██▍       | 92179/371472 [7:19:37<21:56:37,  3.54it/s]
 25%|██▍       | 92180/371472 [7:19:37<21:55:15,  3.54it/s]
                                                           
{'loss': 3.8724, 'learning_rate': 7.770313947725656e-07, 'epoch': 3.97}

 25%|██▍       | 92180/371472 [7:19:37<21:55:15,  3.54it/s]
 25%|██▍       | 92181/371472 [7:19:37<21:09:25,  3.67it/s]
 25%|██▍       | 92182/371472 [7:19:37<21:09:18,  3.67it/s]
 25%|██▍       | 92183/371472 [7:19:38<20:37:42,  3.76it/s]
 25%|██▍       | 92184/371472 [7:19:38<20:17:46,  3.82it/s]
 25%|██▍       | 92185/371472 [7:19:38<20:16:55,  3.83it/s]
 25%|██▍       | 92186/371472 [7:19:38<20:16:55,  3.83it/s]
 25%|██▍       | 92187/371472 [7:19:39<20:50:23,  3.72it/s]
 25%|██▍       | 92188/371472 [7:19:39<20:34:01,  3.77it/s]
 25%|██▍       | 92189/371472 [7:19:39<20:52:55,  3.72it/s]
 25%|██▍       | 92190/371472 [7:19:40<23:43:55,  3.27it/s]
 25%|██▍       | 92191/371472 [7:19:40<22:41:38,  3.42it/s]
 25%|██▍       | 92192/371472 [7:19:40<21:54:05,  3.54it/s]
 25%|██▍       | 92193/371472 [7:19:40<21:12:43,  3.66it/s]
 25%|██▍       | 92194/371472 [7:19:41<20:55:43,  3.71it/s]
 25%|██▍       | 92195/371472 [7:19:41<21:32:14,  3.60it/s]
 25%|██▍       | 92196/371472 [7:19:41<20:50:03,  3.72it/s]
 25%|██▍       | 92197/371472 [7:19:41<20:34:13,  3.77it/s]
 25%|██▍       | 92198/371472 [7:19:42<21:05:11,  3.68it/s]
 25%|██▍       | 92199/371472 [7:19:42<22:53:41,  3.39it/s]
 25%|██▍       | 92200/371472 [7:19:42<24:15:44,  3.20it/s]
                                                           
{'loss': 3.8303, 'learning_rate': 7.769829127970867e-07, 'epoch': 3.97}

 25%|██▍       | 92200/371472 [7:19:42<24:15:44,  3.20it/s]
 25%|██▍       | 92201/371472 [7:19:43<24:18:48,  3.19it/s]
 25%|██▍       | 92202/371472 [7:19:43<25:01:56,  3.10it/s]
 25%|██▍       | 92203/371472 [7:19:43<24:05:58,  3.22it/s]
 25%|██▍       | 92204/371472 [7:19:44<22:47:24,  3.40it/s]
 25%|██▍       | 92205/371472 [7:19:44<24:16:52,  3.19it/s]
 25%|██▍       | 92206/371472 [7:19:44<23:13:53,  3.34it/s]
 25%|██▍       | 92207/371472 [7:19:45<24:52:07,  3.12it/s]
 25%|██▍       | 92208/371472 [7:19:45<23:39:51,  3.28it/s]
 25%|██▍       | 92209/371472 [7:19:45<23:31:01,  3.30it/s]
 25%|██▍       | 92210/371472 [7:19:45<22:03:38,  3.52it/s]
 25%|██▍       | 92211/371472 [7:19:46<21:13:09,  3.66it/s]
 25%|██▍       | 92212/371472 [7:19:46<21:32:25,  3.60it/s]
 25%|██▍       | 92213/371472 [7:19:46<20:47:00,  3.73it/s]
 25%|██▍       | 92214/371472 [7:19:46<21:41:36,  3.58it/s]
 25%|██▍       | 92215/371472 [7:19:47<21:33:30,  3.60it/s]
 25%|██▍       | 92216/371472 [7:19:47<21:56:20,  3.54it/s]
 25%|██▍       | 92217/371472 [7:19:47<22:17:14,  3.48it/s]
 25%|██▍       | 92218/371472 [7:19:48<22:19:53,  3.47it/s]
 25%|██▍       | 92219/371472 [7:19:48<22:56:51,  3.38it/s]
 25%|██▍       | 92220/371472 [7:19:48<25:40:12,  3.02it/s]
                                                           
{'loss': 3.8259, 'learning_rate': 7.769344308216079e-07, 'epoch': 3.97}

 25%|██▍       | 92220/371472 [7:19:48<25:40:12,  3.02it/s]
 25%|██▍       | 92221/371472 [7:19:49<23:48:50,  3.26it/s]
 25%|██▍       | 92222/371472 [7:19:49<24:12:10,  3.20it/s]
 25%|██▍       | 92223/371472 [7:19:49<22:40:28,  3.42it/s]
 25%|██▍       | 92224/371472 [7:19:49<22:41:47,  3.42it/s]
 25%|██▍       | 92225/371472 [7:19:50<22:44:59,  3.41it/s]
 25%|██▍       | 92226/371472 [7:19:50<21:52:03,  3.55it/s]
 25%|██▍       | 92227/371472 [7:19:50<21:45:16,  3.57it/s]
 25%|██▍       | 92228/371472 [7:19:51<22:13:18,  3.49it/s]
 25%|██▍       | 92229/371472 [7:19:51<22:26:42,  3.46it/s]
 25%|██▍       | 92230/371472 [7:19:51<21:40:28,  3.58it/s]
 25%|██▍       | 92231/371472 [7:19:51<20:59:05,  3.70it/s]
 25%|██▍       | 92232/371472 [7:19:52<20:47:30,  3.73it/s]
 25%|██▍       | 92233/371472 [7:19:52<20:23:21,  3.80it/s]
 25%|██▍       | 92234/371472 [7:19:52<22:27:21,  3.45it/s]
 25%|██▍       | 92235/371472 [7:19:53<21:51:41,  3.55it/s]
 25%|██▍       | 92236/371472 [7:19:53<21:10:18,  3.66it/s]
 25%|██▍       | 92237/371472 [7:19:53<22:12:01,  3.49it/s]
 25%|██▍       | 92238/371472 [7:19:53<22:05:16,  3.51it/s]
 25%|██▍       | 92239/371472 [7:19:54<21:38:25,  3.58it/s]
 25%|██▍       | 92240/371472 [7:19:54<20:58:01,  3.70it/s]
                                                           
{'loss': 3.7621, 'learning_rate': 7.76885948846129e-07, 'epoch': 3.97}

 25%|██▍       | 92240/371472 [7:19:54<20:58:01,  3.70it/s]
 25%|██▍       | 92241/371472 [7:19:54<22:05:09,  3.51it/s]
 25%|██▍       | 92242/371472 [7:19:55<22:57:11,  3.38it/s]
 25%|██▍       | 92243/371472 [7:19:55<23:34:49,  3.29it/s]
 25%|██▍       | 92244/371472 [7:19:55<24:10:46,  3.21it/s]
 25%|██▍       | 92245/371472 [7:19:56<28:05:16,  2.76it/s]
 25%|██▍       | 92246/371472 [7:19:56<26:04:54,  2.97it/s]
 25%|██▍       | 92247/371472 [7:19:56<25:40:01,  3.02it/s]
 25%|██▍       | 92248/371472 [7:19:57<25:58:35,  2.99it/s]
 25%|██▍       | 92249/371472 [7:19:57<24:30:02,  3.17it/s]
 25%|██▍       | 92250/371472 [7:19:57<24:34:02,  3.16it/s]
 25%|██▍       | 92251/371472 [7:19:57<23:45:07,  3.27it/s]
 25%|██▍       | 92252/371472 [7:19:58<22:59:37,  3.37it/s]
 25%|██▍       | 92253/371472 [7:19:58<22:12:18,  3.49it/s]
 25%|██▍       | 92254/371472 [7:19:58<23:02:51,  3.37it/s]
 25%|██▍       | 92255/371472 [7:19:59<22:23:13,  3.46it/s]
 25%|██▍       | 92256/371472 [7:19:59<22:20:12,  3.47it/s]
 25%|██▍       | 92257/371472 [7:19:59<21:44:26,  3.57it/s]
 25%|██▍       | 92258/371472 [7:20:00<26:20:46,  2.94it/s]
 25%|██▍       | 92259/371472 [7:20:00<23:59:29,  3.23it/s]
 25%|██▍       | 92260/371472 [7:20:00<23:48:38,  3.26it/s]
                                                           
{'loss': 3.6755, 'learning_rate': 7.7683746687065e-07, 'epoch': 3.97}

 25%|██▍       | 92260/371472 [7:20:00<23:48:38,  3.26it/s]
 25%|██▍       | 92261/371472 [7:20:00<22:57:06,  3.38it/s]
 25%|██▍       | 92262/371472 [7:20:01<23:29:29,  3.30it/s]
 25%|██▍       | 92263/371472 [7:20:01<23:00:04,  3.37it/s]
 25%|██▍       | 92264/371472 [7:20:01<25:07:12,  3.09it/s]
 25%|██▍       | 92265/371472 [7:20:02<23:23:56,  3.31it/s]
 25%|██▍       | 92266/371472 [7:20:02<23:28:33,  3.30it/s]
 25%|██▍       | 92267/371472 [7:20:02<22:43:24,  3.41it/s]
 25%|██▍       | 92268/371472 [7:20:03<23:30:52,  3.30it/s]
 25%|██▍       | 92269/371472 [7:20:03<22:53:28,  3.39it/s]
 25%|██▍       | 92270/371472 [7:20:03<21:55:58,  3.54it/s]
 25%|██▍       | 92271/371472 [7:20:03<22:10:44,  3.50it/s]
 25%|██▍       | 92272/371472 [7:20:04<24:57:19,  3.11it/s]
 25%|██▍       | 92273/371472 [7:20:04<24:00:53,  3.23it/s]
 25%|██▍       | 92274/371472 [7:20:04<22:39:33,  3.42it/s]
 25%|██▍       | 92275/371472 [7:20:05<22:24:29,  3.46it/s]
 25%|██▍       | 92276/371472 [7:20:05<21:39:15,  3.58it/s]
 25%|██▍       | 92277/371472 [7:20:05<21:13:32,  3.65it/s]
 25%|██▍       | 92278/371472 [7:20:05<21:17:09,  3.64it/s]
 25%|██▍       | 92279/371472 [7:20:06<22:41:59,  3.42it/s]
 25%|██▍       | 92280/371472 [7:20:06<21:31:30,  3.60it/s]
                                                           
{'loss': 3.6209, 'learning_rate': 7.767889848951711e-07, 'epoch': 3.97}

 25%|██▍       | 92280/371472 [7:20:06<21:31:30,  3.60it/s]
 25%|██▍       | 92281/371472 [7:20:06<21:07:36,  3.67it/s]
 25%|██▍       | 92282/371472 [7:20:06<20:22:38,  3.81it/s]
 25%|██▍       | 92283/371472 [7:20:07<21:45:15,  3.56it/s]
 25%|██▍       | 92284/371472 [7:20:07<20:48:48,  3.73it/s]
 25%|██▍       | 92285/371472 [7:20:07<20:53:26,  3.71it/s]
 25%|██▍       | 92286/371472 [7:20:08<21:08:08,  3.67it/s]
 25%|██▍       | 92287/371472 [7:20:08<20:32:18,  3.78it/s]
 25%|██▍       | 92288/371472 [7:20:08<21:05:41,  3.68it/s]
 25%|██▍       | 92289/371472 [7:20:08<21:11:51,  3.66it/s]
 25%|██▍       | 92290/371472 [7:20:09<20:59:35,  3.69it/s]
 25%|██▍       | 92291/371472 [7:20:09<21:32:34,  3.60it/s]
 25%|██▍       | 92292/371472 [7:20:09<22:38:08,  3.43it/s]
 25%|██▍       | 92293/371472 [7:20:10<23:18:22,  3.33it/s]
 25%|██▍       | 92294/371472 [7:20:10<22:55:07,  3.38it/s]
 25%|██▍       | 92295/371472 [7:20:10<21:50:12,  3.55it/s]
 25%|██▍       | 92296/371472 [7:20:10<21:23:00,  3.63it/s]
 25%|██▍       | 92297/371472 [7:20:11<23:06:24,  3.36it/s]
 25%|██▍       | 92298/371472 [7:20:11<23:38:18,  3.28it/s]
 25%|██▍       | 92299/371472 [7:20:11<23:41:03,  3.27it/s]
 25%|██▍       | 92300/371472 [7:20:12<23:41:12,  3.27it/s]
                                                           
{'loss': 3.6571, 'learning_rate': 7.767405029196923e-07, 'epoch': 3.98}

 25%|██▍       | 92300/371472 [7:20:12<23:41:12,  3.27it/s]
 25%|██▍       | 92301/371472 [7:20:12<24:05:08,  3.22it/s]
 25%|██▍       | 92302/371472 [7:20:12<22:26:30,  3.46it/s]
 25%|██▍       | 92303/371472 [7:20:13<24:27:12,  3.17it/s]
 25%|██▍       | 92304/371472 [7:20:13<23:57:05,  3.24it/s]
 25%|██▍       | 92305/371472 [7:20:13<22:27:00,  3.45it/s]
 25%|██▍       | 92306/371472 [7:20:13<21:27:08,  3.61it/s]
 25%|██▍       | 92307/371472 [7:20:14<21:58:59,  3.53it/s]
 25%|██▍       | 92308/371472 [7:20:14<21:19:18,  3.64it/s]
 25%|██▍       | 92309/371472 [7:20:14<20:34:52,  3.77it/s]
 25%|██▍       | 92310/371472 [7:20:14<20:44:48,  3.74it/s]
 25%|██▍       | 92311/371472 [7:20:15<21:18:00,  3.64it/s]
 25%|██▍       | 92312/371472 [7:20:15<22:24:10,  3.46it/s]
 25%|██▍       | 92313/371472 [7:20:15<22:14:05,  3.49it/s]
 25%|██▍       | 92314/371472 [7:20:16<22:22:19,  3.47it/s]
 25%|██▍       | 92315/371472 [7:20:16<21:30:04,  3.61it/s]
 25%|██▍       | 92316/371472 [7:20:16<21:43:35,  3.57it/s]
 25%|██▍       | 92317/371472 [7:20:16<21:55:56,  3.54it/s]
 25%|██▍       | 92318/371472 [7:20:17<22:31:30,  3.44it/s]
 25%|██▍       | 92319/371472 [7:20:17<21:40:45,  3.58it/s]
 25%|██▍       | 92320/371472 [7:20:17<21:40:11,  3.58it/s]
                                                           
{'loss': 3.761, 'learning_rate': 7.766920209442133e-07, 'epoch': 3.98}

 25%|██▍       | 92320/371472 [7:20:17<21:40:11,  3.58it/s]
 25%|██▍       | 92321/371472 [7:20:18<21:39:05,  3.58it/s]
 25%|██▍       | 92322/371472 [7:20:18<22:09:40,  3.50it/s]
 25%|██▍       | 92323/371472 [7:20:18<24:34:18,  3.16it/s]
 25%|██▍       | 92324/371472 [7:20:19<23:29:18,  3.30it/s]
 25%|██▍       | 92325/371472 [7:20:19<23:41:36,  3.27it/s]
 25%|██▍       | 92326/371472 [7:20:19<22:30:53,  3.44it/s]
 25%|██▍       | 92327/371472 [7:20:19<22:21:43,  3.47it/s]
 25%|██▍       | 92328/371472 [7:20:20<21:22:39,  3.63it/s]
 25%|██▍       | 92329/371472 [7:20:20<22:35:00,  3.43it/s]
 25%|██▍       | 92330/371472 [7:20:20<22:22:05,  3.47it/s]
 25%|██▍       | 92331/371472 [7:20:21<21:56:46,  3.53it/s]
 25%|██▍       | 92332/371472 [7:20:21<21:28:20,  3.61it/s]
 25%|██▍       | 92333/371472 [7:20:21<21:35:49,  3.59it/s]
 25%|██▍       | 92334/371472 [7:20:21<22:06:57,  3.51it/s]
 25%|██▍       | 92335/371472 [7:20:22<24:20:57,  3.18it/s]
 25%|██▍       | 92336/371472 [7:20:22<23:22:15,  3.32it/s]
 25%|██▍       | 92337/371472 [7:20:22<22:40:48,  3.42it/s]
 25%|██▍       | 92338/371472 [7:20:23<22:05:07,  3.51it/s]
 25%|██▍       | 92339/371472 [7:20:23<20:59:22,  3.69it/s]
 25%|██▍       | 92340/371472 [7:20:23<20:35:56,  3.76it/s]
                                                           
{'loss': 3.6781, 'learning_rate': 7.766435389687345e-07, 'epoch': 3.98}

 25%|██▍       | 92340/371472 [7:20:23<20:35:56,  3.76it/s]
 25%|██▍       | 92341/371472 [7:20:23<21:05:41,  3.68it/s]
 25%|██▍       | 92342/371472 [7:20:24<20:40:29,  3.75it/s]
 25%|██▍       | 92343/371472 [7:20:24<20:48:10,  3.73it/s]
 25%|██▍       | 92344/371472 [7:20:24<21:27:20,  3.61it/s]
 25%|██▍       | 92345/371472 [7:20:24<20:48:05,  3.73it/s]
 25%|██▍       | 92346/371472 [7:20:25<20:54:16,  3.71it/s]
 25%|██▍       | 92347/371472 [7:20:25<21:24:59,  3.62it/s]
 25%|██▍       | 92348/371472 [7:20:25<21:34:42,  3.59it/s]
 25%|██▍       | 92349/371472 [7:20:26<21:20:12,  3.63it/s]
 25%|██▍       | 92350/371472 [7:20:26<21:07:14,  3.67it/s]
 25%|██▍       | 92351/371472 [7:20:26<21:19:20,  3.64it/s]
 25%|██▍       | 92352/371472 [7:20:26<23:06:46,  3.35it/s]
 25%|██▍       | 92353/371472 [7:20:27<22:27:29,  3.45it/s]
 25%|██▍       | 92354/371472 [7:20:27<23:18:48,  3.33it/s]
 25%|██▍       | 92355/371472 [7:20:27<23:20:41,  3.32it/s]
 25%|██▍       | 92356/371472 [7:20:28<23:29:06,  3.30it/s]
 25%|██▍       | 92357/371472 [7:20:28<24:41:01,  3.14it/s]
 25%|██▍       | 92358/371472 [7:20:28<24:32:15,  3.16it/s]
 25%|██▍       | 92359/371472 [7:20:29<24:03:52,  3.22it/s]
 25%|██▍       | 92360/371472 [7:20:29<22:30:57,  3.44it/s]
                                                           
{'loss': 3.7519, 'learning_rate': 7.765950569932556e-07, 'epoch': 3.98}

 25%|██▍       | 92360/371472 [7:20:29<22:30:57,  3.44it/s]
 25%|██▍       | 92361/371472 [7:20:29<22:47:48,  3.40it/s]
 25%|██▍       | 92362/371472 [7:20:29<23:02:34,  3.36it/s]
 25%|██▍       | 92363/371472 [7:20:30<22:50:51,  3.39it/s]
 25%|██▍       | 92364/371472 [7:20:30<23:33:23,  3.29it/s]
 25%|██▍       | 92365/371472 [7:20:30<23:15:07,  3.33it/s]
 25%|██▍       | 92366/371472 [7:20:31<22:36:58,  3.43it/s]
 25%|██▍       | 92367/371472 [7:20:31<22:32:13,  3.44it/s]
 25%|██▍       | 92368/371472 [7:20:31<22:25:02,  3.46it/s]
 25%|██▍       | 92369/371472 [7:20:32<22:26:17,  3.46it/s]
 25%|██▍       | 92370/371472 [7:20:32<22:37:42,  3.43it/s]
 25%|██▍       | 92371/371472 [7:20:32<22:11:16,  3.49it/s]
 25%|██▍       | 92372/371472 [7:20:32<21:54:03,  3.54it/s]
 25%|██▍       | 92373/371472 [7:20:33<22:22:40,  3.46it/s]
 25%|██▍       | 92374/371472 [7:20:33<22:17:42,  3.48it/s]
 25%|██▍       | 92375/371472 [7:20:33<22:20:24,  3.47it/s]
 25%|██▍       | 92376/371472 [7:20:34<22:41:40,  3.42it/s]
 25%|██▍       | 92377/371472 [7:20:34<24:06:20,  3.22it/s]
 25%|██▍       | 92378/371472 [7:20:34<25:27:21,  3.05it/s]
 25%|██▍       | 92379/371472 [7:20:35<24:17:22,  3.19it/s]
 25%|██▍       | 92380/371472 [7:20:35<23:35:16,  3.29it/s]
                                                           
{'loss': 3.6434, 'learning_rate': 7.765465750177766e-07, 'epoch': 3.98}

 25%|██▍       | 92380/371472 [7:20:35<23:35:16,  3.29it/s]
 25%|██▍       | 92381/371472 [7:20:35<24:49:47,  3.12it/s]
 25%|██▍       | 92382/371472 [7:20:35<23:58:53,  3.23it/s]
 25%|██▍       | 92383/371472 [7:20:36<23:14:18,  3.34it/s]
 25%|██▍       | 92384/371472 [7:20:36<22:54:00,  3.39it/s]
 25%|██▍       | 92385/371472 [7:20:36<22:37:04,  3.43it/s]
 25%|██▍       | 92386/371472 [7:20:37<22:04:22,  3.51it/s]
 25%|██▍       | 92387/371472 [7:20:37<21:42:44,  3.57it/s]
 25%|██▍       | 92388/371472 [7:20:37<21:37:16,  3.59it/s]
 25%|██▍       | 92389/371472 [7:20:37<20:58:27,  3.70it/s]
 25%|██▍       | 92390/371472 [7:20:38<21:27:47,  3.61it/s]
 25%|██▍       | 92391/371472 [7:20:38<23:27:48,  3.30it/s]
 25%|██▍       | 92392/371472 [7:20:38<23:37:22,  3.28it/s]
 25%|██▍       | 92393/371472 [7:20:39<22:56:03,  3.38it/s]
 25%|██▍       | 92394/371472 [7:20:39<22:22:01,  3.47it/s]
 25%|██▍       | 92395/371472 [7:20:39<22:06:13,  3.51it/s]
 25%|██▍       | 92396/371472 [7:20:39<22:58:18,  3.37it/s]
 25%|██▍       | 92397/371472 [7:20:40<23:14:27,  3.34it/s]
 25%|██▍       | 92398/371472 [7:20:40<22:25:40,  3.46it/s]
 25%|██▍       | 92399/371472 [7:20:40<22:10:16,  3.50it/s]
 25%|██▍       | 92400/371472 [7:20:41<22:29:53,  3.45it/s]
                                                           
{'loss': 3.7371, 'learning_rate': 7.764980930422978e-07, 'epoch': 3.98}

 25%|██▍       | 92400/371472 [7:20:41<22:29:53,  3.45it/s]
 25%|██▍       | 92401/371472 [7:20:41<22:29:00,  3.45it/s]
 25%|██▍       | 92402/371472 [7:20:41<21:48:26,  3.55it/s]
 25%|██▍       | 92403/371472 [7:20:41<22:10:07,  3.50it/s]
 25%|██▍       | 92404/371472 [7:20:42<22:21:48,  3.47it/s]
 25%|██▍       | 92405/371472 [7:20:42<21:54:01,  3.54it/s]
 25%|██▍       | 92406/371472 [7:20:42<21:32:45,  3.60it/s]
 25%|██▍       | 92407/371472 [7:20:43<21:19:18,  3.64it/s]
 25%|██▍       | 92408/371472 [7:20:43<21:23:29,  3.62it/s]
 25%|██▍       | 92409/371472 [7:20:43<21:42:40,  3.57it/s]
 25%|██▍       | 92410/371472 [7:20:43<21:53:44,  3.54it/s]
 25%|██▍       | 92411/371472 [7:20:44<20:46:51,  3.73it/s]
 25%|██▍       | 92412/371472 [7:20:44<21:12:07,  3.66it/s]
 25%|██▍       | 92413/371472 [7:20:44<21:53:44,  3.54it/s]
 25%|██▍       | 92414/371472 [7:20:45<22:54:28,  3.38it/s]
 25%|██▍       | 92415/371472 [7:20:45<22:44:24,  3.41it/s]
 25%|██▍       | 92416/371472 [7:20:45<21:32:27,  3.60it/s]
 25%|██▍       | 92417/371472 [7:20:45<21:42:18,  3.57it/s]
 25%|██▍       | 92418/371472 [7:20:46<22:06:48,  3.51it/s]
 25%|██▍       | 92419/371472 [7:20:46<21:03:56,  3.68it/s]
 25%|██▍       | 92420/371472 [7:20:46<21:51:02,  3.55it/s]
                                                           
{'loss': 3.6178, 'learning_rate': 7.764496110668189e-07, 'epoch': 3.98}

 25%|██▍       | 92420/371472 [7:20:46<21:51:02,  3.55it/s]
 25%|██▍       | 92421/371472 [7:20:47<23:29:51,  3.30it/s]
 25%|██▍       | 92422/371472 [7:20:47<22:22:06,  3.47it/s]
 25%|██▍       | 92423/371472 [7:20:47<21:23:15,  3.62it/s]
 25%|██▍       | 92424/371472 [7:20:47<22:26:28,  3.45it/s]
 25%|██▍       | 92425/371472 [7:20:48<21:12:08,  3.66it/s]
 25%|██▍       | 92426/371472 [7:20:48<20:44:18,  3.74it/s]
 25%|██▍       | 92427/371472 [7:20:48<21:37:05,  3.59it/s]
 25%|██▍       | 92428/371472 [7:20:49<21:42:25,  3.57it/s]
 25%|██▍       | 92429/371472 [7:20:49<23:07:05,  3.35it/s]
 25%|██▍       | 92430/371472 [7:20:49<22:15:20,  3.48it/s]
 25%|██▍       | 92431/371472 [7:20:49<23:25:00,  3.31it/s]
 25%|██▍       | 92432/371472 [7:20:50<22:44:41,  3.41it/s]
 25%|██▍       | 92433/371472 [7:20:50<21:30:19,  3.60it/s]
 25%|██▍       | 92434/371472 [7:20:50<20:55:52,  3.70it/s]
 25%|██▍       | 92435/371472 [7:20:50<20:37:48,  3.76it/s]
 25%|██▍       | 92436/371472 [7:20:51<21:12:06,  3.66it/s]
 25%|██▍       | 92437/371472 [7:20:51<26:36:37,  2.91it/s]
 25%|██▍       | 92438/371472 [7:20:52<25:00:50,  3.10it/s]
 25%|██▍       | 92439/371472 [7:20:52<25:11:37,  3.08it/s]
 25%|██▍       | 92440/371472 [7:20:52<25:29:21,  3.04it/s]
                                                           
{'loss': 3.6757, 'learning_rate': 7.7640112909134e-07, 'epoch': 3.98}

 25%|██▍       | 92440/371472 [7:20:52<25:29:21,  3.04it/s]
 25%|██▍       | 92441/371472 [7:20:52<24:12:29,  3.20it/s]
 25%|██▍       | 92442/371472 [7:20:53<25:32:03,  3.04it/s]
 25%|██▍       | 92443/371472 [7:20:53<23:45:44,  3.26it/s]
 25%|██▍       | 92444/371472 [7:20:53<23:10:12,  3.35it/s]
 25%|██▍       | 92445/371472 [7:20:54<23:16:30,  3.33it/s]
 25%|██▍       | 92446/371472 [7:20:54<23:46:51,  3.26it/s]
 25%|██▍       | 92447/371472 [7:20:54<23:06:56,  3.35it/s]
 25%|██▍       | 92448/371472 [7:20:55<23:20:22,  3.32it/s]
 25%|██▍       | 92449/371472 [7:20:55<23:43:50,  3.27it/s]
 25%|██▍       | 92450/371472 [7:20:55<22:52:31,  3.39it/s]
 25%|██▍       | 92451/371472 [7:20:55<21:50:28,  3.55it/s]
 25%|██▍       | 92452/371472 [7:20:56<22:07:41,  3.50it/s]
 25%|██▍       | 92453/371472 [7:20:56<22:35:47,  3.43it/s]
 25%|██▍       | 92454/371472 [7:20:56<22:12:59,  3.49it/s]
 25%|██▍       | 92455/371472 [7:20:57<22:31:31,  3.44it/s]
 25%|██▍       | 92456/371472 [7:20:57<22:46:30,  3.40it/s]
 25%|██▍       | 92457/371472 [7:20:57<22:34:49,  3.43it/s]
 25%|██▍       | 92458/371472 [7:20:57<22:32:08,  3.44it/s]
 25%|██▍       | 92459/371472 [7:20:58<21:45:55,  3.56it/s]
 25%|██▍       | 92460/371472 [7:20:58<21:21:41,  3.63it/s]
                                                           
{'loss': 3.8007, 'learning_rate': 7.763526471158611e-07, 'epoch': 3.98}

 25%|██▍       | 92460/371472 [7:20:58<21:21:41,  3.63it/s]
 25%|██▍       | 92461/371472 [7:20:58<22:06:32,  3.51it/s]
 25%|██▍       | 92462/371472 [7:20:59<22:46:11,  3.40it/s]
 25%|██▍       | 92463/371472 [7:20:59<21:43:56,  3.57it/s]
 25%|██▍       | 92464/371472 [7:20:59<22:23:22,  3.46it/s]
 25%|██▍       | 92465/371472 [7:21:00<24:09:18,  3.21it/s]
 25%|██▍       | 92466/371472 [7:21:00<23:15:16,  3.33it/s]
 25%|██▍       | 92467/371472 [7:21:00<22:46:35,  3.40it/s]
 25%|██▍       | 92468/371472 [7:21:00<23:22:41,  3.32it/s]
 25%|██▍       | 92469/371472 [7:21:01<21:54:18,  3.54it/s]
 25%|██▍       | 92470/371472 [7:21:01<21:55:29,  3.53it/s]
 25%|██▍       | 92471/371472 [7:21:01<23:11:57,  3.34it/s]
 25%|██▍       | 92472/371472 [7:21:02<23:14:58,  3.33it/s]
 25%|██▍       | 92473/371472 [7:21:02<21:51:24,  3.55it/s]
 25%|██▍       | 92474/371472 [7:21:02<21:43:10,  3.57it/s]
 25%|██▍       | 92475/371472 [7:21:02<21:34:26,  3.59it/s]
 25%|██▍       | 92476/371472 [7:21:03<21:05:41,  3.67it/s]
 25%|██▍       | 92477/371472 [7:21:03<20:57:48,  3.70it/s]
 25%|██▍       | 92478/371472 [7:21:03<21:23:29,  3.62it/s]
 25%|██▍       | 92479/371472 [7:21:03<21:54:33,  3.54it/s]
 25%|██▍       | 92480/371472 [7:21:04<24:47:38,  3.13it/s]
                                                           
{'loss': 3.7136, 'learning_rate': 7.763041651403822e-07, 'epoch': 3.98}

 25%|██▍       | 92480/371472 [7:21:04<24:47:38,  3.13it/s]
 25%|██▍       | 92481/371472 [7:21:04<23:06:30,  3.35it/s]
 25%|██▍       | 92482/371472 [7:21:04<23:11:09,  3.34it/s]
 25%|██▍       | 92483/371472 [7:21:05<23:26:56,  3.30it/s]
 25%|██▍       | 92484/371472 [7:21:05<24:48:12,  3.12it/s]
 25%|██▍       | 92485/371472 [7:21:05<23:18:16,  3.33it/s]
 25%|██▍       | 92486/371472 [7:21:06<22:15:18,  3.48it/s]
 25%|██▍       | 92487/371472 [7:21:06<22:38:20,  3.42it/s]
 25%|██▍       | 92488/371472 [7:21:06<21:48:35,  3.55it/s]
 25%|██▍       | 92489/371472 [7:21:06<21:38:11,  3.58it/s]
 25%|██▍       | 92490/371472 [7:21:07<21:54:09,  3.54it/s]
 25%|██▍       | 92491/371472 [7:21:07<20:53:10,  3.71it/s]
 25%|██▍       | 92492/371472 [7:21:07<21:16:05,  3.64it/s]
 25%|██▍       | 92493/371472 [7:21:08<20:50:45,  3.72it/s]
 25%|██▍       | 92494/371472 [7:21:08<22:14:28,  3.48it/s]
 25%|██▍       | 92495/371472 [7:21:08<22:06:05,  3.51it/s]
 25%|██▍       | 92496/371472 [7:21:08<22:10:52,  3.49it/s]
 25%|██▍       | 92497/371472 [7:21:09<22:09:33,  3.50it/s]
 25%|██▍       | 92498/371472 [7:21:09<22:39:45,  3.42it/s]
 25%|██▍       | 92499/371472 [7:21:09<21:52:20,  3.54it/s]
 25%|██▍       | 92500/371472 [7:21:10<21:59:53,  3.52it/s]
                                                           
{'loss': 3.8083, 'learning_rate': 7.762556831649034e-07, 'epoch': 3.98}

 25%|██▍       | 92500/371472 [7:21:10<21:59:53,  3.52it/s]
 25%|██▍       | 92501/371472 [7:21:10<23:05:58,  3.35it/s]
 25%|██▍       | 92502/371472 [7:21:10<24:36:05,  3.15it/s]
 25%|██▍       | 92503/371472 [7:21:11<22:52:01,  3.39it/s]
 25%|██▍       | 92504/371472 [7:21:11<22:21:41,  3.47it/s]
 25%|██▍       | 92505/371472 [7:21:11<21:47:22,  3.56it/s]
 25%|██▍       | 92506/371472 [7:21:11<21:58:07,  3.53it/s]
 25%|██▍       | 92507/371472 [7:21:12<21:05:03,  3.68it/s]
 25%|██▍       | 92508/371472 [7:21:12<21:25:51,  3.62it/s]
 25%|██▍       | 92509/371472 [7:21:12<22:08:45,  3.50it/s]
 25%|██▍       | 92510/371472 [7:21:12<21:16:12,  3.64it/s]
 25%|██▍       | 92511/371472 [7:21:13<22:46:28,  3.40it/s]
 25%|██▍       | 92512/371472 [7:21:13<21:58:37,  3.53it/s]
 25%|██▍       | 92513/371472 [7:21:13<22:11:09,  3.49it/s]
 25%|██▍       | 92514/371472 [7:21:14<22:02:43,  3.51it/s]
 25%|██▍       | 92515/371472 [7:21:14<24:08:37,  3.21it/s]
 25%|██▍       | 92516/371472 [7:21:14<23:11:56,  3.34it/s]
 25%|██▍       | 92517/371472 [7:21:15<22:44:43,  3.41it/s]
 25%|██▍       | 92518/371472 [7:21:15<22:14:31,  3.48it/s]
 25%|██▍       | 92519/371472 [7:21:15<21:59:00,  3.52it/s]
 25%|██▍       | 92520/371472 [7:21:15<23:29:54,  3.30it/s]
                                                           
{'loss': 3.8293, 'learning_rate': 7.762072011894244e-07, 'epoch': 3.99}

 25%|██▍       | 92520/371472 [7:21:15<23:29:54,  3.30it/s]
 25%|██▍       | 92521/371472 [7:21:16<22:06:17,  3.51it/s]
 25%|██▍       | 92522/371472 [7:21:16<22:35:23,  3.43it/s]
 25%|██▍       | 92523/371472 [7:21:16<21:56:46,  3.53it/s]
 25%|██▍       | 92524/371472 [7:21:16<21:24:14,  3.62it/s]
 25%|██▍       | 92525/371472 [7:21:17<21:07:57,  3.67it/s]
 25%|██▍       | 92526/371472 [7:21:17<21:31:43,  3.60it/s]
 25%|██▍       | 92527/371472 [7:21:17<22:07:53,  3.50it/s]
 25%|██▍       | 92528/371472 [7:21:18<24:46:50,  3.13it/s]
 25%|██▍       | 92529/371472 [7:21:18<24:05:32,  3.22it/s]
 25%|██▍       | 92530/371472 [7:21:18<26:10:04,  2.96it/s]
 25%|██▍       | 92531/371472 [7:21:19<24:20:12,  3.18it/s]
 25%|██▍       | 92532/371472 [7:21:19<23:00:28,  3.37it/s]
 25%|██▍       | 92533/371472 [7:21:19<23:34:05,  3.29it/s]
 25%|██▍       | 92534/371472 [7:21:20<22:55:14,  3.38it/s]
 25%|██▍       | 92535/371472 [7:21:20<21:52:27,  3.54it/s]
 25%|██▍       | 92536/371472 [7:21:20<21:34:53,  3.59it/s]
 25%|██▍       | 92537/371472 [7:21:20<21:51:09,  3.55it/s]
 25%|██▍       | 92538/371472 [7:21:21<21:16:27,  3.64it/s]
 25%|██▍       | 92539/371472 [7:21:21<21:28:29,  3.61it/s]
 25%|██▍       | 92540/371472 [7:21:21<21:42:20,  3.57it/s]
                                                           
{'loss': 3.6425, 'learning_rate': 7.761587192139455e-07, 'epoch': 3.99}

 25%|██▍       | 92540/371472 [7:21:21<21:42:20,  3.57it/s]
 25%|██▍       | 92541/371472 [7:21:21<21:47:24,  3.56it/s]
 25%|██▍       | 92542/371472 [7:21:22<21:33:41,  3.59it/s]
 25%|██▍       | 92543/371472 [7:21:22<21:28:33,  3.61it/s]
 25%|██▍       | 92544/371472 [7:21:22<21:12:54,  3.65it/s]
 25%|██▍       | 92545/371472 [7:21:23<21:58:55,  3.52it/s]
 25%|██▍       | 92546/371472 [7:21:23<22:02:03,  3.52it/s]
 25%|██▍       | 92547/371472 [7:21:23<21:36:44,  3.58it/s]
 25%|██▍       | 92548/371472 [7:21:23<21:11:26,  3.66it/s]
 25%|██▍       | 92549/371472 [7:21:24<22:14:26,  3.48it/s]
 25%|██▍       | 92550/371472 [7:21:24<22:09:24,  3.50it/s]
 25%|██▍       | 92551/371472 [7:21:24<22:02:03,  3.52it/s]
 25%|██▍       | 92552/371472 [7:21:25<21:32:36,  3.60it/s]
 25%|██▍       | 92553/371472 [7:21:25<22:57:51,  3.37it/s]
 25%|██▍       | 92554/371472 [7:21:25<22:08:19,  3.50it/s]
 25%|██▍       | 92555/371472 [7:21:25<21:15:13,  3.65it/s]
 25%|██▍       | 92556/371472 [7:21:26<21:57:33,  3.53it/s]
 25%|██▍       | 92557/371472 [7:21:26<21:56:53,  3.53it/s]
 25%|██▍       | 92558/371472 [7:21:26<20:48:52,  3.72it/s]
 25%|██▍       | 92559/371472 [7:21:26<21:01:46,  3.68it/s]
 25%|██▍       | 92560/371472 [7:21:27<20:31:21,  3.78it/s]
                                                           
{'loss': 3.8174, 'learning_rate': 7.761102372384666e-07, 'epoch': 3.99}

 25%|██▍       | 92560/371472 [7:21:27<20:31:21,  3.78it/s]
 25%|██▍       | 92561/371472 [7:21:27<21:27:50,  3.61it/s]
 25%|██▍       | 92562/371472 [7:21:27<22:10:26,  3.49it/s]
 25%|██▍       | 92563/371472 [7:21:28<21:50:16,  3.55it/s]
 25%|██▍       | 92564/371472 [7:21:28<21:10:53,  3.66it/s]
 25%|██▍       | 92565/371472 [7:21:28<21:34:04,  3.59it/s]
 25%|██▍       | 92566/371472 [7:21:28<22:09:27,  3.50it/s]
 25%|██▍       | 92567/371472 [7:21:29<21:25:02,  3.62it/s]
 25%|██▍       | 92568/371472 [7:21:29<21:03:06,  3.68it/s]
 25%|██▍       | 92569/371472 [7:21:29<20:45:42,  3.73it/s]
 25%|██▍       | 92570/371472 [7:21:30<20:54:13,  3.71it/s]
 25%|██▍       | 92571/371472 [7:21:30<21:37:23,  3.58it/s]
 25%|██▍       | 92572/371472 [7:21:30<21:21:43,  3.63it/s]
 25%|██▍       | 92573/371472 [7:21:30<20:52:50,  3.71it/s]
 25%|██▍       | 92574/371472 [7:21:31<20:44:58,  3.73it/s]
 25%|██▍       | 92575/371472 [7:21:31<20:56:08,  3.70it/s]
 25%|██▍       | 92576/371472 [7:21:31<21:23:16,  3.62it/s]
 25%|██▍       | 92577/371472 [7:21:31<21:39:35,  3.58it/s]
 25%|██▍       | 92578/371472 [7:21:32<21:53:03,  3.54it/s]
 25%|██▍       | 92579/371472 [7:21:32<22:06:28,  3.50it/s]
 25%|██▍       | 92580/371472 [7:21:32<23:29:04,  3.30it/s]
                                                           
{'loss': 3.7386, 'learning_rate': 7.760617552629878e-07, 'epoch': 3.99}

 25%|██▍       | 92580/371472 [7:21:32<23:29:04,  3.30it/s]
 25%|██▍       | 92581/371472 [7:21:33<22:55:22,  3.38it/s]
 25%|██▍       | 92582/371472 [7:21:33<22:13:14,  3.49it/s]
 25%|██▍       | 92583/371472 [7:21:33<21:10:11,  3.66it/s]
 25%|██▍       | 92584/371472 [7:21:33<21:30:40,  3.60it/s]
 25%|██▍       | 92585/371472 [7:21:34<20:49:47,  3.72it/s]
 25%|██▍       | 92586/371472 [7:21:34<20:42:05,  3.74it/s]
 25%|██▍       | 92587/371472 [7:21:34<20:28:19,  3.78it/s]
 25%|██▍       | 92588/371472 [7:21:35<21:17:13,  3.64it/s]
 25%|██▍       | 92589/371472 [7:21:35<21:19:34,  3.63it/s]
 25%|██▍       | 92590/371472 [7:21:35<20:44:09,  3.74it/s]
 25%|██▍       | 92591/371472 [7:21:35<21:29:50,  3.60it/s]
 25%|██▍       | 92592/371472 [7:21:36<23:33:57,  3.29it/s]
 25%|██▍       | 92593/371472 [7:21:36<22:22:15,  3.46it/s]
 25%|██▍       | 92594/371472 [7:21:36<24:06:43,  3.21it/s]
 25%|██▍       | 92595/371472 [7:21:37<24:52:48,  3.11it/s]
 25%|██▍       | 92596/371472 [7:21:37<23:03:01,  3.36it/s]
 25%|██▍       | 92597/371472 [7:21:37<23:45:30,  3.26it/s]
 25%|██▍       | 92598/371472 [7:21:38<24:30:09,  3.16it/s]
 25%|██▍       | 92599/371472 [7:21:38<23:30:05,  3.30it/s]
 25%|██▍       | 92600/371472 [7:21:38<23:18:14,  3.32it/s]
                                                           
{'loss': 3.6856, 'learning_rate': 7.760132732875089e-07, 'epoch': 3.99}

 25%|██▍       | 92600/371472 [7:21:38<23:18:14,  3.32it/s]
 25%|██▍       | 92601/371472 [7:21:38<22:44:32,  3.41it/s]
 25%|██▍       | 92602/371472 [7:21:39<22:07:19,  3.50it/s]
 25%|██▍       | 92603/371472 [7:21:39<21:56:13,  3.53it/s]
 25%|██▍       | 92604/371472 [7:21:39<21:13:11,  3.65it/s]
 25%|██▍       | 92605/371472 [7:21:40<22:59:49,  3.37it/s]
 25%|██▍       | 92606/371472 [7:21:40<21:53:26,  3.54it/s]
 25%|██▍       | 92607/371472 [7:21:40<22:01:53,  3.52it/s]
 25%|██▍       | 92608/371472 [7:21:40<21:57:16,  3.53it/s]
 25%|██▍       | 92609/371472 [7:21:41<21:22:04,  3.63it/s]
 25%|██▍       | 92610/371472 [7:21:41<21:22:24,  3.62it/s]
 25%|██▍       | 92611/371472 [7:21:41<20:36:10,  3.76it/s]
 25%|██▍       | 92612/371472 [7:21:42<22:23:30,  3.46it/s]
 25%|██▍       | 92613/371472 [7:21:42<21:56:05,  3.53it/s]
 25%|██▍       | 92614/371472 [7:21:42<21:41:57,  3.57it/s]
 25%|██▍       | 92615/371472 [7:21:42<21:11:21,  3.66it/s]
 25%|██▍       | 92616/371472 [7:21:43<20:40:01,  3.75it/s]
 25%|██▍       | 92617/371472 [7:21:43<20:25:08,  3.79it/s]
 25%|██▍       | 92618/371472 [7:21:43<20:47:13,  3.73it/s]
 25%|██▍       | 92619/371472 [7:21:43<21:39:13,  3.58it/s]
 25%|██▍       | 92620/371472 [7:21:44<22:03:03,  3.51it/s]
                                                           
{'loss': 3.7373, 'learning_rate': 7.7596479131203e-07, 'epoch': 3.99}

 25%|██▍       | 92620/371472 [7:21:44<22:03:03,  3.51it/s]
 25%|██▍       | 92621/371472 [7:21:44<21:55:52,  3.53it/s]
 25%|██▍       | 92622/371472 [7:21:44<22:03:12,  3.51it/s]
 25%|██▍       | 92623/371472 [7:21:45<21:38:28,  3.58it/s]
 25%|██▍       | 92624/371472 [7:21:45<23:06:02,  3.35it/s]
 25%|██▍       | 92625/371472 [7:21:45<23:11:11,  3.34it/s]
 25%|██▍       | 92626/371472 [7:21:45<22:39:36,  3.42it/s]
 25%|██▍       | 92627/371472 [7:21:46<22:11:01,  3.49it/s]
 25%|██▍       | 92628/371472 [7:21:46<21:49:57,  3.55it/s]
 25%|██▍       | 92629/371472 [7:21:46<21:33:20,  3.59it/s]
 25%|██▍       | 92630/371472 [7:21:47<21:03:26,  3.68it/s]
 25%|██▍       | 92631/371472 [7:21:47<20:52:02,  3.71it/s]
 25%|██▍       | 92632/371472 [7:21:47<21:54:12,  3.54it/s]
 25%|██▍       | 92633/371472 [7:21:47<23:48:05,  3.25it/s]
 25%|██▍       | 92634/371472 [7:21:48<23:14:00,  3.33it/s]
 25%|██▍       | 92635/371472 [7:21:48<22:50:02,  3.39it/s]
 25%|██▍       | 92636/371472 [7:21:48<22:38:13,  3.42it/s]
 25%|██▍       | 92637/371472 [7:21:49<22:19:29,  3.47it/s]
 25%|██▍       | 92638/371472 [7:21:49<22:06:16,  3.50it/s]
 25%|██▍       | 92639/371472 [7:21:49<21:41:48,  3.57it/s]
 25%|██▍       | 92640/371472 [7:21:49<21:56:54,  3.53it/s]
                                                           
{'loss': 3.6376, 'learning_rate': 7.759163093365509e-07, 'epoch': 3.99}

 25%|██▍       | 92640/371472 [7:21:49<21:56:54,  3.53it/s]
 25%|██▍       | 92641/371472 [7:21:50<22:09:37,  3.50it/s]
 25%|██▍       | 92642/371472 [7:21:50<21:41:41,  3.57it/s]
 25%|██▍       | 92643/371472 [7:21:50<22:47:27,  3.40it/s]
 25%|██▍       | 92644/371472 [7:21:51<22:57:52,  3.37it/s]
 25%|██▍       | 92645/371472 [7:21:51<21:54:42,  3.53it/s]
 25%|██▍       | 92646/371472 [7:21:51<22:21:46,  3.46it/s]
 25%|██▍       | 92647/371472 [7:21:51<22:20:38,  3.47it/s]
 25%|██▍       | 92648/371472 [7:21:52<22:05:56,  3.50it/s]
 25%|██▍       | 92649/371472 [7:21:52<21:58:03,  3.53it/s]
 25%|██▍       | 92650/371472 [7:21:52<21:18:08,  3.64it/s]
 25%|██▍       | 92651/371472 [7:21:53<21:17:25,  3.64it/s]
 25%|██▍       | 92652/371472 [7:21:53<21:10:55,  3.66it/s]
 25%|██▍       | 92653/371472 [7:21:53<20:52:19,  3.71it/s]
 25%|██▍       | 92654/371472 [7:21:53<20:41:43,  3.74it/s]
 25%|██▍       | 92655/371472 [7:21:54<20:58:41,  3.69it/s]
 25%|██▍       | 92656/371472 [7:21:54<20:51:45,  3.71it/s]
 25%|██▍       | 92657/371472 [7:21:54<22:07:24,  3.50it/s]
 25%|██▍       | 92658/371472 [7:21:55<21:45:36,  3.56it/s]
 25%|██▍       | 92659/371472 [7:21:55<21:14:11,  3.65it/s]
 25%|██▍       | 92660/371472 [7:21:55<20:47:29,  3.72it/s]
                                                           
{'loss': 3.7604, 'learning_rate': 7.758678273610722e-07, 'epoch': 3.99}

 25%|██▍       | 92660/371472 [7:21:55<20:47:29,  3.72it/s]
 25%|██▍       | 92661/371472 [7:21:55<20:49:54,  3.72it/s]
 25%|██▍       | 92662/371472 [7:21:56<21:59:26,  3.52it/s]
 25%|██▍       | 92663/371472 [7:21:56<21:23:54,  3.62it/s]
 25%|██▍       | 92664/371472 [7:21:56<20:51:01,  3.71it/s]
 25%|██▍       | 92665/371472 [7:21:56<21:09:03,  3.66it/s]
 25%|██▍       | 92666/371472 [7:21:57<20:46:50,  3.73it/s]
 25%|██▍       | 92667/371472 [7:21:57<20:31:19,  3.77it/s]
 25%|██▍       | 92668/371472 [7:21:57<22:40:51,  3.41it/s]
 25%|██▍       | 92669/371472 [7:21:58<22:14:38,  3.48it/s]
 25%|██▍       | 92670/371472 [7:21:58<21:42:08,  3.57it/s]
 25%|██▍       | 92671/371472 [7:21:58<22:37:05,  3.42it/s]
 25%|██▍       | 92672/371472 [7:21:58<21:51:00,  3.54it/s]
 25%|██▍       | 92673/371472 [7:21:59<22:02:12,  3.51it/s]
 25%|██▍       | 92674/371472 [7:21:59<22:10:45,  3.49it/s]
 25%|██▍       | 92675/371472 [7:21:59<21:44:53,  3.56it/s]
 25%|██▍       | 92676/371472 [7:21:59<21:05:39,  3.67it/s]
 25%|██▍       | 92677/371472 [7:22:00<21:23:42,  3.62it/s]
 25%|██▍       | 92678/371472 [7:22:00<21:49:04,  3.55it/s]
 25%|██▍       | 92679/371472 [7:22:00<21:58:19,  3.52it/s]
 25%|██▍       | 92680/371472 [7:22:01<20:56:42,  3.70it/s]
                                                           
{'loss': 3.7319, 'learning_rate': 7.758193453855932e-07, 'epoch': 3.99}

 25%|██▍       | 92680/371472 [7:22:01<20:56:42,  3.70it/s]
 25%|██▍       | 92681/371472 [7:22:01<21:00:52,  3.69it/s]
 25%|██▍       | 92682/371472 [7:22:01<21:31:44,  3.60it/s]
 25%|██▍       | 92683/371472 [7:22:01<20:46:16,  3.73it/s]
 25%|██▍       | 92684/371472 [7:22:02<22:32:15,  3.44it/s]
 25%|██▍       | 92685/371472 [7:22:02<21:46:43,  3.56it/s]
 25%|██▍       | 92686/371472 [7:22:02<24:18:53,  3.18it/s]
 25%|██▍       | 92687/371472 [7:22:03<24:40:26,  3.14it/s]
 25%|██▍       | 92688/371472 [7:22:03<22:54:57,  3.38it/s]
 25%|██▍       | 92689/371472 [7:22:03<22:16:51,  3.48it/s]
 25%|██▍       | 92690/371472 [7:22:03<21:34:55,  3.59it/s]
 25%|██▍       | 92691/371472 [7:22:04<23:51:46,  3.25it/s]
 25%|██▍       | 92692/371472 [7:22:04<23:28:34,  3.30it/s]
 25%|██▍       | 92693/371472 [7:22:04<22:44:58,  3.40it/s]
 25%|██▍       | 92694/371472 [7:22:05<22:04:48,  3.51it/s]
 25%|██▍       | 92695/371472 [7:22:05<21:37:35,  3.58it/s]
 25%|██▍       | 92696/371472 [7:22:05<21:13:39,  3.65it/s]
 25%|██▍       | 92697/371472 [7:22:06<22:28:34,  3.45it/s]
 25%|██▍       | 92698/371472 [7:22:06<22:24:07,  3.46it/s]
 25%|██▍       | 92699/371472 [7:22:06<23:15:24,  3.33it/s]
 25%|██▍       | 92700/371472 [7:22:06<22:06:32,  3.50it/s]
                                                           
{'loss': 3.6841, 'learning_rate': 7.757708634101144e-07, 'epoch': 3.99}

 25%|██▍       | 92700/371472 [7:22:06<22:06:32,  3.50it/s]
 25%|██▍       | 92701/371472 [7:22:07<21:58:42,  3.52it/s]
 25%|██▍       | 92702/371472 [7:22:07<21:09:11,  3.66it/s]
 25%|██▍       | 92703/371472 [7:22:07<23:02:19,  3.36it/s]
 25%|██▍       | 92704/371472 [7:22:08<22:13:58,  3.48it/s]
 25%|██▍       | 92705/371472 [7:22:08<21:54:01,  3.54it/s]
 25%|██▍       | 92706/371472 [7:22:08<22:09:22,  3.49it/s]
 25%|██▍       | 92707/371472 [7:22:08<21:51:15,  3.54it/s]
 25%|██▍       | 92708/371472 [7:22:09<22:20:58,  3.46it/s]
 25%|██▍       | 92709/371472 [7:22:09<22:37:12,  3.42it/s]
 25%|██▍       | 92710/371472 [7:22:09<21:42:50,  3.57it/s]
 25%|██▍       | 92711/371472 [7:22:10<23:36:04,  3.28it/s]
 25%|██▍       | 92712/371472 [7:22:10<22:26:33,  3.45it/s]
 25%|██▍       | 92713/371472 [7:22:10<23:44:12,  3.26it/s]
 25%|██▍       | 92714/371472 [7:22:11<22:58:23,  3.37it/s]
 25%|██▍       | 92715/371472 [7:22:11<25:06:40,  3.08it/s]
 25%|██▍       | 92716/371472 [7:22:11<27:01:48,  2.86it/s]
 25%|██▍       | 92717/371472 [7:22:12<25:04:29,  3.09it/s]
 25%|██▍       | 92718/371472 [7:22:12<23:36:26,  3.28it/s]
 25%|██▍       | 92719/371472 [7:22:12<23:42:49,  3.27it/s]
 25%|██▍       | 92720/371472 [7:22:12<22:22:59,  3.46it/s]
                                                           
{'loss': 3.6348, 'learning_rate': 7.757223814346355e-07, 'epoch': 3.99}

 25%|██▍       | 92720/371472 [7:22:12<22:22:59,  3.46it/s]
 25%|██▍       | 92721/371472 [7:22:13<22:15:37,  3.48it/s]
 25%|██▍       | 92722/371472 [7:22:13<22:55:04,  3.38it/s]
 25%|██▍       | 92723/371472 [7:22:13<22:21:16,  3.46it/s]
 25%|██▍       | 92724/371472 [7:22:14<24:43:20,  3.13it/s]
 25%|██▍       | 92725/371472 [7:22:14<24:03:45,  3.22it/s]
 25%|██▍       | 92726/371472 [7:22:14<23:06:18,  3.35it/s]
 25%|██▍       | 92727/371472 [7:22:14<22:09:35,  3.49it/s]
 25%|██▍       | 92728/371472 [7:22:15<21:36:49,  3.58it/s]
 25%|██▍       | 92729/371472 [7:22:15<20:54:15,  3.70it/s]
 25%|██▍       | 92730/371472 [7:22:15<22:24:23,  3.46it/s]
 25%|██▍       | 92731/371472 [7:22:16<22:46:24,  3.40it/s]
 25%|██▍       | 92732/371472 [7:22:16<21:38:50,  3.58it/s]
 25%|██▍       | 92733/371472 [7:22:16<21:26:46,  3.61it/s]
 25%|██▍       | 92734/371472 [7:22:16<21:08:15,  3.66it/s]
 25%|██▍       | 92735/371472 [7:22:17<21:03:22,  3.68it/s]
 25%|██▍       | 92736/371472 [7:22:17<22:08:50,  3.50it/s]
 25%|██▍       | 92737/371472 [7:22:17<22:03:29,  3.51it/s]
 25%|██▍       | 92738/371472 [7:22:18<21:43:42,  3.56it/s]
 25%|██▍       | 92739/371472 [7:22:18<21:08:09,  3.66it/s]
 25%|██▍       | 92740/371472 [7:22:18<23:26:49,  3.30it/s]
                                                           
{'loss': 3.951, 'learning_rate': 7.756738994591567e-07, 'epoch': 3.99}

 25%|██▍       | 92740/371472 [7:22:18<23:26:49,  3.30it/s]
 25%|██▍       | 92741/371472 [7:22:18<22:58:58,  3.37it/s]
 25%|██▍       | 92742/371472 [7:22:19<22:17:32,  3.47it/s]
 25%|██▍       | 92743/371472 [7:22:19<21:51:38,  3.54it/s]
 25%|██▍       | 92744/371472 [7:22:19<21:04:09,  3.67it/s]
 25%|██▍       | 92745/371472 [7:22:19<20:42:01,  3.74it/s]
 25%|██▍       | 92746/371472 [7:22:20<20:41:43,  3.74it/s]
 25%|██▍       | 92747/371472 [7:22:20<21:19:26,  3.63it/s]
 25%|██▍       | 92748/371472 [7:22:20<21:08:47,  3.66it/s]
 25%|██▍       | 92749/371472 [7:22:21<21:16:03,  3.64it/s]
 25%|██▍       | 92750/371472 [7:22:21<21:14:36,  3.64it/s]
 25%|██▍       | 92751/371472 [7:22:21<22:09:35,  3.49it/s]
 25%|██▍       | 92752/371472 [7:22:21<21:38:33,  3.58it/s]
 25%|██▍       | 92753/371472 [7:22:22<22:53:09,  3.38it/s]
 25%|██▍       | 92754/371472 [7:22:22<23:04:49,  3.35it/s]
 25%|██▍       | 92755/371472 [7:22:22<22:31:05,  3.44it/s]
 25%|██▍       | 92756/371472 [7:22:23<21:46:25,  3.56it/s]
 25%|██▍       | 92757/371472 [7:22:23<22:16:49,  3.47it/s]
 25%|██▍       | 92758/371472 [7:22:23<21:52:57,  3.54it/s]
 25%|██▍       | 92759/371472 [7:22:23<21:30:25,  3.60it/s]
 25%|██▍       | 92760/371472 [7:22:24<20:31:13,  3.77it/s]
                                                           
{'loss': 3.8506, 'learning_rate': 7.756254174836776e-07, 'epoch': 4.0}

 25%|██▍       | 92760/371472 [7:22:24<20:31:13,  3.77it/s]
 25%|██▍       | 92761/371472 [7:22:24<20:31:20,  3.77it/s]
 25%|██▍       | 92762/371472 [7:22:24<21:05:52,  3.67it/s]
 25%|██▍       | 92763/371472 [7:22:25<21:02:20,  3.68it/s]
 25%|██▍       | 92764/371472 [7:22:25<22:26:51,  3.45it/s]
 25%|██▍       | 92765/371472 [7:22:25<22:18:36,  3.47it/s]
 25%|██▍       | 92766/371472 [7:22:25<22:30:24,  3.44it/s]
 25%|██▍       | 92767/371472 [7:22:26<23:05:30,  3.35it/s]
 25%|██▍       | 92768/371472 [7:22:26<23:52:42,  3.24it/s]
 25%|██▍       | 92769/371472 [7:22:26<24:04:41,  3.22it/s]
 25%|██▍       | 92770/371472 [7:22:27<23:14:03,  3.33it/s]
 25%|██▍       | 92771/371472 [7:22:27<24:01:27,  3.22it/s]
 25%|██▍       | 92772/371472 [7:22:27<24:05:44,  3.21it/s]
 25%|██▍       | 92773/371472 [7:22:28<23:37:50,  3.28it/s]
 25%|██▍       | 92774/371472 [7:22:28<24:19:43,  3.18it/s]
 25%|██▍       | 92775/371472 [7:22:28<23:32:26,  3.29it/s]
 25%|██▍       | 92776/371472 [7:22:28<22:39:55,  3.42it/s]
 25%|██▍       | 92777/371472 [7:22:29<21:30:16,  3.60it/s]
 25%|██▍       | 92778/371472 [7:22:29<20:57:04,  3.69it/s]
 25%|██▍       | 92779/371472 [7:22:29<22:42:51,  3.41it/s]
 25%|██▍       | 92780/371472 [7:22:30<23:14:47,  3.33it/s]
                                                           
{'loss': 3.7258, 'learning_rate': 7.755769355081988e-07, 'epoch': 4.0}

 25%|██▍       | 92780/371472 [7:22:30<23:14:47,  3.33it/s]
 25%|██▍       | 92781/371472 [7:22:30<24:49:27,  3.12it/s]
 25%|██▍       | 92782/371472 [7:22:30<23:40:53,  3.27it/s]
 25%|██▍       | 92783/371472 [7:22:31<22:57:33,  3.37it/s]
 25%|██▍       | 92784/371472 [7:22:31<21:45:12,  3.56it/s]
 25%|██▍       | 92785/371472 [7:22:31<21:01:52,  3.68it/s]
 25%|██▍       | 92786/371472 [7:22:31<21:39:49,  3.57it/s]
 25%|██▍       | 92787/371472 [7:22:32<21:53:56,  3.53it/s]
 25%|██▍       | 92788/371472 [7:22:32<22:29:21,  3.44it/s]
 25%|██▍       | 92789/371472 [7:22:32<21:47:55,  3.55it/s]
 25%|██▍       | 92790/371472 [7:22:33<21:52:51,  3.54it/s]
 25%|██▍       | 92791/371472 [7:22:33<22:06:47,  3.50it/s]
 25%|██▍       | 92792/371472 [7:22:33<21:48:38,  3.55it/s]
 25%|██▍       | 92793/371472 [7:22:33<21:51:51,  3.54it/s]
 25%|██▍       | 92794/371472 [7:22:34<22:04:18,  3.51it/s]
 25%|██▍       | 92795/371472 [7:22:34<21:39:49,  3.57it/s]
 25%|██▍       | 92796/371472 [7:22:34<21:14:13,  3.65it/s]
 25%|██▍       | 92797/371472 [7:22:34<22:11:04,  3.49it/s]
 25%|██▍       | 92798/371472 [7:22:35<21:39:04,  3.58it/s]
 25%|██▍       | 92799/371472 [7:22:35<21:14:28,  3.64it/s]
 25%|██▍       | 92800/371472 [7:22:35<21:25:36,  3.61it/s]
                                                           
{'loss': 3.7346, 'learning_rate': 7.755284535327199e-07, 'epoch': 4.0}

 25%|██▍       | 92800/371472 [7:22:35<21:25:36,  3.61it/s]
 25%|██▍       | 92801/371472 [7:22:36<20:56:12,  3.70it/s]
 25%|██▍       | 92802/371472 [7:22:36<20:42:39,  3.74it/s]
 25%|██▍       | 92803/371472 [7:22:36<21:43:19,  3.56it/s]
 25%|██▍       | 92804/371472 [7:22:36<21:35:00,  3.59it/s]
 25%|██▍       | 92805/371472 [7:22:37<20:56:30,  3.70it/s]
 25%|██▍       | 92806/371472 [7:22:37<20:38:37,  3.75it/s]
 25%|██▍       | 92807/371472 [7:22:37<21:09:00,  3.66it/s]
 25%|██▍       | 92808/371472 [7:22:37<21:17:44,  3.63it/s]
 25%|██▍       | 92809/371472 [7:22:38<20:54:35,  3.70it/s]
 25%|██▍       | 92810/371472 [7:22:38<21:01:35,  3.68it/s]
 25%|██▍       | 92811/371472 [7:22:38<22:28:43,  3.44it/s]
 25%|██▍       | 92812/371472 [7:22:39<22:47:20,  3.40it/s]
 25%|██▍       | 92813/371472 [7:22:39<21:17:56,  3.63it/s]
 25%|██▍       | 92814/371472 [7:22:39<21:04:39,  3.67it/s]
 25%|██▍       | 92815/371472 [7:22:39<21:26:16,  3.61it/s]
 25%|██▍       | 92816/371472 [7:22:40<21:19:16,  3.63it/s]
 25%|██▍       | 92817/371472 [7:22:40<20:50:43,  3.71it/s]
 25%|██▍       | 92818/371472 [7:22:40<21:02:47,  3.68it/s]
 25%|██▍       | 92819/371472 [7:22:40<20:44:11,  3.73it/s]
 25%|██▍       | 92820/371472 [7:22:41<21:01:11,  3.68it/s]
                                                           
{'loss': 3.6512, 'learning_rate': 7.75479971557241e-07, 'epoch': 4.0}

 25%|██▍       | 92820/371472 [7:22:41<21:01:11,  3.68it/s]
 25%|██▍       | 92821/371472 [7:22:41<21:09:34,  3.66it/s]
 25%|██▍       | 92822/371472 [7:22:41<23:33:43,  3.29it/s]
 25%|██▍       | 92823/371472 [7:22:42<22:50:17,  3.39it/s]
 25%|██▍       | 92824/371472 [7:22:42<23:14:11,  3.33it/s]
 25%|██▍       | 92825/371472 [7:22:42<22:22:07,  3.46it/s]
 25%|██▍       | 92826/371472 [7:22:43<22:10:21,  3.49it/s]
 25%|██▍       | 92827/371472 [7:22:43<22:04:30,  3.51it/s]
 25%|██▍       | 92828/371472 [7:22:43<21:11:25,  3.65it/s]
 25%|██▍       | 92829/371472 [7:22:43<21:23:16,  3.62it/s]
 25%|██▍       | 92830/371472 [7:22:44<21:21:42,  3.62it/s]
 25%|██▍       | 92831/371472 [7:22:44<20:53:51,  3.70it/s]
 25%|██▍       | 92832/371472 [7:22:44<20:22:14,  3.80it/s]
 25%|██▍       | 92833/371472 [7:22:45<22:36:02,  3.42it/s]
 25%|██▍       | 92834/371472 [7:22:45<22:58:31,  3.37it/s]
 25%|██▍       | 92835/371472 [7:22:45<23:23:44,  3.31it/s]
 25%|██▍       | 92836/371472 [7:22:45<23:07:10,  3.35it/s]
 25%|██▍       | 92837/371472 [7:22:46<22:00:19,  3.52it/s]
 25%|██▍       | 92838/371472 [7:22:46<22:37:38,  3.42it/s]
 25%|██▍       | 92839/371472 [7:22:46<23:00:35,  3.36it/s]
 25%|██▍       | 92840/371472 [7:22:47<22:34:23,  3.43it/s]
                                                           
{'loss': 3.7337, 'learning_rate': 7.754314895817621e-07, 'epoch': 4.0}

 25%|██▍       | 92840/371472 [7:22:47<22:34:23,  3.43it/s]
 25%|██▍       | 92841/371472 [7:22:47<21:46:47,  3.55it/s]
 25%|██▍       | 92842/371472 [7:22:47<20:59:45,  3.69it/s]
 25%|██▍       | 92843/371472 [7:22:47<21:07:09,  3.66it/s]
 25%|██▍       | 92844/371472 [7:22:48<20:46:23,  3.73it/s]
 25%|██▍       | 92845/371472 [7:22:48<20:43:01,  3.74it/s]
 25%|██▍       | 92846/371472 [7:22:48<21:26:08,  3.61it/s]
 25%|██▍       | 92847/371472 [7:22:49<24:41:57,  3.13it/s]
 25%|██▍       | 92848/371472 [7:22:49<23:02:47,  3.36it/s]
 25%|██▍       | 92849/371472 [7:22:49<23:07:28,  3.35it/s]
 25%|██▍       | 92850/371472 [7:22:49<22:34:22,  3.43it/s]
 25%|██▍       | 92851/371472 [7:22:50<23:55:26,  3.24it/s]
 25%|██▍       | 92852/371472 [7:22:50<23:59:09,  3.23it/s]
 25%|██▍       | 92853/371472 [7:22:50<23:00:08,  3.36it/s]
 25%|██▍       | 92854/371472 [7:22:51<24:04:49,  3.21it/s]
 25%|██▍       | 92855/371472 [7:22:51<23:17:21,  3.32it/s]
 25%|██▍       | 92856/371472 [7:22:51<22:46:35,  3.40it/s]
 25%|██▍       | 92857/371472 [7:22:52<22:59:19,  3.37it/s]
 25%|██▍       | 92858/371472 [7:22:52<21:42:10,  3.57it/s]
 25%|██▍       | 92859/371472 [7:22:52<22:15:39,  3.48it/s]
 25%|██▍       | 92860/371472 [7:22:52<22:40:55,  3.41it/s]
                                                           
{'loss': 3.9018, 'learning_rate': 7.753830076062833e-07, 'epoch': 4.0}

 25%|██▍       | 92860/371472 [7:22:52<22:40:55,  3.41it/s]
 25%|██▍       | 92861/371472 [7:22:53<21:40:41,  3.57it/s]
 25%|██▍       | 92862/371472 [7:22:53<21:39:26,  3.57it/s]
 25%|██▍       | 92863/371472 [7:22:53<22:13:37,  3.48it/s]
 25%|██▍       | 92864/371472 [7:22:54<21:51:30,  3.54it/s]
 25%|██▍       | 92865/371472 [7:22:54<22:14:27,  3.48it/s]
 25%|██▍       | 92866/371472 [7:22:54<21:29:19,  3.60it/s]
 25%|██▍       | 92867/371472 [7:22:54<21:38:19,  3.58it/s]
 25%|██▌       | 92868/371472 [7:22:55<22:05:02,  3.50it/s]Some non-default generation parameters are set in the model config. These should go into a GenerationConfig file (https://huggingface.co/docs/transformers/generation_strategies#save-a-custom-decoding-strategy-with-your-model) instead. This warning will be raised to an exception in v4.41.
Non-default generation parameters: {'max_length': 200, 'early_stopping': True, 'num_beams': 5, 'forced_eos_token_id': 2}
/opt/conda/lib/python3.10/multiprocessing/popen_fork.py:66: RuntimeWarning: os.fork() was called. os.fork() is incompatible with multithreaded code, and JAX is multithreaded, so this will likely lead to a deadlock.
  self.pid = os.fork()

 25%|██▌       | 92869/371472 [7:23:22<645:53:09,  8.35s/it]
 25%|██▌       | 92870/371472 [7:23:22<458:10:44,  5.92s/it]
 25%|██▌       | 92871/371472 [7:23:22<330:40:26,  4.27s/it]
 25%|██▌       | 92872/371472 [7:23:23<237:55:37,  3.07s/it]
 25%|██▌       | 92873/371472 [7:23:23<174:02:09,  2.25s/it]
 25%|██▌       | 92874/371472 [7:23:23<129:33:36,  1.67s/it]
 25%|██▌       | 92875/371472 [7:23:24<97:45:58,  1.26s/it] 
 25%|██▌       | 92876/371472 [7:23:24<76:33:58,  1.01it/s]
 25%|██▌       | 92877/371472 [7:23:24<61:52:29,  1.25it/s]
 25%|██▌       | 92878/371472 [7:23:25<50:35:40,  1.53it/s]
 25%|██▌       | 92879/371472 [7:23:25<41:39:22,  1.86it/s]
 25%|██▌       | 92880/371472 [7:23:25<35:58:08,  2.15it/s]
                                                           
{'loss': 3.7847, 'learning_rate': 7.753345256308044e-07, 'epoch': 4.0}

 25%|██▌       | 92880/371472 [7:23:25<35:58:08,  2.15it/s]
 25%|██▌       | 92881/371472 [7:23:26<33:34:24,  2.30it/s]
 25%|██▌       | 92882/371472 [7:23:26<29:36:44,  2.61it/s]
 25%|██▌       | 92883/371472 [7:23:26<26:45:30,  2.89it/s]
 25%|██▌       | 92884/371472 [7:23:26<24:54:28,  3.11it/s]
 25%|██▌       | 92885/371472 [7:23:27<23:51:47,  3.24it/s]
 25%|██▌       | 92886/371472 [7:23:27<22:48:04,  3.39it/s]
 25%|██▌       | 92887/371472 [7:23:27<22:11:58,  3.49it/s]
 25%|██▌       | 92888/371472 [7:23:28<23:42:34,  3.26it/s]
 25%|██▌       | 92889/371472 [7:23:28<23:07:08,  3.35it/s]
 25%|██▌       | 92890/371472 [7:23:28<23:31:01,  3.29it/s]
 25%|██▌       | 92891/371472 [7:23:28<22:33:37,  3.43it/s]
 25%|██▌       | 92892/371472 [7:23:29<22:04:10,  3.51it/s]
 25%|██▌       | 92893/371472 [7:23:29<21:39:08,  3.57it/s]
 25%|██▌       | 92894/371472 [7:23:29<21:32:08,  3.59it/s]
 25%|██▌       | 92895/371472 [7:23:30<22:19:46,  3.47it/s]
 25%|██▌       | 92896/371472 [7:23:30<22:34:39,  3.43it/s]
 25%|██▌       | 92897/371472 [7:23:30<23:00:51,  3.36it/s]
 25%|██▌       | 92898/371472 [7:23:30<22:38:40,  3.42it/s]
 25%|██▌       | 92899/371472 [7:23:31<22:13:05,  3.48it/s]
 25%|██▌       | 92900/371472 [7:23:31<22:11:52,  3.49it/s]
                                                           
{'loss': 3.6393, 'learning_rate': 7.752860436553254e-07, 'epoch': 4.0}

 25%|██▌       | 92900/371472 [7:23:31<22:11:52,  3.49it/s]
 25%|██▌       | 92901/371472 [7:23:31<24:18:33,  3.18it/s]
 25%|██▌       | 92902/371472 [7:23:32<23:56:11,  3.23it/s]
 25%|██▌       | 92903/371472 [7:23:32<22:39:15,  3.42it/s]
 25%|██▌       | 92904/371472 [7:23:32<22:49:06,  3.39it/s]
 25%|██▌       | 92905/371472 [7:23:33<21:37:58,  3.58it/s]
 25%|██▌       | 92906/371472 [7:23:33<20:53:33,  3.70it/s]
 25%|██▌       | 92907/371472 [7:23:33<20:44:05,  3.73it/s]
 25%|██▌       | 92908/371472 [7:23:33<20:28:12,  3.78it/s]
 25%|██▌       | 92909/371472 [7:23:34<21:36:42,  3.58it/s]
 25%|██▌       | 92910/371472 [7:23:34<21:06:57,  3.66it/s]
 25%|██▌       | 92911/371472 [7:23:34<21:15:45,  3.64it/s]
 25%|██▌       | 92912/371472 [7:23:34<21:54:45,  3.53it/s]
 25%|██▌       | 92913/371472 [7:23:35<21:59:20,  3.52it/s]
 25%|██▌       | 92914/371472 [7:23:35<22:17:38,  3.47it/s]
 25%|██▌       | 92915/371472 [7:23:35<22:07:10,  3.50it/s]
 25%|██▌       | 92916/371472 [7:23:36<21:27:09,  3.61it/s]
 25%|██▌       | 92917/371472 [7:23:36<20:33:09,  3.76it/s]
 25%|██▌       | 92918/371472 [7:23:36<21:07:55,  3.66it/s]
 25%|██▌       | 92919/371472 [7:23:36<22:38:02,  3.42it/s]
 25%|██▌       | 92920/371472 [7:23:37<22:11:43,  3.49it/s]
                                                           
{'loss': 3.7626, 'learning_rate': 7.752375616798465e-07, 'epoch': 4.0}

 25%|██▌       | 92920/371472 [7:23:37<22:11:43,  3.49it/s]
 25%|██▌       | 92921/371472 [7:23:37<22:06:13,  3.50it/s]
 25%|██▌       | 92922/371472 [7:23:37<22:41:57,  3.41it/s]
 25%|██▌       | 92923/371472 [7:23:38<21:43:29,  3.56it/s]
 25%|██▌       | 92924/371472 [7:23:38<22:07:32,  3.50it/s]
 25%|██▌       | 92925/371472 [7:23:38<23:22:00,  3.31it/s]
 25%|██▌       | 92926/371472 [7:23:38<22:52:21,  3.38it/s]
 25%|██▌       | 92927/371472 [7:23:39<21:58:39,  3.52it/s]
 25%|██▌       | 92928/371472 [7:23:39<22:08:46,  3.49it/s]
 25%|██▌       | 92929/371472 [7:23:39<21:57:58,  3.52it/s]
 25%|██▌       | 92930/371472 [7:23:40<21:57:01,  3.52it/s]
 25%|██▌       | 92931/371472 [7:23:40<22:12:12,  3.48it/s]
 25%|██▌       | 92932/371472 [7:23:40<22:28:07,  3.44it/s]
 25%|██▌       | 92933/371472 [7:23:40<21:51:39,  3.54it/s]
 25%|██▌       | 92934/371472 [7:23:41<21:13:26,  3.65it/s]
 25%|██▌       | 92935/371472 [7:23:41<22:01:55,  3.51it/s]
 25%|██▌       | 92936/371472 [7:23:41<21:28:46,  3.60it/s]
 25%|██▌       | 92937/371472 [7:23:42<20:59:57,  3.68it/s]
 25%|██▌       | 92938/371472 [7:23:42<21:21:37,  3.62it/s]
 25%|██▌       | 92939/371472 [7:23:42<20:55:36,  3.70it/s]
 25%|██▌       | 92940/371472 [7:23:42<21:18:39,  3.63it/s]
                                                           
{'loss': 3.7545, 'learning_rate': 7.751890797043677e-07, 'epoch': 4.0}

 25%|██▌       | 92940/371472 [7:23:42<21:18:39,  3.63it/s]
 25%|██▌       | 92941/371472 [7:23:43<21:18:51,  3.63it/s]
 25%|██▌       | 92942/371472 [7:23:43<20:58:52,  3.69it/s]
 25%|██▌       | 92943/371472 [7:23:43<20:37:13,  3.75it/s]
 25%|██▌       | 92944/371472 [7:23:43<20:44:29,  3.73it/s]
 25%|██▌       | 92945/371472 [7:23:44<20:38:45,  3.75it/s]
 25%|██▌       | 92946/371472 [7:23:44<21:16:29,  3.64it/s]
 25%|██▌       | 92947/371472 [7:23:44<21:02:56,  3.68it/s]
 25%|██▌       | 92948/371472 [7:23:45<21:37:42,  3.58it/s]
 25%|██▌       | 92949/371472 [7:23:45<23:16:46,  3.32it/s]
 25%|██▌       | 92950/371472 [7:23:45<24:16:41,  3.19it/s]
 25%|██▌       | 92951/371472 [7:23:46<23:41:03,  3.27it/s]
 25%|██▌       | 92952/371472 [7:23:46<22:22:05,  3.46it/s]
 25%|██▌       | 92953/371472 [7:23:46<22:46:49,  3.40it/s]
 25%|██▌       | 92954/371472 [7:23:46<22:01:17,  3.51it/s]
 25%|██▌       | 92955/371472 [7:23:47<22:21:23,  3.46it/s]
 25%|██▌       | 92956/371472 [7:23:47<22:05:15,  3.50it/s]
 25%|██▌       | 92957/371472 [7:23:47<22:00:04,  3.52it/s]
 25%|██▌       | 92958/371472 [7:23:47<21:06:28,  3.67it/s]
 25%|██▌       | 92959/371472 [7:23:48<21:24:56,  3.61it/s]
 25%|██▌       | 92960/371472 [7:23:48<22:00:55,  3.51it/s]
                                                           
{'loss': 3.8856, 'learning_rate': 7.751405977288888e-07, 'epoch': 4.0}

 25%|██▌       | 92960/371472 [7:23:48<22:00:55,  3.51it/s]
 25%|██▌       | 92961/371472 [7:23:48<21:56:16,  3.53it/s]
 25%|██▌       | 92962/371472 [7:23:49<22:19:04,  3.47it/s]
 25%|██▌       | 92963/371472 [7:23:49<21:47:38,  3.55it/s]
 25%|██▌       | 92964/371472 [7:23:49<22:05:15,  3.50it/s]
 25%|██▌       | 92965/371472 [7:23:50<23:21:33,  3.31it/s]
 25%|██▌       | 92966/371472 [7:23:50<25:33:44,  3.03it/s]
 25%|██▌       | 92967/371472 [7:23:50<26:41:28,  2.90it/s]
 25%|██▌       | 92968/371472 [7:23:51<25:17:29,  3.06it/s]
 25%|██▌       | 92969/371472 [7:23:51<24:37:26,  3.14it/s]
 25%|██▌       | 92970/371472 [7:23:51<23:09:59,  3.34it/s]
 25%|██▌       | 92971/371472 [7:23:51<22:54:01,  3.38it/s]
 25%|██▌       | 92972/371472 [7:23:52<22:46:02,  3.40it/s]
 25%|██▌       | 92973/371472 [7:23:52<22:57:04,  3.37it/s]
 25%|██▌       | 92974/371472 [7:23:52<21:51:46,  3.54it/s]
 25%|██▌       | 92975/371472 [7:23:53<22:38:18,  3.42it/s]
 25%|██▌       | 92976/371472 [7:23:53<22:51:31,  3.38it/s]
 25%|██▌       | 92977/371472 [7:23:53<23:53:43,  3.24it/s]
 25%|██▌       | 92978/371472 [7:23:54<24:03:56,  3.21it/s]
 25%|██▌       | 92979/371472 [7:23:54<25:03:33,  3.09it/s]
 25%|██▌       | 92980/371472 [7:23:54<23:16:05,  3.32it/s]
                                                           
{'loss': 3.874, 'learning_rate': 7.750921157534098e-07, 'epoch': 4.0}

 25%|██▌       | 92980/371472 [7:23:54<23:16:05,  3.32it/s]
 25%|██▌       | 92981/371472 [7:23:54<23:33:18,  3.28it/s]
 25%|██▌       | 92982/371472 [7:23:55<23:10:23,  3.34it/s]
 25%|██▌       | 92983/371472 [7:23:55<23:05:11,  3.35it/s]
 25%|██▌       | 92984/371472 [7:23:55<22:41:56,  3.41it/s]
 25%|██▌       | 92985/371472 [7:23:56<22:05:44,  3.50it/s]
 25%|██▌       | 92986/371472 [7:23:56<21:57:06,  3.52it/s]
 25%|██▌       | 92987/371472 [7:23:56<23:29:50,  3.29it/s]
 25%|██▌       | 92988/371472 [7:23:56<23:04:24,  3.35it/s]
 25%|██▌       | 92989/371472 [7:23:57<22:18:16,  3.47it/s]
 25%|██▌       | 92990/371472 [7:23:57<22:47:58,  3.39it/s]
 25%|██▌       | 92991/371472 [7:23:57<22:09:48,  3.49it/s]
 25%|██▌       | 92992/371472 [7:23:58<22:10:41,  3.49it/s]
 25%|██▌       | 92993/371472 [7:23:58<21:38:34,  3.57it/s]
 25%|██▌       | 92994/371472 [7:23:58<23:01:43,  3.36it/s]
 25%|██▌       | 92995/371472 [7:23:58<22:17:53,  3.47it/s]
 25%|██▌       | 92996/371472 [7:23:59<22:06:45,  3.50it/s]
 25%|██▌       | 92997/371472 [7:23:59<22:47:24,  3.39it/s]
 25%|██▌       | 92998/371472 [7:23:59<23:55:51,  3.23it/s]
 25%|██▌       | 92999/371472 [7:24:00<23:52:55,  3.24it/s]
 25%|██▌       | 93000/371472 [7:24:00<25:35:13,  3.02it/s]
                                                           
{'loss': 3.7486, 'learning_rate': 7.75043633777931e-07, 'epoch': 4.01}

 25%|██▌       | 93000/371472 [7:24:00<25:35:13,  3.02it/s]
 25%|██▌       | 93001/371472 [7:24:01<26:50:34,  2.88it/s]
 25%|██▌       | 93002/371472 [7:24:01<25:49:52,  2.99it/s]
 25%|██▌       | 93003/371472 [7:24:01<24:13:16,  3.19it/s]
 25%|██▌       | 93004/371472 [7:24:01<25:05:14,  3.08it/s]
 25%|██▌       | 93005/371472 [7:24:02<24:43:36,  3.13it/s]
 25%|██▌       | 93006/371472 [7:24:02<23:57:25,  3.23it/s]
 25%|██▌       | 93007/371472 [7:24:02<23:02:42,  3.36it/s]
 25%|██▌       | 93008/371472 [7:24:03<22:54:08,  3.38it/s]
 25%|██▌       | 93009/371472 [7:24:03<23:02:37,  3.36it/s]
 25%|██▌       | 93010/371472 [7:24:03<22:57:29,  3.37it/s]
 25%|██▌       | 93011/371472 [7:24:03<23:15:25,  3.33it/s]
 25%|██▌       | 93012/371472 [7:24:04<23:53:56,  3.24it/s]
 25%|██▌       | 93013/371472 [7:24:04<22:34:24,  3.43it/s]
 25%|██▌       | 93014/371472 [7:24:04<23:04:25,  3.35it/s]
 25%|██▌       | 93015/371472 [7:24:05<23:24:24,  3.30it/s]
 25%|██▌       | 93016/371472 [7:24:05<22:28:50,  3.44it/s]
 25%|██▌       | 93017/371472 [7:24:05<23:22:06,  3.31it/s]
 25%|██▌       | 93018/371472 [7:24:06<23:04:21,  3.35it/s]
 25%|██▌       | 93019/371472 [7:24:06<22:01:40,  3.51it/s]
 25%|██▌       | 93020/371472 [7:24:06<23:20:24,  3.31it/s]
                                                           
{'loss': 3.8536, 'learning_rate': 7.749951518024521e-07, 'epoch': 4.01}

 25%|██▌       | 93020/371472 [7:24:06<23:20:24,  3.31it/s]
 25%|██▌       | 93021/371472 [7:24:06<23:27:52,  3.30it/s]
 25%|██▌       | 93022/371472 [7:24:07<22:20:01,  3.46it/s]
 25%|██▌       | 93023/371472 [7:24:07<22:25:48,  3.45it/s]
 25%|██▌       | 93024/371472 [7:24:07<22:04:12,  3.50it/s]
 25%|██▌       | 93025/371472 [7:24:08<22:20:10,  3.46it/s]
 25%|██▌       | 93026/371472 [7:24:08<23:03:11,  3.36it/s]
 25%|██▌       | 93027/371472 [7:24:08<22:14:43,  3.48it/s]
 25%|██▌       | 93028/371472 [7:24:08<21:51:33,  3.54it/s]
 25%|██▌       | 93029/371472 [7:24:09<22:42:29,  3.41it/s]
 25%|██▌       | 93030/371472 [7:24:09<23:36:13,  3.28it/s]
 25%|██▌       | 93031/371472 [7:24:09<22:48:12,  3.39it/s]
 25%|██▌       | 93032/371472 [7:24:10<22:01:53,  3.51it/s]
 25%|██▌       | 93033/371472 [7:24:10<22:38:00,  3.42it/s]
 25%|██▌       | 93034/371472 [7:24:10<22:01:47,  3.51it/s]
 25%|██▌       | 93035/371472 [7:24:11<22:33:52,  3.43it/s]
 25%|██▌       | 93036/371472 [7:24:11<22:46:31,  3.40it/s]
 25%|██▌       | 93037/371472 [7:24:11<22:00:57,  3.51it/s]
 25%|██▌       | 93038/371472 [7:24:11<20:56:46,  3.69it/s]
 25%|██▌       | 93039/371472 [7:24:12<21:36:43,  3.58it/s]
 25%|██▌       | 93040/371472 [7:24:12<21:42:48,  3.56it/s]
                                                           
{'loss': 3.7286, 'learning_rate': 7.749466698269732e-07, 'epoch': 4.01}

 25%|██▌       | 93040/371472 [7:24:12<21:42:48,  3.56it/s]
 25%|██▌       | 93041/371472 [7:24:12<21:32:44,  3.59it/s]
 25%|██▌       | 93042/371472 [7:24:12<21:20:26,  3.62it/s]
 25%|██▌       | 93043/371472 [7:24:13<21:12:54,  3.65it/s]
 25%|██▌       | 93044/371472 [7:24:13<20:32:29,  3.77it/s]
 25%|██▌       | 93045/371472 [7:24:13<22:02:43,  3.51it/s]
 25%|██▌       | 93046/371472 [7:24:14<21:08:03,  3.66it/s]
 25%|██▌       | 93047/371472 [7:24:14<20:44:11,  3.73it/s]
 25%|██▌       | 93048/371472 [7:24:14<20:10:26,  3.83it/s]
 25%|██▌       | 93049/371472 [7:24:14<21:22:01,  3.62it/s]
 25%|██▌       | 93050/371472 [7:24:15<21:07:58,  3.66it/s]
 25%|██▌       | 93051/371472 [7:24:15<23:59:39,  3.22it/s]
 25%|██▌       | 93052/371472 [7:24:15<22:58:55,  3.37it/s]
 25%|██▌       | 93053/371472 [7:24:16<22:44:19,  3.40it/s]
 25%|██▌       | 93054/371472 [7:24:16<21:52:38,  3.54it/s]
 25%|██▌       | 93055/371472 [7:24:16<21:52:07,  3.54it/s]
 25%|██▌       | 93056/371472 [7:24:16<21:35:31,  3.58it/s]
 25%|██▌       | 93057/371472 [7:24:17<22:09:13,  3.49it/s]
 25%|██▌       | 93058/371472 [7:24:17<21:30:43,  3.60it/s]
 25%|██▌       | 93059/371472 [7:24:17<20:31:06,  3.77it/s]
 25%|██▌       | 93060/371472 [7:24:17<20:28:17,  3.78it/s]
                                                           
{'loss': 3.6872, 'learning_rate': 7.748981878514942e-07, 'epoch': 4.01}

 25%|██▌       | 93060/371472 [7:24:17<20:28:17,  3.78it/s]
 25%|██▌       | 93061/371472 [7:24:18<20:48:50,  3.72it/s]
 25%|██▌       | 93062/371472 [7:24:18<21:08:39,  3.66it/s]
 25%|██▌       | 93063/371472 [7:24:18<21:55:28,  3.53it/s]
 25%|██▌       | 93064/371472 [7:24:19<21:09:10,  3.66it/s]
 25%|██▌       | 93065/371472 [7:24:19<20:10:31,  3.83it/s]
 25%|██▌       | 93066/371472 [7:24:19<21:33:10,  3.59it/s]
 25%|██▌       | 93067/371472 [7:24:19<22:38:05,  3.42it/s]
 25%|██▌       | 93068/371472 [7:24:20<22:09:53,  3.49it/s]
 25%|██▌       | 93069/371472 [7:24:20<21:24:28,  3.61it/s]
 25%|██▌       | 93070/371472 [7:24:20<21:05:49,  3.67it/s]
 25%|██▌       | 93071/371472 [7:24:21<21:13:35,  3.64it/s]
 25%|██▌       | 93072/371472 [7:24:21<21:12:47,  3.65it/s]
 25%|██▌       | 93073/371472 [7:24:21<21:49:25,  3.54it/s]
 25%|██▌       | 93074/371472 [7:24:21<22:14:07,  3.48it/s]
 25%|██▌       | 93075/371472 [7:24:22<21:40:33,  3.57it/s]
 25%|██▌       | 93076/371472 [7:24:22<21:57:50,  3.52it/s]
 25%|██▌       | 93077/371472 [7:24:22<21:25:02,  3.61it/s]
 25%|██▌       | 93078/371472 [7:24:22<21:54:29,  3.53it/s]
 25%|██▌       | 93079/371472 [7:24:23<22:51:28,  3.38it/s]
 25%|██▌       | 93080/371472 [7:24:23<21:50:32,  3.54it/s]
                                                           
{'loss': 3.7737, 'learning_rate': 7.748497058760154e-07, 'epoch': 4.01}

 25%|██▌       | 93080/371472 [7:24:23<21:50:32,  3.54it/s]
 25%|██▌       | 93081/371472 [7:24:23<22:58:21,  3.37it/s]
 25%|██▌       | 93082/371472 [7:24:24<22:00:53,  3.51it/s]
 25%|██▌       | 93083/371472 [7:24:24<21:56:29,  3.52it/s]
 25%|██▌       | 93084/371472 [7:24:24<24:09:13,  3.20it/s]
 25%|██▌       | 93085/371472 [7:24:25<23:20:14,  3.31it/s]
 25%|██▌       | 93086/371472 [7:24:25<23:21:21,  3.31it/s]
 25%|██▌       | 93087/371472 [7:24:25<22:24:12,  3.45it/s]
 25%|██▌       | 93088/371472 [7:24:25<22:10:16,  3.49it/s]
 25%|██▌       | 93089/371472 [7:24:26<21:41:51,  3.56it/s]
 25%|██▌       | 93090/371472 [7:24:26<21:28:22,  3.60it/s]
 25%|██▌       | 93091/371472 [7:24:26<24:15:58,  3.19it/s]
 25%|██▌       | 93092/371472 [7:24:27<23:01:16,  3.36it/s]
 25%|██▌       | 93093/371472 [7:24:27<22:29:43,  3.44it/s]
 25%|██▌       | 93094/371472 [7:24:27<23:03:26,  3.35it/s]
 25%|██▌       | 93095/371472 [7:24:28<22:59:24,  3.36it/s]
 25%|██▌       | 93096/371472 [7:24:28<22:23:12,  3.45it/s]
 25%|██▌       | 93097/371472 [7:24:28<22:34:02,  3.43it/s]
 25%|██▌       | 93098/371472 [7:24:28<22:09:26,  3.49it/s]
 25%|██▌       | 93099/371472 [7:24:29<21:00:42,  3.68it/s]
 25%|██▌       | 93100/371472 [7:24:29<21:26:26,  3.61it/s]
                                                           
{'loss': 3.6935, 'learning_rate': 7.748012239005366e-07, 'epoch': 4.01}

 25%|██▌       | 93100/371472 [7:24:29<21:26:26,  3.61it/s]
 25%|██▌       | 93101/371472 [7:24:29<21:12:56,  3.64it/s]
 25%|██▌       | 93102/371472 [7:24:29<21:38:45,  3.57it/s]
 25%|██▌       | 93103/371472 [7:24:30<20:54:23,  3.70it/s]
 25%|██▌       | 93104/371472 [7:24:30<21:05:59,  3.66it/s]
 25%|██▌       | 93105/371472 [7:24:30<22:32:53,  3.43it/s]
 25%|██▌       | 93106/371472 [7:24:31<22:43:06,  3.40it/s]
 25%|██▌       | 93107/371472 [7:24:31<24:04:33,  3.21it/s]
 25%|██▌       | 93108/371472 [7:24:31<23:20:42,  3.31it/s]
 25%|██▌       | 93109/371472 [7:24:32<23:52:09,  3.24it/s]
 25%|██▌       | 93110/371472 [7:24:32<24:32:52,  3.15it/s]
 25%|██▌       | 93111/371472 [7:24:32<23:16:58,  3.32it/s]
 25%|██▌       | 93112/371472 [7:24:32<23:06:16,  3.35it/s]
 25%|██▌       | 93113/371472 [7:24:33<21:45:42,  3.55it/s]
 25%|██▌       | 93114/371472 [7:24:33<21:44:38,  3.56it/s]
 25%|██▌       | 93115/371472 [7:24:33<20:55:09,  3.70it/s]
 25%|██▌       | 93116/371472 [7:24:34<24:10:14,  3.20it/s]
 25%|██▌       | 93117/371472 [7:24:34<25:08:23,  3.08it/s]
 25%|██▌       | 93118/371472 [7:24:34<26:25:33,  2.93it/s]
 25%|██▌       | 93119/371472 [7:24:35<24:47:17,  3.12it/s]
 25%|██▌       | 93120/371472 [7:24:35<23:39:51,  3.27it/s]
                                                           
{'loss': 3.7127, 'learning_rate': 7.747527419250577e-07, 'epoch': 4.01}

 25%|██▌       | 93120/371472 [7:24:35<23:39:51,  3.27it/s]
 25%|██▌       | 93121/371472 [7:24:35<22:40:30,  3.41it/s]
 25%|██▌       | 93122/371472 [7:24:36<23:36:56,  3.27it/s]
 25%|██▌       | 93123/371472 [7:24:36<23:27:06,  3.30it/s]
 25%|██▌       | 93124/371472 [7:24:36<22:05:30,  3.50it/s]
 25%|██▌       | 93125/371472 [7:24:36<22:22:24,  3.46it/s]
 25%|██▌       | 93126/371472 [7:24:37<22:26:54,  3.44it/s]
 25%|██▌       | 93127/371472 [7:24:37<22:05:10,  3.50it/s]
 25%|██▌       | 93128/371472 [7:24:37<22:05:28,  3.50it/s]
 25%|██▌       | 93129/371472 [7:24:38<22:59:47,  3.36it/s]
 25%|██▌       | 93130/371472 [7:24:38<23:26:19,  3.30it/s]
 25%|██▌       | 93131/371472 [7:24:38<23:51:33,  3.24it/s]
 25%|██▌       | 93132/371472 [7:24:38<24:11:24,  3.20it/s]
 25%|██▌       | 93133/371472 [7:24:39<24:21:35,  3.17it/s]
 25%|██▌       | 93134/371472 [7:24:39<23:26:20,  3.30it/s]
 25%|██▌       | 93135/371472 [7:24:39<22:11:45,  3.48it/s]
 25%|██▌       | 93136/371472 [7:24:40<21:16:07,  3.64it/s]
 25%|██▌       | 93137/371472 [7:24:40<21:46:50,  3.55it/s]
 25%|██▌       | 93138/371472 [7:24:40<22:52:55,  3.38it/s]
 25%|██▌       | 93139/371472 [7:24:40<22:30:20,  3.44it/s]
 25%|██▌       | 93140/371472 [7:24:41<22:20:43,  3.46it/s]
                                                           
{'loss': 3.7855, 'learning_rate': 7.747042599495787e-07, 'epoch': 4.01}

 25%|██▌       | 93140/371472 [7:24:41<22:20:43,  3.46it/s]
 25%|██▌       | 93141/371472 [7:24:41<23:07:37,  3.34it/s]
 25%|██▌       | 93142/371472 [7:24:41<23:55:00,  3.23it/s]
 25%|██▌       | 93143/371472 [7:24:42<22:47:40,  3.39it/s]
 25%|██▌       | 93144/371472 [7:24:42<21:51:14,  3.54it/s]
 25%|██▌       | 93145/371472 [7:24:42<21:12:00,  3.65it/s]
 25%|██▌       | 93146/371472 [7:24:42<20:51:05,  3.71it/s]
 25%|██▌       | 93147/371472 [7:24:43<21:16:40,  3.63it/s]
 25%|██▌       | 93148/371472 [7:24:43<23:05:33,  3.35it/s]
 25%|██▌       | 93149/371472 [7:24:43<22:43:59,  3.40it/s]
 25%|██▌       | 93150/371472 [7:24:44<22:33:22,  3.43it/s]
 25%|██▌       | 93151/371472 [7:24:44<21:44:41,  3.56it/s]
 25%|██▌       | 93152/371472 [7:24:44<23:14:41,  3.33it/s]
 25%|██▌       | 93153/371472 [7:24:45<22:14:35,  3.48it/s]
 25%|██▌       | 93154/371472 [7:24:45<21:45:39,  3.55it/s]
 25%|██▌       | 93155/371472 [7:24:45<22:19:26,  3.46it/s]
 25%|██▌       | 93156/371472 [7:24:45<21:42:21,  3.56it/s]
 25%|██▌       | 93157/371472 [7:24:46<20:54:20,  3.70it/s]
 25%|██▌       | 93158/371472 [7:24:46<21:47:22,  3.55it/s]
 25%|██▌       | 93159/371472 [7:24:46<21:54:10,  3.53it/s]
 25%|██▌       | 93160/371472 [7:24:46<20:55:55,  3.69it/s]
                                                           
{'loss': 3.6971, 'learning_rate': 7.746557779740997e-07, 'epoch': 4.01}

 25%|██▌       | 93160/371472 [7:24:46<20:55:55,  3.69it/s]
 25%|██▌       | 93161/371472 [7:24:47<21:21:46,  3.62it/s]
 25%|██▌       | 93162/371472 [7:24:47<21:20:29,  3.62it/s]
 25%|██▌       | 93163/371472 [7:24:47<21:07:36,  3.66it/s]
 25%|██▌       | 93164/371472 [7:24:48<21:57:43,  3.52it/s]
 25%|██▌       | 93165/371472 [7:24:48<21:43:10,  3.56it/s]
 25%|██▌       | 93166/371472 [7:24:48<21:53:35,  3.53it/s]
 25%|██▌       | 93167/371472 [7:24:48<22:58:18,  3.37it/s]
 25%|██▌       | 93168/371472 [7:24:49<22:38:17,  3.41it/s]
 25%|██▌       | 93169/371472 [7:24:49<22:23:16,  3.45it/s]
 25%|██▌       | 93170/371472 [7:24:49<22:15:11,  3.47it/s]
 25%|██▌       | 93171/371472 [7:24:50<22:04:15,  3.50it/s]
 25%|██▌       | 93172/371472 [7:24:50<21:16:05,  3.63it/s]
 25%|██▌       | 93173/371472 [7:24:50<20:52:03,  3.70it/s]
 25%|██▌       | 93174/371472 [7:24:50<21:13:48,  3.64it/s]
 25%|██▌       | 93175/371472 [7:24:51<21:16:09,  3.63it/s]
 25%|██▌       | 93176/371472 [7:24:51<21:32:56,  3.59it/s]
 25%|██▌       | 93177/371472 [7:24:51<21:22:06,  3.62it/s]
 25%|██▌       | 93178/371472 [7:24:52<21:01:21,  3.68it/s]
 25%|██▌       | 93179/371472 [7:24:52<21:05:28,  3.67it/s]
 25%|██▌       | 93180/371472 [7:24:52<20:25:54,  3.78it/s]
                                                           
{'loss': 3.6356, 'learning_rate': 7.746072959986209e-07, 'epoch': 4.01}

 25%|██▌       | 93180/371472 [7:24:52<20:25:54,  3.78it/s]
 25%|██▌       | 93181/371472 [7:24:52<20:29:05,  3.77it/s]
 25%|██▌       | 93182/371472 [7:24:53<19:44:38,  3.92it/s]
 25%|██▌       | 93183/371472 [7:24:53<20:51:18,  3.71it/s]
 25%|██▌       | 93184/371472 [7:24:53<20:42:28,  3.73it/s]
 25%|██▌       | 93185/371472 [7:24:53<20:21:50,  3.80it/s]
 25%|██▌       | 93186/371472 [7:24:54<21:34:21,  3.58it/s]
 25%|██▌       | 93187/371472 [7:24:54<20:36:48,  3.75it/s]
 25%|██▌       | 93188/371472 [7:24:54<22:17:50,  3.47it/s]
 25%|██▌       | 93189/371472 [7:24:55<21:50:53,  3.54it/s]
 25%|██▌       | 93190/371472 [7:24:55<20:55:55,  3.69it/s]
 25%|██▌       | 93191/371472 [7:24:55<20:21:05,  3.80it/s]
 25%|██▌       | 93192/371472 [7:24:55<20:29:42,  3.77it/s]
 25%|██▌       | 93193/371472 [7:24:56<20:56:12,  3.69it/s]
 25%|██▌       | 93194/371472 [7:24:56<20:34:26,  3.76it/s]
 25%|██▌       | 93195/371472 [7:24:56<20:26:13,  3.78it/s]
 25%|██▌       | 93196/371472 [7:24:56<20:29:01,  3.77it/s]
 25%|██▌       | 93197/371472 [7:24:57<21:50:19,  3.54it/s]
 25%|██▌       | 93198/371472 [7:24:57<21:22:12,  3.62it/s]
 25%|██▌       | 93199/371472 [7:24:57<20:57:41,  3.69it/s]
 25%|██▌       | 93200/371472 [7:24:57<21:04:44,  3.67it/s]
                                                           
{'loss': 3.6845, 'learning_rate': 7.74558814023142e-07, 'epoch': 4.01}

 25%|██▌       | 93200/371472 [7:24:57<21:04:44,  3.67it/s]
 25%|██▌       | 93201/371472 [7:24:58<21:21:13,  3.62it/s]
 25%|██▌       | 93202/371472 [7:24:58<21:57:14,  3.52it/s]
 25%|██▌       | 93203/371472 [7:24:58<22:36:38,  3.42it/s]
 25%|██▌       | 93204/371472 [7:24:59<23:05:18,  3.35it/s]
 25%|██▌       | 93205/371472 [7:24:59<22:16:47,  3.47it/s]
 25%|██▌       | 93206/371472 [7:24:59<22:04:12,  3.50it/s]
 25%|██▌       | 93207/371472 [7:24:59<21:39:57,  3.57it/s]
 25%|██▌       | 93208/371472 [7:25:00<22:03:59,  3.50it/s]
 25%|██▌       | 93209/371472 [7:25:00<21:42:55,  3.56it/s]
 25%|██▌       | 93210/371472 [7:25:00<23:18:11,  3.32it/s]
 25%|██▌       | 93211/371472 [7:25:01<23:20:27,  3.31it/s]
 25%|██▌       | 93212/371472 [7:25:01<23:54:32,  3.23it/s]
 25%|██▌       | 93213/371472 [7:25:01<23:10:31,  3.34it/s]
 25%|██▌       | 93214/371472 [7:25:02<22:18:39,  3.46it/s]
 25%|██▌       | 93215/371472 [7:25:02<22:35:39,  3.42it/s]
 25%|██▌       | 93216/371472 [7:25:02<22:12:08,  3.48it/s]
 25%|██▌       | 93217/371472 [7:25:02<21:41:06,  3.56it/s]
 25%|██▌       | 93218/371472 [7:25:03<21:11:29,  3.65it/s]
 25%|██▌       | 93219/371472 [7:25:03<21:30:09,  3.59it/s]
 25%|██▌       | 93220/371472 [7:25:03<21:38:29,  3.57it/s]
                                                           
{'loss': 3.727, 'learning_rate': 7.745103320476631e-07, 'epoch': 4.02}

 25%|██▌       | 93220/371472 [7:25:03<21:38:29,  3.57it/s]
 25%|██▌       | 93221/371472 [7:25:04<22:06:17,  3.50it/s]
 25%|██▌       | 93222/371472 [7:25:04<22:55:31,  3.37it/s]
 25%|██▌       | 93223/371472 [7:25:04<22:39:32,  3.41it/s]
 25%|██▌       | 93224/371472 [7:25:04<22:15:37,  3.47it/s]
 25%|██▌       | 93225/371472 [7:25:05<22:02:04,  3.51it/s]
 25%|██▌       | 93226/371472 [7:25:05<21:30:45,  3.59it/s]
 25%|██▌       | 93227/371472 [7:25:05<20:52:12,  3.70it/s]
 25%|██▌       | 93228/371472 [7:25:05<21:24:05,  3.61it/s]
 25%|██▌       | 93229/371472 [7:25:06<21:59:47,  3.51it/s]
 25%|██▌       | 93230/371472 [7:25:06<22:22:49,  3.45it/s]
 25%|██▌       | 93231/371472 [7:25:06<22:07:19,  3.49it/s]
 25%|██▌       | 93232/371472 [7:25:07<22:15:27,  3.47it/s]
 25%|██▌       | 93233/371472 [7:25:07<22:43:01,  3.40it/s]
 25%|██▌       | 93234/371472 [7:25:07<23:45:16,  3.25it/s]
 25%|██▌       | 93235/371472 [7:25:08<23:10:58,  3.33it/s]
 25%|██▌       | 93236/371472 [7:25:08<22:15:55,  3.47it/s]
 25%|██▌       | 93237/371472 [7:25:08<22:23:58,  3.45it/s]
 25%|██▌       | 93238/371472 [7:25:08<22:24:13,  3.45it/s]
 25%|██▌       | 93239/371472 [7:25:09<22:34:38,  3.42it/s]
 25%|██▌       | 93240/371472 [7:25:09<23:33:01,  3.28it/s]
                                                           
{'loss': 3.6132, 'learning_rate': 7.744618500721843e-07, 'epoch': 4.02}

 25%|██▌       | 93240/371472 [7:25:09<23:33:01,  3.28it/s]
 25%|██▌       | 93241/371472 [7:25:09<23:28:18,  3.29it/s]
 25%|██▌       | 93242/371472 [7:25:10<25:34:26,  3.02it/s]
 25%|██▌       | 93243/371472 [7:25:10<26:46:04,  2.89it/s]
 25%|██▌       | 93244/371472 [7:25:10<26:14:37,  2.94it/s]
 25%|██▌       | 93245/371472 [7:25:11<26:27:00,  2.92it/s]
 25%|██▌       | 93246/371472 [7:25:11<25:41:45,  3.01it/s]
 25%|██▌       | 93247/371472 [7:25:12<26:46:13,  2.89it/s]
 25%|██▌       | 93248/371472 [7:25:12<28:07:37,  2.75it/s]
 25%|██▌       | 93249/371472 [7:25:12<25:35:35,  3.02it/s]
 25%|██▌       | 93250/371472 [7:25:12<24:26:22,  3.16it/s]
 25%|██▌       | 93251/371472 [7:25:13<23:34:21,  3.28it/s]
 25%|██▌       | 93252/371472 [7:25:13<23:01:14,  3.36it/s]
 25%|██▌       | 93253/371472 [7:25:13<22:36:35,  3.42it/s]
 25%|██▌       | 93254/371472 [7:25:14<23:38:52,  3.27it/s]
 25%|██▌       | 93255/371472 [7:25:14<22:57:59,  3.37it/s]
 25%|██▌       | 93256/371472 [7:25:14<23:28:27,  3.29it/s]
 25%|██▌       | 93257/371472 [7:25:15<23:25:47,  3.30it/s]
 25%|██▌       | 93258/371472 [7:25:15<23:13:57,  3.33it/s]
 25%|██▌       | 93259/371472 [7:25:15<23:02:18,  3.35it/s]
 25%|██▌       | 93260/371472 [7:25:15<22:15:27,  3.47it/s]
                                                           
{'loss': 3.6475, 'learning_rate': 7.744133680967054e-07, 'epoch': 4.02}

 25%|██▌       | 93260/371472 [7:25:15<22:15:27,  3.47it/s]
 25%|██▌       | 93261/371472 [7:25:16<21:53:03,  3.53it/s]
 25%|██▌       | 93262/371472 [7:25:16<20:52:06,  3.70it/s]
 25%|██▌       | 93263/371472 [7:25:16<22:53:17,  3.38it/s]
 25%|██▌       | 93264/371472 [7:25:17<23:23:32,  3.30it/s]
 25%|██▌       | 93265/371472 [7:25:17<23:47:57,  3.25it/s]
 25%|██▌       | 93266/371472 [7:25:17<22:56:45,  3.37it/s]
 25%|██▌       | 93267/371472 [7:25:17<22:46:59,  3.39it/s]
 25%|██▌       | 93268/371472 [7:25:18<22:45:58,  3.39it/s]
 25%|██▌       | 93269/371472 [7:25:18<23:46:02,  3.25it/s]
 25%|██▌       | 93270/371472 [7:25:18<23:29:36,  3.29it/s]
 25%|██▌       | 93271/371472 [7:25:19<23:37:54,  3.27it/s]
 25%|██▌       | 93272/371472 [7:25:19<22:36:35,  3.42it/s]
 25%|██▌       | 93273/371472 [7:25:19<22:56:02,  3.37it/s]
 25%|██▌       | 93274/371472 [7:25:20<22:12:24,  3.48it/s]
 25%|██▌       | 93275/371472 [7:25:20<21:39:59,  3.57it/s]
 25%|██▌       | 93276/371472 [7:25:20<21:24:16,  3.61it/s]
 25%|██▌       | 93277/371472 [7:25:20<24:16:46,  3.18it/s]
 25%|██▌       | 93278/371472 [7:25:21<23:31:56,  3.28it/s]
 25%|██▌       | 93279/371472 [7:25:21<23:15:25,  3.32it/s]
 25%|██▌       | 93280/371472 [7:25:21<23:25:09,  3.30it/s]
                                                           
{'loss': 3.7494, 'learning_rate': 7.743648861212263e-07, 'epoch': 4.02}

 25%|██▌       | 93280/371472 [7:25:21<23:25:09,  3.30it/s]
 25%|██▌       | 93281/371472 [7:25:22<22:44:52,  3.40it/s]
 25%|██▌       | 93282/371472 [7:25:22<22:21:22,  3.46it/s]
 25%|██▌       | 93283/371472 [7:25:22<21:44:06,  3.56it/s]
 25%|██▌       | 93284/371472 [7:25:22<21:10:02,  3.65it/s]
 25%|██▌       | 93285/371472 [7:25:23<21:38:23,  3.57it/s]
 25%|██▌       | 93286/371472 [7:25:23<22:14:05,  3.48it/s]
 25%|██▌       | 93287/371472 [7:25:23<22:00:22,  3.51it/s]
 25%|██▌       | 93288/371472 [7:25:24<22:49:49,  3.38it/s]
 25%|██▌       | 93289/371472 [7:25:24<22:47:16,  3.39it/s]
 25%|██▌       | 93290/371472 [7:25:24<21:36:01,  3.58it/s]
 25%|██▌       | 93291/371472 [7:25:24<22:05:40,  3.50it/s]
 25%|██▌       | 93292/371472 [7:25:25<21:36:31,  3.58it/s]
 25%|██▌       | 93293/371472 [7:25:25<23:53:03,  3.24it/s]
 25%|██▌       | 93294/371472 [7:25:25<23:38:30,  3.27it/s]
 25%|██▌       | 93295/371472 [7:25:26<22:51:53,  3.38it/s]
 25%|██▌       | 93296/371472 [7:25:26<22:03:38,  3.50it/s]
 25%|██▌       | 93297/371472 [7:25:26<21:55:29,  3.52it/s]
 25%|██▌       | 93298/371472 [7:25:27<22:25:29,  3.45it/s]
 25%|██▌       | 93299/371472 [7:25:27<22:40:14,  3.41it/s]
 25%|██▌       | 93300/371472 [7:25:27<23:48:47,  3.24it/s]
                                                           
{'loss': 3.8054, 'learning_rate': 7.743164041457475e-07, 'epoch': 4.02}

 25%|██▌       | 93300/371472 [7:25:27<23:48:47,  3.24it/s]
 25%|██▌       | 93301/371472 [7:25:27<23:42:32,  3.26it/s]
 25%|██▌       | 93302/371472 [7:25:28<23:00:17,  3.36it/s]
 25%|██▌       | 93303/371472 [7:25:28<23:51:47,  3.24it/s]
 25%|██▌       | 93304/371472 [7:25:28<25:53:32,  2.98it/s]
 25%|██▌       | 93305/371472 [7:25:29<24:03:39,  3.21it/s]
 25%|██▌       | 93306/371472 [7:25:29<23:24:59,  3.30it/s]
 25%|██▌       | 93307/371472 [7:25:29<23:14:23,  3.32it/s]
 25%|██▌       | 93308/371472 [7:25:30<22:25:26,  3.45it/s]
 25%|██▌       | 93309/371472 [7:25:30<22:08:04,  3.49it/s]
 25%|██▌       | 93310/371472 [7:25:30<23:26:07,  3.30it/s]
 25%|██▌       | 93311/371472 [7:25:30<23:43:51,  3.26it/s]
 25%|██▌       | 93312/371472 [7:25:31<23:18:43,  3.31it/s]
 25%|██▌       | 93313/371472 [7:25:31<22:38:40,  3.41it/s]
 25%|██▌       | 93314/371472 [7:25:31<23:06:03,  3.34it/s]
 25%|██▌       | 93315/371472 [7:25:32<22:37:15,  3.42it/s]
 25%|██▌       | 93316/371472 [7:25:32<22:50:50,  3.38it/s]
 25%|██▌       | 93317/371472 [7:25:32<22:44:27,  3.40it/s]
 25%|██▌       | 93318/371472 [7:25:33<23:04:14,  3.35it/s]
 25%|██▌       | 93319/371472 [7:25:33<23:06:29,  3.34it/s]
 25%|██▌       | 93320/371472 [7:25:33<22:41:20,  3.41it/s]
                                                           
{'loss': 3.6377, 'learning_rate': 7.742679221702687e-07, 'epoch': 4.02}

 25%|██▌       | 93320/371472 [7:25:33<22:41:20,  3.41it/s]
 25%|██▌       | 93321/371472 [7:25:33<22:42:33,  3.40it/s]
 25%|██▌       | 93322/371472 [7:25:34<22:48:49,  3.39it/s]
 25%|██▌       | 93323/371472 [7:25:34<22:38:40,  3.41it/s]
 25%|██▌       | 93324/371472 [7:25:34<22:04:30,  3.50it/s]
 25%|██▌       | 93325/371472 [7:25:35<21:28:20,  3.60it/s]
 25%|██▌       | 93326/371472 [7:25:35<22:39:58,  3.41it/s]
 25%|██▌       | 93327/371472 [7:25:35<22:24:52,  3.45it/s]
 25%|██▌       | 93328/371472 [7:25:35<21:45:07,  3.55it/s]
 25%|██▌       | 93329/371472 [7:25:36<21:51:35,  3.53it/s]
 25%|██▌       | 93330/371472 [7:25:36<21:50:58,  3.54it/s]
 25%|██▌       | 93331/371472 [7:25:36<21:50:20,  3.54it/s]
 25%|██▌       | 93332/371472 [7:25:37<21:51:38,  3.53it/s]
 25%|██▌       | 93333/371472 [7:25:37<21:35:41,  3.58it/s]
 25%|██▌       | 93334/371472 [7:25:37<21:18:29,  3.63it/s]
 25%|██▌       | 93335/371472 [7:25:37<22:37:03,  3.42it/s]
 25%|██▌       | 93336/371472 [7:25:38<22:18:51,  3.46it/s]
 25%|██▌       | 93337/371472 [7:25:38<21:14:15,  3.64it/s]
 25%|██▌       | 93338/371472 [7:25:38<20:58:56,  3.68it/s]
 25%|██▌       | 93339/371472 [7:25:39<21:52:48,  3.53it/s]
 25%|██▌       | 93340/371472 [7:25:39<23:16:10,  3.32it/s]
                                                           
{'loss': 3.5, 'learning_rate': 7.742194401947898e-07, 'epoch': 4.02}

 25%|██▌       | 93340/371472 [7:25:39<23:16:10,  3.32it/s]
 25%|██▌       | 93341/371472 [7:25:39<22:48:31,  3.39it/s]
 25%|██▌       | 93342/371472 [7:25:39<24:00:52,  3.22it/s]
 25%|██▌       | 93343/371472 [7:25:40<24:01:29,  3.22it/s]
 25%|██▌       | 93344/371472 [7:25:40<23:26:30,  3.30it/s]
 25%|██▌       | 93345/371472 [7:25:40<23:49:36,  3.24it/s]
 25%|██▌       | 93346/371472 [7:25:41<23:34:45,  3.28it/s]
 25%|██▌       | 93347/371472 [7:25:41<23:00:45,  3.36it/s]
 25%|██▌       | 93348/371472 [7:25:41<22:56:21,  3.37it/s]
 25%|██▌       | 93349/371472 [7:25:42<22:44:29,  3.40it/s]
 25%|██▌       | 93350/371472 [7:25:42<24:36:56,  3.14it/s]
 25%|██▌       | 93351/371472 [7:25:42<23:33:48,  3.28it/s]
 25%|██▌       | 93352/371472 [7:25:43<23:24:49,  3.30it/s]
 25%|██▌       | 93353/371472 [7:25:43<22:03:52,  3.50it/s]
 25%|██▌       | 93354/371472 [7:25:43<22:58:54,  3.36it/s]
 25%|██▌       | 93355/371472 [7:25:43<22:00:22,  3.51it/s]
 25%|██▌       | 93356/371472 [7:25:44<21:02:36,  3.67it/s]
 25%|██▌       | 93357/371472 [7:25:44<21:22:06,  3.62it/s]
 25%|██▌       | 93358/371472 [7:25:44<20:34:12,  3.76it/s]
 25%|██▌       | 93359/371472 [7:25:44<20:49:34,  3.71it/s]
 25%|██▌       | 93360/371472 [7:25:45<21:07:36,  3.66it/s]
                                                           
{'loss': 3.8877, 'learning_rate': 7.741709582193108e-07, 'epoch': 4.02}

 25%|██▌       | 93360/371472 [7:25:45<21:07:36,  3.66it/s]
 25%|██▌       | 93361/371472 [7:25:45<21:43:12,  3.56it/s]
 25%|██▌       | 93362/371472 [7:25:45<20:50:32,  3.71it/s]
 25%|██▌       | 93363/371472 [7:25:46<21:18:13,  3.63it/s]
 25%|██▌       | 93364/371472 [7:25:46<21:56:15,  3.52it/s]
 25%|██▌       | 93365/371472 [7:25:46<21:51:07,  3.54it/s]
 25%|██▌       | 93366/371472 [7:25:46<22:51:41,  3.38it/s]
 25%|██▌       | 93367/371472 [7:25:47<21:50:04,  3.54it/s]
 25%|██▌       | 93368/371472 [7:25:47<21:54:21,  3.53it/s]
 25%|██▌       | 93369/371472 [7:25:47<21:54:07,  3.53it/s]
 25%|██▌       | 93370/371472 [7:25:48<22:08:45,  3.49it/s]
 25%|██▌       | 93371/371472 [7:25:48<21:36:38,  3.57it/s]
 25%|██▌       | 93372/371472 [7:25:48<21:27:38,  3.60it/s]
 25%|██▌       | 93373/371472 [7:25:48<21:13:41,  3.64it/s]
 25%|██▌       | 93374/371472 [7:25:49<22:11:01,  3.48it/s]
 25%|██▌       | 93375/371472 [7:25:49<23:55:35,  3.23it/s]
 25%|██▌       | 93376/371472 [7:25:49<23:07:34,  3.34it/s]
 25%|██▌       | 93377/371472 [7:25:50<22:01:07,  3.51it/s]
 25%|██▌       | 93378/371472 [7:25:50<21:01:50,  3.67it/s]
 25%|██▌       | 93379/371472 [7:25:50<22:01:52,  3.51it/s]
 25%|██▌       | 93380/371472 [7:25:50<21:59:54,  3.51it/s]
                                                           
{'loss': 3.8689, 'learning_rate': 7.74122476243832e-07, 'epoch': 4.02}

 25%|██▌       | 93380/371472 [7:25:50<21:59:54,  3.51it/s]
 25%|██▌       | 93381/371472 [7:25:51<23:07:35,  3.34it/s]
 25%|██▌       | 93382/371472 [7:25:51<23:02:37,  3.35it/s]
 25%|██▌       | 93383/371472 [7:25:51<22:59:22,  3.36it/s]
 25%|██▌       | 93384/371472 [7:25:52<23:09:28,  3.34it/s]
 25%|██▌       | 93385/371472 [7:25:52<22:08:19,  3.49it/s]
 25%|██▌       | 93386/371472 [7:25:52<22:29:46,  3.43it/s]
 25%|██▌       | 93387/371472 [7:25:52<23:18:04,  3.32it/s]
 25%|██▌       | 93388/371472 [7:25:53<22:37:22,  3.41it/s]
 25%|██▌       | 93389/371472 [7:25:53<21:36:56,  3.57it/s]
 25%|██▌       | 93390/371472 [7:25:53<22:20:02,  3.46it/s]
 25%|██▌       | 93391/371472 [7:25:54<21:35:40,  3.58it/s]
 25%|██▌       | 93392/371472 [7:25:54<21:20:56,  3.62it/s]
 25%|██▌       | 93393/371472 [7:25:54<21:48:16,  3.54it/s]
 25%|██▌       | 93394/371472 [7:25:54<21:57:44,  3.52it/s]
 25%|██▌       | 93395/371472 [7:25:55<21:09:23,  3.65it/s]
 25%|██▌       | 93396/371472 [7:25:55<23:23:16,  3.30it/s]
 25%|██▌       | 93397/371472 [7:25:55<22:58:13,  3.36it/s]
 25%|██▌       | 93398/371472 [7:25:56<26:41:42,  2.89it/s]
 25%|██▌       | 93399/371472 [7:25:56<26:08:08,  2.96it/s]
 25%|██▌       | 93400/371472 [7:25:56<26:09:12,  2.95it/s]
                                                           
{'loss': 3.785, 'learning_rate': 7.740739942683531e-07, 'epoch': 4.02}

 25%|██▌       | 93400/371472 [7:25:56<26:09:12,  2.95it/s]
 25%|██▌       | 93401/371472 [7:25:57<25:17:11,  3.05it/s]
 25%|██▌       | 93402/371472 [7:25:57<24:30:10,  3.15it/s]
 25%|██▌       | 93403/371472 [7:25:57<24:33:31,  3.15it/s]
 25%|██▌       | 93404/371472 [7:25:58<23:33:45,  3.28it/s]
 25%|██▌       | 93405/371472 [7:25:58<23:51:55,  3.24it/s]
 25%|██▌       | 93406/371472 [7:25:58<23:14:21,  3.32it/s]
 25%|██▌       | 93407/371472 [7:25:59<22:27:36,  3.44it/s]
 25%|██▌       | 93408/371472 [7:25:59<22:28:03,  3.44it/s]
 25%|██▌       | 93409/371472 [7:25:59<23:15:26,  3.32it/s]
 25%|██▌       | 93410/371472 [7:25:59<22:04:09,  3.50it/s]
 25%|██▌       | 93411/371472 [7:26:00<22:44:53,  3.40it/s]
 25%|██▌       | 93412/371472 [7:26:00<22:15:37,  3.47it/s]
 25%|██▌       | 93413/371472 [7:26:00<21:27:41,  3.60it/s]
 25%|██▌       | 93414/371472 [7:26:01<23:07:08,  3.34it/s]
 25%|██▌       | 93415/371472 [7:26:01<23:46:48,  3.25it/s]
 25%|██▌       | 93416/371472 [7:26:01<23:24:02,  3.30it/s]
 25%|██▌       | 93417/371472 [7:26:01<22:48:28,  3.39it/s]
 25%|██▌       | 93418/371472 [7:26:02<22:31:52,  3.43it/s]
 25%|██▌       | 93419/371472 [7:26:02<21:18:25,  3.62it/s]
 25%|██▌       | 93420/371472 [7:26:02<22:25:53,  3.44it/s]
                                                           
{'loss': 3.8665, 'learning_rate': 7.740255122928742e-07, 'epoch': 4.02}

 25%|██▌       | 93420/371472 [7:26:02<22:25:53,  3.44it/s]
 25%|██▌       | 93421/371472 [7:26:03<23:37:41,  3.27it/s]
 25%|██▌       | 93422/371472 [7:26:03<22:13:24,  3.48it/s]
 25%|██▌       | 93423/371472 [7:26:03<23:10:12,  3.33it/s]
 25%|██▌       | 93424/371472 [7:26:04<22:51:51,  3.38it/s]
 25%|██▌       | 93425/371472 [7:26:04<22:32:34,  3.43it/s]
 25%|██▌       | 93426/371472 [7:26:04<21:50:56,  3.53it/s]
 25%|██▌       | 93427/371472 [7:26:04<23:28:51,  3.29it/s]
 25%|██▌       | 93428/371472 [7:26:05<24:57:55,  3.09it/s]
 25%|██▌       | 93429/371472 [7:26:05<24:04:57,  3.21it/s]
 25%|██▌       | 93430/371472 [7:26:05<24:37:27,  3.14it/s]
 25%|██▌       | 93431/371472 [7:26:06<24:03:09,  3.21it/s]
 25%|██▌       | 93432/371472 [7:26:06<23:45:03,  3.25it/s]
 25%|██▌       | 93433/371472 [7:26:06<22:34:54,  3.42it/s]
 25%|██▌       | 93434/371472 [7:26:07<21:48:04,  3.54it/s]
 25%|██▌       | 93435/371472 [7:26:07<21:24:04,  3.61it/s]
 25%|██▌       | 93436/371472 [7:26:07<21:27:20,  3.60it/s]
 25%|██▌       | 93437/371472 [7:26:07<22:00:01,  3.51it/s]
 25%|██▌       | 93438/371472 [7:26:08<22:10:40,  3.48it/s]
 25%|██▌       | 93439/371472 [7:26:08<21:39:45,  3.57it/s]
 25%|██▌       | 93440/371472 [7:26:08<22:51:42,  3.38it/s]
                                                           
{'loss': 3.7676, 'learning_rate': 7.739770303173952e-07, 'epoch': 4.02}

 25%|██▌       | 93440/371472 [7:26:08<22:51:42,  3.38it/s]
 25%|██▌       | 93441/371472 [7:26:09<22:11:26,  3.48it/s]
 25%|██▌       | 93442/371472 [7:26:09<24:04:36,  3.21it/s]
 25%|██▌       | 93443/371472 [7:26:09<23:43:33,  3.26it/s]
 25%|██▌       | 93444/371472 [7:26:09<23:29:22,  3.29it/s]
 25%|██▌       | 93445/371472 [7:26:10<23:40:03,  3.26it/s]
 25%|██▌       | 93446/371472 [7:26:10<22:44:51,  3.40it/s]
 25%|██▌       | 93447/371472 [7:26:10<24:02:18,  3.21it/s]
 25%|██▌       | 93448/371472 [7:26:11<23:19:11,  3.31it/s]
 25%|██▌       | 93449/371472 [7:26:11<23:17:58,  3.31it/s]
 25%|██▌       | 93450/371472 [7:26:11<21:39:48,  3.56it/s]
 25%|██▌       | 93451/371472 [7:26:12<22:32:57,  3.42it/s]
 25%|██▌       | 93452/371472 [7:26:12<22:21:20,  3.45it/s]
 25%|██▌       | 93453/371472 [7:26:12<21:58:53,  3.51it/s]
 25%|██▌       | 93454/371472 [7:26:12<22:46:26,  3.39it/s]
 25%|██▌       | 93455/371472 [7:26:13<22:45:04,  3.39it/s]
 25%|██▌       | 93456/371472 [7:26:13<25:39:33,  3.01it/s]
 25%|██▌       | 93457/371472 [7:26:14<26:39:26,  2.90it/s]
 25%|██▌       | 93458/371472 [7:26:14<25:49:00,  2.99it/s]
 25%|██▌       | 93459/371472 [7:26:14<25:35:28,  3.02it/s]
 25%|██▌       | 93460/371472 [7:26:14<25:33:08,  3.02it/s]
                                                           
{'loss': 3.7239, 'learning_rate': 7.739285483419164e-07, 'epoch': 4.03}

 25%|██▌       | 93460/371472 [7:26:14<25:33:08,  3.02it/s]
 25%|██▌       | 93461/371472 [7:26:15<23:43:26,  3.26it/s]
 25%|██▌       | 93462/371472 [7:26:15<23:02:29,  3.35it/s]
 25%|██▌       | 93463/371472 [7:26:15<22:24:40,  3.45it/s]
 25%|██▌       | 93464/371472 [7:26:16<22:11:14,  3.48it/s]
 25%|██▌       | 93465/371472 [7:26:16<21:36:40,  3.57it/s]
 25%|██▌       | 93466/371472 [7:26:16<22:13:52,  3.47it/s]
 25%|██▌       | 93467/371472 [7:26:16<22:32:17,  3.43it/s]
 25%|██▌       | 93468/371472 [7:26:17<23:08:52,  3.34it/s]
 25%|██▌       | 93469/371472 [7:26:17<24:30:26,  3.15it/s]
 25%|██▌       | 93470/371472 [7:26:17<24:26:30,  3.16it/s]
 25%|██▌       | 93471/371472 [7:26:18<25:20:15,  3.05it/s]
 25%|██▌       | 93472/371472 [7:26:18<27:12:16,  2.84it/s]
 25%|██▌       | 93473/371472 [7:26:19<27:14:00,  2.84it/s]
 25%|██▌       | 93474/371472 [7:26:19<26:09:40,  2.95it/s]
 25%|██▌       | 93475/371472 [7:26:19<25:29:16,  3.03it/s]
 25%|██▌       | 93476/371472 [7:26:19<25:43:47,  3.00it/s]
 25%|██▌       | 93477/371472 [7:26:20<24:06:09,  3.20it/s]
 25%|██▌       | 93478/371472 [7:26:20<23:35:02,  3.27it/s]
 25%|██▌       | 93479/371472 [7:26:20<23:39:19,  3.26it/s]
 25%|██▌       | 93480/371472 [7:26:21<23:36:33,  3.27it/s]
                                                           
{'loss': 3.6412, 'learning_rate': 7.738800663664376e-07, 'epoch': 4.03}

 25%|██▌       | 93480/371472 [7:26:21<23:36:33,  3.27it/s]
 25%|██▌       | 93481/371472 [7:26:21<22:51:32,  3.38it/s]
 25%|██▌       | 93482/371472 [7:26:21<22:53:42,  3.37it/s]
 25%|██▌       | 93483/371472 [7:26:22<24:40:52,  3.13it/s]
 25%|██▌       | 93484/371472 [7:26:22<22:57:01,  3.36it/s]
 25%|██▌       | 93485/371472 [7:26:22<22:47:07,  3.39it/s]
 25%|██▌       | 93486/371472 [7:26:22<24:10:17,  3.19it/s]
 25%|██▌       | 93487/371472 [7:26:23<24:22:46,  3.17it/s]
 25%|██▌       | 93488/371472 [7:26:23<23:20:02,  3.31it/s]
 25%|██▌       | 93489/371472 [7:26:23<22:51:23,  3.38it/s]
 25%|██▌       | 93490/371472 [7:26:24<22:40:59,  3.40it/s]
 25%|██▌       | 93491/371472 [7:26:24<25:12:04,  3.06it/s]
 25%|██▌       | 93492/371472 [7:26:24<24:41:27,  3.13it/s]
 25%|██▌       | 93493/371472 [7:26:25<25:33:06,  3.02it/s]
 25%|██▌       | 93494/371472 [7:26:25<24:32:13,  3.15it/s]
 25%|██▌       | 93495/371472 [7:26:25<22:51:46,  3.38it/s]
 25%|██▌       | 93496/371472 [7:26:26<24:24:05,  3.16it/s]
 25%|██▌       | 93497/371472 [7:26:26<23:50:00,  3.24it/s]
 25%|██▌       | 93498/371472 [7:26:26<22:47:21,  3.39it/s]
 25%|██▌       | 93499/371472 [7:26:27<25:54:42,  2.98it/s]
 25%|██▌       | 93500/371472 [7:26:27<25:29:58,  3.03it/s]
                                                           
{'loss': 3.5538, 'learning_rate': 7.738315843909587e-07, 'epoch': 4.03}

 25%|██▌       | 93500/371472 [7:26:27<25:29:58,  3.03it/s]
 25%|██▌       | 93501/371472 [7:26:27<23:54:39,  3.23it/s]
 25%|██▌       | 93502/371472 [7:26:27<23:08:48,  3.34it/s]
 25%|██▌       | 93503/371472 [7:26:28<22:31:40,  3.43it/s]
 25%|██▌       | 93504/371472 [7:26:28<21:48:33,  3.54it/s]
 25%|██▌       | 93505/371472 [7:26:28<21:56:50,  3.52it/s]
 25%|██▌       | 93506/371472 [7:26:29<23:30:35,  3.28it/s]
 25%|██▌       | 93507/371472 [7:26:29<25:31:12,  3.03it/s]
 25%|██▌       | 93508/371472 [7:26:29<24:32:42,  3.15it/s]
 25%|██▌       | 93509/371472 [7:26:30<24:18:23,  3.18it/s]
 25%|██▌       | 93510/371472 [7:26:30<23:13:07,  3.33it/s]
 25%|██▌       | 93511/371472 [7:26:30<22:43:06,  3.40it/s]
 25%|██▌       | 93512/371472 [7:26:30<21:49:43,  3.54it/s]
 25%|██▌       | 93513/371472 [7:26:31<21:13:49,  3.64it/s]
 25%|██▌       | 93514/371472 [7:26:31<21:44:42,  3.55it/s]
 25%|██▌       | 93515/371472 [7:26:31<22:25:12,  3.44it/s]
 25%|██▌       | 93516/371472 [7:26:32<21:32:24,  3.58it/s]
 25%|██▌       | 93517/371472 [7:26:32<22:21:06,  3.45it/s]
 25%|██▌       | 93518/371472 [7:26:32<22:29:52,  3.43it/s]
 25%|██▌       | 93519/371472 [7:26:32<22:18:21,  3.46it/s]
 25%|██▌       | 93520/371472 [7:26:33<22:18:44,  3.46it/s]
                                                           
{'loss': 3.8761, 'learning_rate': 7.737831024154797e-07, 'epoch': 4.03}

 25%|██▌       | 93520/371472 [7:26:33<22:18:44,  3.46it/s]
 25%|██▌       | 93521/371472 [7:26:33<21:35:56,  3.57it/s]
 25%|██▌       | 93522/371472 [7:26:33<21:15:35,  3.63it/s]
 25%|██▌       | 93523/371472 [7:26:33<20:37:53,  3.74it/s]
 25%|██▌       | 93524/371472 [7:26:34<20:19:11,  3.80it/s]
 25%|██▌       | 93525/371472 [7:26:34<19:54:46,  3.88it/s]
 25%|██▌       | 93526/371472 [7:26:34<20:07:12,  3.84it/s]
 25%|██▌       | 93527/371472 [7:26:35<19:52:59,  3.88it/s]
 25%|██▌       | 93528/371472 [7:26:35<21:26:54,  3.60it/s]
 25%|██▌       | 93529/371472 [7:26:35<22:27:21,  3.44it/s]
 25%|██▌       | 93530/371472 [7:26:35<21:34:53,  3.58it/s]
 25%|██▌       | 93531/371472 [7:26:36<21:01:20,  3.67it/s]
 25%|██▌       | 93532/371472 [7:26:36<22:04:21,  3.50it/s]
 25%|██▌       | 93533/371472 [7:26:36<22:29:12,  3.43it/s]
 25%|██▌       | 93534/371472 [7:26:37<22:24:37,  3.45it/s]
 25%|██▌       | 93535/371472 [7:26:37<22:28:59,  3.43it/s]
 25%|██▌       | 93536/371472 [7:26:37<21:10:57,  3.64it/s]
 25%|██▌       | 93537/371472 [7:26:37<20:50:36,  3.70it/s]
 25%|██▌       | 93538/371472 [7:26:38<20:27:37,  3.77it/s]
 25%|██▌       | 93539/371472 [7:26:38<20:10:48,  3.83it/s]
 25%|██▌       | 93540/371472 [7:26:38<21:47:10,  3.54it/s]
                                                           
{'loss': 3.7814, 'learning_rate': 7.737346204400008e-07, 'epoch': 4.03}

 25%|██▌       | 93540/371472 [7:26:38<21:47:10,  3.54it/s]
 25%|██▌       | 93541/371472 [7:26:38<21:07:13,  3.66it/s]
 25%|██▌       | 93542/371472 [7:26:39<21:13:08,  3.64it/s]
 25%|██▌       | 93543/371472 [7:26:39<21:02:50,  3.67it/s]
 25%|██▌       | 93544/371472 [7:26:39<22:49:06,  3.38it/s]
 25%|██▌       | 93545/371472 [7:26:40<21:34:56,  3.58it/s]
 25%|██▌       | 93546/371472 [7:26:40<21:08:46,  3.65it/s]
 25%|██▌       | 93547/371472 [7:26:40<20:28:36,  3.77it/s]
 25%|██▌       | 93548/371472 [7:26:40<21:10:56,  3.64it/s]
 25%|██▌       | 93549/371472 [7:26:41<20:51:18,  3.70it/s]
 25%|██▌       | 93550/371472 [7:26:41<20:29:41,  3.77it/s]
 25%|██▌       | 93551/371472 [7:26:41<20:14:56,  3.81it/s]
 25%|██▌       | 93552/371472 [7:26:41<20:06:27,  3.84it/s]
 25%|██▌       | 93553/371472 [7:26:42<19:45:03,  3.91it/s]
 25%|██▌       | 93554/371472 [7:26:42<22:24:40,  3.44it/s]
 25%|██▌       | 93555/371472 [7:26:42<22:08:14,  3.49it/s]
 25%|██▌       | 93556/371472 [7:26:43<20:50:51,  3.70it/s]
 25%|██▌       | 93557/371472 [7:26:43<21:12:32,  3.64it/s]
 25%|██▌       | 93558/371472 [7:26:43<23:18:21,  3.31it/s]
 25%|██▌       | 93559/371472 [7:26:43<22:10:55,  3.48it/s]
 25%|██▌       | 93560/371472 [7:26:44<21:26:02,  3.60it/s]
                                                           
{'loss': 3.696, 'learning_rate': 7.73686138464522e-07, 'epoch': 4.03}

 25%|██▌       | 93560/371472 [7:26:44<21:26:02,  3.60it/s]
 25%|██▌       | 93561/371472 [7:26:44<22:01:09,  3.51it/s]
 25%|██▌       | 93562/371472 [7:26:44<21:22:31,  3.61it/s]
 25%|██▌       | 93563/371472 [7:26:45<21:52:14,  3.53it/s]
 25%|██▌       | 93564/371472 [7:26:45<21:45:55,  3.55it/s]
 25%|██▌       | 93565/371472 [7:26:45<21:28:05,  3.60it/s]
 25%|██▌       | 93566/371472 [7:26:45<21:15:14,  3.63it/s]
 25%|██▌       | 93567/371472 [7:26:46<21:58:18,  3.51it/s]
 25%|██▌       | 93568/371472 [7:26:46<22:41:26,  3.40it/s]
 25%|██▌       | 93569/371472 [7:26:46<21:45:44,  3.55it/s]
 25%|██▌       | 93570/371472 [7:26:46<21:01:03,  3.67it/s]
 25%|██▌       | 93571/371472 [7:26:47<20:44:06,  3.72it/s]
 25%|██▌       | 93572/371472 [7:26:47<21:53:09,  3.53it/s]
 25%|██▌       | 93573/371472 [7:26:47<21:25:54,  3.60it/s]
 25%|██▌       | 93574/371472 [7:26:48<22:44:49,  3.39it/s]
 25%|██▌       | 93575/371472 [7:26:48<21:26:03,  3.60it/s]
 25%|██▌       | 93576/371472 [7:26:48<24:13:00,  3.19it/s]
 25%|██▌       | 93577/371472 [7:26:49<22:58:23,  3.36it/s]
 25%|██▌       | 93578/371472 [7:26:49<24:38:07,  3.13it/s]
 25%|██▌       | 93579/371472 [7:26:49<22:52:14,  3.38it/s]
 25%|██▌       | 93580/371472 [7:26:49<22:22:15,  3.45it/s]
                                                           
{'loss': 3.5002, 'learning_rate': 7.73637656489043e-07, 'epoch': 4.03}

 25%|██▌       | 93580/371472 [7:26:49<22:22:15,  3.45it/s]
 25%|██▌       | 93581/371472 [7:26:50<21:25:27,  3.60it/s]
 25%|██▌       | 93582/371472 [7:26:50<20:27:19,  3.77it/s]
 25%|██▌       | 93583/371472 [7:26:50<19:59:31,  3.86it/s]
 25%|██▌       | 93584/371472 [7:26:50<20:08:53,  3.83it/s]
 25%|██▌       | 93585/371472 [7:26:51<19:56:01,  3.87it/s]
 25%|██▌       | 93586/371472 [7:26:51<20:49:03,  3.71it/s]
 25%|██▌       | 93587/371472 [7:26:51<20:20:28,  3.79it/s]
 25%|██▌       | 93588/371472 [7:26:52<24:02:19,  3.21it/s]
 25%|██▌       | 93589/371472 [7:26:52<24:40:47,  3.13it/s]
 25%|██▌       | 93590/371472 [7:26:52<22:49:54,  3.38it/s]
 25%|██▌       | 93591/371472 [7:26:53<23:35:22,  3.27it/s]
 25%|██▌       | 93592/371472 [7:26:53<22:32:09,  3.43it/s]
 25%|██▌       | 93593/371472 [7:26:53<24:01:17,  3.21it/s]
 25%|██▌       | 93594/371472 [7:26:53<22:56:13,  3.37it/s]
 25%|██▌       | 93595/371472 [7:26:54<21:56:16,  3.52it/s]
 25%|██▌       | 93596/371472 [7:26:54<21:37:54,  3.57it/s]
 25%|██▌       | 93597/371472 [7:26:54<21:16:19,  3.63it/s]
 25%|██▌       | 93598/371472 [7:26:54<20:23:54,  3.78it/s]
 25%|██▌       | 93599/371472 [7:26:55<20:04:04,  3.85it/s]
 25%|██▌       | 93600/371472 [7:26:55<19:42:32,  3.92it/s]
                                                           
{'loss': 3.7821, 'learning_rate': 7.735891745135641e-07, 'epoch': 4.03}

 25%|██▌       | 93600/371472 [7:26:55<19:42:32,  3.92it/s]
 25%|██▌       | 93601/371472 [7:26:55<19:41:18,  3.92it/s]
 25%|██▌       | 93602/371472 [7:26:56<20:15:35,  3.81it/s]
 25%|██▌       | 93603/371472 [7:26:56<19:46:09,  3.90it/s]
 25%|██▌       | 93604/371472 [7:26:56<21:13:05,  3.64it/s]
 25%|██▌       | 93605/371472 [7:26:56<22:00:20,  3.51it/s]
 25%|██▌       | 93606/371472 [7:26:57<22:05:08,  3.49it/s]
 25%|██▌       | 93607/371472 [7:26:57<22:29:17,  3.43it/s]
 25%|██▌       | 93608/371472 [7:26:57<22:50:50,  3.38it/s]
 25%|██▌       | 93609/371472 [7:26:58<21:39:32,  3.56it/s]
 25%|██▌       | 93610/371472 [7:26:58<21:51:53,  3.53it/s]
 25%|██▌       | 93611/371472 [7:26:58<23:12:40,  3.33it/s]
 25%|██▌       | 93612/371472 [7:26:58<21:58:49,  3.51it/s]
 25%|██▌       | 93613/371472 [7:26:59<21:18:18,  3.62it/s]
 25%|██▌       | 93614/371472 [7:26:59<20:53:40,  3.69it/s]
 25%|██▌       | 93615/371472 [7:26:59<21:46:16,  3.55it/s]
 25%|██▌       | 93616/371472 [7:26:59<20:48:16,  3.71it/s]
 25%|██▌       | 93617/371472 [7:27:00<20:49:21,  3.71it/s]
 25%|██▌       | 93618/371472 [7:27:00<20:33:08,  3.76it/s]
 25%|██▌       | 93619/371472 [7:27:00<21:50:05,  3.53it/s]
 25%|██▌       | 93620/371472 [7:27:01<21:12:38,  3.64it/s]
                                                           
{'loss': 3.7736, 'learning_rate': 7.735406925380853e-07, 'epoch': 4.03}

 25%|██▌       | 93620/371472 [7:27:01<21:12:38,  3.64it/s]
 25%|██▌       | 93621/371472 [7:27:01<21:48:25,  3.54it/s]
 25%|██▌       | 93622/371472 [7:27:01<22:09:58,  3.48it/s]
 25%|██▌       | 93623/371472 [7:27:01<22:30:08,  3.43it/s]
 25%|██▌       | 93624/371472 [7:27:02<21:53:16,  3.53it/s]
 25%|██▌       | 93625/371472 [7:27:02<21:33:22,  3.58it/s]
 25%|██▌       | 93626/371472 [7:27:02<21:29:03,  3.59it/s]
 25%|██▌       | 93627/371472 [7:27:03<21:33:05,  3.58it/s]
 25%|██▌       | 93628/371472 [7:27:03<21:33:11,  3.58it/s]
 25%|██▌       | 93629/371472 [7:27:03<23:03:52,  3.35it/s]
 25%|██▌       | 93630/371472 [7:27:04<23:27:24,  3.29it/s]
 25%|██▌       | 93631/371472 [7:27:04<22:24:12,  3.44it/s]
 25%|██▌       | 93632/371472 [7:27:04<22:30:38,  3.43it/s]
 25%|██▌       | 93633/371472 [7:27:04<21:15:16,  3.63it/s]
 25%|██▌       | 93634/371472 [7:27:05<21:29:17,  3.59it/s]
 25%|██▌       | 93635/371472 [7:27:05<20:36:19,  3.75it/s]
 25%|██▌       | 93636/371472 [7:27:05<20:43:56,  3.72it/s]
 25%|██▌       | 93637/371472 [7:27:05<20:32:45,  3.76it/s]
 25%|██▌       | 93638/371472 [7:27:06<20:27:51,  3.77it/s]
 25%|██▌       | 93639/371472 [7:27:06<20:09:46,  3.83it/s]
 25%|██▌       | 93640/371472 [7:27:06<20:27:34,  3.77it/s]
                                                           
{'loss': 3.6331, 'learning_rate': 7.734922105626065e-07, 'epoch': 4.03}

 25%|██▌       | 93640/371472 [7:27:06<20:27:34,  3.77it/s]
 25%|██▌       | 93641/371472 [7:27:06<20:31:48,  3.76it/s]
 25%|██▌       | 93642/371472 [7:27:07<21:55:26,  3.52it/s]
 25%|██▌       | 93643/371472 [7:27:07<23:51:03,  3.24it/s]
 25%|██▌       | 93644/371472 [7:27:07<23:09:44,  3.33it/s]
 25%|██▌       | 93645/371472 [7:27:08<23:51:18,  3.24it/s]
 25%|██▌       | 93646/371472 [7:27:08<23:06:36,  3.34it/s]
 25%|██▌       | 93647/371472 [7:27:08<24:00:08,  3.22it/s]
 25%|██▌       | 93648/371472 [7:27:09<23:03:16,  3.35it/s]
 25%|██▌       | 93649/371472 [7:27:09<22:47:32,  3.39it/s]
 25%|██▌       | 93650/371472 [7:27:09<21:55:31,  3.52it/s]
 25%|██▌       | 93651/371472 [7:27:09<21:03:23,  3.67it/s]
 25%|██▌       | 93652/371472 [7:27:10<21:52:59,  3.53it/s]
 25%|██▌       | 93653/371472 [7:27:10<21:28:41,  3.59it/s]
 25%|██▌       | 93654/371472 [7:27:10<20:32:55,  3.76it/s]
 25%|██▌       | 93655/371472 [7:27:10<20:25:22,  3.78it/s]
 25%|██▌       | 93656/371472 [7:27:11<21:12:04,  3.64it/s]
 25%|██▌       | 93657/371472 [7:27:11<21:57:56,  3.51it/s]
 25%|██▌       | 93658/371472 [7:27:11<22:18:34,  3.46it/s]
 25%|██▌       | 93659/371472 [7:27:12<21:56:32,  3.52it/s]
 25%|██▌       | 93660/371472 [7:27:12<21:53:57,  3.52it/s]
                                                           
{'loss': 3.7201, 'learning_rate': 7.734437285871274e-07, 'epoch': 4.03}

 25%|██▌       | 93660/371472 [7:27:12<21:53:57,  3.52it/s]
 25%|██▌       | 93661/371472 [7:27:12<21:00:33,  3.67it/s]
 25%|██▌       | 93662/371472 [7:27:12<21:11:11,  3.64it/s]
 25%|██▌       | 93663/371472 [7:27:13<20:28:55,  3.77it/s]
 25%|██▌       | 93664/371472 [7:27:13<21:31:58,  3.58it/s]
 25%|██▌       | 93665/371472 [7:27:13<23:07:53,  3.34it/s]
 25%|██▌       | 93666/371472 [7:27:14<23:10:14,  3.33it/s]
 25%|██▌       | 93667/371472 [7:27:14<22:45:45,  3.39it/s]
 25%|██▌       | 93668/371472 [7:27:14<22:36:41,  3.41it/s]
 25%|██▌       | 93669/371472 [7:27:14<22:01:32,  3.50it/s]
 25%|██▌       | 93670/371472 [7:27:15<20:58:25,  3.68it/s]
 25%|██▌       | 93671/371472 [7:27:15<20:54:13,  3.69it/s]
 25%|██▌       | 93672/371472 [7:27:15<21:53:17,  3.53it/s]
 25%|██▌       | 93673/371472 [7:27:16<22:05:40,  3.49it/s]
 25%|██▌       | 93674/371472 [7:27:16<23:01:38,  3.35it/s]
 25%|██▌       | 93675/371472 [7:27:16<21:56:16,  3.52it/s]
 25%|██▌       | 93676/371472 [7:27:17<22:38:24,  3.41it/s]
 25%|██▌       | 93677/371472 [7:27:17<22:29:26,  3.43it/s]
 25%|██▌       | 93678/371472 [7:27:17<23:57:20,  3.22it/s]
 25%|██▌       | 93679/371472 [7:27:17<23:20:23,  3.31it/s]
 25%|██▌       | 93680/371472 [7:27:18<22:29:24,  3.43it/s]
                                                           
{'loss': 3.5504, 'learning_rate': 7.733952466116485e-07, 'epoch': 4.03}

 25%|██▌       | 93680/371472 [7:27:18<22:29:24,  3.43it/s]
 25%|██▌       | 93681/371472 [7:27:18<22:20:35,  3.45it/s]
 25%|██▌       | 93682/371472 [7:27:18<23:35:22,  3.27it/s]
 25%|██▌       | 93683/371472 [7:27:19<22:26:34,  3.44it/s]
 25%|██▌       | 93684/371472 [7:27:19<21:15:20,  3.63it/s]
 25%|██▌       | 93685/371472 [7:27:19<21:33:00,  3.58it/s]
 25%|██▌       | 93686/371472 [7:27:19<22:28:40,  3.43it/s]
 25%|██▌       | 93687/371472 [7:27:20<21:38:42,  3.56it/s]
 25%|██▌       | 93688/371472 [7:27:20<21:12:36,  3.64it/s]
 25%|██▌       | 93689/371472 [7:27:20<21:46:59,  3.54it/s]
 25%|██▌       | 93690/371472 [7:27:20<21:12:07,  3.64it/s]
 25%|██▌       | 93691/371472 [7:27:21<21:21:41,  3.61it/s]
 25%|██▌       | 93692/371472 [7:27:21<21:48:01,  3.54it/s]
 25%|██▌       | 93693/371472 [7:27:21<23:24:07,  3.30it/s]
 25%|██▌       | 93694/371472 [7:27:22<23:12:43,  3.32it/s]
 25%|██▌       | 93695/371472 [7:27:22<22:16:21,  3.46it/s]
 25%|██▌       | 93696/371472 [7:27:22<21:19:11,  3.62it/s]
 25%|██▌       | 93697/371472 [7:27:23<21:10:38,  3.64it/s]
 25%|██▌       | 93698/371472 [7:27:23<20:33:20,  3.75it/s]
 25%|██▌       | 93699/371472 [7:27:23<20:14:55,  3.81it/s]
 25%|██▌       | 93700/371472 [7:27:23<21:08:52,  3.65it/s]
                                                           
{'loss': 3.773, 'learning_rate': 7.733467646361697e-07, 'epoch': 4.04}

 25%|██▌       | 93700/371472 [7:27:23<21:08:52,  3.65it/s]
 25%|██▌       | 93701/371472 [7:27:24<22:29:33,  3.43it/s]
 25%|██▌       | 93702/371472 [7:27:24<21:55:42,  3.52it/s]
 25%|██▌       | 93703/371472 [7:27:24<21:16:30,  3.63it/s]
 25%|██▌       | 93704/371472 [7:27:24<20:27:51,  3.77it/s]
 25%|██▌       | 93705/371472 [7:27:25<20:38:06,  3.74it/s]
 25%|██▌       | 93706/371472 [7:27:25<23:19:23,  3.31it/s]
 25%|██▌       | 93707/371472 [7:27:25<22:10:38,  3.48it/s]
 25%|██▌       | 93708/371472 [7:27:26<21:46:41,  3.54it/s]
 25%|██▌       | 93709/371472 [7:27:26<22:06:42,  3.49it/s]
 25%|██▌       | 93710/371472 [7:27:26<21:14:09,  3.63it/s]
 25%|██▌       | 93711/371472 [7:27:26<21:27:06,  3.60it/s]
 25%|██▌       | 93712/371472 [7:27:27<21:28:26,  3.59it/s]
 25%|██▌       | 93713/371472 [7:27:27<20:56:32,  3.68it/s]
 25%|██▌       | 93714/371472 [7:27:27<21:28:17,  3.59it/s]
 25%|██▌       | 93715/371472 [7:27:28<21:36:49,  3.57it/s]
 25%|██▌       | 93716/371472 [7:27:28<21:55:00,  3.52it/s]
 25%|██▌       | 93717/371472 [7:27:28<21:51:27,  3.53it/s]
 25%|██▌       | 93718/371472 [7:27:28<22:13:13,  3.47it/s]
 25%|██▌       | 93719/371472 [7:27:29<21:37:33,  3.57it/s]
 25%|██▌       | 93720/371472 [7:27:29<21:15:00,  3.63it/s]
                                                           
{'loss': 3.5198, 'learning_rate': 7.732982826606908e-07, 'epoch': 4.04}

 25%|██▌       | 93720/371472 [7:27:29<21:15:00,  3.63it/s]
 25%|██▌       | 93721/371472 [7:27:29<21:33:14,  3.58it/s]
 25%|██▌       | 93722/371472 [7:27:29<21:41:32,  3.56it/s]
 25%|██▌       | 93723/371472 [7:27:30<21:08:48,  3.65it/s]
 25%|██▌       | 93724/371472 [7:27:30<21:58:19,  3.51it/s]
 25%|██▌       | 93725/371472 [7:27:30<21:45:34,  3.55it/s]
 25%|██▌       | 93726/371472 [7:27:31<21:41:26,  3.56it/s]
 25%|██▌       | 93727/371472 [7:27:31<21:29:47,  3.59it/s]
 25%|██▌       | 93728/371472 [7:27:31<21:07:05,  3.65it/s]
 25%|██▌       | 93729/371472 [7:27:31<20:27:33,  3.77it/s]
 25%|██▌       | 93730/371472 [7:27:32<21:16:29,  3.63it/s]
 25%|██▌       | 93731/371472 [7:27:32<21:38:53,  3.56it/s]
 25%|██▌       | 93732/371472 [7:27:32<21:26:55,  3.60it/s]
 25%|██▌       | 93733/371472 [7:27:33<21:02:40,  3.67it/s]
 25%|██▌       | 93734/371472 [7:27:33<21:35:26,  3.57it/s]
 25%|██▌       | 93735/371472 [7:27:33<21:44:04,  3.55it/s]
 25%|██▌       | 93736/371472 [7:27:33<21:17:06,  3.62it/s]
 25%|██▌       | 93737/371472 [7:27:34<21:08:40,  3.65it/s]
 25%|██▌       | 93738/371472 [7:27:34<21:45:56,  3.54it/s]
 25%|██▌       | 93739/371472 [7:27:34<21:24:09,  3.60it/s]
 25%|██▌       | 93740/371472 [7:27:34<21:03:54,  3.66it/s]
                                                           
{'loss': 3.6763, 'learning_rate': 7.732498006852118e-07, 'epoch': 4.04}

 25%|██▌       | 93740/371472 [7:27:34<21:03:54,  3.66it/s]
 25%|██▌       | 93741/371472 [7:27:35<21:56:26,  3.52it/s]
 25%|██▌       | 93742/371472 [7:27:35<23:05:46,  3.34it/s]
 25%|██▌       | 93743/371472 [7:27:35<21:58:10,  3.51it/s]
 25%|██▌       | 93744/371472 [7:27:36<21:38:31,  3.56it/s]
 25%|██▌       | 93745/371472 [7:27:36<22:08:11,  3.49it/s]
 25%|██▌       | 93746/371472 [7:27:36<21:22:01,  3.61it/s]
 25%|██▌       | 93747/371472 [7:27:36<21:42:38,  3.55it/s]
 25%|██▌       | 93748/371472 [7:27:37<21:15:21,  3.63it/s]
 25%|██▌       | 93749/371472 [7:27:37<21:07:58,  3.65it/s]
 25%|██▌       | 93750/371472 [7:27:37<21:05:36,  3.66it/s]
 25%|██▌       | 93751/371472 [7:27:38<21:17:32,  3.62it/s]
 25%|██▌       | 93752/371472 [7:27:38<21:29:54,  3.59it/s]
 25%|██▌       | 93753/371472 [7:27:38<20:38:43,  3.74it/s]
 25%|██▌       | 93754/371472 [7:27:38<20:58:12,  3.68it/s]
 25%|██▌       | 93755/371472 [7:27:39<23:08:50,  3.33it/s]
 25%|██▌       | 93756/371472 [7:27:39<23:54:49,  3.23it/s]
 25%|██▌       | 93757/371472 [7:27:39<22:23:45,  3.44it/s]
 25%|██▌       | 93758/371472 [7:27:40<23:02:05,  3.35it/s]
 25%|██▌       | 93759/371472 [7:27:40<22:19:19,  3.46it/s]
 25%|██▌       | 93760/371472 [7:27:40<21:17:05,  3.62it/s]
                                                           
{'loss': 3.7281, 'learning_rate': 7.73201318709733e-07, 'epoch': 4.04}

 25%|██▌       | 93760/371472 [7:27:40<21:17:05,  3.62it/s]
 25%|██▌       | 93761/371472 [7:27:40<21:24:52,  3.60it/s]
 25%|██▌       | 93762/371472 [7:27:41<21:04:15,  3.66it/s]
 25%|██▌       | 93763/371472 [7:27:41<21:32:50,  3.58it/s]
 25%|██▌       | 93764/371472 [7:27:41<23:38:11,  3.26it/s]
 25%|██▌       | 93765/371472 [7:27:42<22:14:54,  3.47it/s]
 25%|██▌       | 93766/371472 [7:27:42<21:16:40,  3.63it/s]
 25%|██▌       | 93767/371472 [7:27:42<20:25:48,  3.78it/s]
 25%|██▌       | 93768/371472 [7:27:42<20:53:36,  3.69it/s]
 25%|██▌       | 93769/371472 [7:27:43<20:40:26,  3.73it/s]
 25%|██▌       | 93770/371472 [7:27:43<21:06:50,  3.65it/s]
 25%|██▌       | 93771/371472 [7:27:43<21:21:10,  3.61it/s]
 25%|██▌       | 93772/371472 [7:27:43<20:51:14,  3.70it/s]
 25%|██▌       | 93773/371472 [7:27:44<20:37:58,  3.74it/s]
 25%|██▌       | 93774/371472 [7:27:44<20:48:48,  3.71it/s]
 25%|██▌       | 93775/371472 [7:27:44<24:24:09,  3.16it/s]
 25%|██▌       | 93776/371472 [7:27:45<23:07:28,  3.34it/s]
 25%|██▌       | 93777/371472 [7:27:45<22:42:05,  3.40it/s]
 25%|██▌       | 93778/371472 [7:27:45<22:59:44,  3.35it/s]
 25%|██▌       | 93779/371472 [7:27:46<21:47:08,  3.54it/s]
 25%|██▌       | 93780/371472 [7:27:46<21:46:58,  3.54it/s]
                                                           
{'loss': 3.6656, 'learning_rate': 7.731528367342541e-07, 'epoch': 4.04}

 25%|██▌       | 93780/371472 [7:27:46<21:46:58,  3.54it/s]
 25%|██▌       | 93781/371472 [7:27:46<22:08:55,  3.48it/s]
 25%|██▌       | 93782/371472 [7:27:46<21:14:06,  3.63it/s]
 25%|██▌       | 93783/371472 [7:27:47<21:40:14,  3.56it/s]
 25%|██▌       | 93784/371472 [7:27:47<21:13:33,  3.63it/s]
 25%|██▌       | 93785/371472 [7:27:47<21:46:52,  3.54it/s]
 25%|██▌       | 93786/371472 [7:27:48<22:36:06,  3.41it/s]
 25%|██▌       | 93787/371472 [7:27:48<22:22:21,  3.45it/s]
 25%|██▌       | 93788/371472 [7:27:48<23:43:00,  3.25it/s]
 25%|██▌       | 93789/371472 [7:27:48<22:39:14,  3.40it/s]
 25%|██▌       | 93790/371472 [7:27:49<22:02:14,  3.50it/s]
 25%|██▌       | 93791/371472 [7:27:49<22:32:36,  3.42it/s]
 25%|██▌       | 93792/371472 [7:27:49<22:39:29,  3.40it/s]
 25%|██▌       | 93793/371472 [7:27:50<21:40:16,  3.56it/s]
 25%|██▌       | 93794/371472 [7:27:50<22:47:39,  3.38it/s]
 25%|██▌       | 93795/371472 [7:27:50<22:01:37,  3.50it/s]
 25%|██▌       | 93796/371472 [7:27:50<21:42:27,  3.55it/s]
 25%|██▌       | 93797/371472 [7:27:51<20:52:12,  3.70it/s]
 25%|██▌       | 93798/371472 [7:27:51<20:34:36,  3.75it/s]
 25%|██▌       | 93799/371472 [7:27:51<20:41:06,  3.73it/s]
 25%|██▌       | 93800/371472 [7:27:51<20:16:47,  3.80it/s]
                                                           
{'loss': 3.961, 'learning_rate': 7.731043547587752e-07, 'epoch': 4.04}

 25%|██▌       | 93800/371472 [7:27:51<20:16:47,  3.80it/s]
 25%|██▌       | 93801/371472 [7:27:52<20:26:41,  3.77it/s]
 25%|██▌       | 93802/371472 [7:27:52<23:18:19,  3.31it/s]
 25%|██▌       | 93803/371472 [7:27:52<21:55:36,  3.52it/s]
 25%|██▌       | 93804/371472 [7:27:53<23:34:05,  3.27it/s]
 25%|██▌       | 93805/371472 [7:27:53<21:57:06,  3.51it/s]
 25%|██▌       | 93806/371472 [7:27:53<22:43:29,  3.39it/s]
 25%|██▌       | 93807/371472 [7:27:54<22:21:38,  3.45it/s]
 25%|██▌       | 93808/371472 [7:27:54<22:31:30,  3.42it/s]
 25%|██▌       | 93809/371472 [7:27:54<22:28:08,  3.43it/s]
 25%|██▌       | 93810/371472 [7:27:54<21:14:00,  3.63it/s]
 25%|██▌       | 93811/371472 [7:27:55<20:21:35,  3.79it/s]
 25%|██▌       | 93812/371472 [7:27:55<20:23:02,  3.78it/s]
 25%|██▌       | 93813/371472 [7:27:55<20:13:28,  3.81it/s]
 25%|██▌       | 93814/371472 [7:27:55<20:32:48,  3.75it/s]
 25%|██▌       | 93815/371472 [7:27:56<19:46:08,  3.90it/s]
 25%|██▌       | 93816/371472 [7:27:56<19:45:58,  3.90it/s]
 25%|██▌       | 93817/371472 [7:27:56<22:15:06,  3.47it/s]
 25%|██▌       | 93818/371472 [7:27:56<21:51:32,  3.53it/s]
 25%|██▌       | 93819/371472 [7:27:57<21:54:31,  3.52it/s]
 25%|██▌       | 93820/371472 [7:27:57<20:52:56,  3.69it/s]
                                                           
{'loss': 3.6461, 'learning_rate': 7.730558727832962e-07, 'epoch': 4.04}

 25%|██▌       | 93820/371472 [7:27:57<20:52:56,  3.69it/s]
 25%|██▌       | 93821/371472 [7:27:57<20:44:16,  3.72it/s]
 25%|██▌       | 93822/371472 [7:27:58<20:31:33,  3.76it/s]
 25%|██▌       | 93823/371472 [7:27:58<20:26:29,  3.77it/s]
 25%|██▌       | 93824/371472 [7:27:58<21:10:06,  3.64it/s]
 25%|██▌       | 93825/371472 [7:27:58<21:15:57,  3.63it/s]
 25%|██▌       | 93826/371472 [7:27:59<20:52:26,  3.69it/s]
 25%|██▌       | 93827/371472 [7:27:59<21:14:51,  3.63it/s]
 25%|██▌       | 93828/371472 [7:27:59<21:01:34,  3.67it/s]
 25%|██▌       | 93829/371472 [7:28:00<28:05:07,  2.75it/s]
 25%|██▌       | 93830/371472 [7:28:00<27:14:14,  2.83it/s]
 25%|██▌       | 93831/371472 [7:28:00<25:11:25,  3.06it/s]
 25%|██▌       | 93832/371472 [7:28:01<23:32:47,  3.28it/s]
 25%|██▌       | 93833/371472 [7:28:01<25:30:01,  3.02it/s]
 25%|██▌       | 93834/371472 [7:28:01<24:18:25,  3.17it/s]
 25%|██▌       | 93835/371472 [7:28:02<23:03:19,  3.35it/s]
 25%|██▌       | 93836/371472 [7:28:02<21:40:32,  3.56it/s]
 25%|██▌       | 93837/371472 [7:28:02<21:51:37,  3.53it/s]
 25%|██▌       | 93838/371472 [7:28:02<22:17:28,  3.46it/s]
 25%|██▌       | 93839/371472 [7:28:03<26:00:19,  2.97it/s]
 25%|██▌       | 93840/371472 [7:28:03<24:33:11,  3.14it/s]
                                                           
{'loss': 3.6627, 'learning_rate': 7.730073908078174e-07, 'epoch': 4.04}

 25%|██▌       | 93840/371472 [7:28:03<24:33:11,  3.14it/s]
 25%|██▌       | 93841/371472 [7:28:03<22:54:15,  3.37it/s]
 25%|██▌       | 93842/371472 [7:28:04<22:03:33,  3.50it/s]
 25%|██▌       | 93843/371472 [7:28:04<22:06:07,  3.49it/s]
 25%|██▌       | 93844/371472 [7:28:04<21:33:24,  3.58it/s]
 25%|██▌       | 93845/371472 [7:28:04<20:33:55,  3.75it/s]
 25%|██▌       | 93846/371472 [7:28:05<22:47:38,  3.38it/s]
 25%|██▌       | 93847/371472 [7:28:05<23:10:52,  3.33it/s]
 25%|██▌       | 93848/371472 [7:28:05<22:14:49,  3.47it/s]
 25%|██▌       | 93849/371472 [7:28:06<21:41:29,  3.56it/s]
 25%|██▌       | 93850/371472 [7:28:06<20:46:52,  3.71it/s]
 25%|██▌       | 93851/371472 [7:28:06<22:34:33,  3.42it/s]
 25%|██▌       | 93852/371472 [7:28:06<22:50:56,  3.38it/s]
 25%|██▌       | 93853/371472 [7:28:07<22:48:27,  3.38it/s]
 25%|██▌       | 93854/371472 [7:28:07<23:27:11,  3.29it/s]
 25%|██▌       | 93855/371472 [7:28:07<22:04:55,  3.49it/s]
 25%|██▌       | 93856/371472 [7:28:08<21:25:34,  3.60it/s]
 25%|██▌       | 93857/371472 [7:28:08<21:08:39,  3.65it/s]
 25%|██▌       | 93858/371472 [7:28:08<21:46:39,  3.54it/s]
 25%|██▌       | 93859/371472 [7:28:08<21:06:38,  3.65it/s]
 25%|██▌       | 93860/371472 [7:28:09<20:20:13,  3.79it/s]
                                                           
{'loss': 3.723, 'learning_rate': 7.729589088323386e-07, 'epoch': 4.04}

 25%|██▌       | 93860/371472 [7:28:09<20:20:13,  3.79it/s]
 25%|██▌       | 93861/371472 [7:28:09<20:29:22,  3.76it/s]
 25%|██▌       | 93862/371472 [7:28:09<20:40:07,  3.73it/s]
 25%|██▌       | 93863/371472 [7:28:09<20:05:46,  3.84it/s]
 25%|██▌       | 93864/371472 [7:28:10<20:53:51,  3.69it/s]
 25%|██▌       | 93865/371472 [7:28:10<20:44:28,  3.72it/s]
 25%|██▌       | 93866/371472 [7:28:10<20:19:49,  3.79it/s]
 25%|██▌       | 93867/371472 [7:28:11<20:59:47,  3.67it/s]
 25%|██▌       | 93868/371472 [7:28:11<20:43:33,  3.72it/s]
 25%|██▌       | 93869/371472 [7:28:11<20:33:32,  3.75it/s]
 25%|██▌       | 93870/371472 [7:28:11<19:45:47,  3.90it/s]
 25%|██▌       | 93871/371472 [7:28:12<20:06:51,  3.83it/s]
 25%|██▌       | 93872/371472 [7:28:12<21:22:58,  3.61it/s]
 25%|██▌       | 93873/371472 [7:28:12<23:05:57,  3.34it/s]
 25%|██▌       | 93874/371472 [7:28:13<22:53:33,  3.37it/s]
 25%|██▌       | 93875/371472 [7:28:13<22:47:32,  3.38it/s]
 25%|██▌       | 93876/371472 [7:28:13<22:16:14,  3.46it/s]
 25%|██▌       | 93877/371472 [7:28:13<22:12:47,  3.47it/s]
 25%|██▌       | 93878/371472 [7:28:14<22:24:32,  3.44it/s]
 25%|██▌       | 93879/371472 [7:28:14<25:09:11,  3.07it/s]
 25%|██▌       | 93880/371472 [7:28:14<24:43:36,  3.12it/s]
                                                           
{'loss': 3.7918, 'learning_rate': 7.729104268568597e-07, 'epoch': 4.04}

 25%|██▌       | 93880/371472 [7:28:14<24:43:36,  3.12it/s]
 25%|██▌       | 93881/371472 [7:28:15<23:24:27,  3.29it/s]
 25%|██▌       | 93882/371472 [7:28:15<22:28:20,  3.43it/s]
 25%|██▌       | 93883/371472 [7:28:15<22:35:02,  3.41it/s]
 25%|██▌       | 93884/371472 [7:28:16<22:41:53,  3.40it/s]
 25%|██▌       | 93885/371472 [7:28:16<21:21:11,  3.61it/s]
 25%|██▌       | 93886/371472 [7:28:16<21:18:40,  3.62it/s]
 25%|██▌       | 93887/371472 [7:28:16<21:13:37,  3.63it/s]
 25%|██▌       | 93888/371472 [7:28:17<23:20:44,  3.30it/s]
 25%|██▌       | 93889/371472 [7:28:17<23:15:20,  3.32it/s]
 25%|██▌       | 93890/371472 [7:28:17<22:35:13,  3.41it/s]
 25%|██▌       | 93891/371472 [7:28:18<22:05:26,  3.49it/s]
 25%|██▌       | 93892/371472 [7:28:18<21:43:20,  3.55it/s]
 25%|██▌       | 93893/371472 [7:28:18<21:37:06,  3.57it/s]
 25%|██▌       | 93894/371472 [7:28:18<21:41:48,  3.55it/s]
 25%|██▌       | 93895/371472 [7:28:19<21:33:00,  3.58it/s]
 25%|██▌       | 93896/371472 [7:28:19<21:06:43,  3.65it/s]
 25%|██▌       | 93897/371472 [7:28:19<21:26:37,  3.60it/s]
 25%|██▌       | 93898/371472 [7:28:19<21:32:19,  3.58it/s]
 25%|██▌       | 93899/371472 [7:28:20<21:16:34,  3.62it/s]
 25%|██▌       | 93900/371472 [7:28:20<22:03:17,  3.50it/s]
                                                           
{'loss': 3.7381, 'learning_rate': 7.728619448813807e-07, 'epoch': 4.04}

 25%|██▌       | 93900/371472 [7:28:20<22:03:17,  3.50it/s]
 25%|██▌       | 93901/371472 [7:28:20<22:12:20,  3.47it/s]
 25%|██▌       | 93902/371472 [7:28:21<22:02:28,  3.50it/s]
 25%|██▌       | 93903/371472 [7:28:21<23:15:04,  3.32it/s]
 25%|██▌       | 93904/371472 [7:28:21<24:18:19,  3.17it/s]
 25%|██▌       | 93905/371472 [7:28:22<22:45:29,  3.39it/s]
 25%|██▌       | 93906/371472 [7:28:22<23:01:20,  3.35it/s]
 25%|██▌       | 93907/371472 [7:28:22<21:42:27,  3.55it/s]
 25%|██▌       | 93908/371472 [7:28:22<21:31:40,  3.58it/s]
 25%|██▌       | 93909/371472 [7:28:23<20:50:13,  3.70it/s]
 25%|██▌       | 93910/371472 [7:28:23<20:36:02,  3.74it/s]
 25%|██▌       | 93911/371472 [7:28:23<20:38:10,  3.74it/s]
 25%|██▌       | 93912/371472 [7:28:23<21:21:15,  3.61it/s]
 25%|██▌       | 93913/371472 [7:28:24<21:54:05,  3.52it/s]
 25%|██▌       | 93914/371472 [7:28:24<20:57:11,  3.68it/s]
 25%|██▌       | 93915/371472 [7:28:24<20:47:09,  3.71it/s]
 25%|██▌       | 93916/371472 [7:28:25<22:36:46,  3.41it/s]
 25%|██▌       | 93917/371472 [7:28:25<21:50:18,  3.53it/s]
 25%|██▌       | 93918/371472 [7:28:25<21:08:17,  3.65it/s]
 25%|██▌       | 93919/371472 [7:28:25<20:03:54,  3.84it/s]
 25%|██▌       | 93920/371472 [7:28:26<20:15:45,  3.80it/s]
                                                           
{'loss': 3.6455, 'learning_rate': 7.728134629059018e-07, 'epoch': 4.05}

 25%|██▌       | 93920/371472 [7:28:26<20:15:45,  3.80it/s]
 25%|██▌       | 93921/371472 [7:28:26<21:15:09,  3.63it/s]
 25%|██▌       | 93922/371472 [7:28:26<22:21:00,  3.45it/s]
 25%|██▌       | 93923/371472 [7:28:27<23:01:24,  3.35it/s]
 25%|██▌       | 93924/371472 [7:28:27<22:50:00,  3.38it/s]
 25%|██▌       | 93925/371472 [7:28:27<22:33:11,  3.42it/s]
 25%|██▌       | 93926/371472 [7:28:27<22:40:36,  3.40it/s]
 25%|██▌       | 93927/371472 [7:28:28<21:34:53,  3.57it/s]
 25%|██▌       | 93928/371472 [7:28:28<20:59:16,  3.67it/s]
 25%|██▌       | 93929/371472 [7:28:28<20:26:58,  3.77it/s]
 25%|██▌       | 93930/371472 [7:28:28<20:33:57,  3.75it/s]
 25%|██▌       | 93931/371472 [7:28:29<20:33:57,  3.75it/s]
 25%|██▌       | 93932/371472 [7:28:29<21:46:37,  3.54it/s]
 25%|██▌       | 93933/371472 [7:28:29<21:13:44,  3.63it/s]
 25%|██▌       | 93934/371472 [7:28:30<21:25:18,  3.60it/s]
 25%|██▌       | 93935/371472 [7:28:30<21:16:15,  3.62it/s]
 25%|██▌       | 93936/371472 [7:28:30<20:54:21,  3.69it/s]
 25%|██▌       | 93937/371472 [7:28:30<23:23:01,  3.30it/s]
 25%|██▌       | 93938/371472 [7:28:31<23:35:14,  3.27it/s]
 25%|██▌       | 93939/371472 [7:28:31<22:48:37,  3.38it/s]
 25%|██▌       | 93940/371472 [7:28:31<23:27:22,  3.29it/s]
                                                           
{'loss': 3.5353, 'learning_rate': 7.72764980930423e-07, 'epoch': 4.05}

 25%|██▌       | 93940/371472 [7:28:31<23:27:22,  3.29it/s]
 25%|██▌       | 93941/371472 [7:28:32<23:07:02,  3.33it/s]
 25%|██▌       | 93942/371472 [7:28:32<22:07:20,  3.48it/s]
 25%|██▌       | 93943/371472 [7:28:32<22:25:43,  3.44it/s]
 25%|██▌       | 93944/371472 [7:28:33<21:44:30,  3.55it/s]
 25%|██▌       | 93945/371472 [7:28:33<21:29:37,  3.59it/s]
 25%|██▌       | 93946/371472 [7:28:33<21:45:21,  3.54it/s]
 25%|██▌       | 93947/371472 [7:28:33<20:54:03,  3.69it/s]
 25%|██▌       | 93948/371472 [7:28:34<20:50:51,  3.70it/s]
 25%|██▌       | 93949/371472 [7:28:34<20:00:24,  3.85it/s]
 25%|██▌       | 93950/371472 [7:28:34<19:56:11,  3.87it/s]
 25%|██▌       | 93951/371472 [7:28:34<20:34:26,  3.75it/s]
 25%|██▌       | 93952/371472 [7:28:35<20:14:54,  3.81it/s]
 25%|██▌       | 93953/371472 [7:28:35<20:29:20,  3.76it/s]
 25%|██▌       | 93954/371472 [7:28:35<20:44:37,  3.72it/s]
 25%|██▌       | 93955/371472 [7:28:35<20:29:13,  3.76it/s]
 25%|██▌       | 93956/371472 [7:28:36<21:19:15,  3.62it/s]
 25%|██▌       | 93957/371472 [7:28:36<20:59:46,  3.67it/s]
 25%|██▌       | 93958/371472 [7:28:36<21:18:14,  3.62it/s]
 25%|██▌       | 93959/371472 [7:28:37<20:56:27,  3.68it/s]
 25%|██▌       | 93960/371472 [7:28:37<20:48:58,  3.70it/s]
                                                           
{'loss': 3.6592, 'learning_rate': 7.72716498954944e-07, 'epoch': 4.05}

 25%|██▌       | 93960/371472 [7:28:37<20:48:58,  3.70it/s]
 25%|██▌       | 93961/371472 [7:28:37<20:17:02,  3.80it/s]
 25%|██▌       | 93962/371472 [7:28:37<21:09:18,  3.64it/s]
 25%|██▌       | 93963/371472 [7:28:38<20:21:19,  3.79it/s]
 25%|██▌       | 93964/371472 [7:28:38<19:55:37,  3.87it/s]
 25%|██▌       | 93965/371472 [7:28:38<20:00:29,  3.85it/s]
 25%|██▌       | 93966/371472 [7:28:38<20:40:51,  3.73it/s]
 25%|██▌       | 93967/371472 [7:28:39<20:32:34,  3.75it/s]
 25%|██▌       | 93968/371472 [7:28:39<20:32:10,  3.75it/s]
 25%|██▌       | 93969/371472 [7:28:39<20:13:38,  3.81it/s]
 25%|██▌       | 93970/371472 [7:28:40<22:02:30,  3.50it/s]
 25%|██▌       | 93971/371472 [7:28:40<21:48:05,  3.54it/s]
 25%|██▌       | 93972/371472 [7:28:40<21:01:52,  3.67it/s]
 25%|██▌       | 93973/371472 [7:28:40<20:47:22,  3.71it/s]
 25%|██▌       | 93974/371472 [7:28:41<20:19:22,  3.79it/s]
 25%|██▌       | 93975/371472 [7:28:41<19:51:30,  3.88it/s]
 25%|██▌       | 93976/371472 [7:28:41<21:31:16,  3.58it/s]
 25%|██▌       | 93977/371472 [7:28:41<22:07:05,  3.48it/s]
 25%|██▌       | 93978/371472 [7:28:42<22:56:29,  3.36it/s]
 25%|██▌       | 93979/371472 [7:28:42<22:15:01,  3.46it/s]
 25%|██▌       | 93980/371472 [7:28:42<22:05:56,  3.49it/s]
                                                           
{'loss': 3.8174, 'learning_rate': 7.726680169794651e-07, 'epoch': 4.05}

 25%|██▌       | 93980/371472 [7:28:42<22:05:56,  3.49it/s]
 25%|██▌       | 93981/371472 [7:28:43<21:34:49,  3.57it/s]
 25%|██▌       | 93982/371472 [7:28:43<21:35:54,  3.57it/s]
 25%|██▌       | 93983/371472 [7:28:43<21:43:35,  3.55it/s]
 25%|██▌       | 93984/371472 [7:28:43<21:32:12,  3.58it/s]
 25%|██▌       | 93985/371472 [7:28:44<21:16:39,  3.62it/s]
 25%|██▌       | 93986/371472 [7:28:44<20:10:34,  3.82it/s]
 25%|██▌       | 93987/371472 [7:28:44<22:46:46,  3.38it/s]
 25%|██▌       | 93988/371472 [7:28:45<21:25:53,  3.60it/s]
 25%|██▌       | 93989/371472 [7:28:45<21:40:43,  3.56it/s]
 25%|██▌       | 93990/371472 [7:28:45<21:09:47,  3.64it/s]
 25%|██▌       | 93991/371472 [7:28:45<20:58:41,  3.67it/s]
 25%|██▌       | 93992/371472 [7:28:46<21:48:16,  3.53it/s]
 25%|██▌       | 93993/371472 [7:28:46<20:59:14,  3.67it/s]
 25%|██▌       | 93994/371472 [7:28:46<21:16:04,  3.62it/s]
 25%|██▌       | 93995/371472 [7:28:46<21:08:34,  3.65it/s]
 25%|██▌       | 93996/371472 [7:28:47<21:07:08,  3.65it/s]
 25%|██▌       | 93997/371472 [7:28:47<20:22:09,  3.78it/s]
 25%|██▌       | 93998/371472 [7:28:47<20:25:12,  3.77it/s]
 25%|██▌       | 93999/371472 [7:28:48<23:51:37,  3.23it/s]
 25%|██▌       | 94000/371472 [7:28:48<22:19:43,  3.45it/s]
                                                           
{'loss': 3.6744, 'learning_rate': 7.726195350039863e-07, 'epoch': 4.05}

 25%|██▌       | 94000/371472 [7:28:48<22:19:43,  3.45it/s]
 25%|██▌       | 94001/371472 [7:28:48<21:37:40,  3.56it/s]
 25%|██▌       | 94002/371472 [7:28:48<21:06:36,  3.65it/s]
 25%|██▌       | 94003/371472 [7:28:49<21:01:08,  3.67it/s]
 25%|██▌       | 94004/371472 [7:28:49<20:22:06,  3.78it/s]
 25%|██▌       | 94005/371472 [7:28:49<21:02:15,  3.66it/s]
 25%|██▌       | 94006/371472 [7:28:49<20:19:48,  3.79it/s]
 25%|██▌       | 94007/371472 [7:28:50<20:01:03,  3.85it/s]
 25%|██▌       | 94008/371472 [7:28:50<19:52:14,  3.88it/s]
 25%|██▌       | 94009/371472 [7:28:50<19:59:59,  3.85it/s]
 25%|██▌       | 94010/371472 [7:28:51<20:43:26,  3.72it/s]
 25%|██▌       | 94011/371472 [7:28:51<21:40:34,  3.56it/s]
 25%|██▌       | 94012/371472 [7:28:51<21:48:28,  3.53it/s]
 25%|██▌       | 94013/371472 [7:28:51<21:05:50,  3.65it/s]
 25%|██▌       | 94014/371472 [7:28:52<21:17:43,  3.62it/s]
 25%|██▌       | 94015/371472 [7:28:52<22:30:42,  3.42it/s]
 25%|██▌       | 94016/371472 [7:28:52<22:21:31,  3.45it/s]
 25%|██▌       | 94017/371472 [7:28:53<21:36:14,  3.57it/s]
 25%|██▌       | 94018/371472 [7:28:53<21:05:23,  3.65it/s]
 25%|██▌       | 94019/371472 [7:28:53<21:12:47,  3.63it/s]
 25%|██▌       | 94020/371472 [7:28:53<21:10:40,  3.64it/s]
                                                           
{'loss': 3.6903, 'learning_rate': 7.725710530285075e-07, 'epoch': 4.05}

 25%|██▌       | 94020/371472 [7:28:53<21:10:40,  3.64it/s]
 25%|██▌       | 94021/371472 [7:28:54<20:58:23,  3.67it/s]
 25%|██▌       | 94022/371472 [7:28:54<20:11:34,  3.82it/s]
 25%|██▌       | 94023/371472 [7:28:54<20:35:56,  3.74it/s]
 25%|██▌       | 94024/371472 [7:28:54<20:37:27,  3.74it/s]
 25%|██▌       | 94025/371472 [7:28:55<20:30:30,  3.76it/s]
 25%|██▌       | 94026/371472 [7:28:55<20:02:52,  3.84it/s]
 25%|██▌       | 94027/371472 [7:28:55<20:30:53,  3.76it/s]
 25%|██▌       | 94028/371472 [7:28:55<20:34:48,  3.74it/s]
 25%|██▌       | 94029/371472 [7:28:56<20:14:44,  3.81it/s]
 25%|██▌       | 94030/371472 [7:28:56<20:11:47,  3.82it/s]
 25%|██▌       | 94031/371472 [7:28:56<20:12:30,  3.81it/s]
 25%|██▌       | 94032/371472 [7:28:57<21:12:23,  3.63it/s]
 25%|██▌       | 94033/371472 [7:28:57<21:33:00,  3.58it/s]
 25%|██▌       | 94034/371472 [7:28:57<20:29:40,  3.76it/s]
 25%|██▌       | 94035/371472 [7:28:57<20:20:15,  3.79it/s]
 25%|██▌       | 94036/371472 [7:28:58<20:05:00,  3.84it/s]
 25%|██▌       | 94037/371472 [7:28:58<21:25:13,  3.60it/s]
 25%|██▌       | 94038/371472 [7:28:58<21:52:07,  3.52it/s]
 25%|██▌       | 94039/371472 [7:28:58<21:38:40,  3.56it/s]
 25%|██▌       | 94040/371472 [7:28:59<21:08:05,  3.65it/s]
                                                           
{'loss': 3.713, 'learning_rate': 7.725225710530284e-07, 'epoch': 4.05}

 25%|██▌       | 94040/371472 [7:28:59<21:08:05,  3.65it/s]
 25%|██▌       | 94041/371472 [7:28:59<20:26:04,  3.77it/s]
 25%|██▌       | 94042/371472 [7:28:59<20:18:31,  3.79it/s]
 25%|██▌       | 94043/371472 [7:28:59<20:11:41,  3.82it/s]
 25%|██▌       | 94044/371472 [7:29:00<20:42:41,  3.72it/s]
 25%|██▌       | 94045/371472 [7:29:00<20:29:30,  3.76it/s]
 25%|██▌       | 94046/371472 [7:29:00<21:34:57,  3.57it/s]
 25%|██▌       | 94047/371472 [7:29:01<20:43:29,  3.72it/s]
 25%|██▌       | 94048/371472 [7:29:01<21:38:00,  3.56it/s]
 25%|██▌       | 94049/371472 [7:29:01<23:16:58,  3.31it/s]
 25%|██▌       | 94050/371472 [7:29:02<23:41:38,  3.25it/s]
 25%|██▌       | 94051/371472 [7:29:02<22:52:02,  3.37it/s]
 25%|██▌       | 94052/371472 [7:29:02<22:10:44,  3.47it/s]
 25%|██▌       | 94053/371472 [7:29:02<22:10:02,  3.48it/s]
 25%|██▌       | 94054/371472 [7:29:03<21:05:32,  3.65it/s]
 25%|██▌       | 94055/371472 [7:29:03<22:36:12,  3.41it/s]
 25%|██▌       | 94056/371472 [7:29:03<22:03:41,  3.49it/s]
 25%|██▌       | 94057/371472 [7:29:03<21:31:13,  3.58it/s]
 25%|██▌       | 94058/371472 [7:29:04<22:39:52,  3.40it/s]
 25%|██▌       | 94059/371472 [7:29:04<22:23:50,  3.44it/s]
 25%|██▌       | 94060/371472 [7:29:04<24:33:59,  3.14it/s]
                                                           
{'loss': 3.7358, 'learning_rate': 7.724740890775495e-07, 'epoch': 4.05}

 25%|██▌       | 94060/371472 [7:29:04<24:33:59,  3.14it/s]
 25%|██▌       | 94061/371472 [7:29:05<22:41:58,  3.39it/s]
 25%|██▌       | 94062/371472 [7:29:05<22:41:06,  3.40it/s]
 25%|██▌       | 94063/371472 [7:29:05<23:46:25,  3.24it/s]
 25%|██▌       | 94064/371472 [7:29:06<23:08:25,  3.33it/s]
 25%|██▌       | 94065/371472 [7:29:06<22:55:28,  3.36it/s]
 25%|██▌       | 94066/371472 [7:29:06<22:23:58,  3.44it/s]
 25%|██▌       | 94067/371472 [7:29:06<21:51:42,  3.52it/s]
 25%|██▌       | 94068/371472 [7:29:07<21:18:56,  3.62it/s]
 25%|██▌       | 94069/371472 [7:29:07<21:07:11,  3.65it/s]
 25%|██▌       | 94070/371472 [7:29:07<21:16:32,  3.62it/s]
 25%|██▌       | 94071/371472 [7:29:08<21:07:08,  3.65it/s]
 25%|██▌       | 94072/371472 [7:29:08<20:40:05,  3.73it/s]
 25%|██▌       | 94073/371472 [7:29:08<20:23:23,  3.78it/s]
 25%|██▌       | 94074/371472 [7:29:08<20:52:57,  3.69it/s]
 25%|██▌       | 94075/371472 [7:29:09<21:59:46,  3.50it/s]
 25%|██▌       | 94076/371472 [7:29:09<21:55:25,  3.51it/s]
 25%|██▌       | 94077/371472 [7:29:09<23:24:33,  3.29it/s]
 25%|██▌       | 94078/371472 [7:29:10<22:10:43,  3.47it/s]
 25%|██▌       | 94079/371472 [7:29:10<22:08:42,  3.48it/s]
 25%|██▌       | 94080/371472 [7:29:10<21:55:04,  3.52it/s]
                                                           
{'loss': 3.7242, 'learning_rate': 7.724256071020707e-07, 'epoch': 4.05}

 25%|██▌       | 94080/371472 [7:29:10<21:55:04,  3.52it/s]
 25%|██▌       | 94081/371472 [7:29:10<22:35:56,  3.41it/s]
 25%|██▌       | 94082/371472 [7:29:11<22:54:42,  3.36it/s]
 25%|██▌       | 94083/371472 [7:29:11<23:35:14,  3.27it/s]
 25%|██▌       | 94084/371472 [7:29:11<22:09:15,  3.48it/s]
 25%|██▌       | 94085/371472 [7:29:12<21:51:14,  3.53it/s]
 25%|██▌       | 94086/371472 [7:29:12<22:40:12,  3.40it/s]
 25%|██▌       | 94087/371472 [7:29:12<21:25:20,  3.60it/s]
 25%|██▌       | 94088/371472 [7:29:12<22:05:22,  3.49it/s]
 25%|██▌       | 94089/371472 [7:29:13<21:01:42,  3.66it/s]
 25%|██▌       | 94090/371472 [7:29:13<21:00:22,  3.67it/s]
 25%|██▌       | 94091/371472 [7:29:13<22:30:36,  3.42it/s]
 25%|██▌       | 94092/371472 [7:29:14<21:19:38,  3.61it/s]
 25%|██▌       | 94093/371472 [7:29:14<20:46:39,  3.71it/s]
 25%|██▌       | 94094/371472 [7:29:14<21:17:23,  3.62it/s]
 25%|██▌       | 94095/371472 [7:29:14<21:29:13,  3.59it/s]
 25%|██▌       | 94096/371472 [7:29:15<21:00:41,  3.67it/s]
 25%|██▌       | 94097/371472 [7:29:15<20:26:09,  3.77it/s]
 25%|██▌       | 94098/371472 [7:29:15<21:20:07,  3.61it/s]
 25%|██▌       | 94099/371472 [7:29:16<26:26:21,  2.91it/s]
 25%|██▌       | 94100/371472 [7:29:16<24:22:40,  3.16it/s]
                                                           
{'loss': 3.6433, 'learning_rate': 7.723771251265918e-07, 'epoch': 4.05}

 25%|██▌       | 94100/371472 [7:29:16<24:22:40,  3.16it/s]
 25%|██▌       | 94101/371472 [7:29:16<23:39:47,  3.26it/s]
 25%|██▌       | 94102/371472 [7:29:16<23:11:16,  3.32it/s]
 25%|██▌       | 94103/371472 [7:29:17<22:52:48,  3.37it/s]
 25%|██▌       | 94104/371472 [7:29:17<22:29:37,  3.43it/s]
 25%|██▌       | 94105/371472 [7:29:17<21:57:42,  3.51it/s]
 25%|██▌       | 94106/371472 [7:29:18<21:43:26,  3.55it/s]
 25%|██▌       | 94107/371472 [7:29:18<21:51:17,  3.53it/s]
 25%|██▌       | 94108/371472 [7:29:18<21:11:42,  3.64it/s]
 25%|██▌       | 94109/371472 [7:29:18<21:48:46,  3.53it/s]
 25%|██▌       | 94110/371472 [7:29:19<22:02:43,  3.49it/s]
 25%|██▌       | 94111/371472 [7:29:19<21:44:03,  3.54it/s]
 25%|██▌       | 94112/371472 [7:29:19<22:18:07,  3.45it/s]
 25%|██▌       | 94113/371472 [7:29:20<21:26:17,  3.59it/s]
 25%|██▌       | 94114/371472 [7:29:20<21:59:52,  3.50it/s]
 25%|██▌       | 94115/371472 [7:29:20<21:11:56,  3.63it/s]
 25%|██▌       | 94116/371472 [7:29:20<21:00:04,  3.67it/s]
 25%|██▌       | 94117/371472 [7:29:21<20:32:36,  3.75it/s]
 25%|██▌       | 94118/371472 [7:29:21<19:58:06,  3.86it/s]
 25%|██▌       | 94119/371472 [7:29:21<21:25:49,  3.60it/s]
 25%|██▌       | 94120/371472 [7:29:21<21:33:56,  3.57it/s]
                                                           
{'loss': 3.7958, 'learning_rate': 7.723286431511129e-07, 'epoch': 4.05}

 25%|██▌       | 94120/371472 [7:29:21<21:33:56,  3.57it/s]
 25%|██▌       | 94121/371472 [7:29:22<22:26:43,  3.43it/s]
 25%|██▌       | 94122/371472 [7:29:22<21:21:51,  3.61it/s]
 25%|██▌       | 94123/371472 [7:29:22<21:44:35,  3.54it/s]
 25%|██▌       | 94124/371472 [7:29:23<21:40:49,  3.55it/s]
 25%|██▌       | 94125/371472 [7:29:23<23:16:39,  3.31it/s]
 25%|██▌       | 94126/371472 [7:29:23<23:02:38,  3.34it/s]
 25%|██▌       | 94127/371472 [7:29:24<22:21:46,  3.45it/s]
 25%|██▌       | 94128/371472 [7:29:24<22:23:50,  3.44it/s]
 25%|██▌       | 94129/371472 [7:29:24<21:40:53,  3.55it/s]
 25%|██▌       | 94130/371472 [7:29:24<20:47:16,  3.71it/s]
 25%|██▌       | 94131/371472 [7:29:25<21:32:43,  3.58it/s]
 25%|██▌       | 94132/371472 [7:29:25<22:29:48,  3.42it/s]
 25%|██▌       | 94133/371472 [7:29:25<23:22:30,  3.30it/s]
 25%|██▌       | 94134/371472 [7:29:26<23:23:58,  3.29it/s]
 25%|██▌       | 94135/371472 [7:29:26<23:21:15,  3.30it/s]
 25%|██▌       | 94136/371472 [7:29:26<22:59:17,  3.35it/s]
 25%|██▌       | 94137/371472 [7:29:26<21:44:53,  3.54it/s]
 25%|██▌       | 94138/371472 [7:29:27<21:55:55,  3.51it/s]
 25%|██▌       | 94139/371472 [7:29:27<21:18:39,  3.61it/s]
 25%|██▌       | 94140/371472 [7:29:27<21:46:14,  3.54it/s]
                                                           
{'loss': 3.6197, 'learning_rate': 7.72280161175634e-07, 'epoch': 4.05}

 25%|██▌       | 94140/371472 [7:29:27<21:46:14,  3.54it/s]
 25%|██▌       | 94141/371472 [7:29:28<21:55:05,  3.51it/s]
 25%|██▌       | 94142/371472 [7:29:28<21:48:21,  3.53it/s]
 25%|██▌       | 94143/371472 [7:29:28<22:49:04,  3.38it/s]
 25%|██▌       | 94144/371472 [7:29:29<24:05:26,  3.20it/s]
 25%|██▌       | 94145/371472 [7:29:29<22:42:50,  3.39it/s]
 25%|██▌       | 94146/371472 [7:29:29<22:24:34,  3.44it/s]
 25%|██▌       | 94147/371472 [7:29:29<21:38:13,  3.56it/s]
 25%|██▌       | 94148/371472 [7:29:30<23:19:24,  3.30it/s]
 25%|██▌       | 94149/371472 [7:29:30<22:21:51,  3.44it/s]
 25%|██▌       | 94150/371472 [7:29:30<24:02:13,  3.20it/s]
 25%|██▌       | 94151/371472 [7:29:31<22:45:22,  3.39it/s]
 25%|██▌       | 94152/371472 [7:29:31<22:42:36,  3.39it/s]
 25%|██▌       | 94153/371472 [7:29:31<21:29:36,  3.58it/s]
 25%|██▌       | 94154/371472 [7:29:31<21:10:19,  3.64it/s]
 25%|██▌       | 94155/371472 [7:29:32<21:12:42,  3.63it/s]
 25%|██▌       | 94156/371472 [7:29:32<22:42:37,  3.39it/s]
 25%|██▌       | 94157/371472 [7:29:32<22:18:43,  3.45it/s]
 25%|██▌       | 94158/371472 [7:29:32<21:26:03,  3.59it/s]
 25%|██▌       | 94159/371472 [7:29:33<22:52:42,  3.37it/s]
 25%|██▌       | 94160/371472 [7:29:33<24:01:09,  3.21it/s]
                                                           
{'loss': 3.4819, 'learning_rate': 7.722316792001551e-07, 'epoch': 4.06}

 25%|██▌       | 94160/371472 [7:29:33<24:01:09,  3.21it/s]
 25%|██▌       | 94161/371472 [7:29:33<24:17:55,  3.17it/s]
 25%|██▌       | 94162/371472 [7:29:34<26:01:18,  2.96it/s]
 25%|██▌       | 94163/371472 [7:29:34<25:21:22,  3.04it/s]
 25%|██▌       | 94164/371472 [7:29:34<24:22:34,  3.16it/s]
 25%|██▌       | 94165/371472 [7:29:35<23:45:37,  3.24it/s]
 25%|██▌       | 94166/371472 [7:29:35<22:49:14,  3.38it/s]
 25%|██▌       | 94167/371472 [7:29:35<22:55:49,  3.36it/s]
 25%|██▌       | 94168/371472 [7:29:36<22:10:27,  3.47it/s]
 25%|██▌       | 94169/371472 [7:29:36<21:42:43,  3.55it/s]
 25%|██▌       | 94170/371472 [7:29:36<21:56:03,  3.51it/s]
 25%|██▌       | 94171/371472 [7:29:36<21:31:50,  3.58it/s]
 25%|██▌       | 94172/371472 [7:29:37<21:32:21,  3.58it/s]
 25%|██▌       | 94173/371472 [7:29:37<22:26:15,  3.43it/s]
 25%|██▌       | 94174/371472 [7:29:37<22:45:34,  3.38it/s]
 25%|██▌       | 94175/371472 [7:29:38<22:57:40,  3.35it/s]
 25%|██▌       | 94176/371472 [7:29:38<21:56:56,  3.51it/s]
 25%|██▌       | 94177/371472 [7:29:38<21:19:03,  3.61it/s]
 25%|██▌       | 94178/371472 [7:29:38<21:03:11,  3.66it/s]
 25%|██▌       | 94179/371472 [7:29:39<20:41:30,  3.72it/s]
 25%|██▌       | 94180/371472 [7:29:39<20:18:07,  3.79it/s]
                                                           
{'loss': 3.6515, 'learning_rate': 7.721831972246763e-07, 'epoch': 4.06}

 25%|██▌       | 94180/371472 [7:29:39<20:18:07,  3.79it/s]
 25%|██▌       | 94181/371472 [7:29:39<19:56:49,  3.86it/s]
 25%|██▌       | 94182/371472 [7:29:40<24:25:50,  3.15it/s]
 25%|██▌       | 94183/371472 [7:29:40<23:44:54,  3.24it/s]
 25%|██▌       | 94184/371472 [7:29:40<24:44:35,  3.11it/s]
 25%|██▌       | 94185/371472 [7:29:41<22:55:33,  3.36it/s]
 25%|██▌       | 94186/371472 [7:29:41<22:23:35,  3.44it/s]
 25%|██▌       | 94187/371472 [7:29:41<22:05:59,  3.49it/s]
 25%|██▌       | 94188/371472 [7:29:41<22:37:45,  3.40it/s]
 25%|██▌       | 94189/371472 [7:29:42<22:06:58,  3.48it/s]
 25%|██▌       | 94190/371472 [7:29:42<22:44:45,  3.39it/s]
 25%|██▌       | 94191/371472 [7:29:42<23:22:08,  3.30it/s]
 25%|██▌       | 94192/371472 [7:29:43<22:07:15,  3.48it/s]
 25%|██▌       | 94193/371472 [7:29:43<21:42:28,  3.55it/s]
 25%|██▌       | 94194/371472 [7:29:43<21:29:06,  3.58it/s]
 25%|██▌       | 94195/371472 [7:29:43<20:49:11,  3.70it/s]
 25%|██▌       | 94196/371472 [7:29:44<20:15:29,  3.80it/s]
 25%|██▌       | 94197/371472 [7:29:44<22:17:52,  3.45it/s]
 25%|██▌       | 94198/371472 [7:29:44<23:12:15,  3.32it/s]
 25%|██▌       | 94199/371472 [7:29:45<22:27:23,  3.43it/s]
 25%|██▌       | 94200/371472 [7:29:45<22:11:59,  3.47it/s]
                                                           
{'loss': 3.6916, 'learning_rate': 7.721347152491973e-07, 'epoch': 4.06}

 25%|██▌       | 94200/371472 [7:29:45<22:11:59,  3.47it/s]
 25%|██▌       | 94201/371472 [7:29:45<21:34:35,  3.57it/s]
 25%|██▌       | 94202/371472 [7:29:45<21:36:03,  3.57it/s]
 25%|██▌       | 94203/371472 [7:29:46<20:48:50,  3.70it/s]
 25%|██▌       | 94204/371472 [7:29:46<20:24:44,  3.77it/s]
 25%|██▌       | 94205/371472 [7:29:46<20:42:47,  3.72it/s]
 25%|██▌       | 94206/371472 [7:29:46<20:36:40,  3.74it/s]
 25%|██▌       | 94207/371472 [7:29:47<22:29:47,  3.42it/s]
 25%|██▌       | 94208/371472 [7:29:47<21:47:24,  3.53it/s]
 25%|██▌       | 94209/371472 [7:29:47<22:12:18,  3.47it/s]
 25%|██▌       | 94210/371472 [7:29:48<20:57:15,  3.68it/s]
 25%|██▌       | 94211/371472 [7:29:48<20:13:56,  3.81it/s]
 25%|██▌       | 94212/371472 [7:29:48<20:35:41,  3.74it/s]
 25%|██▌       | 94213/371472 [7:29:48<22:03:11,  3.49it/s]
 25%|██▌       | 94214/371472 [7:29:49<21:51:11,  3.52it/s]
 25%|██▌       | 94215/371472 [7:29:49<21:35:01,  3.57it/s]
 25%|██▌       | 94216/371472 [7:29:49<21:57:41,  3.51it/s]
 25%|██▌       | 94217/371472 [7:29:49<21:12:27,  3.63it/s]
 25%|██▌       | 94218/371472 [7:29:50<20:36:05,  3.74it/s]
 25%|██▌       | 94219/371472 [7:29:50<20:07:26,  3.83it/s]
 25%|██▌       | 94220/371472 [7:29:50<19:47:31,  3.89it/s]
                                                           
{'loss': 3.6998, 'learning_rate': 7.720862332737184e-07, 'epoch': 4.06}

 25%|██▌       | 94220/371472 [7:29:50<19:47:31,  3.89it/s]
 25%|██▌       | 94221/371472 [7:29:50<19:26:10,  3.96it/s]
 25%|██▌       | 94222/371472 [7:29:51<19:02:42,  4.04it/s]
 25%|██▌       | 94223/371472 [7:29:51<19:00:54,  4.05it/s]
 25%|██▌       | 94224/371472 [7:29:51<19:51:28,  3.88it/s]
 25%|██▌       | 94225/371472 [7:29:52<20:45:35,  3.71it/s]
 25%|██▌       | 94226/371472 [7:29:52<21:15:09,  3.62it/s]
 25%|██▌       | 94227/371472 [7:29:52<21:36:40,  3.56it/s]
 25%|██▌       | 94228/371472 [7:29:52<21:46:01,  3.54it/s]
 25%|██▌       | 94229/371472 [7:29:53<21:14:54,  3.62it/s]
 25%|██▌       | 94230/371472 [7:29:53<20:46:40,  3.71it/s]
 25%|██▌       | 94231/371472 [7:29:53<20:16:49,  3.80it/s]
 25%|██▌       | 94232/371472 [7:29:53<21:50:18,  3.53it/s]
 25%|██▌       | 94233/371472 [7:29:54<21:13:07,  3.63it/s]
 25%|██▌       | 94234/371472 [7:29:54<21:41:59,  3.55it/s]
 25%|██▌       | 94235/371472 [7:29:54<22:39:05,  3.40it/s]
 25%|██▌       | 94236/371472 [7:29:55<22:41:05,  3.39it/s]
 25%|██▌       | 94237/371472 [7:29:55<22:06:00,  3.48it/s]
 25%|██▌       | 94238/371472 [7:29:55<22:01:36,  3.50it/s]
 25%|██▌       | 94239/371472 [7:29:56<24:56:04,  3.09it/s]
 25%|██▌       | 94240/371472 [7:29:56<23:03:56,  3.34it/s]
                                                           
{'loss': 3.9044, 'learning_rate': 7.720377512982396e-07, 'epoch': 4.06}

 25%|██▌       | 94240/371472 [7:29:56<23:03:56,  3.34it/s]
 25%|██▌       | 94241/371472 [7:29:56<23:21:22,  3.30it/s]
 25%|██▌       | 94242/371472 [7:29:56<21:44:51,  3.54it/s]
 25%|██▌       | 94243/371472 [7:29:57<20:56:50,  3.68it/s]
 25%|██▌       | 94244/371472 [7:29:57<21:38:08,  3.56it/s]
 25%|██▌       | 94245/371472 [7:29:57<22:24:53,  3.44it/s]
 25%|██▌       | 94246/371472 [7:29:58<22:13:18,  3.47it/s]
 25%|██▌       | 94247/371472 [7:29:58<22:23:58,  3.44it/s]
 25%|██▌       | 94248/371472 [7:29:58<22:18:40,  3.45it/s]
 25%|██▌       | 94249/371472 [7:29:58<22:08:09,  3.48it/s]
 25%|██▌       | 94250/371472 [7:29:59<22:14:22,  3.46it/s]
 25%|██▌       | 94251/371472 [7:29:59<22:39:05,  3.40it/s]
 25%|██▌       | 94252/371472 [7:29:59<21:37:21,  3.56it/s]
 25%|██▌       | 94253/371472 [7:30:00<21:02:18,  3.66it/s]
 25%|██▌       | 94254/371472 [7:30:00<20:44:19,  3.71it/s]
 25%|██▌       | 94255/371472 [7:30:00<20:22:47,  3.78it/s]
 25%|██▌       | 94256/371472 [7:30:00<19:53:30,  3.87it/s]
 25%|██▌       | 94257/371472 [7:30:01<22:03:23,  3.49it/s]
 25%|██▌       | 94258/371472 [7:30:01<21:18:35,  3.61it/s]
 25%|██▌       | 94259/371472 [7:30:01<21:47:56,  3.53it/s]
 25%|██▌       | 94260/371472 [7:30:01<21:50:39,  3.53it/s]
                                                           
{'loss': 3.5698, 'learning_rate': 7.719892693227606e-07, 'epoch': 4.06}

 25%|██▌       | 94260/371472 [7:30:01<21:50:39,  3.53it/s]
 25%|██▌       | 94261/371472 [7:30:02<23:00:05,  3.35it/s]
 25%|██▌       | 94262/371472 [7:30:02<21:54:33,  3.51it/s]
 25%|██▌       | 94263/371472 [7:30:02<21:45:46,  3.54it/s]
 25%|██▌       | 94264/371472 [7:30:03<21:46:46,  3.54it/s]
 25%|██▌       | 94265/371472 [7:30:03<21:46:54,  3.54it/s]
 25%|██▌       | 94266/371472 [7:30:03<21:40:40,  3.55it/s]
 25%|██▌       | 94267/371472 [7:30:03<21:19:26,  3.61it/s]
 25%|██▌       | 94268/371472 [7:30:04<20:24:35,  3.77it/s]
 25%|██▌       | 94269/371472 [7:30:04<20:37:31,  3.73it/s]
 25%|██▌       | 94270/371472 [7:30:04<22:32:55,  3.41it/s]
 25%|██▌       | 94271/371472 [7:30:05<22:03:39,  3.49it/s]
 25%|██▌       | 94272/371472 [7:30:05<22:25:13,  3.43it/s]
 25%|██▌       | 94273/371472 [7:30:05<21:47:12,  3.53it/s]
 25%|██▌       | 94274/371472 [7:30:05<22:09:17,  3.48it/s]
 25%|██▌       | 94275/371472 [7:30:06<21:41:36,  3.55it/s]
 25%|██▌       | 94276/371472 [7:30:06<21:22:03,  3.60it/s]
 25%|██▌       | 94277/371472 [7:30:06<20:28:29,  3.76it/s]
 25%|██▌       | 94278/371472 [7:30:06<20:00:03,  3.85it/s]
 25%|██▌       | 94279/371472 [7:30:07<20:29:13,  3.76it/s]
 25%|██▌       | 94280/371472 [7:30:07<20:30:27,  3.75it/s]
                                                           
{'loss': 3.5303, 'learning_rate': 7.719407873472817e-07, 'epoch': 4.06}

 25%|██▌       | 94280/371472 [7:30:07<20:30:27,  3.75it/s]
 25%|██▌       | 94281/371472 [7:30:07<20:25:46,  3.77it/s]
 25%|██▌       | 94282/371472 [7:30:08<20:30:57,  3.75it/s]
 25%|██▌       | 94283/371472 [7:30:08<20:16:52,  3.80it/s]
 25%|██▌       | 94284/371472 [7:30:08<20:43:11,  3.72it/s]
 25%|██▌       | 94285/371472 [7:30:08<21:02:21,  3.66it/s]
 25%|██▌       | 94286/371472 [7:30:09<20:59:43,  3.67it/s]
 25%|██▌       | 94287/371472 [7:30:09<19:58:37,  3.85it/s]
 25%|██▌       | 94288/371472 [7:30:09<19:31:04,  3.94it/s]
 25%|██▌       | 94289/371472 [7:30:09<19:15:47,  4.00it/s]
 25%|██▌       | 94290/371472 [7:30:10<19:45:07,  3.90it/s]
 25%|██▌       | 94291/371472 [7:30:10<19:22:19,  3.97it/s]
 25%|██▌       | 94292/371472 [7:30:10<19:33:01,  3.94it/s]
 25%|██▌       | 94293/371472 [7:30:10<19:59:56,  3.85it/s]
 25%|██▌       | 94294/371472 [7:30:11<20:39:33,  3.73it/s]
 25%|██▌       | 94295/371472 [7:30:11<21:12:51,  3.63it/s]
 25%|██▌       | 94296/371472 [7:30:11<21:20:20,  3.61it/s]
 25%|██▌       | 94297/371472 [7:30:12<20:50:24,  3.69it/s]
 25%|██▌       | 94298/371472 [7:30:12<21:14:46,  3.62it/s]
 25%|██▌       | 94299/371472 [7:30:12<20:49:12,  3.70it/s]
 25%|██▌       | 94300/371472 [7:30:12<20:26:55,  3.77it/s]
                                                           
{'loss': 4.0102, 'learning_rate': 7.718923053718028e-07, 'epoch': 4.06}

 25%|██▌       | 94300/371472 [7:30:12<20:26:55,  3.77it/s]
 25%|██▌       | 94301/371472 [7:30:13<20:21:25,  3.78it/s]
 25%|██▌       | 94302/371472 [7:30:13<21:36:12,  3.56it/s]
 25%|██▌       | 94303/371472 [7:30:13<21:10:10,  3.64it/s]
 25%|██▌       | 94304/371472 [7:30:13<20:48:52,  3.70it/s]
 25%|██▌       | 94305/371472 [7:30:14<20:40:21,  3.72it/s]
 25%|██▌       | 94306/371472 [7:30:14<21:05:00,  3.65it/s]
 25%|██▌       | 94307/371472 [7:30:14<21:39:10,  3.56it/s]
 25%|██▌       | 94308/371472 [7:30:15<20:51:25,  3.69it/s]
 25%|██▌       | 94309/371472 [7:30:15<20:08:47,  3.82it/s]
 25%|██▌       | 94310/371472 [7:30:15<20:37:39,  3.73it/s]
 25%|██▌       | 94311/371472 [7:30:15<23:12:51,  3.32it/s]
 25%|██▌       | 94312/371472 [7:30:16<23:33:01,  3.27it/s]
 25%|██▌       | 94313/371472 [7:30:16<24:48:58,  3.10it/s]
 25%|██▌       | 94314/371472 [7:30:16<23:56:42,  3.22it/s]
 25%|██▌       | 94315/371472 [7:30:17<25:22:30,  3.03it/s]
 25%|██▌       | 94316/371472 [7:30:17<23:36:54,  3.26it/s]
 25%|██▌       | 94317/371472 [7:30:17<23:39:26,  3.25it/s]
 25%|██▌       | 94318/371472 [7:30:18<23:22:54,  3.29it/s]
 25%|██▌       | 94319/371472 [7:30:18<23:02:51,  3.34it/s]
 25%|██▌       | 94320/371472 [7:30:18<23:37:02,  3.26it/s]
                                                           
{'loss': 3.4653, 'learning_rate': 7.71843823396324e-07, 'epoch': 4.06}

 25%|██▌       | 94320/371472 [7:30:18<23:37:02,  3.26it/s]
 25%|██▌       | 94321/371472 [7:30:18<22:43:16,  3.39it/s]
 25%|██▌       | 94322/371472 [7:30:19<22:08:57,  3.48it/s]
 25%|██▌       | 94323/371472 [7:30:19<23:25:39,  3.29it/s]
 25%|██▌       | 94324/371472 [7:30:19<22:21:06,  3.44it/s]
 25%|██▌       | 94325/371472 [7:30:20<23:08:43,  3.33it/s]
 25%|██▌       | 94326/371472 [7:30:20<22:28:57,  3.42it/s]
 25%|██▌       | 94327/371472 [7:30:20<22:57:42,  3.35it/s]
 25%|██▌       | 94328/371472 [7:30:21<21:43:08,  3.54it/s]
 25%|██▌       | 94329/371472 [7:30:21<21:39:27,  3.55it/s]
 25%|██▌       | 94330/371472 [7:30:21<20:45:17,  3.71it/s]
 25%|██▌       | 94331/371472 [7:30:21<21:40:32,  3.55it/s]
 25%|██▌       | 94332/371472 [7:30:22<21:39:57,  3.55it/s]
 25%|██▌       | 94333/371472 [7:30:22<20:51:21,  3.69it/s]
 25%|██▌       | 94334/371472 [7:30:22<21:03:43,  3.66it/s]
 25%|██▌       | 94335/371472 [7:30:22<22:43:46,  3.39it/s]
 25%|██▌       | 94336/371472 [7:30:23<22:09:03,  3.48it/s]
 25%|██▌       | 94337/371472 [7:30:23<21:32:14,  3.57it/s]
 25%|██▌       | 94338/371472 [7:30:23<21:45:59,  3.54it/s]
 25%|██▌       | 94339/371472 [7:30:24<20:48:23,  3.70it/s]
 25%|██▌       | 94340/371472 [7:30:24<21:42:08,  3.55it/s]
                                                           
{'loss': 3.581, 'learning_rate': 7.71795341420845e-07, 'epoch': 4.06}

 25%|██▌       | 94340/371472 [7:30:24<21:42:08,  3.55it/s]
 25%|██▌       | 94341/371472 [7:30:24<21:29:31,  3.58it/s]
 25%|██▌       | 94342/371472 [7:30:24<22:17:07,  3.45it/s]
 25%|██▌       | 94343/371472 [7:30:25<21:28:45,  3.58it/s]
 25%|██▌       | 94344/371472 [7:30:25<21:03:51,  3.65it/s]
 25%|██▌       | 94345/371472 [7:30:25<21:22:02,  3.60it/s]
 25%|██▌       | 94346/371472 [7:30:26<20:58:07,  3.67it/s]
 25%|██▌       | 94347/371472 [7:30:26<21:04:39,  3.65it/s]
 25%|██▌       | 94348/371472 [7:30:26<21:30:54,  3.58it/s]
 25%|██▌       | 94349/371472 [7:30:26<22:18:44,  3.45it/s]
 25%|██▌       | 94350/371472 [7:30:27<21:46:03,  3.54it/s]
 25%|██▌       | 94351/371472 [7:30:27<22:01:10,  3.50it/s]
 25%|██▌       | 94352/371472 [7:30:27<21:21:25,  3.60it/s]
 25%|██▌       | 94353/371472 [7:30:27<21:24:23,  3.60it/s]
 25%|██▌       | 94354/371472 [7:30:28<20:51:21,  3.69it/s]
 25%|██▌       | 94355/371472 [7:30:28<23:50:04,  3.23it/s]
 25%|██▌       | 94356/371472 [7:30:28<24:33:39,  3.13it/s]
 25%|██▌       | 94357/371472 [7:30:29<24:07:59,  3.19it/s]
 25%|██▌       | 94358/371472 [7:30:29<22:36:35,  3.40it/s]
 25%|██▌       | 94359/371472 [7:30:29<22:29:46,  3.42it/s]
 25%|██▌       | 94360/371472 [7:30:30<22:22:11,  3.44it/s]
                                                           
{'loss': 3.6084, 'learning_rate': 7.717468594453661e-07, 'epoch': 4.06}

 25%|██▌       | 94360/371472 [7:30:30<22:22:11,  3.44it/s]
 25%|██▌       | 94361/371472 [7:30:30<21:56:06,  3.51it/s]
 25%|██▌       | 94362/371472 [7:30:30<21:58:28,  3.50it/s]
 25%|██▌       | 94363/371472 [7:30:31<24:05:50,  3.19it/s]
 25%|██▌       | 94364/371472 [7:30:31<23:02:17,  3.34it/s]
 25%|██▌       | 94365/371472 [7:30:31<22:06:42,  3.48it/s]
 25%|██▌       | 94366/371472 [7:30:31<23:11:22,  3.32it/s]
 25%|██▌       | 94367/371472 [7:30:32<22:00:08,  3.50it/s]
 25%|██▌       | 94368/371472 [7:30:32<22:38:38,  3.40it/s]
 25%|██▌       | 94369/371472 [7:30:32<21:54:35,  3.51it/s]
 25%|██▌       | 94370/371472 [7:30:32<21:05:45,  3.65it/s]
 25%|██▌       | 94371/371472 [7:30:33<21:13:38,  3.63it/s]
 25%|██▌       | 94372/371472 [7:30:33<20:33:48,  3.74it/s]
 25%|██▌       | 94373/371472 [7:30:33<21:43:37,  3.54it/s]
 25%|██▌       | 94374/371472 [7:30:34<24:53:22,  3.09it/s]
 25%|██▌       | 94375/371472 [7:30:34<24:19:34,  3.16it/s]
 25%|██▌       | 94376/371472 [7:30:34<25:02:06,  3.07it/s]
 25%|██▌       | 94377/371472 [7:30:35<25:50:01,  2.98it/s]
 25%|██▌       | 94378/371472 [7:30:35<24:30:52,  3.14it/s]
 25%|██▌       | 94379/371472 [7:30:35<24:36:48,  3.13it/s]
 25%|██▌       | 94380/371472 [7:30:36<24:10:18,  3.18it/s]
                                                           
{'loss': 3.5158, 'learning_rate': 7.716983774698873e-07, 'epoch': 4.07}

 25%|██▌       | 94380/371472 [7:30:36<24:10:18,  3.18it/s]
 25%|██▌       | 94381/371472 [7:30:36<23:24:20,  3.29it/s]
 25%|██▌       | 94382/371472 [7:30:36<22:01:00,  3.50it/s]
 25%|██▌       | 94383/371472 [7:30:36<21:47:16,  3.53it/s]
 25%|██▌       | 94384/371472 [7:30:37<21:02:15,  3.66it/s]
 25%|██▌       | 94385/371472 [7:30:37<20:26:59,  3.76it/s]
 25%|██▌       | 94386/371472 [7:30:37<21:03:23,  3.66it/s]
 25%|██▌       | 94387/371472 [7:30:37<20:24:45,  3.77it/s]
 25%|██▌       | 94388/371472 [7:30:38<21:46:45,  3.53it/s]
 25%|██▌       | 94389/371472 [7:30:38<21:36:20,  3.56it/s]
 25%|██▌       | 94390/371472 [7:30:38<22:00:01,  3.50it/s]
 25%|██▌       | 94391/371472 [7:30:39<21:24:36,  3.59it/s]
 25%|██▌       | 94392/371472 [7:30:39<20:51:27,  3.69it/s]
 25%|██▌       | 94393/371472 [7:30:39<20:13:12,  3.81it/s]
 25%|██▌       | 94394/371472 [7:30:39<21:25:08,  3.59it/s]
 25%|██▌       | 94395/371472 [7:30:40<21:44:25,  3.54it/s]
 25%|██▌       | 94396/371472 [7:30:40<21:10:29,  3.63it/s]
 25%|██▌       | 94397/371472 [7:30:40<20:55:10,  3.68it/s]
 25%|██▌       | 94398/371472 [7:30:41<21:29:29,  3.58it/s]
 25%|██▌       | 94399/371472 [7:30:41<21:24:09,  3.60it/s]
 25%|██▌       | 94400/371472 [7:30:41<21:30:44,  3.58it/s]
                                                           
{'loss': 3.6894, 'learning_rate': 7.716498954944085e-07, 'epoch': 4.07}

 25%|██▌       | 94400/371472 [7:30:41<21:30:44,  3.58it/s]
 25%|██▌       | 94401/371472 [7:30:41<21:16:49,  3.62it/s]
 25%|██▌       | 94402/371472 [7:30:42<21:11:48,  3.63it/s]
 25%|██▌       | 94403/371472 [7:30:42<21:38:48,  3.56it/s]
 25%|██▌       | 94404/371472 [7:30:42<21:32:24,  3.57it/s]
 25%|██▌       | 94405/371472 [7:30:43<21:01:01,  3.66it/s]
 25%|██▌       | 94406/371472 [7:30:43<21:07:27,  3.64it/s]
 25%|██▌       | 94407/371472 [7:30:43<21:35:47,  3.56it/s]
 25%|██▌       | 94408/371472 [7:30:43<20:41:30,  3.72it/s]
 25%|██▌       | 94409/371472 [7:30:44<20:32:54,  3.75it/s]
 25%|██▌       | 94410/371472 [7:30:44<20:43:31,  3.71it/s]
 25%|██▌       | 94411/371472 [7:30:44<21:00:38,  3.66it/s]
 25%|██▌       | 94412/371472 [7:30:44<21:11:09,  3.63it/s]
 25%|██▌       | 94413/371472 [7:30:45<22:38:56,  3.40it/s]
 25%|██▌       | 94414/371472 [7:30:45<21:46:08,  3.54it/s]
 25%|██▌       | 94415/371472 [7:30:45<20:44:15,  3.71it/s]
 25%|██▌       | 94416/371472 [7:30:46<22:06:38,  3.48it/s]
 25%|██▌       | 94417/371472 [7:30:46<21:42:39,  3.54it/s]
 25%|██▌       | 94418/371472 [7:30:46<21:32:26,  3.57it/s]
 25%|██▌       | 94419/371472 [7:30:46<21:20:54,  3.60it/s]
 25%|██▌       | 94420/371472 [7:30:47<21:16:12,  3.62it/s]
                                                           
{'loss': 3.6205, 'learning_rate': 7.716014135189293e-07, 'epoch': 4.07}

 25%|██▌       | 94420/371472 [7:30:47<21:16:12,  3.62it/s]
 25%|██▌       | 94421/371472 [7:30:47<20:58:20,  3.67it/s]
 25%|██▌       | 94422/371472 [7:30:47<21:18:24,  3.61it/s]
 25%|██▌       | 94423/371472 [7:30:47<21:06:53,  3.64it/s]
 25%|██▌       | 94424/371472 [7:30:48<21:07:06,  3.64it/s]
 25%|██▌       | 94425/371472 [7:30:48<21:13:35,  3.63it/s]
 25%|██▌       | 94426/371472 [7:30:48<22:05:39,  3.48it/s]
 25%|██▌       | 94427/371472 [7:30:49<23:25:42,  3.28it/s]
 25%|██▌       | 94428/371472 [7:30:49<22:34:07,  3.41it/s]
 25%|██▌       | 94429/371472 [7:30:49<22:32:49,  3.41it/s]
 25%|██▌       | 94430/371472 [7:30:50<21:50:17,  3.52it/s]
 25%|██▌       | 94431/371472 [7:30:50<21:12:13,  3.63it/s]
 25%|██▌       | 94432/371472 [7:30:50<23:02:54,  3.34it/s]
 25%|██▌       | 94433/371472 [7:30:50<22:31:57,  3.42it/s]
 25%|██▌       | 94434/371472 [7:30:51<23:24:06,  3.29it/s]
 25%|██▌       | 94435/371472 [7:30:51<22:00:59,  3.50it/s]
 25%|██▌       | 94436/371472 [7:30:51<21:48:19,  3.53it/s]
 25%|██▌       | 94437/371472 [7:30:52<20:58:51,  3.67it/s]
 25%|██▌       | 94438/371472 [7:30:52<22:41:43,  3.39it/s]
 25%|██▌       | 94439/371472 [7:30:52<22:39:08,  3.40it/s]
 25%|██▌       | 94440/371472 [7:30:52<21:55:39,  3.51it/s]
                                                           
{'loss': 3.6581, 'learning_rate': 7.715529315434505e-07, 'epoch': 4.07}

 25%|██▌       | 94440/371472 [7:30:52<21:55:39,  3.51it/s]
 25%|██▌       | 94441/371472 [7:30:53<21:37:58,  3.56it/s]
 25%|██▌       | 94442/371472 [7:30:53<22:44:31,  3.38it/s]
 25%|██▌       | 94443/371472 [7:30:53<21:50:40,  3.52it/s]
 25%|██▌       | 94444/371472 [7:30:54<26:41:24,  2.88it/s]
 25%|██▌       | 94445/371472 [7:30:54<24:09:43,  3.18it/s]
 25%|██▌       | 94446/371472 [7:30:54<23:20:10,  3.30it/s]
 25%|██▌       | 94447/371472 [7:30:55<22:30:36,  3.42it/s]
 25%|██▌       | 94448/371472 [7:30:55<22:45:59,  3.38it/s]
 25%|██▌       | 94449/371472 [7:30:55<22:46:42,  3.38it/s]
 25%|██▌       | 94450/371472 [7:30:55<23:03:53,  3.34it/s]
 25%|██▌       | 94451/371472 [7:30:56<23:32:05,  3.27it/s]
 25%|██▌       | 94452/371472 [7:30:56<22:49:42,  3.37it/s]
 25%|██▌       | 94453/371472 [7:30:56<21:35:36,  3.56it/s]
 25%|██▌       | 94454/371472 [7:30:57<22:11:11,  3.47it/s]
 25%|██▌       | 94455/371472 [7:30:57<21:37:26,  3.56it/s]
 25%|██▌       | 94456/371472 [7:30:57<22:00:48,  3.50it/s]
 25%|██▌       | 94457/371472 [7:30:57<21:48:50,  3.53it/s]
 25%|██▌       | 94458/371472 [7:30:58<21:34:42,  3.57it/s]
 25%|██▌       | 94459/371472 [7:30:58<21:09:36,  3.64it/s]
 25%|██▌       | 94460/371472 [7:30:58<21:15:21,  3.62it/s]
                                                           
{'loss': 3.593, 'learning_rate': 7.715044495679717e-07, 'epoch': 4.07}

 25%|██▌       | 94460/371472 [7:30:58<21:15:21,  3.62it/s]
 25%|██▌       | 94461/371472 [7:30:59<20:35:29,  3.74it/s]
 25%|██▌       | 94462/371472 [7:30:59<19:52:33,  3.87it/s]
 25%|██▌       | 94463/371472 [7:30:59<20:49:35,  3.69it/s]
 25%|██▌       | 94464/371472 [7:30:59<22:05:40,  3.48it/s]
 25%|██▌       | 94465/371472 [7:31:00<24:03:33,  3.20it/s]
 25%|██▌       | 94466/371472 [7:31:00<23:32:37,  3.27it/s]
 25%|██▌       | 94467/371472 [7:31:00<22:08:54,  3.47it/s]
 25%|██▌       | 94468/371472 [7:31:01<21:15:16,  3.62it/s]
 25%|██▌       | 94469/371472 [7:31:01<20:24:33,  3.77it/s]
 25%|██▌       | 94470/371472 [7:31:01<21:16:51,  3.62it/s]
 25%|██▌       | 94471/371472 [7:31:01<20:07:39,  3.82it/s]
 25%|██▌       | 94472/371472 [7:31:02<19:40:50,  3.91it/s]
 25%|██▌       | 94473/371472 [7:31:02<20:00:57,  3.84it/s]
 25%|██▌       | 94474/371472 [7:31:02<19:31:45,  3.94it/s]
 25%|██▌       | 94475/371472 [7:31:02<19:36:30,  3.92it/s]
 25%|██▌       | 94476/371472 [7:31:03<19:44:00,  3.90it/s]
 25%|██▌       | 94477/371472 [7:31:03<20:54:37,  3.68it/s]
 25%|██▌       | 94478/371472 [7:31:03<20:26:26,  3.76it/s]
 25%|██▌       | 94479/371472 [7:31:04<23:09:00,  3.32it/s]
 25%|██▌       | 94480/371472 [7:31:04<23:29:19,  3.28it/s]
                                                           
{'loss': 3.5971, 'learning_rate': 7.714559675924929e-07, 'epoch': 4.07}

 25%|██▌       | 94480/371472 [7:31:04<23:29:19,  3.28it/s]
 25%|██▌       | 94481/371472 [7:31:04<22:07:15,  3.48it/s]
 25%|██▌       | 94482/371472 [7:31:04<21:13:22,  3.63it/s]
 25%|██▌       | 94483/371472 [7:31:05<20:44:37,  3.71it/s]
 25%|██▌       | 94484/371472 [7:31:05<21:28:08,  3.58it/s]
 25%|██▌       | 94485/371472 [7:31:05<21:08:34,  3.64it/s]
 25%|██▌       | 94486/371472 [7:31:05<20:22:42,  3.78it/s]
 25%|██▌       | 94487/371472 [7:31:06<19:50:33,  3.88it/s]
 25%|██▌       | 94488/371472 [7:31:06<20:15:36,  3.80it/s]
 25%|██▌       | 94489/371472 [7:31:06<20:43:21,  3.71it/s]
 25%|██▌       | 94490/371472 [7:31:06<21:07:02,  3.64it/s]
 25%|██▌       | 94491/371472 [7:31:07<21:46:28,  3.53it/s]
 25%|██▌       | 94492/371472 [7:31:07<21:37:40,  3.56it/s]
 25%|██▌       | 94493/371472 [7:31:07<21:05:33,  3.65it/s]
 25%|██▌       | 94494/371472 [7:31:08<20:35:46,  3.74it/s]
 25%|██▌       | 94495/371472 [7:31:08<21:16:46,  3.62it/s]
 25%|██▌       | 94496/371472 [7:31:08<22:05:12,  3.48it/s]
 25%|██▌       | 94497/371472 [7:31:08<21:38:57,  3.55it/s]
 25%|██▌       | 94498/371472 [7:31:09<22:16:16,  3.45it/s]
 25%|██▌       | 94499/371472 [7:31:09<22:41:30,  3.39it/s]
 25%|██▌       | 94500/371472 [7:31:09<22:42:25,  3.39it/s]
                                                           
{'loss': 3.6637, 'learning_rate': 7.714074856170139e-07, 'epoch': 4.07}

 25%|██▌       | 94500/371472 [7:31:09<22:42:25,  3.39it/s]
 25%|██▌       | 94501/371472 [7:31:10<21:48:43,  3.53it/s]
 25%|██▌       | 94502/371472 [7:31:10<21:06:37,  3.64it/s]
 25%|██▌       | 94503/371472 [7:31:10<20:19:24,  3.79it/s]
 25%|██▌       | 94504/371472 [7:31:10<20:42:53,  3.71it/s]
 25%|██▌       | 94505/371472 [7:31:11<20:45:32,  3.71it/s]
 25%|██▌       | 94506/371472 [7:31:11<21:17:45,  3.61it/s]
 25%|██▌       | 94507/371472 [7:31:11<21:26:25,  3.59it/s]
 25%|██▌       | 94508/371472 [7:31:12<22:09:25,  3.47it/s]
 25%|██▌       | 94509/371472 [7:31:12<21:54:51,  3.51it/s]
 25%|██▌       | 94510/371472 [7:31:12<21:09:34,  3.64it/s]
 25%|██▌       | 94511/371472 [7:31:12<24:11:54,  3.18it/s]
 25%|██▌       | 94512/371472 [7:31:13<23:59:54,  3.21it/s]
 25%|██▌       | 94513/371472 [7:31:13<23:34:20,  3.26it/s]
 25%|██▌       | 94514/371472 [7:31:13<22:21:16,  3.44it/s]
 25%|██▌       | 94515/371472 [7:31:14<21:37:38,  3.56it/s]
 25%|██▌       | 94516/371472 [7:31:14<20:54:18,  3.68it/s]
 25%|██▌       | 94517/371472 [7:31:14<21:35:05,  3.56it/s]
 25%|██▌       | 94518/371472 [7:31:14<22:38:04,  3.40it/s]
 25%|██▌       | 94519/371472 [7:31:15<22:09:32,  3.47it/s]
 25%|██▌       | 94520/371472 [7:31:15<24:12:29,  3.18it/s]
                                                           
{'loss': 3.4868, 'learning_rate': 7.713590036415351e-07, 'epoch': 4.07}

 25%|██▌       | 94520/371472 [7:31:15<24:12:29,  3.18it/s]
 25%|██▌       | 94521/371472 [7:31:15<23:02:14,  3.34it/s]
 25%|██▌       | 94522/371472 [7:31:16<22:01:18,  3.49it/s]
 25%|██▌       | 94523/371472 [7:31:16<21:22:44,  3.60it/s]
 25%|██▌       | 94524/371472 [7:31:16<21:30:10,  3.58it/s]
 25%|██▌       | 94525/371472 [7:31:16<21:30:58,  3.58it/s]
 25%|██▌       | 94526/371472 [7:31:17<20:58:51,  3.67it/s]
 25%|██▌       | 94527/371472 [7:31:17<20:24:20,  3.77it/s]
 25%|██▌       | 94528/371472 [7:31:17<21:42:28,  3.54it/s]
 25%|██▌       | 94529/371472 [7:31:18<20:44:18,  3.71it/s]
 25%|██▌       | 94530/371472 [7:31:18<20:28:33,  3.76it/s]
 25%|██▌       | 94531/371472 [7:31:18<21:10:53,  3.63it/s]
 25%|██▌       | 94532/371472 [7:31:18<21:50:47,  3.52it/s]
 25%|██▌       | 94533/371472 [7:31:19<21:12:07,  3.63it/s]
 25%|██▌       | 94534/371472 [7:31:19<21:56:45,  3.51it/s]
 25%|██▌       | 94535/371472 [7:31:19<21:45:34,  3.54it/s]
 25%|██▌       | 94536/371472 [7:31:19<20:59:47,  3.66it/s]
 25%|██▌       | 94537/371472 [7:31:20<21:01:43,  3.66it/s]
 25%|██▌       | 94538/371472 [7:31:20<20:25:28,  3.77it/s]
 25%|██▌       | 94539/371472 [7:31:20<20:36:22,  3.73it/s]
 25%|██▌       | 94540/371472 [7:31:21<21:52:48,  3.52it/s]
                                                           
{'loss': 3.6145, 'learning_rate': 7.713105216660561e-07, 'epoch': 4.07}

 25%|██▌       | 94540/371472 [7:31:21<21:52:48,  3.52it/s]
 25%|██▌       | 94541/371472 [7:31:21<23:17:18,  3.30it/s]
 25%|██▌       | 94542/371472 [7:31:21<23:49:59,  3.23it/s]
 25%|██▌       | 94543/371472 [7:31:22<22:57:10,  3.35it/s]
 25%|██▌       | 94544/371472 [7:31:22<22:21:23,  3.44it/s]
 25%|██▌       | 94545/371472 [7:31:22<21:23:05,  3.60it/s]
 25%|██▌       | 94546/371472 [7:31:22<20:35:01,  3.74it/s]
 25%|██▌       | 94547/371472 [7:31:23<20:22:31,  3.78it/s]
 25%|██▌       | 94548/371472 [7:31:23<20:52:06,  3.69it/s]
 25%|██▌       | 94549/371472 [7:31:23<20:21:44,  3.78it/s]
 25%|██▌       | 94550/371472 [7:31:23<20:01:40,  3.84it/s]
 25%|██▌       | 94551/371472 [7:31:24<20:19:17,  3.79it/s]
 25%|██▌       | 94552/371472 [7:31:24<21:51:08,  3.52it/s]
 25%|██▌       | 94553/371472 [7:31:24<21:43:04,  3.54it/s]
 25%|██▌       | 94554/371472 [7:31:24<21:13:51,  3.62it/s]
 25%|██▌       | 94555/371472 [7:31:25<21:55:50,  3.51it/s]
 25%|██▌       | 94556/371472 [7:31:25<20:52:23,  3.69it/s]
 25%|██▌       | 94557/371472 [7:31:25<20:46:05,  3.70it/s]
 25%|██▌       | 94558/371472 [7:31:26<20:35:19,  3.74it/s]
 25%|██▌       | 94559/371472 [7:31:26<21:37:22,  3.56it/s]
 25%|██▌       | 94560/371472 [7:31:26<21:00:38,  3.66it/s]
                                                           
{'loss': 3.6797, 'learning_rate': 7.712620396905773e-07, 'epoch': 4.07}

 25%|██▌       | 94560/371472 [7:31:26<21:00:38,  3.66it/s]
 25%|██▌       | 94561/371472 [7:31:26<21:27:33,  3.58it/s]
 25%|██▌       | 94562/371472 [7:31:27<21:00:27,  3.66it/s]
 25%|██▌       | 94563/371472 [7:31:27<20:24:46,  3.77it/s]
 25%|██▌       | 94564/371472 [7:31:27<24:38:05,  3.12it/s]
 25%|██▌       | 94565/371472 [7:31:28<24:06:19,  3.19it/s]
 25%|██▌       | 94566/371472 [7:31:28<22:40:51,  3.39it/s]
 25%|██▌       | 94567/371472 [7:31:28<21:55:36,  3.51it/s]
 25%|██▌       | 94568/371472 [7:31:28<21:45:39,  3.53it/s]
 25%|██▌       | 94569/371472 [7:31:29<21:58:48,  3.50it/s]
 25%|██▌       | 94570/371472 [7:31:29<23:00:03,  3.34it/s]
 25%|██▌       | 94571/371472 [7:31:29<22:09:13,  3.47it/s]
 25%|██▌       | 94572/371472 [7:31:30<22:32:39,  3.41it/s]
 25%|██▌       | 94573/371472 [7:31:30<22:06:24,  3.48it/s]
 25%|██▌       | 94574/371472 [7:31:30<23:13:59,  3.31it/s]
 25%|██▌       | 94575/371472 [7:31:31<22:39:11,  3.40it/s]
 25%|██▌       | 94576/371472 [7:31:31<21:22:14,  3.60it/s]
 25%|██▌       | 94577/371472 [7:31:31<20:39:39,  3.72it/s]
 25%|██▌       | 94578/371472 [7:31:31<20:28:14,  3.76it/s]
 25%|██▌       | 94579/371472 [7:31:32<20:20:04,  3.78it/s]
 25%|██▌       | 94580/371472 [7:31:32<19:42:00,  3.90it/s]
                                                           
{'loss': 3.6024, 'learning_rate': 7.712135577150983e-07, 'epoch': 4.07}

 25%|██▌       | 94580/371472 [7:31:32<19:42:00,  3.90it/s]
 25%|██▌       | 94581/371472 [7:31:32<20:12:50,  3.80it/s]
 25%|██▌       | 94582/371472 [7:31:32<20:27:02,  3.76it/s]
 25%|██▌       | 94583/371472 [7:31:33<22:23:14,  3.44it/s]
 25%|██▌       | 94584/371472 [7:31:33<21:19:18,  3.61it/s]
 25%|██▌       | 94585/371472 [7:31:33<20:51:56,  3.69it/s]
 25%|██▌       | 94586/371472 [7:31:33<20:11:49,  3.81it/s]
 25%|██▌       | 94587/371472 [7:31:34<19:59:06,  3.85it/s]
 25%|██▌       | 94588/371472 [7:31:34<20:18:42,  3.79it/s]
 25%|██▌       | 94589/371472 [7:31:34<19:40:22,  3.91it/s]
 25%|██▌       | 94590/371472 [7:31:34<19:33:00,  3.93it/s]
 25%|██▌       | 94591/371472 [7:31:35<20:19:45,  3.78it/s]
 25%|██▌       | 94592/371472 [7:31:35<20:50:21,  3.69it/s]
 25%|██▌       | 94593/371472 [7:31:35<20:47:20,  3.70it/s]
 25%|██▌       | 94594/371472 [7:31:36<22:01:38,  3.49it/s]
 25%|██▌       | 94595/371472 [7:31:36<22:30:17,  3.42it/s]
 25%|██▌       | 94596/371472 [7:31:36<22:13:22,  3.46it/s]
 25%|██▌       | 94597/371472 [7:31:36<21:12:21,  3.63it/s]
 25%|██▌       | 94598/371472 [7:31:37<20:48:15,  3.70it/s]
 25%|██▌       | 94599/371472 [7:31:37<21:11:19,  3.63it/s]
 25%|██▌       | 94600/371472 [7:31:37<20:27:28,  3.76it/s]
                                                           
{'loss': 3.6174, 'learning_rate': 7.711650757396194e-07, 'epoch': 4.07}

 25%|██▌       | 94600/371472 [7:31:37<20:27:28,  3.76it/s]
 25%|██▌       | 94601/371472 [7:31:37<20:34:21,  3.74it/s]
 25%|██▌       | 94602/371472 [7:31:38<21:48:07,  3.53it/s]
 25%|██▌       | 94603/371472 [7:31:38<21:02:23,  3.66it/s]
 25%|██▌       | 94604/371472 [7:31:38<21:19:24,  3.61it/s]
 25%|██▌       | 94605/371472 [7:31:39<20:59:43,  3.66it/s]
 25%|██▌       | 94606/371472 [7:31:39<20:41:47,  3.72it/s]
 25%|██▌       | 94607/371472 [7:31:39<20:42:47,  3.71it/s]
 25%|██▌       | 94608/371472 [7:31:39<21:10:48,  3.63it/s]
 25%|██▌       | 94609/371472 [7:31:40<21:57:35,  3.50it/s]
 25%|██▌       | 94610/371472 [7:31:40<21:14:42,  3.62it/s]
 25%|██▌       | 94611/371472 [7:31:40<20:31:26,  3.75it/s]
 25%|██▌       | 94612/371472 [7:31:41<20:55:11,  3.68it/s]
 25%|██▌       | 94613/371472 [7:31:41<22:15:01,  3.46it/s]
 25%|██▌       | 94614/371472 [7:31:41<21:11:59,  3.63it/s]
 25%|██▌       | 94615/371472 [7:31:41<21:25:30,  3.59it/s]
 25%|██▌       | 94616/371472 [7:31:42<21:27:52,  3.58it/s]
 25%|██▌       | 94617/371472 [7:31:42<20:37:07,  3.73it/s]
 25%|██▌       | 94618/371472 [7:31:42<19:54:47,  3.86it/s]
 25%|██▌       | 94619/371472 [7:31:42<19:40:09,  3.91it/s]
 25%|██▌       | 94620/371472 [7:31:43<20:02:47,  3.84it/s]
                                                           
{'loss': 3.6744, 'learning_rate': 7.711165937641406e-07, 'epoch': 4.08}

 25%|██▌       | 94620/371472 [7:31:43<20:02:47,  3.84it/s]
 25%|██▌       | 94621/371472 [7:31:43<20:06:49,  3.82it/s]
 25%|██▌       | 94622/371472 [7:31:43<19:56:46,  3.86it/s]
 25%|██▌       | 94623/371472 [7:31:43<19:24:36,  3.96it/s]
 25%|██▌       | 94624/371472 [7:31:44<19:46:48,  3.89it/s]
 25%|██▌       | 94625/371472 [7:31:44<20:37:21,  3.73it/s]
 25%|██▌       | 94626/371472 [7:31:44<20:32:33,  3.74it/s]
 25%|██▌       | 94627/371472 [7:31:44<20:08:43,  3.82it/s]
 25%|██▌       | 94628/371472 [7:31:45<20:47:56,  3.70it/s]
 25%|██▌       | 94629/371472 [7:31:45<20:39:26,  3.72it/s]
 25%|██▌       | 94630/371472 [7:31:45<20:08:15,  3.82it/s]
 25%|██▌       | 94631/371472 [7:31:46<20:41:10,  3.72it/s]
 25%|██▌       | 94632/371472 [7:31:46<21:22:42,  3.60it/s]
 25%|██▌       | 94633/371472 [7:31:46<22:07:43,  3.48it/s]
 25%|██▌       | 94634/371472 [7:31:46<21:12:57,  3.62it/s]
 25%|██▌       | 94635/371472 [7:31:47<21:42:24,  3.54it/s]
 25%|██▌       | 94636/371472 [7:31:47<22:00:56,  3.49it/s]
 25%|██▌       | 94637/371472 [7:31:47<21:21:38,  3.60it/s]
 25%|██▌       | 94638/371472 [7:31:48<21:00:18,  3.66it/s]
 25%|██▌       | 94639/371472 [7:31:48<22:05:38,  3.48it/s]
 25%|██▌       | 94640/371472 [7:31:48<21:44:25,  3.54it/s]
                                                           
{'loss': 3.6869, 'learning_rate': 7.710681117886617e-07, 'epoch': 4.08}

 25%|██▌       | 94640/371472 [7:31:48<21:44:25,  3.54it/s]
 25%|██▌       | 94641/371472 [7:31:48<21:20:37,  3.60it/s]
 25%|██▌       | 94642/371472 [7:31:49<20:46:56,  3.70it/s]
 25%|██▌       | 94643/371472 [7:31:49<21:22:23,  3.60it/s]
 25%|██▌       | 94644/371472 [7:31:49<21:03:32,  3.65it/s]
 25%|██▌       | 94645/371472 [7:31:50<21:39:42,  3.55it/s]
 25%|██▌       | 94646/371472 [7:31:50<20:40:32,  3.72it/s]
 25%|██▌       | 94647/371472 [7:31:50<20:40:21,  3.72it/s]
 25%|██▌       | 94648/371472 [7:31:50<20:29:11,  3.75it/s]
 25%|██▌       | 94649/371472 [7:31:51<20:49:59,  3.69it/s]
 25%|██▌       | 94650/371472 [7:31:51<21:11:52,  3.63it/s]
 25%|██▌       | 94651/371472 [7:31:51<21:07:24,  3.64it/s]
 25%|██▌       | 94652/371472 [7:31:51<20:28:20,  3.76it/s]
 25%|██▌       | 94653/371472 [7:31:52<19:44:03,  3.90it/s]
 25%|██▌       | 94654/371472 [7:31:52<19:36:09,  3.92it/s]
 25%|██▌       | 94655/371472 [7:31:52<19:43:58,  3.90it/s]
 25%|██▌       | 94656/371472 [7:31:53<22:24:26,  3.43it/s]
 25%|██▌       | 94657/371472 [7:31:53<21:45:40,  3.53it/s]
 25%|██▌       | 94658/371472 [7:31:53<20:48:19,  3.70it/s]
 25%|██▌       | 94659/371472 [7:31:53<21:14:00,  3.62it/s]
 25%|██▌       | 94660/371472 [7:31:54<20:54:06,  3.68it/s]
                                                           
{'loss': 3.6593, 'learning_rate': 7.710196298131828e-07, 'epoch': 4.08}

 25%|██▌       | 94660/371472 [7:31:54<20:54:06,  3.68it/s]
 25%|██▌       | 94661/371472 [7:31:54<20:17:54,  3.79it/s]
 25%|██▌       | 94662/371472 [7:31:54<20:15:23,  3.80it/s]
 25%|██▌       | 94663/371472 [7:31:54<19:56:42,  3.86it/s]
 25%|██▌       | 94664/371472 [7:31:55<21:40:41,  3.55it/s]
 25%|██▌       | 94665/371472 [7:31:55<21:00:38,  3.66it/s]
 25%|██▌       | 94666/371472 [7:31:55<20:46:02,  3.70it/s]
 25%|██▌       | 94667/371472 [7:31:55<21:57:57,  3.50it/s]
 25%|██▌       | 94668/371472 [7:31:56<21:08:34,  3.64it/s]
 25%|██▌       | 94669/371472 [7:31:56<21:20:54,  3.60it/s]
 25%|██▌       | 94670/371472 [7:31:56<20:38:22,  3.73it/s]
 25%|██▌       | 94671/371472 [7:31:57<22:33:43,  3.41it/s]
 25%|██▌       | 94672/371472 [7:31:57<21:49:46,  3.52it/s]
 25%|██▌       | 94673/371472 [7:31:57<21:43:02,  3.54it/s]
 25%|██▌       | 94674/371472 [7:31:57<21:13:45,  3.62it/s]
 25%|██▌       | 94675/371472 [7:31:58<20:28:42,  3.75it/s]
 25%|██▌       | 94676/371472 [7:31:58<21:19:23,  3.61it/s]
 25%|██▌       | 94677/371472 [7:31:58<22:16:00,  3.45it/s]
 25%|██▌       | 94678/371472 [7:31:59<21:46:28,  3.53it/s]
 25%|██▌       | 94679/371472 [7:31:59<21:33:33,  3.57it/s]
 25%|██▌       | 94680/371472 [7:31:59<21:04:27,  3.65it/s]
                                                           
{'loss': 3.5935, 'learning_rate': 7.709711478377038e-07, 'epoch': 4.08}

 25%|██▌       | 94680/371472 [7:31:59<21:04:27,  3.65it/s]
 25%|██▌       | 94681/371472 [7:31:59<21:10:56,  3.63it/s]
 25%|██▌       | 94682/371472 [7:32:00<20:26:04,  3.76it/s]
 25%|██▌       | 94683/371472 [7:32:00<20:34:20,  3.74it/s]
 25%|██▌       | 94684/371472 [7:32:00<22:28:30,  3.42it/s]
 25%|██▌       | 94685/371472 [7:32:01<22:52:59,  3.36it/s]
 25%|██▌       | 94686/371472 [7:32:01<22:21:19,  3.44it/s]
 25%|██▌       | 94687/371472 [7:32:01<22:23:14,  3.43it/s]
 25%|██▌       | 94688/371472 [7:32:01<23:04:01,  3.33it/s]
 25%|██▌       | 94689/371472 [7:32:02<22:04:42,  3.48it/s]
 25%|██▌       | 94690/371472 [7:32:02<21:44:51,  3.54it/s]
 25%|██▌       | 94691/371472 [7:32:02<21:54:25,  3.51it/s]
 25%|██▌       | 94692/371472 [7:32:02<21:02:27,  3.65it/s]
 25%|██▌       | 94693/371472 [7:32:03<20:36:07,  3.73it/s]
 25%|██▌       | 94694/371472 [7:32:03<21:13:52,  3.62it/s]
 25%|██▌       | 94695/371472 [7:32:03<20:57:41,  3.67it/s]
 25%|██▌       | 94696/371472 [7:32:04<22:43:50,  3.38it/s]
 25%|██▌       | 94697/371472 [7:32:04<22:42:44,  3.39it/s]
 25%|██▌       | 94698/371472 [7:32:04<21:36:26,  3.56it/s]
 25%|██▌       | 94699/371472 [7:32:04<21:10:33,  3.63it/s]
 25%|██▌       | 94700/371472 [7:32:05<20:03:45,  3.83it/s]
                                                           
{'loss': 3.604, 'learning_rate': 7.70922665862225e-07, 'epoch': 4.08}

 25%|██▌       | 94700/371472 [7:32:05<20:03:45,  3.83it/s]
 25%|██▌       | 94701/371472 [7:32:05<22:43:57,  3.38it/s]
 25%|██▌       | 94702/371472 [7:32:05<22:08:13,  3.47it/s]
 25%|██▌       | 94703/371472 [7:32:06<21:50:31,  3.52it/s]
 25%|██▌       | 94704/371472 [7:32:06<21:56:48,  3.50it/s]
 25%|██▌       | 94705/371472 [7:32:06<21:15:01,  3.62it/s]
 25%|██▌       | 94706/371472 [7:32:06<20:28:16,  3.76it/s]
 25%|██▌       | 94707/371472 [7:32:07<21:07:00,  3.64it/s]
 25%|██▌       | 94708/371472 [7:32:07<20:45:08,  3.70it/s]
 25%|██▌       | 94709/371472 [7:32:07<20:04:33,  3.83it/s]
 25%|██▌       | 94710/371472 [7:32:07<19:54:34,  3.86it/s]
 25%|██▌       | 94711/371472 [7:32:08<20:19:34,  3.78it/s]
 25%|██▌       | 94712/371472 [7:32:08<20:56:58,  3.67it/s]
 25%|██▌       | 94713/371472 [7:32:08<22:25:35,  3.43it/s]
 25%|██▌       | 94714/371472 [7:32:09<21:24:52,  3.59it/s]
 25%|██▌       | 94715/371472 [7:32:09<21:27:38,  3.58it/s]
 25%|██▌       | 94716/371472 [7:32:09<21:05:44,  3.64it/s]
 25%|██▌       | 94717/371472 [7:32:09<20:51:59,  3.68it/s]
 25%|██▌       | 94718/371472 [7:32:10<21:16:55,  3.61it/s]
 25%|██▌       | 94719/371472 [7:32:10<20:34:18,  3.74it/s]
 25%|██▌       | 94720/371472 [7:32:10<20:21:34,  3.78it/s]
                                                           
{'loss': 3.7207, 'learning_rate': 7.708741838867461e-07, 'epoch': 4.08}

 25%|██▌       | 94720/371472 [7:32:10<20:21:34,  3.78it/s]
 25%|██▌       | 94721/371472 [7:32:10<20:19:57,  3.78it/s]
 25%|██▌       | 94722/371472 [7:32:11<21:45:03,  3.53it/s]
 25%|██▌       | 94723/371472 [7:32:11<21:58:36,  3.50it/s]
 25%|██▌       | 94724/371472 [7:32:11<22:45:55,  3.38it/s]
 25%|██▌       | 94725/371472 [7:32:12<21:43:53,  3.54it/s]
 26%|██▌       | 94726/371472 [7:32:12<21:09:20,  3.63it/s]
 26%|██▌       | 94727/371472 [7:32:12<25:25:16,  3.02it/s]
 26%|██▌       | 94728/371472 [7:32:13<23:44:41,  3.24it/s]
 26%|██▌       | 94729/371472 [7:32:13<23:47:52,  3.23it/s]
 26%|██▌       | 94730/371472 [7:32:13<23:19:06,  3.30it/s]
 26%|██▌       | 94731/371472 [7:32:13<21:58:44,  3.50it/s]
 26%|██▌       | 94732/371472 [7:32:14<21:58:26,  3.50it/s]
 26%|██▌       | 94733/371472 [7:32:14<21:46:48,  3.53it/s]
 26%|██▌       | 94734/371472 [7:32:14<21:38:40,  3.55it/s]
 26%|██▌       | 94735/371472 [7:32:15<23:08:40,  3.32it/s]
 26%|██▌       | 94736/371472 [7:32:15<22:27:03,  3.42it/s]
 26%|██▌       | 94737/371472 [7:32:15<21:50:58,  3.52it/s]
 26%|██▌       | 94738/371472 [7:32:16<22:25:57,  3.43it/s]
 26%|██▌       | 94739/371472 [7:32:16<21:12:07,  3.63it/s]
 26%|██▌       | 94740/371472 [7:32:16<21:01:32,  3.66it/s]
                                                           
{'loss': 3.6882, 'learning_rate': 7.708257019112672e-07, 'epoch': 4.08}

 26%|██▌       | 94740/371472 [7:32:16<21:01:32,  3.66it/s]
 26%|██▌       | 94741/371472 [7:32:16<21:22:48,  3.60it/s]
 26%|██▌       | 94742/371472 [7:32:17<20:32:11,  3.74it/s]
 26%|██▌       | 94743/371472 [7:32:17<20:14:48,  3.80it/s]
 26%|██▌       | 94744/371472 [7:32:17<21:30:05,  3.58it/s]
 26%|██▌       | 94745/371472 [7:32:17<21:06:00,  3.64it/s]
 26%|██▌       | 94746/371472 [7:32:18<21:00:47,  3.66it/s]
 26%|██▌       | 94747/371472 [7:32:18<20:40:55,  3.72it/s]
 26%|██▌       | 94748/371472 [7:32:18<20:29:22,  3.75it/s]
 26%|██▌       | 94749/371472 [7:32:18<21:03:04,  3.65it/s]
 26%|██▌       | 94750/371472 [7:32:19<20:22:07,  3.77it/s]
 26%|██▌       | 94751/371472 [7:32:19<20:30:51,  3.75it/s]
 26%|██▌       | 94752/371472 [7:32:19<21:56:51,  3.50it/s]
 26%|██▌       | 94753/371472 [7:32:20<22:10:04,  3.47it/s]
 26%|██▌       | 94754/371472 [7:32:20<23:10:55,  3.32it/s]
 26%|██▌       | 94755/371472 [7:32:20<23:21:28,  3.29it/s]
 26%|██▌       | 94756/371472 [7:32:21<22:18:18,  3.45it/s]
 26%|██▌       | 94757/371472 [7:32:21<22:20:01,  3.44it/s]
 26%|██▌       | 94758/371472 [7:32:21<23:01:16,  3.34it/s]
 26%|██▌       | 94759/371472 [7:32:21<22:15:40,  3.45it/s]
 26%|██▌       | 94760/371472 [7:32:22<21:09:08,  3.63it/s]
                                                           
{'loss': 3.7115, 'learning_rate': 7.707772199357883e-07, 'epoch': 4.08}

 26%|██▌       | 94760/371472 [7:32:22<21:09:08,  3.63it/s]
 26%|██▌       | 94761/371472 [7:32:22<21:00:33,  3.66it/s]
 26%|██▌       | 94762/371472 [7:32:22<20:51:17,  3.69it/s]
 26%|██▌       | 94763/371472 [7:32:22<20:32:10,  3.74it/s]
 26%|██▌       | 94764/371472 [7:32:23<20:28:53,  3.75it/s]
 26%|██▌       | 94765/371472 [7:32:23<20:44:35,  3.71it/s]
 26%|██▌       | 94766/371472 [7:32:23<20:08:15,  3.82it/s]
 26%|██▌       | 94767/371472 [7:32:23<20:23:27,  3.77it/s]
 26%|██▌       | 94768/371472 [7:32:24<22:12:35,  3.46it/s]
 26%|██▌       | 94769/371472 [7:32:24<22:53:47,  3.36it/s]
 26%|██▌       | 94770/371472 [7:32:24<22:11:24,  3.46it/s]
 26%|██▌       | 94771/371472 [7:32:25<21:57:27,  3.50it/s]
 26%|██▌       | 94772/371472 [7:32:25<21:16:05,  3.61it/s]
 26%|██▌       | 94773/371472 [7:32:25<22:08:02,  3.47it/s]
 26%|██▌       | 94774/371472 [7:32:26<21:20:45,  3.60it/s]
 26%|██▌       | 94775/371472 [7:32:26<21:13:55,  3.62it/s]
 26%|██▌       | 94776/371472 [7:32:26<20:43:31,  3.71it/s]
 26%|██▌       | 94777/371472 [7:32:26<20:30:18,  3.75it/s]
 26%|██▌       | 94778/371472 [7:32:27<19:56:05,  3.86it/s]
 26%|██▌       | 94779/371472 [7:32:27<19:44:19,  3.89it/s]
 26%|██▌       | 94780/371472 [7:32:27<19:39:51,  3.91it/s]
                                                           
{'loss': 3.607, 'learning_rate': 7.707287379603095e-07, 'epoch': 4.08}

 26%|██▌       | 94780/371472 [7:32:27<19:39:51,  3.91it/s]
 26%|██▌       | 94781/371472 [7:32:27<19:29:29,  3.94it/s]
 26%|██▌       | 94782/371472 [7:32:28<19:44:30,  3.89it/s]
 26%|██▌       | 94783/371472 [7:32:28<20:35:07,  3.73it/s]
 26%|██▌       | 94784/371472 [7:32:28<20:26:36,  3.76it/s]
 26%|██▌       | 94785/371472 [7:32:28<21:05:11,  3.64it/s]
 26%|██▌       | 94786/371472 [7:32:29<21:41:14,  3.54it/s]
 26%|██▌       | 94787/371472 [7:32:29<20:58:52,  3.66it/s]
 26%|██▌       | 94788/371472 [7:32:29<21:23:15,  3.59it/s]
 26%|██▌       | 94789/371472 [7:32:29<20:31:11,  3.75it/s]
 26%|██▌       | 94790/371472 [7:32:30<21:15:43,  3.61it/s]
 26%|██▌       | 94791/371472 [7:32:30<20:47:19,  3.70it/s]
 26%|██▌       | 94792/371472 [7:32:30<22:06:49,  3.48it/s]
 26%|██▌       | 94793/371472 [7:32:31<21:33:59,  3.56it/s]
 26%|██▌       | 94794/371472 [7:32:31<21:20:52,  3.60it/s]
 26%|██▌       | 94795/371472 [7:32:31<21:22:08,  3.60it/s]
 26%|██▌       | 94796/371472 [7:32:31<20:47:50,  3.70it/s]
 26%|██▌       | 94797/371472 [7:32:32<20:31:31,  3.74it/s]
 26%|██▌       | 94798/371472 [7:32:32<21:14:19,  3.62it/s]
 26%|██▌       | 94799/371472 [7:32:32<20:39:00,  3.72it/s]
 26%|██▌       | 94800/371472 [7:32:33<22:45:14,  3.38it/s]
                                                           
{'loss': 3.9763, 'learning_rate': 7.706802559848304e-07, 'epoch': 4.08}

 26%|██▌       | 94800/371472 [7:32:33<22:45:14,  3.38it/s]
 26%|██▌       | 94801/371472 [7:32:33<22:45:24,  3.38it/s]
 26%|██▌       | 94802/371472 [7:32:33<23:27:03,  3.28it/s]
 26%|██▌       | 94803/371472 [7:32:34<24:23:20,  3.15it/s]
 26%|██▌       | 94804/371472 [7:32:34<23:06:10,  3.33it/s]
 26%|██▌       | 94805/371472 [7:32:34<21:36:20,  3.56it/s]
 26%|██▌       | 94806/371472 [7:32:34<24:11:46,  3.18it/s]
 26%|██▌       | 94807/371472 [7:32:35<23:32:17,  3.26it/s]
 26%|██▌       | 94808/371472 [7:32:35<22:17:10,  3.45it/s]
 26%|██▌       | 94809/371472 [7:32:35<22:45:07,  3.38it/s]
 26%|██▌       | 94810/371472 [7:32:36<21:57:27,  3.50it/s]
 26%|██▌       | 94811/371472 [7:32:36<22:18:28,  3.44it/s]
 26%|██▌       | 94812/371472 [7:32:36<21:29:11,  3.58it/s]
 26%|██▌       | 94813/371472 [7:32:36<21:26:35,  3.58it/s]
 26%|██▌       | 94814/371472 [7:32:37<20:28:23,  3.75it/s]
 26%|██▌       | 94815/371472 [7:32:37<20:30:52,  3.75it/s]
 26%|██▌       | 94816/371472 [7:32:37<20:22:17,  3.77it/s]
 26%|██▌       | 94817/371472 [7:32:37<20:51:27,  3.68it/s]
 26%|██▌       | 94818/371472 [7:32:38<20:08:33,  3.82it/s]
 26%|██▌       | 94819/371472 [7:32:38<20:36:15,  3.73it/s]
 26%|██▌       | 94820/371472 [7:32:38<21:24:47,  3.59it/s]
                                                           
{'loss': 3.7004, 'learning_rate': 7.706317740093515e-07, 'epoch': 4.08}

 26%|██▌       | 94820/371472 [7:32:38<21:24:47,  3.59it/s]
 26%|██▌       | 94821/371472 [7:32:39<22:26:38,  3.42it/s]
 26%|██▌       | 94822/371472 [7:32:39<22:08:06,  3.47it/s]
 26%|██▌       | 94823/371472 [7:32:39<21:53:33,  3.51it/s]
 26%|██▌       | 94824/371472 [7:32:39<21:26:52,  3.58it/s]
 26%|██▌       | 94825/371472 [7:32:40<21:39:03,  3.55it/s]
 26%|██▌       | 94826/371472 [7:32:40<21:23:37,  3.59it/s]
 26%|██▌       | 94827/371472 [7:32:40<20:56:27,  3.67it/s]
 26%|██▌       | 94828/371472 [7:32:41<20:38:31,  3.72it/s]
 26%|██▌       | 94829/371472 [7:32:41<20:28:32,  3.75it/s]
 26%|██▌       | 94830/371472 [7:32:41<20:52:46,  3.68it/s]
 26%|██▌       | 94831/371472 [7:32:41<21:20:58,  3.60it/s]
 26%|██▌       | 94832/371472 [7:32:42<22:15:05,  3.45it/s]
 26%|██▌       | 94833/371472 [7:32:42<21:32:40,  3.57it/s]
 26%|██▌       | 94834/371472 [7:32:42<21:30:51,  3.57it/s]
 26%|██▌       | 94835/371472 [7:32:42<21:30:13,  3.57it/s]
 26%|██▌       | 94836/371472 [7:32:43<21:19:00,  3.60it/s]
 26%|██▌       | 94837/371472 [7:32:43<21:03:31,  3.65it/s]
 26%|██▌       | 94838/371472 [7:32:43<21:50:40,  3.52it/s]
 26%|██▌       | 94839/371472 [7:32:44<21:39:55,  3.55it/s]
 26%|██▌       | 94840/371472 [7:32:44<20:46:07,  3.70it/s]
                                                           
{'loss': 3.6568, 'learning_rate': 7.705832920338727e-07, 'epoch': 4.08}

 26%|██▌       | 94840/371472 [7:32:44<20:46:07,  3.70it/s]
 26%|██▌       | 94841/371472 [7:32:44<20:02:51,  3.83it/s]
 26%|██▌       | 94842/371472 [7:32:44<20:30:22,  3.75it/s]
 26%|██▌       | 94843/371472 [7:32:45<20:29:52,  3.75it/s]
 26%|██▌       | 94844/371472 [7:32:45<22:27:12,  3.42it/s]
 26%|██▌       | 94845/371472 [7:32:45<22:51:43,  3.36it/s]
 26%|██▌       | 94846/371472 [7:32:46<21:57:43,  3.50it/s]
 26%|██▌       | 94847/371472 [7:32:46<21:39:47,  3.55it/s]
 26%|██▌       | 94848/371472 [7:32:46<21:28:56,  3.58it/s]
 26%|██▌       | 94849/371472 [7:32:46<20:54:09,  3.68it/s]
 26%|██▌       | 94850/371472 [7:32:47<20:05:52,  3.82it/s]
 26%|██▌       | 94851/371472 [7:32:47<21:26:57,  3.58it/s]
 26%|██▌       | 94852/371472 [7:32:47<20:53:05,  3.68it/s]
 26%|██▌       | 94853/371472 [7:32:47<21:17:49,  3.61it/s]
 26%|██▌       | 94854/371472 [7:32:48<21:07:19,  3.64it/s]
 26%|██▌       | 94855/371472 [7:32:48<21:58:20,  3.50it/s]
 26%|██▌       | 94856/371472 [7:32:48<22:12:34,  3.46it/s]
 26%|██▌       | 94857/371472 [7:32:49<24:34:38,  3.13it/s]
 26%|██▌       | 94858/371472 [7:32:49<25:52:57,  2.97it/s]
 26%|██▌       | 94859/371472 [7:32:49<25:15:03,  3.04it/s]
 26%|██▌       | 94860/371472 [7:32:50<23:50:43,  3.22it/s]
                                                           
{'loss': 3.7294, 'learning_rate': 7.705348100583939e-07, 'epoch': 4.09}

 26%|██▌       | 94860/371472 [7:32:50<23:50:43,  3.22it/s]
 26%|██▌       | 94861/371472 [7:32:50<22:02:46,  3.49it/s]
 26%|██▌       | 94862/371472 [7:32:50<22:04:05,  3.48it/s]
 26%|██▌       | 94863/371472 [7:32:50<21:42:44,  3.54it/s]
 26%|██▌       | 94864/371472 [7:32:51<22:47:58,  3.37it/s]
 26%|██▌       | 94865/371472 [7:32:51<23:37:07,  3.25it/s]
 26%|██▌       | 94866/371472 [7:32:51<22:18:27,  3.44it/s]
 26%|██▌       | 94867/371472 [7:32:52<21:37:01,  3.55it/s]
 26%|██▌       | 94868/371472 [7:32:52<21:20:18,  3.60it/s]
 26%|██▌       | 94869/371472 [7:32:52<20:27:20,  3.76it/s]
 26%|██▌       | 94870/371472 [7:32:52<20:52:11,  3.68it/s]
 26%|██▌       | 94871/371472 [7:32:53<20:01:02,  3.84it/s]
 26%|██▌       | 94872/371472 [7:32:53<19:53:12,  3.86it/s]
 26%|██▌       | 94873/371472 [7:32:53<20:04:56,  3.83it/s]
 26%|██▌       | 94874/371472 [7:32:53<20:41:25,  3.71it/s]
 26%|██▌       | 94875/371472 [7:32:54<21:19:41,  3.60it/s]
 26%|██▌       | 94876/371472 [7:32:54<22:08:45,  3.47it/s]
 26%|██▌       | 94877/371472 [7:32:54<24:27:50,  3.14it/s]
 26%|██▌       | 94878/371472 [7:32:55<22:50:19,  3.36it/s]
 26%|██▌       | 94879/371472 [7:32:55<21:47:33,  3.53it/s]
 26%|██▌       | 94880/371472 [7:32:55<22:17:00,  3.45it/s]
                                                           
{'loss': 3.6133, 'learning_rate': 7.704863280829149e-07, 'epoch': 4.09}

 26%|██▌       | 94880/371472 [7:32:55<22:17:00,  3.45it/s]
 26%|██▌       | 94881/371472 [7:32:56<21:51:47,  3.51it/s]
 26%|██▌       | 94882/371472 [7:32:56<21:29:13,  3.58it/s]
 26%|██▌       | 94883/371472 [7:32:56<21:41:34,  3.54it/s]
 26%|██▌       | 94884/371472 [7:32:56<20:51:17,  3.68it/s]
 26%|██▌       | 94885/371472 [7:32:57<21:10:24,  3.63it/s]
 26%|██▌       | 94886/371472 [7:32:57<22:34:31,  3.40it/s]
 26%|██▌       | 94887/371472 [7:32:57<21:41:36,  3.54it/s]
 26%|██▌       | 94888/371472 [7:32:58<21:21:15,  3.60it/s]
 26%|██▌       | 94889/371472 [7:32:58<20:30:11,  3.75it/s]
 26%|██▌       | 94890/371472 [7:32:58<20:45:37,  3.70it/s]
 26%|██▌       | 94891/371472 [7:32:58<21:04:48,  3.64it/s]
 26%|██▌       | 94892/371472 [7:32:59<20:43:43,  3.71it/s]
 26%|██▌       | 94893/371472 [7:32:59<20:21:36,  3.77it/s]
 26%|██▌       | 94894/371472 [7:32:59<20:27:44,  3.75it/s]
 26%|██▌       | 94895/371472 [7:32:59<20:53:40,  3.68it/s]
 26%|██▌       | 94896/371472 [7:33:00<20:12:27,  3.80it/s]
 26%|██▌       | 94897/371472 [7:33:00<19:30:18,  3.94it/s]
 26%|██▌       | 94898/371472 [7:33:00<19:29:39,  3.94it/s]
 26%|██▌       | 94899/371472 [7:33:00<19:58:00,  3.85it/s]
 26%|██▌       | 94900/371472 [7:33:01<20:04:32,  3.83it/s]
                                                           
{'loss': 3.5222, 'learning_rate': 7.70437846107436e-07, 'epoch': 4.09}

 26%|██▌       | 94900/371472 [7:33:01<20:04:32,  3.83it/s]
 26%|██▌       | 94901/371472 [7:33:01<19:46:56,  3.88it/s]
 26%|██▌       | 94902/371472 [7:33:01<19:48:50,  3.88it/s]
 26%|██▌       | 94903/371472 [7:33:01<19:44:33,  3.89it/s]
 26%|██▌       | 94904/371472 [7:33:02<20:24:55,  3.76it/s]
 26%|██▌       | 94905/371472 [7:33:02<19:48:46,  3.88it/s]
 26%|██▌       | 94906/371472 [7:33:02<19:47:11,  3.88it/s]
 26%|██▌       | 94907/371472 [7:33:03<21:33:12,  3.56it/s]
 26%|██▌       | 94908/371472 [7:33:03<20:57:19,  3.67it/s]
 26%|██▌       | 94909/371472 [7:33:03<20:20:27,  3.78it/s]
 26%|██▌       | 94910/371472 [7:33:03<20:32:56,  3.74it/s]
 26%|██▌       | 94911/371472 [7:33:04<20:21:41,  3.77it/s]
 26%|██▌       | 94912/371472 [7:33:04<20:44:10,  3.70it/s]
 26%|██▌       | 94913/371472 [7:33:04<21:11:41,  3.62it/s]
 26%|██▌       | 94914/371472 [7:33:04<22:36:19,  3.40it/s]
 26%|██▌       | 94915/371472 [7:33:05<23:09:35,  3.32it/s]
 26%|██▌       | 94916/371472 [7:33:05<24:05:12,  3.19it/s]
 26%|██▌       | 94917/371472 [7:33:05<23:52:41,  3.22it/s]
 26%|██▌       | 94918/371472 [7:33:06<22:06:45,  3.47it/s]
 26%|██▌       | 94919/371472 [7:33:06<22:36:49,  3.40it/s]
 26%|██▌       | 94920/371472 [7:33:06<22:07:44,  3.47it/s]
                                                           
{'loss': 3.8665, 'learning_rate': 7.703893641319572e-07, 'epoch': 4.09}

 26%|██▌       | 94920/371472 [7:33:06<22:07:44,  3.47it/s]
 26%|██▌       | 94921/371472 [7:33:07<21:33:43,  3.56it/s]
 26%|██▌       | 94922/371472 [7:33:07<23:27:26,  3.27it/s]
 26%|██▌       | 94923/371472 [7:33:07<22:31:31,  3.41it/s]
 26%|██▌       | 94924/371472 [7:33:07<21:46:38,  3.53it/s]
 26%|██▌       | 94925/371472 [7:33:08<21:35:32,  3.56it/s]
 26%|██▌       | 94926/371472 [7:33:08<20:58:26,  3.66it/s]
 26%|██▌       | 94927/371472 [7:33:08<23:24:07,  3.28it/s]
 26%|██▌       | 94928/371472 [7:33:09<23:10:22,  3.31it/s]
 26%|██▌       | 94929/371472 [7:33:09<21:40:21,  3.54it/s]
 26%|██▌       | 94930/371472 [7:33:09<20:48:25,  3.69it/s]
 26%|██▌       | 94931/371472 [7:33:09<22:31:44,  3.41it/s]
 26%|██▌       | 94932/371472 [7:33:10<21:23:39,  3.59it/s]
 26%|██▌       | 94933/371472 [7:33:10<20:37:54,  3.72it/s]
 26%|██▌       | 94934/371472 [7:33:10<19:58:26,  3.85it/s]
 26%|██▌       | 94935/371472 [7:33:10<20:15:19,  3.79it/s]
 26%|██▌       | 94936/371472 [7:33:11<20:04:09,  3.83it/s]
 26%|██▌       | 94937/371472 [7:33:11<20:20:15,  3.78it/s]
 26%|██▌       | 94938/371472 [7:33:11<21:56:00,  3.50it/s]
 26%|██▌       | 94939/371472 [7:33:12<21:39:52,  3.55it/s]
 26%|██▌       | 94940/371472 [7:33:12<21:38:40,  3.55it/s]
                                                           
{'loss': 3.7331, 'learning_rate': 7.703408821564781e-07, 'epoch': 4.09}

 26%|██▌       | 94940/371472 [7:33:12<21:38:40,  3.55it/s]
 26%|██▌       | 94941/371472 [7:33:12<22:25:44,  3.42it/s]
 26%|██▌       | 94942/371472 [7:33:12<21:49:58,  3.52it/s]
 26%|██▌       | 94943/371472 [7:33:13<21:30:15,  3.57it/s]
 26%|██▌       | 94944/371472 [7:33:13<23:11:04,  3.31it/s]
 26%|██▌       | 94945/371472 [7:33:13<21:52:49,  3.51it/s]
 26%|██▌       | 94946/371472 [7:33:14<21:07:54,  3.63it/s]
 26%|██▌       | 94947/371472 [7:33:14<22:18:50,  3.44it/s]
 26%|██▌       | 94948/371472 [7:33:14<21:13:18,  3.62it/s]
 26%|██▌       | 94949/371472 [7:33:14<20:26:24,  3.76it/s]
 26%|██▌       | 94950/371472 [7:33:15<20:15:09,  3.79it/s]
 26%|██▌       | 94951/371472 [7:33:15<19:47:10,  3.88it/s]
 26%|██▌       | 94952/371472 [7:33:15<19:49:00,  3.88it/s]
 26%|██▌       | 94953/371472 [7:33:15<21:12:47,  3.62it/s]
 26%|██▌       | 94954/371472 [7:33:16<20:36:27,  3.73it/s]
 26%|██▌       | 94955/371472 [7:33:16<22:16:53,  3.45it/s]
 26%|██▌       | 94956/371472 [7:33:16<22:40:36,  3.39it/s]
 26%|██▌       | 94957/371472 [7:33:17<23:57:29,  3.21it/s]
 26%|██▌       | 94958/371472 [7:33:17<22:55:46,  3.35it/s]
 26%|██▌       | 94959/371472 [7:33:17<21:33:39,  3.56it/s]
 26%|██▌       | 94960/371472 [7:33:17<20:50:13,  3.69it/s]
                                                           
{'loss': 3.6031, 'learning_rate': 7.702924001809993e-07, 'epoch': 4.09}

 26%|██▌       | 94960/371472 [7:33:17<20:50:13,  3.69it/s]
 26%|██▌       | 94961/371472 [7:33:18<23:49:34,  3.22it/s]
 26%|██▌       | 94962/371472 [7:33:18<22:56:19,  3.35it/s]
 26%|██▌       | 94963/371472 [7:33:18<21:58:04,  3.50it/s]
 26%|██▌       | 94964/371472 [7:33:19<21:37:27,  3.55it/s]
 26%|██▌       | 94965/371472 [7:33:19<21:56:08,  3.50it/s]
 26%|██▌       | 94966/371472 [7:33:19<22:22:06,  3.43it/s]
 26%|██▌       | 94967/371472 [7:33:20<22:46:27,  3.37it/s]
 26%|██▌       | 94968/371472 [7:33:20<22:50:01,  3.36it/s]
 26%|██▌       | 94969/371472 [7:33:20<23:07:15,  3.32it/s]
 26%|██▌       | 94970/371472 [7:33:20<21:48:20,  3.52it/s]
 26%|██▌       | 94971/371472 [7:33:21<21:57:54,  3.50it/s]
 26%|██▌       | 94972/371472 [7:33:21<23:35:44,  3.26it/s]
 26%|██▌       | 94973/371472 [7:33:21<22:43:58,  3.38it/s]
 26%|██▌       | 94974/371472 [7:33:22<21:51:59,  3.51it/s]
 26%|██▌       | 94975/371472 [7:33:22<21:23:07,  3.59it/s]
 26%|██▌       | 94976/371472 [7:33:22<21:29:35,  3.57it/s]
 26%|██▌       | 94977/371472 [7:33:23<25:06:14,  3.06it/s]
 26%|██▌       | 94978/371472 [7:33:23<24:07:30,  3.18it/s]
 26%|██▌       | 94979/371472 [7:33:23<23:22:15,  3.29it/s]
 26%|██▌       | 94980/371472 [7:33:23<22:59:00,  3.34it/s]
                                                           
{'loss': 3.397, 'learning_rate': 7.702439182055204e-07, 'epoch': 4.09}

 26%|██▌       | 94980/371472 [7:33:23<22:59:00,  3.34it/s]
 26%|██▌       | 94981/371472 [7:33:24<21:48:47,  3.52it/s]
 26%|██▌       | 94982/371472 [7:33:24<21:16:14,  3.61it/s]
 26%|██▌       | 94983/371472 [7:33:24<20:52:39,  3.68it/s]
 26%|██▌       | 94984/371472 [7:33:24<20:39:52,  3.72it/s]
 26%|██▌       | 94985/371472 [7:33:25<21:34:04,  3.56it/s]
 26%|██▌       | 94986/371472 [7:33:25<20:27:14,  3.75it/s]
 26%|██▌       | 94987/371472 [7:33:25<20:52:37,  3.68it/s]
 26%|██▌       | 94988/371472 [7:33:26<20:55:27,  3.67it/s]
 26%|██▌       | 94989/371472 [7:33:26<20:52:04,  3.68it/s]
 26%|██▌       | 94990/371472 [7:33:26<20:11:05,  3.80it/s]
 26%|██▌       | 94991/371472 [7:33:26<20:08:16,  3.81it/s]
 26%|██▌       | 94992/371472 [7:33:27<19:39:00,  3.91it/s]
 26%|██▌       | 94993/371472 [7:33:27<19:58:37,  3.84it/s]
 26%|██▌       | 94994/371472 [7:33:27<20:53:14,  3.68it/s]
 26%|██▌       | 94995/371472 [7:33:27<20:35:39,  3.73it/s]
 26%|██▌       | 94996/371472 [7:33:28<20:31:25,  3.74it/s]
 26%|██▌       | 94997/371472 [7:33:28<20:15:31,  3.79it/s]
 26%|██▌       | 94998/371472 [7:33:28<20:16:43,  3.79it/s]
 26%|██▌       | 94999/371472 [7:33:28<21:09:15,  3.63it/s]
 26%|██▌       | 95000/371472 [7:33:29<21:07:03,  3.64it/s]
                                                           
{'loss': 3.9264, 'learning_rate': 7.701954362300416e-07, 'epoch': 4.09}

 26%|██▌       | 95000/371472 [7:33:29<21:07:03,  3.64it/s]
 26%|██▌       | 95001/371472 [7:33:29<22:16:09,  3.45it/s]
 26%|██▌       | 95002/371472 [7:33:29<21:31:08,  3.57it/s]
 26%|██▌       | 95003/371472 [7:33:30<20:57:30,  3.66it/s]
 26%|██▌       | 95004/371472 [7:33:30<20:24:56,  3.76it/s]
 26%|██▌       | 95005/371472 [7:33:30<20:34:14,  3.73it/s]
 26%|██▌       | 95006/371472 [7:33:30<20:08:19,  3.81it/s]
 26%|██▌       | 95007/371472 [7:33:31<19:54:56,  3.86it/s]
 26%|██▌       | 95008/371472 [7:33:31<20:58:24,  3.66it/s]
 26%|██▌       | 95009/371472 [7:33:31<20:45:54,  3.70it/s]
 26%|██▌       | 95010/371472 [7:33:31<20:21:27,  3.77it/s]
 26%|██▌       | 95011/371472 [7:33:32<20:47:01,  3.69it/s]
 26%|██▌       | 95012/371472 [7:33:32<20:13:07,  3.80it/s]
 26%|██▌       | 95013/371472 [7:33:32<20:14:34,  3.79it/s]
 26%|██▌       | 95014/371472 [7:33:32<19:58:24,  3.84it/s]
 26%|██▌       | 95015/371472 [7:33:33<23:51:05,  3.22it/s]
 26%|██▌       | 95016/371472 [7:33:33<24:17:04,  3.16it/s]
 26%|██▌       | 95017/371472 [7:33:33<22:41:59,  3.38it/s]
 26%|██▌       | 95018/371472 [7:33:34<22:50:23,  3.36it/s]
 26%|██▌       | 95019/371472 [7:33:34<23:49:27,  3.22it/s]
 26%|██▌       | 95020/371472 [7:33:34<21:54:46,  3.50it/s]
                                                           
{'loss': 3.569, 'learning_rate': 7.701469542545627e-07, 'epoch': 4.09}

 26%|██▌       | 95020/371472 [7:33:34<21:54:46,  3.50it/s]
 26%|██▌       | 95021/371472 [7:33:35<22:47:30,  3.37it/s]
 26%|██▌       | 95022/371472 [7:33:35<22:59:31,  3.34it/s]
 26%|██▌       | 95023/371472 [7:33:35<22:54:42,  3.35it/s]
 26%|██▌       | 95024/371472 [7:33:36<21:30:36,  3.57it/s]
 26%|██▌       | 95025/371472 [7:33:36<22:17:38,  3.44it/s]
 26%|██▌       | 95026/371472 [7:33:36<23:22:15,  3.29it/s]
 26%|██▌       | 95027/371472 [7:33:36<22:29:00,  3.42it/s]
 26%|██▌       | 95028/371472 [7:33:37<21:19:36,  3.60it/s]
 26%|██▌       | 95029/371472 [7:33:37<22:01:32,  3.49it/s]
 26%|██▌       | 95030/371472 [7:33:37<21:50:45,  3.52it/s]
 26%|██▌       | 95031/371472 [7:33:37<20:40:44,  3.71it/s]
 26%|██▌       | 95032/371472 [7:33:38<20:28:26,  3.75it/s]
 26%|██▌       | 95033/371472 [7:33:38<21:12:07,  3.62it/s]
 26%|██▌       | 95034/371472 [7:33:38<20:59:38,  3.66it/s]
 26%|██▌       | 95035/371472 [7:33:39<20:26:10,  3.76it/s]
 26%|██▌       | 95036/371472 [7:33:39<20:16:38,  3.79it/s]
 26%|██▌       | 95037/371472 [7:33:39<20:10:27,  3.81it/s]
 26%|██▌       | 95038/371472 [7:33:39<20:50:26,  3.68it/s]
 26%|██▌       | 95039/371472 [7:33:40<21:09:38,  3.63it/s]
 26%|██▌       | 95040/371472 [7:33:40<21:39:59,  3.54it/s]
                                                           
{'loss': 3.586, 'learning_rate': 7.700984722790838e-07, 'epoch': 4.09}

 26%|██▌       | 95040/371472 [7:33:40<21:39:59,  3.54it/s]
 26%|██▌       | 95041/371472 [7:33:40<21:40:45,  3.54it/s]
 26%|██▌       | 95042/371472 [7:33:41<20:56:22,  3.67it/s]
 26%|██▌       | 95043/371472 [7:33:41<21:19:09,  3.60it/s]
 26%|██▌       | 95044/371472 [7:33:41<21:09:38,  3.63it/s]
 26%|██▌       | 95045/371472 [7:33:41<20:47:20,  3.69it/s]
 26%|██▌       | 95046/371472 [7:33:42<21:22:56,  3.59it/s]
 26%|██▌       | 95047/371472 [7:33:42<20:51:30,  3.68it/s]
 26%|██▌       | 95048/371472 [7:33:42<20:47:29,  3.69it/s]
 26%|██▌       | 95049/371472 [7:33:42<20:45:58,  3.70it/s]
 26%|██▌       | 95050/371472 [7:33:43<21:07:03,  3.64it/s]
 26%|██▌       | 95051/371472 [7:33:43<21:05:10,  3.64it/s]
 26%|██▌       | 95052/371472 [7:33:43<20:20:15,  3.78it/s]
 26%|██▌       | 95053/371472 [7:33:43<20:26:44,  3.76it/s]
 26%|██▌       | 95054/371472 [7:33:44<21:19:20,  3.60it/s]
 26%|██▌       | 95055/371472 [7:33:44<21:08:28,  3.63it/s]
 26%|██▌       | 95056/371472 [7:33:44<20:25:11,  3.76it/s]
 26%|██▌       | 95057/371472 [7:33:45<20:49:54,  3.69it/s]
 26%|██▌       | 95058/371472 [7:33:45<20:40:18,  3.71it/s]
 26%|██▌       | 95059/371472 [7:33:45<21:05:36,  3.64it/s]
 26%|██▌       | 95060/371472 [7:33:45<20:34:47,  3.73it/s]
                                                           
{'loss': 3.6438, 'learning_rate': 7.700499903036048e-07, 'epoch': 4.09}

 26%|██▌       | 95060/371472 [7:33:45<20:34:47,  3.73it/s]
 26%|██▌       | 95061/371472 [7:33:46<22:08:18,  3.47it/s]
 26%|██▌       | 95062/371472 [7:33:46<21:11:38,  3.62it/s]
 26%|██▌       | 95063/371472 [7:33:46<21:05:13,  3.64it/s]
 26%|██▌       | 95064/371472 [7:33:47<22:04:35,  3.48it/s]
 26%|██▌       | 95065/371472 [7:33:47<21:49:46,  3.52it/s]
 26%|██▌       | 95066/371472 [7:33:47<21:59:33,  3.49it/s]
 26%|██▌       | 95067/371472 [7:33:47<22:10:17,  3.46it/s]
 26%|██▌       | 95068/371472 [7:33:48<22:19:00,  3.44it/s]
 26%|██▌       | 95069/371472 [7:33:48<21:27:47,  3.58it/s]
 26%|██▌       | 95070/371472 [7:33:48<21:15:21,  3.61it/s]
 26%|██▌       | 95071/371472 [7:33:48<20:47:09,  3.69it/s]
 26%|██▌       | 95072/371472 [7:33:49<20:34:49,  3.73it/s]
 26%|██▌       | 95073/371472 [7:33:49<21:40:15,  3.54it/s]
 26%|██▌       | 95074/371472 [7:33:49<21:32:17,  3.56it/s]
 26%|██▌       | 95075/371472 [7:33:50<21:24:51,  3.59it/s]
 26%|██▌       | 95076/371472 [7:33:50<20:47:57,  3.69it/s]
 26%|██▌       | 95077/371472 [7:33:50<20:39:47,  3.72it/s]
 26%|██▌       | 95078/371472 [7:33:50<20:11:37,  3.80it/s]
 26%|██▌       | 95079/371472 [7:33:51<21:35:51,  3.55it/s]
 26%|██▌       | 95080/371472 [7:33:51<22:04:35,  3.48it/s]
                                                           
{'loss': 3.7133, 'learning_rate': 7.70001508328126e-07, 'epoch': 4.1}

 26%|██▌       | 95080/371472 [7:33:51<22:04:35,  3.48it/s]
 26%|██▌       | 95081/371472 [7:33:51<21:54:25,  3.50it/s]
 26%|██▌       | 95082/371472 [7:33:52<21:39:57,  3.54it/s]
 26%|██▌       | 95083/371472 [7:33:52<21:07:28,  3.63it/s]
 26%|██▌       | 95084/371472 [7:33:52<21:56:35,  3.50it/s]
 26%|██▌       | 95085/371472 [7:33:52<22:25:13,  3.42it/s]
 26%|██▌       | 95086/371472 [7:33:53<22:31:23,  3.41it/s]
 26%|██▌       | 95087/371472 [7:33:53<21:22:22,  3.59it/s]
 26%|██▌       | 95088/371472 [7:33:53<22:16:18,  3.45it/s]
 26%|██▌       | 95089/371472 [7:33:54<22:55:32,  3.35it/s]
 26%|██▌       | 95090/371472 [7:33:54<23:22:12,  3.29it/s]
 26%|██▌       | 95091/371472 [7:33:54<24:02:40,  3.19it/s]
 26%|██▌       | 95092/371472 [7:33:55<28:41:38,  2.68it/s]
 26%|██▌       | 95093/371472 [7:33:55<25:55:45,  2.96it/s]
 26%|██▌       | 95094/371472 [7:33:55<23:54:01,  3.21it/s]
 26%|██▌       | 95095/371472 [7:33:56<22:47:33,  3.37it/s]
 26%|██▌       | 95096/371472 [7:33:56<22:17:35,  3.44it/s]
 26%|██▌       | 95097/371472 [7:33:56<21:29:48,  3.57it/s]
 26%|██▌       | 95098/371472 [7:33:56<20:59:16,  3.66it/s]
 26%|██▌       | 95099/371472 [7:33:57<26:55:30,  2.85it/s]
 26%|██▌       | 95100/371472 [7:33:57<25:11:44,  3.05it/s]
                                                           
{'loss': 3.6876, 'learning_rate': 7.699530263526471e-07, 'epoch': 4.1}

 26%|██▌       | 95100/371472 [7:33:57<25:11:44,  3.05it/s]
 26%|██▌       | 95101/371472 [7:33:57<23:59:24,  3.20it/s]
 26%|██▌       | 95102/371472 [7:33:58<23:24:05,  3.28it/s]
 26%|██▌       | 95103/371472 [7:33:58<22:13:43,  3.45it/s]
 26%|██▌       | 95104/371472 [7:33:58<22:07:24,  3.47it/s]
 26%|██▌       | 95105/371472 [7:33:59<21:14:00,  3.62it/s]
 26%|██▌       | 95106/371472 [7:33:59<21:04:23,  3.64it/s]
 26%|██▌       | 95107/371472 [7:33:59<20:29:46,  3.75it/s]
 26%|██▌       | 95108/371472 [7:33:59<20:34:57,  3.73it/s]
 26%|██▌       | 95109/371472 [7:34:00<20:11:43,  3.80it/s]
 26%|██▌       | 95110/371472 [7:34:00<20:25:25,  3.76it/s]
 26%|██▌       | 95111/371472 [7:34:00<21:55:13,  3.50it/s]
 26%|██▌       | 95112/371472 [7:34:00<21:50:40,  3.51it/s]
 26%|██▌       | 95113/371472 [7:34:01<21:31:43,  3.57it/s]
 26%|██▌       | 95114/371472 [7:34:01<22:05:40,  3.47it/s]
 26%|██▌       | 95115/371472 [7:34:01<21:44:46,  3.53it/s]
 26%|██▌       | 95116/371472 [7:34:02<21:39:16,  3.55it/s]
 26%|██▌       | 95117/371472 [7:34:02<21:08:16,  3.63it/s]
 26%|██▌       | 95118/371472 [7:34:02<21:22:37,  3.59it/s]
 26%|██▌       | 95119/371472 [7:34:02<23:46:47,  3.23it/s]
 26%|██▌       | 95120/371472 [7:34:03<23:11:16,  3.31it/s]
                                                           
{'loss': 3.5328, 'learning_rate': 7.699045443771682e-07, 'epoch': 4.1}

 26%|██▌       | 95120/371472 [7:34:03<23:11:16,  3.31it/s]
 26%|██▌       | 95121/371472 [7:34:03<22:50:01,  3.36it/s]
 26%|██▌       | 95122/371472 [7:34:03<24:17:27,  3.16it/s]
 26%|██▌       | 95123/371472 [7:34:04<23:01:45,  3.33it/s]
 26%|██▌       | 95124/371472 [7:34:04<22:49:10,  3.36it/s]
 26%|██▌       | 95125/371472 [7:34:04<21:55:19,  3.50it/s]
 26%|██▌       | 95126/371472 [7:34:05<21:47:37,  3.52it/s]
 26%|██▌       | 95127/371472 [7:34:05<21:11:39,  3.62it/s]
 26%|██▌       | 95128/371472 [7:34:05<20:49:57,  3.68it/s]
 26%|██▌       | 95129/371472 [7:34:05<20:37:44,  3.72it/s]
 26%|██▌       | 95130/371472 [7:34:06<21:18:21,  3.60it/s]
 26%|██▌       | 95131/371472 [7:34:06<21:49:56,  3.52it/s]
 26%|██▌       | 95132/371472 [7:34:06<21:05:43,  3.64it/s]
 26%|██▌       | 95133/371472 [7:34:06<20:51:06,  3.68it/s]
 26%|██▌       | 95134/371472 [7:34:07<21:51:48,  3.51it/s]
 26%|██▌       | 95135/371472 [7:34:07<21:58:47,  3.49it/s]
 26%|██▌       | 95136/371472 [7:34:07<21:04:42,  3.64it/s]
 26%|██▌       | 95137/371472 [7:34:08<20:50:29,  3.68it/s]
 26%|██▌       | 95138/371472 [7:34:08<22:32:16,  3.41it/s]
 26%|██▌       | 95139/371472 [7:34:08<21:58:35,  3.49it/s]
 26%|██▌       | 95140/371472 [7:34:08<22:22:05,  3.43it/s]
                                                           
{'loss': 3.7075, 'learning_rate': 7.698560624016893e-07, 'epoch': 4.1}

 26%|██▌       | 95140/371472 [7:34:08<22:22:05,  3.43it/s]
 26%|██▌       | 95141/371472 [7:34:09<22:35:39,  3.40it/s]
 26%|██▌       | 95142/371472 [7:34:09<21:42:30,  3.54it/s]
 26%|██▌       | 95143/371472 [7:34:09<20:46:02,  3.70it/s]
 26%|██▌       | 95144/371472 [7:34:09<20:21:26,  3.77it/s]
 26%|██▌       | 95145/371472 [7:34:10<21:19:31,  3.60it/s]
 26%|██▌       | 95146/371472 [7:34:10<21:59:10,  3.49it/s]
 26%|██▌       | 95147/371472 [7:34:10<21:26:40,  3.58it/s]
 26%|██▌       | 95148/371472 [7:34:11<22:03:50,  3.48it/s]
 26%|██▌       | 95149/371472 [7:34:11<21:08:09,  3.63it/s]
 26%|██▌       | 95150/371472 [7:34:11<21:16:28,  3.61it/s]
 26%|██▌       | 95151/371472 [7:34:12<22:35:57,  3.40it/s]
 26%|██▌       | 95152/371472 [7:34:12<22:28:12,  3.42it/s]
 26%|██▌       | 95153/371472 [7:34:12<21:24:05,  3.59it/s]
 26%|██▌       | 95154/371472 [7:34:12<22:19:58,  3.44it/s]
 26%|██▌       | 95155/371472 [7:34:13<21:28:45,  3.57it/s]
 26%|██▌       | 95156/371472 [7:34:13<21:26:18,  3.58it/s]
 26%|██▌       | 95157/371472 [7:34:13<21:23:35,  3.59it/s]
 26%|██▌       | 95158/371472 [7:34:13<21:07:54,  3.63it/s]
 26%|██▌       | 95159/371472 [7:34:14<20:56:58,  3.66it/s]
 26%|██▌       | 95160/371472 [7:34:14<21:17:41,  3.60it/s]
                                                           
{'loss': 3.7001, 'learning_rate': 7.698075804262105e-07, 'epoch': 4.1}

 26%|██▌       | 95160/371472 [7:34:14<21:17:41,  3.60it/s]
 26%|██▌       | 95161/371472 [7:34:14<22:13:09,  3.45it/s]
 26%|██▌       | 95162/371472 [7:34:15<24:46:27,  3.10it/s]
 26%|██▌       | 95163/371472 [7:34:15<24:03:46,  3.19it/s]
 26%|██▌       | 95164/371472 [7:34:15<23:46:00,  3.23it/s]
 26%|██▌       | 95165/371472 [7:34:16<23:56:36,  3.21it/s]
 26%|██▌       | 95166/371472 [7:34:16<24:07:30,  3.18it/s]
 26%|██▌       | 95167/371472 [7:34:16<23:24:11,  3.28it/s]
 26%|██▌       | 95168/371472 [7:34:17<23:59:18,  3.20it/s]
 26%|██▌       | 95169/371472 [7:34:17<22:46:24,  3.37it/s]
 26%|██▌       | 95170/371472 [7:34:17<22:25:33,  3.42it/s]
 26%|██▌       | 95171/371472 [7:34:17<22:09:54,  3.46it/s]
 26%|██▌       | 95172/371472 [7:34:18<21:12:32,  3.62it/s]
 26%|██▌       | 95173/371472 [7:34:18<20:46:23,  3.69it/s]
 26%|██▌       | 95174/371472 [7:34:18<22:18:05,  3.44it/s]
 26%|██▌       | 95175/371472 [7:34:19<22:40:58,  3.38it/s]
 26%|██▌       | 95176/371472 [7:34:19<23:49:25,  3.22it/s]
 26%|██▌       | 95177/371472 [7:34:19<22:47:21,  3.37it/s]
 26%|██▌       | 95178/371472 [7:34:19<22:19:51,  3.44it/s]
 26%|██▌       | 95179/371472 [7:34:20<21:42:23,  3.54it/s]
 26%|██▌       | 95180/371472 [7:34:20<20:46:46,  3.69it/s]
                                                           
{'loss': 3.6158, 'learning_rate': 7.697590984507315e-07, 'epoch': 4.1}

 26%|██▌       | 95180/371472 [7:34:20<20:46:46,  3.69it/s]
 26%|██▌       | 95181/371472 [7:34:20<21:39:13,  3.54it/s]
 26%|██▌       | 95182/371472 [7:34:21<22:17:39,  3.44it/s]
 26%|██▌       | 95183/371472 [7:34:21<22:02:15,  3.48it/s]
 26%|██▌       | 95184/371472 [7:34:21<21:11:51,  3.62it/s]
 26%|██▌       | 95185/371472 [7:34:21<22:33:03,  3.40it/s]
 26%|██▌       | 95186/371472 [7:34:22<22:39:45,  3.39it/s]
 26%|██▌       | 95187/371472 [7:34:22<22:22:37,  3.43it/s]
 26%|██▌       | 95188/371472 [7:34:22<22:14:59,  3.45it/s]
 26%|██▌       | 95189/371472 [7:34:23<22:17:25,  3.44it/s]
 26%|██▌       | 95190/371472 [7:34:23<23:39:36,  3.24it/s]
 26%|██▌       | 95191/371472 [7:34:23<22:11:08,  3.46it/s]
 26%|██▌       | 95192/371472 [7:34:23<21:53:48,  3.50it/s]
 26%|██▌       | 95193/371472 [7:34:24<21:33:01,  3.56it/s]
 26%|██▌       | 95194/371472 [7:34:24<21:16:29,  3.61it/s]
 26%|██▌       | 95195/371472 [7:34:24<21:13:38,  3.62it/s]
 26%|██▌       | 95196/371472 [7:34:25<22:17:28,  3.44it/s]
 26%|██▌       | 95197/371472 [7:34:25<21:52:36,  3.51it/s]
 26%|██▌       | 95198/371472 [7:34:25<21:20:32,  3.60it/s]
 26%|██▌       | 95199/371472 [7:34:25<23:04:31,  3.33it/s]
 26%|██▌       | 95200/371472 [7:34:26<21:53:24,  3.51it/s]
                                                           
{'loss': 3.6288, 'learning_rate': 7.697106164752526e-07, 'epoch': 4.1}

 26%|██▌       | 95200/371472 [7:34:26<21:53:24,  3.51it/s]
 26%|██▌       | 95201/371472 [7:34:26<20:58:59,  3.66it/s]
 26%|██▌       | 95202/371472 [7:34:26<22:15:45,  3.45it/s]
 26%|██▌       | 95203/371472 [7:34:27<21:04:22,  3.64it/s]
 26%|██▌       | 95204/371472 [7:34:27<21:04:18,  3.64it/s]
 26%|██▌       | 95205/371472 [7:34:27<21:15:35,  3.61it/s]
 26%|██▌       | 95206/371472 [7:34:27<20:32:15,  3.74it/s]
 26%|██▌       | 95207/371472 [7:34:28<20:48:23,  3.69it/s]
 26%|██▌       | 95208/371472 [7:34:28<20:02:27,  3.83it/s]
 26%|██▌       | 95209/371472 [7:34:28<20:00:06,  3.84it/s]
 26%|██▌       | 95210/371472 [7:34:28<20:13:50,  3.79it/s]
 26%|██▌       | 95211/371472 [7:34:29<20:25:39,  3.76it/s]
 26%|██▌       | 95212/371472 [7:34:29<20:08:36,  3.81it/s]
 26%|██▌       | 95213/371472 [7:34:29<19:30:17,  3.93it/s]
 26%|██▌       | 95214/371472 [7:34:29<19:19:12,  3.97it/s]
 26%|██▌       | 95215/371472 [7:34:30<19:20:34,  3.97it/s]
 26%|██▌       | 95216/371472 [7:34:30<20:16:26,  3.79it/s]
 26%|██▌       | 95217/371472 [7:34:30<20:43:06,  3.70it/s]
 26%|██▌       | 95218/371472 [7:34:31<20:32:52,  3.73it/s]
 26%|██▌       | 95219/371472 [7:34:31<19:59:07,  3.84it/s]
 26%|██▌       | 95220/371472 [7:34:31<20:11:18,  3.80it/s]
                                                           
{'loss': 3.6396, 'learning_rate': 7.696621344997737e-07, 'epoch': 4.1}

 26%|██▌       | 95220/371472 [7:34:31<20:11:18,  3.80it/s]
 26%|██▌       | 95221/371472 [7:34:31<19:52:33,  3.86it/s]
 26%|██▌       | 95222/371472 [7:34:32<20:42:04,  3.71it/s]
 26%|██▌       | 95223/371472 [7:34:32<20:19:07,  3.78it/s]
 26%|██▌       | 95224/371472 [7:34:32<20:44:56,  3.70it/s]
 26%|██▌       | 95225/371472 [7:34:32<20:53:29,  3.67it/s]
 26%|██▌       | 95226/371472 [7:34:33<19:54:11,  3.86it/s]
 26%|██▌       | 95227/371472 [7:34:33<20:41:41,  3.71it/s]
 26%|██▌       | 95228/371472 [7:34:33<20:54:30,  3.67it/s]
 26%|██▌       | 95229/371472 [7:34:33<21:17:44,  3.60it/s]
 26%|██▌       | 95230/371472 [7:34:34<20:40:49,  3.71it/s]
 26%|██▌       | 95231/371472 [7:34:34<21:23:38,  3.59it/s]
 26%|██▌       | 95232/371472 [7:34:34<21:43:23,  3.53it/s]
 26%|██▌       | 95233/371472 [7:34:35<21:38:01,  3.55it/s]
 26%|██▌       | 95234/371472 [7:34:35<20:39:10,  3.72it/s]
 26%|██▌       | 95235/371472 [7:34:35<20:42:58,  3.70it/s]
 26%|██▌       | 95236/371472 [7:34:35<21:22:27,  3.59it/s]
 26%|██▌       | 95237/371472 [7:34:36<24:34:51,  3.12it/s]
 26%|██▌       | 95238/371472 [7:34:36<25:01:53,  3.07it/s]
 26%|██▌       | 95239/371472 [7:34:36<23:33:40,  3.26it/s]
 26%|██▌       | 95240/371472 [7:34:37<22:41:09,  3.38it/s]
                                                           
{'loss': 3.8677, 'learning_rate': 7.696136525242948e-07, 'epoch': 4.1}

 26%|██▌       | 95240/371472 [7:34:37<22:41:09,  3.38it/s]
 26%|██▌       | 95241/371472 [7:34:37<23:24:06,  3.28it/s]
 26%|██▌       | 95242/371472 [7:34:37<23:05:16,  3.32it/s]
 26%|██▌       | 95243/371472 [7:34:38<22:29:59,  3.41it/s]
 26%|██▌       | 95244/371472 [7:34:38<21:57:02,  3.50it/s]
 26%|██▌       | 95245/371472 [7:34:38<21:08:29,  3.63it/s]
 26%|██▌       | 95246/371472 [7:34:38<21:53:33,  3.50it/s]
 26%|██▌       | 95247/371472 [7:34:39<22:09:30,  3.46it/s]
 26%|██▌       | 95248/371472 [7:34:39<22:03:57,  3.48it/s]
 26%|██▌       | 95249/371472 [7:34:39<21:31:36,  3.56it/s]
 26%|██▌       | 95250/371472 [7:34:40<21:54:16,  3.50it/s]
 26%|██▌       | 95251/371472 [7:34:40<22:25:20,  3.42it/s]
 26%|██▌       | 95252/371472 [7:34:40<22:37:53,  3.39it/s]
 26%|██▌       | 95253/371472 [7:34:40<21:47:03,  3.52it/s]
 26%|██▌       | 95254/371472 [7:34:41<22:02:20,  3.48it/s]
 26%|██▌       | 95255/371472 [7:34:41<21:13:28,  3.62it/s]
 26%|██▌       | 95256/371472 [7:34:41<22:13:43,  3.45it/s]
 26%|██▌       | 95257/371472 [7:34:42<23:14:44,  3.30it/s]
 26%|██▌       | 95258/371472 [7:34:42<22:35:47,  3.40it/s]
 26%|██▌       | 95259/371472 [7:34:42<24:11:23,  3.17it/s]
 26%|██▌       | 95260/371472 [7:34:43<23:50:32,  3.22it/s]
                                                           
{'loss': 3.4926, 'learning_rate': 7.69565170548816e-07, 'epoch': 4.1}

 26%|██▌       | 95260/371472 [7:34:43<23:50:32,  3.22it/s]
 26%|██▌       | 95261/371472 [7:34:43<22:09:32,  3.46it/s]
 26%|██▌       | 95262/371472 [7:34:43<21:52:39,  3.51it/s]
 26%|██▌       | 95263/371472 [7:34:43<21:30:05,  3.57it/s]
 26%|██▌       | 95264/371472 [7:34:44<20:39:13,  3.71it/s]
 26%|██▌       | 95265/371472 [7:34:44<22:08:02,  3.47it/s]
 26%|██▌       | 95266/371472 [7:34:44<22:06:33,  3.47it/s]
 26%|██▌       | 95267/371472 [7:34:44<20:59:35,  3.65it/s]
 26%|██▌       | 95268/371472 [7:34:45<20:01:11,  3.83it/s]
 26%|██▌       | 95269/371472 [7:34:45<20:56:18,  3.66it/s]
 26%|██▌       | 95270/371472 [7:34:45<20:25:48,  3.76it/s]
 26%|██▌       | 95271/371472 [7:34:46<20:56:45,  3.66it/s]
 26%|██▌       | 95272/371472 [7:34:46<20:27:47,  3.75it/s]
 26%|██▌       | 95273/371472 [7:34:46<21:34:41,  3.56it/s]
 26%|██▌       | 95274/371472 [7:34:46<20:43:52,  3.70it/s]
 26%|██▌       | 95275/371472 [7:34:47<20:37:06,  3.72it/s]
 26%|██▌       | 95276/371472 [7:34:47<20:35:45,  3.73it/s]
 26%|██▌       | 95277/371472 [7:34:47<21:05:13,  3.64it/s]
 26%|██▌       | 95278/371472 [7:34:47<22:13:20,  3.45it/s]
 26%|██▌       | 95279/371472 [7:34:48<21:25:44,  3.58it/s]
 26%|██▌       | 95280/371472 [7:34:48<20:29:02,  3.75it/s]
                                                           
{'loss': 3.6808, 'learning_rate': 7.695166885733371e-07, 'epoch': 4.1}

 26%|██▌       | 95280/371472 [7:34:48<20:29:02,  3.75it/s]
 26%|██▌       | 95281/371472 [7:34:48<20:56:15,  3.66it/s]
 26%|██▌       | 95282/371472 [7:34:49<21:06:44,  3.63it/s]
 26%|██▌       | 95283/371472 [7:34:49<21:56:29,  3.50it/s]
 26%|██▌       | 95284/371472 [7:34:49<21:34:07,  3.56it/s]
 26%|██▌       | 95285/371472 [7:34:49<22:07:57,  3.47it/s]
 26%|██▌       | 95286/371472 [7:34:50<21:10:32,  3.62it/s]
 26%|██▌       | 95287/371472 [7:34:50<20:41:53,  3.71it/s]
 26%|██▌       | 95288/371472 [7:34:50<20:18:00,  3.78it/s]
 26%|██▌       | 95289/371472 [7:34:50<20:19:46,  3.77it/s]
 26%|██▌       | 95290/371472 [7:34:51<20:32:52,  3.73it/s]
 26%|██▌       | 95291/371472 [7:34:51<20:43:44,  3.70it/s]
 26%|██▌       | 95292/371472 [7:34:51<20:05:34,  3.82it/s]
 26%|██▌       | 95293/371472 [7:34:52<22:01:45,  3.48it/s]
 26%|██▌       | 95294/371472 [7:34:52<21:04:48,  3.64it/s]
 26%|██▌       | 95295/371472 [7:34:52<20:33:43,  3.73it/s]
 26%|██▌       | 95296/371472 [7:34:52<21:17:24,  3.60it/s]
 26%|██▌       | 95297/371472 [7:34:53<22:00:14,  3.49it/s]
 26%|██▌       | 95298/371472 [7:34:53<21:46:23,  3.52it/s]
 26%|██▌       | 95299/371472 [7:34:53<24:12:58,  3.17it/s]
 26%|██▌       | 95300/371472 [7:34:54<22:37:20,  3.39it/s]
                                                           
{'loss': 3.5624, 'learning_rate': 7.694682065978582e-07, 'epoch': 4.1}

 26%|██▌       | 95300/371472 [7:34:54<22:37:20,  3.39it/s]
 26%|██▌       | 95301/371472 [7:34:54<22:22:42,  3.43it/s]
 26%|██▌       | 95302/371472 [7:34:54<24:07:40,  3.18it/s]
 26%|██▌       | 95303/371472 [7:34:55<23:26:48,  3.27it/s]
 26%|██▌       | 95304/371472 [7:34:55<23:10:26,  3.31it/s]
 26%|██▌       | 95305/371472 [7:34:55<22:45:09,  3.37it/s]
 26%|██▌       | 95306/371472 [7:34:55<21:48:41,  3.52it/s]
 26%|██▌       | 95307/371472 [7:34:56<23:34:38,  3.25it/s]
 26%|██▌       | 95308/371472 [7:34:56<23:33:04,  3.26it/s]
 26%|██▌       | 95309/371472 [7:34:56<22:11:33,  3.46it/s]
 26%|██▌       | 95310/371472 [7:34:57<22:30:40,  3.41it/s]
 26%|██▌       | 95311/371472 [7:34:57<21:36:53,  3.55it/s]
 26%|██▌       | 95312/371472 [7:34:57<21:02:42,  3.65it/s]
 26%|██▌       | 95313/371472 [7:34:57<22:40:48,  3.38it/s]
 26%|██▌       | 95314/371472 [7:34:58<22:00:26,  3.49it/s]
 26%|██▌       | 95315/371472 [7:34:58<21:23:29,  3.59it/s]
 26%|██▌       | 95316/371472 [7:34:58<21:25:05,  3.58it/s]
 26%|██▌       | 95317/371472 [7:34:58<20:36:01,  3.72it/s]
 26%|██▌       | 95318/371472 [7:34:59<21:02:24,  3.65it/s]
 26%|██▌       | 95319/371472 [7:34:59<21:02:53,  3.64it/s]
 26%|██▌       | 95320/371472 [7:34:59<20:36:47,  3.72it/s]
                                                           
{'loss': 3.4057, 'learning_rate': 7.694197246223792e-07, 'epoch': 4.11}

 26%|██▌       | 95320/371472 [7:34:59<20:36:47,  3.72it/s]
 26%|██▌       | 95321/371472 [7:35:00<20:28:30,  3.75it/s]
 26%|██▌       | 95322/371472 [7:35:00<22:20:26,  3.43it/s]
 26%|██▌       | 95323/371472 [7:35:00<21:10:18,  3.62it/s]
 26%|██▌       | 95324/371472 [7:35:00<20:12:40,  3.80it/s]
 26%|██▌       | 95325/371472 [7:35:01<19:48:06,  3.87it/s]
 26%|██▌       | 95326/371472 [7:35:01<20:53:43,  3.67it/s]
 26%|██▌       | 95327/371472 [7:35:01<20:31:32,  3.74it/s]
 26%|██▌       | 95328/371472 [7:35:01<20:53:22,  3.67it/s]
 26%|██▌       | 95329/371472 [7:35:02<19:58:52,  3.84it/s]
 26%|██▌       | 95330/371472 [7:35:02<19:56:47,  3.85it/s]
 26%|██▌       | 95331/371472 [7:35:02<21:06:52,  3.63it/s]
 26%|██▌       | 95332/371472 [7:35:03<20:44:12,  3.70it/s]
 26%|██▌       | 95333/371472 [7:35:03<20:31:30,  3.74it/s]
 26%|██▌       | 95334/371472 [7:35:03<20:18:37,  3.78it/s]
 26%|██▌       | 95335/371472 [7:35:03<20:12:32,  3.80it/s]
 26%|██▌       | 95336/371472 [7:35:04<20:02:00,  3.83it/s]
 26%|██▌       | 95337/371472 [7:35:04<20:42:24,  3.70it/s]
 26%|██▌       | 95338/371472 [7:35:04<20:33:29,  3.73it/s]
 26%|██▌       | 95339/371472 [7:35:04<20:31:22,  3.74it/s]
 26%|██▌       | 95340/371472 [7:35:05<22:27:52,  3.41it/s]
                                                           
{'loss': 3.5641, 'learning_rate': 7.693712426469003e-07, 'epoch': 4.11}

 26%|██▌       | 95340/371472 [7:35:05<22:27:52,  3.41it/s]
 26%|██▌       | 95341/371472 [7:35:05<21:55:28,  3.50it/s]
 26%|██▌       | 95342/371472 [7:35:05<21:03:47,  3.64it/s]
 26%|██▌       | 95343/371472 [7:35:06<22:17:34,  3.44it/s]
 26%|██▌       | 95344/371472 [7:35:06<22:14:57,  3.45it/s]
 26%|██▌       | 95345/371472 [7:35:06<22:27:01,  3.42it/s]
 26%|██▌       | 95346/371472 [7:35:06<21:22:30,  3.59it/s]
 26%|██▌       | 95347/371472 [7:35:07<20:53:06,  3.67it/s]
 26%|██▌       | 95348/371472 [7:35:07<20:40:56,  3.71it/s]
 26%|██▌       | 95349/371472 [7:35:07<20:14:49,  3.79it/s]
 26%|██▌       | 95350/371472 [7:35:08<21:45:07,  3.53it/s]
 26%|██▌       | 95351/371472 [7:35:08<20:37:18,  3.72it/s]
 26%|██▌       | 95352/371472 [7:35:08<21:23:29,  3.59it/s]
 26%|██▌       | 95353/371472 [7:35:08<21:31:34,  3.56it/s]
 26%|██▌       | 95354/371472 [7:35:09<20:56:19,  3.66it/s]
 26%|██▌       | 95355/371472 [7:35:09<20:35:23,  3.73it/s]
 26%|██▌       | 95356/371472 [7:35:09<20:41:52,  3.71it/s]
 26%|██▌       | 95357/371472 [7:35:09<20:18:22,  3.78it/s]
 26%|██▌       | 95358/371472 [7:35:10<20:09:07,  3.81it/s]
 26%|██▌       | 95359/371472 [7:35:10<19:50:24,  3.87it/s]
 26%|██▌       | 95360/371472 [7:35:10<19:20:03,  3.97it/s]
                                                           
{'loss': 3.6686, 'learning_rate': 7.693227606714214e-07, 'epoch': 4.11}

 26%|██▌       | 95360/371472 [7:35:10<19:20:03,  3.97it/s]
 26%|██▌       | 95361/371472 [7:35:10<19:04:26,  4.02it/s]
 26%|██▌       | 95362/371472 [7:35:11<19:49:57,  3.87it/s]
 26%|██▌       | 95363/371472 [7:35:11<21:45:15,  3.53it/s]
 26%|██▌       | 95364/371472 [7:35:11<21:15:57,  3.61it/s]
 26%|██▌       | 95365/371472 [7:35:12<23:10:13,  3.31it/s]
 26%|██▌       | 95366/371472 [7:35:12<23:19:44,  3.29it/s]
 26%|██▌       | 95367/371472 [7:35:12<23:32:31,  3.26it/s]
 26%|██▌       | 95368/371472 [7:35:13<23:31:47,  3.26it/s]
 26%|██▌       | 95369/371472 [7:35:13<23:50:30,  3.22it/s]
 26%|██▌       | 95370/371472 [7:35:13<23:29:59,  3.26it/s]
 26%|██▌       | 95371/371472 [7:35:13<22:47:29,  3.37it/s]
 26%|██▌       | 95372/371472 [7:35:14<21:32:54,  3.56it/s]
 26%|██▌       | 95373/371472 [7:35:14<21:20:16,  3.59it/s]
 26%|██▌       | 95374/371472 [7:35:14<23:37:47,  3.25it/s]
 26%|██▌       | 95375/371472 [7:35:15<24:24:48,  3.14it/s]
 26%|██▌       | 95376/371472 [7:35:15<22:36:54,  3.39it/s]
 26%|██▌       | 95377/371472 [7:35:15<23:14:34,  3.30it/s]
 26%|██▌       | 95378/371472 [7:35:16<23:29:22,  3.26it/s]
 26%|██▌       | 95379/371472 [7:35:16<23:15:08,  3.30it/s]
 26%|██▌       | 95380/371472 [7:35:16<22:21:55,  3.43it/s]
                                                           
{'loss': 3.658, 'learning_rate': 7.692742786959426e-07, 'epoch': 4.11}

 26%|██▌       | 95380/371472 [7:35:16<22:21:55,  3.43it/s]
 26%|██▌       | 95381/371472 [7:35:16<23:10:20,  3.31it/s]
 26%|██▌       | 95382/371472 [7:35:17<22:13:16,  3.45it/s]
 26%|██▌       | 95383/371472 [7:35:17<21:25:13,  3.58it/s]
 26%|██▌       | 95384/371472 [7:35:17<20:51:12,  3.68it/s]
 26%|██▌       | 95385/371472 [7:35:18<21:16:25,  3.60it/s]
 26%|██▌       | 95386/371472 [7:35:18<21:25:51,  3.58it/s]
 26%|██▌       | 95387/371472 [7:35:18<20:37:16,  3.72it/s]
 26%|██▌       | 95388/371472 [7:35:18<20:36:17,  3.72it/s]
 26%|██▌       | 95389/371472 [7:35:19<20:24:37,  3.76it/s]
 26%|██▌       | 95390/371472 [7:35:19<20:38:57,  3.71it/s]
 26%|██▌       | 95391/371472 [7:35:19<20:43:59,  3.70it/s]
 26%|██▌       | 95392/371472 [7:35:19<20:44:26,  3.70it/s]
 26%|██▌       | 95393/371472 [7:35:20<20:32:11,  3.73it/s]
 26%|██▌       | 95394/371472 [7:35:20<20:04:17,  3.82it/s]
 26%|██▌       | 95395/371472 [7:35:20<21:23:49,  3.58it/s]
 26%|██▌       | 95396/371472 [7:35:21<23:11:59,  3.31it/s]
 26%|██▌       | 95397/371472 [7:35:21<22:12:31,  3.45it/s]
 26%|██▌       | 95398/371472 [7:35:21<21:44:18,  3.53it/s]
 26%|██▌       | 95399/371472 [7:35:22<24:55:18,  3.08it/s]
 26%|██▌       | 95400/371472 [7:35:22<23:32:01,  3.26it/s]
                                                           
{'loss': 3.6373, 'learning_rate': 7.692257967204637e-07, 'epoch': 4.11}

 26%|██▌       | 95400/371472 [7:35:22<23:32:01,  3.26it/s]
 26%|██▌       | 95401/371472 [7:35:22<23:07:23,  3.32it/s]
 26%|██▌       | 95402/371472 [7:35:22<24:06:01,  3.18it/s]
 26%|██▌       | 95403/371472 [7:35:23<23:22:13,  3.28it/s]
 26%|██▌       | 95404/371472 [7:35:23<22:10:43,  3.46it/s]
 26%|██▌       | 95405/371472 [7:35:23<23:03:05,  3.33it/s]
 26%|██▌       | 95406/371472 [7:35:24<22:14:42,  3.45it/s]
 26%|██▌       | 95407/371472 [7:35:24<22:09:29,  3.46it/s]
 26%|██▌       | 95408/371472 [7:35:24<21:56:10,  3.50it/s]
 26%|██▌       | 95409/371472 [7:35:24<22:01:23,  3.48it/s]
 26%|██▌       | 95410/371472 [7:35:25<21:31:34,  3.56it/s]
 26%|██▌       | 95411/371472 [7:35:25<20:58:34,  3.66it/s]
 26%|██▌       | 95412/371472 [7:35:25<21:53:46,  3.50it/s]
 26%|██▌       | 95413/371472 [7:35:26<21:51:30,  3.51it/s]
 26%|██▌       | 95414/371472 [7:35:26<22:27:29,  3.41it/s]
 26%|██▌       | 95415/371472 [7:35:26<21:41:21,  3.54it/s]
 26%|██▌       | 95416/371472 [7:35:26<22:04:05,  3.47it/s]
 26%|██▌       | 95417/371472 [7:35:27<24:21:36,  3.15it/s]
 26%|██▌       | 95418/371472 [7:35:27<26:54:55,  2.85it/s]
 26%|██▌       | 95419/371472 [7:35:27<24:36:19,  3.12it/s]
 26%|██▌       | 95420/371472 [7:35:28<23:21:02,  3.28it/s]
                                                           
{'loss': 3.6582, 'learning_rate': 7.691773147449848e-07, 'epoch': 4.11}

 26%|██▌       | 95420/371472 [7:35:28<23:21:02,  3.28it/s]
 26%|██▌       | 95421/371472 [7:35:28<22:25:57,  3.42it/s]
 26%|██▌       | 95422/371472 [7:35:28<23:04:35,  3.32it/s]
 26%|██▌       | 95423/371472 [7:35:29<22:46:47,  3.37it/s]
 26%|██▌       | 95424/371472 [7:35:29<21:43:21,  3.53it/s]
 26%|██▌       | 95425/371472 [7:35:29<21:29:34,  3.57it/s]
 26%|██▌       | 95426/371472 [7:35:29<21:13:36,  3.61it/s]
 26%|██▌       | 95427/371472 [7:35:30<22:26:10,  3.42it/s]
 26%|██▌       | 95428/371472 [7:35:30<21:56:21,  3.50it/s]
 26%|██▌       | 95429/371472 [7:35:30<22:10:29,  3.46it/s]
 26%|██▌       | 95430/371472 [7:35:31<22:07:10,  3.47it/s]
 26%|██▌       | 95431/371472 [7:35:31<22:45:38,  3.37it/s]
 26%|██▌       | 95432/371472 [7:35:31<23:00:49,  3.33it/s]
 26%|██▌       | 95433/371472 [7:35:31<21:55:49,  3.50it/s]
 26%|██▌       | 95434/371472 [7:35:32<21:11:49,  3.62it/s]
 26%|██▌       | 95435/371472 [7:35:32<21:05:25,  3.64it/s]
 26%|██▌       | 95436/371472 [7:35:32<20:55:10,  3.67it/s]
 26%|██▌       | 95437/371472 [7:35:32<20:04:14,  3.82it/s]
 26%|██▌       | 95438/371472 [7:35:33<19:41:19,  3.89it/s]
 26%|██▌       | 95439/371472 [7:35:33<19:37:14,  3.91it/s]
 26%|██▌       | 95440/371472 [7:35:33<20:05:59,  3.81it/s]
                                                           
{'loss': 3.6382, 'learning_rate': 7.691288327695058e-07, 'epoch': 4.11}

 26%|██▌       | 95440/371472 [7:35:33<20:05:59,  3.81it/s]
 26%|██▌       | 95441/371472 [7:35:34<20:58:54,  3.65it/s]
 26%|██▌       | 95442/371472 [7:35:34<20:52:03,  3.67it/s]
 26%|██▌       | 95443/371472 [7:35:34<20:32:30,  3.73it/s]
 26%|██▌       | 95444/371472 [7:35:34<20:56:57,  3.66it/s]
 26%|██▌       | 95445/371472 [7:35:35<20:28:58,  3.74it/s]
 26%|██▌       | 95446/371472 [7:35:35<21:03:00,  3.64it/s]
 26%|██▌       | 95447/371472 [7:35:35<21:00:51,  3.65it/s]
 26%|██▌       | 95448/371472 [7:35:35<20:07:52,  3.81it/s]
 26%|██▌       | 95449/371472 [7:35:36<20:33:11,  3.73it/s]
 26%|██▌       | 95450/371472 [7:35:36<20:59:44,  3.65it/s]
 26%|██▌       | 95451/371472 [7:35:36<21:08:04,  3.63it/s]
 26%|██▌       | 95452/371472 [7:35:37<21:08:17,  3.63it/s]
 26%|██▌       | 95453/371472 [7:35:37<22:14:27,  3.45it/s]
 26%|██▌       | 95454/371472 [7:35:37<23:19:16,  3.29it/s]
 26%|██▌       | 95455/371472 [7:35:37<22:09:44,  3.46it/s]
 26%|██▌       | 95456/371472 [7:35:38<21:24:01,  3.58it/s]
 26%|██▌       | 95457/371472 [7:35:38<22:00:14,  3.48it/s]
 26%|██▌       | 95458/371472 [7:35:38<21:45:50,  3.52it/s]
 26%|██▌       | 95459/371472 [7:35:39<23:31:45,  3.26it/s]
 26%|██▌       | 95460/371472 [7:35:39<23:31:46,  3.26it/s]
                                                           
{'loss': 3.4615, 'learning_rate': 7.69080350794027e-07, 'epoch': 4.11}

 26%|██▌       | 95460/371472 [7:35:39<23:31:46,  3.26it/s]
 26%|██▌       | 95461/371472 [7:35:39<23:06:41,  3.32it/s]
 26%|██▌       | 95462/371472 [7:35:40<22:42:30,  3.38it/s]
 26%|██▌       | 95463/371472 [7:35:40<21:18:16,  3.60it/s]
 26%|██▌       | 95464/371472 [7:35:40<21:43:28,  3.53it/s]
 26%|██▌       | 95465/371472 [7:35:40<21:42:02,  3.53it/s]
 26%|██▌       | 95466/371472 [7:35:41<22:09:19,  3.46it/s]
 26%|██▌       | 95467/371472 [7:35:41<21:36:57,  3.55it/s]
 26%|██▌       | 95468/371472 [7:35:41<21:04:49,  3.64it/s]
 26%|██▌       | 95469/371472 [7:35:41<21:15:15,  3.61it/s]
 26%|██▌       | 95470/371472 [7:35:42<21:08:27,  3.63it/s]
 26%|██▌       | 95471/371472 [7:35:42<21:03:05,  3.64it/s]
 26%|██▌       | 95472/371472 [7:35:42<22:47:15,  3.36it/s]
 26%|██▌       | 95473/371472 [7:35:43<22:21:08,  3.43it/s]
 26%|██▌       | 95474/371472 [7:35:43<21:52:29,  3.50it/s]
 26%|██▌       | 95475/371472 [7:35:43<21:12:29,  3.61it/s]
 26%|██▌       | 95476/371472 [7:35:43<21:08:54,  3.63it/s]
 26%|██▌       | 95477/371472 [7:35:44<21:20:28,  3.59it/s]
 26%|██▌       | 95478/371472 [7:35:44<21:26:59,  3.57it/s]
 26%|██▌       | 95479/371472 [7:35:44<20:57:20,  3.66it/s]
 26%|██▌       | 95480/371472 [7:35:45<20:38:11,  3.71it/s]
                                                           
{'loss': 3.7458, 'learning_rate': 7.690318688185481e-07, 'epoch': 4.11}

 26%|██▌       | 95480/371472 [7:35:45<20:38:11,  3.71it/s]
 26%|██▌       | 95481/371472 [7:35:45<20:39:55,  3.71it/s]
 26%|██▌       | 95482/371472 [7:35:45<20:35:26,  3.72it/s]
 26%|██▌       | 95483/371472 [7:35:45<20:30:18,  3.74it/s]
 26%|██▌       | 95484/371472 [7:35:46<20:45:07,  3.69it/s]
 26%|██▌       | 95485/371472 [7:35:46<20:28:37,  3.74it/s]
 26%|██▌       | 95486/371472 [7:35:46<21:27:34,  3.57it/s]
 26%|██▌       | 95487/371472 [7:35:46<20:47:59,  3.69it/s]
 26%|██▌       | 95488/371472 [7:35:47<20:32:09,  3.73it/s]
 26%|██▌       | 95489/371472 [7:35:47<20:23:24,  3.76it/s]
 26%|██▌       | 95490/371472 [7:35:47<20:12:56,  3.79it/s]
 26%|██▌       | 95491/371472 [7:35:47<20:44:27,  3.70it/s]
 26%|██▌       | 95492/371472 [7:35:48<21:10:15,  3.62it/s]
 26%|██▌       | 95493/371472 [7:35:48<21:46:38,  3.52it/s]
 26%|██▌       | 95494/371472 [7:35:48<22:10:38,  3.46it/s]
 26%|██▌       | 95495/371472 [7:35:49<21:53:46,  3.50it/s]
 26%|██▌       | 95496/371472 [7:35:49<21:33:33,  3.56it/s]
 26%|██▌       | 95497/371472 [7:35:49<22:40:45,  3.38it/s]
 26%|██▌       | 95498/371472 [7:35:50<21:51:10,  3.51it/s]
 26%|██▌       | 95499/371472 [7:35:50<21:54:30,  3.50it/s]
 26%|██▌       | 95500/371472 [7:35:50<21:14:08,  3.61it/s]
                                                           
{'loss': 3.6824, 'learning_rate': 7.689833868430692e-07, 'epoch': 4.11}

 26%|██▌       | 95500/371472 [7:35:50<21:14:08,  3.61it/s]
 26%|██▌       | 95501/371472 [7:35:50<20:41:03,  3.71it/s]
 26%|██▌       | 95502/371472 [7:35:51<21:38:48,  3.54it/s]
 26%|██▌       | 95503/371472 [7:35:51<21:39:17,  3.54it/s]
 26%|██▌       | 95504/371472 [7:35:51<21:32:07,  3.56it/s]
 26%|██▌       | 95505/371472 [7:35:52<24:19:15,  3.15it/s]
 26%|██▌       | 95506/371472 [7:35:52<22:37:26,  3.39it/s]
 26%|██▌       | 95507/371472 [7:35:52<21:25:05,  3.58it/s]
 26%|██▌       | 95508/371472 [7:35:52<20:38:56,  3.71it/s]
 26%|██▌       | 95509/371472 [7:35:53<20:36:02,  3.72it/s]
 26%|██▌       | 95510/371472 [7:35:53<20:08:09,  3.81it/s]
 26%|██▌       | 95511/371472 [7:35:53<20:34:25,  3.73it/s]
 26%|██▌       | 95512/371472 [7:35:53<20:17:24,  3.78it/s]
 26%|██▌       | 95513/371472 [7:35:54<21:46:39,  3.52it/s]
 26%|██▌       | 95514/371472 [7:35:54<21:00:10,  3.65it/s]
 26%|██▌       | 95515/371472 [7:35:54<20:23:34,  3.76it/s]
 26%|██▌       | 95516/371472 [7:35:54<20:32:30,  3.73it/s]
 26%|██▌       | 95517/371472 [7:35:55<20:22:32,  3.76it/s]
 26%|██▌       | 95518/371472 [7:35:55<21:24:43,  3.58it/s]
 26%|██▌       | 95519/371472 [7:35:55<21:25:46,  3.58it/s]
 26%|██▌       | 95520/371472 [7:35:56<22:22:33,  3.43it/s]
                                                           
{'loss': 3.6806, 'learning_rate': 7.689349048675903e-07, 'epoch': 4.11}

 26%|██▌       | 95520/371472 [7:35:56<22:22:33,  3.43it/s]
 26%|██▌       | 95521/371472 [7:35:56<22:25:48,  3.42it/s]
 26%|██▌       | 95522/371472 [7:35:56<22:09:45,  3.46it/s]
 26%|██▌       | 95523/371472 [7:35:57<22:45:40,  3.37it/s]
 26%|██▌       | 95524/371472 [7:35:57<22:12:36,  3.45it/s]
 26%|██▌       | 95525/371472 [7:35:57<21:57:57,  3.49it/s]
 26%|██▌       | 95526/371472 [7:35:57<22:02:06,  3.48it/s]
 26%|██▌       | 95527/371472 [7:35:58<21:33:12,  3.56it/s]
 26%|██▌       | 95528/371472 [7:35:58<23:29:22,  3.26it/s]
 26%|██▌       | 95529/371472 [7:35:58<23:37:37,  3.24it/s]
 26%|██▌       | 95530/371472 [7:35:59<22:33:09,  3.40it/s]
 26%|██▌       | 95531/371472 [7:35:59<22:02:11,  3.48it/s]
 26%|██▌       | 95532/371472 [7:35:59<21:19:35,  3.59it/s]
 26%|██▌       | 95533/371472 [7:35:59<22:44:00,  3.37it/s]
 26%|██▌       | 95534/371472 [7:36:00<21:27:33,  3.57it/s]
 26%|██▌       | 95535/371472 [7:36:00<20:18:30,  3.77it/s]
 26%|██▌       | 95536/371472 [7:36:00<20:26:25,  3.75it/s]
 26%|██▌       | 95537/371472 [7:36:00<20:01:48,  3.83it/s]
 26%|██▌       | 95538/371472 [7:36:01<19:57:34,  3.84it/s]
 26%|██▌       | 95539/371472 [7:36:01<21:33:45,  3.55it/s]
 26%|██▌       | 95540/371472 [7:36:01<21:23:40,  3.58it/s]
                                                           
{'loss': 3.6325, 'learning_rate': 7.688864228921114e-07, 'epoch': 4.12}

 26%|██▌       | 95540/371472 [7:36:01<21:23:40,  3.58it/s]
 26%|██▌       | 95541/371472 [7:36:02<21:48:47,  3.51it/s]
 26%|██▌       | 95542/371472 [7:36:02<22:00:32,  3.48it/s]
 26%|██▌       | 95543/371472 [7:36:02<20:59:04,  3.65it/s]
 26%|██▌       | 95544/371472 [7:36:02<21:13:50,  3.61it/s]
 26%|██▌       | 95545/371472 [7:36:03<21:01:00,  3.65it/s]
 26%|██▌       | 95546/371472 [7:36:03<21:10:41,  3.62it/s]
 26%|██▌       | 95547/371472 [7:36:03<21:39:38,  3.54it/s]
 26%|██▌       | 95548/371472 [7:36:04<21:10:32,  3.62it/s]
 26%|██▌       | 95549/371472 [7:36:04<20:28:33,  3.74it/s]
 26%|██▌       | 95550/371472 [7:36:04<19:53:22,  3.85it/s]
 26%|██▌       | 95551/371472 [7:36:04<19:28:42,  3.93it/s]
 26%|██▌       | 95552/371472 [7:36:05<22:39:23,  3.38it/s]
 26%|██▌       | 95553/371472 [7:36:05<22:32:24,  3.40it/s]
 26%|██▌       | 95554/371472 [7:36:05<21:23:56,  3.58it/s]
 26%|██▌       | 95555/371472 [7:36:05<20:55:45,  3.66it/s]
 26%|██▌       | 95556/371472 [7:36:06<20:17:55,  3.78it/s]
 26%|██▌       | 95557/371472 [7:36:06<19:33:43,  3.92it/s]
 26%|██▌       | 95558/371472 [7:36:06<20:09:50,  3.80it/s]
 26%|██▌       | 95559/371472 [7:36:07<23:12:32,  3.30it/s]
 26%|██▌       | 95560/371472 [7:36:07<22:28:11,  3.41it/s]
                                                           
{'loss': 3.7223, 'learning_rate': 7.688379409166325e-07, 'epoch': 4.12}

 26%|██▌       | 95560/371472 [7:36:07<22:28:11,  3.41it/s]
 26%|██▌       | 95561/371472 [7:36:07<22:41:48,  3.38it/s]
 26%|██▌       | 95562/371472 [7:36:07<22:02:09,  3.48it/s]
 26%|██▌       | 95563/371472 [7:36:08<20:49:29,  3.68it/s]
 26%|██▌       | 95564/371472 [7:36:08<20:08:54,  3.80it/s]
 26%|██▌       | 95565/371472 [7:36:08<20:56:08,  3.66it/s]
 26%|██▌       | 95566/371472 [7:36:08<20:19:14,  3.77it/s]
 26%|██▌       | 95567/371472 [7:36:09<19:33:56,  3.92it/s]
 26%|██▌       | 95568/371472 [7:36:09<20:36:28,  3.72it/s]
 26%|██▌       | 95569/371472 [7:36:09<20:48:22,  3.68it/s]
 26%|██▌       | 95570/371472 [7:36:10<20:08:00,  3.81it/s]
 26%|██▌       | 95571/371472 [7:36:10<20:07:06,  3.81it/s]
 26%|██▌       | 95572/371472 [7:36:10<19:35:57,  3.91it/s]
 26%|██▌       | 95573/371472 [7:36:10<19:14:33,  3.98it/s]
 26%|██▌       | 95574/371472 [7:36:11<21:05:56,  3.63it/s]
 26%|██▌       | 95575/371472 [7:36:11<21:34:18,  3.55it/s]
 26%|██▌       | 95576/371472 [7:36:11<21:21:24,  3.59it/s]
 26%|██▌       | 95577/371472 [7:36:11<21:00:38,  3.65it/s]
 26%|██▌       | 95578/371472 [7:36:12<21:15:47,  3.60it/s]
 26%|██▌       | 95579/371472 [7:36:12<22:09:50,  3.46it/s]
 26%|██▌       | 95580/371472 [7:36:12<21:32:43,  3.56it/s]
                                                           
{'loss': 3.6405, 'learning_rate': 7.687894589411536e-07, 'epoch': 4.12}

 26%|██▌       | 95580/371472 [7:36:12<21:32:43,  3.56it/s]
 26%|██▌       | 95581/371472 [7:36:13<21:49:17,  3.51it/s]
 26%|██▌       | 95582/371472 [7:36:13<23:30:50,  3.26it/s]
 26%|██▌       | 95583/371472 [7:36:13<22:30:41,  3.40it/s]
 26%|██▌       | 95584/371472 [7:36:13<21:16:20,  3.60it/s]
 26%|██▌       | 95585/371472 [7:36:14<21:54:27,  3.50it/s]
 26%|██▌       | 95586/371472 [7:36:14<22:53:08,  3.35it/s]
 26%|██▌       | 95587/371472 [7:36:14<25:22:28,  3.02it/s]
 26%|██▌       | 95588/371472 [7:36:15<24:55:22,  3.07it/s]
 26%|██▌       | 95589/371472 [7:36:15<23:11:08,  3.31it/s]
 26%|██▌       | 95590/371472 [7:36:15<22:38:47,  3.38it/s]
 26%|██▌       | 95591/371472 [7:36:16<25:41:46,  2.98it/s]
 26%|██▌       | 95592/371472 [7:36:16<24:51:29,  3.08it/s]
 26%|██▌       | 95593/371472 [7:36:16<23:10:42,  3.31it/s]
 26%|██▌       | 95594/371472 [7:36:17<22:55:53,  3.34it/s]
 26%|██▌       | 95595/371472 [7:36:17<22:23:39,  3.42it/s]
 26%|██▌       | 95596/371472 [7:36:17<21:51:54,  3.50it/s]
 26%|██▌       | 95597/371472 [7:36:17<21:43:06,  3.53it/s]
 26%|██▌       | 95598/371472 [7:36:18<22:06:11,  3.47it/s]
 26%|██▌       | 95599/371472 [7:36:18<21:57:14,  3.49it/s]
 26%|██▌       | 95600/371472 [7:36:18<22:30:52,  3.40it/s]
                                                           
{'loss': 3.4842, 'learning_rate': 7.687409769656747e-07, 'epoch': 4.12}

 26%|██▌       | 95600/371472 [7:36:18<22:30:52,  3.40it/s]
 26%|██▌       | 95601/371472 [7:36:19<21:06:08,  3.63it/s]
 26%|██▌       | 95602/371472 [7:36:19<20:02:16,  3.82it/s]
 26%|██▌       | 95603/371472 [7:36:19<20:42:49,  3.70it/s]
 26%|██▌       | 95604/371472 [7:36:19<20:22:40,  3.76it/s]
 26%|██▌       | 95605/371472 [7:36:20<20:34:15,  3.73it/s]
 26%|██▌       | 95606/371472 [7:36:20<22:40:13,  3.38it/s]
 26%|██▌       | 95607/371472 [7:36:20<22:57:13,  3.34it/s]
 26%|██▌       | 95608/371472 [7:36:21<22:08:40,  3.46it/s]
 26%|██▌       | 95609/371472 [7:36:21<21:21:55,  3.59it/s]
 26%|██▌       | 95610/371472 [7:36:21<20:45:47,  3.69it/s]
 26%|██▌       | 95611/371472 [7:36:21<20:48:35,  3.68it/s]
 26%|██▌       | 95612/371472 [7:36:22<21:02:54,  3.64it/s]
 26%|██▌       | 95613/371472 [7:36:22<20:54:52,  3.66it/s]
 26%|██▌       | 95614/371472 [7:36:22<21:18:24,  3.60it/s]
 26%|██▌       | 95615/371472 [7:36:22<20:48:44,  3.68it/s]
 26%|██▌       | 95616/371472 [7:36:23<20:40:45,  3.71it/s]
 26%|██▌       | 95617/371472 [7:36:23<20:15:58,  3.78it/s]
 26%|██▌       | 95618/371472 [7:36:23<20:32:29,  3.73it/s]
 26%|██▌       | 95619/371472 [7:36:24<21:55:56,  3.49it/s]
 26%|██▌       | 95620/371472 [7:36:24<21:27:39,  3.57it/s]
                                                           
{'loss': 3.6272, 'learning_rate': 7.686924949901958e-07, 'epoch': 4.12}

 26%|██▌       | 95620/371472 [7:36:24<21:27:39,  3.57it/s]
 26%|██▌       | 95621/371472 [7:36:24<21:35:34,  3.55it/s]
 26%|██▌       | 95622/371472 [7:36:24<21:01:29,  3.64it/s]
 26%|██▌       | 95623/371472 [7:36:25<20:31:27,  3.73it/s]
 26%|██▌       | 95624/371472 [7:36:25<20:05:43,  3.81it/s]
 26%|██▌       | 95625/371472 [7:36:25<19:56:51,  3.84it/s]
 26%|██▌       | 95626/371472 [7:36:25<20:01:03,  3.83it/s]
 26%|██▌       | 95627/371472 [7:36:26<19:35:31,  3.91it/s]
 26%|██▌       | 95628/371472 [7:36:26<19:34:23,  3.91it/s]
 26%|██▌       | 95629/371472 [7:36:26<20:45:57,  3.69it/s]
 26%|██▌       | 95630/371472 [7:36:27<22:26:37,  3.41it/s]
 26%|██▌       | 95631/371472 [7:36:27<21:33:56,  3.55it/s]
 26%|██▌       | 95632/371472 [7:36:27<21:42:38,  3.53it/s]
 26%|██▌       | 95633/371472 [7:36:27<20:55:08,  3.66it/s]
 26%|██▌       | 95634/371472 [7:36:28<19:59:40,  3.83it/s]
 26%|██▌       | 95635/371472 [7:36:28<19:56:52,  3.84it/s]
 26%|██▌       | 95636/371472 [7:36:28<19:46:56,  3.87it/s]
 26%|██▌       | 95637/371472 [7:36:28<22:27:46,  3.41it/s]
 26%|██▌       | 95638/371472 [7:36:29<21:30:23,  3.56it/s]
 26%|██▌       | 95639/371472 [7:36:29<22:03:24,  3.47it/s]
 26%|██▌       | 95640/371472 [7:36:29<23:44:43,  3.23it/s]
                                                           
{'loss': 3.4975, 'learning_rate': 7.68644013014717e-07, 'epoch': 4.12}

 26%|██▌       | 95640/371472 [7:36:29<23:44:43,  3.23it/s]
 26%|██▌       | 95641/371472 [7:36:30<23:03:25,  3.32it/s]
 26%|██▌       | 95642/371472 [7:36:30<22:41:10,  3.38it/s]
 26%|██▌       | 95643/371472 [7:36:30<23:02:32,  3.33it/s]
 26%|██▌       | 95644/371472 [7:36:31<24:45:44,  3.09it/s]
 26%|██▌       | 95645/371472 [7:36:31<23:16:35,  3.29it/s]
 26%|██▌       | 95646/371472 [7:36:31<22:20:05,  3.43it/s]
 26%|██▌       | 95647/371472 [7:36:31<23:48:28,  3.22it/s]
 26%|██▌       | 95648/371472 [7:36:32<23:35:10,  3.25it/s]
 26%|██▌       | 95649/371472 [7:36:32<22:19:16,  3.43it/s]
 26%|██▌       | 95650/371472 [7:36:32<21:40:48,  3.53it/s]
 26%|██▌       | 95651/371472 [7:36:33<21:43:42,  3.53it/s]
 26%|██▌       | 95652/371472 [7:36:33<21:06:30,  3.63it/s]
 26%|██▌       | 95653/371472 [7:36:33<21:56:07,  3.49it/s]
 26%|██▌       | 95654/371472 [7:36:33<22:03:21,  3.47it/s]
 26%|██▌       | 95655/371472 [7:36:34<21:26:11,  3.57it/s]
 26%|██▌       | 95656/371472 [7:36:34<20:44:51,  3.69it/s]
 26%|██▌       | 95657/371472 [7:36:34<21:17:07,  3.60it/s]
 26%|██▌       | 95658/371472 [7:36:34<20:22:54,  3.76it/s]
 26%|██▌       | 95659/371472 [7:36:35<21:05:38,  3.63it/s]
 26%|██▌       | 95660/371472 [7:36:35<22:20:39,  3.43it/s]
                                                           
{'loss': 3.5477, 'learning_rate': 7.685955310392381e-07, 'epoch': 4.12}

 26%|██▌       | 95660/371472 [7:36:35<22:20:39,  3.43it/s]
 26%|██▌       | 95661/371472 [7:36:35<22:23:34,  3.42it/s]
 26%|██▌       | 95662/371472 [7:36:36<21:17:37,  3.60it/s]
 26%|██▌       | 95663/371472 [7:36:36<20:29:27,  3.74it/s]
 26%|██▌       | 95664/371472 [7:36:36<20:52:08,  3.67it/s]
 26%|██▌       | 95665/371472 [7:36:36<20:42:32,  3.70it/s]
 26%|██▌       | 95666/371472 [7:36:37<20:35:56,  3.72it/s]
 26%|██▌       | 95667/371472 [7:36:37<20:10:05,  3.80it/s]
 26%|██▌       | 95668/371472 [7:36:37<21:31:39,  3.56it/s]
 26%|██▌       | 95669/371472 [7:36:38<21:44:14,  3.52it/s]
 26%|██▌       | 95670/371472 [7:36:38<22:01:50,  3.48it/s]
 26%|██▌       | 95671/371472 [7:36:38<21:38:44,  3.54it/s]
 26%|██▌       | 95672/371472 [7:36:38<21:25:29,  3.58it/s]
 26%|██▌       | 95673/371472 [7:36:39<20:42:07,  3.70it/s]
 26%|██▌       | 95674/371472 [7:36:39<20:32:23,  3.73it/s]
 26%|██▌       | 95675/371472 [7:36:39<21:22:58,  3.58it/s]
 26%|██▌       | 95676/371472 [7:36:40<23:09:37,  3.31it/s]
 26%|██▌       | 95677/371472 [7:36:40<22:15:35,  3.44it/s]
 26%|██▌       | 95678/371472 [7:36:40<23:21:10,  3.28it/s]
 26%|██▌       | 95679/371472 [7:36:40<22:08:00,  3.46it/s]
 26%|██▌       | 95680/371472 [7:36:41<21:14:10,  3.61it/s]
                                                           
{'loss': 3.7781, 'learning_rate': 7.685470490637592e-07, 'epoch': 4.12}

 26%|██▌       | 95680/371472 [7:36:41<21:14:10,  3.61it/s]
 26%|██▌       | 95681/371472 [7:36:41<20:55:30,  3.66it/s]
 26%|██▌       | 95682/371472 [7:36:41<22:41:34,  3.38it/s]
 26%|██▌       | 95683/371472 [7:36:42<22:05:45,  3.47it/s]
 26%|██▌       | 95684/371472 [7:36:42<24:52:18,  3.08it/s]
 26%|██▌       | 95685/371472 [7:36:42<24:40:50,  3.10it/s]
 26%|██▌       | 95686/371472 [7:36:43<23:03:26,  3.32it/s]
 26%|██▌       | 95687/371472 [7:36:43<22:01:32,  3.48it/s]
 26%|██▌       | 95688/371472 [7:36:43<21:53:39,  3.50it/s]
 26%|██▌       | 95689/371472 [7:36:43<21:11:31,  3.61it/s]
 26%|██▌       | 95690/371472 [7:36:44<20:35:20,  3.72it/s]
 26%|██▌       | 95691/371472 [7:36:44<20:04:00,  3.82it/s]
 26%|██▌       | 95692/371472 [7:36:44<20:03:33,  3.82it/s]
 26%|██▌       | 95693/371472 [7:36:44<20:28:32,  3.74it/s]
 26%|██▌       | 95694/371472 [7:36:45<20:33:27,  3.73it/s]
 26%|██▌       | 95695/371472 [7:36:45<20:20:40,  3.77it/s]
 26%|██▌       | 95696/371472 [7:36:45<20:42:17,  3.70it/s]
 26%|██▌       | 95697/371472 [7:36:45<21:27:23,  3.57it/s]
 26%|██▌       | 95698/371472 [7:36:46<21:30:51,  3.56it/s]
 26%|██▌       | 95699/371472 [7:36:46<21:03:03,  3.64it/s]
 26%|██▌       | 95700/371472 [7:36:46<20:31:31,  3.73it/s]
                                                           
{'loss': 3.6428, 'learning_rate': 7.684985670882802e-07, 'epoch': 4.12}

 26%|██▌       | 95700/371472 [7:36:46<20:31:31,  3.73it/s]
 26%|██▌       | 95701/371472 [7:36:47<19:54:08,  3.85it/s]
 26%|██▌       | 95702/371472 [7:36:47<20:16:56,  3.78it/s]
 26%|██▌       | 95703/371472 [7:36:47<22:02:55,  3.47it/s]
 26%|██▌       | 95704/371472 [7:36:47<21:55:19,  3.49it/s]
 26%|██▌       | 95705/371472 [7:36:48<20:45:51,  3.69it/s]
 26%|██▌       | 95706/371472 [7:36:48<22:27:18,  3.41it/s]
 26%|██▌       | 95707/371472 [7:36:48<22:33:47,  3.39it/s]
 26%|██▌       | 95708/371472 [7:36:49<22:00:27,  3.48it/s]
 26%|██▌       | 95709/371472 [7:36:49<21:10:21,  3.62it/s]
 26%|██▌       | 95710/371472 [7:36:49<21:32:14,  3.56it/s]
 26%|██▌       | 95711/371472 [7:36:49<21:31:00,  3.56it/s]
 26%|██▌       | 95712/371472 [7:36:50<22:39:25,  3.38it/s]
 26%|██▌       | 95713/371472 [7:36:50<22:08:53,  3.46it/s]
 26%|██▌       | 95714/371472 [7:36:50<21:31:57,  3.56it/s]
 26%|██▌       | 95715/371472 [7:36:51<20:59:22,  3.65it/s]
 26%|██▌       | 95716/371472 [7:36:51<20:49:25,  3.68it/s]
 26%|██▌       | 95717/371472 [7:36:51<20:27:37,  3.74it/s]
 26%|██▌       | 95718/371472 [7:36:51<21:30:32,  3.56it/s]
 26%|██▌       | 95719/371472 [7:36:52<21:20:35,  3.59it/s]
 26%|██▌       | 95720/371472 [7:36:52<20:56:35,  3.66it/s]
                                                           
{'loss': 3.6195, 'learning_rate': 7.684500851128014e-07, 'epoch': 4.12}

 26%|██▌       | 95720/371472 [7:36:52<20:56:35,  3.66it/s]
 26%|██▌       | 95721/371472 [7:36:52<20:37:27,  3.71it/s]
 26%|██▌       | 95722/371472 [7:36:52<20:21:02,  3.76it/s]
 26%|██▌       | 95723/371472 [7:36:53<21:15:47,  3.60it/s]
 26%|██▌       | 95724/371472 [7:36:53<20:42:43,  3.70it/s]
 26%|██▌       | 95725/371472 [7:36:53<21:13:46,  3.61it/s]
 26%|██▌       | 95726/371472 [7:36:54<20:46:26,  3.69it/s]
 26%|██▌       | 95727/371472 [7:36:54<20:39:40,  3.71it/s]
 26%|██▌       | 95728/371472 [7:36:54<20:10:38,  3.80it/s]
 26%|██▌       | 95729/371472 [7:36:54<20:02:41,  3.82it/s]
 26%|██▌       | 95730/371472 [7:36:55<20:24:41,  3.75it/s]
 26%|██▌       | 95731/371472 [7:36:55<21:52:52,  3.50it/s]
 26%|██▌       | 95732/371472 [7:36:55<22:39:16,  3.38it/s]
 26%|██▌       | 95733/371472 [7:36:55<22:07:21,  3.46it/s]
 26%|██▌       | 95734/371472 [7:36:56<23:22:15,  3.28it/s]
 26%|██▌       | 95735/371472 [7:36:56<23:37:56,  3.24it/s]
 26%|██▌       | 95736/371472 [7:36:56<22:45:18,  3.37it/s]
 26%|██▌       | 95737/371472 [7:36:57<21:20:08,  3.59it/s]
 26%|██▌       | 95738/371472 [7:36:57<21:28:29,  3.57it/s]
 26%|██▌       | 95739/371472 [7:36:57<22:14:42,  3.44it/s]
 26%|██▌       | 95740/371472 [7:36:58<21:42:12,  3.53it/s]
                                                           
{'loss': 3.5773, 'learning_rate': 7.684016031373225e-07, 'epoch': 4.12}

 26%|██▌       | 95740/371472 [7:36:58<21:42:12,  3.53it/s]
 26%|██▌       | 95741/371472 [7:36:58<20:58:05,  3.65it/s]
 26%|██▌       | 95742/371472 [7:36:58<20:58:05,  3.65it/s]
 26%|██▌       | 95743/371472 [7:36:58<21:07:14,  3.63it/s]
 26%|██▌       | 95744/371472 [7:36:59<23:19:08,  3.28it/s]
 26%|██▌       | 95745/371472 [7:36:59<22:06:19,  3.46it/s]
 26%|██▌       | 95746/371472 [7:36:59<21:46:43,  3.52it/s]
 26%|██▌       | 95747/371472 [7:37:00<22:30:38,  3.40it/s]
 26%|██▌       | 95748/371472 [7:37:00<22:39:57,  3.38it/s]
 26%|██▌       | 95749/371472 [7:37:00<23:17:11,  3.29it/s]
 26%|██▌       | 95750/371472 [7:37:00<22:43:52,  3.37it/s]
 26%|██▌       | 95751/371472 [7:37:01<21:36:07,  3.55it/s]
 26%|██▌       | 95752/371472 [7:37:01<21:25:17,  3.58it/s]
 26%|██▌       | 95753/371472 [7:37:01<21:11:41,  3.61it/s]
 26%|██▌       | 95754/371472 [7:37:02<22:32:38,  3.40it/s]
 26%|██▌       | 95755/371472 [7:37:02<21:35:58,  3.55it/s]
 26%|██▌       | 95756/371472 [7:37:02<20:54:55,  3.66it/s]
 26%|██▌       | 95757/371472 [7:37:03<26:49:46,  2.85it/s]
 26%|██▌       | 95758/371472 [7:37:03<25:19:23,  3.02it/s]
 26%|██▌       | 95759/371472 [7:37:03<24:30:05,  3.13it/s]
 26%|██▌       | 95760/371472 [7:37:03<22:42:46,  3.37it/s]
                                                           
{'loss': 3.7106, 'learning_rate': 7.683531211618436e-07, 'epoch': 4.12}

 26%|██▌       | 95760/371472 [7:37:03<22:42:46,  3.37it/s]
 26%|██▌       | 95761/371472 [7:37:04<21:56:40,  3.49it/s]
 26%|██▌       | 95762/371472 [7:37:04<23:29:27,  3.26it/s]
 26%|██▌       | 95763/371472 [7:37:04<22:13:04,  3.45it/s]
 26%|██▌       | 95764/371472 [7:37:05<23:31:35,  3.26it/s]
 26%|██▌       | 95765/371472 [7:37:05<22:13:02,  3.45it/s]
 26%|██▌       | 95766/371472 [7:37:05<21:24:57,  3.58it/s]
 26%|██▌       | 95767/371472 [7:37:05<21:08:02,  3.62it/s]
 26%|██▌       | 95768/371472 [7:37:06<21:56:15,  3.49it/s]
 26%|██▌       | 95769/371472 [7:37:06<21:40:04,  3.53it/s]
 26%|██▌       | 95770/371472 [7:37:06<23:04:09,  3.32it/s]
 26%|██▌       | 95771/371472 [7:37:07<22:17:23,  3.44it/s]
 26%|██▌       | 95772/371472 [7:37:07<21:24:36,  3.58it/s]
 26%|██▌       | 95773/371472 [7:37:07<22:01:18,  3.48it/s]
 26%|██▌       | 95774/371472 [7:37:07<22:10:48,  3.45it/s]
 26%|██▌       | 95775/371472 [7:37:08<21:30:19,  3.56it/s]
 26%|██▌       | 95776/371472 [7:37:08<22:27:41,  3.41it/s]
 26%|██▌       | 95777/371472 [7:37:08<22:43:21,  3.37it/s]
 26%|██▌       | 95778/371472 [7:37:09<23:04:58,  3.32it/s]
 26%|██▌       | 95779/371472 [7:37:09<22:55:35,  3.34it/s]
 26%|██▌       | 95780/371472 [7:37:09<21:21:50,  3.58it/s]
                                                           
{'loss': 3.5037, 'learning_rate': 7.683046391863647e-07, 'epoch': 4.13}

 26%|██▌       | 95780/371472 [7:37:09<21:21:50,  3.58it/s]
 26%|██▌       | 95781/371472 [7:37:09<20:41:59,  3.70it/s]
 26%|██▌       | 95782/371472 [7:37:10<20:19:53,  3.77it/s]
 26%|██▌       | 95783/371472 [7:37:10<20:44:19,  3.69it/s]
 26%|██▌       | 95784/371472 [7:37:10<20:39:02,  3.71it/s]
 26%|██▌       | 95785/371472 [7:37:10<20:17:26,  3.77it/s]
 26%|██▌       | 95786/371472 [7:37:11<21:03:09,  3.64it/s]
 26%|██▌       | 95787/371472 [7:37:11<20:26:23,  3.75it/s]
 26%|██▌       | 95788/371472 [7:37:11<20:09:09,  3.80it/s]
 26%|██▌       | 95789/371472 [7:37:12<20:17:41,  3.77it/s]
 26%|██▌       | 95790/371472 [7:37:12<20:03:27,  3.82it/s]
 26%|██▌       | 95791/371472 [7:37:12<20:53:57,  3.66it/s]
 26%|██▌       | 95792/371472 [7:37:12<20:54:00,  3.66it/s]
 26%|██▌       | 95793/371472 [7:37:13<22:42:39,  3.37it/s]
 26%|██▌       | 95794/371472 [7:37:13<22:51:24,  3.35it/s]
 26%|██▌       | 95795/371472 [7:37:13<22:02:01,  3.48it/s]
 26%|██▌       | 95796/371472 [7:37:14<21:05:37,  3.63it/s]
 26%|██▌       | 95797/371472 [7:37:14<21:25:25,  3.57it/s]
 26%|██▌       | 95798/371472 [7:37:14<21:49:25,  3.51it/s]
 26%|██▌       | 95799/371472 [7:37:14<23:03:12,  3.32it/s]
 26%|██▌       | 95800/371472 [7:37:15<21:35:49,  3.55it/s]
                                                           
{'loss': 3.8348, 'learning_rate': 7.682561572108859e-07, 'epoch': 4.13}

 26%|██▌       | 95800/371472 [7:37:15<21:35:49,  3.55it/s]
 26%|██▌       | 95801/371472 [7:37:15<23:44:18,  3.23it/s]
 26%|██▌       | 95802/371472 [7:37:15<22:37:39,  3.38it/s]
 26%|██▌       | 95803/371472 [7:37:16<22:06:58,  3.46it/s]
 26%|██▌       | 95804/371472 [7:37:16<22:33:33,  3.39it/s]
 26%|██▌       | 95805/371472 [7:37:16<21:27:53,  3.57it/s]
 26%|██▌       | 95806/371472 [7:37:16<21:45:07,  3.52it/s]
 26%|██▌       | 95807/371472 [7:37:17<21:53:11,  3.50it/s]
 26%|██▌       | 95808/371472 [7:37:17<21:24:57,  3.58it/s]
 26%|██▌       | 95809/371472 [7:37:17<22:28:16,  3.41it/s]
 26%|██▌       | 95810/371472 [7:37:18<22:11:14,  3.45it/s]
 26%|██▌       | 95811/371472 [7:37:18<21:38:17,  3.54it/s]
 26%|██▌       | 95812/371472 [7:37:18<21:38:00,  3.54it/s]
 26%|██▌       | 95813/371472 [7:37:18<20:57:49,  3.65it/s]
 26%|██▌       | 95814/371472 [7:37:19<20:06:39,  3.81it/s]
 26%|██▌       | 95815/371472 [7:37:19<20:26:11,  3.75it/s]
 26%|██▌       | 95816/371472 [7:37:19<20:03:22,  3.82it/s]
 26%|██▌       | 95817/371472 [7:37:19<19:54:22,  3.85it/s]
 26%|██▌       | 95818/371472 [7:37:20<19:36:03,  3.91it/s]
 26%|██▌       | 95819/371472 [7:37:20<21:52:35,  3.50it/s]
 26%|██▌       | 95820/371472 [7:37:20<21:34:10,  3.55it/s]
                                                           
{'loss': 3.5621, 'learning_rate': 7.682076752354068e-07, 'epoch': 4.13}

 26%|██▌       | 95820/371472 [7:37:20<21:34:10,  3.55it/s]
 26%|██▌       | 95821/371472 [7:37:21<21:29:43,  3.56it/s]
 26%|██▌       | 95822/371472 [7:37:21<20:40:19,  3.70it/s]
 26%|██▌       | 95823/371472 [7:37:21<20:06:41,  3.81it/s]
 26%|██▌       | 95824/371472 [7:37:21<20:13:59,  3.78it/s]
 26%|██▌       | 95825/371472 [7:37:22<20:34:02,  3.72it/s]
 26%|██▌       | 95826/371472 [7:37:22<21:26:25,  3.57it/s]
 26%|██▌       | 95827/371472 [7:37:22<21:49:28,  3.51it/s]
 26%|██▌       | 95828/371472 [7:37:23<21:43:38,  3.52it/s]
 26%|██▌       | 95829/371472 [7:37:23<22:52:15,  3.35it/s]
 26%|██▌       | 95830/371472 [7:37:23<22:27:14,  3.41it/s]
 26%|██▌       | 95831/371472 [7:37:23<21:58:44,  3.48it/s]
 26%|██▌       | 95832/371472 [7:37:24<20:35:32,  3.72it/s]
 26%|██▌       | 95833/371472 [7:37:24<25:44:08,  2.98it/s]
 26%|██▌       | 95834/371472 [7:37:24<23:42:10,  3.23it/s]
 26%|██▌       | 95835/371472 [7:37:25<22:45:52,  3.36it/s]
 26%|██▌       | 95836/371472 [7:37:25<21:39:47,  3.53it/s]
 26%|██▌       | 95837/371472 [7:37:25<21:49:57,  3.51it/s]
 26%|██▌       | 95838/371472 [7:37:25<21:51:44,  3.50it/s]
 26%|██▌       | 95839/371472 [7:37:26<22:08:53,  3.46it/s]
 26%|██▌       | 95840/371472 [7:37:26<22:10:07,  3.45it/s]
                                                           
{'loss': 3.6296, 'learning_rate': 7.681591932599279e-07, 'epoch': 4.13}

 26%|██▌       | 95840/371472 [7:37:26<22:10:07,  3.45it/s]
 26%|██▌       | 95841/371472 [7:37:26<23:04:48,  3.32it/s]
 26%|██▌       | 95842/371472 [7:37:27<22:22:25,  3.42it/s]
 26%|██▌       | 95843/371472 [7:37:27<23:33:10,  3.25it/s]
 26%|██▌       | 95844/371472 [7:37:27<23:07:58,  3.31it/s]
 26%|██▌       | 95845/371472 [7:37:28<22:29:51,  3.40it/s]
 26%|██▌       | 95846/371472 [7:37:28<22:03:54,  3.47it/s]
 26%|██▌       | 95847/371472 [7:37:28<22:19:16,  3.43it/s]
 26%|██▌       | 95848/371472 [7:37:28<22:02:26,  3.47it/s]
 26%|██▌       | 95849/371472 [7:37:29<20:50:35,  3.67it/s]
 26%|██▌       | 95850/371472 [7:37:29<21:11:40,  3.61it/s]
 26%|██▌       | 95851/371472 [7:37:29<22:47:03,  3.36it/s]
 26%|██▌       | 95852/371472 [7:37:30<22:13:13,  3.45it/s]
 26%|██▌       | 95853/371472 [7:37:30<21:39:45,  3.53it/s]
 26%|██▌       | 95854/371472 [7:37:30<21:40:46,  3.53it/s]
 26%|██▌       | 95855/371472 [7:37:30<22:10:33,  3.45it/s]
 26%|██▌       | 95856/371472 [7:37:31<21:15:32,  3.60it/s]
 26%|██▌       | 95857/371472 [7:37:31<21:01:55,  3.64it/s]
 26%|██▌       | 95858/371472 [7:37:31<21:43:07,  3.53it/s]
 26%|██▌       | 95859/371472 [7:37:32<22:43:07,  3.37it/s]
 26%|██▌       | 95860/371472 [7:37:32<21:57:11,  3.49it/s]
                                                           
{'loss': 3.5148, 'learning_rate': 7.681107112844491e-07, 'epoch': 4.13}

 26%|██▌       | 95860/371472 [7:37:32<21:57:11,  3.49it/s]
 26%|██▌       | 95861/371472 [7:37:32<21:37:30,  3.54it/s]
 26%|██▌       | 95862/371472 [7:37:32<21:50:44,  3.50it/s]
 26%|██▌       | 95863/371472 [7:37:33<21:28:18,  3.57it/s]
 26%|██▌       | 95864/371472 [7:37:33<21:39:57,  3.53it/s]
 26%|██▌       | 95865/371472 [7:37:33<20:48:08,  3.68it/s]
 26%|██▌       | 95866/371472 [7:37:33<20:42:20,  3.70it/s]
 26%|██▌       | 95867/371472 [7:37:34<21:07:35,  3.62it/s]
 26%|██▌       | 95868/371472 [7:37:34<21:01:16,  3.64it/s]
 26%|██▌       | 95869/371472 [7:37:34<20:25:02,  3.75it/s]
 26%|██▌       | 95870/371472 [7:37:35<20:46:32,  3.68it/s]
 26%|██▌       | 95871/371472 [7:37:35<20:38:29,  3.71it/s]
 26%|██▌       | 95872/371472 [7:37:35<24:04:06,  3.18it/s]
 26%|██▌       | 95873/371472 [7:37:36<23:27:04,  3.26it/s]
 26%|██▌       | 95874/371472 [7:37:36<22:26:50,  3.41it/s]
 26%|██▌       | 95875/371472 [7:37:36<22:03:41,  3.47it/s]
 26%|██▌       | 95876/371472 [7:37:36<21:03:09,  3.64it/s]
 26%|██▌       | 95877/371472 [7:37:37<21:01:38,  3.64it/s]
 26%|██▌       | 95878/371472 [7:37:37<20:34:22,  3.72it/s]
 26%|██▌       | 95879/371472 [7:37:37<20:55:10,  3.66it/s]
 26%|██▌       | 95880/371472 [7:37:37<20:39:23,  3.71it/s]
                                                           
{'loss': 3.4836, 'learning_rate': 7.680622293089702e-07, 'epoch': 4.13}

 26%|██▌       | 95880/371472 [7:37:37<20:39:23,  3.71it/s]
 26%|██▌       | 95881/371472 [7:37:38<19:42:03,  3.89it/s]
 26%|██▌       | 95882/371472 [7:37:38<20:46:43,  3.68it/s]
 26%|██▌       | 95883/371472 [7:37:38<20:58:01,  3.65it/s]
 26%|██▌       | 95884/371472 [7:37:38<20:58:50,  3.65it/s]
 26%|██▌       | 95885/371472 [7:37:39<20:31:35,  3.73it/s]
 26%|██▌       | 95886/371472 [7:37:39<20:04:30,  3.81it/s]
 26%|██▌       | 95887/371472 [7:37:39<19:46:40,  3.87it/s]
 26%|██▌       | 95888/371472 [7:37:40<20:04:43,  3.81it/s]
 26%|██▌       | 95889/371472 [7:37:40<21:51:39,  3.50it/s]
 26%|██▌       | 95890/371472 [7:37:40<20:53:07,  3.67it/s]
 26%|██▌       | 95891/371472 [7:37:40<20:35:28,  3.72it/s]
 26%|██▌       | 95892/371472 [7:37:41<20:08:41,  3.80it/s]
 26%|██▌       | 95893/371472 [7:37:41<19:59:26,  3.83it/s]
 26%|██▌       | 95894/371472 [7:37:41<20:28:31,  3.74it/s]
 26%|██▌       | 95895/371472 [7:37:41<21:03:21,  3.64it/s]
 26%|██▌       | 95896/371472 [7:37:42<21:53:06,  3.50it/s]
 26%|██▌       | 95897/371472 [7:37:42<21:37:14,  3.54it/s]
 26%|██▌       | 95898/371472 [7:37:42<21:19:33,  3.59it/s]
 26%|██▌       | 95899/371472 [7:37:43<20:42:34,  3.70it/s]
 26%|██▌       | 95900/371472 [7:37:43<20:50:56,  3.67it/s]
                                                           
{'loss': 3.6669, 'learning_rate': 7.680137473334913e-07, 'epoch': 4.13}

 26%|██▌       | 95900/371472 [7:37:43<20:50:56,  3.67it/s]
 26%|██▌       | 95901/371472 [7:37:43<20:44:35,  3.69it/s]
 26%|██▌       | 95902/371472 [7:37:43<20:11:34,  3.79it/s]
 26%|██▌       | 95903/371472 [7:37:44<20:50:40,  3.67it/s]
 26%|██▌       | 95904/371472 [7:37:44<22:26:07,  3.41it/s]
 26%|██▌       | 95905/371472 [7:37:44<21:58:27,  3.48it/s]
 26%|██▌       | 95906/371472 [7:37:45<21:28:28,  3.56it/s]
 26%|██▌       | 95907/371472 [7:37:45<22:56:03,  3.34it/s]
 26%|██▌       | 95908/371472 [7:37:45<22:04:28,  3.47it/s]
 26%|██▌       | 95909/371472 [7:37:45<21:56:52,  3.49it/s]
 26%|██▌       | 95910/371472 [7:37:46<21:21:37,  3.58it/s]
 26%|██▌       | 95911/371472 [7:37:46<20:56:38,  3.65it/s]
 26%|██▌       | 95912/371472 [7:37:46<20:42:10,  3.70it/s]
 26%|██▌       | 95913/371472 [7:37:46<20:59:29,  3.65it/s]
 26%|██▌       | 95914/371472 [7:37:47<20:43:40,  3.69it/s]
 26%|██▌       | 95915/371472 [7:37:47<21:31:05,  3.56it/s]
 26%|██▌       | 95916/371472 [7:37:47<21:37:05,  3.54it/s]
 26%|██▌       | 95917/371472 [7:37:48<21:17:12,  3.60it/s]
 26%|██▌       | 95918/371472 [7:37:48<21:00:37,  3.64it/s]
 26%|██▌       | 95919/371472 [7:37:48<23:49:13,  3.21it/s]
 26%|██▌       | 95920/371472 [7:37:49<23:16:55,  3.29it/s]
                                                           
{'loss': 3.6571, 'learning_rate': 7.679652653580124e-07, 'epoch': 4.13}

 26%|██▌       | 95920/371472 [7:37:49<23:16:55,  3.29it/s]
 26%|██▌       | 95921/371472 [7:37:49<23:47:24,  3.22it/s]
 26%|██▌       | 95922/371472 [7:37:49<22:39:31,  3.38it/s]
 26%|██▌       | 95923/371472 [7:37:49<22:14:51,  3.44it/s]
 26%|██▌       | 95924/371472 [7:37:50<21:21:02,  3.58it/s]
 26%|██▌       | 95925/371472 [7:37:50<21:20:38,  3.59it/s]
 26%|██▌       | 95926/371472 [7:37:50<20:28:33,  3.74it/s]
 26%|██▌       | 95927/371472 [7:37:50<21:02:46,  3.64it/s]
 26%|██▌       | 95928/371472 [7:37:51<21:04:04,  3.63it/s]
 26%|██▌       | 95929/371472 [7:37:51<20:27:18,  3.74it/s]
 26%|██▌       | 95930/371472 [7:37:51<19:46:29,  3.87it/s]
 26%|██▌       | 95931/371472 [7:37:52<22:11:14,  3.45it/s]
 26%|██▌       | 95932/371472 [7:37:52<21:25:08,  3.57it/s]
 26%|██▌       | 95933/371472 [7:37:52<21:11:50,  3.61it/s]
 26%|██▌       | 95934/371472 [7:37:52<20:54:39,  3.66it/s]
 26%|██▌       | 95935/371472 [7:37:53<21:18:09,  3.59it/s]
 26%|██▌       | 95936/371472 [7:37:53<20:56:31,  3.65it/s]
 26%|██▌       | 95937/371472 [7:37:53<20:45:32,  3.69it/s]
 26%|██▌       | 95938/371472 [7:37:53<20:21:47,  3.76it/s]
 26%|██▌       | 95939/371472 [7:37:54<21:59:34,  3.48it/s]
 26%|██▌       | 95940/371472 [7:37:54<21:51:32,  3.50it/s]
                                                           
{'loss': 3.7406, 'learning_rate': 7.679167833825335e-07, 'epoch': 4.13}

 26%|██▌       | 95940/371472 [7:37:54<21:51:32,  3.50it/s]
 26%|██▌       | 95941/371472 [7:37:54<23:20:05,  3.28it/s]
 26%|██▌       | 95942/371472 [7:37:55<22:34:24,  3.39it/s]
 26%|██▌       | 95943/371472 [7:37:55<21:34:53,  3.55it/s]
 26%|██▌       | 95944/371472 [7:37:55<20:57:36,  3.65it/s]
 26%|██▌       | 95945/371472 [7:37:55<20:16:03,  3.78it/s]
 26%|██▌       | 95946/371472 [7:37:56<22:43:09,  3.37it/s]
 26%|██▌       | 95947/371472 [7:37:56<23:05:19,  3.31it/s]
 26%|██▌       | 95948/371472 [7:37:56<23:03:23,  3.32it/s]
 26%|██▌       | 95949/371472 [7:37:57<24:15:00,  3.16it/s]
 26%|██▌       | 95950/371472 [7:37:57<23:33:11,  3.25it/s]
 26%|██▌       | 95951/371472 [7:37:57<22:55:51,  3.34it/s]
 26%|██▌       | 95952/371472 [7:37:58<21:57:57,  3.48it/s]
 26%|██▌       | 95953/371472 [7:37:58<21:47:39,  3.51it/s]
 26%|██▌       | 95954/371472 [7:37:58<21:57:51,  3.48it/s]
 26%|██▌       | 95955/371472 [7:37:58<20:42:46,  3.69it/s]
 26%|██▌       | 95956/371472 [7:37:59<20:22:24,  3.76it/s]
 26%|██▌       | 95957/371472 [7:37:59<20:55:39,  3.66it/s]
 26%|██▌       | 95958/371472 [7:37:59<22:06:03,  3.46it/s]
 26%|██▌       | 95959/371472 [7:38:00<21:43:08,  3.52it/s]
 26%|██▌       | 95960/371472 [7:38:00<23:01:51,  3.32it/s]
                                                           
{'loss': 3.5661, 'learning_rate': 7.678683014070546e-07, 'epoch': 4.13}

 26%|██▌       | 95960/371472 [7:38:00<23:01:51,  3.32it/s]
 26%|██▌       | 95961/371472 [7:38:00<21:59:45,  3.48it/s]
 26%|██▌       | 95962/371472 [7:38:00<21:25:09,  3.57it/s]
 26%|██▌       | 95963/371472 [7:38:01<22:36:50,  3.38it/s]
 26%|██▌       | 95964/371472 [7:38:01<21:29:12,  3.56it/s]
 26%|██▌       | 95965/371472 [7:38:01<22:37:59,  3.38it/s]
 26%|██▌       | 95966/371472 [7:38:02<21:57:16,  3.49it/s]
 26%|██▌       | 95967/371472 [7:38:02<22:48:10,  3.36it/s]
 26%|██▌       | 95968/371472 [7:38:02<23:56:21,  3.20it/s]
 26%|██▌       | 95969/371472 [7:38:02<22:19:02,  3.43it/s]
 26%|██▌       | 95970/371472 [7:38:03<23:10:09,  3.30it/s]
 26%|██▌       | 95971/371472 [7:38:03<22:38:03,  3.38it/s]
 26%|██▌       | 95972/371472 [7:38:03<21:33:52,  3.55it/s]
 26%|██▌       | 95973/371472 [7:38:04<21:48:21,  3.51it/s]
 26%|██▌       | 95974/371472 [7:38:04<20:52:17,  3.67it/s]
 26%|██▌       | 95975/371472 [7:38:04<21:28:13,  3.56it/s]
 26%|██▌       | 95976/371472 [7:38:04<21:09:41,  3.62it/s]
 26%|██▌       | 95977/371472 [7:38:05<20:28:59,  3.74it/s]
 26%|██▌       | 95978/371472 [7:38:05<20:08:09,  3.80it/s]
 26%|██▌       | 95979/371472 [7:38:05<22:57:54,  3.33it/s]
 26%|██▌       | 95980/371472 [7:38:06<21:59:24,  3.48it/s]
                                                           
{'loss': 3.6479, 'learning_rate': 7.678198194315757e-07, 'epoch': 4.13}

 26%|██▌       | 95980/371472 [7:38:06<21:59:24,  3.48it/s]
 26%|██▌       | 95981/371472 [7:38:06<21:19:56,  3.59it/s]
 26%|██▌       | 95982/371472 [7:38:06<22:07:27,  3.46it/s]
 26%|██▌       | 95983/371472 [7:38:06<21:43:29,  3.52it/s]
 26%|██▌       | 95984/371472 [7:38:07<22:06:24,  3.46it/s]
 26%|██▌       | 95985/371472 [7:38:07<22:11:51,  3.45it/s]
 26%|██▌       | 95986/371472 [7:38:07<21:41:52,  3.53it/s]
 26%|██▌       | 95987/371472 [7:38:08<21:28:28,  3.56it/s]
 26%|██▌       | 95988/371472 [7:38:08<21:09:22,  3.62it/s]
 26%|██▌       | 95989/371472 [7:38:08<22:15:29,  3.44it/s]
 26%|██▌       | 95990/371472 [7:38:08<21:36:02,  3.54it/s]
 26%|██▌       | 95991/371472 [7:38:09<20:29:47,  3.73it/s]
 26%|██▌       | 95992/371472 [7:38:09<21:19:52,  3.59it/s]
 26%|██▌       | 95993/371472 [7:38:09<21:46:18,  3.51it/s]
 26%|██▌       | 95994/371472 [7:38:10<21:14:37,  3.60it/s]
 26%|██▌       | 95995/371472 [7:38:10<20:49:14,  3.68it/s]
 26%|██▌       | 95996/371472 [7:38:10<20:04:13,  3.81it/s]
 26%|██▌       | 95997/371472 [7:38:10<20:36:52,  3.71it/s]
 26%|██▌       | 95998/371472 [7:38:11<20:12:12,  3.79it/s]
 26%|██▌       | 95999/371472 [7:38:11<19:48:59,  3.86it/s]
 26%|██▌       | 96000/371472 [7:38:11<19:50:16,  3.86it/s]
                                                           
{'loss': 3.7884, 'learning_rate': 7.677713374560968e-07, 'epoch': 4.13}

 26%|██▌       | 96000/371472 [7:38:11<19:50:16,  3.86it/s]
 26%|██▌       | 96001/371472 [7:38:11<20:12:00,  3.79it/s]
 26%|██▌       | 96002/371472 [7:38:12<19:39:22,  3.89it/s]
 26%|██▌       | 96003/371472 [7:38:12<20:20:34,  3.76it/s]
 26%|██▌       | 96004/371472 [7:38:12<20:03:43,  3.81it/s]
 26%|██▌       | 96005/371472 [7:38:12<19:23:13,  3.95it/s]
 26%|██▌       | 96006/371472 [7:38:13<19:48:04,  3.86it/s]
 26%|██▌       | 96007/371472 [7:38:13<19:26:55,  3.93it/s]
 26%|██▌       | 96008/371472 [7:38:13<19:21:27,  3.95it/s]
 26%|██▌       | 96009/371472 [7:38:13<20:06:36,  3.80it/s]
 26%|██▌       | 96010/371472 [7:38:14<20:05:02,  3.81it/s]
 26%|██▌       | 96011/371472 [7:38:14<19:56:27,  3.84it/s]
 26%|██▌       | 96012/371472 [7:38:14<20:18:07,  3.77it/s]
 26%|██▌       | 96013/371472 [7:38:14<20:10:14,  3.79it/s]
 26%|██▌       | 96014/371472 [7:38:15<20:34:07,  3.72it/s]
 26%|██▌       | 96015/371472 [7:38:15<20:10:44,  3.79it/s]
 26%|██▌       | 96016/371472 [7:38:15<21:11:11,  3.61it/s]
 26%|██▌       | 96017/371472 [7:38:16<20:31:56,  3.73it/s]
 26%|██▌       | 96018/371472 [7:38:16<20:24:07,  3.75it/s]
 26%|██▌       | 96019/371472 [7:38:16<20:20:42,  3.76it/s]
 26%|██▌       | 96020/371472 [7:38:16<21:02:24,  3.64it/s]
                                                           
{'loss': 3.6712, 'learning_rate': 7.67722855480618e-07, 'epoch': 4.14}

 26%|██▌       | 96020/371472 [7:38:16<21:02:24,  3.64it/s]
 26%|██▌       | 96021/371472 [7:38:17<20:10:40,  3.79it/s]
 26%|██▌       | 96022/371472 [7:38:17<21:36:07,  3.54it/s]
 26%|██▌       | 96023/371472 [7:38:17<20:55:54,  3.66it/s]
 26%|██▌       | 96024/371472 [7:38:17<20:49:12,  3.67it/s]
 26%|██▌       | 96025/371472 [7:38:18<21:10:44,  3.61it/s]
 26%|██▌       | 96026/371472 [7:38:18<20:43:35,  3.69it/s]
 26%|██▌       | 96027/371472 [7:38:18<22:19:53,  3.43it/s]
 26%|██▌       | 96028/371472 [7:38:19<22:07:30,  3.46it/s]
 26%|██▌       | 96029/371472 [7:38:19<20:37:43,  3.71it/s]
 26%|██▌       | 96030/371472 [7:38:19<21:12:54,  3.61it/s]
 26%|██▌       | 96031/371472 [7:38:19<20:31:04,  3.73it/s]
 26%|██▌       | 96032/371472 [7:38:20<20:17:13,  3.77it/s]
 26%|██▌       | 96033/371472 [7:38:20<20:40:36,  3.70it/s]
 26%|██▌       | 96034/371472 [7:38:20<20:32:30,  3.72it/s]
 26%|██▌       | 96035/371472 [7:38:20<20:24:30,  3.75it/s]
 26%|██▌       | 96036/371472 [7:38:21<20:55:53,  3.66it/s]
 26%|██▌       | 96037/371472 [7:38:21<21:05:15,  3.63it/s]
 26%|██▌       | 96038/371472 [7:38:21<21:20:20,  3.59it/s]
 26%|██▌       | 96039/371472 [7:38:22<22:32:52,  3.39it/s]
 26%|██▌       | 96040/371472 [7:38:22<21:28:12,  3.56it/s]
                                                           
{'loss': 3.551, 'learning_rate': 7.676743735051391e-07, 'epoch': 4.14}

 26%|██▌       | 96040/371472 [7:38:22<21:28:12,  3.56it/s]
 26%|██▌       | 96041/371472 [7:38:22<22:04:43,  3.47it/s]
 26%|██▌       | 96042/371472 [7:38:22<22:03:54,  3.47it/s]
 26%|██▌       | 96043/371472 [7:38:23<20:53:50,  3.66it/s]
 26%|██▌       | 96044/371472 [7:38:23<20:57:36,  3.65it/s]
 26%|██▌       | 96045/371472 [7:38:23<21:04:12,  3.63it/s]
 26%|██▌       | 96046/371472 [7:38:24<20:18:19,  3.77it/s]
 26%|██▌       | 96047/371472 [7:38:24<21:09:25,  3.62it/s]
 26%|██▌       | 96048/371472 [7:38:24<20:46:51,  3.68it/s]
 26%|██▌       | 96049/371472 [7:38:24<20:49:58,  3.67it/s]
 26%|██▌       | 96050/371472 [7:38:25<20:54:05,  3.66it/s]
 26%|██▌       | 96051/371472 [7:38:25<21:45:48,  3.52it/s]
 26%|██▌       | 96052/371472 [7:38:25<21:34:56,  3.54it/s]
 26%|██▌       | 96053/371472 [7:38:26<22:02:16,  3.47it/s]
 26%|██▌       | 96054/371472 [7:38:26<21:46:04,  3.51it/s]
 26%|██▌       | 96055/371472 [7:38:26<20:58:21,  3.65it/s]
 26%|██▌       | 96056/371472 [7:38:26<21:25:21,  3.57it/s]
 26%|██▌       | 96057/371472 [7:38:27<21:13:16,  3.61it/s]
 26%|██▌       | 96058/371472 [7:38:27<20:24:08,  3.75it/s]
 26%|██▌       | 96059/371472 [7:38:27<20:35:21,  3.72it/s]
 26%|██▌       | 96060/371472 [7:38:27<20:56:42,  3.65it/s]
                                                           
{'loss': 3.6324, 'learning_rate': 7.676258915296602e-07, 'epoch': 4.14}

 26%|██▌       | 96060/371472 [7:38:27<20:56:42,  3.65it/s]
 26%|██▌       | 96061/371472 [7:38:28<22:04:05,  3.47it/s]
 26%|██▌       | 96062/371472 [7:38:28<20:53:48,  3.66it/s]
 26%|██▌       | 96063/371472 [7:38:28<21:06:37,  3.62it/s]
 26%|██▌       | 96064/371472 [7:38:29<20:43:00,  3.69it/s]
 26%|██▌       | 96065/371472 [7:38:29<20:31:03,  3.73it/s]
 26%|██▌       | 96066/371472 [7:38:29<20:59:27,  3.64it/s]
 26%|██▌       | 96067/371472 [7:38:29<20:56:00,  3.65it/s]
 26%|██▌       | 96068/371472 [7:38:30<21:15:16,  3.60it/s]
 26%|██▌       | 96069/371472 [7:38:30<21:38:55,  3.53it/s]
 26%|██▌       | 96070/371472 [7:38:30<20:30:09,  3.73it/s]
 26%|██▌       | 96071/371472 [7:38:30<20:12:03,  3.79it/s]
 26%|██▌       | 96072/371472 [7:38:31<19:59:18,  3.83it/s]
 26%|██▌       | 96073/371472 [7:38:31<20:40:36,  3.70it/s]
 26%|██▌       | 96074/371472 [7:38:31<19:57:23,  3.83it/s]
 26%|██▌       | 96075/371472 [7:38:32<20:45:33,  3.69it/s]
 26%|██▌       | 96076/371472 [7:38:32<21:00:56,  3.64it/s]
 26%|██▌       | 96077/371472 [7:38:32<21:32:44,  3.55it/s]
 26%|██▌       | 96078/371472 [7:38:32<20:22:42,  3.75it/s]
 26%|██▌       | 96079/371472 [7:38:33<20:02:59,  3.82it/s]
 26%|██▌       | 96080/371472 [7:38:33<20:29:43,  3.73it/s]
                                                           
{'loss': 3.829, 'learning_rate': 7.675774095541812e-07, 'epoch': 4.14}

 26%|██▌       | 96080/371472 [7:38:33<20:29:43,  3.73it/s]
 26%|██▌       | 96081/371472 [7:38:33<19:59:33,  3.83it/s]
 26%|██▌       | 96082/371472 [7:38:33<20:10:05,  3.79it/s]
 26%|██▌       | 96083/371472 [7:38:34<20:23:17,  3.75it/s]
 26%|██▌       | 96084/371472 [7:38:34<21:06:31,  3.62it/s]
 26%|██▌       | 96085/371472 [7:38:34<21:45:51,  3.51it/s]
 26%|██▌       | 96086/371472 [7:38:34<21:14:38,  3.60it/s]
 26%|██▌       | 96087/371472 [7:38:35<20:25:25,  3.75it/s]
 26%|██▌       | 96088/371472 [7:38:35<19:58:48,  3.83it/s]
 26%|██▌       | 96089/371472 [7:38:35<19:36:37,  3.90it/s]
 26%|██▌       | 96090/371472 [7:38:35<19:10:21,  3.99it/s]
 26%|██▌       | 96091/371472 [7:38:36<20:21:08,  3.76it/s]
 26%|██▌       | 96092/371472 [7:38:36<20:07:11,  3.80it/s]
 26%|██▌       | 96093/371472 [7:38:36<19:41:12,  3.89it/s]
 26%|██▌       | 96094/371472 [7:38:37<19:45:35,  3.87it/s]
 26%|██▌       | 96095/371472 [7:38:37<20:04:24,  3.81it/s]
 26%|██▌       | 96096/371472 [7:38:37<19:41:03,  3.89it/s]
 26%|██▌       | 96097/371472 [7:38:37<20:58:43,  3.65it/s]
 26%|██▌       | 96098/371472 [7:38:38<20:31:59,  3.73it/s]
 26%|██▌       | 96099/371472 [7:38:38<20:07:53,  3.80it/s]
 26%|██▌       | 96100/371472 [7:38:38<20:31:02,  3.73it/s]
                                                           
{'loss': 3.48, 'learning_rate': 7.675289275787024e-07, 'epoch': 4.14}

 26%|██▌       | 96100/371472 [7:38:38<20:31:02,  3.73it/s]
 26%|██▌       | 96101/371472 [7:38:38<21:08:42,  3.62it/s]
 26%|██▌       | 96102/371472 [7:38:39<20:28:32,  3.74it/s]
 26%|██▌       | 96103/371472 [7:38:39<20:21:52,  3.76it/s]
 26%|██▌       | 96104/371472 [7:38:39<20:14:05,  3.78it/s]
 26%|██▌       | 96105/371472 [7:38:39<20:13:10,  3.78it/s]
 26%|██▌       | 96106/371472 [7:38:40<21:30:07,  3.56it/s]
 26%|██▌       | 96107/371472 [7:38:40<20:55:36,  3.66it/s]
 26%|██▌       | 96108/371472 [7:38:40<20:10:54,  3.79it/s]
 26%|██▌       | 96109/371472 [7:38:41<19:40:51,  3.89it/s]
 26%|██▌       | 96110/371472 [7:38:41<20:03:19,  3.81it/s]
 26%|██▌       | 96111/371472 [7:38:41<20:58:01,  3.65it/s]
 26%|██▌       | 96112/371472 [7:38:41<21:19:03,  3.59it/s]
 26%|██▌       | 96113/371472 [7:38:42<21:24:17,  3.57it/s]
 26%|██▌       | 96114/371472 [7:38:42<23:19:04,  3.28it/s]
 26%|██▌       | 96115/371472 [7:38:42<25:45:15,  2.97it/s]
 26%|██▌       | 96116/371472 [7:38:43<24:15:18,  3.15it/s]
 26%|██▌       | 96117/371472 [7:38:43<23:28:38,  3.26it/s]
 26%|██▌       | 96118/371472 [7:38:43<22:55:36,  3.34it/s]
 26%|██▌       | 96119/371472 [7:38:44<24:02:27,  3.18it/s]
 26%|██▌       | 96120/371472 [7:38:44<22:20:01,  3.42it/s]
                                                           
{'loss': 3.5614, 'learning_rate': 7.674804456032235e-07, 'epoch': 4.14}

 26%|██▌       | 96120/371472 [7:38:44<22:20:01,  3.42it/s]
 26%|██▌       | 96121/371472 [7:38:44<21:37:54,  3.54it/s]
 26%|██▌       | 96122/371472 [7:38:44<21:55:19,  3.49it/s]
 26%|██▌       | 96123/371472 [7:38:45<22:00:38,  3.47it/s]
 26%|██▌       | 96124/371472 [7:38:45<21:46:57,  3.51it/s]
 26%|██▌       | 96125/371472 [7:38:45<21:29:08,  3.56it/s]
 26%|██▌       | 96126/371472 [7:38:46<22:49:50,  3.35it/s]
 26%|██▌       | 96127/371472 [7:38:46<22:37:55,  3.38it/s]
 26%|██▌       | 96128/371472 [7:38:46<21:31:29,  3.55it/s]
 26%|██▌       | 96129/371472 [7:38:46<21:21:50,  3.58it/s]
 26%|██▌       | 96130/371472 [7:38:47<22:23:36,  3.42it/s]
 26%|██▌       | 96131/371472 [7:38:47<21:20:22,  3.58it/s]
 26%|██▌       | 96132/371472 [7:38:47<21:18:47,  3.59it/s]
 26%|██▌       | 96133/371472 [7:38:48<20:46:24,  3.68it/s]
 26%|██▌       | 96134/371472 [7:38:48<20:55:50,  3.65it/s]
 26%|██▌       | 96135/371472 [7:38:48<20:56:22,  3.65it/s]
 26%|██▌       | 96136/371472 [7:38:48<21:19:17,  3.59it/s]
 26%|██▌       | 96137/371472 [7:38:49<20:23:47,  3.75it/s]
 26%|██▌       | 96138/371472 [7:38:49<20:39:34,  3.70it/s]
 26%|██▌       | 96139/371472 [7:38:49<22:31:58,  3.39it/s]
 26%|██▌       | 96140/371472 [7:38:50<21:56:37,  3.49it/s]
                                                           
{'loss': 3.7307, 'learning_rate': 7.674319636277445e-07, 'epoch': 4.14}

 26%|██▌       | 96140/371472 [7:38:50<21:56:37,  3.49it/s]
 26%|██▌       | 96141/371472 [7:38:50<21:28:49,  3.56it/s]
 26%|██▌       | 96142/371472 [7:38:50<25:18:26,  3.02it/s]
 26%|██▌       | 96143/371472 [7:38:51<24:11:00,  3.16it/s]
 26%|██▌       | 96144/371472 [7:38:51<22:35:11,  3.39it/s]
 26%|██▌       | 96145/371472 [7:38:51<22:06:51,  3.46it/s]
 26%|██▌       | 96146/371472 [7:38:51<23:43:05,  3.22it/s]
 26%|██▌       | 96147/371472 [7:38:52<25:04:35,  3.05it/s]
 26%|██▌       | 96148/371472 [7:38:52<24:26:50,  3.13it/s]
 26%|██▌       | 96149/371472 [7:38:52<24:34:11,  3.11it/s]
 26%|██▌       | 96150/371472 [7:38:53<24:31:51,  3.12it/s]
 26%|██▌       | 96151/371472 [7:38:53<24:05:49,  3.17it/s]
 26%|██▌       | 96152/371472 [7:38:53<22:44:59,  3.36it/s]
 26%|██▌       | 96153/371472 [7:38:54<21:24:52,  3.57it/s]
 26%|██▌       | 96154/371472 [7:38:54<21:37:37,  3.54it/s]
 26%|██▌       | 96155/371472 [7:38:54<22:06:12,  3.46it/s]
 26%|██▌       | 96156/371472 [7:38:54<23:29:59,  3.25it/s]
 26%|██▌       | 96157/371472 [7:38:55<22:51:02,  3.35it/s]
 26%|██▌       | 96158/371472 [7:38:55<22:39:15,  3.38it/s]
 26%|██▌       | 96159/371472 [7:38:55<22:33:54,  3.39it/s]
 26%|██▌       | 96160/371472 [7:38:56<23:18:27,  3.28it/s]
                                                           
{'loss': 3.6099, 'learning_rate': 7.673834816522657e-07, 'epoch': 4.14}

 26%|██▌       | 96160/371472 [7:38:56<23:18:27,  3.28it/s]
 26%|██▌       | 96161/371472 [7:38:56<21:55:03,  3.49it/s]
 26%|██▌       | 96162/371472 [7:38:56<20:38:54,  3.70it/s]
 26%|██▌       | 96163/371472 [7:38:56<19:57:25,  3.83it/s]
 26%|██▌       | 96164/371472 [7:38:57<19:43:00,  3.88it/s]
 26%|██▌       | 96165/371472 [7:38:57<19:48:12,  3.86it/s]
 26%|██▌       | 96166/371472 [7:38:57<19:52:23,  3.85it/s]
 26%|██▌       | 96167/371472 [7:38:57<20:05:36,  3.81it/s]
 26%|██▌       | 96168/371472 [7:38:58<21:27:10,  3.56it/s]
 26%|██▌       | 96169/371472 [7:38:58<21:12:57,  3.60it/s]
 26%|██▌       | 96170/371472 [7:38:58<22:16:11,  3.43it/s]
 26%|██▌       | 96171/371472 [7:38:59<23:15:11,  3.29it/s]
 26%|██▌       | 96172/371472 [7:38:59<22:04:27,  3.46it/s]
 26%|██▌       | 96173/371472 [7:38:59<21:47:25,  3.51it/s]
 26%|██▌       | 96174/371472 [7:38:59<22:21:32,  3.42it/s]
 26%|██▌       | 96175/371472 [7:39:00<21:16:37,  3.59it/s]
 26%|██▌       | 96176/371472 [7:39:00<21:02:55,  3.63it/s]
 26%|██▌       | 96177/371472 [7:39:00<20:11:57,  3.79it/s]
 26%|██▌       | 96178/371472 [7:39:01<20:30:13,  3.73it/s]
 26%|██▌       | 96179/371472 [7:39:01<20:08:26,  3.80it/s]
 26%|██▌       | 96180/371472 [7:39:01<20:40:38,  3.70it/s]
                                                           
{'loss': 3.7577, 'learning_rate': 7.673349996767869e-07, 'epoch': 4.14}

 26%|██▌       | 96180/371472 [7:39:01<20:40:38,  3.70it/s]
 26%|██▌       | 96181/371472 [7:39:01<20:23:36,  3.75it/s]
 26%|██▌       | 96182/371472 [7:39:02<20:56:39,  3.65it/s]
 26%|██▌       | 96183/371472 [7:39:02<20:56:28,  3.65it/s]
 26%|██▌       | 96184/371472 [7:39:02<23:20:50,  3.28it/s]
 26%|██▌       | 96185/371472 [7:39:03<22:18:43,  3.43it/s]
 26%|██▌       | 96186/371472 [7:39:03<22:02:35,  3.47it/s]
 26%|██▌       | 96187/371472 [7:39:03<21:44:22,  3.52it/s]
 26%|██▌       | 96188/371472 [7:39:03<20:52:41,  3.66it/s]
 26%|██▌       | 96189/371472 [7:39:04<21:12:25,  3.61it/s]
 26%|██▌       | 96190/371472 [7:39:04<21:05:09,  3.63it/s]
 26%|██▌       | 96191/371472 [7:39:04<22:23:12,  3.42it/s]
 26%|██▌       | 96192/371472 [7:39:05<23:04:20,  3.31it/s]
 26%|██▌       | 96193/371472 [7:39:05<21:34:22,  3.54it/s]
 26%|██▌       | 96194/371472 [7:39:05<20:58:12,  3.65it/s]
 26%|██▌       | 96195/371472 [7:39:05<23:28:33,  3.26it/s]
 26%|██▌       | 96196/371472 [7:39:06<24:59:15,  3.06it/s]
 26%|██▌       | 96197/371472 [7:39:06<23:31:10,  3.25it/s]
 26%|██▌       | 96198/371472 [7:39:06<23:15:51,  3.29it/s]
 26%|██▌       | 96199/371472 [7:39:07<22:20:49,  3.42it/s]
 26%|██▌       | 96200/371472 [7:39:07<21:08:13,  3.62it/s]
                                                           
{'loss': 3.7372, 'learning_rate': 7.672865177013078e-07, 'epoch': 4.14}

 26%|██▌       | 96200/371472 [7:39:07<21:08:13,  3.62it/s]
 26%|██▌       | 96201/371472 [7:39:07<20:16:27,  3.77it/s]
 26%|██▌       | 96202/371472 [7:39:07<21:08:47,  3.62it/s]
 26%|██▌       | 96203/371472 [7:39:08<21:23:58,  3.57it/s]
 26%|██▌       | 96204/371472 [7:39:08<22:21:05,  3.42it/s]
 26%|██▌       | 96205/371472 [7:39:08<21:59:25,  3.48it/s]
 26%|██▌       | 96206/371472 [7:39:09<22:13:17,  3.44it/s]
 26%|██▌       | 96207/371472 [7:39:09<22:17:17,  3.43it/s]
 26%|██▌       | 96208/371472 [7:39:09<21:08:40,  3.62it/s]
 26%|██▌       | 96209/371472 [7:39:09<21:19:08,  3.59it/s]
 26%|██▌       | 96210/371472 [7:39:10<21:42:13,  3.52it/s]
 26%|██▌       | 96211/371472 [7:39:10<21:04:26,  3.63it/s]
 26%|██▌       | 96212/371472 [7:39:10<22:11:19,  3.45it/s]
 26%|██▌       | 96213/371472 [7:39:11<24:53:40,  3.07it/s]
 26%|██▌       | 96214/371472 [7:39:11<23:35:22,  3.24it/s]
 26%|██▌       | 96215/371472 [7:39:11<23:36:33,  3.24it/s]
 26%|██▌       | 96216/371472 [7:39:11<22:08:22,  3.45it/s]
 26%|██▌       | 96217/371472 [7:39:12<22:45:10,  3.36it/s]
 26%|██▌       | 96218/371472 [7:39:12<21:41:59,  3.52it/s]
 26%|██▌       | 96219/371472 [7:39:12<21:24:20,  3.57it/s]
 26%|██▌       | 96220/371472 [7:39:13<20:32:08,  3.72it/s]
                                                           
{'loss': 3.5859, 'learning_rate': 7.672380357258289e-07, 'epoch': 4.14}

 26%|██▌       | 96220/371472 [7:39:13<20:32:08,  3.72it/s]
 26%|██▌       | 96221/371472 [7:39:13<20:36:53,  3.71it/s]
 26%|██▌       | 96222/371472 [7:39:13<19:49:40,  3.86it/s]
 26%|██▌       | 96223/371472 [7:39:13<20:48:14,  3.68it/s]
 26%|██▌       | 96224/371472 [7:39:14<21:35:58,  3.54it/s]
 26%|██▌       | 96225/371472 [7:39:14<22:26:00,  3.41it/s]
 26%|██▌       | 96226/371472 [7:39:14<23:32:50,  3.25it/s]
 26%|██▌       | 96227/371472 [7:39:15<24:04:24,  3.18it/s]
 26%|██▌       | 96228/371472 [7:39:15<23:30:47,  3.25it/s]
 26%|██▌       | 96229/371472 [7:39:15<22:32:23,  3.39it/s]
 26%|██▌       | 96230/371472 [7:39:16<22:01:01,  3.47it/s]
 26%|██▌       | 96231/371472 [7:39:16<20:59:06,  3.64it/s]
 26%|██▌       | 96232/371472 [7:39:16<22:49:02,  3.35it/s]
 26%|██▌       | 96233/371472 [7:39:16<22:04:31,  3.46it/s]
 26%|██▌       | 96234/371472 [7:39:17<21:28:32,  3.56it/s]
 26%|██▌       | 96235/371472 [7:39:17<21:32:05,  3.55it/s]
 26%|██▌       | 96236/371472 [7:39:17<20:37:07,  3.71it/s]
 26%|██▌       | 96237/371472 [7:39:18<22:16:22,  3.43it/s]
 26%|██▌       | 96238/371472 [7:39:18<21:20:03,  3.58it/s]
 26%|██▌       | 96239/371472 [7:39:18<21:00:24,  3.64it/s]
 26%|██▌       | 96240/371472 [7:39:18<21:00:37,  3.64it/s]
                                                           
{'loss': 3.821, 'learning_rate': 7.671895537503501e-07, 'epoch': 4.15}

 26%|██▌       | 96240/371472 [7:39:18<21:00:37,  3.64it/s]
 26%|██▌       | 96241/371472 [7:39:19<20:36:24,  3.71it/s]
 26%|██▌       | 96242/371472 [7:39:19<20:05:02,  3.81it/s]
 26%|██▌       | 96243/371472 [7:39:19<19:48:14,  3.86it/s]
 26%|██▌       | 96244/371472 [7:39:19<20:21:22,  3.76it/s]
 26%|██▌       | 96245/371472 [7:39:20<20:00:56,  3.82it/s]
 26%|██▌       | 96246/371472 [7:39:20<20:50:33,  3.67it/s]
 26%|██▌       | 96247/371472 [7:39:20<20:37:21,  3.71it/s]
 26%|██▌       | 96248/371472 [7:39:20<20:51:10,  3.67it/s]
 26%|██▌       | 96249/371472 [7:39:21<22:11:52,  3.44it/s]
 26%|██▌       | 96250/371472 [7:39:21<22:51:17,  3.35it/s]
 26%|██▌       | 96251/371472 [7:39:21<22:21:00,  3.42it/s]
 26%|██▌       | 96252/371472 [7:39:22<22:00:21,  3.47it/s]
 26%|██▌       | 96253/371472 [7:39:22<21:23:57,  3.57it/s]
 26%|██▌       | 96254/371472 [7:39:22<21:00:43,  3.64it/s]
 26%|██▌       | 96255/371472 [7:39:22<20:34:30,  3.72it/s]
 26%|██▌       | 96256/371472 [7:39:23<20:23:37,  3.75it/s]
 26%|██▌       | 96257/371472 [7:39:23<21:12:01,  3.61it/s]
 26%|██▌       | 96258/371472 [7:39:23<20:55:31,  3.65it/s]
 26%|██▌       | 96259/371472 [7:39:24<21:24:55,  3.57it/s]
 26%|██▌       | 96260/371472 [7:39:24<21:16:41,  3.59it/s]
                                                           
{'loss': 3.6523, 'learning_rate': 7.671410717748713e-07, 'epoch': 4.15}

 26%|██▌       | 96260/371472 [7:39:24<21:16:41,  3.59it/s]
 26%|██▌       | 96261/371472 [7:39:24<21:13:43,  3.60it/s]
 26%|██▌       | 96262/371472 [7:39:24<22:33:14,  3.39it/s]
 26%|██▌       | 96263/371472 [7:39:25<21:15:51,  3.60it/s]
 26%|██▌       | 96264/371472 [7:39:25<21:38:19,  3.53it/s]
 26%|██▌       | 96265/371472 [7:39:25<21:44:46,  3.52it/s]
 26%|██▌       | 96266/371472 [7:39:26<21:19:15,  3.59it/s]
 26%|██▌       | 96267/371472 [7:39:26<20:30:58,  3.73it/s]
 26%|██▌       | 96268/371472 [7:39:26<21:43:06,  3.52it/s]
 26%|██▌       | 96269/371472 [7:39:26<22:44:32,  3.36it/s]
 26%|██▌       | 96270/371472 [7:39:27<22:14:31,  3.44it/s]
 26%|██▌       | 96271/371472 [7:39:27<22:04:44,  3.46it/s]
 26%|██▌       | 96272/371472 [7:39:27<22:21:22,  3.42it/s]
 26%|██▌       | 96273/371472 [7:39:28<22:01:56,  3.47it/s]
 26%|██▌       | 96274/371472 [7:39:28<21:09:16,  3.61it/s]
 26%|██▌       | 96275/371472 [7:39:28<20:36:18,  3.71it/s]
 26%|██▌       | 96276/371472 [7:39:28<20:41:21,  3.69it/s]
 26%|██▌       | 96277/371472 [7:39:29<21:33:51,  3.54it/s]
 26%|██▌       | 96278/371472 [7:39:29<21:15:01,  3.60it/s]
 26%|██▌       | 96279/371472 [7:39:29<20:43:09,  3.69it/s]
 26%|██▌       | 96280/371472 [7:39:29<20:55:56,  3.65it/s]
                                                           
{'loss': 3.7537, 'learning_rate': 7.670925897993924e-07, 'epoch': 4.15}

 26%|██▌       | 96280/371472 [7:39:29<20:55:56,  3.65it/s]
 26%|██▌       | 96281/371472 [7:39:30<22:13:02,  3.44it/s]
 26%|██▌       | 96282/371472 [7:39:30<22:37:35,  3.38it/s]
 26%|██▌       | 96283/371472 [7:39:30<22:13:39,  3.44it/s]
 26%|██▌       | 96284/371472 [7:39:31<20:53:24,  3.66it/s]
 26%|██▌       | 96285/371472 [7:39:31<21:31:31,  3.55it/s]
 26%|██▌       | 96286/371472 [7:39:31<21:23:22,  3.57it/s]
 26%|██▌       | 96287/371472 [7:39:31<21:27:23,  3.56it/s]
 26%|██▌       | 96288/371472 [7:39:32<22:09:11,  3.45it/s]
 26%|██▌       | 96289/371472 [7:39:32<22:55:29,  3.33it/s]
 26%|██▌       | 96290/371472 [7:39:32<21:58:42,  3.48it/s]
 26%|██▌       | 96291/371472 [7:39:33<22:52:39,  3.34it/s]
 26%|██▌       | 96292/371472 [7:39:33<25:15:21,  3.03it/s]
 26%|██▌       | 96293/371472 [7:39:33<23:55:14,  3.20it/s]
 26%|██▌       | 96294/371472 [7:39:34<22:09:39,  3.45it/s]
 26%|██▌       | 96295/371472 [7:39:34<21:10:26,  3.61it/s]
 26%|██▌       | 96296/371472 [7:39:34<21:53:43,  3.49it/s]
 26%|██▌       | 96297/371472 [7:39:34<22:27:18,  3.40it/s]
 26%|██▌       | 96298/371472 [7:39:35<22:06:54,  3.46it/s]
 26%|██▌       | 96299/371472 [7:39:35<23:16:09,  3.28it/s]
 26%|██▌       | 96300/371472 [7:39:35<23:53:33,  3.20it/s]
                                                           
{'loss': 3.5594, 'learning_rate': 7.670441078239135e-07, 'epoch': 4.15}

 26%|██▌       | 96300/371472 [7:39:35<23:53:33,  3.20it/s]
 26%|██▌       | 96301/371472 [7:39:36<22:08:34,  3.45it/s]
 26%|██▌       | 96302/371472 [7:39:36<22:27:15,  3.40it/s]
 26%|██▌       | 96303/371472 [7:39:36<21:17:29,  3.59it/s]
 26%|██▌       | 96304/371472 [7:39:36<21:19:26,  3.58it/s]
 26%|██▌       | 96305/371472 [7:39:37<22:03:16,  3.47it/s]
 26%|██▌       | 96306/371472 [7:39:37<21:43:25,  3.52it/s]
 26%|██▌       | 96307/371472 [7:39:37<21:11:22,  3.61it/s]
 26%|██▌       | 96308/371472 [7:39:38<21:47:26,  3.51it/s]
 26%|██▌       | 96309/371472 [7:39:38<21:17:49,  3.59it/s]
 26%|██▌       | 96310/371472 [7:39:38<20:34:03,  3.72it/s]
 26%|██▌       | 96311/371472 [7:39:38<21:10:49,  3.61it/s]
 26%|██▌       | 96312/371472 [7:39:39<20:35:34,  3.71it/s]
 26%|██▌       | 96313/371472 [7:39:39<21:06:05,  3.62it/s]
 26%|██▌       | 96314/371472 [7:39:39<20:42:06,  3.69it/s]
 26%|██▌       | 96315/371472 [7:39:40<22:11:16,  3.44it/s]
 26%|██▌       | 96316/371472 [7:39:40<22:33:06,  3.39it/s]
 26%|██▌       | 96317/371472 [7:39:40<21:13:49,  3.60it/s]
 26%|██▌       | 96318/371472 [7:39:40<20:22:42,  3.75it/s]
 26%|██▌       | 96319/371472 [7:39:41<19:57:23,  3.83it/s]
 26%|██▌       | 96320/371472 [7:39:41<19:41:00,  3.88it/s]
                                                           
{'loss': 3.6303, 'learning_rate': 7.669956258484345e-07, 'epoch': 4.15}

 26%|██▌       | 96320/371472 [7:39:41<19:41:00,  3.88it/s]
 26%|██▌       | 96321/371472 [7:39:41<20:23:01,  3.75it/s]
 26%|██▌       | 96322/371472 [7:39:41<19:52:12,  3.85it/s]
 26%|██▌       | 96323/371472 [7:39:42<19:53:38,  3.84it/s]
 26%|██▌       | 96324/371472 [7:39:42<19:39:03,  3.89it/s]
 26%|██▌       | 96325/371472 [7:39:42<21:31:25,  3.55it/s]
 26%|██▌       | 96326/371472 [7:39:43<25:41:23,  2.98it/s]
 26%|██▌       | 96327/371472 [7:39:43<24:07:33,  3.17it/s]
 26%|██▌       | 96328/371472 [7:39:43<23:30:22,  3.25it/s]
 26%|██▌       | 96329/371472 [7:39:44<23:35:42,  3.24it/s]
 26%|██▌       | 96330/371472 [7:39:44<23:01:44,  3.32it/s]
 26%|██▌       | 96331/371472 [7:39:44<22:15:00,  3.43it/s]
 26%|██▌       | 96332/371472 [7:39:44<24:09:21,  3.16it/s]
 26%|██▌       | 96333/371472 [7:39:45<22:44:52,  3.36it/s]
 26%|██▌       | 96334/371472 [7:39:45<22:08:24,  3.45it/s]
 26%|██▌       | 96335/371472 [7:39:45<22:11:33,  3.44it/s]
 26%|██▌       | 96336/371472 [7:39:46<21:19:51,  3.58it/s]
 26%|██▌       | 96337/371472 [7:39:46<21:42:53,  3.52it/s]
 26%|██▌       | 96338/371472 [7:39:46<21:10:32,  3.61it/s]
 26%|██▌       | 96339/371472 [7:39:46<20:45:08,  3.68it/s]
 26%|██▌       | 96340/371472 [7:39:47<21:39:49,  3.53it/s]
                                                           
{'loss': 3.6694, 'learning_rate': 7.669471438729557e-07, 'epoch': 4.15}

 26%|██▌       | 96340/371472 [7:39:47<21:39:49,  3.53it/s]
 26%|██▌       | 96341/371472 [7:39:47<20:48:24,  3.67it/s]
 26%|██▌       | 96342/371472 [7:39:47<21:20:43,  3.58it/s]
 26%|██▌       | 96343/371472 [7:39:48<21:57:57,  3.48it/s]
 26%|██▌       | 96344/371472 [7:39:48<21:34:14,  3.54it/s]
 26%|██▌       | 96345/371472 [7:39:48<22:16:01,  3.43it/s]
 26%|██▌       | 96346/371472 [7:39:48<22:51:21,  3.34it/s]
 26%|██▌       | 96347/371472 [7:39:49<21:41:18,  3.52it/s]
 26%|██▌       | 96348/371472 [7:39:49<21:12:12,  3.60it/s]
 26%|██▌       | 96349/371472 [7:39:49<21:25:47,  3.57it/s]
 26%|██▌       | 96350/371472 [7:39:49<20:37:32,  3.71it/s]
 26%|██▌       | 96351/371472 [7:39:50<20:15:23,  3.77it/s]
 26%|██▌       | 96352/371472 [7:39:50<20:05:22,  3.80it/s]
 26%|██▌       | 96353/371472 [7:39:50<20:33:37,  3.72it/s]
 26%|██▌       | 96354/371472 [7:39:51<21:46:00,  3.51it/s]
 26%|██▌       | 96355/371472 [7:39:51<21:55:30,  3.49it/s]
 26%|██▌       | 96356/371472 [7:39:51<20:57:01,  3.65it/s]
 26%|██▌       | 96357/371472 [7:39:51<20:47:07,  3.68it/s]
 26%|██▌       | 96358/371472 [7:39:52<21:00:20,  3.64it/s]
 26%|██▌       | 96359/371472 [7:39:52<21:32:50,  3.55it/s]
 26%|██▌       | 96360/371472 [7:39:52<22:03:59,  3.46it/s]
                                                           
{'loss': 3.5924, 'learning_rate': 7.668986618974766e-07, 'epoch': 4.15}

 26%|██▌       | 96360/371472 [7:39:52<22:03:59,  3.46it/s]
 26%|██▌       | 96361/371472 [7:39:52<20:46:31,  3.68it/s]
 26%|██▌       | 96362/371472 [7:39:53<20:12:56,  3.78it/s]
 26%|██▌       | 96363/371472 [7:39:53<19:53:48,  3.84it/s]
 26%|██▌       | 96364/371472 [7:39:53<19:50:50,  3.85it/s]
 26%|██▌       | 96365/371472 [7:39:54<21:08:33,  3.61it/s]
 26%|██▌       | 96366/371472 [7:39:54<20:43:12,  3.69it/s]
 26%|██▌       | 96367/371472 [7:39:54<23:32:06,  3.25it/s]
 26%|██▌       | 96368/371472 [7:39:55<23:19:06,  3.28it/s]
 26%|██▌       | 96369/371472 [7:39:55<22:51:47,  3.34it/s]
 26%|██▌       | 96370/371472 [7:39:55<23:30:47,  3.25it/s]
 26%|██▌       | 96371/371472 [7:39:55<23:14:29,  3.29it/s]
 26%|██▌       | 96372/371472 [7:39:56<25:24:42,  3.01it/s]
 26%|██▌       | 96373/371472 [7:39:56<25:06:07,  3.04it/s]
 26%|██▌       | 96374/371472 [7:39:56<23:14:14,  3.29it/s]
 26%|██▌       | 96375/371472 [7:39:57<23:17:55,  3.28it/s]
 26%|██▌       | 96376/371472 [7:39:57<22:33:44,  3.39it/s]
 26%|██▌       | 96377/371472 [7:39:57<23:11:13,  3.30it/s]
 26%|██▌       | 96378/371472 [7:39:58<23:18:26,  3.28it/s]
 26%|██▌       | 96379/371472 [7:39:58<24:07:19,  3.17it/s]
 26%|██▌       | 96380/371472 [7:39:58<23:07:23,  3.30it/s]
                                                           
{'loss': 3.6093, 'learning_rate': 7.668501799219978e-07, 'epoch': 4.15}

 26%|██▌       | 96380/371472 [7:39:58<23:07:23,  3.30it/s]
 26%|██▌       | 96381/371472 [7:39:59<23:53:27,  3.20it/s]
 26%|██▌       | 96382/371472 [7:39:59<23:06:57,  3.31it/s]
 26%|██▌       | 96383/371472 [7:39:59<21:54:29,  3.49it/s]
 26%|██▌       | 96384/371472 [7:39:59<21:50:22,  3.50it/s]
 26%|██▌       | 96385/371472 [7:40:00<21:15:55,  3.59it/s]
 26%|██▌       | 96386/371472 [7:40:00<21:02:59,  3.63it/s]
 26%|██▌       | 96387/371472 [7:40:00<21:18:50,  3.59it/s]
 26%|██▌       | 96388/371472 [7:40:00<20:50:46,  3.67it/s]
 26%|██▌       | 96389/371472 [7:40:01<20:45:52,  3.68it/s]
 26%|██▌       | 96390/371472 [7:40:01<20:53:31,  3.66it/s]
 26%|██▌       | 96391/371472 [7:40:01<22:22:59,  3.41it/s]
 26%|██▌       | 96392/371472 [7:40:02<21:34:02,  3.54it/s]
 26%|██▌       | 96393/371472 [7:40:02<21:21:28,  3.58it/s]
 26%|██▌       | 96394/371472 [7:40:02<21:06:53,  3.62it/s]
 26%|██▌       | 96395/371472 [7:40:02<20:59:49,  3.64it/s]
 26%|██▌       | 96396/371472 [7:40:03<23:08:14,  3.30it/s]
 26%|██▌       | 96397/371472 [7:40:03<22:51:35,  3.34it/s]
 26%|██▌       | 96398/371472 [7:40:03<21:55:44,  3.48it/s]
 26%|██▌       | 96399/371472 [7:40:04<21:00:03,  3.64it/s]
 26%|██▌       | 96400/371472 [7:40:04<20:55:57,  3.65it/s]
                                                           
{'loss': 3.7879, 'learning_rate': 7.66801697946519e-07, 'epoch': 4.15}

 26%|██▌       | 96400/371472 [7:40:04<20:55:57,  3.65it/s]
 26%|██▌       | 96401/371472 [7:40:04<23:09:04,  3.30it/s]
 26%|██▌       | 96402/371472 [7:40:04<22:03:58,  3.46it/s]
 26%|██▌       | 96403/371472 [7:40:05<22:08:21,  3.45it/s]
 26%|██▌       | 96404/371472 [7:40:05<22:33:44,  3.39it/s]
 26%|██▌       | 96405/371472 [7:40:05<22:10:51,  3.44it/s]
 26%|██▌       | 96406/371472 [7:40:06<21:38:48,  3.53it/s]
 26%|██▌       | 96407/371472 [7:40:06<21:21:07,  3.58it/s]
 26%|██▌       | 96408/371472 [7:40:06<20:40:40,  3.70it/s]
 26%|██▌       | 96409/371472 [7:40:06<20:43:57,  3.69it/s]
 26%|██▌       | 96410/371472 [7:40:07<20:18:19,  3.76it/s]
 26%|██▌       | 96411/371472 [7:40:07<20:27:08,  3.74it/s]
 26%|██▌       | 96412/371472 [7:40:07<23:26:31,  3.26it/s]
 26%|██▌       | 96413/371472 [7:40:08<22:22:04,  3.42it/s]
 26%|██▌       | 96414/371472 [7:40:08<23:40:18,  3.23it/s]
 26%|██▌       | 96415/371472 [7:40:08<25:23:10,  3.01it/s]
 26%|██▌       | 96416/371472 [7:40:09<23:31:20,  3.25it/s]
 26%|██▌       | 96417/371472 [7:40:09<23:04:32,  3.31it/s]
 26%|██▌       | 96418/371472 [7:40:09<22:00:45,  3.47it/s]
 26%|██▌       | 96419/371472 [7:40:09<21:27:09,  3.56it/s]
 26%|██▌       | 96420/371472 [7:40:10<21:10:29,  3.61it/s]
                                                           
{'loss': 3.6788, 'learning_rate': 7.667532159710401e-07, 'epoch': 4.15}

 26%|██▌       | 96420/371472 [7:40:10<21:10:29,  3.61it/s]
 26%|██▌       | 96421/371472 [7:40:10<21:18:43,  3.58it/s]
 26%|██▌       | 96422/371472 [7:40:10<20:54:46,  3.65it/s]
 26%|██▌       | 96423/371472 [7:40:10<21:09:11,  3.61it/s]
 26%|██▌       | 96424/371472 [7:40:11<20:53:00,  3.66it/s]
 26%|██▌       | 96425/371472 [7:40:11<21:44:55,  3.51it/s]
 26%|██▌       | 96426/371472 [7:40:11<22:02:15,  3.47it/s]
 26%|██▌       | 96427/371472 [7:40:12<22:48:25,  3.35it/s]
 26%|██▌       | 96428/371472 [7:40:12<22:39:18,  3.37it/s]
 26%|██▌       | 96429/371472 [7:40:12<22:14:23,  3.44it/s]
 26%|██▌       | 96430/371472 [7:40:12<21:40:18,  3.53it/s]
 26%|██▌       | 96431/371472 [7:40:13<20:49:13,  3.67it/s]
 26%|██▌       | 96432/371472 [7:40:13<20:45:10,  3.68it/s]
 26%|██▌       | 96433/371472 [7:40:13<20:00:57,  3.82it/s]
 26%|██▌       | 96434/371472 [7:40:14<20:23:54,  3.75it/s]
 26%|██▌       | 96435/371472 [7:40:14<21:35:02,  3.54it/s]
 26%|██▌       | 96436/371472 [7:40:14<21:29:49,  3.55it/s]
 26%|██▌       | 96437/371472 [7:40:14<20:48:37,  3.67it/s]
 26%|██▌       | 96438/371472 [7:40:15<23:01:42,  3.32it/s]
 26%|██▌       | 96439/371472 [7:40:15<22:38:43,  3.37it/s]
 26%|██▌       | 96440/371472 [7:40:15<21:52:28,  3.49it/s]
                                                           
{'loss': 3.6262, 'learning_rate': 7.667047339955611e-07, 'epoch': 4.15}

 26%|██▌       | 96440/371472 [7:40:15<21:52:28,  3.49it/s]
 26%|██▌       | 96441/371472 [7:40:16<22:03:45,  3.46it/s]
 26%|██▌       | 96442/371472 [7:40:16<21:28:40,  3.56it/s]
 26%|██▌       | 96443/371472 [7:40:16<22:55:18,  3.33it/s]
 26%|██▌       | 96444/371472 [7:40:16<21:40:18,  3.53it/s]
 26%|██▌       | 96445/371472 [7:40:17<20:54:39,  3.65it/s]
 26%|██▌       | 96446/371472 [7:40:17<22:06:37,  3.46it/s]
 26%|██▌       | 96447/371472 [7:40:17<21:51:08,  3.50it/s]
 26%|██▌       | 96448/371472 [7:40:18<22:50:40,  3.34it/s]
 26%|██▌       | 96449/371472 [7:40:18<22:25:31,  3.41it/s]
 26%|██▌       | 96450/371472 [7:40:18<21:37:53,  3.53it/s]
 26%|██▌       | 96451/371472 [7:40:18<21:23:36,  3.57it/s]
 26%|██▌       | 96452/371472 [7:40:19<21:16:57,  3.59it/s]
 26%|██▌       | 96453/371472 [7:40:19<21:47:29,  3.51it/s]
 26%|██▌       | 96454/371472 [7:40:19<21:25:44,  3.56it/s]
 26%|██▌       | 96455/371472 [7:40:20<21:50:18,  3.50it/s]
 26%|██▌       | 96456/371472 [7:40:20<20:48:44,  3.67it/s]
 26%|██▌       | 96457/371472 [7:40:20<20:18:36,  3.76it/s]
 26%|██▌       | 96458/371472 [7:40:20<20:35:47,  3.71it/s]
 26%|██▌       | 96459/371472 [7:40:21<19:49:46,  3.85it/s]
 26%|██▌       | 96460/371472 [7:40:21<20:28:01,  3.73it/s]
                                                           
{'loss': 3.571, 'learning_rate': 7.666562520200822e-07, 'epoch': 4.15}

 26%|██▌       | 96460/371472 [7:40:21<20:28:01,  3.73it/s]
 26%|██▌       | 96461/371472 [7:40:21<20:15:47,  3.77it/s]
 26%|██▌       | 96462/371472 [7:40:21<19:58:50,  3.82it/s]
 26%|██▌       | 96463/371472 [7:40:22<22:05:35,  3.46it/s]
 26%|██▌       | 96464/371472 [7:40:22<21:59:29,  3.47it/s]
 26%|██▌       | 96465/371472 [7:40:22<21:36:18,  3.54it/s]
 26%|██▌       | 96466/371472 [7:40:23<21:21:07,  3.58it/s]
 26%|██▌       | 96467/371472 [7:40:23<22:51:50,  3.34it/s]
 26%|██▌       | 96468/371472 [7:40:23<22:20:01,  3.42it/s]
 26%|██▌       | 96469/371472 [7:40:24<23:17:21,  3.28it/s]
 26%|██▌       | 96470/371472 [7:40:24<22:32:11,  3.39it/s]
 26%|██▌       | 96471/371472 [7:40:24<22:38:02,  3.37it/s]
 26%|██▌       | 96472/371472 [7:40:24<24:07:51,  3.17it/s]
 26%|██▌       | 96473/371472 [7:40:25<22:23:14,  3.41it/s]
 26%|██▌       | 96474/371472 [7:40:25<21:09:47,  3.61it/s]
 26%|██▌       | 96475/371472 [7:40:25<24:06:33,  3.17it/s]
 26%|██▌       | 96476/371472 [7:40:26<23:14:46,  3.29it/s]
 26%|██▌       | 96477/371472 [7:40:26<21:55:19,  3.48it/s]
 26%|██▌       | 96478/371472 [7:40:26<22:02:54,  3.46it/s]
 26%|██▌       | 96479/371472 [7:40:26<22:00:00,  3.47it/s]
 26%|██▌       | 96480/371472 [7:40:27<21:39:58,  3.53it/s]
                                                           
{'loss': 3.8031, 'learning_rate': 7.666077700446034e-07, 'epoch': 4.16}

 26%|██▌       | 96480/371472 [7:40:27<21:39:58,  3.53it/s]
 26%|██▌       | 96481/371472 [7:40:27<22:46:55,  3.35it/s]
 26%|██▌       | 96482/371472 [7:40:27<22:21:33,  3.42it/s]
 26%|██▌       | 96483/371472 [7:40:28<21:30:09,  3.55it/s]
 26%|██▌       | 96484/371472 [7:40:28<21:21:19,  3.58it/s]
 26%|██▌       | 96485/371472 [7:40:28<21:51:14,  3.50it/s]
 26%|██▌       | 96486/371472 [7:40:28<21:54:32,  3.49it/s]
 26%|██▌       | 96487/371472 [7:40:29<21:06:45,  3.62it/s]
 26%|██▌       | 96488/371472 [7:40:29<20:39:58,  3.70it/s]
 26%|██▌       | 96489/371472 [7:40:29<20:53:58,  3.65it/s]
 26%|██▌       | 96490/371472 [7:40:30<20:50:18,  3.67it/s]
 26%|██▌       | 96491/371472 [7:40:30<20:06:42,  3.80it/s]
 26%|██▌       | 96492/371472 [7:40:30<20:11:56,  3.78it/s]
 26%|██▌       | 96493/371472 [7:40:30<19:42:50,  3.87it/s]
 26%|██▌       | 96494/371472 [7:40:31<20:06:07,  3.80it/s]
 26%|██▌       | 96495/371472 [7:40:31<20:59:06,  3.64it/s]
 26%|██▌       | 96496/371472 [7:40:31<22:02:16,  3.47it/s]
 26%|██▌       | 96497/371472 [7:40:31<21:02:41,  3.63it/s]
 26%|██▌       | 96498/371472 [7:40:32<20:04:52,  3.80it/s]
 26%|██▌       | 96499/371472 [7:40:32<19:53:44,  3.84it/s]
 26%|██▌       | 96500/371472 [7:40:32<20:11:33,  3.78it/s]
                                                           
{'loss': 3.553, 'learning_rate': 7.665592880691245e-07, 'epoch': 4.16}

 26%|██▌       | 96500/371472 [7:40:32<20:11:33,  3.78it/s]
 26%|██▌       | 96501/371472 [7:40:32<20:08:27,  3.79it/s]
 26%|██▌       | 96502/371472 [7:40:33<19:52:45,  3.84it/s]
 26%|██▌       | 96503/371472 [7:40:33<21:31:33,  3.55it/s]
 26%|██▌       | 96504/371472 [7:40:33<21:17:55,  3.59it/s]
 26%|██▌       | 96505/371472 [7:40:34<21:13:09,  3.60it/s]
 26%|██▌       | 96506/371472 [7:40:34<20:52:31,  3.66it/s]
 26%|██▌       | 96507/371472 [7:40:34<20:43:55,  3.68it/s]
 26%|██▌       | 96508/371472 [7:40:34<21:21:31,  3.58it/s]
 26%|██▌       | 96509/371472 [7:40:35<23:51:07,  3.20it/s]
 26%|██▌       | 96510/371472 [7:40:35<23:06:50,  3.30it/s]
 26%|██▌       | 96511/371472 [7:40:35<22:55:49,  3.33it/s]
 26%|██▌       | 96512/371472 [7:40:36<23:30:38,  3.25it/s]
 26%|██▌       | 96513/371472 [7:40:36<24:20:07,  3.14it/s]
 26%|██▌       | 96514/371472 [7:40:36<23:09:47,  3.30it/s]
 26%|██▌       | 96515/371472 [7:40:37<22:25:14,  3.41it/s]
 26%|██▌       | 96516/371472 [7:40:37<24:50:39,  3.07it/s]
 26%|██▌       | 96517/371472 [7:40:37<22:59:20,  3.32it/s]
 26%|██▌       | 96518/371472 [7:40:37<21:57:47,  3.48it/s]
 26%|██▌       | 96519/371472 [7:40:38<21:18:02,  3.59it/s]
 26%|██▌       | 96520/371472 [7:40:38<20:41:27,  3.69it/s]
                                                           
{'loss': 3.6871, 'learning_rate': 7.665108060936455e-07, 'epoch': 4.16}

 26%|██▌       | 96520/371472 [7:40:38<20:41:27,  3.69it/s]
 26%|██▌       | 96521/371472 [7:40:38<21:30:39,  3.55it/s]
 26%|██▌       | 96522/371472 [7:40:39<20:39:38,  3.70it/s]
 26%|██▌       | 96523/371472 [7:40:39<21:15:42,  3.59it/s]
 26%|██▌       | 96524/371472 [7:40:39<21:07:44,  3.61it/s]
 26%|██▌       | 96525/371472 [7:40:39<21:38:29,  3.53it/s]
 26%|██▌       | 96526/371472 [7:40:40<20:49:36,  3.67it/s]
 26%|██▌       | 96527/371472 [7:40:40<20:46:59,  3.67it/s]
 26%|██▌       | 96528/371472 [7:40:40<20:51:30,  3.66it/s]
 26%|██▌       | 96529/371472 [7:40:40<20:46:02,  3.68it/s]
 26%|██▌       | 96530/371472 [7:40:41<20:01:39,  3.81it/s]
 26%|██▌       | 96531/371472 [7:40:41<19:54:56,  3.83it/s]
 26%|██▌       | 96532/371472 [7:40:41<20:46:14,  3.68it/s]
 26%|██▌       | 96533/371472 [7:40:41<20:08:14,  3.79it/s]
 26%|██▌       | 96534/371472 [7:40:42<21:15:13,  3.59it/s]
 26%|██▌       | 96535/371472 [7:40:42<21:17:44,  3.59it/s]
 26%|██▌       | 96536/371472 [7:40:42<22:17:20,  3.43it/s]
 26%|██▌       | 96537/371472 [7:40:43<22:24:17,  3.41it/s]
 26%|██▌       | 96538/371472 [7:40:43<21:55:41,  3.48it/s]
 26%|██▌       | 96539/371472 [7:40:43<21:36:07,  3.54it/s]
 26%|██▌       | 96540/371472 [7:40:43<20:43:15,  3.69it/s]
                                                           
{'loss': 3.568, 'learning_rate': 7.664623241181667e-07, 'epoch': 4.16}

 26%|██▌       | 96540/371472 [7:40:43<20:43:15,  3.69it/s]
 26%|██▌       | 96541/371472 [7:40:44<20:27:38,  3.73it/s]
 26%|██▌       | 96542/371472 [7:40:44<20:27:09,  3.73it/s]
 26%|██▌       | 96543/371472 [7:40:44<20:12:28,  3.78it/s]
 26%|██▌       | 96544/371472 [7:40:45<19:55:01,  3.83it/s]
 26%|██▌       | 96545/371472 [7:40:45<20:14:27,  3.77it/s]
 26%|██▌       | 96546/371472 [7:40:45<20:08:48,  3.79it/s]
 26%|██▌       | 96547/371472 [7:40:45<21:35:12,  3.54it/s]
 26%|██▌       | 96548/371472 [7:40:46<21:58:22,  3.48it/s]
 26%|██▌       | 96549/371472 [7:40:46<20:57:18,  3.64it/s]
 26%|██▌       | 96550/371472 [7:40:46<20:06:20,  3.80it/s]
 26%|██▌       | 96551/371472 [7:40:47<22:15:56,  3.43it/s]
 26%|██▌       | 96552/371472 [7:40:47<21:54:56,  3.48it/s]
 26%|██▌       | 96553/371472 [7:40:47<21:56:15,  3.48it/s]
 26%|██▌       | 96554/371472 [7:40:47<23:07:15,  3.30it/s]
 26%|██▌       | 96555/371472 [7:40:48<22:16:39,  3.43it/s]
 26%|██▌       | 96556/371472 [7:40:48<21:43:02,  3.52it/s]
 26%|██▌       | 96557/371472 [7:40:48<21:33:33,  3.54it/s]
 26%|██▌       | 96558/371472 [7:40:48<20:36:07,  3.71it/s]
 26%|██▌       | 96559/371472 [7:40:49<20:41:24,  3.69it/s]
 26%|██▌       | 96560/371472 [7:40:49<21:47:08,  3.51it/s]
                                                           
{'loss': 3.6274, 'learning_rate': 7.664138421426879e-07, 'epoch': 4.16}

 26%|██▌       | 96560/371472 [7:40:49<21:47:08,  3.51it/s]
 26%|██▌       | 96561/371472 [7:40:49<22:18:26,  3.42it/s]
 26%|██▌       | 96562/371472 [7:40:50<21:16:22,  3.59it/s]
 26%|██▌       | 96563/371472 [7:40:50<22:08:41,  3.45it/s]
 26%|██▌       | 96564/371472 [7:40:50<21:14:07,  3.60it/s]
 26%|██▌       | 96565/371472 [7:40:51<22:13:42,  3.44it/s]
 26%|██▌       | 96566/371472 [7:40:51<21:06:08,  3.62it/s]
 26%|██▌       | 96567/371472 [7:40:51<20:48:09,  3.67it/s]
 26%|██▌       | 96568/371472 [7:40:51<20:48:31,  3.67it/s]
 26%|██▌       | 96569/371472 [7:40:52<20:14:13,  3.77it/s]
 26%|██▌       | 96570/371472 [7:40:52<20:26:47,  3.73it/s]
 26%|██▌       | 96571/371472 [7:40:52<20:30:04,  3.72it/s]
 26%|██▌       | 96572/371472 [7:40:52<22:37:10,  3.38it/s]
 26%|██▌       | 96573/371472 [7:40:53<21:48:49,  3.50it/s]
 26%|██▌       | 96574/371472 [7:40:53<22:01:03,  3.47it/s]
 26%|██▌       | 96575/371472 [7:40:53<21:37:05,  3.53it/s]
 26%|██▌       | 96576/371472 [7:40:54<23:21:58,  3.27it/s]
 26%|██▌       | 96577/371472 [7:40:54<22:40:32,  3.37it/s]
 26%|██▌       | 96578/371472 [7:40:54<22:53:54,  3.33it/s]
 26%|██▌       | 96579/371472 [7:40:54<21:39:29,  3.53it/s]
 26%|██▌       | 96580/371472 [7:40:55<20:56:58,  3.64it/s]
                                                           
{'loss': 3.7104, 'learning_rate': 7.663653601672089e-07, 'epoch': 4.16}

 26%|██▌       | 96580/371472 [7:40:55<20:56:58,  3.64it/s]
 26%|██▌       | 96581/371472 [7:40:55<21:15:15,  3.59it/s]
 26%|██▌       | 96582/371472 [7:40:55<20:21:47,  3.75it/s]
 26%|██▌       | 96583/371472 [7:40:56<20:56:02,  3.65it/s]
 26%|██▌       | 96584/371472 [7:40:56<20:27:42,  3.73it/s]
 26%|██▌       | 96585/371472 [7:40:56<21:57:22,  3.48it/s]
 26%|██▌       | 96586/371472 [7:40:56<21:21:56,  3.57it/s]
 26%|██▌       | 96587/371472 [7:40:57<21:30:46,  3.55it/s]
 26%|██▌       | 96588/371472 [7:40:57<21:40:46,  3.52it/s]
 26%|██▌       | 96589/371472 [7:40:57<23:32:32,  3.24it/s]
 26%|██▌       | 96590/371472 [7:40:58<22:27:42,  3.40it/s]
 26%|██▌       | 96591/371472 [7:40:58<22:12:28,  3.44it/s]
 26%|██▌       | 96592/371472 [7:40:58<22:44:32,  3.36it/s]
 26%|██▌       | 96593/371472 [7:40:58<22:13:31,  3.44it/s]
 26%|██▌       | 96594/371472 [7:40:59<22:53:08,  3.34it/s]
 26%|██▌       | 96595/371472 [7:40:59<22:36:34,  3.38it/s]
 26%|██▌       | 96596/371472 [7:40:59<23:02:15,  3.31it/s]
 26%|██▌       | 96597/371472 [7:41:00<22:05:58,  3.46it/s]
 26%|██▌       | 96598/371472 [7:41:00<21:20:29,  3.58it/s]
 26%|██▌       | 96599/371472 [7:41:00<20:33:52,  3.71it/s]
 26%|██▌       | 96600/371472 [7:41:00<20:31:43,  3.72it/s]
                                                           
{'loss': 3.7302, 'learning_rate': 7.663168781917299e-07, 'epoch': 4.16}

 26%|██▌       | 96600/371472 [7:41:00<20:31:43,  3.72it/s]
 26%|██▌       | 96601/371472 [7:41:01<19:54:08,  3.84it/s]
 26%|██▌       | 96602/371472 [7:41:01<21:24:53,  3.57it/s]
 26%|██▌       | 96603/371472 [7:41:01<21:07:34,  3.61it/s]
 26%|██▌       | 96604/371472 [7:41:02<20:35:11,  3.71it/s]
 26%|██▌       | 96605/371472 [7:41:02<20:14:55,  3.77it/s]
 26%|██▌       | 96606/371472 [7:41:02<21:04:34,  3.62it/s]
 26%|██▌       | 96607/371472 [7:41:02<20:24:21,  3.74it/s]
 26%|██▌       | 96608/371472 [7:41:03<22:55:03,  3.33it/s]
 26%|██▌       | 96609/371472 [7:41:03<22:12:58,  3.44it/s]
 26%|██▌       | 96610/371472 [7:41:03<21:18:28,  3.58it/s]
 26%|██▌       | 96611/371472 [7:41:03<21:02:04,  3.63it/s]
 26%|██▌       | 96612/371472 [7:41:04<21:01:30,  3.63it/s]
 26%|██▌       | 96613/371472 [7:41:04<21:15:35,  3.59it/s]
 26%|██▌       | 96614/371472 [7:41:04<20:32:19,  3.72it/s]
 26%|██▌       | 96615/371472 [7:41:05<20:36:00,  3.71it/s]
 26%|██▌       | 96616/371472 [7:41:05<20:59:58,  3.64it/s]
 26%|██▌       | 96617/371472 [7:41:05<21:20:20,  3.58it/s]
 26%|██▌       | 96618/371472 [7:41:06<24:15:53,  3.15it/s]
 26%|██▌       | 96619/371472 [7:41:06<24:34:59,  3.11it/s]
 26%|██▌       | 96620/371472 [7:41:06<23:22:54,  3.27it/s]
                                                           
{'loss': 3.6491, 'learning_rate': 7.662683962162511e-07, 'epoch': 4.16}

 26%|██▌       | 96620/371472 [7:41:06<23:22:54,  3.27it/s]
 26%|██▌       | 96621/371472 [7:41:06<22:17:49,  3.42it/s]
 26%|██▌       | 96622/371472 [7:41:07<22:04:32,  3.46it/s]
 26%|██▌       | 96623/371472 [7:41:07<21:51:53,  3.49it/s]
 26%|██▌       | 96624/371472 [7:41:07<23:16:30,  3.28it/s]
 26%|██▌       | 96625/371472 [7:41:08<22:52:39,  3.34it/s]
 26%|██▌       | 96626/371472 [7:41:08<21:22:12,  3.57it/s]
 26%|██▌       | 96627/371472 [7:41:08<21:08:01,  3.61it/s]
 26%|██▌       | 96628/371472 [7:41:08<23:11:57,  3.29it/s]
 26%|██▌       | 96629/371472 [7:41:09<21:53:07,  3.49it/s]
 26%|██▌       | 96630/371472 [7:41:09<23:25:39,  3.26it/s]
 26%|██▌       | 96631/371472 [7:41:09<22:46:33,  3.35it/s]
 26%|██▌       | 96632/371472 [7:41:10<22:26:53,  3.40it/s]
 26%|██▌       | 96633/371472 [7:41:10<21:19:58,  3.58it/s]
 26%|██▌       | 96634/371472 [7:41:10<21:47:48,  3.50it/s]
 26%|██▌       | 96635/371472 [7:41:10<21:47:35,  3.50it/s]
 26%|██▌       | 96636/371472 [7:41:11<21:01:35,  3.63it/s]
 26%|██▌       | 96637/371472 [7:41:11<22:54:39,  3.33it/s]
 26%|██▌       | 96638/371472 [7:41:11<21:57:35,  3.48it/s]
 26%|██▌       | 96639/371472 [7:41:12<21:10:46,  3.60it/s]
 26%|██▌       | 96640/371472 [7:41:12<21:22:58,  3.57it/s]
                                                           
{'loss': 3.753, 'learning_rate': 7.662199142407723e-07, 'epoch': 4.16}

 26%|██▌       | 96640/371472 [7:41:12<21:22:58,  3.57it/s]
 26%|██▌       | 96641/371472 [7:41:12<22:17:16,  3.43it/s]
 26%|██▌       | 96642/371472 [7:41:12<21:52:33,  3.49it/s]
 26%|██▌       | 96643/371472 [7:41:13<21:29:58,  3.55it/s]
 26%|██▌       | 96644/371472 [7:41:13<21:06:05,  3.62it/s]
 26%|██▌       | 96645/371472 [7:41:13<21:04:01,  3.62it/s]
 26%|██▌       | 96646/371472 [7:41:14<21:05:42,  3.62it/s]
 26%|██▌       | 96647/371472 [7:41:14<20:47:59,  3.67it/s]
 26%|██▌       | 96648/371472 [7:41:14<20:45:29,  3.68it/s]
 26%|██▌       | 96649/371472 [7:41:14<20:24:49,  3.74it/s]
 26%|██▌       | 96650/371472 [7:41:15<21:56:33,  3.48it/s]
 26%|██▌       | 96651/371472 [7:41:15<22:45:02,  3.36it/s]
 26%|██▌       | 96652/371472 [7:41:15<21:18:54,  3.58it/s]
 26%|██▌       | 96653/371472 [7:41:15<20:50:55,  3.66it/s]
 26%|██▌       | 96654/371472 [7:41:16<20:20:16,  3.75it/s]
 26%|██▌       | 96655/371472 [7:41:16<19:49:42,  3.85it/s]
 26%|██▌       | 96656/371472 [7:41:16<21:09:12,  3.61it/s]
 26%|██▌       | 96657/371472 [7:41:17<20:37:40,  3.70it/s]
 26%|██▌       | 96658/371472 [7:41:17<21:53:25,  3.49it/s]
 26%|██▌       | 96659/371472 [7:41:17<21:41:00,  3.52it/s]
 26%|██▌       | 96660/371472 [7:41:17<21:22:07,  3.57it/s]
                                                           
{'loss': 3.6668, 'learning_rate': 7.661714322652934e-07, 'epoch': 4.16}

 26%|██▌       | 96660/371472 [7:41:17<21:22:07,  3.57it/s]
 26%|██▌       | 96661/371472 [7:41:18<21:09:43,  3.61it/s]
 26%|██▌       | 96662/371472 [7:41:18<20:23:11,  3.74it/s]
 26%|██▌       | 96663/371472 [7:41:18<20:12:29,  3.78it/s]
 26%|██▌       | 96664/371472 [7:41:19<21:13:52,  3.60it/s]
 26%|██▌       | 96665/371472 [7:41:19<22:36:03,  3.38it/s]
 26%|██▌       | 96666/371472 [7:41:19<21:28:17,  3.56it/s]
 26%|██▌       | 96667/371472 [7:41:19<21:11:03,  3.60it/s]
 26%|██▌       | 96668/371472 [7:41:20<22:23:05,  3.41it/s]
 26%|██▌       | 96669/371472 [7:41:20<21:39:29,  3.52it/s]
 26%|██▌       | 96670/371472 [7:41:20<21:58:27,  3.47it/s]
 26%|██▌       | 96671/371472 [7:41:21<23:29:36,  3.25it/s]
 26%|██▌       | 96672/371472 [7:41:21<23:28:28,  3.25it/s]
 26%|██▌       | 96673/371472 [7:41:21<22:35:31,  3.38it/s]
 26%|██▌       | 96674/371472 [7:41:21<22:07:50,  3.45it/s]
 26%|██▌       | 96675/371472 [7:41:22<21:24:44,  3.56it/s]
 26%|██▌       | 96676/371472 [7:41:22<21:27:15,  3.56it/s]
 26%|██▌       | 96677/371472 [7:41:22<20:53:53,  3.65it/s]
 26%|██▌       | 96678/371472 [7:41:23<20:38:09,  3.70it/s]
 26%|██▌       | 96679/371472 [7:41:23<21:20:34,  3.58it/s]
 26%|██▌       | 96680/371472 [7:41:23<20:50:32,  3.66it/s]
                                                           
{'loss': 3.6697, 'learning_rate': 7.661229502898144e-07, 'epoch': 4.16}

 26%|██▌       | 96680/371472 [7:41:23<20:50:32,  3.66it/s]
 26%|██▌       | 96681/371472 [7:41:23<20:37:27,  3.70it/s]
 26%|██▌       | 96682/371472 [7:41:24<20:12:12,  3.78it/s]
 26%|██▌       | 96683/371472 [7:41:24<20:13:35,  3.77it/s]
 26%|██▌       | 96684/371472 [7:41:24<20:51:39,  3.66it/s]
 26%|██▌       | 96685/371472 [7:41:24<21:26:55,  3.56it/s]
 26%|██▌       | 96686/371472 [7:41:25<20:29:52,  3.72it/s]
 26%|██▌       | 96687/371472 [7:41:25<19:51:37,  3.84it/s]
 26%|██▌       | 96688/371472 [7:41:25<19:59:33,  3.82it/s]
 26%|██▌       | 96689/371472 [7:41:25<19:47:18,  3.86it/s]
 26%|██▌       | 96690/371472 [7:41:26<19:46:28,  3.86it/s]
 26%|██▌       | 96691/371472 [7:41:26<20:10:16,  3.78it/s]
 26%|██▌       | 96692/371472 [7:41:26<20:58:52,  3.64it/s]
 26%|██▌       | 96693/371472 [7:41:27<21:39:18,  3.52it/s]
 26%|██▌       | 96694/371472 [7:41:27<22:40:38,  3.37it/s]
 26%|██▌       | 96695/371472 [7:41:27<21:41:10,  3.52it/s]
 26%|██▌       | 96696/371472 [7:41:28<22:50:21,  3.34it/s]
 26%|██▌       | 96697/371472 [7:41:28<23:12:18,  3.29it/s]
 26%|██▌       | 96698/371472 [7:41:28<21:57:42,  3.48it/s]
 26%|██▌       | 96699/371472 [7:41:28<22:19:49,  3.42it/s]
 26%|██▌       | 96700/371472 [7:41:29<21:09:03,  3.61it/s]
                                                           
{'loss': 3.6219, 'learning_rate': 7.660744683143356e-07, 'epoch': 4.17}

 26%|██▌       | 96700/371472 [7:41:29<21:09:03,  3.61it/s]
 26%|██▌       | 96701/371472 [7:41:29<20:59:11,  3.64it/s]
 26%|██▌       | 96702/371472 [7:41:29<21:11:59,  3.60it/s]
 26%|██▌       | 96703/371472 [7:41:29<20:21:01,  3.75it/s]
 26%|██▌       | 96704/371472 [7:41:30<20:47:13,  3.67it/s]
 26%|██▌       | 96705/371472 [7:41:30<21:22:21,  3.57it/s]
 26%|██▌       | 96706/371472 [7:41:30<21:41:49,  3.52it/s]
 26%|██▌       | 96707/371472 [7:41:31<22:03:25,  3.46it/s]
 26%|██▌       | 96708/371472 [7:41:31<21:27:34,  3.56it/s]
 26%|██▌       | 96709/371472 [7:41:31<20:44:31,  3.68it/s]
 26%|██▌       | 96710/371472 [7:41:31<20:04:37,  3.80it/s]
 26%|██▌       | 96711/371472 [7:41:32<20:35:59,  3.71it/s]
 26%|██▌       | 96712/371472 [7:41:32<21:19:49,  3.58it/s]
 26%|██▌       | 96713/371472 [7:41:32<21:04:03,  3.62it/s]
 26%|██▌       | 96714/371472 [7:41:32<20:00:23,  3.81it/s]
 26%|██▌       | 96715/371472 [7:41:33<19:48:43,  3.85it/s]
 26%|██▌       | 96716/371472 [7:41:33<21:10:56,  3.60it/s]
 26%|██▌       | 96717/371472 [7:41:33<20:42:16,  3.69it/s]
 26%|██▌       | 96718/371472 [7:41:34<21:56:47,  3.48it/s]
 26%|██▌       | 96719/371472 [7:41:34<22:42:30,  3.36it/s]
 26%|██▌       | 96720/371472 [7:41:34<21:43:27,  3.51it/s]
                                                           
{'loss': 3.6411, 'learning_rate': 7.660259863388566e-07, 'epoch': 4.17}

 26%|██▌       | 96720/371472 [7:41:34<21:43:27,  3.51it/s]
 26%|██▌       | 96721/371472 [7:41:34<21:39:32,  3.52it/s]
 26%|██▌       | 96722/371472 [7:41:35<22:18:09,  3.42it/s]
 26%|██▌       | 96723/371472 [7:41:35<21:14:47,  3.59it/s]
 26%|██▌       | 96724/371472 [7:41:35<21:29:23,  3.55it/s]
 26%|██▌       | 96725/371472 [7:41:36<21:23:19,  3.57it/s]
 26%|██▌       | 96726/371472 [7:41:36<21:46:53,  3.50it/s]
 26%|██▌       | 96727/371472 [7:41:36<21:45:01,  3.51it/s]
 26%|██▌       | 96728/371472 [7:41:36<22:05:02,  3.46it/s]
 26%|██▌       | 96729/371472 [7:41:37<22:01:15,  3.47it/s]
 26%|██▌       | 96730/371472 [7:41:37<22:34:28,  3.38it/s]
 26%|██▌       | 96731/371472 [7:41:37<21:46:17,  3.51it/s]
 26%|██▌       | 96732/371472 [7:41:38<21:33:46,  3.54it/s]
 26%|██▌       | 96733/371472 [7:41:38<21:37:51,  3.53it/s]
 26%|██▌       | 96734/371472 [7:41:38<21:09:44,  3.61it/s]
 26%|██▌       | 96735/371472 [7:41:38<20:51:42,  3.66it/s]
 26%|██▌       | 96736/371472 [7:41:39<21:24:05,  3.57it/s]
 26%|██▌       | 96737/371472 [7:41:39<21:29:10,  3.55it/s]
 26%|██▌       | 96738/371472 [7:41:39<20:23:41,  3.74it/s]
 26%|██▌       | 96739/371472 [7:41:39<19:40:04,  3.88it/s]
 26%|██▌       | 96740/371472 [7:41:40<20:37:18,  3.70it/s]
                                                           
{'loss': 3.4607, 'learning_rate': 7.659775043633777e-07, 'epoch': 4.17}

 26%|██▌       | 96740/371472 [7:41:40<20:37:18,  3.70it/s]
 26%|██▌       | 96741/371472 [7:41:40<19:56:43,  3.83it/s]
 26%|██▌       | 96742/371472 [7:41:40<20:30:22,  3.72it/s]
 26%|██▌       | 96743/371472 [7:41:41<20:09:36,  3.79it/s]
 26%|██▌       | 96744/371472 [7:41:41<19:52:00,  3.84it/s]
 26%|██▌       | 96745/371472 [7:41:41<19:25:40,  3.93it/s]
 26%|██▌       | 96746/371472 [7:41:41<19:02:56,  4.01it/s]
 26%|██▌       | 96747/371472 [7:41:42<19:40:24,  3.88it/s]
 26%|██▌       | 96748/371472 [7:41:42<21:13:03,  3.60it/s]
 26%|██▌       | 96749/371472 [7:41:42<20:48:42,  3.67it/s]
 26%|██▌       | 96750/371472 [7:41:42<20:05:47,  3.80it/s]
 26%|██▌       | 96751/371472 [7:41:43<22:14:06,  3.43it/s]
 26%|██▌       | 96752/371472 [7:41:43<21:39:22,  3.52it/s]
 26%|██▌       | 96753/371472 [7:41:43<20:59:13,  3.64it/s]
 26%|██▌       | 96754/371472 [7:41:43<20:07:30,  3.79it/s]
 26%|██▌       | 96755/371472 [7:41:44<19:26:59,  3.92it/s]
 26%|██▌       | 96756/371472 [7:41:44<21:03:47,  3.62it/s]
 26%|██▌       | 96757/371472 [7:41:44<22:22:30,  3.41it/s]
 26%|██▌       | 96758/371472 [7:41:45<22:18:54,  3.42it/s]
 26%|██▌       | 96759/371472 [7:41:45<22:33:33,  3.38it/s]
 26%|██▌       | 96760/371472 [7:41:45<21:44:53,  3.51it/s]
                                                           
{'loss': 3.7117, 'learning_rate': 7.659290223878988e-07, 'epoch': 4.17}

 26%|██▌       | 96760/371472 [7:41:45<21:44:53,  3.51it/s]
 26%|██▌       | 96761/371472 [7:41:45<20:48:05,  3.67it/s]
 26%|██▌       | 96762/371472 [7:41:46<20:25:02,  3.74it/s]
 26%|██▌       | 96763/371472 [7:41:46<21:03:26,  3.62it/s]
 26%|██▌       | 96764/371472 [7:41:46<20:25:26,  3.74it/s]
 26%|██▌       | 96765/371472 [7:41:47<20:20:42,  3.75it/s]
 26%|██▌       | 96766/371472 [7:41:47<20:37:32,  3.70it/s]
 26%|██▌       | 96767/371472 [7:41:47<21:19:49,  3.58it/s]
 26%|██▌       | 96768/371472 [7:41:47<22:51:57,  3.34it/s]
 26%|██▌       | 96769/371472 [7:41:48<23:18:00,  3.27it/s]
 26%|██▌       | 96770/371472 [7:41:48<22:41:09,  3.36it/s]
 26%|██▌       | 96771/371472 [7:41:48<22:51:37,  3.34it/s]
 26%|██▌       | 96772/371472 [7:41:49<23:40:47,  3.22it/s]
 26%|██▌       | 96773/371472 [7:41:49<22:42:22,  3.36it/s]
 26%|██▌       | 96774/371472 [7:41:49<21:41:27,  3.52it/s]
 26%|██▌       | 96775/371472 [7:41:50<22:57:25,  3.32it/s]
 26%|██▌       | 96776/371472 [7:41:50<21:44:09,  3.51it/s]
 26%|██▌       | 96777/371472 [7:41:50<22:09:18,  3.44it/s]
 26%|██▌       | 96778/371472 [7:41:50<21:55:14,  3.48it/s]
 26%|██▌       | 96779/371472 [7:41:51<21:17:21,  3.58it/s]
 26%|██▌       | 96780/371472 [7:41:51<21:26:15,  3.56it/s]
                                                           
{'loss': 3.6294, 'learning_rate': 7.6588054041242e-07, 'epoch': 4.17}

 26%|██▌       | 96780/371472 [7:41:51<21:26:15,  3.56it/s]
 26%|██▌       | 96781/371472 [7:41:51<21:19:39,  3.58it/s]
 26%|██▌       | 96782/371472 [7:41:52<21:56:12,  3.48it/s]
 26%|██▌       | 96783/371472 [7:41:52<26:51:29,  2.84it/s]
 26%|██▌       | 96784/371472 [7:41:52<24:54:26,  3.06it/s]
 26%|██▌       | 96785/371472 [7:41:53<25:08:45,  3.03it/s]
 26%|██▌       | 96786/371472 [7:41:53<23:57:00,  3.19it/s]
 26%|██▌       | 96787/371472 [7:41:53<22:32:20,  3.39it/s]
 26%|██▌       | 96788/371472 [7:41:53<21:28:56,  3.55it/s]
 26%|██▌       | 96789/371472 [7:41:54<21:32:18,  3.54it/s]
 26%|██▌       | 96790/371472 [7:41:54<21:12:28,  3.60it/s]
 26%|██▌       | 96791/371472 [7:41:54<21:25:42,  3.56it/s]
 26%|██▌       | 96792/371472 [7:41:54<20:22:53,  3.74it/s]
 26%|██▌       | 96793/371472 [7:41:55<20:44:24,  3.68it/s]
 26%|██▌       | 96794/371472 [7:41:55<20:33:51,  3.71it/s]
 26%|██▌       | 96795/371472 [7:41:55<20:47:53,  3.67it/s]
 26%|██▌       | 96796/371472 [7:41:56<21:30:06,  3.55it/s]
 26%|██▌       | 96797/371472 [7:41:56<22:47:51,  3.35it/s]
 26%|██▌       | 96798/371472 [7:41:56<24:29:08,  3.12it/s]
 26%|██▌       | 96799/371472 [7:41:57<23:40:37,  3.22it/s]
 26%|██▌       | 96800/371472 [7:41:57<23:29:05,  3.25it/s]
                                                           
{'loss': 3.4917, 'learning_rate': 7.658320584369412e-07, 'epoch': 4.17}

 26%|██▌       | 96800/371472 [7:41:57<23:29:05,  3.25it/s]
 26%|██▌       | 96801/371472 [7:41:57<22:45:02,  3.35it/s]
 26%|██▌       | 96802/371472 [7:41:57<21:29:37,  3.55it/s]
 26%|██▌       | 96803/371472 [7:41:58<22:15:18,  3.43it/s]
 26%|██▌       | 96804/371472 [7:41:58<21:28:25,  3.55it/s]
 26%|██▌       | 96805/371472 [7:41:58<25:01:45,  3.05it/s]
 26%|██▌       | 96806/371472 [7:41:59<25:34:42,  2.98it/s]
 26%|██▌       | 96807/371472 [7:41:59<24:06:46,  3.16it/s]
 26%|██▌       | 96808/371472 [7:41:59<23:29:00,  3.25it/s]
 26%|██▌       | 96809/371472 [7:42:00<23:15:00,  3.28it/s]
 26%|██▌       | 96810/371472 [7:42:00<21:37:42,  3.53it/s]
 26%|██▌       | 96811/371472 [7:42:00<21:00:30,  3.63it/s]
 26%|██▌       | 96812/371472 [7:42:00<21:02:40,  3.63it/s]
 26%|██▌       | 96813/371472 [7:42:01<20:52:18,  3.66it/s]
 26%|██▌       | 96814/371472 [7:42:01<20:27:16,  3.73it/s]
 26%|██▌       | 96815/371472 [7:42:01<20:59:49,  3.63it/s]
 26%|██▌       | 96816/371472 [7:42:02<21:05:46,  3.62it/s]
 26%|██▌       | 96817/371472 [7:42:02<21:57:03,  3.48it/s]
 26%|██▌       | 96818/371472 [7:42:02<21:32:13,  3.54it/s]
 26%|██▌       | 96819/371472 [7:42:02<21:43:29,  3.51it/s]
 26%|██▌       | 96820/371472 [7:42:03<20:49:07,  3.66it/s]
                                                           
{'loss': 3.6277, 'learning_rate': 7.657835764614622e-07, 'epoch': 4.17}

 26%|██▌       | 96820/371472 [7:42:03<20:49:07,  3.66it/s]
 26%|██▌       | 96821/371472 [7:42:03<20:37:16,  3.70it/s]
 26%|██▌       | 96822/371472 [7:42:03<21:02:14,  3.63it/s]
 26%|██▌       | 96823/371472 [7:42:04<22:14:34,  3.43it/s]
 26%|██▌       | 96824/371472 [7:42:04<22:55:48,  3.33it/s]
 26%|██▌       | 96825/371472 [7:42:04<25:45:53,  2.96it/s]
 26%|██▌       | 96826/371472 [7:42:05<24:30:01,  3.11it/s]
 26%|██▌       | 96827/371472 [7:42:05<24:07:35,  3.16it/s]
 26%|██▌       | 96828/371472 [7:42:05<25:26:44,  3.00it/s]
 26%|██▌       | 96829/371472 [7:42:05<24:01:11,  3.18it/s]
 26%|██▌       | 96830/371472 [7:42:06<23:13:46,  3.28it/s]
 26%|██▌       | 96831/371472 [7:42:06<22:36:37,  3.37it/s]
 26%|██▌       | 96832/371472 [7:42:06<21:57:48,  3.47it/s]
 26%|██▌       | 96833/371472 [7:42:07<21:23:04,  3.57it/s]
 26%|██▌       | 96834/371472 [7:42:07<22:13:34,  3.43it/s]
 26%|██▌       | 96835/371472 [7:42:07<21:13:17,  3.59it/s]
 26%|██▌       | 96836/371472 [7:42:07<21:52:37,  3.49it/s]
 26%|██▌       | 96837/371472 [7:42:08<22:10:45,  3.44it/s]
 26%|██▌       | 96838/371472 [7:42:08<21:36:09,  3.53it/s]
 26%|██▌       | 96839/371472 [7:42:08<21:40:52,  3.52it/s]
 26%|██▌       | 96840/371472 [7:42:09<24:07:56,  3.16it/s]
                                                           
{'loss': 3.3923, 'learning_rate': 7.657350944859832e-07, 'epoch': 4.17}

 26%|██▌       | 96840/371472 [7:42:09<24:07:56,  3.16it/s]
 26%|██▌       | 96841/371472 [7:42:09<23:05:59,  3.30it/s]
 26%|██▌       | 96842/371472 [7:42:09<21:37:26,  3.53it/s]
 26%|██▌       | 96843/371472 [7:42:09<21:34:03,  3.54it/s]
 26%|██▌       | 96844/371472 [7:42:10<20:47:25,  3.67it/s]
 26%|██▌       | 96845/371472 [7:42:10<20:59:45,  3.63it/s]
 26%|██▌       | 96846/371472 [7:42:10<20:42:15,  3.68it/s]
 26%|██▌       | 96847/371472 [7:42:11<20:49:20,  3.66it/s]
 26%|██▌       | 96848/371472 [7:42:11<21:29:24,  3.55it/s]
 26%|██▌       | 96849/371472 [7:42:11<20:33:33,  3.71it/s]
 26%|██▌       | 96850/371472 [7:42:11<20:59:55,  3.63it/s]
 26%|██▌       | 96851/371472 [7:42:12<20:51:27,  3.66it/s]
 26%|██▌       | 96852/371472 [7:42:12<21:05:39,  3.62it/s]
 26%|██▌       | 96853/371472 [7:42:12<20:37:52,  3.70it/s]
 26%|██▌       | 96854/371472 [7:42:13<22:49:15,  3.34it/s]
 26%|██▌       | 96855/371472 [7:42:13<22:38:45,  3.37it/s]
 26%|██▌       | 96856/371472 [7:42:13<23:15:53,  3.28it/s]
 26%|██▌       | 96857/371472 [7:42:13<22:34:07,  3.38it/s]
 26%|██▌       | 96858/371472 [7:42:14<22:19:04,  3.42it/s]
 26%|██▌       | 96859/371472 [7:42:14<21:35:40,  3.53it/s]
 26%|██▌       | 96860/371472 [7:42:14<21:42:49,  3.51it/s]
                                                           
{'loss': 3.5579, 'learning_rate': 7.656866125105044e-07, 'epoch': 4.17}

 26%|██▌       | 96860/371472 [7:42:14<21:42:49,  3.51it/s]
 26%|██▌       | 96861/371472 [7:42:15<21:33:55,  3.54it/s]
 26%|██▌       | 96862/371472 [7:42:15<21:19:11,  3.58it/s]
 26%|██▌       | 96863/371472 [7:42:15<21:07:35,  3.61it/s]
 26%|██▌       | 96864/371472 [7:42:15<20:36:47,  3.70it/s]
 26%|██▌       | 96865/371472 [7:42:16<20:24:17,  3.74it/s]
 26%|██▌       | 96866/371472 [7:42:16<20:09:56,  3.78it/s]
 26%|██▌       | 96867/371472 [7:42:16<20:02:47,  3.81it/s]
 26%|██▌       | 96868/371472 [7:42:16<20:03:15,  3.80it/s]
 26%|██▌       | 96869/371472 [7:42:17<20:26:32,  3.73it/s]
 26%|██▌       | 96870/371472 [7:42:17<21:26:16,  3.56it/s]
 26%|██▌       | 96871/371472 [7:42:17<21:56:41,  3.48it/s]
 26%|██▌       | 96872/371472 [7:42:18<21:46:21,  3.50it/s]
 26%|██▌       | 96873/371472 [7:42:18<21:26:41,  3.56it/s]
 26%|██▌       | 96874/371472 [7:42:18<21:08:17,  3.61it/s]
 26%|██▌       | 96875/371472 [7:42:18<21:20:23,  3.57it/s]
 26%|██▌       | 96876/371472 [7:42:19<21:28:12,  3.55it/s]
 26%|██▌       | 96877/371472 [7:42:19<22:42:11,  3.36it/s]
 26%|██▌       | 96878/371472 [7:42:19<22:21:38,  3.41it/s]
 26%|██▌       | 96879/371472 [7:42:20<23:09:13,  3.29it/s]
 26%|██▌       | 96880/371472 [7:42:20<21:31:18,  3.54it/s]
                                                           
{'loss': 3.5401, 'learning_rate': 7.656381305350256e-07, 'epoch': 4.17}

 26%|██▌       | 96880/371472 [7:42:20<21:31:18,  3.54it/s]
 26%|██▌       | 96881/371472 [7:42:20<22:22:20,  3.41it/s]
 26%|██▌       | 96882/371472 [7:42:20<22:00:12,  3.47it/s]
 26%|██▌       | 96883/371472 [7:42:21<21:33:12,  3.54it/s]
 26%|██▌       | 96884/371472 [7:42:21<21:28:52,  3.55it/s]
 26%|██▌       | 96885/371472 [7:42:21<21:36:22,  3.53it/s]
 26%|██▌       | 96886/371472 [7:42:22<22:06:51,  3.45it/s]
 26%|██▌       | 96887/371472 [7:42:22<21:46:58,  3.50it/s]
 26%|██▌       | 96888/371472 [7:42:22<20:58:05,  3.64it/s]
 26%|██▌       | 96889/371472 [7:42:22<21:44:17,  3.51it/s]
 26%|██▌       | 96890/371472 [7:42:23<21:44:05,  3.51it/s]
 26%|██▌       | 96891/371472 [7:42:23<20:43:21,  3.68it/s]
 26%|██▌       | 96892/371472 [7:42:23<21:52:01,  3.49it/s]
 26%|██▌       | 96893/371472 [7:42:24<21:10:24,  3.60it/s]
 26%|██▌       | 96894/371472 [7:42:24<20:25:22,  3.73it/s]
 26%|██▌       | 96895/371472 [7:42:24<20:52:50,  3.65it/s]
 26%|██▌       | 96896/371472 [7:42:24<20:55:09,  3.65it/s]
 26%|██▌       | 96897/371472 [7:42:25<21:35:52,  3.53it/s]
 26%|██▌       | 96898/371472 [7:42:25<20:45:41,  3.67it/s]
 26%|██▌       | 96899/371472 [7:42:25<20:26:31,  3.73it/s]
 26%|██▌       | 96900/371472 [7:42:25<20:00:38,  3.81it/s]
                                                           
{'loss': 3.7217, 'learning_rate': 7.655896485595465e-07, 'epoch': 4.17}

 26%|██▌       | 96900/371472 [7:42:25<20:00:38,  3.81it/s]
 26%|██▌       | 96901/371472 [7:42:26<21:28:23,  3.55it/s]
 26%|██▌       | 96902/371472 [7:42:26<20:24:46,  3.74it/s]
 26%|██▌       | 96903/371472 [7:42:26<19:56:22,  3.83it/s]
 26%|██▌       | 96904/371472 [7:42:26<19:49:01,  3.85it/s]
 26%|██▌       | 96905/371472 [7:42:27<20:14:03,  3.77it/s]
 26%|██▌       | 96906/371472 [7:42:27<21:27:00,  3.56it/s]
 26%|██▌       | 96907/371472 [7:42:27<21:54:57,  3.48it/s]
 26%|██▌       | 96908/371472 [7:42:28<21:06:46,  3.61it/s]
 26%|██▌       | 96909/371472 [7:42:28<21:41:45,  3.52it/s]
 26%|██▌       | 96910/371472 [7:42:28<21:48:40,  3.50it/s]
 26%|██▌       | 96911/371472 [7:42:28<21:19:31,  3.58it/s]
 26%|██▌       | 96912/371472 [7:42:29<20:57:25,  3.64it/s]
 26%|██▌       | 96913/371472 [7:42:29<21:05:16,  3.62it/s]
 26%|██▌       | 96914/371472 [7:42:29<20:28:31,  3.72it/s]
 26%|██▌       | 96915/371472 [7:42:30<20:33:15,  3.71it/s]
 26%|██▌       | 96916/371472 [7:42:30<20:50:28,  3.66it/s]
 26%|██▌       | 96917/371472 [7:42:30<20:43:39,  3.68it/s]
 26%|██▌       | 96918/371472 [7:42:30<20:24:47,  3.74it/s]
 26%|██▌       | 96919/371472 [7:42:31<19:54:22,  3.83it/s]
 26%|██▌       | 96920/371472 [7:42:31<21:14:31,  3.59it/s]
                                                           
{'loss': 3.5982, 'learning_rate': 7.655411665840677e-07, 'epoch': 4.17}

 26%|██▌       | 96920/371472 [7:42:31<21:14:31,  3.59it/s]
 26%|██▌       | 96921/371472 [7:42:31<22:09:48,  3.44it/s]
 26%|██▌       | 96922/371472 [7:42:32<21:49:47,  3.49it/s]
 26%|██▌       | 96923/371472 [7:42:32<21:36:21,  3.53it/s]
 26%|██▌       | 96924/371472 [7:42:32<20:34:23,  3.71it/s]
 26%|██▌       | 96925/371472 [7:42:32<21:22:49,  3.57it/s]
 26%|██▌       | 96926/371472 [7:42:33<21:15:20,  3.59it/s]
 26%|██▌       | 96927/371472 [7:42:33<21:16:18,  3.59it/s]
 26%|██▌       | 96928/371472 [7:42:33<22:47:44,  3.35it/s]
 26%|██▌       | 96929/371472 [7:42:33<21:29:38,  3.55it/s]
 26%|██▌       | 96930/371472 [7:42:34<21:44:25,  3.51it/s]
 26%|██▌       | 96931/371472 [7:42:34<21:33:18,  3.54it/s]
 26%|██▌       | 96932/371472 [7:42:34<22:47:59,  3.34it/s]
 26%|██▌       | 96933/371472 [7:42:35<23:05:16,  3.30it/s]
 26%|██▌       | 96934/371472 [7:42:35<22:21:34,  3.41it/s]
 26%|██▌       | 96935/371472 [7:42:35<24:42:29,  3.09it/s]
 26%|██▌       | 96936/371472 [7:42:36<24:58:07,  3.05it/s]
 26%|██▌       | 96937/371472 [7:42:36<23:40:26,  3.22it/s]
 26%|██▌       | 96938/371472 [7:42:36<22:34:00,  3.38it/s]
 26%|██▌       | 96939/371472 [7:42:37<22:37:39,  3.37it/s]
 26%|██▌       | 96940/371472 [7:42:37<21:50:17,  3.49it/s]
                                                           
{'loss': 3.6811, 'learning_rate': 7.654926846085889e-07, 'epoch': 4.18}

 26%|██▌       | 96940/371472 [7:42:37<21:50:17,  3.49it/s]
 26%|██▌       | 96941/371472 [7:42:37<22:06:42,  3.45it/s]
 26%|██▌       | 96942/371472 [7:42:37<22:03:33,  3.46it/s]
 26%|██▌       | 96943/371472 [7:42:38<22:06:06,  3.45it/s]
 26%|██▌       | 96944/371472 [7:42:38<21:11:18,  3.60it/s]
 26%|██▌       | 96945/371472 [7:42:38<21:11:22,  3.60it/s]
 26%|██▌       | 96946/371472 [7:42:38<20:41:15,  3.69it/s]
 26%|██▌       | 96947/371472 [7:42:39<20:28:48,  3.72it/s]
 26%|██▌       | 96948/371472 [7:42:39<20:33:46,  3.71it/s]
 26%|██▌       | 96949/371472 [7:42:39<20:17:56,  3.76it/s]
 26%|██▌       | 96950/371472 [7:42:40<22:29:31,  3.39it/s]
 26%|██▌       | 96951/371472 [7:42:40<22:01:37,  3.46it/s]
 26%|██▌       | 96952/371472 [7:42:40<21:40:52,  3.52it/s]
 26%|██▌       | 96953/371472 [7:42:41<23:39:26,  3.22it/s]
 26%|██▌       | 96954/371472 [7:42:41<23:14:35,  3.28it/s]
 26%|██▌       | 96955/371472 [7:42:41<22:25:03,  3.40it/s]
 26%|██▌       | 96956/371472 [7:42:41<22:10:00,  3.44it/s]
 26%|██▌       | 96957/371472 [7:42:42<21:07:33,  3.61it/s]
 26%|██▌       | 96958/371472 [7:42:42<23:24:19,  3.26it/s]
 26%|██▌       | 96959/371472 [7:42:42<22:08:23,  3.44it/s]
 26%|██▌       | 96960/371472 [7:42:42<21:31:48,  3.54it/s]
                                                           
{'loss': 3.6916, 'learning_rate': 7.654442026331099e-07, 'epoch': 4.18}

 26%|██▌       | 96960/371472 [7:42:42<21:31:48,  3.54it/s]
 26%|██▌       | 96961/371472 [7:42:43<22:10:31,  3.44it/s]
 26%|██▌       | 96962/371472 [7:42:43<21:30:27,  3.55it/s]
 26%|██▌       | 96963/371472 [7:42:43<20:54:10,  3.65it/s]
 26%|██▌       | 96964/371472 [7:42:44<21:05:03,  3.62it/s]
 26%|██▌       | 96965/371472 [7:42:44<20:18:11,  3.76it/s]
 26%|██▌       | 96966/371472 [7:42:44<20:55:38,  3.64it/s]
 26%|██▌       | 96967/371472 [7:42:44<20:35:25,  3.70it/s]
 26%|██▌       | 96968/371472 [7:42:45<22:09:50,  3.44it/s]
 26%|██▌       | 96969/371472 [7:42:45<21:12:55,  3.59it/s]
 26%|██▌       | 96970/371472 [7:42:45<20:56:39,  3.64it/s]
 26%|██▌       | 96971/371472 [7:42:46<23:40:55,  3.22it/s]
 26%|██▌       | 96972/371472 [7:42:46<22:20:31,  3.41it/s]
 26%|██▌       | 96973/371472 [7:42:46<21:55:59,  3.48it/s]
 26%|██▌       | 96974/371472 [7:42:46<22:33:38,  3.38it/s]
 26%|██▌       | 96975/371472 [7:42:47<21:26:44,  3.56it/s]
 26%|██▌       | 96976/371472 [7:42:47<21:11:20,  3.60it/s]
 26%|██▌       | 96977/371472 [7:42:47<21:00:33,  3.63it/s]
 26%|██▌       | 96978/371472 [7:42:48<20:28:03,  3.73it/s]
 26%|██▌       | 96979/371472 [7:42:48<20:18:52,  3.75it/s]
 26%|██▌       | 96980/371472 [7:42:48<19:59:46,  3.81it/s]
                                                           
{'loss': 3.6281, 'learning_rate': 7.653957206576309e-07, 'epoch': 4.18}

 26%|██▌       | 96980/371472 [7:42:48<19:59:46,  3.81it/s]
 26%|██▌       | 96981/371472 [7:42:48<20:18:21,  3.75it/s]
 26%|██▌       | 96982/371472 [7:42:49<20:35:21,  3.70it/s]
 26%|██▌       | 96983/371472 [7:42:49<22:48:56,  3.34it/s]
 26%|██▌       | 96984/371472 [7:42:49<21:32:47,  3.54it/s]
 26%|██▌       | 96985/371472 [7:42:50<22:37:57,  3.37it/s]
 26%|██▌       | 96986/371472 [7:42:50<21:31:46,  3.54it/s]
 26%|██▌       | 96987/371472 [7:42:50<21:52:09,  3.49it/s]
 26%|██▌       | 96988/371472 [7:42:50<22:31:28,  3.39it/s]
 26%|██▌       | 96989/371472 [7:42:51<22:29:03,  3.39it/s]
 26%|██▌       | 96990/371472 [7:42:51<21:43:30,  3.51it/s]
 26%|██▌       | 96991/371472 [7:42:51<21:00:30,  3.63it/s]
 26%|██▌       | 96992/371472 [7:42:51<20:42:15,  3.68it/s]
 26%|██▌       | 96993/371472 [7:42:52<22:55:43,  3.33it/s]
 26%|██▌       | 96994/371472 [7:42:52<23:53:57,  3.19it/s]
 26%|██▌       | 96995/371472 [7:42:52<22:17:50,  3.42it/s]
 26%|██▌       | 96996/371472 [7:42:53<23:04:18,  3.30it/s]
 26%|██▌       | 96997/371472 [7:42:53<22:28:28,  3.39it/s]
 26%|██▌       | 96998/371472 [7:42:53<22:32:51,  3.38it/s]
 26%|██▌       | 96999/371472 [7:42:54<21:42:18,  3.51it/s]
 26%|██▌       | 97000/371472 [7:42:54<21:14:14,  3.59it/s]
                                                           
{'loss': 3.4743, 'learning_rate': 7.653472386821521e-07, 'epoch': 4.18}

 26%|██▌       | 97000/371472 [7:42:54<21:14:14,  3.59it/s]
 26%|██▌       | 97001/371472 [7:42:54<21:13:33,  3.59it/s]
 26%|██▌       | 97002/371472 [7:42:54<20:11:21,  3.78it/s]
 26%|██▌       | 97003/371472 [7:42:55<19:49:39,  3.85it/s]
 26%|██▌       | 97004/371472 [7:42:55<20:06:36,  3.79it/s]
 26%|██▌       | 97005/371472 [7:42:55<20:23:01,  3.74it/s]
 26%|██▌       | 97006/371472 [7:42:55<19:43:14,  3.87it/s]
 26%|██▌       | 97007/371472 [7:42:56<19:38:32,  3.88it/s]
 26%|██▌       | 97008/371472 [7:42:56<19:29:28,  3.91it/s]
 26%|██▌       | 97009/371472 [7:42:56<19:33:20,  3.90it/s]
 26%|██▌       | 97010/371472 [7:42:56<19:49:26,  3.85it/s]
 26%|██▌       | 97011/371472 [7:42:57<21:27:07,  3.55it/s]
 26%|██▌       | 97012/371472 [7:42:57<22:41:23,  3.36it/s]
 26%|██▌       | 97013/371472 [7:42:57<23:26:40,  3.25it/s]
 26%|██▌       | 97014/371472 [7:42:58<22:00:57,  3.46it/s]
 26%|██▌       | 97015/371472 [7:42:58<20:56:33,  3.64it/s]
 26%|██▌       | 97016/371472 [7:42:58<21:10:25,  3.60it/s]
 26%|██▌       | 97017/371472 [7:42:58<20:28:09,  3.72it/s]
 26%|██▌       | 97018/371472 [7:42:59<20:45:56,  3.67it/s]
 26%|██▌       | 97019/371472 [7:42:59<21:45:34,  3.50it/s]
 26%|██▌       | 97020/371472 [7:42:59<23:45:04,  3.21it/s]
                                                           
{'loss': 3.5921, 'learning_rate': 7.652987567066733e-07, 'epoch': 4.18}

 26%|██▌       | 97020/371472 [7:42:59<23:45:04,  3.21it/s]
 26%|██▌       | 97021/371472 [7:43:00<22:13:12,  3.43it/s]
 26%|██▌       | 97022/371472 [7:43:00<21:39:28,  3.52it/s]
 26%|██▌       | 97023/371472 [7:43:00<21:03:51,  3.62it/s]
 26%|██▌       | 97024/371472 [7:43:00<21:52:42,  3.48it/s]
 26%|██▌       | 97025/371472 [7:43:01<21:33:37,  3.54it/s]
 26%|██▌       | 97026/371472 [7:43:01<20:57:56,  3.64it/s]
 26%|██▌       | 97027/371472 [7:43:01<20:24:55,  3.73it/s]
 26%|██▌       | 97028/371472 [7:43:02<20:01:42,  3.81it/s]
 26%|██▌       | 97029/371472 [7:43:02<20:38:26,  3.69it/s]
 26%|██▌       | 97030/371472 [7:43:02<20:31:47,  3.71it/s]
 26%|██▌       | 97031/371472 [7:43:02<19:57:18,  3.82it/s]
 26%|██▌       | 97032/371472 [7:43:03<19:37:58,  3.88it/s]
 26%|██▌       | 97033/371472 [7:43:03<20:25:59,  3.73it/s]
 26%|██▌       | 97034/371472 [7:43:03<20:32:10,  3.71it/s]
 26%|██▌       | 97035/371472 [7:43:03<20:23:19,  3.74it/s]
 26%|██▌       | 97036/371472 [7:43:04<20:49:59,  3.66it/s]
 26%|██▌       | 97037/371472 [7:43:04<20:50:44,  3.66it/s]
 26%|██▌       | 97038/371472 [7:43:04<21:09:01,  3.60it/s]
 26%|██▌       | 97039/371472 [7:43:05<22:16:42,  3.42it/s]
 26%|██▌       | 97040/371472 [7:43:05<22:15:45,  3.42it/s]
                                                           
{'loss': 3.5673, 'learning_rate': 7.652502747311944e-07, 'epoch': 4.18}

 26%|██▌       | 97040/371472 [7:43:05<22:15:45,  3.42it/s]
 26%|██▌       | 97041/371472 [7:43:05<21:48:54,  3.49it/s]
 26%|██▌       | 97042/371472 [7:43:05<21:56:38,  3.47it/s]
 26%|██▌       | 97043/371472 [7:43:06<21:05:21,  3.61it/s]
 26%|██▌       | 97044/371472 [7:43:06<23:41:58,  3.22it/s]
 26%|██▌       | 97045/371472 [7:43:06<23:12:45,  3.28it/s]
 26%|██▌       | 97046/371472 [7:43:07<23:09:16,  3.29it/s]
 26%|██▌       | 97047/371472 [7:43:07<22:22:11,  3.41it/s]
 26%|██▌       | 97048/371472 [7:43:07<21:33:26,  3.54it/s]
 26%|██▌       | 97049/371472 [7:43:07<21:35:09,  3.53it/s]
 26%|██▌       | 97050/371472 [7:43:08<21:08:44,  3.60it/s]
 26%|██▌       | 97051/371472 [7:43:08<21:09:19,  3.60it/s]
 26%|██▌       | 97052/371472 [7:43:08<21:31:49,  3.54it/s]
 26%|██▌       | 97053/371472 [7:43:09<21:53:00,  3.48it/s]
 26%|██▌       | 97054/371472 [7:43:09<22:19:51,  3.41it/s]
 26%|██▌       | 97055/371472 [7:43:09<21:50:21,  3.49it/s]
 26%|██▌       | 97056/371472 [7:43:09<20:59:35,  3.63it/s]
 26%|██▌       | 97057/371472 [7:43:10<20:37:03,  3.70it/s]
 26%|██▌       | 97058/371472 [7:43:10<20:15:20,  3.76it/s]
 26%|██▌       | 97059/371472 [7:43:10<19:52:04,  3.84it/s]
 26%|██▌       | 97060/371472 [7:43:11<21:17:25,  3.58it/s]
                                                           
{'loss': 3.6073, 'learning_rate': 7.652017927557154e-07, 'epoch': 4.18}

 26%|██▌       | 97060/371472 [7:43:11<21:17:25,  3.58it/s]
 26%|██▌       | 97061/371472 [7:43:11<21:05:30,  3.61it/s]
 26%|██▌       | 97062/371472 [7:43:11<20:52:42,  3.65it/s]
 26%|██▌       | 97063/371472 [7:43:11<24:35:17,  3.10it/s]
 26%|██▌       | 97064/371472 [7:43:12<23:31:34,  3.24it/s]
 26%|██▌       | 97065/371472 [7:43:12<23:15:01,  3.28it/s]
 26%|██▌       | 97066/371472 [7:43:12<23:12:01,  3.29it/s]
 26%|██▌       | 97067/371472 [7:43:13<22:03:23,  3.46it/s]
 26%|██▌       | 97068/371472 [7:43:13<22:13:53,  3.43it/s]
 26%|██▌       | 97069/371472 [7:43:13<22:12:17,  3.43it/s]
 26%|██▌       | 97070/371472 [7:43:13<21:20:29,  3.57it/s]
 26%|██▌       | 97071/371472 [7:43:14<21:08:32,  3.61it/s]
 26%|██▌       | 97072/371472 [7:43:14<20:19:48,  3.75it/s]
 26%|██▌       | 97073/371472 [7:43:14<21:34:29,  3.53it/s]
 26%|██▌       | 97074/371472 [7:43:15<20:32:53,  3.71it/s]
 26%|██▌       | 97075/371472 [7:43:15<20:20:18,  3.75it/s]
 26%|██▌       | 97076/371472 [7:43:15<20:53:16,  3.65it/s]
 26%|██▌       | 97077/371472 [7:43:15<23:44:15,  3.21it/s]
 26%|██▌       | 97078/371472 [7:43:16<22:51:11,  3.34it/s]
 26%|██▌       | 97079/371472 [7:43:16<22:07:45,  3.44it/s]
 26%|██▌       | 97080/371472 [7:43:16<23:24:30,  3.26it/s]
                                                           
{'loss': 3.5392, 'learning_rate': 7.651533107802366e-07, 'epoch': 4.18}

 26%|██▌       | 97080/371472 [7:43:16<23:24:30,  3.26it/s]
 26%|██▌       | 97081/371472 [7:43:17<22:42:35,  3.36it/s]
 26%|██▌       | 97082/371472 [7:43:17<23:55:46,  3.19it/s]
 26%|██▌       | 97083/371472 [7:43:17<22:51:27,  3.33it/s]
 26%|██▌       | 97084/371472 [7:43:18<24:24:51,  3.12it/s]
 26%|██▌       | 97085/371472 [7:43:18<22:42:49,  3.36it/s]
 26%|██▌       | 97086/371472 [7:43:18<23:55:12,  3.19it/s]
 26%|██▌       | 97087/371472 [7:43:19<22:44:51,  3.35it/s]
 26%|██▌       | 97088/371472 [7:43:19<21:43:13,  3.51it/s]
 26%|██▌       | 97089/371472 [7:43:19<22:20:32,  3.41it/s]
 26%|██▌       | 97090/371472 [7:43:19<22:08:57,  3.44it/s]
 26%|██▌       | 97091/371472 [7:43:20<21:10:26,  3.60it/s]
 26%|██▌       | 97092/371472 [7:43:20<20:30:56,  3.72it/s]
 26%|██▌       | 97093/371472 [7:43:20<20:06:08,  3.79it/s]
 26%|██▌       | 97094/371472 [7:43:20<20:19:12,  3.75it/s]
 26%|██▌       | 97095/371472 [7:43:21<20:45:06,  3.67it/s]
 26%|██▌       | 97096/371472 [7:43:21<20:30:20,  3.72it/s]
 26%|██▌       | 97097/371472 [7:43:21<20:04:03,  3.80it/s]
 26%|██▌       | 97098/371472 [7:43:21<21:19:02,  3.58it/s]
 26%|██▌       | 97099/371472 [7:43:22<23:47:26,  3.20it/s]
 26%|██▌       | 97100/371472 [7:43:22<23:07:19,  3.30it/s]
                                                           
{'loss': 3.5971, 'learning_rate': 7.651048288047577e-07, 'epoch': 4.18}

 26%|██▌       | 97100/371472 [7:43:22<23:07:19,  3.30it/s]
 26%|██▌       | 97101/371472 [7:43:22<22:38:29,  3.37it/s]
 26%|██▌       | 97102/371472 [7:43:23<22:41:47,  3.36it/s]
 26%|██▌       | 97103/371472 [7:43:23<21:54:35,  3.48it/s]
 26%|██▌       | 97104/371472 [7:43:23<21:59:38,  3.47it/s]
 26%|██▌       | 97105/371472 [7:43:24<21:44:57,  3.50it/s]
 26%|██▌       | 97106/371472 [7:43:24<21:42:40,  3.51it/s]
 26%|██▌       | 97107/371472 [7:43:24<21:05:04,  3.61it/s]
 26%|██▌       | 97108/371472 [7:43:24<20:27:22,  3.73it/s]
 26%|██▌       | 97109/371472 [7:43:25<20:46:42,  3.67it/s]
 26%|██▌       | 97110/371472 [7:43:25<20:29:45,  3.72it/s]
 26%|██▌       | 97111/371472 [7:43:25<20:48:30,  3.66it/s]
 26%|██▌       | 97112/371472 [7:43:25<20:45:33,  3.67it/s]
 26%|██▌       | 97113/371472 [7:43:26<20:35:01,  3.70it/s]
 26%|██▌       | 97114/371472 [7:43:26<21:44:17,  3.51it/s]
 26%|██▌       | 97115/371472 [7:43:26<21:03:32,  3.62it/s]
 26%|██▌       | 97116/371472 [7:43:27<22:05:14,  3.45it/s]
 26%|██▌       | 97117/371472 [7:43:27<21:16:16,  3.58it/s]
 26%|██▌       | 97118/371472 [7:43:27<20:51:01,  3.66it/s]
 26%|██▌       | 97119/371472 [7:43:27<20:23:21,  3.74it/s]
 26%|██▌       | 97120/371472 [7:43:28<20:16:33,  3.76it/s]
                                                           
{'loss': 3.557, 'learning_rate': 7.650563468292787e-07, 'epoch': 4.18}

 26%|██▌       | 97120/371472 [7:43:28<20:16:33,  3.76it/s]
 26%|██▌       | 97121/371472 [7:43:28<19:34:41,  3.89it/s]
 26%|██▌       | 97122/371472 [7:43:28<21:04:25,  3.62it/s]
 26%|██▌       | 97123/371472 [7:43:29<22:04:33,  3.45it/s]
 26%|██▌       | 97124/371472 [7:43:29<21:04:29,  3.62it/s]
 26%|██▌       | 97125/371472 [7:43:29<20:58:43,  3.63it/s]
 26%|██▌       | 97126/371472 [7:43:29<21:55:15,  3.48it/s]
 26%|██▌       | 97127/371472 [7:43:30<21:58:06,  3.47it/s]
 26%|██▌       | 97128/371472 [7:43:30<21:14:46,  3.59it/s]
 26%|██▌       | 97129/371472 [7:43:30<20:55:46,  3.64it/s]
 26%|██▌       | 97130/371472 [7:43:30<21:16:44,  3.58it/s]
 26%|██▌       | 97131/371472 [7:43:31<20:51:04,  3.65it/s]
 26%|██▌       | 97132/371472 [7:43:31<20:19:04,  3.75it/s]
 26%|██▌       | 97133/371472 [7:43:31<19:44:10,  3.86it/s]
 26%|██▌       | 97134/371472 [7:43:31<19:23:46,  3.93it/s]
 26%|██▌       | 97135/371472 [7:43:32<19:05:55,  3.99it/s]
 26%|██▌       | 97136/371472 [7:43:32<19:26:54,  3.92it/s]
 26%|██▌       | 97137/371472 [7:43:32<20:47:14,  3.67it/s]
 26%|██▌       | 97138/371472 [7:43:33<20:22:39,  3.74it/s]
 26%|██▌       | 97139/371472 [7:43:33<20:42:24,  3.68it/s]
 26%|██▌       | 97140/371472 [7:43:33<20:35:24,  3.70it/s]
                                                           
{'loss': 3.6023, 'learning_rate': 7.650078648537998e-07, 'epoch': 4.18}

 26%|██▌       | 97140/371472 [7:43:33<20:35:24,  3.70it/s]
 26%|██▌       | 97141/371472 [7:43:33<20:05:06,  3.79it/s]
 26%|██▌       | 97142/371472 [7:43:34<21:10:40,  3.60it/s]
 26%|██▌       | 97143/371472 [7:43:34<22:05:39,  3.45it/s]
 26%|██▌       | 97144/371472 [7:43:34<21:30:30,  3.54it/s]
 26%|██▌       | 97145/371472 [7:43:34<20:56:18,  3.64it/s]
 26%|██▌       | 97146/371472 [7:43:35<20:53:07,  3.65it/s]
 26%|██▌       | 97147/371472 [7:43:35<20:17:08,  3.76it/s]
 26%|██▌       | 97148/371472 [7:43:35<21:39:09,  3.52it/s]
 26%|██▌       | 97149/371472 [7:43:36<21:02:08,  3.62it/s]
 26%|██▌       | 97150/371472 [7:43:36<23:01:34,  3.31it/s]
 26%|██▌       | 97151/371472 [7:43:36<22:46:08,  3.35it/s]
 26%|██▌       | 97152/371472 [7:43:37<22:05:15,  3.45it/s]
 26%|██▌       | 97153/371472 [7:43:37<21:05:09,  3.61it/s]
 26%|██▌       | 97154/371472 [7:43:37<20:40:04,  3.69it/s]
 26%|██▌       | 97155/371472 [7:43:37<21:11:21,  3.60it/s]
 26%|██▌       | 97156/371472 [7:43:38<20:43:08,  3.68it/s]
 26%|██▌       | 97157/371472 [7:43:38<20:52:45,  3.65it/s]
 26%|██▌       | 97158/371472 [7:43:38<23:20:14,  3.27it/s]
 26%|██▌       | 97159/371472 [7:43:39<22:37:28,  3.37it/s]
 26%|██▌       | 97160/371472 [7:43:39<25:46:26,  2.96it/s]
                                                           
{'loss': 3.6399, 'learning_rate': 7.64959382878321e-07, 'epoch': 4.18}

 26%|██▌       | 97160/371472 [7:43:39<25:46:26,  2.96it/s]
 26%|██▌       | 97161/371472 [7:43:39<24:14:29,  3.14it/s]
 26%|██▌       | 97162/371472 [7:43:39<23:03:09,  3.31it/s]
 26%|██▌       | 97163/371472 [7:43:40<22:58:13,  3.32it/s]
 26%|██▌       | 97164/371472 [7:43:40<21:57:31,  3.47it/s]
 26%|██▌       | 97165/371472 [7:43:40<22:22:57,  3.40it/s]
 26%|██▌       | 97166/371472 [7:43:41<21:54:17,  3.48it/s]
 26%|██▌       | 97167/371472 [7:43:41<22:23:28,  3.40it/s]
 26%|██▌       | 97168/371472 [7:43:41<22:12:40,  3.43it/s]
 26%|██▌       | 97169/371472 [7:43:41<21:56:28,  3.47it/s]
 26%|██▌       | 97170/371472 [7:43:42<22:24:31,  3.40it/s]
 26%|██▌       | 97171/371472 [7:43:42<23:50:33,  3.20it/s]
 26%|██▌       | 97172/371472 [7:43:42<22:37:33,  3.37it/s]
 26%|██▌       | 97173/371472 [7:43:43<21:30:10,  3.54it/s]
 26%|██▌       | 97174/371472 [7:43:43<21:27:16,  3.55it/s]
 26%|██▌       | 97175/371472 [7:43:43<22:07:14,  3.44it/s]
 26%|██▌       | 97176/371472 [7:43:44<21:29:10,  3.55it/s]
 26%|██▌       | 97177/371472 [7:43:44<22:09:21,  3.44it/s]
 26%|██▌       | 97178/371472 [7:43:44<21:52:37,  3.48it/s]
 26%|██▌       | 97179/371472 [7:43:44<20:54:10,  3.65it/s]
 26%|██▌       | 97180/371472 [7:43:45<20:46:49,  3.67it/s]
                                                           
{'loss': 3.6157, 'learning_rate': 7.649109009028422e-07, 'epoch': 4.19}

 26%|██▌       | 97180/371472 [7:43:45<20:46:49,  3.67it/s]
 26%|██▌       | 97181/371472 [7:43:45<22:52:08,  3.33it/s]
 26%|██▌       | 97182/371472 [7:43:45<22:24:18,  3.40it/s]
 26%|██▌       | 97183/371472 [7:43:46<23:10:35,  3.29it/s]
 26%|██▌       | 97184/371472 [7:43:46<22:33:23,  3.38it/s]
 26%|██▌       | 97185/371472 [7:43:46<22:02:04,  3.46it/s]
 26%|██▌       | 97186/371472 [7:43:46<21:05:40,  3.61it/s]
 26%|██▌       | 97187/371472 [7:43:47<21:31:11,  3.54it/s]
 26%|██▌       | 97188/371472 [7:43:47<21:04:43,  3.61it/s]
 26%|██▌       | 97189/371472 [7:43:47<22:27:09,  3.39it/s]
 26%|██▌       | 97190/371472 [7:43:48<21:50:25,  3.49it/s]
 26%|██▌       | 97191/371472 [7:43:48<22:15:37,  3.42it/s]
 26%|██▌       | 97192/371472 [7:43:48<22:28:36,  3.39it/s]
 26%|██▌       | 97193/371472 [7:43:48<21:27:22,  3.55it/s]
 26%|██▌       | 97194/371472 [7:43:49<21:28:07,  3.55it/s]
 26%|██▌       | 97195/371472 [7:43:49<24:41:33,  3.09it/s]
 26%|██▌       | 97196/371472 [7:43:49<23:22:00,  3.26it/s]
 26%|██▌       | 97197/371472 [7:43:50<23:01:07,  3.31it/s]
 26%|██▌       | 97198/371472 [7:43:50<21:58:59,  3.47it/s]
 26%|██▌       | 97199/371472 [7:43:50<20:59:06,  3.63it/s]
 26%|██▌       | 97200/371472 [7:43:50<20:51:54,  3.65it/s]
                                                           
{'loss': 3.5105, 'learning_rate': 7.648624189273632e-07, 'epoch': 4.19}

 26%|██▌       | 97200/371472 [7:43:50<20:51:54,  3.65it/s]
 26%|██▌       | 97201/371472 [7:43:51<20:59:11,  3.63it/s]
 26%|██▌       | 97202/371472 [7:43:51<21:07:24,  3.61it/s]
 26%|██▌       | 97203/371472 [7:43:51<20:42:38,  3.68it/s]
 26%|██▌       | 97204/371472 [7:43:52<20:46:52,  3.67it/s]
 26%|██▌       | 97205/371472 [7:43:52<20:16:58,  3.76it/s]
 26%|██▌       | 97206/371472 [7:43:52<19:52:47,  3.83it/s]
 26%|██▌       | 97207/371472 [7:43:52<20:49:21,  3.66it/s]
 26%|██▌       | 97208/371472 [7:43:53<20:59:13,  3.63it/s]
 26%|██▌       | 97209/371472 [7:43:53<21:59:19,  3.46it/s]
 26%|██▌       | 97210/371472 [7:43:53<21:00:13,  3.63it/s]
 26%|██▌       | 97211/371472 [7:43:53<21:15:51,  3.58it/s]
 26%|██▌       | 97212/371472 [7:43:54<21:49:36,  3.49it/s]
 26%|██▌       | 97213/371472 [7:43:54<20:43:38,  3.68it/s]
 26%|██▌       | 97214/371472 [7:43:54<20:57:01,  3.64it/s]
 26%|██▌       | 97215/371472 [7:43:55<20:14:19,  3.76it/s]
 26%|██▌       | 97216/371472 [7:43:55<21:14:36,  3.59it/s]
 26%|██▌       | 97217/371472 [7:43:55<23:32:59,  3.23it/s]
 26%|██▌       | 97218/371472 [7:43:56<23:20:14,  3.26it/s]
 26%|██▌       | 97219/371472 [7:43:56<22:06:39,  3.45it/s]
 26%|██▌       | 97220/371472 [7:43:56<21:26:29,  3.55it/s]
                                                           
{'loss': 3.6493, 'learning_rate': 7.648139369518842e-07, 'epoch': 4.19}

 26%|██▌       | 97220/371472 [7:43:56<21:26:29,  3.55it/s]
 26%|██▌       | 97221/371472 [7:43:56<20:24:18,  3.73it/s]
 26%|██▌       | 97222/371472 [7:43:57<20:32:48,  3.71it/s]
 26%|██▌       | 97223/371472 [7:43:57<19:45:56,  3.85it/s]
 26%|██▌       | 97224/371472 [7:43:57<20:24:07,  3.73it/s]
 26%|██▌       | 97225/371472 [7:43:57<22:35:25,  3.37it/s]
 26%|██▌       | 97226/371472 [7:43:58<21:54:45,  3.48it/s]
 26%|██▌       | 97227/371472 [7:43:58<21:29:29,  3.54it/s]
 26%|██▌       | 97228/371472 [7:43:58<22:47:44,  3.34it/s]
 26%|██▌       | 97229/371472 [7:43:59<21:46:32,  3.50it/s]
 26%|██▌       | 97230/371472 [7:43:59<20:54:16,  3.64it/s]
 26%|██▌       | 97231/371472 [7:43:59<21:11:34,  3.59it/s]
 26%|██▌       | 97232/371472 [7:43:59<23:21:12,  3.26it/s]
 26%|██▌       | 97233/371472 [7:44:00<22:26:59,  3.39it/s]
 26%|██▌       | 97234/371472 [7:44:00<22:06:57,  3.44it/s]
 26%|██▌       | 97235/371472 [7:44:00<21:09:26,  3.60it/s]
 26%|██▌       | 97236/371472 [7:44:01<21:19:27,  3.57it/s]
 26%|██▌       | 97237/371472 [7:44:01<21:02:07,  3.62it/s]
 26%|██▌       | 97238/371472 [7:44:01<20:23:35,  3.74it/s]
 26%|██▌       | 97239/371472 [7:44:01<21:07:55,  3.60it/s]
 26%|██▌       | 97240/371472 [7:44:02<20:23:29,  3.74it/s]
                                                           
{'loss': 3.734, 'learning_rate': 7.647654549764054e-07, 'epoch': 4.19}

 26%|██▌       | 97240/371472 [7:44:02<20:23:29,  3.74it/s]
 26%|██▌       | 97241/371472 [7:44:02<20:21:45,  3.74it/s]
 26%|██▌       | 97242/371472 [7:44:02<21:03:32,  3.62it/s]
 26%|██▌       | 97243/371472 [7:44:02<21:40:51,  3.51it/s]
 26%|██▌       | 97244/371472 [7:44:03<20:46:53,  3.67it/s]
 26%|██▌       | 97245/371472 [7:44:03<20:28:41,  3.72it/s]
 26%|██▌       | 97246/371472 [7:44:03<20:28:42,  3.72it/s]
 26%|██▌       | 97247/371472 [7:44:04<21:34:51,  3.53it/s]
 26%|██▌       | 97248/371472 [7:44:04<20:49:50,  3.66it/s]
 26%|██▌       | 97249/371472 [7:44:04<20:38:07,  3.69it/s]
 26%|██▌       | 97250/371472 [7:44:04<22:04:38,  3.45it/s]
 26%|██▌       | 97251/371472 [7:44:05<21:45:36,  3.50it/s]
 26%|██▌       | 97252/371472 [7:44:05<23:00:41,  3.31it/s]
 26%|██▌       | 97253/371472 [7:44:05<21:39:31,  3.52it/s]
 26%|██▌       | 97254/371472 [7:44:06<21:00:13,  3.63it/s]
 26%|██▌       | 97255/371472 [7:44:06<20:19:47,  3.75it/s]
 26%|██▌       | 97256/371472 [7:44:06<19:50:03,  3.84it/s]
 26%|██▌       | 97257/371472 [7:44:06<20:02:54,  3.80it/s]
 26%|██▌       | 97258/371472 [7:44:07<20:44:27,  3.67it/s]
 26%|██▌       | 97259/371472 [7:44:07<20:06:06,  3.79it/s]
 26%|██▌       | 97260/371472 [7:44:07<20:34:49,  3.70it/s]
                                                           
{'loss': 3.6497, 'learning_rate': 7.647169730009266e-07, 'epoch': 4.19}

 26%|██▌       | 97260/371472 [7:44:07<20:34:49,  3.70it/s]
 26%|██▌       | 97261/371472 [7:44:07<22:13:54,  3.43it/s]
 26%|██▌       | 97262/371472 [7:44:08<22:10:08,  3.44it/s]
 26%|██▌       | 97263/371472 [7:44:08<21:41:17,  3.51it/s]
 26%|██▌       | 97264/371472 [7:44:08<22:40:47,  3.36it/s]
 26%|██▌       | 97265/371472 [7:44:09<21:59:29,  3.46it/s]
 26%|██▌       | 97266/371472 [7:44:09<25:05:58,  3.03it/s]
 26%|██▌       | 97267/371472 [7:44:09<23:55:49,  3.18it/s]
 26%|██▌       | 97268/371472 [7:44:10<24:44:40,  3.08it/s]
 26%|██▌       | 97269/371472 [7:44:10<23:33:46,  3.23it/s]
 26%|██▌       | 97270/371472 [7:44:10<22:12:04,  3.43it/s]
 26%|██▌       | 97271/371472 [7:44:10<21:38:34,  3.52it/s]
 26%|██▌       | 97272/371472 [7:44:11<21:50:29,  3.49it/s]
 26%|██▌       | 97273/371472 [7:44:11<24:03:36,  3.17it/s]
 26%|██▌       | 97274/371472 [7:44:11<22:38:43,  3.36it/s]
 26%|██▌       | 97275/371472 [7:44:12<22:29:54,  3.39it/s]
 26%|██▌       | 97276/371472 [7:44:12<21:19:18,  3.57it/s]
 26%|██▌       | 97277/371472 [7:44:12<20:50:55,  3.65it/s]
 26%|██▌       | 97278/371472 [7:44:12<20:01:10,  3.80it/s]
 26%|██▌       | 97279/371472 [7:44:13<20:26:56,  3.72it/s]
 26%|██▌       | 97280/371472 [7:44:13<20:54:20,  3.64it/s]
                                                           
{'loss': 3.5229, 'learning_rate': 7.646684910254476e-07, 'epoch': 4.19}

 26%|██▌       | 97280/371472 [7:44:13<20:54:20,  3.64it/s]
 26%|██▌       | 97281/371472 [7:44:13<20:11:18,  3.77it/s]
 26%|██▌       | 97282/371472 [7:44:14<20:05:55,  3.79it/s]
 26%|██▌       | 97283/371472 [7:44:14<19:56:16,  3.82it/s]
 26%|██▌       | 97284/371472 [7:44:14<20:21:32,  3.74it/s]
 26%|██▌       | 97285/371472 [7:44:14<22:09:37,  3.44it/s]
 26%|██▌       | 97286/371472 [7:44:15<21:14:31,  3.59it/s]
 26%|██▌       | 97287/371472 [7:44:15<21:28:55,  3.55it/s]
 26%|██▌       | 97288/371472 [7:44:15<22:30:23,  3.38it/s]
 26%|██▌       | 97289/371472 [7:44:16<22:45:59,  3.35it/s]
 26%|██▌       | 97290/371472 [7:44:16<21:56:19,  3.47it/s]
 26%|██▌       | 97291/371472 [7:44:16<23:11:31,  3.28it/s]
 26%|██▌       | 97292/371472 [7:44:16<22:10:10,  3.44it/s]
 26%|██▌       | 97293/371472 [7:44:17<26:49:54,  2.84it/s]
 26%|██▌       | 97294/371472 [7:44:17<24:59:02,  3.05it/s]
 26%|██▌       | 97295/371472 [7:44:18<26:11:47,  2.91it/s]
 26%|██▌       | 97296/371472 [7:44:18<25:18:24,  3.01it/s]
 26%|██▌       | 97297/371472 [7:44:18<24:32:40,  3.10it/s]
 26%|██▌       | 97298/371472 [7:44:18<23:24:14,  3.25it/s]
 26%|██▌       | 97299/371472 [7:44:19<22:11:49,  3.43it/s]
 26%|██▌       | 97300/371472 [7:44:19<22:19:43,  3.41it/s]
                                                           
{'loss': 3.55, 'learning_rate': 7.646200090499687e-07, 'epoch': 4.19}

 26%|██▌       | 97300/371472 [7:44:19<22:19:43,  3.41it/s]
 26%|██▌       | 97301/371472 [7:44:19<21:08:45,  3.60it/s]
 26%|██▌       | 97302/371472 [7:44:19<20:38:13,  3.69it/s]
 26%|██▌       | 97303/371472 [7:44:20<20:22:12,  3.74it/s]
 26%|██▌       | 97304/371472 [7:44:20<20:06:58,  3.79it/s]
 26%|██▌       | 97305/371472 [7:44:20<20:53:02,  3.65it/s]
 26%|██▌       | 97306/371472 [7:44:21<20:57:05,  3.63it/s]
 26%|██▌       | 97307/371472 [7:44:21<20:05:36,  3.79it/s]
 26%|██▌       | 97308/371472 [7:44:21<19:45:42,  3.85it/s]
 26%|██▌       | 97309/371472 [7:44:21<20:13:34,  3.77it/s]
 26%|██▌       | 97310/371472 [7:44:22<21:07:04,  3.61it/s]
 26%|██▌       | 97311/371472 [7:44:22<21:18:41,  3.57it/s]
 26%|██▌       | 97312/371472 [7:44:22<20:39:51,  3.69it/s]
 26%|██▌       | 97313/371472 [7:44:22<20:05:10,  3.79it/s]
 26%|██▌       | 97314/371472 [7:44:23<20:13:35,  3.77it/s]
 26%|██▌       | 97315/371472 [7:44:23<20:41:13,  3.68it/s]
 26%|██▌       | 97316/371472 [7:44:23<20:52:35,  3.65it/s]
 26%|██▌       | 97317/371472 [7:44:24<20:54:31,  3.64it/s]
 26%|██▌       | 97318/371472 [7:44:24<23:15:44,  3.27it/s]
 26%|██▌       | 97319/371472 [7:44:24<22:04:11,  3.45it/s]
 26%|██▌       | 97320/371472 [7:44:24<21:42:19,  3.51it/s]
                                                           
{'loss': 3.7054, 'learning_rate': 7.645715270744899e-07, 'epoch': 4.19}

 26%|██▌       | 97320/371472 [7:44:24<21:42:19,  3.51it/s]
 26%|██▌       | 97321/371472 [7:44:25<21:43:00,  3.51it/s]
 26%|██▌       | 97322/371472 [7:44:25<22:00:56,  3.46it/s]
 26%|██▌       | 97323/371472 [7:44:25<20:49:38,  3.66it/s]
 26%|██▌       | 97324/371472 [7:44:26<20:37:12,  3.69it/s]
 26%|██▌       | 97325/371472 [7:44:26<20:42:06,  3.68it/s]
 26%|██▌       | 97326/371472 [7:44:26<20:25:41,  3.73it/s]
 26%|██▌       | 97327/371472 [7:44:26<20:20:27,  3.74it/s]
 26%|██▌       | 97328/371472 [7:44:27<21:05:48,  3.61it/s]
 26%|██▌       | 97329/371472 [7:44:27<21:02:33,  3.62it/s]
 26%|██▌       | 97330/371472 [7:44:27<20:21:42,  3.74it/s]
 26%|██▌       | 97331/371472 [7:44:28<22:23:06,  3.40it/s]
 26%|██▌       | 97332/371472 [7:44:28<22:42:42,  3.35it/s]
 26%|██▌       | 97333/371472 [7:44:28<21:45:38,  3.50it/s]
 26%|██▌       | 97334/371472 [7:44:28<22:04:03,  3.45it/s]
 26%|██▌       | 97335/371472 [7:44:29<23:12:01,  3.28it/s]
 26%|██▌       | 97336/371472 [7:44:29<22:19:31,  3.41it/s]
 26%|██▌       | 97337/371472 [7:44:29<22:46:23,  3.34it/s]
 26%|██▌       | 97338/371472 [7:44:30<22:30:03,  3.38it/s]
 26%|██▌       | 97339/371472 [7:44:30<22:21:56,  3.40it/s]
 26%|██▌       | 97340/371472 [7:44:30<22:23:28,  3.40it/s]
                                                           
{'loss': 3.6473, 'learning_rate': 7.64523045099011e-07, 'epoch': 4.19}

 26%|██▌       | 97340/371472 [7:44:30<22:23:28,  3.40it/s]
 26%|██▌       | 97341/371472 [7:44:30<21:50:48,  3.49it/s]
 26%|██▌       | 97342/371472 [7:44:31<22:02:46,  3.45it/s]
 26%|██▌       | 97343/371472 [7:44:31<21:45:48,  3.50it/s]
 26%|██▌       | 97344/371472 [7:44:31<22:54:02,  3.33it/s]
 26%|██▌       | 97345/371472 [7:44:32<22:43:02,  3.35it/s]
 26%|██▌       | 97346/371472 [7:44:32<22:02:01,  3.46it/s]
 26%|██▌       | 97347/371472 [7:44:32<21:39:08,  3.52it/s]
 26%|██▌       | 97348/371472 [7:44:32<21:06:02,  3.61it/s]
 26%|██▌       | 97349/371472 [7:44:33<20:38:03,  3.69it/s]
 26%|██▌       | 97350/371472 [7:44:33<20:21:13,  3.74it/s]
 26%|██▌       | 97351/371472 [7:44:33<20:03:24,  3.80it/s]
 26%|██▌       | 97352/371472 [7:44:34<20:54:06,  3.64it/s]
 26%|██▌       | 97353/371472 [7:44:34<19:54:56,  3.82it/s]
 26%|██▌       | 97354/371472 [7:44:34<19:45:28,  3.85it/s]
 26%|██▌       | 97355/371472 [7:44:34<20:06:08,  3.79it/s]
 26%|██▌       | 97356/371472 [7:44:35<20:56:21,  3.64it/s]
 26%|██▌       | 97357/371472 [7:44:35<20:13:40,  3.76it/s]
 26%|██▌       | 97358/371472 [7:44:35<20:49:29,  3.66it/s]
 26%|██▌       | 97359/371472 [7:44:35<22:19:07,  3.41it/s]
 26%|██▌       | 97360/371472 [7:44:36<21:49:52,  3.49it/s]
                                                           
{'loss': 3.7658, 'learning_rate': 7.64474563123532e-07, 'epoch': 4.19}

 26%|██▌       | 97360/371472 [7:44:36<21:49:52,  3.49it/s]
 26%|██▌       | 97361/371472 [7:44:36<21:46:49,  3.50it/s]
 26%|██▌       | 97362/371472 [7:44:36<21:12:18,  3.59it/s]
 26%|██▌       | 97363/371472 [7:44:37<21:57:25,  3.47it/s]
 26%|██▌       | 97364/371472 [7:44:37<21:58:53,  3.46it/s]
 26%|██▌       | 97365/371472 [7:44:37<22:20:40,  3.41it/s]
 26%|██▌       | 97366/371472 [7:44:37<21:41:23,  3.51it/s]
 26%|██▌       | 97367/371472 [7:44:38<22:13:41,  3.43it/s]
 26%|██▌       | 97368/371472 [7:44:38<21:49:12,  3.49it/s]
 26%|██▌       | 97369/371472 [7:44:38<21:41:59,  3.51it/s]
 26%|██▌       | 97370/371472 [7:44:39<20:54:22,  3.64it/s]
 26%|██▌       | 97371/371472 [7:44:39<20:43:50,  3.67it/s]
 26%|██▌       | 97372/371472 [7:44:39<20:43:34,  3.67it/s]
 26%|██▌       | 97373/371472 [7:44:39<21:53:43,  3.48it/s]
 26%|██▌       | 97374/371472 [7:44:40<21:50:36,  3.49it/s]
 26%|██▌       | 97375/371472 [7:44:40<21:38:50,  3.52it/s]
 26%|██▌       | 97376/371472 [7:44:40<21:07:44,  3.60it/s]
 26%|██▌       | 97377/371472 [7:44:41<20:56:37,  3.64it/s]
 26%|██▌       | 97378/371472 [7:44:41<19:51:02,  3.84it/s]
 26%|██▌       | 97379/371472 [7:44:41<19:41:11,  3.87it/s]
 26%|██▌       | 97380/371472 [7:44:41<19:20:37,  3.94it/s]
                                                           
{'loss': 3.6228, 'learning_rate': 7.644260811480531e-07, 'epoch': 4.19}

 26%|██▌       | 97380/371472 [7:44:41<19:20:37,  3.94it/s]
 26%|██▌       | 97381/371472 [7:44:42<20:34:05,  3.70it/s]
 26%|██▌       | 97382/371472 [7:44:42<23:08:46,  3.29it/s]
 26%|██▌       | 97383/371472 [7:44:42<23:43:07,  3.21it/s]
 26%|██▌       | 97384/371472 [7:44:43<22:21:44,  3.40it/s]
 26%|██▌       | 97385/371472 [7:44:43<21:31:29,  3.54it/s]
 26%|██▌       | 97386/371472 [7:44:43<21:05:03,  3.61it/s]
 26%|██▌       | 97387/371472 [7:44:43<21:20:58,  3.57it/s]
 26%|██▌       | 97388/371472 [7:44:44<21:36:17,  3.52it/s]
 26%|██▌       | 97389/371472 [7:44:44<20:59:21,  3.63it/s]
 26%|██▌       | 97390/371472 [7:44:44<22:14:37,  3.42it/s]
 26%|██▌       | 97391/371472 [7:44:44<22:17:35,  3.42it/s]
 26%|██▌       | 97392/371472 [7:44:45<21:27:03,  3.55it/s]
 26%|██▌       | 97393/371472 [7:44:45<20:25:52,  3.73it/s]
 26%|██▌       | 97394/371472 [7:44:45<20:08:24,  3.78it/s]
 26%|██▌       | 97395/371472 [7:44:45<19:43:29,  3.86it/s]
 26%|██▌       | 97396/371472 [7:44:46<19:16:08,  3.95it/s]
 26%|██▌       | 97397/371472 [7:44:46<20:24:19,  3.73it/s]
 26%|██▌       | 97398/371472 [7:44:46<20:31:59,  3.71it/s]
 26%|██▌       | 97399/371472 [7:44:47<23:22:49,  3.26it/s]
 26%|██▌       | 97400/371472 [7:44:47<22:13:12,  3.43it/s]
                                                           
{'loss': 3.6086, 'learning_rate': 7.643775991725743e-07, 'epoch': 4.2}

 26%|██▌       | 97400/371472 [7:44:47<22:13:12,  3.43it/s]
 26%|██▌       | 97401/371472 [7:44:47<21:56:11,  3.47it/s]
 26%|██▌       | 97402/371472 [7:44:47<20:41:19,  3.68it/s]
 26%|██▌       | 97403/371472 [7:44:48<20:34:01,  3.70it/s]
 26%|██▌       | 97404/371472 [7:44:48<19:39:29,  3.87it/s]
 26%|██▌       | 97405/371472 [7:44:48<20:07:02,  3.78it/s]
 26%|██▌       | 97406/371472 [7:44:49<21:10:39,  3.59it/s]
 26%|██▌       | 97407/371472 [7:44:49<21:32:34,  3.53it/s]
 26%|██▌       | 97408/371472 [7:44:49<21:42:37,  3.51it/s]
 26%|██▌       | 97409/371472 [7:44:49<22:14:54,  3.42it/s]
 26%|██▌       | 97410/371472 [7:44:50<21:46:55,  3.50it/s]
 26%|██▌       | 97411/371472 [7:44:50<20:34:32,  3.70it/s]
 26%|██▌       | 97412/371472 [7:44:50<21:07:28,  3.60it/s]
 26%|██▌       | 97413/371472 [7:44:51<21:04:07,  3.61it/s]
 26%|██▌       | 97414/371472 [7:44:51<22:10:42,  3.43it/s]
 26%|██▌       | 97415/371472 [7:44:51<21:54:11,  3.48it/s]
 26%|██▌       | 97416/371472 [7:44:51<23:03:56,  3.30it/s]
 26%|██▌       | 97417/371472 [7:44:52<22:10:53,  3.43it/s]
 26%|██▌       | 97418/371472 [7:44:52<21:46:37,  3.50it/s]
 26%|██▌       | 97419/371472 [7:44:52<21:36:09,  3.52it/s]
 26%|██▌       | 97420/371472 [7:44:53<21:41:36,  3.51it/s]
                                                           
{'loss': 3.6835, 'learning_rate': 7.643291171970955e-07, 'epoch': 4.2}

 26%|██▌       | 97420/371472 [7:44:53<21:41:36,  3.51it/s]
 26%|██▌       | 97421/371472 [7:44:53<21:02:07,  3.62it/s]
 26%|██▌       | 97422/371472 [7:44:53<20:52:47,  3.65it/s]
 26%|██▌       | 97423/371472 [7:44:53<20:08:23,  3.78it/s]
 26%|██▌       | 97424/371472 [7:44:54<20:24:10,  3.73it/s]
 26%|██▌       | 97425/371472 [7:44:54<19:55:43,  3.82it/s]
 26%|██▌       | 97426/371472 [7:44:54<19:39:25,  3.87it/s]
 26%|██▌       | 97427/371472 [7:44:54<19:16:31,  3.95it/s]
 26%|██▌       | 97428/371472 [7:44:55<19:10:48,  3.97it/s]
 26%|██▌       | 97429/371472 [7:44:55<19:56:50,  3.82it/s]
 26%|██▌       | 97430/371472 [7:44:55<19:19:54,  3.94it/s]
 26%|██▌       | 97431/371472 [7:44:55<19:06:35,  3.98it/s]
 26%|██▌       | 97432/371472 [7:44:56<19:34:36,  3.89it/s]
 26%|██▌       | 97433/371472 [7:44:56<21:18:03,  3.57it/s]
 26%|██▌       | 97434/371472 [7:44:56<21:48:02,  3.49it/s]
 26%|██▌       | 97435/371472 [7:44:57<22:05:44,  3.45it/s]
 26%|██▌       | 97436/371472 [7:44:57<22:20:08,  3.41it/s]
 26%|██▌       | 97437/371472 [7:44:57<23:39:38,  3.22it/s]
 26%|██▌       | 97438/371472 [7:44:57<22:11:53,  3.43it/s]
 26%|██▌       | 97439/371472 [7:44:58<22:04:15,  3.45it/s]
 26%|██▌       | 97440/371472 [7:44:58<21:22:18,  3.56it/s]
                                                           
{'loss': 3.5575, 'learning_rate': 7.642806352216164e-07, 'epoch': 4.2}

 26%|██▌       | 97440/371472 [7:44:58<21:22:18,  3.56it/s]
 26%|██▌       | 97441/371472 [7:44:58<21:30:24,  3.54it/s]
 26%|██▌       | 97442/371472 [7:44:59<20:50:10,  3.65it/s]
 26%|██▌       | 97443/371472 [7:44:59<20:31:31,  3.71it/s]
 26%|██▌       | 97444/371472 [7:44:59<20:25:52,  3.73it/s]
 26%|██▌       | 97445/371472 [7:44:59<20:32:01,  3.71it/s]
 26%|██▌       | 97446/371472 [7:45:00<20:34:51,  3.70it/s]
 26%|██▌       | 97447/371472 [7:45:00<20:15:54,  3.76it/s]
 26%|██▌       | 97448/371472 [7:45:00<20:12:37,  3.77it/s]
 26%|██▌       | 97449/371472 [7:45:00<20:35:43,  3.70it/s]
 26%|██▌       | 97450/371472 [7:45:01<21:10:49,  3.59it/s]
 26%|██▌       | 97451/371472 [7:45:01<20:53:40,  3.64it/s]
 26%|██▌       | 97452/371472 [7:45:01<20:15:52,  3.76it/s]
 26%|██▌       | 97453/371472 [7:45:01<19:43:20,  3.86it/s]
 26%|██▌       | 97454/371472 [7:45:02<20:16:49,  3.75it/s]
 26%|██▌       | 97455/371472 [7:45:02<20:23:08,  3.73it/s]
 26%|██▌       | 97456/371472 [7:45:02<20:08:18,  3.78it/s]
 26%|██▌       | 97457/371472 [7:45:03<20:39:02,  3.69it/s]
 26%|██▌       | 97458/371472 [7:45:03<20:12:52,  3.77it/s]
 26%|██▌       | 97459/371472 [7:45:03<20:43:55,  3.67it/s]
 26%|██▌       | 97460/371472 [7:45:03<20:40:12,  3.68it/s]
                                                           
{'loss': 3.4224, 'learning_rate': 7.642321532461376e-07, 'epoch': 4.2}

 26%|██▌       | 97460/371472 [7:45:03<20:40:12,  3.68it/s]
 26%|██▌       | 97461/371472 [7:45:04<22:12:34,  3.43it/s]
 26%|██▌       | 97462/371472 [7:45:04<22:14:47,  3.42it/s]
 26%|██▌       | 97463/371472 [7:45:04<22:27:41,  3.39it/s]
 26%|██▌       | 97464/371472 [7:45:05<21:43:12,  3.50it/s]
 26%|██▌       | 97465/371472 [7:45:05<21:27:06,  3.55it/s]
 26%|██▌       | 97466/371472 [7:45:05<20:34:40,  3.70it/s]
 26%|██▌       | 97467/371472 [7:45:05<21:54:30,  3.47it/s]
 26%|██▌       | 97468/371472 [7:45:06<20:28:04,  3.72it/s]
 26%|██▌       | 97469/371472 [7:45:06<20:38:16,  3.69it/s]
 26%|██▌       | 97470/371472 [7:45:06<20:49:09,  3.66it/s]
 26%|██▌       | 97471/371472 [7:45:06<20:54:40,  3.64it/s]
 26%|██▌       | 97472/371472 [7:45:07<20:12:02,  3.77it/s]
 26%|██▌       | 97473/371472 [7:45:07<21:10:49,  3.59it/s]
 26%|██▌       | 97474/371472 [7:45:07<21:56:05,  3.47it/s]
 26%|██▌       | 97475/371472 [7:45:08<20:46:53,  3.66it/s]
 26%|██▌       | 97476/371472 [7:45:08<20:26:23,  3.72it/s]
 26%|██▌       | 97477/371472 [7:45:08<20:14:16,  3.76it/s]
 26%|██▌       | 97478/371472 [7:45:08<21:40:10,  3.51it/s]
 26%|██▌       | 97479/371472 [7:45:09<21:12:25,  3.59it/s]
 26%|██▌       | 97480/371472 [7:45:09<21:52:20,  3.48it/s]
                                                           
{'loss': 3.6825, 'learning_rate': 7.641836712706587e-07, 'epoch': 4.2}

 26%|██▌       | 97480/371472 [7:45:09<21:52:20,  3.48it/s]
 26%|██▌       | 97481/371472 [7:45:09<21:21:23,  3.56it/s]
 26%|██▌       | 97482/371472 [7:45:10<20:22:31,  3.74it/s]
 26%|██▌       | 97483/371472 [7:45:10<20:18:56,  3.75it/s]
 26%|██▌       | 97484/371472 [7:45:10<22:07:57,  3.44it/s]
 26%|██▌       | 97485/371472 [7:45:10<21:28:28,  3.54it/s]
 26%|██▌       | 97486/371472 [7:45:11<22:03:03,  3.45it/s]
 26%|██▌       | 97487/371472 [7:45:11<21:40:39,  3.51it/s]
 26%|██▌       | 97488/371472 [7:45:11<21:21:06,  3.56it/s]
 26%|██▌       | 97489/371472 [7:45:12<21:11:59,  3.59it/s]
 26%|██▌       | 97490/371472 [7:45:12<20:30:07,  3.71it/s]
 26%|██▌       | 97491/371472 [7:45:12<21:37:44,  3.52it/s]
 26%|██▌       | 97492/371472 [7:45:12<20:59:38,  3.63it/s]
 26%|██▌       | 97493/371472 [7:45:13<20:48:05,  3.66it/s]
 26%|██▌       | 97494/371472 [7:45:13<23:17:41,  3.27it/s]
 26%|██▌       | 97495/371472 [7:45:13<22:50:04,  3.33it/s]
 26%|██▌       | 97496/371472 [7:45:14<23:01:19,  3.31it/s]
 26%|██▌       | 97497/371472 [7:45:14<23:02:21,  3.30it/s]
 26%|██▌       | 97498/371472 [7:45:14<21:38:40,  3.52it/s]
 26%|██▌       | 97499/371472 [7:45:14<21:11:03,  3.59it/s]
 26%|██▌       | 97500/371472 [7:45:15<20:44:44,  3.67it/s]
                                                           
{'loss': 3.8836, 'learning_rate': 7.641351892951797e-07, 'epoch': 4.2}

 26%|██▌       | 97500/371472 [7:45:15<20:44:44,  3.67it/s]
 26%|██▌       | 97501/371472 [7:45:15<20:59:22,  3.63it/s]
 26%|██▌       | 97502/371472 [7:45:15<20:52:02,  3.65it/s]
 26%|██▌       | 97503/371472 [7:45:15<20:22:27,  3.74it/s]
 26%|██▌       | 97504/371472 [7:45:16<20:26:23,  3.72it/s]
 26%|██▌       | 97505/371472 [7:45:16<21:44:25,  3.50it/s]
 26%|██▌       | 97506/371472 [7:45:16<21:41:40,  3.51it/s]
 26%|██▌       | 97507/371472 [7:45:17<22:22:31,  3.40it/s]
 26%|██▌       | 97508/371472 [7:45:17<21:54:36,  3.47it/s]
 26%|██▌       | 97509/371472 [7:45:17<21:16:23,  3.58it/s]
 26%|██▌       | 97510/371472 [7:45:17<20:44:26,  3.67it/s]
 26%|██▌       | 97511/371472 [7:45:18<20:26:22,  3.72it/s]
 26%|██▋       | 97512/371472 [7:45:18<19:57:09,  3.81it/s]
 26%|██▋       | 97513/371472 [7:45:18<20:11:17,  3.77it/s]
 26%|██▋       | 97514/371472 [7:45:18<20:22:38,  3.73it/s]
 26%|██▋       | 97515/371472 [7:45:19<20:09:40,  3.77it/s]
 26%|██▋       | 97516/371472 [7:45:19<20:39:47,  3.68it/s]
 26%|██▋       | 97517/371472 [7:45:19<21:12:47,  3.59it/s]
 26%|██▋       | 97518/371472 [7:45:20<21:04:13,  3.61it/s]
 26%|██▋       | 97519/371472 [7:45:20<21:31:05,  3.54it/s]
 26%|██▋       | 97520/371472 [7:45:20<20:50:37,  3.65it/s]
                                                           
{'loss': 3.5121, 'learning_rate': 7.640867073197008e-07, 'epoch': 4.2}

 26%|██▋       | 97520/371472 [7:45:20<20:50:37,  3.65it/s]
 26%|██▋       | 97521/371472 [7:45:20<20:14:09,  3.76it/s]
 26%|██▋       | 97522/371472 [7:45:21<20:28:35,  3.72it/s]
 26%|██▋       | 97523/371472 [7:45:21<20:31:57,  3.71it/s]
 26%|██▋       | 97524/371472 [7:45:21<20:06:54,  3.78it/s]
 26%|██▋       | 97525/371472 [7:45:21<20:08:04,  3.78it/s]
 26%|██▋       | 97526/371472 [7:45:22<20:16:47,  3.75it/s]
 26%|██▋       | 97527/371472 [7:45:22<20:20:14,  3.74it/s]
 26%|██▋       | 97528/371472 [7:45:22<20:08:04,  3.78it/s]
 26%|██▋       | 97529/371472 [7:45:23<20:13:05,  3.76it/s]
 26%|██▋       | 97530/371472 [7:45:23<20:21:08,  3.74it/s]
 26%|██▋       | 97531/371472 [7:45:23<20:21:17,  3.74it/s]
 26%|██▋       | 97532/371472 [7:45:23<19:55:49,  3.82it/s]
 26%|██▋       | 97533/371472 [7:45:24<20:18:08,  3.75it/s]
 26%|██▋       | 97534/371472 [7:45:24<19:53:37,  3.83it/s]
 26%|██▋       | 97535/371472 [7:45:24<19:44:11,  3.86it/s]
 26%|██▋       | 97536/371472 [7:45:24<19:34:42,  3.89it/s]
 26%|██▋       | 97537/371472 [7:45:25<21:21:18,  3.56it/s]
 26%|██▋       | 97538/371472 [7:45:25<21:18:44,  3.57it/s]
 26%|██▋       | 97539/371472 [7:45:25<22:33:58,  3.37it/s]
 26%|██▋       | 97540/371472 [7:45:26<21:57:53,  3.46it/s]
                                                           
{'loss': 3.4411, 'learning_rate': 7.64038225344222e-07, 'epoch': 4.2}

 26%|██▋       | 97540/371472 [7:45:26<21:57:53,  3.46it/s]
 26%|██▋       | 97541/371472 [7:45:26<22:31:43,  3.38it/s]
 26%|██▋       | 97542/371472 [7:45:26<21:51:43,  3.48it/s]
 26%|██▋       | 97543/371472 [7:45:26<21:24:46,  3.55it/s]
 26%|██▋       | 97544/371472 [7:45:27<21:34:17,  3.53it/s]
 26%|██▋       | 97545/371472 [7:45:27<21:41:01,  3.51it/s]
 26%|██▋       | 97546/371472 [7:45:27<21:27:53,  3.54it/s]
 26%|██▋       | 97547/371472 [7:45:28<22:32:21,  3.38it/s]
 26%|██▋       | 97548/371472 [7:45:28<21:18:16,  3.57it/s]
 26%|██▋       | 97549/371472 [7:45:28<22:02:08,  3.45it/s]
 26%|██▋       | 97550/371472 [7:45:28<21:34:20,  3.53it/s]
 26%|██▋       | 97551/371472 [7:45:29<21:20:39,  3.56it/s]
 26%|██▋       | 97552/371472 [7:45:29<22:03:42,  3.45it/s]
 26%|██▋       | 97553/371472 [7:45:29<21:40:16,  3.51it/s]
 26%|██▋       | 97554/371472 [7:45:30<21:25:42,  3.55it/s]
 26%|██▋       | 97555/371472 [7:45:30<20:38:29,  3.69it/s]
 26%|██▋       | 97556/371472 [7:45:30<20:06:52,  3.78it/s]
 26%|██▋       | 97557/371472 [7:45:30<20:56:09,  3.63it/s]
 26%|██▋       | 97558/371472 [7:45:31<22:08:12,  3.44it/s]
 26%|██▋       | 97559/371472 [7:45:31<24:57:17,  3.05it/s]
 26%|██▋       | 97560/371472 [7:45:31<23:20:40,  3.26it/s]
                                                           
{'loss': 3.6295, 'learning_rate': 7.639897433687432e-07, 'epoch': 4.2}

 26%|██▋       | 97560/371472 [7:45:31<23:20:40,  3.26it/s]
 26%|██▋       | 97561/371472 [7:45:32<22:30:24,  3.38it/s]
 26%|██▋       | 97562/371472 [7:45:32<21:49:35,  3.49it/s]
 26%|██▋       | 97563/371472 [7:45:32<21:18:23,  3.57it/s]
 26%|██▋       | 97564/371472 [7:45:32<21:27:38,  3.55it/s]
 26%|██▋       | 97565/371472 [7:45:33<20:46:39,  3.66it/s]
 26%|██▋       | 97566/371472 [7:45:33<20:40:02,  3.68it/s]
 26%|██▋       | 97567/371472 [7:45:33<20:34:01,  3.70it/s]
 26%|██▋       | 97568/371472 [7:45:34<21:50:57,  3.48it/s]
 26%|██▋       | 97569/371472 [7:45:34<20:48:11,  3.66it/s]
 26%|██▋       | 97570/371472 [7:45:34<20:15:22,  3.76it/s]
 26%|██▋       | 97571/371472 [7:45:34<19:22:44,  3.93it/s]
 26%|██▋       | 97572/371472 [7:45:35<19:11:04,  3.97it/s]
 26%|██▋       | 97573/371472 [7:45:35<20:58:01,  3.63it/s]
 26%|██▋       | 97574/371472 [7:45:35<20:53:36,  3.64it/s]
 26%|██▋       | 97575/371472 [7:45:35<21:37:07,  3.52it/s]
 26%|██▋       | 97576/371472 [7:45:36<20:47:29,  3.66it/s]
 26%|██▋       | 97577/371472 [7:45:36<20:14:47,  3.76it/s]
 26%|██▋       | 97578/371472 [7:45:36<19:26:20,  3.91it/s]
 26%|██▋       | 97579/371472 [7:45:36<20:16:31,  3.75it/s]
 26%|██▋       | 97580/371472 [7:45:37<21:08:43,  3.60it/s]
                                                           
{'loss': 3.789, 'learning_rate': 7.639412613932642e-07, 'epoch': 4.2}

 26%|██▋       | 97580/371472 [7:45:37<21:08:43,  3.60it/s]
 26%|██▋       | 97581/371472 [7:45:37<21:13:25,  3.58it/s]
 26%|██▋       | 97582/371472 [7:45:37<21:52:24,  3.48it/s]
 26%|██▋       | 97583/371472 [7:45:38<21:30:47,  3.54it/s]
 26%|██▋       | 97584/371472 [7:45:38<20:43:35,  3.67it/s]
 26%|██▋       | 97585/371472 [7:45:38<20:08:04,  3.78it/s]
 26%|██▋       | 97586/371472 [7:45:38<20:04:00,  3.79it/s]
 26%|██▋       | 97587/371472 [7:45:39<21:30:06,  3.54it/s]
 26%|██▋       | 97588/371472 [7:45:39<21:08:20,  3.60it/s]
 26%|██▋       | 97589/371472 [7:45:39<22:59:32,  3.31it/s]
 26%|██▋       | 97590/371472 [7:45:40<22:08:19,  3.44it/s]
 26%|██▋       | 97591/371472 [7:45:40<21:45:14,  3.50it/s]
 26%|██▋       | 97592/371472 [7:45:40<22:26:22,  3.39it/s]
 26%|██▋       | 97593/371472 [7:45:40<21:42:31,  3.50it/s]
 26%|██▋       | 97594/371472 [7:45:41<20:35:46,  3.69it/s]
 26%|██▋       | 97595/371472 [7:45:41<22:16:22,  3.42it/s]
 26%|██▋       | 97596/371472 [7:45:41<21:24:13,  3.55it/s]
 26%|██▋       | 97597/371472 [7:45:42<21:53:30,  3.48it/s]
 26%|██▋       | 97598/371472 [7:45:42<21:47:33,  3.49it/s]
 26%|██▋       | 97599/371472 [7:45:42<21:48:30,  3.49it/s]
 26%|██▋       | 97600/371472 [7:45:42<22:41:52,  3.35it/s]
                                                           
{'loss': 3.4085, 'learning_rate': 7.638927794177852e-07, 'epoch': 4.2}

 26%|██▋       | 97600/371472 [7:45:42<22:41:52,  3.35it/s]
 26%|██▋       | 97601/371472 [7:45:43<23:43:13,  3.21it/s]
 26%|██▋       | 97602/371472 [7:45:43<23:37:55,  3.22it/s]
 26%|██▋       | 97603/371472 [7:45:43<23:59:17,  3.17it/s]
 26%|██▋       | 97604/371472 [7:45:44<24:22:48,  3.12it/s]
 26%|██▋       | 97605/371472 [7:45:44<27:51:47,  2.73it/s]
 26%|██▋       | 97606/371472 [7:45:45<26:06:02,  2.91it/s]
 26%|██▋       | 97607/371472 [7:45:45<25:25:45,  2.99it/s]
 26%|██▋       | 97608/371472 [7:45:45<23:35:13,  3.23it/s]
 26%|██▋       | 97609/371472 [7:45:45<24:01:37,  3.17it/s]
 26%|██▋       | 97610/371472 [7:45:46<22:58:50,  3.31it/s]
 26%|██▋       | 97611/371472 [7:45:46<22:31:17,  3.38it/s]
 26%|██▋       | 97612/371472 [7:45:46<21:34:54,  3.52it/s]
 26%|██▋       | 97613/371472 [7:45:47<21:26:02,  3.55it/s]
 26%|██▋       | 97614/371472 [7:45:47<21:18:35,  3.57it/s]
 26%|██▋       | 97615/371472 [7:45:47<23:33:21,  3.23it/s]
 26%|██▋       | 97616/371472 [7:45:48<23:56:03,  3.18it/s]
 26%|██▋       | 97617/371472 [7:45:48<22:56:54,  3.31it/s]
 26%|██▋       | 97618/371472 [7:45:48<22:28:07,  3.39it/s]
 26%|██▋       | 97619/371472 [7:45:48<21:39:02,  3.51it/s]
 26%|██▋       | 97620/371472 [7:45:49<21:23:53,  3.55it/s]
                                                           
{'loss': 3.5776, 'learning_rate': 7.638442974423064e-07, 'epoch': 4.2}

 26%|██▋       | 97620/371472 [7:45:49<21:23:53,  3.55it/s]
 26%|██▋       | 97621/371472 [7:45:49<21:09:51,  3.59it/s]
 26%|██▋       | 97622/371472 [7:45:49<20:52:51,  3.64it/s]
 26%|██▋       | 97623/371472 [7:45:49<22:30:52,  3.38it/s]
 26%|██▋       | 97624/371472 [7:45:50<21:50:38,  3.48it/s]
 26%|██▋       | 97625/371472 [7:45:50<21:24:18,  3.55it/s]
 26%|██▋       | 97626/371472 [7:45:50<20:43:00,  3.67it/s]
 26%|██▋       | 97627/371472 [7:45:51<22:08:47,  3.43it/s]
 26%|██▋       | 97628/371472 [7:45:51<20:55:23,  3.64it/s]
 26%|██▋       | 97629/371472 [7:45:51<20:22:35,  3.73it/s]
 26%|██▋       | 97630/371472 [7:45:51<20:40:49,  3.68it/s]
 26%|██▋       | 97631/371472 [7:45:52<20:16:53,  3.75it/s]
 26%|██▋       | 97632/371472 [7:45:52<20:49:09,  3.65it/s]
 26%|██▋       | 97633/371472 [7:45:52<21:09:18,  3.60it/s]
 26%|██▋       | 97634/371472 [7:45:52<21:07:15,  3.60it/s]
 26%|██▋       | 97635/371472 [7:45:53<22:49:23,  3.33it/s]
 26%|██▋       | 97636/371472 [7:45:53<21:22:08,  3.56it/s]
 26%|██▋       | 97637/371472 [7:45:53<21:46:08,  3.49it/s]
 26%|██▋       | 97638/371472 [7:45:54<21:46:53,  3.49it/s]
 26%|██▋       | 97639/371472 [7:45:54<21:41:56,  3.51it/s]
 26%|██▋       | 97640/371472 [7:45:54<21:19:14,  3.57it/s]
                                                           
{'loss': 3.6755, 'learning_rate': 7.637958154668276e-07, 'epoch': 4.21}

 26%|██▋       | 97640/371472 [7:45:54<21:19:14,  3.57it/s]
 26%|██▋       | 97641/371472 [7:45:54<21:48:31,  3.49it/s]
 26%|██▋       | 97642/371472 [7:45:55<21:07:16,  3.60it/s]
 26%|██▋       | 97643/371472 [7:45:55<20:38:12,  3.69it/s]
 26%|██▋       | 97644/371472 [7:45:55<21:20:56,  3.56it/s]
 26%|██▋       | 97645/371472 [7:45:56<23:08:46,  3.29it/s]
 26%|██▋       | 97646/371472 [7:45:56<25:02:43,  3.04it/s]
 26%|██▋       | 97647/371472 [7:45:56<22:48:05,  3.34it/s]
 26%|██▋       | 97648/371472 [7:45:57<23:35:17,  3.22it/s]
 26%|██▋       | 97649/371472 [7:45:57<23:19:12,  3.26it/s]
 26%|██▋       | 97650/371472 [7:45:57<23:51:24,  3.19it/s]
 26%|██▋       | 97651/371472 [7:45:58<22:45:57,  3.34it/s]
 26%|██▋       | 97652/371472 [7:45:58<21:49:20,  3.49it/s]
 26%|██▋       | 97653/371472 [7:45:58<21:23:51,  3.55it/s]
 26%|██▋       | 97654/371472 [7:45:58<22:22:28,  3.40it/s]
 26%|██▋       | 97655/371472 [7:45:59<22:55:54,  3.32it/s]
 26%|██▋       | 97656/371472 [7:45:59<25:31:09,  2.98it/s]
 26%|██▋       | 97657/371472 [7:45:59<24:12:26,  3.14it/s]
 26%|██▋       | 97658/371472 [7:46:00<22:33:31,  3.37it/s]
 26%|██▋       | 97659/371472 [7:46:00<21:22:55,  3.56it/s]
 26%|██▋       | 97660/371472 [7:46:00<21:50:33,  3.48it/s]
                                                           
{'loss': 3.6116, 'learning_rate': 7.637473334913486e-07, 'epoch': 4.21}

 26%|██▋       | 97660/371472 [7:46:00<21:50:33,  3.48it/s]
 26%|██▋       | 97661/371472 [7:46:00<21:58:07,  3.46it/s]
 26%|██▋       | 97662/371472 [7:46:01<22:17:00,  3.41it/s]
 26%|██▋       | 97663/371472 [7:46:01<21:12:20,  3.59it/s]
 26%|██▋       | 97664/371472 [7:46:01<21:15:45,  3.58it/s]
 26%|██▋       | 97665/371472 [7:46:02<20:37:43,  3.69it/s]
 26%|██▋       | 97666/371472 [7:46:02<20:30:36,  3.71it/s]
 26%|██▋       | 97667/371472 [7:46:02<22:39:57,  3.36it/s]
 26%|██▋       | 97668/371472 [7:46:03<23:16:41,  3.27it/s]
 26%|██▋       | 97669/371472 [7:46:03<24:29:42,  3.10it/s]
 26%|██▋       | 97670/371472 [7:46:03<23:00:11,  3.31it/s]
 26%|██▋       | 97671/371472 [7:46:03<23:00:04,  3.31it/s]
 26%|██▋       | 97672/371472 [7:46:04<22:50:07,  3.33it/s]
 26%|██▋       | 97673/371472 [7:46:04<22:12:38,  3.42it/s]
 26%|██▋       | 97674/371472 [7:46:04<21:25:06,  3.55it/s]
 26%|██▋       | 97675/371472 [7:46:05<21:31:53,  3.53it/s]
 26%|██▋       | 97676/371472 [7:46:05<21:05:18,  3.61it/s]
 26%|██▋       | 97677/371472 [7:46:05<21:03:27,  3.61it/s]
 26%|██▋       | 97678/371472 [7:46:05<20:42:20,  3.67it/s]
 26%|██▋       | 97679/371472 [7:46:06<20:18:32,  3.74it/s]
 26%|██▋       | 97680/371472 [7:46:06<20:09:03,  3.77it/s]
                                                           
{'loss': 3.608, 'learning_rate': 7.636988515158697e-07, 'epoch': 4.21}

 26%|██▋       | 97680/371472 [7:46:06<20:09:03,  3.77it/s]
 26%|██▋       | 97681/371472 [7:46:06<22:12:50,  3.42it/s]
 26%|██▋       | 97682/371472 [7:46:06<21:59:14,  3.46it/s]
 26%|██▋       | 97683/371472 [7:46:07<21:32:17,  3.53it/s]
 26%|██▋       | 97684/371472 [7:46:07<20:55:46,  3.63it/s]
 26%|██▋       | 97685/371472 [7:46:07<20:32:08,  3.70it/s]
 26%|██▋       | 97686/371472 [7:46:08<19:57:22,  3.81it/s]
 26%|██▋       | 97687/371472 [7:46:08<19:40:22,  3.87it/s]
 26%|██▋       | 97688/371472 [7:46:08<19:30:02,  3.90it/s]
 26%|██▋       | 97689/371472 [7:46:08<19:43:04,  3.86it/s]
 26%|██▋       | 97690/371472 [7:46:09<20:46:39,  3.66it/s]
 26%|██▋       | 97691/371472 [7:46:09<20:11:09,  3.77it/s]
 26%|██▋       | 97692/371472 [7:46:09<19:56:57,  3.81it/s]
 26%|██▋       | 97693/371472 [7:46:10<23:45:43,  3.20it/s]
 26%|██▋       | 97694/371472 [7:46:10<23:11:45,  3.28it/s]
 26%|██▋       | 97695/371472 [7:46:10<22:49:04,  3.33it/s]
 26%|██▋       | 97696/371472 [7:46:10<21:53:23,  3.47it/s]
 26%|██▋       | 97697/371472 [7:46:11<21:47:25,  3.49it/s]
 26%|██▋       | 97698/371472 [7:46:11<23:19:26,  3.26it/s]
 26%|██▋       | 97699/371472 [7:46:11<21:58:39,  3.46it/s]
 26%|██▋       | 97700/371472 [7:46:12<22:38:31,  3.36it/s]
                                                           
{'loss': 3.5513, 'learning_rate': 7.636503695403909e-07, 'epoch': 4.21}

 26%|██▋       | 97700/371472 [7:46:12<22:38:31,  3.36it/s]
 26%|██▋       | 97701/371472 [7:46:12<22:07:58,  3.44it/s]
 26%|██▋       | 97702/371472 [7:46:12<21:16:50,  3.57it/s]
 26%|██▋       | 97703/371472 [7:46:12<20:21:24,  3.74it/s]
 26%|██▋       | 97704/371472 [7:46:13<20:21:46,  3.73it/s]
 26%|██▋       | 97705/371472 [7:46:13<21:29:29,  3.54it/s]
 26%|██▋       | 97706/371472 [7:46:13<22:23:09,  3.40it/s]
 26%|██▋       | 97707/371472 [7:46:14<21:52:48,  3.48it/s]
 26%|██▋       | 97708/371472 [7:46:14<23:46:03,  3.20it/s]
 26%|██▋       | 97709/371472 [7:46:14<23:35:12,  3.22it/s]
 26%|██▋       | 97710/371472 [7:46:15<24:04:31,  3.16it/s]
 26%|██▋       | 97711/371472 [7:46:15<23:14:14,  3.27it/s]
 26%|██▋       | 97712/371472 [7:46:15<22:51:13,  3.33it/s]
 26%|██▋       | 97713/371472 [7:46:15<22:10:43,  3.43it/s]
 26%|██▋       | 97714/371472 [7:46:16<21:03:18,  3.61it/s]
 26%|██▋       | 97715/371472 [7:46:16<21:14:14,  3.58it/s]
 26%|██▋       | 97716/371472 [7:46:16<20:28:34,  3.71it/s]
 26%|██▋       | 97717/371472 [7:46:16<21:25:26,  3.55it/s]
 26%|██▋       | 97718/371472 [7:46:17<21:22:45,  3.56it/s]
 26%|██▋       | 97719/371472 [7:46:17<20:46:58,  3.66it/s]
 26%|██▋       | 97720/371472 [7:46:17<21:04:27,  3.61it/s]
                                                           
{'loss': 3.5045, 'learning_rate': 7.636018875649119e-07, 'epoch': 4.21}

 26%|██▋       | 97720/371472 [7:46:17<21:04:27,  3.61it/s]
 26%|██▋       | 97721/371472 [7:46:18<20:36:04,  3.69it/s]
 26%|██▋       | 97722/371472 [7:46:18<20:46:49,  3.66it/s]
 26%|██▋       | 97723/371472 [7:46:18<20:29:32,  3.71it/s]
 26%|██▋       | 97724/371472 [7:46:18<21:32:37,  3.53it/s]
 26%|██▋       | 97725/371472 [7:46:19<22:58:43,  3.31it/s]
 26%|██▋       | 97726/371472 [7:46:19<22:03:13,  3.45it/s]
 26%|██▋       | 97727/371472 [7:46:19<21:52:31,  3.48it/s]
 26%|██▋       | 97728/371472 [7:46:20<21:37:52,  3.52it/s]
 26%|██▋       | 97729/371472 [7:46:20<22:52:02,  3.33it/s]
 26%|██▋       | 97730/371472 [7:46:20<22:17:51,  3.41it/s]
 26%|██▋       | 97731/371472 [7:46:20<22:41:51,  3.35it/s]
 26%|██▋       | 97732/371472 [7:46:21<21:47:44,  3.49it/s]
 26%|██▋       | 97733/371472 [7:46:21<21:58:57,  3.46it/s]
 26%|██▋       | 97734/371472 [7:46:21<21:43:16,  3.50it/s]
 26%|██▋       | 97735/371472 [7:46:22<20:48:42,  3.65it/s]
 26%|██▋       | 97736/371472 [7:46:22<20:57:51,  3.63it/s]
 26%|██▋       | 97737/371472 [7:46:22<20:32:54,  3.70it/s]
 26%|██▋       | 97738/371472 [7:46:22<19:59:01,  3.80it/s]
 26%|██▋       | 97739/371472 [7:46:23<19:40:23,  3.86it/s]
 26%|██▋       | 97740/371472 [7:46:23<20:19:18,  3.74it/s]
                                                           
{'loss': 3.487, 'learning_rate': 7.63553405589433e-07, 'epoch': 4.21}

 26%|██▋       | 97740/371472 [7:46:23<20:19:18,  3.74it/s]
 26%|██▋       | 97741/371472 [7:46:23<20:26:22,  3.72it/s]
 26%|██▋       | 97742/371472 [7:46:23<20:37:21,  3.69it/s]
 26%|██▋       | 97743/371472 [7:46:24<22:43:35,  3.35it/s]
 26%|██▋       | 97744/371472 [7:46:24<22:29:10,  3.38it/s]
 26%|██▋       | 97745/371472 [7:46:24<21:14:33,  3.58it/s]
 26%|██▋       | 97746/371472 [7:46:25<21:26:58,  3.54it/s]
 26%|██▋       | 97747/371472 [7:46:25<20:46:36,  3.66it/s]
 26%|██▋       | 97748/371472 [7:46:25<20:12:16,  3.76it/s]
 26%|██▋       | 97749/371472 [7:46:25<20:25:16,  3.72it/s]
 26%|██▋       | 97750/371472 [7:46:26<22:34:43,  3.37it/s]
 26%|██▋       | 97751/371472 [7:46:26<20:57:31,  3.63it/s]
 26%|██▋       | 97752/371472 [7:46:26<20:21:48,  3.73it/s]
 26%|██▋       | 97753/371472 [7:46:26<19:38:28,  3.87it/s]
 26%|██▋       | 97754/371472 [7:46:27<19:19:26,  3.93it/s]
 26%|██▋       | 97755/371472 [7:46:27<19:11:47,  3.96it/s]
 26%|██▋       | 97756/371472 [7:46:27<19:22:48,  3.92it/s]
 26%|██▋       | 97757/371472 [7:46:27<20:11:27,  3.77it/s]
 26%|██▋       | 97758/371472 [7:46:28<20:42:14,  3.67it/s]
 26%|██▋       | 97759/371472 [7:46:28<23:01:34,  3.30it/s]
 26%|██▋       | 97760/371472 [7:46:28<22:32:15,  3.37it/s]
                                                           
{'loss': 3.6189, 'learning_rate': 7.635049236139541e-07, 'epoch': 4.21}

 26%|██▋       | 97760/371472 [7:46:28<22:32:15,  3.37it/s]
 26%|██▋       | 97761/371472 [7:46:29<21:47:29,  3.49it/s]
 26%|██▋       | 97762/371472 [7:46:29<20:49:57,  3.65it/s]
 26%|██▋       | 97763/371472 [7:46:29<21:26:47,  3.55it/s]
 26%|██▋       | 97764/371472 [7:46:30<22:23:33,  3.40it/s]
 26%|██▋       | 97765/371472 [7:46:30<21:38:05,  3.51it/s]
 26%|██▋       | 97766/371472 [7:46:30<21:12:43,  3.58it/s]
 26%|██▋       | 97767/371472 [7:46:30<20:35:23,  3.69it/s]
 26%|██▋       | 97768/371472 [7:46:31<20:42:43,  3.67it/s]
 26%|██▋       | 97769/371472 [7:46:31<21:15:37,  3.58it/s]
 26%|██▋       | 97770/371472 [7:46:31<20:52:00,  3.64it/s]
 26%|██▋       | 97771/371472 [7:46:32<22:34:31,  3.37it/s]
 26%|██▋       | 97772/371472 [7:46:32<21:37:19,  3.52it/s]
 26%|██▋       | 97773/371472 [7:46:32<24:06:33,  3.15it/s]
 26%|██▋       | 97774/371472 [7:46:32<22:43:10,  3.35it/s]
 26%|██▋       | 97775/371472 [7:46:33<23:42:57,  3.21it/s]
 26%|██▋       | 97776/371472 [7:46:33<24:56:28,  3.05it/s]
 26%|██▋       | 97777/371472 [7:46:33<24:02:02,  3.16it/s]
 26%|██▋       | 97778/371472 [7:46:34<22:28:21,  3.38it/s]
 26%|██▋       | 97779/371472 [7:46:34<21:25:32,  3.55it/s]
 26%|██▋       | 97780/371472 [7:46:34<20:48:58,  3.65it/s]
                                                           
{'loss': 3.6587, 'learning_rate': 7.634564416384753e-07, 'epoch': 4.21}

 26%|██▋       | 97780/371472 [7:46:34<20:48:58,  3.65it/s]
 26%|██▋       | 97781/371472 [7:46:34<20:36:47,  3.69it/s]
 26%|██▋       | 97782/371472 [7:46:35<22:30:16,  3.38it/s]
 26%|██▋       | 97783/371472 [7:46:35<21:42:06,  3.50it/s]
 26%|██▋       | 97784/371472 [7:46:35<21:07:17,  3.60it/s]
 26%|██▋       | 97785/371472 [7:46:36<22:03:40,  3.45it/s]
 26%|██▋       | 97786/371472 [7:46:36<22:28:54,  3.38it/s]
 26%|██▋       | 97787/371472 [7:46:36<21:38:47,  3.51it/s]
 26%|██▋       | 97788/371472 [7:46:37<22:04:26,  3.44it/s]
 26%|██▋       | 97789/371472 [7:46:37<22:43:26,  3.35it/s]
 26%|██▋       | 97790/371472 [7:46:37<22:40:44,  3.35it/s]
 26%|██▋       | 97791/371472 [7:46:37<22:13:18,  3.42it/s]
 26%|██▋       | 97792/371472 [7:46:38<22:25:53,  3.39it/s]
 26%|██▋       | 97793/371472 [7:46:38<23:21:41,  3.25it/s]
 26%|██▋       | 97794/371472 [7:46:38<22:44:28,  3.34it/s]
 26%|██▋       | 97795/371472 [7:46:39<21:53:14,  3.47it/s]
 26%|██▋       | 97796/371472 [7:46:39<21:12:32,  3.58it/s]
 26%|██▋       | 97797/371472 [7:46:39<20:43:04,  3.67it/s]
 26%|██▋       | 97798/371472 [7:46:39<20:49:50,  3.65it/s]
 26%|██▋       | 97799/371472 [7:46:40<20:29:11,  3.71it/s]
 26%|██▋       | 97800/371472 [7:46:40<20:39:40,  3.68it/s]
                                                           
{'loss': 3.5741, 'learning_rate': 7.634079596629964e-07, 'epoch': 4.21}

 26%|██▋       | 97800/371472 [7:46:40<20:39:40,  3.68it/s]
 26%|██▋       | 97801/371472 [7:46:40<19:49:08,  3.84it/s]
 26%|██▋       | 97802/371472 [7:46:40<19:53:01,  3.82it/s]
 26%|██▋       | 97803/371472 [7:46:41<19:26:06,  3.91it/s]
 26%|██▋       | 97804/371472 [7:46:41<19:28:39,  3.90it/s]
 26%|██▋       | 97805/371472 [7:46:41<19:07:54,  3.97it/s]
 26%|██▋       | 97806/371472 [7:46:41<19:32:33,  3.89it/s]
 26%|██▋       | 97807/371472 [7:46:42<21:25:19,  3.55it/s]
 26%|██▋       | 97808/371472 [7:46:42<21:17:29,  3.57it/s]
 26%|██▋       | 97809/371472 [7:46:42<21:11:02,  3.59it/s]
 26%|██▋       | 97810/371472 [7:46:43<20:25:10,  3.72it/s]
 26%|██▋       | 97811/371472 [7:46:43<20:26:31,  3.72it/s]
 26%|██▋       | 97812/371472 [7:46:43<21:07:45,  3.60it/s]
 26%|██▋       | 97813/371472 [7:46:43<21:16:39,  3.57it/s]
 26%|██▋       | 97814/371472 [7:46:44<20:12:48,  3.76it/s]
 26%|██▋       | 97815/371472 [7:46:44<19:32:40,  3.89it/s]
 26%|██▋       | 97816/371472 [7:46:44<20:39:04,  3.68it/s]
 26%|██▋       | 97817/371472 [7:46:44<21:08:41,  3.59it/s]
 26%|██▋       | 97818/371472 [7:46:45<21:07:36,  3.60it/s]
 26%|██▋       | 97819/371472 [7:46:45<20:28:33,  3.71it/s]
 26%|██▋       | 97820/371472 [7:46:45<20:48:39,  3.65it/s]
                                                           
{'loss': 3.8757, 'learning_rate': 7.633594776875175e-07, 'epoch': 4.21}

 26%|██▋       | 97820/371472 [7:46:45<20:48:39,  3.65it/s]
 26%|██▋       | 97821/371472 [7:46:46<20:30:41,  3.71it/s]
 26%|██▋       | 97822/371472 [7:46:46<20:33:10,  3.70it/s]
 26%|██▋       | 97823/371472 [7:46:46<20:31:37,  3.70it/s]
 26%|██▋       | 97824/371472 [7:46:46<20:24:35,  3.72it/s]
 26%|██▋       | 97825/371472 [7:46:47<20:42:06,  3.67it/s]
 26%|██▋       | 97826/371472 [7:46:47<20:39:16,  3.68it/s]
 26%|██▋       | 97827/371472 [7:46:47<20:12:24,  3.76it/s]
 26%|██▋       | 97828/371472 [7:46:47<20:18:37,  3.74it/s]
 26%|██▋       | 97829/371472 [7:46:48<19:37:56,  3.87it/s]
 26%|██▋       | 97830/371472 [7:46:48<19:33:46,  3.89it/s]
 26%|██▋       | 97831/371472 [7:46:48<19:41:50,  3.86it/s]
 26%|██▋       | 97832/371472 [7:46:48<20:18:35,  3.74it/s]
 26%|██▋       | 97833/371472 [7:46:49<20:08:38,  3.77it/s]
 26%|██▋       | 97834/371472 [7:46:49<19:41:34,  3.86it/s]
 26%|██▋       | 97835/371472 [7:46:49<20:02:51,  3.79it/s]
 26%|██▋       | 97836/371472 [7:46:49<19:29:45,  3.90it/s]
 26%|██▋       | 97837/371472 [7:46:50<19:18:50,  3.94it/s]
 26%|██▋       | 97838/371472 [7:46:50<19:33:59,  3.88it/s]
 26%|██▋       | 97839/371472 [7:46:50<24:28:24,  3.11it/s]
 26%|██▋       | 97840/371472 [7:46:51<24:54:26,  3.05it/s]
                                                           
{'loss': 3.4607, 'learning_rate': 7.633109957120386e-07, 'epoch': 4.21}

 26%|██▋       | 97840/371472 [7:46:51<24:54:26,  3.05it/s]
 26%|██▋       | 97841/371472 [7:46:51<24:26:29,  3.11it/s]
 26%|██▋       | 97842/371472 [7:46:51<23:06:44,  3.29it/s]
 26%|██▋       | 97843/371472 [7:46:52<22:20:16,  3.40it/s]
 26%|██▋       | 97844/371472 [7:46:52<22:35:46,  3.36it/s]
 26%|██▋       | 97845/371472 [7:46:52<21:53:57,  3.47it/s]
 26%|██▋       | 97846/371472 [7:46:52<20:45:34,  3.66it/s]
 26%|██▋       | 97847/371472 [7:46:53<20:06:17,  3.78it/s]
 26%|██▋       | 97848/371472 [7:46:53<22:45:11,  3.34it/s]
 26%|██▋       | 97849/371472 [7:46:53<22:24:17,  3.39it/s]
 26%|██▋       | 97850/371472 [7:46:54<21:47:24,  3.49it/s]
 26%|██▋       | 97851/371472 [7:46:54<21:58:06,  3.46it/s]
 26%|██▋       | 97852/371472 [7:46:54<21:19:30,  3.56it/s]
 26%|██▋       | 97853/371472 [7:46:54<20:32:01,  3.70it/s]
 26%|██▋       | 97854/371472 [7:46:55<20:22:23,  3.73it/s]
 26%|██▋       | 97855/371472 [7:46:55<21:59:00,  3.46it/s]
 26%|██▋       | 97856/371472 [7:46:55<21:34:29,  3.52it/s]
 26%|██▋       | 97857/371472 [7:46:56<20:39:59,  3.68it/s]
 26%|██▋       | 97858/371472 [7:46:56<20:31:22,  3.70it/s]
 26%|██▋       | 97859/371472 [7:46:56<21:57:46,  3.46it/s]
 26%|██▋       | 97860/371472 [7:46:56<21:32:51,  3.53it/s]
                                                           
{'loss': 3.6519, 'learning_rate': 7.632625137365597e-07, 'epoch': 4.22}

 26%|██▋       | 97860/371472 [7:46:56<21:32:51,  3.53it/s]
 26%|██▋       | 97861/371472 [7:46:57<21:57:34,  3.46it/s]
 26%|██▋       | 97862/371472 [7:46:57<21:11:02,  3.59it/s]
 26%|██▋       | 97863/371472 [7:46:57<20:29:15,  3.71it/s]
 26%|██▋       | 97864/371472 [7:46:58<20:26:36,  3.72it/s]
 26%|██▋       | 97865/371472 [7:46:58<19:36:32,  3.88it/s]
 26%|██▋       | 97866/371472 [7:46:58<19:04:54,  3.98it/s]
 26%|██▋       | 97867/371472 [7:46:58<20:29:22,  3.71it/s]
 26%|██▋       | 97868/371472 [7:46:59<20:32:29,  3.70it/s]
 26%|██▋       | 97869/371472 [7:46:59<20:59:52,  3.62it/s]
 26%|██▋       | 97870/371472 [7:46:59<21:56:40,  3.46it/s]
 26%|██▋       | 97871/371472 [7:46:59<21:40:42,  3.51it/s]
 26%|██▋       | 97872/371472 [7:47:00<22:00:50,  3.45it/s]
 26%|██▋       | 97873/371472 [7:47:00<21:37:36,  3.51it/s]
 26%|██▋       | 97874/371472 [7:47:00<20:45:47,  3.66it/s]
 26%|██▋       | 97875/371472 [7:47:01<20:27:46,  3.71it/s]
 26%|██▋       | 97876/371472 [7:47:01<21:16:33,  3.57it/s]
 26%|██▋       | 97877/371472 [7:47:01<21:01:25,  3.61it/s]
 26%|██▋       | 97878/371472 [7:47:01<21:15:31,  3.57it/s]
 26%|██▋       | 97879/371472 [7:47:02<22:03:54,  3.44it/s]
 26%|██▋       | 97880/371472 [7:47:02<21:00:21,  3.62it/s]
                                                           
{'loss': 3.6615, 'learning_rate': 7.632140317610808e-07, 'epoch': 4.22}

 26%|██▋       | 97880/371472 [7:47:02<21:00:21,  3.62it/s]
 26%|██▋       | 97881/371472 [7:47:02<21:29:50,  3.54it/s]
 26%|██▋       | 97882/371472 [7:47:02<20:52:03,  3.64it/s]
 26%|██▋       | 97883/371472 [7:47:03<20:42:12,  3.67it/s]
 26%|██▋       | 97884/371472 [7:47:03<21:29:30,  3.54it/s]
 26%|██▋       | 97885/371472 [7:47:03<21:06:58,  3.60it/s]
 26%|██▋       | 97886/371472 [7:47:04<20:24:13,  3.72it/s]
 26%|██▋       | 97887/371472 [7:47:04<21:30:16,  3.53it/s]
 26%|██▋       | 97888/371472 [7:47:04<20:30:39,  3.71it/s]
 26%|██▋       | 97889/371472 [7:47:04<20:06:34,  3.78it/s]
 26%|██▋       | 97890/371472 [7:47:05<20:00:31,  3.80it/s]
 26%|██▋       | 97891/371472 [7:47:05<21:31:03,  3.53it/s]
 26%|██▋       | 97892/371472 [7:47:05<21:46:40,  3.49it/s]
 26%|██▋       | 97893/371472 [7:47:06<21:24:51,  3.55it/s]
 26%|██▋       | 97894/371472 [7:47:06<20:59:10,  3.62it/s]
 26%|██▋       | 97895/371472 [7:47:06<23:29:37,  3.23it/s]
 26%|██▋       | 97896/371472 [7:47:07<24:46:06,  3.07it/s]
 26%|██▋       | 97897/371472 [7:47:07<24:09:19,  3.15it/s]
 26%|██▋       | 97898/371472 [7:47:07<23:06:05,  3.29it/s]
 26%|██▋       | 97899/371472 [7:47:07<22:45:48,  3.34it/s]
 26%|██▋       | 97900/371472 [7:47:08<22:45:05,  3.34it/s]
                                                           
{'loss': 3.6786, 'learning_rate': 7.631655497856019e-07, 'epoch': 4.22}

 26%|██▋       | 97900/371472 [7:47:08<22:45:05,  3.34it/s]
 26%|██▋       | 97901/371472 [7:47:08<21:45:31,  3.49it/s]
 26%|██▋       | 97902/371472 [7:47:08<21:45:00,  3.49it/s]
 26%|██▋       | 97903/371472 [7:47:09<21:42:52,  3.50it/s]
 26%|██▋       | 97904/371472 [7:47:09<22:15:16,  3.41it/s]
 26%|██▋       | 97905/371472 [7:47:09<23:22:56,  3.25it/s]
 26%|██▋       | 97906/371472 [7:47:09<22:07:36,  3.43it/s]
 26%|██▋       | 97907/371472 [7:47:10<21:09:51,  3.59it/s]
 26%|██▋       | 97908/371472 [7:47:10<20:36:52,  3.69it/s]
 26%|██▋       | 97909/371472 [7:47:10<22:53:44,  3.32it/s]
 26%|██▋       | 97910/371472 [7:47:11<22:14:39,  3.42it/s]
 26%|██▋       | 97911/371472 [7:47:11<21:25:05,  3.55it/s]
 26%|██▋       | 97912/371472 [7:47:11<20:34:34,  3.69it/s]
 26%|██▋       | 97913/371472 [7:47:11<20:57:40,  3.63it/s]
 26%|██▋       | 97914/371472 [7:47:12<20:52:00,  3.64it/s]
 26%|██▋       | 97915/371472 [7:47:12<20:28:40,  3.71it/s]
 26%|██▋       | 97916/371472 [7:47:12<22:05:15,  3.44it/s]
 26%|██▋       | 97917/371472 [7:47:13<21:46:23,  3.49it/s]
 26%|██▋       | 97918/371472 [7:47:13<22:54:14,  3.32it/s]
 26%|██▋       | 97919/371472 [7:47:13<25:03:27,  3.03it/s]
 26%|██▋       | 97920/371472 [7:47:14<23:52:03,  3.18it/s]
                                                           
{'loss': 3.7063, 'learning_rate': 7.63117067810123e-07, 'epoch': 4.22}

 26%|██▋       | 97920/371472 [7:47:14<23:52:03,  3.18it/s]
 26%|██▋       | 97921/371472 [7:47:14<22:49:26,  3.33it/s]
 26%|██▋       | 97922/371472 [7:47:14<23:46:15,  3.20it/s]
 26%|██▋       | 97923/371472 [7:47:14<22:05:45,  3.44it/s]
 26%|██▋       | 97924/371472 [7:47:15<22:06:26,  3.44it/s]
 26%|██▋       | 97925/371472 [7:47:15<21:30:20,  3.53it/s]
 26%|██▋       | 97926/371472 [7:47:15<21:40:05,  3.51it/s]
 26%|██▋       | 97927/371472 [7:47:16<21:28:23,  3.54it/s]
 26%|██▋       | 97928/371472 [7:47:16<22:00:37,  3.45it/s]
 26%|██▋       | 97929/371472 [7:47:16<21:15:32,  3.57it/s]
 26%|██▋       | 97930/371472 [7:47:16<21:00:33,  3.62it/s]
 26%|██▋       | 97931/371472 [7:47:17<21:12:14,  3.58it/s]
 26%|██▋       | 97932/371472 [7:47:17<22:23:14,  3.39it/s]
 26%|██▋       | 97933/371472 [7:47:17<24:16:43,  3.13it/s]
 26%|██▋       | 97934/371472 [7:47:18<23:05:44,  3.29it/s]
 26%|██▋       | 97935/371472 [7:47:18<22:29:01,  3.38it/s]
 26%|██▋       | 97936/371472 [7:47:18<21:57:36,  3.46it/s]
 26%|██▋       | 97937/371472 [7:47:19<23:46:59,  3.19it/s]
 26%|██▋       | 97938/371472 [7:47:19<23:09:36,  3.28it/s]
 26%|██▋       | 97939/371472 [7:47:19<23:11:28,  3.28it/s]
 26%|██▋       | 97940/371472 [7:47:19<22:36:40,  3.36it/s]
                                                           
{'loss': 3.4403, 'learning_rate': 7.630685858346442e-07, 'epoch': 4.22}

 26%|██▋       | 97940/371472 [7:47:19<22:36:40,  3.36it/s]
 26%|██▋       | 97941/371472 [7:47:20<21:32:16,  3.53it/s]
 26%|██▋       | 97942/371472 [7:47:20<21:04:18,  3.61it/s]
 26%|██▋       | 97943/371472 [7:47:20<20:22:54,  3.73it/s]
 26%|██▋       | 97944/371472 [7:47:20<21:31:49,  3.53it/s]
 26%|██▋       | 97945/371472 [7:47:21<20:55:09,  3.63it/s]
 26%|██▋       | 97946/371472 [7:47:21<20:44:42,  3.66it/s]
 26%|██▋       | 97947/371472 [7:47:21<22:21:47,  3.40it/s]
 26%|██▋       | 97948/371472 [7:47:22<21:09:52,  3.59it/s]
 26%|██▋       | 97949/371472 [7:47:22<21:05:23,  3.60it/s]
 26%|██▋       | 97950/371472 [7:47:22<21:13:09,  3.58it/s]
 26%|██▋       | 97951/371472 [7:47:22<21:25:12,  3.55it/s]
 26%|██▋       | 97952/371472 [7:47:23<21:44:23,  3.49it/s]
 26%|██▋       | 97953/371472 [7:47:23<21:37:30,  3.51it/s]
 26%|██▋       | 97954/371472 [7:47:23<21:04:20,  3.61it/s]
 26%|██▋       | 97955/371472 [7:47:24<23:11:55,  3.28it/s]
 26%|██▋       | 97956/371472 [7:47:24<23:25:19,  3.24it/s]
 26%|██▋       | 97957/371472 [7:47:24<22:22:53,  3.39it/s]
 26%|██▋       | 97958/371472 [7:47:24<21:29:52,  3.53it/s]
 26%|██▋       | 97959/371472 [7:47:25<21:02:34,  3.61it/s]
 26%|██▋       | 97960/371472 [7:47:25<20:34:17,  3.69it/s]
                                                           
{'loss': 3.5957, 'learning_rate': 7.630201038591653e-07, 'epoch': 4.22}

 26%|██▋       | 97960/371472 [7:47:25<20:34:17,  3.69it/s]
 26%|██▋       | 97961/371472 [7:47:25<20:56:53,  3.63it/s]
 26%|██▋       | 97962/371472 [7:47:26<22:51:59,  3.32it/s]
 26%|██▋       | 97963/371472 [7:47:26<22:34:43,  3.36it/s]
 26%|██▋       | 97964/371472 [7:47:26<22:19:07,  3.40it/s]
 26%|██▋       | 97965/371472 [7:47:26<21:10:33,  3.59it/s]
 26%|██▋       | 97966/371472 [7:47:27<20:43:14,  3.67it/s]
 26%|██▋       | 97967/371472 [7:47:27<20:14:31,  3.75it/s]
 26%|██▋       | 97968/371472 [7:47:27<20:41:27,  3.67it/s]
 26%|██▋       | 97969/371472 [7:47:28<20:38:00,  3.68it/s]
 26%|██▋       | 97970/371472 [7:47:28<20:28:19,  3.71it/s]
 26%|██▋       | 97971/371472 [7:47:28<21:31:55,  3.53it/s]
 26%|██▋       | 97972/371472 [7:47:28<21:57:20,  3.46it/s]
 26%|██▋       | 97973/371472 [7:47:29<21:46:31,  3.49it/s]
 26%|██▋       | 97974/371472 [7:47:29<21:11:01,  3.59it/s]
 26%|██▋       | 97975/371472 [7:47:29<21:06:52,  3.60it/s]
 26%|██▋       | 97976/371472 [7:47:30<21:26:46,  3.54it/s]
 26%|██▋       | 97977/371472 [7:47:30<20:52:48,  3.64it/s]
 26%|██▋       | 97978/371472 [7:47:30<20:52:53,  3.64it/s]
 26%|██▋       | 97979/371472 [7:47:30<20:54:07,  3.63it/s]
 26%|██▋       | 97980/371472 [7:47:31<21:40:11,  3.51it/s]
                                                           
{'loss': 3.5053, 'learning_rate': 7.629716218836862e-07, 'epoch': 4.22}

 26%|██▋       | 97980/371472 [7:47:31<21:40:11,  3.51it/s]
 26%|██▋       | 97981/371472 [7:47:31<22:15:15,  3.41it/s]
 26%|██▋       | 97982/371472 [7:47:31<21:01:49,  3.61it/s]
 26%|██▋       | 97983/371472 [7:47:31<21:46:34,  3.49it/s]
 26%|██▋       | 97984/371472 [7:47:32<22:32:41,  3.37it/s]
 26%|██▋       | 97985/371472 [7:47:32<21:16:49,  3.57it/s]
 26%|██▋       | 97986/371472 [7:47:32<20:26:28,  3.72it/s]
 26%|██▋       | 97987/371472 [7:47:33<22:40:45,  3.35it/s]
 26%|██▋       | 97988/371472 [7:47:33<22:22:08,  3.40it/s]
 26%|██▋       | 97989/371472 [7:47:33<21:10:50,  3.59it/s]
 26%|██▋       | 97990/371472 [7:47:33<20:43:26,  3.67it/s]
 26%|██▋       | 97991/371472 [7:47:34<22:02:21,  3.45it/s]
 26%|██▋       | 97992/371472 [7:47:34<22:30:06,  3.38it/s]
 26%|██▋       | 97993/371472 [7:47:34<23:58:51,  3.17it/s]
 26%|██▋       | 97994/371472 [7:47:35<22:37:29,  3.36it/s]
 26%|██▋       | 97995/371472 [7:47:35<22:31:11,  3.37it/s]
 26%|██▋       | 97996/371472 [7:47:35<24:15:37,  3.13it/s]
 26%|██▋       | 97997/371472 [7:47:36<22:59:25,  3.30it/s]
 26%|██▋       | 97998/371472 [7:47:36<22:02:45,  3.45it/s]
 26%|██▋       | 97999/371472 [7:47:36<22:06:48,  3.44it/s]
 26%|██▋       | 98000/371472 [7:47:37<22:48:44,  3.33it/s]
                                                           
{'loss': 3.3752, 'learning_rate': 7.629231399082074e-07, 'epoch': 4.22}

 26%|██▋       | 98000/371472 [7:47:37<22:48:44,  3.33it/s]
 26%|██▋       | 98001/371472 [7:47:37<22:36:51,  3.36it/s]
 26%|██▋       | 98002/371472 [7:47:37<23:08:38,  3.28it/s]
 26%|██▋       | 98003/371472 [7:47:37<21:43:35,  3.50it/s]
 26%|██▋       | 98004/371472 [7:47:38<20:52:01,  3.64it/s]
 26%|██▋       | 98005/371472 [7:47:38<20:47:15,  3.65it/s]
 26%|██▋       | 98006/371472 [7:47:38<22:51:16,  3.32it/s]
 26%|██▋       | 98007/371472 [7:47:39<22:28:59,  3.38it/s]
 26%|██▋       | 98008/371472 [7:47:39<22:03:54,  3.44it/s]
 26%|██▋       | 98009/371472 [7:47:39<21:20:19,  3.56it/s]
 26%|██▋       | 98010/371472 [7:47:39<23:15:00,  3.27it/s]
 26%|██▋       | 98011/371472 [7:47:40<22:19:20,  3.40it/s]
 26%|██▋       | 98012/371472 [7:47:40<21:33:28,  3.52it/s]
 26%|██▋       | 98013/371472 [7:47:40<20:43:14,  3.67it/s]
 26%|██▋       | 98014/371472 [7:47:41<21:23:58,  3.55it/s]
 26%|██▋       | 98015/371472 [7:47:41<21:21:46,  3.56it/s]
 26%|██▋       | 98016/371472 [7:47:41<21:09:55,  3.59it/s]
 26%|██▋       | 98017/371472 [7:47:41<24:28:09,  3.10it/s]
 26%|██▋       | 98018/371472 [7:47:42<24:11:05,  3.14it/s]
 26%|██▋       | 98019/371472 [7:47:42<23:32:39,  3.23it/s]
 26%|██▋       | 98020/371472 [7:47:42<23:58:08,  3.17it/s]
                                                           
{'loss': 3.8487, 'learning_rate': 7.628746579327285e-07, 'epoch': 4.22}

 26%|██▋       | 98020/371472 [7:47:42<23:58:08,  3.17it/s]
 26%|██▋       | 98021/371472 [7:47:43<23:29:54,  3.23it/s]
 26%|██▋       | 98022/371472 [7:47:43<22:56:07,  3.31it/s]
 26%|██▋       | 98023/371472 [7:47:43<23:01:23,  3.30it/s]
 26%|██▋       | 98024/371472 [7:47:44<22:03:39,  3.44it/s]
 26%|██▋       | 98025/371472 [7:47:44<21:38:39,  3.51it/s]
 26%|██▋       | 98026/371472 [7:47:44<22:05:28,  3.44it/s]
 26%|██▋       | 98027/371472 [7:47:44<22:30:58,  3.37it/s]
 26%|██▋       | 98028/371472 [7:47:45<22:16:36,  3.41it/s]
 26%|██▋       | 98029/371472 [7:47:45<22:08:52,  3.43it/s]
 26%|██▋       | 98030/371472 [7:47:45<21:43:38,  3.50it/s]
 26%|██▋       | 98031/371472 [7:47:46<21:39:34,  3.51it/s]
 26%|██▋       | 98032/371472 [7:47:46<21:03:34,  3.61it/s]
 26%|██▋       | 98033/371472 [7:47:46<20:54:11,  3.63it/s]
 26%|██▋       | 98034/371472 [7:47:46<20:16:43,  3.75it/s]
 26%|██▋       | 98035/371472 [7:47:47<20:12:34,  3.76it/s]
 26%|██▋       | 98036/371472 [7:47:47<20:41:02,  3.67it/s]
 26%|██▋       | 98037/371472 [7:47:47<21:08:04,  3.59it/s]
 26%|██▋       | 98038/371472 [7:47:47<21:01:38,  3.61it/s]
 26%|██▋       | 98039/371472 [7:47:48<20:59:25,  3.62it/s]
 26%|██▋       | 98040/371472 [7:47:48<21:01:22,  3.61it/s]
                                                           
{'loss': 3.5937, 'learning_rate': 7.628261759572496e-07, 'epoch': 4.22}

 26%|██▋       | 98040/371472 [7:47:48<21:01:22,  3.61it/s]
 26%|██▋       | 98041/371472 [7:47:48<20:56:41,  3.63it/s]
 26%|██▋       | 98042/371472 [7:47:49<20:08:20,  3.77it/s]
 26%|██▋       | 98043/371472 [7:47:49<20:48:35,  3.65it/s]
 26%|██▋       | 98044/371472 [7:47:49<21:04:13,  3.60it/s]
 26%|██▋       | 98045/371472 [7:47:49<20:43:21,  3.67it/s]
 26%|██▋       | 98046/371472 [7:47:50<20:38:32,  3.68it/s]
 26%|██▋       | 98047/371472 [7:47:50<22:00:58,  3.45it/s]
 26%|██▋       | 98048/371472 [7:47:50<21:37:09,  3.51it/s]
 26%|██▋       | 98049/371472 [7:47:51<21:39:48,  3.51it/s]
 26%|██▋       | 98050/371472 [7:47:51<20:48:28,  3.65it/s]
 26%|██▋       | 98051/371472 [7:47:51<20:49:16,  3.65it/s]
 26%|██▋       | 98052/371472 [7:47:51<21:22:20,  3.55it/s]
 26%|██▋       | 98053/371472 [7:47:52<22:31:21,  3.37it/s]
 26%|██▋       | 98054/371472 [7:47:52<23:35:20,  3.22it/s]
 26%|██▋       | 98055/371472 [7:47:52<22:12:51,  3.42it/s]
 26%|██▋       | 98056/371472 [7:47:53<21:09:19,  3.59it/s]
 26%|██▋       | 98057/371472 [7:47:53<20:29:36,  3.71it/s]
 26%|██▋       | 98058/371472 [7:47:53<20:58:39,  3.62it/s]
 26%|██▋       | 98059/371472 [7:47:53<20:48:09,  3.65it/s]
 26%|██▋       | 98060/371472 [7:47:54<20:51:35,  3.64it/s]
                                                           
{'loss': 3.8835, 'learning_rate': 7.627776939817707e-07, 'epoch': 4.22}

 26%|██▋       | 98060/371472 [7:47:54<20:51:35,  3.64it/s]
 26%|██▋       | 98061/371472 [7:47:54<22:00:20,  3.45it/s]
 26%|██▋       | 98062/371472 [7:47:54<21:49:18,  3.48it/s]
 26%|██▋       | 98063/371472 [7:47:55<21:43:10,  3.50it/s]
 26%|██▋       | 98064/371472 [7:47:55<21:01:09,  3.61it/s]
 26%|██▋       | 98065/371472 [7:47:55<20:41:44,  3.67it/s]
 26%|██▋       | 98066/371472 [7:47:55<20:32:38,  3.70it/s]
 26%|██▋       | 98067/371472 [7:47:56<20:28:53,  3.71it/s]
 26%|██▋       | 98068/371472 [7:47:56<21:01:20,  3.61it/s]
 26%|██▋       | 98069/371472 [7:47:56<21:33:29,  3.52it/s]
 26%|██▋       | 98070/371472 [7:47:56<21:11:23,  3.58it/s]
 26%|██▋       | 98071/371472 [7:47:57<21:50:37,  3.48it/s]
 26%|██▋       | 98072/371472 [7:47:57<21:56:16,  3.46it/s]
 26%|██▋       | 98073/371472 [7:47:57<21:24:13,  3.55it/s]
 26%|██▋       | 98074/371472 [7:47:58<24:09:30,  3.14it/s]
 26%|██▋       | 98075/371472 [7:47:58<23:30:05,  3.23it/s]
 26%|██▋       | 98076/371472 [7:47:58<23:56:08,  3.17it/s]
 26%|██▋       | 98077/371472 [7:47:59<23:30:35,  3.23it/s]
 26%|██▋       | 98078/371472 [7:47:59<23:12:30,  3.27it/s]
 26%|██▋       | 98079/371472 [7:47:59<24:00:14,  3.16it/s]
 26%|██▋       | 98080/371472 [7:48:00<23:06:07,  3.29it/s]
                                                           
{'loss': 3.4389, 'learning_rate': 7.62729212006292e-07, 'epoch': 4.22}

 26%|██▋       | 98080/371472 [7:48:00<23:06:07,  3.29it/s]
 26%|██▋       | 98081/371472 [7:48:00<21:39:54,  3.51it/s]
 26%|██▋       | 98082/371472 [7:48:00<21:39:55,  3.51it/s]
 26%|██▋       | 98083/371472 [7:48:00<21:34:38,  3.52it/s]
 26%|██▋       | 98084/371472 [7:48:01<21:27:38,  3.54it/s]
 26%|██▋       | 98085/371472 [7:48:01<22:21:41,  3.40it/s]
 26%|██▋       | 98086/371472 [7:48:01<21:57:27,  3.46it/s]
 26%|██▋       | 98087/371472 [7:48:01<21:33:45,  3.52it/s]
 26%|██▋       | 98088/371472 [7:48:02<20:49:29,  3.65it/s]
 26%|██▋       | 98089/371472 [7:48:02<20:14:54,  3.75it/s]
 26%|██▋       | 98090/371472 [7:48:02<21:15:49,  3.57it/s]
 26%|██▋       | 98091/371472 [7:48:03<22:04:22,  3.44it/s]
 26%|██▋       | 98092/371472 [7:48:03<24:17:24,  3.13it/s]
 26%|██▋       | 98093/371472 [7:48:03<23:02:51,  3.29it/s]
 26%|██▋       | 98094/371472 [7:48:04<22:51:47,  3.32it/s]
 26%|██▋       | 98095/371472 [7:48:04<22:31:33,  3.37it/s]
 26%|██▋       | 98096/371472 [7:48:04<22:14:30,  3.41it/s]
 26%|██▋       | 98097/371472 [7:48:04<22:32:57,  3.37it/s]
 26%|██▋       | 98098/371472 [7:48:05<23:11:15,  3.27it/s]
 26%|██▋       | 98099/371472 [7:48:05<22:40:19,  3.35it/s]
 26%|██▋       | 98100/371472 [7:48:05<22:09:46,  3.43it/s]
                                                           
{'loss': 3.5515, 'learning_rate': 7.626807300308129e-07, 'epoch': 4.23}

 26%|██▋       | 98100/371472 [7:48:05<22:09:46,  3.43it/s]
 26%|██▋       | 98101/371472 [7:48:06<21:26:58,  3.54it/s]
 26%|██▋       | 98102/371472 [7:48:06<20:49:03,  3.65it/s]
 26%|██▋       | 98103/371472 [7:48:06<20:18:15,  3.74it/s]
 26%|██▋       | 98104/371472 [7:48:06<20:06:52,  3.78it/s]
 26%|██▋       | 98105/371472 [7:48:07<19:53:18,  3.82it/s]
 26%|██▋       | 98106/371472 [7:48:07<20:08:24,  3.77it/s]
 26%|██▋       | 98107/371472 [7:48:07<20:27:54,  3.71it/s]
 26%|██▋       | 98108/371472 [7:48:07<20:27:22,  3.71it/s]
 26%|██▋       | 98109/371472 [7:48:08<20:26:05,  3.72it/s]
 26%|██▋       | 98110/371472 [7:48:08<20:13:00,  3.76it/s]
 26%|██▋       | 98111/371472 [7:48:08<21:03:46,  3.61it/s]
 26%|██▋       | 98112/371472 [7:48:09<22:08:36,  3.43it/s]
 26%|██▋       | 98113/371472 [7:48:09<23:07:17,  3.28it/s]
 26%|██▋       | 98114/371472 [7:48:09<23:00:02,  3.30it/s]
 26%|██▋       | 98115/371472 [7:48:09<22:20:38,  3.40it/s]
 26%|██▋       | 98116/371472 [7:48:10<23:27:32,  3.24it/s]
 26%|██▋       | 98117/371472 [7:48:10<22:49:29,  3.33it/s]
 26%|██▋       | 98118/371472 [7:48:10<22:33:41,  3.37it/s]
 26%|██▋       | 98119/371472 [7:48:11<22:19:43,  3.40it/s]
 26%|██▋       | 98120/371472 [7:48:11<22:02:20,  3.45it/s]
                                                           
{'loss': 3.6198, 'learning_rate': 7.62632248055334e-07, 'epoch': 4.23}

 26%|██▋       | 98120/371472 [7:48:11<22:02:20,  3.45it/s]
 26%|██▋       | 98121/371472 [7:48:11<23:08:30,  3.28it/s]
 26%|██▋       | 98122/371472 [7:48:12<23:15:24,  3.26it/s]
 26%|██▋       | 98123/371472 [7:48:12<22:18:07,  3.40it/s]
 26%|██▋       | 98124/371472 [7:48:12<21:23:30,  3.55it/s]
 26%|██▋       | 98125/371472 [7:48:12<21:13:04,  3.58it/s]
 26%|██▋       | 98126/371472 [7:48:13<21:01:41,  3.61it/s]
 26%|██▋       | 98127/371472 [7:48:13<20:41:18,  3.67it/s]
 26%|██▋       | 98128/371472 [7:48:13<20:29:53,  3.70it/s]
 26%|██▋       | 98129/371472 [7:48:14<21:15:28,  3.57it/s]
 26%|██▋       | 98130/371472 [7:48:14<20:33:53,  3.69it/s]
 26%|██▋       | 98131/371472 [7:48:14<20:46:23,  3.66it/s]
 26%|██▋       | 98132/371472 [7:48:14<20:41:14,  3.67it/s]
 26%|██▋       | 98133/371472 [7:48:15<20:20:52,  3.73it/s]
 26%|██▋       | 98134/371472 [7:48:15<20:20:43,  3.73it/s]
 26%|██▋       | 98135/371472 [7:48:15<20:20:36,  3.73it/s]
 26%|██▋       | 98136/371472 [7:48:15<20:26:33,  3.71it/s]
 26%|██▋       | 98137/371472 [7:48:16<20:26:32,  3.71it/s]
 26%|██▋       | 98138/371472 [7:48:16<20:39:12,  3.68it/s]
 26%|██▋       | 98139/371472 [7:48:16<20:51:24,  3.64it/s]
 26%|██▋       | 98140/371472 [7:48:16<20:16:41,  3.74it/s]
                                                           
{'loss': 3.5712, 'learning_rate': 7.625837660798551e-07, 'epoch': 4.23}

 26%|██▋       | 98140/371472 [7:48:16<20:16:41,  3.74it/s]
 26%|██▋       | 98141/371472 [7:48:17<19:45:11,  3.84it/s]
 26%|██▋       | 98142/371472 [7:48:17<20:09:12,  3.77it/s]
 26%|██▋       | 98143/371472 [7:48:17<21:28:55,  3.53it/s]
 26%|██▋       | 98144/371472 [7:48:18<21:16:18,  3.57it/s]
 26%|██▋       | 98145/371472 [7:48:18<21:18:42,  3.56it/s]
 26%|██▋       | 98146/371472 [7:48:18<20:37:16,  3.68it/s]
 26%|██▋       | 98147/371472 [7:48:18<22:09:42,  3.43it/s]
 26%|██▋       | 98148/371472 [7:48:19<21:54:30,  3.47it/s]
 26%|██▋       | 98149/371472 [7:48:19<21:50:49,  3.48it/s]
 26%|██▋       | 98150/371472 [7:48:19<22:29:56,  3.37it/s]
 26%|██▋       | 98151/371472 [7:48:20<22:20:57,  3.40it/s]
 26%|██▋       | 98152/371472 [7:48:20<24:18:05,  3.12it/s]
 26%|██▋       | 98153/371472 [7:48:20<22:54:46,  3.31it/s]
 26%|██▋       | 98154/371472 [7:48:21<22:20:48,  3.40it/s]
 26%|██▋       | 98155/371472 [7:48:21<22:38:08,  3.35it/s]
 26%|██▋       | 98156/371472 [7:48:21<21:52:20,  3.47it/s]
 26%|██▋       | 98157/371472 [7:48:21<21:22:15,  3.55it/s]
 26%|██▋       | 98158/371472 [7:48:22<21:43:17,  3.50it/s]
 26%|██▋       | 98159/371472 [7:48:22<22:01:31,  3.45it/s]
 26%|██▋       | 98160/371472 [7:48:22<22:19:26,  3.40it/s]
                                                           
{'loss': 3.7876, 'learning_rate': 7.625352841043763e-07, 'epoch': 4.23}

 26%|██▋       | 98160/371472 [7:48:22<22:19:26,  3.40it/s]
 26%|██▋       | 98161/371472 [7:48:23<21:17:33,  3.57it/s]
 26%|██▋       | 98162/371472 [7:48:23<23:23:39,  3.25it/s]
 26%|██▋       | 98163/371472 [7:48:23<22:29:03,  3.38it/s]
 26%|██▋       | 98164/371472 [7:48:23<22:58:29,  3.30it/s]
 26%|██▋       | 98165/371472 [7:48:24<21:58:52,  3.45it/s]
 26%|██▋       | 98166/371472 [7:48:24<21:35:33,  3.52it/s]
 26%|██▋       | 98167/371472 [7:48:24<20:38:13,  3.68it/s]
 26%|██▋       | 98168/371472 [7:48:25<21:32:46,  3.52it/s]
 26%|██▋       | 98169/371472 [7:48:25<22:42:58,  3.34it/s]
 26%|██▋       | 98170/371472 [7:48:25<23:02:11,  3.30it/s]
 26%|██▋       | 98171/371472 [7:48:25<21:43:01,  3.50it/s]
 26%|██▋       | 98172/371472 [7:48:26<21:12:21,  3.58it/s]
 26%|██▋       | 98173/371472 [7:48:26<21:09:02,  3.59it/s]
 26%|██▋       | 98174/371472 [7:48:26<20:31:42,  3.70it/s]
 26%|██▋       | 98175/371472 [7:48:27<21:14:38,  3.57it/s]
 26%|██▋       | 98176/371472 [7:48:27<21:33:04,  3.52it/s]
 26%|██▋       | 98177/371472 [7:48:27<21:11:10,  3.58it/s]
 26%|██▋       | 98178/371472 [7:48:27<23:04:37,  3.29it/s]
 26%|██▋       | 98179/371472 [7:48:28<22:27:36,  3.38it/s]
 26%|██▋       | 98180/371472 [7:48:28<22:26:04,  3.38it/s]
                                                           
{'loss': 3.6569, 'learning_rate': 7.624868021288974e-07, 'epoch': 4.23}

 26%|██▋       | 98180/371472 [7:48:28<22:26:04,  3.38it/s]
 26%|██▋       | 98181/371472 [7:48:28<22:22:44,  3.39it/s]
 26%|██▋       | 98182/371472 [7:48:29<22:16:35,  3.41it/s]
 26%|██▋       | 98183/371472 [7:48:29<23:01:56,  3.30it/s]
 26%|██▋       | 98184/371472 [7:48:29<22:53:20,  3.32it/s]
 26%|██▋       | 98185/371472 [7:48:30<21:51:51,  3.47it/s]
 26%|██▋       | 98186/371472 [7:48:30<23:26:09,  3.24it/s]
 26%|██▋       | 98187/371472 [7:48:30<23:32:43,  3.22it/s]
 26%|██▋       | 98188/371472 [7:48:30<23:12:10,  3.27it/s]
 26%|██▋       | 98189/371472 [7:48:31<22:34:54,  3.36it/s]
 26%|██▋       | 98190/371472 [7:48:31<22:31:41,  3.37it/s]
 26%|██▋       | 98191/371472 [7:48:31<22:04:45,  3.44it/s]
 26%|██▋       | 98192/371472 [7:48:32<21:42:23,  3.50it/s]
 26%|██▋       | 98193/371472 [7:48:32<21:08:56,  3.59it/s]
 26%|██▋       | 98194/371472 [7:48:32<21:53:19,  3.47it/s]
 26%|██▋       | 98195/371472 [7:48:32<21:23:12,  3.55it/s]
 26%|██▋       | 98196/371472 [7:48:33<23:32:31,  3.22it/s]
 26%|██▋       | 98197/371472 [7:48:33<22:44:11,  3.34it/s]
 26%|██▋       | 98198/371472 [7:48:33<22:07:33,  3.43it/s]
 26%|██▋       | 98199/371472 [7:48:34<21:37:47,  3.51it/s]
 26%|██▋       | 98200/371472 [7:48:34<21:21:33,  3.55it/s]
                                                           
{'loss': 3.6339, 'learning_rate': 7.624383201534185e-07, 'epoch': 4.23}

 26%|██▋       | 98200/371472 [7:48:34<21:21:33,  3.55it/s]
 26%|██▋       | 98201/371472 [7:48:34<20:40:32,  3.67it/s]
 26%|██▋       | 98202/371472 [7:48:34<21:59:08,  3.45it/s]
 26%|██▋       | 98203/371472 [7:48:35<21:32:42,  3.52it/s]
 26%|██▋       | 98204/371472 [7:48:35<21:30:21,  3.53it/s]
 26%|██▋       | 98205/371472 [7:48:35<20:47:24,  3.65it/s]
 26%|██▋       | 98206/371472 [7:48:36<20:54:14,  3.63it/s]
 26%|██▋       | 98207/371472 [7:48:36<20:32:56,  3.69it/s]
 26%|██▋       | 98208/371472 [7:48:36<20:52:44,  3.64it/s]
 26%|██▋       | 98209/371472 [7:48:36<20:35:41,  3.69it/s]
 26%|██▋       | 98210/371472 [7:48:37<20:14:36,  3.75it/s]
 26%|██▋       | 98211/371472 [7:48:37<22:03:47,  3.44it/s]
 26%|██▋       | 98212/371472 [7:48:37<22:36:54,  3.36it/s]
 26%|██▋       | 98213/371472 [7:48:38<21:43:46,  3.49it/s]
 26%|██▋       | 98214/371472 [7:48:38<21:50:16,  3.48it/s]
 26%|██▋       | 98215/371472 [7:48:38<22:47:43,  3.33it/s]
 26%|██▋       | 98216/371472 [7:48:38<22:37:56,  3.35it/s]
 26%|██▋       | 98217/371472 [7:48:39<23:24:40,  3.24it/s]
 26%|██▋       | 98218/371472 [7:48:39<24:28:34,  3.10it/s]
 26%|██▋       | 98219/371472 [7:48:39<23:23:45,  3.24it/s]
 26%|██▋       | 98220/371472 [7:48:40<22:16:44,  3.41it/s]
                                                           
{'loss': 3.5889, 'learning_rate': 7.623898381779396e-07, 'epoch': 4.23}

 26%|██▋       | 98220/371472 [7:48:40<22:16:44,  3.41it/s]
 26%|██▋       | 98221/371472 [7:48:40<21:45:40,  3.49it/s]
 26%|██▋       | 98222/371472 [7:48:40<21:15:55,  3.57it/s]
 26%|██▋       | 98223/371472 [7:48:41<21:37:08,  3.51it/s]
 26%|██▋       | 98224/371472 [7:48:41<20:52:25,  3.64it/s]
 26%|██▋       | 98225/371472 [7:48:41<21:28:08,  3.54it/s]
 26%|██▋       | 98226/371472 [7:48:41<21:28:35,  3.53it/s]
 26%|██▋       | 98227/371472 [7:48:42<21:55:44,  3.46it/s]
 26%|██▋       | 98228/371472 [7:48:42<22:02:45,  3.44it/s]
 26%|██▋       | 98229/371472 [7:48:42<21:31:00,  3.53it/s]
 26%|██▋       | 98230/371472 [7:48:43<23:35:22,  3.22it/s]
 26%|██▋       | 98231/371472 [7:48:43<23:42:45,  3.20it/s]
 26%|██▋       | 98232/371472 [7:48:43<22:36:33,  3.36it/s]
 26%|██▋       | 98233/371472 [7:48:43<21:42:00,  3.50it/s]
 26%|██▋       | 98234/371472 [7:48:44<22:25:49,  3.38it/s]
 26%|██▋       | 98235/371472 [7:48:44<22:14:40,  3.41it/s]
 26%|██▋       | 98236/371472 [7:48:44<21:00:41,  3.61it/s]
 26%|██▋       | 98237/371472 [7:48:45<20:49:22,  3.64it/s]
 26%|██▋       | 98238/371472 [7:48:45<21:07:21,  3.59it/s]
 26%|██▋       | 98239/371472 [7:48:45<21:19:43,  3.56it/s]
 26%|██▋       | 98240/371472 [7:48:45<21:39:19,  3.50it/s]
                                                           
{'loss': 3.6677, 'learning_rate': 7.623413562024607e-07, 'epoch': 4.23}

 26%|██▋       | 98240/371472 [7:48:45<21:39:19,  3.50it/s]
 26%|██▋       | 98241/371472 [7:48:46<21:34:31,  3.52it/s]
 26%|██▋       | 98242/371472 [7:48:46<21:16:03,  3.57it/s]
 26%|██▋       | 98243/371472 [7:48:46<21:18:11,  3.56it/s]
 26%|██▋       | 98244/371472 [7:48:47<22:12:36,  3.42it/s]
 26%|██▋       | 98245/371472 [7:48:47<23:59:19,  3.16it/s]
 26%|██▋       | 98246/371472 [7:48:47<23:02:11,  3.29it/s]
 26%|██▋       | 98247/371472 [7:48:47<22:17:15,  3.41it/s]
 26%|██▋       | 98248/371472 [7:48:48<21:50:45,  3.47it/s]
 26%|██▋       | 98249/371472 [7:48:48<22:21:18,  3.39it/s]
 26%|██▋       | 98250/371472 [7:48:48<22:34:53,  3.36it/s]
 26%|██▋       | 98251/371472 [7:48:49<21:31:09,  3.53it/s]
 26%|██▋       | 98252/371472 [7:48:49<21:21:46,  3.55it/s]
 26%|██▋       | 98253/371472 [7:48:49<21:36:05,  3.51it/s]
 26%|██▋       | 98254/371472 [7:48:49<21:17:11,  3.57it/s]
 26%|██▋       | 98255/371472 [7:48:50<21:20:32,  3.56it/s]
 26%|██▋       | 98256/371472 [7:48:50<21:28:32,  3.53it/s]
 26%|██▋       | 98257/371472 [7:48:50<21:48:22,  3.48it/s]
 26%|██▋       | 98258/371472 [7:48:51<21:30:30,  3.53it/s]
 26%|██▋       | 98259/371472 [7:48:51<20:48:46,  3.65it/s]
 26%|██▋       | 98260/371472 [7:48:51<20:54:23,  3.63it/s]
                                                           
{'loss': 3.7587, 'learning_rate': 7.622928742269818e-07, 'epoch': 4.23}

 26%|██▋       | 98260/371472 [7:48:51<20:54:23,  3.63it/s]
 26%|██▋       | 98261/371472 [7:48:51<21:09:09,  3.59it/s]
 26%|██▋       | 98262/371472 [7:48:52<22:31:49,  3.37it/s]
 26%|██▋       | 98263/371472 [7:48:52<21:57:45,  3.46it/s]
 26%|██▋       | 98264/371472 [7:48:52<22:00:45,  3.45it/s]
 26%|██▋       | 98265/371472 [7:48:53<22:59:26,  3.30it/s]
 26%|██▋       | 98266/371472 [7:48:53<22:12:52,  3.42it/s]
 26%|██▋       | 98267/371472 [7:48:53<21:33:06,  3.52it/s]
 26%|██▋       | 98268/371472 [7:48:53<21:30:06,  3.53it/s]
 26%|██▋       | 98269/371472 [7:48:54<20:50:43,  3.64it/s]
 26%|██▋       | 98270/371472 [7:48:54<22:00:29,  3.45it/s]
 26%|██▋       | 98271/371472 [7:48:54<23:02:42,  3.29it/s]
 26%|██▋       | 98272/371472 [7:48:55<22:26:43,  3.38it/s]
 26%|██▋       | 98273/371472 [7:48:55<22:00:16,  3.45it/s]
 26%|██▋       | 98274/371472 [7:48:55<22:38:47,  3.35it/s]
 26%|██▋       | 98275/371472 [7:48:56<21:49:17,  3.48it/s]
 26%|██▋       | 98276/371472 [7:48:56<21:54:08,  3.46it/s]
 26%|██▋       | 98277/371472 [7:48:56<23:11:47,  3.27it/s]
 26%|██▋       | 98278/371472 [7:48:56<22:16:02,  3.41it/s]
 26%|██▋       | 98279/371472 [7:48:57<21:19:42,  3.56it/s]
 26%|██▋       | 98280/371472 [7:48:57<21:30:05,  3.53it/s]
                                                           
{'loss': 3.3814, 'learning_rate': 7.622443922515029e-07, 'epoch': 4.23}

 26%|██▋       | 98280/371472 [7:48:57<21:30:05,  3.53it/s]
 26%|██▋       | 98281/371472 [7:48:57<20:52:38,  3.63it/s]
 26%|██▋       | 98282/371472 [7:48:58<22:02:45,  3.44it/s]
 26%|██▋       | 98283/371472 [7:48:58<22:35:57,  3.36it/s]
 26%|██▋       | 98284/371472 [7:48:58<21:51:51,  3.47it/s]
 26%|██▋       | 98285/371472 [7:48:58<22:49:00,  3.33it/s]
 26%|██▋       | 98286/371472 [7:48:59<21:46:02,  3.49it/s]
 26%|██▋       | 98287/371472 [7:48:59<21:19:24,  3.56it/s]
 26%|██▋       | 98288/371472 [7:48:59<20:50:49,  3.64it/s]
 26%|██▋       | 98289/371472 [7:49:00<22:19:28,  3.40it/s]
 26%|██▋       | 98290/371472 [7:49:00<21:33:59,  3.52it/s]
 26%|██▋       | 98291/371472 [7:49:00<20:49:22,  3.64it/s]
 26%|██▋       | 98292/371472 [7:49:00<21:07:33,  3.59it/s]
 26%|██▋       | 98293/371472 [7:49:01<21:15:30,  3.57it/s]
 26%|██▋       | 98294/371472 [7:49:01<22:55:57,  3.31it/s]
 26%|██▋       | 98295/371472 [7:49:01<22:22:01,  3.39it/s]
 26%|██▋       | 98296/371472 [7:49:02<21:14:12,  3.57it/s]
 26%|██▋       | 98297/371472 [7:49:02<22:06:26,  3.43it/s]
 26%|██▋       | 98298/371472 [7:49:02<21:15:50,  3.57it/s]
 26%|██▋       | 98299/371472 [7:49:02<21:29:06,  3.53it/s]
 26%|██▋       | 98300/371472 [7:49:03<21:03:22,  3.60it/s]
                                                           
{'loss': 3.4579, 'learning_rate': 7.62195910276024e-07, 'epoch': 4.23}

 26%|██▋       | 98300/371472 [7:49:03<21:03:22,  3.60it/s]
 26%|██▋       | 98301/371472 [7:49:03<21:51:23,  3.47it/s]
 26%|██▋       | 98302/371472 [7:49:03<22:00:17,  3.45it/s]
 26%|██▋       | 98303/371472 [7:49:04<21:18:52,  3.56it/s]
 26%|██▋       | 98304/371472 [7:49:04<21:06:38,  3.59it/s]
 26%|██▋       | 98305/371472 [7:49:04<20:38:54,  3.67it/s]
 26%|██▋       | 98306/371472 [7:49:04<20:50:26,  3.64it/s]
 26%|██▋       | 98307/371472 [7:49:05<20:43:43,  3.66it/s]
 26%|██▋       | 98308/371472 [7:49:05<21:34:09,  3.52it/s]
 26%|██▋       | 98309/371472 [7:49:05<23:35:42,  3.22it/s]
 26%|██▋       | 98310/371472 [7:49:06<23:23:14,  3.24it/s]
 26%|██▋       | 98311/371472 [7:49:06<22:29:47,  3.37it/s]
 26%|██▋       | 98312/371472 [7:49:06<21:28:26,  3.53it/s]
 26%|██▋       | 98313/371472 [7:49:06<20:31:36,  3.70it/s]
 26%|██▋       | 98314/371472 [7:49:07<20:34:56,  3.69it/s]
 26%|██▋       | 98315/371472 [7:49:07<20:31:21,  3.70it/s]
 26%|██▋       | 98316/371472 [7:49:07<21:22:10,  3.55it/s]
 26%|██▋       | 98317/371472 [7:49:07<20:39:01,  3.67it/s]
 26%|██▋       | 98318/371472 [7:49:08<20:33:41,  3.69it/s]
 26%|██▋       | 98319/371472 [7:49:08<20:28:47,  3.70it/s]
 26%|██▋       | 98320/371472 [7:49:08<21:17:01,  3.56it/s]
                                                           
{'loss': 3.6606, 'learning_rate': 7.621474283005451e-07, 'epoch': 4.23}

 26%|██▋       | 98320/371472 [7:49:08<21:17:01,  3.56it/s]
 26%|██▋       | 98321/371472 [7:49:09<20:56:14,  3.62it/s]
 26%|██▋       | 98322/371472 [7:49:09<20:52:55,  3.63it/s]
 26%|██▋       | 98323/371472 [7:49:09<20:25:14,  3.72it/s]
 26%|██▋       | 98324/371472 [7:49:09<20:06:16,  3.77it/s]
 26%|██▋       | 98325/371472 [7:49:10<19:50:54,  3.82it/s]
 26%|██▋       | 98326/371472 [7:49:10<20:31:53,  3.70it/s]
 26%|██▋       | 98327/371472 [7:49:10<20:27:26,  3.71it/s]
 26%|██▋       | 98328/371472 [7:49:10<19:59:26,  3.80it/s]
 26%|██▋       | 98329/371472 [7:49:11<20:58:15,  3.62it/s]
 26%|██▋       | 98330/371472 [7:49:11<20:52:46,  3.63it/s]
 26%|██▋       | 98331/371472 [7:49:11<21:01:44,  3.61it/s]
 26%|██▋       | 98332/371472 [7:49:12<20:55:38,  3.63it/s]
 26%|██▋       | 98333/371472 [7:49:12<20:51:00,  3.64it/s]
 26%|██▋       | 98334/371472 [7:49:12<21:32:35,  3.52it/s]
 26%|██▋       | 98335/371472 [7:49:12<20:50:45,  3.64it/s]
 26%|██▋       | 98336/371472 [7:49:13<23:53:19,  3.18it/s]
 26%|██▋       | 98337/371472 [7:49:13<22:55:34,  3.31it/s]
 26%|██▋       | 98338/371472 [7:49:13<22:39:27,  3.35it/s]
 26%|██▋       | 98339/371472 [7:49:14<24:11:17,  3.14it/s]
 26%|██▋       | 98340/371472 [7:49:14<23:00:32,  3.30it/s]
                                                           
{'loss': 3.5666, 'learning_rate': 7.620989463250663e-07, 'epoch': 4.24}

 26%|██▋       | 98340/371472 [7:49:14<23:00:32,  3.30it/s]
 26%|██▋       | 98341/371472 [7:49:14<22:42:34,  3.34it/s]
 26%|██▋       | 98342/371472 [7:49:15<23:37:05,  3.21it/s]
 26%|██▋       | 98343/371472 [7:49:15<22:50:48,  3.32it/s]
 26%|██▋       | 98344/371472 [7:49:15<22:05:22,  3.43it/s]
 26%|██▋       | 98345/371472 [7:49:15<23:17:15,  3.26it/s]
 26%|██▋       | 98346/371472 [7:49:16<22:32:06,  3.37it/s]
 26%|██▋       | 98347/371472 [7:49:16<23:10:18,  3.27it/s]
 26%|██▋       | 98348/371472 [7:49:16<22:04:39,  3.44it/s]
 26%|██▋       | 98349/371472 [7:49:17<21:29:09,  3.53it/s]
 26%|██▋       | 98350/371472 [7:49:17<22:11:28,  3.42it/s]
 26%|██▋       | 98351/371472 [7:49:17<21:40:47,  3.50it/s]
 26%|██▋       | 98352/371472 [7:49:18<22:49:54,  3.32it/s]
 26%|██▋       | 98353/371472 [7:49:18<22:57:04,  3.31it/s]
 26%|██▋       | 98354/371472 [7:49:18<22:25:24,  3.38it/s]
 26%|██▋       | 98355/371472 [7:49:18<22:03:59,  3.44it/s]
 26%|██▋       | 98356/371472 [7:49:19<22:30:47,  3.37it/s]
 26%|██▋       | 98357/371472 [7:49:19<22:18:01,  3.40it/s]
 26%|██▋       | 98358/371472 [7:49:19<21:38:39,  3.51it/s]
 26%|██▋       | 98359/371472 [7:49:20<21:05:48,  3.60it/s]
 26%|██▋       | 98360/371472 [7:49:20<20:34:16,  3.69it/s]
                                                           
{'loss': 3.7073, 'learning_rate': 7.620504643495873e-07, 'epoch': 4.24}

 26%|██▋       | 98360/371472 [7:49:20<20:34:16,  3.69it/s]
 26%|██▋       | 98361/371472 [7:49:20<20:31:42,  3.70it/s]
 26%|██▋       | 98362/371472 [7:49:20<20:33:55,  3.69it/s]
 26%|██▋       | 98363/371472 [7:49:21<20:59:59,  3.61it/s]
 26%|██▋       | 98364/371472 [7:49:21<20:43:08,  3.66it/s]
 26%|██▋       | 98365/371472 [7:49:21<20:50:01,  3.64it/s]
 26%|██▋       | 98366/371472 [7:49:21<20:42:56,  3.66it/s]
 26%|██▋       | 98367/371472 [7:49:22<21:57:08,  3.46it/s]
 26%|██▋       | 98368/371472 [7:49:22<22:26:03,  3.38it/s]
 26%|██▋       | 98369/371472 [7:49:22<22:02:52,  3.44it/s]
 26%|██▋       | 98370/371472 [7:49:23<21:40:11,  3.50it/s]
 26%|██▋       | 98371/371472 [7:49:23<22:39:47,  3.35it/s]
 26%|██▋       | 98372/371472 [7:49:23<21:47:33,  3.48it/s]
 26%|██▋       | 98373/371472 [7:49:24<22:09:21,  3.42it/s]
 26%|██▋       | 98374/371472 [7:49:24<23:15:01,  3.26it/s]
 26%|██▋       | 98375/371472 [7:49:24<22:37:17,  3.35it/s]
 26%|██▋       | 98376/371472 [7:49:24<21:40:22,  3.50it/s]
 26%|██▋       | 98377/371472 [7:49:25<20:56:10,  3.62it/s]
 26%|██▋       | 98378/371472 [7:49:25<21:28:20,  3.53it/s]
 26%|██▋       | 98379/371472 [7:49:25<21:16:37,  3.57it/s]
 26%|██▋       | 98380/371472 [7:49:26<21:40:37,  3.50it/s]
                                                           
{'loss': 3.5744, 'learning_rate': 7.620019823741084e-07, 'epoch': 4.24}

 26%|██▋       | 98380/371472 [7:49:26<21:40:37,  3.50it/s]
 26%|██▋       | 98381/371472 [7:49:26<21:29:04,  3.53it/s]
 26%|██▋       | 98382/371472 [7:49:26<21:19:04,  3.56it/s]
 26%|██▋       | 98383/371472 [7:49:26<21:01:56,  3.61it/s]
 26%|██▋       | 98384/371472 [7:49:27<21:59:26,  3.45it/s]
 26%|██▋       | 98385/371472 [7:49:27<21:15:27,  3.57it/s]
 26%|██▋       | 98386/371472 [7:49:27<21:21:54,  3.55it/s]
 26%|██▋       | 98387/371472 [7:49:27<21:13:58,  3.57it/s]
 26%|██▋       | 98388/371472 [7:49:28<20:24:24,  3.72it/s]
 26%|██▋       | 98389/371472 [7:49:28<20:21:17,  3.73it/s]
 26%|██▋       | 98390/371472 [7:49:28<20:30:44,  3.70it/s]
 26%|██▋       | 98391/371472 [7:49:29<19:58:09,  3.80it/s]
 26%|██▋       | 98392/371472 [7:49:29<19:48:05,  3.83it/s]
 26%|██▋       | 98393/371472 [7:49:29<20:39:06,  3.67it/s]
 26%|██▋       | 98394/371472 [7:49:29<20:28:18,  3.71it/s]
 26%|██▋       | 98395/371472 [7:49:30<20:46:00,  3.65it/s]
 26%|██▋       | 98396/371472 [7:49:30<21:38:47,  3.50it/s]
 26%|██▋       | 98397/371472 [7:49:30<21:12:58,  3.58it/s]
 26%|██▋       | 98398/371472 [7:49:30<21:33:50,  3.52it/s]
 26%|██▋       | 98399/371472 [7:49:31<21:50:29,  3.47it/s]
 26%|██▋       | 98400/371472 [7:49:31<22:42:08,  3.34it/s]
                                                           
{'loss': 3.7059, 'learning_rate': 7.619535003986295e-07, 'epoch': 4.24}

 26%|██▋       | 98400/371472 [7:49:31<22:42:08,  3.34it/s]
 26%|██▋       | 98401/371472 [7:49:31<23:23:50,  3.24it/s]
 26%|██▋       | 98402/371472 [7:49:32<22:48:27,  3.33it/s]
 26%|██▋       | 98403/371472 [7:49:32<22:05:28,  3.43it/s]
 26%|██▋       | 98404/371472 [7:49:32<23:28:37,  3.23it/s]
 26%|██▋       | 98405/371472 [7:49:33<23:32:18,  3.22it/s]
 26%|██▋       | 98406/371472 [7:49:33<22:07:46,  3.43it/s]
 26%|██▋       | 98407/371472 [7:49:33<21:40:37,  3.50it/s]
 26%|██▋       | 98408/371472 [7:49:33<20:47:37,  3.65it/s]
 26%|██▋       | 98409/371472 [7:49:34<20:24:05,  3.72it/s]
 26%|██▋       | 98410/371472 [7:49:34<20:58:52,  3.62it/s]
 26%|██▋       | 98411/371472 [7:49:34<20:26:36,  3.71it/s]
 26%|██▋       | 98412/371472 [7:49:35<21:20:39,  3.55it/s]
 26%|██▋       | 98413/371472 [7:49:35<21:00:31,  3.61it/s]
 26%|██▋       | 98414/371472 [7:49:35<21:24:56,  3.54it/s]
 26%|██▋       | 98415/371472 [7:49:35<21:56:42,  3.46it/s]
 26%|██▋       | 98416/371472 [7:49:36<21:31:05,  3.52it/s]
 26%|██▋       | 98417/371472 [7:49:36<21:19:05,  3.56it/s]
 26%|██▋       | 98418/371472 [7:49:36<21:16:18,  3.57it/s]
 26%|██▋       | 98419/371472 [7:49:37<21:29:18,  3.53it/s]
 26%|██▋       | 98420/371472 [7:49:37<22:54:19,  3.31it/s]
                                                           
{'loss': 3.6127, 'learning_rate': 7.619050184231507e-07, 'epoch': 4.24}

 26%|██▋       | 98420/371472 [7:49:37<22:54:19,  3.31it/s]
 26%|██▋       | 98421/371472 [7:49:37<22:07:42,  3.43it/s]
 26%|██▋       | 98422/371472 [7:49:37<21:47:55,  3.48it/s]
 26%|██▋       | 98423/371472 [7:49:38<21:18:26,  3.56it/s]
 26%|██▋       | 98424/371472 [7:49:38<21:47:30,  3.48it/s]
 26%|██▋       | 98425/371472 [7:49:38<22:46:39,  3.33it/s]
 26%|██▋       | 98426/371472 [7:49:39<21:30:15,  3.53it/s]
 26%|██▋       | 98427/371472 [7:49:39<20:47:17,  3.65it/s]
 26%|██▋       | 98428/371472 [7:49:39<21:58:04,  3.45it/s]
 26%|██▋       | 98429/371472 [7:49:39<21:28:50,  3.53it/s]
 26%|██▋       | 98430/371472 [7:49:40<21:03:54,  3.60it/s]
 26%|██▋       | 98431/371472 [7:49:40<20:47:23,  3.65it/s]
 26%|██▋       | 98432/371472 [7:49:40<20:28:50,  3.70it/s]
 26%|██▋       | 98433/371472 [7:49:40<19:43:30,  3.85it/s]
 26%|██▋       | 98434/371472 [7:49:41<19:49:41,  3.83it/s]
 26%|██▋       | 98435/371472 [7:49:41<22:45:05,  3.33it/s]
 26%|██▋       | 98436/371472 [7:49:41<23:48:06,  3.19it/s]
 26%|██▋       | 98437/371472 [7:49:42<22:29:27,  3.37it/s]
 26%|██▋       | 98438/371472 [7:49:42<22:02:14,  3.44it/s]
 26%|██▋       | 98439/371472 [7:49:42<21:57:39,  3.45it/s]
 26%|██▋       | 98440/371472 [7:49:43<21:46:48,  3.48it/s]
                                                           
{'loss': 3.564, 'learning_rate': 7.618565364476718e-07, 'epoch': 4.24}

 26%|██▋       | 98440/371472 [7:49:43<21:46:48,  3.48it/s]
 27%|██▋       | 98441/371472 [7:49:43<21:37:38,  3.51it/s]
 27%|██▋       | 98442/371472 [7:49:43<21:35:50,  3.51it/s]
 27%|██▋       | 98443/371472 [7:49:43<22:35:54,  3.36it/s]
 27%|██▋       | 98444/371472 [7:49:44<22:44:09,  3.34it/s]
 27%|██▋       | 98445/371472 [7:49:44<22:33:10,  3.36it/s]
 27%|██▋       | 98446/371472 [7:49:44<22:14:56,  3.41it/s]
 27%|██▋       | 98447/371472 [7:49:45<27:08:04,  2.79it/s]
 27%|██▋       | 98448/371472 [7:49:45<25:59:33,  2.92it/s]
 27%|██▋       | 98449/371472 [7:49:45<24:01:48,  3.16it/s]
 27%|██▋       | 98450/371472 [7:49:46<23:13:58,  3.26it/s]
 27%|██▋       | 98451/371472 [7:49:46<22:14:10,  3.41it/s]
 27%|██▋       | 98452/371472 [7:49:46<21:21:23,  3.55it/s]
 27%|██▋       | 98453/371472 [7:49:47<27:32:43,  2.75it/s]
 27%|██▋       | 98454/371472 [7:49:47<25:41:42,  2.95it/s]
 27%|██▋       | 98455/371472 [7:49:47<24:47:02,  3.06it/s]
 27%|██▋       | 98456/371472 [7:49:48<24:22:27,  3.11it/s]
 27%|██▋       | 98457/371472 [7:49:48<24:01:44,  3.16it/s]
 27%|██▋       | 98458/371472 [7:49:48<23:11:20,  3.27it/s]
 27%|██▋       | 98459/371472 [7:49:49<24:08:27,  3.14it/s]
 27%|██▋       | 98460/371472 [7:49:49<22:33:39,  3.36it/s]
                                                           
{'loss': 3.3204, 'learning_rate': 7.618080544721929e-07, 'epoch': 4.24}

 27%|██▋       | 98460/371472 [7:49:49<22:33:39,  3.36it/s]
 27%|██▋       | 98461/371472 [7:49:49<21:11:25,  3.58it/s]
 27%|██▋       | 98462/371472 [7:49:49<22:01:17,  3.44it/s]
 27%|██▋       | 98463/371472 [7:49:50<21:39:13,  3.50it/s]
 27%|██▋       | 98464/371472 [7:49:50<22:22:51,  3.39it/s]
 27%|██▋       | 98465/371472 [7:49:50<22:33:12,  3.36it/s]
 27%|██▋       | 98466/371472 [7:49:51<22:30:59,  3.37it/s]
 27%|██▋       | 98467/371472 [7:49:51<23:31:18,  3.22it/s]
 27%|██▋       | 98468/371472 [7:49:51<22:05:41,  3.43it/s]
 27%|██▋       | 98469/371472 [7:49:51<21:49:09,  3.48it/s]
 27%|██▋       | 98470/371472 [7:49:52<21:13:06,  3.57it/s]
 27%|██▋       | 98471/371472 [7:49:52<20:45:21,  3.65it/s]
 27%|██▋       | 98472/371472 [7:49:52<22:05:59,  3.43it/s]
 27%|██▋       | 98473/371472 [7:49:53<21:56:39,  3.46it/s]
 27%|██▋       | 98474/371472 [7:49:53<23:11:08,  3.27it/s]
 27%|██▋       | 98475/371472 [7:49:53<22:29:08,  3.37it/s]
 27%|██▋       | 98476/371472 [7:49:53<21:07:21,  3.59it/s]
 27%|██▋       | 98477/371472 [7:49:54<20:57:21,  3.62it/s]
 27%|██▋       | 98478/371472 [7:49:54<21:20:57,  3.55it/s]
 27%|██▋       | 98479/371472 [7:49:54<20:56:00,  3.62it/s]
 27%|██▋       | 98480/371472 [7:49:54<20:16:09,  3.74it/s]
                                                           
{'loss': 3.6988, 'learning_rate': 7.61759572496714e-07, 'epoch': 4.24}

 27%|██▋       | 98480/371472 [7:49:54<20:16:09,  3.74it/s]
 27%|██▋       | 98481/371472 [7:49:55<20:01:32,  3.79it/s]
 27%|██▋       | 98482/371472 [7:49:55<20:27:13,  3.71it/s]
 27%|██▋       | 98483/371472 [7:49:55<21:03:14,  3.60it/s]
 27%|██▋       | 98484/371472 [7:49:56<21:35:34,  3.51it/s]
 27%|██▋       | 98485/371472 [7:49:56<21:51:33,  3.47it/s]
 27%|██▋       | 98486/371472 [7:49:56<21:12:35,  3.58it/s]
 27%|██▋       | 98487/371472 [7:49:56<22:07:51,  3.43it/s]
 27%|██▋       | 98488/371472 [7:49:57<22:34:53,  3.36it/s]
 27%|██▋       | 98489/371472 [7:49:57<22:27:09,  3.38it/s]
 27%|██▋       | 98490/371472 [7:49:57<21:11:16,  3.58it/s]
 27%|██▋       | 98491/371472 [7:49:58<21:09:53,  3.58it/s]
 27%|██▋       | 98492/371472 [7:49:58<20:40:53,  3.67it/s]
 27%|██▋       | 98493/371472 [7:49:58<22:04:16,  3.44it/s]
 27%|██▋       | 98494/371472 [7:49:58<21:43:55,  3.49it/s]
 27%|██▋       | 98495/371472 [7:49:59<20:39:56,  3.67it/s]
 27%|██▋       | 98496/371472 [7:49:59<21:38:30,  3.50it/s]
 27%|██▋       | 98497/371472 [7:49:59<21:21:43,  3.55it/s]
 27%|██▋       | 98498/371472 [7:50:00<20:28:10,  3.70it/s]
 27%|██▋       | 98499/371472 [7:50:00<19:52:01,  3.82it/s]
 27%|██▋       | 98500/371472 [7:50:00<22:47:34,  3.33it/s]
                                                           
{'loss': 3.7666, 'learning_rate': 7.61711090521235e-07, 'epoch': 4.24}

 27%|██▋       | 98500/371472 [7:50:00<22:47:34,  3.33it/s]
 27%|██▋       | 98501/371472 [7:50:00<21:30:39,  3.52it/s]
 27%|██▋       | 98502/371472 [7:50:01<21:24:56,  3.54it/s]
 27%|██▋       | 98503/371472 [7:50:01<21:59:55,  3.45it/s]
 27%|██▋       | 98504/371472 [7:50:01<21:48:25,  3.48it/s]
 27%|██▋       | 98505/371472 [7:50:02<23:25:28,  3.24it/s]
 27%|██▋       | 98506/371472 [7:50:02<22:26:49,  3.38it/s]
 27%|██▋       | 98507/371472 [7:50:02<21:51:53,  3.47it/s]
 27%|██▋       | 98508/371472 [7:50:02<21:15:33,  3.57it/s]
 27%|██▋       | 98509/371472 [7:50:03<20:52:19,  3.63it/s]
 27%|██▋       | 98510/371472 [7:50:03<20:12:50,  3.75it/s]
 27%|██▋       | 98511/371472 [7:50:03<20:33:33,  3.69it/s]
 27%|██▋       | 98512/371472 [7:50:04<20:39:55,  3.67it/s]
 27%|██▋       | 98513/371472 [7:50:04<20:30:22,  3.70it/s]
 27%|██▋       | 98514/371472 [7:50:04<20:49:03,  3.64it/s]
 27%|██▋       | 98515/371472 [7:50:04<20:23:40,  3.72it/s]
 27%|██▋       | 98516/371472 [7:50:05<21:40:33,  3.50it/s]
 27%|██▋       | 98517/371472 [7:50:05<21:11:07,  3.58it/s]
 27%|██▋       | 98518/371472 [7:50:05<20:45:40,  3.65it/s]
 27%|██▋       | 98519/371472 [7:50:05<21:04:38,  3.60it/s]
 27%|██▋       | 98520/371472 [7:50:06<22:09:26,  3.42it/s]
                                                           
{'loss': 3.5265, 'learning_rate': 7.616626085457561e-07, 'epoch': 4.24}

 27%|██▋       | 98520/371472 [7:50:06<22:09:26,  3.42it/s]
 27%|██▋       | 98521/371472 [7:50:06<21:21:44,  3.55it/s]
 27%|██▋       | 98522/371472 [7:50:06<21:05:54,  3.59it/s]
 27%|██▋       | 98523/371472 [7:50:07<21:29:53,  3.53it/s]
 27%|██▋       | 98524/371472 [7:50:07<20:23:22,  3.72it/s]
 27%|██▋       | 98525/371472 [7:50:07<23:28:06,  3.23it/s]
 27%|██▋       | 98526/371472 [7:50:08<23:29:04,  3.23it/s]
 27%|██▋       | 98527/371472 [7:50:08<21:55:23,  3.46it/s]
 27%|██▋       | 98528/371472 [7:50:08<21:21:14,  3.55it/s]
 27%|██▋       | 98529/371472 [7:50:08<21:06:26,  3.59it/s]
 27%|██▋       | 98530/371472 [7:50:09<21:23:17,  3.54it/s]
 27%|██▋       | 98531/371472 [7:50:09<21:18:17,  3.56it/s]
 27%|██▋       | 98532/371472 [7:50:09<20:34:49,  3.68it/s]
 27%|██▋       | 98533/371472 [7:50:09<20:58:47,  3.61it/s]
 27%|██▋       | 98534/371472 [7:50:10<20:26:41,  3.71it/s]
 27%|██▋       | 98535/371472 [7:50:10<20:41:17,  3.66it/s]
 27%|██▋       | 98536/371472 [7:50:10<20:20:00,  3.73it/s]
 27%|██▋       | 98537/371472 [7:50:11<20:27:32,  3.71it/s]
 27%|██▋       | 98538/371472 [7:50:11<20:59:06,  3.61it/s]
 27%|██▋       | 98539/371472 [7:50:11<20:21:48,  3.72it/s]
 27%|██▋       | 98540/371472 [7:50:11<20:06:16,  3.77it/s]
                                                           
{'loss': 3.494, 'learning_rate': 7.616141265702773e-07, 'epoch': 4.24}

 27%|██▋       | 98540/371472 [7:50:11<20:06:16,  3.77it/s]
 27%|██▋       | 98541/371472 [7:50:12<20:02:21,  3.78it/s]
 27%|██▋       | 98542/371472 [7:50:12<20:13:39,  3.75it/s]
 27%|██▋       | 98543/371472 [7:50:12<19:48:25,  3.83it/s]
 27%|██▋       | 98544/371472 [7:50:12<19:53:02,  3.81it/s]
 27%|██▋       | 98545/371472 [7:50:13<20:10:06,  3.76it/s]
 27%|██▋       | 98546/371472 [7:50:13<19:54:42,  3.81it/s]
 27%|██▋       | 98547/371472 [7:50:13<20:21:59,  3.72it/s]
 27%|██▋       | 98548/371472 [7:50:13<20:44:34,  3.65it/s]
 27%|██▋       | 98549/371472 [7:50:14<21:23:31,  3.54it/s]
 27%|██▋       | 98550/371472 [7:50:14<22:12:16,  3.41it/s]
 27%|██▋       | 98551/371472 [7:50:14<22:24:10,  3.38it/s]
 27%|██▋       | 98552/371472 [7:50:15<23:13:07,  3.27it/s]
 27%|██▋       | 98553/371472 [7:50:15<22:12:12,  3.41it/s]
 27%|██▋       | 98554/371472 [7:50:15<21:37:43,  3.51it/s]
 27%|██▋       | 98555/371472 [7:50:15<20:50:39,  3.64it/s]
 27%|██▋       | 98556/371472 [7:50:16<23:30:08,  3.23it/s]
 27%|██▋       | 98557/371472 [7:50:16<22:15:27,  3.41it/s]
 27%|██▋       | 98558/371472 [7:50:16<21:02:23,  3.60it/s]
 27%|██▋       | 98559/371472 [7:50:17<20:43:56,  3.66it/s]
 27%|██▋       | 98560/371472 [7:50:17<20:32:53,  3.69it/s]
                                                           
{'loss': 3.636, 'learning_rate': 7.615656445947984e-07, 'epoch': 4.25}

 27%|██▋       | 98560/371472 [7:50:17<20:32:53,  3.69it/s]
 27%|██▋       | 98561/371472 [7:50:17<20:27:13,  3.71it/s]
 27%|██▋       | 98562/371472 [7:50:17<20:23:48,  3.72it/s]
 27%|██▋       | 98563/371472 [7:50:18<19:50:00,  3.82it/s]
 27%|██▋       | 98564/371472 [7:50:18<22:02:36,  3.44it/s]
 27%|██▋       | 98565/371472 [7:50:18<21:36:52,  3.51it/s]
 27%|██▋       | 98566/371472 [7:50:19<21:05:13,  3.59it/s]
 27%|██▋       | 98567/371472 [7:50:19<21:26:37,  3.54it/s]
 27%|██▋       | 98568/371472 [7:50:19<22:00:12,  3.45it/s]
 27%|██▋       | 98569/371472 [7:50:19<21:19:22,  3.56it/s]
 27%|██▋       | 98570/371472 [7:50:20<22:15:11,  3.41it/s]
 27%|██▋       | 98571/371472 [7:50:20<22:04:40,  3.43it/s]
 27%|██▋       | 98572/371472 [7:50:20<21:30:33,  3.52it/s]
 27%|██▋       | 98573/371472 [7:50:21<23:17:46,  3.25it/s]
 27%|██▋       | 98574/371472 [7:50:21<22:24:46,  3.38it/s]
 27%|██▋       | 98575/371472 [7:50:21<21:39:55,  3.50it/s]
 27%|██▋       | 98576/371472 [7:50:22<22:06:22,  3.43it/s]
 27%|██▋       | 98577/371472 [7:50:22<22:34:25,  3.36it/s]
 27%|██▋       | 98578/371472 [7:50:22<22:51:43,  3.32it/s]
 27%|██▋       | 98579/371472 [7:50:22<21:54:14,  3.46it/s]
 27%|██▋       | 98580/371472 [7:50:23<21:09:23,  3.58it/s]
                                                           
{'loss': 3.622, 'learning_rate': 7.615171626193195e-07, 'epoch': 4.25}

 27%|██▋       | 98580/371472 [7:50:23<21:09:23,  3.58it/s]
 27%|██▋       | 98581/371472 [7:50:23<21:21:49,  3.55it/s]
 27%|██▋       | 98582/371472 [7:50:23<20:57:14,  3.62it/s]
 27%|██▋       | 98583/371472 [7:50:24<21:39:56,  3.50it/s]
 27%|██▋       | 98584/371472 [7:50:24<20:50:19,  3.64it/s]
 27%|██▋       | 98585/371472 [7:50:24<20:40:01,  3.67it/s]
 27%|██▋       | 98586/371472 [7:50:24<21:55:08,  3.46it/s]
 27%|██▋       | 98587/371472 [7:50:25<21:35:48,  3.51it/s]
 27%|██▋       | 98588/371472 [7:50:25<21:39:08,  3.50it/s]
 27%|██▋       | 98589/371472 [7:50:25<20:30:16,  3.70it/s]
 27%|██▋       | 98590/371472 [7:50:25<21:49:17,  3.47it/s]
 27%|██▋       | 98591/371472 [7:50:26<21:14:08,  3.57it/s]
 27%|██▋       | 98592/371472 [7:50:26<22:31:23,  3.37it/s]
 27%|██▋       | 98593/371472 [7:50:26<21:39:07,  3.50it/s]
 27%|██▋       | 98594/371472 [7:50:27<20:52:31,  3.63it/s]
 27%|██▋       | 98595/371472 [7:50:27<20:54:10,  3.63it/s]
 27%|██▋       | 98596/371472 [7:50:27<21:45:08,  3.48it/s]
 27%|██▋       | 98597/371472 [7:50:27<21:27:07,  3.53it/s]
 27%|██▋       | 98598/371472 [7:50:28<21:25:19,  3.54it/s]
 27%|██▋       | 98599/371472 [7:50:28<22:13:02,  3.41it/s]
 27%|██▋       | 98600/371472 [7:50:28<22:21:52,  3.39it/s]
                                                           
{'loss': 3.4535, 'learning_rate': 7.614686806438406e-07, 'epoch': 4.25}

 27%|██▋       | 98600/371472 [7:50:28<22:21:52,  3.39it/s]
 27%|██▋       | 98601/371472 [7:50:29<21:54:16,  3.46it/s]
 27%|██▋       | 98602/371472 [7:50:29<22:10:50,  3.42it/s]
 27%|██▋       | 98603/371472 [7:50:29<26:13:42,  2.89it/s]
 27%|██▋       | 98604/371472 [7:50:30<25:29:17,  2.97it/s]
 27%|██▋       | 98605/371472 [7:50:30<24:19:32,  3.12it/s]
 27%|██▋       | 98606/371472 [7:50:30<23:07:06,  3.28it/s]
 27%|██▋       | 98607/371472 [7:50:31<22:55:57,  3.31it/s]
 27%|██▋       | 98608/371472 [7:50:31<22:58:25,  3.30it/s]
 27%|██▋       | 98609/371472 [7:50:31<21:59:07,  3.45it/s]
 27%|██▋       | 98610/371472 [7:50:31<21:03:25,  3.60it/s]
 27%|██▋       | 98611/371472 [7:50:32<22:20:04,  3.39it/s]
 27%|██▋       | 98612/371472 [7:50:32<22:17:34,  3.40it/s]
 27%|██▋       | 98613/371472 [7:50:32<21:09:15,  3.58it/s]
 27%|██▋       | 98614/371472 [7:50:32<20:37:12,  3.68it/s]
 27%|██▋       | 98615/371472 [7:50:33<22:48:00,  3.32it/s]
 27%|██▋       | 98616/371472 [7:50:33<22:17:22,  3.40it/s]
 27%|██▋       | 98617/371472 [7:50:33<22:07:02,  3.43it/s]
 27%|██▋       | 98618/371472 [7:50:34<21:39:11,  3.50it/s]
 27%|██▋       | 98619/371472 [7:50:34<21:28:17,  3.53it/s]
 27%|██▋       | 98620/371472 [7:50:34<21:18:14,  3.56it/s]
                                                           
{'loss': 3.3266, 'learning_rate': 7.614201986683616e-07, 'epoch': 4.25}

 27%|██▋       | 98620/371472 [7:50:34<21:18:14,  3.56it/s]
 27%|██▋       | 98621/371472 [7:50:35<21:12:58,  3.57it/s]
 27%|██▋       | 98622/371472 [7:50:35<20:55:21,  3.62it/s]
 27%|██▋       | 98623/371472 [7:50:35<20:30:19,  3.70it/s]
 27%|██▋       | 98624/371472 [7:50:35<20:40:16,  3.67it/s]
 27%|██▋       | 98625/371472 [7:50:36<21:27:03,  3.53it/s]
 27%|██▋       | 98626/371472 [7:50:36<21:30:59,  3.52it/s]
 27%|██▋       | 98627/371472 [7:50:36<22:07:48,  3.42it/s]
 27%|██▋       | 98628/371472 [7:50:36<21:21:44,  3.55it/s]
 27%|██▋       | 98629/371472 [7:50:37<21:24:58,  3.54it/s]
 27%|██▋       | 98630/371472 [7:50:37<20:27:05,  3.71it/s]
 27%|██▋       | 98631/371472 [7:50:37<23:14:50,  3.26it/s]
 27%|██▋       | 98632/371472 [7:50:38<22:32:17,  3.36it/s]
 27%|██▋       | 98633/371472 [7:50:38<21:33:36,  3.52it/s]
 27%|██▋       | 98634/371472 [7:50:38<22:48:09,  3.32it/s]
 27%|██▋       | 98635/371472 [7:50:39<21:57:28,  3.45it/s]
 27%|██▋       | 98636/371472 [7:50:39<24:55:08,  3.04it/s]
 27%|██▋       | 98637/371472 [7:50:39<23:22:32,  3.24it/s]
 27%|██▋       | 98638/371472 [7:50:39<22:19:58,  3.39it/s]
 27%|██▋       | 98639/371472 [7:50:40<23:00:52,  3.29it/s]
 27%|██▋       | 98640/371472 [7:50:40<22:34:46,  3.36it/s]
                                                           
{'loss': 3.5386, 'learning_rate': 7.613717166928828e-07, 'epoch': 4.25}

 27%|██▋       | 98640/371472 [7:50:40<22:34:46,  3.36it/s]
 27%|██▋       | 98641/371472 [7:50:40<21:50:12,  3.47it/s]
 27%|██▋       | 98642/371472 [7:50:41<21:47:44,  3.48it/s]
 27%|██▋       | 98643/371472 [7:50:41<21:08:44,  3.58it/s]
 27%|██▋       | 98644/371472 [7:50:41<21:05:38,  3.59it/s]
 27%|██▋       | 98645/371472 [7:50:41<20:45:41,  3.65it/s]
 27%|██▋       | 98646/371472 [7:50:42<20:32:50,  3.69it/s]
 27%|██▋       | 98647/371472 [7:50:42<22:42:13,  3.34it/s]
 27%|██▋       | 98648/371472 [7:50:42<22:26:12,  3.38it/s]
 27%|██▋       | 98649/371472 [7:50:43<21:09:17,  3.58it/s]
 27%|██▋       | 98650/371472 [7:50:43<21:09:22,  3.58it/s]
 27%|██▋       | 98651/371472 [7:50:43<22:12:47,  3.41it/s]
 27%|██▋       | 98652/371472 [7:50:43<21:10:16,  3.58it/s]
 27%|██▋       | 98653/371472 [7:50:44<20:37:11,  3.68it/s]
 27%|██▋       | 98654/371472 [7:50:44<21:17:08,  3.56it/s]
 27%|██▋       | 98655/371472 [7:50:44<22:56:30,  3.30it/s]
 27%|██▋       | 98656/371472 [7:50:45<23:49:20,  3.18it/s]
 27%|██▋       | 98657/371472 [7:50:45<22:29:49,  3.37it/s]
 27%|██▋       | 98658/371472 [7:50:45<21:40:48,  3.50it/s]
 27%|██▋       | 98659/371472 [7:50:46<22:42:20,  3.34it/s]
 27%|██▋       | 98660/371472 [7:50:46<22:40:54,  3.34it/s]
                                                           
{'loss': 3.6697, 'learning_rate': 7.613232347174039e-07, 'epoch': 4.25}

 27%|██▋       | 98660/371472 [7:50:46<22:40:54,  3.34it/s]
 27%|██▋       | 98661/371472 [7:50:46<21:50:30,  3.47it/s]
 27%|██▋       | 98662/371472 [7:50:46<22:11:53,  3.41it/s]
 27%|██▋       | 98663/371472 [7:50:47<21:34:55,  3.51it/s]
 27%|██▋       | 98664/371472 [7:50:47<21:31:10,  3.52it/s]
 27%|██▋       | 98665/371472 [7:50:47<21:08:04,  3.59it/s]
 27%|██▋       | 98666/371472 [7:50:48<21:51:36,  3.47it/s]
 27%|██▋       | 98667/371472 [7:50:48<21:26:29,  3.53it/s]
 27%|██▋       | 98668/371472 [7:50:48<21:51:18,  3.47it/s]
 27%|██▋       | 98669/371472 [7:50:48<21:33:40,  3.51it/s]
 27%|██▋       | 98670/371472 [7:50:49<22:09:28,  3.42it/s]
 27%|██▋       | 98671/371472 [7:50:49<21:51:20,  3.47it/s]
 27%|██▋       | 98672/371472 [7:50:49<21:58:04,  3.45it/s]
 27%|██▋       | 98673/371472 [7:50:50<21:45:24,  3.48it/s]
 27%|██▋       | 98674/371472 [7:50:50<22:33:12,  3.36it/s]
 27%|██▋       | 98675/371472 [7:50:50<22:40:05,  3.34it/s]
 27%|██▋       | 98676/371472 [7:50:50<22:12:14,  3.41it/s]
 27%|██▋       | 98677/371472 [7:50:51<21:59:29,  3.45it/s]
 27%|██▋       | 98678/371472 [7:50:51<20:48:38,  3.64it/s]
 27%|██▋       | 98679/371472 [7:50:51<20:54:16,  3.62it/s]
 27%|██▋       | 98680/371472 [7:50:52<20:45:54,  3.65it/s]
                                                           
{'loss': 3.6676, 'learning_rate': 7.61274752741925e-07, 'epoch': 4.25}

 27%|██▋       | 98680/371472 [7:50:52<20:45:54,  3.65it/s]
 27%|██▋       | 98681/371472 [7:50:52<21:24:45,  3.54it/s]
 27%|██▋       | 98682/371472 [7:50:52<22:48:17,  3.32it/s]
 27%|██▋       | 98683/371472 [7:50:52<21:39:28,  3.50it/s]
 27%|██▋       | 98684/371472 [7:50:53<21:10:17,  3.58it/s]
 27%|██▋       | 98685/371472 [7:50:53<21:38:49,  3.50it/s]
 27%|██▋       | 98686/371472 [7:50:53<21:36:06,  3.51it/s]
 27%|██▋       | 98687/371472 [7:50:54<21:18:20,  3.56it/s]
 27%|██▋       | 98688/371472 [7:50:54<22:35:13,  3.35it/s]
 27%|██▋       | 98689/371472 [7:50:54<22:34:11,  3.36it/s]
 27%|██▋       | 98690/371472 [7:50:54<22:16:37,  3.40it/s]
 27%|██▋       | 98691/371472 [7:50:55<21:46:10,  3.48it/s]
 27%|██▋       | 98692/371472 [7:50:55<22:07:07,  3.43it/s]
 27%|██▋       | 98693/371472 [7:50:55<21:32:03,  3.52it/s]
 27%|██▋       | 98694/371472 [7:50:56<20:59:55,  3.61it/s]
 27%|██▋       | 98695/371472 [7:50:56<21:41:06,  3.49it/s]
 27%|██▋       | 98696/371472 [7:50:56<21:24:35,  3.54it/s]
 27%|██▋       | 98697/371472 [7:50:56<21:26:30,  3.53it/s]
 27%|██▋       | 98698/371472 [7:50:57<21:57:32,  3.45it/s]
 27%|██▋       | 98699/371472 [7:50:57<21:11:46,  3.57it/s]
 27%|██▋       | 98700/371472 [7:50:57<20:55:30,  3.62it/s]
                                                           
{'loss': 3.5347, 'learning_rate': 7.612262707664461e-07, 'epoch': 4.25}

 27%|██▋       | 98700/371472 [7:50:57<20:55:30,  3.62it/s]
 27%|██▋       | 98701/371472 [7:50:58<20:31:04,  3.69it/s]
 27%|██▋       | 98702/371472 [7:50:58<22:11:07,  3.42it/s]
 27%|██▋       | 98703/371472 [7:50:58<21:29:37,  3.53it/s]
 27%|██▋       | 98704/371472 [7:50:58<22:04:01,  3.43it/s]
 27%|██▋       | 98705/371472 [7:50:59<21:55:32,  3.46it/s]
 27%|██▋       | 98706/371472 [7:50:59<23:46:53,  3.19it/s]
 27%|██▋       | 98707/371472 [7:50:59<23:31:41,  3.22it/s]
 27%|██▋       | 98708/371472 [7:51:00<23:12:40,  3.26it/s]
 27%|██▋       | 98709/371472 [7:51:00<23:19:15,  3.25it/s]
 27%|██▋       | 98710/371472 [7:51:00<22:25:37,  3.38it/s]
 27%|██▋       | 98711/371472 [7:51:01<21:32:09,  3.52it/s]
 27%|██▋       | 98712/371472 [7:51:01<21:25:55,  3.54it/s]
 27%|██▋       | 98713/371472 [7:51:01<22:36:45,  3.35it/s]
 27%|██▋       | 98714/371472 [7:51:01<21:53:01,  3.46it/s]
 27%|██▋       | 98715/371472 [7:51:02<23:43:53,  3.19it/s]
 27%|██▋       | 98716/371472 [7:51:02<23:37:19,  3.21it/s]
 27%|██▋       | 98717/371472 [7:51:02<22:05:11,  3.43it/s]
 27%|██▋       | 98718/371472 [7:51:03<21:30:03,  3.52it/s]
 27%|██▋       | 98719/371472 [7:51:03<20:54:39,  3.62it/s]
 27%|██▋       | 98720/371472 [7:51:03<22:11:30,  3.41it/s]
                                                           
{'loss': 3.5547, 'learning_rate': 7.611777887909673e-07, 'epoch': 4.25}

 27%|██▋       | 98720/371472 [7:51:03<22:11:30,  3.41it/s]
 27%|██▋       | 98721/371472 [7:51:03<21:53:52,  3.46it/s]
 27%|██▋       | 98722/371472 [7:51:04<20:59:03,  3.61it/s]
 27%|██▋       | 98723/371472 [7:51:04<20:39:44,  3.67it/s]
 27%|██▋       | 98724/371472 [7:51:04<21:11:37,  3.57it/s]
 27%|██▋       | 98725/371472 [7:51:05<20:39:11,  3.67it/s]
 27%|██▋       | 98726/371472 [7:51:05<20:45:08,  3.65it/s]
 27%|██▋       | 98727/371472 [7:51:05<21:31:45,  3.52it/s]
 27%|██▋       | 98728/371472 [7:51:05<21:55:28,  3.46it/s]
 27%|██▋       | 98729/371472 [7:51:06<22:04:10,  3.43it/s]
 27%|██▋       | 98730/371472 [7:51:06<21:34:49,  3.51it/s]
 27%|██▋       | 98731/371472 [7:51:06<21:46:05,  3.48it/s]
 27%|██▋       | 98732/371472 [7:51:07<21:25:16,  3.54it/s]
 27%|██▋       | 98733/371472 [7:51:07<22:05:12,  3.43it/s]
 27%|██▋       | 98734/371472 [7:51:07<21:18:22,  3.56it/s]
 27%|██▋       | 98735/371472 [7:51:07<22:52:22,  3.31it/s]
 27%|██▋       | 98736/371472 [7:51:08<22:34:47,  3.36it/s]
 27%|██▋       | 98737/371472 [7:51:08<24:52:43,  3.05it/s]
 27%|██▋       | 98738/371472 [7:51:08<23:34:55,  3.21it/s]
 27%|██▋       | 98739/371472 [7:51:09<23:19:03,  3.25it/s]
 27%|██▋       | 98740/371472 [7:51:09<22:23:16,  3.38it/s]
                                                           
{'loss': 3.6636, 'learning_rate': 7.611293068154883e-07, 'epoch': 4.25}

 27%|██▋       | 98740/371472 [7:51:09<22:23:16,  3.38it/s]
 27%|██▋       | 98741/371472 [7:51:09<21:42:16,  3.49it/s]
 27%|██▋       | 98742/371472 [7:51:10<20:58:55,  3.61it/s]
 27%|██▋       | 98743/371472 [7:51:10<20:31:19,  3.69it/s]
 27%|██▋       | 98744/371472 [7:51:10<20:34:59,  3.68it/s]
 27%|██▋       | 98745/371472 [7:51:10<20:58:32,  3.61it/s]
 27%|██▋       | 98746/371472 [7:51:11<22:21:27,  3.39it/s]
 27%|██▋       | 98747/371472 [7:51:11<22:28:23,  3.37it/s]
 27%|██▋       | 98748/371472 [7:51:11<22:45:48,  3.33it/s]
 27%|██▋       | 98749/371472 [7:51:12<21:31:38,  3.52it/s]
 27%|██▋       | 98750/371472 [7:51:12<21:57:47,  3.45it/s]
 27%|██▋       | 98751/371472 [7:51:12<21:17:17,  3.56it/s]
 27%|██▋       | 98752/371472 [7:51:12<20:35:25,  3.68it/s]
 27%|██▋       | 98753/371472 [7:51:13<21:36:47,  3.51it/s]
 27%|██▋       | 98754/371472 [7:51:13<22:26:48,  3.37it/s]
 27%|██▋       | 98755/371472 [7:51:13<21:24:47,  3.54it/s]
 27%|██▋       | 98756/371472 [7:51:13<20:52:53,  3.63it/s]
 27%|██▋       | 98757/371472 [7:51:14<20:58:15,  3.61it/s]
 27%|██▋       | 98758/371472 [7:51:14<20:35:28,  3.68it/s]
 27%|██▋       | 98759/371472 [7:51:14<20:45:13,  3.65it/s]
 27%|██▋       | 98760/371472 [7:51:15<20:05:28,  3.77it/s]
                                                           
{'loss': 3.5236, 'learning_rate': 7.610808248400094e-07, 'epoch': 4.25}

 27%|██▋       | 98760/371472 [7:51:15<20:05:28,  3.77it/s]
 27%|██▋       | 98761/371472 [7:51:15<21:40:33,  3.49it/s]
 27%|██▋       | 98762/371472 [7:51:15<21:17:48,  3.56it/s]
 27%|██▋       | 98763/371472 [7:51:16<22:45:32,  3.33it/s]
 27%|██▋       | 98764/371472 [7:51:16<22:52:53,  3.31it/s]
 27%|██▋       | 98765/371472 [7:51:16<22:55:40,  3.30it/s]
 27%|██▋       | 98766/371472 [7:51:16<21:59:27,  3.44it/s]
 27%|██▋       | 98767/371472 [7:51:17<22:21:45,  3.39it/s]
 27%|██▋       | 98768/371472 [7:51:17<22:59:20,  3.30it/s]
 27%|██▋       | 98769/371472 [7:51:17<22:59:13,  3.30it/s]
 27%|██▋       | 98770/371472 [7:51:18<24:02:28,  3.15it/s]
 27%|██▋       | 98771/371472 [7:51:18<23:01:33,  3.29it/s]
 27%|██▋       | 98772/371472 [7:51:18<22:53:31,  3.31it/s]
 27%|██▋       | 98773/371472 [7:51:19<23:19:33,  3.25it/s]
 27%|██▋       | 98774/371472 [7:51:19<23:19:55,  3.25it/s]
 27%|██▋       | 98775/371472 [7:51:19<22:37:14,  3.35it/s]
 27%|██▋       | 98776/371472 [7:51:19<21:53:54,  3.46it/s]
 27%|██▋       | 98777/371472 [7:51:20<20:52:51,  3.63it/s]
 27%|██▋       | 98778/371472 [7:51:20<21:06:43,  3.59it/s]
 27%|██▋       | 98779/371472 [7:51:20<21:55:44,  3.45it/s]
 27%|██▋       | 98780/371472 [7:51:21<21:18:26,  3.55it/s]
                                                           
{'loss': 3.5066, 'learning_rate': 7.610323428645305e-07, 'epoch': 4.25}

 27%|██▋       | 98780/371472 [7:51:21<21:18:26,  3.55it/s]
 27%|██▋       | 98781/371472 [7:51:21<20:35:45,  3.68it/s]
 27%|██▋       | 98782/371472 [7:51:21<20:31:40,  3.69it/s]
 27%|██▋       | 98783/371472 [7:51:21<20:55:49,  3.62it/s]
 27%|██▋       | 98784/371472 [7:51:22<20:34:33,  3.68it/s]
 27%|██▋       | 98785/371472 [7:51:22<20:31:16,  3.69it/s]
 27%|██▋       | 98786/371472 [7:51:22<19:58:53,  3.79it/s]
 27%|██▋       | 98787/371472 [7:51:22<19:49:22,  3.82it/s]
 27%|██▋       | 98788/371472 [7:51:23<20:26:28,  3.71it/s]
 27%|██▋       | 98789/371472 [7:51:23<21:18:50,  3.55it/s]
 27%|██▋       | 98790/371472 [7:51:23<21:12:06,  3.57it/s]
 27%|██▋       | 98791/371472 [7:51:23<20:49:03,  3.64it/s]
 27%|██▋       | 98792/371472 [7:51:24<21:19:49,  3.55it/s]
 27%|██▋       | 98793/371472 [7:51:24<20:44:32,  3.65it/s]
 27%|██▋       | 98794/371472 [7:51:24<20:42:08,  3.66it/s]
 27%|██▋       | 98795/371472 [7:51:25<22:16:37,  3.40it/s]
 27%|██▋       | 98796/371472 [7:51:25<22:09:44,  3.42it/s]
 27%|██▋       | 98797/371472 [7:51:25<22:43:14,  3.33it/s]
 27%|██▋       | 98798/371472 [7:51:26<22:14:55,  3.40it/s]
 27%|██▋       | 98799/371472 [7:51:26<21:59:39,  3.44it/s]
 27%|██▋       | 98800/371472 [7:51:26<22:03:58,  3.43it/s]
                                                           
{'loss': 3.7395, 'learning_rate': 7.609838608890517e-07, 'epoch': 4.26}

 27%|██▋       | 98800/371472 [7:51:26<22:03:58,  3.43it/s]
 27%|██▋       | 98801/371472 [7:51:26<22:11:54,  3.41it/s]
 27%|██▋       | 98802/371472 [7:51:27<22:01:41,  3.44it/s]
 27%|██▋       | 98803/371472 [7:51:27<21:50:37,  3.47it/s]
 27%|██▋       | 98804/371472 [7:51:27<21:51:05,  3.47it/s]
 27%|██▋       | 98805/371472 [7:51:28<21:14:17,  3.57it/s]
 27%|██▋       | 98806/371472 [7:51:28<20:45:35,  3.65it/s]
 27%|██▋       | 98807/371472 [7:51:28<21:34:16,  3.51it/s]
 27%|██▋       | 98808/371472 [7:51:28<21:27:23,  3.53it/s]
 27%|██▋       | 98809/371472 [7:51:29<21:14:43,  3.57it/s]
 27%|██▋       | 98810/371472 [7:51:29<20:51:22,  3.63it/s]
 27%|██▋       | 98811/371472 [7:51:29<20:58:00,  3.61it/s]
 27%|██▋       | 98812/371472 [7:51:29<20:26:21,  3.71it/s]
 27%|██▋       | 98813/371472 [7:51:30<20:11:57,  3.75it/s]
 27%|██▋       | 98814/371472 [7:51:30<21:09:02,  3.58it/s]
 27%|██▋       | 98815/371472 [7:51:30<21:12:45,  3.57it/s]
 27%|██▋       | 98816/371472 [7:51:31<23:32:09,  3.22it/s]
 27%|██▋       | 98817/371472 [7:51:31<24:00:42,  3.15it/s]
 27%|██▋       | 98818/371472 [7:51:31<23:43:32,  3.19it/s]
 27%|██▋       | 98819/371472 [7:51:32<22:58:21,  3.30it/s]
 27%|██▋       | 98820/371472 [7:51:32<22:55:32,  3.30it/s]
                                                           
{'loss': 3.6356, 'learning_rate': 7.609353789135728e-07, 'epoch': 4.26}

 27%|██▋       | 98820/371472 [7:51:32<22:55:32,  3.30it/s]
 27%|██▋       | 98821/371472 [7:51:32<22:01:35,  3.44it/s]
 27%|██▋       | 98822/371472 [7:51:32<21:01:55,  3.60it/s]
 27%|██▋       | 98823/371472 [7:51:33<20:24:28,  3.71it/s]
 27%|██▋       | 98824/371472 [7:51:33<19:47:46,  3.83it/s]
 27%|██▋       | 98825/371472 [7:51:33<19:49:54,  3.82it/s]
 27%|██▋       | 98826/371472 [7:51:33<20:07:04,  3.76it/s]
 27%|██▋       | 98827/371472 [7:51:34<21:09:45,  3.58it/s]
 27%|██▋       | 98828/371472 [7:51:34<20:23:29,  3.71it/s]
 27%|██▋       | 98829/371472 [7:51:34<20:18:21,  3.73it/s]
 27%|██▋       | 98830/371472 [7:51:35<21:29:17,  3.52it/s]
 27%|██▋       | 98831/371472 [7:51:35<21:01:35,  3.60it/s]
 27%|██▋       | 98832/371472 [7:51:35<20:52:56,  3.63it/s]
 27%|██▋       | 98833/371472 [7:51:35<20:26:38,  3.70it/s]
 27%|██▋       | 98834/371472 [7:51:36<20:15:28,  3.74it/s]
 27%|██▋       | 98835/371472 [7:51:36<21:06:22,  3.59it/s]
 27%|██▋       | 98836/371472 [7:51:36<20:52:53,  3.63it/s]
 27%|██▋       | 98837/371472 [7:51:36<20:37:55,  3.67it/s]
 27%|██▋       | 98838/371472 [7:51:37<21:07:08,  3.59it/s]
 27%|██▋       | 98839/371472 [7:51:37<21:56:11,  3.45it/s]
 27%|██▋       | 98840/371472 [7:51:37<21:10:05,  3.58it/s]
                                                           
{'loss': 3.539, 'learning_rate': 7.608868969380939e-07, 'epoch': 4.26}

 27%|██▋       | 98840/371472 [7:51:37<21:10:05,  3.58it/s]
 27%|██▋       | 98841/371472 [7:51:38<23:52:29,  3.17it/s]
 27%|██▋       | 98842/371472 [7:51:38<22:58:21,  3.30it/s]
 27%|██▋       | 98843/371472 [7:51:38<22:39:19,  3.34it/s]
 27%|██▋       | 98844/371472 [7:51:39<21:36:21,  3.51it/s]
 27%|██▋       | 98845/371472 [7:51:39<21:38:01,  3.50it/s]
 27%|██▋       | 98846/371472 [7:51:39<21:22:01,  3.54it/s]
 27%|██▋       | 98847/371472 [7:51:39<21:35:34,  3.51it/s]
 27%|██▋       | 98848/371472 [7:51:40<21:01:08,  3.60it/s]
 27%|██▋       | 98849/371472 [7:51:40<20:41:56,  3.66it/s]
 27%|██▋       | 98850/371472 [7:51:40<22:24:59,  3.38it/s]
 27%|██▋       | 98851/371472 [7:51:41<21:35:17,  3.51it/s]
 27%|██▋       | 98852/371472 [7:51:41<22:32:02,  3.36it/s]
 27%|██▋       | 98853/371472 [7:51:41<21:45:26,  3.48it/s]
 27%|██▋       | 98854/371472 [7:51:41<22:09:47,  3.42it/s]
 27%|██▋       | 98855/371472 [7:51:42<22:37:07,  3.35it/s]
 27%|██▋       | 98856/371472 [7:51:42<21:49:22,  3.47it/s]
 27%|██▋       | 98857/371472 [7:51:42<23:22:11,  3.24it/s]
 27%|██▋       | 98858/371472 [7:51:43<23:29:25,  3.22it/s]
 27%|██▋       | 98859/371472 [7:51:43<22:50:13,  3.32it/s]
 27%|██▋       | 98860/371472 [7:51:43<21:52:30,  3.46it/s]
                                                           
{'loss': 3.5006, 'learning_rate': 7.60838414962615e-07, 'epoch': 4.26}

 27%|██▋       | 98860/371472 [7:51:43<21:52:30,  3.46it/s]
 27%|██▋       | 98861/371472 [7:51:43<21:02:44,  3.60it/s]
 27%|██▋       | 98862/371472 [7:51:44<20:26:01,  3.71it/s]
 27%|██▋       | 98863/371472 [7:51:44<20:06:50,  3.76it/s]
 27%|██▋       | 98864/371472 [7:51:44<19:45:02,  3.83it/s]
 27%|██▋       | 98865/371472 [7:51:45<19:53:53,  3.81it/s]
 27%|██▋       | 98866/371472 [7:51:45<20:44:43,  3.65it/s]
 27%|██▋       | 98867/371472 [7:51:45<21:17:42,  3.56it/s]
 27%|██▋       | 98868/371472 [7:51:45<21:11:28,  3.57it/s]
 27%|██▋       | 98869/371472 [7:51:46<22:26:58,  3.37it/s]
 27%|██▋       | 98870/371472 [7:51:46<21:56:45,  3.45it/s]
 27%|██▋       | 98871/371472 [7:51:46<22:39:32,  3.34it/s]
 27%|██▋       | 98872/371472 [7:51:47<22:05:44,  3.43it/s]
 27%|██▋       | 98873/371472 [7:51:47<21:45:29,  3.48it/s]
 27%|██▋       | 98874/371472 [7:51:47<23:50:37,  3.18it/s]
 27%|██▋       | 98875/371472 [7:51:48<22:32:01,  3.36it/s]
 27%|██▋       | 98876/371472 [7:51:48<22:00:57,  3.44it/s]
 27%|██▋       | 98877/371472 [7:51:48<23:29:54,  3.22it/s]
 27%|██▋       | 98878/371472 [7:51:48<22:50:45,  3.31it/s]
 27%|██▋       | 98879/371472 [7:51:49<22:08:16,  3.42it/s]
 27%|██▋       | 98880/371472 [7:51:49<23:04:45,  3.28it/s]
                                                           
{'loss': 3.7159, 'learning_rate': 7.607899329871361e-07, 'epoch': 4.26}

 27%|██▋       | 98880/371472 [7:51:49<23:04:45,  3.28it/s]
 27%|██▋       | 98881/371472 [7:51:49<22:15:27,  3.40it/s]
 27%|██▋       | 98882/371472 [7:51:50<21:32:34,  3.51it/s]
 27%|██▋       | 98883/371472 [7:51:50<20:27:55,  3.70it/s]
 27%|██▋       | 98884/371472 [7:51:50<20:14:36,  3.74it/s]
 27%|██▋       | 98885/371472 [7:51:50<19:45:41,  3.83it/s]
 27%|██▋       | 98886/371472 [7:51:51<19:48:34,  3.82it/s]
 27%|██▋       | 98887/371472 [7:51:51<20:05:49,  3.77it/s]
 27%|██▋       | 98888/371472 [7:51:51<20:20:31,  3.72it/s]
 27%|██▋       | 98889/371472 [7:51:51<20:29:41,  3.69it/s]
 27%|██▋       | 98890/371472 [7:51:52<20:50:31,  3.63it/s]
 27%|██▋       | 98891/371472 [7:51:52<20:44:03,  3.65it/s]
 27%|██▋       | 98892/371472 [7:51:52<20:24:51,  3.71it/s]
 27%|██▋       | 98893/371472 [7:51:53<22:20:13,  3.39it/s]
 27%|██▋       | 98894/371472 [7:51:53<23:20:10,  3.24it/s]
 27%|██▋       | 98895/371472 [7:51:53<21:58:50,  3.44it/s]
 27%|██▋       | 98896/371472 [7:51:53<21:34:18,  3.51it/s]
 27%|██▋       | 98897/371472 [7:51:54<21:23:56,  3.54it/s]
 27%|██▋       | 98898/371472 [7:51:54<21:14:43,  3.56it/s]
 27%|██▋       | 98899/371472 [7:51:54<21:50:25,  3.47it/s]
 27%|██▋       | 98900/371472 [7:51:55<21:13:42,  3.57it/s]
                                                           
{'loss': 3.672, 'learning_rate': 7.607414510116572e-07, 'epoch': 4.26}

 27%|██▋       | 98900/371472 [7:51:55<21:13:42,  3.57it/s]
 27%|██▋       | 98901/371472 [7:51:55<20:56:02,  3.62it/s]
 27%|██▋       | 98902/371472 [7:51:55<20:14:42,  3.74it/s]
 27%|██▋       | 98903/371472 [7:51:55<21:55:22,  3.45it/s]
 27%|██▋       | 98904/371472 [7:51:56<22:40:29,  3.34it/s]
 27%|██▋       | 98905/371472 [7:51:56<21:35:10,  3.51it/s]
 27%|██▋       | 98906/371472 [7:51:56<22:52:54,  3.31it/s]
 27%|██▋       | 98907/371472 [7:51:57<22:27:42,  3.37it/s]
 27%|██▋       | 98908/371472 [7:51:57<24:09:37,  3.13it/s]
 27%|██▋       | 98909/371472 [7:51:57<23:03:16,  3.28it/s]
 27%|██▋       | 98910/371472 [7:51:57<22:07:23,  3.42it/s]
 27%|██▋       | 98911/371472 [7:51:58<21:34:27,  3.51it/s]
 27%|██▋       | 98912/371472 [7:51:58<22:50:51,  3.31it/s]
 27%|██▋       | 98913/371472 [7:51:58<22:49:28,  3.32it/s]
 27%|██▋       | 98914/371472 [7:51:59<22:26:28,  3.37it/s]
 27%|██▋       | 98915/371472 [7:51:59<22:00:21,  3.44it/s]
 27%|██▋       | 98916/371472 [7:51:59<21:58:54,  3.44it/s]
 27%|██▋       | 98917/371472 [7:52:00<22:51:11,  3.31it/s]
 27%|██▋       | 98918/371472 [7:52:00<24:07:11,  3.14it/s]
 27%|██▋       | 98919/371472 [7:52:00<22:53:35,  3.31it/s]
 27%|██▋       | 98920/371472 [7:52:00<21:29:28,  3.52it/s]
                                                           
{'loss': 3.5287, 'learning_rate': 7.606929690361784e-07, 'epoch': 4.26}

 27%|██▋       | 98920/371472 [7:52:00<21:29:28,  3.52it/s]
 27%|██▋       | 98921/371472 [7:52:01<21:13:22,  3.57it/s]
 27%|██▋       | 98922/371472 [7:52:01<21:16:36,  3.56it/s]
 27%|██▋       | 98923/371472 [7:52:01<20:49:06,  3.64it/s]
 27%|██▋       | 98924/371472 [7:52:02<21:38:51,  3.50it/s]
 27%|██▋       | 98925/371472 [7:52:02<21:21:34,  3.54it/s]
 27%|██▋       | 98926/371472 [7:52:02<21:36:02,  3.50it/s]
 27%|██▋       | 98927/371472 [7:52:02<21:40:01,  3.49it/s]
 27%|██▋       | 98928/371472 [7:52:03<21:10:52,  3.57it/s]
 27%|██▋       | 98929/371472 [7:52:03<21:26:49,  3.53it/s]
 27%|██▋       | 98930/371472 [7:52:03<21:16:19,  3.56it/s]
 27%|██▋       | 98931/371472 [7:52:04<21:02:46,  3.60it/s]
 27%|██▋       | 98932/371472 [7:52:04<21:06:30,  3.59it/s]
 27%|██▋       | 98933/371472 [7:52:04<21:02:03,  3.60it/s]
 27%|██▋       | 98934/371472 [7:52:04<20:49:15,  3.64it/s]
 27%|██▋       | 98935/371472 [7:52:05<21:04:13,  3.59it/s]
 27%|██▋       | 98936/371472 [7:52:05<21:14:56,  3.56it/s]
 27%|██▋       | 98937/371472 [7:52:05<21:11:13,  3.57it/s]
 27%|██▋       | 98938/371472 [7:52:05<20:47:29,  3.64it/s]
 27%|██▋       | 98939/371472 [7:52:06<20:28:13,  3.70it/s]
 27%|██▋       | 98940/371472 [7:52:06<20:05:58,  3.77it/s]
                                                           
{'loss': 3.5974, 'learning_rate': 7.606444870606994e-07, 'epoch': 4.26}

 27%|██▋       | 98940/371472 [7:52:06<20:05:58,  3.77it/s]
 27%|██▋       | 98941/371472 [7:52:06<20:18:45,  3.73it/s]
 27%|██▋       | 98942/371472 [7:52:07<22:14:22,  3.40it/s]
 27%|██▋       | 98943/371472 [7:52:07<23:17:03,  3.25it/s]
 27%|██▋       | 98944/371472 [7:52:07<24:15:41,  3.12it/s]
 27%|██▋       | 98945/371472 [7:52:08<23:16:14,  3.25it/s]
 27%|██▋       | 98946/371472 [7:52:08<22:33:15,  3.36it/s]
 27%|██▋       | 98947/371472 [7:52:08<25:02:48,  3.02it/s]
 27%|██▋       | 98948/371472 [7:52:09<23:54:17,  3.17it/s]
 27%|██▋       | 98949/371472 [7:52:09<23:21:26,  3.24it/s]
 27%|██▋       | 98950/371472 [7:52:09<24:09:11,  3.13it/s]
 27%|██▋       | 98951/371472 [7:52:09<23:11:55,  3.26it/s]
 27%|██▋       | 98952/371472 [7:52:10<23:05:42,  3.28it/s]
 27%|██▋       | 98953/371472 [7:52:10<21:46:51,  3.48it/s]
 27%|██▋       | 98954/371472 [7:52:10<21:03:19,  3.60it/s]
 27%|██▋       | 98955/371472 [7:52:11<20:14:33,  3.74it/s]
 27%|██▋       | 98956/371472 [7:52:11<22:08:46,  3.42it/s]
 27%|██▋       | 98957/371472 [7:52:11<21:26:16,  3.53it/s]
 27%|██▋       | 98958/371472 [7:52:11<20:48:54,  3.64it/s]
 27%|██▋       | 98959/371472 [7:52:12<20:38:18,  3.67it/s]
 27%|██▋       | 98960/371472 [7:52:12<20:01:27,  3.78it/s]
                                                           
{'loss': 3.565, 'learning_rate': 7.605960050852206e-07, 'epoch': 4.26}

 27%|██▋       | 98960/371472 [7:52:12<20:01:27,  3.78it/s]
 27%|██▋       | 98961/371472 [7:52:12<20:18:11,  3.73it/s]
 27%|██▋       | 98962/371472 [7:52:12<20:34:22,  3.68it/s]
 27%|██▋       | 98963/371472 [7:52:13<20:55:07,  3.62it/s]
 27%|██▋       | 98964/371472 [7:52:13<20:18:33,  3.73it/s]
 27%|██▋       | 98965/371472 [7:52:13<20:25:26,  3.71it/s]
 27%|██▋       | 98966/371472 [7:52:14<22:15:09,  3.40it/s]
 27%|██▋       | 98967/371472 [7:52:14<21:50:34,  3.47it/s]
 27%|██▋       | 98968/371472 [7:52:14<21:03:47,  3.59it/s]
 27%|██▋       | 98969/371472 [7:52:15<23:42:45,  3.19it/s]
 27%|██▋       | 98970/371472 [7:52:15<23:45:36,  3.19it/s]
 27%|██▋       | 98971/371472 [7:52:15<22:47:17,  3.32it/s]
 27%|██▋       | 98972/371472 [7:52:15<21:40:55,  3.49it/s]
 27%|██▋       | 98973/371472 [7:52:16<21:07:46,  3.58it/s]
 27%|██▋       | 98974/371472 [7:52:16<21:15:28,  3.56it/s]
 27%|██▋       | 98975/371472 [7:52:16<22:06:40,  3.42it/s]
 27%|██▋       | 98976/371472 [7:52:16<21:31:46,  3.52it/s]
 27%|██▋       | 98977/371472 [7:52:17<21:21:51,  3.54it/s]
 27%|██▋       | 98978/371472 [7:52:17<22:22:58,  3.38it/s]
 27%|██▋       | 98979/371472 [7:52:17<22:24:08,  3.38it/s]
 27%|██▋       | 98980/371472 [7:52:18<21:53:04,  3.46it/s]
                                                           
{'loss': 3.5943, 'learning_rate': 7.605475231097417e-07, 'epoch': 4.26}

 27%|██▋       | 98980/371472 [7:52:18<21:53:04,  3.46it/s]
 27%|██▋       | 98981/371472 [7:52:18<21:33:58,  3.51it/s]
 27%|██▋       | 98982/371472 [7:52:18<21:55:23,  3.45it/s]
 27%|██▋       | 98983/371472 [7:52:19<21:15:37,  3.56it/s]
 27%|██▋       | 98984/371472 [7:52:19<21:02:57,  3.60it/s]
 27%|██▋       | 98985/371472 [7:52:19<23:16:20,  3.25it/s]
 27%|██▋       | 98986/371472 [7:52:19<21:53:40,  3.46it/s]
 27%|██▋       | 98987/371472 [7:52:20<20:59:27,  3.61it/s]
 27%|██▋       | 98988/371472 [7:52:20<20:27:52,  3.70it/s]
 27%|██▋       | 98989/371472 [7:52:20<20:42:27,  3.66it/s]
 27%|██▋       | 98990/371472 [7:52:20<20:45:26,  3.65it/s]
 27%|██▋       | 98991/371472 [7:52:21<20:46:15,  3.64it/s]
 27%|██▋       | 98992/371472 [7:52:21<19:57:31,  3.79it/s]
 27%|██▋       | 98993/371472 [7:52:21<20:59:15,  3.61it/s]
 27%|██▋       | 98994/371472 [7:52:22<21:21:29,  3.54it/s]
 27%|██▋       | 98995/371472 [7:52:22<21:16:27,  3.56it/s]
 27%|██▋       | 98996/371472 [7:52:22<21:42:08,  3.49it/s]
 27%|██▋       | 98997/371472 [7:52:22<21:12:46,  3.57it/s]
 27%|██▋       | 98998/371472 [7:52:23<20:42:01,  3.66it/s]
 27%|██▋       | 98999/371472 [7:52:23<23:00:59,  3.29it/s]
 27%|██▋       | 99000/371472 [7:52:23<22:28:36,  3.37it/s]
                                                           
{'loss': 3.6006, 'learning_rate': 7.604990411342626e-07, 'epoch': 4.26}

 27%|██▋       | 99000/371472 [7:52:23<22:28:36,  3.37it/s]
 27%|██▋       | 99001/371472 [7:52:24<22:27:47,  3.37it/s]
 27%|██▋       | 99002/371472 [7:52:24<21:11:47,  3.57it/s]
 27%|██▋       | 99003/371472 [7:52:24<21:56:06,  3.45it/s]
 27%|██▋       | 99004/371472 [7:52:24<21:36:07,  3.50it/s]
 27%|██▋       | 99005/371472 [7:52:25<21:06:26,  3.59it/s]
 27%|██▋       | 99006/371472 [7:52:25<20:47:24,  3.64it/s]
 27%|██▋       | 99007/371472 [7:52:25<20:55:36,  3.62it/s]
 27%|██▋       | 99008/371472 [7:52:26<20:56:55,  3.61it/s]
 27%|██▋       | 99009/371472 [7:52:26<20:47:13,  3.64it/s]
 27%|██▋       | 99010/371472 [7:52:26<20:45:52,  3.64it/s]
 27%|██▋       | 99011/371472 [7:52:26<20:24:35,  3.71it/s]
 27%|██▋       | 99012/371472 [7:52:27<20:58:31,  3.61it/s]
 27%|██▋       | 99013/371472 [7:52:27<20:46:09,  3.64it/s]
 27%|██▋       | 99014/371472 [7:52:27<21:55:40,  3.45it/s]
 27%|██▋       | 99015/371472 [7:52:28<21:31:06,  3.52it/s]
 27%|██▋       | 99016/371472 [7:52:28<21:22:44,  3.54it/s]
 27%|██▋       | 99017/371472 [7:52:28<21:31:22,  3.52it/s]
 27%|██▋       | 99018/371472 [7:52:28<21:36:33,  3.50it/s]
 27%|██▋       | 99019/371472 [7:52:29<21:09:24,  3.58it/s]
 27%|██▋       | 99020/371472 [7:52:29<21:46:49,  3.47it/s]
                                                           
{'loss': 3.566, 'learning_rate': 7.604505591587838e-07, 'epoch': 4.26}

 27%|██▋       | 99020/371472 [7:52:29<21:46:49,  3.47it/s]
 27%|██▋       | 99021/371472 [7:52:29<21:47:36,  3.47it/s]
 27%|██▋       | 99022/371472 [7:52:30<22:29:11,  3.37it/s]
 27%|██▋       | 99023/371472 [7:52:30<22:18:01,  3.39it/s]
 27%|██▋       | 99024/371472 [7:52:30<21:19:10,  3.55it/s]
 27%|██▋       | 99025/371472 [7:52:30<20:59:18,  3.61it/s]
 27%|██▋       | 99026/371472 [7:52:31<20:31:38,  3.69it/s]
 27%|██▋       | 99027/371472 [7:52:31<21:11:55,  3.57it/s]
 27%|██▋       | 99028/371472 [7:52:31<20:53:22,  3.62it/s]
 27%|██▋       | 99029/371472 [7:52:31<20:22:31,  3.71it/s]
 27%|██▋       | 99030/371472 [7:52:32<20:23:42,  3.71it/s]
 27%|██▋       | 99031/371472 [7:52:32<20:35:36,  3.67it/s]
 27%|██▋       | 99032/371472 [7:52:32<21:05:57,  3.59it/s]
 27%|██▋       | 99033/371472 [7:52:33<20:47:13,  3.64it/s]
 27%|██▋       | 99034/371472 [7:52:33<21:31:19,  3.52it/s]
 27%|██▋       | 99035/371472 [7:52:33<23:24:12,  3.23it/s]
 27%|██▋       | 99036/371472 [7:52:34<23:04:37,  3.28it/s]
 27%|██▋       | 99037/371472 [7:52:34<24:00:20,  3.15it/s]
 27%|██▋       | 99038/371472 [7:52:34<24:57:50,  3.03it/s]
 27%|██▋       | 99039/371472 [7:52:35<25:17:33,  2.99it/s]
 27%|██▋       | 99040/371472 [7:52:35<23:32:03,  3.22it/s]
                                                           
{'loss': 3.6672, 'learning_rate': 7.60402077183305e-07, 'epoch': 4.27}

 27%|██▋       | 99040/371472 [7:52:35<23:32:03,  3.22it/s]
 27%|██▋       | 99041/371472 [7:52:35<23:15:41,  3.25it/s]
 27%|██▋       | 99042/371472 [7:52:35<22:14:38,  3.40it/s]
 27%|██▋       | 99043/371472 [7:52:36<21:56:25,  3.45it/s]
 27%|██▋       | 99044/371472 [7:52:36<22:09:41,  3.41it/s]
 27%|██▋       | 99045/371472 [7:52:36<22:14:07,  3.40it/s]
 27%|██▋       | 99046/371472 [7:52:37<21:47:02,  3.47it/s]
 27%|██▋       | 99047/371472 [7:52:37<21:58:25,  3.44it/s]
 27%|██▋       | 99048/371472 [7:52:37<21:29:48,  3.52it/s]
 27%|██▋       | 99049/371472 [7:52:37<20:41:32,  3.66it/s]
 27%|██▋       | 99050/371472 [7:52:38<22:44:34,  3.33it/s]
 27%|██▋       | 99051/371472 [7:52:38<22:12:52,  3.41it/s]
 27%|██▋       | 99052/371472 [7:52:38<22:19:25,  3.39it/s]
 27%|██▋       | 99053/371472 [7:52:39<21:52:24,  3.46it/s]
 27%|██▋       | 99054/371472 [7:52:39<22:17:21,  3.39it/s]
 27%|██▋       | 99055/371472 [7:52:39<21:10:11,  3.57it/s]
 27%|██▋       | 99056/371472 [7:52:39<21:20:14,  3.55it/s]
 27%|██▋       | 99057/371472 [7:52:40<20:51:54,  3.63it/s]
 27%|██▋       | 99058/371472 [7:52:40<20:19:27,  3.72it/s]
 27%|██▋       | 99059/371472 [7:52:40<20:09:41,  3.75it/s]
 27%|██▋       | 99060/371472 [7:52:40<21:00:10,  3.60it/s]
                                                           
{'loss': 3.4539, 'learning_rate': 7.60353595207826e-07, 'epoch': 4.27}

 27%|██▋       | 99060/371472 [7:52:40<21:00:10,  3.60it/s]
 27%|██▋       | 99061/371472 [7:52:41<20:24:13,  3.71it/s]
 27%|██▋       | 99062/371472 [7:52:41<20:15:51,  3.73it/s]
 27%|██▋       | 99063/371472 [7:52:41<20:14:51,  3.74it/s]
 27%|██▋       | 99064/371472 [7:52:42<19:49:51,  3.82it/s]
 27%|██▋       | 99065/371472 [7:52:42<19:35:54,  3.86it/s]
 27%|██▋       | 99066/371472 [7:52:42<21:26:01,  3.53it/s]
 27%|██▋       | 99067/371472 [7:52:42<21:07:27,  3.58it/s]
 27%|██▋       | 99068/371472 [7:52:43<21:01:37,  3.60it/s]
 27%|██▋       | 99069/371472 [7:52:43<21:26:43,  3.53it/s]
 27%|██▋       | 99070/371472 [7:52:43<21:10:55,  3.57it/s]
 27%|██▋       | 99071/371472 [7:52:43<20:58:38,  3.61it/s]
 27%|██▋       | 99072/371472 [7:52:44<21:10:51,  3.57it/s]
 27%|██▋       | 99073/371472 [7:52:44<22:02:02,  3.43it/s]
 27%|██▋       | 99074/371472 [7:52:44<21:20:54,  3.54it/s]
 27%|██▋       | 99075/371472 [7:52:45<20:35:52,  3.67it/s]
 27%|██▋       | 99076/371472 [7:52:45<20:25:16,  3.71it/s]
 27%|██▋       | 99077/371472 [7:52:45<20:38:05,  3.67it/s]
 27%|██▋       | 99078/371472 [7:52:45<20:49:58,  3.63it/s]
 27%|██▋       | 99079/371472 [7:52:46<20:52:34,  3.62it/s]
 27%|██▋       | 99080/371472 [7:52:46<20:36:01,  3.67it/s]
                                                           
{'loss': 3.8522, 'learning_rate': 7.603051132323471e-07, 'epoch': 4.27}

 27%|██▋       | 99080/371472 [7:52:46<20:36:01,  3.67it/s]
 27%|██▋       | 99081/371472 [7:52:46<20:55:15,  3.62it/s]
 27%|██▋       | 99082/371472 [7:52:47<23:18:37,  3.25it/s]
 27%|██▋       | 99083/371472 [7:52:47<22:46:08,  3.32it/s]
 27%|██▋       | 99084/371472 [7:52:47<22:33:20,  3.35it/s]
 27%|██▋       | 99085/371472 [7:52:48<23:18:07,  3.25it/s]
 27%|██▋       | 99086/371472 [7:52:48<22:42:17,  3.33it/s]
 27%|██▋       | 99087/371472 [7:52:48<22:35:07,  3.35it/s]
 27%|██▋       | 99088/371472 [7:52:48<23:10:43,  3.26it/s]
 27%|██▋       | 99089/371472 [7:52:49<21:47:37,  3.47it/s]
 27%|██▋       | 99090/371472 [7:52:49<21:38:25,  3.50it/s]
 27%|██▋       | 99091/371472 [7:52:49<20:56:43,  3.61it/s]
 27%|██▋       | 99092/371472 [7:52:50<22:07:51,  3.42it/s]
 27%|██▋       | 99093/371472 [7:52:50<21:37:42,  3.50it/s]
 27%|██▋       | 99094/371472 [7:52:50<21:09:07,  3.58it/s]
 27%|██▋       | 99095/371472 [7:52:50<21:24:04,  3.54it/s]
 27%|██▋       | 99096/371472 [7:52:51<21:13:13,  3.57it/s]
 27%|██▋       | 99097/371472 [7:52:51<20:54:25,  3.62it/s]
 27%|██▋       | 99098/371472 [7:52:51<20:47:30,  3.64it/s]
 27%|██▋       | 99099/371472 [7:52:51<21:16:30,  3.56it/s]
 27%|██▋       | 99100/371472 [7:52:52<20:38:47,  3.66it/s]
                                                           
{'loss': 3.6473, 'learning_rate': 7.602566312568683e-07, 'epoch': 4.27}

 27%|██▋       | 99100/371472 [7:52:52<20:38:47,  3.66it/s]
 27%|██▋       | 99101/371472 [7:52:52<20:25:20,  3.70it/s]
 27%|██▋       | 99102/371472 [7:52:52<20:18:35,  3.73it/s]
 27%|██▋       | 99103/371472 [7:52:53<20:11:29,  3.75it/s]
 27%|██▋       | 99104/371472 [7:52:53<20:14:38,  3.74it/s]
 27%|██▋       | 99105/371472 [7:52:53<21:07:35,  3.58it/s]
 27%|██▋       | 99106/371472 [7:52:53<21:34:02,  3.51it/s]
 27%|██▋       | 99107/371472 [7:52:54<21:26:51,  3.53it/s]
 27%|██▋       | 99108/371472 [7:52:54<21:29:30,  3.52it/s]
 27%|██▋       | 99109/371472 [7:52:54<21:06:33,  3.58it/s]
 27%|██▋       | 99110/371472 [7:52:55<21:22:29,  3.54it/s]
 27%|██▋       | 99111/371472 [7:52:55<22:24:13,  3.38it/s]
 27%|██▋       | 99112/371472 [7:52:55<23:41:16,  3.19it/s]
 27%|██▋       | 99113/371472 [7:52:55<22:32:15,  3.36it/s]
 27%|██▋       | 99114/371472 [7:52:56<23:08:01,  3.27it/s]
 27%|██▋       | 99115/371472 [7:52:56<23:45:09,  3.19it/s]
 27%|██▋       | 99116/371472 [7:52:56<22:51:14,  3.31it/s]
 27%|██▋       | 99117/371472 [7:52:57<21:27:08,  3.53it/s]
 27%|██▋       | 99118/371472 [7:52:57<21:28:23,  3.52it/s]
 27%|██▋       | 99119/371472 [7:52:57<21:39:58,  3.49it/s]
 27%|██▋       | 99120/371472 [7:52:57<21:28:46,  3.52it/s]
                                                           
{'loss': 3.5483, 'learning_rate': 7.602081492813893e-07, 'epoch': 4.27}

 27%|██▋       | 99120/371472 [7:52:57<21:28:46,  3.52it/s]
 27%|██▋       | 99121/371472 [7:52:58<22:28:26,  3.37it/s]
 27%|██▋       | 99122/371472 [7:52:58<21:23:00,  3.54it/s]
 27%|██▋       | 99123/371472 [7:52:58<21:15:34,  3.56it/s]
 27%|██▋       | 99124/371472 [7:52:59<21:12:32,  3.57it/s]
 27%|██▋       | 99125/371472 [7:52:59<21:28:46,  3.52it/s]
 27%|██▋       | 99126/371472 [7:52:59<20:52:48,  3.62it/s]
 27%|██▋       | 99127/371472 [7:52:59<21:01:05,  3.60it/s]
 27%|██▋       | 99128/371472 [7:53:00<24:01:24,  3.15it/s]
 27%|██▋       | 99129/371472 [7:53:00<23:32:42,  3.21it/s]
 27%|██▋       | 99130/371472 [7:53:01<24:13:07,  3.12it/s]
 27%|██▋       | 99131/371472 [7:53:01<24:12:33,  3.12it/s]
 27%|██▋       | 99132/371472 [7:53:01<22:53:05,  3.31it/s]
 27%|██▋       | 99133/371472 [7:53:01<22:23:32,  3.38it/s]
 27%|██▋       | 99134/371472 [7:53:02<21:28:12,  3.52it/s]
 27%|██▋       | 99135/371472 [7:53:02<21:43:45,  3.48it/s]
 27%|██▋       | 99136/371472 [7:53:02<21:10:52,  3.57it/s]
 27%|██▋       | 99137/371472 [7:53:02<21:00:30,  3.60it/s]
 27%|██▋       | 99138/371472 [7:53:03<21:40:26,  3.49it/s]
 27%|██▋       | 99139/371472 [7:53:03<21:51:49,  3.46it/s]
 27%|██▋       | 99140/371472 [7:53:03<21:08:35,  3.58it/s]
                                                           
{'loss': 3.4412, 'learning_rate': 7.601596673059104e-07, 'epoch': 4.27}

 27%|██▋       | 99140/371472 [7:53:03<21:08:35,  3.58it/s]
 27%|██▋       | 99141/371472 [7:53:04<20:49:42,  3.63it/s]
 27%|██▋       | 99142/371472 [7:53:04<20:18:16,  3.73it/s]
 27%|██▋       | 99143/371472 [7:53:04<20:25:31,  3.70it/s]
 27%|██▋       | 99144/371472 [7:53:04<19:56:31,  3.79it/s]
 27%|██▋       | 99145/371472 [7:53:05<20:16:04,  3.73it/s]
 27%|██▋       | 99146/371472 [7:53:05<20:12:34,  3.74it/s]
 27%|██▋       | 99147/371472 [7:53:05<20:03:24,  3.77it/s]
 27%|██▋       | 99148/371472 [7:53:05<21:19:50,  3.55it/s]
 27%|██▋       | 99149/371472 [7:53:06<21:41:20,  3.49it/s]
 27%|██▋       | 99150/371472 [7:53:06<21:25:44,  3.53it/s]
 27%|██▋       | 99151/371472 [7:53:06<21:49:13,  3.47it/s]
 27%|██▋       | 99152/371472 [7:53:07<21:43:35,  3.48it/s]
 27%|██▋       | 99153/371472 [7:53:07<21:26:12,  3.53it/s]
 27%|██▋       | 99154/371472 [7:53:07<22:18:04,  3.39it/s]
 27%|██▋       | 99155/371472 [7:53:08<21:46:42,  3.47it/s]
 27%|██▋       | 99156/371472 [7:53:08<21:13:06,  3.56it/s]
 27%|██▋       | 99157/371472 [7:53:08<20:20:16,  3.72it/s]
 27%|██▋       | 99158/371472 [7:53:08<20:24:04,  3.71it/s]
 27%|██▋       | 99159/371472 [7:53:09<20:00:36,  3.78it/s]
 27%|██▋       | 99160/371472 [7:53:09<20:22:24,  3.71it/s]
                                                           
{'loss': 3.6133, 'learning_rate': 7.601111853304315e-07, 'epoch': 4.27}

 27%|██▋       | 99160/371472 [7:53:09<20:22:24,  3.71it/s]
 27%|██▋       | 99161/371472 [7:53:09<19:56:38,  3.79it/s]
 27%|██▋       | 99162/371472 [7:53:09<19:37:22,  3.85it/s]
 27%|██▋       | 99163/371472 [7:53:10<19:27:10,  3.89it/s]
 27%|██▋       | 99164/371472 [7:53:10<19:40:34,  3.84it/s]
 27%|██▋       | 99165/371472 [7:53:10<20:09:03,  3.75it/s]
 27%|██▋       | 99166/371472 [7:53:10<21:02:58,  3.59it/s]
 27%|██▋       | 99167/371472 [7:53:11<20:48:36,  3.63it/s]
 27%|██▋       | 99168/371472 [7:53:11<21:35:33,  3.50it/s]
 27%|██▋       | 99169/371472 [7:53:11<20:31:03,  3.69it/s]
 27%|██▋       | 99170/371472 [7:53:12<21:43:24,  3.48it/s]
 27%|██▋       | 99171/371472 [7:53:12<22:22:28,  3.38it/s]
 27%|██▋       | 99172/371472 [7:53:12<22:10:21,  3.41it/s]
 27%|██▋       | 99173/371472 [7:53:12<23:10:22,  3.26it/s]
 27%|██▋       | 99174/371472 [7:53:13<22:57:39,  3.29it/s]
 27%|██▋       | 99175/371472 [7:53:13<21:59:53,  3.44it/s]
 27%|██▋       | 99176/371472 [7:53:13<22:04:11,  3.43it/s]
 27%|██▋       | 99177/371472 [7:53:14<22:56:33,  3.30it/s]
 27%|██▋       | 99178/371472 [7:53:14<22:44:12,  3.33it/s]
 27%|██▋       | 99179/371472 [7:53:14<21:43:08,  3.48it/s]
 27%|██▋       | 99180/371472 [7:53:15<21:47:10,  3.47it/s]
                                                           
{'loss': 3.7525, 'learning_rate': 7.600627033549527e-07, 'epoch': 4.27}

 27%|██▋       | 99180/371472 [7:53:15<21:47:10,  3.47it/s]
 27%|██▋       | 99181/371472 [7:53:15<21:32:21,  3.51it/s]
 27%|██▋       | 99182/371472 [7:53:15<22:13:16,  3.40it/s]
 27%|██▋       | 99183/371472 [7:53:15<21:30:52,  3.52it/s]
 27%|██▋       | 99184/371472 [7:53:16<21:45:59,  3.47it/s]
 27%|██▋       | 99185/371472 [7:53:16<21:10:43,  3.57it/s]
 27%|██▋       | 99186/371472 [7:53:16<21:32:49,  3.51it/s]
 27%|██▋       | 99187/371472 [7:53:16<21:03:33,  3.59it/s]
 27%|██▋       | 99188/371472 [7:53:17<20:36:48,  3.67it/s]
 27%|██▋       | 99189/371472 [7:53:17<20:04:32,  3.77it/s]
 27%|██▋       | 99190/371472 [7:53:17<20:23:21,  3.71it/s]
 27%|██▋       | 99191/371472 [7:53:18<22:41:50,  3.33it/s]
 27%|██▋       | 99192/371472 [7:53:18<21:55:02,  3.45it/s]
 27%|██▋       | 99193/371472 [7:53:18<21:25:15,  3.53it/s]
 27%|██▋       | 99194/371472 [7:53:19<22:47:53,  3.32it/s]
 27%|██▋       | 99195/371472 [7:53:19<23:06:07,  3.27it/s]
 27%|██▋       | 99196/371472 [7:53:19<21:53:08,  3.46it/s]
 27%|██▋       | 99197/371472 [7:53:19<21:55:43,  3.45it/s]
 27%|██▋       | 99198/371472 [7:53:20<22:48:46,  3.32it/s]
 27%|██▋       | 99199/371472 [7:53:20<22:56:17,  3.30it/s]
 27%|██▋       | 99200/371472 [7:53:20<23:57:24,  3.16it/s]
                                                           
{'loss': 3.7139, 'learning_rate': 7.600142213794738e-07, 'epoch': 4.27}

 27%|██▋       | 99200/371472 [7:53:20<23:57:24,  3.16it/s]
 27%|██▋       | 99201/371472 [7:53:21<22:46:30,  3.32it/s]
 27%|██▋       | 99202/371472 [7:53:21<22:06:58,  3.42it/s]
 27%|██▋       | 99203/371472 [7:53:21<21:58:24,  3.44it/s]
 27%|██▋       | 99204/371472 [7:53:21<22:15:34,  3.40it/s]
 27%|██▋       | 99205/371472 [7:53:22<22:08:46,  3.42it/s]
 27%|██▋       | 99206/371472 [7:53:22<20:47:35,  3.64it/s]
 27%|██▋       | 99207/371472 [7:53:22<20:21:04,  3.72it/s]
 27%|██▋       | 99208/371472 [7:53:23<20:11:52,  3.74it/s]
 27%|██▋       | 99209/371472 [7:53:23<21:29:30,  3.52it/s]
 27%|██▋       | 99210/371472 [7:53:23<20:30:49,  3.69it/s]
 27%|██▋       | 99211/371472 [7:53:23<20:29:05,  3.69it/s]
 27%|██▋       | 99212/371472 [7:53:24<21:01:56,  3.60it/s]
 27%|██▋       | 99213/371472 [7:53:24<20:22:24,  3.71it/s]
 27%|██▋       | 99214/371472 [7:53:24<20:52:47,  3.62it/s]
 27%|██▋       | 99215/371472 [7:53:24<20:43:22,  3.65it/s]
 27%|██▋       | 99216/371472 [7:53:25<21:13:49,  3.56it/s]
 27%|██▋       | 99217/371472 [7:53:25<21:36:43,  3.50it/s]
 27%|██▋       | 99218/371472 [7:53:25<21:07:49,  3.58it/s]
 27%|██▋       | 99219/371472 [7:53:26<20:51:20,  3.63it/s]
 27%|██▋       | 99220/371472 [7:53:26<21:11:03,  3.57it/s]
                                                           
{'loss': 3.6204, 'learning_rate': 7.599657394039948e-07, 'epoch': 4.27}

 27%|██▋       | 99220/371472 [7:53:26<21:11:03,  3.57it/s]
 27%|██▋       | 99221/371472 [7:53:26<20:39:30,  3.66it/s]
 27%|██▋       | 99222/371472 [7:53:26<20:57:31,  3.61it/s]
 27%|██▋       | 99223/371472 [7:53:27<21:18:51,  3.55it/s]
 27%|██▋       | 99224/371472 [7:53:27<23:26:23,  3.23it/s]
 27%|██▋       | 99225/371472 [7:53:27<22:40:18,  3.34it/s]
 27%|██▋       | 99226/371472 [7:53:28<21:45:20,  3.48it/s]
 27%|██▋       | 99227/371472 [7:53:28<22:34:36,  3.35it/s]
 27%|██▋       | 99228/371472 [7:53:28<22:15:09,  3.40it/s]
 27%|██▋       | 99229/371472 [7:53:29<21:46:00,  3.47it/s]
 27%|██▋       | 99230/371472 [7:53:29<23:11:23,  3.26it/s]
 27%|██▋       | 99231/371472 [7:53:29<23:13:18,  3.26it/s]
 27%|██▋       | 99232/371472 [7:53:29<22:00:19,  3.44it/s]
 27%|██▋       | 99233/371472 [7:53:30<21:21:51,  3.54it/s]
 27%|██▋       | 99234/371472 [7:53:30<21:20:09,  3.54it/s]
 27%|██▋       | 99235/371472 [7:53:30<20:33:19,  3.68it/s]
 27%|██▋       | 99236/371472 [7:53:31<21:28:34,  3.52it/s]
 27%|██▋       | 99237/371472 [7:53:31<21:21:18,  3.54it/s]
 27%|██▋       | 99238/371472 [7:53:31<22:24:11,  3.38it/s]
 27%|██▋       | 99239/371472 [7:53:31<22:17:50,  3.39it/s]
 27%|██▋       | 99240/371472 [7:53:32<22:28:31,  3.36it/s]
                                                           
{'loss': 3.5158, 'learning_rate': 7.59917257428516e-07, 'epoch': 4.27}

 27%|██▋       | 99240/371472 [7:53:32<22:28:31,  3.36it/s]
 27%|██▋       | 99241/371472 [7:53:32<21:39:34,  3.49it/s]
 27%|██▋       | 99242/371472 [7:53:32<21:58:01,  3.44it/s]
 27%|██▋       | 99243/371472 [7:53:33<22:27:19,  3.37it/s]
 27%|██▋       | 99244/371472 [7:53:33<21:18:21,  3.55it/s]
 27%|██▋       | 99245/371472 [7:53:33<22:46:38,  3.32it/s]
 27%|██▋       | 99246/371472 [7:53:34<22:51:39,  3.31it/s]
 27%|██▋       | 99247/371472 [7:53:34<22:44:51,  3.32it/s]
 27%|██▋       | 99248/371472 [7:53:34<23:16:01,  3.25it/s]
 27%|██▋       | 99249/371472 [7:53:34<22:25:59,  3.37it/s]
 27%|██▋       | 99250/371472 [7:53:35<21:46:23,  3.47it/s]
 27%|██▋       | 99251/371472 [7:53:35<21:20:15,  3.54it/s]
 27%|██▋       | 99252/371472 [7:53:35<21:25:21,  3.53it/s]
 27%|██▋       | 99253/371472 [7:53:35<21:11:42,  3.57it/s]
 27%|██▋       | 99254/371472 [7:53:36<20:49:39,  3.63it/s]
 27%|██▋       | 99255/371472 [7:53:36<21:37:33,  3.50it/s]
 27%|██▋       | 99256/371472 [7:53:36<21:15:15,  3.56it/s]
 27%|██▋       | 99257/371472 [7:53:37<21:13:30,  3.56it/s]
 27%|██▋       | 99258/371472 [7:53:37<21:30:53,  3.51it/s]
 27%|██▋       | 99259/371472 [7:53:37<21:55:12,  3.45it/s]
 27%|██▋       | 99260/371472 [7:53:37<21:42:22,  3.48it/s]
                                                           
{'loss': 3.6156, 'learning_rate': 7.598687754530371e-07, 'epoch': 4.28}

 27%|██▋       | 99260/371472 [7:53:38<21:42:22,  3.48it/s]
 27%|██▋       | 99261/371472 [7:53:38<21:07:52,  3.58it/s]
 27%|██▋       | 99262/371472 [7:53:38<20:12:04,  3.74it/s]
 27%|██▋       | 99263/371472 [7:53:38<21:09:46,  3.57it/s]
 27%|██▋       | 99264/371472 [7:53:39<24:36:05,  3.07it/s]
 27%|██▋       | 99265/371472 [7:53:39<23:46:12,  3.18it/s]
 27%|██▋       | 99266/371472 [7:53:39<22:52:34,  3.31it/s]
 27%|██▋       | 99267/371472 [7:53:40<21:35:17,  3.50it/s]
 27%|██▋       | 99268/371472 [7:53:40<21:54:42,  3.45it/s]
 27%|██▋       | 99269/371472 [7:53:40<21:35:18,  3.50it/s]
 27%|██▋       | 99270/371472 [7:53:40<21:08:31,  3.58it/s]
 27%|██▋       | 99271/371472 [7:53:41<21:01:57,  3.59it/s]
 27%|██▋       | 99272/371472 [7:53:41<21:13:41,  3.56it/s]
 27%|██▋       | 99273/371472 [7:53:41<21:10:54,  3.57it/s]
 27%|██▋       | 99274/371472 [7:53:42<21:27:11,  3.52it/s]
 27%|██▋       | 99275/371472 [7:53:42<21:51:11,  3.46it/s]
 27%|██▋       | 99276/371472 [7:53:42<22:57:50,  3.29it/s]
 27%|██▋       | 99277/371472 [7:53:43<23:48:27,  3.18it/s]
 27%|██▋       | 99278/371472 [7:53:43<23:04:42,  3.28it/s]
 27%|██▋       | 99279/371472 [7:53:43<23:29:23,  3.22it/s]
 27%|██▋       | 99280/371472 [7:53:43<22:45:18,  3.32it/s]
                                                           
{'loss': 3.7032, 'learning_rate': 7.598202934775582e-07, 'epoch': 4.28}

 27%|██▋       | 99280/371472 [7:53:43<22:45:18,  3.32it/s]
 27%|██▋       | 99281/371472 [7:53:44<22:28:18,  3.36it/s]
 27%|██▋       | 99282/371472 [7:53:44<22:07:27,  3.42it/s]
 27%|██▋       | 99283/371472 [7:53:44<24:47:16,  3.05it/s]
 27%|██▋       | 99284/371472 [7:53:45<26:02:45,  2.90it/s]
 27%|██▋       | 99285/371472 [7:53:45<23:52:54,  3.17it/s]
 27%|██▋       | 99286/371472 [7:53:45<24:20:07,  3.11it/s]
 27%|██▋       | 99287/371472 [7:53:46<23:17:36,  3.25it/s]
 27%|██▋       | 99288/371472 [7:53:46<22:08:31,  3.41it/s]
 27%|██▋       | 99289/371472 [7:53:46<22:19:57,  3.39it/s]
 27%|██▋       | 99290/371472 [7:53:46<21:36:52,  3.50it/s]
 27%|██▋       | 99291/371472 [7:53:47<21:20:32,  3.54it/s]
 27%|██▋       | 99292/371472 [7:53:47<20:54:53,  3.61it/s]
 27%|██▋       | 99293/371472 [7:53:47<20:20:41,  3.72it/s]
 27%|██▋       | 99294/371472 [7:53:48<21:28:58,  3.52it/s]
 27%|██▋       | 99295/371472 [7:53:48<21:59:38,  3.44it/s]
 27%|██▋       | 99296/371472 [7:53:48<21:54:06,  3.45it/s]
 27%|██▋       | 99297/371472 [7:53:48<21:28:12,  3.52it/s]
 27%|██▋       | 99298/371472 [7:53:49<21:09:14,  3.57it/s]
 27%|██▋       | 99299/371472 [7:53:49<22:43:17,  3.33it/s]
 27%|██▋       | 99300/371472 [7:53:49<24:13:23,  3.12it/s]
                                                           
{'loss': 3.575, 'learning_rate': 7.597718115020792e-07, 'epoch': 4.28}

 27%|██▋       | 99300/371472 [7:53:49<24:13:23,  3.12it/s]
 27%|██▋       | 99301/371472 [7:53:50<23:32:05,  3.21it/s]
 27%|██▋       | 99302/371472 [7:53:50<22:40:12,  3.33it/s]
 27%|██▋       | 99303/371472 [7:53:50<22:33:16,  3.35it/s]
 27%|██▋       | 99304/371472 [7:53:51<21:35:10,  3.50it/s]
 27%|██▋       | 99305/371472 [7:53:51<21:28:35,  3.52it/s]
 27%|██▋       | 99306/371472 [7:53:51<20:38:25,  3.66it/s]
 27%|██▋       | 99307/371472 [7:53:51<20:29:27,  3.69it/s]
 27%|██▋       | 99308/371472 [7:53:52<20:37:52,  3.66it/s]
 27%|██▋       | 99309/371472 [7:53:52<20:10:33,  3.75it/s]
 27%|██▋       | 99310/371472 [7:53:52<22:43:21,  3.33it/s]
 27%|██▋       | 99311/371472 [7:53:52<22:27:14,  3.37it/s]
 27%|██▋       | 99312/371472 [7:53:53<21:56:09,  3.45it/s]
 27%|██▋       | 99313/371472 [7:53:53<22:07:27,  3.42it/s]
 27%|██▋       | 99314/371472 [7:53:53<21:19:50,  3.54it/s]
 27%|██▋       | 99315/371472 [7:53:54<20:32:22,  3.68it/s]
 27%|██▋       | 99316/371472 [7:53:54<20:31:08,  3.68it/s]
 27%|██▋       | 99317/371472 [7:53:54<20:23:21,  3.71it/s]
 27%|██▋       | 99318/371472 [7:53:54<20:26:05,  3.70it/s]
 27%|██▋       | 99319/371472 [7:53:55<21:23:30,  3.53it/s]
 27%|██▋       | 99320/371472 [7:53:55<21:54:59,  3.45it/s]
                                                           
{'loss': 3.4864, 'learning_rate': 7.597233295266004e-07, 'epoch': 4.28}

 27%|██▋       | 99320/371472 [7:53:55<21:54:59,  3.45it/s]
 27%|██▋       | 99321/371472 [7:53:55<21:50:56,  3.46it/s]
 27%|██▋       | 99322/371472 [7:53:56<20:34:03,  3.68it/s]
 27%|██▋       | 99323/371472 [7:53:56<20:16:16,  3.73it/s]
 27%|██▋       | 99324/371472 [7:53:56<20:13:17,  3.74it/s]
 27%|██▋       | 99325/371472 [7:53:56<21:31:19,  3.51it/s]
 27%|██▋       | 99326/371472 [7:53:57<20:59:25,  3.60it/s]
 27%|██▋       | 99327/371472 [7:53:57<20:43:45,  3.65it/s]
 27%|██▋       | 99328/371472 [7:53:57<21:34:32,  3.50it/s]
 27%|██▋       | 99329/371472 [7:53:57<21:37:10,  3.50it/s]
 27%|██▋       | 99330/371472 [7:53:58<21:27:51,  3.52it/s]
 27%|██▋       | 99331/371472 [7:53:58<21:05:04,  3.59it/s]
 27%|██▋       | 99332/371472 [7:53:58<21:02:34,  3.59it/s]
 27%|██▋       | 99333/371472 [7:53:59<20:08:09,  3.75it/s]
 27%|██▋       | 99334/371472 [7:53:59<19:58:13,  3.79it/s]
 27%|██▋       | 99335/371472 [7:53:59<19:49:35,  3.81it/s]
 27%|██▋       | 99336/371472 [7:53:59<20:18:36,  3.72it/s]
 27%|██▋       | 99337/371472 [7:54:00<21:00:16,  3.60it/s]
 27%|██▋       | 99338/371472 [7:54:00<21:41:08,  3.49it/s]
 27%|██▋       | 99339/371472 [7:54:00<22:18:44,  3.39it/s]
 27%|██▋       | 99340/371472 [7:54:01<22:09:39,  3.41it/s]
                                                           
{'loss': 3.4801, 'learning_rate': 7.596748475511216e-07, 'epoch': 4.28}

 27%|██▋       | 99340/371472 [7:54:01<22:09:39,  3.41it/s]
 27%|██▋       | 99341/371472 [7:54:01<21:22:01,  3.54it/s]
 27%|██▋       | 99342/371472 [7:54:01<21:00:33,  3.60it/s]
 27%|██▋       | 99343/371472 [7:54:01<20:59:57,  3.60it/s]
 27%|██▋       | 99344/371472 [7:54:02<21:31:37,  3.51it/s]
 27%|██▋       | 99345/371472 [7:54:02<23:52:22,  3.17it/s]
 27%|██▋       | 99346/371472 [7:54:02<22:53:25,  3.30it/s]
 27%|██▋       | 99347/371472 [7:54:03<21:56:03,  3.45it/s]
 27%|██▋       | 99348/371472 [7:54:03<21:03:59,  3.59it/s]
 27%|██▋       | 99349/371472 [7:54:03<20:41:40,  3.65it/s]
 27%|██▋       | 99350/371472 [7:54:03<20:30:25,  3.69it/s]
 27%|██▋       | 99351/371472 [7:54:04<20:28:52,  3.69it/s]
 27%|██▋       | 99352/371472 [7:54:04<21:36:20,  3.50it/s]
 27%|██▋       | 99353/371472 [7:54:04<21:40:25,  3.49it/s]
 27%|██▋       | 99354/371472 [7:54:05<21:25:27,  3.53it/s]
 27%|██▋       | 99355/371472 [7:54:05<21:42:32,  3.48it/s]
 27%|██▋       | 99356/371472 [7:54:05<21:09:53,  3.57it/s]
 27%|██▋       | 99357/371472 [7:54:05<20:47:41,  3.63it/s]
 27%|██▋       | 99358/371472 [7:54:06<20:56:23,  3.61it/s]
 27%|██▋       | 99359/371472 [7:54:06<20:37:53,  3.66it/s]
 27%|██▋       | 99360/371472 [7:54:06<21:07:25,  3.58it/s]
                                                           
{'loss': 3.5849, 'learning_rate': 7.596263655756427e-07, 'epoch': 4.28}

 27%|██▋       | 99360/371472 [7:54:06<21:07:25,  3.58it/s]
 27%|██▋       | 99361/371472 [7:54:06<20:59:49,  3.60it/s]
 27%|██▋       | 99362/371472 [7:54:07<20:47:50,  3.63it/s]
 27%|██▋       | 99363/371472 [7:54:07<20:26:21,  3.70it/s]
 27%|██▋       | 99364/371472 [7:54:07<20:20:17,  3.72it/s]
 27%|██▋       | 99365/371472 [7:54:08<20:03:14,  3.77it/s]
 27%|██▋       | 99366/371472 [7:54:08<19:41:06,  3.84it/s]
 27%|██▋       | 99367/371472 [7:54:08<21:19:47,  3.54it/s]
 27%|██▋       | 99368/371472 [7:54:08<21:51:32,  3.46it/s]
 27%|██▋       | 99369/371472 [7:54:09<21:37:29,  3.50it/s]
 27%|██▋       | 99370/371472 [7:54:09<20:59:26,  3.60it/s]
 27%|██▋       | 99371/371472 [7:54:09<21:30:21,  3.51it/s]
 27%|██▋       | 99372/371472 [7:54:10<21:41:41,  3.48it/s]
 27%|██▋       | 99373/371472 [7:54:10<20:57:52,  3.61it/s]
 27%|██▋       | 99374/371472 [7:54:10<20:23:14,  3.71it/s]
 27%|██▋       | 99375/371472 [7:54:10<20:44:21,  3.64it/s]
 27%|██▋       | 99376/371472 [7:54:11<21:00:44,  3.60it/s]
 27%|██▋       | 99377/371472 [7:54:11<22:20:43,  3.38it/s]
 27%|██▋       | 99378/371472 [7:54:11<21:31:16,  3.51it/s]
 27%|██▋       | 99379/371472 [7:54:11<20:58:40,  3.60it/s]
 27%|██▋       | 99380/371472 [7:54:12<21:56:08,  3.45it/s]
                                                           
{'loss': 3.6636, 'learning_rate': 7.595778836001636e-07, 'epoch': 4.28}

 27%|██▋       | 99380/371472 [7:54:12<21:56:08,  3.45it/s]
 27%|██▋       | 99381/371472 [7:54:12<22:30:22,  3.36it/s]
 27%|██▋       | 99382/371472 [7:54:12<22:11:42,  3.41it/s]
 27%|██▋       | 99383/371472 [7:54:13<21:41:05,  3.49it/s]
 27%|██▋       | 99384/371472 [7:54:13<20:57:56,  3.60it/s]
 27%|██▋       | 99385/371472 [7:54:13<20:35:24,  3.67it/s]
 27%|██▋       | 99386/371472 [7:54:13<20:38:43,  3.66it/s]
 27%|██▋       | 99387/371472 [7:54:14<20:28:58,  3.69it/s]
 27%|██▋       | 99388/371472 [7:54:14<22:12:37,  3.40it/s]
 27%|██▋       | 99389/371472 [7:54:14<22:10:45,  3.41it/s]
 27%|██▋       | 99390/371472 [7:54:15<21:00:40,  3.60it/s]
 27%|██▋       | 99391/371472 [7:54:15<21:41:09,  3.49it/s]
 27%|██▋       | 99392/371472 [7:54:15<21:25:29,  3.53it/s]
 27%|██▋       | 99393/371472 [7:54:15<21:31:43,  3.51it/s]
 27%|██▋       | 99394/371472 [7:54:16<23:22:18,  3.23it/s]
 27%|██▋       | 99395/371472 [7:54:16<24:24:30,  3.10it/s]
 27%|██▋       | 99396/371472 [7:54:16<23:24:00,  3.23it/s]
 27%|██▋       | 99397/371472 [7:54:17<22:16:11,  3.39it/s]
 27%|██▋       | 99398/371472 [7:54:17<21:17:59,  3.55it/s]
 27%|██▋       | 99399/371472 [7:54:17<22:01:47,  3.43it/s]
 27%|██▋       | 99400/371472 [7:54:18<21:46:41,  3.47it/s]
                                                           
{'loss': 3.5957, 'learning_rate': 7.595294016246848e-07, 'epoch': 4.28}

 27%|██▋       | 99400/371472 [7:54:18<21:46:41,  3.47it/s]
 27%|██▋       | 99401/371472 [7:54:18<21:08:35,  3.57it/s]
 27%|██▋       | 99402/371472 [7:54:18<22:06:15,  3.42it/s]
 27%|██▋       | 99403/371472 [7:54:18<21:57:11,  3.44it/s]
 27%|██▋       | 99404/371472 [7:54:19<21:39:16,  3.49it/s]
 27%|██▋       | 99405/371472 [7:54:19<22:25:15,  3.37it/s]
 27%|██▋       | 99406/371472 [7:54:19<22:41:13,  3.33it/s]
 27%|██▋       | 99407/371472 [7:54:20<22:10:02,  3.41it/s]
 27%|██▋       | 99408/371472 [7:54:20<21:32:48,  3.51it/s]
 27%|██▋       | 99409/371472 [7:54:20<20:53:49,  3.62it/s]
 27%|██▋       | 99410/371472 [7:54:20<21:20:18,  3.54it/s]
 27%|██▋       | 99411/371472 [7:54:21<22:49:19,  3.31it/s]
 27%|██▋       | 99412/371472 [7:54:21<21:45:15,  3.47it/s]
 27%|██▋       | 99413/371472 [7:54:21<22:23:34,  3.37it/s]
 27%|██▋       | 99414/371472 [7:54:22<22:21:37,  3.38it/s]
 27%|██▋       | 99415/371472 [7:54:22<23:43:27,  3.19it/s]
 27%|██▋       | 99416/371472 [7:54:22<22:22:07,  3.38it/s]
 27%|██▋       | 99417/371472 [7:54:23<22:11:16,  3.41it/s]
 27%|██▋       | 99418/371472 [7:54:23<21:48:41,  3.46it/s]
 27%|██▋       | 99419/371472 [7:54:23<22:20:15,  3.38it/s]
 27%|██▋       | 99420/371472 [7:54:23<22:22:52,  3.38it/s]
                                                           
{'loss': 3.7073, 'learning_rate': 7.59480919649206e-07, 'epoch': 4.28}

 27%|██▋       | 99420/371472 [7:54:23<22:22:52,  3.38it/s]
 27%|██▋       | 99421/371472 [7:54:24<22:23:02,  3.38it/s]
 27%|██▋       | 99422/371472 [7:54:24<21:45:05,  3.47it/s]
 27%|██▋       | 99423/371472 [7:54:24<21:02:11,  3.59it/s]
 27%|██▋       | 99424/371472 [7:54:25<21:21:08,  3.54it/s]
 27%|██▋       | 99425/371472 [7:54:25<21:04:55,  3.58it/s]
 27%|██▋       | 99426/371472 [7:54:25<22:25:14,  3.37it/s]
 27%|██▋       | 99427/371472 [7:54:25<21:17:52,  3.55it/s]
 27%|██▋       | 99428/371472 [7:54:26<22:25:56,  3.37it/s]
 27%|██▋       | 99429/371472 [7:54:26<21:55:39,  3.45it/s]
 27%|██▋       | 99430/371472 [7:54:26<22:12:33,  3.40it/s]
 27%|██▋       | 99431/371472 [7:54:27<21:55:38,  3.45it/s]
 27%|██▋       | 99432/371472 [7:54:27<21:23:01,  3.53it/s]
 27%|██▋       | 99433/371472 [7:54:27<22:10:09,  3.41it/s]
 27%|██▋       | 99434/371472 [7:54:27<21:40:12,  3.49it/s]
 27%|██▋       | 99435/371472 [7:54:28<22:01:50,  3.43it/s]
 27%|██▋       | 99436/371472 [7:54:28<22:01:32,  3.43it/s]
 27%|██▋       | 99437/371472 [7:54:28<22:53:50,  3.30it/s]
 27%|██▋       | 99438/371472 [7:54:29<21:55:52,  3.45it/s]
 27%|██▋       | 99439/371472 [7:54:29<22:18:22,  3.39it/s]
 27%|██▋       | 99440/371472 [7:54:29<21:11:13,  3.57it/s]
                                                           
{'loss': 3.4552, 'learning_rate': 7.594324376737271e-07, 'epoch': 4.28}

 27%|██▋       | 99440/371472 [7:54:29<21:11:13,  3.57it/s]
 27%|██▋       | 99441/371472 [7:54:29<21:02:43,  3.59it/s]
 27%|██▋       | 99442/371472 [7:54:30<20:05:46,  3.76it/s]
 27%|██▋       | 99443/371472 [7:54:30<21:00:41,  3.60it/s]
 27%|██▋       | 99444/371472 [7:54:30<21:13:33,  3.56it/s]
 27%|██▋       | 99445/371472 [7:54:31<20:43:06,  3.65it/s]
 27%|██▋       | 99446/371472 [7:54:31<20:09:17,  3.75it/s]
 27%|██▋       | 99447/371472 [7:54:31<19:50:28,  3.81it/s]
 27%|██▋       | 99448/371472 [7:54:31<20:07:12,  3.76it/s]
 27%|██▋       | 99449/371472 [7:54:32<19:35:57,  3.86it/s]
 27%|██▋       | 99450/371472 [7:54:32<20:43:41,  3.65it/s]
 27%|██▋       | 99451/371472 [7:54:32<20:17:18,  3.72it/s]
 27%|██▋       | 99452/371472 [7:54:32<20:26:11,  3.70it/s]
 27%|██▋       | 99453/371472 [7:54:33<20:32:07,  3.68it/s]
 27%|██▋       | 99454/371472 [7:54:33<20:39:38,  3.66it/s]
 27%|██▋       | 99455/371472 [7:54:33<20:41:19,  3.65it/s]
 27%|██▋       | 99456/371472 [7:54:33<20:02:28,  3.77it/s]
 27%|██▋       | 99457/371472 [7:54:34<22:10:22,  3.41it/s]
 27%|██▋       | 99458/371472 [7:54:34<21:44:42,  3.47it/s]
 27%|██▋       | 99459/371472 [7:54:34<20:51:13,  3.62it/s]
 27%|██▋       | 99460/371472 [7:54:35<21:17:16,  3.55it/s]
                                                           
{'loss': 3.6417, 'learning_rate': 7.593839556982481e-07, 'epoch': 4.28}

 27%|██▋       | 99460/371472 [7:54:35<21:17:16,  3.55it/s]
 27%|██▋       | 99461/371472 [7:54:35<20:56:00,  3.61it/s]
 27%|██▋       | 99462/371472 [7:54:35<20:45:51,  3.64it/s]
 27%|██▋       | 99463/371472 [7:54:35<21:01:37,  3.59it/s]
 27%|██▋       | 99464/371472 [7:54:36<21:02:01,  3.59it/s]
 27%|██▋       | 99465/371472 [7:54:36<21:02:48,  3.59it/s]
 27%|██▋       | 99466/371472 [7:54:36<20:49:26,  3.63it/s]
 27%|██▋       | 99467/371472 [7:54:37<20:23:40,  3.70it/s]
 27%|██▋       | 99468/371472 [7:54:37<21:13:44,  3.56it/s]
 27%|██▋       | 99469/371472 [7:54:37<22:42:40,  3.33it/s]
 27%|██▋       | 99470/371472 [7:54:38<24:29:31,  3.08it/s]
 27%|██▋       | 99471/371472 [7:54:38<23:24:18,  3.23it/s]
 27%|██▋       | 99472/371472 [7:54:38<22:16:49,  3.39it/s]
 27%|██▋       | 99473/371472 [7:54:38<22:06:41,  3.42it/s]
 27%|██▋       | 99474/371472 [7:54:39<20:53:37,  3.62it/s]
 27%|██▋       | 99475/371472 [7:54:39<20:37:29,  3.66it/s]
 27%|██▋       | 99476/371472 [7:54:39<20:23:27,  3.71it/s]
 27%|██▋       | 99477/371472 [7:54:40<22:19:19,  3.38it/s]
 27%|██▋       | 99478/371472 [7:54:40<21:46:27,  3.47it/s]
 27%|██▋       | 99479/371472 [7:54:40<21:18:46,  3.54it/s]
 27%|██▋       | 99480/371472 [7:54:40<21:04:41,  3.58it/s]
                                                           
{'loss': 3.5259, 'learning_rate': 7.593354737227693e-07, 'epoch': 4.28}

 27%|██▋       | 99480/371472 [7:54:40<21:04:41,  3.58it/s]
 27%|██▋       | 99481/371472 [7:54:41<20:58:39,  3.60it/s]
 27%|██▋       | 99482/371472 [7:54:41<20:47:00,  3.64it/s]
 27%|██▋       | 99483/371472 [7:54:41<21:30:45,  3.51it/s]
 27%|██▋       | 99484/371472 [7:54:41<20:29:05,  3.69it/s]
 27%|██▋       | 99485/371472 [7:54:42<22:16:34,  3.39it/s]
 27%|██▋       | 99486/371472 [7:54:42<21:50:42,  3.46it/s]
 27%|██▋       | 99487/371472 [7:54:42<21:45:09,  3.47it/s]
 27%|██▋       | 99488/371472 [7:54:43<21:56:55,  3.44it/s]
 27%|██▋       | 99489/371472 [7:54:43<21:28:34,  3.52it/s]
 27%|██▋       | 99490/371472 [7:54:43<20:49:41,  3.63it/s]
 27%|██▋       | 99491/371472 [7:54:43<20:29:33,  3.69it/s]
 27%|██▋       | 99492/371472 [7:54:44<21:12:54,  3.56it/s]
 27%|██▋       | 99493/371472 [7:54:44<21:06:43,  3.58it/s]
 27%|██▋       | 99494/371472 [7:54:44<20:51:24,  3.62it/s]
 27%|██▋       | 99495/371472 [7:54:45<20:46:18,  3.64it/s]
 27%|██▋       | 99496/371472 [7:54:45<20:47:15,  3.63it/s]
 27%|██▋       | 99497/371472 [7:54:45<20:41:38,  3.65it/s]
 27%|██▋       | 99498/371472 [7:54:45<20:11:05,  3.74it/s]
 27%|██▋       | 99499/371472 [7:54:46<20:54:45,  3.61it/s]
 27%|██▋       | 99500/371472 [7:54:46<20:19:18,  3.72it/s]
                                                           
{'loss': 3.7289, 'learning_rate': 7.592869917472904e-07, 'epoch': 4.29}

 27%|██▋       | 99500/371472 [7:54:46<20:19:18,  3.72it/s]
 27%|██▋       | 99501/371472 [7:54:46<20:22:00,  3.71it/s]
 27%|██▋       | 99502/371472 [7:54:46<21:06:48,  3.58it/s]
 27%|██▋       | 99503/371472 [7:54:47<21:40:23,  3.49it/s]
 27%|██▋       | 99504/371472 [7:54:47<22:24:34,  3.37it/s]
 27%|██▋       | 99505/371472 [7:54:47<22:10:17,  3.41it/s]
 27%|██▋       | 99506/371472 [7:54:48<21:28:15,  3.52it/s]
 27%|██▋       | 99507/371472 [7:54:48<21:27:08,  3.52it/s]
 27%|██▋       | 99508/371472 [7:54:48<21:31:27,  3.51it/s]
 27%|██▋       | 99509/371472 [7:54:49<22:22:09,  3.38it/s]
 27%|██▋       | 99510/371472 [7:54:49<22:20:12,  3.38it/s]
 27%|██▋       | 99511/371472 [7:54:49<21:57:35,  3.44it/s]
 27%|██▋       | 99512/371472 [7:54:49<21:36:22,  3.50it/s]
 27%|██▋       | 99513/371472 [7:54:50<22:44:18,  3.32it/s]
 27%|██▋       | 99514/371472 [7:54:50<21:51:15,  3.46it/s]
 27%|██▋       | 99515/371472 [7:54:50<21:07:51,  3.58it/s]
 27%|██▋       | 99516/371472 [7:54:51<21:18:39,  3.54it/s]
 27%|██▋       | 99517/371472 [7:54:51<21:02:02,  3.59it/s]
 27%|██▋       | 99518/371472 [7:54:51<21:17:30,  3.55it/s]
 27%|██▋       | 99519/371472 [7:54:51<21:55:54,  3.44it/s]
 27%|██▋       | 99520/371472 [7:54:52<21:25:11,  3.53it/s]
                                                           
{'loss': 3.606, 'learning_rate': 7.592385097718115e-07, 'epoch': 4.29}

 27%|██▋       | 99520/371472 [7:54:52<21:25:11,  3.53it/s]
 27%|██▋       | 99521/371472 [7:54:52<21:28:44,  3.52it/s]
 27%|██▋       | 99522/371472 [7:54:52<26:23:53,  2.86it/s]
 27%|██▋       | 99523/371472 [7:54:53<26:39:32,  2.83it/s]
 27%|██▋       | 99524/371472 [7:54:53<25:44:17,  2.93it/s]
 27%|██▋       | 99525/371472 [7:54:53<24:26:38,  3.09it/s]
 27%|██▋       | 99526/371472 [7:54:54<23:34:12,  3.20it/s]
 27%|██▋       | 99527/371472 [7:54:54<23:09:55,  3.26it/s]
 27%|██▋       | 99528/371472 [7:54:54<22:17:54,  3.39it/s]
 27%|██▋       | 99529/371472 [7:54:55<23:55:19,  3.16it/s]
 27%|██▋       | 99530/371472 [7:54:55<22:48:05,  3.31it/s]
 27%|██▋       | 99531/371472 [7:54:55<22:02:43,  3.43it/s]
 27%|██▋       | 99532/371472 [7:54:56<23:22:05,  3.23it/s]
 27%|██▋       | 99533/371472 [7:54:56<21:50:23,  3.46it/s]
 27%|██▋       | 99534/371472 [7:54:56<21:22:12,  3.53it/s]
 27%|██▋       | 99535/371472 [7:54:56<21:43:29,  3.48it/s]
 27%|██▋       | 99536/371472 [7:54:57<21:38:43,  3.49it/s]
 27%|██▋       | 99537/371472 [7:54:57<21:20:56,  3.54it/s]
 27%|██▋       | 99538/371472 [7:54:57<22:37:57,  3.34it/s]
 27%|██▋       | 99539/371472 [7:54:58<22:40:22,  3.33it/s]
 27%|██▋       | 99540/371472 [7:54:58<21:37:35,  3.49it/s]
                                                           
{'loss': 3.6425, 'learning_rate': 7.591900277963325e-07, 'epoch': 4.29}

 27%|██▋       | 99540/371472 [7:54:58<21:37:35,  3.49it/s]
 27%|██▋       | 99541/371472 [7:54:58<21:41:19,  3.48it/s]
 27%|██▋       | 99542/371472 [7:54:58<22:01:43,  3.43it/s]
 27%|██▋       | 99543/371472 [7:54:59<22:12:47,  3.40it/s]
 27%|██▋       | 99544/371472 [7:54:59<21:21:47,  3.54it/s]
 27%|██▋       | 99545/371472 [7:54:59<20:32:14,  3.68it/s]
 27%|██▋       | 99546/371472 [7:54:59<21:12:07,  3.56it/s]
 27%|██▋       | 99547/371472 [7:55:00<21:37:30,  3.49it/s]
 27%|██▋       | 99548/371472 [7:55:00<20:58:21,  3.60it/s]
 27%|██▋       | 99549/371472 [7:55:00<21:10:33,  3.57it/s]
 27%|██▋       | 99550/371472 [7:55:01<21:58:27,  3.44it/s]
 27%|██▋       | 99551/371472 [7:55:01<21:34:47,  3.50it/s]
 27%|██▋       | 99552/371472 [7:55:01<21:22:48,  3.53it/s]
 27%|██▋       | 99553/371472 [7:55:01<20:42:06,  3.65it/s]
 27%|██▋       | 99554/371472 [7:55:02<20:53:16,  3.62it/s]
 27%|██▋       | 99555/371472 [7:55:02<21:07:07,  3.58it/s]
 27%|██▋       | 99556/371472 [7:55:02<20:22:56,  3.71it/s]
 27%|██▋       | 99557/371472 [7:55:03<20:29:35,  3.69it/s]
 27%|██▋       | 99558/371472 [7:55:03<19:57:40,  3.78it/s]
 27%|██▋       | 99559/371472 [7:55:03<19:31:55,  3.87it/s]
 27%|██▋       | 99560/371472 [7:55:03<19:44:01,  3.83it/s]
                                                           
{'loss': 3.6355, 'learning_rate': 7.591415458208537e-07, 'epoch': 4.29}

 27%|██▋       | 99560/371472 [7:55:03<19:44:01,  3.83it/s]
 27%|██▋       | 99561/371472 [7:55:04<19:14:31,  3.93it/s]
 27%|██▋       | 99562/371472 [7:55:04<19:25:28,  3.89it/s]
 27%|██▋       | 99563/371472 [7:55:04<20:15:01,  3.73it/s]
 27%|██▋       | 99564/371472 [7:55:04<21:11:27,  3.56it/s]
 27%|██▋       | 99565/371472 [7:55:05<20:31:09,  3.68it/s]
 27%|██▋       | 99566/371472 [7:55:05<20:56:45,  3.61it/s]
 27%|██▋       | 99567/371472 [7:55:05<20:28:58,  3.69it/s]
 27%|██▋       | 99568/371472 [7:55:06<21:15:00,  3.55it/s]
 27%|██▋       | 99569/371472 [7:55:06<21:38:11,  3.49it/s]
 27%|██▋       | 99570/371472 [7:55:06<22:16:17,  3.39it/s]
 27%|██▋       | 99571/371472 [7:55:06<21:03:15,  3.59it/s]
 27%|██▋       | 99572/371472 [7:55:07<20:21:08,  3.71it/s]
 27%|██▋       | 99573/371472 [7:55:07<20:32:11,  3.68it/s]
 27%|██▋       | 99574/371472 [7:55:07<22:06:05,  3.42it/s]
 27%|██▋       | 99575/371472 [7:55:08<22:08:52,  3.41it/s]
 27%|██▋       | 99576/371472 [7:55:08<23:06:02,  3.27it/s]
 27%|██▋       | 99577/371472 [7:55:08<22:33:59,  3.35it/s]
 27%|██▋       | 99578/371472 [7:55:08<21:55:38,  3.44it/s]
 27%|██▋       | 99579/371472 [7:55:09<21:37:41,  3.49it/s]
 27%|██▋       | 99580/371472 [7:55:09<21:55:59,  3.44it/s]
                                                           
{'loss': 3.527, 'learning_rate': 7.590930638453749e-07, 'epoch': 4.29}

 27%|██▋       | 99580/371472 [7:55:09<21:55:59,  3.44it/s]
 27%|██▋       | 99581/371472 [7:55:09<23:22:22,  3.23it/s]
 27%|██▋       | 99582/371472 [7:55:10<22:49:20,  3.31it/s]
 27%|██▋       | 99583/371472 [7:55:10<22:09:58,  3.41it/s]
 27%|██▋       | 99584/371472 [7:55:10<23:53:55,  3.16it/s]
 27%|██▋       | 99585/371472 [7:55:11<22:06:25,  3.42it/s]
 27%|██▋       | 99586/371472 [7:55:11<21:44:03,  3.47it/s]
 27%|██▋       | 99587/371472 [7:55:11<23:08:20,  3.26it/s]
 27%|██▋       | 99588/371472 [7:55:11<21:50:33,  3.46it/s]
 27%|██▋       | 99589/371472 [7:55:12<23:51:45,  3.16it/s]
 27%|██▋       | 99590/371472 [7:55:12<22:24:31,  3.37it/s]
 27%|██▋       | 99591/371472 [7:55:12<23:12:09,  3.25it/s]
 27%|██▋       | 99592/371472 [7:55:13<21:37:03,  3.49it/s]
 27%|██▋       | 99593/371472 [7:55:13<22:46:49,  3.32it/s]
 27%|██▋       | 99594/371472 [7:55:13<21:34:03,  3.50it/s]
 27%|██▋       | 99595/371472 [7:55:13<22:20:05,  3.38it/s]
 27%|██▋       | 99596/371472 [7:55:14<21:43:23,  3.48it/s]
 27%|██▋       | 99597/371472 [7:55:14<22:32:24,  3.35it/s]
 27%|██▋       | 99598/371472 [7:55:14<22:05:55,  3.42it/s]
 27%|██▋       | 99599/371472 [7:55:15<22:37:14,  3.34it/s]
 27%|██▋       | 99600/371472 [7:55:15<23:55:45,  3.16it/s]
                                                           
{'loss': 3.3932, 'learning_rate': 7.590445818698958e-07, 'epoch': 4.29}

 27%|██▋       | 99600/371472 [7:55:15<23:55:45,  3.16it/s]
 27%|██▋       | 99601/371472 [7:55:15<22:34:51,  3.34it/s]
 27%|██▋       | 99602/371472 [7:55:16<21:25:48,  3.52it/s]
 27%|██▋       | 99603/371472 [7:55:16<21:59:59,  3.43it/s]
 27%|██▋       | 99604/371472 [7:55:16<21:12:50,  3.56it/s]
 27%|██▋       | 99605/371472 [7:55:16<20:28:01,  3.69it/s]
 27%|██▋       | 99606/371472 [7:55:17<21:53:28,  3.45it/s]
 27%|██▋       | 99607/371472 [7:55:17<21:27:09,  3.52it/s]
 27%|██▋       | 99608/371472 [7:55:17<20:53:54,  3.61it/s]
 27%|██▋       | 99609/371472 [7:55:17<20:54:34,  3.61it/s]
 27%|██▋       | 99610/371472 [7:55:18<20:46:31,  3.63it/s]
 27%|██▋       | 99611/371472 [7:55:18<21:41:43,  3.48it/s]
 27%|██▋       | 99612/371472 [7:55:18<21:33:00,  3.50it/s]
 27%|██▋       | 99613/371472 [7:55:19<20:30:57,  3.68it/s]
 27%|██▋       | 99614/371472 [7:55:19<21:22:56,  3.53it/s]
 27%|██▋       | 99615/371472 [7:55:19<21:30:11,  3.51it/s]
 27%|██▋       | 99616/371472 [7:55:20<23:03:00,  3.28it/s]
 27%|██▋       | 99617/371472 [7:55:20<21:58:20,  3.44it/s]
 27%|██▋       | 99618/371472 [7:55:20<22:15:22,  3.39it/s]
 27%|██▋       | 99619/371472 [7:55:20<23:30:28,  3.21it/s]
 27%|██▋       | 99620/371472 [7:55:21<23:28:52,  3.22it/s]
                                                           
{'loss': 3.5408, 'learning_rate': 7.58996099894417e-07, 'epoch': 4.29}

 27%|██▋       | 99620/371472 [7:55:21<23:28:52,  3.22it/s]
 27%|██▋       | 99621/371472 [7:55:21<22:45:03,  3.32it/s]
 27%|██▋       | 99622/371472 [7:55:21<21:52:28,  3.45it/s]
 27%|██▋       | 99623/371472 [7:55:22<21:58:19,  3.44it/s]
 27%|██▋       | 99624/371472 [7:55:22<21:47:10,  3.47it/s]
 27%|██▋       | 99625/371472 [7:55:22<21:17:36,  3.55it/s]
 27%|██▋       | 99626/371472 [7:55:22<21:42:48,  3.48it/s]
 27%|██▋       | 99627/371472 [7:55:23<23:21:26,  3.23it/s]
 27%|██▋       | 99628/371472 [7:55:23<22:21:08,  3.38it/s]
 27%|██▋       | 99629/371472 [7:55:23<22:26:03,  3.37it/s]
 27%|██▋       | 99630/371472 [7:55:24<21:50:48,  3.46it/s]
 27%|██▋       | 99631/371472 [7:55:24<21:51:03,  3.46it/s]
 27%|██▋       | 99632/371472 [7:55:24<21:49:00,  3.46it/s]
 27%|██▋       | 99633/371472 [7:55:25<21:43:49,  3.47it/s]
 27%|██▋       | 99634/371472 [7:55:25<20:52:41,  3.62it/s]
 27%|██▋       | 99635/371472 [7:55:25<20:14:20,  3.73it/s]
 27%|██▋       | 99636/371472 [7:55:25<20:20:15,  3.71it/s]
 27%|██▋       | 99637/371472 [7:55:26<19:56:53,  3.79it/s]
 27%|██▋       | 99638/371472 [7:55:26<20:20:53,  3.71it/s]
 27%|██▋       | 99639/371472 [7:55:26<20:11:11,  3.74it/s]
 27%|██▋       | 99640/371472 [7:55:26<19:50:26,  3.81it/s]
                                                           
{'loss': 3.6079, 'learning_rate': 7.589476179189381e-07, 'epoch': 4.29}

 27%|██▋       | 99640/371472 [7:55:26<19:50:26,  3.81it/s]
 27%|██▋       | 99641/371472 [7:55:27<20:33:45,  3.67it/s]
 27%|██▋       | 99642/371472 [7:55:27<20:51:51,  3.62it/s]
 27%|██▋       | 99643/371472 [7:55:27<21:25:50,  3.52it/s]
 27%|██▋       | 99644/371472 [7:55:27<21:17:48,  3.55it/s]
 27%|██▋       | 99645/371472 [7:55:28<23:44:39,  3.18it/s]
 27%|██▋       | 99646/371472 [7:55:28<22:55:41,  3.29it/s]
 27%|██▋       | 99647/371472 [7:55:28<22:18:44,  3.38it/s]
 27%|██▋       | 99648/371472 [7:55:29<23:10:11,  3.26it/s]
 27%|██▋       | 99649/371472 [7:55:29<22:13:18,  3.40it/s]
 27%|██▋       | 99650/371472 [7:55:29<21:46:12,  3.47it/s]
 27%|██▋       | 99651/371472 [7:55:30<21:31:34,  3.51it/s]
 27%|██▋       | 99652/371472 [7:55:30<21:55:09,  3.44it/s]
 27%|██▋       | 99653/371472 [7:55:30<22:20:43,  3.38it/s]
 27%|██▋       | 99654/371472 [7:55:31<22:28:36,  3.36it/s]
 27%|██▋       | 99655/371472 [7:55:31<22:19:55,  3.38it/s]
 27%|██▋       | 99656/371472 [7:55:31<22:00:10,  3.43it/s]
 27%|██▋       | 99657/371472 [7:55:31<21:19:58,  3.54it/s]
 27%|██▋       | 99658/371472 [7:55:32<21:56:04,  3.44it/s]
 27%|██▋       | 99659/371472 [7:55:32<21:51:00,  3.46it/s]
 27%|██▋       | 99660/371472 [7:55:32<21:12:47,  3.56it/s]
                                                           
{'loss': 3.4367, 'learning_rate': 7.588991359434592e-07, 'epoch': 4.29}

 27%|██▋       | 99660/371472 [7:55:32<21:12:47,  3.56it/s]
 27%|██▋       | 99661/371472 [7:55:32<20:18:11,  3.72it/s]
 27%|██▋       | 99662/371472 [7:55:33<20:41:46,  3.65it/s]
 27%|██▋       | 99663/371472 [7:55:33<21:21:06,  3.54it/s]
 27%|██▋       | 99664/371472 [7:55:33<21:04:13,  3.58it/s]
 27%|██▋       | 99665/371472 [7:55:34<21:14:36,  3.55it/s]
 27%|██▋       | 99666/371472 [7:55:34<22:02:31,  3.43it/s]
 27%|██▋       | 99667/371472 [7:55:34<21:02:26,  3.59it/s]
 27%|██▋       | 99668/371472 [7:55:34<21:21:40,  3.53it/s]
 27%|██▋       | 99669/371472 [7:55:35<20:43:42,  3.64it/s]
 27%|██▋       | 99670/371472 [7:55:35<21:05:07,  3.58it/s]
 27%|██▋       | 99671/371472 [7:55:35<21:22:57,  3.53it/s]
 27%|██▋       | 99672/371472 [7:55:36<21:08:00,  3.57it/s]
 27%|██▋       | 99673/371472 [7:55:36<20:50:03,  3.62it/s]
 27%|██▋       | 99674/371472 [7:55:36<20:19:24,  3.71it/s]
 27%|██▋       | 99675/371472 [7:55:36<19:41:39,  3.83it/s]
 27%|██▋       | 99676/371472 [7:55:37<19:39:28,  3.84it/s]
 27%|██▋       | 99677/371472 [7:55:37<20:14:53,  3.73it/s]
 27%|██▋       | 99678/371472 [7:55:37<20:27:05,  3.69it/s]
 27%|██▋       | 99679/371472 [7:55:37<20:25:49,  3.70it/s]
 27%|██▋       | 99680/371472 [7:55:38<20:38:47,  3.66it/s]
                                                           
{'loss': 3.4824, 'learning_rate': 7.588506539679802e-07, 'epoch': 4.29}

 27%|██▋       | 99680/371472 [7:55:38<20:38:47,  3.66it/s]
 27%|██▋       | 99681/371472 [7:55:38<20:17:15,  3.72it/s]
 27%|██▋       | 99682/371472 [7:55:38<19:56:30,  3.79it/s]
 27%|██▋       | 99683/371472 [7:55:38<19:14:14,  3.92it/s]
 27%|██▋       | 99684/371472 [7:55:39<19:37:16,  3.85it/s]
 27%|██▋       | 99685/371472 [7:55:39<19:27:37,  3.88it/s]
 27%|██▋       | 99686/371472 [7:55:39<19:38:48,  3.84it/s]
 27%|██▋       | 99687/371472 [7:55:39<19:05:47,  3.95it/s]
 27%|██▋       | 99688/371472 [7:55:40<19:49:57,  3.81it/s]
 27%|██▋       | 99689/371472 [7:55:40<19:22:06,  3.90it/s]
 27%|██▋       | 99690/371472 [7:55:40<19:54:23,  3.79it/s]
 27%|██▋       | 99691/371472 [7:55:41<20:19:17,  3.71it/s]
 27%|██▋       | 99692/371472 [7:55:41<20:57:42,  3.60it/s]
 27%|██▋       | 99693/371472 [7:55:41<20:53:12,  3.61it/s]
 27%|██▋       | 99694/371472 [7:55:41<22:10:26,  3.40it/s]
 27%|██▋       | 99695/371472 [7:55:42<21:45:32,  3.47it/s]
 27%|██▋       | 99696/371472 [7:55:42<21:48:28,  3.46it/s]
 27%|██▋       | 99697/371472 [7:55:42<22:08:55,  3.41it/s]
 27%|██▋       | 99698/371472 [7:55:43<21:36:15,  3.49it/s]
 27%|██▋       | 99699/371472 [7:55:43<20:34:53,  3.67it/s]
 27%|██▋       | 99700/371472 [7:55:43<21:01:46,  3.59it/s]
                                                           
{'loss': 3.6333, 'learning_rate': 7.588021719925014e-07, 'epoch': 4.29}

 27%|██▋       | 99700/371472 [7:55:43<21:01:46,  3.59it/s]
 27%|██▋       | 99701/371472 [7:55:43<22:15:29,  3.39it/s]
 27%|██▋       | 99702/371472 [7:55:44<23:00:30,  3.28it/s]
 27%|██▋       | 99703/371472 [7:55:44<22:54:44,  3.29it/s]
 27%|██▋       | 99704/371472 [7:55:44<21:40:46,  3.48it/s]
 27%|██▋       | 99705/371472 [7:55:45<24:33:17,  3.07it/s]
 27%|██▋       | 99706/371472 [7:55:45<23:17:49,  3.24it/s]
 27%|██▋       | 99707/371472 [7:55:45<22:20:37,  3.38it/s]
 27%|██▋       | 99708/371472 [7:55:46<23:14:25,  3.25it/s]
 27%|██▋       | 99709/371472 [7:55:46<22:18:38,  3.38it/s]
 27%|██▋       | 99710/371472 [7:55:46<21:56:49,  3.44it/s]
 27%|██▋       | 99711/371472 [7:55:46<21:09:52,  3.57it/s]
 27%|██▋       | 99712/371472 [7:55:47<22:28:33,  3.36it/s]
 27%|██▋       | 99713/371472 [7:55:47<22:31:19,  3.35it/s]
 27%|██▋       | 99714/371472 [7:55:47<23:28:37,  3.22it/s]
 27%|██▋       | 99715/371472 [7:55:48<22:25:38,  3.37it/s]
 27%|██▋       | 99716/371472 [7:55:48<22:27:59,  3.36it/s]
 27%|██▋       | 99717/371472 [7:55:48<21:45:18,  3.47it/s]
 27%|██▋       | 99718/371472 [7:55:48<21:22:01,  3.53it/s]
 27%|██▋       | 99719/371472 [7:55:49<21:12:41,  3.56it/s]
 27%|██▋       | 99720/371472 [7:55:49<24:16:29,  3.11it/s]
                                                           
{'loss': 3.664, 'learning_rate': 7.587536900170226e-07, 'epoch': 4.3}

 27%|██▋       | 99720/371472 [7:55:49<24:16:29,  3.11it/s]
 27%|██▋       | 99721/371472 [7:55:49<23:00:28,  3.28it/s]
 27%|██▋       | 99722/371472 [7:55:50<25:12:25,  2.99it/s]
 27%|██▋       | 99723/371472 [7:55:50<23:28:25,  3.22it/s]
 27%|██▋       | 99724/371472 [7:55:50<21:44:15,  3.47it/s]
 27%|██▋       | 99725/371472 [7:55:51<21:05:36,  3.58it/s]
 27%|██▋       | 99726/371472 [7:55:51<20:49:15,  3.63it/s]
 27%|██▋       | 99727/371472 [7:55:51<21:03:31,  3.58it/s]
 27%|██▋       | 99728/371472 [7:55:51<20:58:16,  3.60it/s]
 27%|██▋       | 99729/371472 [7:55:52<21:45:48,  3.47it/s]
 27%|██▋       | 99730/371472 [7:55:52<22:35:29,  3.34it/s]
 27%|██▋       | 99731/371472 [7:55:52<21:49:26,  3.46it/s]
 27%|██▋       | 99732/371472 [7:55:53<21:52:50,  3.45it/s]
 27%|██▋       | 99733/371472 [7:55:53<21:06:56,  3.57it/s]
 27%|██▋       | 99734/371472 [7:55:53<20:51:48,  3.62it/s]
 27%|██▋       | 99735/371472 [7:55:53<21:44:42,  3.47it/s]
 27%|██▋       | 99736/371472 [7:55:54<20:58:45,  3.60it/s]
 27%|██▋       | 99737/371472 [7:55:54<20:24:42,  3.70it/s]
 27%|██▋       | 99738/371472 [7:55:54<20:22:00,  3.71it/s]
 27%|██▋       | 99739/371472 [7:55:54<19:48:36,  3.81it/s]
 27%|██▋       | 99740/371472 [7:55:55<20:10:39,  3.74it/s]
                                                           
{'loss': 3.5497, 'learning_rate': 7.587052080415437e-07, 'epoch': 4.3}

 27%|██▋       | 99740/371472 [7:55:55<20:10:39,  3.74it/s]
 27%|██▋       | 99741/371472 [7:55:55<21:04:02,  3.58it/s]
 27%|██▋       | 99742/371472 [7:55:55<20:46:07,  3.63it/s]
 27%|██▋       | 99743/371472 [7:55:56<20:40:34,  3.65it/s]
 27%|██▋       | 99744/371472 [7:55:56<20:13:57,  3.73it/s]
 27%|██▋       | 99745/371472 [7:55:56<21:01:57,  3.59it/s]
 27%|██▋       | 99746/371472 [7:55:56<20:15:47,  3.72it/s]
 27%|██▋       | 99747/371472 [7:55:57<20:38:30,  3.66it/s]
 27%|██▋       | 99748/371472 [7:55:57<20:46:02,  3.63it/s]
 27%|██▋       | 99749/371472 [7:55:57<21:32:14,  3.50it/s]
 27%|██▋       | 99750/371472 [7:55:58<21:27:16,  3.52it/s]
 27%|██▋       | 99751/371472 [7:55:58<21:17:34,  3.54it/s]
 27%|██▋       | 99752/371472 [7:55:58<21:57:52,  3.44it/s]
 27%|██▋       | 99753/371472 [7:55:58<21:36:06,  3.49it/s]
 27%|██▋       | 99754/371472 [7:55:59<22:13:33,  3.40it/s]
 27%|██▋       | 99755/371472 [7:55:59<21:09:22,  3.57it/s]
 27%|██▋       | 99756/371472 [7:55:59<22:01:50,  3.43it/s]
 27%|██▋       | 99757/371472 [7:56:00<21:31:18,  3.51it/s]
 27%|██▋       | 99758/371472 [7:56:00<21:12:01,  3.56it/s]
 27%|██▋       | 99759/371472 [7:56:00<21:27:42,  3.52it/s]
 27%|██▋       | 99760/371472 [7:56:01<24:08:17,  3.13it/s]
                                                           
{'loss': 3.5202, 'learning_rate': 7.586567260660646e-07, 'epoch': 4.3}

 27%|██▋       | 99760/371472 [7:56:01<24:08:17,  3.13it/s]
 27%|██▋       | 99761/371472 [7:56:01<23:34:51,  3.20it/s]
 27%|██▋       | 99762/371472 [7:56:01<24:23:06,  3.10it/s]
 27%|██▋       | 99763/371472 [7:56:02<23:59:54,  3.14it/s]
 27%|██▋       | 99764/371472 [7:56:02<23:09:33,  3.26it/s]
 27%|██▋       | 99765/371472 [7:56:02<23:02:34,  3.28it/s]
 27%|██▋       | 99766/371472 [7:56:02<22:00:27,  3.43it/s]
 27%|██▋       | 99767/371472 [7:56:03<22:47:01,  3.31it/s]
 27%|██▋       | 99768/371472 [7:56:03<22:31:17,  3.35it/s]
 27%|██▋       | 99769/371472 [7:56:03<25:12:13,  2.99it/s]
 27%|██▋       | 99770/371472 [7:56:04<26:15:30,  2.87it/s]
 27%|██▋       | 99771/371472 [7:56:04<26:14:23,  2.88it/s]
 27%|██▋       | 99772/371472 [7:56:04<24:49:18,  3.04it/s]
 27%|██▋       | 99773/371472 [7:56:05<23:47:01,  3.17it/s]
 27%|██▋       | 99774/371472 [7:56:05<23:44:32,  3.18it/s]
 27%|██▋       | 99775/371472 [7:56:05<22:50:11,  3.30it/s]
 27%|██▋       | 99776/371472 [7:56:06<22:06:08,  3.41it/s]
 27%|██▋       | 99777/371472 [7:56:06<21:53:14,  3.45it/s]
 27%|██▋       | 99778/371472 [7:56:06<22:01:39,  3.43it/s]
 27%|██▋       | 99779/371472 [7:56:06<22:07:46,  3.41it/s]
 27%|██▋       | 99780/371472 [7:56:07<23:53:14,  3.16it/s]
                                                           
{'loss': 3.6558, 'learning_rate': 7.586082440905858e-07, 'epoch': 4.3}

 27%|██▋       | 99780/371472 [7:56:07<23:53:14,  3.16it/s]
 27%|██▋       | 99781/371472 [7:56:07<22:57:32,  3.29it/s]
 27%|██▋       | 99782/371472 [7:56:07<22:27:25,  3.36it/s]
 27%|██▋       | 99783/371472 [7:56:08<22:26:15,  3.36it/s]
 27%|██▋       | 99784/371472 [7:56:08<22:21:21,  3.38it/s]
 27%|██▋       | 99785/371472 [7:56:08<22:00:30,  3.43it/s]
 27%|██▋       | 99786/371472 [7:56:09<23:27:06,  3.22it/s]
 27%|██▋       | 99787/371472 [7:56:09<22:17:34,  3.39it/s]
 27%|██▋       | 99788/371472 [7:56:09<21:16:23,  3.55it/s]
 27%|██▋       | 99789/371472 [7:56:09<20:48:50,  3.63it/s]
 27%|██▋       | 99790/371472 [7:56:10<20:30:40,  3.68it/s]
 27%|██▋       | 99791/371472 [7:56:10<20:34:54,  3.67it/s]
 27%|██▋       | 99792/371472 [7:56:10<20:22:12,  3.70it/s]
 27%|██▋       | 99793/371472 [7:56:10<20:13:32,  3.73it/s]
 27%|██▋       | 99794/371472 [7:56:11<20:25:17,  3.70it/s]
 27%|██▋       | 99795/371472 [7:56:11<20:42:30,  3.64it/s]
 27%|██▋       | 99796/371472 [7:56:11<20:12:11,  3.74it/s]
 27%|██▋       | 99797/371472 [7:56:12<21:12:01,  3.56it/s]
 27%|██▋       | 99798/371472 [7:56:12<21:36:28,  3.49it/s]
 27%|██▋       | 99799/371472 [7:56:12<21:05:59,  3.58it/s]
 27%|██▋       | 99800/371472 [7:56:12<21:12:38,  3.56it/s]
                                                           
{'loss': 3.5368, 'learning_rate': 7.58559762115107e-07, 'epoch': 4.3}

 27%|██▋       | 99800/371472 [7:56:12<21:12:38,  3.56it/s]
 27%|██▋       | 99801/371472 [7:56:13<22:02:51,  3.42it/s]
 27%|██▋       | 99802/371472 [7:56:13<21:40:01,  3.48it/s]
 27%|██▋       | 99803/371472 [7:56:13<20:57:48,  3.60it/s]
 27%|██▋       | 99804/371472 [7:56:13<20:12:04,  3.74it/s]
 27%|██▋       | 99805/371472 [7:56:14<21:51:42,  3.45it/s]
 27%|██▋       | 99806/371472 [7:56:14<21:16:44,  3.55it/s]
 27%|██▋       | 99807/371472 [7:56:14<20:45:52,  3.63it/s]
 27%|██▋       | 99808/371472 [7:56:15<20:58:02,  3.60it/s]
 27%|██▋       | 99809/371472 [7:56:15<20:55:30,  3.61it/s]
 27%|██▋       | 99810/371472 [7:56:15<20:36:02,  3.66it/s]
 27%|██▋       | 99811/371472 [7:56:15<21:00:55,  3.59it/s]
 27%|██▋       | 99812/371472 [7:56:16<20:53:05,  3.61it/s]
 27%|██▋       | 99813/371472 [7:56:16<22:22:45,  3.37it/s]
 27%|██▋       | 99814/371472 [7:56:16<21:46:05,  3.47it/s]
 27%|██▋       | 99815/371472 [7:56:17<22:12:32,  3.40it/s]
 27%|██▋       | 99816/371472 [7:56:17<21:52:01,  3.45it/s]
 27%|██▋       | 99817/371472 [7:56:17<22:50:07,  3.30it/s]
 27%|██▋       | 99818/371472 [7:56:18<22:24:21,  3.37it/s]
 27%|██▋       | 99819/371472 [7:56:18<22:21:11,  3.38it/s]
 27%|██▋       | 99820/371472 [7:56:18<22:48:38,  3.31it/s]
                                                           
{'loss': 3.5494, 'learning_rate': 7.58511280139628e-07, 'epoch': 4.3}

 27%|██▋       | 99820/371472 [7:56:18<22:48:38,  3.31it/s]
 27%|██▋       | 99821/371472 [7:56:18<23:36:47,  3.20it/s]
 27%|██▋       | 99822/371472 [7:56:19<23:03:57,  3.27it/s]
 27%|██▋       | 99823/371472 [7:56:19<21:42:19,  3.48it/s]
 27%|██▋       | 99824/371472 [7:56:19<21:42:08,  3.48it/s]
 27%|██▋       | 99825/371472 [7:56:20<21:51:41,  3.45it/s]
 27%|██▋       | 99826/371472 [7:56:20<21:16:25,  3.55it/s]
 27%|██▋       | 99827/371472 [7:56:20<22:24:10,  3.37it/s]
 27%|██▋       | 99828/371472 [7:56:21<23:01:34,  3.28it/s]
 27%|██▋       | 99829/371472 [7:56:21<21:54:13,  3.44it/s]
 27%|██▋       | 99830/371472 [7:56:21<20:46:22,  3.63it/s]
 27%|██▋       | 99831/371472 [7:56:21<20:44:34,  3.64it/s]
 27%|██▋       | 99832/371472 [7:56:22<20:32:14,  3.67it/s]
 27%|██▋       | 99833/371472 [7:56:22<20:36:34,  3.66it/s]
 27%|██▋       | 99834/371472 [7:56:22<20:57:22,  3.60it/s]
 27%|██▋       | 99835/371472 [7:56:22<20:14:13,  3.73it/s]
 27%|██▋       | 99836/371472 [7:56:23<20:23:33,  3.70it/s]
 27%|██▋       | 99837/371472 [7:56:23<21:05:04,  3.58it/s]
 27%|██▋       | 99838/371472 [7:56:23<20:31:26,  3.68it/s]
 27%|██▋       | 99839/371472 [7:56:24<21:44:59,  3.47it/s]
 27%|██▋       | 99840/371472 [7:56:24<21:05:58,  3.58it/s]
                                                           
{'loss': 3.8079, 'learning_rate': 7.584627981641491e-07, 'epoch': 4.3}

 27%|██▋       | 99840/371472 [7:56:24<21:05:58,  3.58it/s]
 27%|██▋       | 99841/371472 [7:56:24<21:25:26,  3.52it/s]
 27%|██▋       | 99842/371472 [7:56:24<21:29:02,  3.51it/s]
 27%|██▋       | 99843/371472 [7:56:25<21:01:30,  3.59it/s]
 27%|██▋       | 99844/371472 [7:56:25<20:44:51,  3.64it/s]
 27%|██▋       | 99845/371472 [7:56:25<20:09:43,  3.74it/s]
 27%|██▋       | 99846/371472 [7:56:25<20:34:42,  3.67it/s]
 27%|██▋       | 99847/371472 [7:56:26<22:19:01,  3.38it/s]
 27%|██▋       | 99848/371472 [7:56:26<21:24:15,  3.53it/s]
 27%|██▋       | 99849/371472 [7:56:26<21:50:06,  3.46it/s]
 27%|██▋       | 99850/371472 [7:56:27<21:31:42,  3.50it/s]
 27%|██▋       | 99851/371472 [7:56:27<23:30:43,  3.21it/s]
 27%|██▋       | 99852/371472 [7:56:27<22:30:57,  3.35it/s]
 27%|██▋       | 99853/371472 [7:56:28<21:56:43,  3.44it/s]
 27%|██▋       | 99854/371472 [7:56:28<21:18:19,  3.54it/s]
 27%|██▋       | 99855/371472 [7:56:28<20:38:19,  3.66it/s]
 27%|██▋       | 99856/371472 [7:56:28<20:45:45,  3.63it/s]
 27%|██▋       | 99857/371472 [7:56:29<22:40:40,  3.33it/s]
 27%|██▋       | 99858/371472 [7:56:29<21:54:38,  3.44it/s]
 27%|██▋       | 99859/371472 [7:56:29<21:45:06,  3.47it/s]
 27%|██▋       | 99860/371472 [7:56:29<21:18:11,  3.54it/s]
                                                           
{'loss': 3.6958, 'learning_rate': 7.584143161886704e-07, 'epoch': 4.3}

 27%|██▋       | 99860/371472 [7:56:29<21:18:11,  3.54it/s]
 27%|██▋       | 99861/371472 [7:56:30<22:40:08,  3.33it/s]
 27%|██▋       | 99862/371472 [7:56:30<21:51:23,  3.45it/s]
 27%|██▋       | 99863/371472 [7:56:30<22:12:32,  3.40it/s]
 27%|██▋       | 99864/371472 [7:56:31<22:52:58,  3.30it/s]
 27%|██▋       | 99865/371472 [7:56:31<23:44:48,  3.18it/s]
 27%|██▋       | 99866/371472 [7:56:31<23:16:30,  3.24it/s]
 27%|██▋       | 99867/371472 [7:56:32<23:15:29,  3.24it/s]
 27%|██▋       | 99868/371472 [7:56:32<22:26:47,  3.36it/s]
 27%|██▋       | 99869/371472 [7:56:32<21:57:11,  3.44it/s]
 27%|██▋       | 99870/371472 [7:56:32<21:01:34,  3.59it/s]
 27%|██▋       | 99871/371472 [7:56:33<20:33:45,  3.67it/s]
 27%|██▋       | 99872/371472 [7:56:33<22:37:47,  3.33it/s]
 27%|██▋       | 99873/371472 [7:56:33<21:36:58,  3.49it/s]
 27%|██▋       | 99874/371472 [7:56:34<21:18:10,  3.54it/s]
 27%|██▋       | 99875/371472 [7:56:34<22:04:22,  3.42it/s]
 27%|██▋       | 99876/371472 [7:56:34<22:00:59,  3.43it/s]
 27%|██▋       | 99877/371472 [7:56:35<23:13:10,  3.25it/s]
 27%|██▋       | 99878/371472 [7:56:35<23:11:56,  3.25it/s]
 27%|██▋       | 99879/371472 [7:56:35<22:12:52,  3.40it/s]
 27%|██▋       | 99880/371472 [7:56:35<21:42:45,  3.47it/s]
                                                           
{'loss': 3.5206, 'learning_rate': 7.583658342131914e-07, 'epoch': 4.3}

 27%|██▋       | 99880/371472 [7:56:35<21:42:45,  3.47it/s]
 27%|██▋       | 99881/371472 [7:56:36<21:10:07,  3.56it/s]
 27%|██▋       | 99882/371472 [7:56:36<20:17:00,  3.72it/s]
 27%|██▋       | 99883/371472 [7:56:36<20:21:34,  3.71it/s]
 27%|██▋       | 99884/371472 [7:56:37<22:57:03,  3.29it/s]
 27%|██▋       | 99885/371472 [7:56:37<24:33:34,  3.07it/s]
 27%|██▋       | 99886/371472 [7:56:37<24:17:49,  3.10it/s]
 27%|██▋       | 99887/371472 [7:56:38<22:42:49,  3.32it/s]
 27%|██▋       | 99888/371472 [7:56:38<22:21:24,  3.37it/s]
 27%|██▋       | 99889/371472 [7:56:38<21:27:43,  3.52it/s]
 27%|██▋       | 99890/371472 [7:56:38<21:09:30,  3.57it/s]
 27%|██▋       | 99891/371472 [7:56:39<20:12:51,  3.73it/s]
 27%|██▋       | 99892/371472 [7:56:39<24:48:29,  3.04it/s]
 27%|██▋       | 99893/371472 [7:56:39<23:05:32,  3.27it/s]
 27%|██▋       | 99894/371472 [7:56:40<22:16:55,  3.39it/s]
 27%|██▋       | 99895/371472 [7:56:40<21:55:26,  3.44it/s]
 27%|██▋       | 99896/371472 [7:56:40<21:18:36,  3.54it/s]
 27%|██▋       | 99897/371472 [7:56:40<21:12:46,  3.56it/s]
 27%|██▋       | 99898/371472 [7:56:41<22:13:54,  3.39it/s]
 27%|██▋       | 99899/371472 [7:56:41<22:17:13,  3.38it/s]
 27%|██▋       | 99900/371472 [7:56:41<22:04:00,  3.42it/s]
                                                           
{'loss': 3.5383, 'learning_rate': 7.583173522377124e-07, 'epoch': 4.3}

 27%|██▋       | 99900/371472 [7:56:41<22:04:00,  3.42it/s]
 27%|██▋       | 99901/371472 [7:56:42<21:31:07,  3.51it/s]
 27%|██▋       | 99902/371472 [7:56:42<21:27:32,  3.52it/s]
 27%|██▋       | 99903/371472 [7:56:42<21:59:24,  3.43it/s]
 27%|██▋       | 99904/371472 [7:56:42<21:28:02,  3.51it/s]
 27%|██▋       | 99905/371472 [7:56:43<20:44:09,  3.64it/s]
 27%|██▋       | 99906/371472 [7:56:43<20:13:52,  3.73it/s]
 27%|██▋       | 99907/371472 [7:56:43<20:11:16,  3.74it/s]
 27%|██▋       | 99908/371472 [7:56:43<19:55:43,  3.79it/s]
 27%|██▋       | 99909/371472 [7:56:44<19:57:12,  3.78it/s]
 27%|██▋       | 99910/371472 [7:56:44<19:50:24,  3.80it/s]
 27%|██▋       | 99911/371472 [7:56:44<22:27:00,  3.36it/s]
 27%|██▋       | 99912/371472 [7:56:45<21:50:14,  3.45it/s]
 27%|██▋       | 99913/371472 [7:56:45<22:17:47,  3.38it/s]
 27%|██▋       | 99914/371472 [7:56:45<22:45:03,  3.32it/s]
 27%|██▋       | 99915/371472 [7:56:46<23:03:53,  3.27it/s]
 27%|██▋       | 99916/371472 [7:56:46<23:06:27,  3.26it/s]
 27%|██▋       | 99917/371472 [7:56:46<23:04:07,  3.27it/s]
 27%|██▋       | 99918/371472 [7:56:47<24:11:51,  3.12it/s]
 27%|██▋       | 99919/371472 [7:56:47<22:45:54,  3.31it/s]
 27%|██▋       | 99920/371472 [7:56:47<22:06:05,  3.41it/s]
                                                           
{'loss': 3.5775, 'learning_rate': 7.582688702622335e-07, 'epoch': 4.3}

 27%|██▋       | 99920/371472 [7:56:47<22:06:05,  3.41it/s]
 27%|██▋       | 99921/371472 [7:56:47<21:35:18,  3.49it/s]
 27%|██▋       | 99922/371472 [7:56:48<20:59:49,  3.59it/s]
 27%|██▋       | 99923/371472 [7:56:48<20:46:56,  3.63it/s]
 27%|██▋       | 99924/371472 [7:56:48<20:35:48,  3.66it/s]
 27%|██▋       | 99925/371472 [7:56:48<21:14:53,  3.55it/s]
 27%|██▋       | 99926/371472 [7:56:49<21:27:06,  3.52it/s]
 27%|██▋       | 99927/371472 [7:56:49<21:37:38,  3.49it/s]
 27%|██▋       | 99928/371472 [7:56:49<21:29:22,  3.51it/s]
 27%|██▋       | 99929/371472 [7:56:50<21:26:42,  3.52it/s]
 27%|██▋       | 99930/371472 [7:56:50<20:32:21,  3.67it/s]
 27%|██▋       | 99931/371472 [7:56:50<20:45:32,  3.63it/s]
 27%|██▋       | 99932/371472 [7:56:50<21:59:56,  3.43it/s]
 27%|██▋       | 99933/371472 [7:56:51<22:14:46,  3.39it/s]
 27%|██▋       | 99934/371472 [7:56:51<21:24:20,  3.52it/s]
 27%|██▋       | 99935/371472 [7:56:51<21:13:07,  3.55it/s]
 27%|██▋       | 99936/371472 [7:56:52<21:46:50,  3.46it/s]
 27%|██▋       | 99937/371472 [7:56:52<20:38:35,  3.65it/s]
 27%|██▋       | 99938/371472 [7:56:52<20:43:54,  3.64it/s]
 27%|██▋       | 99939/371472 [7:56:52<21:36:12,  3.49it/s]
 27%|██▋       | 99940/371472 [7:56:53<21:20:28,  3.53it/s]
                                                           
{'loss': 3.6891, 'learning_rate': 7.582203882867547e-07, 'epoch': 4.3}

 27%|██▋       | 99940/371472 [7:56:53<21:20:28,  3.53it/s]
 27%|██▋       | 99941/371472 [7:56:53<20:49:32,  3.62it/s]
 27%|██▋       | 99942/371472 [7:56:53<20:43:06,  3.64it/s]
 27%|██▋       | 99943/371472 [7:56:53<20:54:48,  3.61it/s]
 27%|██▋       | 99944/371472 [7:56:54<20:54:00,  3.61it/s]
 27%|██▋       | 99945/371472 [7:56:54<20:53:09,  3.61it/s]
 27%|██▋       | 99946/371472 [7:56:54<21:02:08,  3.59it/s]
 27%|██▋       | 99947/371472 [7:56:55<20:56:47,  3.60it/s]
 27%|██▋       | 99948/371472 [7:56:55<21:04:23,  3.58it/s]
 27%|██▋       | 99949/371472 [7:56:55<22:43:12,  3.32it/s]
 27%|██▋       | 99950/371472 [7:56:55<21:39:34,  3.48it/s]
 27%|██▋       | 99951/371472 [7:56:56<21:27:54,  3.51it/s]
 27%|██▋       | 99952/371472 [7:56:56<21:03:08,  3.58it/s]
 27%|██▋       | 99953/371472 [7:56:56<22:07:50,  3.41it/s]
 27%|██▋       | 99954/371472 [7:56:57<21:02:02,  3.59it/s]
 27%|██▋       | 99955/371472 [7:56:57<22:30:57,  3.35it/s]
 27%|██▋       | 99956/371472 [7:56:57<22:27:54,  3.36it/s]
 27%|██▋       | 99957/371472 [7:56:58<23:16:44,  3.24it/s]
 27%|██▋       | 99958/371472 [7:56:58<22:51:01,  3.30it/s]
 27%|██▋       | 99959/371472 [7:56:58<22:55:02,  3.29it/s]
 27%|██▋       | 99960/371472 [7:56:58<22:49:23,  3.30it/s]
                                                           
{'loss': 3.7513, 'learning_rate': 7.581719063112759e-07, 'epoch': 4.31}

 27%|██▋       | 99960/371472 [7:56:58<22:49:23,  3.30it/s]
 27%|██▋       | 99961/371472 [7:56:59<21:47:23,  3.46it/s]
 27%|██▋       | 99962/371472 [7:56:59<21:13:21,  3.55it/s]
 27%|██▋       | 99963/371472 [7:56:59<20:17:36,  3.72it/s]
 27%|██▋       | 99964/371472 [7:57:00<20:27:01,  3.69it/s]
 27%|██▋       | 99965/371472 [7:57:00<20:23:02,  3.70it/s]
 27%|██▋       | 99966/371472 [7:57:00<20:53:57,  3.61it/s]
 27%|██▋       | 99967/371472 [7:57:00<21:56:57,  3.44it/s]
 27%|██▋       | 99968/371472 [7:57:01<21:07:49,  3.57it/s]
 27%|██▋       | 99969/371472 [7:57:01<21:16:42,  3.54it/s]
 27%|██▋       | 99970/371472 [7:57:01<20:38:47,  3.65it/s]
 27%|██▋       | 99971/371472 [7:57:02<21:18:38,  3.54it/s]
 27%|██▋       | 99972/371472 [7:57:02<22:05:36,  3.41it/s]
 27%|██▋       | 99973/371472 [7:57:02<22:08:09,  3.41it/s]
 27%|██▋       | 99974/371472 [7:57:02<22:38:25,  3.33it/s]
 27%|██▋       | 99975/371472 [7:57:03<23:21:32,  3.23it/s]
 27%|██▋       | 99976/371472 [7:57:03<22:09:33,  3.40it/s]
 27%|██▋       | 99977/371472 [7:57:03<22:07:40,  3.41it/s]
 27%|██▋       | 99978/371472 [7:57:04<22:02:21,  3.42it/s]
 27%|██▋       | 99979/371472 [7:57:04<21:15:58,  3.55it/s]
 27%|██▋       | 99980/371472 [7:57:04<20:47:08,  3.63it/s]
                                                           
{'loss': 3.5897, 'learning_rate': 7.581234243357969e-07, 'epoch': 4.31}

 27%|██▋       | 99980/371472 [7:57:04<20:47:08,  3.63it/s]
 27%|██▋       | 99981/371472 [7:57:04<20:39:41,  3.65it/s]
 27%|██▋       | 99982/371472 [7:57:05<22:44:40,  3.32it/s]
 27%|██▋       | 99983/371472 [7:57:05<22:56:07,  3.29it/s]
 27%|██▋       | 99984/371472 [7:57:05<22:35:41,  3.34it/s]
 27%|██▋       | 99985/371472 [7:57:06<21:32:32,  3.50it/s]
 27%|██▋       | 99986/371472 [7:57:06<20:40:33,  3.65it/s]
 27%|██▋       | 99987/371472 [7:57:06<20:26:31,  3.69it/s]
 27%|██▋       | 99988/371472 [7:57:07<23:11:58,  3.25it/s]
 27%|██▋       | 99989/371472 [7:57:07<22:53:46,  3.29it/s]
 27%|██▋       | 99990/371472 [7:57:07<23:03:08,  3.27it/s]
 27%|██▋       | 99991/371472 [7:57:07<22:24:07,  3.37it/s]
 27%|██▋       | 99992/371472 [7:57:08<21:22:15,  3.53it/s]
 27%|██▋       | 99993/371472 [7:57:08<20:51:41,  3.61it/s]
 27%|██▋       | 99994/371472 [7:57:08<20:24:35,  3.69it/s]
 27%|██▋       | 99995/371472 [7:57:08<21:36:36,  3.49it/s]
 27%|██▋       | 99996/371472 [7:57:09<21:08:56,  3.57it/s]
 27%|██▋       | 99997/371472 [7:57:09<22:53:31,  3.29it/s]
 27%|██▋       | 99998/371472 [7:57:09<21:50:39,  3.45it/s]
 27%|██▋       | 99999/371472 [7:57:10<21:21:41,  3.53it/s]
 27%|██▋       | 100000/371472 [7:57:10<20:50:08,  3.62it/s]
                                                            
{'loss': 3.5481, 'learning_rate': 7.58074942360318e-07, 'epoch': 4.31}

 27%|██▋       | 100000/371472 [7:57:10<20:50:08,  3.62it/s]
 27%|██▋       | 100001/371472 [7:57:10<20:37:34,  3.66it/s]
 27%|██▋       | 100002/371472 [7:57:10<21:44:25,  3.47it/s]
 27%|██▋       | 100003/371472 [7:57:11<20:46:59,  3.63it/s]
 27%|██▋       | 100004/371472 [7:57:11<20:08:29,  3.74it/s]
 27%|██▋       | 100005/371472 [7:57:11<20:25:36,  3.69it/s]
 27%|██▋       | 100006/371472 [7:57:12<20:14:39,  3.72it/s]
 27%|██▋       | 100007/371472 [7:57:12<19:46:09,  3.81it/s]
 27%|██▋       | 100008/371472 [7:57:12<21:37:33,  3.49it/s]
 27%|██▋       | 100009/371472 [7:57:12<21:57:00,  3.44it/s]
 27%|██▋       | 100010/371472 [7:57:13<22:14:24,  3.39it/s]
 27%|██▋       | 100011/371472 [7:57:13<21:41:50,  3.48it/s]
 27%|██▋       | 100012/371472 [7:57:13<20:53:37,  3.61it/s]
 27%|██▋       | 100013/371472 [7:57:14<20:30:36,  3.68it/s]
 27%|██▋       | 100014/371472 [7:57:14<21:01:22,  3.59it/s]
 27%|██▋       | 100015/371472 [7:57:14<21:04:21,  3.58it/s]
 27%|██▋       | 100016/371472 [7:57:14<21:32:15,  3.50it/s]
 27%|██▋       | 100017/371472 [7:57:15<21:41:35,  3.48it/s]
 27%|██▋       | 100018/371472 [7:57:15<21:01:33,  3.59it/s]
 27%|██▋       | 100019/371472 [7:57:15<21:36:01,  3.49it/s]
 27%|██▋       | 100020/371472 [7:57:16<22:25:41,  3.36it/s]
                                                            
{'loss': 3.6821, 'learning_rate': 7.580264603848391e-07, 'epoch': 4.31}

 27%|██▋       | 100020/371472 [7:57:16<22:25:41,  3.36it/s]
 27%|██▋       | 100021/371472 [7:57:16<22:04:17,  3.42it/s]
 27%|██▋       | 100022/371472 [7:57:16<21:31:15,  3.50it/s]
 27%|██▋       | 100023/371472 [7:57:16<21:38:38,  3.48it/s]
 27%|██▋       | 100024/371472 [7:57:17<23:27:05,  3.22it/s]
 27%|██▋       | 100025/371472 [7:57:17<23:07:12,  3.26it/s]
 27%|██▋       | 100026/371472 [7:57:17<22:43:49,  3.32it/s]
 27%|██▋       | 100027/371472 [7:57:18<22:53:49,  3.29it/s]
 27%|██▋       | 100028/371472 [7:57:18<23:11:35,  3.25it/s]
 27%|██▋       | 100029/371472 [7:57:18<22:50:30,  3.30it/s]
 27%|██▋       | 100030/371472 [7:57:19<22:08:06,  3.41it/s]
 27%|██▋       | 100031/371472 [7:57:19<22:42:05,  3.32it/s]
 27%|██▋       | 100032/371472 [7:57:19<21:56:34,  3.44it/s]
 27%|██▋       | 100033/371472 [7:57:19<21:22:55,  3.53it/s]
 27%|██▋       | 100034/371472 [7:57:20<21:04:42,  3.58it/s]
 27%|██▋       | 100035/371472 [7:57:20<20:42:40,  3.64it/s]
 27%|██▋       | 100036/371472 [7:57:20<21:15:58,  3.55it/s]
 27%|██▋       | 100037/371472 [7:57:20<20:51:52,  3.61it/s]
 27%|██▋       | 100038/371472 [7:57:21<20:47:58,  3.63it/s]
 27%|██▋       | 100039/371472 [7:57:21<20:56:56,  3.60it/s]
 27%|██▋       | 100040/371472 [7:57:21<20:36:23,  3.66it/s]
                                                            
{'loss': 3.6613, 'learning_rate': 7.579779784093603e-07, 'epoch': 4.31}

 27%|██▋       | 100040/371472 [7:57:21<20:36:23,  3.66it/s]
 27%|██▋       | 100041/371472 [7:57:22<21:24:17,  3.52it/s]
 27%|██▋       | 100042/371472 [7:57:22<20:51:00,  3.62it/s]
 27%|██▋       | 100043/371472 [7:57:22<21:57:25,  3.43it/s]
 27%|██▋       | 100044/371472 [7:57:22<21:55:18,  3.44it/s]
 27%|██▋       | 100045/371472 [7:57:23<22:44:02,  3.32it/s]
 27%|██▋       | 100046/371472 [7:57:23<24:02:24,  3.14it/s]
 27%|██▋       | 100047/371472 [7:57:23<23:00:04,  3.28it/s]
 27%|██▋       | 100048/371472 [7:57:24<23:18:06,  3.24it/s]
 27%|██▋       | 100049/371472 [7:57:24<23:00:28,  3.28it/s]
 27%|██▋       | 100050/371472 [7:57:24<23:18:23,  3.23it/s]
 27%|██▋       | 100051/371472 [7:57:25<22:11:45,  3.40it/s]
 27%|██▋       | 100052/371472 [7:57:25<21:32:23,  3.50it/s]
 27%|██▋       | 100053/371472 [7:57:25<21:58:06,  3.43it/s]
 27%|██▋       | 100054/371472 [7:57:25<21:40:11,  3.48it/s]
 27%|██▋       | 100055/371472 [7:57:26<20:47:04,  3.63it/s]
 27%|██▋       | 100056/371472 [7:57:26<20:58:59,  3.59it/s]
 27%|██▋       | 100057/371472 [7:57:26<22:07:36,  3.41it/s]
 27%|██▋       | 100058/371472 [7:57:27<23:33:44,  3.20it/s]
 27%|██▋       | 100059/371472 [7:57:27<22:32:32,  3.34it/s]
 27%|██▋       | 100060/371472 [7:57:27<22:42:18,  3.32it/s]
                                                            
{'loss': 3.4891, 'learning_rate': 7.579294964338813e-07, 'epoch': 4.31}

 27%|██▋       | 100060/371472 [7:57:27<22:42:18,  3.32it/s]
 27%|██▋       | 100061/371472 [7:57:28<21:51:54,  3.45it/s]
 27%|██▋       | 100062/371472 [7:57:28<21:05:39,  3.57it/s]
 27%|██▋       | 100063/371472 [7:57:28<20:37:53,  3.65it/s]
 27%|██▋       | 100064/371472 [7:57:28<21:18:50,  3.54it/s]
 27%|██▋       | 100065/371472 [7:57:29<21:24:02,  3.52it/s]
 27%|██▋       | 100066/371472 [7:57:29<22:08:29,  3.40it/s]
 27%|██▋       | 100067/371472 [7:57:29<22:26:12,  3.36it/s]
 27%|██▋       | 100068/371472 [7:57:30<22:33:16,  3.34it/s]
 27%|██▋       | 100069/371472 [7:57:30<22:39:05,  3.33it/s]
 27%|██▋       | 100070/371472 [7:57:30<22:08:25,  3.41it/s]
 27%|██▋       | 100071/371472 [7:57:30<22:04:35,  3.41it/s]
 27%|██▋       | 100072/371472 [7:57:31<21:23:56,  3.52it/s]
 27%|██▋       | 100073/371472 [7:57:31<21:09:12,  3.56it/s]
 27%|██▋       | 100074/371472 [7:57:31<20:20:23,  3.71it/s]
 27%|██▋       | 100075/371472 [7:57:31<20:10:01,  3.74it/s]
 27%|██▋       | 100076/371472 [7:57:32<22:01:08,  3.42it/s]
 27%|██▋       | 100077/371472 [7:57:32<23:21:06,  3.23it/s]
 27%|██▋       | 100078/371472 [7:57:32<22:57:26,  3.28it/s]
 27%|██▋       | 100079/371472 [7:57:33<21:22:09,  3.53it/s]
 27%|██▋       | 100080/371472 [7:57:33<21:03:38,  3.58it/s]
                                                            
{'loss': 3.5326, 'learning_rate': 7.578810144584024e-07, 'epoch': 4.31}

 27%|██▋       | 100080/371472 [7:57:33<21:03:38,  3.58it/s]
 27%|██▋       | 100081/371472 [7:57:33<22:11:54,  3.40it/s]
 27%|██▋       | 100082/371472 [7:57:34<21:39:40,  3.48it/s]
 27%|██▋       | 100083/371472 [7:57:34<21:03:00,  3.58it/s]
 27%|██▋       | 100084/371472 [7:57:34<20:31:19,  3.67it/s]
 27%|██▋       | 100085/371472 [7:57:34<19:51:31,  3.80it/s]
 27%|██▋       | 100086/371472 [7:57:35<19:43:39,  3.82it/s]
 27%|██▋       | 100087/371472 [7:57:35<19:47:42,  3.81it/s]
 27%|██▋       | 100088/371472 [7:57:35<19:18:04,  3.91it/s]
 27%|██▋       | 100089/371472 [7:57:35<19:13:15,  3.92it/s]
 27%|██▋       | 100090/371472 [7:57:36<19:13:25,  3.92it/s]
 27%|██▋       | 100091/371472 [7:57:36<18:48:17,  4.01it/s]
 27%|██▋       | 100092/371472 [7:57:36<18:32:16,  4.07it/s]
 27%|██▋       | 100093/371472 [7:57:36<18:25:02,  4.09it/s]
 27%|██▋       | 100094/371472 [7:57:37<18:21:01,  4.11it/s]
 27%|██▋       | 100095/371472 [7:57:37<18:40:37,  4.04it/s]
 27%|██▋       | 100096/371472 [7:57:37<22:18:25,  3.38it/s]
 27%|██▋       | 100097/371472 [7:57:38<21:34:47,  3.49it/s]
 27%|██▋       | 100098/371472 [7:57:38<21:16:29,  3.54it/s]
 27%|██▋       | 100099/371472 [7:57:38<22:04:25,  3.41it/s]
 27%|██▋       | 100100/371472 [7:57:38<21:34:51,  3.49it/s]
                                                            
{'loss': 3.7199, 'learning_rate': 7.578325324829236e-07, 'epoch': 4.31}

 27%|██▋       | 100100/371472 [7:57:38<21:34:51,  3.49it/s]
 27%|██▋       | 100101/371472 [7:57:39<21:04:15,  3.58it/s]
 27%|██▋       | 100102/371472 [7:57:39<19:54:24,  3.79it/s]
 27%|██▋       | 100103/371472 [7:57:39<19:23:47,  3.89it/s]
 27%|██▋       | 100104/371472 [7:57:39<20:59:45,  3.59it/s]
 27%|██▋       | 100105/371472 [7:57:40<20:50:50,  3.62it/s]
 27%|██▋       | 100106/371472 [7:57:40<20:28:01,  3.68it/s]
 27%|██▋       | 100107/371472 [7:57:40<20:32:12,  3.67it/s]
 27%|██▋       | 100108/371472 [7:57:41<25:07:00,  3.00it/s]
 27%|██▋       | 100109/371472 [7:57:41<24:31:37,  3.07it/s]
 27%|██▋       | 100110/371472 [7:57:41<23:21:39,  3.23it/s]
 27%|██▋       | 100111/371472 [7:57:42<22:46:14,  3.31it/s]
 27%|██▋       | 100112/371472 [7:57:42<21:55:37,  3.44it/s]
 27%|██▋       | 100113/371472 [7:57:42<24:23:14,  3.09it/s]
 27%|██▋       | 100114/371472 [7:57:43<23:24:48,  3.22it/s]
 27%|██▋       | 100115/371472 [7:57:43<22:36:18,  3.33it/s]
 27%|██▋       | 100116/371472 [7:57:43<22:57:18,  3.28it/s]
 27%|██▋       | 100117/371472 [7:57:43<22:27:57,  3.36it/s]
 27%|██▋       | 100118/371472 [7:57:44<21:44:49,  3.47it/s]
 27%|██▋       | 100119/371472 [7:57:44<21:47:47,  3.46it/s]
 27%|██▋       | 100120/371472 [7:57:44<21:24:49,  3.52it/s]
                                                            
{'loss': 3.4382, 'learning_rate': 7.577840505074448e-07, 'epoch': 4.31}

 27%|██▋       | 100120/371472 [7:57:44<21:24:49,  3.52it/s]
 27%|██▋       | 100121/371472 [7:57:44<20:48:28,  3.62it/s]
 27%|██▋       | 100122/371472 [7:57:45<21:00:00,  3.59it/s]
 27%|██▋       | 100123/371472 [7:57:45<20:03:38,  3.76it/s]
 27%|██▋       | 100124/371472 [7:57:45<19:59:53,  3.77it/s]
 27%|██▋       | 100125/371472 [7:57:46<19:34:20,  3.85it/s]
 27%|██▋       | 100126/371472 [7:57:46<21:36:20,  3.49it/s]
 27%|██▋       | 100127/371472 [7:57:46<21:44:42,  3.47it/s]
 27%|██▋       | 100128/371472 [7:57:46<22:01:50,  3.42it/s]
 27%|██▋       | 100129/371472 [7:57:47<21:37:07,  3.49it/s]
 27%|██▋       | 100130/371472 [7:57:47<21:46:52,  3.46it/s]
 27%|██▋       | 100131/371472 [7:57:47<20:57:12,  3.60it/s]
 27%|██▋       | 100132/371472 [7:57:48<20:11:37,  3.73it/s]
 27%|██▋       | 100133/371472 [7:57:48<19:36:35,  3.84it/s]
 27%|██▋       | 100134/371472 [7:57:48<19:36:40,  3.84it/s]
 27%|██▋       | 100135/371472 [7:57:48<20:12:08,  3.73it/s]
 27%|██▋       | 100136/371472 [7:57:49<20:00:40,  3.77it/s]
 27%|██▋       | 100137/371472 [7:57:49<19:29:44,  3.87it/s]
 27%|██▋       | 100138/371472 [7:57:49<20:29:58,  3.68it/s]
 27%|██▋       | 100139/371472 [7:57:49<20:30:26,  3.68it/s]
 27%|██▋       | 100140/371472 [7:57:50<20:22:08,  3.70it/s]
                                                            
{'loss': 3.6127, 'learning_rate': 7.577355685319657e-07, 'epoch': 4.31}

 27%|██▋       | 100140/371472 [7:57:50<20:22:08,  3.70it/s]
 27%|██▋       | 100141/371472 [7:57:50<20:15:33,  3.72it/s]
 27%|██▋       | 100142/371472 [7:57:50<20:18:08,  3.71it/s]
 27%|██▋       | 100143/371472 [7:57:50<19:52:57,  3.79it/s]
 27%|██▋       | 100144/371472 [7:57:51<21:29:19,  3.51it/s]
 27%|██▋       | 100145/371472 [7:57:51<21:38:46,  3.48it/s]
 27%|██▋       | 100146/371472 [7:57:51<22:16:54,  3.38it/s]
 27%|██▋       | 100147/371472 [7:57:52<23:01:56,  3.27it/s]
 27%|██▋       | 100148/371472 [7:57:52<22:19:53,  3.37it/s]
 27%|██▋       | 100149/371472 [7:57:52<21:48:05,  3.46it/s]
 27%|██▋       | 100150/371472 [7:57:53<22:28:02,  3.35it/s]
 27%|██▋       | 100151/371472 [7:57:53<21:58:00,  3.43it/s]
 27%|██▋       | 100152/371472 [7:57:53<21:22:38,  3.53it/s]
 27%|██▋       | 100153/371472 [7:57:53<21:34:56,  3.49it/s]
 27%|██▋       | 100154/371472 [7:57:54<20:30:47,  3.67it/s]
 27%|██▋       | 100155/371472 [7:57:54<20:13:49,  3.73it/s]
 27%|██▋       | 100156/371472 [7:57:54<19:56:51,  3.78it/s]
 27%|██▋       | 100157/371472 [7:57:54<20:33:04,  3.67it/s]
 27%|██▋       | 100158/371472 [7:57:55<19:47:35,  3.81it/s]
 27%|██▋       | 100159/371472 [7:57:55<20:57:34,  3.60it/s]
 27%|██▋       | 100160/371472 [7:57:55<22:17:17,  3.38it/s]
                                                            
{'loss': 3.6243, 'learning_rate': 7.576870865564868e-07, 'epoch': 4.31}

 27%|██▋       | 100160/371472 [7:57:55<22:17:17,  3.38it/s]
 27%|██▋       | 100161/371472 [7:57:56<21:58:55,  3.43it/s]
 27%|██▋       | 100162/371472 [7:57:56<21:32:56,  3.50it/s]
 27%|██▋       | 100163/371472 [7:57:56<21:25:55,  3.52it/s]
 27%|██▋       | 100164/371472 [7:57:56<20:57:14,  3.60it/s]
 27%|██▋       | 100165/371472 [7:57:57<21:19:26,  3.53it/s]
 27%|██▋       | 100166/371472 [7:57:57<20:50:45,  3.62it/s]
 27%|██▋       | 100167/371472 [7:57:57<20:27:45,  3.68it/s]
 27%|██▋       | 100168/371472 [7:57:58<20:22:06,  3.70it/s]
 27%|██▋       | 100169/371472 [7:57:58<21:01:36,  3.58it/s]
 27%|██▋       | 100170/371472 [7:57:58<21:15:51,  3.54it/s]
 27%|██▋       | 100171/371472 [7:57:58<20:39:44,  3.65it/s]
 27%|██▋       | 100172/371472 [7:57:59<20:03:42,  3.76it/s]
 27%|██▋       | 100173/371472 [7:57:59<20:09:25,  3.74it/s]
 27%|██▋       | 100174/371472 [7:57:59<19:43:02,  3.82it/s]
 27%|██▋       | 100175/371472 [7:57:59<21:24:04,  3.52it/s]
 27%|██▋       | 100176/371472 [7:58:00<20:50:46,  3.62it/s]
 27%|██▋       | 100177/371472 [7:58:00<20:49:48,  3.62it/s]
 27%|██▋       | 100178/371472 [7:58:00<22:04:27,  3.41it/s]
 27%|██▋       | 100179/371472 [7:58:01<21:06:23,  3.57it/s]
 27%|██▋       | 100180/371472 [7:58:01<20:35:48,  3.66it/s]
                                                            
{'loss': 3.7023, 'learning_rate': 7.57638604581008e-07, 'epoch': 4.31}

 27%|██▋       | 100180/371472 [7:58:01<20:35:48,  3.66it/s]
 27%|██▋       | 100181/371472 [7:58:01<20:00:04,  3.77it/s]
 27%|██▋       | 100182/371472 [7:58:01<20:10:53,  3.73it/s]
 27%|██▋       | 100183/371472 [7:58:02<21:48:13,  3.46it/s]
 27%|██▋       | 100184/371472 [7:58:02<21:28:09,  3.51it/s]
 27%|██▋       | 100185/371472 [7:58:02<20:33:54,  3.66it/s]
 27%|██▋       | 100186/371472 [7:58:02<19:58:18,  3.77it/s]
 27%|██▋       | 100187/371472 [7:58:03<19:44:24,  3.82it/s]
 27%|██▋       | 100188/371472 [7:58:03<19:45:54,  3.81it/s]
 27%|██▋       | 100189/371472 [7:58:03<21:03:30,  3.58it/s]
 27%|██▋       | 100190/371472 [7:58:04<21:06:25,  3.57it/s]
 27%|██▋       | 100191/371472 [7:58:04<21:31:55,  3.50it/s]
 27%|██▋       | 100192/371472 [7:58:04<20:19:43,  3.71it/s]
 27%|██▋       | 100193/371472 [7:58:04<20:02:26,  3.76it/s]
 27%|██▋       | 100194/371472 [7:58:05<20:08:52,  3.74it/s]
 27%|██▋       | 100195/371472 [7:58:05<20:03:08,  3.76it/s]
 27%|██▋       | 100196/371472 [7:58:05<19:58:00,  3.77it/s]
 27%|██▋       | 100197/371472 [7:58:05<19:42:19,  3.82it/s]
 27%|██▋       | 100198/371472 [7:58:06<20:07:23,  3.74it/s]
 27%|██▋       | 100199/371472 [7:58:06<20:11:07,  3.73it/s]
 27%|██▋       | 100200/371472 [7:58:06<19:42:19,  3.82it/s]
                                                            
{'loss': 3.6696, 'learning_rate': 7.57590122605529e-07, 'epoch': 4.32}

 27%|██▋       | 100200/371472 [7:58:06<19:42:19,  3.82it/s]
 27%|██▋       | 100201/371472 [7:58:06<19:49:43,  3.80it/s]
 27%|██▋       | 100202/371472 [7:58:07<21:52:53,  3.44it/s]
 27%|██▋       | 100203/371472 [7:58:07<21:32:12,  3.50it/s]
 27%|██▋       | 100204/371472 [7:58:07<22:03:39,  3.42it/s]
 27%|██▋       | 100205/371472 [7:58:08<21:03:06,  3.58it/s]
 27%|██▋       | 100206/371472 [7:58:08<20:23:41,  3.69it/s]
 27%|██▋       | 100207/371472 [7:58:08<20:59:09,  3.59it/s]
 27%|██▋       | 100208/371472 [7:58:09<22:37:33,  3.33it/s]
 27%|██▋       | 100209/371472 [7:58:09<21:37:54,  3.48it/s]
 27%|██▋       | 100210/371472 [7:58:09<21:35:20,  3.49it/s]
 27%|██▋       | 100211/371472 [7:58:09<21:17:23,  3.54it/s]
 27%|██▋       | 100212/371472 [7:58:10<22:57:49,  3.28it/s]
 27%|██▋       | 100213/371472 [7:58:10<22:28:27,  3.35it/s]
 27%|██▋       | 100214/371472 [7:58:10<21:36:48,  3.49it/s]
 27%|██▋       | 100215/371472 [7:58:11<21:29:55,  3.50it/s]
 27%|██▋       | 100216/371472 [7:58:11<21:54:40,  3.44it/s]
 27%|██▋       | 100217/371472 [7:58:11<21:40:24,  3.48it/s]
 27%|██▋       | 100218/371472 [7:58:11<20:52:15,  3.61it/s]
 27%|██▋       | 100219/371472 [7:58:12<21:11:00,  3.56it/s]
 27%|██▋       | 100220/371472 [7:58:12<22:14:36,  3.39it/s]
                                                            
{'loss': 3.6333, 'learning_rate': 7.575416406300501e-07, 'epoch': 4.32}

 27%|██▋       | 100220/371472 [7:58:12<22:14:36,  3.39it/s]
 27%|██▋       | 100221/371472 [7:58:12<20:57:04,  3.60it/s]
 27%|██▋       | 100222/371472 [7:58:13<20:19:08,  3.71it/s]
 27%|██▋       | 100223/371472 [7:58:13<19:46:32,  3.81it/s]
 27%|██▋       | 100224/371472 [7:58:13<22:11:42,  3.39it/s]
 27%|██▋       | 100225/371472 [7:58:13<21:34:24,  3.49it/s]
 27%|██▋       | 100226/371472 [7:58:14<23:12:19,  3.25it/s]
 27%|██▋       | 100227/371472 [7:58:14<21:47:29,  3.46it/s]
 27%|██▋       | 100228/371472 [7:58:14<20:36:19,  3.66it/s]
 27%|██▋       | 100229/371472 [7:58:15<20:26:48,  3.68it/s]
 27%|██▋       | 100230/371472 [7:58:15<20:19:07,  3.71it/s]
 27%|██▋       | 100231/371472 [7:58:15<20:13:29,  3.73it/s]
 27%|██▋       | 100232/371472 [7:58:15<20:12:55,  3.73it/s]
 27%|██▋       | 100233/371472 [7:58:16<20:24:41,  3.69it/s]
 27%|██▋       | 100234/371472 [7:58:16<20:07:21,  3.74it/s]
 27%|██▋       | 100235/371472 [7:58:16<19:54:13,  3.79it/s]
 27%|██▋       | 100236/371472 [7:58:16<19:40:18,  3.83it/s]
 27%|██▋       | 100237/371472 [7:58:17<21:03:38,  3.58it/s]
 27%|██▋       | 100238/371472 [7:58:17<20:18:24,  3.71it/s]
 27%|██▋       | 100239/371472 [7:58:17<21:07:43,  3.57it/s]
 27%|██▋       | 100240/371472 [7:58:18<21:31:41,  3.50it/s]
                                                            
{'loss': 3.6335, 'learning_rate': 7.574931586545713e-07, 'epoch': 4.32}

 27%|██▋       | 100240/371472 [7:58:18<21:31:41,  3.50it/s]
 27%|██▋       | 100241/371472 [7:58:18<22:16:55,  3.38it/s]
 27%|██▋       | 100242/371472 [7:58:18<23:21:37,  3.23it/s]
 27%|██▋       | 100243/371472 [7:58:19<24:02:35,  3.13it/s]
 27%|██▋       | 100244/371472 [7:58:19<23:02:42,  3.27it/s]
 27%|██▋       | 100245/371472 [7:58:19<22:54:00,  3.29it/s]
 27%|██▋       | 100246/371472 [7:58:19<22:37:32,  3.33it/s]
 27%|██▋       | 100247/371472 [7:58:20<21:47:45,  3.46it/s]
 27%|██▋       | 100248/371472 [7:58:20<21:05:33,  3.57it/s]
 27%|██▋       | 100249/371472 [7:58:20<21:58:24,  3.43it/s]
 27%|██▋       | 100250/371472 [7:58:20<21:00:25,  3.59it/s]
 27%|██▋       | 100251/371472 [7:58:21<21:24:18,  3.52it/s]
 27%|██▋       | 100252/371472 [7:58:21<22:26:49,  3.36it/s]
 27%|██▋       | 100253/371472 [7:58:22<25:24:47,  2.96it/s]
 27%|██▋       | 100254/371472 [7:58:22<25:21:33,  2.97it/s]
 27%|██▋       | 100255/371472 [7:58:22<27:01:26,  2.79it/s]
 27%|██▋       | 100256/371472 [7:58:23<25:28:22,  2.96it/s]
 27%|██▋       | 100257/371472 [7:58:23<25:32:24,  2.95it/s]
 27%|██▋       | 100258/371472 [7:58:23<25:07:53,  3.00it/s]
 27%|██▋       | 100259/371472 [7:58:24<24:43:03,  3.05it/s]
 27%|██▋       | 100260/371472 [7:58:24<23:17:49,  3.23it/s]
                                                            
{'loss': 3.4217, 'learning_rate': 7.574446766790925e-07, 'epoch': 4.32}

 27%|██▋       | 100260/371472 [7:58:24<23:17:49,  3.23it/s]
 27%|██▋       | 100261/371472 [7:58:24<22:38:33,  3.33it/s]
 27%|██▋       | 100262/371472 [7:58:24<21:36:42,  3.49it/s]
 27%|██▋       | 100263/371472 [7:58:25<22:05:36,  3.41it/s]
 27%|██▋       | 100264/371472 [7:58:25<23:45:59,  3.17it/s]
 27%|██▋       | 100265/371472 [7:58:25<22:25:25,  3.36it/s]
 27%|██▋       | 100266/371472 [7:58:26<22:12:02,  3.39it/s]
 27%|██▋       | 100267/371472 [7:58:26<21:05:20,  3.57it/s]
 27%|██▋       | 100268/371472 [7:58:26<21:53:42,  3.44it/s]
 27%|██▋       | 100269/371472 [7:58:26<22:24:21,  3.36it/s]
 27%|██▋       | 100270/371472 [7:58:27<22:45:13,  3.31it/s]
 27%|██▋       | 100271/371472 [7:58:27<22:42:43,  3.32it/s]
 27%|██▋       | 100272/371472 [7:58:27<21:53:54,  3.44it/s]
 27%|██▋       | 100273/371472 [7:58:28<22:53:38,  3.29it/s]
 27%|██▋       | 100274/371472 [7:58:28<21:18:17,  3.54it/s]
 27%|██▋       | 100275/371472 [7:58:28<21:33:23,  3.49it/s]
 27%|██▋       | 100276/371472 [7:58:29<28:30:20,  2.64it/s]
 27%|██▋       | 100277/371472 [7:58:29<25:34:56,  2.94it/s]
 27%|██▋       | 100278/371472 [7:58:29<23:39:36,  3.18it/s]
 27%|██▋       | 100279/371472 [7:58:30<24:01:07,  3.14it/s]
 27%|██▋       | 100280/371472 [7:58:30<22:39:30,  3.32it/s]
                                                            
{'loss': 3.4638, 'learning_rate': 7.573961947036134e-07, 'epoch': 4.32}

 27%|██▋       | 100280/371472 [7:58:30<22:39:30,  3.32it/s]
 27%|██▋       | 100281/371472 [7:58:30<21:45:43,  3.46it/s]
 27%|██▋       | 100282/371472 [7:58:30<21:26:04,  3.51it/s]
 27%|██▋       | 100283/371472 [7:58:31<20:54:38,  3.60it/s]
 27%|██▋       | 100284/371472 [7:58:31<21:24:31,  3.52it/s]
 27%|██▋       | 100285/371472 [7:58:31<21:19:33,  3.53it/s]
 27%|██▋       | 100286/371472 [7:58:32<22:21:51,  3.37it/s]
 27%|██▋       | 100287/371472 [7:58:32<21:10:15,  3.56it/s]
 27%|██▋       | 100288/371472 [7:58:32<21:50:26,  3.45it/s]
 27%|██▋       | 100289/371472 [7:58:32<21:01:36,  3.58it/s]
 27%|██▋       | 100290/371472 [7:58:33<21:39:38,  3.48it/s]
 27%|██▋       | 100291/371472 [7:58:33<21:32:12,  3.50it/s]
 27%|██▋       | 100292/371472 [7:58:33<25:22:18,  2.97it/s]
 27%|██▋       | 100293/371472 [7:58:34<24:07:04,  3.12it/s]
 27%|██▋       | 100294/371472 [7:58:34<23:35:59,  3.19it/s]
 27%|██▋       | 100295/371472 [7:58:34<23:30:12,  3.20it/s]
 27%|██▋       | 100296/371472 [7:58:35<24:34:26,  3.07it/s]
 27%|██▋       | 100297/371472 [7:58:35<24:43:55,  3.05it/s]
 27%|██▋       | 100298/371472 [7:58:35<23:23:29,  3.22it/s]
 27%|██▋       | 100299/371472 [7:58:36<21:54:20,  3.44it/s]
 27%|██▋       | 100300/371472 [7:58:36<21:13:43,  3.55it/s]
                                                            
{'loss': 3.6377, 'learning_rate': 7.573477127281345e-07, 'epoch': 4.32}

 27%|██▋       | 100300/371472 [7:58:36<21:13:43,  3.55it/s]
 27%|██▋       | 100301/371472 [7:58:36<21:05:36,  3.57it/s]
 27%|██▋       | 100302/371472 [7:58:36<20:57:53,  3.59it/s]
 27%|██▋       | 100303/371472 [7:58:37<20:46:21,  3.63it/s]
 27%|██▋       | 100304/371472 [7:58:37<20:35:00,  3.66it/s]
 27%|██▋       | 100305/371472 [7:58:37<21:06:55,  3.57it/s]
 27%|██▋       | 100306/371472 [7:58:37<21:17:59,  3.54it/s]
 27%|██▋       | 100307/371472 [7:58:38<23:05:08,  3.26it/s]
 27%|██▋       | 100308/371472 [7:58:38<22:46:39,  3.31it/s]
 27%|██▋       | 100309/371472 [7:58:38<22:03:03,  3.42it/s]
 27%|██▋       | 100310/371472 [7:58:39<21:05:48,  3.57it/s]
 27%|██▋       | 100311/371472 [7:58:39<20:21:09,  3.70it/s]
 27%|██▋       | 100312/371472 [7:58:39<20:29:35,  3.68it/s]
 27%|██▋       | 100313/371472 [7:58:39<21:38:21,  3.48it/s]
 27%|██▋       | 100314/371472 [7:58:40<22:34:09,  3.34it/s]
 27%|██▋       | 100315/371472 [7:58:40<21:31:36,  3.50it/s]
 27%|██▋       | 100316/371472 [7:58:40<21:02:30,  3.58it/s]
 27%|██▋       | 100317/371472 [7:58:41<20:32:08,  3.67it/s]
 27%|██▋       | 100318/371472 [7:58:41<19:36:13,  3.84it/s]
 27%|██▋       | 100319/371472 [7:58:41<21:59:24,  3.43it/s]
 27%|██▋       | 100320/371472 [7:58:41<22:10:28,  3.40it/s]
                                                            
{'loss': 3.5025, 'learning_rate': 7.572992307526557e-07, 'epoch': 4.32}

 27%|██▋       | 100320/371472 [7:58:41<22:10:28,  3.40it/s]
 27%|██▋       | 100321/371472 [7:58:42<21:38:44,  3.48it/s]
 27%|██▋       | 100322/371472 [7:58:42<20:30:42,  3.67it/s]
 27%|██▋       | 100323/371472 [7:58:42<20:22:16,  3.70it/s]
 27%|██▋       | 100324/371472 [7:58:43<20:19:52,  3.70it/s]
 27%|██▋       | 100325/371472 [7:58:43<20:33:16,  3.66it/s]
 27%|██▋       | 100326/371472 [7:58:43<20:26:33,  3.68it/s]
 27%|██▋       | 100327/371472 [7:58:43<22:00:59,  3.42it/s]
 27%|██▋       | 100328/371472 [7:58:44<20:52:21,  3.61it/s]
 27%|██▋       | 100329/371472 [7:58:44<22:49:27,  3.30it/s]
 27%|██▋       | 100330/371472 [7:58:44<22:04:49,  3.41it/s]
 27%|██▋       | 100331/371472 [7:58:45<23:39:26,  3.18it/s]
 27%|██▋       | 100332/371472 [7:58:45<23:40:42,  3.18it/s]
 27%|██▋       | 100333/371472 [7:58:45<24:18:33,  3.10it/s]
 27%|██▋       | 100334/371472 [7:58:46<22:42:30,  3.32it/s]
 27%|██▋       | 100335/371472 [7:58:46<23:14:07,  3.24it/s]
 27%|██▋       | 100336/371472 [7:58:46<22:22:14,  3.37it/s]
 27%|██▋       | 100337/371472 [7:58:47<23:21:40,  3.22it/s]
 27%|██▋       | 100338/371472 [7:58:47<22:16:11,  3.38it/s]
 27%|██▋       | 100339/371472 [7:58:47<22:07:01,  3.41it/s]
 27%|██▋       | 100340/371472 [7:58:47<22:38:19,  3.33it/s]
                                                            
{'loss': 3.4211, 'learning_rate': 7.572507487771769e-07, 'epoch': 4.32}

 27%|██▋       | 100340/371472 [7:58:47<22:38:19,  3.33it/s]
 27%|██▋       | 100341/371472 [7:58:48<22:50:59,  3.30it/s]
 27%|██▋       | 100342/371472 [7:58:48<21:49:45,  3.45it/s]
 27%|██▋       | 100343/371472 [7:58:48<21:45:46,  3.46it/s]
 27%|██▋       | 100344/371472 [7:58:49<21:34:05,  3.49it/s]
 27%|██▋       | 100345/371472 [7:58:49<21:49:19,  3.45it/s]
 27%|██▋       | 100346/371472 [7:58:49<21:17:21,  3.54it/s]
 27%|██▋       | 100347/371472 [7:58:49<22:14:27,  3.39it/s]
 27%|██▋       | 100348/371472 [7:58:50<22:05:14,  3.41it/s]
 27%|██▋       | 100349/371472 [7:58:50<21:55:25,  3.44it/s]
 27%|██▋       | 100350/371472 [7:58:50<21:55:32,  3.43it/s]
 27%|██▋       | 100351/371472 [7:58:51<21:13:33,  3.55it/s]
 27%|██▋       | 100352/371472 [7:58:51<21:57:14,  3.43it/s]
 27%|██▋       | 100353/371472 [7:58:51<20:56:57,  3.59it/s]
 27%|██▋       | 100354/371472 [7:58:51<20:10:39,  3.73it/s]
 27%|██▋       | 100355/371472 [7:58:52<21:43:20,  3.47it/s]
 27%|██▋       | 100356/371472 [7:58:52<21:03:48,  3.58it/s]
 27%|██▋       | 100357/371472 [7:58:52<20:22:19,  3.70it/s]
 27%|██▋       | 100358/371472 [7:58:52<20:51:40,  3.61it/s]
 27%|██▋       | 100359/371472 [7:58:53<21:40:57,  3.47it/s]
 27%|██▋       | 100360/371472 [7:58:53<22:23:51,  3.36it/s]
                                                            
{'loss': 3.4665, 'learning_rate': 7.572022668016979e-07, 'epoch': 4.32}

 27%|██▋       | 100360/371472 [7:58:53<22:23:51,  3.36it/s]
 27%|██▋       | 100361/371472 [7:58:53<22:15:27,  3.38it/s]
 27%|██▋       | 100362/371472 [7:58:54<21:45:34,  3.46it/s]
 27%|██▋       | 100363/371472 [7:58:54<22:06:13,  3.41it/s]
 27%|██▋       | 100364/371472 [7:58:54<21:39:51,  3.48it/s]
 27%|██▋       | 100365/371472 [7:58:55<21:12:11,  3.55it/s]
 27%|██▋       | 100366/371472 [7:58:55<22:32:58,  3.34it/s]
 27%|██▋       | 100367/371472 [7:58:55<25:09:07,  2.99it/s]
 27%|██▋       | 100368/371472 [7:58:56<23:49:53,  3.16it/s]
 27%|██▋       | 100369/371472 [7:58:56<22:51:38,  3.29it/s]
 27%|██▋       | 100370/371472 [7:58:56<24:57:43,  3.02it/s]
 27%|██▋       | 100371/371472 [7:58:56<23:42:58,  3.18it/s]
 27%|██▋       | 100372/371472 [7:58:57<23:22:41,  3.22it/s]
 27%|██▋       | 100373/371472 [7:58:57<23:27:24,  3.21it/s]
 27%|██▋       | 100374/371472 [7:58:57<24:01:59,  3.13it/s]
 27%|██▋       | 100375/371472 [7:58:58<22:40:55,  3.32it/s]
 27%|██▋       | 100376/371472 [7:58:58<21:53:37,  3.44it/s]
 27%|██▋       | 100377/371472 [7:58:58<22:21:07,  3.37it/s]
 27%|██▋       | 100378/371472 [7:58:59<21:41:13,  3.47it/s]
 27%|██▋       | 100379/371472 [7:58:59<20:52:42,  3.61it/s]
 27%|██▋       | 100380/371472 [7:58:59<21:00:20,  3.58it/s]
                                                            
{'loss': 3.635, 'learning_rate': 7.57153784826219e-07, 'epoch': 4.32}

 27%|██▋       | 100380/371472 [7:58:59<21:00:20,  3.58it/s]
 27%|██▋       | 100381/371472 [7:58:59<20:25:27,  3.69it/s]
 27%|██▋       | 100382/371472 [7:59:00<19:50:41,  3.79it/s]
 27%|██▋       | 100383/371472 [7:59:00<19:40:38,  3.83it/s]
 27%|██▋       | 100384/371472 [7:59:00<20:02:25,  3.76it/s]
 27%|██▋       | 100385/371472 [7:59:00<21:31:48,  3.50it/s]
 27%|██▋       | 100386/371472 [7:59:01<21:18:15,  3.53it/s]
 27%|██▋       | 100387/371472 [7:59:01<20:52:48,  3.61it/s]
 27%|██▋       | 100388/371472 [7:59:01<20:40:24,  3.64it/s]
 27%|██▋       | 100389/371472 [7:59:01<19:51:04,  3.79it/s]
 27%|██▋       | 100390/371472 [7:59:02<19:23:48,  3.88it/s]
 27%|██▋       | 100391/371472 [7:59:02<18:54:46,  3.98it/s]
 27%|██▋       | 100392/371472 [7:59:02<19:02:39,  3.95it/s]
 27%|██▋       | 100393/371472 [7:59:03<19:51:33,  3.79it/s]
 27%|██▋       | 100394/371472 [7:59:03<20:45:55,  3.63it/s]
 27%|██▋       | 100395/371472 [7:59:03<19:48:04,  3.80it/s]
 27%|██▋       | 100396/371472 [7:59:03<19:34:57,  3.85it/s]
 27%|██▋       | 100397/371472 [7:59:04<19:13:45,  3.92it/s]
 27%|██▋       | 100398/371472 [7:59:04<19:23:15,  3.88it/s]
 27%|██▋       | 100399/371472 [7:59:04<19:41:08,  3.83it/s]
 27%|██▋       | 100400/371472 [7:59:04<19:56:05,  3.78it/s]
                                                            
{'loss': 3.7561, 'learning_rate': 7.571053028507401e-07, 'epoch': 4.32}

 27%|██▋       | 100400/371472 [7:59:04<19:56:05,  3.78it/s]
 27%|██▋       | 100401/371472 [7:59:05<20:08:07,  3.74it/s]
 27%|██▋       | 100402/371472 [7:59:05<21:14:38,  3.54it/s]
 27%|██▋       | 100403/371472 [7:59:05<20:46:55,  3.62it/s]
 27%|██▋       | 100404/371472 [7:59:06<22:38:11,  3.33it/s]
 27%|██▋       | 100405/371472 [7:59:06<21:45:05,  3.46it/s]
 27%|██▋       | 100406/371472 [7:59:06<21:28:23,  3.51it/s]
 27%|██▋       | 100407/371472 [7:59:06<21:21:34,  3.53it/s]
 27%|██▋       | 100408/371472 [7:59:07<21:03:44,  3.57it/s]
 27%|██▋       | 100409/371472 [7:59:07<21:26:35,  3.51it/s]
 27%|██▋       | 100410/371472 [7:59:07<20:17:04,  3.71it/s]
 27%|██▋       | 100411/371472 [7:59:08<21:54:42,  3.44it/s]
 27%|██▋       | 100412/371472 [7:59:08<22:11:15,  3.39it/s]
 27%|██▋       | 100413/371472 [7:59:08<21:58:38,  3.43it/s]
 27%|██▋       | 100414/371472 [7:59:08<21:29:17,  3.50it/s]
 27%|██▋       | 100415/371472 [7:59:09<20:33:43,  3.66it/s]
 27%|██▋       | 100416/371472 [7:59:09<20:20:18,  3.70it/s]
 27%|██▋       | 100417/371472 [7:59:09<19:37:59,  3.83it/s]
 27%|██▋       | 100418/371472 [7:59:09<19:05:57,  3.94it/s]
 27%|██▋       | 100419/371472 [7:59:10<19:39:34,  3.83it/s]
 27%|██▋       | 100420/371472 [7:59:10<19:46:53,  3.81it/s]
                                                            
{'loss': 3.6254, 'learning_rate': 7.570568208752613e-07, 'epoch': 4.33}

 27%|██▋       | 100420/371472 [7:59:10<19:46:53,  3.81it/s]
 27%|██▋       | 100421/371472 [7:59:10<19:43:51,  3.82it/s]
 27%|██▋       | 100422/371472 [7:59:10<19:34:27,  3.85it/s]
 27%|██▋       | 100423/371472 [7:59:11<19:17:56,  3.90it/s]
 27%|██▋       | 100424/371472 [7:59:11<20:44:32,  3.63it/s]
 27%|██▋       | 100425/371472 [7:59:11<20:34:28,  3.66it/s]
 27%|██▋       | 100426/371472 [7:59:12<20:35:15,  3.66it/s]
 27%|██▋       | 100427/371472 [7:59:12<20:46:24,  3.62it/s]
 27%|██▋       | 100428/371472 [7:59:12<20:59:33,  3.59it/s]
 27%|██▋       | 100429/371472 [7:59:12<21:54:32,  3.44it/s]
 27%|██▋       | 100430/371472 [7:59:13<20:47:29,  3.62it/s]
 27%|██▋       | 100431/371472 [7:59:13<21:21:19,  3.53it/s]
 27%|██▋       | 100432/371472 [7:59:13<20:56:35,  3.59it/s]
 27%|██▋       | 100433/371472 [7:59:13<20:08:05,  3.74it/s]
 27%|██▋       | 100434/371472 [7:59:14<19:56:11,  3.78it/s]
 27%|██▋       | 100435/371472 [7:59:14<21:47:44,  3.45it/s]
 27%|██▋       | 100436/371472 [7:59:14<23:16:34,  3.23it/s]
 27%|██▋       | 100437/371472 [7:59:15<22:30:04,  3.35it/s]
 27%|██▋       | 100438/371472 [7:59:15<22:00:59,  3.42it/s]
 27%|██▋       | 100439/371472 [7:59:15<21:36:23,  3.48it/s]
 27%|██▋       | 100440/371472 [7:59:16<21:00:15,  3.58it/s]
                                                            
{'loss': 3.3085, 'learning_rate': 7.570083388997823e-07, 'epoch': 4.33}

 27%|██▋       | 100440/371472 [7:59:16<21:00:15,  3.58it/s]
 27%|██▋       | 100441/371472 [7:59:16<20:11:36,  3.73it/s]
 27%|██▋       | 100442/371472 [7:59:16<20:33:19,  3.66it/s]
 27%|██▋       | 100443/371472 [7:59:16<19:59:31,  3.77it/s]
 27%|██▋       | 100444/371472 [7:59:17<20:36:29,  3.65it/s]
 27%|██▋       | 100445/371472 [7:59:17<20:16:32,  3.71it/s]
 27%|██▋       | 100446/371472 [7:59:17<20:17:39,  3.71it/s]
 27%|██▋       | 100447/371472 [7:59:17<20:34:39,  3.66it/s]
 27%|██▋       | 100448/371472 [7:59:18<20:53:31,  3.60it/s]
 27%|██▋       | 100449/371472 [7:59:18<20:56:42,  3.59it/s]
 27%|██▋       | 100450/371472 [7:59:18<20:22:49,  3.69it/s]
 27%|██▋       | 100451/371472 [7:59:18<20:28:38,  3.68it/s]
 27%|██▋       | 100452/371472 [7:59:19<21:00:09,  3.58it/s]
 27%|██▋       | 100453/371472 [7:59:19<20:16:29,  3.71it/s]
 27%|██▋       | 100454/371472 [7:59:19<19:29:39,  3.86it/s]
 27%|██▋       | 100455/371472 [7:59:20<19:31:07,  3.86it/s]
 27%|██▋       | 100456/371472 [7:59:20<19:34:43,  3.85it/s]
 27%|██▋       | 100457/371472 [7:59:20<19:58:17,  3.77it/s]
 27%|██▋       | 100458/371472 [7:59:20<20:11:01,  3.73it/s]
 27%|██▋       | 100459/371472 [7:59:21<19:51:09,  3.79it/s]
 27%|██▋       | 100460/371472 [7:59:21<21:00:21,  3.58it/s]
                                                            
{'loss': 3.4187, 'learning_rate': 7.569598569243034e-07, 'epoch': 4.33}

 27%|██▋       | 100460/371472 [7:59:21<21:00:21,  3.58it/s]
 27%|██▋       | 100461/371472 [7:59:21<20:14:26,  3.72it/s]
 27%|██▋       | 100462/371472 [7:59:21<20:18:45,  3.71it/s]
 27%|██▋       | 100463/371472 [7:59:22<20:05:50,  3.75it/s]
 27%|██▋       | 100464/371472 [7:59:22<20:26:49,  3.68it/s]
 27%|██▋       | 100465/371472 [7:59:22<20:31:07,  3.67it/s]
 27%|██▋       | 100466/371472 [7:59:23<21:19:47,  3.53it/s]
 27%|██▋       | 100467/371472 [7:59:23<20:45:11,  3.63it/s]
 27%|██▋       | 100468/371472 [7:59:23<20:48:57,  3.62it/s]
 27%|██▋       | 100469/371472 [7:59:23<20:16:24,  3.71it/s]
 27%|██▋       | 100470/371472 [7:59:24<20:07:35,  3.74it/s]
 27%|██▋       | 100471/371472 [7:59:24<19:59:06,  3.77it/s]
 27%|██▋       | 100472/371472 [7:59:24<20:27:29,  3.68it/s]
 27%|██▋       | 100473/371472 [7:59:24<20:46:51,  3.62it/s]
 27%|██▋       | 100474/371472 [7:59:25<21:06:47,  3.57it/s]
 27%|██▋       | 100475/371472 [7:59:25<21:22:32,  3.52it/s]
 27%|██▋       | 100476/371472 [7:59:25<20:42:18,  3.64it/s]
 27%|██▋       | 100477/371472 [7:59:26<21:52:14,  3.44it/s]
 27%|██▋       | 100478/371472 [7:59:26<20:52:43,  3.61it/s]
 27%|██▋       | 100479/371472 [7:59:26<21:13:49,  3.55it/s]
 27%|██▋       | 100480/371472 [7:59:26<22:26:50,  3.35it/s]
                                                            
{'loss': 3.4405, 'learning_rate': 7.569113749488246e-07, 'epoch': 4.33}

 27%|██▋       | 100480/371472 [7:59:26<22:26:50,  3.35it/s]
 27%|██▋       | 100481/371472 [7:59:27<22:11:19,  3.39it/s]
 27%|██▋       | 100482/371472 [7:59:27<21:52:55,  3.44it/s]
 27%|██▋       | 100483/371472 [7:59:27<21:29:06,  3.50it/s]
 27%|██▋       | 100484/371472 [7:59:28<22:47:55,  3.30it/s]
 27%|██▋       | 100485/371472 [7:59:28<24:16:36,  3.10it/s]
 27%|██▋       | 100486/371472 [7:59:28<23:31:22,  3.20it/s]
 27%|██▋       | 100487/371472 [7:59:29<23:43:11,  3.17it/s]
 27%|██▋       | 100488/371472 [7:59:29<22:25:59,  3.36it/s]
 27%|██▋       | 100489/371472 [7:59:29<21:26:55,  3.51it/s]
 27%|██▋       | 100490/371472 [7:59:30<23:03:43,  3.26it/s]
 27%|██▋       | 100491/371472 [7:59:30<21:45:30,  3.46it/s]
 27%|██▋       | 100492/371472 [7:59:30<22:27:31,  3.35it/s]
 27%|██▋       | 100493/371472 [7:59:30<22:21:13,  3.37it/s]
 27%|██▋       | 100494/371472 [7:59:31<21:56:43,  3.43it/s]
 27%|██▋       | 100495/371472 [7:59:31<21:21:04,  3.53it/s]
 27%|██▋       | 100496/371472 [7:59:31<21:29:46,  3.50it/s]
 27%|██▋       | 100497/371472 [7:59:31<21:07:09,  3.56it/s]
 27%|██▋       | 100498/371472 [7:59:32<20:48:49,  3.62it/s]
 27%|██▋       | 100499/371472 [7:59:32<20:51:29,  3.61it/s]
 27%|██▋       | 100500/371472 [7:59:32<20:48:34,  3.62it/s]
                                                            
{'loss': 3.619, 'learning_rate': 7.568628929733458e-07, 'epoch': 4.33}

 27%|██▋       | 100500/371472 [7:59:32<20:48:34,  3.62it/s]
 27%|██▋       | 100501/371472 [7:59:33<21:52:23,  3.44it/s]
 27%|██▋       | 100502/371472 [7:59:33<21:43:50,  3.46it/s]
 27%|██▋       | 100503/371472 [7:59:33<21:38:06,  3.48it/s]
 27%|██▋       | 100504/371472 [7:59:33<20:50:42,  3.61it/s]
 27%|██▋       | 100505/371472 [7:59:34<21:25:30,  3.51it/s]
 27%|██▋       | 100506/371472 [7:59:34<21:38:19,  3.48it/s]
 27%|██▋       | 100507/371472 [7:59:34<20:57:54,  3.59it/s]
 27%|██▋       | 100508/371472 [7:59:35<21:07:18,  3.56it/s]
 27%|██▋       | 100509/371472 [7:59:35<20:51:08,  3.61it/s]
 27%|██▋       | 100510/371472 [7:59:35<22:42:19,  3.31it/s]
 27%|██▋       | 100511/371472 [7:59:36<23:11:37,  3.25it/s]
 27%|██▋       | 100512/371472 [7:59:36<23:19:16,  3.23it/s]
 27%|██▋       | 100513/371472 [7:59:36<21:58:16,  3.43it/s]
 27%|██▋       | 100514/371472 [7:59:36<21:21:08,  3.52it/s]
 27%|██▋       | 100515/371472 [7:59:37<23:00:45,  3.27it/s]
 27%|██▋       | 100516/371472 [7:59:37<21:55:16,  3.43it/s]
 27%|██▋       | 100517/371472 [7:59:37<20:54:11,  3.60it/s]
 27%|██▋       | 100518/371472 [7:59:38<22:44:01,  3.31it/s]
 27%|██▋       | 100519/371472 [7:59:38<21:15:02,  3.54it/s]
 27%|██▋       | 100520/371472 [7:59:38<21:05:05,  3.57it/s]
                                                            
{'loss': 3.6213, 'learning_rate': 7.568144109978667e-07, 'epoch': 4.33}

 27%|██▋       | 100520/371472 [7:59:38<21:05:05,  3.57it/s]
 27%|██▋       | 100521/371472 [7:59:38<21:12:06,  3.55it/s]
 27%|██▋       | 100522/371472 [7:59:39<21:38:24,  3.48it/s]
 27%|██▋       | 100523/371472 [7:59:39<20:24:34,  3.69it/s]
 27%|██▋       | 100524/371472 [7:59:39<21:11:48,  3.55it/s]
 27%|██▋       | 100525/371472 [7:59:40<21:41:28,  3.47it/s]
 27%|██▋       | 100526/371472 [7:59:40<21:40:15,  3.47it/s]
 27%|██▋       | 100527/371472 [7:59:40<20:46:59,  3.62it/s]
 27%|██▋       | 100528/371472 [7:59:40<20:02:19,  3.76it/s]
 27%|██▋       | 100529/371472 [7:59:41<20:25:05,  3.69it/s]
 27%|██▋       | 100530/371472 [7:59:41<20:32:11,  3.66it/s]
 27%|██▋       | 100531/371472 [7:59:41<20:10:36,  3.73it/s]
 27%|██▋       | 100532/371472 [7:59:41<21:49:18,  3.45it/s]
 27%|██▋       | 100533/371472 [7:59:42<21:17:04,  3.54it/s]
 27%|██▋       | 100534/371472 [7:59:42<20:58:03,  3.59it/s]
 27%|██▋       | 100535/371472 [7:59:42<20:28:05,  3.68it/s]
 27%|██▋       | 100536/371472 [7:59:42<19:54:36,  3.78it/s]
 27%|██▋       | 100537/371472 [7:59:43<19:41:20,  3.82it/s]
 27%|██▋       | 100538/371472 [7:59:43<20:22:34,  3.69it/s]
 27%|██▋       | 100539/371472 [7:59:43<20:06:30,  3.74it/s]
 27%|██▋       | 100540/371472 [7:59:44<21:42:19,  3.47it/s]
                                                            
{'loss': 3.5508, 'learning_rate': 7.567659290223878e-07, 'epoch': 4.33}

 27%|██▋       | 100540/371472 [7:59:44<21:42:19,  3.47it/s]
 27%|██▋       | 100541/371472 [7:59:44<21:03:39,  3.57it/s]
 27%|██▋       | 100542/371472 [7:59:44<20:50:19,  3.61it/s]
 27%|██▋       | 100543/371472 [7:59:44<20:10:34,  3.73it/s]
 27%|██▋       | 100544/371472 [7:59:45<20:18:21,  3.71it/s]
 27%|██▋       | 100545/371472 [7:59:45<20:35:10,  3.66it/s]
 27%|██▋       | 100546/371472 [7:59:45<20:32:48,  3.66it/s]
 27%|██▋       | 100547/371472 [7:59:46<21:45:50,  3.46it/s]
 27%|██▋       | 100548/371472 [7:59:46<21:11:35,  3.55it/s]
 27%|██▋       | 100549/371472 [7:59:46<24:32:52,  3.07it/s]
 27%|██▋       | 100550/371472 [7:59:47<22:51:33,  3.29it/s]
 27%|██▋       | 100551/371472 [7:59:47<22:16:48,  3.38it/s]
 27%|██▋       | 100552/371472 [7:59:47<21:00:33,  3.58it/s]
 27%|██▋       | 100553/371472 [7:59:47<20:22:07,  3.69it/s]
 27%|██▋       | 100554/371472 [7:59:48<21:05:52,  3.57it/s]
 27%|██▋       | 100555/371472 [7:59:48<20:13:39,  3.72it/s]
 27%|██▋       | 100556/371472 [7:59:48<20:36:01,  3.65it/s]
 27%|██▋       | 100557/371472 [7:59:48<21:11:25,  3.55it/s]
 27%|██▋       | 100558/371472 [7:59:49<20:54:40,  3.60it/s]
 27%|██▋       | 100559/371472 [7:59:49<20:43:43,  3.63it/s]
 27%|██▋       | 100560/371472 [7:59:49<21:10:23,  3.55it/s]
                                                            
{'loss': 3.4848, 'learning_rate': 7.56717447046909e-07, 'epoch': 4.33}

 27%|██▋       | 100560/371472 [7:59:49<21:10:23,  3.55it/s]
 27%|██▋       | 100561/371472 [7:59:50<22:14:45,  3.38it/s]
 27%|██▋       | 100562/371472 [7:59:50<21:24:40,  3.51it/s]
 27%|██▋       | 100563/371472 [7:59:50<22:04:26,  3.41it/s]
 27%|██▋       | 100564/371472 [7:59:50<21:42:45,  3.47it/s]
 27%|██▋       | 100565/371472 [7:59:51<21:08:52,  3.56it/s]
 27%|██▋       | 100566/371472 [7:59:51<20:26:32,  3.68it/s]
 27%|██▋       | 100567/371472 [7:59:51<21:28:03,  3.51it/s]
 27%|██▋       | 100568/371472 [7:59:52<21:47:44,  3.45it/s]
 27%|██▋       | 100569/371472 [7:59:52<20:39:16,  3.64it/s]
 27%|██▋       | 100570/371472 [7:59:52<20:14:32,  3.72it/s]
 27%|██▋       | 100571/371472 [7:59:52<19:51:22,  3.79it/s]
 27%|██▋       | 100572/371472 [7:59:53<21:26:16,  3.51it/s]
 27%|██▋       | 100573/371472 [7:59:53<23:41:08,  3.18it/s]
 27%|██▋       | 100574/371472 [7:59:53<23:13:45,  3.24it/s]
 27%|██▋       | 100575/371472 [7:59:54<22:43:59,  3.31it/s]
 27%|██▋       | 100576/371472 [7:59:54<21:55:09,  3.43it/s]
 27%|██▋       | 100577/371472 [7:59:54<20:56:07,  3.59it/s]
 27%|██▋       | 100578/371472 [7:59:54<22:41:57,  3.32it/s]
 27%|██▋       | 100579/371472 [7:59:55<21:21:04,  3.52it/s]
 27%|██▋       | 100580/371472 [7:59:55<21:31:35,  3.50it/s]
                                                            
{'loss': 3.4511, 'learning_rate': 7.566689650714301e-07, 'epoch': 4.33}

 27%|██▋       | 100580/371472 [7:59:55<21:31:35,  3.50it/s]
 27%|██▋       | 100581/371472 [7:59:55<20:43:26,  3.63it/s]
 27%|██▋       | 100582/371472 [7:59:56<20:36:07,  3.65it/s]
 27%|██▋       | 100583/371472 [7:59:56<21:03:21,  3.57it/s]
 27%|██▋       | 100584/371472 [7:59:56<22:36:02,  3.33it/s]
 27%|██▋       | 100585/371472 [7:59:56<23:08:01,  3.25it/s]
 27%|██▋       | 100586/371472 [7:59:57<21:45:08,  3.46it/s]
 27%|██▋       | 100587/371472 [7:59:57<21:29:35,  3.50it/s]
 27%|██▋       | 100588/371472 [7:59:57<21:49:17,  3.45it/s]
 27%|██▋       | 100589/371472 [7:59:58<21:31:36,  3.50it/s]
 27%|██▋       | 100590/371472 [7:59:58<20:21:46,  3.70it/s]
 27%|██▋       | 100591/371472 [7:59:58<20:30:43,  3.67it/s]
 27%|██▋       | 100592/371472 [7:59:58<21:01:43,  3.58it/s]
 27%|██▋       | 100593/371472 [7:59:59<21:37:13,  3.48it/s]
 27%|██▋       | 100594/371472 [7:59:59<21:31:22,  3.50it/s]
 27%|██▋       | 100595/371472 [7:59:59<21:19:46,  3.53it/s]
 27%|██▋       | 100596/371472 [8:00:00<21:33:43,  3.49it/s]
 27%|██▋       | 100597/371472 [8:00:00<21:21:42,  3.52it/s]
 27%|██▋       | 100598/371472 [8:00:00<20:50:34,  3.61it/s]
 27%|██▋       | 100599/371472 [8:00:00<20:06:09,  3.74it/s]
 27%|██▋       | 100600/371472 [8:00:01<20:25:52,  3.68it/s]
                                                            
{'loss': 3.5972, 'learning_rate': 7.566204830959512e-07, 'epoch': 4.33}

 27%|██▋       | 100600/371472 [8:00:01<20:25:52,  3.68it/s]
 27%|██▋       | 100601/371472 [8:00:01<19:46:16,  3.81it/s]
 27%|██▋       | 100602/371472 [8:00:01<21:44:45,  3.46it/s]
 27%|██▋       | 100603/371472 [8:00:01<21:19:43,  3.53it/s]
 27%|██▋       | 100604/371472 [8:00:02<23:15:12,  3.24it/s]
 27%|██▋       | 100605/371472 [8:00:02<23:58:46,  3.14it/s]
 27%|██▋       | 100606/371472 [8:00:02<22:38:47,  3.32it/s]
 27%|██▋       | 100607/371472 [8:00:03<22:35:44,  3.33it/s]
 27%|██▋       | 100608/371472 [8:00:03<22:32:26,  3.34it/s]
 27%|██▋       | 100609/371472 [8:00:03<21:46:34,  3.46it/s]
 27%|██▋       | 100610/371472 [8:00:04<20:59:12,  3.59it/s]
 27%|██▋       | 100611/371472 [8:00:04<20:19:09,  3.70it/s]
 27%|██▋       | 100612/371472 [8:00:04<19:56:17,  3.77it/s]
 27%|██▋       | 100613/371472 [8:00:04<20:05:02,  3.75it/s]
 27%|██▋       | 100614/371472 [8:00:05<20:13:06,  3.72it/s]
 27%|██▋       | 100615/371472 [8:00:05<19:49:50,  3.79it/s]
 27%|██▋       | 100616/371472 [8:00:05<21:30:23,  3.50it/s]
 27%|██▋       | 100617/371472 [8:00:05<20:57:15,  3.59it/s]
 27%|██▋       | 100618/371472 [8:00:06<20:32:31,  3.66it/s]
 27%|██▋       | 100619/371472 [8:00:06<20:31:48,  3.66it/s]
 27%|██▋       | 100620/371472 [8:00:06<20:53:26,  3.60it/s]
                                                            
{'loss': 3.5877, 'learning_rate': 7.565720011204723e-07, 'epoch': 4.33}

 27%|██▋       | 100620/371472 [8:00:06<20:53:26,  3.60it/s]
 27%|██▋       | 100621/371472 [8:00:07<20:24:59,  3.69it/s]
 27%|██▋       | 100622/371472 [8:00:07<20:45:40,  3.62it/s]
 27%|██▋       | 100623/371472 [8:00:07<22:31:46,  3.34it/s]
 27%|██▋       | 100624/371472 [8:00:07<21:31:46,  3.49it/s]
 27%|██▋       | 100625/371472 [8:00:08<21:11:06,  3.55it/s]
 27%|██▋       | 100626/371472 [8:00:08<23:23:23,  3.22it/s]
 27%|██▋       | 100627/371472 [8:00:08<22:49:37,  3.30it/s]
 27%|██▋       | 100628/371472 [8:00:09<22:21:16,  3.37it/s]
 27%|██▋       | 100629/371472 [8:00:09<21:13:36,  3.54it/s]
 27%|██▋       | 100630/371472 [8:00:09<20:23:32,  3.69it/s]
 27%|██▋       | 100631/371472 [8:00:09<20:55:18,  3.60it/s]
 27%|██▋       | 100632/371472 [8:00:10<20:58:36,  3.59it/s]
 27%|██▋       | 100633/371472 [8:00:10<21:03:02,  3.57it/s]
 27%|██▋       | 100634/371472 [8:00:10<20:49:14,  3.61it/s]
 27%|██▋       | 100635/371472 [8:00:11<20:10:01,  3.73it/s]
 27%|██▋       | 100636/371472 [8:00:11<19:16:25,  3.90it/s]
 27%|██▋       | 100637/371472 [8:00:11<22:23:00,  3.36it/s]
 27%|██▋       | 100638/371472 [8:00:11<22:20:39,  3.37it/s]
 27%|██▋       | 100639/371472 [8:00:12<21:27:15,  3.51it/s]
 27%|██▋       | 100640/371472 [8:00:12<21:45:14,  3.46it/s]
                                                            
{'loss': 3.7472, 'learning_rate': 7.565235191449935e-07, 'epoch': 4.33}

 27%|██▋       | 100640/371472 [8:00:12<21:45:14,  3.46it/s]
 27%|██▋       | 100641/371472 [8:00:12<21:25:10,  3.51it/s]
 27%|██▋       | 100642/371472 [8:00:13<22:07:10,  3.40it/s]
 27%|██▋       | 100643/371472 [8:00:13<21:01:54,  3.58it/s]
 27%|██▋       | 100644/371472 [8:00:13<20:07:36,  3.74it/s]
 27%|██▋       | 100645/371472 [8:00:13<22:25:07,  3.36it/s]
 27%|██▋       | 100646/371472 [8:00:14<21:19:23,  3.53it/s]
 27%|██▋       | 100647/371472 [8:00:14<20:37:17,  3.65it/s]
 27%|██▋       | 100648/371472 [8:00:14<20:25:28,  3.68it/s]
 27%|██▋       | 100649/371472 [8:00:14<19:57:28,  3.77it/s]
 27%|██▋       | 100650/371472 [8:00:15<19:45:48,  3.81it/s]
 27%|██▋       | 100651/371472 [8:00:15<20:06:47,  3.74it/s]
 27%|██▋       | 100652/371472 [8:00:15<21:46:51,  3.45it/s]
 27%|██▋       | 100653/371472 [8:00:16<22:56:01,  3.28it/s]
 27%|██▋       | 100654/371472 [8:00:16<23:39:15,  3.18it/s]
 27%|██▋       | 100655/371472 [8:00:16<23:22:42,  3.22it/s]
 27%|██▋       | 100656/371472 [8:00:17<22:30:38,  3.34it/s]
 27%|██▋       | 100657/371472 [8:00:17<21:27:20,  3.51it/s]
 27%|██▋       | 100658/371472 [8:00:17<21:01:26,  3.58it/s]
 27%|██▋       | 100659/371472 [8:00:17<20:45:19,  3.62it/s]
 27%|██▋       | 100660/371472 [8:00:18<20:56:19,  3.59it/s]
                                                            
{'loss': 3.5291, 'learning_rate': 7.564750371695145e-07, 'epoch': 4.34}

 27%|██▋       | 100660/371472 [8:00:18<20:56:19,  3.59it/s]
 27%|██▋       | 100661/371472 [8:00:18<21:10:03,  3.55it/s]
 27%|██▋       | 100662/371472 [8:00:18<21:14:36,  3.54it/s]
 27%|██▋       | 100663/371472 [8:00:19<21:06:38,  3.56it/s]
 27%|██▋       | 100664/371472 [8:00:19<21:24:37,  3.51it/s]
 27%|██▋       | 100665/371472 [8:00:19<22:32:22,  3.34it/s]
 27%|██▋       | 100666/371472 [8:00:19<22:57:35,  3.28it/s]
 27%|██▋       | 100667/371472 [8:00:20<22:41:59,  3.31it/s]
 27%|██▋       | 100668/371472 [8:00:20<22:01:31,  3.42it/s]
 27%|██▋       | 100669/371472 [8:00:20<20:53:18,  3.60it/s]
 27%|██▋       | 100670/371472 [8:00:21<19:53:22,  3.78it/s]
 27%|██▋       | 100671/371472 [8:00:21<22:12:40,  3.39it/s]
 27%|██▋       | 100672/371472 [8:00:21<21:12:15,  3.55it/s]
 27%|██▋       | 100673/371472 [8:00:21<21:06:19,  3.56it/s]
 27%|██▋       | 100674/371472 [8:00:22<20:50:46,  3.61it/s]
 27%|██▋       | 100675/371472 [8:00:22<19:55:30,  3.78it/s]
 27%|██▋       | 100676/371472 [8:00:22<20:16:20,  3.71it/s]
 27%|██▋       | 100677/371472 [8:00:22<19:34:36,  3.84it/s]
 27%|██▋       | 100678/371472 [8:00:23<19:48:08,  3.80it/s]
 27%|██▋       | 100679/371472 [8:00:23<20:08:30,  3.73it/s]
 27%|██▋       | 100680/371472 [8:00:23<20:05:59,  3.74it/s]
                                                            
{'loss': 3.5092, 'learning_rate': 7.564265551940355e-07, 'epoch': 4.34}

 27%|██▋       | 100680/371472 [8:00:23<20:05:59,  3.74it/s]
 27%|██▋       | 100681/371472 [8:00:24<20:46:35,  3.62it/s]
 27%|██▋       | 100682/371472 [8:00:24<20:03:56,  3.75it/s]
 27%|██▋       | 100683/371472 [8:00:24<19:34:44,  3.84it/s]
 27%|██▋       | 100684/371472 [8:00:24<19:32:31,  3.85it/s]
 27%|██▋       | 100685/371472 [8:00:25<19:41:11,  3.82it/s]
 27%|██▋       | 100686/371472 [8:00:25<20:12:02,  3.72it/s]
 27%|██▋       | 100687/371472 [8:00:25<20:21:37,  3.69it/s]
 27%|██▋       | 100688/371472 [8:00:25<20:37:57,  3.65it/s]
 27%|██▋       | 100689/371472 [8:00:26<20:55:01,  3.60it/s]
 27%|██▋       | 100690/371472 [8:00:26<20:17:37,  3.71it/s]
 27%|██▋       | 100691/371472 [8:00:26<20:02:29,  3.75it/s]
 27%|██▋       | 100692/371472 [8:00:26<20:13:18,  3.72it/s]
 27%|██▋       | 100693/371472 [8:00:27<23:21:13,  3.22it/s]
 27%|██▋       | 100694/371472 [8:00:27<28:16:53,  2.66it/s]
 27%|██▋       | 100695/371472 [8:00:28<27:34:12,  2.73it/s]
 27%|██▋       | 100696/371472 [8:00:28<24:42:11,  3.04it/s]
 27%|██▋       | 100697/371472 [8:00:28<24:19:39,  3.09it/s]
 27%|██▋       | 100698/371472 [8:00:29<23:13:03,  3.24it/s]
 27%|██▋       | 100699/371472 [8:00:29<22:24:32,  3.36it/s]
 27%|██▋       | 100700/371472 [8:00:29<21:44:57,  3.46it/s]
                                                            
{'loss': 3.2994, 'learning_rate': 7.563780732185568e-07, 'epoch': 4.34}

 27%|██▋       | 100700/371472 [8:00:29<21:44:57,  3.46it/s]
 27%|██▋       | 100701/371472 [8:00:29<21:50:17,  3.44it/s]
 27%|██▋       | 100702/371472 [8:00:30<21:05:43,  3.57it/s]
 27%|██▋       | 100703/371472 [8:00:30<23:16:02,  3.23it/s]
 27%|██▋       | 100704/371472 [8:00:30<22:47:18,  3.30it/s]
 27%|██▋       | 100705/371472 [8:00:31<21:55:55,  3.43it/s]
 27%|██▋       | 100706/371472 [8:00:31<21:24:42,  3.51it/s]
 27%|██▋       | 100707/371472 [8:00:31<20:36:25,  3.65it/s]
 27%|██▋       | 100708/371472 [8:00:31<20:53:18,  3.60it/s]
 27%|██▋       | 100709/371472 [8:00:32<20:06:00,  3.74it/s]
 27%|██▋       | 100710/371472 [8:00:32<20:11:13,  3.73it/s]
 27%|██▋       | 100711/371472 [8:00:32<20:41:42,  3.63it/s]
 27%|██▋       | 100712/371472 [8:00:32<20:43:01,  3.63it/s]
 27%|██▋       | 100713/371472 [8:00:33<21:41:43,  3.47it/s]
 27%|██▋       | 100714/371472 [8:00:33<21:01:24,  3.58it/s]
 27%|██▋       | 100715/371472 [8:00:33<21:40:47,  3.47it/s]
 27%|██▋       | 100716/371472 [8:00:34<21:08:14,  3.56it/s]
 27%|██▋       | 100717/371472 [8:00:34<20:53:42,  3.60it/s]
 27%|██▋       | 100718/371472 [8:00:34<20:18:22,  3.70it/s]
 27%|██▋       | 100719/371472 [8:00:34<21:16:54,  3.53it/s]
 27%|██▋       | 100720/371472 [8:00:35<22:38:37,  3.32it/s]
                                                            
{'loss': 3.4567, 'learning_rate': 7.563295912430779e-07, 'epoch': 4.34}

 27%|██▋       | 100720/371472 [8:00:35<22:38:37,  3.32it/s]
 27%|██▋       | 100721/371472 [8:00:35<22:22:34,  3.36it/s]
 27%|██▋       | 100722/371472 [8:00:35<20:56:37,  3.59it/s]
 27%|██▋       | 100723/371472 [8:00:36<21:58:08,  3.42it/s]
 27%|██▋       | 100724/371472 [8:00:36<21:05:54,  3.56it/s]
 27%|██▋       | 100725/371472 [8:00:36<20:49:57,  3.61it/s]
 27%|██▋       | 100726/371472 [8:00:36<21:37:36,  3.48it/s]
 27%|██▋       | 100727/371472 [8:00:37<22:25:13,  3.35it/s]
 27%|██▋       | 100728/371472 [8:00:37<21:51:55,  3.44it/s]
 27%|██▋       | 100729/371472 [8:00:37<22:47:55,  3.30it/s]
 27%|██▋       | 100730/371472 [8:00:38<22:21:04,  3.36it/s]
 27%|██▋       | 100731/371472 [8:00:38<21:13:20,  3.54it/s]
 27%|██▋       | 100732/371472 [8:00:38<21:24:56,  3.51it/s]
 27%|██▋       | 100733/371472 [8:00:39<20:52:59,  3.60it/s]
 27%|██▋       | 100734/371472 [8:00:39<21:11:10,  3.55it/s]
 27%|██▋       | 100735/371472 [8:00:39<20:44:49,  3.62it/s]
 27%|██▋       | 100736/371472 [8:00:39<21:43:13,  3.46it/s]
 27%|██▋       | 100737/371472 [8:00:40<21:55:33,  3.43it/s]
 27%|██▋       | 100738/371472 [8:00:40<21:14:40,  3.54it/s]
 27%|██▋       | 100739/371472 [8:00:40<22:28:06,  3.35it/s]
 27%|██▋       | 100740/371472 [8:00:41<21:41:58,  3.47it/s]
                                                            
{'loss': 3.6029, 'learning_rate': 7.562811092675989e-07, 'epoch': 4.34}

 27%|██▋       | 100740/371472 [8:00:41<21:41:58,  3.47it/s]
 27%|██▋       | 100741/371472 [8:00:41<21:36:16,  3.48it/s]
 27%|██▋       | 100742/371472 [8:00:41<21:05:28,  3.57it/s]
 27%|██▋       | 100743/371472 [8:00:41<20:57:09,  3.59it/s]
 27%|██▋       | 100744/371472 [8:00:42<22:10:16,  3.39it/s]
 27%|██▋       | 100745/371472 [8:00:42<22:40:32,  3.32it/s]
 27%|██▋       | 100746/371472 [8:00:42<22:53:36,  3.28it/s]
 27%|██▋       | 100747/371472 [8:00:43<22:52:55,  3.29it/s]
 27%|██▋       | 100748/371472 [8:00:43<22:06:44,  3.40it/s]
 27%|██▋       | 100749/371472 [8:00:43<21:46:14,  3.45it/s]
 27%|██▋       | 100750/371472 [8:00:43<21:25:47,  3.51it/s]
 27%|██▋       | 100751/371472 [8:00:44<21:28:57,  3.50it/s]
 27%|██▋       | 100752/371472 [8:00:44<21:07:54,  3.56it/s]
 27%|██▋       | 100753/371472 [8:00:44<21:00:21,  3.58it/s]
 27%|██▋       | 100754/371472 [8:00:45<20:46:21,  3.62it/s]
 27%|██▋       | 100755/371472 [8:00:45<20:47:32,  3.62it/s]
 27%|██▋       | 100756/371472 [8:00:45<20:29:47,  3.67it/s]
 27%|██▋       | 100757/371472 [8:00:45<20:19:40,  3.70it/s]
 27%|██▋       | 100758/371472 [8:00:46<20:50:40,  3.61it/s]
 27%|██▋       | 100759/371472 [8:00:46<20:28:56,  3.67it/s]
 27%|██▋       | 100760/371472 [8:00:46<22:37:17,  3.32it/s]
                                                            
{'loss': 3.6637, 'learning_rate': 7.5623262729212e-07, 'epoch': 4.34}

 27%|██▋       | 100760/371472 [8:00:46<22:37:17,  3.32it/s]
 27%|██▋       | 100761/371472 [8:00:47<21:34:50,  3.48it/s]
 27%|██▋       | 100762/371472 [8:00:47<21:39:10,  3.47it/s]
 27%|██▋       | 100763/371472 [8:00:47<20:40:10,  3.64it/s]
 27%|██▋       | 100764/371472 [8:00:47<20:11:19,  3.72it/s]
 27%|██▋       | 100765/371472 [8:00:48<19:58:23,  3.76it/s]
 27%|██▋       | 100766/371472 [8:00:48<19:49:39,  3.79it/s]
 27%|██▋       | 100767/371472 [8:00:48<20:05:42,  3.74it/s]
 27%|██▋       | 100768/371472 [8:00:48<21:33:07,  3.49it/s]
 27%|██▋       | 100769/371472 [8:00:49<20:36:27,  3.65it/s]
 27%|██▋       | 100770/371472 [8:00:49<20:45:29,  3.62it/s]
 27%|██▋       | 100771/371472 [8:00:49<21:21:14,  3.52it/s]
 27%|██▋       | 100772/371472 [8:00:50<20:19:17,  3.70it/s]
 27%|██▋       | 100773/371472 [8:00:50<20:05:03,  3.74it/s]
 27%|██▋       | 100774/371472 [8:00:50<20:06:19,  3.74it/s]
 27%|██▋       | 100775/371472 [8:00:50<20:42:54,  3.63it/s]
 27%|██▋       | 100776/371472 [8:00:51<21:08:44,  3.56it/s]
 27%|██▋       | 100777/371472 [8:00:51<21:01:13,  3.58it/s]
 27%|██▋       | 100778/371472 [8:00:51<21:39:51,  3.47it/s]
 27%|██▋       | 100779/371472 [8:00:51<20:43:12,  3.63it/s]
 27%|██▋       | 100780/371472 [8:00:52<20:32:52,  3.66it/s]
                                                            
{'loss': 3.6901, 'learning_rate': 7.561841453166411e-07, 'epoch': 4.34}

 27%|██▋       | 100780/371472 [8:00:52<20:32:52,  3.66it/s]
 27%|██▋       | 100781/371472 [8:00:52<22:44:31,  3.31it/s]
 27%|██▋       | 100782/371472 [8:00:52<21:34:03,  3.49it/s]
 27%|██▋       | 100783/371472 [8:00:53<22:29:11,  3.34it/s]
 27%|██▋       | 100784/371472 [8:00:53<21:50:12,  3.44it/s]
 27%|██▋       | 100785/371472 [8:00:53<20:43:41,  3.63it/s]
 27%|██▋       | 100786/371472 [8:00:53<20:57:18,  3.59it/s]
 27%|██▋       | 100787/371472 [8:00:54<20:29:48,  3.67it/s]
 27%|██▋       | 100788/371472 [8:00:54<20:23:35,  3.69it/s]
 27%|██▋       | 100789/371472 [8:00:54<20:40:18,  3.64it/s]
 27%|██▋       | 100790/371472 [8:00:55<20:01:46,  3.75it/s]
 27%|██▋       | 100791/371472 [8:00:55<20:56:49,  3.59it/s]
 27%|██▋       | 100792/371472 [8:00:55<20:56:49,  3.59it/s]
 27%|██▋       | 100793/371472 [8:00:55<21:11:03,  3.55it/s]
 27%|██▋       | 100794/371472 [8:00:56<20:16:43,  3.71it/s]
 27%|██▋       | 100795/371472 [8:00:56<20:40:36,  3.64it/s]
 27%|██▋       | 100796/371472 [8:00:56<20:10:43,  3.73it/s]
 27%|██▋       | 100797/371472 [8:00:56<20:02:15,  3.75it/s]
 27%|██▋       | 100798/371472 [8:00:57<19:42:14,  3.82it/s]
 27%|██▋       | 100799/371472 [8:00:57<20:13:36,  3.72it/s]
 27%|██▋       | 100800/371472 [8:00:57<21:27:38,  3.50it/s]
                                                            
{'loss': 3.7772, 'learning_rate': 7.561356633411622e-07, 'epoch': 4.34}

 27%|██▋       | 100800/371472 [8:00:57<21:27:38,  3.50it/s]
 27%|██▋       | 100801/371472 [8:00:58<21:46:28,  3.45it/s]
 27%|██▋       | 100802/371472 [8:00:58<21:12:20,  3.55it/s]
 27%|██▋       | 100803/371472 [8:00:58<21:08:20,  3.56it/s]
 27%|██▋       | 100804/371472 [8:00:58<21:01:22,  3.58it/s]
 27%|██▋       | 100805/371472 [8:00:59<21:11:28,  3.55it/s]
 27%|██▋       | 100806/371472 [8:00:59<21:24:39,  3.51it/s]
 27%|██▋       | 100807/371472 [8:00:59<21:29:14,  3.50it/s]
 27%|██▋       | 100808/371472 [8:01:00<21:52:39,  3.44it/s]
 27%|██▋       | 100809/371472 [8:01:00<21:03:03,  3.57it/s]
 27%|██▋       | 100810/371472 [8:01:00<20:28:53,  3.67it/s]
 27%|██▋       | 100811/371472 [8:01:00<20:02:31,  3.75it/s]
 27%|██▋       | 100812/371472 [8:01:01<19:38:44,  3.83it/s]
 27%|██▋       | 100813/371472 [8:01:01<21:48:16,  3.45it/s]
 27%|██▋       | 100814/371472 [8:01:01<21:39:01,  3.47it/s]
 27%|██▋       | 100815/371472 [8:01:02<20:56:32,  3.59it/s]
 27%|██▋       | 100816/371472 [8:01:02<21:48:20,  3.45it/s]
 27%|██▋       | 100817/371472 [8:01:02<21:09:15,  3.55it/s]
 27%|██▋       | 100818/371472 [8:01:02<20:50:41,  3.61it/s]
 27%|██▋       | 100819/371472 [8:01:03<20:04:11,  3.75it/s]
 27%|██▋       | 100820/371472 [8:01:03<19:48:30,  3.80it/s]
                                                            
{'loss': 3.4727, 'learning_rate': 7.560871813656833e-07, 'epoch': 4.34}

 27%|██▋       | 100820/371472 [8:01:03<19:48:30,  3.80it/s]
 27%|██▋       | 100821/371472 [8:01:03<19:48:33,  3.80it/s]
 27%|██▋       | 100822/371472 [8:01:03<19:41:37,  3.82it/s]
 27%|██▋       | 100823/371472 [8:01:04<20:57:50,  3.59it/s]
 27%|██▋       | 100824/371472 [8:01:04<21:29:47,  3.50it/s]
 27%|██▋       | 100825/371472 [8:01:04<22:43:55,  3.31it/s]
 27%|██▋       | 100826/371472 [8:01:05<21:37:49,  3.48it/s]
 27%|██▋       | 100827/371472 [8:01:05<21:46:59,  3.45it/s]
 27%|██▋       | 100828/371472 [8:01:05<20:58:10,  3.59it/s]
 27%|██▋       | 100829/371472 [8:01:05<21:07:04,  3.56it/s]
 27%|██▋       | 100830/371472 [8:01:06<20:24:29,  3.68it/s]
 27%|██▋       | 100831/371472 [8:01:06<19:26:24,  3.87it/s]
 27%|██▋       | 100832/371472 [8:01:06<19:16:44,  3.90it/s]
 27%|██▋       | 100833/371472 [8:01:06<19:43:04,  3.81it/s]
 27%|██▋       | 100834/371472 [8:01:07<19:55:19,  3.77it/s]
 27%|██▋       | 100835/371472 [8:01:07<19:29:42,  3.86it/s]
 27%|██▋       | 100836/371472 [8:01:07<19:09:23,  3.92it/s]
 27%|██▋       | 100837/371472 [8:01:07<19:29:06,  3.86it/s]
 27%|██▋       | 100838/371472 [8:01:08<21:16:46,  3.53it/s]
 27%|██▋       | 100839/371472 [8:01:08<20:39:16,  3.64it/s]
 27%|██▋       | 100840/371472 [8:01:08<21:16:59,  3.53it/s]
                                                            
{'loss': 3.6293, 'learning_rate': 7.560386993902044e-07, 'epoch': 4.34}

 27%|██▋       | 100840/371472 [8:01:08<21:16:59,  3.53it/s]
 27%|██▋       | 100841/371472 [8:01:09<21:26:37,  3.51it/s]
 27%|██▋       | 100842/371472 [8:01:09<21:50:37,  3.44it/s]
 27%|██▋       | 100843/371472 [8:01:09<20:54:58,  3.59it/s]
 27%|██▋       | 100844/371472 [8:01:09<20:17:06,  3.71it/s]
 27%|██▋       | 100845/371472 [8:01:10<19:36:53,  3.83it/s]
 27%|██▋       | 100846/371472 [8:01:10<19:33:56,  3.84it/s]
 27%|██▋       | 100847/371472 [8:01:10<19:07:13,  3.93it/s]
 27%|██▋       | 100848/371472 [8:01:10<18:47:40,  4.00it/s]
 27%|██▋       | 100849/371472 [8:01:11<19:35:31,  3.84it/s]
 27%|██▋       | 100850/371472 [8:01:11<19:32:00,  3.85it/s]
 27%|██▋       | 100851/371472 [8:01:11<20:09:13,  3.73it/s]
 27%|██▋       | 100852/371472 [8:01:12<20:33:03,  3.66it/s]
 27%|██▋       | 100853/371472 [8:01:12<19:48:38,  3.79it/s]
 27%|██▋       | 100854/371472 [8:01:12<19:41:50,  3.82it/s]
 27%|██▋       | 100855/371472 [8:01:12<20:07:00,  3.74it/s]
 27%|██▋       | 100856/371472 [8:01:13<19:52:05,  3.78it/s]
 27%|██▋       | 100857/371472 [8:01:13<19:39:41,  3.82it/s]
 27%|██▋       | 100858/371472 [8:01:13<20:23:26,  3.69it/s]
 27%|██▋       | 100859/371472 [8:01:13<21:12:16,  3.54it/s]
 27%|██▋       | 100860/371472 [8:01:14<21:07:35,  3.56it/s]
                                                            
{'loss': 3.566, 'learning_rate': 7.559902174147256e-07, 'epoch': 4.34}

 27%|██▋       | 100860/371472 [8:01:14<21:07:35,  3.56it/s]
 27%|██▋       | 100861/371472 [8:01:14<23:15:16,  3.23it/s]
 27%|██▋       | 100862/371472 [8:01:14<23:18:40,  3.22it/s]
 27%|██▋       | 100863/371472 [8:01:15<22:52:50,  3.29it/s]
 27%|██▋       | 100864/371472 [8:01:15<22:17:07,  3.37it/s]
 27%|██▋       | 100865/371472 [8:01:15<21:27:41,  3.50it/s]
 27%|██▋       | 100866/371472 [8:01:16<23:19:21,  3.22it/s]
 27%|██▋       | 100867/371472 [8:01:16<23:20:12,  3.22it/s]
 27%|██▋       | 100868/371472 [8:01:16<23:57:24,  3.14it/s]
 27%|██▋       | 100869/371472 [8:01:17<22:57:46,  3.27it/s]
 27%|██▋       | 100870/371472 [8:01:17<21:51:34,  3.44it/s]
 27%|██▋       | 100871/371472 [8:01:17<21:44:32,  3.46it/s]
 27%|██▋       | 100872/371472 [8:01:17<21:05:17,  3.56it/s]
 27%|██▋       | 100873/371472 [8:01:18<20:45:56,  3.62it/s]
 27%|██▋       | 100874/371472 [8:01:18<20:33:50,  3.66it/s]
 27%|██▋       | 100875/371472 [8:01:18<20:20:37,  3.69it/s]
 27%|██▋       | 100876/371472 [8:01:18<21:08:58,  3.55it/s]
 27%|██▋       | 100877/371472 [8:01:19<20:38:35,  3.64it/s]
 27%|██▋       | 100878/371472 [8:01:19<20:34:26,  3.65it/s]
 27%|██▋       | 100879/371472 [8:01:19<20:24:33,  3.68it/s]
 27%|██▋       | 100880/371472 [8:01:19<19:56:42,  3.77it/s]
                                                            
{'loss': 3.612, 'learning_rate': 7.559417354392467e-07, 'epoch': 4.35}

 27%|██▋       | 100880/371472 [8:01:19<19:56:42,  3.77it/s]
 27%|██▋       | 100881/371472 [8:01:20<20:28:11,  3.67it/s]
 27%|██▋       | 100882/371472 [8:01:20<19:53:52,  3.78it/s]
 27%|██▋       | 100883/371472 [8:01:20<19:56:12,  3.77it/s]
 27%|██▋       | 100884/371472 [8:01:21<20:23:50,  3.68it/s]
 27%|██▋       | 100885/371472 [8:01:21<19:57:59,  3.76it/s]
 27%|██▋       | 100886/371472 [8:01:21<20:55:21,  3.59it/s]
 27%|██▋       | 100887/371472 [8:01:21<20:14:16,  3.71it/s]
 27%|██▋       | 100888/371472 [8:01:22<19:43:51,  3.81it/s]
 27%|██▋       | 100889/371472 [8:01:22<20:27:21,  3.67it/s]
 27%|██▋       | 100890/371472 [8:01:22<20:55:02,  3.59it/s]
 27%|██▋       | 100891/371472 [8:01:23<21:13:47,  3.54it/s]
 27%|██▋       | 100892/371472 [8:01:23<20:31:51,  3.66it/s]
 27%|██▋       | 100893/371472 [8:01:23<21:12:48,  3.54it/s]
 27%|██▋       | 100894/371472 [8:01:23<21:10:48,  3.55it/s]
 27%|██▋       | 100895/371472 [8:01:24<20:33:53,  3.65it/s]
 27%|██▋       | 100896/371472 [8:01:24<20:37:00,  3.65it/s]
 27%|██▋       | 100897/371472 [8:01:24<21:35:05,  3.48it/s]
 27%|██▋       | 100898/371472 [8:01:24<21:56:20,  3.43it/s]
 27%|██▋       | 100899/371472 [8:01:25<21:02:10,  3.57it/s]
 27%|██▋       | 100900/371472 [8:01:25<20:38:15,  3.64it/s]
                                                            
{'loss': 3.5499, 'learning_rate': 7.558932534637677e-07, 'epoch': 4.35}

 27%|██▋       | 100900/371472 [8:01:25<20:38:15,  3.64it/s]
 27%|██▋       | 100901/371472 [8:01:25<21:14:09,  3.54it/s]
 27%|██▋       | 100902/371472 [8:01:26<22:25:47,  3.35it/s]
 27%|██▋       | 100903/371472 [8:01:26<22:04:42,  3.40it/s]
 27%|██▋       | 100904/371472 [8:01:26<21:05:25,  3.56it/s]
 27%|██▋       | 100905/371472 [8:01:26<21:03:59,  3.57it/s]
 27%|██▋       | 100906/371472 [8:01:27<20:26:52,  3.68it/s]
 27%|██▋       | 100907/371472 [8:01:27<20:24:16,  3.68it/s]
 27%|██▋       | 100908/371472 [8:01:27<20:33:35,  3.66it/s]
 27%|██▋       | 100909/371472 [8:01:28<22:24:08,  3.35it/s]
 27%|██▋       | 100910/371472 [8:01:28<22:04:55,  3.40it/s]
 27%|██▋       | 100911/371472 [8:01:28<22:01:46,  3.41it/s]
 27%|██▋       | 100912/371472 [8:01:28<21:08:51,  3.55it/s]
 27%|██▋       | 100913/371472 [8:01:29<20:55:23,  3.59it/s]
 27%|██▋       | 100914/371472 [8:01:29<21:07:21,  3.56it/s]
 27%|██▋       | 100915/371472 [8:01:29<20:31:20,  3.66it/s]
 27%|██▋       | 100916/371472 [8:01:30<20:29:29,  3.67it/s]
 27%|██▋       | 100917/371472 [8:01:30<20:24:41,  3.68it/s]
 27%|██▋       | 100918/371472 [8:01:30<21:29:36,  3.50it/s]
 27%|██▋       | 100919/371472 [8:01:30<21:16:51,  3.53it/s]
 27%|██▋       | 100920/371472 [8:01:31<20:58:24,  3.58it/s]
                                                            
{'loss': 3.6266, 'learning_rate': 7.558447714882888e-07, 'epoch': 4.35}

 27%|██▋       | 100920/371472 [8:01:31<20:58:24,  3.58it/s]
 27%|██▋       | 100921/371472 [8:01:31<21:45:09,  3.45it/s]
 27%|██▋       | 100922/371472 [8:01:31<22:37:13,  3.32it/s]
 27%|██▋       | 100923/371472 [8:01:32<22:39:12,  3.32it/s]
 27%|██▋       | 100924/371472 [8:01:32<21:08:57,  3.55it/s]
 27%|██▋       | 100925/371472 [8:01:32<20:47:24,  3.61it/s]
 27%|██▋       | 100926/371472 [8:01:32<20:24:36,  3.68it/s]
 27%|██▋       | 100927/371472 [8:01:33<20:19:49,  3.70it/s]
 27%|██▋       | 100928/371472 [8:01:33<20:19:51,  3.70it/s]
 27%|██▋       | 100929/371472 [8:01:33<20:14:42,  3.71it/s]
 27%|██▋       | 100930/371472 [8:01:33<20:06:23,  3.74it/s]
 27%|██▋       | 100931/371472 [8:01:34<20:01:29,  3.75it/s]
 27%|██▋       | 100932/371472 [8:01:34<21:26:53,  3.50it/s]
 27%|██▋       | 100933/371472 [8:01:34<23:09:55,  3.24it/s]
 27%|██▋       | 100934/371472 [8:01:35<22:21:42,  3.36it/s]
 27%|██▋       | 100935/371472 [8:01:35<22:40:35,  3.31it/s]
 27%|██▋       | 100936/371472 [8:01:35<23:31:26,  3.19it/s]
 27%|██▋       | 100937/371472 [8:01:36<23:27:00,  3.20it/s]
 27%|██▋       | 100938/371472 [8:01:36<22:22:46,  3.36it/s]
 27%|██▋       | 100939/371472 [8:01:36<21:35:05,  3.48it/s]
 27%|██▋       | 100940/371472 [8:01:36<21:23:26,  3.51it/s]
                                                            
{'loss': 3.5335, 'learning_rate': 7.5579628951281e-07, 'epoch': 4.35}

 27%|██▋       | 100940/371472 [8:01:36<21:23:26,  3.51it/s]
 27%|██▋       | 100941/371472 [8:01:37<20:45:42,  3.62it/s]
 27%|██▋       | 100942/371472 [8:01:37<22:16:37,  3.37it/s]
 27%|██▋       | 100943/371472 [8:01:37<21:33:57,  3.48it/s]
 27%|██▋       | 100944/371472 [8:01:38<21:20:43,  3.52it/s]
 27%|██▋       | 100945/371472 [8:01:38<21:44:45,  3.46it/s]
 27%|██▋       | 100946/371472 [8:01:38<21:18:26,  3.53it/s]
 27%|██▋       | 100947/371472 [8:01:38<22:14:32,  3.38it/s]
 27%|██▋       | 100948/371472 [8:01:39<21:44:51,  3.46it/s]
 27%|██▋       | 100949/371472 [8:01:39<20:49:38,  3.61it/s]
 27%|██▋       | 100950/371472 [8:01:39<20:24:03,  3.68it/s]
 27%|██▋       | 100951/371472 [8:01:39<20:01:28,  3.75it/s]
 27%|██▋       | 100952/371472 [8:01:40<20:48:33,  3.61it/s]
 27%|██▋       | 100953/371472 [8:01:40<20:16:43,  3.71it/s]
 27%|██▋       | 100954/371472 [8:01:40<20:04:08,  3.74it/s]
 27%|██▋       | 100955/371472 [8:01:41<20:03:55,  3.74it/s]
 27%|██▋       | 100956/371472 [8:01:41<21:51:31,  3.44it/s]
 27%|██▋       | 100957/371472 [8:01:41<20:52:12,  3.60it/s]
 27%|██▋       | 100958/371472 [8:01:41<20:20:53,  3.69it/s]
 27%|██▋       | 100959/371472 [8:01:42<19:54:11,  3.78it/s]
 27%|██▋       | 100960/371472 [8:01:42<20:24:09,  3.68it/s]
                                                            
{'loss': 3.545, 'learning_rate': 7.557478075373311e-07, 'epoch': 4.35}

 27%|██▋       | 100960/371472 [8:01:42<20:24:09,  3.68it/s]
 27%|██▋       | 100961/371472 [8:01:42<20:40:01,  3.64it/s]
 27%|██▋       | 100962/371472 [8:01:43<20:25:31,  3.68it/s]
 27%|██▋       | 100963/371472 [8:01:43<20:31:30,  3.66it/s]
 27%|██▋       | 100964/371472 [8:01:43<19:50:32,  3.79it/s]
 27%|██▋       | 100965/371472 [8:01:43<19:07:10,  3.93it/s]
 27%|██▋       | 100966/371472 [8:01:44<19:48:41,  3.79it/s]
 27%|██▋       | 100967/371472 [8:01:44<19:51:42,  3.78it/s]
 27%|██▋       | 100968/371472 [8:01:44<19:54:40,  3.77it/s]
 27%|██▋       | 100969/371472 [8:01:44<20:56:37,  3.59it/s]
 27%|██▋       | 100970/371472 [8:01:45<20:41:59,  3.63it/s]
 27%|██▋       | 100971/371472 [8:01:45<21:06:59,  3.56it/s]
 27%|██▋       | 100972/371472 [8:01:45<20:33:57,  3.65it/s]
 27%|██▋       | 100973/371472 [8:01:45<20:44:42,  3.62it/s]
 27%|██▋       | 100974/371472 [8:01:46<21:23:45,  3.51it/s]
 27%|██▋       | 100975/371472 [8:01:46<22:33:16,  3.33it/s]
 27%|██▋       | 100976/371472 [8:01:47<24:34:57,  3.06it/s]
 27%|██▋       | 100977/371472 [8:01:47<23:01:59,  3.26it/s]
 27%|██▋       | 100978/371472 [8:01:47<23:42:59,  3.17it/s]
 27%|██▋       | 100979/371472 [8:01:47<22:49:33,  3.29it/s]
 27%|██▋       | 100980/371472 [8:01:48<22:16:38,  3.37it/s]
                                                            
{'loss': 3.6761, 'learning_rate': 7.556993255618522e-07, 'epoch': 4.35}

 27%|██▋       | 100980/371472 [8:01:48<22:16:38,  3.37it/s]
 27%|██▋       | 100981/371472 [8:01:48<22:25:38,  3.35it/s]
 27%|██▋       | 100982/371472 [8:01:48<23:25:45,  3.21it/s]
 27%|██▋       | 100983/371472 [8:01:49<22:56:39,  3.27it/s]
 27%|██▋       | 100984/371472 [8:01:49<22:56:01,  3.28it/s]
 27%|██▋       | 100985/371472 [8:01:49<21:24:26,  3.51it/s]
 27%|██▋       | 100986/371472 [8:01:49<22:47:15,  3.30it/s]
 27%|██▋       | 100987/371472 [8:01:50<22:21:03,  3.36it/s]
 27%|██▋       | 100988/371472 [8:01:50<22:57:08,  3.27it/s]
 27%|██▋       | 100989/371472 [8:01:50<22:02:51,  3.41it/s]
 27%|██▋       | 100990/371472 [8:01:51<21:48:14,  3.45it/s]
 27%|██▋       | 100991/371472 [8:01:51<21:56:56,  3.42it/s]
 27%|██▋       | 100992/371472 [8:01:51<22:07:14,  3.40it/s]
 27%|██▋       | 100993/371472 [8:01:52<21:17:19,  3.53it/s]
 27%|██▋       | 100994/371472 [8:01:52<22:10:39,  3.39it/s]
 27%|██▋       | 100995/371472 [8:01:52<21:21:25,  3.52it/s]
 27%|██▋       | 100996/371472 [8:01:52<22:01:19,  3.41it/s]
 27%|██▋       | 100997/371472 [8:01:53<22:56:02,  3.28it/s]
 27%|██▋       | 100998/371472 [8:01:53<22:37:39,  3.32it/s]
 27%|██▋       | 100999/371472 [8:01:53<22:12:37,  3.38it/s]
 27%|██▋       | 101000/371472 [8:01:54<21:36:45,  3.48it/s]
                                                            
{'loss': 3.7315, 'learning_rate': 7.556508435863733e-07, 'epoch': 4.35}

 27%|██▋       | 101000/371472 [8:01:54<21:36:45,  3.48it/s]
 27%|██▋       | 101001/371472 [8:01:54<22:17:52,  3.37it/s]
 27%|██▋       | 101002/371472 [8:01:54<20:59:17,  3.58it/s]
 27%|██▋       | 101003/371472 [8:01:54<22:04:50,  3.40it/s]
 27%|██▋       | 101004/371472 [8:01:55<22:34:59,  3.33it/s]
 27%|██▋       | 101005/371472 [8:01:55<21:31:35,  3.49it/s]
 27%|██▋       | 101006/371472 [8:01:55<20:41:38,  3.63it/s]
 27%|██▋       | 101007/371472 [8:01:56<20:28:28,  3.67it/s]
 27%|██▋       | 101008/371472 [8:01:56<21:16:47,  3.53it/s]
 27%|██▋       | 101009/371472 [8:01:56<21:01:36,  3.57it/s]
 27%|██▋       | 101010/371472 [8:01:56<20:04:35,  3.74it/s]
 27%|██▋       | 101011/371472 [8:01:57<20:06:56,  3.73it/s]
 27%|██▋       | 101012/371472 [8:01:57<20:40:04,  3.63it/s]
 27%|██▋       | 101013/371472 [8:01:57<20:19:48,  3.70it/s]
 27%|██▋       | 101014/371472 [8:01:57<20:27:35,  3.67it/s]
 27%|██▋       | 101015/371472 [8:01:58<20:56:16,  3.59it/s]
 27%|██▋       | 101016/371472 [8:01:58<21:18:59,  3.52it/s]
 27%|██▋       | 101017/371472 [8:01:58<21:26:27,  3.50it/s]
 27%|██▋       | 101018/371472 [8:01:59<22:19:22,  3.37it/s]
 27%|██▋       | 101019/371472 [8:01:59<23:25:30,  3.21it/s]
 27%|██▋       | 101020/371472 [8:01:59<22:53:15,  3.28it/s]
                                                            
{'loss': 3.4357, 'learning_rate': 7.556023616108945e-07, 'epoch': 4.35}

 27%|██▋       | 101020/371472 [8:01:59<22:53:15,  3.28it/s]
 27%|██▋       | 101021/371472 [8:02:00<25:59:32,  2.89it/s]
 27%|██▋       | 101022/371472 [8:02:00<24:48:41,  3.03it/s]
 27%|██▋       | 101023/371472 [8:02:00<23:29:52,  3.20it/s]
 27%|██▋       | 101024/371472 [8:02:01<22:13:21,  3.38it/s]
 27%|██▋       | 101025/371472 [8:02:01<21:36:11,  3.48it/s]
 27%|██▋       | 101026/371472 [8:02:01<21:10:11,  3.55it/s]
 27%|██▋       | 101027/371472 [8:02:01<20:34:40,  3.65it/s]
 27%|██▋       | 101028/371472 [8:02:02<20:05:14,  3.74it/s]
 27%|██▋       | 101029/371472 [8:02:02<20:22:12,  3.69it/s]
 27%|██▋       | 101030/371472 [8:02:02<21:07:46,  3.56it/s]
 27%|██▋       | 101031/371472 [8:02:03<21:55:01,  3.43it/s]
 27%|██▋       | 101032/371472 [8:02:03<22:06:47,  3.40it/s]
 27%|██▋       | 101033/371472 [8:02:03<21:25:55,  3.51it/s]
 27%|██▋       | 101034/371472 [8:02:03<20:37:25,  3.64it/s]
 27%|██▋       | 101035/371472 [8:02:04<20:57:03,  3.59it/s]
 27%|██▋       | 101036/371472 [8:02:04<20:28:04,  3.67it/s]
 27%|██▋       | 101037/371472 [8:02:04<20:07:23,  3.73it/s]
 27%|██▋       | 101038/371472 [8:02:04<20:20:37,  3.69it/s]
 27%|██▋       | 101039/371472 [8:02:05<20:57:32,  3.58it/s]
 27%|██▋       | 101040/371472 [8:02:05<23:26:55,  3.20it/s]
                                                            
{'loss': 3.5213, 'learning_rate': 7.555538796354155e-07, 'epoch': 4.35}

 27%|██▋       | 101040/371472 [8:02:05<23:26:55,  3.20it/s]
 27%|██▋       | 101041/371472 [8:02:05<22:40:18,  3.31it/s]
 27%|██▋       | 101042/371472 [8:02:06<22:40:38,  3.31it/s]
 27%|██▋       | 101043/371472 [8:02:06<21:30:07,  3.49it/s]
 27%|██▋       | 101044/371472 [8:02:06<22:43:56,  3.30it/s]
 27%|██▋       | 101045/371472 [8:02:07<22:02:43,  3.41it/s]
 27%|██▋       | 101046/371472 [8:02:07<23:16:27,  3.23it/s]
 27%|██▋       | 101047/371472 [8:02:07<22:23:15,  3.36it/s]
 27%|██▋       | 101048/371472 [8:02:07<21:47:25,  3.45it/s]
 27%|██▋       | 101049/371472 [8:02:08<21:43:06,  3.46it/s]
 27%|██▋       | 101050/371472 [8:02:08<21:28:55,  3.50it/s]
 27%|██▋       | 101051/371472 [8:02:08<21:14:22,  3.54it/s]
 27%|██▋       | 101052/371472 [8:02:09<21:00:56,  3.57it/s]
 27%|██▋       | 101053/371472 [8:02:09<21:10:17,  3.55it/s]
 27%|██▋       | 101054/371472 [8:02:09<21:04:01,  3.57it/s]
 27%|██▋       | 101055/371472 [8:02:09<20:29:10,  3.67it/s]
 27%|██▋       | 101056/371472 [8:02:10<21:40:11,  3.47it/s]
 27%|██▋       | 101057/371472 [8:02:10<21:09:38,  3.55it/s]
 27%|██▋       | 101058/371472 [8:02:10<20:46:42,  3.62it/s]
 27%|██▋       | 101059/371472 [8:02:10<19:55:14,  3.77it/s]
 27%|██▋       | 101060/371472 [8:02:11<20:12:38,  3.72it/s]
                                                            
{'loss': 3.5497, 'learning_rate': 7.555053976599366e-07, 'epoch': 4.35}

 27%|██▋       | 101060/371472 [8:02:11<20:12:38,  3.72it/s]
 27%|██▋       | 101061/371472 [8:02:11<21:11:14,  3.55it/s]
 27%|██▋       | 101062/371472 [8:02:11<21:06:30,  3.56it/s]
 27%|██▋       | 101063/371472 [8:02:12<20:41:17,  3.63it/s]
 27%|██▋       | 101064/371472 [8:02:12<20:54:36,  3.59it/s]
 27%|██▋       | 101065/371472 [8:02:12<21:41:11,  3.46it/s]
 27%|██▋       | 101066/371472 [8:02:12<20:54:05,  3.59it/s]
 27%|██▋       | 101067/371472 [8:02:13<21:57:26,  3.42it/s]
 27%|██▋       | 101068/371472 [8:02:13<23:08:25,  3.25it/s]
 27%|██▋       | 101069/371472 [8:02:13<23:37:04,  3.18it/s]
 27%|██▋       | 101070/371472 [8:02:14<22:21:18,  3.36it/s]
 27%|██▋       | 101071/371472 [8:02:14<22:31:58,  3.33it/s]
 27%|██▋       | 101072/371472 [8:02:14<22:34:52,  3.33it/s]
 27%|██▋       | 101073/371472 [8:02:15<21:33:38,  3.48it/s]
 27%|██▋       | 101074/371472 [8:02:15<21:07:24,  3.56it/s]
 27%|██▋       | 101075/371472 [8:02:15<21:17:13,  3.53it/s]
 27%|██▋       | 101076/371472 [8:02:15<22:06:32,  3.40it/s]
 27%|██▋       | 101077/371472 [8:02:16<21:20:10,  3.52it/s]
 27%|██▋       | 101078/371472 [8:02:16<20:25:28,  3.68it/s]
 27%|██▋       | 101079/371472 [8:02:16<19:57:08,  3.76it/s]
 27%|██▋       | 101080/371472 [8:02:16<19:15:50,  3.90it/s]
                                                            
{'loss': 3.6045, 'learning_rate': 7.554569156844577e-07, 'epoch': 4.35}

 27%|██▋       | 101080/371472 [8:02:16<19:15:50,  3.90it/s]
 27%|██▋       | 101081/371472 [8:02:17<19:26:55,  3.86it/s]
 27%|██▋       | 101082/371472 [8:02:17<19:14:46,  3.90it/s]
 27%|██▋       | 101083/371472 [8:02:17<19:42:32,  3.81it/s]
 27%|██▋       | 101084/371472 [8:02:18<20:53:49,  3.59it/s]
 27%|██▋       | 101085/371472 [8:02:18<20:01:11,  3.75it/s]
 27%|██▋       | 101086/371472 [8:02:18<19:41:22,  3.81it/s]
 27%|██▋       | 101087/371472 [8:02:18<20:08:49,  3.73it/s]
 27%|██▋       | 101088/371472 [8:02:19<20:07:35,  3.73it/s]
 27%|██▋       | 101089/371472 [8:02:19<20:45:41,  3.62it/s]
 27%|██▋       | 101090/371472 [8:02:19<20:39:13,  3.64it/s]
 27%|██▋       | 101091/371472 [8:02:19<20:16:38,  3.70it/s]
 27%|██▋       | 101092/371472 [8:02:20<20:42:21,  3.63it/s]
 27%|██▋       | 101093/371472 [8:02:20<20:26:04,  3.68it/s]
 27%|██▋       | 101094/371472 [8:02:20<21:30:50,  3.49it/s]
 27%|██▋       | 101095/371472 [8:02:21<21:03:55,  3.57it/s]
 27%|██▋       | 101096/371472 [8:02:21<20:21:46,  3.69it/s]
 27%|██▋       | 101097/371472 [8:02:21<20:46:57,  3.61it/s]
 27%|██▋       | 101098/371472 [8:02:21<20:34:51,  3.65it/s]
 27%|██▋       | 101099/371472 [8:02:22<20:21:15,  3.69it/s]
 27%|██▋       | 101100/371472 [8:02:22<23:11:24,  3.24it/s]
                                                            
{'loss': 3.7542, 'learning_rate': 7.554084337089789e-07, 'epoch': 4.35}

 27%|██▋       | 101100/371472 [8:02:22<23:11:24,  3.24it/s]
 27%|██▋       | 101101/371472 [8:02:22<23:06:26,  3.25it/s]
 27%|██▋       | 101102/371472 [8:02:23<21:28:01,  3.50it/s]
 27%|██▋       | 101103/371472 [8:02:23<20:30:49,  3.66it/s]
 27%|██▋       | 101104/371472 [8:02:23<20:32:32,  3.66it/s]
 27%|██▋       | 101105/371472 [8:02:23<20:12:56,  3.72it/s]
 27%|██▋       | 101106/371472 [8:02:24<21:36:17,  3.48it/s]
 27%|██▋       | 101107/371472 [8:02:24<22:38:49,  3.32it/s]
 27%|██▋       | 101108/371472 [8:02:24<22:08:20,  3.39it/s]
 27%|██▋       | 101109/371472 [8:02:25<22:19:48,  3.36it/s]
 27%|██▋       | 101110/371472 [8:02:25<21:36:31,  3.48it/s]
 27%|██▋       | 101111/371472 [8:02:25<21:09:30,  3.55it/s]
 27%|██▋       | 101112/371472 [8:02:25<21:03:05,  3.57it/s]
 27%|██▋       | 101113/371472 [8:02:26<20:34:54,  3.65it/s]
 27%|██▋       | 101114/371472 [8:02:26<20:11:14,  3.72it/s]
 27%|██▋       | 101115/371472 [8:02:26<21:26:54,  3.50it/s]
 27%|██▋       | 101116/371472 [8:02:26<20:56:56,  3.58it/s]
 27%|██▋       | 101117/371472 [8:02:27<21:11:31,  3.54it/s]
 27%|██▋       | 101118/371472 [8:02:27<20:29:39,  3.66it/s]
 27%|██▋       | 101119/371472 [8:02:27<23:34:27,  3.19it/s]
 27%|██▋       | 101120/371472 [8:02:28<22:21:48,  3.36it/s]
                                                            
{'loss': 3.5407, 'learning_rate': 7.553599517335e-07, 'epoch': 4.36}

 27%|██▋       | 101120/371472 [8:02:28<22:21:48,  3.36it/s]
 27%|██▋       | 101121/371472 [8:02:28<20:49:09,  3.61it/s]
 27%|██▋       | 101122/371472 [8:02:28<21:06:53,  3.56it/s]
 27%|██▋       | 101123/371472 [8:02:28<20:02:02,  3.75it/s]
 27%|██▋       | 101124/371472 [8:02:29<20:38:17,  3.64it/s]
 27%|██▋       | 101125/371472 [8:02:29<20:08:51,  3.73it/s]
 27%|██▋       | 101126/371472 [8:02:29<20:45:40,  3.62it/s]
 27%|██▋       | 101127/371472 [8:02:30<20:05:54,  3.74it/s]
 27%|██▋       | 101128/371472 [8:02:30<19:31:13,  3.85it/s]
 27%|██▋       | 101129/371472 [8:02:30<21:01:51,  3.57it/s]
 27%|██▋       | 101130/371472 [8:02:30<22:19:32,  3.36it/s]
 27%|██▋       | 101131/371472 [8:02:31<21:12:25,  3.54it/s]
 27%|██▋       | 101132/371472 [8:02:31<21:35:50,  3.48it/s]
 27%|██▋       | 101133/371472 [8:02:31<21:17:33,  3.53it/s]
 27%|██▋       | 101134/371472 [8:02:32<20:42:55,  3.63it/s]
 27%|██▋       | 101135/371472 [8:02:32<20:13:08,  3.71it/s]
 27%|██▋       | 101136/371472 [8:02:32<20:49:26,  3.61it/s]
 27%|██▋       | 101137/371472 [8:02:32<21:40:11,  3.47it/s]
 27%|██▋       | 101138/371472 [8:02:33<21:12:31,  3.54it/s]
 27%|██▋       | 101139/371472 [8:02:33<21:15:15,  3.53it/s]
 27%|██▋       | 101140/371472 [8:02:33<22:01:47,  3.41it/s]
                                                            
{'loss': 3.6474, 'learning_rate': 7.553114697580211e-07, 'epoch': 4.36}

 27%|██▋       | 101140/371472 [8:02:33<22:01:47,  3.41it/s]
 27%|██▋       | 101141/371472 [8:02:34<21:24:00,  3.51it/s]
 27%|██▋       | 101142/371472 [8:02:34<21:16:19,  3.53it/s]
 27%|██▋       | 101143/371472 [8:02:34<21:17:45,  3.53it/s]
 27%|██▋       | 101144/371472 [8:02:34<20:52:03,  3.60it/s]
 27%|██▋       | 101145/371472 [8:02:35<20:06:48,  3.73it/s]
 27%|██▋       | 101146/371472 [8:02:35<20:20:57,  3.69it/s]
 27%|██▋       | 101147/371472 [8:02:35<21:58:26,  3.42it/s]
 27%|██▋       | 101148/371472 [8:02:35<21:24:04,  3.51it/s]
 27%|██▋       | 101149/371472 [8:02:36<20:43:41,  3.62it/s]
 27%|██▋       | 101150/371472 [8:02:36<20:04:56,  3.74it/s]
 27%|██▋       | 101151/371472 [8:02:36<20:20:34,  3.69it/s]
 27%|██▋       | 101152/371472 [8:02:37<20:59:31,  3.58it/s]
 27%|██▋       | 101153/371472 [8:02:37<20:29:21,  3.66it/s]
 27%|██▋       | 101154/371472 [8:02:37<20:42:59,  3.62it/s]
 27%|██▋       | 101155/371472 [8:02:37<21:48:04,  3.44it/s]
 27%|██▋       | 101156/371472 [8:02:38<22:07:44,  3.39it/s]
 27%|██▋       | 101157/371472 [8:02:38<20:59:37,  3.58it/s]
 27%|██▋       | 101158/371472 [8:02:38<20:52:26,  3.60it/s]
 27%|██▋       | 101159/371472 [8:02:39<23:46:35,  3.16it/s]
 27%|██▋       | 101160/371472 [8:02:39<22:28:27,  3.34it/s]
                                                            
{'loss': 3.6087, 'learning_rate': 7.552629877825421e-07, 'epoch': 4.36}

 27%|██▋       | 101160/371472 [8:02:39<22:28:27,  3.34it/s]
 27%|██▋       | 101161/371472 [8:02:39<21:27:56,  3.50it/s]
 27%|██▋       | 101162/371472 [8:02:39<20:36:56,  3.64it/s]
 27%|██▋       | 101163/371472 [8:02:40<23:06:52,  3.25it/s]
 27%|██▋       | 101164/371472 [8:02:40<21:24:14,  3.51it/s]
 27%|██▋       | 101165/371472 [8:02:40<20:23:39,  3.68it/s]
 27%|██▋       | 101166/371472 [8:02:41<21:45:35,  3.45it/s]
 27%|██▋       | 101167/371472 [8:02:41<20:56:46,  3.58it/s]
 27%|██▋       | 101168/371472 [8:02:41<23:13:56,  3.23it/s]
 27%|██▋       | 101169/371472 [8:02:42<23:29:45,  3.20it/s]
 27%|██▋       | 101170/371472 [8:02:42<23:31:29,  3.19it/s]
 27%|██▋       | 101171/371472 [8:02:42<22:28:21,  3.34it/s]
 27%|██▋       | 101172/371472 [8:02:42<21:57:11,  3.42it/s]
 27%|██▋       | 101173/371472 [8:02:43<23:37:28,  3.18it/s]
 27%|██▋       | 101174/371472 [8:02:43<22:44:01,  3.30it/s]
 27%|██▋       | 101175/371472 [8:02:43<21:26:59,  3.50it/s]
 27%|██▋       | 101176/371472 [8:02:44<21:23:11,  3.51it/s]
 27%|██▋       | 101177/371472 [8:02:44<21:14:07,  3.54it/s]
 27%|██▋       | 101178/371472 [8:02:44<20:45:02,  3.62it/s]
 27%|██▋       | 101179/371472 [8:02:44<20:19:36,  3.69it/s]
 27%|██▋       | 101180/371472 [8:02:45<19:56:15,  3.77it/s]
                                                            
{'loss': 3.2966, 'learning_rate': 7.552145058070632e-07, 'epoch': 4.36}

 27%|██▋       | 101180/371472 [8:02:45<19:56:15,  3.77it/s]
 27%|██▋       | 101181/371472 [8:02:45<20:04:21,  3.74it/s]
 27%|██▋       | 101182/371472 [8:02:45<21:40:34,  3.46it/s]
 27%|██▋       | 101183/371472 [8:02:46<22:07:10,  3.39it/s]
 27%|██▋       | 101184/371472 [8:02:46<21:17:11,  3.53it/s]
 27%|██▋       | 101185/371472 [8:02:46<20:22:39,  3.68it/s]
 27%|██▋       | 101186/371472 [8:02:46<19:33:06,  3.84it/s]
 27%|██▋       | 101187/371472 [8:02:47<21:09:10,  3.55it/s]
 27%|██▋       | 101188/371472 [8:02:47<20:01:20,  3.75it/s]
 27%|██▋       | 101189/371472 [8:02:47<19:26:06,  3.86it/s]
 27%|██▋       | 101190/371472 [8:02:47<19:35:43,  3.83it/s]
 27%|██▋       | 101191/371472 [8:02:48<20:25:36,  3.68it/s]
 27%|██▋       | 101192/371472 [8:02:48<20:27:28,  3.67it/s]
 27%|██▋       | 101193/371472 [8:02:48<20:12:24,  3.72it/s]
 27%|██▋       | 101194/371472 [8:02:48<19:58:24,  3.76it/s]
 27%|██▋       | 101195/371472 [8:02:49<19:33:22,  3.84it/s]
 27%|██▋       | 101196/371472 [8:02:49<19:26:58,  3.86it/s]
 27%|██▋       | 101197/371472 [8:02:49<20:39:36,  3.63it/s]
 27%|██▋       | 101198/371472 [8:02:50<19:54:25,  3.77it/s]
 27%|██▋       | 101199/371472 [8:02:50<19:45:30,  3.80it/s]
 27%|██▋       | 101200/371472 [8:02:50<21:18:53,  3.52it/s]
                                                            
{'loss': 3.5954, 'learning_rate': 7.551660238315844e-07, 'epoch': 4.36}

 27%|██▋       | 101200/371472 [8:02:50<21:18:53,  3.52it/s]
 27%|██▋       | 101201/371472 [8:02:50<20:13:54,  3.71it/s]
 27%|██▋       | 101202/371472 [8:02:51<22:03:30,  3.40it/s]
 27%|██▋       | 101203/371472 [8:02:51<21:35:00,  3.48it/s]
 27%|██▋       | 101204/371472 [8:02:51<21:24:40,  3.51it/s]
 27%|██▋       | 101205/371472 [8:02:52<21:14:48,  3.53it/s]
 27%|██▋       | 101206/371472 [8:02:52<22:29:02,  3.34it/s]
 27%|██▋       | 101207/371472 [8:02:52<21:28:35,  3.50it/s]
 27%|██▋       | 101208/371472 [8:02:52<20:47:33,  3.61it/s]
 27%|██▋       | 101209/371472 [8:02:53<21:52:07,  3.43it/s]
 27%|██▋       | 101210/371472 [8:02:53<20:55:45,  3.59it/s]
 27%|██▋       | 101211/371472 [8:02:53<21:15:50,  3.53it/s]
 27%|██▋       | 101212/371472 [8:02:54<21:39:54,  3.47it/s]
 27%|██▋       | 101213/371472 [8:02:54<21:24:07,  3.51it/s]
 27%|██▋       | 101214/371472 [8:02:54<20:40:52,  3.63it/s]
 27%|██▋       | 101215/371472 [8:02:54<20:49:34,  3.60it/s]
 27%|██▋       | 101216/371472 [8:02:55<20:38:09,  3.64it/s]
 27%|██▋       | 101217/371472 [8:02:55<20:28:57,  3.67it/s]
 27%|██▋       | 101218/371472 [8:02:55<20:20:08,  3.69it/s]
 27%|██▋       | 101219/371472 [8:02:55<19:45:17,  3.80it/s]
 27%|██▋       | 101220/371472 [8:02:56<19:39:58,  3.82it/s]
                                                            
{'loss': 3.587, 'learning_rate': 7.551175418561054e-07, 'epoch': 4.36}

 27%|██▋       | 101220/371472 [8:02:56<19:39:58,  3.82it/s]
 27%|██▋       | 101221/371472 [8:02:56<19:27:44,  3.86it/s]
 27%|██▋       | 101222/371472 [8:02:56<20:21:23,  3.69it/s]
 27%|██▋       | 101223/371472 [8:02:57<21:45:28,  3.45it/s]
 27%|██▋       | 101224/371472 [8:02:57<20:52:29,  3.60it/s]
 27%|██▋       | 101225/371472 [8:02:57<21:04:19,  3.56it/s]
 27%|██▋       | 101226/371472 [8:02:57<21:26:37,  3.50it/s]
 27%|██▋       | 101227/371472 [8:02:58<20:56:47,  3.58it/s]
 27%|██▋       | 101228/371472 [8:02:58<21:19:08,  3.52it/s]
 27%|██▋       | 101229/371472 [8:02:58<22:14:18,  3.38it/s]
 27%|██▋       | 101230/371472 [8:02:59<22:33:02,  3.33it/s]
 27%|██▋       | 101231/371472 [8:02:59<21:36:56,  3.47it/s]
 27%|██▋       | 101232/371472 [8:02:59<20:33:25,  3.65it/s]
 27%|██▋       | 101233/371472 [8:02:59<20:58:02,  3.58it/s]
 27%|██▋       | 101234/371472 [8:03:00<21:12:29,  3.54it/s]
 27%|██▋       | 101235/371472 [8:03:00<21:02:26,  3.57it/s]
 27%|██▋       | 101236/371472 [8:03:00<20:08:36,  3.73it/s]
 27%|██▋       | 101237/371472 [8:03:00<20:28:00,  3.67it/s]
 27%|██▋       | 101238/371472 [8:03:01<21:07:02,  3.55it/s]
 27%|██▋       | 101239/371472 [8:03:01<20:54:10,  3.59it/s]
 27%|██▋       | 101240/371472 [8:03:01<21:01:20,  3.57it/s]
                                                            
{'loss': 3.5307, 'learning_rate': 7.550690598806266e-07, 'epoch': 4.36}

 27%|██▋       | 101240/371472 [8:03:01<21:01:20,  3.57it/s]
 27%|██▋       | 101241/371472 [8:03:02<20:53:35,  3.59it/s]
 27%|██▋       | 101242/371472 [8:03:02<20:58:00,  3.58it/s]
 27%|██▋       | 101243/371472 [8:03:02<21:32:51,  3.48it/s]
 27%|██▋       | 101244/371472 [8:03:02<22:07:06,  3.39it/s]
 27%|██▋       | 101245/371472 [8:03:03<22:44:40,  3.30it/s]
 27%|██▋       | 101246/371472 [8:03:03<21:51:51,  3.43it/s]
 27%|██▋       | 101247/371472 [8:03:03<22:49:14,  3.29it/s]
 27%|██▋       | 101248/371472 [8:03:04<21:39:12,  3.47it/s]
 27%|██▋       | 101249/371472 [8:03:04<20:49:03,  3.61it/s]
 27%|██▋       | 101250/371472 [8:03:04<22:22:46,  3.35it/s]
 27%|██▋       | 101251/371472 [8:03:05<23:09:35,  3.24it/s]
 27%|██▋       | 101252/371472 [8:03:05<21:43:06,  3.46it/s]
 27%|██▋       | 101253/371472 [8:03:05<21:18:28,  3.52it/s]
 27%|██▋       | 101254/371472 [8:03:05<21:01:55,  3.57it/s]
 27%|██▋       | 101255/371472 [8:03:06<21:11:18,  3.54it/s]
 27%|██▋       | 101256/371472 [8:03:06<20:57:34,  3.58it/s]
 27%|██▋       | 101257/371472 [8:03:06<21:02:12,  3.57it/s]
 27%|██▋       | 101258/371472 [8:03:06<20:59:24,  3.58it/s]
 27%|██▋       | 101259/371472 [8:03:07<20:53:01,  3.59it/s]
 27%|██▋       | 101260/371472 [8:03:07<20:29:06,  3.66it/s]
                                                            
{'loss': 3.5444, 'learning_rate': 7.550205779051477e-07, 'epoch': 4.36}

 27%|██▋       | 101260/371472 [8:03:07<20:29:06,  3.66it/s]
 27%|██▋       | 101261/371472 [8:03:07<21:08:50,  3.55it/s]
 27%|██▋       | 101262/371472 [8:03:08<22:12:40,  3.38it/s]
 27%|██▋       | 101263/371472 [8:03:08<21:54:19,  3.43it/s]
 27%|██▋       | 101264/371472 [8:03:08<21:48:13,  3.44it/s]
 27%|██▋       | 101265/371472 [8:03:09<21:17:45,  3.52it/s]
 27%|██▋       | 101266/371472 [8:03:09<21:56:13,  3.42it/s]
 27%|██▋       | 101267/371472 [8:03:09<20:59:56,  3.57it/s]
 27%|██▋       | 101268/371472 [8:03:09<22:13:27,  3.38it/s]
 27%|██▋       | 101269/371472 [8:03:10<22:13:07,  3.38it/s]
 27%|██▋       | 101270/371472 [8:03:10<21:01:57,  3.57it/s]
 27%|██▋       | 101271/371472 [8:03:10<20:26:11,  3.67it/s]
 27%|██▋       | 101272/371472 [8:03:11<21:14:36,  3.53it/s]
 27%|██▋       | 101273/371472 [8:03:11<20:46:28,  3.61it/s]
 27%|██▋       | 101274/371472 [8:03:11<20:37:40,  3.64it/s]
 27%|██▋       | 101275/371472 [8:03:11<20:03:53,  3.74it/s]
 27%|██▋       | 101276/371472 [8:03:12<20:38:19,  3.64it/s]
 27%|██▋       | 101277/371472 [8:03:12<20:14:37,  3.71it/s]
 27%|██▋       | 101278/371472 [8:03:12<21:46:47,  3.45it/s]
 27%|██▋       | 101279/371472 [8:03:12<20:57:16,  3.58it/s]
 27%|██▋       | 101280/371472 [8:03:13<20:25:40,  3.67it/s]
                                                            
{'loss': 3.4748, 'learning_rate': 7.549720959296688e-07, 'epoch': 4.36}

 27%|██▋       | 101280/371472 [8:03:13<20:25:40,  3.67it/s]
 27%|██▋       | 101281/371472 [8:03:13<20:05:30,  3.74it/s]
 27%|██▋       | 101282/371472 [8:03:13<20:25:57,  3.67it/s]
 27%|██▋       | 101283/371472 [8:03:13<19:51:25,  3.78it/s]
 27%|██▋       | 101284/371472 [8:03:14<20:20:11,  3.69it/s]
 27%|██▋       | 101285/371472 [8:03:14<21:25:40,  3.50it/s]
 27%|██▋       | 101286/371472 [8:03:14<22:00:28,  3.41it/s]
 27%|██▋       | 101287/371472 [8:03:15<21:55:06,  3.42it/s]
 27%|██▋       | 101288/371472 [8:03:15<21:12:24,  3.54it/s]
 27%|██▋       | 101289/371472 [8:03:15<23:11:23,  3.24it/s]
 27%|██▋       | 101290/371472 [8:03:16<22:54:15,  3.28it/s]
 27%|██▋       | 101291/371472 [8:03:16<21:46:44,  3.45it/s]
 27%|██▋       | 101292/371472 [8:03:16<21:09:43,  3.55it/s]
 27%|██▋       | 101293/371472 [8:03:16<20:17:50,  3.70it/s]
 27%|██▋       | 101294/371472 [8:03:17<20:32:34,  3.65it/s]
 27%|██▋       | 101295/371472 [8:03:17<20:35:59,  3.64it/s]
 27%|██▋       | 101296/371472 [8:03:17<20:44:34,  3.62it/s]
 27%|██▋       | 101297/371472 [8:03:18<21:44:50,  3.45it/s]
 27%|██▋       | 101298/371472 [8:03:18<21:31:29,  3.49it/s]
 27%|██▋       | 101299/371472 [8:03:18<21:06:38,  3.55it/s]
 27%|██▋       | 101300/371472 [8:03:18<22:05:28,  3.40it/s]
                                                            
{'loss': 3.314, 'learning_rate': 7.549236139541898e-07, 'epoch': 4.36}

 27%|██▋       | 101300/371472 [8:03:18<22:05:28,  3.40it/s]
 27%|██▋       | 101301/371472 [8:03:19<21:18:52,  3.52it/s]
 27%|██▋       | 101302/371472 [8:03:19<21:24:39,  3.51it/s]
 27%|██▋       | 101303/371472 [8:03:19<20:55:52,  3.59it/s]
 27%|██▋       | 101304/371472 [8:03:19<21:05:22,  3.56it/s]
 27%|██▋       | 101305/371472 [8:03:20<24:00:12,  3.13it/s]
 27%|██▋       | 101306/371472 [8:03:20<23:49:50,  3.15it/s]
 27%|██▋       | 101307/371472 [8:03:20<22:10:31,  3.38it/s]
 27%|██▋       | 101308/371472 [8:03:21<23:12:21,  3.23it/s]
 27%|██▋       | 101309/371472 [8:03:21<21:29:26,  3.49it/s]
 27%|██▋       | 101310/371472 [8:03:21<20:44:25,  3.62it/s]
 27%|██▋       | 101311/371472 [8:03:22<20:26:24,  3.67it/s]
 27%|██▋       | 101312/371472 [8:03:22<20:29:12,  3.66it/s]
 27%|██▋       | 101313/371472 [8:03:22<20:57:53,  3.58it/s]
 27%|██▋       | 101314/371472 [8:03:22<20:43:16,  3.62it/s]
 27%|██▋       | 101315/371472 [8:03:23<20:26:05,  3.67it/s]
 27%|██▋       | 101316/371472 [8:03:23<19:37:07,  3.83it/s]
 27%|██▋       | 101317/371472 [8:03:23<20:20:06,  3.69it/s]
 27%|██▋       | 101318/371472 [8:03:23<20:51:22,  3.60it/s]
 27%|██▋       | 101319/371472 [8:03:24<21:26:13,  3.50it/s]
 27%|██▋       | 101320/371472 [8:03:24<20:43:26,  3.62it/s]
                                                            
{'loss': 3.4928, 'learning_rate': 7.54875131978711e-07, 'epoch': 4.36}

 27%|██▋       | 101320/371472 [8:03:24<20:43:26,  3.62it/s]
 27%|██▋       | 101321/371472 [8:03:24<21:43:50,  3.45it/s]
 27%|██▋       | 101322/371472 [8:03:25<22:52:46,  3.28it/s]
 27%|██▋       | 101323/371472 [8:03:25<22:28:04,  3.34it/s]
 27%|██▋       | 101324/371472 [8:03:25<22:00:28,  3.41it/s]
 27%|██▋       | 101325/371472 [8:03:26<21:10:45,  3.54it/s]
 27%|██▋       | 101326/371472 [8:03:26<22:07:22,  3.39it/s]
 27%|██▋       | 101327/371472 [8:03:26<21:14:29,  3.53it/s]
 27%|██▋       | 101328/371472 [8:03:26<20:51:28,  3.60it/s]
 27%|██▋       | 101329/371472 [8:03:27<19:54:00,  3.77it/s]
 27%|██▋       | 101330/371472 [8:03:27<20:21:22,  3.69it/s]
 27%|██▋       | 101331/371472 [8:03:27<20:45:57,  3.61it/s]
 27%|██▋       | 101332/371472 [8:03:27<20:23:48,  3.68it/s]
 27%|██▋       | 101333/371472 [8:03:28<20:46:10,  3.61it/s]
 27%|██▋       | 101334/371472 [8:03:28<21:12:08,  3.54it/s]
 27%|██▋       | 101335/371472 [8:03:28<21:09:08,  3.55it/s]
 27%|██▋       | 101336/371472 [8:03:29<21:08:32,  3.55it/s]
 27%|██▋       | 101337/371472 [8:03:29<20:07:05,  3.73it/s]
 27%|██▋       | 101338/371472 [8:03:29<20:13:21,  3.71it/s]
 27%|██▋       | 101339/371472 [8:03:29<20:29:37,  3.66it/s]
 27%|██▋       | 101340/371472 [8:03:30<20:02:45,  3.74it/s]
                                                            
{'loss': 3.5253, 'learning_rate': 7.548266500032321e-07, 'epoch': 4.36}

 27%|██▋       | 101340/371472 [8:03:30<20:02:45,  3.74it/s]
 27%|██▋       | 101341/371472 [8:03:30<20:24:41,  3.68it/s]
 27%|██▋       | 101342/371472 [8:03:30<20:23:39,  3.68it/s]
 27%|██▋       | 101343/371472 [8:03:30<20:16:43,  3.70it/s]
 27%|██▋       | 101344/371472 [8:03:31<20:42:19,  3.62it/s]
 27%|██▋       | 101345/371472 [8:03:31<20:46:48,  3.61it/s]
 27%|██▋       | 101346/371472 [8:03:31<20:24:28,  3.68it/s]
 27%|██▋       | 101347/371472 [8:03:32<21:18:10,  3.52it/s]
 27%|██▋       | 101348/371472 [8:03:32<21:09:08,  3.55it/s]
 27%|██▋       | 101349/371472 [8:03:32<20:32:26,  3.65it/s]
 27%|██▋       | 101350/371472 [8:03:32<20:08:58,  3.72it/s]
 27%|██▋       | 101351/371472 [8:03:33<19:41:02,  3.81it/s]
 27%|██▋       | 101352/371472 [8:03:33<19:26:02,  3.86it/s]
 27%|██▋       | 101353/371472 [8:03:33<19:58:25,  3.76it/s]
 27%|██▋       | 101354/371472 [8:03:33<19:28:31,  3.85it/s]
 27%|██▋       | 101355/371472 [8:03:34<19:18:27,  3.89it/s]
 27%|██▋       | 101356/371472 [8:03:34<19:45:12,  3.80it/s]
 27%|██▋       | 101357/371472 [8:03:34<19:43:55,  3.80it/s]
 27%|██▋       | 101358/371472 [8:03:34<19:55:11,  3.77it/s]
 27%|██▋       | 101359/371472 [8:03:35<19:51:06,  3.78it/s]
 27%|██▋       | 101360/371472 [8:03:35<19:52:21,  3.78it/s]
                                                            
{'loss': 3.4639, 'learning_rate': 7.547781680277532e-07, 'epoch': 4.37}

 27%|██▋       | 101360/371472 [8:03:35<19:52:21,  3.78it/s]
 27%|██▋       | 101361/371472 [8:03:35<19:52:02,  3.78it/s]
 27%|██▋       | 101362/371472 [8:03:36<20:52:23,  3.59it/s]
 27%|██▋       | 101363/371472 [8:03:36<21:29:37,  3.49it/s]
 27%|██▋       | 101364/371472 [8:03:36<23:05:27,  3.25it/s]
 27%|██▋       | 101365/371472 [8:03:37<22:24:44,  3.35it/s]
 27%|██▋       | 101366/371472 [8:03:37<22:49:07,  3.29it/s]
 27%|██▋       | 101367/371472 [8:03:37<23:15:01,  3.23it/s]
 27%|██▋       | 101368/371472 [8:03:37<22:09:21,  3.39it/s]
 27%|██▋       | 101369/371472 [8:03:38<21:06:45,  3.55it/s]
 27%|██▋       | 101370/371472 [8:03:38<22:35:16,  3.32it/s]
 27%|██▋       | 101371/371472 [8:03:38<22:12:26,  3.38it/s]
 27%|██▋       | 101372/371472 [8:03:39<21:17:42,  3.52it/s]
 27%|██▋       | 101373/371472 [8:03:39<21:03:25,  3.56it/s]
 27%|██▋       | 101374/371472 [8:03:39<22:00:49,  3.41it/s]
 27%|██▋       | 101375/371472 [8:03:39<21:55:20,  3.42it/s]
 27%|██▋       | 101376/371472 [8:03:40<21:03:24,  3.56it/s]
 27%|██▋       | 101377/371472 [8:03:40<20:22:30,  3.68it/s]
 27%|██▋       | 101378/371472 [8:03:40<19:36:59,  3.82it/s]
 27%|██▋       | 101379/371472 [8:03:41<21:16:05,  3.53it/s]
 27%|██▋       | 101380/371472 [8:03:41<20:48:48,  3.60it/s]
                                                            
{'loss': 3.4132, 'learning_rate': 7.547296860522743e-07, 'epoch': 4.37}

 27%|██▋       | 101380/371472 [8:03:41<20:48:48,  3.60it/s]
 27%|██▋       | 101381/371472 [8:03:41<21:15:04,  3.53it/s]
 27%|██▋       | 101382/371472 [8:03:41<20:42:04,  3.62it/s]
 27%|██▋       | 101383/371472 [8:03:42<20:42:43,  3.62it/s]
 27%|██▋       | 101384/371472 [8:03:42<21:15:07,  3.53it/s]
 27%|██▋       | 101385/371472 [8:03:43<30:34:35,  2.45it/s]
 27%|██▋       | 101386/371472 [8:03:43<27:33:46,  2.72it/s]
 27%|██▋       | 101387/371472 [8:03:43<26:07:54,  2.87it/s]
 27%|██▋       | 101388/371472 [8:03:43<24:18:34,  3.09it/s]
 27%|██▋       | 101389/371472 [8:03:44<22:20:21,  3.36it/s]
 27%|██▋       | 101390/371472 [8:03:44<26:29:55,  2.83it/s]
 27%|██▋       | 101391/371472 [8:03:45<26:27:13,  2.84it/s]
 27%|██▋       | 101392/371472 [8:03:45<24:33:37,  3.05it/s]
 27%|██▋       | 101393/371472 [8:03:45<23:24:45,  3.20it/s]
 27%|██▋       | 101394/371472 [8:03:45<24:01:52,  3.12it/s]
 27%|██▋       | 101395/371472 [8:03:46<22:26:39,  3.34it/s]
 27%|██▋       | 101396/371472 [8:03:46<23:43:38,  3.16it/s]
 27%|██▋       | 101397/371472 [8:03:46<23:40:56,  3.17it/s]
 27%|██▋       | 101398/371472 [8:03:47<23:55:24,  3.14it/s]
 27%|██▋       | 101399/371472 [8:03:47<22:46:21,  3.29it/s]
 27%|██▋       | 101400/371472 [8:03:47<22:13:34,  3.38it/s]
                                                            
{'loss': 3.4828, 'learning_rate': 7.546812040767955e-07, 'epoch': 4.37}

 27%|██▋       | 101400/371472 [8:03:47<22:13:34,  3.38it/s]
 27%|██▋       | 101401/371472 [8:03:47<22:03:23,  3.40it/s]
 27%|██▋       | 101402/371472 [8:03:48<22:07:47,  3.39it/s]
 27%|██▋       | 101403/371472 [8:03:48<20:53:33,  3.59it/s]
 27%|██▋       | 101404/371472 [8:03:48<20:39:07,  3.63it/s]
 27%|██▋       | 101405/371472 [8:03:49<21:00:56,  3.57it/s]
 27%|██▋       | 101406/371472 [8:03:49<21:19:43,  3.52it/s]
 27%|██▋       | 101407/371472 [8:03:49<20:57:29,  3.58it/s]
 27%|██▋       | 101408/371472 [8:03:49<22:00:38,  3.41it/s]
 27%|██▋       | 101409/371472 [8:03:50<21:37:13,  3.47it/s]
 27%|██▋       | 101410/371472 [8:03:50<22:20:35,  3.36it/s]
 27%|██▋       | 101411/371472 [8:03:50<21:06:26,  3.55it/s]
 27%|██▋       | 101412/371472 [8:03:51<20:36:30,  3.64it/s]
 27%|██▋       | 101413/371472 [8:03:51<21:52:08,  3.43it/s]
 27%|██▋       | 101414/371472 [8:03:51<22:43:38,  3.30it/s]
 27%|██▋       | 101415/371472 [8:03:51<21:28:34,  3.49it/s]
 27%|██▋       | 101416/371472 [8:03:52<21:22:49,  3.51it/s]
 27%|██▋       | 101417/371472 [8:03:52<20:46:15,  3.61it/s]
 27%|██▋       | 101418/371472 [8:03:52<20:03:35,  3.74it/s]
 27%|██▋       | 101419/371472 [8:03:53<20:32:47,  3.65it/s]
 27%|██▋       | 101420/371472 [8:03:53<20:05:14,  3.73it/s]
                                                            
{'loss': 3.5509, 'learning_rate': 7.546327221013165e-07, 'epoch': 4.37}

 27%|██▋       | 101420/371472 [8:03:53<20:05:14,  3.73it/s]
 27%|██▋       | 101421/371472 [8:03:53<19:55:59,  3.76it/s]
 27%|██▋       | 101422/371472 [8:03:53<19:36:00,  3.83it/s]
 27%|██▋       | 101423/371472 [8:03:54<19:42:47,  3.81it/s]
 27%|██▋       | 101424/371472 [8:03:54<19:46:33,  3.79it/s]
 27%|██▋       | 101425/371472 [8:03:54<19:06:13,  3.93it/s]
 27%|██▋       | 101426/371472 [8:03:54<19:35:02,  3.83it/s]
 27%|██▋       | 101427/371472 [8:03:55<19:55:34,  3.76it/s]
 27%|██▋       | 101428/371472 [8:03:55<19:32:29,  3.84it/s]
 27%|██▋       | 101429/371472 [8:03:55<19:18:02,  3.89it/s]
 27%|██▋       | 101430/371472 [8:03:55<19:18:58,  3.88it/s]
 27%|██▋       | 101431/371472 [8:03:56<21:19:32,  3.52it/s]
 27%|██▋       | 101432/371472 [8:03:56<22:34:19,  3.32it/s]
 27%|██▋       | 101433/371472 [8:03:56<21:21:15,  3.51it/s]
 27%|██▋       | 101434/371472 [8:03:57<20:57:16,  3.58it/s]
 27%|██▋       | 101435/371472 [8:03:57<20:36:55,  3.64it/s]
 27%|██▋       | 101436/371472 [8:03:57<20:22:04,  3.68it/s]
 27%|██▋       | 101437/371472 [8:03:57<19:39:50,  3.81it/s]
 27%|██▋       | 101438/371472 [8:03:58<19:13:56,  3.90it/s]
 27%|██▋       | 101439/371472 [8:03:58<19:34:38,  3.83it/s]
 27%|██▋       | 101440/371472 [8:03:58<19:44:41,  3.80it/s]
                                                            
{'loss': 3.6032, 'learning_rate': 7.545842401258376e-07, 'epoch': 4.37}

 27%|██▋       | 101440/371472 [8:03:58<19:44:41,  3.80it/s]
 27%|██▋       | 101441/371472 [8:03:58<21:32:23,  3.48it/s]
 27%|██▋       | 101442/371472 [8:03:59<23:10:32,  3.24it/s]
 27%|██▋       | 101443/371472 [8:03:59<21:53:08,  3.43it/s]
 27%|██▋       | 101444/371472 [8:03:59<21:16:50,  3.52it/s]
 27%|██▋       | 101445/371472 [8:04:00<20:30:36,  3.66it/s]
 27%|██▋       | 101446/371472 [8:04:00<20:44:28,  3.62it/s]
 27%|██▋       | 101447/371472 [8:04:00<20:11:26,  3.71it/s]
 27%|██▋       | 101448/371472 [8:04:00<19:49:09,  3.78it/s]
 27%|██▋       | 101449/371472 [8:04:01<20:15:51,  3.70it/s]
 27%|██▋       | 101450/371472 [8:04:01<19:25:34,  3.86it/s]
 27%|██▋       | 101451/371472 [8:04:01<20:06:20,  3.73it/s]
 27%|██▋       | 101452/371472 [8:04:01<20:19:54,  3.69it/s]
 27%|██▋       | 101453/371472 [8:04:02<20:22:08,  3.68it/s]
 27%|██▋       | 101454/371472 [8:04:02<20:56:58,  3.58it/s]
 27%|██▋       | 101455/371472 [8:04:02<19:58:37,  3.75it/s]
 27%|██▋       | 101456/371472 [8:04:03<20:43:28,  3.62it/s]
 27%|██▋       | 101457/371472 [8:04:03<20:34:34,  3.65it/s]
 27%|██▋       | 101458/371472 [8:04:03<20:40:16,  3.63it/s]
 27%|██▋       | 101459/371472 [8:04:03<20:38:23,  3.63it/s]
 27%|██▋       | 101460/371472 [8:04:04<20:32:20,  3.65it/s]
                                                            
{'loss': 3.6337, 'learning_rate': 7.545357581503587e-07, 'epoch': 4.37}

 27%|██▋       | 101460/371472 [8:04:04<20:32:20,  3.65it/s]
 27%|██▋       | 101461/371472 [8:04:04<20:44:52,  3.61it/s]
 27%|██▋       | 101462/371472 [8:04:04<20:52:33,  3.59it/s]
 27%|██▋       | 101463/371472 [8:04:05<21:16:42,  3.52it/s]
 27%|██▋       | 101464/371472 [8:04:05<21:16:49,  3.52it/s]
 27%|██▋       | 101465/371472 [8:04:05<22:51:59,  3.28it/s]
 27%|██▋       | 101466/371472 [8:04:05<22:34:38,  3.32it/s]
 27%|██▋       | 101467/371472 [8:04:06<22:03:34,  3.40it/s]
 27%|██▋       | 101468/371472 [8:04:06<22:53:09,  3.28it/s]
 27%|██▋       | 101469/371472 [8:04:06<22:25:39,  3.34it/s]
 27%|██▋       | 101470/371472 [8:04:07<22:54:45,  3.27it/s]
 27%|██▋       | 101471/371472 [8:04:07<22:36:44,  3.32it/s]
 27%|██▋       | 101472/371472 [8:04:07<22:01:10,  3.41it/s]
 27%|██▋       | 101473/371472 [8:04:08<21:27:05,  3.50it/s]
 27%|██▋       | 101474/371472 [8:04:08<21:08:07,  3.55it/s]
 27%|██▋       | 101475/371472 [8:04:08<21:16:50,  3.52it/s]
 27%|██▋       | 101476/371472 [8:04:08<22:47:07,  3.29it/s]
 27%|██▋       | 101477/371472 [8:04:09<23:15:18,  3.23it/s]
 27%|██▋       | 101478/371472 [8:04:09<23:44:14,  3.16it/s]
 27%|██▋       | 101479/371472 [8:04:09<23:03:27,  3.25it/s]
 27%|██▋       | 101480/371472 [8:04:10<22:40:35,  3.31it/s]
                                                            
{'loss': 3.51, 'learning_rate': 7.544872761748798e-07, 'epoch': 4.37}

 27%|██▋       | 101480/371472 [8:04:10<22:40:35,  3.31it/s]
 27%|██▋       | 101481/371472 [8:04:10<23:05:54,  3.25it/s]
 27%|██▋       | 101482/371472 [8:04:10<22:05:20,  3.40it/s]
 27%|██▋       | 101483/371472 [8:04:11<23:27:10,  3.20it/s]
 27%|██▋       | 101484/371472 [8:04:11<22:33:26,  3.32it/s]
 27%|██▋       | 101485/371472 [8:04:11<23:05:40,  3.25it/s]
 27%|██▋       | 101486/371472 [8:04:11<22:38:41,  3.31it/s]
 27%|██▋       | 101487/371472 [8:04:12<21:38:58,  3.46it/s]
 27%|██▋       | 101488/371472 [8:04:12<23:16:53,  3.22it/s]
 27%|██▋       | 101489/371472 [8:04:12<22:34:51,  3.32it/s]
 27%|██▋       | 101490/371472 [8:04:13<23:10:16,  3.24it/s]
 27%|██▋       | 101491/371472 [8:04:13<22:45:38,  3.29it/s]
 27%|██▋       | 101492/371472 [8:04:13<22:02:17,  3.40it/s]
 27%|██▋       | 101493/371472 [8:04:14<21:42:03,  3.46it/s]
 27%|██▋       | 101494/371472 [8:04:14<21:13:53,  3.53it/s]
 27%|██▋       | 101495/371472 [8:04:14<20:42:28,  3.62it/s]
 27%|██▋       | 101496/371472 [8:04:14<20:12:02,  3.71it/s]
 27%|██▋       | 101497/371472 [8:04:15<19:56:12,  3.76it/s]
 27%|██▋       | 101498/371472 [8:04:15<20:28:47,  3.66it/s]
 27%|██▋       | 101499/371472 [8:04:15<20:32:32,  3.65it/s]
 27%|██▋       | 101500/371472 [8:04:15<20:50:34,  3.60it/s]
                                                            
{'loss': 3.5567, 'learning_rate': 7.54438794199401e-07, 'epoch': 4.37}

 27%|██▋       | 101500/371472 [8:04:15<20:50:34,  3.60it/s]
 27%|██▋       | 101501/371472 [8:04:16<21:10:13,  3.54it/s]
 27%|██▋       | 101502/371472 [8:04:16<21:49:51,  3.44it/s]
 27%|██▋       | 101503/371472 [8:04:16<21:45:35,  3.45it/s]
 27%|██▋       | 101504/371472 [8:04:17<21:44:46,  3.45it/s]
 27%|██▋       | 101505/371472 [8:04:17<22:21:09,  3.35it/s]
 27%|██▋       | 101506/371472 [8:04:17<21:59:46,  3.41it/s]
 27%|██▋       | 101507/371472 [8:04:17<21:21:19,  3.51it/s]
 27%|██▋       | 101508/371472 [8:04:18<20:36:15,  3.64it/s]
 27%|██▋       | 101509/371472 [8:04:18<20:05:58,  3.73it/s]
 27%|██▋       | 101510/371472 [8:04:18<21:01:18,  3.57it/s]
 27%|██▋       | 101511/371472 [8:04:19<20:09:07,  3.72it/s]
 27%|██▋       | 101512/371472 [8:04:19<20:11:35,  3.71it/s]
 27%|██▋       | 101513/371472 [8:04:19<20:02:02,  3.74it/s]
 27%|██▋       | 101514/371472 [8:04:19<21:35:50,  3.47it/s]
 27%|██▋       | 101515/371472 [8:04:20<20:46:29,  3.61it/s]
 27%|██▋       | 101516/371472 [8:04:20<20:30:08,  3.66it/s]
 27%|██▋       | 101517/371472 [8:04:20<20:25:25,  3.67it/s]
 27%|██▋       | 101518/371472 [8:04:20<19:39:47,  3.81it/s]
 27%|██▋       | 101519/371472 [8:04:21<20:24:57,  3.67it/s]
 27%|██▋       | 101520/371472 [8:04:21<20:24:42,  3.67it/s]
                                                            
{'loss': 3.5941, 'learning_rate': 7.543903122239221e-07, 'epoch': 4.37}

 27%|██▋       | 101520/371472 [8:04:21<20:24:42,  3.67it/s]
 27%|██▋       | 101521/371472 [8:04:21<21:04:29,  3.56it/s]
 27%|██▋       | 101522/371472 [8:04:22<21:00:44,  3.57it/s]
 27%|██▋       | 101523/371472 [8:04:22<20:29:17,  3.66it/s]
 27%|██▋       | 101524/371472 [8:04:22<21:34:56,  3.47it/s]
 27%|██▋       | 101525/371472 [8:04:22<21:44:13,  3.45it/s]
 27%|██▋       | 101526/371472 [8:04:23<20:23:35,  3.68it/s]
 27%|██▋       | 101527/371472 [8:04:23<21:37:17,  3.47it/s]
 27%|██▋       | 101528/371472 [8:04:23<20:43:16,  3.62it/s]
 27%|██▋       | 101529/371472 [8:04:24<20:02:58,  3.74it/s]
 27%|██▋       | 101530/371472 [8:04:24<20:23:49,  3.68it/s]
 27%|██▋       | 101531/371472 [8:04:24<19:49:57,  3.78it/s]
 27%|██▋       | 101532/371472 [8:04:24<22:14:01,  3.37it/s]
 27%|██▋       | 101533/371472 [8:04:25<21:08:08,  3.55it/s]
 27%|██▋       | 101534/371472 [8:04:25<20:30:44,  3.66it/s]
 27%|██▋       | 101535/371472 [8:04:25<20:35:35,  3.64it/s]
 27%|██▋       | 101536/371472 [8:04:25<20:37:16,  3.64it/s]
 27%|██▋       | 101537/371472 [8:04:26<19:45:35,  3.79it/s]
 27%|██▋       | 101538/371472 [8:04:26<19:18:35,  3.88it/s]
 27%|██▋       | 101539/371472 [8:04:26<19:58:54,  3.75it/s]
 27%|██▋       | 101540/371472 [8:04:27<20:17:44,  3.69it/s]
                                                            
{'loss': 3.6253, 'learning_rate': 7.543418302484431e-07, 'epoch': 4.37}

 27%|██▋       | 101540/371472 [8:04:27<20:17:44,  3.69it/s]
 27%|██▋       | 101541/371472 [8:04:27<19:51:41,  3.78it/s]
 27%|██▋       | 101542/371472 [8:04:27<20:11:11,  3.71it/s]
 27%|██▋       | 101543/371472 [8:04:27<20:53:49,  3.59it/s]
 27%|██▋       | 101544/371472 [8:04:28<20:25:54,  3.67it/s]
 27%|██▋       | 101545/371472 [8:04:28<21:00:57,  3.57it/s]
 27%|██▋       | 101546/371472 [8:04:28<21:09:21,  3.54it/s]
 27%|██▋       | 101547/371472 [8:04:28<21:13:54,  3.53it/s]
 27%|██▋       | 101548/371472 [8:04:29<20:23:53,  3.68it/s]
 27%|██▋       | 101549/371472 [8:04:29<20:07:27,  3.73it/s]
 27%|██▋       | 101550/371472 [8:04:29<20:01:50,  3.74it/s]
 27%|██▋       | 101551/371472 [8:04:30<20:53:14,  3.59it/s]
 27%|██▋       | 101552/371472 [8:04:30<20:46:19,  3.61it/s]
 27%|██▋       | 101553/371472 [8:04:30<20:46:44,  3.61it/s]
 27%|██▋       | 101554/371472 [8:04:30<20:34:29,  3.64it/s]
 27%|██▋       | 101555/371472 [8:04:31<20:09:52,  3.72it/s]
 27%|██▋       | 101556/371472 [8:04:31<20:01:52,  3.74it/s]
 27%|██▋       | 101557/371472 [8:04:31<19:38:56,  3.82it/s]
 27%|██▋       | 101558/371472 [8:04:31<20:10:08,  3.72it/s]
 27%|██▋       | 101559/371472 [8:04:32<20:13:54,  3.71it/s]
 27%|██▋       | 101560/371472 [8:04:32<19:45:03,  3.80it/s]
                                                            
{'loss': 3.6321, 'learning_rate': 7.542933482729642e-07, 'epoch': 4.37}

 27%|██▋       | 101560/371472 [8:04:32<19:45:03,  3.80it/s]
 27%|██▋       | 101561/371472 [8:04:32<20:48:51,  3.60it/s]
 27%|██▋       | 101562/371472 [8:04:33<20:58:35,  3.57it/s]
 27%|██▋       | 101563/371472 [8:04:33<21:39:34,  3.46it/s]
 27%|██▋       | 101564/371472 [8:04:33<20:55:07,  3.58it/s]
 27%|██▋       | 101565/371472 [8:04:33<20:55:09,  3.58it/s]
 27%|██▋       | 101566/371472 [8:04:34<19:58:24,  3.75it/s]
 27%|██▋       | 101567/371472 [8:04:34<20:29:33,  3.66it/s]
 27%|██▋       | 101568/371472 [8:04:34<19:42:19,  3.80it/s]
 27%|██▋       | 101569/371472 [8:04:34<19:52:01,  3.77it/s]
 27%|██▋       | 101570/371472 [8:04:35<19:53:00,  3.77it/s]
 27%|██▋       | 101571/371472 [8:04:35<19:43:42,  3.80it/s]
 27%|██▋       | 101572/371472 [8:04:35<19:57:13,  3.76it/s]
 27%|██▋       | 101573/371472 [8:04:36<20:50:46,  3.60it/s]
 27%|██▋       | 101574/371472 [8:04:36<20:13:24,  3.71it/s]
 27%|██▋       | 101575/371472 [8:04:36<20:39:08,  3.63it/s]
 27%|██▋       | 101576/371472 [8:04:36<20:29:57,  3.66it/s]
 27%|██▋       | 101577/371472 [8:04:37<20:09:31,  3.72it/s]
 27%|██▋       | 101578/371472 [8:04:37<20:03:40,  3.74it/s]
 27%|██▋       | 101579/371472 [8:04:37<20:29:26,  3.66it/s]
 27%|██▋       | 101580/371472 [8:04:37<20:24:02,  3.67it/s]
                                                            
{'loss': 3.685, 'learning_rate': 7.542448662974854e-07, 'epoch': 4.38}

 27%|██▋       | 101580/371472 [8:04:37<20:24:02,  3.67it/s]
 27%|██▋       | 101581/371472 [8:04:38<20:05:10,  3.73it/s]
 27%|██▋       | 101582/371472 [8:04:38<19:32:52,  3.84it/s]
 27%|██▋       | 101583/371472 [8:04:38<19:14:31,  3.90it/s]
 27%|██▋       | 101584/371472 [8:04:38<19:37:13,  3.82it/s]
 27%|██▋       | 101585/371472 [8:04:39<19:01:04,  3.94it/s]
 27%|██▋       | 101586/371472 [8:04:39<19:32:06,  3.84it/s]
 27%|██▋       | 101587/371472 [8:04:39<19:46:54,  3.79it/s]
 27%|██▋       | 101588/371472 [8:04:40<20:46:33,  3.61it/s]
 27%|██▋       | 101589/371472 [8:04:40<19:47:59,  3.79it/s]
 27%|██▋       | 101590/371472 [8:04:40<20:20:03,  3.69it/s]
 27%|██▋       | 101591/371472 [8:04:40<21:28:31,  3.49it/s]
 27%|██▋       | 101592/371472 [8:04:41<22:01:39,  3.40it/s]
 27%|██▋       | 101593/371472 [8:04:41<22:02:18,  3.40it/s]
 27%|██▋       | 101594/371472 [8:04:41<21:53:43,  3.42it/s]
 27%|██▋       | 101595/371472 [8:04:42<21:29:14,  3.49it/s]
 27%|██▋       | 101596/371472 [8:04:42<21:28:43,  3.49it/s]
 27%|██▋       | 101597/371472 [8:04:42<20:43:33,  3.62it/s]
 27%|██▋       | 101598/371472 [8:04:42<20:44:43,  3.61it/s]
 27%|██▋       | 101599/371472 [8:04:43<21:53:30,  3.42it/s]
 27%|██▋       | 101600/371472 [8:04:43<20:57:10,  3.58it/s]
                                                            
{'loss': 3.5317, 'learning_rate': 7.541963843220065e-07, 'epoch': 4.38}

 27%|██▋       | 101600/371472 [8:04:43<20:57:10,  3.58it/s]
 27%|██▋       | 101601/371472 [8:04:43<20:36:42,  3.64it/s]
 27%|██▋       | 101602/371472 [8:04:43<20:41:42,  3.62it/s]
 27%|██▋       | 101603/371472 [8:04:44<19:54:09,  3.77it/s]
 27%|██▋       | 101604/371472 [8:04:44<19:20:58,  3.87it/s]
 27%|██▋       | 101605/371472 [8:04:44<20:00:40,  3.75it/s]
 27%|██▋       | 101606/371472 [8:04:44<19:25:53,  3.86it/s]
 27%|██▋       | 101607/371472 [8:04:45<20:39:27,  3.63it/s]
 27%|██▋       | 101608/371472 [8:04:45<20:44:02,  3.62it/s]
 27%|██▋       | 101609/371472 [8:04:45<20:14:15,  3.70it/s]
 27%|██▋       | 101610/371472 [8:04:46<20:52:11,  3.59it/s]
 27%|██▋       | 101611/371472 [8:04:46<22:04:06,  3.40it/s]
 27%|██▋       | 101612/371472 [8:04:46<21:34:49,  3.47it/s]
 27%|██▋       | 101613/371472 [8:04:47<23:03:10,  3.25it/s]
 27%|██▋       | 101614/371472 [8:04:47<21:48:15,  3.44it/s]
 27%|██▋       | 101615/371472 [8:04:47<21:21:47,  3.51it/s]
 27%|██▋       | 101616/371472 [8:04:47<21:11:26,  3.54it/s]
 27%|██▋       | 101617/371472 [8:04:48<21:10:59,  3.54it/s]
 27%|██▋       | 101618/371472 [8:04:48<22:27:51,  3.34it/s]
 27%|██▋       | 101619/371472 [8:04:48<22:27:19,  3.34it/s]
 27%|██▋       | 101620/371472 [8:04:49<22:41:24,  3.30it/s]
                                                            
{'loss': 3.3984, 'learning_rate': 7.541479023465276e-07, 'epoch': 4.38}

 27%|██▋       | 101620/371472 [8:04:49<22:41:24,  3.30it/s]
 27%|██▋       | 101621/371472 [8:04:49<22:57:20,  3.27it/s]
 27%|██▋       | 101622/371472 [8:04:49<22:26:17,  3.34it/s]
 27%|██▋       | 101623/371472 [8:04:49<21:39:08,  3.46it/s]
 27%|██▋       | 101624/371472 [8:04:50<21:30:14,  3.49it/s]
 27%|██▋       | 101625/371472 [8:04:50<22:22:34,  3.35it/s]
 27%|██▋       | 101626/371472 [8:04:50<22:49:11,  3.28it/s]
 27%|██▋       | 101627/371472 [8:04:51<21:26:25,  3.50it/s]
 27%|██▋       | 101628/371472 [8:04:51<20:49:12,  3.60it/s]
 27%|██▋       | 101629/371472 [8:04:51<20:35:49,  3.64it/s]
 27%|██▋       | 101630/371472 [8:04:51<20:00:46,  3.75it/s]
 27%|██▋       | 101631/371472 [8:04:52<20:10:14,  3.72it/s]
 27%|██▋       | 101632/371472 [8:04:52<21:44:52,  3.45it/s]
 27%|██▋       | 101633/371472 [8:04:52<20:35:42,  3.64it/s]
 27%|██▋       | 101634/371472 [8:04:53<20:08:21,  3.72it/s]
 27%|██▋       | 101635/371472 [8:04:53<20:28:08,  3.66it/s]
 27%|██▋       | 101636/371472 [8:04:53<21:04:54,  3.56it/s]
 27%|██▋       | 101637/371472 [8:04:53<21:24:41,  3.50it/s]
 27%|██▋       | 101638/371472 [8:04:54<20:39:37,  3.63it/s]
 27%|██▋       | 101639/371472 [8:04:54<20:15:49,  3.70it/s]
 27%|██▋       | 101640/371472 [8:04:54<20:14:14,  3.70it/s]
                                                            
{'loss': 3.6187, 'learning_rate': 7.540994203710488e-07, 'epoch': 4.38}

 27%|██▋       | 101640/371472 [8:04:54<20:14:14,  3.70it/s]
 27%|██▋       | 101641/371472 [8:04:54<20:17:05,  3.70it/s]
 27%|██▋       | 101642/371472 [8:04:55<19:57:06,  3.76it/s]
 27%|██▋       | 101643/371472 [8:04:55<20:55:10,  3.58it/s]
 27%|██▋       | 101644/371472 [8:04:55<20:33:20,  3.65it/s]
 27%|██▋       | 101645/371472 [8:04:56<20:38:02,  3.63it/s]
 27%|██▋       | 101646/371472 [8:04:56<20:17:27,  3.69it/s]
 27%|██▋       | 101647/371472 [8:04:56<19:42:13,  3.80it/s]
 27%|██▋       | 101648/371472 [8:04:56<19:42:26,  3.80it/s]
 27%|██▋       | 101649/371472 [8:04:57<21:14:06,  3.53it/s]
 27%|██▋       | 101650/371472 [8:04:57<22:35:12,  3.32it/s]
 27%|██▋       | 101651/371472 [8:04:57<21:45:14,  3.45it/s]
 27%|██▋       | 101652/371472 [8:04:58<21:11:20,  3.54it/s]
 27%|██▋       | 101653/371472 [8:04:58<21:03:07,  3.56it/s]
 27%|██▋       | 101654/371472 [8:04:58<20:58:41,  3.57it/s]
 27%|██▋       | 101655/371472 [8:04:58<23:26:27,  3.20it/s]
 27%|██▋       | 101656/371472 [8:04:59<21:55:22,  3.42it/s]
 27%|██▋       | 101657/371472 [8:04:59<21:54:31,  3.42it/s]
 27%|██▋       | 101658/371472 [8:04:59<21:09:49,  3.54it/s]
 27%|██▋       | 101659/371472 [8:05:00<20:33:19,  3.65it/s]
 27%|██▋       | 101660/371472 [8:05:00<22:16:32,  3.36it/s]
                                                            
{'loss': 3.5354, 'learning_rate': 7.540509383955698e-07, 'epoch': 4.38}

 27%|██▋       | 101660/371472 [8:05:00<22:16:32,  3.36it/s]
 27%|██▋       | 101661/371472 [8:05:00<22:05:12,  3.39it/s]
 27%|██▋       | 101662/371472 [8:05:00<21:12:44,  3.53it/s]
 27%|██▋       | 101663/371472 [8:05:01<21:08:19,  3.55it/s]
 27%|██▋       | 101664/371472 [8:05:01<21:07:33,  3.55it/s]
 27%|██▋       | 101665/371472 [8:05:01<20:38:13,  3.63it/s]
 27%|██▋       | 101666/371472 [8:05:02<19:59:32,  3.75it/s]
 27%|██▋       | 101667/371472 [8:05:02<19:44:50,  3.80it/s]
 27%|██▋       | 101668/371472 [8:05:02<20:39:37,  3.63it/s]
 27%|██▋       | 101669/371472 [8:05:02<20:12:15,  3.71it/s]
 27%|██▋       | 101670/371472 [8:05:03<19:32:38,  3.83it/s]
 27%|██▋       | 101671/371472 [8:05:03<20:41:42,  3.62it/s]
 27%|██▋       | 101672/371472 [8:05:03<21:01:16,  3.57it/s]
 27%|██▋       | 101673/371472 [8:05:03<20:22:39,  3.68it/s]
 27%|██▋       | 101674/371472 [8:05:04<20:03:40,  3.74it/s]
 27%|██▋       | 101675/371472 [8:05:04<20:16:03,  3.70it/s]
 27%|██▋       | 101676/371472 [8:05:04<20:12:42,  3.71it/s]
 27%|██▋       | 101677/371472 [8:05:05<21:00:58,  3.57it/s]
 27%|██▋       | 101678/371472 [8:05:05<21:01:20,  3.56it/s]
 27%|██▋       | 101679/371472 [8:05:05<21:43:49,  3.45it/s]
 27%|██▋       | 101680/371472 [8:05:05<20:42:25,  3.62it/s]
                                                            
{'loss': 3.5014, 'learning_rate': 7.540024564200909e-07, 'epoch': 4.38}

 27%|██▋       | 101680/371472 [8:05:05<20:42:25,  3.62it/s]
 27%|██▋       | 101681/371472 [8:05:06<20:15:41,  3.70it/s]
 27%|██▋       | 101682/371472 [8:05:06<20:56:05,  3.58it/s]
 27%|██▋       | 101683/371472 [8:05:06<21:00:37,  3.57it/s]
 27%|██▋       | 101684/371472 [8:05:07<23:59:18,  3.12it/s]
 27%|██▋       | 101685/371472 [8:05:07<22:57:51,  3.26it/s]
 27%|██▋       | 101686/371472 [8:05:07<22:39:53,  3.31it/s]
 27%|██▋       | 101687/371472 [8:05:07<22:19:05,  3.36it/s]
 27%|██▋       | 101688/371472 [8:05:08<21:33:25,  3.48it/s]
 27%|██▋       | 101689/371472 [8:05:08<21:03:08,  3.56it/s]
 27%|██▋       | 101690/371472 [8:05:08<21:22:18,  3.51it/s]
 27%|██▋       | 101691/371472 [8:05:09<20:43:08,  3.62it/s]
 27%|██▋       | 101692/371472 [8:05:09<20:53:54,  3.59it/s]
 27%|██▋       | 101693/371472 [8:05:09<23:41:06,  3.16it/s]
 27%|██▋       | 101694/371472 [8:05:10<24:11:56,  3.10it/s]
 27%|██▋       | 101695/371472 [8:05:10<22:51:54,  3.28it/s]
 27%|██▋       | 101696/371472 [8:05:10<22:56:56,  3.27it/s]
 27%|██▋       | 101697/371472 [8:05:10<21:30:11,  3.48it/s]
 27%|██▋       | 101698/371472 [8:05:11<22:21:53,  3.35it/s]
 27%|██▋       | 101699/371472 [8:05:11<21:14:00,  3.53it/s]
 27%|██▋       | 101700/371472 [8:05:11<21:35:59,  3.47it/s]
                                                            
{'loss': 3.5726, 'learning_rate': 7.53953974444612e-07, 'epoch': 4.38}

 27%|██▋       | 101700/371472 [8:05:11<21:35:59,  3.47it/s]
 27%|██▋       | 101701/371472 [8:05:12<23:23:14,  3.20it/s]
 27%|██▋       | 101702/371472 [8:05:12<22:16:58,  3.36it/s]
 27%|██▋       | 101703/371472 [8:05:12<22:37:18,  3.31it/s]
 27%|██▋       | 101704/371472 [8:05:13<23:17:20,  3.22it/s]
 27%|██▋       | 101705/371472 [8:05:13<24:08:05,  3.10it/s]
 27%|██▋       | 101706/371472 [8:05:13<24:36:09,  3.05it/s]
 27%|██▋       | 101707/371472 [8:05:14<23:29:52,  3.19it/s]
 27%|██▋       | 101708/371472 [8:05:14<22:36:32,  3.31it/s]
 27%|██▋       | 101709/371472 [8:05:14<22:51:37,  3.28it/s]
 27%|██▋       | 101710/371472 [8:05:14<22:12:00,  3.38it/s]
 27%|██▋       | 101711/371472 [8:05:15<22:33:41,  3.32it/s]
 27%|██▋       | 101712/371472 [8:05:15<21:59:34,  3.41it/s]
 27%|██▋       | 101713/371472 [8:05:15<22:23:18,  3.35it/s]
 27%|██▋       | 101714/371472 [8:05:16<23:14:54,  3.22it/s]
 27%|██▋       | 101715/371472 [8:05:16<23:46:36,  3.15it/s]
 27%|██▋       | 101716/371472 [8:05:16<23:03:39,  3.25it/s]
 27%|██▋       | 101717/371472 [8:05:17<22:44:44,  3.29it/s]
 27%|██▋       | 101718/371472 [8:05:17<23:14:48,  3.22it/s]
 27%|██▋       | 101719/371472 [8:05:17<23:51:18,  3.14it/s]
 27%|██▋       | 101720/371472 [8:05:17<22:35:02,  3.32it/s]
                                                            
{'loss': 3.6799, 'learning_rate': 7.539054924691331e-07, 'epoch': 4.38}

 27%|██▋       | 101720/371472 [8:05:17<22:35:02,  3.32it/s]
 27%|██▋       | 101721/371472 [8:05:18<21:07:59,  3.55it/s]
 27%|██▋       | 101722/371472 [8:05:18<22:23:31,  3.35it/s]
 27%|██▋       | 101723/371472 [8:05:18<22:13:23,  3.37it/s]
 27%|██▋       | 101724/371472 [8:05:19<23:27:46,  3.19it/s]
 27%|██▋       | 101725/371472 [8:05:19<22:24:52,  3.34it/s]
 27%|██▋       | 101726/371472 [8:05:19<21:56:55,  3.41it/s]
 27%|██▋       | 101727/371472 [8:05:20<22:35:56,  3.32it/s]
 27%|██▋       | 101728/371472 [8:05:20<21:32:19,  3.48it/s]
 27%|██▋       | 101729/371472 [8:05:20<21:06:47,  3.55it/s]
 27%|██▋       | 101730/371472 [8:05:20<20:50:18,  3.60it/s]
 27%|██▋       | 101731/371472 [8:05:21<21:25:20,  3.50it/s]
 27%|██▋       | 101732/371472 [8:05:21<22:42:19,  3.30it/s]
 27%|██▋       | 101733/371472 [8:05:21<22:32:04,  3.32it/s]
 27%|██▋       | 101734/371472 [8:05:22<21:30:37,  3.48it/s]
 27%|██▋       | 101735/371472 [8:05:22<20:48:47,  3.60it/s]
 27%|██▋       | 101736/371472 [8:05:22<21:23:51,  3.50it/s]
 27%|██▋       | 101737/371472 [8:05:22<20:52:25,  3.59it/s]
 27%|██▋       | 101738/371472 [8:05:23<20:24:56,  3.67it/s]
 27%|██▋       | 101739/371472 [8:05:23<21:36:04,  3.47it/s]
 27%|██▋       | 101740/371472 [8:05:23<21:33:58,  3.47it/s]
                                                            
{'loss': 3.6045, 'learning_rate': 7.538570104936543e-07, 'epoch': 4.38}

 27%|██▋       | 101740/371472 [8:05:23<21:33:58,  3.47it/s]
 27%|██▋       | 101741/371472 [8:05:23<21:19:08,  3.51it/s]
 27%|██▋       | 101742/371472 [8:05:24<20:37:45,  3.63it/s]
 27%|██▋       | 101743/371472 [8:05:24<20:10:24,  3.71it/s]
 27%|██▋       | 101744/371472 [8:05:24<22:18:25,  3.36it/s]
 27%|██▋       | 101745/371472 [8:05:25<24:53:57,  3.01it/s]
 27%|██▋       | 101746/371472 [8:05:25<23:11:01,  3.23it/s]
 27%|██▋       | 101747/371472 [8:05:25<21:57:32,  3.41it/s]
 27%|██▋       | 101748/371472 [8:05:26<21:16:25,  3.52it/s]
 27%|██▋       | 101749/371472 [8:05:26<20:44:53,  3.61it/s]
 27%|██▋       | 101750/371472 [8:05:26<20:53:21,  3.59it/s]
 27%|██▋       | 101751/371472 [8:05:26<20:08:22,  3.72it/s]
 27%|██▋       | 101752/371472 [8:05:27<22:23:13,  3.35it/s]
 27%|██▋       | 101753/371472 [8:05:27<22:25:29,  3.34it/s]
 27%|██▋       | 101754/371472 [8:05:27<22:19:08,  3.36it/s]
 27%|██▋       | 101755/371472 [8:05:28<21:09:49,  3.54it/s]
 27%|██▋       | 101756/371472 [8:05:28<21:48:21,  3.44it/s]
 27%|██▋       | 101757/371472 [8:05:28<22:21:39,  3.35it/s]
 27%|██▋       | 101758/371472 [8:05:28<21:43:30,  3.45it/s]
 27%|██▋       | 101759/371472 [8:05:29<20:49:34,  3.60it/s]
 27%|██▋       | 101760/371472 [8:05:29<20:12:26,  3.71it/s]
                                                            
{'loss': 3.5273, 'learning_rate': 7.538085285181753e-07, 'epoch': 4.38}

 27%|██▋       | 101760/371472 [8:05:29<20:12:26,  3.71it/s]
 27%|██▋       | 101761/371472 [8:05:29<22:10:44,  3.38it/s]
 27%|██▋       | 101762/371472 [8:05:30<20:58:51,  3.57it/s]
 27%|██▋       | 101763/371472 [8:05:30<20:39:29,  3.63it/s]
 27%|██▋       | 101764/371472 [8:05:30<20:23:12,  3.67it/s]
 27%|██▋       | 101765/371472 [8:05:30<20:40:36,  3.62it/s]
 27%|██▋       | 101766/371472 [8:05:31<21:56:50,  3.41it/s]
 27%|██▋       | 101767/371472 [8:05:31<21:06:47,  3.55it/s]
 27%|██▋       | 101768/371472 [8:05:31<20:15:13,  3.70it/s]
 27%|██▋       | 101769/371472 [8:05:31<20:23:02,  3.68it/s]
 27%|██▋       | 101770/371472 [8:05:32<20:59:07,  3.57it/s]
 27%|██▋       | 101771/371472 [8:05:32<21:03:19,  3.56it/s]
 27%|██▋       | 101772/371472 [8:05:32<20:19:08,  3.69it/s]
 27%|██▋       | 101773/371472 [8:05:33<19:56:41,  3.76it/s]
 27%|██▋       | 101774/371472 [8:05:33<19:23:00,  3.86it/s]
 27%|██▋       | 101775/371472 [8:05:33<20:25:13,  3.67it/s]
 27%|██▋       | 101776/371472 [8:05:33<20:17:26,  3.69it/s]
 27%|██▋       | 101777/371472 [8:05:34<20:32:56,  3.65it/s]
 27%|██▋       | 101778/371472 [8:05:34<20:03:55,  3.73it/s]
 27%|██▋       | 101779/371472 [8:05:34<20:33:11,  3.64it/s]
 27%|██▋       | 101780/371472 [8:05:34<21:23:39,  3.50it/s]
                                                            
{'loss': 3.5461, 'learning_rate': 7.537600465426964e-07, 'epoch': 4.38}

 27%|██▋       | 101780/371472 [8:05:34<21:23:39,  3.50it/s]
 27%|██▋       | 101781/371472 [8:05:35<21:15:03,  3.53it/s]
 27%|██▋       | 101782/371472 [8:05:35<21:28:37,  3.49it/s]
 27%|██▋       | 101783/371472 [8:05:35<23:22:27,  3.20it/s]
 27%|██▋       | 101784/371472 [8:05:36<22:11:20,  3.38it/s]
 27%|██▋       | 101785/371472 [8:05:36<23:01:39,  3.25it/s]
 27%|██▋       | 101786/371472 [8:05:36<21:31:13,  3.48it/s]
 27%|██▋       | 101787/371472 [8:05:37<25:03:28,  2.99it/s]
 27%|██▋       | 101788/371472 [8:05:37<23:12:37,  3.23it/s]
 27%|██▋       | 101789/371472 [8:05:37<23:44:51,  3.15it/s]
 27%|██▋       | 101790/371472 [8:05:38<22:13:35,  3.37it/s]
 27%|██▋       | 101791/371472 [8:05:38<21:47:50,  3.44it/s]
 27%|██▋       | 101792/371472 [8:05:38<22:25:51,  3.34it/s]
 27%|██▋       | 101793/371472 [8:05:38<23:07:16,  3.24it/s]
 27%|██▋       | 101794/371472 [8:05:39<21:39:15,  3.46it/s]
 27%|██▋       | 101795/371472 [8:05:39<21:25:03,  3.50it/s]
 27%|██▋       | 101796/371472 [8:05:39<21:48:17,  3.44it/s]
 27%|██▋       | 101797/371472 [8:05:40<20:48:11,  3.60it/s]
 27%|██▋       | 101798/371472 [8:05:40<21:54:13,  3.42it/s]
 27%|██▋       | 101799/371472 [8:05:40<20:49:45,  3.60it/s]
 27%|██▋       | 101800/371472 [8:05:40<20:20:48,  3.68it/s]
                                                            
{'loss': 3.6679, 'learning_rate': 7.537115645672175e-07, 'epoch': 4.38}

 27%|██▋       | 101800/371472 [8:05:40<20:20:48,  3.68it/s]
 27%|██▋       | 101801/371472 [8:05:41<20:40:33,  3.62it/s]
 27%|██▋       | 101802/371472 [8:05:41<20:47:35,  3.60it/s]
 27%|██▋       | 101803/371472 [8:05:41<20:28:55,  3.66it/s]
 27%|██▋       | 101804/371472 [8:05:41<20:39:59,  3.62it/s]
 27%|██▋       | 101805/371472 [8:05:42<20:43:02,  3.62it/s]
 27%|██▋       | 101806/371472 [8:05:42<20:13:00,  3.71it/s]
 27%|██▋       | 101807/371472 [8:05:42<19:52:46,  3.77it/s]
 27%|██▋       | 101808/371472 [8:05:43<20:24:03,  3.67it/s]
 27%|██▋       | 101809/371472 [8:05:43<19:57:50,  3.75it/s]
 27%|██▋       | 101810/371472 [8:05:43<19:54:51,  3.76it/s]
 27%|██▋       | 101811/371472 [8:05:43<19:27:27,  3.85it/s]
 27%|██▋       | 101812/371472 [8:05:44<19:36:53,  3.82it/s]
 27%|██▋       | 101813/371472 [8:05:44<20:19:05,  3.69it/s]
 27%|██▋       | 101814/371472 [8:05:44<20:40:12,  3.62it/s]
 27%|██▋       | 101815/371472 [8:05:44<20:50:42,  3.59it/s]
 27%|██▋       | 101816/371472 [8:05:45<21:15:32,  3.52it/s]
 27%|██▋       | 101817/371472 [8:05:45<21:10:19,  3.54it/s]
 27%|██▋       | 101818/371472 [8:05:45<20:38:57,  3.63it/s]
 27%|██▋       | 101819/371472 [8:05:46<20:10:56,  3.71it/s]
 27%|██▋       | 101820/371472 [8:05:46<19:38:31,  3.81it/s]
                                                            
{'loss': 3.5037, 'learning_rate': 7.536630825917386e-07, 'epoch': 4.39}

 27%|██▋       | 101820/371472 [8:05:46<19:38:31,  3.81it/s]
 27%|██▋       | 101821/371472 [8:05:46<19:23:45,  3.86it/s]
 27%|██▋       | 101822/371472 [8:05:46<19:51:20,  3.77it/s]
 27%|██▋       | 101823/371472 [8:05:47<20:06:05,  3.73it/s]
 27%|██▋       | 101824/371472 [8:05:47<22:48:32,  3.28it/s]
 27%|██▋       | 101825/371472 [8:05:47<21:52:31,  3.42it/s]
 27%|██▋       | 101826/371472 [8:05:48<21:39:29,  3.46it/s]
 27%|██▋       | 101827/371472 [8:05:48<22:15:40,  3.36it/s]
 27%|██▋       | 101828/371472 [8:05:48<21:45:19,  3.44it/s]
 27%|██▋       | 101829/371472 [8:05:48<21:25:06,  3.50it/s]
 27%|██▋       | 101830/371472 [8:05:49<21:42:24,  3.45it/s]
 27%|██▋       | 101831/371472 [8:05:49<21:32:11,  3.48it/s]
 27%|██▋       | 101832/371472 [8:05:49<21:44:49,  3.44it/s]
 27%|██▋       | 101833/371472 [8:05:50<21:58:33,  3.41it/s]
 27%|██▋       | 101834/371472 [8:05:50<21:21:40,  3.51it/s]
 27%|██▋       | 101835/371472 [8:05:50<21:03:36,  3.56it/s]
 27%|██▋       | 101836/371472 [8:05:50<22:44:00,  3.29it/s]
 27%|██▋       | 101837/371472 [8:05:51<21:53:26,  3.42it/s]
 27%|██▋       | 101838/371472 [8:05:51<21:29:46,  3.48it/s]
 27%|██▋       | 101839/371472 [8:05:51<20:25:25,  3.67it/s]
 27%|██▋       | 101840/371472 [8:05:52<21:25:31,  3.50it/s]
                                                            
{'loss': 3.6358, 'learning_rate': 7.536146006162597e-07, 'epoch': 4.39}

 27%|██▋       | 101840/371472 [8:05:52<21:25:31,  3.50it/s]
 27%|██▋       | 101841/371472 [8:05:52<21:53:20,  3.42it/s]
 27%|██▋       | 101842/371472 [8:05:52<21:50:06,  3.43it/s]
 27%|██▋       | 101843/371472 [8:05:52<20:52:47,  3.59it/s]
 27%|██▋       | 101844/371472 [8:05:53<20:41:32,  3.62it/s]
 27%|██▋       | 101845/371472 [8:05:53<20:39:20,  3.63it/s]
 27%|██▋       | 101846/371472 [8:05:53<21:04:53,  3.55it/s]
 27%|██▋       | 101847/371472 [8:05:54<20:47:53,  3.60it/s]
 27%|██▋       | 101848/371472 [8:05:54<21:09:38,  3.54it/s]
 27%|██▋       | 101849/371472 [8:05:54<21:37:57,  3.46it/s]
 27%|██▋       | 101850/371472 [8:05:54<22:12:13,  3.37it/s]
 27%|██▋       | 101851/371472 [8:05:55<22:23:38,  3.34it/s]
 27%|██▋       | 101852/371472 [8:05:55<24:01:07,  3.12it/s]
 27%|██▋       | 101853/371472 [8:05:55<24:45:29,  3.03it/s]
 27%|██▋       | 101854/371472 [8:05:56<23:02:48,  3.25it/s]
 27%|██▋       | 101855/371472 [8:05:56<21:54:03,  3.42it/s]
 27%|██▋       | 101856/371472 [8:05:56<20:54:51,  3.58it/s]
 27%|██▋       | 101857/371472 [8:05:57<21:20:58,  3.51it/s]
 27%|██▋       | 101858/371472 [8:05:57<20:36:08,  3.64it/s]
 27%|██▋       | 101859/371472 [8:05:57<20:50:03,  3.59it/s]
 27%|██▋       | 101860/371472 [8:05:57<20:53:54,  3.58it/s]
                                                            
{'loss': 3.568, 'learning_rate': 7.535661186407808e-07, 'epoch': 4.39}

 27%|██▋       | 101860/371472 [8:05:57<20:53:54,  3.58it/s]
 27%|██▋       | 101861/371472 [8:05:58<20:43:08,  3.61it/s]
 27%|██▋       | 101862/371472 [8:05:58<22:04:31,  3.39it/s]
 27%|██▋       | 101863/371472 [8:05:58<21:14:46,  3.52it/s]
 27%|██▋       | 101864/371472 [8:05:59<22:37:44,  3.31it/s]
 27%|██▋       | 101865/371472 [8:05:59<22:27:00,  3.34it/s]
 27%|██▋       | 101866/371472 [8:05:59<21:28:00,  3.49it/s]
 27%|██▋       | 101867/371472 [8:05:59<20:41:41,  3.62it/s]
 27%|██▋       | 101868/371472 [8:06:00<21:06:55,  3.55it/s]
 27%|██▋       | 101869/371472 [8:06:00<21:11:16,  3.53it/s]
 27%|██▋       | 101870/371472 [8:06:00<21:15:01,  3.52it/s]
 27%|██▋       | 101871/371472 [8:06:00<20:40:06,  3.62it/s]
 27%|██▋       | 101872/371472 [8:06:01<20:45:09,  3.61it/s]
 27%|██▋       | 101873/371472 [8:06:01<20:53:05,  3.59it/s]
 27%|██▋       | 101874/371472 [8:06:02<27:58:34,  2.68it/s]
 27%|██▋       | 101875/371472 [8:06:02<25:10:48,  2.97it/s]
 27%|██▋       | 101876/371472 [8:06:02<23:29:34,  3.19it/s]
 27%|██▋       | 101877/371472 [8:06:02<22:14:02,  3.37it/s]
 27%|██▋       | 101878/371472 [8:06:03<25:02:53,  2.99it/s]
 27%|██▋       | 101879/371472 [8:06:03<23:23:17,  3.20it/s]
 27%|██▋       | 101880/371472 [8:06:03<21:55:09,  3.42it/s]
                                                            
{'loss': 3.5031, 'learning_rate': 7.53517636665302e-07, 'epoch': 4.39}

 27%|██▋       | 101880/371472 [8:06:03<21:55:09,  3.42it/s]
 27%|██▋       | 101881/371472 [8:06:04<21:43:49,  3.45it/s]
 27%|██▋       | 101882/371472 [8:06:04<20:52:33,  3.59it/s]
 27%|██▋       | 101883/371472 [8:06:04<21:51:41,  3.43it/s]
 27%|██▋       | 101884/371472 [8:06:04<21:05:34,  3.55it/s]
 27%|██▋       | 101885/371472 [8:06:05<21:53:13,  3.42it/s]
 27%|██▋       | 101886/371472 [8:06:05<22:29:02,  3.33it/s]
 27%|██▋       | 101887/371472 [8:06:05<21:51:08,  3.43it/s]
 27%|██▋       | 101888/371472 [8:06:06<21:31:24,  3.48it/s]
 27%|██▋       | 101889/371472 [8:06:06<22:38:30,  3.31it/s]
 27%|██▋       | 101890/371472 [8:06:06<23:11:24,  3.23it/s]
 27%|██▋       | 101891/371472 [8:06:07<26:32:22,  2.82it/s]
 27%|██▋       | 101892/371472 [8:06:07<25:35:02,  2.93it/s]
 27%|██▋       | 101893/371472 [8:06:07<24:47:12,  3.02it/s]
 27%|██▋       | 101894/371472 [8:06:08<25:27:22,  2.94it/s]
 27%|██▋       | 101895/371472 [8:06:08<24:17:09,  3.08it/s]
 27%|██▋       | 101896/371472 [8:06:08<23:01:55,  3.25it/s]
 27%|██▋       | 101897/371472 [8:06:09<21:35:12,  3.47it/s]
 27%|██▋       | 101898/371472 [8:06:09<20:45:52,  3.61it/s]
 27%|██▋       | 101899/371472 [8:06:09<21:36:22,  3.47it/s]
 27%|██▋       | 101900/371472 [8:06:09<21:15:48,  3.52it/s]
                                                            
{'loss': 3.3478, 'learning_rate': 7.534691546898231e-07, 'epoch': 4.39}

 27%|██▋       | 101900/371472 [8:06:09<21:15:48,  3.52it/s]
 27%|██▋       | 101901/371472 [8:06:10<20:48:35,  3.60it/s]
 27%|██▋       | 101902/371472 [8:06:10<21:04:59,  3.55it/s]
 27%|██▋       | 101903/371472 [8:06:10<22:35:06,  3.32it/s]
 27%|██▋       | 101904/371472 [8:06:11<22:22:12,  3.35it/s]
 27%|██▋       | 101905/371472 [8:06:11<22:16:55,  3.36it/s]
 27%|██▋       | 101906/371472 [8:06:11<22:48:36,  3.28it/s]
 27%|██▋       | 101907/371472 [8:06:11<22:50:34,  3.28it/s]
 27%|██▋       | 101908/371472 [8:06:12<21:22:08,  3.50it/s]
 27%|██▋       | 101909/371472 [8:06:12<20:40:56,  3.62it/s]
 27%|██▋       | 101910/371472 [8:06:12<21:58:31,  3.41it/s]
 27%|██▋       | 101911/371472 [8:06:13<21:12:53,  3.53it/s]
 27%|██▋       | 101912/371472 [8:06:13<22:03:35,  3.39it/s]
 27%|██▋       | 101913/371472 [8:06:13<21:22:27,  3.50it/s]
 27%|██▋       | 101914/371472 [8:06:13<21:37:00,  3.46it/s]
 27%|██▋       | 101915/371472 [8:06:14<21:15:21,  3.52it/s]
 27%|██▋       | 101916/371472 [8:06:14<20:37:37,  3.63it/s]
 27%|██▋       | 101917/371472 [8:06:14<20:54:13,  3.58it/s]
 27%|██▋       | 101918/371472 [8:06:15<20:28:22,  3.66it/s]
 27%|██▋       | 101919/371472 [8:06:15<20:07:05,  3.72it/s]
 27%|██▋       | 101920/371472 [8:06:15<21:52:51,  3.42it/s]
                                                            
{'loss': 3.6285, 'learning_rate': 7.534206727143442e-07, 'epoch': 4.39}

 27%|██▋       | 101920/371472 [8:06:15<21:52:51,  3.42it/s]
 27%|██▋       | 101921/371472 [8:06:15<22:37:00,  3.31it/s]
 27%|██▋       | 101922/371472 [8:06:16<23:08:27,  3.24it/s]
 27%|██▋       | 101923/371472 [8:06:16<23:16:07,  3.22it/s]
 27%|██▋       | 101924/371472 [8:06:16<22:55:19,  3.27it/s]
 27%|██▋       | 101925/371472 [8:06:17<22:07:48,  3.38it/s]
 27%|██▋       | 101926/371472 [8:06:17<22:14:05,  3.37it/s]
 27%|██▋       | 101927/371472 [8:06:17<21:48:25,  3.43it/s]
 27%|██▋       | 101928/371472 [8:06:18<21:10:20,  3.54it/s]
 27%|██▋       | 101929/371472 [8:06:18<20:40:24,  3.62it/s]
 27%|██▋       | 101930/371472 [8:06:18<21:56:24,  3.41it/s]
 27%|██▋       | 101931/371472 [8:06:18<21:29:22,  3.48it/s]
 27%|██▋       | 101932/371472 [8:06:19<20:57:15,  3.57it/s]
 27%|██▋       | 101933/371472 [8:06:19<21:55:09,  3.42it/s]
 27%|██▋       | 101934/371472 [8:06:19<21:05:51,  3.55it/s]
 27%|██▋       | 101935/371472 [8:06:20<21:06:38,  3.55it/s]
 27%|██▋       | 101936/371472 [8:06:20<21:37:49,  3.46it/s]
 27%|██▋       | 101937/371472 [8:06:20<20:54:47,  3.58it/s]
 27%|██▋       | 101938/371472 [8:06:20<22:45:05,  3.29it/s]
 27%|██▋       | 101939/371472 [8:06:21<23:15:46,  3.22it/s]
 27%|██▋       | 101940/371472 [8:06:21<21:58:41,  3.41it/s]
                                                            
{'loss': 3.549, 'learning_rate': 7.533721907388652e-07, 'epoch': 4.39}

 27%|██▋       | 101940/371472 [8:06:21<21:58:41,  3.41it/s]
 27%|██▋       | 101941/371472 [8:06:21<22:51:36,  3.28it/s]
 27%|██▋       | 101942/371472 [8:06:22<23:16:43,  3.22it/s]
 27%|██▋       | 101943/371472 [8:06:22<24:52:33,  3.01it/s]
 27%|██▋       | 101944/371472 [8:06:22<23:16:20,  3.22it/s]
 27%|██▋       | 101945/371472 [8:06:23<22:07:02,  3.39it/s]
 27%|██▋       | 101946/371472 [8:06:23<21:33:39,  3.47it/s]
 27%|██▋       | 101947/371472 [8:06:23<21:45:59,  3.44it/s]
 27%|██▋       | 101948/371472 [8:06:23<22:07:16,  3.38it/s]
 27%|██▋       | 101949/371472 [8:06:24<22:56:16,  3.26it/s]
 27%|██▋       | 101950/371472 [8:06:24<22:39:03,  3.31it/s]
 27%|██▋       | 101951/371472 [8:06:24<22:12:34,  3.37it/s]
 27%|██▋       | 101952/371472 [8:06:25<21:34:36,  3.47it/s]
 27%|██▋       | 101953/371472 [8:06:25<21:49:49,  3.43it/s]
 27%|██▋       | 101954/371472 [8:06:25<21:32:20,  3.48it/s]
 27%|██▋       | 101955/371472 [8:06:26<21:47:26,  3.44it/s]
 27%|██▋       | 101956/371472 [8:06:26<21:43:24,  3.45it/s]
 27%|██▋       | 101957/371472 [8:06:26<22:05:24,  3.39it/s]
 27%|██▋       | 101958/371472 [8:06:26<22:15:17,  3.36it/s]
 27%|██▋       | 101959/371472 [8:06:27<21:54:35,  3.42it/s]
 27%|██▋       | 101960/371472 [8:06:27<22:57:43,  3.26it/s]
                                                            
{'loss': 3.5341, 'learning_rate': 7.533237087633864e-07, 'epoch': 4.39}

 27%|██▋       | 101960/371472 [8:06:27<22:57:43,  3.26it/s]
 27%|██▋       | 101961/371472 [8:06:27<22:15:55,  3.36it/s]
 27%|██▋       | 101962/371472 [8:06:28<21:37:12,  3.46it/s]
 27%|██▋       | 101963/371472 [8:06:28<20:48:26,  3.60it/s]
 27%|██▋       | 101964/371472 [8:06:28<21:42:26,  3.45it/s]
 27%|██▋       | 101965/371472 [8:06:28<22:16:41,  3.36it/s]
 27%|██▋       | 101966/371472 [8:06:29<23:21:56,  3.20it/s]
 27%|██▋       | 101967/371472 [8:06:29<22:45:49,  3.29it/s]
 27%|██▋       | 101968/371472 [8:06:29<22:53:07,  3.27it/s]
 27%|██▋       | 101969/371472 [8:06:30<22:09:40,  3.38it/s]
 27%|██▋       | 101970/371472 [8:06:30<21:32:57,  3.47it/s]
 27%|██▋       | 101971/371472 [8:06:30<21:12:00,  3.53it/s]
 27%|██▋       | 101972/371472 [8:06:30<21:19:17,  3.51it/s]
 27%|██▋       | 101973/371472 [8:06:31<21:01:52,  3.56it/s]
 27%|██▋       | 101974/371472 [8:06:31<21:17:04,  3.52it/s]
 27%|██▋       | 101975/371472 [8:06:31<21:27:41,  3.49it/s]
 27%|██▋       | 101976/371472 [8:06:32<24:03:04,  3.11it/s]
 27%|██▋       | 101977/371472 [8:06:32<22:49:08,  3.28it/s]
 27%|██▋       | 101978/371472 [8:06:32<21:42:52,  3.45it/s]
 27%|██▋       | 101979/371472 [8:06:33<21:53:18,  3.42it/s]
 27%|██▋       | 101980/371472 [8:06:33<22:38:14,  3.31it/s]
                                                            
{'loss': 3.6116, 'learning_rate': 7.532752267879075e-07, 'epoch': 4.39}

 27%|██▋       | 101980/371472 [8:06:33<22:38:14,  3.31it/s]
 27%|██▋       | 101981/371472 [8:06:33<22:23:42,  3.34it/s]
 27%|██▋       | 101982/371472 [8:06:33<21:50:18,  3.43it/s]
 27%|██▋       | 101983/371472 [8:06:34<21:17:27,  3.52it/s]
 27%|██▋       | 101984/371472 [8:06:34<20:41:03,  3.62it/s]
 27%|██▋       | 101985/371472 [8:06:34<21:01:18,  3.56it/s]
 27%|██▋       | 101986/371472 [8:06:35<20:44:42,  3.61it/s]
 27%|██▋       | 101987/371472 [8:06:35<22:01:48,  3.40it/s]
 27%|██▋       | 101988/371472 [8:06:35<22:24:26,  3.34it/s]
 27%|██▋       | 101989/371472 [8:06:35<21:06:45,  3.55it/s]
 27%|██▋       | 101990/371472 [8:06:36<21:36:53,  3.46it/s]
 27%|██▋       | 101991/371472 [8:06:36<24:15:24,  3.09it/s]
 27%|██▋       | 101992/371472 [8:06:36<23:38:21,  3.17it/s]
 27%|██▋       | 101993/371472 [8:06:37<22:54:42,  3.27it/s]
 27%|██▋       | 101994/371472 [8:06:37<22:32:57,  3.32it/s]
 27%|██▋       | 101995/371472 [8:06:37<22:32:49,  3.32it/s]
 27%|██▋       | 101996/371472 [8:06:38<22:23:12,  3.34it/s]
 27%|██▋       | 101997/371472 [8:06:38<21:17:47,  3.51it/s]
 27%|██▋       | 101998/371472 [8:06:38<21:17:37,  3.52it/s]
 27%|██▋       | 101999/371472 [8:06:39<24:07:10,  3.10it/s]
 27%|██▋       | 102000/371472 [8:06:39<22:33:49,  3.32it/s]
                                                            
{'loss': 3.4513, 'learning_rate': 7.532267448124286e-07, 'epoch': 4.39}

 27%|██▋       | 102000/371472 [8:06:39<22:33:49,  3.32it/s]
 27%|██▋       | 102001/371472 [8:06:39<21:31:37,  3.48it/s]
 27%|██▋       | 102002/371472 [8:06:39<20:51:21,  3.59it/s]
 27%|██▋       | 102003/371472 [8:06:40<20:04:29,  3.73it/s]
 27%|██▋       | 102004/371472 [8:06:40<19:57:22,  3.75it/s]
 27%|██▋       | 102005/371472 [8:06:40<21:06:21,  3.55it/s]
 27%|██▋       | 102006/371472 [8:06:40<21:07:25,  3.54it/s]
 27%|██▋       | 102007/371472 [8:06:41<21:19:55,  3.51it/s]
 27%|██▋       | 102008/371472 [8:06:41<21:11:45,  3.53it/s]
 27%|██▋       | 102009/371472 [8:06:41<20:17:51,  3.69it/s]
 27%|██▋       | 102010/371472 [8:06:42<20:52:05,  3.59it/s]
 27%|██▋       | 102011/371472 [8:06:42<21:22:18,  3.50it/s]
 27%|██▋       | 102012/371472 [8:06:42<21:36:47,  3.46it/s]
 27%|██▋       | 102013/371472 [8:06:42<21:48:56,  3.43it/s]
 27%|██▋       | 102014/371472 [8:06:43<20:46:18,  3.60it/s]
 27%|██▋       | 102015/371472 [8:06:43<20:05:48,  3.72it/s]
 27%|██▋       | 102016/371472 [8:06:43<19:38:31,  3.81it/s]
 27%|██▋       | 102017/371472 [8:06:43<20:06:52,  3.72it/s]
 27%|██▋       | 102018/371472 [8:06:44<22:22:39,  3.34it/s]
 27%|██▋       | 102019/371472 [8:06:44<21:07:25,  3.54it/s]
 27%|██▋       | 102020/371472 [8:06:44<22:05:34,  3.39it/s]
                                                            
{'loss': 3.6678, 'learning_rate': 7.531782628369497e-07, 'epoch': 4.39}

 27%|██▋       | 102020/371472 [8:06:44<22:05:34,  3.39it/s]
 27%|██▋       | 102021/371472 [8:06:45<21:39:00,  3.46it/s]
 27%|██▋       | 102022/371472 [8:06:45<20:56:34,  3.57it/s]
 27%|██▋       | 102023/371472 [8:06:45<21:46:53,  3.44it/s]
 27%|██▋       | 102024/371472 [8:06:46<21:11:11,  3.53it/s]
 27%|██▋       | 102025/371472 [8:06:46<21:00:56,  3.56it/s]
 27%|██▋       | 102026/371472 [8:06:46<21:27:31,  3.49it/s]
 27%|██▋       | 102027/371472 [8:06:46<21:23:33,  3.50it/s]
 27%|██▋       | 102028/371472 [8:06:47<20:33:01,  3.64it/s]
 27%|██▋       | 102029/371472 [8:06:47<20:20:37,  3.68it/s]
 27%|██▋       | 102030/371472 [8:06:47<20:35:45,  3.63it/s]
 27%|██▋       | 102031/371472 [8:06:47<21:38:48,  3.46it/s]
 27%|██▋       | 102032/371472 [8:06:48<21:27:57,  3.49it/s]
 27%|██▋       | 102033/371472 [8:06:48<20:47:42,  3.60it/s]
 27%|██▋       | 102034/371472 [8:06:48<21:14:46,  3.52it/s]
 27%|██▋       | 102035/371472 [8:06:49<21:49:18,  3.43it/s]
 27%|██▋       | 102036/371472 [8:06:49<21:10:58,  3.53it/s]
 27%|██▋       | 102037/371472 [8:06:49<20:42:35,  3.61it/s]
 27%|██▋       | 102038/371472 [8:06:49<20:25:12,  3.67it/s]
 27%|██▋       | 102039/371472 [8:06:50<20:02:31,  3.73it/s]
 27%|██▋       | 102040/371472 [8:06:50<21:00:32,  3.56it/s]
                                                            
{'loss': 3.5044, 'learning_rate': 7.531297808614709e-07, 'epoch': 4.4}

 27%|██▋       | 102040/371472 [8:06:50<21:00:32,  3.56it/s]
 27%|██▋       | 102041/371472 [8:06:50<21:04:10,  3.55it/s]
 27%|██▋       | 102042/371472 [8:06:51<20:29:52,  3.65it/s]
 27%|██▋       | 102043/371472 [8:06:51<20:12:33,  3.70it/s]
 27%|██▋       | 102044/371472 [8:06:51<19:50:58,  3.77it/s]
 27%|██▋       | 102045/371472 [8:06:51<20:16:22,  3.69it/s]
 27%|██▋       | 102046/371472 [8:06:52<20:02:51,  3.73it/s]
 27%|██▋       | 102047/371472 [8:06:52<20:33:40,  3.64it/s]
 27%|██▋       | 102048/371472 [8:06:52<20:19:00,  3.68it/s]
 27%|██▋       | 102049/371472 [8:06:52<19:58:13,  3.75it/s]
 27%|██▋       | 102050/371472 [8:06:53<20:52:42,  3.58it/s]
 27%|██▋       | 102051/371472 [8:06:53<21:56:17,  3.41it/s]
 27%|██▋       | 102052/371472 [8:06:53<21:38:32,  3.46it/s]
 27%|██▋       | 102053/371472 [8:06:54<21:48:39,  3.43it/s]
 27%|██▋       | 102054/371472 [8:06:54<21:44:52,  3.44it/s]
 27%|██▋       | 102055/371472 [8:06:54<21:47:28,  3.43it/s]
 27%|██▋       | 102056/371472 [8:06:55<22:36:56,  3.31it/s]
 27%|██▋       | 102057/371472 [8:06:55<21:33:27,  3.47it/s]
 27%|██▋       | 102058/371472 [8:06:55<22:52:14,  3.27it/s]
 27%|██▋       | 102059/371472 [8:06:55<22:30:18,  3.33it/s]
 27%|██▋       | 102060/371472 [8:06:56<21:50:44,  3.43it/s]
                                                            
{'loss': 3.4782, 'learning_rate': 7.530812988859919e-07, 'epoch': 4.4}

 27%|██▋       | 102060/371472 [8:06:56<21:50:44,  3.43it/s]
 27%|██▋       | 102061/371472 [8:06:56<21:32:14,  3.47it/s]
 27%|██▋       | 102062/371472 [8:06:56<20:54:01,  3.58it/s]
 27%|██▋       | 102063/371472 [8:06:57<24:56:46,  3.00it/s]
 27%|██▋       | 102064/371472 [8:06:57<23:49:55,  3.14it/s]
 27%|██▋       | 102065/371472 [8:06:57<22:17:43,  3.36it/s]
 27%|██▋       | 102066/371472 [8:06:58<22:18:35,  3.35it/s]
 27%|██▋       | 102067/371472 [8:06:58<21:13:17,  3.53it/s]
 27%|██▋       | 102068/371472 [8:06:58<21:18:10,  3.51it/s]
 27%|██▋       | 102069/371472 [8:06:58<21:19:47,  3.51it/s]
 27%|██▋       | 102070/371472 [8:06:59<21:45:07,  3.44it/s]
 27%|██▋       | 102071/371472 [8:06:59<21:48:48,  3.43it/s]
 27%|██▋       | 102072/371472 [8:06:59<20:57:20,  3.57it/s]
 27%|██▋       | 102073/371472 [8:06:59<21:17:47,  3.51it/s]
 27%|██▋       | 102074/371472 [8:07:00<20:37:52,  3.63it/s]
 27%|██▋       | 102075/371472 [8:07:00<22:12:40,  3.37it/s]
 27%|██▋       | 102076/371472 [8:07:00<20:56:42,  3.57it/s]
 27%|██▋       | 102077/371472 [8:07:01<20:30:40,  3.65it/s]
 27%|██▋       | 102078/371472 [8:07:01<20:16:37,  3.69it/s]
 27%|██▋       | 102079/371472 [8:07:01<20:19:28,  3.68it/s]
 27%|██▋       | 102080/371472 [8:07:01<20:27:59,  3.66it/s]
                                                            
{'loss': 3.4979, 'learning_rate': 7.530328169105129e-07, 'epoch': 4.4}

 27%|██▋       | 102080/371472 [8:07:01<20:27:59,  3.66it/s]
 27%|██▋       | 102081/371472 [8:07:02<20:31:22,  3.65it/s]
 27%|██▋       | 102082/371472 [8:07:02<20:43:06,  3.61it/s]
 27%|██▋       | 102083/371472 [8:07:02<22:30:33,  3.32it/s]
 27%|██▋       | 102084/371472 [8:07:03<22:24:58,  3.34it/s]
 27%|██▋       | 102085/371472 [8:07:03<21:57:03,  3.41it/s]
 27%|██▋       | 102086/371472 [8:07:03<21:33:49,  3.47it/s]
 27%|██▋       | 102087/371472 [8:07:03<21:11:23,  3.53it/s]
 27%|██▋       | 102088/371472 [8:07:04<21:30:31,  3.48it/s]
 27%|██▋       | 102089/371472 [8:07:04<21:56:05,  3.41it/s]
 27%|██▋       | 102090/371472 [8:07:04<21:52:16,  3.42it/s]
 27%|██▋       | 102091/371472 [8:07:05<21:48:22,  3.43it/s]
 27%|██▋       | 102092/371472 [8:07:05<21:08:51,  3.54it/s]
 27%|██▋       | 102093/371472 [8:07:05<21:58:26,  3.41it/s]
 27%|██▋       | 102094/371472 [8:07:06<22:10:32,  3.37it/s]
 27%|██▋       | 102095/371472 [8:07:06<21:02:28,  3.56it/s]
 27%|██▋       | 102096/371472 [8:07:06<20:46:03,  3.60it/s]
 27%|██▋       | 102097/371472 [8:07:06<20:16:13,  3.69it/s]
 27%|██▋       | 102098/371472 [8:07:07<20:38:45,  3.62it/s]
 27%|██▋       | 102099/371472 [8:07:07<20:52:24,  3.58it/s]
 27%|██▋       | 102100/371472 [8:07:07<21:08:25,  3.54it/s]
                                                            
{'loss': 3.4867, 'learning_rate': 7.529843349350341e-07, 'epoch': 4.4}

 27%|██▋       | 102100/371472 [8:07:07<21:08:25,  3.54it/s]
 27%|██▋       | 102101/371472 [8:07:07<21:08:57,  3.54it/s]
 27%|██▋       | 102102/371472 [8:07:08<21:04:46,  3.55it/s]
 27%|██▋       | 102103/371472 [8:07:08<20:47:18,  3.60it/s]
 27%|██▋       | 102104/371472 [8:07:08<21:41:45,  3.45it/s]
 27%|██▋       | 102105/371472 [8:07:09<22:10:16,  3.37it/s]
 27%|██▋       | 102106/371472 [8:07:09<21:58:00,  3.41it/s]
 27%|██▋       | 102107/371472 [8:07:09<21:27:06,  3.49it/s]
 27%|██▋       | 102108/371472 [8:07:09<21:10:16,  3.53it/s]
 27%|██▋       | 102109/371472 [8:07:10<20:30:26,  3.65it/s]
 27%|██▋       | 102110/371472 [8:07:10<21:01:38,  3.56it/s]
 27%|██▋       | 102111/371472 [8:07:10<21:48:33,  3.43it/s]
 27%|██▋       | 102112/371472 [8:07:11<21:29:10,  3.48it/s]
 27%|██▋       | 102113/371472 [8:07:11<20:47:46,  3.60it/s]
 27%|██▋       | 102114/371472 [8:07:11<20:12:02,  3.70it/s]
 27%|██▋       | 102115/371472 [8:07:11<21:42:03,  3.45it/s]
 27%|██▋       | 102116/371472 [8:07:12<21:16:00,  3.52it/s]
 27%|██▋       | 102117/371472 [8:07:12<21:22:11,  3.50it/s]
 27%|██▋       | 102118/371472 [8:07:12<21:49:10,  3.43it/s]
 27%|██▋       | 102119/371472 [8:07:13<21:13:57,  3.52it/s]
 27%|██▋       | 102120/371472 [8:07:13<20:42:49,  3.61it/s]
                                                            
{'loss': 3.4821, 'learning_rate': 7.529358529595553e-07, 'epoch': 4.4}

 27%|██▋       | 102120/371472 [8:07:13<20:42:49,  3.61it/s]
 27%|██▋       | 102121/371472 [8:07:13<20:02:36,  3.73it/s]
 27%|██▋       | 102122/371472 [8:07:13<20:08:29,  3.71it/s]
 27%|██▋       | 102123/371472 [8:07:14<20:33:48,  3.64it/s]
 27%|██▋       | 102124/371472 [8:07:14<20:18:53,  3.68it/s]
 27%|██▋       | 102125/371472 [8:07:14<21:22:14,  3.50it/s]
 27%|██▋       | 102126/371472 [8:07:14<20:52:27,  3.58it/s]
 27%|██▋       | 102127/371472 [8:07:15<21:07:26,  3.54it/s]
 27%|██▋       | 102128/371472 [8:07:15<21:29:51,  3.48it/s]
 27%|██▋       | 102129/371472 [8:07:15<21:25:19,  3.49it/s]
 27%|██▋       | 102130/371472 [8:07:16<20:53:43,  3.58it/s]
 27%|██▋       | 102131/371472 [8:07:16<25:18:44,  2.96it/s]
 27%|██▋       | 102132/371472 [8:07:16<24:41:08,  3.03it/s]
 27%|██▋       | 102133/371472 [8:07:17<24:34:30,  3.04it/s]
 27%|██▋       | 102134/371472 [8:07:17<22:37:19,  3.31it/s]
 27%|██▋       | 102135/371472 [8:07:17<21:43:45,  3.44it/s]
 27%|██▋       | 102136/371472 [8:07:17<21:20:01,  3.51it/s]
 27%|██▋       | 102137/371472 [8:07:18<21:27:04,  3.49it/s]
 27%|██▋       | 102138/371472 [8:07:18<20:55:08,  3.58it/s]
 27%|██▋       | 102139/371472 [8:07:18<20:48:41,  3.59it/s]
 27%|██▋       | 102140/371472 [8:07:19<21:49:21,  3.43it/s]
                                                            
{'loss': 3.6658, 'learning_rate': 7.528873709840764e-07, 'epoch': 4.4}

 27%|██▋       | 102140/371472 [8:07:19<21:49:21,  3.43it/s]
 27%|██▋       | 102141/371472 [8:07:19<22:03:22,  3.39it/s]
 27%|██▋       | 102142/371472 [8:07:19<21:25:16,  3.49it/s]
 27%|██▋       | 102143/371472 [8:07:20<22:56:41,  3.26it/s]
 27%|██▋       | 102144/371472 [8:07:20<21:56:42,  3.41it/s]
 27%|██▋       | 102145/371472 [8:07:20<21:27:06,  3.49it/s]
 27%|██▋       | 102146/371472 [8:07:20<21:30:46,  3.48it/s]
 27%|██▋       | 102147/371472 [8:07:21<22:45:21,  3.29it/s]
 27%|██▋       | 102148/371472 [8:07:21<22:06:07,  3.38it/s]
 27%|██▋       | 102149/371472 [8:07:21<20:46:05,  3.60it/s]
 27%|██▋       | 102150/371472 [8:07:21<20:12:33,  3.70it/s]
 27%|██▋       | 102151/371472 [8:07:22<20:51:28,  3.59it/s]
 27%|██▋       | 102152/371472 [8:07:22<20:20:51,  3.68it/s]
 27%|██▋       | 102153/371472 [8:07:22<22:22:39,  3.34it/s]
 27%|██▋       | 102154/371472 [8:07:23<25:25:42,  2.94it/s]
 28%|██▊       | 102155/371472 [8:07:23<24:23:52,  3.07it/s]
 28%|██▊       | 102156/371472 [8:07:23<23:22:45,  3.20it/s]
 28%|██▊       | 102157/371472 [8:07:24<24:50:48,  3.01it/s]
 28%|██▊       | 102158/371472 [8:07:24<23:38:22,  3.16it/s]
 28%|██▊       | 102159/371472 [8:07:24<23:13:08,  3.22it/s]
 28%|██▊       | 102160/371472 [8:07:25<22:00:56,  3.40it/s]
                                                            
{'loss': 3.3317, 'learning_rate': 7.528388890085974e-07, 'epoch': 4.4}

 28%|██▊       | 102160/371472 [8:07:25<22:00:56,  3.40it/s]
 28%|██▊       | 102161/371472 [8:07:25<20:59:39,  3.56it/s]
 28%|██▊       | 102162/371472 [8:07:25<21:03:34,  3.55it/s]
 28%|██▊       | 102163/371472 [8:07:25<21:00:31,  3.56it/s]
 28%|██▊       | 102164/371472 [8:07:26<21:04:45,  3.55it/s]
 28%|██▊       | 102165/371472 [8:07:26<21:01:10,  3.56it/s]
 28%|██▊       | 102166/371472 [8:07:26<21:21:54,  3.50it/s]
 28%|██▊       | 102167/371472 [8:07:27<20:41:22,  3.62it/s]
 28%|██▊       | 102168/371472 [8:07:27<19:59:29,  3.74it/s]
 28%|██▊       | 102169/371472 [8:07:27<20:24:33,  3.67it/s]
 28%|██▊       | 102170/371472 [8:07:27<20:31:18,  3.65it/s]
 28%|██▊       | 102171/371472 [8:07:28<21:09:58,  3.53it/s]
 28%|██▊       | 102172/371472 [8:07:28<20:58:39,  3.57it/s]
 28%|██▊       | 102173/371472 [8:07:28<21:14:01,  3.52it/s]
 28%|██▊       | 102174/371472 [8:07:29<22:28:21,  3.33it/s]
 28%|██▊       | 102175/371472 [8:07:29<21:45:49,  3.44it/s]
 28%|██▊       | 102176/371472 [8:07:29<21:08:34,  3.54it/s]
 28%|██▊       | 102177/371472 [8:07:29<22:12:40,  3.37it/s]
 28%|██▊       | 102178/371472 [8:07:30<21:34:07,  3.47it/s]
 28%|██▊       | 102179/371472 [8:07:30<22:05:19,  3.39it/s]
 28%|██▊       | 102180/371472 [8:07:30<22:48:32,  3.28it/s]
                                                            
{'loss': 3.6214, 'learning_rate': 7.527904070331185e-07, 'epoch': 4.4}

 28%|██▊       | 102180/371472 [8:07:30<22:48:32,  3.28it/s]
 28%|██▊       | 102181/371472 [8:07:31<21:45:16,  3.44it/s]
 28%|██▊       | 102182/371472 [8:07:31<20:50:23,  3.59it/s]
 28%|██▊       | 102183/371472 [8:07:31<21:21:32,  3.50it/s]
 28%|██▊       | 102184/371472 [8:07:31<21:15:56,  3.52it/s]
 28%|██▊       | 102185/371472 [8:07:32<20:34:58,  3.63it/s]
 28%|██▊       | 102186/371472 [8:07:32<21:01:13,  3.56it/s]
 28%|██▊       | 102187/371472 [8:07:32<20:07:01,  3.72it/s]
 28%|██▊       | 102188/371472 [8:07:33<20:22:40,  3.67it/s]
 28%|██▊       | 102189/371472 [8:07:33<21:23:56,  3.50it/s]
 28%|██▊       | 102190/371472 [8:07:33<20:22:30,  3.67it/s]
 28%|██▊       | 102191/371472 [8:07:33<20:43:33,  3.61it/s]
 28%|██▊       | 102192/371472 [8:07:34<21:30:30,  3.48it/s]
 28%|██▊       | 102193/371472 [8:07:34<21:03:12,  3.55it/s]
 28%|██▊       | 102194/371472 [8:07:34<21:00:06,  3.56it/s]
 28%|██▊       | 102195/371472 [8:07:34<20:37:05,  3.63it/s]
 28%|██▊       | 102196/371472 [8:07:35<20:43:52,  3.61it/s]
 28%|██▊       | 102197/371472 [8:07:35<20:42:20,  3.61it/s]
 28%|██▊       | 102198/371472 [8:07:35<22:05:22,  3.39it/s]
 28%|██▊       | 102199/371472 [8:07:36<22:26:49,  3.33it/s]
 28%|██▊       | 102200/371472 [8:07:36<22:35:45,  3.31it/s]
                                                            
{'loss': 3.5743, 'learning_rate': 7.527419250576397e-07, 'epoch': 4.4}

 28%|██▊       | 102200/371472 [8:07:36<22:35:45,  3.31it/s]
 28%|██▊       | 102201/371472 [8:07:36<22:45:46,  3.29it/s]
 28%|██▊       | 102202/371472 [8:07:37<21:46:04,  3.44it/s]
 28%|██▊       | 102203/371472 [8:07:37<21:05:45,  3.55it/s]
 28%|██▊       | 102204/371472 [8:07:37<20:55:30,  3.57it/s]
 28%|██▊       | 102205/371472 [8:07:37<20:44:07,  3.61it/s]
 28%|██▊       | 102206/371472 [8:07:38<20:41:38,  3.61it/s]
 28%|██▊       | 102207/371472 [8:07:38<20:45:56,  3.60it/s]
 28%|██▊       | 102208/371472 [8:07:38<20:57:29,  3.57it/s]
 28%|██▊       | 102209/371472 [8:07:39<21:52:18,  3.42it/s]
 28%|██▊       | 102210/371472 [8:07:39<21:04:11,  3.55it/s]
 28%|██▊       | 102211/371472 [8:07:39<20:49:53,  3.59it/s]
 28%|██▊       | 102212/371472 [8:07:39<20:42:50,  3.61it/s]
 28%|██▊       | 102213/371472 [8:07:40<20:54:28,  3.58it/s]
 28%|██▊       | 102214/371472 [8:07:40<21:36:12,  3.46it/s]
 28%|██▊       | 102215/371472 [8:07:40<22:05:36,  3.39it/s]
 28%|██▊       | 102216/371472 [8:07:40<20:54:21,  3.58it/s]
 28%|██▊       | 102217/371472 [8:07:41<21:32:51,  3.47it/s]
 28%|██▊       | 102218/371472 [8:07:41<21:10:10,  3.53it/s]
 28%|██▊       | 102219/371472 [8:07:41<20:27:41,  3.66it/s]
 28%|██▊       | 102220/371472 [8:07:42<22:13:40,  3.36it/s]
                                                            
{'loss': 3.5693, 'learning_rate': 7.526934430821608e-07, 'epoch': 4.4}

 28%|██▊       | 102220/371472 [8:07:42<22:13:40,  3.36it/s]
 28%|██▊       | 102221/371472 [8:07:42<25:19:47,  2.95it/s]
 28%|██▊       | 102222/371472 [8:07:42<24:15:11,  3.08it/s]
 28%|██▊       | 102223/371472 [8:07:43<23:53:38,  3.13it/s]
 28%|██▊       | 102224/371472 [8:07:43<22:15:51,  3.36it/s]
 28%|██▊       | 102225/371472 [8:07:43<24:16:49,  3.08it/s]
 28%|██▊       | 102226/371472 [8:07:44<23:00:29,  3.25it/s]
 28%|██▊       | 102227/371472 [8:07:44<22:39:33,  3.30it/s]
 28%|██▊       | 102228/371472 [8:07:44<24:02:06,  3.11it/s]
 28%|██▊       | 102229/371472 [8:07:45<22:39:12,  3.30it/s]
 28%|██▊       | 102230/371472 [8:07:45<21:25:59,  3.49it/s]
 28%|██▊       | 102231/371472 [8:07:45<21:28:00,  3.48it/s]
 28%|██▊       | 102232/371472 [8:07:45<21:01:23,  3.56it/s]
 28%|██▊       | 102233/371472 [8:07:46<21:23:11,  3.50it/s]
 28%|██▊       | 102234/371472 [8:07:46<21:04:07,  3.55it/s]
 28%|██▊       | 102235/371472 [8:07:46<20:57:06,  3.57it/s]
 28%|██▊       | 102236/371472 [8:07:46<21:30:17,  3.48it/s]
 28%|██▊       | 102237/371472 [8:07:47<22:46:23,  3.28it/s]
 28%|██▊       | 102238/371472 [8:07:47<21:49:20,  3.43it/s]
 28%|██▊       | 102239/371472 [8:07:47<21:49:42,  3.43it/s]
 28%|██▊       | 102240/371472 [8:07:48<23:01:10,  3.25it/s]
                                                            
{'loss': 3.7025, 'learning_rate': 7.526449611066818e-07, 'epoch': 4.4}

 28%|██▊       | 102240/371472 [8:07:48<23:01:10,  3.25it/s]
 28%|██▊       | 102241/371472 [8:07:48<23:37:16,  3.17it/s]
 28%|██▊       | 102242/371472 [8:07:48<22:56:40,  3.26it/s]
 28%|██▊       | 102243/371472 [8:07:49<22:09:55,  3.37it/s]
 28%|██▊       | 102244/371472 [8:07:49<21:22:28,  3.50it/s]
 28%|██▊       | 102245/371472 [8:07:49<21:29:35,  3.48it/s]
 28%|██▊       | 102246/371472 [8:07:50<22:42:51,  3.29it/s]
 28%|██▊       | 102247/371472 [8:07:50<21:34:55,  3.47it/s]
 28%|██▊       | 102248/371472 [8:07:50<21:06:22,  3.54it/s]
 28%|██▊       | 102249/371472 [8:07:50<20:44:41,  3.60it/s]
 28%|██▊       | 102250/371472 [8:07:51<21:30:31,  3.48it/s]
 28%|██▊       | 102251/371472 [8:07:51<23:28:03,  3.19it/s]
 28%|██▊       | 102252/371472 [8:07:51<22:40:37,  3.30it/s]
 28%|██▊       | 102253/371472 [8:07:52<22:23:14,  3.34it/s]
 28%|██▊       | 102254/371472 [8:07:52<21:57:55,  3.40it/s]
 28%|██▊       | 102255/371472 [8:07:52<22:30:25,  3.32it/s]
 28%|██▊       | 102256/371472 [8:07:52<21:05:50,  3.54it/s]
 28%|██▊       | 102257/371472 [8:07:53<20:39:41,  3.62it/s]
 28%|██▊       | 102258/371472 [8:07:53<20:46:50,  3.60it/s]
 28%|██▊       | 102259/371472 [8:07:53<20:11:36,  3.70it/s]
 28%|██▊       | 102260/371472 [8:07:53<20:28:53,  3.65it/s]
                                                            
{'loss': 3.5446, 'learning_rate': 7.52596479131203e-07, 'epoch': 4.4}

 28%|██▊       | 102260/371472 [8:07:53<20:28:53,  3.65it/s]
 28%|██▊       | 102261/371472 [8:07:54<21:28:31,  3.48it/s]
 28%|██▊       | 102262/371472 [8:07:54<22:00:49,  3.40it/s]
 28%|██▊       | 102263/371472 [8:07:54<23:01:24,  3.25it/s]
 28%|██▊       | 102264/371472 [8:07:55<22:03:20,  3.39it/s]
 28%|██▊       | 102265/371472 [8:07:55<21:49:29,  3.43it/s]
 28%|██▊       | 102266/371472 [8:07:55<21:00:03,  3.56it/s]
 28%|██▊       | 102267/371472 [8:07:56<21:08:52,  3.54it/s]
 28%|██▊       | 102268/371472 [8:07:56<21:03:54,  3.55it/s]
 28%|██▊       | 102269/371472 [8:07:56<21:10:56,  3.53it/s]
 28%|██▊       | 102270/371472 [8:07:56<20:38:16,  3.62it/s]
 28%|██▊       | 102271/371472 [8:07:57<21:26:04,  3.49it/s]
 28%|██▊       | 102272/371472 [8:07:57<20:34:52,  3.63it/s]
 28%|██▊       | 102273/371472 [8:07:57<20:53:44,  3.58it/s]
 28%|██▊       | 102274/371472 [8:07:57<21:13:19,  3.52it/s]
 28%|██▊       | 102275/371472 [8:07:58<21:03:00,  3.55it/s]
 28%|██▊       | 102276/371472 [8:07:58<23:43:18,  3.15it/s]
 28%|██▊       | 102277/371472 [8:07:58<22:45:26,  3.29it/s]
 28%|██▊       | 102278/371472 [8:07:59<22:50:14,  3.27it/s]
 28%|██▊       | 102279/371472 [8:07:59<21:54:27,  3.41it/s]
 28%|██▊       | 102280/371472 [8:07:59<25:00:30,  2.99it/s]
                                                            
{'loss': 3.689, 'learning_rate': 7.525479971557242e-07, 'epoch': 4.41}

 28%|██▊       | 102280/371472 [8:07:59<25:00:30,  2.99it/s]
 28%|██▊       | 102281/371472 [8:08:00<24:20:40,  3.07it/s]
 28%|██▊       | 102282/371472 [8:08:00<22:42:03,  3.29it/s]
 28%|██▊       | 102283/371472 [8:08:00<21:48:34,  3.43it/s]
 28%|██▊       | 102284/371472 [8:08:01<21:33:39,  3.47it/s]
 28%|██▊       | 102285/371472 [8:08:01<20:45:32,  3.60it/s]
 28%|██▊       | 102286/371472 [8:08:01<21:08:00,  3.54it/s]
 28%|██▊       | 102287/371472 [8:08:01<20:53:03,  3.58it/s]
 28%|██▊       | 102288/371472 [8:08:02<20:49:41,  3.59it/s]
 28%|██▊       | 102289/371472 [8:08:02<19:52:28,  3.76it/s]
 28%|██▊       | 102290/371472 [8:08:02<20:57:12,  3.57it/s]
 28%|██▊       | 102291/371472 [8:08:02<21:27:56,  3.48it/s]
 28%|██▊       | 102292/371472 [8:08:03<23:39:51,  3.16it/s]
 28%|██▊       | 102293/371472 [8:08:03<22:14:31,  3.36it/s]
 28%|██▊       | 102294/371472 [8:08:03<21:48:49,  3.43it/s]
 28%|██▊       | 102295/371472 [8:08:04<21:21:35,  3.50it/s]
 28%|██▊       | 102296/371472 [8:08:04<21:27:32,  3.48it/s]
 28%|██▊       | 102297/371472 [8:08:04<20:39:26,  3.62it/s]
 28%|██▊       | 102298/371472 [8:08:04<20:10:31,  3.71it/s]
 28%|██▊       | 102299/371472 [8:08:05<20:49:27,  3.59it/s]
 28%|██▊       | 102300/371472 [8:08:05<21:08:42,  3.54it/s]
                                                            
{'loss': 3.4581, 'learning_rate': 7.524995151802452e-07, 'epoch': 4.41}

 28%|██▊       | 102300/371472 [8:08:05<21:08:42,  3.54it/s]
 28%|██▊       | 102301/371472 [8:08:05<23:00:07,  3.25it/s]
 28%|██▊       | 102302/371472 [8:08:06<21:59:13,  3.40it/s]
 28%|██▊       | 102303/371472 [8:08:06<20:46:10,  3.60it/s]
 28%|██▊       | 102304/371472 [8:08:06<21:35:18,  3.46it/s]
 28%|██▊       | 102305/371472 [8:08:07<21:16:15,  3.52it/s]
 28%|██▊       | 102306/371472 [8:08:07<20:28:29,  3.65it/s]
 28%|██▊       | 102307/371472 [8:08:07<22:23:52,  3.34it/s]
 28%|██▊       | 102308/371472 [8:08:07<23:09:44,  3.23it/s]
 28%|██▊       | 102309/371472 [8:08:08<22:25:16,  3.33it/s]
 28%|██▊       | 102310/371472 [8:08:08<21:55:15,  3.41it/s]
 28%|██▊       | 102311/371472 [8:08:08<22:04:05,  3.39it/s]
 28%|██▊       | 102312/371472 [8:08:09<21:38:40,  3.45it/s]
 28%|██▊       | 102313/371472 [8:08:09<21:02:20,  3.55it/s]
 28%|██▊       | 102314/371472 [8:08:09<20:28:23,  3.65it/s]
 28%|██▊       | 102315/371472 [8:08:09<20:20:05,  3.68it/s]
 28%|██▊       | 102316/371472 [8:08:10<20:17:49,  3.68it/s]
 28%|██▊       | 102317/371472 [8:08:10<20:09:55,  3.71it/s]
 28%|██▊       | 102318/371472 [8:08:10<19:40:40,  3.80it/s]
 28%|██▊       | 102319/371472 [8:08:10<19:30:00,  3.83it/s]
 28%|██▊       | 102320/371472 [8:08:11<19:06:52,  3.91it/s]
                                                            
{'loss': 3.4008, 'learning_rate': 7.524510332047662e-07, 'epoch': 4.41}

 28%|██▊       | 102320/371472 [8:08:11<19:06:52,  3.91it/s]
 28%|██▊       | 102321/371472 [8:08:11<19:43:01,  3.79it/s]
 28%|██▊       | 102322/371472 [8:08:11<20:47:18,  3.60it/s]
 28%|██▊       | 102323/371472 [8:08:12<21:31:28,  3.47it/s]
 28%|██▊       | 102324/371472 [8:08:12<21:59:19,  3.40it/s]
 28%|██▊       | 102325/371472 [8:08:12<21:37:48,  3.46it/s]
 28%|██▊       | 102326/371472 [8:08:12<21:24:10,  3.49it/s]
 28%|██▊       | 102327/371472 [8:08:13<22:25:55,  3.33it/s]
 28%|██▊       | 102328/371472 [8:08:13<21:37:32,  3.46it/s]
 28%|██▊       | 102329/371472 [8:08:13<21:19:04,  3.51it/s]
 28%|██▊       | 102330/371472 [8:08:14<22:01:04,  3.40it/s]
 28%|██▊       | 102331/371472 [8:08:14<21:03:22,  3.55it/s]
 28%|██▊       | 102332/371472 [8:08:14<20:19:21,  3.68it/s]
 28%|██▊       | 102333/371472 [8:08:14<19:33:02,  3.82it/s]
 28%|██▊       | 102334/371472 [8:08:15<21:07:55,  3.54it/s]
 28%|██▊       | 102335/371472 [8:08:15<21:05:08,  3.55it/s]
 28%|██▊       | 102336/371472 [8:08:15<21:07:26,  3.54it/s]
 28%|██▊       | 102337/371472 [8:08:16<20:42:29,  3.61it/s]
 28%|██▊       | 102338/371472 [8:08:16<21:30:00,  3.48it/s]
 28%|██▊       | 102339/371472 [8:08:16<22:46:04,  3.28it/s]
 28%|██▊       | 102340/371472 [8:08:16<21:46:38,  3.43it/s]
                                                            
{'loss': 3.4142, 'learning_rate': 7.524025512292874e-07, 'epoch': 4.41}

 28%|██▊       | 102340/371472 [8:08:16<21:46:38,  3.43it/s]
 28%|██▊       | 102341/371472 [8:08:17<21:41:27,  3.45it/s]
 28%|██▊       | 102342/371472 [8:08:17<20:52:44,  3.58it/s]
 28%|██▊       | 102343/371472 [8:08:17<21:57:48,  3.40it/s]
 28%|██▊       | 102344/371472 [8:08:18<21:26:15,  3.49it/s]
 28%|██▊       | 102345/371472 [8:08:18<21:54:18,  3.41it/s]
 28%|██▊       | 102346/371472 [8:08:18<22:19:48,  3.35it/s]
 28%|██▊       | 102347/371472 [8:08:18<21:36:12,  3.46it/s]
 28%|██▊       | 102348/371472 [8:08:19<21:14:30,  3.52it/s]
 28%|██▊       | 102349/371472 [8:08:19<21:14:17,  3.52it/s]
 28%|██▊       | 102350/371472 [8:08:19<21:16:49,  3.51it/s]
 28%|██▊       | 102351/371472 [8:08:20<21:37:24,  3.46it/s]
 28%|██▊       | 102352/371472 [8:08:20<20:46:38,  3.60it/s]
 28%|██▊       | 102353/371472 [8:08:20<20:33:48,  3.64it/s]
 28%|██▊       | 102354/371472 [8:08:20<20:17:46,  3.68it/s]
 28%|██▊       | 102355/371472 [8:08:21<19:58:37,  3.74it/s]
 28%|██▊       | 102356/371472 [8:08:21<20:32:45,  3.64it/s]
 28%|██▊       | 102357/371472 [8:08:21<20:11:10,  3.70it/s]
 28%|██▊       | 102358/371472 [8:08:21<19:57:11,  3.75it/s]
 28%|██▊       | 102359/371472 [8:08:22<20:42:02,  3.61it/s]
 28%|██▊       | 102360/371472 [8:08:22<20:49:04,  3.59it/s]
                                                            
{'loss': 3.3853, 'learning_rate': 7.523540692538085e-07, 'epoch': 4.41}

 28%|██▊       | 102360/371472 [8:08:22<20:49:04,  3.59it/s]
 28%|██▊       | 102361/371472 [8:08:22<20:52:09,  3.58it/s]
 28%|██▊       | 102362/371472 [8:08:23<20:44:21,  3.60it/s]
 28%|██▊       | 102363/371472 [8:08:23<20:46:45,  3.60it/s]
 28%|██▊       | 102364/371472 [8:08:23<21:15:02,  3.52it/s]
 28%|██▊       | 102365/371472 [8:08:23<22:04:04,  3.39it/s]
 28%|██▊       | 102366/371472 [8:08:24<22:26:51,  3.33it/s]
 28%|██▊       | 102367/371472 [8:08:24<21:46:14,  3.43it/s]
 28%|██▊       | 102368/371472 [8:08:24<21:44:14,  3.44it/s]
 28%|██▊       | 102369/371472 [8:08:25<21:56:34,  3.41it/s]
 28%|██▊       | 102370/371472 [8:08:25<21:34:30,  3.46it/s]
 28%|██▊       | 102371/371472 [8:08:25<23:39:21,  3.16it/s]
 28%|██▊       | 102372/371472 [8:08:26<23:09:38,  3.23it/s]
 28%|██▊       | 102373/371472 [8:08:26<22:31:32,  3.32it/s]
 28%|██▊       | 102374/371472 [8:08:26<24:38:31,  3.03it/s]
 28%|██▊       | 102375/371472 [8:08:27<24:26:05,  3.06it/s]
 28%|██▊       | 102376/371472 [8:08:27<24:39:16,  3.03it/s]
 28%|██▊       | 102377/371472 [8:08:27<24:00:33,  3.11it/s]
 28%|██▊       | 102378/371472 [8:08:28<22:20:35,  3.35it/s]
 28%|██▊       | 102379/371472 [8:08:28<21:29:31,  3.48it/s]
 28%|██▊       | 102380/371472 [8:08:28<21:23:52,  3.49it/s]
                                                            
{'loss': 3.4031, 'learning_rate': 7.523055872783294e-07, 'epoch': 4.41}

 28%|██▊       | 102380/371472 [8:08:28<21:23:52,  3.49it/s]
 28%|██▊       | 102381/371472 [8:08:28<22:49:06,  3.28it/s]
 28%|██▊       | 102382/371472 [8:08:29<21:33:49,  3.47it/s]
 28%|██▊       | 102383/371472 [8:08:29<20:56:53,  3.57it/s]
 28%|██▊       | 102384/371472 [8:08:29<20:50:48,  3.59it/s]
 28%|██▊       | 102385/371472 [8:08:29<20:48:14,  3.59it/s]
 28%|██▊       | 102386/371472 [8:08:30<22:33:55,  3.31it/s]
 28%|██▊       | 102387/371472 [8:08:30<22:02:32,  3.39it/s]
 28%|██▊       | 102388/371472 [8:08:30<21:36:15,  3.46it/s]
 28%|██▊       | 102389/371472 [8:08:31<22:52:42,  3.27it/s]
 28%|██▊       | 102390/371472 [8:08:31<22:07:19,  3.38it/s]
 28%|██▊       | 102391/371472 [8:08:31<21:48:00,  3.43it/s]
 28%|██▊       | 102392/371472 [8:08:32<24:19:56,  3.07it/s]
 28%|██▊       | 102393/371472 [8:08:32<23:03:28,  3.24it/s]
 28%|██▊       | 102394/371472 [8:08:32<22:58:58,  3.25it/s]
 28%|██▊       | 102395/371472 [8:08:33<22:27:54,  3.33it/s]
 28%|██▊       | 102396/371472 [8:08:33<22:13:33,  3.36it/s]
 28%|██▊       | 102397/371472 [8:08:33<21:06:22,  3.54it/s]
 28%|██▊       | 102398/371472 [8:08:33<22:32:23,  3.32it/s]
 28%|██▊       | 102399/371472 [8:08:34<21:20:47,  3.50it/s]
 28%|██▊       | 102400/371472 [8:08:34<21:08:40,  3.53it/s]
                                                            
{'loss': 3.4219, 'learning_rate': 7.522571053028507e-07, 'epoch': 4.41}

 28%|██▊       | 102400/371472 [8:08:34<21:08:40,  3.53it/s]
 28%|██▊       | 102401/371472 [8:08:34<22:15:45,  3.36it/s]
 28%|██▊       | 102402/371472 [8:08:35<22:18:56,  3.35it/s]
 28%|██▊       | 102403/371472 [8:08:35<21:39:54,  3.45it/s]
 28%|██▊       | 102404/371472 [8:08:35<21:13:12,  3.52it/s]
 28%|██▊       | 102405/371472 [8:08:35<21:05:46,  3.54it/s]
 28%|██▊       | 102406/371472 [8:08:36<20:36:10,  3.63it/s]
 28%|██▊       | 102407/371472 [8:08:36<20:57:38,  3.57it/s]
 28%|██▊       | 102408/371472 [8:08:36<20:39:00,  3.62it/s]
 28%|██▊       | 102409/371472 [8:08:37<21:27:51,  3.48it/s]
 28%|██▊       | 102410/371472 [8:08:37<21:31:42,  3.47it/s]
 28%|██▊       | 102411/371472 [8:08:37<21:33:46,  3.47it/s]
 28%|██▊       | 102412/371472 [8:08:37<21:16:05,  3.51it/s]
 28%|██▊       | 102413/371472 [8:08:38<20:58:29,  3.56it/s]
 28%|██▊       | 102414/371472 [8:08:38<20:46:23,  3.60it/s]
 28%|██▊       | 102415/371472 [8:08:38<20:46:30,  3.60it/s]
 28%|██▊       | 102416/371472 [8:08:38<20:43:57,  3.60it/s]
 28%|██▊       | 102417/371472 [8:08:39<20:10:35,  3.70it/s]
 28%|██▊       | 102418/371472 [8:08:39<22:57:04,  3.26it/s]
 28%|██▊       | 102419/371472 [8:08:39<22:12:30,  3.37it/s]
 28%|██▊       | 102420/371472 [8:08:40<21:14:19,  3.52it/s]
                                                            
{'loss': 3.6066, 'learning_rate': 7.522086233273719e-07, 'epoch': 4.41}

 28%|██▊       | 102420/371472 [8:08:40<21:14:19,  3.52it/s]
 28%|██▊       | 102421/371472 [8:08:40<21:28:02,  3.48it/s]
 28%|██▊       | 102422/371472 [8:08:40<21:11:30,  3.53it/s]
 28%|██▊       | 102423/371472 [8:08:41<21:46:28,  3.43it/s]
 28%|██▊       | 102424/371472 [8:08:41<21:16:47,  3.51it/s]
 28%|██▊       | 102425/371472 [8:08:41<20:50:43,  3.59it/s]
 28%|██▊       | 102426/371472 [8:08:41<20:31:59,  3.64it/s]
 28%|██▊       | 102427/371472 [8:08:42<21:34:18,  3.46it/s]
 28%|██▊       | 102428/371472 [8:08:42<21:01:10,  3.56it/s]
 28%|██▊       | 102429/371472 [8:08:42<21:03:20,  3.55it/s]
 28%|██▊       | 102430/371472 [8:08:43<22:18:59,  3.35it/s]
 28%|██▊       | 102431/371472 [8:08:43<21:17:04,  3.51it/s]
 28%|██▊       | 102432/371472 [8:08:43<20:30:36,  3.64it/s]
 28%|██▊       | 102433/371472 [8:08:43<20:25:59,  3.66it/s]
 28%|██▊       | 102434/371472 [8:08:44<20:47:34,  3.59it/s]
 28%|██▊       | 102435/371472 [8:08:44<21:13:17,  3.52it/s]
 28%|██▊       | 102436/371472 [8:08:44<21:08:22,  3.54it/s]
 28%|██▊       | 102437/371472 [8:08:44<21:18:11,  3.51it/s]
 28%|██▊       | 102438/371472 [8:08:45<22:29:32,  3.32it/s]
 28%|██▊       | 102439/371472 [8:08:45<22:18:49,  3.35it/s]
 28%|██▊       | 102440/371472 [8:08:45<21:45:03,  3.44it/s]
                                                            
{'loss': 3.4492, 'learning_rate': 7.521601413518929e-07, 'epoch': 4.41}

 28%|██▊       | 102440/371472 [8:08:45<21:45:03,  3.44it/s]
 28%|██▊       | 102441/371472 [8:08:46<22:40:08,  3.30it/s]
 28%|██▊       | 102442/371472 [8:08:46<22:24:21,  3.34it/s]
 28%|██▊       | 102443/371472 [8:08:46<21:10:39,  3.53it/s]
 28%|██▊       | 102444/371472 [8:08:46<20:22:56,  3.67it/s]
 28%|██▊       | 102445/371472 [8:08:47<21:17:56,  3.51it/s]
 28%|██▊       | 102446/371472 [8:08:47<20:49:23,  3.59it/s]
 28%|██▊       | 102447/371472 [8:08:47<21:20:27,  3.50it/s]
 28%|██▊       | 102448/371472 [8:08:48<21:36:02,  3.46it/s]
 28%|██▊       | 102449/371472 [8:08:48<22:22:39,  3.34it/s]
 28%|██▊       | 102450/371472 [8:08:48<24:10:09,  3.09it/s]
 28%|██▊       | 102451/371472 [8:08:49<23:38:27,  3.16it/s]
 28%|██▊       | 102452/371472 [8:08:49<22:25:33,  3.33it/s]
 28%|██▊       | 102453/371472 [8:08:49<21:14:13,  3.52it/s]
 28%|██▊       | 102454/371472 [8:08:49<20:50:52,  3.58it/s]
 28%|██▊       | 102455/371472 [8:08:50<21:27:23,  3.48it/s]
 28%|██▊       | 102456/371472 [8:08:50<21:02:22,  3.55it/s]
 28%|██▊       | 102457/371472 [8:08:50<22:00:23,  3.40it/s]
 28%|██▊       | 102458/371472 [8:08:51<21:14:29,  3.52it/s]
 28%|██▊       | 102459/371472 [8:08:51<23:05:54,  3.24it/s]
 28%|██▊       | 102460/371472 [8:08:51<22:56:21,  3.26it/s]
                                                            
{'loss': 3.4515, 'learning_rate': 7.521116593764139e-07, 'epoch': 4.41}

 28%|██▊       | 102460/371472 [8:08:51<22:56:21,  3.26it/s]
 28%|██▊       | 102461/371472 [8:08:52<22:07:01,  3.38it/s]
 28%|██▊       | 102462/371472 [8:08:52<21:17:53,  3.51it/s]
 28%|██▊       | 102463/371472 [8:08:52<21:56:39,  3.41it/s]
 28%|██▊       | 102464/371472 [8:08:52<21:12:57,  3.52it/s]
 28%|██▊       | 102465/371472 [8:08:53<20:53:39,  3.58it/s]
 28%|██▊       | 102466/371472 [8:08:53<21:51:50,  3.42it/s]
 28%|██▊       | 102467/371472 [8:08:53<21:59:02,  3.40it/s]
 28%|██▊       | 102468/371472 [8:08:54<21:46:42,  3.43it/s]
 28%|██▊       | 102469/371472 [8:08:54<21:07:27,  3.54it/s]
 28%|██▊       | 102470/371472 [8:08:54<21:55:11,  3.41it/s]
 28%|██▊       | 102471/371472 [8:08:54<21:48:26,  3.43it/s]
 28%|██▊       | 102472/371472 [8:08:55<21:11:29,  3.53it/s]
 28%|██▊       | 102473/371472 [8:08:55<20:11:35,  3.70it/s]
 28%|██▊       | 102474/371472 [8:08:55<20:18:42,  3.68it/s]
 28%|██▊       | 102475/371472 [8:08:55<20:05:34,  3.72it/s]
 28%|██▊       | 102476/371472 [8:08:56<19:52:01,  3.76it/s]
 28%|██▊       | 102477/371472 [8:08:56<19:36:24,  3.81it/s]
 28%|██▊       | 102478/371472 [8:08:56<19:45:27,  3.78it/s]
 28%|██▊       | 102479/371472 [8:08:57<21:04:54,  3.54it/s]
 28%|██▊       | 102480/371472 [8:08:57<23:53:40,  3.13it/s]
                                                            
{'loss': 3.7738, 'learning_rate': 7.520631774009352e-07, 'epoch': 4.41}

 28%|██▊       | 102480/371472 [8:08:57<23:53:40,  3.13it/s]
 28%|██▊       | 102481/371472 [8:08:57<22:56:19,  3.26it/s]
 28%|██▊       | 102482/371472 [8:08:58<24:14:55,  3.08it/s]
 28%|██▊       | 102483/371472 [8:08:58<22:47:29,  3.28it/s]
 28%|██▊       | 102484/371472 [8:08:58<21:46:40,  3.43it/s]
 28%|██▊       | 102485/371472 [8:08:58<21:45:26,  3.43it/s]
 28%|██▊       | 102486/371472 [8:08:59<22:06:40,  3.38it/s]
 28%|██▊       | 102487/371472 [8:08:59<22:21:31,  3.34it/s]
 28%|██▊       | 102488/371472 [8:08:59<22:46:53,  3.28it/s]
 28%|██▊       | 102489/371472 [8:09:00<23:58:05,  3.12it/s]
 28%|██▊       | 102490/371472 [8:09:00<22:39:47,  3.30it/s]
 28%|██▊       | 102491/371472 [8:09:00<21:18:59,  3.51it/s]
 28%|██▊       | 102492/371472 [8:09:01<21:31:13,  3.47it/s]
 28%|██▊       | 102493/371472 [8:09:01<20:21:04,  3.67it/s]
 28%|██▊       | 102494/371472 [8:09:01<21:48:45,  3.43it/s]
 28%|██▊       | 102495/371472 [8:09:01<21:08:34,  3.53it/s]
 28%|██▊       | 102496/371472 [8:09:02<20:53:47,  3.58it/s]
 28%|██▊       | 102497/371472 [8:09:02<20:38:43,  3.62it/s]
 28%|██▊       | 102498/371472 [8:09:02<20:55:12,  3.57it/s]
 28%|██▊       | 102499/371472 [8:09:02<21:45:37,  3.43it/s]
 28%|██▊       | 102500/371472 [8:09:03<21:19:11,  3.50it/s]
                                                            
{'loss': 3.4874, 'learning_rate': 7.520146954254563e-07, 'epoch': 4.41}

 28%|██▊       | 102500/371472 [8:09:03<21:19:11,  3.50it/s]
 28%|██▊       | 102501/371472 [8:09:03<23:23:17,  3.19it/s]
 28%|██▊       | 102502/371472 [8:09:03<22:15:30,  3.36it/s]
 28%|██▊       | 102503/371472 [8:09:04<22:02:21,  3.39it/s]
 28%|██▊       | 102504/371472 [8:09:04<22:20:44,  3.34it/s]
 28%|██▊       | 102505/371472 [8:09:04<24:02:45,  3.11it/s]
 28%|██▊       | 102506/371472 [8:09:05<24:02:32,  3.11it/s]
 28%|██▊       | 102507/371472 [8:09:05<24:24:32,  3.06it/s]
 28%|██▊       | 102508/371472 [8:09:05<23:13:27,  3.22it/s]
 28%|██▊       | 102509/371472 [8:09:06<22:03:54,  3.39it/s]
 28%|██▊       | 102510/371472 [8:09:06<23:46:08,  3.14it/s]
 28%|██▊       | 102511/371472 [8:09:06<22:46:05,  3.28it/s]
 28%|██▊       | 102512/371472 [8:09:06<21:37:42,  3.45it/s]
 28%|██▊       | 102513/371472 [8:09:07<22:08:45,  3.37it/s]
 28%|██▊       | 102514/371472 [8:09:07<21:20:43,  3.50it/s]
 28%|██▊       | 102515/371472 [8:09:07<22:37:49,  3.30it/s]
 28%|██▊       | 102516/371472 [8:09:08<22:27:15,  3.33it/s]
 28%|██▊       | 102517/371472 [8:09:08<22:07:09,  3.38it/s]
 28%|██▊       | 102518/371472 [8:09:08<22:06:27,  3.38it/s]
 28%|██▊       | 102519/371472 [8:09:09<20:58:38,  3.56it/s]
 28%|██▊       | 102520/371472 [8:09:09<20:42:38,  3.61it/s]
                                                            
{'loss': 3.3105, 'learning_rate': 7.519662134499774e-07, 'epoch': 4.42}

 28%|██▊       | 102520/371472 [8:09:09<20:42:38,  3.61it/s]
 28%|██▊       | 102521/371472 [8:09:09<20:58:53,  3.56it/s]
 28%|██▊       | 102522/371472 [8:09:09<21:12:56,  3.52it/s]
 28%|██▊       | 102523/371472 [8:09:10<20:22:08,  3.67it/s]
 28%|██▊       | 102524/371472 [8:09:10<20:32:44,  3.64it/s]
 28%|██▊       | 102525/371472 [8:09:10<20:33:24,  3.63it/s]
 28%|██▊       | 102526/371472 [8:09:11<22:32:02,  3.32it/s]
 28%|██▊       | 102527/371472 [8:09:11<23:23:39,  3.19it/s]
 28%|██▊       | 102528/371472 [8:09:11<22:58:15,  3.25it/s]
 28%|██▊       | 102529/371472 [8:09:11<23:10:08,  3.22it/s]
 28%|██▊       | 102530/371472 [8:09:12<21:59:47,  3.40it/s]
 28%|██▊       | 102531/371472 [8:09:12<21:50:31,  3.42it/s]
 28%|██▊       | 102532/371472 [8:09:12<20:58:40,  3.56it/s]
 28%|██▊       | 102533/371472 [8:09:13<21:24:41,  3.49it/s]
 28%|██▊       | 102534/371472 [8:09:13<22:30:07,  3.32it/s]
 28%|██▊       | 102535/371472 [8:09:13<22:39:27,  3.30it/s]
 28%|██▊       | 102536/371472 [8:09:13<22:04:25,  3.38it/s]
 28%|██▊       | 102537/371472 [8:09:14<22:10:06,  3.37it/s]
 28%|██▊       | 102538/371472 [8:09:14<21:40:56,  3.45it/s]
 28%|██▊       | 102539/371472 [8:09:14<21:22:40,  3.49it/s]
 28%|██▊       | 102540/371472 [8:09:15<21:18:22,  3.51it/s]
                                                            
{'loss': 3.6158, 'learning_rate': 7.519177314744984e-07, 'epoch': 4.42}

 28%|██▊       | 102540/371472 [8:09:15<21:18:22,  3.51it/s]
 28%|██▊       | 102541/371472 [8:09:15<23:15:17,  3.21it/s]
 28%|██▊       | 102542/371472 [8:09:15<22:22:40,  3.34it/s]
 28%|██▊       | 102543/371472 [8:09:16<21:32:28,  3.47it/s]
 28%|██▊       | 102544/371472 [8:09:16<21:36:13,  3.46it/s]
 28%|██▊       | 102545/371472 [8:09:16<23:07:21,  3.23it/s]
 28%|██▊       | 102546/371472 [8:09:16<21:46:25,  3.43it/s]
 28%|██▊       | 102547/371472 [8:09:17<21:31:08,  3.47it/s]
 28%|██▊       | 102548/371472 [8:09:17<21:06:05,  3.54it/s]
 28%|██▊       | 102549/371472 [8:09:17<22:13:33,  3.36it/s]
 28%|██▊       | 102550/371472 [8:09:18<21:56:24,  3.40it/s]
 28%|██▊       | 102551/371472 [8:09:18<21:29:00,  3.48it/s]
 28%|██▊       | 102552/371472 [8:09:18<21:22:16,  3.50it/s]
 28%|██▊       | 102553/371472 [8:09:19<23:05:16,  3.24it/s]
 28%|██▊       | 102554/371472 [8:09:19<21:46:10,  3.43it/s]
 28%|██▊       | 102555/371472 [8:09:19<22:19:06,  3.35it/s]
 28%|██▊       | 102556/371472 [8:09:19<21:55:57,  3.41it/s]
 28%|██▊       | 102557/371472 [8:09:20<21:52:47,  3.41it/s]
 28%|██▊       | 102558/371472 [8:09:20<21:20:10,  3.50it/s]
 28%|██▊       | 102559/371472 [8:09:20<20:44:23,  3.60it/s]
 28%|██▊       | 102560/371472 [8:09:21<22:31:15,  3.32it/s]
                                                            
{'loss': 3.5226, 'learning_rate': 7.518692494990195e-07, 'epoch': 4.42}

 28%|██▊       | 102560/371472 [8:09:21<22:31:15,  3.32it/s]
 28%|██▊       | 102561/371472 [8:09:21<22:18:19,  3.35it/s]
 28%|██▊       | 102562/371472 [8:09:21<23:32:07,  3.17it/s]
 28%|██▊       | 102563/371472 [8:09:21<23:07:16,  3.23it/s]
 28%|██▊       | 102564/371472 [8:09:22<22:02:25,  3.39it/s]
 28%|██▊       | 102565/371472 [8:09:22<21:14:58,  3.52it/s]
 28%|██▊       | 102566/371472 [8:09:22<21:54:47,  3.41it/s]
 28%|██▊       | 102567/371472 [8:09:23<23:36:29,  3.16it/s]
 28%|██▊       | 102568/371472 [8:09:23<22:45:55,  3.28it/s]
 28%|██▊       | 102569/371472 [8:09:23<23:00:45,  3.25it/s]
 28%|██▊       | 102570/371472 [8:09:24<22:50:02,  3.27it/s]
 28%|██▊       | 102571/371472 [8:09:24<22:33:17,  3.31it/s]
 28%|██▊       | 102572/371472 [8:09:24<23:19:11,  3.20it/s]
 28%|██▊       | 102573/371472 [8:09:25<23:23:57,  3.19it/s]
 28%|██▊       | 102574/371472 [8:09:25<23:04:49,  3.24it/s]
 28%|██▊       | 102575/371472 [8:09:25<23:04:26,  3.24it/s]
 28%|██▊       | 102576/371472 [8:09:25<23:28:16,  3.18it/s]
 28%|██▊       | 102577/371472 [8:09:26<22:34:05,  3.31it/s]
 28%|██▊       | 102578/371472 [8:09:26<22:31:39,  3.32it/s]
 28%|██▊       | 102579/371472 [8:09:26<23:03:01,  3.24it/s]
 28%|██▊       | 102580/371472 [8:09:27<22:02:30,  3.39it/s]
                                                            
{'loss': 3.4994, 'learning_rate': 7.518207675235407e-07, 'epoch': 4.42}

 28%|██▊       | 102580/371472 [8:09:27<22:02:30,  3.39it/s]
 28%|██▊       | 102581/371472 [8:09:27<21:30:20,  3.47it/s]
 28%|██▊       | 102582/371472 [8:09:27<21:37:58,  3.45it/s]
 28%|██▊       | 102583/371472 [8:09:27<21:16:24,  3.51it/s]
 28%|██▊       | 102584/371472 [8:09:28<20:34:48,  3.63it/s]
 28%|██▊       | 102585/371472 [8:09:28<21:40:32,  3.45it/s]
 28%|██▊       | 102586/371472 [8:09:28<23:13:01,  3.22it/s]
 28%|██▊       | 102587/371472 [8:09:29<23:45:39,  3.14it/s]
 28%|██▊       | 102588/371472 [8:09:29<22:49:12,  3.27it/s]
 28%|██▊       | 102589/371472 [8:09:29<22:06:49,  3.38it/s]
 28%|██▊       | 102590/371472 [8:09:30<21:22:14,  3.49it/s]
 28%|██▊       | 102591/371472 [8:09:30<21:28:44,  3.48it/s]
 28%|██▊       | 102592/371472 [8:09:30<20:52:24,  3.58it/s]
 28%|██▊       | 102593/371472 [8:09:30<20:44:19,  3.60it/s]
 28%|██▊       | 102594/371472 [8:09:31<21:20:52,  3.50it/s]
 28%|██▊       | 102595/371472 [8:09:31<20:32:56,  3.63it/s]
 28%|██▊       | 102596/371472 [8:09:31<20:06:05,  3.72it/s]
 28%|██▊       | 102597/371472 [8:09:32<26:02:06,  2.87it/s]
 28%|██▊       | 102598/371472 [8:09:32<23:48:40,  3.14it/s]
 28%|██▊       | 102599/371472 [8:09:32<22:57:59,  3.25it/s]
 28%|██▊       | 102600/371472 [8:09:33<23:49:36,  3.13it/s]
                                                            
{'loss': 3.4928, 'learning_rate': 7.517722855480618e-07, 'epoch': 4.42}

 28%|██▊       | 102600/371472 [8:09:33<23:49:36,  3.13it/s]
 28%|██▊       | 102601/371472 [8:09:33<23:58:54,  3.11it/s]
 28%|██▊       | 102602/371472 [8:09:33<23:52:37,  3.13it/s]
 28%|██▊       | 102603/371472 [8:09:34<22:37:58,  3.30it/s]
 28%|██▊       | 102604/371472 [8:09:34<21:52:58,  3.41it/s]
 28%|██▊       | 102605/371472 [8:09:34<20:39:09,  3.62it/s]
 28%|██▊       | 102606/371472 [8:09:34<20:04:23,  3.72it/s]
 28%|██▊       | 102607/371472 [8:09:35<19:53:34,  3.75it/s]
 28%|██▊       | 102608/371472 [8:09:35<20:50:00,  3.58it/s]
 28%|██▊       | 102609/371472 [8:09:35<22:11:21,  3.37it/s]
 28%|██▊       | 102610/371472 [8:09:35<22:01:23,  3.39it/s]
 28%|██▊       | 102611/371472 [8:09:36<22:33:52,  3.31it/s]
 28%|██▊       | 102612/371472 [8:09:36<21:53:26,  3.41it/s]
 28%|██▊       | 102613/371472 [8:09:36<21:48:40,  3.42it/s]
 28%|██▊       | 102614/371472 [8:09:37<20:33:38,  3.63it/s]
 28%|██▊       | 102615/371472 [8:09:37<20:35:15,  3.63it/s]
 28%|██▊       | 102616/371472 [8:09:37<25:49:54,  2.89it/s]
 28%|██▊       | 102617/371472 [8:09:38<24:56:50,  2.99it/s]
 28%|██▊       | 102618/371472 [8:09:38<22:50:51,  3.27it/s]
 28%|██▊       | 102619/371472 [8:09:38<22:28:13,  3.32it/s]
 28%|██▊       | 102620/371472 [8:09:38<21:28:14,  3.48it/s]
                                                            
{'loss': 3.6281, 'learning_rate': 7.517238035725828e-07, 'epoch': 4.42}

 28%|██▊       | 102620/371472 [8:09:38<21:28:14,  3.48it/s]
 28%|██▊       | 102621/371472 [8:09:39<22:52:07,  3.27it/s]
 28%|██▊       | 102622/371472 [8:09:39<22:42:16,  3.29it/s]
 28%|██▊       | 102623/371472 [8:09:39<22:14:23,  3.36it/s]
 28%|██▊       | 102624/371472 [8:09:40<22:21:04,  3.34it/s]
 28%|██▊       | 102625/371472 [8:09:40<22:55:59,  3.26it/s]
 28%|██▊       | 102626/371472 [8:09:40<22:18:24,  3.35it/s]
 28%|██▊       | 102627/371472 [8:09:41<21:14:24,  3.52it/s]
 28%|██▊       | 102628/371472 [8:09:41<21:38:06,  3.45it/s]
 28%|██▊       | 102629/371472 [8:09:41<21:40:38,  3.45it/s]
 28%|██▊       | 102630/371472 [8:09:41<21:03:08,  3.55it/s]
 28%|██▊       | 102631/371472 [8:09:42<20:40:44,  3.61it/s]
 28%|██▊       | 102632/371472 [8:09:42<20:30:13,  3.64it/s]
 28%|██▊       | 102633/371472 [8:09:42<19:40:26,  3.80it/s]
 28%|██▊       | 102634/371472 [8:09:42<20:04:20,  3.72it/s]
 28%|██▊       | 102635/371472 [8:09:43<20:21:21,  3.67it/s]
 28%|██▊       | 102636/371472 [8:09:43<20:12:32,  3.70it/s]
 28%|██▊       | 102637/371472 [8:09:43<19:59:53,  3.73it/s]
 28%|██▊       | 102638/371472 [8:09:44<21:04:07,  3.54it/s]
 28%|██▊       | 102639/371472 [8:09:44<20:32:05,  3.64it/s]
 28%|██▊       | 102640/371472 [8:09:44<21:09:40,  3.53it/s]
                                                            
{'loss': 3.4549, 'learning_rate': 7.51675321597104e-07, 'epoch': 4.42}

 28%|██▊       | 102640/371472 [8:09:44<21:09:40,  3.53it/s]
 28%|██▊       | 102641/371472 [8:09:44<22:07:26,  3.38it/s]
 28%|██▊       | 102642/371472 [8:09:45<21:47:23,  3.43it/s]
 28%|██▊       | 102643/371472 [8:09:45<21:48:36,  3.42it/s]
 28%|██▊       | 102644/371472 [8:09:45<21:04:42,  3.54it/s]
 28%|██▊       | 102645/371472 [8:09:46<20:20:37,  3.67it/s]
 28%|██▊       | 102646/371472 [8:09:46<19:59:28,  3.74it/s]
 28%|██▊       | 102647/371472 [8:09:46<20:13:20,  3.69it/s]
 28%|██▊       | 102648/371472 [8:09:46<20:43:47,  3.60it/s]
 28%|██▊       | 102649/371472 [8:09:47<20:14:12,  3.69it/s]
 28%|██▊       | 102650/371472 [8:09:47<20:25:07,  3.66it/s]
 28%|██▊       | 102651/371472 [8:09:47<20:30:58,  3.64it/s]
 28%|██▊       | 102652/371472 [8:09:47<20:17:23,  3.68it/s]
 28%|██▊       | 102653/371472 [8:09:48<20:56:41,  3.57it/s]
 28%|██▊       | 102654/371472 [8:09:48<20:29:33,  3.64it/s]
 28%|██▊       | 102655/371472 [8:09:48<21:17:48,  3.51it/s]
 28%|██▊       | 102656/371472 [8:09:49<21:15:02,  3.51it/s]
 28%|██▊       | 102657/371472 [8:09:49<21:52:00,  3.41it/s]
 28%|██▊       | 102658/371472 [8:09:49<21:41:22,  3.44it/s]
 28%|██▊       | 102659/371472 [8:09:49<21:29:42,  3.47it/s]
 28%|██▊       | 102660/371472 [8:09:50<21:55:35,  3.41it/s]
                                                            
{'loss': 3.5594, 'learning_rate': 7.516268396216252e-07, 'epoch': 4.42}

 28%|██▊       | 102660/371472 [8:09:50<21:55:35,  3.41it/s]
 28%|██▊       | 102661/371472 [8:09:50<25:21:37,  2.94it/s]
 28%|██▊       | 102662/371472 [8:09:51<24:40:44,  3.03it/s]
 28%|██▊       | 102663/371472 [8:09:51<23:16:35,  3.21it/s]
 28%|██▊       | 102664/371472 [8:09:51<22:06:14,  3.38it/s]
 28%|██▊       | 102665/371472 [8:09:51<21:51:43,  3.42it/s]
 28%|██▊       | 102666/371472 [8:09:52<21:32:34,  3.47it/s]
 28%|██▊       | 102667/371472 [8:09:52<21:38:40,  3.45it/s]
 28%|██▊       | 102668/371472 [8:09:52<22:03:45,  3.38it/s]
 28%|██▊       | 102669/371472 [8:09:53<21:47:19,  3.43it/s]
 28%|██▊       | 102670/371472 [8:09:53<21:27:04,  3.48it/s]
 28%|██▊       | 102671/371472 [8:09:53<21:31:47,  3.47it/s]
 28%|██▊       | 102672/371472 [8:09:53<21:26:49,  3.48it/s]
 28%|██▊       | 102673/371472 [8:09:54<21:35:10,  3.46it/s]
 28%|██▊       | 102674/371472 [8:09:54<23:12:32,  3.22it/s]
 28%|██▊       | 102675/371472 [8:09:54<23:23:10,  3.19it/s]
 28%|██▊       | 102676/371472 [8:09:55<25:32:32,  2.92it/s]
 28%|██▊       | 102677/371472 [8:09:55<24:05:19,  3.10it/s]
 28%|██▊       | 102678/371472 [8:09:55<23:25:22,  3.19it/s]
 28%|██▊       | 102679/371472 [8:09:56<22:34:12,  3.31it/s]
 28%|██▊       | 102680/371472 [8:09:56<22:04:09,  3.38it/s]
                                                            
{'loss': 3.4348, 'learning_rate': 7.515783576461461e-07, 'epoch': 4.42}

 28%|██▊       | 102680/371472 [8:09:56<22:04:09,  3.38it/s]
 28%|██▊       | 102681/371472 [8:09:56<22:17:40,  3.35it/s]
 28%|██▊       | 102682/371472 [8:09:57<22:47:30,  3.28it/s]
 28%|██▊       | 102683/371472 [8:09:57<23:41:36,  3.15it/s]
 28%|██▊       | 102684/371472 [8:09:57<23:07:27,  3.23it/s]
 28%|██▊       | 102685/371472 [8:09:57<22:31:27,  3.31it/s]
 28%|██▊       | 102686/371472 [8:09:58<22:27:48,  3.32it/s]
 28%|██▊       | 102687/371472 [8:09:58<22:24:06,  3.33it/s]
 28%|██▊       | 102688/371472 [8:09:58<22:50:20,  3.27it/s]
 28%|██▊       | 102689/371472 [8:09:59<22:06:09,  3.38it/s]
 28%|██▊       | 102690/371472 [8:09:59<21:59:52,  3.39it/s]
 28%|██▊       | 102691/371472 [8:09:59<21:48:04,  3.42it/s]
 28%|██▊       | 102692/371472 [8:09:59<21:27:22,  3.48it/s]
 28%|██▊       | 102693/371472 [8:10:00<24:41:28,  3.02it/s]
 28%|██▊       | 102694/371472 [8:10:00<23:16:22,  3.21it/s]
 28%|██▊       | 102695/371472 [8:10:00<22:32:38,  3.31it/s]
 28%|██▊       | 102696/371472 [8:10:01<21:22:28,  3.49it/s]
 28%|██▊       | 102697/371472 [8:10:01<20:53:08,  3.57it/s]
 28%|██▊       | 102698/371472 [8:10:01<23:08:21,  3.23it/s]
 28%|██▊       | 102699/371472 [8:10:02<21:59:38,  3.39it/s]
 28%|██▊       | 102700/371472 [8:10:02<21:55:04,  3.41it/s]
                                                            
{'loss': 3.4455, 'learning_rate': 7.515298756706672e-07, 'epoch': 4.42}

 28%|██▊       | 102700/371472 [8:10:02<21:55:04,  3.41it/s]
 28%|██▊       | 102701/371472 [8:10:02<21:31:45,  3.47it/s]
 28%|██▊       | 102702/371472 [8:10:02<21:01:58,  3.55it/s]
 28%|██▊       | 102703/371472 [8:10:03<20:54:13,  3.57it/s]
 28%|██▊       | 102704/371472 [8:10:03<20:29:54,  3.64it/s]
 28%|██▊       | 102705/371472 [8:10:03<24:33:39,  3.04it/s]
 28%|██▊       | 102706/371472 [8:10:04<23:06:23,  3.23it/s]
 28%|██▊       | 102707/371472 [8:10:04<23:52:32,  3.13it/s]
 28%|██▊       | 102708/371472 [8:10:04<22:35:21,  3.30it/s]
 28%|██▊       | 102709/371472 [8:10:05<21:32:13,  3.47it/s]
 28%|██▊       | 102710/371472 [8:10:05<21:11:40,  3.52it/s]
 28%|██▊       | 102711/371472 [8:10:05<20:57:31,  3.56it/s]
 28%|██▊       | 102712/371472 [8:10:05<20:43:56,  3.60it/s]
 28%|██▊       | 102713/371472 [8:10:06<21:30:46,  3.47it/s]
 28%|██▊       | 102714/371472 [8:10:06<20:48:46,  3.59it/s]
 28%|██▊       | 102715/371472 [8:10:06<20:26:19,  3.65it/s]
 28%|██▊       | 102716/371472 [8:10:07<21:22:30,  3.49it/s]
 28%|██▊       | 102717/371472 [8:10:07<20:41:39,  3.61it/s]
 28%|██▊       | 102718/371472 [8:10:07<20:42:46,  3.60it/s]
 28%|██▊       | 102719/371472 [8:10:07<21:30:52,  3.47it/s]
 28%|██▊       | 102720/371472 [8:10:08<21:13:33,  3.52it/s]
                                                            
{'loss': 3.5326, 'learning_rate': 7.514813936951884e-07, 'epoch': 4.42}

 28%|██▊       | 102720/371472 [8:10:08<21:13:33,  3.52it/s]
 28%|██▊       | 102721/371472 [8:10:08<22:08:01,  3.37it/s]
 28%|██▊       | 102722/371472 [8:10:08<21:54:20,  3.41it/s]
 28%|██▊       | 102723/371472 [8:10:09<22:01:53,  3.39it/s]
 28%|██▊       | 102724/371472 [8:10:09<21:52:16,  3.41it/s]
 28%|██▊       | 102725/371472 [8:10:09<22:49:11,  3.27it/s]
 28%|██▊       | 102726/371472 [8:10:09<22:13:11,  3.36it/s]
 28%|██▊       | 102727/371472 [8:10:10<21:16:21,  3.51it/s]
 28%|██▊       | 102728/371472 [8:10:10<21:17:06,  3.51it/s]
 28%|██▊       | 102729/371472 [8:10:10<20:33:27,  3.63it/s]
 28%|██▊       | 102730/371472 [8:10:11<21:02:09,  3.55it/s]
 28%|██▊       | 102731/371472 [8:10:11<21:25:57,  3.48it/s]
 28%|██▊       | 102732/371472 [8:10:11<21:50:07,  3.42it/s]
 28%|██▊       | 102733/371472 [8:10:11<20:48:51,  3.59it/s]
 28%|██▊       | 102734/371472 [8:10:12<21:38:21,  3.45it/s]
 28%|██▊       | 102735/371472 [8:10:12<21:50:45,  3.42it/s]
 28%|██▊       | 102736/371472 [8:10:12<21:02:47,  3.55it/s]
 28%|██▊       | 102737/371472 [8:10:13<21:12:35,  3.52it/s]
 28%|██▊       | 102738/371472 [8:10:13<20:34:15,  3.63it/s]
 28%|██▊       | 102739/371472 [8:10:13<20:46:19,  3.59it/s]
 28%|██▊       | 102740/371472 [8:10:13<20:31:36,  3.64it/s]
                                                            
{'loss': 3.8389, 'learning_rate': 7.514329117197096e-07, 'epoch': 4.43}

 28%|██▊       | 102740/371472 [8:10:13<20:31:36,  3.64it/s]
 28%|██▊       | 102741/371472 [8:10:14<20:23:16,  3.66it/s]
 28%|██▊       | 102742/371472 [8:10:14<20:20:39,  3.67it/s]
 28%|██▊       | 102743/371472 [8:10:14<19:37:14,  3.80it/s]
 28%|██▊       | 102744/371472 [8:10:15<21:44:40,  3.43it/s]
 28%|██▊       | 102745/371472 [8:10:15<22:09:37,  3.37it/s]
 28%|██▊       | 102746/371472 [8:10:15<21:23:04,  3.49it/s]
 28%|██▊       | 102747/371472 [8:10:15<21:08:14,  3.53it/s]
 28%|██▊       | 102748/371472 [8:10:16<20:45:46,  3.60it/s]
 28%|██▊       | 102749/371472 [8:10:16<20:27:30,  3.65it/s]
 28%|██▊       | 102750/371472 [8:10:16<20:45:18,  3.60it/s]
 28%|██▊       | 102751/371472 [8:10:16<20:37:46,  3.62it/s]
 28%|██▊       | 102752/371472 [8:10:17<19:52:34,  3.76it/s]
 28%|██▊       | 102753/371472 [8:10:17<19:43:15,  3.79it/s]
 28%|██▊       | 102754/371472 [8:10:17<19:43:36,  3.78it/s]
 28%|██▊       | 102755/371472 [8:10:17<19:57:26,  3.74it/s]
 28%|██▊       | 102756/371472 [8:10:18<20:01:02,  3.73it/s]
 28%|██▊       | 102757/371472 [8:10:18<20:31:18,  3.64it/s]
 28%|██▊       | 102758/371472 [8:10:18<20:57:29,  3.56it/s]
 28%|██▊       | 102759/371472 [8:10:19<20:37:23,  3.62it/s]
 28%|██▊       | 102760/371472 [8:10:19<20:01:49,  3.73it/s]
                                                            
{'loss': 3.6775, 'learning_rate': 7.513844297442306e-07, 'epoch': 4.43}

 28%|██▊       | 102760/371472 [8:10:19<20:01:49,  3.73it/s]
 28%|██▊       | 102761/371472 [8:10:19<19:57:46,  3.74it/s]
 28%|██▊       | 102762/371472 [8:10:19<20:11:38,  3.70it/s]
 28%|██▊       | 102763/371472 [8:10:20<20:23:14,  3.66it/s]
 28%|██▊       | 102764/371472 [8:10:20<20:01:58,  3.73it/s]
 28%|██▊       | 102765/371472 [8:10:20<20:00:35,  3.73it/s]
 28%|██▊       | 102766/371472 [8:10:21<20:33:36,  3.63it/s]
 28%|██▊       | 102767/371472 [8:10:21<20:40:43,  3.61it/s]
 28%|██▊       | 102768/371472 [8:10:21<21:05:31,  3.54it/s]
 28%|██▊       | 102769/371472 [8:10:21<22:10:15,  3.37it/s]
 28%|██▊       | 102770/371472 [8:10:22<21:17:03,  3.51it/s]
 28%|██▊       | 102771/371472 [8:10:22<20:47:35,  3.59it/s]
 28%|██▊       | 102772/371472 [8:10:22<20:06:28,  3.71it/s]
 28%|██▊       | 102773/371472 [8:10:22<20:36:59,  3.62it/s]
 28%|██▊       | 102774/371472 [8:10:23<20:30:49,  3.64it/s]
 28%|██▊       | 102775/371472 [8:10:23<20:26:52,  3.65it/s]
 28%|██▊       | 102776/371472 [8:10:23<20:37:23,  3.62it/s]
 28%|██▊       | 102777/371472 [8:10:24<21:30:04,  3.47it/s]
 28%|██▊       | 102778/371472 [8:10:24<22:02:38,  3.39it/s]
 28%|██▊       | 102779/371472 [8:10:24<21:47:46,  3.42it/s]
 28%|██▊       | 102780/371472 [8:10:25<23:06:08,  3.23it/s]
                                                            
{'loss': 3.6713, 'learning_rate': 7.513359477687517e-07, 'epoch': 4.43}

 28%|██▊       | 102780/371472 [8:10:25<23:06:08,  3.23it/s]
 28%|██▊       | 102781/371472 [8:10:25<21:57:52,  3.40it/s]
 28%|██▊       | 102782/371472 [8:10:25<21:09:47,  3.53it/s]
 28%|██▊       | 102783/371472 [8:10:25<22:16:26,  3.35it/s]
 28%|██▊       | 102784/371472 [8:10:26<21:19:25,  3.50it/s]
 28%|██▊       | 102785/371472 [8:10:26<22:29:41,  3.32it/s]
 28%|██▊       | 102786/371472 [8:10:26<21:25:19,  3.48it/s]
 28%|██▊       | 102787/371472 [8:10:27<22:18:45,  3.34it/s]
 28%|██▊       | 102788/371472 [8:10:27<21:03:03,  3.55it/s]
 28%|██▊       | 102789/371472 [8:10:27<21:17:27,  3.51it/s]
 28%|██▊       | 102790/371472 [8:10:27<22:38:40,  3.30it/s]
 28%|██▊       | 102791/371472 [8:10:28<21:51:02,  3.42it/s]
 28%|██▊       | 102792/371472 [8:10:28<22:57:20,  3.25it/s]
 28%|██▊       | 102793/371472 [8:10:28<22:17:59,  3.35it/s]
 28%|██▊       | 102794/371472 [8:10:29<22:20:18,  3.34it/s]
 28%|██▊       | 102795/371472 [8:10:29<22:09:10,  3.37it/s]
 28%|██▊       | 102796/371472 [8:10:29<22:11:21,  3.36it/s]
 28%|██▊       | 102797/371472 [8:10:30<22:57:46,  3.25it/s]
 28%|██▊       | 102798/371472 [8:10:30<21:52:28,  3.41it/s]
 28%|██▊       | 102799/371472 [8:10:30<21:48:14,  3.42it/s]
 28%|██▊       | 102800/371472 [8:10:30<21:10:35,  3.52it/s]
                                                            
{'loss': 3.5122, 'learning_rate': 7.512874657932729e-07, 'epoch': 4.43}

 28%|██▊       | 102800/371472 [8:10:30<21:10:35,  3.52it/s]
 28%|██▊       | 102801/371472 [8:10:31<20:45:24,  3.60it/s]
 28%|██▊       | 102802/371472 [8:10:31<20:34:41,  3.63it/s]
 28%|██▊       | 102803/371472 [8:10:31<20:16:35,  3.68it/s]
 28%|██▊       | 102804/371472 [8:10:31<20:19:02,  3.67it/s]
 28%|██▊       | 102805/371472 [8:10:32<21:22:13,  3.49it/s]
 28%|██▊       | 102806/371472 [8:10:32<20:55:53,  3.57it/s]
 28%|██▊       | 102807/371472 [8:10:32<20:39:53,  3.61it/s]
 28%|██▊       | 102808/371472 [8:10:33<21:20:36,  3.50it/s]
 28%|██▊       | 102809/371472 [8:10:33<20:39:33,  3.61it/s]
 28%|██▊       | 102810/371472 [8:10:33<20:04:52,  3.72it/s]
 28%|██▊       | 102811/371472 [8:10:33<20:05:25,  3.71it/s]
 28%|██▊       | 102812/371472 [8:10:34<20:02:47,  3.72it/s]
 28%|██▊       | 102813/371472 [8:10:34<23:05:02,  3.23it/s]
 28%|██▊       | 102814/371472 [8:10:34<22:02:05,  3.39it/s]
 28%|██▊       | 102815/371472 [8:10:35<21:20:49,  3.50it/s]
 28%|██▊       | 102816/371472 [8:10:35<20:53:18,  3.57it/s]
 28%|██▊       | 102817/371472 [8:10:35<20:43:45,  3.60it/s]
 28%|██▊       | 102818/371472 [8:10:35<21:11:51,  3.52it/s]
 28%|██▊       | 102819/371472 [8:10:36<20:21:25,  3.67it/s]
 28%|██▊       | 102820/371472 [8:10:36<20:27:22,  3.65it/s]
                                                            
{'loss': 3.4725, 'learning_rate': 7.51238983817794e-07, 'epoch': 4.43}

 28%|██▊       | 102820/371472 [8:10:36<20:27:22,  3.65it/s]
 28%|██▊       | 102821/371472 [8:10:36<21:09:19,  3.53it/s]
 28%|██▊       | 102822/371472 [8:10:37<21:04:06,  3.54it/s]
 28%|██▊       | 102823/371472 [8:10:37<20:57:57,  3.56it/s]
 28%|██▊       | 102824/371472 [8:10:37<20:21:07,  3.67it/s]
 28%|██▊       | 102825/371472 [8:10:37<20:20:22,  3.67it/s]
 28%|██▊       | 102826/371472 [8:10:38<19:53:27,  3.75it/s]
 28%|██▊       | 102827/371472 [8:10:38<19:45:06,  3.78it/s]
 28%|██▊       | 102828/371472 [8:10:38<19:42:43,  3.79it/s]
 28%|██▊       | 102829/371472 [8:10:38<20:18:07,  3.68it/s]
 28%|██▊       | 102830/371472 [8:10:39<19:27:55,  3.83it/s]
 28%|██▊       | 102831/371472 [8:10:39<19:59:48,  3.73it/s]
 28%|██▊       | 102832/371472 [8:10:39<19:49:43,  3.76it/s]
 28%|██▊       | 102833/371472 [8:10:40<21:14:59,  3.51it/s]
 28%|██▊       | 102834/371472 [8:10:40<20:34:31,  3.63it/s]
 28%|██▊       | 102835/371472 [8:10:40<23:55:23,  3.12it/s]
 28%|██▊       | 102836/371472 [8:10:40<23:05:21,  3.23it/s]
 28%|██▊       | 102837/371472 [8:10:41<22:52:26,  3.26it/s]
 28%|██▊       | 102838/371472 [8:10:41<22:31:30,  3.31it/s]
 28%|██▊       | 102839/371472 [8:10:41<21:19:23,  3.50it/s]
 28%|██▊       | 102840/371472 [8:10:42<20:30:10,  3.64it/s]
                                                            
{'loss': 3.4536, 'learning_rate': 7.511905018423149e-07, 'epoch': 4.43}

 28%|██▊       | 102840/371472 [8:10:42<20:30:10,  3.64it/s]
 28%|██▊       | 102841/371472 [8:10:42<20:40:34,  3.61it/s]
 28%|██▊       | 102842/371472 [8:10:42<21:17:39,  3.50it/s]
 28%|██▊       | 102843/371472 [8:10:42<20:43:57,  3.60it/s]
 28%|██▊       | 102844/371472 [8:10:43<20:39:58,  3.61it/s]
 28%|██▊       | 102845/371472 [8:10:43<21:09:48,  3.53it/s]
 28%|██▊       | 102846/371472 [8:10:43<20:34:50,  3.63it/s]
 28%|██▊       | 102847/371472 [8:10:44<20:45:54,  3.59it/s]
 28%|██▊       | 102848/371472 [8:10:44<19:53:23,  3.75it/s]
 28%|██▊       | 102849/371472 [8:10:44<20:14:05,  3.69it/s]
 28%|██▊       | 102850/371472 [8:10:44<20:04:41,  3.72it/s]
 28%|██▊       | 102851/371472 [8:10:45<22:32:51,  3.31it/s]
 28%|██▊       | 102852/371472 [8:10:45<21:30:15,  3.47it/s]
 28%|██▊       | 102853/371472 [8:10:45<21:51:43,  3.41it/s]
 28%|██▊       | 102854/371472 [8:10:46<22:04:07,  3.38it/s]
 28%|██▊       | 102855/371472 [8:10:46<22:51:13,  3.26it/s]
 28%|██▊       | 102856/371472 [8:10:46<22:56:37,  3.25it/s]
 28%|██▊       | 102857/371472 [8:10:46<22:34:48,  3.30it/s]
 28%|██▊       | 102858/371472 [8:10:47<21:36:57,  3.45it/s]
 28%|██▊       | 102859/371472 [8:10:47<20:42:06,  3.60it/s]
 28%|██▊       | 102860/371472 [8:10:47<20:51:56,  3.58it/s]
                                                            
{'loss': 3.4621, 'learning_rate': 7.511420198668361e-07, 'epoch': 4.43}

 28%|██▊       | 102860/371472 [8:10:47<20:51:56,  3.58it/s]
 28%|██▊       | 102861/371472 [8:10:48<21:25:22,  3.48it/s]
 28%|██▊       | 102862/371472 [8:10:48<21:20:58,  3.49it/s]
 28%|██▊       | 102863/371472 [8:10:48<21:22:14,  3.49it/s]
 28%|██▊       | 102864/371472 [8:10:48<21:50:48,  3.42it/s]
 28%|██▊       | 102865/371472 [8:10:49<21:31:10,  3.47it/s]
 28%|██▊       | 102866/371472 [8:10:49<21:21:31,  3.49it/s]
 28%|██▊       | 102867/371472 [8:10:49<21:17:15,  3.50it/s]
 28%|██▊       | 102868/371472 [8:10:50<21:53:11,  3.41it/s]
 28%|██▊       | 102869/371472 [8:10:50<23:49:21,  3.13it/s]
 28%|██▊       | 102870/371472 [8:10:50<23:49:22,  3.13it/s]
 28%|██▊       | 102871/371472 [8:10:51<22:20:04,  3.34it/s]
 28%|██▊       | 102872/371472 [8:10:51<21:47:46,  3.42it/s]
 28%|██▊       | 102873/371472 [8:10:51<20:59:06,  3.56it/s]
 28%|██▊       | 102874/371472 [8:10:51<21:09:00,  3.53it/s]
 28%|██▊       | 102875/371472 [8:10:52<21:00:48,  3.55it/s]
 28%|██▊       | 102876/371472 [8:10:52<20:42:35,  3.60it/s]
 28%|██▊       | 102877/371472 [8:10:52<20:30:47,  3.64it/s]
 28%|██▊       | 102878/371472 [8:10:52<20:14:56,  3.68it/s]
 28%|██▊       | 102879/371472 [8:10:53<20:09:24,  3.70it/s]
 28%|██▊       | 102880/371472 [8:10:53<19:32:27,  3.82it/s]
                                                            
{'loss': 3.6124, 'learning_rate': 7.510935378913573e-07, 'epoch': 4.43}

 28%|██▊       | 102880/371472 [8:10:53<19:32:27,  3.82it/s]
 28%|██▊       | 102881/371472 [8:10:53<19:37:16,  3.80it/s]
 28%|██▊       | 102882/371472 [8:10:54<22:02:10,  3.39it/s]
 28%|██▊       | 102883/371472 [8:10:54<21:42:49,  3.44it/s]
 28%|██▊       | 102884/371472 [8:10:54<21:44:23,  3.43it/s]
 28%|██▊       | 102885/371472 [8:10:54<21:12:49,  3.52it/s]
 28%|██▊       | 102886/371472 [8:10:55<21:16:12,  3.51it/s]
 28%|██▊       | 102887/371472 [8:10:55<20:41:37,  3.61it/s]
 28%|██▊       | 102888/371472 [8:10:55<20:54:43,  3.57it/s]
 28%|██▊       | 102889/371472 [8:10:56<20:57:46,  3.56it/s]
 28%|██▊       | 102890/371472 [8:10:56<21:34:49,  3.46it/s]
 28%|██▊       | 102891/371472 [8:10:56<21:26:22,  3.48it/s]
 28%|██▊       | 102892/371472 [8:10:56<20:51:22,  3.58it/s]
 28%|██▊       | 102893/371472 [8:10:57<20:35:19,  3.62it/s]
 28%|██▊       | 102894/371472 [8:10:57<19:44:26,  3.78it/s]
 28%|██▊       | 102895/371472 [8:10:57<20:20:11,  3.67it/s]
 28%|██▊       | 102896/371472 [8:10:57<20:02:28,  3.72it/s]
 28%|██▊       | 102897/371472 [8:10:58<19:06:25,  3.90it/s]
 28%|██▊       | 102898/371472 [8:10:58<20:08:42,  3.70it/s]
 28%|██▊       | 102899/371472 [8:10:58<21:03:56,  3.54it/s]
 28%|██▊       | 102900/371472 [8:10:59<24:05:47,  3.10it/s]
                                                            
{'loss': 3.4475, 'learning_rate': 7.510450559158785e-07, 'epoch': 4.43}

 28%|██▊       | 102900/371472 [8:10:59<24:05:47,  3.10it/s]
 28%|██▊       | 102901/371472 [8:10:59<22:48:57,  3.27it/s]
 28%|██▊       | 102902/371472 [8:10:59<22:24:19,  3.33it/s]
 28%|██▊       | 102903/371472 [8:11:00<22:32:32,  3.31it/s]
 28%|██▊       | 102904/371472 [8:11:00<22:46:05,  3.28it/s]
 28%|██▊       | 102905/371472 [8:11:00<22:10:30,  3.36it/s]
 28%|██▊       | 102906/371472 [8:11:01<23:16:19,  3.21it/s]
 28%|██▊       | 102907/371472 [8:11:01<23:04:27,  3.23it/s]
 28%|██▊       | 102908/371472 [8:11:01<23:34:09,  3.17it/s]
 28%|██▊       | 102909/371472 [8:11:01<23:25:05,  3.19it/s]
 28%|██▊       | 102910/371472 [8:11:02<21:51:55,  3.41it/s]
 28%|██▊       | 102911/371472 [8:11:02<23:00:14,  3.24it/s]
 28%|██▊       | 102912/371472 [8:11:02<21:25:00,  3.48it/s]
 28%|██▊       | 102913/371472 [8:11:03<20:39:49,  3.61it/s]
 28%|██▊       | 102914/371472 [8:11:03<20:32:47,  3.63it/s]
 28%|██▊       | 102915/371472 [8:11:03<21:18:32,  3.50it/s]
 28%|██▊       | 102916/371472 [8:11:03<20:55:42,  3.56it/s]
 28%|██▊       | 102917/371472 [8:11:04<21:43:26,  3.43it/s]
 28%|██▊       | 102918/371472 [8:11:04<21:39:15,  3.44it/s]
 28%|██▊       | 102919/371472 [8:11:04<21:26:54,  3.48it/s]
 28%|██▊       | 102920/371472 [8:11:05<24:52:05,  3.00it/s]
                                                            
{'loss': 3.5734, 'learning_rate': 7.509965739403994e-07, 'epoch': 4.43}

 28%|██▊       | 102920/371472 [8:11:05<24:52:05,  3.00it/s]
 28%|██▊       | 102921/371472 [8:11:05<23:12:12,  3.21it/s]
 28%|██▊       | 102922/371472 [8:11:05<23:11:26,  3.22it/s]
 28%|██▊       | 102923/371472 [8:11:06<22:30:21,  3.31it/s]
 28%|██▊       | 102924/371472 [8:11:06<22:26:45,  3.32it/s]
 28%|██▊       | 102925/371472 [8:11:06<21:31:25,  3.47it/s]
 28%|██▊       | 102926/371472 [8:11:06<21:44:02,  3.43it/s]
 28%|██▊       | 102927/371472 [8:11:07<23:09:07,  3.22it/s]
 28%|██▊       | 102928/371472 [8:11:07<22:50:22,  3.27it/s]
 28%|██▊       | 102929/371472 [8:11:07<24:30:44,  3.04it/s]
 28%|██▊       | 102930/371472 [8:11:08<23:44:52,  3.14it/s]
 28%|██▊       | 102931/371472 [8:11:08<24:13:45,  3.08it/s]
 28%|██▊       | 102932/371472 [8:11:08<24:36:34,  3.03it/s]
 28%|██▊       | 102933/371472 [8:11:09<23:30:27,  3.17it/s]
 28%|██▊       | 102934/371472 [8:11:09<23:54:34,  3.12it/s]
 28%|██▊       | 102935/371472 [8:11:09<23:03:06,  3.24it/s]
 28%|██▊       | 102936/371472 [8:11:10<23:02:40,  3.24it/s]
 28%|██▊       | 102937/371472 [8:11:10<22:28:40,  3.32it/s]
 28%|██▊       | 102938/371472 [8:11:10<22:02:26,  3.38it/s]
 28%|██▊       | 102939/371472 [8:11:11<22:23:02,  3.33it/s]
 28%|██▊       | 102940/371472 [8:11:11<24:43:27,  3.02it/s]
                                                            
{'loss': 3.3826, 'learning_rate': 7.509480919649205e-07, 'epoch': 4.43}

 28%|██▊       | 102940/371472 [8:11:11<24:43:27,  3.02it/s]
 28%|██▊       | 102941/371472 [8:11:11<23:22:39,  3.19it/s]
 28%|██▊       | 102942/371472 [8:11:12<23:02:15,  3.24it/s]
 28%|██▊       | 102943/371472 [8:11:12<25:10:23,  2.96it/s]
 28%|██▊       | 102944/371472 [8:11:12<23:22:51,  3.19it/s]
 28%|██▊       | 102945/371472 [8:11:12<22:26:45,  3.32it/s]
 28%|██▊       | 102946/371472 [8:11:13<21:25:33,  3.48it/s]
 28%|██▊       | 102947/371472 [8:11:13<21:30:42,  3.47it/s]
 28%|██▊       | 102948/371472 [8:11:13<20:54:46,  3.57it/s]
 28%|██▊       | 102949/371472 [8:11:14<21:04:03,  3.54it/s]
 28%|██▊       | 102950/371472 [8:11:14<20:43:20,  3.60it/s]
 28%|██▊       | 102951/371472 [8:11:14<20:22:26,  3.66it/s]
 28%|██▊       | 102952/371472 [8:11:14<21:10:49,  3.52it/s]
 28%|██▊       | 102953/371472 [8:11:15<20:43:55,  3.60it/s]
 28%|██▊       | 102954/371472 [8:11:15<20:36:10,  3.62it/s]
 28%|██▊       | 102955/371472 [8:11:15<19:53:40,  3.75it/s]
 28%|██▊       | 102956/371472 [8:11:15<20:39:09,  3.61it/s]
 28%|██▊       | 102957/371472 [8:11:16<20:50:11,  3.58it/s]
 28%|██▊       | 102958/371472 [8:11:16<21:34:45,  3.46it/s]
 28%|██▊       | 102959/371472 [8:11:16<22:25:49,  3.33it/s]
 28%|██▊       | 102960/371472 [8:11:17<21:24:37,  3.48it/s]
                                                            
{'loss': 3.6288, 'learning_rate': 7.508996099894417e-07, 'epoch': 4.43}

 28%|██▊       | 102960/371472 [8:11:17<21:24:37,  3.48it/s]
 28%|██▊       | 102961/371472 [8:11:17<20:51:17,  3.58it/s]
 28%|██▊       | 102962/371472 [8:11:17<21:42:38,  3.44it/s]
 28%|██▊       | 102963/371472 [8:11:18<21:53:27,  3.41it/s]
 28%|██▊       | 102964/371472 [8:11:18<22:21:43,  3.34it/s]
 28%|██▊       | 102965/371472 [8:11:18<21:40:03,  3.44it/s]
 28%|██▊       | 102966/371472 [8:11:18<22:18:49,  3.34it/s]
 28%|██▊       | 102967/371472 [8:11:19<22:06:41,  3.37it/s]
 28%|██▊       | 102968/371472 [8:11:19<21:26:01,  3.48it/s]
 28%|██▊       | 102969/371472 [8:11:19<21:34:27,  3.46it/s]
 28%|██▊       | 102970/371472 [8:11:20<20:40:23,  3.61it/s]
 28%|██▊       | 102971/371472 [8:11:20<20:08:02,  3.70it/s]
 28%|██▊       | 102972/371472 [8:11:20<21:02:00,  3.55it/s]
 28%|██▊       | 102973/371472 [8:11:20<22:19:42,  3.34it/s]
 28%|██▊       | 102974/371472 [8:11:21<21:34:38,  3.46it/s]
 28%|██▊       | 102975/371472 [8:11:21<21:50:53,  3.41it/s]
 28%|██▊       | 102976/371472 [8:11:21<20:37:10,  3.62it/s]
 28%|██▊       | 102977/371472 [8:11:21<20:22:15,  3.66it/s]
 28%|██▊       | 102978/371472 [8:11:22<19:59:20,  3.73it/s]
 28%|██▊       | 102979/371472 [8:11:22<20:53:22,  3.57it/s]
 28%|██▊       | 102980/371472 [8:11:22<20:38:24,  3.61it/s]
                                                            
{'loss': 3.5509, 'learning_rate': 7.508511280139627e-07, 'epoch': 4.44}

 28%|██▊       | 102980/371472 [8:11:22<20:38:24,  3.61it/s]
 28%|██▊       | 102981/371472 [8:11:23<20:55:50,  3.56it/s]
 28%|██▊       | 102982/371472 [8:11:23<21:52:09,  3.41it/s]
 28%|██▊       | 102983/371472 [8:11:23<21:52:34,  3.41it/s]
 28%|██▊       | 102984/371472 [8:11:24<21:56:08,  3.40it/s]
 28%|██▊       | 102985/371472 [8:11:24<21:28:05,  3.47it/s]
 28%|██▊       | 102986/371472 [8:11:24<21:36:10,  3.45it/s]
 28%|██▊       | 102987/371472 [8:11:24<21:46:55,  3.42it/s]
 28%|██▊       | 102988/371472 [8:11:25<21:37:24,  3.45it/s]
 28%|██▊       | 102989/371472 [8:11:25<20:46:07,  3.59it/s]
 28%|██▊       | 102990/371472 [8:11:25<20:19:52,  3.67it/s]
 28%|██▊       | 102991/371472 [8:11:25<20:23:12,  3.66it/s]
 28%|██▊       | 102992/371472 [8:11:26<19:49:55,  3.76it/s]
 28%|██▊       | 102993/371472 [8:11:26<22:38:23,  3.29it/s]
 28%|██▊       | 102994/371472 [8:11:26<22:46:00,  3.28it/s]
 28%|██▊       | 102995/371472 [8:11:27<22:07:56,  3.37it/s]
 28%|██▊       | 102996/371472 [8:11:27<21:26:46,  3.48it/s]
 28%|██▊       | 102997/371472 [8:11:27<21:03:57,  3.54it/s]
 28%|██▊       | 102998/371472 [8:11:27<20:51:08,  3.58it/s]
 28%|██▊       | 102999/371472 [8:11:28<19:56:16,  3.74it/s]
 28%|██▊       | 103000/371472 [8:11:28<21:21:24,  3.49it/s]
                                                            
{'loss': 3.5255, 'learning_rate': 7.508026460384838e-07, 'epoch': 4.44}

 28%|██▊       | 103000/371472 [8:11:28<21:21:24,  3.49it/s]
 28%|██▊       | 103001/371472 [8:11:28<22:05:08,  3.38it/s]
 28%|██▊       | 103002/371472 [8:11:29<21:10:08,  3.52it/s]
 28%|██▊       | 103003/371472 [8:11:29<21:07:57,  3.53it/s]
 28%|██▊       | 103004/371472 [8:11:29<22:10:02,  3.36it/s]
 28%|██▊       | 103005/371472 [8:11:30<21:24:38,  3.48it/s]
 28%|██▊       | 103006/371472 [8:11:30<22:16:09,  3.35it/s]
 28%|██▊       | 103007/371472 [8:11:30<21:42:26,  3.44it/s]
 28%|██▊       | 103008/371472 [8:11:30<21:35:11,  3.45it/s]
 28%|██▊       | 103009/371472 [8:11:31<21:25:48,  3.48it/s]
 28%|██▊       | 103010/371472 [8:11:31<21:31:50,  3.46it/s]
 28%|██▊       | 103011/371472 [8:11:31<20:50:51,  3.58it/s]
 28%|██▊       | 103012/371472 [8:11:31<20:24:48,  3.65it/s]
 28%|██▊       | 103013/371472 [8:11:32<20:07:48,  3.70it/s]
 28%|██▊       | 103014/371472 [8:11:32<20:57:05,  3.56it/s]
 28%|██▊       | 103015/371472 [8:11:32<21:01:14,  3.55it/s]
 28%|██▊       | 103016/371472 [8:11:33<19:58:03,  3.73it/s]
 28%|██▊       | 103017/371472 [8:11:33<19:21:08,  3.85it/s]
 28%|██▊       | 103018/371472 [8:11:33<19:37:06,  3.80it/s]
 28%|██▊       | 103019/371472 [8:11:33<19:04:16,  3.91it/s]
 28%|██▊       | 103020/371472 [8:11:34<19:18:50,  3.86it/s]
                                                            
{'loss': 3.4593, 'learning_rate': 7.50754164063005e-07, 'epoch': 4.44}

 28%|██▊       | 103020/371472 [8:11:34<19:18:50,  3.86it/s]
 28%|██▊       | 103021/371472 [8:11:34<19:29:19,  3.83it/s]
 28%|██▊       | 103022/371472 [8:11:34<19:37:13,  3.80it/s]
 28%|██▊       | 103023/371472 [8:11:34<19:48:40,  3.76it/s]
 28%|██▊       | 103024/371472 [8:11:35<19:52:26,  3.75it/s]
 28%|██▊       | 103025/371472 [8:11:35<20:17:41,  3.67it/s]
 28%|██▊       | 103026/371472 [8:11:35<20:21:09,  3.66it/s]
 28%|██▊       | 103027/371472 [8:11:36<20:43:15,  3.60it/s]
 28%|██▊       | 103028/371472 [8:11:36<21:44:38,  3.43it/s]
 28%|██▊       | 103029/371472 [8:11:36<21:53:35,  3.41it/s]
 28%|██▊       | 103030/371472 [8:11:36<21:31:46,  3.46it/s]
 28%|██▊       | 103031/371472 [8:11:37<20:26:52,  3.65it/s]
 28%|██▊       | 103032/371472 [8:11:37<21:45:04,  3.43it/s]
 28%|██▊       | 103033/371472 [8:11:37<20:46:05,  3.59it/s]
 28%|██▊       | 103034/371472 [8:11:38<20:40:19,  3.61it/s]
 28%|██▊       | 103035/371472 [8:11:38<20:13:34,  3.69it/s]
 28%|██▊       | 103036/371472 [8:11:38<19:43:22,  3.78it/s]
 28%|██▊       | 103037/371472 [8:11:38<21:17:03,  3.50it/s]
 28%|██▊       | 103038/371472 [8:11:39<21:27:12,  3.48it/s]
 28%|██▊       | 103039/371472 [8:11:39<20:28:29,  3.64it/s]
 28%|██▊       | 103040/371472 [8:11:39<20:08:12,  3.70it/s]
                                                            
{'loss': 3.2955, 'learning_rate': 7.507056820875262e-07, 'epoch': 4.44}

 28%|██▊       | 103040/371472 [8:11:39<20:08:12,  3.70it/s]
 28%|██▊       | 103041/371472 [8:11:39<20:03:08,  3.72it/s]
 28%|██▊       | 103042/371472 [8:11:40<19:36:22,  3.80it/s]
 28%|██▊       | 103043/371472 [8:11:40<19:49:33,  3.76it/s]
 28%|██▊       | 103044/371472 [8:11:40<20:25:22,  3.65it/s]
 28%|██▊       | 103045/371472 [8:11:41<21:00:32,  3.55it/s]
 28%|██▊       | 103046/371472 [8:11:41<21:17:05,  3.50it/s]
 28%|██▊       | 103047/371472 [8:11:41<21:19:30,  3.50it/s]
 28%|██▊       | 103048/371472 [8:11:41<20:43:08,  3.60it/s]
 28%|██▊       | 103049/371472 [8:11:42<21:15:52,  3.51it/s]
 28%|██▊       | 103050/371472 [8:11:42<23:13:23,  3.21it/s]
 28%|██▊       | 103051/371472 [8:11:42<21:51:29,  3.41it/s]
 28%|██▊       | 103052/371472 [8:11:43<21:07:09,  3.53it/s]
 28%|██▊       | 103053/371472 [8:11:43<21:24:48,  3.48it/s]
 28%|██▊       | 103054/371472 [8:11:43<21:31:24,  3.46it/s]
 28%|██▊       | 103055/371472 [8:11:44<23:57:13,  3.11it/s]
 28%|██▊       | 103056/371472 [8:11:44<23:01:23,  3.24it/s]
 28%|██▊       | 103057/371472 [8:11:44<22:02:08,  3.38it/s]
 28%|██▊       | 103058/371472 [8:11:44<20:37:37,  3.61it/s]
 28%|██▊       | 103059/371472 [8:11:45<20:28:34,  3.64it/s]
 28%|██▊       | 103060/371472 [8:11:45<20:03:24,  3.72it/s]
                                                            
{'loss': 3.6332, 'learning_rate': 7.506572001120472e-07, 'epoch': 4.44}

 28%|██▊       | 103060/371472 [8:11:45<20:03:24,  3.72it/s]
 28%|██▊       | 103061/371472 [8:11:45<19:29:28,  3.83it/s]
 28%|██▊       | 103062/371472 [8:11:45<19:11:31,  3.88it/s]
 28%|██▊       | 103063/371472 [8:11:46<19:21:09,  3.85it/s]
 28%|██▊       | 103064/371472 [8:11:46<19:59:27,  3.73it/s]
 28%|██▊       | 103065/371472 [8:11:46<19:20:40,  3.85it/s]
 28%|██▊       | 103066/371472 [8:11:46<19:49:42,  3.76it/s]
 28%|██▊       | 103067/371472 [8:11:47<19:43:37,  3.78it/s]
 28%|██▊       | 103068/371472 [8:11:47<21:50:06,  3.41it/s]
 28%|██▊       | 103069/371472 [8:11:47<21:00:11,  3.55it/s]
 28%|██▊       | 103070/371472 [8:11:48<20:06:29,  3.71it/s]
 28%|██▊       | 103071/371472 [8:11:48<20:19:01,  3.67it/s]
 28%|██▊       | 103072/371472 [8:11:48<20:06:16,  3.71it/s]
 28%|██▊       | 103073/371472 [8:11:48<20:20:32,  3.67it/s]
 28%|██▊       | 103074/371472 [8:11:49<20:36:59,  3.62it/s]
 28%|██▊       | 103075/371472 [8:11:49<21:59:51,  3.39it/s]
 28%|██▊       | 103076/371472 [8:11:49<21:19:06,  3.50it/s]
 28%|██▊       | 103077/371472 [8:11:49<20:41:18,  3.60it/s]
 28%|██▊       | 103078/371472 [8:11:50<21:55:38,  3.40it/s]
 28%|██▊       | 103079/371472 [8:11:50<21:41:18,  3.44it/s]
 28%|██▊       | 103080/371472 [8:11:50<21:07:57,  3.53it/s]
                                                            
{'loss': 3.3554, 'learning_rate': 7.506087181365682e-07, 'epoch': 4.44}

 28%|██▊       | 103080/371472 [8:11:50<21:07:57,  3.53it/s]
 28%|██▊       | 103081/371472 [8:11:51<20:32:31,  3.63it/s]
 28%|██▊       | 103082/371472 [8:11:51<20:10:10,  3.70it/s]
 28%|██▊       | 103083/371472 [8:11:51<20:03:49,  3.72it/s]
 28%|██▊       | 103084/371472 [8:11:51<20:12:08,  3.69it/s]
 28%|██▊       | 103085/371472 [8:11:52<20:14:00,  3.68it/s]
 28%|██▊       | 103086/371472 [8:11:52<20:36:05,  3.62it/s]
 28%|██▊       | 103087/371472 [8:11:52<19:43:20,  3.78it/s]
 28%|██▊       | 103088/371472 [8:11:52<19:21:49,  3.85it/s]
 28%|██▊       | 103089/371472 [8:11:53<19:51:38,  3.75it/s]
 28%|██▊       | 103090/371472 [8:11:53<19:48:28,  3.76it/s]
 28%|██▊       | 103091/371472 [8:11:53<20:19:42,  3.67it/s]
 28%|██▊       | 103092/371472 [8:11:54<19:57:34,  3.74it/s]
 28%|██▊       | 103093/371472 [8:11:54<20:16:16,  3.68it/s]
 28%|██▊       | 103094/371472 [8:11:54<20:46:44,  3.59it/s]
 28%|██▊       | 103095/371472 [8:11:54<20:36:23,  3.62it/s]
 28%|██▊       | 103096/371472 [8:11:55<20:42:32,  3.60it/s]
 28%|██▊       | 103097/371472 [8:11:55<20:07:56,  3.70it/s]
 28%|██▊       | 103098/371472 [8:11:55<20:18:58,  3.67it/s]
 28%|██▊       | 103099/371472 [8:11:56<20:12:56,  3.69it/s]
 28%|██▊       | 103100/371472 [8:11:56<20:04:57,  3.71it/s]
                                                            
{'loss': 3.6188, 'learning_rate': 7.505602361610894e-07, 'epoch': 4.44}

 28%|██▊       | 103100/371472 [8:11:56<20:04:57,  3.71it/s]
 28%|██▊       | 103101/371472 [8:11:56<20:19:12,  3.67it/s]
 28%|██▊       | 103102/371472 [8:11:56<20:18:10,  3.67it/s]
 28%|██▊       | 103103/371472 [8:11:57<20:21:56,  3.66it/s]
 28%|██▊       | 103104/371472 [8:11:57<20:10:38,  3.69it/s]
 28%|██▊       | 103105/371472 [8:11:57<20:07:45,  3.70it/s]
 28%|██▊       | 103106/371472 [8:11:57<20:21:02,  3.66it/s]
 28%|██▊       | 103107/371472 [8:11:58<20:08:49,  3.70it/s]
 28%|██▊       | 103108/371472 [8:11:58<19:49:58,  3.76it/s]
 28%|██▊       | 103109/371472 [8:11:58<22:22:53,  3.33it/s]
 28%|██▊       | 103110/371472 [8:11:59<21:55:28,  3.40it/s]
 28%|██▊       | 103111/371472 [8:11:59<21:29:47,  3.47it/s]
 28%|██▊       | 103112/371472 [8:11:59<21:18:42,  3.50it/s]
 28%|██▊       | 103113/371472 [8:11:59<21:38:24,  3.44it/s]
 28%|██▊       | 103114/371472 [8:12:00<21:58:26,  3.39it/s]
 28%|██▊       | 103115/371472 [8:12:00<22:19:38,  3.34it/s]
 28%|██▊       | 103116/371472 [8:12:00<21:43:44,  3.43it/s]
 28%|██▊       | 103117/371472 [8:12:01<22:20:59,  3.34it/s]
 28%|██▊       | 103118/371472 [8:12:01<22:39:04,  3.29it/s]
 28%|██▊       | 103119/371472 [8:12:01<23:02:16,  3.24it/s]
 28%|██▊       | 103120/371472 [8:12:02<23:37:40,  3.15it/s]
                                                            
{'loss': 3.4414, 'learning_rate': 7.505117541856106e-07, 'epoch': 4.44}

 28%|██▊       | 103120/371472 [8:12:02<23:37:40,  3.15it/s]
 28%|██▊       | 103121/371472 [8:12:02<22:44:06,  3.28it/s]
 28%|██▊       | 103122/371472 [8:12:02<22:03:43,  3.38it/s]
 28%|██▊       | 103123/371472 [8:12:02<22:04:38,  3.38it/s]
 28%|██▊       | 103124/371472 [8:12:03<21:20:04,  3.49it/s]
 28%|██▊       | 103125/371472 [8:12:03<20:55:25,  3.56it/s]
 28%|██▊       | 103126/371472 [8:12:03<20:43:14,  3.60it/s]
 28%|██▊       | 103127/371472 [8:12:04<21:16:42,  3.50it/s]
 28%|██▊       | 103128/371472 [8:12:04<21:04:43,  3.54it/s]
 28%|██▊       | 103129/371472 [8:12:04<21:12:17,  3.52it/s]
 28%|██▊       | 103130/371472 [8:12:04<22:06:29,  3.37it/s]
 28%|██▊       | 103131/371472 [8:12:05<23:05:50,  3.23it/s]
 28%|██▊       | 103132/371472 [8:12:05<24:41:17,  3.02it/s]
 28%|██▊       | 103133/371472 [8:12:05<22:59:43,  3.24it/s]
 28%|██▊       | 103134/371472 [8:12:06<22:09:31,  3.36it/s]
 28%|██▊       | 103135/371472 [8:12:06<21:19:46,  3.49it/s]
 28%|██▊       | 103136/371472 [8:12:06<21:22:18,  3.49it/s]
 28%|██▊       | 103137/371472 [8:12:07<21:42:22,  3.43it/s]
 28%|██▊       | 103138/371472 [8:12:07<21:10:02,  3.52it/s]
 28%|██▊       | 103139/371472 [8:12:07<21:27:46,  3.47it/s]
 28%|██▊       | 103140/371472 [8:12:07<22:24:45,  3.33it/s]
                                                            
{'loss': 3.546, 'learning_rate': 7.504632722101316e-07, 'epoch': 4.44}

 28%|██▊       | 103140/371472 [8:12:07<22:24:45,  3.33it/s]
 28%|██▊       | 103141/371472 [8:12:08<21:53:49,  3.40it/s]
 28%|██▊       | 103142/371472 [8:12:08<21:43:42,  3.43it/s]
 28%|██▊       | 103143/371472 [8:12:08<21:52:07,  3.41it/s]
 28%|██▊       | 103144/371472 [8:12:09<20:46:48,  3.59it/s]
 28%|██▊       | 103145/371472 [8:12:09<22:01:21,  3.38it/s]
 28%|██▊       | 103146/371472 [8:12:09<21:08:30,  3.53it/s]
 28%|██▊       | 103147/371472 [8:12:09<21:15:02,  3.51it/s]
 28%|██▊       | 103148/371472 [8:12:10<21:48:05,  3.42it/s]
 28%|██▊       | 103149/371472 [8:12:10<20:52:55,  3.57it/s]
 28%|██▊       | 103150/371472 [8:12:10<20:01:13,  3.72it/s]
 28%|██▊       | 103151/371472 [8:12:11<21:21:59,  3.49it/s]
 28%|██▊       | 103152/371472 [8:12:11<20:48:04,  3.58it/s]
 28%|██▊       | 103153/371472 [8:12:11<20:22:00,  3.66it/s]
 28%|██▊       | 103154/371472 [8:12:11<20:19:01,  3.67it/s]
 28%|██▊       | 103155/371472 [8:12:12<20:16:17,  3.68it/s]
 28%|██▊       | 103156/371472 [8:12:12<21:57:37,  3.39it/s]
 28%|██▊       | 103157/371472 [8:12:12<21:29:34,  3.47it/s]
 28%|██▊       | 103158/371472 [8:12:13<21:10:30,  3.52it/s]
 28%|██▊       | 103159/371472 [8:12:13<21:39:55,  3.44it/s]
 28%|██▊       | 103160/371472 [8:12:13<21:12:09,  3.52it/s]
                                                            
{'loss': 3.3908, 'learning_rate': 7.504147902346527e-07, 'epoch': 4.44}

 28%|██▊       | 103160/371472 [8:12:13<21:12:09,  3.52it/s]
 28%|██▊       | 103161/371472 [8:12:13<21:21:42,  3.49it/s]
 28%|██▊       | 103162/371472 [8:12:14<22:41:27,  3.28it/s]
 28%|██▊       | 103163/371472 [8:12:14<22:36:37,  3.30it/s]
 28%|██▊       | 103164/371472 [8:12:14<22:20:24,  3.34it/s]
 28%|██▊       | 103165/371472 [8:12:15<21:59:24,  3.39it/s]
 28%|██▊       | 103166/371472 [8:12:15<21:52:48,  3.41it/s]
 28%|██▊       | 103167/371472 [8:12:15<21:08:59,  3.52it/s]
 28%|██▊       | 103168/371472 [8:12:15<21:01:57,  3.54it/s]
 28%|██▊       | 103169/371472 [8:12:16<21:03:04,  3.54it/s]
 28%|██▊       | 103170/371472 [8:12:16<20:57:39,  3.56it/s]
 28%|██▊       | 103171/371472 [8:12:16<20:23:27,  3.65it/s]
 28%|██▊       | 103172/371472 [8:12:17<20:11:02,  3.69it/s]
 28%|██▊       | 103173/371472 [8:12:17<20:34:40,  3.62it/s]
 28%|██▊       | 103174/371472 [8:12:17<21:22:20,  3.49it/s]
 28%|██▊       | 103175/371472 [8:12:17<20:55:50,  3.56it/s]
 28%|██▊       | 103176/371472 [8:12:18<20:38:10,  3.61it/s]
 28%|██▊       | 103177/371472 [8:12:18<21:50:25,  3.41it/s]
 28%|██▊       | 103178/371472 [8:12:18<22:12:10,  3.36it/s]
 28%|██▊       | 103179/371472 [8:12:19<21:13:36,  3.51it/s]
 28%|██▊       | 103180/371472 [8:12:19<21:03:33,  3.54it/s]
                                                            
{'loss': 3.5382, 'learning_rate': 7.503663082591739e-07, 'epoch': 4.44}

 28%|██▊       | 103180/371472 [8:12:19<21:03:33,  3.54it/s]
 28%|██▊       | 103181/371472 [8:12:19<23:43:47,  3.14it/s]
 28%|██▊       | 103182/371472 [8:12:19<22:05:03,  3.37it/s]
 28%|██▊       | 103183/371472 [8:12:20<21:20:32,  3.49it/s]
 28%|██▊       | 103184/371472 [8:12:20<20:28:16,  3.64it/s]
 28%|██▊       | 103185/371472 [8:12:20<20:01:02,  3.72it/s]
 28%|██▊       | 103186/371472 [8:12:21<21:01:00,  3.55it/s]
 28%|██▊       | 103187/371472 [8:12:21<20:42:26,  3.60it/s]
 28%|██▊       | 103188/371472 [8:12:21<20:09:14,  3.70it/s]
 28%|██▊       | 103189/371472 [8:12:21<21:00:31,  3.55it/s]
 28%|██▊       | 103190/371472 [8:12:22<20:35:21,  3.62it/s]
 28%|██▊       | 103191/371472 [8:12:22<21:52:43,  3.41it/s]
 28%|██▊       | 103192/371472 [8:12:22<21:50:11,  3.41it/s]
 28%|██▊       | 103193/371472 [8:12:23<20:30:21,  3.63it/s]
 28%|██▊       | 103194/371472 [8:12:23<20:04:32,  3.71it/s]
 28%|██▊       | 103195/371472 [8:12:23<19:51:28,  3.75it/s]
 28%|██▊       | 103196/371472 [8:12:23<19:19:06,  3.86it/s]
 28%|██▊       | 103197/371472 [8:12:24<19:09:17,  3.89it/s]
 28%|██▊       | 103198/371472 [8:12:24<19:22:23,  3.85it/s]
 28%|██▊       | 103199/371472 [8:12:24<19:29:57,  3.82it/s]
 28%|██▊       | 103200/371472 [8:12:24<19:34:23,  3.81it/s]
                                                            
{'loss': 3.52, 'learning_rate': 7.50317826283695e-07, 'epoch': 4.45}

 28%|██▊       | 103200/371472 [8:12:24<19:34:23,  3.81it/s]
 28%|██▊       | 103201/371472 [8:12:25<20:10:41,  3.69it/s]
 28%|██▊       | 103202/371472 [8:12:25<20:23:09,  3.66it/s]
 28%|██▊       | 103203/371472 [8:12:25<20:14:03,  3.68it/s]
 28%|██▊       | 103204/371472 [8:12:25<20:01:46,  3.72it/s]
 28%|██▊       | 103205/371472 [8:12:26<19:49:17,  3.76it/s]
 28%|██▊       | 103206/371472 [8:12:26<19:54:29,  3.74it/s]
 28%|██▊       | 103207/371472 [8:12:26<20:39:44,  3.61it/s]
 28%|██▊       | 103208/371472 [8:12:27<22:06:14,  3.37it/s]
 28%|██▊       | 103209/371472 [8:12:27<21:18:03,  3.50it/s]
 28%|██▊       | 103210/371472 [8:12:27<22:39:54,  3.29it/s]
 28%|██▊       | 103211/371472 [8:12:27<21:25:03,  3.48it/s]
 28%|██▊       | 103212/371472 [8:12:28<20:52:26,  3.57it/s]
 28%|██▊       | 103213/371472 [8:12:28<20:26:05,  3.65it/s]
 28%|██▊       | 103214/371472 [8:12:28<20:28:34,  3.64it/s]
 28%|██▊       | 103215/371472 [8:12:29<20:31:04,  3.63it/s]
 28%|██▊       | 103216/371472 [8:12:29<20:32:10,  3.63it/s]
 28%|██▊       | 103217/371472 [8:12:29<20:39:20,  3.61it/s]
 28%|██▊       | 103218/371472 [8:12:29<21:27:05,  3.47it/s]
 28%|██▊       | 103219/371472 [8:12:30<20:38:28,  3.61it/s]
 28%|██▊       | 103220/371472 [8:12:30<20:44:45,  3.59it/s]
                                                            
{'loss': 3.5026, 'learning_rate': 7.50269344308216e-07, 'epoch': 4.45}

 28%|██▊       | 103220/371472 [8:12:30<20:44:45,  3.59it/s]
 28%|██▊       | 103221/371472 [8:12:30<21:06:29,  3.53it/s]
 28%|██▊       | 103222/371472 [8:12:31<21:03:26,  3.54it/s]
 28%|██▊       | 103223/371472 [8:12:31<20:58:59,  3.55it/s]
 28%|██▊       | 103224/371472 [8:12:31<21:16:12,  3.50it/s]
 28%|██▊       | 103225/371472 [8:12:31<22:07:27,  3.37it/s]
 28%|██▊       | 103226/371472 [8:12:32<21:50:15,  3.41it/s]
 28%|██▊       | 103227/371472 [8:12:32<22:37:33,  3.29it/s]
 28%|██▊       | 103228/371472 [8:12:32<21:47:38,  3.42it/s]
 28%|██▊       | 103229/371472 [8:12:33<21:15:11,  3.51it/s]
 28%|██▊       | 103230/371472 [8:12:33<20:55:08,  3.56it/s]
 28%|██▊       | 103231/371472 [8:12:33<20:32:22,  3.63it/s]
 28%|██▊       | 103232/371472 [8:12:33<23:05:19,  3.23it/s]
 28%|██▊       | 103233/371472 [8:12:34<21:35:41,  3.45it/s]
 28%|██▊       | 103234/371472 [8:12:34<20:19:20,  3.67it/s]
 28%|██▊       | 103235/371472 [8:12:34<20:27:48,  3.64it/s]
 28%|██▊       | 103236/371472 [8:12:35<20:36:05,  3.62it/s]
 28%|██▊       | 103237/371472 [8:12:35<20:10:18,  3.69it/s]
 28%|██▊       | 103238/371472 [8:12:35<20:22:17,  3.66it/s]
 28%|██▊       | 103239/371472 [8:12:35<21:13:45,  3.51it/s]
 28%|██▊       | 103240/371472 [8:12:36<21:21:44,  3.49it/s]
                                                            
{'loss': 3.4411, 'learning_rate': 7.502208623327371e-07, 'epoch': 4.45}

 28%|██▊       | 103240/371472 [8:12:36<21:21:44,  3.49it/s]
 28%|██▊       | 103241/371472 [8:12:36<21:50:05,  3.41it/s]
 28%|██▊       | 103242/371472 [8:12:36<22:08:59,  3.36it/s]
 28%|██▊       | 103243/371472 [8:12:37<22:29:11,  3.31it/s]
 28%|██▊       | 103244/371472 [8:12:37<22:20:38,  3.33it/s]
 28%|██▊       | 103245/371472 [8:12:37<21:53:55,  3.40it/s]
 28%|██▊       | 103246/371472 [8:12:37<21:09:53,  3.52it/s]
 28%|██▊       | 103247/371472 [8:12:38<23:00:58,  3.24it/s]
 28%|██▊       | 103248/371472 [8:12:38<24:01:19,  3.10it/s]
 28%|██▊       | 103249/371472 [8:12:38<22:44:21,  3.28it/s]
 28%|██▊       | 103250/371472 [8:12:39<21:15:45,  3.50it/s]
 28%|██▊       | 103251/371472 [8:12:39<22:02:37,  3.38it/s]
 28%|██▊       | 103252/371472 [8:12:39<21:20:58,  3.49it/s]
 28%|██▊       | 103253/371472 [8:12:39<20:27:13,  3.64it/s]
 28%|██▊       | 103254/371472 [8:12:40<20:00:36,  3.72it/s]
 28%|██▊       | 103255/371472 [8:12:40<19:42:46,  3.78it/s]
 28%|██▊       | 103256/371472 [8:12:40<19:30:13,  3.82it/s]
 28%|██▊       | 103257/371472 [8:12:41<19:48:32,  3.76it/s]
 28%|██▊       | 103258/371472 [8:12:41<20:49:20,  3.58it/s]
 28%|██▊       | 103259/371472 [8:12:41<20:07:35,  3.70it/s]
 28%|██▊       | 103260/371472 [8:12:41<20:15:15,  3.68it/s]
                                                            
{'loss': 3.6578, 'learning_rate': 7.501723803572583e-07, 'epoch': 4.45}

 28%|██▊       | 103260/371472 [8:12:41<20:15:15,  3.68it/s]
 28%|██▊       | 103261/371472 [8:12:42<19:23:28,  3.84it/s]
 28%|██▊       | 103262/371472 [8:12:42<19:14:02,  3.87it/s]
 28%|██▊       | 103263/371472 [8:12:42<19:11:28,  3.88it/s]
 28%|██▊       | 103264/371472 [8:12:42<19:10:11,  3.89it/s]
 28%|██▊       | 103265/371472 [8:12:43<18:50:03,  3.96it/s]
 28%|██▊       | 103266/371472 [8:12:43<19:17:37,  3.86it/s]
 28%|██▊       | 103267/371472 [8:12:43<23:33:49,  3.16it/s]
 28%|██▊       | 103268/371472 [8:12:44<23:10:54,  3.21it/s]
 28%|██▊       | 103269/371472 [8:12:44<21:36:40,  3.45it/s]
 28%|██▊       | 103270/371472 [8:12:44<21:54:24,  3.40it/s]
 28%|██▊       | 103271/371472 [8:12:44<21:17:38,  3.50it/s]
 28%|██▊       | 103272/371472 [8:12:45<22:02:29,  3.38it/s]
 28%|██▊       | 103273/371472 [8:12:45<22:55:31,  3.25it/s]
 28%|██▊       | 103274/371472 [8:12:45<24:40:47,  3.02it/s]
 28%|██▊       | 103275/371472 [8:12:46<24:07:51,  3.09it/s]
 28%|██▊       | 103276/371472 [8:12:46<23:17:32,  3.20it/s]
 28%|██▊       | 103277/371472 [8:12:46<23:28:43,  3.17it/s]
 28%|██▊       | 103278/371472 [8:12:47<24:49:54,  3.00it/s]
 28%|██▊       | 103279/371472 [8:12:47<22:53:46,  3.25it/s]
 28%|██▊       | 103280/371472 [8:12:47<23:12:47,  3.21it/s]
                                                            
{'loss': 3.5964, 'learning_rate': 7.501238983817795e-07, 'epoch': 4.45}

 28%|██▊       | 103280/371472 [8:12:47<23:12:47,  3.21it/s]
 28%|██▊       | 103281/371472 [8:12:48<21:59:35,  3.39it/s]
 28%|██▊       | 103282/371472 [8:12:48<20:53:20,  3.57it/s]
 28%|██▊       | 103283/371472 [8:12:48<22:06:54,  3.37it/s]
 28%|██▊       | 103284/371472 [8:12:48<21:39:58,  3.44it/s]
 28%|██▊       | 103285/371472 [8:12:49<22:02:01,  3.38it/s]
 28%|██▊       | 103286/371472 [8:12:49<21:16:15,  3.50it/s]
 28%|██▊       | 103287/371472 [8:12:49<20:55:44,  3.56it/s]
 28%|██▊       | 103288/371472 [8:12:50<22:09:21,  3.36it/s]
 28%|██▊       | 103289/371472 [8:12:50<21:04:42,  3.53it/s]
 28%|██▊       | 103290/371472 [8:12:50<20:19:38,  3.66it/s]
 28%|██▊       | 103291/371472 [8:12:50<21:38:43,  3.44it/s]
 28%|██▊       | 103292/371472 [8:12:51<21:09:19,  3.52it/s]
 28%|██▊       | 103293/371472 [8:12:51<20:04:49,  3.71it/s]
 28%|██▊       | 103294/371472 [8:12:51<20:21:43,  3.66it/s]
 28%|██▊       | 103295/371472 [8:12:52<22:01:03,  3.38it/s]
 28%|██▊       | 103296/371472 [8:12:52<22:19:24,  3.34it/s]
 28%|██▊       | 103297/371472 [8:12:52<21:09:54,  3.52it/s]
 28%|██▊       | 103298/371472 [8:12:52<21:25:23,  3.48it/s]
 28%|██▊       | 103299/371472 [8:12:53<22:06:27,  3.37it/s]
 28%|██▊       | 103300/371472 [8:12:53<21:00:09,  3.55it/s]
                                                            
{'loss': 3.4745, 'learning_rate': 7.500754164063005e-07, 'epoch': 4.45}

 28%|██▊       | 103300/371472 [8:12:53<21:00:09,  3.55it/s]
 28%|██▊       | 103301/371472 [8:12:53<20:38:36,  3.61it/s]
 28%|██▊       | 103302/371472 [8:12:54<20:05:21,  3.71it/s]
 28%|██▊       | 103303/371472 [8:12:54<19:38:03,  3.79it/s]
 28%|██▊       | 103304/371472 [8:12:54<19:42:39,  3.78it/s]
 28%|██▊       | 103305/371472 [8:12:54<21:39:35,  3.44it/s]
 28%|██▊       | 103306/371472 [8:12:55<20:44:08,  3.59it/s]
 28%|██▊       | 103307/371472 [8:12:55<20:34:59,  3.62it/s]
 28%|██▊       | 103308/371472 [8:12:55<20:38:59,  3.61it/s]
 28%|██▊       | 103309/371472 [8:12:55<19:51:21,  3.75it/s]
 28%|██▊       | 103310/371472 [8:12:56<19:37:08,  3.80it/s]
 28%|██▊       | 103311/371472 [8:12:56<19:53:59,  3.74it/s]
 28%|██▊       | 103312/371472 [8:12:56<19:05:41,  3.90it/s]
 28%|██▊       | 103313/371472 [8:12:56<19:31:50,  3.81it/s]
 28%|██▊       | 103314/371472 [8:12:57<19:05:56,  3.90it/s]
 28%|██▊       | 103315/371472 [8:12:57<19:52:11,  3.75it/s]
 28%|██▊       | 103316/371472 [8:12:57<19:54:19,  3.74it/s]
 28%|██▊       | 103317/371472 [8:12:58<20:06:49,  3.70it/s]
 28%|██▊       | 103318/371472 [8:12:58<20:19:05,  3.67it/s]
 28%|██▊       | 103319/371472 [8:12:58<20:26:29,  3.64it/s]
 28%|██▊       | 103320/371472 [8:12:58<22:09:55,  3.36it/s]
                                                            
{'loss': 3.4408, 'learning_rate': 7.500269344308215e-07, 'epoch': 4.45}

 28%|██▊       | 103320/371472 [8:12:58<22:09:55,  3.36it/s]
 28%|██▊       | 103321/371472 [8:12:59<21:29:56,  3.46it/s]
 28%|██▊       | 103322/371472 [8:12:59<20:57:27,  3.55it/s]
 28%|██▊       | 103323/371472 [8:12:59<21:18:52,  3.49it/s]
 28%|██▊       | 103324/371472 [8:13:00<21:12:40,  3.51it/s]
 28%|██▊       | 103325/371472 [8:13:00<20:40:41,  3.60it/s]
 28%|██▊       | 103326/371472 [8:13:00<19:57:26,  3.73it/s]
 28%|██▊       | 103327/371472 [8:13:00<20:42:42,  3.60it/s]
 28%|██▊       | 103328/371472 [8:13:01<20:09:24,  3.70it/s]
 28%|██▊       | 103329/371472 [8:13:01<20:15:25,  3.68it/s]
 28%|██▊       | 103330/371472 [8:13:01<20:49:06,  3.58it/s]
 28%|██▊       | 103331/371472 [8:13:01<20:12:48,  3.68it/s]
 28%|██▊       | 103332/371472 [8:13:02<20:55:36,  3.56it/s]
 28%|██▊       | 103333/371472 [8:13:02<20:29:30,  3.63it/s]
 28%|██▊       | 103334/371472 [8:13:02<20:18:39,  3.67it/s]
 28%|██▊       | 103335/371472 [8:13:03<19:29:34,  3.82it/s]
 28%|██▊       | 103336/371472 [8:13:03<18:58:59,  3.92it/s]
 28%|██▊       | 103337/371472 [8:13:03<20:39:07,  3.61it/s]
 28%|██▊       | 103338/371472 [8:13:03<20:49:41,  3.58it/s]
 28%|██▊       | 103339/371472 [8:13:04<20:02:54,  3.72it/s]
 28%|██▊       | 103340/371472 [8:13:04<19:40:52,  3.78it/s]
                                                            
{'loss': 3.5472, 'learning_rate': 7.499784524553427e-07, 'epoch': 4.45}

 28%|██▊       | 103340/371472 [8:13:04<19:40:52,  3.78it/s]
 28%|██▊       | 103341/371472 [8:13:04<19:24:20,  3.84it/s]
 28%|██▊       | 103342/371472 [8:13:04<19:33:40,  3.81it/s]
 28%|██▊       | 103343/371472 [8:13:05<20:23:16,  3.65it/s]
 28%|██▊       | 103344/371472 [8:13:05<20:12:18,  3.69it/s]
 28%|██▊       | 103345/371472 [8:13:05<24:04:35,  3.09it/s]
 28%|██▊       | 103346/371472 [8:13:06<23:25:37,  3.18it/s]
 28%|██▊       | 103347/371472 [8:13:06<23:25:19,  3.18it/s]
 28%|██▊       | 103348/371472 [8:13:06<22:49:00,  3.26it/s]
 28%|██▊       | 103349/371472 [8:13:07<23:00:12,  3.24it/s]
 28%|██▊       | 103350/371472 [8:13:07<21:42:58,  3.43it/s]
 28%|██▊       | 103351/371472 [8:13:07<21:20:37,  3.49it/s]
 28%|██▊       | 103352/371472 [8:13:07<20:59:44,  3.55it/s]
 28%|██▊       | 103353/371472 [8:13:08<20:54:35,  3.56it/s]
 28%|██▊       | 103354/371472 [8:13:08<21:01:43,  3.54it/s]
 28%|██▊       | 103355/371472 [8:13:08<21:31:21,  3.46it/s]
 28%|██▊       | 103356/371472 [8:13:09<22:11:44,  3.36it/s]
 28%|██▊       | 103357/371472 [8:13:09<21:07:11,  3.53it/s]
 28%|██▊       | 103358/371472 [8:13:09<22:50:50,  3.26it/s]
 28%|██▊       | 103359/371472 [8:13:10<23:40:19,  3.15it/s]
 28%|██▊       | 103360/371472 [8:13:10<22:39:47,  3.29it/s]
                                                            
{'loss': 3.3716, 'learning_rate': 7.499299704798638e-07, 'epoch': 4.45}

 28%|██▊       | 103360/371472 [8:13:10<22:39:47,  3.29it/s]
 28%|██▊       | 103361/371472 [8:13:10<22:33:13,  3.30it/s]
 28%|██▊       | 103362/371472 [8:13:10<22:11:49,  3.36it/s]
 28%|██▊       | 103363/371472 [8:13:11<21:34:56,  3.45it/s]
 28%|██▊       | 103364/371472 [8:13:11<20:29:33,  3.63it/s]
 28%|██▊       | 103365/371472 [8:13:11<20:27:57,  3.64it/s]
 28%|██▊       | 103366/371472 [8:13:11<20:04:12,  3.71it/s]
 28%|██▊       | 103367/371472 [8:13:12<20:09:45,  3.69it/s]
 28%|██▊       | 103368/371472 [8:13:12<20:20:50,  3.66it/s]
 28%|██▊       | 103369/371472 [8:13:12<19:30:12,  3.82it/s]
 28%|██▊       | 103370/371472 [8:13:13<19:44:07,  3.77it/s]
 28%|██▊       | 103371/371472 [8:13:13<19:50:26,  3.75it/s]
 28%|██▊       | 103372/371472 [8:13:13<19:34:52,  3.80it/s]
 28%|██▊       | 103373/371472 [8:13:13<19:47:36,  3.76it/s]
 28%|██▊       | 103374/371472 [8:13:14<19:53:56,  3.74it/s]
 28%|██▊       | 103375/371472 [8:13:14<20:12:46,  3.68it/s]
 28%|██▊       | 103376/371472 [8:13:14<20:23:02,  3.65it/s]
 28%|██▊       | 103377/371472 [8:13:14<19:26:28,  3.83it/s]
 28%|██▊       | 103378/371472 [8:13:15<20:03:15,  3.71it/s]
 28%|██▊       | 103379/371472 [8:13:15<20:34:25,  3.62it/s]
 28%|██▊       | 103380/371472 [8:13:15<20:42:25,  3.60it/s]
                                                            
{'loss': 3.6598, 'learning_rate': 7.498814885043848e-07, 'epoch': 4.45}

 28%|██▊       | 103380/371472 [8:13:15<20:42:25,  3.60it/s]
 28%|██▊       | 103381/371472 [8:13:16<21:46:58,  3.42it/s]
 28%|██▊       | 103382/371472 [8:13:16<23:40:11,  3.15it/s]
 28%|██▊       | 103383/371472 [8:13:16<22:22:01,  3.33it/s]
 28%|██▊       | 103384/371472 [8:13:17<22:48:46,  3.26it/s]
 28%|██▊       | 103385/371472 [8:13:17<21:25:07,  3.48it/s]
 28%|██▊       | 103386/371472 [8:13:17<21:07:24,  3.53it/s]
 28%|██▊       | 103387/371472 [8:13:17<20:27:40,  3.64it/s]
 28%|██▊       | 103388/371472 [8:13:18<20:51:34,  3.57it/s]
 28%|██▊       | 103389/371472 [8:13:18<21:39:18,  3.44it/s]
 28%|██▊       | 103390/371472 [8:13:18<26:04:19,  2.86it/s]
 28%|██▊       | 103391/371472 [8:13:19<24:27:59,  3.04it/s]
 28%|██▊       | 103392/371472 [8:13:19<22:33:19,  3.30it/s]
 28%|██▊       | 103393/371472 [8:13:19<21:54:10,  3.40it/s]
 28%|██▊       | 103394/371472 [8:13:19<21:20:40,  3.49it/s]
 28%|██▊       | 103395/371472 [8:13:20<22:58:53,  3.24it/s]
 28%|██▊       | 103396/371472 [8:13:20<22:07:06,  3.37it/s]
 28%|██▊       | 103397/371472 [8:13:20<21:58:39,  3.39it/s]
 28%|██▊       | 103398/371472 [8:13:21<21:33:54,  3.45it/s]
 28%|██▊       | 103399/371472 [8:13:21<21:09:53,  3.52it/s]
 28%|██▊       | 103400/371472 [8:13:21<22:04:37,  3.37it/s]
                                                            
{'loss': 3.5674, 'learning_rate': 7.49833006528906e-07, 'epoch': 4.45}

 28%|██▊       | 103400/371472 [8:13:21<22:04:37,  3.37it/s]
 28%|██▊       | 103401/371472 [8:13:22<21:31:20,  3.46it/s]
 28%|██▊       | 103402/371472 [8:13:22<21:31:43,  3.46it/s]
 28%|██▊       | 103403/371472 [8:13:22<21:18:58,  3.49it/s]
 28%|██▊       | 103404/371472 [8:13:22<21:11:31,  3.51it/s]
 28%|██▊       | 103405/371472 [8:13:23<20:38:01,  3.61it/s]
 28%|██▊       | 103406/371472 [8:13:23<20:59:28,  3.55it/s]
 28%|██▊       | 103407/371472 [8:13:23<22:11:37,  3.36it/s]
 28%|██▊       | 103408/371472 [8:13:24<21:28:02,  3.47it/s]
 28%|██▊       | 103409/371472 [8:13:24<21:22:17,  3.48it/s]
 28%|██▊       | 103410/371472 [8:13:24<22:52:32,  3.26it/s]
 28%|██▊       | 103411/371472 [8:13:24<22:04:55,  3.37it/s]
 28%|██▊       | 103412/371472 [8:13:25<22:03:55,  3.37it/s]
 28%|██▊       | 103413/371472 [8:13:25<21:09:03,  3.52it/s]
 28%|██▊       | 103414/371472 [8:13:25<20:58:08,  3.55it/s]
 28%|██▊       | 103415/371472 [8:13:26<20:26:06,  3.64it/s]
 28%|██▊       | 103416/371472 [8:13:26<20:46:04,  3.59it/s]
 28%|██▊       | 103417/371472 [8:13:26<20:35:02,  3.62it/s]
 28%|██▊       | 103418/371472 [8:13:26<21:37:24,  3.44it/s]
 28%|██▊       | 103419/371472 [8:13:27<21:46:40,  3.42it/s]
 28%|██▊       | 103420/371472 [8:13:27<21:21:23,  3.49it/s]
                                                            
{'loss': 3.402, 'learning_rate': 7.497845245534273e-07, 'epoch': 4.45}

 28%|██▊       | 103420/371472 [8:13:27<21:21:23,  3.49it/s]
 28%|██▊       | 103421/371472 [8:13:27<22:40:06,  3.28it/s]
 28%|██▊       | 103422/371472 [8:13:28<22:42:57,  3.28it/s]
 28%|██▊       | 103423/371472 [8:13:28<21:41:24,  3.43it/s]
 28%|██▊       | 103424/371472 [8:13:28<22:53:36,  3.25it/s]
 28%|██▊       | 103425/371472 [8:13:29<22:48:07,  3.27it/s]
 28%|██▊       | 103426/371472 [8:13:29<22:24:37,  3.32it/s]
 28%|██▊       | 103427/371472 [8:13:29<21:09:58,  3.52it/s]
 28%|██▊       | 103428/371472 [8:13:29<21:48:14,  3.41it/s]
 28%|██▊       | 103429/371472 [8:13:30<21:18:39,  3.49it/s]
 28%|██▊       | 103430/371472 [8:13:30<20:10:31,  3.69it/s]
 28%|██▊       | 103431/371472 [8:13:30<21:04:42,  3.53it/s]
 28%|██▊       | 103432/371472 [8:13:30<20:47:06,  3.58it/s]
 28%|██▊       | 103433/371472 [8:13:31<21:26:50,  3.47it/s]
 28%|██▊       | 103434/371472 [8:13:31<21:35:28,  3.45it/s]
 28%|██▊       | 103435/371472 [8:13:31<21:39:21,  3.44it/s]
 28%|██▊       | 103436/371472 [8:13:32<22:16:20,  3.34it/s]
 28%|██▊       | 103437/371472 [8:13:32<23:27:59,  3.17it/s]
 28%|██▊       | 103438/371472 [8:13:32<23:01:48,  3.23it/s]
 28%|██▊       | 103439/371472 [8:13:33<21:50:13,  3.41it/s]
 28%|██▊       | 103440/371472 [8:13:33<21:46:27,  3.42it/s]
                                                            
{'loss': 3.4623, 'learning_rate': 7.497360425779482e-07, 'epoch': 4.46}

 28%|██▊       | 103440/371472 [8:13:33<21:46:27,  3.42it/s]
 28%|██▊       | 103441/371472 [8:13:33<22:43:02,  3.28it/s]
 28%|██▊       | 103442/371472 [8:13:33<22:00:35,  3.38it/s]
 28%|██▊       | 103443/371472 [8:13:34<20:55:50,  3.56it/s]
 28%|██▊       | 103444/371472 [8:13:34<20:40:48,  3.60it/s]
 28%|██▊       | 103445/371472 [8:13:34<21:15:03,  3.50it/s]
 28%|██▊       | 103446/371472 [8:13:35<21:45:44,  3.42it/s]
 28%|██▊       | 103447/371472 [8:13:35<21:07:43,  3.52it/s]
 28%|██▊       | 103448/371472 [8:13:35<20:57:55,  3.55it/s]
 28%|██▊       | 103449/371472 [8:13:35<22:21:49,  3.33it/s]
 28%|██▊       | 103450/371472 [8:13:36<21:03:20,  3.54it/s]
 28%|██▊       | 103451/371472 [8:13:36<20:46:35,  3.58it/s]
 28%|██▊       | 103452/371472 [8:13:36<21:06:37,  3.53it/s]
 28%|██▊       | 103453/371472 [8:13:37<20:35:17,  3.62it/s]
 28%|██▊       | 103454/371472 [8:13:37<20:30:20,  3.63it/s]
 28%|██▊       | 103455/371472 [8:13:37<20:39:50,  3.60it/s]
 28%|██▊       | 103456/371472 [8:13:37<21:49:19,  3.41it/s]
 28%|██▊       | 103457/371472 [8:13:38<21:05:14,  3.53it/s]
 28%|██▊       | 103458/371472 [8:13:38<22:14:30,  3.35it/s]
 28%|██▊       | 103459/371472 [8:13:38<23:06:35,  3.22it/s]
 28%|██▊       | 103460/371472 [8:13:39<22:16:38,  3.34it/s]
                                                            
{'loss': 3.4413, 'learning_rate': 7.496875606024692e-07, 'epoch': 4.46}

 28%|██▊       | 103460/371472 [8:13:39<22:16:38,  3.34it/s]
 28%|██▊       | 103461/371472 [8:13:39<23:11:48,  3.21it/s]
 28%|██▊       | 103462/371472 [8:13:39<24:05:39,  3.09it/s]
 28%|██▊       | 103463/371472 [8:13:40<22:26:54,  3.32it/s]
 28%|██▊       | 103464/371472 [8:13:40<21:20:53,  3.49it/s]
 28%|██▊       | 103465/371472 [8:13:40<21:52:50,  3.40it/s]
 28%|██▊       | 103466/371472 [8:13:40<20:59:16,  3.55it/s]
 28%|██▊       | 103467/371472 [8:13:41<21:26:30,  3.47it/s]
 28%|██▊       | 103468/371472 [8:13:41<20:58:31,  3.55it/s]
 28%|██▊       | 103469/371472 [8:13:41<20:35:44,  3.61it/s]
 28%|██▊       | 103470/371472 [8:13:42<21:11:55,  3.51it/s]
 28%|██▊       | 103471/371472 [8:13:42<20:37:36,  3.61it/s]
 28%|██▊       | 103472/371472 [8:13:42<20:04:03,  3.71it/s]
 28%|██▊       | 103473/371472 [8:13:42<20:17:34,  3.67it/s]
 28%|██▊       | 103474/371472 [8:13:43<20:17:11,  3.67it/s]
 28%|██▊       | 103475/371472 [8:13:43<20:52:56,  3.56it/s]
 28%|██▊       | 103476/371472 [8:13:43<20:19:09,  3.66it/s]
 28%|██▊       | 103477/371472 [8:13:44<22:19:13,  3.34it/s]
 28%|██▊       | 103478/371472 [8:13:44<21:14:14,  3.51it/s]
 28%|██▊       | 103479/371472 [8:13:44<22:34:56,  3.30it/s]
 28%|██▊       | 103480/371472 [8:13:44<22:20:16,  3.33it/s]
                                                            
{'loss': 3.5012, 'learning_rate': 7.496390786269904e-07, 'epoch': 4.46}

 28%|██▊       | 103480/371472 [8:13:44<22:20:16,  3.33it/s]
 28%|██▊       | 103481/371472 [8:13:45<21:12:32,  3.51it/s]
 28%|██▊       | 103482/371472 [8:13:45<21:18:04,  3.49it/s]
 28%|██▊       | 103483/371472 [8:13:45<21:06:52,  3.53it/s]
 28%|██▊       | 103484/371472 [8:13:46<21:40:08,  3.44it/s]
 28%|██▊       | 103485/371472 [8:13:46<20:43:16,  3.59it/s]
 28%|██▊       | 103486/371472 [8:13:46<20:35:26,  3.62it/s]
 28%|██▊       | 103487/371472 [8:13:46<22:57:12,  3.24it/s]
 28%|██▊       | 103488/371472 [8:13:47<22:22:02,  3.33it/s]
 28%|██▊       | 103489/371472 [8:13:47<21:36:43,  3.44it/s]
 28%|██▊       | 103490/371472 [8:13:47<21:24:14,  3.48it/s]
 28%|██▊       | 103491/371472 [8:13:48<20:14:01,  3.68it/s]
 28%|██▊       | 103492/371472 [8:13:48<20:44:59,  3.59it/s]
 28%|██▊       | 103493/371472 [8:13:48<20:29:05,  3.63it/s]
 28%|██▊       | 103494/371472 [8:13:48<20:50:44,  3.57it/s]
 28%|██▊       | 103495/371472 [8:13:49<20:12:55,  3.68it/s]
 28%|██▊       | 103496/371472 [8:13:49<22:47:22,  3.27it/s]
 28%|██▊       | 103497/371472 [8:13:49<23:19:06,  3.19it/s]
 28%|██▊       | 103498/371472 [8:13:50<22:46:02,  3.27it/s]
 28%|██▊       | 103499/371472 [8:13:50<22:41:08,  3.28it/s]
 28%|██▊       | 103500/371472 [8:13:50<21:32:42,  3.45it/s]
                                                            
{'loss': 3.5767, 'learning_rate': 7.495905966515116e-07, 'epoch': 4.46}

 28%|██▊       | 103500/371472 [8:13:50<21:32:42,  3.45it/s]
 28%|██▊       | 103501/371472 [8:13:50<21:04:28,  3.53it/s]
 28%|██▊       | 103502/371472 [8:13:51<20:58:58,  3.55it/s]
 28%|██▊       | 103503/371472 [8:13:51<20:36:42,  3.61it/s]
 28%|██▊       | 103504/371472 [8:13:51<23:11:06,  3.21it/s]
 28%|██▊       | 103505/371472 [8:13:52<21:58:05,  3.39it/s]
 28%|██▊       | 103506/371472 [8:13:52<21:01:34,  3.54it/s]
 28%|██▊       | 103507/371472 [8:13:52<21:24:30,  3.48it/s]
 28%|██▊       | 103508/371472 [8:13:52<21:28:02,  3.47it/s]
 28%|██▊       | 103509/371472 [8:13:53<21:42:49,  3.43it/s]
 28%|██▊       | 103510/371472 [8:13:53<20:48:36,  3.58it/s]
 28%|██▊       | 103511/371472 [8:13:53<20:35:38,  3.61it/s]
 28%|██▊       | 103512/371472 [8:13:54<20:24:52,  3.65it/s]
 28%|██▊       | 103513/371472 [8:13:54<20:16:31,  3.67it/s]
 28%|██▊       | 103514/371472 [8:13:54<21:30:42,  3.46it/s]
 28%|██▊       | 103515/371472 [8:13:55<22:44:18,  3.27it/s]
 28%|██▊       | 103516/371472 [8:13:55<22:14:17,  3.35it/s]
 28%|██▊       | 103517/371472 [8:13:55<21:41:10,  3.43it/s]
 28%|██▊       | 103518/371472 [8:13:55<20:48:07,  3.58it/s]
 28%|██▊       | 103519/371472 [8:13:56<21:08:11,  3.52it/s]
 28%|██▊       | 103520/371472 [8:13:56<20:50:24,  3.57it/s]
                                                            
{'loss': 3.4629, 'learning_rate': 7.495421146760326e-07, 'epoch': 4.46}

 28%|██▊       | 103520/371472 [8:13:56<20:50:24,  3.57it/s]
 28%|██▊       | 103521/371472 [8:13:56<21:36:53,  3.44it/s]
 28%|██▊       | 103522/371472 [8:13:57<21:57:25,  3.39it/s]
 28%|██▊       | 103523/371472 [8:13:57<21:18:25,  3.49it/s]
 28%|██▊       | 103524/371472 [8:13:57<21:42:43,  3.43it/s]
 28%|██▊       | 103525/371472 [8:13:57<20:32:42,  3.62it/s]
 28%|██▊       | 103526/371472 [8:13:58<21:14:02,  3.51it/s]
 28%|██▊       | 103527/371472 [8:13:58<20:57:32,  3.55it/s]
 28%|██▊       | 103528/371472 [8:13:58<20:35:40,  3.61it/s]
 28%|██▊       | 103529/371472 [8:13:58<20:28:11,  3.64it/s]
 28%|██▊       | 103530/371472 [8:13:59<20:14:47,  3.68it/s]
 28%|██▊       | 103531/371472 [8:13:59<19:54:04,  3.74it/s]
 28%|██▊       | 103532/371472 [8:13:59<19:45:41,  3.77it/s]
 28%|██▊       | 103533/371472 [8:14:00<23:43:08,  3.14it/s]
 28%|██▊       | 103534/371472 [8:14:00<23:09:56,  3.21it/s]
 28%|██▊       | 103535/371472 [8:14:00<22:15:53,  3.34it/s]
 28%|██▊       | 103536/371472 [8:14:00<21:15:38,  3.50it/s]
 28%|██▊       | 103537/371472 [8:14:01<21:29:54,  3.46it/s]
 28%|██▊       | 103538/371472 [8:14:01<20:27:15,  3.64it/s]
 28%|██▊       | 103539/371472 [8:14:01<20:46:41,  3.58it/s]
 28%|██▊       | 103540/371472 [8:14:02<20:36:49,  3.61it/s]
                                                            
{'loss': 3.4782, 'learning_rate': 7.494936327005537e-07, 'epoch': 4.46}

 28%|██▊       | 103540/371472 [8:14:02<20:36:49,  3.61it/s]
 28%|██▊       | 103541/371472 [8:14:02<20:47:36,  3.58it/s]
 28%|██▊       | 103542/371472 [8:14:02<20:22:05,  3.65it/s]
 28%|██▊       | 103543/371472 [8:14:02<21:31:10,  3.46it/s]
 28%|██▊       | 103544/371472 [8:14:03<20:28:55,  3.63it/s]
 28%|██▊       | 103545/371472 [8:14:03<20:49:35,  3.57it/s]
 28%|██▊       | 103546/371472 [8:14:03<21:38:07,  3.44it/s]
 28%|██▊       | 103547/371472 [8:14:04<20:49:13,  3.57it/s]
 28%|██▊       | 103548/371472 [8:14:04<20:12:42,  3.68it/s]
 28%|██▊       | 103549/371472 [8:14:04<20:15:37,  3.67it/s]
 28%|██▊       | 103550/371472 [8:14:04<20:07:30,  3.70it/s]
 28%|██▊       | 103551/371472 [8:14:05<20:09:01,  3.69it/s]
 28%|██▊       | 103552/371472 [8:14:05<20:16:38,  3.67it/s]
 28%|██▊       | 103553/371472 [8:14:05<20:12:34,  3.68it/s]
 28%|██▊       | 103554/371472 [8:14:05<20:16:45,  3.67it/s]
 28%|██▊       | 103555/371472 [8:14:06<20:17:23,  3.67it/s]
 28%|██▊       | 103556/371472 [8:14:06<21:21:52,  3.48it/s]
 28%|██▊       | 103557/371472 [8:14:06<20:52:36,  3.56it/s]
 28%|██▊       | 103558/371472 [8:14:07<22:30:53,  3.31it/s]
 28%|██▊       | 103559/371472 [8:14:07<22:07:32,  3.36it/s]
 28%|██▊       | 103560/371472 [8:14:07<21:19:58,  3.49it/s]
                                                            
{'loss': 3.5955, 'learning_rate': 7.494451507250749e-07, 'epoch': 4.46}

 28%|██▊       | 103560/371472 [8:14:07<21:19:58,  3.49it/s]
 28%|██▊       | 103561/371472 [8:14:07<21:27:20,  3.47it/s]
 28%|██▊       | 103562/371472 [8:14:08<20:29:39,  3.63it/s]
 28%|██▊       | 103563/371472 [8:14:08<21:03:53,  3.53it/s]
 28%|██▊       | 103564/371472 [8:14:08<22:17:35,  3.34it/s]
 28%|██▊       | 103565/371472 [8:14:09<23:44:08,  3.14it/s]
 28%|██▊       | 103566/371472 [8:14:09<22:02:30,  3.38it/s]
 28%|██▊       | 103567/371472 [8:14:09<24:06:27,  3.09it/s]
 28%|██▊       | 103568/371472 [8:14:10<23:15:14,  3.20it/s]
 28%|██▊       | 103569/371472 [8:14:10<24:49:34,  3.00it/s]
 28%|██▊       | 103570/371472 [8:14:10<25:42:40,  2.89it/s]
 28%|██▊       | 103571/371472 [8:14:11<24:00:48,  3.10it/s]
 28%|██▊       | 103572/371472 [8:14:11<24:12:58,  3.07it/s]
 28%|██▊       | 103573/371472 [8:14:11<24:00:11,  3.10it/s]
 28%|██▊       | 103574/371472 [8:14:12<25:43:04,  2.89it/s]
 28%|██▊       | 103575/371472 [8:14:12<23:34:01,  3.16it/s]
 28%|██▊       | 103576/371472 [8:14:12<22:32:25,  3.30it/s]
 28%|██▊       | 103577/371472 [8:14:12<21:24:30,  3.48it/s]
 28%|██▊       | 103578/371472 [8:14:13<21:19:25,  3.49it/s]
 28%|██▊       | 103579/371472 [8:14:13<21:17:11,  3.50it/s]
 28%|██▊       | 103580/371472 [8:14:13<21:43:14,  3.43it/s]
                                                            
{'loss': 3.3298, 'learning_rate': 7.49396668749596e-07, 'epoch': 4.46}

 28%|██▊       | 103580/371472 [8:14:13<21:43:14,  3.43it/s]
 28%|██▊       | 103581/371472 [8:14:14<22:28:59,  3.31it/s]
 28%|██▊       | 103582/371472 [8:14:14<21:11:05,  3.51it/s]
 28%|██▊       | 103583/371472 [8:14:14<20:13:00,  3.68it/s]
 28%|██▊       | 103584/371472 [8:14:14<20:10:07,  3.69it/s]
 28%|██▊       | 103585/371472 [8:14:15<20:38:48,  3.60it/s]
 28%|██▊       | 103586/371472 [8:14:15<20:26:25,  3.64it/s]
 28%|██▊       | 103587/371472 [8:14:15<19:36:48,  3.79it/s]
 28%|██▊       | 103588/371472 [8:14:16<20:00:36,  3.72it/s]
 28%|██▊       | 103589/371472 [8:14:16<20:25:21,  3.64it/s]
 28%|██▊       | 103590/371472 [8:14:16<19:51:57,  3.75it/s]
 28%|██▊       | 103591/371472 [8:14:16<20:03:33,  3.71it/s]
 28%|██▊       | 103592/371472 [8:14:17<19:58:48,  3.72it/s]
 28%|██▊       | 103593/371472 [8:14:17<20:17:08,  3.67it/s]
 28%|██▊       | 103594/371472 [8:14:17<20:14:27,  3.68it/s]
 28%|██▊       | 103595/371472 [8:14:17<20:10:44,  3.69it/s]
 28%|██▊       | 103596/371472 [8:14:18<19:36:30,  3.79it/s]
 28%|██▊       | 103597/371472 [8:14:18<20:05:06,  3.70it/s]
 28%|██▊       | 103598/371472 [8:14:18<20:48:17,  3.58it/s]
 28%|██▊       | 103599/371472 [8:14:19<20:13:35,  3.68it/s]
 28%|██▊       | 103600/371472 [8:14:19<19:59:47,  3.72it/s]
                                                            
{'loss': 3.5234, 'learning_rate': 7.49348186774117e-07, 'epoch': 4.46}

 28%|██▊       | 103600/371472 [8:14:19<19:59:47,  3.72it/s]
 28%|██▊       | 103601/371472 [8:14:19<21:02:01,  3.54it/s]
 28%|██▊       | 103602/371472 [8:14:19<22:12:46,  3.35it/s]
 28%|██▊       | 103603/371472 [8:14:20<22:20:57,  3.33it/s]
 28%|██▊       | 103604/371472 [8:14:20<22:08:26,  3.36it/s]
 28%|██▊       | 103605/371472 [8:14:20<21:33:01,  3.45it/s]
 28%|██▊       | 103606/371472 [8:14:21<22:02:55,  3.37it/s]
 28%|██▊       | 103607/371472 [8:14:21<21:27:48,  3.47it/s]
 28%|██▊       | 103608/371472 [8:14:21<20:41:54,  3.59it/s]
 28%|██▊       | 103609/371472 [8:14:21<21:30:10,  3.46it/s]
 28%|██▊       | 103610/371472 [8:14:22<23:04:45,  3.22it/s]
 28%|██▊       | 103611/371472 [8:14:22<22:01:55,  3.38it/s]
 28%|██▊       | 103612/371472 [8:14:22<22:47:42,  3.26it/s]
 28%|██▊       | 103613/371472 [8:14:23<21:14:36,  3.50it/s]
 28%|██▊       | 103614/371472 [8:14:23<21:03:16,  3.53it/s]
 28%|██▊       | 103615/371472 [8:14:23<22:16:04,  3.34it/s]
 28%|██▊       | 103616/371472 [8:14:24<22:10:37,  3.35it/s]
 28%|██▊       | 103617/371472 [8:14:24<21:25:37,  3.47it/s]
 28%|██▊       | 103618/371472 [8:14:24<21:54:27,  3.40it/s]
 28%|██▊       | 103619/371472 [8:14:24<21:12:46,  3.51it/s]
 28%|██▊       | 103620/371472 [8:14:25<21:18:53,  3.49it/s]
                                                            
{'loss': 3.4356, 'learning_rate': 7.492997047986381e-07, 'epoch': 4.46}

 28%|██▊       | 103620/371472 [8:14:25<21:18:53,  3.49it/s]
 28%|██▊       | 103621/371472 [8:14:25<20:58:56,  3.55it/s]
 28%|██▊       | 103622/371472 [8:14:25<20:59:46,  3.54it/s]
 28%|██▊       | 103623/371472 [8:14:25<20:20:43,  3.66it/s]
 28%|██▊       | 103624/371472 [8:14:26<20:36:00,  3.61it/s]
 28%|██▊       | 103625/371472 [8:14:26<22:07:56,  3.36it/s]
 28%|██▊       | 103626/371472 [8:14:26<22:04:04,  3.37it/s]
 28%|██▊       | 103627/371472 [8:14:27<22:00:54,  3.38it/s]
 28%|██▊       | 103628/371472 [8:14:27<20:39:48,  3.60it/s]
 28%|██▊       | 103629/371472 [8:14:27<20:31:15,  3.63it/s]
 28%|██▊       | 103630/371472 [8:14:27<19:41:10,  3.78it/s]
 28%|██▊       | 103631/371472 [8:14:28<19:20:29,  3.85it/s]
 28%|██▊       | 103632/371472 [8:14:28<22:05:01,  3.37it/s]
 28%|██▊       | 103633/371472 [8:14:28<21:24:43,  3.47it/s]
 28%|██▊       | 103634/371472 [8:14:29<20:39:19,  3.60it/s]
 28%|██▊       | 103635/371472 [8:14:29<20:14:59,  3.67it/s]
 28%|██▊       | 103636/371472 [8:14:29<21:58:06,  3.39it/s]
 28%|██▊       | 103637/371472 [8:14:29<21:44:18,  3.42it/s]
 28%|██▊       | 103638/371472 [8:14:30<21:09:45,  3.52it/s]
 28%|██▊       | 103639/371472 [8:14:30<20:49:53,  3.57it/s]
 28%|██▊       | 103640/371472 [8:14:30<23:09:59,  3.21it/s]
                                                            
{'loss': 3.3151, 'learning_rate': 7.492512228231593e-07, 'epoch': 4.46}

 28%|██▊       | 103640/371472 [8:14:30<23:09:59,  3.21it/s]
 28%|██▊       | 103641/371472 [8:14:31<22:48:20,  3.26it/s]
 28%|██▊       | 103642/371472 [8:14:31<24:03:19,  3.09it/s]
 28%|██▊       | 103643/371472 [8:14:31<24:04:08,  3.09it/s]
 28%|██▊       | 103644/371472 [8:14:32<23:57:39,  3.10it/s]
 28%|██▊       | 103645/371472 [8:14:32<22:21:09,  3.33it/s]
 28%|██▊       | 103646/371472 [8:14:32<21:21:33,  3.48it/s]
 28%|██▊       | 103647/371472 [8:14:32<21:15:44,  3.50it/s]
 28%|██▊       | 103648/371472 [8:14:33<20:52:33,  3.56it/s]
 28%|██▊       | 103649/371472 [8:14:33<20:10:59,  3.69it/s]
 28%|██▊       | 103650/371472 [8:14:33<22:35:32,  3.29it/s]
 28%|██▊       | 103651/371472 [8:14:34<21:13:37,  3.50it/s]
 28%|██▊       | 103652/371472 [8:14:34<20:31:17,  3.63it/s]
 28%|██▊       | 103653/371472 [8:14:34<22:00:54,  3.38it/s]
 28%|██▊       | 103654/371472 [8:14:35<22:33:30,  3.30it/s]
 28%|██▊       | 103655/371472 [8:14:35<21:37:18,  3.44it/s]
 28%|██▊       | 103656/371472 [8:14:35<20:21:24,  3.65it/s]
 28%|██▊       | 103657/371472 [8:14:35<19:58:34,  3.72it/s]
 28%|██▊       | 103658/371472 [8:14:36<20:34:47,  3.61it/s]
 28%|██▊       | 103659/371472 [8:14:36<20:51:46,  3.57it/s]
 28%|██▊       | 103660/371472 [8:14:36<20:31:52,  3.62it/s]
                                                            
{'loss': 3.4003, 'learning_rate': 7.492027408476804e-07, 'epoch': 4.46}

 28%|██▊       | 103660/371472 [8:14:36<20:31:52,  3.62it/s]
 28%|██▊       | 103661/371472 [8:14:36<20:00:07,  3.72it/s]
 28%|██▊       | 103662/371472 [8:14:37<20:19:11,  3.66it/s]
 28%|██▊       | 103663/371472 [8:14:37<21:29:09,  3.46it/s]
 28%|██▊       | 103664/371472 [8:14:37<20:23:21,  3.65it/s]
 28%|██▊       | 103665/371472 [8:14:38<20:22:11,  3.65it/s]
 28%|██▊       | 103666/371472 [8:14:38<20:50:14,  3.57it/s]
 28%|██▊       | 103667/371472 [8:14:38<21:10:59,  3.51it/s]
 28%|██▊       | 103668/371472 [8:14:38<20:58:06,  3.55it/s]
 28%|██▊       | 103669/371472 [8:14:39<20:43:54,  3.59it/s]
 28%|██▊       | 103670/371472 [8:14:39<21:50:49,  3.41it/s]
 28%|██▊       | 103671/371472 [8:14:39<21:07:33,  3.52it/s]
 28%|██▊       | 103672/371472 [8:14:40<22:14:37,  3.34it/s]
 28%|██▊       | 103673/371472 [8:14:40<21:18:47,  3.49it/s]
 28%|██▊       | 103674/371472 [8:14:40<20:50:22,  3.57it/s]
 28%|██▊       | 103675/371472 [8:14:40<20:59:03,  3.54it/s]
 28%|██▊       | 103676/371472 [8:14:41<21:29:50,  3.46it/s]
 28%|██▊       | 103677/371472 [8:14:41<21:05:11,  3.53it/s]
 28%|██▊       | 103678/371472 [8:14:41<20:51:36,  3.57it/s]
 28%|██▊       | 103679/371472 [8:14:42<22:01:35,  3.38it/s]
 28%|██▊       | 103680/371472 [8:14:42<21:50:16,  3.41it/s]
                                                            
{'loss': 3.4551, 'learning_rate': 7.491542588722015e-07, 'epoch': 4.47}

 28%|██▊       | 103680/371472 [8:14:42<21:50:16,  3.41it/s]
 28%|██▊       | 103681/371472 [8:14:42<22:13:18,  3.35it/s]
 28%|██▊       | 103682/371472 [8:14:42<22:37:08,  3.29it/s]
 28%|██▊       | 103683/371472 [8:14:43<22:30:20,  3.31it/s]
 28%|██▊       | 103684/371472 [8:14:43<21:17:25,  3.49it/s]
 28%|██▊       | 103685/371472 [8:14:43<20:08:15,  3.69it/s]
 28%|██▊       | 103686/371472 [8:14:44<21:01:40,  3.54it/s]
 28%|██▊       | 103687/371472 [8:14:44<21:22:02,  3.48it/s]
 28%|██▊       | 103688/371472 [8:14:44<21:58:23,  3.39it/s]
 28%|██▊       | 103689/371472 [8:14:44<21:07:58,  3.52it/s]
 28%|██▊       | 103690/371472 [8:14:45<20:50:35,  3.57it/s]
 28%|██▊       | 103691/371472 [8:14:45<20:16:08,  3.67it/s]
 28%|██▊       | 103692/371472 [8:14:45<20:11:08,  3.68it/s]
 28%|██▊       | 103693/371472 [8:14:45<19:27:45,  3.82it/s]
 28%|██▊       | 103694/371472 [8:14:46<19:28:06,  3.82it/s]
 28%|██▊       | 103695/371472 [8:14:46<19:23:35,  3.84it/s]
 28%|██▊       | 103696/371472 [8:14:46<19:11:18,  3.88it/s]
 28%|██▊       | 103697/371472 [8:14:46<18:33:32,  4.01it/s]
 28%|██▊       | 103698/371472 [8:14:47<18:36:46,  4.00it/s]
 28%|██▊       | 103699/371472 [8:14:47<18:34:01,  4.01it/s]
 28%|██▊       | 103700/371472 [8:14:47<19:07:14,  3.89it/s]
                                                            
{'loss': 3.4606, 'learning_rate': 7.491057768967226e-07, 'epoch': 4.47}

 28%|██▊       | 103700/371472 [8:14:47<19:07:14,  3.89it/s]
 28%|██▊       | 103701/371472 [8:14:48<19:45:53,  3.76it/s]
 28%|██▊       | 103702/371472 [8:14:48<20:31:03,  3.63it/s]
 28%|██▊       | 103703/371472 [8:14:48<20:04:51,  3.70it/s]
 28%|██▊       | 103704/371472 [8:14:48<21:28:35,  3.46it/s]
 28%|██▊       | 103705/371472 [8:14:49<22:33:04,  3.30it/s]
 28%|██▊       | 103706/371472 [8:14:49<23:53:27,  3.11it/s]
 28%|██▊       | 103707/371472 [8:14:49<22:22:57,  3.32it/s]
 28%|██▊       | 103708/371472 [8:14:50<23:13:16,  3.20it/s]
 28%|██▊       | 103709/371472 [8:14:50<22:19:54,  3.33it/s]
 28%|██▊       | 103710/371472 [8:14:50<21:40:53,  3.43it/s]
 28%|██▊       | 103711/371472 [8:14:51<21:48:23,  3.41it/s]
 28%|██▊       | 103712/371472 [8:14:51<22:25:34,  3.32it/s]
 28%|██▊       | 103713/371472 [8:14:51<23:29:31,  3.17it/s]
 28%|██▊       | 103714/371472 [8:14:52<22:41:38,  3.28it/s]
 28%|██▊       | 103715/371472 [8:14:52<21:51:32,  3.40it/s]
 28%|██▊       | 103716/371472 [8:14:52<21:02:14,  3.54it/s]
 28%|██▊       | 103717/371472 [8:14:52<20:35:40,  3.61it/s]
 28%|██▊       | 103718/371472 [8:14:53<20:17:36,  3.67it/s]
 28%|██▊       | 103719/371472 [8:14:53<19:31:31,  3.81it/s]
 28%|██▊       | 103720/371472 [8:14:53<20:04:16,  3.71it/s]
                                                            
{'loss': 3.4888, 'learning_rate': 7.490572949212437e-07, 'epoch': 4.47}

 28%|██▊       | 103720/371472 [8:14:53<20:04:16,  3.71it/s]
 28%|██▊       | 103721/371472 [8:14:53<19:28:25,  3.82it/s]
 28%|██▊       | 103722/371472 [8:14:54<21:28:16,  3.46it/s]
 28%|██▊       | 103723/371472 [8:14:54<22:25:07,  3.32it/s]
 28%|██▊       | 103724/371472 [8:14:54<21:35:31,  3.44it/s]
 28%|██▊       | 103725/371472 [8:14:55<21:13:43,  3.50it/s]
 28%|██▊       | 103726/371472 [8:14:55<20:45:26,  3.58it/s]
 28%|██▊       | 103727/371472 [8:14:55<20:43:15,  3.59it/s]
 28%|██▊       | 103728/371472 [8:14:55<21:09:49,  3.51it/s]
 28%|██▊       | 103729/371472 [8:14:56<20:06:00,  3.70it/s]
 28%|██▊       | 103730/371472 [8:14:56<20:01:51,  3.71it/s]
 28%|██▊       | 103731/371472 [8:14:56<19:37:18,  3.79it/s]
 28%|██▊       | 103732/371472 [8:14:56<19:34:05,  3.80it/s]
 28%|██▊       | 103733/371472 [8:14:57<19:45:12,  3.76it/s]
 28%|██▊       | 103734/371472 [8:14:57<19:19:05,  3.85it/s]
 28%|██▊       | 103735/371472 [8:14:57<20:16:45,  3.67it/s]
 28%|██▊       | 103736/371472 [8:14:58<20:17:51,  3.66it/s]
 28%|██▊       | 103737/371472 [8:14:58<19:45:07,  3.77it/s]
 28%|██▊       | 103738/371472 [8:14:58<19:42:54,  3.77it/s]
 28%|██▊       | 103739/371472 [8:14:58<20:25:13,  3.64it/s]
 28%|██▊       | 103740/371472 [8:14:59<20:07:44,  3.69it/s]
                                                            
{'loss': 3.5808, 'learning_rate': 7.490088129457648e-07, 'epoch': 4.47}

 28%|██▊       | 103740/371472 [8:14:59<20:07:44,  3.69it/s]
 28%|██▊       | 103741/371472 [8:14:59<19:27:29,  3.82it/s]
 28%|██▊       | 103742/371472 [8:14:59<20:04:26,  3.70it/s]
 28%|██▊       | 103743/371472 [8:14:59<20:33:53,  3.62it/s]
 28%|██▊       | 103744/371472 [8:15:00<20:49:25,  3.57it/s]
 28%|██▊       | 103745/371472 [8:15:00<20:48:13,  3.57it/s]
 28%|██▊       | 103746/371472 [8:15:00<20:33:40,  3.62it/s]
 28%|██▊       | 103747/371472 [8:15:01<20:07:31,  3.70it/s]
 28%|██▊       | 103748/371472 [8:15:01<21:43:39,  3.42it/s]
 28%|██▊       | 103749/371472 [8:15:01<21:04:01,  3.53it/s]
 28%|██▊       | 103750/371472 [8:15:01<21:03:27,  3.53it/s]
 28%|██▊       | 103751/371472 [8:15:02<21:09:57,  3.51it/s]
 28%|██▊       | 103752/371472 [8:15:02<20:35:22,  3.61it/s]
 28%|██▊       | 103753/371472 [8:15:02<20:21:57,  3.65it/s]
 28%|██▊       | 103754/371472 [8:15:02<19:53:27,  3.74it/s]
 28%|██▊       | 103755/371472 [8:15:03<19:58:08,  3.72it/s]
 28%|██▊       | 103756/371472 [8:15:03<19:35:20,  3.80it/s]
 28%|██▊       | 103757/371472 [8:15:03<19:19:00,  3.85it/s]
 28%|██▊       | 103758/371472 [8:15:03<18:52:32,  3.94it/s]
 28%|██▊       | 103759/371472 [8:15:04<18:45:50,  3.96it/s]
 28%|██▊       | 103760/371472 [8:15:04<19:40:29,  3.78it/s]
                                                            
{'loss': 3.5023, 'learning_rate': 7.489603309702859e-07, 'epoch': 4.47}

 28%|██▊       | 103760/371472 [8:15:04<19:40:29,  3.78it/s]
 28%|██▊       | 103761/371472 [8:15:04<19:46:49,  3.76it/s]
 28%|██▊       | 103762/371472 [8:15:05<21:10:27,  3.51it/s]
 28%|██▊       | 103763/371472 [8:15:05<21:46:06,  3.42it/s]
 28%|██▊       | 103764/371472 [8:15:05<21:53:02,  3.40it/s]
 28%|██▊       | 103765/371472 [8:15:06<21:46:20,  3.42it/s]
 28%|██▊       | 103766/371472 [8:15:06<20:39:57,  3.60it/s]
 28%|██▊       | 103767/371472 [8:15:06<21:46:16,  3.42it/s]
 28%|██▊       | 103768/371472 [8:15:06<20:56:18,  3.55it/s]
 28%|██▊       | 103769/371472 [8:15:07<21:29:42,  3.46it/s]
 28%|██▊       | 103770/371472 [8:15:07<22:19:26,  3.33it/s]
 28%|██▊       | 103771/371472 [8:15:07<21:57:35,  3.39it/s]
 28%|██▊       | 103772/371472 [8:15:08<21:24:00,  3.47it/s]
 28%|██▊       | 103773/371472 [8:15:08<20:59:31,  3.54it/s]
 28%|██▊       | 103774/371472 [8:15:08<20:29:05,  3.63it/s]
 28%|██▊       | 103775/371472 [8:15:08<21:29:30,  3.46it/s]
 28%|██▊       | 103776/371472 [8:15:09<21:19:25,  3.49it/s]
 28%|██▊       | 103777/371472 [8:15:09<20:12:48,  3.68it/s]
 28%|██▊       | 103778/371472 [8:15:09<19:55:54,  3.73it/s]
 28%|██▊       | 103779/371472 [8:15:09<19:45:43,  3.76it/s]
 28%|██▊       | 103780/371472 [8:15:10<19:35:01,  3.80it/s]
                                                            
{'loss': 3.4667, 'learning_rate': 7.48911848994807e-07, 'epoch': 4.47}

 28%|██▊       | 103780/371472 [8:15:10<19:35:01,  3.80it/s]
 28%|██▊       | 103781/371472 [8:15:10<19:06:55,  3.89it/s]
 28%|██▊       | 103782/371472 [8:15:10<18:50:36,  3.95it/s]
 28%|██▊       | 103783/371472 [8:15:10<19:09:42,  3.88it/s]
 28%|██▊       | 103784/371472 [8:15:11<19:49:32,  3.75it/s]
 28%|██▊       | 103785/371472 [8:15:11<19:25:00,  3.83it/s]
 28%|██▊       | 103786/371472 [8:15:11<19:39:13,  3.78it/s]
 28%|██▊       | 103787/371472 [8:15:12<21:08:34,  3.52it/s]
 28%|██▊       | 103788/371472 [8:15:12<20:37:15,  3.61it/s]
 28%|██▊       | 103789/371472 [8:15:12<21:24:43,  3.47it/s]
 28%|██▊       | 103790/371472 [8:15:12<21:25:45,  3.47it/s]
 28%|██▊       | 103791/371472 [8:15:13<20:58:04,  3.55it/s]
 28%|██▊       | 103792/371472 [8:15:13<20:59:15,  3.54it/s]
 28%|██▊       | 103793/371472 [8:15:13<22:07:18,  3.36it/s]
 28%|██▊       | 103794/371472 [8:15:14<23:16:02,  3.20it/s]
 28%|██▊       | 103795/371472 [8:15:14<22:05:49,  3.36it/s]
 28%|██▊       | 103796/371472 [8:15:14<21:28:12,  3.46it/s]
 28%|██▊       | 103797/371472 [8:15:14<21:03:00,  3.53it/s]
 28%|██▊       | 103798/371472 [8:15:15<20:19:48,  3.66it/s]
 28%|██▊       | 103799/371472 [8:15:15<20:54:51,  3.56it/s]
 28%|██▊       | 103800/371472 [8:15:15<20:27:02,  3.64it/s]
                                                            
{'loss': 3.421, 'learning_rate': 7.488633670193282e-07, 'epoch': 4.47}

 28%|██▊       | 103800/371472 [8:15:15<20:27:02,  3.64it/s]
 28%|██▊       | 103801/371472 [8:15:16<21:05:30,  3.53it/s]
 28%|██▊       | 103802/371472 [8:15:16<20:10:38,  3.68it/s]
 28%|██▊       | 103803/371472 [8:15:16<21:37:56,  3.44it/s]
 28%|██▊       | 103804/371472 [8:15:16<20:41:52,  3.59it/s]
 28%|██▊       | 103805/371472 [8:15:17<21:02:56,  3.53it/s]
 28%|██▊       | 103806/371472 [8:15:17<20:16:10,  3.67it/s]
 28%|██▊       | 103807/371472 [8:15:17<19:52:41,  3.74it/s]
 28%|██▊       | 103808/371472 [8:15:17<20:21:07,  3.65it/s]
 28%|██▊       | 103809/371472 [8:15:18<19:26:56,  3.82it/s]
 28%|██▊       | 103810/371472 [8:15:18<21:19:08,  3.49it/s]
 28%|██▊       | 103811/371472 [8:15:18<21:52:27,  3.40it/s]
 28%|██▊       | 103812/371472 [8:15:19<21:31:12,  3.45it/s]
 28%|██▊       | 103813/371472 [8:15:19<21:30:03,  3.46it/s]
 28%|██▊       | 103814/371472 [8:15:19<22:30:03,  3.30it/s]
 28%|██▊       | 103815/371472 [8:15:20<21:19:42,  3.49it/s]
 28%|██▊       | 103816/371472 [8:15:20<23:29:41,  3.16it/s]
 28%|██▊       | 103817/371472 [8:15:20<24:11:47,  3.07it/s]
 28%|██▊       | 103818/371472 [8:15:20<22:17:28,  3.34it/s]
 28%|██▊       | 103819/371472 [8:15:21<22:59:09,  3.23it/s]
 28%|██▊       | 103820/371472 [8:15:21<22:00:40,  3.38it/s]
                                                            
{'loss': 3.4601, 'learning_rate': 7.488148850438493e-07, 'epoch': 4.47}

 28%|██▊       | 103820/371472 [8:15:21<22:00:40,  3.38it/s]
 28%|██▊       | 103821/371472 [8:15:21<22:05:07,  3.37it/s]
 28%|██▊       | 103822/371472 [8:15:22<22:21:00,  3.33it/s]
 28%|██▊       | 103823/371472 [8:15:22<22:26:22,  3.31it/s]
 28%|██▊       | 103824/371472 [8:15:22<22:10:51,  3.35it/s]
 28%|██▊       | 103825/371472 [8:15:23<21:46:04,  3.42it/s]
 28%|██▊       | 103826/371472 [8:15:23<23:13:24,  3.20it/s]
 28%|██▊       | 103827/371472 [8:15:23<22:13:24,  3.35it/s]
 28%|██▊       | 103828/371472 [8:15:24<22:49:57,  3.26it/s]
 28%|██▊       | 103829/371472 [8:15:24<21:26:01,  3.47it/s]
 28%|██▊       | 103830/371472 [8:15:24<20:33:49,  3.62it/s]
 28%|██▊       | 103831/371472 [8:15:24<20:59:45,  3.54it/s]
 28%|██▊       | 103832/371472 [8:15:25<20:28:15,  3.63it/s]
 28%|██▊       | 103833/371472 [8:15:25<20:20:57,  3.65it/s]
 28%|██▊       | 103834/371472 [8:15:25<20:16:17,  3.67it/s]
 28%|██▊       | 103835/371472 [8:15:25<20:28:50,  3.63it/s]
 28%|██▊       | 103836/371472 [8:15:26<24:48:47,  3.00it/s]
 28%|██▊       | 103837/371472 [8:15:26<26:17:24,  2.83it/s]
 28%|██▊       | 103838/371472 [8:15:27<23:55:12,  3.11it/s]
 28%|██▊       | 103839/371472 [8:15:27<22:44:29,  3.27it/s]
 28%|██▊       | 103840/371472 [8:15:27<22:19:07,  3.33it/s]
                                                            
{'loss': 3.4548, 'learning_rate': 7.487664030683703e-07, 'epoch': 4.47}

 28%|██▊       | 103840/371472 [8:15:27<22:19:07,  3.33it/s]
 28%|██▊       | 103841/371472 [8:15:27<21:27:49,  3.46it/s]
 28%|██▊       | 103842/371472 [8:15:28<23:16:44,  3.19it/s]
 28%|██▊       | 103843/371472 [8:15:28<22:24:08,  3.32it/s]
 28%|██▊       | 103844/371472 [8:15:28<21:47:37,  3.41it/s]
 28%|██▊       | 103845/371472 [8:15:29<22:13:24,  3.35it/s]
 28%|██▊       | 103846/371472 [8:15:29<21:17:00,  3.49it/s]
 28%|██▊       | 103847/371472 [8:15:29<20:40:43,  3.60it/s]
 28%|██▊       | 103848/371472 [8:15:29<22:00:09,  3.38it/s]
 28%|██▊       | 103849/371472 [8:15:30<21:57:08,  3.39it/s]
 28%|██▊       | 103850/371472 [8:15:30<21:13:32,  3.50it/s]
 28%|██▊       | 103851/371472 [8:15:30<20:43:38,  3.59it/s]
 28%|██▊       | 103852/371472 [8:15:31<20:24:23,  3.64it/s]
 28%|██▊       | 103853/371472 [8:15:31<20:08:43,  3.69it/s]
 28%|██▊       | 103854/371472 [8:15:31<20:14:12,  3.67it/s]
 28%|██▊       | 103855/371472 [8:15:31<20:44:42,  3.58it/s]
 28%|██▊       | 103856/371472 [8:15:32<21:29:09,  3.46it/s]
 28%|██▊       | 103857/371472 [8:15:32<20:49:42,  3.57it/s]
 28%|██▊       | 103858/371472 [8:15:32<20:25:03,  3.64it/s]
 28%|██▊       | 103859/371472 [8:15:32<19:55:09,  3.73it/s]
 28%|██▊       | 103860/371472 [8:15:33<20:29:37,  3.63it/s]
                                                            
{'loss': 3.4377, 'learning_rate': 7.487179210928914e-07, 'epoch': 4.47}

 28%|██▊       | 103860/371472 [8:15:33<20:29:37,  3.63it/s]
 28%|██▊       | 103861/371472 [8:15:33<20:52:35,  3.56it/s]
 28%|██▊       | 103862/371472 [8:15:33<22:21:49,  3.32it/s]
 28%|██▊       | 103863/371472 [8:15:34<22:30:33,  3.30it/s]
 28%|██▊       | 103864/371472 [8:15:34<23:04:34,  3.22it/s]
 28%|██▊       | 103865/371472 [8:15:34<22:44:03,  3.27it/s]
 28%|██▊       | 103866/371472 [8:15:35<22:02:18,  3.37it/s]
 28%|██▊       | 103867/371472 [8:15:35<21:59:02,  3.38it/s]
 28%|██▊       | 103868/371472 [8:15:35<21:05:27,  3.52it/s]
 28%|██▊       | 103869/371472 [8:15:35<22:05:17,  3.37it/s]
 28%|██▊       | 103870/371472 [8:15:36<22:30:01,  3.30it/s]
 28%|██▊       | 103871/371472 [8:15:36<21:59:36,  3.38it/s]
 28%|██▊       | 103872/371472 [8:15:36<21:07:19,  3.52it/s]
 28%|██▊       | 103873/371472 [8:15:37<20:49:43,  3.57it/s]
 28%|██▊       | 103874/371472 [8:15:37<20:25:46,  3.64it/s]
 28%|██▊       | 103875/371472 [8:15:37<21:44:42,  3.42it/s]
 28%|██▊       | 103876/371472 [8:15:37<20:36:33,  3.61it/s]
 28%|██▊       | 103877/371472 [8:15:38<21:03:37,  3.53it/s]
 28%|██▊       | 103878/371472 [8:15:38<19:56:35,  3.73it/s]
 28%|██▊       | 103879/371472 [8:15:38<19:38:04,  3.79it/s]
 28%|██▊       | 103880/371472 [8:15:39<20:53:09,  3.56it/s]
                                                            
{'loss': 3.2797, 'learning_rate': 7.486694391174126e-07, 'epoch': 4.47}

 28%|██▊       | 103880/371472 [8:15:39<20:53:09,  3.56it/s]
 28%|██▊       | 103881/371472 [8:15:39<20:33:49,  3.61it/s]
 28%|██▊       | 103882/371472 [8:15:39<21:12:08,  3.51it/s]
 28%|██▊       | 103883/371472 [8:15:39<20:48:01,  3.57it/s]
 28%|██▊       | 103884/371472 [8:15:40<20:14:29,  3.67it/s]
 28%|██▊       | 103885/371472 [8:15:40<20:02:31,  3.71it/s]
 28%|██▊       | 103886/371472 [8:15:40<19:42:22,  3.77it/s]
 28%|██▊       | 103887/371472 [8:15:40<19:25:41,  3.83it/s]
 28%|██▊       | 103888/371472 [8:15:41<20:31:52,  3.62it/s]
 28%|██▊       | 103889/371472 [8:15:41<20:14:07,  3.67it/s]
 28%|██▊       | 103890/371472 [8:15:41<20:14:59,  3.67it/s]
 28%|██▊       | 103891/371472 [8:15:41<19:31:57,  3.81it/s]
 28%|██▊       | 103892/371472 [8:15:42<20:28:02,  3.63it/s]
 28%|██▊       | 103893/371472 [8:15:42<20:14:22,  3.67it/s]
 28%|██▊       | 103894/371472 [8:15:42<19:34:56,  3.80it/s]
 28%|██▊       | 103895/371472 [8:15:43<19:46:30,  3.76it/s]
 28%|██▊       | 103896/371472 [8:15:43<21:27:10,  3.46it/s]
 28%|██▊       | 103897/371472 [8:15:43<21:07:24,  3.52it/s]
 28%|██▊       | 103898/371472 [8:15:43<21:23:40,  3.47it/s]
 28%|██▊       | 103899/371472 [8:15:44<20:27:53,  3.63it/s]
 28%|██▊       | 103900/371472 [8:15:44<20:01:22,  3.71it/s]
                                                            
{'loss': 3.6023, 'learning_rate': 7.486209571419336e-07, 'epoch': 4.48}

 28%|██▊       | 103900/371472 [8:15:44<20:01:22,  3.71it/s]
 28%|██▊       | 103901/371472 [8:15:44<19:40:57,  3.78it/s]
 28%|██▊       | 103902/371472 [8:15:44<19:48:34,  3.75it/s]
 28%|██▊       | 103903/371472 [8:15:45<21:06:17,  3.52it/s]
 28%|██▊       | 103904/371472 [8:15:45<21:00:37,  3.54it/s]
 28%|██▊       | 103905/371472 [8:15:45<22:25:48,  3.31it/s]
 28%|██▊       | 103906/371472 [8:15:46<23:16:30,  3.19it/s]
 28%|██▊       | 103907/371472 [8:15:46<22:03:23,  3.37it/s]
 28%|██▊       | 103908/371472 [8:15:46<23:35:55,  3.15it/s]
 28%|██▊       | 103909/371472 [8:15:47<22:30:08,  3.30it/s]
 28%|██▊       | 103910/371472 [8:15:47<23:18:58,  3.19it/s]
 28%|██▊       | 103911/371472 [8:15:47<23:01:02,  3.23it/s]
 28%|██▊       | 103912/371472 [8:15:48<23:17:39,  3.19it/s]
 28%|██▊       | 103913/371472 [8:15:48<22:27:29,  3.31it/s]
 28%|██▊       | 103914/371472 [8:15:48<22:05:51,  3.36it/s]
 28%|██▊       | 103915/371472 [8:15:49<24:17:09,  3.06it/s]
 28%|██▊       | 103916/371472 [8:15:49<25:12:26,  2.95it/s]
 28%|██▊       | 103917/371472 [8:15:49<23:09:59,  3.21it/s]
 28%|██▊       | 103918/371472 [8:15:49<21:44:19,  3.42it/s]
 28%|██▊       | 103919/371472 [8:15:50<20:47:13,  3.58it/s]
 28%|██▊       | 103920/371472 [8:15:50<21:03:14,  3.53it/s]
                                                            
{'loss': 3.3117, 'learning_rate': 7.485724751664547e-07, 'epoch': 4.48}

 28%|██▊       | 103920/371472 [8:15:50<21:03:14,  3.53it/s]
 28%|██▊       | 103921/371472 [8:15:50<20:18:44,  3.66it/s]
 28%|██▊       | 103922/371472 [8:15:50<20:02:06,  3.71it/s]
 28%|██▊       | 103923/371472 [8:15:51<20:18:07,  3.66it/s]
 28%|██▊       | 103924/371472 [8:15:51<20:21:45,  3.65it/s]
 28%|██▊       | 103925/371472 [8:15:51<20:20:25,  3.65it/s]
 28%|██▊       | 103926/371472 [8:15:52<20:12:06,  3.68it/s]
 28%|██▊       | 103927/371472 [8:15:52<20:01:41,  3.71it/s]
 28%|██▊       | 103928/371472 [8:15:52<20:38:39,  3.60it/s]
 28%|██▊       | 103929/371472 [8:15:52<19:58:01,  3.72it/s]
 28%|██▊       | 103930/371472 [8:15:53<22:20:32,  3.33it/s]
 28%|██▊       | 103931/371472 [8:15:53<22:39:15,  3.28it/s]
 28%|██▊       | 103932/371472 [8:15:53<21:23:50,  3.47it/s]
 28%|██▊       | 103933/371472 [8:15:54<20:53:47,  3.56it/s]
 28%|██▊       | 103934/371472 [8:15:54<20:57:18,  3.55it/s]
 28%|██▊       | 103935/371472 [8:15:54<21:52:13,  3.40it/s]
 28%|██▊       | 103936/371472 [8:15:54<21:17:24,  3.49it/s]
 28%|██▊       | 103937/371472 [8:15:55<21:29:48,  3.46it/s]
 28%|██▊       | 103938/371472 [8:15:55<20:29:28,  3.63it/s]
 28%|██▊       | 103939/371472 [8:15:55<20:09:15,  3.69it/s]
 28%|██▊       | 103940/371472 [8:15:56<19:30:56,  3.81it/s]
                                                            
{'loss': 3.352, 'learning_rate': 7.485239931909759e-07, 'epoch': 4.48}

 28%|██▊       | 103940/371472 [8:15:56<19:30:56,  3.81it/s]
 28%|██▊       | 103941/371472 [8:15:56<19:20:18,  3.84it/s]
 28%|██▊       | 103942/371472 [8:15:56<19:00:05,  3.91it/s]
 28%|██▊       | 103943/371472 [8:15:56<19:45:47,  3.76it/s]
 28%|██▊       | 103944/371472 [8:15:57<21:07:05,  3.52it/s]
 28%|██▊       | 103945/371472 [8:15:57<21:28:03,  3.46it/s]
 28%|██▊       | 103946/371472 [8:15:57<20:25:59,  3.64it/s]
 28%|██▊       | 103947/371472 [8:15:57<19:58:56,  3.72it/s]
 28%|██▊       | 103948/371472 [8:15:58<22:39:52,  3.28it/s]
 28%|██▊       | 103949/371472 [8:15:58<22:24:38,  3.32it/s]
 28%|██▊       | 103950/371472 [8:15:58<22:29:46,  3.30it/s]
 28%|██▊       | 103951/371472 [8:15:59<22:05:10,  3.36it/s]
 28%|██▊       | 103952/371472 [8:15:59<21:45:05,  3.42it/s]
 28%|██▊       | 103953/371472 [8:15:59<20:39:05,  3.60it/s]
 28%|██▊       | 103954/371472 [8:16:00<20:27:58,  3.63it/s]
 28%|██▊       | 103955/371472 [8:16:00<20:31:10,  3.62it/s]
 28%|██▊       | 103956/371472 [8:16:00<19:56:19,  3.73it/s]
 28%|██▊       | 103957/371472 [8:16:00<20:09:18,  3.69it/s]
 28%|██▊       | 103958/371472 [8:16:01<21:17:36,  3.49it/s]
 28%|██▊       | 103959/371472 [8:16:01<21:34:33,  3.44it/s]
 28%|██▊       | 103960/371472 [8:16:01<21:32:49,  3.45it/s]
                                                            
{'loss': 3.6262, 'learning_rate': 7.484755112154969e-07, 'epoch': 4.48}

 28%|██▊       | 103960/371472 [8:16:01<21:32:49,  3.45it/s]
 28%|██▊       | 103961/371472 [8:16:02<22:04:28,  3.37it/s]
 28%|██▊       | 103962/371472 [8:16:02<22:05:56,  3.36it/s]
 28%|██▊       | 103963/371472 [8:16:02<20:50:02,  3.57it/s]
 28%|██▊       | 103964/371472 [8:16:02<21:10:06,  3.51it/s]
 28%|██▊       | 103965/371472 [8:16:03<21:48:11,  3.41it/s]
 28%|██▊       | 103966/371472 [8:16:03<20:35:46,  3.61it/s]
 28%|██▊       | 103967/371472 [8:16:03<20:36:30,  3.61it/s]
 28%|██▊       | 103968/371472 [8:16:03<20:36:11,  3.61it/s]
 28%|██▊       | 103969/371472 [8:16:04<21:21:02,  3.48it/s]
 28%|██▊       | 103970/371472 [8:16:04<21:14:04,  3.50it/s]
 28%|██▊       | 103971/371472 [8:16:04<20:33:53,  3.61it/s]
 28%|██▊       | 103972/371472 [8:16:05<20:23:19,  3.64it/s]
 28%|██▊       | 103973/371472 [8:16:05<22:02:22,  3.37it/s]
 28%|██▊       | 103974/371472 [8:16:05<21:37:07,  3.44it/s]
 28%|██▊       | 103975/371472 [8:16:05<20:33:48,  3.61it/s]
 28%|██▊       | 103976/371472 [8:16:06<20:26:05,  3.64it/s]
 28%|██▊       | 103977/371472 [8:16:06<19:53:44,  3.73it/s]
 28%|██▊       | 103978/371472 [8:16:06<19:37:56,  3.78it/s]
 28%|██▊       | 103979/371472 [8:16:07<19:54:48,  3.73it/s]
 28%|██▊       | 103980/371472 [8:16:07<19:35:36,  3.79it/s]
                                                            
{'loss': 3.3985, 'learning_rate': 7.48427029240018e-07, 'epoch': 4.48}

 28%|██▊       | 103980/371472 [8:16:07<19:35:36,  3.79it/s]
 28%|██▊       | 103981/371472 [8:16:07<19:39:50,  3.78it/s]
 28%|██▊       | 103982/371472 [8:16:07<20:12:28,  3.68it/s]
 28%|██▊       | 103983/371472 [8:16:08<21:57:28,  3.38it/s]
 28%|██▊       | 103984/371472 [8:16:08<21:20:19,  3.48it/s]
 28%|██▊       | 103985/371472 [8:16:08<20:59:53,  3.54it/s]
 28%|██▊       | 103986/371472 [8:16:08<20:14:14,  3.67it/s]
 28%|██▊       | 103987/371472 [8:16:09<21:07:46,  3.52it/s]
 28%|██▊       | 103988/371472 [8:16:09<20:26:16,  3.64it/s]
 28%|██▊       | 103989/371472 [8:16:09<19:27:43,  3.82it/s]
 28%|██▊       | 103990/371472 [8:16:10<19:12:02,  3.87it/s]
 28%|██▊       | 103991/371472 [8:16:10<19:32:58,  3.80it/s]
 28%|██▊       | 103992/371472 [8:16:10<25:51:18,  2.87it/s]
 28%|██▊       | 103993/371472 [8:16:11<24:23:11,  3.05it/s]
 28%|██▊       | 103994/371472 [8:16:11<23:43:05,  3.13it/s]
 28%|██▊       | 103995/371472 [8:16:11<22:42:51,  3.27it/s]
 28%|██▊       | 103996/371472 [8:16:11<21:43:35,  3.42it/s]
 28%|██▊       | 103997/371472 [8:16:12<21:16:22,  3.49it/s]
 28%|██▊       | 103998/371472 [8:16:12<21:14:38,  3.50it/s]
 28%|██▊       | 103999/371472 [8:16:12<21:58:07,  3.38it/s]
 28%|██▊       | 104000/371472 [8:16:13<23:44:44,  3.13it/s]
                                                            
{'loss': 3.5367, 'learning_rate': 7.483785472645391e-07, 'epoch': 4.48}

 28%|██▊       | 104000/371472 [8:16:13<23:44:44,  3.13it/s]
 28%|██▊       | 104001/371472 [8:16:13<23:21:50,  3.18it/s]
 28%|██▊       | 104002/371472 [8:16:13<21:51:46,  3.40it/s]
 28%|██▊       | 104003/371472 [8:16:14<22:13:15,  3.34it/s]
 28%|██▊       | 104004/371472 [8:16:14<21:58:58,  3.38it/s]
 28%|██▊       | 104005/371472 [8:16:14<21:44:02,  3.42it/s]
 28%|██▊       | 104006/371472 [8:16:14<20:38:47,  3.60it/s]
 28%|██▊       | 104007/371472 [8:16:15<20:39:03,  3.60it/s]
 28%|██▊       | 104008/371472 [8:16:15<21:41:14,  3.43it/s]
 28%|██▊       | 104009/371472 [8:16:15<20:55:51,  3.55it/s]
 28%|██▊       | 104010/371472 [8:16:16<20:25:42,  3.64it/s]
 28%|██▊       | 104011/371472 [8:16:16<19:31:18,  3.81it/s]
 28%|██▊       | 104012/371472 [8:16:16<19:48:14,  3.75it/s]
 28%|██▊       | 104013/371472 [8:16:16<19:48:46,  3.75it/s]
 28%|██▊       | 104014/371472 [8:16:17<20:36:31,  3.60it/s]
 28%|██▊       | 104015/371472 [8:16:17<20:15:49,  3.67it/s]
 28%|██▊       | 104016/371472 [8:16:17<20:57:57,  3.54it/s]
 28%|██▊       | 104017/371472 [8:16:17<20:23:44,  3.64it/s]
 28%|██▊       | 104018/371472 [8:16:18<19:37:28,  3.79it/s]
 28%|██▊       | 104019/371472 [8:16:18<19:52:06,  3.74it/s]
 28%|██▊       | 104020/371472 [8:16:18<20:04:30,  3.70it/s]
                                                            
{'loss': 3.353, 'learning_rate': 7.483300652890603e-07, 'epoch': 4.48}

 28%|██▊       | 104020/371472 [8:16:18<20:04:30,  3.70it/s]
 28%|██▊       | 104021/371472 [8:16:18<20:27:56,  3.63it/s]
 28%|██▊       | 104022/371472 [8:16:19<19:55:37,  3.73it/s]
 28%|██▊       | 104023/371472 [8:16:19<20:04:29,  3.70it/s]
 28%|██▊       | 104024/371472 [8:16:19<20:19:04,  3.66it/s]
 28%|██▊       | 104025/371472 [8:16:20<20:20:00,  3.65it/s]
 28%|██▊       | 104026/371472 [8:16:20<20:38:30,  3.60it/s]
 28%|██▊       | 104027/371472 [8:16:20<20:24:08,  3.64it/s]
 28%|██▊       | 104028/371472 [8:16:20<20:34:43,  3.61it/s]
 28%|██▊       | 104029/371472 [8:16:21<20:18:58,  3.66it/s]
 28%|██▊       | 104030/371472 [8:16:21<19:41:57,  3.77it/s]
 28%|██▊       | 104031/371472 [8:16:21<20:17:15,  3.66it/s]
 28%|██▊       | 104032/371472 [8:16:22<21:34:57,  3.44it/s]
 28%|██▊       | 104033/371472 [8:16:22<21:14:04,  3.50it/s]
 28%|██▊       | 104034/371472 [8:16:22<20:35:19,  3.61it/s]
 28%|██▊       | 104035/371472 [8:16:22<20:27:27,  3.63it/s]
 28%|██▊       | 104036/371472 [8:16:23<20:04:12,  3.70it/s]
 28%|██▊       | 104037/371472 [8:16:23<19:40:13,  3.78it/s]
 28%|██▊       | 104038/371472 [8:16:23<19:27:11,  3.82it/s]
 28%|██▊       | 104039/371472 [8:16:23<20:57:36,  3.54it/s]
 28%|██▊       | 104040/371472 [8:16:24<21:24:41,  3.47it/s]
                                                            
{'loss': 3.5371, 'learning_rate': 7.482815833135814e-07, 'epoch': 4.48}

 28%|██▊       | 104040/371472 [8:16:24<21:24:41,  3.47it/s]
 28%|██▊       | 104041/371472 [8:16:24<21:23:19,  3.47it/s]
 28%|██▊       | 104042/371472 [8:16:24<20:26:14,  3.63it/s]
 28%|██▊       | 104043/371472 [8:16:25<20:51:06,  3.56it/s]
 28%|██▊       | 104044/371472 [8:16:25<20:41:03,  3.59it/s]
 28%|██▊       | 104045/371472 [8:16:25<22:29:08,  3.30it/s]
 28%|██▊       | 104046/371472 [8:16:25<21:10:59,  3.51it/s]
 28%|██▊       | 104047/371472 [8:16:26<21:31:10,  3.45it/s]
 28%|██▊       | 104048/371472 [8:16:26<21:05:16,  3.52it/s]
 28%|██▊       | 104049/371472 [8:16:26<20:10:26,  3.68it/s]
 28%|██▊       | 104050/371472 [8:16:27<20:36:00,  3.61it/s]
 28%|██▊       | 104051/371472 [8:16:27<21:34:27,  3.44it/s]
 28%|██▊       | 104052/371472 [8:16:27<21:33:39,  3.45it/s]
 28%|██▊       | 104053/371472 [8:16:27<20:42:44,  3.59it/s]
 28%|██▊       | 104054/371472 [8:16:28<20:40:36,  3.59it/s]
 28%|██▊       | 104055/371472 [8:16:28<19:55:14,  3.73it/s]
 28%|██▊       | 104056/371472 [8:16:28<19:44:18,  3.76it/s]
 28%|██▊       | 104057/371472 [8:16:28<19:28:11,  3.82it/s]
 28%|██▊       | 104058/371472 [8:16:29<19:55:32,  3.73it/s]
 28%|██▊       | 104059/371472 [8:16:29<19:07:20,  3.88it/s]
 28%|██▊       | 104060/371472 [8:16:29<19:35:10,  3.79it/s]
                                                            
{'loss': 3.4642, 'learning_rate': 7.482331013381025e-07, 'epoch': 4.48}

 28%|██▊       | 104060/371472 [8:16:29<19:35:10,  3.79it/s]
 28%|██▊       | 104061/371472 [8:16:29<19:12:55,  3.87it/s]
 28%|██▊       | 104062/371472 [8:16:30<19:20:55,  3.84it/s]
 28%|██▊       | 104063/371472 [8:16:30<19:52:53,  3.74it/s]
 28%|██▊       | 104064/371472 [8:16:30<19:24:43,  3.83it/s]
 28%|██▊       | 104065/371472 [8:16:31<20:21:30,  3.65it/s]
 28%|██▊       | 104066/371472 [8:16:31<19:55:54,  3.73it/s]
 28%|██▊       | 104067/371472 [8:16:31<19:48:25,  3.75it/s]
 28%|██▊       | 104068/371472 [8:16:31<22:41:22,  3.27it/s]
 28%|██▊       | 104069/371472 [8:16:32<23:40:41,  3.14it/s]
 28%|██▊       | 104070/371472 [8:16:32<22:29:01,  3.30it/s]
 28%|██▊       | 104071/371472 [8:16:32<22:28:55,  3.30it/s]
 28%|██▊       | 104072/371472 [8:16:33<21:23:46,  3.47it/s]
 28%|██▊       | 104073/371472 [8:16:33<20:44:33,  3.58it/s]
 28%|██▊       | 104074/371472 [8:16:33<21:39:17,  3.43it/s]
 28%|██▊       | 104075/371472 [8:16:34<21:03:41,  3.53it/s]
 28%|██▊       | 104076/371472 [8:16:34<21:07:36,  3.52it/s]
 28%|██▊       | 104077/371472 [8:16:34<20:39:21,  3.60it/s]
 28%|██▊       | 104078/371472 [8:16:34<20:38:11,  3.60it/s]
 28%|██▊       | 104079/371472 [8:16:35<20:50:12,  3.56it/s]
 28%|██▊       | 104080/371472 [8:16:35<21:26:27,  3.46it/s]
                                                            
{'loss': 3.4866, 'learning_rate': 7.481846193626236e-07, 'epoch': 4.48}

 28%|██▊       | 104080/371472 [8:16:35<21:26:27,  3.46it/s]
 28%|██▊       | 104081/371472 [8:16:35<22:32:13,  3.30it/s]
 28%|██▊       | 104082/371472 [8:16:36<22:04:01,  3.37it/s]
 28%|██▊       | 104083/371472 [8:16:36<22:02:46,  3.37it/s]
 28%|██▊       | 104084/371472 [8:16:36<22:47:51,  3.26it/s]
 28%|██▊       | 104085/371472 [8:16:37<23:10:36,  3.20it/s]
 28%|██▊       | 104086/371472 [8:16:37<23:00:18,  3.23it/s]
 28%|██▊       | 104087/371472 [8:16:37<22:14:13,  3.34it/s]
 28%|██▊       | 104088/371472 [8:16:37<21:55:10,  3.39it/s]
 28%|██▊       | 104089/371472 [8:16:38<22:03:56,  3.37it/s]
 28%|██▊       | 104090/371472 [8:16:38<21:12:26,  3.50it/s]
 28%|██▊       | 104091/371472 [8:16:38<20:58:54,  3.54it/s]
 28%|██▊       | 104092/371472 [8:16:38<20:48:56,  3.57it/s]
 28%|██▊       | 104093/371472 [8:16:39<21:31:24,  3.45it/s]
 28%|██▊       | 104094/371472 [8:16:39<22:14:21,  3.34it/s]
 28%|██▊       | 104095/371472 [8:16:39<22:18:18,  3.33it/s]
 28%|██▊       | 104096/371472 [8:16:40<22:13:27,  3.34it/s]
 28%|██▊       | 104097/371472 [8:16:40<21:35:05,  3.44it/s]
 28%|██▊       | 104098/371472 [8:16:40<23:15:14,  3.19it/s]
 28%|██▊       | 104099/371472 [8:16:41<22:01:37,  3.37it/s]
 28%|██▊       | 104100/371472 [8:16:41<21:09:17,  3.51it/s]
                                                            
{'loss': 3.5181, 'learning_rate': 7.481361373871447e-07, 'epoch': 4.48}

 28%|██▊       | 104100/371472 [8:16:41<21:09:17,  3.51it/s]
 28%|██▊       | 104101/371472 [8:16:41<21:21:13,  3.48it/s]
 28%|██▊       | 104102/371472 [8:16:41<20:47:50,  3.57it/s]
 28%|██▊       | 104103/371472 [8:16:42<21:33:15,  3.45it/s]
 28%|██▊       | 104104/371472 [8:16:42<22:12:43,  3.34it/s]
 28%|██▊       | 104105/371472 [8:16:42<21:51:27,  3.40it/s]
 28%|██▊       | 104106/371472 [8:16:43<21:50:09,  3.40it/s]
 28%|██▊       | 104107/371472 [8:16:43<22:28:46,  3.30it/s]
 28%|██▊       | 104108/371472 [8:16:43<22:47:05,  3.26it/s]
 28%|██▊       | 104109/371472 [8:16:44<22:04:09,  3.37it/s]
 28%|██▊       | 104110/371472 [8:16:44<21:16:28,  3.49it/s]
 28%|██▊       | 104111/371472 [8:16:44<21:44:24,  3.42it/s]
 28%|██▊       | 104112/371472 [8:16:44<21:35:15,  3.44it/s]
 28%|██▊       | 104113/371472 [8:16:45<21:34:53,  3.44it/s]
 28%|██▊       | 104114/371472 [8:16:45<21:18:55,  3.48it/s]
 28%|██▊       | 104115/371472 [8:16:45<21:40:15,  3.43it/s]
 28%|██▊       | 104116/371472 [8:16:46<20:28:21,  3.63it/s]
 28%|██▊       | 104117/371472 [8:16:46<21:42:01,  3.42it/s]
 28%|██▊       | 104118/371472 [8:16:46<21:02:34,  3.53it/s]
 28%|██▊       | 104119/371472 [8:16:46<20:19:50,  3.65it/s]
 28%|██▊       | 104120/371472 [8:16:47<20:07:24,  3.69it/s]
                                                            
{'loss': 3.6749, 'learning_rate': 7.480876554116658e-07, 'epoch': 4.48}

 28%|██▊       | 104120/371472 [8:16:47<20:07:24,  3.69it/s]
 28%|██▊       | 104121/371472 [8:16:47<20:48:35,  3.57it/s]
 28%|██▊       | 104122/371472 [8:16:47<21:38:23,  3.43it/s]
 28%|██▊       | 104123/371472 [8:16:48<22:27:07,  3.31it/s]
 28%|██▊       | 104124/371472 [8:16:48<21:51:44,  3.40it/s]
 28%|██▊       | 104125/371472 [8:16:48<22:36:27,  3.28it/s]
 28%|██▊       | 104126/371472 [8:16:49<23:45:30,  3.13it/s]
 28%|██▊       | 104127/371472 [8:16:49<23:50:39,  3.11it/s]
 28%|██▊       | 104128/371472 [8:16:49<23:57:11,  3.10it/s]
 28%|██▊       | 104129/371472 [8:16:49<23:47:19,  3.12it/s]
 28%|██▊       | 104130/371472 [8:16:50<25:37:43,  2.90it/s]
 28%|██▊       | 104131/371472 [8:16:50<23:38:24,  3.14it/s]
 28%|██▊       | 104132/371472 [8:16:50<22:16:00,  3.34it/s]
 28%|██▊       | 104133/371472 [8:16:51<21:18:32,  3.48it/s]
 28%|██▊       | 104134/371472 [8:16:51<21:01:46,  3.53it/s]
 28%|██▊       | 104135/371472 [8:16:51<20:48:58,  3.57it/s]
 28%|██▊       | 104136/371472 [8:16:52<21:42:11,  3.42it/s]
 28%|██▊       | 104137/371472 [8:16:52<21:13:36,  3.50it/s]
 28%|██▊       | 104138/371472 [8:16:52<21:35:16,  3.44it/s]
 28%|██▊       | 104139/371472 [8:16:52<21:30:35,  3.45it/s]
 28%|██▊       | 104140/371472 [8:16:53<20:53:32,  3.55it/s]
                                                            
{'loss': 3.4921, 'learning_rate': 7.480391734361869e-07, 'epoch': 4.49}

 28%|██▊       | 104140/371472 [8:16:53<20:53:32,  3.55it/s]
 28%|██▊       | 104141/371472 [8:16:53<21:29:26,  3.46it/s]
 28%|██▊       | 104142/371472 [8:16:53<22:52:52,  3.25it/s]
 28%|██▊       | 104143/371472 [8:16:54<21:44:36,  3.42it/s]
 28%|██▊       | 104144/371472 [8:16:54<21:18:13,  3.49it/s]
 28%|██▊       | 104145/371472 [8:16:54<21:52:31,  3.39it/s]
 28%|██▊       | 104146/371472 [8:16:54<21:35:34,  3.44it/s]
 28%|██▊       | 104147/371472 [8:16:55<23:41:49,  3.13it/s]
 28%|██▊       | 104148/371472 [8:16:55<22:10:31,  3.35it/s]
 28%|██▊       | 104149/371472 [8:16:55<22:05:16,  3.36it/s]
 28%|██▊       | 104150/371472 [8:16:56<23:22:16,  3.18it/s]
 28%|██▊       | 104151/371472 [8:16:56<22:00:24,  3.37it/s]
 28%|██▊       | 104152/371472 [8:16:56<22:00:50,  3.37it/s]
 28%|██▊       | 104153/371472 [8:16:57<21:49:00,  3.40it/s]
 28%|██▊       | 104154/371472 [8:16:57<21:00:23,  3.53it/s]
 28%|██▊       | 104155/371472 [8:16:57<20:23:30,  3.64it/s]
 28%|██▊       | 104156/371472 [8:16:57<22:26:44,  3.31it/s]
 28%|██▊       | 104157/371472 [8:16:58<21:51:10,  3.40it/s]
 28%|██▊       | 104158/371472 [8:16:58<22:23:42,  3.32it/s]
 28%|██▊       | 104159/371472 [8:16:58<21:51:06,  3.40it/s]
 28%|██▊       | 104160/371472 [8:16:59<20:53:40,  3.55it/s]
                                                            
{'loss': 3.4176, 'learning_rate': 7.479906914607079e-07, 'epoch': 4.49}

 28%|██▊       | 104160/371472 [8:16:59<20:53:40,  3.55it/s]
 28%|██▊       | 104161/371472 [8:16:59<21:21:39,  3.48it/s]
 28%|██▊       | 104162/371472 [8:16:59<20:50:18,  3.56it/s]
 28%|██▊       | 104163/371472 [8:16:59<20:28:53,  3.63it/s]
 28%|██▊       | 104164/371472 [8:17:00<20:00:59,  3.71it/s]
 28%|██▊       | 104165/371472 [8:17:00<20:12:24,  3.67it/s]
 28%|██▊       | 104166/371472 [8:17:00<23:02:31,  3.22it/s]
 28%|██▊       | 104167/371472 [8:17:01<21:55:45,  3.39it/s]
 28%|██▊       | 104168/371472 [8:17:01<21:02:34,  3.53it/s]
 28%|██▊       | 104169/371472 [8:17:01<21:54:54,  3.39it/s]
 28%|██▊       | 104170/371472 [8:17:01<21:10:07,  3.51it/s]
 28%|██▊       | 104171/371472 [8:17:02<21:32:24,  3.45it/s]
 28%|██▊       | 104172/371472 [8:17:02<23:33:42,  3.15it/s]
 28%|██▊       | 104173/371472 [8:17:02<22:15:03,  3.34it/s]
 28%|██▊       | 104174/371472 [8:17:03<22:38:31,  3.28it/s]
 28%|██▊       | 104175/371472 [8:17:03<21:39:16,  3.43it/s]
 28%|██▊       | 104176/371472 [8:17:03<20:32:03,  3.62it/s]
 28%|██▊       | 104177/371472 [8:17:03<21:02:43,  3.53it/s]
 28%|██▊       | 104178/371472 [8:17:04<21:07:16,  3.52it/s]
 28%|██▊       | 104179/371472 [8:17:04<20:59:01,  3.54it/s]
 28%|██▊       | 104180/371472 [8:17:04<20:19:37,  3.65it/s]
                                                            
{'loss': 3.5571, 'learning_rate': 7.479422094852292e-07, 'epoch': 4.49}

 28%|██▊       | 104180/371472 [8:17:04<20:19:37,  3.65it/s]
 28%|██▊       | 104181/371472 [8:17:05<20:42:38,  3.58it/s]
 28%|██▊       | 104182/371472 [8:17:05<19:54:55,  3.73it/s]
 28%|██▊       | 104183/371472 [8:17:05<22:07:35,  3.36it/s]
 28%|██▊       | 104184/371472 [8:17:05<21:50:28,  3.40it/s]
 28%|██▊       | 104185/371472 [8:17:06<22:44:12,  3.27it/s]
 28%|██▊       | 104186/371472 [8:17:06<22:02:41,  3.37it/s]
 28%|██▊       | 104187/371472 [8:17:06<20:52:31,  3.56it/s]
 28%|██▊       | 104188/371472 [8:17:07<20:10:02,  3.68it/s]
 28%|██▊       | 104189/371472 [8:17:07<21:11:55,  3.50it/s]
 28%|██▊       | 104190/371472 [8:17:07<21:06:24,  3.52it/s]
 28%|██▊       | 104191/371472 [8:17:07<20:57:29,  3.54it/s]
 28%|██▊       | 104192/371472 [8:17:08<20:18:48,  3.65it/s]
 28%|██▊       | 104193/371472 [8:17:08<19:46:48,  3.75it/s]
 28%|██▊       | 104194/371472 [8:17:08<19:43:17,  3.76it/s]
 28%|██▊       | 104195/371472 [8:17:09<20:09:59,  3.68it/s]
 28%|██▊       | 104196/371472 [8:17:09<20:32:34,  3.61it/s]
 28%|██▊       | 104197/371472 [8:17:09<20:00:25,  3.71it/s]
 28%|██▊       | 104198/371472 [8:17:09<20:23:45,  3.64it/s]
 28%|██▊       | 104199/371472 [8:17:10<20:38:32,  3.60it/s]
 28%|██▊       | 104200/371472 [8:17:10<20:16:04,  3.66it/s]
                                                            
{'loss': 3.4492, 'learning_rate': 7.478937275097503e-07, 'epoch': 4.49}

 28%|██▊       | 104200/371472 [8:17:10<20:16:04,  3.66it/s]
 28%|██▊       | 104201/371472 [8:17:10<19:54:23,  3.73it/s]
 28%|██▊       | 104202/371472 [8:17:10<21:12:28,  3.50it/s]
 28%|██▊       | 104203/371472 [8:17:11<21:55:40,  3.39it/s]
 28%|██▊       | 104204/371472 [8:17:11<22:08:37,  3.35it/s]
 28%|██▊       | 104205/371472 [8:17:11<21:15:22,  3.49it/s]
 28%|██▊       | 104206/371472 [8:17:12<21:34:43,  3.44it/s]
 28%|██▊       | 104207/371472 [8:17:12<20:34:09,  3.61it/s]
 28%|██▊       | 104208/371472 [8:17:12<20:41:21,  3.59it/s]
 28%|██▊       | 104209/371472 [8:17:12<19:51:42,  3.74it/s]
 28%|██▊       | 104210/371472 [8:17:13<19:46:47,  3.75it/s]
 28%|██▊       | 104211/371472 [8:17:13<19:12:52,  3.86it/s]
 28%|██▊       | 104212/371472 [8:17:13<19:55:04,  3.73it/s]
 28%|██▊       | 104213/371472 [8:17:13<19:58:49,  3.72it/s]
 28%|██▊       | 104214/371472 [8:17:14<20:52:07,  3.56it/s]
 28%|██▊       | 104215/371472 [8:17:14<20:37:48,  3.60it/s]
 28%|██▊       | 104216/371472 [8:17:14<21:14:53,  3.49it/s]
 28%|██▊       | 104217/371472 [8:17:15<21:49:16,  3.40it/s]
 28%|██▊       | 104218/371472 [8:17:15<21:01:37,  3.53it/s]
 28%|██▊       | 104219/371472 [8:17:15<20:17:07,  3.66it/s]
 28%|██▊       | 104220/371472 [8:17:15<19:36:26,  3.79it/s]
                                                            
{'loss': 3.4424, 'learning_rate': 7.478452455342713e-07, 'epoch': 4.49}

 28%|██▊       | 104220/371472 [8:17:15<19:36:26,  3.79it/s]
 28%|██▊       | 104221/371472 [8:17:16<19:31:49,  3.80it/s]
 28%|██▊       | 104222/371472 [8:17:16<19:38:05,  3.78it/s]
 28%|██▊       | 104223/371472 [8:17:16<20:09:16,  3.68it/s]
 28%|██▊       | 104224/371472 [8:17:17<21:46:02,  3.41it/s]
 28%|██▊       | 104225/371472 [8:17:17<21:24:26,  3.47it/s]
 28%|██▊       | 104226/371472 [8:17:17<22:02:50,  3.37it/s]
 28%|██▊       | 104227/371472 [8:17:17<21:20:43,  3.48it/s]
 28%|██▊       | 104228/371472 [8:17:18<21:17:24,  3.49it/s]
 28%|██▊       | 104229/371472 [8:17:18<20:57:45,  3.54it/s]
 28%|██▊       | 104230/371472 [8:17:18<21:01:34,  3.53it/s]
 28%|██▊       | 104231/371472 [8:17:19<21:07:31,  3.51it/s]
 28%|██▊       | 104232/371472 [8:17:19<22:47:48,  3.26it/s]
 28%|██▊       | 104233/371472 [8:17:19<21:36:06,  3.44it/s]
 28%|██▊       | 104234/371472 [8:17:20<21:33:37,  3.44it/s]
 28%|██▊       | 104235/371472 [8:17:20<21:41:21,  3.42it/s]
 28%|██▊       | 104236/371472 [8:17:20<21:44:46,  3.41it/s]
 28%|██▊       | 104237/371472 [8:17:20<22:21:07,  3.32it/s]
 28%|██▊       | 104238/371472 [8:17:21<22:13:54,  3.34it/s]
 28%|██▊       | 104239/371472 [8:17:21<22:04:42,  3.36it/s]
 28%|██▊       | 104240/371472 [8:17:21<21:16:33,  3.49it/s]
                                                            
{'loss': 3.5695, 'learning_rate': 7.477967635587924e-07, 'epoch': 4.49}

 28%|██▊       | 104240/371472 [8:17:21<21:16:33,  3.49it/s]
 28%|██▊       | 104241/371472 [8:17:22<21:00:15,  3.53it/s]
 28%|██▊       | 104242/371472 [8:17:22<20:27:29,  3.63it/s]
 28%|██▊       | 104243/371472 [8:17:22<20:22:49,  3.64it/s]
 28%|██▊       | 104244/371472 [8:17:22<20:40:08,  3.59it/s]
 28%|██▊       | 104245/371472 [8:17:23<20:22:10,  3.64it/s]
 28%|██▊       | 104246/371472 [8:17:23<20:45:12,  3.58it/s]
 28%|██▊       | 104247/371472 [8:17:23<21:49:13,  3.40it/s]
 28%|██▊       | 104248/371472 [8:17:24<21:30:23,  3.45it/s]
 28%|██▊       | 104249/371472 [8:17:24<22:08:13,  3.35it/s]
 28%|██▊       | 104250/371472 [8:17:24<21:48:06,  3.40it/s]
 28%|██▊       | 104251/371472 [8:17:24<20:44:30,  3.58it/s]
 28%|██▊       | 104252/371472 [8:17:25<20:00:30,  3.71it/s]
 28%|██▊       | 104253/371472 [8:17:25<20:08:18,  3.69it/s]
 28%|██▊       | 104254/371472 [8:17:25<21:16:37,  3.49it/s]
 28%|██▊       | 104255/371472 [8:17:26<21:36:54,  3.43it/s]
 28%|██▊       | 104256/371472 [8:17:26<21:34:54,  3.44it/s]
 28%|██▊       | 104257/371472 [8:17:26<21:42:54,  3.42it/s]
 28%|██▊       | 104258/371472 [8:17:26<21:49:46,  3.40it/s]
 28%|██▊       | 104259/371472 [8:17:27<21:09:51,  3.51it/s]
 28%|██▊       | 104260/371472 [8:17:27<21:05:46,  3.52it/s]
                                                            
{'loss': 3.4163, 'learning_rate': 7.477482815833137e-07, 'epoch': 4.49}

 28%|██▊       | 104260/371472 [8:17:27<21:05:46,  3.52it/s]
 28%|██▊       | 104261/371472 [8:17:27<20:57:00,  3.54it/s]
 28%|██▊       | 104262/371472 [8:17:28<21:03:21,  3.53it/s]
 28%|██▊       | 104263/371472 [8:17:28<20:47:30,  3.57it/s]
 28%|██▊       | 104264/371472 [8:17:28<20:55:26,  3.55it/s]
 28%|██▊       | 104265/371472 [8:17:28<20:58:54,  3.54it/s]
 28%|██▊       | 104266/371472 [8:17:29<20:52:09,  3.56it/s]
 28%|██▊       | 104267/371472 [8:17:29<22:35:15,  3.29it/s]
 28%|██▊       | 104268/371472 [8:17:29<21:30:33,  3.45it/s]
 28%|██▊       | 104269/371472 [8:17:30<23:05:10,  3.22it/s]
 28%|██▊       | 104270/371472 [8:17:30<22:38:18,  3.28it/s]
 28%|██▊       | 104271/371472 [8:17:30<21:40:48,  3.42it/s]
 28%|██▊       | 104272/371472 [8:17:30<20:59:48,  3.53it/s]
 28%|██▊       | 104273/371472 [8:17:31<21:08:05,  3.51it/s]
 28%|██▊       | 104274/371472 [8:17:31<22:11:38,  3.34it/s]
 28%|██▊       | 104275/371472 [8:17:31<21:01:15,  3.53it/s]
 28%|██▊       | 104276/371472 [8:17:32<20:07:50,  3.69it/s]
 28%|██▊       | 104277/371472 [8:17:32<20:13:15,  3.67it/s]
 28%|██▊       | 104278/371472 [8:17:32<20:48:00,  3.57it/s]
 28%|██▊       | 104279/371472 [8:17:32<21:10:14,  3.51it/s]
 28%|██▊       | 104280/371472 [8:17:33<23:20:52,  3.18it/s]
                                                            
{'loss': 3.4495, 'learning_rate': 7.476997996078347e-07, 'epoch': 4.49}

 28%|██▊       | 104280/371472 [8:17:33<23:20:52,  3.18it/s]
 28%|██▊       | 104281/371472 [8:17:33<24:42:31,  3.00it/s]
 28%|██▊       | 104282/371472 [8:17:33<23:19:37,  3.18it/s]
 28%|██▊       | 104283/371472 [8:17:34<22:34:14,  3.29it/s]
 28%|██▊       | 104284/371472 [8:17:34<22:32:31,  3.29it/s]
 28%|██▊       | 104285/371472 [8:17:34<21:36:57,  3.43it/s]
 28%|██▊       | 104286/371472 [8:17:35<20:59:59,  3.53it/s]
 28%|██▊       | 104287/371472 [8:17:35<20:11:42,  3.68it/s]
 28%|██▊       | 104288/371472 [8:17:35<20:58:04,  3.54it/s]
 28%|██▊       | 104289/371472 [8:17:35<20:38:10,  3.60it/s]
 28%|██▊       | 104290/371472 [8:17:36<21:10:34,  3.50it/s]
 28%|██▊       | 104291/371472 [8:17:36<20:50:14,  3.56it/s]
 28%|██▊       | 104292/371472 [8:17:36<20:26:14,  3.63it/s]
 28%|██▊       | 104293/371472 [8:17:36<20:31:33,  3.62it/s]
 28%|██▊       | 104294/371472 [8:17:37<21:29:18,  3.45it/s]
 28%|██▊       | 104295/371472 [8:17:37<21:22:07,  3.47it/s]
 28%|██▊       | 104296/371472 [8:17:37<20:12:09,  3.67it/s]
 28%|██▊       | 104297/371472 [8:17:38<20:44:47,  3.58it/s]
 28%|██▊       | 104298/371472 [8:17:38<20:23:36,  3.64it/s]
 28%|██▊       | 104299/371472 [8:17:38<20:41:11,  3.59it/s]
 28%|██▊       | 104300/371472 [8:17:38<21:15:09,  3.49it/s]
                                                            
{'loss': 3.5052, 'learning_rate': 7.476513176323558e-07, 'epoch': 4.49}

 28%|██▊       | 104300/371472 [8:17:38<21:15:09,  3.49it/s]
 28%|██▊       | 104301/371472 [8:17:39<20:21:40,  3.64it/s]
 28%|██▊       | 104302/371472 [8:17:39<19:36:46,  3.78it/s]
 28%|██▊       | 104303/371472 [8:17:39<19:35:50,  3.79it/s]
 28%|██▊       | 104304/371472 [8:17:40<20:07:04,  3.69it/s]
 28%|██▊       | 104305/371472 [8:17:40<21:44:25,  3.41it/s]
 28%|██▊       | 104306/371472 [8:17:40<21:22:28,  3.47it/s]
 28%|██▊       | 104307/371472 [8:17:40<21:42:29,  3.42it/s]
 28%|██▊       | 104308/371472 [8:17:41<21:12:54,  3.50it/s]
 28%|██▊       | 104309/371472 [8:17:41<20:59:38,  3.53it/s]
 28%|██▊       | 104310/371472 [8:17:41<20:08:32,  3.68it/s]
 28%|██▊       | 104311/371472 [8:17:41<19:39:45,  3.77it/s]
 28%|██▊       | 104312/371472 [8:17:42<19:20:34,  3.84it/s]
 28%|██▊       | 104313/371472 [8:17:42<19:08:09,  3.88it/s]
 28%|██▊       | 104314/371472 [8:17:42<18:57:58,  3.91it/s]
 28%|██▊       | 104315/371472 [8:17:42<19:09:23,  3.87it/s]
 28%|██▊       | 104316/371472 [8:17:43<20:24:40,  3.64it/s]
 28%|██▊       | 104317/371472 [8:17:43<20:13:02,  3.67it/s]
 28%|██▊       | 104318/371472 [8:17:43<21:22:46,  3.47it/s]
 28%|██▊       | 104319/371472 [8:17:44<21:49:30,  3.40it/s]
 28%|██▊       | 104320/371472 [8:17:44<21:46:28,  3.41it/s]
                                                            
{'loss': 3.5367, 'learning_rate': 7.476028356568769e-07, 'epoch': 4.49}

 28%|██▊       | 104320/371472 [8:17:44<21:46:28,  3.41it/s]
 28%|██▊       | 104321/371472 [8:17:44<22:24:59,  3.31it/s]
 28%|██▊       | 104322/371472 [8:17:45<21:46:25,  3.41it/s]
 28%|██▊       | 104323/371472 [8:17:45<21:28:34,  3.46it/s]
 28%|██▊       | 104324/371472 [8:17:45<20:38:16,  3.60it/s]
 28%|██▊       | 104325/371472 [8:17:45<21:34:57,  3.44it/s]
 28%|██▊       | 104326/371472 [8:17:46<21:50:08,  3.40it/s]
 28%|██▊       | 104327/371472 [8:17:46<21:22:47,  3.47it/s]
 28%|██▊       | 104328/371472 [8:17:46<20:58:54,  3.54it/s]
 28%|██▊       | 104329/371472 [8:17:47<22:04:14,  3.36it/s]
 28%|██▊       | 104330/371472 [8:17:47<21:16:47,  3.49it/s]
 28%|██▊       | 104331/371472 [8:17:47<20:58:33,  3.54it/s]
 28%|██▊       | 104332/371472 [8:17:47<20:52:35,  3.55it/s]
 28%|██▊       | 104333/371472 [8:17:48<21:33:27,  3.44it/s]
 28%|██▊       | 104334/371472 [8:17:48<21:22:55,  3.47it/s]
 28%|██▊       | 104335/371472 [8:17:48<21:38:48,  3.43it/s]
 28%|██▊       | 104336/371472 [8:17:49<20:51:33,  3.56it/s]
 28%|██▊       | 104337/371472 [8:17:49<20:35:11,  3.60it/s]
 28%|██▊       | 104338/371472 [8:17:49<21:33:21,  3.44it/s]
 28%|██▊       | 104339/371472 [8:17:49<20:32:57,  3.61it/s]
 28%|██▊       | 104340/371472 [8:17:50<20:26:06,  3.63it/s]
                                                            
{'loss': 3.341, 'learning_rate': 7.475543536813979e-07, 'epoch': 4.49}

 28%|██▊       | 104340/371472 [8:17:50<20:26:06,  3.63it/s]
 28%|██▊       | 104341/371472 [8:17:50<20:16:10,  3.66it/s]
 28%|██▊       | 104342/371472 [8:17:50<19:55:56,  3.72it/s]
 28%|██▊       | 104343/371472 [8:17:50<19:56:36,  3.72it/s]
 28%|██▊       | 104344/371472 [8:17:51<20:08:21,  3.68it/s]
 28%|██▊       | 104345/371472 [8:17:51<19:49:23,  3.74it/s]
 28%|██▊       | 104346/371472 [8:17:51<20:05:50,  3.69it/s]
 28%|██▊       | 104347/371472 [8:17:52<20:59:12,  3.54it/s]
 28%|██▊       | 104348/371472 [8:17:52<21:24:17,  3.47it/s]
 28%|██▊       | 104349/371472 [8:17:52<21:01:09,  3.53it/s]
 28%|██▊       | 104350/371472 [8:17:52<20:36:21,  3.60it/s]
 28%|██▊       | 104351/371472 [8:17:53<20:34:47,  3.61it/s]
 28%|██▊       | 104352/371472 [8:17:53<20:34:53,  3.61it/s]
 28%|██▊       | 104353/371472 [8:17:53<21:27:23,  3.46it/s]
 28%|██▊       | 104354/371472 [8:17:54<20:39:10,  3.59it/s]
 28%|██▊       | 104355/371472 [8:17:54<22:06:33,  3.36it/s]
 28%|██▊       | 104356/371472 [8:17:54<21:35:46,  3.44it/s]
 28%|██▊       | 104357/371472 [8:17:54<21:03:50,  3.52it/s]
 28%|██▊       | 104358/371472 [8:17:55<20:39:29,  3.59it/s]
 28%|██▊       | 104359/371472 [8:17:55<21:05:03,  3.52it/s]
 28%|██▊       | 104360/371472 [8:17:55<22:38:05,  3.28it/s]
                                                            
{'loss': 3.4593, 'learning_rate': 7.475058717059191e-07, 'epoch': 4.49}

 28%|██▊       | 104360/371472 [8:17:55<22:38:05,  3.28it/s]
 28%|██▊       | 104361/371472 [8:17:56<21:55:25,  3.38it/s]
 28%|██▊       | 104362/371472 [8:17:56<20:54:17,  3.55it/s]
 28%|██▊       | 104363/371472 [8:17:56<20:47:39,  3.57it/s]
 28%|██▊       | 104364/371472 [8:17:56<20:25:48,  3.63it/s]
 28%|██▊       | 104365/371472 [8:17:57<20:12:50,  3.67it/s]
 28%|██▊       | 104366/371472 [8:17:57<20:58:07,  3.54it/s]
 28%|██▊       | 104367/371472 [8:17:57<20:53:28,  3.55it/s]
 28%|██▊       | 104368/371472 [8:17:58<20:27:25,  3.63it/s]
 28%|██▊       | 104369/371472 [8:17:58<19:33:29,  3.79it/s]
 28%|██▊       | 104370/371472 [8:17:58<20:17:03,  3.66it/s]
 28%|██▊       | 104371/371472 [8:17:58<21:05:06,  3.52it/s]
 28%|██▊       | 104372/371472 [8:17:59<20:58:05,  3.54it/s]
 28%|██▊       | 104373/371472 [8:17:59<21:25:10,  3.46it/s]
 28%|██▊       | 104374/371472 [8:17:59<20:43:35,  3.58it/s]
 28%|██▊       | 104375/371472 [8:18:00<22:16:59,  3.33it/s]
 28%|██▊       | 104376/371472 [8:18:00<23:01:36,  3.22it/s]
 28%|██▊       | 104377/371472 [8:18:00<21:53:39,  3.39it/s]
 28%|██▊       | 104378/371472 [8:18:00<21:11:41,  3.50it/s]
 28%|██▊       | 104379/371472 [8:18:01<21:39:17,  3.43it/s]
 28%|██▊       | 104380/371472 [8:18:01<21:07:31,  3.51it/s]
                                                            
{'loss': 3.4561, 'learning_rate': 7.474573897304402e-07, 'epoch': 4.5}

 28%|██▊       | 104380/371472 [8:18:01<21:07:31,  3.51it/s]
 28%|██▊       | 104381/371472 [8:18:01<20:38:35,  3.59it/s]
 28%|██▊       | 104382/371472 [8:18:02<20:01:36,  3.70it/s]
 28%|██▊       | 104383/371472 [8:18:02<19:57:31,  3.72it/s]
 28%|██▊       | 104384/371472 [8:18:02<19:38:58,  3.78it/s]
 28%|██▊       | 104385/371472 [8:18:02<21:05:03,  3.52it/s]
 28%|██▊       | 104386/371472 [8:18:03<21:33:31,  3.44it/s]
 28%|██▊       | 104387/371472 [8:18:03<20:56:05,  3.54it/s]
 28%|██▊       | 104388/371472 [8:18:03<20:52:37,  3.55it/s]
 28%|██▊       | 104389/371472 [8:18:03<20:31:32,  3.61it/s]
 28%|██▊       | 104390/371472 [8:18:04<21:57:05,  3.38it/s]
 28%|██▊       | 104391/371472 [8:18:04<21:09:10,  3.51it/s]
 28%|██▊       | 104392/371472 [8:18:04<21:45:35,  3.41it/s]
 28%|██▊       | 104393/371472 [8:18:05<21:20:04,  3.48it/s]
 28%|██▊       | 104394/371472 [8:18:05<20:40:05,  3.59it/s]
 28%|██▊       | 104395/371472 [8:18:05<20:22:44,  3.64it/s]
 28%|██▊       | 104396/371472 [8:18:05<20:23:36,  3.64it/s]
 28%|██▊       | 104397/371472 [8:18:06<19:49:17,  3.74it/s]
 28%|██▊       | 104398/371472 [8:18:06<20:50:32,  3.56it/s]
 28%|██▊       | 104399/371472 [8:18:06<20:56:59,  3.54it/s]
 28%|██▊       | 104400/371472 [8:18:07<20:19:22,  3.65it/s]
                                                            
{'loss': 3.6461, 'learning_rate': 7.474089077549613e-07, 'epoch': 4.5}

 28%|██▊       | 104400/371472 [8:18:07<20:19:22,  3.65it/s]
 28%|██▊       | 104401/371472 [8:18:07<20:06:01,  3.69it/s]
 28%|██▊       | 104402/371472 [8:18:07<19:38:15,  3.78it/s]
 28%|██▊       | 104403/371472 [8:18:07<19:24:25,  3.82it/s]
 28%|██▊       | 104404/371472 [8:18:08<20:29:52,  3.62it/s]
 28%|██▊       | 104405/371472 [8:18:08<20:24:17,  3.64it/s]
 28%|██▊       | 104406/371472 [8:18:08<20:12:22,  3.67it/s]
 28%|██▊       | 104407/371472 [8:18:09<21:49:56,  3.40it/s]
 28%|██▊       | 104408/371472 [8:18:09<21:07:44,  3.51it/s]
 28%|██▊       | 104409/371472 [8:18:09<20:40:48,  3.59it/s]
 28%|██▊       | 104410/371472 [8:18:09<20:33:05,  3.61it/s]
 28%|██▊       | 104411/371472 [8:18:10<24:14:47,  3.06it/s]
 28%|██▊       | 104412/371472 [8:18:10<24:35:16,  3.02it/s]
 28%|██▊       | 104413/371472 [8:18:10<23:02:40,  3.22it/s]
 28%|██▊       | 104414/371472 [8:18:11<24:33:08,  3.02it/s]
 28%|██▊       | 104415/371472 [8:18:11<23:25:55,  3.17it/s]
 28%|██▊       | 104416/371472 [8:18:11<21:51:07,  3.39it/s]
 28%|██▊       | 104417/371472 [8:18:12<21:15:29,  3.49it/s]
 28%|██▊       | 104418/371472 [8:18:12<21:28:32,  3.45it/s]
 28%|██▊       | 104419/371472 [8:18:12<20:46:43,  3.57it/s]
 28%|██▊       | 104420/371472 [8:18:12<21:01:26,  3.53it/s]
                                                            
{'loss': 3.4264, 'learning_rate': 7.473604257794824e-07, 'epoch': 4.5}

 28%|██▊       | 104420/371472 [8:18:12<21:01:26,  3.53it/s]
 28%|██▊       | 104421/371472 [8:18:13<22:05:43,  3.36it/s]
 28%|██▊       | 104422/371472 [8:18:13<22:19:50,  3.32it/s]
 28%|██▊       | 104423/371472 [8:18:13<21:18:50,  3.48it/s]
 28%|██▊       | 104424/371472 [8:18:14<21:20:06,  3.48it/s]
 28%|██▊       | 104425/371472 [8:18:14<21:05:27,  3.52it/s]
 28%|██▊       | 104426/371472 [8:18:14<21:02:43,  3.52it/s]
 28%|██▊       | 104427/371472 [8:18:14<21:50:27,  3.40it/s]
 28%|██▊       | 104428/371472 [8:18:15<24:41:38,  3.00it/s]
 28%|██▊       | 104429/371472 [8:18:15<23:07:11,  3.21it/s]
 28%|██▊       | 104430/371472 [8:18:15<22:03:46,  3.36it/s]
 28%|██▊       | 104431/371472 [8:18:16<21:12:14,  3.50it/s]
 28%|██▊       | 104432/371472 [8:18:16<20:41:56,  3.58it/s]
 28%|██▊       | 104433/371472 [8:18:16<20:29:19,  3.62it/s]
 28%|██▊       | 104434/371472 [8:18:17<21:06:47,  3.51it/s]
 28%|██▊       | 104435/371472 [8:18:17<21:45:39,  3.41it/s]
 28%|██▊       | 104436/371472 [8:18:17<20:45:09,  3.57it/s]
 28%|██▊       | 104437/371472 [8:18:17<21:00:58,  3.53it/s]
 28%|██▊       | 104438/371472 [8:18:18<20:28:32,  3.62it/s]
 28%|██▊       | 104439/371472 [8:18:18<21:39:00,  3.43it/s]
 28%|██▊       | 104440/371472 [8:18:18<21:30:07,  3.45it/s]
                                                            
{'loss': 3.4126, 'learning_rate': 7.473119438040035e-07, 'epoch': 4.5}

 28%|██▊       | 104440/371472 [8:18:18<21:30:07,  3.45it/s]
 28%|██▊       | 104441/371472 [8:18:18<20:55:32,  3.54it/s]
 28%|██▊       | 104442/371472 [8:18:19<20:46:26,  3.57it/s]
 28%|██▊       | 104443/371472 [8:18:19<21:11:38,  3.50it/s]
 28%|██▊       | 104444/371472 [8:18:19<20:38:10,  3.59it/s]
 28%|██▊       | 104445/371472 [8:18:20<20:58:32,  3.54it/s]
 28%|██▊       | 104446/371472 [8:18:20<21:38:51,  3.43it/s]
 28%|██▊       | 104447/371472 [8:18:20<21:00:16,  3.53it/s]
 28%|██▊       | 104448/371472 [8:18:20<20:36:55,  3.60it/s]
 28%|██▊       | 104449/371472 [8:18:21<20:53:59,  3.55it/s]
 28%|██▊       | 104450/371472 [8:18:21<20:54:01,  3.55it/s]
 28%|██▊       | 104451/371472 [8:18:21<20:19:35,  3.65it/s]
 28%|██▊       | 104452/371472 [8:18:22<22:05:47,  3.36it/s]
 28%|██▊       | 104453/371472 [8:18:22<21:24:12,  3.47it/s]
 28%|██▊       | 104454/371472 [8:18:22<21:30:45,  3.45it/s]
 28%|██▊       | 104455/371472 [8:18:23<21:31:21,  3.45it/s]
 28%|██▊       | 104456/371472 [8:18:23<22:48:01,  3.25it/s]
 28%|██▊       | 104457/371472 [8:18:23<22:37:44,  3.28it/s]
 28%|██▊       | 104458/371472 [8:18:23<22:58:35,  3.23it/s]
 28%|██▊       | 104459/371472 [8:18:24<22:17:55,  3.33it/s]
 28%|██▊       | 104460/371472 [8:18:24<21:59:58,  3.37it/s]
                                                            
{'loss': 3.4079, 'learning_rate': 7.472634618285246e-07, 'epoch': 4.5}

 28%|██▊       | 104460/371472 [8:18:24<21:59:58,  3.37it/s]
 28%|██▊       | 104461/371472 [8:18:24<22:05:29,  3.36it/s]
 28%|██▊       | 104462/371472 [8:18:25<22:13:43,  3.34it/s]
 28%|██▊       | 104463/371472 [8:18:25<21:20:36,  3.48it/s]
 28%|██▊       | 104464/371472 [8:18:25<20:56:05,  3.54it/s]
 28%|██▊       | 104465/371472 [8:18:26<22:25:17,  3.31it/s]
 28%|██▊       | 104466/371472 [8:18:26<22:26:19,  3.31it/s]
 28%|██▊       | 104467/371472 [8:18:26<23:48:30,  3.12it/s]
 28%|██▊       | 104468/371472 [8:18:27<23:50:10,  3.11it/s]
 28%|██▊       | 104469/371472 [8:18:27<25:03:40,  2.96it/s]
 28%|██▊       | 104470/371472 [8:18:27<24:16:05,  3.06it/s]
 28%|██▊       | 104471/371472 [8:18:27<22:47:21,  3.25it/s]
 28%|██▊       | 104472/371472 [8:18:28<22:19:10,  3.32it/s]
 28%|██▊       | 104473/371472 [8:18:28<23:12:23,  3.20it/s]
 28%|██▊       | 104474/371472 [8:18:28<22:24:01,  3.31it/s]
 28%|██▊       | 104475/371472 [8:18:29<21:31:08,  3.45it/s]
 28%|██▊       | 104476/371472 [8:18:29<20:55:35,  3.54it/s]
 28%|██▊       | 104477/371472 [8:18:29<20:42:58,  3.58it/s]
 28%|██▊       | 104478/371472 [8:18:29<20:29:58,  3.62it/s]
 28%|██▊       | 104479/371472 [8:18:30<19:59:49,  3.71it/s]
 28%|██▊       | 104480/371472 [8:18:30<19:30:41,  3.80it/s]
                                                            
{'loss': 3.5648, 'learning_rate': 7.472149798530457e-07, 'epoch': 4.5}

 28%|██▊       | 104480/371472 [8:18:30<19:30:41,  3.80it/s]
 28%|██▊       | 104481/371472 [8:18:30<21:17:49,  3.48it/s]
 28%|██▊       | 104482/371472 [8:18:31<20:37:04,  3.60it/s]
 28%|██▊       | 104483/371472 [8:18:31<22:24:01,  3.31it/s]
 28%|██▊       | 104484/371472 [8:18:31<22:25:00,  3.31it/s]
 28%|██▊       | 104485/371472 [8:18:32<23:39:34,  3.13it/s]
 28%|██▊       | 104486/371472 [8:18:32<23:11:57,  3.20it/s]
 28%|██▊       | 104487/371472 [8:18:32<22:38:24,  3.28it/s]
 28%|██▊       | 104488/371472 [8:18:32<22:58:51,  3.23it/s]
 28%|██▊       | 104489/371472 [8:18:33<22:09:36,  3.35it/s]
 28%|██▊       | 104490/371472 [8:18:33<20:57:11,  3.54it/s]
 28%|██▊       | 104491/371472 [8:18:33<21:03:04,  3.52it/s]
 28%|██▊       | 104492/371472 [8:18:34<21:55:23,  3.38it/s]
 28%|██▊       | 104493/371472 [8:18:34<20:43:52,  3.58it/s]
 28%|██▊       | 104494/371472 [8:18:34<20:30:46,  3.62it/s]
 28%|██▊       | 104495/371472 [8:18:34<22:30:15,  3.30it/s]
 28%|██▊       | 104496/371472 [8:18:35<23:32:59,  3.15it/s]
 28%|██▊       | 104497/371472 [8:18:35<22:52:24,  3.24it/s]
 28%|██▊       | 104498/371472 [8:18:35<22:27:57,  3.30it/s]
 28%|██▊       | 104499/371472 [8:18:36<22:01:39,  3.37it/s]
 28%|██▊       | 104500/371472 [8:18:36<22:49:52,  3.25it/s]
                                                            
{'loss': 3.6219, 'learning_rate': 7.471664978775668e-07, 'epoch': 4.5}

 28%|██▊       | 104500/371472 [8:18:36<22:49:52,  3.25it/s]
 28%|██▊       | 104501/371472 [8:18:36<21:58:25,  3.37it/s]
 28%|██▊       | 104502/371472 [8:18:37<21:31:45,  3.44it/s]
 28%|██▊       | 104503/371472 [8:18:37<20:42:01,  3.58it/s]
 28%|██▊       | 104504/371472 [8:18:37<21:18:01,  3.48it/s]
 28%|██▊       | 104505/371472 [8:18:37<21:19:38,  3.48it/s]
 28%|██▊       | 104506/371472 [8:18:38<21:07:11,  3.51it/s]
 28%|██▊       | 104507/371472 [8:18:38<20:54:16,  3.55it/s]
 28%|██▊       | 104508/371472 [8:18:38<20:25:31,  3.63it/s]
 28%|██▊       | 104509/371472 [8:18:39<21:21:33,  3.47it/s]
 28%|██▊       | 104510/371472 [8:18:39<22:13:33,  3.34it/s]
 28%|██▊       | 104511/371472 [8:18:39<21:12:57,  3.50it/s]
 28%|██▊       | 104512/371472 [8:18:39<20:57:54,  3.54it/s]
 28%|██▊       | 104513/371472 [8:18:40<20:12:58,  3.67it/s]
 28%|██▊       | 104514/371472 [8:18:40<19:55:43,  3.72it/s]
 28%|██▊       | 104515/371472 [8:18:40<19:55:57,  3.72it/s]
 28%|██▊       | 104516/371472 [8:18:40<20:33:01,  3.61it/s]
 28%|██▊       | 104517/371472 [8:18:41<21:11:19,  3.50it/s]
 28%|██▊       | 104518/371472 [8:18:41<22:06:29,  3.35it/s]
 28%|██▊       | 104519/371472 [8:18:41<22:24:32,  3.31it/s]
 28%|██▊       | 104520/371472 [8:18:42<21:19:41,  3.48it/s]
                                                            
{'loss': 3.5651, 'learning_rate': 7.471180159020879e-07, 'epoch': 4.5}

 28%|██▊       | 104520/371472 [8:18:42<21:19:41,  3.48it/s]
 28%|██▊       | 104521/371472 [8:18:42<21:40:39,  3.42it/s]
 28%|██▊       | 104522/371472 [8:18:42<21:36:17,  3.43it/s]
 28%|██▊       | 104523/371472 [8:18:43<20:53:23,  3.55it/s]
 28%|██▊       | 104524/371472 [8:18:43<20:40:01,  3.59it/s]
 28%|██▊       | 104525/371472 [8:18:43<19:52:18,  3.73it/s]
 28%|██▊       | 104526/371472 [8:18:43<21:06:39,  3.51it/s]
 28%|██▊       | 104527/371472 [8:18:44<20:34:15,  3.60it/s]
 28%|██▊       | 104528/371472 [8:18:44<20:25:36,  3.63it/s]
 28%|██▊       | 104529/371472 [8:18:44<19:34:38,  3.79it/s]
 28%|██▊       | 104530/371472 [8:18:44<19:27:27,  3.81it/s]
 28%|██▊       | 104531/371472 [8:18:45<19:05:51,  3.88it/s]
 28%|██▊       | 104532/371472 [8:18:45<20:36:33,  3.60it/s]
 28%|██▊       | 104533/371472 [8:18:45<20:49:57,  3.56it/s]
 28%|██▊       | 104534/371472 [8:18:45<20:35:17,  3.60it/s]
 28%|██▊       | 104535/371472 [8:18:46<20:19:25,  3.65it/s]
 28%|██▊       | 104536/371472 [8:18:46<21:24:17,  3.46it/s]
 28%|██▊       | 104537/371472 [8:18:47<25:25:30,  2.92it/s]
 28%|██▊       | 104538/371472 [8:18:47<23:23:53,  3.17it/s]
 28%|██▊       | 104539/371472 [8:18:47<22:34:49,  3.28it/s]
 28%|██▊       | 104540/371472 [8:18:47<22:20:39,  3.32it/s]
                                                            
{'loss': 3.5358, 'learning_rate': 7.47069533926609e-07, 'epoch': 4.5}

 28%|██▊       | 104540/371472 [8:18:47<22:20:39,  3.32it/s]
 28%|██▊       | 104541/371472 [8:18:48<21:51:53,  3.39it/s]
 28%|██▊       | 104542/371472 [8:18:48<21:26:19,  3.46it/s]
 28%|██▊       | 104543/371472 [8:18:48<20:53:09,  3.55it/s]
 28%|██▊       | 104544/371472 [8:18:48<20:46:10,  3.57it/s]
 28%|██▊       | 104545/371472 [8:18:49<20:43:03,  3.58it/s]
 28%|██▊       | 104546/371472 [8:18:49<20:09:26,  3.68it/s]
 28%|██▊       | 104547/371472 [8:18:49<20:21:49,  3.64it/s]
 28%|██▊       | 104548/371472 [8:18:50<22:27:36,  3.30it/s]
 28%|██▊       | 104549/371472 [8:18:50<22:22:32,  3.31it/s]
 28%|██▊       | 104550/371472 [8:18:50<22:20:08,  3.32it/s]
 28%|██▊       | 104551/371472 [8:18:51<21:15:04,  3.49it/s]
 28%|██▊       | 104552/371472 [8:18:51<20:50:09,  3.56it/s]
 28%|██▊       | 104553/371472 [8:18:51<20:46:39,  3.57it/s]
 28%|██▊       | 104554/371472 [8:18:51<20:13:38,  3.67it/s]
 28%|██▊       | 104555/371472 [8:18:52<19:53:16,  3.73it/s]
 28%|██▊       | 104556/371472 [8:18:52<20:10:18,  3.68it/s]
 28%|██▊       | 104557/371472 [8:18:52<20:48:08,  3.56it/s]
 28%|██▊       | 104558/371472 [8:18:52<20:20:11,  3.65it/s]
 28%|██▊       | 104559/371472 [8:18:53<20:30:28,  3.62it/s]
 28%|██▊       | 104560/371472 [8:18:53<21:43:23,  3.41it/s]
                                                            
{'loss': 3.3053, 'learning_rate': 7.470210519511301e-07, 'epoch': 4.5}

 28%|██▊       | 104560/371472 [8:18:53<21:43:23,  3.41it/s]
 28%|██▊       | 104561/371472 [8:18:53<21:27:38,  3.45it/s]
 28%|██▊       | 104562/371472 [8:18:54<20:39:18,  3.59it/s]
 28%|██▊       | 104563/371472 [8:18:54<21:41:11,  3.42it/s]
 28%|██▊       | 104564/371472 [8:18:54<22:30:25,  3.29it/s]
 28%|██▊       | 104565/371472 [8:18:55<29:59:18,  2.47it/s]
 28%|██▊       | 104566/371472 [8:18:55<28:27:41,  2.60it/s]
 28%|██▊       | 104567/371472 [8:18:55<25:52:41,  2.86it/s]
 28%|██▊       | 104568/371472 [8:18:56<24:53:59,  2.98it/s]
 28%|██▊       | 104569/371472 [8:18:56<23:16:06,  3.19it/s]
 28%|██▊       | 104570/371472 [8:18:56<22:30:12,  3.29it/s]
 28%|██▊       | 104571/371472 [8:18:57<22:55:59,  3.23it/s]
 28%|██▊       | 104572/371472 [8:18:57<21:29:13,  3.45it/s]
 28%|██▊       | 104573/371472 [8:18:57<20:36:51,  3.60it/s]
 28%|██▊       | 104574/371472 [8:18:57<19:56:19,  3.72it/s]
 28%|██▊       | 104575/371472 [8:18:58<19:22:32,  3.83it/s]
 28%|██▊       | 104576/371472 [8:18:58<20:25:25,  3.63it/s]
 28%|██▊       | 104577/371472 [8:18:58<20:36:38,  3.60it/s]
 28%|██▊       | 104578/371472 [8:18:58<19:59:31,  3.71it/s]
 28%|██▊       | 104579/371472 [8:18:59<20:03:47,  3.70it/s]
 28%|██▊       | 104580/371472 [8:18:59<19:56:28,  3.72it/s]
                                                            
{'loss': 3.467, 'learning_rate': 7.469725699756513e-07, 'epoch': 4.5}

 28%|██▊       | 104580/371472 [8:18:59<19:56:28,  3.72it/s]
 28%|██▊       | 104581/371472 [8:18:59<20:04:04,  3.69it/s]
 28%|██▊       | 104582/371472 [8:19:00<19:43:02,  3.76it/s]
 28%|██▊       | 104583/371472 [8:19:00<19:22:13,  3.83it/s]
 28%|██▊       | 104584/371472 [8:19:00<18:54:35,  3.92it/s]
 28%|██▊       | 104585/371472 [8:19:00<19:17:25,  3.84it/s]
 28%|██▊       | 104586/371472 [8:19:01<18:58:07,  3.91it/s]
 28%|██▊       | 104587/371472 [8:19:01<19:12:29,  3.86it/s]
 28%|██▊       | 104588/371472 [8:19:01<19:18:19,  3.84it/s]
 28%|██▊       | 104589/371472 [8:19:01<19:24:59,  3.82it/s]
 28%|██▊       | 104590/371472 [8:19:02<19:12:14,  3.86it/s]
 28%|██▊       | 104591/371472 [8:19:02<20:06:27,  3.69it/s]
 28%|██▊       | 104592/371472 [8:19:02<20:20:52,  3.64it/s]
 28%|██▊       | 104593/371472 [8:19:02<20:27:25,  3.62it/s]
 28%|██▊       | 104594/371472 [8:19:03<20:48:52,  3.56it/s]
 28%|██▊       | 104595/371472 [8:19:03<20:40:21,  3.59it/s]
 28%|██▊       | 104596/371472 [8:19:03<20:19:16,  3.65it/s]
 28%|██▊       | 104597/371472 [8:19:04<19:53:32,  3.73it/s]
 28%|██▊       | 104598/371472 [8:19:04<20:01:29,  3.70it/s]
 28%|██▊       | 104599/371472 [8:19:04<20:10:44,  3.67it/s]
 28%|██▊       | 104600/371472 [8:19:04<19:37:45,  3.78it/s]
                                                            
{'loss': 3.3649, 'learning_rate': 7.469240880001723e-07, 'epoch': 4.51}

 28%|██▊       | 104600/371472 [8:19:04<19:37:45,  3.78it/s]
 28%|██▊       | 104601/371472 [8:19:05<20:00:04,  3.71it/s]
 28%|██▊       | 104602/371472 [8:19:05<20:20:11,  3.65it/s]
 28%|██▊       | 104603/371472 [8:19:05<20:29:04,  3.62it/s]
 28%|██▊       | 104604/371472 [8:19:06<21:48:13,  3.40it/s]
 28%|██▊       | 104605/371472 [8:19:06<23:29:07,  3.16it/s]
 28%|██▊       | 104606/371472 [8:19:06<22:29:34,  3.30it/s]
 28%|██▊       | 104607/371472 [8:19:06<21:11:09,  3.50it/s]
 28%|██▊       | 104608/371472 [8:19:07<20:36:26,  3.60it/s]
 28%|██▊       | 104609/371472 [8:19:07<19:58:42,  3.71it/s]
 28%|██▊       | 104610/371472 [8:19:07<21:28:55,  3.45it/s]
 28%|██▊       | 104611/371472 [8:19:08<22:17:21,  3.33it/s]
 28%|██▊       | 104612/371472 [8:19:08<25:28:20,  2.91it/s]
 28%|██▊       | 104613/371472 [8:19:08<24:41:45,  3.00it/s]
 28%|██▊       | 104614/371472 [8:19:09<23:30:03,  3.15it/s]
 28%|██▊       | 104615/371472 [8:19:09<23:02:44,  3.22it/s]
 28%|██▊       | 104616/371472 [8:19:09<21:33:41,  3.44it/s]
 28%|██▊       | 104617/371472 [8:19:09<20:40:46,  3.58it/s]
 28%|██▊       | 104618/371472 [8:19:10<22:47:45,  3.25it/s]
 28%|██▊       | 104619/371472 [8:19:10<22:23:37,  3.31it/s]
 28%|██▊       | 104620/371472 [8:19:10<22:03:23,  3.36it/s]
                                                            
{'loss': 3.5051, 'learning_rate': 7.468756060246934e-07, 'epoch': 4.51}

 28%|██▊       | 104620/371472 [8:19:10<22:03:23,  3.36it/s]
 28%|██▊       | 104621/371472 [8:19:11<21:21:31,  3.47it/s]
 28%|██▊       | 104622/371472 [8:19:11<21:18:22,  3.48it/s]
 28%|██▊       | 104623/371472 [8:19:11<20:17:58,  3.65it/s]
 28%|██▊       | 104624/371472 [8:19:11<19:42:11,  3.76it/s]
 28%|██▊       | 104625/371472 [8:19:12<20:08:36,  3.68it/s]
 28%|██▊       | 104626/371472 [8:19:12<21:07:20,  3.51it/s]
 28%|██▊       | 104627/371472 [8:19:12<20:50:00,  3.56it/s]
 28%|██▊       | 104628/371472 [8:19:13<21:29:02,  3.45it/s]
 28%|██▊       | 104629/371472 [8:19:13<21:20:59,  3.47it/s]
 28%|██▊       | 104630/371472 [8:19:13<21:55:48,  3.38it/s]
 28%|██▊       | 104631/371472 [8:19:13<21:26:33,  3.46it/s]
 28%|██▊       | 104632/371472 [8:19:14<22:48:38,  3.25it/s]
 28%|██▊       | 104633/371472 [8:19:14<21:36:32,  3.43it/s]
 28%|██▊       | 104634/371472 [8:19:14<22:27:09,  3.30it/s]
 28%|██▊       | 104635/371472 [8:19:15<21:29:59,  3.45it/s]
 28%|██▊       | 104636/371472 [8:19:15<21:46:49,  3.40it/s]
 28%|██▊       | 104637/371472 [8:19:15<21:09:48,  3.50it/s]
 28%|██▊       | 104638/371472 [8:19:15<20:57:22,  3.54it/s]
 28%|██▊       | 104639/371472 [8:19:16<21:15:18,  3.49it/s]
 28%|██▊       | 104640/371472 [8:19:16<21:25:59,  3.46it/s]
                                                            
{'loss': 3.2979, 'learning_rate': 7.468271240492145e-07, 'epoch': 4.51}

 28%|██▊       | 104640/371472 [8:19:16<21:25:59,  3.46it/s]
 28%|██▊       | 104641/371472 [8:19:16<20:45:28,  3.57it/s]
 28%|██▊       | 104642/371472 [8:19:17<22:05:31,  3.36it/s]
 28%|██▊       | 104643/371472 [8:19:17<21:53:26,  3.39it/s]
 28%|██▊       | 104644/371472 [8:19:17<21:10:11,  3.50it/s]
 28%|██▊       | 104645/371472 [8:19:18<22:48:27,  3.25it/s]
 28%|██▊       | 104646/371472 [8:19:18<21:42:16,  3.41it/s]
 28%|██▊       | 104647/371472 [8:19:18<20:58:09,  3.53it/s]
 28%|██▊       | 104648/371472 [8:19:18<21:19:40,  3.48it/s]
 28%|██▊       | 104649/371472 [8:19:19<20:34:51,  3.60it/s]
 28%|██▊       | 104650/371472 [8:19:19<20:40:46,  3.58it/s]
 28%|██▊       | 104651/371472 [8:19:19<20:57:52,  3.54it/s]
 28%|██▊       | 104652/371472 [8:19:19<20:40:26,  3.58it/s]
 28%|██▊       | 104653/371472 [8:19:20<19:57:00,  3.72it/s]
 28%|██▊       | 104654/371472 [8:19:20<20:06:03,  3.69it/s]
 28%|██▊       | 104655/371472 [8:19:20<20:48:29,  3.56it/s]
 28%|██▊       | 104656/371472 [8:19:21<20:49:05,  3.56it/s]
 28%|██▊       | 104657/371472 [8:19:21<20:19:03,  3.65it/s]
 28%|██▊       | 104658/371472 [8:19:21<20:34:06,  3.60it/s]
 28%|██▊       | 104659/371472 [8:19:21<20:39:56,  3.59it/s]
 28%|██▊       | 104660/371472 [8:19:22<20:22:46,  3.64it/s]
                                                            
{'loss': 3.5733, 'learning_rate': 7.467786420737357e-07, 'epoch': 4.51}

 28%|██▊       | 104660/371472 [8:19:22<20:22:46,  3.64it/s]
 28%|██▊       | 104661/371472 [8:19:22<20:06:46,  3.68it/s]
 28%|██▊       | 104662/371472 [8:19:22<20:47:36,  3.56it/s]
 28%|██▊       | 104663/371472 [8:19:23<20:20:56,  3.64it/s]
 28%|██▊       | 104664/371472 [8:19:23<20:23:54,  3.63it/s]
 28%|██▊       | 104665/371472 [8:19:23<20:33:31,  3.60it/s]
 28%|██▊       | 104666/371472 [8:19:23<22:12:25,  3.34it/s]
 28%|██▊       | 104667/371472 [8:19:24<21:45:04,  3.41it/s]
 28%|██▊       | 104668/371472 [8:19:24<21:28:54,  3.45it/s]
 28%|██▊       | 104669/371472 [8:19:24<20:52:34,  3.55it/s]
 28%|██▊       | 104670/371472 [8:19:25<20:45:12,  3.57it/s]
 28%|██▊       | 104671/371472 [8:19:25<21:34:25,  3.44it/s]
 28%|██▊       | 104672/371472 [8:19:25<21:28:02,  3.45it/s]
 28%|██▊       | 104673/371472 [8:19:25<21:12:03,  3.50it/s]
 28%|██▊       | 104674/371472 [8:19:26<22:19:08,  3.32it/s]
 28%|██▊       | 104675/371472 [8:19:26<21:45:06,  3.41it/s]
 28%|██▊       | 104676/371472 [8:19:26<22:22:40,  3.31it/s]
 28%|██▊       | 104677/371472 [8:19:27<22:02:18,  3.36it/s]
 28%|██▊       | 104678/371472 [8:19:27<21:38:56,  3.42it/s]
 28%|██▊       | 104679/371472 [8:19:27<23:07:19,  3.21it/s]
 28%|██▊       | 104680/371472 [8:19:28<21:57:32,  3.37it/s]
                                                            
{'loss': 3.5325, 'learning_rate': 7.467301600982569e-07, 'epoch': 4.51}

 28%|██▊       | 104680/371472 [8:19:28<21:57:32,  3.37it/s]
 28%|██▊       | 104681/371472 [8:19:28<20:56:45,  3.54it/s]
 28%|██▊       | 104682/371472 [8:19:28<20:55:17,  3.54it/s]
 28%|██▊       | 104683/371472 [8:19:28<20:52:02,  3.55it/s]
 28%|██▊       | 104684/371472 [8:19:29<21:30:04,  3.45it/s]
 28%|██▊       | 104685/371472 [8:19:29<20:24:49,  3.63it/s]
 28%|██▊       | 104686/371472 [8:19:29<19:38:41,  3.77it/s]
 28%|██▊       | 104687/371472 [8:19:29<19:28:36,  3.80it/s]
 28%|██▊       | 104688/371472 [8:19:30<19:37:44,  3.78it/s]
 28%|██▊       | 104689/371472 [8:19:30<19:47:52,  3.74it/s]
 28%|██▊       | 104690/371472 [8:19:30<19:31:04,  3.80it/s]
 28%|██▊       | 104691/371472 [8:19:30<19:44:33,  3.75it/s]
 28%|██▊       | 104692/371472 [8:19:31<20:35:21,  3.60it/s]
 28%|██▊       | 104693/371472 [8:19:31<20:45:02,  3.57it/s]
 28%|██▊       | 104694/371472 [8:19:31<22:19:33,  3.32it/s]
 28%|██▊       | 104695/371472 [8:19:32<22:14:27,  3.33it/s]
 28%|██▊       | 104696/371472 [8:19:32<21:15:25,  3.49it/s]
 28%|██▊       | 104697/371472 [8:19:32<22:27:19,  3.30it/s]
 28%|██▊       | 104698/371472 [8:19:33<21:19:42,  3.47it/s]
 28%|██▊       | 104699/371472 [8:19:33<20:48:26,  3.56it/s]
 28%|██▊       | 104700/371472 [8:19:33<20:36:12,  3.60it/s]
                                                            
{'loss': 3.4373, 'learning_rate': 7.466816781227779e-07, 'epoch': 4.51}

 28%|██▊       | 104700/371472 [8:19:33<20:36:12,  3.60it/s]
 28%|██▊       | 104701/371472 [8:19:33<20:58:36,  3.53it/s]
 28%|██▊       | 104702/371472 [8:19:34<20:27:48,  3.62it/s]
 28%|██▊       | 104703/371472 [8:19:34<20:05:56,  3.69it/s]
 28%|██▊       | 104704/371472 [8:19:34<21:19:58,  3.47it/s]
 28%|██▊       | 104705/371472 [8:19:35<22:21:10,  3.32it/s]
 28%|██▊       | 104706/371472 [8:19:35<22:02:26,  3.36it/s]
 28%|██▊       | 104707/371472 [8:19:35<22:04:35,  3.36it/s]
 28%|██▊       | 104708/371472 [8:19:35<21:04:21,  3.52it/s]
 28%|██▊       | 104709/371472 [8:19:36<21:33:08,  3.44it/s]
 28%|██▊       | 104710/371472 [8:19:36<22:57:48,  3.23it/s]
 28%|██▊       | 104711/371472 [8:19:36<22:04:15,  3.36it/s]
 28%|██▊       | 104712/371472 [8:19:37<22:33:04,  3.29it/s]
 28%|██▊       | 104713/371472 [8:19:37<21:57:08,  3.38it/s]
 28%|██▊       | 104714/371472 [8:19:37<21:34:43,  3.43it/s]
 28%|██▊       | 104715/371472 [8:19:37<21:39:31,  3.42it/s]
 28%|██▊       | 104716/371472 [8:19:38<22:38:03,  3.27it/s]
 28%|██▊       | 104717/371472 [8:19:38<21:41:28,  3.42it/s]
 28%|██▊       | 104718/371472 [8:19:38<22:21:37,  3.31it/s]
 28%|██▊       | 104719/371472 [8:19:39<21:09:35,  3.50it/s]
 28%|██▊       | 104720/371472 [8:19:39<22:07:34,  3.35it/s]
                                                            
{'loss': 3.3197, 'learning_rate': 7.466331961472989e-07, 'epoch': 4.51}

 28%|██▊       | 104720/371472 [8:19:39<22:07:34,  3.35it/s]
 28%|██▊       | 104721/371472 [8:19:39<21:07:12,  3.51it/s]
 28%|██▊       | 104722/371472 [8:19:40<20:53:37,  3.55it/s]
 28%|██▊       | 104723/371472 [8:19:40<22:21:51,  3.31it/s]
 28%|██▊       | 104724/371472 [8:19:40<21:50:20,  3.39it/s]
 28%|██▊       | 104725/371472 [8:19:40<21:31:27,  3.44it/s]
 28%|██▊       | 104726/371472 [8:19:41<21:45:30,  3.41it/s]
 28%|██▊       | 104727/371472 [8:19:41<20:36:13,  3.60it/s]
 28%|██▊       | 104728/371472 [8:19:41<22:03:33,  3.36it/s]
 28%|██▊       | 104729/371472 [8:19:42<21:40:21,  3.42it/s]
 28%|██▊       | 104730/371472 [8:19:42<22:05:24,  3.35it/s]
 28%|██▊       | 104731/371472 [8:19:42<21:49:51,  3.39it/s]
 28%|██▊       | 104732/371472 [8:19:42<21:13:33,  3.49it/s]
 28%|██▊       | 104733/371472 [8:19:43<21:48:46,  3.40it/s]
 28%|██▊       | 104734/371472 [8:19:43<22:02:21,  3.36it/s]
 28%|██▊       | 104735/371472 [8:19:43<20:56:14,  3.54it/s]
 28%|██▊       | 104736/371472 [8:19:44<21:00:59,  3.53it/s]
 28%|██▊       | 104737/371472 [8:19:44<20:00:33,  3.70it/s]
 28%|██▊       | 104738/371472 [8:19:44<20:01:45,  3.70it/s]
 28%|██▊       | 104739/371472 [8:19:44<19:56:50,  3.71it/s]
 28%|██▊       | 104740/371472 [8:19:45<20:35:44,  3.60it/s]
                                                            
{'loss': 3.4607, 'learning_rate': 7.465847141718201e-07, 'epoch': 4.51}

 28%|██▊       | 104740/371472 [8:19:45<20:35:44,  3.60it/s]
 28%|██▊       | 104741/371472 [8:19:45<20:21:14,  3.64it/s]
 28%|██▊       | 104742/371472 [8:19:45<20:14:52,  3.66it/s]
 28%|██▊       | 104743/371472 [8:19:45<20:12:18,  3.67it/s]
 28%|██▊       | 104744/371472 [8:19:46<20:30:17,  3.61it/s]
 28%|██▊       | 104745/371472 [8:19:46<20:19:47,  3.64it/s]
 28%|██▊       | 104746/371472 [8:19:46<20:22:00,  3.64it/s]
 28%|██▊       | 104747/371472 [8:19:47<20:31:43,  3.61it/s]
 28%|██▊       | 104748/371472 [8:19:47<19:47:26,  3.74it/s]
 28%|██▊       | 104749/371472 [8:19:47<19:22:59,  3.82it/s]
 28%|██▊       | 104750/371472 [8:19:47<21:32:23,  3.44it/s]
 28%|██▊       | 104751/371472 [8:19:48<22:06:50,  3.35it/s]
 28%|██▊       | 104752/371472 [8:19:48<21:40:25,  3.42it/s]
 28%|██▊       | 104753/371472 [8:19:48<21:52:31,  3.39it/s]
 28%|██▊       | 104754/371472 [8:19:49<21:10:28,  3.50it/s]
 28%|██▊       | 104755/371472 [8:19:49<20:14:35,  3.66it/s]
 28%|██▊       | 104756/371472 [8:19:49<19:43:25,  3.76it/s]
 28%|██▊       | 104757/371472 [8:19:49<19:24:00,  3.82it/s]
 28%|██▊       | 104758/371472 [8:19:50<18:57:38,  3.91it/s]
 28%|██▊       | 104759/371472 [8:19:50<18:48:40,  3.94it/s]
 28%|██▊       | 104760/371472 [8:19:50<19:11:26,  3.86it/s]
                                                            
{'loss': 3.6503, 'learning_rate': 7.465362321963412e-07, 'epoch': 4.51}

 28%|██▊       | 104760/371472 [8:19:50<19:11:26,  3.86it/s]
 28%|██▊       | 104761/371472 [8:19:50<18:57:14,  3.91it/s]
 28%|██▊       | 104762/371472 [8:19:51<18:41:07,  3.96it/s]
 28%|██▊       | 104763/371472 [8:19:51<18:17:27,  4.05it/s]
 28%|██▊       | 104764/371472 [8:19:51<19:38:56,  3.77it/s]
 28%|██▊       | 104765/371472 [8:19:51<19:50:09,  3.73it/s]
 28%|██▊       | 104766/371472 [8:19:52<21:15:02,  3.49it/s]
 28%|██▊       | 104767/371472 [8:19:52<23:24:21,  3.17it/s]
 28%|██▊       | 104768/371472 [8:19:52<22:59:19,  3.22it/s]
 28%|██▊       | 104769/371472 [8:19:53<21:58:31,  3.37it/s]
 28%|██▊       | 104770/371472 [8:19:53<21:40:33,  3.42it/s]
 28%|██▊       | 104771/371472 [8:19:53<21:08:19,  3.50it/s]
 28%|██▊       | 104772/371472 [8:19:54<23:24:29,  3.16it/s]
 28%|██▊       | 104773/371472 [8:19:54<22:10:48,  3.34it/s]
 28%|██▊       | 104774/371472 [8:19:54<21:19:57,  3.47it/s]
 28%|██▊       | 104775/371472 [8:19:54<22:07:12,  3.35it/s]
 28%|██▊       | 104776/371472 [8:19:55<21:44:51,  3.41it/s]
 28%|██▊       | 104777/371472 [8:19:55<24:15:45,  3.05it/s]
 28%|██▊       | 104778/371472 [8:19:56<24:09:14,  3.07it/s]
 28%|██▊       | 104779/371472 [8:19:56<23:21:17,  3.17it/s]
 28%|██▊       | 104780/371472 [8:19:56<22:23:04,  3.31it/s]
                                                            
{'loss': 3.5161, 'learning_rate': 7.464877502208623e-07, 'epoch': 4.51}

 28%|██▊       | 104780/371472 [8:19:56<22:23:04,  3.31it/s]
 28%|██▊       | 104781/371472 [8:19:56<22:32:44,  3.29it/s]
 28%|██▊       | 104782/371472 [8:19:57<22:28:53,  3.30it/s]
 28%|██▊       | 104783/371472 [8:19:57<22:05:31,  3.35it/s]
 28%|██▊       | 104784/371472 [8:19:57<21:37:14,  3.43it/s]
 28%|██▊       | 104785/371472 [8:19:58<23:38:05,  3.13it/s]
 28%|██▊       | 104786/371472 [8:19:58<23:26:53,  3.16it/s]
 28%|██▊       | 104787/371472 [8:19:58<23:22:36,  3.17it/s]
 28%|██▊       | 104788/371472 [8:19:59<22:22:48,  3.31it/s]
 28%|██▊       | 104789/371472 [8:19:59<21:09:15,  3.50it/s]
 28%|██▊       | 104790/371472 [8:19:59<21:23:27,  3.46it/s]
 28%|██▊       | 104791/371472 [8:19:59<20:56:13,  3.54it/s]
 28%|██▊       | 104792/371472 [8:20:00<20:14:42,  3.66it/s]
 28%|██▊       | 104793/371472 [8:20:00<20:10:36,  3.67it/s]
 28%|██▊       | 104794/371472 [8:20:00<20:06:52,  3.68it/s]
 28%|██▊       | 104795/371472 [8:20:00<19:52:52,  3.73it/s]
 28%|██▊       | 104796/371472 [8:20:01<19:39:11,  3.77it/s]
 28%|██▊       | 104797/371472 [8:20:01<19:50:52,  3.73it/s]
 28%|██▊       | 104798/371472 [8:20:01<19:50:27,  3.73it/s]
 28%|██▊       | 104799/371472 [8:20:01<19:48:35,  3.74it/s]
 28%|██▊       | 104800/371472 [8:20:02<19:15:35,  3.85it/s]
                                                            
{'loss': 3.4362, 'learning_rate': 7.464392682453834e-07, 'epoch': 4.51}

 28%|██▊       | 104800/371472 [8:20:02<19:15:35,  3.85it/s]
 28%|██▊       | 104801/371472 [8:20:02<19:22:12,  3.82it/s]
 28%|██▊       | 104802/371472 [8:20:02<19:35:57,  3.78it/s]
 28%|██▊       | 104803/371472 [8:20:03<20:58:42,  3.53it/s]
 28%|██▊       | 104804/371472 [8:20:03<21:17:51,  3.48it/s]
 28%|██▊       | 104805/371472 [8:20:03<23:15:25,  3.19it/s]
 28%|██▊       | 104806/371472 [8:20:03<22:13:12,  3.33it/s]
 28%|██▊       | 104807/371472 [8:20:04<23:45:56,  3.12it/s]
 28%|██▊       | 104808/371472 [8:20:04<23:31:15,  3.15it/s]
 28%|██▊       | 104809/371472 [8:20:04<22:07:11,  3.35it/s]
 28%|██▊       | 104810/371472 [8:20:05<21:09:34,  3.50it/s]
 28%|██▊       | 104811/371472 [8:20:05<21:25:00,  3.46it/s]
 28%|██▊       | 104812/371472 [8:20:05<21:23:02,  3.46it/s]
 28%|██▊       | 104813/371472 [8:20:06<20:29:36,  3.61it/s]
 28%|██▊       | 104814/371472 [8:20:06<20:15:47,  3.66it/s]
 28%|██▊       | 104815/371472 [8:20:06<20:02:21,  3.70it/s]
 28%|██▊       | 104816/371472 [8:20:06<19:24:52,  3.82it/s]
 28%|██▊       | 104817/371472 [8:20:07<19:00:53,  3.90it/s]
 28%|██▊       | 104818/371472 [8:20:07<20:09:46,  3.67it/s]
 28%|██▊       | 104819/371472 [8:20:07<20:59:32,  3.53it/s]
 28%|██▊       | 104820/371472 [8:20:07<22:12:07,  3.34it/s]
                                                            
{'loss': 3.389, 'learning_rate': 7.463907862699046e-07, 'epoch': 4.51}

 28%|██▊       | 104820/371472 [8:20:07<22:12:07,  3.34it/s]
 28%|██▊       | 104821/371472 [8:20:08<21:32:50,  3.44it/s]
 28%|██▊       | 104822/371472 [8:20:08<21:02:49,  3.52it/s]
 28%|██▊       | 104823/371472 [8:20:08<20:52:22,  3.55it/s]
 28%|██▊       | 104824/371472 [8:20:09<20:09:19,  3.67it/s]
 28%|██▊       | 104825/371472 [8:20:09<20:00:10,  3.70it/s]
 28%|██▊       | 104826/371472 [8:20:09<20:25:26,  3.63it/s]
 28%|██▊       | 104827/371472 [8:20:09<20:39:10,  3.59it/s]
 28%|██▊       | 104828/371472 [8:20:10<21:09:34,  3.50it/s]
 28%|██▊       | 104829/371472 [8:20:10<22:16:40,  3.32it/s]
 28%|██▊       | 104830/371472 [8:20:10<21:17:50,  3.48it/s]
 28%|██▊       | 104831/371472 [8:20:11<20:56:28,  3.54it/s]
 28%|██▊       | 104832/371472 [8:20:11<21:30:14,  3.44it/s]
 28%|██▊       | 104833/371472 [8:20:11<20:22:26,  3.64it/s]
 28%|██▊       | 104834/371472 [8:20:11<20:07:10,  3.68it/s]
 28%|██▊       | 104835/371472 [8:20:12<19:38:41,  3.77it/s]
 28%|██▊       | 104836/371472 [8:20:12<19:42:05,  3.76it/s]
 28%|██▊       | 104837/371472 [8:20:12<20:57:35,  3.53it/s]
 28%|██▊       | 104838/371472 [8:20:12<20:51:57,  3.55it/s]
 28%|██▊       | 104839/371472 [8:20:13<20:23:06,  3.63it/s]
 28%|██▊       | 104840/371472 [8:20:13<20:56:37,  3.54it/s]
                                                            
{'loss': 3.6639, 'learning_rate': 7.463423042944257e-07, 'epoch': 4.52}

 28%|██▊       | 104840/371472 [8:20:13<20:56:37,  3.54it/s]
 28%|██▊       | 104841/371472 [8:20:13<20:40:44,  3.58it/s]
 28%|██▊       | 104842/371472 [8:20:14<21:05:03,  3.51it/s]
 28%|██▊       | 104843/371472 [8:20:14<20:04:30,  3.69it/s]
 28%|██▊       | 104844/371472 [8:20:14<21:06:10,  3.51it/s]
 28%|██▊       | 104845/371472 [8:20:14<21:15:17,  3.48it/s]
 28%|██▊       | 104846/371472 [8:20:15<21:38:32,  3.42it/s]
 28%|██▊       | 104847/371472 [8:20:15<20:46:54,  3.56it/s]
 28%|██▊       | 104848/371472 [8:20:15<20:36:02,  3.60it/s]
 28%|██▊       | 104849/371472 [8:20:16<20:08:21,  3.68it/s]
 28%|██▊       | 104850/371472 [8:20:16<20:23:37,  3.63it/s]
 28%|██▊       | 104851/371472 [8:20:16<26:30:30,  2.79it/s]
 28%|██▊       | 104852/371472 [8:20:17<25:00:56,  2.96it/s]
 28%|██▊       | 104853/371472 [8:20:17<24:17:28,  3.05it/s]
 28%|██▊       | 104854/371472 [8:20:17<24:29:42,  3.02it/s]
 28%|██▊       | 104855/371472 [8:20:18<22:57:16,  3.23it/s]
 28%|██▊       | 104856/371472 [8:20:18<22:00:23,  3.37it/s]
 28%|██▊       | 104857/371472 [8:20:18<22:15:22,  3.33it/s]
 28%|██▊       | 104858/371472 [8:20:18<22:15:26,  3.33it/s]
 28%|██▊       | 104859/371472 [8:20:19<21:30:23,  3.44it/s]
 28%|██▊       | 104860/371472 [8:20:19<21:27:40,  3.45it/s]
                                                            
{'loss': 3.4774, 'learning_rate': 7.462938223189466e-07, 'epoch': 4.52}

 28%|██▊       | 104860/371472 [8:20:19<21:27:40,  3.45it/s]
 28%|██▊       | 104861/371472 [8:20:19<21:17:50,  3.48it/s]
 28%|██▊       | 104862/371472 [8:20:20<23:08:13,  3.20it/s]
 28%|██▊       | 104863/371472 [8:20:20<21:53:21,  3.38it/s]
 28%|██▊       | 104864/371472 [8:20:20<22:37:59,  3.27it/s]
 28%|██▊       | 104865/371472 [8:20:21<21:30:37,  3.44it/s]
 28%|██▊       | 104866/371472 [8:20:21<21:47:33,  3.40it/s]
 28%|██▊       | 104867/371472 [8:20:21<26:43:06,  2.77it/s]
 28%|██▊       | 104868/371472 [8:20:22<26:30:40,  2.79it/s]
 28%|██▊       | 104869/371472 [8:20:22<23:56:59,  3.09it/s]
 28%|██▊       | 104870/371472 [8:20:22<24:15:32,  3.05it/s]
 28%|██▊       | 104871/371472 [8:20:23<22:50:13,  3.24it/s]
 28%|██▊       | 104872/371472 [8:20:23<21:51:06,  3.39it/s]
 28%|██▊       | 104873/371472 [8:20:23<22:32:26,  3.29it/s]
 28%|██▊       | 104874/371472 [8:20:23<21:24:49,  3.46it/s]
 28%|██▊       | 104875/371472 [8:20:24<20:17:34,  3.65it/s]
 28%|██▊       | 104876/371472 [8:20:24<20:00:32,  3.70it/s]
 28%|██▊       | 104877/371472 [8:20:24<19:52:14,  3.73it/s]
 28%|██▊       | 104878/371472 [8:20:24<20:42:14,  3.58it/s]
 28%|██▊       | 104879/371472 [8:20:25<20:38:32,  3.59it/s]
 28%|██▊       | 104880/371472 [8:20:25<21:16:49,  3.48it/s]
                                                            
{'loss': 3.2268, 'learning_rate': 7.462453403434678e-07, 'epoch': 4.52}

 28%|██▊       | 104880/371472 [8:20:25<21:16:49,  3.48it/s]
 28%|██▊       | 104881/371472 [8:20:25<22:06:17,  3.35it/s]
 28%|██▊       | 104882/371472 [8:20:26<22:19:56,  3.32it/s]
 28%|██▊       | 104883/371472 [8:20:26<21:03:21,  3.52it/s]
 28%|██▊       | 104884/371472 [8:20:26<21:12:41,  3.49it/s]
 28%|██▊       | 104885/371472 [8:20:26<21:33:51,  3.43it/s]
 28%|██▊       | 104886/371472 [8:20:27<21:11:34,  3.49it/s]
 28%|██▊       | 104887/371472 [8:20:27<20:30:50,  3.61it/s]
 28%|██▊       | 104888/371472 [8:20:27<22:39:34,  3.27it/s]
 28%|██▊       | 104889/371472 [8:20:28<21:56:09,  3.38it/s]
 28%|██▊       | 104890/371472 [8:20:28<22:19:35,  3.32it/s]
 28%|██▊       | 104891/371472 [8:20:28<21:36:39,  3.43it/s]
 28%|██▊       | 104892/371472 [8:20:29<21:15:08,  3.48it/s]
 28%|██▊       | 104893/371472 [8:20:29<21:48:26,  3.40it/s]
 28%|██▊       | 104894/371472 [8:20:29<22:14:39,  3.33it/s]
 28%|██▊       | 104895/371472 [8:20:29<22:50:49,  3.24it/s]
 28%|██▊       | 104896/371472 [8:20:30<22:23:37,  3.31it/s]
 28%|██▊       | 104897/371472 [8:20:30<22:14:31,  3.33it/s]
 28%|██▊       | 104898/371472 [8:20:30<21:49:29,  3.39it/s]
 28%|██▊       | 104899/371472 [8:20:31<20:57:40,  3.53it/s]
 28%|██▊       | 104900/371472 [8:20:31<21:03:27,  3.52it/s]
                                                            
{'loss': 3.5172, 'learning_rate': 7.46196858367989e-07, 'epoch': 4.52}

 28%|██▊       | 104900/371472 [8:20:31<21:03:27,  3.52it/s]
 28%|██▊       | 104901/371472 [8:20:31<20:52:14,  3.55it/s]
 28%|██▊       | 104902/371472 [8:20:31<20:45:07,  3.57it/s]
 28%|██▊       | 104903/371472 [8:20:32<21:35:04,  3.43it/s]
 28%|██▊       | 104904/371472 [8:20:32<21:14:18,  3.49it/s]
 28%|██▊       | 104905/371472 [8:20:32<21:16:29,  3.48it/s]
 28%|██▊       | 104906/371472 [8:20:33<20:48:44,  3.56it/s]
 28%|██▊       | 104907/371472 [8:20:33<20:21:07,  3.64it/s]
 28%|██▊       | 104908/371472 [8:20:33<20:35:26,  3.60it/s]
 28%|██▊       | 104909/371472 [8:20:33<19:44:44,  3.75it/s]
 28%|██▊       | 104910/371472 [8:20:34<19:39:34,  3.77it/s]
 28%|██▊       | 104911/371472 [8:20:34<20:13:19,  3.66it/s]
 28%|██▊       | 104912/371472 [8:20:34<20:39:10,  3.59it/s]
 28%|██▊       | 104913/371472 [8:20:35<20:38:15,  3.59it/s]
 28%|██▊       | 104914/371472 [8:20:35<21:19:17,  3.47it/s]
 28%|██▊       | 104915/371472 [8:20:35<20:30:29,  3.61it/s]
 28%|██▊       | 104916/371472 [8:20:35<20:07:20,  3.68it/s]
 28%|██▊       | 104917/371472 [8:20:36<20:50:25,  3.55it/s]
 28%|██▊       | 104918/371472 [8:20:36<20:11:06,  3.67it/s]
 28%|██▊       | 104919/371472 [8:20:36<20:17:31,  3.65it/s]
 28%|██▊       | 104920/371472 [8:20:37<21:52:16,  3.39it/s]
                                                            
{'loss': 3.5388, 'learning_rate': 7.461483763925101e-07, 'epoch': 4.52}

 28%|██▊       | 104920/371472 [8:20:37<21:52:16,  3.39it/s]
 28%|██▊       | 104921/371472 [8:20:37<21:12:02,  3.49it/s]
 28%|██▊       | 104922/371472 [8:20:37<22:58:22,  3.22it/s]
 28%|██▊       | 104923/371472 [8:20:37<22:14:39,  3.33it/s]
 28%|██▊       | 104924/371472 [8:20:38<22:23:03,  3.31it/s]
 28%|██▊       | 104925/371472 [8:20:38<21:08:42,  3.50it/s]
 28%|██▊       | 104926/371472 [8:20:39<30:55:12,  2.39it/s]
 28%|██▊       | 104927/371472 [8:20:39<27:07:39,  2.73it/s]
 28%|██▊       | 104928/371472 [8:20:39<25:20:25,  2.92it/s]
 28%|██▊       | 104929/371472 [8:20:39<23:23:32,  3.17it/s]
 28%|██▊       | 104930/371472 [8:20:40<23:20:54,  3.17it/s]
 28%|██▊       | 104931/371472 [8:20:40<22:22:53,  3.31it/s]
 28%|██▊       | 104932/371472 [8:20:40<21:18:56,  3.47it/s]
 28%|██▊       | 104933/371472 [8:20:41<21:18:14,  3.48it/s]
 28%|██▊       | 104934/371472 [8:20:41<21:43:41,  3.41it/s]
 28%|██▊       | 104935/371472 [8:20:41<21:06:21,  3.51it/s]
 28%|██▊       | 104936/371472 [8:20:42<22:49:05,  3.24it/s]
 28%|██▊       | 104937/371472 [8:20:42<22:00:27,  3.36it/s]
 28%|██▊       | 104938/371472 [8:20:42<21:59:53,  3.37it/s]
 28%|██▊       | 104939/371472 [8:20:42<21:24:14,  3.46it/s]
 28%|██▊       | 104940/371472 [8:20:43<21:18:38,  3.47it/s]
                                                            
{'loss': 3.5466, 'learning_rate': 7.460998944170311e-07, 'epoch': 4.52}

 28%|██▊       | 104940/371472 [8:20:43<21:18:38,  3.47it/s]
 28%|██▊       | 104941/371472 [8:20:43<20:33:38,  3.60it/s]
 28%|██▊       | 104942/371472 [8:20:43<20:04:26,  3.69it/s]
 28%|██▊       | 104943/371472 [8:20:43<19:21:19,  3.83it/s]
 28%|██▊       | 104944/371472 [8:20:44<19:33:58,  3.78it/s]
 28%|██▊       | 104945/371472 [8:20:44<19:27:43,  3.80it/s]
 28%|██▊       | 104946/371472 [8:20:44<19:40:41,  3.76it/s]
 28%|██▊       | 104947/371472 [8:20:44<19:07:53,  3.87it/s]
 28%|██▊       | 104948/371472 [8:20:45<19:39:57,  3.76it/s]
 28%|██▊       | 104949/371472 [8:20:45<19:32:16,  3.79it/s]
 28%|██▊       | 104950/371472 [8:20:45<20:25:34,  3.62it/s]
 28%|██▊       | 104951/371472 [8:20:46<21:51:12,  3.39it/s]
 28%|██▊       | 104952/371472 [8:20:46<21:06:51,  3.51it/s]
 28%|██▊       | 104953/371472 [8:20:46<21:43:35,  3.41it/s]
 28%|██▊       | 104954/371472 [8:20:46<20:38:20,  3.59it/s]
 28%|██▊       | 104955/371472 [8:20:47<20:14:22,  3.66it/s]
 28%|██▊       | 104956/371472 [8:20:47<20:40:48,  3.58it/s]
 28%|██▊       | 104957/371472 [8:20:47<20:07:22,  3.68it/s]
 28%|██▊       | 104958/371472 [8:20:48<20:27:41,  3.62it/s]
 28%|██▊       | 104959/371472 [8:20:48<20:39:00,  3.59it/s]
 28%|██▊       | 104960/371472 [8:20:48<21:09:38,  3.50it/s]
                                                            
{'loss': 3.3623, 'learning_rate': 7.460514124415523e-07, 'epoch': 4.52}

 28%|██▊       | 104960/371472 [8:20:48<21:09:38,  3.50it/s]
 28%|██▊       | 104961/371472 [8:20:49<22:42:41,  3.26it/s]
 28%|██▊       | 104962/371472 [8:20:49<22:05:36,  3.35it/s]
 28%|██▊       | 104963/371472 [8:20:49<20:58:16,  3.53it/s]
 28%|██▊       | 104964/371472 [8:20:49<20:17:29,  3.65it/s]
 28%|██▊       | 104965/371472 [8:20:50<19:49:15,  3.73it/s]
 28%|██▊       | 104966/371472 [8:20:50<19:53:43,  3.72it/s]
 28%|██▊       | 104967/371472 [8:20:50<21:15:21,  3.48it/s]
 28%|██▊       | 104968/371472 [8:20:50<21:13:41,  3.49it/s]
 28%|██▊       | 104969/371472 [8:20:51<20:54:34,  3.54it/s]
 28%|██▊       | 104970/371472 [8:20:51<21:27:38,  3.45it/s]
 28%|██▊       | 104971/371472 [8:20:51<21:35:15,  3.43it/s]
 28%|██▊       | 104972/371472 [8:20:52<22:08:40,  3.34it/s]
 28%|██▊       | 104973/371472 [8:20:52<21:36:05,  3.43it/s]
 28%|██▊       | 104974/371472 [8:20:52<23:12:59,  3.19it/s]
 28%|██▊       | 104975/371472 [8:20:53<22:15:43,  3.33it/s]
 28%|██▊       | 104976/371472 [8:20:53<21:02:45,  3.52it/s]
 28%|██▊       | 104977/371472 [8:20:53<21:07:23,  3.50it/s]
 28%|██▊       | 104978/371472 [8:20:53<22:02:24,  3.36it/s]
 28%|██▊       | 104979/371472 [8:20:54<21:12:23,  3.49it/s]
 28%|██▊       | 104980/371472 [8:20:54<20:37:24,  3.59it/s]
                                                            
{'loss': 3.479, 'learning_rate': 7.460029304660733e-07, 'epoch': 4.52}

 28%|██▊       | 104980/371472 [8:20:54<20:37:24,  3.59it/s]
 28%|██▊       | 104981/371472 [8:20:54<20:56:13,  3.54it/s]
 28%|██▊       | 104982/371472 [8:20:54<20:11:59,  3.66it/s]
 28%|██▊       | 104983/371472 [8:20:55<20:46:07,  3.56it/s]
 28%|██▊       | 104984/371472 [8:20:55<21:23:34,  3.46it/s]
 28%|██▊       | 104985/371472 [8:20:55<20:39:39,  3.58it/s]
 28%|██▊       | 104986/371472 [8:20:56<20:12:24,  3.66it/s]
 28%|██▊       | 104987/371472 [8:20:56<19:42:14,  3.76it/s]
 28%|██▊       | 104988/371472 [8:20:56<20:00:14,  3.70it/s]
 28%|██▊       | 104989/371472 [8:20:56<20:47:15,  3.56it/s]
 28%|██▊       | 104990/371472 [8:20:57<21:36:23,  3.43it/s]
 28%|██▊       | 104991/371472 [8:20:57<22:54:49,  3.23it/s]
 28%|██▊       | 104992/371472 [8:20:57<22:24:56,  3.30it/s]
 28%|██▊       | 104993/371472 [8:20:58<23:10:13,  3.19it/s]
 28%|██▊       | 104994/371472 [8:20:58<21:49:49,  3.39it/s]
 28%|██▊       | 104995/371472 [8:20:58<21:18:53,  3.47it/s]
 28%|██▊       | 104996/371472 [8:20:58<21:01:41,  3.52it/s]
 28%|██▊       | 104997/371472 [8:20:59<20:33:26,  3.60it/s]
 28%|██▊       | 104998/371472 [8:20:59<20:15:25,  3.65it/s]
 28%|██▊       | 104999/371472 [8:20:59<19:47:41,  3.74it/s]
 28%|██▊       | 105000/371472 [8:21:00<19:12:51,  3.85it/s]
                                                            
{'loss': 3.4183, 'learning_rate': 7.459544484905945e-07, 'epoch': 4.52}

 28%|██▊       | 105000/371472 [8:21:00<19:12:51,  3.85it/s]
 28%|██▊       | 105001/371472 [8:21:00<20:16:35,  3.65it/s]
 28%|██▊       | 105002/371472 [8:21:00<19:53:21,  3.72it/s]
 28%|██▊       | 105003/371472 [8:21:00<19:46:36,  3.74it/s]
 28%|██▊       | 105004/371472 [8:21:01<19:52:50,  3.72it/s]
 28%|██▊       | 105005/371472 [8:21:01<19:24:20,  3.81it/s]
 28%|██▊       | 105006/371472 [8:21:01<19:47:04,  3.74it/s]
 28%|██▊       | 105007/371472 [8:21:01<20:11:47,  3.66it/s]
 28%|██▊       | 105008/371472 [8:21:02<20:26:50,  3.62it/s]
 28%|██▊       | 105009/371472 [8:21:02<21:11:54,  3.49it/s]
 28%|██▊       | 105010/371472 [8:21:02<20:49:29,  3.55it/s]
 28%|██▊       | 105011/371472 [8:21:03<22:49:46,  3.24it/s]
 28%|██▊       | 105012/371472 [8:21:03<22:11:40,  3.33it/s]
 28%|██▊       | 105013/371472 [8:21:03<21:40:15,  3.42it/s]
 28%|██▊       | 105014/371472 [8:21:04<22:26:20,  3.30it/s]
 28%|██▊       | 105015/371472 [8:21:04<22:44:49,  3.25it/s]
 28%|██▊       | 105016/371472 [8:21:04<21:26:24,  3.45it/s]
 28%|██▊       | 105017/371472 [8:21:04<21:19:03,  3.47it/s]
 28%|██▊       | 105018/371472 [8:21:05<20:34:01,  3.60it/s]
 28%|██▊       | 105019/371472 [8:21:05<19:40:40,  3.76it/s]
 28%|██▊       | 105020/371472 [8:21:05<19:34:06,  3.78it/s]
                                                            
{'loss': 3.3884, 'learning_rate': 7.459059665151155e-07, 'epoch': 4.52}

 28%|██▊       | 105020/371472 [8:21:05<19:34:06,  3.78it/s]
 28%|██▊       | 105021/371472 [8:21:05<20:16:16,  3.65it/s]
 28%|██▊       | 105022/371472 [8:21:06<20:34:55,  3.60it/s]
 28%|██▊       | 105023/371472 [8:21:06<21:20:48,  3.47it/s]
 28%|██▊       | 105024/371472 [8:21:06<20:24:50,  3.63it/s]
 28%|██▊       | 105025/371472 [8:21:07<21:27:23,  3.45it/s]
 28%|██▊       | 105026/371472 [8:21:07<21:26:38,  3.45it/s]
 28%|██▊       | 105027/371472 [8:21:07<20:42:52,  3.57it/s]
 28%|██▊       | 105028/371472 [8:21:07<20:15:20,  3.65it/s]
 28%|██▊       | 105029/371472 [8:21:08<20:26:24,  3.62it/s]
 28%|██▊       | 105030/371472 [8:21:08<20:24:36,  3.63it/s]
 28%|██▊       | 105031/371472 [8:21:08<21:52:22,  3.38it/s]
 28%|██▊       | 105032/371472 [8:21:09<21:23:06,  3.46it/s]
 28%|██▊       | 105033/371472 [8:21:09<21:03:51,  3.51it/s]
 28%|██▊       | 105034/371472 [8:21:09<20:44:56,  3.57it/s]
 28%|██▊       | 105035/371472 [8:21:09<21:24:25,  3.46it/s]
 28%|██▊       | 105036/371472 [8:21:10<20:26:18,  3.62it/s]
 28%|██▊       | 105037/371472 [8:21:10<19:48:59,  3.73it/s]
 28%|██▊       | 105038/371472 [8:21:10<21:20:38,  3.47it/s]
 28%|██▊       | 105039/371472 [8:21:11<21:24:43,  3.46it/s]
 28%|██▊       | 105040/371472 [8:21:11<20:40:48,  3.58it/s]
                                                            
{'loss': 3.6151, 'learning_rate': 7.458574845396367e-07, 'epoch': 4.52}

 28%|██▊       | 105040/371472 [8:21:11<20:40:48,  3.58it/s]
 28%|██▊       | 105041/371472 [8:21:11<19:58:09,  3.71it/s]
 28%|██▊       | 105042/371472 [8:21:11<20:42:09,  3.57it/s]
 28%|██▊       | 105043/371472 [8:21:12<20:41:13,  3.58it/s]
 28%|██▊       | 105044/371472 [8:21:12<20:41:07,  3.58it/s]
 28%|██▊       | 105045/371472 [8:21:12<20:09:18,  3.67it/s]
 28%|██▊       | 105046/371472 [8:21:12<20:37:44,  3.59it/s]
 28%|██▊       | 105047/371472 [8:21:13<20:03:47,  3.69it/s]
 28%|██▊       | 105048/371472 [8:21:13<20:30:58,  3.61it/s]
 28%|██▊       | 105049/371472 [8:21:13<20:56:53,  3.53it/s]
 28%|██▊       | 105050/371472 [8:21:14<20:44:55,  3.57it/s]
 28%|██▊       | 105051/371472 [8:21:14<20:35:46,  3.59it/s]
 28%|██▊       | 105052/371472 [8:21:14<20:19:06,  3.64it/s]
 28%|██▊       | 105053/371472 [8:21:14<20:01:43,  3.69it/s]
 28%|██▊       | 105054/371472 [8:21:15<21:23:29,  3.46it/s]
 28%|██▊       | 105055/371472 [8:21:15<21:14:22,  3.48it/s]
 28%|██▊       | 105056/371472 [8:21:15<20:56:55,  3.53it/s]
 28%|██▊       | 105057/371472 [8:21:16<20:20:52,  3.64it/s]
 28%|██▊       | 105058/371472 [8:21:16<19:42:30,  3.75it/s]
 28%|██▊       | 105059/371472 [8:21:16<19:23:41,  3.82it/s]
 28%|██▊       | 105060/371472 [8:21:16<22:05:52,  3.35it/s]
                                                            
{'loss': 3.3566, 'learning_rate': 7.458090025641578e-07, 'epoch': 4.53}

 28%|██▊       | 105060/371472 [8:21:16<22:05:52,  3.35it/s]
 28%|██▊       | 105061/371472 [8:21:17<20:58:55,  3.53it/s]
 28%|██▊       | 105062/371472 [8:21:17<20:17:53,  3.65it/s]
 28%|██▊       | 105063/371472 [8:21:17<20:01:12,  3.70it/s]
 28%|██▊       | 105064/371472 [8:21:17<20:17:07,  3.65it/s]
 28%|██▊       | 105065/371472 [8:21:18<20:02:52,  3.69it/s]
 28%|██▊       | 105066/371472 [8:21:18<19:58:35,  3.70it/s]
 28%|██▊       | 105067/371472 [8:21:18<20:23:09,  3.63it/s]
 28%|██▊       | 105068/371472 [8:21:19<20:56:45,  3.53it/s]
 28%|██▊       | 105069/371472 [8:21:19<20:19:22,  3.64it/s]
 28%|██▊       | 105070/371472 [8:21:19<20:07:41,  3.68it/s]
 28%|██▊       | 105071/371472 [8:21:19<20:08:32,  3.67it/s]
 28%|██▊       | 105072/371472 [8:21:20<21:56:48,  3.37it/s]
 28%|██▊       | 105073/371472 [8:21:20<20:57:31,  3.53it/s]
 28%|██▊       | 105074/371472 [8:21:20<20:37:53,  3.59it/s]
 28%|██▊       | 105075/371472 [8:21:21<20:41:34,  3.58it/s]
 28%|██▊       | 105076/371472 [8:21:21<20:14:25,  3.66it/s]
 28%|██▊       | 105077/371472 [8:21:21<19:54:07,  3.72it/s]
 28%|██▊       | 105078/371472 [8:21:21<20:33:17,  3.60it/s]
 28%|██▊       | 105079/371472 [8:21:22<20:05:33,  3.68it/s]
 28%|██▊       | 105080/371472 [8:21:22<20:01:29,  3.70it/s]
                                                            
{'loss': 3.4119, 'learning_rate': 7.457605205886789e-07, 'epoch': 4.53}

 28%|██▊       | 105080/371472 [8:21:22<20:01:29,  3.70it/s]
 28%|██▊       | 105081/371472 [8:21:22<20:16:41,  3.65it/s]
 28%|██▊       | 105082/371472 [8:21:22<19:49:17,  3.73it/s]
 28%|██▊       | 105083/371472 [8:21:23<22:16:49,  3.32it/s]
 28%|██▊       | 105084/371472 [8:21:23<21:41:13,  3.41it/s]
 28%|██▊       | 105085/371472 [8:21:23<20:49:06,  3.55it/s]
 28%|██▊       | 105086/371472 [8:21:24<21:10:36,  3.49it/s]
 28%|██▊       | 105087/371472 [8:21:24<20:34:41,  3.60it/s]
 28%|██▊       | 105088/371472 [8:21:24<20:34:42,  3.60it/s]
 28%|██▊       | 105089/371472 [8:21:24<20:28:18,  3.61it/s]
 28%|██▊       | 105090/371472 [8:21:25<21:07:40,  3.50it/s]
 28%|██▊       | 105091/371472 [8:21:25<20:42:03,  3.57it/s]
 28%|██▊       | 105092/371472 [8:21:25<20:10:13,  3.67it/s]
 28%|██▊       | 105093/371472 [8:21:26<20:04:29,  3.69it/s]
 28%|██▊       | 105094/371472 [8:21:26<20:17:47,  3.65it/s]
 28%|██▊       | 105095/371472 [8:21:26<19:39:25,  3.76it/s]
 28%|██▊       | 105096/371472 [8:21:26<20:47:58,  3.56it/s]
 28%|██▊       | 105097/371472 [8:21:27<20:45:16,  3.57it/s]
 28%|██▊       | 105098/371472 [8:21:27<20:13:11,  3.66it/s]
 28%|██▊       | 105099/371472 [8:21:27<20:02:36,  3.69it/s]
 28%|██▊       | 105100/371472 [8:21:27<19:32:13,  3.79it/s]
                                                            
{'loss': 3.5635, 'learning_rate': 7.457120386131999e-07, 'epoch': 4.53}

 28%|██▊       | 105100/371472 [8:21:27<19:32:13,  3.79it/s]
 28%|██▊       | 105101/371472 [8:21:28<20:00:09,  3.70it/s]
 28%|██▊       | 105102/371472 [8:21:28<20:05:16,  3.68it/s]
 28%|██▊       | 105103/371472 [8:21:28<21:30:46,  3.44it/s]
 28%|██▊       | 105104/371472 [8:21:29<21:26:38,  3.45it/s]
 28%|██▊       | 105105/371472 [8:21:29<21:28:45,  3.44it/s]
 28%|██▊       | 105106/371472 [8:21:29<20:54:03,  3.54it/s]
 28%|██▊       | 105107/371472 [8:21:29<21:14:33,  3.48it/s]
 28%|██▊       | 105108/371472 [8:21:30<21:19:03,  3.47it/s]
 28%|██▊       | 105109/371472 [8:21:30<21:33:46,  3.43it/s]
 28%|██▊       | 105110/371472 [8:21:30<20:54:44,  3.54it/s]
 28%|██▊       | 105111/371472 [8:21:31<21:26:42,  3.45it/s]
 28%|██▊       | 105112/371472 [8:21:31<21:03:39,  3.51it/s]
 28%|██▊       | 105113/371472 [8:21:31<21:22:15,  3.46it/s]
 28%|██▊       | 105114/371472 [8:21:31<21:30:40,  3.44it/s]
 28%|██▊       | 105115/371472 [8:21:32<21:13:04,  3.49it/s]
 28%|██▊       | 105116/371472 [8:21:32<21:24:25,  3.46it/s]
 28%|██▊       | 105117/371472 [8:21:32<21:36:39,  3.42it/s]
 28%|██▊       | 105118/371472 [8:21:33<22:29:03,  3.29it/s]
 28%|██▊       | 105119/371472 [8:21:33<23:13:10,  3.19it/s]
 28%|██▊       | 105120/371472 [8:21:33<23:31:22,  3.15it/s]
                                                            
{'loss': 3.4142, 'learning_rate': 7.456635566377211e-07, 'epoch': 4.53}

 28%|██▊       | 105120/371472 [8:21:33<23:31:22,  3.15it/s]
 28%|██▊       | 105121/371472 [8:21:34<23:03:21,  3.21it/s]
 28%|██▊       | 105122/371472 [8:21:34<22:38:18,  3.27it/s]
 28%|██▊       | 105123/371472 [8:21:34<22:09:40,  3.34it/s]
 28%|██▊       | 105124/371472 [8:21:35<22:27:27,  3.29it/s]
 28%|██▊       | 105125/371472 [8:21:35<23:37:39,  3.13it/s]
 28%|██▊       | 105126/371472 [8:21:35<24:26:41,  3.03it/s]
 28%|██▊       | 105127/371472 [8:21:36<23:53:17,  3.10it/s]
 28%|██▊       | 105128/371472 [8:21:36<23:52:22,  3.10it/s]
 28%|██▊       | 105129/371472 [8:21:36<23:57:29,  3.09it/s]
 28%|██▊       | 105130/371472 [8:21:36<22:49:29,  3.24it/s]
 28%|██▊       | 105131/371472 [8:21:37<22:01:09,  3.36it/s]
 28%|██▊       | 105132/371472 [8:21:37<21:23:02,  3.46it/s]
 28%|██▊       | 105133/371472 [8:21:37<20:44:10,  3.57it/s]
 28%|██▊       | 105134/371472 [8:21:38<20:23:22,  3.63it/s]
 28%|██▊       | 105135/371472 [8:21:38<20:28:38,  3.61it/s]
 28%|██▊       | 105136/371472 [8:21:38<19:56:27,  3.71it/s]
 28%|██▊       | 105137/371472 [8:21:38<20:13:51,  3.66it/s]
 28%|██▊       | 105138/371472 [8:21:39<19:58:17,  3.70it/s]
 28%|██▊       | 105139/371472 [8:21:39<21:05:00,  3.51it/s]
 28%|██▊       | 105140/371472 [8:21:39<20:19:36,  3.64it/s]
                                                            
{'loss': 3.5333, 'learning_rate': 7.456150746622422e-07, 'epoch': 4.53}

 28%|██▊       | 105140/371472 [8:21:39<20:19:36,  3.64it/s]
 28%|██▊       | 105141/371472 [8:21:39<19:56:12,  3.71it/s]
 28%|██▊       | 105142/371472 [8:21:40<19:32:41,  3.79it/s]
 28%|██▊       | 105143/371472 [8:21:40<19:30:04,  3.79it/s]
 28%|██▊       | 105144/371472 [8:21:40<20:06:48,  3.68it/s]
 28%|██▊       | 105145/371472 [8:21:41<19:53:45,  3.72it/s]
 28%|██▊       | 105146/371472 [8:21:41<20:13:23,  3.66it/s]
 28%|██▊       | 105147/371472 [8:21:41<20:30:52,  3.61it/s]
 28%|██▊       | 105148/371472 [8:21:41<20:53:48,  3.54it/s]
 28%|██▊       | 105149/371472 [8:21:42<20:34:38,  3.60it/s]
 28%|██▊       | 105150/371472 [8:21:42<20:44:55,  3.57it/s]
 28%|██▊       | 105151/371472 [8:21:42<21:34:57,  3.43it/s]
 28%|██▊       | 105152/371472 [8:21:43<23:32:20,  3.14it/s]
 28%|██▊       | 105153/371472 [8:21:43<22:27:47,  3.29it/s]
 28%|██▊       | 105154/371472 [8:21:43<21:04:17,  3.51it/s]
 28%|██▊       | 105155/371472 [8:21:43<20:37:15,  3.59it/s]
 28%|██▊       | 105156/371472 [8:21:44<20:19:18,  3.64it/s]
 28%|██▊       | 105157/371472 [8:21:44<21:16:46,  3.48it/s]
 28%|██▊       | 105158/371472 [8:21:44<21:17:20,  3.47it/s]
 28%|██▊       | 105159/371472 [8:21:45<20:42:21,  3.57it/s]
 28%|██▊       | 105160/371472 [8:21:45<20:16:22,  3.65it/s]
                                                            
{'loss': 3.6108, 'learning_rate': 7.455665926867632e-07, 'epoch': 4.53}

 28%|██▊       | 105160/371472 [8:21:45<20:16:22,  3.65it/s]
 28%|██▊       | 105161/371472 [8:21:45<21:20:37,  3.47it/s]
 28%|██▊       | 105162/371472 [8:21:45<20:39:08,  3.58it/s]
 28%|██▊       | 105163/371472 [8:21:46<19:55:01,  3.71it/s]
 28%|██▊       | 105164/371472 [8:21:46<19:32:58,  3.78it/s]
 28%|██▊       | 105165/371472 [8:21:46<19:22:16,  3.82it/s]
 28%|██▊       | 105166/371472 [8:21:46<20:08:38,  3.67it/s]
 28%|██▊       | 105167/371472 [8:21:47<19:58:45,  3.70it/s]
 28%|██▊       | 105168/371472 [8:21:47<19:51:07,  3.73it/s]
 28%|██▊       | 105169/371472 [8:21:47<19:27:19,  3.80it/s]
 28%|██▊       | 105170/371472 [8:21:47<19:53:08,  3.72it/s]
 28%|██▊       | 105171/371472 [8:21:48<19:40:12,  3.76it/s]
 28%|██▊       | 105172/371472 [8:21:48<19:03:50,  3.88it/s]
 28%|██▊       | 105173/371472 [8:21:48<19:44:38,  3.75it/s]
 28%|██▊       | 105174/371472 [8:21:49<21:22:51,  3.46it/s]
 28%|██▊       | 105175/371472 [8:21:49<20:43:35,  3.57it/s]
 28%|██▊       | 105176/371472 [8:21:49<20:17:10,  3.65it/s]
 28%|██▊       | 105177/371472 [8:21:49<19:15:38,  3.84it/s]
 28%|██▊       | 105178/371472 [8:21:50<19:08:39,  3.86it/s]
 28%|██▊       | 105179/371472 [8:21:50<19:39:23,  3.76it/s]
 28%|██▊       | 105180/371472 [8:21:50<19:48:08,  3.74it/s]
                                                            
{'loss': 3.5274, 'learning_rate': 7.455181107112844e-07, 'epoch': 4.53}

 28%|██▊       | 105180/371472 [8:21:50<19:48:08,  3.74it/s]
 28%|██▊       | 105181/371472 [8:21:50<20:35:45,  3.59it/s]
 28%|██▊       | 105182/371472 [8:21:51<21:15:47,  3.48it/s]
 28%|██▊       | 105183/371472 [8:21:51<20:21:18,  3.63it/s]
 28%|██▊       | 105184/371472 [8:21:51<20:06:57,  3.68it/s]
 28%|██▊       | 105185/371472 [8:21:52<20:15:33,  3.65it/s]
 28%|██▊       | 105186/371472 [8:21:52<19:49:53,  3.73it/s]
 28%|██▊       | 105187/371472 [8:21:52<20:29:00,  3.61it/s]
 28%|██▊       | 105188/371472 [8:21:52<20:35:03,  3.59it/s]
 28%|██▊       | 105189/371472 [8:21:53<19:57:42,  3.71it/s]
 28%|██▊       | 105190/371472 [8:21:53<20:01:30,  3.69it/s]
 28%|██▊       | 105191/371472 [8:21:53<20:18:28,  3.64it/s]
 28%|██▊       | 105192/371472 [8:21:54<21:32:48,  3.43it/s]
 28%|██▊       | 105193/371472 [8:21:54<22:12:58,  3.33it/s]
 28%|██▊       | 105194/371472 [8:21:54<21:11:17,  3.49it/s]
 28%|██▊       | 105195/371472 [8:21:54<20:32:02,  3.60it/s]
 28%|██▊       | 105196/371472 [8:21:55<21:55:13,  3.37it/s]
 28%|██▊       | 105197/371472 [8:21:55<22:39:24,  3.26it/s]
 28%|██▊       | 105198/371472 [8:21:55<22:13:46,  3.33it/s]
 28%|██▊       | 105199/371472 [8:21:56<21:08:55,  3.50it/s]
 28%|██▊       | 105200/371472 [8:21:56<20:35:19,  3.59it/s]
                                                            
{'loss': 3.3089, 'learning_rate': 7.454696287358057e-07, 'epoch': 4.53}

 28%|██▊       | 105200/371472 [8:21:56<20:35:19,  3.59it/s]
 28%|██▊       | 105201/371472 [8:21:56<19:58:26,  3.70it/s]
 28%|██▊       | 105202/371472 [8:21:56<20:08:36,  3.67it/s]
 28%|██▊       | 105203/371472 [8:21:57<20:01:03,  3.69it/s]
 28%|██▊       | 105204/371472 [8:21:57<19:52:14,  3.72it/s]
 28%|██▊       | 105205/371472 [8:21:57<20:31:22,  3.60it/s]
 28%|██▊       | 105206/371472 [8:21:57<20:03:21,  3.69it/s]
 28%|██▊       | 105207/371472 [8:21:58<19:48:28,  3.73it/s]
 28%|██▊       | 105208/371472 [8:21:58<20:37:19,  3.59it/s]
 28%|██▊       | 105209/371472 [8:21:58<21:32:33,  3.43it/s]
 28%|██▊       | 105210/371472 [8:21:59<22:06:16,  3.35it/s]
 28%|██▊       | 105211/371472 [8:21:59<21:50:38,  3.39it/s]
 28%|██▊       | 105212/371472 [8:21:59<20:57:26,  3.53it/s]
 28%|██▊       | 105213/371472 [8:22:00<21:33:48,  3.43it/s]
 28%|██▊       | 105214/371472 [8:22:00<22:20:04,  3.31it/s]
 28%|██▊       | 105215/371472 [8:22:00<21:26:55,  3.45it/s]
 28%|██▊       | 105216/371472 [8:22:00<20:14:36,  3.65it/s]
 28%|██▊       | 105217/371472 [8:22:01<21:21:36,  3.46it/s]
 28%|██▊       | 105218/371472 [8:22:01<20:48:22,  3.55it/s]
 28%|██▊       | 105219/371472 [8:22:01<21:36:31,  3.42it/s]
 28%|██▊       | 105220/371472 [8:22:02<21:30:34,  3.44it/s]
                                                            
{'loss': 3.4432, 'learning_rate': 7.454211467603267e-07, 'epoch': 4.53}

 28%|██▊       | 105220/371472 [8:22:02<21:30:34,  3.44it/s]
 28%|██▊       | 105221/371472 [8:22:02<26:23:51,  2.80it/s]
 28%|██▊       | 105222/371472 [8:22:02<24:20:20,  3.04it/s]
 28%|██▊       | 105223/371472 [8:22:03<23:36:40,  3.13it/s]
 28%|██▊       | 105224/371472 [8:22:03<22:11:04,  3.33it/s]
 28%|██▊       | 105225/371472 [8:22:03<21:15:58,  3.48it/s]
 28%|██▊       | 105226/371472 [8:22:03<20:41:34,  3.57it/s]
 28%|██▊       | 105227/371472 [8:22:04<20:04:33,  3.68it/s]
 28%|██▊       | 105228/371472 [8:22:04<19:57:49,  3.70it/s]
 28%|██▊       | 105229/371472 [8:22:04<19:37:31,  3.77it/s]
 28%|██▊       | 105230/371472 [8:22:04<21:14:38,  3.48it/s]
 28%|██▊       | 105231/371472 [8:22:05<21:11:47,  3.49it/s]
 28%|██▊       | 105232/371472 [8:22:05<21:22:27,  3.46it/s]
 28%|██▊       | 105233/371472 [8:22:05<22:24:52,  3.30it/s]
 28%|██▊       | 105234/371472 [8:22:06<22:16:44,  3.32it/s]
 28%|██▊       | 105235/371472 [8:22:06<21:18:05,  3.47it/s]
 28%|██▊       | 105236/371472 [8:22:06<21:12:37,  3.49it/s]
 28%|██▊       | 105237/371472 [8:22:07<21:26:17,  3.45it/s]
 28%|██▊       | 105238/371472 [8:22:07<21:31:28,  3.44it/s]
 28%|██▊       | 105239/371472 [8:22:07<20:18:54,  3.64it/s]
 28%|██▊       | 105240/371472 [8:22:07<20:00:45,  3.70it/s]
                                                            
{'loss': 3.4167, 'learning_rate': 7.453726647848476e-07, 'epoch': 4.53}

 28%|██▊       | 105240/371472 [8:22:07<20:00:45,  3.70it/s]
 28%|██▊       | 105241/371472 [8:22:08<19:27:55,  3.80it/s]
 28%|██▊       | 105242/371472 [8:22:08<20:25:58,  3.62it/s]
 28%|██▊       | 105243/371472 [8:22:08<20:05:20,  3.68it/s]
 28%|██▊       | 105244/371472 [8:22:08<19:47:52,  3.74it/s]
 28%|██▊       | 105245/371472 [8:22:09<19:37:37,  3.77it/s]
 28%|██▊       | 105246/371472 [8:22:09<19:46:38,  3.74it/s]
 28%|██▊       | 105247/371472 [8:22:09<20:50:44,  3.55it/s]
 28%|██▊       | 105248/371472 [8:22:09<19:56:56,  3.71it/s]
 28%|██▊       | 105249/371472 [8:22:10<21:18:25,  3.47it/s]
 28%|██▊       | 105250/371472 [8:22:10<21:09:59,  3.49it/s]
 28%|██▊       | 105251/371472 [8:22:10<21:37:31,  3.42it/s]
 28%|██▊       | 105252/371472 [8:22:11<20:56:39,  3.53it/s]
 28%|██▊       | 105253/371472 [8:22:11<19:52:41,  3.72it/s]
 28%|██▊       | 105254/371472 [8:22:11<19:17:26,  3.83it/s]
 28%|██▊       | 105255/371472 [8:22:11<19:53:34,  3.72it/s]
 28%|██▊       | 105256/371472 [8:22:12<19:39:13,  3.76it/s]
 28%|██▊       | 105257/371472 [8:22:12<20:11:53,  3.66it/s]
 28%|██▊       | 105258/371472 [8:22:12<20:59:54,  3.52it/s]
 28%|██▊       | 105259/371472 [8:22:13<21:04:13,  3.51it/s]
 28%|██▊       | 105260/371472 [8:22:13<21:00:13,  3.52it/s]
                                                            
{'loss': 3.4467, 'learning_rate': 7.453241828093688e-07, 'epoch': 4.53}

 28%|██▊       | 105260/371472 [8:22:13<21:00:13,  3.52it/s]
 28%|██▊       | 105261/371472 [8:22:13<22:09:04,  3.34it/s]
 28%|██▊       | 105262/371472 [8:22:13<21:39:02,  3.42it/s]
 28%|██▊       | 105263/371472 [8:22:14<22:07:18,  3.34it/s]
 28%|██▊       | 105264/371472 [8:22:14<21:07:22,  3.50it/s]
 28%|██▊       | 105265/371472 [8:22:14<20:19:19,  3.64it/s]
 28%|██▊       | 105266/371472 [8:22:15<21:53:06,  3.38it/s]
 28%|██▊       | 105267/371472 [8:22:15<21:33:16,  3.43it/s]
 28%|██▊       | 105268/371472 [8:22:15<25:13:39,  2.93it/s]
 28%|██▊       | 105269/371472 [8:22:16<23:10:16,  3.19it/s]
 28%|██▊       | 105270/371472 [8:22:16<22:17:23,  3.32it/s]
 28%|██▊       | 105271/371472 [8:22:16<21:26:38,  3.45it/s]
 28%|██▊       | 105272/371472 [8:22:16<20:59:13,  3.52it/s]
 28%|██▊       | 105273/371472 [8:22:17<20:32:31,  3.60it/s]
 28%|██▊       | 105274/371472 [8:22:17<21:17:52,  3.47it/s]
 28%|██▊       | 105275/371472 [8:22:17<21:34:50,  3.43it/s]
 28%|██▊       | 105276/371472 [8:22:18<21:22:27,  3.46it/s]
 28%|██▊       | 105277/371472 [8:22:18<20:27:32,  3.61it/s]
 28%|██▊       | 105278/371472 [8:22:18<19:53:33,  3.72it/s]
 28%|██▊       | 105279/371472 [8:22:18<19:52:33,  3.72it/s]
 28%|██▊       | 105280/371472 [8:22:19<20:04:20,  3.68it/s]
                                                            
{'loss': 3.5601, 'learning_rate': 7.4527570083389e-07, 'epoch': 4.53}

 28%|██▊       | 105280/371472 [8:22:19<20:04:20,  3.68it/s]
 28%|██▊       | 105281/371472 [8:22:19<19:57:54,  3.70it/s]
 28%|██▊       | 105282/371472 [8:22:19<19:48:23,  3.73it/s]
 28%|██▊       | 105283/371472 [8:22:19<19:18:02,  3.83it/s]
 28%|██▊       | 105284/371472 [8:22:20<19:23:13,  3.81it/s]
 28%|██▊       | 105285/371472 [8:22:20<19:35:49,  3.77it/s]
 28%|██▊       | 105286/371472 [8:22:20<19:38:28,  3.76it/s]
 28%|██▊       | 105287/371472 [8:22:20<19:08:21,  3.86it/s]
 28%|██▊       | 105288/371472 [8:22:21<19:41:42,  3.75it/s]
 28%|██▊       | 105289/371472 [8:22:21<19:53:55,  3.72it/s]
 28%|██▊       | 105290/371472 [8:22:21<19:41:56,  3.75it/s]
 28%|██▊       | 105291/371472 [8:22:22<19:37:48,  3.77it/s]
 28%|██▊       | 105292/371472 [8:22:22<19:43:20,  3.75it/s]
 28%|██▊       | 105293/371472 [8:22:22<20:28:13,  3.61it/s]
 28%|██▊       | 105294/371472 [8:22:22<19:59:20,  3.70it/s]
 28%|██▊       | 105295/371472 [8:22:23<19:51:58,  3.72it/s]
 28%|██▊       | 105296/371472 [8:22:23<19:40:56,  3.76it/s]
 28%|██▊       | 105297/371472 [8:22:23<20:22:06,  3.63it/s]
 28%|██▊       | 105298/371472 [8:22:23<19:45:59,  3.74it/s]
 28%|██▊       | 105299/371472 [8:22:24<20:16:35,  3.65it/s]
 28%|██▊       | 105300/371472 [8:22:24<20:38:12,  3.58it/s]
                                                            
{'loss': 3.5308, 'learning_rate': 7.452272188584111e-07, 'epoch': 4.54}

 28%|██▊       | 105300/371472 [8:22:24<20:38:12,  3.58it/s]
 28%|██▊       | 105301/371472 [8:22:24<19:59:15,  3.70it/s]
 28%|██▊       | 105302/371472 [8:22:25<20:20:07,  3.64it/s]
 28%|██▊       | 105303/371472 [8:22:25<21:10:48,  3.49it/s]
 28%|██▊       | 105304/371472 [8:22:25<21:28:08,  3.44it/s]
 28%|██▊       | 105305/371472 [8:22:25<21:26:24,  3.45it/s]
 28%|██▊       | 105306/371472 [8:22:26<20:18:06,  3.64it/s]
 28%|██▊       | 105307/371472 [8:22:26<20:47:18,  3.56it/s]
 28%|██▊       | 105308/371472 [8:22:26<20:53:18,  3.54it/s]
 28%|██▊       | 105309/371472 [8:22:27<22:36:53,  3.27it/s]
 28%|██▊       | 105310/371472 [8:22:27<21:35:53,  3.42it/s]
 28%|██▊       | 105311/371472 [8:22:27<21:24:56,  3.45it/s]
 28%|██▊       | 105312/371472 [8:22:27<20:47:43,  3.56it/s]
 28%|██▊       | 105313/371472 [8:22:28<20:08:28,  3.67it/s]
 28%|██▊       | 105314/371472 [8:22:28<21:08:45,  3.50it/s]
 28%|██▊       | 105315/371472 [8:22:28<21:03:40,  3.51it/s]
 28%|██▊       | 105316/371472 [8:22:29<20:32:12,  3.60it/s]
 28%|██▊       | 105317/371472 [8:22:29<21:12:26,  3.49it/s]
 28%|██▊       | 105318/371472 [8:22:29<21:24:46,  3.45it/s]
 28%|██▊       | 105319/371472 [8:22:29<20:28:51,  3.61it/s]
 28%|██▊       | 105320/371472 [8:22:30<20:11:39,  3.66it/s]
                                                            
{'loss': 3.3293, 'learning_rate': 7.451787368829321e-07, 'epoch': 4.54}

 28%|██▊       | 105320/371472 [8:22:30<20:11:39,  3.66it/s]
 28%|██▊       | 105321/371472 [8:22:30<19:38:49,  3.76it/s]
 28%|██▊       | 105322/371472 [8:22:30<19:29:38,  3.79it/s]
 28%|██▊       | 105323/371472 [8:22:31<21:00:31,  3.52it/s]
 28%|██▊       | 105324/371472 [8:22:31<20:53:10,  3.54it/s]
 28%|██▊       | 105325/371472 [8:22:31<20:27:37,  3.61it/s]
 28%|██▊       | 105326/371472 [8:22:31<20:24:53,  3.62it/s]
 28%|██▊       | 105327/371472 [8:22:32<20:26:01,  3.62it/s]
 28%|██▊       | 105328/371472 [8:22:32<20:06:58,  3.68it/s]
 28%|██▊       | 105329/371472 [8:22:32<21:10:42,  3.49it/s]
 28%|██▊       | 105330/371472 [8:22:32<20:02:56,  3.69it/s]
 28%|██▊       | 105331/371472 [8:22:33<20:08:56,  3.67it/s]
 28%|██▊       | 105332/371472 [8:22:33<21:56:05,  3.37it/s]
 28%|██▊       | 105333/371472 [8:22:33<21:59:13,  3.36it/s]
 28%|██▊       | 105334/371472 [8:22:34<22:03:38,  3.35it/s]
 28%|██▊       | 105335/371472 [8:22:34<21:29:41,  3.44it/s]
 28%|██▊       | 105336/371472 [8:22:34<21:31:22,  3.43it/s]
 28%|██▊       | 105337/371472 [8:22:35<21:25:36,  3.45it/s]
 28%|██▊       | 105338/371472 [8:22:35<22:13:55,  3.33it/s]
 28%|██▊       | 105339/371472 [8:22:35<21:18:19,  3.47it/s]
 28%|██▊       | 105340/371472 [8:22:35<20:32:19,  3.60it/s]
                                                            
{'loss': 3.4035, 'learning_rate': 7.451302549074533e-07, 'epoch': 4.54}

 28%|██▊       | 105340/371472 [8:22:35<20:32:19,  3.60it/s]
 28%|██▊       | 105341/371472 [8:22:36<20:53:04,  3.54it/s]
 28%|██▊       | 105342/371472 [8:22:36<23:55:22,  3.09it/s]
 28%|██▊       | 105343/371472 [8:22:36<24:24:58,  3.03it/s]
 28%|██▊       | 105344/371472 [8:22:37<23:31:02,  3.14it/s]
 28%|██▊       | 105345/371472 [8:22:37<24:30:02,  3.02it/s]
 28%|██▊       | 105346/371472 [8:22:37<22:58:34,  3.22it/s]
 28%|██▊       | 105347/371472 [8:22:38<22:31:43,  3.28it/s]
 28%|██▊       | 105348/371472 [8:22:38<21:46:27,  3.39it/s]
 28%|██▊       | 105349/371472 [8:22:38<23:44:38,  3.11it/s]
 28%|██▊       | 105350/371472 [8:22:39<22:24:04,  3.30it/s]
 28%|██▊       | 105351/371472 [8:22:39<21:19:47,  3.47it/s]
 28%|██▊       | 105352/371472 [8:22:39<20:41:53,  3.57it/s]
 28%|██▊       | 105353/371472 [8:22:39<22:07:28,  3.34it/s]
 28%|██▊       | 105354/371472 [8:22:40<21:22:06,  3.46it/s]
 28%|██▊       | 105355/371472 [8:22:40<20:44:47,  3.56it/s]
 28%|██▊       | 105356/371472 [8:22:40<20:08:42,  3.67it/s]
 28%|██▊       | 105357/371472 [8:22:40<19:48:44,  3.73it/s]
 28%|██▊       | 105358/371472 [8:22:41<19:58:57,  3.70it/s]
 28%|██▊       | 105359/371472 [8:22:41<20:30:28,  3.60it/s]
 28%|██▊       | 105360/371472 [8:22:41<21:24:29,  3.45it/s]
                                                            
{'loss': 3.4777, 'learning_rate': 7.450817729319744e-07, 'epoch': 4.54}

 28%|██▊       | 105360/371472 [8:22:41<21:24:29,  3.45it/s]
 28%|██▊       | 105361/371472 [8:22:42<22:15:16,  3.32it/s]
 28%|██▊       | 105362/371472 [8:22:42<21:22:35,  3.46it/s]
 28%|██▊       | 105363/371472 [8:22:42<20:47:05,  3.56it/s]
 28%|██▊       | 105364/371472 [8:22:42<21:27:58,  3.44it/s]
 28%|██▊       | 105365/371472 [8:22:43<21:21:44,  3.46it/s]
 28%|██▊       | 105366/371472 [8:22:43<20:46:30,  3.56it/s]
 28%|██▊       | 105367/371472 [8:22:43<20:25:55,  3.62it/s]
 28%|██▊       | 105368/371472 [8:22:44<19:53:16,  3.72it/s]
 28%|██▊       | 105369/371472 [8:22:44<20:30:01,  3.61it/s]
 28%|██▊       | 105370/371472 [8:22:44<21:18:30,  3.47it/s]
 28%|██▊       | 105371/371472 [8:22:44<21:34:38,  3.43it/s]
 28%|██▊       | 105372/371472 [8:22:45<22:54:21,  3.23it/s]
 28%|██▊       | 105373/371472 [8:22:45<21:48:01,  3.39it/s]
 28%|██▊       | 105374/371472 [8:22:45<21:34:01,  3.43it/s]
 28%|██▊       | 105375/371472 [8:22:46<20:58:10,  3.52it/s]
 28%|██▊       | 105376/371472 [8:22:46<21:28:01,  3.44it/s]
 28%|██▊       | 105377/371472 [8:22:46<21:45:06,  3.40it/s]
 28%|██▊       | 105378/371472 [8:22:46<21:08:34,  3.50it/s]
 28%|██▊       | 105379/371472 [8:22:47<22:36:18,  3.27it/s]
 28%|██▊       | 105380/371472 [8:22:47<21:29:30,  3.44it/s]
                                                            
{'loss': 3.5998, 'learning_rate': 7.450332909564955e-07, 'epoch': 4.54}

 28%|██▊       | 105380/371472 [8:22:47<21:29:30,  3.44it/s]
 28%|██▊       | 105381/371472 [8:22:47<20:49:25,  3.55it/s]
 28%|██▊       | 105382/371472 [8:22:48<19:55:44,  3.71it/s]
 28%|██▊       | 105383/371472 [8:22:48<19:49:09,  3.73it/s]
 28%|██▊       | 105384/371472 [8:22:48<20:00:35,  3.69it/s]
 28%|██▊       | 105385/371472 [8:22:48<21:45:44,  3.40it/s]
 28%|██▊       | 105386/371472 [8:22:49<21:15:20,  3.48it/s]
 28%|██▊       | 105387/371472 [8:22:49<21:16:12,  3.47it/s]
 28%|██▊       | 105388/371472 [8:22:49<20:38:49,  3.58it/s]
 28%|██▊       | 105389/371472 [8:22:50<21:08:51,  3.50it/s]
 28%|██▊       | 105390/371472 [8:22:50<20:38:04,  3.58it/s]
 28%|██▊       | 105391/371472 [8:22:50<20:37:26,  3.58it/s]
 28%|██▊       | 105392/371472 [8:22:50<19:47:59,  3.73it/s]
 28%|██▊       | 105393/371472 [8:22:51<20:02:06,  3.69it/s]
 28%|██▊       | 105394/371472 [8:22:51<20:22:48,  3.63it/s]
 28%|██▊       | 105395/371472 [8:22:51<20:35:21,  3.59it/s]
 28%|██▊       | 105396/371472 [8:22:52<20:36:39,  3.59it/s]
 28%|██▊       | 105397/371472 [8:22:52<22:08:03,  3.34it/s]
 28%|██▊       | 105398/371472 [8:22:52<21:17:16,  3.47it/s]
 28%|██▊       | 105399/371472 [8:22:52<22:24:56,  3.30it/s]
 28%|██▊       | 105400/371472 [8:22:53<21:58:08,  3.36it/s]
                                                            
{'loss': 3.367, 'learning_rate': 7.449848089810165e-07, 'epoch': 4.54}

 28%|██▊       | 105400/371472 [8:22:53<21:58:08,  3.36it/s]
 28%|██▊       | 105401/371472 [8:22:53<22:48:30,  3.24it/s]
 28%|██▊       | 105402/371472 [8:22:53<23:16:38,  3.18it/s]
 28%|██▊       | 105403/371472 [8:22:54<21:55:42,  3.37it/s]
 28%|██▊       | 105404/371472 [8:22:54<21:08:40,  3.50it/s]
 28%|██▊       | 105405/371472 [8:22:54<21:06:16,  3.50it/s]
 28%|██▊       | 105406/371472 [8:22:55<22:51:12,  3.23it/s]
 28%|██▊       | 105407/371472 [8:22:55<22:04:59,  3.35it/s]
 28%|██▊       | 105408/371472 [8:22:55<21:52:14,  3.38it/s]
 28%|██▊       | 105409/371472 [8:22:55<21:18:22,  3.47it/s]
 28%|██▊       | 105410/371472 [8:22:56<20:40:35,  3.57it/s]
 28%|██▊       | 105411/371472 [8:22:56<21:19:47,  3.46it/s]
 28%|██▊       | 105412/371472 [8:22:56<20:27:54,  3.61it/s]
 28%|██▊       | 105413/371472 [8:22:57<20:14:40,  3.65it/s]
 28%|██▊       | 105414/371472 [8:22:57<21:42:56,  3.40it/s]
 28%|██▊       | 105415/371472 [8:22:57<22:23:47,  3.30it/s]
 28%|██▊       | 105416/371472 [8:22:57<22:19:37,  3.31it/s]
 28%|██▊       | 105417/371472 [8:22:58<21:01:03,  3.52it/s]
 28%|██▊       | 105418/371472 [8:22:58<20:35:42,  3.59it/s]
 28%|██▊       | 105419/371472 [8:22:58<20:34:13,  3.59it/s]
 28%|██▊       | 105420/371472 [8:22:59<20:14:42,  3.65it/s]
                                                            
{'loss': 3.638, 'learning_rate': 7.449363270055377e-07, 'epoch': 4.54}

 28%|██▊       | 105420/371472 [8:22:59<20:14:42,  3.65it/s]
 28%|██▊       | 105421/371472 [8:22:59<19:59:36,  3.70it/s]
 28%|██▊       | 105422/371472 [8:22:59<20:11:03,  3.66it/s]
 28%|██▊       | 105423/371472 [8:22:59<19:59:26,  3.70it/s]
 28%|██▊       | 105424/371472 [8:23:00<19:51:59,  3.72it/s]
 28%|██▊       | 105425/371472 [8:23:00<20:12:36,  3.66it/s]
 28%|██▊       | 105426/371472 [8:23:00<19:24:02,  3.81it/s]
 28%|██▊       | 105427/371472 [8:23:00<19:52:16,  3.72it/s]
 28%|██▊       | 105428/371472 [8:23:01<20:09:16,  3.67it/s]
 28%|██▊       | 105429/371472 [8:23:01<20:59:40,  3.52it/s]
 28%|██▊       | 105430/371472 [8:23:01<20:39:43,  3.58it/s]
 28%|██▊       | 105431/371472 [8:23:02<19:51:06,  3.72it/s]
 28%|██▊       | 105432/371472 [8:23:02<19:11:49,  3.85it/s]
 28%|██▊       | 105433/371472 [8:23:02<19:29:20,  3.79it/s]
 28%|██▊       | 105434/371472 [8:23:02<20:02:43,  3.69it/s]
 28%|██▊       | 105435/371472 [8:23:03<19:59:36,  3.70it/s]
 28%|██▊       | 105436/371472 [8:23:03<22:45:17,  3.25it/s]
 28%|██▊       | 105437/371472 [8:23:03<22:56:13,  3.22it/s]
 28%|██▊       | 105438/371472 [8:23:04<22:45:13,  3.25it/s]
 28%|██▊       | 105439/371472 [8:23:04<24:24:13,  3.03it/s]
 28%|██▊       | 105440/371472 [8:23:04<22:34:20,  3.27it/s]
                                                            
{'loss': 3.4904, 'learning_rate': 7.448878450300589e-07, 'epoch': 4.54}

 28%|██▊       | 105440/371472 [8:23:04<22:34:20,  3.27it/s]
 28%|██▊       | 105441/371472 [8:23:05<22:43:10,  3.25it/s]
 28%|██▊       | 105442/371472 [8:23:05<22:52:53,  3.23it/s]
 28%|██▊       | 105443/371472 [8:23:05<21:41:50,  3.41it/s]
 28%|██▊       | 105444/371472 [8:23:05<22:09:40,  3.33it/s]
 28%|██▊       | 105445/371472 [8:23:06<23:43:47,  3.11it/s]
 28%|██▊       | 105446/371472 [8:23:06<23:03:53,  3.20it/s]
 28%|██▊       | 105447/371472 [8:23:06<22:57:37,  3.22it/s]
 28%|██▊       | 105448/371472 [8:23:07<23:36:50,  3.13it/s]
 28%|██▊       | 105449/371472 [8:23:07<22:13:40,  3.32it/s]
 28%|██▊       | 105450/371472 [8:23:07<20:58:15,  3.52it/s]
 28%|██▊       | 105451/371472 [8:23:08<22:24:15,  3.30it/s]
 28%|██▊       | 105452/371472 [8:23:08<22:38:35,  3.26it/s]
 28%|██▊       | 105453/371472 [8:23:08<22:14:57,  3.32it/s]
 28%|██▊       | 105454/371472 [8:23:08<22:28:31,  3.29it/s]
 28%|██▊       | 105455/371472 [8:23:09<21:52:22,  3.38it/s]
 28%|██▊       | 105456/371472 [8:23:09<21:36:10,  3.42it/s]
 28%|██▊       | 105457/371472 [8:23:09<20:48:51,  3.55it/s]
 28%|██▊       | 105458/371472 [8:23:10<20:41:23,  3.57it/s]
 28%|██▊       | 105459/371472 [8:23:10<21:48:47,  3.39it/s]
 28%|██▊       | 105460/371472 [8:23:10<21:56:48,  3.37it/s]
                                                            
{'loss': 3.4241, 'learning_rate': 7.4483936305458e-07, 'epoch': 4.54}

 28%|██▊       | 105460/371472 [8:23:10<21:56:48,  3.37it/s]
 28%|██▊       | 105461/371472 [8:23:10<21:11:10,  3.49it/s]
 28%|██▊       | 105462/371472 [8:23:11<21:33:26,  3.43it/s]
 28%|██▊       | 105463/371472 [8:23:11<22:00:22,  3.36it/s]
 28%|██▊       | 105464/371472 [8:23:11<22:27:16,  3.29it/s]
 28%|██▊       | 105465/371472 [8:23:12<21:29:40,  3.44it/s]
 28%|██▊       | 105466/371472 [8:23:12<20:36:23,  3.59it/s]
 28%|██▊       | 105467/371472 [8:23:12<20:10:33,  3.66it/s]
 28%|██▊       | 105468/371472 [8:23:12<19:31:40,  3.78it/s]
 28%|██▊       | 105469/371472 [8:23:13<19:26:49,  3.80it/s]
 28%|██▊       | 105470/371472 [8:23:13<20:30:41,  3.60it/s]
 28%|██▊       | 105471/371472 [8:23:13<19:56:20,  3.71it/s]
 28%|██▊       | 105472/371472 [8:23:13<19:22:27,  3.81it/s]
 28%|██▊       | 105473/371472 [8:23:14<19:16:11,  3.83it/s]
 28%|██▊       | 105474/371472 [8:23:14<21:16:04,  3.47it/s]
 28%|██▊       | 105475/371472 [8:23:14<22:15:36,  3.32it/s]
 28%|██▊       | 105476/371472 [8:23:15<21:42:01,  3.40it/s]
 28%|██▊       | 105477/371472 [8:23:15<20:48:53,  3.55it/s]
 28%|██▊       | 105478/371472 [8:23:15<20:20:20,  3.63it/s]
 28%|██▊       | 105479/371472 [8:23:15<20:16:18,  3.64it/s]
 28%|██▊       | 105480/371472 [8:23:16<20:12:34,  3.66it/s]
                                                            
{'loss': 3.319, 'learning_rate': 7.44790881079101e-07, 'epoch': 4.54}

 28%|██▊       | 105480/371472 [8:23:16<20:12:34,  3.66it/s]
 28%|██▊       | 105481/371472 [8:23:16<20:55:45,  3.53it/s]
 28%|██▊       | 105482/371472 [8:23:16<20:46:24,  3.56it/s]
 28%|██▊       | 105483/371472 [8:23:17<21:13:33,  3.48it/s]
 28%|██▊       | 105484/371472 [8:23:17<21:50:37,  3.38it/s]
 28%|██▊       | 105485/371472 [8:23:17<20:52:11,  3.54it/s]
 28%|██▊       | 105486/371472 [8:23:18<21:31:12,  3.43it/s]
 28%|██▊       | 105487/371472 [8:23:18<21:23:22,  3.45it/s]
 28%|██▊       | 105488/371472 [8:23:18<20:19:53,  3.63it/s]
 28%|██▊       | 105489/371472 [8:23:18<21:30:11,  3.44it/s]
 28%|██▊       | 105490/371472 [8:23:19<21:34:51,  3.42it/s]
 28%|██▊       | 105491/371472 [8:23:19<20:32:35,  3.60it/s]
 28%|██▊       | 105492/371472 [8:23:19<19:54:47,  3.71it/s]
 28%|██▊       | 105493/371472 [8:23:19<20:51:25,  3.54it/s]
 28%|██▊       | 105494/371472 [8:23:20<21:40:15,  3.41it/s]
 28%|██▊       | 105495/371472 [8:23:20<21:34:57,  3.42it/s]
 28%|██▊       | 105496/371472 [8:23:20<21:52:46,  3.38it/s]
 28%|██▊       | 105497/371472 [8:23:21<21:02:57,  3.51it/s]
 28%|██▊       | 105498/371472 [8:23:21<20:46:28,  3.56it/s]
 28%|██▊       | 105499/371472 [8:23:21<20:28:39,  3.61it/s]
 28%|██▊       | 105500/371472 [8:23:22<21:15:58,  3.47it/s]
                                                            
{'loss': 3.4746, 'learning_rate': 7.447423991036221e-07, 'epoch': 4.54}

 28%|██▊       | 105500/371472 [8:23:22<21:15:58,  3.47it/s]
 28%|██▊       | 105501/371472 [8:23:22<23:17:39,  3.17it/s]
 28%|██▊       | 105502/371472 [8:23:22<22:32:59,  3.28it/s]
 28%|██▊       | 105503/371472 [8:23:23<23:46:11,  3.11it/s]
 28%|██▊       | 105504/371472 [8:23:23<22:35:29,  3.27it/s]
 28%|██▊       | 105505/371472 [8:23:23<21:52:58,  3.38it/s]
 28%|██▊       | 105506/371472 [8:23:23<20:52:25,  3.54it/s]
 28%|██▊       | 105507/371472 [8:23:24<20:08:53,  3.67it/s]
 28%|██▊       | 105508/371472 [8:23:24<20:13:45,  3.65it/s]
 28%|██▊       | 105509/371472 [8:23:24<20:17:34,  3.64it/s]
 28%|██▊       | 105510/371472 [8:23:24<21:03:55,  3.51it/s]
 28%|██▊       | 105511/371472 [8:23:25<20:54:18,  3.53it/s]
 28%|██▊       | 105512/371472 [8:23:25<21:00:38,  3.52it/s]
 28%|██▊       | 105513/371472 [8:23:25<21:15:59,  3.47it/s]
 28%|██▊       | 105514/371472 [8:23:26<20:16:49,  3.64it/s]
 28%|██▊       | 105515/371472 [8:23:26<22:21:43,  3.30it/s]
 28%|██▊       | 105516/371472 [8:23:26<21:31:52,  3.43it/s]
 28%|██▊       | 105517/371472 [8:23:26<21:40:16,  3.41it/s]
 28%|██▊       | 105518/371472 [8:23:27<20:49:48,  3.55it/s]
 28%|██▊       | 105519/371472 [8:23:27<20:33:31,  3.59it/s]
 28%|██▊       | 105520/371472 [8:23:27<20:56:35,  3.53it/s]
                                                            
{'loss': 3.5823, 'learning_rate': 7.446939171281433e-07, 'epoch': 4.54}

 28%|██▊       | 105520/371472 [8:23:27<20:56:35,  3.53it/s]
 28%|██▊       | 105521/371472 [8:23:28<21:06:29,  3.50it/s]
 28%|██▊       | 105522/371472 [8:23:28<20:15:32,  3.65it/s]
 28%|██▊       | 105523/371472 [8:23:28<19:56:10,  3.71it/s]
 28%|██▊       | 105524/371472 [8:23:28<21:46:53,  3.39it/s]
 28%|██▊       | 105525/371472 [8:23:29<22:40:34,  3.26it/s]
 28%|██▊       | 105526/371472 [8:23:29<21:15:26,  3.48it/s]
 28%|██▊       | 105527/371472 [8:23:29<20:52:56,  3.54it/s]
 28%|██▊       | 105528/371472 [8:23:30<20:45:38,  3.56it/s]
 28%|██▊       | 105529/371472 [8:23:30<20:54:15,  3.53it/s]
 28%|██▊       | 105530/371472 [8:23:30<21:05:37,  3.50it/s]
 28%|██▊       | 105531/371472 [8:23:30<20:10:05,  3.66it/s]
 28%|██▊       | 105532/371472 [8:23:31<22:36:52,  3.27it/s]
 28%|██▊       | 105533/371472 [8:23:31<21:54:09,  3.37it/s]
 28%|██▊       | 105534/371472 [8:23:31<21:21:45,  3.46it/s]
 28%|██▊       | 105535/371472 [8:23:32<20:55:46,  3.53it/s]
 28%|██▊       | 105536/371472 [8:23:32<21:15:55,  3.47it/s]
 28%|██▊       | 105537/371472 [8:23:32<20:33:01,  3.59it/s]
 28%|██▊       | 105538/371472 [8:23:32<20:26:03,  3.62it/s]
 28%|██▊       | 105539/371472 [8:23:33<20:28:58,  3.61it/s]
 28%|██▊       | 105540/371472 [8:23:33<20:31:14,  3.60it/s]
                                                            
{'loss': 3.3827, 'learning_rate': 7.446454351526642e-07, 'epoch': 4.55}

 28%|██▊       | 105540/371472 [8:23:33<20:31:14,  3.60it/s]
 28%|██▊       | 105541/371472 [8:23:33<20:13:28,  3.65it/s]
 28%|██▊       | 105542/371472 [8:23:33<19:29:52,  3.79it/s]
 28%|██▊       | 105543/371472 [8:23:34<21:21:56,  3.46it/s]
 28%|██▊       | 105544/371472 [8:23:34<21:58:03,  3.36it/s]
 28%|██▊       | 105545/371472 [8:23:34<22:22:02,  3.30it/s]
 28%|██▊       | 105546/371472 [8:23:35<22:59:03,  3.21it/s]
 28%|██▊       | 105547/371472 [8:23:35<22:28:18,  3.29it/s]
 28%|██▊       | 105548/371472 [8:23:35<22:01:10,  3.35it/s]
 28%|██▊       | 105549/371472 [8:23:36<21:58:36,  3.36it/s]
 28%|██▊       | 105550/371472 [8:23:36<22:28:24,  3.29it/s]
 28%|██▊       | 105551/371472 [8:23:36<21:22:40,  3.46it/s]
 28%|██▊       | 105552/371472 [8:23:37<21:23:33,  3.45it/s]
 28%|██▊       | 105553/371472 [8:23:37<21:04:23,  3.51it/s]
 28%|██▊       | 105554/371472 [8:23:37<21:57:46,  3.36it/s]
 28%|██▊       | 105555/371472 [8:23:37<21:35:34,  3.42it/s]
 28%|██▊       | 105556/371472 [8:23:38<21:21:14,  3.46it/s]
 28%|██▊       | 105557/371472 [8:23:38<20:25:06,  3.62it/s]
 28%|██▊       | 105558/371472 [8:23:38<20:13:54,  3.65it/s]
 28%|██▊       | 105559/371472 [8:23:39<20:46:50,  3.55it/s]
 28%|██▊       | 105560/371472 [8:23:39<20:18:07,  3.64it/s]
                                                            
{'loss': 3.3021, 'learning_rate': 7.445969531771854e-07, 'epoch': 4.55}

 28%|██▊       | 105560/371472 [8:23:39<20:18:07,  3.64it/s]
 28%|██▊       | 105561/371472 [8:23:39<20:26:13,  3.61it/s]
 28%|██▊       | 105562/371472 [8:23:39<19:49:36,  3.73it/s]
 28%|██▊       | 105563/371472 [8:23:40<20:28:34,  3.61it/s]
 28%|██▊       | 105564/371472 [8:23:40<20:53:51,  3.53it/s]
 28%|██▊       | 105565/371472 [8:23:40<20:44:16,  3.56it/s]
 28%|██▊       | 105566/371472 [8:23:40<21:14:21,  3.48it/s]
 28%|██▊       | 105567/371472 [8:23:41<23:16:39,  3.17it/s]
 28%|██▊       | 105568/371472 [8:23:41<21:48:12,  3.39it/s]
 28%|██▊       | 105569/371472 [8:23:41<21:00:18,  3.52it/s]
 28%|██▊       | 105570/371472 [8:23:42<20:34:03,  3.59it/s]
 28%|██▊       | 105571/371472 [8:23:42<20:54:04,  3.53it/s]
 28%|██▊       | 105572/371472 [8:23:42<20:18:37,  3.64it/s]
 28%|██▊       | 105573/371472 [8:23:42<19:40:49,  3.75it/s]
 28%|██▊       | 105574/371472 [8:23:43<19:27:11,  3.80it/s]
 28%|██▊       | 105575/371472 [8:23:43<19:41:02,  3.75it/s]
 28%|██▊       | 105576/371472 [8:23:43<21:53:35,  3.37it/s]
 28%|██▊       | 105577/371472 [8:23:44<22:46:44,  3.24it/s]
 28%|██▊       | 105578/371472 [8:23:44<21:34:07,  3.42it/s]
 28%|██▊       | 105579/371472 [8:23:44<20:39:09,  3.58it/s]
 28%|██▊       | 105580/371472 [8:23:44<19:32:45,  3.78it/s]
                                                            
{'loss': 3.3844, 'learning_rate': 7.445484712017066e-07, 'epoch': 4.55}

 28%|██▊       | 105580/371472 [8:23:44<19:32:45,  3.78it/s]
 28%|██▊       | 105581/371472 [8:23:45<20:46:02,  3.56it/s]
 28%|██▊       | 105582/371472 [8:23:45<20:11:57,  3.66it/s]
 28%|██▊       | 105583/371472 [8:23:45<20:14:20,  3.65it/s]
 28%|██▊       | 105584/371472 [8:23:46<20:17:47,  3.64it/s]
 28%|██▊       | 105585/371472 [8:23:46<19:28:58,  3.79it/s]
 28%|██▊       | 105586/371472 [8:23:46<20:46:29,  3.56it/s]
 28%|██▊       | 105587/371472 [8:23:46<20:06:50,  3.67it/s]
 28%|██▊       | 105588/371472 [8:23:47<19:47:28,  3.73it/s]
 28%|██▊       | 105589/371472 [8:23:47<19:49:12,  3.73it/s]
 28%|██▊       | 105590/371472 [8:23:47<19:49:30,  3.73it/s]
 28%|██▊       | 105591/371472 [8:23:47<19:45:19,  3.74it/s]
 28%|██▊       | 105592/371472 [8:23:48<19:17:47,  3.83it/s]
 28%|██▊       | 105593/371472 [8:23:48<19:40:11,  3.75it/s]
 28%|██▊       | 105594/371472 [8:23:48<20:38:25,  3.58it/s]
 28%|██▊       | 105595/371472 [8:23:49<20:49:04,  3.55it/s]
 28%|██▊       | 105596/371472 [8:23:49<21:44:03,  3.40it/s]
 28%|██▊       | 105597/371472 [8:23:49<21:16:19,  3.47it/s]
 28%|██▊       | 105598/371472 [8:23:49<22:09:31,  3.33it/s]
 28%|██▊       | 105599/371472 [8:23:50<21:34:51,  3.42it/s]
 28%|██▊       | 105600/371472 [8:23:50<20:28:10,  3.61it/s]
                                                            
{'loss': 3.4303, 'learning_rate': 7.444999892262277e-07, 'epoch': 4.55}

 28%|██▊       | 105600/371472 [8:23:50<20:28:10,  3.61it/s]
 28%|██▊       | 105601/371472 [8:23:50<20:13:28,  3.65it/s]
 28%|██▊       | 105602/371472 [8:23:50<19:26:50,  3.80it/s]
 28%|██▊       | 105603/371472 [8:23:51<19:46:39,  3.73it/s]
 28%|██▊       | 105604/371472 [8:23:51<19:20:59,  3.82it/s]
 28%|██▊       | 105605/371472 [8:23:51<19:52:23,  3.72it/s]
 28%|██▊       | 105606/371472 [8:23:52<19:44:55,  3.74it/s]
 28%|██▊       | 105607/371472 [8:23:52<19:59:16,  3.69it/s]
 28%|██▊       | 105608/371472 [8:23:52<20:41:12,  3.57it/s]
 28%|██▊       | 105609/371472 [8:23:52<20:57:11,  3.52it/s]
 28%|██▊       | 105610/371472 [8:23:53<20:54:41,  3.53it/s]
 28%|██▊       | 105611/371472 [8:23:53<21:14:30,  3.48it/s]
 28%|██▊       | 105612/371472 [8:23:53<20:10:27,  3.66it/s]
 28%|██▊       | 105613/371472 [8:23:54<20:34:17,  3.59it/s]
 28%|██▊       | 105614/371472 [8:23:54<21:38:39,  3.41it/s]
 28%|██▊       | 105615/371472 [8:23:54<21:37:49,  3.41it/s]
 28%|██▊       | 105616/371472 [8:23:54<21:06:46,  3.50it/s]
 28%|██▊       | 105617/371472 [8:23:55<20:19:56,  3.63it/s]
 28%|██▊       | 105618/371472 [8:23:55<21:41:53,  3.40it/s]
 28%|██▊       | 105619/371472 [8:23:55<21:28:22,  3.44it/s]
 28%|██▊       | 105620/371472 [8:23:56<22:06:57,  3.34it/s]
                                                            
{'loss': 3.2746, 'learning_rate': 7.444515072507486e-07, 'epoch': 4.55}

 28%|██▊       | 105620/371472 [8:23:56<22:06:57,  3.34it/s]
 28%|██▊       | 105621/371472 [8:23:56<21:33:57,  3.42it/s]
 28%|██▊       | 105622/371472 [8:23:56<20:26:17,  3.61it/s]
 28%|██▊       | 105623/371472 [8:23:56<20:15:48,  3.64it/s]
 28%|██▊       | 105624/371472 [8:23:57<20:04:05,  3.68it/s]
 28%|██▊       | 105625/371472 [8:23:57<21:47:54,  3.39it/s]
 28%|██▊       | 105626/371472 [8:23:57<20:53:10,  3.54it/s]
 28%|██▊       | 105627/371472 [8:23:58<20:24:43,  3.62it/s]
 28%|██▊       | 105628/371472 [8:23:58<20:11:08,  3.66it/s]
 28%|██▊       | 105629/371472 [8:23:58<20:45:30,  3.56it/s]
 28%|██▊       | 105630/371472 [8:23:58<20:17:14,  3.64it/s]
 28%|██▊       | 105631/371472 [8:23:59<20:22:42,  3.62it/s]
 28%|██▊       | 105632/371472 [8:23:59<20:57:09,  3.52it/s]
 28%|██▊       | 105633/371472 [8:23:59<20:57:52,  3.52it/s]
 28%|██▊       | 105634/371472 [8:23:59<20:33:02,  3.59it/s]
 28%|██▊       | 105635/371472 [8:24:00<20:51:42,  3.54it/s]
 28%|██▊       | 105636/371472 [8:24:00<21:09:53,  3.49it/s]
 28%|██▊       | 105637/371472 [8:24:00<20:22:28,  3.62it/s]
 28%|██▊       | 105638/371472 [8:24:01<21:01:22,  3.51it/s]
 28%|██▊       | 105639/371472 [8:24:01<20:08:36,  3.67it/s]
 28%|██▊       | 105640/371472 [8:24:01<20:53:59,  3.53it/s]
                                                            
{'loss': 3.4267, 'learning_rate': 7.444030252752698e-07, 'epoch': 4.55}

 28%|██▊       | 105640/371472 [8:24:01<20:53:59,  3.53it/s]
 28%|██▊       | 105641/371472 [8:24:01<20:47:03,  3.55it/s]
 28%|██▊       | 105642/371472 [8:24:02<20:18:32,  3.64it/s]
 28%|██▊       | 105643/371472 [8:24:02<20:46:37,  3.55it/s]
 28%|██▊       | 105644/371472 [8:24:02<21:40:57,  3.41it/s]
 28%|██▊       | 105645/371472 [8:24:03<21:45:22,  3.39it/s]
 28%|██▊       | 105646/371472 [8:24:03<20:52:44,  3.54it/s]
 28%|██▊       | 105647/371472 [8:24:03<21:15:20,  3.47it/s]
 28%|██▊       | 105648/371472 [8:24:03<20:33:37,  3.59it/s]
 28%|██▊       | 105649/371472 [8:24:04<21:16:50,  3.47it/s]
 28%|██▊       | 105650/371472 [8:24:04<21:15:43,  3.47it/s]
 28%|██▊       | 105651/371472 [8:24:04<21:00:12,  3.52it/s]
 28%|██▊       | 105652/371472 [8:24:05<21:33:31,  3.43it/s]
 28%|██▊       | 105653/371472 [8:24:05<21:47:40,  3.39it/s]
 28%|██▊       | 105654/371472 [8:24:05<20:36:11,  3.58it/s]
 28%|██▊       | 105655/371472 [8:24:06<22:20:29,  3.30it/s]
 28%|██▊       | 105656/371472 [8:24:06<21:59:55,  3.36it/s]
 28%|██▊       | 105657/371472 [8:24:06<21:14:06,  3.48it/s]
 28%|██▊       | 105658/371472 [8:24:06<20:35:29,  3.59it/s]
 28%|██▊       | 105659/371472 [8:24:07<20:37:41,  3.58it/s]
 28%|██▊       | 105660/371472 [8:24:07<20:08:42,  3.67it/s]
                                                            
{'loss': 3.4473, 'learning_rate': 7.44354543299791e-07, 'epoch': 4.55}

 28%|██▊       | 105660/371472 [8:24:07<20:08:42,  3.67it/s]
 28%|██▊       | 105661/371472 [8:24:07<20:17:30,  3.64it/s]
 28%|██▊       | 105662/371472 [8:24:07<20:52:03,  3.54it/s]
 28%|██▊       | 105663/371472 [8:24:08<20:43:50,  3.56it/s]
 28%|██▊       | 105664/371472 [8:24:08<20:01:38,  3.69it/s]
 28%|██▊       | 105665/371472 [8:24:08<20:02:21,  3.68it/s]
 28%|██▊       | 105666/371472 [8:24:08<19:40:20,  3.75it/s]
 28%|██▊       | 105667/371472 [8:24:09<19:57:39,  3.70it/s]
 28%|██▊       | 105668/371472 [8:24:09<21:03:44,  3.51it/s]
 28%|██▊       | 105669/371472 [8:24:09<20:36:35,  3.58it/s]
 28%|██▊       | 105670/371472 [8:24:10<19:53:57,  3.71it/s]
 28%|██▊       | 105671/371472 [8:24:10<20:56:31,  3.53it/s]
 28%|██▊       | 105672/371472 [8:24:10<20:14:55,  3.65it/s]
 28%|██▊       | 105673/371472 [8:24:10<19:36:40,  3.76it/s]
 28%|██▊       | 105674/371472 [8:24:11<19:33:11,  3.78it/s]
 28%|██▊       | 105675/371472 [8:24:11<19:13:13,  3.84it/s]
 28%|██▊       | 105676/371472 [8:24:11<21:04:29,  3.50it/s]
 28%|██▊       | 105677/371472 [8:24:12<20:56:15,  3.53it/s]
 28%|██▊       | 105678/371472 [8:24:12<20:02:38,  3.68it/s]
 28%|██▊       | 105679/371472 [8:24:12<19:37:58,  3.76it/s]
 28%|██▊       | 105680/371472 [8:24:12<20:49:39,  3.54it/s]
                                                            
{'loss': 3.4104, 'learning_rate': 7.443060613243121e-07, 'epoch': 4.55}

 28%|██▊       | 105680/371472 [8:24:12<20:49:39,  3.54it/s]
 28%|██▊       | 105681/371472 [8:24:13<20:53:03,  3.54it/s]
 28%|██▊       | 105682/371472 [8:24:13<21:10:41,  3.49it/s]
 28%|██▊       | 105683/371472 [8:24:13<23:04:56,  3.20it/s]
 28%|██▊       | 105684/371472 [8:24:14<23:58:10,  3.08it/s]
 28%|██▊       | 105685/371472 [8:24:14<22:51:45,  3.23it/s]
 28%|██▊       | 105686/371472 [8:24:14<21:23:20,  3.45it/s]
 28%|██▊       | 105687/371472 [8:24:14<21:13:43,  3.48it/s]
 28%|██▊       | 105688/371472 [8:24:15<20:31:20,  3.60it/s]
 28%|██▊       | 105689/371472 [8:24:15<20:36:16,  3.58it/s]
 28%|██▊       | 105690/371472 [8:24:15<19:57:39,  3.70it/s]
 28%|██▊       | 105691/371472 [8:24:16<20:12:30,  3.65it/s]
 28%|██▊       | 105692/371472 [8:24:16<20:00:45,  3.69it/s]
 28%|██▊       | 105693/371472 [8:24:16<20:53:42,  3.53it/s]
 28%|██▊       | 105694/371472 [8:24:16<20:43:17,  3.56it/s]
 28%|██▊       | 105695/371472 [8:24:17<21:24:27,  3.45it/s]
 28%|██▊       | 105696/371472 [8:24:17<20:48:19,  3.55it/s]
 28%|██▊       | 105697/371472 [8:24:17<20:37:29,  3.58it/s]
 28%|██▊       | 105698/371472 [8:24:18<20:20:12,  3.63it/s]
 28%|██▊       | 105699/371472 [8:24:18<19:58:10,  3.70it/s]
 28%|██▊       | 105700/371472 [8:24:18<19:50:09,  3.72it/s]
                                                            
{'loss': 3.5344, 'learning_rate': 7.442575793488331e-07, 'epoch': 4.55}

 28%|██▊       | 105700/371472 [8:24:18<19:50:09,  3.72it/s]
 28%|██▊       | 105701/371472 [8:24:18<20:00:01,  3.69it/s]
 28%|██▊       | 105702/371472 [8:24:19<19:31:16,  3.78it/s]
 28%|██▊       | 105703/371472 [8:24:19<19:41:07,  3.75it/s]
 28%|██▊       | 105704/371472 [8:24:19<19:30:41,  3.78it/s]
 28%|██▊       | 105705/371472 [8:24:19<19:37:16,  3.76it/s]
 28%|██▊       | 105706/371472 [8:24:20<19:48:36,  3.73it/s]
 28%|██▊       | 105707/371472 [8:24:20<21:39:40,  3.41it/s]
 28%|██▊       | 105708/371472 [8:24:20<20:46:30,  3.55it/s]
 28%|██▊       | 105709/371472 [8:24:20<19:48:05,  3.73it/s]
 28%|██▊       | 105710/371472 [8:24:21<21:19:31,  3.46it/s]
 28%|██▊       | 105711/371472 [8:24:21<20:21:54,  3.62it/s]
 28%|██▊       | 105712/371472 [8:24:21<21:14:01,  3.48it/s]
 28%|██▊       | 105713/371472 [8:24:22<20:10:12,  3.66it/s]
 28%|██▊       | 105714/371472 [8:24:22<19:50:14,  3.72it/s]
 28%|██▊       | 105715/371472 [8:24:22<20:38:52,  3.58it/s]
 28%|██▊       | 105716/371472 [8:24:22<20:29:55,  3.60it/s]
 28%|██▊       | 105717/371472 [8:24:23<20:09:27,  3.66it/s]
 28%|██▊       | 105718/371472 [8:24:23<20:25:10,  3.62it/s]
 28%|██▊       | 105719/371472 [8:24:23<21:09:18,  3.49it/s]
 28%|██▊       | 105720/371472 [8:24:24<21:34:24,  3.42it/s]
                                                            
{'loss': 3.445, 'learning_rate': 7.442090973733543e-07, 'epoch': 4.55}

 28%|██▊       | 105720/371472 [8:24:24<21:34:24,  3.42it/s]
 28%|██▊       | 105721/371472 [8:24:24<21:33:55,  3.42it/s]
 28%|██▊       | 105722/371472 [8:24:24<21:02:18,  3.51it/s]
 28%|██▊       | 105723/371472 [8:24:24<21:53:25,  3.37it/s]
 28%|██▊       | 105724/371472 [8:24:25<21:03:50,  3.50it/s]
 28%|██▊       | 105725/371472 [8:24:25<21:04:55,  3.50it/s]
 28%|██▊       | 105726/371472 [8:24:25<20:23:30,  3.62it/s]
 28%|██▊       | 105727/371472 [8:24:26<19:35:08,  3.77it/s]
 28%|██▊       | 105728/371472 [8:24:26<19:31:30,  3.78it/s]
 28%|██▊       | 105729/371472 [8:24:26<19:18:27,  3.82it/s]
 28%|██▊       | 105730/371472 [8:24:26<20:43:22,  3.56it/s]
 28%|██▊       | 105731/371472 [8:24:27<21:45:54,  3.39it/s]
 28%|██▊       | 105732/371472 [8:24:27<21:00:10,  3.51it/s]
 28%|██▊       | 105733/371472 [8:24:27<20:38:56,  3.57it/s]
 28%|██▊       | 105734/371472 [8:24:28<22:38:18,  3.26it/s]
 28%|██▊       | 105735/371472 [8:24:28<22:24:13,  3.29it/s]
 28%|██▊       | 105736/371472 [8:24:28<22:05:43,  3.34it/s]
 28%|██▊       | 105737/371472 [8:24:28<21:03:34,  3.51it/s]
 28%|██▊       | 105738/371472 [8:24:29<21:37:46,  3.41it/s]
 28%|██▊       | 105739/371472 [8:24:29<20:38:29,  3.58it/s]
 28%|██▊       | 105740/371472 [8:24:29<20:45:26,  3.56it/s]
                                                            
{'loss': 3.5019, 'learning_rate': 7.441606153978754e-07, 'epoch': 4.55}

 28%|██▊       | 105740/371472 [8:24:29<20:45:26,  3.56it/s]
 28%|██▊       | 105741/371472 [8:24:30<20:45:28,  3.56it/s]
 28%|██▊       | 105742/371472 [8:24:30<21:37:02,  3.41it/s]
 28%|██▊       | 105743/371472 [8:24:30<21:10:47,  3.49it/s]
 28%|██▊       | 105744/371472 [8:24:30<20:15:30,  3.64it/s]
 28%|██▊       | 105745/371472 [8:24:31<20:18:46,  3.63it/s]
 28%|██▊       | 105746/371472 [8:24:31<22:00:24,  3.35it/s]
 28%|██▊       | 105747/371472 [8:24:31<21:13:27,  3.48it/s]
 28%|██▊       | 105748/371472 [8:24:32<22:38:23,  3.26it/s]
 28%|██▊       | 105749/371472 [8:24:32<22:23:59,  3.30it/s]
 28%|██▊       | 105750/371472 [8:24:32<20:56:37,  3.52it/s]
 28%|██▊       | 105751/371472 [8:24:32<21:29:22,  3.43it/s]
 28%|██▊       | 105752/371472 [8:24:33<20:45:54,  3.55it/s]
 28%|██▊       | 105753/371472 [8:24:33<20:14:17,  3.65it/s]
 28%|██▊       | 105754/371472 [8:24:33<19:59:58,  3.69it/s]
 28%|██▊       | 105755/371472 [8:24:34<20:31:47,  3.60it/s]
 28%|██▊       | 105756/371472 [8:24:34<20:03:04,  3.68it/s]
 28%|██▊       | 105757/371472 [8:24:34<19:36:44,  3.76it/s]
 28%|██▊       | 105758/371472 [8:24:34<20:20:31,  3.63it/s]
 28%|██▊       | 105759/371472 [8:24:35<21:36:03,  3.42it/s]
 28%|██▊       | 105760/371472 [8:24:35<21:26:49,  3.44it/s]
                                                            
{'loss': 3.3507, 'learning_rate': 7.441121334223965e-07, 'epoch': 4.56}

 28%|██▊       | 105760/371472 [8:24:35<21:26:49,  3.44it/s]
 28%|██▊       | 105761/371472 [8:24:35<21:33:45,  3.42it/s]
 28%|██▊       | 105762/371472 [8:24:36<20:31:38,  3.60it/s]
 28%|██▊       | 105763/371472 [8:24:36<20:15:56,  3.64it/s]
 28%|██▊       | 105764/371472 [8:24:36<20:13:06,  3.65it/s]
 28%|██▊       | 105765/371472 [8:24:36<20:09:18,  3.66it/s]
 28%|██▊       | 105766/371472 [8:24:37<19:26:34,  3.80it/s]
 28%|██▊       | 105767/371472 [8:24:37<20:01:01,  3.69it/s]
 28%|██▊       | 105768/371472 [8:24:37<19:45:37,  3.74it/s]
 28%|██▊       | 105769/371472 [8:24:37<20:10:50,  3.66it/s]
 28%|██▊       | 105770/371472 [8:24:38<19:44:56,  3.74it/s]
 28%|██▊       | 105771/371472 [8:24:38<19:18:54,  3.82it/s]
 28%|██▊       | 105772/371472 [8:24:38<20:26:06,  3.61it/s]
 28%|██▊       | 105773/371472 [8:24:39<20:35:12,  3.59it/s]
 28%|██▊       | 105774/371472 [8:24:39<20:34:30,  3.59it/s]
 28%|██▊       | 105775/371472 [8:24:39<19:42:56,  3.74it/s]
 28%|██▊       | 105776/371472 [8:24:39<20:27:08,  3.61it/s]
 28%|██▊       | 105777/371472 [8:24:40<20:00:22,  3.69it/s]
 28%|██▊       | 105778/371472 [8:24:40<20:31:04,  3.60it/s]
 28%|██▊       | 105779/371472 [8:24:40<20:46:32,  3.55it/s]
 28%|██▊       | 105780/371472 [8:24:40<20:23:41,  3.62it/s]
                                                            
{'loss': 3.4429, 'learning_rate': 7.440636514469175e-07, 'epoch': 4.56}

 28%|██▊       | 105780/371472 [8:24:40<20:23:41,  3.62it/s]
 28%|██▊       | 105781/371472 [8:24:41<20:57:08,  3.52it/s]
 28%|██▊       | 105782/371472 [8:24:41<21:05:20,  3.50it/s]
 28%|██▊       | 105783/371472 [8:24:41<20:18:59,  3.63it/s]
 28%|██▊       | 105784/371472 [8:24:42<20:11:31,  3.66it/s]
 28%|██▊       | 105785/371472 [8:24:42<19:42:05,  3.75it/s]
 28%|██▊       | 105786/371472 [8:24:42<20:09:29,  3.66it/s]
 28%|██▊       | 105787/371472 [8:24:42<20:27:59,  3.61it/s]
 28%|██▊       | 105788/371472 [8:24:43<21:03:54,  3.50it/s]
 28%|██▊       | 105789/371472 [8:24:43<20:53:18,  3.53it/s]
 28%|██▊       | 105790/371472 [8:24:43<21:01:16,  3.51it/s]
 28%|██▊       | 105791/371472 [8:24:44<21:07:07,  3.49it/s]
 28%|██▊       | 105792/371472 [8:24:44<21:58:49,  3.36it/s]
 28%|██▊       | 105793/371472 [8:24:44<21:12:53,  3.48it/s]
 28%|██▊       | 105794/371472 [8:24:44<20:28:38,  3.60it/s]
 28%|██▊       | 105795/371472 [8:24:45<19:31:08,  3.78it/s]
 28%|██▊       | 105796/371472 [8:24:45<20:35:43,  3.58it/s]
 28%|██▊       | 105797/371472 [8:24:45<21:23:53,  3.45it/s]
 28%|██▊       | 105798/371472 [8:24:46<22:01:45,  3.35it/s]
 28%|██▊       | 105799/371472 [8:24:46<20:43:43,  3.56it/s]
 28%|██▊       | 105800/371472 [8:24:46<20:33:02,  3.59it/s]
                                                            
{'loss': 3.4688, 'learning_rate': 7.440151694714387e-07, 'epoch': 4.56}

 28%|██▊       | 105800/371472 [8:24:46<20:33:02,  3.59it/s]
 28%|██▊       | 105801/371472 [8:24:46<21:44:44,  3.39it/s]
 28%|██▊       | 105802/371472 [8:24:47<21:22:48,  3.45it/s]
 28%|██▊       | 105803/371472 [8:24:47<20:35:15,  3.58it/s]
 28%|██▊       | 105804/371472 [8:24:47<20:13:57,  3.65it/s]
 28%|██▊       | 105805/371472 [8:24:47<20:27:14,  3.61it/s]
 28%|██▊       | 105806/371472 [8:24:48<24:01:16,  3.07it/s]
 28%|██▊       | 105807/371472 [8:24:48<22:41:02,  3.25it/s]
 28%|██▊       | 105808/371472 [8:24:49<23:19:28,  3.16it/s]
 28%|██▊       | 105809/371472 [8:24:49<23:03:49,  3.20it/s]
 28%|██▊       | 105810/371472 [8:24:49<22:27:21,  3.29it/s]
 28%|██▊       | 105811/371472 [8:24:49<22:09:33,  3.33it/s]
 28%|██▊       | 105812/371472 [8:24:50<21:32:04,  3.43it/s]
 28%|██▊       | 105813/371472 [8:24:50<20:40:25,  3.57it/s]
 28%|██▊       | 105814/371472 [8:24:50<19:51:26,  3.72it/s]
 28%|██▊       | 105815/371472 [8:24:50<19:29:26,  3.79it/s]
 28%|██▊       | 105816/371472 [8:24:51<19:56:57,  3.70it/s]
 28%|██▊       | 105817/371472 [8:24:51<19:33:31,  3.77it/s]
 28%|██▊       | 105818/371472 [8:24:51<20:20:45,  3.63it/s]
 28%|██▊       | 105819/371472 [8:24:52<20:43:37,  3.56it/s]
 28%|██▊       | 105820/371472 [8:24:52<20:11:31,  3.65it/s]
                                                            
{'loss': 3.2943, 'learning_rate': 7.439666874959599e-07, 'epoch': 4.56}

 28%|██▊       | 105820/371472 [8:24:52<20:11:31,  3.65it/s]
 28%|██▊       | 105821/371472 [8:24:52<19:50:14,  3.72it/s]
 28%|██▊       | 105822/371472 [8:24:52<20:27:00,  3.61it/s]
 28%|██▊       | 105823/371472 [8:24:53<19:29:04,  3.79it/s]
 28%|██▊       | 105824/371472 [8:24:53<20:12:26,  3.65it/s]
 28%|██▊       | 105825/371472 [8:24:53<20:53:57,  3.53it/s]
 28%|██▊       | 105826/371472 [8:24:53<20:12:02,  3.65it/s]
 28%|██▊       | 105827/371472 [8:24:54<20:08:44,  3.66it/s]
 28%|██▊       | 105828/371472 [8:24:54<20:00:34,  3.69it/s]
 28%|██▊       | 105829/371472 [8:24:54<19:12:11,  3.84it/s]
 28%|██▊       | 105830/371472 [8:24:55<20:05:27,  3.67it/s]
 28%|██▊       | 105831/371472 [8:24:55<19:31:38,  3.78it/s]
 28%|██▊       | 105832/371472 [8:24:55<19:47:11,  3.73it/s]
 28%|██▊       | 105833/371472 [8:24:55<22:13:41,  3.32it/s]
 28%|██▊       | 105834/371472 [8:24:56<22:01:38,  3.35it/s]
 28%|██▊       | 105835/371472 [8:24:56<20:42:47,  3.56it/s]
 28%|██▊       | 105836/371472 [8:24:56<20:06:40,  3.67it/s]
 28%|██▊       | 105837/371472 [8:24:57<21:20:38,  3.46it/s]
 28%|██▊       | 105838/371472 [8:24:57<21:27:08,  3.44it/s]
 28%|██▊       | 105839/371472 [8:24:57<21:02:10,  3.51it/s]
 28%|██▊       | 105840/371472 [8:24:57<22:48:40,  3.23it/s]
                                                            
{'loss': 3.5317, 'learning_rate': 7.43918205520481e-07, 'epoch': 4.56}

 28%|██▊       | 105840/371472 [8:24:57<22:48:40,  3.23it/s]
 28%|██▊       | 105841/371472 [8:24:58<22:37:18,  3.26it/s]
 28%|██▊       | 105842/371472 [8:24:58<23:12:39,  3.18it/s]
 28%|██▊       | 105843/371472 [8:24:58<24:33:29,  3.00it/s]
 28%|██▊       | 105844/371472 [8:24:59<23:32:43,  3.13it/s]
 28%|██▊       | 105845/371472 [8:24:59<25:37:19,  2.88it/s]
 28%|██▊       | 105846/371472 [8:24:59<23:45:05,  3.11it/s]
 28%|██▊       | 105847/371472 [8:25:00<22:22:00,  3.30it/s]
 28%|██▊       | 105848/371472 [8:25:00<21:36:21,  3.41it/s]
 28%|██▊       | 105849/371472 [8:25:00<22:04:21,  3.34it/s]
 28%|██▊       | 105850/371472 [8:25:01<21:46:13,  3.39it/s]
 28%|██▊       | 105851/371472 [8:25:01<21:54:10,  3.37it/s]
 28%|██▊       | 105852/371472 [8:25:01<22:19:39,  3.30it/s]
 28%|██▊       | 105853/371472 [8:25:01<21:49:22,  3.38it/s]
 28%|██▊       | 105854/371472 [8:25:02<20:32:54,  3.59it/s]
 28%|██▊       | 105855/371472 [8:25:02<22:16:46,  3.31it/s]
 28%|██▊       | 105856/371472 [8:25:02<21:08:26,  3.49it/s]
 28%|██▊       | 105857/371472 [8:25:03<20:46:49,  3.55it/s]
 28%|██▊       | 105858/371472 [8:25:03<20:57:47,  3.52it/s]
 28%|██▊       | 105859/371472 [8:25:03<20:18:06,  3.63it/s]
 28%|██▊       | 105860/371472 [8:25:03<20:15:51,  3.64it/s]
                                                            
{'loss': 3.4314, 'learning_rate': 7.43869723545002e-07, 'epoch': 4.56}

 28%|██▊       | 105860/371472 [8:25:03<20:15:51,  3.64it/s]
 28%|██▊       | 105861/371472 [8:25:04<19:58:46,  3.69it/s]
 28%|██▊       | 105862/371472 [8:25:04<19:37:34,  3.76it/s]
 28%|██▊       | 105863/371472 [8:25:04<19:26:24,  3.80it/s]
 28%|██▊       | 105864/371472 [8:25:04<20:34:13,  3.59it/s]
 28%|██▊       | 105865/371472 [8:25:05<19:32:07,  3.78it/s]
 28%|██▊       | 105866/371472 [8:25:05<20:24:51,  3.61it/s]
 28%|██▊       | 105867/371472 [8:25:05<23:04:44,  3.20it/s]
 28%|██▊       | 105868/371472 [8:25:06<21:35:26,  3.42it/s]
 28%|██▊       | 105869/371472 [8:25:06<21:55:00,  3.37it/s]
 29%|██▊       | 105870/371472 [8:25:06<22:32:36,  3.27it/s]
 29%|██▊       | 105871/371472 [8:25:07<22:34:15,  3.27it/s]
 29%|██▊       | 105872/371472 [8:25:07<21:40:56,  3.40it/s]
 29%|██▊       | 105873/371472 [8:25:07<20:49:32,  3.54it/s]
 29%|██▊       | 105874/371472 [8:25:07<21:59:37,  3.35it/s]
 29%|██▊       | 105875/371472 [8:25:08<22:28:18,  3.28it/s]
 29%|██▊       | 105876/371472 [8:25:08<22:13:13,  3.32it/s]
 29%|██▊       | 105877/371472 [8:25:08<21:17:34,  3.46it/s]
 29%|██▊       | 105878/371472 [8:25:09<20:41:16,  3.57it/s]
 29%|██▊       | 105879/371472 [8:25:09<21:03:35,  3.50it/s]
 29%|██▊       | 105880/371472 [8:25:09<21:23:18,  3.45it/s]
                                                            
{'loss': 3.6768, 'learning_rate': 7.438212415695231e-07, 'epoch': 4.56}

 29%|██▊       | 105880/371472 [8:25:09<21:23:18,  3.45it/s]
 29%|██▊       | 105881/371472 [8:25:09<20:40:27,  3.57it/s]
 29%|██▊       | 105882/371472 [8:25:10<21:35:35,  3.42it/s]
 29%|██▊       | 105883/371472 [8:25:10<21:02:36,  3.51it/s]
 29%|██▊       | 105884/371472 [8:25:10<21:08:54,  3.49it/s]
 29%|██▊       | 105885/371472 [8:25:11<20:59:07,  3.52it/s]
 29%|██▊       | 105886/371472 [8:25:11<20:32:08,  3.59it/s]
 29%|██▊       | 105887/371472 [8:25:11<20:37:37,  3.58it/s]
 29%|██▊       | 105888/371472 [8:25:12<22:19:12,  3.31it/s]
 29%|██▊       | 105889/371472 [8:25:12<21:23:22,  3.45it/s]
 29%|██▊       | 105890/371472 [8:25:12<23:26:31,  3.15it/s]
 29%|██▊       | 105891/371472 [8:25:13<24:23:41,  3.02it/s]
 29%|██▊       | 105892/371472 [8:25:13<22:54:19,  3.22it/s]
 29%|██▊       | 105893/371472 [8:25:13<22:46:58,  3.24it/s]
 29%|██▊       | 105894/371472 [8:25:13<21:32:06,  3.43it/s]
 29%|██▊       | 105895/371472 [8:25:14<20:44:30,  3.56it/s]
 29%|██▊       | 105896/371472 [8:25:14<20:50:16,  3.54it/s]
 29%|██▊       | 105897/371472 [8:25:14<20:29:26,  3.60it/s]
 29%|██▊       | 105898/371472 [8:25:14<20:09:20,  3.66it/s]
 29%|██▊       | 105899/371472 [8:25:15<20:30:47,  3.60it/s]
 29%|██▊       | 105900/371472 [8:25:15<20:56:12,  3.52it/s]
                                                            
{'loss': 3.3843, 'learning_rate': 7.437727595940443e-07, 'epoch': 4.56}

 29%|██▊       | 105900/371472 [8:25:15<20:56:12,  3.52it/s]
 29%|██▊       | 105901/371472 [8:25:15<20:28:12,  3.60it/s]
 29%|██▊       | 105902/371472 [8:25:15<19:35:28,  3.77it/s]
 29%|██▊       | 105903/371472 [8:25:16<21:12:53,  3.48it/s]
 29%|██▊       | 105904/371472 [8:25:16<20:37:40,  3.58it/s]
 29%|██▊       | 105905/371472 [8:25:16<21:47:54,  3.38it/s]
 29%|██▊       | 105906/371472 [8:25:17<22:43:05,  3.25it/s]
 29%|██▊       | 105907/371472 [8:25:17<21:43:18,  3.40it/s]
 29%|██▊       | 105908/371472 [8:25:17<21:38:28,  3.41it/s]
 29%|██▊       | 105909/371472 [8:25:18<24:57:27,  2.96it/s]
 29%|██▊       | 105910/371472 [8:25:18<23:40:41,  3.12it/s]
 29%|██▊       | 105911/371472 [8:25:18<23:51:14,  3.09it/s]
 29%|██▊       | 105912/371472 [8:25:19<23:35:47,  3.13it/s]
 29%|██▊       | 105913/371472 [8:25:19<21:45:54,  3.39it/s]
 29%|██▊       | 105914/371472 [8:25:19<21:09:54,  3.49it/s]
 29%|██▊       | 105915/371472 [8:25:19<20:44:45,  3.56it/s]
 29%|██▊       | 105916/371472 [8:25:20<20:04:11,  3.68it/s]
 29%|██▊       | 105917/371472 [8:25:20<20:51:44,  3.54it/s]
 29%|██▊       | 105918/371472 [8:25:20<21:06:57,  3.49it/s]
 29%|██▊       | 105919/371472 [8:25:21<20:45:58,  3.55it/s]
 29%|██▊       | 105920/371472 [8:25:21<21:20:28,  3.46it/s]
                                                            
{'loss': 3.4105, 'learning_rate': 7.437242776185653e-07, 'epoch': 4.56}

 29%|██▊       | 105920/371472 [8:25:21<21:20:28,  3.46it/s]
 29%|██▊       | 105921/371472 [8:25:21<21:10:20,  3.48it/s]
 29%|██▊       | 105922/371472 [8:25:21<21:19:45,  3.46it/s]
 29%|██▊       | 105923/371472 [8:25:22<20:49:48,  3.54it/s]
 29%|██▊       | 105924/371472 [8:25:22<20:52:32,  3.53it/s]
 29%|██▊       | 105925/371472 [8:25:22<20:01:54,  3.68it/s]
 29%|██▊       | 105926/371472 [8:25:23<19:55:56,  3.70it/s]
 29%|██▊       | 105927/371472 [8:25:23<21:53:50,  3.37it/s]
 29%|██▊       | 105928/371472 [8:25:23<22:28:06,  3.28it/s]
 29%|██▊       | 105929/371472 [8:25:23<21:16:21,  3.47it/s]
 29%|██▊       | 105930/371472 [8:25:24<21:52:42,  3.37it/s]
 29%|██▊       | 105931/371472 [8:25:24<21:33:42,  3.42it/s]
 29%|██▊       | 105932/371472 [8:25:24<22:01:09,  3.35it/s]
 29%|██▊       | 105933/371472 [8:25:25<22:17:04,  3.31it/s]
 29%|██▊       | 105934/371472 [8:25:25<21:58:01,  3.36it/s]
 29%|██▊       | 105935/371472 [8:25:25<21:24:27,  3.45it/s]
 29%|██▊       | 105936/371472 [8:25:26<20:52:53,  3.53it/s]
 29%|██▊       | 105937/371472 [8:25:26<20:25:42,  3.61it/s]
 29%|██▊       | 105938/371472 [8:25:26<20:16:16,  3.64it/s]
 29%|██▊       | 105939/371472 [8:25:26<20:00:12,  3.69it/s]
 29%|██▊       | 105940/371472 [8:25:27<19:57:13,  3.70it/s]
                                                            
{'loss': 3.4629, 'learning_rate': 7.436757956430863e-07, 'epoch': 4.56}

 29%|██▊       | 105940/371472 [8:25:27<19:57:13,  3.70it/s]
 29%|██▊       | 105941/371472 [8:25:27<19:29:56,  3.78it/s]
 29%|██▊       | 105942/371472 [8:25:27<20:12:56,  3.65it/s]
 29%|██▊       | 105943/371472 [8:25:27<20:24:01,  3.62it/s]
 29%|██▊       | 105944/371472 [8:25:28<19:55:50,  3.70it/s]
 29%|██▊       | 105945/371472 [8:25:28<19:12:05,  3.84it/s]
 29%|██▊       | 105946/371472 [8:25:28<19:36:52,  3.76it/s]
 29%|██▊       | 105947/371472 [8:25:28<19:56:01,  3.70it/s]
 29%|██▊       | 105948/371472 [8:25:29<20:04:24,  3.67it/s]
 29%|██▊       | 105949/371472 [8:25:29<19:35:00,  3.77it/s]
 29%|██▊       | 105950/371472 [8:25:29<19:47:46,  3.73it/s]
 29%|██▊       | 105951/371472 [8:25:30<19:42:28,  3.74it/s]
 29%|██▊       | 105952/371472 [8:25:30<20:21:28,  3.62it/s]
 29%|██▊       | 105953/371472 [8:25:30<20:27:15,  3.61it/s]
 29%|██▊       | 105954/371472 [8:25:30<20:57:22,  3.52it/s]
 29%|██▊       | 105955/371472 [8:25:31<20:49:13,  3.54it/s]
 29%|██▊       | 105956/371472 [8:25:31<20:57:44,  3.52it/s]
 29%|██▊       | 105957/371472 [8:25:31<21:49:02,  3.38it/s]
 29%|██▊       | 105958/371472 [8:25:32<21:09:22,  3.49it/s]
 29%|██▊       | 105959/371472 [8:25:32<21:58:35,  3.36it/s]
 29%|██▊       | 105960/371472 [8:25:32<21:37:34,  3.41it/s]
                                                            
{'loss': 3.4537, 'learning_rate': 7.436273136676076e-07, 'epoch': 4.56}

 29%|██▊       | 105960/371472 [8:25:32<21:37:34,  3.41it/s]
 29%|██▊       | 105961/371472 [8:25:32<20:45:10,  3.55it/s]
 29%|██▊       | 105962/371472 [8:25:33<20:39:34,  3.57it/s]
 29%|██▊       | 105963/371472 [8:25:33<21:12:40,  3.48it/s]
 29%|██▊       | 105964/371472 [8:25:33<20:10:37,  3.66it/s]
 29%|██▊       | 105965/371472 [8:25:34<20:52:43,  3.53it/s]
 29%|██▊       | 105966/371472 [8:25:34<21:30:06,  3.43it/s]
 29%|██▊       | 105967/371472 [8:25:34<20:42:18,  3.56it/s]
 29%|██▊       | 105968/371472 [8:25:34<20:23:59,  3.62it/s]
 29%|██▊       | 105969/371472 [8:25:35<21:04:29,  3.50it/s]
 29%|██▊       | 105970/371472 [8:25:35<21:12:21,  3.48it/s]
 29%|██▊       | 105971/371472 [8:25:35<22:14:51,  3.31it/s]
 29%|██▊       | 105972/371472 [8:25:36<22:42:10,  3.25it/s]
 29%|██▊       | 105973/371472 [8:25:36<22:07:14,  3.33it/s]
 29%|██▊       | 105974/371472 [8:25:36<22:17:49,  3.31it/s]
 29%|██▊       | 105975/371472 [8:25:36<21:18:25,  3.46it/s]
 29%|██▊       | 105976/371472 [8:25:37<22:03:01,  3.34it/s]
 29%|██▊       | 105977/371472 [8:25:37<23:08:27,  3.19it/s]
 29%|██▊       | 105978/371472 [8:25:37<23:59:48,  3.07it/s]
 29%|██▊       | 105979/371472 [8:25:38<22:43:52,  3.24it/s]
 29%|██▊       | 105980/371472 [8:25:38<21:38:15,  3.41it/s]
                                                            
{'loss': 3.4705, 'learning_rate': 7.435788316921288e-07, 'epoch': 4.56}

 29%|██▊       | 105980/371472 [8:25:38<21:38:15,  3.41it/s]
 29%|██▊       | 105981/371472 [8:25:38<21:41:02,  3.40it/s]
 29%|██▊       | 105982/371472 [8:25:39<20:30:02,  3.60it/s]
 29%|██▊       | 105983/371472 [8:25:39<20:07:41,  3.66it/s]
 29%|██▊       | 105984/371472 [8:25:39<20:53:48,  3.53it/s]
 29%|██▊       | 105985/371472 [8:25:39<21:34:02,  3.42it/s]
 29%|██▊       | 105986/371472 [8:25:40<20:35:19,  3.58it/s]
 29%|██▊       | 105987/371472 [8:25:40<20:20:18,  3.63it/s]
 29%|██▊       | 105988/371472 [8:25:40<19:33:43,  3.77it/s]
 29%|██▊       | 105989/371472 [8:25:40<20:00:20,  3.69it/s]
 29%|██▊       | 105990/371472 [8:25:41<20:57:43,  3.52it/s]
 29%|██▊       | 105991/371472 [8:25:41<21:30:21,  3.43it/s]
 29%|██▊       | 105992/371472 [8:25:41<21:01:32,  3.51it/s]
 29%|██▊       | 105993/371472 [8:25:42<21:11:10,  3.48it/s]
 29%|██▊       | 105994/371472 [8:25:42<20:23:34,  3.62it/s]
 29%|██▊       | 105995/371472 [8:25:42<20:16:35,  3.64it/s]
 29%|██▊       | 105996/371472 [8:25:42<19:59:19,  3.69it/s]
 29%|██▊       | 105997/371472 [8:25:43<20:29:29,  3.60it/s]
 29%|██▊       | 105998/371472 [8:25:43<20:14:24,  3.64it/s]
 29%|██▊       | 105999/371472 [8:25:43<21:13:41,  3.47it/s]
 29%|██▊       | 106000/371472 [8:25:44<22:05:56,  3.34it/s]
                                                            
{'loss': 3.4859, 'learning_rate': 7.435303497166497e-07, 'epoch': 4.57}

 29%|██▊       | 106000/371472 [8:25:44<22:05:56,  3.34it/s]
 29%|██▊       | 106001/371472 [8:25:44<21:21:37,  3.45it/s]
 29%|██▊       | 106002/371472 [8:25:44<20:43:53,  3.56it/s]
 29%|██▊       | 106003/371472 [8:25:45<21:27:57,  3.44it/s]
 29%|██▊       | 106004/371472 [8:25:45<24:37:24,  2.99it/s]
 29%|██▊       | 106005/371472 [8:25:45<23:02:49,  3.20it/s]
 29%|██▊       | 106006/371472 [8:25:45<22:09:28,  3.33it/s]
 29%|██▊       | 106007/371472 [8:25:46<21:16:49,  3.47it/s]
 29%|██▊       | 106008/371472 [8:25:46<21:18:26,  3.46it/s]
 29%|██▊       | 106009/371472 [8:25:46<21:25:43,  3.44it/s]
 29%|██▊       | 106010/371472 [8:25:47<21:04:26,  3.50it/s]
 29%|██▊       | 106011/371472 [8:25:47<20:41:41,  3.56it/s]
 29%|██▊       | 106012/371472 [8:25:47<20:39:40,  3.57it/s]
 29%|██▊       | 106013/371472 [8:25:47<20:05:43,  3.67it/s]
 29%|██▊       | 106014/371472 [8:25:48<20:55:41,  3.52it/s]
 29%|██▊       | 106015/371472 [8:25:48<20:19:46,  3.63it/s]
 29%|██▊       | 106016/371472 [8:25:48<20:46:33,  3.55it/s]
 29%|██▊       | 106017/371472 [8:25:49<20:01:56,  3.68it/s]
 29%|██▊       | 106018/371472 [8:25:49<19:32:28,  3.77it/s]
 29%|██▊       | 106019/371472 [8:25:49<19:15:47,  3.83it/s]
 29%|██▊       | 106020/371472 [8:25:49<20:44:45,  3.55it/s]
                                                            
{'loss': 3.5219, 'learning_rate': 7.434818677411708e-07, 'epoch': 4.57}

 29%|██▊       | 106020/371472 [8:25:49<20:44:45,  3.55it/s]
 29%|██▊       | 106021/371472 [8:25:50<19:59:33,  3.69it/s]
 29%|██▊       | 106022/371472 [8:25:50<19:57:04,  3.70it/s]
 29%|██▊       | 106023/371472 [8:25:50<19:45:08,  3.73it/s]
 29%|██▊       | 106024/371472 [8:25:50<19:24:11,  3.80it/s]
 29%|██▊       | 106025/371472 [8:25:51<18:53:39,  3.90it/s]
 29%|██▊       | 106026/371472 [8:25:51<23:09:14,  3.18it/s]
 29%|██▊       | 106027/371472 [8:25:51<22:08:26,  3.33it/s]
 29%|██▊       | 106028/371472 [8:25:52<22:22:17,  3.30it/s]
 29%|██▊       | 106029/371472 [8:25:52<21:25:37,  3.44it/s]
 29%|██▊       | 106030/371472 [8:25:52<21:56:02,  3.36it/s]
 29%|██▊       | 106031/371472 [8:25:52<21:31:05,  3.43it/s]
 29%|██▊       | 106032/371472 [8:25:53<22:48:59,  3.23it/s]
 29%|██▊       | 106033/371472 [8:25:53<21:22:47,  3.45it/s]
 29%|██▊       | 106034/371472 [8:25:53<20:22:51,  3.62it/s]
 29%|██▊       | 106035/371472 [8:25:54<21:39:32,  3.40it/s]
 29%|██▊       | 106036/371472 [8:25:54<20:48:43,  3.54it/s]
 29%|██▊       | 106037/371472 [8:25:54<21:46:00,  3.39it/s]
 29%|██▊       | 106038/371472 [8:25:55<21:24:22,  3.44it/s]
 29%|██▊       | 106039/371472 [8:25:55<20:31:20,  3.59it/s]
 29%|██▊       | 106040/371472 [8:25:55<19:51:37,  3.71it/s]
                                                            
{'loss': 3.4374, 'learning_rate': 7.434333857656921e-07, 'epoch': 4.57}

 29%|██▊       | 106040/371472 [8:25:55<19:51:37,  3.71it/s]
 29%|██▊       | 106041/371472 [8:25:55<19:18:22,  3.82it/s]
 29%|██▊       | 106042/371472 [8:25:56<19:29:03,  3.78it/s]
 29%|██▊       | 106043/371472 [8:25:56<19:21:25,  3.81it/s]
 29%|██▊       | 106044/371472 [8:25:56<18:48:59,  3.92it/s]
 29%|██▊       | 106045/371472 [8:25:56<18:41:53,  3.94it/s]
 29%|██▊       | 106046/371472 [8:25:57<19:16:41,  3.82it/s]
 29%|██▊       | 106047/371472 [8:25:57<19:58:43,  3.69it/s]
 29%|██▊       | 106048/371472 [8:25:57<20:45:01,  3.55it/s]
 29%|██▊       | 106049/371472 [8:25:57<20:43:30,  3.56it/s]
 29%|██▊       | 106050/371472 [8:25:58<22:39:59,  3.25it/s]
 29%|██▊       | 106051/371472 [8:25:58<22:14:46,  3.31it/s]
 29%|██▊       | 106052/371472 [8:25:58<21:41:37,  3.40it/s]
 29%|██▊       | 106053/371472 [8:25:59<21:20:03,  3.46it/s]
 29%|██▊       | 106054/371472 [8:25:59<21:33:53,  3.42it/s]
 29%|██▊       | 106055/371472 [8:25:59<20:29:50,  3.60it/s]
 29%|██▊       | 106056/371472 [8:25:59<21:01:06,  3.51it/s]
 29%|██▊       | 106057/371472 [8:26:00<20:17:10,  3.63it/s]
 29%|██▊       | 106058/371472 [8:26:00<20:51:44,  3.53it/s]
 29%|██▊       | 106059/371472 [8:26:00<20:24:09,  3.61it/s]
 29%|██▊       | 106060/371472 [8:26:01<20:05:35,  3.67it/s]
                                                            
{'loss': 3.3109, 'learning_rate': 7.43384903790213e-07, 'epoch': 4.57}

 29%|██▊       | 106060/371472 [8:26:01<20:05:35,  3.67it/s]
 29%|██▊       | 106061/371472 [8:26:01<20:12:16,  3.65it/s]
 29%|██▊       | 106062/371472 [8:26:01<20:12:25,  3.65it/s]
 29%|██▊       | 106063/371472 [8:26:01<20:24:56,  3.61it/s]
 29%|██▊       | 106064/371472 [8:26:02<20:46:55,  3.55it/s]
 29%|██▊       | 106065/371472 [8:26:02<20:26:34,  3.61it/s]
 29%|██▊       | 106066/371472 [8:26:02<21:41:55,  3.40it/s]
 29%|██▊       | 106067/371472 [8:26:03<21:14:21,  3.47it/s]
 29%|██▊       | 106068/371472 [8:26:03<23:02:03,  3.20it/s]
 29%|██▊       | 106069/371472 [8:26:03<21:29:41,  3.43it/s]
 29%|██▊       | 106070/371472 [8:26:03<21:19:24,  3.46it/s]
 29%|██▊       | 106071/371472 [8:26:04<20:38:54,  3.57it/s]
 29%|██▊       | 106072/371472 [8:26:04<20:21:44,  3.62it/s]
 29%|██▊       | 106073/371472 [8:26:04<20:14:10,  3.64it/s]
 29%|██▊       | 106074/371472 [8:26:05<20:23:06,  3.62it/s]
 29%|██▊       | 106075/371472 [8:26:05<20:16:19,  3.64it/s]
 29%|██▊       | 106076/371472 [8:26:05<20:04:29,  3.67it/s]
 29%|██▊       | 106077/371472 [8:26:05<20:11:56,  3.65it/s]
 29%|██▊       | 106078/371472 [8:26:06<20:21:00,  3.62it/s]
 29%|██▊       | 106079/371472 [8:26:06<20:11:26,  3.65it/s]
 29%|██▊       | 106080/371472 [8:26:06<19:59:09,  3.69it/s]
                                                            
{'loss': 3.5075, 'learning_rate': 7.433364218147341e-07, 'epoch': 4.57}

 29%|██▊       | 106080/371472 [8:26:06<19:59:09,  3.69it/s]
 29%|██▊       | 106081/371472 [8:26:06<20:45:41,  3.55it/s]
 29%|██▊       | 106082/371472 [8:26:07<21:15:08,  3.47it/s]
 29%|██▊       | 106083/371472 [8:26:07<21:15:17,  3.47it/s]
 29%|██▊       | 106084/371472 [8:26:07<20:19:31,  3.63it/s]
 29%|██▊       | 106085/371472 [8:26:08<20:19:45,  3.63it/s]
 29%|██▊       | 106086/371472 [8:26:08<21:27:42,  3.43it/s]
 29%|██▊       | 106087/371472 [8:26:08<21:05:01,  3.50it/s]
 29%|██▊       | 106088/371472 [8:26:08<21:11:59,  3.48it/s]
 29%|██▊       | 106089/371472 [8:26:09<20:44:54,  3.55it/s]
 29%|██▊       | 106090/371472 [8:26:09<23:13:05,  3.17it/s]
 29%|██▊       | 106091/371472 [8:26:09<22:37:39,  3.26it/s]
 29%|██▊       | 106092/371472 [8:26:10<24:31:05,  3.01it/s]
 29%|██▊       | 106093/371472 [8:26:10<23:33:18,  3.13it/s]
 29%|██▊       | 106094/371472 [8:26:10<22:42:07,  3.25it/s]
 29%|██▊       | 106095/371472 [8:26:11<22:55:19,  3.22it/s]
 29%|██▊       | 106096/371472 [8:26:11<22:51:45,  3.22it/s]
 29%|██▊       | 106097/371472 [8:26:11<21:56:59,  3.36it/s]
 29%|██▊       | 106098/371472 [8:26:12<21:36:22,  3.41it/s]
 29%|██▊       | 106099/371472 [8:26:12<21:01:41,  3.51it/s]
 29%|██▊       | 106100/371472 [8:26:12<20:50:59,  3.54it/s]
                                                            
{'loss': 3.3777, 'learning_rate': 7.432879398392553e-07, 'epoch': 4.57}

 29%|██▊       | 106100/371472 [8:26:12<20:50:59,  3.54it/s]
 29%|██▊       | 106101/371472 [8:26:12<20:22:17,  3.62it/s]
 29%|██▊       | 106102/371472 [8:26:13<20:36:19,  3.58it/s]
 29%|██▊       | 106103/371472 [8:26:13<22:43:48,  3.24it/s]
 29%|██▊       | 106104/371472 [8:26:13<22:54:20,  3.22it/s]
 29%|██▊       | 106105/371472 [8:26:14<22:07:33,  3.33it/s]
 29%|██▊       | 106106/371472 [8:26:14<22:26:45,  3.28it/s]
 29%|██▊       | 106107/371472 [8:26:14<21:24:45,  3.44it/s]
 29%|██▊       | 106108/371472 [8:26:15<21:20:28,  3.45it/s]
 29%|██▊       | 106109/371472 [8:26:15<21:09:13,  3.48it/s]
 29%|██▊       | 106110/371472 [8:26:15<20:16:48,  3.63it/s]
 29%|██▊       | 106111/371472 [8:26:15<19:46:54,  3.73it/s]
 29%|██▊       | 106112/371472 [8:26:16<19:52:04,  3.71it/s]
 29%|██▊       | 106113/371472 [8:26:16<19:30:27,  3.78it/s]
 29%|██▊       | 106114/371472 [8:26:16<20:05:50,  3.67it/s]
 29%|██▊       | 106115/371472 [8:26:16<19:22:50,  3.80it/s]
 29%|██▊       | 106116/371472 [8:26:17<21:09:20,  3.48it/s]
 29%|██▊       | 106117/371472 [8:26:17<22:21:13,  3.30it/s]
 29%|██▊       | 106118/371472 [8:26:17<23:22:24,  3.15it/s]
 29%|██▊       | 106119/371472 [8:26:18<22:27:27,  3.28it/s]
 29%|██▊       | 106120/371472 [8:26:18<21:54:47,  3.36it/s]
                                                            
{'loss': 3.4756, 'learning_rate': 7.432394578637764e-07, 'epoch': 4.57}

 29%|██▊       | 106120/371472 [8:26:18<21:54:47,  3.36it/s]
 29%|██▊       | 106121/371472 [8:26:18<22:20:42,  3.30it/s]
 29%|██▊       | 106122/371472 [8:26:19<21:43:36,  3.39it/s]
 29%|██▊       | 106123/371472 [8:26:19<22:41:29,  3.25it/s]
 29%|██▊       | 106124/371472 [8:26:19<22:09:15,  3.33it/s]
 29%|██▊       | 106125/371472 [8:26:19<21:56:22,  3.36it/s]
 29%|██▊       | 106126/371472 [8:26:20<21:56:40,  3.36it/s]
 29%|██▊       | 106127/371472 [8:26:20<21:31:57,  3.42it/s]
 29%|██▊       | 106128/371472 [8:26:20<21:03:57,  3.50it/s]
 29%|██▊       | 106129/371472 [8:26:21<22:03:00,  3.34it/s]
 29%|██▊       | 106130/371472 [8:26:21<20:38:34,  3.57it/s]
 29%|██▊       | 106131/371472 [8:26:21<20:48:05,  3.54it/s]
 29%|██▊       | 106132/371472 [8:26:21<21:04:47,  3.50it/s]
 29%|██▊       | 106133/371472 [8:26:22<21:18:40,  3.46it/s]
 29%|██▊       | 106134/371472 [8:26:22<21:32:29,  3.42it/s]
 29%|██▊       | 106135/371472 [8:26:22<21:07:42,  3.49it/s]
 29%|██▊       | 106136/371472 [8:26:23<23:03:54,  3.20it/s]
 29%|██▊       | 106137/371472 [8:26:23<21:46:24,  3.39it/s]
 29%|██▊       | 106138/371472 [8:26:23<20:58:55,  3.51it/s]
 29%|██▊       | 106139/371472 [8:26:23<21:20:01,  3.45it/s]
 29%|██▊       | 106140/371472 [8:26:24<22:02:44,  3.34it/s]
                                                            
{'loss': 3.4662, 'learning_rate': 7.431909758882974e-07, 'epoch': 4.57}

 29%|██▊       | 106140/371472 [8:26:24<22:02:44,  3.34it/s]
 29%|██▊       | 106141/371472 [8:26:24<21:33:05,  3.42it/s]
 29%|██▊       | 106142/371472 [8:26:24<20:43:10,  3.56it/s]
 29%|██▊       | 106143/371472 [8:26:25<20:07:56,  3.66it/s]
 29%|██▊       | 106144/371472 [8:26:25<20:20:48,  3.62it/s]
 29%|██▊       | 106145/371472 [8:26:25<20:20:47,  3.62it/s]
 29%|██▊       | 106146/371472 [8:26:26<22:05:11,  3.34it/s]
 29%|██▊       | 106147/371472 [8:26:26<21:12:10,  3.48it/s]
 29%|██▊       | 106148/371472 [8:26:26<20:58:50,  3.51it/s]
 29%|██▊       | 106149/371472 [8:26:26<21:13:34,  3.47it/s]
 29%|██▊       | 106150/371472 [8:26:27<20:42:54,  3.56it/s]
 29%|██▊       | 106151/371472 [8:26:27<20:24:30,  3.61it/s]
 29%|██▊       | 106152/371472 [8:26:27<20:01:19,  3.68it/s]
 29%|██▊       | 106153/371472 [8:26:27<20:17:42,  3.63it/s]
 29%|██▊       | 106154/371472 [8:26:28<20:20:21,  3.62it/s]
 29%|██▊       | 106155/371472 [8:26:28<21:47:52,  3.38it/s]
 29%|██▊       | 106156/371472 [8:26:28<23:02:21,  3.20it/s]
 29%|██▊       | 106157/371472 [8:26:29<21:44:20,  3.39it/s]
 29%|██▊       | 106158/371472 [8:26:29<21:21:06,  3.45it/s]
 29%|██▊       | 106159/371472 [8:26:29<20:34:22,  3.58it/s]
 29%|██▊       | 106160/371472 [8:26:29<20:26:45,  3.60it/s]
                                                            
{'loss': 3.4017, 'learning_rate': 7.431424939128185e-07, 'epoch': 4.57}

 29%|██▊       | 106160/371472 [8:26:29<20:26:45,  3.60it/s]
 29%|██▊       | 106161/371472 [8:26:30<21:22:56,  3.45it/s]
 29%|██▊       | 106162/371472 [8:26:30<22:14:21,  3.31it/s]
 29%|██▊       | 106163/371472 [8:26:30<22:45:19,  3.24it/s]
 29%|██▊       | 106164/371472 [8:26:31<22:17:26,  3.31it/s]
 29%|██▊       | 106165/371472 [8:26:31<21:39:45,  3.40it/s]
 29%|██▊       | 106166/371472 [8:26:31<22:05:53,  3.33it/s]
 29%|██▊       | 106167/371472 [8:26:32<22:06:48,  3.33it/s]
 29%|██▊       | 106168/371472 [8:26:32<21:50:25,  3.37it/s]
 29%|██▊       | 106169/371472 [8:26:32<21:34:24,  3.42it/s]
 29%|██▊       | 106170/371472 [8:26:32<21:25:49,  3.44it/s]
 29%|██▊       | 106171/371472 [8:26:33<23:39:26,  3.12it/s]
 29%|██▊       | 106172/371472 [8:26:33<22:44:42,  3.24it/s]
 29%|██▊       | 106173/371472 [8:26:33<22:07:10,  3.33it/s]
 29%|██▊       | 106174/371472 [8:26:34<22:04:39,  3.34it/s]
 29%|██▊       | 106175/371472 [8:26:34<21:29:50,  3.43it/s]
 29%|██▊       | 106176/371472 [8:26:34<22:47:47,  3.23it/s]
 29%|██▊       | 106177/371472 [8:26:35<22:23:16,  3.29it/s]
 29%|██▊       | 106178/371472 [8:26:35<22:21:24,  3.30it/s]
 29%|██▊       | 106179/371472 [8:26:35<21:08:12,  3.49it/s]
 29%|██▊       | 106180/371472 [8:26:35<20:04:00,  3.67it/s]
                                                            
{'loss': 3.2848, 'learning_rate': 7.430940119373397e-07, 'epoch': 4.57}

 29%|██▊       | 106180/371472 [8:26:35<20:04:00,  3.67it/s]
 29%|██▊       | 106181/371472 [8:26:36<20:19:50,  3.62it/s]
 29%|██▊       | 106182/371472 [8:26:36<20:22:42,  3.62it/s]
 29%|██▊       | 106183/371472 [8:26:36<21:21:56,  3.45it/s]
 29%|██▊       | 106184/371472 [8:26:37<21:47:16,  3.38it/s]
 29%|██▊       | 106185/371472 [8:26:37<22:15:28,  3.31it/s]
 29%|██▊       | 106186/371472 [8:26:37<21:14:47,  3.47it/s]
 29%|██▊       | 106187/371472 [8:26:37<21:28:13,  3.43it/s]
 29%|██▊       | 106188/371472 [8:26:38<20:29:09,  3.60it/s]
 29%|██▊       | 106189/371472 [8:26:38<20:49:01,  3.54it/s]
 29%|██▊       | 106190/371472 [8:26:38<21:26:38,  3.44it/s]
 29%|██▊       | 106191/371472 [8:26:39<20:55:32,  3.52it/s]
 29%|██▊       | 106192/371472 [8:26:39<21:01:20,  3.51it/s]
 29%|██▊       | 106193/371472 [8:26:39<20:45:42,  3.55it/s]
 29%|██▊       | 106194/371472 [8:26:39<20:27:23,  3.60it/s]
 29%|██▊       | 106195/371472 [8:26:40<21:10:59,  3.48it/s]
 29%|██▊       | 106196/371472 [8:26:40<20:21:11,  3.62it/s]
 29%|██▊       | 106197/371472 [8:26:40<20:33:34,  3.58it/s]
 29%|██▊       | 106198/371472 [8:26:41<20:08:17,  3.66it/s]
 29%|██▊       | 106199/371472 [8:26:41<21:05:07,  3.49it/s]
 29%|██▊       | 106200/371472 [8:26:41<20:20:28,  3.62it/s]
                                                            
{'loss': 3.2424, 'learning_rate': 7.430455299618609e-07, 'epoch': 4.57}

 29%|██▊       | 106200/371472 [8:26:41<20:20:28,  3.62it/s]
 29%|██▊       | 106201/371472 [8:26:41<22:34:17,  3.26it/s]
 29%|██▊       | 106202/371472 [8:26:42<21:39:06,  3.40it/s]
 29%|██▊       | 106203/371472 [8:26:42<20:50:15,  3.54it/s]
 29%|██▊       | 106204/371472 [8:26:42<20:34:49,  3.58it/s]
 29%|██▊       | 106205/371472 [8:26:43<21:06:17,  3.49it/s]
 29%|██▊       | 106206/371472 [8:26:43<20:35:24,  3.58it/s]
 29%|██▊       | 106207/371472 [8:26:43<20:40:37,  3.56it/s]
 29%|██▊       | 106208/371472 [8:26:43<19:59:49,  3.68it/s]
 29%|██▊       | 106209/371472 [8:26:44<20:12:56,  3.64it/s]
 29%|██▊       | 106210/371472 [8:26:44<20:54:49,  3.52it/s]
 29%|██▊       | 106211/371472 [8:26:44<20:39:58,  3.57it/s]
 29%|██▊       | 106212/371472 [8:26:44<20:18:03,  3.63it/s]
 29%|██▊       | 106213/371472 [8:26:45<21:08:57,  3.48it/s]
 29%|██▊       | 106214/371472 [8:26:45<21:30:47,  3.43it/s]
 29%|██▊       | 106215/371472 [8:26:45<21:11:45,  3.48it/s]
 29%|██▊       | 106216/371472 [8:26:46<22:40:37,  3.25it/s]
 29%|██▊       | 106217/371472 [8:26:46<23:37:22,  3.12it/s]
 29%|██▊       | 106218/371472 [8:26:47<27:41:49,  2.66it/s]
 29%|██▊       | 106219/371472 [8:26:47<28:32:09,  2.58it/s]
 29%|██▊       | 106220/371472 [8:26:47<26:15:33,  2.81it/s]
                                                            
{'loss': 3.3857, 'learning_rate': 7.429970479863819e-07, 'epoch': 4.58}

 29%|██▊       | 106220/371472 [8:26:47<26:15:33,  2.81it/s]
 29%|██▊       | 106221/371472 [8:26:48<23:43:35,  3.11it/s]
 29%|██▊       | 106222/371472 [8:26:48<24:51:37,  2.96it/s]
 29%|██▊       | 106223/371472 [8:26:48<23:33:15,  3.13it/s]
 29%|██▊       | 106224/371472 [8:26:48<22:34:21,  3.26it/s]
 29%|██▊       | 106225/371472 [8:26:49<21:36:40,  3.41it/s]
 29%|██▊       | 106226/371472 [8:26:49<22:09:22,  3.33it/s]
 29%|██▊       | 106227/371472 [8:26:49<23:47:09,  3.10it/s]
 29%|██▊       | 106228/371472 [8:26:50<22:50:23,  3.23it/s]
 29%|██▊       | 106229/371472 [8:26:50<22:14:40,  3.31it/s]
 29%|██▊       | 106230/371472 [8:26:50<22:17:12,  3.31it/s]
 29%|██▊       | 106231/371472 [8:26:51<21:42:16,  3.39it/s]
 29%|██▊       | 106232/371472 [8:26:51<21:06:24,  3.49it/s]
 29%|██▊       | 106233/371472 [8:26:51<21:19:58,  3.45it/s]
 29%|██▊       | 106234/371472 [8:26:51<21:27:12,  3.43it/s]
 29%|██▊       | 106235/371472 [8:26:52<20:28:32,  3.60it/s]
 29%|██▊       | 106236/371472 [8:26:52<20:22:36,  3.62it/s]
 29%|██▊       | 106237/371472 [8:26:53<26:45:23,  2.75it/s]
 29%|██▊       | 106238/371472 [8:26:53<24:50:29,  2.97it/s]
 29%|██▊       | 106239/371472 [8:26:53<23:06:06,  3.19it/s]
 29%|██▊       | 106240/371472 [8:26:53<21:53:29,  3.37it/s]
                                                            
{'loss': 3.5344, 'learning_rate': 7.42948566010903e-07, 'epoch': 4.58}

 29%|██▊       | 106240/371472 [8:26:53<21:53:29,  3.37it/s]
 29%|██▊       | 106241/371472 [8:26:54<25:29:10,  2.89it/s]
 29%|██▊       | 106242/371472 [8:26:54<25:07:22,  2.93it/s]
 29%|██▊       | 106243/371472 [8:26:54<24:29:57,  3.01it/s]
 29%|██▊       | 106244/371472 [8:26:55<22:56:31,  3.21it/s]
 29%|██▊       | 106245/371472 [8:26:55<23:06:53,  3.19it/s]
 29%|██▊       | 106246/371472 [8:26:55<23:22:58,  3.15it/s]
 29%|██▊       | 106247/371472 [8:26:56<22:56:29,  3.21it/s]
 29%|██▊       | 106248/371472 [8:26:56<22:46:38,  3.23it/s]
 29%|██▊       | 106249/371472 [8:26:56<23:04:36,  3.19it/s]
 29%|██▊       | 106250/371472 [8:26:57<23:01:39,  3.20it/s]
 29%|██▊       | 106251/371472 [8:26:57<21:59:15,  3.35it/s]
 29%|██▊       | 106252/371472 [8:26:57<22:28:06,  3.28it/s]
 29%|██▊       | 106253/371472 [8:26:57<21:34:06,  3.42it/s]
 29%|██▊       | 106254/371472 [8:26:58<21:07:50,  3.49it/s]
 29%|██▊       | 106255/371472 [8:26:58<21:00:06,  3.51it/s]
 29%|██▊       | 106256/371472 [8:26:58<20:42:10,  3.56it/s]
 29%|██▊       | 106257/371472 [8:26:58<20:30:43,  3.59it/s]
 29%|██▊       | 106258/371472 [8:26:59<21:26:00,  3.44it/s]
 29%|██▊       | 106259/371472 [8:26:59<22:41:24,  3.25it/s]
 29%|██▊       | 106260/371472 [8:26:59<21:51:12,  3.37it/s]
                                                            
{'loss': 3.4852, 'learning_rate': 7.429000840354241e-07, 'epoch': 4.58}

 29%|██▊       | 106260/371472 [8:26:59<21:51:12,  3.37it/s]
 29%|██▊       | 106261/371472 [8:27:00<21:55:39,  3.36it/s]
 29%|██▊       | 106262/371472 [8:27:00<21:31:51,  3.42it/s]
 29%|██▊       | 106263/371472 [8:27:00<21:09:09,  3.48it/s]
 29%|██▊       | 106264/371472 [8:27:01<21:46:16,  3.38it/s]
 29%|██▊       | 106265/371472 [8:27:01<21:17:41,  3.46it/s]
 29%|██▊       | 106266/371472 [8:27:01<20:44:40,  3.55it/s]
 29%|██▊       | 106267/371472 [8:27:01<21:31:12,  3.42it/s]
 29%|██▊       | 106268/371472 [8:27:02<21:06:38,  3.49it/s]
 29%|██▊       | 106269/371472 [8:27:02<22:30:29,  3.27it/s]
 29%|██▊       | 106270/371472 [8:27:02<21:42:13,  3.39it/s]
 29%|██▊       | 106271/371472 [8:27:03<21:59:50,  3.35it/s]
 29%|██▊       | 106272/371472 [8:27:03<21:09:24,  3.48it/s]
 29%|██▊       | 106273/371472 [8:27:03<20:17:40,  3.63it/s]
 29%|██▊       | 106274/371472 [8:27:03<20:11:18,  3.65it/s]
 29%|██▊       | 106275/371472 [8:27:04<19:46:03,  3.73it/s]
 29%|██▊       | 106276/371472 [8:27:04<21:07:59,  3.49it/s]
 29%|██▊       | 106277/371472 [8:27:04<20:38:31,  3.57it/s]
 29%|██▊       | 106278/371472 [8:27:05<21:34:14,  3.42it/s]
 29%|██▊       | 106279/371472 [8:27:05<21:03:24,  3.50it/s]
 29%|██▊       | 106280/371472 [8:27:05<21:46:52,  3.38it/s]
                                                            
{'loss': 3.2511, 'learning_rate': 7.428516020599453e-07, 'epoch': 4.58}

 29%|██▊       | 106280/371472 [8:27:05<21:46:52,  3.38it/s]
 29%|██▊       | 106281/371472 [8:27:05<21:18:03,  3.46it/s]
 29%|██▊       | 106282/371472 [8:27:06<20:44:39,  3.55it/s]
 29%|██▊       | 106283/371472 [8:27:06<20:25:17,  3.61it/s]
 29%|██▊       | 106284/371472 [8:27:06<20:04:59,  3.67it/s]
 29%|██▊       | 106285/371472 [8:27:07<20:34:59,  3.58it/s]
 29%|██▊       | 106286/371472 [8:27:07<21:04:14,  3.50it/s]
 29%|██▊       | 106287/371472 [8:27:07<20:07:53,  3.66it/s]
 29%|██▊       | 106288/371472 [8:27:07<21:22:02,  3.45it/s]
 29%|██▊       | 106289/371472 [8:27:08<22:28:42,  3.28it/s]
 29%|██▊       | 106290/371472 [8:27:08<21:44:37,  3.39it/s]
 29%|██▊       | 106291/371472 [8:27:08<21:05:18,  3.49it/s]
 29%|██▊       | 106292/371472 [8:27:09<21:48:29,  3.38it/s]
 29%|██▊       | 106293/371472 [8:27:09<22:07:22,  3.33it/s]
 29%|██▊       | 106294/371472 [8:27:09<22:05:56,  3.33it/s]
 29%|██▊       | 106295/371472 [8:27:10<21:43:20,  3.39it/s]
 29%|██▊       | 106296/371472 [8:27:10<20:54:58,  3.52it/s]
 29%|██▊       | 106297/371472 [8:27:10<20:52:59,  3.53it/s]
 29%|██▊       | 106298/371472 [8:27:10<21:20:51,  3.45it/s]
 29%|██▊       | 106299/371472 [8:27:11<22:42:42,  3.24it/s]
 29%|██▊       | 106300/371472 [8:27:11<22:51:46,  3.22it/s]
                                                            
{'loss': 3.3752, 'learning_rate': 7.428031200844663e-07, 'epoch': 4.58}

 29%|██▊       | 106300/371472 [8:27:11<22:51:46,  3.22it/s]
 29%|██▊       | 106301/371472 [8:27:11<22:45:35,  3.24it/s]
 29%|██▊       | 106302/371472 [8:27:12<22:13:58,  3.31it/s]
 29%|██▊       | 106303/371472 [8:27:12<22:11:52,  3.32it/s]
 29%|██▊       | 106304/371472 [8:27:12<22:36:51,  3.26it/s]
 29%|██▊       | 106305/371472 [8:27:13<22:26:02,  3.28it/s]
 29%|██▊       | 106306/371472 [8:27:13<21:34:32,  3.41it/s]
 29%|██▊       | 106307/371472 [8:27:13<21:58:46,  3.35it/s]
 29%|██▊       | 106308/371472 [8:27:13<22:28:34,  3.28it/s]
 29%|██▊       | 106309/371472 [8:27:14<22:02:36,  3.34it/s]
 29%|██▊       | 106310/371472 [8:27:14<22:03:45,  3.34it/s]
 29%|██▊       | 106311/371472 [8:27:14<22:14:30,  3.31it/s]
 29%|██▊       | 106312/371472 [8:27:15<21:09:40,  3.48it/s]
 29%|██▊       | 106313/371472 [8:27:15<20:19:40,  3.62it/s]
 29%|██▊       | 106314/371472 [8:27:15<20:09:41,  3.65it/s]
 29%|██▊       | 106315/371472 [8:27:15<20:10:08,  3.65it/s]
 29%|██▊       | 106316/371472 [8:27:16<19:54:29,  3.70it/s]
 29%|██▊       | 106317/371472 [8:27:16<20:21:05,  3.62it/s]
 29%|██▊       | 106318/371472 [8:27:16<19:49:28,  3.72it/s]
 29%|██▊       | 106319/371472 [8:27:16<19:15:27,  3.82it/s]
 29%|██▊       | 106320/371472 [8:27:17<20:16:34,  3.63it/s]
                                                            
{'loss': 3.5539, 'learning_rate': 7.427546381089874e-07, 'epoch': 4.58}

 29%|██▊       | 106320/371472 [8:27:17<20:16:34,  3.63it/s]
 29%|██▊       | 106321/371472 [8:27:17<21:02:22,  3.50it/s]
 29%|██▊       | 106322/371472 [8:27:17<22:02:39,  3.34it/s]
 29%|██▊       | 106323/371472 [8:27:18<22:06:09,  3.33it/s]
 29%|██▊       | 106324/371472 [8:27:18<21:36:44,  3.41it/s]
 29%|██▊       | 106325/371472 [8:27:18<22:44:11,  3.24it/s]
 29%|██▊       | 106326/371472 [8:27:19<26:13:31,  2.81it/s]
 29%|██▊       | 106327/371472 [8:27:19<24:28:58,  3.01it/s]
 29%|██▊       | 106328/371472 [8:27:19<22:46:53,  3.23it/s]
 29%|██▊       | 106329/371472 [8:27:20<23:14:41,  3.17it/s]
 29%|██▊       | 106330/371472 [8:27:20<22:20:17,  3.30it/s]
 29%|██▊       | 106331/371472 [8:27:20<20:50:25,  3.53it/s]
 29%|██▊       | 106332/371472 [8:27:20<20:09:22,  3.65it/s]
 29%|██▊       | 106333/371472 [8:27:21<20:41:42,  3.56it/s]
 29%|██▊       | 106334/371472 [8:27:21<21:48:16,  3.38it/s]
 29%|██▊       | 106335/371472 [8:27:21<21:44:39,  3.39it/s]
 29%|██▊       | 106336/371472 [8:27:22<21:43:20,  3.39it/s]
 29%|██▊       | 106337/371472 [8:27:22<21:59:23,  3.35it/s]
 29%|██▊       | 106338/371472 [8:27:22<21:10:28,  3.48it/s]
 29%|██▊       | 106339/371472 [8:27:22<20:54:26,  3.52it/s]
 29%|██▊       | 106340/371472 [8:27:23<21:27:27,  3.43it/s]
                                                            
{'loss': 3.4688, 'learning_rate': 7.427061561335086e-07, 'epoch': 4.58}

 29%|██▊       | 106340/371472 [8:27:23<21:27:27,  3.43it/s]
 29%|██▊       | 106341/371472 [8:27:23<20:39:07,  3.57it/s]
 29%|██▊       | 106342/371472 [8:27:23<20:32:34,  3.59it/s]
 29%|██▊       | 106343/371472 [8:27:24<20:22:16,  3.62it/s]
 29%|██▊       | 106344/371472 [8:27:24<20:33:44,  3.58it/s]
 29%|██▊       | 106345/371472 [8:27:24<22:09:11,  3.32it/s]
 29%|██▊       | 106346/371472 [8:27:24<21:19:29,  3.45it/s]
 29%|██▊       | 106347/371472 [8:27:25<21:05:04,  3.49it/s]
 29%|██▊       | 106348/371472 [8:27:25<20:02:26,  3.67it/s]
 29%|██▊       | 106349/371472 [8:27:25<19:52:29,  3.71it/s]
 29%|██▊       | 106350/371472 [8:27:26<19:30:45,  3.77it/s]
 29%|██▊       | 106351/371472 [8:27:26<21:01:32,  3.50it/s]
 29%|██▊       | 106352/371472 [8:27:26<21:08:11,  3.48it/s]
 29%|██▊       | 106353/371472 [8:27:26<21:31:09,  3.42it/s]
 29%|██▊       | 106354/371472 [8:27:27<21:04:32,  3.49it/s]
 29%|██▊       | 106355/371472 [8:27:27<21:12:09,  3.47it/s]
 29%|██▊       | 106356/371472 [8:27:27<20:52:41,  3.53it/s]
 29%|██▊       | 106357/371472 [8:27:28<20:54:18,  3.52it/s]
 29%|██▊       | 106358/371472 [8:27:28<25:05:15,  2.94it/s]
 29%|██▊       | 106359/371472 [8:27:28<25:34:58,  2.88it/s]
 29%|██▊       | 106360/371472 [8:27:29<24:07:12,  3.05it/s]
                                                            
{'loss': 3.4532, 'learning_rate': 7.426576741580298e-07, 'epoch': 4.58}

 29%|██▊       | 106360/371472 [8:27:29<24:07:12,  3.05it/s]
 29%|██▊       | 106361/371472 [8:27:29<23:00:14,  3.20it/s]
 29%|██▊       | 106362/371472 [8:27:29<21:57:00,  3.35it/s]
 29%|██▊       | 106363/371472 [8:27:30<21:51:19,  3.37it/s]
 29%|██▊       | 106364/371472 [8:27:30<21:02:51,  3.50it/s]
 29%|██▊       | 106365/371472 [8:27:30<21:33:27,  3.42it/s]
 29%|██▊       | 106366/371472 [8:27:30<22:31:32,  3.27it/s]
 29%|██▊       | 106367/371472 [8:27:31<22:36:31,  3.26it/s]
 29%|██▊       | 106368/371472 [8:27:31<21:24:40,  3.44it/s]
 29%|██▊       | 106369/371472 [8:27:31<20:50:16,  3.53it/s]
 29%|██▊       | 106370/371472 [8:27:31<20:12:44,  3.64it/s]
 29%|██▊       | 106371/371472 [8:27:32<20:20:46,  3.62it/s]
 29%|██▊       | 106372/371472 [8:27:32<22:14:34,  3.31it/s]
 29%|██▊       | 106373/371472 [8:27:32<21:27:27,  3.43it/s]
 29%|██▊       | 106374/371472 [8:27:33<22:12:43,  3.32it/s]
 29%|██▊       | 106375/371472 [8:27:33<22:29:01,  3.28it/s]
 29%|██▊       | 106376/371472 [8:27:33<22:25:59,  3.28it/s]
 29%|██▊       | 106377/371472 [8:27:34<23:55:53,  3.08it/s]
 29%|██▊       | 106378/371472 [8:27:34<23:46:51,  3.10it/s]
 29%|██▊       | 106379/371472 [8:27:34<22:21:52,  3.29it/s]
 29%|██▊       | 106380/371472 [8:27:35<21:48:16,  3.38it/s]
                                                            
{'loss': 3.3261, 'learning_rate': 7.426091921825507e-07, 'epoch': 4.58}

 29%|██▊       | 106380/371472 [8:27:35<21:48:16,  3.38it/s]
 29%|██▊       | 106381/371472 [8:27:35<21:47:37,  3.38it/s]
 29%|██▊       | 106382/371472 [8:27:35<20:48:57,  3.54it/s]
 29%|██▊       | 106383/371472 [8:27:35<21:15:45,  3.46it/s]
 29%|██▊       | 106384/371472 [8:27:36<21:09:24,  3.48it/s]
 29%|██▊       | 106385/371472 [8:27:36<22:27:01,  3.28it/s]
 29%|██▊       | 106386/371472 [8:27:36<23:23:06,  3.15it/s]
 29%|██▊       | 106387/371472 [8:27:37<24:32:05,  3.00it/s]
 29%|██▊       | 106388/371472 [8:27:37<23:14:23,  3.17it/s]
 29%|██▊       | 106389/371472 [8:27:37<22:35:08,  3.26it/s]
 29%|██▊       | 106390/371472 [8:27:38<21:17:57,  3.46it/s]
 29%|██▊       | 106391/371472 [8:27:38<20:42:13,  3.56it/s]
 29%|██▊       | 106392/371472 [8:27:38<20:44:49,  3.55it/s]
 29%|██▊       | 106393/371472 [8:27:38<22:27:12,  3.28it/s]
 29%|██▊       | 106394/371472 [8:27:39<22:02:08,  3.34it/s]
 29%|██▊       | 106395/371472 [8:27:39<21:09:22,  3.48it/s]
 29%|██▊       | 106396/371472 [8:27:39<20:26:04,  3.60it/s]
 29%|██▊       | 106397/371472 [8:27:40<19:27:43,  3.78it/s]
 29%|██▊       | 106398/371472 [8:27:40<19:38:00,  3.75it/s]
 29%|██▊       | 106399/371472 [8:27:40<20:05:59,  3.66it/s]
 29%|██▊       | 106400/371472 [8:27:40<20:02:22,  3.67it/s]
                                                            
{'loss': 3.3305, 'learning_rate': 7.425607102070718e-07, 'epoch': 4.58}

 29%|██▊       | 106400/371472 [8:27:40<20:02:22,  3.67it/s]
 29%|██▊       | 106401/371472 [8:27:41<20:03:21,  3.67it/s]
 29%|██▊       | 106402/371472 [8:27:41<20:53:26,  3.52it/s]
 29%|██▊       | 106403/371472 [8:27:41<21:37:34,  3.40it/s]
 29%|██▊       | 106404/371472 [8:27:42<22:08:14,  3.33it/s]
 29%|██▊       | 106405/371472 [8:27:42<22:07:15,  3.33it/s]
 29%|██▊       | 106406/371472 [8:27:42<21:29:35,  3.43it/s]
 29%|██▊       | 106407/371472 [8:27:42<22:01:29,  3.34it/s]
 29%|██▊       | 106408/371472 [8:27:43<22:29:46,  3.27it/s]
 29%|██▊       | 106409/371472 [8:27:43<21:44:51,  3.39it/s]
 29%|██▊       | 106410/371472 [8:27:43<20:59:45,  3.51it/s]
 29%|██▊       | 106411/371472 [8:27:44<20:18:17,  3.63it/s]
 29%|██▊       | 106412/371472 [8:27:44<20:01:55,  3.68it/s]
 29%|██▊       | 106413/371472 [8:27:44<19:44:49,  3.73it/s]
 29%|██▊       | 106414/371472 [8:27:44<20:37:25,  3.57it/s]
 29%|██▊       | 106415/371472 [8:27:45<20:24:22,  3.61it/s]
 29%|██▊       | 106416/371472 [8:27:45<21:08:46,  3.48it/s]
 29%|██▊       | 106417/371472 [8:27:45<20:38:03,  3.57it/s]
 29%|██▊       | 106418/371472 [8:27:46<20:23:45,  3.61it/s]
 29%|██▊       | 106419/371472 [8:27:46<20:31:00,  3.59it/s]
 29%|██▊       | 106420/371472 [8:27:46<20:15:28,  3.63it/s]
                                                            
{'loss': 3.6248, 'learning_rate': 7.42512228231593e-07, 'epoch': 4.58}

 29%|██▊       | 106420/371472 [8:27:46<20:15:28,  3.63it/s]
 29%|██▊       | 106421/371472 [8:27:46<20:01:23,  3.68it/s]
 29%|██▊       | 106422/371472 [8:27:47<19:59:56,  3.68it/s]
 29%|██▊       | 106423/371472 [8:27:47<19:40:09,  3.74it/s]
 29%|██▊       | 106424/371472 [8:27:47<19:43:10,  3.73it/s]
 29%|██▊       | 106425/371472 [8:27:47<19:51:17,  3.71it/s]
 29%|██▊       | 106426/371472 [8:27:48<20:08:21,  3.66it/s]
 29%|██▊       | 106427/371472 [8:27:48<20:19:58,  3.62it/s]
 29%|██▊       | 106428/371472 [8:27:48<20:06:39,  3.66it/s]
 29%|██▊       | 106429/371472 [8:27:49<20:34:29,  3.58it/s]
 29%|██▊       | 106430/371472 [8:27:49<21:09:28,  3.48it/s]
 29%|██▊       | 106431/371472 [8:27:49<22:48:41,  3.23it/s]
 29%|██▊       | 106432/371472 [8:27:49<22:43:19,  3.24it/s]
 29%|██▊       | 106433/371472 [8:27:50<22:36:33,  3.26it/s]
 29%|██▊       | 106434/371472 [8:27:50<21:49:08,  3.37it/s]
 29%|██▊       | 106435/371472 [8:27:50<23:31:38,  3.13it/s]
 29%|██▊       | 106436/371472 [8:27:51<22:39:14,  3.25it/s]
 29%|██▊       | 106437/371472 [8:27:51<22:12:39,  3.31it/s]
 29%|██▊       | 106438/371472 [8:27:51<22:03:07,  3.34it/s]
 29%|██▊       | 106439/371472 [8:27:52<21:58:07,  3.35it/s]
 29%|██▊       | 106440/371472 [8:27:52<22:38:17,  3.25it/s]
                                                            
{'loss': 3.5392, 'learning_rate': 7.424637462561142e-07, 'epoch': 4.58}

 29%|██▊       | 106440/371472 [8:27:52<22:38:17,  3.25it/s]
 29%|██▊       | 106441/371472 [8:27:52<22:07:39,  3.33it/s]
 29%|██▊       | 106442/371472 [8:27:53<22:38:39,  3.25it/s]
 29%|██▊       | 106443/371472 [8:27:53<22:27:40,  3.28it/s]
 29%|██▊       | 106444/371472 [8:27:53<22:23:32,  3.29it/s]
 29%|██▊       | 106445/371472 [8:27:53<21:49:14,  3.37it/s]
 29%|██▊       | 106446/371472 [8:27:54<21:46:21,  3.38it/s]
 29%|██▊       | 106447/371472 [8:27:54<20:53:39,  3.52it/s]
 29%|██▊       | 106448/371472 [8:27:54<20:20:24,  3.62it/s]
 29%|██▊       | 106449/371472 [8:27:54<19:57:28,  3.69it/s]
 29%|██▊       | 106450/371472 [8:27:55<19:52:08,  3.71it/s]
 29%|██▊       | 106451/371472 [8:27:55<20:07:15,  3.66it/s]
 29%|██▊       | 106452/371472 [8:27:55<21:09:06,  3.48it/s]
 29%|██▊       | 106453/371472 [8:27:56<20:20:47,  3.62it/s]
 29%|██▊       | 106454/371472 [8:27:56<20:01:53,  3.67it/s]
 29%|██▊       | 106455/371472 [8:27:56<20:39:32,  3.56it/s]
 29%|██▊       | 106456/371472 [8:27:56<21:31:27,  3.42it/s]
 29%|██▊       | 106457/371472 [8:27:57<20:49:07,  3.54it/s]
 29%|██▊       | 106458/371472 [8:27:57<20:58:42,  3.51it/s]
 29%|██▊       | 106459/371472 [8:27:57<21:07:55,  3.48it/s]
 29%|██▊       | 106460/371472 [8:27:58<22:37:54,  3.25it/s]
                                                            
{'loss': 3.1391, 'learning_rate': 7.424152642806353e-07, 'epoch': 4.59}

 29%|██▊       | 106460/371472 [8:27:58<22:37:54,  3.25it/s]
 29%|██▊       | 106461/371472 [8:27:58<21:54:31,  3.36it/s]
 29%|██▊       | 106462/371472 [8:27:58<21:30:41,  3.42it/s]
 29%|██▊       | 106463/371472 [8:27:59<21:38:33,  3.40it/s]
 29%|██▊       | 106464/371472 [8:27:59<21:20:29,  3.45it/s]
 29%|██▊       | 106465/371472 [8:27:59<21:55:12,  3.36it/s]
 29%|██▊       | 106466/371472 [8:27:59<22:04:31,  3.33it/s]
 29%|██▊       | 106467/371472 [8:28:00<21:29:21,  3.43it/s]
 29%|██▊       | 106468/371472 [8:28:00<22:14:17,  3.31it/s]
 29%|██▊       | 106469/371472 [8:28:00<22:23:09,  3.29it/s]
 29%|██▊       | 106470/371472 [8:28:01<21:23:23,  3.44it/s]
 29%|██▊       | 106471/371472 [8:28:01<21:37:39,  3.40it/s]
 29%|██▊       | 106472/371472 [8:28:01<22:02:09,  3.34it/s]
 29%|██▊       | 106473/371472 [8:28:02<22:03:47,  3.34it/s]
 29%|██▊       | 106474/371472 [8:28:02<21:08:04,  3.48it/s]
 29%|██▊       | 106475/371472 [8:28:02<20:19:45,  3.62it/s]
 29%|██▊       | 106476/371472 [8:28:02<20:39:28,  3.56it/s]
 29%|██▊       | 106477/371472 [8:28:03<20:22:49,  3.61it/s]
 29%|██▊       | 106478/371472 [8:28:03<19:24:07,  3.79it/s]
 29%|██▊       | 106479/371472 [8:28:03<22:07:43,  3.33it/s]
 29%|██▊       | 106480/371472 [8:28:03<20:42:45,  3.55it/s]
                                                            
{'loss': 3.2933, 'learning_rate': 7.423667823051563e-07, 'epoch': 4.59}

 29%|██▊       | 106480/371472 [8:28:03<20:42:45,  3.55it/s]
 29%|██▊       | 106481/371472 [8:28:04<20:12:51,  3.64it/s]
 29%|██▊       | 106482/371472 [8:28:04<20:44:49,  3.55it/s]
 29%|██▊       | 106483/371472 [8:28:04<22:44:52,  3.24it/s]
 29%|██▊       | 106484/371472 [8:28:05<21:51:32,  3.37it/s]
 29%|██▊       | 106485/371472 [8:28:05<21:46:56,  3.38it/s]
 29%|██▊       | 106486/371472 [8:28:05<21:40:39,  3.40it/s]
 29%|██▊       | 106487/371472 [8:28:05<20:49:05,  3.54it/s]
 29%|██▊       | 106488/371472 [8:28:06<21:01:38,  3.50it/s]
 29%|██▊       | 106489/371472 [8:28:06<21:36:06,  3.41it/s]
 29%|██▊       | 106490/371472 [8:28:06<20:39:50,  3.56it/s]
 29%|██▊       | 106491/371472 [8:28:07<21:28:47,  3.43it/s]
 29%|██▊       | 106492/371472 [8:28:07<21:39:29,  3.40it/s]
 29%|██▊       | 106493/371472 [8:28:07<21:22:40,  3.44it/s]
 29%|██▊       | 106494/371472 [8:28:08<22:22:46,  3.29it/s]
 29%|██▊       | 106495/371472 [8:28:08<21:53:27,  3.36it/s]
 29%|██▊       | 106496/371472 [8:28:08<21:58:26,  3.35it/s]
 29%|██▊       | 106497/371472 [8:28:08<20:58:14,  3.51it/s]
 29%|██▊       | 106498/371472 [8:28:09<22:38:41,  3.25it/s]
 29%|██▊       | 106499/371472 [8:28:09<22:21:46,  3.29it/s]
 29%|██▊       | 106500/371472 [8:28:09<21:26:14,  3.43it/s]
                                                            
{'loss': 3.3931, 'learning_rate': 7.423183003296774e-07, 'epoch': 4.59}

 29%|██▊       | 106500/371472 [8:28:09<21:26:14,  3.43it/s]
 29%|██▊       | 106501/371472 [8:28:10<22:28:56,  3.27it/s]
 29%|██▊       | 106502/371472 [8:28:10<21:48:34,  3.37it/s]
 29%|██▊       | 106503/371472 [8:28:10<20:41:40,  3.56it/s]
 29%|██▊       | 106504/371472 [8:28:10<20:12:01,  3.64it/s]
 29%|██▊       | 106505/371472 [8:28:11<21:12:21,  3.47it/s]
 29%|██▊       | 106506/371472 [8:28:11<20:47:53,  3.54it/s]
 29%|██▊       | 106507/371472 [8:28:11<20:09:28,  3.65it/s]
 29%|██▊       | 106508/371472 [8:28:12<20:32:25,  3.58it/s]
 29%|██▊       | 106509/371472 [8:28:12<20:38:56,  3.56it/s]
 29%|██▊       | 106510/371472 [8:28:12<22:15:48,  3.31it/s]
 29%|██▊       | 106511/371472 [8:28:13<22:02:18,  3.34it/s]
 29%|██▊       | 106512/371472 [8:28:13<21:33:44,  3.41it/s]
 29%|██▊       | 106513/371472 [8:28:13<22:01:12,  3.34it/s]
 29%|██▊       | 106514/371472 [8:28:13<23:48:43,  3.09it/s]
 29%|██▊       | 106515/371472 [8:28:14<23:38:24,  3.11it/s]
 29%|██▊       | 106516/371472 [8:28:14<24:44:00,  2.98it/s]
 29%|██▊       | 106517/371472 [8:28:14<23:19:47,  3.15it/s]
 29%|██▊       | 106518/371472 [8:28:15<22:43:35,  3.24it/s]
 29%|██▊       | 106519/371472 [8:28:15<22:00:05,  3.35it/s]
 29%|██▊       | 106520/371472 [8:28:15<21:47:23,  3.38it/s]
                                                            
{'loss': 3.3831, 'learning_rate': 7.422698183541985e-07, 'epoch': 4.59}

 29%|██▊       | 106520/371472 [8:28:15<21:47:23,  3.38it/s]
 29%|██▊       | 106521/371472 [8:28:16<21:02:01,  3.50it/s]
 29%|██▊       | 106522/371472 [8:28:16<20:42:42,  3.55it/s]
 29%|██▊       | 106523/371472 [8:28:16<20:45:46,  3.54it/s]
 29%|██▊       | 106524/371472 [8:28:16<20:20:27,  3.62it/s]
 29%|██▊       | 106525/371472 [8:28:17<20:56:44,  3.51it/s]
 29%|██▊       | 106526/371472 [8:28:17<20:38:12,  3.57it/s]
 29%|██▊       | 106527/371472 [8:28:17<21:07:56,  3.48it/s]
 29%|██▊       | 106528/371472 [8:28:18<20:36:14,  3.57it/s]
 29%|██▊       | 106529/371472 [8:28:18<20:58:00,  3.51it/s]
 29%|██▊       | 106530/371472 [8:28:18<21:01:22,  3.50it/s]
 29%|██▊       | 106531/371472 [8:28:18<21:14:56,  3.46it/s]
 29%|██▊       | 106532/371472 [8:28:19<21:03:26,  3.49it/s]
 29%|██▊       | 106533/371472 [8:28:19<20:32:47,  3.58it/s]
 29%|██▊       | 106534/371472 [8:28:19<20:27:51,  3.60it/s]
 29%|██▊       | 106535/371472 [8:28:19<19:56:30,  3.69it/s]
 29%|██▊       | 106536/371472 [8:28:20<19:56:51,  3.69it/s]
 29%|██▊       | 106537/371472 [8:28:20<20:18:57,  3.62it/s]
 29%|██▊       | 106538/371472 [8:28:20<20:03:44,  3.67it/s]
 29%|██▊       | 106539/371472 [8:28:21<19:34:24,  3.76it/s]
 29%|██▊       | 106540/371472 [8:28:21<22:43:37,  3.24it/s]
                                                            
{'loss': 3.3134, 'learning_rate': 7.422213363787196e-07, 'epoch': 4.59}

 29%|██▊       | 106540/371472 [8:28:21<22:43:37,  3.24it/s]
 29%|██▊       | 106541/371472 [8:28:21<22:22:30,  3.29it/s]
 29%|██▊       | 106542/371472 [8:28:22<21:58:40,  3.35it/s]
 29%|██▊       | 106543/371472 [8:28:22<22:13:01,  3.31it/s]
 29%|██▊       | 106544/371472 [8:28:22<21:21:21,  3.45it/s]
 29%|██▊       | 106545/371472 [8:28:22<23:34:52,  3.12it/s]
 29%|██▊       | 106546/371472 [8:28:23<22:45:38,  3.23it/s]
 29%|██▊       | 106547/371472 [8:28:23<21:59:09,  3.35it/s]
 29%|██▊       | 106548/371472 [8:28:23<21:35:59,  3.41it/s]
 29%|██▊       | 106549/371472 [8:28:24<21:35:31,  3.41it/s]
 29%|██▊       | 106550/371472 [8:28:24<21:50:36,  3.37it/s]
 29%|██▊       | 106551/371472 [8:28:24<22:02:42,  3.34it/s]
 29%|██▊       | 106552/371472 [8:28:25<23:20:52,  3.15it/s]
 29%|██▊       | 106553/371472 [8:28:25<24:11:20,  3.04it/s]
 29%|██▊       | 106554/371472 [8:28:25<24:44:23,  2.97it/s]
 29%|██▊       | 106555/371472 [8:28:26<23:12:40,  3.17it/s]
 29%|██▊       | 106556/371472 [8:28:26<22:25:35,  3.28it/s]
 29%|██▊       | 106557/371472 [8:28:26<23:13:50,  3.17it/s]
 29%|██▊       | 106558/371472 [8:28:26<22:24:54,  3.28it/s]
 29%|██▊       | 106559/371472 [8:28:27<22:27:57,  3.28it/s]
 29%|██▊       | 106560/371472 [8:28:27<22:07:49,  3.33it/s]
                                                            
{'loss': 3.3329, 'learning_rate': 7.421728544032407e-07, 'epoch': 4.59}

 29%|██▊       | 106560/371472 [8:28:27<22:07:49,  3.33it/s]
 29%|██▊       | 106561/371472 [8:28:27<23:29:35,  3.13it/s]
 29%|██▊       | 106562/371472 [8:28:28<22:29:13,  3.27it/s]
 29%|██▊       | 106563/371472 [8:28:28<21:22:15,  3.44it/s]
 29%|██▊       | 106564/371472 [8:28:28<21:54:57,  3.36it/s]
 29%|██▊       | 106565/371472 [8:28:29<21:31:46,  3.42it/s]
 29%|██▊       | 106566/371472 [8:28:29<21:08:20,  3.48it/s]
 29%|██▊       | 106567/371472 [8:28:29<20:43:06,  3.55it/s]
 29%|██▊       | 106568/371472 [8:28:29<20:12:39,  3.64it/s]
 29%|██▊       | 106569/371472 [8:28:30<20:14:20,  3.64it/s]
 29%|██▊       | 106570/371472 [8:28:30<21:13:27,  3.47it/s]
 29%|██▊       | 106571/371472 [8:28:30<20:33:59,  3.58it/s]
 29%|██▊       | 106572/371472 [8:28:30<20:10:26,  3.65it/s]
 29%|██▊       | 106573/371472 [8:28:31<19:50:45,  3.71it/s]
 29%|██▊       | 106574/371472 [8:28:31<19:13:55,  3.83it/s]
 29%|██▊       | 106575/371472 [8:28:31<21:58:18,  3.35it/s]
 29%|██▊       | 106576/371472 [8:28:32<20:51:35,  3.53it/s]
 29%|██▊       | 106577/371472 [8:28:32<20:47:07,  3.54it/s]
 29%|██▊       | 106578/371472 [8:28:32<21:06:43,  3.49it/s]
 29%|██▊       | 106579/371472 [8:28:32<21:20:20,  3.45it/s]
 29%|██▊       | 106580/371472 [8:28:33<21:35:44,  3.41it/s]
                                                            
{'loss': 3.6775, 'learning_rate': 7.421243724277619e-07, 'epoch': 4.59}

 29%|██▊       | 106580/371472 [8:28:33<21:35:44,  3.41it/s]
 29%|██▊       | 106581/371472 [8:28:33<21:18:09,  3.45it/s]
 29%|██▊       | 106582/371472 [8:28:33<20:29:26,  3.59it/s]
 29%|██▊       | 106583/371472 [8:28:34<20:11:51,  3.64it/s]
 29%|██▊       | 106584/371472 [8:28:34<19:56:42,  3.69it/s]
 29%|██▊       | 106585/371472 [8:28:34<20:14:52,  3.63it/s]
 29%|██▊       | 106586/371472 [8:28:34<20:17:50,  3.63it/s]
 29%|██▊       | 106587/371472 [8:28:35<20:58:04,  3.51it/s]
 29%|██▊       | 106588/371472 [8:28:35<21:13:42,  3.47it/s]
 29%|██▊       | 106589/371472 [8:28:35<20:57:59,  3.51it/s]
 29%|██▊       | 106590/371472 [8:28:36<21:30:33,  3.42it/s]
 29%|██▊       | 106591/371472 [8:28:36<21:06:24,  3.49it/s]
 29%|██▊       | 106592/371472 [8:28:36<21:14:24,  3.46it/s]
 29%|██▊       | 106593/371472 [8:28:37<22:39:34,  3.25it/s]
 29%|██▊       | 106594/371472 [8:28:37<21:35:14,  3.41it/s]
 29%|██▊       | 106595/371472 [8:28:37<20:58:50,  3.51it/s]
 29%|██▊       | 106596/371472 [8:28:37<22:12:06,  3.31it/s]
 29%|██▊       | 106597/371472 [8:28:38<22:13:26,  3.31it/s]
 29%|██▊       | 106598/371472 [8:28:38<21:21:55,  3.44it/s]
 29%|██▊       | 106599/371472 [8:28:38<21:37:33,  3.40it/s]
 29%|██▊       | 106600/371472 [8:28:39<21:24:10,  3.44it/s]
                                                            
{'loss': 3.4037, 'learning_rate': 7.420758904522829e-07, 'epoch': 4.59}

 29%|██▊       | 106600/371472 [8:28:39<21:24:10,  3.44it/s]
 29%|██▊       | 106601/371472 [8:28:39<21:00:56,  3.50it/s]
 29%|██▊       | 106602/371472 [8:28:39<21:03:59,  3.49it/s]
 29%|██▊       | 106603/371472 [8:28:39<22:01:26,  3.34it/s]
 29%|██▊       | 106604/371472 [8:28:40<20:54:01,  3.52it/s]
 29%|██▊       | 106605/371472 [8:28:40<20:24:49,  3.60it/s]
 29%|██▊       | 106606/371472 [8:28:40<21:12:38,  3.47it/s]
 29%|██▊       | 106607/371472 [8:28:41<20:33:27,  3.58it/s]
 29%|██▊       | 106608/371472 [8:28:41<20:31:09,  3.59it/s]
 29%|██▊       | 106609/371472 [8:28:41<20:13:59,  3.64it/s]
 29%|██▊       | 106610/371472 [8:28:41<20:40:42,  3.56it/s]
 29%|██▊       | 106611/371472 [8:28:42<20:10:28,  3.65it/s]
 29%|██▊       | 106612/371472 [8:28:42<20:22:39,  3.61it/s]
 29%|██▊       | 106613/371472 [8:28:42<20:44:20,  3.55it/s]
 29%|██▊       | 106614/371472 [8:28:42<20:04:36,  3.66it/s]
 29%|██▊       | 106615/371472 [8:28:43<19:55:51,  3.69it/s]
 29%|██▊       | 106616/371472 [8:28:43<20:38:39,  3.56it/s]
 29%|██▊       | 106617/371472 [8:28:43<20:10:00,  3.65it/s]
 29%|██▊       | 106618/371472 [8:28:44<19:41:11,  3.74it/s]
 29%|██▊       | 106619/371472 [8:28:44<19:13:19,  3.83it/s]
 29%|██▊       | 106620/371472 [8:28:44<18:50:31,  3.90it/s]
                                                            
{'loss': 3.4664, 'learning_rate': 7.42027408476804e-07, 'epoch': 4.59}

 29%|██▊       | 106620/371472 [8:28:44<18:50:31,  3.90it/s]
 29%|██▊       | 106621/371472 [8:28:44<19:26:36,  3.78it/s]
 29%|██▊       | 106622/371472 [8:28:45<19:58:24,  3.68it/s]
 29%|██▊       | 106623/371472 [8:28:45<20:24:21,  3.61it/s]
 29%|██▊       | 106624/371472 [8:28:45<20:17:46,  3.62it/s]
 29%|██▊       | 106625/371472 [8:28:45<19:56:25,  3.69it/s]
 29%|██▊       | 106626/371472 [8:28:46<19:41:47,  3.74it/s]
 29%|██▊       | 106627/371472 [8:28:46<19:47:52,  3.72it/s]
 29%|██▊       | 106628/371472 [8:28:46<20:30:42,  3.59it/s]
 29%|██▊       | 106629/371472 [8:28:46<19:59:30,  3.68it/s]
 29%|██▊       | 106630/371472 [8:28:47<20:34:24,  3.58it/s]
 29%|██▊       | 106631/371472 [8:28:47<20:48:02,  3.54it/s]
 29%|██▊       | 106632/371472 [8:28:47<20:37:43,  3.57it/s]
 29%|██▊       | 106633/371472 [8:28:48<20:17:21,  3.63it/s]
 29%|██▊       | 106634/371472 [8:28:48<20:04:05,  3.67it/s]
 29%|██▊       | 106635/371472 [8:28:48<21:48:19,  3.37it/s]
 29%|██▊       | 106636/371472 [8:28:48<21:04:20,  3.49it/s]
 29%|██▊       | 106637/371472 [8:28:49<21:08:02,  3.48it/s]
 29%|██▊       | 106638/371472 [8:28:49<21:26:29,  3.43it/s]
 29%|██▊       | 106639/371472 [8:28:49<20:55:40,  3.52it/s]
 29%|██▊       | 106640/371472 [8:28:50<21:17:00,  3.46it/s]
                                                            
{'loss': 3.4854, 'learning_rate': 7.419789265013251e-07, 'epoch': 4.59}

 29%|██▊       | 106640/371472 [8:28:50<21:17:00,  3.46it/s]
 29%|██▊       | 106641/371472 [8:28:50<23:49:28,  3.09it/s]
 29%|██▊       | 106642/371472 [8:28:50<22:45:03,  3.23it/s]
 29%|██▊       | 106643/371472 [8:28:51<21:26:12,  3.43it/s]
 29%|██▊       | 106644/371472 [8:28:51<22:06:45,  3.33it/s]
 29%|██▊       | 106645/371472 [8:28:51<23:01:32,  3.19it/s]
 29%|██▊       | 106646/371472 [8:28:52<22:31:51,  3.26it/s]
 29%|██▊       | 106647/371472 [8:28:52<21:18:59,  3.45it/s]
 29%|██▊       | 106648/371472 [8:28:52<20:48:25,  3.54it/s]
 29%|██▊       | 106649/371472 [8:28:52<21:14:51,  3.46it/s]
 29%|██▊       | 106650/371472 [8:28:53<20:15:42,  3.63it/s]
 29%|██▊       | 106651/371472 [8:28:53<20:12:59,  3.64it/s]
 29%|██▊       | 106652/371472 [8:28:53<20:34:44,  3.57it/s]
 29%|██▊       | 106653/371472 [8:28:54<22:49:59,  3.22it/s]
 29%|██▊       | 106654/371472 [8:28:54<22:06:11,  3.33it/s]
 29%|██▊       | 106655/371472 [8:28:54<20:43:41,  3.55it/s]
 29%|██▊       | 106656/371472 [8:28:54<20:13:03,  3.64it/s]
 29%|██▊       | 106657/371472 [8:28:55<19:46:24,  3.72it/s]
 29%|██▊       | 106658/371472 [8:28:55<20:46:21,  3.54it/s]
 29%|██▊       | 106659/371472 [8:28:55<21:38:04,  3.40it/s]
 29%|██▊       | 106660/371472 [8:28:55<21:22:53,  3.44it/s]
                                                            
{'loss': 3.4455, 'learning_rate': 7.419304445258463e-07, 'epoch': 4.59}

 29%|██▊       | 106660/371472 [8:28:55<21:22:53,  3.44it/s]
 29%|██▊       | 106661/371472 [8:28:56<20:24:10,  3.61it/s]
 29%|██▊       | 106662/371472 [8:28:56<20:34:48,  3.57it/s]
 29%|██▊       | 106663/371472 [8:28:56<21:11:55,  3.47it/s]
 29%|██▊       | 106664/371472 [8:28:57<21:08:38,  3.48it/s]
 29%|██▊       | 106665/371472 [8:28:57<21:20:43,  3.45it/s]
 29%|██▊       | 106666/371472 [8:28:57<21:54:07,  3.36it/s]
 29%|██▊       | 106667/371472 [8:28:58<21:52:40,  3.36it/s]
 29%|██▊       | 106668/371472 [8:28:58<21:19:28,  3.45it/s]
 29%|██▊       | 106669/371472 [8:28:58<21:06:59,  3.48it/s]
 29%|██▊       | 106670/371472 [8:28:58<22:26:33,  3.28it/s]
 29%|██▊       | 106671/371472 [8:28:59<21:26:02,  3.43it/s]
 29%|██▊       | 106672/371472 [8:28:59<21:16:12,  3.46it/s]
 29%|██▊       | 106673/371472 [8:28:59<21:14:19,  3.46it/s]
 29%|██▊       | 106674/371472 [8:29:00<21:28:31,  3.43it/s]
 29%|██▊       | 106675/371472 [8:29:00<23:00:04,  3.20it/s]
 29%|██▊       | 106676/371472 [8:29:00<22:04:15,  3.33it/s]
 29%|██▊       | 106677/371472 [8:29:00<21:58:53,  3.35it/s]
 29%|██▊       | 106678/371472 [8:29:01<21:13:17,  3.47it/s]
 29%|██▊       | 106679/371472 [8:29:01<20:10:34,  3.65it/s]
 29%|██▊       | 106680/371472 [8:29:01<19:49:39,  3.71it/s]
                                                            
{'loss': 3.2571, 'learning_rate': 7.418819625503673e-07, 'epoch': 4.59}

 29%|██▊       | 106680/371472 [8:29:01<19:49:39,  3.71it/s]
 29%|██▊       | 106681/371472 [8:29:02<19:48:51,  3.71it/s]
 29%|██▊       | 106682/371472 [8:29:02<20:15:54,  3.63it/s]
 29%|██▊       | 106683/371472 [8:29:02<19:43:19,  3.73it/s]
 29%|██▊       | 106684/371472 [8:29:02<19:35:54,  3.75it/s]
 29%|██▊       | 106685/371472 [8:29:03<20:17:14,  3.63it/s]
 29%|██▊       | 106686/371472 [8:29:03<20:37:43,  3.57it/s]
 29%|██▊       | 106687/371472 [8:29:03<20:00:03,  3.68it/s]
 29%|██▊       | 106688/371472 [8:29:03<19:46:40,  3.72it/s]
 29%|██▊       | 106689/371472 [8:29:04<19:48:46,  3.71it/s]
 29%|██▊       | 106690/371472 [8:29:04<20:09:38,  3.65it/s]
 29%|██▊       | 106691/371472 [8:29:04<20:25:50,  3.60it/s]
 29%|██▊       | 106692/371472 [8:29:05<20:46:55,  3.54it/s]
 29%|██▊       | 106693/371472 [8:29:05<19:56:30,  3.69it/s]
 29%|██▊       | 106694/371472 [8:29:05<19:27:22,  3.78it/s]
 29%|██▊       | 106695/371472 [8:29:05<19:01:44,  3.87it/s]
 29%|██▊       | 106696/371472 [8:29:06<19:09:18,  3.84it/s]
 29%|██▊       | 106697/371472 [8:29:06<19:03:15,  3.86it/s]
 29%|██▊       | 106698/371472 [8:29:06<20:07:05,  3.66it/s]
 29%|██▊       | 106699/371472 [8:29:06<20:03:29,  3.67it/s]
 29%|██▊       | 106700/371472 [8:29:07<19:59:40,  3.68it/s]
                                                            
{'loss': 3.3615, 'learning_rate': 7.418334805748884e-07, 'epoch': 4.6}

 29%|██▊       | 106700/371472 [8:29:07<19:59:40,  3.68it/s]
 29%|██▊       | 106701/371472 [8:29:07<19:46:21,  3.72it/s]
 29%|██▊       | 106702/371472 [8:29:07<19:45:01,  3.72it/s]
 29%|██▊       | 106703/371472 [8:29:07<19:21:20,  3.80it/s]
 29%|██▊       | 106704/371472 [8:29:08<19:34:50,  3.76it/s]
 29%|██▊       | 106705/371472 [8:29:08<19:24:34,  3.79it/s]
 29%|██▊       | 106706/371472 [8:29:08<19:37:03,  3.75it/s]
 29%|██▊       | 106707/371472 [8:29:09<20:00:55,  3.67it/s]
 29%|██▊       | 106708/371472 [8:29:09<21:39:37,  3.40it/s]
 29%|██▊       | 106709/371472 [8:29:09<21:14:10,  3.46it/s]
 29%|██▊       | 106710/371472 [8:29:10<22:27:50,  3.27it/s]
 29%|██▊       | 106711/371472 [8:29:10<21:26:57,  3.43it/s]
 29%|██▊       | 106712/371472 [8:29:10<20:48:01,  3.54it/s]
 29%|██▊       | 106713/371472 [8:29:10<20:34:54,  3.57it/s]
 29%|██▊       | 106714/371472 [8:29:11<20:44:25,  3.55it/s]
 29%|██▊       | 106715/371472 [8:29:11<20:42:27,  3.55it/s]
 29%|██▊       | 106716/371472 [8:29:11<21:46:21,  3.38it/s]
 29%|██▊       | 106717/371472 [8:29:12<22:32:48,  3.26it/s]
 29%|██▊       | 106718/371472 [8:29:12<22:25:30,  3.28it/s]
 29%|██▊       | 106719/371472 [8:29:12<22:24:02,  3.28it/s]
 29%|██▊       | 106720/371472 [8:29:12<21:52:04,  3.36it/s]
                                                            
{'loss': 3.5081, 'learning_rate': 7.417849985994096e-07, 'epoch': 4.6}

 29%|██▊       | 106720/371472 [8:29:12<21:52:04,  3.36it/s]
 29%|██▊       | 106721/371472 [8:29:13<21:08:43,  3.48it/s]
 29%|██▊       | 106722/371472 [8:29:13<20:56:27,  3.51it/s]
 29%|██▊       | 106723/371472 [8:29:13<20:50:12,  3.53it/s]
 29%|██▊       | 106724/371472 [8:29:14<21:00:06,  3.50it/s]
 29%|██▊       | 106725/371472 [8:29:14<20:17:37,  3.62it/s]
 29%|██▊       | 106726/371472 [8:29:14<19:36:32,  3.75it/s]
 29%|██▊       | 106727/371472 [8:29:14<20:06:42,  3.66it/s]
 29%|██▊       | 106728/371472 [8:29:15<20:07:05,  3.66it/s]
 29%|██▊       | 106729/371472 [8:29:15<20:10:44,  3.64it/s]
 29%|██▊       | 106730/371472 [8:29:15<19:41:48,  3.73it/s]
 29%|██▊       | 106731/371472 [8:29:15<20:37:39,  3.57it/s]
 29%|██▊       | 106732/371472 [8:29:16<20:43:50,  3.55it/s]
 29%|██▊       | 106733/371472 [8:29:16<21:46:55,  3.38it/s]
 29%|██▊       | 106734/371472 [8:29:16<21:09:35,  3.48it/s]
 29%|██▊       | 106735/371472 [8:29:17<20:06:20,  3.66it/s]
 29%|██▊       | 106736/371472 [8:29:17<19:41:06,  3.74it/s]
 29%|██▊       | 106737/371472 [8:29:17<20:05:33,  3.66it/s]
 29%|██▊       | 106738/371472 [8:29:17<20:31:18,  3.58it/s]
 29%|██▊       | 106739/371472 [8:29:18<20:04:24,  3.66it/s]
 29%|██▊       | 106740/371472 [8:29:18<19:18:50,  3.81it/s]
                                                            
{'loss': 3.5212, 'learning_rate': 7.417365166239308e-07, 'epoch': 4.6}

 29%|██▊       | 106740/371472 [8:29:18<19:18:50,  3.81it/s]
 29%|██▊       | 106741/371472 [8:29:18<20:07:54,  3.65it/s]
 29%|██▊       | 106742/371472 [8:29:18<20:12:09,  3.64it/s]
 29%|██▊       | 106743/371472 [8:29:19<19:58:39,  3.68it/s]
 29%|██▊       | 106744/371472 [8:29:19<21:21:13,  3.44it/s]
 29%|██▊       | 106745/371472 [8:29:19<20:48:37,  3.53it/s]
 29%|██▊       | 106746/371472 [8:29:20<20:58:22,  3.51it/s]
 29%|██▊       | 106747/371472 [8:29:20<21:43:59,  3.38it/s]
 29%|██▊       | 106748/371472 [8:29:20<26:04:53,  2.82it/s]
 29%|██▊       | 106749/371472 [8:29:21<24:34:22,  2.99it/s]
 29%|██▊       | 106750/371472 [8:29:21<23:16:35,  3.16it/s]
 29%|██▊       | 106751/371472 [8:29:21<23:10:49,  3.17it/s]
 29%|██▊       | 106752/371472 [8:29:22<21:38:26,  3.40it/s]
 29%|██▊       | 106753/371472 [8:29:22<21:00:11,  3.50it/s]
 29%|██▊       | 106754/371472 [8:29:22<22:20:42,  3.29it/s]
 29%|██▊       | 106755/371472 [8:29:22<21:18:11,  3.45it/s]
 29%|██▊       | 106756/371472 [8:29:23<20:38:12,  3.56it/s]
 29%|██▊       | 106757/371472 [8:29:23<21:01:49,  3.50it/s]
 29%|██▊       | 106758/371472 [8:29:23<21:13:29,  3.46it/s]
 29%|██▊       | 106759/371472 [8:29:24<21:04:54,  3.49it/s]
 29%|██▊       | 106760/371472 [8:29:24<21:24:31,  3.43it/s]
                                                            
{'loss': 3.4033, 'learning_rate': 7.416880346484517e-07, 'epoch': 4.6}

 29%|██▊       | 106760/371472 [8:29:24<21:24:31,  3.43it/s]
 29%|██▊       | 106761/371472 [8:29:24<21:04:47,  3.49it/s]
 29%|██▊       | 106762/371472 [8:29:24<21:08:52,  3.48it/s]
 29%|██▊       | 106763/371472 [8:29:25<21:19:43,  3.45it/s]
 29%|██▊       | 106764/371472 [8:29:25<22:04:47,  3.33it/s]
 29%|██▊       | 106765/371472 [8:29:25<21:21:11,  3.44it/s]
 29%|██▊       | 106766/371472 [8:29:26<20:18:46,  3.62it/s]
 29%|██▊       | 106767/371472 [8:29:26<21:12:02,  3.47it/s]
 29%|██▊       | 106768/371472 [8:29:26<20:58:24,  3.51it/s]
 29%|██▊       | 106769/371472 [8:29:26<20:26:49,  3.60it/s]
 29%|██▊       | 106770/371472 [8:29:27<21:06:32,  3.48it/s]
 29%|██▊       | 106771/371472 [8:29:27<21:03:00,  3.49it/s]
 29%|██▊       | 106772/371472 [8:29:27<22:03:41,  3.33it/s]
 29%|██▊       | 106773/371472 [8:29:28<22:00:03,  3.34it/s]
 29%|██▊       | 106774/371472 [8:29:28<22:13:31,  3.31it/s]
 29%|██▊       | 106775/371472 [8:29:28<21:59:19,  3.34it/s]
 29%|██▊       | 106776/371472 [8:29:29<22:00:55,  3.34it/s]
 29%|██▊       | 106777/371472 [8:29:29<20:59:03,  3.50it/s]
 29%|██▊       | 106778/371472 [8:29:29<19:52:20,  3.70it/s]
 29%|██▊       | 106779/371472 [8:29:29<19:56:43,  3.69it/s]
 29%|██▊       | 106780/371472 [8:29:30<21:33:10,  3.41it/s]
                                                            
{'loss': 3.528, 'learning_rate': 7.416395526729729e-07, 'epoch': 4.6}

 29%|██▊       | 106780/371472 [8:29:30<21:33:10,  3.41it/s]
 29%|██▊       | 106781/371472 [8:29:30<20:27:24,  3.59it/s]
 29%|██▊       | 106782/371472 [8:29:30<20:10:59,  3.64it/s]
 29%|██▊       | 106783/371472 [8:29:30<19:49:41,  3.71it/s]
 29%|██▊       | 106784/371472 [8:29:31<19:26:24,  3.78it/s]
 29%|██▊       | 106785/371472 [8:29:31<20:39:11,  3.56it/s]
 29%|██▊       | 106786/371472 [8:29:31<19:53:05,  3.70it/s]
 29%|██▊       | 106787/371472 [8:29:31<19:18:47,  3.81it/s]
 29%|██▊       | 106788/371472 [8:29:32<19:17:52,  3.81it/s]
 29%|██▊       | 106789/371472 [8:29:32<18:52:20,  3.90it/s]
 29%|██▊       | 106790/371472 [8:29:32<19:04:24,  3.85it/s]
 29%|██▊       | 106791/371472 [8:29:33<19:50:08,  3.71it/s]
 29%|██▊       | 106792/371472 [8:29:33<19:28:35,  3.77it/s]
 29%|██▊       | 106793/371472 [8:29:33<19:59:30,  3.68it/s]
 29%|██▊       | 106794/371472 [8:29:33<19:48:11,  3.71it/s]
 29%|██▊       | 106795/371472 [8:29:34<19:54:57,  3.69it/s]
 29%|██▊       | 106796/371472 [8:29:34<19:27:23,  3.78it/s]
 29%|██▊       | 106797/371472 [8:29:34<21:15:56,  3.46it/s]
 29%|██▊       | 106798/371472 [8:29:34<20:31:59,  3.58it/s]
 29%|██▉       | 106799/371472 [8:29:35<20:51:52,  3.52it/s]
 29%|██▉       | 106800/371472 [8:29:35<21:58:57,  3.34it/s]
                                                            
{'loss': 3.4061, 'learning_rate': 7.41591070697494e-07, 'epoch': 4.6}

 29%|██▉       | 106800/371472 [8:29:35<21:58:57,  3.34it/s]
 29%|██▉       | 106801/371472 [8:29:35<24:14:24,  3.03it/s]
 29%|██▉       | 106802/371472 [8:29:36<24:00:56,  3.06it/s]
 29%|██▉       | 106803/371472 [8:29:36<22:43:47,  3.23it/s]
 29%|██▉       | 106804/371472 [8:29:36<22:50:31,  3.22it/s]
 29%|██▉       | 106805/371472 [8:29:37<21:28:46,  3.42it/s]
 29%|██▉       | 106806/371472 [8:29:37<21:46:53,  3.38it/s]
 29%|██▉       | 106807/371472 [8:29:37<22:04:50,  3.33it/s]
 29%|██▉       | 106808/371472 [8:29:38<22:02:52,  3.33it/s]
 29%|██▉       | 106809/371472 [8:29:38<21:26:48,  3.43it/s]
 29%|██▉       | 106810/371472 [8:29:38<21:35:14,  3.41it/s]
 29%|██▉       | 106811/371472 [8:29:38<22:36:52,  3.25it/s]
 29%|██▉       | 106812/371472 [8:29:39<23:31:38,  3.12it/s]
 29%|██▉       | 106813/371472 [8:29:39<25:07:54,  2.93it/s]
 29%|██▉       | 106814/371472 [8:29:40<24:12:10,  3.04it/s]
 29%|██▉       | 106815/371472 [8:29:40<22:57:49,  3.20it/s]
 29%|██▉       | 106816/371472 [8:29:40<21:45:58,  3.38it/s]
 29%|██▉       | 106817/371472 [8:29:40<20:53:11,  3.52it/s]
 29%|██▉       | 106818/371472 [8:29:41<22:46:31,  3.23it/s]
 29%|██▉       | 106819/371472 [8:29:41<21:12:43,  3.47it/s]
 29%|██▉       | 106820/371472 [8:29:41<20:23:49,  3.60it/s]
                                                            
{'loss': 3.3811, 'learning_rate': 7.415425887220151e-07, 'epoch': 4.6}

 29%|██▉       | 106820/371472 [8:29:41<20:23:49,  3.60it/s]
 29%|██▉       | 106821/371472 [8:29:41<21:29:50,  3.42it/s]
 29%|██▉       | 106822/371472 [8:29:42<22:30:16,  3.27it/s]
 29%|██▉       | 106823/371472 [8:29:42<21:41:12,  3.39it/s]
 29%|██▉       | 106824/371472 [8:29:42<20:45:37,  3.54it/s]
 29%|██▉       | 106825/371472 [8:29:43<20:14:33,  3.63it/s]
 29%|██▉       | 106826/371472 [8:29:43<19:59:29,  3.68it/s]
 29%|██▉       | 106827/371472 [8:29:43<20:11:10,  3.64it/s]
 29%|██▉       | 106828/371472 [8:29:43<20:46:00,  3.54it/s]
 29%|██▉       | 106829/371472 [8:29:44<20:16:10,  3.63it/s]
 29%|██▉       | 106830/371472 [8:29:44<19:56:36,  3.69it/s]
 29%|██▉       | 106831/371472 [8:29:44<20:37:00,  3.57it/s]
 29%|██▉       | 106832/371472 [8:29:45<19:58:01,  3.68it/s]
 29%|██▉       | 106833/371472 [8:29:45<20:42:21,  3.55it/s]
 29%|██▉       | 106834/371472 [8:29:45<19:49:58,  3.71it/s]
 29%|██▉       | 106835/371472 [8:29:45<20:21:38,  3.61it/s]
 29%|██▉       | 106836/371472 [8:29:46<19:54:47,  3.69it/s]
 29%|██▉       | 106837/371472 [8:29:46<19:57:55,  3.68it/s]
 29%|██▉       | 106838/371472 [8:29:46<19:19:22,  3.80it/s]
 29%|██▉       | 106839/371472 [8:29:46<20:03:57,  3.66it/s]
 29%|██▉       | 106840/371472 [8:29:47<20:17:49,  3.62it/s]
                                                            
{'loss': 3.4855, 'learning_rate': 7.414941067465362e-07, 'epoch': 4.6}

 29%|██▉       | 106840/371472 [8:29:47<20:17:49,  3.62it/s]
 29%|██▉       | 106841/371472 [8:29:47<20:59:54,  3.50it/s]
 29%|██▉       | 106842/371472 [8:29:47<20:06:38,  3.66it/s]
 29%|██▉       | 106843/371472 [8:29:48<19:33:46,  3.76it/s]
 29%|██▉       | 106844/371472 [8:29:48<20:58:43,  3.50it/s]
 29%|██▉       | 106845/371472 [8:29:48<20:43:03,  3.55it/s]
 29%|██▉       | 106846/371472 [8:29:48<20:16:43,  3.62it/s]
 29%|██▉       | 106847/371472 [8:29:49<20:24:43,  3.60it/s]
 29%|██▉       | 106848/371472 [8:29:49<20:53:05,  3.52it/s]
 29%|██▉       | 106849/371472 [8:29:49<20:40:10,  3.56it/s]
 29%|██▉       | 106850/371472 [8:29:49<19:59:10,  3.68it/s]
 29%|██▉       | 106851/371472 [8:29:50<20:41:28,  3.55it/s]
 29%|██▉       | 106852/371472 [8:29:50<20:26:15,  3.60it/s]
 29%|██▉       | 106853/371472 [8:29:50<20:13:33,  3.63it/s]
 29%|██▉       | 106854/371472 [8:29:51<20:54:26,  3.52it/s]
 29%|██▉       | 106855/371472 [8:29:51<21:28:50,  3.42it/s]
 29%|██▉       | 106856/371472 [8:29:51<20:47:00,  3.54it/s]
 29%|██▉       | 106857/371472 [8:29:51<20:47:40,  3.53it/s]
 29%|██▉       | 106858/371472 [8:29:52<20:53:37,  3.52it/s]
 29%|██▉       | 106859/371472 [8:29:52<21:12:46,  3.47it/s]
 29%|██▉       | 106860/371472 [8:29:52<20:28:47,  3.59it/s]
                                                            
{'loss': 3.3583, 'learning_rate': 7.414456247710573e-07, 'epoch': 4.6}

 29%|██▉       | 106860/371472 [8:29:52<20:28:47,  3.59it/s]
 29%|██▉       | 106861/371472 [8:29:53<20:52:15,  3.52it/s]
 29%|██▉       | 106862/371472 [8:29:53<20:21:06,  3.61it/s]
 29%|██▉       | 106863/371472 [8:29:53<20:39:49,  3.56it/s]
 29%|██▉       | 106864/371472 [8:29:53<21:33:25,  3.41it/s]
 29%|██▉       | 106865/371472 [8:29:54<20:59:53,  3.50it/s]
 29%|██▉       | 106866/371472 [8:29:54<20:15:36,  3.63it/s]
 29%|██▉       | 106867/371472 [8:29:54<19:31:58,  3.76it/s]
 29%|██▉       | 106868/371472 [8:29:55<20:08:45,  3.65it/s]
 29%|██▉       | 106869/371472 [8:29:55<20:09:19,  3.65it/s]
 29%|██▉       | 106870/371472 [8:29:55<20:03:43,  3.66it/s]
 29%|██▉       | 106871/371472 [8:29:55<19:57:02,  3.68it/s]
 29%|██▉       | 106872/371472 [8:29:56<19:58:14,  3.68it/s]
 29%|██▉       | 106873/371472 [8:29:56<20:14:01,  3.63it/s]
 29%|██▉       | 106874/371472 [8:29:56<20:15:56,  3.63it/s]
 29%|██▉       | 106875/371472 [8:29:56<19:52:08,  3.70it/s]
 29%|██▉       | 106876/371472 [8:29:57<19:24:36,  3.79it/s]
 29%|██▉       | 106877/371472 [8:29:57<20:32:17,  3.58it/s]
 29%|██▉       | 106878/371472 [8:29:57<20:50:13,  3.53it/s]
 29%|██▉       | 106879/371472 [8:29:58<20:41:26,  3.55it/s]
 29%|██▉       | 106880/371472 [8:29:58<20:22:58,  3.61it/s]
                                                            
{'loss': 3.3726, 'learning_rate': 7.413971427955784e-07, 'epoch': 4.6}

 29%|██▉       | 106880/371472 [8:29:58<20:22:58,  3.61it/s]
 29%|██▉       | 106881/371472 [8:29:58<21:37:48,  3.40it/s]
 29%|██▉       | 106882/371472 [8:29:58<20:57:31,  3.51it/s]
 29%|██▉       | 106883/371472 [8:29:59<20:26:14,  3.60it/s]
 29%|██▉       | 106884/371472 [8:29:59<19:36:47,  3.75it/s]
 29%|██▉       | 106885/371472 [8:29:59<19:27:35,  3.78it/s]
 29%|██▉       | 106886/371472 [8:30:00<19:52:44,  3.70it/s]
 29%|██▉       | 106887/371472 [8:30:00<22:02:45,  3.33it/s]
 29%|██▉       | 106888/371472 [8:30:00<21:21:52,  3.44it/s]
 29%|██▉       | 106889/371472 [8:30:00<21:10:29,  3.47it/s]
 29%|██▉       | 106890/371472 [8:30:01<21:26:03,  3.43it/s]
 29%|██▉       | 106891/371472 [8:30:01<20:40:22,  3.56it/s]
 29%|██▉       | 106892/371472 [8:30:01<19:51:11,  3.70it/s]
 29%|██▉       | 106893/371472 [8:30:02<20:39:06,  3.56it/s]
 29%|██▉       | 106894/371472 [8:30:02<20:20:00,  3.61it/s]
 29%|██▉       | 106895/371472 [8:30:02<20:43:10,  3.55it/s]
 29%|██▉       | 106896/371472 [8:30:02<20:43:12,  3.55it/s]
 29%|██▉       | 106897/371472 [8:30:03<21:37:18,  3.40it/s]
 29%|██▉       | 106898/371472 [8:30:03<22:38:32,  3.25it/s]
 29%|██▉       | 106899/371472 [8:30:03<22:17:46,  3.30it/s]
 29%|██▉       | 106900/371472 [8:30:04<22:39:41,  3.24it/s]
                                                            
{'loss': 3.5457, 'learning_rate': 7.413486608200995e-07, 'epoch': 4.6}

 29%|██▉       | 106900/371472 [8:30:04<22:39:41,  3.24it/s]
 29%|██▉       | 106901/371472 [8:30:04<22:07:19,  3.32it/s]
 29%|██▉       | 106902/371472 [8:30:04<21:50:53,  3.36it/s]
 29%|██▉       | 106903/371472 [8:30:05<22:18:16,  3.29it/s]
 29%|██▉       | 106904/371472 [8:30:05<23:57:35,  3.07it/s]
 29%|██▉       | 106905/371472 [8:30:05<23:20:45,  3.15it/s]
 29%|██▉       | 106906/371472 [8:30:05<21:58:51,  3.34it/s]
 29%|██▉       | 106907/371472 [8:30:06<20:56:58,  3.51it/s]
 29%|██▉       | 106908/371472 [8:30:06<21:34:27,  3.41it/s]
 29%|██▉       | 106909/371472 [8:30:06<20:58:57,  3.50it/s]
 29%|██▉       | 106910/371472 [8:30:07<20:46:58,  3.54it/s]
 29%|██▉       | 106911/371472 [8:30:07<20:09:09,  3.65it/s]
 29%|██▉       | 106912/371472 [8:30:07<20:20:24,  3.61it/s]
 29%|██▉       | 106913/371472 [8:30:07<19:50:44,  3.70it/s]
 29%|██▉       | 106914/371472 [8:30:08<20:09:15,  3.65it/s]
 29%|██▉       | 106915/371472 [8:30:08<20:17:58,  3.62it/s]
 29%|██▉       | 106916/371472 [8:30:08<22:03:54,  3.33it/s]
 29%|██▉       | 106917/371472 [8:30:09<21:18:38,  3.45it/s]
 29%|██▉       | 106918/371472 [8:30:09<20:29:03,  3.59it/s]
 29%|██▉       | 106919/371472 [8:30:09<19:43:12,  3.73it/s]
 29%|██▉       | 106920/371472 [8:30:09<20:00:22,  3.67it/s]
                                                            
{'loss': 3.3274, 'learning_rate': 7.413001788446206e-07, 'epoch': 4.61}

 29%|██▉       | 106920/371472 [8:30:09<20:00:22,  3.67it/s]
 29%|██▉       | 106921/371472 [8:30:10<20:51:46,  3.52it/s]
 29%|██▉       | 106922/371472 [8:30:10<20:26:21,  3.60it/s]
 29%|██▉       | 106923/371472 [8:30:10<21:02:50,  3.49it/s]
 29%|██▉       | 106924/371472 [8:30:10<20:16:38,  3.62it/s]
 29%|██▉       | 106925/371472 [8:30:11<19:46:55,  3.71it/s]
 29%|██▉       | 106926/371472 [8:30:11<22:41:32,  3.24it/s]
 29%|██▉       | 106927/371472 [8:30:11<21:41:03,  3.39it/s]
 29%|██▉       | 106928/371472 [8:30:12<20:45:28,  3.54it/s]
 29%|██▉       | 106929/371472 [8:30:12<20:33:25,  3.57it/s]
 29%|██▉       | 106930/371472 [8:30:12<22:11:49,  3.31it/s]
 29%|██▉       | 106931/371472 [8:30:13<20:54:25,  3.51it/s]
 29%|██▉       | 106932/371472 [8:30:13<20:28:24,  3.59it/s]
 29%|██▉       | 106933/371472 [8:30:13<20:10:28,  3.64it/s]
 29%|██▉       | 106934/371472 [8:30:13<19:44:10,  3.72it/s]
 29%|██▉       | 106935/371472 [8:30:14<21:57:04,  3.35it/s]
 29%|██▉       | 106936/371472 [8:30:14<22:22:55,  3.28it/s]
 29%|██▉       | 106937/371472 [8:30:14<22:32:25,  3.26it/s]
 29%|██▉       | 106938/371472 [8:30:15<21:32:21,  3.41it/s]
 29%|██▉       | 106939/371472 [8:30:15<20:49:14,  3.53it/s]
 29%|██▉       | 106940/371472 [8:30:15<22:00:12,  3.34it/s]
                                                            
{'loss': 3.5479, 'learning_rate': 7.412516968691417e-07, 'epoch': 4.61}

 29%|██▉       | 106940/371472 [8:30:15<22:00:12,  3.34it/s]
 29%|██▉       | 106941/371472 [8:30:15<21:32:00,  3.41it/s]
 29%|██▉       | 106942/371472 [8:30:16<21:03:29,  3.49it/s]
 29%|██▉       | 106943/371472 [8:30:16<21:13:47,  3.46it/s]
 29%|██▉       | 106944/371472 [8:30:16<20:42:13,  3.55it/s]
 29%|██▉       | 106945/371472 [8:30:17<21:02:14,  3.49it/s]
 29%|██▉       | 106946/371472 [8:30:17<20:24:25,  3.60it/s]
 29%|██▉       | 106947/371472 [8:30:17<20:35:32,  3.57it/s]
 29%|██▉       | 106948/371472 [8:30:17<20:43:32,  3.55it/s]
 29%|██▉       | 106949/371472 [8:30:18<20:45:59,  3.54it/s]
 29%|██▉       | 106950/371472 [8:30:18<19:51:20,  3.70it/s]
 29%|██▉       | 106951/371472 [8:30:18<20:14:26,  3.63it/s]
 29%|██▉       | 106952/371472 [8:30:18<20:23:38,  3.60it/s]
 29%|██▉       | 106953/371472 [8:30:19<21:21:14,  3.44it/s]
 29%|██▉       | 106954/371472 [8:30:19<21:02:25,  3.49it/s]
 29%|██▉       | 106955/371472 [8:30:19<20:46:58,  3.54it/s]
 29%|██▉       | 106956/371472 [8:30:20<20:20:01,  3.61it/s]
 29%|██▉       | 106957/371472 [8:30:20<20:39:22,  3.56it/s]
 29%|██▉       | 106958/371472 [8:30:20<20:11:51,  3.64it/s]
 29%|██▉       | 106959/371472 [8:30:20<19:34:36,  3.75it/s]
 29%|██▉       | 106960/371472 [8:30:21<20:37:47,  3.56it/s]
                                                            
{'loss': 3.4976, 'learning_rate': 7.412032148936629e-07, 'epoch': 4.61}

 29%|██▉       | 106960/371472 [8:30:21<20:37:47,  3.56it/s]
 29%|██▉       | 106961/371472 [8:30:21<19:47:56,  3.71it/s]
 29%|██▉       | 106962/371472 [8:30:21<20:43:14,  3.55it/s]
 29%|██▉       | 106963/371472 [8:30:22<21:05:53,  3.48it/s]
 29%|██▉       | 106964/371472 [8:30:22<20:25:11,  3.60it/s]
 29%|██▉       | 106965/371472 [8:30:22<19:52:38,  3.70it/s]
 29%|██▉       | 106966/371472 [8:30:22<19:46:23,  3.72it/s]
 29%|██▉       | 106967/371472 [8:30:23<20:24:14,  3.60it/s]
 29%|██▉       | 106968/371472 [8:30:23<19:29:59,  3.77it/s]
 29%|██▉       | 106969/371472 [8:30:23<19:33:08,  3.76it/s]
 29%|██▉       | 106970/371472 [8:30:23<19:32:50,  3.76it/s]
 29%|██▉       | 106971/371472 [8:30:24<21:44:33,  3.38it/s]
 29%|██▉       | 106972/371472 [8:30:24<21:14:44,  3.46it/s]
 29%|██▉       | 106973/371472 [8:30:24<20:38:28,  3.56it/s]
 29%|██▉       | 106974/371472 [8:30:25<20:34:35,  3.57it/s]
 29%|██▉       | 106975/371472 [8:30:25<20:57:57,  3.50it/s]
 29%|██▉       | 106976/371472 [8:30:25<20:48:32,  3.53it/s]
 29%|██▉       | 106977/371472 [8:30:25<20:03:04,  3.66it/s]
 29%|██▉       | 106978/371472 [8:30:26<20:39:11,  3.56it/s]
 29%|██▉       | 106979/371472 [8:30:26<24:02:29,  3.06it/s]
 29%|██▉       | 106980/371472 [8:30:27<25:12:54,  2.91it/s]
                                                            
{'loss': 3.3176, 'learning_rate': 7.411547329181841e-07, 'epoch': 4.61}

 29%|██▉       | 106980/371472 [8:30:27<25:12:54,  2.91it/s]
 29%|██▉       | 106981/371472 [8:30:27<23:11:09,  3.17it/s]
 29%|██▉       | 106982/371472 [8:30:27<22:48:11,  3.22it/s]
 29%|██▉       | 106983/371472 [8:30:27<21:07:37,  3.48it/s]
 29%|██▉       | 106984/371472 [8:30:28<20:30:24,  3.58it/s]
 29%|██▉       | 106985/371472 [8:30:28<19:55:29,  3.69it/s]
 29%|██▉       | 106986/371472 [8:30:28<19:43:07,  3.73it/s]
 29%|██▉       | 106987/371472 [8:30:28<20:02:16,  3.67it/s]
 29%|██▉       | 106988/371472 [8:30:29<20:28:40,  3.59it/s]
 29%|██▉       | 106989/371472 [8:30:29<20:55:43,  3.51it/s]
 29%|██▉       | 106990/371472 [8:30:29<20:52:32,  3.52it/s]
 29%|██▉       | 106991/371472 [8:30:30<20:54:41,  3.51it/s]
 29%|██▉       | 106992/371472 [8:30:30<20:39:15,  3.56it/s]
 29%|██▉       | 106993/371472 [8:30:30<20:35:24,  3.57it/s]
 29%|██▉       | 106994/371472 [8:30:30<21:43:58,  3.38it/s]
 29%|██▉       | 106995/371472 [8:30:31<20:59:43,  3.50it/s]
 29%|██▉       | 106996/371472 [8:30:31<20:49:30,  3.53it/s]
 29%|██▉       | 106997/371472 [8:30:31<21:16:16,  3.45it/s]
 29%|██▉       | 106998/371472 [8:30:32<20:23:40,  3.60it/s]
 29%|██▉       | 106999/371472 [8:30:32<20:19:36,  3.61it/s]
 29%|██▉       | 107000/371472 [8:30:32<19:39:49,  3.74it/s]
                                                            
{'loss': 3.4915, 'learning_rate': 7.411062509427051e-07, 'epoch': 4.61}

 29%|██▉       | 107000/371472 [8:30:32<19:39:49,  3.74it/s]
 29%|██▉       | 107001/371472 [8:30:32<20:30:49,  3.58it/s]
 29%|██▉       | 107002/371472 [8:30:33<20:40:48,  3.55it/s]
 29%|██▉       | 107003/371472 [8:30:33<20:46:03,  3.54it/s]
 29%|██▉       | 107004/371472 [8:30:33<21:35:43,  3.40it/s]
 29%|██▉       | 107005/371472 [8:30:34<21:31:10,  3.41it/s]
 29%|██▉       | 107006/371472 [8:30:34<20:56:05,  3.51it/s]
 29%|██▉       | 107007/371472 [8:30:34<20:19:43,  3.61it/s]
 29%|██▉       | 107008/371472 [8:30:34<20:39:54,  3.55it/s]
 29%|██▉       | 107009/371472 [8:30:35<20:12:51,  3.63it/s]
 29%|██▉       | 107010/371472 [8:30:35<19:56:19,  3.68it/s]
 29%|██▉       | 107011/371472 [8:30:35<19:44:16,  3.72it/s]
 29%|██▉       | 107012/371472 [8:30:35<20:55:13,  3.51it/s]
 29%|██▉       | 107013/371472 [8:30:36<21:12:32,  3.46it/s]
 29%|██▉       | 107014/371472 [8:30:36<20:57:11,  3.51it/s]
 29%|██▉       | 107015/371472 [8:30:36<20:15:33,  3.63it/s]
 29%|██▉       | 107016/371472 [8:30:37<20:38:06,  3.56it/s]
 29%|██▉       | 107017/371472 [8:30:37<20:30:47,  3.58it/s]
 29%|██▉       | 107018/371472 [8:30:37<20:55:29,  3.51it/s]
 29%|██▉       | 107019/371472 [8:30:37<21:19:00,  3.45it/s]
 29%|██▉       | 107020/371472 [8:30:38<20:44:19,  3.54it/s]
                                                            
{'loss': 3.5571, 'learning_rate': 7.410577689672261e-07, 'epoch': 4.61}

 29%|██▉       | 107020/371472 [8:30:38<20:44:19,  3.54it/s]
 29%|██▉       | 107021/371472 [8:30:38<20:31:14,  3.58it/s]
 29%|██▉       | 107022/371472 [8:30:38<20:41:28,  3.55it/s]
 29%|██▉       | 107023/371472 [8:30:39<20:56:32,  3.51it/s]
 29%|██▉       | 107024/371472 [8:30:39<20:58:33,  3.50it/s]
 29%|██▉       | 107025/371472 [8:30:39<21:19:56,  3.44it/s]
 29%|██▉       | 107026/371472 [8:30:39<20:33:59,  3.57it/s]
 29%|██▉       | 107027/371472 [8:30:40<20:32:22,  3.58it/s]
 29%|██▉       | 107028/371472 [8:30:40<22:25:10,  3.28it/s]
 29%|██▉       | 107029/371472 [8:30:40<21:27:49,  3.42it/s]
 29%|██▉       | 107030/371472 [8:30:41<20:51:42,  3.52it/s]
 29%|██▉       | 107031/371472 [8:30:41<22:28:31,  3.27it/s]
 29%|██▉       | 107032/371472 [8:30:41<21:15:54,  3.45it/s]
 29%|██▉       | 107033/371472 [8:30:42<22:17:54,  3.29it/s]
 29%|██▉       | 107034/371472 [8:30:42<21:44:41,  3.38it/s]
 29%|██▉       | 107035/371472 [8:30:42<22:24:24,  3.28it/s]
 29%|██▉       | 107036/371472 [8:30:42<21:03:50,  3.49it/s]
 29%|██▉       | 107037/371472 [8:30:43<20:57:46,  3.50it/s]
 29%|██▉       | 107038/371472 [8:30:43<21:22:09,  3.44it/s]
 29%|██▉       | 107039/371472 [8:30:43<21:05:16,  3.48it/s]
 29%|██▉       | 107040/371472 [8:30:44<21:26:03,  3.43it/s]
                                                            
{'loss': 3.5125, 'learning_rate': 7.410092869917472e-07, 'epoch': 4.61}

 29%|██▉       | 107040/371472 [8:30:44<21:26:03,  3.43it/s]
 29%|██▉       | 107041/371472 [8:30:44<21:59:39,  3.34it/s]
 29%|██▉       | 107042/371472 [8:30:44<21:00:28,  3.50it/s]
 29%|██▉       | 107043/371472 [8:30:44<20:53:14,  3.52it/s]
 29%|██▉       | 107044/371472 [8:30:45<20:26:01,  3.59it/s]
 29%|██▉       | 107045/371472 [8:30:45<20:53:01,  3.52it/s]
 29%|██▉       | 107046/371472 [8:30:45<22:00:11,  3.34it/s]
 29%|██▉       | 107047/371472 [8:30:46<23:29:50,  3.13it/s]
 29%|██▉       | 107048/371472 [8:30:46<22:56:40,  3.20it/s]
 29%|██▉       | 107049/371472 [8:30:46<21:48:10,  3.37it/s]
 29%|██▉       | 107050/371472 [8:30:47<21:44:58,  3.38it/s]
 29%|██▉       | 107051/371472 [8:30:47<21:58:05,  3.34it/s]
 29%|██▉       | 107052/371472 [8:30:47<23:01:04,  3.19it/s]
 29%|██▉       | 107053/371472 [8:30:47<22:50:30,  3.22it/s]
 29%|██▉       | 107054/371472 [8:30:48<22:42:59,  3.23it/s]
 29%|██▉       | 107055/371472 [8:30:48<22:18:35,  3.29it/s]
 29%|██▉       | 107056/371472 [8:30:48<23:36:38,  3.11it/s]
 29%|██▉       | 107057/371472 [8:30:49<23:03:32,  3.19it/s]
 29%|██▉       | 107058/371472 [8:30:49<22:16:59,  3.30it/s]
 29%|██▉       | 107059/371472 [8:30:49<21:57:06,  3.35it/s]
 29%|██▉       | 107060/371472 [8:30:50<22:51:59,  3.21it/s]
                                                            
{'loss': 3.4239, 'learning_rate': 7.409608050162684e-07, 'epoch': 4.61}

 29%|██▉       | 107060/371472 [8:30:50<22:51:59,  3.21it/s]
 29%|██▉       | 107061/371472 [8:30:50<22:04:36,  3.33it/s]
 29%|██▉       | 107062/371472 [8:30:50<21:45:37,  3.38it/s]
 29%|██▉       | 107063/371472 [8:30:50<21:23:04,  3.43it/s]
 29%|██▉       | 107064/371472 [8:30:51<21:26:29,  3.43it/s]
 29%|██▉       | 107065/371472 [8:30:51<21:51:20,  3.36it/s]
 29%|██▉       | 107066/371472 [8:30:51<21:05:57,  3.48it/s]
 29%|██▉       | 107067/371472 [8:30:52<21:29:48,  3.42it/s]
 29%|██▉       | 107068/371472 [8:30:52<20:51:04,  3.52it/s]
 29%|██▉       | 107069/371472 [8:30:52<20:26:50,  3.59it/s]
 29%|██▉       | 107070/371472 [8:30:52<20:22:30,  3.60it/s]
 29%|██▉       | 107071/371472 [8:30:53<20:14:19,  3.63it/s]
 29%|██▉       | 107072/371472 [8:30:53<20:41:16,  3.55it/s]
 29%|██▉       | 107073/371472 [8:30:53<20:46:28,  3.54it/s]
 29%|██▉       | 107074/371472 [8:30:54<21:25:43,  3.43it/s]
 29%|██▉       | 107075/371472 [8:30:54<21:08:23,  3.47it/s]
 29%|██▉       | 107076/371472 [8:30:54<22:27:57,  3.27it/s]
 29%|██▉       | 107077/371472 [8:30:55<23:41:59,  3.10it/s]
 29%|██▉       | 107078/371472 [8:30:55<22:01:47,  3.33it/s]
 29%|██▉       | 107079/371472 [8:30:55<22:25:21,  3.28it/s]
 29%|██▉       | 107080/371472 [8:30:55<21:17:30,  3.45it/s]
                                                            
{'loss': 3.4943, 'learning_rate': 7.409123230407895e-07, 'epoch': 4.61}

 29%|██▉       | 107080/371472 [8:30:55<21:17:30,  3.45it/s]
 29%|██▉       | 107081/371472 [8:30:56<21:12:02,  3.46it/s]
 29%|██▉       | 107082/371472 [8:30:56<20:40:44,  3.55it/s]
 29%|██▉       | 107083/371472 [8:30:56<20:03:43,  3.66it/s]
 29%|██▉       | 107084/371472 [8:30:57<21:00:03,  3.50it/s]
 29%|██▉       | 107085/371472 [8:30:57<21:05:22,  3.48it/s]
 29%|██▉       | 107086/371472 [8:30:57<21:15:55,  3.45it/s]
 29%|██▉       | 107087/371472 [8:30:57<21:09:16,  3.47it/s]
 29%|██▉       | 107088/371472 [8:30:58<19:59:58,  3.67it/s]
 29%|██▉       | 107089/371472 [8:30:58<19:50:48,  3.70it/s]
 29%|██▉       | 107090/371472 [8:30:58<22:44:09,  3.23it/s]
 29%|██▉       | 107091/371472 [8:30:59<21:23:43,  3.43it/s]
 29%|██▉       | 107092/371472 [8:30:59<20:36:57,  3.56it/s]
 29%|██▉       | 107093/371472 [8:30:59<21:14:59,  3.46it/s]
 29%|██▉       | 107094/371472 [8:30:59<22:10:58,  3.31it/s]
 29%|██▉       | 107095/371472 [8:31:00<21:10:26,  3.47it/s]
 29%|██▉       | 107096/371472 [8:31:00<21:15:43,  3.45it/s]
 29%|██▉       | 107097/371472 [8:31:00<20:40:22,  3.55it/s]
 29%|██▉       | 107098/371472 [8:31:01<20:34:34,  3.57it/s]
 29%|██▉       | 107099/371472 [8:31:01<20:50:33,  3.52it/s]
 29%|██▉       | 107100/371472 [8:31:01<20:05:41,  3.65it/s]
                                                            
{'loss': 3.5271, 'learning_rate': 7.408638410653106e-07, 'epoch': 4.61}

 29%|██▉       | 107100/371472 [8:31:01<20:05:41,  3.65it/s]
 29%|██▉       | 107101/371472 [8:31:01<19:43:49,  3.72it/s]
 29%|██▉       | 107102/371472 [8:31:02<19:39:09,  3.74it/s]
 29%|██▉       | 107103/371472 [8:31:02<19:25:53,  3.78it/s]
 29%|██▉       | 107104/371472 [8:31:02<22:08:46,  3.32it/s]
 29%|██▉       | 107105/371472 [8:31:03<22:34:23,  3.25it/s]
 29%|██▉       | 107106/371472 [8:31:03<22:15:04,  3.30it/s]
 29%|██▉       | 107107/371472 [8:31:03<23:02:45,  3.19it/s]
 29%|██▉       | 107108/371472 [8:31:03<22:06:06,  3.32it/s]
 29%|██▉       | 107109/371472 [8:31:04<21:03:00,  3.49it/s]
 29%|██▉       | 107110/371472 [8:31:04<22:22:34,  3.28it/s]
 29%|██▉       | 107111/371472 [8:31:04<21:47:46,  3.37it/s]
 29%|██▉       | 107112/371472 [8:31:05<21:19:15,  3.44it/s]
 29%|██▉       | 107113/371472 [8:31:05<20:45:25,  3.54it/s]
 29%|██▉       | 107114/371472 [8:31:05<20:55:08,  3.51it/s]
 29%|██▉       | 107115/371472 [8:31:05<20:27:24,  3.59it/s]
 29%|██▉       | 107116/371472 [8:31:06<20:49:00,  3.53it/s]
 29%|██▉       | 107117/371472 [8:31:06<20:35:30,  3.57it/s]
 29%|██▉       | 107118/371472 [8:31:06<20:13:00,  3.63it/s]
 29%|██▉       | 107119/371472 [8:31:07<24:27:46,  3.00it/s]
 29%|██▉       | 107120/371472 [8:31:07<22:59:09,  3.19it/s]
                                                            
{'loss': 3.3703, 'learning_rate': 7.408153590898317e-07, 'epoch': 4.61}

 29%|██▉       | 107120/371472 [8:31:07<22:59:09,  3.19it/s]
 29%|██▉       | 107121/371472 [8:31:07<23:14:05,  3.16it/s]
 29%|██▉       | 107122/371472 [8:31:08<22:47:14,  3.22it/s]
 29%|██▉       | 107123/371472 [8:31:08<23:27:14,  3.13it/s]
 29%|██▉       | 107124/371472 [8:31:08<22:38:22,  3.24it/s]
 29%|██▉       | 107125/371472 [8:31:09<22:12:07,  3.31it/s]
 29%|██▉       | 107126/371472 [8:31:09<21:58:41,  3.34it/s]
 29%|██▉       | 107127/371472 [8:31:09<21:03:46,  3.49it/s]
 29%|██▉       | 107128/371472 [8:31:09<22:10:26,  3.31it/s]
 29%|██▉       | 107129/371472 [8:31:10<21:01:43,  3.49it/s]
 29%|██▉       | 107130/371472 [8:31:10<20:58:27,  3.50it/s]
 29%|██▉       | 107131/371472 [8:31:10<20:36:44,  3.56it/s]
 29%|██▉       | 107132/371472 [8:31:11<20:45:17,  3.54it/s]
 29%|██▉       | 107133/371472 [8:31:11<19:46:34,  3.71it/s]
 29%|██▉       | 107134/371472 [8:31:11<20:14:31,  3.63it/s]
 29%|██▉       | 107135/371472 [8:31:11<20:41:12,  3.55it/s]
 29%|██▉       | 107136/371472 [8:31:12<20:16:47,  3.62it/s]
 29%|██▉       | 107137/371472 [8:31:12<19:48:57,  3.71it/s]
 29%|██▉       | 107138/371472 [8:31:12<19:48:24,  3.71it/s]
 29%|██▉       | 107139/371472 [8:31:12<20:20:42,  3.61it/s]
 29%|██▉       | 107140/371472 [8:31:13<20:02:43,  3.66it/s]
                                                            
{'loss': 3.4195, 'learning_rate': 7.407668771143527e-07, 'epoch': 4.61}

 29%|██▉       | 107140/371472 [8:31:13<20:02:43,  3.66it/s]
 29%|██▉       | 107141/371472 [8:31:13<19:47:09,  3.71it/s]
 29%|██▉       | 107142/371472 [8:31:13<19:55:54,  3.68it/s]
 29%|██▉       | 107143/371472 [8:31:14<20:11:22,  3.64it/s]
 29%|██▉       | 107144/371472 [8:31:14<19:56:31,  3.68it/s]
 29%|██▉       | 107145/371472 [8:31:14<19:31:25,  3.76it/s]
 29%|██▉       | 107146/371472 [8:31:14<21:19:20,  3.44it/s]
 29%|██▉       | 107147/371472 [8:31:15<20:57:53,  3.50it/s]
 29%|██▉       | 107148/371472 [8:31:15<20:02:44,  3.66it/s]
 29%|██▉       | 107149/371472 [8:31:15<20:21:44,  3.61it/s]
 29%|██▉       | 107150/371472 [8:31:15<19:53:04,  3.69it/s]
 29%|██▉       | 107151/371472 [8:31:16<22:25:37,  3.27it/s]
 29%|██▉       | 107152/371472 [8:31:16<21:33:10,  3.41it/s]
 29%|██▉       | 107153/371472 [8:31:16<20:41:17,  3.55it/s]
 29%|██▉       | 107154/371472 [8:31:17<20:12:44,  3.63it/s]
 29%|██▉       | 107155/371472 [8:31:17<20:49:03,  3.53it/s]
 29%|██▉       | 107156/371472 [8:31:17<21:40:07,  3.39it/s]
 29%|██▉       | 107157/371472 [8:31:18<23:38:12,  3.11it/s]
 29%|██▉       | 107158/371472 [8:31:18<22:33:01,  3.26it/s]
 29%|██▉       | 107159/371472 [8:31:18<22:12:02,  3.31it/s]
 29%|██▉       | 107160/371472 [8:31:18<21:28:40,  3.42it/s]
                                                            
{'loss': 3.5447, 'learning_rate': 7.407183951388738e-07, 'epoch': 4.62}

 29%|██▉       | 107160/371472 [8:31:18<21:28:40,  3.42it/s]
 29%|██▉       | 107161/371472 [8:31:19<21:06:10,  3.48it/s]
 29%|██▉       | 107162/371472 [8:31:19<20:11:19,  3.64it/s]
 29%|██▉       | 107163/371472 [8:31:19<19:48:44,  3.71it/s]
 29%|██▉       | 107164/371472 [8:31:20<21:14:25,  3.46it/s]
 29%|██▉       | 107165/371472 [8:31:20<21:25:00,  3.43it/s]
 29%|██▉       | 107166/371472 [8:31:20<20:48:49,  3.53it/s]
 29%|██▉       | 107167/371472 [8:31:20<20:45:43,  3.54it/s]
 29%|██▉       | 107168/371472 [8:31:21<20:07:05,  3.65it/s]
 29%|██▉       | 107169/371472 [8:31:21<19:47:22,  3.71it/s]
 29%|██▉       | 107170/371472 [8:31:21<19:09:57,  3.83it/s]
 29%|██▉       | 107171/371472 [8:31:21<19:44:04,  3.72it/s]
 29%|██▉       | 107172/371472 [8:31:22<19:53:02,  3.69it/s]
 29%|██▉       | 107173/371472 [8:31:22<19:41:07,  3.73it/s]
 29%|██▉       | 107174/371472 [8:31:22<19:46:44,  3.71it/s]
 29%|██▉       | 107175/371472 [8:31:23<21:54:25,  3.35it/s]
 29%|██▉       | 107176/371472 [8:31:23<21:34:45,  3.40it/s]
 29%|██▉       | 107177/371472 [8:31:23<21:05:04,  3.48it/s]
 29%|██▉       | 107178/371472 [8:31:23<20:37:41,  3.56it/s]
 29%|██▉       | 107179/371472 [8:31:24<21:42:54,  3.38it/s]
 29%|██▉       | 107180/371472 [8:31:24<20:41:10,  3.55it/s]
                                                            
{'loss': 3.468, 'learning_rate': 7.40669913163395e-07, 'epoch': 4.62}

 29%|██▉       | 107180/371472 [8:31:24<20:41:10,  3.55it/s]
 29%|██▉       | 107181/371472 [8:31:24<19:47:46,  3.71it/s]
 29%|██▉       | 107182/371472 [8:31:25<19:28:36,  3.77it/s]
 29%|██▉       | 107183/371472 [8:31:25<21:47:55,  3.37it/s]
 29%|██▉       | 107184/371472 [8:31:25<21:01:16,  3.49it/s]
 29%|██▉       | 107185/371472 [8:31:25<21:07:54,  3.47it/s]
 29%|██▉       | 107186/371472 [8:31:26<20:28:57,  3.58it/s]
 29%|██▉       | 107187/371472 [8:31:26<21:32:10,  3.41it/s]
 29%|██▉       | 107188/371472 [8:31:26<22:28:55,  3.27it/s]
 29%|██▉       | 107189/371472 [8:31:27<21:25:59,  3.43it/s]
 29%|██▉       | 107190/371472 [8:31:27<23:16:52,  3.15it/s]
 29%|██▉       | 107191/371472 [8:31:27<21:54:23,  3.35it/s]
 29%|██▉       | 107192/371472 [8:31:28<21:40:57,  3.39it/s]
 29%|██▉       | 107193/371472 [8:31:28<20:54:56,  3.51it/s]
 29%|██▉       | 107194/371472 [8:31:28<21:06:03,  3.48it/s]
 29%|██▉       | 107195/371472 [8:31:28<21:28:49,  3.42it/s]
 29%|██▉       | 107196/371472 [8:31:29<21:04:52,  3.48it/s]
 29%|██▉       | 107197/371472 [8:31:29<22:11:16,  3.31it/s]
 29%|██▉       | 107198/371472 [8:31:29<21:51:53,  3.36it/s]
 29%|██▉       | 107199/371472 [8:31:30<22:49:17,  3.22it/s]
 29%|██▉       | 107200/371472 [8:31:30<21:13:13,  3.46it/s]
                                                            
{'loss': 3.6039, 'learning_rate': 7.406214311879161e-07, 'epoch': 4.62}

 29%|██▉       | 107200/371472 [8:31:30<21:13:13,  3.46it/s]
 29%|██▉       | 107201/371472 [8:31:30<20:46:36,  3.53it/s]
 29%|██▉       | 107202/371472 [8:31:30<19:48:16,  3.71it/s]
 29%|██▉       | 107203/371472 [8:31:31<21:10:10,  3.47it/s]
 29%|██▉       | 107204/371472 [8:31:31<20:22:30,  3.60it/s]
 29%|██▉       | 107205/371472 [8:31:31<19:39:14,  3.73it/s]
 29%|██▉       | 107206/371472 [8:31:32<19:59:40,  3.67it/s]
 29%|██▉       | 107207/371472 [8:31:32<19:43:52,  3.72it/s]
 29%|██▉       | 107208/371472 [8:31:32<19:30:21,  3.76it/s]
 29%|██▉       | 107209/371472 [8:31:32<19:09:40,  3.83it/s]
 29%|██▉       | 107210/371472 [8:31:33<19:09:42,  3.83it/s]
 29%|██▉       | 107211/371472 [8:31:33<19:14:54,  3.81it/s]
 29%|██▉       | 107212/371472 [8:31:33<19:51:44,  3.70it/s]
 29%|██▉       | 107213/371472 [8:31:33<20:36:06,  3.56it/s]
 29%|██▉       | 107214/371472 [8:31:34<20:13:19,  3.63it/s]
 29%|██▉       | 107215/371472 [8:31:34<19:55:16,  3.68it/s]
 29%|██▉       | 107216/371472 [8:31:34<19:59:45,  3.67it/s]
 29%|██▉       | 107217/371472 [8:31:35<20:36:20,  3.56it/s]
 29%|██▉       | 107218/371472 [8:31:35<20:09:50,  3.64it/s]
 29%|██▉       | 107219/371472 [8:31:35<20:01:07,  3.67it/s]
 29%|██▉       | 107220/371472 [8:31:35<20:18:13,  3.62it/s]
                                                            
{'loss': 3.4525, 'learning_rate': 7.405729492124372e-07, 'epoch': 4.62}

 29%|██▉       | 107220/371472 [8:31:35<20:18:13,  3.62it/s]
 29%|██▉       | 107221/371472 [8:31:36<20:41:53,  3.55it/s]
 29%|██▉       | 107222/371472 [8:31:36<22:39:35,  3.24it/s]
 29%|██▉       | 107223/371472 [8:31:36<21:47:45,  3.37it/s]
 29%|██▉       | 107224/371472 [8:31:37<20:47:59,  3.53it/s]
 29%|██▉       | 107225/371472 [8:31:37<20:51:41,  3.52it/s]
 29%|██▉       | 107226/371472 [8:31:37<20:32:15,  3.57it/s]
 29%|██▉       | 107227/371472 [8:31:37<19:40:38,  3.73it/s]
 29%|██▉       | 107228/371472 [8:31:38<20:19:23,  3.61it/s]
 29%|██▉       | 107229/371472 [8:31:38<19:42:39,  3.72it/s]
 29%|██▉       | 107230/371472 [8:31:38<19:08:18,  3.84it/s]
 29%|██▉       | 107231/371472 [8:31:38<21:30:54,  3.41it/s]
 29%|██▉       | 107232/371472 [8:31:39<20:17:38,  3.62it/s]
 29%|██▉       | 107233/371472 [8:31:39<20:11:33,  3.63it/s]
 29%|██▉       | 107234/371472 [8:31:39<20:33:53,  3.57it/s]
 29%|██▉       | 107235/371472 [8:31:40<19:55:21,  3.68it/s]
 29%|██▉       | 107236/371472 [8:31:40<20:14:43,  3.63it/s]
 29%|██▉       | 107237/371472 [8:31:40<19:22:35,  3.79it/s]
 29%|██▉       | 107238/371472 [8:31:40<19:08:31,  3.83it/s]
 29%|██▉       | 107239/371472 [8:31:41<18:48:40,  3.90it/s]
 29%|██▉       | 107240/371472 [8:31:41<19:59:12,  3.67it/s]
                                                            
{'loss': 3.4267, 'learning_rate': 7.405244672369583e-07, 'epoch': 4.62}

 29%|██▉       | 107240/371472 [8:31:41<19:59:12,  3.67it/s]
 29%|██▉       | 107241/371472 [8:31:41<19:55:25,  3.68it/s]
 29%|██▉       | 107242/371472 [8:31:41<20:08:53,  3.64it/s]
 29%|██▉       | 107243/371472 [8:31:42<20:25:59,  3.59it/s]
 29%|██▉       | 107244/371472 [8:31:42<21:15:15,  3.45it/s]
 29%|██▉       | 107245/371472 [8:31:42<20:12:26,  3.63it/s]
 29%|██▉       | 107246/371472 [8:31:42<19:32:42,  3.76it/s]
 29%|██▉       | 107247/371472 [8:31:43<19:32:38,  3.76it/s]
 29%|██▉       | 107248/371472 [8:31:43<19:02:30,  3.85it/s]
 29%|██▉       | 107249/371472 [8:31:43<19:41:18,  3.73it/s]
 29%|██▉       | 107250/371472 [8:31:44<20:28:32,  3.58it/s]
 29%|██▉       | 107251/371472 [8:31:44<19:46:53,  3.71it/s]
 29%|██▉       | 107252/371472 [8:31:44<20:27:57,  3.59it/s]
 29%|██▉       | 107253/371472 [8:31:44<19:34:14,  3.75it/s]
 29%|██▉       | 107254/371472 [8:31:45<21:46:13,  3.37it/s]
 29%|██▉       | 107255/371472 [8:31:45<21:28:59,  3.42it/s]
 29%|██▉       | 107256/371472 [8:31:45<20:54:08,  3.51it/s]
 29%|██▉       | 107257/371472 [8:31:46<20:07:51,  3.65it/s]
 29%|██▉       | 107258/371472 [8:31:46<21:46:16,  3.37it/s]
 29%|██▉       | 107259/371472 [8:31:46<21:43:29,  3.38it/s]
 29%|██▉       | 107260/371472 [8:31:47<22:24:45,  3.27it/s]
                                                            
{'loss': 3.5692, 'learning_rate': 7.404759852614795e-07, 'epoch': 4.62}

 29%|██▉       | 107260/371472 [8:31:47<22:24:45,  3.27it/s]
 29%|██▉       | 107261/371472 [8:31:47<21:23:40,  3.43it/s]
 29%|██▉       | 107262/371472 [8:31:47<20:44:59,  3.54it/s]
 29%|██▉       | 107263/371472 [8:31:47<20:27:11,  3.59it/s]
 29%|██▉       | 107264/371472 [8:31:48<20:16:13,  3.62it/s]
 29%|██▉       | 107265/371472 [8:31:48<19:18:16,  3.80it/s]
 29%|██▉       | 107266/371472 [8:31:48<18:51:54,  3.89it/s]
 29%|██▉       | 107267/371472 [8:31:48<19:00:31,  3.86it/s]
 29%|██▉       | 107268/371472 [8:31:49<18:51:59,  3.89it/s]
 29%|██▉       | 107269/371472 [8:31:49<19:00:58,  3.86it/s]
 29%|██▉       | 107270/371472 [8:31:49<19:35:08,  3.75it/s]
 29%|██▉       | 107271/371472 [8:31:49<19:36:44,  3.74it/s]
 29%|██▉       | 107272/371472 [8:31:50<19:14:53,  3.81it/s]
 29%|██▉       | 107273/371472 [8:31:50<19:45:06,  3.72it/s]
 29%|██▉       | 107274/371472 [8:31:50<19:49:48,  3.70it/s]
 29%|██▉       | 107275/371472 [8:31:50<20:18:15,  3.61it/s]
 29%|██▉       | 107276/371472 [8:31:51<19:54:48,  3.69it/s]
 29%|██▉       | 107277/371472 [8:31:51<20:56:36,  3.50it/s]
 29%|██▉       | 107278/371472 [8:31:51<20:18:57,  3.61it/s]
 29%|██▉       | 107279/371472 [8:31:52<20:32:45,  3.57it/s]
 29%|██▉       | 107280/371472 [8:31:52<20:49:23,  3.52it/s]
                                                            
{'loss': 3.4588, 'learning_rate': 7.404275032860005e-07, 'epoch': 4.62}

 29%|██▉       | 107280/371472 [8:31:52<20:49:23,  3.52it/s]
 29%|██▉       | 107281/371472 [8:31:52<20:11:46,  3.63it/s]
 29%|██▉       | 107282/371472 [8:31:52<19:22:41,  3.79it/s]
 29%|██▉       | 107283/371472 [8:31:53<20:03:35,  3.66it/s]
 29%|██▉       | 107284/371472 [8:31:53<20:15:15,  3.62it/s]
 29%|██▉       | 107285/371472 [8:31:53<21:02:02,  3.49it/s]
 29%|██▉       | 107286/371472 [8:31:54<20:32:36,  3.57it/s]
 29%|██▉       | 107287/371472 [8:31:54<19:37:46,  3.74it/s]
 29%|██▉       | 107288/371472 [8:31:54<20:33:02,  3.57it/s]
 29%|██▉       | 107289/371472 [8:31:54<20:04:21,  3.66it/s]
 29%|██▉       | 107290/371472 [8:31:55<20:39:17,  3.55it/s]
 29%|██▉       | 107291/371472 [8:31:55<20:54:51,  3.51it/s]
 29%|██▉       | 107292/371472 [8:31:55<20:58:05,  3.50it/s]
 29%|██▉       | 107293/371472 [8:31:55<20:21:58,  3.60it/s]
 29%|██▉       | 107294/371472 [8:31:56<21:44:33,  3.38it/s]
 29%|██▉       | 107295/371472 [8:31:56<20:41:42,  3.55it/s]
 29%|██▉       | 107296/371472 [8:31:56<20:36:46,  3.56it/s]
 29%|██▉       | 107297/371472 [8:31:57<20:37:13,  3.56it/s]
 29%|██▉       | 107298/371472 [8:31:57<22:44:42,  3.23it/s]
 29%|██▉       | 107299/371472 [8:31:57<22:35:26,  3.25it/s]
 29%|██▉       | 107300/371472 [8:31:58<22:01:10,  3.33it/s]
                                                            
{'loss': 3.4214, 'learning_rate': 7.403790213105217e-07, 'epoch': 4.62}

 29%|██▉       | 107300/371472 [8:31:58<22:01:10,  3.33it/s]
 29%|██▉       | 107301/371472 [8:31:58<20:57:46,  3.50it/s]
 29%|██▉       | 107302/371472 [8:31:58<20:56:52,  3.50it/s]
 29%|██▉       | 107303/371472 [8:31:58<21:36:09,  3.40it/s]
 29%|██▉       | 107304/371472 [8:31:59<21:34:50,  3.40it/s]
 29%|██▉       | 107305/371472 [8:31:59<20:54:09,  3.51it/s]
 29%|██▉       | 107306/371472 [8:31:59<20:59:03,  3.50it/s]
 29%|██▉       | 107307/371472 [8:32:00<23:21:29,  3.14it/s]
 29%|██▉       | 107308/371472 [8:32:00<22:18:12,  3.29it/s]
 29%|██▉       | 107309/371472 [8:32:00<21:18:45,  3.44it/s]
 29%|██▉       | 107310/371472 [8:32:01<23:03:06,  3.18it/s]
 29%|██▉       | 107311/371472 [8:32:01<21:47:11,  3.37it/s]
 29%|██▉       | 107312/371472 [8:32:01<21:43:11,  3.38it/s]
 29%|██▉       | 107313/371472 [8:32:01<21:02:27,  3.49it/s]
 29%|██▉       | 107314/371472 [8:32:02<21:01:59,  3.49it/s]
 29%|██▉       | 107315/371472 [8:32:02<20:55:33,  3.51it/s]
 29%|██▉       | 107316/371472 [8:32:02<20:28:19,  3.58it/s]
 29%|██▉       | 107317/371472 [8:32:03<21:17:56,  3.45it/s]
 29%|██▉       | 107318/371472 [8:32:03<21:40:00,  3.39it/s]
 29%|██▉       | 107319/371472 [8:32:03<21:38:37,  3.39it/s]
 29%|██▉       | 107320/371472 [8:32:03<21:11:06,  3.46it/s]
                                                            
{'loss': 3.273, 'learning_rate': 7.403305393350427e-07, 'epoch': 4.62}

 29%|██▉       | 107320/371472 [8:32:03<21:11:06,  3.46it/s]
 29%|██▉       | 107321/371472 [8:32:04<20:37:15,  3.56it/s]
 29%|██▉       | 107322/371472 [8:32:04<20:09:22,  3.64it/s]
 29%|██▉       | 107323/371472 [8:32:04<19:13:18,  3.82it/s]
 29%|██▉       | 107324/371472 [8:32:04<18:52:04,  3.89it/s]
 29%|██▉       | 107325/371472 [8:32:05<19:11:52,  3.82it/s]
 29%|██▉       | 107326/371472 [8:32:05<19:22:50,  3.79it/s]
 29%|██▉       | 107327/371472 [8:32:05<19:23:40,  3.78it/s]
 29%|██▉       | 107328/371472 [8:32:06<19:34:33,  3.75it/s]
 29%|██▉       | 107329/371472 [8:32:06<20:37:52,  3.56it/s]
 29%|██▉       | 107330/371472 [8:32:06<19:57:46,  3.68it/s]
 29%|██▉       | 107331/371472 [8:32:06<21:16:14,  3.45it/s]
 29%|██▉       | 107332/371472 [8:32:07<21:45:20,  3.37it/s]
 29%|██▉       | 107333/371472 [8:32:07<21:05:02,  3.48it/s]
 29%|██▉       | 107334/371472 [8:32:07<20:42:48,  3.54it/s]
 29%|██▉       | 107335/371472 [8:32:08<20:38:50,  3.55it/s]
 29%|██▉       | 107336/371472 [8:32:08<20:14:15,  3.63it/s]
 29%|██▉       | 107337/371472 [8:32:08<21:47:22,  3.37it/s]
 29%|██▉       | 107338/371472 [8:32:08<21:36:34,  3.40it/s]
 29%|██▉       | 107339/371472 [8:32:09<20:53:51,  3.51it/s]
 29%|██▉       | 107340/371472 [8:32:09<20:34:01,  3.57it/s]
                                                            
{'loss': 3.5492, 'learning_rate': 7.402820573595639e-07, 'epoch': 4.62}

 29%|██▉       | 107340/371472 [8:32:09<20:34:01,  3.57it/s]
 29%|██▉       | 107341/371472 [8:32:09<20:27:27,  3.59it/s]
 29%|██▉       | 107342/371472 [8:32:09<19:56:11,  3.68it/s]
 29%|██▉       | 107343/371472 [8:32:10<20:18:50,  3.61it/s]
 29%|██▉       | 107344/371472 [8:32:10<20:17:08,  3.62it/s]
 29%|██▉       | 107345/371472 [8:32:10<20:15:12,  3.62it/s]
 29%|██▉       | 107346/371472 [8:32:11<19:31:52,  3.76it/s]
 29%|██▉       | 107347/371472 [8:32:11<19:17:37,  3.80it/s]
 29%|██▉       | 107348/371472 [8:32:11<22:09:41,  3.31it/s]
 29%|██▉       | 107349/371472 [8:32:12<22:26:55,  3.27it/s]
 29%|██▉       | 107350/371472 [8:32:12<22:11:23,  3.31it/s]
 29%|██▉       | 107351/371472 [8:32:12<22:00:11,  3.33it/s]
 29%|██▉       | 107352/371472 [8:32:12<22:07:40,  3.32it/s]
 29%|██▉       | 107353/371472 [8:32:13<24:18:39,  3.02it/s]
 29%|██▉       | 107354/371472 [8:32:13<22:55:59,  3.20it/s]
 29%|██▉       | 107355/371472 [8:32:13<22:34:07,  3.25it/s]
 29%|██▉       | 107356/371472 [8:32:14<21:38:04,  3.39it/s]
 29%|██▉       | 107357/371472 [8:32:14<20:22:56,  3.60it/s]
 29%|██▉       | 107358/371472 [8:32:14<19:34:12,  3.75it/s]
 29%|██▉       | 107359/371472 [8:32:14<18:52:45,  3.89it/s]
 29%|██▉       | 107360/371472 [8:32:15<18:33:45,  3.95it/s]
                                                            
{'loss': 3.3676, 'learning_rate': 7.40233575384085e-07, 'epoch': 4.62}

 29%|██▉       | 107360/371472 [8:32:15<18:33:45,  3.95it/s]
 29%|██▉       | 107361/371472 [8:32:15<19:15:29,  3.81it/s]
 29%|██▉       | 107362/371472 [8:32:15<19:01:07,  3.86it/s]
 29%|██▉       | 107363/371472 [8:32:15<19:30:56,  3.76it/s]
 29%|██▉       | 107364/371472 [8:32:16<20:10:18,  3.64it/s]
 29%|██▉       | 107365/371472 [8:32:16<20:09:14,  3.64it/s]
 29%|██▉       | 107366/371472 [8:32:16<19:49:27,  3.70it/s]
 29%|██▉       | 107367/371472 [8:32:17<19:35:21,  3.75it/s]
 29%|██▉       | 107368/371472 [8:32:17<19:51:56,  3.69it/s]
 29%|██▉       | 107369/371472 [8:32:17<20:18:10,  3.61it/s]
 29%|██▉       | 107370/371472 [8:32:17<20:22:21,  3.60it/s]
 29%|██▉       | 107371/371472 [8:32:18<22:50:37,  3.21it/s]
 29%|██▉       | 107372/371472 [8:32:18<22:14:02,  3.30it/s]
 29%|██▉       | 107373/371472 [8:32:18<21:48:26,  3.36it/s]
 29%|██▉       | 107374/371472 [8:32:19<21:18:01,  3.44it/s]
 29%|██▉       | 107375/371472 [8:32:19<20:19:49,  3.61it/s]
 29%|██▉       | 107376/371472 [8:32:19<19:55:08,  3.68it/s]
 29%|██▉       | 107377/371472 [8:32:19<20:46:52,  3.53it/s]
 29%|██▉       | 107378/371472 [8:32:20<21:20:14,  3.44it/s]
 29%|██▉       | 107379/371472 [8:32:20<21:29:14,  3.41it/s]
 29%|██▉       | 107380/371472 [8:32:20<20:20:41,  3.61it/s]
                                                            
{'loss': 3.4707, 'learning_rate': 7.401850934086061e-07, 'epoch': 4.63}

 29%|██▉       | 107380/371472 [8:32:20<20:20:41,  3.61it/s]
 29%|██▉       | 107381/371472 [8:32:21<24:14:10,  3.03it/s]
 29%|██▉       | 107382/371472 [8:32:21<22:43:48,  3.23it/s]
 29%|██▉       | 107383/371472 [8:32:21<21:26:19,  3.42it/s]
 29%|██▉       | 107384/371472 [8:32:22<21:11:58,  3.46it/s]
 29%|██▉       | 107385/371472 [8:32:22<20:50:23,  3.52it/s]
 29%|██▉       | 107386/371472 [8:32:22<21:07:32,  3.47it/s]
 29%|██▉       | 107387/371472 [8:32:22<21:26:58,  3.42it/s]
 29%|██▉       | 107388/371472 [8:32:23<21:19:04,  3.44it/s]
 29%|██▉       | 107389/371472 [8:32:23<20:28:58,  3.58it/s]
 29%|██▉       | 107390/371472 [8:32:23<20:23:41,  3.60it/s]
 29%|██▉       | 107391/371472 [8:32:24<20:46:10,  3.53it/s]
 29%|██▉       | 107392/371472 [8:32:24<21:07:49,  3.47it/s]
 29%|██▉       | 107393/371472 [8:32:24<20:15:40,  3.62it/s]
 29%|██▉       | 107394/371472 [8:32:24<19:22:03,  3.79it/s]
 29%|██▉       | 107395/371472 [8:32:25<19:11:44,  3.82it/s]
 29%|██▉       | 107396/371472 [8:32:25<19:39:51,  3.73it/s]
 29%|██▉       | 107397/371472 [8:32:25<19:30:45,  3.76it/s]
 29%|██▉       | 107398/371472 [8:32:25<21:11:56,  3.46it/s]
 29%|██▉       | 107399/371472 [8:32:26<21:38:49,  3.39it/s]
 29%|██▉       | 107400/371472 [8:32:26<21:51:29,  3.36it/s]
                                                            
{'loss': 3.3834, 'learning_rate': 7.401366114331271e-07, 'epoch': 4.63}

 29%|██▉       | 107400/371472 [8:32:26<21:51:29,  3.36it/s]
 29%|██▉       | 107401/371472 [8:32:26<21:22:33,  3.43it/s]
 29%|██▉       | 107402/371472 [8:32:27<21:13:16,  3.46it/s]
 29%|██▉       | 107403/371472 [8:32:27<20:33:24,  3.57it/s]
 29%|██▉       | 107404/371472 [8:32:27<21:12:11,  3.46it/s]
 29%|██▉       | 107405/371472 [8:32:27<20:02:39,  3.66it/s]
 29%|██▉       | 107406/371472 [8:32:28<19:39:39,  3.73it/s]
 29%|██▉       | 107407/371472 [8:32:28<19:41:20,  3.73it/s]
 29%|██▉       | 107408/371472 [8:32:28<20:14:46,  3.62it/s]
 29%|██▉       | 107409/371472 [8:32:29<21:15:51,  3.45it/s]
 29%|██▉       | 107410/371472 [8:32:29<20:53:01,  3.51it/s]
 29%|██▉       | 107411/371472 [8:32:29<20:56:45,  3.50it/s]
 29%|██▉       | 107412/371472 [8:32:29<22:02:38,  3.33it/s]
 29%|██▉       | 107413/371472 [8:32:30<20:45:45,  3.53it/s]
 29%|██▉       | 107414/371472 [8:32:30<20:26:20,  3.59it/s]
 29%|██▉       | 107415/371472 [8:32:30<20:51:00,  3.52it/s]
 29%|██▉       | 107416/371472 [8:32:31<20:33:57,  3.57it/s]
 29%|██▉       | 107417/371472 [8:32:31<19:47:30,  3.71it/s]
 29%|██▉       | 107418/371472 [8:32:31<19:14:30,  3.81it/s]
 29%|██▉       | 107419/371472 [8:32:31<19:23:55,  3.78it/s]
 29%|██▉       | 107420/371472 [8:32:32<19:04:22,  3.85it/s]
                                                            
{'loss': 3.5304, 'learning_rate': 7.400881294576482e-07, 'epoch': 4.63}

 29%|██▉       | 107420/371472 [8:32:32<19:04:22,  3.85it/s]
 29%|██▉       | 107421/371472 [8:32:32<19:04:25,  3.85it/s]
 29%|██▉       | 107422/371472 [8:32:32<20:07:49,  3.64it/s]
 29%|██▉       | 107423/371472 [8:32:32<19:34:06,  3.75it/s]
 29%|██▉       | 107424/371472 [8:32:33<21:16:16,  3.45it/s]
 29%|██▉       | 107425/371472 [8:32:33<20:27:58,  3.58it/s]
 29%|██▉       | 107426/371472 [8:32:33<20:13:34,  3.63it/s]
 29%|██▉       | 107427/371472 [8:32:33<20:03:43,  3.66it/s]
 29%|██▉       | 107428/371472 [8:32:34<19:16:58,  3.80it/s]
 29%|██▉       | 107429/371472 [8:32:34<19:08:12,  3.83it/s]
 29%|██▉       | 107430/371472 [8:32:34<19:19:54,  3.79it/s]
 29%|██▉       | 107431/371472 [8:32:35<21:04:29,  3.48it/s]
 29%|██▉       | 107432/371472 [8:32:35<21:45:55,  3.37it/s]
 29%|██▉       | 107433/371472 [8:32:35<22:31:27,  3.26it/s]
 29%|██▉       | 107434/371472 [8:32:35<21:23:30,  3.43it/s]
 29%|██▉       | 107435/371472 [8:32:36<20:15:57,  3.62it/s]
 29%|██▉       | 107436/371472 [8:32:36<20:30:32,  3.58it/s]
 29%|██▉       | 107437/371472 [8:32:36<21:05:23,  3.48it/s]
 29%|██▉       | 107438/371472 [8:32:37<21:04:05,  3.48it/s]
 29%|██▉       | 107439/371472 [8:32:37<20:26:42,  3.59it/s]
 29%|██▉       | 107440/371472 [8:32:37<20:31:07,  3.57it/s]
                                                            
{'loss': 3.4311, 'learning_rate': 7.400396474821694e-07, 'epoch': 4.63}

 29%|██▉       | 107440/371472 [8:32:37<20:31:07,  3.57it/s]
 29%|██▉       | 107441/371472 [8:32:37<21:48:57,  3.36it/s]
 29%|██▉       | 107442/371472 [8:32:38<22:11:46,  3.30it/s]
 29%|██▉       | 107443/371472 [8:32:38<21:28:13,  3.42it/s]
 29%|██▉       | 107444/371472 [8:32:38<23:50:04,  3.08it/s]
 29%|██▉       | 107445/371472 [8:32:39<22:13:26,  3.30it/s]
 29%|██▉       | 107446/371472 [8:32:39<21:33:28,  3.40it/s]
 29%|██▉       | 107447/371472 [8:32:39<20:50:16,  3.52it/s]
 29%|██▉       | 107448/371472 [8:32:40<20:06:12,  3.65it/s]
 29%|██▉       | 107449/371472 [8:32:40<19:25:02,  3.78it/s]
 29%|██▉       | 107450/371472 [8:32:40<20:16:31,  3.62it/s]
 29%|██▉       | 107451/371472 [8:32:40<19:47:52,  3.70it/s]
 29%|██▉       | 107452/371472 [8:32:41<22:33:25,  3.25it/s]
 29%|██▉       | 107453/371472 [8:32:41<21:27:02,  3.42it/s]
 29%|██▉       | 107454/371472 [8:32:41<21:31:03,  3.41it/s]
 29%|██▉       | 107455/371472 [8:32:42<20:33:11,  3.57it/s]
 29%|██▉       | 107456/371472 [8:32:42<20:30:59,  3.57it/s]
 29%|██▉       | 107457/371472 [8:32:42<19:47:38,  3.71it/s]
 29%|██▉       | 107458/371472 [8:32:42<19:26:44,  3.77it/s]
 29%|██▉       | 107459/371472 [8:32:43<19:12:44,  3.82it/s]
 29%|██▉       | 107460/371472 [8:32:43<20:01:52,  3.66it/s]
                                                            
{'loss': 3.5663, 'learning_rate': 7.399911655066905e-07, 'epoch': 4.63}

 29%|██▉       | 107460/371472 [8:32:43<20:01:52,  3.66it/s]
 29%|██▉       | 107461/371472 [8:32:43<19:46:08,  3.71it/s]
 29%|██▉       | 107462/371472 [8:32:43<19:38:17,  3.73it/s]
 29%|██▉       | 107463/371472 [8:32:44<19:40:16,  3.73it/s]
 29%|██▉       | 107464/371472 [8:32:44<19:10:23,  3.82it/s]
 29%|██▉       | 107465/371472 [8:32:44<19:22:05,  3.79it/s]
 29%|██▉       | 107466/371472 [8:32:44<19:42:39,  3.72it/s]
 29%|██▉       | 107467/371472 [8:32:45<20:33:59,  3.57it/s]
 29%|██▉       | 107468/371472 [8:32:45<20:44:07,  3.54it/s]
 29%|██▉       | 107469/371472 [8:32:45<19:51:19,  3.69it/s]
 29%|██▉       | 107470/371472 [8:32:46<19:18:39,  3.80it/s]
 29%|██▉       | 107471/371472 [8:32:46<20:24:06,  3.59it/s]
 29%|██▉       | 107472/371472 [8:32:46<19:34:16,  3.75it/s]
 29%|██▉       | 107473/371472 [8:32:46<19:28:24,  3.77it/s]
 29%|██▉       | 107474/371472 [8:32:47<19:33:52,  3.75it/s]
 29%|██▉       | 107475/371472 [8:32:47<18:51:40,  3.89it/s]
 29%|██▉       | 107476/371472 [8:32:47<19:58:22,  3.67it/s]
 29%|██▉       | 107477/371472 [8:32:47<20:19:24,  3.61it/s]
 29%|██▉       | 107478/371472 [8:32:48<19:59:54,  3.67it/s]
 29%|██▉       | 107479/371472 [8:32:48<20:03:33,  3.66it/s]
 29%|██▉       | 107480/371472 [8:32:48<20:27:52,  3.58it/s]
                                                            
{'loss': 3.4356, 'learning_rate': 7.399426835312116e-07, 'epoch': 4.63}

 29%|██▉       | 107480/371472 [8:32:48<20:27:52,  3.58it/s]
 29%|██▉       | 107481/371472 [8:32:49<20:58:57,  3.49it/s]
 29%|██▉       | 107482/371472 [8:32:49<21:59:08,  3.34it/s]
 29%|██▉       | 107483/371472 [8:32:49<21:01:27,  3.49it/s]
 29%|██▉       | 107484/371472 [8:32:49<19:54:18,  3.68it/s]
 29%|██▉       | 107485/371472 [8:32:50<20:28:49,  3.58it/s]
 29%|██▉       | 107486/371472 [8:32:50<21:50:33,  3.36it/s]
 29%|██▉       | 107487/371472 [8:32:50<21:33:42,  3.40it/s]
 29%|██▉       | 107488/371472 [8:32:51<20:23:48,  3.60it/s]
 29%|██▉       | 107489/371472 [8:32:51<21:32:23,  3.40it/s]
 29%|██▉       | 107490/371472 [8:32:51<23:02:59,  3.18it/s]
 29%|██▉       | 107491/371472 [8:32:52<22:35:57,  3.24it/s]
 29%|██▉       | 107492/371472 [8:32:52<22:52:53,  3.20it/s]
 29%|██▉       | 107493/371472 [8:32:52<23:53:07,  3.07it/s]
 29%|██▉       | 107494/371472 [8:32:52<22:39:38,  3.24it/s]
 29%|██▉       | 107495/371472 [8:32:53<23:03:00,  3.18it/s]
 29%|██▉       | 107496/371472 [8:32:53<22:09:45,  3.31it/s]
 29%|██▉       | 107497/371472 [8:32:53<22:12:34,  3.30it/s]
 29%|██▉       | 107498/371472 [8:32:54<21:28:55,  3.41it/s]
 29%|██▉       | 107499/371472 [8:32:54<20:30:18,  3.58it/s]
 29%|██▉       | 107500/371472 [8:32:54<20:49:14,  3.52it/s]
                                                            
{'loss': 3.5589, 'learning_rate': 7.398942015557327e-07, 'epoch': 4.63}

 29%|██▉       | 107500/371472 [8:32:54<20:49:14,  3.52it/s]
 29%|██▉       | 107501/371472 [8:32:54<20:01:21,  3.66it/s]
 29%|██▉       | 107502/371472 [8:32:55<21:09:17,  3.47it/s]
 29%|██▉       | 107503/371472 [8:32:55<20:33:18,  3.57it/s]
 29%|██▉       | 107504/371472 [8:32:55<20:21:56,  3.60it/s]
 29%|██▉       | 107505/371472 [8:32:56<20:17:51,  3.61it/s]
 29%|██▉       | 107506/371472 [8:32:56<20:33:10,  3.57it/s]
 29%|██▉       | 107507/371472 [8:32:56<20:18:43,  3.61it/s]
 29%|██▉       | 107508/371472 [8:32:56<19:59:39,  3.67it/s]
 29%|██▉       | 107509/371472 [8:32:57<20:03:43,  3.65it/s]
 29%|██▉       | 107510/371472 [8:32:57<19:32:22,  3.75it/s]
 29%|██▉       | 107511/371472 [8:32:57<19:47:18,  3.71it/s]
 29%|██▉       | 107512/371472 [8:32:58<20:13:50,  3.62it/s]
 29%|██▉       | 107513/371472 [8:32:58<20:27:13,  3.58it/s]
 29%|██▉       | 107514/371472 [8:32:58<21:52:26,  3.35it/s]
 29%|██▉       | 107515/371472 [8:32:58<21:35:40,  3.40it/s]
 29%|██▉       | 107516/371472 [8:32:59<21:50:29,  3.36it/s]
 29%|██▉       | 107517/371472 [8:32:59<21:13:30,  3.45it/s]
 29%|██▉       | 107518/371472 [8:32:59<20:10:14,  3.63it/s]
 29%|██▉       | 107519/371472 [8:32:59<19:32:43,  3.75it/s]
 29%|██▉       | 107520/371472 [8:33:00<19:14:53,  3.81it/s]
                                                            
{'loss': 3.4957, 'learning_rate': 7.398457195802538e-07, 'epoch': 4.63}

 29%|██▉       | 107520/371472 [8:33:00<19:14:53,  3.81it/s]
 29%|██▉       | 107521/371472 [8:33:00<19:55:49,  3.68it/s]
 29%|██▉       | 107522/371472 [8:33:00<19:48:03,  3.70it/s]
 29%|██▉       | 107523/371472 [8:33:01<19:30:41,  3.76it/s]
 29%|██▉       | 107524/371472 [8:33:01<19:58:03,  3.67it/s]
 29%|██▉       | 107525/371472 [8:33:01<19:34:42,  3.74it/s]
 29%|██▉       | 107526/371472 [8:33:01<19:16:17,  3.80it/s]
 29%|██▉       | 107527/371472 [8:33:02<19:07:43,  3.83it/s]
 29%|██▉       | 107528/371472 [8:33:02<18:43:43,  3.91it/s]
 29%|██▉       | 107529/371472 [8:33:02<19:19:13,  3.79it/s]
 29%|██▉       | 107530/371472 [8:33:02<21:22:45,  3.43it/s]
 29%|██▉       | 107531/371472 [8:33:03<21:37:12,  3.39it/s]
 29%|██▉       | 107532/371472 [8:33:03<21:55:52,  3.34it/s]
 29%|██▉       | 107533/371472 [8:33:03<21:19:13,  3.44it/s]
 29%|██▉       | 107534/371472 [8:33:04<21:19:57,  3.44it/s]
 29%|██▉       | 107535/371472 [8:33:04<21:07:38,  3.47it/s]
 29%|██▉       | 107536/371472 [8:33:04<21:15:12,  3.45it/s]
 29%|██▉       | 107537/371472 [8:33:05<22:45:41,  3.22it/s]
 29%|██▉       | 107538/371472 [8:33:05<22:17:54,  3.29it/s]
 29%|██▉       | 107539/371472 [8:33:05<22:11:10,  3.30it/s]
 29%|██▉       | 107540/371472 [8:33:05<21:31:20,  3.41it/s]
                                                            
{'loss': 3.3148, 'learning_rate': 7.397972376047749e-07, 'epoch': 4.63}

 29%|██▉       | 107540/371472 [8:33:05<21:31:20,  3.41it/s]
 29%|██▉       | 107541/371472 [8:33:06<21:31:59,  3.40it/s]
 29%|██▉       | 107542/371472 [8:33:06<21:19:25,  3.44it/s]
 29%|██▉       | 107543/371472 [8:33:06<21:50:37,  3.36it/s]
 29%|██▉       | 107544/371472 [8:33:07<20:31:31,  3.57it/s]
 29%|██▉       | 107545/371472 [8:33:07<20:55:19,  3.50it/s]
 29%|██▉       | 107546/371472 [8:33:07<20:36:22,  3.56it/s]
 29%|██▉       | 107547/371472 [8:33:07<20:46:52,  3.53it/s]
 29%|██▉       | 107548/371472 [8:33:08<20:35:04,  3.56it/s]
 29%|██▉       | 107549/371472 [8:33:08<22:53:49,  3.20it/s]
 29%|██▉       | 107550/371472 [8:33:08<22:49:26,  3.21it/s]
 29%|██▉       | 107551/371472 [8:33:09<22:45:23,  3.22it/s]
 29%|██▉       | 107552/371472 [8:33:09<23:44:42,  3.09it/s]
 29%|██▉       | 107553/371472 [8:33:09<22:51:48,  3.21it/s]
 29%|██▉       | 107554/371472 [8:33:10<22:45:40,  3.22it/s]
 29%|██▉       | 107555/371472 [8:33:10<22:35:17,  3.25it/s]
 29%|██▉       | 107556/371472 [8:33:10<21:28:11,  3.41it/s]
 29%|██▉       | 107557/371472 [8:33:10<20:13:28,  3.62it/s]
 29%|██▉       | 107558/371472 [8:33:11<19:58:04,  3.67it/s]
 29%|██▉       | 107559/371472 [8:33:11<21:30:58,  3.41it/s]
 29%|██▉       | 107560/371472 [8:33:11<21:19:13,  3.44it/s]
                                                            
{'loss': 3.3393, 'learning_rate': 7.39748755629296e-07, 'epoch': 4.63}

 29%|██▉       | 107560/371472 [8:33:11<21:19:13,  3.44it/s]
 29%|██▉       | 107561/371472 [8:33:12<20:28:30,  3.58it/s]
 29%|██▉       | 107562/371472 [8:33:12<20:28:57,  3.58it/s]
 29%|██▉       | 107563/371472 [8:33:12<20:18:55,  3.61it/s]
 29%|██▉       | 107564/371472 [8:33:12<20:47:25,  3.53it/s]
 29%|██▉       | 107565/371472 [8:33:13<19:52:06,  3.69it/s]
 29%|██▉       | 107566/371472 [8:33:13<19:39:16,  3.73it/s]
 29%|██▉       | 107567/371472 [8:33:13<20:18:06,  3.61it/s]
 29%|██▉       | 107568/371472 [8:33:14<20:43:22,  3.54it/s]
 29%|██▉       | 107569/371472 [8:33:14<22:18:51,  3.29it/s]
 29%|██▉       | 107570/371472 [8:33:14<22:35:07,  3.25it/s]
 29%|██▉       | 107571/371472 [8:33:14<21:38:23,  3.39it/s]
 29%|██▉       | 107572/371472 [8:33:15<20:49:28,  3.52it/s]
 29%|██▉       | 107573/371472 [8:33:15<20:09:48,  3.64it/s]
 29%|██▉       | 107574/371472 [8:33:15<20:02:00,  3.66it/s]
 29%|██▉       | 107575/371472 [8:33:16<20:43:32,  3.54it/s]
 29%|██▉       | 107576/371472 [8:33:16<20:57:37,  3.50it/s]
 29%|██▉       | 107577/371472 [8:33:16<20:29:30,  3.58it/s]
 29%|██▉       | 107578/371472 [8:33:16<21:08:39,  3.47it/s]
 29%|██▉       | 107579/371472 [8:33:17<21:45:34,  3.37it/s]
 29%|██▉       | 107580/371472 [8:33:17<20:39:26,  3.55it/s]
                                                            
{'loss': 3.3857, 'learning_rate': 7.397002736538171e-07, 'epoch': 4.63}

 29%|██▉       | 107580/371472 [8:33:17<20:39:26,  3.55it/s]
 29%|██▉       | 107581/371472 [8:33:17<22:17:43,  3.29it/s]
 29%|██▉       | 107582/371472 [8:33:18<21:11:44,  3.46it/s]
 29%|██▉       | 107583/371472 [8:33:18<20:56:11,  3.50it/s]
 29%|██▉       | 107584/371472 [8:33:18<21:08:00,  3.47it/s]
 29%|██▉       | 107585/371472 [8:33:18<20:15:03,  3.62it/s]
 29%|██▉       | 107586/371472 [8:33:19<20:29:49,  3.58it/s]
 29%|██▉       | 107587/371472 [8:33:19<19:53:09,  3.69it/s]
 29%|██▉       | 107588/371472 [8:33:19<19:37:39,  3.73it/s]
 29%|██▉       | 107589/371472 [8:33:20<20:11:00,  3.63it/s]
 29%|██▉       | 107590/371472 [8:33:20<20:22:38,  3.60it/s]
 29%|██▉       | 107591/371472 [8:33:20<20:49:48,  3.52it/s]
 29%|██▉       | 107592/371472 [8:33:20<21:47:49,  3.36it/s]
 29%|██▉       | 107593/371472 [8:33:21<21:36:41,  3.39it/s]
 29%|██▉       | 107594/371472 [8:33:21<20:44:32,  3.53it/s]
 29%|██▉       | 107595/371472 [8:33:21<20:39:09,  3.55it/s]
 29%|██▉       | 107596/371472 [8:33:22<20:05:21,  3.65it/s]
 29%|██▉       | 107597/371472 [8:33:22<20:32:06,  3.57it/s]
 29%|██▉       | 107598/371472 [8:33:22<20:33:34,  3.57it/s]
 29%|██▉       | 107599/371472 [8:33:22<20:30:07,  3.58it/s]
 29%|██▉       | 107600/371472 [8:33:23<20:35:28,  3.56it/s]
                                                            
{'loss': 3.2937, 'learning_rate': 7.396517916783383e-07, 'epoch': 4.63}

 29%|██▉       | 107600/371472 [8:33:23<20:35:28,  3.56it/s]
 29%|██▉       | 107601/371472 [8:33:23<22:07:44,  3.31it/s]
 29%|██▉       | 107602/371472 [8:33:23<21:15:22,  3.45it/s]
 29%|██▉       | 107603/371472 [8:33:24<21:09:41,  3.46it/s]
 29%|██▉       | 107604/371472 [8:33:24<20:20:38,  3.60it/s]
 29%|██▉       | 107605/371472 [8:33:24<19:44:17,  3.71it/s]
 29%|██▉       | 107606/371472 [8:33:24<20:12:05,  3.63it/s]
 29%|██▉       | 107607/371472 [8:33:25<20:00:32,  3.66it/s]
 29%|██▉       | 107608/371472 [8:33:25<20:30:28,  3.57it/s]
 29%|██▉       | 107609/371472 [8:33:25<20:47:13,  3.53it/s]
 29%|██▉       | 107610/371472 [8:33:25<20:47:13,  3.53it/s]
 29%|██▉       | 107611/371472 [8:33:26<21:04:51,  3.48it/s]
 29%|██▉       | 107612/371472 [8:33:26<20:14:05,  3.62it/s]
 29%|██▉       | 107613/371472 [8:33:26<20:28:57,  3.58it/s]
 29%|██▉       | 107614/371472 [8:33:27<21:23:11,  3.43it/s]
 29%|██▉       | 107615/371472 [8:33:27<20:56:07,  3.50it/s]
 29%|██▉       | 107616/371472 [8:33:27<20:34:55,  3.56it/s]
 29%|██▉       | 107617/371472 [8:33:27<20:03:29,  3.65it/s]
 29%|██▉       | 107618/371472 [8:33:28<19:35:54,  3.74it/s]
 29%|██▉       | 107619/371472 [8:33:28<20:20:07,  3.60it/s]
 29%|██▉       | 107620/371472 [8:33:28<21:00:23,  3.49it/s]
                                                            
{'loss': 3.1365, 'learning_rate': 7.396033097028594e-07, 'epoch': 4.64}

 29%|██▉       | 107620/371472 [8:33:28<21:00:23,  3.49it/s]
 29%|██▉       | 107621/371472 [8:33:29<21:02:36,  3.48it/s]
 29%|██▉       | 107622/371472 [8:33:29<20:52:45,  3.51it/s]
 29%|██▉       | 107623/371472 [8:33:29<21:01:59,  3.48it/s]
 29%|██▉       | 107624/371472 [8:33:29<20:30:10,  3.57it/s]
 29%|██▉       | 107625/371472 [8:33:30<19:47:40,  3.70it/s]
 29%|██▉       | 107626/371472 [8:33:30<22:11:14,  3.30it/s]
 29%|██▉       | 107627/371472 [8:33:30<21:13:33,  3.45it/s]
 29%|██▉       | 107628/371472 [8:33:31<21:23:10,  3.43it/s]
 29%|██▉       | 107629/371472 [8:33:31<22:38:59,  3.24it/s]
 29%|██▉       | 107630/371472 [8:33:31<21:30:48,  3.41it/s]
 29%|██▉       | 107631/371472 [8:33:31<21:09:45,  3.46it/s]
 29%|██▉       | 107632/371472 [8:33:32<21:16:07,  3.45it/s]
 29%|██▉       | 107633/371472 [8:33:32<20:33:32,  3.56it/s]
 29%|██▉       | 107634/371472 [8:33:32<21:37:18,  3.39it/s]
 29%|██▉       | 107635/371472 [8:33:33<20:39:32,  3.55it/s]
 29%|██▉       | 107636/371472 [8:33:33<20:17:20,  3.61it/s]
 29%|██▉       | 107637/371472 [8:33:33<21:16:26,  3.44it/s]
 29%|██▉       | 107638/371472 [8:33:34<21:48:24,  3.36it/s]
 29%|██▉       | 107639/371472 [8:33:34<20:44:28,  3.53it/s]
 29%|██▉       | 107640/371472 [8:33:34<20:52:07,  3.51it/s]
                                                            
{'loss': 3.2864, 'learning_rate': 7.395548277273805e-07, 'epoch': 4.64}

 29%|██▉       | 107640/371472 [8:33:34<20:52:07,  3.51it/s]
 29%|██▉       | 107641/371472 [8:33:34<21:59:22,  3.33it/s]
 29%|██▉       | 107642/371472 [8:33:35<21:57:09,  3.34it/s]
 29%|██▉       | 107643/371472 [8:33:35<21:15:24,  3.45it/s]
 29%|██▉       | 107644/371472 [8:33:35<20:01:17,  3.66it/s]
 29%|██▉       | 107645/371472 [8:33:36<22:05:23,  3.32it/s]
 29%|██▉       | 107646/371472 [8:33:36<21:17:27,  3.44it/s]
 29%|██▉       | 107647/371472 [8:33:36<21:18:42,  3.44it/s]
 29%|██▉       | 107648/371472 [8:33:36<20:58:30,  3.49it/s]
 29%|██▉       | 107649/371472 [8:33:37<22:16:09,  3.29it/s]
 29%|██▉       | 107650/371472 [8:33:37<21:38:32,  3.39it/s]
 29%|██▉       | 107651/371472 [8:33:37<20:51:05,  3.51it/s]
 29%|██▉       | 107652/371472 [8:33:38<20:40:14,  3.55it/s]
 29%|██▉       | 107653/371472 [8:33:38<20:50:04,  3.52it/s]
 29%|██▉       | 107654/371472 [8:33:38<20:07:47,  3.64it/s]
 29%|██▉       | 107655/371472 [8:33:38<20:38:07,  3.55it/s]
 29%|██▉       | 107656/371472 [8:33:39<20:28:21,  3.58it/s]
 29%|██▉       | 107657/371472 [8:33:39<20:42:09,  3.54it/s]
 29%|██▉       | 107658/371472 [8:33:39<21:08:52,  3.47it/s]
 29%|██▉       | 107659/371472 [8:33:40<20:40:33,  3.54it/s]
 29%|██▉       | 107660/371472 [8:33:40<20:54:48,  3.50it/s]
                                                            
{'loss': 3.4913, 'learning_rate': 7.395063457519015e-07, 'epoch': 4.64}

 29%|██▉       | 107660/371472 [8:33:40<20:54:48,  3.50it/s]
 29%|██▉       | 107661/371472 [8:33:40<20:26:11,  3.59it/s]
 29%|██▉       | 107662/371472 [8:33:40<20:34:43,  3.56it/s]
 29%|██▉       | 107663/371472 [8:33:41<20:35:27,  3.56it/s]
 29%|██▉       | 107664/371472 [8:33:41<20:21:58,  3.60it/s]
 29%|██▉       | 107665/371472 [8:33:41<20:53:28,  3.51it/s]
 29%|██▉       | 107666/371472 [8:33:42<20:56:11,  3.50it/s]
 29%|██▉       | 107667/371472 [8:33:42<20:45:05,  3.53it/s]
 29%|██▉       | 107668/371472 [8:33:42<21:51:40,  3.35it/s]
 29%|██▉       | 107669/371472 [8:33:42<20:57:31,  3.50it/s]
 29%|██▉       | 107670/371472 [8:33:43<22:19:46,  3.28it/s]
 29%|██▉       | 107671/371472 [8:33:43<23:42:03,  3.09it/s]
 29%|██▉       | 107672/371472 [8:33:43<22:08:26,  3.31it/s]
 29%|██▉       | 107673/371472 [8:33:44<21:10:20,  3.46it/s]
 29%|██▉       | 107674/371472 [8:33:44<20:12:06,  3.63it/s]
 29%|██▉       | 107675/371472 [8:33:44<20:15:41,  3.62it/s]
 29%|██▉       | 107676/371472 [8:33:45<22:59:01,  3.19it/s]
 29%|██▉       | 107677/371472 [8:33:45<22:24:52,  3.27it/s]
 29%|██▉       | 107678/371472 [8:33:45<21:15:12,  3.45it/s]
 29%|██▉       | 107679/371472 [8:33:45<21:04:51,  3.48it/s]
 29%|██▉       | 107680/371472 [8:33:46<20:23:31,  3.59it/s]
                                                            
{'loss': 3.3579, 'learning_rate': 7.394578637764226e-07, 'epoch': 4.64}

 29%|██▉       | 107680/371472 [8:33:46<20:23:31,  3.59it/s]
 29%|██▉       | 107681/371472 [8:33:46<21:43:21,  3.37it/s]
 29%|██▉       | 107682/371472 [8:33:46<21:08:16,  3.47it/s]
 29%|██▉       | 107683/371472 [8:33:46<20:16:16,  3.61it/s]
 29%|██▉       | 107684/371472 [8:33:47<21:35:34,  3.39it/s]
 29%|██▉       | 107685/371472 [8:33:47<20:33:20,  3.56it/s]
 29%|██▉       | 107686/371472 [8:33:47<20:12:00,  3.63it/s]
 29%|██▉       | 107687/371472 [8:33:48<19:16:37,  3.80it/s]
 29%|██▉       | 107688/371472 [8:33:48<21:44:12,  3.37it/s]
 29%|██▉       | 107689/371472 [8:33:48<21:07:00,  3.47it/s]
 29%|██▉       | 107690/371472 [8:33:48<21:04:50,  3.48it/s]
 29%|██▉       | 107691/371472 [8:33:49<20:34:52,  3.56it/s]
 29%|██▉       | 107692/371472 [8:33:49<24:25:01,  3.00it/s]
 29%|██▉       | 107693/371472 [8:33:49<22:38:07,  3.24it/s]
 29%|██▉       | 107694/371472 [8:33:50<21:41:03,  3.38it/s]
 29%|██▉       | 107695/371472 [8:33:50<21:42:05,  3.38it/s]
 29%|██▉       | 107696/371472 [8:33:50<21:20:10,  3.43it/s]
 29%|██▉       | 107697/371472 [8:33:51<20:12:34,  3.63it/s]
 29%|██▉       | 107698/371472 [8:33:51<19:47:58,  3.70it/s]
 29%|██▉       | 107699/371472 [8:33:51<19:19:14,  3.79it/s]
 29%|██▉       | 107700/371472 [8:33:51<20:47:57,  3.52it/s]
                                                            
{'loss': 3.3795, 'learning_rate': 7.394093818009437e-07, 'epoch': 4.64}

 29%|██▉       | 107700/371472 [8:33:51<20:47:57,  3.52it/s]
 29%|██▉       | 107701/371472 [8:33:52<20:46:46,  3.53it/s]
 29%|██▉       | 107702/371472 [8:33:52<21:09:45,  3.46it/s]
 29%|██▉       | 107703/371472 [8:33:52<20:28:45,  3.58it/s]
 29%|██▉       | 107704/371472 [8:33:52<19:49:16,  3.70it/s]
 29%|██▉       | 107705/371472 [8:33:53<20:48:39,  3.52it/s]
 29%|██▉       | 107706/371472 [8:33:53<20:09:51,  3.63it/s]
 29%|██▉       | 107707/371472 [8:33:53<20:38:23,  3.55it/s]
 29%|██▉       | 107708/371472 [8:33:54<20:47:26,  3.52it/s]
 29%|██▉       | 107709/371472 [8:33:54<20:03:25,  3.65it/s]
 29%|██▉       | 107710/371472 [8:33:54<20:08:07,  3.64it/s]
 29%|██▉       | 107711/371472 [8:33:54<19:39:52,  3.73it/s]
 29%|██▉       | 107712/371472 [8:33:55<20:12:30,  3.63it/s]
 29%|██▉       | 107713/371472 [8:33:55<20:07:51,  3.64it/s]
 29%|██▉       | 107714/371472 [8:33:55<19:31:15,  3.75it/s]
 29%|██▉       | 107715/371472 [8:33:56<20:02:30,  3.66it/s]
 29%|██▉       | 107716/371472 [8:33:56<20:53:48,  3.51it/s]
 29%|██▉       | 107717/371472 [8:33:56<20:23:48,  3.59it/s]
 29%|██▉       | 107718/371472 [8:33:56<19:57:40,  3.67it/s]
 29%|██▉       | 107719/371472 [8:33:57<19:58:57,  3.67it/s]
 29%|██▉       | 107720/371472 [8:33:57<20:21:46,  3.60it/s]
                                                            
{'loss': 3.4284, 'learning_rate': 7.393608998254647e-07, 'epoch': 4.64}

 29%|██▉       | 107720/371472 [8:33:57<20:21:46,  3.60it/s]
 29%|██▉       | 107721/371472 [8:33:57<20:46:24,  3.53it/s]
 29%|██▉       | 107722/371472 [8:33:57<21:09:11,  3.46it/s]
 29%|██▉       | 107723/371472 [8:33:58<20:24:06,  3.59it/s]
 29%|██▉       | 107724/371472 [8:33:58<23:10:34,  3.16it/s]
 29%|██▉       | 107725/371472 [8:33:58<22:52:07,  3.20it/s]
 29%|██▉       | 107726/371472 [8:33:59<22:09:07,  3.31it/s]
 29%|██▉       | 107727/371472 [8:33:59<20:55:47,  3.50it/s]
 29%|██▉       | 107728/371472 [8:33:59<20:36:50,  3.55it/s]
 29%|██▉       | 107729/371472 [8:34:00<21:40:03,  3.38it/s]
 29%|██▉       | 107730/371472 [8:34:00<21:45:38,  3.37it/s]
 29%|██▉       | 107731/371472 [8:34:00<21:42:41,  3.37it/s]
 29%|██▉       | 107732/371472 [8:34:00<21:52:25,  3.35it/s]
 29%|██▉       | 107733/371472 [8:34:01<20:43:52,  3.53it/s]
 29%|██▉       | 107734/371472 [8:34:01<19:49:03,  3.70it/s]
 29%|██▉       | 107735/371472 [8:34:01<20:49:01,  3.52it/s]
 29%|██▉       | 107736/371472 [8:34:02<22:51:23,  3.21it/s]
 29%|██▉       | 107737/371472 [8:34:02<21:47:09,  3.36it/s]
 29%|██▉       | 107738/371472 [8:34:02<22:33:29,  3.25it/s]
 29%|██▉       | 107739/371472 [8:34:03<24:33:26,  2.98it/s]
 29%|██▉       | 107740/371472 [8:34:03<25:29:46,  2.87it/s]
                                                            
{'loss': 3.5511, 'learning_rate': 7.39312417849986e-07, 'epoch': 4.64}

 29%|██▉       | 107740/371472 [8:34:03<25:29:46,  2.87it/s]
 29%|██▉       | 107741/371472 [8:34:03<23:41:39,  3.09it/s]
 29%|██▉       | 107742/371472 [8:34:04<22:20:50,  3.28it/s]
 29%|██▉       | 107743/371472 [8:34:04<21:11:48,  3.46it/s]
 29%|██▉       | 107744/371472 [8:34:04<20:43:32,  3.53it/s]
 29%|██▉       | 107745/371472 [8:34:04<19:44:51,  3.71it/s]
 29%|██▉       | 107746/371472 [8:34:05<19:11:47,  3.82it/s]
 29%|██▉       | 107747/371472 [8:34:05<19:06:11,  3.83it/s]
 29%|██▉       | 107748/371472 [8:34:05<20:34:11,  3.56it/s]
 29%|██▉       | 107749/371472 [8:34:05<20:52:34,  3.51it/s]
 29%|██▉       | 107750/371472 [8:34:06<20:30:22,  3.57it/s]
 29%|██▉       | 107751/371472 [8:34:06<22:45:10,  3.22it/s]
 29%|██▉       | 107752/371472 [8:34:06<21:28:17,  3.41it/s]
 29%|██▉       | 107753/371472 [8:34:07<21:22:29,  3.43it/s]
 29%|██▉       | 107754/371472 [8:34:07<21:09:00,  3.46it/s]
 29%|██▉       | 107755/371472 [8:34:07<20:38:33,  3.55it/s]
 29%|██▉       | 107756/371472 [8:34:08<21:58:28,  3.33it/s]
 29%|██▉       | 107757/371472 [8:34:08<21:40:52,  3.38it/s]
 29%|██▉       | 107758/371472 [8:34:08<21:14:25,  3.45it/s]
 29%|██▉       | 107759/371472 [8:34:08<21:25:00,  3.42it/s]
 29%|██▉       | 107760/371472 [8:34:09<21:18:25,  3.44it/s]
                                                            
{'loss': 3.5303, 'learning_rate': 7.392639358745071e-07, 'epoch': 4.64}

 29%|██▉       | 107760/371472 [8:34:09<21:18:25,  3.44it/s]
 29%|██▉       | 107761/371472 [8:34:09<20:39:30,  3.55it/s]
 29%|██▉       | 107762/371472 [8:34:09<20:14:14,  3.62it/s]
 29%|██▉       | 107763/371472 [8:34:09<20:35:56,  3.56it/s]
 29%|██▉       | 107764/371472 [8:34:10<20:44:59,  3.53it/s]
 29%|██▉       | 107765/371472 [8:34:10<20:02:37,  3.65it/s]
 29%|██▉       | 107766/371472 [8:34:10<19:59:19,  3.66it/s]
 29%|██▉       | 107767/371472 [8:34:11<20:30:28,  3.57it/s]
 29%|██▉       | 107768/371472 [8:34:11<19:55:14,  3.68it/s]
 29%|██▉       | 107769/371472 [8:34:11<19:48:52,  3.70it/s]
 29%|██▉       | 107770/371472 [8:34:11<19:47:14,  3.70it/s]
 29%|██▉       | 107771/371472 [8:34:12<20:53:19,  3.51it/s]
 29%|██▉       | 107772/371472 [8:34:12<21:06:14,  3.47it/s]
 29%|██▉       | 107773/371472 [8:34:12<20:38:05,  3.55it/s]
 29%|██▉       | 107774/371472 [8:34:13<22:05:51,  3.31it/s]
 29%|██▉       | 107775/371472 [8:34:13<22:31:32,  3.25it/s]
 29%|██▉       | 107776/371472 [8:34:13<23:06:37,  3.17it/s]
 29%|██▉       | 107777/371472 [8:34:14<22:31:28,  3.25it/s]
 29%|██▉       | 107778/371472 [8:34:14<22:20:11,  3.28it/s]
 29%|██▉       | 107779/371472 [8:34:14<21:31:49,  3.40it/s]
 29%|██▉       | 107780/371472 [8:34:14<20:36:10,  3.56it/s]
                                                            
{'loss': 3.4329, 'learning_rate': 7.392154538990281e-07, 'epoch': 4.64}

 29%|██▉       | 107780/371472 [8:34:14<20:36:10,  3.56it/s]
 29%|██▉       | 107781/371472 [8:34:15<19:58:03,  3.67it/s]
 29%|██▉       | 107782/371472 [8:34:15<19:53:15,  3.68it/s]
 29%|██▉       | 107783/371472 [8:34:15<21:18:33,  3.44it/s]
 29%|██▉       | 107784/371472 [8:34:16<21:13:01,  3.45it/s]
 29%|██▉       | 107785/371472 [8:34:16<20:48:58,  3.52it/s]
 29%|██▉       | 107786/371472 [8:34:16<22:00:06,  3.33it/s]
 29%|██▉       | 107787/371472 [8:34:16<20:52:22,  3.51it/s]
 29%|██▉       | 107788/371472 [8:34:17<20:24:29,  3.59it/s]
 29%|██▉       | 107789/371472 [8:34:17<20:20:44,  3.60it/s]
 29%|██▉       | 107790/371472 [8:34:17<21:14:34,  3.45it/s]
 29%|██▉       | 107791/371472 [8:34:18<21:43:24,  3.37it/s]
 29%|██▉       | 107792/371472 [8:34:18<20:33:54,  3.56it/s]
 29%|██▉       | 107793/371472 [8:34:18<21:26:41,  3.42it/s]
 29%|██▉       | 107794/371472 [8:34:18<22:26:11,  3.26it/s]
 29%|██▉       | 107795/371472 [8:34:19<21:00:28,  3.49it/s]
 29%|██▉       | 107796/371472 [8:34:19<23:02:56,  3.18it/s]
 29%|██▉       | 107797/371472 [8:34:19<23:13:47,  3.15it/s]
 29%|██▉       | 107798/371472 [8:34:20<24:40:17,  2.97it/s]
 29%|██▉       | 107799/371472 [8:34:20<23:09:18,  3.16it/s]
 29%|██▉       | 107800/371472 [8:34:20<22:12:24,  3.30it/s]
                                                            
{'loss': 3.2984, 'learning_rate': 7.391669719235492e-07, 'epoch': 4.64}

 29%|██▉       | 107800/371472 [8:34:20<22:12:24,  3.30it/s]
 29%|██▉       | 107801/371472 [8:34:21<21:45:45,  3.37it/s]
 29%|██▉       | 107802/371472 [8:34:21<21:23:22,  3.42it/s]
 29%|██▉       | 107803/371472 [8:34:21<21:46:16,  3.36it/s]
 29%|██▉       | 107804/371472 [8:34:22<23:04:55,  3.17it/s]
 29%|██▉       | 107805/371472 [8:34:22<21:24:41,  3.42it/s]
 29%|██▉       | 107806/371472 [8:34:22<21:24:52,  3.42it/s]
 29%|██▉       | 107807/371472 [8:34:22<20:30:45,  3.57it/s]
 29%|██▉       | 107808/371472 [8:34:23<21:36:16,  3.39it/s]
 29%|██▉       | 107809/371472 [8:34:23<20:55:13,  3.50it/s]
 29%|██▉       | 107810/371472 [8:34:23<20:16:24,  3.61it/s]
 29%|██▉       | 107811/371472 [8:34:23<20:26:26,  3.58it/s]
 29%|██▉       | 107812/371472 [8:34:24<21:13:23,  3.45it/s]
 29%|██▉       | 107813/371472 [8:34:24<21:23:28,  3.42it/s]
 29%|██▉       | 107814/371472 [8:34:24<20:26:57,  3.58it/s]
 29%|██▉       | 107815/371472 [8:34:25<19:47:01,  3.70it/s]
 29%|██▉       | 107816/371472 [8:34:25<19:47:36,  3.70it/s]
 29%|██▉       | 107817/371472 [8:34:25<20:42:47,  3.54it/s]
 29%|██▉       | 107818/371472 [8:34:25<20:09:45,  3.63it/s]
 29%|██▉       | 107819/371472 [8:34:26<19:44:06,  3.71it/s]
 29%|██▉       | 107820/371472 [8:34:26<19:31:47,  3.75it/s]
                                                            
{'loss': 3.2471, 'learning_rate': 7.391184899480705e-07, 'epoch': 4.64}

 29%|██▉       | 107820/371472 [8:34:26<19:31:47,  3.75it/s]
 29%|██▉       | 107821/371472 [8:34:26<19:35:37,  3.74it/s]
 29%|██▉       | 107822/371472 [8:34:27<20:35:37,  3.56it/s]
 29%|██▉       | 107823/371472 [8:34:27<20:08:10,  3.64it/s]
 29%|██▉       | 107824/371472 [8:34:27<20:18:39,  3.61it/s]
 29%|██▉       | 107825/371472 [8:34:27<20:12:34,  3.62it/s]
 29%|██▉       | 107826/371472 [8:34:28<20:20:19,  3.60it/s]
 29%|██▉       | 107827/371472 [8:34:28<19:27:33,  3.76it/s]
 29%|██▉       | 107828/371472 [8:34:28<19:23:08,  3.78it/s]
 29%|██▉       | 107829/371472 [8:34:28<20:36:43,  3.55it/s]
 29%|██▉       | 107830/371472 [8:34:29<20:21:02,  3.60it/s]
 29%|██▉       | 107831/371472 [8:34:29<20:44:09,  3.53it/s]
 29%|██▉       | 107832/371472 [8:34:29<21:33:28,  3.40it/s]
 29%|██▉       | 107833/371472 [8:34:30<20:50:18,  3.51it/s]
 29%|██▉       | 107834/371472 [8:34:30<20:58:24,  3.49it/s]
 29%|██▉       | 107835/371472 [8:34:30<20:24:02,  3.59it/s]
 29%|██▉       | 107836/371472 [8:34:30<20:39:21,  3.55it/s]
 29%|██▉       | 107837/371472 [8:34:31<20:40:15,  3.54it/s]
 29%|██▉       | 107838/371472 [8:34:31<19:56:30,  3.67it/s]
 29%|██▉       | 107839/371472 [8:34:31<20:15:57,  3.61it/s]
 29%|██▉       | 107840/371472 [8:34:32<20:15:02,  3.62it/s]
                                                            
{'loss': 3.5918, 'learning_rate': 7.390700079725915e-07, 'epoch': 4.64}

 29%|██▉       | 107840/371472 [8:34:32<20:15:02,  3.62it/s]
 29%|██▉       | 107841/371472 [8:34:32<20:49:47,  3.52it/s]
 29%|██▉       | 107842/371472 [8:34:32<20:48:00,  3.52it/s]
 29%|██▉       | 107843/371472 [8:34:32<20:33:56,  3.56it/s]
 29%|██▉       | 107844/371472 [8:34:33<20:26:10,  3.58it/s]
 29%|██▉       | 107845/371472 [8:34:33<20:18:18,  3.61it/s]
 29%|██▉       | 107846/371472 [8:34:33<20:30:20,  3.57it/s]
 29%|██▉       | 107847/371472 [8:34:34<20:29:30,  3.57it/s]
 29%|██▉       | 107848/371472 [8:34:34<21:02:46,  3.48it/s]
 29%|██▉       | 107849/371472 [8:34:34<22:08:23,  3.31it/s]
 29%|██▉       | 107850/371472 [8:34:34<21:08:02,  3.46it/s]
 29%|██▉       | 107851/371472 [8:34:35<21:57:26,  3.34it/s]
 29%|██▉       | 107852/371472 [8:34:35<20:52:30,  3.51it/s]
 29%|██▉       | 107853/371472 [8:34:35<21:51:19,  3.35it/s]
 29%|██▉       | 107854/371472 [8:34:36<21:01:29,  3.48it/s]
 29%|██▉       | 107855/371472 [8:34:36<21:32:26,  3.40it/s]
 29%|██▉       | 107856/371472 [8:34:36<20:51:48,  3.51it/s]
 29%|██▉       | 107857/371472 [8:34:36<20:17:26,  3.61it/s]
 29%|██▉       | 107858/371472 [8:34:37<20:31:28,  3.57it/s]
 29%|██▉       | 107859/371472 [8:34:37<20:23:54,  3.59it/s]
 29%|██▉       | 107860/371472 [8:34:37<20:09:38,  3.63it/s]
                                                            
{'loss': 3.3016, 'learning_rate': 7.390215259971126e-07, 'epoch': 4.65}

 29%|██▉       | 107860/371472 [8:34:37<20:09:38,  3.63it/s]
 29%|██▉       | 107861/371472 [8:34:38<20:29:30,  3.57it/s]
 29%|██▉       | 107862/371472 [8:34:38<19:41:45,  3.72it/s]
 29%|██▉       | 107863/371472 [8:34:38<20:08:27,  3.64it/s]
 29%|██▉       | 107864/371472 [8:34:38<20:01:44,  3.66it/s]
 29%|██▉       | 107865/371472 [8:34:39<19:17:08,  3.80it/s]
 29%|██▉       | 107866/371472 [8:34:39<19:23:52,  3.77it/s]
 29%|██▉       | 107867/371472 [8:34:39<19:35:43,  3.74it/s]
 29%|██▉       | 107868/371472 [8:34:39<18:54:21,  3.87it/s]
 29%|██▉       | 107869/371472 [8:34:40<18:30:20,  3.96it/s]
 29%|██▉       | 107870/371472 [8:34:40<18:31:39,  3.95it/s]
 29%|██▉       | 107871/371472 [8:34:40<18:35:48,  3.94it/s]
 29%|██▉       | 107872/371472 [8:34:40<19:48:38,  3.70it/s]
 29%|██▉       | 107873/371472 [8:34:41<19:27:10,  3.76it/s]
 29%|██▉       | 107874/371472 [8:34:41<19:02:54,  3.84it/s]
 29%|██▉       | 107875/371472 [8:34:41<18:57:30,  3.86it/s]
 29%|██▉       | 107876/371472 [8:34:41<19:41:32,  3.72it/s]
 29%|██▉       | 107877/371472 [8:34:42<20:43:48,  3.53it/s]
 29%|██▉       | 107878/371472 [8:34:42<20:25:47,  3.58it/s]
 29%|██▉       | 107879/371472 [8:34:42<20:45:43,  3.53it/s]
 29%|██▉       | 107880/371472 [8:34:43<19:42:34,  3.71it/s]
                                                            
{'loss': 3.4703, 'learning_rate': 7.389730440216337e-07, 'epoch': 4.65}

 29%|██▉       | 107880/371472 [8:34:43<19:42:34,  3.71it/s]
 29%|██▉       | 107881/371472 [8:34:43<20:00:00,  3.66it/s]
 29%|██▉       | 107882/371472 [8:34:43<20:04:42,  3.65it/s]
 29%|██▉       | 107883/371472 [8:34:43<20:06:41,  3.64it/s]
 29%|██▉       | 107884/371472 [8:34:44<20:36:38,  3.55it/s]
 29%|██▉       | 107885/371472 [8:34:44<21:25:47,  3.42it/s]
 29%|██▉       | 107886/371472 [8:34:44<21:04:07,  3.48it/s]
 29%|██▉       | 107887/371472 [8:34:45<20:25:48,  3.58it/s]
 29%|██▉       | 107888/371472 [8:34:45<21:46:12,  3.36it/s]
 29%|██▉       | 107889/371472 [8:34:45<23:05:07,  3.17it/s]
 29%|██▉       | 107890/371472 [8:34:46<22:44:10,  3.22it/s]
 29%|██▉       | 107891/371472 [8:34:46<21:16:09,  3.44it/s]
 29%|██▉       | 107892/371472 [8:34:46<20:32:33,  3.56it/s]
 29%|██▉       | 107893/371472 [8:34:46<21:25:25,  3.42it/s]
 29%|██▉       | 107894/371472 [8:34:47<20:12:54,  3.62it/s]
 29%|██▉       | 107895/371472 [8:34:47<21:23:11,  3.42it/s]
 29%|██▉       | 107896/371472 [8:34:47<21:12:56,  3.45it/s]
 29%|██▉       | 107897/371472 [8:34:48<20:58:59,  3.49it/s]
 29%|██▉       | 107898/371472 [8:34:48<21:15:10,  3.44it/s]
 29%|██▉       | 107899/371472 [8:34:48<20:10:03,  3.63it/s]
 29%|██▉       | 107900/371472 [8:34:48<21:25:46,  3.42it/s]
                                                            
{'loss': 3.5508, 'learning_rate': 7.389245620461548e-07, 'epoch': 4.65}

 29%|██▉       | 107900/371472 [8:34:48<21:25:46,  3.42it/s]
 29%|██▉       | 107901/371472 [8:34:49<21:31:42,  3.40it/s]
 29%|██▉       | 107902/371472 [8:34:49<20:50:28,  3.51it/s]
 29%|██▉       | 107903/371472 [8:34:49<20:15:41,  3.61it/s]
 29%|██▉       | 107904/371472 [8:34:49<20:37:03,  3.55it/s]
 29%|██▉       | 107905/371472 [8:34:50<20:30:54,  3.57it/s]
 29%|██▉       | 107906/371472 [8:34:50<20:23:01,  3.59it/s]
 29%|██▉       | 107907/371472 [8:34:50<20:34:41,  3.56it/s]
 29%|██▉       | 107908/371472 [8:34:51<20:32:07,  3.57it/s]
 29%|██▉       | 107909/371472 [8:34:51<21:14:27,  3.45it/s]
 29%|██▉       | 107910/371472 [8:34:51<20:25:34,  3.58it/s]
 29%|██▉       | 107911/371472 [8:34:51<20:52:52,  3.51it/s]
 29%|██▉       | 107912/371472 [8:34:52<20:19:42,  3.60it/s]
 29%|██▉       | 107913/371472 [8:34:52<20:25:54,  3.58it/s]
 29%|██▉       | 107914/371472 [8:34:52<20:31:37,  3.57it/s]
 29%|██▉       | 107915/371472 [8:34:53<21:27:20,  3.41it/s]
 29%|██▉       | 107916/371472 [8:34:53<20:51:12,  3.51it/s]
 29%|██▉       | 107917/371472 [8:34:53<21:00:41,  3.48it/s]
 29%|██▉       | 107918/371472 [8:34:53<20:15:19,  3.61it/s]
 29%|██▉       | 107919/371472 [8:34:54<21:04:38,  3.47it/s]
 29%|██▉       | 107920/371472 [8:34:54<22:09:29,  3.30it/s]
                                                            
{'loss': 3.2261, 'learning_rate': 7.388760800706759e-07, 'epoch': 4.65}

 29%|██▉       | 107920/371472 [8:34:54<22:09:29,  3.30it/s]
 29%|██▉       | 107921/371472 [8:34:54<21:39:06,  3.38it/s]
 29%|██▉       | 107922/371472 [8:34:55<22:44:15,  3.22it/s]
 29%|██▉       | 107923/371472 [8:34:55<21:29:13,  3.41it/s]
 29%|██▉       | 107924/371472 [8:34:55<20:26:54,  3.58it/s]
 29%|██▉       | 107925/371472 [8:34:55<19:24:09,  3.77it/s]
 29%|██▉       | 107926/371472 [8:34:56<19:18:16,  3.79it/s]
 29%|██▉       | 107927/371472 [8:34:56<19:18:09,  3.79it/s]
 29%|██▉       | 107928/371472 [8:34:56<18:58:11,  3.86it/s]
 29%|██▉       | 107929/371472 [8:34:56<18:59:30,  3.85it/s]
 29%|██▉       | 107930/371472 [8:34:57<21:16:57,  3.44it/s]
 29%|██▉       | 107931/371472 [8:34:57<20:22:31,  3.59it/s]
 29%|██▉       | 107932/371472 [8:34:57<20:28:41,  3.57it/s]
 29%|██▉       | 107933/371472 [8:34:58<20:11:09,  3.63it/s]
 29%|██▉       | 107934/371472 [8:34:58<19:53:57,  3.68it/s]
 29%|██▉       | 107935/371472 [8:34:58<20:18:04,  3.61it/s]
 29%|██▉       | 107936/371472 [8:34:58<20:17:47,  3.61it/s]
 29%|██▉       | 107937/371472 [8:34:59<19:45:33,  3.70it/s]
 29%|██▉       | 107938/371472 [8:34:59<20:07:23,  3.64it/s]
 29%|██▉       | 107939/371472 [8:34:59<19:12:52,  3.81it/s]
 29%|██▉       | 107940/371472 [8:34:59<18:36:34,  3.93it/s]
                                                            
{'loss': 3.5461, 'learning_rate': 7.38827598095197e-07, 'epoch': 4.65}

 29%|██▉       | 107940/371472 [8:34:59<18:36:34,  3.93it/s]
 29%|██▉       | 107941/371472 [8:35:00<20:57:51,  3.49it/s]
 29%|██▉       | 107942/371472 [8:35:00<20:38:25,  3.55it/s]
 29%|██▉       | 107943/371472 [8:35:00<22:55:09,  3.19it/s]
 29%|██▉       | 107944/371472 [8:35:01<21:15:53,  3.44it/s]
 29%|██▉       | 107945/371472 [8:35:01<21:39:22,  3.38it/s]
 29%|██▉       | 107946/371472 [8:35:01<22:16:50,  3.29it/s]
 29%|██▉       | 107947/371472 [8:35:02<23:07:05,  3.17it/s]
 29%|██▉       | 107948/371472 [8:35:02<21:25:22,  3.42it/s]
 29%|██▉       | 107949/371472 [8:35:02<20:25:52,  3.58it/s]
 29%|██▉       | 107950/371472 [8:35:02<19:51:13,  3.69it/s]
 29%|██▉       | 107951/371472 [8:35:03<19:51:15,  3.69it/s]
 29%|██▉       | 107952/371472 [8:35:03<20:09:28,  3.63it/s]
 29%|██▉       | 107953/371472 [8:35:03<21:10:59,  3.46it/s]
 29%|██▉       | 107954/371472 [8:35:04<20:47:33,  3.52it/s]
 29%|██▉       | 107955/371472 [8:35:04<19:58:58,  3.66it/s]
 29%|██▉       | 107956/371472 [8:35:04<20:12:51,  3.62it/s]
 29%|██▉       | 107957/371472 [8:35:04<19:57:56,  3.67it/s]
 29%|██▉       | 107958/371472 [8:35:05<19:37:26,  3.73it/s]
 29%|██▉       | 107959/371472 [8:35:05<22:41:51,  3.22it/s]
 29%|██▉       | 107960/371472 [8:35:05<21:08:47,  3.46it/s]
                                                            
{'loss': 3.4937, 'learning_rate': 7.387791161197181e-07, 'epoch': 4.65}

 29%|██▉       | 107960/371472 [8:35:05<21:08:47,  3.46it/s]
 29%|██▉       | 107961/371472 [8:35:06<21:00:30,  3.48it/s]
 29%|██▉       | 107962/371472 [8:35:06<20:24:22,  3.59it/s]
 29%|██▉       | 107963/371472 [8:35:06<19:24:58,  3.77it/s]
 29%|██▉       | 107964/371472 [8:35:06<19:16:02,  3.80it/s]
 29%|██▉       | 107965/371472 [8:35:07<20:02:20,  3.65it/s]
 29%|██▉       | 107966/371472 [8:35:07<19:28:06,  3.76it/s]
 29%|██▉       | 107967/371472 [8:35:07<20:02:57,  3.65it/s]
 29%|██▉       | 107968/371472 [8:35:07<19:48:38,  3.69it/s]
 29%|██▉       | 107969/371472 [8:35:08<22:26:02,  3.26it/s]
 29%|██▉       | 107970/371472 [8:35:08<23:13:07,  3.15it/s]
 29%|██▉       | 107971/371472 [8:35:08<22:42:46,  3.22it/s]
 29%|██▉       | 107972/371472 [8:35:09<22:48:12,  3.21it/s]
 29%|██▉       | 107973/371472 [8:35:09<22:00:19,  3.33it/s]
 29%|██▉       | 107974/371472 [8:35:09<21:05:24,  3.47it/s]
 29%|██▉       | 107975/371472 [8:35:10<20:49:26,  3.51it/s]
 29%|██▉       | 107976/371472 [8:35:10<22:34:21,  3.24it/s]
 29%|██▉       | 107977/371472 [8:35:10<23:01:02,  3.18it/s]
 29%|██▉       | 107978/371472 [8:35:11<24:41:12,  2.96it/s]
 29%|██▉       | 107979/371472 [8:35:11<23:33:11,  3.11it/s]
 29%|██▉       | 107980/371472 [8:35:11<21:56:47,  3.34it/s]
                                                            
{'loss': 3.2862, 'learning_rate': 7.387306341442393e-07, 'epoch': 4.65}

 29%|██▉       | 107980/371472 [8:35:11<21:56:47,  3.34it/s]
 29%|██▉       | 107981/371472 [8:35:12<23:46:31,  3.08it/s]
 29%|██▉       | 107982/371472 [8:35:12<22:05:53,  3.31it/s]
 29%|██▉       | 107983/371472 [8:35:12<21:16:57,  3.44it/s]
 29%|██▉       | 107984/371472 [8:35:12<20:35:17,  3.56it/s]
 29%|██▉       | 107985/371472 [8:35:13<20:11:38,  3.62it/s]
 29%|██▉       | 107986/371472 [8:35:13<20:33:57,  3.56it/s]
 29%|██▉       | 107987/371472 [8:35:13<21:05:45,  3.47it/s]
 29%|██▉       | 107988/371472 [8:35:13<21:01:09,  3.48it/s]
 29%|██▉       | 107989/371472 [8:35:14<20:59:16,  3.49it/s]
 29%|██▉       | 107990/371472 [8:35:14<20:06:32,  3.64it/s]
 29%|██▉       | 107991/371472 [8:35:14<20:13:38,  3.62it/s]
 29%|██▉       | 107992/371472 [8:35:15<19:50:56,  3.69it/s]
 29%|██▉       | 107993/371472 [8:35:15<19:06:55,  3.83it/s]
 29%|██▉       | 107994/371472 [8:35:15<19:48:43,  3.69it/s]
 29%|██▉       | 107995/371472 [8:35:15<20:11:33,  3.62it/s]
 29%|██▉       | 107996/371472 [8:35:16<20:38:36,  3.55it/s]
 29%|██▉       | 107997/371472 [8:35:16<20:49:01,  3.52it/s]
 29%|██▉       | 107998/371472 [8:35:16<20:22:20,  3.59it/s]
 29%|██▉       | 107999/371472 [8:35:17<20:43:17,  3.53it/s]
 29%|██▉       | 108000/371472 [8:35:17<20:19:22,  3.60it/s]
                                                            
{'loss': 3.2475, 'learning_rate': 7.386821521687604e-07, 'epoch': 4.65}

 29%|██▉       | 108000/371472 [8:35:17<20:19:22,  3.60it/s]
 29%|██▉       | 108001/371472 [8:35:17<20:14:20,  3.62it/s]
 29%|██▉       | 108002/371472 [8:35:17<21:57:09,  3.33it/s]
 29%|██▉       | 108003/371472 [8:35:18<21:44:41,  3.37it/s]
 29%|██▉       | 108004/371472 [8:35:18<21:16:01,  3.44it/s]
 29%|██▉       | 108005/371472 [8:35:18<22:01:10,  3.32it/s]
 29%|██▉       | 108006/371472 [8:35:19<22:23:37,  3.27it/s]
 29%|██▉       | 108007/371472 [8:35:19<21:14:46,  3.44it/s]
 29%|██▉       | 108008/371472 [8:35:19<20:50:36,  3.51it/s]
 29%|██▉       | 108009/371472 [8:35:19<20:39:37,  3.54it/s]
 29%|██▉       | 108010/371472 [8:35:20<20:34:50,  3.56it/s]
 29%|██▉       | 108011/371472 [8:35:20<19:58:41,  3.66it/s]
 29%|██▉       | 108012/371472 [8:35:20<19:59:04,  3.66it/s]
 29%|██▉       | 108013/371472 [8:35:20<19:07:36,  3.83it/s]
 29%|██▉       | 108014/371472 [8:35:21<19:03:16,  3.84it/s]
 29%|██▉       | 108015/371472 [8:35:21<19:13:43,  3.81it/s]
 29%|██▉       | 108016/371472 [8:35:21<19:20:59,  3.78it/s]
 29%|██▉       | 108017/371472 [8:35:22<19:17:41,  3.79it/s]
 29%|██▉       | 108018/371472 [8:35:22<21:51:22,  3.35it/s]
 29%|██▉       | 108019/371472 [8:35:22<20:50:13,  3.51it/s]
 29%|██▉       | 108020/371472 [8:35:22<20:39:45,  3.54it/s]
                                                            
{'loss': 3.4575, 'learning_rate': 7.386336701932814e-07, 'epoch': 4.65}

 29%|██▉       | 108020/371472 [8:35:22<20:39:45,  3.54it/s]
 29%|██▉       | 108021/371472 [8:35:23<21:32:56,  3.40it/s]
 29%|██▉       | 108022/371472 [8:35:23<21:02:05,  3.48it/s]
 29%|██▉       | 108023/371472 [8:35:23<21:07:49,  3.46it/s]
 29%|██▉       | 108024/371472 [8:35:24<22:38:09,  3.23it/s]
 29%|██▉       | 108025/371472 [8:35:24<23:18:45,  3.14it/s]
 29%|██▉       | 108026/371472 [8:35:24<23:13:51,  3.15it/s]
 29%|██▉       | 108027/371472 [8:35:25<22:07:45,  3.31it/s]
 29%|██▉       | 108028/371472 [8:35:25<22:51:35,  3.20it/s]
 29%|██▉       | 108029/371472 [8:35:25<21:43:52,  3.37it/s]
 29%|██▉       | 108030/371472 [8:35:25<21:06:32,  3.47it/s]
 29%|██▉       | 108031/371472 [8:35:26<20:54:43,  3.50it/s]
 29%|██▉       | 108032/371472 [8:35:26<20:53:50,  3.50it/s]
 29%|██▉       | 108033/371472 [8:35:26<20:39:20,  3.54it/s]
 29%|██▉       | 108034/371472 [8:35:27<20:45:52,  3.52it/s]
 29%|██▉       | 108035/371472 [8:35:27<21:06:04,  3.47it/s]
 29%|██▉       | 108036/371472 [8:35:27<20:47:19,  3.52it/s]
 29%|██▉       | 108037/371472 [8:35:27<20:02:54,  3.65it/s]
 29%|██▉       | 108038/371472 [8:35:28<20:33:50,  3.56it/s]
 29%|██▉       | 108039/371472 [8:35:28<22:33:32,  3.24it/s]
 29%|██▉       | 108040/371472 [8:35:28<22:15:33,  3.29it/s]
                                                            
{'loss': 3.234, 'learning_rate': 7.385851882178025e-07, 'epoch': 4.65}

 29%|██▉       | 108040/371472 [8:35:28<22:15:33,  3.29it/s]
 29%|██▉       | 108041/371472 [8:35:29<21:24:52,  3.42it/s]
 29%|██▉       | 108042/371472 [8:35:29<21:14:57,  3.44it/s]
 29%|██▉       | 108043/371472 [8:35:29<21:06:04,  3.47it/s]
 29%|██▉       | 108044/371472 [8:35:29<20:27:03,  3.58it/s]
 29%|██▉       | 108045/371472 [8:35:30<21:09:25,  3.46it/s]
 29%|██▉       | 108046/371472 [8:35:30<20:40:25,  3.54it/s]
 29%|██▉       | 108047/371472 [8:35:30<20:41:24,  3.54it/s]
 29%|██▉       | 108048/371472 [8:35:31<20:29:42,  3.57it/s]
 29%|██▉       | 108049/371472 [8:35:31<20:39:21,  3.54it/s]
 29%|██▉       | 108050/371472 [8:35:31<20:39:59,  3.54it/s]
 29%|██▉       | 108051/371472 [8:35:31<19:44:18,  3.71it/s]
 29%|██▉       | 108052/371472 [8:35:32<21:02:31,  3.48it/s]
 29%|██▉       | 108053/371472 [8:35:32<21:55:51,  3.34it/s]
 29%|██▉       | 108054/371472 [8:35:32<23:03:40,  3.17it/s]
 29%|██▉       | 108055/371472 [8:35:33<22:42:41,  3.22it/s]
 29%|██▉       | 108056/371472 [8:35:33<21:45:19,  3.36it/s]
 29%|██▉       | 108057/371472 [8:35:33<21:23:31,  3.42it/s]
 29%|██▉       | 108058/371472 [8:35:34<22:29:18,  3.25it/s]
 29%|██▉       | 108059/371472 [8:35:34<21:28:58,  3.41it/s]
 29%|██▉       | 108060/371472 [8:35:34<20:32:06,  3.56it/s]
                                                            
{'loss': 3.3128, 'learning_rate': 7.385367062423237e-07, 'epoch': 4.65}

 29%|██▉       | 108060/371472 [8:35:34<20:32:06,  3.56it/s]
 29%|██▉       | 108061/371472 [8:35:34<20:10:00,  3.63it/s]
 29%|██▉       | 108062/371472 [8:35:35<20:07:42,  3.64it/s]
 29%|██▉       | 108063/371472 [8:35:35<19:40:54,  3.72it/s]
 29%|██▉       | 108064/371472 [8:35:35<20:27:04,  3.58it/s]
 29%|██▉       | 108065/371472 [8:35:36<20:32:25,  3.56it/s]
 29%|██▉       | 108066/371472 [8:35:36<20:44:30,  3.53it/s]
 29%|██▉       | 108067/371472 [8:35:36<20:06:34,  3.64it/s]
 29%|██▉       | 108068/371472 [8:35:36<20:05:35,  3.64it/s]
 29%|██▉       | 108069/371472 [8:35:37<21:02:15,  3.48it/s]
 29%|██▉       | 108070/371472 [8:35:37<20:01:37,  3.65it/s]
 29%|██▉       | 108071/371472 [8:35:37<19:27:59,  3.76it/s]
 29%|██▉       | 108072/371472 [8:35:37<19:03:52,  3.84it/s]
 29%|██▉       | 108073/371472 [8:35:38<20:47:06,  3.52it/s]
 29%|██▉       | 108074/371472 [8:35:38<20:31:19,  3.57it/s]
 29%|██▉       | 108075/371472 [8:35:38<20:41:49,  3.54it/s]
 29%|██▉       | 108076/371472 [8:35:39<20:42:15,  3.53it/s]
 29%|██▉       | 108077/371472 [8:35:39<21:49:42,  3.35it/s]
 29%|██▉       | 108078/371472 [8:35:39<21:46:14,  3.36it/s]
 29%|██▉       | 108079/371472 [8:35:40<22:14:44,  3.29it/s]
 29%|██▉       | 108080/371472 [8:35:40<21:36:41,  3.39it/s]
                                                            
{'loss': 3.3031, 'learning_rate': 7.384882242668448e-07, 'epoch': 4.66}

 29%|██▉       | 108080/371472 [8:35:40<21:36:41,  3.39it/s]
 29%|██▉       | 108081/371472 [8:35:40<20:50:40,  3.51it/s]
 29%|██▉       | 108082/371472 [8:35:40<20:06:48,  3.64it/s]
 29%|██▉       | 108083/371472 [8:35:41<20:13:52,  3.62it/s]
 29%|██▉       | 108084/371472 [8:35:41<20:20:48,  3.60it/s]
 29%|██▉       | 108085/371472 [8:35:41<20:42:40,  3.53it/s]
 29%|██▉       | 108086/371472 [8:35:41<20:36:52,  3.55it/s]
 29%|██▉       | 108087/371472 [8:35:42<20:16:37,  3.61it/s]
 29%|██▉       | 108088/371472 [8:35:42<21:02:46,  3.48it/s]
 29%|██▉       | 108089/371472 [8:35:42<21:28:24,  3.41it/s]
 29%|██▉       | 108090/371472 [8:35:43<20:30:11,  3.57it/s]
 29%|██▉       | 108091/371472 [8:35:43<20:11:42,  3.62it/s]
 29%|██▉       | 108092/371472 [8:35:43<19:31:34,  3.75it/s]
 29%|██▉       | 108093/371472 [8:35:43<19:17:35,  3.79it/s]
 29%|██▉       | 108094/371472 [8:35:44<19:36:08,  3.73it/s]
 29%|██▉       | 108095/371472 [8:35:44<19:04:48,  3.83it/s]
 29%|██▉       | 108096/371472 [8:35:44<18:30:18,  3.95it/s]
 29%|██▉       | 108097/371472 [8:35:44<19:19:44,  3.78it/s]
 29%|██▉       | 108098/371472 [8:35:45<18:49:56,  3.88it/s]
 29%|██▉       | 108099/371472 [8:35:45<20:32:01,  3.56it/s]
 29%|██▉       | 108100/371472 [8:35:45<21:52:16,  3.34it/s]
                                                            
{'loss': 3.4557, 'learning_rate': 7.384397422913658e-07, 'epoch': 4.66}

 29%|██▉       | 108100/371472 [8:35:45<21:52:16,  3.34it/s]
 29%|██▉       | 108101/371472 [8:35:46<20:48:39,  3.52it/s]
 29%|██▉       | 108102/371472 [8:35:46<20:30:49,  3.57it/s]
 29%|██▉       | 108103/371472 [8:35:46<21:27:07,  3.41it/s]
 29%|██▉       | 108104/371472 [8:35:46<20:33:45,  3.56it/s]
 29%|██▉       | 108105/371472 [8:35:47<19:51:44,  3.68it/s]
 29%|██▉       | 108106/371472 [8:35:47<19:47:35,  3.70it/s]
 29%|██▉       | 108107/371472 [8:35:47<20:14:35,  3.61it/s]
 29%|██▉       | 108108/371472 [8:35:47<20:15:06,  3.61it/s]
 29%|██▉       | 108109/371472 [8:35:48<19:54:25,  3.67it/s]
 29%|██▉       | 108110/371472 [8:35:48<20:41:41,  3.53it/s]
 29%|██▉       | 108111/371472 [8:35:48<20:45:10,  3.53it/s]
 29%|██▉       | 108112/371472 [8:35:49<20:49:32,  3.51it/s]
 29%|██▉       | 108113/371472 [8:35:49<22:10:17,  3.30it/s]
 29%|██▉       | 108114/371472 [8:35:49<22:40:38,  3.23it/s]
 29%|██▉       | 108115/371472 [8:35:50<21:20:53,  3.43it/s]
 29%|██▉       | 108116/371472 [8:35:50<21:57:12,  3.33it/s]
 29%|██▉       | 108117/371472 [8:35:50<21:39:16,  3.38it/s]
 29%|██▉       | 108118/371472 [8:35:50<21:17:44,  3.44it/s]
 29%|██▉       | 108119/371472 [8:35:51<21:45:32,  3.36it/s]
 29%|██▉       | 108120/371472 [8:35:51<21:34:38,  3.39it/s]
                                                            
{'loss': 3.4523, 'learning_rate': 7.38391260315887e-07, 'epoch': 4.66}

 29%|██▉       | 108120/371472 [8:35:51<21:34:38,  3.39it/s]
 29%|██▉       | 108121/371472 [8:35:51<22:04:05,  3.31it/s]
 29%|██▉       | 108122/371472 [8:35:52<21:20:12,  3.43it/s]
 29%|██▉       | 108123/371472 [8:35:52<20:27:34,  3.58it/s]
 29%|██▉       | 108124/371472 [8:35:52<21:05:44,  3.47it/s]
 29%|██▉       | 108125/371472 [8:35:52<20:11:44,  3.62it/s]
 29%|██▉       | 108126/371472 [8:35:53<22:43:48,  3.22it/s]
 29%|██▉       | 108127/371472 [8:35:53<21:59:37,  3.33it/s]
 29%|██▉       | 108128/371472 [8:35:53<21:59:20,  3.33it/s]
 29%|██▉       | 108129/371472 [8:35:54<21:21:21,  3.43it/s]
 29%|██▉       | 108130/371472 [8:35:54<20:25:11,  3.58it/s]
 29%|██▉       | 108131/371472 [8:35:54<20:37:55,  3.55it/s]
 29%|██▉       | 108132/371472 [8:35:54<19:59:29,  3.66it/s]
 29%|██▉       | 108133/371472 [8:35:55<21:05:00,  3.47it/s]
 29%|██▉       | 108134/371472 [8:35:55<22:56:34,  3.19it/s]
 29%|██▉       | 108135/371472 [8:35:55<22:20:23,  3.27it/s]
 29%|██▉       | 108136/371472 [8:35:56<21:54:16,  3.34it/s]
 29%|██▉       | 108137/371472 [8:35:56<21:55:24,  3.34it/s]
 29%|██▉       | 108138/371472 [8:35:56<21:16:59,  3.44it/s]
 29%|██▉       | 108139/371472 [8:35:57<20:21:02,  3.59it/s]
 29%|██▉       | 108140/371472 [8:35:57<22:33:53,  3.24it/s]
                                                            
{'loss': 3.3763, 'learning_rate': 7.383427783404082e-07, 'epoch': 4.66}

 29%|██▉       | 108140/371472 [8:35:57<22:33:53,  3.24it/s]
 29%|██▉       | 108141/371472 [8:35:57<21:44:21,  3.36it/s]
 29%|██▉       | 108142/371472 [8:35:57<21:05:13,  3.47it/s]
 29%|██▉       | 108143/371472 [8:35:58<21:18:33,  3.43it/s]
 29%|██▉       | 108144/371472 [8:35:58<20:39:12,  3.54it/s]
 29%|██▉       | 108145/371472 [8:35:58<20:48:02,  3.52it/s]
 29%|██▉       | 108146/371472 [8:35:59<20:21:41,  3.59it/s]
 29%|██▉       | 108147/371472 [8:35:59<19:58:16,  3.66it/s]
 29%|██▉       | 108148/371472 [8:35:59<23:08:00,  3.16it/s]
 29%|██▉       | 108149/371472 [8:36:00<23:45:49,  3.08it/s]
 29%|██▉       | 108150/371472 [8:36:00<23:53:08,  3.06it/s]
 29%|██▉       | 108151/371472 [8:36:00<22:59:32,  3.18it/s]
 29%|██▉       | 108152/371472 [8:36:00<21:55:38,  3.34it/s]
 29%|██▉       | 108153/371472 [8:36:01<21:28:46,  3.41it/s]
 29%|██▉       | 108154/371472 [8:36:01<21:18:31,  3.43it/s]
 29%|██▉       | 108155/371472 [8:36:01<21:11:30,  3.45it/s]
 29%|██▉       | 108156/371472 [8:36:02<20:17:30,  3.60it/s]
 29%|██▉       | 108157/371472 [8:36:02<19:43:16,  3.71it/s]
 29%|██▉       | 108158/371472 [8:36:02<19:19:39,  3.78it/s]
 29%|██▉       | 108159/371472 [8:36:02<19:18:10,  3.79it/s]
 29%|██▉       | 108160/371472 [8:36:03<19:04:30,  3.83it/s]
                                                            
{'loss': 3.3701, 'learning_rate': 7.382942963649292e-07, 'epoch': 4.66}

 29%|██▉       | 108160/371472 [8:36:03<19:04:30,  3.83it/s]
 29%|██▉       | 108161/371472 [8:36:03<19:29:36,  3.75it/s]
 29%|██▉       | 108162/371472 [8:36:03<19:10:49,  3.81it/s]
 29%|██▉       | 108163/371472 [8:36:03<19:28:14,  3.76it/s]
 29%|██▉       | 108164/371472 [8:36:04<19:54:07,  3.68it/s]
 29%|██▉       | 108165/371472 [8:36:04<19:33:24,  3.74it/s]
 29%|██▉       | 108166/371472 [8:36:04<21:35:54,  3.39it/s]
 29%|██▉       | 108167/371472 [8:36:05<21:22:38,  3.42it/s]
 29%|██▉       | 108168/371472 [8:36:05<20:22:36,  3.59it/s]
 29%|██▉       | 108169/371472 [8:36:05<20:31:50,  3.56it/s]
 29%|██▉       | 108170/371472 [8:36:05<19:53:40,  3.68it/s]
 29%|██▉       | 108171/371472 [8:36:06<19:36:28,  3.73it/s]
 29%|██▉       | 108172/371472 [8:36:06<19:25:49,  3.76it/s]
 29%|██▉       | 108173/371472 [8:36:06<19:16:45,  3.79it/s]
 29%|██▉       | 108174/371472 [8:36:06<19:23:37,  3.77it/s]
 29%|██▉       | 108175/371472 [8:36:07<20:27:27,  3.58it/s]
 29%|██▉       | 108176/371472 [8:36:07<21:04:41,  3.47it/s]
 29%|██▉       | 108177/371472 [8:36:07<21:40:08,  3.38it/s]
 29%|██▉       | 108178/371472 [8:36:08<21:04:43,  3.47it/s]
 29%|██▉       | 108179/371472 [8:36:08<20:21:58,  3.59it/s]
 29%|██▉       | 108180/371472 [8:36:08<21:54:12,  3.34it/s]
                                                            
{'loss': 3.5039, 'learning_rate': 7.382458143894502e-07, 'epoch': 4.66}

 29%|██▉       | 108180/371472 [8:36:08<21:54:12,  3.34it/s]
 29%|██▉       | 108181/371472 [8:36:09<20:53:48,  3.50it/s]
 29%|██▉       | 108182/371472 [8:36:09<20:21:42,  3.59it/s]
 29%|██▉       | 108183/371472 [8:36:09<20:05:59,  3.64it/s]
 29%|██▉       | 108184/371472 [8:36:09<20:56:33,  3.49it/s]
 29%|██▉       | 108185/371472 [8:36:10<20:43:59,  3.53it/s]
 29%|██▉       | 108186/371472 [8:36:10<21:31:13,  3.40it/s]
 29%|██▉       | 108187/371472 [8:36:10<21:00:37,  3.48it/s]
 29%|██▉       | 108188/371472 [8:36:11<21:54:07,  3.34it/s]
 29%|██▉       | 108189/371472 [8:36:11<22:10:37,  3.30it/s]
 29%|██▉       | 108190/371472 [8:36:11<21:35:19,  3.39it/s]
 29%|██▉       | 108191/371472 [8:36:11<20:58:19,  3.49it/s]
 29%|██▉       | 108192/371472 [8:36:12<21:08:33,  3.46it/s]
 29%|██▉       | 108193/371472 [8:36:12<21:32:40,  3.39it/s]
 29%|██▉       | 108194/371472 [8:36:12<21:40:16,  3.37it/s]
 29%|██▉       | 108195/371472 [8:36:13<21:11:00,  3.45it/s]
 29%|██▉       | 108196/371472 [8:36:13<20:08:27,  3.63it/s]
 29%|██▉       | 108197/371472 [8:36:13<20:04:18,  3.64it/s]
 29%|██▉       | 108198/371472 [8:36:13<20:11:26,  3.62it/s]
 29%|██▉       | 108199/371472 [8:36:14<20:59:20,  3.48it/s]
 29%|██▉       | 108200/371472 [8:36:14<20:57:31,  3.49it/s]
                                                            
{'loss': 3.4298, 'learning_rate': 7.381973324139714e-07, 'epoch': 4.66}

 29%|██▉       | 108200/371472 [8:36:14<20:57:31,  3.49it/s]
 29%|██▉       | 108201/371472 [8:36:14<21:31:04,  3.40it/s]
 29%|██▉       | 108202/371472 [8:36:15<21:55:22,  3.34it/s]
 29%|██▉       | 108203/371472 [8:36:15<21:13:08,  3.45it/s]
 29%|██▉       | 108204/371472 [8:36:15<21:42:37,  3.37it/s]
 29%|██▉       | 108205/371472 [8:36:15<21:39:26,  3.38it/s]
 29%|██▉       | 108206/371472 [8:36:16<21:06:24,  3.46it/s]
 29%|██▉       | 108207/371472 [8:36:16<20:16:14,  3.61it/s]
 29%|██▉       | 108208/371472 [8:36:16<20:06:54,  3.64it/s]
 29%|██▉       | 108209/371472 [8:36:17<19:57:07,  3.67it/s]
 29%|██▉       | 108210/371472 [8:36:17<20:03:40,  3.65it/s]
 29%|██▉       | 108211/371472 [8:36:17<20:24:23,  3.58it/s]
 29%|██▉       | 108212/371472 [8:36:17<19:46:26,  3.70it/s]
 29%|██▉       | 108213/371472 [8:36:18<20:07:56,  3.63it/s]
 29%|██▉       | 108214/371472 [8:36:18<20:16:07,  3.61it/s]
 29%|██▉       | 108215/371472 [8:36:18<20:17:06,  3.60it/s]
 29%|██▉       | 108216/371472 [8:36:18<19:42:44,  3.71it/s]
 29%|██▉       | 108217/371472 [8:36:19<20:40:26,  3.54it/s]
 29%|██▉       | 108218/371472 [8:36:19<21:30:14,  3.40it/s]
 29%|██▉       | 108219/371472 [8:36:19<20:39:34,  3.54it/s]
 29%|██▉       | 108220/371472 [8:36:20<20:14:57,  3.61it/s]
                                                            
{'loss': 3.5846, 'learning_rate': 7.381488504384925e-07, 'epoch': 4.66}

 29%|██▉       | 108220/371472 [8:36:20<20:14:57,  3.61it/s]
 29%|██▉       | 108221/371472 [8:36:20<19:30:23,  3.75it/s]
 29%|██▉       | 108222/371472 [8:36:20<22:31:25,  3.25it/s]
 29%|██▉       | 108223/371472 [8:36:20<21:25:18,  3.41it/s]
 29%|██▉       | 108224/371472 [8:36:21<20:20:12,  3.60it/s]
 29%|██▉       | 108225/371472 [8:36:21<19:49:28,  3.69it/s]
 29%|██▉       | 108226/371472 [8:36:21<19:49:21,  3.69it/s]
 29%|██▉       | 108227/371472 [8:36:22<19:51:09,  3.68it/s]
 29%|██▉       | 108228/371472 [8:36:22<19:42:26,  3.71it/s]
 29%|██▉       | 108229/371472 [8:36:22<19:51:46,  3.68it/s]
 29%|██▉       | 108230/371472 [8:36:22<21:53:55,  3.34it/s]
 29%|██▉       | 108231/371472 [8:36:23<21:23:22,  3.42it/s]
 29%|██▉       | 108232/371472 [8:36:23<21:45:52,  3.36it/s]
 29%|██▉       | 108233/371472 [8:36:23<20:38:20,  3.54it/s]
 29%|██▉       | 108234/371472 [8:36:24<20:24:08,  3.58it/s]
 29%|██▉       | 108235/371472 [8:36:24<20:10:03,  3.63it/s]
 29%|██▉       | 108236/371472 [8:36:24<19:42:01,  3.71it/s]
 29%|██▉       | 108237/371472 [8:36:24<20:24:09,  3.58it/s]
 29%|██▉       | 108238/371472 [8:36:25<20:11:24,  3.62it/s]
 29%|██▉       | 108239/371472 [8:36:25<20:51:04,  3.51it/s]
 29%|██▉       | 108240/371472 [8:36:25<20:19:26,  3.60it/s]
                                                            
{'loss': 3.3374, 'learning_rate': 7.381003684630136e-07, 'epoch': 4.66}

 29%|██▉       | 108240/371472 [8:36:25<20:19:26,  3.60it/s]
 29%|██▉       | 108241/371472 [8:36:25<20:16:56,  3.61it/s]
 29%|██▉       | 108242/371472 [8:36:26<19:50:17,  3.69it/s]
 29%|██▉       | 108243/371472 [8:36:26<20:02:15,  3.65it/s]
 29%|██▉       | 108244/371472 [8:36:26<20:15:02,  3.61it/s]
 29%|██▉       | 108245/371472 [8:36:27<19:38:34,  3.72it/s]
 29%|██▉       | 108246/371472 [8:36:27<19:44:05,  3.71it/s]
 29%|██▉       | 108247/371472 [8:36:27<19:35:55,  3.73it/s]
 29%|██▉       | 108248/371472 [8:36:27<19:13:04,  3.80it/s]
 29%|██▉       | 108249/371472 [8:36:28<19:32:28,  3.74it/s]
 29%|██▉       | 108250/371472 [8:36:28<19:49:49,  3.69it/s]
 29%|██▉       | 108251/371472 [8:36:28<20:10:04,  3.63it/s]
 29%|██▉       | 108252/371472 [8:36:28<20:26:29,  3.58it/s]
 29%|██▉       | 108253/371472 [8:36:29<21:01:40,  3.48it/s]
 29%|██▉       | 108254/371472 [8:36:29<21:30:05,  3.40it/s]
 29%|██▉       | 108255/371472 [8:36:29<21:26:26,  3.41it/s]
 29%|██▉       | 108256/371472 [8:36:30<20:55:04,  3.50it/s]
 29%|██▉       | 108257/371472 [8:36:30<20:35:33,  3.55it/s]
 29%|██▉       | 108258/371472 [8:36:30<20:14:57,  3.61it/s]
 29%|██▉       | 108259/371472 [8:36:30<19:43:24,  3.71it/s]
 29%|██▉       | 108260/371472 [8:36:31<21:10:19,  3.45it/s]
                                                            
{'loss': 3.6548, 'learning_rate': 7.380518864875347e-07, 'epoch': 4.66}

 29%|██▉       | 108260/371472 [8:36:31<21:10:19,  3.45it/s]
 29%|██▉       | 108261/371472 [8:36:31<21:37:25,  3.38it/s]
 29%|██▉       | 108262/371472 [8:36:31<22:49:28,  3.20it/s]
 29%|██▉       | 108263/371472 [8:36:32<23:13:36,  3.15it/s]
 29%|██▉       | 108264/371472 [8:36:32<22:22:30,  3.27it/s]
 29%|██▉       | 108265/371472 [8:36:32<21:27:34,  3.41it/s]
 29%|██▉       | 108266/371472 [8:36:33<21:01:14,  3.48it/s]
 29%|██▉       | 108267/371472 [8:36:33<20:37:01,  3.55it/s]
 29%|██▉       | 108268/371472 [8:36:33<23:17:08,  3.14it/s]
 29%|██▉       | 108269/371472 [8:36:34<23:46:05,  3.08it/s]
 29%|██▉       | 108270/371472 [8:36:34<23:43:20,  3.08it/s]
 29%|██▉       | 108271/371472 [8:36:34<22:20:59,  3.27it/s]
 29%|██▉       | 108272/371472 [8:36:34<21:30:40,  3.40it/s]
 29%|██▉       | 108273/371472 [8:36:35<20:27:36,  3.57it/s]
 29%|██▉       | 108274/371472 [8:36:35<20:14:21,  3.61it/s]
 29%|██▉       | 108275/371472 [8:36:35<22:29:42,  3.25it/s]
 29%|██▉       | 108276/371472 [8:36:36<21:44:48,  3.36it/s]
 29%|██▉       | 108277/371472 [8:36:36<20:48:11,  3.51it/s]
 29%|██▉       | 108278/371472 [8:36:36<20:51:16,  3.51it/s]
 29%|██▉       | 108279/371472 [8:36:36<20:40:09,  3.54it/s]
 29%|██▉       | 108280/371472 [8:36:37<21:01:33,  3.48it/s]
                                                            
{'loss': 3.428, 'learning_rate': 7.380034045120558e-07, 'epoch': 4.66}

 29%|██▉       | 108280/371472 [8:36:37<21:01:33,  3.48it/s]
 29%|██▉       | 108281/371472 [8:36:37<20:16:23,  3.61it/s]
 29%|██▉       | 108282/371472 [8:36:37<22:20:26,  3.27it/s]
 29%|██▉       | 108283/371472 [8:36:38<22:18:14,  3.28it/s]
 29%|██▉       | 108284/371472 [8:36:38<21:17:55,  3.43it/s]
 29%|██▉       | 108285/371472 [8:36:38<22:56:14,  3.19it/s]
 29%|██▉       | 108286/371472 [8:36:39<22:57:05,  3.19it/s]
 29%|██▉       | 108287/371472 [8:36:39<22:28:55,  3.25it/s]
 29%|██▉       | 108288/371472 [8:36:39<21:07:24,  3.46it/s]
 29%|██▉       | 108289/371472 [8:36:39<20:34:45,  3.55it/s]
 29%|██▉       | 108290/371472 [8:36:40<22:53:59,  3.19it/s]
 29%|██▉       | 108291/371472 [8:36:40<23:22:46,  3.13it/s]
 29%|██▉       | 108292/371472 [8:36:40<22:45:21,  3.21it/s]
 29%|██▉       | 108293/371472 [8:36:41<22:35:53,  3.24it/s]
 29%|██▉       | 108294/371472 [8:36:41<22:43:54,  3.22it/s]
 29%|██▉       | 108295/371472 [8:36:41<21:37:22,  3.38it/s]
 29%|██▉       | 108296/371472 [8:36:42<22:22:19,  3.27it/s]
 29%|██▉       | 108297/371472 [8:36:42<22:07:59,  3.30it/s]
 29%|██▉       | 108298/371472 [8:36:42<22:40:08,  3.22it/s]
 29%|██▉       | 108299/371472 [8:36:43<22:12:28,  3.29it/s]
 29%|██▉       | 108300/371472 [8:36:43<21:32:00,  3.39it/s]
                                                            
{'loss': 3.5412, 'learning_rate': 7.379549225365769e-07, 'epoch': 4.66}

 29%|██▉       | 108300/371472 [8:36:43<21:32:00,  3.39it/s]
 29%|██▉       | 108301/371472 [8:36:43<21:21:46,  3.42it/s]
 29%|██▉       | 108302/371472 [8:36:43<21:46:52,  3.36it/s]
 29%|██▉       | 108303/371472 [8:36:44<21:21:46,  3.42it/s]
 29%|██▉       | 108304/371472 [8:36:44<20:53:40,  3.50it/s]
 29%|██▉       | 108305/371472 [8:36:44<20:07:39,  3.63it/s]
 29%|██▉       | 108306/371472 [8:36:45<20:30:56,  3.56it/s]
 29%|██▉       | 108307/371472 [8:36:45<20:46:41,  3.52it/s]
 29%|██▉       | 108308/371472 [8:36:45<20:29:52,  3.57it/s]
 29%|██▉       | 108309/371472 [8:36:45<22:06:18,  3.31it/s]
 29%|██▉       | 108310/371472 [8:36:46<20:43:14,  3.53it/s]
 29%|██▉       | 108311/371472 [8:36:46<20:10:19,  3.62it/s]
 29%|██▉       | 108312/371472 [8:36:46<20:12:23,  3.62it/s]
 29%|██▉       | 108313/371472 [8:36:46<19:43:08,  3.71it/s]
 29%|██▉       | 108314/371472 [8:36:47<19:59:57,  3.66it/s]
 29%|██▉       | 108315/371472 [8:36:47<20:27:23,  3.57it/s]
 29%|██▉       | 108316/371472 [8:36:47<20:08:50,  3.63it/s]
 29%|██▉       | 108317/371472 [8:36:48<20:43:08,  3.53it/s]
 29%|██▉       | 108318/371472 [8:36:48<20:16:13,  3.61it/s]
 29%|██▉       | 108319/371472 [8:36:48<20:13:00,  3.62it/s]
 29%|██▉       | 108320/371472 [8:36:48<20:57:07,  3.49it/s]
                                                            
{'loss': 3.4767, 'learning_rate': 7.379064405610979e-07, 'epoch': 4.67}

 29%|██▉       | 108320/371472 [8:36:48<20:57:07,  3.49it/s]
 29%|██▉       | 108321/371472 [8:36:49<19:53:21,  3.68it/s]
 29%|██▉       | 108322/371472 [8:36:49<20:06:47,  3.63it/s]
 29%|██▉       | 108323/371472 [8:36:49<19:54:52,  3.67it/s]
 29%|██▉       | 108324/371472 [8:36:50<21:23:31,  3.42it/s]
 29%|██▉       | 108325/371472 [8:36:50<20:53:48,  3.50it/s]
 29%|██▉       | 108326/371472 [8:36:50<20:33:19,  3.56it/s]
 29%|██▉       | 108327/371472 [8:36:50<21:10:01,  3.45it/s]
 29%|██▉       | 108328/371472 [8:36:51<22:28:10,  3.25it/s]
 29%|██▉       | 108329/371472 [8:36:51<21:54:04,  3.34it/s]
 29%|██▉       | 108330/371472 [8:36:51<21:10:17,  3.45it/s]
 29%|██▉       | 108331/371472 [8:36:52<22:16:37,  3.28it/s]
 29%|██▉       | 108332/371472 [8:36:52<21:33:02,  3.39it/s]
 29%|██▉       | 108333/371472 [8:36:52<20:55:52,  3.49it/s]
 29%|██▉       | 108334/371472 [8:36:52<20:48:37,  3.51it/s]
 29%|██▉       | 108335/371472 [8:36:53<22:13:40,  3.29it/s]
 29%|██▉       | 108336/371472 [8:36:53<20:50:23,  3.51it/s]
 29%|██▉       | 108337/371472 [8:36:53<21:38:11,  3.38it/s]
 29%|██▉       | 108338/371472 [8:36:54<21:26:23,  3.41it/s]
 29%|██▉       | 108339/371472 [8:36:54<20:59:17,  3.48it/s]
 29%|██▉       | 108340/371472 [8:36:54<20:06:42,  3.63it/s]
                                                            
{'loss': 3.317, 'learning_rate': 7.378579585856191e-07, 'epoch': 4.67}

 29%|██▉       | 108340/371472 [8:36:54<20:06:42,  3.63it/s]
 29%|██▉       | 108341/371472 [8:36:54<20:23:04,  3.59it/s]
 29%|██▉       | 108342/371472 [8:36:55<19:40:15,  3.72it/s]
 29%|██▉       | 108343/371472 [8:36:55<20:01:10,  3.65it/s]
 29%|██▉       | 108344/371472 [8:36:55<20:27:39,  3.57it/s]
 29%|██▉       | 108345/371472 [8:36:56<20:13:58,  3.61it/s]
 29%|██▉       | 108346/371472 [8:36:56<19:46:52,  3.69it/s]
 29%|██▉       | 108347/371472 [8:36:56<20:26:11,  3.58it/s]
 29%|██▉       | 108348/371472 [8:36:56<21:14:25,  3.44it/s]
 29%|██▉       | 108349/371472 [8:36:57<20:42:41,  3.53it/s]
 29%|██▉       | 108350/371472 [8:36:57<20:19:32,  3.60it/s]
 29%|██▉       | 108351/371472 [8:36:57<21:23:30,  3.42it/s]
 29%|██▉       | 108352/371472 [8:36:58<20:31:09,  3.56it/s]
 29%|██▉       | 108353/371472 [8:36:58<20:18:53,  3.60it/s]
 29%|██▉       | 108354/371472 [8:36:58<20:43:55,  3.53it/s]
 29%|██▉       | 108355/371472 [8:36:58<20:20:23,  3.59it/s]
 29%|██▉       | 108356/371472 [8:36:59<19:47:02,  3.69it/s]
 29%|██▉       | 108357/371472 [8:36:59<19:50:05,  3.68it/s]
 29%|██▉       | 108358/371472 [8:36:59<20:12:53,  3.62it/s]
 29%|██▉       | 108359/371472 [8:36:59<20:18:39,  3.60it/s]
 29%|██▉       | 108360/371472 [8:37:00<19:27:06,  3.76it/s]
                                                            
{'loss': 3.4289, 'learning_rate': 7.378094766101403e-07, 'epoch': 4.67}

 29%|██▉       | 108360/371472 [8:37:00<19:27:06,  3.76it/s]
 29%|██▉       | 108361/371472 [8:37:00<21:17:39,  3.43it/s]
 29%|██▉       | 108362/371472 [8:37:00<21:53:15,  3.34it/s]
 29%|██▉       | 108363/371472 [8:37:01<21:00:26,  3.48it/s]
 29%|██▉       | 108364/371472 [8:37:01<22:34:26,  3.24it/s]
 29%|██▉       | 108365/371472 [8:37:01<21:06:51,  3.46it/s]
 29%|██▉       | 108366/371472 [8:37:02<22:24:52,  3.26it/s]
 29%|██▉       | 108367/371472 [8:37:02<21:29:54,  3.40it/s]
 29%|██▉       | 108368/371472 [8:37:02<21:47:50,  3.35it/s]
 29%|██▉       | 108369/371472 [8:37:02<20:53:52,  3.50it/s]
 29%|██▉       | 108370/371472 [8:37:03<20:49:37,  3.51it/s]
 29%|██▉       | 108371/371472 [8:37:03<19:49:55,  3.69it/s]
 29%|██▉       | 108372/371472 [8:37:03<19:52:40,  3.68it/s]
 29%|██▉       | 108373/371472 [8:37:04<19:53:27,  3.67it/s]
 29%|██▉       | 108374/371472 [8:37:04<19:57:37,  3.66it/s]
 29%|██▉       | 108375/371472 [8:37:04<19:10:34,  3.81it/s]
 29%|██▉       | 108376/371472 [8:37:04<18:43:33,  3.90it/s]
 29%|██▉       | 108377/371472 [8:37:05<19:17:48,  3.79it/s]
 29%|██▉       | 108378/371472 [8:37:05<19:16:40,  3.79it/s]
 29%|██▉       | 108379/371472 [8:37:05<19:23:14,  3.77it/s]
 29%|██▉       | 108380/371472 [8:37:05<18:49:23,  3.88it/s]
                                                            
{'loss': 3.5949, 'learning_rate': 7.377609946346614e-07, 'epoch': 4.67}

 29%|██▉       | 108380/371472 [8:37:05<18:49:23,  3.88it/s]
 29%|██▉       | 108381/371472 [8:37:06<18:44:55,  3.90it/s]
 29%|██▉       | 108382/371472 [8:37:06<18:49:29,  3.88it/s]
 29%|██▉       | 108383/371472 [8:37:06<19:12:45,  3.80it/s]
 29%|██▉       | 108384/371472 [8:37:06<19:44:28,  3.70it/s]
 29%|██▉       | 108385/371472 [8:37:07<19:02:42,  3.84it/s]
 29%|██▉       | 108386/371472 [8:37:07<19:02:44,  3.84it/s]
 29%|██▉       | 108387/371472 [8:37:07<19:06:17,  3.83it/s]
 29%|██▉       | 108388/371472 [8:37:07<19:14:16,  3.80it/s]
 29%|██▉       | 108389/371472 [8:37:08<19:42:50,  3.71it/s]
 29%|██▉       | 108390/371472 [8:37:08<20:26:33,  3.57it/s]
 29%|██▉       | 108391/371472 [8:37:08<20:08:06,  3.63it/s]
 29%|██▉       | 108392/371472 [8:37:09<19:36:47,  3.73it/s]
 29%|██▉       | 108393/371472 [8:37:09<20:24:21,  3.58it/s]
 29%|██▉       | 108394/371472 [8:37:09<20:31:34,  3.56it/s]
 29%|██▉       | 108395/371472 [8:37:09<20:42:39,  3.53it/s]
 29%|██▉       | 108396/371472 [8:37:10<20:45:16,  3.52it/s]
 29%|██▉       | 108397/371472 [8:37:10<20:32:04,  3.56it/s]
 29%|██▉       | 108398/371472 [8:37:10<20:37:45,  3.54it/s]
 29%|██▉       | 108399/371472 [8:37:11<22:35:47,  3.23it/s]
 29%|██▉       | 108400/371472 [8:37:11<22:02:22,  3.32it/s]
                                                            
{'loss': 3.3951, 'learning_rate': 7.377125126591824e-07, 'epoch': 4.67}

 29%|██▉       | 108400/371472 [8:37:11<22:02:22,  3.32it/s]
 29%|██▉       | 108401/371472 [8:37:11<21:10:25,  3.45it/s]
 29%|██▉       | 108402/371472 [8:37:12<22:27:56,  3.25it/s]
 29%|██▉       | 108403/371472 [8:37:12<22:03:40,  3.31it/s]
 29%|██▉       | 108404/371472 [8:37:12<21:56:39,  3.33it/s]
 29%|██▉       | 108405/371472 [8:37:12<20:54:00,  3.50it/s]
 29%|██▉       | 108406/371472 [8:37:13<20:23:42,  3.58it/s]
 29%|██▉       | 108407/371472 [8:37:13<22:29:00,  3.25it/s]
 29%|██▉       | 108408/371472 [8:37:13<21:01:59,  3.47it/s]
 29%|██▉       | 108409/371472 [8:37:14<21:01:31,  3.48it/s]
 29%|██▉       | 108410/371472 [8:37:14<21:08:23,  3.46it/s]
 29%|██▉       | 108411/371472 [8:37:14<21:02:04,  3.47it/s]
 29%|██▉       | 108412/371472 [8:37:14<21:33:07,  3.39it/s]
 29%|██▉       | 108413/371472 [8:37:15<20:40:32,  3.53it/s]
 29%|██▉       | 108414/371472 [8:37:15<20:41:12,  3.53it/s]
 29%|██▉       | 108415/371472 [8:37:15<20:03:37,  3.64it/s]
 29%|██▉       | 108416/371472 [8:37:15<19:53:15,  3.67it/s]
 29%|██▉       | 108417/371472 [8:37:16<19:50:17,  3.68it/s]
 29%|██▉       | 108418/371472 [8:37:16<19:30:14,  3.75it/s]
 29%|██▉       | 108419/371472 [8:37:16<19:17:08,  3.79it/s]
 29%|██▉       | 108420/371472 [8:37:17<20:53:19,  3.50it/s]
                                                            
{'loss': 3.2444, 'learning_rate': 7.376640306837035e-07, 'epoch': 4.67}

 29%|██▉       | 108420/371472 [8:37:17<20:53:19,  3.50it/s]
 29%|██▉       | 108421/371472 [8:37:17<20:53:01,  3.50it/s]
 29%|██▉       | 108422/371472 [8:37:17<22:02:22,  3.32it/s]
 29%|██▉       | 108423/371472 [8:37:17<21:16:49,  3.43it/s]
 29%|██▉       | 108424/371472 [8:37:18<21:25:11,  3.41it/s]
 29%|██▉       | 108425/371472 [8:37:18<21:10:13,  3.45it/s]
 29%|██▉       | 108426/371472 [8:37:18<21:01:21,  3.48it/s]
 29%|██▉       | 108427/371472 [8:37:19<21:37:04,  3.38it/s]
 29%|██▉       | 108428/371472 [8:37:19<21:31:40,  3.39it/s]
 29%|██▉       | 108429/371472 [8:37:19<20:56:32,  3.49it/s]
 29%|██▉       | 108430/371472 [8:37:19<20:30:23,  3.56it/s]
 29%|██▉       | 108431/371472 [8:37:20<21:11:02,  3.45it/s]
 29%|██▉       | 108432/371472 [8:37:20<20:46:57,  3.52it/s]
 29%|██▉       | 108433/371472 [8:37:20<22:44:41,  3.21it/s]
 29%|██▉       | 108434/371472 [8:37:21<21:59:33,  3.32it/s]
 29%|██▉       | 108435/371472 [8:37:21<20:58:29,  3.48it/s]
 29%|██▉       | 108436/371472 [8:37:21<21:54:32,  3.33it/s]
 29%|██▉       | 108437/371472 [8:37:22<21:08:24,  3.46it/s]
 29%|██▉       | 108438/371472 [8:37:22<21:41:11,  3.37it/s]
 29%|██▉       | 108439/371472 [8:37:22<21:41:51,  3.37it/s]
 29%|██▉       | 108440/371472 [8:37:22<20:52:58,  3.50it/s]
                                                            
{'loss': 3.4278, 'learning_rate': 7.376155487082247e-07, 'epoch': 4.67}

 29%|██▉       | 108440/371472 [8:37:22<20:52:58,  3.50it/s]
 29%|██▉       | 108441/371472 [8:37:23<20:56:09,  3.49it/s]
 29%|██▉       | 108442/371472 [8:37:23<23:07:54,  3.16it/s]
 29%|██▉       | 108443/371472 [8:37:23<22:10:12,  3.30it/s]
 29%|██▉       | 108444/371472 [8:37:24<21:30:26,  3.40it/s]
 29%|██▉       | 108445/371472 [8:37:24<21:14:21,  3.44it/s]
 29%|██▉       | 108446/371472 [8:37:24<21:11:25,  3.45it/s]
 29%|██▉       | 108447/371472 [8:37:25<21:13:34,  3.44it/s]
 29%|██▉       | 108448/371472 [8:37:25<21:04:01,  3.47it/s]
 29%|██▉       | 108449/371472 [8:37:25<21:50:18,  3.35it/s]
 29%|██▉       | 108450/371472 [8:37:25<21:10:50,  3.45it/s]
 29%|██▉       | 108451/371472 [8:37:26<20:19:38,  3.59it/s]
 29%|██▉       | 108452/371472 [8:37:26<20:14:49,  3.61it/s]
 29%|██▉       | 108453/371472 [8:37:26<21:09:56,  3.45it/s]
 29%|██▉       | 108454/371472 [8:37:27<20:46:28,  3.52it/s]
 29%|██▉       | 108455/371472 [8:37:27<21:45:02,  3.36it/s]
 29%|██▉       | 108456/371472 [8:37:27<20:28:11,  3.57it/s]
 29%|██▉       | 108457/371472 [8:37:27<20:30:20,  3.56it/s]
 29%|██▉       | 108458/371472 [8:37:28<20:49:11,  3.51it/s]
 29%|██▉       | 108459/371472 [8:37:28<21:28:09,  3.40it/s]
 29%|██▉       | 108460/371472 [8:37:28<21:33:07,  3.39it/s]
                                                            
{'loss': 3.3376, 'learning_rate': 7.375670667327458e-07, 'epoch': 4.67}

 29%|██▉       | 108460/371472 [8:37:28<21:33:07,  3.39it/s]
 29%|██▉       | 108461/371472 [8:37:29<21:02:54,  3.47it/s]
 29%|██▉       | 108462/371472 [8:37:29<20:11:31,  3.62it/s]
 29%|██▉       | 108463/371472 [8:37:29<20:12:39,  3.61it/s]
 29%|██▉       | 108464/371472 [8:37:29<20:02:36,  3.64it/s]
 29%|██▉       | 108465/371472 [8:37:30<20:53:55,  3.50it/s]
 29%|██▉       | 108466/371472 [8:37:30<20:31:28,  3.56it/s]
 29%|██▉       | 108467/371472 [8:37:30<22:11:17,  3.29it/s]
 29%|██▉       | 108468/371472 [8:37:31<21:52:55,  3.34it/s]
 29%|██▉       | 108469/371472 [8:37:31<21:40:11,  3.37it/s]
 29%|██▉       | 108470/371472 [8:37:31<23:28:14,  3.11it/s]
 29%|██▉       | 108471/371472 [8:37:31<22:03:18,  3.31it/s]
 29%|██▉       | 108472/371472 [8:37:32<21:25:41,  3.41it/s]
 29%|██▉       | 108473/371472 [8:37:32<21:34:46,  3.39it/s]
 29%|██▉       | 108474/371472 [8:37:32<21:47:27,  3.35it/s]
 29%|██▉       | 108475/371472 [8:37:33<21:52:26,  3.34it/s]
 29%|██▉       | 108476/371472 [8:37:33<21:42:09,  3.37it/s]
 29%|██▉       | 108477/371472 [8:37:33<20:43:55,  3.52it/s]
 29%|██▉       | 108478/371472 [8:37:33<20:33:31,  3.55it/s]
 29%|██▉       | 108479/371472 [8:37:34<19:34:19,  3.73it/s]
 29%|██▉       | 108480/371472 [8:37:34<19:19:47,  3.78it/s]
                                                            
{'loss': 3.3744, 'learning_rate': 7.375185847572668e-07, 'epoch': 4.67}

 29%|██▉       | 108480/371472 [8:37:34<19:19:47,  3.78it/s]
 29%|██▉       | 108481/371472 [8:37:34<19:47:12,  3.69it/s]
 29%|██▉       | 108482/371472 [8:37:35<19:27:47,  3.75it/s]
 29%|██▉       | 108483/371472 [8:37:35<19:54:24,  3.67it/s]
 29%|██▉       | 108484/371472 [8:37:35<19:53:13,  3.67it/s]
 29%|██▉       | 108485/371472 [8:37:35<20:15:24,  3.61it/s]
 29%|██▉       | 108486/371472 [8:37:36<20:52:05,  3.50it/s]
 29%|██▉       | 108487/371472 [8:37:36<23:19:28,  3.13it/s]
 29%|██▉       | 108488/371472 [8:37:36<22:33:13,  3.24it/s]
 29%|██▉       | 108489/371472 [8:37:37<21:55:42,  3.33it/s]
 29%|██▉       | 108490/371472 [8:37:37<20:48:29,  3.51it/s]
 29%|██▉       | 108491/371472 [8:37:37<20:45:39,  3.52it/s]
 29%|██▉       | 108492/371472 [8:37:37<20:03:23,  3.64it/s]
 29%|██▉       | 108493/371472 [8:37:38<20:47:22,  3.51it/s]
 29%|██▉       | 108494/371472 [8:37:38<20:13:20,  3.61it/s]
 29%|██▉       | 108495/371472 [8:37:38<20:17:25,  3.60it/s]
 29%|██▉       | 108496/371472 [8:37:39<19:36:03,  3.73it/s]
 29%|██▉       | 108497/371472 [8:37:39<19:22:49,  3.77it/s]
 29%|██▉       | 108498/371472 [8:37:39<20:12:42,  3.61it/s]
 29%|██▉       | 108499/371472 [8:37:39<20:45:56,  3.52it/s]
 29%|██▉       | 108500/371472 [8:37:40<20:17:11,  3.60it/s]
                                                            
{'loss': 3.5111, 'learning_rate': 7.37470102781788e-07, 'epoch': 4.67}

 29%|██▉       | 108500/371472 [8:37:40<20:17:11,  3.60it/s]
 29%|██▉       | 108501/371472 [8:37:40<21:34:28,  3.39it/s]
 29%|██▉       | 108502/371472 [8:37:40<21:23:55,  3.41it/s]
 29%|██▉       | 108503/371472 [8:37:41<21:09:35,  3.45it/s]
 29%|██▉       | 108504/371472 [8:37:41<21:57:22,  3.33it/s]
 29%|██▉       | 108505/371472 [8:37:41<22:51:36,  3.20it/s]
 29%|██▉       | 108506/371472 [8:37:41<21:15:52,  3.44it/s]
 29%|██▉       | 108507/371472 [8:37:42<20:42:47,  3.53it/s]
 29%|██▉       | 108508/371472 [8:37:42<21:13:23,  3.44it/s]
 29%|██▉       | 108509/371472 [8:37:42<21:36:34,  3.38it/s]
 29%|██▉       | 108510/371472 [8:37:43<21:28:43,  3.40it/s]
 29%|██▉       | 108511/371472 [8:37:43<21:26:37,  3.41it/s]
 29%|██▉       | 108512/371472 [8:37:43<21:21:07,  3.42it/s]
 29%|██▉       | 108513/371472 [8:37:44<23:07:58,  3.16it/s]
 29%|██▉       | 108514/371472 [8:37:44<21:16:22,  3.43it/s]
 29%|██▉       | 108515/371472 [8:37:44<20:54:23,  3.49it/s]
 29%|██▉       | 108516/371472 [8:37:44<20:14:21,  3.61it/s]
 29%|██▉       | 108517/371472 [8:37:45<19:20:38,  3.78it/s]
 29%|██▉       | 108518/371472 [8:37:45<20:06:45,  3.63it/s]
 29%|██▉       | 108519/371472 [8:37:45<19:49:36,  3.68it/s]
 29%|██▉       | 108520/371472 [8:37:45<19:31:32,  3.74it/s]
                                                            
{'loss': 3.6147, 'learning_rate': 7.374216208063092e-07, 'epoch': 4.67}

 29%|██▉       | 108520/371472 [8:37:45<19:31:32,  3.74it/s]
 29%|██▉       | 108521/371472 [8:37:46<19:38:41,  3.72it/s]
 29%|██▉       | 108522/371472 [8:37:46<19:55:57,  3.66it/s]
 29%|██▉       | 108523/371472 [8:37:46<20:21:50,  3.59it/s]
 29%|██▉       | 108524/371472 [8:37:47<20:03:06,  3.64it/s]
 29%|██▉       | 108525/371472 [8:37:47<19:41:01,  3.71it/s]
 29%|██▉       | 108526/371472 [8:37:47<19:57:47,  3.66it/s]
 29%|██▉       | 108527/371472 [8:37:47<20:54:38,  3.49it/s]
 29%|██▉       | 108528/371472 [8:37:48<20:17:04,  3.60it/s]
 29%|██▉       | 108529/371472 [8:37:48<21:02:00,  3.47it/s]
 29%|██▉       | 108530/371472 [8:37:48<20:59:56,  3.48it/s]
 29%|██▉       | 108531/371472 [8:37:49<21:20:37,  3.42it/s]
 29%|██▉       | 108532/371472 [8:37:49<20:54:17,  3.49it/s]
 29%|██▉       | 108533/371472 [8:37:49<20:28:34,  3.57it/s]
 29%|██▉       | 108534/371472 [8:37:49<20:25:37,  3.58it/s]
 29%|██▉       | 108535/371472 [8:37:50<19:55:02,  3.67it/s]
 29%|██▉       | 108536/371472 [8:37:50<21:24:43,  3.41it/s]
 29%|██▉       | 108537/371472 [8:37:50<21:11:22,  3.45it/s]
 29%|██▉       | 108538/371472 [8:37:50<20:23:43,  3.58it/s]
 29%|██▉       | 108539/371472 [8:37:51<21:11:51,  3.45it/s]
 29%|██▉       | 108540/371472 [8:37:51<20:04:41,  3.64it/s]
                                                            
{'loss': 3.454, 'learning_rate': 7.373731388308302e-07, 'epoch': 4.68}

 29%|██▉       | 108540/371472 [8:37:51<20:04:41,  3.64it/s]
 29%|██▉       | 108541/371472 [8:37:51<20:04:01,  3.64it/s]
 29%|██▉       | 108542/371472 [8:37:52<20:29:46,  3.56it/s]
 29%|██▉       | 108543/371472 [8:37:52<20:31:55,  3.56it/s]
 29%|██▉       | 108544/371472 [8:37:52<20:54:54,  3.49it/s]
 29%|██▉       | 108545/371472 [8:37:52<20:14:18,  3.61it/s]
 29%|██▉       | 108546/371472 [8:37:53<20:19:48,  3.59it/s]
 29%|██▉       | 108547/371472 [8:37:53<19:35:46,  3.73it/s]
 29%|██▉       | 108548/371472 [8:37:53<21:16:48,  3.43it/s]
 29%|██▉       | 108549/371472 [8:37:54<20:45:07,  3.52it/s]
 29%|██▉       | 108550/371472 [8:37:54<21:18:36,  3.43it/s]
 29%|██▉       | 108551/371472 [8:37:54<21:35:12,  3.38it/s]
 29%|██▉       | 108552/371472 [8:37:55<22:23:51,  3.26it/s]
 29%|██▉       | 108553/371472 [8:37:55<21:19:32,  3.42it/s]
 29%|██▉       | 108554/371472 [8:37:55<20:37:05,  3.54it/s]
 29%|██▉       | 108555/371472 [8:37:55<20:02:04,  3.65it/s]
 29%|██▉       | 108556/371472 [8:37:56<20:20:47,  3.59it/s]
 29%|██▉       | 108557/371472 [8:37:56<20:20:25,  3.59it/s]
 29%|██▉       | 108558/371472 [8:37:56<20:17:06,  3.60it/s]
 29%|██▉       | 108559/371472 [8:37:56<21:35:01,  3.38it/s]
 29%|██▉       | 108560/371472 [8:37:57<20:29:15,  3.56it/s]
                                                            
{'loss': 3.3569, 'learning_rate': 7.373246568553513e-07, 'epoch': 4.68}

 29%|██▉       | 108560/371472 [8:37:57<20:29:15,  3.56it/s]
 29%|██▉       | 108561/371472 [8:37:57<21:06:43,  3.46it/s]
 29%|██▉       | 108562/371472 [8:37:57<20:37:09,  3.54it/s]
 29%|██▉       | 108563/371472 [8:37:58<20:25:31,  3.58it/s]
 29%|██▉       | 108564/371472 [8:37:58<20:41:17,  3.53it/s]
 29%|██▉       | 108565/371472 [8:37:58<20:42:19,  3.53it/s]
 29%|██▉       | 108566/371472 [8:37:58<20:08:45,  3.63it/s]
 29%|██▉       | 108567/371472 [8:37:59<19:40:45,  3.71it/s]
 29%|██▉       | 108568/371472 [8:37:59<20:38:24,  3.54it/s]
 29%|██▉       | 108569/371472 [8:37:59<19:43:27,  3.70it/s]
 29%|██▉       | 108570/371472 [8:37:59<19:30:37,  3.74it/s]
 29%|██▉       | 108571/371472 [8:38:00<19:39:13,  3.72it/s]
 29%|██▉       | 108572/371472 [8:38:00<19:46:09,  3.69it/s]
 29%|██▉       | 108573/371472 [8:38:00<19:37:34,  3.72it/s]
 29%|██▉       | 108574/371472 [8:38:01<20:18:11,  3.60it/s]
 29%|██▉       | 108575/371472 [8:38:01<20:58:50,  3.48it/s]
 29%|██▉       | 108576/371472 [8:38:01<20:10:40,  3.62it/s]
 29%|██▉       | 108577/371472 [8:38:01<20:40:05,  3.53it/s]
 29%|██▉       | 108578/371472 [8:38:02<20:09:52,  3.62it/s]
 29%|██▉       | 108579/371472 [8:38:02<19:40:11,  3.71it/s]
 29%|██▉       | 108580/371472 [8:38:02<19:28:09,  3.75it/s]
                                                            
{'loss': 3.5428, 'learning_rate': 7.372761748798724e-07, 'epoch': 4.68}

 29%|██▉       | 108580/371472 [8:38:02<19:28:09,  3.75it/s]
 29%|██▉       | 108581/371472 [8:38:03<20:07:37,  3.63it/s]
 29%|██▉       | 108582/371472 [8:38:03<21:12:52,  3.44it/s]
 29%|██▉       | 108583/371472 [8:38:03<20:33:05,  3.55it/s]
 29%|██▉       | 108584/371472 [8:38:03<21:23:40,  3.41it/s]
 29%|██▉       | 108585/371472 [8:38:04<20:52:42,  3.50it/s]
 29%|██▉       | 108586/371472 [8:38:04<21:04:56,  3.46it/s]
 29%|██▉       | 108587/371472 [8:38:04<20:52:03,  3.50it/s]
 29%|██▉       | 108588/371472 [8:38:05<20:30:28,  3.56it/s]
 29%|██▉       | 108589/371472 [8:38:05<20:12:46,  3.61it/s]
 29%|██▉       | 108590/371472 [8:38:05<19:45:28,  3.70it/s]
 29%|██▉       | 108591/371472 [8:38:05<20:25:15,  3.58it/s]
 29%|██▉       | 108592/371472 [8:38:06<20:18:45,  3.59it/s]
 29%|██▉       | 108593/371472 [8:38:06<20:00:44,  3.65it/s]
 29%|██▉       | 108594/371472 [8:38:06<19:47:29,  3.69it/s]
 29%|██▉       | 108595/371472 [8:38:06<19:22:39,  3.77it/s]
 29%|██▉       | 108596/371472 [8:38:07<19:21:32,  3.77it/s]
 29%|██▉       | 108597/371472 [8:38:07<20:18:58,  3.59it/s]
 29%|██▉       | 108598/371472 [8:38:07<20:32:42,  3.55it/s]
 29%|██▉       | 108599/371472 [8:38:08<21:02:59,  3.47it/s]
 29%|██▉       | 108600/371472 [8:38:08<20:43:55,  3.52it/s]
                                                            
{'loss': 3.4574, 'learning_rate': 7.372276929043936e-07, 'epoch': 4.68}

 29%|██▉       | 108600/371472 [8:38:08<20:43:55,  3.52it/s]
 29%|██▉       | 108601/371472 [8:38:08<20:09:42,  3.62it/s]
 29%|██▉       | 108602/371472 [8:38:08<20:36:11,  3.54it/s]
 29%|██▉       | 108603/371472 [8:38:09<21:18:19,  3.43it/s]
 29%|██▉       | 108604/371472 [8:38:09<20:00:30,  3.65it/s]
 29%|██▉       | 108605/371472 [8:38:09<20:46:30,  3.51it/s]
 29%|██▉       | 108606/371472 [8:38:10<21:05:58,  3.46it/s]
 29%|██▉       | 108607/371472 [8:38:10<20:26:53,  3.57it/s]
 29%|██▉       | 108608/371472 [8:38:10<19:59:45,  3.65it/s]
 29%|██▉       | 108609/371472 [8:38:10<21:35:54,  3.38it/s]
 29%|██▉       | 108610/371472 [8:38:11<20:25:45,  3.57it/s]
 29%|██▉       | 108611/371472 [8:38:11<20:33:36,  3.55it/s]
 29%|██▉       | 108612/371472 [8:38:11<20:26:23,  3.57it/s]
 29%|██▉       | 108613/371472 [8:38:12<20:39:05,  3.54it/s]
 29%|██▉       | 108614/371472 [8:38:12<21:04:47,  3.46it/s]
 29%|██▉       | 108615/371472 [8:38:12<20:05:00,  3.64it/s]
 29%|██▉       | 108616/371472 [8:38:12<20:33:12,  3.55it/s]
 29%|██▉       | 108617/371472 [8:38:13<20:14:28,  3.61it/s]
 29%|██▉       | 108618/371472 [8:38:13<20:12:57,  3.61it/s]
 29%|██▉       | 108619/371472 [8:38:13<20:00:12,  3.65it/s]
 29%|██▉       | 108620/371472 [8:38:13<20:37:38,  3.54it/s]
                                                            
{'loss': 3.4242, 'learning_rate': 7.371792109289146e-07, 'epoch': 4.68}

 29%|██▉       | 108620/371472 [8:38:13<20:37:38,  3.54it/s]
 29%|██▉       | 108621/371472 [8:38:14<20:15:46,  3.60it/s]
 29%|██▉       | 108622/371472 [8:38:14<22:21:42,  3.27it/s]
 29%|██▉       | 108623/371472 [8:38:14<21:20:14,  3.42it/s]
 29%|██▉       | 108624/371472 [8:38:15<20:36:54,  3.54it/s]
 29%|██▉       | 108625/371472 [8:38:15<20:48:27,  3.51it/s]
 29%|██▉       | 108626/371472 [8:38:15<19:56:13,  3.66it/s]
 29%|██▉       | 108627/371472 [8:38:15<19:34:18,  3.73it/s]
 29%|██▉       | 108628/371472 [8:38:16<20:58:31,  3.48it/s]
 29%|██▉       | 108629/371472 [8:38:16<20:30:00,  3.56it/s]
 29%|██▉       | 108630/371472 [8:38:16<19:43:09,  3.70it/s]
 29%|██▉       | 108631/371472 [8:38:17<22:37:28,  3.23it/s]
 29%|██▉       | 108632/371472 [8:38:17<21:51:10,  3.34it/s]
 29%|██▉       | 108633/371472 [8:38:17<20:57:08,  3.48it/s]
 29%|██▉       | 108634/371472 [8:38:18<22:12:36,  3.29it/s]
 29%|██▉       | 108635/371472 [8:38:18<22:08:30,  3.30it/s]
 29%|██▉       | 108636/371472 [8:38:18<22:11:10,  3.29it/s]
 29%|██▉       | 108637/371472 [8:38:18<21:46:02,  3.35it/s]
 29%|██▉       | 108638/371472 [8:38:19<20:47:29,  3.51it/s]
 29%|██▉       | 108639/371472 [8:38:19<20:36:24,  3.54it/s]
 29%|██▉       | 108640/371472 [8:38:19<20:57:35,  3.48it/s]
                                                            
{'loss': 3.2827, 'learning_rate': 7.371307289534357e-07, 'epoch': 4.68}

 29%|██▉       | 108640/371472 [8:38:19<20:57:35,  3.48it/s]
 29%|██▉       | 108641/371472 [8:38:20<19:56:47,  3.66it/s]
 29%|██▉       | 108642/371472 [8:38:20<20:28:39,  3.57it/s]
 29%|██▉       | 108643/371472 [8:38:20<20:45:14,  3.52it/s]
 29%|██▉       | 108644/371472 [8:38:20<21:16:46,  3.43it/s]
 29%|██▉       | 108645/371472 [8:38:21<20:31:52,  3.56it/s]
 29%|██▉       | 108646/371472 [8:38:21<20:47:03,  3.51it/s]
 29%|██▉       | 108647/371472 [8:38:21<21:25:59,  3.41it/s]
 29%|██▉       | 108648/371472 [8:38:22<21:42:14,  3.36it/s]
 29%|██▉       | 108649/371472 [8:38:22<21:09:03,  3.45it/s]
 29%|██▉       | 108650/371472 [8:38:22<20:55:13,  3.49it/s]
 29%|██▉       | 108651/371472 [8:38:22<20:19:48,  3.59it/s]
 29%|██▉       | 108652/371472 [8:38:23<20:26:46,  3.57it/s]
 29%|██▉       | 108653/371472 [8:38:23<20:01:55,  3.64it/s]
 29%|██▉       | 108654/371472 [8:38:23<20:03:57,  3.64it/s]
 29%|██▉       | 108655/371472 [8:38:23<20:00:46,  3.65it/s]
 29%|██▉       | 108656/371472 [8:38:24<19:26:44,  3.75it/s]
 29%|██▉       | 108657/371472 [8:38:24<20:15:18,  3.60it/s]
 29%|██▉       | 108658/371472 [8:38:24<20:34:07,  3.55it/s]
 29%|██▉       | 108659/371472 [8:38:25<19:51:03,  3.68it/s]
 29%|██▉       | 108660/371472 [8:38:25<20:31:11,  3.56it/s]
                                                            
{'loss': 3.209, 'learning_rate': 7.370822469779568e-07, 'epoch': 4.68}

 29%|██▉       | 108660/371472 [8:38:25<20:31:11,  3.56it/s]
 29%|██▉       | 108661/371472 [8:38:25<20:44:39,  3.52it/s]
 29%|██▉       | 108662/371472 [8:38:26<21:38:40,  3.37it/s]
 29%|██▉       | 108663/371472 [8:38:26<21:30:49,  3.39it/s]
 29%|██▉       | 108664/371472 [8:38:26<20:51:34,  3.50it/s]
 29%|██▉       | 108665/371472 [8:38:26<20:38:19,  3.54it/s]
 29%|██▉       | 108666/371472 [8:38:27<20:20:20,  3.59it/s]
 29%|██▉       | 108667/371472 [8:38:27<20:25:30,  3.57it/s]
 29%|██▉       | 108668/371472 [8:38:27<21:05:42,  3.46it/s]
 29%|██▉       | 108669/371472 [8:38:27<19:52:21,  3.67it/s]
 29%|██▉       | 108670/371472 [8:38:28<20:02:23,  3.64it/s]
 29%|██▉       | 108671/371472 [8:38:28<19:37:27,  3.72it/s]
 29%|██▉       | 108672/371472 [8:38:28<20:46:08,  3.51it/s]
 29%|██▉       | 108673/371472 [8:38:29<20:05:01,  3.63it/s]
 29%|██▉       | 108674/371472 [8:38:29<19:51:49,  3.67it/s]
 29%|██▉       | 108675/371472 [8:38:29<20:18:34,  3.59it/s]
 29%|██▉       | 108676/371472 [8:38:29<19:55:57,  3.66it/s]
 29%|██▉       | 108677/371472 [8:38:30<20:12:46,  3.61it/s]
 29%|██▉       | 108678/371472 [8:38:30<19:40:46,  3.71it/s]
 29%|██▉       | 108679/371472 [8:38:30<22:35:35,  3.23it/s]
 29%|██▉       | 108680/371472 [8:38:31<21:56:31,  3.33it/s]
                                                            
{'loss': 3.3644, 'learning_rate': 7.37033765002478e-07, 'epoch': 4.68}

 29%|██▉       | 108680/371472 [8:38:31<21:56:31,  3.33it/s]
 29%|██▉       | 108681/371472 [8:38:31<23:00:57,  3.17it/s]
 29%|██▉       | 108682/371472 [8:38:31<22:30:12,  3.24it/s]
 29%|██▉       | 108683/371472 [8:38:32<22:16:33,  3.28it/s]
 29%|██▉       | 108684/371472 [8:38:32<21:31:32,  3.39it/s]
 29%|██▉       | 108685/371472 [8:38:32<21:01:05,  3.47it/s]
 29%|██▉       | 108686/371472 [8:38:32<21:08:57,  3.45it/s]
 29%|██▉       | 108687/371472 [8:38:33<20:34:01,  3.55it/s]
 29%|██▉       | 108688/371472 [8:38:33<19:47:15,  3.69it/s]
 29%|██▉       | 108689/371472 [8:38:33<19:40:47,  3.71it/s]
 29%|██▉       | 108690/371472 [8:38:33<20:12:23,  3.61it/s]
 29%|██▉       | 108691/371472 [8:38:34<20:05:32,  3.63it/s]
 29%|██▉       | 108692/371472 [8:38:34<20:29:32,  3.56it/s]
 29%|██▉       | 108693/371472 [8:38:34<23:30:30,  3.11it/s]
 29%|██▉       | 108694/371472 [8:38:35<23:55:24,  3.05it/s]
 29%|██▉       | 108695/371472 [8:38:35<23:49:24,  3.06it/s]
 29%|██▉       | 108696/371472 [8:38:35<22:20:01,  3.27it/s]
 29%|██▉       | 108697/371472 [8:38:36<21:46:05,  3.35it/s]
 29%|██▉       | 108698/371472 [8:38:36<21:52:14,  3.34it/s]
 29%|██▉       | 108699/371472 [8:38:36<22:43:11,  3.21it/s]
 29%|██▉       | 108700/371472 [8:38:37<21:36:32,  3.38it/s]
                                                            
{'loss': 3.4966, 'learning_rate': 7.36985283026999e-07, 'epoch': 4.68}

 29%|██▉       | 108700/371472 [8:38:37<21:36:32,  3.38it/s]
 29%|██▉       | 108701/371472 [8:38:37<21:53:05,  3.34it/s]
 29%|██▉       | 108702/371472 [8:38:37<21:55:17,  3.33it/s]
 29%|██▉       | 108703/371472 [8:38:37<21:07:38,  3.45it/s]
 29%|██▉       | 108704/371472 [8:38:38<20:34:52,  3.55it/s]
 29%|██▉       | 108705/371472 [8:38:38<20:36:01,  3.54it/s]
 29%|██▉       | 108706/371472 [8:38:38<20:25:14,  3.57it/s]
 29%|██▉       | 108707/371472 [8:38:39<20:58:32,  3.48it/s]
 29%|██▉       | 108708/371472 [8:38:39<20:24:00,  3.58it/s]
 29%|██▉       | 108709/371472 [8:38:39<21:37:34,  3.38it/s]
 29%|██▉       | 108710/371472 [8:38:39<21:04:07,  3.46it/s]
 29%|██▉       | 108711/371472 [8:38:40<20:51:04,  3.50it/s]
 29%|██▉       | 108712/371472 [8:38:40<21:03:54,  3.46it/s]
 29%|██▉       | 108713/371472 [8:38:40<20:19:35,  3.59it/s]
 29%|██▉       | 108714/371472 [8:38:40<19:24:04,  3.76it/s]
 29%|██▉       | 108715/371472 [8:38:41<20:16:56,  3.60it/s]
 29%|██▉       | 108716/371472 [8:38:41<20:17:56,  3.60it/s]
 29%|██▉       | 108717/371472 [8:38:41<19:51:29,  3.68it/s]
 29%|██▉       | 108718/371472 [8:38:42<20:02:00,  3.64it/s]
 29%|██▉       | 108719/371472 [8:38:42<21:52:35,  3.34it/s]
 29%|██▉       | 108720/371472 [8:38:42<21:59:57,  3.32it/s]
                                                            
{'loss': 3.1675, 'learning_rate': 7.369368010515201e-07, 'epoch': 4.68}

 29%|██▉       | 108720/371472 [8:38:42<21:59:57,  3.32it/s]
 29%|██▉       | 108721/371472 [8:38:43<22:38:00,  3.22it/s]
 29%|██▉       | 108722/371472 [8:38:43<21:51:03,  3.34it/s]
 29%|██▉       | 108723/371472 [8:38:43<21:00:48,  3.47it/s]
 29%|██▉       | 108724/371472 [8:38:43<20:17:44,  3.60it/s]
 29%|██▉       | 108725/371472 [8:38:44<19:43:38,  3.70it/s]
 29%|██▉       | 108726/371472 [8:38:44<20:23:08,  3.58it/s]
 29%|██▉       | 108727/371472 [8:38:44<19:44:39,  3.70it/s]
 29%|██▉       | 108728/371472 [8:38:44<20:00:37,  3.65it/s]
 29%|██▉       | 108729/371472 [8:38:45<19:38:06,  3.72it/s]
 29%|██▉       | 108730/371472 [8:38:45<21:00:39,  3.47it/s]
 29%|██▉       | 108731/371472 [8:38:45<21:07:37,  3.45it/s]
 29%|██▉       | 108732/371472 [8:38:46<21:41:46,  3.36it/s]
 29%|██▉       | 108733/371472 [8:38:46<21:41:24,  3.36it/s]
 29%|██▉       | 108734/371472 [8:38:46<21:09:22,  3.45it/s]
 29%|██▉       | 108735/371472 [8:38:46<20:41:25,  3.53it/s]
 29%|██▉       | 108736/371472 [8:38:47<20:14:15,  3.61it/s]
 29%|██▉       | 108737/371472 [8:38:47<20:26:48,  3.57it/s]
 29%|██▉       | 108738/371472 [8:38:47<21:55:27,  3.33it/s]
 29%|██▉       | 108739/371472 [8:38:48<20:55:09,  3.49it/s]
 29%|██▉       | 108740/371472 [8:38:48<20:32:41,  3.55it/s]
                                                            
{'loss': 3.3223, 'learning_rate': 7.368883190760413e-07, 'epoch': 4.68}

 29%|██▉       | 108740/371472 [8:38:48<20:32:41,  3.55it/s]
 29%|██▉       | 108741/371472 [8:38:48<20:56:46,  3.48it/s]
 29%|██▉       | 108742/371472 [8:38:49<23:08:49,  3.15it/s]
 29%|██▉       | 108743/371472 [8:38:49<21:37:57,  3.37it/s]
 29%|██▉       | 108744/371472 [8:38:49<20:07:52,  3.63it/s]
 29%|██▉       | 108745/371472 [8:38:49<21:17:18,  3.43it/s]
 29%|██▉       | 108746/371472 [8:38:50<20:40:15,  3.53it/s]
 29%|██▉       | 108747/371472 [8:38:50<20:02:55,  3.64it/s]
 29%|██▉       | 108748/371472 [8:38:50<20:24:04,  3.58it/s]
 29%|██▉       | 108749/371472 [8:38:51<21:42:35,  3.36it/s]
 29%|██▉       | 108750/371472 [8:38:51<21:53:44,  3.33it/s]
 29%|██▉       | 108751/371472 [8:38:51<21:26:57,  3.40it/s]
 29%|██▉       | 108752/371472 [8:38:51<22:04:39,  3.31it/s]
 29%|██▉       | 108753/371472 [8:38:52<21:22:45,  3.41it/s]
 29%|██▉       | 108754/371472 [8:38:52<20:47:25,  3.51it/s]
 29%|██▉       | 108755/371472 [8:38:52<21:04:45,  3.46it/s]
 29%|██▉       | 108756/371472 [8:38:53<20:47:34,  3.51it/s]
 29%|██▉       | 108757/371472 [8:38:53<20:33:34,  3.55it/s]
 29%|██▉       | 108758/371472 [8:38:53<20:38:36,  3.54it/s]
 29%|██▉       | 108759/371472 [8:38:53<19:47:48,  3.69it/s]
 29%|██▉       | 108760/371472 [8:38:54<20:42:59,  3.52it/s]
                                                            
{'loss': 3.3081, 'learning_rate': 7.368398371005624e-07, 'epoch': 4.68}

 29%|██▉       | 108760/371472 [8:38:54<20:42:59,  3.52it/s]
 29%|██▉       | 108761/371472 [8:38:54<20:57:12,  3.48it/s]
 29%|██▉       | 108762/371472 [8:38:54<20:38:51,  3.53it/s]
 29%|██▉       | 108763/371472 [8:38:55<20:12:07,  3.61it/s]
 29%|██▉       | 108764/371472 [8:38:55<21:12:28,  3.44it/s]
 29%|██▉       | 108765/371472 [8:38:55<20:29:09,  3.56it/s]
 29%|██▉       | 108766/371472 [8:38:55<19:53:28,  3.67it/s]
 29%|██▉       | 108767/371472 [8:38:56<19:32:21,  3.73it/s]
 29%|██▉       | 108768/371472 [8:38:56<20:12:43,  3.61it/s]
 29%|██▉       | 108769/371472 [8:38:56<20:24:29,  3.58it/s]
 29%|██▉       | 108770/371472 [8:38:56<20:06:07,  3.63it/s]
 29%|██▉       | 108771/371472 [8:38:57<21:41:48,  3.36it/s]
 29%|██▉       | 108772/371472 [8:38:57<23:20:10,  3.13it/s]
 29%|██▉       | 108773/371472 [8:38:57<23:10:50,  3.15it/s]
 29%|██▉       | 108774/371472 [8:38:58<22:46:48,  3.20it/s]
 29%|██▉       | 108775/371472 [8:38:58<22:34:53,  3.23it/s]
 29%|██▉       | 108776/371472 [8:38:58<22:20:28,  3.27it/s]
 29%|██▉       | 108777/371472 [8:38:59<21:21:53,  3.42it/s]
 29%|██▉       | 108778/371472 [8:38:59<20:53:13,  3.49it/s]
 29%|██▉       | 108779/371472 [8:38:59<20:33:11,  3.55it/s]
 29%|██▉       | 108780/371472 [8:38:59<19:59:40,  3.65it/s]
                                                            
{'loss': 3.4824, 'learning_rate': 7.367913551250834e-07, 'epoch': 4.69}

 29%|██▉       | 108780/371472 [8:38:59<19:59:40,  3.65it/s]
 29%|██▉       | 108781/371472 [8:39:00<20:17:32,  3.60it/s]
 29%|██▉       | 108782/371472 [8:39:00<21:07:53,  3.45it/s]
 29%|██▉       | 108783/371472 [8:39:00<20:50:57,  3.50it/s]
 29%|██▉       | 108784/371472 [8:39:01<20:29:11,  3.56it/s]
 29%|██▉       | 108785/371472 [8:39:01<20:22:11,  3.58it/s]
 29%|██▉       | 108786/371472 [8:39:01<19:22:27,  3.77it/s]
 29%|██▉       | 108787/371472 [8:39:01<19:10:09,  3.81it/s]
 29%|██▉       | 108788/371472 [8:39:02<19:49:30,  3.68it/s]
 29%|██▉       | 108789/371472 [8:39:02<19:42:18,  3.70it/s]
 29%|██▉       | 108790/371472 [8:39:02<19:40:58,  3.71it/s]
 29%|██▉       | 108791/371472 [8:39:02<20:31:15,  3.56it/s]
 29%|██▉       | 108792/371472 [8:39:03<21:25:29,  3.41it/s]
 29%|██▉       | 108793/371472 [8:39:03<20:56:29,  3.48it/s]
 29%|██▉       | 108794/371472 [8:39:03<20:24:09,  3.58it/s]
 29%|██▉       | 108795/371472 [8:39:04<21:30:43,  3.39it/s]
 29%|██▉       | 108796/371472 [8:39:04<20:19:44,  3.59it/s]
 29%|██▉       | 108797/371472 [8:39:04<20:16:11,  3.60it/s]
 29%|██▉       | 108798/371472 [8:39:04<19:54:17,  3.67it/s]
 29%|██▉       | 108799/371472 [8:39:05<19:28:14,  3.75it/s]
 29%|██▉       | 108800/371472 [8:39:05<19:57:23,  3.66it/s]
                                                            
{'loss': 3.4848, 'learning_rate': 7.367428731496045e-07, 'epoch': 4.69}

 29%|██▉       | 108800/371472 [8:39:05<19:57:23,  3.66it/s]
 29%|██▉       | 108801/371472 [8:39:05<20:21:52,  3.58it/s]
 29%|██▉       | 108802/371472 [8:39:06<19:36:32,  3.72it/s]
 29%|██▉       | 108803/371472 [8:39:06<19:54:46,  3.66it/s]
 29%|██▉       | 108804/371472 [8:39:06<19:58:25,  3.65it/s]
 29%|██▉       | 108805/371472 [8:39:06<19:33:41,  3.73it/s]
 29%|██▉       | 108806/371472 [8:39:07<19:57:59,  3.65it/s]
 29%|██▉       | 108807/371472 [8:39:07<19:45:02,  3.69it/s]
 29%|██▉       | 108808/371472 [8:39:07<19:48:01,  3.68it/s]
 29%|██▉       | 108809/371472 [8:39:07<20:20:30,  3.59it/s]
 29%|██▉       | 108810/371472 [8:39:08<19:32:35,  3.73it/s]
 29%|██▉       | 108811/371472 [8:39:08<19:16:13,  3.79it/s]
 29%|██▉       | 108812/371472 [8:39:08<19:13:45,  3.79it/s]
 29%|██▉       | 108813/371472 [8:39:09<19:40:45,  3.71it/s]
 29%|██▉       | 108814/371472 [8:39:09<20:07:14,  3.63it/s]
 29%|██▉       | 108815/371472 [8:39:09<20:01:52,  3.64it/s]
 29%|██▉       | 108816/371472 [8:39:09<21:08:41,  3.45it/s]
 29%|██▉       | 108817/371472 [8:39:10<20:41:02,  3.53it/s]
 29%|██▉       | 108818/371472 [8:39:10<20:02:10,  3.64it/s]
 29%|██▉       | 108819/371472 [8:39:10<19:41:45,  3.70it/s]
 29%|██▉       | 108820/371472 [8:39:10<19:07:02,  3.82it/s]
                                                            
{'loss': 3.5141, 'learning_rate': 7.366943911741257e-07, 'epoch': 4.69}

 29%|██▉       | 108820/371472 [8:39:10<19:07:02,  3.82it/s]
 29%|██▉       | 108821/371472 [8:39:11<20:01:58,  3.64it/s]
 29%|██▉       | 108822/371472 [8:39:11<19:47:40,  3.69it/s]
 29%|██▉       | 108823/371472 [8:39:11<19:33:16,  3.73it/s]
 29%|██▉       | 108824/371472 [8:39:12<19:36:04,  3.72it/s]
 29%|██▉       | 108825/371472 [8:39:12<19:34:02,  3.73it/s]
 29%|██▉       | 108826/371472 [8:39:12<19:55:43,  3.66it/s]
 29%|██▉       | 108827/371472 [8:39:12<19:48:39,  3.68it/s]
 29%|██▉       | 108828/371472 [8:39:13<19:38:32,  3.71it/s]
 29%|██▉       | 108829/371472 [8:39:13<20:08:27,  3.62it/s]
 29%|██▉       | 108830/371472 [8:39:13<20:58:41,  3.48it/s]
 29%|██▉       | 108831/371472 [8:39:13<20:20:30,  3.59it/s]
 29%|██▉       | 108832/371472 [8:39:14<20:25:12,  3.57it/s]
 29%|██▉       | 108833/371472 [8:39:14<20:23:29,  3.58it/s]
 29%|██▉       | 108834/371472 [8:39:14<19:54:17,  3.67it/s]
 29%|██▉       | 108835/371472 [8:39:15<19:59:21,  3.65it/s]
 29%|██▉       | 108836/371472 [8:39:15<19:42:31,  3.70it/s]
 29%|██▉       | 108837/371472 [8:39:15<19:53:18,  3.67it/s]
 29%|██▉       | 108838/371472 [8:39:15<20:53:54,  3.49it/s]
 29%|██▉       | 108839/371472 [8:39:16<20:55:21,  3.49it/s]
 29%|██▉       | 108840/371472 [8:39:16<20:12:54,  3.61it/s]
                                                            
{'loss': 3.2749, 'learning_rate': 7.366459091986468e-07, 'epoch': 4.69}

 29%|██▉       | 108840/371472 [8:39:16<20:12:54,  3.61it/s]
 29%|██▉       | 108841/371472 [8:39:16<19:50:04,  3.68it/s]
 29%|██▉       | 108842/371472 [8:39:17<20:31:14,  3.56it/s]
 29%|██▉       | 108843/371472 [8:39:17<21:00:14,  3.47it/s]
 29%|██▉       | 108844/371472 [8:39:17<20:44:17,  3.52it/s]
 29%|██▉       | 108845/371472 [8:39:17<21:56:56,  3.32it/s]
 29%|██▉       | 108846/371472 [8:39:18<21:40:55,  3.36it/s]
 29%|██▉       | 108847/371472 [8:39:18<23:59:06,  3.04it/s]
 29%|██▉       | 108848/371472 [8:39:18<22:47:55,  3.20it/s]
 29%|██▉       | 108849/371472 [8:39:19<22:15:20,  3.28it/s]
 29%|██▉       | 108850/371472 [8:39:19<21:43:12,  3.36it/s]
 29%|██▉       | 108851/371472 [8:39:19<20:22:55,  3.58it/s]
 29%|██▉       | 108852/371472 [8:39:19<20:11:21,  3.61it/s]
 29%|██▉       | 108853/371472 [8:39:20<19:33:45,  3.73it/s]
 29%|██▉       | 108854/371472 [8:39:20<20:01:38,  3.64it/s]
 29%|██▉       | 108855/371472 [8:39:20<20:30:21,  3.56it/s]
 29%|██▉       | 108856/371472 [8:39:21<20:48:05,  3.51it/s]
 29%|██▉       | 108857/371472 [8:39:21<20:16:13,  3.60it/s]
 29%|██▉       | 108858/371472 [8:39:21<19:23:27,  3.76it/s]
 29%|██▉       | 108859/371472 [8:39:21<19:27:53,  3.75it/s]
 29%|██▉       | 108860/371472 [8:39:22<19:57:10,  3.66it/s]
                                                            
{'loss': 3.3197, 'learning_rate': 7.365974272231678e-07, 'epoch': 4.69}

 29%|██▉       | 108860/371472 [8:39:22<19:57:10,  3.66it/s]
 29%|██▉       | 108861/371472 [8:39:22<20:16:59,  3.60it/s]
 29%|██▉       | 108862/371472 [8:39:22<20:09:50,  3.62it/s]
 29%|██▉       | 108863/371472 [8:39:22<19:31:30,  3.74it/s]
 29%|██▉       | 108864/371472 [8:39:23<19:32:45,  3.73it/s]
 29%|██▉       | 108865/371472 [8:39:23<21:15:36,  3.43it/s]
 29%|██▉       | 108866/371472 [8:39:23<21:06:42,  3.46it/s]
 29%|██▉       | 108867/371472 [8:39:24<20:30:11,  3.56it/s]
 29%|██▉       | 108868/371472 [8:39:24<21:01:17,  3.47it/s]
 29%|██▉       | 108869/371472 [8:39:24<22:42:57,  3.21it/s]
 29%|██▉       | 108870/371472 [8:39:25<22:49:15,  3.20it/s]
 29%|██▉       | 108871/371472 [8:39:25<21:31:37,  3.39it/s]
 29%|██▉       | 108872/371472 [8:39:25<21:43:36,  3.36it/s]
 29%|██▉       | 108873/371472 [8:39:25<21:06:15,  3.46it/s]
 29%|██▉       | 108874/371472 [8:39:26<23:40:14,  3.08it/s]
 29%|██▉       | 108875/371472 [8:39:26<21:50:22,  3.34it/s]
 29%|██▉       | 108876/371472 [8:39:26<21:21:26,  3.42it/s]
 29%|██▉       | 108877/371472 [8:39:27<20:19:40,  3.59it/s]
 29%|██▉       | 108878/371472 [8:39:27<19:41:31,  3.70it/s]
 29%|██▉       | 108879/371472 [8:39:27<19:41:03,  3.71it/s]
 29%|██▉       | 108880/371472 [8:39:27<20:11:54,  3.61it/s]
                                                            
{'loss': 3.41, 'learning_rate': 7.36548945247689e-07, 'epoch': 4.69}

 29%|██▉       | 108880/371472 [8:39:27<20:11:54,  3.61it/s]
 29%|██▉       | 108881/371472 [8:39:28<19:33:47,  3.73it/s]
 29%|██▉       | 108882/371472 [8:39:28<19:23:19,  3.76it/s]
 29%|██▉       | 108883/371472 [8:39:28<20:38:45,  3.53it/s]
 29%|██▉       | 108884/371472 [8:39:29<20:51:08,  3.50it/s]
 29%|██▉       | 108885/371472 [8:39:29<20:42:44,  3.52it/s]
 29%|██▉       | 108886/371472 [8:39:29<20:19:02,  3.59it/s]
 29%|██▉       | 108887/371472 [8:39:29<20:12:00,  3.61it/s]
 29%|██▉       | 108888/371472 [8:39:30<20:26:20,  3.57it/s]
 29%|██▉       | 108889/371472 [8:39:30<20:30:41,  3.56it/s]
 29%|██▉       | 108890/371472 [8:39:30<20:14:02,  3.60it/s]
 29%|██▉       | 108891/371472 [8:39:31<22:28:08,  3.25it/s]
 29%|██▉       | 108892/371472 [8:39:31<21:05:20,  3.46it/s]
 29%|██▉       | 108893/371472 [8:39:31<21:19:48,  3.42it/s]
 29%|██▉       | 108894/371472 [8:39:31<20:12:16,  3.61it/s]
 29%|██▉       | 108895/371472 [8:39:32<20:41:13,  3.53it/s]
 29%|██▉       | 108896/371472 [8:39:32<20:31:53,  3.55it/s]
 29%|██▉       | 108897/371472 [8:39:32<20:54:54,  3.49it/s]
 29%|██▉       | 108898/371472 [8:39:33<21:49:15,  3.34it/s]
 29%|██▉       | 108899/371472 [8:39:33<20:57:19,  3.48it/s]
 29%|██▉       | 108900/371472 [8:39:33<21:28:20,  3.40it/s]
                                                            
{'loss': 3.5239, 'learning_rate': 7.365004632722102e-07, 'epoch': 4.69}

 29%|██▉       | 108900/371472 [8:39:33<21:28:20,  3.40it/s]
 29%|██▉       | 108901/371472 [8:39:34<22:30:08,  3.24it/s]
 29%|██▉       | 108902/371472 [8:39:34<21:44:37,  3.35it/s]
 29%|██▉       | 108903/371472 [8:39:34<20:45:45,  3.51it/s]
 29%|██▉       | 108904/371472 [8:39:34<21:11:51,  3.44it/s]
 29%|██▉       | 108905/371472 [8:39:35<21:12:30,  3.44it/s]
 29%|██▉       | 108906/371472 [8:39:35<21:15:41,  3.43it/s]
 29%|██▉       | 108907/371472 [8:39:35<20:52:07,  3.49it/s]
 29%|██▉       | 108908/371472 [8:39:36<21:45:43,  3.35it/s]
 29%|██▉       | 108909/371472 [8:39:36<20:50:01,  3.50it/s]
 29%|██▉       | 108910/371472 [8:39:36<20:48:49,  3.50it/s]
 29%|██▉       | 108911/371472 [8:39:36<20:13:51,  3.61it/s]
 29%|██▉       | 108912/371472 [8:39:37<21:05:26,  3.46it/s]
 29%|██▉       | 108913/371472 [8:39:37<20:23:20,  3.58it/s]
 29%|██▉       | 108914/371472 [8:39:37<20:36:49,  3.54it/s]
 29%|██▉       | 108915/371472 [8:39:38<21:28:55,  3.40it/s]
 29%|██▉       | 108916/371472 [8:39:38<23:02:14,  3.17it/s]
 29%|██▉       | 108917/371472 [8:39:38<21:54:56,  3.33it/s]
 29%|██▉       | 108918/371472 [8:39:39<23:37:30,  3.09it/s]
 29%|██▉       | 108919/371472 [8:39:39<21:46:36,  3.35it/s]
 29%|██▉       | 108920/371472 [8:39:39<26:43:14,  2.73it/s]
                                                            
{'loss': 3.3409, 'learning_rate': 7.364519812967311e-07, 'epoch': 4.69}

 29%|██▉       | 108920/371472 [8:39:39<26:43:14,  2.73it/s]
 29%|██▉       | 108921/371472 [8:39:40<24:09:59,  3.02it/s]
 29%|██▉       | 108922/371472 [8:39:40<23:22:09,  3.12it/s]
 29%|██▉       | 108923/371472 [8:39:40<24:05:04,  3.03it/s]
 29%|██▉       | 108924/371472 [8:39:40<23:17:04,  3.13it/s]
 29%|██▉       | 108925/371472 [8:39:41<22:25:03,  3.25it/s]
 29%|██▉       | 108926/371472 [8:39:41<23:41:27,  3.08it/s]
 29%|██▉       | 108927/371472 [8:39:41<23:47:32,  3.07it/s]
 29%|██▉       | 108928/371472 [8:39:42<22:12:20,  3.28it/s]
 29%|██▉       | 108929/371472 [8:39:42<21:12:58,  3.44it/s]
 29%|██▉       | 108930/371472 [8:39:42<20:22:52,  3.58it/s]
 29%|██▉       | 108931/371472 [8:39:42<19:56:09,  3.66it/s]
 29%|██▉       | 108932/371472 [8:39:43<19:21:42,  3.77it/s]
 29%|██▉       | 108933/371472 [8:39:43<19:10:14,  3.80it/s]
 29%|██▉       | 108934/371472 [8:39:43<18:44:58,  3.89it/s]
 29%|██▉       | 108935/371472 [8:39:43<18:25:25,  3.96it/s]
 29%|██▉       | 108936/371472 [8:39:44<18:04:31,  4.03it/s]
 29%|██▉       | 108937/371472 [8:39:44<19:27:34,  3.75it/s]
 29%|██▉       | 108938/371472 [8:39:44<20:03:33,  3.64it/s]
 29%|██▉       | 108939/371472 [8:39:45<19:49:44,  3.68it/s]
 29%|██▉       | 108940/371472 [8:39:45<20:06:11,  3.63it/s]
                                                            
{'loss': 3.4581, 'learning_rate': 7.364034993212522e-07, 'epoch': 4.69}

 29%|██▉       | 108940/371472 [8:39:45<20:06:11,  3.63it/s]
 29%|██▉       | 108941/371472 [8:39:45<20:40:56,  3.53it/s]
 29%|██▉       | 108942/371472 [8:39:45<20:15:55,  3.60it/s]
 29%|██▉       | 108943/371472 [8:39:46<20:16:22,  3.60it/s]
 29%|██▉       | 108944/371472 [8:39:46<21:37:53,  3.37it/s]
 29%|██▉       | 108945/371472 [8:39:46<21:22:48,  3.41it/s]
 29%|██▉       | 108946/371472 [8:39:47<21:19:26,  3.42it/s]
 29%|██▉       | 108947/371472 [8:39:47<20:23:13,  3.58it/s]
 29%|██▉       | 108948/371472 [8:39:47<20:38:19,  3.53it/s]
 29%|██▉       | 108949/371472 [8:39:47<20:22:40,  3.58it/s]
 29%|██▉       | 108950/371472 [8:39:48<21:29:39,  3.39it/s]
 29%|██▉       | 108951/371472 [8:39:48<20:50:59,  3.50it/s]
 29%|██▉       | 108952/371472 [8:39:48<20:12:50,  3.61it/s]
 29%|██▉       | 108953/371472 [8:39:49<19:51:59,  3.67it/s]
 29%|██▉       | 108954/371472 [8:39:49<19:52:42,  3.67it/s]
 29%|██▉       | 108955/371472 [8:39:49<22:12:08,  3.28it/s]
 29%|██▉       | 108956/371472 [8:39:49<21:08:08,  3.45it/s]
 29%|██▉       | 108957/371472 [8:39:50<20:36:44,  3.54it/s]
 29%|██▉       | 108958/371472 [8:39:50<19:49:27,  3.68it/s]
 29%|██▉       | 108959/371472 [8:39:50<20:30:47,  3.55it/s]
 29%|██▉       | 108960/371472 [8:39:51<19:44:17,  3.69it/s]
                                                            
{'loss': 3.4348, 'learning_rate': 7.363550173457734e-07, 'epoch': 4.69}

 29%|██▉       | 108960/371472 [8:39:51<19:44:17,  3.69it/s]
 29%|██▉       | 108961/371472 [8:39:51<20:25:39,  3.57it/s]
 29%|██▉       | 108962/371472 [8:39:51<19:58:49,  3.65it/s]
 29%|██▉       | 108963/371472 [8:39:51<19:31:26,  3.73it/s]
 29%|██▉       | 108964/371472 [8:39:52<20:04:18,  3.63it/s]
 29%|██▉       | 108965/371472 [8:39:52<19:45:13,  3.69it/s]
 29%|██▉       | 108966/371472 [8:39:52<19:09:39,  3.81it/s]
 29%|██▉       | 108967/371472 [8:39:52<20:16:28,  3.60it/s]
 29%|██▉       | 108968/371472 [8:39:53<20:25:51,  3.57it/s]
 29%|██▉       | 108969/371472 [8:39:53<20:15:07,  3.60it/s]
 29%|██▉       | 108970/371472 [8:39:53<20:55:43,  3.48it/s]
 29%|██▉       | 108971/371472 [8:39:54<20:41:24,  3.52it/s]
 29%|██▉       | 108972/371472 [8:39:54<20:02:21,  3.64it/s]
 29%|██▉       | 108973/371472 [8:39:54<20:31:47,  3.55it/s]
 29%|██▉       | 108974/371472 [8:39:54<20:27:39,  3.56it/s]
 29%|██▉       | 108975/371472 [8:39:55<21:25:40,  3.40it/s]
 29%|██▉       | 108976/371472 [8:39:55<22:20:34,  3.26it/s]
 29%|██▉       | 108977/371472 [8:39:55<23:05:15,  3.16it/s]
 29%|██▉       | 108978/371472 [8:39:56<22:33:38,  3.23it/s]
 29%|██▉       | 108979/371472 [8:39:56<21:41:48,  3.36it/s]
 29%|██▉       | 108980/371472 [8:39:56<21:30:53,  3.39it/s]
                                                            
{'loss': 3.3815, 'learning_rate': 7.363065353702946e-07, 'epoch': 4.69}

 29%|██▉       | 108980/371472 [8:39:56<21:30:53,  3.39it/s]
 29%|██▉       | 108981/371472 [8:39:57<21:10:39,  3.44it/s]
 29%|██▉       | 108982/371472 [8:39:57<20:57:26,  3.48it/s]
 29%|██▉       | 108983/371472 [8:39:57<20:28:45,  3.56it/s]
 29%|██▉       | 108984/371472 [8:39:57<21:52:43,  3.33it/s]
 29%|██▉       | 108985/371472 [8:39:58<21:30:55,  3.39it/s]
 29%|██▉       | 108986/371472 [8:39:58<20:53:03,  3.49it/s]
 29%|██▉       | 108987/371472 [8:39:58<21:16:34,  3.43it/s]
 29%|██▉       | 108988/371472 [8:39:59<21:26:17,  3.40it/s]
 29%|██▉       | 108989/371472 [8:39:59<21:43:59,  3.35it/s]
 29%|██▉       | 108990/371472 [8:39:59<21:11:56,  3.44it/s]
 29%|██▉       | 108991/371472 [8:40:00<23:22:25,  3.12it/s]
 29%|██▉       | 108992/371472 [8:40:00<21:43:49,  3.36it/s]
 29%|██▉       | 108993/371472 [8:40:00<21:36:35,  3.37it/s]
 29%|██▉       | 108994/371472 [8:40:00<20:56:37,  3.48it/s]
 29%|██▉       | 108995/371472 [8:40:01<21:51:14,  3.34it/s]
 29%|██▉       | 108996/371472 [8:40:01<21:28:29,  3.40it/s]
 29%|██▉       | 108997/371472 [8:40:01<21:14:00,  3.43it/s]
 29%|██▉       | 108998/371472 [8:40:02<21:49:50,  3.34it/s]
 29%|██▉       | 108999/371472 [8:40:02<21:21:19,  3.41it/s]
 29%|██▉       | 109000/371472 [8:40:02<21:19:26,  3.42it/s]
                                                            
{'loss': 3.4902, 'learning_rate': 7.362580533948156e-07, 'epoch': 4.69}

 29%|██▉       | 109000/371472 [8:40:02<21:19:26,  3.42it/s]
 29%|██▉       | 109001/371472 [8:40:02<22:28:41,  3.24it/s]
 29%|██▉       | 109002/371472 [8:40:03<21:41:57,  3.36it/s]
 29%|██▉       | 109003/371472 [8:40:03<31:16:45,  2.33it/s]
 29%|██▉       | 109004/371472 [8:40:04<27:27:17,  2.66it/s]
 29%|██▉       | 109005/371472 [8:40:04<25:33:22,  2.85it/s]
 29%|██▉       | 109006/371472 [8:40:04<27:55:49,  2.61it/s]
 29%|██▉       | 109007/371472 [8:40:05<26:41:15,  2.73it/s]
 29%|██▉       | 109008/371472 [8:40:05<25:04:11,  2.91it/s]
 29%|██▉       | 109009/371472 [8:40:05<25:58:15,  2.81it/s]
 29%|██▉       | 109010/371472 [8:40:06<24:01:07,  3.04it/s]
 29%|██▉       | 109011/371472 [8:40:06<22:12:23,  3.28it/s]
 29%|██▉       | 109012/371472 [8:40:06<21:49:22,  3.34it/s]
 29%|██▉       | 109013/371472 [8:40:07<21:53:16,  3.33it/s]
 29%|██▉       | 109014/371472 [8:40:07<20:36:09,  3.54it/s]
 29%|██▉       | 109015/371472 [8:40:07<20:06:14,  3.63it/s]
 29%|██▉       | 109016/371472 [8:40:07<20:37:53,  3.53it/s]
 29%|██▉       | 109017/371472 [8:40:08<20:13:01,  3.61it/s]
 29%|██▉       | 109018/371472 [8:40:08<20:17:15,  3.59it/s]
 29%|██▉       | 109019/371472 [8:40:08<19:54:52,  3.66it/s]
 29%|██▉       | 109020/371472 [8:40:08<19:53:23,  3.67it/s]
                                                            
{'loss': 3.4949, 'learning_rate': 7.362095714193367e-07, 'epoch': 4.7}

 29%|██▉       | 109020/371472 [8:40:08<19:53:23,  3.67it/s]
 29%|██▉       | 109021/371472 [8:40:09<20:00:23,  3.64it/s]
 29%|██▉       | 109022/371472 [8:40:09<19:49:25,  3.68it/s]
 29%|██▉       | 109023/371472 [8:40:09<19:18:17,  3.78it/s]
 29%|██▉       | 109024/371472 [8:40:10<21:05:49,  3.46it/s]
 29%|██▉       | 109025/371472 [8:40:10<21:35:58,  3.38it/s]
 29%|██▉       | 109026/371472 [8:40:10<20:59:27,  3.47it/s]
 29%|██▉       | 109027/371472 [8:40:10<20:30:15,  3.56it/s]
 29%|██▉       | 109028/371472 [8:40:11<20:12:57,  3.61it/s]
 29%|██▉       | 109029/371472 [8:40:11<19:34:38,  3.72it/s]
 29%|██▉       | 109030/371472 [8:40:11<20:11:34,  3.61it/s]
 29%|██▉       | 109031/371472 [8:40:12<20:37:52,  3.53it/s]
 29%|██▉       | 109032/371472 [8:40:12<20:42:47,  3.52it/s]
 29%|██▉       | 109033/371472 [8:40:12<20:21:53,  3.58it/s]
 29%|██▉       | 109034/371472 [8:40:12<21:19:29,  3.42it/s]
 29%|██▉       | 109035/371472 [8:40:13<23:03:22,  3.16it/s]
 29%|██▉       | 109036/371472 [8:40:13<22:13:34,  3.28it/s]
 29%|██▉       | 109037/371472 [8:40:13<22:28:34,  3.24it/s]
 29%|██▉       | 109038/371472 [8:40:14<22:08:41,  3.29it/s]
 29%|██▉       | 109039/371472 [8:40:14<21:04:32,  3.46it/s]
 29%|██▉       | 109040/371472 [8:40:14<20:51:41,  3.49it/s]
                                                            
{'loss': 3.4152, 'learning_rate': 7.361610894438579e-07, 'epoch': 4.7}

 29%|██▉       | 109040/371472 [8:40:14<20:51:41,  3.49it/s]
 29%|██▉       | 109041/371472 [8:40:15<20:20:22,  3.58it/s]
 29%|██▉       | 109042/371472 [8:40:15<21:22:40,  3.41it/s]
 29%|██▉       | 109043/371472 [8:40:15<20:20:00,  3.59it/s]
 29%|██▉       | 109044/371472 [8:40:15<19:53:35,  3.66it/s]
 29%|██▉       | 109045/371472 [8:40:16<19:50:47,  3.67it/s]
 29%|██▉       | 109046/371472 [8:40:16<20:36:43,  3.54it/s]
 29%|██▉       | 109047/371472 [8:40:16<21:47:39,  3.34it/s]
 29%|██▉       | 109048/371472 [8:40:17<20:49:32,  3.50it/s]
 29%|██▉       | 109049/371472 [8:40:17<19:47:09,  3.68it/s]
 29%|██▉       | 109050/371472 [8:40:17<19:17:32,  3.78it/s]
 29%|██▉       | 109051/371472 [8:40:17<19:30:26,  3.74it/s]
 29%|██▉       | 109052/371472 [8:40:18<19:26:09,  3.75it/s]
 29%|██▉       | 109053/371472 [8:40:18<19:06:42,  3.81it/s]
 29%|██▉       | 109054/371472 [8:40:18<20:52:38,  3.49it/s]
 29%|██▉       | 109055/371472 [8:40:18<20:47:01,  3.51it/s]
 29%|██▉       | 109056/371472 [8:40:19<20:12:12,  3.61it/s]
 29%|██▉       | 109057/371472 [8:40:19<20:54:10,  3.49it/s]
 29%|██▉       | 109058/371472 [8:40:19<20:52:01,  3.49it/s]
 29%|██▉       | 109059/371472 [8:40:20<23:16:57,  3.13it/s]
 29%|██▉       | 109060/371472 [8:40:20<23:41:04,  3.08it/s]
                                                            
{'loss': 3.4191, 'learning_rate': 7.36112607468379e-07, 'epoch': 4.7}

 29%|██▉       | 109060/371472 [8:40:20<23:41:04,  3.08it/s]
 29%|██▉       | 109061/371472 [8:40:20<22:11:09,  3.29it/s]
 29%|██▉       | 109062/371472 [8:40:21<21:13:43,  3.43it/s]
 29%|██▉       | 109063/371472 [8:40:21<21:21:42,  3.41it/s]
 29%|██▉       | 109064/371472 [8:40:21<20:34:38,  3.54it/s]
 29%|██▉       | 109065/371472 [8:40:21<20:57:59,  3.48it/s]
 29%|██▉       | 109066/371472 [8:40:22<20:10:45,  3.61it/s]
 29%|██▉       | 109067/371472 [8:40:22<19:40:08,  3.71it/s]
 29%|██▉       | 109068/371472 [8:40:22<19:15:23,  3.79it/s]
 29%|██▉       | 109069/371472 [8:40:22<21:33:21,  3.38it/s]
 29%|██▉       | 109070/371472 [8:40:23<20:26:40,  3.57it/s]
 29%|██▉       | 109071/371472 [8:40:23<19:54:08,  3.66it/s]
 29%|██▉       | 109072/371472 [8:40:23<19:24:42,  3.75it/s]
 29%|██▉       | 109073/371472 [8:40:23<18:53:46,  3.86it/s]
 29%|██▉       | 109074/371472 [8:40:24<19:23:27,  3.76it/s]
 29%|██▉       | 109075/371472 [8:40:24<19:17:06,  3.78it/s]
 29%|██▉       | 109076/371472 [8:40:24<19:58:01,  3.65it/s]
 29%|██▉       | 109077/371472 [8:40:25<19:28:29,  3.74it/s]
 29%|██▉       | 109078/371472 [8:40:25<19:43:20,  3.70it/s]
 29%|██▉       | 109079/371472 [8:40:25<19:29:06,  3.74it/s]
 29%|██▉       | 109080/371472 [8:40:25<20:00:03,  3.64it/s]
                                                            
{'loss': 3.4569, 'learning_rate': 7.360641254929001e-07, 'epoch': 4.7}

 29%|██▉       | 109080/371472 [8:40:25<20:00:03,  3.64it/s]
 29%|██▉       | 109081/371472 [8:40:26<19:38:46,  3.71it/s]
 29%|██▉       | 109082/371472 [8:40:26<19:23:11,  3.76it/s]
 29%|██▉       | 109083/371472 [8:40:26<19:39:22,  3.71it/s]
 29%|██▉       | 109084/371472 [8:40:26<19:54:20,  3.66it/s]
 29%|██▉       | 109085/371472 [8:40:27<20:25:59,  3.57it/s]
 29%|██▉       | 109086/371472 [8:40:27<20:44:24,  3.51it/s]
 29%|██▉       | 109087/371472 [8:40:27<20:57:57,  3.48it/s]
 29%|██▉       | 109088/371472 [8:40:28<21:41:11,  3.36it/s]
 29%|██▉       | 109089/371472 [8:40:28<21:06:35,  3.45it/s]
 29%|██▉       | 109090/371472 [8:40:28<20:56:05,  3.48it/s]
 29%|██▉       | 109091/371472 [8:40:29<20:26:44,  3.56it/s]
 29%|██▉       | 109092/371472 [8:40:29<19:53:34,  3.66it/s]
 29%|██▉       | 109093/371472 [8:40:29<19:21:34,  3.76it/s]
 29%|██▉       | 109094/371472 [8:40:29<19:32:46,  3.73it/s]
 29%|██▉       | 109095/371472 [8:40:30<19:04:17,  3.82it/s]
 29%|██▉       | 109096/371472 [8:40:30<20:14:08,  3.60it/s]
 29%|██▉       | 109097/371472 [8:40:30<19:54:56,  3.66it/s]
 29%|██▉       | 109098/371472 [8:40:30<20:07:40,  3.62it/s]
 29%|██▉       | 109099/371472 [8:40:31<20:16:36,  3.59it/s]
 29%|██▉       | 109100/371472 [8:40:31<19:33:25,  3.73it/s]
                                                            
{'loss': 3.2765, 'learning_rate': 7.360156435174211e-07, 'epoch': 4.7}

 29%|██▉       | 109100/371472 [8:40:31<19:33:25,  3.73it/s]
 29%|██▉       | 109101/371472 [8:40:31<19:39:10,  3.71it/s]
 29%|██▉       | 109102/371472 [8:40:31<19:45:10,  3.69it/s]
 29%|██▉       | 109103/371472 [8:40:32<20:00:51,  3.64it/s]
 29%|██▉       | 109104/371472 [8:40:32<19:50:05,  3.67it/s]
 29%|██▉       | 109105/371472 [8:40:32<19:20:44,  3.77it/s]
 29%|██▉       | 109106/371472 [8:40:33<19:52:05,  3.67it/s]
 29%|██▉       | 109107/371472 [8:40:33<19:17:53,  3.78it/s]
 29%|██▉       | 109108/371472 [8:40:33<20:22:38,  3.58it/s]
 29%|██▉       | 109109/371472 [8:40:33<20:33:18,  3.55it/s]
 29%|██▉       | 109110/371472 [8:40:34<22:00:30,  3.31it/s]
 29%|██▉       | 109111/371472 [8:40:34<21:12:13,  3.44it/s]
 29%|██▉       | 109112/371472 [8:40:34<20:21:25,  3.58it/s]
 29%|██▉       | 109113/371472 [8:40:35<20:16:48,  3.59it/s]
 29%|██▉       | 109114/371472 [8:40:35<20:14:04,  3.60it/s]
 29%|██▉       | 109115/371472 [8:40:35<24:01:29,  3.03it/s]
 29%|██▉       | 109116/371472 [8:40:36<23:18:15,  3.13it/s]
 29%|██▉       | 109117/371472 [8:40:36<22:26:36,  3.25it/s]
 29%|██▉       | 109118/371472 [8:40:36<23:29:53,  3.10it/s]
 29%|██▉       | 109119/371472 [8:40:36<22:27:34,  3.24it/s]
 29%|██▉       | 109120/371472 [8:40:37<21:23:28,  3.41it/s]
                                                            
{'loss': 3.3831, 'learning_rate': 7.359671615419423e-07, 'epoch': 4.7}

 29%|██▉       | 109120/371472 [8:40:37<21:23:28,  3.41it/s]
 29%|██▉       | 109121/371472 [8:40:37<22:00:04,  3.31it/s]
 29%|██▉       | 109122/371472 [8:40:37<20:28:13,  3.56it/s]
 29%|██▉       | 109123/371472 [8:40:38<20:32:52,  3.55it/s]
 29%|██▉       | 109124/371472 [8:40:38<20:22:45,  3.58it/s]
 29%|██▉       | 109125/371472 [8:40:38<20:30:47,  3.55it/s]
 29%|██▉       | 109126/371472 [8:40:38<20:23:36,  3.57it/s]
 29%|██▉       | 109127/371472 [8:40:39<20:56:04,  3.48it/s]
 29%|██▉       | 109128/371472 [8:40:39<20:49:41,  3.50it/s]
 29%|██▉       | 109129/371472 [8:40:39<19:35:51,  3.72it/s]
 29%|██▉       | 109130/371472 [8:40:39<19:25:45,  3.75it/s]
 29%|██▉       | 109131/371472 [8:40:40<19:52:19,  3.67it/s]
 29%|██▉       | 109132/371472 [8:40:40<19:52:03,  3.67it/s]
 29%|██▉       | 109133/371472 [8:40:40<19:39:50,  3.71it/s]
 29%|██▉       | 109134/371472 [8:40:41<19:20:45,  3.77it/s]
 29%|██▉       | 109135/371472 [8:40:41<19:53:41,  3.66it/s]
 29%|██▉       | 109136/371472 [8:40:41<20:27:31,  3.56it/s]
 29%|██▉       | 109137/371472 [8:40:41<20:05:56,  3.63it/s]
 29%|██▉       | 109138/371472 [8:40:42<20:04:46,  3.63it/s]
 29%|██▉       | 109139/371472 [8:40:42<21:05:50,  3.45it/s]
 29%|██▉       | 109140/371472 [8:40:42<20:20:02,  3.58it/s]
                                                            
{'loss': 3.6725, 'learning_rate': 7.359186795664635e-07, 'epoch': 4.7}

 29%|██▉       | 109140/371472 [8:40:42<20:20:02,  3.58it/s]
 29%|██▉       | 109141/371472 [8:40:43<20:45:16,  3.51it/s]
 29%|██▉       | 109142/371472 [8:40:43<20:46:27,  3.51it/s]
 29%|██▉       | 109143/371472 [8:40:43<21:52:03,  3.33it/s]
 29%|██▉       | 109144/371472 [8:40:44<21:57:23,  3.32it/s]
 29%|██▉       | 109145/371472 [8:40:44<22:57:01,  3.18it/s]
 29%|██▉       | 109146/371472 [8:40:44<22:13:27,  3.28it/s]
 29%|██▉       | 109147/371472 [8:40:44<22:01:20,  3.31it/s]
 29%|██▉       | 109148/371472 [8:40:45<22:57:51,  3.17it/s]
 29%|██▉       | 109149/371472 [8:40:45<22:59:57,  3.17it/s]
 29%|██▉       | 109150/371472 [8:40:45<21:42:48,  3.36it/s]
 29%|██▉       | 109151/371472 [8:40:46<22:36:12,  3.22it/s]
 29%|██▉       | 109152/371472 [8:40:46<21:33:57,  3.38it/s]
 29%|██▉       | 109153/371472 [8:40:46<21:55:05,  3.32it/s]
 29%|██▉       | 109154/371472 [8:40:47<21:25:16,  3.40it/s]
 29%|██▉       | 109155/371472 [8:40:47<20:15:00,  3.60it/s]
 29%|██▉       | 109156/371472 [8:40:47<20:39:04,  3.53it/s]
 29%|██▉       | 109157/371472 [8:40:47<20:28:58,  3.56it/s]
 29%|██▉       | 109158/371472 [8:40:48<20:23:54,  3.57it/s]
 29%|██▉       | 109159/371472 [8:40:48<22:18:49,  3.27it/s]
 29%|██▉       | 109160/371472 [8:40:48<23:32:58,  3.09it/s]
                                                            
{'loss': 3.3772, 'learning_rate': 7.358701975909845e-07, 'epoch': 4.7}

 29%|██▉       | 109160/371472 [8:40:48<23:32:58,  3.09it/s]
 29%|██▉       | 109161/371472 [8:40:49<22:09:02,  3.29it/s]
 29%|██▉       | 109162/371472 [8:40:49<21:09:00,  3.45it/s]
 29%|██▉       | 109163/371472 [8:40:49<20:20:19,  3.58it/s]
 29%|██▉       | 109164/371472 [8:40:49<19:38:14,  3.71it/s]
 29%|██▉       | 109165/371472 [8:40:50<20:37:27,  3.53it/s]
 29%|██▉       | 109166/371472 [8:40:50<20:00:51,  3.64it/s]
 29%|██▉       | 109167/371472 [8:40:50<20:01:53,  3.64it/s]
 29%|██▉       | 109168/371472 [8:40:51<20:21:08,  3.58it/s]
 29%|██▉       | 109169/371472 [8:40:51<19:57:18,  3.65it/s]
 29%|██▉       | 109170/371472 [8:40:51<19:04:33,  3.82it/s]
 29%|██▉       | 109171/371472 [8:40:51<19:16:40,  3.78it/s]
 29%|██▉       | 109172/371472 [8:40:52<20:01:36,  3.64it/s]
 29%|██▉       | 109173/371472 [8:40:52<19:48:49,  3.68it/s]
 29%|██▉       | 109174/371472 [8:40:52<19:47:40,  3.68it/s]
 29%|██▉       | 109175/371472 [8:40:52<20:00:36,  3.64it/s]
 29%|██▉       | 109176/371472 [8:40:53<20:16:00,  3.60it/s]
 29%|██▉       | 109177/371472 [8:40:53<20:02:04,  3.64it/s]
 29%|██▉       | 109178/371472 [8:40:53<19:34:31,  3.72it/s]
 29%|██▉       | 109179/371472 [8:40:53<19:39:37,  3.71it/s]
 29%|██▉       | 109180/371472 [8:40:54<20:18:51,  3.59it/s]
                                                            
{'loss': 3.482, 'learning_rate': 7.358217156155055e-07, 'epoch': 4.7}

 29%|██▉       | 109180/371472 [8:40:54<20:18:51,  3.59it/s]
 29%|██▉       | 109181/371472 [8:40:54<20:48:56,  3.50it/s]
 29%|██▉       | 109182/371472 [8:40:54<21:32:50,  3.38it/s]
 29%|██▉       | 109183/371472 [8:40:55<21:07:42,  3.45it/s]
 29%|██▉       | 109184/371472 [8:40:55<20:22:40,  3.58it/s]
 29%|██▉       | 109185/371472 [8:40:55<19:42:48,  3.70it/s]
 29%|██▉       | 109186/371472 [8:40:55<20:22:34,  3.58it/s]
 29%|██▉       | 109187/371472 [8:40:56<20:17:24,  3.59it/s]
 29%|██▉       | 109188/371472 [8:40:56<20:43:32,  3.52it/s]
 29%|██▉       | 109189/371472 [8:40:56<20:06:51,  3.62it/s]
 29%|██▉       | 109190/371472 [8:40:57<19:43:12,  3.69it/s]
 29%|██▉       | 109191/371472 [8:40:57<19:58:45,  3.65it/s]
 29%|██▉       | 109192/371472 [8:40:57<20:09:05,  3.62it/s]
 29%|██▉       | 109193/371472 [8:40:57<19:41:50,  3.70it/s]
 29%|██▉       | 109194/371472 [8:40:58<19:29:25,  3.74it/s]
 29%|██▉       | 109195/371472 [8:40:58<19:17:53,  3.78it/s]
 29%|██▉       | 109196/371472 [8:40:58<19:39:19,  3.71it/s]
 29%|██▉       | 109197/371472 [8:40:58<20:24:13,  3.57it/s]
 29%|██▉       | 109198/371472 [8:40:59<20:02:50,  3.63it/s]
 29%|██▉       | 109199/371472 [8:40:59<20:53:48,  3.49it/s]
 29%|██▉       | 109200/371472 [8:40:59<22:00:26,  3.31it/s]
                                                            
{'loss': 3.4736, 'learning_rate': 7.357732336400267e-07, 'epoch': 4.7}

 29%|██▉       | 109200/371472 [8:40:59<22:00:26,  3.31it/s]
 29%|██▉       | 109201/371472 [8:41:00<20:59:13,  3.47it/s]
 29%|██▉       | 109202/371472 [8:41:00<19:48:05,  3.68it/s]
 29%|██▉       | 109203/371472 [8:41:00<20:17:08,  3.59it/s]
 29%|██▉       | 109204/371472 [8:41:00<20:01:27,  3.64it/s]
 29%|██▉       | 109205/371472 [8:41:01<19:48:18,  3.68it/s]
 29%|██▉       | 109206/371472 [8:41:01<20:27:21,  3.56it/s]
 29%|██▉       | 109207/371472 [8:41:01<20:29:12,  3.56it/s]
 29%|██▉       | 109208/371472 [8:41:02<20:14:10,  3.60it/s]
 29%|██▉       | 109209/371472 [8:41:02<19:58:58,  3.65it/s]
 29%|██▉       | 109210/371472 [8:41:02<20:10:46,  3.61it/s]
 29%|██▉       | 109211/371472 [8:41:02<20:32:33,  3.55it/s]
 29%|██▉       | 109212/371472 [8:41:03<19:48:33,  3.68it/s]
 29%|██▉       | 109213/371472 [8:41:03<19:20:23,  3.77it/s]
 29%|██▉       | 109214/371472 [8:41:03<19:27:42,  3.74it/s]
 29%|██▉       | 109215/371472 [8:41:03<20:11:36,  3.61it/s]
 29%|██▉       | 109216/371472 [8:41:04<21:19:45,  3.42it/s]
 29%|██▉       | 109217/371472 [8:41:04<21:10:57,  3.44it/s]
 29%|██▉       | 109218/371472 [8:41:04<23:23:41,  3.11it/s]
 29%|██▉       | 109219/371472 [8:41:05<23:03:10,  3.16it/s]
 29%|██▉       | 109220/371472 [8:41:05<21:15:41,  3.43it/s]
                                                            
{'loss': 3.4527, 'learning_rate': 7.357247516645479e-07, 'epoch': 4.7}

 29%|██▉       | 109220/371472 [8:41:05<21:15:41,  3.43it/s]
 29%|██▉       | 109221/371472 [8:41:05<20:41:20,  3.52it/s]
 29%|██▉       | 109222/371472 [8:41:06<21:01:16,  3.47it/s]
 29%|██▉       | 109223/371472 [8:41:06<20:46:35,  3.51it/s]
 29%|██▉       | 109224/371472 [8:41:06<20:06:23,  3.62it/s]
 29%|██▉       | 109225/371472 [8:41:06<19:54:54,  3.66it/s]
 29%|██▉       | 109226/371472 [8:41:07<20:57:14,  3.48it/s]
 29%|██▉       | 109227/371472 [8:41:07<21:59:28,  3.31it/s]
 29%|██▉       | 109228/371472 [8:41:07<22:08:49,  3.29it/s]
 29%|██▉       | 109229/371472 [8:41:08<22:13:04,  3.28it/s]
 29%|██▉       | 109230/371472 [8:41:08<22:35:06,  3.23it/s]
 29%|██▉       | 109231/371472 [8:41:08<21:40:42,  3.36it/s]
 29%|██▉       | 109232/371472 [8:41:09<20:38:34,  3.53it/s]
 29%|██▉       | 109233/371472 [8:41:09<21:04:45,  3.46it/s]
 29%|██▉       | 109234/371472 [8:41:09<20:52:45,  3.49it/s]
 29%|██▉       | 109235/371472 [8:41:10<24:53:06,  2.93it/s]
 29%|██▉       | 109236/371472 [8:41:10<32:10:27,  2.26it/s]
 29%|██▉       | 109237/371472 [8:41:11<28:14:49,  2.58it/s]
 29%|██▉       | 109238/371472 [8:41:11<25:58:40,  2.80it/s]
 29%|██▉       | 109239/371472 [8:41:11<24:12:48,  3.01it/s]
 29%|██▉       | 109240/371472 [8:41:11<23:21:08,  3.12it/s]
                                                            
{'loss': 3.362, 'learning_rate': 7.356762696890689e-07, 'epoch': 4.71}

 29%|██▉       | 109240/371472 [8:41:11<23:21:08,  3.12it/s]
 29%|██▉       | 109241/371472 [8:41:12<22:15:14,  3.27it/s]
 29%|██▉       | 109242/371472 [8:41:12<21:48:19,  3.34it/s]
 29%|██▉       | 109243/371472 [8:41:12<22:29:39,  3.24it/s]
 29%|██▉       | 109244/371472 [8:41:13<21:51:40,  3.33it/s]
 29%|██▉       | 109245/371472 [8:41:13<21:29:08,  3.39it/s]
 29%|██▉       | 109246/371472 [8:41:13<21:30:19,  3.39it/s]
 29%|██▉       | 109247/371472 [8:41:13<21:06:38,  3.45it/s]
 29%|██▉       | 109248/371472 [8:41:14<21:04:50,  3.46it/s]
 29%|██▉       | 109249/371472 [8:41:14<20:42:05,  3.52it/s]
 29%|██▉       | 109250/371472 [8:41:14<20:21:25,  3.58it/s]
 29%|██▉       | 109251/371472 [8:41:14<20:28:00,  3.56it/s]
 29%|██▉       | 109252/371472 [8:41:15<20:21:07,  3.58it/s]
 29%|██▉       | 109253/371472 [8:41:15<20:32:03,  3.55it/s]
 29%|██▉       | 109254/371472 [8:41:15<20:18:59,  3.59it/s]
 29%|██▉       | 109255/371472 [8:41:16<20:20:17,  3.58it/s]
 29%|██▉       | 109256/371472 [8:41:16<20:35:26,  3.54it/s]
 29%|██▉       | 109257/371472 [8:41:16<21:13:57,  3.43it/s]
 29%|██▉       | 109258/371472 [8:41:17<21:23:42,  3.40it/s]
 29%|██▉       | 109259/371472 [8:41:17<24:35:18,  2.96it/s]
 29%|██▉       | 109260/371472 [8:41:17<23:18:40,  3.12it/s]
                                                            
{'loss': 3.3077, 'learning_rate': 7.3562778771359e-07, 'epoch': 4.71}

 29%|██▉       | 109260/371472 [8:41:17<23:18:40,  3.12it/s]
 29%|██▉       | 109261/371472 [8:41:18<23:37:43,  3.08it/s]
 29%|██▉       | 109262/371472 [8:41:18<22:42:54,  3.21it/s]
 29%|██▉       | 109263/371472 [8:41:18<22:07:30,  3.29it/s]
 29%|██▉       | 109264/371472 [8:41:18<22:24:01,  3.25it/s]
 29%|██▉       | 109265/371472 [8:41:19<21:57:45,  3.32it/s]
 29%|██▉       | 109266/371472 [8:41:19<21:43:35,  3.35it/s]
 29%|██▉       | 109267/371472 [8:41:19<21:26:31,  3.40it/s]
 29%|██▉       | 109268/371472 [8:41:20<21:57:13,  3.32it/s]
 29%|██▉       | 109269/371472 [8:41:20<20:46:25,  3.51it/s]
 29%|██▉       | 109270/371472 [8:41:20<21:09:08,  3.44it/s]
 29%|██▉       | 109271/371472 [8:41:20<21:18:30,  3.42it/s]
 29%|██▉       | 109272/371472 [8:41:21<22:17:38,  3.27it/s]
 29%|██▉       | 109273/371472 [8:41:21<22:29:08,  3.24it/s]
 29%|██▉       | 109274/371472 [8:41:21<21:25:29,  3.40it/s]
 29%|██▉       | 109275/371472 [8:41:22<20:43:22,  3.51it/s]
 29%|██▉       | 109276/371472 [8:41:22<20:22:54,  3.57it/s]
 29%|██▉       | 109277/371472 [8:41:22<20:40:20,  3.52it/s]
 29%|██▉       | 109278/371472 [8:41:22<20:09:14,  3.61it/s]
 29%|██▉       | 109279/371472 [8:41:23<20:27:52,  3.56it/s]
 29%|██▉       | 109280/371472 [8:41:23<21:23:06,  3.41it/s]
                                                            
{'loss': 3.3716, 'learning_rate': 7.355793057381112e-07, 'epoch': 4.71}

 29%|██▉       | 109280/371472 [8:41:23<21:23:06,  3.41it/s]
 29%|██▉       | 109281/371472 [8:41:23<20:51:09,  3.49it/s]
 29%|██▉       | 109282/371472 [8:41:24<20:31:08,  3.55it/s]
 29%|██▉       | 109283/371472 [8:41:24<19:44:50,  3.69it/s]
 29%|██▉       | 109284/371472 [8:41:24<19:40:07,  3.70it/s]
 29%|██▉       | 109285/371472 [8:41:24<19:29:50,  3.74it/s]
 29%|██▉       | 109286/371472 [8:41:25<19:34:05,  3.72it/s]
 29%|██▉       | 109287/371472 [8:41:25<20:42:48,  3.52it/s]
 29%|██▉       | 109288/371472 [8:41:25<20:45:40,  3.51it/s]
 29%|██▉       | 109289/371472 [8:41:26<22:55:01,  3.18it/s]
 29%|██▉       | 109290/371472 [8:41:26<22:04:21,  3.30it/s]
 29%|██▉       | 109291/371472 [8:41:26<21:58:52,  3.31it/s]
 29%|██▉       | 109292/371472 [8:41:26<20:52:40,  3.49it/s]
 29%|██▉       | 109293/371472 [8:41:27<20:17:07,  3.59it/s]
 29%|██▉       | 109294/371472 [8:41:27<19:44:06,  3.69it/s]
 29%|██▉       | 109295/371472 [8:41:27<19:39:57,  3.70it/s]
 29%|██▉       | 109296/371472 [8:41:28<21:06:56,  3.45it/s]
 29%|██▉       | 109297/371472 [8:41:28<20:36:29,  3.53it/s]
 29%|██▉       | 109298/371472 [8:41:28<22:13:17,  3.28it/s]
 29%|██▉       | 109299/371472 [8:41:28<21:23:33,  3.40it/s]
 29%|██▉       | 109300/371472 [8:41:29<20:22:20,  3.57it/s]
                                                            
{'loss': 3.4546, 'learning_rate': 7.355308237626321e-07, 'epoch': 4.71}

 29%|██▉       | 109300/371472 [8:41:29<20:22:20,  3.57it/s]
 29%|██▉       | 109301/371472 [8:41:29<20:27:41,  3.56it/s]
 29%|██▉       | 109302/371472 [8:41:29<20:42:58,  3.52it/s]
 29%|██▉       | 109303/371472 [8:41:30<20:53:32,  3.49it/s]
 29%|██▉       | 109304/371472 [8:41:30<20:32:07,  3.55it/s]
 29%|██▉       | 109305/371472 [8:41:30<20:09:19,  3.61it/s]
 29%|██▉       | 109306/371472 [8:41:30<19:46:55,  3.68it/s]
 29%|██▉       | 109307/371472 [8:41:31<19:47:49,  3.68it/s]
 29%|██▉       | 109308/371472 [8:41:31<19:13:12,  3.79it/s]
 29%|██▉       | 109309/371472 [8:41:31<21:00:22,  3.47it/s]
 29%|██▉       | 109310/371472 [8:41:32<20:20:46,  3.58it/s]
 29%|██▉       | 109311/371472 [8:41:32<19:48:08,  3.68it/s]
 29%|██▉       | 109312/371472 [8:41:32<20:42:48,  3.52it/s]
 29%|██▉       | 109313/371472 [8:41:32<20:17:15,  3.59it/s]
 29%|██▉       | 109314/371472 [8:41:33<19:52:00,  3.67it/s]
 29%|██▉       | 109315/371472 [8:41:33<20:02:52,  3.63it/s]
 29%|██▉       | 109316/371472 [8:41:33<19:37:51,  3.71it/s]
 29%|██▉       | 109317/371472 [8:41:33<19:57:03,  3.65it/s]
 29%|██▉       | 109318/371472 [8:41:34<19:28:54,  3.74it/s]
 29%|██▉       | 109319/371472 [8:41:34<20:27:26,  3.56it/s]
 29%|██▉       | 109320/371472 [8:41:34<22:02:12,  3.30it/s]
                                                            
{'loss': 3.2998, 'learning_rate': 7.354823417871532e-07, 'epoch': 4.71}

 29%|██▉       | 109320/371472 [8:41:34<22:02:12,  3.30it/s]
 29%|██▉       | 109321/371472 [8:41:35<20:47:03,  3.50it/s]
 29%|██▉       | 109322/371472 [8:41:35<22:02:46,  3.30it/s]
 29%|██▉       | 109323/371472 [8:41:35<21:35:22,  3.37it/s]
 29%|██▉       | 109324/371472 [8:41:35<20:48:57,  3.50it/s]
 29%|██▉       | 109325/371472 [8:41:36<20:33:05,  3.54it/s]
 29%|██▉       | 109326/371472 [8:41:36<20:25:52,  3.56it/s]
 29%|██▉       | 109327/371472 [8:41:36<20:31:33,  3.55it/s]
 29%|██▉       | 109328/371472 [8:41:37<19:42:50,  3.69it/s]
 29%|██▉       | 109329/371472 [8:41:37<19:32:15,  3.73it/s]
 29%|██▉       | 109330/371472 [8:41:37<19:16:53,  3.78it/s]
 29%|██▉       | 109331/371472 [8:41:37<19:19:40,  3.77it/s]
 29%|██▉       | 109332/371472 [8:41:38<18:48:26,  3.87it/s]
 29%|██▉       | 109333/371472 [8:41:38<20:19:02,  3.58it/s]
 29%|██▉       | 109334/371472 [8:41:38<20:42:06,  3.52it/s]
 29%|██▉       | 109335/371472 [8:41:39<20:44:08,  3.51it/s]
 29%|██▉       | 109336/371472 [8:41:39<20:36:58,  3.53it/s]
 29%|██▉       | 109337/371472 [8:41:39<19:55:40,  3.65it/s]
 29%|██▉       | 109338/371472 [8:41:39<20:05:35,  3.62it/s]
 29%|██▉       | 109339/371472 [8:41:40<21:02:14,  3.46it/s]
 29%|██▉       | 109340/371472 [8:41:40<20:58:47,  3.47it/s]
                                                            
{'loss': 3.4644, 'learning_rate': 7.354338598116744e-07, 'epoch': 4.71}

 29%|██▉       | 109340/371472 [8:41:40<20:58:47,  3.47it/s]
 29%|██▉       | 109341/371472 [8:41:40<20:55:11,  3.48it/s]
 29%|██▉       | 109342/371472 [8:41:41<20:53:30,  3.49it/s]
 29%|██▉       | 109343/371472 [8:41:41<21:36:18,  3.37it/s]
 29%|██▉       | 109344/371472 [8:41:41<22:27:08,  3.24it/s]
 29%|██▉       | 109345/371472 [8:41:41<23:03:55,  3.16it/s]
 29%|██▉       | 109346/371472 [8:41:42<21:47:42,  3.34it/s]
 29%|██▉       | 109347/371472 [8:41:42<21:33:30,  3.38it/s]
 29%|██▉       | 109348/371472 [8:41:42<20:45:27,  3.51it/s]
 29%|██▉       | 109349/371472 [8:41:43<20:55:17,  3.48it/s]
 29%|██▉       | 109350/371472 [8:41:43<20:15:31,  3.59it/s]
 29%|██▉       | 109351/371472 [8:41:43<19:21:51,  3.76it/s]
 29%|██▉       | 109352/371472 [8:41:43<20:09:58,  3.61it/s]
 29%|██▉       | 109353/371472 [8:41:44<19:45:31,  3.68it/s]
 29%|██▉       | 109354/371472 [8:41:44<19:30:47,  3.73it/s]
 29%|██▉       | 109355/371472 [8:41:44<19:42:26,  3.69it/s]
 29%|██▉       | 109356/371472 [8:41:44<19:13:49,  3.79it/s]
 29%|██▉       | 109357/371472 [8:41:45<19:35:01,  3.72it/s]
 29%|██▉       | 109358/371472 [8:41:45<18:55:58,  3.85it/s]
 29%|██▉       | 109359/371472 [8:41:45<18:26:38,  3.95it/s]
 29%|██▉       | 109360/371472 [8:41:45<19:26:54,  3.74it/s]
                                                            
{'loss': 3.4126, 'learning_rate': 7.353853778361956e-07, 'epoch': 4.71}

 29%|██▉       | 109360/371472 [8:41:45<19:26:54,  3.74it/s]
 29%|██▉       | 109361/371472 [8:41:46<20:10:31,  3.61it/s]
 29%|██▉       | 109362/371472 [8:41:46<19:53:49,  3.66it/s]
 29%|██▉       | 109363/371472 [8:41:46<20:39:09,  3.53it/s]
 29%|██▉       | 109364/371472 [8:41:47<20:45:49,  3.51it/s]
 29%|██▉       | 109365/371472 [8:41:47<19:55:56,  3.65it/s]
 29%|██▉       | 109366/371472 [8:41:47<19:34:14,  3.72it/s]
 29%|██▉       | 109367/371472 [8:41:47<19:27:36,  3.74it/s]
 29%|██▉       | 109368/371472 [8:41:48<19:03:31,  3.82it/s]
 29%|██▉       | 109369/371472 [8:41:48<19:04:32,  3.82it/s]
 29%|██▉       | 109370/371472 [8:41:48<20:05:41,  3.62it/s]
 29%|██▉       | 109371/371472 [8:41:48<19:44:16,  3.69it/s]
 29%|██▉       | 109372/371472 [8:41:49<19:12:35,  3.79it/s]
 29%|██▉       | 109373/371472 [8:41:49<19:07:59,  3.81it/s]
 29%|██▉       | 109374/371472 [8:41:49<18:56:51,  3.84it/s]
 29%|██▉       | 109375/371472 [8:41:50<19:42:10,  3.70it/s]
 29%|██▉       | 109376/371472 [8:41:50<19:23:08,  3.76it/s]
 29%|██▉       | 109377/371472 [8:41:50<18:48:39,  3.87it/s]
 29%|██▉       | 109378/371472 [8:41:50<19:25:45,  3.75it/s]
 29%|██▉       | 109379/371472 [8:41:51<19:26:16,  3.75it/s]
 29%|██▉       | 109380/371472 [8:41:51<19:40:46,  3.70it/s]
                                                            
{'loss': 3.3607, 'learning_rate': 7.353368958607166e-07, 'epoch': 4.71}

 29%|██▉       | 109380/371472 [8:41:51<19:40:46,  3.70it/s]
 29%|██▉       | 109381/371472 [8:41:51<23:07:50,  3.15it/s]
 29%|██▉       | 109382/371472 [8:41:52<22:09:21,  3.29it/s]
 29%|██▉       | 109383/371472 [8:41:52<21:39:32,  3.36it/s]
 29%|██▉       | 109384/371472 [8:41:52<20:45:45,  3.51it/s]
 29%|██▉       | 109385/371472 [8:41:52<21:10:29,  3.44it/s]
 29%|██▉       | 109386/371472 [8:41:53<21:43:05,  3.35it/s]
 29%|██▉       | 109387/371472 [8:41:53<23:43:59,  3.07it/s]
 29%|██▉       | 109388/371472 [8:41:53<22:28:18,  3.24it/s]
 29%|██▉       | 109389/371472 [8:41:54<21:52:24,  3.33it/s]
 29%|██▉       | 109390/371472 [8:41:54<21:14:00,  3.43it/s]
 29%|██▉       | 109391/371472 [8:41:54<20:22:09,  3.57it/s]
 29%|██▉       | 109392/371472 [8:41:54<19:59:18,  3.64it/s]
 29%|██▉       | 109393/371472 [8:41:55<20:00:08,  3.64it/s]
 29%|██▉       | 109394/371472 [8:41:55<20:06:02,  3.62it/s]
 29%|██▉       | 109395/371472 [8:41:55<20:36:20,  3.53it/s]
 29%|██▉       | 109396/371472 [8:41:56<23:36:09,  3.08it/s]
 29%|██▉       | 109397/371472 [8:41:56<23:01:59,  3.16it/s]
 29%|██▉       | 109398/371472 [8:41:56<21:48:25,  3.34it/s]
 29%|██▉       | 109399/371472 [8:41:57<21:31:36,  3.38it/s]
 29%|██▉       | 109400/371472 [8:41:57<20:49:15,  3.50it/s]
                                                            
{'loss': 3.3738, 'learning_rate': 7.352884138852377e-07, 'epoch': 4.71}

 29%|██▉       | 109400/371472 [8:41:57<20:49:15,  3.50it/s]
 29%|██▉       | 109401/371472 [8:41:57<20:07:17,  3.62it/s]
 29%|██▉       | 109402/371472 [8:41:57<20:07:11,  3.62it/s]
 29%|██▉       | 109403/371472 [8:41:58<20:44:27,  3.51it/s]
 29%|██▉       | 109404/371472 [8:41:58<20:08:20,  3.61it/s]
 29%|██▉       | 109405/371472 [8:41:58<21:34:04,  3.38it/s]
 29%|██▉       | 109406/371472 [8:41:59<21:53:12,  3.33it/s]
 29%|██▉       | 109407/371472 [8:41:59<25:11:18,  2.89it/s]
 29%|██▉       | 109408/371472 [8:41:59<24:36:28,  2.96it/s]
 29%|██▉       | 109409/371472 [8:42:00<22:27:37,  3.24it/s]
 29%|██▉       | 109410/371472 [8:42:00<22:58:46,  3.17it/s]
 29%|██▉       | 109411/371472 [8:42:00<22:12:17,  3.28it/s]
 29%|██▉       | 109412/371472 [8:42:00<21:39:18,  3.36it/s]
 29%|██▉       | 109413/371472 [8:42:01<21:41:48,  3.36it/s]
 29%|██▉       | 109414/371472 [8:42:01<23:34:34,  3.09it/s]
 29%|██▉       | 109415/371472 [8:42:01<21:49:41,  3.33it/s]
 29%|██▉       | 109416/371472 [8:42:02<21:41:52,  3.35it/s]
 29%|██▉       | 109417/371472 [8:42:02<21:34:38,  3.37it/s]
 29%|██▉       | 109418/371472 [8:42:02<20:56:53,  3.47it/s]
 29%|██▉       | 109419/371472 [8:42:03<20:48:11,  3.50it/s]
 29%|██▉       | 109420/371472 [8:42:03<20:38:08,  3.53it/s]
                                                            
{'loss': 3.4028, 'learning_rate': 7.352399319097589e-07, 'epoch': 4.71}

 29%|██▉       | 109420/371472 [8:42:03<20:38:08,  3.53it/s]
 29%|██▉       | 109421/371472 [8:42:03<20:06:23,  3.62it/s]
 29%|██▉       | 109422/371472 [8:42:03<19:36:25,  3.71it/s]
 29%|██▉       | 109423/371472 [8:42:04<20:23:56,  3.57it/s]
 29%|██▉       | 109424/371472 [8:42:04<19:47:26,  3.68it/s]
 29%|██▉       | 109425/371472 [8:42:04<19:43:02,  3.69it/s]
 29%|██▉       | 109426/371472 [8:42:04<19:41:55,  3.70it/s]
 29%|██▉       | 109427/371472 [8:42:05<20:16:40,  3.59it/s]
 29%|██▉       | 109428/371472 [8:42:05<20:08:04,  3.62it/s]
 29%|██▉       | 109429/371472 [8:42:05<19:27:57,  3.74it/s]
 29%|██▉       | 109430/371472 [8:42:06<22:07:15,  3.29it/s]
 29%|██▉       | 109431/371472 [8:42:06<21:39:01,  3.36it/s]
 29%|██▉       | 109432/371472 [8:42:06<22:16:30,  3.27it/s]
 29%|██▉       | 109433/371472 [8:42:07<21:28:06,  3.39it/s]
 29%|██▉       | 109434/371472 [8:42:07<21:12:17,  3.43it/s]
 29%|██▉       | 109435/371472 [8:42:07<21:35:47,  3.37it/s]
 29%|██▉       | 109436/371472 [8:42:07<20:55:42,  3.48it/s]
 29%|██▉       | 109437/371472 [8:42:08<20:12:32,  3.60it/s]
 29%|██▉       | 109438/371472 [8:42:08<19:43:17,  3.69it/s]
 29%|██▉       | 109439/371472 [8:42:08<19:36:52,  3.71it/s]
 29%|██▉       | 109440/371472 [8:42:08<19:16:34,  3.78it/s]
                                                            
{'loss': 3.467, 'learning_rate': 7.3519144993428e-07, 'epoch': 4.71}

 29%|██▉       | 109440/371472 [8:42:08<19:16:34,  3.78it/s]
 29%|██▉       | 109441/371472 [8:42:09<20:05:46,  3.62it/s]
 29%|██▉       | 109442/371472 [8:42:09<21:15:29,  3.42it/s]
 29%|██▉       | 109443/371472 [8:42:09<20:27:57,  3.56it/s]
 29%|██▉       | 109444/371472 [8:42:10<21:57:05,  3.32it/s]
 29%|██▉       | 109445/371472 [8:42:10<20:38:34,  3.53it/s]
 29%|██▉       | 109446/371472 [8:42:10<20:21:27,  3.58it/s]
 29%|██▉       | 109447/371472 [8:42:10<19:34:47,  3.72it/s]
 29%|██▉       | 109448/371472 [8:42:11<20:44:28,  3.51it/s]
 29%|██▉       | 109449/371472 [8:42:11<22:34:02,  3.23it/s]
 29%|██▉       | 109450/371472 [8:42:11<21:06:25,  3.45it/s]
 29%|██▉       | 109451/371472 [8:42:12<20:45:41,  3.51it/s]
 29%|██▉       | 109452/371472 [8:42:12<23:19:17,  3.12it/s]
 29%|██▉       | 109453/371472 [8:42:12<22:28:16,  3.24it/s]
 29%|██▉       | 109454/371472 [8:42:13<20:49:46,  3.49it/s]
 29%|██▉       | 109455/371472 [8:42:13<21:03:34,  3.46it/s]
 29%|██▉       | 109456/371472 [8:42:13<20:03:56,  3.63it/s]
 29%|██▉       | 109457/371472 [8:42:13<20:02:17,  3.63it/s]
 29%|██▉       | 109458/371472 [8:42:14<22:39:27,  3.21it/s]
 29%|██▉       | 109459/371472 [8:42:14<22:15:51,  3.27it/s]
 29%|██▉       | 109460/371472 [8:42:14<21:30:53,  3.38it/s]
                                                            
{'loss': 3.607, 'learning_rate': 7.35142967958801e-07, 'epoch': 4.71}

 29%|██▉       | 109460/371472 [8:42:14<21:30:53,  3.38it/s]
 29%|██▉       | 109461/371472 [8:42:15<20:15:53,  3.59it/s]
 29%|██▉       | 109462/371472 [8:42:15<19:36:13,  3.71it/s]
 29%|██▉       | 109463/371472 [8:42:15<19:40:34,  3.70it/s]
 29%|██▉       | 109464/371472 [8:42:15<19:27:09,  3.74it/s]
 29%|██▉       | 109465/371472 [8:42:16<19:22:07,  3.76it/s]
 29%|██▉       | 109466/371472 [8:42:16<19:00:59,  3.83it/s]
 29%|██▉       | 109467/371472 [8:42:16<19:13:58,  3.78it/s]
 29%|██▉       | 109468/371472 [8:42:16<18:57:24,  3.84it/s]
 29%|██▉       | 109469/371472 [8:42:17<20:11:06,  3.61it/s]
 29%|██▉       | 109470/371472 [8:42:17<19:24:50,  3.75it/s]
 29%|██▉       | 109471/371472 [8:42:17<19:11:25,  3.79it/s]
 29%|██▉       | 109472/371472 [8:42:17<19:54:02,  3.66it/s]
 29%|██▉       | 109473/371472 [8:42:18<21:09:29,  3.44it/s]
 29%|██▉       | 109474/371472 [8:42:18<20:43:00,  3.51it/s]
 29%|██▉       | 109475/371472 [8:42:18<20:23:14,  3.57it/s]
 29%|██▉       | 109476/371472 [8:42:19<20:23:24,  3.57it/s]
 29%|██▉       | 109477/371472 [8:42:19<19:41:24,  3.70it/s]
 29%|██▉       | 109478/371472 [8:42:19<18:56:43,  3.84it/s]
 29%|██▉       | 109479/371472 [8:42:19<18:56:55,  3.84it/s]
 29%|██▉       | 109480/371472 [8:42:20<19:18:55,  3.77it/s]
                                                            
{'loss': 3.4806, 'learning_rate': 7.350944859833221e-07, 'epoch': 4.72}

 29%|██▉       | 109480/371472 [8:42:20<19:18:55,  3.77it/s]
 29%|██▉       | 109481/371472 [8:42:20<20:29:44,  3.55it/s]
 29%|██▉       | 109482/371472 [8:42:20<21:10:16,  3.44it/s]
 29%|██▉       | 109483/371472 [8:42:21<21:17:07,  3.42it/s]
 29%|██▉       | 109484/371472 [8:42:21<21:10:03,  3.44it/s]
 29%|██▉       | 109485/371472 [8:42:21<20:39:57,  3.52it/s]
 29%|██▉       | 109486/371472 [8:42:21<20:58:31,  3.47it/s]
 29%|██▉       | 109487/371472 [8:42:22<20:43:58,  3.51it/s]
 29%|██▉       | 109488/371472 [8:42:22<20:43:33,  3.51it/s]
 29%|██▉       | 109489/371472 [8:42:22<20:50:06,  3.49it/s]
 29%|██▉       | 109490/371472 [8:42:23<20:21:40,  3.57it/s]
 29%|██▉       | 109491/371472 [8:42:23<19:52:28,  3.66it/s]
 29%|██▉       | 109492/371472 [8:42:23<19:22:47,  3.76it/s]
 29%|██▉       | 109493/371472 [8:42:23<19:06:36,  3.81it/s]
 29%|██▉       | 109494/371472 [8:42:24<18:57:32,  3.84it/s]
 29%|██▉       | 109495/371472 [8:42:24<19:28:18,  3.74it/s]
 29%|██▉       | 109496/371472 [8:42:24<22:14:55,  3.27it/s]
 29%|██▉       | 109497/371472 [8:42:25<22:06:24,  3.29it/s]
 29%|██▉       | 109498/371472 [8:42:25<22:51:13,  3.18it/s]
 29%|██▉       | 109499/371472 [8:42:25<21:41:00,  3.36it/s]
 29%|██▉       | 109500/371472 [8:42:25<21:25:24,  3.40it/s]
                                                            
{'loss': 3.5371, 'learning_rate': 7.350460040078432e-07, 'epoch': 4.72}

 29%|██▉       | 109500/371472 [8:42:25<21:25:24,  3.40it/s]
 29%|██▉       | 109501/371472 [8:42:26<22:31:22,  3.23it/s]
 29%|██▉       | 109502/371472 [8:42:26<21:39:06,  3.36it/s]
 29%|██▉       | 109503/371472 [8:42:26<21:09:21,  3.44it/s]
 29%|██▉       | 109504/371472 [8:42:27<20:46:45,  3.50it/s]
 29%|██▉       | 109505/371472 [8:42:27<21:10:51,  3.44it/s]
 29%|██▉       | 109506/371472 [8:42:27<21:10:04,  3.44it/s]
 29%|██▉       | 109507/371472 [8:42:27<21:05:24,  3.45it/s]
 29%|██▉       | 109508/371472 [8:42:28<20:27:47,  3.56it/s]
 29%|██▉       | 109509/371472 [8:42:28<20:21:38,  3.57it/s]
 29%|██▉       | 109510/371472 [8:42:28<20:30:55,  3.55it/s]
 29%|██▉       | 109511/371472 [8:42:29<20:40:02,  3.52it/s]
 29%|██▉       | 109512/371472 [8:42:29<20:07:33,  3.62it/s]
 29%|██▉       | 109513/371472 [8:42:29<20:16:03,  3.59it/s]
 29%|██▉       | 109514/371472 [8:42:29<19:48:12,  3.67it/s]
 29%|██▉       | 109515/371472 [8:42:30<19:10:31,  3.79it/s]
 29%|██▉       | 109516/371472 [8:42:30<19:06:23,  3.81it/s]
 29%|██▉       | 109517/371472 [8:42:30<18:56:53,  3.84it/s]
 29%|██▉       | 109518/371472 [8:42:30<19:20:59,  3.76it/s]
 29%|██▉       | 109519/371472 [8:42:31<19:18:54,  3.77it/s]
 29%|██▉       | 109520/371472 [8:42:31<19:01:00,  3.83it/s]
                                                            
{'loss': 3.4783, 'learning_rate': 7.349975220323645e-07, 'epoch': 4.72}

 29%|██▉       | 109520/371472 [8:42:31<19:01:00,  3.83it/s]
 29%|██▉       | 109521/371472 [8:42:31<19:07:50,  3.80it/s]
 29%|██▉       | 109522/371472 [8:42:31<18:52:34,  3.85it/s]
 29%|██▉       | 109523/371472 [8:42:32<20:27:17,  3.56it/s]
 29%|██▉       | 109524/371472 [8:42:32<20:17:04,  3.59it/s]
 29%|██▉       | 109525/371472 [8:42:32<22:18:26,  3.26it/s]
 29%|██▉       | 109526/371472 [8:42:33<21:31:43,  3.38it/s]
 29%|██▉       | 109527/371472 [8:42:33<20:56:35,  3.47it/s]
 29%|██▉       | 109528/371472 [8:42:33<20:21:49,  3.57it/s]
 29%|██▉       | 109529/371472 [8:42:33<19:43:57,  3.69it/s]
 29%|██▉       | 109530/371472 [8:42:34<19:38:13,  3.71it/s]
 29%|██▉       | 109531/371472 [8:42:34<20:36:52,  3.53it/s]
 29%|██▉       | 109532/371472 [8:42:34<20:03:03,  3.63it/s]
 29%|██▉       | 109533/371472 [8:42:35<20:12:52,  3.60it/s]
 29%|██▉       | 109534/371472 [8:42:35<20:57:46,  3.47it/s]
 29%|██▉       | 109535/371472 [8:42:35<20:26:50,  3.56it/s]
 29%|██▉       | 109536/371472 [8:42:36<22:14:48,  3.27it/s]
 29%|██▉       | 109537/371472 [8:42:36<22:19:30,  3.26it/s]
 29%|██▉       | 109538/371472 [8:42:36<21:01:36,  3.46it/s]
 29%|██▉       | 109539/371472 [8:42:36<20:23:44,  3.57it/s]
 29%|██▉       | 109540/371472 [8:42:37<21:23:45,  3.40it/s]
                                                            
{'loss': 3.2858, 'learning_rate': 7.349490400568855e-07, 'epoch': 4.72}

 29%|██▉       | 109540/371472 [8:42:37<21:23:45,  3.40it/s]
 29%|██▉       | 109541/371472 [8:42:37<21:14:48,  3.42it/s]
 29%|██▉       | 109542/371472 [8:42:37<20:24:09,  3.57it/s]
 29%|██▉       | 109543/371472 [8:42:38<20:27:34,  3.56it/s]
 29%|██▉       | 109544/371472 [8:42:38<19:57:15,  3.65it/s]
 29%|██▉       | 109545/371472 [8:42:38<20:00:38,  3.64it/s]
 29%|██▉       | 109546/371472 [8:42:38<20:40:22,  3.52it/s]
 29%|██▉       | 109547/371472 [8:42:39<20:01:40,  3.63it/s]
 29%|██▉       | 109548/371472 [8:42:39<19:35:00,  3.72it/s]
 29%|██▉       | 109549/371472 [8:42:39<19:46:02,  3.68it/s]
 29%|██▉       | 109550/371472 [8:42:39<20:17:24,  3.59it/s]
 29%|██▉       | 109551/371472 [8:42:40<19:43:43,  3.69it/s]
 29%|██▉       | 109552/371472 [8:42:40<20:16:44,  3.59it/s]
 29%|██▉       | 109553/371472 [8:42:40<20:30:27,  3.55it/s]
 29%|██▉       | 109554/371472 [8:42:41<20:10:42,  3.61it/s]
 29%|██▉       | 109555/371472 [8:42:41<20:42:41,  3.51it/s]
 29%|██▉       | 109556/371472 [8:42:41<19:55:38,  3.65it/s]
 29%|██▉       | 109557/371472 [8:42:41<20:27:15,  3.56it/s]
 29%|██▉       | 109558/371472 [8:42:42<20:13:28,  3.60it/s]
 29%|██▉       | 109559/371472 [8:42:42<19:36:30,  3.71it/s]
 29%|██▉       | 109560/371472 [8:42:42<19:26:04,  3.74it/s]
                                                            
{'loss': 3.6001, 'learning_rate': 7.349005580814065e-07, 'epoch': 4.72}

 29%|██▉       | 109560/371472 [8:42:42<19:26:04,  3.74it/s]
 29%|██▉       | 109561/371472 [8:42:42<19:13:47,  3.78it/s]
 29%|██▉       | 109562/371472 [8:42:43<19:02:49,  3.82it/s]
 29%|██▉       | 109563/371472 [8:42:43<20:10:26,  3.61it/s]
 29%|██▉       | 109564/371472 [8:42:43<20:45:23,  3.51it/s]
 29%|██▉       | 109565/371472 [8:42:44<19:59:14,  3.64it/s]
 29%|██▉       | 109566/371472 [8:42:44<19:13:01,  3.79it/s]
 29%|██▉       | 109567/371472 [8:42:44<19:26:41,  3.74it/s]
 29%|██▉       | 109568/371472 [8:42:44<19:16:49,  3.77it/s]
 29%|██▉       | 109569/371472 [8:42:45<19:42:29,  3.69it/s]
 29%|██▉       | 109570/371472 [8:42:45<20:03:43,  3.63it/s]
 29%|██▉       | 109571/371472 [8:42:45<20:21:07,  3.57it/s]
 29%|██▉       | 109572/371472 [8:42:45<19:44:14,  3.69it/s]
 29%|██▉       | 109573/371472 [8:42:46<21:38:18,  3.36it/s]
 29%|██▉       | 109574/371472 [8:42:46<21:23:21,  3.40it/s]
 29%|██▉       | 109575/371472 [8:42:46<22:13:54,  3.27it/s]
 29%|██▉       | 109576/371472 [8:42:47<22:10:53,  3.28it/s]
 29%|██▉       | 109577/371472 [8:42:47<23:25:45,  3.11it/s]
 29%|██▉       | 109578/371472 [8:42:47<22:37:55,  3.21it/s]
 29%|██▉       | 109579/371472 [8:42:48<21:14:51,  3.42it/s]
 29%|██▉       | 109580/371472 [8:42:48<20:10:33,  3.61it/s]
                                                            
{'loss': 3.567, 'learning_rate': 7.348520761059277e-07, 'epoch': 4.72}

 29%|██▉       | 109580/371472 [8:42:48<20:10:33,  3.61it/s]
 29%|██▉       | 109581/371472 [8:42:48<20:44:32,  3.51it/s]
 29%|██▉       | 109582/371472 [8:42:48<20:38:07,  3.53it/s]
 29%|██▉       | 109583/371472 [8:42:49<19:55:57,  3.65it/s]
 29%|██▉       | 109584/371472 [8:42:49<19:05:59,  3.81it/s]
 30%|██▉       | 109585/371472 [8:42:49<18:55:35,  3.84it/s]
 30%|██▉       | 109586/371472 [8:42:49<19:35:40,  3.71it/s]
 30%|██▉       | 109587/371472 [8:42:50<20:42:36,  3.51it/s]
 30%|██▉       | 109588/371472 [8:42:50<21:08:24,  3.44it/s]
 30%|██▉       | 109589/371472 [8:42:50<20:14:16,  3.59it/s]
 30%|██▉       | 109590/371472 [8:42:51<21:11:30,  3.43it/s]
 30%|██▉       | 109591/371472 [8:42:51<21:10:10,  3.44it/s]
 30%|██▉       | 109592/371472 [8:42:51<20:16:41,  3.59it/s]
 30%|██▉       | 109593/371472 [8:42:52<23:52:40,  3.05it/s]
 30%|██▉       | 109594/371472 [8:42:52<23:44:12,  3.06it/s]
 30%|██▉       | 109595/371472 [8:42:52<22:00:06,  3.31it/s]
 30%|██▉       | 109596/371472 [8:42:53<21:24:35,  3.40it/s]
 30%|██▉       | 109597/371472 [8:42:53<20:51:33,  3.49it/s]
 30%|██▉       | 109598/371472 [8:42:53<21:15:04,  3.42it/s]
 30%|██▉       | 109599/371472 [8:42:53<22:29:33,  3.23it/s]
 30%|██▉       | 109600/371472 [8:42:54<22:07:37,  3.29it/s]
                                                            
{'loss': 3.5085, 'learning_rate': 7.34803594130449e-07, 'epoch': 4.72}

 30%|██▉       | 109600/371472 [8:42:54<22:07:37,  3.29it/s]
 30%|██▉       | 109601/371472 [8:42:54<23:09:31,  3.14it/s]
 30%|██▉       | 109602/371472 [8:42:54<24:09:43,  3.01it/s]
 30%|██▉       | 109603/371472 [8:42:55<22:06:22,  3.29it/s]
 30%|██▉       | 109604/371472 [8:42:55<20:45:45,  3.50it/s]
 30%|██▉       | 109605/371472 [8:42:55<20:28:31,  3.55it/s]
 30%|██▉       | 109606/371472 [8:42:55<20:44:51,  3.51it/s]
 30%|██▉       | 109607/371472 [8:42:56<19:55:59,  3.65it/s]
 30%|██▉       | 109608/371472 [8:42:56<21:17:36,  3.42it/s]
 30%|██▉       | 109609/371472 [8:42:56<23:07:46,  3.14it/s]
 30%|██▉       | 109610/371472 [8:42:57<23:00:21,  3.16it/s]
 30%|██▉       | 109611/371472 [8:42:57<21:46:50,  3.34it/s]
 30%|██▉       | 109612/371472 [8:42:57<20:37:41,  3.53it/s]
 30%|██▉       | 109613/371472 [8:42:58<19:47:00,  3.68it/s]
 30%|██▉       | 109614/371472 [8:42:58<19:25:20,  3.75it/s]
 30%|██▉       | 109615/371472 [8:42:58<19:30:37,  3.73it/s]
 30%|██▉       | 109616/371472 [8:42:58<21:21:02,  3.41it/s]
 30%|██▉       | 109617/371472 [8:42:59<22:31:04,  3.23it/s]
 30%|██▉       | 109618/371472 [8:42:59<23:05:29,  3.15it/s]
 30%|██▉       | 109619/371472 [8:42:59<22:06:07,  3.29it/s]
 30%|██▉       | 109620/371472 [8:43:00<22:34:56,  3.22it/s]
                                                            
{'loss': 3.4442, 'learning_rate': 7.347551121549699e-07, 'epoch': 4.72}

 30%|██▉       | 109620/371472 [8:43:00<22:34:56,  3.22it/s]
 30%|██▉       | 109621/371472 [8:43:00<21:06:23,  3.45it/s]
 30%|██▉       | 109622/371472 [8:43:00<22:14:18,  3.27it/s]
 30%|██▉       | 109623/371472 [8:43:01<21:21:36,  3.41it/s]
 30%|██▉       | 109624/371472 [8:43:01<20:22:13,  3.57it/s]
 30%|██▉       | 109625/371472 [8:43:01<21:31:25,  3.38it/s]
 30%|██▉       | 109626/371472 [8:43:01<20:43:23,  3.51it/s]
 30%|██▉       | 109627/371472 [8:43:02<19:39:07,  3.70it/s]
 30%|██▉       | 109628/371472 [8:43:02<22:53:29,  3.18it/s]
 30%|██▉       | 109629/371472 [8:43:02<22:03:57,  3.30it/s]
 30%|██▉       | 109630/371472 [8:43:03<21:18:08,  3.41it/s]
 30%|██▉       | 109631/371472 [8:43:03<20:31:32,  3.54it/s]
 30%|██▉       | 109632/371472 [8:43:03<20:22:18,  3.57it/s]
 30%|██▉       | 109633/371472 [8:43:03<20:25:45,  3.56it/s]
 30%|██▉       | 109634/371472 [8:43:04<20:46:28,  3.50it/s]
 30%|██▉       | 109635/371472 [8:43:04<23:39:54,  3.07it/s]
 30%|██▉       | 109636/371472 [8:43:04<22:37:56,  3.21it/s]
 30%|██▉       | 109637/371472 [8:43:05<21:39:28,  3.36it/s]
 30%|██▉       | 109638/371472 [8:43:05<22:04:16,  3.30it/s]
 30%|██▉       | 109639/371472 [8:43:05<21:02:32,  3.46it/s]
 30%|██▉       | 109640/371472 [8:43:06<22:19:08,  3.26it/s]
                                                            
{'loss': 3.1194, 'learning_rate': 7.34706630179491e-07, 'epoch': 4.72}

 30%|██▉       | 109640/371472 [8:43:06<22:19:08,  3.26it/s]
 30%|██▉       | 109641/371472 [8:43:06<21:34:14,  3.37it/s]
 30%|██▉       | 109642/371472 [8:43:06<20:28:28,  3.55it/s]
 30%|██▉       | 109643/371472 [8:43:06<19:52:27,  3.66it/s]
 30%|██▉       | 109644/371472 [8:43:07<19:15:16,  3.78it/s]
 30%|██▉       | 109645/371472 [8:43:07<19:05:36,  3.81it/s]
 30%|██▉       | 109646/371472 [8:43:07<19:35:48,  3.71it/s]
 30%|██▉       | 109647/371472 [8:43:07<19:49:42,  3.67it/s]
 30%|██▉       | 109648/371472 [8:43:08<19:59:44,  3.64it/s]
 30%|██▉       | 109649/371472 [8:43:08<20:11:36,  3.60it/s]
 30%|██▉       | 109650/371472 [8:43:08<20:10:02,  3.61it/s]
 30%|██▉       | 109651/371472 [8:43:09<20:14:21,  3.59it/s]
 30%|██▉       | 109652/371472 [8:43:09<19:52:21,  3.66it/s]
 30%|██▉       | 109653/371472 [8:43:09<19:35:05,  3.71it/s]
 30%|██▉       | 109654/371472 [8:43:09<19:19:31,  3.76it/s]
 30%|██▉       | 109655/371472 [8:43:10<19:50:44,  3.66it/s]
 30%|██▉       | 109656/371472 [8:43:10<21:12:13,  3.43it/s]
 30%|██▉       | 109657/371472 [8:43:10<22:37:28,  3.21it/s]
 30%|██▉       | 109658/371472 [8:43:11<21:53:57,  3.32it/s]
 30%|██▉       | 109659/371472 [8:43:11<21:44:16,  3.35it/s]
 30%|██▉       | 109660/371472 [8:43:11<20:52:54,  3.48it/s]
                                                            
{'loss': 3.2859, 'learning_rate': 7.346581482040122e-07, 'epoch': 4.72}

 30%|██▉       | 109660/371472 [8:43:11<20:52:54,  3.48it/s]
 30%|██▉       | 109661/371472 [8:43:11<20:55:30,  3.48it/s]
 30%|██▉       | 109662/371472 [8:43:12<20:22:05,  3.57it/s]
 30%|██▉       | 109663/371472 [8:43:12<20:36:54,  3.53it/s]
 30%|██▉       | 109664/371472 [8:43:12<20:43:51,  3.51it/s]
 30%|██▉       | 109665/371472 [8:43:12<20:04:11,  3.62it/s]
 30%|██▉       | 109666/371472 [8:43:13<20:03:13,  3.63it/s]
 30%|██▉       | 109667/371472 [8:43:13<19:28:22,  3.73it/s]
 30%|██▉       | 109668/371472 [8:43:13<19:23:52,  3.75it/s]
 30%|██▉       | 109669/371472 [8:43:14<19:27:19,  3.74it/s]
 30%|██▉       | 109670/371472 [8:43:14<19:50:28,  3.67it/s]
 30%|██▉       | 109671/371472 [8:43:14<19:30:07,  3.73it/s]
 30%|██▉       | 109672/371472 [8:43:14<18:42:55,  3.89it/s]
 30%|██▉       | 109673/371472 [8:43:15<19:47:04,  3.68it/s]
 30%|██▉       | 109674/371472 [8:43:15<19:39:52,  3.70it/s]
 30%|██▉       | 109675/371472 [8:43:15<21:33:49,  3.37it/s]
 30%|██▉       | 109676/371472 [8:43:16<22:29:14,  3.23it/s]
 30%|██▉       | 109677/371472 [8:43:16<21:55:08,  3.32it/s]
 30%|██▉       | 109678/371472 [8:43:16<20:54:08,  3.48it/s]
 30%|██▉       | 109679/371472 [8:43:16<20:25:30,  3.56it/s]
 30%|██▉       | 109680/371472 [8:43:17<19:22:06,  3.75it/s]
                                                            
{'loss': 3.3333, 'learning_rate': 7.346096662285332e-07, 'epoch': 4.72}

 30%|██▉       | 109680/371472 [8:43:17<19:22:06,  3.75it/s]
 30%|██▉       | 109681/371472 [8:43:17<19:15:42,  3.78it/s]
 30%|██▉       | 109682/371472 [8:43:17<20:27:07,  3.56it/s]
 30%|██▉       | 109683/371472 [8:43:17<20:12:20,  3.60it/s]
 30%|██▉       | 109684/371472 [8:43:18<21:23:10,  3.40it/s]
 30%|██▉       | 109685/371472 [8:43:18<21:28:51,  3.39it/s]
 30%|██▉       | 109686/371472 [8:43:18<22:12:05,  3.28it/s]
 30%|██▉       | 109687/371472 [8:43:19<21:32:40,  3.38it/s]
 30%|██▉       | 109688/371472 [8:43:19<21:11:19,  3.43it/s]
 30%|██▉       | 109689/371472 [8:43:19<20:28:47,  3.55it/s]
 30%|██▉       | 109690/371472 [8:43:20<20:55:55,  3.47it/s]
 30%|██▉       | 109691/371472 [8:43:20<22:15:10,  3.27it/s]
 30%|██▉       | 109692/371472 [8:43:20<22:09:26,  3.28it/s]
 30%|██▉       | 109693/371472 [8:43:21<22:59:10,  3.16it/s]
 30%|██▉       | 109694/371472 [8:43:21<21:40:34,  3.35it/s]
 30%|██▉       | 109695/371472 [8:43:21<20:45:07,  3.50it/s]
 30%|██▉       | 109696/371472 [8:43:21<19:33:47,  3.72it/s]
 30%|██▉       | 109697/371472 [8:43:22<20:37:11,  3.53it/s]
 30%|██▉       | 109698/371472 [8:43:22<20:17:54,  3.58it/s]
 30%|██▉       | 109699/371472 [8:43:22<19:25:41,  3.74it/s]
 30%|██▉       | 109700/371472 [8:43:22<20:33:57,  3.54it/s]
                                                            
{'loss': 3.3976, 'learning_rate': 7.345611842530543e-07, 'epoch': 4.72}

 30%|██▉       | 109700/371472 [8:43:22<20:33:57,  3.54it/s]
 30%|██▉       | 109701/371472 [8:43:23<20:21:49,  3.57it/s]
 30%|██▉       | 109702/371472 [8:43:23<19:51:00,  3.66it/s]
 30%|██▉       | 109703/371472 [8:43:23<20:02:38,  3.63it/s]
 30%|██▉       | 109704/371472 [8:43:24<19:46:45,  3.68it/s]
 30%|██▉       | 109705/371472 [8:43:24<19:57:41,  3.64it/s]
 30%|██▉       | 109706/371472 [8:43:24<19:42:50,  3.69it/s]
 30%|██▉       | 109707/371472 [8:43:24<19:40:38,  3.70it/s]
 30%|██▉       | 109708/371472 [8:43:25<19:26:14,  3.74it/s]
 30%|██▉       | 109709/371472 [8:43:25<19:21:03,  3.76it/s]
 30%|██▉       | 109710/371472 [8:43:25<19:30:36,  3.73it/s]
 30%|██▉       | 109711/371472 [8:43:25<20:38:27,  3.52it/s]
 30%|██▉       | 109712/371472 [8:43:26<20:09:43,  3.61it/s]
 30%|██▉       | 109713/371472 [8:43:26<20:52:13,  3.48it/s]
 30%|██▉       | 109714/371472 [8:43:26<20:06:51,  3.61it/s]
 30%|██▉       | 109715/371472 [8:43:27<20:47:39,  3.50it/s]
 30%|██▉       | 109716/371472 [8:43:27<21:24:31,  3.40it/s]
 30%|██▉       | 109717/371472 [8:43:27<20:14:25,  3.59it/s]
 30%|██▉       | 109718/371472 [8:43:27<20:48:14,  3.49it/s]
 30%|██▉       | 109719/371472 [8:43:28<22:35:23,  3.22it/s]
 30%|██▉       | 109720/371472 [8:43:28<22:44:36,  3.20it/s]
                                                            
{'loss': 3.5718, 'learning_rate': 7.345127022775754e-07, 'epoch': 4.73}

 30%|██▉       | 109720/371472 [8:43:28<22:44:36,  3.20it/s]
 30%|██▉       | 109721/371472 [8:43:28<21:40:30,  3.35it/s]
 30%|██▉       | 109722/371472 [8:43:29<21:46:34,  3.34it/s]
 30%|██▉       | 109723/371472 [8:43:29<20:38:20,  3.52it/s]
 30%|██▉       | 109724/371472 [8:43:29<20:55:40,  3.47it/s]
 30%|██▉       | 109725/371472 [8:43:30<20:48:55,  3.49it/s]
 30%|██▉       | 109726/371472 [8:43:30<20:24:54,  3.56it/s]
 30%|██▉       | 109727/371472 [8:43:30<22:10:04,  3.28it/s]
 30%|██▉       | 109728/371472 [8:43:30<20:56:05,  3.47it/s]
 30%|██▉       | 109729/371472 [8:43:31<20:43:06,  3.51it/s]
 30%|██▉       | 109730/371472 [8:43:31<19:59:30,  3.64it/s]
 30%|██▉       | 109731/371472 [8:43:31<21:18:22,  3.41it/s]
 30%|██▉       | 109732/371472 [8:43:32<21:25:34,  3.39it/s]
 30%|██▉       | 109733/371472 [8:43:32<20:58:46,  3.47it/s]
 30%|██▉       | 109734/371472 [8:43:32<22:11:35,  3.28it/s]
 30%|██▉       | 109735/371472 [8:43:32<21:25:20,  3.39it/s]
 30%|██▉       | 109736/371472 [8:43:33<22:13:58,  3.27it/s]
 30%|██▉       | 109737/371472 [8:43:33<21:44:04,  3.35it/s]
 30%|██▉       | 109738/371472 [8:43:33<20:47:31,  3.50it/s]
 30%|██▉       | 109739/371472 [8:43:34<24:30:40,  2.97it/s]
 30%|██▉       | 109740/371472 [8:43:34<22:51:52,  3.18it/s]
                                                            
{'loss': 3.234, 'learning_rate': 7.344642203020966e-07, 'epoch': 4.73}

 30%|██▉       | 109740/371472 [8:43:34<22:51:52,  3.18it/s]
 30%|██▉       | 109741/371472 [8:43:34<22:26:49,  3.24it/s]
 30%|██▉       | 109742/371472 [8:43:35<22:06:26,  3.29it/s]
 30%|██▉       | 109743/371472 [8:43:35<22:39:08,  3.21it/s]
 30%|██▉       | 109744/371472 [8:43:35<21:18:41,  3.41it/s]
 30%|██▉       | 109745/371472 [8:43:36<21:38:07,  3.36it/s]
 30%|██▉       | 109746/371472 [8:43:36<22:07:45,  3.29it/s]
 30%|██▉       | 109747/371472 [8:43:36<21:25:35,  3.39it/s]
 30%|██▉       | 109748/371472 [8:43:36<20:54:57,  3.48it/s]
 30%|██▉       | 109749/371472 [8:43:37<21:43:00,  3.35it/s]
 30%|██▉       | 109750/371472 [8:43:37<21:57:48,  3.31it/s]
 30%|██▉       | 109751/371472 [8:43:37<23:02:21,  3.16it/s]
 30%|██▉       | 109752/371472 [8:43:38<22:54:56,  3.17it/s]
 30%|██▉       | 109753/371472 [8:43:38<22:49:48,  3.18it/s]
 30%|██▉       | 109754/371472 [8:43:38<23:39:55,  3.07it/s]
 30%|██▉       | 109755/371472 [8:43:39<22:26:32,  3.24it/s]
 30%|██▉       | 109756/371472 [8:43:39<22:13:32,  3.27it/s]
 30%|██▉       | 109757/371472 [8:43:39<22:01:33,  3.30it/s]
 30%|██▉       | 109758/371472 [8:43:40<22:41:04,  3.20it/s]
 30%|██▉       | 109759/371472 [8:43:40<22:12:35,  3.27it/s]
 30%|██▉       | 109760/371472 [8:43:40<21:38:31,  3.36it/s]
                                                            
{'loss': 3.247, 'learning_rate': 7.344157383266177e-07, 'epoch': 4.73}

 30%|██▉       | 109760/371472 [8:43:40<21:38:31,  3.36it/s]
 30%|██▉       | 109761/371472 [8:43:40<20:59:31,  3.46it/s]
 30%|██▉       | 109762/371472 [8:43:41<21:00:15,  3.46it/s]
 30%|██▉       | 109763/371472 [8:43:41<21:00:11,  3.46it/s]
 30%|██▉       | 109764/371472 [8:43:41<23:07:38,  3.14it/s]
 30%|██▉       | 109765/371472 [8:43:42<22:25:50,  3.24it/s]
 30%|██▉       | 109766/371472 [8:43:42<21:42:59,  3.35it/s]
 30%|██▉       | 109767/371472 [8:43:42<21:20:13,  3.41it/s]
 30%|██▉       | 109768/371472 [8:43:43<23:07:12,  3.14it/s]
 30%|██▉       | 109769/371472 [8:43:43<22:49:00,  3.19it/s]
 30%|██▉       | 109770/371472 [8:43:43<21:48:33,  3.33it/s]
 30%|██▉       | 109771/371472 [8:43:43<21:24:43,  3.40it/s]
 30%|██▉       | 109772/371472 [8:43:44<22:21:51,  3.25it/s]
 30%|██▉       | 109773/371472 [8:43:44<21:08:28,  3.44it/s]
 30%|██▉       | 109774/371472 [8:43:44<20:32:46,  3.54it/s]
 30%|██▉       | 109775/371472 [8:43:45<20:04:03,  3.62it/s]
 30%|██▉       | 109776/371472 [8:43:45<19:24:14,  3.75it/s]
 30%|██▉       | 109777/371472 [8:43:45<19:49:39,  3.67it/s]
 30%|██▉       | 109778/371472 [8:43:45<19:58:35,  3.64it/s]
 30%|██▉       | 109779/371472 [8:43:46<19:48:19,  3.67it/s]
 30%|██▉       | 109780/371472 [8:43:46<19:28:10,  3.73it/s]
                                                            
{'loss': 3.3834, 'learning_rate': 7.343672563511388e-07, 'epoch': 4.73}

 30%|██▉       | 109780/371472 [8:43:46<19:28:10,  3.73it/s]
 30%|██▉       | 109781/371472 [8:43:46<19:56:58,  3.64it/s]
 30%|██▉       | 109782/371472 [8:43:46<19:23:27,  3.75it/s]
 30%|██▉       | 109783/371472 [8:43:47<19:00:34,  3.82it/s]
 30%|██▉       | 109784/371472 [8:43:47<19:04:01,  3.81it/s]
 30%|██▉       | 109785/371472 [8:43:47<19:09:39,  3.79it/s]
 30%|██▉       | 109786/371472 [8:43:47<19:56:43,  3.64it/s]
 30%|██▉       | 109787/371472 [8:43:48<19:56:40,  3.64it/s]
 30%|██▉       | 109788/371472 [8:43:48<20:17:41,  3.58it/s]
 30%|██▉       | 109789/371472 [8:43:48<20:47:07,  3.50it/s]
 30%|██▉       | 109790/371472 [8:43:49<20:59:15,  3.46it/s]
 30%|██▉       | 109791/371472 [8:43:49<20:17:26,  3.58it/s]
 30%|██▉       | 109792/371472 [8:43:49<19:40:46,  3.69it/s]
 30%|██▉       | 109793/371472 [8:43:49<19:27:24,  3.74it/s]
 30%|██▉       | 109794/371472 [8:43:50<19:55:23,  3.65it/s]
 30%|██▉       | 109795/371472 [8:43:50<19:21:56,  3.75it/s]
 30%|██▉       | 109796/371472 [8:43:50<19:38:01,  3.70it/s]
 30%|██▉       | 109797/371472 [8:43:50<19:25:36,  3.74it/s]
 30%|██▉       | 109798/371472 [8:43:51<19:17:22,  3.77it/s]
 30%|██▉       | 109799/371472 [8:43:51<20:21:13,  3.57it/s]
 30%|██▉       | 109800/371472 [8:43:51<20:38:15,  3.52it/s]
                                                            
{'loss': 3.4639, 'learning_rate': 7.343187743756599e-07, 'epoch': 4.73}

 30%|██▉       | 109800/371472 [8:43:51<20:38:15,  3.52it/s]
 30%|██▉       | 109801/371472 [8:43:52<20:23:21,  3.56it/s]
 30%|██▉       | 109802/371472 [8:43:52<19:43:14,  3.69it/s]
 30%|██▉       | 109803/371472 [8:43:52<19:44:09,  3.68it/s]
 30%|██▉       | 109804/371472 [8:43:52<19:11:58,  3.79it/s]
 30%|██▉       | 109805/371472 [8:43:53<25:58:05,  2.80it/s]
 30%|██▉       | 109806/371472 [8:43:53<24:00:10,  3.03it/s]
 30%|██▉       | 109807/371472 [8:43:53<22:15:53,  3.26it/s]
 30%|██▉       | 109808/371472 [8:43:54<22:08:29,  3.28it/s]
 30%|██▉       | 109809/371472 [8:43:54<21:03:45,  3.45it/s]
 30%|██▉       | 109810/371472 [8:43:54<21:08:23,  3.44it/s]
 30%|██▉       | 109811/371472 [8:43:55<20:36:11,  3.53it/s]
 30%|██▉       | 109812/371472 [8:43:55<22:57:47,  3.17it/s]
 30%|██▉       | 109813/371472 [8:43:55<22:23:58,  3.24it/s]
 30%|██▉       | 109814/371472 [8:43:56<21:04:58,  3.45it/s]
 30%|██▉       | 109815/371472 [8:43:56<21:07:49,  3.44it/s]
 30%|██▉       | 109816/371472 [8:43:56<20:24:08,  3.56it/s]
 30%|██▉       | 109817/371472 [8:43:56<21:03:37,  3.45it/s]
 30%|██▉       | 109818/371472 [8:43:57<20:27:07,  3.55it/s]
 30%|██▉       | 109819/371472 [8:43:57<23:37:00,  3.08it/s]
 30%|██▉       | 109820/371472 [8:43:57<21:41:52,  3.35it/s]
                                                            
{'loss': 3.4121, 'learning_rate': 7.34270292400181e-07, 'epoch': 4.73}

 30%|██▉       | 109820/371472 [8:43:57<21:41:52,  3.35it/s]
 30%|██▉       | 109821/371472 [8:43:58<21:12:36,  3.43it/s]
 30%|██▉       | 109822/371472 [8:43:58<20:37:17,  3.52it/s]
 30%|██▉       | 109823/371472 [8:43:58<21:31:45,  3.38it/s]
 30%|██▉       | 109824/371472 [8:43:58<20:52:58,  3.48it/s]
 30%|██▉       | 109825/371472 [8:43:59<20:21:21,  3.57it/s]
 30%|██▉       | 109826/371472 [8:43:59<21:22:38,  3.40it/s]
 30%|██▉       | 109827/371472 [8:43:59<20:30:27,  3.54it/s]
 30%|██▉       | 109828/371472 [8:44:00<21:28:23,  3.38it/s]
 30%|██▉       | 109829/371472 [8:44:00<20:44:34,  3.50it/s]
 30%|██▉       | 109830/371472 [8:44:00<20:41:14,  3.51it/s]
 30%|██▉       | 109831/371472 [8:44:00<20:20:42,  3.57it/s]
 30%|██▉       | 109832/371472 [8:44:01<23:08:41,  3.14it/s]
 30%|██▉       | 109833/371472 [8:44:01<23:56:35,  3.04it/s]
 30%|██▉       | 109834/371472 [8:44:02<23:31:49,  3.09it/s]
 30%|██▉       | 109835/371472 [8:44:02<23:34:25,  3.08it/s]
 30%|██▉       | 109836/371472 [8:44:02<22:47:13,  3.19it/s]
 30%|██▉       | 109837/371472 [8:44:02<23:32:39,  3.09it/s]
 30%|██▉       | 109838/371472 [8:44:03<22:25:45,  3.24it/s]
 30%|██▉       | 109839/371472 [8:44:03<21:39:04,  3.36it/s]
 30%|██▉       | 109840/371472 [8:44:03<20:57:10,  3.47it/s]
                                                            
{'loss': 3.4958, 'learning_rate': 7.34221810424702e-07, 'epoch': 4.73}

 30%|██▉       | 109840/371472 [8:44:03<20:57:10,  3.47it/s]
 30%|██▉       | 109841/371472 [8:44:04<20:54:12,  3.48it/s]
 30%|██▉       | 109842/371472 [8:44:04<21:08:42,  3.44it/s]
 30%|██▉       | 109843/371472 [8:44:04<20:24:52,  3.56it/s]
 30%|██▉       | 109844/371472 [8:44:04<20:38:10,  3.52it/s]
 30%|██▉       | 109845/371472 [8:44:05<20:27:54,  3.55it/s]
 30%|██▉       | 109846/371472 [8:44:05<20:38:09,  3.52it/s]
 30%|██▉       | 109847/371472 [8:44:05<20:32:39,  3.54it/s]
 30%|██▉       | 109848/371472 [8:44:06<19:46:31,  3.67it/s]
 30%|██▉       | 109849/371472 [8:44:06<19:12:32,  3.78it/s]
 30%|██▉       | 109850/371472 [8:44:06<19:42:37,  3.69it/s]
 30%|██▉       | 109851/371472 [8:44:06<19:29:44,  3.73it/s]
 30%|██▉       | 109852/371472 [8:44:07<20:00:00,  3.63it/s]
 30%|██▉       | 109853/371472 [8:44:07<20:13:21,  3.59it/s]
 30%|██▉       | 109854/371472 [8:44:07<20:44:42,  3.50it/s]
 30%|██▉       | 109855/371472 [8:44:07<20:46:00,  3.50it/s]
 30%|██▉       | 109856/371472 [8:44:08<21:11:55,  3.43it/s]
 30%|██▉       | 109857/371472 [8:44:08<21:44:28,  3.34it/s]
 30%|██▉       | 109858/371472 [8:44:08<21:24:38,  3.39it/s]
 30%|██▉       | 109859/371472 [8:44:09<24:21:54,  2.98it/s]
 30%|██▉       | 109860/371472 [8:44:09<23:24:14,  3.11it/s]
                                                            
{'loss': 3.4193, 'learning_rate': 7.341733284492231e-07, 'epoch': 4.73}

 30%|██▉       | 109860/371472 [8:44:09<23:24:14,  3.11it/s]
 30%|██▉       | 109861/371472 [8:44:09<22:28:36,  3.23it/s]
 30%|██▉       | 109862/371472 [8:44:10<23:02:26,  3.15it/s]
 30%|██▉       | 109863/371472 [8:44:10<22:44:17,  3.20it/s]
 30%|██▉       | 109864/371472 [8:44:10<22:10:10,  3.28it/s]
 30%|██▉       | 109865/371472 [8:44:11<20:48:37,  3.49it/s]
 30%|██▉       | 109866/371472 [8:44:11<19:40:07,  3.69it/s]
 30%|██▉       | 109867/371472 [8:44:11<19:08:02,  3.80it/s]
 30%|██▉       | 109868/371472 [8:44:11<20:21:13,  3.57it/s]
 30%|██▉       | 109869/371472 [8:44:12<20:39:04,  3.52it/s]
 30%|██▉       | 109870/371472 [8:44:12<19:56:33,  3.64it/s]
 30%|██▉       | 109871/371472 [8:44:12<20:25:41,  3.56it/s]
 30%|██▉       | 109872/371472 [8:44:13<21:21:48,  3.40it/s]
 30%|██▉       | 109873/371472 [8:44:13<22:31:57,  3.22it/s]
 30%|██▉       | 109874/371472 [8:44:13<22:08:25,  3.28it/s]
 30%|██▉       | 109875/371472 [8:44:13<21:39:02,  3.36it/s]
 30%|██▉       | 109876/371472 [8:44:14<20:36:28,  3.53it/s]
 30%|██▉       | 109877/371472 [8:44:14<20:38:08,  3.52it/s]
 30%|██▉       | 109878/371472 [8:44:14<19:41:21,  3.69it/s]
 30%|██▉       | 109879/371472 [8:44:15<20:35:39,  3.53it/s]
 30%|██▉       | 109880/371472 [8:44:15<21:51:56,  3.32it/s]
                                                            
{'loss': 3.4574, 'learning_rate': 7.341248464737443e-07, 'epoch': 4.73}

 30%|██▉       | 109880/371472 [8:44:15<21:51:56,  3.32it/s]
 30%|██▉       | 109881/371472 [8:44:15<21:07:33,  3.44it/s]
 30%|██▉       | 109882/371472 [8:44:15<20:55:53,  3.47it/s]
 30%|██▉       | 109883/371472 [8:44:16<20:07:13,  3.61it/s]
 30%|██▉       | 109884/371472 [8:44:16<19:47:44,  3.67it/s]
 30%|██▉       | 109885/371472 [8:44:16<19:52:42,  3.66it/s]
 30%|██▉       | 109886/371472 [8:44:16<19:22:42,  3.75it/s]
 30%|██▉       | 109887/371472 [8:44:17<20:11:08,  3.60it/s]
 30%|██▉       | 109888/371472 [8:44:17<21:00:24,  3.46it/s]
 30%|██▉       | 109889/371472 [8:44:17<20:56:57,  3.47it/s]
 30%|██▉       | 109890/371472 [8:44:18<20:09:37,  3.60it/s]
 30%|██▉       | 109891/371472 [8:44:18<19:58:37,  3.64it/s]
 30%|██▉       | 109892/371472 [8:44:18<19:57:25,  3.64it/s]
 30%|██▉       | 109893/371472 [8:44:18<20:33:07,  3.54it/s]
 30%|██▉       | 109894/371472 [8:44:19<20:06:25,  3.61it/s]
 30%|██▉       | 109895/371472 [8:44:19<19:58:12,  3.64it/s]
 30%|██▉       | 109896/371472 [8:44:19<20:42:02,  3.51it/s]
 30%|██▉       | 109897/371472 [8:44:20<21:08:54,  3.44it/s]
 30%|██▉       | 109898/371472 [8:44:20<20:31:16,  3.54it/s]
 30%|██▉       | 109899/371472 [8:44:20<19:53:04,  3.65it/s]
 30%|██▉       | 109900/371472 [8:44:20<19:50:04,  3.66it/s]
                                                            
{'loss': 3.3919, 'learning_rate': 7.340763644982654e-07, 'epoch': 4.73}

 30%|██▉       | 109900/371472 [8:44:20<19:50:04,  3.66it/s]
 30%|██▉       | 109901/371472 [8:44:21<19:32:18,  3.72it/s]
 30%|██▉       | 109902/371472 [8:44:21<20:34:22,  3.53it/s]
 30%|██▉       | 109903/371472 [8:44:21<21:34:12,  3.37it/s]
 30%|██▉       | 109904/371472 [8:44:22<21:00:12,  3.46it/s]
 30%|██▉       | 109905/371472 [8:44:22<20:54:53,  3.47it/s]
 30%|██▉       | 109906/371472 [8:44:22<20:15:24,  3.59it/s]
 30%|██▉       | 109907/371472 [8:44:22<20:04:50,  3.62it/s]
 30%|██▉       | 109908/371472 [8:44:23<19:44:24,  3.68it/s]
 30%|██▉       | 109909/371472 [8:44:23<19:58:37,  3.64it/s]
 30%|██▉       | 109910/371472 [8:44:23<19:48:20,  3.67it/s]
 30%|██▉       | 109911/371472 [8:44:23<19:35:11,  3.71it/s]
 30%|██▉       | 109912/371472 [8:44:24<19:27:19,  3.73it/s]
 30%|██▉       | 109913/371472 [8:44:24<19:15:12,  3.77it/s]
 30%|██▉       | 109914/371472 [8:44:24<19:42:24,  3.69it/s]
 30%|██▉       | 109915/371472 [8:44:25<21:02:26,  3.45it/s]
 30%|██▉       | 109916/371472 [8:44:25<22:52:39,  3.18it/s]
 30%|██▉       | 109917/371472 [8:44:25<22:09:21,  3.28it/s]
 30%|██▉       | 109918/371472 [8:44:26<23:18:43,  3.12it/s]
 30%|██▉       | 109919/371472 [8:44:26<22:07:49,  3.28it/s]
 30%|██▉       | 109920/371472 [8:44:26<24:16:07,  2.99it/s]
                                                            
{'loss': 3.4558, 'learning_rate': 7.340278825227865e-07, 'epoch': 4.73}

 30%|██▉       | 109920/371472 [8:44:26<24:16:07,  2.99it/s]
 30%|██▉       | 109921/371472 [8:44:27<23:24:48,  3.10it/s]
 30%|██▉       | 109922/371472 [8:44:27<21:49:03,  3.33it/s]
 30%|██▉       | 109923/371472 [8:44:27<20:52:42,  3.48it/s]
 30%|██▉       | 109924/371472 [8:44:27<20:28:57,  3.55it/s]
 30%|██▉       | 109925/371472 [8:44:28<20:08:06,  3.61it/s]
 30%|██▉       | 109926/371472 [8:44:28<19:53:28,  3.65it/s]
 30%|██▉       | 109927/371472 [8:44:28<20:24:23,  3.56it/s]
 30%|██▉       | 109928/371472 [8:44:28<20:43:20,  3.51it/s]
 30%|██▉       | 109929/371472 [8:44:29<21:21:31,  3.40it/s]
 30%|██▉       | 109930/371472 [8:44:29<22:57:55,  3.16it/s]
 30%|██▉       | 109931/371472 [8:44:29<22:04:17,  3.29it/s]
 30%|██▉       | 109932/371472 [8:44:30<22:24:37,  3.24it/s]
 30%|██▉       | 109933/371472 [8:44:30<21:20:15,  3.40it/s]
 30%|██▉       | 109934/371472 [8:44:30<21:07:43,  3.44it/s]
 30%|██▉       | 109935/371472 [8:44:31<21:18:05,  3.41it/s]
 30%|██▉       | 109936/371472 [8:44:31<21:13:15,  3.42it/s]
 30%|██▉       | 109937/371472 [8:44:31<20:28:55,  3.55it/s]
 30%|██▉       | 109938/371472 [8:44:31<21:13:10,  3.42it/s]
 30%|██▉       | 109939/371472 [8:44:32<20:46:43,  3.50it/s]
 30%|██▉       | 109940/371472 [8:44:32<21:08:28,  3.44it/s]
                                                            
{'loss': 3.3465, 'learning_rate': 7.339794005473075e-07, 'epoch': 4.74}

 30%|██▉       | 109940/371472 [8:44:32<21:08:28,  3.44it/s]
 30%|██▉       | 109941/371472 [8:44:32<20:02:13,  3.63it/s]
 30%|██▉       | 109942/371472 [8:44:33<20:09:26,  3.60it/s]
 30%|██▉       | 109943/371472 [8:44:33<20:59:32,  3.46it/s]
 30%|██▉       | 109944/371472 [8:44:33<20:37:22,  3.52it/s]
 30%|██▉       | 109945/371472 [8:44:33<19:50:49,  3.66it/s]
 30%|██▉       | 109946/371472 [8:44:34<20:10:11,  3.60it/s]
 30%|██▉       | 109947/371472 [8:44:34<20:43:31,  3.51it/s]
 30%|██▉       | 109948/371472 [8:44:34<20:24:51,  3.56it/s]
 30%|██▉       | 109949/371472 [8:44:35<20:05:51,  3.61it/s]
 30%|██▉       | 109950/371472 [8:44:35<19:39:42,  3.69it/s]
 30%|██▉       | 109951/371472 [8:44:35<19:29:30,  3.73it/s]
 30%|██▉       | 109952/371472 [8:44:35<21:53:10,  3.32it/s]
 30%|██▉       | 109953/371472 [8:44:36<21:18:00,  3.41it/s]
 30%|██▉       | 109954/371472 [8:44:36<21:23:42,  3.40it/s]
 30%|██▉       | 109955/371472 [8:44:36<20:55:34,  3.47it/s]
 30%|██▉       | 109956/371472 [8:44:36<19:53:24,  3.65it/s]
 30%|██▉       | 109957/371472 [8:44:37<19:28:25,  3.73it/s]
 30%|██▉       | 109958/371472 [8:44:37<19:41:39,  3.69it/s]
 30%|██▉       | 109959/371472 [8:44:37<19:24:34,  3.74it/s]
 30%|██▉       | 109960/371472 [8:44:38<20:53:11,  3.48it/s]
                                                            
{'loss': 3.4276, 'learning_rate': 7.339309185718287e-07, 'epoch': 4.74}

 30%|██▉       | 109960/371472 [8:44:38<20:53:11,  3.48it/s]
 30%|██▉       | 109961/371472 [8:44:38<21:16:54,  3.41it/s]
 30%|██▉       | 109962/371472 [8:44:38<20:57:01,  3.47it/s]
 30%|██▉       | 109963/371472 [8:44:38<21:04:08,  3.45it/s]
 30%|██▉       | 109964/371472 [8:44:39<20:08:34,  3.61it/s]
 30%|██▉       | 109965/371472 [8:44:39<20:05:24,  3.62it/s]
 30%|██▉       | 109966/371472 [8:44:39<19:29:27,  3.73it/s]
 30%|██▉       | 109967/371472 [8:44:40<19:59:29,  3.63it/s]
 30%|██▉       | 109968/371472 [8:44:40<20:31:53,  3.54it/s]
 30%|██▉       | 109969/371472 [8:44:40<20:08:24,  3.61it/s]
 30%|██▉       | 109970/371472 [8:44:40<20:15:29,  3.59it/s]
 30%|██▉       | 109971/371472 [8:44:41<19:48:17,  3.67it/s]
 30%|██▉       | 109972/371472 [8:44:41<21:06:56,  3.44it/s]
 30%|██▉       | 109973/371472 [8:44:41<20:45:29,  3.50it/s]
 30%|██▉       | 109974/371472 [8:44:42<21:09:05,  3.43it/s]
 30%|██▉       | 109975/371472 [8:44:42<23:07:40,  3.14it/s]
 30%|██▉       | 109976/371472 [8:44:42<22:36:02,  3.21it/s]
 30%|██▉       | 109977/371472 [8:44:43<22:08:56,  3.28it/s]
 30%|██▉       | 109978/371472 [8:44:43<21:06:48,  3.44it/s]
 30%|██▉       | 109979/371472 [8:44:43<21:25:28,  3.39it/s]
 30%|██▉       | 109980/371472 [8:44:43<20:23:27,  3.56it/s]
                                                            
{'loss': 3.4679, 'learning_rate': 7.338824365963498e-07, 'epoch': 4.74}

 30%|██▉       | 109980/371472 [8:44:43<20:23:27,  3.56it/s]
 30%|██▉       | 109981/371472 [8:44:44<20:22:14,  3.57it/s]
 30%|██▉       | 109982/371472 [8:44:44<20:41:01,  3.51it/s]
 30%|██▉       | 109983/371472 [8:44:44<20:12:22,  3.59it/s]
 30%|██▉       | 109984/371472 [8:44:45<21:12:24,  3.43it/s]
 30%|██▉       | 109985/371472 [8:44:45<20:46:05,  3.50it/s]
 30%|██▉       | 109986/371472 [8:44:45<22:00:35,  3.30it/s]
 30%|██▉       | 109987/371472 [8:44:45<22:03:13,  3.29it/s]
 30%|██▉       | 109988/371472 [8:44:46<22:15:35,  3.26it/s]
 30%|██▉       | 109989/371472 [8:44:46<21:10:42,  3.43it/s]
 30%|██▉       | 109990/371472 [8:44:46<20:42:26,  3.51it/s]
 30%|██▉       | 109991/371472 [8:44:47<21:41:45,  3.35it/s]
 30%|██▉       | 109992/371472 [8:44:47<20:42:20,  3.51it/s]
 30%|██▉       | 109993/371472 [8:44:47<20:28:49,  3.55it/s]
 30%|██▉       | 109994/371472 [8:44:47<20:43:38,  3.50it/s]
 30%|██▉       | 109995/371472 [8:44:48<19:57:46,  3.64it/s]
 30%|██▉       | 109996/371472 [8:44:48<22:50:15,  3.18it/s]
 30%|██▉       | 109997/371472 [8:44:48<22:15:52,  3.26it/s]
 30%|██▉       | 109998/371472 [8:44:49<22:33:41,  3.22it/s]
 30%|██▉       | 109999/371472 [8:44:49<21:58:14,  3.31it/s]
 30%|██▉       | 110000/371472 [8:44:49<21:17:41,  3.41it/s]
                                                            
{'loss': 3.3457, 'learning_rate': 7.338339546208709e-07, 'epoch': 4.74}

 30%|██▉       | 110000/371472 [8:44:49<21:17:41,  3.41it/s]
 30%|██▉       | 110001/371472 [8:44:49<20:34:30,  3.53it/s]
 30%|██▉       | 110002/371472 [8:44:50<21:12:34,  3.42it/s]
 30%|██▉       | 110003/371472 [8:44:50<20:21:51,  3.57it/s]
 30%|██▉       | 110004/371472 [8:44:50<21:41:24,  3.35it/s]
 30%|██▉       | 110005/371472 [8:44:51<23:17:12,  3.12it/s]
 30%|██▉       | 110006/371472 [8:44:51<21:24:08,  3.39it/s]
 30%|██▉       | 110007/371472 [8:44:51<21:12:02,  3.43it/s]
 30%|██▉       | 110008/371472 [8:44:52<21:37:05,  3.36it/s]
 30%|██▉       | 110009/371472 [8:44:52<21:04:25,  3.45it/s]
 30%|██▉       | 110010/371472 [8:44:52<21:43:47,  3.34it/s]
 30%|██▉       | 110011/371472 [8:44:53<21:43:38,  3.34it/s]
 30%|██▉       | 110012/371472 [8:44:53<21:28:04,  3.38it/s]
 30%|██▉       | 110013/371472 [8:44:53<20:09:08,  3.60it/s]
 30%|██▉       | 110014/371472 [8:44:53<19:17:40,  3.76it/s]
 30%|██▉       | 110015/371472 [8:44:54<19:57:21,  3.64it/s]
 30%|██▉       | 110016/371472 [8:44:54<20:26:02,  3.55it/s]
 30%|██▉       | 110017/371472 [8:44:54<19:26:17,  3.74it/s]
 30%|██▉       | 110018/371472 [8:44:54<18:54:01,  3.84it/s]
 30%|██▉       | 110019/371472 [8:44:55<19:19:27,  3.76it/s]
 30%|██▉       | 110020/371472 [8:44:55<19:18:43,  3.76it/s]
                                                            
{'loss': 3.1823, 'learning_rate': 7.33785472645392e-07, 'epoch': 4.74}

 30%|██▉       | 110020/371472 [8:44:55<19:18:43,  3.76it/s]
 30%|██▉       | 110021/371472 [8:44:55<20:47:44,  3.49it/s]
 30%|██▉       | 110022/371472 [8:44:56<21:15:41,  3.42it/s]
 30%|██▉       | 110023/371472 [8:44:56<21:04:17,  3.45it/s]
 30%|██▉       | 110024/371472 [8:44:56<20:16:17,  3.58it/s]
 30%|██▉       | 110025/371472 [8:44:56<22:40:27,  3.20it/s]
 30%|██▉       | 110026/371472 [8:44:57<22:23:57,  3.24it/s]
 30%|██▉       | 110027/371472 [8:44:57<22:06:04,  3.29it/s]
 30%|██▉       | 110028/371472 [8:44:57<22:28:10,  3.23it/s]
 30%|██▉       | 110029/371472 [8:44:58<21:09:10,  3.43it/s]
 30%|██▉       | 110030/371472 [8:44:58<20:12:36,  3.59it/s]
 30%|██▉       | 110031/371472 [8:44:58<22:42:39,  3.20it/s]
 30%|██▉       | 110032/371472 [8:44:59<22:38:25,  3.21it/s]
 30%|██▉       | 110033/371472 [8:44:59<21:31:22,  3.37it/s]
 30%|██▉       | 110034/371472 [8:44:59<20:21:52,  3.57it/s]
 30%|██▉       | 110035/371472 [8:44:59<20:09:20,  3.60it/s]
 30%|██▉       | 110036/371472 [8:45:00<19:58:38,  3.64it/s]
 30%|██▉       | 110037/371472 [8:45:00<20:59:12,  3.46it/s]
 30%|██▉       | 110038/371472 [8:45:00<20:23:45,  3.56it/s]
 30%|██▉       | 110039/371472 [8:45:00<20:25:56,  3.55it/s]
 30%|██▉       | 110040/371472 [8:45:01<20:30:40,  3.54it/s]
                                                            
{'loss': 3.2189, 'learning_rate': 7.337369906699132e-07, 'epoch': 4.74}

 30%|██▉       | 110040/371472 [8:45:01<20:30:40,  3.54it/s]
 30%|██▉       | 110041/371472 [8:45:01<20:28:52,  3.55it/s]
 30%|██▉       | 110042/371472 [8:45:01<20:28:38,  3.55it/s]
 30%|██▉       | 110043/371472 [8:45:02<21:53:56,  3.32it/s]
 30%|██▉       | 110044/371472 [8:45:02<21:26:37,  3.39it/s]
 30%|██▉       | 110045/371472 [8:45:02<21:24:11,  3.39it/s]
 30%|██▉       | 110046/371472 [8:45:03<22:13:38,  3.27it/s]
 30%|██▉       | 110047/371472 [8:45:03<21:35:42,  3.36it/s]
 30%|██▉       | 110048/371472 [8:45:03<21:09:28,  3.43it/s]
 30%|██▉       | 110049/371472 [8:45:03<20:51:10,  3.48it/s]
 30%|██▉       | 110050/371472 [8:45:04<20:50:57,  3.48it/s]
 30%|██▉       | 110051/371472 [8:45:04<20:04:15,  3.62it/s]
 30%|██▉       | 110052/371472 [8:45:04<19:32:57,  3.71it/s]
 30%|██▉       | 110053/371472 [8:45:05<21:25:44,  3.39it/s]
 30%|██▉       | 110054/371472 [8:45:05<20:53:26,  3.48it/s]
 30%|██▉       | 110055/371472 [8:45:05<20:51:53,  3.48it/s]
 30%|██▉       | 110056/371472 [8:45:05<20:12:42,  3.59it/s]
 30%|██▉       | 110057/371472 [8:45:06<20:25:34,  3.56it/s]
 30%|██▉       | 110058/371472 [8:45:06<21:27:17,  3.38it/s]
 30%|██▉       | 110059/371472 [8:45:06<21:05:01,  3.44it/s]
 30%|██▉       | 110060/371472 [8:45:07<22:52:33,  3.17it/s]
                                                            
{'loss': 3.4356, 'learning_rate': 7.336885086944342e-07, 'epoch': 4.74}

 30%|██▉       | 110060/371472 [8:45:07<22:52:33,  3.17it/s]
 30%|██▉       | 110061/371472 [8:45:07<21:13:20,  3.42it/s]
 30%|██▉       | 110062/371472 [8:45:07<23:01:56,  3.15it/s]
 30%|██▉       | 110063/371472 [8:45:08<22:32:38,  3.22it/s]
 30%|██▉       | 110064/371472 [8:45:08<21:23:55,  3.39it/s]
 30%|██▉       | 110065/371472 [8:45:08<22:20:29,  3.25it/s]
 30%|██▉       | 110066/371472 [8:45:08<21:53:39,  3.32it/s]
 30%|██▉       | 110067/371472 [8:45:09<21:41:49,  3.35it/s]
 30%|██▉       | 110068/371472 [8:45:09<21:20:32,  3.40it/s]
 30%|██▉       | 110069/371472 [8:45:09<20:51:18,  3.48it/s]
 30%|██▉       | 110070/371472 [8:45:10<19:53:46,  3.65it/s]
 30%|██▉       | 110071/371472 [8:45:10<29:57:41,  2.42it/s]
 30%|██▉       | 110072/371472 [8:45:11<27:34:17,  2.63it/s]
 30%|██▉       | 110073/371472 [8:45:11<24:43:16,  2.94it/s]
 30%|██▉       | 110074/371472 [8:45:11<23:24:50,  3.10it/s]
 30%|██▉       | 110075/371472 [8:45:11<21:20:28,  3.40it/s]
 30%|██▉       | 110076/371472 [8:45:12<20:48:28,  3.49it/s]
 30%|██▉       | 110077/371472 [8:45:12<20:54:21,  3.47it/s]
 30%|██▉       | 110078/371472 [8:45:12<20:08:23,  3.61it/s]
 30%|██▉       | 110079/371472 [8:45:12<19:52:41,  3.65it/s]
 30%|██▉       | 110080/371472 [8:45:13<19:55:38,  3.64it/s]
                                                            
{'loss': 3.3379, 'learning_rate': 7.336400267189553e-07, 'epoch': 4.74}

 30%|██▉       | 110080/371472 [8:45:13<19:55:38,  3.64it/s]
 30%|██▉       | 110081/371472 [8:45:13<20:08:07,  3.61it/s]
 30%|██▉       | 110082/371472 [8:45:13<20:41:49,  3.51it/s]
 30%|██▉       | 110083/371472 [8:45:14<20:16:22,  3.58it/s]
 30%|██▉       | 110084/371472 [8:45:14<20:40:03,  3.51it/s]
 30%|██▉       | 110085/371472 [8:45:14<20:37:59,  3.52it/s]
 30%|██▉       | 110086/371472 [8:45:14<20:07:35,  3.61it/s]
 30%|██▉       | 110087/371472 [8:45:15<19:35:34,  3.71it/s]
 30%|██▉       | 110088/371472 [8:45:15<19:42:37,  3.68it/s]
 30%|██▉       | 110089/371472 [8:45:15<19:28:29,  3.73it/s]
 30%|██▉       | 110090/371472 [8:45:15<20:35:28,  3.53it/s]
 30%|██▉       | 110091/371472 [8:45:16<21:59:29,  3.30it/s]
 30%|██▉       | 110092/371472 [8:45:16<22:13:43,  3.27it/s]
 30%|██▉       | 110093/371472 [8:45:16<23:10:42,  3.13it/s]
 30%|██▉       | 110094/371472 [8:45:17<22:47:51,  3.18it/s]
 30%|██▉       | 110095/371472 [8:45:17<21:58:04,  3.31it/s]
 30%|██▉       | 110096/371472 [8:45:17<22:12:49,  3.27it/s]
 30%|██▉       | 110097/371472 [8:45:18<22:52:34,  3.17it/s]
 30%|██▉       | 110098/371472 [8:45:18<23:03:08,  3.15it/s]
 30%|██▉       | 110099/371472 [8:45:18<22:41:13,  3.20it/s]
 30%|██▉       | 110100/371472 [8:45:19<21:42:05,  3.35it/s]
                                                            
{'loss': 3.3428, 'learning_rate': 7.335915447434764e-07, 'epoch': 4.74}

 30%|██▉       | 110100/371472 [8:45:19<21:42:05,  3.35it/s]
 30%|██▉       | 110101/371472 [8:45:19<20:31:43,  3.54it/s]
 30%|██▉       | 110102/371472 [8:45:19<20:16:37,  3.58it/s]
 30%|██▉       | 110103/371472 [8:45:19<20:13:36,  3.59it/s]
 30%|██▉       | 110104/371472 [8:45:20<21:13:52,  3.42it/s]
 30%|██▉       | 110105/371472 [8:45:20<22:20:00,  3.25it/s]
 30%|██▉       | 110106/371472 [8:45:20<21:06:02,  3.44it/s]
 30%|██▉       | 110107/371472 [8:45:21<20:28:40,  3.55it/s]
 30%|██▉       | 110108/371472 [8:45:21<19:24:29,  3.74it/s]
 30%|██▉       | 110109/371472 [8:45:21<19:32:30,  3.72it/s]
 30%|██▉       | 110110/371472 [8:45:21<19:02:57,  3.81it/s]
 30%|██▉       | 110111/371472 [8:45:22<18:28:50,  3.93it/s]
 30%|██▉       | 110112/371472 [8:45:22<18:10:45,  3.99it/s]
 30%|██▉       | 110113/371472 [8:45:22<18:08:33,  4.00it/s]
 30%|██▉       | 110114/371472 [8:45:22<18:01:07,  4.03it/s]
 30%|██▉       | 110115/371472 [8:45:23<18:00:29,  4.03it/s]
 30%|██▉       | 110116/371472 [8:45:23<19:22:43,  3.75it/s]
 30%|██▉       | 110117/371472 [8:45:23<19:07:52,  3.79it/s]
 30%|██▉       | 110118/371472 [8:45:23<18:59:24,  3.82it/s]
 30%|██▉       | 110119/371472 [8:45:24<19:43:26,  3.68it/s]
 30%|██▉       | 110120/371472 [8:45:24<20:47:08,  3.49it/s]
                                                            
{'loss': 3.3437, 'learning_rate': 7.335430627679976e-07, 'epoch': 4.74}

 30%|██▉       | 110120/371472 [8:45:24<20:47:08,  3.49it/s]
 30%|██▉       | 110121/371472 [8:45:24<19:52:21,  3.65it/s]
 30%|██▉       | 110122/371472 [8:45:25<21:58:01,  3.30it/s]
 30%|██▉       | 110123/371472 [8:45:25<20:45:36,  3.50it/s]
 30%|██▉       | 110124/371472 [8:45:25<20:48:59,  3.49it/s]
 30%|██▉       | 110125/371472 [8:45:26<22:59:07,  3.16it/s]
 30%|██▉       | 110126/371472 [8:45:26<22:40:01,  3.20it/s]
 30%|██▉       | 110127/371472 [8:45:26<22:12:53,  3.27it/s]
 30%|██▉       | 110128/371472 [8:45:26<21:04:51,  3.44it/s]
 30%|██▉       | 110129/371472 [8:45:27<21:54:59,  3.31it/s]
 30%|██▉       | 110130/371472 [8:45:27<20:53:45,  3.47it/s]
 30%|██▉       | 110131/371472 [8:45:27<21:07:44,  3.44it/s]
 30%|██▉       | 110132/371472 [8:45:28<20:25:47,  3.55it/s]
 30%|██▉       | 110133/371472 [8:45:28<20:20:09,  3.57it/s]
 30%|██▉       | 110134/371472 [8:45:28<20:11:15,  3.60it/s]
 30%|██▉       | 110135/371472 [8:45:28<20:04:00,  3.62it/s]
 30%|██▉       | 110136/371472 [8:45:29<21:37:12,  3.36it/s]
 30%|██▉       | 110137/371472 [8:45:29<21:14:08,  3.42it/s]
 30%|██▉       | 110138/371472 [8:45:29<21:16:11,  3.41it/s]
 30%|██▉       | 110139/371472 [8:45:30<20:44:54,  3.50it/s]
 30%|██▉       | 110140/371472 [8:45:30<19:50:56,  3.66it/s]
                                                            
{'loss': 3.4678, 'learning_rate': 7.334945807925187e-07, 'epoch': 4.74}

 30%|██▉       | 110140/371472 [8:45:30<19:50:56,  3.66it/s]
 30%|██▉       | 110141/371472 [8:45:30<19:19:00,  3.76it/s]
 30%|██▉       | 110142/371472 [8:45:30<18:55:42,  3.84it/s]
 30%|██▉       | 110143/371472 [8:45:31<20:04:00,  3.62it/s]
 30%|██▉       | 110144/371472 [8:45:31<20:14:10,  3.59it/s]
 30%|██▉       | 110145/371472 [8:45:31<20:38:23,  3.52it/s]
 30%|██▉       | 110146/371472 [8:45:31<20:31:21,  3.54it/s]
 30%|██▉       | 110147/371472 [8:45:32<21:26:37,  3.39it/s]
 30%|██▉       | 110148/371472 [8:45:32<20:21:13,  3.57it/s]
 30%|██▉       | 110149/371472 [8:45:32<20:14:26,  3.59it/s]
 30%|██▉       | 110150/371472 [8:45:33<19:56:00,  3.64it/s]
 30%|██▉       | 110151/371472 [8:45:33<20:45:51,  3.50it/s]
 30%|██▉       | 110152/371472 [8:45:33<20:10:08,  3.60it/s]
 30%|██▉       | 110153/371472 [8:45:33<19:50:01,  3.66it/s]
 30%|██▉       | 110154/371472 [8:45:34<20:05:09,  3.61it/s]
 30%|██▉       | 110155/371472 [8:45:34<20:17:42,  3.58it/s]
 30%|██▉       | 110156/371472 [8:45:34<19:50:08,  3.66it/s]
 30%|██▉       | 110157/371472 [8:45:34<19:29:01,  3.73it/s]
 30%|██▉       | 110158/371472 [8:45:35<19:02:18,  3.81it/s]
 30%|██▉       | 110159/371472 [8:45:35<20:37:05,  3.52it/s]
 30%|██▉       | 110160/371472 [8:45:35<20:38:29,  3.52it/s]
                                                            
{'loss': 3.4782, 'learning_rate': 7.334460988170398e-07, 'epoch': 4.74}

 30%|██▉       | 110160/371472 [8:45:35<20:38:29,  3.52it/s]
 30%|██▉       | 110161/371472 [8:45:36<19:37:35,  3.70it/s]
 30%|██▉       | 110162/371472 [8:45:36<19:20:00,  3.75it/s]
 30%|██▉       | 110163/371472 [8:45:36<18:55:36,  3.84it/s]
 30%|██▉       | 110164/371472 [8:45:36<19:41:54,  3.68it/s]
 30%|██▉       | 110165/371472 [8:45:37<18:55:53,  3.83it/s]
 30%|██▉       | 110166/371472 [8:45:37<21:51:02,  3.32it/s]
 30%|██▉       | 110167/371472 [8:45:37<20:45:08,  3.50it/s]
 30%|██▉       | 110168/371472 [8:45:38<20:45:19,  3.50it/s]
 30%|██▉       | 110169/371472 [8:45:38<20:44:08,  3.50it/s]
 30%|██▉       | 110170/371472 [8:45:38<21:15:16,  3.41it/s]
 30%|██▉       | 110171/371472 [8:45:38<21:27:50,  3.38it/s]
 30%|██▉       | 110172/371472 [8:45:39<20:15:07,  3.58it/s]
 30%|██▉       | 110173/371472 [8:45:39<19:45:17,  3.67it/s]
 30%|██▉       | 110174/371472 [8:45:39<20:03:36,  3.62it/s]
 30%|██▉       | 110175/371472 [8:45:40<20:10:30,  3.60it/s]
 30%|██▉       | 110176/371472 [8:45:40<19:33:46,  3.71it/s]
 30%|██▉       | 110177/371472 [8:45:40<20:12:34,  3.59it/s]
 30%|██▉       | 110178/371472 [8:45:40<19:53:39,  3.65it/s]
 30%|██▉       | 110179/371472 [8:45:41<20:23:12,  3.56it/s]
 30%|██▉       | 110180/371472 [8:45:41<20:32:32,  3.53it/s]
                                                            
{'loss': 3.4444, 'learning_rate': 7.333976168415609e-07, 'epoch': 4.75}

 30%|██▉       | 110180/371472 [8:45:41<20:32:32,  3.53it/s]
 30%|██▉       | 110181/371472 [8:45:41<19:35:51,  3.70it/s]
 30%|██▉       | 110182/371472 [8:45:41<20:07:05,  3.61it/s]
 30%|██▉       | 110183/371472 [8:45:42<20:39:20,  3.51it/s]
 30%|██▉       | 110184/371472 [8:45:42<20:30:03,  3.54it/s]
 30%|██▉       | 110185/371472 [8:45:42<20:43:10,  3.50it/s]
 30%|██▉       | 110186/371472 [8:45:43<20:16:28,  3.58it/s]
 30%|██▉       | 110187/371472 [8:45:43<19:42:31,  3.68it/s]
 30%|██▉       | 110188/371472 [8:45:43<19:38:38,  3.69it/s]
 30%|██▉       | 110189/371472 [8:45:43<19:18:51,  3.76it/s]
 30%|██▉       | 110190/371472 [8:45:44<18:56:55,  3.83it/s]
 30%|██▉       | 110191/371472 [8:45:44<18:26:22,  3.94it/s]
 30%|██▉       | 110192/371472 [8:45:44<19:45:27,  3.67it/s]
 30%|██▉       | 110193/371472 [8:45:44<20:22:45,  3.56it/s]
 30%|██▉       | 110194/371472 [8:45:45<19:50:19,  3.66it/s]
 30%|██▉       | 110195/371472 [8:45:45<20:40:08,  3.51it/s]
 30%|██▉       | 110196/371472 [8:45:45<19:57:58,  3.63it/s]
 30%|██▉       | 110197/371472 [8:45:46<19:39:28,  3.69it/s]
 30%|██▉       | 110198/371472 [8:45:46<20:05:34,  3.61it/s]
 30%|██▉       | 110199/371472 [8:45:46<20:18:13,  3.57it/s]
 30%|██▉       | 110200/371472 [8:45:46<20:02:38,  3.62it/s]
                                                            
{'loss': 3.4967, 'learning_rate': 7.333491348660819e-07, 'epoch': 4.75}

 30%|██▉       | 110200/371472 [8:45:46<20:02:38,  3.62it/s]
 30%|██▉       | 110201/371472 [8:45:47<20:55:12,  3.47it/s]
 30%|██▉       | 110202/371472 [8:45:47<20:11:37,  3.59it/s]
 30%|██▉       | 110203/371472 [8:45:47<19:43:53,  3.68it/s]
 30%|██▉       | 110204/371472 [8:45:47<19:38:04,  3.70it/s]
 30%|██▉       | 110205/371472 [8:45:48<19:11:03,  3.78it/s]
 30%|██▉       | 110206/371472 [8:45:48<19:31:28,  3.72it/s]
 30%|██▉       | 110207/371472 [8:45:48<21:06:54,  3.44it/s]
 30%|██▉       | 110208/371472 [8:45:49<22:26:33,  3.23it/s]
 30%|██▉       | 110209/371472 [8:45:49<21:31:23,  3.37it/s]
 30%|██▉       | 110210/371472 [8:45:49<21:22:38,  3.39it/s]
 30%|██▉       | 110211/371472 [8:45:49<20:05:21,  3.61it/s]
 30%|██▉       | 110212/371472 [8:45:50<20:36:40,  3.52it/s]
 30%|██▉       | 110213/371472 [8:45:50<20:01:27,  3.62it/s]
 30%|██▉       | 110214/371472 [8:45:50<19:34:16,  3.71it/s]
 30%|██▉       | 110215/371472 [8:45:51<19:37:02,  3.70it/s]
 30%|██▉       | 110216/371472 [8:45:51<19:23:31,  3.74it/s]
 30%|██▉       | 110217/371472 [8:45:51<20:01:16,  3.62it/s]
 30%|██▉       | 110218/371472 [8:45:51<20:17:51,  3.58it/s]
 30%|██▉       | 110219/371472 [8:45:52<20:24:13,  3.56it/s]
 30%|██▉       | 110220/371472 [8:45:52<21:21:10,  3.40it/s]
                                                            
{'loss': 3.1003, 'learning_rate': 7.333006528906031e-07, 'epoch': 4.75}

 30%|██▉       | 110220/371472 [8:45:52<21:21:10,  3.40it/s]
 30%|██▉       | 110221/371472 [8:45:52<20:44:45,  3.50it/s]
 30%|██▉       | 110222/371472 [8:45:53<23:50:46,  3.04it/s]
 30%|██▉       | 110223/371472 [8:45:53<22:30:56,  3.22it/s]
 30%|██▉       | 110224/371472 [8:45:53<21:28:21,  3.38it/s]
 30%|██▉       | 110225/371472 [8:45:54<21:36:56,  3.36it/s]
 30%|██▉       | 110226/371472 [8:45:54<22:06:24,  3.28it/s]
 30%|██▉       | 110227/371472 [8:45:54<22:59:24,  3.16it/s]
 30%|██▉       | 110228/371472 [8:45:54<21:55:38,  3.31it/s]
 30%|██▉       | 110229/371472 [8:45:55<22:39:14,  3.20it/s]
 30%|██▉       | 110230/371472 [8:45:55<21:45:51,  3.33it/s]
 30%|██▉       | 110231/371472 [8:45:55<21:12:08,  3.42it/s]
 30%|██▉       | 110232/371472 [8:45:56<20:19:48,  3.57it/s]
 30%|██▉       | 110233/371472 [8:45:56<20:34:52,  3.53it/s]
 30%|██▉       | 110234/371472 [8:45:56<20:37:06,  3.52it/s]
 30%|██▉       | 110235/371472 [8:45:56<19:54:30,  3.64it/s]
 30%|██▉       | 110236/371472 [8:45:57<20:34:56,  3.53it/s]
 30%|██▉       | 110237/371472 [8:45:57<20:42:25,  3.50it/s]
 30%|██▉       | 110238/371472 [8:45:57<20:22:01,  3.56it/s]
 30%|██▉       | 110239/371472 [8:45:58<20:30:46,  3.54it/s]
 30%|██▉       | 110240/371472 [8:45:58<19:39:48,  3.69it/s]
                                                            
{'loss': 3.2818, 'learning_rate': 7.332521709151242e-07, 'epoch': 4.75}

 30%|██▉       | 110240/371472 [8:45:58<19:39:48,  3.69it/s]
 30%|██▉       | 110241/371472 [8:45:58<20:36:18,  3.52it/s]
 30%|██▉       | 110242/371472 [8:45:58<20:47:51,  3.49it/s]
 30%|██▉       | 110243/371472 [8:45:59<22:02:27,  3.29it/s]
 30%|██▉       | 110244/371472 [8:45:59<21:16:51,  3.41it/s]
 30%|██▉       | 110245/371472 [8:45:59<21:02:10,  3.45it/s]
 30%|██▉       | 110246/371472 [8:46:00<21:30:07,  3.37it/s]
 30%|██▉       | 110247/371472 [8:46:00<21:37:15,  3.36it/s]
 30%|██▉       | 110248/371472 [8:46:00<20:56:11,  3.47it/s]
 30%|██▉       | 110249/371472 [8:46:00<20:27:44,  3.55it/s]
 30%|██▉       | 110250/371472 [8:46:01<20:42:16,  3.50it/s]
 30%|██▉       | 110251/371472 [8:46:01<21:57:48,  3.30it/s]
 30%|██▉       | 110252/371472 [8:46:01<22:38:28,  3.20it/s]
 30%|██▉       | 110253/371472 [8:46:02<21:12:13,  3.42it/s]
 30%|██▉       | 110254/371472 [8:46:02<21:21:54,  3.40it/s]
 30%|██▉       | 110255/371472 [8:46:02<21:30:13,  3.37it/s]
 30%|██▉       | 110256/371472 [8:46:03<21:29:07,  3.38it/s]
 30%|██▉       | 110257/371472 [8:46:03<21:17:56,  3.41it/s]
 30%|██▉       | 110258/371472 [8:46:03<20:16:07,  3.58it/s]
 30%|██▉       | 110259/371472 [8:46:04<22:03:17,  3.29it/s]
 30%|██▉       | 110260/371472 [8:46:04<21:10:11,  3.43it/s]
                                                            
{'loss': 3.4107, 'learning_rate': 7.332036889396453e-07, 'epoch': 4.75}

 30%|██▉       | 110260/371472 [8:46:04<21:10:11,  3.43it/s]
 30%|██▉       | 110261/371472 [8:46:04<20:24:39,  3.55it/s]
 30%|██▉       | 110262/371472 [8:46:04<19:54:44,  3.64it/s]
 30%|██▉       | 110263/371472 [8:46:05<19:47:34,  3.67it/s]
 30%|██▉       | 110264/371472 [8:46:05<20:03:04,  3.62it/s]
 30%|██▉       | 110265/371472 [8:46:05<19:43:39,  3.68it/s]
 30%|██▉       | 110266/371472 [8:46:05<19:39:34,  3.69it/s]
 30%|██▉       | 110267/371472 [8:46:06<19:05:33,  3.80it/s]
 30%|██▉       | 110268/371472 [8:46:06<19:38:43,  3.69it/s]
 30%|██▉       | 110269/371472 [8:46:06<20:11:36,  3.59it/s]
 30%|██▉       | 110270/371472 [8:46:07<22:56:17,  3.16it/s]
 30%|██▉       | 110271/371472 [8:46:07<22:46:48,  3.19it/s]
 30%|██▉       | 110272/371472 [8:46:07<22:25:57,  3.23it/s]
 30%|██▉       | 110273/371472 [8:46:07<21:18:43,  3.40it/s]
 30%|██▉       | 110274/371472 [8:46:08<20:58:48,  3.46it/s]
 30%|██▉       | 110275/371472 [8:46:08<21:18:49,  3.40it/s]
 30%|██▉       | 110276/371472 [8:46:08<20:55:42,  3.47it/s]
 30%|██▉       | 110277/371472 [8:46:09<20:31:14,  3.54it/s]
 30%|██▉       | 110278/371472 [8:46:09<20:31:35,  3.53it/s]
 30%|██▉       | 110279/371472 [8:46:09<21:23:13,  3.39it/s]
 30%|██▉       | 110280/371472 [8:46:10<22:09:59,  3.27it/s]
                                                            
{'loss': 3.4498, 'learning_rate': 7.331552069641664e-07, 'epoch': 4.75}

 30%|██▉       | 110280/371472 [8:46:10<22:09:59,  3.27it/s]
 30%|██▉       | 110281/371472 [8:46:10<22:15:51,  3.26it/s]
 30%|██▉       | 110282/371472 [8:46:10<21:16:23,  3.41it/s]
 30%|██▉       | 110283/371472 [8:46:10<21:34:52,  3.36it/s]
 30%|██▉       | 110284/371472 [8:46:11<21:22:10,  3.40it/s]
 30%|██▉       | 110285/371472 [8:46:11<20:40:47,  3.51it/s]
 30%|██▉       | 110286/371472 [8:46:11<22:59:11,  3.16it/s]
 30%|██▉       | 110287/371472 [8:46:12<21:54:56,  3.31it/s]
 30%|██▉       | 110288/371472 [8:46:12<20:47:56,  3.49it/s]
 30%|██▉       | 110289/371472 [8:46:12<20:47:55,  3.49it/s]
 30%|██▉       | 110290/371472 [8:46:12<20:45:45,  3.49it/s]
 30%|██▉       | 110291/371472 [8:46:13<20:19:42,  3.57it/s]
 30%|██▉       | 110292/371472 [8:46:13<19:32:13,  3.71it/s]
 30%|██▉       | 110293/371472 [8:46:13<19:53:01,  3.65it/s]
 30%|██▉       | 110294/371472 [8:46:14<22:16:20,  3.26it/s]
 30%|██▉       | 110295/371472 [8:46:14<21:03:02,  3.45it/s]
 30%|██▉       | 110296/371472 [8:46:14<22:36:28,  3.21it/s]
 30%|██▉       | 110297/371472 [8:46:14<21:08:02,  3.43it/s]
 30%|██▉       | 110298/371472 [8:46:15<21:01:25,  3.45it/s]
 30%|██▉       | 110299/371472 [8:46:15<20:54:06,  3.47it/s]
 30%|██▉       | 110300/371472 [8:46:15<20:07:18,  3.61it/s]
                                                            
{'loss': 3.5525, 'learning_rate': 7.331067249886876e-07, 'epoch': 4.75}

 30%|██▉       | 110300/371472 [8:46:15<20:07:18,  3.61it/s]
 30%|██▉       | 110301/371472 [8:46:16<19:57:42,  3.63it/s]
 30%|██▉       | 110302/371472 [8:46:16<19:46:33,  3.67it/s]
 30%|██▉       | 110303/371472 [8:46:16<19:35:55,  3.70it/s]
 30%|██▉       | 110304/371472 [8:46:16<19:41:35,  3.68it/s]
 30%|██▉       | 110305/371472 [8:46:17<20:07:15,  3.61it/s]
 30%|██▉       | 110306/371472 [8:46:17<20:34:53,  3.52it/s]
 30%|██▉       | 110307/371472 [8:46:17<19:51:50,  3.65it/s]
 30%|██▉       | 110308/371472 [8:46:17<19:45:15,  3.67it/s]
 30%|██▉       | 110309/371472 [8:46:18<19:31:46,  3.71it/s]
 30%|██▉       | 110310/371472 [8:46:18<18:49:43,  3.85it/s]
 30%|██▉       | 110311/371472 [8:46:18<19:28:44,  3.72it/s]
 30%|██▉       | 110312/371472 [8:46:19<19:08:30,  3.79it/s]
 30%|██▉       | 110313/371472 [8:46:19<19:48:47,  3.66it/s]
 30%|██▉       | 110314/371472 [8:46:19<19:37:12,  3.70it/s]
 30%|██▉       | 110315/371472 [8:46:19<19:50:21,  3.66it/s]
 30%|██▉       | 110316/371472 [8:46:20<19:29:48,  3.72it/s]
 30%|██▉       | 110317/371472 [8:46:20<20:23:46,  3.56it/s]
 30%|██▉       | 110318/371472 [8:46:20<20:50:38,  3.48it/s]
 30%|██▉       | 110319/371472 [8:46:21<21:34:22,  3.36it/s]
 30%|██▉       | 110320/371472 [8:46:21<23:01:50,  3.15it/s]
                                                            
{'loss': 3.2837, 'learning_rate': 7.330582430132086e-07, 'epoch': 4.75}

 30%|██▉       | 110320/371472 [8:46:21<23:01:50,  3.15it/s]
 30%|██▉       | 110321/371472 [8:46:21<22:23:52,  3.24it/s]
 30%|██▉       | 110322/371472 [8:46:21<20:58:44,  3.46it/s]
 30%|██▉       | 110323/371472 [8:46:22<20:56:17,  3.46it/s]
 30%|██▉       | 110324/371472 [8:46:22<20:36:59,  3.52it/s]
 30%|██▉       | 110325/371472 [8:46:22<20:16:21,  3.58it/s]
 30%|██▉       | 110326/371472 [8:46:23<19:25:58,  3.73it/s]
 30%|██▉       | 110327/371472 [8:46:23<20:06:06,  3.61it/s]
 30%|██▉       | 110328/371472 [8:46:23<21:04:23,  3.44it/s]
 30%|██▉       | 110329/371472 [8:46:23<22:00:58,  3.29it/s]
 30%|██▉       | 110330/371472 [8:46:24<24:05:59,  3.01it/s]
 30%|██▉       | 110331/371472 [8:46:24<22:53:21,  3.17it/s]
 30%|██▉       | 110332/371472 [8:46:24<22:31:50,  3.22it/s]
 30%|██▉       | 110333/371472 [8:46:25<22:58:44,  3.16it/s]
 30%|██▉       | 110334/371472 [8:46:25<21:56:17,  3.31it/s]
 30%|██▉       | 110335/371472 [8:46:25<21:16:55,  3.41it/s]
 30%|██▉       | 110336/371472 [8:46:26<20:34:07,  3.53it/s]
 30%|██▉       | 110337/371472 [8:46:26<19:36:49,  3.70it/s]
 30%|██▉       | 110338/371472 [8:46:26<19:36:42,  3.70it/s]
 30%|██▉       | 110339/371472 [8:46:26<19:11:18,  3.78it/s]
 30%|██▉       | 110340/371472 [8:46:27<18:38:55,  3.89it/s]
                                                            
{'loss': 3.3246, 'learning_rate': 7.330097610377298e-07, 'epoch': 4.75}

 30%|██▉       | 110340/371472 [8:46:27<18:38:55,  3.89it/s]
 30%|██▉       | 110341/371472 [8:46:27<18:32:18,  3.91it/s]
 30%|██▉       | 110342/371472 [8:46:27<19:19:11,  3.75it/s]
 30%|██▉       | 110343/371472 [8:46:27<20:23:39,  3.56it/s]
 30%|██▉       | 110344/371472 [8:46:28<19:46:07,  3.67it/s]
 30%|██▉       | 110345/371472 [8:46:28<19:58:16,  3.63it/s]
 30%|██▉       | 110346/371472 [8:46:28<19:26:14,  3.73it/s]
 30%|██▉       | 110347/371472 [8:46:29<19:55:58,  3.64it/s]
 30%|██▉       | 110348/371472 [8:46:29<19:46:17,  3.67it/s]
 30%|██▉       | 110349/371472 [8:46:29<22:14:23,  3.26it/s]
 30%|██▉       | 110350/371472 [8:46:29<20:42:46,  3.50it/s]
 30%|██▉       | 110351/371472 [8:46:30<20:17:51,  3.57it/s]
 30%|██▉       | 110352/371472 [8:46:30<19:57:35,  3.63it/s]
 30%|██▉       | 110353/371472 [8:46:30<19:27:24,  3.73it/s]
 30%|██▉       | 110354/371472 [8:46:30<19:03:51,  3.80it/s]
 30%|██▉       | 110355/371472 [8:46:31<20:30:00,  3.54it/s]
 30%|██▉       | 110356/371472 [8:46:31<20:04:09,  3.61it/s]
 30%|██▉       | 110357/371472 [8:46:31<19:20:10,  3.75it/s]
 30%|██▉       | 110358/371472 [8:46:32<19:40:56,  3.69it/s]
 30%|██▉       | 110359/371472 [8:46:32<19:45:18,  3.67it/s]
 30%|██▉       | 110360/371472 [8:46:32<19:52:10,  3.65it/s]
                                                            
{'loss': 3.3768, 'learning_rate': 7.329612790622508e-07, 'epoch': 4.75}

 30%|██▉       | 110360/371472 [8:46:32<19:52:10,  3.65it/s]
 30%|██▉       | 110361/371472 [8:46:32<20:59:02,  3.46it/s]
 30%|██▉       | 110362/371472 [8:46:33<20:39:13,  3.51it/s]
 30%|██▉       | 110363/371472 [8:46:33<20:17:19,  3.57it/s]
 30%|██▉       | 110364/371472 [8:46:33<20:23:16,  3.56it/s]
 30%|██▉       | 110365/371472 [8:46:34<20:16:51,  3.58it/s]
 30%|██▉       | 110366/371472 [8:46:34<19:52:31,  3.65it/s]
 30%|██▉       | 110367/371472 [8:46:34<20:08:41,  3.60it/s]
 30%|██▉       | 110368/371472 [8:46:34<20:24:44,  3.55it/s]
 30%|██▉       | 110369/371472 [8:46:35<20:30:53,  3.54it/s]
 30%|██▉       | 110370/371472 [8:46:35<20:07:04,  3.61it/s]
 30%|██▉       | 110371/371472 [8:46:35<21:07:01,  3.43it/s]
 30%|██▉       | 110372/371472 [8:46:36<20:43:11,  3.50it/s]
 30%|██▉       | 110373/371472 [8:46:36<20:45:13,  3.49it/s]
 30%|██▉       | 110374/371472 [8:46:36<20:47:47,  3.49it/s]
 30%|██▉       | 110375/371472 [8:46:36<21:25:44,  3.38it/s]
 30%|██▉       | 110376/371472 [8:46:37<21:08:34,  3.43it/s]
 30%|██▉       | 110377/371472 [8:46:37<21:03:38,  3.44it/s]
 30%|██▉       | 110378/371472 [8:46:37<21:01:12,  3.45it/s]
 30%|██▉       | 110379/371472 [8:46:38<20:03:37,  3.62it/s]
 30%|██▉       | 110380/371472 [8:46:38<19:30:17,  3.72it/s]
                                                            
{'loss': 3.3292, 'learning_rate': 7.329127970867719e-07, 'epoch': 4.75}

 30%|██▉       | 110380/371472 [8:46:38<19:30:17,  3.72it/s]
 30%|██▉       | 110381/371472 [8:46:38<19:39:06,  3.69it/s]
 30%|██▉       | 110382/371472 [8:46:38<19:47:08,  3.67it/s]
 30%|██▉       | 110383/371472 [8:46:39<19:08:39,  3.79it/s]
 30%|██▉       | 110384/371472 [8:46:39<20:06:16,  3.61it/s]
 30%|██▉       | 110385/371472 [8:46:39<20:54:22,  3.47it/s]
 30%|██▉       | 110386/371472 [8:46:39<20:01:45,  3.62it/s]
 30%|██▉       | 110387/371472 [8:46:40<21:16:51,  3.41it/s]
 30%|██▉       | 110388/371472 [8:46:40<21:21:55,  3.39it/s]
 30%|██▉       | 110389/371472 [8:46:40<20:17:34,  3.57it/s]
 30%|██▉       | 110390/371472 [8:46:41<22:01:09,  3.29it/s]
 30%|██▉       | 110391/371472 [8:46:41<22:21:51,  3.24it/s]
 30%|██▉       | 110392/371472 [8:46:41<22:15:59,  3.26it/s]
 30%|██▉       | 110393/371472 [8:46:42<21:43:49,  3.34it/s]
 30%|██▉       | 110394/371472 [8:46:42<21:27:54,  3.38it/s]
 30%|██▉       | 110395/371472 [8:46:42<20:26:56,  3.55it/s]
 30%|██▉       | 110396/371472 [8:46:42<19:37:59,  3.69it/s]
 30%|██▉       | 110397/371472 [8:46:43<19:39:40,  3.69it/s]
 30%|██▉       | 110398/371472 [8:46:43<19:53:28,  3.65it/s]
 30%|██▉       | 110399/371472 [8:46:43<19:40:48,  3.68it/s]
 30%|██▉       | 110400/371472 [8:46:43<19:56:03,  3.64it/s]
                                                            
{'loss': 3.496, 'learning_rate': 7.32864315111293e-07, 'epoch': 4.76}

 30%|██▉       | 110400/371472 [8:46:43<19:56:03,  3.64it/s]
 30%|██▉       | 110401/371472 [8:46:44<21:00:14,  3.45it/s]
 30%|██▉       | 110402/371472 [8:46:44<20:32:58,  3.53it/s]
 30%|██▉       | 110403/371472 [8:46:44<19:35:54,  3.70it/s]
 30%|██▉       | 110404/371472 [8:46:45<20:04:56,  3.61it/s]
 30%|██▉       | 110405/371472 [8:46:45<19:25:56,  3.73it/s]
 30%|██▉       | 110406/371472 [8:46:45<20:53:54,  3.47it/s]
 30%|██▉       | 110407/371472 [8:46:45<19:57:06,  3.63it/s]
 30%|██▉       | 110408/371472 [8:46:46<20:16:28,  3.58it/s]
 30%|██▉       | 110409/371472 [8:46:46<20:12:26,  3.59it/s]
 30%|██▉       | 110410/371472 [8:46:46<19:45:47,  3.67it/s]
 30%|██▉       | 110411/371472 [8:46:47<20:23:40,  3.56it/s]
 30%|██▉       | 110412/371472 [8:46:47<20:50:17,  3.48it/s]
 30%|██▉       | 110413/371472 [8:46:47<20:03:12,  3.62it/s]
 30%|██▉       | 110414/371472 [8:46:47<20:24:52,  3.55it/s]
 30%|██▉       | 110415/371472 [8:46:48<20:42:51,  3.50it/s]
 30%|██▉       | 110416/371472 [8:46:48<20:15:24,  3.58it/s]
 30%|██▉       | 110417/371472 [8:46:48<19:54:42,  3.64it/s]
 30%|██▉       | 110418/371472 [8:46:48<19:27:32,  3.73it/s]
 30%|██▉       | 110419/371472 [8:46:49<19:36:02,  3.70it/s]
 30%|██▉       | 110420/371472 [8:46:49<18:58:00,  3.82it/s]
                                                            
{'loss': 3.3893, 'learning_rate': 7.328158331358142e-07, 'epoch': 4.76}

 30%|██▉       | 110420/371472 [8:46:49<18:58:00,  3.82it/s]
 30%|██▉       | 110421/371472 [8:46:49<19:25:19,  3.73it/s]
 30%|██▉       | 110422/371472 [8:46:50<19:48:18,  3.66it/s]
 30%|██▉       | 110423/371472 [8:46:50<20:05:40,  3.61it/s]
 30%|██▉       | 110424/371472 [8:46:50<21:03:26,  3.44it/s]
 30%|██▉       | 110425/371472 [8:46:50<20:31:57,  3.53it/s]
 30%|██▉       | 110426/371472 [8:46:51<20:02:49,  3.62it/s]
 30%|██▉       | 110427/371472 [8:46:51<19:29:21,  3.72it/s]
 30%|██▉       | 110428/371472 [8:46:51<20:50:36,  3.48it/s]
 30%|██▉       | 110429/371472 [8:46:52<20:55:31,  3.47it/s]
 30%|██▉       | 110430/371472 [8:46:52<20:19:54,  3.57it/s]
 30%|██▉       | 110431/371472 [8:46:52<20:52:53,  3.47it/s]
 30%|██▉       | 110432/371472 [8:46:52<20:17:20,  3.57it/s]
 30%|██▉       | 110433/371472 [8:46:53<19:38:07,  3.69it/s]
 30%|██▉       | 110434/371472 [8:46:53<19:03:35,  3.80it/s]
 30%|██▉       | 110435/371472 [8:46:53<18:33:15,  3.91it/s]
 30%|██▉       | 110436/371472 [8:46:53<18:35:27,  3.90it/s]
 30%|██▉       | 110437/371472 [8:46:54<19:52:15,  3.65it/s]
 30%|██▉       | 110438/371472 [8:46:54<19:46:30,  3.67it/s]
 30%|██▉       | 110439/371472 [8:46:54<20:08:51,  3.60it/s]
 30%|██▉       | 110440/371472 [8:46:55<20:26:38,  3.55it/s]
                                                            
{'loss': 3.3441, 'learning_rate': 7.327673511603352e-07, 'epoch': 4.76}

 30%|██▉       | 110440/371472 [8:46:55<20:26:38,  3.55it/s]
 30%|██▉       | 110441/371472 [8:46:55<19:56:53,  3.63it/s]
 30%|██▉       | 110442/371472 [8:46:55<19:03:41,  3.80it/s]
 30%|██▉       | 110443/371472 [8:46:55<19:28:24,  3.72it/s]
 30%|██▉       | 110444/371472 [8:46:56<19:30:59,  3.72it/s]
 30%|██▉       | 110445/371472 [8:46:56<19:12:16,  3.78it/s]
 30%|██▉       | 110446/371472 [8:46:56<20:20:52,  3.56it/s]
 30%|██▉       | 110447/371472 [8:46:56<20:43:26,  3.50it/s]
 30%|██▉       | 110448/371472 [8:46:57<20:15:45,  3.58it/s]
 30%|██▉       | 110449/371472 [8:46:57<20:05:39,  3.61it/s]
 30%|██▉       | 110450/371472 [8:46:57<19:43:01,  3.68it/s]
 30%|██▉       | 110451/371472 [8:46:58<20:36:40,  3.52it/s]
 30%|██▉       | 110452/371472 [8:46:58<20:41:28,  3.50it/s]
 30%|██▉       | 110453/371472 [8:46:58<21:58:50,  3.30it/s]
 30%|██▉       | 110454/371472 [8:46:59<23:00:46,  3.15it/s]
 30%|██▉       | 110455/371472 [8:46:59<22:03:53,  3.29it/s]
 30%|██▉       | 110456/371472 [8:46:59<20:57:24,  3.46it/s]
 30%|██▉       | 110457/371472 [8:46:59<21:08:15,  3.43it/s]
 30%|██▉       | 110458/371472 [8:47:00<20:05:52,  3.61it/s]
 30%|██▉       | 110459/371472 [8:47:00<19:58:25,  3.63it/s]
 30%|██▉       | 110460/371472 [8:47:00<19:42:02,  3.68it/s]
                                                            
{'loss': 3.4125, 'learning_rate': 7.327188691848563e-07, 'epoch': 4.76}

 30%|██▉       | 110460/371472 [8:47:00<19:42:02,  3.68it/s]
 30%|██▉       | 110461/371472 [8:47:00<19:54:54,  3.64it/s]
 30%|██▉       | 110462/371472 [8:47:01<19:25:37,  3.73it/s]
 30%|██▉       | 110463/371472 [8:47:01<19:09:17,  3.79it/s]
 30%|██▉       | 110464/371472 [8:47:01<19:13:41,  3.77it/s]
 30%|██▉       | 110465/371472 [8:47:01<19:45:06,  3.67it/s]
 30%|██▉       | 110466/371472 [8:47:02<21:34:13,  3.36it/s]
 30%|██▉       | 110467/371472 [8:47:02<20:25:50,  3.55it/s]
 30%|██▉       | 110468/371472 [8:47:02<19:50:17,  3.65it/s]
 30%|██▉       | 110469/371472 [8:47:03<19:39:06,  3.69it/s]
 30%|██▉       | 110470/371472 [8:47:03<19:35:24,  3.70it/s]
 30%|██▉       | 110471/371472 [8:47:03<19:46:47,  3.67it/s]
 30%|██▉       | 110472/371472 [8:47:03<19:47:42,  3.66it/s]
 30%|██▉       | 110473/371472 [8:47:04<19:45:54,  3.67it/s]
 30%|██▉       | 110474/371472 [8:47:04<20:00:55,  3.62it/s]
 30%|██▉       | 110475/371472 [8:47:04<19:49:07,  3.66it/s]
 30%|██▉       | 110476/371472 [8:47:05<19:39:09,  3.69it/s]
 30%|██▉       | 110477/371472 [8:47:05<19:37:06,  3.70it/s]
 30%|██▉       | 110478/371472 [8:47:05<19:26:18,  3.73it/s]
 30%|██▉       | 110479/371472 [8:47:05<19:53:07,  3.65it/s]
 30%|██▉       | 110480/371472 [8:47:06<20:17:47,  3.57it/s]
                                                            
{'loss': 3.4208, 'learning_rate': 7.326703872093774e-07, 'epoch': 4.76}

 30%|██▉       | 110480/371472 [8:47:06<20:17:47,  3.57it/s]
 30%|██▉       | 110481/371472 [8:47:06<21:13:55,  3.41it/s]
 30%|██▉       | 110482/371472 [8:47:06<20:21:47,  3.56it/s]
 30%|██▉       | 110483/371472 [8:47:06<19:54:26,  3.64it/s]
 30%|██▉       | 110484/371472 [8:47:07<19:45:54,  3.67it/s]
 30%|██▉       | 110485/371472 [8:47:07<20:54:56,  3.47it/s]
 30%|██▉       | 110486/371472 [8:47:07<21:30:55,  3.37it/s]
 30%|██▉       | 110487/371472 [8:47:08<22:07:05,  3.28it/s]
 30%|██▉       | 110488/371472 [8:47:08<22:35:42,  3.21it/s]
 30%|██▉       | 110489/371472 [8:47:08<22:00:26,  3.29it/s]
 30%|██▉       | 110490/371472 [8:47:09<21:33:13,  3.36it/s]
 30%|██▉       | 110491/371472 [8:47:09<22:01:02,  3.29it/s]
 30%|██▉       | 110492/371472 [8:47:09<21:30:49,  3.37it/s]
 30%|██▉       | 110493/371472 [8:47:09<20:25:06,  3.55it/s]
 30%|██▉       | 110494/371472 [8:47:10<20:38:18,  3.51it/s]
 30%|██▉       | 110495/371472 [8:47:10<19:53:56,  3.64it/s]
 30%|██▉       | 110496/371472 [8:47:10<20:51:23,  3.48it/s]
 30%|██▉       | 110497/371472 [8:47:11<20:41:49,  3.50it/s]
 30%|██▉       | 110498/371472 [8:47:11<21:06:32,  3.43it/s]
 30%|██▉       | 110499/371472 [8:47:11<20:15:20,  3.58it/s]
 30%|██▉       | 110500/371472 [8:47:11<20:50:46,  3.48it/s]
                                                            
{'loss': 3.4095, 'learning_rate': 7.326219052338985e-07, 'epoch': 4.76}

 30%|██▉       | 110500/371472 [8:47:11<20:50:46,  3.48it/s]
 30%|██▉       | 110501/371472 [8:47:12<20:36:53,  3.52it/s]
 30%|██▉       | 110502/371472 [8:47:12<22:50:44,  3.17it/s]
 30%|██▉       | 110503/371472 [8:47:12<22:55:13,  3.16it/s]
 30%|██▉       | 110504/371472 [8:47:13<22:37:22,  3.20it/s]
 30%|██▉       | 110505/371472 [8:47:13<23:36:26,  3.07it/s]
 30%|██▉       | 110506/371472 [8:47:13<22:38:41,  3.20it/s]
 30%|██▉       | 110507/371472 [8:47:14<21:55:04,  3.31it/s]
 30%|██▉       | 110508/371472 [8:47:14<22:06:14,  3.28it/s]
 30%|██▉       | 110509/371472 [8:47:14<21:44:14,  3.33it/s]
 30%|██▉       | 110510/371472 [8:47:15<21:14:56,  3.41it/s]
 30%|██▉       | 110511/371472 [8:47:15<21:12:54,  3.42it/s]
 30%|██▉       | 110512/371472 [8:47:15<20:38:57,  3.51it/s]
 30%|██▉       | 110513/371472 [8:47:15<20:05:28,  3.61it/s]
 30%|██▉       | 110514/371472 [8:47:16<19:22:05,  3.74it/s]
 30%|██▉       | 110515/371472 [8:47:16<19:11:46,  3.78it/s]
 30%|██▉       | 110516/371472 [8:47:16<19:49:01,  3.66it/s]
 30%|██▉       | 110517/371472 [8:47:16<20:28:44,  3.54it/s]
 30%|██▉       | 110518/371472 [8:47:17<20:24:12,  3.55it/s]
 30%|██▉       | 110519/371472 [8:47:17<20:57:16,  3.46it/s]
 30%|██▉       | 110520/371472 [8:47:17<21:15:10,  3.41it/s]
                                                            
{'loss': 3.3821, 'learning_rate': 7.325734232584197e-07, 'epoch': 4.76}

 30%|██▉       | 110520/371472 [8:47:17<21:15:10,  3.41it/s]
 30%|██▉       | 110521/371472 [8:47:18<20:12:57,  3.59it/s]
 30%|██▉       | 110522/371472 [8:47:18<19:35:02,  3.70it/s]
 30%|██▉       | 110523/371472 [8:47:18<19:18:47,  3.75it/s]
 30%|██▉       | 110524/371472 [8:47:18<19:40:02,  3.69it/s]
 30%|██▉       | 110525/371472 [8:47:19<19:38:52,  3.69it/s]
 30%|██▉       | 110526/371472 [8:47:19<20:33:02,  3.53it/s]
 30%|██▉       | 110527/371472 [8:47:19<20:24:35,  3.55it/s]
 30%|██▉       | 110528/371472 [8:47:20<20:10:25,  3.59it/s]
 30%|██▉       | 110529/371472 [8:47:20<19:48:07,  3.66it/s]
 30%|██▉       | 110530/371472 [8:47:20<22:04:58,  3.28it/s]
 30%|██▉       | 110531/371472 [8:47:20<21:14:21,  3.41it/s]
 30%|██▉       | 110532/371472 [8:47:21<20:41:01,  3.50it/s]
 30%|██▉       | 110533/371472 [8:47:21<20:34:41,  3.52it/s]
 30%|██▉       | 110534/371472 [8:47:21<21:31:32,  3.37it/s]
 30%|██▉       | 110535/371472 [8:47:22<20:26:32,  3.55it/s]
 30%|██▉       | 110536/371472 [8:47:22<20:58:16,  3.46it/s]
 30%|██▉       | 110537/371472 [8:47:22<20:34:10,  3.52it/s]
 30%|██▉       | 110538/371472 [8:47:22<19:43:11,  3.68it/s]
 30%|██▉       | 110539/371472 [8:47:23<20:14:10,  3.58it/s]
 30%|██▉       | 110540/371472 [8:47:23<20:38:13,  3.51it/s]
                                                            
{'loss': 3.5809, 'learning_rate': 7.325249412829408e-07, 'epoch': 4.76}

 30%|██▉       | 110540/371472 [8:47:23<20:38:13,  3.51it/s]
 30%|██▉       | 110541/371472 [8:47:23<20:11:37,  3.59it/s]
 30%|██▉       | 110542/371472 [8:47:23<20:09:42,  3.59it/s]
 30%|██▉       | 110543/371472 [8:47:24<19:39:50,  3.69it/s]
 30%|██▉       | 110544/371472 [8:47:24<20:09:44,  3.59it/s]
 30%|██▉       | 110545/371472 [8:47:24<19:51:13,  3.65it/s]
 30%|██▉       | 110546/371472 [8:47:25<19:44:17,  3.67it/s]
 30%|██▉       | 110547/371472 [8:47:25<20:54:32,  3.47it/s]
 30%|██▉       | 110548/371472 [8:47:25<20:14:39,  3.58it/s]
 30%|██▉       | 110549/371472 [8:47:25<21:21:00,  3.39it/s]
 30%|██▉       | 110550/371472 [8:47:26<20:48:51,  3.48it/s]
 30%|██▉       | 110551/371472 [8:47:26<20:42:41,  3.50it/s]
 30%|██▉       | 110552/371472 [8:47:26<21:09:14,  3.43it/s]
 30%|██▉       | 110553/371472 [8:47:27<20:17:21,  3.57it/s]
 30%|██▉       | 110554/371472 [8:47:27<20:17:00,  3.57it/s]
 30%|██▉       | 110555/371472 [8:47:27<20:16:32,  3.57it/s]
 30%|██▉       | 110556/371472 [8:47:27<19:44:08,  3.67it/s]
 30%|██▉       | 110557/371472 [8:47:28<19:10:32,  3.78it/s]
 30%|██▉       | 110558/371472 [8:47:28<19:09:35,  3.78it/s]
 30%|██▉       | 110559/371472 [8:47:28<20:13:30,  3.58it/s]
 30%|██▉       | 110560/371472 [8:47:29<21:01:21,  3.45it/s]
                                                            
{'loss': 3.3793, 'learning_rate': 7.324764593074619e-07, 'epoch': 4.76}

 30%|██▉       | 110560/371472 [8:47:29<21:01:21,  3.45it/s]
 30%|██▉       | 110561/371472 [8:47:29<21:16:36,  3.41it/s]
 30%|██▉       | 110562/371472 [8:47:29<20:07:46,  3.60it/s]
 30%|██▉       | 110563/371472 [8:47:29<19:55:36,  3.64it/s]
 30%|██▉       | 110564/371472 [8:47:30<19:26:23,  3.73it/s]
 30%|██▉       | 110565/371472 [8:47:30<19:19:00,  3.75it/s]
 30%|██▉       | 110566/371472 [8:47:30<19:07:07,  3.79it/s]
 30%|██▉       | 110567/371472 [8:47:30<18:34:26,  3.90it/s]
 30%|██▉       | 110568/371472 [8:47:31<19:10:48,  3.78it/s]
 30%|██▉       | 110569/371472 [8:47:31<19:28:31,  3.72it/s]
 30%|██▉       | 110570/371472 [8:47:31<20:50:44,  3.48it/s]
 30%|██▉       | 110571/371472 [8:47:31<19:39:58,  3.69it/s]
 30%|██▉       | 110572/371472 [8:47:32<19:26:01,  3.73it/s]
 30%|██▉       | 110573/371472 [8:47:32<19:28:31,  3.72it/s]
 30%|██▉       | 110574/371472 [8:47:32<19:25:30,  3.73it/s]
 30%|██▉       | 110575/371472 [8:47:33<19:32:21,  3.71it/s]
 30%|██▉       | 110576/371472 [8:47:33<19:29:59,  3.72it/s]
 30%|██▉       | 110577/371472 [8:47:33<18:52:56,  3.84it/s]
 30%|██▉       | 110578/371472 [8:47:33<18:38:52,  3.89it/s]
 30%|██▉       | 110579/371472 [8:47:34<19:58:34,  3.63it/s]
 30%|██▉       | 110580/371472 [8:47:34<19:29:26,  3.72it/s]
                                                            
{'loss': 3.4014, 'learning_rate': 7.324279773319829e-07, 'epoch': 4.76}

 30%|██▉       | 110580/371472 [8:47:34<19:29:26,  3.72it/s]
 30%|██▉       | 110581/371472 [8:47:34<19:51:40,  3.65it/s]
 30%|██▉       | 110582/371472 [8:47:34<20:08:13,  3.60it/s]
 30%|██▉       | 110583/371472 [8:47:35<20:31:23,  3.53it/s]
 30%|██▉       | 110584/371472 [8:47:35<20:14:02,  3.58it/s]
 30%|██▉       | 110585/371472 [8:47:35<20:43:29,  3.50it/s]
 30%|██▉       | 110586/371472 [8:47:36<20:00:44,  3.62it/s]
 30%|██▉       | 110587/371472 [8:47:36<21:45:29,  3.33it/s]
 30%|██▉       | 110588/371472 [8:47:36<20:42:49,  3.50it/s]
 30%|██▉       | 110589/371472 [8:47:37<21:29:49,  3.37it/s]
 30%|██▉       | 110590/371472 [8:47:37<21:05:28,  3.44it/s]
 30%|██▉       | 110591/371472 [8:47:37<20:16:34,  3.57it/s]
 30%|██▉       | 110592/371472 [8:47:37<20:48:36,  3.48it/s]
 30%|██▉       | 110593/371472 [8:47:38<21:23:04,  3.39it/s]
 30%|██▉       | 110594/371472 [8:47:38<21:22:43,  3.39it/s]
 30%|██▉       | 110595/371472 [8:47:38<21:24:43,  3.38it/s]
 30%|██▉       | 110596/371472 [8:47:39<21:15:03,  3.41it/s]
 30%|██▉       | 110597/371472 [8:47:39<21:14:13,  3.41it/s]
 30%|██▉       | 110598/371472 [8:47:39<20:54:29,  3.47it/s]
 30%|██▉       | 110599/371472 [8:47:39<20:23:53,  3.55it/s]
 30%|██▉       | 110600/371472 [8:47:40<19:48:03,  3.66it/s]
                                                            
{'loss': 3.3375, 'learning_rate': 7.323794953565041e-07, 'epoch': 4.76}

 30%|██▉       | 110600/371472 [8:47:40<19:48:03,  3.66it/s]
 30%|██▉       | 110601/371472 [8:47:40<19:27:06,  3.73it/s]
 30%|██▉       | 110602/371472 [8:47:40<20:18:15,  3.57it/s]
 30%|██▉       | 110603/371472 [8:47:40<20:34:39,  3.52it/s]
 30%|██▉       | 110604/371472 [8:47:41<21:01:29,  3.45it/s]
 30%|██▉       | 110605/371472 [8:47:41<20:30:17,  3.53it/s]
 30%|██▉       | 110606/371472 [8:47:41<20:33:20,  3.53it/s]
 30%|██▉       | 110607/371472 [8:47:42<20:28:34,  3.54it/s]
 30%|██▉       | 110608/371472 [8:47:42<20:09:25,  3.59it/s]
 30%|██▉       | 110609/371472 [8:47:42<21:16:23,  3.41it/s]
 30%|██▉       | 110610/371472 [8:47:43<20:51:30,  3.47it/s]
 30%|██▉       | 110611/371472 [8:47:43<20:40:45,  3.50it/s]
 30%|██▉       | 110612/371472 [8:47:43<22:15:06,  3.26it/s]
 30%|██▉       | 110613/371472 [8:47:43<22:26:38,  3.23it/s]
 30%|██▉       | 110614/371472 [8:47:44<21:16:22,  3.41it/s]
 30%|██▉       | 110615/371472 [8:47:44<20:53:41,  3.47it/s]
 30%|██▉       | 110616/371472 [8:47:44<20:16:54,  3.57it/s]
 30%|██▉       | 110617/371472 [8:47:45<19:41:08,  3.68it/s]
 30%|██▉       | 110618/371472 [8:47:45<19:18:28,  3.75it/s]
 30%|██▉       | 110619/371472 [8:47:45<19:06:45,  3.79it/s]
 30%|██▉       | 110620/371472 [8:47:45<19:02:11,  3.81it/s]
                                                            
{'loss': 3.4503, 'learning_rate': 7.323310133810252e-07, 'epoch': 4.76}

 30%|██▉       | 110620/371472 [8:47:45<19:02:11,  3.81it/s]
 30%|██▉       | 110621/371472 [8:47:46<20:19:58,  3.56it/s]
 30%|██▉       | 110622/371472 [8:47:46<19:11:24,  3.78it/s]
 30%|██▉       | 110623/371472 [8:47:46<20:27:12,  3.54it/s]
 30%|██▉       | 110624/371472 [8:47:46<20:26:29,  3.54it/s]
 30%|██▉       | 110625/371472 [8:47:47<19:19:53,  3.75it/s]
 30%|██▉       | 110626/371472 [8:47:47<18:56:51,  3.82it/s]
 30%|██▉       | 110627/371472 [8:47:47<19:22:05,  3.74it/s]
 30%|██▉       | 110628/371472 [8:47:47<19:14:55,  3.76it/s]
 30%|██▉       | 110629/371472 [8:47:48<19:21:05,  3.74it/s]
 30%|██▉       | 110630/371472 [8:47:48<19:48:00,  3.66it/s]
 30%|██▉       | 110631/371472 [8:47:48<20:15:51,  3.58it/s]
 30%|██▉       | 110632/371472 [8:47:49<21:10:29,  3.42it/s]
 30%|██▉       | 110633/371472 [8:47:49<21:28:52,  3.37it/s]
 30%|██▉       | 110634/371472 [8:47:49<21:02:59,  3.44it/s]
 30%|██▉       | 110635/371472 [8:47:50<21:33:09,  3.36it/s]
 30%|██▉       | 110636/371472 [8:47:50<20:30:08,  3.53it/s]
 30%|██▉       | 110637/371472 [8:47:50<20:45:29,  3.49it/s]
 30%|██▉       | 110638/371472 [8:47:50<20:38:30,  3.51it/s]
 30%|██▉       | 110639/371472 [8:47:51<19:45:43,  3.67it/s]
 30%|██▉       | 110640/371472 [8:47:51<19:51:01,  3.65it/s]
                                                            
{'loss': 3.4172, 'learning_rate': 7.322825314055463e-07, 'epoch': 4.77}

 30%|██▉       | 110640/371472 [8:47:51<19:51:01,  3.65it/s]
 30%|██▉       | 110641/371472 [8:47:51<19:26:30,  3.73it/s]
 30%|██▉       | 110642/371472 [8:47:51<19:11:07,  3.78it/s]
 30%|██▉       | 110643/371472 [8:47:52<19:29:20,  3.72it/s]
 30%|██▉       | 110644/371472 [8:47:52<19:16:45,  3.76it/s]
 30%|██▉       | 110645/371472 [8:47:52<19:06:58,  3.79it/s]
 30%|██▉       | 110646/371472 [8:47:52<19:54:30,  3.64it/s]
 30%|██▉       | 110647/371472 [8:47:53<19:27:05,  3.72it/s]
 30%|██▉       | 110648/371472 [8:47:53<19:24:38,  3.73it/s]
 30%|██▉       | 110649/371472 [8:47:53<19:07:36,  3.79it/s]
 30%|██▉       | 110650/371472 [8:47:54<20:32:27,  3.53it/s]
 30%|██▉       | 110651/371472 [8:47:54<20:58:25,  3.45it/s]
 30%|██▉       | 110652/371472 [8:47:54<21:05:16,  3.44it/s]
 30%|██▉       | 110653/371472 [8:47:54<21:05:58,  3.43it/s]
 30%|██▉       | 110654/371472 [8:47:55<20:36:40,  3.52it/s]
 30%|██▉       | 110655/371472 [8:47:55<20:20:49,  3.56it/s]
 30%|██▉       | 110656/371472 [8:47:55<19:57:56,  3.63it/s]
 30%|██▉       | 110657/371472 [8:47:56<19:54:50,  3.64it/s]
 30%|██▉       | 110658/371472 [8:47:56<19:23:25,  3.74it/s]
 30%|██▉       | 110659/371472 [8:47:56<19:21:26,  3.74it/s]
 30%|██▉       | 110660/371472 [8:47:56<20:19:44,  3.56it/s]
                                                            
{'loss': 3.4392, 'learning_rate': 7.322340494300674e-07, 'epoch': 4.77}

 30%|██▉       | 110660/371472 [8:47:56<20:19:44,  3.56it/s]
 30%|██▉       | 110661/371472 [8:47:57<20:11:16,  3.59it/s]
 30%|██▉       | 110662/371472 [8:47:57<20:04:28,  3.61it/s]
 30%|██▉       | 110663/371472 [8:47:57<20:24:02,  3.55it/s]
 30%|██▉       | 110664/371472 [8:47:57<20:09:52,  3.59it/s]
 30%|██▉       | 110665/371472 [8:47:58<20:08:32,  3.60it/s]
 30%|██▉       | 110666/371472 [8:47:58<20:53:33,  3.47it/s]
 30%|██▉       | 110667/371472 [8:47:58<20:54:41,  3.46it/s]
 30%|██▉       | 110668/371472 [8:47:59<20:29:11,  3.54it/s]
 30%|██▉       | 110669/371472 [8:47:59<19:43:30,  3.67it/s]
 30%|██▉       | 110670/371472 [8:47:59<20:36:30,  3.52it/s]
 30%|██▉       | 110671/371472 [8:48:00<21:43:47,  3.33it/s]
 30%|██▉       | 110672/371472 [8:48:00<20:38:54,  3.51it/s]
 30%|██▉       | 110673/371472 [8:48:00<20:42:04,  3.50it/s]
 30%|██▉       | 110674/371472 [8:48:00<20:18:15,  3.57it/s]
 30%|██▉       | 110675/371472 [8:48:01<20:04:19,  3.61it/s]
 30%|██▉       | 110676/371472 [8:48:01<20:48:29,  3.48it/s]
 30%|██▉       | 110677/371472 [8:48:01<22:58:03,  3.15it/s]
 30%|██▉       | 110678/371472 [8:48:02<21:26:27,  3.38it/s]
 30%|██▉       | 110679/371472 [8:48:02<21:18:00,  3.40it/s]
 30%|██▉       | 110680/371472 [8:48:02<20:17:59,  3.57it/s]
                                                            
{'loss': 3.4987, 'learning_rate': 7.321855674545886e-07, 'epoch': 4.77}

 30%|██▉       | 110680/371472 [8:48:02<20:17:59,  3.57it/s]
 30%|██▉       | 110681/371472 [8:48:02<20:41:47,  3.50it/s]
 30%|██▉       | 110682/371472 [8:48:03<19:46:51,  3.66it/s]
 30%|██▉       | 110683/371472 [8:48:03<20:27:30,  3.54it/s]
 30%|██▉       | 110684/371472 [8:48:03<20:20:03,  3.56it/s]
 30%|██▉       | 110685/371472 [8:48:03<19:50:14,  3.65it/s]
 30%|██▉       | 110686/371472 [8:48:04<19:46:20,  3.66it/s]
 30%|██▉       | 110687/371472 [8:48:04<20:45:44,  3.49it/s]
 30%|██▉       | 110688/371472 [8:48:04<20:33:53,  3.52it/s]
 30%|██▉       | 110689/371472 [8:48:05<19:53:41,  3.64it/s]
 30%|██▉       | 110690/371472 [8:48:05<19:48:27,  3.66it/s]
 30%|██▉       | 110691/371472 [8:48:05<19:46:25,  3.66it/s]
 30%|██▉       | 110692/371472 [8:48:05<19:33:24,  3.70it/s]
 30%|██▉       | 110693/371472 [8:48:06<23:22:45,  3.10it/s]
 30%|██▉       | 110694/371472 [8:48:06<23:22:14,  3.10it/s]
 30%|██▉       | 110695/371472 [8:48:06<22:06:59,  3.28it/s]
 30%|██▉       | 110696/371472 [8:48:07<21:30:12,  3.37it/s]
 30%|██▉       | 110697/371472 [8:48:07<22:31:11,  3.22it/s]
 30%|██▉       | 110698/371472 [8:48:07<20:59:40,  3.45it/s]
 30%|██▉       | 110699/371472 [8:48:08<20:07:12,  3.60it/s]
 30%|██▉       | 110700/371472 [8:48:08<19:18:38,  3.75it/s]
                                                            
{'loss': 3.2126, 'learning_rate': 7.321370854791096e-07, 'epoch': 4.77}

 30%|██▉       | 110700/371472 [8:48:08<19:18:38,  3.75it/s]
 30%|██▉       | 110701/371472 [8:48:08<18:46:20,  3.86it/s]
 30%|██▉       | 110702/371472 [8:48:08<19:14:40,  3.76it/s]
 30%|██▉       | 110703/371472 [8:48:09<18:40:08,  3.88it/s]
 30%|██▉       | 110704/371472 [8:48:09<19:07:18,  3.79it/s]
 30%|██▉       | 110705/371472 [8:48:09<19:44:51,  3.67it/s]
 30%|██▉       | 110706/371472 [8:48:09<19:53:47,  3.64it/s]
 30%|██▉       | 110707/371472 [8:48:10<21:29:46,  3.37it/s]
 30%|██▉       | 110708/371472 [8:48:10<21:15:17,  3.41it/s]
 30%|██▉       | 110709/371472 [8:48:10<22:11:22,  3.26it/s]
 30%|██▉       | 110710/371472 [8:48:11<21:16:43,  3.40it/s]
 30%|██▉       | 110711/371472 [8:48:11<20:33:19,  3.52it/s]
 30%|██▉       | 110712/371472 [8:48:11<21:43:50,  3.33it/s]
 30%|██▉       | 110713/371472 [8:48:12<22:49:03,  3.17it/s]
 30%|██▉       | 110714/371472 [8:48:12<22:16:48,  3.25it/s]
 30%|██▉       | 110715/371472 [8:48:12<22:30:44,  3.22it/s]
 30%|██▉       | 110716/371472 [8:48:12<22:24:55,  3.23it/s]
 30%|██▉       | 110717/371472 [8:48:13<21:59:27,  3.29it/s]
 30%|██▉       | 110718/371472 [8:48:13<22:20:52,  3.24it/s]
 30%|██▉       | 110719/371472 [8:48:13<22:03:19,  3.28it/s]
 30%|██▉       | 110720/371472 [8:48:14<20:47:17,  3.48it/s]
                                                            
{'loss': 3.4632, 'learning_rate': 7.320886035036307e-07, 'epoch': 4.77}

 30%|██▉       | 110720/371472 [8:48:14<20:47:17,  3.48it/s]
 30%|██▉       | 110721/371472 [8:48:14<20:08:07,  3.60it/s]
 30%|██▉       | 110722/371472 [8:48:14<19:30:05,  3.71it/s]
 30%|██▉       | 110723/371472 [8:48:14<19:38:40,  3.69it/s]
 30%|██▉       | 110724/371472 [8:48:15<19:24:06,  3.73it/s]
 30%|██▉       | 110725/371472 [8:48:15<19:52:17,  3.64it/s]
 30%|██▉       | 110726/371472 [8:48:15<20:15:38,  3.57it/s]
 30%|██▉       | 110727/371472 [8:48:16<19:44:43,  3.67it/s]
 30%|██▉       | 110728/371472 [8:48:16<20:18:57,  3.57it/s]
 30%|██▉       | 110729/371472 [8:48:16<20:16:39,  3.57it/s]
 30%|██▉       | 110730/371472 [8:48:16<19:36:32,  3.69it/s]
 30%|██▉       | 110731/371472 [8:48:17<20:41:32,  3.50it/s]
 30%|██▉       | 110732/371472 [8:48:17<20:57:39,  3.46it/s]
 30%|██▉       | 110733/371472 [8:48:17<24:13:42,  2.99it/s]
 30%|██▉       | 110734/371472 [8:48:18<22:43:50,  3.19it/s]
 30%|██▉       | 110735/371472 [8:48:18<22:03:22,  3.28it/s]
 30%|██▉       | 110736/371472 [8:48:18<20:57:59,  3.45it/s]
 30%|██▉       | 110737/371472 [8:48:19<22:21:21,  3.24it/s]
 30%|██▉       | 110738/371472 [8:48:19<22:09:59,  3.27it/s]
 30%|██▉       | 110739/371472 [8:48:19<21:06:53,  3.43it/s]
 30%|██▉       | 110740/371472 [8:48:19<21:06:25,  3.43it/s]
                                                            
{'loss': 3.527, 'learning_rate': 7.320401215281518e-07, 'epoch': 4.77}

 30%|██▉       | 110740/371472 [8:48:19<21:06:25,  3.43it/s]
 30%|██▉       | 110741/371472 [8:48:20<21:07:52,  3.43it/s]
 30%|██▉       | 110742/371472 [8:48:20<20:44:56,  3.49it/s]
 30%|██▉       | 110743/371472 [8:48:20<21:17:26,  3.40it/s]
 30%|██▉       | 110744/371472 [8:48:21<20:34:12,  3.52it/s]
 30%|██▉       | 110745/371472 [8:48:21<19:39:38,  3.68it/s]
 30%|██▉       | 110746/371472 [8:48:21<19:40:21,  3.68it/s]
 30%|██▉       | 110747/371472 [8:48:21<20:10:30,  3.59it/s]
 30%|██▉       | 110748/371472 [8:48:22<20:00:49,  3.62it/s]
 30%|██▉       | 110749/371472 [8:48:22<19:38:46,  3.69it/s]
 30%|██▉       | 110750/371472 [8:48:22<20:54:23,  3.46it/s]
 30%|██▉       | 110751/371472 [8:48:22<20:26:12,  3.54it/s]
 30%|██▉       | 110752/371472 [8:48:23<20:36:15,  3.51it/s]
 30%|██▉       | 110753/371472 [8:48:23<19:58:14,  3.63it/s]
 30%|██▉       | 110754/371472 [8:48:23<19:35:55,  3.70it/s]
 30%|██▉       | 110755/371472 [8:48:24<21:17:41,  3.40it/s]
 30%|██▉       | 110756/371472 [8:48:24<20:34:04,  3.52it/s]
 30%|██▉       | 110757/371472 [8:48:24<20:09:59,  3.59it/s]
 30%|██▉       | 110758/371472 [8:48:24<19:41:00,  3.68it/s]
 30%|██▉       | 110759/371472 [8:48:25<20:15:24,  3.58it/s]
 30%|██▉       | 110760/371472 [8:48:25<21:02:29,  3.44it/s]
                                                            
{'loss': 3.5748, 'learning_rate': 7.31991639552673e-07, 'epoch': 4.77}

 30%|██▉       | 110760/371472 [8:48:25<21:02:29,  3.44it/s]
 30%|██▉       | 110761/371472 [8:48:25<20:15:57,  3.57it/s]
 30%|██▉       | 110762/371472 [8:48:26<20:06:53,  3.60it/s]
 30%|██▉       | 110763/371472 [8:48:26<20:21:39,  3.56it/s]
 30%|██▉       | 110764/371472 [8:48:26<21:34:44,  3.36it/s]
 30%|██▉       | 110765/371472 [8:48:27<23:30:42,  3.08it/s]
 30%|██▉       | 110766/371472 [8:48:27<22:12:55,  3.26it/s]
 30%|██▉       | 110767/371472 [8:48:27<22:01:24,  3.29it/s]
 30%|██▉       | 110768/371472 [8:48:27<21:45:47,  3.33it/s]
 30%|██▉       | 110769/371472 [8:48:28<22:39:26,  3.20it/s]
 30%|██▉       | 110770/371472 [8:48:28<21:47:20,  3.32it/s]
 30%|██▉       | 110771/371472 [8:48:28<22:13:08,  3.26it/s]
 30%|██▉       | 110772/371472 [8:48:29<22:20:55,  3.24it/s]
 30%|██▉       | 110773/371472 [8:48:29<21:07:20,  3.43it/s]
 30%|██▉       | 110774/371472 [8:48:29<21:13:21,  3.41it/s]
 30%|██▉       | 110775/371472 [8:48:29<20:36:00,  3.52it/s]
 30%|██▉       | 110776/371472 [8:48:30<20:15:32,  3.57it/s]
 30%|██▉       | 110777/371472 [8:48:30<19:48:53,  3.65it/s]
 30%|██▉       | 110778/371472 [8:48:30<19:13:03,  3.77it/s]
 30%|██▉       | 110779/371472 [8:48:31<19:57:22,  3.63it/s]
 30%|██▉       | 110780/371472 [8:48:31<20:17:44,  3.57it/s]
                                                            
{'loss': 3.5437, 'learning_rate': 7.319431575771941e-07, 'epoch': 4.77}

 30%|██▉       | 110780/371472 [8:48:31<20:17:44,  3.57it/s]
 30%|██▉       | 110781/371472 [8:48:31<20:18:22,  3.57it/s]
 30%|██▉       | 110782/371472 [8:48:31<20:12:35,  3.58it/s]
 30%|██▉       | 110783/371472 [8:48:32<19:20:06,  3.75it/s]
 30%|██▉       | 110784/371472 [8:48:32<19:51:24,  3.65it/s]
 30%|██▉       | 110785/371472 [8:48:32<18:56:53,  3.82it/s]
 30%|██▉       | 110786/371472 [8:48:32<19:18:17,  3.75it/s]
 30%|██▉       | 110787/371472 [8:48:33<19:21:50,  3.74it/s]
 30%|██▉       | 110788/371472 [8:48:33<19:55:12,  3.64it/s]
 30%|██▉       | 110789/371472 [8:48:33<20:13:51,  3.58it/s]
 30%|██▉       | 110790/371472 [8:48:34<19:58:57,  3.62it/s]
 30%|██▉       | 110791/371472 [8:48:34<19:34:33,  3.70it/s]
 30%|██▉       | 110792/371472 [8:48:34<19:29:15,  3.72it/s]
 30%|██▉       | 110793/371472 [8:48:34<19:18:13,  3.75it/s]
 30%|██▉       | 110794/371472 [8:48:35<20:10:15,  3.59it/s]
 30%|██▉       | 110795/371472 [8:48:35<20:29:04,  3.53it/s]
 30%|██▉       | 110796/371472 [8:48:35<20:40:16,  3.50it/s]
 30%|██▉       | 110797/371472 [8:48:36<21:34:05,  3.36it/s]
 30%|██▉       | 110798/371472 [8:48:36<20:48:24,  3.48it/s]
 30%|██▉       | 110799/371472 [8:48:36<20:36:48,  3.51it/s]
 30%|██▉       | 110800/371472 [8:48:36<20:33:03,  3.52it/s]
                                                            
{'loss': 3.3332, 'learning_rate': 7.318946756017151e-07, 'epoch': 4.77}

 30%|██▉       | 110800/371472 [8:48:36<20:33:03,  3.52it/s]
 30%|██▉       | 110801/371472 [8:48:37<20:04:49,  3.61it/s]
 30%|██▉       | 110802/371472 [8:48:37<19:37:31,  3.69it/s]
 30%|██▉       | 110803/371472 [8:48:37<18:50:53,  3.84it/s]
 30%|██▉       | 110804/371472 [8:48:38<20:44:49,  3.49it/s]
 30%|██▉       | 110805/371472 [8:48:38<20:28:36,  3.54it/s]
 30%|██▉       | 110806/371472 [8:48:38<23:01:12,  3.15it/s]
 30%|██▉       | 110807/371472 [8:48:38<21:54:56,  3.30it/s]
 30%|██▉       | 110808/371472 [8:48:39<21:40:41,  3.34it/s]
 30%|██▉       | 110809/371472 [8:48:39<20:56:01,  3.46it/s]
 30%|██▉       | 110810/371472 [8:48:39<20:26:00,  3.54it/s]
 30%|██▉       | 110811/371472 [8:48:40<20:43:21,  3.49it/s]
 30%|██▉       | 110812/371472 [8:48:40<21:16:23,  3.40it/s]
 30%|██▉       | 110813/371472 [8:48:40<20:30:08,  3.53it/s]
 30%|██▉       | 110814/371472 [8:48:40<21:24:06,  3.38it/s]
 30%|██▉       | 110815/371472 [8:48:41<20:07:04,  3.60it/s]
 30%|██▉       | 110816/371472 [8:48:41<20:02:59,  3.61it/s]
 30%|██▉       | 110817/371472 [8:48:41<19:59:55,  3.62it/s]
 30%|██▉       | 110818/371472 [8:48:42<20:09:58,  3.59it/s]
 30%|██▉       | 110819/371472 [8:48:42<19:31:44,  3.71it/s]
 30%|██▉       | 110820/371472 [8:48:42<19:49:10,  3.65it/s]
                                                            
{'loss': 3.5089, 'learning_rate': 7.318461936262363e-07, 'epoch': 4.77}

 30%|██▉       | 110820/371472 [8:48:42<19:49:10,  3.65it/s]
 30%|██▉       | 110821/371472 [8:48:42<20:22:32,  3.55it/s]
 30%|██▉       | 110822/371472 [8:48:43<19:56:44,  3.63it/s]
 30%|██▉       | 110823/371472 [8:48:43<19:54:06,  3.64it/s]
 30%|██▉       | 110824/371472 [8:48:43<19:41:38,  3.68it/s]
 30%|██▉       | 110825/371472 [8:48:43<19:40:31,  3.68it/s]
 30%|██▉       | 110826/371472 [8:48:44<19:23:29,  3.73it/s]
 30%|██▉       | 110827/371472 [8:48:44<19:53:32,  3.64it/s]
 30%|██▉       | 110828/371472 [8:48:44<19:25:06,  3.73it/s]
 30%|██▉       | 110829/371472 [8:48:45<20:16:37,  3.57it/s]
 30%|██▉       | 110830/371472 [8:48:45<19:44:56,  3.67it/s]
 30%|██▉       | 110831/371472 [8:48:45<20:38:38,  3.51it/s]
 30%|██▉       | 110832/371472 [8:48:45<22:24:14,  3.23it/s]
 30%|██▉       | 110833/371472 [8:48:46<21:07:28,  3.43it/s]
 30%|██▉       | 110834/371472 [8:48:46<20:17:17,  3.57it/s]
 30%|██▉       | 110835/371472 [8:48:46<20:36:37,  3.51it/s]
 30%|██▉       | 110836/371472 [8:48:47<20:31:20,  3.53it/s]
 30%|██▉       | 110837/371472 [8:48:47<20:36:00,  3.51it/s]
 30%|██▉       | 110838/371472 [8:48:47<20:10:42,  3.59it/s]
 30%|██▉       | 110839/371472 [8:48:47<19:24:03,  3.73it/s]
 30%|██▉       | 110840/371472 [8:48:48<19:38:08,  3.69it/s]
                                                            
{'loss': 3.2424, 'learning_rate': 7.317977116507574e-07, 'epoch': 4.77}

 30%|██▉       | 110840/371472 [8:48:48<19:38:08,  3.69it/s]
 30%|██▉       | 110841/371472 [8:48:48<20:26:50,  3.54it/s]
 30%|██▉       | 110842/371472 [8:48:48<19:48:14,  3.66it/s]
 30%|██▉       | 110843/371472 [8:48:48<20:18:05,  3.57it/s]
 30%|██▉       | 110844/371472 [8:48:49<19:40:06,  3.68it/s]
 30%|██▉       | 110845/371472 [8:48:49<20:09:34,  3.59it/s]
 30%|██▉       | 110846/371472 [8:48:49<20:13:41,  3.58it/s]
 30%|██▉       | 110847/371472 [8:48:50<19:34:40,  3.70it/s]
 30%|██▉       | 110848/371472 [8:48:50<19:56:23,  3.63it/s]
 30%|██▉       | 110849/371472 [8:48:50<19:46:09,  3.66it/s]
 30%|██▉       | 110850/371472 [8:48:50<19:38:50,  3.68it/s]
 30%|██▉       | 110851/371472 [8:48:51<20:40:11,  3.50it/s]
 30%|██▉       | 110852/371472 [8:48:51<20:38:36,  3.51it/s]
 30%|██▉       | 110853/371472 [8:48:51<20:25:39,  3.54it/s]
 30%|██▉       | 110854/371472 [8:48:52<20:22:45,  3.55it/s]
 30%|██▉       | 110855/371472 [8:48:52<19:54:43,  3.64it/s]
 30%|██▉       | 110856/371472 [8:48:52<20:06:42,  3.60it/s]
 30%|██▉       | 110857/371472 [8:48:52<20:21:47,  3.56it/s]
 30%|██▉       | 110858/371472 [8:48:53<19:58:08,  3.63it/s]
 30%|██▉       | 110859/371472 [8:48:53<19:21:43,  3.74it/s]
 30%|██▉       | 110860/371472 [8:48:53<18:46:11,  3.86it/s]
                                                            
{'loss': 3.4568, 'learning_rate': 7.317492296752786e-07, 'epoch': 4.77}

 30%|██▉       | 110860/371472 [8:48:53<18:46:11,  3.86it/s]
 30%|██▉       | 110861/371472 [8:48:53<19:57:39,  3.63it/s]
 30%|██▉       | 110862/371472 [8:48:54<19:21:46,  3.74it/s]
 30%|██▉       | 110863/371472 [8:48:54<19:34:12,  3.70it/s]
 30%|██▉       | 110864/371472 [8:48:54<20:02:02,  3.61it/s]
 30%|██▉       | 110865/371472 [8:48:55<19:41:04,  3.68it/s]
 30%|██▉       | 110866/371472 [8:48:55<19:35:37,  3.69it/s]
 30%|██▉       | 110867/371472 [8:48:55<19:45:15,  3.66it/s]
 30%|██▉       | 110868/371472 [8:48:55<20:18:12,  3.57it/s]
 30%|██▉       | 110869/371472 [8:48:56<20:08:00,  3.60it/s]
 30%|██▉       | 110870/371472 [8:48:56<20:14:22,  3.58it/s]
 30%|██▉       | 110871/371472 [8:48:56<20:22:51,  3.55it/s]
 30%|██▉       | 110872/371472 [8:48:56<20:00:02,  3.62it/s]
 30%|██▉       | 110873/371472 [8:48:57<19:06:57,  3.79it/s]
 30%|██▉       | 110874/371472 [8:48:57<18:50:38,  3.84it/s]
 30%|██▉       | 110875/371472 [8:48:57<19:13:35,  3.76it/s]
 30%|██▉       | 110876/371472 [8:48:58<19:18:31,  3.75it/s]
 30%|██▉       | 110877/371472 [8:48:58<19:20:41,  3.74it/s]
 30%|██▉       | 110878/371472 [8:48:58<19:59:28,  3.62it/s]
 30%|██▉       | 110879/371472 [8:48:58<20:06:32,  3.60it/s]
 30%|██▉       | 110880/371472 [8:48:59<20:22:34,  3.55it/s]
                                                            
{'loss': 3.2172, 'learning_rate': 7.317007476997995e-07, 'epoch': 4.78}

 30%|██▉       | 110880/371472 [8:48:59<20:22:34,  3.55it/s]
 30%|██▉       | 110881/371472 [8:48:59<20:29:40,  3.53it/s]
 30%|██▉       | 110882/371472 [8:48:59<20:15:51,  3.57it/s]
 30%|██▉       | 110883/371472 [8:48:59<19:46:45,  3.66it/s]
 30%|██▉       | 110884/371472 [8:49:00<19:19:06,  3.75it/s]
 30%|██▉       | 110885/371472 [8:49:00<20:08:08,  3.59it/s]
 30%|██▉       | 110886/371472 [8:49:00<21:48:04,  3.32it/s]
 30%|██▉       | 110887/371472 [8:49:01<21:55:03,  3.30it/s]
 30%|██▉       | 110888/371472 [8:49:01<23:57:19,  3.02it/s]
 30%|██▉       | 110889/371472 [8:49:01<22:34:38,  3.21it/s]
 30%|██▉       | 110890/371472 [8:49:02<21:50:29,  3.31it/s]
 30%|██▉       | 110891/371472 [8:49:02<21:44:51,  3.33it/s]
 30%|██▉       | 110892/371472 [8:49:02<21:21:50,  3.39it/s]
 30%|██▉       | 110893/371472 [8:49:02<21:24:16,  3.38it/s]
 30%|██▉       | 110894/371472 [8:49:03<20:17:33,  3.57it/s]
 30%|██▉       | 110895/371472 [8:49:03<20:09:57,  3.59it/s]
 30%|██▉       | 110896/371472 [8:49:03<20:08:39,  3.59it/s]
 30%|██▉       | 110897/371472 [8:49:04<20:55:43,  3.46it/s]
 30%|██▉       | 110898/371472 [8:49:04<20:38:10,  3.51it/s]
 30%|██▉       | 110899/371472 [8:49:04<21:14:11,  3.41it/s]
 30%|██▉       | 110900/371472 [8:49:04<20:09:00,  3.59it/s]
                                                            
{'loss': 3.3651, 'learning_rate': 7.316522657243207e-07, 'epoch': 4.78}

 30%|██▉       | 110900/371472 [8:49:04<20:09:00,  3.59it/s]
 30%|██▉       | 110901/371472 [8:49:05<19:58:52,  3.62it/s]
 30%|██▉       | 110902/371472 [8:49:05<19:35:40,  3.69it/s]
 30%|██▉       | 110903/371472 [8:49:05<18:57:22,  3.82it/s]
 30%|██▉       | 110904/371472 [8:49:06<19:42:59,  3.67it/s]
 30%|██▉       | 110905/371472 [8:49:06<20:13:20,  3.58it/s]
 30%|██▉       | 110906/371472 [8:49:06<21:17:17,  3.40it/s]
 30%|██▉       | 110907/371472 [8:49:06<20:10:31,  3.59it/s]
 30%|██▉       | 110908/371472 [8:49:07<20:10:48,  3.59it/s]
 30%|██▉       | 110909/371472 [8:49:07<19:52:12,  3.64it/s]
 30%|██▉       | 110910/371472 [8:49:07<19:21:03,  3.74it/s]
 30%|██▉       | 110911/371472 [8:49:07<19:20:08,  3.74it/s]
 30%|██▉       | 110912/371472 [8:49:08<21:02:54,  3.44it/s]
 30%|██▉       | 110913/371472 [8:49:08<20:37:24,  3.51it/s]
 30%|██▉       | 110914/371472 [8:49:08<21:19:51,  3.39it/s]
 30%|██▉       | 110915/371472 [8:49:09<21:14:14,  3.41it/s]
 30%|██▉       | 110916/371472 [8:49:09<21:28:52,  3.37it/s]
 30%|██▉       | 110917/371472 [8:49:09<21:11:22,  3.42it/s]
 30%|██▉       | 110918/371472 [8:49:10<21:50:22,  3.31it/s]
 30%|██▉       | 110919/371472 [8:49:10<21:00:05,  3.45it/s]
 30%|██▉       | 110920/371472 [8:49:10<20:47:06,  3.48it/s]
                                                            
{'loss': 3.3589, 'learning_rate': 7.316037837488418e-07, 'epoch': 4.78}

 30%|██▉       | 110920/371472 [8:49:10<20:47:06,  3.48it/s]
 30%|██▉       | 110921/371472 [8:49:10<19:51:58,  3.64it/s]
 30%|██▉       | 110922/371472 [8:49:11<19:30:11,  3.71it/s]
 30%|██▉       | 110923/371472 [8:49:11<19:13:06,  3.77it/s]
 30%|██▉       | 110924/371472 [8:49:11<18:48:33,  3.85it/s]
 30%|██▉       | 110925/371472 [8:49:11<19:01:57,  3.80it/s]
 30%|██▉       | 110926/371472 [8:49:12<19:49:05,  3.65it/s]
 30%|██▉       | 110927/371472 [8:49:12<20:46:04,  3.48it/s]
 30%|██▉       | 110928/371472 [8:49:12<20:17:27,  3.57it/s]
 30%|██▉       | 110929/371472 [8:49:13<21:01:10,  3.44it/s]
 30%|██▉       | 110930/371472 [8:49:13<20:28:23,  3.54it/s]
 30%|██▉       | 110931/371472 [8:49:13<20:01:17,  3.61it/s]
 30%|██▉       | 110932/371472 [8:49:14<23:54:36,  3.03it/s]
 30%|██▉       | 110933/371472 [8:49:14<22:46:36,  3.18it/s]
 30%|██▉       | 110934/371472 [8:49:14<21:56:14,  3.30it/s]
 30%|██▉       | 110935/371472 [8:49:14<21:26:59,  3.37it/s]
 30%|██▉       | 110936/371472 [8:49:15<21:03:25,  3.44it/s]
 30%|██▉       | 110937/371472 [8:49:15<22:11:46,  3.26it/s]
 30%|██▉       | 110938/371472 [8:49:15<21:15:46,  3.40it/s]
 30%|██▉       | 110939/371472 [8:49:16<20:51:25,  3.47it/s]
 30%|██▉       | 110940/371472 [8:49:16<19:45:16,  3.66it/s]
                                                            
{'loss': 3.3583, 'learning_rate': 7.315553017733629e-07, 'epoch': 4.78}

 30%|██▉       | 110940/371472 [8:49:16<19:45:16,  3.66it/s]
 30%|██▉       | 110941/371472 [8:49:16<19:18:55,  3.75it/s]
 30%|██▉       | 110942/371472 [8:49:16<21:12:52,  3.41it/s]
 30%|██▉       | 110943/371472 [8:49:17<20:45:26,  3.49it/s]
 30%|██▉       | 110944/371472 [8:49:17<19:56:34,  3.63it/s]
 30%|██▉       | 110945/371472 [8:49:17<19:34:06,  3.70it/s]
 30%|██▉       | 110946/371472 [8:49:17<19:24:22,  3.73it/s]
 30%|██▉       | 110947/371472 [8:49:18<20:05:40,  3.60it/s]
 30%|██▉       | 110948/371472 [8:49:18<21:36:32,  3.35it/s]
 30%|██▉       | 110949/371472 [8:49:18<21:32:22,  3.36it/s]
 30%|██▉       | 110950/371472 [8:49:19<20:24:36,  3.55it/s]
 30%|██▉       | 110951/371472 [8:49:19<22:09:56,  3.26it/s]
 30%|██▉       | 110952/371472 [8:49:19<21:06:50,  3.43it/s]
 30%|██▉       | 110953/371472 [8:49:20<20:38:22,  3.51it/s]
 30%|██▉       | 110954/371472 [8:49:20<20:19:11,  3.56it/s]
 30%|██▉       | 110955/371472 [8:49:20<21:40:44,  3.34it/s]
 30%|██▉       | 110956/371472 [8:49:20<21:02:49,  3.44it/s]
 30%|██▉       | 110957/371472 [8:49:21<20:05:59,  3.60it/s]
 30%|██▉       | 110958/371472 [8:49:21<19:28:13,  3.72it/s]
 30%|██▉       | 110959/371472 [8:49:21<19:11:05,  3.77it/s]
 30%|██▉       | 110960/371472 [8:49:21<18:50:41,  3.84it/s]
                                                            
{'loss': 3.1732, 'learning_rate': 7.315068197978839e-07, 'epoch': 4.78}

 30%|██▉       | 110960/371472 [8:49:21<18:50:41,  3.84it/s]
 30%|██▉       | 110961/371472 [8:49:22<19:05:45,  3.79it/s]
 30%|██▉       | 110962/371472 [8:49:22<22:31:42,  3.21it/s]
 30%|██▉       | 110963/371472 [8:49:22<21:55:28,  3.30it/s]
 30%|██▉       | 110964/371472 [8:49:23<22:33:14,  3.21it/s]
 30%|██▉       | 110965/371472 [8:49:23<22:10:05,  3.26it/s]
 30%|██▉       | 110966/371472 [8:49:23<22:10:15,  3.26it/s]
 30%|██▉       | 110967/371472 [8:49:24<21:18:26,  3.40it/s]
 30%|██▉       | 110968/371472 [8:49:24<20:32:41,  3.52it/s]
 30%|██▉       | 110969/371472 [8:49:24<21:30:10,  3.37it/s]
 30%|██▉       | 110970/371472 [8:49:24<21:02:28,  3.44it/s]
 30%|██▉       | 110971/371472 [8:49:25<20:48:07,  3.48it/s]
 30%|██▉       | 110972/371472 [8:49:25<20:54:55,  3.46it/s]
 30%|██▉       | 110973/371472 [8:49:25<21:16:50,  3.40it/s]
 30%|██▉       | 110974/371472 [8:49:26<21:31:22,  3.36it/s]
 30%|██▉       | 110975/371472 [8:49:26<21:17:45,  3.40it/s]
 30%|██▉       | 110976/371472 [8:49:26<22:00:36,  3.29it/s]
 30%|██▉       | 110977/371472 [8:49:27<21:47:42,  3.32it/s]
 30%|██▉       | 110978/371472 [8:49:27<21:16:55,  3.40it/s]
 30%|██▉       | 110979/371472 [8:49:27<21:32:01,  3.36it/s]
 30%|██▉       | 110980/371472 [8:49:27<20:34:57,  3.52it/s]
                                                            
{'loss': 3.4154, 'learning_rate': 7.314583378224051e-07, 'epoch': 4.78}

 30%|██▉       | 110980/371472 [8:49:27<20:34:57,  3.52it/s]
 30%|██▉       | 110981/371472 [8:49:28<20:58:42,  3.45it/s]
 30%|██▉       | 110982/371472 [8:49:28<22:02:34,  3.28it/s]
 30%|██▉       | 110983/371472 [8:49:28<21:31:04,  3.36it/s]
 30%|██▉       | 110984/371472 [8:49:29<20:49:31,  3.47it/s]
 30%|██▉       | 110985/371472 [8:49:29<21:26:29,  3.37it/s]
 30%|██▉       | 110986/371472 [8:49:29<24:53:56,  2.91it/s]
 30%|██▉       | 110987/371472 [8:49:30<24:47:00,  2.92it/s]
 30%|██▉       | 110988/371472 [8:49:30<23:47:50,  3.04it/s]
 30%|██▉       | 110989/371472 [8:49:30<24:21:54,  2.97it/s]
 30%|██▉       | 110990/371472 [8:49:31<22:21:42,  3.24it/s]
 30%|██▉       | 110991/371472 [8:49:31<21:50:54,  3.31it/s]
 30%|██▉       | 110992/371472 [8:49:31<20:37:21,  3.51it/s]
 30%|██▉       | 110993/371472 [8:49:31<20:48:38,  3.48it/s]
 30%|██▉       | 110994/371472 [8:49:32<20:17:31,  3.57it/s]
 30%|██▉       | 110995/371472 [8:49:32<19:37:36,  3.69it/s]
 30%|██▉       | 110996/371472 [8:49:32<19:10:22,  3.77it/s]
 30%|██▉       | 110997/371472 [8:49:32<19:32:33,  3.70it/s]
 30%|██▉       | 110998/371472 [8:49:33<19:10:37,  3.77it/s]
 30%|██▉       | 110999/371472 [8:49:33<18:53:39,  3.83it/s]
 30%|██▉       | 111000/371472 [8:49:33<18:40:24,  3.87it/s]
                                                            
{'loss': 3.5414, 'learning_rate': 7.314098558469262e-07, 'epoch': 4.78}

 30%|██▉       | 111000/371472 [8:49:33<18:40:24,  3.87it/s]
 30%|██▉       | 111001/371472 [8:49:33<19:20:14,  3.74it/s]
 30%|██▉       | 111002/371472 [8:49:34<19:04:34,  3.79it/s]
 30%|██▉       | 111003/371472 [8:49:34<18:51:35,  3.84it/s]
 30%|██▉       | 111004/371472 [8:49:34<19:39:10,  3.68it/s]
 30%|██▉       | 111005/371472 [8:49:35<19:09:32,  3.78it/s]
 30%|██▉       | 111006/371472 [8:49:35<20:07:53,  3.59it/s]
 30%|██▉       | 111007/371472 [8:49:35<19:34:45,  3.70it/s]
 30%|██▉       | 111008/371472 [8:49:35<19:32:40,  3.70it/s]
 30%|██▉       | 111009/371472 [8:49:36<21:13:46,  3.41it/s]
 30%|██▉       | 111010/371472 [8:49:36<21:18:08,  3.40it/s]
 30%|██▉       | 111011/371472 [8:49:36<20:13:24,  3.58it/s]
 30%|██▉       | 111012/371472 [8:49:37<19:53:20,  3.64it/s]
 30%|██▉       | 111013/371472 [8:49:37<19:38:11,  3.68it/s]
 30%|██▉       | 111014/371472 [8:49:37<19:00:12,  3.81it/s]
 30%|██▉       | 111015/371472 [8:49:37<18:50:25,  3.84it/s]
 30%|██▉       | 111016/371472 [8:49:38<19:04:16,  3.79it/s]
 30%|██▉       | 111017/371472 [8:49:38<19:54:40,  3.63it/s]
 30%|██▉       | 111018/371472 [8:49:38<20:27:59,  3.53it/s]
 30%|██▉       | 111019/371472 [8:49:38<20:16:41,  3.57it/s]
 30%|██▉       | 111020/371472 [8:49:39<19:36:04,  3.69it/s]
                                                            
{'loss': 3.4901, 'learning_rate': 7.313613738714473e-07, 'epoch': 4.78}

 30%|██▉       | 111020/371472 [8:49:39<19:36:04,  3.69it/s]
 30%|██▉       | 111021/371472 [8:49:39<19:11:51,  3.77it/s]
 30%|██▉       | 111022/371472 [8:49:39<20:51:04,  3.47it/s]
 30%|██▉       | 111023/371472 [8:49:40<20:34:11,  3.52it/s]
 30%|██▉       | 111024/371472 [8:49:40<23:35:46,  3.07it/s]
 30%|██▉       | 111025/371472 [8:49:40<21:28:22,  3.37it/s]
 30%|██▉       | 111026/371472 [8:49:40<20:48:52,  3.48it/s]
 30%|██▉       | 111027/371472 [8:49:41<20:36:28,  3.51it/s]
 30%|██▉       | 111028/371472 [8:49:41<20:36:28,  3.51it/s]
 30%|██▉       | 111029/371472 [8:49:41<21:05:14,  3.43it/s]
 30%|██▉       | 111030/371472 [8:49:42<20:20:01,  3.56it/s]
 30%|██▉       | 111031/371472 [8:49:42<19:40:58,  3.68it/s]
 30%|██▉       | 111032/371472 [8:49:42<19:33:37,  3.70it/s]
 30%|██▉       | 111033/371472 [8:49:42<19:58:18,  3.62it/s]
 30%|██▉       | 111034/371472 [8:49:43<20:59:03,  3.45it/s]
 30%|██▉       | 111035/371472 [8:49:43<21:50:24,  3.31it/s]
 30%|██▉       | 111036/371472 [8:49:43<21:51:36,  3.31it/s]
 30%|██▉       | 111037/371472 [8:49:44<22:52:02,  3.16it/s]
 30%|██▉       | 111038/371472 [8:49:44<21:56:59,  3.30it/s]
 30%|██▉       | 111039/371472 [8:49:44<21:13:41,  3.41it/s]
 30%|██▉       | 111040/371472 [8:49:45<20:33:20,  3.52it/s]
                                                            
{'loss': 3.3706, 'learning_rate': 7.313128918959684e-07, 'epoch': 4.78}

 30%|██▉       | 111040/371472 [8:49:45<20:33:20,  3.52it/s]
 30%|██▉       | 111041/371472 [8:49:45<20:01:36,  3.61it/s]
 30%|██▉       | 111042/371472 [8:49:45<19:23:26,  3.73it/s]
 30%|██▉       | 111043/371472 [8:49:45<19:52:23,  3.64it/s]
 30%|██▉       | 111044/371472 [8:49:46<20:02:38,  3.61it/s]
 30%|██▉       | 111045/371472 [8:49:46<20:42:56,  3.49it/s]
 30%|██▉       | 111046/371472 [8:49:46<26:32:53,  2.72it/s]
 30%|██▉       | 111047/371472 [8:49:47<24:31:00,  2.95it/s]
 30%|██▉       | 111048/371472 [8:49:47<24:32:08,  2.95it/s]
 30%|██▉       | 111049/371472 [8:49:47<23:03:55,  3.14it/s]
 30%|██▉       | 111050/371472 [8:49:48<21:45:52,  3.32it/s]
 30%|██▉       | 111051/371472 [8:49:48<21:09:16,  3.42it/s]
 30%|██▉       | 111052/371472 [8:49:48<22:09:10,  3.27it/s]
 30%|██▉       | 111053/371472 [8:49:48<20:42:59,  3.49it/s]
 30%|██▉       | 111054/371472 [8:49:49<19:49:15,  3.65it/s]
 30%|██▉       | 111055/371472 [8:49:49<19:49:42,  3.65it/s]
 30%|██▉       | 111056/371472 [8:49:49<19:13:08,  3.76it/s]
 30%|██▉       | 111057/371472 [8:49:50<20:16:41,  3.57it/s]
 30%|██▉       | 111058/371472 [8:49:50<20:03:03,  3.61it/s]
 30%|██▉       | 111059/371472 [8:49:50<19:52:10,  3.64it/s]
 30%|██▉       | 111060/371472 [8:49:50<20:32:45,  3.52it/s]
                                                            
{'loss': 3.2446, 'learning_rate': 7.312644099204896e-07, 'epoch': 4.78}

 30%|██▉       | 111060/371472 [8:49:50<20:32:45,  3.52it/s]
 30%|██▉       | 111061/371472 [8:49:51<20:17:25,  3.57it/s]
 30%|██▉       | 111062/371472 [8:49:51<20:40:20,  3.50it/s]
 30%|██▉       | 111063/371472 [8:49:51<19:39:59,  3.68it/s]
 30%|██▉       | 111064/371472 [8:49:51<19:07:54,  3.78it/s]
 30%|██▉       | 111065/371472 [8:49:52<18:55:25,  3.82it/s]
 30%|██▉       | 111066/371472 [8:49:52<19:12:05,  3.77it/s]
 30%|██▉       | 111067/371472 [8:49:52<19:30:02,  3.71it/s]
 30%|██▉       | 111068/371472 [8:49:53<19:14:28,  3.76it/s]
 30%|██▉       | 111069/371472 [8:49:53<18:58:18,  3.81it/s]
 30%|██▉       | 111070/371472 [8:49:53<19:48:04,  3.65it/s]
 30%|██▉       | 111071/371472 [8:49:53<19:01:32,  3.80it/s]
 30%|██▉       | 111072/371472 [8:49:54<20:38:44,  3.50it/s]
 30%|██▉       | 111073/371472 [8:49:54<20:23:40,  3.55it/s]
 30%|██▉       | 111074/371472 [8:49:54<20:22:29,  3.55it/s]
 30%|██▉       | 111075/371472 [8:49:54<20:47:39,  3.48it/s]
 30%|██▉       | 111076/371472 [8:49:55<20:46:59,  3.48it/s]
 30%|██▉       | 111077/371472 [8:49:55<20:21:35,  3.55it/s]
 30%|██▉       | 111078/371472 [8:49:55<19:43:31,  3.67it/s]
 30%|██▉       | 111079/371472 [8:49:56<21:20:54,  3.39it/s]
 30%|██▉       | 111080/371472 [8:49:56<20:31:57,  3.52it/s]
                                                            
{'loss': 3.5023, 'learning_rate': 7.312159279450106e-07, 'epoch': 4.78}

 30%|██▉       | 111080/371472 [8:49:56<20:31:57,  3.52it/s]
 30%|██▉       | 111081/371472 [8:49:56<19:30:06,  3.71it/s]
 30%|██▉       | 111082/371472 [8:49:56<19:04:40,  3.79it/s]
 30%|██▉       | 111083/371472 [8:49:57<20:40:06,  3.50it/s]
 30%|██▉       | 111084/371472 [8:49:57<20:17:04,  3.57it/s]
 30%|██▉       | 111085/371472 [8:49:57<20:46:22,  3.48it/s]
 30%|██▉       | 111086/371472 [8:49:58<19:44:40,  3.66it/s]
 30%|██▉       | 111087/371472 [8:49:58<19:21:55,  3.73it/s]
 30%|██▉       | 111088/371472 [8:49:58<18:50:30,  3.84it/s]
 30%|██▉       | 111089/371472 [8:49:58<19:54:43,  3.63it/s]
 30%|██▉       | 111090/371472 [8:49:59<19:38:47,  3.68it/s]
 30%|██▉       | 111091/371472 [8:49:59<20:33:32,  3.52it/s]
 30%|██▉       | 111092/371472 [8:49:59<19:52:46,  3.64it/s]
 30%|██▉       | 111093/371472 [8:49:59<19:32:30,  3.70it/s]
 30%|██▉       | 111094/371472 [8:50:00<19:38:15,  3.68it/s]
 30%|██▉       | 111095/371472 [8:50:00<20:58:39,  3.45it/s]
 30%|██▉       | 111096/371472 [8:50:00<21:59:41,  3.29it/s]
 30%|██▉       | 111097/371472 [8:50:01<25:01:59,  2.89it/s]
 30%|██▉       | 111098/371472 [8:50:01<23:42:10,  3.05it/s]
 30%|██▉       | 111099/371472 [8:50:01<21:54:44,  3.30it/s]
 30%|██▉       | 111100/371472 [8:50:02<21:16:40,  3.40it/s]
                                                            
{'loss': 3.4189, 'learning_rate': 7.311674459695316e-07, 'epoch': 4.79}

 30%|██▉       | 111100/371472 [8:50:02<21:16:40,  3.40it/s]
 30%|██▉       | 111101/371472 [8:50:02<23:36:28,  3.06it/s]
 30%|██▉       | 111102/371472 [8:50:02<23:06:11,  3.13it/s]
 30%|██▉       | 111103/371472 [8:50:03<23:14:38,  3.11it/s]
 30%|██▉       | 111104/371472 [8:50:03<22:22:04,  3.23it/s]
 30%|██▉       | 111105/371472 [8:50:03<21:16:22,  3.40it/s]
 30%|██▉       | 111106/371472 [8:50:03<20:23:52,  3.55it/s]
 30%|██▉       | 111107/371472 [8:50:04<19:41:35,  3.67it/s]
 30%|██▉       | 111108/371472 [8:50:04<19:58:30,  3.62it/s]
 30%|██▉       | 111109/371472 [8:50:04<19:50:38,  3.64it/s]
 30%|██▉       | 111110/371472 [8:50:05<20:32:45,  3.52it/s]
 30%|██▉       | 111111/371472 [8:50:05<20:07:05,  3.59it/s]
 30%|██▉       | 111112/371472 [8:50:05<24:57:33,  2.90it/s]
 30%|██▉       | 111113/371472 [8:50:06<25:36:49,  2.82it/s]
 30%|██▉       | 111114/371472 [8:50:06<23:22:48,  3.09it/s]
 30%|██▉       | 111115/371472 [8:50:06<25:15:09,  2.86it/s]
 30%|██▉       | 111116/371472 [8:50:07<23:46:46,  3.04it/s]
 30%|██▉       | 111117/371472 [8:50:07<24:39:53,  2.93it/s]
 30%|██▉       | 111118/371472 [8:50:07<24:06:00,  3.00it/s]
 30%|██▉       | 111119/371472 [8:50:08<24:10:56,  2.99it/s]
 30%|██▉       | 111120/371472 [8:50:08<22:44:33,  3.18it/s]
                                                            
{'loss': 3.2795, 'learning_rate': 7.311189639940528e-07, 'epoch': 4.79}

 30%|██▉       | 111120/371472 [8:50:08<22:44:33,  3.18it/s]
 30%|██▉       | 111121/371472 [8:50:08<22:04:17,  3.28it/s]
 30%|██▉       | 111122/371472 [8:50:09<21:25:52,  3.37it/s]
 30%|██▉       | 111123/371472 [8:50:09<22:07:58,  3.27it/s]
 30%|██▉       | 111124/371472 [8:50:09<21:52:59,  3.30it/s]
 30%|██▉       | 111125/371472 [8:50:09<22:17:05,  3.25it/s]
 30%|██▉       | 111126/371472 [8:50:10<21:32:04,  3.36it/s]
 30%|██▉       | 111127/371472 [8:50:10<23:45:06,  3.04it/s]
 30%|██▉       | 111128/371472 [8:50:10<22:07:04,  3.27it/s]
 30%|██▉       | 111129/371472 [8:50:11<22:06:14,  3.27it/s]
 30%|██▉       | 111130/371472 [8:50:11<22:29:57,  3.21it/s]
 30%|██▉       | 111131/371472 [8:50:11<21:57:37,  3.29it/s]
 30%|██▉       | 111132/371472 [8:50:12<21:17:51,  3.40it/s]
 30%|██▉       | 111133/371472 [8:50:12<20:46:47,  3.48it/s]
 30%|██▉       | 111134/371472 [8:50:12<19:53:13,  3.64it/s]
 30%|██▉       | 111135/371472 [8:50:12<19:25:02,  3.72it/s]
 30%|██▉       | 111136/371472 [8:50:13<20:07:36,  3.59it/s]
 30%|██▉       | 111137/371472 [8:50:13<19:38:37,  3.68it/s]
 30%|██▉       | 111138/371472 [8:50:13<19:48:58,  3.65it/s]
 30%|██▉       | 111139/371472 [8:50:13<19:42:20,  3.67it/s]
 30%|██▉       | 111140/371472 [8:50:14<19:51:46,  3.64it/s]
                                                            
{'loss': 3.2671, 'learning_rate': 7.31070482018574e-07, 'epoch': 4.79}

 30%|██▉       | 111140/371472 [8:50:14<19:51:46,  3.64it/s]
 30%|██▉       | 111141/371472 [8:50:14<19:44:45,  3.66it/s]
 30%|██▉       | 111142/371472 [8:50:14<19:36:29,  3.69it/s]
 30%|██▉       | 111143/371472 [8:50:14<18:53:39,  3.83it/s]
 30%|██▉       | 111144/371472 [8:50:15<19:20:19,  3.74it/s]
 30%|██▉       | 111145/371472 [8:50:15<19:07:09,  3.78it/s]
 30%|██▉       | 111146/371472 [8:50:15<19:01:53,  3.80it/s]
 30%|██▉       | 111147/371472 [8:50:16<19:35:08,  3.69it/s]
 30%|██▉       | 111148/371472 [8:50:16<19:37:40,  3.68it/s]
 30%|██▉       | 111149/371472 [8:50:16<19:30:50,  3.71it/s]
 30%|██▉       | 111150/371472 [8:50:16<19:43:27,  3.67it/s]
 30%|██▉       | 111151/371472 [8:50:17<19:50:08,  3.65it/s]
 30%|██▉       | 111152/371472 [8:50:17<19:23:27,  3.73it/s]
 30%|██▉       | 111153/371472 [8:50:17<19:14:01,  3.76it/s]
 30%|██▉       | 111154/371472 [8:50:17<19:25:05,  3.72it/s]
 30%|██▉       | 111155/371472 [8:50:18<20:26:00,  3.54it/s]
 30%|██▉       | 111156/371472 [8:50:18<20:49:42,  3.47it/s]
 30%|██▉       | 111157/371472 [8:50:18<20:50:42,  3.47it/s]
 30%|██▉       | 111158/371472 [8:50:19<20:13:32,  3.58it/s]
 30%|██▉       | 111159/371472 [8:50:19<21:36:00,  3.35it/s]
 30%|██▉       | 111160/371472 [8:50:19<20:40:42,  3.50it/s]
                                                            
{'loss': 3.2637, 'learning_rate': 7.310220000430951e-07, 'epoch': 4.79}

 30%|██▉       | 111160/371472 [8:50:19<20:40:42,  3.50it/s]
 30%|██▉       | 111161/371472 [8:50:19<19:57:34,  3.62it/s]
 30%|██▉       | 111162/371472 [8:50:20<19:49:07,  3.65it/s]
 30%|██▉       | 111163/371472 [8:50:20<19:30:04,  3.71it/s]
 30%|██▉       | 111164/371472 [8:50:20<19:56:49,  3.62it/s]
 30%|██▉       | 111165/371472 [8:50:21<20:21:42,  3.55it/s]
 30%|██▉       | 111166/371472 [8:50:21<21:39:28,  3.34it/s]
 30%|██▉       | 111167/371472 [8:50:21<20:40:29,  3.50it/s]
 30%|██▉       | 111168/371472 [8:50:21<20:35:25,  3.51it/s]
 30%|██▉       | 111169/371472 [8:50:22<22:20:06,  3.24it/s]
 30%|██▉       | 111170/371472 [8:50:22<21:27:34,  3.37it/s]
 30%|██▉       | 111171/371472 [8:50:22<20:41:13,  3.50it/s]
 30%|██▉       | 111172/371472 [8:50:23<20:02:45,  3.61it/s]
 30%|██▉       | 111173/371472 [8:50:23<19:48:06,  3.65it/s]
 30%|██▉       | 111174/371472 [8:50:23<19:13:04,  3.76it/s]
 30%|██▉       | 111175/371472 [8:50:23<20:22:19,  3.55it/s]
 30%|██▉       | 111176/371472 [8:50:24<20:09:51,  3.59it/s]
 30%|██▉       | 111177/371472 [8:50:24<19:13:01,  3.76it/s]
 30%|██▉       | 111178/371472 [8:50:24<20:23:57,  3.54it/s]
 30%|██▉       | 111179/371472 [8:50:25<20:09:00,  3.59it/s]
 30%|██▉       | 111180/371472 [8:50:25<21:06:11,  3.43it/s]
                                                            
{'loss': 3.2527, 'learning_rate': 7.309735180676161e-07, 'epoch': 4.79}

 30%|██▉       | 111180/371472 [8:50:25<21:06:11,  3.43it/s]
 30%|██▉       | 111181/371472 [8:50:25<20:10:17,  3.58it/s]
 30%|██▉       | 111182/371472 [8:50:25<20:02:42,  3.61it/s]
 30%|██▉       | 111183/371472 [8:50:26<19:43:02,  3.67it/s]
 30%|██▉       | 111184/371472 [8:50:26<19:14:07,  3.76it/s]
 30%|██▉       | 111185/371472 [8:50:26<19:04:52,  3.79it/s]
 30%|██▉       | 111186/371472 [8:50:26<19:24:24,  3.73it/s]
 30%|██▉       | 111187/371472 [8:50:27<21:19:19,  3.39it/s]
 30%|██▉       | 111188/371472 [8:50:27<20:32:03,  3.52it/s]
 30%|██▉       | 111189/371472 [8:50:27<20:19:40,  3.56it/s]
 30%|██▉       | 111190/371472 [8:50:28<20:29:53,  3.53it/s]
 30%|██▉       | 111191/371472 [8:50:28<20:17:01,  3.56it/s]
 30%|██▉       | 111192/371472 [8:50:28<20:39:11,  3.50it/s]
 30%|██▉       | 111193/371472 [8:50:28<20:03:19,  3.60it/s]
 30%|██▉       | 111194/371472 [8:50:29<19:39:36,  3.68it/s]
 30%|██▉       | 111195/371472 [8:50:29<19:40:28,  3.67it/s]
 30%|██▉       | 111196/371472 [8:50:29<20:31:45,  3.52it/s]
 30%|██▉       | 111197/371472 [8:50:30<19:39:11,  3.68it/s]
 30%|██▉       | 111198/371472 [8:50:30<20:27:07,  3.54it/s]
 30%|██▉       | 111199/371472 [8:50:30<20:28:46,  3.53it/s]
 30%|██▉       | 111200/371472 [8:50:30<20:10:05,  3.58it/s]
                                                            
{'loss': 3.4921, 'learning_rate': 7.309250360921373e-07, 'epoch': 4.79}

 30%|██▉       | 111200/371472 [8:50:30<20:10:05,  3.58it/s]
 30%|██▉       | 111201/371472 [8:50:31<20:16:32,  3.57it/s]
 30%|██▉       | 111202/371472 [8:50:31<21:57:07,  3.29it/s]
 30%|██▉       | 111203/371472 [8:50:31<21:39:02,  3.34it/s]
 30%|██▉       | 111204/371472 [8:50:32<21:43:53,  3.33it/s]
 30%|██▉       | 111205/371472 [8:50:32<21:34:01,  3.35it/s]
 30%|██▉       | 111206/371472 [8:50:32<21:58:16,  3.29it/s]
 30%|██▉       | 111207/371472 [8:50:33<22:42:32,  3.18it/s]
 30%|██▉       | 111208/371472 [8:50:33<21:22:56,  3.38it/s]
 30%|██▉       | 111209/371472 [8:50:33<20:50:21,  3.47it/s]
 30%|██▉       | 111210/371472 [8:50:33<20:26:33,  3.54it/s]
 30%|██▉       | 111211/371472 [8:50:34<21:02:34,  3.44it/s]
 30%|██▉       | 111212/371472 [8:50:34<20:09:50,  3.59it/s]
 30%|██▉       | 111213/371472 [8:50:34<20:08:06,  3.59it/s]
 30%|██▉       | 111214/371472 [8:50:34<19:34:43,  3.69it/s]
 30%|██▉       | 111215/371472 [8:50:35<19:22:27,  3.73it/s]
 30%|██▉       | 111216/371472 [8:50:35<20:05:11,  3.60it/s]
 30%|██▉       | 111217/371472 [8:50:35<20:20:14,  3.55it/s]
 30%|██▉       | 111218/371472 [8:50:36<21:06:32,  3.42it/s]
 30%|██▉       | 111219/371472 [8:50:36<20:56:22,  3.45it/s]
 30%|██▉       | 111220/371472 [8:50:36<21:37:20,  3.34it/s]
                                                            
{'loss': 3.5235, 'learning_rate': 7.308765541166584e-07, 'epoch': 4.79}

 30%|██▉       | 111220/371472 [8:50:36<21:37:20,  3.34it/s]
 30%|██▉       | 111221/371472 [8:50:37<20:42:06,  3.49it/s]
 30%|██▉       | 111222/371472 [8:50:37<20:47:11,  3.48it/s]
 30%|██▉       | 111223/371472 [8:50:37<20:22:11,  3.55it/s]
 30%|██▉       | 111224/371472 [8:50:37<20:10:56,  3.58it/s]
 30%|██▉       | 111225/371472 [8:50:38<19:56:32,  3.62it/s]
 30%|██▉       | 111226/371472 [8:50:38<20:26:15,  3.54it/s]
 30%|██▉       | 111227/371472 [8:50:38<20:43:58,  3.49it/s]
 30%|██▉       | 111228/371472 [8:50:38<20:28:36,  3.53it/s]
 30%|██▉       | 111229/371472 [8:50:39<20:13:12,  3.58it/s]
 30%|██▉       | 111230/371472 [8:50:39<19:50:52,  3.64it/s]
 30%|██▉       | 111231/371472 [8:50:39<20:10:05,  3.58it/s]
 30%|██▉       | 111232/371472 [8:50:40<22:16:11,  3.25it/s]
 30%|██▉       | 111233/371472 [8:50:40<21:49:57,  3.31it/s]
 30%|██▉       | 111234/371472 [8:50:40<21:16:17,  3.40it/s]
 30%|██▉       | 111235/371472 [8:50:41<21:33:39,  3.35it/s]
 30%|██▉       | 111236/371472 [8:50:41<20:53:09,  3.46it/s]
 30%|██▉       | 111237/371472 [8:50:41<20:19:45,  3.56it/s]
 30%|██▉       | 111238/371472 [8:50:41<20:48:37,  3.47it/s]
 30%|██▉       | 111239/371472 [8:50:42<20:21:33,  3.55it/s]
 30%|██▉       | 111240/371472 [8:50:42<19:34:46,  3.69it/s]
                                                            
{'loss': 3.3067, 'learning_rate': 7.308280721411795e-07, 'epoch': 4.79}

 30%|██▉       | 111240/371472 [8:50:42<19:34:46,  3.69it/s]
 30%|██▉       | 111241/371472 [8:50:42<23:05:16,  3.13it/s]
 30%|██▉       | 111242/371472 [8:50:43<21:55:52,  3.30it/s]
 30%|██▉       | 111243/371472 [8:50:43<21:41:37,  3.33it/s]
 30%|██▉       | 111244/371472 [8:50:43<20:52:35,  3.46it/s]
 30%|██▉       | 111245/371472 [8:50:43<19:48:56,  3.65it/s]
 30%|██▉       | 111246/371472 [8:50:44<19:13:43,  3.76it/s]
 30%|██▉       | 111247/371472 [8:50:44<19:48:10,  3.65it/s]
 30%|██▉       | 111248/371472 [8:50:44<22:25:34,  3.22it/s]
 30%|██▉       | 111249/371472 [8:50:45<21:25:54,  3.37it/s]
 30%|██▉       | 111250/371472 [8:50:45<21:33:05,  3.35it/s]
 30%|██▉       | 111251/371472 [8:50:45<23:38:57,  3.06it/s]
 30%|██▉       | 111252/371472 [8:50:46<24:46:01,  2.92it/s]
 30%|██▉       | 111253/371472 [8:50:46<22:56:19,  3.15it/s]
 30%|██▉       | 111254/371472 [8:50:46<21:24:27,  3.38it/s]
 30%|██▉       | 111255/371472 [8:50:46<20:56:53,  3.45it/s]
 30%|██▉       | 111256/371472 [8:50:47<20:46:43,  3.48it/s]
 30%|██▉       | 111257/371472 [8:50:47<19:46:03,  3.66it/s]
 30%|██▉       | 111258/371472 [8:50:47<19:53:53,  3.63it/s]
 30%|██▉       | 111259/371472 [8:50:48<20:29:28,  3.53it/s]
 30%|██▉       | 111260/371472 [8:50:48<21:05:30,  3.43it/s]
                                                            
{'loss': 3.3875, 'learning_rate': 7.307795901657005e-07, 'epoch': 4.79}

 30%|██▉       | 111260/371472 [8:50:48<21:05:30,  3.43it/s]
 30%|██▉       | 111261/371472 [8:50:48<20:54:06,  3.46it/s]
 30%|██▉       | 111262/371472 [8:50:48<21:55:35,  3.30it/s]
 30%|██▉       | 111263/371472 [8:50:49<21:38:32,  3.34it/s]
 30%|██▉       | 111264/371472 [8:50:49<20:43:02,  3.49it/s]
 30%|██▉       | 111265/371472 [8:50:49<20:00:25,  3.61it/s]
 30%|██▉       | 111266/371472 [8:50:50<19:24:02,  3.73it/s]
 30%|██▉       | 111267/371472 [8:50:50<19:58:25,  3.62it/s]
 30%|██▉       | 111268/371472 [8:50:50<20:11:39,  3.58it/s]
 30%|██▉       | 111269/371472 [8:50:51<23:22:21,  3.09it/s]
 30%|██▉       | 111270/371472 [8:50:51<21:59:15,  3.29it/s]
 30%|██▉       | 111271/371472 [8:50:51<21:14:29,  3.40it/s]
 30%|██▉       | 111272/371472 [8:50:51<20:02:46,  3.61it/s]
 30%|██▉       | 111273/371472 [8:50:52<19:54:20,  3.63it/s]
 30%|██▉       | 111274/371472 [8:50:52<19:29:24,  3.71it/s]
 30%|██▉       | 111275/371472 [8:50:52<19:23:53,  3.73it/s]
 30%|██▉       | 111276/371472 [8:50:52<19:49:35,  3.65it/s]
 30%|██▉       | 111277/371472 [8:50:53<19:30:43,  3.70it/s]
 30%|██▉       | 111278/371472 [8:50:53<20:21:28,  3.55it/s]
 30%|██▉       | 111279/371472 [8:50:53<19:34:44,  3.69it/s]
 30%|██▉       | 111280/371472 [8:50:53<19:14:02,  3.76it/s]
                                                            
{'loss': 3.4976, 'learning_rate': 7.307311081902216e-07, 'epoch': 4.79}

 30%|██▉       | 111280/371472 [8:50:53<19:14:02,  3.76it/s]
 30%|██▉       | 111281/371472 [8:50:54<19:19:34,  3.74it/s]
 30%|██▉       | 111282/371472 [8:50:54<19:26:05,  3.72it/s]
 30%|██▉       | 111283/371472 [8:50:54<18:56:00,  3.82it/s]
 30%|██▉       | 111284/371472 [8:50:55<19:23:42,  3.73it/s]
 30%|██▉       | 111285/371472 [8:50:55<19:36:55,  3.68it/s]
 30%|██▉       | 111286/371472 [8:50:55<19:27:24,  3.71it/s]
 30%|██▉       | 111287/371472 [8:50:55<19:05:56,  3.78it/s]
 30%|██▉       | 111288/371472 [8:50:56<18:57:13,  3.81it/s]
 30%|██▉       | 111289/371472 [8:50:56<20:23:30,  3.54it/s]
 30%|██▉       | 111290/371472 [8:50:56<20:13:00,  3.57it/s]
 30%|██▉       | 111291/371472 [8:50:56<20:29:15,  3.53it/s]
 30%|██▉       | 111292/371472 [8:50:57<19:56:30,  3.62it/s]
 30%|██▉       | 111293/371472 [8:50:57<21:11:10,  3.41it/s]
 30%|██▉       | 111294/371472 [8:50:57<22:49:18,  3.17it/s]
 30%|██▉       | 111295/371472 [8:50:58<21:59:47,  3.29it/s]
 30%|██▉       | 111296/371472 [8:50:58<24:13:51,  2.98it/s]
 30%|██▉       | 111297/371472 [8:50:58<22:56:55,  3.15it/s]
 30%|██▉       | 111298/371472 [8:50:59<21:31:03,  3.36it/s]
 30%|██▉       | 111299/371472 [8:50:59<20:38:29,  3.50it/s]
 30%|██▉       | 111300/371472 [8:50:59<20:16:51,  3.56it/s]
                                                            
{'loss': 3.3921, 'learning_rate': 7.306826262147429e-07, 'epoch': 4.79}

 30%|██▉       | 111300/371472 [8:50:59<20:16:51,  3.56it/s]
 30%|██▉       | 111301/371472 [8:51:00<22:33:37,  3.20it/s]
 30%|██▉       | 111302/371472 [8:51:00<21:29:51,  3.36it/s]
 30%|██▉       | 111303/371472 [8:51:00<22:33:12,  3.20it/s]
 30%|██▉       | 111304/371472 [8:51:01<25:05:04,  2.88it/s]
 30%|██▉       | 111305/371472 [8:51:01<22:53:35,  3.16it/s]
 30%|██▉       | 111306/371472 [8:51:01<21:25:24,  3.37it/s]
 30%|██▉       | 111307/371472 [8:51:01<21:04:14,  3.43it/s]
 30%|██▉       | 111308/371472 [8:51:02<20:11:24,  3.58it/s]
 30%|██▉       | 111309/371472 [8:51:02<21:01:11,  3.44it/s]
 30%|██▉       | 111310/371472 [8:51:02<22:30:08,  3.21it/s]
 30%|██▉       | 111311/371472 [8:51:03<22:45:05,  3.18it/s]
 30%|██▉       | 111312/371472 [8:51:03<21:20:03,  3.39it/s]
 30%|██▉       | 111313/371472 [8:51:03<22:38:07,  3.19it/s]
 30%|██▉       | 111314/371472 [8:51:04<22:35:09,  3.20it/s]
 30%|██▉       | 111315/371472 [8:51:04<22:23:00,  3.23it/s]
 30%|██▉       | 111316/371472 [8:51:04<21:28:34,  3.36it/s]
 30%|██▉       | 111317/371472 [8:51:04<21:14:13,  3.40it/s]
 30%|██▉       | 111318/371472 [8:51:05<20:42:56,  3.49it/s]
 30%|██▉       | 111319/371472 [8:51:05<20:02:12,  3.61it/s]
 30%|██▉       | 111320/371472 [8:51:05<20:05:54,  3.60it/s]
                                                            
{'loss': 3.4683, 'learning_rate': 7.30634144239264e-07, 'epoch': 4.79}

 30%|██▉       | 111320/371472 [8:51:05<20:05:54,  3.60it/s]
 30%|██▉       | 111321/371472 [8:51:05<19:32:56,  3.70it/s]
 30%|██▉       | 111322/371472 [8:51:06<20:10:49,  3.58it/s]
 30%|██▉       | 111323/371472 [8:51:06<19:26:37,  3.72it/s]
 30%|██▉       | 111324/371472 [8:51:06<19:42:06,  3.67it/s]
 30%|██▉       | 111325/371472 [8:51:07<19:55:19,  3.63it/s]
 30%|██▉       | 111326/371472 [8:51:07<19:26:37,  3.72it/s]
 30%|██▉       | 111327/371472 [8:51:07<19:19:35,  3.74it/s]
 30%|██▉       | 111328/371472 [8:51:08<23:05:53,  3.13it/s]
 30%|██▉       | 111329/371472 [8:51:08<23:22:58,  3.09it/s]
 30%|██▉       | 111330/371472 [8:51:08<22:44:59,  3.18it/s]
 30%|██▉       | 111331/371472 [8:51:08<21:48:50,  3.31it/s]
 30%|██▉       | 111332/371472 [8:51:09<21:04:49,  3.43it/s]
 30%|██▉       | 111333/371472 [8:51:09<21:55:41,  3.30it/s]
 30%|██▉       | 111334/371472 [8:51:09<23:05:16,  3.13it/s]
 30%|██▉       | 111335/371472 [8:51:10<22:17:19,  3.24it/s]
 30%|██▉       | 111336/371472 [8:51:10<21:57:27,  3.29it/s]
 30%|██▉       | 111337/371472 [8:51:10<22:01:07,  3.28it/s]
 30%|██▉       | 111338/371472 [8:51:11<21:33:20,  3.35it/s]
 30%|██▉       | 111339/371472 [8:51:11<21:09:29,  3.42it/s]
 30%|██▉       | 111340/371472 [8:51:11<22:40:13,  3.19it/s]
                                                            
{'loss': 3.4451, 'learning_rate': 7.305856622637849e-07, 'epoch': 4.8}

 30%|██▉       | 111340/371472 [8:51:11<22:40:13,  3.19it/s]
 30%|██▉       | 111341/371472 [8:51:11<22:02:47,  3.28it/s]
 30%|██▉       | 111342/371472 [8:51:12<20:30:22,  3.52it/s]
 30%|██▉       | 111343/371472 [8:51:12<20:00:21,  3.61it/s]
 30%|██▉       | 111344/371472 [8:51:12<19:53:16,  3.63it/s]
 30%|██▉       | 111345/371472 [8:51:12<19:25:21,  3.72it/s]
 30%|██▉       | 111346/371472 [8:51:13<19:41:50,  3.67it/s]
 30%|██▉       | 111347/371472 [8:51:13<19:36:31,  3.68it/s]
 30%|██▉       | 111348/371472 [8:51:13<21:47:33,  3.32it/s]
 30%|██▉       | 111349/371472 [8:51:14<21:46:38,  3.32it/s]
 30%|██▉       | 111350/371472 [8:51:14<21:34:44,  3.35it/s]
 30%|██▉       | 111351/371472 [8:51:14<20:49:50,  3.47it/s]
 30%|██▉       | 111352/371472 [8:51:15<21:19:35,  3.39it/s]
 30%|██▉       | 111353/371472 [8:51:15<20:22:28,  3.55it/s]
 30%|██▉       | 111354/371472 [8:51:15<19:35:44,  3.69it/s]
 30%|██▉       | 111355/371472 [8:51:15<19:26:11,  3.72it/s]
 30%|██▉       | 111356/371472 [8:51:16<19:41:49,  3.67it/s]
 30%|██▉       | 111357/371472 [8:51:16<19:33:52,  3.69it/s]
 30%|██▉       | 111358/371472 [8:51:16<19:17:54,  3.74it/s]
 30%|██▉       | 111359/371472 [8:51:16<19:53:26,  3.63it/s]
 30%|██▉       | 111360/371472 [8:51:17<20:56:30,  3.45it/s]
                                                            
{'loss': 3.5001, 'learning_rate': 7.305371802883061e-07, 'epoch': 4.8}

 30%|██▉       | 111360/371472 [8:51:17<20:56:30,  3.45it/s]
 30%|██▉       | 111361/371472 [8:51:17<20:35:38,  3.51it/s]
 30%|██▉       | 111362/371472 [8:51:17<20:33:22,  3.51it/s]
 30%|██▉       | 111363/371472 [8:51:18<21:27:34,  3.37it/s]
 30%|██▉       | 111364/371472 [8:51:18<20:52:33,  3.46it/s]
 30%|██▉       | 111365/371472 [8:51:18<21:59:28,  3.29it/s]
 30%|██▉       | 111366/371472 [8:51:19<20:46:40,  3.48it/s]
 30%|██▉       | 111367/371472 [8:51:19<20:21:14,  3.55it/s]
 30%|██▉       | 111368/371472 [8:51:19<20:17:48,  3.56it/s]
 30%|██▉       | 111369/371472 [8:51:19<20:15:51,  3.57it/s]
 30%|██▉       | 111370/371472 [8:51:20<27:58:09,  2.58it/s]
 30%|██▉       | 111371/371472 [8:51:20<25:34:58,  2.82it/s]
 30%|██▉       | 111372/371472 [8:51:21<25:05:24,  2.88it/s]
 30%|██▉       | 111373/371472 [8:51:21<23:40:11,  3.05it/s]
 30%|██▉       | 111374/371472 [8:51:21<22:57:47,  3.15it/s]
 30%|██▉       | 111375/371472 [8:51:21<21:44:41,  3.32it/s]
 30%|██▉       | 111376/371472 [8:51:22<20:48:41,  3.47it/s]
 30%|██▉       | 111377/371472 [8:51:22<21:25:32,  3.37it/s]
 30%|██▉       | 111378/371472 [8:51:22<21:31:41,  3.36it/s]
 30%|██▉       | 111379/371472 [8:51:23<20:44:20,  3.48it/s]
 30%|██▉       | 111380/371472 [8:51:23<20:45:30,  3.48it/s]
                                                            
{'loss': 3.4202, 'learning_rate': 7.304886983128274e-07, 'epoch': 4.8}

 30%|██▉       | 111380/371472 [8:51:23<20:45:30,  3.48it/s]
 30%|██▉       | 111381/371472 [8:51:23<20:14:03,  3.57it/s]
 30%|██▉       | 111382/371472 [8:51:23<20:10:04,  3.58it/s]
 30%|██▉       | 111383/371472 [8:51:24<21:00:08,  3.44it/s]
 30%|██▉       | 111384/371472 [8:51:24<22:12:11,  3.25it/s]
 30%|██▉       | 111385/371472 [8:51:24<21:59:35,  3.28it/s]
 30%|██▉       | 111386/371472 [8:51:25<21:32:58,  3.35it/s]
 30%|██▉       | 111387/371472 [8:51:25<21:04:42,  3.43it/s]
 30%|██▉       | 111388/371472 [8:51:25<22:20:00,  3.23it/s]
 30%|██▉       | 111389/371472 [8:51:26<21:14:21,  3.40it/s]
 30%|██▉       | 111390/371472 [8:51:26<20:30:22,  3.52it/s]
 30%|██▉       | 111391/371472 [8:51:26<20:17:51,  3.56it/s]
 30%|██▉       | 111392/371472 [8:51:26<19:40:44,  3.67it/s]
 30%|██▉       | 111393/371472 [8:51:27<20:14:42,  3.57it/s]
 30%|██▉       | 111394/371472 [8:51:27<20:54:16,  3.46it/s]
 30%|██▉       | 111395/371472 [8:51:27<19:58:15,  3.62it/s]
 30%|██▉       | 111396/371472 [8:51:27<19:48:38,  3.65it/s]
 30%|██▉       | 111397/371472 [8:51:28<19:29:25,  3.71it/s]
 30%|██▉       | 111398/371472 [8:51:28<19:31:05,  3.70it/s]
 30%|██▉       | 111399/371472 [8:51:28<19:50:06,  3.64it/s]
 30%|██▉       | 111400/371472 [8:51:29<19:44:54,  3.66it/s]
                                                            
{'loss': 3.4148, 'learning_rate': 7.304402163373484e-07, 'epoch': 4.8}

 30%|██▉       | 111400/371472 [8:51:29<19:44:54,  3.66it/s]
 30%|██▉       | 111401/371472 [8:51:29<19:51:41,  3.64it/s]
 30%|██▉       | 111402/371472 [8:51:29<19:42:53,  3.66it/s]
 30%|██▉       | 111403/371472 [8:51:29<20:47:30,  3.47it/s]
 30%|██▉       | 111404/371472 [8:51:30<22:05:43,  3.27it/s]
 30%|██▉       | 111405/371472 [8:51:30<21:20:36,  3.38it/s]
 30%|██▉       | 111406/371472 [8:51:30<21:27:48,  3.37it/s]
 30%|██▉       | 111407/371472 [8:51:31<20:47:45,  3.47it/s]
 30%|██▉       | 111408/371472 [8:51:31<20:20:34,  3.55it/s]
 30%|██▉       | 111409/371472 [8:51:31<20:27:03,  3.53it/s]
 30%|██▉       | 111410/371472 [8:51:31<22:29:38,  3.21it/s]
 30%|██▉       | 111411/371472 [8:51:32<22:06:22,  3.27it/s]
 30%|██▉       | 111412/371472 [8:51:32<22:18:20,  3.24it/s]
 30%|██▉       | 111413/371472 [8:51:32<22:05:04,  3.27it/s]
 30%|██▉       | 111414/371472 [8:51:33<21:21:25,  3.38it/s]
 30%|██▉       | 111415/371472 [8:51:33<21:03:49,  3.43it/s]
 30%|██▉       | 111416/371472 [8:51:33<19:53:34,  3.63it/s]
 30%|██▉       | 111417/371472 [8:51:34<21:14:55,  3.40it/s]
 30%|██▉       | 111418/371472 [8:51:34<21:19:56,  3.39it/s]
 30%|██▉       | 111419/371472 [8:51:34<20:30:47,  3.52it/s]
 30%|██▉       | 111420/371472 [8:51:34<21:30:06,  3.36it/s]
                                                            
{'loss': 3.3397, 'learning_rate': 7.303917343618694e-07, 'epoch': 4.8}

 30%|██▉       | 111420/371472 [8:51:34<21:30:06,  3.36it/s]
 30%|██▉       | 111421/371472 [8:51:35<21:35:13,  3.35it/s]
 30%|██▉       | 111422/371472 [8:51:35<20:43:45,  3.48it/s]
 30%|██▉       | 111423/371472 [8:51:35<20:29:09,  3.53it/s]
 30%|██▉       | 111424/371472 [8:51:36<20:02:33,  3.60it/s]
 30%|██▉       | 111425/371472 [8:51:36<20:12:36,  3.57it/s]
 30%|██▉       | 111426/371472 [8:51:36<20:12:46,  3.57it/s]
 30%|██▉       | 111427/371472 [8:51:36<19:32:56,  3.70it/s]
 30%|██▉       | 111428/371472 [8:51:37<19:44:12,  3.66it/s]
 30%|██▉       | 111429/371472 [8:51:37<19:53:15,  3.63it/s]
 30%|██▉       | 111430/371472 [8:51:37<19:02:12,  3.79it/s]
 30%|██▉       | 111431/371472 [8:51:37<20:18:23,  3.56it/s]
 30%|██▉       | 111432/371472 [8:51:38<19:57:29,  3.62it/s]
 30%|██▉       | 111433/371472 [8:51:38<19:07:24,  3.78it/s]
 30%|██▉       | 111434/371472 [8:51:38<20:01:55,  3.61it/s]
 30%|██▉       | 111435/371472 [8:51:39<20:11:55,  3.58it/s]
 30%|██▉       | 111436/371472 [8:51:39<19:09:41,  3.77it/s]
 30%|██▉       | 111437/371472 [8:51:39<19:16:55,  3.75it/s]
 30%|██▉       | 111438/371472 [8:51:39<19:17:01,  3.75it/s]
 30%|██▉       | 111439/371472 [8:51:40<20:52:00,  3.46it/s]
 30%|██▉       | 111440/371472 [8:51:40<20:21:37,  3.55it/s]
                                                            
{'loss': 3.4448, 'learning_rate': 7.303432523863906e-07, 'epoch': 4.8}

 30%|██▉       | 111440/371472 [8:51:40<20:21:37,  3.55it/s]
 30%|██▉       | 111441/371472 [8:51:40<21:22:00,  3.38it/s]
 30%|███       | 111442/371472 [8:51:41<20:38:20,  3.50it/s]
 30%|███       | 111443/371472 [8:51:41<20:17:59,  3.56it/s]
 30%|███       | 111444/371472 [8:51:41<19:57:11,  3.62it/s]
 30%|███       | 111445/371472 [8:51:41<19:48:47,  3.65it/s]
 30%|███       | 111446/371472 [8:51:42<19:25:21,  3.72it/s]
 30%|███       | 111447/371472 [8:51:42<19:25:22,  3.72it/s]
 30%|███       | 111448/371472 [8:51:42<19:07:28,  3.78it/s]
 30%|███       | 111449/371472 [8:51:42<18:45:08,  3.85it/s]
 30%|███       | 111450/371472 [8:51:43<19:17:18,  3.74it/s]
 30%|███       | 111451/371472 [8:51:43<19:56:18,  3.62it/s]
 30%|███       | 111452/371472 [8:51:43<19:44:53,  3.66it/s]
 30%|███       | 111453/371472 [8:51:44<21:04:44,  3.43it/s]
 30%|███       | 111454/371472 [8:51:44<21:35:09,  3.35it/s]
 30%|███       | 111455/371472 [8:51:44<22:31:46,  3.21it/s]
 30%|███       | 111456/371472 [8:51:44<21:59:43,  3.28it/s]
 30%|███       | 111457/371472 [8:51:45<21:55:53,  3.29it/s]
 30%|███       | 111458/371472 [8:51:45<23:19:52,  3.10it/s]
 30%|███       | 111459/371472 [8:51:45<22:56:36,  3.15it/s]
 30%|███       | 111460/371472 [8:51:46<23:18:48,  3.10it/s]
                                                            
{'loss': 3.3335, 'learning_rate': 7.302947704109117e-07, 'epoch': 4.8}

 30%|███       | 111460/371472 [8:51:46<23:18:48,  3.10it/s]
 30%|███       | 111461/371472 [8:51:46<23:38:02,  3.06it/s]
 30%|███       | 111462/371472 [8:51:46<22:44:33,  3.18it/s]
 30%|███       | 111463/371472 [8:51:47<23:09:06,  3.12it/s]
 30%|███       | 111464/371472 [8:51:47<22:18:43,  3.24it/s]
 30%|███       | 111465/371472 [8:51:47<21:28:42,  3.36it/s]
 30%|███       | 111466/371472 [8:51:48<21:05:00,  3.43it/s]
 30%|███       | 111467/371472 [8:51:48<20:39:25,  3.50it/s]
 30%|███       | 111468/371472 [8:51:48<20:34:01,  3.51it/s]
 30%|███       | 111469/371472 [8:51:48<20:38:54,  3.50it/s]
 30%|███       | 111470/371472 [8:51:49<20:32:21,  3.52it/s]
 30%|███       | 111471/371472 [8:51:49<20:01:20,  3.61it/s]
 30%|███       | 111472/371472 [8:51:49<20:12:15,  3.57it/s]
 30%|███       | 111473/371472 [8:51:49<19:37:08,  3.68it/s]
 30%|███       | 111474/371472 [8:51:50<19:53:35,  3.63it/s]
 30%|███       | 111475/371472 [8:51:50<19:41:20,  3.67it/s]
 30%|███       | 111476/371472 [8:51:50<19:49:24,  3.64it/s]
 30%|███       | 111477/371472 [8:51:51<19:41:20,  3.67it/s]
 30%|███       | 111478/371472 [8:51:51<19:24:44,  3.72it/s]
 30%|███       | 111479/371472 [8:51:51<19:01:37,  3.80it/s]
 30%|███       | 111480/371472 [8:51:51<19:08:37,  3.77it/s]
                                                            
{'loss': 3.4823, 'learning_rate': 7.302462884354326e-07, 'epoch': 4.8}

 30%|███       | 111480/371472 [8:51:51<19:08:37,  3.77it/s]
 30%|███       | 111481/371472 [8:51:52<19:12:31,  3.76it/s]
 30%|███       | 111482/371472 [8:51:52<20:46:17,  3.48it/s]
 30%|███       | 111483/371472 [8:51:52<20:24:21,  3.54it/s]
 30%|███       | 111484/371472 [8:51:53<20:55:48,  3.45it/s]
 30%|███       | 111485/371472 [8:51:53<20:49:55,  3.47it/s]
 30%|███       | 111486/371472 [8:51:53<20:33:46,  3.51it/s]
 30%|███       | 111487/371472 [8:51:53<19:38:26,  3.68it/s]
 30%|███       | 111488/371472 [8:51:54<18:40:07,  3.87it/s]
 30%|███       | 111489/371472 [8:51:54<19:06:49,  3.78it/s]
 30%|███       | 111490/371472 [8:51:54<19:38:24,  3.68it/s]
 30%|███       | 111491/371472 [8:51:54<20:09:31,  3.58it/s]
 30%|███       | 111492/371472 [8:51:55<21:25:06,  3.37it/s]
 30%|███       | 111493/371472 [8:51:55<21:17:46,  3.39it/s]
 30%|███       | 111494/371472 [8:51:55<21:01:58,  3.43it/s]
 30%|███       | 111495/371472 [8:51:56<21:02:51,  3.43it/s]
 30%|███       | 111496/371472 [8:51:56<20:20:55,  3.55it/s]
 30%|███       | 111497/371472 [8:51:56<21:33:31,  3.35it/s]
 30%|███       | 111498/371472 [8:51:57<20:49:18,  3.47it/s]
 30%|███       | 111499/371472 [8:51:57<21:52:48,  3.30it/s]
 30%|███       | 111500/371472 [8:51:57<21:57:19,  3.29it/s]
                                                            
{'loss': 3.3321, 'learning_rate': 7.301978064599538e-07, 'epoch': 4.8}

 30%|███       | 111500/371472 [8:51:57<21:57:19,  3.29it/s]
 30%|███       | 111501/371472 [8:51:57<22:26:09,  3.22it/s]
 30%|███       | 111502/371472 [8:51:58<20:55:31,  3.45it/s]
 30%|███       | 111503/371472 [8:51:58<20:07:17,  3.59it/s]
 30%|███       | 111504/371472 [8:51:58<20:09:05,  3.58it/s]
 30%|███       | 111505/371472 [8:51:59<21:06:23,  3.42it/s]
 30%|███       | 111506/371472 [8:51:59<20:57:26,  3.45it/s]
 30%|███       | 111507/371472 [8:51:59<20:56:08,  3.45it/s]
 30%|███       | 111508/371472 [8:51:59<20:34:46,  3.51it/s]
 30%|███       | 111509/371472 [8:52:00<19:51:15,  3.64it/s]
 30%|███       | 111510/371472 [8:52:00<19:00:45,  3.80it/s]
 30%|███       | 111511/371472 [8:52:00<19:40:18,  3.67it/s]
 30%|███       | 111512/371472 [8:52:00<19:34:48,  3.69it/s]
 30%|███       | 111513/371472 [8:52:01<19:22:33,  3.73it/s]
 30%|███       | 111514/371472 [8:52:01<19:03:10,  3.79it/s]
 30%|███       | 111515/371472 [8:52:01<19:10:24,  3.77it/s]
 30%|███       | 111516/371472 [8:52:02<18:56:04,  3.81it/s]
 30%|███       | 111517/371472 [8:52:02<19:23:27,  3.72it/s]
 30%|███       | 111518/371472 [8:52:02<19:46:03,  3.65it/s]
 30%|███       | 111519/371472 [8:52:02<20:12:05,  3.57it/s]
 30%|███       | 111520/371472 [8:52:03<19:34:09,  3.69it/s]
                                                            
{'loss': 3.4012, 'learning_rate': 7.30149324484475e-07, 'epoch': 4.8}

 30%|███       | 111520/371472 [8:52:03<19:34:09,  3.69it/s]
 30%|███       | 111521/371472 [8:52:03<20:59:06,  3.44it/s]
 30%|███       | 111522/371472 [8:52:03<20:13:23,  3.57it/s]
 30%|███       | 111523/371472 [8:52:04<20:21:04,  3.55it/s]
 30%|███       | 111524/371472 [8:52:04<21:27:49,  3.36it/s]
 30%|███       | 111525/371472 [8:52:04<21:19:05,  3.39it/s]
 30%|███       | 111526/371472 [8:52:04<20:20:42,  3.55it/s]
 30%|███       | 111527/371472 [8:52:05<20:21:39,  3.55it/s]
 30%|███       | 111528/371472 [8:52:05<19:59:57,  3.61it/s]
 30%|███       | 111529/371472 [8:52:05<20:30:51,  3.52it/s]
 30%|███       | 111530/371472 [8:52:05<20:09:23,  3.58it/s]
 30%|███       | 111531/371472 [8:52:06<19:46:46,  3.65it/s]
 30%|███       | 111532/371472 [8:52:06<19:27:02,  3.71it/s]
 30%|███       | 111533/371472 [8:52:06<20:00:27,  3.61it/s]
 30%|███       | 111534/371472 [8:52:07<19:26:10,  3.71it/s]
 30%|███       | 111535/371472 [8:52:07<19:02:00,  3.79it/s]
 30%|███       | 111536/371472 [8:52:07<19:13:30,  3.76it/s]
 30%|███       | 111537/371472 [8:52:07<20:14:52,  3.57it/s]
 30%|███       | 111538/371472 [8:52:08<20:11:49,  3.57it/s]
 30%|███       | 111539/371472 [8:52:08<19:44:58,  3.66it/s]
 30%|███       | 111540/371472 [8:52:08<20:17:44,  3.56it/s]
                                                            
{'loss': 3.4922, 'learning_rate': 7.301008425089961e-07, 'epoch': 4.8}

 30%|███       | 111540/371472 [8:52:08<20:17:44,  3.56it/s]
 30%|███       | 111541/371472 [8:52:09<20:43:50,  3.48it/s]
 30%|███       | 111542/371472 [8:52:09<19:34:32,  3.69it/s]
 30%|███       | 111543/371472 [8:52:09<20:23:56,  3.54it/s]
 30%|███       | 111544/371472 [8:52:09<20:04:21,  3.60it/s]
 30%|███       | 111545/371472 [8:52:10<19:49:57,  3.64it/s]
 30%|███       | 111546/371472 [8:52:10<20:24:51,  3.54it/s]
 30%|███       | 111547/371472 [8:52:10<21:08:46,  3.41it/s]
 30%|███       | 111548/371472 [8:52:11<20:39:08,  3.50it/s]
 30%|███       | 111549/371472 [8:52:11<22:48:49,  3.16it/s]
 30%|███       | 111550/371472 [8:52:11<21:57:53,  3.29it/s]
 30%|███       | 111551/371472 [8:52:11<20:59:59,  3.44it/s]
 30%|███       | 111552/371472 [8:52:12<20:42:46,  3.49it/s]
 30%|███       | 111553/371472 [8:52:12<20:47:31,  3.47it/s]
 30%|███       | 111554/371472 [8:52:12<20:41:21,  3.49it/s]
 30%|███       | 111555/371472 [8:52:13<19:44:45,  3.66it/s]
 30%|███       | 111556/371472 [8:52:13<19:13:37,  3.76it/s]
 30%|███       | 111557/371472 [8:52:13<19:24:22,  3.72it/s]
 30%|███       | 111558/371472 [8:52:13<20:33:00,  3.51it/s]
 30%|███       | 111559/371472 [8:52:14<20:48:12,  3.47it/s]
 30%|███       | 111560/371472 [8:52:14<21:04:00,  3.43it/s]
                                                            
{'loss': 3.2925, 'learning_rate': 7.300523605335171e-07, 'epoch': 4.81}

 30%|███       | 111560/371472 [8:52:14<21:04:00,  3.43it/s]
 30%|███       | 111561/371472 [8:52:14<20:06:01,  3.59it/s]
 30%|███       | 111562/371472 [8:52:14<19:58:25,  3.61it/s]
 30%|███       | 111563/371472 [8:52:15<21:19:19,  3.39it/s]
 30%|███       | 111564/371472 [8:52:15<20:58:39,  3.44it/s]
 30%|███       | 111565/371472 [8:52:15<20:15:13,  3.56it/s]
 30%|███       | 111566/371472 [8:52:16<20:07:33,  3.59it/s]
 30%|███       | 111567/371472 [8:52:16<19:54:18,  3.63it/s]
 30%|███       | 111568/371472 [8:52:16<20:23:37,  3.54it/s]
 30%|███       | 111569/371472 [8:52:16<19:53:04,  3.63it/s]
 30%|███       | 111570/371472 [8:52:17<19:32:17,  3.70it/s]
 30%|███       | 111571/371472 [8:52:17<19:52:37,  3.63it/s]
 30%|███       | 111572/371472 [8:52:17<19:44:48,  3.66it/s]
 30%|███       | 111573/371472 [8:52:18<21:33:14,  3.35it/s]
 30%|███       | 111574/371472 [8:52:18<22:10:00,  3.26it/s]
 30%|███       | 111575/371472 [8:52:18<21:54:07,  3.30it/s]
 30%|███       | 111576/371472 [8:52:19<21:15:01,  3.40it/s]
 30%|███       | 111577/371472 [8:52:19<20:38:08,  3.50it/s]
 30%|███       | 111578/371472 [8:52:19<20:09:15,  3.58it/s]
 30%|███       | 111579/371472 [8:52:19<21:28:45,  3.36it/s]
 30%|███       | 111580/371472 [8:52:20<21:43:10,  3.32it/s]
                                                            
{'loss': 3.3143, 'learning_rate': 7.300038785580383e-07, 'epoch': 4.81}

 30%|███       | 111580/371472 [8:52:20<21:43:10,  3.32it/s]
 30%|███       | 111581/371472 [8:52:20<20:43:14,  3.48it/s]
 30%|███       | 111582/371472 [8:52:20<21:28:54,  3.36it/s]
 30%|███       | 111583/371472 [8:52:21<20:43:45,  3.48it/s]
 30%|███       | 111584/371472 [8:52:21<20:37:25,  3.50it/s]
 30%|███       | 111585/371472 [8:52:21<20:17:37,  3.56it/s]
 30%|███       | 111586/371472 [8:52:21<21:14:02,  3.40it/s]
 30%|███       | 111587/371472 [8:52:22<20:56:21,  3.45it/s]
 30%|███       | 111588/371472 [8:52:22<20:35:50,  3.50it/s]
 30%|███       | 111589/371472 [8:52:22<20:42:44,  3.49it/s]
 30%|███       | 111590/371472 [8:52:23<19:54:23,  3.63it/s]
 30%|███       | 111591/371472 [8:52:23<21:36:41,  3.34it/s]
 30%|███       | 111592/371472 [8:52:23<20:44:47,  3.48it/s]
 30%|███       | 111593/371472 [8:52:23<21:00:10,  3.44it/s]
 30%|███       | 111594/371472 [8:52:24<21:12:16,  3.40it/s]
 30%|███       | 111595/371472 [8:52:24<21:48:41,  3.31it/s]
 30%|███       | 111596/371472 [8:52:24<20:54:53,  3.45it/s]
 30%|███       | 111597/371472 [8:52:25<20:04:03,  3.60it/s]
 30%|███       | 111598/371472 [8:52:25<20:45:33,  3.48it/s]
 30%|███       | 111599/371472 [8:52:25<20:19:59,  3.55it/s]
 30%|███       | 111600/371472 [8:52:25<19:19:21,  3.74it/s]
                                                            
{'loss': 3.3931, 'learning_rate': 7.299553965825594e-07, 'epoch': 4.81}

 30%|███       | 111600/371472 [8:52:25<19:19:21,  3.74it/s]
 30%|███       | 111601/371472 [8:52:26<21:19:22,  3.39it/s]
 30%|███       | 111602/371472 [8:52:26<22:41:15,  3.18it/s]
 30%|███       | 111603/371472 [8:52:26<21:42:11,  3.33it/s]
 30%|███       | 111604/371472 [8:52:27<22:18:23,  3.24it/s]
 30%|███       | 111605/371472 [8:52:27<21:12:55,  3.40it/s]
 30%|███       | 111606/371472 [8:52:27<20:41:01,  3.49it/s]
 30%|███       | 111607/371472 [8:52:27<20:27:56,  3.53it/s]
 30%|███       | 111608/371472 [8:52:28<23:31:37,  3.07it/s]
 30%|███       | 111609/371472 [8:52:28<23:10:29,  3.11it/s]
 30%|███       | 111610/371472 [8:52:29<23:09:34,  3.12it/s]
 30%|███       | 111611/371472 [8:52:29<27:55:55,  2.58it/s]
 30%|███       | 111612/371472 [8:52:29<25:13:59,  2.86it/s]
 30%|███       | 111613/371472 [8:52:30<23:50:20,  3.03it/s]
 30%|███       | 111614/371472 [8:52:30<22:19:05,  3.23it/s]
 30%|███       | 111615/371472 [8:52:30<21:13:26,  3.40it/s]
 30%|███       | 111616/371472 [8:52:30<21:23:17,  3.37it/s]
 30%|███       | 111617/371472 [8:52:31<20:58:05,  3.44it/s]
 30%|███       | 111618/371472 [8:52:31<20:30:25,  3.52it/s]
 30%|███       | 111619/371472 [8:52:31<19:55:23,  3.62it/s]
 30%|███       | 111620/371472 [8:52:32<20:29:19,  3.52it/s]
                                                            
{'loss': 3.3061, 'learning_rate': 7.299069146070805e-07, 'epoch': 4.81}

 30%|███       | 111620/371472 [8:52:32<20:29:19,  3.52it/s]
 30%|███       | 111621/371472 [8:52:32<20:39:03,  3.50it/s]
 30%|███       | 111622/371472 [8:52:32<20:26:16,  3.53it/s]
 30%|███       | 111623/371472 [8:52:32<19:59:19,  3.61it/s]
 30%|███       | 111624/371472 [8:52:33<20:28:39,  3.52it/s]
 30%|███       | 111625/371472 [8:52:33<20:07:54,  3.59it/s]
 30%|███       | 111626/371472 [8:52:33<21:56:54,  3.29it/s]
 30%|███       | 111627/371472 [8:52:34<21:15:16,  3.40it/s]
 30%|███       | 111628/371472 [8:52:34<20:32:23,  3.51it/s]
 30%|███       | 111629/371472 [8:52:34<20:29:30,  3.52it/s]
 30%|███       | 111630/371472 [8:52:34<20:31:47,  3.52it/s]
 30%|███       | 111631/371472 [8:52:35<19:47:56,  3.65it/s]
 30%|███       | 111632/371472 [8:52:35<20:37:52,  3.50it/s]
 30%|███       | 111633/371472 [8:52:35<20:06:45,  3.59it/s]
 30%|███       | 111634/371472 [8:52:36<19:41:13,  3.67it/s]
 30%|███       | 111635/371472 [8:52:36<20:18:34,  3.55it/s]
 30%|███       | 111636/371472 [8:52:36<19:44:18,  3.66it/s]
 30%|███       | 111637/371472 [8:52:36<20:03:20,  3.60it/s]
 30%|███       | 111638/371472 [8:52:37<19:58:57,  3.61it/s]
 30%|███       | 111639/371472 [8:52:37<21:17:36,  3.39it/s]
 30%|███       | 111640/371472 [8:52:37<20:59:31,  3.44it/s]
                                                            
{'loss': 3.2464, 'learning_rate': 7.298584326316015e-07, 'epoch': 4.81}

 30%|███       | 111640/371472 [8:52:37<20:59:31,  3.44it/s]
 30%|███       | 111641/371472 [8:52:37<20:00:04,  3.61it/s]
 30%|███       | 111642/371472 [8:52:38<19:22:07,  3.73it/s]
 30%|███       | 111643/371472 [8:52:38<19:41:40,  3.66it/s]
 30%|███       | 111644/371472 [8:52:38<19:48:42,  3.64it/s]
 30%|███       | 111645/371472 [8:52:39<19:35:17,  3.68it/s]
 30%|███       | 111646/371472 [8:52:39<19:53:07,  3.63it/s]
 30%|███       | 111647/371472 [8:52:39<19:47:32,  3.65it/s]
 30%|███       | 111648/371472 [8:52:39<20:39:28,  3.49it/s]
 30%|███       | 111649/371472 [8:52:40<21:24:58,  3.37it/s]
 30%|███       | 111650/371472 [8:52:40<21:09:27,  3.41it/s]
 30%|███       | 111651/371472 [8:52:40<21:04:25,  3.42it/s]
 30%|███       | 111652/371472 [8:52:41<20:54:07,  3.45it/s]
 30%|███       | 111653/371472 [8:52:41<20:40:46,  3.49it/s]
 30%|███       | 111654/371472 [8:52:41<20:12:27,  3.57it/s]
 30%|███       | 111655/371472 [8:52:41<20:17:11,  3.56it/s]
 30%|███       | 111656/371472 [8:52:42<20:28:03,  3.53it/s]
 30%|███       | 111657/371472 [8:52:42<20:43:58,  3.48it/s]
 30%|███       | 111658/371472 [8:52:42<21:57:51,  3.29it/s]
 30%|███       | 111659/371472 [8:52:43<21:25:45,  3.37it/s]
 30%|███       | 111660/371472 [8:52:43<21:53:57,  3.30it/s]
                                                            
{'loss': 3.4188, 'learning_rate': 7.298099506561227e-07, 'epoch': 4.81}

 30%|███       | 111660/371472 [8:52:43<21:53:57,  3.30it/s]
 30%|███       | 111661/371472 [8:52:43<21:01:38,  3.43it/s]
 30%|███       | 111662/371472 [8:52:43<19:58:23,  3.61it/s]
 30%|███       | 111663/371472 [8:52:44<19:44:38,  3.66it/s]
 30%|███       | 111664/371472 [8:52:44<19:25:36,  3.71it/s]
 30%|███       | 111665/371472 [8:52:44<19:54:53,  3.62it/s]
 30%|███       | 111666/371472 [8:52:45<21:09:27,  3.41it/s]
 30%|███       | 111667/371472 [8:52:45<20:10:07,  3.58it/s]
 30%|███       | 111668/371472 [8:52:45<19:21:40,  3.73it/s]
 30%|███       | 111669/371472 [8:52:45<19:14:00,  3.75it/s]
 30%|███       | 111670/371472 [8:52:46<19:32:51,  3.69it/s]
 30%|███       | 111671/371472 [8:52:46<19:29:09,  3.70it/s]
 30%|███       | 111672/371472 [8:52:46<18:58:24,  3.80it/s]
 30%|███       | 111673/371472 [8:52:46<19:52:36,  3.63it/s]
 30%|███       | 111674/371472 [8:52:47<20:04:04,  3.60it/s]
 30%|███       | 111675/371472 [8:52:47<19:51:09,  3.64it/s]
 30%|███       | 111676/371472 [8:52:47<19:14:26,  3.75it/s]
 30%|███       | 111677/371472 [8:52:48<19:54:24,  3.63it/s]
 30%|███       | 111678/371472 [8:52:48<19:51:39,  3.63it/s]
 30%|███       | 111679/371472 [8:52:48<23:27:22,  3.08it/s]
 30%|███       | 111680/371472 [8:52:49<23:29:44,  3.07it/s]
                                                            
{'loss': 3.2762, 'learning_rate': 7.297614686806439e-07, 'epoch': 4.81}

 30%|███       | 111680/371472 [8:52:49<23:29:44,  3.07it/s]
 30%|███       | 111681/371472 [8:52:49<23:14:09,  3.11it/s]
 30%|███       | 111682/371472 [8:52:49<23:57:54,  3.01it/s]
 30%|███       | 111683/371472 [8:52:50<23:14:13,  3.11it/s]
 30%|███       | 111684/371472 [8:52:50<21:45:16,  3.32it/s]
 30%|███       | 111685/371472 [8:52:50<21:12:21,  3.40it/s]
 30%|███       | 111686/371472 [8:52:50<20:01:38,  3.60it/s]
 30%|███       | 111687/371472 [8:52:51<19:58:30,  3.61it/s]
 30%|███       | 111688/371472 [8:52:51<19:32:37,  3.69it/s]
 30%|███       | 111689/371472 [8:52:51<19:27:43,  3.71it/s]
 30%|███       | 111690/371472 [8:52:51<19:29:12,  3.70it/s]
 30%|███       | 111691/371472 [8:52:52<19:51:56,  3.63it/s]
 30%|███       | 111692/371472 [8:52:52<20:26:12,  3.53it/s]
 30%|███       | 111693/371472 [8:52:52<19:58:57,  3.61it/s]
 30%|███       | 111694/371472 [8:52:53<21:25:04,  3.37it/s]
 30%|███       | 111695/371472 [8:52:53<20:29:39,  3.52it/s]
 30%|███       | 111696/371472 [8:52:53<21:25:53,  3.37it/s]
 30%|███       | 111697/371472 [8:52:53<20:57:57,  3.44it/s]
 30%|███       | 111698/371472 [8:52:54<20:40:04,  3.49it/s]
 30%|███       | 111699/371472 [8:52:54<20:37:13,  3.50it/s]
 30%|███       | 111700/371472 [8:52:54<20:37:14,  3.50it/s]
                                                            
{'loss': 3.4127, 'learning_rate': 7.29712986705165e-07, 'epoch': 4.81}

 30%|███       | 111700/371472 [8:52:54<20:37:14,  3.50it/s]
 30%|███       | 111701/371472 [8:52:55<22:25:53,  3.22it/s]
 30%|███       | 111702/371472 [8:52:55<22:35:50,  3.19it/s]
 30%|███       | 111703/371472 [8:52:55<21:44:27,  3.32it/s]
 30%|███       | 111704/371472 [8:52:56<21:08:49,  3.41it/s]
 30%|███       | 111705/371472 [8:52:56<22:54:58,  3.15it/s]
 30%|███       | 111706/371472 [8:52:56<26:49:44,  2.69it/s]
 30%|███       | 111707/371472 [8:52:57<24:14:08,  2.98it/s]
 30%|███       | 111708/371472 [8:52:57<23:33:55,  3.06it/s]
 30%|███       | 111709/371472 [8:52:57<22:25:08,  3.22it/s]
 30%|███       | 111710/371472 [8:52:58<21:39:44,  3.33it/s]
 30%|███       | 111711/371472 [8:52:58<22:26:03,  3.22it/s]
 30%|███       | 111712/371472 [8:52:58<21:34:42,  3.34it/s]
 30%|███       | 111713/371472 [8:52:58<21:38:50,  3.33it/s]
 30%|███       | 111714/371472 [8:52:59<21:40:08,  3.33it/s]
 30%|███       | 111715/371472 [8:52:59<20:58:27,  3.44it/s]
 30%|███       | 111716/371472 [8:52:59<21:28:01,  3.36it/s]
 30%|███       | 111717/371472 [8:53:00<21:24:05,  3.37it/s]
 30%|███       | 111718/371472 [8:53:00<20:55:01,  3.45it/s]
 30%|███       | 111719/371472 [8:53:00<22:14:22,  3.24it/s]
 30%|███       | 111720/371472 [8:53:01<21:31:18,  3.35it/s]
                                                            
{'loss': 3.3055, 'learning_rate': 7.296645047296859e-07, 'epoch': 4.81}

 30%|███       | 111720/371472 [8:53:01<21:31:18,  3.35it/s]
 30%|███       | 111721/371472 [8:53:01<21:48:40,  3.31it/s]
 30%|███       | 111722/371472 [8:53:01<20:42:09,  3.49it/s]
 30%|███       | 111723/371472 [8:53:01<20:04:26,  3.59it/s]
 30%|███       | 111724/371472 [8:53:02<19:37:13,  3.68it/s]
 30%|███       | 111725/371472 [8:53:02<20:00:40,  3.61it/s]
 30%|███       | 111726/371472 [8:53:02<21:00:12,  3.44it/s]
 30%|███       | 111727/371472 [8:53:03<20:53:12,  3.45it/s]
 30%|███       | 111728/371472 [8:53:03<21:15:24,  3.39it/s]
 30%|███       | 111729/371472 [8:53:03<22:41:31,  3.18it/s]
 30%|███       | 111730/371472 [8:53:03<21:22:04,  3.38it/s]
 30%|███       | 111731/371472 [8:53:04<20:39:16,  3.49it/s]
 30%|███       | 111732/371472 [8:53:04<20:42:13,  3.48it/s]
 30%|███       | 111733/371472 [8:53:04<19:54:07,  3.63it/s]
 30%|███       | 111734/371472 [8:53:05<20:09:08,  3.58it/s]
 30%|███       | 111735/371472 [8:53:05<21:53:18,  3.30it/s]
 30%|███       | 111736/371472 [8:53:05<21:54:03,  3.29it/s]
 30%|███       | 111737/371472 [8:53:05<20:59:58,  3.44it/s]
 30%|███       | 111738/371472 [8:53:06<20:34:46,  3.51it/s]
 30%|███       | 111739/371472 [8:53:06<20:01:43,  3.60it/s]
 30%|███       | 111740/371472 [8:53:06<20:12:15,  3.57it/s]
                                                            
{'loss': 3.383, 'learning_rate': 7.296160227542071e-07, 'epoch': 4.81}

 30%|███       | 111740/371472 [8:53:06<20:12:15,  3.57it/s]
 30%|███       | 111741/371472 [8:53:07<21:59:15,  3.28it/s]
 30%|███       | 111742/371472 [8:53:07<20:58:28,  3.44it/s]
 30%|███       | 111743/371472 [8:53:07<20:42:02,  3.49it/s]
 30%|███       | 111744/371472 [8:53:07<20:23:02,  3.54it/s]
 30%|███       | 111745/371472 [8:53:08<22:07:43,  3.26it/s]
 30%|███       | 111746/371472 [8:53:08<20:48:23,  3.47it/s]
 30%|███       | 111747/371472 [8:53:08<20:23:58,  3.54it/s]
 30%|███       | 111748/371472 [8:53:09<21:06:50,  3.42it/s]
 30%|███       | 111749/371472 [8:53:09<20:49:17,  3.46it/s]
 30%|███       | 111750/371472 [8:53:09<20:07:04,  3.59it/s]
 30%|███       | 111751/371472 [8:53:09<20:04:41,  3.59it/s]
 30%|███       | 111752/371472 [8:53:10<19:54:20,  3.62it/s]
 30%|███       | 111753/371472 [8:53:10<19:46:20,  3.65it/s]
 30%|███       | 111754/371472 [8:53:10<20:05:12,  3.59it/s]
 30%|███       | 111755/371472 [8:53:11<19:58:34,  3.61it/s]
 30%|███       | 111756/371472 [8:53:11<19:33:44,  3.69it/s]
 30%|███       | 111757/371472 [8:53:11<19:43:00,  3.66it/s]
 30%|███       | 111758/371472 [8:53:11<20:28:52,  3.52it/s]
 30%|███       | 111759/371472 [8:53:12<24:56:01,  2.89it/s]
 30%|███       | 111760/371472 [8:53:12<24:03:48,  3.00it/s]
                                                            
{'loss': 3.5977, 'learning_rate': 7.295675407787283e-07, 'epoch': 4.81}

 30%|███       | 111760/371472 [8:53:12<24:03:48,  3.00it/s]
 30%|███       | 111761/371472 [8:53:12<22:36:15,  3.19it/s]
 30%|███       | 111762/371472 [8:53:13<23:18:37,  3.09it/s]
 30%|███       | 111763/371472 [8:53:13<22:00:23,  3.28it/s]
 30%|███       | 111764/371472 [8:53:13<23:25:00,  3.08it/s]
 30%|███       | 111765/371472 [8:53:14<22:01:14,  3.28it/s]
 30%|███       | 111766/371472 [8:53:14<21:48:11,  3.31it/s]
 30%|███       | 111767/371472 [8:53:14<20:29:50,  3.52it/s]
 30%|███       | 111768/371472 [8:53:15<20:33:22,  3.51it/s]
 30%|███       | 111769/371472 [8:53:15<21:52:01,  3.30it/s]
 30%|███       | 111770/371472 [8:53:15<21:41:57,  3.32it/s]
 30%|███       | 111771/371472 [8:53:15<21:07:41,  3.41it/s]
 30%|███       | 111772/371472 [8:53:16<20:15:59,  3.56it/s]
 30%|███       | 111773/371472 [8:53:16<20:01:04,  3.60it/s]
 30%|███       | 111774/371472 [8:53:16<19:47:46,  3.64it/s]
 30%|███       | 111775/371472 [8:53:16<19:42:00,  3.66it/s]
 30%|███       | 111776/371472 [8:53:17<21:10:21,  3.41it/s]
 30%|███       | 111777/371472 [8:53:17<21:55:01,  3.29it/s]
 30%|███       | 111778/371472 [8:53:17<21:10:04,  3.41it/s]
 30%|███       | 111779/371472 [8:53:18<20:45:20,  3.48it/s]
 30%|███       | 111780/371472 [8:53:18<20:31:09,  3.52it/s]
                                                            
{'loss': 3.2123, 'learning_rate': 7.295190588032493e-07, 'epoch': 4.81}

 30%|███       | 111780/371472 [8:53:18<20:31:09,  3.52it/s]
 30%|███       | 111781/371472 [8:53:18<22:23:38,  3.22it/s]
 30%|███       | 111782/371472 [8:53:19<22:29:43,  3.21it/s]
 30%|███       | 111783/371472 [8:53:19<21:31:04,  3.35it/s]
 30%|███       | 111784/371472 [8:53:19<20:33:09,  3.51it/s]
 30%|███       | 111785/371472 [8:53:19<20:00:27,  3.61it/s]
 30%|███       | 111786/371472 [8:53:20<20:20:46,  3.55it/s]
 30%|███       | 111787/371472 [8:53:20<20:59:17,  3.44it/s]
 30%|███       | 111788/371472 [8:53:20<20:17:42,  3.55it/s]
 30%|███       | 111789/371472 [8:53:21<19:50:56,  3.63it/s]
 30%|███       | 111790/371472 [8:53:21<19:23:58,  3.72it/s]
 30%|███       | 111791/371472 [8:53:21<19:01:17,  3.79it/s]
 30%|███       | 111792/371472 [8:53:21<19:21:01,  3.73it/s]
 30%|███       | 111793/371472 [8:53:22<19:57:27,  3.61it/s]
 30%|███       | 111794/371472 [8:53:22<19:47:26,  3.64it/s]
 30%|███       | 111795/371472 [8:53:22<19:00:41,  3.79it/s]
 30%|███       | 111796/371472 [8:53:22<19:30:05,  3.70it/s]
 30%|███       | 111797/371472 [8:53:23<20:15:34,  3.56it/s]
 30%|███       | 111798/371472 [8:53:23<20:28:09,  3.52it/s]
 30%|███       | 111799/371472 [8:53:23<19:57:43,  3.61it/s]
 30%|███       | 111800/371472 [8:53:24<19:46:51,  3.65it/s]
                                                            
{'loss': 3.4144, 'learning_rate': 7.294705768277704e-07, 'epoch': 4.82}

 30%|███       | 111800/371472 [8:53:24<19:46:51,  3.65it/s]
 30%|███       | 111801/371472 [8:53:24<20:00:47,  3.60it/s]
 30%|███       | 111802/371472 [8:53:24<19:39:33,  3.67it/s]
 30%|███       | 111803/371472 [8:53:24<19:09:43,  3.76it/s]
 30%|███       | 111804/371472 [8:53:25<19:08:31,  3.77it/s]
 30%|███       | 111805/371472 [8:53:25<18:53:06,  3.82it/s]
 30%|███       | 111806/371472 [8:53:25<19:09:46,  3.76it/s]
 30%|███       | 111807/371472 [8:53:25<18:56:35,  3.81it/s]
 30%|███       | 111808/371472 [8:53:26<19:30:36,  3.70it/s]
 30%|███       | 111809/371472 [8:53:26<19:46:52,  3.65it/s]
 30%|███       | 111810/371472 [8:53:26<19:32:33,  3.69it/s]
 30%|███       | 111811/371472 [8:53:27<19:53:58,  3.62it/s]
 30%|███       | 111812/371472 [8:53:27<20:11:46,  3.57it/s]
 30%|███       | 111813/371472 [8:53:27<20:17:25,  3.55it/s]
 30%|███       | 111814/371472 [8:53:27<20:10:04,  3.58it/s]
 30%|███       | 111815/371472 [8:53:28<20:09:42,  3.58it/s]
 30%|███       | 111816/371472 [8:53:28<21:02:34,  3.43it/s]
 30%|███       | 111817/371472 [8:53:28<22:44:01,  3.17it/s]
 30%|███       | 111818/371472 [8:53:29<21:06:35,  3.42it/s]
 30%|███       | 111819/371472 [8:53:29<21:29:39,  3.36it/s]
 30%|███       | 111820/371472 [8:53:29<21:44:37,  3.32it/s]
                                                            
{'loss': 3.3147, 'learning_rate': 7.294220948522916e-07, 'epoch': 4.82}

 30%|███       | 111820/371472 [8:53:29<21:44:37,  3.32it/s]
 30%|███       | 111821/371472 [8:53:30<22:33:56,  3.20it/s]
 30%|███       | 111822/371472 [8:53:30<24:53:28,  2.90it/s]
 30%|███       | 111823/371472 [8:53:30<22:56:09,  3.14it/s]
 30%|███       | 111824/371472 [8:53:30<21:42:57,  3.32it/s]
 30%|███       | 111825/371472 [8:53:31<21:26:56,  3.36it/s]
 30%|███       | 111826/371472 [8:53:31<21:41:13,  3.33it/s]
 30%|███       | 111827/371472 [8:53:31<20:34:11,  3.51it/s]
 30%|███       | 111828/371472 [8:53:32<20:10:08,  3.58it/s]
 30%|███       | 111829/371472 [8:53:32<20:21:10,  3.54it/s]
 30%|███       | 111830/371472 [8:53:32<20:49:08,  3.46it/s]
 30%|███       | 111831/371472 [8:53:32<20:00:10,  3.61it/s]
 30%|███       | 111832/371472 [8:53:33<21:38:45,  3.33it/s]
 30%|███       | 111833/371472 [8:53:33<20:45:00,  3.48it/s]
 30%|███       | 111834/371472 [8:53:33<20:15:15,  3.56it/s]
 30%|███       | 111835/371472 [8:53:34<19:16:17,  3.74it/s]
 30%|███       | 111836/371472 [8:53:34<18:53:43,  3.82it/s]
 30%|███       | 111837/371472 [8:53:34<19:07:29,  3.77it/s]
 30%|███       | 111838/371472 [8:53:34<20:11:45,  3.57it/s]
 30%|███       | 111839/371472 [8:53:35<22:08:20,  3.26it/s]
 30%|███       | 111840/371472 [8:53:35<21:07:32,  3.41it/s]
                                                            
{'loss': 3.3394, 'learning_rate': 7.293736128768127e-07, 'epoch': 4.82}

 30%|███       | 111840/371472 [8:53:35<21:07:32,  3.41it/s]
 30%|███       | 111841/371472 [8:53:35<21:07:38,  3.41it/s]
 30%|███       | 111842/371472 [8:53:36<20:44:40,  3.48it/s]
 30%|███       | 111843/371472 [8:53:36<19:44:49,  3.65it/s]
 30%|███       | 111844/371472 [8:53:36<19:06:19,  3.77it/s]
 30%|███       | 111845/371472 [8:53:36<19:02:40,  3.79it/s]
 30%|███       | 111846/371472 [8:53:37<19:14:49,  3.75it/s]
 30%|███       | 111847/371472 [8:53:37<19:29:39,  3.70it/s]
 30%|███       | 111848/371472 [8:53:37<19:04:53,  3.78it/s]
 30%|███       | 111849/371472 [8:53:37<18:57:28,  3.80it/s]
 30%|███       | 111850/371472 [8:53:38<19:38:55,  3.67it/s]
 30%|███       | 111851/371472 [8:53:38<19:37:41,  3.67it/s]
 30%|███       | 111852/371472 [8:53:38<20:40:40,  3.49it/s]
 30%|███       | 111853/371472 [8:53:39<21:40:35,  3.33it/s]
 30%|███       | 111854/371472 [8:53:39<20:51:58,  3.46it/s]
 30%|███       | 111855/371472 [8:53:39<20:39:00,  3.49it/s]
 30%|███       | 111856/371472 [8:53:39<21:29:58,  3.35it/s]
 30%|███       | 111857/371472 [8:53:40<21:03:57,  3.42it/s]
 30%|███       | 111858/371472 [8:53:40<21:21:35,  3.38it/s]
 30%|███       | 111859/371472 [8:53:40<20:43:19,  3.48it/s]
 30%|███       | 111860/371472 [8:53:41<20:23:17,  3.54it/s]
                                                            
{'loss': 3.4783, 'learning_rate': 7.293251309013337e-07, 'epoch': 4.82}

 30%|███       | 111860/371472 [8:53:41<20:23:17,  3.54it/s]
 30%|███       | 111861/371472 [8:53:41<21:09:08,  3.41it/s]
 30%|███       | 111862/371472 [8:53:41<20:58:11,  3.44it/s]
 30%|███       | 111863/371472 [8:53:42<21:43:14,  3.32it/s]
 30%|███       | 111864/371472 [8:53:42<21:15:19,  3.39it/s]
 30%|███       | 111865/371472 [8:53:42<21:09:25,  3.41it/s]
 30%|███       | 111866/371472 [8:53:42<22:18:00,  3.23it/s]
 30%|███       | 111867/371472 [8:53:43<21:30:21,  3.35it/s]
 30%|███       | 111868/371472 [8:53:43<21:47:00,  3.31it/s]
 30%|███       | 111869/371472 [8:53:43<21:10:17,  3.41it/s]
 30%|███       | 111870/371472 [8:53:44<21:22:15,  3.37it/s]
 30%|███       | 111871/371472 [8:53:44<20:52:16,  3.46it/s]
 30%|███       | 111872/371472 [8:53:44<21:11:49,  3.40it/s]
 30%|███       | 111873/371472 [8:53:44<20:29:24,  3.52it/s]
 30%|███       | 111874/371472 [8:53:45<20:03:45,  3.59it/s]
 30%|███       | 111875/371472 [8:53:45<19:57:20,  3.61it/s]
 30%|███       | 111876/371472 [8:53:45<19:53:15,  3.63it/s]
 30%|███       | 111877/371472 [8:53:46<21:25:42,  3.37it/s]
 30%|███       | 111878/371472 [8:53:46<20:35:25,  3.50it/s]
 30%|███       | 111879/371472 [8:53:46<19:34:47,  3.68it/s]
 30%|███       | 111880/371472 [8:53:46<21:12:39,  3.40it/s]
                                                            
{'loss': 3.1755, 'learning_rate': 7.292766489258548e-07, 'epoch': 4.82}

 30%|███       | 111880/371472 [8:53:46<21:12:39,  3.40it/s]
 30%|███       | 111881/371472 [8:53:47<20:20:41,  3.54it/s]
 30%|███       | 111882/371472 [8:53:47<20:00:14,  3.60it/s]
 30%|███       | 111883/371472 [8:53:47<21:00:24,  3.43it/s]
 30%|███       | 111884/371472 [8:53:48<20:30:50,  3.52it/s]
 30%|███       | 111885/371472 [8:53:48<20:08:47,  3.58it/s]
 30%|███       | 111886/371472 [8:53:48<19:49:00,  3.64it/s]
 30%|███       | 111887/371472 [8:53:48<21:08:01,  3.41it/s]
 30%|███       | 111888/371472 [8:53:49<23:22:30,  3.08it/s]
 30%|███       | 111889/371472 [8:53:49<21:57:28,  3.28it/s]
 30%|███       | 111890/371472 [8:53:49<22:23:40,  3.22it/s]
 30%|███       | 111891/371472 [8:53:50<22:38:08,  3.19it/s]
 30%|███       | 111892/371472 [8:53:50<21:22:41,  3.37it/s]
 30%|███       | 111893/371472 [8:53:50<21:49:30,  3.30it/s]
 30%|███       | 111894/371472 [8:53:51<20:43:06,  3.48it/s]
 30%|███       | 111895/371472 [8:53:51<20:12:25,  3.57it/s]
 30%|███       | 111896/371472 [8:53:51<22:07:52,  3.26it/s]
 30%|███       | 111897/371472 [8:53:51<21:30:28,  3.35it/s]
 30%|███       | 111898/371472 [8:53:52<21:29:05,  3.36it/s]
 30%|███       | 111899/371472 [8:53:52<21:08:17,  3.41it/s]
 30%|███       | 111900/371472 [8:53:52<21:45:51,  3.31it/s]
                                                            
{'loss': 3.2937, 'learning_rate': 7.29228166950376e-07, 'epoch': 4.82}

 30%|███       | 111900/371472 [8:53:52<21:45:51,  3.31it/s]
 30%|███       | 111901/371472 [8:53:53<20:38:47,  3.49it/s]
 30%|███       | 111902/371472 [8:53:53<20:02:24,  3.60it/s]
 30%|███       | 111903/371472 [8:53:53<20:54:33,  3.45it/s]
 30%|███       | 111904/371472 [8:53:53<21:02:22,  3.43it/s]
 30%|███       | 111905/371472 [8:53:54<21:19:59,  3.38it/s]
 30%|███       | 111906/371472 [8:53:54<21:22:09,  3.37it/s]
 30%|███       | 111907/371472 [8:53:54<20:25:51,  3.53it/s]
 30%|███       | 111908/371472 [8:53:55<19:48:49,  3.64it/s]
 30%|███       | 111909/371472 [8:53:55<20:24:21,  3.53it/s]
 30%|███       | 111910/371472 [8:53:55<20:17:16,  3.55it/s]
 30%|███       | 111911/371472 [8:53:55<20:08:01,  3.58it/s]
 30%|███       | 111912/371472 [8:53:56<19:50:37,  3.63it/s]
 30%|███       | 111913/371472 [8:53:56<19:16:17,  3.74it/s]
 30%|███       | 111914/371472 [8:53:56<19:37:31,  3.67it/s]
 30%|███       | 111915/371472 [8:53:57<19:34:00,  3.68it/s]
 30%|███       | 111916/371472 [8:53:57<20:36:15,  3.50it/s]
 30%|███       | 111917/371472 [8:53:57<19:43:30,  3.66it/s]
 30%|███       | 111918/371472 [8:53:57<19:14:11,  3.75it/s]
 30%|███       | 111919/371472 [8:53:58<19:11:41,  3.76it/s]
 30%|███       | 111920/371472 [8:53:58<19:52:29,  3.63it/s]
                                                            
{'loss': 3.2458, 'learning_rate': 7.291796849748972e-07, 'epoch': 4.82}

 30%|███       | 111920/371472 [8:53:58<19:52:29,  3.63it/s]
 30%|███       | 111921/371472 [8:53:58<20:10:10,  3.57it/s]
 30%|███       | 111922/371472 [8:53:58<20:00:12,  3.60it/s]
 30%|███       | 111923/371472 [8:53:59<19:28:07,  3.70it/s]
 30%|███       | 111924/371472 [8:53:59<21:20:18,  3.38it/s]
 30%|███       | 111925/371472 [8:53:59<20:49:09,  3.46it/s]
 30%|███       | 111926/371472 [8:54:00<20:25:44,  3.53it/s]
 30%|███       | 111927/371472 [8:54:00<20:23:17,  3.54it/s]
 30%|███       | 111928/371472 [8:54:00<20:39:25,  3.49it/s]
 30%|███       | 111929/371472 [8:54:00<20:28:59,  3.52it/s]
 30%|███       | 111930/371472 [8:54:01<20:03:51,  3.59it/s]
 30%|███       | 111931/371472 [8:54:01<19:30:23,  3.70it/s]
 30%|███       | 111932/371472 [8:54:01<20:42:14,  3.48it/s]
 30%|███       | 111933/371472 [8:54:02<20:03:54,  3.59it/s]
 30%|███       | 111934/371472 [8:54:02<20:10:02,  3.57it/s]
 30%|███       | 111935/371472 [8:54:02<19:45:22,  3.65it/s]
 30%|███       | 111936/371472 [8:54:02<19:33:43,  3.69it/s]
 30%|███       | 111937/371472 [8:54:03<19:24:28,  3.71it/s]
 30%|███       | 111938/371472 [8:54:03<20:00:45,  3.60it/s]
 30%|███       | 111939/371472 [8:54:03<22:07:53,  3.26it/s]
 30%|███       | 111940/371472 [8:54:04<21:20:22,  3.38it/s]
                                                            
{'loss': 3.3099, 'learning_rate': 7.291312029994182e-07, 'epoch': 4.82}

 30%|███       | 111940/371472 [8:54:04<21:20:22,  3.38it/s]
 30%|███       | 111941/371472 [8:54:04<21:14:21,  3.39it/s]
 30%|███       | 111942/371472 [8:54:04<21:54:15,  3.29it/s]
 30%|███       | 111943/371472 [8:54:04<20:57:03,  3.44it/s]
 30%|███       | 111944/371472 [8:54:05<21:00:30,  3.43it/s]
 30%|███       | 111945/371472 [8:54:05<19:56:02,  3.62it/s]
 30%|███       | 111946/371472 [8:54:05<21:14:15,  3.39it/s]
 30%|███       | 111947/371472 [8:54:06<20:23:58,  3.53it/s]
 30%|███       | 111948/371472 [8:54:06<20:17:51,  3.55it/s]
 30%|███       | 111949/371472 [8:54:06<20:01:48,  3.60it/s]
 30%|███       | 111950/371472 [8:54:06<19:16:02,  3.74it/s]
 30%|███       | 111951/371472 [8:54:07<20:26:44,  3.53it/s]
 30%|███       | 111952/371472 [8:54:07<20:05:23,  3.59it/s]
 30%|███       | 111953/371472 [8:54:07<20:31:13,  3.51it/s]
 30%|███       | 111954/371472 [8:54:08<20:28:39,  3.52it/s]
 30%|███       | 111955/371472 [8:54:08<19:53:34,  3.62it/s]
 30%|███       | 111956/371472 [8:54:08<19:16:36,  3.74it/s]
 30%|███       | 111957/371472 [8:54:08<20:07:15,  3.58it/s]
 30%|███       | 111958/371472 [8:54:09<20:05:10,  3.59it/s]
 30%|███       | 111959/371472 [8:54:09<19:38:35,  3.67it/s]
 30%|███       | 111960/371472 [8:54:09<19:48:28,  3.64it/s]
                                                            
{'loss': 3.531, 'learning_rate': 7.290827210239393e-07, 'epoch': 4.82}

 30%|███       | 111960/371472 [8:54:09<19:48:28,  3.64it/s]
 30%|███       | 111961/371472 [8:54:09<19:33:53,  3.68it/s]
 30%|███       | 111962/371472 [8:54:10<20:08:11,  3.58it/s]
 30%|███       | 111963/371472 [8:54:10<19:58:07,  3.61it/s]
 30%|███       | 111964/371472 [8:54:10<21:06:08,  3.42it/s]
 30%|███       | 111965/371472 [8:54:11<20:23:19,  3.54it/s]
 30%|███       | 111966/371472 [8:54:11<19:51:20,  3.63it/s]
 30%|███       | 111967/371472 [8:54:11<20:38:07,  3.49it/s]
 30%|███       | 111968/371472 [8:54:11<19:49:49,  3.64it/s]
 30%|███       | 111969/371472 [8:54:12<21:32:51,  3.35it/s]
 30%|███       | 111970/371472 [8:54:12<20:48:11,  3.47it/s]
 30%|███       | 111971/371472 [8:54:12<20:22:43,  3.54it/s]
 30%|███       | 111972/371472 [8:54:13<20:11:00,  3.57it/s]
 30%|███       | 111973/371472 [8:54:13<21:34:09,  3.34it/s]
 30%|███       | 111974/371472 [8:54:13<20:58:16,  3.44it/s]
 30%|███       | 111975/371472 [8:54:13<21:10:25,  3.40it/s]
 30%|███       | 111976/371472 [8:54:14<21:37:09,  3.33it/s]
 30%|███       | 111977/371472 [8:54:14<21:00:35,  3.43it/s]
 30%|███       | 111978/371472 [8:54:14<20:25:26,  3.53it/s]
 30%|███       | 111979/371472 [8:54:15<20:35:03,  3.50it/s]
 30%|███       | 111980/371472 [8:54:15<21:17:42,  3.38it/s]
                                                            
{'loss': 3.1037, 'learning_rate': 7.290342390484604e-07, 'epoch': 4.82}

 30%|███       | 111980/371472 [8:54:15<21:17:42,  3.38it/s]
 30%|███       | 111981/371472 [8:54:15<20:30:06,  3.52it/s]
 30%|███       | 111982/371472 [8:54:15<20:18:15,  3.55it/s]
 30%|███       | 111983/371472 [8:54:16<21:22:47,  3.37it/s]
 30%|███       | 111984/371472 [8:54:16<21:50:15,  3.30it/s]
 30%|███       | 111985/371472 [8:54:16<21:02:54,  3.42it/s]
 30%|███       | 111986/371472 [8:54:17<21:25:34,  3.36it/s]
 30%|███       | 111987/371472 [8:54:17<21:17:08,  3.39it/s]
 30%|███       | 111988/371472 [8:54:17<21:04:38,  3.42it/s]
 30%|███       | 111989/371472 [8:54:18<20:33:55,  3.50it/s]
 30%|███       | 111990/371472 [8:54:18<22:33:10,  3.20it/s]
 30%|███       | 111991/371472 [8:54:18<21:25:32,  3.36it/s]
 30%|███       | 111992/371472 [8:54:18<20:20:55,  3.54it/s]
 30%|███       | 111993/371472 [8:54:19<19:16:02,  3.74it/s]
 30%|███       | 111994/371472 [8:54:19<19:04:44,  3.78it/s]
 30%|███       | 111995/371472 [8:54:19<19:24:45,  3.71it/s]
 30%|███       | 111996/371472 [8:54:19<19:29:37,  3.70it/s]
 30%|███       | 111997/371472 [8:54:20<20:11:41,  3.57it/s]
 30%|███       | 111998/371472 [8:54:20<19:44:48,  3.65it/s]
 30%|███       | 111999/371472 [8:54:20<19:38:33,  3.67it/s]
 30%|███       | 112000/371472 [8:54:21<19:21:23,  3.72it/s]
                                                            
{'loss': 3.4912, 'learning_rate': 7.289857570729814e-07, 'epoch': 4.82}

 30%|███       | 112000/371472 [8:54:21<19:21:23,  3.72it/s]
 30%|███       | 112001/371472 [8:54:21<20:48:04,  3.46it/s]
 30%|███       | 112002/371472 [8:54:21<19:39:43,  3.67it/s]
 30%|███       | 112003/371472 [8:54:21<20:11:59,  3.57it/s]
 30%|███       | 112004/371472 [8:54:22<20:25:52,  3.53it/s]
 30%|███       | 112005/371472 [8:54:22<20:21:02,  3.54it/s]
 30%|███       | 112006/371472 [8:54:22<20:15:04,  3.56it/s]
 30%|███       | 112007/371472 [8:54:23<20:54:45,  3.45it/s]
 30%|███       | 112008/371472 [8:54:23<20:07:22,  3.58it/s]
 30%|███       | 112009/371472 [8:54:23<20:47:04,  3.47it/s]
 30%|███       | 112010/371472 [8:54:23<19:51:24,  3.63it/s]
 30%|███       | 112011/371472 [8:54:24<19:29:47,  3.70it/s]
 30%|███       | 112012/371472 [8:54:24<19:38:21,  3.67it/s]
 30%|███       | 112013/371472 [8:54:24<19:22:12,  3.72it/s]
 30%|███       | 112014/371472 [8:54:24<18:40:12,  3.86it/s]
 30%|███       | 112015/371472 [8:54:25<18:54:26,  3.81it/s]
 30%|███       | 112016/371472 [8:54:25<18:47:23,  3.84it/s]
 30%|███       | 112017/371472 [8:54:25<18:47:53,  3.83it/s]
 30%|███       | 112018/371472 [8:54:26<22:44:58,  3.17it/s]
 30%|███       | 112019/371472 [8:54:26<21:31:44,  3.35it/s]
 30%|███       | 112020/371472 [8:54:26<20:14:43,  3.56it/s]
                                                            
{'loss': 3.4789, 'learning_rate': 7.289372750975025e-07, 'epoch': 4.82}

 30%|███       | 112020/371472 [8:54:26<20:14:43,  3.56it/s]
 30%|███       | 112021/371472 [8:54:26<20:17:34,  3.55it/s]
 30%|███       | 112022/371472 [8:54:27<21:25:59,  3.36it/s]
 30%|███       | 112023/371472 [8:54:27<21:31:48,  3.35it/s]
 30%|███       | 112024/371472 [8:54:27<21:20:10,  3.38it/s]
 30%|███       | 112025/371472 [8:54:28<21:11:36,  3.40it/s]
 30%|███       | 112026/371472 [8:54:28<20:48:14,  3.46it/s]
 30%|███       | 112027/371472 [8:54:28<20:33:04,  3.51it/s]
 30%|███       | 112028/371472 [8:54:29<20:13:37,  3.56it/s]
 30%|███       | 112029/371472 [8:54:29<19:54:19,  3.62it/s]
 30%|███       | 112030/371472 [8:54:29<18:55:10,  3.81it/s]
 30%|███       | 112031/371472 [8:54:29<18:29:08,  3.90it/s]
 30%|███       | 112032/371472 [8:54:29<18:21:00,  3.93it/s]
 30%|███       | 112033/371472 [8:54:30<18:15:22,  3.95it/s]
 30%|███       | 112034/371472 [8:54:30<18:46:44,  3.84it/s]
 30%|███       | 112035/371472 [8:54:30<18:34:17,  3.88it/s]
 30%|███       | 112036/371472 [8:54:31<18:39:01,  3.86it/s]
 30%|███       | 112037/371472 [8:54:31<18:34:01,  3.88it/s]
 30%|███       | 112038/371472 [8:54:31<18:47:36,  3.83it/s]
 30%|███       | 112039/371472 [8:54:31<18:56:16,  3.81it/s]
 30%|███       | 112040/371472 [8:54:32<19:34:40,  3.68it/s]
                                                            
{'loss': 3.5027, 'learning_rate': 7.288887931220237e-07, 'epoch': 4.83}

 30%|███       | 112040/371472 [8:54:32<19:34:40,  3.68it/s]
 30%|███       | 112041/371472 [8:54:32<19:05:18,  3.78it/s]
 30%|███       | 112042/371472 [8:54:32<19:21:18,  3.72it/s]
 30%|███       | 112043/371472 [8:54:32<20:20:14,  3.54it/s]
 30%|███       | 112044/371472 [8:54:33<19:57:11,  3.61it/s]
 30%|███       | 112045/371472 [8:54:33<20:00:57,  3.60it/s]
 30%|███       | 112046/371472 [8:54:33<19:29:00,  3.70it/s]
 30%|███       | 112047/371472 [8:54:34<19:38:13,  3.67it/s]
 30%|███       | 112048/371472 [8:54:34<20:54:41,  3.45it/s]
 30%|███       | 112049/371472 [8:54:34<19:58:49,  3.61it/s]
 30%|███       | 112050/371472 [8:54:34<19:22:13,  3.72it/s]
 30%|███       | 112051/371472 [8:54:35<19:56:52,  3.61it/s]
 30%|███       | 112052/371472 [8:54:35<20:03:56,  3.59it/s]
 30%|███       | 112053/371472 [8:54:35<19:47:27,  3.64it/s]
 30%|███       | 112054/371472 [8:54:36<20:42:22,  3.48it/s]
 30%|███       | 112055/371472 [8:54:36<19:41:06,  3.66it/s]
 30%|███       | 112056/371472 [8:54:36<19:28:47,  3.70it/s]
 30%|███       | 112057/371472 [8:54:36<19:07:39,  3.77it/s]
 30%|███       | 112058/371472 [8:54:37<18:59:53,  3.79it/s]
 30%|███       | 112059/371472 [8:54:37<19:01:06,  3.79it/s]
 30%|███       | 112060/371472 [8:54:37<22:36:10,  3.19it/s]
                                                            
{'loss': 3.4467, 'learning_rate': 7.288403111465449e-07, 'epoch': 4.83}

 30%|███       | 112060/371472 [8:54:37<22:36:10,  3.19it/s]
 30%|███       | 112061/371472 [8:54:38<21:38:00,  3.33it/s]
 30%|███       | 112062/371472 [8:54:38<20:36:17,  3.50it/s]
 30%|███       | 112063/371472 [8:54:38<20:31:41,  3.51it/s]
 30%|███       | 112064/371472 [8:54:38<20:00:47,  3.60it/s]
 30%|███       | 112065/371472 [8:54:39<20:11:54,  3.57it/s]
 30%|███       | 112066/371472 [8:54:39<21:53:45,  3.29it/s]
 30%|███       | 112067/371472 [8:54:39<22:14:36,  3.24it/s]
 30%|███       | 112068/371472 [8:54:40<21:02:15,  3.43it/s]
 30%|███       | 112069/371472 [8:54:40<21:21:51,  3.37it/s]
 30%|███       | 112070/371472 [8:54:40<22:47:14,  3.16it/s]
 30%|███       | 112071/371472 [8:54:40<22:25:31,  3.21it/s]
 30%|███       | 112072/371472 [8:54:41<21:45:55,  3.31it/s]
 30%|███       | 112073/371472 [8:54:41<22:50:22,  3.15it/s]
 30%|███       | 112074/371472 [8:54:41<21:35:13,  3.34it/s]
 30%|███       | 112075/371472 [8:54:42<21:33:35,  3.34it/s]
 30%|███       | 112076/371472 [8:54:42<20:37:49,  3.49it/s]
 30%|███       | 112077/371472 [8:54:42<19:56:01,  3.61it/s]
 30%|███       | 112078/371472 [8:54:42<19:40:53,  3.66it/s]
 30%|███       | 112079/371472 [8:54:43<19:19:37,  3.73it/s]
 30%|███       | 112080/371472 [8:54:43<19:57:44,  3.61it/s]
                                                            
{'loss': 3.3026, 'learning_rate': 7.28791829171066e-07, 'epoch': 4.83}

 30%|███       | 112080/371472 [8:54:43<19:57:44,  3.61it/s]
 30%|███       | 112081/371472 [8:54:43<20:10:06,  3.57it/s]
 30%|███       | 112082/371472 [8:54:44<19:20:14,  3.73it/s]
 30%|███       | 112083/371472 [8:54:44<19:30:13,  3.69it/s]
 30%|███       | 112084/371472 [8:54:44<19:13:09,  3.75it/s]
 30%|███       | 112085/371472 [8:54:44<18:40:05,  3.86it/s]
 30%|███       | 112086/371472 [8:54:45<18:28:25,  3.90it/s]
 30%|███       | 112087/371472 [8:54:45<18:43:45,  3.85it/s]
 30%|███       | 112088/371472 [8:54:45<19:02:59,  3.78it/s]
 30%|███       | 112089/371472 [8:54:45<19:27:54,  3.70it/s]
 30%|███       | 112090/371472 [8:54:46<19:27:17,  3.70it/s]
 30%|███       | 112091/371472 [8:54:46<19:24:09,  3.71it/s]
 30%|███       | 112092/371472 [8:54:46<20:30:07,  3.51it/s]
 30%|███       | 112093/371472 [8:54:47<23:29:48,  3.07it/s]
 30%|███       | 112094/371472 [8:54:47<21:51:46,  3.30it/s]
 30%|███       | 112095/371472 [8:54:47<20:48:50,  3.46it/s]
 30%|███       | 112096/371472 [8:54:48<22:02:47,  3.27it/s]
 30%|███       | 112097/371472 [8:54:48<21:22:09,  3.37it/s]
 30%|███       | 112098/371472 [8:54:48<20:55:13,  3.44it/s]
 30%|███       | 112099/371472 [8:54:48<20:15:16,  3.56it/s]
 30%|███       | 112100/371472 [8:54:49<20:17:48,  3.55it/s]
                                                            
{'loss': 3.316, 'learning_rate': 7.28743347195587e-07, 'epoch': 4.83}

 30%|███       | 112100/371472 [8:54:49<20:17:48,  3.55it/s]
 30%|███       | 112101/371472 [8:54:49<20:32:40,  3.51it/s]
 30%|███       | 112102/371472 [8:54:49<20:16:48,  3.55it/s]
 30%|███       | 112103/371472 [8:54:49<20:48:38,  3.46it/s]
 30%|███       | 112104/371472 [8:54:50<19:55:32,  3.62it/s]
 30%|███       | 112105/371472 [8:54:50<20:48:24,  3.46it/s]
 30%|███       | 112106/371472 [8:54:50<20:29:16,  3.52it/s]
 30%|███       | 112107/371472 [8:54:51<21:56:31,  3.28it/s]
 30%|███       | 112108/371472 [8:54:51<21:24:20,  3.37it/s]
 30%|███       | 112109/371472 [8:54:51<21:52:37,  3.29it/s]
 30%|███       | 112110/371472 [8:54:52<22:13:26,  3.24it/s]
 30%|███       | 112111/371472 [8:54:52<21:41:18,  3.32it/s]
 30%|███       | 112112/371472 [8:54:52<21:17:38,  3.38it/s]
 30%|███       | 112113/371472 [8:54:53<24:34:38,  2.93it/s]
 30%|███       | 112114/371472 [8:54:53<22:43:29,  3.17it/s]
 30%|███       | 112115/371472 [8:54:53<21:34:51,  3.34it/s]
 30%|███       | 112116/371472 [8:54:53<20:46:52,  3.47it/s]
 30%|███       | 112117/371472 [8:54:54<20:00:20,  3.60it/s]
 30%|███       | 112118/371472 [8:54:54<20:47:01,  3.47it/s]
 30%|███       | 112119/371472 [8:54:54<20:49:50,  3.46it/s]
 30%|███       | 112120/371472 [8:54:54<19:41:03,  3.66it/s]
                                                            
{'loss': 3.2805, 'learning_rate': 7.28694865220108e-07, 'epoch': 4.83}

 30%|███       | 112120/371472 [8:54:54<19:41:03,  3.66it/s]
 30%|███       | 112121/371472 [8:54:55<19:47:05,  3.64it/s]
 30%|███       | 112122/371472 [8:54:55<22:13:06,  3.24it/s]
 30%|███       | 112123/371472 [8:54:55<21:22:47,  3.37it/s]
 30%|███       | 112124/371472 [8:54:56<20:17:18,  3.55it/s]
 30%|███       | 112125/371472 [8:54:56<20:17:02,  3.55it/s]
 30%|███       | 112126/371472 [8:54:56<19:51:59,  3.63it/s]
 30%|███       | 112127/371472 [8:54:57<20:29:02,  3.52it/s]
 30%|███       | 112128/371472 [8:54:57<19:33:25,  3.68it/s]
 30%|███       | 112129/371472 [8:54:57<20:51:49,  3.45it/s]
 30%|███       | 112130/371472 [8:54:57<20:06:51,  3.58it/s]
 30%|███       | 112131/371472 [8:54:58<20:03:20,  3.59it/s]
 30%|███       | 112132/371472 [8:54:58<19:19:04,  3.73it/s]
 30%|███       | 112133/371472 [8:54:58<19:07:01,  3.77it/s]
 30%|███       | 112134/371472 [8:54:58<19:31:19,  3.69it/s]
 30%|███       | 112135/371472 [8:54:59<19:03:36,  3.78it/s]
 30%|███       | 112136/371472 [8:54:59<19:11:56,  3.75it/s]
 30%|███       | 112137/371472 [8:54:59<19:18:42,  3.73it/s]
 30%|███       | 112138/371472 [8:54:59<19:41:56,  3.66it/s]
 30%|███       | 112139/371472 [8:55:00<20:33:54,  3.50it/s]
 30%|███       | 112140/371472 [8:55:00<20:00:58,  3.60it/s]
                                                            
{'loss': 3.3764, 'learning_rate': 7.286463832446293e-07, 'epoch': 4.83}

 30%|███       | 112140/371472 [8:55:00<20:00:58,  3.60it/s]
 30%|███       | 112141/371472 [8:55:00<19:46:55,  3.64it/s]
 30%|███       | 112142/371472 [8:55:01<21:28:18,  3.35it/s]
 30%|███       | 112143/371472 [8:55:01<20:52:39,  3.45it/s]
 30%|███       | 112144/371472 [8:55:01<20:27:47,  3.52it/s]
 30%|███       | 112145/371472 [8:55:02<21:00:03,  3.43it/s]
 30%|███       | 112146/371472 [8:55:02<24:26:25,  2.95it/s]
 30%|███       | 112147/371472 [8:55:02<23:53:24,  3.02it/s]
 30%|███       | 112148/371472 [8:55:03<22:21:39,  3.22it/s]
 30%|███       | 112149/371472 [8:55:03<21:10:28,  3.40it/s]
 30%|███       | 112150/371472 [8:55:03<21:49:45,  3.30it/s]
 30%|███       | 112151/371472 [8:55:03<21:38:35,  3.33it/s]
 30%|███       | 112152/371472 [8:55:04<21:26:32,  3.36it/s]
 30%|███       | 112153/371472 [8:55:04<21:51:14,  3.30it/s]
 30%|███       | 112154/371472 [8:55:04<20:54:17,  3.45it/s]
 30%|███       | 112155/371472 [8:55:05<20:35:10,  3.50it/s]
 30%|███       | 112156/371472 [8:55:05<20:16:00,  3.55it/s]
 30%|███       | 112157/371472 [8:55:05<19:08:21,  3.76it/s]
 30%|███       | 112158/371472 [8:55:05<20:50:18,  3.46it/s]
 30%|███       | 112159/371472 [8:55:06<20:40:54,  3.48it/s]
 30%|███       | 112160/371472 [8:55:06<19:54:02,  3.62it/s]
                                                            
{'loss': 3.384, 'learning_rate': 7.285979012691503e-07, 'epoch': 4.83}

 30%|███       | 112160/371472 [8:55:06<19:54:02,  3.62it/s]
 30%|███       | 112161/371472 [8:55:06<20:25:52,  3.53it/s]
 30%|███       | 112162/371472 [8:55:06<19:16:41,  3.74it/s]
 30%|███       | 112163/371472 [8:55:07<20:28:10,  3.52it/s]
 30%|███       | 112164/371472 [8:55:07<21:26:57,  3.36it/s]
 30%|███       | 112165/371472 [8:55:07<20:11:10,  3.57it/s]
 30%|███       | 112166/371472 [8:55:08<19:36:42,  3.67it/s]
 30%|███       | 112167/371472 [8:55:08<19:48:37,  3.64it/s]
 30%|███       | 112168/371472 [8:55:08<19:55:52,  3.61it/s]
 30%|███       | 112169/371472 [8:55:08<19:35:35,  3.68it/s]
 30%|███       | 112170/371472 [8:55:09<20:17:55,  3.55it/s]
 30%|███       | 112171/371472 [8:55:09<20:10:59,  3.57it/s]
 30%|███       | 112172/371472 [8:55:09<19:22:58,  3.72it/s]
 30%|███       | 112173/371472 [8:55:10<20:37:29,  3.49it/s]
 30%|███       | 112174/371472 [8:55:10<21:10:57,  3.40it/s]
 30%|███       | 112175/371472 [8:55:10<20:51:06,  3.45it/s]
 30%|███       | 112176/371472 [8:55:10<19:52:44,  3.62it/s]
 30%|███       | 112177/371472 [8:55:11<19:46:17,  3.64it/s]
 30%|███       | 112178/371472 [8:55:11<20:22:44,  3.53it/s]
 30%|███       | 112179/371472 [8:55:11<21:34:12,  3.34it/s]
 30%|███       | 112180/371472 [8:55:12<22:52:42,  3.15it/s]
                                                            
{'loss': 3.4574, 'learning_rate': 7.285494192936714e-07, 'epoch': 4.83}

 30%|███       | 112180/371472 [8:55:12<22:52:42,  3.15it/s]
 30%|███       | 112181/371472 [8:55:12<21:28:55,  3.35it/s]
 30%|███       | 112182/371472 [8:55:12<23:32:05,  3.06it/s]
 30%|███       | 112183/371472 [8:55:13<22:40:32,  3.18it/s]
 30%|███       | 112184/371472 [8:55:13<21:34:13,  3.34it/s]
 30%|███       | 112185/371472 [8:55:13<20:57:36,  3.44it/s]
 30%|███       | 112186/371472 [8:55:13<20:46:30,  3.47it/s]
 30%|███       | 112187/371472 [8:55:14<19:53:52,  3.62it/s]
 30%|███       | 112188/371472 [8:55:14<19:03:26,  3.78it/s]
 30%|███       | 112189/371472 [8:55:14<18:50:48,  3.82it/s]
 30%|███       | 112190/371472 [8:55:15<20:08:28,  3.58it/s]
 30%|███       | 112191/371472 [8:55:15<21:41:16,  3.32it/s]
 30%|███       | 112192/371472 [8:55:15<21:29:36,  3.35it/s]
 30%|███       | 112193/371472 [8:55:15<21:41:42,  3.32it/s]
 30%|███       | 112194/371472 [8:55:16<21:08:45,  3.41it/s]
 30%|███       | 112195/371472 [8:55:16<20:01:38,  3.60it/s]
 30%|███       | 112196/371472 [8:55:16<20:46:59,  3.47it/s]
 30%|███       | 112197/371472 [8:55:17<19:39:41,  3.66it/s]
 30%|███       | 112198/371472 [8:55:17<20:45:46,  3.47it/s]
 30%|███       | 112199/371472 [8:55:17<21:25:59,  3.36it/s]
 30%|███       | 112200/371472 [8:55:17<21:37:01,  3.33it/s]
                                                            
{'loss': 3.3161, 'learning_rate': 7.285009373181926e-07, 'epoch': 4.83}

 30%|███       | 112200/371472 [8:55:17<21:37:01,  3.33it/s]
 30%|███       | 112201/371472 [8:55:18<21:38:16,  3.33it/s]
 30%|███       | 112202/371472 [8:55:18<21:44:04,  3.31it/s]
 30%|███       | 112203/371472 [8:55:18<21:46:02,  3.31it/s]
 30%|███       | 112204/371472 [8:55:19<20:44:35,  3.47it/s]
 30%|███       | 112205/371472 [8:55:19<19:58:12,  3.61it/s]
 30%|███       | 112206/371472 [8:55:19<21:45:37,  3.31it/s]
 30%|███       | 112207/371472 [8:55:20<20:50:05,  3.46it/s]
 30%|███       | 112208/371472 [8:55:20<21:12:43,  3.40it/s]
 30%|███       | 112209/371472 [8:55:20<21:13:37,  3.39it/s]
 30%|███       | 112210/371472 [8:55:20<20:41:15,  3.48it/s]
 30%|███       | 112211/371472 [8:55:21<20:23:21,  3.53it/s]
 30%|███       | 112212/371472 [8:55:21<19:40:28,  3.66it/s]
 30%|███       | 112213/371472 [8:55:21<19:20:34,  3.72it/s]
 30%|███       | 112214/371472 [8:55:21<19:39:23,  3.66it/s]
 30%|███       | 112215/371472 [8:55:22<19:01:17,  3.79it/s]
 30%|███       | 112216/371472 [8:55:22<20:19:07,  3.54it/s]
 30%|███       | 112217/371472 [8:55:22<21:25:55,  3.36it/s]
 30%|███       | 112218/371472 [8:55:23<20:45:41,  3.47it/s]
 30%|███       | 112219/371472 [8:55:23<20:10:35,  3.57it/s]
 30%|███       | 112220/371472 [8:55:23<19:50:26,  3.63it/s]
                                                            
{'loss': 3.4587, 'learning_rate': 7.284524553427137e-07, 'epoch': 4.83}

 30%|███       | 112220/371472 [8:55:23<19:50:26,  3.63it/s]
 30%|███       | 112221/371472 [8:55:23<19:15:17,  3.74it/s]
 30%|███       | 112222/371472 [8:55:24<18:59:57,  3.79it/s]
 30%|███       | 112223/371472 [8:55:24<19:16:29,  3.74it/s]
 30%|███       | 112224/371472 [8:55:24<19:14:57,  3.74it/s]
 30%|███       | 112225/371472 [8:55:24<19:36:04,  3.67it/s]
 30%|███       | 112226/371472 [8:55:25<18:54:47,  3.81it/s]
 30%|███       | 112227/371472 [8:55:25<21:55:00,  3.29it/s]
 30%|███       | 112228/371472 [8:55:25<21:47:52,  3.30it/s]
 30%|███       | 112229/371472 [8:55:26<22:22:09,  3.22it/s]
 30%|███       | 112230/371472 [8:55:26<21:26:32,  3.36it/s]
 30%|███       | 112231/371472 [8:55:26<20:21:09,  3.54it/s]
 30%|███       | 112232/371472 [8:55:27<19:39:00,  3.66it/s]
 30%|███       | 112233/371472 [8:55:27<19:15:43,  3.74it/s]
 30%|███       | 112234/371472 [8:55:27<20:16:10,  3.55it/s]
 30%|███       | 112235/371472 [8:55:27<19:57:28,  3.61it/s]
 30%|███       | 112236/371472 [8:55:28<19:42:39,  3.65it/s]
 30%|███       | 112237/371472 [8:55:28<21:54:54,  3.29it/s]
 30%|███       | 112238/371472 [8:55:28<21:28:55,  3.35it/s]
 30%|███       | 112239/371472 [8:55:29<21:51:12,  3.30it/s]
 30%|███       | 112240/371472 [8:55:29<21:17:15,  3.38it/s]
                                                            
{'loss': 3.3729, 'learning_rate': 7.284039733672347e-07, 'epoch': 4.83}

 30%|███       | 112240/371472 [8:55:29<21:17:15,  3.38it/s]
 30%|███       | 112241/371472 [8:55:29<21:08:51,  3.41it/s]
 30%|███       | 112242/371472 [8:55:29<20:09:38,  3.57it/s]
 30%|███       | 112243/371472 [8:55:30<19:15:04,  3.74it/s]
 30%|███       | 112244/371472 [8:55:30<19:55:20,  3.61it/s]
 30%|███       | 112245/371472 [8:55:30<19:49:54,  3.63it/s]
 30%|███       | 112246/371472 [8:55:30<19:31:07,  3.69it/s]
 30%|███       | 112247/371472 [8:55:31<18:59:24,  3.79it/s]
 30%|███       | 112248/371472 [8:55:31<21:36:48,  3.33it/s]
 30%|███       | 112249/371472 [8:55:31<21:26:44,  3.36it/s]
 30%|███       | 112250/371472 [8:55:32<20:15:41,  3.55it/s]
 30%|███       | 112251/371472 [8:55:32<20:25:20,  3.53it/s]
 30%|███       | 112252/371472 [8:55:32<20:10:18,  3.57it/s]
 30%|███       | 112253/371472 [8:55:33<20:58:41,  3.43it/s]
 30%|███       | 112254/371472 [8:55:33<19:40:17,  3.66it/s]
 30%|███       | 112255/371472 [8:55:33<20:02:42,  3.59it/s]
 30%|███       | 112256/371472 [8:55:33<19:46:47,  3.64it/s]
 30%|███       | 112257/371472 [8:55:34<20:05:15,  3.58it/s]
 30%|███       | 112258/371472 [8:55:34<20:02:34,  3.59it/s]
 30%|███       | 112259/371472 [8:55:34<21:47:21,  3.30it/s]
 30%|███       | 112260/371472 [8:55:35<22:01:33,  3.27it/s]
                                                            
{'loss': 3.4642, 'learning_rate': 7.283554913917558e-07, 'epoch': 4.84}

 30%|███       | 112260/371472 [8:55:35<22:01:33,  3.27it/s]
 30%|███       | 112261/371472 [8:55:35<22:39:12,  3.18it/s]
 30%|███       | 112262/371472 [8:55:35<21:14:18,  3.39it/s]
 30%|███       | 112263/371472 [8:55:35<21:32:26,  3.34it/s]
 30%|███       | 112264/371472 [8:55:36<22:07:16,  3.25it/s]
 30%|███       | 112265/371472 [8:55:36<21:34:30,  3.34it/s]
 30%|███       | 112266/371472 [8:55:36<22:05:26,  3.26it/s]
 30%|███       | 112267/371472 [8:55:37<23:24:56,  3.07it/s]
 30%|███       | 112268/371472 [8:55:37<22:30:51,  3.20it/s]
 30%|███       | 112269/371472 [8:55:37<21:19:31,  3.38it/s]
 30%|███       | 112270/371472 [8:55:38<21:16:57,  3.38it/s]
 30%|███       | 112271/371472 [8:55:38<22:55:51,  3.14it/s]
 30%|███       | 112272/371472 [8:55:38<22:02:07,  3.27it/s]
 30%|███       | 112273/371472 [8:55:39<21:31:39,  3.34it/s]
 30%|███       | 112274/371472 [8:55:39<20:28:00,  3.52it/s]
 30%|███       | 112275/371472 [8:55:39<20:20:20,  3.54it/s]
 30%|███       | 112276/371472 [8:55:39<20:53:43,  3.45it/s]
 30%|███       | 112277/371472 [8:55:40<20:31:58,  3.51it/s]
 30%|███       | 112278/371472 [8:55:40<20:12:31,  3.56it/s]
 30%|███       | 112279/371472 [8:55:40<19:38:25,  3.67it/s]
 30%|███       | 112280/371472 [8:55:40<19:38:42,  3.66it/s]
                                                            
{'loss': 3.3543, 'learning_rate': 7.28307009416277e-07, 'epoch': 4.84}

 30%|███       | 112280/371472 [8:55:40<19:38:42,  3.66it/s]
 30%|███       | 112281/371472 [8:55:41<18:58:53,  3.79it/s]
 30%|███       | 112282/371472 [8:55:41<19:01:36,  3.78it/s]
 30%|███       | 112283/371472 [8:55:41<21:05:08,  3.41it/s]
 30%|███       | 112284/371472 [8:55:42<20:37:15,  3.49it/s]
 30%|███       | 112285/371472 [8:55:42<19:41:05,  3.66it/s]
 30%|███       | 112286/371472 [8:55:42<20:25:26,  3.53it/s]
 30%|███       | 112287/371472 [8:55:42<20:21:14,  3.54it/s]
 30%|███       | 112288/371472 [8:55:43<20:25:25,  3.53it/s]
 30%|███       | 112289/371472 [8:55:43<19:56:12,  3.61it/s]
 30%|███       | 112290/371472 [8:55:43<19:24:10,  3.71it/s]
 30%|███       | 112291/371472 [8:55:44<21:56:53,  3.28it/s]
 30%|███       | 112292/371472 [8:55:44<21:43:17,  3.31it/s]
 30%|███       | 112293/371472 [8:55:44<20:51:26,  3.45it/s]
 30%|███       | 112294/371472 [8:55:44<20:30:09,  3.51it/s]
 30%|███       | 112295/371472 [8:55:45<20:33:21,  3.50it/s]
 30%|███       | 112296/371472 [8:55:45<20:24:03,  3.53it/s]
 30%|███       | 112297/371472 [8:55:45<21:03:09,  3.42it/s]
 30%|███       | 112298/371472 [8:55:46<21:07:36,  3.41it/s]
 30%|███       | 112299/371472 [8:55:46<20:22:25,  3.53it/s]
 30%|███       | 112300/371472 [8:55:46<20:40:37,  3.48it/s]
                                                            
{'loss': 3.3695, 'learning_rate': 7.282585274407982e-07, 'epoch': 4.84}

 30%|███       | 112300/371472 [8:55:46<20:40:37,  3.48it/s]
 30%|███       | 112301/371472 [8:55:46<21:19:49,  3.38it/s]
 30%|███       | 112302/371472 [8:55:47<22:05:21,  3.26it/s]
 30%|███       | 112303/371472 [8:55:47<21:22:17,  3.37it/s]
 30%|███       | 112304/371472 [8:55:47<20:39:57,  3.48it/s]
 30%|███       | 112305/371472 [8:55:48<19:37:20,  3.67it/s]
 30%|███       | 112306/371472 [8:55:48<19:06:36,  3.77it/s]
 30%|███       | 112307/371472 [8:55:48<21:32:55,  3.34it/s]
 30%|███       | 112308/371472 [8:55:49<22:43:52,  3.17it/s]
 30%|███       | 112309/371472 [8:55:49<22:12:07,  3.24it/s]
 30%|███       | 112310/371472 [8:55:49<20:54:38,  3.44it/s]
 30%|███       | 112311/371472 [8:55:49<20:10:15,  3.57it/s]
 30%|███       | 112312/371472 [8:55:50<19:54:57,  3.61it/s]
 30%|███       | 112313/371472 [8:55:50<20:06:07,  3.58it/s]
 30%|███       | 112314/371472 [8:55:50<20:15:41,  3.55it/s]
 30%|███       | 112315/371472 [8:55:50<19:53:18,  3.62it/s]
 30%|███       | 112316/371472 [8:55:51<20:02:20,  3.59it/s]
 30%|███       | 112317/371472 [8:55:51<21:54:44,  3.29it/s]
 30%|███       | 112318/371472 [8:55:51<21:56:29,  3.28it/s]
 30%|███       | 112319/371472 [8:55:52<20:29:58,  3.51it/s]
 30%|███       | 112320/371472 [8:55:52<20:43:22,  3.47it/s]
                                                            
{'loss': 3.4284, 'learning_rate': 7.282100454653192e-07, 'epoch': 4.84}

 30%|███       | 112320/371472 [8:55:52<20:43:22,  3.47it/s]
 30%|███       | 112321/371472 [8:55:52<21:21:19,  3.37it/s]
 30%|███       | 112322/371472 [8:55:53<20:34:55,  3.50it/s]
 30%|███       | 112323/371472 [8:55:53<20:24:58,  3.53it/s]
 30%|███       | 112324/371472 [8:55:53<20:32:27,  3.50it/s]
 30%|███       | 112325/371472 [8:55:53<19:47:48,  3.64it/s]
 30%|███       | 112326/371472 [8:55:54<23:34:10,  3.05it/s]
 30%|███       | 112327/371472 [8:55:54<23:33:52,  3.05it/s]
 30%|███       | 112328/371472 [8:55:54<23:34:39,  3.05it/s]
 30%|███       | 112329/371472 [8:55:55<21:56:22,  3.28it/s]
 30%|███       | 112330/371472 [8:55:55<22:00:40,  3.27it/s]
 30%|███       | 112331/371472 [8:55:55<21:30:01,  3.35it/s]
 30%|███       | 112332/371472 [8:55:56<20:42:07,  3.48it/s]
 30%|███       | 112333/371472 [8:55:56<21:49:29,  3.30it/s]
 30%|███       | 112334/371472 [8:55:56<20:58:53,  3.43it/s]
 30%|███       | 112335/371472 [8:55:56<19:53:18,  3.62it/s]
 30%|███       | 112336/371472 [8:55:57<19:52:03,  3.62it/s]
 30%|███       | 112337/371472 [8:55:57<20:10:28,  3.57it/s]
 30%|███       | 112338/371472 [8:55:57<20:17:29,  3.55it/s]
 30%|███       | 112339/371472 [8:55:58<20:13:20,  3.56it/s]
 30%|███       | 112340/371472 [8:55:58<19:27:56,  3.70it/s]
                                                            
{'loss': 3.3576, 'learning_rate': 7.281615634898403e-07, 'epoch': 4.84}

 30%|███       | 112340/371472 [8:55:58<19:27:56,  3.70it/s]
 30%|███       | 112341/371472 [8:55:58<19:07:23,  3.76it/s]
 30%|███       | 112342/371472 [8:55:58<20:19:50,  3.54it/s]
 30%|███       | 112343/371472 [8:55:59<19:35:21,  3.67it/s]
 30%|███       | 112344/371472 [8:55:59<19:15:35,  3.74it/s]
 30%|███       | 112345/371472 [8:55:59<19:41:46,  3.65it/s]
 30%|███       | 112346/371472 [8:55:59<18:57:22,  3.80it/s]
 30%|███       | 112347/371472 [8:56:00<19:30:42,  3.69it/s]
 30%|███       | 112348/371472 [8:56:00<19:28:44,  3.70it/s]
 30%|███       | 112349/371472 [8:56:00<19:48:20,  3.63it/s]
 30%|███       | 112350/371472 [8:56:01<21:15:24,  3.39it/s]
 30%|███       | 112351/371472 [8:56:01<20:14:14,  3.56it/s]
 30%|███       | 112352/371472 [8:56:01<21:06:28,  3.41it/s]
 30%|███       | 112353/371472 [8:56:01<21:27:46,  3.35it/s]
 30%|███       | 112354/371472 [8:56:02<20:10:45,  3.57it/s]
 30%|███       | 112355/371472 [8:56:02<19:47:25,  3.64it/s]
 30%|███       | 112356/371472 [8:56:02<19:41:16,  3.66it/s]
 30%|███       | 112357/371472 [8:56:02<20:10:16,  3.57it/s]
 30%|███       | 112358/371472 [8:56:03<19:51:05,  3.63it/s]
 30%|███       | 112359/371472 [8:56:03<19:22:28,  3.71it/s]
 30%|███       | 112360/371472 [8:56:03<21:10:53,  3.40it/s]
                                                            
{'loss': 3.4828, 'learning_rate': 7.281130815143614e-07, 'epoch': 4.84}

 30%|███       | 112360/371472 [8:56:03<21:10:53,  3.40it/s]
 30%|███       | 112361/371472 [8:56:04<24:21:21,  2.96it/s]
 30%|███       | 112362/371472 [8:56:04<26:35:02,  2.71it/s]
 30%|███       | 112363/371472 [8:56:04<23:55:50,  3.01it/s]
 30%|███       | 112364/371472 [8:56:05<21:52:56,  3.29it/s]
 30%|███       | 112365/371472 [8:56:05<21:35:41,  3.33it/s]
 30%|███       | 112366/371472 [8:56:05<20:22:26,  3.53it/s]
 30%|███       | 112367/371472 [8:56:06<21:30:17,  3.35it/s]
 30%|███       | 112368/371472 [8:56:06<20:30:00,  3.51it/s]
 30%|███       | 112369/371472 [8:56:06<19:49:31,  3.63it/s]
 30%|███       | 112370/371472 [8:56:06<20:18:28,  3.54it/s]
 30%|███       | 112371/371472 [8:56:07<19:22:39,  3.71it/s]
 30%|███       | 112372/371472 [8:56:07<20:15:40,  3.55it/s]
 30%|███       | 112373/371472 [8:56:07<19:37:35,  3.67it/s]
 30%|███       | 112374/371472 [8:56:07<18:52:06,  3.81it/s]
 30%|███       | 112375/371472 [8:56:08<18:52:07,  3.81it/s]
 30%|███       | 112376/371472 [8:56:08<18:55:07,  3.80it/s]
 30%|███       | 112377/371472 [8:56:08<19:27:45,  3.70it/s]
 30%|███       | 112378/371472 [8:56:09<18:56:14,  3.80it/s]
 30%|███       | 112379/371472 [8:56:09<18:43:37,  3.84it/s]
 30%|███       | 112380/371472 [8:56:09<18:55:58,  3.80it/s]
                                                            
{'loss': 3.4506, 'learning_rate': 7.280645995388825e-07, 'epoch': 4.84}

 30%|███       | 112380/371472 [8:56:09<18:55:58,  3.80it/s]
 30%|███       | 112381/371472 [8:56:09<18:35:25,  3.87it/s]
 30%|███       | 112382/371472 [8:56:10<19:15:56,  3.74it/s]
 30%|███       | 112383/371472 [8:56:10<19:29:42,  3.69it/s]
 30%|███       | 112384/371472 [8:56:10<20:08:51,  3.57it/s]
 30%|███       | 112385/371472 [8:56:10<20:21:11,  3.54it/s]
 30%|███       | 112386/371472 [8:56:11<19:53:22,  3.62it/s]
 30%|███       | 112387/371472 [8:56:11<19:29:43,  3.69it/s]
 30%|███       | 112388/371472 [8:56:11<20:31:35,  3.51it/s]
 30%|███       | 112389/371472 [8:56:12<22:14:51,  3.23it/s]
 30%|███       | 112390/371472 [8:56:12<20:56:49,  3.44it/s]
 30%|███       | 112391/371472 [8:56:12<19:53:56,  3.62it/s]
 30%|███       | 112392/371472 [8:56:12<20:27:10,  3.52it/s]
 30%|███       | 112393/371472 [8:56:13<21:36:46,  3.33it/s]
 30%|███       | 112394/371472 [8:56:13<20:33:17,  3.50it/s]
 30%|███       | 112395/371472 [8:56:13<21:26:53,  3.36it/s]
 30%|███       | 112396/371472 [8:56:14<21:19:15,  3.38it/s]
 30%|███       | 112397/371472 [8:56:14<21:08:18,  3.40it/s]
 30%|███       | 112398/371472 [8:56:14<20:01:16,  3.59it/s]
 30%|███       | 112399/371472 [8:56:14<20:49:33,  3.46it/s]
 30%|███       | 112400/371472 [8:56:15<21:12:01,  3.39it/s]
                                                            
{'loss': 3.2465, 'learning_rate': 7.280161175634036e-07, 'epoch': 4.84}

 30%|███       | 112400/371472 [8:56:15<21:12:01,  3.39it/s]
 30%|███       | 112401/371472 [8:56:15<21:50:15,  3.30it/s]
 30%|███       | 112402/371472 [8:56:15<21:50:53,  3.29it/s]
 30%|███       | 112403/371472 [8:56:16<20:49:10,  3.46it/s]
 30%|███       | 112404/371472 [8:56:16<19:48:40,  3.63it/s]
 30%|███       | 112405/371472 [8:56:16<19:52:49,  3.62it/s]
 30%|███       | 112406/371472 [8:56:16<19:54:27,  3.61it/s]
 30%|███       | 112407/371472 [8:56:17<20:03:58,  3.59it/s]
 30%|███       | 112408/371472 [8:56:17<19:57:51,  3.60it/s]
 30%|███       | 112409/371472 [8:56:17<19:29:37,  3.69it/s]
 30%|███       | 112410/371472 [8:56:18<20:38:16,  3.49it/s]
 30%|███       | 112411/371472 [8:56:18<19:57:49,  3.60it/s]
 30%|███       | 112412/371472 [8:56:18<20:32:30,  3.50it/s]
 30%|███       | 112413/371472 [8:56:18<20:00:48,  3.60it/s]
 30%|███       | 112414/371472 [8:56:19<20:08:00,  3.57it/s]
 30%|███       | 112415/371472 [8:56:19<20:14:11,  3.56it/s]
 30%|███       | 112416/371472 [8:56:19<20:12:57,  3.56it/s]
 30%|███       | 112417/371472 [8:56:20<21:14:15,  3.39it/s]
 30%|███       | 112418/371472 [8:56:20<20:32:05,  3.50it/s]
 30%|███       | 112419/371472 [8:56:20<20:58:47,  3.43it/s]
 30%|███       | 112420/371472 [8:56:20<20:51:07,  3.45it/s]
                                                            
{'loss': 3.4101, 'learning_rate': 7.279676355879247e-07, 'epoch': 4.84}

 30%|███       | 112420/371472 [8:56:20<20:51:07,  3.45it/s]
 30%|███       | 112421/371472 [8:56:21<21:11:01,  3.40it/s]
 30%|███       | 112422/371472 [8:56:21<21:09:01,  3.40it/s]
 30%|███       | 112423/371472 [8:56:21<20:15:14,  3.55it/s]
 30%|███       | 112424/371472 [8:56:22<19:59:54,  3.60it/s]
 30%|███       | 112425/371472 [8:56:22<19:58:30,  3.60it/s]
 30%|███       | 112426/371472 [8:56:22<20:41:06,  3.48it/s]
 30%|███       | 112427/371472 [8:56:22<21:30:22,  3.35it/s]
 30%|███       | 112428/371472 [8:56:23<20:45:36,  3.47it/s]
 30%|███       | 112429/371472 [8:56:23<20:41:46,  3.48it/s]
 30%|███       | 112430/371472 [8:56:23<20:01:06,  3.59it/s]
 30%|███       | 112431/371472 [8:56:24<19:30:00,  3.69it/s]
 30%|███       | 112432/371472 [8:56:24<19:52:27,  3.62it/s]
 30%|███       | 112433/371472 [8:56:24<20:36:25,  3.49it/s]
 30%|███       | 112434/371472 [8:56:24<21:06:01,  3.41it/s]
 30%|███       | 112435/371472 [8:56:25<20:51:18,  3.45it/s]
 30%|███       | 112436/371472 [8:56:25<20:20:08,  3.54it/s]
 30%|███       | 112437/371472 [8:56:25<19:54:36,  3.61it/s]
 30%|███       | 112438/371472 [8:56:26<19:28:47,  3.69it/s]
 30%|███       | 112439/371472 [8:56:26<19:57:14,  3.61it/s]
 30%|███       | 112440/371472 [8:56:26<21:35:02,  3.33it/s]
                                                            
{'loss': 3.4494, 'learning_rate': 7.279191536124459e-07, 'epoch': 4.84}

 30%|███       | 112440/371472 [8:56:26<21:35:02,  3.33it/s]
 30%|███       | 112441/371472 [8:56:26<20:41:32,  3.48it/s]
 30%|███       | 112442/371472 [8:56:27<19:36:25,  3.67it/s]
 30%|███       | 112443/371472 [8:56:27<20:08:01,  3.57it/s]
 30%|███       | 112444/371472 [8:56:27<19:45:46,  3.64it/s]
 30%|███       | 112445/371472 [8:56:27<19:19:45,  3.72it/s]
 30%|███       | 112446/371472 [8:56:28<18:53:28,  3.81it/s]
 30%|███       | 112447/371472 [8:56:28<18:26:40,  3.90it/s]
 30%|███       | 112448/371472 [8:56:28<19:23:59,  3.71it/s]
 30%|███       | 112449/371472 [8:56:29<19:57:59,  3.60it/s]
 30%|███       | 112450/371472 [8:56:29<19:39:50,  3.66it/s]
 30%|███       | 112451/371472 [8:56:29<20:34:22,  3.50it/s]
 30%|███       | 112452/371472 [8:56:29<21:16:00,  3.38it/s]
 30%|███       | 112453/371472 [8:56:30<22:13:09,  3.24it/s]
 30%|███       | 112454/371472 [8:56:30<21:16:53,  3.38it/s]
 30%|███       | 112455/371472 [8:56:30<21:08:42,  3.40it/s]
 30%|███       | 112456/371472 [8:56:31<22:07:23,  3.25it/s]
 30%|███       | 112457/371472 [8:56:31<22:54:20,  3.14it/s]
 30%|███       | 112458/371472 [8:56:31<22:51:46,  3.15it/s]
 30%|███       | 112459/371472 [8:56:32<22:22:33,  3.22it/s]
 30%|███       | 112460/371472 [8:56:32<22:21:33,  3.22it/s]
                                                            
{'loss': 3.6476, 'learning_rate': 7.27870671636967e-07, 'epoch': 4.84}

 30%|███       | 112460/371472 [8:56:32<22:21:33,  3.22it/s]
 30%|███       | 112461/371472 [8:56:32<21:30:34,  3.34it/s]
 30%|███       | 112462/371472 [8:56:32<20:27:11,  3.52it/s]
 30%|███       | 112463/371472 [8:56:33<20:06:31,  3.58it/s]
 30%|███       | 112464/371472 [8:56:33<20:18:39,  3.54it/s]
 30%|███       | 112465/371472 [8:56:33<19:48:27,  3.63it/s]
 30%|███       | 112466/371472 [8:56:34<20:46:41,  3.46it/s]
 30%|███       | 112467/371472 [8:56:34<21:36:06,  3.33it/s]
 30%|███       | 112468/371472 [8:56:34<20:24:23,  3.53it/s]
 30%|███       | 112469/371472 [8:56:34<19:54:08,  3.61it/s]
 30%|███       | 112470/371472 [8:56:35<19:37:37,  3.67it/s]
 30%|███       | 112471/371472 [8:56:35<19:37:35,  3.67it/s]
 30%|███       | 112472/371472 [8:56:35<19:25:38,  3.70it/s]
 30%|███       | 112473/371472 [8:56:36<19:40:46,  3.66it/s]
 30%|███       | 112474/371472 [8:56:36<20:11:08,  3.56it/s]
 30%|███       | 112475/371472 [8:56:36<20:51:15,  3.45it/s]
 30%|███       | 112476/371472 [8:56:36<21:04:15,  3.41it/s]
 30%|███       | 112477/371472 [8:56:37<20:03:38,  3.59it/s]
 30%|███       | 112478/371472 [8:56:37<21:00:53,  3.42it/s]
 30%|███       | 112479/371472 [8:56:37<20:52:23,  3.45it/s]
 30%|███       | 112480/371472 [8:56:38<20:20:37,  3.54it/s]
                                                            
{'loss': 3.1845, 'learning_rate': 7.27822189661488e-07, 'epoch': 4.84}

 30%|███       | 112480/371472 [8:56:38<20:20:37,  3.54it/s]
 30%|███       | 112481/371472 [8:56:38<19:54:40,  3.61it/s]
 30%|███       | 112482/371472 [8:56:38<20:43:05,  3.47it/s]
 30%|███       | 112483/371472 [8:56:38<21:52:09,  3.29it/s]
 30%|███       | 112484/371472 [8:56:39<21:33:06,  3.34it/s]
 30%|███       | 112485/371472 [8:56:39<21:41:29,  3.32it/s]
 30%|███       | 112486/371472 [8:56:39<21:24:56,  3.36it/s]
 30%|███       | 112487/371472 [8:56:40<22:16:22,  3.23it/s]
 30%|███       | 112488/371472 [8:56:40<21:17:24,  3.38it/s]
 30%|███       | 112489/371472 [8:56:40<22:42:38,  3.17it/s]
 30%|███       | 112490/371472 [8:56:41<21:28:32,  3.35it/s]
 30%|███       | 112491/371472 [8:56:41<20:20:39,  3.54it/s]
 30%|███       | 112492/371472 [8:56:41<20:30:49,  3.51it/s]
 30%|███       | 112493/371472 [8:56:41<20:21:57,  3.53it/s]
 30%|███       | 112494/371472 [8:56:42<22:04:55,  3.26it/s]
 30%|███       | 112495/371472 [8:56:42<21:18:01,  3.38it/s]
 30%|███       | 112496/371472 [8:56:42<21:21:18,  3.37it/s]
 30%|███       | 112497/371472 [8:56:43<20:41:32,  3.48it/s]
 30%|███       | 112498/371472 [8:56:43<20:08:39,  3.57it/s]
 30%|███       | 112499/371472 [8:56:43<20:29:44,  3.51it/s]
 30%|███       | 112500/371472 [8:56:43<20:37:49,  3.49it/s]
                                                            
{'loss': 3.324, 'learning_rate': 7.277737076860091e-07, 'epoch': 4.85}

 30%|███       | 112500/371472 [8:56:43<20:37:49,  3.49it/s]
 30%|███       | 112501/371472 [8:56:44<20:36:54,  3.49it/s]
 30%|███       | 112502/371472 [8:56:44<19:50:01,  3.63it/s]
 30%|███       | 112503/371472 [8:56:44<20:46:40,  3.46it/s]
 30%|███       | 112504/371472 [8:56:45<20:33:48,  3.50it/s]
 30%|███       | 112505/371472 [8:56:45<20:48:55,  3.46it/s]
 30%|███       | 112506/371472 [8:56:45<19:57:36,  3.60it/s]
 30%|███       | 112507/371472 [8:56:45<19:40:46,  3.66it/s]
 30%|███       | 112508/371472 [8:56:46<19:41:55,  3.65it/s]
 30%|███       | 112509/371472 [8:56:46<19:04:18,  3.77it/s]
 30%|███       | 112510/371472 [8:56:46<19:13:32,  3.74it/s]
 30%|███       | 112511/371472 [8:56:46<18:59:52,  3.79it/s]
 30%|███       | 112512/371472 [8:56:47<19:01:44,  3.78it/s]
 30%|███       | 112513/371472 [8:56:47<18:35:38,  3.87it/s]
 30%|███       | 112514/371472 [8:56:47<19:53:54,  3.61it/s]
 30%|███       | 112515/371472 [8:56:48<19:45:05,  3.64it/s]
 30%|███       | 112516/371472 [8:56:48<19:38:36,  3.66it/s]
 30%|███       | 112517/371472 [8:56:48<19:30:15,  3.69it/s]
 30%|███       | 112518/371472 [8:56:48<19:59:02,  3.60it/s]
 30%|███       | 112519/371472 [8:56:49<20:21:59,  3.53it/s]
 30%|███       | 112520/371472 [8:56:49<20:24:40,  3.52it/s]
                                                            
{'loss': 3.3586, 'learning_rate': 7.277252257105303e-07, 'epoch': 4.85}

 30%|███       | 112520/371472 [8:56:49<20:24:40,  3.52it/s]
 30%|███       | 112521/371472 [8:56:49<20:48:45,  3.46it/s]
 30%|███       | 112522/371472 [8:56:50<20:29:17,  3.51it/s]
 30%|███       | 112523/371472 [8:56:50<20:00:03,  3.60it/s]
 30%|███       | 112524/371472 [8:56:50<19:36:46,  3.67it/s]
 30%|███       | 112525/371472 [8:56:50<20:13:09,  3.56it/s]
 30%|███       | 112526/371472 [8:56:51<19:51:03,  3.62it/s]
 30%|███       | 112527/371472 [8:56:51<20:18:54,  3.54it/s]
 30%|███       | 112528/371472 [8:56:51<19:57:24,  3.60it/s]
 30%|███       | 112529/371472 [8:56:52<21:31:39,  3.34it/s]
 30%|███       | 112530/371472 [8:56:52<21:22:39,  3.36it/s]
 30%|███       | 112531/371472 [8:56:52<21:22:57,  3.36it/s]
 30%|███       | 112532/371472 [8:56:52<21:23:03,  3.36it/s]
 30%|███       | 112533/371472 [8:56:53<20:49:11,  3.45it/s]
 30%|███       | 112534/371472 [8:56:53<20:38:43,  3.48it/s]
 30%|███       | 112535/371472 [8:56:53<20:50:15,  3.45it/s]
 30%|███       | 112536/371472 [8:56:54<20:30:33,  3.51it/s]
 30%|███       | 112537/371472 [8:56:54<20:24:34,  3.52it/s]
 30%|███       | 112538/371472 [8:56:54<21:33:14,  3.34it/s]
 30%|███       | 112539/371472 [8:56:54<20:53:20,  3.44it/s]
 30%|███       | 112540/371472 [8:56:55<22:19:31,  3.22it/s]
                                                            
{'loss': 3.4245, 'learning_rate': 7.276767437350512e-07, 'epoch': 4.85}

 30%|███       | 112540/371472 [8:56:55<22:19:31,  3.22it/s]
 30%|███       | 112541/371472 [8:56:55<22:55:23,  3.14it/s]
 30%|███       | 112542/371472 [8:56:55<22:26:24,  3.21it/s]
 30%|███       | 112543/371472 [8:56:56<21:09:23,  3.40it/s]
 30%|███       | 112544/371472 [8:56:56<22:11:01,  3.24it/s]
 30%|███       | 112545/371472 [8:56:56<21:57:49,  3.27it/s]
 30%|███       | 112546/371472 [8:56:57<21:56:46,  3.28it/s]
 30%|███       | 112547/371472 [8:56:57<21:49:29,  3.30it/s]
 30%|███       | 112548/371472 [8:56:57<21:11:59,  3.39it/s]
 30%|███       | 112549/371472 [8:56:58<21:37:04,  3.33it/s]
 30%|███       | 112550/371472 [8:56:58<20:39:25,  3.48it/s]
 30%|███       | 112551/371472 [8:56:58<21:39:18,  3.32it/s]
 30%|███       | 112552/371472 [8:56:58<21:06:38,  3.41it/s]
 30%|███       | 112553/371472 [8:56:59<20:26:05,  3.52it/s]
 30%|███       | 112554/371472 [8:56:59<19:33:01,  3.68it/s]
 30%|███       | 112555/371472 [8:56:59<20:36:24,  3.49it/s]
 30%|███       | 112556/371472 [8:56:59<20:23:42,  3.53it/s]
 30%|███       | 112557/371472 [8:57:00<20:03:20,  3.59it/s]
 30%|███       | 112558/371472 [8:57:00<19:06:46,  3.76it/s]
 30%|███       | 112559/371472 [8:57:00<19:10:54,  3.75it/s]
 30%|███       | 112560/371472 [8:57:01<19:04:19,  3.77it/s]
                                                            
{'loss': 3.3284, 'learning_rate': 7.276282617595724e-07, 'epoch': 4.85}

 30%|███       | 112560/371472 [8:57:01<19:04:19,  3.77it/s]
 30%|███       | 112561/371472 [8:57:01<18:38:09,  3.86it/s]
 30%|███       | 112562/371472 [8:57:01<19:26:00,  3.70it/s]
 30%|███       | 112563/371472 [8:57:01<19:05:59,  3.77it/s]
 30%|███       | 112564/371472 [8:57:02<18:57:52,  3.79it/s]
 30%|███       | 112565/371472 [8:57:02<19:38:09,  3.66it/s]
 30%|███       | 112566/371472 [8:57:02<19:35:50,  3.67it/s]
 30%|███       | 112567/371472 [8:57:02<19:27:09,  3.70it/s]
 30%|███       | 112568/371472 [8:57:03<19:22:36,  3.71it/s]
 30%|███       | 112569/371472 [8:57:03<20:21:23,  3.53it/s]
 30%|███       | 112570/371472 [8:57:03<19:47:35,  3.63it/s]
 30%|███       | 112571/371472 [8:57:04<19:33:22,  3.68it/s]
 30%|███       | 112572/371472 [8:57:04<19:39:03,  3.66it/s]
 30%|███       | 112573/371472 [8:57:04<19:44:33,  3.64it/s]
 30%|███       | 112574/371472 [8:57:04<19:43:02,  3.65it/s]
 30%|███       | 112575/371472 [8:57:05<19:49:50,  3.63it/s]
 30%|███       | 112576/371472 [8:57:05<19:37:26,  3.66it/s]
 30%|███       | 112577/371472 [8:57:05<19:45:56,  3.64it/s]
 30%|███       | 112578/371472 [8:57:05<19:27:31,  3.70it/s]
 30%|███       | 112579/371472 [8:57:06<20:22:18,  3.53it/s]
 30%|███       | 112580/371472 [8:57:06<20:35:57,  3.49it/s]
                                                            
{'loss': 3.291, 'learning_rate': 7.275797797840936e-07, 'epoch': 4.85}

 30%|███       | 112580/371472 [8:57:06<20:35:57,  3.49it/s]
 30%|███       | 112581/371472 [8:57:06<21:03:46,  3.41it/s]
 30%|███       | 112582/371472 [8:57:07<21:29:07,  3.35it/s]
 30%|███       | 112583/371472 [8:57:07<21:11:41,  3.39it/s]
 30%|███       | 112584/371472 [8:57:07<20:21:42,  3.53it/s]
 30%|███       | 112585/371472 [8:57:07<20:42:10,  3.47it/s]
 30%|███       | 112586/371472 [8:57:08<20:30:29,  3.51it/s]
 30%|███       | 112587/371472 [8:57:08<20:28:33,  3.51it/s]
 30%|███       | 112588/371472 [8:57:08<20:13:46,  3.55it/s]
 30%|███       | 112589/371472 [8:57:09<19:55:10,  3.61it/s]
 30%|███       | 112590/371472 [8:57:09<20:26:46,  3.52it/s]
 30%|███       | 112591/371472 [8:57:09<19:44:12,  3.64it/s]
 30%|███       | 112592/371472 [8:57:09<19:49:33,  3.63it/s]
 30%|███       | 112593/371472 [8:57:10<19:21:01,  3.72it/s]
 30%|███       | 112594/371472 [8:57:10<19:39:27,  3.66it/s]
 30%|███       | 112595/371472 [8:57:10<19:57:34,  3.60it/s]
 30%|███       | 112596/371472 [8:57:11<20:01:31,  3.59it/s]
 30%|███       | 112597/371472 [8:57:11<20:24:44,  3.52it/s]
 30%|███       | 112598/371472 [8:57:11<20:23:07,  3.53it/s]
 30%|███       | 112599/371472 [8:57:11<22:46:16,  3.16it/s]
 30%|███       | 112600/371472 [8:57:12<21:49:15,  3.30it/s]
                                                            
{'loss': 3.4461, 'learning_rate': 7.275312978086148e-07, 'epoch': 4.85}

 30%|███       | 112600/371472 [8:57:12<21:49:15,  3.30it/s]
 30%|███       | 112601/371472 [8:57:12<21:55:38,  3.28it/s]
 30%|███       | 112602/371472 [8:57:12<23:02:20,  3.12it/s]
 30%|███       | 112603/371472 [8:57:13<22:36:16,  3.18it/s]
 30%|███       | 112604/371472 [8:57:13<21:28:33,  3.35it/s]
 30%|███       | 112605/371472 [8:57:13<21:17:55,  3.38it/s]
 30%|███       | 112606/371472 [8:57:14<20:20:40,  3.53it/s]
 30%|███       | 112607/371472 [8:57:14<20:11:07,  3.56it/s]
 30%|███       | 112608/371472 [8:57:14<19:59:13,  3.60it/s]
 30%|███       | 112609/371472 [8:57:14<20:02:43,  3.59it/s]
 30%|███       | 112610/371472 [8:57:15<19:34:27,  3.67it/s]
 30%|███       | 112611/371472 [8:57:15<20:19:58,  3.54it/s]
 30%|███       | 112612/371472 [8:57:15<20:13:19,  3.56it/s]
 30%|███       | 112613/371472 [8:57:15<19:57:25,  3.60it/s]
 30%|███       | 112614/371472 [8:57:16<21:00:20,  3.42it/s]
 30%|███       | 112615/371472 [8:57:16<21:28:41,  3.35it/s]
 30%|███       | 112616/371472 [8:57:16<20:40:36,  3.48it/s]
 30%|███       | 112617/371472 [8:57:17<19:49:39,  3.63it/s]
 30%|███       | 112618/371472 [8:57:17<19:41:39,  3.65it/s]
 30%|███       | 112619/371472 [8:57:17<18:58:14,  3.79it/s]
 30%|███       | 112620/371472 [8:57:17<18:47:29,  3.83it/s]
                                                            
{'loss': 3.4262, 'learning_rate': 7.274828158331357e-07, 'epoch': 4.85}

 30%|███       | 112620/371472 [8:57:17<18:47:29,  3.83it/s]
 30%|███       | 112621/371472 [8:57:18<20:17:28,  3.54it/s]
 30%|███       | 112622/371472 [8:57:18<20:17:18,  3.54it/s]
 30%|███       | 112623/371472 [8:57:18<21:44:04,  3.31it/s]
 30%|███       | 112624/371472 [8:57:19<21:04:06,  3.41it/s]
 30%|███       | 112625/371472 [8:57:19<21:31:41,  3.34it/s]
 30%|███       | 112626/371472 [8:57:19<20:29:38,  3.51it/s]
 30%|███       | 112627/371472 [8:57:19<20:14:15,  3.55it/s]
 30%|███       | 112628/371472 [8:57:20<19:20:27,  3.72it/s]
 30%|███       | 112629/371472 [8:57:20<19:22:07,  3.71it/s]
 30%|███       | 112630/371472 [8:57:20<21:07:03,  3.40it/s]
 30%|███       | 112631/371472 [8:57:21<21:51:59,  3.29it/s]
 30%|███       | 112632/371472 [8:57:21<20:58:35,  3.43it/s]
 30%|███       | 112633/371472 [8:57:21<22:07:56,  3.25it/s]
 30%|███       | 112634/371472 [8:57:22<21:02:09,  3.42it/s]
 30%|███       | 112635/371472 [8:57:22<20:53:24,  3.44it/s]
 30%|███       | 112636/371472 [8:57:22<21:39:11,  3.32it/s]
 30%|███       | 112637/371472 [8:57:22<20:48:33,  3.46it/s]
 30%|███       | 112638/371472 [8:57:23<20:56:49,  3.43it/s]
 30%|███       | 112639/371472 [8:57:23<20:11:26,  3.56it/s]
 30%|███       | 112640/371472 [8:57:23<20:23:17,  3.53it/s]
                                                            
{'loss': 3.3892, 'learning_rate': 7.274343338576568e-07, 'epoch': 4.85}

 30%|███       | 112640/371472 [8:57:23<20:23:17,  3.53it/s]
 30%|███       | 112641/371472 [8:57:24<20:35:38,  3.49it/s]
 30%|███       | 112642/371472 [8:57:24<20:19:13,  3.54it/s]
 30%|███       | 112643/371472 [8:57:24<20:09:31,  3.57it/s]
 30%|███       | 112644/371472 [8:57:24<20:33:02,  3.50it/s]
 30%|███       | 112645/371472 [8:57:25<20:33:34,  3.50it/s]
 30%|███       | 112646/371472 [8:57:25<22:37:35,  3.18it/s]
 30%|███       | 112647/371472 [8:57:25<21:22:41,  3.36it/s]
 30%|███       | 112648/371472 [8:57:26<20:46:12,  3.46it/s]
 30%|███       | 112649/371472 [8:57:26<20:27:04,  3.52it/s]
 30%|███       | 112650/371472 [8:57:26<20:22:37,  3.53it/s]
 30%|███       | 112651/371472 [8:57:26<19:59:36,  3.60it/s]
 30%|███       | 112652/371472 [8:57:27<21:15:14,  3.38it/s]
 30%|███       | 112653/371472 [8:57:27<21:45:51,  3.30it/s]
 30%|███       | 112654/371472 [8:57:27<21:04:25,  3.41it/s]
 30%|███       | 112655/371472 [8:57:28<20:25:21,  3.52it/s]
 30%|███       | 112656/371472 [8:57:28<19:55:27,  3.61it/s]
 30%|███       | 112657/371472 [8:57:28<19:56:19,  3.61it/s]
 30%|███       | 112658/371472 [8:57:28<20:32:52,  3.50it/s]
 30%|███       | 112659/371472 [8:57:29<20:50:41,  3.45it/s]
 30%|███       | 112660/371472 [8:57:29<20:17:50,  3.54it/s]
                                                            
{'loss': 3.3796, 'learning_rate': 7.27385851882178e-07, 'epoch': 4.85}

 30%|███       | 112660/371472 [8:57:29<20:17:50,  3.54it/s]
 30%|███       | 112661/371472 [8:57:29<19:51:03,  3.62it/s]
 30%|███       | 112662/371472 [8:57:30<21:40:50,  3.32it/s]
 30%|███       | 112663/371472 [8:57:30<20:51:01,  3.45it/s]
 30%|███       | 112664/371472 [8:57:30<20:37:35,  3.49it/s]
 30%|███       | 112665/371472 [8:57:30<20:15:58,  3.55it/s]
 30%|███       | 112666/371472 [8:57:31<20:28:39,  3.51it/s]
 30%|███       | 112667/371472 [8:57:31<21:25:56,  3.35it/s]
 30%|███       | 112668/371472 [8:57:31<20:20:45,  3.53it/s]
 30%|███       | 112669/371472 [8:57:32<21:13:32,  3.39it/s]
 30%|███       | 112670/371472 [8:57:32<20:22:42,  3.53it/s]
 30%|███       | 112671/371472 [8:57:32<21:22:44,  3.36it/s]
 30%|███       | 112672/371472 [8:57:32<21:06:30,  3.41it/s]
 30%|███       | 112673/371472 [8:57:33<22:04:46,  3.26it/s]
 30%|███       | 112674/371472 [8:57:33<21:33:11,  3.34it/s]
 30%|███       | 112675/371472 [8:57:33<21:07:00,  3.40it/s]
 30%|███       | 112676/371472 [8:57:34<20:58:22,  3.43it/s]
 30%|███       | 112677/371472 [8:57:34<20:47:45,  3.46it/s]
 30%|███       | 112678/371472 [8:57:34<20:47:09,  3.46it/s]
 30%|███       | 112679/371472 [8:57:35<20:37:53,  3.48it/s]
 30%|███       | 112680/371472 [8:57:35<20:05:32,  3.58it/s]
                                                            
{'loss': 3.3873, 'learning_rate': 7.273373699066992e-07, 'epoch': 4.85}

 30%|███       | 112680/371472 [8:57:35<20:05:32,  3.58it/s]
 30%|███       | 112681/371472 [8:57:35<19:56:06,  3.61it/s]
 30%|███       | 112682/371472 [8:57:35<21:12:26,  3.39it/s]
 30%|███       | 112683/371472 [8:57:36<21:20:26,  3.37it/s]
 30%|███       | 112684/371472 [8:57:36<20:50:49,  3.45it/s]
 30%|███       | 112685/371472 [8:57:36<21:32:42,  3.34it/s]
 30%|███       | 112686/371472 [8:57:37<21:13:53,  3.39it/s]
 30%|███       | 112687/371472 [8:57:37<21:02:17,  3.42it/s]
 30%|███       | 112688/371472 [8:57:37<21:11:31,  3.39it/s]
 30%|███       | 112689/371472 [8:57:37<21:08:16,  3.40it/s]
 30%|███       | 112690/371472 [8:57:38<20:39:19,  3.48it/s]
 30%|███       | 112691/371472 [8:57:38<21:06:12,  3.41it/s]
 30%|███       | 112692/371472 [8:57:38<21:24:59,  3.36it/s]
 30%|███       | 112693/371472 [8:57:39<20:32:34,  3.50it/s]
 30%|███       | 112694/371472 [8:57:39<20:35:18,  3.49it/s]
 30%|███       | 112695/371472 [8:57:39<21:02:47,  3.42it/s]
 30%|███       | 112696/371472 [8:57:39<21:11:01,  3.39it/s]
 30%|███       | 112697/371472 [8:57:40<20:41:42,  3.47it/s]
 30%|███       | 112698/371472 [8:57:40<20:10:35,  3.56it/s]
 30%|███       | 112699/371472 [8:57:40<20:03:22,  3.58it/s]
 30%|███       | 112700/371472 [8:57:41<20:05:48,  3.58it/s]
                                                            
{'loss': 3.3284, 'learning_rate': 7.272888879312202e-07, 'epoch': 4.85}

 30%|███       | 112700/371472 [8:57:41<20:05:48,  3.58it/s]
 30%|███       | 112701/371472 [8:57:41<19:30:51,  3.68it/s]
 30%|███       | 112702/371472 [8:57:41<20:39:30,  3.48it/s]
 30%|███       | 112703/371472 [8:57:41<20:01:01,  3.59it/s]
 30%|███       | 112704/371472 [8:57:42<22:23:20,  3.21it/s]
 30%|███       | 112705/371472 [8:57:42<20:58:14,  3.43it/s]
 30%|███       | 112706/371472 [8:57:42<21:29:40,  3.34it/s]
 30%|███       | 112707/371472 [8:57:43<23:05:34,  3.11it/s]
 30%|███       | 112708/371472 [8:57:43<22:41:16,  3.17it/s]
 30%|███       | 112709/371472 [8:57:43<22:22:52,  3.21it/s]
 30%|███       | 112710/371472 [8:57:44<21:39:27,  3.32it/s]
 30%|███       | 112711/371472 [8:57:44<20:49:49,  3.45it/s]
 30%|███       | 112712/371472 [8:57:44<19:44:43,  3.64it/s]
 30%|███       | 112713/371472 [8:57:44<19:04:43,  3.77it/s]
 30%|███       | 112714/371472 [8:57:45<19:19:44,  3.72it/s]
 30%|███       | 112715/371472 [8:57:45<18:55:53,  3.80it/s]
 30%|███       | 112716/371472 [8:57:45<19:05:24,  3.77it/s]
 30%|███       | 112717/371472 [8:57:45<19:41:35,  3.65it/s]
 30%|███       | 112718/371472 [8:57:46<19:22:34,  3.71it/s]
 30%|███       | 112719/371472 [8:57:46<19:11:08,  3.75it/s]
 30%|███       | 112720/371472 [8:57:46<19:33:29,  3.67it/s]
                                                            
{'loss': 3.3175, 'learning_rate': 7.272404059557413e-07, 'epoch': 4.86}

 30%|███       | 112720/371472 [8:57:46<19:33:29,  3.67it/s]
 30%|███       | 112721/371472 [8:57:47<19:51:34,  3.62it/s]
 30%|███       | 112722/371472 [8:57:47<21:20:19,  3.37it/s]
 30%|███       | 112723/371472 [8:57:47<22:17:20,  3.22it/s]
 30%|███       | 112724/371472 [8:57:48<22:36:10,  3.18it/s]
 30%|███       | 112725/371472 [8:57:48<21:25:12,  3.36it/s]
 30%|███       | 112726/371472 [8:57:48<22:46:09,  3.16it/s]
 30%|███       | 112727/371472 [8:57:48<21:07:59,  3.40it/s]
 30%|███       | 112728/371472 [8:57:49<20:00:04,  3.59it/s]
 30%|███       | 112729/371472 [8:57:49<19:23:28,  3.71it/s]
 30%|███       | 112730/371472 [8:57:49<21:09:13,  3.40it/s]
 30%|███       | 112731/371472 [8:57:50<20:12:31,  3.56it/s]
 30%|███       | 112732/371472 [8:57:50<19:52:02,  3.62it/s]
 30%|███       | 112733/371472 [8:57:50<20:13:47,  3.55it/s]
 30%|███       | 112734/371472 [8:57:50<20:05:50,  3.58it/s]
 30%|███       | 112735/371472 [8:57:51<21:18:04,  3.37it/s]
 30%|███       | 112736/371472 [8:57:51<20:21:43,  3.53it/s]
 30%|███       | 112737/371472 [8:57:51<19:49:00,  3.63it/s]
 30%|███       | 112738/371472 [8:57:51<20:04:23,  3.58it/s]
 30%|███       | 112739/371472 [8:57:52<19:51:08,  3.62it/s]
 30%|███       | 112740/371472 [8:57:52<19:40:32,  3.65it/s]
                                                            
{'loss': 3.4371, 'learning_rate': 7.271919239802624e-07, 'epoch': 4.86}

 30%|███       | 112740/371472 [8:57:52<19:40:32,  3.65it/s]
 30%|███       | 112741/371472 [8:57:52<20:10:02,  3.56it/s]
 30%|███       | 112742/371472 [8:57:53<20:05:52,  3.58it/s]
 30%|███       | 112743/371472 [8:57:53<19:23:33,  3.71it/s]
 30%|███       | 112744/371472 [8:57:53<19:11:41,  3.74it/s]
 30%|███       | 112745/371472 [8:57:53<20:57:02,  3.43it/s]
 30%|███       | 112746/371472 [8:57:54<20:03:47,  3.58it/s]
 30%|███       | 112747/371472 [8:57:54<21:12:41,  3.39it/s]
 30%|███       | 112748/371472 [8:57:54<20:33:53,  3.49it/s]
 30%|███       | 112749/371472 [8:57:55<20:21:40,  3.53it/s]
 30%|███       | 112750/371472 [8:57:55<20:32:32,  3.50it/s]
 30%|███       | 112751/371472 [8:57:55<21:01:30,  3.42it/s]
 30%|███       | 112752/371472 [8:57:56<21:41:47,  3.31it/s]
 30%|███       | 112753/371472 [8:57:56<20:55:37,  3.43it/s]
 30%|███       | 112754/371472 [8:57:56<22:21:08,  3.22it/s]
 30%|███       | 112755/371472 [8:57:56<21:51:10,  3.29it/s]
 30%|███       | 112756/371472 [8:57:57<20:56:18,  3.43it/s]
 30%|███       | 112757/371472 [8:57:57<20:45:33,  3.46it/s]
 30%|███       | 112758/371472 [8:57:57<20:28:54,  3.51it/s]
 30%|███       | 112759/371472 [8:57:58<21:18:15,  3.37it/s]
 30%|███       | 112760/371472 [8:57:58<20:41:08,  3.47it/s]
                                                            
{'loss': 3.2728, 'learning_rate': 7.271434420047835e-07, 'epoch': 4.86}

 30%|███       | 112760/371472 [8:57:58<20:41:08,  3.47it/s]
 30%|███       | 112761/371472 [8:57:58<20:45:52,  3.46it/s]
 30%|███       | 112762/371472 [8:57:58<20:47:51,  3.46it/s]
 30%|███       | 112763/371472 [8:57:59<20:45:54,  3.46it/s]
 30%|███       | 112764/371472 [8:57:59<20:27:02,  3.51it/s]
 30%|███       | 112765/371472 [8:57:59<21:39:27,  3.32it/s]
 30%|███       | 112766/371472 [8:58:00<22:28:29,  3.20it/s]
 30%|███       | 112767/371472 [8:58:00<21:40:42,  3.31it/s]
 30%|███       | 112768/371472 [8:58:00<21:12:57,  3.39it/s]
 30%|███       | 112769/371472 [8:58:00<21:04:59,  3.41it/s]
 30%|███       | 112770/371472 [8:58:01<20:04:21,  3.58it/s]
 30%|███       | 112771/371472 [8:58:01<20:11:32,  3.56it/s]
 30%|███       | 112772/371472 [8:58:01<21:51:51,  3.29it/s]
 30%|███       | 112773/371472 [8:58:02<21:33:34,  3.33it/s]
 30%|███       | 112774/371472 [8:58:02<22:19:11,  3.22it/s]
 30%|███       | 112775/371472 [8:58:02<21:35:08,  3.33it/s]
 30%|███       | 112776/371472 [8:58:03<22:08:40,  3.25it/s]
 30%|███       | 112777/371472 [8:58:03<22:23:40,  3.21it/s]
 30%|███       | 112778/371472 [8:58:03<23:20:57,  3.08it/s]
 30%|███       | 112779/371472 [8:58:04<23:12:23,  3.10it/s]
 30%|███       | 112780/371472 [8:58:04<21:48:19,  3.30it/s]
                                                            
{'loss': 3.3408, 'learning_rate': 7.270949600293046e-07, 'epoch': 4.86}

 30%|███       | 112780/371472 [8:58:04<21:48:19,  3.30it/s]
 30%|███       | 112781/371472 [8:58:04<20:38:40,  3.48it/s]
 30%|███       | 112782/371472 [8:58:04<21:08:08,  3.40it/s]
 30%|███       | 112783/371472 [8:58:05<20:17:59,  3.54it/s]
 30%|███       | 112784/371472 [8:58:05<20:58:00,  3.43it/s]
 30%|███       | 112785/371472 [8:58:05<20:38:28,  3.48it/s]
 30%|███       | 112786/371472 [8:58:06<20:37:46,  3.48it/s]
 30%|███       | 112787/371472 [8:58:06<20:43:05,  3.47it/s]
 30%|███       | 112788/371472 [8:58:06<20:53:03,  3.44it/s]
 30%|███       | 112789/371472 [8:58:06<20:16:48,  3.54it/s]
 30%|███       | 112790/371472 [8:58:07<19:19:34,  3.72it/s]
 30%|███       | 112791/371472 [8:58:07<19:48:03,  3.63it/s]
 30%|███       | 112792/371472 [8:58:07<19:45:08,  3.64it/s]
 30%|███       | 112793/371472 [8:58:08<20:56:54,  3.43it/s]
 30%|███       | 112794/371472 [8:58:08<20:16:49,  3.54it/s]
 30%|███       | 112795/371472 [8:58:08<19:52:33,  3.62it/s]
 30%|███       | 112796/371472 [8:58:08<20:27:59,  3.51it/s]
 30%|███       | 112797/371472 [8:58:09<20:01:27,  3.59it/s]
 30%|███       | 112798/371472 [8:58:09<24:10:05,  2.97it/s]
 30%|███       | 112799/371472 [8:58:09<23:41:40,  3.03it/s]
 30%|███       | 112800/371472 [8:58:10<21:59:50,  3.27it/s]
                                                            
{'loss': 3.4124, 'learning_rate': 7.270464780538257e-07, 'epoch': 4.86}

 30%|███       | 112800/371472 [8:58:10<21:59:50,  3.27it/s]
 30%|███       | 112801/371472 [8:58:10<21:38:29,  3.32it/s]
 30%|███       | 112802/371472 [8:58:10<21:31:36,  3.34it/s]
 30%|███       | 112803/371472 [8:58:11<22:39:11,  3.17it/s]
 30%|███       | 112804/371472 [8:58:11<21:56:16,  3.28it/s]
 30%|███       | 112805/371472 [8:58:11<21:19:16,  3.37it/s]
 30%|███       | 112806/371472 [8:58:11<20:40:22,  3.48it/s]
 30%|███       | 112807/371472 [8:58:12<21:45:30,  3.30it/s]
 30%|███       | 112808/371472 [8:58:12<21:15:58,  3.38it/s]
 30%|███       | 112809/371472 [8:58:12<21:01:12,  3.42it/s]
 30%|███       | 112810/371472 [8:58:13<20:26:33,  3.51it/s]
 30%|███       | 112811/371472 [8:58:13<20:52:58,  3.44it/s]
 30%|███       | 112812/371472 [8:58:13<21:22:05,  3.36it/s]
 30%|███       | 112813/371472 [8:58:13<20:34:33,  3.49it/s]
 30%|███       | 112814/371472 [8:58:14<20:55:21,  3.43it/s]
 30%|███       | 112815/371472 [8:58:14<20:24:23,  3.52it/s]
 30%|███       | 112816/371472 [8:58:14<20:39:45,  3.48it/s]
 30%|███       | 112817/371472 [8:58:15<20:07:56,  3.57it/s]
 30%|███       | 112818/371472 [8:58:15<22:31:52,  3.19it/s]
 30%|███       | 112819/371472 [8:58:15<22:25:01,  3.21it/s]
 30%|███       | 112820/371472 [8:58:16<23:16:47,  3.09it/s]
                                                            
{'loss': 3.3237, 'learning_rate': 7.269979960783469e-07, 'epoch': 4.86}

 30%|███       | 112820/371472 [8:58:16<23:16:47,  3.09it/s]
 30%|███       | 112821/371472 [8:58:16<21:46:52,  3.30it/s]
 30%|███       | 112822/371472 [8:58:16<21:03:28,  3.41it/s]
 30%|███       | 112823/371472 [8:58:16<20:18:04,  3.54it/s]
 30%|███       | 112824/371472 [8:58:17<19:50:25,  3.62it/s]
 30%|███       | 112825/371472 [8:58:17<19:44:11,  3.64it/s]
 30%|███       | 112826/371472 [8:58:17<20:11:19,  3.56it/s]
 30%|███       | 112827/371472 [8:58:18<19:55:01,  3.61it/s]
 30%|███       | 112828/371472 [8:58:18<19:56:41,  3.60it/s]
 30%|███       | 112829/371472 [8:58:18<19:12:50,  3.74it/s]
 30%|███       | 112830/371472 [8:58:18<19:54:17,  3.61it/s]
 30%|███       | 112831/371472 [8:58:19<19:58:39,  3.60it/s]
 30%|███       | 112832/371472 [8:58:19<19:16:47,  3.73it/s]
 30%|███       | 112833/371472 [8:58:19<18:48:42,  3.82it/s]
 30%|███       | 112834/371472 [8:58:19<19:14:14,  3.73it/s]
 30%|███       | 112835/371472 [8:58:20<18:47:04,  3.82it/s]
 30%|███       | 112836/371472 [8:58:20<20:15:45,  3.55it/s]
 30%|███       | 112837/371472 [8:58:20<23:03:29,  3.12it/s]
 30%|███       | 112838/371472 [8:58:21<21:36:46,  3.32it/s]
 30%|███       | 112839/371472 [8:58:21<21:06:42,  3.40it/s]
 30%|███       | 112840/371472 [8:58:21<20:49:07,  3.45it/s]
                                                            
{'loss': 3.2809, 'learning_rate': 7.26949514102868e-07, 'epoch': 4.86}

 30%|███       | 112840/371472 [8:58:21<20:49:07,  3.45it/s]
 30%|███       | 112841/371472 [8:58:21<20:26:04,  3.52it/s]
 30%|███       | 112842/371472 [8:58:22<19:43:07,  3.64it/s]
 30%|███       | 112843/371472 [8:58:22<19:30:24,  3.68it/s]
 30%|███       | 112844/371472 [8:58:22<19:45:31,  3.64it/s]
 30%|███       | 112845/371472 [8:58:23<19:35:47,  3.67it/s]
 30%|███       | 112846/371472 [8:58:23<19:29:21,  3.69it/s]
 30%|███       | 112847/371472 [8:58:23<20:15:24,  3.55it/s]
 30%|███       | 112848/371472 [8:58:23<20:08:23,  3.57it/s]
 30%|███       | 112849/371472 [8:58:24<21:09:30,  3.40it/s]
 30%|███       | 112850/371472 [8:58:24<19:50:45,  3.62it/s]
 30%|███       | 112851/371472 [8:58:24<20:03:10,  3.58it/s]
 30%|███       | 112852/371472 [8:58:25<19:40:47,  3.65it/s]
 30%|███       | 112853/371472 [8:58:25<20:02:59,  3.58it/s]
 30%|███       | 112854/371472 [8:58:25<20:53:10,  3.44it/s]
 30%|███       | 112855/371472 [8:58:25<20:48:20,  3.45it/s]
 30%|███       | 112856/371472 [8:58:26<22:04:16,  3.25it/s]
 30%|███       | 112857/371472 [8:58:26<21:00:34,  3.42it/s]
 30%|███       | 112858/371472 [8:58:26<20:22:59,  3.52it/s]
 30%|███       | 112859/371472 [8:58:27<21:18:20,  3.37it/s]
 30%|███       | 112860/371472 [8:58:27<21:24:08,  3.36it/s]
                                                            
{'loss': 3.1672, 'learning_rate': 7.26901032127389e-07, 'epoch': 4.86}

 30%|███       | 112860/371472 [8:58:27<21:24:08,  3.36it/s]
 30%|███       | 112861/371472 [8:58:27<21:24:47,  3.35it/s]
 30%|███       | 112862/371472 [8:58:27<20:34:47,  3.49it/s]
 30%|███       | 112863/371472 [8:58:28<20:12:37,  3.55it/s]
 30%|███       | 112864/371472 [8:58:28<19:40:53,  3.65it/s]
 30%|███       | 112865/371472 [8:58:28<20:25:45,  3.52it/s]
 30%|███       | 112866/371472 [8:58:29<21:20:30,  3.37it/s]
 30%|███       | 112867/371472 [8:58:29<21:39:23,  3.32it/s]
 30%|███       | 112868/371472 [8:58:29<20:30:49,  3.50it/s]
 30%|███       | 112869/371472 [8:58:30<21:07:01,  3.40it/s]
 30%|███       | 112870/371472 [8:58:30<21:35:15,  3.33it/s]
 30%|███       | 112871/371472 [8:58:30<20:45:51,  3.46it/s]
 30%|███       | 112872/371472 [8:58:30<20:21:19,  3.53it/s]
 30%|███       | 112873/371472 [8:58:31<19:32:08,  3.68it/s]
 30%|███       | 112874/371472 [8:58:31<19:23:27,  3.70it/s]
 30%|███       | 112875/371472 [8:58:31<18:46:19,  3.83it/s]
 30%|███       | 112876/371472 [8:58:31<19:54:49,  3.61it/s]
 30%|███       | 112877/371472 [8:58:32<22:46:03,  3.16it/s]
 30%|███       | 112878/371472 [8:58:32<24:23:21,  2.95it/s]
 30%|███       | 112879/371472 [8:58:33<23:39:00,  3.04it/s]
 30%|███       | 112880/371472 [8:58:33<24:50:37,  2.89it/s]
                                                            
{'loss': 3.1231, 'learning_rate': 7.268525501519101e-07, 'epoch': 4.86}

 30%|███       | 112880/371472 [8:58:33<24:50:37,  2.89it/s]
 30%|███       | 112881/371472 [8:58:33<23:17:21,  3.08it/s]
 30%|███       | 112882/371472 [8:58:33<23:02:29,  3.12it/s]
 30%|███       | 112883/371472 [8:58:34<22:52:31,  3.14it/s]
 30%|███       | 112884/371472 [8:58:34<21:50:10,  3.29it/s]
 30%|███       | 112885/371472 [8:58:34<22:11:35,  3.24it/s]
 30%|███       | 112886/371472 [8:58:35<21:17:30,  3.37it/s]
 30%|███       | 112887/371472 [8:58:35<21:31:58,  3.34it/s]
 30%|███       | 112888/371472 [8:58:35<22:16:17,  3.23it/s]
 30%|███       | 112889/371472 [8:58:36<21:43:00,  3.31it/s]
 30%|███       | 112890/371472 [8:58:36<21:31:10,  3.34it/s]
 30%|███       | 112891/371472 [8:58:36<21:28:02,  3.35it/s]
 30%|███       | 112892/371472 [8:58:36<21:03:58,  3.41it/s]
 30%|███       | 112893/371472 [8:58:37<20:18:32,  3.54it/s]
 30%|███       | 112894/371472 [8:58:37<19:59:09,  3.59it/s]
 30%|███       | 112895/371472 [8:58:37<19:43:45,  3.64it/s]
 30%|███       | 112896/371472 [8:58:38<19:38:28,  3.66it/s]
 30%|███       | 112897/371472 [8:58:38<19:27:17,  3.69it/s]
 30%|███       | 112898/371472 [8:58:38<19:11:56,  3.74it/s]
 30%|███       | 112899/371472 [8:58:38<19:11:03,  3.74it/s]
 30%|███       | 112900/371472 [8:58:39<19:26:04,  3.70it/s]
                                                            
{'loss': 3.291, 'learning_rate': 7.268040681764313e-07, 'epoch': 4.86}

 30%|███       | 112900/371472 [8:58:39<19:26:04,  3.70it/s]
 30%|███       | 112901/371472 [8:58:39<20:04:29,  3.58it/s]
 30%|███       | 112902/371472 [8:58:39<19:41:59,  3.65it/s]
 30%|███       | 112903/371472 [8:58:39<19:20:28,  3.71it/s]
 30%|███       | 112904/371472 [8:58:40<18:51:19,  3.81it/s]
 30%|███       | 112905/371472 [8:58:40<18:47:29,  3.82it/s]
 30%|███       | 112906/371472 [8:58:40<20:01:06,  3.59it/s]
 30%|███       | 112907/371472 [8:58:41<20:04:32,  3.58it/s]
 30%|███       | 112908/371472 [8:58:41<19:34:28,  3.67it/s]
 30%|███       | 112909/371472 [8:58:41<20:06:22,  3.57it/s]
 30%|███       | 112910/371472 [8:58:41<20:05:44,  3.57it/s]
 30%|███       | 112911/371472 [8:58:42<19:24:20,  3.70it/s]
 30%|███       | 112912/371472 [8:58:42<19:43:03,  3.64it/s]
 30%|███       | 112913/371472 [8:58:42<19:01:36,  3.77it/s]
 30%|███       | 112914/371472 [8:58:42<19:05:12,  3.76it/s]
 30%|███       | 112915/371472 [8:58:43<19:03:25,  3.77it/s]
 30%|███       | 112916/371472 [8:58:43<21:04:10,  3.41it/s]
 30%|███       | 112917/371472 [8:58:43<20:25:44,  3.52it/s]
 30%|███       | 112918/371472 [8:58:44<19:33:28,  3.67it/s]
 30%|███       | 112919/371472 [8:58:44<19:16:27,  3.73it/s]
 30%|███       | 112920/371472 [8:58:44<19:23:21,  3.70it/s]
                                                            
{'loss': 3.5074, 'learning_rate': 7.267555862009524e-07, 'epoch': 4.86}

 30%|███       | 112920/371472 [8:58:44<19:23:21,  3.70it/s]
 30%|███       | 112921/371472 [8:58:44<19:39:43,  3.65it/s]
 30%|███       | 112922/371472 [8:58:45<20:12:25,  3.55it/s]
 30%|███       | 112923/371472 [8:58:45<20:33:52,  3.49it/s]
 30%|███       | 112924/371472 [8:58:45<22:01:24,  3.26it/s]
 30%|███       | 112925/371472 [8:58:46<21:26:41,  3.35it/s]
 30%|███       | 112926/371472 [8:58:46<21:50:48,  3.29it/s]
 30%|███       | 112927/371472 [8:58:46<21:15:40,  3.38it/s]
 30%|███       | 112928/371472 [8:58:46<21:31:37,  3.34it/s]
 30%|███       | 112929/371472 [8:58:47<21:13:24,  3.38it/s]
 30%|███       | 112930/371472 [8:58:47<21:20:56,  3.36it/s]
 30%|███       | 112931/371472 [8:58:47<21:34:45,  3.33it/s]
 30%|███       | 112932/371472 [8:58:48<20:48:15,  3.45it/s]
 30%|███       | 112933/371472 [8:58:48<20:19:45,  3.53it/s]
 30%|███       | 112934/371472 [8:58:48<19:49:41,  3.62it/s]
 30%|███       | 112935/371472 [8:58:49<21:44:52,  3.30it/s]
 30%|███       | 112936/371472 [8:58:49<20:53:35,  3.44it/s]
 30%|███       | 112937/371472 [8:58:49<19:58:38,  3.59it/s]
 30%|███       | 112938/371472 [8:58:49<20:06:40,  3.57it/s]
 30%|███       | 112939/371472 [8:58:50<20:27:59,  3.51it/s]
 30%|███       | 112940/371472 [8:58:50<20:28:27,  3.51it/s]
                                                            
{'loss': 3.4051, 'learning_rate': 7.267071042254735e-07, 'epoch': 4.86}

 30%|███       | 112940/371472 [8:58:50<20:28:27,  3.51it/s]
 30%|███       | 112941/371472 [8:58:50<19:55:52,  3.60it/s]
 30%|███       | 112942/371472 [8:58:50<20:05:23,  3.57it/s]
 30%|███       | 112943/371472 [8:58:51<19:58:04,  3.60it/s]
 30%|███       | 112944/371472 [8:58:51<20:07:05,  3.57it/s]
 30%|███       | 112945/371472 [8:58:51<19:40:01,  3.65it/s]
 30%|███       | 112946/371472 [8:58:52<19:35:25,  3.67it/s]
 30%|███       | 112947/371472 [8:58:52<19:27:53,  3.69it/s]
 30%|███       | 112948/371472 [8:58:52<22:14:44,  3.23it/s]
 30%|███       | 112949/371472 [8:58:53<22:22:24,  3.21it/s]
 30%|███       | 112950/371472 [8:58:53<22:08:17,  3.24it/s]
 30%|███       | 112951/371472 [8:58:53<21:29:22,  3.34it/s]
 30%|███       | 112952/371472 [8:58:53<20:50:25,  3.45it/s]
 30%|███       | 112953/371472 [8:58:54<20:09:34,  3.56it/s]
 30%|███       | 112954/371472 [8:58:54<19:48:36,  3.62it/s]
 30%|███       | 112955/371472 [8:58:54<19:36:52,  3.66it/s]
 30%|███       | 112956/371472 [8:58:55<21:06:28,  3.40it/s]
 30%|███       | 112957/371472 [8:58:55<22:54:23,  3.13it/s]
 30%|███       | 112958/371472 [8:58:55<22:35:26,  3.18it/s]
 30%|███       | 112959/371472 [8:58:55<21:34:34,  3.33it/s]
 30%|███       | 112960/371472 [8:58:56<20:26:41,  3.51it/s]
                                                            
{'loss': 3.3751, 'learning_rate': 7.266586222499946e-07, 'epoch': 4.87}

 30%|███       | 112960/371472 [8:58:56<20:26:41,  3.51it/s]
 30%|███       | 112961/371472 [8:58:56<19:49:51,  3.62it/s]
 30%|███       | 112962/371472 [8:58:56<20:16:39,  3.54it/s]
 30%|███       | 112963/371472 [8:58:57<21:05:28,  3.40it/s]
 30%|███       | 112964/371472 [8:58:57<21:27:16,  3.35it/s]
 30%|███       | 112965/371472 [8:58:57<21:00:21,  3.42it/s]
 30%|███       | 112966/371472 [8:58:57<21:56:41,  3.27it/s]
 30%|███       | 112967/371472 [8:58:58<20:46:04,  3.46it/s]
 30%|███       | 112968/371472 [8:58:58<20:43:05,  3.47it/s]
 30%|███       | 112969/371472 [8:58:58<21:50:36,  3.29it/s]
 30%|███       | 112970/371472 [8:58:59<21:32:24,  3.33it/s]
 30%|███       | 112971/371472 [8:58:59<21:04:01,  3.41it/s]
 30%|███       | 112972/371472 [8:58:59<23:02:26,  3.12it/s]
 30%|███       | 112973/371472 [8:59:00<24:19:26,  2.95it/s]
 30%|███       | 112974/371472 [8:59:00<23:16:32,  3.08it/s]
 30%|███       | 112975/371472 [8:59:00<21:31:44,  3.34it/s]
 30%|███       | 112976/371472 [8:59:00<20:09:09,  3.56it/s]
 30%|███       | 112977/371472 [8:59:01<19:54:24,  3.61it/s]
 30%|███       | 112978/371472 [8:59:01<20:10:28,  3.56it/s]
 30%|███       | 112979/371472 [8:59:01<19:55:32,  3.60it/s]
 30%|███       | 112980/371472 [8:59:02<19:16:36,  3.72it/s]
                                                            
{'loss': 3.481, 'learning_rate': 7.266101402745158e-07, 'epoch': 4.87}

 30%|███       | 112980/371472 [8:59:02<19:16:36,  3.72it/s]
 30%|███       | 112981/371472 [8:59:02<20:11:55,  3.55it/s]
 30%|███       | 112982/371472 [8:59:02<19:35:50,  3.66it/s]
 30%|███       | 112983/371472 [8:59:02<19:42:10,  3.64it/s]
 30%|███       | 112984/371472 [8:59:03<19:40:35,  3.65it/s]
 30%|███       | 112985/371472 [8:59:03<19:08:07,  3.75it/s]
 30%|███       | 112986/371472 [8:59:03<18:57:53,  3.79it/s]
 30%|███       | 112987/371472 [8:59:03<18:53:03,  3.80it/s]
 30%|███       | 112988/371472 [8:59:04<19:05:24,  3.76it/s]
 30%|███       | 112989/371472 [8:59:04<18:56:51,  3.79it/s]
 30%|███       | 112990/371472 [8:59:04<19:48:03,  3.63it/s]
 30%|███       | 112991/371472 [8:59:05<21:51:26,  3.28it/s]
 30%|███       | 112992/371472 [8:59:05<20:56:42,  3.43it/s]
 30%|███       | 112993/371472 [8:59:05<21:09:11,  3.39it/s]
 30%|███       | 112994/371472 [8:59:05<20:09:39,  3.56it/s]
 30%|███       | 112995/371472 [8:59:06<20:16:39,  3.54it/s]
 30%|███       | 112996/371472 [8:59:06<20:05:43,  3.57it/s]
 30%|███       | 112997/371472 [8:59:06<19:48:51,  3.62it/s]
 30%|███       | 112998/371472 [8:59:07<19:36:53,  3.66it/s]
 30%|███       | 112999/371472 [8:59:07<20:31:28,  3.50it/s]
 30%|███       | 113000/371472 [8:59:07<20:49:35,  3.45it/s]
                                                            
{'loss': 3.502, 'learning_rate': 7.265616582990368e-07, 'epoch': 4.87}

 30%|███       | 113000/371472 [8:59:07<20:49:35,  3.45it/s]
 30%|███       | 113001/371472 [8:59:07<20:32:23,  3.50it/s]
 30%|███       | 113002/371472 [8:59:08<21:52:05,  3.28it/s]
 30%|███       | 113003/371472 [8:59:08<20:50:40,  3.44it/s]
 30%|███       | 113004/371472 [8:59:08<20:09:30,  3.56it/s]
 30%|███       | 113005/371472 [8:59:09<20:51:05,  3.44it/s]
 30%|███       | 113006/371472 [8:59:09<20:10:01,  3.56it/s]
 30%|███       | 113007/371472 [8:59:09<21:13:29,  3.38it/s]
 30%|███       | 113008/371472 [8:59:09<21:03:53,  3.41it/s]
 30%|███       | 113009/371472 [8:59:10<20:54:49,  3.43it/s]
 30%|███       | 113010/371472 [8:59:10<20:15:17,  3.54it/s]
 30%|███       | 113011/371472 [8:59:10<21:01:36,  3.41it/s]
 30%|███       | 113012/371472 [8:59:11<20:54:52,  3.43it/s]
 30%|███       | 113013/371472 [8:59:11<20:42:06,  3.47it/s]
 30%|███       | 113014/371472 [8:59:11<20:47:36,  3.45it/s]
 30%|███       | 113015/371472 [8:59:11<20:24:11,  3.52it/s]
 30%|███       | 113016/371472 [8:59:12<19:44:29,  3.64it/s]
 30%|███       | 113017/371472 [8:59:12<19:09:25,  3.75it/s]
 30%|███       | 113018/371472 [8:59:12<19:04:52,  3.76it/s]
 30%|███       | 113019/371472 [8:59:13<19:00:26,  3.78it/s]
 30%|███       | 113020/371472 [8:59:13<18:54:23,  3.80it/s]
                                                            
{'loss': 3.4113, 'learning_rate': 7.265131763235579e-07, 'epoch': 4.87}

 30%|███       | 113020/371472 [8:59:13<18:54:23,  3.80it/s]
 30%|███       | 113021/371472 [8:59:13<20:06:54,  3.57it/s]
 30%|███       | 113022/371472 [8:59:13<19:28:14,  3.69it/s]
 30%|███       | 113023/371472 [8:59:14<19:00:37,  3.78it/s]
 30%|███       | 113024/371472 [8:59:14<18:54:31,  3.80it/s]
 30%|███       | 113025/371472 [8:59:14<21:01:50,  3.41it/s]
 30%|███       | 113026/371472 [8:59:15<21:35:37,  3.32it/s]
 30%|███       | 113027/371472 [8:59:15<24:21:04,  2.95it/s]
 30%|███       | 113028/371472 [8:59:15<22:41:22,  3.16it/s]
 30%|███       | 113029/371472 [8:59:15<21:21:38,  3.36it/s]
 30%|███       | 113030/371472 [8:59:16<21:44:56,  3.30it/s]
 30%|███       | 113031/371472 [8:59:16<22:11:24,  3.24it/s]
 30%|███       | 113032/371472 [8:59:16<21:57:31,  3.27it/s]
 30%|███       | 113033/371472 [8:59:17<21:31:17,  3.34it/s]
 30%|███       | 113034/371472 [8:59:17<22:01:17,  3.26it/s]
 30%|███       | 113035/371472 [8:59:17<20:52:14,  3.44it/s]
 30%|███       | 113036/371472 [8:59:18<20:14:31,  3.55it/s]
 30%|███       | 113037/371472 [8:59:18<19:47:58,  3.63it/s]
 30%|███       | 113038/371472 [8:59:18<19:41:50,  3.64it/s]
 30%|███       | 113039/371472 [8:59:18<21:11:23,  3.39it/s]
 30%|███       | 113040/371472 [8:59:19<19:56:51,  3.60it/s]
                                                            
{'loss': 3.4011, 'learning_rate': 7.26464694348079e-07, 'epoch': 4.87}

 30%|███       | 113040/371472 [8:59:19<19:56:51,  3.60it/s]
 30%|███       | 113041/371472 [8:59:19<19:07:12,  3.75it/s]
 30%|███       | 113042/371472 [8:59:19<18:43:39,  3.83it/s]
 30%|███       | 113043/371472 [8:59:19<19:34:52,  3.67it/s]
 30%|███       | 113044/371472 [8:59:20<20:02:33,  3.58it/s]
 30%|███       | 113045/371472 [8:59:20<19:59:19,  3.59it/s]
 30%|███       | 113046/371472 [8:59:20<19:19:20,  3.72it/s]
 30%|███       | 113047/371472 [8:59:21<19:13:07,  3.74it/s]
 30%|███       | 113048/371472 [8:59:21<19:14:47,  3.73it/s]
 30%|███       | 113049/371472 [8:59:21<19:28:10,  3.69it/s]
 30%|███       | 113050/371472 [8:59:21<19:58:22,  3.59it/s]
 30%|███       | 113051/371472 [8:59:22<20:57:34,  3.42it/s]
 30%|███       | 113052/371472 [8:59:22<21:27:57,  3.34it/s]
 30%|███       | 113053/371472 [8:59:22<22:41:12,  3.16it/s]
 30%|███       | 113054/371472 [8:59:23<23:01:57,  3.12it/s]
 30%|███       | 113055/371472 [8:59:23<21:27:45,  3.34it/s]
 30%|███       | 113056/371472 [8:59:23<21:52:38,  3.28it/s]
 30%|███       | 113057/371472 [8:59:24<21:32:28,  3.33it/s]
 30%|███       | 113058/371472 [8:59:24<20:08:03,  3.57it/s]
 30%|███       | 113059/371472 [8:59:24<19:43:09,  3.64it/s]
 30%|███       | 113060/371472 [8:59:24<19:38:25,  3.65it/s]
                                                            
{'loss': 3.3976, 'learning_rate': 7.264162123726e-07, 'epoch': 4.87}

 30%|███       | 113060/371472 [8:59:24<19:38:25,  3.65it/s]
 30%|███       | 113061/371472 [8:59:25<19:14:52,  3.73it/s]
 30%|███       | 113062/371472 [8:59:25<19:05:01,  3.76it/s]
 30%|███       | 113063/371472 [8:59:25<19:24:14,  3.70it/s]
 30%|███       | 113064/371472 [8:59:25<20:11:26,  3.56it/s]
 30%|███       | 113065/371472 [8:59:26<19:51:24,  3.61it/s]
 30%|███       | 113066/371472 [8:59:26<19:49:03,  3.62it/s]
 30%|███       | 113067/371472 [8:59:26<19:50:54,  3.62it/s]
 30%|███       | 113068/371472 [8:59:26<19:15:21,  3.73it/s]
 30%|███       | 113069/371472 [8:59:27<19:26:27,  3.69it/s]
 30%|███       | 113070/371472 [8:59:27<20:22:05,  3.52it/s]
 30%|███       | 113071/371472 [8:59:27<20:45:32,  3.46it/s]
 30%|███       | 113072/371472 [8:59:28<22:20:33,  3.21it/s]
 30%|███       | 113073/371472 [8:59:28<21:04:29,  3.41it/s]
 30%|███       | 113074/371472 [8:59:28<21:49:28,  3.29it/s]
 30%|███       | 113075/371472 [8:59:29<21:22:43,  3.36it/s]
 30%|███       | 113076/371472 [8:59:29<20:16:54,  3.54it/s]
 30%|███       | 113077/371472 [8:59:29<19:29:50,  3.68it/s]
 30%|███       | 113078/371472 [8:59:29<19:30:33,  3.68it/s]
 30%|███       | 113079/371472 [8:59:30<20:16:25,  3.54it/s]
 30%|███       | 113080/371472 [8:59:30<20:00:04,  3.59it/s]
                                                            
{'loss': 3.4237, 'learning_rate': 7.263677303971212e-07, 'epoch': 4.87}

 30%|███       | 113080/371472 [8:59:30<20:00:04,  3.59it/s]
 30%|███       | 113081/371472 [8:59:30<20:06:15,  3.57it/s]
 30%|███       | 113082/371472 [8:59:31<19:45:12,  3.63it/s]
 30%|███       | 113083/371472 [8:59:31<20:43:33,  3.46it/s]
 30%|███       | 113084/371472 [8:59:31<21:34:02,  3.33it/s]
 30%|███       | 113085/371472 [8:59:31<21:02:38,  3.41it/s]
 30%|███       | 113086/371472 [8:59:32<20:52:14,  3.44it/s]
 30%|███       | 113087/371472 [8:59:32<20:50:14,  3.44it/s]
 30%|███       | 113088/371472 [8:59:32<20:31:19,  3.50it/s]
 30%|███       | 113089/371472 [8:59:33<20:31:15,  3.50it/s]
 30%|███       | 113090/371472 [8:59:33<20:18:23,  3.53it/s]
 30%|███       | 113091/371472 [8:59:33<20:05:35,  3.57it/s]
 30%|███       | 113092/371472 [8:59:33<19:14:58,  3.73it/s]
 30%|███       | 113093/371472 [8:59:34<19:19:44,  3.71it/s]
 30%|███       | 113094/371472 [8:59:34<20:07:32,  3.57it/s]
 30%|███       | 113095/371472 [8:59:34<20:13:17,  3.55it/s]
 30%|███       | 113096/371472 [8:59:35<20:47:23,  3.45it/s]
 30%|███       | 113097/371472 [8:59:35<19:53:02,  3.61it/s]
 30%|███       | 113098/371472 [8:59:35<19:30:53,  3.68it/s]
 30%|███       | 113099/371472 [8:59:35<20:17:54,  3.54it/s]
 30%|███       | 113100/371472 [8:59:36<19:47:48,  3.63it/s]
                                                            
{'loss': 3.4112, 'learning_rate': 7.263192484216423e-07, 'epoch': 4.87}

 30%|███       | 113100/371472 [8:59:36<19:47:48,  3.63it/s]
 30%|███       | 113101/371472 [8:59:36<20:28:45,  3.50it/s]
 30%|███       | 113102/371472 [8:59:36<20:41:26,  3.47it/s]
 30%|███       | 113103/371472 [8:59:36<19:58:38,  3.59it/s]
 30%|███       | 113104/371472 [8:59:37<19:21:33,  3.71it/s]
 30%|███       | 113105/371472 [8:59:37<19:29:49,  3.68it/s]
 30%|███       | 113106/371472 [8:59:37<18:49:04,  3.81it/s]
 30%|███       | 113107/371472 [8:59:38<19:10:14,  3.74it/s]
 30%|███       | 113108/371472 [8:59:38<18:36:54,  3.86it/s]
 30%|███       | 113109/371472 [8:59:38<19:03:40,  3.77it/s]
 30%|███       | 113110/371472 [8:59:38<20:25:00,  3.52it/s]
 30%|███       | 113111/371472 [8:59:39<20:31:02,  3.50it/s]
 30%|███       | 113112/371472 [8:59:39<19:41:23,  3.64it/s]
 30%|███       | 113113/371472 [8:59:39<19:34:39,  3.67it/s]
 30%|███       | 113114/371472 [8:59:39<19:27:10,  3.69it/s]
 30%|███       | 113115/371472 [8:59:40<19:14:59,  3.73it/s]
 30%|███       | 113116/371472 [8:59:40<19:03:00,  3.77it/s]
 30%|███       | 113117/371472 [8:59:40<19:11:45,  3.74it/s]
 30%|███       | 113118/371472 [8:59:41<19:47:40,  3.63it/s]
 30%|███       | 113119/371472 [8:59:41<21:19:09,  3.37it/s]
 30%|███       | 113120/371472 [8:59:41<20:22:30,  3.52it/s]
                                                            
{'loss': 3.3411, 'learning_rate': 7.262707664461634e-07, 'epoch': 4.87}

 30%|███       | 113120/371472 [8:59:41<20:22:30,  3.52it/s]
 30%|███       | 113121/371472 [8:59:41<21:01:03,  3.41it/s]
 30%|███       | 113122/371472 [8:59:42<20:19:10,  3.53it/s]
 30%|███       | 113123/371472 [8:59:42<19:47:02,  3.63it/s]
 30%|███       | 113124/371472 [8:59:42<19:44:02,  3.64it/s]
 30%|███       | 113125/371472 [8:59:42<19:44:58,  3.63it/s]
 30%|███       | 113126/371472 [8:59:43<19:28:37,  3.68it/s]
 30%|███       | 113127/371472 [8:59:43<19:49:31,  3.62it/s]
 30%|███       | 113128/371472 [8:59:43<19:29:07,  3.68it/s]
 30%|███       | 113129/371472 [8:59:44<21:36:52,  3.32it/s]
 30%|███       | 113130/371472 [8:59:44<20:55:02,  3.43it/s]
 30%|███       | 113131/371472 [8:59:44<19:48:40,  3.62it/s]
 30%|███       | 113132/371472 [8:59:44<20:03:16,  3.58it/s]
 30%|███       | 113133/371472 [8:59:45<19:37:15,  3.66it/s]
 30%|███       | 113134/371472 [8:59:45<19:31:58,  3.67it/s]
 30%|███       | 113135/371472 [8:59:45<19:44:07,  3.64it/s]
 30%|███       | 113136/371472 [8:59:46<18:58:51,  3.78it/s]
 30%|███       | 113137/371472 [8:59:46<18:58:04,  3.78it/s]
 30%|███       | 113138/371472 [8:59:46<20:10:47,  3.56it/s]
 30%|███       | 113139/371472 [8:59:46<19:37:57,  3.66it/s]
 30%|███       | 113140/371472 [8:59:47<20:38:09,  3.48it/s]
                                                            
{'loss': 3.5716, 'learning_rate': 7.262222844706845e-07, 'epoch': 4.87}

 30%|███       | 113140/371472 [8:59:47<20:38:09,  3.48it/s]
 30%|███       | 113141/371472 [8:59:47<19:57:18,  3.60it/s]
 30%|███       | 113142/371472 [8:59:47<20:22:40,  3.52it/s]
 30%|███       | 113143/371472 [8:59:48<21:54:21,  3.28it/s]
 30%|███       | 113144/371472 [8:59:48<20:53:00,  3.44it/s]
 30%|███       | 113145/371472 [8:59:48<20:16:20,  3.54it/s]
 30%|███       | 113146/371472 [8:59:48<20:46:09,  3.45it/s]
 30%|███       | 113147/371472 [8:59:49<20:26:04,  3.51it/s]
 30%|███       | 113148/371472 [8:59:49<19:43:42,  3.64it/s]
 30%|███       | 113149/371472 [8:59:49<19:26:41,  3.69it/s]
 30%|███       | 113150/371472 [8:59:49<19:35:36,  3.66it/s]
 30%|███       | 113151/371472 [8:59:50<20:11:23,  3.55it/s]
 30%|███       | 113152/371472 [8:59:50<21:28:49,  3.34it/s]
 30%|███       | 113153/371472 [8:59:50<21:03:54,  3.41it/s]
 30%|███       | 113154/371472 [8:59:51<20:26:07,  3.51it/s]
 30%|███       | 113155/371472 [8:59:51<19:39:25,  3.65it/s]
 30%|███       | 113156/371472 [8:59:51<21:22:30,  3.36it/s]
 30%|███       | 113157/371472 [8:59:52<21:34:37,  3.33it/s]
 30%|███       | 113158/371472 [8:59:52<20:34:28,  3.49it/s]
 30%|███       | 113159/371472 [8:59:52<22:02:30,  3.26it/s]
 30%|███       | 113160/371472 [8:59:52<21:32:41,  3.33it/s]
                                                            
{'loss': 3.301, 'learning_rate': 7.261738024952056e-07, 'epoch': 4.87}

 30%|███       | 113160/371472 [8:59:52<21:32:41,  3.33it/s]
 30%|███       | 113161/371472 [8:59:53<22:01:53,  3.26it/s]
 30%|███       | 113162/371472 [8:59:53<21:27:09,  3.34it/s]
 30%|███       | 113163/371472 [8:59:53<21:54:40,  3.27it/s]
 30%|███       | 113164/371472 [8:59:54<22:40:59,  3.16it/s]
 30%|███       | 113165/371472 [8:59:54<22:02:07,  3.26it/s]
 30%|███       | 113166/371472 [8:59:54<22:21:39,  3.21it/s]
 30%|███       | 113167/371472 [8:59:55<21:38:15,  3.32it/s]
 30%|███       | 113168/371472 [8:59:55<21:05:58,  3.40it/s]
 30%|███       | 113169/371472 [8:59:55<20:42:36,  3.46it/s]
 30%|███       | 113170/371472 [8:59:55<20:27:33,  3.51it/s]
 30%|███       | 113171/371472 [8:59:56<20:25:18,  3.51it/s]
 30%|███       | 113172/371472 [8:59:56<20:33:25,  3.49it/s]
 30%|███       | 113173/371472 [8:59:56<21:05:05,  3.40it/s]
 30%|███       | 113174/371472 [8:59:57<21:28:05,  3.34it/s]
 30%|███       | 113175/371472 [8:59:57<20:51:51,  3.44it/s]
 30%|███       | 113176/371472 [8:59:57<21:10:18,  3.39it/s]
 30%|███       | 113177/371472 [8:59:58<21:12:46,  3.38it/s]
 30%|███       | 113178/371472 [8:59:58<20:55:33,  3.43it/s]
 30%|███       | 113179/371472 [8:59:58<20:35:40,  3.48it/s]
 30%|███       | 113180/371472 [8:59:58<20:57:53,  3.42it/s]
                                                            
{'loss': 3.4115, 'learning_rate': 7.261253205197267e-07, 'epoch': 4.87}

 30%|███       | 113180/371472 [8:59:58<20:57:53,  3.42it/s]
 30%|███       | 113181/371472 [8:59:59<21:44:03,  3.30it/s]
 30%|███       | 113182/371472 [8:59:59<21:21:54,  3.36it/s]
 30%|███       | 113183/371472 [8:59:59<20:31:09,  3.50it/s]
 30%|███       | 113184/371472 [9:00:00<21:16:31,  3.37it/s]
 30%|███       | 113185/371472 [9:00:00<20:42:12,  3.47it/s]
 30%|███       | 113186/371472 [9:00:00<20:08:09,  3.56it/s]
 30%|███       | 113187/371472 [9:00:00<19:27:03,  3.69it/s]
 30%|███       | 113188/371472 [9:00:01<19:43:10,  3.64it/s]
 30%|███       | 113189/371472 [9:00:01<20:24:07,  3.52it/s]
 30%|███       | 113190/371472 [9:00:01<20:21:30,  3.52it/s]
 30%|███       | 113191/371472 [9:00:02<21:04:38,  3.40it/s]
 30%|███       | 113192/371472 [9:00:02<21:09:27,  3.39it/s]
 30%|███       | 113193/371472 [9:00:02<21:20:29,  3.36it/s]
 30%|███       | 113194/371472 [9:00:02<20:18:59,  3.53it/s]
 30%|███       | 113195/371472 [9:00:03<21:10:19,  3.39it/s]
 30%|███       | 113196/371472 [9:00:03<20:09:28,  3.56it/s]
 30%|███       | 113197/371472 [9:00:03<19:54:47,  3.60it/s]
 30%|███       | 113198/371472 [9:00:03<19:24:55,  3.70it/s]
 30%|███       | 113199/371472 [9:00:04<19:10:13,  3.74it/s]
 30%|███       | 113200/371472 [9:00:04<18:48:59,  3.81it/s]
                                                            
{'loss': 3.2897, 'learning_rate': 7.260768385442479e-07, 'epoch': 4.88}

 30%|███       | 113200/371472 [9:00:04<18:48:59,  3.81it/s]
 30%|███       | 113201/371472 [9:00:04<19:39:02,  3.65it/s]
 30%|███       | 113202/371472 [9:00:05<19:20:34,  3.71it/s]
 30%|███       | 113203/371472 [9:00:05<19:17:22,  3.72it/s]
 30%|███       | 113204/371472 [9:00:05<18:53:44,  3.80it/s]
 30%|███       | 113205/371472 [9:00:05<19:01:58,  3.77it/s]
 30%|███       | 113206/371472 [9:00:06<18:39:30,  3.84it/s]
 30%|███       | 113207/371472 [9:00:06<19:37:19,  3.66it/s]
 30%|███       | 113208/371472 [9:00:06<22:40:33,  3.16it/s]
 30%|███       | 113209/371472 [9:00:07<21:36:53,  3.32it/s]
 30%|███       | 113210/371472 [9:00:07<21:13:08,  3.38it/s]
 30%|███       | 113211/371472 [9:00:07<20:07:53,  3.56it/s]
 30%|███       | 113212/371472 [9:00:07<20:37:13,  3.48it/s]
 30%|███       | 113213/371472 [9:00:08<21:30:37,  3.34it/s]
 30%|███       | 113214/371472 [9:00:08<21:40:26,  3.31it/s]
 30%|███       | 113215/371472 [9:00:08<22:24:06,  3.20it/s]
 30%|███       | 113216/371472 [9:00:09<21:23:52,  3.35it/s]
 30%|███       | 113217/371472 [9:00:09<23:22:11,  3.07it/s]
 30%|███       | 113218/371472 [9:00:09<21:22:54,  3.36it/s]
 30%|███       | 113219/371472 [9:00:10<21:51:46,  3.28it/s]
 30%|███       | 113220/371472 [9:00:10<20:49:04,  3.45it/s]
                                                            
{'loss': 3.2583, 'learning_rate': 7.26028356568769e-07, 'epoch': 4.88}

 30%|███       | 113220/371472 [9:00:10<20:49:04,  3.45it/s]
 30%|███       | 113221/371472 [9:00:10<20:42:32,  3.46it/s]
 30%|███       | 113222/371472 [9:00:10<20:07:11,  3.57it/s]
 30%|███       | 113223/371472 [9:00:11<19:29:32,  3.68it/s]
 30%|███       | 113224/371472 [9:00:11<19:23:17,  3.70it/s]
 30%|███       | 113225/371472 [9:00:11<18:45:10,  3.83it/s]
 30%|███       | 113226/371472 [9:00:11<19:23:59,  3.70it/s]
 30%|███       | 113227/371472 [9:00:12<19:10:55,  3.74it/s]
 30%|███       | 113228/371472 [9:00:12<19:30:36,  3.68it/s]
 30%|███       | 113229/371472 [9:00:12<19:25:09,  3.69it/s]
 30%|███       | 113230/371472 [9:00:13<20:00:47,  3.58it/s]
 30%|███       | 113231/371472 [9:00:13<19:54:24,  3.60it/s]
 30%|███       | 113232/371472 [9:00:13<19:27:55,  3.69it/s]
 30%|███       | 113233/371472 [9:00:13<19:10:29,  3.74it/s]
 30%|███       | 113234/371472 [9:00:14<19:29:48,  3.68it/s]
 30%|███       | 113235/371472 [9:00:14<20:20:13,  3.53it/s]
 30%|███       | 113236/371472 [9:00:14<19:42:34,  3.64it/s]
 30%|███       | 113237/371472 [9:00:14<19:18:13,  3.72it/s]
 30%|███       | 113238/371472 [9:00:15<18:32:39,  3.87it/s]
 30%|███       | 113239/371472 [9:00:15<18:46:06,  3.82it/s]
 30%|███       | 113240/371472 [9:00:15<18:30:55,  3.87it/s]
                                                            
{'loss': 3.3965, 'learning_rate': 7.259798745932901e-07, 'epoch': 4.88}

 30%|███       | 113240/371472 [9:00:15<18:30:55,  3.87it/s]
 30%|███       | 113241/371472 [9:00:15<17:59:00,  3.99it/s]
 30%|███       | 113242/371472 [9:00:16<18:02:47,  3.97it/s]
 30%|███       | 113243/371472 [9:00:16<18:47:13,  3.82it/s]
 30%|███       | 113244/371472 [9:00:16<19:01:31,  3.77it/s]
 30%|███       | 113245/371472 [9:00:17<18:59:04,  3.78it/s]
 30%|███       | 113246/371472 [9:00:17<18:58:05,  3.78it/s]
 30%|███       | 113247/371472 [9:00:17<18:37:22,  3.85it/s]
 30%|███       | 113248/371472 [9:00:17<18:43:47,  3.83it/s]
 30%|███       | 113249/371472 [9:00:18<24:53:41,  2.88it/s]
 30%|███       | 113250/371472 [9:00:18<23:34:34,  3.04it/s]
 30%|███       | 113251/371472 [9:00:18<22:46:15,  3.15it/s]
 30%|███       | 113252/371472 [9:00:19<21:49:44,  3.29it/s]
 30%|███       | 113253/371472 [9:00:19<21:16:12,  3.37it/s]
 30%|███       | 113254/371472 [9:00:19<20:36:45,  3.48it/s]
 30%|███       | 113255/371472 [9:00:20<23:20:16,  3.07it/s]
 30%|███       | 113256/371472 [9:00:20<22:10:07,  3.24it/s]
 30%|███       | 113257/371472 [9:00:20<22:06:11,  3.25it/s]
 30%|███       | 113258/371472 [9:00:21<21:45:54,  3.30it/s]
 30%|███       | 113259/371472 [9:00:21<23:48:07,  3.01it/s]
 30%|███       | 113260/371472 [9:00:21<21:48:27,  3.29it/s]
                                                            
{'loss': 3.3279, 'learning_rate': 7.259313926178111e-07, 'epoch': 4.88}

 30%|███       | 113260/371472 [9:00:21<21:48:27,  3.29it/s]
 30%|███       | 113261/371472 [9:00:21<21:34:19,  3.32it/s]
 30%|███       | 113262/371472 [9:00:22<21:12:15,  3.38it/s]
 30%|███       | 113263/371472 [9:00:22<21:39:35,  3.31it/s]
 30%|███       | 113264/371472 [9:00:22<20:47:42,  3.45it/s]
 30%|███       | 113265/371472 [9:00:23<20:27:36,  3.51it/s]
 30%|███       | 113266/371472 [9:00:23<20:24:33,  3.51it/s]
 30%|███       | 113267/371472 [9:00:23<20:13:09,  3.55it/s]
 30%|███       | 113268/371472 [9:00:23<19:29:31,  3.68it/s]
 30%|███       | 113269/371472 [9:00:24<19:32:11,  3.67it/s]
 30%|███       | 113270/371472 [9:00:24<19:33:50,  3.67it/s]
 30%|███       | 113271/371472 [9:00:24<19:09:05,  3.74it/s]
 30%|███       | 113272/371472 [9:00:24<19:16:40,  3.72it/s]
 30%|███       | 113273/371472 [9:00:25<19:22:48,  3.70it/s]
 30%|███       | 113274/371472 [9:00:25<20:34:32,  3.49it/s]
 30%|███       | 113275/371472 [9:00:25<23:11:51,  3.09it/s]
 30%|███       | 113276/371472 [9:00:26<22:04:59,  3.25it/s]
 30%|███       | 113277/371472 [9:00:26<21:26:46,  3.34it/s]
 30%|███       | 113278/371472 [9:00:26<22:26:59,  3.19it/s]
 30%|███       | 113279/371472 [9:00:27<21:15:49,  3.37it/s]
 30%|███       | 113280/371472 [9:00:27<26:04:55,  2.75it/s]
                                                            
{'loss': 3.5487, 'learning_rate': 7.258829106423322e-07, 'epoch': 4.88}

 30%|███       | 113280/371472 [9:00:27<26:04:55,  2.75it/s]
 30%|███       | 113281/371472 [9:00:27<23:50:10,  3.01it/s]
 30%|███       | 113282/371472 [9:00:28<22:15:18,  3.22it/s]
 30%|███       | 113283/371472 [9:00:28<20:56:39,  3.42it/s]
 30%|███       | 113284/371472 [9:00:28<20:42:18,  3.46it/s]
 30%|███       | 113285/371472 [9:00:28<20:07:55,  3.56it/s]
 30%|███       | 113286/371472 [9:00:29<19:51:10,  3.61it/s]
 30%|███       | 113287/371472 [9:00:29<19:22:04,  3.70it/s]
 30%|███       | 113288/371472 [9:00:29<20:03:25,  3.58it/s]
 30%|███       | 113289/371472 [9:00:30<19:31:11,  3.67it/s]
 30%|███       | 113290/371472 [9:00:30<20:20:06,  3.53it/s]
 30%|███       | 113291/371472 [9:00:30<20:19:11,  3.53it/s]
 30%|███       | 113292/371472 [9:00:30<20:36:40,  3.48it/s]
 30%|███       | 113293/371472 [9:00:31<19:52:59,  3.61it/s]
 30%|███       | 113294/371472 [9:00:31<20:53:28,  3.43it/s]
 30%|███       | 113295/371472 [9:00:31<20:48:59,  3.45it/s]
 30%|███       | 113296/371472 [9:00:32<20:28:10,  3.50it/s]
 30%|███       | 113297/371472 [9:00:32<20:11:13,  3.55it/s]
 30%|███       | 113298/371472 [9:00:32<19:57:42,  3.59it/s]
 31%|███       | 113299/371472 [9:00:32<19:21:07,  3.71it/s]
 31%|███       | 113300/371472 [9:00:33<20:21:42,  3.52it/s]
                                                            
{'loss': 3.3615, 'learning_rate': 7.258344286668534e-07, 'epoch': 4.88}

 31%|███       | 113300/371472 [9:00:33<20:21:42,  3.52it/s]
 31%|███       | 113301/371472 [9:00:33<20:09:44,  3.56it/s]
 31%|███       | 113302/371472 [9:00:33<19:50:45,  3.61it/s]
 31%|███       | 113303/371472 [9:00:33<19:32:17,  3.67it/s]
 31%|███       | 113304/371472 [9:00:34<19:18:25,  3.71it/s]
 31%|███       | 113305/371472 [9:00:34<20:32:58,  3.49it/s]
 31%|███       | 113306/371472 [9:00:34<21:30:55,  3.33it/s]
 31%|███       | 113307/371472 [9:00:35<21:16:25,  3.37it/s]
 31%|███       | 113308/371472 [9:00:35<20:10:01,  3.56it/s]
 31%|███       | 113309/371472 [9:00:35<20:15:34,  3.54it/s]
 31%|███       | 113310/371472 [9:00:35<19:30:41,  3.68it/s]
 31%|███       | 113311/371472 [9:00:36<19:24:49,  3.69it/s]
 31%|███       | 113312/371472 [9:00:36<19:29:19,  3.68it/s]
 31%|███       | 113313/371472 [9:00:36<20:56:34,  3.42it/s]
 31%|███       | 113314/371472 [9:00:37<23:25:26,  3.06it/s]
 31%|███       | 113315/371472 [9:00:37<22:22:13,  3.21it/s]
 31%|███       | 113316/371472 [9:00:37<21:59:04,  3.26it/s]
 31%|███       | 113317/371472 [9:00:38<21:39:50,  3.31it/s]
 31%|███       | 113318/371472 [9:00:38<22:04:43,  3.25it/s]
 31%|███       | 113319/371472 [9:00:38<21:41:48,  3.31it/s]
 31%|███       | 113320/371472 [9:00:39<22:07:37,  3.24it/s]
                                                            
{'loss': 3.2451, 'learning_rate': 7.257859466913745e-07, 'epoch': 4.88}

 31%|███       | 113320/371472 [9:00:39<22:07:37,  3.24it/s]
 31%|███       | 113321/371472 [9:00:39<23:24:02,  3.06it/s]
 31%|███       | 113322/371472 [9:00:39<22:11:21,  3.23it/s]
 31%|███       | 113323/371472 [9:00:39<21:51:34,  3.28it/s]
 31%|███       | 113324/371472 [9:00:40<21:26:11,  3.35it/s]
 31%|███       | 113325/371472 [9:00:40<21:41:05,  3.31it/s]
 31%|███       | 113326/371472 [9:00:40<20:35:09,  3.48it/s]
 31%|███       | 113327/371472 [9:00:41<20:15:57,  3.54it/s]
 31%|███       | 113328/371472 [9:00:41<21:57:25,  3.27it/s]
 31%|███       | 113329/371472 [9:00:41<20:25:09,  3.51it/s]
 31%|███       | 113330/371472 [9:00:41<19:39:18,  3.65it/s]
 31%|███       | 113331/371472 [9:00:42<19:45:23,  3.63it/s]
 31%|███       | 113332/371472 [9:00:42<19:57:59,  3.59it/s]
 31%|███       | 113333/371472 [9:00:42<19:58:44,  3.59it/s]
 31%|███       | 113334/371472 [9:00:43<19:18:36,  3.71it/s]
 31%|███       | 113335/371472 [9:00:43<19:13:03,  3.73it/s]
 31%|███       | 113336/371472 [9:00:43<20:06:10,  3.57it/s]
 31%|███       | 113337/371472 [9:00:43<21:39:37,  3.31it/s]
 31%|███       | 113338/371472 [9:00:44<22:11:09,  3.23it/s]
 31%|███       | 113339/371472 [9:00:44<22:08:25,  3.24it/s]
 31%|███       | 113340/371472 [9:00:44<22:02:22,  3.25it/s]
                                                            
{'loss': 3.2804, 'learning_rate': 7.257374647158956e-07, 'epoch': 4.88}

 31%|███       | 113340/371472 [9:00:44<22:02:22,  3.25it/s]
 31%|███       | 113341/371472 [9:00:45<22:39:20,  3.16it/s]
 31%|███       | 113342/371472 [9:00:45<21:24:59,  3.35it/s]
 31%|███       | 113343/371472 [9:00:45<19:59:33,  3.59it/s]
 31%|███       | 113344/371472 [9:00:46<19:54:53,  3.60it/s]
 31%|███       | 113345/371472 [9:00:46<19:59:45,  3.59it/s]
 31%|███       | 113346/371472 [9:00:46<19:47:07,  3.62it/s]
 31%|███       | 113347/371472 [9:00:46<19:06:18,  3.75it/s]
 31%|███       | 113348/371472 [9:00:47<18:46:54,  3.82it/s]
 31%|███       | 113349/371472 [9:00:47<19:20:48,  3.71it/s]
 31%|███       | 113350/371472 [9:00:47<19:58:40,  3.59it/s]
 31%|███       | 113351/371472 [9:00:47<19:33:05,  3.67it/s]
 31%|███       | 113352/371472 [9:00:48<19:37:39,  3.65it/s]
 31%|███       | 113353/371472 [9:00:48<20:23:13,  3.52it/s]
 31%|███       | 113354/371472 [9:00:48<21:24:19,  3.35it/s]
 31%|███       | 113355/371472 [9:00:49<21:12:26,  3.38it/s]
 31%|███       | 113356/371472 [9:00:49<20:14:03,  3.54it/s]
 31%|███       | 113357/371472 [9:00:49<21:34:53,  3.32it/s]
 31%|███       | 113358/371472 [9:00:50<21:56:17,  3.27it/s]
 31%|███       | 113359/371472 [9:00:50<21:09:37,  3.39it/s]
 31%|███       | 113360/371472 [9:00:50<20:55:21,  3.43it/s]
                                                            
{'loss': 3.2816, 'learning_rate': 7.256889827404167e-07, 'epoch': 4.88}

 31%|███       | 113360/371472 [9:00:50<20:55:21,  3.43it/s]
 31%|███       | 113361/371472 [9:00:50<20:40:34,  3.47it/s]
 31%|███       | 113362/371472 [9:00:51<22:14:42,  3.22it/s]
 31%|███       | 113363/371472 [9:00:51<21:11:16,  3.38it/s]
 31%|███       | 113364/371472 [9:00:51<20:38:14,  3.47it/s]
 31%|███       | 113365/371472 [9:00:52<19:53:18,  3.60it/s]
 31%|███       | 113366/371472 [9:00:52<19:55:23,  3.60it/s]
 31%|███       | 113367/371472 [9:00:52<19:39:56,  3.65it/s]
 31%|███       | 113368/371472 [9:00:52<19:36:40,  3.66it/s]
 31%|███       | 113369/371472 [9:00:53<19:35:11,  3.66it/s]
 31%|███       | 113370/371472 [9:00:53<19:34:19,  3.66it/s]
 31%|███       | 113371/371472 [9:00:53<20:27:06,  3.51it/s]
 31%|███       | 113372/371472 [9:00:54<21:25:04,  3.35it/s]
 31%|███       | 113373/371472 [9:00:54<21:02:39,  3.41it/s]
 31%|███       | 113374/371472 [9:00:54<20:38:53,  3.47it/s]
 31%|███       | 113375/371472 [9:00:54<20:33:55,  3.49it/s]
 31%|███       | 113376/371472 [9:00:55<22:35:47,  3.17it/s]
 31%|███       | 113377/371472 [9:00:55<21:20:42,  3.36it/s]
 31%|███       | 113378/371472 [9:00:55<21:56:56,  3.27it/s]
 31%|███       | 113379/371472 [9:00:56<22:07:11,  3.24it/s]
 31%|███       | 113380/371472 [9:00:56<20:37:05,  3.48it/s]
                                                            
{'loss': 3.1812, 'learning_rate': 7.256405007649378e-07, 'epoch': 4.88}

 31%|███       | 113380/371472 [9:00:56<20:37:05,  3.48it/s]
 31%|███       | 113381/371472 [9:00:56<20:31:41,  3.49it/s]
 31%|███       | 113382/371472 [9:00:56<21:20:55,  3.36it/s]
 31%|███       | 113383/371472 [9:00:57<20:52:30,  3.43it/s]
 31%|███       | 113384/371472 [9:00:57<20:11:08,  3.55it/s]
 31%|███       | 113385/371472 [9:00:57<19:33:37,  3.67it/s]
 31%|███       | 113386/371472 [9:00:58<20:22:43,  3.52it/s]
 31%|███       | 113387/371472 [9:00:58<19:45:22,  3.63it/s]
 31%|███       | 113388/371472 [9:00:58<20:03:54,  3.57it/s]
 31%|███       | 113389/371472 [9:00:58<20:10:24,  3.55it/s]
 31%|███       | 113390/371472 [9:00:59<20:24:31,  3.51it/s]
 31%|███       | 113391/371472 [9:00:59<20:19:05,  3.53it/s]
 31%|███       | 113392/371472 [9:00:59<20:04:00,  3.57it/s]
 31%|███       | 113393/371472 [9:01:00<20:48:04,  3.45it/s]
 31%|███       | 113394/371472 [9:01:00<20:59:37,  3.41it/s]
 31%|███       | 113395/371472 [9:01:00<21:01:49,  3.41it/s]
 31%|███       | 113396/371472 [9:01:00<21:00:52,  3.41it/s]
 31%|███       | 113397/371472 [9:01:01<19:56:11,  3.60it/s]
 31%|███       | 113398/371472 [9:01:01<20:46:58,  3.45it/s]
 31%|███       | 113399/371472 [9:01:01<19:59:53,  3.58it/s]
 31%|███       | 113400/371472 [9:01:02<20:30:22,  3.50it/s]
                                                            
{'loss': 3.4344, 'learning_rate': 7.255920187894589e-07, 'epoch': 4.88}

 31%|███       | 113400/371472 [9:01:02<20:30:22,  3.50it/s]
 31%|███       | 113401/371472 [9:01:02<20:32:48,  3.49it/s]
 31%|███       | 113402/371472 [9:01:02<20:05:51,  3.57it/s]
 31%|███       | 113403/371472 [9:01:02<20:57:00,  3.42it/s]
 31%|███       | 113404/371472 [9:01:03<20:55:18,  3.43it/s]
 31%|███       | 113405/371472 [9:01:03<20:14:40,  3.54it/s]
 31%|███       | 113406/371472 [9:01:03<19:55:31,  3.60it/s]
 31%|███       | 113407/371472 [9:01:04<20:01:04,  3.58it/s]
 31%|███       | 113408/371472 [9:01:04<20:18:16,  3.53it/s]
 31%|███       | 113409/371472 [9:01:04<19:35:18,  3.66it/s]
 31%|███       | 113410/371472 [9:01:04<20:37:27,  3.48it/s]
 31%|███       | 113411/371472 [9:01:05<20:35:46,  3.48it/s]
 31%|███       | 113412/371472 [9:01:05<23:14:08,  3.09it/s]
 31%|███       | 113413/371472 [9:01:05<23:11:08,  3.09it/s]
 31%|███       | 113414/371472 [9:01:06<23:31:43,  3.05it/s]
 31%|███       | 113415/371472 [9:01:06<22:52:50,  3.13it/s]
 31%|███       | 113416/371472 [9:01:06<22:05:24,  3.24it/s]
 31%|███       | 113417/371472 [9:01:07<20:56:09,  3.42it/s]
 31%|███       | 113418/371472 [9:01:07<20:03:00,  3.58it/s]
 31%|███       | 113419/371472 [9:01:07<19:20:20,  3.71it/s]
 31%|███       | 113420/371472 [9:01:07<19:03:57,  3.76it/s]
                                                            
{'loss': 3.5236, 'learning_rate': 7.2554353681398e-07, 'epoch': 4.89}

 31%|███       | 113420/371472 [9:01:07<19:03:57,  3.76it/s]
 31%|███       | 113421/371472 [9:01:08<19:00:06,  3.77it/s]
 31%|███       | 113422/371472 [9:01:08<19:23:24,  3.70it/s]
 31%|███       | 113423/371472 [9:01:08<20:00:54,  3.58it/s]
 31%|███       | 113424/371472 [9:01:09<21:03:27,  3.40it/s]
 31%|███       | 113425/371472 [9:01:09<20:34:38,  3.48it/s]
 31%|███       | 113426/371472 [9:01:09<21:13:35,  3.38it/s]
 31%|███       | 113427/371472 [9:01:09<20:53:59,  3.43it/s]
 31%|███       | 113428/371472 [9:01:10<20:23:11,  3.52it/s]
 31%|███       | 113429/371472 [9:01:10<20:12:31,  3.55it/s]
 31%|███       | 113430/371472 [9:01:10<20:44:30,  3.46it/s]
 31%|███       | 113431/371472 [9:01:11<20:25:16,  3.51it/s]
 31%|███       | 113432/371472 [9:01:11<20:10:17,  3.55it/s]
 31%|███       | 113433/371472 [9:01:11<22:11:13,  3.23it/s]
 31%|███       | 113434/371472 [9:01:11<20:57:55,  3.42it/s]
 31%|███       | 113435/371472 [9:01:12<21:27:59,  3.34it/s]
 31%|███       | 113436/371472 [9:01:12<21:10:37,  3.38it/s]
 31%|███       | 113437/371472 [9:01:12<22:06:00,  3.24it/s]
 31%|███       | 113438/371472 [9:01:13<21:21:11,  3.36it/s]
 31%|███       | 113439/371472 [9:01:13<21:48:16,  3.29it/s]
 31%|███       | 113440/371472 [9:01:13<22:17:48,  3.21it/s]
                                                            
{'loss': 3.4669, 'learning_rate': 7.254950548385011e-07, 'epoch': 4.89}

 31%|███       | 113440/371472 [9:01:13<22:17:48,  3.21it/s]
 31%|███       | 113441/371472 [9:01:14<21:39:46,  3.31it/s]
 31%|███       | 113442/371472 [9:01:14<20:26:32,  3.51it/s]
 31%|███       | 113443/371472 [9:01:14<20:37:26,  3.48it/s]
 31%|███       | 113444/371472 [9:01:14<20:46:15,  3.45it/s]
 31%|███       | 113445/371472 [9:01:15<20:55:10,  3.43it/s]
 31%|███       | 113446/371472 [9:01:15<20:11:14,  3.55it/s]
 31%|███       | 113447/371472 [9:01:15<19:17:46,  3.71it/s]
 31%|███       | 113448/371472 [9:01:15<19:04:10,  3.76it/s]
 31%|███       | 113449/371472 [9:01:16<19:05:19,  3.75it/s]
 31%|███       | 113450/371472 [9:01:16<19:21:40,  3.70it/s]
 31%|███       | 113451/371472 [9:01:16<18:54:53,  3.79it/s]
 31%|███       | 113452/371472 [9:01:16<18:28:41,  3.88it/s]
 31%|███       | 113453/371472 [9:01:17<18:20:08,  3.91it/s]
 31%|███       | 113454/371472 [9:01:17<18:06:19,  3.96it/s]
 31%|███       | 113455/371472 [9:01:17<20:14:51,  3.54it/s]
 31%|███       | 113456/371472 [9:01:18<19:47:21,  3.62it/s]
 31%|███       | 113457/371472 [9:01:18<21:45:23,  3.29it/s]
 31%|███       | 113458/371472 [9:01:18<21:37:01,  3.32it/s]
 31%|███       | 113459/371472 [9:01:19<20:51:18,  3.44it/s]
 31%|███       | 113460/371472 [9:01:19<20:16:18,  3.54it/s]
                                                            
{'loss': 3.7011, 'learning_rate': 7.254465728630223e-07, 'epoch': 4.89}

 31%|███       | 113460/371472 [9:01:19<20:16:18,  3.54it/s]
 31%|███       | 113461/371472 [9:01:19<20:41:45,  3.46it/s]
 31%|███       | 113462/371472 [9:01:19<20:19:18,  3.53it/s]
 31%|███       | 113463/371472 [9:01:20<21:00:30,  3.41it/s]
 31%|███       | 113464/371472 [9:01:20<19:48:56,  3.62it/s]
 31%|███       | 113465/371472 [9:01:20<21:24:52,  3.35it/s]
 31%|███       | 113466/371472 [9:01:21<20:24:41,  3.51it/s]
 31%|███       | 113467/371472 [9:01:21<19:04:39,  3.76it/s]
 31%|███       | 113468/371472 [9:01:21<18:52:58,  3.80it/s]
 31%|███       | 113469/371472 [9:01:21<19:23:49,  3.69it/s]
 31%|███       | 113470/371472 [9:01:22<19:46:56,  3.62it/s]
 31%|███       | 113471/371472 [9:01:22<19:14:04,  3.73it/s]
 31%|███       | 113472/371472 [9:01:22<19:04:59,  3.76it/s]
 31%|███       | 113473/371472 [9:01:22<19:24:05,  3.69it/s]
 31%|███       | 113474/371472 [9:01:23<19:03:07,  3.76it/s]
 31%|███       | 113475/371472 [9:01:23<19:17:34,  3.71it/s]
 31%|███       | 113476/371472 [9:01:23<18:58:53,  3.78it/s]
 31%|███       | 113477/371472 [9:01:23<19:40:32,  3.64it/s]
 31%|███       | 113478/371472 [9:01:24<19:03:15,  3.76it/s]
 31%|███       | 113479/371472 [9:01:24<19:33:25,  3.66it/s]
 31%|███       | 113480/371472 [9:01:24<19:30:42,  3.67it/s]
                                                            
{'loss': 3.3601, 'learning_rate': 7.253980908875434e-07, 'epoch': 4.89}

 31%|███       | 113480/371472 [9:01:24<19:30:42,  3.67it/s]
 31%|███       | 113481/371472 [9:01:25<19:04:42,  3.76it/s]
 31%|███       | 113482/371472 [9:01:25<18:54:01,  3.79it/s]
 31%|███       | 113483/371472 [9:01:25<19:04:11,  3.76it/s]
 31%|███       | 113484/371472 [9:01:25<18:58:14,  3.78it/s]
 31%|███       | 113485/371472 [9:01:26<18:42:13,  3.83it/s]
 31%|███       | 113486/371472 [9:01:26<18:44:32,  3.82it/s]
 31%|███       | 113487/371472 [9:01:26<18:19:44,  3.91it/s]
 31%|███       | 113488/371472 [9:01:26<19:13:47,  3.73it/s]
 31%|███       | 113489/371472 [9:01:27<18:59:38,  3.77it/s]
 31%|███       | 113490/371472 [9:01:27<19:08:48,  3.74it/s]
 31%|███       | 113491/371472 [9:01:27<19:06:41,  3.75it/s]
 31%|███       | 113492/371472 [9:01:27<18:44:41,  3.82it/s]
 31%|███       | 113493/371472 [9:01:28<18:31:17,  3.87it/s]
 31%|███       | 113494/371472 [9:01:28<18:13:02,  3.93it/s]
 31%|███       | 113495/371472 [9:01:28<18:47:56,  3.81it/s]
 31%|███       | 113496/371472 [9:01:28<18:50:00,  3.80it/s]
 31%|███       | 113497/371472 [9:01:29<18:48:58,  3.81it/s]
 31%|███       | 113498/371472 [9:01:29<18:33:37,  3.86it/s]
 31%|███       | 113499/371472 [9:01:29<19:13:03,  3.73it/s]
 31%|███       | 113500/371472 [9:01:30<20:49:45,  3.44it/s]
                                                            
{'loss': 3.3322, 'learning_rate': 7.253496089120644e-07, 'epoch': 4.89}

 31%|███       | 113500/371472 [9:01:30<20:49:45,  3.44it/s]
 31%|███       | 113501/371472 [9:01:30<20:49:07,  3.44it/s]
 31%|███       | 113502/371472 [9:01:30<20:00:31,  3.58it/s]
 31%|███       | 113503/371472 [9:01:30<20:14:58,  3.54it/s]
 31%|███       | 113504/371472 [9:01:31<20:14:15,  3.54it/s]
 31%|███       | 113505/371472 [9:01:31<19:24:25,  3.69it/s]
 31%|███       | 113506/371472 [9:01:31<19:39:37,  3.64it/s]
 31%|███       | 113507/371472 [9:01:31<18:55:12,  3.79it/s]
 31%|███       | 113508/371472 [9:01:32<18:51:51,  3.80it/s]
 31%|███       | 113509/371472 [9:01:32<20:00:08,  3.58it/s]
 31%|███       | 113510/371472 [9:01:32<19:54:16,  3.60it/s]
 31%|███       | 113511/371472 [9:01:33<19:41:31,  3.64it/s]
 31%|███       | 113512/371472 [9:01:33<19:04:08,  3.76it/s]
 31%|███       | 113513/371472 [9:01:33<19:50:15,  3.61it/s]
 31%|███       | 113514/371472 [9:01:33<20:45:24,  3.45it/s]
 31%|███       | 113515/371472 [9:01:34<21:10:52,  3.38it/s]
 31%|███       | 113516/371472 [9:01:34<21:56:03,  3.27it/s]
 31%|███       | 113517/371472 [9:01:34<21:06:02,  3.40it/s]
 31%|███       | 113518/371472 [9:01:35<20:06:04,  3.56it/s]
 31%|███       | 113519/371472 [9:01:35<20:22:11,  3.52it/s]
 31%|███       | 113520/371472 [9:01:35<20:11:39,  3.55it/s]
                                                            
{'loss': 3.3331, 'learning_rate': 7.253011269365855e-07, 'epoch': 4.89}

 31%|███       | 113520/371472 [9:01:35<20:11:39,  3.55it/s]
 31%|███       | 113521/371472 [9:01:35<19:27:36,  3.68it/s]
 31%|███       | 113522/371472 [9:01:36<19:00:44,  3.77it/s]
 31%|███       | 113523/371472 [9:01:36<19:58:32,  3.59it/s]
 31%|███       | 113524/371472 [9:01:36<19:46:23,  3.62it/s]
 31%|███       | 113525/371472 [9:01:37<22:29:47,  3.19it/s]
 31%|███       | 113526/371472 [9:01:37<21:57:18,  3.26it/s]
 31%|███       | 113527/371472 [9:01:37<20:51:50,  3.43it/s]
 31%|███       | 113528/371472 [9:01:37<20:41:20,  3.46it/s]
 31%|███       | 113529/371472 [9:01:38<21:47:51,  3.29it/s]
 31%|███       | 113530/371472 [9:01:38<22:32:19,  3.18it/s]
 31%|███       | 113531/371472 [9:01:38<21:33:03,  3.32it/s]
 31%|███       | 113532/371472 [9:01:39<21:08:34,  3.39it/s]
 31%|███       | 113533/371472 [9:01:39<21:05:13,  3.40it/s]
 31%|███       | 113534/371472 [9:01:39<21:59:42,  3.26it/s]
 31%|███       | 113535/371472 [9:01:40<21:43:52,  3.30it/s]
 31%|███       | 113536/371472 [9:01:40<20:55:03,  3.43it/s]
 31%|███       | 113537/371472 [9:01:40<21:44:14,  3.30it/s]
 31%|███       | 113538/371472 [9:01:41<22:27:44,  3.19it/s]
 31%|███       | 113539/371472 [9:01:41<22:14:46,  3.22it/s]
 31%|███       | 113540/371472 [9:01:41<21:19:04,  3.36it/s]
                                                            
{'loss': 3.4049, 'learning_rate': 7.252526449611067e-07, 'epoch': 4.89}

 31%|███       | 113540/371472 [9:01:41<21:19:04,  3.36it/s]
 31%|███       | 113541/371472 [9:01:41<20:33:34,  3.48it/s]
 31%|███       | 113542/371472 [9:01:42<21:46:52,  3.29it/s]
 31%|███       | 113543/371472 [9:01:42<22:02:32,  3.25it/s]
 31%|███       | 113544/371472 [9:01:42<21:33:33,  3.32it/s]
 31%|███       | 113545/371472 [9:01:43<21:02:37,  3.40it/s]
 31%|███       | 113546/371472 [9:01:43<22:24:21,  3.20it/s]
 31%|███       | 113547/371472 [9:01:43<23:42:02,  3.02it/s]
 31%|███       | 113548/371472 [9:01:44<22:03:43,  3.25it/s]
 31%|███       | 113549/371472 [9:01:44<21:42:00,  3.30it/s]
 31%|███       | 113550/371472 [9:01:44<22:22:17,  3.20it/s]
 31%|███       | 113551/371472 [9:01:45<21:47:05,  3.29it/s]
 31%|███       | 113552/371472 [9:01:45<23:27:41,  3.05it/s]
 31%|███       | 113553/371472 [9:01:45<23:00:10,  3.11it/s]
 31%|███       | 113554/371472 [9:01:45<21:20:15,  3.36it/s]
 31%|███       | 113555/371472 [9:01:46<20:14:49,  3.54it/s]
 31%|███       | 113556/371472 [9:01:46<19:42:43,  3.63it/s]
 31%|███       | 113557/371472 [9:01:46<19:31:27,  3.67it/s]
 31%|███       | 113558/371472 [9:01:46<18:33:02,  3.86it/s]
 31%|███       | 113559/371472 [9:01:47<18:23:25,  3.90it/s]
 31%|███       | 113560/371472 [9:01:47<19:48:23,  3.62it/s]
                                                            
{'loss': 3.3272, 'learning_rate': 7.252041629856278e-07, 'epoch': 4.89}

 31%|███       | 113560/371472 [9:01:47<19:48:23,  3.62it/s]
 31%|███       | 113561/371472 [9:01:47<19:30:38,  3.67it/s]
 31%|███       | 113562/371472 [9:01:48<19:00:20,  3.77it/s]
 31%|███       | 113563/371472 [9:01:48<19:14:58,  3.72it/s]
 31%|███       | 113564/371472 [9:01:48<20:07:50,  3.56it/s]
 31%|███       | 113565/371472 [9:01:48<20:03:13,  3.57it/s]
 31%|███       | 113566/371472 [9:01:49<19:23:14,  3.70it/s]
 31%|███       | 113567/371472 [9:01:49<19:39:02,  3.65it/s]
 31%|███       | 113568/371472 [9:01:49<21:21:36,  3.35it/s]
 31%|███       | 113569/371472 [9:01:50<22:30:20,  3.18it/s]
 31%|███       | 113570/371472 [9:01:50<22:03:24,  3.25it/s]
 31%|███       | 113571/371472 [9:01:50<20:47:53,  3.44it/s]
 31%|███       | 113572/371472 [9:01:50<20:35:17,  3.48it/s]
 31%|███       | 113573/371472 [9:01:51<20:02:39,  3.57it/s]
 31%|███       | 113574/371472 [9:01:51<20:12:31,  3.54it/s]
 31%|███       | 113575/371472 [9:01:51<19:29:00,  3.68it/s]
 31%|███       | 113576/371472 [9:01:52<19:21:26,  3.70it/s]
 31%|███       | 113577/371472 [9:01:52<19:26:26,  3.68it/s]
 31%|███       | 113578/371472 [9:01:52<19:19:08,  3.71it/s]
 31%|███       | 113579/371472 [9:01:52<21:01:22,  3.41it/s]
 31%|███       | 113580/371472 [9:01:53<20:04:25,  3.57it/s]
                                                            
{'loss': 3.217, 'learning_rate': 7.251556810101489e-07, 'epoch': 4.89}

 31%|███       | 113580/371472 [9:01:53<20:04:25,  3.57it/s]
 31%|███       | 113581/371472 [9:01:53<20:17:07,  3.53it/s]
 31%|███       | 113582/371472 [9:01:53<20:01:13,  3.58it/s]
 31%|███       | 113583/371472 [9:01:53<19:38:49,  3.65it/s]
 31%|███       | 113584/371472 [9:01:54<19:04:42,  3.75it/s]
 31%|███       | 113585/371472 [9:01:54<20:38:20,  3.47it/s]
 31%|███       | 113586/371472 [9:01:54<21:47:56,  3.29it/s]
 31%|███       | 113587/371472 [9:01:55<20:58:17,  3.42it/s]
 31%|███       | 113588/371472 [9:01:55<20:17:00,  3.53it/s]
 31%|███       | 113589/371472 [9:01:55<19:38:52,  3.65it/s]
 31%|███       | 113590/371472 [9:01:55<19:02:01,  3.76it/s]
 31%|███       | 113591/371472 [9:01:56<18:42:10,  3.83it/s]
 31%|███       | 113592/371472 [9:01:56<19:01:35,  3.76it/s]
 31%|███       | 113593/371472 [9:01:56<19:37:13,  3.65it/s]
 31%|███       | 113594/371472 [9:01:57<19:36:26,  3.65it/s]
 31%|███       | 113595/371472 [9:01:57<19:23:05,  3.70it/s]
 31%|███       | 113596/371472 [9:01:57<20:12:20,  3.55it/s]
 31%|███       | 113597/371472 [9:01:57<19:45:19,  3.63it/s]
 31%|███       | 113598/371472 [9:01:58<19:01:51,  3.76it/s]
 31%|███       | 113599/371472 [9:01:58<19:56:35,  3.59it/s]
 31%|███       | 113600/371472 [9:01:58<19:53:11,  3.60it/s]
                                                            
{'loss': 3.275, 'learning_rate': 7.2510719903467e-07, 'epoch': 4.89}

 31%|███       | 113600/371472 [9:01:58<19:53:11,  3.60it/s]
 31%|███       | 113601/371472 [9:01:59<21:08:22,  3.39it/s]
 31%|███       | 113602/371472 [9:01:59<20:10:59,  3.55it/s]
 31%|███       | 113603/371472 [9:01:59<19:13:43,  3.73it/s]
 31%|███       | 113604/371472 [9:01:59<19:28:02,  3.68it/s]
 31%|███       | 113605/371472 [9:02:00<18:44:47,  3.82it/s]
 31%|███       | 113606/371472 [9:02:00<19:04:15,  3.76it/s]
 31%|███       | 113607/371472 [9:02:00<19:27:53,  3.68it/s]
 31%|███       | 113608/371472 [9:02:00<19:03:04,  3.76it/s]
 31%|███       | 113609/371472 [9:02:01<18:55:45,  3.78it/s]
 31%|███       | 113610/371472 [9:02:01<19:07:22,  3.75it/s]
 31%|███       | 113611/371472 [9:02:01<18:40:22,  3.84it/s]
 31%|███       | 113612/371472 [9:02:01<18:43:46,  3.82it/s]
 31%|███       | 113613/371472 [9:02:02<20:17:36,  3.53it/s]
 31%|███       | 113614/371472 [9:02:02<19:50:57,  3.61it/s]
 31%|███       | 113615/371472 [9:02:02<20:12:15,  3.55it/s]
 31%|███       | 113616/371472 [9:02:03<20:12:34,  3.54it/s]
 31%|███       | 113617/371472 [9:02:03<19:16:53,  3.71it/s]
 31%|███       | 113618/371472 [9:02:03<18:54:58,  3.79it/s]
 31%|███       | 113619/371472 [9:02:03<20:22:17,  3.52it/s]
 31%|███       | 113620/371472 [9:02:04<20:04:54,  3.57it/s]
                                                            
{'loss': 3.5163, 'learning_rate': 7.250587170591911e-07, 'epoch': 4.89}

 31%|███       | 113620/371472 [9:02:04<20:04:54,  3.57it/s]
 31%|███       | 113621/371472 [9:02:04<19:38:23,  3.65it/s]
 31%|███       | 113622/371472 [9:02:04<19:55:15,  3.60it/s]
 31%|███       | 113623/371472 [9:02:04<19:34:20,  3.66it/s]
 31%|███       | 113624/371472 [9:02:05<19:40:33,  3.64it/s]
 31%|███       | 113625/371472 [9:02:05<19:02:11,  3.76it/s]
 31%|███       | 113626/371472 [9:02:05<18:42:13,  3.83it/s]
 31%|███       | 113627/371472 [9:02:06<19:25:26,  3.69it/s]
 31%|███       | 113628/371472 [9:02:06<19:07:49,  3.74it/s]
 31%|███       | 113629/371472 [9:02:06<19:21:06,  3.70it/s]
 31%|███       | 113630/371472 [9:02:06<19:12:15,  3.73it/s]
 31%|███       | 113631/371472 [9:02:07<20:33:14,  3.48it/s]
 31%|███       | 113632/371472 [9:02:07<20:53:28,  3.43it/s]
 31%|███       | 113633/371472 [9:02:07<20:30:22,  3.49it/s]
 31%|███       | 113634/371472 [9:02:08<20:37:56,  3.47it/s]
 31%|███       | 113635/371472 [9:02:08<19:58:45,  3.58it/s]
 31%|███       | 113636/371472 [9:02:08<20:35:51,  3.48it/s]
 31%|███       | 113637/371472 [9:02:08<21:34:52,  3.32it/s]
 31%|███       | 113638/371472 [9:02:09<20:40:55,  3.46it/s]
 31%|███       | 113639/371472 [9:02:09<20:15:55,  3.53it/s]
 31%|███       | 113640/371472 [9:02:09<19:58:38,  3.59it/s]
                                                            
{'loss': 3.372, 'learning_rate': 7.250102350837121e-07, 'epoch': 4.89}

 31%|███       | 113640/371472 [9:02:09<19:58:38,  3.59it/s]
 31%|███       | 113641/371472 [9:02:09<19:23:21,  3.69it/s]
 31%|███       | 113642/371472 [9:02:10<19:09:14,  3.74it/s]
 31%|███       | 113643/371472 [9:02:10<19:01:50,  3.76it/s]
 31%|███       | 113644/371472 [9:02:10<19:09:20,  3.74it/s]
 31%|███       | 113645/371472 [9:02:11<18:49:19,  3.81it/s]
 31%|███       | 113646/371472 [9:02:11<18:44:44,  3.82it/s]
 31%|███       | 113647/371472 [9:02:11<18:41:42,  3.83it/s]
 31%|███       | 113648/371472 [9:02:11<20:06:25,  3.56it/s]
 31%|███       | 113649/371472 [9:02:12<20:17:33,  3.53it/s]
 31%|███       | 113650/371472 [9:02:12<19:31:04,  3.67it/s]
 31%|███       | 113651/371472 [9:02:12<19:29:33,  3.67it/s]
 31%|███       | 113652/371472 [9:02:12<19:56:54,  3.59it/s]
 31%|███       | 113653/371472 [9:02:13<21:05:52,  3.39it/s]
 31%|███       | 113654/371472 [9:02:13<20:42:33,  3.46it/s]
 31%|███       | 113655/371472 [9:02:13<20:17:02,  3.53it/s]
 31%|███       | 113656/371472 [9:02:14<19:33:19,  3.66it/s]
 31%|███       | 113657/371472 [9:02:14<19:22:13,  3.70it/s]
 31%|███       | 113658/371472 [9:02:14<19:25:33,  3.69it/s]
 31%|███       | 113659/371472 [9:02:14<19:53:14,  3.60it/s]
 31%|███       | 113660/371472 [9:02:15<19:36:41,  3.65it/s]
                                                            
{'loss': 3.4274, 'learning_rate': 7.249617531082332e-07, 'epoch': 4.9}

 31%|███       | 113660/371472 [9:02:15<19:36:41,  3.65it/s]
 31%|███       | 113661/371472 [9:02:15<19:02:26,  3.76it/s]
 31%|███       | 113662/371472 [9:02:15<19:48:54,  3.61it/s]
 31%|███       | 113663/371472 [9:02:16<20:03:47,  3.57it/s]
 31%|███       | 113664/371472 [9:02:16<21:36:49,  3.31it/s]
 31%|███       | 113665/371472 [9:02:16<20:32:20,  3.49it/s]
 31%|███       | 113666/371472 [9:02:16<20:05:18,  3.56it/s]
 31%|███       | 113667/371472 [9:02:17<19:54:19,  3.60it/s]
 31%|███       | 113668/371472 [9:02:17<20:33:58,  3.48it/s]
 31%|███       | 113669/371472 [9:02:17<19:48:50,  3.61it/s]
 31%|███       | 113670/371472 [9:02:18<19:56:19,  3.59it/s]
 31%|███       | 113671/371472 [9:02:18<19:48:10,  3.62it/s]
 31%|███       | 113672/371472 [9:02:18<18:58:39,  3.77it/s]
 31%|███       | 113673/371472 [9:02:18<19:33:27,  3.66it/s]
 31%|███       | 113674/371472 [9:02:19<19:42:38,  3.63it/s]
 31%|███       | 113675/371472 [9:02:19<20:04:10,  3.57it/s]
 31%|███       | 113676/371472 [9:02:19<20:10:06,  3.55it/s]
 31%|███       | 113677/371472 [9:02:19<19:30:37,  3.67it/s]
 31%|███       | 113678/371472 [9:02:20<19:17:01,  3.71it/s]
 31%|███       | 113679/371472 [9:02:20<20:43:10,  3.46it/s]
 31%|███       | 113680/371472 [9:02:20<20:27:40,  3.50it/s]
                                                            
{'loss': 3.2712, 'learning_rate': 7.249132711327544e-07, 'epoch': 4.9}

 31%|███       | 113680/371472 [9:02:20<20:27:40,  3.50it/s]
 31%|███       | 113681/371472 [9:02:21<21:26:25,  3.34it/s]
 31%|███       | 113682/371472 [9:02:21<20:53:50,  3.43it/s]
 31%|███       | 113683/371472 [9:02:21<19:56:35,  3.59it/s]
 31%|███       | 113684/371472 [9:02:21<20:21:01,  3.52it/s]
 31%|███       | 113685/371472 [9:02:22<20:21:31,  3.52it/s]
 31%|███       | 113686/371472 [9:02:22<20:19:26,  3.52it/s]
 31%|███       | 113687/371472 [9:02:22<21:07:55,  3.39it/s]
 31%|███       | 113688/371472 [9:02:23<20:27:24,  3.50it/s]
 31%|███       | 113689/371472 [9:02:23<19:55:46,  3.59it/s]
 31%|███       | 113690/371472 [9:02:23<21:04:38,  3.40it/s]
 31%|███       | 113691/371472 [9:02:24<21:38:38,  3.31it/s]
 31%|███       | 113692/371472 [9:02:24<21:01:05,  3.41it/s]
 31%|███       | 113693/371472 [9:02:24<20:03:26,  3.57it/s]
 31%|███       | 113694/371472 [9:02:24<19:17:42,  3.71it/s]
 31%|███       | 113695/371472 [9:02:25<19:10:04,  3.74it/s]
 31%|███       | 113696/371472 [9:02:25<20:26:01,  3.50it/s]
 31%|███       | 113697/371472 [9:02:25<20:33:07,  3.48it/s]
 31%|███       | 113698/371472 [9:02:25<21:18:04,  3.36it/s]
 31%|███       | 113699/371472 [9:02:26<20:46:20,  3.45it/s]
 31%|███       | 113700/371472 [9:02:26<20:47:04,  3.45it/s]
                                                            
{'loss': 3.2933, 'learning_rate': 7.248647891572755e-07, 'epoch': 4.9}

 31%|███       | 113700/371472 [9:02:26<20:47:04,  3.45it/s]
 31%|███       | 113701/371472 [9:02:26<20:51:02,  3.43it/s]
 31%|███       | 113702/371472 [9:02:27<20:56:57,  3.42it/s]
 31%|███       | 113703/371472 [9:02:27<21:08:29,  3.39it/s]
 31%|███       | 113704/371472 [9:02:27<20:33:08,  3.48it/s]
 31%|███       | 113705/371472 [9:02:28<20:28:19,  3.50it/s]
 31%|███       | 113706/371472 [9:02:28<20:47:35,  3.44it/s]
 31%|███       | 113707/371472 [9:02:28<20:28:33,  3.50it/s]
 31%|███       | 113708/371472 [9:02:28<21:45:37,  3.29it/s]
 31%|███       | 113709/371472 [9:02:29<21:02:32,  3.40it/s]
 31%|███       | 113710/371472 [9:02:29<20:11:47,  3.55it/s]
 31%|███       | 113711/371472 [9:02:29<21:15:28,  3.37it/s]
 31%|███       | 113712/371472 [9:02:30<20:53:12,  3.43it/s]
 31%|███       | 113713/371472 [9:02:30<21:38:26,  3.31it/s]
 31%|███       | 113714/371472 [9:02:30<20:23:48,  3.51it/s]
 31%|███       | 113715/371472 [9:02:30<19:33:10,  3.66it/s]
 31%|███       | 113716/371472 [9:02:31<20:57:50,  3.42it/s]
 31%|███       | 113717/371472 [9:02:31<20:44:49,  3.45it/s]
 31%|███       | 113718/371472 [9:02:31<20:20:36,  3.52it/s]
 31%|███       | 113719/371472 [9:02:32<20:13:54,  3.54it/s]
 31%|███       | 113720/371472 [9:02:32<22:45:48,  3.15it/s]
                                                            
{'loss': 3.2578, 'learning_rate': 7.248163071817966e-07, 'epoch': 4.9}

 31%|███       | 113720/371472 [9:02:32<22:45:48,  3.15it/s]
 31%|███       | 113721/371472 [9:02:32<21:25:05,  3.34it/s]
 31%|███       | 113722/371472 [9:02:33<22:19:25,  3.21it/s]
 31%|███       | 113723/371472 [9:02:33<21:06:42,  3.39it/s]
 31%|███       | 113724/371472 [9:02:33<20:31:03,  3.49it/s]
 31%|███       | 113725/371472 [9:02:33<19:43:39,  3.63it/s]
 31%|███       | 113726/371472 [9:02:34<19:43:39,  3.63it/s]
 31%|███       | 113727/371472 [9:02:34<19:07:40,  3.74it/s]
 31%|███       | 113728/371472 [9:02:34<19:45:39,  3.62it/s]
 31%|███       | 113729/371472 [9:02:34<19:28:25,  3.68it/s]
 31%|███       | 113730/371472 [9:02:35<18:57:28,  3.78it/s]
 31%|███       | 113731/371472 [9:02:35<19:15:07,  3.72it/s]
 31%|███       | 113732/371472 [9:02:35<19:24:21,  3.69it/s]
 31%|███       | 113733/371472 [9:02:36<19:57:53,  3.59it/s]
 31%|███       | 113734/371472 [9:02:36<21:17:13,  3.36it/s]
 31%|███       | 113735/371472 [9:02:36<20:29:57,  3.49it/s]
 31%|███       | 113736/371472 [9:02:36<21:37:34,  3.31it/s]
 31%|███       | 113737/371472 [9:02:37<20:41:49,  3.46it/s]
 31%|███       | 113738/371472 [9:02:37<20:09:57,  3.55it/s]
 31%|███       | 113739/371472 [9:02:37<19:32:39,  3.66it/s]
 31%|███       | 113740/371472 [9:02:38<20:49:29,  3.44it/s]
                                                            
{'loss': 3.2918, 'learning_rate': 7.247678252063177e-07, 'epoch': 4.9}

 31%|███       | 113740/371472 [9:02:38<20:49:29,  3.44it/s]
 31%|███       | 113741/371472 [9:02:38<20:46:59,  3.44it/s]
 31%|███       | 113742/371472 [9:02:38<20:20:24,  3.52it/s]
 31%|███       | 113743/371472 [9:02:38<21:56:00,  3.26it/s]
 31%|███       | 113744/371472 [9:02:39<21:08:02,  3.39it/s]
 31%|███       | 113745/371472 [9:02:39<20:25:16,  3.51it/s]
 31%|███       | 113746/371472 [9:02:39<20:04:34,  3.57it/s]
 31%|███       | 113747/371472 [9:02:40<19:42:21,  3.63it/s]
 31%|███       | 113748/371472 [9:02:40<20:11:03,  3.55it/s]
 31%|███       | 113749/371472 [9:02:40<19:59:08,  3.58it/s]
 31%|███       | 113750/371472 [9:02:40<19:57:48,  3.59it/s]
 31%|███       | 113751/371472 [9:02:41<19:43:24,  3.63it/s]
 31%|███       | 113752/371472 [9:02:41<19:01:57,  3.76it/s]
 31%|███       | 113753/371472 [9:02:41<19:17:39,  3.71it/s]
 31%|███       | 113754/371472 [9:02:41<19:11:55,  3.73it/s]
 31%|███       | 113755/371472 [9:02:42<21:09:50,  3.38it/s]
 31%|███       | 113756/371472 [9:02:42<20:15:52,  3.53it/s]
 31%|███       | 113757/371472 [9:02:42<19:57:02,  3.59it/s]
 31%|███       | 113758/371472 [9:02:43<19:41:49,  3.63it/s]
 31%|███       | 113759/371472 [9:02:43<19:58:34,  3.58it/s]
 31%|███       | 113760/371472 [9:02:43<19:58:05,  3.59it/s]
                                                            
{'loss': 3.1761, 'learning_rate': 7.247193432308388e-07, 'epoch': 4.9}

 31%|███       | 113760/371472 [9:02:43<19:58:05,  3.59it/s]
 31%|███       | 113761/371472 [9:02:43<20:56:02,  3.42it/s]
 31%|███       | 113762/371472 [9:02:44<21:07:35,  3.39it/s]
 31%|███       | 113763/371472 [9:02:44<22:43:25,  3.15it/s]
 31%|███       | 113764/371472 [9:02:44<21:55:48,  3.26it/s]
 31%|███       | 113765/371472 [9:02:45<22:30:21,  3.18it/s]
 31%|███       | 113766/371472 [9:02:45<21:58:38,  3.26it/s]
 31%|███       | 113767/371472 [9:02:45<20:29:34,  3.49it/s]
 31%|███       | 113768/371472 [9:02:46<21:50:27,  3.28it/s]
 31%|███       | 113769/371472 [9:02:46<21:16:14,  3.37it/s]
 31%|███       | 113770/371472 [9:02:46<20:30:13,  3.49it/s]
 31%|███       | 113771/371472 [9:02:46<20:56:03,  3.42it/s]
 31%|███       | 113772/371472 [9:02:47<21:15:16,  3.37it/s]
 31%|███       | 113773/371472 [9:02:47<21:37:03,  3.31it/s]
 31%|███       | 113774/371472 [9:02:47<20:30:02,  3.49it/s]
 31%|███       | 113775/371472 [9:02:48<20:07:04,  3.56it/s]
 31%|███       | 113776/371472 [9:02:48<20:28:26,  3.50it/s]
 31%|███       | 113777/371472 [9:02:48<19:42:53,  3.63it/s]
 31%|███       | 113778/371472 [9:02:49<22:11:34,  3.23it/s]
 31%|███       | 113779/371472 [9:02:49<20:45:58,  3.45it/s]
 31%|███       | 113780/371472 [9:02:49<19:53:59,  3.60it/s]
                                                            
{'loss': 3.3231, 'learning_rate': 7.246708612553599e-07, 'epoch': 4.9}

 31%|███       | 113780/371472 [9:02:49<19:53:59,  3.60it/s]
 31%|███       | 113781/371472 [9:02:49<19:01:52,  3.76it/s]
 31%|███       | 113782/371472 [9:02:50<19:00:15,  3.77it/s]
 31%|███       | 113783/371472 [9:02:50<22:59:03,  3.11it/s]
 31%|███       | 113784/371472 [9:02:50<24:06:07,  2.97it/s]
 31%|███       | 113785/371472 [9:02:51<22:19:53,  3.21it/s]
 31%|███       | 113786/371472 [9:02:51<23:26:06,  3.05it/s]
 31%|███       | 113787/371472 [9:02:51<23:48:42,  3.01it/s]
 31%|███       | 113788/371472 [9:02:52<22:56:54,  3.12it/s]
 31%|███       | 113789/371472 [9:02:52<25:30:07,  2.81it/s]
 31%|███       | 113790/371472 [9:02:52<24:50:38,  2.88it/s]
 31%|███       | 113791/371472 [9:02:53<25:38:36,  2.79it/s]
 31%|███       | 113792/371472 [9:02:53<23:19:49,  3.07it/s]
 31%|███       | 113793/371472 [9:02:53<21:54:32,  3.27it/s]
 31%|███       | 113794/371472 [9:02:54<20:49:44,  3.44it/s]
 31%|███       | 113795/371472 [9:02:54<19:57:57,  3.58it/s]
 31%|███       | 113796/371472 [9:02:54<20:12:44,  3.54it/s]
 31%|███       | 113797/371472 [9:02:54<19:56:39,  3.59it/s]
 31%|███       | 113798/371472 [9:02:55<19:23:12,  3.69it/s]
 31%|███       | 113799/371472 [9:02:55<19:53:52,  3.60it/s]
 31%|███       | 113800/371472 [9:02:55<20:07:48,  3.56it/s]
                                                            
{'loss': 3.2292, 'learning_rate': 7.24622379279881e-07, 'epoch': 4.9}

 31%|███       | 113800/371472 [9:02:55<20:07:48,  3.56it/s]
 31%|███       | 113801/371472 [9:02:55<19:56:26,  3.59it/s]
 31%|███       | 113802/371472 [9:02:56<19:46:23,  3.62it/s]
 31%|███       | 113803/371472 [9:02:56<20:22:10,  3.51it/s]
 31%|███       | 113804/371472 [9:02:56<19:43:55,  3.63it/s]
 31%|███       | 113805/371472 [9:02:57<20:51:09,  3.43it/s]
 31%|███       | 113806/371472 [9:02:57<20:19:49,  3.52it/s]
 31%|███       | 113807/371472 [9:02:57<20:01:28,  3.57it/s]
 31%|███       | 113808/371472 [9:02:57<19:37:19,  3.65it/s]
 31%|███       | 113809/371472 [9:02:58<19:41:10,  3.64it/s]
 31%|███       | 113810/371472 [9:02:58<19:57:41,  3.59it/s]
 31%|███       | 113811/371472 [9:02:58<20:38:23,  3.47it/s]
 31%|███       | 113812/371472 [9:02:59<20:55:17,  3.42it/s]
 31%|███       | 113813/371472 [9:02:59<20:30:37,  3.49it/s]
 31%|███       | 113814/371472 [9:02:59<19:53:19,  3.60it/s]
 31%|███       | 113815/371472 [9:02:59<19:28:52,  3.67it/s]
 31%|███       | 113816/371472 [9:03:00<19:38:10,  3.64it/s]
 31%|███       | 113817/371472 [9:03:00<20:12:04,  3.54it/s]
 31%|███       | 113818/371472 [9:03:00<19:47:22,  3.62it/s]
 31%|███       | 113819/371472 [9:03:01<20:50:05,  3.44it/s]
 31%|███       | 113820/371472 [9:03:01<20:45:57,  3.45it/s]
                                                            
{'loss': 3.5422, 'learning_rate': 7.245738973044021e-07, 'epoch': 4.9}

 31%|███       | 113820/371472 [9:03:01<20:45:57,  3.45it/s]
 31%|███       | 113821/371472 [9:03:01<20:18:33,  3.52it/s]
 31%|███       | 113822/371472 [9:03:01<21:09:38,  3.38it/s]
 31%|███       | 113823/371472 [9:03:02<21:21:13,  3.35it/s]
 31%|███       | 113824/371472 [9:03:02<20:35:52,  3.47it/s]
 31%|███       | 113825/371472 [9:03:02<20:38:44,  3.47it/s]
 31%|███       | 113826/371472 [9:03:03<20:03:48,  3.57it/s]
 31%|███       | 113827/371472 [9:03:03<19:30:08,  3.67it/s]
 31%|███       | 113828/371472 [9:03:03<20:26:43,  3.50it/s]
 31%|███       | 113829/371472 [9:03:03<20:12:55,  3.54it/s]
 31%|███       | 113830/371472 [9:03:04<21:48:12,  3.28it/s]
 31%|███       | 113831/371472 [9:03:04<21:31:31,  3.32it/s]
 31%|███       | 113832/371472 [9:03:04<20:54:26,  3.42it/s]
 31%|███       | 113833/371472 [9:03:05<20:09:05,  3.55it/s]
 31%|███       | 113834/371472 [9:03:05<20:05:20,  3.56it/s]
 31%|███       | 113835/371472 [9:03:05<19:59:58,  3.58it/s]
 31%|███       | 113836/371472 [9:03:05<19:46:27,  3.62it/s]
 31%|███       | 113837/371472 [9:03:06<20:04:47,  3.56it/s]
 31%|███       | 113838/371472 [9:03:06<21:29:48,  3.33it/s]
 31%|███       | 113839/371472 [9:03:06<21:44:38,  3.29it/s]
 31%|███       | 113840/371472 [9:03:07<21:18:32,  3.36it/s]
                                                            
{'loss': 3.4631, 'learning_rate': 7.245254153289233e-07, 'epoch': 4.9}

 31%|███       | 113840/371472 [9:03:07<21:18:32,  3.36it/s]
 31%|███       | 113841/371472 [9:03:07<21:14:57,  3.37it/s]
 31%|███       | 113842/371472 [9:03:07<22:17:20,  3.21it/s]
 31%|███       | 113843/371472 [9:03:08<22:13:53,  3.22it/s]
 31%|███       | 113844/371472 [9:03:08<21:25:05,  3.34it/s]
 31%|███       | 113845/371472 [9:03:08<20:25:13,  3.50it/s]
 31%|███       | 113846/371472 [9:03:08<20:39:55,  3.46it/s]
 31%|███       | 113847/371472 [9:03:09<20:08:10,  3.55it/s]
 31%|███       | 113848/371472 [9:03:09<19:48:49,  3.61it/s]
 31%|███       | 113849/371472 [9:03:09<18:53:34,  3.79it/s]
 31%|███       | 113850/371472 [9:03:09<19:01:25,  3.76it/s]
 31%|███       | 113851/371472 [9:03:10<18:51:59,  3.79it/s]
 31%|███       | 113852/371472 [9:03:10<18:55:58,  3.78it/s]
 31%|███       | 113853/371472 [9:03:10<19:04:24,  3.75it/s]
 31%|███       | 113854/371472 [9:03:11<20:02:26,  3.57it/s]
 31%|███       | 113855/371472 [9:03:11<20:34:25,  3.48it/s]
 31%|███       | 113856/371472 [9:03:11<20:24:38,  3.51it/s]
 31%|███       | 113857/371472 [9:03:11<20:40:45,  3.46it/s]
 31%|███       | 113858/371472 [9:03:12<20:43:37,  3.45it/s]
 31%|███       | 113859/371472 [9:03:12<20:19:48,  3.52it/s]
 31%|███       | 113860/371472 [9:03:12<19:54:29,  3.59it/s]
                                                            
{'loss': 3.4453, 'learning_rate': 7.244769333534444e-07, 'epoch': 4.9}

 31%|███       | 113860/371472 [9:03:12<19:54:29,  3.59it/s]
 31%|███       | 113861/371472 [9:03:13<20:16:14,  3.53it/s]
 31%|███       | 113862/371472 [9:03:13<20:26:10,  3.50it/s]
 31%|███       | 113863/371472 [9:03:13<20:29:57,  3.49it/s]
 31%|███       | 113864/371472 [9:03:13<21:02:56,  3.40it/s]
 31%|███       | 113865/371472 [9:03:14<20:06:11,  3.56it/s]
 31%|███       | 113866/371472 [9:03:14<20:07:19,  3.56it/s]
 31%|███       | 113867/371472 [9:03:14<20:45:22,  3.45it/s]
 31%|███       | 113868/371472 [9:03:15<21:36:10,  3.31it/s]
 31%|███       | 113869/371472 [9:03:15<23:16:44,  3.07it/s]
 31%|███       | 113870/371472 [9:03:15<21:37:49,  3.31it/s]
 31%|███       | 113871/371472 [9:03:16<21:14:14,  3.37it/s]
 31%|███       | 113872/371472 [9:03:16<20:15:49,  3.53it/s]
 31%|███       | 113873/371472 [9:03:16<20:33:44,  3.48it/s]
 31%|███       | 113874/371472 [9:03:16<21:23:51,  3.34it/s]
 31%|███       | 113875/371472 [9:03:17<21:38:15,  3.31it/s]
 31%|███       | 113876/371472 [9:03:17<22:13:40,  3.22it/s]
 31%|███       | 113877/371472 [9:03:17<21:17:38,  3.36it/s]
 31%|███       | 113878/371472 [9:03:18<21:34:15,  3.32it/s]
 31%|███       | 113879/371472 [9:03:18<21:04:53,  3.39it/s]
 31%|███       | 113880/371472 [9:03:18<20:07:36,  3.56it/s]
                                                            
{'loss': 3.3112, 'learning_rate': 7.244284513779655e-07, 'epoch': 4.91}

 31%|███       | 113880/371472 [9:03:18<20:07:36,  3.56it/s]
 31%|███       | 113881/371472 [9:03:18<20:04:14,  3.57it/s]
 31%|███       | 113882/371472 [9:03:19<19:34:50,  3.65it/s]
 31%|███       | 113883/371472 [9:03:19<18:45:00,  3.82it/s]
 31%|███       | 113884/371472 [9:03:19<18:40:35,  3.83it/s]
 31%|███       | 113885/371472 [9:03:20<20:48:58,  3.44it/s]
 31%|███       | 113886/371472 [9:03:20<21:46:38,  3.29it/s]
 31%|███       | 113887/371472 [9:03:20<21:18:57,  3.36it/s]
 31%|███       | 113888/371472 [9:03:20<20:44:48,  3.45it/s]
 31%|███       | 113889/371472 [9:03:21<20:06:50,  3.56it/s]
 31%|███       | 113890/371472 [9:03:21<21:07:06,  3.39it/s]
 31%|███       | 113891/371472 [9:03:21<20:01:58,  3.57it/s]
 31%|███       | 113892/371472 [9:03:22<21:03:19,  3.40it/s]
 31%|███       | 113893/371472 [9:03:22<20:08:17,  3.55it/s]
 31%|███       | 113894/371472 [9:03:22<24:06:27,  2.97it/s]
 31%|███       | 113895/371472 [9:03:23<22:47:39,  3.14it/s]
 31%|███       | 113896/371472 [9:03:23<24:18:01,  2.94it/s]
 31%|███       | 113897/371472 [9:03:23<22:38:15,  3.16it/s]
 31%|███       | 113898/371472 [9:03:24<21:50:30,  3.28it/s]
 31%|███       | 113899/371472 [9:03:24<23:33:15,  3.04it/s]
 31%|███       | 113900/371472 [9:03:24<22:12:57,  3.22it/s]
                                                            
{'loss': 3.4012, 'learning_rate': 7.243799694024864e-07, 'epoch': 4.91}

 31%|███       | 113900/371472 [9:03:24<22:12:57,  3.22it/s]
 31%|███       | 113901/371472 [9:03:24<21:01:06,  3.40it/s]
 31%|███       | 113902/371472 [9:03:25<20:55:21,  3.42it/s]
 31%|███       | 113903/371472 [9:03:25<20:33:39,  3.48it/s]
 31%|███       | 113904/371472 [9:03:25<22:01:50,  3.25it/s]
 31%|███       | 113905/371472 [9:03:26<21:39:27,  3.30it/s]
 31%|███       | 113906/371472 [9:03:26<20:56:18,  3.42it/s]
 31%|███       | 113907/371472 [9:03:26<20:40:52,  3.46it/s]
 31%|███       | 113908/371472 [9:03:26<20:48:43,  3.44it/s]
 31%|███       | 113909/371472 [9:03:27<20:23:13,  3.51it/s]
 31%|███       | 113910/371472 [9:03:27<20:16:22,  3.53it/s]
 31%|███       | 113911/371472 [9:03:27<19:46:55,  3.62it/s]
 31%|███       | 113912/371472 [9:03:28<23:07:07,  3.09it/s]
 31%|███       | 113913/371472 [9:03:28<22:18:37,  3.21it/s]
 31%|███       | 113914/371472 [9:03:28<22:46:52,  3.14it/s]
 31%|███       | 113915/371472 [9:03:29<21:52:48,  3.27it/s]
 31%|███       | 113916/371472 [9:03:29<20:42:22,  3.46it/s]
 31%|███       | 113917/371472 [9:03:29<20:26:52,  3.50it/s]
 31%|███       | 113918/371472 [9:03:29<20:56:41,  3.42it/s]
 31%|███       | 113919/371472 [9:03:30<22:32:36,  3.17it/s]
 31%|███       | 113920/371472 [9:03:30<21:35:02,  3.31it/s]
                                                            
{'loss': 3.5263, 'learning_rate': 7.243314874270077e-07, 'epoch': 4.91}

 31%|███       | 113920/371472 [9:03:30<21:35:02,  3.31it/s]
 31%|███       | 113921/371472 [9:03:30<21:41:35,  3.30it/s]
 31%|███       | 113922/371472 [9:03:31<21:11:11,  3.38it/s]
 31%|███       | 113923/371472 [9:03:31<20:56:51,  3.42it/s]
 31%|███       | 113924/371472 [9:03:31<20:06:50,  3.56it/s]
 31%|███       | 113925/371472 [9:03:32<20:14:42,  3.53it/s]
 31%|███       | 113926/371472 [9:03:32<20:04:39,  3.56it/s]
 31%|███       | 113927/371472 [9:03:32<19:57:09,  3.59it/s]
 31%|███       | 113928/371472 [9:03:32<20:03:17,  3.57it/s]
 31%|███       | 113929/371472 [9:03:33<19:31:32,  3.66it/s]
 31%|███       | 113930/371472 [9:03:33<19:26:43,  3.68it/s]
 31%|███       | 113931/371472 [9:03:33<20:47:08,  3.44it/s]
 31%|███       | 113932/371472 [9:03:33<20:11:50,  3.54it/s]
 31%|███       | 113933/371472 [9:03:34<19:53:34,  3.60it/s]
 31%|███       | 113934/371472 [9:03:34<19:44:45,  3.62it/s]
 31%|███       | 113935/371472 [9:03:34<20:15:34,  3.53it/s]
 31%|███       | 113936/371472 [9:03:35<21:50:42,  3.27it/s]
 31%|███       | 113937/371472 [9:03:35<21:20:23,  3.35it/s]
 31%|███       | 113938/371472 [9:03:35<20:53:43,  3.42it/s]
 31%|███       | 113939/371472 [9:03:35<20:29:41,  3.49it/s]
 31%|███       | 113940/371472 [9:03:36<20:03:54,  3.57it/s]
                                                            
{'loss': 3.3166, 'learning_rate': 7.242830054515288e-07, 'epoch': 4.91}

 31%|███       | 113940/371472 [9:03:36<20:03:54,  3.57it/s]
 31%|███       | 113941/371472 [9:03:36<20:31:03,  3.49it/s]
 31%|███       | 113942/371472 [9:03:36<20:12:18,  3.54it/s]
 31%|███       | 113943/371472 [9:03:37<19:16:39,  3.71it/s]
 31%|███       | 113944/371472 [9:03:37<19:37:47,  3.64it/s]
 31%|███       | 113945/371472 [9:03:37<19:09:11,  3.73it/s]
 31%|███       | 113946/371472 [9:03:37<19:01:40,  3.76it/s]
 31%|███       | 113947/371472 [9:03:38<19:31:31,  3.66it/s]
 31%|███       | 113948/371472 [9:03:38<20:01:06,  3.57it/s]
 31%|███       | 113949/371472 [9:03:38<21:51:39,  3.27it/s]
 31%|███       | 113950/371472 [9:03:39<20:57:25,  3.41it/s]
 31%|███       | 113951/371472 [9:03:39<21:08:09,  3.38it/s]
 31%|███       | 113952/371472 [9:03:39<20:27:56,  3.50it/s]
 31%|███       | 113953/371472 [9:03:39<21:06:42,  3.39it/s]
 31%|███       | 113954/371472 [9:03:40<20:09:46,  3.55it/s]
 31%|███       | 113955/371472 [9:03:40<19:24:03,  3.69it/s]
 31%|███       | 113956/371472 [9:03:40<19:39:19,  3.64it/s]
 31%|███       | 113957/371472 [9:03:41<19:51:04,  3.60it/s]
 31%|███       | 113958/371472 [9:03:41<19:14:48,  3.72it/s]
 31%|███       | 113959/371472 [9:03:41<18:52:32,  3.79it/s]
 31%|███       | 113960/371472 [9:03:41<19:58:33,  3.58it/s]
                                                            
{'loss': 3.2745, 'learning_rate': 7.242345234760498e-07, 'epoch': 4.91}

 31%|███       | 113960/371472 [9:03:41<19:58:33,  3.58it/s]
 31%|███       | 113961/371472 [9:03:42<19:48:57,  3.61it/s]
 31%|███       | 113962/371472 [9:03:42<19:51:00,  3.60it/s]
 31%|███       | 113963/371472 [9:03:42<19:03:40,  3.75it/s]
 31%|███       | 113964/371472 [9:03:42<20:12:17,  3.54it/s]
 31%|███       | 113965/371472 [9:03:43<20:16:09,  3.53it/s]
 31%|███       | 113966/371472 [9:03:43<21:16:08,  3.36it/s]
 31%|███       | 113967/371472 [9:03:43<22:08:17,  3.23it/s]
 31%|███       | 113968/371472 [9:03:44<21:50:44,  3.27it/s]
 31%|███       | 113969/371472 [9:03:44<21:16:18,  3.36it/s]
 31%|███       | 113970/371472 [9:03:44<20:21:49,  3.51it/s]
 31%|███       | 113971/371472 [9:03:45<20:08:57,  3.55it/s]
 31%|███       | 113972/371472 [9:03:45<20:23:10,  3.51it/s]
 31%|███       | 113973/371472 [9:03:45<20:45:04,  3.45it/s]
 31%|███       | 113974/371472 [9:03:45<20:21:39,  3.51it/s]
 31%|███       | 113975/371472 [9:03:46<20:56:49,  3.41it/s]
 31%|███       | 113976/371472 [9:03:46<20:19:55,  3.52it/s]
 31%|███       | 113977/371472 [9:03:46<20:53:48,  3.42it/s]
 31%|███       | 113978/371472 [9:03:47<21:41:18,  3.30it/s]
 31%|███       | 113979/371472 [9:03:47<20:55:44,  3.42it/s]
 31%|███       | 113980/371472 [9:03:47<21:12:05,  3.37it/s]
                                                            
{'loss': 3.2829, 'learning_rate': 7.24186041500571e-07, 'epoch': 4.91}

 31%|███       | 113980/371472 [9:03:47<21:12:05,  3.37it/s]
 31%|███       | 113981/371472 [9:03:48<22:06:28,  3.24it/s]
 31%|███       | 113982/371472 [9:03:48<21:04:58,  3.39it/s]
 31%|███       | 113983/371472 [9:03:48<21:33:11,  3.32it/s]
 31%|███       | 113984/371472 [9:03:48<20:57:58,  3.41it/s]
 31%|███       | 113985/371472 [9:03:49<20:36:38,  3.47it/s]
 31%|███       | 113986/371472 [9:03:49<20:49:23,  3.43it/s]
 31%|███       | 113987/371472 [9:03:49<21:36:13,  3.31it/s]
 31%|███       | 113988/371472 [9:03:50<21:48:20,  3.28it/s]
 31%|███       | 113989/371472 [9:03:50<20:48:26,  3.44it/s]
 31%|███       | 113990/371472 [9:03:50<19:39:05,  3.64it/s]
 31%|███       | 113991/371472 [9:03:50<18:53:08,  3.79it/s]
 31%|███       | 113992/371472 [9:03:51<18:45:45,  3.81it/s]
 31%|███       | 113993/371472 [9:03:51<19:11:39,  3.73it/s]
 31%|███       | 113994/371472 [9:03:51<18:45:09,  3.81it/s]
 31%|███       | 113995/371472 [9:03:51<19:39:24,  3.64it/s]
 31%|███       | 113996/371472 [9:03:52<19:15:39,  3.71it/s]
 31%|███       | 113997/371472 [9:03:52<18:53:06,  3.79it/s]
 31%|███       | 113998/371472 [9:03:52<19:01:13,  3.76it/s]
 31%|███       | 113999/371472 [9:03:52<18:59:58,  3.76it/s]
 31%|███       | 114000/371472 [9:03:53<18:50:44,  3.80it/s]
                                                            
{'loss': 3.2522, 'learning_rate': 7.241375595250921e-07, 'epoch': 4.91}

 31%|███       | 114000/371472 [9:03:53<18:50:44,  3.80it/s]
 31%|███       | 114001/371472 [9:03:53<19:31:59,  3.66it/s]
 31%|███       | 114002/371472 [9:03:53<20:27:48,  3.49it/s]
 31%|███       | 114003/371472 [9:03:54<20:50:59,  3.43it/s]
 31%|███       | 114004/371472 [9:03:54<24:23:48,  2.93it/s]
 31%|███       | 114005/371472 [9:03:54<24:21:38,  2.94it/s]
 31%|███       | 114006/371472 [9:03:55<22:44:49,  3.14it/s]
 31%|███       | 114007/371472 [9:03:55<22:09:41,  3.23it/s]
 31%|███       | 114008/371472 [9:03:55<20:49:45,  3.43it/s]
 31%|███       | 114009/371472 [9:03:55<19:49:51,  3.61it/s]
 31%|███       | 114010/371472 [9:03:56<22:20:22,  3.20it/s]
 31%|███       | 114011/371472 [9:03:56<21:36:37,  3.31it/s]
 31%|███       | 114012/371472 [9:03:56<20:23:20,  3.51it/s]
 31%|███       | 114013/371472 [9:03:57<20:29:37,  3.49it/s]
 31%|███       | 114014/371472 [9:03:57<20:06:49,  3.56it/s]
 31%|███       | 114015/371472 [9:03:57<19:28:05,  3.67it/s]
 31%|███       | 114016/371472 [9:03:57<19:35:16,  3.65it/s]
 31%|███       | 114017/371472 [9:03:58<20:13:59,  3.53it/s]
 31%|███       | 114018/371472 [9:03:58<22:18:15,  3.21it/s]
 31%|███       | 114019/371472 [9:03:58<21:17:28,  3.36it/s]
 31%|███       | 114020/371472 [9:03:59<20:36:46,  3.47it/s]
                                                            
{'loss': 3.0851, 'learning_rate': 7.240890775496132e-07, 'epoch': 4.91}

 31%|███       | 114020/371472 [9:03:59<20:36:46,  3.47it/s]
 31%|███       | 114021/371472 [9:03:59<20:23:05,  3.51it/s]
 31%|███       | 114022/371472 [9:03:59<19:57:43,  3.58it/s]
 31%|███       | 114023/371472 [9:03:59<19:37:49,  3.64it/s]
 31%|███       | 114024/371472 [9:04:00<20:13:22,  3.54it/s]
 31%|███       | 114025/371472 [9:04:00<19:24:20,  3.69it/s]
 31%|███       | 114026/371472 [9:04:00<19:09:41,  3.73it/s]
 31%|███       | 114027/371472 [9:04:01<19:13:52,  3.72it/s]
 31%|███       | 114028/371472 [9:04:01<20:00:07,  3.58it/s]
 31%|███       | 114029/371472 [9:04:01<20:40:05,  3.46it/s]
 31%|███       | 114030/371472 [9:04:02<21:13:02,  3.37it/s]
 31%|███       | 114031/371472 [9:04:02<20:44:05,  3.45it/s]
 31%|███       | 114032/371472 [9:04:02<20:33:47,  3.48it/s]
 31%|███       | 114033/371472 [9:04:02<20:28:41,  3.49it/s]
 31%|███       | 114034/371472 [9:04:03<21:07:59,  3.38it/s]
 31%|███       | 114035/371472 [9:04:03<20:11:56,  3.54it/s]
 31%|███       | 114036/371472 [9:04:03<20:13:20,  3.54it/s]
 31%|███       | 114037/371472 [9:04:04<21:50:07,  3.27it/s]
 31%|███       | 114038/371472 [9:04:04<21:16:49,  3.36it/s]
 31%|███       | 114039/371472 [9:04:04<20:42:04,  3.45it/s]
 31%|███       | 114040/371472 [9:04:04<20:38:08,  3.47it/s]
                                                            
{'loss': 3.4579, 'learning_rate': 7.240405955741342e-07, 'epoch': 4.91}

 31%|███       | 114040/371472 [9:04:04<20:38:08,  3.47it/s]
 31%|███       | 114041/371472 [9:04:05<21:42:22,  3.29it/s]
 31%|███       | 114042/371472 [9:04:05<20:41:58,  3.45it/s]
 31%|███       | 114043/371472 [9:04:05<20:36:57,  3.47it/s]
 31%|███       | 114044/371472 [9:04:06<20:11:34,  3.54it/s]
 31%|███       | 114045/371472 [9:04:06<19:51:02,  3.60it/s]
 31%|███       | 114046/371472 [9:04:06<20:28:45,  3.49it/s]
 31%|███       | 114047/371472 [9:04:06<20:08:19,  3.55it/s]
 31%|███       | 114048/371472 [9:04:07<20:55:48,  3.42it/s]
 31%|███       | 114049/371472 [9:04:07<22:15:30,  3.21it/s]
 31%|███       | 114050/371472 [9:04:07<20:58:00,  3.41it/s]
 31%|███       | 114051/371472 [9:04:08<20:47:18,  3.44it/s]
 31%|███       | 114052/371472 [9:04:08<20:01:29,  3.57it/s]
 31%|███       | 114053/371472 [9:04:08<20:01:31,  3.57it/s]
 31%|███       | 114054/371472 [9:04:08<20:27:05,  3.50it/s]
 31%|███       | 114055/371472 [9:04:09<19:55:39,  3.59it/s]
 31%|███       | 114056/371472 [9:04:09<19:36:00,  3.65it/s]
 31%|███       | 114057/371472 [9:04:09<20:05:18,  3.56it/s]
 31%|███       | 114058/371472 [9:04:10<20:07:58,  3.55it/s]
 31%|███       | 114059/371472 [9:04:10<22:33:53,  3.17it/s]
 31%|███       | 114060/371472 [9:04:10<22:54:50,  3.12it/s]
                                                            
{'loss': 3.5174, 'learning_rate': 7.239921135986554e-07, 'epoch': 4.91}

 31%|███       | 114060/371472 [9:04:10<22:54:50,  3.12it/s]
 31%|███       | 114061/371472 [9:04:11<21:51:43,  3.27it/s]
 31%|███       | 114062/371472 [9:04:11<21:34:12,  3.31it/s]
 31%|███       | 114063/371472 [9:04:11<20:34:11,  3.48it/s]
 31%|███       | 114064/371472 [9:04:11<19:52:47,  3.60it/s]
 31%|███       | 114065/371472 [9:04:12<20:21:58,  3.51it/s]
 31%|███       | 114066/371472 [9:04:12<19:29:16,  3.67it/s]
 31%|███       | 114067/371472 [9:04:12<19:00:25,  3.76it/s]
 31%|███       | 114068/371472 [9:04:12<19:11:40,  3.73it/s]
 31%|███       | 114069/371472 [9:04:13<18:54:05,  3.78it/s]
 31%|███       | 114070/371472 [9:04:13<18:24:52,  3.88it/s]
 31%|███       | 114071/371472 [9:04:13<19:19:42,  3.70it/s]
 31%|███       | 114072/371472 [9:04:13<19:29:36,  3.67it/s]
 31%|███       | 114073/371472 [9:04:14<19:16:50,  3.71it/s]
 31%|███       | 114074/371472 [9:04:14<18:52:28,  3.79it/s]
 31%|███       | 114075/371472 [9:04:14<19:32:15,  3.66it/s]
 31%|███       | 114076/371472 [9:04:15<20:06:26,  3.56it/s]
 31%|███       | 114077/371472 [9:04:15<21:00:32,  3.40it/s]
 31%|███       | 114078/371472 [9:04:15<23:05:42,  3.10it/s]
 31%|███       | 114079/371472 [9:04:16<23:13:05,  3.08it/s]
 31%|███       | 114080/371472 [9:04:16<22:26:02,  3.19it/s]
                                                            
{'loss': 3.2439, 'learning_rate': 7.239436316231766e-07, 'epoch': 4.91}

 31%|███       | 114080/371472 [9:04:16<22:26:02,  3.19it/s]
 31%|███       | 114081/371472 [9:04:16<21:35:04,  3.31it/s]
 31%|███       | 114082/371472 [9:04:17<23:11:56,  3.08it/s]
 31%|███       | 114083/371472 [9:04:17<21:44:38,  3.29it/s]
 31%|███       | 114084/371472 [9:04:17<20:45:31,  3.44it/s]
 31%|███       | 114085/371472 [9:04:17<19:33:48,  3.65it/s]
 31%|███       | 114086/371472 [9:04:18<20:28:34,  3.49it/s]
 31%|███       | 114087/371472 [9:04:18<21:01:42,  3.40it/s]
 31%|███       | 114088/371472 [9:04:18<21:41:27,  3.30it/s]
 31%|███       | 114089/371472 [9:04:19<21:32:17,  3.32it/s]
 31%|███       | 114090/371472 [9:04:19<21:29:27,  3.33it/s]
 31%|███       | 114091/371472 [9:04:19<20:45:21,  3.44it/s]
 31%|███       | 114092/371472 [9:04:19<20:38:38,  3.46it/s]
 31%|███       | 114093/371472 [9:04:20<19:54:05,  3.59it/s]
 31%|███       | 114094/371472 [9:04:20<19:19:19,  3.70it/s]
 31%|███       | 114095/371472 [9:04:20<19:00:48,  3.76it/s]
 31%|███       | 114096/371472 [9:04:21<23:16:44,  3.07it/s]
 31%|███       | 114097/371472 [9:04:21<21:21:27,  3.35it/s]
 31%|███       | 114098/371472 [9:04:21<20:06:06,  3.56it/s]
 31%|███       | 114099/371472 [9:04:21<21:04:47,  3.39it/s]
 31%|███       | 114100/371472 [9:04:22<23:33:14,  3.04it/s]
                                                            
{'loss': 3.3721, 'learning_rate': 7.238951496476977e-07, 'epoch': 4.91}

 31%|███       | 114100/371472 [9:04:22<23:33:14,  3.04it/s]
 31%|███       | 114101/371472 [9:04:22<22:34:13,  3.17it/s]
 31%|███       | 114102/371472 [9:04:22<22:22:15,  3.20it/s]
 31%|███       | 114103/371472 [9:04:23<21:12:21,  3.37it/s]
 31%|███       | 114104/371472 [9:04:23<21:19:37,  3.35it/s]
 31%|███       | 114105/371472 [9:04:23<20:48:46,  3.43it/s]
 31%|███       | 114106/371472 [9:04:24<20:04:33,  3.56it/s]
 31%|███       | 114107/371472 [9:04:24<20:50:17,  3.43it/s]
 31%|███       | 114108/371472 [9:04:24<21:10:27,  3.38it/s]
 31%|███       | 114109/371472 [9:04:24<20:42:37,  3.45it/s]
 31%|███       | 114110/371472 [9:04:25<20:37:54,  3.47it/s]
 31%|███       | 114111/371472 [9:04:25<20:46:15,  3.44it/s]
 31%|███       | 114112/371472 [9:04:25<21:01:42,  3.40it/s]
 31%|███       | 114113/371472 [9:04:26<19:52:06,  3.60it/s]
 31%|███       | 114114/371472 [9:04:26<19:13:25,  3.72it/s]
 31%|███       | 114115/371472 [9:04:26<18:36:48,  3.84it/s]
 31%|███       | 114116/371472 [9:04:26<19:00:01,  3.76it/s]
 31%|███       | 114117/371472 [9:04:27<18:47:33,  3.80it/s]
 31%|███       | 114118/371472 [9:04:27<20:06:56,  3.55it/s]
 31%|███       | 114119/371472 [9:04:27<19:44:08,  3.62it/s]
 31%|███       | 114120/371472 [9:04:27<20:12:23,  3.54it/s]
                                                            
{'loss': 3.34, 'learning_rate': 7.238466676722187e-07, 'epoch': 4.92}

 31%|███       | 114120/371472 [9:04:27<20:12:23,  3.54it/s]
 31%|███       | 114121/371472 [9:04:28<20:30:08,  3.49it/s]
 31%|███       | 114122/371472 [9:04:28<20:11:32,  3.54it/s]
 31%|███       | 114123/371472 [9:04:28<20:30:15,  3.49it/s]
 31%|███       | 114124/371472 [9:04:29<21:05:00,  3.39it/s]
 31%|███       | 114125/371472 [9:04:29<20:20:00,  3.52it/s]
 31%|███       | 114126/371472 [9:04:29<21:05:41,  3.39it/s]
 31%|███       | 114127/371472 [9:04:29<20:19:59,  3.52it/s]
 31%|███       | 114128/371472 [9:04:30<19:30:39,  3.66it/s]
 31%|███       | 114129/371472 [9:04:30<19:21:02,  3.69it/s]
 31%|███       | 114130/371472 [9:04:30<19:14:42,  3.71it/s]
 31%|███       | 114131/371472 [9:04:31<19:03:19,  3.75it/s]
 31%|███       | 114132/371472 [9:04:31<21:10:04,  3.38it/s]
 31%|███       | 114133/371472 [9:04:31<21:09:11,  3.38it/s]
 31%|███       | 114134/371472 [9:04:31<20:13:07,  3.54it/s]
 31%|███       | 114135/371472 [9:04:32<20:12:58,  3.54it/s]
 31%|███       | 114136/371472 [9:04:32<19:23:31,  3.69it/s]
 31%|███       | 114137/371472 [9:04:32<19:05:18,  3.74it/s]
 31%|███       | 114138/371472 [9:04:32<19:04:30,  3.75it/s]
 31%|███       | 114139/371472 [9:04:33<19:36:46,  3.64it/s]
 31%|███       | 114140/371472 [9:04:33<20:29:26,  3.49it/s]
                                                            
{'loss': 3.4718, 'learning_rate': 7.237981856967398e-07, 'epoch': 4.92}

 31%|███       | 114140/371472 [9:04:33<20:29:26,  3.49it/s]
 31%|███       | 114141/371472 [9:04:33<21:10:50,  3.37it/s]
 31%|███       | 114142/371472 [9:04:34<20:13:35,  3.53it/s]
 31%|███       | 114143/371472 [9:04:34<20:21:50,  3.51it/s]
 31%|███       | 114144/371472 [9:04:34<19:59:15,  3.58it/s]
 31%|███       | 114145/371472 [9:04:35<19:50:55,  3.60it/s]
 31%|███       | 114146/371472 [9:04:35<19:54:52,  3.59it/s]
 31%|███       | 114147/371472 [9:04:35<19:45:07,  3.62it/s]
 31%|███       | 114148/371472 [9:04:36<23:28:46,  3.04it/s]
 31%|███       | 114149/371472 [9:04:36<22:38:41,  3.16it/s]
 31%|███       | 114150/371472 [9:04:36<21:19:16,  3.35it/s]
 31%|███       | 114151/371472 [9:04:36<20:25:52,  3.50it/s]
 31%|███       | 114152/371472 [9:04:37<19:38:49,  3.64it/s]
 31%|███       | 114153/371472 [9:04:37<19:19:42,  3.70it/s]
 31%|███       | 114154/371472 [9:04:37<18:57:32,  3.77it/s]
 31%|███       | 114155/371472 [9:04:37<19:01:57,  3.76it/s]
 31%|███       | 114156/371472 [9:04:38<18:59:29,  3.76it/s]
 31%|███       | 114157/371472 [9:04:38<19:18:31,  3.70it/s]
 31%|███       | 114158/371472 [9:04:38<19:53:04,  3.59it/s]
 31%|███       | 114159/371472 [9:04:38<19:30:50,  3.66it/s]
 31%|███       | 114160/371472 [9:04:39<19:41:12,  3.63it/s]
                                                            
{'loss': 3.4232, 'learning_rate': 7.237497037212609e-07, 'epoch': 4.92}

 31%|███       | 114160/371472 [9:04:39<19:41:12,  3.63it/s]
 31%|███       | 114161/371472 [9:04:39<20:27:13,  3.49it/s]
 31%|███       | 114162/371472 [9:04:39<22:50:55,  3.13it/s]
 31%|███       | 114163/371472 [9:04:40<21:41:29,  3.30it/s]
 31%|███       | 114164/371472 [9:04:40<20:50:52,  3.43it/s]
 31%|███       | 114165/371472 [9:04:40<20:13:34,  3.53it/s]
 31%|███       | 114166/371472 [9:04:40<19:44:56,  3.62it/s]
 31%|███       | 114167/371472 [9:04:41<19:35:13,  3.65it/s]
 31%|███       | 114168/371472 [9:04:41<20:03:40,  3.56it/s]
 31%|███       | 114169/371472 [9:04:41<20:00:52,  3.57it/s]
 31%|███       | 114170/371472 [9:04:42<21:32:59,  3.32it/s]
 31%|███       | 114171/371472 [9:04:42<21:29:55,  3.32it/s]
 31%|███       | 114172/371472 [9:04:42<20:38:21,  3.46it/s]
 31%|███       | 114173/371472 [9:04:42<19:51:19,  3.60it/s]
 31%|███       | 114174/371472 [9:04:43<19:23:30,  3.69it/s]
 31%|███       | 114175/371472 [9:04:43<19:13:32,  3.72it/s]
 31%|███       | 114176/371472 [9:04:43<20:00:14,  3.57it/s]
 31%|███       | 114177/371472 [9:04:44<19:36:11,  3.65it/s]
 31%|███       | 114178/371472 [9:04:44<19:45:52,  3.62it/s]
 31%|███       | 114179/371472 [9:04:44<19:59:51,  3.57it/s]
 31%|███       | 114180/371472 [9:04:44<20:57:23,  3.41it/s]
                                                            
{'loss': 3.2935, 'learning_rate': 7.23701221745782e-07, 'epoch': 4.92}

 31%|███       | 114180/371472 [9:04:44<20:57:23,  3.41it/s]
 31%|███       | 114181/371472 [9:04:45<20:18:52,  3.52it/s]
 31%|███       | 114182/371472 [9:04:45<21:06:11,  3.39it/s]
 31%|███       | 114183/371472 [9:04:45<20:06:06,  3.56it/s]
 31%|███       | 114184/371472 [9:04:46<19:26:27,  3.68it/s]
 31%|███       | 114185/371472 [9:04:46<18:42:52,  3.82it/s]
 31%|███       | 114186/371472 [9:04:46<19:25:02,  3.68it/s]
 31%|███       | 114187/371472 [9:04:46<19:49:22,  3.61it/s]
 31%|███       | 114188/371472 [9:04:47<20:26:51,  3.50it/s]
 31%|███       | 114189/371472 [9:04:47<19:51:21,  3.60it/s]
 31%|███       | 114190/371472 [9:04:47<20:37:45,  3.46it/s]
 31%|███       | 114191/371472 [9:04:48<21:13:55,  3.37it/s]
 31%|███       | 114192/371472 [9:04:48<21:01:48,  3.40it/s]
 31%|███       | 114193/371472 [9:04:48<20:34:04,  3.47it/s]
 31%|███       | 114194/371472 [9:04:48<21:16:46,  3.36it/s]
 31%|███       | 114195/371472 [9:04:49<20:29:46,  3.49it/s]
 31%|███       | 114196/371472 [9:04:49<20:03:17,  3.56it/s]
 31%|███       | 114197/371472 [9:04:49<19:31:11,  3.66it/s]
 31%|███       | 114198/371472 [9:04:50<20:26:25,  3.50it/s]
 31%|███       | 114199/371472 [9:04:50<19:49:02,  3.61it/s]
 31%|███       | 114200/371472 [9:04:50<20:40:18,  3.46it/s]
                                                            
{'loss': 3.3965, 'learning_rate': 7.236527397703031e-07, 'epoch': 4.92}

 31%|███       | 114200/371472 [9:04:50<20:40:18,  3.46it/s]
 31%|███       | 114201/371472 [9:04:50<21:22:13,  3.34it/s]
 31%|███       | 114202/371472 [9:04:51<20:18:59,  3.52it/s]
 31%|███       | 114203/371472 [9:04:51<19:46:48,  3.61it/s]
 31%|███       | 114204/371472 [9:04:51<19:05:21,  3.74it/s]
 31%|███       | 114205/371472 [9:04:51<19:29:30,  3.67it/s]
 31%|███       | 114206/371472 [9:04:52<19:26:51,  3.67it/s]
 31%|███       | 114207/371472 [9:04:52<19:45:40,  3.62it/s]
 31%|███       | 114208/371472 [9:04:52<19:50:33,  3.60it/s]
 31%|███       | 114209/371472 [9:04:53<19:26:15,  3.68it/s]
 31%|███       | 114210/371472 [9:04:53<20:18:12,  3.52it/s]
 31%|███       | 114211/371472 [9:04:53<20:52:19,  3.42it/s]
 31%|███       | 114212/371472 [9:04:54<21:57:29,  3.25it/s]
 31%|███       | 114213/371472 [9:04:54<20:46:30,  3.44it/s]
 31%|███       | 114214/371472 [9:04:54<21:03:43,  3.39it/s]
 31%|███       | 114215/371472 [9:04:54<21:37:49,  3.30it/s]
 31%|███       | 114216/371472 [9:04:55<21:29:00,  3.33it/s]
 31%|███       | 114217/371472 [9:04:55<20:33:28,  3.48it/s]
 31%|███       | 114218/371472 [9:04:55<20:08:00,  3.55it/s]
 31%|███       | 114219/371472 [9:04:56<19:37:09,  3.64it/s]
 31%|███       | 114220/371472 [9:04:56<19:45:26,  3.62it/s]
                                                            
{'loss': 3.4413, 'learning_rate': 7.236042577948243e-07, 'epoch': 4.92}

 31%|███       | 114220/371472 [9:04:56<19:45:26,  3.62it/s]
 31%|███       | 114221/371472 [9:04:56<20:13:56,  3.53it/s]
 31%|███       | 114222/371472 [9:04:56<20:00:01,  3.57it/s]
 31%|███       | 114223/371472 [9:04:57<19:16:56,  3.71it/s]
 31%|███       | 114224/371472 [9:04:57<21:47:33,  3.28it/s]
 31%|███       | 114225/371472 [9:04:57<22:49:19,  3.13it/s]
 31%|███       | 114226/371472 [9:04:58<21:47:06,  3.28it/s]
 31%|███       | 114227/371472 [9:04:58<20:22:23,  3.51it/s]
 31%|███       | 114228/371472 [9:04:58<20:49:56,  3.43it/s]
 31%|███       | 114229/371472 [9:04:58<21:24:12,  3.34it/s]
 31%|███       | 114230/371472 [9:04:59<22:01:09,  3.25it/s]
 31%|███       | 114231/371472 [9:04:59<20:56:40,  3.41it/s]
 31%|███       | 114232/371472 [9:04:59<19:55:55,  3.58it/s]
 31%|███       | 114233/371472 [9:05:00<20:24:17,  3.50it/s]
 31%|███       | 114234/371472 [9:05:00<20:36:38,  3.47it/s]
 31%|███       | 114235/371472 [9:05:00<20:14:50,  3.53it/s]
 31%|███       | 114236/371472 [9:05:00<19:24:04,  3.68it/s]
 31%|███       | 114237/371472 [9:05:01<19:45:03,  3.62it/s]
 31%|███       | 114238/371472 [9:05:01<19:49:11,  3.61it/s]
 31%|███       | 114239/371472 [9:05:01<19:38:04,  3.64it/s]
 31%|███       | 114240/371472 [9:05:02<19:35:05,  3.65it/s]
                                                            
{'loss': 3.1762, 'learning_rate': 7.235557758193454e-07, 'epoch': 4.92}

 31%|███       | 114240/371472 [9:05:02<19:35:05,  3.65it/s]
 31%|███       | 114241/371472 [9:05:02<19:54:59,  3.59it/s]
 31%|███       | 114242/371472 [9:05:02<20:42:18,  3.45it/s]
 31%|███       | 114243/371472 [9:05:02<20:06:17,  3.55it/s]
 31%|███       | 114244/371472 [9:05:03<22:25:48,  3.19it/s]
 31%|███       | 114245/371472 [9:05:03<21:33:28,  3.31it/s]
 31%|███       | 114246/371472 [9:05:03<20:21:04,  3.51it/s]
 31%|███       | 114247/371472 [9:05:04<21:22:52,  3.34it/s]
 31%|███       | 114248/371472 [9:05:04<20:54:09,  3.42it/s]
 31%|███       | 114249/371472 [9:05:04<20:03:23,  3.56it/s]
 31%|███       | 114250/371472 [9:05:04<20:33:32,  3.48it/s]
 31%|███       | 114251/371472 [9:05:05<21:54:58,  3.26it/s]
 31%|███       | 114252/371472 [9:05:05<23:36:17,  3.03it/s]
 31%|███       | 114253/371472 [9:05:05<21:42:42,  3.29it/s]
 31%|███       | 114254/371472 [9:05:06<20:55:15,  3.42it/s]
 31%|███       | 114255/371472 [9:05:06<20:22:52,  3.51it/s]
 31%|███       | 114256/371472 [9:05:06<19:20:03,  3.70it/s]
 31%|███       | 114257/371472 [9:05:06<19:22:31,  3.69it/s]
 31%|███       | 114258/371472 [9:05:07<20:11:47,  3.54it/s]
 31%|███       | 114259/371472 [9:05:07<19:59:50,  3.57it/s]
 31%|███       | 114260/371472 [9:05:07<19:45:49,  3.62it/s]
                                                            
{'loss': 3.4838, 'learning_rate': 7.235072938438664e-07, 'epoch': 4.92}

 31%|███       | 114260/371472 [9:05:07<19:45:49,  3.62it/s]
 31%|███       | 114261/371472 [9:05:08<20:36:05,  3.47it/s]
 31%|███       | 114262/371472 [9:05:08<20:22:01,  3.51it/s]
 31%|███       | 114263/371472 [9:05:08<20:22:13,  3.51it/s]
 31%|███       | 114264/371472 [9:05:09<20:26:06,  3.50it/s]
 31%|███       | 114265/371472 [9:05:09<19:40:05,  3.63it/s]
 31%|███       | 114266/371472 [9:05:09<23:51:52,  2.99it/s]
 31%|███       | 114267/371472 [9:05:10<22:26:10,  3.18it/s]
 31%|███       | 114268/371472 [9:05:10<22:08:16,  3.23it/s]
 31%|███       | 114269/371472 [9:05:10<21:18:23,  3.35it/s]
 31%|███       | 114270/371472 [9:05:10<20:52:33,  3.42it/s]
 31%|███       | 114271/371472 [9:05:11<20:27:21,  3.49it/s]
 31%|███       | 114272/371472 [9:05:11<20:14:17,  3.53it/s]
 31%|███       | 114273/371472 [9:05:11<20:09:24,  3.54it/s]
 31%|███       | 114274/371472 [9:05:11<19:46:27,  3.61it/s]
 31%|███       | 114275/371472 [9:05:12<20:06:27,  3.55it/s]
 31%|███       | 114276/371472 [9:05:12<19:52:41,  3.59it/s]
 31%|███       | 114277/371472 [9:05:12<19:50:51,  3.60it/s]
 31%|███       | 114278/371472 [9:05:13<20:01:44,  3.57it/s]
 31%|███       | 114279/371472 [9:05:13<19:56:16,  3.58it/s]
 31%|███       | 114280/371472 [9:05:13<21:15:17,  3.36it/s]
                                                            
{'loss': 3.3305, 'learning_rate': 7.234588118683875e-07, 'epoch': 4.92}

 31%|███       | 114280/371472 [9:05:13<21:15:17,  3.36it/s]
 31%|███       | 114281/371472 [9:05:13<20:09:25,  3.54it/s]
 31%|███       | 114282/371472 [9:05:14<19:57:18,  3.58it/s]
 31%|███       | 114283/371472 [9:05:14<19:49:20,  3.60it/s]
 31%|███       | 114284/371472 [9:05:14<19:45:29,  3.62it/s]
 31%|███       | 114285/371472 [9:05:15<19:48:18,  3.61it/s]
 31%|███       | 114286/371472 [9:05:15<19:37:46,  3.64it/s]
 31%|███       | 114287/371472 [9:05:15<20:28:04,  3.49it/s]
 31%|███       | 114288/371472 [9:05:15<19:53:23,  3.59it/s]
 31%|███       | 114289/371472 [9:05:16<20:09:21,  3.54it/s]
 31%|███       | 114290/371472 [9:05:16<19:44:09,  3.62it/s]
 31%|███       | 114291/371472 [9:05:16<19:13:55,  3.71it/s]
 31%|███       | 114292/371472 [9:05:16<18:55:03,  3.78it/s]
 31%|███       | 114293/371472 [9:05:17<19:23:02,  3.69it/s]
 31%|███       | 114294/371472 [9:05:17<20:26:09,  3.50it/s]
 31%|███       | 114295/371472 [9:05:17<20:06:19,  3.55it/s]
 31%|███       | 114296/371472 [9:05:18<20:15:06,  3.53it/s]
 31%|███       | 114297/371472 [9:05:18<19:59:57,  3.57it/s]
 31%|███       | 114298/371472 [9:05:18<21:09:10,  3.38it/s]
 31%|███       | 114299/371472 [9:05:18<19:54:25,  3.59it/s]
 31%|███       | 114300/371472 [9:05:19<20:03:36,  3.56it/s]
                                                            
{'loss': 3.4817, 'learning_rate': 7.234103298929087e-07, 'epoch': 4.92}

 31%|███       | 114300/371472 [9:05:19<20:03:36,  3.56it/s]
 31%|███       | 114301/371472 [9:05:19<19:24:15,  3.68it/s]
 31%|███       | 114302/371472 [9:05:19<20:24:09,  3.50it/s]
 31%|███       | 114303/371472 [9:05:20<20:09:51,  3.54it/s]
 31%|███       | 114304/371472 [9:05:20<19:39:00,  3.64it/s]
 31%|███       | 114305/371472 [9:05:20<19:58:10,  3.58it/s]
 31%|███       | 114306/371472 [9:05:20<19:58:16,  3.58it/s]
 31%|███       | 114307/371472 [9:05:21<19:52:21,  3.59it/s]
 31%|███       | 114308/371472 [9:05:21<19:02:37,  3.75it/s]
 31%|███       | 114309/371472 [9:05:21<18:57:31,  3.77it/s]
 31%|███       | 114310/371472 [9:05:21<19:26:05,  3.68it/s]
 31%|███       | 114311/371472 [9:05:22<19:25:06,  3.68it/s]
 31%|███       | 114312/371472 [9:05:22<19:27:40,  3.67it/s]
 31%|███       | 114313/371472 [9:05:22<19:33:03,  3.65it/s]
 31%|███       | 114314/371472 [9:05:23<20:26:59,  3.49it/s]
 31%|███       | 114315/371472 [9:05:23<19:50:02,  3.60it/s]
 31%|███       | 114316/371472 [9:05:23<20:06:03,  3.55it/s]
 31%|███       | 114317/371472 [9:05:23<19:51:43,  3.60it/s]
 31%|███       | 114318/371472 [9:05:24<19:17:08,  3.70it/s]
 31%|███       | 114319/371472 [9:05:24<18:39:20,  3.83it/s]
 31%|███       | 114320/371472 [9:05:24<20:17:53,  3.52it/s]
                                                            
{'loss': 3.4203, 'learning_rate': 7.233618479174297e-07, 'epoch': 4.92}

 31%|███       | 114320/371472 [9:05:24<20:17:53,  3.52it/s]
 31%|███       | 114321/371472 [9:05:24<19:27:53,  3.67it/s]
 31%|███       | 114322/371472 [9:05:25<18:59:37,  3.76it/s]
 31%|███       | 114323/371472 [9:05:25<19:19:17,  3.70it/s]
 31%|███       | 114324/371472 [9:05:25<20:12:28,  3.53it/s]
 31%|███       | 114325/371472 [9:05:26<20:42:56,  3.45it/s]
 31%|███       | 114326/371472 [9:05:26<21:39:11,  3.30it/s]
 31%|███       | 114327/371472 [9:05:26<20:53:27,  3.42it/s]
 31%|███       | 114328/371472 [9:05:27<20:18:52,  3.52it/s]
 31%|███       | 114329/371472 [9:05:27<20:08:09,  3.55it/s]
 31%|███       | 114330/371472 [9:05:27<19:25:43,  3.68it/s]
 31%|███       | 114331/371472 [9:05:27<21:30:36,  3.32it/s]
 31%|███       | 114332/371472 [9:05:28<20:24:48,  3.50it/s]
 31%|███       | 114333/371472 [9:05:28<20:06:47,  3.55it/s]
 31%|███       | 114334/371472 [9:05:28<19:39:14,  3.63it/s]
 31%|███       | 114335/371472 [9:05:28<19:56:35,  3.58it/s]
 31%|███       | 114336/371472 [9:05:29<19:07:52,  3.73it/s]
 31%|███       | 114337/371472 [9:05:29<19:36:22,  3.64it/s]
 31%|███       | 114338/371472 [9:05:29<19:50:36,  3.60it/s]
 31%|███       | 114339/371472 [9:05:30<20:56:05,  3.41it/s]
 31%|███       | 114340/371472 [9:05:30<20:34:23,  3.47it/s]
                                                            
{'loss': 3.3875, 'learning_rate': 7.233133659419508e-07, 'epoch': 4.92}

 31%|███       | 114340/371472 [9:05:30<20:34:23,  3.47it/s]
 31%|███       | 114341/371472 [9:05:30<20:05:26,  3.56it/s]
 31%|███       | 114342/371472 [9:05:30<20:05:21,  3.56it/s]
 31%|███       | 114343/371472 [9:05:31<19:23:07,  3.68it/s]
 31%|███       | 114344/371472 [9:05:31<20:11:46,  3.54it/s]
 31%|███       | 114345/371472 [9:05:31<20:04:53,  3.56it/s]
 31%|███       | 114346/371472 [9:05:32<19:49:14,  3.60it/s]
 31%|███       | 114347/371472 [9:05:32<20:23:30,  3.50it/s]
 31%|███       | 114348/371472 [9:05:32<19:44:53,  3.62it/s]
 31%|███       | 114349/371472 [9:05:32<19:28:01,  3.67it/s]
 31%|███       | 114350/371472 [9:05:33<19:15:40,  3.71it/s]
 31%|███       | 114351/371472 [9:05:33<19:30:37,  3.66it/s]
 31%|███       | 114352/371472 [9:05:33<20:01:41,  3.57it/s]
 31%|███       | 114353/371472 [9:05:33<19:55:56,  3.58it/s]
 31%|███       | 114354/371472 [9:05:34<20:30:05,  3.48it/s]
 31%|███       | 114355/371472 [9:05:34<19:58:52,  3.57it/s]
 31%|███       | 114356/371472 [9:05:34<19:48:17,  3.61it/s]
 31%|███       | 114357/371472 [9:05:35<20:09:06,  3.54it/s]
 31%|███       | 114358/371472 [9:05:35<22:08:11,  3.23it/s]
 31%|███       | 114359/371472 [9:05:35<21:07:26,  3.38it/s]
 31%|███       | 114360/371472 [9:05:36<20:07:00,  3.55it/s]
                                                            
{'loss': 3.5222, 'learning_rate': 7.23264883966472e-07, 'epoch': 4.93}

 31%|███       | 114360/371472 [9:05:36<20:07:00,  3.55it/s]
 31%|███       | 114361/371472 [9:05:36<19:27:56,  3.67it/s]
 31%|███       | 114362/371472 [9:05:36<18:55:25,  3.77it/s]
 31%|███       | 114363/371472 [9:05:36<18:53:45,  3.78it/s]
 31%|███       | 114364/371472 [9:05:37<19:34:11,  3.65it/s]
 31%|███       | 114365/371472 [9:05:37<19:26:39,  3.67it/s]
 31%|███       | 114366/371472 [9:05:37<19:21:40,  3.69it/s]
 31%|███       | 114367/371472 [9:05:37<19:05:15,  3.74it/s]
 31%|███       | 114368/371472 [9:05:38<18:35:07,  3.84it/s]
 31%|███       | 114369/371472 [9:05:38<18:54:37,  3.78it/s]
 31%|███       | 114370/371472 [9:05:38<19:56:04,  3.58it/s]
 31%|███       | 114371/371472 [9:05:38<19:51:43,  3.60it/s]
 31%|███       | 114372/371472 [9:05:39<20:13:11,  3.53it/s]
 31%|███       | 114373/371472 [9:05:39<19:56:53,  3.58it/s]
 31%|███       | 114374/371472 [9:05:39<20:24:41,  3.50it/s]
 31%|███       | 114375/371472 [9:05:40<21:45:39,  3.28it/s]
 31%|███       | 114376/371472 [9:05:40<20:26:20,  3.49it/s]
 31%|███       | 114377/371472 [9:05:40<19:56:28,  3.58it/s]
 31%|███       | 114378/371472 [9:05:41<21:07:50,  3.38it/s]
 31%|███       | 114379/371472 [9:05:41<22:43:22,  3.14it/s]
 31%|███       | 114380/371472 [9:05:41<21:17:18,  3.35it/s]
                                                            
{'loss': 3.327, 'learning_rate': 7.232164019909932e-07, 'epoch': 4.93}

 31%|███       | 114380/371472 [9:05:41<21:17:18,  3.35it/s]
 31%|███       | 114381/371472 [9:05:41<20:37:44,  3.46it/s]
 31%|███       | 114382/371472 [9:05:42<20:09:36,  3.54it/s]
 31%|███       | 114383/371472 [9:05:42<20:20:21,  3.51it/s]
 31%|███       | 114384/371472 [9:05:42<20:10:44,  3.54it/s]
 31%|███       | 114385/371472 [9:05:43<19:48:09,  3.61it/s]
 31%|███       | 114386/371472 [9:05:43<18:51:28,  3.79it/s]
 31%|███       | 114387/371472 [9:05:43<18:52:46,  3.78it/s]
 31%|███       | 114388/371472 [9:05:43<18:43:32,  3.81it/s]
 31%|███       | 114389/371472 [9:05:44<19:13:49,  3.71it/s]
 31%|███       | 114390/371472 [9:05:44<20:33:56,  3.47it/s]
 31%|███       | 114391/371472 [9:05:44<20:08:53,  3.54it/s]
 31%|███       | 114392/371472 [9:05:44<19:56:55,  3.58it/s]
 31%|███       | 114393/371472 [9:05:45<20:47:02,  3.44it/s]
 31%|███       | 114394/371472 [9:05:45<21:05:40,  3.39it/s]
 31%|███       | 114395/371472 [9:05:45<20:21:36,  3.51it/s]
 31%|███       | 114396/371472 [9:05:46<20:10:05,  3.54it/s]
 31%|███       | 114397/371472 [9:05:46<19:50:37,  3.60it/s]
 31%|███       | 114398/371472 [9:05:46<19:14:26,  3.71it/s]
 31%|███       | 114399/371472 [9:05:46<19:13:17,  3.72it/s]
 31%|███       | 114400/371472 [9:05:47<20:05:03,  3.56it/s]
                                                            
{'loss': 3.2285, 'learning_rate': 7.231679200155142e-07, 'epoch': 4.93}

 31%|███       | 114400/371472 [9:05:47<20:05:03,  3.56it/s]
 31%|███       | 114401/371472 [9:05:47<19:38:38,  3.64it/s]
 31%|███       | 114402/371472 [9:05:47<19:09:40,  3.73it/s]
 31%|███       | 114403/371472 [9:05:47<19:15:39,  3.71it/s]
 31%|███       | 114404/371472 [9:05:48<20:36:24,  3.47it/s]
 31%|███       | 114405/371472 [9:05:48<20:18:00,  3.52it/s]
 31%|███       | 114406/371472 [9:05:48<20:27:12,  3.49it/s]
 31%|███       | 114407/371472 [9:05:49<20:08:00,  3.55it/s]
 31%|███       | 114408/371472 [9:05:49<19:10:35,  3.72it/s]
 31%|███       | 114409/371472 [9:05:49<19:16:36,  3.70it/s]
 31%|███       | 114410/371472 [9:05:50<21:05:25,  3.39it/s]
 31%|███       | 114411/371472 [9:05:50<21:19:46,  3.35it/s]
 31%|███       | 114412/371472 [9:05:50<21:28:35,  3.32it/s]
 31%|███       | 114413/371472 [9:05:50<21:54:08,  3.26it/s]
 31%|███       | 114414/371472 [9:05:51<21:24:40,  3.33it/s]
 31%|███       | 114415/371472 [9:05:51<21:01:13,  3.40it/s]
 31%|███       | 114416/371472 [9:05:51<20:56:08,  3.41it/s]
 31%|███       | 114417/371472 [9:05:52<20:22:05,  3.51it/s]
 31%|███       | 114418/371472 [9:05:52<19:39:38,  3.63it/s]
 31%|███       | 114419/371472 [9:05:52<22:32:52,  3.17it/s]
 31%|███       | 114420/371472 [9:05:53<22:01:03,  3.24it/s]
                                                            
{'loss': 3.2453, 'learning_rate': 7.231194380400352e-07, 'epoch': 4.93}

 31%|███       | 114420/371472 [9:05:53<22:01:03,  3.24it/s]
 31%|███       | 114421/371472 [9:05:53<25:06:02,  2.84it/s]
 31%|███       | 114422/371472 [9:05:53<23:01:15,  3.10it/s]
 31%|███       | 114423/371472 [9:05:53<21:53:49,  3.26it/s]
 31%|███       | 114424/371472 [9:05:54<20:53:54,  3.42it/s]
 31%|███       | 114425/371472 [9:05:54<20:33:19,  3.47it/s]
 31%|███       | 114426/371472 [9:05:54<21:33:22,  3.31it/s]
 31%|███       | 114427/371472 [9:05:55<21:49:18,  3.27it/s]
 31%|███       | 114428/371472 [9:05:55<21:05:59,  3.38it/s]
 31%|███       | 114429/371472 [9:05:55<20:01:58,  3.56it/s]
 31%|███       | 114430/371472 [9:05:55<19:34:51,  3.65it/s]
 31%|███       | 114431/371472 [9:05:56<21:29:06,  3.32it/s]
 31%|███       | 114432/371472 [9:05:56<20:41:46,  3.45it/s]
 31%|███       | 114433/371472 [9:05:56<20:57:39,  3.41it/s]
 31%|███       | 114434/371472 [9:05:57<20:39:39,  3.46it/s]
 31%|███       | 114435/371472 [9:05:57<20:08:42,  3.54it/s]
 31%|███       | 114436/371472 [9:05:57<20:08:03,  3.55it/s]
 31%|███       | 114437/371472 [9:05:57<19:42:33,  3.62it/s]
 31%|███       | 114438/371472 [9:05:58<18:58:34,  3.76it/s]
 31%|███       | 114439/371472 [9:05:58<20:33:02,  3.47it/s]
 31%|███       | 114440/371472 [9:05:58<20:44:56,  3.44it/s]
                                                            
{'loss': 3.3993, 'learning_rate': 7.230709560645564e-07, 'epoch': 4.93}

 31%|███       | 114440/371472 [9:05:58<20:44:56,  3.44it/s]
 31%|███       | 114441/371472 [9:05:59<20:42:27,  3.45it/s]
 31%|███       | 114442/371472 [9:05:59<19:53:33,  3.59it/s]
 31%|███       | 114443/371472 [9:05:59<20:11:58,  3.53it/s]
 31%|███       | 114444/371472 [9:05:59<19:59:24,  3.57it/s]
 31%|███       | 114445/371472 [9:06:00<21:10:23,  3.37it/s]
 31%|███       | 114446/371472 [9:06:00<20:26:33,  3.49it/s]
 31%|███       | 114447/371472 [9:06:00<19:37:13,  3.64it/s]
 31%|███       | 114448/371472 [9:06:01<19:50:07,  3.60it/s]
 31%|███       | 114449/371472 [9:06:01<20:32:06,  3.48it/s]
 31%|███       | 114450/371472 [9:06:01<19:55:30,  3.58it/s]
 31%|███       | 114451/371472 [9:06:01<19:28:53,  3.66it/s]
 31%|███       | 114452/371472 [9:06:02<20:10:42,  3.54it/s]
 31%|███       | 114453/371472 [9:06:02<21:01:53,  3.39it/s]
 31%|███       | 114454/371472 [9:06:02<20:22:32,  3.50it/s]
 31%|███       | 114455/371472 [9:06:03<20:56:14,  3.41it/s]
 31%|███       | 114456/371472 [9:06:03<20:52:22,  3.42it/s]
 31%|███       | 114457/371472 [9:06:03<21:30:51,  3.32it/s]
 31%|███       | 114458/371472 [9:06:04<21:03:05,  3.39it/s]
 31%|███       | 114459/371472 [9:06:04<20:03:43,  3.56it/s]
 31%|███       | 114460/371472 [9:06:04<19:53:56,  3.59it/s]
                                                            
{'loss': 3.4082, 'learning_rate': 7.230224740890776e-07, 'epoch': 4.93}

 31%|███       | 114460/371472 [9:06:04<19:53:56,  3.59it/s]
 31%|███       | 114461/371472 [9:06:04<20:57:11,  3.41it/s]
 31%|███       | 114462/371472 [9:06:05<20:25:42,  3.49it/s]
 31%|███       | 114463/371472 [9:06:05<20:34:03,  3.47it/s]
 31%|███       | 114464/371472 [9:06:05<21:40:58,  3.29it/s]
 31%|███       | 114465/371472 [9:06:06<20:44:29,  3.44it/s]
 31%|███       | 114466/371472 [9:06:06<20:13:41,  3.53it/s]
 31%|███       | 114467/371472 [9:06:06<19:57:20,  3.58it/s]
 31%|███       | 114468/371472 [9:06:06<21:49:05,  3.27it/s]
 31%|███       | 114469/371472 [9:06:07<20:35:34,  3.47it/s]
 31%|███       | 114470/371472 [9:06:07<21:20:21,  3.35it/s]
 31%|███       | 114471/371472 [9:06:07<20:47:00,  3.43it/s]
 31%|███       | 114472/371472 [9:06:08<21:23:10,  3.34it/s]
 31%|███       | 114473/371472 [9:06:08<20:39:32,  3.46it/s]
 31%|███       | 114474/371472 [9:06:08<20:44:28,  3.44it/s]
 31%|███       | 114475/371472 [9:06:08<20:33:09,  3.47it/s]
 31%|███       | 114476/371472 [9:06:09<20:11:12,  3.54it/s]
 31%|███       | 114477/371472 [9:06:09<19:13:57,  3.71it/s]
 31%|███       | 114478/371472 [9:06:09<18:22:35,  3.88it/s]
 31%|███       | 114479/371472 [9:06:09<18:47:33,  3.80it/s]
 31%|███       | 114480/371472 [9:06:10<18:49:57,  3.79it/s]
                                                            
{'loss': 3.4327, 'learning_rate': 7.229739921135987e-07, 'epoch': 4.93}

 31%|███       | 114480/371472 [9:06:10<18:49:57,  3.79it/s]
 31%|███       | 114481/371472 [9:06:10<18:48:02,  3.80it/s]
 31%|███       | 114482/371472 [9:06:10<19:10:47,  3.72it/s]
 31%|███       | 114483/371472 [9:06:11<18:39:07,  3.83it/s]
 31%|███       | 114484/371472 [9:06:11<18:26:18,  3.87it/s]
 31%|███       | 114485/371472 [9:06:11<18:12:32,  3.92it/s]
 31%|███       | 114486/371472 [9:06:11<18:56:58,  3.77it/s]
 31%|███       | 114487/371472 [9:06:12<18:27:14,  3.87it/s]
 31%|███       | 114488/371472 [9:06:12<19:13:38,  3.71it/s]
 31%|███       | 114489/371472 [9:06:12<18:46:12,  3.80it/s]
 31%|███       | 114490/371472 [9:06:12<18:38:50,  3.83it/s]
 31%|███       | 114491/371472 [9:06:13<19:29:22,  3.66it/s]
 31%|███       | 114492/371472 [9:06:13<18:59:12,  3.76it/s]
 31%|███       | 114493/371472 [9:06:13<19:04:47,  3.74it/s]
 31%|███       | 114494/371472 [9:06:13<18:36:09,  3.84it/s]
 31%|███       | 114495/371472 [9:06:14<19:26:35,  3.67it/s]
 31%|███       | 114496/371472 [9:06:14<18:59:13,  3.76it/s]
 31%|███       | 114497/371472 [9:06:14<18:51:06,  3.79it/s]
 31%|███       | 114498/371472 [9:06:14<18:40:58,  3.82it/s]
 31%|███       | 114499/371472 [9:06:15<19:07:11,  3.73it/s]
 31%|███       | 114500/371472 [9:06:15<18:43:23,  3.81it/s]
                                                            
{'loss': 3.3565, 'learning_rate': 7.229255101381197e-07, 'epoch': 4.93}

 31%|███       | 114500/371472 [9:06:15<18:43:23,  3.81it/s]
 31%|███       | 114501/371472 [9:06:15<18:21:04,  3.89it/s]
 31%|███       | 114502/371472 [9:06:16<18:32:09,  3.85it/s]
 31%|███       | 114503/371472 [9:06:16<20:08:58,  3.54it/s]
 31%|███       | 114504/371472 [9:06:16<19:36:18,  3.64it/s]
 31%|███       | 114505/371472 [9:06:16<19:22:03,  3.69it/s]
 31%|███       | 114506/371472 [9:06:17<20:05:59,  3.55it/s]
 31%|███       | 114507/371472 [9:06:17<19:28:42,  3.66it/s]
 31%|███       | 114508/371472 [9:06:17<21:15:48,  3.36it/s]
 31%|███       | 114509/371472 [9:06:18<21:22:44,  3.34it/s]
 31%|███       | 114510/371472 [9:06:18<22:23:09,  3.19it/s]
 31%|███       | 114511/371472 [9:06:18<21:30:15,  3.32it/s]
 31%|███       | 114512/371472 [9:06:18<20:37:30,  3.46it/s]
 31%|███       | 114513/371472 [9:06:19<19:25:17,  3.68it/s]
 31%|███       | 114514/371472 [9:06:19<20:11:19,  3.54it/s]
 31%|███       | 114515/371472 [9:06:19<20:02:49,  3.56it/s]
 31%|███       | 114516/371472 [9:06:20<19:49:54,  3.60it/s]
 31%|███       | 114517/371472 [9:06:20<22:13:02,  3.21it/s]
 31%|███       | 114518/371472 [9:06:20<22:42:38,  3.14it/s]
 31%|███       | 114519/371472 [9:06:21<20:51:57,  3.42it/s]
 31%|███       | 114520/371472 [9:06:21<21:58:42,  3.25it/s]
                                                            
{'loss': 3.1696, 'learning_rate': 7.228770281626408e-07, 'epoch': 4.93}

 31%|███       | 114520/371472 [9:06:21<21:58:42,  3.25it/s]
 31%|███       | 114521/371472 [9:06:21<22:01:59,  3.24it/s]
 31%|███       | 114522/371472 [9:06:21<21:56:59,  3.25it/s]
 31%|███       | 114523/371472 [9:06:22<21:47:27,  3.28it/s]
 31%|███       | 114524/371472 [9:06:22<21:12:38,  3.37it/s]
 31%|███       | 114525/371472 [9:06:22<21:08:54,  3.37it/s]
 31%|███       | 114526/371472 [9:06:23<19:51:15,  3.59it/s]
 31%|███       | 114527/371472 [9:06:23<19:23:42,  3.68it/s]
 31%|███       | 114528/371472 [9:06:23<19:19:20,  3.69it/s]
 31%|███       | 114529/371472 [9:06:23<19:47:20,  3.61it/s]
 31%|███       | 114530/371472 [9:06:24<22:24:28,  3.19it/s]
 31%|███       | 114531/371472 [9:06:24<21:47:30,  3.28it/s]
 31%|███       | 114532/371472 [9:06:24<21:11:05,  3.37it/s]
 31%|███       | 114533/371472 [9:06:25<20:34:32,  3.47it/s]
 31%|███       | 114534/371472 [9:06:25<20:14:11,  3.53it/s]
 31%|███       | 114535/371472 [9:06:25<19:43:07,  3.62it/s]
 31%|███       | 114536/371472 [9:06:25<20:38:29,  3.46it/s]
 31%|███       | 114537/371472 [9:06:26<21:04:53,  3.39it/s]
 31%|███       | 114538/371472 [9:06:26<22:51:50,  3.12it/s]
 31%|███       | 114539/371472 [9:06:26<21:48:25,  3.27it/s]
 31%|███       | 114540/371472 [9:06:27<20:46:21,  3.44it/s]
                                                            
{'loss': 3.3463, 'learning_rate': 7.22828546187162e-07, 'epoch': 4.93}

 31%|███       | 114540/371472 [9:06:27<20:46:21,  3.44it/s]
 31%|███       | 114541/371472 [9:06:27<20:10:17,  3.54it/s]
 31%|███       | 114542/371472 [9:06:27<19:45:11,  3.61it/s]
 31%|███       | 114543/371472 [9:06:28<21:35:20,  3.31it/s]
 31%|███       | 114544/371472 [9:06:28<20:18:43,  3.51it/s]
 31%|███       | 114545/371472 [9:06:28<19:50:47,  3.60it/s]
 31%|███       | 114546/371472 [9:06:28<20:36:09,  3.46it/s]
 31%|███       | 114547/371472 [9:06:29<20:02:46,  3.56it/s]
 31%|███       | 114548/371472 [9:06:29<20:44:37,  3.44it/s]
 31%|███       | 114549/371472 [9:06:29<19:56:51,  3.58it/s]
 31%|███       | 114550/371472 [9:06:29<19:22:53,  3.68it/s]
 31%|███       | 114551/371472 [9:06:30<18:47:59,  3.80it/s]
 31%|███       | 114552/371472 [9:06:30<18:29:15,  3.86it/s]
 31%|███       | 114553/371472 [9:06:30<19:29:00,  3.66it/s]
 31%|███       | 114554/371472 [9:06:31<19:33:58,  3.65it/s]
 31%|███       | 114555/371472 [9:06:31<19:12:22,  3.72it/s]
 31%|███       | 114556/371472 [9:06:31<18:44:15,  3.81it/s]
 31%|███       | 114557/371472 [9:06:31<18:39:06,  3.83it/s]
 31%|███       | 114558/371472 [9:06:32<18:49:53,  3.79it/s]
 31%|███       | 114559/371472 [9:06:32<18:50:19,  3.79it/s]
 31%|███       | 114560/371472 [9:06:32<20:41:44,  3.45it/s]
                                                            
{'loss': 3.3488, 'learning_rate': 7.22780064211683e-07, 'epoch': 4.93}

 31%|███       | 114560/371472 [9:06:32<20:41:44,  3.45it/s]
 31%|███       | 114561/371472 [9:06:32<20:00:17,  3.57it/s]
 31%|███       | 114562/371472 [9:06:33<19:20:18,  3.69it/s]
 31%|███       | 114563/371472 [9:06:33<19:22:10,  3.68it/s]
 31%|███       | 114564/371472 [9:06:33<19:53:14,  3.59it/s]
 31%|███       | 114565/371472 [9:06:34<20:46:06,  3.44it/s]
 31%|███       | 114566/371472 [9:06:34<20:44:08,  3.44it/s]
 31%|███       | 114567/371472 [9:06:34<20:43:53,  3.44it/s]
 31%|███       | 114568/371472 [9:06:34<20:13:55,  3.53it/s]
 31%|███       | 114569/371472 [9:06:35<19:53:26,  3.59it/s]
 31%|███       | 114570/371472 [9:06:35<19:09:24,  3.73it/s]
 31%|███       | 114571/371472 [9:06:35<20:15:51,  3.52it/s]
 31%|███       | 114572/371472 [9:06:36<20:15:19,  3.52it/s]
 31%|███       | 114573/371472 [9:06:36<19:58:55,  3.57it/s]
 31%|███       | 114574/371472 [9:06:36<20:04:45,  3.55it/s]
 31%|███       | 114575/371472 [9:06:36<20:27:12,  3.49it/s]
 31%|███       | 114576/371472 [9:06:37<20:30:44,  3.48it/s]
 31%|███       | 114577/371472 [9:06:37<21:52:51,  3.26it/s]
 31%|███       | 114578/371472 [9:06:37<21:17:04,  3.35it/s]
 31%|███       | 114579/371472 [9:06:38<20:14:58,  3.52it/s]
 31%|███       | 114580/371472 [9:06:38<22:32:43,  3.17it/s]
                                                            
{'loss': 3.3541, 'learning_rate': 7.227315822362041e-07, 'epoch': 4.94}

 31%|███       | 114580/371472 [9:06:38<22:32:43,  3.17it/s]
 31%|███       | 114581/371472 [9:06:38<22:12:25,  3.21it/s]
 31%|███       | 114582/371472 [9:06:39<23:04:32,  3.09it/s]
 31%|███       | 114583/371472 [9:06:39<22:52:21,  3.12it/s]
 31%|███       | 114584/371472 [9:06:39<22:22:05,  3.19it/s]
 31%|███       | 114585/371472 [9:06:40<21:51:22,  3.26it/s]
 31%|███       | 114586/371472 [9:06:40<20:52:52,  3.42it/s]
 31%|███       | 114587/371472 [9:06:40<20:24:20,  3.50it/s]
 31%|███       | 114588/371472 [9:06:40<19:42:59,  3.62it/s]
 31%|███       | 114589/371472 [9:06:41<19:12:54,  3.71it/s]
 31%|███       | 114590/371472 [9:06:41<19:38:19,  3.63it/s]
 31%|███       | 114591/371472 [9:06:41<20:06:52,  3.55it/s]
 31%|███       | 114592/371472 [9:06:42<22:56:38,  3.11it/s]
 31%|███       | 114593/371472 [9:06:42<21:31:58,  3.31it/s]
 31%|███       | 114594/371472 [9:06:42<21:59:35,  3.24it/s]
 31%|███       | 114595/371472 [9:06:42<21:36:17,  3.30it/s]
 31%|███       | 114596/371472 [9:06:43<20:43:00,  3.44it/s]
 31%|███       | 114597/371472 [9:06:43<21:09:11,  3.37it/s]
 31%|███       | 114598/371472 [9:06:43<20:00:22,  3.57it/s]
 31%|███       | 114599/371472 [9:06:44<19:55:33,  3.58it/s]
 31%|███       | 114600/371472 [9:06:44<19:56:20,  3.58it/s]
                                                            
{'loss': 3.255, 'learning_rate': 7.226831002607253e-07, 'epoch': 4.94}

 31%|███       | 114600/371472 [9:06:44<19:56:20,  3.58it/s]
 31%|███       | 114601/371472 [9:06:44<19:24:47,  3.68it/s]
 31%|███       | 114602/371472 [9:06:44<20:30:48,  3.48it/s]
 31%|███       | 114603/371472 [9:06:45<20:06:53,  3.55it/s]
 31%|███       | 114604/371472 [9:06:45<19:52:44,  3.59it/s]
 31%|███       | 114605/371472 [9:06:45<19:44:40,  3.61it/s]
 31%|███       | 114606/371472 [9:06:45<19:08:37,  3.73it/s]
 31%|███       | 114607/371472 [9:06:46<19:19:52,  3.69it/s]
 31%|███       | 114608/371472 [9:06:46<20:51:00,  3.42it/s]
 31%|███       | 114609/371472 [9:06:46<19:57:12,  3.58it/s]
 31%|███       | 114610/371472 [9:06:47<19:48:21,  3.60it/s]
 31%|███       | 114611/371472 [9:06:47<21:50:52,  3.27it/s]
 31%|███       | 114612/371472 [9:06:47<20:45:30,  3.44it/s]
 31%|███       | 114613/371472 [9:06:47<20:33:06,  3.47it/s]
 31%|███       | 114614/371472 [9:06:48<20:24:49,  3.50it/s]
 31%|███       | 114615/371472 [9:06:48<20:43:43,  3.44it/s]
 31%|███       | 114616/371472 [9:06:48<20:58:32,  3.40it/s]
 31%|███       | 114617/371472 [9:06:49<20:49:09,  3.43it/s]
 31%|███       | 114618/371472 [9:06:49<20:22:41,  3.50it/s]
 31%|███       | 114619/371472 [9:06:49<19:46:51,  3.61it/s]
 31%|███       | 114620/371472 [9:06:49<19:21:37,  3.69it/s]
                                                            
{'loss': 3.399, 'learning_rate': 7.226346182852465e-07, 'epoch': 4.94}

 31%|███       | 114620/371472 [9:06:49<19:21:37,  3.69it/s]
 31%|███       | 114621/371472 [9:06:50<20:18:46,  3.51it/s]
 31%|███       | 114622/371472 [9:06:50<20:37:45,  3.46it/s]
 31%|███       | 114623/371472 [9:06:50<20:41:57,  3.45it/s]
 31%|███       | 114624/371472 [9:06:51<20:29:26,  3.48it/s]
 31%|███       | 114625/371472 [9:06:51<19:38:07,  3.63it/s]
 31%|███       | 114626/371472 [9:06:51<19:10:09,  3.72it/s]
 31%|███       | 114627/371472 [9:06:51<18:26:32,  3.87it/s]
 31%|███       | 114628/371472 [9:06:52<19:25:12,  3.67it/s]
 31%|███       | 114629/371472 [9:06:52<20:13:56,  3.53it/s]
 31%|███       | 114630/371472 [9:06:52<20:05:08,  3.55it/s]
 31%|███       | 114631/371472 [9:06:53<19:34:49,  3.64it/s]
 31%|███       | 114632/371472 [9:06:53<20:10:07,  3.54it/s]
 31%|███       | 114633/371472 [9:06:53<21:03:19,  3.39it/s]
 31%|███       | 114634/371472 [9:06:53<21:26:58,  3.33it/s]
 31%|███       | 114635/371472 [9:06:54<21:35:47,  3.30it/s]
 31%|███       | 114636/371472 [9:06:54<21:19:15,  3.35it/s]
 31%|███       | 114637/371472 [9:06:54<21:13:41,  3.36it/s]
 31%|███       | 114638/371472 [9:06:55<20:37:20,  3.46it/s]
 31%|███       | 114639/371472 [9:06:55<20:18:42,  3.51it/s]
 31%|███       | 114640/371472 [9:06:55<19:41:09,  3.62it/s]
                                                            
{'loss': 3.5777, 'learning_rate': 7.225861363097674e-07, 'epoch': 4.94}

 31%|███       | 114640/371472 [9:06:55<19:41:09,  3.62it/s]
 31%|███       | 114641/371472 [9:06:56<21:46:10,  3.28it/s]
 31%|███       | 114642/371472 [9:06:56<21:54:39,  3.26it/s]
 31%|███       | 114643/371472 [9:06:56<20:35:41,  3.46it/s]
 31%|███       | 114644/371472 [9:06:56<20:50:19,  3.42it/s]
 31%|███       | 114645/371472 [9:06:57<20:07:12,  3.55it/s]
 31%|███       | 114646/371472 [9:06:57<20:21:27,  3.50it/s]
 31%|███       | 114647/371472 [9:06:57<19:43:34,  3.62it/s]
 31%|███       | 114648/371472 [9:06:57<19:51:33,  3.59it/s]
 31%|███       | 114649/371472 [9:06:58<19:56:12,  3.58it/s]
 31%|███       | 114650/371472 [9:06:58<19:01:36,  3.75it/s]
 31%|███       | 114651/371472 [9:06:58<20:30:52,  3.48it/s]
 31%|███       | 114652/371472 [9:06:59<19:49:21,  3.60it/s]
 31%|███       | 114653/371472 [9:06:59<20:34:15,  3.47it/s]
 31%|███       | 114654/371472 [9:06:59<20:15:16,  3.52it/s]
 31%|███       | 114655/371472 [9:06:59<20:28:26,  3.48it/s]
 31%|███       | 114656/371472 [9:07:00<21:14:59,  3.36it/s]
 31%|███       | 114657/371472 [9:07:00<20:33:43,  3.47it/s]
 31%|███       | 114658/371472 [9:07:00<20:21:43,  3.50it/s]
 31%|███       | 114659/371472 [9:07:01<20:11:21,  3.53it/s]
 31%|███       | 114660/371472 [9:07:01<19:43:34,  3.62it/s]
                                                            
{'loss': 3.3915, 'learning_rate': 7.225376543342885e-07, 'epoch': 4.94}

 31%|███       | 114660/371472 [9:07:01<19:43:34,  3.62it/s]
 31%|███       | 114661/371472 [9:07:01<22:41:07,  3.14it/s]
 31%|███       | 114662/371472 [9:07:02<21:40:16,  3.29it/s]
 31%|███       | 114663/371472 [9:07:02<21:13:55,  3.36it/s]
 31%|███       | 114664/371472 [9:07:02<20:28:09,  3.48it/s]
 31%|███       | 114665/371472 [9:07:02<21:04:14,  3.39it/s]
 31%|███       | 114666/371472 [9:07:03<20:57:09,  3.40it/s]
 31%|███       | 114667/371472 [9:07:03<21:14:25,  3.36it/s]
 31%|███       | 114668/371472 [9:07:03<20:40:15,  3.45it/s]
 31%|███       | 114669/371472 [9:07:04<20:21:19,  3.50it/s]
 31%|███       | 114670/371472 [9:07:04<20:35:05,  3.47it/s]
 31%|███       | 114671/371472 [9:07:04<20:51:39,  3.42it/s]
 31%|███       | 114672/371472 [9:07:04<20:21:33,  3.50it/s]
 31%|███       | 114673/371472 [9:07:05<21:58:27,  3.25it/s]
 31%|███       | 114674/371472 [9:07:05<21:15:16,  3.36it/s]
 31%|███       | 114675/371472 [9:07:05<19:55:04,  3.58it/s]
 31%|███       | 114676/371472 [9:07:06<21:02:56,  3.39it/s]
 31%|███       | 114677/371472 [9:07:06<21:47:46,  3.27it/s]
 31%|███       | 114678/371472 [9:07:06<20:35:33,  3.46it/s]
 31%|███       | 114679/371472 [9:07:07<20:50:53,  3.42it/s]
 31%|███       | 114680/371472 [9:07:07<20:45:35,  3.44it/s]
                                                            
{'loss': 3.3361, 'learning_rate': 7.224891723588097e-07, 'epoch': 4.94}

 31%|███       | 114680/371472 [9:07:07<20:45:35,  3.44it/s]
 31%|███       | 114681/371472 [9:07:07<20:33:58,  3.47it/s]
 31%|███       | 114682/371472 [9:07:07<20:24:07,  3.50it/s]
 31%|███       | 114683/371472 [9:07:08<19:30:44,  3.66it/s]
 31%|███       | 114684/371472 [9:07:08<19:15:50,  3.70it/s]
 31%|███       | 114685/371472 [9:07:08<19:33:53,  3.65it/s]
 31%|███       | 114686/371472 [9:07:08<20:46:54,  3.43it/s]
 31%|███       | 114687/371472 [9:07:09<20:27:43,  3.49it/s]
 31%|███       | 114688/371472 [9:07:09<20:14:09,  3.52it/s]
 31%|███       | 114689/371472 [9:07:09<19:45:05,  3.61it/s]
 31%|███       | 114690/371472 [9:07:10<22:17:42,  3.20it/s]
 31%|███       | 114691/371472 [9:07:10<22:08:27,  3.22it/s]
 31%|███       | 114692/371472 [9:07:10<21:01:43,  3.39it/s]
 31%|███       | 114693/371472 [9:07:11<19:58:12,  3.57it/s]
 31%|███       | 114694/371472 [9:07:11<19:53:53,  3.58it/s]
 31%|███       | 114695/371472 [9:07:11<19:19:42,  3.69it/s]
 31%|███       | 114696/371472 [9:07:11<18:55:22,  3.77it/s]
 31%|███       | 114697/371472 [9:07:12<20:34:23,  3.47it/s]
 31%|███       | 114698/371472 [9:07:12<20:17:49,  3.51it/s]
 31%|███       | 114699/371472 [9:07:12<19:42:54,  3.62it/s]
 31%|███       | 114700/371472 [9:07:13<21:11:23,  3.37it/s]
                                                            
{'loss': 3.2038, 'learning_rate': 7.224406903833308e-07, 'epoch': 4.94}

 31%|███       | 114700/371472 [9:07:13<21:11:23,  3.37it/s]
 31%|███       | 114701/371472 [9:07:13<20:14:51,  3.52it/s]
 31%|███       | 114702/371472 [9:07:13<19:35:35,  3.64it/s]
 31%|███       | 114703/371472 [9:07:13<19:03:54,  3.74it/s]
 31%|███       | 114704/371472 [9:07:14<19:38:15,  3.63it/s]
 31%|███       | 114705/371472 [9:07:14<19:46:21,  3.61it/s]
 31%|███       | 114706/371472 [9:07:14<19:03:53,  3.74it/s]
 31%|███       | 114707/371472 [9:07:14<18:44:11,  3.81it/s]
 31%|███       | 114708/371472 [9:07:15<19:09:34,  3.72it/s]
 31%|███       | 114709/371472 [9:07:15<19:47:10,  3.60it/s]
 31%|███       | 114710/371472 [9:07:15<20:11:53,  3.53it/s]
 31%|███       | 114711/371472 [9:07:15<20:05:18,  3.55it/s]
 31%|███       | 114712/371472 [9:07:16<19:30:24,  3.66it/s]
 31%|███       | 114713/371472 [9:07:16<18:52:05,  3.78it/s]
 31%|███       | 114714/371472 [9:07:16<18:40:50,  3.82it/s]
 31%|███       | 114715/371472 [9:07:17<18:35:20,  3.84it/s]
 31%|███       | 114716/371472 [9:07:17<19:54:13,  3.58it/s]
 31%|███       | 114717/371472 [9:07:17<20:13:34,  3.53it/s]
 31%|███       | 114718/371472 [9:07:17<20:51:59,  3.42it/s]
 31%|███       | 114719/371472 [9:07:18<20:44:18,  3.44it/s]
 31%|███       | 114720/371472 [9:07:18<20:36:54,  3.46it/s]
                                                            
{'loss': 3.4828, 'learning_rate': 7.223922084078518e-07, 'epoch': 4.94}

 31%|███       | 114720/371472 [9:07:18<20:36:54,  3.46it/s]
 31%|███       | 114721/371472 [9:07:18<20:58:34,  3.40it/s]
 31%|███       | 114722/371472 [9:07:19<20:28:57,  3.48it/s]
 31%|███       | 114723/371472 [9:07:19<22:23:48,  3.18it/s]
 31%|███       | 114724/371472 [9:07:19<21:41:45,  3.29it/s]
 31%|███       | 114725/371472 [9:07:20<21:34:03,  3.31it/s]
 31%|███       | 114726/371472 [9:07:20<21:25:04,  3.33it/s]
 31%|███       | 114727/371472 [9:07:20<20:47:40,  3.43it/s]
 31%|███       | 114728/371472 [9:07:20<19:55:26,  3.58it/s]
 31%|███       | 114729/371472 [9:07:21<20:36:56,  3.46it/s]
 31%|███       | 114730/371472 [9:07:21<20:37:37,  3.46it/s]
 31%|███       | 114731/371472 [9:07:21<21:10:17,  3.37it/s]
 31%|███       | 114732/371472 [9:07:22<20:03:39,  3.55it/s]
 31%|███       | 114733/371472 [9:07:22<19:57:11,  3.57it/s]
 31%|███       | 114734/371472 [9:07:22<19:39:16,  3.63it/s]
 31%|███       | 114735/371472 [9:07:22<20:27:19,  3.49it/s]
 31%|███       | 114736/371472 [9:07:23<19:46:17,  3.61it/s]
 31%|███       | 114737/371472 [9:07:23<19:45:53,  3.61it/s]
 31%|███       | 114738/371472 [9:07:23<19:22:00,  3.68it/s]
 31%|███       | 114739/371472 [9:07:24<21:30:36,  3.32it/s]
 31%|███       | 114740/371472 [9:07:24<20:59:36,  3.40it/s]
                                                            
{'loss': 3.4013, 'learning_rate': 7.22343726432373e-07, 'epoch': 4.94}

 31%|███       | 114740/371472 [9:07:24<20:59:36,  3.40it/s]
 31%|███       | 114741/371472 [9:07:24<21:12:21,  3.36it/s]
 31%|███       | 114742/371472 [9:07:24<21:09:28,  3.37it/s]
 31%|███       | 114743/371472 [9:07:25<20:25:17,  3.49it/s]
 31%|███       | 114744/371472 [9:07:25<21:15:46,  3.35it/s]
 31%|███       | 114745/371472 [9:07:25<20:57:09,  3.40it/s]
 31%|███       | 114746/371472 [9:07:26<20:22:46,  3.50it/s]
 31%|███       | 114747/371472 [9:07:26<19:56:02,  3.58it/s]
 31%|███       | 114748/371472 [9:07:26<20:23:22,  3.50it/s]
 31%|███       | 114749/371472 [9:07:26<20:34:22,  3.47it/s]
 31%|███       | 114750/371472 [9:07:27<19:58:22,  3.57it/s]
 31%|███       | 114751/371472 [9:07:27<19:02:55,  3.74it/s]
 31%|███       | 114752/371472 [9:07:27<18:50:02,  3.79it/s]
 31%|███       | 114753/371472 [9:07:27<19:20:10,  3.69it/s]
 31%|███       | 114754/371472 [9:07:28<20:17:10,  3.52it/s]
 31%|███       | 114755/371472 [9:07:28<20:20:43,  3.50it/s]
 31%|███       | 114756/371472 [9:07:28<20:02:41,  3.56it/s]
 31%|███       | 114757/371472 [9:07:29<20:51:09,  3.42it/s]
 31%|███       | 114758/371472 [9:07:29<20:22:54,  3.50it/s]
 31%|███       | 114759/371472 [9:07:29<19:36:59,  3.64it/s]
 31%|███       | 114760/371472 [9:07:29<20:21:42,  3.50it/s]
                                                            
{'loss': 3.4448, 'learning_rate': 7.222952444568942e-07, 'epoch': 4.94}

 31%|███       | 114760/371472 [9:07:29<20:21:42,  3.50it/s]
 31%|███       | 114761/371472 [9:07:30<20:27:17,  3.49it/s]
 31%|███       | 114762/371472 [9:07:30<19:59:21,  3.57it/s]
 31%|███       | 114763/371472 [9:07:30<19:33:08,  3.65it/s]
 31%|███       | 114764/371472 [9:07:31<19:00:31,  3.75it/s]
 31%|███       | 114765/371472 [9:07:31<18:18:50,  3.89it/s]
 31%|███       | 114766/371472 [9:07:31<17:56:39,  3.97it/s]
 31%|███       | 114767/371472 [9:07:31<18:15:13,  3.91it/s]
 31%|███       | 114768/371472 [9:07:32<18:41:58,  3.81it/s]
 31%|███       | 114769/371472 [9:07:32<19:55:54,  3.58it/s]
 31%|███       | 114770/371472 [9:07:32<20:58:33,  3.40it/s]
 31%|███       | 114771/371472 [9:07:33<23:16:15,  3.06it/s]
 31%|███       | 114772/371472 [9:07:33<21:30:50,  3.31it/s]
 31%|███       | 114773/371472 [9:07:33<20:31:58,  3.47it/s]
 31%|███       | 114774/371472 [9:07:33<20:36:40,  3.46it/s]
 31%|███       | 114775/371472 [9:07:34<21:09:41,  3.37it/s]
 31%|███       | 114776/371472 [9:07:34<20:33:40,  3.47it/s]
 31%|███       | 114777/371472 [9:07:34<19:38:09,  3.63it/s]
 31%|███       | 114778/371472 [9:07:34<19:21:35,  3.68it/s]
 31%|███       | 114779/371472 [9:07:35<19:11:08,  3.72it/s]
 31%|███       | 114780/371472 [9:07:35<19:45:38,  3.61it/s]
                                                            
{'loss': 3.2879, 'learning_rate': 7.222467624814152e-07, 'epoch': 4.94}

 31%|███       | 114780/371472 [9:07:35<19:45:38,  3.61it/s]
 31%|███       | 114781/371472 [9:07:35<19:35:24,  3.64it/s]
 31%|███       | 114782/371472 [9:07:36<19:46:51,  3.60it/s]
 31%|███       | 114783/371472 [9:07:36<21:41:20,  3.29it/s]
 31%|███       | 114784/371472 [9:07:36<20:09:47,  3.54it/s]
 31%|███       | 114785/371472 [9:07:36<20:06:08,  3.55it/s]
 31%|███       | 114786/371472 [9:07:37<20:31:59,  3.47it/s]
 31%|███       | 114787/371472 [9:07:37<20:26:17,  3.49it/s]
 31%|███       | 114788/371472 [9:07:37<20:31:50,  3.47it/s]
 31%|███       | 114789/371472 [9:07:38<20:45:22,  3.44it/s]
 31%|███       | 114790/371472 [9:07:38<22:27:15,  3.18it/s]
 31%|███       | 114791/371472 [9:07:38<21:47:55,  3.27it/s]
 31%|███       | 114792/371472 [9:07:39<21:18:17,  3.35it/s]
 31%|███       | 114793/371472 [9:07:39<20:36:06,  3.46it/s]
 31%|███       | 114794/371472 [9:07:39<21:54:22,  3.25it/s]
 31%|███       | 114795/371472 [9:07:39<20:30:12,  3.48it/s]
 31%|███       | 114796/371472 [9:07:40<19:53:54,  3.58it/s]
 31%|███       | 114797/371472 [9:07:40<20:06:16,  3.55it/s]
 31%|███       | 114798/371472 [9:07:40<20:25:36,  3.49it/s]
 31%|███       | 114799/371472 [9:07:41<19:44:08,  3.61it/s]
 31%|███       | 114800/371472 [9:07:41<20:50:43,  3.42it/s]
                                                            
{'loss': 3.2429, 'learning_rate': 7.221982805059362e-07, 'epoch': 4.94}

 31%|███       | 114800/371472 [9:07:41<20:50:43,  3.42it/s]
 31%|███       | 114801/371472 [9:07:41<21:15:10,  3.35it/s]
 31%|███       | 114802/371472 [9:07:41<20:20:25,  3.51it/s]
 31%|███       | 114803/371472 [9:07:42<19:20:21,  3.69it/s]
 31%|███       | 114804/371472 [9:07:42<19:11:25,  3.72it/s]
 31%|███       | 114805/371472 [9:07:42<19:26:22,  3.67it/s]
 31%|███       | 114806/371472 [9:07:42<19:19:02,  3.69it/s]
 31%|███       | 114807/371472 [9:07:43<20:58:45,  3.40it/s]
 31%|███       | 114808/371472 [9:07:43<21:01:31,  3.39it/s]
 31%|███       | 114809/371472 [9:07:43<20:36:36,  3.46it/s]
 31%|███       | 114810/371472 [9:07:44<20:34:09,  3.47it/s]
 31%|███       | 114811/371472 [9:07:44<21:35:03,  3.30it/s]
 31%|███       | 114812/371472 [9:07:44<20:08:38,  3.54it/s]
 31%|███       | 114813/371472 [9:07:45<20:32:07,  3.47it/s]
 31%|███       | 114814/371472 [9:07:45<21:18:32,  3.35it/s]
 31%|███       | 114815/371472 [9:07:45<21:26:31,  3.32it/s]
 31%|███       | 114816/371472 [9:07:45<21:15:25,  3.35it/s]
 31%|███       | 114817/371472 [9:07:46<21:20:00,  3.34it/s]
 31%|███       | 114818/371472 [9:07:46<21:20:07,  3.34it/s]
 31%|███       | 114819/371472 [9:07:46<21:04:33,  3.38it/s]
 31%|███       | 114820/371472 [9:07:47<20:03:11,  3.56it/s]
                                                            
{'loss': 3.3428, 'learning_rate': 7.221497985304574e-07, 'epoch': 4.95}

 31%|███       | 114820/371472 [9:07:47<20:03:11,  3.56it/s]
 31%|███       | 114821/371472 [9:07:47<19:49:02,  3.60it/s]
 31%|███       | 114822/371472 [9:07:47<19:55:27,  3.58it/s]
 31%|███       | 114823/371472 [9:07:47<20:12:19,  3.53it/s]
 31%|███       | 114824/371472 [9:07:48<19:31:48,  3.65it/s]
 31%|███       | 114825/371472 [9:07:48<18:48:12,  3.79it/s]
 31%|███       | 114826/371472 [9:07:48<19:02:43,  3.74it/s]
 31%|███       | 114827/371472 [9:07:49<19:35:44,  3.64it/s]
 31%|███       | 114828/371472 [9:07:49<19:12:56,  3.71it/s]
 31%|███       | 114829/371472 [9:07:49<19:10:46,  3.72it/s]
 31%|███       | 114830/371472 [9:07:49<19:17:26,  3.70it/s]
 31%|███       | 114831/371472 [9:07:50<18:42:26,  3.81it/s]
 31%|███       | 114832/371472 [9:07:50<20:11:33,  3.53it/s]
 31%|███       | 114833/371472 [9:07:50<19:37:58,  3.63it/s]
 31%|███       | 114834/371472 [9:07:50<18:58:08,  3.76it/s]
 31%|███       | 114835/371472 [9:07:51<19:32:34,  3.65it/s]
 31%|███       | 114836/371472 [9:07:51<20:24:59,  3.49it/s]
 31%|███       | 114837/371472 [9:07:51<19:34:28,  3.64it/s]
 31%|███       | 114838/371472 [9:07:52<19:13:38,  3.71it/s]
 31%|███       | 114839/371472 [9:07:52<19:27:50,  3.66it/s]
 31%|███       | 114840/371472 [9:07:52<18:54:13,  3.77it/s]
                                                            
{'loss': 3.3784, 'learning_rate': 7.221013165549785e-07, 'epoch': 4.95}

 31%|███       | 114840/371472 [9:07:52<18:54:13,  3.77it/s]
 31%|███       | 114841/371472 [9:07:52<19:04:11,  3.74it/s]
 31%|███       | 114842/371472 [9:07:53<19:14:11,  3.71it/s]
 31%|███       | 114843/371472 [9:07:53<18:44:04,  3.81it/s]
 31%|███       | 114844/371472 [9:07:53<18:52:36,  3.78it/s]
 31%|███       | 114845/371472 [9:07:53<18:24:52,  3.87it/s]
 31%|███       | 114846/371472 [9:07:54<18:32:13,  3.85it/s]
 31%|███       | 114847/371472 [9:07:54<18:59:43,  3.75it/s]
 31%|███       | 114848/371472 [9:07:54<18:47:10,  3.79it/s]
 31%|███       | 114849/371472 [9:07:54<18:27:59,  3.86it/s]
 31%|███       | 114850/371472 [9:07:55<20:43:58,  3.44it/s]
 31%|███       | 114851/371472 [9:07:55<20:22:36,  3.50it/s]
 31%|███       | 114852/371472 [9:07:55<19:40:05,  3.62it/s]
 31%|███       | 114853/371472 [9:07:56<20:03:45,  3.55it/s]
 31%|███       | 114854/371472 [9:07:56<19:57:24,  3.57it/s]
 31%|███       | 114855/371472 [9:07:56<19:52:05,  3.59it/s]
 31%|███       | 114856/371472 [9:07:56<20:50:38,  3.42it/s]
 31%|███       | 114857/371472 [9:07:57<20:44:28,  3.44it/s]
 31%|███       | 114858/371472 [9:07:57<20:15:58,  3.52it/s]
 31%|███       | 114859/371472 [9:07:57<19:14:56,  3.70it/s]
 31%|███       | 114860/371472 [9:07:58<19:09:16,  3.72it/s]
                                                            
{'loss': 3.3063, 'learning_rate': 7.220528345794996e-07, 'epoch': 4.95}

 31%|███       | 114860/371472 [9:07:58<19:09:16,  3.72it/s]
 31%|███       | 114861/371472 [9:07:58<18:47:18,  3.79it/s]
 31%|███       | 114862/371472 [9:07:58<18:42:17,  3.81it/s]
 31%|███       | 114863/371472 [9:07:58<19:35:11,  3.64it/s]
 31%|███       | 114864/371472 [9:07:59<19:55:57,  3.58it/s]
 31%|███       | 114865/371472 [9:07:59<19:51:25,  3.59it/s]
 31%|███       | 114866/371472 [9:07:59<19:28:09,  3.66it/s]
 31%|███       | 114867/371472 [9:08:00<22:44:09,  3.14it/s]
 31%|███       | 114868/371472 [9:08:00<22:06:57,  3.22it/s]
 31%|███       | 114869/371472 [9:08:00<21:35:04,  3.30it/s]
 31%|███       | 114870/371472 [9:08:00<20:49:12,  3.42it/s]
 31%|███       | 114871/371472 [9:08:01<20:12:08,  3.53it/s]
 31%|███       | 114872/371472 [9:08:01<19:55:59,  3.58it/s]
 31%|███       | 114873/371472 [9:08:01<20:02:00,  3.56it/s]
 31%|███       | 114874/371472 [9:08:02<19:53:25,  3.58it/s]
 31%|███       | 114875/371472 [9:08:02<21:04:40,  3.38it/s]
 31%|███       | 114876/371472 [9:08:02<20:14:41,  3.52it/s]
 31%|███       | 114877/371472 [9:08:02<19:39:49,  3.62it/s]
 31%|███       | 114878/371472 [9:08:03<20:14:18,  3.52it/s]
 31%|███       | 114879/371472 [9:08:03<20:16:09,  3.52it/s]
 31%|███       | 114880/371472 [9:08:03<23:28:42,  3.04it/s]
                                                            
{'loss': 3.4032, 'learning_rate': 7.220043526040207e-07, 'epoch': 4.95}

 31%|███       | 114880/371472 [9:08:03<23:28:42,  3.04it/s]
 31%|███       | 114881/371472 [9:08:04<23:16:11,  3.06it/s]
 31%|███       | 114882/371472 [9:08:04<21:40:14,  3.29it/s]
 31%|███       | 114883/371472 [9:08:04<20:25:47,  3.49it/s]
 31%|███       | 114884/371472 [9:08:04<19:39:06,  3.63it/s]
 31%|███       | 114885/371472 [9:08:05<19:14:06,  3.71it/s]
 31%|███       | 114886/371472 [9:08:05<19:26:37,  3.67it/s]
 31%|███       | 114887/371472 [9:08:05<19:14:31,  3.70it/s]
 31%|███       | 114888/371472 [9:08:06<19:03:41,  3.74it/s]
 31%|███       | 114889/371472 [9:08:06<18:56:50,  3.76it/s]
 31%|███       | 114890/371472 [9:08:06<19:32:08,  3.65it/s]
 31%|███       | 114891/371472 [9:08:06<18:56:12,  3.76it/s]
 31%|███       | 114892/371472 [9:08:07<18:46:23,  3.80it/s]
 31%|███       | 114893/371472 [9:08:07<19:44:09,  3.61it/s]
 31%|███       | 114894/371472 [9:08:07<22:51:03,  3.12it/s]
 31%|███       | 114895/371472 [9:08:08<21:24:28,  3.33it/s]
 31%|███       | 114896/371472 [9:08:08<20:24:50,  3.49it/s]
 31%|███       | 114897/371472 [9:08:08<20:53:16,  3.41it/s]
 31%|███       | 114898/371472 [9:08:08<20:39:21,  3.45it/s]
 31%|███       | 114899/371472 [9:08:09<20:09:59,  3.53it/s]
 31%|███       | 114900/371472 [9:08:09<20:21:38,  3.50it/s]
                                                            
{'loss': 3.3629, 'learning_rate': 7.219558706285418e-07, 'epoch': 4.95}

 31%|███       | 114900/371472 [9:08:09<20:21:38,  3.50it/s]
 31%|███       | 114901/371472 [9:08:09<19:26:55,  3.66it/s]
 31%|███       | 114902/371472 [9:08:09<19:14:25,  3.70it/s]
 31%|███       | 114903/371472 [9:08:10<19:18:10,  3.69it/s]
 31%|███       | 114904/371472 [9:08:10<19:06:44,  3.73it/s]
 31%|███       | 114905/371472 [9:08:10<19:33:48,  3.64it/s]
 31%|███       | 114906/371472 [9:08:11<19:41:12,  3.62it/s]
 31%|███       | 114907/371472 [9:08:11<19:19:43,  3.69it/s]
 31%|███       | 114908/371472 [9:08:11<19:11:15,  3.71it/s]
 31%|███       | 114909/371472 [9:08:11<19:10:29,  3.72it/s]
 31%|███       | 114910/371472 [9:08:12<19:37:46,  3.63it/s]
 31%|███       | 114911/371472 [9:08:12<19:40:58,  3.62it/s]
 31%|███       | 114912/371472 [9:08:12<20:01:49,  3.56it/s]
 31%|███       | 114913/371472 [9:08:13<20:07:05,  3.54it/s]
 31%|███       | 114914/371472 [9:08:13<20:37:14,  3.46it/s]
 31%|███       | 114915/371472 [9:08:13<19:58:11,  3.57it/s]
 31%|███       | 114916/371472 [9:08:13<19:51:52,  3.59it/s]
 31%|███       | 114917/371472 [9:08:14<19:07:44,  3.73it/s]
 31%|███       | 114918/371472 [9:08:14<20:30:25,  3.48it/s]
 31%|███       | 114919/371472 [9:08:14<20:14:41,  3.52it/s]
 31%|███       | 114920/371472 [9:08:15<20:13:52,  3.52it/s]
                                                            
{'loss': 3.3282, 'learning_rate': 7.21907388653063e-07, 'epoch': 4.95}

 31%|███       | 114920/371472 [9:08:15<20:13:52,  3.52it/s]
 31%|███       | 114921/371472 [9:08:15<20:23:16,  3.50it/s]
 31%|███       | 114922/371472 [9:08:15<19:31:48,  3.65it/s]
 31%|███       | 114923/371472 [9:08:15<18:58:05,  3.76it/s]
 31%|███       | 114924/371472 [9:08:16<18:36:43,  3.83it/s]
 31%|███       | 114925/371472 [9:08:16<20:14:25,  3.52it/s]
 31%|███       | 114926/371472 [9:08:16<20:03:57,  3.55it/s]
 31%|███       | 114927/371472 [9:08:16<19:37:50,  3.63it/s]
 31%|███       | 114928/371472 [9:08:17<19:38:28,  3.63it/s]
 31%|███       | 114929/371472 [9:08:17<20:19:55,  3.50it/s]
 31%|███       | 114930/371472 [9:08:17<19:41:09,  3.62it/s]
 31%|███       | 114931/371472 [9:08:18<21:25:43,  3.33it/s]
 31%|███       | 114932/371472 [9:08:18<20:54:51,  3.41it/s]
 31%|███       | 114933/371472 [9:08:18<20:23:33,  3.49it/s]
 31%|███       | 114934/371472 [9:08:18<21:21:44,  3.34it/s]
 31%|███       | 114935/371472 [9:08:19<20:18:30,  3.51it/s]
 31%|███       | 114936/371472 [9:08:19<19:19:02,  3.69it/s]
 31%|███       | 114937/371472 [9:08:19<18:53:55,  3.77it/s]
 31%|███       | 114938/371472 [9:08:19<18:23:25,  3.87it/s]
 31%|███       | 114939/371472 [9:08:20<19:20:23,  3.68it/s]
 31%|███       | 114940/371472 [9:08:20<19:16:12,  3.70it/s]
                                                            
{'loss': 3.2692, 'learning_rate': 7.21858906677584e-07, 'epoch': 4.95}

 31%|███       | 114940/371472 [9:08:20<19:16:12,  3.70it/s]
 31%|███       | 114941/371472 [9:08:20<19:42:35,  3.62it/s]
 31%|███       | 114942/371472 [9:08:21<19:36:52,  3.63it/s]
 31%|███       | 114943/371472 [9:08:21<19:21:10,  3.68it/s]
 31%|███       | 114944/371472 [9:08:21<18:48:03,  3.79it/s]
 31%|███       | 114945/371472 [9:08:21<20:56:01,  3.40it/s]
 31%|███       | 114946/371472 [9:08:22<20:45:56,  3.43it/s]
 31%|███       | 114947/371472 [9:08:22<20:02:17,  3.56it/s]
 31%|███       | 114948/371472 [9:08:22<19:14:32,  3.70it/s]
 31%|███       | 114949/371472 [9:08:23<18:48:25,  3.79it/s]
 31%|███       | 114950/371472 [9:08:23<19:44:03,  3.61it/s]
 31%|███       | 114951/371472 [9:08:23<18:53:29,  3.77it/s]
 31%|███       | 114952/371472 [9:08:23<18:49:39,  3.78it/s]
 31%|███       | 114953/371472 [9:08:24<18:55:56,  3.76it/s]
 31%|███       | 114954/371472 [9:08:24<19:06:55,  3.73it/s]
 31%|███       | 114955/371472 [9:08:24<18:56:58,  3.76it/s]
 31%|███       | 114956/371472 [9:08:24<19:25:33,  3.67it/s]
 31%|███       | 114957/371472 [9:08:25<19:35:17,  3.64it/s]
 31%|███       | 114958/371472 [9:08:25<19:29:54,  3.65it/s]
 31%|███       | 114959/371472 [9:08:25<19:33:10,  3.64it/s]
 31%|███       | 114960/371472 [9:08:26<19:41:37,  3.62it/s]
                                                            
{'loss': 3.3157, 'learning_rate': 7.218104247021051e-07, 'epoch': 4.95}

 31%|███       | 114960/371472 [9:08:26<19:41:37,  3.62it/s]
 31%|███       | 114961/371472 [9:08:26<19:13:29,  3.71it/s]
 31%|███       | 114962/371472 [9:08:26<20:42:26,  3.44it/s]
 31%|███       | 114963/371472 [9:08:26<20:46:46,  3.43it/s]
 31%|███       | 114964/371472 [9:08:27<24:23:56,  2.92it/s]
 31%|███       | 114965/371472 [9:08:27<22:18:03,  3.20it/s]
 31%|███       | 114966/371472 [9:08:27<22:38:51,  3.15it/s]
 31%|███       | 114967/371472 [9:08:28<22:07:59,  3.22it/s]
 31%|███       | 114968/371472 [9:08:28<21:22:38,  3.33it/s]
 31%|███       | 114969/371472 [9:08:28<21:51:01,  3.26it/s]
 31%|███       | 114970/371472 [9:08:29<20:50:41,  3.42it/s]
 31%|███       | 114971/371472 [9:08:29<19:42:38,  3.61it/s]
 31%|███       | 114972/371472 [9:08:29<19:35:50,  3.64it/s]
 31%|███       | 114973/371472 [9:08:29<19:10:47,  3.71it/s]
 31%|███       | 114974/371472 [9:08:30<19:14:09,  3.70it/s]
 31%|███       | 114975/371472 [9:08:30<19:09:50,  3.72it/s]
 31%|███       | 114976/371472 [9:08:30<19:08:30,  3.72it/s]
 31%|███       | 114977/371472 [9:08:30<19:12:55,  3.71it/s]
 31%|███       | 114978/371472 [9:08:31<19:16:32,  3.70it/s]
 31%|███       | 114979/371472 [9:08:31<21:37:49,  3.29it/s]
 31%|███       | 114980/371472 [9:08:31<20:39:22,  3.45it/s]
                                                            
{'loss': 3.3772, 'learning_rate': 7.217619427266263e-07, 'epoch': 4.95}

 31%|███       | 114980/371472 [9:08:31<20:39:22,  3.45it/s]
 31%|███       | 114981/371472 [9:08:32<20:45:13,  3.43it/s]
 31%|███       | 114982/371472 [9:08:32<20:48:25,  3.42it/s]
 31%|███       | 114983/371472 [9:08:32<21:57:17,  3.25it/s]
 31%|███       | 114984/371472 [9:08:33<21:17:54,  3.35it/s]
 31%|███       | 114985/371472 [9:08:33<20:31:50,  3.47it/s]
 31%|███       | 114986/371472 [9:08:33<19:26:40,  3.66it/s]
 31%|███       | 114987/371472 [9:08:33<19:22:03,  3.68it/s]
 31%|███       | 114988/371472 [9:08:34<20:08:35,  3.54it/s]
 31%|███       | 114989/371472 [9:08:34<20:28:26,  3.48it/s]
 31%|███       | 114990/371472 [9:08:34<19:33:43,  3.64it/s]
 31%|███       | 114991/371472 [9:08:35<20:44:10,  3.44it/s]
 31%|███       | 114992/371472 [9:08:35<21:21:10,  3.34it/s]
 31%|███       | 114993/371472 [9:08:35<20:58:02,  3.40it/s]
 31%|███       | 114994/371472 [9:08:35<19:50:05,  3.59it/s]
 31%|███       | 114995/371472 [9:08:36<19:31:50,  3.65it/s]
 31%|███       | 114996/371472 [9:08:36<19:23:23,  3.67it/s]
 31%|███       | 114997/371472 [9:08:36<18:56:14,  3.76it/s]
 31%|███       | 114998/371472 [9:08:37<21:01:24,  3.39it/s]
 31%|███       | 114999/371472 [9:08:37<20:44:03,  3.44it/s]
 31%|███       | 115000/371472 [9:08:37<19:52:10,  3.59it/s]
                                                            
{'loss': 3.334, 'learning_rate': 7.217134607511475e-07, 'epoch': 4.95}

 31%|███       | 115000/371472 [9:08:37<19:52:10,  3.59it/s]
 31%|███       | 115001/371472 [9:08:37<20:15:33,  3.52it/s]
 31%|███       | 115002/371472 [9:08:38<19:52:17,  3.59it/s]
 31%|███       | 115003/371472 [9:08:38<21:18:55,  3.34it/s]
 31%|███       | 115004/371472 [9:08:38<20:23:22,  3.49it/s]
 31%|███       | 115005/371472 [9:08:38<20:10:08,  3.53it/s]
 31%|███       | 115006/371472 [9:08:39<19:37:12,  3.63it/s]
 31%|███       | 115007/371472 [9:08:39<18:48:33,  3.79it/s]
 31%|███       | 115008/371472 [9:08:39<20:57:32,  3.40it/s]
 31%|███       | 115009/371472 [9:08:40<21:37:50,  3.29it/s]
 31%|███       | 115010/371472 [9:08:40<20:25:45,  3.49it/s]
 31%|███       | 115011/371472 [9:08:40<21:03:38,  3.38it/s]
 31%|███       | 115012/371472 [9:08:41<21:08:45,  3.37it/s]
 31%|███       | 115013/371472 [9:08:41<20:11:57,  3.53it/s]
 31%|███       | 115014/371472 [9:08:41<19:24:14,  3.67it/s]
 31%|███       | 115015/371472 [9:08:41<19:01:12,  3.75it/s]
 31%|███       | 115016/371472 [9:08:42<18:34:32,  3.83it/s]
 31%|███       | 115017/371472 [9:08:42<18:22:05,  3.88it/s]
 31%|███       | 115018/371472 [9:08:42<18:49:54,  3.78it/s]
 31%|███       | 115019/371472 [9:08:42<19:06:57,  3.73it/s]
 31%|███       | 115020/371472 [9:08:43<19:01:46,  3.74it/s]
                                                            
{'loss': 3.4466, 'learning_rate': 7.216649787756685e-07, 'epoch': 4.95}

 31%|███       | 115020/371472 [9:08:43<19:01:46,  3.74it/s]
 31%|███       | 115021/371472 [9:08:43<18:52:25,  3.77it/s]
 31%|███       | 115022/371472 [9:08:43<23:59:12,  2.97it/s]
 31%|███       | 115023/371472 [9:08:44<22:44:32,  3.13it/s]
 31%|███       | 115024/371472 [9:08:44<21:39:15,  3.29it/s]
 31%|███       | 115025/371472 [9:08:44<22:27:08,  3.17it/s]
 31%|███       | 115026/371472 [9:08:44<20:45:35,  3.43it/s]
 31%|███       | 115027/371472 [9:08:45<19:58:47,  3.57it/s]
 31%|███       | 115028/371472 [9:08:45<20:30:46,  3.47it/s]
 31%|███       | 115029/371472 [9:08:45<21:11:35,  3.36it/s]
 31%|███       | 115030/371472 [9:08:46<20:06:23,  3.54it/s]
 31%|███       | 115031/371472 [9:08:46<19:27:25,  3.66it/s]
 31%|███       | 115032/371472 [9:08:46<19:11:20,  3.71it/s]
 31%|███       | 115033/371472 [9:08:46<20:20:24,  3.50it/s]
 31%|███       | 115034/371472 [9:08:47<19:30:35,  3.65it/s]
 31%|███       | 115035/371472 [9:08:47<20:47:17,  3.43it/s]
 31%|███       | 115036/371472 [9:08:47<20:30:36,  3.47it/s]
 31%|███       | 115037/371472 [9:08:48<20:37:46,  3.45it/s]
 31%|███       | 115038/371472 [9:08:48<20:20:05,  3.50it/s]
 31%|███       | 115039/371472 [9:08:48<20:48:24,  3.42it/s]
 31%|███       | 115040/371472 [9:08:48<20:19:43,  3.50it/s]
                                                            
{'loss': 3.3218, 'learning_rate': 7.216164968001895e-07, 'epoch': 4.95}

 31%|███       | 115040/371472 [9:08:48<20:19:43,  3.50it/s]
 31%|███       | 115041/371472 [9:08:49<20:16:53,  3.51it/s]
 31%|███       | 115042/371472 [9:08:49<20:26:23,  3.48it/s]
 31%|███       | 115043/371472 [9:08:49<20:34:10,  3.46it/s]
 31%|███       | 115044/371472 [9:08:50<21:07:22,  3.37it/s]
 31%|███       | 115045/371472 [9:08:50<20:23:49,  3.49it/s]
 31%|███       | 115046/371472 [9:08:50<19:27:01,  3.66it/s]
 31%|███       | 115047/371472 [9:08:50<21:07:24,  3.37it/s]
 31%|███       | 115048/371472 [9:08:51<20:09:26,  3.53it/s]
 31%|███       | 115049/371472 [9:08:51<20:03:58,  3.55it/s]
 31%|███       | 115050/371472 [9:08:51<21:02:51,  3.38it/s]
 31%|███       | 115051/371472 [9:08:52<19:58:52,  3.56it/s]
 31%|███       | 115052/371472 [9:08:52<20:43:20,  3.44it/s]
 31%|███       | 115053/371472 [9:08:52<21:20:47,  3.34it/s]
 31%|███       | 115054/371472 [9:08:52<20:33:51,  3.46it/s]
 31%|███       | 115055/371472 [9:08:53<21:27:14,  3.32it/s]
 31%|███       | 115056/371472 [9:08:53<22:01:25,  3.23it/s]
 31%|███       | 115057/371472 [9:08:54<24:05:08,  2.96it/s]
 31%|███       | 115058/371472 [9:08:54<22:56:00,  3.11it/s]
 31%|███       | 115059/371472 [9:08:54<22:50:12,  3.12it/s]
 31%|███       | 115060/371472 [9:08:54<22:46:24,  3.13it/s]
                                                            
{'loss': 3.2133, 'learning_rate': 7.215680148247107e-07, 'epoch': 4.96}

 31%|███       | 115060/371472 [9:08:54<22:46:24,  3.13it/s]
 31%|███       | 115061/371472 [9:08:55<22:29:41,  3.17it/s]
 31%|███       | 115062/371472 [9:08:55<22:03:06,  3.23it/s]
 31%|███       | 115063/371472 [9:08:55<21:10:05,  3.36it/s]
 31%|███       | 115064/371472 [9:08:56<22:17:01,  3.20it/s]
 31%|███       | 115065/371472 [9:08:56<20:59:24,  3.39it/s]
 31%|███       | 115066/371472 [9:08:56<20:05:39,  3.54it/s]
 31%|███       | 115067/371472 [9:08:57<20:27:46,  3.48it/s]
 31%|███       | 115068/371472 [9:08:57<21:40:32,  3.29it/s]
 31%|███       | 115069/371472 [9:08:57<21:38:52,  3.29it/s]
 31%|███       | 115070/371472 [9:08:57<20:43:24,  3.44it/s]
 31%|███       | 115071/371472 [9:08:58<21:29:01,  3.32it/s]
 31%|███       | 115072/371472 [9:08:58<21:38:29,  3.29it/s]
 31%|███       | 115073/371472 [9:08:58<21:19:56,  3.34it/s]
 31%|███       | 115074/371472 [9:08:59<21:28:30,  3.32it/s]
 31%|███       | 115075/371472 [9:08:59<20:30:50,  3.47it/s]
 31%|███       | 115076/371472 [9:08:59<20:41:30,  3.44it/s]
 31%|███       | 115077/371472 [9:08:59<20:24:56,  3.49it/s]
 31%|███       | 115078/371472 [9:09:00<19:52:48,  3.58it/s]
 31%|███       | 115079/371472 [9:09:00<19:29:17,  3.65it/s]
 31%|███       | 115080/371472 [9:09:00<19:13:41,  3.70it/s]
                                                            
{'loss': 3.3602, 'learning_rate': 7.215195328492319e-07, 'epoch': 4.96}

 31%|███       | 115080/371472 [9:09:00<19:13:41,  3.70it/s]
 31%|███       | 115081/371472 [9:09:01<19:11:45,  3.71it/s]
 31%|███       | 115082/371472 [9:09:01<20:01:40,  3.56it/s]
 31%|███       | 115083/371472 [9:09:01<19:52:32,  3.58it/s]
 31%|███       | 115084/371472 [9:09:01<19:35:49,  3.63it/s]
 31%|███       | 115085/371472 [9:09:02<19:13:51,  3.70it/s]
 31%|███       | 115086/371472 [9:09:02<18:39:36,  3.82it/s]
 31%|███       | 115087/371472 [9:09:02<18:09:24,  3.92it/s]
 31%|███       | 115088/371472 [9:09:02<18:22:48,  3.87it/s]
 31%|███       | 115089/371472 [9:09:03<19:15:48,  3.70it/s]
 31%|███       | 115090/371472 [9:09:03<19:35:12,  3.64it/s]
 31%|███       | 115091/371472 [9:09:03<18:56:25,  3.76it/s]
 31%|███       | 115092/371472 [9:09:03<18:13:46,  3.91it/s]
 31%|███       | 115093/371472 [9:09:04<20:07:47,  3.54it/s]
 31%|███       | 115094/371472 [9:09:04<20:32:09,  3.47it/s]
 31%|███       | 115095/371472 [9:09:04<19:43:51,  3.61it/s]
 31%|███       | 115096/371472 [9:09:05<20:26:02,  3.49it/s]
 31%|███       | 115097/371472 [9:09:05<20:39:34,  3.45it/s]
 31%|███       | 115098/371472 [9:09:05<22:47:57,  3.12it/s]
 31%|███       | 115099/371472 [9:09:06<21:12:06,  3.36it/s]
 31%|███       | 115100/371472 [9:09:06<23:27:43,  3.04it/s]
                                                            
{'loss': 3.3511, 'learning_rate': 7.214710508737529e-07, 'epoch': 4.96}

 31%|███       | 115100/371472 [9:09:06<23:27:43,  3.04it/s]
 31%|███       | 115101/371472 [9:09:06<22:23:22,  3.18it/s]
 31%|███       | 115102/371472 [9:09:07<20:56:13,  3.40it/s]
 31%|███       | 115103/371472 [9:09:07<20:34:16,  3.46it/s]
 31%|███       | 115104/371472 [9:09:07<19:53:36,  3.58it/s]
 31%|███       | 115105/371472 [9:09:07<19:51:41,  3.59it/s]
 31%|███       | 115106/371472 [9:09:08<20:52:07,  3.41it/s]
 31%|███       | 115107/371472 [9:09:08<21:09:12,  3.37it/s]
 31%|███       | 115108/371472 [9:09:08<20:43:55,  3.43it/s]
 31%|███       | 115109/371472 [9:09:09<20:32:33,  3.47it/s]
 31%|███       | 115110/371472 [9:09:09<21:09:27,  3.37it/s]
 31%|███       | 115111/371472 [9:09:09<20:35:50,  3.46it/s]
 31%|███       | 115112/371472 [9:09:09<21:58:49,  3.24it/s]
 31%|███       | 115113/371472 [9:09:10<21:27:47,  3.32it/s]
 31%|███       | 115114/371472 [9:09:10<20:48:35,  3.42it/s]
 31%|███       | 115115/371472 [9:09:10<20:00:04,  3.56it/s]
 31%|███       | 115116/371472 [9:09:11<19:43:10,  3.61it/s]
 31%|███       | 115117/371472 [9:09:11<19:45:00,  3.61it/s]
 31%|███       | 115118/371472 [9:09:11<19:02:37,  3.74it/s]
 31%|███       | 115119/371472 [9:09:11<19:08:51,  3.72it/s]
 31%|███       | 115120/371472 [9:09:12<19:10:22,  3.71it/s]
                                                            
{'loss': 3.5421, 'learning_rate': 7.21422568898274e-07, 'epoch': 4.96}

 31%|███       | 115120/371472 [9:09:12<19:10:22,  3.71it/s]
 31%|███       | 115121/371472 [9:09:12<19:13:06,  3.71it/s]
 31%|███       | 115122/371472 [9:09:12<19:10:18,  3.71it/s]
 31%|███       | 115123/371472 [9:09:12<18:52:59,  3.77it/s]
 31%|███       | 115124/371472 [9:09:13<19:25:09,  3.67it/s]
 31%|███       | 115125/371472 [9:09:13<19:54:04,  3.58it/s]
 31%|███       | 115126/371472 [9:09:13<19:37:54,  3.63it/s]
 31%|███       | 115127/371472 [9:09:14<19:30:15,  3.65it/s]
 31%|███       | 115128/371472 [9:09:14<19:47:07,  3.60it/s]
 31%|███       | 115129/371472 [9:09:14<19:19:42,  3.68it/s]
 31%|███       | 115130/371472 [9:09:14<21:17:09,  3.35it/s]
 31%|███       | 115131/371472 [9:09:15<21:55:34,  3.25it/s]
 31%|███       | 115132/371472 [9:09:15<21:13:43,  3.35it/s]
 31%|███       | 115133/371472 [9:09:15<20:54:58,  3.40it/s]
 31%|███       | 115134/371472 [9:09:16<22:38:56,  3.14it/s]
 31%|███       | 115135/371472 [9:09:16<21:32:02,  3.31it/s]
 31%|███       | 115136/371472 [9:09:16<20:17:45,  3.51it/s]
 31%|███       | 115137/371472 [9:09:17<20:48:36,  3.42it/s]
 31%|███       | 115138/371472 [9:09:17<20:18:04,  3.51it/s]
 31%|███       | 115139/371472 [9:09:17<20:09:42,  3.53it/s]
 31%|███       | 115140/371472 [9:09:17<20:01:11,  3.56it/s]
                                                            
{'loss': 3.4279, 'learning_rate': 7.213740869227952e-07, 'epoch': 4.96}

 31%|███       | 115140/371472 [9:09:17<20:01:11,  3.56it/s]
 31%|███       | 115141/371472 [9:09:18<20:14:34,  3.52it/s]
 31%|███       | 115142/371472 [9:09:18<20:26:08,  3.48it/s]
 31%|███       | 115143/371472 [9:09:18<20:06:29,  3.54it/s]
 31%|███       | 115144/371472 [9:09:18<19:44:46,  3.61it/s]
 31%|███       | 115145/371472 [9:09:19<19:56:17,  3.57it/s]
 31%|███       | 115146/371472 [9:09:19<20:01:49,  3.55it/s]
 31%|███       | 115147/371472 [9:09:19<20:00:10,  3.56it/s]
 31%|███       | 115148/371472 [9:09:20<20:06:06,  3.54it/s]
 31%|███       | 115149/371472 [9:09:20<20:02:17,  3.55it/s]
 31%|███       | 115150/371472 [9:09:20<20:38:47,  3.45it/s]
 31%|███       | 115151/371472 [9:09:20<20:42:59,  3.44it/s]
 31%|███       | 115152/371472 [9:09:21<20:30:06,  3.47it/s]
 31%|███       | 115153/371472 [9:09:21<21:20:31,  3.34it/s]
 31%|███       | 115154/371472 [9:09:21<21:47:42,  3.27it/s]
 31%|███       | 115155/371472 [9:09:22<21:15:43,  3.35it/s]
 31%|███       | 115156/371472 [9:09:22<20:39:49,  3.45it/s]
 31%|███       | 115157/371472 [9:09:22<20:10:10,  3.53it/s]
 31%|███       | 115158/371472 [9:09:23<20:38:54,  3.45it/s]
 31%|███       | 115159/371472 [9:09:23<19:31:55,  3.65it/s]
 31%|███       | 115160/371472 [9:09:23<19:28:45,  3.66it/s]
                                                            
{'loss': 3.2522, 'learning_rate': 7.213256049473163e-07, 'epoch': 4.96}

 31%|███       | 115160/371472 [9:09:23<19:28:45,  3.66it/s]
 31%|███       | 115161/371472 [9:09:23<20:37:10,  3.45it/s]
 31%|███       | 115162/371472 [9:09:24<20:12:46,  3.52it/s]
 31%|███       | 115163/371472 [9:09:24<21:22:32,  3.33it/s]
 31%|███       | 115164/371472 [9:09:24<20:31:53,  3.47it/s]
 31%|███       | 115165/371472 [9:09:24<19:54:32,  3.58it/s]
 31%|███       | 115166/371472 [9:09:25<19:53:41,  3.58it/s]
 31%|███       | 115167/371472 [9:09:25<20:57:51,  3.40it/s]
 31%|███       | 115168/371472 [9:09:25<20:43:31,  3.44it/s]
 31%|███       | 115169/371472 [9:09:26<19:54:06,  3.58it/s]
 31%|███       | 115170/371472 [9:09:26<19:24:16,  3.67it/s]
 31%|███       | 115171/371472 [9:09:26<19:36:05,  3.63it/s]
 31%|███       | 115172/371472 [9:09:26<19:46:54,  3.60it/s]
 31%|███       | 115173/371472 [9:09:27<19:33:13,  3.64it/s]
 31%|███       | 115174/371472 [9:09:27<19:08:02,  3.72it/s]
 31%|███       | 115175/371472 [9:09:27<20:28:05,  3.48it/s]
 31%|███       | 115176/371472 [9:09:28<19:55:24,  3.57it/s]
 31%|███       | 115177/371472 [9:09:28<20:05:24,  3.54it/s]
 31%|███       | 115178/371472 [9:09:28<19:51:41,  3.58it/s]
 31%|███       | 115179/371472 [9:09:28<19:44:50,  3.61it/s]
 31%|███       | 115180/371472 [9:09:29<20:37:36,  3.45it/s]
                                                            
{'loss': 3.4242, 'learning_rate': 7.212771229718373e-07, 'epoch': 4.96}

 31%|███       | 115180/371472 [9:09:29<20:37:36,  3.45it/s]
 31%|███       | 115181/371472 [9:09:29<23:54:19,  2.98it/s]
 31%|███       | 115182/371472 [9:09:29<23:26:38,  3.04it/s]
 31%|███       | 115183/371472 [9:09:30<22:28:30,  3.17it/s]
 31%|███       | 115184/371472 [9:09:30<21:42:42,  3.28it/s]
 31%|███       | 115185/371472 [9:09:30<20:40:32,  3.44it/s]
 31%|███       | 115186/371472 [9:09:31<20:13:15,  3.52it/s]
 31%|███       | 115187/371472 [9:09:31<20:18:28,  3.51it/s]
 31%|███       | 115188/371472 [9:09:31<20:18:59,  3.50it/s]
 31%|███       | 115189/371472 [9:09:31<20:02:27,  3.55it/s]
 31%|███       | 115190/371472 [9:09:32<20:11:37,  3.53it/s]
 31%|███       | 115191/371472 [9:09:32<19:46:08,  3.60it/s]
 31%|███       | 115192/371472 [9:09:32<20:19:11,  3.50it/s]
 31%|███       | 115193/371472 [9:09:33<20:02:13,  3.55it/s]
 31%|███       | 115194/371472 [9:09:33<20:16:14,  3.51it/s]
 31%|███       | 115195/371472 [9:09:33<20:31:48,  3.47it/s]
 31%|███       | 115196/371472 [9:09:33<21:01:51,  3.38it/s]
 31%|███       | 115197/371472 [9:09:34<23:16:49,  3.06it/s]
 31%|███       | 115198/371472 [9:09:34<21:39:48,  3.29it/s]
 31%|███       | 115199/371472 [9:09:34<20:18:57,  3.50it/s]
 31%|███       | 115200/371472 [9:09:35<20:18:06,  3.51it/s]
                                                            
{'loss': 3.3116, 'learning_rate': 7.212286409963584e-07, 'epoch': 4.96}

 31%|███       | 115200/371472 [9:09:35<20:18:06,  3.51it/s]
 31%|███       | 115201/371472 [9:09:35<20:43:46,  3.43it/s]
 31%|███       | 115202/371472 [9:09:35<20:10:38,  3.53it/s]
 31%|███       | 115203/371472 [9:09:35<20:05:25,  3.54it/s]
 31%|███       | 115204/371472 [9:09:36<20:03:38,  3.55it/s]
 31%|███       | 115205/371472 [9:09:36<19:21:35,  3.68it/s]
 31%|███       | 115206/371472 [9:09:36<19:13:32,  3.70it/s]
 31%|███       | 115207/371472 [9:09:37<19:42:03,  3.61it/s]
 31%|███       | 115208/371472 [9:09:37<19:46:13,  3.60it/s]
 31%|███       | 115209/371472 [9:09:37<19:59:41,  3.56it/s]
 31%|███       | 115210/371472 [9:09:37<20:31:54,  3.47it/s]
 31%|███       | 115211/371472 [9:09:38<19:57:19,  3.57it/s]
 31%|███       | 115212/371472 [9:09:38<18:54:49,  3.76it/s]
 31%|███       | 115213/371472 [9:09:38<21:42:48,  3.28it/s]
 31%|███       | 115214/371472 [9:09:39<21:05:18,  3.38it/s]
 31%|███       | 115215/371472 [9:09:39<20:28:12,  3.48it/s]
 31%|███       | 115216/371472 [9:09:39<19:55:32,  3.57it/s]
 31%|███       | 115217/371472 [9:09:39<19:20:07,  3.68it/s]
 31%|███       | 115218/371472 [9:09:40<18:44:15,  3.80it/s]
 31%|███       | 115219/371472 [9:09:40<18:40:58,  3.81it/s]
 31%|███       | 115220/371472 [9:09:40<18:53:21,  3.77it/s]
                                                            
{'loss': 3.3607, 'learning_rate': 7.211801590208796e-07, 'epoch': 4.96}

 31%|███       | 115220/371472 [9:09:40<18:53:21,  3.77it/s]
 31%|███       | 115221/371472 [9:09:40<18:37:39,  3.82it/s]
 31%|███       | 115222/371472 [9:09:41<17:57:31,  3.96it/s]
 31%|███       | 115223/371472 [9:09:41<18:25:55,  3.86it/s]
 31%|███       | 115224/371472 [9:09:41<19:45:14,  3.60it/s]
 31%|███       | 115225/371472 [9:09:42<19:44:31,  3.61it/s]
 31%|███       | 115226/371472 [9:09:42<19:34:08,  3.64it/s]
 31%|███       | 115227/371472 [9:09:42<19:39:38,  3.62it/s]
 31%|███       | 115228/371472 [9:09:42<19:16:44,  3.69it/s]
 31%|███       | 115229/371472 [9:09:43<19:05:26,  3.73it/s]
 31%|███       | 115230/371472 [9:09:43<18:56:30,  3.76it/s]
 31%|███       | 115231/371472 [9:09:43<19:11:53,  3.71it/s]
 31%|███       | 115232/371472 [9:09:43<20:02:30,  3.55it/s]
 31%|███       | 115233/371472 [9:09:44<20:21:46,  3.50it/s]
 31%|███       | 115234/371472 [9:09:44<19:16:14,  3.69it/s]
 31%|███       | 115235/371472 [9:09:44<18:40:55,  3.81it/s]
 31%|███       | 115236/371472 [9:09:44<19:04:19,  3.73it/s]
 31%|███       | 115237/371472 [9:09:45<21:37:28,  3.29it/s]
 31%|███       | 115238/371472 [9:09:45<21:53:19,  3.25it/s]
 31%|███       | 115239/371472 [9:09:46<22:11:17,  3.21it/s]
 31%|███       | 115240/371472 [9:09:46<21:01:57,  3.38it/s]
                                                            
{'loss': 3.3513, 'learning_rate': 7.211316770454006e-07, 'epoch': 4.96}

 31%|███       | 115240/371472 [9:09:46<21:01:57,  3.38it/s]
 31%|███       | 115241/371472 [9:09:46<20:43:45,  3.43it/s]
 31%|███       | 115242/371472 [9:09:46<20:14:44,  3.52it/s]
 31%|███       | 115243/371472 [9:09:47<20:15:07,  3.51it/s]
 31%|███       | 115244/371472 [9:09:47<20:13:35,  3.52it/s]
 31%|███       | 115245/371472 [9:09:47<19:55:48,  3.57it/s]
 31%|███       | 115246/371472 [9:09:47<20:11:38,  3.52it/s]
 31%|███       | 115247/371472 [9:09:48<19:52:01,  3.58it/s]
 31%|███       | 115248/371472 [9:09:48<20:34:55,  3.46it/s]
 31%|███       | 115249/371472 [9:09:48<20:33:35,  3.46it/s]
 31%|███       | 115250/371472 [9:09:49<19:58:11,  3.56it/s]
 31%|███       | 115251/371472 [9:09:49<19:49:34,  3.59it/s]
 31%|███       | 115252/371472 [9:09:49<20:31:05,  3.47it/s]
 31%|███       | 115253/371472 [9:09:50<21:46:50,  3.27it/s]
 31%|███       | 115254/371472 [9:09:50<21:24:02,  3.33it/s]
 31%|███       | 115255/371472 [9:09:50<21:55:03,  3.25it/s]
 31%|███       | 115256/371472 [9:09:50<21:41:33,  3.28it/s]
 31%|███       | 115257/371472 [9:09:51<20:56:33,  3.40it/s]
 31%|███       | 115258/371472 [9:09:51<19:49:30,  3.59it/s]
 31%|███       | 115259/371472 [9:09:51<20:55:15,  3.40it/s]
 31%|███       | 115260/371472 [9:09:52<20:38:35,  3.45it/s]
                                                            
{'loss': 3.2433, 'learning_rate': 7.210831950699218e-07, 'epoch': 4.96}

 31%|███       | 115260/371472 [9:09:52<20:38:35,  3.45it/s]
 31%|███       | 115261/371472 [9:09:52<20:23:33,  3.49it/s]
 31%|███       | 115262/371472 [9:09:52<21:19:07,  3.34it/s]
 31%|███       | 115263/371472 [9:09:52<21:34:20,  3.30it/s]
 31%|███       | 115264/371472 [9:09:53<20:13:31,  3.52it/s]
 31%|███       | 115265/371472 [9:09:53<20:11:47,  3.52it/s]
 31%|███       | 115266/371472 [9:09:53<21:33:25,  3.30it/s]
 31%|███       | 115267/371472 [9:09:54<20:38:44,  3.45it/s]
 31%|███       | 115268/371472 [9:09:54<21:11:44,  3.36it/s]
 31%|███       | 115269/371472 [9:09:54<20:15:40,  3.51it/s]
 31%|███       | 115270/371472 [9:09:54<20:06:34,  3.54it/s]
 31%|███       | 115271/371472 [9:09:55<21:06:03,  3.37it/s]
 31%|███       | 115272/371472 [9:09:55<21:53:18,  3.25it/s]
 31%|███       | 115273/371472 [9:09:55<20:31:47,  3.47it/s]
 31%|███       | 115274/371472 [9:09:56<20:48:10,  3.42it/s]
 31%|███       | 115275/371472 [9:09:56<20:11:52,  3.52it/s]
 31%|███       | 115276/371472 [9:09:56<20:00:51,  3.56it/s]
 31%|███       | 115277/371472 [9:09:56<19:39:39,  3.62it/s]
 31%|███       | 115278/371472 [9:09:57<19:24:46,  3.67it/s]
 31%|███       | 115279/371472 [9:09:57<19:18:44,  3.68it/s]
 31%|███       | 115280/371472 [9:09:57<18:45:46,  3.79it/s]
                                                            
{'loss': 3.2373, 'learning_rate': 7.210347130944428e-07, 'epoch': 4.97}

 31%|███       | 115280/371472 [9:09:57<18:45:46,  3.79it/s]
 31%|███       | 115281/371472 [9:09:58<20:05:14,  3.54it/s]
 31%|███       | 115282/371472 [9:09:58<19:52:08,  3.58it/s]
 31%|███       | 115283/371472 [9:09:58<18:59:57,  3.75it/s]
 31%|███       | 115284/371472 [9:09:58<19:03:39,  3.73it/s]
 31%|███       | 115285/371472 [9:09:59<20:03:46,  3.55it/s]
 31%|███       | 115286/371472 [9:09:59<20:53:43,  3.41it/s]
 31%|███       | 115287/371472 [9:09:59<20:37:24,  3.45it/s]
 31%|███       | 115288/371472 [9:10:00<19:54:07,  3.58it/s]
 31%|███       | 115289/371472 [9:10:00<19:57:59,  3.56it/s]
 31%|███       | 115290/371472 [9:10:00<19:32:24,  3.64it/s]
 31%|███       | 115291/371472 [9:10:00<19:22:49,  3.67it/s]
 31%|███       | 115292/371472 [9:10:01<20:45:47,  3.43it/s]
 31%|███       | 115293/371472 [9:10:01<20:28:13,  3.48it/s]
 31%|███       | 115294/371472 [9:10:01<20:12:19,  3.52it/s]
 31%|███       | 115295/371472 [9:10:02<21:17:56,  3.34it/s]
 31%|███       | 115296/371472 [9:10:02<21:44:55,  3.27it/s]
 31%|███       | 115297/371472 [9:10:02<21:09:57,  3.36it/s]
 31%|███       | 115298/371472 [9:10:02<21:12:06,  3.36it/s]
 31%|███       | 115299/371472 [9:10:03<21:26:57,  3.32it/s]
 31%|███       | 115300/371472 [9:10:03<22:16:28,  3.19it/s]
                                                            
{'loss': 3.5493, 'learning_rate': 7.20986231118964e-07, 'epoch': 4.97}

 31%|███       | 115300/371472 [9:10:03<22:16:28,  3.19it/s]
 31%|███       | 115301/371472 [9:10:03<22:46:26,  3.12it/s]
 31%|███       | 115302/371472 [9:10:04<21:36:53,  3.29it/s]
 31%|███       | 115303/371472 [9:10:04<22:52:53,  3.11it/s]
 31%|███       | 115304/371472 [9:10:04<24:11:49,  2.94it/s]
 31%|███       | 115305/371472 [9:10:05<22:28:15,  3.17it/s]
 31%|███       | 115306/371472 [9:10:05<21:25:02,  3.32it/s]
 31%|███       | 115307/371472 [9:10:05<21:54:08,  3.25it/s]
 31%|███       | 115308/371472 [9:10:06<20:16:17,  3.51it/s]
 31%|███       | 115309/371472 [9:10:06<19:59:55,  3.56it/s]
 31%|███       | 115310/371472 [9:10:06<19:26:37,  3.66it/s]
 31%|███       | 115311/371472 [9:10:06<20:23:38,  3.49it/s]
 31%|███       | 115312/371472 [9:10:07<20:08:42,  3.53it/s]
 31%|███       | 115313/371472 [9:10:07<21:59:01,  3.24it/s]
 31%|███       | 115314/371472 [9:10:07<20:53:24,  3.41it/s]
 31%|███       | 115315/371472 [9:10:08<20:50:22,  3.41it/s]
 31%|███       | 115316/371472 [9:10:08<22:46:37,  3.12it/s]
 31%|███       | 115317/371472 [9:10:08<22:25:16,  3.17it/s]
 31%|███       | 115318/371472 [9:10:09<21:36:02,  3.29it/s]
 31%|███       | 115319/371472 [9:10:09<20:07:58,  3.53it/s]
 31%|███       | 115320/371472 [9:10:09<19:25:38,  3.66it/s]
                                                            
{'loss': 3.2338, 'learning_rate': 7.20937749143485e-07, 'epoch': 4.97}

 31%|███       | 115320/371472 [9:10:09<19:25:38,  3.66it/s]
 31%|███       | 115321/371472 [9:10:09<19:03:17,  3.73it/s]
 31%|███       | 115322/371472 [9:10:10<18:42:58,  3.80it/s]
 31%|███       | 115323/371472 [9:10:10<19:34:27,  3.63it/s]
 31%|███       | 115324/371472 [9:10:10<20:10:40,  3.53it/s]
 31%|███       | 115325/371472 [9:10:10<19:12:47,  3.70it/s]
 31%|███       | 115326/371472 [9:10:11<18:50:40,  3.78it/s]
 31%|███       | 115327/371472 [9:10:11<19:21:00,  3.68it/s]
 31%|███       | 115328/371472 [9:10:11<19:20:51,  3.68it/s]
 31%|███       | 115329/371472 [9:10:11<20:21:29,  3.49it/s]
 31%|███       | 115330/371472 [9:10:12<20:24:25,  3.49it/s]
 31%|███       | 115331/371472 [9:10:12<21:22:46,  3.33it/s]
 31%|███       | 115332/371472 [9:10:12<20:19:24,  3.50it/s]
 31%|███       | 115333/371472 [9:10:13<19:09:21,  3.71it/s]
 31%|███       | 115334/371472 [9:10:13<19:43:56,  3.61it/s]
 31%|███       | 115335/371472 [9:10:13<19:55:06,  3.57it/s]
 31%|███       | 115336/371472 [9:10:14<23:52:28,  2.98it/s]
 31%|███       | 115337/371472 [9:10:14<22:09:49,  3.21it/s]
 31%|███       | 115338/371472 [9:10:14<22:31:17,  3.16it/s]
 31%|███       | 115339/371472 [9:10:15<22:29:40,  3.16it/s]
 31%|███       | 115340/371472 [9:10:15<21:48:48,  3.26it/s]
                                                            
{'loss': 3.4842, 'learning_rate': 7.208892671680061e-07, 'epoch': 4.97}

 31%|███       | 115340/371472 [9:10:15<21:48:48,  3.26it/s]
 31%|███       | 115341/371472 [9:10:15<21:39:44,  3.28it/s]
 31%|███       | 115342/371472 [9:10:15<21:06:15,  3.37it/s]
 31%|███       | 115343/371472 [9:10:16<22:26:12,  3.17it/s]
 31%|███       | 115344/371472 [9:10:16<20:57:26,  3.39it/s]
 31%|███       | 115345/371472 [9:10:16<19:57:20,  3.57it/s]
 31%|███       | 115346/371472 [9:10:16<18:56:12,  3.76it/s]
 31%|███       | 115347/371472 [9:10:17<20:08:07,  3.53it/s]
 31%|███       | 115348/371472 [9:10:17<19:56:39,  3.57it/s]
 31%|███       | 115349/371472 [9:10:17<20:04:59,  3.54it/s]
 31%|███       | 115350/371472 [9:10:18<20:05:24,  3.54it/s]
 31%|███       | 115351/371472 [9:10:18<19:16:28,  3.69it/s]
 31%|███       | 115352/371472 [9:10:18<19:31:40,  3.64it/s]
 31%|███       | 115353/371472 [9:10:18<19:36:54,  3.63it/s]
 31%|███       | 115354/371472 [9:10:19<21:24:41,  3.32it/s]
 31%|███       | 115355/371472 [9:10:19<20:27:35,  3.48it/s]
 31%|███       | 115356/371472 [9:10:19<19:57:26,  3.56it/s]
 31%|███       | 115357/371472 [9:10:20<19:46:24,  3.60it/s]
 31%|███       | 115358/371472 [9:10:20<19:40:32,  3.62it/s]
 31%|███       | 115359/371472 [9:10:20<18:58:18,  3.75it/s]
 31%|███       | 115360/371472 [9:10:20<18:52:05,  3.77it/s]
                                                            
{'loss': 3.2719, 'learning_rate': 7.208407851925273e-07, 'epoch': 4.97}

 31%|███       | 115360/371472 [9:10:20<18:52:05,  3.77it/s]
 31%|███       | 115361/371472 [9:10:21<20:04:48,  3.54it/s]
 31%|███       | 115362/371472 [9:10:21<19:26:10,  3.66it/s]
 31%|███       | 115363/371472 [9:10:21<19:26:17,  3.66it/s]
 31%|███       | 115364/371472 [9:10:22<20:41:02,  3.44it/s]
 31%|███       | 115365/371472 [9:10:22<19:34:21,  3.63it/s]
 31%|███       | 115366/371472 [9:10:22<19:36:53,  3.63it/s]
 31%|███       | 115367/371472 [9:10:22<20:20:31,  3.50it/s]
 31%|███       | 115368/371472 [9:10:23<21:41:05,  3.28it/s]
 31%|███       | 115369/371472 [9:10:23<20:55:36,  3.40it/s]
 31%|███       | 115370/371472 [9:10:23<20:08:28,  3.53it/s]
 31%|███       | 115371/371472 [9:10:24<20:39:08,  3.44it/s]
 31%|███       | 115372/371472 [9:10:24<19:33:53,  3.64it/s]
 31%|███       | 115373/371472 [9:10:24<19:03:43,  3.73it/s]
 31%|███       | 115374/371472 [9:10:24<19:27:43,  3.66it/s]
 31%|███       | 115375/371472 [9:10:25<19:18:39,  3.68it/s]
 31%|███       | 115376/371472 [9:10:25<19:32:13,  3.64it/s]
 31%|███       | 115377/371472 [9:10:25<19:05:52,  3.72it/s]
 31%|███       | 115378/371472 [9:10:26<20:48:38,  3.42it/s]
 31%|███       | 115379/371472 [9:10:26<20:54:57,  3.40it/s]
 31%|███       | 115380/371472 [9:10:26<22:36:59,  3.15it/s]
                                                            
{'loss': 3.3858, 'learning_rate': 7.207923032170485e-07, 'epoch': 4.97}

 31%|███       | 115380/371472 [9:10:26<22:36:59,  3.15it/s]
 31%|███       | 115381/371472 [9:10:26<22:07:54,  3.21it/s]
 31%|███       | 115382/371472 [9:10:27<21:48:27,  3.26it/s]
 31%|███       | 115383/371472 [9:10:27<21:10:41,  3.36it/s]
 31%|███       | 115384/371472 [9:10:27<20:22:03,  3.49it/s]
 31%|███       | 115385/371472 [9:10:28<20:10:38,  3.53it/s]
 31%|███       | 115386/371472 [9:10:28<20:12:27,  3.52it/s]
 31%|███       | 115387/371472 [9:10:28<20:10:21,  3.53it/s]
 31%|███       | 115388/371472 [9:10:29<21:29:10,  3.31it/s]
 31%|███       | 115389/371472 [9:10:29<22:18:07,  3.19it/s]
 31%|███       | 115390/371472 [9:10:29<21:15:11,  3.35it/s]
 31%|███       | 115391/371472 [9:10:29<21:33:55,  3.30it/s]
 31%|███       | 115392/371472 [9:10:30<24:02:31,  2.96it/s]
 31%|███       | 115393/371472 [9:10:30<22:41:46,  3.13it/s]
 31%|███       | 115394/371472 [9:10:30<21:07:48,  3.37it/s]
 31%|███       | 115395/371472 [9:10:31<21:53:03,  3.25it/s]
 31%|███       | 115396/371472 [9:10:31<21:10:43,  3.36it/s]
 31%|███       | 115397/371472 [9:10:31<20:13:54,  3.52it/s]
 31%|███       | 115398/371472 [9:10:31<19:16:22,  3.69it/s]
 31%|███       | 115399/371472 [9:10:32<19:42:58,  3.61it/s]
 31%|███       | 115400/371472 [9:10:32<19:46:56,  3.60it/s]
                                                            
{'loss': 3.2511, 'learning_rate': 7.207438212415695e-07, 'epoch': 4.97}

 31%|███       | 115400/371472 [9:10:32<19:46:56,  3.60it/s]
 31%|███       | 115401/371472 [9:10:32<19:53:09,  3.58it/s]
 31%|███       | 115402/371472 [9:10:33<19:16:27,  3.69it/s]
 31%|███       | 115403/371472 [9:10:33<19:04:13,  3.73it/s]
 31%|███       | 115404/371472 [9:10:33<19:08:55,  3.71it/s]
 31%|███       | 115405/371472 [9:10:33<18:49:11,  3.78it/s]
 31%|███       | 115406/371472 [9:10:34<18:22:31,  3.87it/s]
 31%|███       | 115407/371472 [9:10:34<18:28:08,  3.85it/s]
 31%|███       | 115408/371472 [9:10:34<19:39:20,  3.62it/s]
 31%|███       | 115409/371472 [9:10:34<20:05:00,  3.54it/s]
 31%|███       | 115410/371472 [9:10:35<21:51:21,  3.25it/s]
 31%|███       | 115411/371472 [9:10:35<22:19:48,  3.19it/s]
 31%|███       | 115412/371472 [9:10:35<20:57:57,  3.39it/s]
 31%|███       | 115413/371472 [9:10:36<20:26:19,  3.48it/s]
 31%|███       | 115414/371472 [9:10:36<21:18:56,  3.34it/s]
 31%|███       | 115415/371472 [9:10:36<20:24:53,  3.48it/s]
 31%|███       | 115416/371472 [9:10:37<19:24:27,  3.66it/s]
 31%|███       | 115417/371472 [9:10:37<18:51:25,  3.77it/s]
 31%|███       | 115418/371472 [9:10:37<20:47:51,  3.42it/s]
 31%|███       | 115419/371472 [9:10:37<19:46:07,  3.60it/s]
 31%|███       | 115420/371472 [9:10:38<20:43:43,  3.43it/s]
                                                            
{'loss': 3.2809, 'learning_rate': 7.206953392660905e-07, 'epoch': 4.97}

 31%|███       | 115420/371472 [9:10:38<20:43:43,  3.43it/s]
 31%|███       | 115421/371472 [9:10:38<19:45:59,  3.60it/s]
 31%|███       | 115422/371472 [9:10:38<19:27:14,  3.66it/s]
 31%|███       | 115423/371472 [9:10:38<19:57:03,  3.56it/s]
 31%|███       | 115424/371472 [9:10:39<20:29:00,  3.47it/s]
 31%|███       | 115425/371472 [9:10:39<19:38:56,  3.62it/s]
 31%|███       | 115426/371472 [9:10:39<19:30:48,  3.64it/s]
 31%|███       | 115427/371472 [9:10:40<19:38:53,  3.62it/s]
 31%|███       | 115428/371472 [9:10:40<19:08:27,  3.72it/s]
 31%|███       | 115429/371472 [9:10:40<18:36:11,  3.82it/s]
 31%|███       | 115430/371472 [9:10:40<19:16:19,  3.69it/s]
 31%|███       | 115431/371472 [9:10:41<19:30:21,  3.65it/s]
 31%|███       | 115432/371472 [9:10:41<20:18:28,  3.50it/s]
 31%|███       | 115433/371472 [9:10:41<20:33:56,  3.46it/s]
 31%|███       | 115434/371472 [9:10:42<19:55:19,  3.57it/s]
 31%|███       | 115435/371472 [9:10:42<19:43:48,  3.60it/s]
 31%|███       | 115436/371472 [9:10:42<21:13:32,  3.35it/s]
 31%|███       | 115437/371472 [9:10:42<20:15:35,  3.51it/s]
 31%|███       | 115438/371472 [9:10:43<19:55:18,  3.57it/s]
 31%|███       | 115439/371472 [9:10:43<20:39:30,  3.44it/s]
 31%|███       | 115440/371472 [9:10:43<19:36:43,  3.63it/s]
                                                            
{'loss': 3.453, 'learning_rate': 7.206468572906117e-07, 'epoch': 4.97}

 31%|███       | 115440/371472 [9:10:43<19:36:43,  3.63it/s]
 31%|███       | 115441/371472 [9:10:43<18:42:49,  3.80it/s]
 31%|███       | 115442/371472 [9:10:44<18:29:58,  3.84it/s]
 31%|███       | 115443/371472 [9:10:44<18:38:09,  3.82it/s]
 31%|███       | 115444/371472 [9:10:44<18:16:40,  3.89it/s]
 31%|███       | 115445/371472 [9:10:44<18:21:56,  3.87it/s]
 31%|███       | 115446/371472 [9:10:45<19:13:29,  3.70it/s]
 31%|███       | 115447/371472 [9:10:45<19:06:08,  3.72it/s]
 31%|███       | 115448/371472 [9:10:45<19:26:00,  3.66it/s]
 31%|███       | 115449/371472 [9:10:46<19:08:32,  3.72it/s]
 31%|███       | 115450/371472 [9:10:46<19:26:27,  3.66it/s]
 31%|███       | 115451/371472 [9:10:46<18:51:31,  3.77it/s]
 31%|███       | 115452/371472 [9:10:46<19:59:54,  3.56it/s]
 31%|███       | 115453/371472 [9:10:47<19:53:01,  3.58it/s]
 31%|███       | 115454/371472 [9:10:47<19:54:18,  3.57it/s]
 31%|███       | 115455/371472 [9:10:47<19:48:49,  3.59it/s]
 31%|███       | 115456/371472 [9:10:48<19:26:59,  3.66it/s]
 31%|███       | 115457/371472 [9:10:48<19:46:25,  3.60it/s]
 31%|███       | 115458/371472 [9:10:48<19:48:45,  3.59it/s]
 31%|███       | 115459/371472 [9:10:48<20:17:03,  3.51it/s]
 31%|███       | 115460/371472 [9:10:49<19:48:58,  3.59it/s]
                                                            
{'loss': 3.3949, 'learning_rate': 7.205983753151329e-07, 'epoch': 4.97}

 31%|███       | 115460/371472 [9:10:49<19:48:58,  3.59it/s]
 31%|███       | 115461/371472 [9:10:49<19:23:17,  3.67it/s]
 31%|███       | 115462/371472 [9:10:49<20:35:13,  3.45it/s]
 31%|███       | 115463/371472 [9:10:50<20:27:12,  3.48it/s]
 31%|███       | 115464/371472 [9:10:50<19:49:27,  3.59it/s]
 31%|███       | 115465/371472 [9:10:50<21:29:38,  3.31it/s]
 31%|███       | 115466/371472 [9:10:50<21:06:12,  3.37it/s]
 31%|███       | 115467/371472 [9:10:51<21:13:11,  3.35it/s]
 31%|███       | 115468/371472 [9:10:51<22:12:25,  3.20it/s]
 31%|███       | 115469/371472 [9:10:51<21:23:49,  3.32it/s]
 31%|███       | 115470/371472 [9:10:52<20:43:39,  3.43it/s]
 31%|███       | 115471/371472 [9:10:52<19:50:29,  3.58it/s]
 31%|███       | 115472/371472 [9:10:52<19:11:16,  3.71it/s]
 31%|███       | 115473/371472 [9:10:52<18:58:12,  3.75it/s]
 31%|███       | 115474/371472 [9:10:53<19:01:46,  3.74it/s]
 31%|███       | 115475/371472 [9:10:53<19:36:26,  3.63it/s]
 31%|███       | 115476/371472 [9:10:53<19:01:17,  3.74it/s]
 31%|███       | 115477/371472 [9:10:53<18:51:48,  3.77it/s]
 31%|███       | 115478/371472 [9:10:54<20:36:20,  3.45it/s]
 31%|███       | 115479/371472 [9:10:54<19:59:10,  3.56it/s]
 31%|███       | 115480/371472 [9:10:54<20:44:52,  3.43it/s]
                                                            
{'loss': 3.473, 'learning_rate': 7.205498933396539e-07, 'epoch': 4.97}

 31%|███       | 115480/371472 [9:10:54<20:44:52,  3.43it/s]
 31%|███       | 115481/371472 [9:10:55<19:55:06,  3.57it/s]
 31%|███       | 115482/371472 [9:10:55<19:24:17,  3.66it/s]
 31%|███       | 115483/371472 [9:10:55<19:30:35,  3.64it/s]
 31%|███       | 115484/371472 [9:10:56<22:11:35,  3.20it/s]
 31%|███       | 115485/371472 [9:10:56<21:16:40,  3.34it/s]
 31%|███       | 115486/371472 [9:10:56<20:34:34,  3.46it/s]
 31%|███       | 115487/371472 [9:10:56<20:08:32,  3.53it/s]
 31%|███       | 115488/371472 [9:10:57<19:30:49,  3.64it/s]
 31%|███       | 115489/371472 [9:10:57<19:01:43,  3.74it/s]
 31%|███       | 115490/371472 [9:10:57<19:05:02,  3.73it/s]
 31%|███       | 115491/371472 [9:10:57<19:15:11,  3.69it/s]
 31%|███       | 115492/371472 [9:10:58<19:11:11,  3.71it/s]
 31%|███       | 115493/371472 [9:10:58<18:39:01,  3.81it/s]
 31%|███       | 115494/371472 [9:10:58<19:07:06,  3.72it/s]
 31%|███       | 115495/371472 [9:10:59<21:07:33,  3.37it/s]
 31%|███       | 115496/371472 [9:10:59<20:13:05,  3.52it/s]
 31%|███       | 115497/371472 [9:10:59<20:24:01,  3.49it/s]
 31%|███       | 115498/371472 [9:11:00<25:35:37,  2.78it/s]
 31%|███       | 115499/371472 [9:11:00<24:20:17,  2.92it/s]
 31%|███       | 115500/371472 [9:11:00<26:25:23,  2.69it/s]
                                                            
{'loss': 3.3837, 'learning_rate': 7.20501411364175e-07, 'epoch': 4.97}

 31%|███       | 115500/371472 [9:11:00<26:25:23,  2.69it/s]
 31%|███       | 115501/371472 [9:11:01<23:43:26,  3.00it/s]
 31%|███       | 115502/371472 [9:11:01<22:15:00,  3.20it/s]
 31%|███       | 115503/371472 [9:11:01<24:34:19,  2.89it/s]
 31%|███       | 115504/371472 [9:11:02<23:21:09,  3.04it/s]
 31%|███       | 115505/371472 [9:11:02<23:58:12,  2.97it/s]
 31%|███       | 115506/371472 [9:11:02<23:23:08,  3.04it/s]
 31%|███       | 115507/371472 [9:11:03<21:23:15,  3.32it/s]
 31%|███       | 115508/371472 [9:11:03<20:19:34,  3.50it/s]
 31%|███       | 115509/371472 [9:11:03<20:12:20,  3.52it/s]
 31%|███       | 115510/371472 [9:11:03<19:51:51,  3.58it/s]
 31%|███       | 115511/371472 [9:11:04<19:48:08,  3.59it/s]
 31%|███       | 115512/371472 [9:11:04<19:20:05,  3.68it/s]
 31%|███       | 115513/371472 [9:11:04<18:49:57,  3.78it/s]
 31%|███       | 115514/371472 [9:11:04<19:04:44,  3.73it/s]
 31%|███       | 115515/371472 [9:11:05<18:52:11,  3.77it/s]
 31%|███       | 115516/371472 [9:11:05<18:23:39,  3.87it/s]
 31%|███       | 115517/371472 [9:11:05<18:44:17,  3.79it/s]
 31%|███       | 115518/371472 [9:11:05<18:52:42,  3.77it/s]
 31%|███       | 115519/371472 [9:11:06<19:04:49,  3.73it/s]
 31%|███       | 115520/371472 [9:11:06<20:42:56,  3.43it/s]
                                                            
{'loss': 3.153, 'learning_rate': 7.204529293886962e-07, 'epoch': 4.98}

 31%|███       | 115520/371472 [9:11:06<20:42:56,  3.43it/s]
 31%|███       | 115521/371472 [9:11:06<20:51:20,  3.41it/s]
 31%|███       | 115522/371472 [9:11:07<19:41:15,  3.61it/s]
 31%|███       | 115523/371472 [9:11:07<19:40:10,  3.61it/s]
 31%|███       | 115524/371472 [9:11:07<22:45:13,  3.12it/s]
 31%|███       | 115525/371472 [9:11:08<21:48:44,  3.26it/s]
 31%|███       | 115526/371472 [9:11:08<21:28:49,  3.31it/s]
 31%|███       | 115527/371472 [9:11:08<20:44:06,  3.43it/s]
 31%|███       | 115528/371472 [9:11:08<20:09:03,  3.53it/s]
 31%|███       | 115529/371472 [9:11:09<21:22:36,  3.33it/s]
 31%|███       | 115530/371472 [9:11:09<20:54:16,  3.40it/s]
 31%|███       | 115531/371472 [9:11:09<22:23:55,  3.17it/s]
 31%|███       | 115532/371472 [9:11:10<23:27:22,  3.03it/s]
 31%|███       | 115533/371472 [9:11:10<21:50:39,  3.25it/s]
 31%|███       | 115534/371472 [9:11:10<22:01:51,  3.23it/s]
 31%|███       | 115535/371472 [9:11:11<23:17:45,  3.05it/s]
 31%|███       | 115536/371472 [9:11:11<21:39:24,  3.28it/s]
 31%|███       | 115537/371472 [9:11:11<22:04:40,  3.22it/s]
 31%|███       | 115538/371472 [9:11:12<21:32:50,  3.30it/s]
 31%|███       | 115539/371472 [9:11:12<20:44:19,  3.43it/s]
 31%|███       | 115540/371472 [9:11:12<20:53:06,  3.40it/s]
                                                            
{'loss': 3.3058, 'learning_rate': 7.204044474132172e-07, 'epoch': 4.98}

 31%|███       | 115540/371472 [9:11:12<20:53:06,  3.40it/s]
 31%|███       | 115541/371472 [9:11:12<21:11:14,  3.36it/s]
 31%|███       | 115542/371472 [9:11:13<20:37:35,  3.45it/s]
 31%|███       | 115543/371472 [9:11:13<19:34:02,  3.63it/s]
 31%|███       | 115544/371472 [9:11:13<18:41:24,  3.80it/s]
 31%|███       | 115545/371472 [9:11:13<19:07:22,  3.72it/s]
 31%|███       | 115546/371472 [9:11:14<19:07:37,  3.72it/s]
 31%|███       | 115547/371472 [9:11:14<20:26:22,  3.48it/s]
 31%|███       | 115548/371472 [9:11:14<20:20:05,  3.50it/s]
 31%|███       | 115549/371472 [9:11:15<19:33:49,  3.63it/s]
 31%|███       | 115550/371472 [9:11:15<19:41:50,  3.61it/s]
 31%|███       | 115551/371472 [9:11:15<21:52:01,  3.25it/s]
 31%|███       | 115552/371472 [9:11:16<21:29:16,  3.31it/s]
 31%|███       | 115553/371472 [9:11:16<20:12:42,  3.52it/s]
 31%|███       | 115554/371472 [9:11:16<19:06:40,  3.72it/s]
 31%|███       | 115555/371472 [9:11:16<18:23:13,  3.87it/s]
 31%|███       | 115556/371472 [9:11:17<19:10:36,  3.71it/s]
 31%|███       | 115557/371472 [9:11:17<18:37:50,  3.82it/s]
 31%|███       | 115558/371472 [9:11:17<19:12:47,  3.70it/s]
 31%|███       | 115559/371472 [9:11:17<19:22:20,  3.67it/s]
 31%|███       | 115560/371472 [9:11:18<19:17:05,  3.69it/s]
                                                            
{'loss': 3.1242, 'learning_rate': 7.203559654377383e-07, 'epoch': 4.98}

 31%|███       | 115560/371472 [9:11:18<19:17:05,  3.69it/s]
 31%|███       | 115561/371472 [9:11:18<19:07:22,  3.72it/s]
 31%|███       | 115562/371472 [9:11:18<19:29:58,  3.65it/s]
 31%|███       | 115563/371472 [9:11:18<19:25:51,  3.66it/s]
 31%|███       | 115564/371472 [9:11:19<19:33:29,  3.63it/s]
 31%|███       | 115565/371472 [9:11:19<19:13:18,  3.70it/s]
 31%|███       | 115566/371472 [9:11:19<20:27:58,  3.47it/s]
 31%|███       | 115567/371472 [9:11:20<20:59:31,  3.39it/s]
 31%|███       | 115568/371472 [9:11:20<20:02:58,  3.55it/s]
 31%|███       | 115569/371472 [9:11:20<19:48:44,  3.59it/s]
 31%|███       | 115570/371472 [9:11:20<20:25:26,  3.48it/s]
 31%|███       | 115571/371472 [9:11:21<20:22:12,  3.49it/s]
 31%|███       | 115572/371472 [9:11:21<21:46:53,  3.26it/s]
 31%|███       | 115573/371472 [9:11:21<21:59:12,  3.23it/s]
 31%|███       | 115574/371472 [9:11:22<21:39:18,  3.28it/s]
 31%|███       | 115575/371472 [9:11:22<20:28:28,  3.47it/s]
 31%|███       | 115576/371472 [9:11:22<19:49:39,  3.58it/s]
 31%|███       | 115577/371472 [9:11:22<19:51:48,  3.58it/s]
 31%|███       | 115578/371472 [9:11:23<20:15:11,  3.51it/s]
 31%|███       | 115579/371472 [9:11:23<21:30:15,  3.31it/s]
 31%|███       | 115580/371472 [9:11:23<20:34:46,  3.45it/s]
                                                            
{'loss': 3.2933, 'learning_rate': 7.203074834622594e-07, 'epoch': 4.98}

 31%|███       | 115580/371472 [9:11:23<20:34:46,  3.45it/s]
 31%|███       | 115581/371472 [9:11:24<20:02:56,  3.55it/s]
 31%|███       | 115582/371472 [9:11:24<21:03:13,  3.38it/s]
 31%|███       | 115583/371472 [9:11:24<20:51:23,  3.41it/s]
 31%|███       | 115584/371472 [9:11:25<20:07:51,  3.53it/s]
 31%|███       | 115585/371472 [9:11:25<20:09:23,  3.53it/s]
 31%|███       | 115586/371472 [9:11:25<20:02:16,  3.55it/s]
 31%|███       | 115587/371472 [9:11:25<19:46:49,  3.59it/s]
 31%|███       | 115588/371472 [9:11:26<20:58:54,  3.39it/s]
 31%|███       | 115589/371472 [9:11:26<21:10:43,  3.36it/s]
 31%|███       | 115590/371472 [9:11:26<21:46:11,  3.27it/s]
 31%|███       | 115591/371472 [9:11:27<20:45:46,  3.42it/s]
 31%|███       | 115592/371472 [9:11:27<22:47:09,  3.12it/s]
 31%|███       | 115593/371472 [9:11:27<21:33:45,  3.30it/s]
 31%|███       | 115594/371472 [9:11:27<20:50:47,  3.41it/s]
 31%|███       | 115595/371472 [9:11:28<20:41:21,  3.44it/s]
 31%|███       | 115596/371472 [9:11:28<20:25:15,  3.48it/s]
 31%|███       | 115597/371472 [9:11:28<21:43:14,  3.27it/s]
 31%|███       | 115598/371472 [9:11:29<20:47:59,  3.42it/s]
 31%|███       | 115599/371472 [9:11:29<21:21:27,  3.33it/s]
 31%|███       | 115600/371472 [9:11:29<20:37:53,  3.44it/s]
                                                            
{'loss': 3.1943, 'learning_rate': 7.202590014867806e-07, 'epoch': 4.98}

 31%|███       | 115600/371472 [9:11:29<20:37:53,  3.44it/s]
 31%|███       | 115601/371472 [9:11:30<20:09:06,  3.53it/s]
 31%|███       | 115602/371472 [9:11:30<19:48:14,  3.59it/s]
 31%|███       | 115603/371472 [9:11:30<19:38:25,  3.62it/s]
 31%|███       | 115604/371472 [9:11:30<19:36:57,  3.62it/s]
 31%|███       | 115605/371472 [9:11:31<18:53:23,  3.76it/s]
 31%|███       | 115606/371472 [9:11:31<18:10:37,  3.91it/s]
 31%|███       | 115607/371472 [9:11:31<18:19:16,  3.88it/s]
 31%|███       | 115608/371472 [9:11:31<19:07:52,  3.72it/s]
 31%|███       | 115609/371472 [9:11:32<19:20:17,  3.68it/s]
 31%|███       | 115610/371472 [9:11:32<19:54:48,  3.57it/s]
 31%|███       | 115611/371472 [9:11:32<19:57:50,  3.56it/s]
 31%|███       | 115612/371472 [9:11:33<20:18:17,  3.50it/s]
 31%|███       | 115613/371472 [9:11:33<20:51:53,  3.41it/s]
 31%|███       | 115614/371472 [9:11:33<20:01:27,  3.55it/s]
 31%|███       | 115615/371472 [9:11:33<19:54:48,  3.57it/s]
 31%|███       | 115616/371472 [9:11:34<19:55:07,  3.57it/s]
 31%|███       | 115617/371472 [9:11:34<20:33:53,  3.46it/s]
 31%|███       | 115618/371472 [9:11:34<20:17:58,  3.50it/s]
 31%|███       | 115619/371472 [9:11:35<19:58:18,  3.56it/s]
 31%|███       | 115620/371472 [9:11:35<20:53:59,  3.40it/s]
                                                            
{'loss': 3.2513, 'learning_rate': 7.202105195113017e-07, 'epoch': 4.98}

 31%|███       | 115620/371472 [9:11:35<20:53:59,  3.40it/s]
 31%|███       | 115621/371472 [9:11:35<19:55:38,  3.57it/s]
 31%|███       | 115622/371472 [9:11:35<23:01:21,  3.09it/s]
 31%|███       | 115623/371472 [9:11:36<21:37:32,  3.29it/s]
 31%|███       | 115624/371472 [9:11:36<21:00:08,  3.38it/s]
 31%|███       | 115625/371472 [9:11:36<20:06:36,  3.53it/s]
 31%|███       | 115626/371472 [9:11:37<19:47:50,  3.59it/s]
 31%|███       | 115627/371472 [9:11:37<19:13:44,  3.70it/s]
 31%|███       | 115628/371472 [9:11:37<19:30:12,  3.64it/s]
 31%|███       | 115629/371472 [9:11:37<20:42:39,  3.43it/s]
 31%|███       | 115630/371472 [9:11:38<21:39:14,  3.28it/s]
 31%|███       | 115631/371472 [9:11:38<21:48:49,  3.26it/s]
 31%|███       | 115632/371472 [9:11:38<22:46:11,  3.12it/s]
 31%|███       | 115633/371472 [9:11:39<21:45:14,  3.27it/s]
 31%|███       | 115634/371472 [9:11:39<20:45:09,  3.42it/s]
 31%|███       | 115635/371472 [9:11:39<20:13:10,  3.51it/s]
 31%|███       | 115636/371472 [9:11:40<20:14:01,  3.51it/s]
 31%|███       | 115637/371472 [9:11:40<19:28:36,  3.65it/s]
 31%|███       | 115638/371472 [9:11:40<19:07:56,  3.71it/s]
 31%|███       | 115639/371472 [9:11:40<19:33:20,  3.63it/s]
 31%|███       | 115640/371472 [9:11:41<19:37:02,  3.62it/s]
                                                            
{'loss': 3.4284, 'learning_rate': 7.201620375358228e-07, 'epoch': 4.98}

 31%|███       | 115640/371472 [9:11:41<19:37:02,  3.62it/s]
 31%|███       | 115641/371472 [9:11:41<20:20:57,  3.49it/s]
 31%|███       | 115642/371472 [9:11:41<19:34:04,  3.63it/s]
 31%|███       | 115643/371472 [9:11:41<20:35:18,  3.45it/s]
 31%|███       | 115644/371472 [9:11:42<20:18:51,  3.50it/s]
 31%|███       | 115645/371472 [9:11:42<20:25:41,  3.48it/s]
 31%|███       | 115646/371472 [9:11:42<20:02:05,  3.55it/s]
 31%|███       | 115647/371472 [9:11:43<22:29:20,  3.16it/s]
 31%|███       | 115648/371472 [9:11:43<22:11:29,  3.20it/s]
 31%|███       | 115649/371472 [9:11:43<21:23:59,  3.32it/s]
 31%|███       | 115650/371472 [9:11:44<20:58:42,  3.39it/s]
 31%|███       | 115651/371472 [9:11:44<20:17:20,  3.50it/s]
 31%|███       | 115652/371472 [9:11:44<19:49:50,  3.58it/s]
 31%|███       | 115653/371472 [9:11:44<19:41:23,  3.61it/s]
 31%|███       | 115654/371472 [9:11:45<19:29:21,  3.65it/s]
 31%|███       | 115655/371472 [9:11:45<18:57:58,  3.75it/s]
 31%|███       | 115656/371472 [9:11:45<19:07:16,  3.72it/s]
 31%|███       | 115657/371472 [9:11:45<19:24:26,  3.66it/s]
 31%|███       | 115658/371472 [9:11:46<19:30:17,  3.64it/s]
 31%|███       | 115659/371472 [9:11:46<19:15:41,  3.69it/s]
 31%|███       | 115660/371472 [9:11:46<19:22:54,  3.67it/s]
                                                            
{'loss': 3.3555, 'learning_rate': 7.201135555603439e-07, 'epoch': 4.98}

 31%|███       | 115660/371472 [9:11:46<19:22:54,  3.67it/s]
 31%|███       | 115661/371472 [9:11:47<19:05:41,  3.72it/s]
 31%|███       | 115662/371472 [9:11:47<19:04:38,  3.72it/s]
 31%|███       | 115663/371472 [9:11:47<19:13:56,  3.69it/s]
 31%|███       | 115664/371472 [9:11:47<19:22:48,  3.67it/s]
 31%|███       | 115665/371472 [9:11:48<18:44:12,  3.79it/s]
 31%|███       | 115666/371472 [9:11:48<19:07:01,  3.72it/s]
 31%|███       | 115667/371472 [9:11:48<18:46:44,  3.78it/s]
 31%|███       | 115668/371472 [9:11:48<18:52:32,  3.76it/s]
 31%|███       | 115669/371472 [9:11:49<19:16:05,  3.69it/s]
 31%|███       | 115670/371472 [9:11:49<19:40:52,  3.61it/s]
 31%|███       | 115671/371472 [9:11:49<19:25:42,  3.66it/s]
 31%|███       | 115672/371472 [9:11:49<19:09:01,  3.71it/s]
 31%|███       | 115673/371472 [9:11:50<19:17:17,  3.68it/s]
 31%|███       | 115674/371472 [9:11:50<19:47:05,  3.59it/s]
 31%|███       | 115675/371472 [9:11:50<20:17:01,  3.50it/s]
 31%|███       | 115676/371472 [9:11:51<20:22:26,  3.49it/s]
 31%|███       | 115677/371472 [9:11:51<19:27:36,  3.65it/s]
 31%|███       | 115678/371472 [9:11:51<19:39:02,  3.62it/s]
 31%|███       | 115679/371472 [9:11:51<18:40:47,  3.80it/s]
 31%|███       | 115680/371472 [9:11:52<19:57:37,  3.56it/s]
                                                            
{'loss': 3.4221, 'learning_rate': 7.200650735848649e-07, 'epoch': 4.98}

 31%|███       | 115680/371472 [9:11:52<19:57:37,  3.56it/s]
 31%|███       | 115681/371472 [9:11:52<19:32:24,  3.64it/s]
 31%|███       | 115682/371472 [9:11:52<18:59:50,  3.74it/s]
 31%|███       | 115683/371472 [9:11:52<18:22:49,  3.87it/s]
 31%|███       | 115684/371472 [9:11:53<19:23:45,  3.66it/s]
 31%|███       | 115685/371472 [9:11:53<19:18:54,  3.68it/s]
 31%|███       | 115686/371472 [9:11:53<19:22:37,  3.67it/s]
 31%|███       | 115687/371472 [9:11:54<19:16:25,  3.69it/s]
 31%|███       | 115688/371472 [9:11:54<20:23:34,  3.48it/s]
 31%|███       | 115689/371472 [9:11:54<19:27:35,  3.65it/s]
 31%|███       | 115690/371472 [9:11:54<19:52:08,  3.58it/s]
 31%|███       | 115691/371472 [9:11:55<19:38:20,  3.62it/s]
 31%|███       | 115692/371472 [9:11:55<19:33:30,  3.63it/s]
 31%|███       | 115693/371472 [9:11:55<19:52:07,  3.58it/s]
 31%|███       | 115694/371472 [9:11:56<19:50:31,  3.58it/s]
 31%|███       | 115695/371472 [9:11:56<19:26:29,  3.65it/s]
 31%|███       | 115696/371472 [9:11:56<19:48:00,  3.59it/s]
 31%|███       | 115697/371472 [9:11:56<19:08:56,  3.71it/s]
 31%|███       | 115698/371472 [9:11:57<18:57:39,  3.75it/s]
 31%|███       | 115699/371472 [9:11:57<18:51:58,  3.77it/s]
 31%|███       | 115700/371472 [9:11:57<19:00:41,  3.74it/s]
                                                            
{'loss': 3.3952, 'learning_rate': 7.200165916093861e-07, 'epoch': 4.98}

 31%|███       | 115700/371472 [9:11:57<19:00:41,  3.74it/s]
 31%|███       | 115701/371472 [9:11:57<18:34:40,  3.82it/s]
 31%|███       | 115702/371472 [9:11:58<19:21:58,  3.67it/s]
 31%|███       | 115703/371472 [9:11:58<21:15:26,  3.34it/s]
 31%|███       | 115704/371472 [9:11:58<20:45:04,  3.42it/s]
 31%|███       | 115705/371472 [9:11:59<19:43:11,  3.60it/s]
 31%|███       | 115706/371472 [9:11:59<19:15:04,  3.69it/s]
 31%|███       | 115707/371472 [9:11:59<18:45:30,  3.79it/s]
 31%|███       | 115708/371472 [9:11:59<19:44:36,  3.60it/s]
 31%|███       | 115709/371472 [9:12:00<21:05:06,  3.37it/s]
 31%|███       | 115710/371472 [9:12:00<20:58:16,  3.39it/s]
 31%|███       | 115711/371472 [9:12:00<20:58:47,  3.39it/s]
 31%|███       | 115712/371472 [9:12:01<22:04:33,  3.22it/s]
 31%|███       | 115713/371472 [9:12:01<22:01:20,  3.23it/s]
 31%|███       | 115714/371472 [9:12:01<21:59:22,  3.23it/s]
 31%|███       | 115715/371472 [9:12:02<21:02:53,  3.38it/s]
 31%|███       | 115716/371472 [9:12:02<20:02:24,  3.55it/s]
 31%|███       | 115717/371472 [9:12:02<19:26:38,  3.65it/s]
 31%|███       | 115718/371472 [9:12:02<19:26:24,  3.65it/s]
 31%|███       | 115719/371472 [9:12:03<20:10:20,  3.52it/s]
 31%|███       | 115720/371472 [9:12:03<19:33:56,  3.63it/s]
                                                            
{'loss': 3.2709, 'learning_rate': 7.199681096339072e-07, 'epoch': 4.98}

 31%|███       | 115720/371472 [9:12:03<19:33:56,  3.63it/s]
 31%|███       | 115721/371472 [9:12:03<21:13:55,  3.35it/s]
 31%|███       | 115722/371472 [9:12:04<20:56:26,  3.39it/s]
 31%|███       | 115723/371472 [9:12:04<19:57:29,  3.56it/s]
 31%|███       | 115724/371472 [9:12:04<19:55:55,  3.56it/s]
 31%|███       | 115725/371472 [9:12:04<19:43:29,  3.60it/s]
 31%|███       | 115726/371472 [9:12:05<19:10:28,  3.70it/s]
 31%|███       | 115727/371472 [9:12:05<18:44:00,  3.79it/s]
 31%|███       | 115728/371472 [9:12:05<19:09:57,  3.71it/s]
 31%|███       | 115729/371472 [9:12:05<19:51:17,  3.58it/s]
 31%|███       | 115730/371472 [9:12:06<20:58:45,  3.39it/s]
 31%|███       | 115731/371472 [9:12:06<22:12:01,  3.20it/s]
 31%|███       | 115732/371472 [9:12:06<21:26:31,  3.31it/s]
 31%|███       | 115733/371472 [9:12:07<20:49:12,  3.41it/s]
 31%|███       | 115734/371472 [9:12:07<19:34:40,  3.63it/s]
 31%|███       | 115735/371472 [9:12:07<20:58:29,  3.39it/s]
 31%|███       | 115736/371472 [9:12:07<19:46:26,  3.59it/s]
 31%|███       | 115737/371472 [9:12:08<19:10:20,  3.71it/s]
 31%|███       | 115738/371472 [9:12:08<18:50:55,  3.77it/s]
 31%|███       | 115739/371472 [9:12:08<20:42:21,  3.43it/s]
 31%|███       | 115740/371472 [9:12:09<20:42:22,  3.43it/s]
                                                            
{'loss': 3.309, 'learning_rate': 7.199196276584283e-07, 'epoch': 4.99}

 31%|███       | 115740/371472 [9:12:09<20:42:22,  3.43it/s]
 31%|███       | 115741/371472 [9:12:09<21:53:44,  3.24it/s]
 31%|███       | 115742/371472 [9:12:09<21:58:42,  3.23it/s]
 31%|███       | 115743/371472 [9:12:10<22:16:51,  3.19it/s]
 31%|███       | 115744/371472 [9:12:10<22:21:37,  3.18it/s]
 31%|███       | 115745/371472 [9:12:10<22:48:45,  3.11it/s]
 31%|███       | 115746/371472 [9:12:11<22:02:36,  3.22it/s]
 31%|███       | 115747/371472 [9:12:11<22:04:55,  3.22it/s]
 31%|███       | 115748/371472 [9:12:11<20:58:57,  3.39it/s]
 31%|███       | 115749/371472 [9:12:11<19:47:05,  3.59it/s]
 31%|███       | 115750/371472 [9:12:12<20:10:09,  3.52it/s]
 31%|███       | 115751/371472 [9:12:12<19:41:49,  3.61it/s]
 31%|███       | 115752/371472 [9:12:12<19:16:59,  3.68it/s]
 31%|███       | 115753/371472 [9:12:12<18:57:20,  3.75it/s]
 31%|███       | 115754/371472 [9:12:13<20:03:23,  3.54it/s]
 31%|███       | 115755/371472 [9:12:13<19:42:02,  3.61it/s]
 31%|███       | 115756/371472 [9:12:13<19:29:50,  3.64it/s]
 31%|███       | 115757/371472 [9:12:14<18:40:26,  3.80it/s]
 31%|███       | 115758/371472 [9:12:14<19:53:03,  3.57it/s]
 31%|███       | 115759/371472 [9:12:14<19:17:33,  3.68it/s]
 31%|███       | 115760/371472 [9:12:14<19:04:22,  3.72it/s]
                                                            
{'loss': 3.2481, 'learning_rate': 7.198711456829495e-07, 'epoch': 4.99}

 31%|███       | 115760/371472 [9:12:14<19:04:22,  3.72it/s]
 31%|███       | 115761/371472 [9:12:15<19:10:39,  3.70it/s]
 31%|███       | 115762/371472 [9:12:15<18:55:25,  3.75it/s]
 31%|███       | 115763/371472 [9:12:15<19:05:36,  3.72it/s]
 31%|███       | 115764/371472 [9:12:15<18:42:49,  3.80it/s]
 31%|███       | 115765/371472 [9:12:16<18:32:11,  3.83it/s]
 31%|███       | 115766/371472 [9:12:16<18:30:38,  3.84it/s]
 31%|███       | 115767/371472 [9:12:16<19:30:07,  3.64it/s]
 31%|███       | 115768/371472 [9:12:17<21:29:11,  3.31it/s]
 31%|███       | 115769/371472 [9:12:17<20:34:00,  3.45it/s]
 31%|███       | 115770/371472 [9:12:17<20:10:59,  3.52it/s]
 31%|███       | 115771/371472 [9:12:17<19:34:05,  3.63it/s]
 31%|███       | 115772/371472 [9:12:18<19:16:12,  3.69it/s]
 31%|███       | 115773/371472 [9:12:18<18:43:59,  3.79it/s]
 31%|███       | 115774/371472 [9:12:18<19:10:58,  3.70it/s]
 31%|███       | 115775/371472 [9:12:18<18:53:52,  3.76it/s]
 31%|███       | 115776/371472 [9:12:19<19:10:59,  3.70it/s]
 31%|███       | 115777/371472 [9:12:19<19:15:10,  3.69it/s]
 31%|███       | 115778/371472 [9:12:19<18:55:51,  3.75it/s]
 31%|███       | 115779/371472 [9:12:20<20:49:45,  3.41it/s]
 31%|███       | 115780/371472 [9:12:20<20:10:20,  3.52it/s]
                                                            
{'loss': 3.462, 'learning_rate': 7.198226637074705e-07, 'epoch': 4.99}

 31%|███       | 115780/371472 [9:12:20<20:10:20,  3.52it/s]
 31%|███       | 115781/371472 [9:12:20<21:24:34,  3.32it/s]
 31%|███       | 115782/371472 [9:12:20<20:24:52,  3.48it/s]
 31%|███       | 115783/371472 [9:12:21<21:58:45,  3.23it/s]
 31%|███       | 115784/371472 [9:12:21<21:36:33,  3.29it/s]
 31%|███       | 115785/371472 [9:12:21<21:14:37,  3.34it/s]
 31%|███       | 115786/371472 [9:12:22<21:09:36,  3.36it/s]
 31%|███       | 115787/371472 [9:12:22<21:37:48,  3.28it/s]
 31%|███       | 115788/371472 [9:12:22<20:43:39,  3.43it/s]
 31%|███       | 115789/371472 [9:12:23<20:23:47,  3.48it/s]
 31%|███       | 115790/371472 [9:12:23<20:21:27,  3.49it/s]
 31%|███       | 115791/371472 [9:12:23<19:58:10,  3.56it/s]
 31%|███       | 115792/371472 [9:12:23<19:03:29,  3.73it/s]
 31%|███       | 115793/371472 [9:12:24<18:38:51,  3.81it/s]
 31%|███       | 115794/371472 [9:12:24<18:39:09,  3.81it/s]
 31%|███       | 115795/371472 [9:12:24<18:35:45,  3.82it/s]
 31%|███       | 115796/371472 [9:12:24<18:37:50,  3.81it/s]
 31%|███       | 115797/371472 [9:12:25<18:41:25,  3.80it/s]
 31%|███       | 115798/371472 [9:12:25<19:00:19,  3.74it/s]
 31%|███       | 115799/371472 [9:12:25<18:35:46,  3.82it/s]
 31%|███       | 115800/371472 [9:12:25<18:59:52,  3.74it/s]
                                                            
{'loss': 3.2731, 'learning_rate': 7.197741817319915e-07, 'epoch': 4.99}

 31%|███       | 115800/371472 [9:12:25<18:59:52,  3.74it/s]
 31%|███       | 115801/371472 [9:12:26<21:02:52,  3.37it/s]
 31%|███       | 115802/371472 [9:12:26<22:31:47,  3.15it/s]
 31%|███       | 115803/371472 [9:12:26<22:10:35,  3.20it/s]
 31%|███       | 115804/371472 [9:12:27<21:40:06,  3.28it/s]
 31%|███       | 115805/371472 [9:12:27<20:56:12,  3.39it/s]
 31%|███       | 115806/371472 [9:12:27<20:27:26,  3.47it/s]
 31%|███       | 115807/371472 [9:12:28<20:26:52,  3.47it/s]
 31%|███       | 115808/371472 [9:12:28<21:08:58,  3.36it/s]
 31%|███       | 115809/371472 [9:12:28<21:02:40,  3.37it/s]
 31%|███       | 115810/371472 [9:12:28<20:49:59,  3.41it/s]
 31%|███       | 115811/371472 [9:12:29<20:20:18,  3.49it/s]
 31%|███       | 115812/371472 [9:12:29<19:30:33,  3.64it/s]
 31%|███       | 115813/371472 [9:12:29<19:15:39,  3.69it/s]
 31%|███       | 115814/371472 [9:12:30<19:20:41,  3.67it/s]
 31%|███       | 115815/371472 [9:12:30<19:53:51,  3.57it/s]
 31%|███       | 115816/371472 [9:12:30<19:10:32,  3.70it/s]
 31%|███       | 115817/371472 [9:12:30<18:49:05,  3.77it/s]
 31%|███       | 115818/371472 [9:12:31<18:29:12,  3.84it/s]
 31%|███       | 115819/371472 [9:12:31<19:04:01,  3.72it/s]
 31%|███       | 115820/371472 [9:12:31<20:11:51,  3.52it/s]
                                                            
{'loss': 3.309, 'learning_rate': 7.197256997565127e-07, 'epoch': 4.99}

 31%|███       | 115820/371472 [9:12:31<20:11:51,  3.52it/s]
 31%|███       | 115821/371472 [9:12:31<19:26:37,  3.65it/s]
 31%|███       | 115822/371472 [9:12:32<19:27:12,  3.65it/s]
 31%|███       | 115823/371472 [9:12:32<19:07:41,  3.71it/s]
 31%|███       | 115824/371472 [9:12:32<19:04:01,  3.72it/s]
 31%|███       | 115825/371472 [9:12:33<19:23:46,  3.66it/s]
 31%|███       | 115826/371472 [9:12:33<19:55:40,  3.56it/s]
 31%|███       | 115827/371472 [9:12:33<19:39:20,  3.61it/s]
 31%|███       | 115828/371472 [9:12:33<18:59:25,  3.74it/s]
 31%|███       | 115829/371472 [9:12:34<19:05:44,  3.72it/s]
 31%|███       | 115830/371472 [9:12:34<19:03:06,  3.73it/s]
 31%|███       | 115831/371472 [9:12:34<18:45:03,  3.79it/s]
 31%|███       | 115832/371472 [9:12:34<19:20:13,  3.67it/s]
 31%|███       | 115833/371472 [9:12:35<19:40:45,  3.61it/s]
 31%|███       | 115834/371472 [9:12:35<20:37:14,  3.44it/s]
 31%|███       | 115835/371472 [9:12:35<20:45:19,  3.42it/s]
 31%|███       | 115836/371472 [9:12:36<20:04:04,  3.54it/s]
 31%|███       | 115837/371472 [9:12:36<20:02:51,  3.54it/s]
 31%|███       | 115838/371472 [9:12:36<20:11:51,  3.52it/s]
 31%|███       | 115839/371472 [9:12:36<20:08:41,  3.52it/s]
 31%|███       | 115840/371472 [9:12:37<19:48:28,  3.58it/s]
                                                            
{'loss': 3.2293, 'learning_rate': 7.196772177810338e-07, 'epoch': 4.99}

 31%|███       | 115840/371472 [9:12:37<19:48:28,  3.58it/s]
 31%|███       | 115841/371472 [9:12:37<19:53:59,  3.57it/s]
 31%|███       | 115842/371472 [9:12:37<20:14:06,  3.51it/s]
 31%|███       | 115843/371472 [9:12:38<22:20:46,  3.18it/s]
 31%|███       | 115844/371472 [9:12:38<21:15:39,  3.34it/s]
 31%|███       | 115845/371472 [9:12:38<21:07:06,  3.36it/s]
 31%|███       | 115846/371472 [9:12:38<19:47:03,  3.59it/s]
 31%|███       | 115847/371472 [9:12:39<20:38:42,  3.44it/s]
 31%|███       | 115848/371472 [9:12:39<20:31:02,  3.46it/s]
 31%|███       | 115849/371472 [9:12:39<19:48:35,  3.58it/s]
 31%|███       | 115850/371472 [9:12:40<19:15:23,  3.69it/s]
 31%|███       | 115851/371472 [9:12:40<18:34:43,  3.82it/s]
 31%|███       | 115852/371472 [9:12:40<18:49:35,  3.77it/s]
 31%|███       | 115853/371472 [9:12:40<19:38:45,  3.61it/s]
 31%|███       | 115854/371472 [9:12:41<19:30:37,  3.64it/s]
 31%|███       | 115855/371472 [9:12:41<19:10:56,  3.70it/s]
 31%|███       | 115856/371472 [9:12:41<19:24:56,  3.66it/s]
 31%|███       | 115857/371472 [9:12:41<19:43:54,  3.60it/s]
 31%|███       | 115858/371472 [9:12:42<19:32:21,  3.63it/s]
 31%|███       | 115859/371472 [9:12:42<19:14:53,  3.69it/s]
 31%|███       | 115860/371472 [9:12:42<18:30:14,  3.84it/s]
                                                            
{'loss': 3.5308, 'learning_rate': 7.196287358055549e-07, 'epoch': 4.99}

 31%|███       | 115860/371472 [9:12:42<18:30:14,  3.84it/s]
 31%|███       | 115861/371472 [9:12:43<20:38:00,  3.44it/s]
 31%|███       | 115862/371472 [9:12:43<22:19:17,  3.18it/s]
 31%|███       | 115863/371472 [9:12:43<21:05:06,  3.37it/s]
 31%|███       | 115864/371472 [9:12:44<20:42:23,  3.43it/s]
 31%|███       | 115865/371472 [9:12:44<20:50:51,  3.41it/s]
 31%|███       | 115866/371472 [9:12:44<20:42:50,  3.43it/s]
 31%|███       | 115867/371472 [9:12:44<20:18:47,  3.50it/s]
 31%|███       | 115868/371472 [9:12:45<20:24:29,  3.48it/s]
 31%|███       | 115869/371472 [9:12:45<20:25:33,  3.48it/s]
 31%|███       | 115870/371472 [9:12:45<19:49:18,  3.58it/s]
 31%|███       | 115871/371472 [9:12:45<18:56:37,  3.75it/s]
 31%|███       | 115872/371472 [9:12:46<19:33:20,  3.63it/s]
 31%|███       | 115873/371472 [9:12:46<19:16:09,  3.68it/s]
 31%|███       | 115874/371472 [9:12:46<21:39:15,  3.28it/s]
 31%|███       | 115875/371472 [9:12:47<20:34:43,  3.45it/s]
 31%|███       | 115876/371472 [9:12:47<19:58:37,  3.55it/s]
 31%|███       | 115877/371472 [9:12:47<19:24:30,  3.66it/s]
 31%|███       | 115878/371472 [9:12:47<19:42:56,  3.60it/s]
 31%|███       | 115879/371472 [9:12:48<20:09:39,  3.52it/s]
 31%|███       | 115880/371472 [9:12:48<21:27:58,  3.31it/s]
                                                            
{'loss': 3.4282, 'learning_rate': 7.19580253830076e-07, 'epoch': 4.99}

 31%|███       | 115880/371472 [9:12:48<21:27:58,  3.31it/s]
 31%|███       | 115881/371472 [9:12:48<21:40:09,  3.28it/s]
 31%|███       | 115882/371472 [9:12:49<20:11:25,  3.52it/s]
 31%|███       | 115883/371472 [9:12:49<20:33:00,  3.45it/s]
 31%|███       | 115884/371472 [9:12:49<20:11:38,  3.52it/s]
 31%|███       | 115885/371472 [9:12:50<20:19:01,  3.49it/s]
 31%|███       | 115886/371472 [9:12:50<19:42:25,  3.60it/s]
 31%|███       | 115887/371472 [9:12:50<19:24:03,  3.66it/s]
 31%|███       | 115888/371472 [9:12:50<20:27:31,  3.47it/s]
 31%|███       | 115889/371472 [9:12:51<20:58:37,  3.38it/s]
 31%|███       | 115890/371472 [9:12:51<21:46:14,  3.26it/s]
 31%|███       | 115891/371472 [9:12:51<20:58:55,  3.38it/s]
 31%|███       | 115892/371472 [9:12:52<21:43:59,  3.27it/s]
 31%|███       | 115893/371472 [9:12:52<20:43:21,  3.43it/s]
 31%|███       | 115894/371472 [9:12:52<21:41:25,  3.27it/s]
 31%|███       | 115895/371472 [9:12:52<21:22:07,  3.32it/s]
 31%|███       | 115896/371472 [9:12:53<21:29:12,  3.30it/s]
 31%|███       | 115897/371472 [9:12:53<23:20:07,  3.04it/s]
 31%|███       | 115898/371472 [9:12:53<22:35:23,  3.14it/s]
 31%|███       | 115899/371472 [9:12:54<21:53:14,  3.24it/s]
 31%|███       | 115900/371472 [9:12:54<21:17:51,  3.33it/s]
                                                            
{'loss': 3.2874, 'learning_rate': 7.195317718545972e-07, 'epoch': 4.99}

 31%|███       | 115900/371472 [9:12:54<21:17:51,  3.33it/s]
 31%|███       | 115901/371472 [9:12:54<20:43:03,  3.43it/s]
 31%|███       | 115902/371472 [9:12:55<20:38:06,  3.44it/s]
 31%|███       | 115903/371472 [9:12:55<20:26:17,  3.47it/s]
 31%|███       | 115904/371472 [9:12:55<21:09:01,  3.36it/s]
 31%|███       | 115905/371472 [9:12:56<21:58:32,  3.23it/s]
 31%|███       | 115906/371472 [9:12:56<21:28:26,  3.31it/s]
 31%|███       | 115907/371472 [9:12:56<21:09:29,  3.36it/s]
 31%|███       | 115908/371472 [9:12:56<20:29:08,  3.47it/s]
 31%|███       | 115909/371472 [9:12:57<20:20:11,  3.49it/s]
 31%|███       | 115910/371472 [9:12:57<21:37:56,  3.28it/s]
 31%|███       | 115911/371472 [9:12:57<23:30:24,  3.02it/s]
 31%|███       | 115912/371472 [9:12:58<22:18:17,  3.18it/s]
 31%|███       | 115913/371472 [9:12:58<21:01:33,  3.38it/s]
 31%|███       | 115914/371472 [9:12:58<21:21:43,  3.32it/s]
 31%|███       | 115915/371472 [9:12:59<24:33:29,  2.89it/s]
 31%|███       | 115916/371472 [9:12:59<22:52:52,  3.10it/s]
 31%|███       | 115917/371472 [9:12:59<22:10:39,  3.20it/s]
 31%|███       | 115918/371472 [9:13:00<21:53:45,  3.24it/s]
 31%|███       | 115919/371472 [9:13:00<21:41:45,  3.27it/s]
 31%|███       | 115920/371472 [9:13:00<20:09:04,  3.52it/s]
                                                            
{'loss': 3.2489, 'learning_rate': 7.194832898791182e-07, 'epoch': 4.99}

 31%|███       | 115920/371472 [9:13:00<20:09:04,  3.52it/s]
 31%|███       | 115921/371472 [9:13:00<19:12:54,  3.69it/s]
 31%|███       | 115922/371472 [9:13:01<19:51:08,  3.58it/s]
 31%|███       | 115923/371472 [9:13:01<19:50:32,  3.58it/s]
 31%|███       | 115924/371472 [9:13:01<19:33:38,  3.63it/s]
 31%|███       | 115925/371472 [9:13:01<18:52:49,  3.76it/s]
 31%|███       | 115926/371472 [9:13:02<19:47:23,  3.59it/s]
 31%|███       | 115927/371472 [9:13:02<19:10:10,  3.70it/s]
 31%|███       | 115928/371472 [9:13:02<19:33:25,  3.63it/s]
 31%|███       | 115929/371472 [9:13:03<20:31:00,  3.46it/s]
 31%|███       | 115930/371472 [9:13:03<19:31:11,  3.64it/s]
 31%|███       | 115931/371472 [9:13:03<19:46:00,  3.59it/s]
 31%|███       | 115932/371472 [9:13:03<20:03:20,  3.54it/s]
 31%|███       | 115933/371472 [9:13:04<19:46:36,  3.59it/s]
 31%|███       | 115934/371472 [9:13:04<20:10:30,  3.52it/s]
 31%|███       | 115935/371472 [9:13:04<19:28:32,  3.64it/s]
 31%|███       | 115936/371472 [9:13:05<19:42:44,  3.60it/s]
 31%|███       | 115937/371472 [9:13:05<21:09:34,  3.35it/s]
 31%|███       | 115938/371472 [9:13:05<20:41:08,  3.43it/s]
 31%|███       | 115939/371472 [9:13:05<20:21:51,  3.49it/s]
 31%|███       | 115940/371472 [9:13:06<21:23:24,  3.32it/s]
                                                            
{'loss': 3.3017, 'learning_rate': 7.194348079036393e-07, 'epoch': 4.99}

 31%|███       | 115940/371472 [9:13:06<21:23:24,  3.32it/s]
 31%|███       | 115941/371472 [9:13:06<21:02:01,  3.37it/s]
 31%|███       | 115942/371472 [9:13:06<20:53:45,  3.40it/s]
 31%|███       | 115943/371472 [9:13:07<19:53:13,  3.57it/s]
 31%|███       | 115944/371472 [9:13:07<19:30:26,  3.64it/s]
 31%|███       | 115945/371472 [9:13:07<19:53:34,  3.57it/s]
 31%|███       | 115946/371472 [9:13:07<19:18:04,  3.68it/s]
 31%|███       | 115947/371472 [9:13:08<18:36:34,  3.81it/s]
 31%|███       | 115948/371472 [9:13:08<18:02:13,  3.94it/s]
 31%|███       | 115949/371472 [9:13:08<18:22:02,  3.86it/s]
 31%|███       | 115950/371472 [9:13:08<20:26:07,  3.47it/s]
 31%|███       | 115951/371472 [9:13:09<20:17:29,  3.50it/s]
 31%|███       | 115952/371472 [9:13:09<21:17:29,  3.33it/s]
 31%|███       | 115953/371472 [9:13:09<20:29:55,  3.46it/s]
 31%|███       | 115954/371472 [9:13:10<20:12:47,  3.51it/s]
 31%|███       | 115955/371472 [9:13:10<20:16:10,  3.50it/s]
 31%|███       | 115956/371472 [9:13:10<20:33:31,  3.45it/s]
 31%|███       | 115957/371472 [9:13:10<20:13:26,  3.51it/s]
 31%|███       | 115958/371472 [9:13:11<19:31:12,  3.64it/s]
 31%|███       | 115959/371472 [9:13:11<20:34:37,  3.45it/s]
 31%|███       | 115960/371472 [9:13:11<19:54:39,  3.56it/s]
                                                            
{'loss': 3.54, 'learning_rate': 7.193863259281604e-07, 'epoch': 4.99}

 31%|███       | 115960/371472 [9:13:11<19:54:39,  3.56it/s]
 31%|███       | 115961/371472 [9:13:12<19:52:39,  3.57it/s]
 31%|███       | 115962/371472 [9:13:12<19:44:42,  3.59it/s]
 31%|███       | 115963/371472 [9:13:12<19:29:25,  3.64it/s]
 31%|███       | 115964/371472 [9:13:12<19:42:09,  3.60it/s]
 31%|███       | 115965/371472 [9:13:13<19:08:36,  3.71it/s]
 31%|███       | 115966/371472 [9:13:13<19:35:22,  3.62it/s]
 31%|███       | 115967/371472 [9:13:13<19:28:04,  3.65it/s]
 31%|███       | 115968/371472 [9:13:14<20:23:53,  3.48it/s]
 31%|███       | 115969/371472 [9:13:14<19:45:15,  3.59it/s]
 31%|███       | 115970/371472 [9:13:14<19:13:26,  3.69it/s]
 31%|███       | 115971/371472 [9:13:14<19:10:41,  3.70it/s]
 31%|███       | 115972/371472 [9:13:15<20:17:51,  3.50it/s]
 31%|███       | 115973/371472 [9:13:15<20:00:37,  3.55it/s]
 31%|███       | 115974/371472 [9:13:15<19:57:03,  3.56it/s]
 31%|███       | 115975/371472 [9:13:15<19:32:40,  3.63it/s]
 31%|███       | 115976/371472 [9:13:16<19:48:11,  3.58it/s]
 31%|███       | 115977/371472 [9:13:16<19:03:21,  3.72it/s]
 31%|███       | 115978/371472 [9:13:16<19:13:23,  3.69it/s]
 31%|███       | 115979/371472 [9:13:17<18:39:33,  3.80it/s]
 31%|███       | 115980/371472 [9:13:17<18:32:04,  3.83it/s]
                                                            
{'loss': 3.5398, 'learning_rate': 7.193378439526816e-07, 'epoch': 5.0}

 31%|███       | 115980/371472 [9:13:17<18:32:04,  3.83it/s]
 31%|███       | 115981/371472 [9:13:17<19:12:41,  3.69it/s]
 31%|███       | 115982/371472 [9:13:17<18:39:54,  3.80it/s]
 31%|███       | 115983/371472 [9:13:18<18:40:46,  3.80it/s]
 31%|███       | 115984/371472 [9:13:18<19:41:00,  3.61it/s]
 31%|███       | 115985/371472 [9:13:18<20:02:57,  3.54it/s]
 31%|███       | 115986/371472 [9:13:18<19:15:08,  3.69it/s]
 31%|███       | 115987/371472 [9:13:19<20:17:06,  3.50it/s]
 31%|███       | 115988/371472 [9:13:19<19:56:46,  3.56it/s]
 31%|███       | 115989/371472 [9:13:19<20:50:49,  3.40it/s]
 31%|███       | 115990/371472 [9:13:20<20:50:35,  3.40it/s]
 31%|███       | 115991/371472 [9:13:20<19:56:09,  3.56it/s]
 31%|███       | 115992/371472 [9:13:20<19:34:38,  3.62it/s]
 31%|███       | 115993/371472 [9:13:20<19:08:20,  3.71it/s]
 31%|███       | 115994/371472 [9:13:21<19:50:17,  3.58it/s]
 31%|███       | 115995/371472 [9:13:21<20:16:54,  3.50it/s]
 31%|███       | 115996/371472 [9:13:21<20:29:53,  3.46it/s]
 31%|███       | 115997/371472 [9:13:22<20:26:01,  3.47it/s]
 31%|███       | 115998/371472 [9:13:22<20:14:44,  3.51it/s]
 31%|███       | 115999/371472 [9:13:22<20:19:36,  3.49it/s]
 31%|███       | 116000/371472 [9:13:22<20:18:58,  3.49it/s]
                                                            
{'loss': 3.3978, 'learning_rate': 7.192893619772027e-07, 'epoch': 5.0}

 31%|███       | 116000/371472 [9:13:22<20:18:58,  3.49it/s]
 31%|███       | 116001/371472 [9:13:23<20:28:41,  3.47it/s]
 31%|███       | 116002/371472 [9:13:23<19:36:24,  3.62it/s]
 31%|███       | 116003/371472 [9:13:23<19:50:21,  3.58it/s]
 31%|███       | 116004/371472 [9:13:24<19:47:54,  3.58it/s]
 31%|███       | 116005/371472 [9:13:24<19:51:42,  3.57it/s]
 31%|███       | 116006/371472 [9:13:24<19:15:38,  3.68it/s]
 31%|███       | 116007/371472 [9:13:24<20:23:49,  3.48it/s]
 31%|███       | 116008/371472 [9:13:25<20:16:00,  3.50it/s]
 31%|███       | 116009/371472 [9:13:25<19:48:49,  3.58it/s]
 31%|███       | 116010/371472 [9:13:25<19:51:38,  3.57it/s]
 31%|███       | 116011/371472 [9:13:25<19:15:00,  3.69it/s]
 31%|███       | 116012/371472 [9:13:26<19:11:26,  3.70it/s]
 31%|███       | 116013/371472 [9:13:26<19:33:39,  3.63it/s]
 31%|███       | 116014/371472 [9:13:26<22:06:42,  3.21it/s]
 31%|███       | 116015/371472 [9:13:27<22:03:19,  3.22it/s]
 31%|███       | 116016/371472 [9:13:27<20:43:40,  3.42it/s]
 31%|███       | 116017/371472 [9:13:27<21:07:44,  3.36it/s]
 31%|███       | 116018/371472 [9:13:28<21:14:43,  3.34it/s]
 31%|███       | 116019/371472 [9:13:28<22:01:03,  3.22it/s]
 31%|███       | 116020/371472 [9:13:28<20:42:52,  3.43it/s]
                                                            
{'loss': 3.2752, 'learning_rate': 7.192408800017238e-07, 'epoch': 5.0}

 31%|███       | 116020/371472 [9:13:28<20:42:52,  3.43it/s]
 31%|███       | 116021/371472 [9:13:28<20:06:16,  3.53it/s]
 31%|███       | 116022/371472 [9:13:29<19:58:24,  3.55it/s]
 31%|███       | 116023/371472 [9:13:29<19:04:08,  3.72it/s]
 31%|███       | 116024/371472 [9:13:29<19:10:50,  3.70it/s]
 31%|███       | 116025/371472 [9:13:30<18:46:39,  3.78it/s]
 31%|███       | 116026/371472 [9:13:30<18:51:21,  3.76it/s]
 31%|███       | 116027/371472 [9:13:30<18:32:39,  3.83it/s]
 31%|███       | 116028/371472 [9:13:30<18:24:47,  3.85it/s]
 31%|███       | 116029/371472 [9:13:31<18:55:36,  3.75it/s]
 31%|███       | 116030/371472 [9:13:31<18:23:10,  3.86it/s]
 31%|███       | 116031/371472 [9:13:31<19:19:13,  3.67it/s]
 31%|███       | 116032/371472 [9:13:31<20:02:55,  3.54it/s]
 31%|███       | 116033/371472 [9:13:32<20:03:07,  3.54it/s]
 31%|███       | 116034/371472 [9:13:32<20:18:31,  3.49it/s]
 31%|███       | 116035/371472 [9:13:32<20:12:47,  3.51it/s]
 31%|███       | 116036/371472 [9:13:33<21:56:59,  3.23it/s]
 31%|███       | 116037/371472 [9:13:33<21:45:08,  3.26it/s]
 31%|███       | 116038/371472 [9:13:33<20:54:14,  3.39it/s]
 31%|███       | 116039/371472 [9:13:33<20:38:42,  3.44it/s]
 31%|███       | 116040/371472 [9:13:34<21:39:32,  3.28it/s]
                                                            
{'loss': 3.2816, 'learning_rate': 7.191923980262449e-07, 'epoch': 5.0}

 31%|███       | 116040/371472 [9:13:34<21:39:32,  3.28it/s]
 31%|███       | 116041/371472 [9:13:34<20:16:08,  3.50it/s]
 31%|███       | 116042/371472 [9:13:34<21:54:43,  3.24it/s]
 31%|███       | 116043/371472 [9:13:35<23:45:32,  2.99it/s]
 31%|███       | 116044/371472 [9:13:35<22:09:25,  3.20it/s]
 31%|███       | 116045/371472 [9:13:35<20:55:38,  3.39it/s]
 31%|███       | 116046/371472 [9:13:36<20:43:26,  3.42it/s]
 31%|███       | 116047/371472 [9:13:36<19:44:29,  3.59it/s]
 31%|███       | 116048/371472 [9:13:36<19:40:58,  3.60it/s]
 31%|███       | 116049/371472 [9:13:36<19:22:27,  3.66it/s]
 31%|███       | 116050/371472 [9:13:37<18:55:53,  3.75it/s]
 31%|███       | 116051/371472 [9:13:37<18:27:14,  3.84it/s]
 31%|███       | 116052/371472 [9:13:37<18:00:27,  3.94it/s]
 31%|███       | 116053/371472 [9:13:38<20:13:07,  3.51it/s]
 31%|███       | 116054/371472 [9:13:38<21:33:13,  3.29it/s]
 31%|███       | 116055/371472 [9:13:38<20:32:05,  3.46it/s]
 31%|███       | 116056/371472 [9:13:38<20:36:39,  3.44it/s]
 31%|███       | 116057/371472 [9:13:39<20:35:09,  3.45it/s]
 31%|███       | 116058/371472 [9:13:39<19:33:31,  3.63it/s]
 31%|███       | 116059/371472 [9:13:39<20:04:59,  3.53it/s]
 31%|███       | 116060/371472 [9:13:40<20:15:50,  3.50it/s]
                                                            
{'loss': 3.1059, 'learning_rate': 7.19143916050766e-07, 'epoch': 5.0}

 31%|███       | 116060/371472 [9:13:40<20:15:50,  3.50it/s]
 31%|███       | 116061/371472 [9:13:40<20:32:53,  3.45it/s]
 31%|███       | 116062/371472 [9:13:40<19:36:20,  3.62it/s]
 31%|███       | 116063/371472 [9:13:40<19:15:14,  3.68it/s]
 31%|███       | 116064/371472 [9:13:41<18:57:33,  3.74it/s]
 31%|███       | 116065/371472 [9:13:41<18:44:38,  3.79it/s]
 31%|███       | 116066/371472 [9:13:41<18:12:28,  3.90it/s]
 31%|███       | 116067/371472 [9:13:41<19:06:38,  3.71it/s]
 31%|███       | 116068/371472 [9:13:42<19:00:40,  3.73it/s]
 31%|███       | 116069/371472 [9:13:42<18:30:01,  3.83it/s]
 31%|███       | 116070/371472 [9:13:42<18:15:52,  3.88it/s]
 31%|███       | 116071/371472 [9:13:42<19:47:33,  3.58it/s]
 31%|███       | 116072/371472 [9:13:43<20:31:26,  3.46it/s]
 31%|███       | 116073/371472 [9:13:43<20:05:49,  3.53it/s]
 31%|███       | 116074/371472 [9:13:43<19:22:30,  3.66it/s]
 31%|███       | 116075/371472 [9:13:44<19:25:59,  3.65it/s]
 31%|███       | 116076/371472 [9:13:44<20:31:19,  3.46it/s]
 31%|███       | 116077/371472 [9:13:44<20:19:25,  3.49it/s]
 31%|███       | 116078/371472 [9:13:44<20:39:49,  3.43it/s]
 31%|███       | 116079/371472 [9:13:45<20:04:27,  3.53it/s]
 31%|███       | 116080/371472 [9:13:45<19:34:51,  3.62it/s]
                                                            
{'loss': 3.4993, 'learning_rate': 7.190954340752871e-07, 'epoch': 5.0}

 31%|███       | 116080/371472 [9:13:45<19:34:51,  3.62it/s]
 31%|███       | 116081/371472 [9:13:45<20:09:59,  3.52it/s]
 31%|███       | 116082/371472 [9:13:46<20:32:05,  3.45it/s]
 31%|███       | 116083/371472 [9:13:46<20:45:21,  3.42it/s]
 31%|███       | 116084/371472 [9:13:46<19:37:59,  3.61it/s]
 31%|███▏      | 116085/371472 [9:13:46<20:19:48,  3.49it/s]Some non-default generation parameters are set in the model config. These should go into a GenerationConfig file (https://huggingface.co/docs/transformers/generation_strategies#save-a-custom-decoding-strategy-with-your-model) instead. This warning will be raised to an exception in v4.41.
Non-default generation parameters: {'max_length': 200, 'early_stopping': True, 'num_beams': 5, 'forced_eos_token_id': 2}
/opt/conda/lib/python3.10/multiprocessing/popen_fork.py:66: RuntimeWarning: os.fork() was called. os.fork() is incompatible with multithreaded code, and JAX is multithreaded, so this will likely lead to a deadlock.
  self.pid = os.fork()

 31%|███▏      | 116086/371472 [9:14:18<686:49:52,  9.68s/it]
 31%|███▏      | 116087/371472 [9:14:18<487:28:16,  6.87s/it]
 31%|███▏      | 116088/371472 [9:14:19<347:37:58,  4.90s/it]
 31%|███▏      | 116089/371472 [9:14:19<251:15:02,  3.54s/it]
 31%|███▏      | 116090/371472 [9:14:19<184:02:30,  2.59s/it]
 31%|███▏      | 116091/371472 [9:14:20<135:20:58,  1.91s/it]
 31%|███▏      | 116092/371472 [9:14:20<100:43:41,  1.42s/it]
 31%|███▏      | 116093/371472 [9:14:20<76:17:26,  1.08s/it] 
 31%|███▏      | 116094/371472 [9:14:21<60:23:48,  1.17it/s]
 31%|███▏      | 116095/371472 [9:14:21<49:18:02,  1.44it/s]
 31%|███▏      | 116096/371472 [9:14:21<40:44:58,  1.74it/s]
 31%|███▏      | 116097/371472 [9:14:22<34:45:11,  2.04it/s]
 31%|███▏      | 116098/371472 [9:14:22<32:35:25,  2.18it/s]
 31%|███▏      | 116099/371472 [9:14:22<31:09:37,  2.28it/s]
 31%|███▏      | 116100/371472 [9:14:23<27:26:10,  2.59it/s]
                                                            
{'loss': 3.2164, 'learning_rate': 7.190469520998081e-07, 'epoch': 5.0}

 31%|███▏      | 116100/371472 [9:14:23<27:26:10,  2.59it/s]
 31%|███▏      | 116101/371472 [9:14:23<26:33:22,  2.67it/s]
 31%|███▏      | 116102/371472 [9:14:23<27:41:44,  2.56it/s]
 31%|███▏      | 116103/371472 [9:14:24<25:27:39,  2.79it/s]
 31%|███▏      | 116104/371472 [9:14:24<23:33:51,  3.01it/s]
 31%|███▏      | 116105/371472 [9:14:24<21:56:01,  3.23it/s]
 31%|███▏      | 116106/371472 [9:14:24<20:35:34,  3.44it/s]
 31%|███▏      | 116107/371472 [9:14:25<20:16:46,  3.50it/s]
 31%|███▏      | 116108/371472 [9:14:25<20:20:35,  3.49it/s]
 31%|███▏      | 116109/371472 [9:14:25<20:48:20,  3.41it/s]
 31%|███▏      | 116110/371472 [9:14:26<19:45:23,  3.59it/s]
 31%|███▏      | 116111/371472 [9:14:26<19:01:32,  3.73it/s]
 31%|███▏      | 116112/371472 [9:14:26<20:22:53,  3.48it/s]
 31%|███▏      | 116113/371472 [9:14:26<19:43:34,  3.60it/s]
 31%|███▏      | 116114/371472 [9:14:27<20:01:45,  3.54it/s]
 31%|███▏      | 116115/371472 [9:14:27<19:50:43,  3.57it/s]
 31%|███▏      | 116116/371472 [9:14:27<20:41:51,  3.43it/s]
 31%|███▏      | 116117/371472 [9:14:28<20:38:41,  3.44it/s]
 31%|███▏      | 116118/371472 [9:14:28<20:48:43,  3.41it/s]
 31%|███▏      | 116119/371472 [9:14:28<20:40:34,  3.43it/s]
 31%|███▏      | 116120/371472 [9:14:28<21:15:25,  3.34it/s]
                                                            
{'loss': 3.1924, 'learning_rate': 7.189984701243293e-07, 'epoch': 5.0}

 31%|███▏      | 116120/371472 [9:14:28<21:15:25,  3.34it/s]
 31%|███▏      | 116121/371472 [9:14:29<22:09:00,  3.20it/s]
 31%|███▏      | 116122/371472 [9:14:29<21:53:21,  3.24it/s]
 31%|███▏      | 116123/371472 [9:14:29<20:38:25,  3.44it/s]
 31%|███▏      | 116124/371472 [9:14:30<20:25:21,  3.47it/s]
 31%|███▏      | 116125/371472 [9:14:30<20:07:45,  3.52it/s]
 31%|███▏      | 116126/371472 [9:14:30<19:49:36,  3.58it/s]
 31%|███▏      | 116127/371472 [9:14:31<22:20:29,  3.17it/s]
 31%|███▏      | 116128/371472 [9:14:31<20:55:11,  3.39it/s]
 31%|███▏      | 116129/371472 [9:14:31<20:04:38,  3.53it/s]
 31%|███▏      | 116130/371472 [9:14:31<19:49:05,  3.58it/s]
 31%|███▏      | 116131/371472 [9:14:32<19:20:06,  3.67it/s]
 31%|███▏      | 116132/371472 [9:14:32<19:10:42,  3.70it/s]
 31%|███▏      | 116133/371472 [9:14:32<18:49:43,  3.77it/s]
 31%|███▏      | 116134/371472 [9:14:32<19:50:10,  3.58it/s]
 31%|███▏      | 116135/371472 [9:14:33<19:17:13,  3.68it/s]
 31%|███▏      | 116136/371472 [9:14:33<20:23:01,  3.48it/s]
 31%|███▏      | 116137/371472 [9:14:33<20:48:18,  3.41it/s]
 31%|███▏      | 116138/371472 [9:14:34<20:39:43,  3.43it/s]
 31%|███▏      | 116139/371472 [9:14:34<20:48:16,  3.41it/s]
 31%|███▏      | 116140/371472 [9:14:34<19:48:33,  3.58it/s]
                                                            
{'loss': 3.4916, 'learning_rate': 7.189499881488504e-07, 'epoch': 5.0}

 31%|███▏      | 116140/371472 [9:14:34<19:48:33,  3.58it/s]
 31%|███▏      | 116141/371472 [9:14:34<19:17:12,  3.68it/s]
 31%|███▏      | 116142/371472 [9:14:35<19:15:27,  3.68it/s]
 31%|███▏      | 116143/371472 [9:14:35<19:18:49,  3.67it/s]
 31%|███▏      | 116144/371472 [9:14:35<19:26:04,  3.65it/s]
 31%|███▏      | 116145/371472 [9:14:35<18:49:16,  3.77it/s]
 31%|███▏      | 116146/371472 [9:14:36<18:43:13,  3.79it/s]
 31%|███▏      | 116147/371472 [9:14:36<18:36:37,  3.81it/s]
 31%|███▏      | 116148/371472 [9:14:36<19:31:24,  3.63it/s]
 31%|███▏      | 116149/371472 [9:14:37<19:02:47,  3.72it/s]
 31%|███▏      | 116150/371472 [9:14:37<19:15:55,  3.68it/s]
 31%|███▏      | 116151/371472 [9:14:37<18:36:13,  3.81it/s]
 31%|███▏      | 116152/371472 [9:14:37<18:18:06,  3.88it/s]
 31%|███▏      | 116153/371472 [9:14:38<18:07:33,  3.91it/s]
 31%|███▏      | 116154/371472 [9:14:38<18:41:06,  3.80it/s]
 31%|███▏      | 116155/371472 [9:14:38<18:54:20,  3.75it/s]
 31%|███▏      | 116156/371472 [9:14:38<21:17:17,  3.33it/s]
 31%|███▏      | 116157/371472 [9:14:39<20:36:34,  3.44it/s]
 31%|███▏      | 116158/371472 [9:14:39<21:45:56,  3.26it/s]
 31%|███▏      | 116159/371472 [9:14:39<22:36:30,  3.14it/s]
 31%|███▏      | 116160/371472 [9:14:40<22:42:19,  3.12it/s]
                                                            
{'loss': 3.3075, 'learning_rate': 7.189015061733716e-07, 'epoch': 5.0}

 31%|███▏      | 116160/371472 [9:14:40<22:42:19,  3.12it/s]
 31%|███▏      | 116161/371472 [9:14:40<22:18:00,  3.18it/s]
 31%|███▏      | 116162/371472 [9:14:40<22:18:29,  3.18it/s]
 31%|███▏      | 116163/371472 [9:14:41<21:11:50,  3.35it/s]
 31%|███▏      | 116164/371472 [9:14:41<20:21:23,  3.48it/s]
 31%|███▏      | 116165/371472 [9:14:41<20:42:01,  3.43it/s]
 31%|███▏      | 116166/371472 [9:14:42<21:03:48,  3.37it/s]
 31%|███▏      | 116167/371472 [9:14:42<20:28:25,  3.46it/s]
 31%|███▏      | 116168/371472 [9:14:42<20:49:30,  3.41it/s]
 31%|███▏      | 116169/371472 [9:14:42<20:27:08,  3.47it/s]
 31%|███▏      | 116170/371472 [9:14:43<20:44:33,  3.42it/s]
 31%|███▏      | 116171/371472 [9:14:43<20:36:25,  3.44it/s]
 31%|███▏      | 116172/371472 [9:14:43<21:02:05,  3.37it/s]
 31%|███▏      | 116173/371472 [9:14:44<20:14:05,  3.50it/s]
 31%|███▏      | 116174/371472 [9:14:44<19:29:34,  3.64it/s]
 31%|███▏      | 116175/371472 [9:14:44<19:43:34,  3.59it/s]
 31%|███▏      | 116176/371472 [9:14:44<19:21:37,  3.66it/s]
 31%|███▏      | 116177/371472 [9:14:45<19:44:18,  3.59it/s]
 31%|███▏      | 116178/371472 [9:14:45<20:51:51,  3.40it/s]
 31%|███▏      | 116179/371472 [9:14:45<21:33:12,  3.29it/s]
 31%|███▏      | 116180/371472 [9:14:46<21:42:19,  3.27it/s]
                                                            
{'loss': 3.4159, 'learning_rate': 7.188530241978926e-07, 'epoch': 5.0}

 31%|███▏      | 116180/371472 [9:14:46<21:42:19,  3.27it/s]
 31%|███▏      | 116181/371472 [9:14:46<21:58:40,  3.23it/s]
 31%|███▏      | 116182/371472 [9:14:46<21:17:44,  3.33it/s]
 31%|███▏      | 116183/371472 [9:14:46<20:06:06,  3.53it/s]
 31%|███▏      | 116184/371472 [9:14:47<20:30:31,  3.46it/s]
 31%|███▏      | 116185/371472 [9:14:47<22:11:24,  3.20it/s]
 31%|███▏      | 116186/371472 [9:14:47<22:32:58,  3.14it/s]
 31%|███▏      | 116187/371472 [9:14:48<23:40:54,  2.99it/s]
 31%|███▏      | 116188/371472 [9:14:48<23:20:52,  3.04it/s]
 31%|███▏      | 116189/371472 [9:14:48<23:12:06,  3.06it/s]
 31%|███▏      | 116190/371472 [9:14:49<22:04:20,  3.21it/s]
 31%|███▏      | 116191/371472 [9:14:49<20:46:42,  3.41it/s]
 31%|███▏      | 116192/371472 [9:14:49<21:34:30,  3.29it/s]
 31%|███▏      | 116193/371472 [9:14:50<21:08:54,  3.35it/s]
 31%|███▏      | 116194/371472 [9:14:50<20:01:13,  3.54it/s]
 31%|███▏      | 116195/371472 [9:14:50<22:09:52,  3.20it/s]
 31%|███▏      | 116196/371472 [9:14:50<21:12:33,  3.34it/s]
 31%|███▏      | 116197/371472 [9:14:51<21:07:10,  3.36it/s]
 31%|███▏      | 116198/371472 [9:14:51<22:11:28,  3.20it/s]
 31%|███▏      | 116199/371472 [9:14:51<22:17:01,  3.18it/s]
 31%|███▏      | 116200/371472 [9:14:52<20:55:02,  3.39it/s]
                                                            
{'loss': 3.3504, 'learning_rate': 7.188045422224137e-07, 'epoch': 5.0}

 31%|███▏      | 116200/371472 [9:14:52<20:55:02,  3.39it/s]
 31%|███▏      | 116201/371472 [9:14:52<22:06:47,  3.21it/s]
 31%|███▏      | 116202/371472 [9:14:52<20:41:30,  3.43it/s]
 31%|███▏      | 116203/371472 [9:14:53<20:05:19,  3.53it/s]
 31%|███▏      | 116204/371472 [9:14:53<20:06:26,  3.53it/s]
 31%|███▏      | 116205/371472 [9:14:53<19:57:53,  3.55it/s]
 31%|███▏      | 116206/371472 [9:14:53<20:21:35,  3.48it/s]
 31%|███▏      | 116207/371472 [9:14:54<20:28:39,  3.46it/s]
 31%|███▏      | 116208/371472 [9:14:54<20:10:26,  3.51it/s]
 31%|███▏      | 116209/371472 [9:14:54<20:20:26,  3.49it/s]
 31%|███▏      | 116210/371472 [9:14:55<19:48:43,  3.58it/s]
 31%|███▏      | 116211/371472 [9:14:55<19:36:18,  3.62it/s]
 31%|███▏      | 116212/371472 [9:14:55<19:26:30,  3.65it/s]
 31%|███▏      | 116213/371472 [9:14:55<20:19:17,  3.49it/s]
 31%|███▏      | 116214/371472 [9:14:56<20:02:09,  3.54it/s]
 31%|███▏      | 116215/371472 [9:14:56<20:54:31,  3.39it/s]
 31%|███▏      | 116216/371472 [9:14:56<20:44:53,  3.42it/s]
 31%|███▏      | 116217/371472 [9:14:57<19:51:18,  3.57it/s]
 31%|███▏      | 116218/371472 [9:14:57<19:17:38,  3.67it/s]
 31%|███▏      | 116219/371472 [9:14:57<18:58:40,  3.74it/s]
 31%|███▏      | 116220/371472 [9:14:57<19:19:09,  3.67it/s]
                                                            
{'loss': 3.1897, 'learning_rate': 7.187560602469348e-07, 'epoch': 5.01}

 31%|███▏      | 116220/371472 [9:14:57<19:19:09,  3.67it/s]
 31%|███▏      | 116221/371472 [9:14:58<19:38:52,  3.61it/s]
 31%|███▏      | 116222/371472 [9:14:58<19:11:05,  3.70it/s]
 31%|███▏      | 116223/371472 [9:14:58<19:26:40,  3.65it/s]
 31%|███▏      | 116224/371472 [9:14:58<20:18:00,  3.49it/s]
 31%|███▏      | 116225/371472 [9:14:59<21:00:19,  3.38it/s]
 31%|███▏      | 116226/371472 [9:14:59<20:42:39,  3.42it/s]
 31%|███▏      | 116227/371472 [9:14:59<20:40:49,  3.43it/s]
 31%|███▏      | 116228/371472 [9:15:00<21:24:54,  3.31it/s]
 31%|███▏      | 116229/371472 [9:15:00<22:27:53,  3.16it/s]
 31%|███▏      | 116230/371472 [9:15:00<21:58:04,  3.23it/s]
 31%|███▏      | 116231/371472 [9:15:01<21:59:38,  3.22it/s]
 31%|███▏      | 116232/371472 [9:15:01<21:51:05,  3.24it/s]
 31%|███▏      | 116233/371472 [9:15:01<21:33:36,  3.29it/s]
 31%|███▏      | 116234/371472 [9:15:02<22:38:46,  3.13it/s]
 31%|███▏      | 116235/371472 [9:15:02<21:56:03,  3.23it/s]
 31%|███▏      | 116236/371472 [9:15:02<21:58:22,  3.23it/s]
 31%|███▏      | 116237/371472 [9:15:02<22:14:16,  3.19it/s]
 31%|███▏      | 116238/371472 [9:15:03<21:30:35,  3.30it/s]
 31%|███▏      | 116239/371472 [9:15:03<20:12:35,  3.51it/s]
 31%|███▏      | 116240/371472 [9:15:03<23:43:34,  2.99it/s]
                                                            
{'loss': 3.1461, 'learning_rate': 7.18707578271456e-07, 'epoch': 5.01}

 31%|███▏      | 116240/371472 [9:15:03<23:43:34,  2.99it/s]
 31%|███▏      | 116241/371472 [9:15:04<21:55:15,  3.23it/s]
 31%|███▏      | 116242/371472 [9:15:04<21:19:03,  3.33it/s]
 31%|███▏      | 116243/371472 [9:15:04<21:40:07,  3.27it/s]
 31%|███▏      | 116244/371472 [9:15:05<20:47:50,  3.41it/s]
 31%|███▏      | 116245/371472 [9:15:05<21:06:47,  3.36it/s]
 31%|███▏      | 116246/371472 [9:15:05<21:09:03,  3.35it/s]
 31%|███▏      | 116247/371472 [9:15:05<21:02:19,  3.37it/s]
 31%|███▏      | 116248/371472 [9:15:06<20:27:45,  3.46it/s]
 31%|███▏      | 116249/371472 [9:15:06<20:20:22,  3.49it/s]
 31%|███▏      | 116250/371472 [9:15:06<19:59:56,  3.54it/s]
 31%|███▏      | 116251/371472 [9:15:07<19:25:30,  3.65it/s]
 31%|███▏      | 116252/371472 [9:15:07<20:04:44,  3.53it/s]
 31%|███▏      | 116253/371472 [9:15:07<20:00:23,  3.54it/s]
 31%|███▏      | 116254/371472 [9:15:07<21:04:41,  3.36it/s]
 31%|███▏      | 116255/371472 [9:15:08<20:20:56,  3.48it/s]
 31%|███▏      | 116256/371472 [9:15:08<20:31:50,  3.45it/s]
 31%|███▏      | 116257/371472 [9:15:08<20:53:50,  3.39it/s]
 31%|███▏      | 116258/371472 [9:15:09<20:53:59,  3.39it/s]
 31%|███▏      | 116259/371472 [9:15:09<20:47:46,  3.41it/s]
 31%|███▏      | 116260/371472 [9:15:09<20:51:34,  3.40it/s]
                                                            
{'loss': 3.3035, 'learning_rate': 7.186590962959771e-07, 'epoch': 5.01}

 31%|███▏      | 116260/371472 [9:15:09<20:51:34,  3.40it/s]
 31%|███▏      | 116261/371472 [9:15:09<20:02:55,  3.54it/s]
 31%|███▏      | 116262/371472 [9:15:10<20:35:09,  3.44it/s]
 31%|███▏      | 116263/371472 [9:15:10<19:56:53,  3.55it/s]
 31%|███▏      | 116264/371472 [9:15:10<19:12:56,  3.69it/s]
 31%|███▏      | 116265/371472 [9:15:11<19:08:01,  3.71it/s]
 31%|███▏      | 116266/371472 [9:15:11<19:21:38,  3.66it/s]
 31%|███▏      | 116267/371472 [9:15:11<19:17:02,  3.68it/s]
 31%|███▏      | 116268/371472 [9:15:11<19:00:57,  3.73it/s]
 31%|███▏      | 116269/371472 [9:15:12<19:46:22,  3.59it/s]
 31%|███▏      | 116270/371472 [9:15:12<22:02:42,  3.22it/s]
 31%|███▏      | 116271/371472 [9:15:12<22:20:10,  3.17it/s]
 31%|███▏      | 116272/371472 [9:15:13<22:12:49,  3.19it/s]
 31%|███▏      | 116273/371472 [9:15:13<21:47:29,  3.25it/s]
 31%|███▏      | 116274/371472 [9:15:13<21:27:13,  3.30it/s]
 31%|███▏      | 116275/371472 [9:15:14<21:14:08,  3.34it/s]
 31%|███▏      | 116276/371472 [9:15:14<22:39:33,  3.13it/s]
 31%|███▏      | 116277/371472 [9:15:14<21:01:36,  3.37it/s]
 31%|███▏      | 116278/371472 [9:15:14<19:53:15,  3.56it/s]
 31%|███▏      | 116279/371472 [9:15:15<20:11:40,  3.51it/s]
 31%|███▏      | 116280/371472 [9:15:15<20:50:38,  3.40it/s]
                                                            
{'loss': 3.0551, 'learning_rate': 7.186106143204982e-07, 'epoch': 5.01}

 31%|███▏      | 116280/371472 [9:15:15<20:50:38,  3.40it/s]
 31%|███▏      | 116281/371472 [9:15:15<21:04:43,  3.36it/s]
 31%|███▏      | 116282/371472 [9:15:16<20:24:16,  3.47it/s]
 31%|███▏      | 116283/371472 [9:15:16<20:48:44,  3.41it/s]
 31%|███▏      | 116284/371472 [9:15:16<20:07:56,  3.52it/s]
 31%|███▏      | 116285/371472 [9:15:17<21:02:57,  3.37it/s]
 31%|███▏      | 116286/371472 [9:15:17<20:37:59,  3.44it/s]
 31%|███▏      | 116287/371472 [9:15:17<22:36:51,  3.13it/s]
 31%|███▏      | 116288/371472 [9:15:17<22:31:30,  3.15it/s]
 31%|███▏      | 116289/371472 [9:15:18<22:08:13,  3.20it/s]
 31%|███▏      | 116290/371472 [9:15:18<21:12:58,  3.34it/s]
 31%|███▏      | 116291/371472 [9:15:18<21:30:25,  3.30it/s]
 31%|███▏      | 116292/371472 [9:15:19<21:13:08,  3.34it/s]
 31%|███▏      | 116293/371472 [9:15:19<24:47:30,  2.86it/s]
 31%|███▏      | 116294/371472 [9:15:19<24:11:50,  2.93it/s]
 31%|███▏      | 116295/371472 [9:15:20<22:20:33,  3.17it/s]
 31%|███▏      | 116296/371472 [9:15:20<21:55:38,  3.23it/s]
 31%|███▏      | 116297/371472 [9:15:20<20:47:35,  3.41it/s]
 31%|███▏      | 116298/371472 [9:15:21<20:58:14,  3.38it/s]
 31%|███▏      | 116299/371472 [9:15:21<21:56:57,  3.23it/s]
 31%|███▏      | 116300/371472 [9:15:21<22:43:02,  3.12it/s]
                                                            
{'loss': 3.3047, 'learning_rate': 7.185621323450192e-07, 'epoch': 5.01}

 31%|███▏      | 116300/371472 [9:15:21<22:43:02,  3.12it/s]
 31%|███▏      | 116301/371472 [9:15:22<21:44:08,  3.26it/s]
 31%|███▏      | 116302/371472 [9:15:22<20:17:15,  3.49it/s]
 31%|███▏      | 116303/371472 [9:15:22<19:13:39,  3.69it/s]
 31%|███▏      | 116304/371472 [9:15:22<18:53:12,  3.75it/s]
 31%|███▏      | 116305/371472 [9:15:23<19:07:42,  3.71it/s]
 31%|███▏      | 116306/371472 [9:15:23<19:15:14,  3.68it/s]
 31%|███▏      | 116307/371472 [9:15:23<19:50:26,  3.57it/s]
 31%|███▏      | 116308/371472 [9:15:23<19:20:38,  3.66it/s]
 31%|███▏      | 116309/371472 [9:15:24<19:28:25,  3.64it/s]
 31%|███▏      | 116310/371472 [9:15:24<19:17:38,  3.67it/s]
 31%|███▏      | 116311/371472 [9:15:24<18:59:37,  3.73it/s]
 31%|███▏      | 116312/371472 [9:15:24<19:14:00,  3.69it/s]
 31%|███▏      | 116313/371472 [9:15:25<19:27:32,  3.64it/s]
 31%|███▏      | 116314/371472 [9:15:25<19:40:46,  3.60it/s]
 31%|███▏      | 116315/371472 [9:15:25<18:51:48,  3.76it/s]
 31%|███▏      | 116316/371472 [9:15:26<18:54:38,  3.75it/s]
 31%|███▏      | 116317/371472 [9:15:26<18:23:37,  3.85it/s]
 31%|███▏      | 116318/371472 [9:15:26<17:59:52,  3.94it/s]
 31%|███▏      | 116319/371472 [9:15:26<18:03:01,  3.93it/s]
 31%|███▏      | 116320/371472 [9:15:27<19:51:06,  3.57it/s]
                                                            
{'loss': 3.2376, 'learning_rate': 7.185136503695403e-07, 'epoch': 5.01}

 31%|███▏      | 116320/371472 [9:15:27<19:51:06,  3.57it/s]
 31%|███▏      | 116321/371472 [9:15:27<20:14:30,  3.50it/s]
 31%|███▏      | 116322/371472 [9:15:27<20:05:08,  3.53it/s]
 31%|███▏      | 116323/371472 [9:15:27<19:43:27,  3.59it/s]
 31%|███▏      | 116324/371472 [9:15:28<19:20:08,  3.67it/s]
 31%|███▏      | 116325/371472 [9:15:28<19:03:42,  3.72it/s]
 31%|███▏      | 116326/371472 [9:15:28<19:19:33,  3.67it/s]
 31%|███▏      | 116327/371472 [9:15:29<19:49:30,  3.57it/s]
 31%|███▏      | 116328/371472 [9:15:29<21:01:36,  3.37it/s]
 31%|███▏      | 116329/371472 [9:15:29<20:22:48,  3.48it/s]
 31%|███▏      | 116330/371472 [9:15:29<20:19:58,  3.49it/s]
 31%|███▏      | 116331/371472 [9:15:30<19:55:33,  3.56it/s]
 31%|███▏      | 116332/371472 [9:15:30<20:11:35,  3.51it/s]
 31%|███▏      | 116333/371472 [9:15:30<20:03:13,  3.53it/s]
 31%|███▏      | 116334/371472 [9:15:31<20:16:17,  3.50it/s]
 31%|███▏      | 116335/371472 [9:15:31<19:53:17,  3.56it/s]
 31%|███▏      | 116336/371472 [9:15:31<20:21:19,  3.48it/s]
 31%|███▏      | 116337/371472 [9:15:31<19:54:53,  3.56it/s]
 31%|███▏      | 116338/371472 [9:15:32<20:16:55,  3.49it/s]
 31%|███▏      | 116339/371472 [9:15:32<20:20:39,  3.48it/s]
 31%|███▏      | 116340/371472 [9:15:32<21:23:20,  3.31it/s]
                                                            
{'loss': 3.1463, 'learning_rate': 7.184651683940614e-07, 'epoch': 5.01}

 31%|███▏      | 116340/371472 [9:15:32<21:23:20,  3.31it/s]
 31%|███▏      | 116341/371472 [9:15:33<22:10:05,  3.20it/s]
 31%|███▏      | 116342/371472 [9:15:33<23:20:38,  3.04it/s]
 31%|███▏      | 116343/371472 [9:15:33<23:10:50,  3.06it/s]
 31%|███▏      | 116344/371472 [9:15:34<23:07:30,  3.06it/s]
 31%|███▏      | 116345/371472 [9:15:34<23:17:01,  3.04it/s]
 31%|███▏      | 116346/371472 [9:15:34<23:06:29,  3.07it/s]
 31%|███▏      | 116347/371472 [9:15:35<22:57:55,  3.09it/s]
 31%|███▏      | 116348/371472 [9:15:35<23:03:31,  3.07it/s]
 31%|███▏      | 116349/371472 [9:15:35<23:52:32,  2.97it/s]
 31%|███▏      | 116350/371472 [9:15:36<25:15:33,  2.81it/s]
 31%|███▏      | 116351/371472 [9:15:36<24:20:57,  2.91it/s]
 31%|███▏      | 116352/371472 [9:15:36<24:02:46,  2.95it/s]
 31%|███▏      | 116353/371472 [9:15:37<23:50:20,  2.97it/s]
 31%|███▏      | 116354/371472 [9:15:37<22:04:31,  3.21it/s]
 31%|███▏      | 116355/371472 [9:15:37<22:17:47,  3.18it/s]
 31%|███▏      | 116356/371472 [9:15:38<23:49:37,  2.97it/s]
 31%|███▏      | 116357/371472 [9:15:38<22:48:32,  3.11it/s]
 31%|███▏      | 116358/371472 [9:15:38<22:49:05,  3.11it/s]
 31%|███▏      | 116359/371472 [9:15:39<21:52:24,  3.24it/s]
 31%|███▏      | 116360/371472 [9:15:39<21:51:45,  3.24it/s]
                                                            
{'loss': 3.3451, 'learning_rate': 7.184166864185826e-07, 'epoch': 5.01}

 31%|███▏      | 116360/371472 [9:15:39<21:51:45,  3.24it/s]
 31%|███▏      | 116361/371472 [9:15:39<20:57:25,  3.38it/s]
 31%|███▏      | 116362/371472 [9:15:39<22:20:17,  3.17it/s]
 31%|███▏      | 116363/371472 [9:15:40<21:42:28,  3.26it/s]
 31%|███▏      | 116364/371472 [9:15:40<20:56:31,  3.38it/s]
 31%|███▏      | 116365/371472 [9:15:40<20:00:25,  3.54it/s]
 31%|███▏      | 116366/371472 [9:15:41<19:33:55,  3.62it/s]
 31%|███▏      | 116367/371472 [9:15:41<19:30:22,  3.63it/s]
 31%|███▏      | 116368/371472 [9:15:41<20:36:17,  3.44it/s]
 31%|███▏      | 116369/371472 [9:15:41<19:55:56,  3.56it/s]
 31%|███▏      | 116370/371472 [9:15:42<20:27:46,  3.46it/s]
 31%|███▏      | 116371/371472 [9:15:42<19:59:58,  3.54it/s]
 31%|███▏      | 116372/371472 [9:15:42<20:23:08,  3.48it/s]
 31%|███▏      | 116373/371472 [9:15:43<20:24:32,  3.47it/s]
 31%|███▏      | 116374/371472 [9:15:43<21:30:32,  3.29it/s]
 31%|███▏      | 116375/371472 [9:15:43<20:26:19,  3.47it/s]
 31%|███▏      | 116376/371472 [9:15:43<20:30:07,  3.46it/s]
 31%|███▏      | 116377/371472 [9:15:44<20:25:09,  3.47it/s]
 31%|███▏      | 116378/371472 [9:15:44<19:58:55,  3.55it/s]
 31%|███▏      | 116379/371472 [9:15:44<20:19:11,  3.49it/s]
 31%|███▏      | 116380/371472 [9:15:45<24:19:24,  2.91it/s]
                                                            
{'loss': 3.3481, 'learning_rate': 7.183682044431037e-07, 'epoch': 5.01}

 31%|███▏      | 116380/371472 [9:15:45<24:19:24,  2.91it/s]
 31%|███▏      | 116381/371472 [9:15:45<22:55:28,  3.09it/s]
 31%|███▏      | 116382/371472 [9:15:45<21:53:43,  3.24it/s]
 31%|███▏      | 116383/371472 [9:15:46<20:49:46,  3.40it/s]
 31%|███▏      | 116384/371472 [9:15:46<20:20:35,  3.48it/s]
 31%|███▏      | 116385/371472 [9:15:46<20:08:51,  3.52it/s]
 31%|███▏      | 116386/371472 [9:15:47<22:34:40,  3.14it/s]
 31%|███▏      | 116387/371472 [9:15:47<21:47:23,  3.25it/s]
 31%|███▏      | 116388/371472 [9:15:47<20:30:53,  3.45it/s]
 31%|███▏      | 116389/371472 [9:15:47<20:03:43,  3.53it/s]
 31%|███▏      | 116390/371472 [9:15:48<23:45:43,  2.98it/s]
 31%|███▏      | 116391/371472 [9:15:48<22:24:44,  3.16it/s]
 31%|███▏      | 116392/371472 [9:15:48<21:15:08,  3.33it/s]
 31%|███▏      | 116393/371472 [9:15:49<20:21:31,  3.48it/s]
 31%|███▏      | 116394/371472 [9:15:49<20:19:26,  3.49it/s]
 31%|███▏      | 116395/371472 [9:15:49<19:17:41,  3.67it/s]
 31%|███▏      | 116396/371472 [9:15:49<18:47:19,  3.77it/s]
 31%|███▏      | 116397/371472 [9:15:50<19:41:14,  3.60it/s]
 31%|███▏      | 116398/371472 [9:15:50<19:46:05,  3.58it/s]
 31%|███▏      | 116399/371472 [9:15:50<20:44:17,  3.42it/s]
 31%|███▏      | 116400/371472 [9:15:51<20:29:25,  3.46it/s]
                                                            
{'loss': 3.3748, 'learning_rate': 7.183197224676248e-07, 'epoch': 5.01}

 31%|███▏      | 116400/371472 [9:15:51<20:29:25,  3.46it/s]
 31%|███▏      | 116401/371472 [9:15:51<21:09:14,  3.35it/s]
 31%|███▏      | 116402/371472 [9:15:51<21:48:55,  3.25it/s]
 31%|███▏      | 116403/371472 [9:15:51<21:21:21,  3.32it/s]
 31%|███▏      | 116404/371472 [9:15:52<21:09:13,  3.35it/s]
 31%|███▏      | 116405/371472 [9:15:52<20:23:55,  3.47it/s]
 31%|███▏      | 116406/371472 [9:15:52<20:59:18,  3.38it/s]
 31%|███▏      | 116407/371472 [9:15:53<20:20:34,  3.48it/s]
 31%|███▏      | 116408/371472 [9:15:53<20:43:14,  3.42it/s]
 31%|███▏      | 116409/371472 [9:15:53<22:33:06,  3.14it/s]
 31%|███▏      | 116410/371472 [9:15:54<21:39:40,  3.27it/s]
 31%|███▏      | 116411/371472 [9:15:54<22:23:08,  3.16it/s]
 31%|███▏      | 116412/371472 [9:15:54<21:43:39,  3.26it/s]
 31%|███▏      | 116413/371472 [9:15:54<21:08:00,  3.35it/s]
 31%|███▏      | 116414/371472 [9:15:55<20:15:57,  3.50it/s]
 31%|███▏      | 116415/371472 [9:15:55<20:41:19,  3.42it/s]
 31%|███▏      | 116416/371472 [9:15:55<21:03:52,  3.36it/s]
 31%|███▏      | 116417/371472 [9:15:56<21:35:52,  3.28it/s]
 31%|███▏      | 116418/371472 [9:15:56<20:27:19,  3.46it/s]
 31%|███▏      | 116419/371472 [9:15:56<20:22:15,  3.48it/s]
 31%|███▏      | 116420/371472 [9:15:56<19:56:16,  3.55it/s]
                                                            
{'loss': 3.399, 'learning_rate': 7.182712404921459e-07, 'epoch': 5.01}

 31%|███▏      | 116420/371472 [9:15:56<19:56:16,  3.55it/s]
 31%|███▏      | 116421/371472 [9:15:57<19:18:44,  3.67it/s]
 31%|███▏      | 116422/371472 [9:15:57<20:07:44,  3.52it/s]
 31%|███▏      | 116423/371472 [9:15:57<19:47:22,  3.58it/s]
 31%|███▏      | 116424/371472 [9:15:58<19:41:29,  3.60it/s]
 31%|███▏      | 116425/371472 [9:15:58<19:51:23,  3.57it/s]
 31%|███▏      | 116426/371472 [9:15:58<20:06:58,  3.52it/s]
 31%|███▏      | 116427/371472 [9:15:59<21:22:30,  3.31it/s]
 31%|███▏      | 116428/371472 [9:15:59<20:24:46,  3.47it/s]
 31%|███▏      | 116429/371472 [9:15:59<19:56:46,  3.55it/s]
 31%|███▏      | 116430/371472 [9:15:59<19:40:38,  3.60it/s]
 31%|███▏      | 116431/371472 [9:16:00<19:00:00,  3.73it/s]
 31%|███▏      | 116432/371472 [9:16:00<19:34:01,  3.62it/s]
 31%|███▏      | 116433/371472 [9:16:00<20:22:56,  3.48it/s]
 31%|███▏      | 116434/371472 [9:16:00<19:32:26,  3.63it/s]
 31%|███▏      | 116435/371472 [9:16:01<20:17:20,  3.49it/s]
 31%|███▏      | 116436/371472 [9:16:01<19:59:56,  3.54it/s]
 31%|███▏      | 116437/371472 [9:16:01<19:51:47,  3.57it/s]
 31%|███▏      | 116438/371472 [9:16:02<20:28:05,  3.46it/s]
 31%|███▏      | 116439/371472 [9:16:02<19:54:52,  3.56it/s]
 31%|███▏      | 116440/371472 [9:16:02<22:00:20,  3.22it/s]
                                                            
{'loss': 3.2716, 'learning_rate': 7.182227585166669e-07, 'epoch': 5.02}

 31%|███▏      | 116440/371472 [9:16:02<22:00:20,  3.22it/s]
 31%|███▏      | 116441/371472 [9:16:02<21:01:14,  3.37it/s]
 31%|███▏      | 116442/371472 [9:16:03<20:11:22,  3.51it/s]
 31%|███▏      | 116443/371472 [9:16:03<21:03:43,  3.36it/s]
 31%|███▏      | 116444/371472 [9:16:03<20:48:11,  3.41it/s]
 31%|███▏      | 116445/371472 [9:16:04<20:25:14,  3.47it/s]
 31%|███▏      | 116446/371472 [9:16:04<20:18:56,  3.49it/s]
 31%|███▏      | 116447/371472 [9:16:04<21:14:04,  3.34it/s]
 31%|███▏      | 116448/371472 [9:16:05<21:20:40,  3.32it/s]
 31%|███▏      | 116449/371472 [9:16:05<20:51:38,  3.40it/s]
 31%|███▏      | 116450/371472 [9:16:05<20:12:04,  3.51it/s]
 31%|███▏      | 116451/371472 [9:16:06<23:04:35,  3.07it/s]
 31%|███▏      | 116452/371472 [9:16:06<22:33:11,  3.14it/s]
 31%|███▏      | 116453/371472 [9:16:06<21:12:49,  3.34it/s]
 31%|███▏      | 116454/371472 [9:16:06<20:59:35,  3.37it/s]
 31%|███▏      | 116455/371472 [9:16:07<20:16:07,  3.49it/s]
 31%|███▏      | 116456/371472 [9:16:07<21:05:30,  3.36it/s]
 31%|███▏      | 116457/371472 [9:16:07<22:52:48,  3.10it/s]
 31%|███▏      | 116458/371472 [9:16:08<22:02:42,  3.21it/s]
 31%|███▏      | 116459/371472 [9:16:08<21:02:43,  3.37it/s]
 31%|███▏      | 116460/371472 [9:16:08<20:52:40,  3.39it/s]
                                                            
{'loss': 3.3551, 'learning_rate': 7.181742765411881e-07, 'epoch': 5.02}

 31%|███▏      | 116460/371472 [9:16:08<20:52:40,  3.39it/s]
 31%|███▏      | 116461/371472 [9:16:08<19:40:43,  3.60it/s]
 31%|███▏      | 116462/371472 [9:16:09<19:52:14,  3.56it/s]
 31%|███▏      | 116463/371472 [9:16:09<20:17:09,  3.49it/s]
 31%|███▏      | 116464/371472 [9:16:09<19:59:35,  3.54it/s]
 31%|███▏      | 116465/371472 [9:16:10<20:28:45,  3.46it/s]
 31%|███▏      | 116466/371472 [9:16:10<20:35:08,  3.44it/s]
 31%|███▏      | 116467/371472 [9:16:10<20:34:29,  3.44it/s]
 31%|███▏      | 116468/371472 [9:16:10<20:53:39,  3.39it/s]
 31%|███▏      | 116469/371472 [9:16:11<20:11:39,  3.51it/s]
 31%|███▏      | 116470/371472 [9:16:11<19:15:35,  3.68it/s]
 31%|███▏      | 116471/371472 [9:16:11<18:53:12,  3.75it/s]
 31%|███▏      | 116472/371472 [9:16:12<20:04:24,  3.53it/s]
 31%|███▏      | 116473/371472 [9:16:12<20:02:37,  3.53it/s]
 31%|███▏      | 116474/371472 [9:16:12<19:59:47,  3.54it/s]
 31%|███▏      | 116475/371472 [9:16:12<19:36:19,  3.61it/s]
 31%|███▏      | 116476/371472 [9:16:13<20:36:29,  3.44it/s]
 31%|███▏      | 116477/371472 [9:16:13<20:19:55,  3.48it/s]
 31%|███▏      | 116478/371472 [9:16:13<20:18:46,  3.49it/s]
 31%|███▏      | 116479/371472 [9:16:14<19:40:40,  3.60it/s]
 31%|███▏      | 116480/371472 [9:16:14<20:03:38,  3.53it/s]
                                                            
{'loss': 3.2017, 'learning_rate': 7.181257945657092e-07, 'epoch': 5.02}

 31%|███▏      | 116480/371472 [9:16:14<20:03:38,  3.53it/s]
 31%|███▏      | 116481/371472 [9:16:14<19:44:57,  3.59it/s]
 31%|███▏      | 116482/371472 [9:16:14<20:00:28,  3.54it/s]
 31%|███▏      | 116483/371472 [9:16:15<20:21:51,  3.48it/s]
 31%|███▏      | 116484/371472 [9:16:15<19:44:55,  3.59it/s]
 31%|███▏      | 116485/371472 [9:16:15<21:11:48,  3.34it/s]
 31%|███▏      | 116486/371472 [9:16:16<21:14:06,  3.34it/s]
 31%|███▏      | 116487/371472 [9:16:16<23:16:54,  3.04it/s]
 31%|███▏      | 116488/371472 [9:16:16<23:40:19,  2.99it/s]
 31%|███▏      | 116489/371472 [9:16:17<22:38:53,  3.13it/s]
 31%|███▏      | 116490/371472 [9:16:17<21:24:26,  3.31it/s]
 31%|███▏      | 116491/371472 [9:16:17<22:25:40,  3.16it/s]
 31%|███▏      | 116492/371472 [9:16:18<23:30:49,  3.01it/s]
 31%|███▏      | 116493/371472 [9:16:18<22:04:35,  3.21it/s]
 31%|███▏      | 116494/371472 [9:16:18<21:26:33,  3.30it/s]
 31%|███▏      | 116495/371472 [9:16:18<22:33:19,  3.14it/s]
 31%|███▏      | 116496/371472 [9:16:19<22:00:53,  3.22it/s]
 31%|███▏      | 116497/371472 [9:16:19<21:55:44,  3.23it/s]
 31%|███▏      | 116498/371472 [9:16:19<20:54:27,  3.39it/s]
 31%|███▏      | 116499/371472 [9:16:20<20:55:00,  3.39it/s]
 31%|███▏      | 116500/371472 [9:16:20<20:30:12,  3.45it/s]
                                                            
{'loss': 3.2237, 'learning_rate': 7.180773125902303e-07, 'epoch': 5.02}

 31%|███▏      | 116500/371472 [9:16:20<20:30:12,  3.45it/s]
 31%|███▏      | 116501/371472 [9:16:20<20:15:08,  3.50it/s]
 31%|███▏      | 116502/371472 [9:16:21<20:37:09,  3.43it/s]
 31%|███▏      | 116503/371472 [9:16:21<21:13:32,  3.34it/s]
 31%|███▏      | 116504/371472 [9:16:21<20:45:49,  3.41it/s]
 31%|███▏      | 116505/371472 [9:16:21<21:48:14,  3.25it/s]
 31%|███▏      | 116506/371472 [9:16:22<21:43:10,  3.26it/s]
 31%|███▏      | 116507/371472 [9:16:22<22:19:59,  3.17it/s]
 31%|███▏      | 116508/371472 [9:16:22<24:14:08,  2.92it/s]
 31%|███▏      | 116509/371472 [9:16:23<23:12:52,  3.05it/s]
 31%|███▏      | 116510/371472 [9:16:23<21:43:51,  3.26it/s]
 31%|███▏      | 116511/371472 [9:16:23<20:41:09,  3.42it/s]
 31%|███▏      | 116512/371472 [9:16:24<21:33:22,  3.29it/s]
 31%|███▏      | 116513/371472 [9:16:24<20:30:53,  3.45it/s]
 31%|███▏      | 116514/371472 [9:16:24<20:27:20,  3.46it/s]
 31%|███▏      | 116515/371472 [9:16:24<20:36:20,  3.44it/s]
 31%|███▏      | 116516/371472 [9:16:25<23:24:56,  3.02it/s]
 31%|███▏      | 116517/371472 [9:16:25<22:23:06,  3.16it/s]
 31%|███▏      | 116518/371472 [9:16:25<21:31:39,  3.29it/s]
 31%|███▏      | 116519/371472 [9:16:26<20:21:01,  3.48it/s]
 31%|███▏      | 116520/371472 [9:16:26<20:01:55,  3.54it/s]
                                                            
{'loss': 3.333, 'learning_rate': 7.180288306147514e-07, 'epoch': 5.02}

 31%|███▏      | 116520/371472 [9:16:26<20:01:55,  3.54it/s]
 31%|███▏      | 116521/371472 [9:16:26<19:31:15,  3.63it/s]
 31%|███▏      | 116522/371472 [9:16:27<19:50:37,  3.57it/s]
 31%|███▏      | 116523/371472 [9:16:27<19:27:55,  3.64it/s]
 31%|███▏      | 116524/371472 [9:16:27<20:25:21,  3.47it/s]
 31%|███▏      | 116525/371472 [9:16:27<20:08:49,  3.52it/s]
 31%|███▏      | 116526/371472 [9:16:28<19:54:07,  3.56it/s]
 31%|███▏      | 116527/371472 [9:16:28<19:32:19,  3.62it/s]
 31%|███▏      | 116528/371472 [9:16:28<19:54:27,  3.56it/s]
 31%|███▏      | 116529/371472 [9:16:29<21:37:01,  3.28it/s]
 31%|███▏      | 116530/371472 [9:16:29<21:42:57,  3.26it/s]
 31%|███▏      | 116531/371472 [9:16:29<21:03:57,  3.36it/s]
 31%|███▏      | 116532/371472 [9:16:29<21:08:26,  3.35it/s]
 31%|███▏      | 116533/371472 [9:16:30<20:04:34,  3.53it/s]
 31%|███▏      | 116534/371472 [9:16:30<19:56:56,  3.55it/s]
 31%|███▏      | 116535/371472 [9:16:30<20:21:10,  3.48it/s]
 31%|███▏      | 116536/371472 [9:16:31<20:12:33,  3.50it/s]
 31%|███▏      | 116537/371472 [9:16:31<20:21:56,  3.48it/s]
 31%|███▏      | 116538/371472 [9:16:31<20:36:55,  3.44it/s]
 31%|███▏      | 116539/371472 [9:16:32<22:09:48,  3.20it/s]
 31%|███▏      | 116540/371472 [9:16:32<22:08:21,  3.20it/s]
                                                            
{'loss': 3.3354, 'learning_rate': 7.179803486392726e-07, 'epoch': 5.02}

 31%|███▏      | 116540/371472 [9:16:32<22:08:21,  3.20it/s]
 31%|███▏      | 116541/371472 [9:16:32<22:39:07,  3.13it/s]
 31%|███▏      | 116542/371472 [9:16:32<22:01:59,  3.21it/s]
 31%|███▏      | 116543/371472 [9:16:33<22:20:04,  3.17it/s]
 31%|███▏      | 116544/371472 [9:16:33<21:27:17,  3.30it/s]
 31%|███▏      | 116545/371472 [9:16:33<20:36:40,  3.44it/s]
 31%|███▏      | 116546/371472 [9:16:34<20:37:22,  3.43it/s]
 31%|███▏      | 116547/371472 [9:16:34<20:10:41,  3.51it/s]
 31%|███▏      | 116548/371472 [9:16:34<21:09:00,  3.35it/s]
 31%|███▏      | 116549/371472 [9:16:35<22:02:43,  3.21it/s]
 31%|███▏      | 116550/371472 [9:16:35<23:26:34,  3.02it/s]
 31%|███▏      | 116551/371472 [9:16:35<22:19:58,  3.17it/s]
 31%|███▏      | 116552/371472 [9:16:35<21:20:30,  3.32it/s]
 31%|███▏      | 116553/371472 [9:16:36<21:02:05,  3.37it/s]
 31%|███▏      | 116554/371472 [9:16:36<21:06:30,  3.35it/s]
 31%|███▏      | 116555/371472 [9:16:36<21:24:50,  3.31it/s]
 31%|███▏      | 116556/371472 [9:16:37<20:56:05,  3.38it/s]
 31%|███▏      | 116557/371472 [9:16:37<21:16:48,  3.33it/s]
 31%|███▏      | 116558/371472 [9:16:37<21:40:21,  3.27it/s]
 31%|███▏      | 116559/371472 [9:16:38<21:21:53,  3.31it/s]
 31%|███▏      | 116560/371472 [9:16:38<21:47:41,  3.25it/s]
                                                            
{'loss': 3.2447, 'learning_rate': 7.179318666637936e-07, 'epoch': 5.02}

 31%|███▏      | 116560/371472 [9:16:38<21:47:41,  3.25it/s]
 31%|███▏      | 116561/371472 [9:16:38<21:25:39,  3.30it/s]
 31%|███▏      | 116562/371472 [9:16:38<21:06:08,  3.36it/s]
 31%|███▏      | 116563/371472 [9:16:39<20:07:38,  3.52it/s]
 31%|███▏      | 116564/371472 [9:16:39<21:50:53,  3.24it/s]
 31%|███▏      | 116565/371472 [9:16:39<21:16:13,  3.33it/s]
 31%|███▏      | 116566/371472 [9:16:40<20:42:36,  3.42it/s]
 31%|███▏      | 116567/371472 [9:16:40<20:43:25,  3.42it/s]
 31%|███▏      | 116568/371472 [9:16:40<19:53:20,  3.56it/s]
 31%|███▏      | 116569/371472 [9:16:40<19:35:28,  3.61it/s]
 31%|███▏      | 116570/371472 [9:16:41<20:17:29,  3.49it/s]
 31%|███▏      | 116571/371472 [9:16:41<20:58:22,  3.38it/s]
 31%|███▏      | 116572/371472 [9:16:41<21:07:04,  3.35it/s]
 31%|███▏      | 116573/371472 [9:16:42<21:35:18,  3.28it/s]
 31%|███▏      | 116574/371472 [9:16:42<21:27:50,  3.30it/s]
 31%|███▏      | 116575/371472 [9:16:42<21:06:40,  3.35it/s]
 31%|███▏      | 116576/371472 [9:16:43<21:04:09,  3.36it/s]
 31%|███▏      | 116577/371472 [9:16:43<20:22:16,  3.48it/s]
 31%|███▏      | 116578/371472 [9:16:43<20:02:41,  3.53it/s]
 31%|███▏      | 116579/371472 [9:16:43<19:27:17,  3.64it/s]
 31%|███▏      | 116580/371472 [9:16:44<20:39:22,  3.43it/s]
                                                            
{'loss': 3.3293, 'learning_rate': 7.178833846883147e-07, 'epoch': 5.02}

 31%|███▏      | 116580/371472 [9:16:44<20:39:22,  3.43it/s]
 31%|███▏      | 116581/371472 [9:16:44<20:54:37,  3.39it/s]
 31%|███▏      | 116582/371472 [9:16:44<22:04:42,  3.21it/s]
 31%|███▏      | 116583/371472 [9:16:45<21:42:49,  3.26it/s]
 31%|███▏      | 116584/371472 [9:16:45<20:58:19,  3.38it/s]
 31%|███▏      | 116585/371472 [9:16:45<20:50:32,  3.40it/s]
 31%|███▏      | 116586/371472 [9:16:46<20:43:41,  3.42it/s]
 31%|███▏      | 116587/371472 [9:16:46<20:31:23,  3.45it/s]
 31%|███▏      | 116588/371472 [9:16:46<21:13:14,  3.34it/s]
 31%|███▏      | 116589/371472 [9:16:46<20:41:11,  3.42it/s]
 31%|███▏      | 116590/371472 [9:16:47<20:16:17,  3.49it/s]
 31%|███▏      | 116591/371472 [9:16:47<21:02:56,  3.36it/s]
 31%|███▏      | 116592/371472 [9:16:47<21:57:54,  3.22it/s]
 31%|███▏      | 116593/371472 [9:16:48<22:04:15,  3.21it/s]
 31%|███▏      | 116594/371472 [9:16:48<22:03:34,  3.21it/s]
 31%|███▏      | 116595/371472 [9:16:48<23:14:31,  3.05it/s]
 31%|███▏      | 116596/371472 [9:16:49<24:42:33,  2.87it/s]
 31%|███▏      | 116597/371472 [9:16:49<23:18:12,  3.04it/s]
 31%|███▏      | 116598/371472 [9:16:49<22:05:11,  3.21it/s]
 31%|███▏      | 116599/371472 [9:16:50<21:21:53,  3.31it/s]
 31%|███▏      | 116600/371472 [9:16:50<20:41:33,  3.42it/s]
                                                            
{'loss': 3.2851, 'learning_rate': 7.178349027128358e-07, 'epoch': 5.02}

 31%|███▏      | 116600/371472 [9:16:50<20:41:33,  3.42it/s]
 31%|███▏      | 116601/371472 [9:16:50<20:18:40,  3.49it/s]
 31%|███▏      | 116602/371472 [9:16:50<21:45:36,  3.25it/s]
 31%|███▏      | 116603/371472 [9:16:51<20:56:13,  3.38it/s]
 31%|███▏      | 116604/371472 [9:16:51<21:16:43,  3.33it/s]
 31%|███▏      | 116605/371472 [9:16:51<21:28:23,  3.30it/s]
 31%|███▏      | 116606/371472 [9:16:52<22:34:28,  3.14it/s]
 31%|███▏      | 116607/371472 [9:16:52<21:50:32,  3.24it/s]
 31%|███▏      | 116608/371472 [9:16:52<21:23:33,  3.31it/s]
 31%|███▏      | 116609/371472 [9:16:53<20:33:27,  3.44it/s]
 31%|███▏      | 116610/371472 [9:16:53<20:52:33,  3.39it/s]
 31%|███▏      | 116611/371472 [9:16:53<20:41:39,  3.42it/s]
 31%|███▏      | 116612/371472 [9:16:53<21:20:04,  3.32it/s]
 31%|███▏      | 116613/371472 [9:16:54<20:28:08,  3.46it/s]
 31%|███▏      | 116614/371472 [9:16:54<20:44:52,  3.41it/s]
 31%|███▏      | 116615/371472 [9:16:54<20:23:18,  3.47it/s]
 31%|███▏      | 116616/371472 [9:16:55<20:09:50,  3.51it/s]
 31%|███▏      | 116617/371472 [9:16:55<19:32:16,  3.62it/s]
 31%|███▏      | 116618/371472 [9:16:55<19:12:01,  3.69it/s]
 31%|███▏      | 116619/371472 [9:16:55<19:29:06,  3.63it/s]
 31%|███▏      | 116620/371472 [9:16:56<19:31:20,  3.63it/s]
                                                            
{'loss': 3.2433, 'learning_rate': 7.177864207373569e-07, 'epoch': 5.02}

 31%|███▏      | 116620/371472 [9:16:56<19:31:20,  3.63it/s]
 31%|███▏      | 116621/371472 [9:16:56<19:44:26,  3.59it/s]
 31%|███▏      | 116622/371472 [9:16:56<19:44:31,  3.59it/s]
 31%|███▏      | 116623/371472 [9:16:56<19:11:38,  3.69it/s]
 31%|███▏      | 116624/371472 [9:16:57<19:23:01,  3.65it/s]
 31%|███▏      | 116625/371472 [9:16:57<19:04:24,  3.71it/s]
 31%|███▏      | 116626/371472 [9:16:57<19:36:28,  3.61it/s]
 31%|███▏      | 116627/371472 [9:16:58<20:33:58,  3.44it/s]
 31%|███▏      | 116628/371472 [9:16:58<20:23:56,  3.47it/s]
 31%|███▏      | 116629/371472 [9:16:58<19:58:42,  3.54it/s]
 31%|███▏      | 116630/371472 [9:16:58<20:00:35,  3.54it/s]
 31%|███▏      | 116631/371472 [9:16:59<22:02:08,  3.21it/s]
 31%|███▏      | 116632/371472 [9:16:59<21:26:24,  3.30it/s]
 31%|███▏      | 116633/371472 [9:16:59<21:03:01,  3.36it/s]
 31%|███▏      | 116634/371472 [9:17:00<20:35:03,  3.44it/s]
 31%|███▏      | 116635/371472 [9:17:00<19:51:05,  3.57it/s]
 31%|███▏      | 116636/371472 [9:17:00<20:20:38,  3.48it/s]
 31%|███▏      | 116637/371472 [9:17:01<21:56:13,  3.23it/s]
 31%|███▏      | 116638/371472 [9:17:01<22:39:40,  3.12it/s]
 31%|███▏      | 116639/371472 [9:17:01<22:05:03,  3.21it/s]
 31%|███▏      | 116640/371472 [9:17:02<22:38:10,  3.13it/s]
                                                            
{'loss': 3.4275, 'learning_rate': 7.177379387618781e-07, 'epoch': 5.02}

 31%|███▏      | 116640/371472 [9:17:02<22:38:10,  3.13it/s]
 31%|███▏      | 116641/371472 [9:17:02<21:32:20,  3.29it/s]
 31%|███▏      | 116642/371472 [9:17:02<20:53:09,  3.39it/s]
 31%|███▏      | 116643/371472 [9:17:02<22:04:42,  3.21it/s]
 31%|███▏      | 116644/371472 [9:17:03<22:29:31,  3.15it/s]
 31%|███▏      | 116645/371472 [9:17:03<21:30:38,  3.29it/s]
 31%|███▏      | 116646/371472 [9:17:03<20:34:25,  3.44it/s]
 31%|███▏      | 116647/371472 [9:17:04<20:08:56,  3.51it/s]
 31%|███▏      | 116648/371472 [9:17:04<20:00:44,  3.54it/s]
 31%|███▏      | 116649/371472 [9:17:04<20:02:53,  3.53it/s]
 31%|███▏      | 116650/371472 [9:17:04<20:28:27,  3.46it/s]
 31%|███▏      | 116651/371472 [9:17:05<20:36:40,  3.43it/s]
 31%|███▏      | 116652/371472 [9:17:05<20:06:35,  3.52it/s]
 31%|███▏      | 116653/371472 [9:17:05<19:55:41,  3.55it/s]
 31%|███▏      | 116654/371472 [9:17:06<19:40:33,  3.60it/s]
 31%|███▏      | 116655/371472 [9:17:06<19:01:24,  3.72it/s]
 31%|███▏      | 116656/371472 [9:17:06<20:02:25,  3.53it/s]
 31%|███▏      | 116657/371472 [9:17:06<19:44:23,  3.59it/s]
 31%|███▏      | 116658/371472 [9:17:07<20:05:36,  3.52it/s]
 31%|███▏      | 116659/371472 [9:17:07<20:07:14,  3.52it/s]
 31%|███▏      | 116660/371472 [9:17:07<19:35:41,  3.61it/s]
                                                            
{'loss': 3.2474, 'learning_rate': 7.176894567863992e-07, 'epoch': 5.02}

 31%|███▏      | 116660/371472 [9:17:07<19:35:41,  3.61it/s]
 31%|███▏      | 116661/371472 [9:17:08<19:17:47,  3.67it/s]
 31%|███▏      | 116662/371472 [9:17:08<19:02:57,  3.72it/s]
 31%|███▏      | 116663/371472 [9:17:08<18:49:39,  3.76it/s]
 31%|███▏      | 116664/371472 [9:17:08<20:04:19,  3.53it/s]
 31%|███▏      | 116665/371472 [9:17:09<20:45:37,  3.41it/s]
 31%|███▏      | 116666/371472 [9:17:09<21:40:04,  3.27it/s]
 31%|███▏      | 116667/371472 [9:17:09<21:35:21,  3.28it/s]
 31%|███▏      | 116668/371472 [9:17:10<20:44:37,  3.41it/s]
 31%|███▏      | 116669/371472 [9:17:10<20:39:48,  3.43it/s]
 31%|███▏      | 116670/371472 [9:17:10<21:23:31,  3.31it/s]
 31%|███▏      | 116671/371472 [9:17:10<21:21:12,  3.31it/s]
 31%|███▏      | 116672/371472 [9:17:11<21:54:11,  3.23it/s]
 31%|███▏      | 116673/371472 [9:17:11<21:21:28,  3.31it/s]
 31%|███▏      | 116674/371472 [9:17:11<21:34:51,  3.28it/s]
 31%|███▏      | 116675/371472 [9:17:12<21:31:10,  3.29it/s]
 31%|███▏      | 116676/371472 [9:17:12<23:32:16,  3.01it/s]
 31%|███▏      | 116677/371472 [9:17:13<24:49:52,  2.85it/s]
 31%|███▏      | 116678/371472 [9:17:13<22:47:16,  3.11it/s]
 31%|███▏      | 116679/371472 [9:17:13<21:23:14,  3.31it/s]
 31%|███▏      | 116680/371472 [9:17:13<20:37:02,  3.43it/s]
                                                            
{'loss': 3.1054, 'learning_rate': 7.176409748109202e-07, 'epoch': 5.03}

 31%|███▏      | 116680/371472 [9:17:13<20:37:02,  3.43it/s]
 31%|███▏      | 116681/371472 [9:17:14<21:50:14,  3.24it/s]
 31%|███▏      | 116682/371472 [9:17:14<21:29:02,  3.29it/s]
 31%|███▏      | 116683/371472 [9:17:14<20:44:27,  3.41it/s]
 31%|███▏      | 116684/371472 [9:17:14<20:53:05,  3.39it/s]
 31%|███▏      | 116685/371472 [9:17:15<20:48:13,  3.40it/s]
 31%|███▏      | 116686/371472 [9:17:15<20:04:44,  3.52it/s]
 31%|███▏      | 116687/371472 [9:17:15<19:38:21,  3.60it/s]
 31%|███▏      | 116688/371472 [9:17:16<19:16:02,  3.67it/s]
 31%|███▏      | 116689/371472 [9:17:16<19:26:08,  3.64it/s]
 31%|███▏      | 116690/371472 [9:17:16<19:21:24,  3.66it/s]
 31%|███▏      | 116691/371472 [9:17:16<20:18:27,  3.49it/s]
 31%|███▏      | 116692/371472 [9:17:17<21:04:42,  3.36it/s]
 31%|███▏      | 116693/371472 [9:17:17<20:35:23,  3.44it/s]
 31%|███▏      | 116694/371472 [9:17:17<20:06:23,  3.52it/s]
 31%|███▏      | 116695/371472 [9:17:18<21:13:01,  3.34it/s]
 31%|███▏      | 116696/371472 [9:17:18<21:20:07,  3.32it/s]
 31%|███▏      | 116697/371472 [9:17:18<20:33:38,  3.44it/s]
 31%|███▏      | 116698/371472 [9:17:19<22:00:49,  3.21it/s]
 31%|███▏      | 116699/371472 [9:17:19<20:53:34,  3.39it/s]
 31%|███▏      | 116700/371472 [9:17:19<20:28:10,  3.46it/s]
                                                            
{'loss': 3.2145, 'learning_rate': 7.175924928354414e-07, 'epoch': 5.03}

 31%|███▏      | 116700/371472 [9:17:19<20:28:10,  3.46it/s]
 31%|███▏      | 116701/371472 [9:17:19<20:20:07,  3.48it/s]
 31%|███▏      | 116702/371472 [9:17:20<19:42:01,  3.59it/s]
 31%|███▏      | 116703/371472 [9:17:20<21:13:03,  3.34it/s]
 31%|███▏      | 116704/371472 [9:17:20<21:18:59,  3.32it/s]
 31%|███▏      | 116705/371472 [9:17:21<20:03:04,  3.53it/s]
 31%|███▏      | 116706/371472 [9:17:21<20:22:33,  3.47it/s]
 31%|███▏      | 116707/371472 [9:17:21<19:25:52,  3.64it/s]
 31%|███▏      | 116708/371472 [9:17:21<19:43:24,  3.59it/s]
 31%|███▏      | 116709/371472 [9:17:22<19:34:39,  3.61it/s]
 31%|███▏      | 116710/371472 [9:17:22<19:09:39,  3.69it/s]
 31%|███▏      | 116711/371472 [9:17:22<19:32:32,  3.62it/s]
 31%|███▏      | 116712/371472 [9:17:22<20:10:23,  3.51it/s]
 31%|███▏      | 116713/371472 [9:17:23<20:31:52,  3.45it/s]
 31%|███▏      | 116714/371472 [9:17:23<19:48:10,  3.57it/s]
 31%|███▏      | 116715/371472 [9:17:23<20:01:21,  3.53it/s]
 31%|███▏      | 116716/371472 [9:17:24<19:27:03,  3.64it/s]
 31%|███▏      | 116717/371472 [9:17:24<19:13:48,  3.68it/s]
 31%|███▏      | 116718/371472 [9:17:24<18:44:12,  3.78it/s]
 31%|███▏      | 116719/371472 [9:17:24<19:49:34,  3.57it/s]
 31%|███▏      | 116720/371472 [9:17:25<20:27:35,  3.46it/s]
                                                            
{'loss': 3.3423, 'learning_rate': 7.175440108599625e-07, 'epoch': 5.03}

 31%|███▏      | 116720/371472 [9:17:25<20:27:35,  3.46it/s]
 31%|███▏      | 116721/371472 [9:17:25<20:50:25,  3.40it/s]
 31%|███▏      | 116722/371472 [9:17:25<21:08:06,  3.35it/s]
 31%|███▏      | 116723/371472 [9:17:26<20:32:22,  3.45it/s]
 31%|███▏      | 116724/371472 [9:17:26<21:46:02,  3.25it/s]
 31%|███▏      | 116725/371472 [9:17:26<22:39:48,  3.12it/s]
 31%|███▏      | 116726/371472 [9:17:27<23:17:30,  3.04it/s]
 31%|███▏      | 116727/371472 [9:17:27<22:22:21,  3.16it/s]
 31%|███▏      | 116728/371472 [9:17:27<22:08:02,  3.20it/s]
 31%|███▏      | 116729/371472 [9:17:28<20:56:32,  3.38it/s]
 31%|███▏      | 116730/371472 [9:17:28<20:19:49,  3.48it/s]
 31%|███▏      | 116731/371472 [9:17:28<19:40:47,  3.60it/s]
 31%|███▏      | 116732/371472 [9:17:28<19:16:36,  3.67it/s]
 31%|███▏      | 116733/371472 [9:17:29<19:44:03,  3.59it/s]
 31%|███▏      | 116734/371472 [9:17:29<19:17:45,  3.67it/s]
 31%|███▏      | 116735/371472 [9:17:29<21:21:09,  3.31it/s]
 31%|███▏      | 116736/371472 [9:17:29<20:41:16,  3.42it/s]
 31%|███▏      | 116737/371472 [9:17:30<19:58:20,  3.54it/s]
 31%|███▏      | 116738/371472 [9:17:30<20:04:17,  3.53it/s]
 31%|███▏      | 116739/371472 [9:17:30<19:39:15,  3.60it/s]
 31%|███▏      | 116740/371472 [9:17:31<19:25:54,  3.64it/s]
                                                            
{'loss': 3.2361, 'learning_rate': 7.174955288844835e-07, 'epoch': 5.03}

 31%|███▏      | 116740/371472 [9:17:31<19:25:54,  3.64it/s]
 31%|███▏      | 116741/371472 [9:17:31<19:21:49,  3.65it/s]
 31%|███▏      | 116742/371472 [9:17:31<18:55:05,  3.74it/s]
 31%|███▏      | 116743/371472 [9:17:31<18:41:24,  3.79it/s]
 31%|███▏      | 116744/371472 [9:17:32<18:22:08,  3.85it/s]
 31%|███▏      | 116745/371472 [9:17:32<18:07:46,  3.90it/s]
 31%|███▏      | 116746/371472 [9:17:32<18:22:43,  3.85it/s]
 31%|███▏      | 116747/371472 [9:17:32<18:28:12,  3.83it/s]
 31%|███▏      | 116748/371472 [9:17:33<18:45:34,  3.77it/s]
 31%|███▏      | 116749/371472 [9:17:33<18:21:50,  3.85it/s]
 31%|███▏      | 116750/371472 [9:17:33<18:39:27,  3.79it/s]
 31%|███▏      | 116751/371472 [9:17:33<18:32:14,  3.82it/s]
 31%|███▏      | 116752/371472 [9:17:34<20:01:47,  3.53it/s]
 31%|███▏      | 116753/371472 [9:17:34<20:03:59,  3.53it/s]
 31%|███▏      | 116754/371472 [9:17:34<19:37:44,  3.60it/s]
 31%|███▏      | 116755/371472 [9:17:35<18:51:32,  3.75it/s]
 31%|███▏      | 116756/371472 [9:17:35<20:14:29,  3.50it/s]
 31%|███▏      | 116757/371472 [9:17:35<21:39:32,  3.27it/s]
 31%|███▏      | 116758/371472 [9:17:35<20:33:49,  3.44it/s]
 31%|███▏      | 116759/371472 [9:17:36<19:40:03,  3.60it/s]
 31%|███▏      | 116760/371472 [9:17:36<21:07:29,  3.35it/s]
                                                            
{'loss': 3.3735, 'learning_rate': 7.174470469090047e-07, 'epoch': 5.03}

 31%|███▏      | 116760/371472 [9:17:36<21:07:29,  3.35it/s]
 31%|███▏      | 116761/371472 [9:17:36<21:13:38,  3.33it/s]
 31%|███▏      | 116762/371472 [9:17:37<20:48:47,  3.40it/s]
 31%|███▏      | 116763/371472 [9:17:37<20:31:25,  3.45it/s]
 31%|███▏      | 116764/371472 [9:17:37<19:55:49,  3.55it/s]
 31%|███▏      | 116765/371472 [9:17:38<22:29:55,  3.14it/s]
 31%|███▏      | 116766/371472 [9:17:38<21:51:19,  3.24it/s]
 31%|███▏      | 116767/371472 [9:17:38<20:45:25,  3.41it/s]
 31%|███▏      | 116768/371472 [9:17:38<19:57:54,  3.54it/s]
 31%|███▏      | 116769/371472 [9:17:39<19:17:23,  3.67it/s]
 31%|███▏      | 116770/371472 [9:17:39<19:04:30,  3.71it/s]
 31%|███▏      | 116771/371472 [9:17:39<18:38:58,  3.79it/s]
 31%|███▏      | 116772/371472 [9:17:39<18:38:37,  3.79it/s]
 31%|███▏      | 116773/371472 [9:17:40<18:40:07,  3.79it/s]
 31%|███▏      | 116774/371472 [9:17:40<19:29:07,  3.63it/s]
 31%|███▏      | 116775/371472 [9:17:40<19:06:16,  3.70it/s]
 31%|███▏      | 116776/371472 [9:17:41<21:01:09,  3.37it/s]
 31%|███▏      | 116777/371472 [9:17:41<20:13:27,  3.50it/s]
 31%|███▏      | 116778/371472 [9:17:41<19:44:34,  3.58it/s]
 31%|███▏      | 116779/371472 [9:17:41<20:08:24,  3.51it/s]
 31%|███▏      | 116780/371472 [9:17:42<20:02:46,  3.53it/s]
                                                            
{'loss': 3.3189, 'learning_rate': 7.173985649335259e-07, 'epoch': 5.03}

 31%|███▏      | 116780/371472 [9:17:42<20:02:46,  3.53it/s]
 31%|███▏      | 116781/371472 [9:17:42<20:48:23,  3.40it/s]
 31%|███▏      | 116782/371472 [9:17:42<19:58:43,  3.54it/s]
 31%|███▏      | 116783/371472 [9:17:43<20:06:30,  3.52it/s]
 31%|███▏      | 116784/371472 [9:17:43<20:21:22,  3.48it/s]
 31%|███▏      | 116785/371472 [9:17:43<19:42:05,  3.59it/s]
 31%|███▏      | 116786/371472 [9:17:43<19:37:39,  3.60it/s]
 31%|███▏      | 116787/371472 [9:17:44<20:06:10,  3.52it/s]
 31%|███▏      | 116788/371472 [9:17:44<21:03:55,  3.36it/s]
 31%|███▏      | 116789/371472 [9:17:44<20:15:29,  3.49it/s]
 31%|███▏      | 116790/371472 [9:17:45<19:44:50,  3.58it/s]
 31%|███▏      | 116791/371472 [9:17:45<19:17:35,  3.67it/s]
 31%|███▏      | 116792/371472 [9:17:45<18:59:56,  3.72it/s]
 31%|███▏      | 116793/371472 [9:17:45<20:02:03,  3.53it/s]
 31%|███▏      | 116794/371472 [9:17:46<19:58:23,  3.54it/s]
 31%|███▏      | 116795/371472 [9:17:46<20:41:41,  3.42it/s]
 31%|███▏      | 116796/371472 [9:17:46<20:31:15,  3.45it/s]
 31%|███▏      | 116797/371472 [9:17:47<19:45:15,  3.58it/s]
 31%|███▏      | 116798/371472 [9:17:47<19:12:22,  3.68it/s]
 31%|███▏      | 116799/371472 [9:17:47<19:44:15,  3.58it/s]
 31%|███▏      | 116800/371472 [9:17:47<20:03:50,  3.53it/s]
                                                            
{'loss': 3.1903, 'learning_rate': 7.17350082958047e-07, 'epoch': 5.03}

 31%|███▏      | 116800/371472 [9:17:47<20:03:50,  3.53it/s]
 31%|███▏      | 116801/371472 [9:17:48<20:59:32,  3.37it/s]
 31%|███▏      | 116802/371472 [9:17:48<19:52:56,  3.56it/s]
 31%|███▏      | 116803/371472 [9:17:48<21:12:23,  3.34it/s]
 31%|███▏      | 116804/371472 [9:17:49<20:21:21,  3.48it/s]
 31%|███▏      | 116805/371472 [9:17:49<19:21:04,  3.66it/s]
 31%|███▏      | 116806/371472 [9:17:49<19:46:56,  3.58it/s]
 31%|███▏      | 116807/371472 [9:17:49<19:52:46,  3.56it/s]
 31%|███▏      | 116808/371472 [9:17:50<20:38:41,  3.43it/s]
 31%|███▏      | 116809/371472 [9:17:50<19:56:41,  3.55it/s]
 31%|███▏      | 116810/371472 [9:17:50<19:52:22,  3.56it/s]
 31%|███▏      | 116811/371472 [9:17:51<20:41:23,  3.42it/s]
 31%|███▏      | 116812/371472 [9:17:51<21:22:46,  3.31it/s]
 31%|███▏      | 116813/371472 [9:17:51<20:17:45,  3.49it/s]
 31%|███▏      | 116814/371472 [9:17:51<21:16:46,  3.32it/s]
 31%|███▏      | 116815/371472 [9:17:52<21:12:55,  3.33it/s]
 31%|███▏      | 116816/371472 [9:17:52<21:38:36,  3.27it/s]
 31%|███▏      | 116817/371472 [9:17:52<22:19:07,  3.17it/s]
 31%|███▏      | 116818/371472 [9:17:53<22:44:47,  3.11it/s]
 31%|███▏      | 116819/371472 [9:17:53<22:04:26,  3.20it/s]
 31%|███▏      | 116820/371472 [9:17:53<21:05:45,  3.35it/s]
                                                            
{'loss': 3.4081, 'learning_rate': 7.173016009825679e-07, 'epoch': 5.03}

 31%|███▏      | 116820/371472 [9:17:53<21:05:45,  3.35it/s]
 31%|███▏      | 116821/371472 [9:17:54<20:45:24,  3.41it/s]
 31%|███▏      | 116822/371472 [9:17:54<20:11:28,  3.50it/s]
 31%|███▏      | 116823/371472 [9:17:54<20:30:07,  3.45it/s]
 31%|███▏      | 116824/371472 [9:17:55<21:46:55,  3.25it/s]
 31%|███▏      | 116825/371472 [9:17:55<21:05:54,  3.35it/s]
 31%|███▏      | 116826/371472 [9:17:55<20:46:46,  3.40it/s]
 31%|███▏      | 116827/371472 [9:17:55<19:59:43,  3.54it/s]
 31%|███▏      | 116828/371472 [9:17:56<19:51:25,  3.56it/s]
 31%|███▏      | 116829/371472 [9:17:56<20:01:03,  3.53it/s]
 31%|███▏      | 116830/371472 [9:17:56<19:37:02,  3.61it/s]
 31%|███▏      | 116831/371472 [9:17:56<19:48:28,  3.57it/s]
 31%|███▏      | 116832/371472 [9:17:57<21:25:15,  3.30it/s]
 31%|███▏      | 116833/371472 [9:17:57<22:00:07,  3.21it/s]
 31%|███▏      | 116834/371472 [9:17:57<22:14:58,  3.18it/s]
 31%|███▏      | 116835/371472 [9:17:58<23:53:29,  2.96it/s]
 31%|███▏      | 116836/371472 [9:17:58<24:04:50,  2.94it/s]
 31%|███▏      | 116837/371472 [9:17:58<22:23:43,  3.16it/s]
 31%|███▏      | 116838/371472 [9:17:59<20:55:49,  3.38it/s]
 31%|███▏      | 116839/371472 [9:17:59<20:18:11,  3.48it/s]
 31%|███▏      | 116840/371472 [9:17:59<19:31:27,  3.62it/s]
                                                            
{'loss': 3.3324, 'learning_rate': 7.172531190070891e-07, 'epoch': 5.03}

 31%|███▏      | 116840/371472 [9:17:59<19:31:27,  3.62it/s]
 31%|███▏      | 116841/371472 [9:18:00<20:13:19,  3.50it/s]
 31%|███▏      | 116842/371472 [9:18:00<20:09:02,  3.51it/s]
 31%|███▏      | 116843/371472 [9:18:00<20:40:12,  3.42it/s]
 31%|███▏      | 116844/371472 [9:18:00<20:15:07,  3.49it/s]
 31%|███▏      | 116845/371472 [9:18:01<19:44:04,  3.58it/s]
 31%|███▏      | 116846/371472 [9:18:01<19:38:59,  3.60it/s]
 31%|███▏      | 116847/371472 [9:18:01<19:35:50,  3.61it/s]
 31%|███▏      | 116848/371472 [9:18:01<19:35:20,  3.61it/s]
 31%|███▏      | 116849/371472 [9:18:02<19:51:05,  3.56it/s]
 31%|███▏      | 116850/371472 [9:18:02<21:02:20,  3.36it/s]
 31%|███▏      | 116851/371472 [9:18:02<20:58:06,  3.37it/s]
 31%|███▏      | 116852/371472 [9:18:03<20:44:50,  3.41it/s]
 31%|███▏      | 116853/371472 [9:18:03<20:10:18,  3.51it/s]
 31%|███▏      | 116854/371472 [9:18:03<19:53:05,  3.56it/s]
 31%|███▏      | 116855/371472 [9:18:03<19:11:04,  3.69it/s]
 31%|███▏      | 116856/371472 [9:18:04<19:05:19,  3.71it/s]
 31%|███▏      | 116857/371472 [9:18:04<19:39:48,  3.60it/s]
 31%|███▏      | 116858/371472 [9:18:04<18:58:54,  3.73it/s]
 31%|███▏      | 116859/371472 [9:18:05<19:07:20,  3.70it/s]
 31%|███▏      | 116860/371472 [9:18:05<20:21:14,  3.47it/s]
                                                            
{'loss': 3.2918, 'learning_rate': 7.172046370316102e-07, 'epoch': 5.03}

 31%|███▏      | 116860/371472 [9:18:05<20:21:14,  3.47it/s]
 31%|███▏      | 116861/371472 [9:18:05<20:07:13,  3.52it/s]
 31%|███▏      | 116862/371472 [9:18:05<20:35:45,  3.43it/s]
 31%|███▏      | 116863/371472 [9:18:06<20:23:53,  3.47it/s]
 31%|███▏      | 116864/371472 [9:18:06<19:58:56,  3.54it/s]
 31%|███▏      | 116865/371472 [9:18:06<19:14:44,  3.67it/s]
 31%|███▏      | 116866/371472 [9:18:07<18:45:52,  3.77it/s]
 31%|███▏      | 116867/371472 [9:18:07<19:34:27,  3.61it/s]
 31%|███▏      | 116868/371472 [9:18:07<19:22:24,  3.65it/s]
 31%|███▏      | 116869/371472 [9:18:07<21:08:31,  3.35it/s]
 31%|███▏      | 116870/371472 [9:18:08<20:35:46,  3.43it/s]
 31%|███▏      | 116871/371472 [9:18:08<21:27:00,  3.30it/s]
 31%|███▏      | 116872/371472 [9:18:08<22:03:53,  3.21it/s]
 31%|███▏      | 116873/371472 [9:18:09<20:37:26,  3.43it/s]
 31%|███▏      | 116874/371472 [9:18:09<20:04:58,  3.52it/s]
 31%|███▏      | 116875/371472 [9:18:09<21:04:00,  3.36it/s]
 31%|███▏      | 116876/371472 [9:18:10<21:19:52,  3.32it/s]
 31%|███▏      | 116877/371472 [9:18:10<20:37:33,  3.43it/s]
 31%|███▏      | 116878/371472 [9:18:10<19:51:35,  3.56it/s]
 31%|███▏      | 116879/371472 [9:18:10<19:41:43,  3.59it/s]
 31%|███▏      | 116880/371472 [9:18:11<19:25:52,  3.64it/s]
                                                            
{'loss': 3.4805, 'learning_rate': 7.171561550561313e-07, 'epoch': 5.03}

 31%|███▏      | 116880/371472 [9:18:11<19:25:52,  3.64it/s]
 31%|███▏      | 116881/371472 [9:18:11<20:04:44,  3.52it/s]
 31%|███▏      | 116882/371472 [9:18:11<20:12:41,  3.50it/s]
 31%|███▏      | 116883/371472 [9:18:11<19:44:04,  3.58it/s]
 31%|███▏      | 116884/371472 [9:18:12<20:07:41,  3.51it/s]
 31%|███▏      | 116885/371472 [9:18:12<20:00:09,  3.54it/s]
 31%|███▏      | 116886/371472 [9:18:12<20:02:41,  3.53it/s]
 31%|███▏      | 116887/371472 [9:18:13<19:29:45,  3.63it/s]
 31%|███▏      | 116888/371472 [9:18:13<19:06:22,  3.70it/s]
 31%|███▏      | 116889/371472 [9:18:13<19:14:44,  3.67it/s]
 31%|███▏      | 116890/371472 [9:18:13<19:15:17,  3.67it/s]
 31%|███▏      | 116891/371472 [9:18:14<20:34:58,  3.44it/s]
 31%|███▏      | 116892/371472 [9:18:14<19:50:35,  3.56it/s]
 31%|███▏      | 116893/371472 [9:18:14<19:18:20,  3.66it/s]
 31%|███▏      | 116894/371472 [9:18:14<18:43:13,  3.78it/s]
 31%|███▏      | 116895/371472 [9:18:15<18:35:06,  3.80it/s]
 31%|███▏      | 116896/371472 [9:18:15<18:49:04,  3.76it/s]
 31%|███▏      | 116897/371472 [9:18:15<19:28:55,  3.63it/s]
 31%|███▏      | 116898/371472 [9:18:16<19:16:38,  3.67it/s]
 31%|███▏      | 116899/371472 [9:18:16<18:50:23,  3.75it/s]
 31%|███▏      | 116900/371472 [9:18:16<19:01:20,  3.72it/s]
                                                            
{'loss': 3.1995, 'learning_rate': 7.171076730806524e-07, 'epoch': 5.04}

 31%|███▏      | 116900/371472 [9:18:16<19:01:20,  3.72it/s]
 31%|███▏      | 116901/371472 [9:18:16<19:28:51,  3.63it/s]
 31%|███▏      | 116902/371472 [9:18:17<18:45:44,  3.77it/s]
 31%|███▏      | 116903/371472 [9:18:17<19:05:01,  3.71it/s]
 31%|███▏      | 116904/371472 [9:18:17<19:57:18,  3.54it/s]
 31%|███▏      | 116905/371472 [9:18:17<19:49:47,  3.57it/s]
 31%|███▏      | 116906/371472 [9:18:18<19:29:53,  3.63it/s]
 31%|███▏      | 116907/371472 [9:18:18<19:15:51,  3.67it/s]
 31%|███▏      | 116908/371472 [9:18:18<19:32:53,  3.62it/s]
 31%|███▏      | 116909/371472 [9:18:19<19:59:10,  3.54it/s]
 31%|███▏      | 116910/371472 [9:18:19<20:53:26,  3.38it/s]
 31%|███▏      | 116911/371472 [9:18:19<21:40:04,  3.26it/s]
 31%|███▏      | 116912/371472 [9:18:20<20:31:10,  3.45it/s]
 31%|███▏      | 116913/371472 [9:18:20<19:45:04,  3.58it/s]
 31%|███▏      | 116914/371472 [9:18:20<19:12:29,  3.68it/s]
 31%|███▏      | 116915/371472 [9:18:20<18:52:38,  3.75it/s]
 31%|███▏      | 116916/371472 [9:18:21<22:00:35,  3.21it/s]
 31%|███▏      | 116917/371472 [9:18:21<21:21:46,  3.31it/s]
 31%|███▏      | 116918/371472 [9:18:21<20:48:10,  3.40it/s]
 31%|███▏      | 116919/371472 [9:18:22<20:38:24,  3.43it/s]
 31%|███▏      | 116920/371472 [9:18:22<21:08:26,  3.34it/s]
                                                            
{'loss': 3.4255, 'learning_rate': 7.170591911051736e-07, 'epoch': 5.04}

 31%|███▏      | 116920/371472 [9:18:22<21:08:26,  3.34it/s]
 31%|███▏      | 116921/371472 [9:18:22<20:38:18,  3.43it/s]
 31%|███▏      | 116922/371472 [9:18:22<21:18:37,  3.32it/s]
 31%|███▏      | 116923/371472 [9:18:23<21:56:56,  3.22it/s]
 31%|███▏      | 116924/371472 [9:18:23<21:49:31,  3.24it/s]
 31%|███▏      | 116925/371472 [9:18:23<20:43:26,  3.41it/s]
 31%|███▏      | 116926/371472 [9:18:24<20:57:58,  3.37it/s]
 31%|███▏      | 116927/371472 [9:18:24<20:51:49,  3.39it/s]
 31%|███▏      | 116928/371472 [9:18:24<20:07:58,  3.51it/s]
 31%|███▏      | 116929/371472 [9:18:24<19:59:40,  3.54it/s]
 31%|███▏      | 116930/371472 [9:18:25<20:34:15,  3.44it/s]
 31%|███▏      | 116931/371472 [9:18:25<20:57:26,  3.37it/s]
 31%|███▏      | 116932/371472 [9:18:25<20:32:04,  3.44it/s]
 31%|███▏      | 116933/371472 [9:18:26<21:33:01,  3.28it/s]
 31%|███▏      | 116934/371472 [9:18:26<20:19:09,  3.48it/s]
 31%|███▏      | 116935/371472 [9:18:26<22:10:44,  3.19it/s]
 31%|███▏      | 116936/371472 [9:18:27<20:46:32,  3.40it/s]
 31%|███▏      | 116937/371472 [9:18:27<20:57:39,  3.37it/s]
 31%|███▏      | 116938/371472 [9:18:27<19:58:04,  3.54it/s]
 31%|███▏      | 116939/371472 [9:18:27<19:05:05,  3.70it/s]
 31%|███▏      | 116940/371472 [9:18:28<19:50:00,  3.56it/s]
                                                            
{'loss': 3.0694, 'learning_rate': 7.170107091296945e-07, 'epoch': 5.04}

 31%|███▏      | 116940/371472 [9:18:28<19:50:00,  3.56it/s]
 31%|███▏      | 116941/371472 [9:18:28<19:40:39,  3.59it/s]
 31%|███▏      | 116942/371472 [9:18:28<20:40:30,  3.42it/s]
 31%|███▏      | 116943/371472 [9:18:29<20:51:48,  3.39it/s]
 31%|███▏      | 116944/371472 [9:18:29<21:19:02,  3.32it/s]
 31%|███▏      | 116945/371472 [9:18:29<22:54:18,  3.09it/s]
 31%|███▏      | 116946/371472 [9:18:30<21:48:19,  3.24it/s]
 31%|███▏      | 116947/371472 [9:18:30<20:40:22,  3.42it/s]
 31%|███▏      | 116948/371472 [9:18:30<20:40:42,  3.42it/s]
 31%|███▏      | 116949/371472 [9:18:30<20:12:37,  3.50it/s]
 31%|███▏      | 116950/371472 [9:18:31<19:43:11,  3.59it/s]
 31%|███▏      | 116951/371472 [9:18:31<19:31:09,  3.62it/s]
 31%|███▏      | 116952/371472 [9:18:31<19:18:54,  3.66it/s]
 31%|███▏      | 116953/371472 [9:18:31<19:15:30,  3.67it/s]
 31%|███▏      | 116954/371472 [9:18:32<19:12:23,  3.68it/s]
 31%|███▏      | 116955/371472 [9:18:32<19:01:51,  3.71it/s]
 31%|███▏      | 116956/371472 [9:18:32<18:53:07,  3.74it/s]
 31%|███▏      | 116957/371472 [9:18:33<19:45:58,  3.58it/s]
 31%|███▏      | 116958/371472 [9:18:33<19:49:56,  3.56it/s]
 31%|███▏      | 116959/371472 [9:18:33<20:07:36,  3.51it/s]
 31%|███▏      | 116960/371472 [9:18:33<19:34:59,  3.61it/s]
                                                            
{'loss': 3.4009, 'learning_rate': 7.169622271542157e-07, 'epoch': 5.04}

 31%|███▏      | 116960/371472 [9:18:33<19:34:59,  3.61it/s]
 31%|███▏      | 116961/371472 [9:18:34<19:54:16,  3.55it/s]
 31%|███▏      | 116962/371472 [9:18:34<19:25:22,  3.64it/s]
 31%|███▏      | 116963/371472 [9:18:34<20:01:26,  3.53it/s]
 31%|███▏      | 116964/371472 [9:18:34<19:35:33,  3.61it/s]
 31%|███▏      | 116965/371472 [9:18:35<19:04:50,  3.71it/s]
 31%|███▏      | 116966/371472 [9:18:35<19:57:00,  3.54it/s]
 31%|███▏      | 116967/371472 [9:18:35<21:26:56,  3.30it/s]
 31%|███▏      | 116968/371472 [9:18:36<20:31:21,  3.44it/s]
 31%|███▏      | 116969/371472 [9:18:36<20:22:02,  3.47it/s]
 31%|███▏      | 116970/371472 [9:18:36<20:25:45,  3.46it/s]
 31%|███▏      | 116971/371472 [9:18:36<19:48:36,  3.57it/s]
 31%|███▏      | 116972/371472 [9:18:37<19:27:14,  3.63it/s]
 31%|███▏      | 116973/371472 [9:18:37<20:42:02,  3.42it/s]
 31%|███▏      | 116974/371472 [9:18:37<20:32:15,  3.44it/s]
 31%|███▏      | 116975/371472 [9:18:38<19:17:31,  3.66it/s]
 31%|███▏      | 116976/371472 [9:18:38<19:01:26,  3.72it/s]
 31%|███▏      | 116977/371472 [9:18:38<18:49:45,  3.75it/s]
 31%|███▏      | 116978/371472 [9:18:38<20:32:12,  3.44it/s]
 31%|███▏      | 116979/371472 [9:18:39<20:07:47,  3.51it/s]
 31%|███▏      | 116980/371472 [9:18:39<19:38:09,  3.60it/s]
                                                            
{'loss': 3.3476, 'learning_rate': 7.169137451787368e-07, 'epoch': 5.04}

 31%|███▏      | 116980/371472 [9:18:39<19:38:09,  3.60it/s]
 31%|███▏      | 116981/371472 [9:18:39<20:59:04,  3.37it/s]
 31%|███▏      | 116982/371472 [9:18:40<20:30:18,  3.45it/s]
 31%|███▏      | 116983/371472 [9:18:40<20:55:02,  3.38it/s]
 31%|███▏      | 116984/371472 [9:18:40<20:19:51,  3.48it/s]
 31%|███▏      | 116985/371472 [9:18:41<21:54:10,  3.23it/s]
 31%|███▏      | 116986/371472 [9:18:41<20:46:24,  3.40it/s]
 31%|███▏      | 116987/371472 [9:18:41<20:17:05,  3.48it/s]
 31%|███▏      | 116988/371472 [9:18:41<20:29:46,  3.45it/s]
 31%|███▏      | 116989/371472 [9:18:42<20:21:14,  3.47it/s]
 31%|███▏      | 116990/371472 [9:18:42<20:11:03,  3.50it/s]
 31%|███▏      | 116991/371472 [9:18:42<20:58:02,  3.37it/s]
 31%|███▏      | 116992/371472 [9:18:43<20:08:48,  3.51it/s]
 31%|███▏      | 116993/371472 [9:18:43<20:06:51,  3.51it/s]
 31%|███▏      | 116994/371472 [9:18:43<19:49:21,  3.57it/s]
 31%|███▏      | 116995/371472 [9:18:43<19:07:12,  3.70it/s]
 31%|███▏      | 116996/371472 [9:18:44<18:35:56,  3.80it/s]
 31%|███▏      | 116997/371472 [9:18:44<18:35:08,  3.80it/s]
 31%|███▏      | 116998/371472 [9:18:44<19:06:55,  3.70it/s]
 31%|███▏      | 116999/371472 [9:18:44<18:43:48,  3.77it/s]
 31%|███▏      | 117000/371472 [9:18:45<18:39:09,  3.79it/s]
                                                            
{'loss': 3.2149, 'learning_rate': 7.16865263203258e-07, 'epoch': 5.04}

 31%|███▏      | 117000/371472 [9:18:45<18:39:09,  3.79it/s]
 31%|███▏      | 117001/371472 [9:18:45<18:39:53,  3.79it/s]
 31%|███▏      | 117002/371472 [9:18:45<18:54:11,  3.74it/s]
 31%|███▏      | 117003/371472 [9:18:45<18:59:26,  3.72it/s]
 31%|███▏      | 117004/371472 [9:18:46<18:54:48,  3.74it/s]
 31%|███▏      | 117005/371472 [9:18:46<22:04:00,  3.20it/s]
 31%|███▏      | 117006/371472 [9:18:46<20:40:05,  3.42it/s]
 31%|███▏      | 117007/371472 [9:18:47<20:12:13,  3.50it/s]
 31%|███▏      | 117008/371472 [9:18:47<19:37:19,  3.60it/s]
 31%|███▏      | 117009/371472 [9:18:47<19:08:47,  3.69it/s]
 31%|███▏      | 117010/371472 [9:18:48<25:28:44,  2.77it/s]
 31%|███▏      | 117011/371472 [9:18:48<23:56:56,  2.95it/s]
 31%|███▏      | 117012/371472 [9:18:48<22:46:25,  3.10it/s]
 31%|███▏      | 117013/371472 [9:18:49<21:38:27,  3.27it/s]
 32%|███▏      | 117014/371472 [9:18:49<20:35:56,  3.43it/s]
 32%|███▏      | 117015/371472 [9:18:49<21:39:22,  3.26it/s]
 32%|███▏      | 117016/371472 [9:18:49<21:21:46,  3.31it/s]
 32%|███▏      | 117017/371472 [9:18:50<20:54:42,  3.38it/s]
 32%|███▏      | 117018/371472 [9:18:50<20:50:37,  3.39it/s]
 32%|███▏      | 117019/371472 [9:18:50<19:48:29,  3.57it/s]
 32%|███▏      | 117020/371472 [9:18:51<19:36:48,  3.60it/s]
                                                            
{'loss': 3.2856, 'learning_rate': 7.168167812277791e-07, 'epoch': 5.04}

 32%|███▏      | 117020/371472 [9:18:51<19:36:48,  3.60it/s]
 32%|███▏      | 117021/371472 [9:18:51<19:00:15,  3.72it/s]
 32%|███▏      | 117022/371472 [9:18:51<18:52:26,  3.74it/s]
 32%|███▏      | 117023/371472 [9:18:51<19:58:26,  3.54it/s]
 32%|███▏      | 117024/371472 [9:18:52<19:31:47,  3.62it/s]
 32%|███▏      | 117025/371472 [9:18:52<18:49:58,  3.75it/s]
 32%|███▏      | 117026/371472 [9:18:52<18:40:49,  3.78it/s]
 32%|███▏      | 117027/371472 [9:18:52<18:47:20,  3.76it/s]
 32%|███▏      | 117028/371472 [9:18:53<18:57:58,  3.73it/s]
 32%|███▏      | 117029/371472 [9:18:53<19:38:58,  3.60it/s]
 32%|███▏      | 117030/371472 [9:18:53<19:49:11,  3.57it/s]
 32%|███▏      | 117031/371472 [9:18:54<18:53:59,  3.74it/s]
 32%|███▏      | 117032/371472 [9:18:54<18:32:05,  3.81it/s]
 32%|███▏      | 117033/371472 [9:18:54<19:53:37,  3.55it/s]
 32%|███▏      | 117034/371472 [9:18:54<19:13:36,  3.68it/s]
 32%|███▏      | 117035/371472 [9:18:55<19:17:41,  3.66it/s]
 32%|███▏      | 117036/371472 [9:18:55<19:32:40,  3.62it/s]
 32%|███▏      | 117037/371472 [9:18:55<19:16:51,  3.67it/s]
 32%|███▏      | 117038/371472 [9:18:56<20:34:00,  3.44it/s]
 32%|███▏      | 117039/371472 [9:18:56<21:11:16,  3.34it/s]
 32%|███▏      | 117040/371472 [9:18:56<20:31:40,  3.44it/s]
                                                            
{'loss': 3.4699, 'learning_rate': 7.167682992523003e-07, 'epoch': 5.04}

 32%|███▏      | 117040/371472 [9:18:56<20:31:40,  3.44it/s]
 32%|███▏      | 117041/371472 [9:18:56<21:16:28,  3.32it/s]
 32%|███▏      | 117042/371472 [9:18:57<21:18:25,  3.32it/s]
 32%|███▏      | 117043/371472 [9:18:57<21:14:43,  3.33it/s]
 32%|███▏      | 117044/371472 [9:18:57<21:04:59,  3.35it/s]
 32%|███▏      | 117045/371472 [9:18:58<21:32:37,  3.28it/s]
 32%|███▏      | 117046/371472 [9:18:58<20:12:32,  3.50it/s]
 32%|███▏      | 117047/371472 [9:18:58<19:53:51,  3.55it/s]
 32%|███▏      | 117048/371472 [9:18:58<20:26:17,  3.46it/s]
 32%|███▏      | 117049/371472 [9:18:59<20:39:56,  3.42it/s]
 32%|███▏      | 117050/371472 [9:18:59<21:26:58,  3.29it/s]
 32%|███▏      | 117051/371472 [9:18:59<21:23:25,  3.30it/s]
 32%|███▏      | 117052/371472 [9:19:00<21:12:23,  3.33it/s]
 32%|███▏      | 117053/371472 [9:19:00<20:39:52,  3.42it/s]
 32%|███▏      | 117054/371472 [9:19:00<20:37:40,  3.43it/s]
 32%|███▏      | 117055/371472 [9:19:01<20:58:03,  3.37it/s]
 32%|███▏      | 117056/371472 [9:19:01<20:52:41,  3.38it/s]
 32%|███▏      | 117057/371472 [9:19:01<22:16:12,  3.17it/s]
 32%|███▏      | 117058/371472 [9:19:02<21:54:51,  3.22it/s]
 32%|███▏      | 117059/371472 [9:19:02<20:47:45,  3.40it/s]
 32%|███▏      | 117060/371472 [9:19:02<20:36:08,  3.43it/s]
                                                            
{'loss': 3.3669, 'learning_rate': 7.167198172768212e-07, 'epoch': 5.04}

 32%|███▏      | 117060/371472 [9:19:02<20:36:08,  3.43it/s]
 32%|███▏      | 117061/371472 [9:19:02<20:15:06,  3.49it/s]
 32%|███▏      | 117062/371472 [9:19:03<21:08:22,  3.34it/s]
 32%|███▏      | 117063/371472 [9:19:03<20:36:01,  3.43it/s]
 32%|███▏      | 117064/371472 [9:19:03<20:26:30,  3.46it/s]
 32%|███▏      | 117065/371472 [9:19:03<20:01:12,  3.53it/s]
 32%|███▏      | 117066/371472 [9:19:04<20:20:41,  3.47it/s]
 32%|███▏      | 117067/371472 [9:19:04<19:49:26,  3.56it/s]
 32%|███▏      | 117068/371472 [9:19:04<19:22:00,  3.65it/s]
 32%|███▏      | 117069/371472 [9:19:05<20:25:13,  3.46it/s]
 32%|███▏      | 117070/371472 [9:19:05<20:05:52,  3.52it/s]
 32%|███▏      | 117071/371472 [9:19:05<19:56:45,  3.54it/s]
 32%|███▏      | 117072/371472 [9:19:05<19:08:02,  3.69it/s]
 32%|███▏      | 117073/371472 [9:19:06<18:37:09,  3.80it/s]
 32%|███▏      | 117074/371472 [9:19:06<19:30:01,  3.62it/s]
 32%|███▏      | 117075/371472 [9:19:06<18:58:57,  3.72it/s]
 32%|███▏      | 117076/371472 [9:19:07<20:48:38,  3.40it/s]
 32%|███▏      | 117077/371472 [9:19:07<20:32:39,  3.44it/s]
 32%|███▏      | 117078/371472 [9:19:07<19:32:47,  3.62it/s]
 32%|███▏      | 117079/371472 [9:19:07<19:38:42,  3.60it/s]
 32%|███▏      | 117080/371472 [9:19:08<18:48:58,  3.76it/s]
                                                            
{'loss': 3.2544, 'learning_rate': 7.166713353013424e-07, 'epoch': 5.04}

 32%|███▏      | 117080/371472 [9:19:08<18:48:58,  3.76it/s]
 32%|███▏      | 117081/371472 [9:19:08<18:56:51,  3.73it/s]
 32%|███▏      | 117082/371472 [9:19:08<18:45:02,  3.77it/s]
 32%|███▏      | 117083/371472 [9:19:08<19:28:19,  3.63it/s]
 32%|███▏      | 117084/371472 [9:19:09<20:07:17,  3.51it/s]
 32%|███▏      | 117085/371472 [9:19:09<20:37:53,  3.42it/s]
 32%|███▏      | 117086/371472 [9:19:09<19:57:40,  3.54it/s]
 32%|███▏      | 117087/371472 [9:19:10<20:03:43,  3.52it/s]
 32%|███▏      | 117088/371472 [9:19:10<20:42:12,  3.41it/s]
 32%|███▏      | 117089/371472 [9:19:10<21:08:13,  3.34it/s]
 32%|███▏      | 117090/371472 [9:19:11<20:56:53,  3.37it/s]
 32%|███▏      | 117091/371472 [9:19:11<20:13:11,  3.49it/s]
 32%|███▏      | 117092/371472 [9:19:11<19:22:29,  3.65it/s]
 32%|███▏      | 117093/371472 [9:19:11<19:01:37,  3.71it/s]
 32%|███▏      | 117094/371472 [9:19:12<20:02:04,  3.53it/s]
 32%|███▏      | 117095/371472 [9:19:12<19:59:10,  3.54it/s]
 32%|███▏      | 117096/371472 [9:19:12<19:41:27,  3.59it/s]
 32%|███▏      | 117097/371472 [9:19:12<19:36:52,  3.60it/s]
 32%|███▏      | 117098/371472 [9:19:13<19:34:40,  3.61it/s]
 32%|███▏      | 117099/371472 [9:19:13<19:00:33,  3.72it/s]
 32%|███▏      | 117100/371472 [9:19:13<19:06:50,  3.70it/s]
                                                            
{'loss': 3.4742, 'learning_rate': 7.166228533258635e-07, 'epoch': 5.04}

 32%|███▏      | 117100/371472 [9:19:13<19:06:50,  3.70it/s]
 32%|███▏      | 117101/371472 [9:19:14<19:40:31,  3.59it/s]
 32%|███▏      | 117102/371472 [9:19:14<19:27:20,  3.63it/s]
 32%|███▏      | 117103/371472 [9:19:14<19:43:00,  3.58it/s]
 32%|███▏      | 117104/371472 [9:19:14<20:00:28,  3.53it/s]
 32%|███▏      | 117105/371472 [9:19:15<20:56:22,  3.37it/s]
 32%|███▏      | 117106/371472 [9:19:15<19:59:49,  3.53it/s]
 32%|███▏      | 117107/371472 [9:19:15<20:12:04,  3.50it/s]
 32%|███▏      | 117108/371472 [9:19:15<19:08:41,  3.69it/s]
 32%|███▏      | 117109/371472 [9:19:16<18:52:55,  3.74it/s]
 32%|███▏      | 117110/371472 [9:19:16<18:55:30,  3.73it/s]
 32%|███▏      | 117111/371472 [9:19:16<18:59:54,  3.72it/s]
 32%|███▏      | 117112/371472 [9:19:17<18:25:22,  3.84it/s]
 32%|███▏      | 117113/371472 [9:19:17<19:04:54,  3.70it/s]
 32%|███▏      | 117114/371472 [9:19:17<21:01:21,  3.36it/s]
 32%|███▏      | 117115/371472 [9:19:17<20:54:48,  3.38it/s]
 32%|███▏      | 117116/371472 [9:19:18<19:44:21,  3.58it/s]
 32%|███▏      | 117117/371472 [9:19:18<20:54:05,  3.38it/s]
 32%|███▏      | 117118/371472 [9:19:18<20:35:33,  3.43it/s]
 32%|███▏      | 117119/371472 [9:19:19<20:03:32,  3.52it/s]
 32%|███▏      | 117120/371472 [9:19:19<19:34:34,  3.61it/s]
                                                            
{'loss': 3.1644, 'learning_rate': 7.165743713503845e-07, 'epoch': 5.04}

 32%|███▏      | 117120/371472 [9:19:19<19:34:34,  3.61it/s]
 32%|███▏      | 117121/371472 [9:19:19<19:24:17,  3.64it/s]
 32%|███▏      | 117122/371472 [9:19:19<18:49:16,  3.75it/s]
 32%|███▏      | 117123/371472 [9:19:20<19:42:51,  3.58it/s]
 32%|███▏      | 117124/371472 [9:19:20<20:37:08,  3.43it/s]
 32%|███▏      | 117125/371472 [9:19:20<20:10:42,  3.50it/s]
 32%|███▏      | 117126/371472 [9:19:21<19:58:51,  3.54it/s]
 32%|███▏      | 117127/371472 [9:19:21<19:34:00,  3.61it/s]
 32%|███▏      | 117128/371472 [9:19:21<20:39:16,  3.42it/s]
 32%|███▏      | 117129/371472 [9:19:21<19:54:34,  3.55it/s]
 32%|███▏      | 117130/371472 [9:19:22<20:15:09,  3.49it/s]
 32%|███▏      | 117131/371472 [9:19:22<20:19:13,  3.48it/s]
 32%|███▏      | 117132/371472 [9:19:22<20:46:01,  3.40it/s]
 32%|███▏      | 117133/371472 [9:19:23<22:46:02,  3.10it/s]
 32%|███▏      | 117134/371472 [9:19:23<22:10:50,  3.19it/s]
 32%|███▏      | 117135/371472 [9:19:23<20:51:15,  3.39it/s]
 32%|███▏      | 117136/371472 [9:19:24<21:12:30,  3.33it/s]
 32%|███▏      | 117137/371472 [9:19:24<21:54:31,  3.22it/s]
 32%|███▏      | 117138/371472 [9:19:24<20:58:57,  3.37it/s]
 32%|███▏      | 117139/371472 [9:19:24<20:47:17,  3.40it/s]
 32%|███▏      | 117140/371472 [9:19:25<20:01:46,  3.53it/s]
                                                            
{'loss': 3.2146, 'learning_rate': 7.165258893749057e-07, 'epoch': 5.05}

 32%|███▏      | 117140/371472 [9:19:25<20:01:46,  3.53it/s]
 32%|███▏      | 117141/371472 [9:19:25<19:46:21,  3.57it/s]
 32%|███▏      | 117142/371472 [9:19:25<19:00:52,  3.72it/s]
 32%|███▏      | 117143/371472 [9:19:26<19:31:07,  3.62it/s]
 32%|███▏      | 117144/371472 [9:19:26<19:20:10,  3.65it/s]
 32%|███▏      | 117145/371472 [9:19:26<20:27:44,  3.45it/s]
 32%|███▏      | 117146/371472 [9:19:26<20:07:32,  3.51it/s]
 32%|███▏      | 117147/371472 [9:19:27<20:30:42,  3.44it/s]
 32%|███▏      | 117148/371472 [9:19:27<20:35:05,  3.43it/s]
 32%|███▏      | 117149/371472 [9:19:27<21:21:43,  3.31it/s]
 32%|███▏      | 117150/371472 [9:19:28<21:03:10,  3.36it/s]
 32%|███▏      | 117151/371472 [9:19:28<20:17:58,  3.48it/s]
 32%|███▏      | 117152/371472 [9:19:28<20:40:27,  3.42it/s]
 32%|███▏      | 117153/371472 [9:19:28<20:19:18,  3.48it/s]
 32%|███▏      | 117154/371472 [9:19:29<20:27:11,  3.45it/s]
 32%|███▏      | 117155/371472 [9:19:29<19:59:57,  3.53it/s]
 32%|███▏      | 117156/371472 [9:19:29<20:33:46,  3.44it/s]
 32%|███▏      | 117157/371472 [9:19:30<19:47:34,  3.57it/s]
 32%|███▏      | 117158/371472 [9:19:30<19:47:31,  3.57it/s]
 32%|███▏      | 117159/371472 [9:19:30<20:22:25,  3.47it/s]
 32%|███▏      | 117160/371472 [9:19:30<20:42:52,  3.41it/s]
                                                            
{'loss': 3.2629, 'learning_rate': 7.164774073994269e-07, 'epoch': 5.05}

 32%|███▏      | 117160/371472 [9:19:30<20:42:52,  3.41it/s]
 32%|███▏      | 117161/371472 [9:19:31<20:01:05,  3.53it/s]
 32%|███▏      | 117162/371472 [9:19:31<21:58:46,  3.21it/s]
 32%|███▏      | 117163/371472 [9:19:31<22:31:08,  3.14it/s]
 32%|███▏      | 117164/371472 [9:19:32<22:28:29,  3.14it/s]
 32%|███▏      | 117165/371472 [9:19:32<22:09:59,  3.19it/s]
 32%|███▏      | 117166/371472 [9:19:32<21:37:57,  3.27it/s]
 32%|███▏      | 117167/371472 [9:19:33<20:46:08,  3.40it/s]
 32%|███▏      | 117168/371472 [9:19:33<20:10:10,  3.50it/s]
 32%|███▏      | 117169/371472 [9:19:33<20:50:05,  3.39it/s]
 32%|███▏      | 117170/371472 [9:19:33<20:51:57,  3.39it/s]
 32%|███▏      | 117171/371472 [9:19:34<20:55:13,  3.38it/s]
 32%|███▏      | 117172/371472 [9:19:34<19:54:06,  3.55it/s]
 32%|███▏      | 117173/371472 [9:19:34<19:59:07,  3.53it/s]
 32%|███▏      | 117174/371472 [9:19:35<19:44:43,  3.58it/s]
 32%|███▏      | 117175/371472 [9:19:35<19:29:35,  3.62it/s]
 32%|███▏      | 117176/371472 [9:19:35<19:42:03,  3.59it/s]
 32%|███▏      | 117177/371472 [9:19:35<18:53:26,  3.74it/s]
 32%|███▏      | 117178/371472 [9:19:36<18:46:24,  3.76it/s]
 32%|███▏      | 117179/371472 [9:19:36<20:27:40,  3.45it/s]
 32%|███▏      | 117180/371472 [9:19:36<19:37:45,  3.60it/s]
                                                            
{'loss': 3.4091, 'learning_rate': 7.16428925423948e-07, 'epoch': 5.05}

 32%|███▏      | 117180/371472 [9:19:36<19:37:45,  3.60it/s]
 32%|███▏      | 117181/371472 [9:19:37<20:44:25,  3.41it/s]
 32%|███▏      | 117182/371472 [9:19:37<20:17:14,  3.48it/s]
 32%|███▏      | 117183/371472 [9:19:37<21:31:10,  3.28it/s]
 32%|███▏      | 117184/371472 [9:19:37<20:46:26,  3.40it/s]
 32%|███▏      | 117185/371472 [9:19:38<19:44:06,  3.58it/s]
 32%|███▏      | 117186/371472 [9:19:38<19:49:02,  3.56it/s]
 32%|███▏      | 117187/371472 [9:19:38<21:03:41,  3.35it/s]
 32%|███▏      | 117188/371472 [9:19:39<20:15:15,  3.49it/s]
 32%|███▏      | 117189/371472 [9:19:39<19:43:49,  3.58it/s]
 32%|███▏      | 117190/371472 [9:19:39<21:05:14,  3.35it/s]
 32%|███▏      | 117191/371472 [9:19:39<19:50:50,  3.56it/s]
 32%|███▏      | 117192/371472 [9:19:40<19:35:12,  3.61it/s]
 32%|███▏      | 117193/371472 [9:19:40<22:17:18,  3.17it/s]
 32%|███▏      | 117194/371472 [9:19:40<21:22:50,  3.30it/s]
 32%|███▏      | 117195/371472 [9:19:41<21:05:04,  3.35it/s]
 32%|███▏      | 117196/371472 [9:19:41<20:18:54,  3.48it/s]
 32%|███▏      | 117197/371472 [9:19:41<20:22:38,  3.47it/s]
 32%|███▏      | 117198/371472 [9:19:42<20:39:03,  3.42it/s]
 32%|███▏      | 117199/371472 [9:19:42<19:45:22,  3.58it/s]
 32%|███▏      | 117200/371472 [9:19:42<20:06:30,  3.51it/s]
                                                            
{'loss': 3.3521, 'learning_rate': 7.163804434484689e-07, 'epoch': 5.05}

 32%|███▏      | 117200/371472 [9:19:42<20:06:30,  3.51it/s]
 32%|███▏      | 117201/371472 [9:19:42<19:40:56,  3.59it/s]
 32%|███▏      | 117202/371472 [9:19:43<20:01:07,  3.53it/s]
 32%|███▏      | 117203/371472 [9:19:43<20:15:49,  3.49it/s]
 32%|███▏      | 117204/371472 [9:19:43<19:24:59,  3.64it/s]
 32%|███▏      | 117205/371472 [9:19:43<19:21:16,  3.65it/s]
 32%|███▏      | 117206/371472 [9:19:44<18:54:45,  3.73it/s]
 32%|███▏      | 117207/371472 [9:19:44<18:48:51,  3.75it/s]
 32%|███▏      | 117208/371472 [9:19:44<18:52:47,  3.74it/s]
 32%|███▏      | 117209/371472 [9:19:45<19:41:35,  3.59it/s]
 32%|███▏      | 117210/371472 [9:19:45<19:14:51,  3.67it/s]
 32%|███▏      | 117211/371472 [9:19:45<19:13:40,  3.67it/s]
 32%|███▏      | 117212/371472 [9:19:45<19:15:41,  3.67it/s]
 32%|███▏      | 117213/371472 [9:19:46<19:31:20,  3.62it/s]
 32%|███▏      | 117214/371472 [9:19:46<19:25:52,  3.63it/s]
 32%|███▏      | 117215/371472 [9:19:46<18:54:53,  3.73it/s]
 32%|███▏      | 117216/371472 [9:19:46<19:41:54,  3.59it/s]
 32%|███▏      | 117217/371472 [9:19:47<19:55:33,  3.54it/s]
 32%|███▏      | 117218/371472 [9:19:47<19:28:44,  3.63it/s]
 32%|███▏      | 117219/371472 [9:19:47<20:11:47,  3.50it/s]
 32%|███▏      | 117220/371472 [9:19:48<19:59:46,  3.53it/s]
                                                            
{'loss': 3.3163, 'learning_rate': 7.163319614729901e-07, 'epoch': 5.05}

 32%|███▏      | 117220/371472 [9:19:48<19:59:46,  3.53it/s]
 32%|███▏      | 117221/371472 [9:19:48<19:08:15,  3.69it/s]
 32%|███▏      | 117222/371472 [9:19:48<19:27:53,  3.63it/s]
 32%|███▏      | 117223/371472 [9:19:48<19:53:49,  3.55it/s]
 32%|███▏      | 117224/371472 [9:19:49<19:49:44,  3.56it/s]
 32%|███▏      | 117225/371472 [9:19:49<19:36:22,  3.60it/s]
 32%|███▏      | 117226/371472 [9:19:49<19:14:00,  3.67it/s]
 32%|███▏      | 117227/371472 [9:19:49<19:16:04,  3.67it/s]
 32%|███▏      | 117228/371472 [9:19:50<18:37:16,  3.79it/s]
 32%|███▏      | 117229/371472 [9:19:50<18:43:50,  3.77it/s]
 32%|███▏      | 117230/371472 [9:19:50<18:56:13,  3.73it/s]
 32%|███▏      | 117231/371472 [9:19:51<20:17:59,  3.48it/s]
 32%|███▏      | 117232/371472 [9:19:51<20:50:17,  3.39it/s]
 32%|███▏      | 117233/371472 [9:19:51<20:14:31,  3.49it/s]
 32%|███▏      | 117234/371472 [9:19:51<19:36:29,  3.60it/s]
 32%|███▏      | 117235/371472 [9:19:52<20:11:21,  3.50it/s]
 32%|███▏      | 117236/371472 [9:19:52<21:49:09,  3.24it/s]
 32%|███▏      | 117237/371472 [9:19:52<22:20:08,  3.16it/s]
 32%|███▏      | 117238/371472 [9:19:53<22:29:06,  3.14it/s]
 32%|███▏      | 117239/371472 [9:19:53<22:49:58,  3.09it/s]
 32%|███▏      | 117240/371472 [9:19:53<21:22:14,  3.30it/s]
                                                            
{'loss': 3.2432, 'learning_rate': 7.162834794975113e-07, 'epoch': 5.05}

 32%|███▏      | 117240/371472 [9:19:53<21:22:14,  3.30it/s]
 32%|███▏      | 117241/371472 [9:19:54<20:35:45,  3.43it/s]
 32%|███▏      | 117242/371472 [9:19:54<20:12:54,  3.49it/s]
 32%|███▏      | 117243/371472 [9:19:54<20:17:51,  3.48it/s]
 32%|███▏      | 117244/371472 [9:19:54<19:48:15,  3.57it/s]
 32%|███▏      | 117245/371472 [9:19:55<19:25:52,  3.63it/s]
 32%|███▏      | 117246/371472 [9:19:55<18:43:39,  3.77it/s]
 32%|███▏      | 117247/371472 [9:19:55<20:33:08,  3.44it/s]
 32%|███▏      | 117248/371472 [9:19:56<19:52:19,  3.55it/s]
 32%|███▏      | 117249/371472 [9:19:56<20:18:11,  3.48it/s]
 32%|███▏      | 117250/371472 [9:19:56<19:34:03,  3.61it/s]
 32%|███▏      | 117251/371472 [9:19:56<19:18:09,  3.66it/s]
 32%|███▏      | 117252/371472 [9:19:57<19:32:09,  3.61it/s]
 32%|███▏      | 117253/371472 [9:19:57<19:17:26,  3.66it/s]
 32%|███▏      | 117254/371472 [9:19:57<20:36:56,  3.43it/s]
 32%|███▏      | 117255/371472 [9:19:58<20:14:38,  3.49it/s]
 32%|███▏      | 117256/371472 [9:19:58<21:41:25,  3.26it/s]
 32%|███▏      | 117257/371472 [9:19:58<21:42:39,  3.25it/s]
 32%|███▏      | 117258/371472 [9:19:58<20:57:15,  3.37it/s]
 32%|███▏      | 117259/371472 [9:19:59<20:00:37,  3.53it/s]
 32%|███▏      | 117260/371472 [9:19:59<21:10:54,  3.33it/s]
                                                            
{'loss': 3.3028, 'learning_rate': 7.162349975220324e-07, 'epoch': 5.05}

 32%|███▏      | 117260/371472 [9:19:59<21:10:54,  3.33it/s]
 32%|███▏      | 117261/371472 [9:19:59<20:23:30,  3.46it/s]
 32%|███▏      | 117262/371472 [9:20:00<19:27:06,  3.63it/s]
 32%|███▏      | 117263/371472 [9:20:00<19:03:12,  3.71it/s]
 32%|███▏      | 117264/371472 [9:20:00<19:13:23,  3.67it/s]
 32%|███▏      | 117265/371472 [9:20:00<19:33:17,  3.61it/s]
 32%|███▏      | 117266/371472 [9:20:01<20:57:14,  3.37it/s]
 32%|███▏      | 117267/371472 [9:20:01<21:52:18,  3.23it/s]
 32%|███▏      | 117268/371472 [9:20:01<20:58:06,  3.37it/s]
 32%|███▏      | 117269/371472 [9:20:02<20:17:15,  3.48it/s]
 32%|███▏      | 117270/371472 [9:20:02<19:36:44,  3.60it/s]
 32%|███▏      | 117271/371472 [9:20:02<20:27:11,  3.45it/s]
 32%|███▏      | 117272/371472 [9:20:02<19:56:03,  3.54it/s]
 32%|███▏      | 117273/371472 [9:20:03<19:30:08,  3.62it/s]
 32%|███▏      | 117274/371472 [9:20:03<20:34:15,  3.43it/s]
 32%|███▏      | 117275/371472 [9:20:03<20:42:41,  3.41it/s]
 32%|███▏      | 117276/371472 [9:20:04<20:37:19,  3.42it/s]
 32%|███▏      | 117277/371472 [9:20:04<20:30:32,  3.44it/s]
 32%|███▏      | 117278/371472 [9:20:04<19:35:52,  3.60it/s]
 32%|███▏      | 117279/371472 [9:20:04<20:26:05,  3.46it/s]
 32%|███▏      | 117280/371472 [9:20:05<20:41:27,  3.41it/s]
                                                            
{'loss': 3.3965, 'learning_rate': 7.161865155465534e-07, 'epoch': 5.05}

 32%|███▏      | 117280/371472 [9:20:05<20:41:27,  3.41it/s]
 32%|███▏      | 117281/371472 [9:20:05<20:25:20,  3.46it/s]
 32%|███▏      | 117282/371472 [9:20:05<20:26:08,  3.46it/s]
 32%|███▏      | 117283/371472 [9:20:06<20:50:21,  3.39it/s]
 32%|███▏      | 117284/371472 [9:20:06<20:26:09,  3.46it/s]
 32%|███▏      | 117285/371472 [9:20:06<19:30:57,  3.62it/s]
 32%|███▏      | 117286/371472 [9:20:06<20:04:46,  3.52it/s]
 32%|███▏      | 117287/371472 [9:20:07<19:50:05,  3.56it/s]
 32%|███▏      | 117288/371472 [9:20:07<19:24:46,  3.64it/s]
 32%|███▏      | 117289/371472 [9:20:07<19:03:44,  3.70it/s]
 32%|███▏      | 117290/371472 [9:20:08<18:49:06,  3.75it/s]
 32%|███▏      | 117291/371472 [9:20:08<19:07:56,  3.69it/s]
 32%|███▏      | 117292/371472 [9:20:08<19:01:13,  3.71it/s]
 32%|███▏      | 117293/371472 [9:20:08<19:11:20,  3.68it/s]
 32%|███▏      | 117294/371472 [9:20:09<21:10:13,  3.34it/s]
 32%|███▏      | 117295/371472 [9:20:09<21:19:59,  3.31it/s]
 32%|███▏      | 117296/371472 [9:20:09<20:42:02,  3.41it/s]
 32%|███▏      | 117297/371472 [9:20:10<21:28:44,  3.29it/s]
 32%|███▏      | 117298/371472 [9:20:10<20:47:42,  3.40it/s]
 32%|███▏      | 117299/371472 [9:20:10<20:31:02,  3.44it/s]
 32%|███▏      | 117300/371472 [9:20:10<20:15:37,  3.48it/s]
                                                            
{'loss': 3.3166, 'learning_rate': 7.161380335710746e-07, 'epoch': 5.05}

 32%|███▏      | 117300/371472 [9:20:10<20:15:37,  3.48it/s]
 32%|███▏      | 117301/371472 [9:20:11<20:33:21,  3.43it/s]
 32%|███▏      | 117302/371472 [9:20:11<19:51:21,  3.56it/s]
 32%|███▏      | 117303/371472 [9:20:11<19:29:42,  3.62it/s]
 32%|███▏      | 117304/371472 [9:20:12<19:14:54,  3.67it/s]
 32%|███▏      | 117305/371472 [9:20:12<18:42:11,  3.77it/s]
 32%|███▏      | 117306/371472 [9:20:12<18:40:44,  3.78it/s]
 32%|███▏      | 117307/371472 [9:20:12<18:22:37,  3.84it/s]
 32%|███▏      | 117308/371472 [9:20:13<18:28:44,  3.82it/s]
 32%|███▏      | 117309/371472 [9:20:13<17:58:02,  3.93it/s]
 32%|███▏      | 117310/371472 [9:20:13<18:27:20,  3.83it/s]
 32%|███▏      | 117311/371472 [9:20:13<18:24:58,  3.83it/s]
 32%|███▏      | 117312/371472 [9:20:14<19:26:00,  3.63it/s]
 32%|███▏      | 117313/371472 [9:20:14<19:47:28,  3.57it/s]
 32%|███▏      | 117314/371472 [9:20:14<19:27:58,  3.63it/s]
 32%|███▏      | 117315/371472 [9:20:15<20:15:35,  3.48it/s]
 32%|███▏      | 117316/371472 [9:20:15<19:31:22,  3.62it/s]
 32%|███▏      | 117317/371472 [9:20:15<19:33:31,  3.61it/s]
 32%|███▏      | 117318/371472 [9:20:15<22:00:27,  3.21it/s]
 32%|███▏      | 117319/371472 [9:20:16<21:16:30,  3.32it/s]
 32%|███▏      | 117320/371472 [9:20:16<20:18:55,  3.48it/s]
                                                            
{'loss': 3.4106, 'learning_rate': 7.160895515955957e-07, 'epoch': 5.05}

 32%|███▏      | 117320/371472 [9:20:16<20:18:55,  3.48it/s]
 32%|███▏      | 117321/371472 [9:20:16<20:16:21,  3.48it/s]
 32%|███▏      | 117322/371472 [9:20:17<19:57:49,  3.54it/s]
 32%|███▏      | 117323/371472 [9:20:17<19:57:52,  3.54it/s]
 32%|███▏      | 117324/371472 [9:20:17<19:04:38,  3.70it/s]
 32%|███▏      | 117325/371472 [9:20:17<19:50:49,  3.56it/s]
 32%|███▏      | 117326/371472 [9:20:18<20:42:23,  3.41it/s]
 32%|███▏      | 117327/371472 [9:20:18<20:18:23,  3.48it/s]
 32%|███▏      | 117328/371472 [9:20:18<20:34:26,  3.43it/s]
 32%|███▏      | 117329/371472 [9:20:19<20:18:06,  3.48it/s]
 32%|███▏      | 117330/371472 [9:20:19<20:18:06,  3.48it/s]
 32%|███▏      | 117331/371472 [9:20:19<19:28:27,  3.63it/s]
 32%|███▏      | 117332/371472 [9:20:19<19:14:09,  3.67it/s]
 32%|███▏      | 117333/371472 [9:20:20<18:29:57,  3.82it/s]
 32%|███▏      | 117334/371472 [9:20:20<18:35:17,  3.80it/s]
 32%|███▏      | 117335/371472 [9:20:20<18:53:15,  3.74it/s]
 32%|███▏      | 117336/371472 [9:20:20<20:27:31,  3.45it/s]
 32%|███▏      | 117337/371472 [9:20:21<20:36:29,  3.43it/s]
 32%|███▏      | 117338/371472 [9:20:21<20:05:38,  3.51it/s]
 32%|███▏      | 117339/371472 [9:20:21<19:42:38,  3.58it/s]
 32%|███▏      | 117340/371472 [9:20:22<19:58:54,  3.53it/s]
                                                            
{'loss': 3.4457, 'learning_rate': 7.160410696201167e-07, 'epoch': 5.05}

 32%|███▏      | 117340/371472 [9:20:22<19:58:54,  3.53it/s]
 32%|███▏      | 117341/371472 [9:20:22<21:25:38,  3.29it/s]
 32%|███▏      | 117342/371472 [9:20:22<20:26:15,  3.45it/s]
 32%|███▏      | 117343/371472 [9:20:22<19:54:10,  3.55it/s]
 32%|███▏      | 117344/371472 [9:20:23<19:21:18,  3.65it/s]
 32%|███▏      | 117345/371472 [9:20:23<20:18:32,  3.48it/s]
 32%|███▏      | 117346/371472 [9:20:23<20:06:28,  3.51it/s]
 32%|███▏      | 117347/371472 [9:20:24<20:26:53,  3.45it/s]
 32%|███▏      | 117348/371472 [9:20:24<19:30:19,  3.62it/s]
 32%|███▏      | 117349/371472 [9:20:24<20:02:55,  3.52it/s]
 32%|███▏      | 117350/371472 [9:20:24<20:36:03,  3.43it/s]
 32%|███▏      | 117351/371472 [9:20:25<20:20:23,  3.47it/s]
 32%|███▏      | 117352/371472 [9:20:25<21:26:19,  3.29it/s]
 32%|███▏      | 117353/371472 [9:20:25<20:35:25,  3.43it/s]
 32%|███▏      | 117354/371472 [9:20:26<20:20:35,  3.47it/s]
 32%|███▏      | 117355/371472 [9:20:26<19:44:44,  3.57it/s]
 32%|███▏      | 117356/371472 [9:20:26<19:22:42,  3.64it/s]
 32%|███▏      | 117357/371472 [9:20:26<19:41:17,  3.59it/s]
 32%|███▏      | 117358/371472 [9:20:27<19:49:50,  3.56it/s]
 32%|███▏      | 117359/371472 [9:20:27<19:29:53,  3.62it/s]
 32%|███▏      | 117360/371472 [9:20:27<21:16:01,  3.32it/s]
                                                            
{'loss': 3.209, 'learning_rate': 7.159925876446378e-07, 'epoch': 5.05}

 32%|███▏      | 117360/371472 [9:20:27<21:16:01,  3.32it/s]
 32%|███▏      | 117361/371472 [9:20:28<20:07:56,  3.51it/s]
 32%|███▏      | 117362/371472 [9:20:28<19:11:58,  3.68it/s]
 32%|███▏      | 117363/371472 [9:20:28<19:35:36,  3.60it/s]
 32%|███▏      | 117364/371472 [9:20:28<19:16:02,  3.66it/s]
 32%|███▏      | 117365/371472 [9:20:29<18:43:07,  3.77it/s]
 32%|███▏      | 117366/371472 [9:20:29<18:29:01,  3.82it/s]
 32%|███▏      | 117367/371472 [9:20:29<18:49:07,  3.75it/s]
 32%|███▏      | 117368/371472 [9:20:29<19:17:38,  3.66it/s]
 32%|███▏      | 117369/371472 [9:20:30<19:02:11,  3.71it/s]
 32%|███▏      | 117370/371472 [9:20:30<18:56:25,  3.73it/s]
 32%|███▏      | 117371/371472 [9:20:30<20:08:49,  3.50it/s]
 32%|███▏      | 117372/371472 [9:20:31<19:17:59,  3.66it/s]
 32%|███▏      | 117373/371472 [9:20:31<19:32:42,  3.61it/s]
 32%|███▏      | 117374/371472 [9:20:31<19:21:07,  3.65it/s]
 32%|███▏      | 117375/371472 [9:20:31<21:12:28,  3.33it/s]
 32%|███▏      | 117376/371472 [9:20:32<20:38:24,  3.42it/s]
 32%|███▏      | 117377/371472 [9:20:32<20:21:48,  3.47it/s]
 32%|███▏      | 117378/371472 [9:20:32<19:59:03,  3.53it/s]
 32%|███▏      | 117379/371472 [9:20:33<19:18:37,  3.66it/s]
 32%|███▏      | 117380/371472 [9:20:33<19:10:09,  3.68it/s]
                                                            
{'loss': 3.4142, 'learning_rate': 7.15944105669159e-07, 'epoch': 5.06}

 32%|███▏      | 117380/371472 [9:20:33<19:10:09,  3.68it/s]
 32%|███▏      | 117381/371472 [9:20:33<20:00:18,  3.53it/s]
 32%|███▏      | 117382/371472 [9:20:33<19:39:39,  3.59it/s]
 32%|███▏      | 117383/371472 [9:20:34<20:56:10,  3.37it/s]
 32%|███▏      | 117384/371472 [9:20:34<23:24:37,  3.01it/s]
 32%|███▏      | 117385/371472 [9:20:34<21:53:11,  3.22it/s]
 32%|███▏      | 117386/371472 [9:20:35<21:37:35,  3.26it/s]
 32%|███▏      | 117387/371472 [9:20:35<21:58:05,  3.21it/s]
 32%|███▏      | 117388/371472 [9:20:35<20:46:41,  3.40it/s]
 32%|███▏      | 117389/371472 [9:20:36<20:56:56,  3.37it/s]
 32%|███▏      | 117390/371472 [9:20:36<20:51:13,  3.38it/s]
 32%|███▏      | 117391/371472 [9:20:36<20:08:16,  3.50it/s]
 32%|███▏      | 117392/371472 [9:20:36<19:28:38,  3.62it/s]
 32%|███▏      | 117393/371472 [9:20:37<19:34:58,  3.60it/s]
 32%|███▏      | 117394/371472 [9:20:37<19:56:53,  3.54it/s]
 32%|███▏      | 117395/371472 [9:20:37<19:33:25,  3.61it/s]
 32%|███▏      | 117396/371472 [9:20:38<20:14:25,  3.49it/s]
 32%|███▏      | 117397/371472 [9:20:38<21:09:29,  3.34it/s]
 32%|███▏      | 117398/371472 [9:20:38<21:04:31,  3.35it/s]
 32%|███▏      | 117399/371472 [9:20:38<19:48:41,  3.56it/s]
 32%|███▏      | 117400/371472 [9:20:39<19:43:48,  3.58it/s]
                                                            
{'loss': 3.3758, 'learning_rate': 7.158956236936801e-07, 'epoch': 5.06}

 32%|███▏      | 117400/371472 [9:20:39<19:43:48,  3.58it/s]
 32%|███▏      | 117401/371472 [9:20:39<19:03:46,  3.70it/s]
 32%|███▏      | 117402/371472 [9:20:39<19:05:43,  3.70it/s]
 32%|███▏      | 117403/371472 [9:20:40<19:57:37,  3.54it/s]
 32%|███▏      | 117404/371472 [9:20:40<19:29:03,  3.62it/s]
 32%|███▏      | 117405/371472 [9:20:40<18:55:17,  3.73it/s]
 32%|███▏      | 117406/371472 [9:20:40<21:00:47,  3.36it/s]
 32%|███▏      | 117407/371472 [9:20:41<20:16:53,  3.48it/s]
 32%|███▏      | 117408/371472 [9:20:41<19:50:30,  3.56it/s]
 32%|███▏      | 117409/371472 [9:20:41<19:30:48,  3.62it/s]
 32%|███▏      | 117410/371472 [9:20:42<20:24:46,  3.46it/s]
 32%|███▏      | 117411/371472 [9:20:42<20:35:40,  3.43it/s]
 32%|███▏      | 117412/371472 [9:20:42<19:50:54,  3.56it/s]
 32%|███▏      | 117413/371472 [9:20:42<20:46:32,  3.40it/s]
 32%|███▏      | 117414/371472 [9:20:43<20:26:05,  3.45it/s]
 32%|███▏      | 117415/371472 [9:20:43<20:32:30,  3.44it/s]
 32%|███▏      | 117416/371472 [9:20:43<19:57:23,  3.54it/s]
 32%|███▏      | 117417/371472 [9:20:44<20:02:56,  3.52it/s]
 32%|███▏      | 117418/371472 [9:20:44<19:52:40,  3.55it/s]
 32%|███▏      | 117419/371472 [9:20:44<19:40:05,  3.59it/s]
 32%|███▏      | 117420/371472 [9:20:44<20:01:56,  3.52it/s]
                                                            
{'loss': 3.4906, 'learning_rate': 7.158471417182011e-07, 'epoch': 5.06}

 32%|███▏      | 117420/371472 [9:20:44<20:01:56,  3.52it/s]
 32%|███▏      | 117421/371472 [9:20:45<19:50:59,  3.56it/s]
 32%|███▏      | 117422/371472 [9:20:45<19:30:38,  3.62it/s]
 32%|███▏      | 117423/371472 [9:20:45<20:14:55,  3.49it/s]
 32%|███▏      | 117424/371472 [9:20:45<19:32:59,  3.61it/s]
 32%|███▏      | 117425/371472 [9:20:46<22:04:00,  3.20it/s]
 32%|███▏      | 117426/371472 [9:20:46<21:01:24,  3.36it/s]
 32%|███▏      | 117427/371472 [9:20:46<22:22:22,  3.15it/s]
 32%|███▏      | 117428/371472 [9:20:47<21:16:41,  3.32it/s]
 32%|███▏      | 117429/371472 [9:20:47<20:24:30,  3.46it/s]
 32%|███▏      | 117430/371472 [9:20:47<19:55:24,  3.54it/s]
 32%|███▏      | 117431/371472 [9:20:48<20:31:04,  3.44it/s]
 32%|███▏      | 117432/371472 [9:20:48<19:37:43,  3.60it/s]
 32%|███▏      | 117433/371472 [9:20:48<20:07:37,  3.51it/s]
 32%|███▏      | 117434/371472 [9:20:49<22:46:36,  3.10it/s]
 32%|███▏      | 117435/371472 [9:20:49<21:22:33,  3.30it/s]
 32%|███▏      | 117436/371472 [9:20:49<21:03:11,  3.35it/s]
 32%|███▏      | 117437/371472 [9:20:49<20:48:57,  3.39it/s]
 32%|███▏      | 117438/371472 [9:20:50<20:43:45,  3.40it/s]
 32%|███▏      | 117439/371472 [9:20:50<21:06:35,  3.34it/s]
 32%|███▏      | 117440/371472 [9:20:50<20:27:29,  3.45it/s]
                                                            
{'loss': 3.3155, 'learning_rate': 7.157986597427223e-07, 'epoch': 5.06}

 32%|███▏      | 117440/371472 [9:20:50<20:27:29,  3.45it/s]
 32%|███▏      | 117441/371472 [9:20:51<21:02:17,  3.35it/s]
 32%|███▏      | 117442/371472 [9:20:51<20:39:15,  3.42it/s]
 32%|███▏      | 117443/371472 [9:20:51<20:37:28,  3.42it/s]
 32%|███▏      | 117444/371472 [9:20:51<20:36:40,  3.42it/s]
 32%|███▏      | 117445/371472 [9:20:52<20:40:17,  3.41it/s]
 32%|███▏      | 117446/371472 [9:20:52<19:58:47,  3.53it/s]
 32%|███▏      | 117447/371472 [9:20:52<21:25:12,  3.29it/s]
 32%|███▏      | 117448/371472 [9:20:53<21:09:07,  3.34it/s]
 32%|███▏      | 117449/371472 [9:20:53<21:55:45,  3.22it/s]
 32%|███▏      | 117450/371472 [9:20:53<20:35:07,  3.43it/s]
 32%|███▏      | 117451/371472 [9:20:53<20:01:07,  3.52it/s]
 32%|███▏      | 117452/371472 [9:20:54<19:29:56,  3.62it/s]
 32%|███▏      | 117453/371472 [9:20:54<20:35:05,  3.43it/s]
 32%|███▏      | 117454/371472 [9:20:54<20:15:06,  3.48it/s]
 32%|███▏      | 117455/371472 [9:20:55<19:19:19,  3.65it/s]
 32%|███▏      | 117456/371472 [9:20:55<20:30:01,  3.44it/s]
 32%|███▏      | 117457/371472 [9:20:55<21:00:11,  3.36it/s]
 32%|███▏      | 117458/371472 [9:20:56<20:34:23,  3.43it/s]
 32%|███▏      | 117459/371472 [9:20:56<20:10:47,  3.50it/s]
 32%|███▏      | 117460/371472 [9:20:56<20:33:03,  3.43it/s]
                                                            
{'loss': 3.2834, 'learning_rate': 7.157501777672433e-07, 'epoch': 5.06}

 32%|███▏      | 117460/371472 [9:20:56<20:33:03,  3.43it/s]
 32%|███▏      | 117461/371472 [9:20:56<21:20:47,  3.31it/s]
 32%|███▏      | 117462/371472 [9:20:57<21:34:25,  3.27it/s]
 32%|███▏      | 117463/371472 [9:20:57<21:04:48,  3.35it/s]
 32%|███▏      | 117464/371472 [9:20:57<21:36:10,  3.27it/s]
 32%|███▏      | 117465/371472 [9:20:58<21:07:04,  3.34it/s]
 32%|███▏      | 117466/371472 [9:20:58<20:27:12,  3.45it/s]
 32%|███▏      | 117467/371472 [9:20:58<20:23:47,  3.46it/s]
 32%|███▏      | 117468/371472 [9:20:58<20:15:15,  3.48it/s]
 32%|███▏      | 117469/371472 [9:20:59<19:24:04,  3.64it/s]
 32%|███▏      | 117470/371472 [9:20:59<19:59:45,  3.53it/s]
 32%|███▏      | 117471/371472 [9:20:59<20:04:43,  3.51it/s]
 32%|███▏      | 117472/371472 [9:21:00<19:40:53,  3.58it/s]
 32%|███▏      | 117473/371472 [9:21:00<19:11:12,  3.68it/s]
 32%|███▏      | 117474/371472 [9:21:00<19:02:50,  3.70it/s]
 32%|███▏      | 117475/371472 [9:21:00<19:13:05,  3.67it/s]
 32%|███▏      | 117476/371472 [9:21:01<19:26:56,  3.63it/s]
 32%|███▏      | 117477/371472 [9:21:01<18:59:02,  3.72it/s]
 32%|███▏      | 117478/371472 [9:21:01<19:17:13,  3.66it/s]
 32%|███▏      | 117479/371472 [9:21:01<19:58:26,  3.53it/s]
 32%|███▏      | 117480/371472 [9:21:02<19:43:49,  3.58it/s]
                                                            
{'loss': 3.2455, 'learning_rate': 7.157016957917645e-07, 'epoch': 5.06}

 32%|███▏      | 117480/371472 [9:21:02<19:43:49,  3.58it/s]
 32%|███▏      | 117481/371472 [9:21:02<19:43:58,  3.58it/s]
 32%|███▏      | 117482/371472 [9:21:02<20:47:31,  3.39it/s]
 32%|███▏      | 117483/371472 [9:21:03<20:21:14,  3.47it/s]
 32%|███▏      | 117484/371472 [9:21:03<22:13:22,  3.17it/s]
 32%|███▏      | 117485/371472 [9:21:03<20:54:41,  3.37it/s]
 32%|███▏      | 117486/371472 [9:21:04<20:51:55,  3.38it/s]
 32%|███▏      | 117487/371472 [9:21:04<20:22:49,  3.46it/s]
 32%|███▏      | 117488/371472 [9:21:04<21:12:22,  3.33it/s]
 32%|███▏      | 117489/371472 [9:21:04<20:14:12,  3.49it/s]
 32%|███▏      | 117490/371472 [9:21:05<20:08:23,  3.50it/s]
 32%|███▏      | 117491/371472 [9:21:05<19:42:20,  3.58it/s]
 32%|███▏      | 117492/371472 [9:21:05<19:39:06,  3.59it/s]
 32%|███▏      | 117493/371472 [9:21:06<19:19:46,  3.65it/s]
 32%|███▏      | 117494/371472 [9:21:06<18:50:10,  3.75it/s]
 32%|███▏      | 117495/371472 [9:21:06<19:35:28,  3.60it/s]
 32%|███▏      | 117496/371472 [9:21:06<19:10:23,  3.68it/s]
 32%|███▏      | 117497/371472 [9:21:07<19:30:10,  3.62it/s]
 32%|███▏      | 117498/371472 [9:21:07<19:50:22,  3.56it/s]
 32%|███▏      | 117499/371472 [9:21:07<20:13:32,  3.49it/s]
 32%|███▏      | 117500/371472 [9:21:07<20:13:10,  3.49it/s]
                                                            
{'loss': 3.2418, 'learning_rate': 7.156532138162855e-07, 'epoch': 5.06}

 32%|███▏      | 117500/371472 [9:21:07<20:13:10,  3.49it/s]
 32%|███▏      | 117501/371472 [9:21:08<20:04:36,  3.51it/s]
 32%|███▏      | 117502/371472 [9:21:08<19:46:29,  3.57it/s]
 32%|███▏      | 117503/371472 [9:21:08<20:13:20,  3.49it/s]
 32%|███▏      | 117504/371472 [9:21:09<20:18:33,  3.47it/s]
 32%|███▏      | 117505/371472 [9:21:09<19:27:18,  3.63it/s]
 32%|███▏      | 117506/371472 [9:21:09<19:37:06,  3.60it/s]
 32%|███▏      | 117507/371472 [9:21:09<19:11:46,  3.67it/s]
 32%|███▏      | 117508/371472 [9:21:10<19:14:42,  3.67it/s]
 32%|███▏      | 117509/371472 [9:21:10<20:30:18,  3.44it/s]
 32%|███▏      | 117510/371472 [9:21:10<21:37:08,  3.26it/s]
 32%|███▏      | 117511/371472 [9:21:11<20:38:17,  3.42it/s]
 32%|███▏      | 117512/371472 [9:21:11<19:52:44,  3.55it/s]
 32%|███▏      | 117513/371472 [9:21:11<20:01:41,  3.52it/s]
 32%|███▏      | 117514/371472 [9:21:11<19:46:46,  3.57it/s]
 32%|███▏      | 117515/371472 [9:21:12<19:24:21,  3.64it/s]
 32%|███▏      | 117516/371472 [9:21:12<19:14:53,  3.66it/s]
 32%|███▏      | 117517/371472 [9:21:12<19:11:55,  3.67it/s]
 32%|███▏      | 117518/371472 [9:21:13<19:10:57,  3.68it/s]
 32%|███▏      | 117519/371472 [9:21:13<18:56:42,  3.72it/s]
 32%|███▏      | 117520/371472 [9:21:13<20:24:42,  3.46it/s]
                                                            
{'loss': 3.369, 'learning_rate': 7.156047318408067e-07, 'epoch': 5.06}

 32%|███▏      | 117520/371472 [9:21:13<20:24:42,  3.46it/s]
 32%|███▏      | 117521/371472 [9:21:13<20:43:56,  3.40it/s]
 32%|███▏      | 117522/371472 [9:21:14<20:06:57,  3.51it/s]
 32%|███▏      | 117523/371472 [9:21:14<21:23:40,  3.30it/s]
 32%|███▏      | 117524/371472 [9:21:14<20:36:35,  3.42it/s]
 32%|███▏      | 117525/371472 [9:21:15<20:00:22,  3.53it/s]
 32%|███▏      | 117526/371472 [9:21:15<19:11:08,  3.68it/s]
 32%|███▏      | 117527/371472 [9:21:15<19:29:15,  3.62it/s]
 32%|███▏      | 117528/371472 [9:21:15<20:03:22,  3.52it/s]
 32%|███▏      | 117529/371472 [9:21:16<20:35:14,  3.43it/s]
 32%|███▏      | 117530/371472 [9:21:16<19:50:33,  3.55it/s]
 32%|███▏      | 117531/371472 [9:21:16<21:20:57,  3.30it/s]
 32%|███▏      | 117532/371472 [9:21:17<22:35:43,  3.12it/s]
 32%|███▏      | 117533/371472 [9:21:17<21:34:43,  3.27it/s]
 32%|███▏      | 117534/371472 [9:21:17<21:45:43,  3.24it/s]
 32%|███▏      | 117535/371472 [9:21:18<22:41:06,  3.11it/s]
 32%|███▏      | 117536/371472 [9:21:18<21:15:10,  3.32it/s]
 32%|███▏      | 117537/371472 [9:21:18<20:38:51,  3.42it/s]
 32%|███▏      | 117538/371472 [9:21:18<20:08:13,  3.50it/s]
 32%|███▏      | 117539/371472 [9:21:19<19:46:03,  3.57it/s]
 32%|███▏      | 117540/371472 [9:21:19<19:31:16,  3.61it/s]
                                                            
{'loss': 3.35, 'learning_rate': 7.155562498653279e-07, 'epoch': 5.06}

 32%|███▏      | 117540/371472 [9:21:19<19:31:16,  3.61it/s]
 32%|███▏      | 117541/371472 [9:21:19<19:32:53,  3.61it/s]
 32%|███▏      | 117542/371472 [9:21:20<22:15:02,  3.17it/s]
 32%|███▏      | 117543/371472 [9:21:20<21:02:08,  3.35it/s]
 32%|███▏      | 117544/371472 [9:21:20<22:17:05,  3.17it/s]
 32%|███▏      | 117545/371472 [9:21:21<21:43:48,  3.25it/s]
 32%|███▏      | 117546/371472 [9:21:21<21:03:20,  3.35it/s]
 32%|███▏      | 117547/371472 [9:21:21<22:50:53,  3.09it/s]
 32%|███▏      | 117548/371472 [9:21:21<21:46:08,  3.24it/s]
 32%|███▏      | 117549/371472 [9:21:22<21:04:56,  3.35it/s]
 32%|███▏      | 117550/371472 [9:21:22<21:40:29,  3.25it/s]
 32%|███▏      | 117551/371472 [9:21:22<21:39:25,  3.26it/s]
 32%|███▏      | 117552/371472 [9:21:23<20:35:08,  3.43it/s]
 32%|███▏      | 117553/371472 [9:21:23<20:55:37,  3.37it/s]
 32%|███▏      | 117554/371472 [9:21:23<20:07:09,  3.51it/s]
 32%|███▏      | 117555/371472 [9:21:23<19:49:09,  3.56it/s]
 32%|███▏      | 117556/371472 [9:21:24<19:36:20,  3.60it/s]
 32%|███▏      | 117557/371472 [9:21:24<19:26:19,  3.63it/s]
 32%|███▏      | 117558/371472 [9:21:24<19:46:37,  3.57it/s]
 32%|███▏      | 117559/371472 [9:21:25<20:52:49,  3.38it/s]
 32%|███▏      | 117560/371472 [9:21:25<20:29:20,  3.44it/s]
                                                            
{'loss': 3.3948, 'learning_rate': 7.15507767889849e-07, 'epoch': 5.06}

 32%|███▏      | 117560/371472 [9:21:25<20:29:20,  3.44it/s]
 32%|███▏      | 117561/371472 [9:21:25<21:16:53,  3.31it/s]
 32%|███▏      | 117562/371472 [9:21:26<20:54:04,  3.37it/s]
 32%|███▏      | 117563/371472 [9:21:26<20:09:27,  3.50it/s]
 32%|███▏      | 117564/371472 [9:21:26<20:09:56,  3.50it/s]
 32%|███▏      | 117565/371472 [9:21:26<19:55:01,  3.54it/s]
 32%|███▏      | 117566/371472 [9:21:27<20:36:31,  3.42it/s]
 32%|███▏      | 117567/371472 [9:21:27<20:19:52,  3.47it/s]
 32%|███▏      | 117568/371472 [9:21:27<19:42:07,  3.58it/s]
 32%|███▏      | 117569/371472 [9:21:27<19:51:39,  3.55it/s]
 32%|███▏      | 117570/371472 [9:21:28<19:47:20,  3.56it/s]
 32%|███▏      | 117571/371472 [9:21:28<19:56:45,  3.54it/s]
 32%|███▏      | 117572/371472 [9:21:28<20:44:59,  3.40it/s]
 32%|███▏      | 117573/371472 [9:21:29<21:42:18,  3.25it/s]
 32%|███▏      | 117574/371472 [9:21:29<20:32:15,  3.43it/s]
 32%|███▏      | 117575/371472 [9:21:29<20:24:58,  3.45it/s]
 32%|███▏      | 117576/371472 [9:21:30<20:33:05,  3.43it/s]
 32%|███▏      | 117577/371472 [9:21:30<19:59:44,  3.53it/s]
 32%|███▏      | 117578/371472 [9:21:30<19:38:28,  3.59it/s]
 32%|███▏      | 117579/371472 [9:21:30<19:17:17,  3.66it/s]
 32%|███▏      | 117580/371472 [9:21:31<20:11:45,  3.49it/s]
                                                            
{'loss': 3.1273, 'learning_rate': 7.154592859143699e-07, 'epoch': 5.06}

 32%|███▏      | 117580/371472 [9:21:31<20:11:45,  3.49it/s]
 32%|███▏      | 117581/371472 [9:21:31<20:16:59,  3.48it/s]
 32%|███▏      | 117582/371472 [9:21:31<20:44:36,  3.40it/s]
 32%|███▏      | 117583/371472 [9:21:32<20:44:12,  3.40it/s]
 32%|███▏      | 117584/371472 [9:21:32<20:48:50,  3.39it/s]
 32%|███▏      | 117585/371472 [9:21:32<19:56:08,  3.54it/s]
 32%|███▏      | 117586/371472 [9:21:32<19:50:56,  3.55it/s]
 32%|███▏      | 117587/371472 [9:21:33<19:34:49,  3.60it/s]
 32%|███▏      | 117588/371472 [9:21:33<19:12:04,  3.67it/s]
 32%|███▏      | 117589/371472 [9:21:33<22:17:12,  3.16it/s]
 32%|███▏      | 117590/371472 [9:21:34<21:15:24,  3.32it/s]
 32%|███▏      | 117591/371472 [9:21:34<21:28:13,  3.28it/s]
 32%|███▏      | 117592/371472 [9:21:34<21:28:20,  3.28it/s]
 32%|███▏      | 117593/371472 [9:21:35<21:20:23,  3.30it/s]
 32%|███▏      | 117594/371472 [9:21:35<23:07:55,  3.05it/s]
 32%|███▏      | 117595/371472 [9:21:35<22:30:39,  3.13it/s]
 32%|███▏      | 117596/371472 [9:21:35<21:23:13,  3.30it/s]
 32%|███▏      | 117597/371472 [9:21:36<21:53:49,  3.22it/s]
 32%|███▏      | 117598/371472 [9:21:36<21:03:17,  3.35it/s]
 32%|███▏      | 117599/371472 [9:21:36<20:11:03,  3.49it/s]
 32%|███▏      | 117600/371472 [9:21:37<21:26:35,  3.29it/s]
                                                            
{'loss': 3.3413, 'learning_rate': 7.154108039388911e-07, 'epoch': 5.07}

 32%|███▏      | 117600/371472 [9:21:37<21:26:35,  3.29it/s]
 32%|███▏      | 117601/371472 [9:21:37<20:44:35,  3.40it/s]
 32%|███▏      | 117602/371472 [9:21:37<19:40:28,  3.58it/s]
 32%|███▏      | 117603/371472 [9:21:37<20:27:56,  3.45it/s]
 32%|███▏      | 117604/371472 [9:21:38<21:58:35,  3.21it/s]
 32%|███▏      | 117605/371472 [9:21:38<22:19:35,  3.16it/s]
 32%|███▏      | 117606/371472 [9:21:38<22:05:53,  3.19it/s]
 32%|███▏      | 117607/371472 [9:21:39<20:43:30,  3.40it/s]
 32%|███▏      | 117608/371472 [9:21:39<20:48:39,  3.39it/s]
 32%|███▏      | 117609/371472 [9:21:39<20:32:41,  3.43it/s]
 32%|███▏      | 117610/371472 [9:21:40<20:51:39,  3.38it/s]
 32%|███▏      | 117611/371472 [9:21:40<20:31:27,  3.44it/s]
 32%|███▏      | 117612/371472 [9:21:40<21:43:38,  3.25it/s]
 32%|███▏      | 117613/371472 [9:21:41<21:44:59,  3.24it/s]
 32%|███▏      | 117614/371472 [9:21:41<21:16:20,  3.31it/s]
 32%|███▏      | 117615/371472 [9:21:41<21:08:06,  3.34it/s]
 32%|███▏      | 117616/371472 [9:21:41<21:11:20,  3.33it/s]
 32%|███▏      | 117617/371472 [9:21:42<20:13:24,  3.49it/s]
 32%|███▏      | 117618/371472 [9:21:42<20:19:24,  3.47it/s]
 32%|███▏      | 117619/371472 [9:21:42<20:20:54,  3.47it/s]
 32%|███▏      | 117620/371472 [9:21:43<21:06:11,  3.34it/s]
                                                            
{'loss': 3.2372, 'learning_rate': 7.153623219634123e-07, 'epoch': 5.07}

 32%|███▏      | 117620/371472 [9:21:43<21:06:11,  3.34it/s]
 32%|███▏      | 117621/371472 [9:21:43<20:26:33,  3.45it/s]
 32%|███▏      | 117622/371472 [9:21:43<19:49:39,  3.56it/s]
 32%|███▏      | 117623/371472 [9:21:43<19:30:35,  3.61it/s]
 32%|███▏      | 117624/371472 [9:21:44<20:13:58,  3.49it/s]
 32%|███▏      | 117625/371472 [9:21:44<20:09:12,  3.50it/s]
 32%|███▏      | 117626/371472 [9:21:44<19:19:30,  3.65it/s]
 32%|███▏      | 117627/371472 [9:21:44<18:48:00,  3.75it/s]
 32%|███▏      | 117628/371472 [9:21:45<20:12:43,  3.49it/s]
 32%|███▏      | 117629/371472 [9:21:45<20:58:55,  3.36it/s]
 32%|███▏      | 117630/371472 [9:21:45<19:56:03,  3.54it/s]
 32%|███▏      | 117631/371472 [9:21:46<21:07:29,  3.34it/s]
 32%|███▏      | 117632/371472 [9:21:46<20:32:56,  3.43it/s]
 32%|███▏      | 117633/371472 [9:21:46<19:51:23,  3.55it/s]
 32%|███▏      | 117634/371472 [9:21:47<19:38:45,  3.59it/s]
 32%|███▏      | 117635/371472 [9:21:47<19:49:19,  3.56it/s]
 32%|███▏      | 117636/371472 [9:21:47<20:51:26,  3.38it/s]
 32%|███▏      | 117637/371472 [9:21:47<20:03:15,  3.52it/s]
 32%|███▏      | 117638/371472 [9:21:48<19:31:10,  3.61it/s]
 32%|███▏      | 117639/371472 [9:21:48<19:12:53,  3.67it/s]
 32%|███▏      | 117640/371472 [9:21:48<20:36:00,  3.42it/s]
                                                            
{'loss': 3.216, 'learning_rate': 7.153138399879334e-07, 'epoch': 5.07}

 32%|███▏      | 117640/371472 [9:21:48<20:36:00,  3.42it/s]
 32%|███▏      | 117641/371472 [9:21:49<21:16:24,  3.31it/s]
 32%|███▏      | 117642/371472 [9:21:49<21:04:23,  3.35it/s]
 32%|███▏      | 117643/371472 [9:21:49<19:55:42,  3.54it/s]
 32%|███▏      | 117644/371472 [9:21:49<20:11:27,  3.49it/s]
 32%|███▏      | 117645/371472 [9:21:50<19:53:00,  3.55it/s]
 32%|███▏      | 117646/371472 [9:21:50<19:25:59,  3.63it/s]
 32%|███▏      | 117647/371472 [9:21:50<21:15:16,  3.32it/s]
 32%|███▏      | 117648/371472 [9:21:51<22:36:04,  3.12it/s]
 32%|███▏      | 117649/371472 [9:21:51<21:23:38,  3.30it/s]
 32%|███▏      | 117650/371472 [9:21:51<20:20:10,  3.47it/s]
 32%|███▏      | 117651/371472 [9:21:52<24:57:54,  2.82it/s]
 32%|███▏      | 117652/371472 [9:21:52<23:33:10,  2.99it/s]
 32%|███▏      | 117653/371472 [9:21:52<21:58:35,  3.21it/s]
 32%|███▏      | 117654/371472 [9:21:53<21:39:38,  3.25it/s]
 32%|███▏      | 117655/371472 [9:21:53<21:00:02,  3.36it/s]
 32%|███▏      | 117656/371472 [9:21:53<21:09:41,  3.33it/s]
 32%|███▏      | 117657/371472 [9:21:53<21:43:12,  3.25it/s]
 32%|███▏      | 117658/371472 [9:21:54<22:00:16,  3.20it/s]
 32%|███▏      | 117659/371472 [9:21:54<21:28:06,  3.28it/s]
 32%|███▏      | 117660/371472 [9:21:54<21:07:04,  3.34it/s]
                                                            
{'loss': 3.141, 'learning_rate': 7.152653580124544e-07, 'epoch': 5.07}

 32%|███▏      | 117660/371472 [9:21:54<21:07:04,  3.34it/s]
 32%|███▏      | 117661/371472 [9:21:55<20:11:02,  3.49it/s]
 32%|███▏      | 117662/371472 [9:21:55<21:55:40,  3.22it/s]
 32%|███▏      | 117663/371472 [9:21:55<20:49:28,  3.39it/s]
 32%|███▏      | 117664/371472 [9:21:56<20:17:25,  3.47it/s]
 32%|███▏      | 117665/371472 [9:21:56<19:28:21,  3.62it/s]
 32%|███▏      | 117666/371472 [9:21:56<19:07:24,  3.69it/s]
 32%|███▏      | 117667/371472 [9:21:56<19:24:47,  3.63it/s]
 32%|███▏      | 117668/371472 [9:21:57<21:12:16,  3.32it/s]
 32%|███▏      | 117669/371472 [9:21:57<21:16:11,  3.31it/s]
 32%|███▏      | 117670/371472 [9:21:57<20:05:21,  3.51it/s]
 32%|███▏      | 117671/371472 [9:21:58<20:42:34,  3.40it/s]
 32%|███▏      | 117672/371472 [9:21:58<20:47:57,  3.39it/s]
 32%|███▏      | 117673/371472 [9:21:58<21:01:46,  3.35it/s]
 32%|███▏      | 117674/371472 [9:21:58<21:30:19,  3.28it/s]
 32%|███▏      | 117675/371472 [9:21:59<21:42:19,  3.25it/s]
 32%|███▏      | 117676/371472 [9:21:59<21:10:09,  3.33it/s]
 32%|███▏      | 117677/371472 [9:21:59<20:11:51,  3.49it/s]
 32%|███▏      | 117678/371472 [9:22:00<22:01:59,  3.20it/s]
 32%|███▏      | 117679/371472 [9:22:00<22:28:30,  3.14it/s]
 32%|███▏      | 117680/371472 [9:22:00<21:24:51,  3.29it/s]
                                                            
{'loss': 3.3666, 'learning_rate': 7.152168760369756e-07, 'epoch': 5.07}

 32%|███▏      | 117680/371472 [9:22:00<21:24:51,  3.29it/s]
 32%|███▏      | 117681/371472 [9:22:01<21:06:43,  3.34it/s]
 32%|███▏      | 117682/371472 [9:22:01<20:34:14,  3.43it/s]
 32%|███▏      | 117683/371472 [9:22:01<21:29:45,  3.28it/s]
 32%|███▏      | 117684/371472 [9:22:01<21:03:28,  3.35it/s]
 32%|███▏      | 117685/371472 [9:22:02<20:05:40,  3.51it/s]
 32%|███▏      | 117686/371472 [9:22:02<19:48:16,  3.56it/s]
 32%|███▏      | 117687/371472 [9:22:02<19:46:24,  3.57it/s]
 32%|███▏      | 117688/371472 [9:22:03<19:19:54,  3.65it/s]
 32%|███▏      | 117689/371472 [9:22:03<19:07:45,  3.69it/s]
 32%|███▏      | 117690/371472 [9:22:03<19:04:11,  3.70it/s]
 32%|███▏      | 117691/371472 [9:22:03<18:57:39,  3.72it/s]
 32%|███▏      | 117692/371472 [9:22:04<18:52:03,  3.74it/s]
 32%|███▏      | 117693/371472 [9:22:04<20:17:17,  3.47it/s]
 32%|███▏      | 117694/371472 [9:22:04<20:13:25,  3.49it/s]
 32%|███▏      | 117695/371472 [9:22:04<19:29:44,  3.62it/s]
 32%|███▏      | 117696/371472 [9:22:05<19:17:40,  3.65it/s]
 32%|███▏      | 117697/371472 [9:22:05<19:42:24,  3.58it/s]
 32%|███▏      | 117698/371472 [9:22:05<19:44:46,  3.57it/s]
 32%|███▏      | 117699/371472 [9:22:06<19:22:14,  3.64it/s]
 32%|███▏      | 117700/371472 [9:22:06<20:04:40,  3.51it/s]
                                                            
{'loss': 3.2647, 'learning_rate': 7.151683940614967e-07, 'epoch': 5.07}

 32%|███▏      | 117700/371472 [9:22:06<20:04:40,  3.51it/s]
 32%|███▏      | 117701/371472 [9:22:06<20:05:55,  3.51it/s]
 32%|███▏      | 117702/371472 [9:22:06<19:55:33,  3.54it/s]
 32%|███▏      | 117703/371472 [9:22:07<20:36:25,  3.42it/s]
 32%|███▏      | 117704/371472 [9:22:07<21:20:06,  3.30it/s]
 32%|███▏      | 117705/371472 [9:22:07<20:15:53,  3.48it/s]
 32%|███▏      | 117706/371472 [9:22:08<20:28:50,  3.44it/s]
 32%|███▏      | 117707/371472 [9:22:08<20:31:51,  3.43it/s]
 32%|███▏      | 117708/371472 [9:22:08<20:13:38,  3.48it/s]
 32%|███▏      | 117709/371472 [9:22:09<20:38:44,  3.41it/s]
 32%|███▏      | 117710/371472 [9:22:09<19:50:12,  3.55it/s]
 32%|███▏      | 117711/371472 [9:22:09<20:06:18,  3.51it/s]
 32%|███▏      | 117712/371472 [9:22:09<20:09:38,  3.50it/s]
 32%|███▏      | 117713/371472 [9:22:10<19:49:38,  3.56it/s]
 32%|███▏      | 117714/371472 [9:22:10<20:35:34,  3.42it/s]
 32%|███▏      | 117715/371472 [9:22:10<20:14:37,  3.48it/s]
 32%|███▏      | 117716/371472 [9:22:10<19:49:06,  3.56it/s]
 32%|███▏      | 117717/371472 [9:22:11<20:35:28,  3.42it/s]
 32%|███▏      | 117718/371472 [9:22:11<20:03:44,  3.51it/s]
 32%|███▏      | 117719/371472 [9:22:11<20:03:45,  3.51it/s]
 32%|███▏      | 117720/371472 [9:22:12<19:51:26,  3.55it/s]
                                                            
{'loss': 3.2725, 'learning_rate': 7.151199120860177e-07, 'epoch': 5.07}

 32%|███▏      | 117720/371472 [9:22:12<19:51:26,  3.55it/s]
 32%|███▏      | 117721/371472 [9:22:12<19:21:23,  3.64it/s]
 32%|███▏      | 117722/371472 [9:22:12<18:55:49,  3.72it/s]
 32%|███▏      | 117723/371472 [9:22:12<19:09:03,  3.68it/s]
 32%|███▏      | 117724/371472 [9:22:13<19:08:32,  3.68it/s]
 32%|███▏      | 117725/371472 [9:22:13<19:03:28,  3.70it/s]
 32%|███▏      | 117726/371472 [9:22:13<19:04:41,  3.69it/s]
 32%|███▏      | 117727/371472 [9:22:14<20:44:53,  3.40it/s]
 32%|███▏      | 117728/371472 [9:22:14<20:05:14,  3.51it/s]
 32%|███▏      | 117729/371472 [9:22:14<19:44:42,  3.57it/s]
 32%|███▏      | 117730/371472 [9:22:14<19:40:12,  3.58it/s]
 32%|███▏      | 117731/371472 [9:22:15<18:56:49,  3.72it/s]
 32%|███▏      | 117732/371472 [9:22:15<20:02:54,  3.52it/s]
 32%|███▏      | 117733/371472 [9:22:15<20:08:18,  3.50it/s]
 32%|███▏      | 117734/371472 [9:22:16<20:05:59,  3.51it/s]
 32%|███▏      | 117735/371472 [9:22:16<19:53:59,  3.54it/s]
 32%|███▏      | 117736/371472 [9:22:16<20:32:23,  3.43it/s]
 32%|███▏      | 117737/371472 [9:22:16<19:51:58,  3.55it/s]
 32%|███▏      | 117738/371472 [9:22:17<22:07:33,  3.19it/s]
 32%|███▏      | 117739/371472 [9:22:17<24:54:03,  2.83it/s]
 32%|███▏      | 117740/371472 [9:22:17<23:35:28,  2.99it/s]
                                                            
{'loss': 3.2857, 'learning_rate': 7.150714301105388e-07, 'epoch': 5.07}

 32%|███▏      | 117740/371472 [9:22:17<23:35:28,  2.99it/s]
 32%|███▏      | 117741/371472 [9:22:18<22:15:37,  3.17it/s]
 32%|███▏      | 117742/371472 [9:22:18<22:28:02,  3.14it/s]
 32%|███▏      | 117743/371472 [9:22:18<21:46:28,  3.24it/s]
 32%|███▏      | 117744/371472 [9:22:19<21:04:42,  3.34it/s]
 32%|███▏      | 117745/371472 [9:22:19<20:45:58,  3.39it/s]
 32%|███▏      | 117746/371472 [9:22:19<20:21:28,  3.46it/s]
 32%|███▏      | 117747/371472 [9:22:19<20:02:09,  3.52it/s]
 32%|███▏      | 117748/371472 [9:22:20<20:07:19,  3.50it/s]
 32%|███▏      | 117749/371472 [9:22:20<21:40:48,  3.25it/s]
 32%|███▏      | 117750/371472 [9:22:20<21:57:51,  3.21it/s]
 32%|███▏      | 117751/371472 [9:22:21<21:16:13,  3.31it/s]
 32%|███▏      | 117752/371472 [9:22:21<20:40:03,  3.41it/s]
 32%|███▏      | 117753/371472 [9:22:21<21:06:47,  3.34it/s]
 32%|███▏      | 117754/371472 [9:22:22<20:35:53,  3.42it/s]
 32%|███▏      | 117755/371472 [9:22:22<19:54:40,  3.54it/s]
 32%|███▏      | 117756/371472 [9:22:22<20:59:01,  3.36it/s]
 32%|███▏      | 117757/371472 [9:22:22<20:28:10,  3.44it/s]
 32%|███▏      | 117758/371472 [9:22:23<20:03:59,  3.51it/s]
 32%|███▏      | 117759/371472 [9:22:23<19:08:04,  3.68it/s]
 32%|███▏      | 117760/371472 [9:22:23<18:45:10,  3.76it/s]
                                                            
{'loss': 3.3427, 'learning_rate': 7.1502294813506e-07, 'epoch': 5.07}

 32%|███▏      | 117760/371472 [9:22:23<18:45:10,  3.76it/s]
 32%|███▏      | 117761/371472 [9:22:24<19:53:43,  3.54it/s]
 32%|███▏      | 117762/371472 [9:22:24<19:31:34,  3.61it/s]
 32%|███▏      | 117763/371472 [9:22:24<20:22:34,  3.46it/s]
 32%|███▏      | 117764/371472 [9:22:24<19:36:14,  3.59it/s]
 32%|███▏      | 117765/371472 [9:22:25<18:58:45,  3.71it/s]
 32%|███▏      | 117766/371472 [9:22:25<18:35:18,  3.79it/s]
 32%|███▏      | 117767/371472 [9:22:25<18:19:18,  3.85it/s]
 32%|███▏      | 117768/371472 [9:22:25<17:45:18,  3.97it/s]
 32%|███▏      | 117769/371472 [9:22:26<18:55:10,  3.72it/s]
 32%|███▏      | 117770/371472 [9:22:26<18:45:48,  3.76it/s]
 32%|███▏      | 117771/371472 [9:22:26<18:20:17,  3.84it/s]
 32%|███▏      | 117772/371472 [9:22:26<18:06:38,  3.89it/s]
 32%|███▏      | 117773/371472 [9:22:27<18:25:58,  3.82it/s]
 32%|███▏      | 117774/371472 [9:22:27<18:33:12,  3.80it/s]
 32%|███▏      | 117775/371472 [9:22:27<18:36:28,  3.79it/s]
 32%|███▏      | 117776/371472 [9:22:27<18:37:05,  3.79it/s]
 32%|███▏      | 117777/371472 [9:22:28<18:40:42,  3.77it/s]
 32%|███▏      | 117778/371472 [9:22:28<18:47:49,  3.75it/s]
 32%|███▏      | 117779/371472 [9:22:28<19:27:49,  3.62it/s]
 32%|███▏      | 117780/371472 [9:22:29<19:20:54,  3.64it/s]
                                                            
{'loss': 3.4027, 'learning_rate': 7.149744661595812e-07, 'epoch': 5.07}

 32%|███▏      | 117780/371472 [9:22:29<19:20:54,  3.64it/s]
 32%|███▏      | 117781/371472 [9:22:29<18:54:09,  3.73it/s]
 32%|███▏      | 117782/371472 [9:22:29<18:56:27,  3.72it/s]
 32%|███▏      | 117783/371472 [9:22:29<18:27:00,  3.82it/s]
 32%|███▏      | 117784/371472 [9:22:30<18:58:19,  3.71it/s]
 32%|███▏      | 117785/371472 [9:22:30<19:08:34,  3.68it/s]
 32%|███▏      | 117786/371472 [9:22:30<18:26:49,  3.82it/s]
 32%|███▏      | 117787/371472 [9:22:30<18:28:43,  3.81it/s]
 32%|███▏      | 117788/371472 [9:22:31<21:07:37,  3.34it/s]
 32%|███▏      | 117789/371472 [9:22:31<22:01:59,  3.20it/s]
 32%|███▏      | 117790/371472 [9:22:31<20:59:50,  3.36it/s]
 32%|███▏      | 117791/371472 [9:22:32<20:25:52,  3.45it/s]
 32%|███▏      | 117792/371472 [9:22:32<20:20:50,  3.46it/s]
 32%|███▏      | 117793/371472 [9:22:32<20:16:46,  3.47it/s]
 32%|███▏      | 117794/371472 [9:22:33<20:41:12,  3.41it/s]
 32%|███▏      | 117795/371472 [9:22:33<20:09:32,  3.50it/s]
 32%|███▏      | 117796/371472 [9:22:33<19:53:05,  3.54it/s]
 32%|███▏      | 117797/371472 [9:22:33<19:19:58,  3.64it/s]
 32%|███▏      | 117798/371472 [9:22:34<20:18:03,  3.47it/s]
 32%|███▏      | 117799/371472 [9:22:34<21:03:32,  3.35it/s]
 32%|███▏      | 117800/371472 [9:22:34<20:20:52,  3.46it/s]
                                                            
{'loss': 3.2014, 'learning_rate': 7.149259841841022e-07, 'epoch': 5.07}

 32%|███▏      | 117800/371472 [9:22:34<20:20:52,  3.46it/s]
 32%|███▏      | 117801/371472 [9:22:35<19:40:01,  3.58it/s]
 32%|███▏      | 117802/371472 [9:22:35<19:28:14,  3.62it/s]
 32%|███▏      | 117803/371472 [9:22:35<20:04:55,  3.51it/s]
 32%|███▏      | 117804/371472 [9:22:35<19:39:52,  3.58it/s]
 32%|███▏      | 117805/371472 [9:22:36<21:35:32,  3.26it/s]
 32%|███▏      | 117806/371472 [9:22:36<20:38:06,  3.41it/s]
 32%|███▏      | 117807/371472 [9:22:36<20:13:20,  3.48it/s]
 32%|███▏      | 117808/371472 [9:22:37<21:28:11,  3.28it/s]
 32%|███▏      | 117809/371472 [9:22:37<21:26:54,  3.29it/s]
 32%|███▏      | 117810/371472 [9:22:37<20:59:56,  3.36it/s]
 32%|███▏      | 117811/371472 [9:22:37<19:51:07,  3.55it/s]
 32%|███▏      | 117812/371472 [9:22:38<19:44:20,  3.57it/s]
 32%|███▏      | 117813/371472 [9:22:38<19:57:58,  3.53it/s]
 32%|███▏      | 117814/371472 [9:22:38<20:55:04,  3.37it/s]
 32%|███▏      | 117815/371472 [9:22:39<20:10:14,  3.49it/s]
 32%|███▏      | 117816/371472 [9:22:39<20:33:33,  3.43it/s]
 32%|███▏      | 117817/371472 [9:22:39<21:14:33,  3.32it/s]
 32%|███▏      | 117818/371472 [9:22:40<20:22:57,  3.46it/s]
 32%|███▏      | 117819/371472 [9:22:40<20:11:25,  3.49it/s]
 32%|███▏      | 117820/371472 [9:22:40<19:40:15,  3.58it/s]
                                                            
{'loss': 3.3583, 'learning_rate': 7.148775022086233e-07, 'epoch': 5.07}

 32%|███▏      | 117820/371472 [9:22:40<19:40:15,  3.58it/s]
 32%|███▏      | 117821/371472 [9:22:40<20:51:25,  3.38it/s]
 32%|███▏      | 117822/371472 [9:22:41<21:03:12,  3.35it/s]
 32%|███▏      | 117823/371472 [9:22:41<21:31:27,  3.27it/s]
 32%|███▏      | 117824/371472 [9:22:41<20:29:03,  3.44it/s]
 32%|███▏      | 117825/371472 [9:22:42<20:39:50,  3.41it/s]
 32%|███▏      | 117826/371472 [9:22:42<21:20:32,  3.30it/s]
 32%|███▏      | 117827/371472 [9:22:42<21:27:48,  3.28it/s]
 32%|███▏      | 117828/371472 [9:22:42<20:53:56,  3.37it/s]
 32%|███▏      | 117829/371472 [9:22:43<21:24:10,  3.29it/s]
 32%|███▏      | 117830/371472 [9:22:43<21:11:58,  3.32it/s]
 32%|███▏      | 117831/371472 [9:22:43<20:40:48,  3.41it/s]
 32%|███▏      | 117832/371472 [9:22:44<20:13:45,  3.48it/s]
 32%|███▏      | 117833/371472 [9:22:44<21:27:09,  3.28it/s]
 32%|███▏      | 117834/371472 [9:22:44<21:19:42,  3.30it/s]
 32%|███▏      | 117835/371472 [9:22:45<22:00:48,  3.20it/s]
 32%|███▏      | 117836/371472 [9:22:45<20:55:40,  3.37it/s]
 32%|███▏      | 117837/371472 [9:22:45<20:37:34,  3.42it/s]
 32%|███▏      | 117838/371472 [9:22:45<20:51:26,  3.38it/s]
 32%|███▏      | 117839/371472 [9:22:46<20:11:23,  3.49it/s]
 32%|███▏      | 117840/371472 [9:22:46<20:03:09,  3.51it/s]
                                                            
{'loss': 3.1608, 'learning_rate': 7.148290202331444e-07, 'epoch': 5.08}

 32%|███▏      | 117840/371472 [9:22:46<20:03:09,  3.51it/s]
 32%|███▏      | 117841/371472 [9:22:46<19:21:06,  3.64it/s]
 32%|███▏      | 117842/371472 [9:22:47<21:28:16,  3.28it/s]
 32%|███▏      | 117843/371472 [9:22:47<20:47:25,  3.39it/s]
 32%|███▏      | 117844/371472 [9:22:47<20:07:27,  3.50it/s]
 32%|███▏      | 117845/371472 [9:22:47<20:13:49,  3.48it/s]
 32%|███▏      | 117846/371472 [9:22:48<19:52:35,  3.54it/s]
 32%|███▏      | 117847/371472 [9:22:48<19:22:30,  3.64it/s]
 32%|███▏      | 117848/371472 [9:22:48<20:25:32,  3.45it/s]
 32%|███▏      | 117849/371472 [9:22:49<20:33:39,  3.43it/s]
 32%|███▏      | 117850/371472 [9:22:49<21:58:47,  3.21it/s]
 32%|███▏      | 117851/371472 [9:22:49<21:05:25,  3.34it/s]
 32%|███▏      | 117852/371472 [9:22:50<20:29:45,  3.44it/s]
 32%|███▏      | 117853/371472 [9:22:50<20:21:04,  3.46it/s]
 32%|███▏      | 117854/371472 [9:22:50<19:58:56,  3.53it/s]
 32%|███▏      | 117855/371472 [9:22:50<20:32:01,  3.43it/s]
 32%|███▏      | 117856/371472 [9:22:51<20:01:16,  3.52it/s]
 32%|███▏      | 117857/371472 [9:22:51<20:15:04,  3.48it/s]
 32%|███▏      | 117858/371472 [9:22:51<20:14:54,  3.48it/s]
 32%|███▏      | 117859/371472 [9:22:51<19:41:58,  3.58it/s]
 32%|███▏      | 117860/371472 [9:22:52<19:34:57,  3.60it/s]
                                                            
{'loss': 3.1793, 'learning_rate': 7.147805382576656e-07, 'epoch': 5.08}

 32%|███▏      | 117860/371472 [9:22:52<19:34:57,  3.60it/s]
 32%|███▏      | 117861/371472 [9:22:52<19:36:26,  3.59it/s]
 32%|███▏      | 117862/371472 [9:22:52<19:31:02,  3.61it/s]
 32%|███▏      | 117863/371472 [9:22:53<18:59:05,  3.71it/s]
 32%|███▏      | 117864/371472 [9:22:53<19:07:15,  3.68it/s]
 32%|███▏      | 117865/371472 [9:22:53<19:01:50,  3.70it/s]
 32%|███▏      | 117866/371472 [9:22:53<18:52:37,  3.73it/s]
 32%|███▏      | 117867/371472 [9:22:54<19:20:14,  3.64it/s]
 32%|███▏      | 117868/371472 [9:22:54<19:41:37,  3.58it/s]
 32%|███▏      | 117869/371472 [9:22:54<19:19:20,  3.65it/s]
 32%|███▏      | 117870/371472 [9:22:54<19:03:08,  3.70it/s]
 32%|███▏      | 117871/371472 [9:22:55<18:45:34,  3.76it/s]
 32%|███▏      | 117872/371472 [9:22:55<19:49:52,  3.55it/s]
 32%|███▏      | 117873/371472 [9:22:55<19:34:25,  3.60it/s]
 32%|███▏      | 117874/371472 [9:22:56<19:27:50,  3.62it/s]
 32%|███▏      | 117875/371472 [9:22:56<20:38:09,  3.41it/s]
 32%|███▏      | 117876/371472 [9:22:56<20:24:29,  3.45it/s]
 32%|███▏      | 117877/371472 [9:22:56<20:03:21,  3.51it/s]
 32%|███▏      | 117878/371472 [9:22:57<22:00:23,  3.20it/s]
 32%|███▏      | 117879/371472 [9:22:57<22:25:32,  3.14it/s]
 32%|███▏      | 117880/371472 [9:22:58<23:48:24,  2.96it/s]
                                                            
{'loss': 3.2232, 'learning_rate': 7.147320562821865e-07, 'epoch': 5.08}

 32%|███▏      | 117880/371472 [9:22:58<23:48:24,  2.96it/s]
 32%|███▏      | 117881/371472 [9:22:58<22:41:32,  3.10it/s]
 32%|███▏      | 117882/371472 [9:22:58<21:59:42,  3.20it/s]
 32%|███▏      | 117883/371472 [9:22:58<21:31:36,  3.27it/s]
 32%|███▏      | 117884/371472 [9:22:59<21:04:39,  3.34it/s]
 32%|███▏      | 117885/371472 [9:22:59<20:02:18,  3.52it/s]
 32%|███▏      | 117886/371472 [9:22:59<19:32:35,  3.60it/s]
 32%|███▏      | 117887/371472 [9:22:59<18:58:45,  3.71it/s]
 32%|███▏      | 117888/371472 [9:23:00<19:05:21,  3.69it/s]
 32%|███▏      | 117889/371472 [9:23:00<18:46:56,  3.75it/s]
 32%|███▏      | 117890/371472 [9:23:00<19:31:07,  3.61it/s]
 32%|███▏      | 117891/371472 [9:23:01<19:22:33,  3.64it/s]
 32%|███▏      | 117892/371472 [9:23:01<19:57:49,  3.53it/s]
 32%|███▏      | 117893/371472 [9:23:01<19:28:08,  3.62it/s]
 32%|███▏      | 117894/371472 [9:23:01<19:08:56,  3.68it/s]
 32%|███▏      | 117895/371472 [9:23:02<18:49:11,  3.74it/s]
 32%|███▏      | 117896/371472 [9:23:02<19:07:16,  3.68it/s]
 32%|███▏      | 117897/371472 [9:23:02<20:16:03,  3.48it/s]
 32%|███▏      | 117898/371472 [9:23:03<19:23:06,  3.63it/s]
 32%|███▏      | 117899/371472 [9:23:03<21:54:19,  3.22it/s]
 32%|███▏      | 117900/371472 [9:23:03<21:54:33,  3.21it/s]
                                                            
{'loss': 3.3778, 'learning_rate': 7.146835743067077e-07, 'epoch': 5.08}

 32%|███▏      | 117900/371472 [9:23:03<21:54:33,  3.21it/s]
 32%|███▏      | 117901/371472 [9:23:03<20:48:39,  3.38it/s]
 32%|███▏      | 117902/371472 [9:23:04<20:47:57,  3.39it/s]
 32%|███▏      | 117903/371472 [9:23:04<20:07:11,  3.50it/s]
 32%|███▏      | 117904/371472 [9:23:04<19:17:04,  3.65it/s]
 32%|███▏      | 117905/371472 [9:23:05<18:38:33,  3.78it/s]
 32%|███▏      | 117906/371472 [9:23:05<19:20:59,  3.64it/s]
 32%|███▏      | 117907/371472 [9:23:05<19:17:12,  3.65it/s]
 32%|███▏      | 117908/371472 [9:23:05<20:04:10,  3.51it/s]
 32%|███▏      | 117909/371472 [9:23:06<19:42:56,  3.57it/s]
 32%|███▏      | 117910/371472 [9:23:06<18:58:44,  3.71it/s]
 32%|███▏      | 117911/371472 [9:23:06<19:03:31,  3.70it/s]
 32%|███▏      | 117912/371472 [9:23:06<19:29:06,  3.61it/s]
 32%|███▏      | 117913/371472 [9:23:07<19:44:20,  3.57it/s]
 32%|███▏      | 117914/371472 [9:23:07<19:09:49,  3.68it/s]
 32%|███▏      | 117915/371472 [9:23:07<19:22:26,  3.64it/s]
 32%|███▏      | 117916/371472 [9:23:08<19:33:13,  3.60it/s]
 32%|███▏      | 117917/371472 [9:23:08<18:58:27,  3.71it/s]
 32%|███▏      | 117918/371472 [9:23:08<20:05:17,  3.51it/s]
 32%|███▏      | 117919/371472 [9:23:08<20:04:18,  3.51it/s]
 32%|███▏      | 117920/371472 [9:23:09<20:12:19,  3.49it/s]
                                                            
{'loss': 3.4455, 'learning_rate': 7.146350923312289e-07, 'epoch': 5.08}

 32%|███▏      | 117920/371472 [9:23:09<20:12:19,  3.49it/s]
 32%|███▏      | 117921/371472 [9:23:09<19:42:50,  3.57it/s]
 32%|███▏      | 117922/371472 [9:23:09<20:25:02,  3.45it/s]
 32%|███▏      | 117923/371472 [9:23:10<20:14:44,  3.48it/s]
 32%|███▏      | 117924/371472 [9:23:10<19:36:33,  3.59it/s]
 32%|███▏      | 117925/371472 [9:23:10<20:48:54,  3.38it/s]
 32%|███▏      | 117926/371472 [9:23:10<20:30:14,  3.43it/s]
 32%|███▏      | 117927/371472 [9:23:11<19:37:40,  3.59it/s]
 32%|███▏      | 117928/371472 [9:23:11<19:30:06,  3.61it/s]
 32%|███▏      | 117929/371472 [9:23:11<19:09:40,  3.68it/s]
 32%|███▏      | 117930/371472 [9:23:12<18:35:45,  3.79it/s]
 32%|███▏      | 117931/371472 [9:23:12<18:57:01,  3.72it/s]
 32%|███▏      | 117932/371472 [9:23:12<19:27:08,  3.62it/s]
 32%|███▏      | 117933/371472 [9:23:12<19:23:18,  3.63it/s]
 32%|███▏      | 117934/371472 [9:23:13<19:29:23,  3.61it/s]
 32%|███▏      | 117935/371472 [9:23:13<19:50:35,  3.55it/s]
 32%|███▏      | 117936/371472 [9:23:13<20:58:54,  3.36it/s]
 32%|███▏      | 117937/371472 [9:23:14<20:11:41,  3.49it/s]
 32%|███▏      | 117938/371472 [9:23:14<20:22:47,  3.46it/s]
 32%|███▏      | 117939/371472 [9:23:14<20:26:50,  3.44it/s]
 32%|███▏      | 117940/371472 [9:23:14<20:09:28,  3.49it/s]
                                                            
{'loss': 3.2943, 'learning_rate': 7.1458661035575e-07, 'epoch': 5.08}

 32%|███▏      | 117940/371472 [9:23:14<20:09:28,  3.49it/s]
 32%|███▏      | 117941/371472 [9:23:15<19:33:03,  3.60it/s]
 32%|███▏      | 117942/371472 [9:23:15<19:16:23,  3.65it/s]
 32%|███▏      | 117943/371472 [9:23:15<19:42:54,  3.57it/s]
 32%|███▏      | 117944/371472 [9:23:15<19:23:04,  3.63it/s]
 32%|███▏      | 117945/371472 [9:23:16<19:14:23,  3.66it/s]
 32%|███▏      | 117946/371472 [9:23:16<18:51:36,  3.73it/s]
 32%|███▏      | 117947/371472 [9:23:16<18:46:23,  3.75it/s]
 32%|███▏      | 117948/371472 [9:23:17<18:46:54,  3.75it/s]
 32%|███▏      | 117949/371472 [9:23:17<18:23:21,  3.83it/s]
 32%|███▏      | 117950/371472 [9:23:17<18:09:22,  3.88it/s]
 32%|███▏      | 117951/371472 [9:23:17<17:38:26,  3.99it/s]
 32%|███▏      | 117952/371472 [9:23:18<17:23:50,  4.05it/s]
 32%|███▏      | 117953/371472 [9:23:18<17:38:53,  3.99it/s]
 32%|███▏      | 117954/371472 [9:23:18<18:26:34,  3.82it/s]
 32%|███▏      | 117955/371472 [9:23:18<18:50:12,  3.74it/s]
 32%|███▏      | 117956/371472 [9:23:19<19:01:45,  3.70it/s]
 32%|███▏      | 117957/371472 [9:23:19<18:42:55,  3.76it/s]
 32%|███▏      | 117958/371472 [9:23:19<18:08:46,  3.88it/s]
 32%|███▏      | 117959/371472 [9:23:19<17:47:31,  3.96it/s]
 32%|███▏      | 117960/371472 [9:23:20<18:26:03,  3.82it/s]
                                                            
{'loss': 3.3868, 'learning_rate': 7.145381283802709e-07, 'epoch': 5.08}

 32%|███▏      | 117960/371472 [9:23:20<18:26:03,  3.82it/s]
 32%|███▏      | 117961/371472 [9:23:20<18:18:03,  3.85it/s]
 32%|███▏      | 117962/371472 [9:23:20<19:28:50,  3.61it/s]
 32%|███▏      | 117963/371472 [9:23:21<20:20:07,  3.46it/s]
 32%|███▏      | 117964/371472 [9:23:21<19:53:49,  3.54it/s]
 32%|███▏      | 117965/371472 [9:23:21<20:47:59,  3.39it/s]
 32%|███▏      | 117966/371472 [9:23:21<20:28:11,  3.44it/s]
 32%|███▏      | 117967/371472 [9:23:22<20:31:52,  3.43it/s]
 32%|███▏      | 117968/371472 [9:23:22<21:43:57,  3.24it/s]
 32%|███▏      | 117969/371472 [9:23:22<20:39:30,  3.41it/s]
 32%|███▏      | 117970/371472 [9:23:23<19:30:32,  3.61it/s]
 32%|███▏      | 117971/371472 [9:23:23<20:07:08,  3.50it/s]
 32%|███▏      | 117972/371472 [9:23:23<20:37:32,  3.41it/s]
 32%|███▏      | 117973/371472 [9:23:23<19:54:39,  3.54it/s]
 32%|███▏      | 117974/371472 [9:23:24<19:38:07,  3.59it/s]
 32%|███▏      | 117975/371472 [9:23:24<20:53:26,  3.37it/s]
 32%|███▏      | 117976/371472 [9:23:24<21:16:19,  3.31it/s]
 32%|███▏      | 117977/371472 [9:23:25<20:24:51,  3.45it/s]
 32%|███▏      | 117978/371472 [9:23:25<20:19:59,  3.46it/s]
 32%|███▏      | 117979/371472 [9:23:25<19:39:30,  3.58it/s]
 32%|███▏      | 117980/371472 [9:23:25<19:11:34,  3.67it/s]
                                                            
{'loss': 3.2209, 'learning_rate': 7.144896464047921e-07, 'epoch': 5.08}

 32%|███▏      | 117980/371472 [9:23:25<19:11:34,  3.67it/s]
 32%|███▏      | 117981/371472 [9:23:26<18:57:21,  3.71it/s]
 32%|███▏      | 117982/371472 [9:23:26<19:23:47,  3.63it/s]
 32%|███▏      | 117983/371472 [9:23:26<19:10:55,  3.67it/s]
 32%|███▏      | 117984/371472 [9:23:26<18:56:16,  3.72it/s]
 32%|███▏      | 117985/371472 [9:23:27<19:36:27,  3.59it/s]
 32%|███▏      | 117986/371472 [9:23:27<19:23:43,  3.63it/s]
 32%|███▏      | 117987/371472 [9:23:27<19:40:47,  3.58it/s]
 32%|███▏      | 117988/371472 [9:23:28<19:48:05,  3.56it/s]
 32%|███▏      | 117989/371472 [9:23:28<20:22:09,  3.46it/s]
 32%|███▏      | 117990/371472 [9:23:28<20:06:03,  3.50it/s]
 32%|███▏      | 117991/371472 [9:23:28<20:38:18,  3.41it/s]
 32%|███▏      | 117992/371472 [9:23:29<20:39:50,  3.41it/s]
 32%|███▏      | 117993/371472 [9:23:29<21:48:21,  3.23it/s]
 32%|███▏      | 117994/371472 [9:23:29<20:45:18,  3.39it/s]
 32%|███▏      | 117995/371472 [9:23:30<19:51:34,  3.55it/s]
 32%|███▏      | 117996/371472 [9:23:30<21:36:23,  3.26it/s]
 32%|███▏      | 117997/371472 [9:23:30<20:05:49,  3.50it/s]
 32%|███▏      | 117998/371472 [9:23:31<21:14:51,  3.31it/s]
 32%|███▏      | 117999/371472 [9:23:31<20:32:44,  3.43it/s]
 32%|███▏      | 118000/371472 [9:23:31<19:22:34,  3.63it/s]
                                                            
{'loss': 3.1395, 'learning_rate': 7.144411644293133e-07, 'epoch': 5.08}

 32%|███▏      | 118000/371472 [9:23:31<19:22:34,  3.63it/s]
 32%|███▏      | 118001/371472 [9:23:31<19:25:24,  3.62it/s]
 32%|███▏      | 118002/371472 [9:23:32<18:45:35,  3.75it/s]
 32%|███▏      | 118003/371472 [9:23:32<18:23:06,  3.83it/s]
 32%|███▏      | 118004/371472 [9:23:32<18:45:03,  3.75it/s]
 32%|███▏      | 118005/371472 [9:23:32<19:18:35,  3.65it/s]
 32%|███▏      | 118006/371472 [9:23:33<18:43:35,  3.76it/s]
 32%|███▏      | 118007/371472 [9:23:33<18:25:20,  3.82it/s]
 32%|███▏      | 118008/371472 [9:23:33<20:26:38,  3.44it/s]
 32%|███▏      | 118009/371472 [9:23:34<21:01:12,  3.35it/s]
 32%|███▏      | 118010/371472 [9:23:34<21:16:17,  3.31it/s]
 32%|███▏      | 118011/371472 [9:23:34<20:16:27,  3.47it/s]
 32%|███▏      | 118012/371472 [9:23:34<19:37:05,  3.59it/s]
 32%|███▏      | 118013/371472 [9:23:35<19:19:34,  3.64it/s]
 32%|███▏      | 118014/371472 [9:23:35<18:55:03,  3.72it/s]
 32%|███▏      | 118015/371472 [9:23:35<19:29:14,  3.61it/s]
 32%|███▏      | 118016/371472 [9:23:36<20:41:36,  3.40it/s]
 32%|███▏      | 118017/371472 [9:23:36<21:26:17,  3.28it/s]
 32%|███▏      | 118018/371472 [9:23:36<20:58:39,  3.36it/s]
 32%|███▏      | 118019/371472 [9:23:36<20:39:58,  3.41it/s]
 32%|███▏      | 118020/371472 [9:23:37<20:23:22,  3.45it/s]
                                                            
{'loss': 3.4147, 'learning_rate': 7.143926824538343e-07, 'epoch': 5.08}

 32%|███▏      | 118020/371472 [9:23:37<20:23:22,  3.45it/s]
 32%|███▏      | 118021/371472 [9:23:37<20:12:49,  3.48it/s]
 32%|███▏      | 118022/371472 [9:23:37<22:42:40,  3.10it/s]
 32%|███▏      | 118023/371472 [9:23:38<21:43:37,  3.24it/s]
 32%|███▏      | 118024/371472 [9:23:38<24:20:26,  2.89it/s]
 32%|███▏      | 118025/371472 [9:23:38<23:04:13,  3.05it/s]
 32%|███▏      | 118026/371472 [9:23:39<24:24:01,  2.89it/s]
 32%|███▏      | 118027/371472 [9:23:39<22:31:29,  3.13it/s]
 32%|███▏      | 118028/371472 [9:23:39<21:12:01,  3.32it/s]
 32%|███▏      | 118029/371472 [9:23:40<20:22:25,  3.46it/s]
 32%|███▏      | 118030/371472 [9:23:40<19:57:55,  3.53it/s]
 32%|███▏      | 118031/371472 [9:23:40<19:31:48,  3.60it/s]
 32%|███▏      | 118032/371472 [9:23:40<20:43:49,  3.40it/s]
 32%|███▏      | 118033/371472 [9:23:41<19:43:46,  3.57it/s]
 32%|███▏      | 118034/371472 [9:23:41<21:40:05,  3.25it/s]
 32%|███▏      | 118035/371472 [9:23:41<20:51:05,  3.38it/s]
 32%|███▏      | 118036/371472 [9:23:42<20:40:48,  3.40it/s]
 32%|███▏      | 118037/371472 [9:23:42<19:57:09,  3.53it/s]
 32%|███▏      | 118038/371472 [9:23:42<19:19:39,  3.64it/s]
 32%|███▏      | 118039/371472 [9:23:42<18:53:53,  3.73it/s]
 32%|███▏      | 118040/371472 [9:23:43<20:13:11,  3.48it/s]
                                                            
{'loss': 3.372, 'learning_rate': 7.143442004783554e-07, 'epoch': 5.08}

 32%|███▏      | 118040/371472 [9:23:43<20:13:11,  3.48it/s]
 32%|███▏      | 118041/371472 [9:23:43<20:50:48,  3.38it/s]
 32%|███▏      | 118042/371472 [9:23:43<20:25:32,  3.45it/s]
 32%|███▏      | 118043/371472 [9:23:44<20:22:44,  3.45it/s]
 32%|███▏      | 118044/371472 [9:23:44<19:41:18,  3.58it/s]
 32%|███▏      | 118045/371472 [9:23:44<19:27:59,  3.62it/s]
 32%|███▏      | 118046/371472 [9:23:44<20:13:35,  3.48it/s]
 32%|███▏      | 118047/371472 [9:23:45<20:22:43,  3.45it/s]
 32%|███▏      | 118048/371472 [9:23:45<20:08:11,  3.50it/s]
 32%|███▏      | 118049/371472 [9:23:45<20:33:10,  3.43it/s]
 32%|███▏      | 118050/371472 [9:23:46<21:34:51,  3.26it/s]
 32%|███▏      | 118051/371472 [9:23:46<21:00:18,  3.35it/s]
 32%|███▏      | 118052/371472 [9:23:46<22:06:12,  3.18it/s]
 32%|███▏      | 118053/371472 [9:23:47<21:20:06,  3.30it/s]
 32%|███▏      | 118054/371472 [9:23:47<20:56:02,  3.36it/s]
 32%|███▏      | 118055/371472 [9:23:47<20:38:11,  3.41it/s]
 32%|███▏      | 118056/371472 [9:23:47<20:35:44,  3.42it/s]
 32%|███▏      | 118057/371472 [9:23:48<20:39:37,  3.41it/s]
 32%|███▏      | 118058/371472 [9:23:48<20:28:26,  3.44it/s]
 32%|███▏      | 118059/371472 [9:23:48<20:45:55,  3.39it/s]
 32%|███▏      | 118060/371472 [9:23:49<20:22:08,  3.46it/s]
                                                            
{'loss': 3.3439, 'learning_rate': 7.142957185028766e-07, 'epoch': 5.09}

 32%|███▏      | 118060/371472 [9:23:49<20:22:08,  3.46it/s]
 32%|███▏      | 118061/371472 [9:23:49<20:51:22,  3.38it/s]
 32%|███▏      | 118062/371472 [9:23:49<20:56:37,  3.36it/s]
 32%|███▏      | 118063/371472 [9:23:50<20:41:30,  3.40it/s]
 32%|███▏      | 118064/371472 [9:23:50<20:40:46,  3.40it/s]
 32%|███▏      | 118065/371472 [9:23:50<20:23:36,  3.45it/s]
 32%|███▏      | 118066/371472 [9:23:50<20:14:47,  3.48it/s]
 32%|███▏      | 118067/371472 [9:23:51<21:31:47,  3.27it/s]
 32%|███▏      | 118068/371472 [9:23:51<20:58:07,  3.36it/s]
 32%|███▏      | 118069/371472 [9:23:51<21:33:18,  3.27it/s]
 32%|███▏      | 118070/371472 [9:23:52<20:54:16,  3.37it/s]
 32%|███▏      | 118071/371472 [9:23:52<22:02:21,  3.19it/s]
 32%|███▏      | 118072/371472 [9:23:52<20:53:19,  3.37it/s]
 32%|███▏      | 118073/371472 [9:23:52<20:06:43,  3.50it/s]
 32%|███▏      | 118074/371472 [9:23:53<20:24:46,  3.45it/s]
 32%|███▏      | 118075/371472 [9:23:53<21:09:28,  3.33it/s]
 32%|███▏      | 118076/371472 [9:23:53<20:18:53,  3.46it/s]
 32%|███▏      | 118077/371472 [9:23:54<19:47:25,  3.56it/s]
 32%|███▏      | 118078/371472 [9:23:54<19:51:15,  3.55it/s]
 32%|███▏      | 118079/371472 [9:23:54<19:10:02,  3.67it/s]
 32%|███▏      | 118080/371472 [9:23:54<19:20:47,  3.64it/s]
                                                            
{'loss': 3.4245, 'learning_rate': 7.142472365273977e-07, 'epoch': 5.09}

 32%|███▏      | 118080/371472 [9:23:54<19:20:47,  3.64it/s]
 32%|███▏      | 118081/371472 [9:23:55<19:26:15,  3.62it/s]
 32%|███▏      | 118082/371472 [9:23:55<19:11:44,  3.67it/s]
 32%|███▏      | 118083/371472 [9:23:55<19:50:38,  3.55it/s]
 32%|███▏      | 118084/371472 [9:23:56<19:57:05,  3.53it/s]
 32%|███▏      | 118085/371472 [9:23:56<21:27:54,  3.28it/s]
 32%|███▏      | 118086/371472 [9:23:56<20:43:40,  3.40it/s]
 32%|███▏      | 118087/371472 [9:23:56<20:27:56,  3.44it/s]
 32%|███▏      | 118088/371472 [9:23:57<19:54:07,  3.54it/s]
 32%|███▏      | 118089/371472 [9:23:57<19:43:32,  3.57it/s]
 32%|███▏      | 118090/371472 [9:23:57<19:26:38,  3.62it/s]
 32%|███▏      | 118091/371472 [9:23:58<20:34:59,  3.42it/s]
 32%|███▏      | 118092/371472 [9:23:58<20:24:43,  3.45it/s]
 32%|███▏      | 118093/371472 [9:23:58<20:27:18,  3.44it/s]
 32%|███▏      | 118094/371472 [9:23:58<20:22:56,  3.45it/s]
 32%|███▏      | 118095/371472 [9:23:59<20:04:08,  3.51it/s]
 32%|███▏      | 118096/371472 [9:23:59<19:51:59,  3.54it/s]
 32%|███▏      | 118097/371472 [9:23:59<19:23:13,  3.63it/s]
 32%|███▏      | 118098/371472 [9:24:00<19:44:01,  3.57it/s]
 32%|███▏      | 118099/371472 [9:24:00<20:15:12,  3.48it/s]
 32%|███▏      | 118100/371472 [9:24:00<19:31:06,  3.61it/s]
                                                            
{'loss': 3.2875, 'learning_rate': 7.141987545519187e-07, 'epoch': 5.09}

 32%|███▏      | 118100/371472 [9:24:00<19:31:06,  3.61it/s]
 32%|███▏      | 118101/371472 [9:24:00<19:06:57,  3.68it/s]
 32%|███▏      | 118102/371472 [9:24:01<18:32:06,  3.80it/s]
 32%|███▏      | 118103/371472 [9:24:01<18:12:31,  3.87it/s]
 32%|███▏      | 118104/371472 [9:24:01<18:30:51,  3.80it/s]
 32%|███▏      | 118105/371472 [9:24:01<19:15:02,  3.66it/s]
 32%|███▏      | 118106/371472 [9:24:02<19:05:54,  3.69it/s]
 32%|███▏      | 118107/371472 [9:24:02<18:33:41,  3.79it/s]
 32%|███▏      | 118108/371472 [9:24:02<20:33:41,  3.42it/s]
 32%|███▏      | 118109/371472 [9:24:03<22:00:13,  3.20it/s]
 32%|███▏      | 118110/371472 [9:24:03<21:58:35,  3.20it/s]
 32%|███▏      | 118111/371472 [9:24:03<21:24:01,  3.29it/s]
 32%|███▏      | 118112/371472 [9:24:04<21:08:41,  3.33it/s]
 32%|███▏      | 118113/371472 [9:24:04<21:24:46,  3.29it/s]
 32%|███▏      | 118114/371472 [9:24:04<20:10:24,  3.49it/s]
 32%|███▏      | 118115/371472 [9:24:04<20:44:32,  3.39it/s]
 32%|███▏      | 118116/371472 [9:24:05<20:59:50,  3.35it/s]
 32%|███▏      | 118117/371472 [9:24:05<19:43:07,  3.57it/s]
 32%|███▏      | 118118/371472 [9:24:05<19:31:05,  3.61it/s]
 32%|███▏      | 118119/371472 [9:24:06<20:14:32,  3.48it/s]
 32%|███▏      | 118120/371472 [9:24:06<19:41:30,  3.57it/s]
                                                            
{'loss': 3.3443, 'learning_rate': 7.141502725764398e-07, 'epoch': 5.09}

 32%|███▏      | 118120/371472 [9:24:06<19:41:30,  3.57it/s]
 32%|███▏      | 118121/371472 [9:24:06<20:40:00,  3.41it/s]
 32%|███▏      | 118122/371472 [9:24:06<20:24:42,  3.45it/s]
 32%|███▏      | 118123/371472 [9:24:07<21:51:02,  3.22it/s]
 32%|███▏      | 118124/371472 [9:24:07<20:46:45,  3.39it/s]
 32%|███▏      | 118125/371472 [9:24:07<19:44:23,  3.57it/s]
 32%|███▏      | 118126/371472 [9:24:08<20:57:49,  3.36it/s]
 32%|███▏      | 118127/371472 [9:24:08<20:58:59,  3.35it/s]
 32%|███▏      | 118128/371472 [9:24:08<21:31:39,  3.27it/s]
 32%|███▏      | 118129/371472 [9:24:09<21:16:49,  3.31it/s]
 32%|███▏      | 118130/371472 [9:24:09<21:55:04,  3.21it/s]
 32%|███▏      | 118131/371472 [9:24:09<21:14:42,  3.31it/s]
 32%|███▏      | 118132/371472 [9:24:09<20:17:58,  3.47it/s]
 32%|███▏      | 118133/371472 [9:24:10<19:53:53,  3.54it/s]
 32%|███▏      | 118134/371472 [9:24:10<19:49:35,  3.55it/s]
 32%|███▏      | 118135/371472 [9:24:10<19:49:26,  3.55it/s]
 32%|███▏      | 118136/371472 [9:24:11<20:55:02,  3.36it/s]
 32%|███▏      | 118137/371472 [9:24:11<21:11:17,  3.32it/s]
 32%|███▏      | 118138/371472 [9:24:11<20:10:40,  3.49it/s]
 32%|███▏      | 118139/371472 [9:24:11<19:48:30,  3.55it/s]
 32%|███▏      | 118140/371472 [9:24:12<20:12:12,  3.48it/s]
                                                            
{'loss': 3.1295, 'learning_rate': 7.14101790600961e-07, 'epoch': 5.09}

 32%|███▏      | 118140/371472 [9:24:12<20:12:12,  3.48it/s]
 32%|███▏      | 118141/371472 [9:24:12<19:20:11,  3.64it/s]
 32%|███▏      | 118142/371472 [9:24:12<19:11:36,  3.67it/s]
 32%|███▏      | 118143/371472 [9:24:13<19:47:13,  3.56it/s]
 32%|███▏      | 118144/371472 [9:24:13<19:52:22,  3.54it/s]
 32%|███▏      | 118145/371472 [9:24:13<19:37:32,  3.59it/s]
 32%|███▏      | 118146/371472 [9:24:13<19:26:07,  3.62it/s]
 32%|███▏      | 118147/371472 [9:24:14<19:10:05,  3.67it/s]
 32%|███▏      | 118148/371472 [9:24:14<19:32:21,  3.60it/s]
 32%|███▏      | 118149/371472 [9:24:14<22:19:54,  3.15it/s]
 32%|███▏      | 118150/371472 [9:24:15<21:10:13,  3.32it/s]
 32%|███▏      | 118151/371472 [9:24:15<23:19:32,  3.02it/s]
 32%|███▏      | 118152/371472 [9:24:15<22:27:36,  3.13it/s]
 32%|███▏      | 118153/371472 [9:24:16<21:41:17,  3.24it/s]
 32%|███▏      | 118154/371472 [9:24:16<20:15:24,  3.47it/s]
 32%|███▏      | 118155/371472 [9:24:16<20:25:59,  3.44it/s]
 32%|███▏      | 118156/371472 [9:24:16<20:35:05,  3.42it/s]
 32%|███▏      | 118157/371472 [9:24:17<20:34:44,  3.42it/s]
 32%|███▏      | 118158/371472 [9:24:17<19:55:08,  3.53it/s]
 32%|███▏      | 118159/371472 [9:24:17<20:53:40,  3.37it/s]
 32%|███▏      | 118160/371472 [9:24:18<21:07:04,  3.33it/s]
                                                            
{'loss': 3.3251, 'learning_rate': 7.140533086254822e-07, 'epoch': 5.09}

 32%|███▏      | 118160/371472 [9:24:18<21:07:04,  3.33it/s]
 32%|███▏      | 118161/371472 [9:24:18<21:04:44,  3.34it/s]
 32%|███▏      | 118162/371472 [9:24:18<20:34:34,  3.42it/s]
 32%|███▏      | 118163/371472 [9:24:18<20:25:37,  3.44it/s]
 32%|███▏      | 118164/371472 [9:24:19<19:47:29,  3.56it/s]
 32%|███▏      | 118165/371472 [9:24:19<19:37:15,  3.59it/s]
 32%|███▏      | 118166/371472 [9:24:19<19:17:42,  3.65it/s]
 32%|███▏      | 118167/371472 [9:24:20<20:31:57,  3.43it/s]
 32%|███▏      | 118168/371472 [9:24:20<19:51:15,  3.54it/s]
 32%|███▏      | 118169/371472 [9:24:20<20:33:18,  3.42it/s]
 32%|███▏      | 118170/371472 [9:24:20<20:16:36,  3.47it/s]
 32%|███▏      | 118171/371472 [9:24:21<20:04:04,  3.51it/s]
 32%|███▏      | 118172/371472 [9:24:21<20:59:34,  3.35it/s]
 32%|███▏      | 118173/371472 [9:24:21<20:39:40,  3.41it/s]
 32%|███▏      | 118174/371472 [9:24:22<20:15:34,  3.47it/s]
 32%|███▏      | 118175/371472 [9:24:22<19:42:45,  3.57it/s]
 32%|███▏      | 118176/371472 [9:24:22<19:08:45,  3.67it/s]
 32%|███▏      | 118177/371472 [9:24:22<19:55:25,  3.53it/s]
 32%|███▏      | 118178/371472 [9:24:23<19:48:46,  3.55it/s]
 32%|███▏      | 118179/371472 [9:24:23<19:43:00,  3.57it/s]
 32%|███▏      | 118180/371472 [9:24:23<20:11:55,  3.48it/s]
                                                            
{'loss': 3.5161, 'learning_rate': 7.140048266500032e-07, 'epoch': 5.09}

 32%|███▏      | 118180/371472 [9:24:23<20:11:55,  3.48it/s]
 32%|███▏      | 118181/371472 [9:24:24<20:32:38,  3.42it/s]
 32%|███▏      | 118182/371472 [9:24:24<20:02:30,  3.51it/s]
 32%|███▏      | 118183/371472 [9:24:24<19:50:20,  3.55it/s]
 32%|███▏      | 118184/371472 [9:24:24<20:06:03,  3.50it/s]
 32%|███▏      | 118185/371472 [9:24:25<19:56:30,  3.53it/s]
 32%|███▏      | 118186/371472 [9:24:25<19:57:04,  3.53it/s]
 32%|███▏      | 118187/371472 [9:24:25<20:29:05,  3.43it/s]
 32%|███▏      | 118188/371472 [9:24:26<19:45:09,  3.56it/s]
 32%|███▏      | 118189/371472 [9:24:26<19:03:18,  3.69it/s]
 32%|███▏      | 118190/371472 [9:24:26<19:13:32,  3.66it/s]
 32%|███▏      | 118191/371472 [9:24:26<19:22:44,  3.63it/s]
 32%|███▏      | 118192/371472 [9:24:27<19:31:07,  3.60it/s]
 32%|███▏      | 118193/371472 [9:24:27<18:33:19,  3.79it/s]
 32%|███▏      | 118194/371472 [9:24:27<19:33:21,  3.60it/s]
 32%|███▏      | 118195/371472 [9:24:27<19:18:52,  3.64it/s]
 32%|███▏      | 118196/371472 [9:24:28<19:13:04,  3.66it/s]
 32%|███▏      | 118197/371472 [9:24:28<19:13:55,  3.66it/s]
 32%|███▏      | 118198/371472 [9:24:28<19:42:31,  3.57it/s]
 32%|███▏      | 118199/371472 [9:24:29<21:32:09,  3.27it/s]
 32%|███▏      | 118200/371472 [9:24:29<20:30:25,  3.43it/s]
                                                            
{'loss': 3.2926, 'learning_rate': 7.139563446745243e-07, 'epoch': 5.09}

 32%|███▏      | 118200/371472 [9:24:29<20:30:25,  3.43it/s]
 32%|███▏      | 118201/371472 [9:24:29<20:35:55,  3.42it/s]
 32%|███▏      | 118202/371472 [9:24:29<19:54:01,  3.54it/s]
 32%|███▏      | 118203/371472 [9:24:30<19:19:59,  3.64it/s]
 32%|███▏      | 118204/371472 [9:24:30<18:52:59,  3.73it/s]
 32%|███▏      | 118205/371472 [9:24:30<19:57:59,  3.52it/s]
 32%|███▏      | 118206/371472 [9:24:31<20:06:06,  3.50it/s]
 32%|███▏      | 118207/371472 [9:24:31<19:27:10,  3.62it/s]
 32%|███▏      | 118208/371472 [9:24:31<19:01:47,  3.70it/s]
 32%|███▏      | 118209/371472 [9:24:31<19:57:01,  3.53it/s]
 32%|███▏      | 118210/371472 [9:24:32<20:59:27,  3.35it/s]
 32%|███▏      | 118211/371472 [9:24:32<19:42:23,  3.57it/s]
 32%|███▏      | 118212/371472 [9:24:32<18:54:29,  3.72it/s]
 32%|███▏      | 118213/371472 [9:24:32<18:36:18,  3.78it/s]
 32%|███▏      | 118214/371472 [9:24:33<19:35:57,  3.59it/s]
 32%|███▏      | 118215/371472 [9:24:33<19:46:54,  3.56it/s]
 32%|███▏      | 118216/371472 [9:24:33<20:01:49,  3.51it/s]
 32%|███▏      | 118217/371472 [9:24:34<19:35:37,  3.59it/s]
 32%|███▏      | 118218/371472 [9:24:34<20:57:49,  3.36it/s]
 32%|███▏      | 118219/371472 [9:24:34<20:09:04,  3.49it/s]
 32%|███▏      | 118220/371472 [9:24:34<19:28:12,  3.61it/s]
                                                            
{'loss': 3.4842, 'learning_rate': 7.139078626990454e-07, 'epoch': 5.09}

 32%|███▏      | 118220/371472 [9:24:35<19:28:12,  3.61it/s]
 32%|███▏      | 118221/371472 [9:24:35<18:50:28,  3.73it/s]
 32%|███▏      | 118222/371472 [9:24:35<19:36:29,  3.59it/s]
 32%|███▏      | 118223/371472 [9:24:35<19:55:22,  3.53it/s]
 32%|███▏      | 118224/371472 [9:24:36<20:27:32,  3.44it/s]
 32%|███▏      | 118225/371472 [9:24:36<20:34:16,  3.42it/s]
 32%|███▏      | 118226/371472 [9:24:36<20:16:43,  3.47it/s]
 32%|███▏      | 118227/371472 [9:24:37<20:42:01,  3.40it/s]
 32%|███▏      | 118228/371472 [9:24:37<20:03:33,  3.51it/s]
 32%|███▏      | 118229/371472 [9:24:37<19:42:36,  3.57it/s]
 32%|███▏      | 118230/371472 [9:24:37<20:31:04,  3.43it/s]
 32%|███▏      | 118231/371472 [9:24:38<19:43:02,  3.57it/s]
 32%|███▏      | 118232/371472 [9:24:38<19:35:55,  3.59it/s]
 32%|███▏      | 118233/371472 [9:24:38<19:04:23,  3.69it/s]
 32%|███▏      | 118234/371472 [9:24:38<19:04:37,  3.69it/s]
 32%|███▏      | 118235/371472 [9:24:39<19:07:54,  3.68it/s]
 32%|███▏      | 118236/371472 [9:24:39<18:37:30,  3.78it/s]
 32%|███▏      | 118237/371472 [9:24:39<18:43:43,  3.76it/s]
 32%|███▏      | 118238/371472 [9:24:40<18:50:20,  3.73it/s]
 32%|███▏      | 118239/371472 [9:24:40<18:29:55,  3.80it/s]
 32%|███▏      | 118240/371472 [9:24:40<18:40:42,  3.77it/s]
                                                            
{'loss': 3.2159, 'learning_rate': 7.138593807235666e-07, 'epoch': 5.09}

 32%|███▏      | 118240/371472 [9:24:40<18:40:42,  3.77it/s]
 32%|███▏      | 118241/371472 [9:24:40<18:22:39,  3.83it/s]
 32%|███▏      | 118242/371472 [9:24:41<18:32:10,  3.79it/s]
 32%|███▏      | 118243/371472 [9:24:41<18:33:37,  3.79it/s]
 32%|███▏      | 118244/371472 [9:24:41<18:15:35,  3.85it/s]
 32%|███▏      | 118245/371472 [9:24:41<19:08:42,  3.67it/s]
 32%|███▏      | 118246/371472 [9:24:42<19:04:19,  3.69it/s]
 32%|███▏      | 118247/371472 [9:24:42<19:16:29,  3.65it/s]
 32%|███▏      | 118248/371472 [9:24:42<19:27:23,  3.62it/s]
 32%|███▏      | 118249/371472 [9:24:43<21:00:58,  3.35it/s]
 32%|███▏      | 118250/371472 [9:24:43<19:54:44,  3.53it/s]
 32%|███▏      | 118251/371472 [9:24:43<20:48:13,  3.38it/s]
 32%|███▏      | 118252/371472 [9:24:43<20:01:00,  3.51it/s]
 32%|███▏      | 118253/371472 [9:24:44<20:01:20,  3.51it/s]
 32%|███▏      | 118254/371472 [9:24:44<19:43:21,  3.57it/s]
 32%|███▏      | 118255/371472 [9:24:44<19:35:13,  3.59it/s]
 32%|███▏      | 118256/371472 [9:24:44<19:52:41,  3.54it/s]
 32%|███▏      | 118257/371472 [9:24:45<19:42:51,  3.57it/s]
 32%|███▏      | 118258/371472 [9:24:45<20:09:18,  3.49it/s]
 32%|███▏      | 118259/371472 [9:24:45<20:47:07,  3.38it/s]
 32%|███▏      | 118260/371472 [9:24:46<20:10:14,  3.49it/s]
                                                            
{'loss': 3.2224, 'learning_rate': 7.138108987480876e-07, 'epoch': 5.09}

 32%|███▏      | 118260/371472 [9:24:46<20:10:14,  3.49it/s]
 32%|███▏      | 118261/371472 [9:24:46<20:42:46,  3.40it/s]
 32%|███▏      | 118262/371472 [9:24:46<20:27:01,  3.44it/s]
 32%|███▏      | 118263/371472 [9:24:47<20:32:14,  3.42it/s]
 32%|███▏      | 118264/371472 [9:24:47<21:03:56,  3.34it/s]
 32%|███▏      | 118265/371472 [9:24:47<20:39:06,  3.41it/s]
 32%|███▏      | 118266/371472 [9:24:47<19:52:14,  3.54it/s]
 32%|███▏      | 118267/371472 [9:24:48<19:14:20,  3.66it/s]
 32%|███▏      | 118268/371472 [9:24:48<20:07:26,  3.50it/s]
 32%|███▏      | 118269/371472 [9:24:48<20:24:33,  3.45it/s]
 32%|███▏      | 118270/371472 [9:24:49<20:21:19,  3.46it/s]
 32%|███▏      | 118271/371472 [9:24:49<19:38:05,  3.58it/s]
 32%|███▏      | 118272/371472 [9:24:49<21:29:38,  3.27it/s]
 32%|███▏      | 118273/371472 [9:24:49<20:59:27,  3.35it/s]
 32%|███▏      | 118274/371472 [9:24:50<20:59:47,  3.35it/s]
 32%|███▏      | 118275/371472 [9:24:50<20:30:21,  3.43it/s]
 32%|███▏      | 118276/371472 [9:24:50<19:39:55,  3.58it/s]
 32%|███▏      | 118277/371472 [9:24:51<19:47:28,  3.55it/s]
 32%|███▏      | 118278/371472 [9:24:51<19:45:06,  3.56it/s]
 32%|███▏      | 118279/371472 [9:24:51<19:52:33,  3.54it/s]
 32%|███▏      | 118280/371472 [9:24:51<19:18:47,  3.64it/s]
                                                            
{'loss': 3.3001, 'learning_rate': 7.137624167726087e-07, 'epoch': 5.09}

 32%|███▏      | 118280/371472 [9:24:51<19:18:47,  3.64it/s]
 32%|███▏      | 118281/371472 [9:24:52<19:10:58,  3.67it/s]
 32%|███▏      | 118282/371472 [9:24:52<18:57:45,  3.71it/s]
 32%|███▏      | 118283/371472 [9:24:52<19:19:34,  3.64it/s]
 32%|███▏      | 118284/371472 [9:24:53<20:34:24,  3.42it/s]
 32%|███▏      | 118285/371472 [9:24:53<21:14:23,  3.31it/s]
 32%|███▏      | 118286/371472 [9:24:53<20:27:38,  3.44it/s]
 32%|███▏      | 118287/371472 [9:24:53<20:20:05,  3.46it/s]
 32%|███▏      | 118288/371472 [9:24:54<19:56:16,  3.53it/s]
 32%|███▏      | 118289/371472 [9:24:54<20:21:36,  3.45it/s]
 32%|███▏      | 118290/371472 [9:24:54<20:26:57,  3.44it/s]
 32%|███▏      | 118291/371472 [9:24:55<22:10:29,  3.17it/s]
 32%|███▏      | 118292/371472 [9:24:55<22:24:30,  3.14it/s]
 32%|███▏      | 118293/371472 [9:24:55<22:20:04,  3.15it/s]
 32%|███▏      | 118294/371472 [9:24:56<21:03:26,  3.34it/s]
 32%|███▏      | 118295/371472 [9:24:56<20:07:26,  3.49it/s]
 32%|███▏      | 118296/371472 [9:24:56<19:37:19,  3.58it/s]
 32%|███▏      | 118297/371472 [9:24:56<19:46:59,  3.55it/s]
 32%|███▏      | 118298/371472 [9:24:57<20:58:20,  3.35it/s]
 32%|███▏      | 118299/371472 [9:24:57<20:21:22,  3.45it/s]
 32%|███▏      | 118300/371472 [9:24:57<19:44:36,  3.56it/s]
                                                            
{'loss': 3.1671, 'learning_rate': 7.137139347971299e-07, 'epoch': 5.1}

 32%|███▏      | 118300/371472 [9:24:57<19:44:36,  3.56it/s]
 32%|███▏      | 118301/371472 [9:24:57<19:28:41,  3.61it/s]
 32%|███▏      | 118302/371472 [9:24:58<19:56:48,  3.53it/s]
 32%|███▏      | 118303/371472 [9:24:58<20:22:39,  3.45it/s]
 32%|███▏      | 118304/371472 [9:24:58<21:10:14,  3.32it/s]
 32%|███▏      | 118305/371472 [9:24:59<20:57:45,  3.35it/s]
 32%|███▏      | 118306/371472 [9:24:59<20:40:48,  3.40it/s]
 32%|███▏      | 118307/371472 [9:24:59<20:22:21,  3.45it/s]
 32%|███▏      | 118308/371472 [9:25:00<20:08:45,  3.49it/s]
 32%|███▏      | 118309/371472 [9:25:00<19:32:16,  3.60it/s]
 32%|███▏      | 118310/371472 [9:25:00<19:06:50,  3.68it/s]
 32%|███▏      | 118311/371472 [9:25:00<19:48:36,  3.55it/s]
 32%|███▏      | 118312/371472 [9:25:01<19:24:24,  3.62it/s]
 32%|███▏      | 118313/371472 [9:25:01<19:30:20,  3.61it/s]
 32%|███▏      | 118314/371472 [9:25:01<19:26:04,  3.62it/s]
 32%|███▏      | 118315/371472 [9:25:01<18:58:24,  3.71it/s]
 32%|███▏      | 118316/371472 [9:25:02<18:40:46,  3.76it/s]
 32%|███▏      | 118317/371472 [9:25:02<18:56:58,  3.71it/s]
 32%|███▏      | 118318/371472 [9:25:02<19:32:32,  3.60it/s]
 32%|███▏      | 118319/371472 [9:25:03<20:02:58,  3.51it/s]
 32%|███▏      | 118320/371472 [9:25:03<20:16:41,  3.47it/s]
                                                            
{'loss': 3.2863, 'learning_rate': 7.13665452821651e-07, 'epoch': 5.1}

 32%|███▏      | 118320/371472 [9:25:03<20:16:41,  3.47it/s]
 32%|███▏      | 118321/371472 [9:25:03<19:55:38,  3.53it/s]
 32%|███▏      | 118322/371472 [9:25:03<19:41:08,  3.57it/s]
 32%|███▏      | 118323/371472 [9:25:04<20:00:10,  3.52it/s]
 32%|███▏      | 118324/371472 [9:25:04<21:10:38,  3.32it/s]
 32%|███▏      | 118325/371472 [9:25:04<20:44:06,  3.39it/s]
 32%|███▏      | 118326/371472 [9:25:05<20:13:22,  3.48it/s]
 32%|███▏      | 118327/371472 [9:25:05<19:24:28,  3.62it/s]
 32%|███▏      | 118328/371472 [9:25:05<18:59:53,  3.70it/s]
 32%|███▏      | 118329/371472 [9:25:05<19:03:21,  3.69it/s]
 32%|███▏      | 118330/371472 [9:25:06<19:03:18,  3.69it/s]
 32%|███▏      | 118331/371472 [9:25:06<19:03:37,  3.69it/s]
 32%|███▏      | 118332/371472 [9:25:06<20:23:18,  3.45it/s]
 32%|███▏      | 118333/371472 [9:25:07<19:52:01,  3.54it/s]
 32%|███▏      | 118334/371472 [9:25:07<19:53:17,  3.54it/s]
 32%|███▏      | 118335/371472 [9:25:07<19:57:56,  3.52it/s]
 32%|███▏      | 118336/371472 [9:25:07<19:25:49,  3.62it/s]
 32%|███▏      | 118337/371472 [9:25:08<20:14:26,  3.47it/s]
 32%|███▏      | 118338/371472 [9:25:08<19:27:56,  3.61it/s]
 32%|███▏      | 118339/371472 [9:25:08<20:18:04,  3.46it/s]
 32%|███▏      | 118340/371472 [9:25:09<20:40:34,  3.40it/s]
                                                            
{'loss': 3.4125, 'learning_rate': 7.13616970846172e-07, 'epoch': 5.1}

 32%|███▏      | 118340/371472 [9:25:09<20:40:34,  3.40it/s]
 32%|███▏      | 118341/371472 [9:25:09<20:17:55,  3.46it/s]
 32%|███▏      | 118342/371472 [9:25:09<19:25:03,  3.62it/s]
 32%|███▏      | 118343/371472 [9:25:09<20:41:45,  3.40it/s]
 32%|███▏      | 118344/371472 [9:25:10<20:42:54,  3.39it/s]
 32%|███▏      | 118345/371472 [9:25:10<20:23:03,  3.45it/s]
 32%|███▏      | 118346/371472 [9:25:10<20:08:44,  3.49it/s]
 32%|███▏      | 118347/371472 [9:25:11<19:44:16,  3.56it/s]
 32%|███▏      | 118348/371472 [9:25:11<19:22:43,  3.63it/s]
 32%|███▏      | 118349/371472 [9:25:11<20:27:28,  3.44it/s]
 32%|███▏      | 118350/371472 [9:25:11<20:05:43,  3.50it/s]
 32%|███▏      | 118351/371472 [9:25:12<19:37:30,  3.58it/s]
 32%|███▏      | 118352/371472 [9:25:12<20:03:43,  3.50it/s]
 32%|███▏      | 118353/371472 [9:25:12<19:30:45,  3.60it/s]
 32%|███▏      | 118354/371472 [9:25:13<21:11:13,  3.32it/s]
 32%|███▏      | 118355/371472 [9:25:13<20:27:20,  3.44it/s]
 32%|███▏      | 118356/371472 [9:25:13<19:37:13,  3.58it/s]
 32%|███▏      | 118357/371472 [9:25:13<20:42:15,  3.40it/s]
 32%|███▏      | 118358/371472 [9:25:14<20:54:50,  3.36it/s]
 32%|███▏      | 118359/371472 [9:25:14<20:15:09,  3.47it/s]
 32%|███▏      | 118360/371472 [9:25:14<20:00:45,  3.51it/s]
                                                            
{'loss': 3.1658, 'learning_rate': 7.135684888706931e-07, 'epoch': 5.1}

 32%|███▏      | 118360/371472 [9:25:14<20:00:45,  3.51it/s]
 32%|███▏      | 118361/371472 [9:25:15<20:21:17,  3.45it/s]
 32%|███▏      | 118362/371472 [9:25:15<21:00:16,  3.35it/s]
 32%|███▏      | 118363/371472 [9:25:15<20:10:29,  3.48it/s]
 32%|███▏      | 118364/371472 [9:25:15<19:46:33,  3.56it/s]
 32%|███▏      | 118365/371472 [9:25:16<19:19:58,  3.64it/s]
 32%|███▏      | 118366/371472 [9:25:16<18:35:30,  3.78it/s]
 32%|███▏      | 118367/371472 [9:25:16<18:38:44,  3.77it/s]
 32%|███▏      | 118368/371472 [9:25:16<18:24:06,  3.82it/s]
 32%|███▏      | 118369/371472 [9:25:17<19:08:07,  3.67it/s]
 32%|███▏      | 118370/371472 [9:25:17<18:28:05,  3.81it/s]
 32%|███▏      | 118371/371472 [9:25:17<18:34:06,  3.79it/s]
 32%|███▏      | 118372/371472 [9:25:17<18:15:46,  3.85it/s]
 32%|███▏      | 118373/371472 [9:25:18<19:46:12,  3.56it/s]
 32%|███▏      | 118374/371472 [9:25:18<19:29:02,  3.61it/s]
 32%|███▏      | 118375/371472 [9:25:18<19:35:51,  3.59it/s]
 32%|███▏      | 118376/371472 [9:25:19<19:48:55,  3.55it/s]
 32%|███▏      | 118377/371472 [9:25:19<19:28:24,  3.61it/s]
 32%|███▏      | 118378/371472 [9:25:19<20:34:25,  3.42it/s]
 32%|███▏      | 118379/371472 [9:25:20<20:00:10,  3.51it/s]
 32%|███▏      | 118380/371472 [9:25:20<19:52:12,  3.54it/s]
                                                            
{'loss': 3.4096, 'learning_rate': 7.135200068952143e-07, 'epoch': 5.1}

 32%|███▏      | 118380/371472 [9:25:20<19:52:12,  3.54it/s]
 32%|███▏      | 118381/371472 [9:25:20<20:04:33,  3.50it/s]
 32%|███▏      | 118382/371472 [9:25:20<19:45:19,  3.56it/s]
 32%|███▏      | 118383/371472 [9:25:21<20:01:04,  3.51it/s]
 32%|███▏      | 118384/371472 [9:25:21<19:41:06,  3.57it/s]
 32%|███▏      | 118385/371472 [9:25:21<19:29:10,  3.61it/s]
 32%|███▏      | 118386/371472 [9:25:21<19:44:45,  3.56it/s]
 32%|███▏      | 118387/371472 [9:25:22<19:30:42,  3.60it/s]
 32%|███▏      | 118388/371472 [9:25:22<19:58:30,  3.52it/s]
 32%|███▏      | 118389/371472 [9:25:22<21:36:35,  3.25it/s]
 32%|███▏      | 118390/371472 [9:25:23<20:30:06,  3.43it/s]
 32%|███▏      | 118391/371472 [9:25:23<20:59:31,  3.35it/s]
 32%|███▏      | 118392/371472 [9:25:23<20:44:08,  3.39it/s]
 32%|███▏      | 118393/371472 [9:25:24<20:03:51,  3.50it/s]
 32%|███▏      | 118394/371472 [9:25:24<20:58:14,  3.35it/s]
 32%|███▏      | 118395/371472 [9:25:24<21:38:12,  3.25it/s]
 32%|███▏      | 118396/371472 [9:25:24<20:43:44,  3.39it/s]
 32%|███▏      | 118397/371472 [9:25:25<20:24:37,  3.44it/s]
 32%|███▏      | 118398/371472 [9:25:25<20:25:06,  3.44it/s]
 32%|███▏      | 118399/371472 [9:25:25<20:04:20,  3.50it/s]
 32%|███▏      | 118400/371472 [9:25:26<22:01:19,  3.19it/s]
                                                            
{'loss': 3.1757, 'learning_rate': 7.134715249197353e-07, 'epoch': 5.1}

 32%|███▏      | 118400/371472 [9:25:26<22:01:19,  3.19it/s]
 32%|███▏      | 118401/371472 [9:25:26<21:15:26,  3.31it/s]
 32%|███▏      | 118402/371472 [9:25:26<22:03:03,  3.19it/s]
 32%|███▏      | 118403/371472 [9:25:27<21:00:50,  3.35it/s]
 32%|███▏      | 118404/371472 [9:25:27<21:15:41,  3.31it/s]
 32%|███▏      | 118405/371472 [9:25:27<20:40:07,  3.40it/s]
 32%|███▏      | 118406/371472 [9:25:27<21:01:42,  3.34it/s]
 32%|███▏      | 118407/371472 [9:25:28<21:21:20,  3.29it/s]
 32%|███▏      | 118408/371472 [9:25:28<20:27:44,  3.44it/s]
 32%|███▏      | 118409/371472 [9:25:28<20:33:02,  3.42it/s]
 32%|███▏      | 118410/371472 [9:25:29<20:34:13,  3.42it/s]
 32%|███▏      | 118411/371472 [9:25:29<20:17:37,  3.46it/s]
 32%|███▏      | 118412/371472 [9:25:29<19:53:10,  3.53it/s]
 32%|███▏      | 118413/371472 [9:25:30<21:45:52,  3.23it/s]
 32%|███▏      | 118414/371472 [9:25:30<20:39:06,  3.40it/s]
 32%|███▏      | 118415/371472 [9:25:30<20:19:30,  3.46it/s]
 32%|███▏      | 118416/371472 [9:25:30<19:57:18,  3.52it/s]
 32%|███▏      | 118417/371472 [9:25:31<19:51:15,  3.54it/s]
 32%|███▏      | 118418/371472 [9:25:31<20:03:24,  3.50it/s]
 32%|███▏      | 118419/371472 [9:25:31<20:16:25,  3.47it/s]
 32%|███▏      | 118420/371472 [9:25:31<20:02:38,  3.51it/s]
                                                            
{'loss': 3.4005, 'learning_rate': 7.134230429442565e-07, 'epoch': 5.1}

 32%|███▏      | 118420/371472 [9:25:31<20:02:38,  3.51it/s]
 32%|███▏      | 118421/371472 [9:25:32<19:25:51,  3.62it/s]
 32%|███▏      | 118422/371472 [9:25:32<19:06:33,  3.68it/s]
 32%|███▏      | 118423/371472 [9:25:32<19:41:33,  3.57it/s]
 32%|███▏      | 118424/371472 [9:25:33<19:06:06,  3.68it/s]
 32%|███▏      | 118425/371472 [9:25:33<20:06:41,  3.50it/s]
 32%|███▏      | 118426/371472 [9:25:33<20:14:01,  3.47it/s]
 32%|███▏      | 118427/371472 [9:25:33<20:03:32,  3.50it/s]
 32%|███▏      | 118428/371472 [9:25:34<19:36:38,  3.58it/s]
 32%|███▏      | 118429/371472 [9:25:34<18:57:37,  3.71it/s]
 32%|███▏      | 118430/371472 [9:25:34<20:40:14,  3.40it/s]
 32%|███▏      | 118431/371472 [9:25:35<21:21:59,  3.29it/s]
 32%|███▏      | 118432/371472 [9:25:35<20:07:54,  3.49it/s]
 32%|███▏      | 118433/371472 [9:25:35<20:02:25,  3.51it/s]
 32%|███▏      | 118434/371472 [9:25:35<20:01:18,  3.51it/s]
 32%|███▏      | 118435/371472 [9:25:36<19:48:04,  3.55it/s]
 32%|███▏      | 118436/371472 [9:25:36<18:57:25,  3.71it/s]
 32%|███▏      | 118437/371472 [9:25:36<18:25:54,  3.81it/s]
 32%|███▏      | 118438/371472 [9:25:37<20:24:08,  3.45it/s]
 32%|███▏      | 118439/371472 [9:25:37<19:32:09,  3.60it/s]
 32%|███▏      | 118440/371472 [9:25:37<19:08:36,  3.67it/s]
                                                            
{'loss': 3.4536, 'learning_rate': 7.133745609687776e-07, 'epoch': 5.1}

 32%|███▏      | 118440/371472 [9:25:37<19:08:36,  3.67it/s]
 32%|███▏      | 118441/371472 [9:25:37<19:57:33,  3.52it/s]
 32%|███▏      | 118442/371472 [9:25:38<20:06:48,  3.49it/s]
 32%|███▏      | 118443/371472 [9:25:38<19:49:03,  3.55it/s]
 32%|███▏      | 118444/371472 [9:25:38<20:48:04,  3.38it/s]
 32%|███▏      | 118445/371472 [9:25:39<20:54:19,  3.36it/s]
 32%|███▏      | 118446/371472 [9:25:39<20:45:40,  3.39it/s]
 32%|███▏      | 118447/371472 [9:25:39<21:56:59,  3.20it/s]
 32%|███▏      | 118448/371472 [9:25:39<20:35:59,  3.41it/s]
 32%|███▏      | 118449/371472 [9:25:40<21:14:02,  3.31it/s]
 32%|███▏      | 118450/371472 [9:25:40<20:55:05,  3.36it/s]
 32%|███▏      | 118451/371472 [9:25:40<20:19:50,  3.46it/s]
 32%|███▏      | 118452/371472 [9:25:41<19:31:41,  3.60it/s]
 32%|███▏      | 118453/371472 [9:25:41<19:13:14,  3.66it/s]
 32%|███▏      | 118454/371472 [9:25:41<18:40:54,  3.76it/s]
 32%|███▏      | 118455/371472 [9:25:42<21:27:37,  3.27it/s]
 32%|███▏      | 118456/371472 [9:25:42<20:47:46,  3.38it/s]
 32%|███▏      | 118457/371472 [9:25:42<19:56:00,  3.53it/s]
 32%|███▏      | 118458/371472 [9:25:42<19:33:25,  3.59it/s]
 32%|███▏      | 118459/371472 [9:25:43<18:57:55,  3.71it/s]
 32%|███▏      | 118460/371472 [9:25:43<18:59:47,  3.70it/s]
                                                            
{'loss': 3.3017, 'learning_rate': 7.133260789932987e-07, 'epoch': 5.1}

 32%|███▏      | 118460/371472 [9:25:43<18:59:47,  3.70it/s]
 32%|███▏      | 118461/371472 [9:25:43<19:14:19,  3.65it/s]
 32%|███▏      | 118462/371472 [9:25:43<19:21:47,  3.63it/s]
 32%|███▏      | 118463/371472 [9:25:44<20:15:59,  3.47it/s]
 32%|███▏      | 118464/371472 [9:25:44<20:40:43,  3.40it/s]
 32%|███▏      | 118465/371472 [9:25:44<20:45:56,  3.38it/s]
 32%|███▏      | 118466/371472 [9:25:45<20:05:43,  3.50it/s]
 32%|███▏      | 118467/371472 [9:25:45<19:12:53,  3.66it/s]
 32%|███▏      | 118468/371472 [9:25:45<19:11:26,  3.66it/s]
 32%|███▏      | 118469/371472 [9:25:45<19:06:46,  3.68it/s]
 32%|███▏      | 118470/371472 [9:25:46<19:18:51,  3.64it/s]
 32%|███▏      | 118471/371472 [9:25:46<20:18:38,  3.46it/s]
 32%|███▏      | 118472/371472 [9:25:46<19:58:22,  3.52it/s]
 32%|███▏      | 118473/371472 [9:25:47<20:10:34,  3.48it/s]
 32%|███▏      | 118474/371472 [9:25:47<19:54:44,  3.53it/s]
 32%|███▏      | 118475/371472 [9:25:47<19:46:03,  3.56it/s]
 32%|███▏      | 118476/371472 [9:25:47<19:40:47,  3.57it/s]
 32%|███▏      | 118477/371472 [9:25:48<19:23:46,  3.62it/s]
 32%|███▏      | 118478/371472 [9:25:48<19:10:13,  3.67it/s]
 32%|███▏      | 118479/371472 [9:25:48<18:52:23,  3.72it/s]
 32%|███▏      | 118480/371472 [9:25:48<18:45:03,  3.75it/s]
                                                            
{'loss': 3.2372, 'learning_rate': 7.132775970178197e-07, 'epoch': 5.1}

 32%|███▏      | 118480/371472 [9:25:48<18:45:03,  3.75it/s]
 32%|███▏      | 118481/371472 [9:25:49<20:27:11,  3.44it/s]
 32%|███▏      | 118482/371472 [9:25:49<21:19:14,  3.30it/s]
 32%|███▏      | 118483/371472 [9:25:49<21:03:25,  3.34it/s]
 32%|███▏      | 118484/371472 [9:25:50<21:41:44,  3.24it/s]
 32%|███▏      | 118485/371472 [9:25:50<21:06:55,  3.33it/s]
 32%|███▏      | 118486/371472 [9:25:50<21:15:01,  3.31it/s]
 32%|███▏      | 118487/371472 [9:25:51<20:26:29,  3.44it/s]
 32%|███▏      | 118488/371472 [9:25:51<20:07:25,  3.49it/s]
 32%|███▏      | 118489/371472 [9:25:51<21:16:15,  3.30it/s]
 32%|███▏      | 118490/371472 [9:25:51<21:05:51,  3.33it/s]
 32%|███▏      | 118491/371472 [9:25:52<20:20:16,  3.46it/s]
 32%|███▏      | 118492/371472 [9:25:52<21:14:22,  3.31it/s]
 32%|███▏      | 118493/371472 [9:25:52<20:46:34,  3.38it/s]
 32%|███▏      | 118494/371472 [9:25:53<21:00:47,  3.34it/s]
 32%|███▏      | 118495/371472 [9:25:53<20:55:34,  3.36it/s]
 32%|███▏      | 118496/371472 [9:25:53<21:42:57,  3.24it/s]
 32%|███▏      | 118497/371472 [9:25:54<20:35:30,  3.41it/s]
 32%|███▏      | 118498/371472 [9:25:54<21:05:05,  3.33it/s]
 32%|███▏      | 118499/371472 [9:25:54<19:50:11,  3.54it/s]
 32%|███▏      | 118500/371472 [9:25:54<19:50:21,  3.54it/s]
                                                            
{'loss': 3.1772, 'learning_rate': 7.132291150423408e-07, 'epoch': 5.1}

 32%|███▏      | 118500/371472 [9:25:54<19:50:21,  3.54it/s]
 32%|███▏      | 118501/371472 [9:25:55<20:27:31,  3.43it/s]
 32%|███▏      | 118502/371472 [9:25:55<19:53:12,  3.53it/s]
 32%|███▏      | 118503/371472 [9:25:55<20:01:16,  3.51it/s]
 32%|███▏      | 118504/371472 [9:25:56<20:39:44,  3.40it/s]
 32%|███▏      | 118505/371472 [9:25:56<20:17:39,  3.46it/s]
 32%|███▏      | 118506/371472 [9:25:56<19:29:43,  3.60it/s]
 32%|███▏      | 118507/371472 [9:25:56<19:05:30,  3.68it/s]
 32%|███▏      | 118508/371472 [9:25:57<18:51:50,  3.72it/s]
 32%|███▏      | 118509/371472 [9:25:57<21:11:59,  3.31it/s]
 32%|███▏      | 118510/371472 [9:25:57<20:47:01,  3.38it/s]
 32%|███▏      | 118511/371472 [9:25:58<23:01:00,  3.05it/s]
 32%|███▏      | 118512/371472 [9:25:58<21:39:01,  3.25it/s]
 32%|███▏      | 118513/371472 [9:25:58<21:01:22,  3.34it/s]
 32%|███▏      | 118514/371472 [9:25:59<21:56:06,  3.20it/s]
 32%|███▏      | 118515/371472 [9:25:59<21:20:19,  3.29it/s]
 32%|███▏      | 118516/371472 [9:25:59<21:53:20,  3.21it/s]
 32%|███▏      | 118517/371472 [9:25:59<20:56:15,  3.36it/s]
 32%|███▏      | 118518/371472 [9:26:00<20:11:30,  3.48it/s]
 32%|███▏      | 118519/371472 [9:26:00<19:39:44,  3.57it/s]
 32%|███▏      | 118520/371472 [9:26:00<19:42:19,  3.57it/s]
                                                            
{'loss': 3.141, 'learning_rate': 7.13180633066862e-07, 'epoch': 5.1}

 32%|███▏      | 118520/371472 [9:26:00<19:42:19,  3.57it/s]
 32%|███▏      | 118521/371472 [9:26:01<20:09:25,  3.49it/s]
 32%|███▏      | 118522/371472 [9:26:01<19:30:38,  3.60it/s]
 32%|███▏      | 118523/371472 [9:26:01<19:09:57,  3.67it/s]
 32%|███▏      | 118524/371472 [9:26:01<18:43:06,  3.75it/s]
 32%|███▏      | 118525/371472 [9:26:02<21:23:37,  3.28it/s]
 32%|███▏      | 118526/371472 [9:26:02<22:00:16,  3.19it/s]
 32%|███▏      | 118527/371472 [9:26:02<21:07:45,  3.33it/s]
 32%|███▏      | 118528/371472 [9:26:03<20:35:24,  3.41it/s]
 32%|███▏      | 118529/371472 [9:26:03<19:28:01,  3.61it/s]
 32%|███▏      | 118530/371472 [9:26:03<19:10:43,  3.66it/s]
 32%|███▏      | 118531/371472 [9:26:03<19:28:53,  3.61it/s]
 32%|███▏      | 118532/371472 [9:26:04<19:03:27,  3.69it/s]
 32%|███▏      | 118533/371472 [9:26:04<19:51:55,  3.54it/s]
 32%|███▏      | 118534/371472 [9:26:04<21:26:39,  3.28it/s]
 32%|███▏      | 118535/371472 [9:26:05<21:31:15,  3.26it/s]
 32%|███▏      | 118536/371472 [9:26:05<20:17:00,  3.46it/s]
 32%|███▏      | 118537/371472 [9:26:05<20:48:10,  3.38it/s]
 32%|███▏      | 118538/371472 [9:26:05<20:56:32,  3.35it/s]
 32%|███▏      | 118539/371472 [9:26:06<21:01:56,  3.34it/s]
 32%|███▏      | 118540/371472 [9:26:06<20:21:37,  3.45it/s]
                                                            
{'loss': 3.2798, 'learning_rate': 7.131321510913832e-07, 'epoch': 5.11}

 32%|███▏      | 118540/371472 [9:26:06<20:21:37,  3.45it/s]
 32%|███▏      | 118541/371472 [9:26:06<20:50:24,  3.37it/s]
 32%|███▏      | 118542/371472 [9:26:07<20:29:00,  3.43it/s]
 32%|███▏      | 118543/371472 [9:26:07<20:43:57,  3.39it/s]
 32%|███▏      | 118544/371472 [9:26:07<20:40:33,  3.40it/s]
 32%|███▏      | 118545/371472 [9:26:08<20:02:29,  3.51it/s]
 32%|███▏      | 118546/371472 [9:26:08<19:54:00,  3.53it/s]
 32%|███▏      | 118547/371472 [9:26:08<19:38:25,  3.58it/s]
 32%|███▏      | 118548/371472 [9:26:08<20:00:07,  3.51it/s]
 32%|███▏      | 118549/371472 [9:26:09<19:42:28,  3.56it/s]
 32%|███▏      | 118550/371472 [9:26:09<20:17:09,  3.46it/s]
 32%|███▏      | 118551/371472 [9:26:09<19:38:16,  3.58it/s]
 32%|███▏      | 118552/371472 [9:26:09<19:48:05,  3.55it/s]
 32%|███▏      | 118553/371472 [9:26:10<19:26:05,  3.61it/s]
 32%|███▏      | 118554/371472 [9:26:10<19:58:08,  3.52it/s]
 32%|███▏      | 118555/371472 [9:26:10<19:45:41,  3.56it/s]
 32%|███▏      | 118556/371472 [9:26:11<20:06:41,  3.49it/s]
 32%|███▏      | 118557/371472 [9:26:11<20:08:13,  3.49it/s]
 32%|███▏      | 118558/371472 [9:26:11<19:55:29,  3.53it/s]
 32%|███▏      | 118559/371472 [9:26:11<20:17:10,  3.46it/s]
 32%|███▏      | 118560/371472 [9:26:12<20:04:46,  3.50it/s]
                                                            
{'loss': 3.2898, 'learning_rate': 7.130836691159042e-07, 'epoch': 5.11}

 32%|███▏      | 118560/371472 [9:26:12<20:04:46,  3.50it/s]
 32%|███▏      | 118561/371472 [9:26:12<19:43:32,  3.56it/s]
 32%|███▏      | 118562/371472 [9:26:12<19:30:57,  3.60it/s]
 32%|███▏      | 118563/371472 [9:26:13<20:03:13,  3.50it/s]
 32%|███▏      | 118564/371472 [9:26:13<20:32:17,  3.42it/s]
 32%|███▏      | 118565/371472 [9:26:13<22:30:19,  3.12it/s]
 32%|███▏      | 118566/371472 [9:26:14<21:22:27,  3.29it/s]
 32%|███▏      | 118567/371472 [9:26:14<20:37:39,  3.41it/s]
 32%|███▏      | 118568/371472 [9:26:14<21:31:03,  3.26it/s]
 32%|███▏      | 118569/371472 [9:26:15<23:00:10,  3.05it/s]
 32%|███▏      | 118570/371472 [9:26:15<22:19:21,  3.15it/s]
 32%|███▏      | 118571/371472 [9:26:15<20:51:15,  3.37it/s]
 32%|███▏      | 118572/371472 [9:26:15<20:23:13,  3.45it/s]
 32%|███▏      | 118573/371472 [9:26:16<20:28:25,  3.43it/s]
 32%|███▏      | 118574/371472 [9:26:16<19:57:34,  3.52it/s]
 32%|███▏      | 118575/371472 [9:26:16<20:18:59,  3.46it/s]
 32%|███▏      | 118576/371472 [9:26:16<19:32:21,  3.60it/s]
 32%|███▏      | 118577/371472 [9:26:17<22:05:40,  3.18it/s]
 32%|███▏      | 118578/371472 [9:26:17<21:04:22,  3.33it/s]
 32%|███▏      | 118579/371472 [9:26:17<21:19:16,  3.29it/s]
 32%|███▏      | 118580/371472 [9:26:18<20:23:32,  3.44it/s]
                                                            
{'loss': 3.4141, 'learning_rate': 7.130351871404253e-07, 'epoch': 5.11}

 32%|███▏      | 118580/371472 [9:26:18<20:23:32,  3.44it/s]
 32%|███▏      | 118581/371472 [9:26:18<19:49:35,  3.54it/s]
 32%|███▏      | 118582/371472 [9:26:18<20:22:37,  3.45it/s]
 32%|███▏      | 118583/371472 [9:26:19<20:19:22,  3.46it/s]
 32%|███▏      | 118584/371472 [9:26:19<20:25:39,  3.44it/s]
 32%|███▏      | 118585/371472 [9:26:19<19:41:03,  3.57it/s]
 32%|███▏      | 118586/371472 [9:26:19<20:21:11,  3.45it/s]
 32%|███▏      | 118587/371472 [9:26:20<19:58:47,  3.52it/s]
 32%|███▏      | 118588/371472 [9:26:20<19:31:27,  3.60it/s]
 32%|███▏      | 118589/371472 [9:26:20<19:28:55,  3.61it/s]
 32%|███▏      | 118590/371472 [9:26:20<18:43:13,  3.75it/s]
 32%|███▏      | 118591/371472 [9:26:21<20:06:33,  3.49it/s]
 32%|███▏      | 118592/371472 [9:26:21<21:56:24,  3.20it/s]
 32%|███▏      | 118593/371472 [9:26:21<21:04:10,  3.33it/s]
 32%|███▏      | 118594/371472 [9:26:22<20:24:25,  3.44it/s]
 32%|███▏      | 118595/371472 [9:26:22<19:51:56,  3.54it/s]
 32%|███▏      | 118596/371472 [9:26:22<18:58:16,  3.70it/s]
 32%|███▏      | 118597/371472 [9:26:23<20:51:18,  3.37it/s]
 32%|███▏      | 118598/371472 [9:26:23<20:31:22,  3.42it/s]
 32%|███▏      | 118599/371472 [9:26:23<21:03:45,  3.33it/s]
 32%|███▏      | 118600/371472 [9:26:23<20:44:15,  3.39it/s]
                                                            
{'loss': 3.2897, 'learning_rate': 7.129867051649464e-07, 'epoch': 5.11}

 32%|███▏      | 118600/371472 [9:26:23<20:44:15,  3.39it/s]
 32%|███▏      | 118601/371472 [9:26:24<20:15:31,  3.47it/s]
 32%|███▏      | 118602/371472 [9:26:24<21:05:18,  3.33it/s]
 32%|███▏      | 118603/371472 [9:26:24<19:53:18,  3.53it/s]
 32%|███▏      | 118604/371472 [9:26:25<19:44:21,  3.56it/s]
 32%|███▏      | 118605/371472 [9:26:25<19:09:35,  3.67it/s]
 32%|███▏      | 118606/371472 [9:26:25<19:08:24,  3.67it/s]
 32%|███▏      | 118607/371472 [9:26:25<20:14:17,  3.47it/s]
 32%|███▏      | 118608/371472 [9:26:26<20:31:16,  3.42it/s]
 32%|███▏      | 118609/371472 [9:26:26<20:08:01,  3.49it/s]
 32%|███▏      | 118610/371472 [9:26:26<19:21:14,  3.63it/s]
 32%|███▏      | 118611/371472 [9:26:27<18:40:15,  3.76it/s]
 32%|███▏      | 118612/371472 [9:26:27<18:16:48,  3.84it/s]
 32%|███▏      | 118613/371472 [9:26:27<18:32:46,  3.79it/s]
 32%|███▏      | 118614/371472 [9:26:27<18:44:07,  3.75it/s]
 32%|███▏      | 118615/371472 [9:26:28<18:45:56,  3.74it/s]
 32%|███▏      | 118616/371472 [9:26:28<18:59:33,  3.70it/s]
 32%|███▏      | 118617/371472 [9:26:28<19:43:07,  3.56it/s]
 32%|███▏      | 118618/371472 [9:26:28<19:42:27,  3.56it/s]
 32%|███▏      | 118619/371472 [9:26:29<20:20:13,  3.45it/s]
 32%|███▏      | 118620/371472 [9:26:29<19:59:31,  3.51it/s]
                                                            
{'loss': 3.34, 'learning_rate': 7.129382231894675e-07, 'epoch': 5.11}

 32%|███▏      | 118620/371472 [9:26:29<19:59:31,  3.51it/s]
 32%|███▏      | 118621/371472 [9:26:29<19:36:08,  3.58it/s]
 32%|███▏      | 118622/371472 [9:26:30<18:47:17,  3.74it/s]
 32%|███▏      | 118623/371472 [9:26:30<18:41:46,  3.76it/s]
 32%|███▏      | 118624/371472 [9:26:30<18:31:36,  3.79it/s]
 32%|███▏      | 118625/371472 [9:26:30<19:29:32,  3.60it/s]
 32%|███▏      | 118626/371472 [9:26:31<19:28:03,  3.61it/s]
 32%|███▏      | 118627/371472 [9:26:31<19:25:07,  3.62it/s]
 32%|███▏      | 118628/371472 [9:26:31<19:24:55,  3.62it/s]
 32%|███▏      | 118629/371472 [9:26:31<18:47:22,  3.74it/s]
 32%|███▏      | 118630/371472 [9:26:32<19:20:00,  3.63it/s]
 32%|███▏      | 118631/371472 [9:26:32<21:01:15,  3.34it/s]
 32%|███▏      | 118632/371472 [9:26:32<22:00:09,  3.19it/s]
 32%|███▏      | 118633/371472 [9:26:33<22:44:12,  3.09it/s]
 32%|███▏      | 118634/371472 [9:26:33<22:07:13,  3.18it/s]
 32%|███▏      | 118635/371472 [9:26:33<20:34:51,  3.41it/s]
 32%|███▏      | 118636/371472 [9:26:34<19:31:09,  3.60it/s]
 32%|███▏      | 118637/371472 [9:26:34<19:02:35,  3.69it/s]
 32%|███▏      | 118638/371472 [9:26:34<21:19:49,  3.29it/s]
 32%|███▏      | 118639/371472 [9:26:34<21:06:31,  3.33it/s]
 32%|███▏      | 118640/371472 [9:26:35<20:28:22,  3.43it/s]
                                                            
{'loss': 3.3275, 'learning_rate': 7.128897412139886e-07, 'epoch': 5.11}

 32%|███▏      | 118640/371472 [9:26:35<20:28:22,  3.43it/s]
 32%|███▏      | 118641/371472 [9:26:35<19:45:41,  3.55it/s]
 32%|███▏      | 118642/371472 [9:26:35<20:19:23,  3.46it/s]
 32%|███▏      | 118643/371472 [9:26:36<21:07:45,  3.32it/s]
 32%|███▏      | 118644/371472 [9:26:36<20:58:19,  3.35it/s]
 32%|███▏      | 118645/371472 [9:26:36<20:15:51,  3.47it/s]
 32%|███▏      | 118646/371472 [9:26:37<21:20:17,  3.29it/s]
 32%|███▏      | 118647/371472 [9:26:37<19:59:38,  3.51it/s]
 32%|███▏      | 118648/371472 [9:26:37<19:36:53,  3.58it/s]
 32%|███▏      | 118649/371472 [9:26:37<20:15:50,  3.47it/s]
 32%|███▏      | 118650/371472 [9:26:38<20:42:23,  3.39it/s]
 32%|███▏      | 118651/371472 [9:26:38<20:57:33,  3.35it/s]
 32%|███▏      | 118652/371472 [9:26:38<24:38:19,  2.85it/s]
 32%|███▏      | 118653/371472 [9:26:39<22:33:14,  3.11it/s]
 32%|███▏      | 118654/371472 [9:26:39<21:46:04,  3.23it/s]
 32%|███▏      | 118655/371472 [9:26:39<22:15:33,  3.15it/s]
 32%|███▏      | 118656/371472 [9:26:40<20:46:05,  3.38it/s]
 32%|███▏      | 118657/371472 [9:26:40<19:52:11,  3.53it/s]
 32%|███▏      | 118658/371472 [9:26:40<20:04:35,  3.50it/s]
 32%|███▏      | 118659/371472 [9:26:40<19:35:07,  3.59it/s]
 32%|███▏      | 118660/371472 [9:26:41<19:30:26,  3.60it/s]
                                                            
{'loss': 3.3727, 'learning_rate': 7.128412592385097e-07, 'epoch': 5.11}

 32%|███▏      | 118660/371472 [9:26:41<19:30:26,  3.60it/s]
 32%|███▏      | 118661/371472 [9:26:41<20:24:29,  3.44it/s]
 32%|███▏      | 118662/371472 [9:26:41<20:24:13,  3.44it/s]
 32%|███▏      | 118663/371472 [9:26:42<21:36:07,  3.25it/s]
 32%|███▏      | 118664/371472 [9:26:42<22:36:54,  3.11it/s]
 32%|███▏      | 118665/371472 [9:26:42<21:22:36,  3.29it/s]
 32%|███▏      | 118666/371472 [9:26:43<22:35:02,  3.11it/s]
 32%|███▏      | 118667/371472 [9:26:43<22:10:58,  3.17it/s]
 32%|███▏      | 118668/371472 [9:26:43<21:06:32,  3.33it/s]
 32%|███▏      | 118669/371472 [9:26:43<20:22:24,  3.45it/s]
 32%|███▏      | 118670/371472 [9:26:44<20:33:54,  3.41it/s]
 32%|███▏      | 118671/371472 [9:26:44<21:50:00,  3.22it/s]
 32%|███▏      | 118672/371472 [9:26:44<21:57:00,  3.20it/s]
 32%|███▏      | 118673/371472 [9:26:45<21:52:46,  3.21it/s]
 32%|███▏      | 118674/371472 [9:26:45<20:45:35,  3.38it/s]
 32%|███▏      | 118675/371472 [9:26:45<21:04:41,  3.33it/s]
 32%|███▏      | 118676/371472 [9:26:46<21:09:43,  3.32it/s]
 32%|███▏      | 118677/371472 [9:26:46<20:03:12,  3.50it/s]
 32%|███▏      | 118678/371472 [9:26:46<20:10:17,  3.48it/s]
 32%|███▏      | 118679/371472 [9:26:46<19:22:13,  3.63it/s]
 32%|███▏      | 118680/371472 [9:26:47<18:54:48,  3.71it/s]
                                                            
{'loss': 3.0476, 'learning_rate': 7.127927772630309e-07, 'epoch': 5.11}

 32%|███▏      | 118680/371472 [9:26:47<18:54:48,  3.71it/s]
 32%|███▏      | 118681/371472 [9:26:47<18:41:19,  3.76it/s]
 32%|███▏      | 118682/371472 [9:26:47<19:46:48,  3.55it/s]
 32%|███▏      | 118683/371472 [9:26:47<19:54:29,  3.53it/s]
 32%|███▏      | 118684/371472 [9:26:48<19:01:34,  3.69it/s]
 32%|███▏      | 118685/371472 [9:26:48<18:41:32,  3.76it/s]
 32%|███▏      | 118686/371472 [9:26:48<20:11:33,  3.48it/s]
 32%|███▏      | 118687/371472 [9:26:49<20:16:35,  3.46it/s]
 32%|███▏      | 118688/371472 [9:26:49<20:54:20,  3.36it/s]
 32%|███▏      | 118689/371472 [9:26:49<20:03:51,  3.50it/s]
 32%|███▏      | 118690/371472 [9:26:49<19:16:09,  3.64it/s]
 32%|███▏      | 118691/371472 [9:26:50<20:17:13,  3.46it/s]
 32%|███▏      | 118692/371472 [9:26:50<21:54:17,  3.21it/s]
 32%|███▏      | 118693/371472 [9:26:51<24:14:35,  2.90it/s]
 32%|███▏      | 118694/371472 [9:26:51<22:38:24,  3.10it/s]
 32%|███▏      | 118695/371472 [9:26:51<22:56:42,  3.06it/s]
 32%|███▏      | 118696/371472 [9:26:51<21:48:35,  3.22it/s]
 32%|███▏      | 118697/371472 [9:26:52<20:49:55,  3.37it/s]
 32%|███▏      | 118698/371472 [9:26:52<20:02:34,  3.50it/s]
 32%|███▏      | 118699/371472 [9:26:52<20:18:54,  3.46it/s]
 32%|███▏      | 118700/371472 [9:26:53<19:33:12,  3.59it/s]
                                                            
{'loss': 3.1781, 'learning_rate': 7.12744295287552e-07, 'epoch': 5.11}

 32%|███▏      | 118700/371472 [9:26:53<19:33:12,  3.59it/s]
 32%|███▏      | 118701/371472 [9:26:53<19:05:03,  3.68it/s]
 32%|███▏      | 118702/371472 [9:26:53<19:11:56,  3.66it/s]
 32%|███▏      | 118703/371472 [9:26:53<18:46:55,  3.74it/s]
 32%|███▏      | 118704/371472 [9:26:54<18:30:31,  3.79it/s]
 32%|███▏      | 118705/371472 [9:26:54<18:49:12,  3.73it/s]
 32%|███▏      | 118706/371472 [9:26:54<19:38:03,  3.58it/s]
 32%|███▏      | 118707/371472 [9:26:54<20:12:43,  3.47it/s]
 32%|███▏      | 118708/371472 [9:26:55<19:44:19,  3.56it/s]
 32%|███▏      | 118709/371472 [9:26:55<19:17:51,  3.64it/s]
 32%|███▏      | 118710/371472 [9:26:55<18:32:09,  3.79it/s]
 32%|███▏      | 118711/371472 [9:26:55<18:19:55,  3.83it/s]
 32%|███▏      | 118712/371472 [9:26:56<18:22:03,  3.82it/s]
 32%|███▏      | 118713/371472 [9:26:56<18:33:22,  3.78it/s]
 32%|███▏      | 118714/371472 [9:26:56<19:21:07,  3.63it/s]
 32%|███▏      | 118715/371472 [9:26:57<20:33:23,  3.42it/s]
 32%|███▏      | 118716/371472 [9:26:57<20:37:32,  3.40it/s]
 32%|███▏      | 118717/371472 [9:26:57<19:28:44,  3.60it/s]
 32%|███▏      | 118718/371472 [9:26:57<19:19:20,  3.63it/s]
 32%|███▏      | 118719/371472 [9:26:58<19:12:36,  3.65it/s]
 32%|███▏      | 118720/371472 [9:26:58<18:45:09,  3.74it/s]
                                                            
{'loss': 3.3102, 'learning_rate': 7.126958133120729e-07, 'epoch': 5.11}

 32%|███▏      | 118720/371472 [9:26:58<18:45:09,  3.74it/s]
 32%|███▏      | 118721/371472 [9:26:58<18:47:25,  3.74it/s]
 32%|███▏      | 118722/371472 [9:26:59<20:10:55,  3.48it/s]
 32%|███▏      | 118723/371472 [9:26:59<20:01:47,  3.51it/s]
 32%|███▏      | 118724/371472 [9:26:59<21:07:06,  3.32it/s]
 32%|███▏      | 118725/371472 [9:26:59<20:14:04,  3.47it/s]
 32%|███▏      | 118726/371472 [9:27:00<19:42:50,  3.56it/s]
 32%|███▏      | 118727/371472 [9:27:00<20:32:54,  3.42it/s]
 32%|███▏      | 118728/371472 [9:27:00<20:24:37,  3.44it/s]
 32%|███▏      | 118729/371472 [9:27:01<20:30:02,  3.42it/s]
 32%|███▏      | 118730/371472 [9:27:01<20:15:39,  3.47it/s]
 32%|███▏      | 118731/371472 [9:27:01<19:28:41,  3.60it/s]
 32%|███▏      | 118732/371472 [9:27:01<19:15:04,  3.65it/s]
 32%|███▏      | 118733/371472 [9:27:02<20:13:31,  3.47it/s]
 32%|███▏      | 118734/371472 [9:27:02<21:49:40,  3.22it/s]
 32%|███▏      | 118735/371472 [9:27:02<21:36:38,  3.25it/s]
 32%|███▏      | 118736/371472 [9:27:03<21:42:41,  3.23it/s]
 32%|███▏      | 118737/371472 [9:27:03<21:13:38,  3.31it/s]
 32%|███▏      | 118738/371472 [9:27:03<20:58:08,  3.35it/s]
 32%|███▏      | 118739/371472 [9:27:04<19:45:56,  3.55it/s]
 32%|███▏      | 118740/371472 [9:27:04<19:41:35,  3.56it/s]
                                                            
{'loss': 3.4757, 'learning_rate': 7.126473313365941e-07, 'epoch': 5.11}

 32%|███▏      | 118740/371472 [9:27:04<19:41:35,  3.56it/s]
 32%|███▏      | 118741/371472 [9:27:04<18:51:36,  3.72it/s]
 32%|███▏      | 118742/371472 [9:27:04<18:21:51,  3.82it/s]
 32%|███▏      | 118743/371472 [9:27:05<19:13:17,  3.65it/s]
 32%|███▏      | 118744/371472 [9:27:05<19:08:45,  3.67it/s]
 32%|███▏      | 118745/371472 [9:27:05<19:22:37,  3.62it/s]
 32%|███▏      | 118746/371472 [9:27:05<21:05:21,  3.33it/s]
 32%|███▏      | 118747/371472 [9:27:06<19:48:23,  3.54it/s]
 32%|███▏      | 118748/371472 [9:27:06<21:12:59,  3.31it/s]
 32%|███▏      | 118749/371472 [9:27:06<21:02:28,  3.34it/s]
 32%|███▏      | 118750/371472 [9:27:07<20:39:55,  3.40it/s]
 32%|███▏      | 118751/371472 [9:27:07<19:43:14,  3.56it/s]
 32%|███▏      | 118752/371472 [9:27:07<19:38:28,  3.57it/s]
 32%|███▏      | 118753/371472 [9:27:07<19:05:55,  3.68it/s]
 32%|███▏      | 118754/371472 [9:27:08<20:01:50,  3.50it/s]
 32%|███▏      | 118755/371472 [9:27:08<19:53:20,  3.53it/s]
 32%|███▏      | 118756/371472 [9:27:08<20:21:09,  3.45it/s]
 32%|███▏      | 118757/371472 [9:27:09<20:37:03,  3.40it/s]
 32%|███▏      | 118758/371472 [9:27:09<19:53:27,  3.53it/s]
 32%|███▏      | 118759/371472 [9:27:09<19:19:48,  3.63it/s]
 32%|███▏      | 118760/371472 [9:27:09<19:36:31,  3.58it/s]
                                                            
{'loss': 3.3084, 'learning_rate': 7.125988493611153e-07, 'epoch': 5.12}

 32%|███▏      | 118760/371472 [9:27:09<19:36:31,  3.58it/s]
 32%|███▏      | 118761/371472 [9:27:10<20:05:46,  3.49it/s]
 32%|███▏      | 118762/371472 [9:27:10<19:33:19,  3.59it/s]
 32%|███▏      | 118763/371472 [9:27:10<19:48:08,  3.54it/s]
 32%|███▏      | 118764/371472 [9:27:11<19:11:06,  3.66it/s]
 32%|███▏      | 118765/371472 [9:27:11<18:33:51,  3.78it/s]
 32%|███▏      | 118766/371472 [9:27:11<21:31:56,  3.26it/s]
 32%|███▏      | 118767/371472 [9:27:11<20:05:21,  3.49it/s]
 32%|███▏      | 118768/371472 [9:27:12<20:37:00,  3.40it/s]
 32%|███▏      | 118769/371472 [9:27:12<20:12:09,  3.47it/s]
 32%|███▏      | 118770/371472 [9:27:12<20:08:46,  3.48it/s]
 32%|███▏      | 118771/371472 [9:27:13<19:48:10,  3.54it/s]
 32%|███▏      | 118772/371472 [9:27:13<19:50:15,  3.54it/s]
 32%|███▏      | 118773/371472 [9:27:13<19:30:52,  3.60it/s]
 32%|███▏      | 118774/371472 [9:27:13<18:58:34,  3.70it/s]
 32%|███▏      | 118775/371472 [9:27:14<18:28:49,  3.80it/s]
 32%|███▏      | 118776/371472 [9:27:14<19:08:04,  3.67it/s]
 32%|███▏      | 118777/371472 [9:27:14<18:59:27,  3.70it/s]
 32%|███▏      | 118778/371472 [9:27:14<18:28:46,  3.80it/s]
 32%|███▏      | 118779/371472 [9:27:15<18:14:05,  3.85it/s]
 32%|███▏      | 118780/371472 [9:27:15<18:15:30,  3.84it/s]
                                                            
{'loss': 3.3996, 'learning_rate': 7.125503673856364e-07, 'epoch': 5.12}

 32%|███▏      | 118780/371472 [9:27:15<18:15:30,  3.84it/s]
 32%|███▏      | 118781/371472 [9:27:15<20:19:46,  3.45it/s]
 32%|███▏      | 118782/371472 [9:27:16<20:02:28,  3.50it/s]
 32%|███▏      | 118783/371472 [9:27:16<19:16:02,  3.64it/s]
 32%|███▏      | 118784/371472 [9:27:16<20:20:26,  3.45it/s]
 32%|███▏      | 118785/371472 [9:27:16<21:25:46,  3.28it/s]
 32%|███▏      | 118786/371472 [9:27:17<20:40:01,  3.40it/s]
 32%|███▏      | 118787/371472 [9:27:17<20:21:45,  3.45it/s]
 32%|███▏      | 118788/371472 [9:27:17<19:35:39,  3.58it/s]
 32%|███▏      | 118789/371472 [9:27:18<19:35:55,  3.58it/s]
 32%|███▏      | 118790/371472 [9:27:18<19:25:29,  3.61it/s]
 32%|███▏      | 118791/371472 [9:27:18<20:07:57,  3.49it/s]
 32%|███▏      | 118792/371472 [9:27:18<19:38:03,  3.57it/s]
 32%|███▏      | 118793/371472 [9:27:19<20:08:59,  3.48it/s]
 32%|███▏      | 118794/371472 [9:27:19<19:57:33,  3.52it/s]
 32%|███▏      | 118795/371472 [9:27:19<20:24:31,  3.44it/s]
 32%|███▏      | 118796/371472 [9:27:20<22:16:44,  3.15it/s]
 32%|███▏      | 118797/371472 [9:27:20<22:20:49,  3.14it/s]
 32%|███▏      | 118798/371472 [9:27:20<21:39:05,  3.24it/s]
 32%|███▏      | 118799/371472 [9:27:21<21:18:28,  3.29it/s]
 32%|███▏      | 118800/371472 [9:27:21<20:21:12,  3.45it/s]
                                                            
{'loss': 3.447, 'learning_rate': 7.125018854101575e-07, 'epoch': 5.12}

 32%|███▏      | 118800/371472 [9:27:21<20:21:12,  3.45it/s]
 32%|███▏      | 118801/371472 [9:27:21<20:45:55,  3.38it/s]
 32%|███▏      | 118802/371472 [9:27:21<19:54:04,  3.53it/s]
 32%|███▏      | 118803/371472 [9:27:22<19:37:35,  3.58it/s]
 32%|███▏      | 118804/371472 [9:27:22<19:45:44,  3.55it/s]
 32%|███▏      | 118805/371472 [9:27:22<20:12:58,  3.47it/s]
 32%|███▏      | 118806/371472 [9:27:23<19:41:49,  3.56it/s]
 32%|███▏      | 118807/371472 [9:27:23<19:04:49,  3.68it/s]
 32%|███▏      | 118808/371472 [9:27:23<18:35:38,  3.77it/s]
 32%|███▏      | 118809/371472 [9:27:23<18:27:17,  3.80it/s]
 32%|███▏      | 118810/371472 [9:27:24<21:00:49,  3.34it/s]
 32%|███▏      | 118811/371472 [9:27:24<20:26:55,  3.43it/s]
 32%|███▏      | 118812/371472 [9:27:24<19:52:30,  3.53it/s]
 32%|███▏      | 118813/371472 [9:27:25<20:27:46,  3.43it/s]
 32%|███▏      | 118814/371472 [9:27:25<19:28:50,  3.60it/s]
 32%|███▏      | 118815/371472 [9:27:25<18:47:05,  3.74it/s]
 32%|███▏      | 118816/371472 [9:27:25<18:36:50,  3.77it/s]
 32%|███▏      | 118817/371472 [9:27:26<18:58:43,  3.70it/s]
 32%|███▏      | 118818/371472 [9:27:26<20:18:26,  3.46it/s]
 32%|███▏      | 118819/371472 [9:27:26<21:02:36,  3.34it/s]
 32%|███▏      | 118820/371472 [9:27:27<21:19:50,  3.29it/s]
                                                            
{'loss': 3.2432, 'learning_rate': 7.124534034346787e-07, 'epoch': 5.12}

 32%|███▏      | 118820/371472 [9:27:27<21:19:50,  3.29it/s]
 32%|███▏      | 118821/371472 [9:27:27<21:47:30,  3.22it/s]
 32%|███▏      | 118822/371472 [9:27:27<21:21:21,  3.29it/s]
 32%|███▏      | 118823/371472 [9:27:27<20:52:26,  3.36it/s]
 32%|███▏      | 118824/371472 [9:27:28<20:43:38,  3.39it/s]
 32%|███▏      | 118825/371472 [9:27:28<20:15:13,  3.47it/s]
 32%|███▏      | 118826/371472 [9:27:28<21:39:04,  3.24it/s]
 32%|███▏      | 118827/371472 [9:27:29<21:39:01,  3.24it/s]
 32%|███▏      | 118828/371472 [9:27:29<20:41:45,  3.39it/s]
 32%|███▏      | 118829/371472 [9:27:29<20:46:16,  3.38it/s]
 32%|███▏      | 118830/371472 [9:27:29<20:01:19,  3.51it/s]
 32%|███▏      | 118831/371472 [9:27:30<19:34:33,  3.58it/s]
 32%|███▏      | 118832/371472 [9:27:30<19:41:43,  3.56it/s]
 32%|███▏      | 118833/371472 [9:27:30<18:55:15,  3.71it/s]
 32%|███▏      | 118834/371472 [9:27:31<20:18:30,  3.46it/s]
 32%|███▏      | 118835/371472 [9:27:31<21:11:31,  3.31it/s]
 32%|███▏      | 118836/371472 [9:27:31<22:37:23,  3.10it/s]
 32%|███▏      | 118837/371472 [9:27:32<21:59:33,  3.19it/s]
 32%|███▏      | 118838/371472 [9:27:32<21:15:12,  3.30it/s]
 32%|███▏      | 118839/371472 [9:27:32<20:46:48,  3.38it/s]
 32%|███▏      | 118840/371472 [9:27:32<20:26:29,  3.43it/s]
                                                            
{'loss': 3.2017, 'learning_rate': 7.124049214591997e-07, 'epoch': 5.12}

 32%|███▏      | 118840/371472 [9:27:32<20:26:29,  3.43it/s]
 32%|███▏      | 118841/371472 [9:27:33<21:16:57,  3.30it/s]
 32%|███▏      | 118842/371472 [9:27:33<21:40:11,  3.24it/s]
 32%|███▏      | 118843/371472 [9:27:33<22:05:28,  3.18it/s]
 32%|███▏      | 118844/371472 [9:27:34<21:15:42,  3.30it/s]
 32%|███▏      | 118845/371472 [9:27:34<20:15:21,  3.46it/s]
 32%|███▏      | 118846/371472 [9:27:34<19:07:31,  3.67it/s]
 32%|███▏      | 118847/371472 [9:27:34<18:56:16,  3.71it/s]
 32%|███▏      | 118848/371472 [9:27:35<18:50:02,  3.73it/s]
 32%|███▏      | 118849/371472 [9:27:35<18:44:19,  3.74it/s]
 32%|███▏      | 118850/371472 [9:27:35<19:23:48,  3.62it/s]
 32%|███▏      | 118851/371472 [9:27:36<19:01:45,  3.69it/s]
 32%|███▏      | 118852/371472 [9:27:36<19:32:27,  3.59it/s]
 32%|███▏      | 118853/371472 [9:27:36<19:07:50,  3.67it/s]
 32%|███▏      | 118854/371472 [9:27:36<19:05:09,  3.68it/s]
 32%|███▏      | 118855/371472 [9:27:37<18:59:05,  3.70it/s]
 32%|███▏      | 118856/371472 [9:27:37<18:57:02,  3.70it/s]
 32%|███▏      | 118857/371472 [9:27:37<19:48:32,  3.54it/s]
 32%|███▏      | 118858/371472 [9:27:37<19:00:05,  3.69it/s]
 32%|███▏      | 118859/371472 [9:27:38<18:28:42,  3.80it/s]
 32%|███▏      | 118860/371472 [9:27:38<18:32:45,  3.78it/s]
                                                            
{'loss': 3.1725, 'learning_rate': 7.123564394837208e-07, 'epoch': 5.12}

 32%|███▏      | 118860/371472 [9:27:38<18:32:45,  3.78it/s]
 32%|███▏      | 118861/371472 [9:27:38<18:56:46,  3.70it/s]
 32%|███▏      | 118862/371472 [9:27:39<20:18:42,  3.45it/s]
 32%|███▏      | 118863/371472 [9:27:39<20:37:53,  3.40it/s]
 32%|███▏      | 118864/371472 [9:27:39<20:43:09,  3.39it/s]
 32%|███▏      | 118865/371472 [9:27:39<20:04:40,  3.49it/s]
 32%|███▏      | 118866/371472 [9:27:40<19:25:04,  3.61it/s]
 32%|███▏      | 118867/371472 [9:27:40<20:10:55,  3.48it/s]
 32%|███▏      | 118868/371472 [9:27:40<19:26:36,  3.61it/s]
 32%|███▏      | 118869/371472 [9:27:41<19:51:09,  3.53it/s]
 32%|███▏      | 118870/371472 [9:27:41<19:44:31,  3.55it/s]
 32%|███▏      | 118871/371472 [9:27:41<19:54:02,  3.53it/s]
 32%|███▏      | 118872/371472 [9:27:41<19:17:09,  3.64it/s]
 32%|███▏      | 118873/371472 [9:27:42<19:59:47,  3.51it/s]
 32%|███▏      | 118874/371472 [9:27:42<19:15:17,  3.64it/s]
 32%|███▏      | 118875/371472 [9:27:42<19:18:38,  3.63it/s]
 32%|███▏      | 118876/371472 [9:27:42<18:54:52,  3.71it/s]
 32%|███▏      | 118877/371472 [9:27:43<18:52:34,  3.72it/s]
 32%|███▏      | 118878/371472 [9:27:43<19:18:01,  3.64it/s]
 32%|███▏      | 118879/371472 [9:27:43<19:22:58,  3.62it/s]
 32%|███▏      | 118880/371472 [9:27:44<18:44:50,  3.74it/s]
                                                            
{'loss': 3.2998, 'learning_rate': 7.123079575082419e-07, 'epoch': 5.12}

 32%|███▏      | 118880/371472 [9:27:44<18:44:50,  3.74it/s]
 32%|███▏      | 118881/371472 [9:27:44<20:04:20,  3.50it/s]
 32%|███▏      | 118882/371472 [9:27:44<19:38:59,  3.57it/s]
 32%|███▏      | 118883/371472 [9:27:44<19:30:11,  3.60it/s]
 32%|███▏      | 118884/371472 [9:27:45<19:52:44,  3.53it/s]
 32%|███▏      | 118885/371472 [9:27:45<19:40:00,  3.57it/s]
 32%|███▏      | 118886/371472 [9:27:45<21:06:15,  3.32it/s]
 32%|███▏      | 118887/371472 [9:27:46<21:52:23,  3.21it/s]
 32%|███▏      | 118888/371472 [9:27:46<21:31:04,  3.26it/s]
 32%|███▏      | 118889/371472 [9:27:46<20:19:46,  3.45it/s]
 32%|███▏      | 118890/371472 [9:27:46<19:29:09,  3.60it/s]
 32%|███▏      | 118891/371472 [9:27:47<19:42:09,  3.56it/s]
 32%|███▏      | 118892/371472 [9:27:47<19:28:36,  3.60it/s]
 32%|███▏      | 118893/371472 [9:27:47<19:05:08,  3.68it/s]
 32%|███▏      | 118894/371472 [9:27:48<18:47:34,  3.73it/s]
 32%|███▏      | 118895/371472 [9:27:48<18:59:30,  3.69it/s]
 32%|███▏      | 118896/371472 [9:27:48<19:30:04,  3.60it/s]
 32%|███▏      | 118897/371472 [9:27:48<20:35:04,  3.41it/s]
 32%|███▏      | 118898/371472 [9:27:49<19:35:51,  3.58it/s]
 32%|███▏      | 118899/371472 [9:27:49<20:04:38,  3.49it/s]
 32%|███▏      | 118900/371472 [9:27:49<19:36:24,  3.58it/s]
                                                            
{'loss': 3.179, 'learning_rate': 7.12259475532763e-07, 'epoch': 5.12}

 32%|███▏      | 118900/371472 [9:27:49<19:36:24,  3.58it/s]
 32%|███▏      | 118901/371472 [9:27:50<20:10:51,  3.48it/s]
 32%|███▏      | 118902/371472 [9:27:50<20:11:33,  3.47it/s]
 32%|███▏      | 118903/371472 [9:27:50<20:04:16,  3.50it/s]
 32%|███▏      | 118904/371472 [9:27:50<18:57:55,  3.70it/s]
 32%|███▏      | 118905/371472 [9:27:51<18:49:50,  3.73it/s]
 32%|███▏      | 118906/371472 [9:27:51<20:00:46,  3.51it/s]
 32%|███▏      | 118907/371472 [9:27:51<20:15:10,  3.46it/s]
 32%|███▏      | 118908/371472 [9:27:52<19:55:12,  3.52it/s]
 32%|███▏      | 118909/371472 [9:27:52<20:27:23,  3.43it/s]
 32%|███▏      | 118910/371472 [9:27:52<20:04:53,  3.49it/s]
 32%|███▏      | 118911/371472 [9:27:52<19:35:43,  3.58it/s]
 32%|███▏      | 118912/371472 [9:27:53<19:25:15,  3.61it/s]
 32%|███▏      | 118913/371472 [9:27:53<19:19:08,  3.63it/s]
 32%|███▏      | 118914/371472 [9:27:53<18:49:17,  3.73it/s]
 32%|███▏      | 118915/371472 [9:27:53<19:33:08,  3.59it/s]
 32%|███▏      | 118916/371472 [9:27:54<19:41:02,  3.56it/s]
 32%|███▏      | 118917/371472 [9:27:54<19:51:40,  3.53it/s]
 32%|███▏      | 118918/371472 [9:27:54<19:37:25,  3.57it/s]
 32%|███▏      | 118919/371472 [9:27:55<20:39:59,  3.39it/s]
 32%|███▏      | 118920/371472 [9:27:55<20:02:26,  3.50it/s]
                                                            
{'loss': 3.1106, 'learning_rate': 7.122109935572842e-07, 'epoch': 5.12}

 32%|███▏      | 118920/371472 [9:27:55<20:02:26,  3.50it/s]
 32%|███▏      | 118921/371472 [9:27:55<19:39:35,  3.57it/s]
 32%|███▏      | 118922/371472 [9:27:55<19:23:25,  3.62it/s]
 32%|███▏      | 118923/371472 [9:27:56<21:32:27,  3.26it/s]
 32%|███▏      | 118924/371472 [9:27:56<20:27:30,  3.43it/s]
 32%|███▏      | 118925/371472 [9:27:57<23:24:27,  3.00it/s]
 32%|███▏      | 118926/371472 [9:27:57<22:23:07,  3.13it/s]
 32%|███▏      | 118927/371472 [9:27:57<21:21:08,  3.29it/s]
 32%|███▏      | 118928/371472 [9:27:57<22:12:02,  3.16it/s]
 32%|███▏      | 118929/371472 [9:27:58<21:29:14,  3.26it/s]
 32%|███▏      | 118930/371472 [9:27:58<20:57:44,  3.35it/s]
 32%|███▏      | 118931/371472 [9:27:58<21:54:12,  3.20it/s]
 32%|███▏      | 118932/371472 [9:27:59<21:19:22,  3.29it/s]
 32%|███▏      | 118933/371472 [9:27:59<20:29:07,  3.42it/s]
 32%|███▏      | 118934/371472 [9:27:59<19:42:42,  3.56it/s]
 32%|███▏      | 118935/371472 [9:27:59<19:09:19,  3.66it/s]
 32%|███▏      | 118936/371472 [9:28:00<18:57:26,  3.70it/s]
 32%|███▏      | 118937/371472 [9:28:00<18:54:05,  3.71it/s]
 32%|███▏      | 118938/371472 [9:28:00<19:41:14,  3.56it/s]
 32%|███▏      | 118939/371472 [9:28:00<19:00:39,  3.69it/s]
 32%|███▏      | 118940/371472 [9:28:01<18:37:51,  3.77it/s]
                                                            
{'loss': 3.1492, 'learning_rate': 7.121625115818053e-07, 'epoch': 5.12}

 32%|███▏      | 118940/371472 [9:28:01<18:37:51,  3.77it/s]
 32%|███▏      | 118941/371472 [9:28:01<18:48:24,  3.73it/s]
 32%|███▏      | 118942/371472 [9:28:01<18:25:08,  3.81it/s]
 32%|███▏      | 118943/371472 [9:28:01<18:11:52,  3.85it/s]
 32%|███▏      | 118944/371472 [9:28:02<18:18:05,  3.83it/s]
 32%|███▏      | 118945/371472 [9:28:02<18:28:11,  3.80it/s]
 32%|███▏      | 118946/371472 [9:28:02<19:11:39,  3.65it/s]
 32%|███▏      | 118947/371472 [9:28:03<18:53:03,  3.71it/s]
 32%|███▏      | 118948/371472 [9:28:03<19:07:32,  3.67it/s]
 32%|███▏      | 118949/371472 [9:28:03<18:36:58,  3.77it/s]
 32%|███▏      | 118950/371472 [9:28:03<19:09:49,  3.66it/s]
 32%|███▏      | 118951/371472 [9:28:04<19:08:46,  3.66it/s]
 32%|███▏      | 118952/371472 [9:28:04<19:45:14,  3.55it/s]
 32%|███▏      | 118953/371472 [9:28:04<19:25:13,  3.61it/s]
 32%|███▏      | 118954/371472 [9:28:05<20:11:07,  3.47it/s]
 32%|███▏      | 118955/371472 [9:28:05<19:56:57,  3.52it/s]
 32%|███▏      | 118956/371472 [9:28:05<19:13:15,  3.65it/s]
 32%|███▏      | 118957/371472 [9:28:05<18:33:33,  3.78it/s]
 32%|███▏      | 118958/371472 [9:28:06<19:51:48,  3.53it/s]
 32%|███▏      | 118959/371472 [9:28:06<21:19:31,  3.29it/s]
 32%|███▏      | 118960/371472 [9:28:06<20:45:07,  3.38it/s]
                                                            
{'loss': 3.2879, 'learning_rate': 7.121140296063264e-07, 'epoch': 5.12}

 32%|███▏      | 118960/371472 [9:28:06<20:45:07,  3.38it/s]
 32%|███▏      | 118961/371472 [9:28:07<20:44:10,  3.38it/s]
 32%|███▏      | 118962/371472 [9:28:07<21:25:16,  3.27it/s]
 32%|███▏      | 118963/371472 [9:28:07<21:08:33,  3.32it/s]
 32%|███▏      | 118964/371472 [9:28:07<20:57:02,  3.35it/s]
 32%|███▏      | 118965/371472 [9:28:08<20:07:12,  3.49it/s]
 32%|███▏      | 118966/371472 [9:28:08<19:50:15,  3.54it/s]
 32%|███▏      | 118967/371472 [9:28:08<20:36:20,  3.40it/s]
 32%|███▏      | 118968/371472 [9:28:09<19:56:10,  3.52it/s]
 32%|███▏      | 118969/371472 [9:28:09<18:55:20,  3.71it/s]
 32%|███▏      | 118970/371472 [9:28:09<18:57:24,  3.70it/s]
 32%|███▏      | 118971/371472 [9:28:09<19:59:41,  3.51it/s]
 32%|███▏      | 118972/371472 [9:28:10<19:52:58,  3.53it/s]
 32%|███▏      | 118973/371472 [9:28:10<19:41:40,  3.56it/s]
 32%|███▏      | 118974/371472 [9:28:10<20:55:15,  3.35it/s]
 32%|███▏      | 118975/371472 [9:28:11<20:39:37,  3.39it/s]
 32%|███▏      | 118976/371472 [9:28:11<20:05:50,  3.49it/s]
 32%|███▏      | 118977/371472 [9:28:11<19:29:19,  3.60it/s]
 32%|███▏      | 118978/371472 [9:28:11<19:04:12,  3.68it/s]
 32%|███▏      | 118979/371472 [9:28:12<18:31:34,  3.79it/s]
 32%|███▏      | 118980/371472 [9:28:12<19:24:11,  3.61it/s]
                                                            
{'loss': 3.3552, 'learning_rate': 7.120655476308474e-07, 'epoch': 5.12}

 32%|███▏      | 118980/371472 [9:28:12<19:24:11,  3.61it/s]
 32%|███▏      | 118981/371472 [9:28:12<18:46:27,  3.74it/s]
 32%|███▏      | 118982/371472 [9:28:12<18:21:51,  3.82it/s]
 32%|███▏      | 118983/371472 [9:28:13<18:30:24,  3.79it/s]
 32%|███▏      | 118984/371472 [9:28:13<20:06:30,  3.49it/s]
 32%|███▏      | 118985/371472 [9:28:13<20:14:42,  3.46it/s]
 32%|███▏      | 118986/371472 [9:28:14<19:41:56,  3.56it/s]
 32%|███▏      | 118987/371472 [9:28:14<21:37:05,  3.24it/s]
 32%|███▏      | 118988/371472 [9:28:14<20:15:12,  3.46it/s]
 32%|███▏      | 118989/371472 [9:28:15<22:04:41,  3.18it/s]
 32%|███▏      | 118990/371472 [9:28:15<21:47:05,  3.22it/s]
 32%|███▏      | 118991/371472 [9:28:15<20:41:20,  3.39it/s]
 32%|███▏      | 118992/371472 [9:28:15<21:32:06,  3.26it/s]
 32%|███▏      | 118993/371472 [9:28:16<21:09:57,  3.31it/s]
 32%|███▏      | 118994/371472 [9:28:16<21:17:21,  3.29it/s]
 32%|███▏      | 118995/371472 [9:28:16<20:30:57,  3.42it/s]
 32%|███▏      | 118996/371472 [9:28:17<20:42:41,  3.39it/s]
 32%|███▏      | 118997/371472 [9:28:17<21:18:25,  3.29it/s]
 32%|███▏      | 118998/371472 [9:28:17<22:15:46,  3.15it/s]
 32%|███▏      | 118999/371472 [9:28:18<21:50:10,  3.21it/s]
 32%|███▏      | 119000/371472 [9:28:18<21:06:51,  3.32it/s]
                                                            
{'loss': 3.1907, 'learning_rate': 7.120170656553685e-07, 'epoch': 5.13}

 32%|███▏      | 119000/371472 [9:28:18<21:06:51,  3.32it/s]
 32%|███▏      | 119001/371472 [9:28:18<20:45:04,  3.38it/s]
 32%|███▏      | 119002/371472 [9:28:18<20:55:33,  3.35it/s]
 32%|███▏      | 119003/371472 [9:28:19<20:23:51,  3.44it/s]
 32%|███▏      | 119004/371472 [9:28:19<20:02:16,  3.50it/s]
 32%|███▏      | 119005/371472 [9:28:19<19:27:28,  3.60it/s]
 32%|███▏      | 119006/371472 [9:28:20<19:22:07,  3.62it/s]
 32%|███▏      | 119007/371472 [9:28:20<19:17:42,  3.63it/s]
 32%|███▏      | 119008/371472 [9:28:20<19:25:35,  3.61it/s]
 32%|███▏      | 119009/371472 [9:28:20<20:54:14,  3.35it/s]
 32%|███▏      | 119010/371472 [9:28:21<20:54:40,  3.35it/s]
 32%|███▏      | 119011/371472 [9:28:21<19:54:25,  3.52it/s]
 32%|███▏      | 119012/371472 [9:28:21<19:30:15,  3.60it/s]
 32%|███▏      | 119013/371472 [9:28:22<18:56:48,  3.70it/s]
 32%|███▏      | 119014/371472 [9:28:22<20:20:33,  3.45it/s]
 32%|███▏      | 119015/371472 [9:28:22<19:51:48,  3.53it/s]
 32%|███▏      | 119016/371472 [9:28:22<19:40:36,  3.56it/s]
 32%|███▏      | 119017/371472 [9:28:23<18:51:26,  3.72it/s]
 32%|███▏      | 119018/371472 [9:28:23<19:25:28,  3.61it/s]
 32%|███▏      | 119019/371472 [9:28:23<18:45:22,  3.74it/s]
 32%|███▏      | 119020/371472 [9:28:23<18:30:32,  3.79it/s]
                                                            
{'loss': 3.2938, 'learning_rate': 7.119685836798896e-07, 'epoch': 5.13}

 32%|███▏      | 119020/371472 [9:28:23<18:30:32,  3.79it/s]
 32%|███▏      | 119021/371472 [9:28:24<18:40:16,  3.76it/s]
 32%|███▏      | 119022/371472 [9:28:24<19:41:57,  3.56it/s]
 32%|███▏      | 119023/371472 [9:28:24<19:04:47,  3.68it/s]
 32%|███▏      | 119024/371472 [9:28:25<19:08:17,  3.66it/s]
 32%|███▏      | 119025/371472 [9:28:25<20:06:32,  3.49it/s]
 32%|███▏      | 119026/371472 [9:28:25<19:46:58,  3.54it/s]
 32%|███▏      | 119027/371472 [9:28:25<19:12:45,  3.65it/s]
 32%|███▏      | 119028/371472 [9:28:26<19:19:06,  3.63it/s]
 32%|███▏      | 119029/371472 [9:28:26<20:02:50,  3.50it/s]
 32%|███▏      | 119030/371472 [9:28:26<20:13:06,  3.47it/s]
 32%|███▏      | 119031/371472 [9:28:27<20:49:53,  3.37it/s]
 32%|███▏      | 119032/371472 [9:28:27<21:00:22,  3.34it/s]
 32%|███▏      | 119033/371472 [9:28:27<20:36:56,  3.40it/s]
 32%|███▏      | 119034/371472 [9:28:28<21:24:18,  3.28it/s]
 32%|███▏      | 119035/371472 [9:28:28<20:16:51,  3.46it/s]
 32%|███▏      | 119036/371472 [9:28:28<20:07:50,  3.48it/s]
 32%|███▏      | 119037/371472 [9:28:28<20:41:04,  3.39it/s]
 32%|███▏      | 119038/371472 [9:28:29<20:25:02,  3.43it/s]
 32%|███▏      | 119039/371472 [9:28:29<19:51:22,  3.53it/s]
 32%|███▏      | 119040/371472 [9:28:29<19:40:54,  3.56it/s]
                                                            
{'loss': 3.3589, 'learning_rate': 7.119201017044107e-07, 'epoch': 5.13}

 32%|███▏      | 119040/371472 [9:28:29<19:40:54,  3.56it/s]
 32%|███▏      | 119041/371472 [9:28:30<20:09:21,  3.48it/s]
 32%|███▏      | 119042/371472 [9:28:30<21:04:51,  3.33it/s]
 32%|███▏      | 119043/371472 [9:28:30<22:46:15,  3.08it/s]
 32%|███▏      | 119044/371472 [9:28:31<22:13:22,  3.16it/s]
 32%|███▏      | 119045/371472 [9:28:31<20:47:20,  3.37it/s]
 32%|███▏      | 119046/371472 [9:28:31<21:01:04,  3.34it/s]
 32%|███▏      | 119047/371472 [9:28:31<19:52:45,  3.53it/s]
 32%|███▏      | 119048/371472 [9:28:32<19:25:40,  3.61it/s]
 32%|███▏      | 119049/371472 [9:28:32<18:52:10,  3.72it/s]
 32%|███▏      | 119050/371472 [9:28:32<18:31:57,  3.78it/s]
 32%|███▏      | 119051/371472 [9:28:32<19:32:10,  3.59it/s]
 32%|███▏      | 119052/371472 [9:28:33<20:01:36,  3.50it/s]
 32%|███▏      | 119053/371472 [9:28:33<20:02:25,  3.50it/s]
 32%|███▏      | 119054/371472 [9:28:33<20:05:54,  3.49it/s]
 32%|███▏      | 119055/371472 [9:28:34<19:22:05,  3.62it/s]
 32%|███▏      | 119056/371472 [9:28:34<19:54:08,  3.52it/s]
 32%|███▏      | 119057/371472 [9:28:34<19:21:29,  3.62it/s]
 32%|███▏      | 119058/371472 [9:28:34<18:44:57,  3.74it/s]
 32%|███▏      | 119059/371472 [9:28:35<18:29:25,  3.79it/s]
 32%|███▏      | 119060/371472 [9:28:35<18:11:03,  3.86it/s]
                                                            
{'loss': 3.1688, 'learning_rate': 7.118716197289319e-07, 'epoch': 5.13}

 32%|███▏      | 119060/371472 [9:28:35<18:11:03,  3.86it/s]
 32%|███▏      | 119061/371472 [9:28:35<18:56:38,  3.70it/s]
 32%|███▏      | 119062/371472 [9:28:36<21:23:20,  3.28it/s]
 32%|███▏      | 119063/371472 [9:28:36<21:04:09,  3.33it/s]
 32%|███▏      | 119064/371472 [9:28:36<20:21:26,  3.44it/s]
 32%|███▏      | 119065/371472 [9:28:36<20:19:22,  3.45it/s]
 32%|███▏      | 119066/371472 [9:28:37<19:36:39,  3.58it/s]
 32%|███▏      | 119067/371472 [9:28:37<19:11:17,  3.65it/s]
 32%|███▏      | 119068/371472 [9:28:37<19:24:16,  3.61it/s]
 32%|███▏      | 119069/371472 [9:28:37<19:31:23,  3.59it/s]
 32%|███▏      | 119070/371472 [9:28:38<19:31:21,  3.59it/s]
 32%|███▏      | 119071/371472 [9:28:38<19:08:39,  3.66it/s]
 32%|███▏      | 119072/371472 [9:28:38<21:42:38,  3.23it/s]
 32%|███▏      | 119073/371472 [9:28:39<20:37:57,  3.40it/s]
 32%|███▏      | 119074/371472 [9:28:39<21:38:42,  3.24it/s]
 32%|███▏      | 119075/371472 [9:28:39<21:21:33,  3.28it/s]
 32%|███▏      | 119076/371472 [9:28:40<20:47:25,  3.37it/s]
 32%|███▏      | 119077/371472 [9:28:40<19:44:04,  3.55it/s]
 32%|███▏      | 119078/371472 [9:28:40<19:32:55,  3.59it/s]
 32%|███▏      | 119079/371472 [9:28:40<19:21:47,  3.62it/s]
 32%|███▏      | 119080/371472 [9:28:41<20:52:23,  3.36it/s]
                                                            
{'loss': 3.2452, 'learning_rate': 7.11823137753453e-07, 'epoch': 5.13}

 32%|███▏      | 119080/371472 [9:28:41<20:52:23,  3.36it/s]
 32%|███▏      | 119081/371472 [9:28:41<19:55:46,  3.52it/s]
 32%|███▏      | 119082/371472 [9:28:41<18:55:27,  3.70it/s]
 32%|███▏      | 119083/371472 [9:28:41<18:22:33,  3.82it/s]
 32%|███▏      | 119084/371472 [9:28:42<19:33:52,  3.58it/s]
 32%|███▏      | 119085/371472 [9:28:42<20:20:06,  3.45it/s]
 32%|███▏      | 119086/371472 [9:28:42<19:57:18,  3.51it/s]
 32%|███▏      | 119087/371472 [9:28:43<19:02:59,  3.68it/s]
 32%|███▏      | 119088/371472 [9:28:43<18:26:16,  3.80it/s]
 32%|███▏      | 119089/371472 [9:28:43<18:44:50,  3.74it/s]
 32%|███▏      | 119090/371472 [9:28:43<17:56:32,  3.91it/s]
 32%|███▏      | 119091/371472 [9:28:44<18:23:13,  3.81it/s]
 32%|███▏      | 119092/371472 [9:28:44<18:23:22,  3.81it/s]
 32%|███▏      | 119093/371472 [9:28:44<18:12:57,  3.85it/s]
 32%|███▏      | 119094/371472 [9:28:44<18:24:27,  3.81it/s]
 32%|███▏      | 119095/371472 [9:28:45<21:00:03,  3.34it/s]
 32%|███▏      | 119096/371472 [9:28:45<21:28:13,  3.27it/s]
 32%|███▏      | 119097/371472 [9:28:45<20:44:13,  3.38it/s]
 32%|███▏      | 119098/371472 [9:28:46<21:03:06,  3.33it/s]
 32%|███▏      | 119099/371472 [9:28:46<21:00:51,  3.34it/s]
 32%|███▏      | 119100/371472 [9:28:46<19:48:06,  3.54it/s]
                                                            
{'loss': 3.3892, 'learning_rate': 7.11774655777974e-07, 'epoch': 5.13}

 32%|███▏      | 119100/371472 [9:28:46<19:48:06,  3.54it/s]
 32%|███▏      | 119101/371472 [9:28:46<19:27:23,  3.60it/s]
 32%|███▏      | 119102/371472 [9:28:47<18:57:27,  3.70it/s]
 32%|███▏      | 119103/371472 [9:28:47<19:28:05,  3.60it/s]
 32%|███▏      | 119104/371472 [9:28:47<19:00:52,  3.69it/s]
 32%|███▏      | 119105/371472 [9:28:48<19:15:23,  3.64it/s]
 32%|███▏      | 119106/371472 [9:28:48<19:16:27,  3.64it/s]
 32%|███▏      | 119107/371472 [9:28:48<18:48:17,  3.73it/s]
 32%|███▏      | 119108/371472 [9:28:48<18:59:15,  3.69it/s]
 32%|███▏      | 119109/371472 [9:28:49<20:45:58,  3.38it/s]
 32%|███▏      | 119110/371472 [9:28:49<19:46:11,  3.55it/s]
 32%|███▏      | 119111/371472 [9:28:49<18:55:23,  3.70it/s]
 32%|███▏      | 119112/371472 [9:28:49<18:41:12,  3.75it/s]
 32%|███▏      | 119113/371472 [9:28:50<19:03:27,  3.68it/s]
 32%|███▏      | 119114/371472 [9:28:50<18:35:19,  3.77it/s]
 32%|███▏      | 119115/371472 [9:28:50<18:08:17,  3.86it/s]
 32%|███▏      | 119116/371472 [9:28:51<19:48:18,  3.54it/s]
 32%|███▏      | 119117/371472 [9:28:51<20:14:39,  3.46it/s]
 32%|███▏      | 119118/371472 [9:28:51<20:32:23,  3.41it/s]
 32%|███▏      | 119119/371472 [9:28:51<19:37:43,  3.57it/s]
 32%|███▏      | 119120/371472 [9:28:52<20:08:12,  3.48it/s]
                                                            
{'loss': 3.425, 'learning_rate': 7.117261738024951e-07, 'epoch': 5.13}

 32%|███▏      | 119120/371472 [9:28:52<20:08:12,  3.48it/s]
 32%|███▏      | 119121/371472 [9:28:52<19:28:03,  3.60it/s]
 32%|███▏      | 119122/371472 [9:28:52<19:21:55,  3.62it/s]
 32%|███▏      | 119123/371472 [9:28:53<20:04:03,  3.49it/s]
 32%|███▏      | 119124/371472 [9:28:53<21:11:30,  3.31it/s]
 32%|███▏      | 119125/371472 [9:28:53<20:49:58,  3.36it/s]
 32%|███▏      | 119126/371472 [9:28:53<20:20:41,  3.45it/s]
 32%|███▏      | 119127/371472 [9:28:54<20:31:06,  3.42it/s]
 32%|███▏      | 119128/371472 [9:28:54<20:29:01,  3.42it/s]
 32%|███▏      | 119129/371472 [9:28:54<19:40:21,  3.56it/s]
 32%|███▏      | 119130/371472 [9:28:55<18:46:50,  3.73it/s]
 32%|███▏      | 119131/371472 [9:28:55<18:41:44,  3.75it/s]
 32%|███▏      | 119132/371472 [9:28:55<18:26:41,  3.80it/s]
 32%|███▏      | 119133/371472 [9:28:55<19:29:07,  3.60it/s]
 32%|███▏      | 119134/371472 [9:28:56<19:16:10,  3.64it/s]
 32%|███▏      | 119135/371472 [9:28:56<18:52:20,  3.71it/s]
 32%|███▏      | 119136/371472 [9:28:56<18:52:17,  3.71it/s]
 32%|███▏      | 119137/371472 [9:28:56<18:57:39,  3.70it/s]
 32%|███▏      | 119138/371472 [9:28:57<18:34:31,  3.77it/s]
 32%|███▏      | 119139/371472 [9:28:57<18:23:17,  3.81it/s]
 32%|███▏      | 119140/371472 [9:28:57<18:19:06,  3.83it/s]
                                                            
{'loss': 3.2473, 'learning_rate': 7.116776918270163e-07, 'epoch': 5.13}

 32%|███▏      | 119140/371472 [9:28:57<18:19:06,  3.83it/s]
 32%|███▏      | 119141/371472 [9:28:57<18:16:45,  3.83it/s]
 32%|███▏      | 119142/371472 [9:28:58<18:37:08,  3.76it/s]
 32%|███▏      | 119143/371472 [9:28:58<18:21:35,  3.82it/s]
 32%|███▏      | 119144/371472 [9:28:58<19:17:31,  3.63it/s]
 32%|███▏      | 119145/371472 [9:28:59<19:16:08,  3.64it/s]
 32%|███▏      | 119146/371472 [9:28:59<18:47:36,  3.73it/s]
 32%|███▏      | 119147/371472 [9:28:59<19:20:21,  3.62it/s]
 32%|███▏      | 119148/371472 [9:28:59<19:56:37,  3.51it/s]
 32%|███▏      | 119149/371472 [9:29:00<21:00:12,  3.34it/s]
 32%|███▏      | 119150/371472 [9:29:00<19:54:37,  3.52it/s]
 32%|███▏      | 119151/371472 [9:29:00<19:47:59,  3.54it/s]
 32%|███▏      | 119152/371472 [9:29:01<19:45:13,  3.55it/s]
 32%|███▏      | 119153/371472 [9:29:01<20:12:04,  3.47it/s]
 32%|███▏      | 119154/371472 [9:29:01<19:47:02,  3.54it/s]
 32%|███▏      | 119155/371472 [9:29:01<20:03:52,  3.49it/s]
 32%|███▏      | 119156/371472 [9:29:02<19:48:03,  3.54it/s]
 32%|███▏      | 119157/371472 [9:29:02<19:12:16,  3.65it/s]
 32%|███▏      | 119158/371472 [9:29:02<19:04:14,  3.68it/s]
 32%|███▏      | 119159/371472 [9:29:03<19:00:01,  3.69it/s]
 32%|███▏      | 119160/371472 [9:29:03<19:06:07,  3.67it/s]
                                                            
{'loss': 3.3399, 'learning_rate': 7.116292098515374e-07, 'epoch': 5.13}

 32%|███▏      | 119160/371472 [9:29:03<19:06:07,  3.67it/s]
 32%|███▏      | 119161/371472 [9:29:03<21:06:59,  3.32it/s]
 32%|███▏      | 119162/371472 [9:29:03<20:50:00,  3.36it/s]
 32%|███▏      | 119163/371472 [9:29:04<19:54:26,  3.52it/s]
 32%|███▏      | 119164/371472 [9:29:04<20:08:36,  3.48it/s]
 32%|███▏      | 119165/371472 [9:29:04<20:18:03,  3.45it/s]
 32%|███▏      | 119166/371472 [9:29:05<19:36:05,  3.58it/s]
 32%|███▏      | 119167/371472 [9:29:05<19:29:45,  3.59it/s]
 32%|███▏      | 119168/371472 [9:29:05<19:05:42,  3.67it/s]
 32%|███▏      | 119169/371472 [9:29:05<18:37:28,  3.76it/s]
 32%|███▏      | 119170/371472 [9:29:06<18:45:59,  3.73it/s]
 32%|███▏      | 119171/371472 [9:29:06<18:27:44,  3.80it/s]
 32%|███▏      | 119172/371472 [9:29:06<17:57:19,  3.90it/s]
 32%|███▏      | 119173/371472 [9:29:06<18:03:56,  3.88it/s]
 32%|███▏      | 119174/371472 [9:29:07<18:11:59,  3.85it/s]
 32%|███▏      | 119175/371472 [9:29:07<18:41:51,  3.75it/s]
 32%|███▏      | 119176/371472 [9:29:07<18:34:42,  3.77it/s]
 32%|███▏      | 119177/371472 [9:29:07<18:49:09,  3.72it/s]
 32%|███▏      | 119178/371472 [9:29:08<18:36:41,  3.77it/s]
 32%|███▏      | 119179/371472 [9:29:08<18:20:32,  3.82it/s]
 32%|███▏      | 119180/371472 [9:29:08<20:23:58,  3.44it/s]
                                                            
{'loss': 3.4017, 'learning_rate': 7.115807278760585e-07, 'epoch': 5.13}

 32%|███▏      | 119180/371472 [9:29:08<20:23:58,  3.44it/s]
 32%|███▏      | 119181/371472 [9:29:09<19:25:01,  3.61it/s]
 32%|███▏      | 119182/371472 [9:29:09<18:54:55,  3.70it/s]
 32%|███▏      | 119183/371472 [9:29:09<18:32:38,  3.78it/s]
 32%|███▏      | 119184/371472 [9:29:09<18:24:18,  3.81it/s]
 32%|███▏      | 119185/371472 [9:29:10<18:06:26,  3.87it/s]
 32%|███▏      | 119186/371472 [9:29:10<19:53:13,  3.52it/s]
 32%|███▏      | 119187/371472 [9:29:10<19:32:57,  3.58it/s]
 32%|███▏      | 119188/371472 [9:29:10<18:56:15,  3.70it/s]
 32%|███▏      | 119189/371472 [9:29:11<19:35:15,  3.58it/s]
 32%|███▏      | 119190/371472 [9:29:11<19:28:06,  3.60it/s]
 32%|███▏      | 119191/371472 [9:29:11<20:47:44,  3.37it/s]
 32%|███▏      | 119192/371472 [9:29:12<20:49:07,  3.37it/s]
 32%|███▏      | 119193/371472 [9:29:12<20:33:59,  3.41it/s]
 32%|███▏      | 119194/371472 [9:29:12<19:34:34,  3.58it/s]
 32%|███▏      | 119195/371472 [9:29:12<19:24:17,  3.61it/s]
 32%|███▏      | 119196/371472 [9:29:13<19:47:00,  3.54it/s]
 32%|███▏      | 119197/371472 [9:29:13<19:53:10,  3.52it/s]
 32%|███▏      | 119198/371472 [9:29:13<19:48:45,  3.54it/s]
 32%|███▏      | 119199/371472 [9:29:14<18:55:05,  3.70it/s]
 32%|███▏      | 119200/371472 [9:29:14<19:14:53,  3.64it/s]
                                                            
{'loss': 3.1981, 'learning_rate': 7.115322459005796e-07, 'epoch': 5.13}

 32%|███▏      | 119200/371472 [9:29:14<19:14:53,  3.64it/s]
 32%|███▏      | 119201/371472 [9:29:14<20:26:41,  3.43it/s]
 32%|███▏      | 119202/371472 [9:29:14<19:58:27,  3.51it/s]
 32%|███▏      | 119203/371472 [9:29:15<19:19:29,  3.63it/s]
 32%|███▏      | 119204/371472 [9:29:15<18:48:47,  3.72it/s]
 32%|███▏      | 119205/371472 [9:29:15<19:19:34,  3.63it/s]
 32%|███▏      | 119206/371472 [9:29:16<19:12:04,  3.65it/s]
 32%|███▏      | 119207/371472 [9:29:16<18:18:56,  3.83it/s]
 32%|███▏      | 119208/371472 [9:29:16<18:43:27,  3.74it/s]
 32%|███▏      | 119209/371472 [9:29:16<18:31:25,  3.78it/s]
 32%|███▏      | 119210/371472 [9:29:17<18:22:58,  3.81it/s]
 32%|███▏      | 119211/371472 [9:29:17<18:36:49,  3.76it/s]
 32%|███▏      | 119212/371472 [9:29:17<18:43:29,  3.74it/s]
 32%|███▏      | 119213/371472 [9:29:17<18:41:42,  3.75it/s]
 32%|███▏      | 119214/371472 [9:29:18<18:12:19,  3.85it/s]
 32%|███▏      | 119215/371472 [9:29:18<18:58:41,  3.69it/s]
 32%|███▏      | 119216/371472 [9:29:18<18:58:25,  3.69it/s]
 32%|███▏      | 119217/371472 [9:29:18<18:58:20,  3.69it/s]
 32%|███▏      | 119218/371472 [9:29:19<18:27:58,  3.79it/s]
 32%|███▏      | 119219/371472 [9:29:19<18:35:25,  3.77it/s]
 32%|███▏      | 119220/371472 [9:29:19<18:39:32,  3.76it/s]
                                                            
{'loss': 3.248, 'learning_rate': 7.114837639251008e-07, 'epoch': 5.14}

 32%|███▏      | 119220/371472 [9:29:19<18:39:32,  3.76it/s]
 32%|███▏      | 119221/371472 [9:29:19<18:28:09,  3.79it/s]
 32%|███▏      | 119222/371472 [9:29:20<18:34:17,  3.77it/s]
 32%|███▏      | 119223/371472 [9:29:20<18:37:34,  3.76it/s]
 32%|███▏      | 119224/371472 [9:29:20<18:59:02,  3.69it/s]
 32%|███▏      | 119225/371472 [9:29:21<19:44:19,  3.55it/s]
 32%|███▏      | 119226/371472 [9:29:21<19:39:42,  3.56it/s]
 32%|███▏      | 119227/371472 [9:29:21<20:40:06,  3.39it/s]
 32%|███▏      | 119228/371472 [9:29:21<20:00:55,  3.50it/s]
 32%|███▏      | 119229/371472 [9:29:22<19:33:20,  3.58it/s]
 32%|███▏      | 119230/371472 [9:29:22<19:21:15,  3.62it/s]
 32%|███▏      | 119231/371472 [9:29:22<19:07:21,  3.66it/s]
 32%|███▏      | 119232/371472 [9:29:23<18:35:39,  3.77it/s]
 32%|███▏      | 119233/371472 [9:29:23<19:00:53,  3.68it/s]
 32%|███▏      | 119234/371472 [9:29:23<18:45:48,  3.73it/s]
 32%|███▏      | 119235/371472 [9:29:23<18:54:32,  3.71it/s]
 32%|███▏      | 119236/371472 [9:29:24<18:20:45,  3.82it/s]
 32%|███▏      | 119237/371472 [9:29:24<18:32:10,  3.78it/s]
 32%|███▏      | 119238/371472 [9:29:24<19:04:53,  3.67it/s]
 32%|███▏      | 119239/371472 [9:29:24<20:39:56,  3.39it/s]
 32%|███▏      | 119240/371472 [9:29:25<20:25:41,  3.43it/s]
                                                            
{'loss': 3.2817, 'learning_rate': 7.114352819496217e-07, 'epoch': 5.14}

 32%|███▏      | 119240/371472 [9:29:25<20:25:41,  3.43it/s]
 32%|███▏      | 119241/371472 [9:29:25<19:40:27,  3.56it/s]
 32%|███▏      | 119242/371472 [9:29:25<19:35:37,  3.58it/s]
 32%|███▏      | 119243/371472 [9:29:26<21:55:14,  3.20it/s]
 32%|███▏      | 119244/371472 [9:29:26<20:43:08,  3.38it/s]
 32%|███▏      | 119245/371472 [9:29:26<19:42:17,  3.56it/s]
 32%|███▏      | 119246/371472 [9:29:26<19:24:23,  3.61it/s]
 32%|███▏      | 119247/371472 [9:29:27<19:16:33,  3.63it/s]
 32%|███▏      | 119248/371472 [9:29:27<19:09:29,  3.66it/s]
 32%|███▏      | 119249/371472 [9:29:27<19:13:35,  3.64it/s]
 32%|███▏      | 119250/371472 [9:29:28<19:19:50,  3.62it/s]
 32%|███▏      | 119251/371472 [9:29:28<18:59:42,  3.69it/s]
 32%|███▏      | 119252/371472 [9:29:28<18:41:25,  3.75it/s]
 32%|███▏      | 119253/371472 [9:29:28<19:04:14,  3.67it/s]
 32%|███▏      | 119254/371472 [9:29:29<21:44:27,  3.22it/s]
 32%|███▏      | 119255/371472 [9:29:29<20:42:02,  3.38it/s]
 32%|███▏      | 119256/371472 [9:29:29<20:12:58,  3.47it/s]
 32%|███▏      | 119257/371472 [9:29:30<20:52:32,  3.36it/s]
 32%|███▏      | 119258/371472 [9:29:30<20:04:08,  3.49it/s]
 32%|███▏      | 119259/371472 [9:29:30<20:27:02,  3.43it/s]
 32%|███▏      | 119260/371472 [9:29:30<19:46:25,  3.54it/s]
                                                            
{'loss': 3.3869, 'learning_rate': 7.113867999741429e-07, 'epoch': 5.14}

 32%|███▏      | 119260/371472 [9:29:30<19:46:25,  3.54it/s]
 32%|███▏      | 119261/371472 [9:29:31<19:13:24,  3.64it/s]
 32%|███▏      | 119262/371472 [9:29:31<18:27:37,  3.80it/s]
 32%|███▏      | 119263/371472 [9:29:31<18:53:43,  3.71it/s]
 32%|███▏      | 119264/371472 [9:29:31<18:46:52,  3.73it/s]
 32%|███▏      | 119265/371472 [9:29:32<18:24:43,  3.80it/s]
 32%|███▏      | 119266/371472 [9:29:32<18:22:28,  3.81it/s]
 32%|███▏      | 119267/371472 [9:29:32<18:14:21,  3.84it/s]
 32%|███▏      | 119268/371472 [9:29:33<19:10:08,  3.65it/s]
 32%|███▏      | 119269/371472 [9:29:33<20:01:40,  3.50it/s]
 32%|███▏      | 119270/371472 [9:29:33<20:06:19,  3.48it/s]
 32%|███▏      | 119271/371472 [9:29:33<20:01:28,  3.50it/s]
 32%|███▏      | 119272/371472 [9:29:34<19:14:52,  3.64it/s]
 32%|███▏      | 119273/371472 [9:29:34<19:13:49,  3.64it/s]
 32%|███▏      | 119274/371472 [9:29:34<18:27:41,  3.79it/s]
 32%|███▏      | 119275/371472 [9:29:35<20:00:31,  3.50it/s]
 32%|███▏      | 119276/371472 [9:29:35<19:40:20,  3.56it/s]
 32%|███▏      | 119277/371472 [9:29:35<19:24:38,  3.61it/s]
 32%|███▏      | 119278/371472 [9:29:35<19:04:35,  3.67it/s]
 32%|███▏      | 119279/371472 [9:29:36<18:54:12,  3.71it/s]
 32%|███▏      | 119280/371472 [9:29:36<19:44:18,  3.55it/s]
                                                            
{'loss': 3.408, 'learning_rate': 7.11338317998664e-07, 'epoch': 5.14}

 32%|███▏      | 119280/371472 [9:29:36<19:44:18,  3.55it/s]
 32%|███▏      | 119281/371472 [9:29:36<19:56:15,  3.51it/s]
 32%|███▏      | 119282/371472 [9:29:37<21:15:38,  3.29it/s]
 32%|███▏      | 119283/371472 [9:29:37<20:01:59,  3.50it/s]
 32%|███▏      | 119284/371472 [9:29:37<19:39:42,  3.56it/s]
 32%|███▏      | 119285/371472 [9:29:37<19:48:25,  3.54it/s]
 32%|███▏      | 119286/371472 [9:29:38<19:55:19,  3.52it/s]
 32%|███▏      | 119287/371472 [9:29:38<21:06:45,  3.32it/s]
 32%|███▏      | 119288/371472 [9:29:38<20:22:52,  3.44it/s]
 32%|███▏      | 119289/371472 [9:29:39<20:55:43,  3.35it/s]
 32%|███▏      | 119290/371472 [9:29:39<21:20:21,  3.28it/s]
 32%|███▏      | 119291/371472 [9:29:39<20:55:19,  3.35it/s]
 32%|███▏      | 119292/371472 [9:29:39<21:14:11,  3.30it/s]
 32%|███▏      | 119293/371472 [9:29:40<21:20:27,  3.28it/s]
 32%|███▏      | 119294/371472 [9:29:40<21:27:48,  3.26it/s]
 32%|███▏      | 119295/371472 [9:29:40<20:26:08,  3.43it/s]
 32%|███▏      | 119296/371472 [9:29:41<19:45:43,  3.54it/s]
 32%|███▏      | 119297/371472 [9:29:41<19:28:50,  3.60it/s]
 32%|███▏      | 119298/371472 [9:29:41<19:34:42,  3.58it/s]
 32%|███▏      | 119299/371472 [9:29:41<19:51:57,  3.53it/s]
 32%|███▏      | 119300/371472 [9:29:42<19:04:56,  3.67it/s]
                                                            
{'loss': 3.162, 'learning_rate': 7.112898360231851e-07, 'epoch': 5.14}

 32%|███▏      | 119300/371472 [9:29:42<19:04:56,  3.67it/s]
 32%|███▏      | 119301/371472 [9:29:42<19:19:00,  3.63it/s]
 32%|███▏      | 119302/371472 [9:29:42<19:20:56,  3.62it/s]
 32%|███▏      | 119303/371472 [9:29:43<18:53:12,  3.71it/s]
 32%|███▏      | 119304/371472 [9:29:43<19:21:50,  3.62it/s]
 32%|███▏      | 119305/371472 [9:29:43<20:36:20,  3.40it/s]
 32%|███▏      | 119306/371472 [9:29:43<19:58:05,  3.51it/s]
 32%|███▏      | 119307/371472 [9:29:44<20:27:39,  3.42it/s]
 32%|███▏      | 119308/371472 [9:29:44<19:55:45,  3.51it/s]
 32%|███▏      | 119309/371472 [9:29:44<19:41:50,  3.56it/s]
 32%|███▏      | 119310/371472 [9:29:45<19:05:01,  3.67it/s]
 32%|███▏      | 119311/371472 [9:29:45<20:43:30,  3.38it/s]
 32%|███▏      | 119312/371472 [9:29:45<20:59:58,  3.34it/s]
 32%|███▏      | 119313/371472 [9:29:45<20:05:02,  3.49it/s]
 32%|███▏      | 119314/371472 [9:29:46<20:34:15,  3.40it/s]
 32%|███▏      | 119315/371472 [9:29:46<19:40:00,  3.56it/s]
 32%|███▏      | 119316/371472 [9:29:46<18:51:05,  3.72it/s]
 32%|███▏      | 119317/371472 [9:29:47<19:09:20,  3.66it/s]
 32%|███▏      | 119318/371472 [9:29:47<20:50:52,  3.36it/s]
 32%|███▏      | 119319/371472 [9:29:47<20:06:57,  3.48it/s]
 32%|███▏      | 119320/371472 [9:29:47<19:46:59,  3.54it/s]
                                                            
{'loss': 3.2604, 'learning_rate': 7.112413540477063e-07, 'epoch': 5.14}

 32%|███▏      | 119320/371472 [9:29:47<19:46:59,  3.54it/s]
 32%|███▏      | 119321/371472 [9:29:48<22:21:58,  3.13it/s]
 32%|███▏      | 119322/371472 [9:29:48<21:20:08,  3.28it/s]
 32%|███▏      | 119323/371472 [9:29:48<21:30:44,  3.26it/s]
 32%|███▏      | 119324/371472 [9:29:49<21:04:44,  3.32it/s]
 32%|███▏      | 119325/371472 [9:29:49<20:43:30,  3.38it/s]
 32%|███▏      | 119326/371472 [9:29:49<20:51:20,  3.36it/s]
 32%|███▏      | 119327/371472 [9:29:50<20:13:37,  3.46it/s]
 32%|███▏      | 119328/371472 [9:29:50<19:01:53,  3.68it/s]
 32%|███▏      | 119329/371472 [9:29:50<18:47:39,  3.73it/s]
 32%|███▏      | 119330/371472 [9:29:50<19:23:53,  3.61it/s]
 32%|███▏      | 119331/371472 [9:29:51<18:51:27,  3.71it/s]
 32%|███▏      | 119332/371472 [9:29:51<18:45:50,  3.73it/s]
 32%|███▏      | 119333/371472 [9:29:51<19:04:18,  3.67it/s]
 32%|███▏      | 119334/371472 [9:29:51<19:22:25,  3.62it/s]
 32%|███▏      | 119335/371472 [9:29:52<22:39:26,  3.09it/s]
 32%|███▏      | 119336/371472 [9:29:52<21:45:18,  3.22it/s]
 32%|███▏      | 119337/371472 [9:29:52<20:23:49,  3.43it/s]
 32%|███▏      | 119338/371472 [9:29:53<19:58:14,  3.51it/s]
 32%|███▏      | 119339/371472 [9:29:53<21:11:22,  3.31it/s]
 32%|███▏      | 119340/371472 [9:29:53<21:10:31,  3.31it/s]
                                                            
{'loss': 3.176, 'learning_rate': 7.111928720722274e-07, 'epoch': 5.14}

 32%|███▏      | 119340/371472 [9:29:53<21:10:31,  3.31it/s]
 32%|███▏      | 119341/371472 [9:29:54<20:50:39,  3.36it/s]
 32%|███▏      | 119342/371472 [9:29:54<20:24:21,  3.43it/s]
 32%|███▏      | 119343/371472 [9:29:54<19:36:22,  3.57it/s]
 32%|███▏      | 119344/371472 [9:29:54<19:25:21,  3.61it/s]
 32%|███▏      | 119345/371472 [9:29:55<19:43:27,  3.55it/s]
 32%|███▏      | 119346/371472 [9:29:55<19:29:52,  3.59it/s]
 32%|███▏      | 119347/371472 [9:29:55<18:49:43,  3.72it/s]
 32%|███▏      | 119348/371472 [9:29:55<18:47:14,  3.73it/s]
 32%|███▏      | 119349/371472 [9:29:56<18:59:50,  3.69it/s]
 32%|███▏      | 119350/371472 [9:29:56<18:14:41,  3.84it/s]
 32%|███▏      | 119351/371472 [9:29:56<18:15:59,  3.83it/s]
 32%|███▏      | 119352/371472 [9:29:57<18:33:01,  3.78it/s]
 32%|███▏      | 119353/371472 [9:29:57<18:38:30,  3.76it/s]
 32%|███▏      | 119354/371472 [9:29:57<18:09:29,  3.86it/s]
 32%|███▏      | 119355/371472 [9:29:57<18:01:50,  3.88it/s]
 32%|███▏      | 119356/371472 [9:29:58<20:28:04,  3.42it/s]
 32%|███▏      | 119357/371472 [9:29:58<20:11:45,  3.47it/s]
 32%|███▏      | 119358/371472 [9:29:58<19:53:59,  3.52it/s]
 32%|███▏      | 119359/371472 [9:29:59<20:53:33,  3.35it/s]
 32%|███▏      | 119360/371472 [9:29:59<20:29:19,  3.42it/s]
                                                            
{'loss': 3.3473, 'learning_rate': 7.111443900967484e-07, 'epoch': 5.14}

 32%|███▏      | 119360/371472 [9:29:59<20:29:19,  3.42it/s]
 32%|███▏      | 119361/371472 [9:29:59<20:42:50,  3.38it/s]
 32%|███▏      | 119362/371472 [9:29:59<20:07:33,  3.48it/s]
 32%|███▏      | 119363/371472 [9:30:00<21:30:21,  3.26it/s]
 32%|███▏      | 119364/371472 [9:30:00<21:05:30,  3.32it/s]
 32%|███▏      | 119365/371472 [9:30:00<22:20:41,  3.13it/s]
 32%|███▏      | 119366/371472 [9:30:01<21:35:07,  3.24it/s]
 32%|███▏      | 119367/371472 [9:30:01<20:56:00,  3.35it/s]
 32%|███▏      | 119368/371472 [9:30:01<21:14:55,  3.30it/s]
 32%|███▏      | 119369/371472 [9:30:02<20:03:44,  3.49it/s]
 32%|███▏      | 119370/371472 [9:30:02<19:13:03,  3.64it/s]
 32%|███▏      | 119371/371472 [9:30:02<19:18:03,  3.63it/s]
 32%|███▏      | 119372/371472 [9:30:02<19:36:29,  3.57it/s]
 32%|███▏      | 119373/371472 [9:30:03<19:59:06,  3.50it/s]
 32%|███▏      | 119374/371472 [9:30:03<22:02:57,  3.18it/s]
 32%|███▏      | 119375/371472 [9:30:03<21:06:29,  3.32it/s]
 32%|███▏      | 119376/371472 [9:30:04<20:50:26,  3.36it/s]
 32%|███▏      | 119377/371472 [9:30:04<20:22:07,  3.44it/s]
 32%|███▏      | 119378/371472 [9:30:04<20:08:38,  3.48it/s]
 32%|███▏      | 119379/371472 [9:30:04<21:15:01,  3.30it/s]
 32%|███▏      | 119380/371472 [9:30:05<20:56:33,  3.34it/s]
                                                            
{'loss': 3.199, 'learning_rate': 7.110959081212695e-07, 'epoch': 5.14}

 32%|███▏      | 119380/371472 [9:30:05<20:56:33,  3.34it/s]
 32%|███▏      | 119381/371472 [9:30:05<20:16:59,  3.45it/s]
 32%|███▏      | 119382/371472 [9:30:05<20:14:15,  3.46it/s]
 32%|███▏      | 119383/371472 [9:30:06<19:24:15,  3.61it/s]
 32%|███▏      | 119384/371472 [9:30:06<18:55:02,  3.70it/s]
 32%|███▏      | 119385/371472 [9:30:06<18:43:54,  3.74it/s]
 32%|███▏      | 119386/371472 [9:30:06<18:21:00,  3.82it/s]
 32%|███▏      | 119387/371472 [9:30:07<18:48:04,  3.72it/s]
 32%|███▏      | 119388/371472 [9:30:07<17:59:54,  3.89it/s]
 32%|███▏      | 119389/371472 [9:30:07<18:04:42,  3.87it/s]
 32%|███▏      | 119390/371472 [9:30:07<17:44:30,  3.95it/s]
 32%|███▏      | 119391/371472 [9:30:08<18:23:09,  3.81it/s]
 32%|███▏      | 119392/371472 [9:30:08<17:43:49,  3.95it/s]
 32%|███▏      | 119393/371472 [9:30:08<17:26:32,  4.01it/s]
 32%|███▏      | 119394/371472 [9:30:08<18:31:21,  3.78it/s]
 32%|███▏      | 119395/371472 [9:30:09<18:44:16,  3.74it/s]
 32%|███▏      | 119396/371472 [9:30:09<19:27:18,  3.60it/s]
 32%|███▏      | 119397/371472 [9:30:09<19:33:03,  3.58it/s]
 32%|███▏      | 119398/371472 [9:30:10<19:04:44,  3.67it/s]
 32%|███▏      | 119399/371472 [9:30:10<18:50:09,  3.72it/s]
 32%|███▏      | 119400/371472 [9:30:10<19:31:52,  3.58it/s]
                                                            
{'loss': 3.3073, 'learning_rate': 7.110474261457907e-07, 'epoch': 5.14}

 32%|███▏      | 119400/371472 [9:30:10<19:31:52,  3.58it/s]
 32%|███▏      | 119401/371472 [9:30:10<19:49:07,  3.53it/s]
 32%|███▏      | 119402/371472 [9:30:11<19:16:52,  3.63it/s]
 32%|███▏      | 119403/371472 [9:30:11<19:41:46,  3.55it/s]
 32%|███▏      | 119404/371472 [9:30:11<19:29:32,  3.59it/s]
 32%|███▏      | 119405/371472 [9:30:12<21:59:27,  3.18it/s]
 32%|███▏      | 119406/371472 [9:30:12<20:49:12,  3.36it/s]
 32%|███▏      | 119407/371472 [9:30:12<20:09:48,  3.47it/s]
 32%|███▏      | 119408/371472 [9:30:12<19:07:39,  3.66it/s]
 32%|███▏      | 119409/371472 [9:30:13<20:13:01,  3.46it/s]
 32%|███▏      | 119410/371472 [9:30:13<19:38:03,  3.57it/s]
 32%|███▏      | 119411/371472 [9:30:13<19:29:25,  3.59it/s]
 32%|███▏      | 119412/371472 [9:30:13<19:08:53,  3.66it/s]
 32%|███▏      | 119413/371472 [9:30:14<18:45:00,  3.73it/s]
 32%|███▏      | 119414/371472 [9:30:14<18:33:36,  3.77it/s]
 32%|███▏      | 119415/371472 [9:30:14<17:47:16,  3.94it/s]
 32%|███▏      | 119416/371472 [9:30:14<17:48:03,  3.93it/s]
 32%|███▏      | 119417/371472 [9:30:15<19:35:05,  3.57it/s]
 32%|███▏      | 119418/371472 [9:30:15<19:14:55,  3.64it/s]
 32%|███▏      | 119419/371472 [9:30:15<19:03:12,  3.67it/s]
 32%|███▏      | 119420/371472 [9:30:16<18:45:12,  3.73it/s]
                                                            
{'loss': 3.3468, 'learning_rate': 7.109989441703118e-07, 'epoch': 5.14}

 32%|███▏      | 119420/371472 [9:30:16<18:45:12,  3.73it/s]
 32%|███▏      | 119421/371472 [9:30:16<19:54:05,  3.52it/s]
 32%|███▏      | 119422/371472 [9:30:16<21:16:42,  3.29it/s]
 32%|███▏      | 119423/371472 [9:30:16<19:49:27,  3.53it/s]
 32%|███▏      | 119424/371472 [9:30:17<19:38:18,  3.57it/s]
 32%|███▏      | 119425/371472 [9:30:17<18:43:22,  3.74it/s]
 32%|███▏      | 119426/371472 [9:30:17<20:41:23,  3.38it/s]
 32%|███▏      | 119427/371472 [9:30:18<21:37:29,  3.24it/s]
 32%|███▏      | 119428/371472 [9:30:18<22:45:21,  3.08it/s]
 32%|███▏      | 119429/371472 [9:30:18<22:09:20,  3.16it/s]
 32%|███▏      | 119430/371472 [9:30:19<22:39:08,  3.09it/s]
 32%|███▏      | 119431/371472 [9:30:19<21:00:48,  3.33it/s]
 32%|███▏      | 119432/371472 [9:30:19<20:01:36,  3.50it/s]
 32%|███▏      | 119433/371472 [9:30:19<20:00:36,  3.50it/s]
 32%|███▏      | 119434/371472 [9:30:20<20:06:15,  3.48it/s]
 32%|███▏      | 119435/371472 [9:30:20<19:49:56,  3.53it/s]
 32%|███▏      | 119436/371472 [9:30:20<19:27:36,  3.60it/s]
 32%|███▏      | 119437/371472 [9:30:21<19:31:14,  3.59it/s]
 32%|███▏      | 119438/371472 [9:30:21<19:08:48,  3.66it/s]
 32%|███▏      | 119439/371472 [9:30:21<18:50:20,  3.72it/s]
 32%|███▏      | 119440/371472 [9:30:21<19:08:28,  3.66it/s]
                                                            
{'loss': 3.2473, 'learning_rate': 7.109504621948329e-07, 'epoch': 5.14}

 32%|███▏      | 119440/371472 [9:30:21<19:08:28,  3.66it/s]
 32%|███▏      | 119441/371472 [9:30:22<19:19:20,  3.62it/s]
 32%|███▏      | 119442/371472 [9:30:22<19:18:39,  3.63it/s]
 32%|███▏      | 119443/371472 [9:30:22<18:49:39,  3.72it/s]
 32%|███▏      | 119444/371472 [9:30:22<18:56:07,  3.70it/s]
 32%|███▏      | 119445/371472 [9:30:23<18:25:20,  3.80it/s]
 32%|███▏      | 119446/371472 [9:30:23<18:50:46,  3.71it/s]
 32%|███▏      | 119447/371472 [9:30:23<18:11:44,  3.85it/s]
 32%|███▏      | 119448/371472 [9:30:24<18:44:57,  3.73it/s]
 32%|███▏      | 119449/371472 [9:30:24<18:02:13,  3.88it/s]
 32%|███▏      | 119450/371472 [9:30:24<17:38:58,  3.97it/s]
 32%|███▏      | 119451/371472 [9:30:24<17:56:52,  3.90it/s]
 32%|███▏      | 119452/371472 [9:30:25<18:45:21,  3.73it/s]
 32%|███▏      | 119453/371472 [9:30:25<19:42:23,  3.55it/s]
 32%|███▏      | 119454/371472 [9:30:25<19:04:13,  3.67it/s]
 32%|███▏      | 119455/371472 [9:30:25<18:39:26,  3.75it/s]
 32%|███▏      | 119456/371472 [9:30:26<19:35:16,  3.57it/s]
 32%|███▏      | 119457/371472 [9:30:26<19:25:47,  3.60it/s]
 32%|███▏      | 119458/371472 [9:30:26<19:38:28,  3.56it/s]
 32%|███▏      | 119459/371472 [9:30:27<19:59:55,  3.50it/s]
 32%|███▏      | 119460/371472 [9:30:27<20:03:12,  3.49it/s]
                                                            
{'loss': 3.2101, 'learning_rate': 7.10901980219354e-07, 'epoch': 5.15}

 32%|███▏      | 119460/371472 [9:30:27<20:03:12,  3.49it/s]
 32%|███▏      | 119461/371472 [9:30:27<19:24:46,  3.61it/s]
 32%|███▏      | 119462/371472 [9:30:27<19:09:04,  3.66it/s]
 32%|███▏      | 119463/371472 [9:30:28<19:00:37,  3.68it/s]
 32%|███▏      | 119464/371472 [9:30:28<19:05:52,  3.67it/s]
 32%|███▏      | 119465/371472 [9:30:28<18:40:47,  3.75it/s]
 32%|███▏      | 119466/371472 [9:30:28<18:36:59,  3.76it/s]
 32%|███▏      | 119467/371472 [9:30:29<19:21:41,  3.62it/s]
 32%|███▏      | 119468/371472 [9:30:29<20:37:19,  3.39it/s]
 32%|███▏      | 119469/371472 [9:30:29<20:40:03,  3.39it/s]
 32%|███▏      | 119470/371472 [9:30:30<20:54:19,  3.35it/s]
 32%|███▏      | 119471/371472 [9:30:30<20:28:52,  3.42it/s]
 32%|███▏      | 119472/371472 [9:30:30<20:40:10,  3.39it/s]
 32%|███▏      | 119473/371472 [9:30:31<20:21:20,  3.44it/s]
 32%|███▏      | 119474/371472 [9:30:31<20:56:11,  3.34it/s]
 32%|███▏      | 119475/371472 [9:30:31<20:07:26,  3.48it/s]
 32%|███▏      | 119476/371472 [9:30:31<19:46:23,  3.54it/s]
 32%|███▏      | 119477/371472 [9:30:32<19:02:26,  3.68it/s]
 32%|███▏      | 119478/371472 [9:30:32<18:57:18,  3.69it/s]
 32%|███▏      | 119479/371472 [9:30:32<18:28:31,  3.79it/s]
 32%|███▏      | 119480/371472 [9:30:32<18:55:03,  3.70it/s]
                                                            
{'loss': 3.329, 'learning_rate': 7.108534982438751e-07, 'epoch': 5.15}

 32%|███▏      | 119480/371472 [9:30:32<18:55:03,  3.70it/s]
 32%|███▏      | 119481/371472 [9:30:33<18:13:06,  3.84it/s]
 32%|███▏      | 119482/371472 [9:30:33<17:49:14,  3.93it/s]
 32%|███▏      | 119483/371472 [9:30:33<17:52:19,  3.92it/s]
 32%|███▏      | 119484/371472 [9:30:33<17:49:38,  3.93it/s]
 32%|███▏      | 119485/371472 [9:30:34<18:45:07,  3.73it/s]
 32%|███▏      | 119486/371472 [9:30:34<18:46:22,  3.73it/s]
 32%|███▏      | 119487/371472 [9:30:34<18:18:52,  3.82it/s]
 32%|███▏      | 119488/371472 [9:30:35<18:49:44,  3.72it/s]
 32%|███▏      | 119489/371472 [9:30:35<18:23:36,  3.81it/s]
 32%|███▏      | 119490/371472 [9:30:35<18:24:06,  3.80it/s]
 32%|███▏      | 119491/371472 [9:30:35<18:32:02,  3.78it/s]
 32%|███▏      | 119492/371472 [9:30:36<20:32:43,  3.41it/s]
 32%|███▏      | 119493/371472 [9:30:36<21:51:25,  3.20it/s]
 32%|███▏      | 119494/371472 [9:30:36<21:17:21,  3.29it/s]
 32%|███▏      | 119495/371472 [9:30:37<22:07:27,  3.16it/s]
 32%|███▏      | 119496/371472 [9:30:37<20:47:07,  3.37it/s]
 32%|███▏      | 119497/371472 [9:30:37<21:05:53,  3.32it/s]
 32%|███▏      | 119498/371472 [9:30:37<20:36:11,  3.40it/s]
 32%|███▏      | 119499/371472 [9:30:38<19:55:42,  3.51it/s]
 32%|███▏      | 119500/371472 [9:30:38<19:34:08,  3.58it/s]
                                                            
{'loss': 3.2842, 'learning_rate': 7.108050162683962e-07, 'epoch': 5.15}

 32%|███▏      | 119500/371472 [9:30:38<19:34:08,  3.58it/s]
 32%|███▏      | 119501/371472 [9:30:38<21:55:06,  3.19it/s]
 32%|███▏      | 119502/371472 [9:30:39<20:45:03,  3.37it/s]
 32%|███▏      | 119503/371472 [9:30:39<19:42:26,  3.55it/s]
 32%|███▏      | 119504/371472 [9:30:39<18:56:48,  3.69it/s]
 32%|███▏      | 119505/371472 [9:30:39<18:37:15,  3.76it/s]
 32%|███▏      | 119506/371472 [9:30:40<18:25:20,  3.80it/s]
 32%|███▏      | 119507/371472 [9:30:40<18:32:20,  3.78it/s]
 32%|███▏      | 119508/371472 [9:30:40<18:37:11,  3.76it/s]
 32%|███▏      | 119509/371472 [9:30:41<19:33:41,  3.58it/s]
 32%|███▏      | 119510/371472 [9:30:41<18:39:59,  3.75it/s]
 32%|███▏      | 119511/371472 [9:30:41<18:27:37,  3.79it/s]
 32%|███▏      | 119512/371472 [9:30:41<19:05:56,  3.66it/s]
 32%|███▏      | 119513/371472 [9:30:42<19:33:35,  3.58it/s]
 32%|███▏      | 119514/371472 [9:30:42<20:21:50,  3.44it/s]
 32%|███▏      | 119515/371472 [9:30:42<19:22:59,  3.61it/s]
 32%|███▏      | 119516/371472 [9:30:42<19:50:54,  3.53it/s]
 32%|███▏      | 119517/371472 [9:30:43<19:10:39,  3.65it/s]
 32%|███▏      | 119518/371472 [9:30:43<19:10:43,  3.65it/s]
 32%|███▏      | 119519/371472 [9:30:43<18:46:48,  3.73it/s]
 32%|███▏      | 119520/371472 [9:30:44<20:52:33,  3.35it/s]
                                                            
{'loss': 3.225, 'learning_rate': 7.107565342929172e-07, 'epoch': 5.15}

 32%|███▏      | 119520/371472 [9:30:44<20:52:33,  3.35it/s]
 32%|███▏      | 119521/371472 [9:30:44<20:42:07,  3.38it/s]
 32%|███▏      | 119522/371472 [9:30:44<20:01:48,  3.49it/s]
 32%|███▏      | 119523/371472 [9:30:44<19:27:20,  3.60it/s]
 32%|███▏      | 119524/371472 [9:30:45<21:43:57,  3.22it/s]
 32%|███▏      | 119525/371472 [9:30:45<21:20:55,  3.28it/s]
 32%|███▏      | 119526/371472 [9:30:45<20:29:55,  3.41it/s]
 32%|███▏      | 119527/371472 [9:30:46<19:46:06,  3.54it/s]
 32%|███▏      | 119528/371472 [9:30:46<20:36:46,  3.40it/s]
 32%|███▏      | 119529/371472 [9:30:46<20:10:07,  3.47it/s]
 32%|███▏      | 119530/371472 [9:30:47<20:24:45,  3.43it/s]
 32%|███▏      | 119531/371472 [9:30:47<19:42:32,  3.55it/s]
 32%|███▏      | 119532/371472 [9:30:47<19:21:09,  3.62it/s]
 32%|███▏      | 119533/371472 [9:30:47<19:13:46,  3.64it/s]
 32%|███▏      | 119534/371472 [9:30:48<18:27:02,  3.79it/s]
 32%|███▏      | 119535/371472 [9:30:48<18:09:57,  3.85it/s]
 32%|███▏      | 119536/371472 [9:30:48<17:55:24,  3.90it/s]
 32%|███▏      | 119537/371472 [9:30:48<18:14:04,  3.84it/s]
 32%|███▏      | 119538/371472 [9:30:49<19:13:56,  3.64it/s]
 32%|███▏      | 119539/371472 [9:30:49<18:54:43,  3.70it/s]
 32%|███▏      | 119540/371472 [9:30:49<20:24:28,  3.43it/s]
                                                            
{'loss': 3.3703, 'learning_rate': 7.107080523174384e-07, 'epoch': 5.15}

 32%|███▏      | 119540/371472 [9:30:49<20:24:28,  3.43it/s]
 32%|███▏      | 119541/371472 [9:30:50<21:38:32,  3.23it/s]
 32%|███▏      | 119542/371472 [9:30:50<20:56:08,  3.34it/s]
 32%|███▏      | 119543/371472 [9:30:50<21:14:59,  3.29it/s]
 32%|███▏      | 119544/371472 [9:30:50<20:41:27,  3.38it/s]
 32%|███▏      | 119545/371472 [9:30:51<20:25:26,  3.43it/s]
 32%|███▏      | 119546/371472 [9:30:51<20:02:35,  3.49it/s]
 32%|███▏      | 119547/371472 [9:30:51<19:53:11,  3.52it/s]
 32%|███▏      | 119548/371472 [9:30:52<19:24:52,  3.60it/s]
 32%|███▏      | 119549/371472 [9:30:52<18:57:58,  3.69it/s]
 32%|███▏      | 119550/371472 [9:30:52<18:57:00,  3.69it/s]
 32%|███▏      | 119551/371472 [9:30:52<19:01:05,  3.68it/s]
 32%|███▏      | 119552/371472 [9:30:53<19:05:22,  3.67it/s]
 32%|███▏      | 119553/371472 [9:30:53<18:21:16,  3.81it/s]
 32%|███▏      | 119554/371472 [9:30:53<18:22:32,  3.81it/s]
 32%|███▏      | 119555/371472 [9:30:53<18:23:18,  3.81it/s]
 32%|███▏      | 119556/371472 [9:30:54<18:34:09,  3.77it/s]
 32%|███▏      | 119557/371472 [9:30:54<19:21:44,  3.61it/s]
 32%|███▏      | 119558/371472 [9:30:54<19:15:54,  3.63it/s]
 32%|███▏      | 119559/371472 [9:30:55<19:36:11,  3.57it/s]
 32%|███▏      | 119560/371472 [9:30:55<18:55:26,  3.70it/s]
                                                            
{'loss': 3.2941, 'learning_rate': 7.106595703419595e-07, 'epoch': 5.15}

 32%|███▏      | 119560/371472 [9:30:55<18:55:26,  3.70it/s]
 32%|███▏      | 119561/371472 [9:30:55<19:51:23,  3.52it/s]
 32%|███▏      | 119562/371472 [9:30:55<19:27:05,  3.60it/s]
 32%|███▏      | 119563/371472 [9:30:56<18:21:30,  3.81it/s]
 32%|███▏      | 119564/371472 [9:30:56<20:11:57,  3.46it/s]
 32%|███▏      | 119565/371472 [9:30:56<20:40:11,  3.39it/s]
 32%|███▏      | 119566/371472 [9:30:57<21:32:13,  3.25it/s]
 32%|███▏      | 119567/371472 [9:30:57<20:45:31,  3.37it/s]
 32%|███▏      | 119568/371472 [9:30:57<20:10:14,  3.47it/s]
 32%|███▏      | 119569/371472 [9:30:57<20:10:42,  3.47it/s]
 32%|███▏      | 119570/371472 [9:30:58<19:21:57,  3.61it/s]
 32%|███▏      | 119571/371472 [9:30:58<19:50:43,  3.53it/s]
 32%|███▏      | 119572/371472 [9:30:58<21:00:15,  3.33it/s]
 32%|███▏      | 119573/371472 [9:30:59<20:46:00,  3.37it/s]
 32%|███▏      | 119574/371472 [9:30:59<19:31:30,  3.58it/s]
 32%|███▏      | 119575/371472 [9:30:59<20:46:49,  3.37it/s]
 32%|███▏      | 119576/371472 [9:30:59<20:06:30,  3.48it/s]
 32%|███▏      | 119577/371472 [9:31:00<19:22:06,  3.61it/s]
 32%|███▏      | 119578/371472 [9:31:00<18:37:34,  3.76it/s]
 32%|███▏      | 119579/371472 [9:31:00<19:40:12,  3.56it/s]
 32%|███▏      | 119580/371472 [9:31:01<20:44:53,  3.37it/s]
                                                            
{'loss': 3.0823, 'learning_rate': 7.106110883664806e-07, 'epoch': 5.15}

 32%|███▏      | 119580/371472 [9:31:01<20:44:53,  3.37it/s]
 32%|███▏      | 119581/371472 [9:31:01<20:11:21,  3.47it/s]
 32%|███▏      | 119582/371472 [9:31:01<19:31:31,  3.58it/s]
 32%|███▏      | 119583/371472 [9:31:01<18:32:22,  3.77it/s]
 32%|███▏      | 119584/371472 [9:31:02<18:36:26,  3.76it/s]
 32%|███▏      | 119585/371472 [9:31:02<18:54:46,  3.70it/s]
 32%|███▏      | 119586/371472 [9:31:02<19:14:37,  3.64it/s]
 32%|███▏      | 119587/371472 [9:31:02<18:57:14,  3.69it/s]
 32%|███▏      | 119588/371472 [9:31:03<18:25:05,  3.80it/s]
 32%|███▏      | 119589/371472 [9:31:03<19:36:25,  3.57it/s]
 32%|███▏      | 119590/371472 [9:31:03<19:23:54,  3.61it/s]
 32%|███▏      | 119591/371472 [9:31:04<18:49:15,  3.72it/s]
 32%|███▏      | 119592/371472 [9:31:04<18:27:26,  3.79it/s]
 32%|███▏      | 119593/371472 [9:31:04<18:41:55,  3.74it/s]
 32%|███▏      | 119594/371472 [9:31:04<18:03:07,  3.88it/s]
 32%|███▏      | 119595/371472 [9:31:05<19:17:42,  3.63it/s]
 32%|███▏      | 119596/371472 [9:31:05<19:22:54,  3.61it/s]
 32%|███▏      | 119597/371472 [9:31:05<19:03:40,  3.67it/s]
 32%|███▏      | 119598/371472 [9:31:05<18:56:41,  3.69it/s]
 32%|███▏      | 119599/371472 [9:31:06<19:15:25,  3.63it/s]
 32%|███▏      | 119600/371472 [9:31:06<19:32:00,  3.58it/s]
                                                            
{'loss': 3.1861, 'learning_rate': 7.105626063910017e-07, 'epoch': 5.15}

 32%|███▏      | 119600/371472 [9:31:06<19:32:00,  3.58it/s]
 32%|███▏      | 119601/371472 [9:31:06<20:00:24,  3.50it/s]
 32%|███▏      | 119602/371472 [9:31:07<20:07:47,  3.48it/s]
 32%|███▏      | 119603/371472 [9:31:07<20:04:43,  3.48it/s]
 32%|███▏      | 119604/371472 [9:31:07<19:45:08,  3.54it/s]
 32%|███▏      | 119605/371472 [9:31:07<20:39:26,  3.39it/s]
 32%|███▏      | 119606/371472 [9:31:08<20:44:03,  3.37it/s]
 32%|███▏      | 119607/371472 [9:31:08<20:16:20,  3.45it/s]
 32%|███▏      | 119608/371472 [9:31:08<20:41:21,  3.38it/s]
 32%|███▏      | 119609/371472 [9:31:09<19:49:06,  3.53it/s]
 32%|███▏      | 119610/371472 [9:31:09<24:15:15,  2.88it/s]
 32%|███▏      | 119611/371472 [9:31:10<27:10:39,  2.57it/s]
 32%|███▏      | 119612/371472 [9:31:10<24:05:27,  2.90it/s]
 32%|███▏      | 119613/371472 [9:31:10<23:57:44,  2.92it/s]
 32%|███▏      | 119614/371472 [9:31:10<21:49:05,  3.21it/s]
 32%|███▏      | 119615/371472 [9:31:11<21:07:40,  3.31it/s]
 32%|███▏      | 119616/371472 [9:31:11<19:47:32,  3.53it/s]
 32%|███▏      | 119617/371472 [9:31:11<18:52:49,  3.71it/s]
 32%|███▏      | 119618/371472 [9:31:11<19:33:20,  3.58it/s]
 32%|███▏      | 119619/371472 [9:31:12<18:48:59,  3.72it/s]
 32%|███▏      | 119620/371472 [9:31:12<18:21:49,  3.81it/s]
                                                            
{'loss': 3.2413, 'learning_rate': 7.105141244155228e-07, 'epoch': 5.15}

 32%|███▏      | 119620/371472 [9:31:12<18:21:49,  3.81it/s]
 32%|███▏      | 119621/371472 [9:31:12<19:15:09,  3.63it/s]
 32%|███▏      | 119622/371472 [9:31:13<20:09:53,  3.47it/s]
 32%|███▏      | 119623/371472 [9:31:13<20:23:05,  3.43it/s]
 32%|███▏      | 119624/371472 [9:31:13<19:49:44,  3.53it/s]
 32%|███▏      | 119625/371472 [9:31:13<19:50:48,  3.52it/s]
 32%|███▏      | 119626/371472 [9:31:14<19:25:24,  3.60it/s]
 32%|███▏      | 119627/371472 [9:31:14<20:07:20,  3.48it/s]
 32%|███▏      | 119628/371472 [9:31:14<20:02:09,  3.49it/s]
 32%|███▏      | 119629/371472 [9:31:15<19:26:08,  3.60it/s]
 32%|███▏      | 119630/371472 [9:31:15<19:21:01,  3.62it/s]
 32%|███▏      | 119631/371472 [9:31:15<19:47:34,  3.53it/s]
 32%|███▏      | 119632/371472 [9:31:15<19:02:13,  3.67it/s]
 32%|███▏      | 119633/371472 [9:31:16<19:31:30,  3.58it/s]
 32%|███▏      | 119634/371472 [9:31:16<19:21:02,  3.62it/s]
 32%|███▏      | 119635/371472 [9:31:16<19:06:42,  3.66it/s]
 32%|███▏      | 119636/371472 [9:31:16<19:08:10,  3.66it/s]
 32%|███▏      | 119637/371472 [9:31:17<19:04:01,  3.67it/s]
 32%|███▏      | 119638/371472 [9:31:17<19:18:49,  3.62it/s]
 32%|███▏      | 119639/371472 [9:31:17<19:15:54,  3.63it/s]
 32%|███▏      | 119640/371472 [9:31:18<18:26:59,  3.79it/s]
                                                            
{'loss': 3.289, 'learning_rate': 7.104656424400439e-07, 'epoch': 5.15}

 32%|███▏      | 119640/371472 [9:31:18<18:26:59,  3.79it/s]
 32%|███▏      | 119641/371472 [9:31:18<19:04:19,  3.67it/s]
 32%|███▏      | 119642/371472 [9:31:18<20:45:34,  3.37it/s]
 32%|███▏      | 119643/371472 [9:31:18<21:09:15,  3.31it/s]
 32%|███▏      | 119644/371472 [9:31:19<20:32:04,  3.41it/s]
 32%|███▏      | 119645/371472 [9:31:19<19:26:51,  3.60it/s]
 32%|███▏      | 119646/371472 [9:31:19<18:33:20,  3.77it/s]
 32%|███▏      | 119647/371472 [9:31:19<18:04:11,  3.87it/s]
 32%|███▏      | 119648/371472 [9:31:20<18:22:20,  3.81it/s]
 32%|███▏      | 119649/371472 [9:31:20<18:09:48,  3.85it/s]
 32%|███▏      | 119650/371472 [9:31:20<17:55:44,  3.90it/s]
 32%|███▏      | 119651/371472 [9:31:21<19:37:07,  3.57it/s]
 32%|███▏      | 119652/371472 [9:31:21<19:15:38,  3.63it/s]
 32%|███▏      | 119653/371472 [9:31:21<19:46:59,  3.54it/s]
 32%|███▏      | 119654/371472 [9:31:21<19:42:36,  3.55it/s]
 32%|███▏      | 119655/371472 [9:31:22<18:57:30,  3.69it/s]
 32%|███▏      | 119656/371472 [9:31:22<18:20:12,  3.81it/s]
 32%|███▏      | 119657/371472 [9:31:22<17:40:05,  3.96it/s]
 32%|███▏      | 119658/371472 [9:31:22<17:23:01,  4.02it/s]
 32%|███▏      | 119659/371472 [9:31:23<18:48:00,  3.72it/s]
 32%|███▏      | 119660/371472 [9:31:23<18:29:40,  3.78it/s]
                                                            
{'loss': 3.1453, 'learning_rate': 7.10417160464565e-07, 'epoch': 5.15}

 32%|███▏      | 119660/371472 [9:31:23<18:29:40,  3.78it/s]
 32%|███▏      | 119661/371472 [9:31:23<20:15:43,  3.45it/s]
 32%|███▏      | 119662/371472 [9:31:24<19:24:57,  3.60it/s]
 32%|███▏      | 119663/371472 [9:31:24<19:09:27,  3.65it/s]
 32%|███▏      | 119664/371472 [9:31:24<19:56:58,  3.51it/s]
 32%|███▏      | 119665/371472 [9:31:24<19:37:49,  3.56it/s]
 32%|███▏      | 119666/371472 [9:31:25<18:33:26,  3.77it/s]
 32%|███▏      | 119667/371472 [9:31:25<18:14:14,  3.84it/s]
 32%|███▏      | 119668/371472 [9:31:25<18:48:23,  3.72it/s]
 32%|███▏      | 119669/371472 [9:31:25<18:44:33,  3.73it/s]
 32%|███▏      | 119670/371472 [9:31:26<18:25:53,  3.79it/s]
 32%|███▏      | 119671/371472 [9:31:26<18:27:27,  3.79it/s]
 32%|███▏      | 119672/371472 [9:31:26<18:08:37,  3.85it/s]
 32%|███▏      | 119673/371472 [9:31:27<19:24:19,  3.60it/s]
 32%|███▏      | 119674/371472 [9:31:27<19:44:18,  3.54it/s]
 32%|███▏      | 119675/371472 [9:31:27<20:07:49,  3.47it/s]
 32%|███▏      | 119676/371472 [9:31:27<19:25:14,  3.60it/s]
 32%|███▏      | 119677/371472 [9:31:28<20:03:03,  3.49it/s]
 32%|███▏      | 119678/371472 [9:31:28<19:33:48,  3.58it/s]
 32%|███▏      | 119679/371472 [9:31:28<20:11:44,  3.46it/s]
 32%|███▏      | 119680/371472 [9:31:29<20:04:28,  3.48it/s]
                                                            
{'loss': 3.3127, 'learning_rate': 7.103686784890861e-07, 'epoch': 5.15}

 32%|███▏      | 119680/371472 [9:31:29<20:04:28,  3.48it/s]
 32%|███▏      | 119681/371472 [9:31:29<21:15:02,  3.29it/s]
 32%|███▏      | 119682/371472 [9:31:29<21:40:24,  3.23it/s]
 32%|███▏      | 119683/371472 [9:31:29<20:24:32,  3.43it/s]
 32%|███▏      | 119684/371472 [9:31:30<19:36:50,  3.57it/s]
 32%|███▏      | 119685/371472 [9:31:30<20:08:34,  3.47it/s]
 32%|███▏      | 119686/371472 [9:31:30<21:12:39,  3.30it/s]
 32%|███▏      | 119687/371472 [9:31:31<20:54:28,  3.35it/s]
 32%|███▏      | 119688/371472 [9:31:31<21:30:48,  3.25it/s]
 32%|███▏      | 119689/371472 [9:31:31<20:40:47,  3.38it/s]
 32%|███▏      | 119690/371472 [9:31:31<20:08:01,  3.47it/s]
 32%|███▏      | 119691/371472 [9:31:32<20:17:43,  3.45it/s]
 32%|███▏      | 119692/371472 [9:31:32<20:08:12,  3.47it/s]
 32%|███▏      | 119693/371472 [9:31:32<19:28:08,  3.59it/s]
 32%|███▏      | 119694/371472 [9:31:33<19:14:21,  3.64it/s]
 32%|███▏      | 119695/371472 [9:31:33<19:25:07,  3.60it/s]
 32%|███▏      | 119696/371472 [9:31:33<19:31:19,  3.58it/s]
 32%|███▏      | 119697/371472 [9:31:33<19:32:07,  3.58it/s]
 32%|███▏      | 119698/371472 [9:31:34<18:43:59,  3.73it/s]
 32%|███▏      | 119699/371472 [9:31:34<18:28:02,  3.79it/s]
 32%|███▏      | 119700/371472 [9:31:34<18:47:58,  3.72it/s]
                                                            
{'loss': 3.253, 'learning_rate': 7.103201965136073e-07, 'epoch': 5.16}

 32%|███▏      | 119700/371472 [9:31:34<18:47:58,  3.72it/s]
 32%|███▏      | 119701/371472 [9:31:34<18:21:07,  3.81it/s]
 32%|███▏      | 119702/371472 [9:31:35<17:41:44,  3.95it/s]
 32%|███▏      | 119703/371472 [9:31:35<19:14:11,  3.64it/s]
 32%|███▏      | 119704/371472 [9:31:35<18:20:18,  3.81it/s]
 32%|███▏      | 119705/371472 [9:31:36<18:12:53,  3.84it/s]
 32%|███▏      | 119706/371472 [9:31:36<17:30:03,  4.00it/s]
 32%|███▏      | 119707/371472 [9:31:36<17:45:53,  3.94it/s]
 32%|███▏      | 119708/371472 [9:31:36<19:32:17,  3.58it/s]
 32%|███▏      | 119709/371472 [9:31:37<19:10:49,  3.65it/s]
 32%|███▏      | 119710/371472 [9:31:37<19:05:55,  3.66it/s]
 32%|███▏      | 119711/371472 [9:31:37<19:56:17,  3.51it/s]
 32%|███▏      | 119712/371472 [9:31:37<20:08:17,  3.47it/s]
 32%|███▏      | 119713/371472 [9:31:38<19:19:56,  3.62it/s]
 32%|███▏      | 119714/371472 [9:31:38<18:53:34,  3.70it/s]
 32%|███▏      | 119715/371472 [9:31:38<18:30:01,  3.78it/s]
 32%|███▏      | 119716/371472 [9:31:39<19:28:36,  3.59it/s]
 32%|███▏      | 119717/371472 [9:31:39<19:00:58,  3.68it/s]
 32%|███▏      | 119718/371472 [9:31:39<19:30:29,  3.58it/s]
 32%|███▏      | 119719/371472 [9:31:39<20:20:38,  3.44it/s]
 32%|███▏      | 119720/371472 [9:31:40<20:18:03,  3.44it/s]
                                                            
{'loss': 3.4088, 'learning_rate': 7.102717145381284e-07, 'epoch': 5.16}

 32%|███▏      | 119720/371472 [9:31:40<20:18:03,  3.44it/s]
 32%|███▏      | 119721/371472 [9:31:40<20:58:24,  3.33it/s]
 32%|███▏      | 119722/371472 [9:31:40<22:16:38,  3.14it/s]
 32%|███▏      | 119723/371472 [9:31:41<20:53:11,  3.35it/s]
 32%|███▏      | 119724/371472 [9:31:41<23:19:54,  3.00it/s]
 32%|███▏      | 119725/371472 [9:31:41<22:22:41,  3.12it/s]
 32%|███▏      | 119726/371472 [9:31:42<22:39:42,  3.09it/s]
 32%|███▏      | 119727/371472 [9:31:42<22:51:15,  3.06it/s]
 32%|███▏      | 119728/371472 [9:31:42<21:43:53,  3.22it/s]
 32%|███▏      | 119729/371472 [9:31:43<21:56:57,  3.19it/s]
 32%|███▏      | 119730/371472 [9:31:43<21:26:06,  3.26it/s]
 32%|███▏      | 119731/371472 [9:31:43<20:51:04,  3.35it/s]
 32%|███▏      | 119732/371472 [9:31:43<20:55:21,  3.34it/s]
 32%|███▏      | 119733/371472 [9:31:44<21:27:53,  3.26it/s]
 32%|███▏      | 119734/371472 [9:31:44<20:31:17,  3.41it/s]
 32%|███▏      | 119735/371472 [9:31:44<19:14:04,  3.64it/s]
 32%|███▏      | 119736/371472 [9:31:45<19:47:53,  3.53it/s]
 32%|███▏      | 119737/371472 [9:31:45<19:47:12,  3.53it/s]
 32%|███▏      | 119738/371472 [9:31:45<19:22:49,  3.61it/s]
 32%|███▏      | 119739/371472 [9:31:45<20:09:26,  3.47it/s]
 32%|███▏      | 119740/371472 [9:31:46<19:18:28,  3.62it/s]
                                                            
{'loss': 3.1496, 'learning_rate': 7.102232325626494e-07, 'epoch': 5.16}

 32%|███▏      | 119740/371472 [9:31:46<19:18:28,  3.62it/s]
 32%|███▏      | 119741/371472 [9:31:46<19:00:25,  3.68it/s]
 32%|███▏      | 119742/371472 [9:31:46<18:50:29,  3.71it/s]
 32%|███▏      | 119743/371472 [9:31:47<20:05:07,  3.48it/s]
 32%|███▏      | 119744/371472 [9:31:47<19:55:34,  3.51it/s]
 32%|███▏      | 119745/371472 [9:31:47<20:55:18,  3.34it/s]
 32%|███▏      | 119746/371472 [9:31:47<20:20:57,  3.44it/s]
 32%|███▏      | 119747/371472 [9:31:48<19:46:30,  3.54it/s]
 32%|███▏      | 119748/371472 [9:31:48<21:25:49,  3.26it/s]
 32%|███▏      | 119749/371472 [9:31:48<20:51:17,  3.35it/s]
 32%|███▏      | 119750/371472 [9:31:49<22:30:00,  3.11it/s]
 32%|███▏      | 119751/371472 [9:31:49<21:58:12,  3.18it/s]
 32%|███▏      | 119752/371472 [9:31:49<21:59:28,  3.18it/s]
 32%|███▏      | 119753/371472 [9:31:50<22:13:58,  3.14it/s]
 32%|███▏      | 119754/371472 [9:31:50<20:48:57,  3.36it/s]
 32%|███▏      | 119755/371472 [9:31:50<20:23:50,  3.43it/s]
 32%|███▏      | 119756/371472 [9:31:50<20:00:11,  3.50it/s]
 32%|███▏      | 119757/371472 [9:31:51<19:18:12,  3.62it/s]
 32%|███▏      | 119758/371472 [9:31:51<20:07:44,  3.47it/s]
 32%|███▏      | 119759/371472 [9:31:51<19:37:03,  3.56it/s]
 32%|███▏      | 119760/371472 [9:31:52<19:51:16,  3.52it/s]
                                                            
{'loss': 3.1972, 'learning_rate': 7.101747505871705e-07, 'epoch': 5.16}

 32%|███▏      | 119760/371472 [9:31:52<19:51:16,  3.52it/s]
 32%|███▏      | 119761/371472 [9:31:52<21:03:22,  3.32it/s]
 32%|███▏      | 119762/371472 [9:31:52<20:00:22,  3.49it/s]
 32%|███▏      | 119763/371472 [9:31:53<20:56:54,  3.34it/s]
 32%|███▏      | 119764/371472 [9:31:53<21:08:58,  3.31it/s]
 32%|███▏      | 119765/371472 [9:31:53<20:14:54,  3.45it/s]
 32%|███▏      | 119766/371472 [9:31:53<19:26:07,  3.60it/s]
 32%|███▏      | 119767/371472 [9:31:54<19:01:26,  3.68it/s]
 32%|███▏      | 119768/371472 [9:31:54<20:28:16,  3.42it/s]
 32%|███▏      | 119769/371472 [9:31:54<20:47:24,  3.36it/s]
 32%|███▏      | 119770/371472 [9:31:54<19:59:29,  3.50it/s]
 32%|███▏      | 119771/371472 [9:31:55<19:32:40,  3.58it/s]
 32%|███▏      | 119772/371472 [9:31:55<18:53:26,  3.70it/s]
 32%|███▏      | 119773/371472 [9:31:55<18:50:14,  3.71it/s]
 32%|███▏      | 119774/371472 [9:31:56<18:22:35,  3.80it/s]
 32%|███▏      | 119775/371472 [9:31:56<18:50:13,  3.71it/s]
 32%|███▏      | 119776/371472 [9:31:56<18:25:18,  3.80it/s]
 32%|███▏      | 119777/371472 [9:31:56<18:03:19,  3.87it/s]
 32%|███▏      | 119778/371472 [9:31:57<19:23:06,  3.61it/s]
 32%|███▏      | 119779/371472 [9:31:57<19:14:10,  3.63it/s]
 32%|███▏      | 119780/371472 [9:31:57<19:07:45,  3.65it/s]
                                                            
{'loss': 3.3144, 'learning_rate': 7.101262686116917e-07, 'epoch': 5.16}

 32%|███▏      | 119780/371472 [9:31:57<19:07:45,  3.65it/s]
 32%|███▏      | 119781/371472 [9:31:57<20:01:32,  3.49it/s]
 32%|███▏      | 119782/371472 [9:31:58<19:10:33,  3.65it/s]
 32%|███▏      | 119783/371472 [9:31:58<19:09:15,  3.65it/s]
 32%|███▏      | 119784/371472 [9:31:58<19:36:27,  3.57it/s]
 32%|███▏      | 119785/371472 [9:31:59<20:12:30,  3.46it/s]
 32%|███▏      | 119786/371472 [9:31:59<20:03:38,  3.49it/s]
 32%|███▏      | 119787/371472 [9:31:59<19:39:28,  3.56it/s]
 32%|███▏      | 119788/371472 [9:31:59<19:28:33,  3.59it/s]
 32%|███▏      | 119789/371472 [9:32:00<18:40:44,  3.74it/s]
 32%|███▏      | 119790/371472 [9:32:00<18:38:15,  3.75it/s]
 32%|███▏      | 119791/371472 [9:32:00<19:11:32,  3.64it/s]
 32%|███▏      | 119792/371472 [9:32:01<20:10:51,  3.46it/s]
 32%|███▏      | 119793/371472 [9:32:01<19:14:16,  3.63it/s]
 32%|███▏      | 119794/371472 [9:32:01<19:03:50,  3.67it/s]
 32%|███▏      | 119795/371472 [9:32:01<22:07:16,  3.16it/s]
 32%|███▏      | 119796/371472 [9:32:02<20:42:20,  3.38it/s]
 32%|███▏      | 119797/371472 [9:32:02<21:23:24,  3.27it/s]
 32%|███▏      | 119798/371472 [9:32:02<20:41:19,  3.38it/s]
 32%|███▏      | 119799/371472 [9:32:03<20:08:47,  3.47it/s]
 32%|███▏      | 119800/371472 [9:32:03<22:24:40,  3.12it/s]
                                                            
{'loss': 3.2915, 'learning_rate': 7.100777866362128e-07, 'epoch': 5.16}

 32%|███▏      | 119800/371472 [9:32:03<22:24:40,  3.12it/s]
 32%|███▏      | 119801/371472 [9:32:03<22:56:18,  3.05it/s]
 32%|███▏      | 119802/371472 [9:32:04<21:35:02,  3.24it/s]
 32%|███▏      | 119803/371472 [9:32:04<21:28:06,  3.26it/s]
 32%|███▏      | 119804/371472 [9:32:04<20:15:50,  3.45it/s]
 32%|███▏      | 119805/371472 [9:32:04<20:30:25,  3.41it/s]
 32%|███▏      | 119806/371472 [9:32:05<20:23:25,  3.43it/s]
 32%|███▏      | 119807/371472 [9:32:05<20:07:38,  3.47it/s]
 32%|███▏      | 119808/371472 [9:32:05<19:24:33,  3.60it/s]
 32%|███▏      | 119809/371472 [9:32:06<20:17:08,  3.45it/s]
 32%|███▏      | 119810/371472 [9:32:06<19:23:47,  3.60it/s]
 32%|███▏      | 119811/371472 [9:32:06<18:55:39,  3.69it/s]
 32%|███▏      | 119812/371472 [9:32:06<19:10:16,  3.65it/s]
 32%|███▏      | 119813/371472 [9:32:07<18:42:51,  3.74it/s]
 32%|███▏      | 119814/371472 [9:32:07<18:47:06,  3.72it/s]
 32%|███▏      | 119815/371472 [9:32:07<19:28:49,  3.59it/s]
 32%|███▏      | 119816/371472 [9:32:08<22:16:42,  3.14it/s]
 32%|███▏      | 119817/371472 [9:32:08<21:44:18,  3.22it/s]
 32%|███▏      | 119818/371472 [9:32:08<21:23:38,  3.27it/s]
 32%|███▏      | 119819/371472 [9:32:08<20:03:00,  3.49it/s]
 32%|███▏      | 119820/371472 [9:32:09<20:24:26,  3.43it/s]
                                                            
{'loss': 3.2987, 'learning_rate': 7.100293046607338e-07, 'epoch': 5.16}

 32%|███▏      | 119820/371472 [9:32:09<20:24:26,  3.43it/s]
 32%|███▏      | 119821/371472 [9:32:09<19:46:28,  3.53it/s]
 32%|███▏      | 119822/371472 [9:32:09<19:20:16,  3.61it/s]
 32%|███▏      | 119823/371472 [9:32:10<19:50:08,  3.52it/s]
 32%|███▏      | 119824/371472 [9:32:10<20:07:16,  3.47it/s]
 32%|███▏      | 119825/371472 [9:32:10<22:11:40,  3.15it/s]
 32%|███▏      | 119826/371472 [9:32:11<21:06:19,  3.31it/s]
 32%|███▏      | 119827/371472 [9:32:11<21:27:03,  3.26it/s]
 32%|███▏      | 119828/371472 [9:32:11<21:48:30,  3.21it/s]
 32%|███▏      | 119829/371472 [9:32:11<21:04:00,  3.32it/s]
 32%|███▏      | 119830/371472 [9:32:12<21:41:13,  3.22it/s]
 32%|███▏      | 119831/371472 [9:32:12<20:56:33,  3.34it/s]
 32%|███▏      | 119832/371472 [9:32:12<20:54:35,  3.34it/s]
 32%|███▏      | 119833/371472 [9:32:13<19:33:45,  3.57it/s]
 32%|███▏      | 119834/371472 [9:32:13<21:17:36,  3.28it/s]
 32%|███▏      | 119835/371472 [9:32:13<20:38:30,  3.39it/s]
 32%|███▏      | 119836/371472 [9:32:13<20:06:19,  3.48it/s]
 32%|███▏      | 119837/371472 [9:32:14<21:25:01,  3.26it/s]
 32%|███▏      | 119838/371472 [9:32:14<21:23:34,  3.27it/s]
 32%|███▏      | 119839/371472 [9:32:14<22:08:15,  3.16it/s]
 32%|███▏      | 119840/371472 [9:32:15<21:56:36,  3.19it/s]
                                                            
{'loss': 3.3093, 'learning_rate': 7.09980822685255e-07, 'epoch': 5.16}

 32%|███▏      | 119840/371472 [9:32:15<21:56:36,  3.19it/s]
 32%|███▏      | 119841/371472 [9:32:15<20:15:53,  3.45it/s]
 32%|███▏      | 119842/371472 [9:32:15<20:33:49,  3.40it/s]
 32%|███▏      | 119843/371472 [9:32:16<21:08:08,  3.31it/s]
 32%|███▏      | 119844/371472 [9:32:16<20:19:07,  3.44it/s]
 32%|███▏      | 119845/371472 [9:32:16<20:23:47,  3.43it/s]
 32%|███▏      | 119846/371472 [9:32:16<20:12:02,  3.46it/s]
 32%|███▏      | 119847/371472 [9:32:17<21:57:43,  3.18it/s]
 32%|███▏      | 119848/371472 [9:32:17<21:54:25,  3.19it/s]
 32%|███▏      | 119849/371472 [9:32:17<21:28:05,  3.26it/s]
 32%|███▏      | 119850/371472 [9:32:18<20:36:04,  3.39it/s]
 32%|███▏      | 119851/371472 [9:32:18<19:48:39,  3.53it/s]
 32%|███▏      | 119852/371472 [9:32:18<20:02:38,  3.49it/s]
 32%|███▏      | 119853/371472 [9:32:19<19:43:33,  3.54it/s]
 32%|███▏      | 119854/371472 [9:32:19<20:26:56,  3.42it/s]
 32%|███▏      | 119855/371472 [9:32:19<20:15:12,  3.45it/s]
 32%|███▏      | 119856/371472 [9:32:19<19:49:50,  3.52it/s]
 32%|███▏      | 119857/371472 [9:32:20<19:34:08,  3.57it/s]
 32%|███▏      | 119858/371472 [9:32:20<19:24:07,  3.60it/s]
 32%|███▏      | 119859/371472 [9:32:20<18:35:22,  3.76it/s]
 32%|███▏      | 119860/371472 [9:32:20<18:49:36,  3.71it/s]
                                                            
{'loss': 3.0692, 'learning_rate': 7.099323407097761e-07, 'epoch': 5.16}

 32%|███▏      | 119860/371472 [9:32:20<18:49:36,  3.71it/s]
 32%|███▏      | 119861/371472 [9:32:21<18:19:25,  3.81it/s]
 32%|███▏      | 119862/371472 [9:32:21<17:54:04,  3.90it/s]
 32%|███▏      | 119863/371472 [9:32:21<19:32:01,  3.58it/s]
 32%|███▏      | 119864/371472 [9:32:22<18:51:11,  3.71it/s]
 32%|███▏      | 119865/371472 [9:32:22<18:49:25,  3.71it/s]
 32%|███▏      | 119866/371472 [9:32:22<18:29:37,  3.78it/s]
 32%|███▏      | 119867/371472 [9:32:22<19:19:52,  3.62it/s]
 32%|███▏      | 119868/371472 [9:32:23<20:56:08,  3.34it/s]
 32%|███▏      | 119869/371472 [9:32:23<20:11:17,  3.46it/s]
 32%|███▏      | 119870/371472 [9:32:23<20:35:38,  3.39it/s]
 32%|███▏      | 119871/371472 [9:32:24<19:54:45,  3.51it/s]
 32%|███▏      | 119872/371472 [9:32:24<20:04:27,  3.48it/s]
 32%|███▏      | 119873/371472 [9:32:24<19:22:16,  3.61it/s]
 32%|███▏      | 119874/371472 [9:32:25<22:46:04,  3.07it/s]
 32%|███▏      | 119875/371472 [9:32:25<21:57:52,  3.18it/s]
 32%|███▏      | 119876/371472 [9:32:25<21:13:21,  3.29it/s]
 32%|███▏      | 119877/371472 [9:32:25<20:26:10,  3.42it/s]
 32%|███▏      | 119878/371472 [9:32:26<20:30:41,  3.41it/s]
 32%|███▏      | 119879/371472 [9:32:26<19:33:36,  3.57it/s]
 32%|███▏      | 119880/371472 [9:32:26<19:14:46,  3.63it/s]
                                                            
{'loss': 3.2909, 'learning_rate': 7.098838587342972e-07, 'epoch': 5.16}

 32%|███▏      | 119880/371472 [9:32:26<19:14:46,  3.63it/s]
 32%|███▏      | 119881/371472 [9:32:26<19:05:52,  3.66it/s]
 32%|███▏      | 119882/371472 [9:32:27<19:30:28,  3.58it/s]
 32%|███▏      | 119883/371472 [9:32:27<20:02:28,  3.49it/s]
 32%|███▏      | 119884/371472 [9:32:27<19:24:18,  3.60it/s]
 32%|███▏      | 119885/371472 [9:32:28<19:55:05,  3.51it/s]
 32%|███▏      | 119886/371472 [9:32:28<20:03:29,  3.48it/s]
 32%|███▏      | 119887/371472 [9:32:28<19:42:23,  3.55it/s]
 32%|███▏      | 119888/371472 [9:32:28<18:49:31,  3.71it/s]
 32%|███▏      | 119889/371472 [9:32:29<19:02:41,  3.67it/s]
 32%|███▏      | 119890/371472 [9:32:29<19:15:41,  3.63it/s]
 32%|███▏      | 119891/371472 [9:32:29<18:17:24,  3.82it/s]
 32%|███▏      | 119892/371472 [9:32:29<18:21:38,  3.81it/s]
 32%|███▏      | 119893/371472 [9:32:30<18:54:48,  3.69it/s]
 32%|███▏      | 119894/371472 [9:32:30<19:06:45,  3.66it/s]
 32%|███▏      | 119895/371472 [9:32:30<19:21:28,  3.61it/s]
 32%|███▏      | 119896/371472 [9:32:31<19:25:17,  3.60it/s]
 32%|███▏      | 119897/371472 [9:32:31<18:52:02,  3.70it/s]
 32%|███▏      | 119898/371472 [9:32:31<19:12:40,  3.64it/s]
 32%|███▏      | 119899/371472 [9:32:31<18:36:59,  3.75it/s]
 32%|███▏      | 119900/371472 [9:32:32<19:46:56,  3.53it/s]
                                                            
{'loss': 3.1687, 'learning_rate': 7.098353767588182e-07, 'epoch': 5.16}

 32%|███▏      | 119900/371472 [9:32:32<19:46:56,  3.53it/s]
 32%|███▏      | 119901/371472 [9:32:32<19:06:34,  3.66it/s]
 32%|███▏      | 119902/371472 [9:32:32<19:06:27,  3.66it/s]
 32%|███▏      | 119903/371472 [9:32:33<19:44:18,  3.54it/s]
 32%|███▏      | 119904/371472 [9:32:33<20:11:02,  3.46it/s]
 32%|███▏      | 119905/371472 [9:32:33<20:12:28,  3.46it/s]
 32%|███▏      | 119906/371472 [9:32:33<19:54:28,  3.51it/s]
 32%|███▏      | 119907/371472 [9:32:34<18:58:29,  3.68it/s]
 32%|███▏      | 119908/371472 [9:32:34<20:00:31,  3.49it/s]
 32%|███▏      | 119909/371472 [9:32:34<19:56:59,  3.50it/s]
 32%|███▏      | 119910/371472 [9:32:35<18:59:36,  3.68it/s]
 32%|███▏      | 119911/371472 [9:32:35<19:47:51,  3.53it/s]
 32%|███▏      | 119912/371472 [9:32:35<19:13:48,  3.63it/s]
 32%|███▏      | 119913/371472 [9:32:35<18:39:14,  3.75it/s]
 32%|███▏      | 119914/371472 [9:32:36<20:19:51,  3.44it/s]
 32%|███▏      | 119915/371472 [9:32:36<20:40:47,  3.38it/s]
 32%|███▏      | 119916/371472 [9:32:36<22:04:15,  3.17it/s]
 32%|███▏      | 119917/371472 [9:32:37<20:56:04,  3.34it/s]
 32%|███▏      | 119918/371472 [9:32:37<20:18:51,  3.44it/s]
 32%|███▏      | 119919/371472 [9:32:37<20:56:49,  3.34it/s]
 32%|███▏      | 119920/371472 [9:32:38<21:21:32,  3.27it/s]
                                                            
{'loss': 3.2103, 'learning_rate': 7.097868947833394e-07, 'epoch': 5.17}

 32%|███▏      | 119920/371472 [9:32:38<21:21:32,  3.27it/s]
 32%|███▏      | 119921/371472 [9:32:38<21:44:39,  3.21it/s]
 32%|███▏      | 119922/371472 [9:32:38<21:05:42,  3.31it/s]
 32%|███▏      | 119923/371472 [9:32:38<21:31:35,  3.25it/s]
 32%|███▏      | 119924/371472 [9:32:39<20:47:19,  3.36it/s]
 32%|███▏      | 119925/371472 [9:32:39<20:10:26,  3.46it/s]
 32%|███▏      | 119926/371472 [9:32:39<19:40:24,  3.55it/s]
 32%|███▏      | 119927/371472 [9:32:39<19:08:28,  3.65it/s]
 32%|███▏      | 119928/371472 [9:32:40<18:55:08,  3.69it/s]
 32%|███▏      | 119929/371472 [9:32:40<19:51:30,  3.52it/s]
 32%|███▏      | 119930/371472 [9:32:40<19:48:05,  3.53it/s]
 32%|███▏      | 119931/371472 [9:32:41<19:28:30,  3.59it/s]
 32%|███▏      | 119932/371472 [9:32:41<20:55:26,  3.34it/s]
 32%|███▏      | 119933/371472 [9:32:41<19:34:10,  3.57it/s]
 32%|███▏      | 119934/371472 [9:32:41<19:47:27,  3.53it/s]
 32%|███▏      | 119935/371472 [9:32:42<19:25:41,  3.60it/s]
 32%|███▏      | 119936/371472 [9:32:42<20:08:57,  3.47it/s]
 32%|███▏      | 119937/371472 [9:32:42<19:25:45,  3.60it/s]
 32%|███▏      | 119938/371472 [9:32:43<19:21:23,  3.61it/s]
 32%|███▏      | 119939/371472 [9:32:43<19:48:37,  3.53it/s]
 32%|███▏      | 119940/371472 [9:32:43<20:53:16,  3.34it/s]
                                                            
{'loss': 3.1913, 'learning_rate': 7.097384128078606e-07, 'epoch': 5.17}

 32%|███▏      | 119940/371472 [9:32:43<20:53:16,  3.34it/s]
 32%|███▏      | 119941/371472 [9:32:44<22:47:45,  3.07it/s]
 32%|███▏      | 119942/371472 [9:32:44<21:22:28,  3.27it/s]
 32%|███▏      | 119943/371472 [9:32:44<21:19:28,  3.28it/s]
 32%|███▏      | 119944/371472 [9:32:44<19:45:59,  3.53it/s]
 32%|███▏      | 119945/371472 [9:32:45<20:08:03,  3.47it/s]
 32%|███▏      | 119946/371472 [9:32:45<21:03:26,  3.32it/s]
 32%|███▏      | 119947/371472 [9:32:45<21:13:55,  3.29it/s]
 32%|███▏      | 119948/371472 [9:32:46<21:02:20,  3.32it/s]
 32%|███▏      | 119949/371472 [9:32:46<20:03:52,  3.48it/s]
 32%|███▏      | 119950/371472 [9:32:46<19:44:08,  3.54it/s]
 32%|███▏      | 119951/371472 [9:32:46<19:39:21,  3.55it/s]
 32%|███▏      | 119952/371472 [9:32:47<19:20:10,  3.61it/s]
 32%|███▏      | 119953/371472 [9:32:47<19:17:24,  3.62it/s]
 32%|███▏      | 119954/371472 [9:32:47<20:00:44,  3.49it/s]
 32%|███▏      | 119955/371472 [9:32:48<19:12:20,  3.64it/s]
 32%|███▏      | 119956/371472 [9:32:48<20:16:56,  3.44it/s]
 32%|███▏      | 119957/371472 [9:32:48<21:17:51,  3.28it/s]
 32%|███▏      | 119958/371472 [9:32:49<21:02:13,  3.32it/s]
 32%|███▏      | 119959/371472 [9:32:49<20:22:26,  3.43it/s]
 32%|███▏      | 119960/371472 [9:32:49<19:49:39,  3.52it/s]
                                                            
{'loss': 3.2558, 'learning_rate': 7.096899308323817e-07, 'epoch': 5.17}

 32%|███▏      | 119960/371472 [9:32:49<19:49:39,  3.52it/s]
 32%|███▏      | 119961/371472 [9:32:49<18:43:04,  3.73it/s]
 32%|███▏      | 119962/371472 [9:32:50<19:58:18,  3.50it/s]
 32%|███▏      | 119963/371472 [9:32:50<19:59:00,  3.50it/s]
 32%|███▏      | 119964/371472 [9:32:50<19:50:57,  3.52it/s]
 32%|███▏      | 119965/371472 [9:32:50<19:27:27,  3.59it/s]
 32%|███▏      | 119966/371472 [9:32:51<19:18:21,  3.62it/s]
 32%|███▏      | 119967/371472 [9:32:51<18:50:37,  3.71it/s]
 32%|███▏      | 119968/371472 [9:32:51<18:34:58,  3.76it/s]
 32%|███▏      | 119969/371472 [9:32:51<18:40:09,  3.74it/s]
 32%|███▏      | 119970/371472 [9:32:52<18:17:57,  3.82it/s]
 32%|███▏      | 119971/371472 [9:32:52<17:59:19,  3.88it/s]
 32%|███▏      | 119972/371472 [9:32:52<19:09:27,  3.65it/s]
 32%|███▏      | 119973/371472 [9:32:53<22:05:41,  3.16it/s]
 32%|███▏      | 119974/371472 [9:32:53<22:00:15,  3.17it/s]
 32%|███▏      | 119975/371472 [9:32:53<20:53:40,  3.34it/s]
 32%|███▏      | 119976/371472 [9:32:54<19:47:07,  3.53it/s]
 32%|███▏      | 119977/371472 [9:32:54<19:45:21,  3.54it/s]
 32%|███▏      | 119978/371472 [9:32:54<20:06:38,  3.47it/s]
 32%|███▏      | 119979/371472 [9:32:54<20:00:53,  3.49it/s]
 32%|███▏      | 119980/371472 [9:32:55<20:23:42,  3.43it/s]
                                                            
{'loss': 3.4224, 'learning_rate': 7.096414488569027e-07, 'epoch': 5.17}

 32%|███▏      | 119980/371472 [9:32:55<20:23:42,  3.43it/s]
 32%|███▏      | 119981/371472 [9:32:55<20:34:11,  3.40it/s]
 32%|███▏      | 119982/371472 [9:32:55<20:52:44,  3.35it/s]
 32%|███▏      | 119983/371472 [9:32:56<19:37:27,  3.56it/s]
 32%|███▏      | 119984/371472 [9:32:56<19:45:23,  3.54it/s]
 32%|███▏      | 119985/371472 [9:32:56<18:58:37,  3.68it/s]
 32%|███▏      | 119986/371472 [9:32:56<19:00:54,  3.67it/s]
 32%|███▏      | 119987/371472 [9:32:57<18:40:54,  3.74it/s]
 32%|███▏      | 119988/371472 [9:32:57<18:34:46,  3.76it/s]
 32%|███▏      | 119989/371472 [9:32:57<18:52:28,  3.70it/s]
 32%|███▏      | 119990/371472 [9:32:58<20:21:55,  3.43it/s]
 32%|███▏      | 119991/371472 [9:32:58<20:04:06,  3.48it/s]
 32%|███▏      | 119992/371472 [9:32:58<19:45:36,  3.54it/s]
 32%|███▏      | 119993/371472 [9:32:58<19:46:57,  3.53it/s]
 32%|███▏      | 119994/371472 [9:32:59<20:22:00,  3.43it/s]
 32%|███▏      | 119995/371472 [9:32:59<19:31:34,  3.58it/s]
 32%|███▏      | 119996/371472 [9:32:59<18:57:22,  3.69it/s]
 32%|███▏      | 119997/371472 [9:32:59<19:27:35,  3.59it/s]
 32%|███▏      | 119998/371472 [9:33:00<19:35:29,  3.57it/s]
 32%|███▏      | 119999/371472 [9:33:00<18:49:08,  3.71it/s]
 32%|███▏      | 120000/371472 [9:33:00<19:12:38,  3.64it/s]
                                                            
{'loss': 3.4945, 'learning_rate': 7.095929668814238e-07, 'epoch': 5.17}

 32%|███▏      | 120000/371472 [9:33:00<19:12:38,  3.64it/s]
 32%|███▏      | 120001/371472 [9:33:01<19:33:27,  3.57it/s]
 32%|███▏      | 120002/371472 [9:33:01<18:56:48,  3.69it/s]
 32%|███▏      | 120003/371472 [9:33:01<18:37:09,  3.75it/s]
 32%|███▏      | 120004/371472 [9:33:01<18:04:25,  3.86it/s]
 32%|███▏      | 120005/371472 [9:33:02<18:33:06,  3.77it/s]
 32%|███▏      | 120006/371472 [9:33:02<18:14:05,  3.83it/s]
 32%|███▏      | 120007/371472 [9:33:02<17:36:41,  3.97it/s]
 32%|███▏      | 120008/371472 [9:33:02<18:03:04,  3.87it/s]
 32%|███▏      | 120009/371472 [9:33:03<17:48:41,  3.92it/s]
 32%|███▏      | 120010/371472 [9:33:03<18:14:28,  3.83it/s]
 32%|███▏      | 120011/371472 [9:33:03<18:23:13,  3.80it/s]
 32%|███▏      | 120012/371472 [9:33:03<20:02:20,  3.49it/s]
 32%|███▏      | 120013/371472 [9:33:04<19:35:33,  3.57it/s]
 32%|███▏      | 120014/371472 [9:33:04<19:25:32,  3.60it/s]
 32%|███▏      | 120015/371472 [9:33:04<18:34:40,  3.76it/s]
 32%|███▏      | 120016/371472 [9:33:05<19:26:21,  3.59it/s]
 32%|███▏      | 120017/371472 [9:33:05<18:48:32,  3.71it/s]
 32%|███▏      | 120018/371472 [9:33:05<18:22:33,  3.80it/s]
 32%|███▏      | 120019/371472 [9:33:05<17:48:08,  3.92it/s]
 32%|███▏      | 120020/371472 [9:33:06<17:54:08,  3.90it/s]
                                                            
{'loss': 3.4162, 'learning_rate': 7.09544484905945e-07, 'epoch': 5.17}

 32%|███▏      | 120020/371472 [9:33:06<17:54:08,  3.90it/s]
 32%|███▏      | 120021/371472 [9:33:06<18:14:59,  3.83it/s]
 32%|███▏      | 120022/371472 [9:33:06<18:18:27,  3.82it/s]
 32%|███▏      | 120023/371472 [9:33:06<18:44:39,  3.73it/s]
 32%|███▏      | 120024/371472 [9:33:07<18:25:13,  3.79it/s]
 32%|███▏      | 120025/371472 [9:33:07<19:13:25,  3.63it/s]
 32%|███▏      | 120026/371472 [9:33:07<19:35:49,  3.56it/s]
 32%|███▏      | 120027/371472 [9:33:07<19:20:48,  3.61it/s]
 32%|███▏      | 120028/371472 [9:33:08<19:57:45,  3.50it/s]
 32%|███▏      | 120029/371472 [9:33:08<19:09:12,  3.65it/s]
 32%|███▏      | 120030/371472 [9:33:08<19:19:38,  3.61it/s]
 32%|███▏      | 120031/371472 [9:33:09<21:26:50,  3.26it/s]
 32%|███▏      | 120032/371472 [9:33:09<20:21:39,  3.43it/s]
 32%|███▏      | 120033/371472 [9:33:09<19:54:38,  3.51it/s]
 32%|███▏      | 120034/371472 [9:33:09<19:14:31,  3.63it/s]
 32%|███▏      | 120035/371472 [9:33:10<18:38:27,  3.75it/s]
 32%|███▏      | 120036/371472 [9:33:10<18:23:46,  3.80it/s]
 32%|███▏      | 120037/371472 [9:33:10<18:13:36,  3.83it/s]
 32%|███▏      | 120038/371472 [9:33:10<17:44:23,  3.94it/s]
 32%|███▏      | 120039/371472 [9:33:11<17:25:54,  4.01it/s]
 32%|███▏      | 120040/371472 [9:33:11<17:21:58,  4.02it/s]
                                                            
{'loss': 3.1287, 'learning_rate': 7.094960029304661e-07, 'epoch': 5.17}

 32%|███▏      | 120040/371472 [9:33:11<17:21:58,  4.02it/s]
 32%|███▏      | 120041/371472 [9:33:11<18:10:57,  3.84it/s]
 32%|███▏      | 120042/371472 [9:33:12<18:23:18,  3.80it/s]
 32%|███▏      | 120043/371472 [9:33:12<19:06:54,  3.65it/s]
 32%|███▏      | 120044/371472 [9:33:12<19:26:17,  3.59it/s]
 32%|███▏      | 120045/371472 [9:33:12<19:39:56,  3.55it/s]
 32%|███▏      | 120046/371472 [9:33:13<19:45:37,  3.53it/s]
 32%|███▏      | 120047/371472 [9:33:13<19:59:18,  3.49it/s]
 32%|███▏      | 120048/371472 [9:33:13<19:52:55,  3.51it/s]
 32%|███▏      | 120049/371472 [9:33:14<19:29:01,  3.58it/s]
 32%|███▏      | 120050/371472 [9:33:14<18:52:54,  3.70it/s]
 32%|███▏      | 120051/371472 [9:33:14<21:24:57,  3.26it/s]
 32%|███▏      | 120052/371472 [9:33:14<21:10:35,  3.30it/s]
 32%|███▏      | 120053/371472 [9:33:15<21:39:41,  3.22it/s]
 32%|███▏      | 120054/371472 [9:33:15<22:13:27,  3.14it/s]
 32%|███▏      | 120055/371472 [9:33:15<21:16:17,  3.28it/s]
 32%|███▏      | 120056/371472 [9:33:16<20:36:13,  3.39it/s]
 32%|███▏      | 120057/371472 [9:33:16<20:40:25,  3.38it/s]
 32%|███▏      | 120058/371472 [9:33:16<20:41:56,  3.37it/s]
 32%|███▏      | 120059/371472 [9:33:17<19:51:18,  3.52it/s]
 32%|███▏      | 120060/371472 [9:33:17<18:54:17,  3.69it/s]
                                                            
{'loss': 3.2619, 'learning_rate': 7.094475209549871e-07, 'epoch': 5.17}

 32%|███▏      | 120060/371472 [9:33:17<18:54:17,  3.69it/s]
 32%|███▏      | 120061/371472 [9:33:17<19:40:42,  3.55it/s]
 32%|███▏      | 120062/371472 [9:33:17<20:13:26,  3.45it/s]
 32%|███▏      | 120063/371472 [9:33:18<21:13:18,  3.29it/s]
 32%|███▏      | 120064/371472 [9:33:18<21:32:48,  3.24it/s]
 32%|███▏      | 120065/371472 [9:33:18<22:32:52,  3.10it/s]
 32%|███▏      | 120066/371472 [9:33:19<21:26:51,  3.26it/s]
 32%|███▏      | 120067/371472 [9:33:19<20:05:14,  3.48it/s]
 32%|███▏      | 120068/371472 [9:33:19<21:19:32,  3.27it/s]
 32%|███▏      | 120069/371472 [9:33:20<20:25:28,  3.42it/s]
 32%|███▏      | 120070/371472 [9:33:20<23:47:23,  2.94it/s]
 32%|███▏      | 120071/371472 [9:33:20<22:38:32,  3.08it/s]
 32%|███▏      | 120072/371472 [9:33:21<21:35:02,  3.24it/s]
 32%|███▏      | 120073/371472 [9:33:21<20:53:10,  3.34it/s]
 32%|███▏      | 120074/371472 [9:33:21<21:36:39,  3.23it/s]
 32%|███▏      | 120075/371472 [9:33:21<20:51:36,  3.35it/s]
 32%|███▏      | 120076/371472 [9:33:22<19:44:57,  3.54it/s]
 32%|███▏      | 120077/371472 [9:33:22<19:08:40,  3.65it/s]
 32%|███▏      | 120078/371472 [9:33:22<19:10:31,  3.64it/s]
 32%|███▏      | 120079/371472 [9:33:22<19:54:53,  3.51it/s]
 32%|███▏      | 120080/371472 [9:33:23<20:58:08,  3.33it/s]
                                                            
{'loss': 3.351, 'learning_rate': 7.093990389795083e-07, 'epoch': 5.17}

 32%|███▏      | 120080/371472 [9:33:23<20:58:08,  3.33it/s]
 32%|███▏      | 120081/371472 [9:33:23<20:47:41,  3.36it/s]
 32%|███▏      | 120082/371472 [9:33:23<19:42:23,  3.54it/s]
 32%|███▏      | 120083/371472 [9:33:24<19:39:17,  3.55it/s]
 32%|███▏      | 120084/371472 [9:33:24<19:40:54,  3.55it/s]
 32%|███▏      | 120085/371472 [9:33:24<19:38:01,  3.56it/s]
 32%|███▏      | 120086/371472 [9:33:24<19:29:48,  3.58it/s]
 32%|███▏      | 120087/371472 [9:33:25<19:03:30,  3.66it/s]
 32%|███▏      | 120088/371472 [9:33:25<19:01:07,  3.67it/s]
 32%|███▏      | 120089/371472 [9:33:25<20:11:49,  3.46it/s]
 32%|███▏      | 120090/371472 [9:33:26<19:33:19,  3.57it/s]
 32%|███▏      | 120091/371472 [9:33:26<19:23:40,  3.60it/s]
 32%|███▏      | 120092/371472 [9:33:26<18:56:26,  3.69it/s]
 32%|███▏      | 120093/371472 [9:33:26<18:53:17,  3.70it/s]
 32%|███▏      | 120094/371472 [9:33:27<18:21:00,  3.81it/s]
 32%|███▏      | 120095/371472 [9:33:27<20:41:33,  3.37it/s]
 32%|███▏      | 120096/371472 [9:33:27<20:50:37,  3.35it/s]
 32%|███▏      | 120097/371472 [9:33:28<19:46:10,  3.53it/s]
 32%|███▏      | 120098/371472 [9:33:28<19:16:17,  3.62it/s]
 32%|███▏      | 120099/371472 [9:33:28<18:38:23,  3.75it/s]
 32%|███▏      | 120100/371472 [9:33:28<19:38:50,  3.55it/s]
                                                            
{'loss': 3.2758, 'learning_rate': 7.093505570040294e-07, 'epoch': 5.17}

 32%|███▏      | 120100/371472 [9:33:28<19:38:50,  3.55it/s]
 32%|███▏      | 120101/371472 [9:33:29<19:43:11,  3.54it/s]
 32%|███▏      | 120102/371472 [9:33:29<20:44:46,  3.37it/s]
 32%|███▏      | 120103/371472 [9:33:29<19:55:18,  3.50it/s]
 32%|███▏      | 120104/371472 [9:33:30<19:12:58,  3.63it/s]
 32%|███▏      | 120105/371472 [9:33:30<18:36:43,  3.75it/s]
 32%|███▏      | 120106/371472 [9:33:30<19:04:43,  3.66it/s]
 32%|███▏      | 120107/371472 [9:33:30<19:09:08,  3.65it/s]
 32%|███▏      | 120108/371472 [9:33:31<20:47:08,  3.36it/s]
 32%|███▏      | 120109/371472 [9:33:31<19:53:33,  3.51it/s]
 32%|███▏      | 120110/371472 [9:33:31<19:04:01,  3.66it/s]
 32%|███▏      | 120111/371472 [9:33:32<20:22:04,  3.43it/s]
 32%|███▏      | 120112/371472 [9:33:32<20:02:09,  3.48it/s]
 32%|███▏      | 120113/371472 [9:33:32<20:14:30,  3.45it/s]
 32%|███▏      | 120114/371472 [9:33:32<21:05:50,  3.31it/s]
 32%|███▏      | 120115/371472 [9:33:33<19:51:55,  3.51it/s]
 32%|███▏      | 120116/371472 [9:33:33<19:46:32,  3.53it/s]
 32%|███▏      | 120117/371472 [9:33:33<20:30:42,  3.40it/s]
 32%|███▏      | 120118/371472 [9:33:34<19:32:17,  3.57it/s]
 32%|███▏      | 120119/371472 [9:33:34<19:44:10,  3.54it/s]
 32%|███▏      | 120120/371472 [9:33:34<19:55:51,  3.50it/s]
                                                            
{'loss': 3.3792, 'learning_rate': 7.093020750285503e-07, 'epoch': 5.17}

 32%|███▏      | 120120/371472 [9:33:34<19:55:51,  3.50it/s]
 32%|███▏      | 120121/371472 [9:33:34<19:07:24,  3.65it/s]
 32%|███▏      | 120122/371472 [9:33:35<19:11:23,  3.64it/s]
 32%|███▏      | 120123/371472 [9:33:35<18:44:42,  3.72it/s]
 32%|███▏      | 120124/371472 [9:33:35<17:59:26,  3.88it/s]
 32%|███▏      | 120125/371472 [9:33:35<18:17:52,  3.82it/s]
 32%|███▏      | 120126/371472 [9:33:36<17:43:02,  3.94it/s]
 32%|███▏      | 120127/371472 [9:33:36<18:12:10,  3.84it/s]
 32%|███▏      | 120128/371472 [9:33:36<18:24:40,  3.79it/s]
 32%|███▏      | 120129/371472 [9:33:36<19:13:26,  3.63it/s]
 32%|███▏      | 120130/371472 [9:33:37<19:35:19,  3.56it/s]
 32%|███▏      | 120131/371472 [9:33:37<21:45:13,  3.21it/s]
 32%|███▏      | 120132/371472 [9:33:37<20:21:57,  3.43it/s]
 32%|███▏      | 120133/371472 [9:33:38<19:48:51,  3.52it/s]
 32%|███▏      | 120134/371472 [9:33:38<19:06:38,  3.65it/s]
 32%|███▏      | 120135/371472 [9:33:38<22:13:18,  3.14it/s]
 32%|███▏      | 120136/371472 [9:33:39<21:10:09,  3.30it/s]
 32%|███▏      | 120137/371472 [9:33:39<20:42:29,  3.37it/s]
 32%|███▏      | 120138/371472 [9:33:39<21:23:37,  3.26it/s]
 32%|███▏      | 120139/371472 [9:33:39<19:59:48,  3.49it/s]
 32%|███▏      | 120140/371472 [9:33:40<19:55:24,  3.50it/s]
                                                            
{'loss': 3.449, 'learning_rate': 7.092535930530715e-07, 'epoch': 5.17}

 32%|███▏      | 120140/371472 [9:33:40<19:55:24,  3.50it/s]
 32%|███▏      | 120141/371472 [9:33:40<19:39:22,  3.55it/s]
 32%|███▏      | 120142/371472 [9:33:40<19:27:32,  3.59it/s]
 32%|███▏      | 120143/371472 [9:33:41<19:13:27,  3.63it/s]
 32%|███▏      | 120144/371472 [9:33:41<18:44:11,  3.73it/s]
 32%|███▏      | 120145/371472 [9:33:41<18:38:55,  3.74it/s]
 32%|███▏      | 120146/371472 [9:33:41<18:51:58,  3.70it/s]
 32%|███▏      | 120147/371472 [9:33:42<18:30:38,  3.77it/s]
 32%|███▏      | 120148/371472 [9:33:42<19:50:32,  3.52it/s]
 32%|███▏      | 120149/371472 [9:33:42<18:56:34,  3.69it/s]
 32%|███▏      | 120150/371472 [9:33:42<20:46:40,  3.36it/s]
 32%|███▏      | 120151/371472 [9:33:43<19:29:45,  3.58it/s]
 32%|███▏      | 120152/371472 [9:33:43<19:29:15,  3.58it/s]
 32%|███▏      | 120153/371472 [9:33:43<19:10:59,  3.64it/s]
 32%|███▏      | 120154/371472 [9:33:44<18:46:21,  3.72it/s]
 32%|███▏      | 120155/371472 [9:33:44<19:30:04,  3.58it/s]
 32%|███▏      | 120156/371472 [9:33:44<19:35:07,  3.56it/s]
 32%|███▏      | 120157/371472 [9:33:44<20:06:03,  3.47it/s]
 32%|███▏      | 120158/371472 [9:33:45<19:04:00,  3.66it/s]
 32%|███▏      | 120159/371472 [9:33:45<18:32:42,  3.76it/s]
 32%|███▏      | 120160/371472 [9:33:45<19:49:19,  3.52it/s]
                                                            
{'loss': 3.3339, 'learning_rate': 7.092051110775927e-07, 'epoch': 5.18}

 32%|███▏      | 120160/371472 [9:33:45<19:49:19,  3.52it/s]
 32%|███▏      | 120161/371472 [9:33:45<19:11:51,  3.64it/s]
 32%|███▏      | 120162/371472 [9:33:46<20:20:01,  3.43it/s]
 32%|███▏      | 120163/371472 [9:33:46<19:50:53,  3.52it/s]
 32%|███▏      | 120164/371472 [9:33:46<19:31:47,  3.57it/s]
 32%|███▏      | 120165/371472 [9:33:47<20:20:04,  3.43it/s]
 32%|███▏      | 120166/371472 [9:33:47<19:25:52,  3.59it/s]
 32%|███▏      | 120167/371472 [9:33:47<18:59:33,  3.68it/s]
 32%|███▏      | 120168/371472 [9:33:47<18:53:13,  3.70it/s]
 32%|███▏      | 120169/371472 [9:33:48<18:50:23,  3.71it/s]
 32%|███▏      | 120170/371472 [9:33:48<19:06:57,  3.65it/s]
 32%|███▏      | 120171/371472 [9:33:48<19:17:13,  3.62it/s]
 32%|███▏      | 120172/371472 [9:33:49<19:45:30,  3.53it/s]
 32%|███▏      | 120173/371472 [9:33:49<19:50:03,  3.52it/s]
 32%|███▏      | 120174/371472 [9:33:49<19:25:10,  3.59it/s]
 32%|███▏      | 120175/371472 [9:33:49<19:08:36,  3.65it/s]
 32%|███▏      | 120176/371472 [9:33:50<18:58:57,  3.68it/s]
 32%|███▏      | 120177/371472 [9:33:50<19:25:22,  3.59it/s]
 32%|███▏      | 120178/371472 [9:33:50<19:29:01,  3.58it/s]
 32%|███▏      | 120179/371472 [9:33:50<18:55:17,  3.69it/s]
 32%|███▏      | 120180/371472 [9:33:51<19:30:37,  3.58it/s]
                                                            
{'loss': 3.4083, 'learning_rate': 7.091566291021138e-07, 'epoch': 5.18}

 32%|███▏      | 120180/371472 [9:33:51<19:30:37,  3.58it/s]
 32%|███▏      | 120181/371472 [9:33:51<19:37:33,  3.56it/s]
 32%|███▏      | 120182/371472 [9:33:51<20:09:52,  3.46it/s]
 32%|███▏      | 120183/371472 [9:33:52<19:37:18,  3.56it/s]
 32%|███▏      | 120184/371472 [9:33:52<20:04:58,  3.48it/s]
 32%|███▏      | 120185/371472 [9:33:52<19:30:48,  3.58it/s]
 32%|███▏      | 120186/371472 [9:33:52<18:35:00,  3.76it/s]
 32%|███▏      | 120187/371472 [9:33:53<20:39:22,  3.38it/s]
 32%|███▏      | 120188/371472 [9:33:53<20:19:33,  3.43it/s]
 32%|███▏      | 120189/371472 [9:33:53<19:34:51,  3.56it/s]
 32%|███▏      | 120190/371472 [9:33:54<19:27:27,  3.59it/s]
 32%|███▏      | 120191/371472 [9:33:54<20:00:00,  3.49it/s]
 32%|███▏      | 120192/371472 [9:33:54<19:00:12,  3.67it/s]
 32%|███▏      | 120193/371472 [9:33:54<18:16:49,  3.82it/s]
 32%|███▏      | 120194/371472 [9:33:55<18:53:38,  3.69it/s]
 32%|███▏      | 120195/371472 [9:33:55<20:31:48,  3.40it/s]
 32%|███▏      | 120196/371472 [9:33:55<21:59:47,  3.17it/s]
 32%|███▏      | 120197/371472 [9:33:56<20:25:06,  3.42it/s]
 32%|███▏      | 120198/371472 [9:33:56<20:35:57,  3.39it/s]
 32%|███▏      | 120199/371472 [9:33:56<19:22:05,  3.60it/s]
 32%|███▏      | 120200/371472 [9:33:56<18:22:35,  3.80it/s]
                                                            
{'loss': 3.2743, 'learning_rate': 7.091081471266348e-07, 'epoch': 5.18}

 32%|███▏      | 120200/371472 [9:33:56<18:22:35,  3.80it/s]
 32%|███▏      | 120201/371472 [9:33:57<19:03:51,  3.66it/s]
 32%|███▏      | 120202/371472 [9:33:57<18:43:53,  3.73it/s]
 32%|███▏      | 120203/371472 [9:33:57<19:21:34,  3.61it/s]
 32%|███▏      | 120204/371472 [9:33:58<19:06:37,  3.65it/s]
 32%|███▏      | 120205/371472 [9:33:58<19:10:48,  3.64it/s]
 32%|███▏      | 120206/371472 [9:33:58<19:23:35,  3.60it/s]
 32%|███▏      | 120207/371472 [9:33:58<19:34:30,  3.57it/s]
 32%|███▏      | 120208/371472 [9:33:59<19:32:20,  3.57it/s]
 32%|███▏      | 120209/371472 [9:33:59<20:45:33,  3.36it/s]
 32%|███▏      | 120210/371472 [9:33:59<19:45:44,  3.53it/s]
 32%|███▏      | 120211/371472 [9:34:00<21:18:06,  3.28it/s]
 32%|███▏      | 120212/371472 [9:34:00<19:53:31,  3.51it/s]
 32%|███▏      | 120213/371472 [9:34:00<21:03:39,  3.31it/s]
 32%|███▏      | 120214/371472 [9:34:00<20:35:18,  3.39it/s]
 32%|███▏      | 120215/371472 [9:34:01<19:54:29,  3.51it/s]
 32%|███▏      | 120216/371472 [9:34:01<20:27:33,  3.41it/s]
 32%|███▏      | 120217/371472 [9:34:01<20:34:22,  3.39it/s]
 32%|███▏      | 120218/371472 [9:34:02<20:18:27,  3.44it/s]
 32%|███▏      | 120219/371472 [9:34:02<21:23:31,  3.26it/s]
 32%|███▏      | 120220/371472 [9:34:02<19:59:40,  3.49it/s]
                                                            
{'loss': 3.2275, 'learning_rate': 7.09059665151156e-07, 'epoch': 5.18}

 32%|███▏      | 120220/371472 [9:34:02<19:59:40,  3.49it/s]
 32%|███▏      | 120221/371472 [9:34:02<19:12:25,  3.63it/s]
 32%|███▏      | 120222/371472 [9:34:03<18:41:40,  3.73it/s]
 32%|███▏      | 120223/371472 [9:34:03<18:56:01,  3.69it/s]
 32%|███▏      | 120224/371472 [9:34:03<19:03:16,  3.66it/s]
 32%|███▏      | 120225/371472 [9:34:04<18:46:30,  3.72it/s]
 32%|███▏      | 120226/371472 [9:34:04<18:27:46,  3.78it/s]
 32%|███▏      | 120227/371472 [9:34:04<19:01:42,  3.67it/s]
 32%|███▏      | 120228/371472 [9:34:04<20:26:54,  3.41it/s]
 32%|███▏      | 120229/371472 [9:34:05<19:52:18,  3.51it/s]
 32%|███▏      | 120230/371472 [9:34:05<19:34:21,  3.57it/s]
 32%|███▏      | 120231/371472 [9:34:05<19:15:25,  3.62it/s]
 32%|███▏      | 120232/371472 [9:34:05<19:08:45,  3.65it/s]
 32%|███▏      | 120233/371472 [9:34:06<19:24:41,  3.60it/s]
 32%|███▏      | 120234/371472 [9:34:06<19:59:53,  3.49it/s]
 32%|███▏      | 120235/371472 [9:34:06<19:07:20,  3.65it/s]
 32%|███▏      | 120236/371472 [9:34:07<19:23:43,  3.60it/s]
 32%|███▏      | 120237/371472 [9:34:07<19:31:22,  3.57it/s]
 32%|███▏      | 120238/371472 [9:34:07<20:30:04,  3.40it/s]
 32%|███▏      | 120239/371472 [9:34:07<19:49:43,  3.52it/s]
 32%|███▏      | 120240/371472 [9:34:08<19:26:17,  3.59it/s]
                                                            
{'loss': 3.2897, 'learning_rate': 7.090111831756771e-07, 'epoch': 5.18}

 32%|███▏      | 120240/371472 [9:34:08<19:26:17,  3.59it/s]
 32%|███▏      | 120241/371472 [9:34:08<18:51:24,  3.70it/s]
 32%|███▏      | 120242/371472 [9:34:08<19:10:38,  3.64it/s]
 32%|███▏      | 120243/371472 [9:34:09<18:49:17,  3.71it/s]
 32%|███▏      | 120244/371472 [9:34:09<21:17:24,  3.28it/s]
 32%|███▏      | 120245/371472 [9:34:09<20:24:25,  3.42it/s]
 32%|███▏      | 120246/371472 [9:34:09<19:49:21,  3.52it/s]
 32%|███▏      | 120247/371472 [9:34:10<19:10:39,  3.64it/s]
 32%|███▏      | 120248/371472 [9:34:10<20:32:29,  3.40it/s]
 32%|███▏      | 120249/371472 [9:34:10<20:55:52,  3.33it/s]
 32%|███▏      | 120250/371472 [9:34:11<19:41:54,  3.54it/s]
 32%|███▏      | 120251/371472 [9:34:11<19:51:59,  3.51it/s]
 32%|███▏      | 120252/371472 [9:34:11<19:01:19,  3.67it/s]
 32%|███▏      | 120253/371472 [9:34:11<18:45:29,  3.72it/s]
 32%|███▏      | 120254/371472 [9:34:12<19:08:37,  3.65it/s]
 32%|███▏      | 120255/371472 [9:34:12<19:59:44,  3.49it/s]
 32%|███▏      | 120256/371472 [9:34:12<20:11:03,  3.46it/s]
 32%|███▏      | 120257/371472 [9:34:13<20:02:54,  3.48it/s]
 32%|███▏      | 120258/371472 [9:34:13<19:15:17,  3.62it/s]
 32%|███▏      | 120259/371472 [9:34:13<18:51:44,  3.70it/s]
 32%|███▏      | 120260/371472 [9:34:13<18:22:24,  3.80it/s]
                                                            
{'loss': 3.3508, 'learning_rate': 7.089627012001982e-07, 'epoch': 5.18}

 32%|███▏      | 120260/371472 [9:34:13<18:22:24,  3.80it/s]
 32%|███▏      | 120261/371472 [9:34:14<18:37:20,  3.75it/s]
 32%|███▏      | 120262/371472 [9:34:14<20:11:59,  3.45it/s]
 32%|███▏      | 120263/371472 [9:34:14<19:16:19,  3.62it/s]
 32%|███▏      | 120264/371472 [9:34:14<18:43:14,  3.73it/s]
 32%|███▏      | 120265/371472 [9:34:15<19:37:15,  3.56it/s]
 32%|███▏      | 120266/371472 [9:34:15<19:25:33,  3.59it/s]
 32%|███▏      | 120267/371472 [9:34:15<20:42:32,  3.37it/s]
 32%|███▏      | 120268/371472 [9:34:16<20:38:37,  3.38it/s]
 32%|███▏      | 120269/371472 [9:34:16<21:28:06,  3.25it/s]
 32%|███▏      | 120270/371472 [9:34:16<20:39:18,  3.38it/s]
 32%|███▏      | 120271/371472 [9:34:17<19:54:48,  3.50it/s]
 32%|███▏      | 120272/371472 [9:34:17<20:40:47,  3.37it/s]
 32%|███▏      | 120273/371472 [9:34:17<20:00:35,  3.49it/s]
 32%|███▏      | 120274/371472 [9:34:17<21:31:09,  3.24it/s]
 32%|███▏      | 120275/371472 [9:34:18<20:50:58,  3.35it/s]
 32%|███▏      | 120276/371472 [9:34:18<21:03:53,  3.31it/s]
 32%|███▏      | 120277/371472 [9:34:18<20:33:13,  3.39it/s]
 32%|███▏      | 120278/371472 [9:34:19<22:41:12,  3.08it/s]
 32%|███▏      | 120279/371472 [9:34:19<21:57:23,  3.18it/s]
 32%|███▏      | 120280/371472 [9:34:19<20:34:27,  3.39it/s]
                                                            
{'loss': 3.2463, 'learning_rate': 7.089142192247192e-07, 'epoch': 5.18}

 32%|███▏      | 120280/371472 [9:34:19<20:34:27,  3.39it/s]
 32%|███▏      | 120281/371472 [9:34:20<20:26:31,  3.41it/s]
 32%|███▏      | 120282/371472 [9:34:20<19:57:07,  3.50it/s]
 32%|███▏      | 120283/371472 [9:34:20<19:11:33,  3.64it/s]
 32%|███▏      | 120284/371472 [9:34:20<20:49:28,  3.35it/s]
 32%|███▏      | 120285/371472 [9:34:21<20:59:16,  3.32it/s]
 32%|███▏      | 120286/371472 [9:34:21<19:43:16,  3.54it/s]
 32%|███▏      | 120287/371472 [9:34:21<18:55:51,  3.69it/s]
 32%|███▏      | 120288/371472 [9:34:22<24:56:36,  2.80it/s]
 32%|███▏      | 120289/371472 [9:34:22<23:19:20,  2.99it/s]
 32%|███▏      | 120290/371472 [9:34:22<21:58:55,  3.17it/s]
 32%|███▏      | 120291/371472 [9:34:23<22:19:36,  3.13it/s]
 32%|███▏      | 120292/371472 [9:34:23<22:30:50,  3.10it/s]
 32%|███▏      | 120293/371472 [9:34:23<20:52:43,  3.34it/s]
 32%|███▏      | 120294/371472 [9:34:23<19:58:14,  3.49it/s]
 32%|███▏      | 120295/371472 [9:34:24<19:06:54,  3.65it/s]
 32%|███▏      | 120296/371472 [9:34:24<18:35:41,  3.75it/s]
 32%|███▏      | 120297/371472 [9:34:24<18:25:34,  3.79it/s]
 32%|███▏      | 120298/371472 [9:34:25<19:03:22,  3.66it/s]
 32%|███▏      | 120299/371472 [9:34:25<18:52:49,  3.70it/s]
 32%|███▏      | 120300/371472 [9:34:25<19:30:04,  3.58it/s]
                                                            
{'loss': 3.1163, 'learning_rate': 7.088657372492404e-07, 'epoch': 5.18}

 32%|███▏      | 120300/371472 [9:34:25<19:30:04,  3.58it/s]
 32%|███▏      | 120301/371472 [9:34:25<18:54:54,  3.69it/s]
 32%|███▏      | 120302/371472 [9:34:26<18:32:37,  3.76it/s]
 32%|███▏      | 120303/371472 [9:34:26<18:22:10,  3.80it/s]
 32%|███▏      | 120304/371472 [9:34:26<18:09:32,  3.84it/s]
 32%|███▏      | 120305/371472 [9:34:26<19:22:06,  3.60it/s]
 32%|███▏      | 120306/371472 [9:34:27<19:06:05,  3.65it/s]
 32%|███▏      | 120307/371472 [9:34:27<18:50:46,  3.70it/s]
 32%|███▏      | 120308/371472 [9:34:27<19:20:40,  3.61it/s]
 32%|███▏      | 120309/371472 [9:34:28<19:14:07,  3.63it/s]
 32%|███▏      | 120310/371472 [9:34:28<19:40:16,  3.55it/s]
 32%|███▏      | 120311/371472 [9:34:28<19:34:01,  3.57it/s]
 32%|███▏      | 120312/371472 [9:34:29<23:04:38,  3.02it/s]
 32%|███▏      | 120313/371472 [9:34:29<22:41:38,  3.07it/s]
 32%|███▏      | 120314/371472 [9:34:29<21:16:50,  3.28it/s]
 32%|███▏      | 120315/371472 [9:34:29<20:22:08,  3.43it/s]
 32%|███▏      | 120316/371472 [9:34:30<20:11:05,  3.46it/s]
 32%|███▏      | 120317/371472 [9:34:30<20:52:24,  3.34it/s]
 32%|███▏      | 120318/371472 [9:34:30<20:09:33,  3.46it/s]
 32%|███▏      | 120319/371472 [9:34:31<19:38:34,  3.55it/s]
 32%|███▏      | 120320/371472 [9:34:31<21:31:22,  3.24it/s]
                                                            
{'loss': 3.2874, 'learning_rate': 7.088172552737616e-07, 'epoch': 5.18}

 32%|███▏      | 120320/371472 [9:34:31<21:31:22,  3.24it/s]
 32%|███▏      | 120321/371472 [9:34:31<20:38:07,  3.38it/s]
 32%|███▏      | 120322/371472 [9:34:31<21:26:05,  3.25it/s]
 32%|███▏      | 120323/371472 [9:34:32<20:22:21,  3.42it/s]
 32%|███▏      | 120324/371472 [9:34:32<19:59:32,  3.49it/s]
 32%|███▏      | 120325/371472 [9:34:32<19:40:14,  3.55it/s]
 32%|███▏      | 120326/371472 [9:34:33<19:03:44,  3.66it/s]
 32%|███▏      | 120327/371472 [9:34:33<18:54:15,  3.69it/s]
 32%|███▏      | 120328/371472 [9:34:33<18:36:04,  3.75it/s]
 32%|███▏      | 120329/371472 [9:34:33<18:48:59,  3.71it/s]
 32%|███▏      | 120330/371472 [9:34:34<18:33:45,  3.76it/s]
 32%|███▏      | 120331/371472 [9:34:34<18:36:54,  3.75it/s]
 32%|███▏      | 120332/371472 [9:34:34<19:32:25,  3.57it/s]
 32%|███▏      | 120333/371472 [9:34:34<19:30:23,  3.58it/s]
 32%|███▏      | 120334/371472 [9:34:35<19:24:13,  3.60it/s]
 32%|███▏      | 120335/371472 [9:34:35<19:29:57,  3.58it/s]
 32%|███▏      | 120336/371472 [9:34:35<19:07:54,  3.65it/s]
 32%|███▏      | 120337/371472 [9:34:36<18:43:31,  3.73it/s]
 32%|███▏      | 120338/371472 [9:34:36<18:40:56,  3.73it/s]
 32%|███▏      | 120339/371472 [9:34:36<18:19:22,  3.81it/s]
 32%|███▏      | 120340/371472 [9:34:36<17:53:50,  3.90it/s]
                                                            
{'loss': 3.2875, 'learning_rate': 7.087687732982827e-07, 'epoch': 5.18}

 32%|███▏      | 120340/371472 [9:34:36<17:53:50,  3.90it/s]
 32%|███▏      | 120341/371472 [9:34:37<18:55:14,  3.69it/s]
 32%|███▏      | 120342/371472 [9:34:37<19:31:10,  3.57it/s]
 32%|███▏      | 120343/371472 [9:34:37<19:40:26,  3.55it/s]
 32%|███▏      | 120344/371472 [9:34:37<20:34:21,  3.39it/s]
 32%|███▏      | 120345/371472 [9:34:38<22:22:09,  3.12it/s]
 32%|███▏      | 120346/371472 [9:34:38<21:00:54,  3.32it/s]
 32%|███▏      | 120347/371472 [9:34:38<21:50:06,  3.19it/s]
 32%|███▏      | 120348/371472 [9:34:39<21:25:07,  3.26it/s]
 32%|███▏      | 120349/371472 [9:34:39<20:09:48,  3.46it/s]
 32%|███▏      | 120350/371472 [9:34:39<19:41:10,  3.54it/s]
 32%|███▏      | 120351/371472 [9:34:40<20:56:00,  3.33it/s]
 32%|███▏      | 120352/371472 [9:34:40<20:33:24,  3.39it/s]
 32%|███▏      | 120353/371472 [9:34:40<19:36:12,  3.56it/s]
 32%|███▏      | 120354/371472 [9:34:40<19:19:59,  3.61it/s]
 32%|███▏      | 120355/371472 [9:34:41<19:45:53,  3.53it/s]
 32%|███▏      | 120356/371472 [9:34:41<21:50:32,  3.19it/s]
 32%|███▏      | 120357/371472 [9:34:41<21:15:16,  3.28it/s]
 32%|███▏      | 120358/371472 [9:34:42<20:17:02,  3.44it/s]
 32%|███▏      | 120359/371472 [9:34:42<20:19:55,  3.43it/s]
 32%|███▏      | 120360/371472 [9:34:42<20:01:02,  3.48it/s]
                                                            
{'loss': 3.3629, 'learning_rate': 7.087202913228037e-07, 'epoch': 5.18}

 32%|███▏      | 120360/371472 [9:34:42<20:01:02,  3.48it/s]
 32%|███▏      | 120361/371472 [9:34:43<20:20:10,  3.43it/s]
 32%|███▏      | 120362/371472 [9:34:43<20:33:18,  3.39it/s]
 32%|███▏      | 120363/371472 [9:34:43<19:42:13,  3.54it/s]
 32%|███▏      | 120364/371472 [9:34:43<20:34:16,  3.39it/s]
 32%|███▏      | 120365/371472 [9:34:44<20:05:14,  3.47it/s]
 32%|███▏      | 120366/371472 [9:34:44<19:11:33,  3.63it/s]
 32%|███▏      | 120367/371472 [9:34:44<20:17:21,  3.44it/s]
 32%|███▏      | 120368/371472 [9:34:45<19:48:57,  3.52it/s]
 32%|███▏      | 120369/371472 [9:34:45<19:30:14,  3.58it/s]
 32%|███▏      | 120370/371472 [9:34:45<18:51:05,  3.70it/s]
 32%|███▏      | 120371/371472 [9:34:45<18:49:57,  3.70it/s]
 32%|███▏      | 120372/371472 [9:34:46<18:28:03,  3.78it/s]
 32%|███▏      | 120373/371472 [9:34:46<18:20:46,  3.80it/s]
 32%|███▏      | 120374/371472 [9:34:46<18:58:11,  3.68it/s]
 32%|███▏      | 120375/371472 [9:34:46<19:50:50,  3.51it/s]
 32%|███▏      | 120376/371472 [9:34:47<19:27:37,  3.58it/s]
 32%|███▏      | 120377/371472 [9:34:47<19:18:50,  3.61it/s]
 32%|███▏      | 120378/371472 [9:34:47<20:15:28,  3.44it/s]
 32%|███▏      | 120379/371472 [9:34:48<19:49:49,  3.52it/s]
 32%|███▏      | 120380/371472 [9:34:48<19:39:04,  3.55it/s]
                                                            
{'loss': 3.1691, 'learning_rate': 7.086718093473248e-07, 'epoch': 5.18}

 32%|███▏      | 120380/371472 [9:34:48<19:39:04,  3.55it/s]
 32%|███▏      | 120381/371472 [9:34:48<20:49:07,  3.35it/s]
 32%|███▏      | 120382/371472 [9:34:49<22:23:34,  3.11it/s]
 32%|███▏      | 120383/371472 [9:34:49<21:39:02,  3.22it/s]
 32%|███▏      | 120384/371472 [9:34:49<21:44:10,  3.21it/s]
 32%|███▏      | 120385/371472 [9:34:49<21:25:26,  3.26it/s]
 32%|███▏      | 120386/371472 [9:34:50<20:32:43,  3.39it/s]
 32%|███▏      | 120387/371472 [9:34:50<19:50:43,  3.51it/s]
 32%|███▏      | 120388/371472 [9:34:50<19:24:18,  3.59it/s]
 32%|███▏      | 120389/371472 [9:34:50<19:03:07,  3.66it/s]
 32%|███▏      | 120390/371472 [9:34:51<19:26:52,  3.59it/s]
 32%|███▏      | 120391/371472 [9:34:51<18:44:15,  3.72it/s]
 32%|███▏      | 120392/371472 [9:34:51<19:29:34,  3.58it/s]
 32%|███▏      | 120393/371472 [9:34:52<19:39:23,  3.55it/s]
 32%|███▏      | 120394/371472 [9:34:52<19:27:46,  3.58it/s]
 32%|███▏      | 120395/371472 [9:34:52<18:40:31,  3.73it/s]
 32%|███▏      | 120396/371472 [9:34:52<18:13:41,  3.83it/s]
 32%|███▏      | 120397/371472 [9:34:53<18:34:41,  3.75it/s]
 32%|███▏      | 120398/371472 [9:34:53<18:05:51,  3.85it/s]
 32%|███▏      | 120399/371472 [9:34:53<19:02:33,  3.66it/s]
 32%|███▏      | 120400/371472 [9:34:53<18:26:24,  3.78it/s]
                                                            
{'loss': 3.2311, 'learning_rate': 7.08623327371846e-07, 'epoch': 5.19}

 32%|███▏      | 120400/371472 [9:34:53<18:26:24,  3.78it/s]
 32%|███▏      | 120401/371472 [9:34:54<19:03:03,  3.66it/s]
 32%|███▏      | 120402/371472 [9:34:54<19:28:12,  3.58it/s]
 32%|███▏      | 120403/371472 [9:34:54<19:30:55,  3.57it/s]
 32%|███▏      | 120404/371472 [9:34:55<20:08:38,  3.46it/s]
 32%|███▏      | 120405/371472 [9:34:55<20:06:29,  3.47it/s]
 32%|███▏      | 120406/371472 [9:34:55<19:57:28,  3.49it/s]
 32%|███▏      | 120407/371472 [9:34:55<19:47:27,  3.52it/s]
 32%|███▏      | 120408/371472 [9:34:56<19:41:10,  3.54it/s]
 32%|███▏      | 120409/371472 [9:34:56<20:12:04,  3.45it/s]
 32%|███▏      | 120410/371472 [9:34:56<20:04:28,  3.47it/s]
 32%|███▏      | 120411/371472 [9:34:57<19:10:21,  3.64it/s]
 32%|███▏      | 120412/371472 [9:34:57<19:01:26,  3.67it/s]
 32%|███▏      | 120413/371472 [9:34:57<18:43:26,  3.72it/s]
 32%|███▏      | 120414/371472 [9:34:57<18:43:22,  3.72it/s]
 32%|███▏      | 120415/371472 [9:34:58<18:21:12,  3.80it/s]
 32%|███▏      | 120416/371472 [9:34:58<18:48:41,  3.71it/s]
 32%|███▏      | 120417/371472 [9:34:58<19:38:10,  3.55it/s]
 32%|███▏      | 120418/371472 [9:34:59<20:08:17,  3.46it/s]
 32%|███▏      | 120419/371472 [9:34:59<19:15:42,  3.62it/s]
 32%|███▏      | 120420/371472 [9:34:59<18:58:17,  3.68it/s]
                                                            
{'loss': 3.1645, 'learning_rate': 7.085748453963671e-07, 'epoch': 5.19}

 32%|███▏      | 120420/371472 [9:34:59<18:58:17,  3.68it/s]
 32%|███▏      | 120421/371472 [9:34:59<18:49:28,  3.70it/s]
 32%|███▏      | 120422/371472 [9:35:00<18:50:16,  3.70it/s]
 32%|███▏      | 120423/371472 [9:35:00<18:47:54,  3.71it/s]
 32%|███▏      | 120424/371472 [9:35:00<18:33:45,  3.76it/s]
 32%|███▏      | 120425/371472 [9:35:00<18:28:18,  3.78it/s]
 32%|███▏      | 120426/371472 [9:35:01<19:04:06,  3.66it/s]
 32%|███▏      | 120427/371472 [9:35:01<18:54:18,  3.69it/s]
 32%|███▏      | 120428/371472 [9:35:01<19:32:15,  3.57it/s]
 32%|███▏      | 120429/371472 [9:35:01<19:10:16,  3.64it/s]
 32%|███▏      | 120430/371472 [9:35:02<18:41:57,  3.73it/s]
 32%|███▏      | 120431/371472 [9:35:02<18:30:59,  3.77it/s]
 32%|███▏      | 120432/371472 [9:35:02<18:19:29,  3.81it/s]
 32%|███▏      | 120433/371472 [9:35:02<18:01:36,  3.87it/s]
 32%|███▏      | 120434/371472 [9:35:03<18:01:10,  3.87it/s]
 32%|███▏      | 120435/371472 [9:35:03<18:38:32,  3.74it/s]
 32%|███▏      | 120436/371472 [9:35:03<18:25:46,  3.78it/s]
 32%|███▏      | 120437/371472 [9:35:04<19:14:20,  3.62it/s]
 32%|███▏      | 120438/371472 [9:35:04<19:19:21,  3.61it/s]
 32%|███▏      | 120439/371472 [9:35:04<19:07:23,  3.65it/s]
 32%|███▏      | 120440/371472 [9:35:04<18:28:39,  3.77it/s]
                                                            
{'loss': 3.1069, 'learning_rate': 7.085263634208881e-07, 'epoch': 5.19}

 32%|███▏      | 120440/371472 [9:35:04<18:28:39,  3.77it/s]
 32%|███▏      | 120441/371472 [9:35:05<18:06:59,  3.85it/s]
 32%|███▏      | 120442/371472 [9:35:05<18:45:27,  3.72it/s]
 32%|███▏      | 120443/371472 [9:35:05<22:56:32,  3.04it/s]
 32%|███▏      | 120444/371472 [9:35:06<22:18:29,  3.13it/s]
 32%|███▏      | 120445/371472 [9:35:06<21:52:51,  3.19it/s]
 32%|███▏      | 120446/371472 [9:35:06<20:30:04,  3.40it/s]
 32%|███▏      | 120447/371472 [9:35:07<21:21:48,  3.26it/s]
 32%|███▏      | 120448/371472 [9:35:07<20:27:35,  3.41it/s]
 32%|███▏      | 120449/371472 [9:35:07<19:53:20,  3.51it/s]
 32%|███▏      | 120450/371472 [9:35:07<19:39:19,  3.55it/s]
 32%|███▏      | 120451/371472 [9:35:08<19:56:32,  3.50it/s]
 32%|███▏      | 120452/371472 [9:35:08<19:07:22,  3.65it/s]
 32%|███▏      | 120453/371472 [9:35:08<18:59:17,  3.67it/s]
 32%|███▏      | 120454/371472 [9:35:08<18:59:52,  3.67it/s]
 32%|███▏      | 120455/371472 [9:35:09<18:28:48,  3.77it/s]
 32%|███▏      | 120456/371472 [9:35:09<18:16:51,  3.81it/s]
 32%|███▏      | 120457/371472 [9:35:09<18:10:01,  3.84it/s]
 32%|███▏      | 120458/371472 [9:35:10<18:48:43,  3.71it/s]
 32%|███▏      | 120459/371472 [9:35:10<18:29:47,  3.77it/s]
 32%|███▏      | 120460/371472 [9:35:10<18:04:24,  3.86it/s]
                                                            
{'loss': 3.3347, 'learning_rate': 7.084778814454093e-07, 'epoch': 5.19}

 32%|███▏      | 120460/371472 [9:35:10<18:04:24,  3.86it/s]
 32%|███▏      | 120461/371472 [9:35:10<19:06:57,  3.65it/s]
 32%|███▏      | 120462/371472 [9:35:11<19:31:05,  3.57it/s]
 32%|███▏      | 120463/371472 [9:35:11<19:43:05,  3.54it/s]
 32%|███▏      | 120464/371472 [9:35:11<19:20:05,  3.61it/s]
 32%|███▏      | 120465/371472 [9:35:11<18:15:43,  3.82it/s]
 32%|███▏      | 120466/371472 [9:35:12<18:22:36,  3.79it/s]
 32%|███▏      | 120467/371472 [9:35:12<18:14:39,  3.82it/s]
 32%|███▏      | 120468/371472 [9:35:12<18:03:48,  3.86it/s]
 32%|███▏      | 120469/371472 [9:35:12<18:32:49,  3.76it/s]
 32%|███▏      | 120470/371472 [9:35:13<18:11:50,  3.83it/s]
 32%|███▏      | 120471/371472 [9:35:13<19:36:03,  3.56it/s]
 32%|███▏      | 120472/371472 [9:35:13<19:24:45,  3.59it/s]
 32%|███▏      | 120473/371472 [9:35:14<18:41:23,  3.73it/s]
 32%|███▏      | 120474/371472 [9:35:14<18:43:25,  3.72it/s]
 32%|███▏      | 120475/371472 [9:35:14<18:30:36,  3.77it/s]
 32%|███▏      | 120476/371472 [9:35:14<18:29:18,  3.77it/s]
 32%|███▏      | 120477/371472 [9:35:15<20:21:52,  3.42it/s]
 32%|███▏      | 120478/371472 [9:35:15<21:04:32,  3.31it/s]
 32%|███▏      | 120479/371472 [9:35:15<20:24:17,  3.42it/s]
 32%|███▏      | 120480/371472 [9:35:16<19:46:46,  3.52it/s]
                                                            
{'loss': 3.2396, 'learning_rate': 7.084293994699305e-07, 'epoch': 5.19}

 32%|███▏      | 120480/371472 [9:35:16<19:46:46,  3.52it/s]
 32%|███▏      | 120481/371472 [9:35:16<19:26:41,  3.59it/s]
 32%|███▏      | 120482/371472 [9:35:16<18:27:11,  3.78it/s]
 32%|███▏      | 120483/371472 [9:35:16<18:06:49,  3.85it/s]
 32%|███▏      | 120484/371472 [9:35:17<18:22:44,  3.79it/s]
 32%|███▏      | 120485/371472 [9:35:17<19:05:46,  3.65it/s]
 32%|███▏      | 120486/371472 [9:35:17<18:26:32,  3.78it/s]
 32%|███▏      | 120487/371472 [9:35:17<19:49:07,  3.52it/s]
 32%|███▏      | 120488/371472 [9:35:18<19:58:45,  3.49it/s]
 32%|███▏      | 120489/371472 [9:35:18<20:16:26,  3.44it/s]
 32%|███▏      | 120490/371472 [9:35:18<19:33:44,  3.56it/s]
 32%|███▏      | 120491/371472 [9:35:19<19:28:41,  3.58it/s]
 32%|███▏      | 120492/371472 [9:35:19<19:11:38,  3.63it/s]
 32%|███▏      | 120493/371472 [9:35:19<18:39:15,  3.74it/s]
 32%|███▏      | 120494/371472 [9:35:19<20:17:25,  3.44it/s]
 32%|███▏      | 120495/371472 [9:35:20<20:06:36,  3.47it/s]
 32%|███▏      | 120496/371472 [9:35:20<20:01:06,  3.48it/s]
 32%|███▏      | 120497/371472 [9:35:20<21:09:55,  3.29it/s]
 32%|███▏      | 120498/371472 [9:35:21<21:03:18,  3.31it/s]
 32%|███▏      | 120499/371472 [9:35:21<20:38:50,  3.38it/s]
 32%|███▏      | 120500/371472 [9:35:21<20:18:02,  3.43it/s]
                                                            
{'loss': 3.3069, 'learning_rate': 7.083809174944513e-07, 'epoch': 5.19}

 32%|███▏      | 120500/371472 [9:35:21<20:18:02,  3.43it/s]
 32%|███▏      | 120501/371472 [9:35:22<22:16:02,  3.13it/s]
 32%|███▏      | 120502/371472 [9:35:22<21:41:56,  3.21it/s]
 32%|███▏      | 120503/371472 [9:35:22<20:45:30,  3.36it/s]
 32%|███▏      | 120504/371472 [9:35:22<20:31:19,  3.40it/s]
 32%|███▏      | 120505/371472 [9:35:23<21:23:17,  3.26it/s]
 32%|███▏      | 120506/371472 [9:35:23<19:57:20,  3.49it/s]
 32%|███▏      | 120507/371472 [9:35:23<19:47:01,  3.52it/s]
 32%|███▏      | 120508/371472 [9:35:24<19:03:00,  3.66it/s]
 32%|███▏      | 120509/371472 [9:35:24<18:18:55,  3.81it/s]
 32%|███▏      | 120510/371472 [9:35:24<18:33:17,  3.76it/s]
 32%|███▏      | 120511/371472 [9:35:24<19:23:25,  3.60it/s]
 32%|███▏      | 120512/371472 [9:35:25<20:27:27,  3.41it/s]
 32%|███▏      | 120513/371472 [9:35:25<19:42:17,  3.54it/s]
 32%|███▏      | 120514/371472 [9:35:25<19:37:08,  3.55it/s]
 32%|███▏      | 120515/371472 [9:35:26<19:30:33,  3.57it/s]
 32%|███▏      | 120516/371472 [9:35:26<19:19:15,  3.61it/s]
 32%|███▏      | 120517/371472 [9:35:26<18:55:26,  3.68it/s]
 32%|███▏      | 120518/371472 [9:35:26<19:48:05,  3.52it/s]
 32%|███▏      | 120519/371472 [9:35:27<19:30:21,  3.57it/s]
 32%|███▏      | 120520/371472 [9:35:27<19:50:34,  3.51it/s]
                                                            
{'loss': 3.3206, 'learning_rate': 7.083324355189725e-07, 'epoch': 5.19}

 32%|███▏      | 120520/371472 [9:35:27<19:50:34,  3.51it/s]
 32%|███▏      | 120521/371472 [9:35:27<19:54:11,  3.50it/s]
 32%|███▏      | 120522/371472 [9:35:27<19:58:19,  3.49it/s]
 32%|███▏      | 120523/371472 [9:35:28<21:18:59,  3.27it/s]
 32%|███▏      | 120524/371472 [9:35:28<20:08:51,  3.46it/s]
 32%|███▏      | 120525/371472 [9:35:28<19:45:53,  3.53it/s]
 32%|███▏      | 120526/371472 [9:35:29<19:03:08,  3.66it/s]
 32%|███▏      | 120527/371472 [9:35:29<18:59:18,  3.67it/s]
 32%|███▏      | 120528/371472 [9:35:29<19:41:23,  3.54it/s]
 32%|███▏      | 120529/371472 [9:35:29<18:54:51,  3.69it/s]
 32%|███▏      | 120530/371472 [9:35:30<19:29:45,  3.58it/s]
 32%|███▏      | 120531/371472 [9:35:30<19:20:00,  3.61it/s]
 32%|███▏      | 120532/371472 [9:35:30<19:31:04,  3.57it/s]
 32%|███▏      | 120533/371472 [9:35:31<20:38:47,  3.38it/s]
 32%|███▏      | 120534/371472 [9:35:31<19:29:32,  3.58it/s]
 32%|███▏      | 120535/371472 [9:35:31<19:32:40,  3.57it/s]
 32%|███▏      | 120536/371472 [9:35:31<19:43:58,  3.53it/s]
 32%|███▏      | 120537/371472 [9:35:32<20:04:01,  3.47it/s]
 32%|███▏      | 120538/371472 [9:35:32<19:23:08,  3.60it/s]
 32%|███▏      | 120539/371472 [9:35:32<19:27:18,  3.58it/s]
 32%|███▏      | 120540/371472 [9:35:33<19:51:24,  3.51it/s]
                                                            
{'loss': 3.3677, 'learning_rate': 7.082839535434937e-07, 'epoch': 5.19}

 32%|███▏      | 120540/371472 [9:35:33<19:51:24,  3.51it/s]
 32%|███▏      | 120541/371472 [9:35:33<19:51:19,  3.51it/s]
 32%|███▏      | 120542/371472 [9:35:33<20:45:51,  3.36it/s]
 32%|███▏      | 120543/371472 [9:35:34<21:34:49,  3.23it/s]
 32%|███▏      | 120544/371472 [9:35:34<20:45:22,  3.36it/s]
 32%|███▏      | 120545/371472 [9:35:34<19:38:34,  3.55it/s]
 32%|███▏      | 120546/371472 [9:35:34<18:51:36,  3.70it/s]
 32%|███▏      | 120547/371472 [9:35:35<19:07:25,  3.64it/s]
 32%|███▏      | 120548/371472 [9:35:35<20:39:27,  3.37it/s]
 32%|███▏      | 120549/371472 [9:35:35<20:17:18,  3.44it/s]
 32%|███▏      | 120550/371472 [9:35:35<20:16:32,  3.44it/s]
 32%|███▏      | 120551/371472 [9:35:36<19:53:44,  3.50it/s]
 32%|███▏      | 120552/371472 [9:35:36<19:06:20,  3.65it/s]
 32%|███▏      | 120553/371472 [9:35:36<18:57:38,  3.68it/s]
 32%|███▏      | 120554/371472 [9:35:37<18:31:10,  3.76it/s]
 32%|███▏      | 120555/371472 [9:35:37<18:24:52,  3.78it/s]
 32%|███▏      | 120556/371472 [9:35:37<20:24:16,  3.42it/s]
 32%|███▏      | 120557/371472 [9:35:37<20:07:16,  3.46it/s]
 32%|███▏      | 120558/371472 [9:35:38<19:52:37,  3.51it/s]
 32%|███▏      | 120559/371472 [9:35:38<19:08:56,  3.64it/s]
 32%|███▏      | 120560/371472 [9:35:38<19:44:01,  3.53it/s]
                                                            
{'loss': 3.3377, 'learning_rate': 7.082354715680149e-07, 'epoch': 5.19}

 32%|███▏      | 120560/371472 [9:35:38<19:44:01,  3.53it/s]
 32%|███▏      | 120561/371472 [9:35:39<19:32:33,  3.57it/s]
 32%|███▏      | 120562/371472 [9:35:39<19:00:00,  3.67it/s]
 32%|███▏      | 120563/371472 [9:35:39<19:07:03,  3.65it/s]
 32%|███▏      | 120564/371472 [9:35:39<18:47:06,  3.71it/s]
 32%|███▏      | 120565/371472 [9:35:40<18:27:37,  3.78it/s]
 32%|███▏      | 120566/371472 [9:35:40<18:57:41,  3.68it/s]
 32%|███▏      | 120567/371472 [9:35:40<19:09:50,  3.64it/s]
 32%|███▏      | 120568/371472 [9:35:40<19:14:59,  3.62it/s]
 32%|███▏      | 120569/371472 [9:35:41<19:19:09,  3.61it/s]
 32%|███▏      | 120570/371472 [9:35:41<18:39:04,  3.74it/s]
 32%|███▏      | 120571/371472 [9:35:41<18:48:27,  3.71it/s]
 32%|███▏      | 120572/371472 [9:35:41<18:48:32,  3.71it/s]
 32%|███▏      | 120573/371472 [9:35:42<19:28:07,  3.58it/s]
 32%|███▏      | 120574/371472 [9:35:42<19:56:29,  3.49it/s]
 32%|███▏      | 120575/371472 [9:35:42<20:36:40,  3.38it/s]
 32%|███▏      | 120576/371472 [9:35:43<21:38:47,  3.22it/s]
 32%|███▏      | 120577/371472 [9:35:43<22:55:50,  3.04it/s]
 32%|███▏      | 120578/371472 [9:35:43<22:29:58,  3.10it/s]
 32%|███▏      | 120579/371472 [9:35:44<21:27:58,  3.25it/s]
 32%|███▏      | 120580/371472 [9:35:44<20:17:53,  3.43it/s]
                                                            
{'loss': 3.3011, 'learning_rate': 7.081869895925359e-07, 'epoch': 5.19}

 32%|███▏      | 120580/371472 [9:35:44<20:17:53,  3.43it/s]
 32%|███▏      | 120581/371472 [9:35:44<21:29:38,  3.24it/s]
 32%|███▏      | 120582/371472 [9:35:45<20:28:06,  3.40it/s]
 32%|███▏      | 120583/371472 [9:35:45<20:19:59,  3.43it/s]
 32%|███▏      | 120584/371472 [9:35:45<19:56:06,  3.50it/s]
 32%|███▏      | 120585/371472 [9:35:45<20:03:03,  3.48it/s]
 32%|███▏      | 120586/371472 [9:35:46<19:58:15,  3.49it/s]
 32%|███▏      | 120587/371472 [9:35:46<19:20:43,  3.60it/s]
 32%|███▏      | 120588/371472 [9:35:46<18:45:31,  3.72it/s]
 32%|███▏      | 120589/371472 [9:35:46<19:15:56,  3.62it/s]
 32%|███▏      | 120590/371472 [9:35:47<19:15:53,  3.62it/s]
 32%|███▏      | 120591/371472 [9:35:47<18:44:30,  3.72it/s]
 32%|███▏      | 120592/371472 [9:35:47<19:50:12,  3.51it/s]
 32%|███▏      | 120593/371472 [9:35:48<20:26:38,  3.41it/s]
 32%|███▏      | 120594/371472 [9:35:48<20:28:17,  3.40it/s]
 32%|███▏      | 120595/371472 [9:35:48<19:19:47,  3.61it/s]
 32%|███▏      | 120596/371472 [9:35:48<19:28:57,  3.58it/s]
 32%|███▏      | 120597/371472 [9:35:49<20:04:32,  3.47it/s]
 32%|███▏      | 120598/371472 [9:35:49<18:57:53,  3.67it/s]
 32%|███▏      | 120599/371472 [9:35:49<19:43:11,  3.53it/s]
 32%|███▏      | 120600/371472 [9:35:50<18:50:02,  3.70it/s]
                                                            
{'loss': 3.207, 'learning_rate': 7.081385076170571e-07, 'epoch': 5.19}

 32%|███▏      | 120600/371472 [9:35:50<18:50:02,  3.70it/s]
 32%|███▏      | 120601/371472 [9:35:50<19:01:08,  3.66it/s]
 32%|███▏      | 120602/371472 [9:35:50<18:41:54,  3.73it/s]
 32%|███▏      | 120603/371472 [9:35:50<18:28:37,  3.77it/s]
 32%|███▏      | 120604/371472 [9:35:51<19:11:26,  3.63it/s]
 32%|███▏      | 120605/371472 [9:35:51<19:28:53,  3.58it/s]
 32%|███▏      | 120606/371472 [9:35:51<19:27:51,  3.58it/s]
 32%|███▏      | 120607/371472 [9:35:51<18:40:04,  3.73it/s]
 32%|███▏      | 120608/371472 [9:35:52<19:07:51,  3.64it/s]
 32%|███▏      | 120609/371472 [9:35:52<19:47:17,  3.52it/s]
 32%|███▏      | 120610/371472 [9:35:52<19:35:57,  3.56it/s]
 32%|███▏      | 120611/371472 [9:35:53<19:15:46,  3.62it/s]
 32%|███▏      | 120612/371472 [9:35:53<21:42:33,  3.21it/s]
 32%|███▏      | 120613/371472 [9:35:53<20:28:46,  3.40it/s]
 32%|███▏      | 120614/371472 [9:35:54<20:51:01,  3.34it/s]
 32%|███▏      | 120615/371472 [9:35:54<20:44:04,  3.36it/s]
 32%|███▏      | 120616/371472 [9:35:54<22:15:52,  3.13it/s]
 32%|███▏      | 120617/371472 [9:35:55<22:41:04,  3.07it/s]
 32%|███▏      | 120618/371472 [9:35:55<20:44:05,  3.36it/s]
 32%|███▏      | 120619/371472 [9:35:55<20:24:43,  3.41it/s]
 32%|███▏      | 120620/371472 [9:35:55<19:17:55,  3.61it/s]
                                                            
{'loss': 3.1702, 'learning_rate': 7.080900256415781e-07, 'epoch': 5.2}

 32%|███▏      | 120620/371472 [9:35:55<19:17:55,  3.61it/s]
 32%|███▏      | 120621/371472 [9:35:56<20:33:42,  3.39it/s]
 32%|███▏      | 120622/371472 [9:35:56<20:36:25,  3.38it/s]
 32%|███▏      | 120623/371472 [9:35:56<20:22:49,  3.42it/s]
 32%|███▏      | 120624/371472 [9:35:56<19:26:51,  3.58it/s]
 32%|███▏      | 120625/371472 [9:35:57<18:54:50,  3.68it/s]
 32%|███▏      | 120626/371472 [9:35:57<18:42:11,  3.73it/s]
 32%|███▏      | 120627/371472 [9:35:57<18:23:06,  3.79it/s]
 32%|███▏      | 120628/371472 [9:35:58<18:55:34,  3.68it/s]
 32%|███▏      | 120629/371472 [9:35:58<19:16:02,  3.62it/s]
 32%|███▏      | 120630/371472 [9:35:58<20:37:29,  3.38it/s]
 32%|███▏      | 120631/371472 [9:35:59<21:14:37,  3.28it/s]
 32%|███▏      | 120632/371472 [9:35:59<20:49:56,  3.34it/s]
 32%|███▏      | 120633/371472 [9:35:59<20:52:19,  3.34it/s]
 32%|███▏      | 120634/371472 [9:35:59<20:39:12,  3.37it/s]
 32%|███▏      | 120635/371472 [9:36:00<20:20:09,  3.43it/s]
 32%|███▏      | 120636/371472 [9:36:00<19:49:19,  3.52it/s]
 32%|███▏      | 120637/371472 [9:36:00<19:05:45,  3.65it/s]
 32%|███▏      | 120638/371472 [9:36:00<19:13:47,  3.62it/s]
 32%|███▏      | 120639/371472 [9:36:01<19:07:42,  3.64it/s]
 32%|███▏      | 120640/371472 [9:36:01<18:30:05,  3.77it/s]
                                                            
{'loss': 3.2638, 'learning_rate': 7.080415436660992e-07, 'epoch': 5.2}

 32%|███▏      | 120640/371472 [9:36:01<18:30:05,  3.77it/s]
 32%|███▏      | 120641/371472 [9:36:01<18:57:07,  3.68it/s]
 32%|███▏      | 120642/371472 [9:36:02<19:50:23,  3.51it/s]
 32%|███▏      | 120643/371472 [9:36:02<19:32:49,  3.56it/s]
 32%|███▏      | 120644/371472 [9:36:02<19:43:42,  3.53it/s]
 32%|███▏      | 120645/371472 [9:36:02<19:04:28,  3.65it/s]
 32%|███▏      | 120646/371472 [9:36:03<18:38:58,  3.74it/s]
 32%|███▏      | 120647/371472 [9:36:03<21:03:00,  3.31it/s]
 32%|███▏      | 120648/371472 [9:36:03<20:03:33,  3.47it/s]
 32%|███▏      | 120649/371472 [9:36:04<19:42:43,  3.53it/s]
 32%|███▏      | 120650/371472 [9:36:04<19:16:21,  3.62it/s]
 32%|███▏      | 120651/371472 [9:36:04<18:46:32,  3.71it/s]
 32%|███▏      | 120652/371472 [9:36:04<18:19:47,  3.80it/s]
 32%|███▏      | 120653/371472 [9:36:05<19:14:37,  3.62it/s]
 32%|███▏      | 120654/371472 [9:36:05<18:29:24,  3.77it/s]
 32%|███▏      | 120655/371472 [9:36:05<18:13:27,  3.82it/s]
 32%|███▏      | 120656/371472 [9:36:05<18:39:59,  3.73it/s]
 32%|███▏      | 120657/371472 [9:36:06<21:13:16,  3.28it/s]
 32%|███▏      | 120658/371472 [9:36:06<21:04:55,  3.30it/s]
 32%|███▏      | 120659/371472 [9:36:06<19:51:18,  3.51it/s]
 32%|███▏      | 120660/371472 [9:36:07<20:52:07,  3.34it/s]
                                                            
{'loss': 3.2216, 'learning_rate': 7.079930616906202e-07, 'epoch': 5.2}

 32%|███▏      | 120660/371472 [9:36:07<20:52:07,  3.34it/s]
 32%|███▏      | 120661/371472 [9:36:07<22:20:34,  3.12it/s]
 32%|███▏      | 120662/371472 [9:36:07<22:01:47,  3.16it/s]
 32%|███▏      | 120663/371472 [9:36:08<21:47:21,  3.20it/s]
 32%|███▏      | 120664/371472 [9:36:08<20:31:54,  3.39it/s]
 32%|███▏      | 120665/371472 [9:36:08<20:07:57,  3.46it/s]
 32%|███▏      | 120666/371472 [9:36:08<20:30:16,  3.40it/s]
 32%|███▏      | 120667/371472 [9:36:09<20:41:50,  3.37it/s]
 32%|███▏      | 120668/371472 [9:36:09<19:30:38,  3.57it/s]
 32%|███▏      | 120669/371472 [9:36:09<19:08:31,  3.64it/s]
 32%|███▏      | 120670/371472 [9:36:10<19:00:40,  3.66it/s]
 32%|███▏      | 120671/371472 [9:36:10<20:07:41,  3.46it/s]
 32%|███▏      | 120672/371472 [9:36:10<20:00:39,  3.48it/s]
 32%|███▏      | 120673/371472 [9:36:10<19:11:11,  3.63it/s]
 32%|███▏      | 120674/371472 [9:36:11<18:40:46,  3.73it/s]
 32%|███▏      | 120675/371472 [9:36:11<19:02:37,  3.66it/s]
 32%|███▏      | 120676/371472 [9:36:11<19:17:08,  3.61it/s]
 32%|███▏      | 120677/371472 [9:36:12<19:20:28,  3.60it/s]
 32%|███▏      | 120678/371472 [9:36:12<19:34:31,  3.56it/s]
 32%|███▏      | 120679/371472 [9:36:12<20:30:47,  3.40it/s]
 32%|███▏      | 120680/371472 [9:36:12<19:32:55,  3.56it/s]
                                                            
{'loss': 3.1858, 'learning_rate': 7.079445797151414e-07, 'epoch': 5.2}

 32%|███▏      | 120680/371472 [9:36:12<19:32:55,  3.56it/s]
 32%|███▏      | 120681/371472 [9:36:13<21:35:14,  3.23it/s]
 32%|███▏      | 120682/371472 [9:36:13<22:23:40,  3.11it/s]
 32%|███▏      | 120683/371472 [9:36:13<20:33:31,  3.39it/s]
 32%|███▏      | 120684/371472 [9:36:14<19:35:21,  3.56it/s]
 32%|███▏      | 120685/371472 [9:36:14<19:11:41,  3.63it/s]
 32%|███▏      | 120686/371472 [9:36:14<21:13:11,  3.28it/s]
 32%|███▏      | 120687/371472 [9:36:14<20:29:04,  3.40it/s]
 32%|███▏      | 120688/371472 [9:36:15<19:29:14,  3.57it/s]
 32%|███▏      | 120689/371472 [9:36:15<18:54:39,  3.68it/s]
 32%|███▏      | 120690/371472 [9:36:15<18:16:59,  3.81it/s]
 32%|███▏      | 120691/371472 [9:36:15<18:10:17,  3.83it/s]
 32%|███▏      | 120692/371472 [9:36:16<18:23:09,  3.79it/s]
 32%|███▏      | 120693/371472 [9:36:16<19:12:20,  3.63it/s]
 32%|███▏      | 120694/371472 [9:36:16<18:13:36,  3.82it/s]
 32%|███▏      | 120695/371472 [9:36:17<18:49:56,  3.70it/s]
 32%|███▏      | 120696/371472 [9:36:17<19:25:37,  3.59it/s]
 32%|███▏      | 120697/371472 [9:36:17<19:48:11,  3.52it/s]
 32%|███▏      | 120698/371472 [9:36:17<20:00:18,  3.48it/s]
 32%|███▏      | 120699/371472 [9:36:18<19:41:38,  3.54it/s]
 32%|███▏      | 120700/371472 [9:36:18<18:54:25,  3.68it/s]
                                                            
{'loss': 3.3262, 'learning_rate': 7.078960977396626e-07, 'epoch': 5.2}

 32%|███▏      | 120700/371472 [9:36:18<18:54:25,  3.68it/s]
 32%|███▏      | 120701/371472 [9:36:18<19:06:33,  3.65it/s]
 32%|███▏      | 120702/371472 [9:36:19<19:57:12,  3.49it/s]
 32%|███▏      | 120703/371472 [9:36:19<19:17:57,  3.61it/s]
 32%|███▏      | 120704/371472 [9:36:19<18:55:03,  3.68it/s]
 32%|███▏      | 120705/371472 [9:36:19<18:45:15,  3.71it/s]
 32%|███▏      | 120706/371472 [9:36:20<18:18:58,  3.80it/s]
 32%|███▏      | 120707/371472 [9:36:20<19:07:45,  3.64it/s]
 32%|███▏      | 120708/371472 [9:36:20<18:42:28,  3.72it/s]
 32%|███▏      | 120709/371472 [9:36:20<19:20:31,  3.60it/s]
 32%|███▏      | 120710/371472 [9:36:21<20:00:39,  3.48it/s]
 32%|███▏      | 120711/371472 [9:36:21<19:33:26,  3.56it/s]
 32%|███▏      | 120712/371472 [9:36:21<19:34:08,  3.56it/s]
 32%|███▏      | 120713/371472 [9:36:22<18:34:43,  3.75it/s]
 32%|███▏      | 120714/371472 [9:36:22<19:55:22,  3.50it/s]
 32%|███▏      | 120715/371472 [9:36:22<19:58:53,  3.49it/s]
 32%|███▏      | 120716/371472 [9:36:22<19:37:20,  3.55it/s]
 32%|███▏      | 120717/371472 [9:36:23<19:10:31,  3.63it/s]
 32%|███▏      | 120718/371472 [9:36:23<19:50:28,  3.51it/s]
 32%|███▏      | 120719/371472 [9:36:23<19:17:09,  3.61it/s]
 32%|███▏      | 120720/371472 [9:36:24<19:05:51,  3.65it/s]
                                                            
{'loss': 3.1264, 'learning_rate': 7.078476157641837e-07, 'epoch': 5.2}

 32%|███▏      | 120720/371472 [9:36:24<19:05:51,  3.65it/s]
 32%|███▏      | 120721/371472 [9:36:24<20:05:49,  3.47it/s]
 32%|███▏      | 120722/371472 [9:36:24<19:52:50,  3.50it/s]
 32%|███▏      | 120723/371472 [9:36:24<19:40:40,  3.54it/s]
 32%|███▏      | 120724/371472 [9:36:25<19:39:36,  3.54it/s]
 32%|███▏      | 120725/371472 [9:36:25<20:20:08,  3.43it/s]
 32%|███▏      | 120726/371472 [9:36:25<21:23:33,  3.26it/s]
 32%|███▏      | 120727/371472 [9:36:26<21:30:10,  3.24it/s]
 32%|███▏      | 120728/371472 [9:36:26<20:13:54,  3.44it/s]
 33%|███▎      | 120729/371472 [9:36:26<20:44:59,  3.36it/s]
 33%|███▎      | 120730/371472 [9:36:27<20:32:12,  3.39it/s]
 33%|███▎      | 120731/371472 [9:36:27<20:05:56,  3.47it/s]
 33%|███▎      | 120732/371472 [9:36:27<19:09:06,  3.64it/s]
 33%|███▎      | 120733/371472 [9:36:27<19:35:00,  3.56it/s]
 33%|███▎      | 120734/371472 [9:36:28<19:09:12,  3.64it/s]
 33%|███▎      | 120735/371472 [9:36:28<19:22:45,  3.59it/s]
 33%|███▎      | 120736/371472 [9:36:28<18:56:06,  3.68it/s]
 33%|███▎      | 120737/371472 [9:36:29<21:12:20,  3.28it/s]
 33%|███▎      | 120738/371472 [9:36:29<22:20:42,  3.12it/s]
 33%|███▎      | 120739/371472 [9:36:29<21:38:20,  3.22it/s]
 33%|███▎      | 120740/371472 [9:36:29<20:41:45,  3.37it/s]
                                                            
{'loss': 3.15, 'learning_rate': 7.077991337887047e-07, 'epoch': 5.2}

 33%|███▎      | 120740/371472 [9:36:29<20:41:45,  3.37it/s]
 33%|███▎      | 120741/371472 [9:36:30<23:05:39,  3.02it/s]
 33%|███▎      | 120742/371472 [9:36:30<21:19:58,  3.26it/s]
 33%|███▎      | 120743/371472 [9:36:30<20:18:06,  3.43it/s]
 33%|███▎      | 120744/371472 [9:36:31<21:00:03,  3.32it/s]
 33%|███▎      | 120745/371472 [9:36:31<21:07:37,  3.30it/s]
 33%|███▎      | 120746/371472 [9:36:31<20:41:06,  3.37it/s]
 33%|███▎      | 120747/371472 [9:36:32<20:21:06,  3.42it/s]
 33%|███▎      | 120748/371472 [9:36:32<20:30:40,  3.40it/s]
 33%|███▎      | 120749/371472 [9:36:32<19:29:48,  3.57it/s]
 33%|███▎      | 120750/371472 [9:36:32<18:31:07,  3.76it/s]
 33%|███▎      | 120751/371472 [9:36:33<18:16:29,  3.81it/s]
 33%|███▎      | 120752/371472 [9:36:33<18:08:22,  3.84it/s]
 33%|███▎      | 120753/371472 [9:36:33<18:52:31,  3.69it/s]
 33%|███▎      | 120754/371472 [9:36:33<18:36:18,  3.74it/s]
 33%|███▎      | 120755/371472 [9:36:34<18:10:12,  3.83it/s]
 33%|███▎      | 120756/371472 [9:36:34<18:03:22,  3.86it/s]
 33%|███▎      | 120757/371472 [9:36:34<19:25:41,  3.58it/s]
 33%|███▎      | 120758/371472 [9:36:34<18:50:27,  3.70it/s]
 33%|███▎      | 120759/371472 [9:36:35<18:21:23,  3.79it/s]
 33%|███▎      | 120760/371472 [9:36:35<17:53:06,  3.89it/s]
                                                            
{'loss': 3.2252, 'learning_rate': 7.077506518132258e-07, 'epoch': 5.2}

 33%|███▎      | 120760/371472 [9:36:35<17:53:06,  3.89it/s]
 33%|███▎      | 120761/371472 [9:36:35<17:36:31,  3.95it/s]
 33%|███▎      | 120762/371472 [9:36:35<18:08:50,  3.84it/s]
 33%|███▎      | 120763/371472 [9:36:36<18:18:18,  3.80it/s]
 33%|███▎      | 120764/371472 [9:36:36<18:37:54,  3.74it/s]
 33%|███▎      | 120765/371472 [9:36:36<18:30:45,  3.76it/s]
 33%|███▎      | 120766/371472 [9:36:37<18:46:48,  3.71it/s]
 33%|███▎      | 120767/371472 [9:36:37<17:59:41,  3.87it/s]
 33%|███▎      | 120768/371472 [9:36:37<17:51:42,  3.90it/s]
 33%|███▎      | 120769/371472 [9:36:37<18:44:57,  3.71it/s]
 33%|███▎      | 120770/371472 [9:36:38<19:35:58,  3.55it/s]
 33%|███▎      | 120771/371472 [9:36:38<18:50:13,  3.70it/s]
 33%|███▎      | 120772/371472 [9:36:38<19:06:17,  3.65it/s]
 33%|███▎      | 120773/371472 [9:36:39<20:22:39,  3.42it/s]
 33%|███▎      | 120774/371472 [9:36:39<20:04:35,  3.47it/s]
 33%|███▎      | 120775/371472 [9:36:39<19:09:01,  3.64it/s]
 33%|███▎      | 120776/371472 [9:36:39<18:27:48,  3.77it/s]
 33%|███▎      | 120777/371472 [9:36:40<19:01:45,  3.66it/s]
 33%|███▎      | 120778/371472 [9:36:40<19:00:57,  3.66it/s]
 33%|███▎      | 120779/371472 [9:36:40<18:44:03,  3.72it/s]
 33%|███▎      | 120780/371472 [9:36:40<19:02:05,  3.66it/s]
                                                            
{'loss': 3.3022, 'learning_rate': 7.07702169837747e-07, 'epoch': 5.2}

 33%|███▎      | 120780/371472 [9:36:40<19:02:05,  3.66it/s]
 33%|███▎      | 120781/371472 [9:36:41<19:22:56,  3.59it/s]
 33%|███▎      | 120782/371472 [9:36:41<19:00:07,  3.66it/s]
 33%|███▎      | 120783/371472 [9:36:41<18:24:27,  3.78it/s]
 33%|███▎      | 120784/371472 [9:36:41<18:40:25,  3.73it/s]
 33%|███▎      | 120785/371472 [9:36:42<18:44:06,  3.72it/s]
 33%|███▎      | 120786/371472 [9:36:42<18:43:54,  3.72it/s]
 33%|███▎      | 120787/371472 [9:36:42<18:40:02,  3.73it/s]
 33%|███▎      | 120788/371472 [9:36:43<19:37:47,  3.55it/s]
 33%|███▎      | 120789/371472 [9:36:43<20:13:10,  3.44it/s]
 33%|███▎      | 120790/371472 [9:36:43<19:42:42,  3.53it/s]
 33%|███▎      | 120791/371472 [9:36:43<19:26:05,  3.58it/s]
 33%|███▎      | 120792/371472 [9:36:44<21:01:56,  3.31it/s]
 33%|███▎      | 120793/371472 [9:36:44<19:56:41,  3.49it/s]
 33%|███▎      | 120794/371472 [9:36:44<20:25:34,  3.41it/s]
 33%|███▎      | 120795/371472 [9:36:45<19:16:41,  3.61it/s]
 33%|███▎      | 120796/371472 [9:36:45<19:23:05,  3.59it/s]
 33%|███▎      | 120797/371472 [9:36:45<18:55:44,  3.68it/s]
 33%|███▎      | 120798/371472 [9:36:45<19:00:30,  3.66it/s]
 33%|███▎      | 120799/371472 [9:36:46<18:46:41,  3.71it/s]
 33%|███▎      | 120800/371472 [9:36:46<20:05:14,  3.47it/s]
                                                            
{'loss': 3.1993, 'learning_rate': 7.07653687862268e-07, 'epoch': 5.2}

 33%|███▎      | 120800/371472 [9:36:46<20:05:14,  3.47it/s]
 33%|███▎      | 120801/371472 [9:36:46<19:17:02,  3.61it/s]
 33%|███▎      | 120802/371472 [9:36:47<19:17:25,  3.61it/s]
 33%|███▎      | 120803/371472 [9:36:47<18:57:05,  3.67it/s]
 33%|███▎      | 120804/371472 [9:36:47<18:50:31,  3.70it/s]
 33%|███▎      | 120805/371472 [9:36:47<19:02:24,  3.66it/s]
 33%|███▎      | 120806/371472 [9:36:48<19:07:43,  3.64it/s]
 33%|███▎      | 120807/371472 [9:36:48<19:31:25,  3.57it/s]
 33%|███▎      | 120808/371472 [9:36:48<19:55:35,  3.49it/s]
 33%|███▎      | 120809/371472 [9:36:48<19:31:02,  3.57it/s]
 33%|███▎      | 120810/371472 [9:36:49<19:27:26,  3.58it/s]
 33%|███▎      | 120811/371472 [9:36:49<20:01:34,  3.48it/s]
 33%|███▎      | 120812/371472 [9:36:49<20:43:31,  3.36it/s]
 33%|███▎      | 120813/371472 [9:36:50<19:59:55,  3.48it/s]
 33%|███▎      | 120814/371472 [9:36:50<19:40:38,  3.54it/s]
 33%|███▎      | 120815/371472 [9:36:50<19:35:53,  3.55it/s]
 33%|███▎      | 120816/371472 [9:36:51<21:09:43,  3.29it/s]
 33%|███▎      | 120817/371472 [9:36:51<20:02:51,  3.47it/s]
 33%|███▎      | 120818/371472 [9:36:51<19:08:07,  3.64it/s]
 33%|███▎      | 120819/371472 [9:36:51<19:17:13,  3.61it/s]
 33%|███▎      | 120820/371472 [9:36:52<19:11:17,  3.63it/s]
                                                            
{'loss': 3.17, 'learning_rate': 7.076052058867891e-07, 'epoch': 5.2}

 33%|███▎      | 120820/371472 [9:36:52<19:11:17,  3.63it/s]
 33%|███▎      | 120821/371472 [9:36:52<18:27:18,  3.77it/s]
 33%|███▎      | 120822/371472 [9:36:52<18:15:02,  3.81it/s]
 33%|███▎      | 120823/371472 [9:36:52<18:43:37,  3.72it/s]
 33%|███▎      | 120824/371472 [9:36:53<19:23:16,  3.59it/s]
 33%|███▎      | 120825/371472 [9:36:53<19:14:08,  3.62it/s]
 33%|███▎      | 120826/371472 [9:36:53<18:33:29,  3.75it/s]
 33%|███▎      | 120827/371472 [9:36:53<18:59:06,  3.67it/s]
 33%|███▎      | 120828/371472 [9:36:54<18:21:28,  3.79it/s]
 33%|███▎      | 120829/371472 [9:36:54<18:47:44,  3.70it/s]
 33%|███▎      | 120830/371472 [9:36:54<19:03:09,  3.65it/s]
 33%|███▎      | 120831/371472 [9:36:55<19:28:51,  3.57it/s]
 33%|███▎      | 120832/371472 [9:36:55<19:01:30,  3.66it/s]
 33%|███▎      | 120833/371472 [9:36:55<18:29:28,  3.77it/s]
 33%|███▎      | 120834/371472 [9:36:55<19:03:41,  3.65it/s]
 33%|███▎      | 120835/371472 [9:36:56<19:44:34,  3.53it/s]
 33%|███▎      | 120836/371472 [9:36:56<19:41:29,  3.54it/s]
 33%|███▎      | 120837/371472 [9:36:56<19:14:04,  3.62it/s]
 33%|███▎      | 120838/371472 [9:36:56<19:27:02,  3.58it/s]
 33%|███▎      | 120839/371472 [9:36:57<19:26:23,  3.58it/s]
 33%|███▎      | 120840/371472 [9:36:57<20:25:37,  3.41it/s]
                                                            
{'loss': 3.1966, 'learning_rate': 7.075567239113103e-07, 'epoch': 5.2}

 33%|███▎      | 120840/371472 [9:36:57<20:25:37,  3.41it/s]
 33%|███▎      | 120841/371472 [9:36:57<20:44:02,  3.36it/s]
 33%|███▎      | 120842/371472 [9:36:58<20:27:35,  3.40it/s]
 33%|███▎      | 120843/371472 [9:36:58<19:56:17,  3.49it/s]
 33%|███▎      | 120844/371472 [9:36:58<21:05:18,  3.30it/s]
 33%|███▎      | 120845/371472 [9:36:59<20:20:47,  3.42it/s]
 33%|███▎      | 120846/371472 [9:36:59<19:31:05,  3.57it/s]
 33%|███▎      | 120847/371472 [9:36:59<19:56:33,  3.49it/s]
 33%|███▎      | 120848/371472 [9:36:59<20:32:24,  3.39it/s]
 33%|███▎      | 120849/371472 [9:37:00<19:27:08,  3.58it/s]
 33%|███▎      | 120850/371472 [9:37:00<18:44:45,  3.71it/s]
 33%|███▎      | 120851/371472 [9:37:00<18:19:34,  3.80it/s]
 33%|███▎      | 120852/371472 [9:37:00<19:19:20,  3.60it/s]
 33%|███▎      | 120853/371472 [9:37:01<19:03:44,  3.65it/s]
 33%|███▎      | 120854/371472 [9:37:01<20:09:13,  3.45it/s]
 33%|███▎      | 120855/371472 [9:37:01<19:59:02,  3.48it/s]
 33%|███▎      | 120856/371472 [9:37:02<18:49:52,  3.70it/s]
 33%|███▎      | 120857/371472 [9:37:02<18:45:53,  3.71it/s]
 33%|███▎      | 120858/371472 [9:37:02<19:07:42,  3.64it/s]
 33%|███▎      | 120859/371472 [9:37:02<18:49:53,  3.70it/s]
 33%|███▎      | 120860/371472 [9:37:03<18:36:03,  3.74it/s]
                                                            
{'loss': 3.2244, 'learning_rate': 7.075082419358315e-07, 'epoch': 5.21}

 33%|███▎      | 120860/371472 [9:37:03<18:36:03,  3.74it/s]
 33%|███▎      | 120861/371472 [9:37:03<18:07:27,  3.84it/s]
 33%|███▎      | 120862/371472 [9:37:03<18:55:17,  3.68it/s]
 33%|███▎      | 120863/371472 [9:37:03<19:05:44,  3.65it/s]
 33%|███▎      | 120864/371472 [9:37:04<19:19:40,  3.60it/s]
 33%|███▎      | 120865/371472 [9:37:04<18:27:19,  3.77it/s]
 33%|███▎      | 120866/371472 [9:37:04<19:40:44,  3.54it/s]
 33%|███▎      | 120867/371472 [9:37:05<18:38:02,  3.74it/s]
 33%|███▎      | 120868/371472 [9:37:05<18:19:54,  3.80it/s]
 33%|███▎      | 120869/371472 [9:37:05<18:08:35,  3.84it/s]
 33%|███▎      | 120870/371472 [9:37:05<17:41:35,  3.93it/s]
 33%|███▎      | 120871/371472 [9:37:06<20:06:52,  3.46it/s]
 33%|███▎      | 120872/371472 [9:37:06<20:08:34,  3.46it/s]
 33%|███▎      | 120873/371472 [9:37:06<19:27:02,  3.58it/s]
 33%|███▎      | 120874/371472 [9:37:07<23:20:53,  2.98it/s]
 33%|███▎      | 120875/371472 [9:37:07<21:20:12,  3.26it/s]
 33%|███▎      | 120876/371472 [9:37:07<20:36:47,  3.38it/s]
 33%|███▎      | 120877/371472 [9:37:07<19:43:30,  3.53it/s]
 33%|███▎      | 120878/371472 [9:37:08<19:56:05,  3.49it/s]
 33%|███▎      | 120879/371472 [9:37:08<18:51:38,  3.69it/s]
 33%|███▎      | 120880/371472 [9:37:08<18:57:47,  3.67it/s]
                                                            
{'loss': 3.2044, 'learning_rate': 7.074597599603524e-07, 'epoch': 5.21}

 33%|███▎      | 120880/371472 [9:37:08<18:57:47,  3.67it/s]
 33%|███▎      | 120881/371472 [9:37:09<18:53:55,  3.68it/s]
 33%|███▎      | 120882/371472 [9:37:09<19:07:56,  3.64it/s]
 33%|███▎      | 120883/371472 [9:37:09<18:34:41,  3.75it/s]
 33%|███▎      | 120884/371472 [9:37:09<19:59:40,  3.48it/s]
 33%|███▎      | 120885/371472 [9:37:10<19:28:40,  3.57it/s]
 33%|███▎      | 120886/371472 [9:37:10<18:54:56,  3.68it/s]
 33%|███▎      | 120887/371472 [9:37:10<18:34:16,  3.75it/s]
 33%|███▎      | 120888/371472 [9:37:10<18:36:41,  3.74it/s]
 33%|███▎      | 120889/371472 [9:37:11<19:46:57,  3.52it/s]
 33%|███▎      | 120890/371472 [9:37:11<18:47:09,  3.71it/s]
 33%|███▎      | 120891/371472 [9:37:11<18:30:22,  3.76it/s]
 33%|███▎      | 120892/371472 [9:37:12<18:59:14,  3.67it/s]
 33%|███▎      | 120893/371472 [9:37:12<18:10:47,  3.83it/s]
 33%|███▎      | 120894/371472 [9:37:12<18:08:38,  3.84it/s]
 33%|███▎      | 120895/371472 [9:37:12<18:59:09,  3.67it/s]
 33%|███▎      | 120896/371472 [9:37:13<18:46:28,  3.71it/s]
 33%|███▎      | 120897/371472 [9:37:13<20:03:36,  3.47it/s]
 33%|███▎      | 120898/371472 [9:37:13<19:25:45,  3.58it/s]
 33%|███▎      | 120899/371472 [9:37:14<21:05:07,  3.30it/s]
 33%|███▎      | 120900/371472 [9:37:14<19:40:38,  3.54it/s]
                                                            
{'loss': 3.4288, 'learning_rate': 7.074112779848735e-07, 'epoch': 5.21}

 33%|███▎      | 120900/371472 [9:37:14<19:40:38,  3.54it/s]
 33%|███▎      | 120901/371472 [9:37:14<19:12:55,  3.62it/s]
 33%|███▎      | 120902/371472 [9:37:14<19:58:35,  3.48it/s]
 33%|███▎      | 120903/371472 [9:37:15<19:40:20,  3.54it/s]
 33%|███▎      | 120904/371472 [9:37:15<19:29:45,  3.57it/s]
 33%|███▎      | 120905/371472 [9:37:15<19:15:01,  3.62it/s]
 33%|███▎      | 120906/371472 [9:37:15<19:13:53,  3.62it/s]
 33%|███▎      | 120907/371472 [9:37:16<19:29:11,  3.57it/s]
 33%|███▎      | 120908/371472 [9:37:16<18:40:25,  3.73it/s]
 33%|███▎      | 120909/371472 [9:37:16<19:07:06,  3.64it/s]
 33%|███▎      | 120910/371472 [9:37:17<19:56:55,  3.49it/s]
 33%|███▎      | 120911/371472 [9:37:17<18:46:57,  3.71it/s]
 33%|███▎      | 120912/371472 [9:37:17<19:43:14,  3.53it/s]
 33%|███▎      | 120913/371472 [9:37:17<19:43:03,  3.53it/s]
 33%|███▎      | 120914/371472 [9:37:18<19:22:23,  3.59it/s]
 33%|███▎      | 120915/371472 [9:37:18<19:06:05,  3.64it/s]
 33%|███▎      | 120916/371472 [9:37:18<19:06:16,  3.64it/s]
 33%|███▎      | 120917/371472 [9:37:19<19:56:58,  3.49it/s]
 33%|███▎      | 120918/371472 [9:37:19<23:37:16,  2.95it/s]
 33%|███▎      | 120919/371472 [9:37:19<22:06:19,  3.15it/s]
 33%|███▎      | 120920/371472 [9:37:20<21:38:27,  3.22it/s]
                                                            
{'loss': 3.2562, 'learning_rate': 7.073627960093947e-07, 'epoch': 5.21}

 33%|███▎      | 120920/371472 [9:37:20<21:38:27,  3.22it/s]
 33%|███▎      | 120921/371472 [9:37:20<20:27:12,  3.40it/s]
 33%|███▎      | 120922/371472 [9:37:20<19:27:48,  3.58it/s]
 33%|███▎      | 120923/371472 [9:37:20<20:09:35,  3.45it/s]
 33%|███▎      | 120924/371472 [9:37:21<19:22:28,  3.59it/s]
 33%|███▎      | 120925/371472 [9:37:21<19:25:01,  3.58it/s]
 33%|███▎      | 120926/371472 [9:37:21<19:33:11,  3.56it/s]
 33%|███▎      | 120927/371472 [9:37:21<19:07:52,  3.64it/s]
 33%|███▎      | 120928/371472 [9:37:22<18:44:54,  3.71it/s]
 33%|███▎      | 120929/371472 [9:37:22<18:41:04,  3.72it/s]
 33%|███▎      | 120930/371472 [9:37:22<18:34:08,  3.75it/s]
 33%|███▎      | 120931/371472 [9:37:23<18:43:37,  3.72it/s]
 33%|███▎      | 120932/371472 [9:37:23<19:08:02,  3.64it/s]
 33%|███▎      | 120933/371472 [9:37:23<18:32:21,  3.75it/s]
 33%|███▎      | 120934/371472 [9:37:23<19:55:34,  3.49it/s]
 33%|███▎      | 120935/371472 [9:37:24<19:38:10,  3.54it/s]
 33%|███▎      | 120936/371472 [9:37:24<20:07:12,  3.46it/s]
 33%|███▎      | 120937/371472 [9:37:24<19:29:46,  3.57it/s]
 33%|███▎      | 120938/371472 [9:37:24<18:48:42,  3.70it/s]
 33%|███▎      | 120939/371472 [9:37:25<18:30:29,  3.76it/s]
 33%|███▎      | 120940/371472 [9:37:25<18:47:57,  3.70it/s]
                                                            
{'loss': 3.3652, 'learning_rate': 7.073143140339159e-07, 'epoch': 5.21}

 33%|███▎      | 120940/371472 [9:37:25<18:47:57,  3.70it/s]
 33%|███▎      | 120941/371472 [9:37:25<19:22:10,  3.59it/s]
 33%|███▎      | 120942/371472 [9:37:26<18:50:50,  3.69it/s]
 33%|███▎      | 120943/371472 [9:37:26<18:45:52,  3.71it/s]
 33%|███▎      | 120944/371472 [9:37:26<19:36:25,  3.55it/s]
 33%|███▎      | 120945/371472 [9:37:26<19:42:04,  3.53it/s]
 33%|███▎      | 120946/371472 [9:37:27<19:03:33,  3.65it/s]
 33%|███▎      | 120947/371472 [9:37:27<19:19:25,  3.60it/s]
 33%|███▎      | 120948/371472 [9:37:27<19:54:39,  3.50it/s]
 33%|███▎      | 120949/371472 [9:37:28<20:17:40,  3.43it/s]
 33%|███▎      | 120950/371472 [9:37:28<21:09:16,  3.29it/s]
 33%|███▎      | 120951/371472 [9:37:28<20:29:32,  3.40it/s]
 33%|███▎      | 120952/371472 [9:37:28<21:06:07,  3.30it/s]
 33%|███▎      | 120953/371472 [9:37:29<20:28:00,  3.40it/s]
 33%|███▎      | 120954/371472 [9:37:29<19:32:54,  3.56it/s]
 33%|███▎      | 120955/371472 [9:37:29<19:47:24,  3.52it/s]
 33%|███▎      | 120956/371472 [9:37:30<19:26:46,  3.58it/s]
 33%|███▎      | 120957/371472 [9:37:30<19:23:23,  3.59it/s]
 33%|███▎      | 120958/371472 [9:37:30<19:05:59,  3.64it/s]
 33%|███▎      | 120959/371472 [9:37:30<18:29:40,  3.76it/s]
 33%|███▎      | 120960/371472 [9:37:31<18:13:00,  3.82it/s]
                                                            
{'loss': 3.2845, 'learning_rate': 7.072658320584369e-07, 'epoch': 5.21}

 33%|███▎      | 120960/371472 [9:37:31<18:13:00,  3.82it/s]
 33%|███▎      | 120961/371472 [9:37:31<17:55:01,  3.88it/s]
 33%|███▎      | 120962/371472 [9:37:31<18:29:40,  3.76it/s]
 33%|███▎      | 120963/371472 [9:37:31<18:37:35,  3.74it/s]
 33%|███▎      | 120964/371472 [9:37:32<18:20:30,  3.79it/s]
 33%|███▎      | 120965/371472 [9:37:32<20:38:28,  3.37it/s]
 33%|███▎      | 120966/371472 [9:37:32<19:36:03,  3.55it/s]
 33%|███▎      | 120967/371472 [9:37:33<19:15:21,  3.61it/s]
 33%|███▎      | 120968/371472 [9:37:33<19:13:10,  3.62it/s]
 33%|███▎      | 120969/371472 [9:37:33<19:19:50,  3.60it/s]
 33%|███▎      | 120970/371472 [9:37:33<19:22:17,  3.59it/s]
 33%|███▎      | 120971/371472 [9:37:34<20:50:07,  3.34it/s]
 33%|███▎      | 120972/371472 [9:37:34<20:00:56,  3.48it/s]
 33%|███▎      | 120973/371472 [9:37:34<18:55:51,  3.68it/s]
 33%|███▎      | 120974/371472 [9:37:35<19:48:09,  3.51it/s]
 33%|███▎      | 120975/371472 [9:37:35<19:18:36,  3.60it/s]
 33%|███▎      | 120976/371472 [9:37:35<19:01:57,  3.66it/s]
 33%|███▎      | 120977/371472 [9:37:35<19:09:01,  3.63it/s]
 33%|███▎      | 120978/371472 [9:37:36<18:48:08,  3.70it/s]
 33%|███▎      | 120979/371472 [9:37:36<18:45:17,  3.71it/s]
 33%|███▎      | 120980/371472 [9:37:36<18:32:54,  3.75it/s]
                                                            
{'loss': 3.1904, 'learning_rate': 7.07217350082958e-07, 'epoch': 5.21}

 33%|███▎      | 120980/371472 [9:37:36<18:32:54,  3.75it/s]
 33%|███▎      | 120981/371472 [9:37:36<19:14:22,  3.62it/s]
 33%|███▎      | 120982/371472 [9:37:37<19:13:58,  3.62it/s]
 33%|███▎      | 120983/371472 [9:37:37<19:34:19,  3.56it/s]
 33%|███▎      | 120984/371472 [9:37:37<18:32:45,  3.75it/s]
 33%|███▎      | 120985/371472 [9:37:37<17:52:08,  3.89it/s]
 33%|███▎      | 120986/371472 [9:37:38<17:23:53,  4.00it/s]
 33%|███▎      | 120987/371472 [9:37:38<17:17:18,  4.02it/s]
 33%|███▎      | 120988/371472 [9:37:38<17:29:11,  3.98it/s]
 33%|███▎      | 120989/371472 [9:37:38<17:37:01,  3.95it/s]
 33%|███▎      | 120990/371472 [9:37:39<17:33:10,  3.96it/s]
 33%|███▎      | 120991/371472 [9:37:39<18:11:37,  3.82it/s]
 33%|███▎      | 120992/371472 [9:37:39<17:48:05,  3.91it/s]
 33%|███▎      | 120993/371472 [9:37:40<17:52:06,  3.89it/s]
 33%|███▎      | 120994/371472 [9:37:40<18:25:33,  3.78it/s]
 33%|███▎      | 120995/371472 [9:37:40<19:22:19,  3.59it/s]
 33%|███▎      | 120996/371472 [9:37:40<19:12:45,  3.62it/s]
 33%|███▎      | 120997/371472 [9:37:41<18:50:45,  3.69it/s]
 33%|███▎      | 120998/371472 [9:37:41<20:45:23,  3.35it/s]
 33%|███▎      | 120999/371472 [9:37:41<20:22:28,  3.41it/s]
 33%|███▎      | 121000/371472 [9:37:42<19:20:54,  3.60it/s]
                                                            
{'loss': 3.4221, 'learning_rate': 7.071688681074792e-07, 'epoch': 5.21}

 33%|███▎      | 121000/371472 [9:37:42<19:20:54,  3.60it/s]
 33%|███▎      | 121001/371472 [9:37:42<20:24:47,  3.41it/s]
 33%|███▎      | 121002/371472 [9:37:42<19:52:01,  3.50it/s]
 33%|███▎      | 121003/371472 [9:37:42<19:20:13,  3.60it/s]
 33%|███▎      | 121004/371472 [9:37:43<18:50:29,  3.69it/s]
 33%|███▎      | 121005/371472 [9:37:43<18:22:18,  3.79it/s]
 33%|███▎      | 121006/371472 [9:37:43<18:12:50,  3.82it/s]
 33%|███▎      | 121007/371472 [9:37:43<18:05:33,  3.85it/s]
 33%|███▎      | 121008/371472 [9:37:44<17:31:42,  3.97it/s]
 33%|███▎      | 121009/371472 [9:37:44<17:46:01,  3.92it/s]
 33%|███▎      | 121010/371472 [9:37:44<17:24:16,  4.00it/s]
 33%|███▎      | 121011/371472 [9:37:44<17:04:28,  4.07it/s]
 33%|███▎      | 121012/371472 [9:37:45<18:14:50,  3.81it/s]
 33%|███▎      | 121013/371472 [9:37:45<18:12:11,  3.82it/s]
 33%|███▎      | 121014/371472 [9:37:45<18:49:01,  3.70it/s]
 33%|███▎      | 121015/371472 [9:37:45<18:20:55,  3.79it/s]
 33%|███▎      | 121016/371472 [9:37:46<20:32:37,  3.39it/s]
 33%|███▎      | 121017/371472 [9:37:46<20:15:32,  3.43it/s]
 33%|███▎      | 121018/371472 [9:37:46<18:59:43,  3.66it/s]
 33%|███▎      | 121019/371472 [9:37:47<19:13:39,  3.62it/s]
 33%|███▎      | 121020/371472 [9:37:47<18:39:10,  3.73it/s]
                                                            
{'loss': 3.1999, 'learning_rate': 7.071203861320002e-07, 'epoch': 5.21}

 33%|███▎      | 121020/371472 [9:37:47<18:39:10,  3.73it/s]
 33%|███▎      | 121021/371472 [9:37:47<18:33:44,  3.75it/s]
 33%|███▎      | 121022/371472 [9:37:47<19:48:43,  3.51it/s]
 33%|███▎      | 121023/371472 [9:37:48<19:51:48,  3.50it/s]
 33%|███▎      | 121024/371472 [9:37:48<20:28:16,  3.40it/s]
 33%|███▎      | 121025/371472 [9:37:48<20:03:51,  3.47it/s]
 33%|███▎      | 121026/371472 [9:37:49<20:05:54,  3.46it/s]
 33%|███▎      | 121027/371472 [9:37:49<20:37:06,  3.37it/s]
 33%|███▎      | 121028/371472 [9:37:49<21:01:58,  3.31it/s]
 33%|███▎      | 121029/371472 [9:37:50<21:42:36,  3.20it/s]
 33%|███▎      | 121030/371472 [9:37:50<21:51:53,  3.18it/s]
 33%|███▎      | 121031/371472 [9:37:50<20:17:30,  3.43it/s]
 33%|███▎      | 121032/371472 [9:37:50<20:14:19,  3.44it/s]
 33%|███▎      | 121033/371472 [9:37:51<19:24:38,  3.58it/s]
 33%|███▎      | 121034/371472 [9:37:51<19:46:17,  3.52it/s]
 33%|███▎      | 121035/371472 [9:37:51<20:54:19,  3.33it/s]
 33%|███▎      | 121036/371472 [9:37:52<20:31:46,  3.39it/s]
 33%|███▎      | 121037/371472 [9:37:52<19:24:43,  3.58it/s]
 33%|███▎      | 121038/371472 [9:37:52<19:14:23,  3.62it/s]
 33%|███▎      | 121039/371472 [9:37:52<18:40:19,  3.73it/s]
 33%|███▎      | 121040/371472 [9:37:53<18:55:25,  3.68it/s]
                                                            
{'loss': 3.1014, 'learning_rate': 7.070719041565213e-07, 'epoch': 5.21}

 33%|███▎      | 121040/371472 [9:37:53<18:55:25,  3.68it/s]
 33%|███▎      | 121041/371472 [9:37:53<18:44:40,  3.71it/s]
 33%|███▎      | 121042/371472 [9:37:53<19:00:47,  3.66it/s]
 33%|███▎      | 121043/371472 [9:37:53<18:53:18,  3.68it/s]
 33%|███▎      | 121044/371472 [9:37:54<19:01:02,  3.66it/s]
 33%|███▎      | 121045/371472 [9:37:54<20:27:53,  3.40it/s]
 33%|███▎      | 121046/371472 [9:37:54<22:27:58,  3.10it/s]
 33%|███▎      | 121047/371472 [9:37:55<22:08:30,  3.14it/s]
 33%|███▎      | 121048/371472 [9:37:55<20:41:17,  3.36it/s]
 33%|███▎      | 121049/371472 [9:37:55<20:23:09,  3.41it/s]
 33%|███▎      | 121050/371472 [9:37:56<19:23:54,  3.59it/s]
 33%|███▎      | 121051/371472 [9:37:56<18:55:00,  3.68it/s]
 33%|███▎      | 121052/371472 [9:37:56<19:29:04,  3.57it/s]
 33%|███▎      | 121053/371472 [9:37:56<18:44:50,  3.71it/s]
 33%|███▎      | 121054/371472 [9:37:57<18:52:06,  3.69it/s]
 33%|███▎      | 121055/371472 [9:37:57<19:31:25,  3.56it/s]
 33%|███▎      | 121056/371472 [9:37:57<19:16:37,  3.61it/s]
 33%|███▎      | 121057/371472 [9:37:57<18:27:45,  3.77it/s]
 33%|███▎      | 121058/371472 [9:37:58<17:59:53,  3.86it/s]
 33%|███▎      | 121059/371472 [9:37:58<19:45:54,  3.52it/s]
 33%|███▎      | 121060/371472 [9:37:58<20:39:02,  3.37it/s]
                                                            
{'loss': 3.2871, 'learning_rate': 7.070234221810424e-07, 'epoch': 5.21}

 33%|███▎      | 121060/371472 [9:37:58<20:39:02,  3.37it/s]
 33%|███▎      | 121061/371472 [9:37:59<20:12:05,  3.44it/s]
 33%|███▎      | 121062/371472 [9:37:59<20:23:50,  3.41it/s]
 33%|███▎      | 121063/371472 [9:37:59<21:13:22,  3.28it/s]
 33%|███▎      | 121064/371472 [9:38:00<20:35:48,  3.38it/s]
 33%|███▎      | 121065/371472 [9:38:00<19:33:33,  3.56it/s]
 33%|███▎      | 121066/371472 [9:38:00<18:52:12,  3.69it/s]
 33%|███▎      | 121067/371472 [9:38:00<20:18:29,  3.43it/s]
 33%|███▎      | 121068/371472 [9:38:01<19:32:42,  3.56it/s]
 33%|███▎      | 121069/371472 [9:38:01<19:17:03,  3.61it/s]
 33%|███▎      | 121070/371472 [9:38:01<19:10:02,  3.63it/s]
 33%|███▎      | 121071/371472 [9:38:01<19:01:45,  3.66it/s]
 33%|███▎      | 121072/371472 [9:38:02<19:20:57,  3.59it/s]
 33%|███▎      | 121073/371472 [9:38:02<19:17:10,  3.61it/s]
 33%|███▎      | 121074/371472 [9:38:02<19:21:06,  3.59it/s]
 33%|███▎      | 121075/371472 [9:38:03<20:42:52,  3.36it/s]
 33%|███▎      | 121076/371472 [9:38:03<20:42:29,  3.36it/s]
 33%|███▎      | 121077/371472 [9:38:03<20:21:39,  3.42it/s]
 33%|███▎      | 121078/371472 [9:38:03<19:38:12,  3.54it/s]
 33%|███▎      | 121079/371472 [9:38:04<20:16:43,  3.43it/s]
 33%|███▎      | 121080/371472 [9:38:04<20:19:01,  3.42it/s]
                                                            
{'loss': 3.2395, 'learning_rate': 7.069749402055636e-07, 'epoch': 5.22}

 33%|███▎      | 121080/371472 [9:38:04<20:19:01,  3.42it/s]
 33%|███▎      | 121081/371472 [9:38:04<18:55:55,  3.67it/s]
 33%|███▎      | 121082/371472 [9:38:05<20:07:27,  3.46it/s]
 33%|███▎      | 121083/371472 [9:38:05<19:55:08,  3.49it/s]
 33%|███▎      | 121084/371472 [9:38:05<19:14:37,  3.61it/s]
 33%|███▎      | 121085/371472 [9:38:05<18:52:03,  3.69it/s]
 33%|███▎      | 121086/371472 [9:38:06<18:25:34,  3.77it/s]
 33%|███▎      | 121087/371472 [9:38:06<17:41:56,  3.93it/s]
 33%|███▎      | 121088/371472 [9:38:06<19:53:10,  3.50it/s]
 33%|███▎      | 121089/371472 [9:38:07<20:11:21,  3.44it/s]
 33%|███▎      | 121090/371472 [9:38:07<19:52:12,  3.50it/s]
 33%|███▎      | 121091/371472 [9:38:07<18:46:11,  3.71it/s]
 33%|███▎      | 121092/371472 [9:38:07<19:48:37,  3.51it/s]
 33%|███▎      | 121093/371472 [9:38:08<19:51:55,  3.50it/s]
 33%|███▎      | 121094/371472 [9:38:08<19:28:52,  3.57it/s]
 33%|███▎      | 121095/371472 [9:38:08<19:12:47,  3.62it/s]
 33%|███▎      | 121096/371472 [9:38:09<20:15:32,  3.43it/s]
 33%|███▎      | 121097/371472 [9:38:09<20:51:39,  3.33it/s]
 33%|███▎      | 121098/371472 [9:38:09<22:02:30,  3.16it/s]
 33%|███▎      | 121099/371472 [9:38:10<23:01:10,  3.02it/s]
 33%|███▎      | 121100/371472 [9:38:10<22:04:13,  3.15it/s]
                                                            
{'loss': 3.1326, 'learning_rate': 7.069264582300848e-07, 'epoch': 5.22}

 33%|███▎      | 121100/371472 [9:38:10<22:04:13,  3.15it/s]
 33%|███▎      | 121101/371472 [9:38:10<21:11:17,  3.28it/s]
 33%|███▎      | 121102/371472 [9:38:10<20:36:10,  3.38it/s]
 33%|███▎      | 121103/371472 [9:38:11<19:57:01,  3.49it/s]
 33%|███▎      | 121104/371472 [9:38:11<18:57:35,  3.67it/s]
 33%|███▎      | 121105/371472 [9:38:11<20:08:18,  3.45it/s]
 33%|███▎      | 121106/371472 [9:38:12<19:38:15,  3.54it/s]
 33%|███▎      | 121107/371472 [9:38:12<20:43:14,  3.36it/s]
 33%|███▎      | 121108/371472 [9:38:12<19:48:43,  3.51it/s]
 33%|███▎      | 121109/371472 [9:38:12<19:49:02,  3.51it/s]
 33%|███▎      | 121110/371472 [9:38:13<21:13:43,  3.28it/s]
 33%|███▎      | 121111/371472 [9:38:13<20:04:19,  3.46it/s]
 33%|███▎      | 121112/371472 [9:38:13<19:56:58,  3.49it/s]
 33%|███▎      | 121113/371472 [9:38:14<19:42:58,  3.53it/s]
 33%|███▎      | 121114/371472 [9:38:14<19:43:37,  3.53it/s]
 33%|███▎      | 121115/371472 [9:38:14<19:57:13,  3.49it/s]
 33%|███▎      | 121116/371472 [9:38:14<19:16:40,  3.61it/s]
 33%|███▎      | 121117/371472 [9:38:15<20:34:51,  3.38it/s]
 33%|███▎      | 121118/371472 [9:38:15<19:22:07,  3.59it/s]
 33%|███▎      | 121119/371472 [9:38:15<19:43:07,  3.53it/s]
 33%|███▎      | 121120/371472 [9:38:16<19:09:55,  3.63it/s]
                                                            
{'loss': 3.1206, 'learning_rate': 7.068779762546058e-07, 'epoch': 5.22}

 33%|███▎      | 121120/371472 [9:38:16<19:09:55,  3.63it/s]
 33%|███▎      | 121121/371472 [9:38:16<18:39:55,  3.73it/s]
 33%|███▎      | 121122/371472 [9:38:16<18:18:58,  3.80it/s]
 33%|███▎      | 121123/371472 [9:38:16<17:50:55,  3.90it/s]
 33%|███▎      | 121124/371472 [9:38:17<18:04:40,  3.85it/s]
 33%|███▎      | 121125/371472 [9:38:17<17:55:42,  3.88it/s]
 33%|███▎      | 121126/371472 [9:38:17<18:45:25,  3.71it/s]
 33%|███▎      | 121127/371472 [9:38:17<18:21:10,  3.79it/s]
 33%|███▎      | 121128/371472 [9:38:18<19:52:39,  3.50it/s]
 33%|███▎      | 121129/371472 [9:38:18<18:45:45,  3.71it/s]
 33%|███▎      | 121130/371472 [9:38:18<19:01:17,  3.66it/s]
 33%|███▎      | 121131/371472 [9:38:18<18:11:59,  3.82it/s]
 33%|███▎      | 121132/371472 [9:38:19<17:40:05,  3.94it/s]
 33%|███▎      | 121133/371472 [9:38:19<17:33:17,  3.96it/s]
 33%|███▎      | 121134/371472 [9:38:19<17:41:40,  3.93it/s]
 33%|███▎      | 121135/371472 [9:38:19<17:52:00,  3.89it/s]
 33%|███▎      | 121136/371472 [9:38:20<18:49:24,  3.69it/s]
 33%|███▎      | 121137/371472 [9:38:20<19:13:35,  3.62it/s]
 33%|███▎      | 121138/371472 [9:38:20<19:53:47,  3.49it/s]
 33%|███▎      | 121139/371472 [9:38:21<19:22:44,  3.59it/s]
 33%|███▎      | 121140/371472 [9:38:21<19:28:10,  3.57it/s]
                                                            
{'loss': 3.368, 'learning_rate': 7.068294942791268e-07, 'epoch': 5.22}

 33%|███▎      | 121140/371472 [9:38:21<19:28:10,  3.57it/s]
 33%|███▎      | 121141/371472 [9:38:21<19:35:05,  3.55it/s]
 33%|███▎      | 121142/371472 [9:38:21<20:12:18,  3.44it/s]
 33%|███▎      | 121143/371472 [9:38:22<19:50:56,  3.50it/s]
 33%|███▎      | 121144/371472 [9:38:22<19:15:57,  3.61it/s]
 33%|███▎      | 121145/371472 [9:38:22<18:42:07,  3.72it/s]
 33%|███▎      | 121146/371472 [9:38:23<18:56:34,  3.67it/s]
 33%|███▎      | 121147/371472 [9:38:23<18:49:12,  3.69it/s]
 33%|███▎      | 121148/371472 [9:38:23<18:38:21,  3.73it/s]
 33%|███▎      | 121149/371472 [9:38:23<18:11:00,  3.82it/s]
 33%|███▎      | 121150/371472 [9:38:24<17:59:43,  3.86it/s]
 33%|███▎      | 121151/371472 [9:38:24<17:49:57,  3.90it/s]
 33%|███▎      | 121152/371472 [9:38:24<17:39:13,  3.94it/s]
 33%|███▎      | 121153/371472 [9:38:24<18:06:19,  3.84it/s]
 33%|███▎      | 121154/371472 [9:38:25<18:15:37,  3.81it/s]
 33%|███▎      | 121155/371472 [9:38:25<18:26:03,  3.77it/s]
 33%|███▎      | 121156/371472 [9:38:25<18:54:16,  3.68it/s]
 33%|███▎      | 121157/371472 [9:38:25<18:14:10,  3.81it/s]
 33%|███▎      | 121158/371472 [9:38:26<17:51:56,  3.89it/s]
 33%|███▎      | 121159/371472 [9:38:26<18:01:08,  3.86it/s]
 33%|███▎      | 121160/371472 [9:38:26<17:49:44,  3.90it/s]
                                                            
{'loss': 3.2948, 'learning_rate': 7.06781012303648e-07, 'epoch': 5.22}

 33%|███▎      | 121160/371472 [9:38:26<17:49:44,  3.90it/s]
 33%|███▎      | 121161/371472 [9:38:26<18:10:13,  3.83it/s]
 33%|███▎      | 121162/371472 [9:38:27<18:06:03,  3.84it/s]
 33%|███▎      | 121163/371472 [9:38:27<18:49:58,  3.69it/s]
 33%|███▎      | 121164/371472 [9:38:27<19:41:41,  3.53it/s]
 33%|███▎      | 121165/371472 [9:38:28<19:09:43,  3.63it/s]
 33%|███▎      | 121166/371472 [9:38:28<18:40:22,  3.72it/s]
 33%|███▎      | 121167/371472 [9:38:28<18:44:50,  3.71it/s]
 33%|███▎      | 121168/371472 [9:38:28<19:01:05,  3.66it/s]
 33%|███▎      | 121169/371472 [9:38:29<19:57:44,  3.48it/s]
 33%|███▎      | 121170/371472 [9:38:29<19:38:04,  3.54it/s]
 33%|███▎      | 121171/371472 [9:38:29<20:21:02,  3.42it/s]
 33%|███▎      | 121172/371472 [9:38:29<19:11:02,  3.62it/s]
 33%|███▎      | 121173/371472 [9:38:30<18:48:58,  3.70it/s]
 33%|███▎      | 121174/371472 [9:38:30<18:13:54,  3.81it/s]
 33%|███▎      | 121175/371472 [9:38:30<18:22:25,  3.78it/s]
 33%|███▎      | 121176/371472 [9:38:31<20:56:14,  3.32it/s]
 33%|███▎      | 121177/371472 [9:38:31<20:49:05,  3.34it/s]
 33%|███▎      | 121178/371472 [9:38:31<21:51:24,  3.18it/s]
 33%|███▎      | 121179/371472 [9:38:32<20:41:48,  3.36it/s]
 33%|███▎      | 121180/371472 [9:38:32<20:49:30,  3.34it/s]
                                                            
{'loss': 3.284, 'learning_rate': 7.06732530328169e-07, 'epoch': 5.22}

 33%|███▎      | 121180/371472 [9:38:32<20:49:30,  3.34it/s]
 33%|███▎      | 121181/371472 [9:38:32<20:06:24,  3.46it/s]
 33%|███▎      | 121182/371472 [9:38:32<20:37:54,  3.37it/s]
 33%|███▎      | 121183/371472 [9:38:33<20:11:45,  3.44it/s]
 33%|███▎      | 121184/371472 [9:38:33<19:59:10,  3.48it/s]
 33%|███▎      | 121185/371472 [9:38:33<20:34:47,  3.38it/s]
 33%|███▎      | 121186/371472 [9:38:34<20:42:05,  3.36it/s]
 33%|███▎      | 121187/371472 [9:38:34<21:02:16,  3.30it/s]
 33%|███▎      | 121188/371472 [9:38:34<19:59:00,  3.48it/s]
 33%|███▎      | 121189/371472 [9:38:34<18:57:50,  3.67it/s]
 33%|███▎      | 121190/371472 [9:38:35<18:47:46,  3.70it/s]
 33%|███▎      | 121191/371472 [9:38:35<18:08:52,  3.83it/s]
 33%|███▎      | 121192/371472 [9:38:35<18:23:55,  3.78it/s]
 33%|███▎      | 121193/371472 [9:38:35<18:03:50,  3.85it/s]
 33%|███▎      | 121194/371472 [9:38:36<17:47:47,  3.91it/s]
 33%|███▎      | 121195/371472 [9:38:36<18:12:51,  3.82it/s]
 33%|███▎      | 121196/371472 [9:38:36<18:13:19,  3.82it/s]
 33%|███▎      | 121197/371472 [9:38:37<18:30:37,  3.76it/s]
 33%|███▎      | 121198/371472 [9:38:37<18:15:46,  3.81it/s]
 33%|███▎      | 121199/371472 [9:38:37<19:15:45,  3.61it/s]
 33%|███▎      | 121200/371472 [9:38:37<18:33:59,  3.74it/s]
                                                            
{'loss': 3.4241, 'learning_rate': 7.066840483526901e-07, 'epoch': 5.22}

 33%|███▎      | 121200/371472 [9:38:37<18:33:59,  3.74it/s]
 33%|███▎      | 121201/371472 [9:38:38<18:48:03,  3.70it/s]
 33%|███▎      | 121202/371472 [9:38:38<18:17:57,  3.80it/s]
 33%|███▎      | 121203/371472 [9:38:38<18:54:13,  3.68it/s]
 33%|███▎      | 121204/371472 [9:38:38<18:59:34,  3.66it/s]
 33%|███▎      | 121205/371472 [9:38:39<18:29:40,  3.76it/s]
 33%|███▎      | 121206/371472 [9:38:39<17:52:53,  3.89it/s]
 33%|███▎      | 121207/371472 [9:38:39<17:25:19,  3.99it/s]
 33%|███▎      | 121208/371472 [9:38:39<17:53:48,  3.88it/s]
 33%|███▎      | 121209/371472 [9:38:40<18:22:15,  3.78it/s]
 33%|███▎      | 121210/371472 [9:38:40<19:18:59,  3.60it/s]
 33%|███▎      | 121211/371472 [9:38:40<20:00:45,  3.47it/s]
 33%|███▎      | 121212/371472 [9:38:41<19:26:36,  3.58it/s]
 33%|███▎      | 121213/371472 [9:38:41<18:31:18,  3.75it/s]
 33%|███▎      | 121214/371472 [9:38:41<18:16:47,  3.80it/s]
 33%|███▎      | 121215/371472 [9:38:41<18:07:48,  3.83it/s]
 33%|███▎      | 121216/371472 [9:38:42<20:11:46,  3.44it/s]
 33%|███▎      | 121217/371472 [9:38:42<19:33:40,  3.55it/s]
 33%|███▎      | 121218/371472 [9:38:42<19:14:29,  3.61it/s]
 33%|███▎      | 121219/371472 [9:38:42<18:46:16,  3.70it/s]
 33%|███▎      | 121220/371472 [9:38:43<18:23:13,  3.78it/s]
                                                            
{'loss': 3.1637, 'learning_rate': 7.066355663772113e-07, 'epoch': 5.22}

 33%|███▎      | 121220/371472 [9:38:43<18:23:13,  3.78it/s]
 33%|███▎      | 121221/371472 [9:38:43<19:01:38,  3.65it/s]
 33%|███▎      | 121222/371472 [9:38:43<19:12:27,  3.62it/s]
 33%|███▎      | 121223/371472 [9:38:44<18:33:37,  3.75it/s]
 33%|███▎      | 121224/371472 [9:38:44<18:29:39,  3.76it/s]
 33%|███▎      | 121225/371472 [9:38:44<18:08:47,  3.83it/s]
 33%|███▎      | 121226/371472 [9:38:44<19:45:34,  3.52it/s]
 33%|███▎      | 121227/371472 [9:38:45<19:11:55,  3.62it/s]
 33%|███▎      | 121228/371472 [9:38:45<20:23:28,  3.41it/s]
 33%|███▎      | 121229/371472 [9:38:45<21:12:41,  3.28it/s]
 33%|███▎      | 121230/371472 [9:38:46<20:37:57,  3.37it/s]
 33%|███▎      | 121231/371472 [9:38:46<20:53:20,  3.33it/s]
 33%|███▎      | 121232/371472 [9:38:46<21:05:01,  3.30it/s]
 33%|███▎      | 121233/371472 [9:38:46<20:46:03,  3.35it/s]
 33%|███▎      | 121234/371472 [9:38:47<20:23:33,  3.41it/s]
 33%|███▎      | 121235/371472 [9:38:47<19:55:52,  3.49it/s]
 33%|███▎      | 121236/371472 [9:38:47<19:55:26,  3.49it/s]
 33%|███▎      | 121237/371472 [9:38:48<19:14:13,  3.61it/s]
 33%|███▎      | 121238/371472 [9:38:48<19:22:06,  3.59it/s]
 33%|███▎      | 121239/371472 [9:38:48<19:46:52,  3.51it/s]
 33%|███▎      | 121240/371472 [9:38:48<19:48:05,  3.51it/s]
                                                            
{'loss': 3.2195, 'learning_rate': 7.065870844017325e-07, 'epoch': 5.22}

 33%|███▎      | 121240/371472 [9:38:48<19:48:05,  3.51it/s]
 33%|███▎      | 121241/371472 [9:38:49<19:25:47,  3.58it/s]
 33%|███▎      | 121242/371472 [9:38:49<18:47:53,  3.70it/s]
 33%|███▎      | 121243/371472 [9:38:49<19:05:09,  3.64it/s]
 33%|███▎      | 121244/371472 [9:38:50<18:59:57,  3.66it/s]
 33%|███▎      | 121245/371472 [9:38:50<20:17:01,  3.43it/s]
 33%|███▎      | 121246/371472 [9:38:50<20:01:10,  3.47it/s]
 33%|███▎      | 121247/371472 [9:38:50<19:22:30,  3.59it/s]
 33%|███▎      | 121248/371472 [9:38:51<18:52:04,  3.68it/s]
 33%|███▎      | 121249/371472 [9:38:51<19:10:21,  3.63it/s]
 33%|███▎      | 121250/371472 [9:38:51<19:09:26,  3.63it/s]
 33%|███▎      | 121251/371472 [9:38:51<19:02:06,  3.65it/s]
 33%|███▎      | 121252/371472 [9:38:52<18:39:03,  3.73it/s]
 33%|███▎      | 121253/371472 [9:38:52<18:27:34,  3.77it/s]
 33%|███▎      | 121254/371472 [9:38:52<18:11:58,  3.82it/s]
 33%|███▎      | 121255/371472 [9:38:53<18:28:17,  3.76it/s]
 33%|███▎      | 121256/371472 [9:38:53<19:53:53,  3.49it/s]
 33%|███▎      | 121257/371472 [9:38:53<18:54:36,  3.68it/s]
 33%|███▎      | 121258/371472 [9:38:53<18:07:59,  3.83it/s]
 33%|███▎      | 121259/371472 [9:38:54<17:52:39,  3.89it/s]
 33%|███▎      | 121260/371472 [9:38:54<18:32:35,  3.75it/s]
                                                            
{'loss': 3.208, 'learning_rate': 7.065386024262534e-07, 'epoch': 5.22}

 33%|███▎      | 121260/371472 [9:38:54<18:32:35,  3.75it/s]
 33%|███▎      | 121261/371472 [9:38:54<18:25:54,  3.77it/s]
 33%|███▎      | 121262/371472 [9:38:54<17:54:15,  3.88it/s]
 33%|███▎      | 121263/371472 [9:38:55<18:35:58,  3.74it/s]
 33%|███▎      | 121264/371472 [9:38:55<18:26:40,  3.77it/s]
 33%|███▎      | 121265/371472 [9:38:55<18:25:58,  3.77it/s]
 33%|███▎      | 121266/371472 [9:38:55<18:38:15,  3.73it/s]
 33%|███▎      | 121267/371472 [9:38:56<18:13:43,  3.81it/s]
 33%|███▎      | 121268/371472 [9:38:56<18:34:31,  3.74it/s]
 33%|███▎      | 121269/371472 [9:38:56<18:19:57,  3.79it/s]
 33%|███▎      | 121270/371472 [9:38:57<18:33:10,  3.75it/s]
 33%|███▎      | 121271/371472 [9:38:57<19:05:11,  3.64it/s]
 33%|███▎      | 121272/371472 [9:38:57<20:00:26,  3.47it/s]
 33%|███▎      | 121273/371472 [9:38:57<19:05:07,  3.64it/s]
 33%|███▎      | 121274/371472 [9:38:58<19:40:04,  3.53it/s]
 33%|███▎      | 121275/371472 [9:38:58<18:56:14,  3.67it/s]
 33%|███▎      | 121276/371472 [9:38:58<18:58:23,  3.66it/s]
 33%|███▎      | 121277/371472 [9:38:58<19:02:36,  3.65it/s]
 33%|███▎      | 121278/371472 [9:38:59<18:49:54,  3.69it/s]
 33%|███▎      | 121279/371472 [9:38:59<19:55:33,  3.49it/s]
 33%|███▎      | 121280/371472 [9:38:59<19:40:46,  3.53it/s]
                                                            
{'loss': 3.3566, 'learning_rate': 7.064901204507745e-07, 'epoch': 5.22}

 33%|███▎      | 121280/371472 [9:38:59<19:40:46,  3.53it/s]
 33%|███▎      | 121281/371472 [9:39:00<19:54:31,  3.49it/s]
 33%|███▎      | 121282/371472 [9:39:00<19:08:59,  3.63it/s]
 33%|███▎      | 121283/371472 [9:39:00<18:41:06,  3.72it/s]
 33%|███▎      | 121284/371472 [9:39:00<19:29:29,  3.57it/s]
 33%|███▎      | 121285/371472 [9:39:01<18:56:01,  3.67it/s]
 33%|███▎      | 121286/371472 [9:39:01<18:34:50,  3.74it/s]
 33%|███▎      | 121287/371472 [9:39:01<18:04:02,  3.85it/s]
 33%|███▎      | 121288/371472 [9:39:01<18:16:26,  3.80it/s]
 33%|███▎      | 121289/371472 [9:39:02<18:47:04,  3.70it/s]
 33%|███▎      | 121290/371472 [9:39:02<19:04:16,  3.64it/s]
 33%|███▎      | 121291/371472 [9:39:02<19:28:43,  3.57it/s]
 33%|███▎      | 121292/371472 [9:39:03<19:21:34,  3.59it/s]
 33%|███▎      | 121293/371472 [9:39:03<18:58:35,  3.66it/s]
 33%|███▎      | 121294/371472 [9:39:03<19:18:34,  3.60it/s]
 33%|███▎      | 121295/371472 [9:39:03<18:35:49,  3.74it/s]
 33%|███▎      | 121296/371472 [9:39:04<18:48:31,  3.69it/s]
 33%|███▎      | 121297/371472 [9:39:04<18:22:56,  3.78it/s]
 33%|███▎      | 121298/371472 [9:39:04<18:52:14,  3.68it/s]
 33%|███▎      | 121299/371472 [9:39:04<18:42:39,  3.71it/s]
 33%|███▎      | 121300/371472 [9:39:05<18:16:16,  3.80it/s]
                                                            
{'loss': 3.3725, 'learning_rate': 7.064416384752957e-07, 'epoch': 5.22}

 33%|███▎      | 121300/371472 [9:39:05<18:16:16,  3.80it/s]
 33%|███▎      | 121301/371472 [9:39:05<19:16:09,  3.61it/s]
 33%|███▎      | 121302/371472 [9:39:05<20:12:52,  3.44it/s]
 33%|███▎      | 121303/371472 [9:39:06<21:35:14,  3.22it/s]
 33%|███▎      | 121304/371472 [9:39:06<20:52:09,  3.33it/s]
 33%|███▎      | 121305/371472 [9:39:06<19:51:14,  3.50it/s]
 33%|███▎      | 121306/371472 [9:39:07<19:45:27,  3.52it/s]
 33%|███▎      | 121307/371472 [9:39:07<19:44:03,  3.52it/s]
 33%|███▎      | 121308/371472 [9:39:07<19:26:23,  3.57it/s]
 33%|███▎      | 121309/371472 [9:39:07<20:14:33,  3.43it/s]
 33%|███▎      | 121310/371472 [9:39:08<19:19:16,  3.60it/s]
 33%|███▎      | 121311/371472 [9:39:08<18:44:00,  3.71it/s]
 33%|███▎      | 121312/371472 [9:39:08<18:29:33,  3.76it/s]
 33%|███▎      | 121313/371472 [9:39:09<21:00:46,  3.31it/s]
 33%|███▎      | 121314/371472 [9:39:09<20:04:37,  3.46it/s]
 33%|███▎      | 121315/371472 [9:39:09<19:27:54,  3.57it/s]
 33%|███▎      | 121316/371472 [9:39:09<21:08:32,  3.29it/s]
 33%|███▎      | 121317/371472 [9:39:10<20:28:35,  3.39it/s]
 33%|███▎      | 121318/371472 [9:39:10<20:18:41,  3.42it/s]
 33%|███▎      | 121319/371472 [9:39:10<24:01:54,  2.89it/s]
 33%|███▎      | 121320/371472 [9:39:11<22:43:41,  3.06it/s]
                                                            
{'loss': 3.3575, 'learning_rate': 7.063931564998169e-07, 'epoch': 5.23}

 33%|███▎      | 121320/371472 [9:39:11<22:43:41,  3.06it/s]
 33%|███▎      | 121321/371472 [9:39:11<22:21:59,  3.11it/s]
 33%|███▎      | 121322/371472 [9:39:11<21:59:10,  3.16it/s]
 33%|███▎      | 121323/371472 [9:39:12<21:18:27,  3.26it/s]
 33%|███▎      | 121324/371472 [9:39:12<20:34:36,  3.38it/s]
 33%|███▎      | 121325/371472 [9:39:12<22:58:13,  3.02it/s]
 33%|███▎      | 121326/371472 [9:39:13<22:08:21,  3.14it/s]
 33%|███▎      | 121327/371472 [9:39:13<22:34:13,  3.08it/s]
 33%|███▎      | 121328/371472 [9:39:13<21:56:41,  3.17it/s]
 33%|███▎      | 121329/371472 [9:39:13<20:49:23,  3.34it/s]
 33%|███▎      | 121330/371472 [9:39:14<21:16:37,  3.27it/s]
 33%|███▎      | 121331/371472 [9:39:14<20:38:33,  3.37it/s]
 33%|███▎      | 121332/371472 [9:39:14<20:02:43,  3.47it/s]
 33%|███▎      | 121333/371472 [9:39:15<19:53:30,  3.49it/s]
 33%|███▎      | 121334/371472 [9:39:15<22:16:40,  3.12it/s]
 33%|███▎      | 121335/371472 [9:39:15<21:47:15,  3.19it/s]
 33%|███▎      | 121336/371472 [9:39:16<20:32:14,  3.38it/s]
 33%|███▎      | 121337/371472 [9:39:16<21:18:35,  3.26it/s]
 33%|███▎      | 121338/371472 [9:39:16<22:13:16,  3.13it/s]
 33%|███▎      | 121339/371472 [9:39:17<21:26:05,  3.24it/s]
 33%|███▎      | 121340/371472 [9:39:17<20:09:11,  3.45it/s]
                                                            
{'loss': 3.3201, 'learning_rate': 7.063446745243379e-07, 'epoch': 5.23}

 33%|███▎      | 121340/371472 [9:39:17<20:09:11,  3.45it/s]
 33%|███▎      | 121341/371472 [9:39:17<19:12:51,  3.62it/s]
 33%|███▎      | 121342/371472 [9:39:17<20:18:04,  3.42it/s]
 33%|███▎      | 121343/371472 [9:39:18<19:41:44,  3.53it/s]
 33%|███▎      | 121344/371472 [9:39:18<19:56:24,  3.48it/s]
 33%|███▎      | 121345/371472 [9:39:18<20:47:00,  3.34it/s]
 33%|███▎      | 121346/371472 [9:39:19<19:49:53,  3.50it/s]
 33%|███▎      | 121347/371472 [9:39:19<19:45:42,  3.52it/s]
 33%|███▎      | 121348/371472 [9:39:19<20:27:18,  3.40it/s]
 33%|███▎      | 121349/371472 [9:39:19<20:08:56,  3.45it/s]
 33%|███▎      | 121350/371472 [9:39:20<19:10:11,  3.62it/s]
 33%|███▎      | 121351/371472 [9:39:20<22:07:38,  3.14it/s]
 33%|███▎      | 121352/371472 [9:39:20<21:34:54,  3.22it/s]
 33%|███▎      | 121353/371472 [9:39:21<21:22:13,  3.25it/s]
 33%|███▎      | 121354/371472 [9:39:21<20:50:01,  3.33it/s]
 33%|███▎      | 121355/371472 [9:39:21<19:36:57,  3.54it/s]
 33%|███▎      | 121356/371472 [9:39:21<19:56:00,  3.49it/s]
 33%|███▎      | 121357/371472 [9:39:22<19:24:59,  3.58it/s]
 33%|███▎      | 121358/371472 [9:39:22<18:45:23,  3.70it/s]
 33%|███▎      | 121359/371472 [9:39:22<18:58:33,  3.66it/s]
 33%|███▎      | 121360/371472 [9:39:23<18:49:08,  3.69it/s]
                                                            
{'loss': 3.2648, 'learning_rate': 7.06296192548859e-07, 'epoch': 5.23}

 33%|███▎      | 121360/371472 [9:39:23<18:49:08,  3.69it/s]
 33%|███▎      | 121361/371472 [9:39:23<19:18:01,  3.60it/s]
 33%|███▎      | 121362/371472 [9:39:23<18:24:29,  3.77it/s]
 33%|███▎      | 121363/371472 [9:39:23<18:34:41,  3.74it/s]
 33%|███▎      | 121364/371472 [9:39:24<20:13:46,  3.43it/s]
 33%|███▎      | 121365/371472 [9:39:24<19:55:24,  3.49it/s]
 33%|███▎      | 121366/371472 [9:39:24<19:44:46,  3.52it/s]
 33%|███▎      | 121367/371472 [9:39:25<21:35:39,  3.22it/s]
 33%|███▎      | 121368/371472 [9:39:25<20:28:23,  3.39it/s]
 33%|███▎      | 121369/371472 [9:39:25<19:49:48,  3.50it/s]
 33%|███▎      | 121370/371472 [9:39:25<20:04:14,  3.46it/s]
 33%|███▎      | 121371/371472 [9:39:26<20:23:20,  3.41it/s]
 33%|███▎      | 121372/371472 [9:39:26<20:09:36,  3.45it/s]
 33%|███▎      | 121373/371472 [9:39:26<19:36:27,  3.54it/s]
 33%|███▎      | 121374/371472 [9:39:27<20:05:32,  3.46it/s]
 33%|███▎      | 121375/371472 [9:39:27<19:09:56,  3.62it/s]
 33%|███▎      | 121376/371472 [9:39:27<18:34:10,  3.74it/s]
 33%|███▎      | 121377/371472 [9:39:27<19:04:23,  3.64it/s]
 33%|███▎      | 121378/371472 [9:39:28<18:31:10,  3.75it/s]
 33%|███▎      | 121379/371472 [9:39:28<18:47:44,  3.70it/s]
 33%|███▎      | 121380/371472 [9:39:28<19:24:03,  3.58it/s]
                                                            
{'loss': 3.186, 'learning_rate': 7.062477105733802e-07, 'epoch': 5.23}

 33%|███▎      | 121380/371472 [9:39:28<19:24:03,  3.58it/s]
 33%|███▎      | 121381/371472 [9:39:28<18:59:01,  3.66it/s]
 33%|███▎      | 121382/371472 [9:39:29<18:19:12,  3.79it/s]
 33%|███▎      | 121383/371472 [9:39:29<18:46:46,  3.70it/s]
 33%|███▎      | 121384/371472 [9:39:29<19:09:42,  3.63it/s]
 33%|███▎      | 121385/371472 [9:39:30<19:38:46,  3.54it/s]
 33%|███▎      | 121386/371472 [9:39:30<19:19:13,  3.60it/s]
 33%|███▎      | 121387/371472 [9:39:30<19:28:49,  3.57it/s]
 33%|███▎      | 121388/371472 [9:39:30<19:22:23,  3.59it/s]
 33%|███▎      | 121389/371472 [9:39:31<20:02:08,  3.47it/s]
 33%|███▎      | 121390/371472 [9:39:31<19:41:10,  3.53it/s]
 33%|███▎      | 121391/371472 [9:39:31<19:42:20,  3.53it/s]
 33%|███▎      | 121392/371472 [9:39:32<19:15:49,  3.61it/s]
 33%|███▎      | 121393/371472 [9:39:32<18:37:15,  3.73it/s]
 33%|███▎      | 121394/371472 [9:39:32<18:16:29,  3.80it/s]
 33%|███▎      | 121395/371472 [9:39:32<18:40:59,  3.72it/s]
 33%|███▎      | 121396/371472 [9:39:33<18:43:47,  3.71it/s]
 33%|███▎      | 121397/371472 [9:39:33<18:28:51,  3.76it/s]
 33%|███▎      | 121398/371472 [9:39:33<18:10:45,  3.82it/s]
 33%|███▎      | 121399/371472 [9:39:33<18:32:08,  3.75it/s]
 33%|███▎      | 121400/371472 [9:39:34<18:49:16,  3.69it/s]
                                                            
{'loss': 3.3726, 'learning_rate': 7.061992285979013e-07, 'epoch': 5.23}

 33%|███▎      | 121400/371472 [9:39:34<18:49:16,  3.69it/s]
 33%|███▎      | 121401/371472 [9:39:34<18:55:44,  3.67it/s]
 33%|███▎      | 121402/371472 [9:39:34<18:15:28,  3.80it/s]
 33%|███▎      | 121403/371472 [9:39:34<18:01:33,  3.85it/s]
 33%|███▎      | 121404/371472 [9:39:35<17:57:41,  3.87it/s]
 33%|███▎      | 121405/371472 [9:39:35<17:53:55,  3.88it/s]
 33%|███▎      | 121406/371472 [9:39:35<17:23:23,  3.99it/s]
 33%|███▎      | 121407/371472 [9:39:35<17:16:23,  4.02it/s]
 33%|███▎      | 121408/371472 [9:39:36<17:21:32,  4.00it/s]
 33%|███▎      | 121409/371472 [9:39:36<17:02:10,  4.08it/s]
 33%|███▎      | 121410/371472 [9:39:36<18:18:51,  3.79it/s]
 33%|███▎      | 121411/371472 [9:39:36<18:10:58,  3.82it/s]
 33%|███▎      | 121412/371472 [9:39:37<18:57:03,  3.67it/s]
 33%|███▎      | 121413/371472 [9:39:37<19:05:56,  3.64it/s]
 33%|███▎      | 121414/371472 [9:39:37<20:32:57,  3.38it/s]
 33%|███▎      | 121415/371472 [9:39:38<19:25:05,  3.58it/s]
 33%|███▎      | 121416/371472 [9:39:38<18:24:00,  3.77it/s]
 33%|███▎      | 121417/371472 [9:39:38<18:05:43,  3.84it/s]
 33%|███▎      | 121418/371472 [9:39:38<19:25:27,  3.58it/s]
 33%|███▎      | 121419/371472 [9:39:39<19:40:54,  3.53it/s]
 33%|███▎      | 121420/371472 [9:39:39<20:26:16,  3.40it/s]
                                                            
{'loss': 3.2674, 'learning_rate': 7.061507466224223e-07, 'epoch': 5.23}

 33%|███▎      | 121420/371472 [9:39:39<20:26:16,  3.40it/s]
 33%|███▎      | 121421/371472 [9:39:39<19:45:02,  3.52it/s]
 33%|███▎      | 121422/371472 [9:39:40<18:49:42,  3.69it/s]
 33%|███▎      | 121423/371472 [9:39:40<19:43:04,  3.52it/s]
 33%|███▎      | 121424/371472 [9:39:40<20:12:58,  3.44it/s]
 33%|███▎      | 121425/371472 [9:39:40<20:13:10,  3.44it/s]
 33%|███▎      | 121426/371472 [9:39:41<20:06:34,  3.45it/s]
 33%|███▎      | 121427/371472 [9:39:41<20:46:06,  3.34it/s]
 33%|███▎      | 121428/371472 [9:39:41<21:22:10,  3.25it/s]
 33%|███▎      | 121429/371472 [9:39:42<22:08:21,  3.14it/s]
 33%|███▎      | 121430/371472 [9:39:42<22:39:02,  3.07it/s]
 33%|███▎      | 121431/371472 [9:39:42<21:31:09,  3.23it/s]
 33%|███▎      | 121432/371472 [9:39:43<20:55:18,  3.32it/s]
 33%|███▎      | 121433/371472 [9:39:43<21:30:40,  3.23it/s]
 33%|███▎      | 121434/371472 [9:39:43<21:26:02,  3.24it/s]
 33%|███▎      | 121435/371472 [9:39:44<20:25:43,  3.40it/s]
 33%|███▎      | 121436/371472 [9:39:44<19:34:35,  3.55it/s]
 33%|███▎      | 121437/371472 [9:39:44<21:11:06,  3.28it/s]
 33%|███▎      | 121438/371472 [9:39:44<19:52:33,  3.49it/s]
 33%|███▎      | 121439/371472 [9:39:45<19:19:55,  3.59it/s]
 33%|███▎      | 121440/371472 [9:39:45<18:34:02,  3.74it/s]
                                                            
{'loss': 3.3961, 'learning_rate': 7.061022646469434e-07, 'epoch': 5.23}

 33%|███▎      | 121440/371472 [9:39:45<18:34:02,  3.74it/s]
 33%|███▎      | 121441/371472 [9:39:45<18:48:49,  3.69it/s]
 33%|███▎      | 121442/371472 [9:39:46<20:54:20,  3.32it/s]
 33%|███▎      | 121443/371472 [9:39:46<20:24:00,  3.40it/s]
 33%|███▎      | 121444/371472 [9:39:46<19:58:46,  3.48it/s]
 33%|███▎      | 121445/371472 [9:39:46<19:49:39,  3.50it/s]
 33%|███▎      | 121446/371472 [9:39:47<19:03:47,  3.64it/s]
 33%|███▎      | 121447/371472 [9:39:47<20:00:28,  3.47it/s]
 33%|███▎      | 121448/371472 [9:39:47<20:00:54,  3.47it/s]
 33%|███▎      | 121449/371472 [9:39:47<19:29:41,  3.56it/s]
 33%|███▎      | 121450/371472 [9:39:48<19:08:15,  3.63it/s]
 33%|███▎      | 121451/371472 [9:39:48<18:49:13,  3.69it/s]
 33%|███▎      | 121452/371472 [9:39:48<19:15:07,  3.61it/s]
 33%|███▎      | 121453/371472 [9:39:49<18:49:10,  3.69it/s]
 33%|███▎      | 121454/371472 [9:39:49<18:54:01,  3.67it/s]
 33%|███▎      | 121455/371472 [9:39:49<19:40:37,  3.53it/s]
 33%|███▎      | 121456/371472 [9:39:49<19:49:39,  3.50it/s]
 33%|███▎      | 121457/371472 [9:39:50<19:18:00,  3.60it/s]
 33%|███▎      | 121458/371472 [9:39:50<18:38:46,  3.72it/s]
 33%|███▎      | 121459/371472 [9:39:50<18:20:14,  3.79it/s]
 33%|███▎      | 121460/371472 [9:39:51<20:26:16,  3.40it/s]
                                                            
{'loss': 3.0819, 'learning_rate': 7.060537826714646e-07, 'epoch': 5.23}

 33%|███▎      | 121460/371472 [9:39:51<20:26:16,  3.40it/s]
 33%|███▎      | 121461/371472 [9:39:51<20:23:33,  3.41it/s]
 33%|███▎      | 121462/371472 [9:39:51<19:13:05,  3.61it/s]
 33%|███▎      | 121463/371472 [9:39:51<18:35:45,  3.73it/s]
 33%|███▎      | 121464/371472 [9:39:52<19:01:27,  3.65it/s]
 33%|███▎      | 121465/371472 [9:39:52<19:01:07,  3.65it/s]
 33%|███▎      | 121466/371472 [9:39:52<18:25:49,  3.77it/s]
 33%|███▎      | 121467/371472 [9:39:52<20:38:47,  3.36it/s]
 33%|███▎      | 121468/371472 [9:39:53<20:10:30,  3.44it/s]
 33%|███▎      | 121469/371472 [9:39:53<21:59:39,  3.16it/s]
 33%|███▎      | 121470/371472 [9:39:54<24:13:45,  2.87it/s]
 33%|███▎      | 121471/371472 [9:39:54<23:11:21,  2.99it/s]
 33%|███▎      | 121472/371472 [9:39:54<22:50:17,  3.04it/s]
 33%|███▎      | 121473/371472 [9:39:54<21:26:31,  3.24it/s]
 33%|███▎      | 121474/371472 [9:39:55<20:16:21,  3.43it/s]
 33%|███▎      | 121475/371472 [9:39:55<20:20:21,  3.41it/s]
 33%|███▎      | 121476/371472 [9:39:55<20:22:12,  3.41it/s]
 33%|███▎      | 121477/371472 [9:39:56<19:41:15,  3.53it/s]
 33%|███▎      | 121478/371472 [9:39:56<20:42:41,  3.35it/s]
 33%|███▎      | 121479/371472 [9:39:56<19:53:53,  3.49it/s]
 33%|███▎      | 121480/371472 [9:39:56<19:14:04,  3.61it/s]
                                                            
{'loss': 3.3016, 'learning_rate': 7.060053006959857e-07, 'epoch': 5.23}

 33%|███▎      | 121480/371472 [9:39:56<19:14:04,  3.61it/s]
 33%|███▎      | 121481/371472 [9:39:57<19:45:27,  3.51it/s]
 33%|███▎      | 121482/371472 [9:39:57<19:50:45,  3.50it/s]
 33%|███▎      | 121483/371472 [9:39:57<19:20:47,  3.59it/s]
 33%|███▎      | 121484/371472 [9:39:58<19:33:05,  3.55it/s]
 33%|███▎      | 121485/371472 [9:39:58<21:20:07,  3.25it/s]
 33%|███▎      | 121486/371472 [9:39:58<20:45:59,  3.34it/s]
 33%|███▎      | 121487/371472 [9:39:59<21:48:38,  3.18it/s]
 33%|███▎      | 121488/371472 [9:39:59<20:44:23,  3.35it/s]
 33%|███▎      | 121489/371472 [9:39:59<21:48:56,  3.18it/s]
 33%|███▎      | 121490/371472 [9:39:59<21:29:21,  3.23it/s]
 33%|███▎      | 121491/371472 [9:40:00<20:12:54,  3.43it/s]
 33%|███▎      | 121492/371472 [9:40:00<19:27:41,  3.57it/s]
 33%|███▎      | 121493/371472 [9:40:00<20:18:00,  3.42it/s]
 33%|███▎      | 121494/371472 [9:40:01<19:51:17,  3.50it/s]
 33%|███▎      | 121495/371472 [9:40:01<19:44:05,  3.52it/s]
 33%|███▎      | 121496/371472 [9:40:01<19:13:24,  3.61it/s]
 33%|███▎      | 121497/371472 [9:40:01<19:01:01,  3.65it/s]
 33%|███▎      | 121498/371472 [9:40:02<19:26:28,  3.57it/s]
 33%|███▎      | 121499/371472 [9:40:02<18:48:12,  3.69it/s]
 33%|███▎      | 121500/371472 [9:40:02<18:45:30,  3.70it/s]
                                                            
{'loss': 3.2763, 'learning_rate': 7.059568187205068e-07, 'epoch': 5.23}

 33%|███▎      | 121500/371472 [9:40:02<18:45:30,  3.70it/s]
 33%|███▎      | 121501/371472 [9:40:03<20:25:11,  3.40it/s]
 33%|███▎      | 121502/371472 [9:40:03<20:34:32,  3.37it/s]
 33%|███▎      | 121503/371472 [9:40:03<20:35:26,  3.37it/s]
 33%|███▎      | 121504/371472 [9:40:03<19:47:42,  3.51it/s]
 33%|███▎      | 121505/371472 [9:40:04<19:13:34,  3.61it/s]
 33%|███▎      | 121506/371472 [9:40:04<18:58:24,  3.66it/s]
 33%|███▎      | 121507/371472 [9:40:04<19:36:06,  3.54it/s]
 33%|███▎      | 121508/371472 [9:40:04<19:28:12,  3.57it/s]
 33%|███▎      | 121509/371472 [9:40:05<18:51:44,  3.68it/s]
 33%|███▎      | 121510/371472 [9:40:05<19:54:58,  3.49it/s]
 33%|███▎      | 121511/371472 [9:40:05<20:10:18,  3.44it/s]
 33%|███▎      | 121512/371472 [9:40:06<19:44:12,  3.52it/s]
 33%|███▎      | 121513/371472 [9:40:06<19:37:51,  3.54it/s]
 33%|███▎      | 121514/371472 [9:40:06<18:55:38,  3.67it/s]
 33%|███▎      | 121515/371472 [9:40:06<18:22:33,  3.78it/s]
 33%|███▎      | 121516/371472 [9:40:07<18:41:25,  3.71it/s]
 33%|███▎      | 121517/371472 [9:40:07<21:08:29,  3.28it/s]
 33%|███▎      | 121518/371472 [9:40:07<19:52:31,  3.49it/s]
 33%|███▎      | 121519/371472 [9:40:08<18:54:10,  3.67it/s]
 33%|███▎      | 121520/371472 [9:40:08<18:36:18,  3.73it/s]
                                                            
{'loss': 3.2682, 'learning_rate': 7.059083367450278e-07, 'epoch': 5.23}

 33%|███▎      | 121520/371472 [9:40:08<18:36:18,  3.73it/s]
 33%|███▎      | 121521/371472 [9:40:08<18:00:19,  3.86it/s]
 33%|███▎      | 121522/371472 [9:40:08<18:52:54,  3.68it/s]
 33%|███▎      | 121523/371472 [9:40:09<18:43:53,  3.71it/s]
 33%|███▎      | 121524/371472 [9:40:09<18:56:43,  3.66it/s]
 33%|███▎      | 121525/371472 [9:40:09<19:11:33,  3.62it/s]
 33%|███▎      | 121526/371472 [9:40:09<19:13:17,  3.61it/s]
 33%|███▎      | 121527/371472 [9:40:10<18:56:16,  3.67it/s]
 33%|███▎      | 121528/371472 [9:40:10<19:17:34,  3.60it/s]
 33%|███▎      | 121529/371472 [9:40:10<19:25:06,  3.58it/s]
 33%|███▎      | 121530/371472 [9:40:11<18:59:25,  3.66it/s]
 33%|███▎      | 121531/371472 [9:40:11<18:16:17,  3.80it/s]
 33%|███▎      | 121532/371472 [9:40:11<18:24:25,  3.77it/s]
 33%|███▎      | 121533/371472 [9:40:11<18:36:50,  3.73it/s]
 33%|███▎      | 121534/371472 [9:40:12<18:48:36,  3.69it/s]
 33%|███▎      | 121535/371472 [9:40:12<18:24:54,  3.77it/s]
 33%|███▎      | 121536/371472 [9:40:12<19:00:17,  3.65it/s]
 33%|███▎      | 121537/371472 [9:40:12<18:59:38,  3.66it/s]
 33%|███▎      | 121538/371472 [9:40:13<18:31:35,  3.75it/s]
 33%|███▎      | 121539/371472 [9:40:13<19:02:26,  3.65it/s]
 33%|███▎      | 121540/371472 [9:40:13<18:54:27,  3.67it/s]
                                                            
{'loss': 3.3309, 'learning_rate': 7.05859854769549e-07, 'epoch': 5.23}

 33%|███▎      | 121540/371472 [9:40:13<18:54:27,  3.67it/s]
 33%|███▎      | 121541/371472 [9:40:14<20:34:48,  3.37it/s]
 33%|███▎      | 121542/371472 [9:40:14<20:07:59,  3.45it/s]
 33%|███▎      | 121543/371472 [9:40:14<19:59:12,  3.47it/s]
 33%|███▎      | 121544/371472 [9:40:14<20:06:51,  3.45it/s]
 33%|███▎      | 121545/371472 [9:40:15<20:54:58,  3.32it/s]
 33%|███▎      | 121546/371472 [9:40:15<20:33:52,  3.38it/s]
 33%|███▎      | 121547/371472 [9:40:15<20:21:20,  3.41it/s]
 33%|███▎      | 121548/371472 [9:40:16<19:27:53,  3.57it/s]
 33%|███▎      | 121549/371472 [9:40:16<19:16:14,  3.60it/s]
 33%|███▎      | 121550/371472 [9:40:16<19:11:36,  3.62it/s]
 33%|███▎      | 121551/371472 [9:40:16<19:28:39,  3.56it/s]
 33%|███▎      | 121552/371472 [9:40:17<19:57:07,  3.48it/s]
 33%|███▎      | 121553/371472 [9:40:17<18:53:06,  3.68it/s]
 33%|███▎      | 121554/371472 [9:40:17<18:48:24,  3.69it/s]
 33%|███▎      | 121555/371472 [9:40:18<19:46:12,  3.51it/s]
 33%|███▎      | 121556/371472 [9:40:18<19:28:26,  3.56it/s]
 33%|███▎      | 121557/371472 [9:40:18<18:36:41,  3.73it/s]
 33%|███▎      | 121558/371472 [9:40:18<19:14:00,  3.61it/s]
 33%|███▎      | 121559/371472 [9:40:19<18:48:59,  3.69it/s]
 33%|███▎      | 121560/371472 [9:40:19<18:29:31,  3.75it/s]
                                                            
{'loss': 3.2571, 'learning_rate': 7.058113727940701e-07, 'epoch': 5.24}

 33%|███▎      | 121560/371472 [9:40:19<18:29:31,  3.75it/s]
 33%|███▎      | 121561/371472 [9:40:19<19:12:48,  3.61it/s]
 33%|███▎      | 121562/371472 [9:40:19<20:18:59,  3.42it/s]
 33%|███▎      | 121563/371472 [9:40:20<19:16:13,  3.60it/s]
 33%|███▎      | 121564/371472 [9:40:20<19:00:14,  3.65it/s]
 33%|███▎      | 121565/371472 [9:40:20<20:02:17,  3.46it/s]
 33%|███▎      | 121566/371472 [9:40:21<19:52:47,  3.49it/s]
 33%|███▎      | 121567/371472 [9:40:21<19:31:55,  3.55it/s]
 33%|███▎      | 121568/371472 [9:40:21<19:37:02,  3.54it/s]
 33%|███▎      | 121569/371472 [9:40:21<19:18:27,  3.60it/s]
 33%|███▎      | 121570/371472 [9:40:22<20:18:36,  3.42it/s]
 33%|███▎      | 121571/371472 [9:40:22<19:32:58,  3.55it/s]
 33%|███▎      | 121572/371472 [9:40:22<19:24:39,  3.58it/s]
 33%|███▎      | 121573/371472 [9:40:23<19:13:15,  3.61it/s]
 33%|███▎      | 121574/371472 [9:40:23<19:00:39,  3.65it/s]
 33%|███▎      | 121575/371472 [9:40:23<19:23:10,  3.58it/s]
 33%|███▎      | 121576/371472 [9:40:23<19:07:20,  3.63it/s]
 33%|███▎      | 121577/371472 [9:40:24<19:06:00,  3.63it/s]
 33%|███▎      | 121578/371472 [9:40:24<19:16:24,  3.60it/s]
 33%|███▎      | 121579/371472 [9:40:24<19:08:49,  3.63it/s]
 33%|███▎      | 121580/371472 [9:40:24<18:30:15,  3.75it/s]
                                                            
{'loss': 3.2318, 'learning_rate': 7.057628908185912e-07, 'epoch': 5.24}

 33%|███▎      | 121580/371472 [9:40:24<18:30:15,  3.75it/s]
 33%|███▎      | 121581/371472 [9:40:25<18:32:54,  3.74it/s]
 33%|███▎      | 121582/371472 [9:40:25<19:59:38,  3.47it/s]
 33%|███▎      | 121583/371472 [9:40:25<18:56:48,  3.66it/s]
 33%|███▎      | 121584/371472 [9:40:26<20:15:00,  3.43it/s]
 33%|███▎      | 121585/371472 [9:40:26<21:01:59,  3.30it/s]
 33%|███▎      | 121586/371472 [9:40:26<20:54:27,  3.32it/s]
 33%|███▎      | 121587/371472 [9:40:27<20:24:05,  3.40it/s]
 33%|███▎      | 121588/371472 [9:40:27<20:39:26,  3.36it/s]
 33%|███▎      | 121589/371472 [9:40:27<20:06:38,  3.45it/s]
 33%|███▎      | 121590/371472 [9:40:27<19:08:58,  3.62it/s]
 33%|███▎      | 121591/371472 [9:40:28<19:09:50,  3.62it/s]
 33%|███▎      | 121592/371472 [9:40:28<18:31:54,  3.75it/s]
 33%|███▎      | 121593/371472 [9:40:28<18:39:53,  3.72it/s]
 33%|███▎      | 121594/371472 [9:40:28<18:26:36,  3.76it/s]
 33%|███▎      | 121595/371472 [9:40:29<18:24:23,  3.77it/s]
 33%|███▎      | 121596/371472 [9:40:29<18:33:32,  3.74it/s]
 33%|███▎      | 121597/371472 [9:40:29<18:36:47,  3.73it/s]
 33%|███▎      | 121598/371472 [9:40:30<19:16:22,  3.60it/s]
 33%|███▎      | 121599/371472 [9:40:30<19:04:16,  3.64it/s]
 33%|███▎      | 121600/371472 [9:40:30<18:35:35,  3.73it/s]
                                                            
{'loss': 3.1048, 'learning_rate': 7.057144088431123e-07, 'epoch': 5.24}

 33%|███▎      | 121600/371472 [9:40:30<18:35:35,  3.73it/s]
 33%|███▎      | 121601/371472 [9:40:30<19:37:20,  3.54it/s]
 33%|███▎      | 121602/371472 [9:40:31<19:00:46,  3.65it/s]
 33%|███▎      | 121603/371472 [9:40:31<19:07:38,  3.63it/s]
 33%|███▎      | 121604/371472 [9:40:31<21:19:52,  3.25it/s]
 33%|███▎      | 121605/371472 [9:40:32<21:52:56,  3.17it/s]
 33%|███▎      | 121606/371472 [9:40:32<21:29:53,  3.23it/s]
 33%|███▎      | 121607/371472 [9:40:32<19:59:12,  3.47it/s]
 33%|███▎      | 121608/371472 [9:40:32<19:33:37,  3.55it/s]
 33%|███▎      | 121609/371472 [9:40:33<19:35:42,  3.54it/s]
 33%|███▎      | 121610/371472 [9:40:33<18:52:00,  3.68it/s]
 33%|███▎      | 121611/371472 [9:40:33<18:36:15,  3.73it/s]
 33%|███▎      | 121612/371472 [9:40:33<18:58:37,  3.66it/s]
 33%|███▎      | 121613/371472 [9:40:34<20:13:42,  3.43it/s]
 33%|███▎      | 121614/371472 [9:40:34<19:40:13,  3.53it/s]
 33%|███▎      | 121615/371472 [9:40:34<18:47:58,  3.69it/s]
 33%|███▎      | 121616/371472 [9:40:35<18:49:13,  3.69it/s]
 33%|███▎      | 121617/371472 [9:40:35<18:42:04,  3.71it/s]
 33%|███▎      | 121618/371472 [9:40:35<18:52:05,  3.68it/s]
 33%|███▎      | 121619/371472 [9:40:35<18:41:08,  3.71it/s]
 33%|███▎      | 121620/371472 [9:40:36<20:22:09,  3.41it/s]
                                                            
{'loss': 3.2561, 'learning_rate': 7.056659268676335e-07, 'epoch': 5.24}

 33%|███▎      | 121620/371472 [9:40:36<20:22:09,  3.41it/s]
 33%|███▎      | 121621/371472 [9:40:36<19:32:31,  3.55it/s]
 33%|███▎      | 121622/371472 [9:40:36<19:20:07,  3.59it/s]
 33%|███▎      | 121623/371472 [9:40:37<20:53:58,  3.32it/s]
 33%|███▎      | 121624/371472 [9:40:37<20:42:51,  3.35it/s]
 33%|███▎      | 121625/371472 [9:40:37<20:50:37,  3.33it/s]
 33%|███▎      | 121626/371472 [9:40:38<21:06:26,  3.29it/s]
 33%|███▎      | 121627/371472 [9:40:38<21:21:47,  3.25it/s]
 33%|███▎      | 121628/371472 [9:40:38<20:29:05,  3.39it/s]
 33%|███▎      | 121629/371472 [9:40:38<21:00:07,  3.30it/s]
 33%|███▎      | 121630/371472 [9:40:39<20:10:54,  3.44it/s]
 33%|███▎      | 121631/371472 [9:40:39<19:15:50,  3.60it/s]
 33%|███▎      | 121632/371472 [9:40:39<18:46:48,  3.70it/s]
 33%|███▎      | 121633/371472 [9:40:39<18:05:56,  3.83it/s]
 33%|███▎      | 121634/371472 [9:40:40<20:16:27,  3.42it/s]
 33%|███▎      | 121635/371472 [9:40:40<19:56:36,  3.48it/s]
 33%|███▎      | 121636/371472 [9:40:40<19:40:46,  3.53it/s]
 33%|███▎      | 121637/371472 [9:40:41<19:32:30,  3.55it/s]
 33%|███▎      | 121638/371472 [9:40:41<18:30:01,  3.75it/s]
 33%|███▎      | 121639/371472 [9:40:41<17:54:59,  3.87it/s]
 33%|███▎      | 121640/371472 [9:40:41<17:42:45,  3.92it/s]
                                                            
{'loss': 3.3285, 'learning_rate': 7.056174448921545e-07, 'epoch': 5.24}

 33%|███▎      | 121640/371472 [9:40:41<17:42:45,  3.92it/s]
 33%|███▎      | 121641/371472 [9:40:42<19:46:42,  3.51it/s]
 33%|███▎      | 121642/371472 [9:40:42<20:19:02,  3.42it/s]
 33%|███▎      | 121643/371472 [9:40:42<19:41:47,  3.52it/s]
 33%|███▎      | 121644/371472 [9:40:43<20:27:07,  3.39it/s]
 33%|███▎      | 121645/371472 [9:40:43<20:21:09,  3.41it/s]
 33%|███▎      | 121646/371472 [9:40:43<20:28:08,  3.39it/s]
 33%|███▎      | 121647/371472 [9:40:44<20:46:38,  3.34it/s]
 33%|███▎      | 121648/371472 [9:40:44<20:24:07,  3.40it/s]
 33%|███▎      | 121649/371472 [9:40:44<19:39:30,  3.53it/s]
 33%|███▎      | 121650/371472 [9:40:44<18:49:49,  3.69it/s]
 33%|███▎      | 121651/371472 [9:40:45<19:39:36,  3.53it/s]
 33%|███▎      | 121652/371472 [9:40:45<19:57:43,  3.48it/s]
 33%|███▎      | 121653/371472 [9:40:45<20:32:40,  3.38it/s]
 33%|███▎      | 121654/371472 [9:40:45<20:01:12,  3.47it/s]
 33%|███▎      | 121655/371472 [9:40:46<19:31:38,  3.55it/s]
 33%|███▎      | 121656/371472 [9:40:46<19:35:49,  3.54it/s]
 33%|███▎      | 121657/371472 [9:40:46<19:42:50,  3.52it/s]
 33%|███▎      | 121658/371472 [9:40:47<18:53:21,  3.67it/s]
 33%|███▎      | 121659/371472 [9:40:47<20:24:18,  3.40it/s]
 33%|███▎      | 121660/371472 [9:40:47<19:23:04,  3.58it/s]
                                                            
{'loss': 3.1627, 'learning_rate': 7.055689629166756e-07, 'epoch': 5.24}

 33%|███▎      | 121660/371472 [9:40:47<19:23:04,  3.58it/s]
 33%|███▎      | 121661/371472 [9:40:47<19:10:55,  3.62it/s]
 33%|███▎      | 121662/371472 [9:40:48<18:52:45,  3.68it/s]
 33%|███▎      | 121663/371472 [9:40:48<18:48:40,  3.69it/s]
 33%|███▎      | 121664/371472 [9:40:48<18:23:55,  3.77it/s]
 33%|███▎      | 121665/371472 [9:40:48<18:10:23,  3.82it/s]
 33%|███▎      | 121666/371472 [9:40:49<19:31:31,  3.55it/s]
 33%|███▎      | 121667/371472 [9:40:49<19:29:14,  3.56it/s]
 33%|███▎      | 121668/371472 [9:40:49<19:06:05,  3.63it/s]
 33%|███▎      | 121669/371472 [9:40:50<18:57:19,  3.66it/s]
 33%|███▎      | 121670/371472 [9:40:50<20:13:05,  3.43it/s]
 33%|███▎      | 121671/371472 [9:40:50<20:11:46,  3.44it/s]
 33%|███▎      | 121672/371472 [9:40:50<19:17:54,  3.60it/s]
 33%|███▎      | 121673/371472 [9:40:51<18:25:58,  3.76it/s]
 33%|███▎      | 121674/371472 [9:40:51<19:19:23,  3.59it/s]
 33%|███▎      | 121675/371472 [9:40:51<18:34:48,  3.73it/s]
 33%|███▎      | 121676/371472 [9:40:52<18:31:31,  3.75it/s]
 33%|███▎      | 121677/371472 [9:40:52<18:49:01,  3.69it/s]
 33%|███▎      | 121678/371472 [9:40:52<18:26:53,  3.76it/s]
 33%|███▎      | 121679/371472 [9:40:52<18:13:01,  3.81it/s]
 33%|███▎      | 121680/371472 [9:40:53<19:34:33,  3.54it/s]
                                                            
{'loss': 3.2619, 'learning_rate': 7.055204809411967e-07, 'epoch': 5.24}

 33%|███▎      | 121680/371472 [9:40:53<19:34:33,  3.54it/s]
 33%|███▎      | 121681/371472 [9:40:53<19:54:59,  3.48it/s]
 33%|███▎      | 121682/371472 [9:40:53<20:19:42,  3.41it/s]
 33%|███▎      | 121683/371472 [9:40:53<19:09:52,  3.62it/s]
 33%|███▎      | 121684/371472 [9:40:54<18:56:52,  3.66it/s]
 33%|███▎      | 121685/371472 [9:40:54<18:37:35,  3.73it/s]
 33%|███▎      | 121686/371472 [9:40:54<18:53:10,  3.67it/s]
 33%|███▎      | 121687/371472 [9:40:55<18:05:22,  3.84it/s]
 33%|███▎      | 121688/371472 [9:40:55<18:52:16,  3.68it/s]
 33%|███▎      | 121689/371472 [9:40:55<18:33:14,  3.74it/s]
 33%|███▎      | 121690/371472 [9:40:55<19:57:58,  3.48it/s]
 33%|███▎      | 121691/371472 [9:40:56<21:44:16,  3.19it/s]
 33%|███▎      | 121692/371472 [9:40:56<20:35:32,  3.37it/s]
 33%|███▎      | 121693/371472 [9:40:56<19:31:24,  3.55it/s]
 33%|███▎      | 121694/371472 [9:40:57<19:53:29,  3.49it/s]
 33%|███▎      | 121695/371472 [9:40:57<19:09:54,  3.62it/s]
 33%|███▎      | 121696/371472 [9:40:57<18:52:04,  3.68it/s]
 33%|███▎      | 121697/371472 [9:40:57<19:53:06,  3.49it/s]
 33%|███▎      | 121698/371472 [9:40:58<21:03:16,  3.30it/s]
 33%|███▎      | 121699/371472 [9:40:58<20:24:48,  3.40it/s]
 33%|███▎      | 121700/371472 [9:40:58<20:10:12,  3.44it/s]
                                                            
{'loss': 3.1182, 'learning_rate': 7.054719989657179e-07, 'epoch': 5.24}

 33%|███▎      | 121700/371472 [9:40:58<20:10:12,  3.44it/s]
 33%|███▎      | 121701/371472 [9:40:59<20:32:11,  3.38it/s]
 33%|███▎      | 121702/371472 [9:40:59<20:10:56,  3.44it/s]
 33%|███▎      | 121703/371472 [9:40:59<23:08:56,  3.00it/s]
 33%|███▎      | 121704/371472 [9:41:00<21:25:19,  3.24it/s]
 33%|███▎      | 121705/371472 [9:41:00<21:22:28,  3.25it/s]
 33%|███▎      | 121706/371472 [9:41:00<21:07:08,  3.29it/s]
 33%|███▎      | 121707/371472 [9:41:00<20:55:54,  3.31it/s]
 33%|███▎      | 121708/371472 [9:41:01<20:39:11,  3.36it/s]
 33%|███▎      | 121709/371472 [9:41:01<19:52:52,  3.49it/s]
 33%|███▎      | 121710/371472 [9:41:01<20:45:29,  3.34it/s]
 33%|███▎      | 121711/371472 [9:41:02<21:05:05,  3.29it/s]
 33%|███▎      | 121712/371472 [9:41:02<20:05:51,  3.45it/s]
 33%|███▎      | 121713/371472 [9:41:02<19:45:01,  3.51it/s]
 33%|███▎      | 121714/371472 [9:41:02<19:24:23,  3.57it/s]
 33%|███▎      | 121715/371472 [9:41:03<18:49:44,  3.68it/s]
 33%|███▎      | 121716/371472 [9:41:03<20:07:00,  3.45it/s]
 33%|███▎      | 121717/371472 [9:41:03<20:09:59,  3.44it/s]
 33%|███▎      | 121718/371472 [9:41:04<19:25:51,  3.57it/s]
 33%|███▎      | 121719/371472 [9:41:04<18:48:20,  3.69it/s]
 33%|███▎      | 121720/371472 [9:41:04<19:15:08,  3.60it/s]
                                                            
{'loss': 3.2971, 'learning_rate': 7.054235169902389e-07, 'epoch': 5.24}

 33%|███▎      | 121720/371472 [9:41:04<19:15:08,  3.60it/s]
 33%|███▎      | 121721/371472 [9:41:04<18:56:06,  3.66it/s]
 33%|███▎      | 121722/371472 [9:41:05<18:52:42,  3.67it/s]
 33%|███▎      | 121723/371472 [9:41:05<19:31:15,  3.55it/s]
 33%|███▎      | 121724/371472 [9:41:05<18:26:14,  3.76it/s]
 33%|███▎      | 121725/371472 [9:41:06<18:49:06,  3.69it/s]
 33%|███▎      | 121726/371472 [9:41:06<18:06:13,  3.83it/s]
 33%|███▎      | 121727/371472 [9:41:06<19:23:31,  3.58it/s]
 33%|███▎      | 121728/371472 [9:41:06<18:28:35,  3.75it/s]
 33%|███▎      | 121729/371472 [9:41:07<18:48:00,  3.69it/s]
 33%|███▎      | 121730/371472 [9:41:07<18:11:58,  3.81it/s]
 33%|███▎      | 121731/371472 [9:41:07<18:08:06,  3.83it/s]
 33%|███▎      | 121732/371472 [9:41:07<18:40:15,  3.72it/s]
 33%|███▎      | 121733/371472 [9:41:08<19:23:06,  3.58it/s]
 33%|███▎      | 121734/371472 [9:41:08<19:51:25,  3.49it/s]
 33%|███▎      | 121735/371472 [9:41:08<20:19:29,  3.41it/s]
 33%|███▎      | 121736/371472 [9:41:09<20:19:35,  3.41it/s]
 33%|███▎      | 121737/371472 [9:41:09<20:41:35,  3.35it/s]
 33%|███▎      | 121738/371472 [9:41:09<21:02:50,  3.30it/s]
 33%|███▎      | 121739/371472 [9:41:09<20:15:19,  3.42it/s]
 33%|███▎      | 121740/371472 [9:41:10<19:17:49,  3.59it/s]
                                                            
{'loss': 3.2285, 'learning_rate': 7.0537503501476e-07, 'epoch': 5.24}

 33%|███▎      | 121740/371472 [9:41:10<19:17:49,  3.59it/s]
 33%|███▎      | 121741/371472 [9:41:10<19:17:50,  3.59it/s]
 33%|███▎      | 121742/371472 [9:41:10<19:36:51,  3.54it/s]
 33%|███▎      | 121743/371472 [9:41:11<19:03:19,  3.64it/s]
 33%|███▎      | 121744/371472 [9:41:11<18:16:12,  3.80it/s]
 33%|███▎      | 121745/371472 [9:41:11<18:02:40,  3.84it/s]
 33%|███▎      | 121746/371472 [9:41:11<18:19:15,  3.79it/s]
 33%|███▎      | 121747/371472 [9:41:12<19:17:57,  3.59it/s]
 33%|███▎      | 121748/371472 [9:41:12<19:14:24,  3.61it/s]
 33%|███▎      | 121749/371472 [9:41:12<19:25:32,  3.57it/s]
 33%|███▎      | 121750/371472 [9:41:12<18:58:46,  3.65it/s]
 33%|███▎      | 121751/371472 [9:41:13<19:03:07,  3.64it/s]
 33%|███▎      | 121752/371472 [9:41:13<18:52:43,  3.67it/s]
 33%|███▎      | 121753/371472 [9:41:13<19:25:00,  3.57it/s]
 33%|███▎      | 121754/371472 [9:41:14<18:40:10,  3.72it/s]
 33%|███▎      | 121755/371472 [9:41:14<18:03:31,  3.84it/s]
 33%|███▎      | 121756/371472 [9:41:14<18:22:38,  3.77it/s]
 33%|███▎      | 121757/371472 [9:41:14<19:12:46,  3.61it/s]
 33%|███▎      | 121758/371472 [9:41:15<18:28:14,  3.76it/s]
 33%|███▎      | 121759/371472 [9:41:15<18:26:26,  3.76it/s]
 33%|███▎      | 121760/371472 [9:41:15<19:50:17,  3.50it/s]
                                                            
{'loss': 3.297, 'learning_rate': 7.053265530392812e-07, 'epoch': 5.24}

 33%|███▎      | 121760/371472 [9:41:15<19:50:17,  3.50it/s]
 33%|███▎      | 121761/371472 [9:41:15<20:09:59,  3.44it/s]
 33%|███▎      | 121762/371472 [9:41:16<20:11:45,  3.43it/s]
 33%|███▎      | 121763/371472 [9:41:16<19:15:42,  3.60it/s]
 33%|███▎      | 121764/371472 [9:41:16<19:29:32,  3.56it/s]
 33%|███▎      | 121765/371472 [9:41:17<19:04:35,  3.64it/s]
 33%|███▎      | 121766/371472 [9:41:17<18:34:45,  3.73it/s]
 33%|███▎      | 121767/371472 [9:41:17<18:22:11,  3.78it/s]
 33%|███▎      | 121768/371472 [9:41:17<18:14:51,  3.80it/s]
 33%|███▎      | 121769/371472 [9:41:18<17:52:13,  3.88it/s]
 33%|███▎      | 121770/371472 [9:41:18<18:10:35,  3.82it/s]
 33%|███▎      | 121771/371472 [9:41:18<19:10:53,  3.62it/s]
 33%|███▎      | 121772/371472 [9:41:19<23:06:18,  3.00it/s]
 33%|███▎      | 121773/371472 [9:41:19<22:15:48,  3.12it/s]
 33%|███▎      | 121774/371472 [9:41:19<21:23:41,  3.24it/s]
 33%|███▎      | 121775/371472 [9:41:19<20:26:17,  3.39it/s]
 33%|███▎      | 121776/371472 [9:41:20<20:08:52,  3.44it/s]
 33%|███▎      | 121777/371472 [9:41:20<19:50:40,  3.50it/s]
 33%|███▎      | 121778/371472 [9:41:20<19:30:54,  3.55it/s]
 33%|███▎      | 121779/371472 [9:41:21<19:28:46,  3.56it/s]
 33%|███▎      | 121780/371472 [9:41:21<18:23:04,  3.77it/s]
                                                            
{'loss': 3.1897, 'learning_rate': 7.052780710638022e-07, 'epoch': 5.25}

 33%|███▎      | 121780/371472 [9:41:21<18:23:04,  3.77it/s]
 33%|███▎      | 121781/371472 [9:41:21<18:26:16,  3.76it/s]
 33%|███▎      | 121782/371472 [9:41:21<18:29:31,  3.75it/s]
 33%|███▎      | 121783/371472 [9:41:22<19:04:37,  3.64it/s]
 33%|███▎      | 121784/371472 [9:41:22<19:45:05,  3.51it/s]
 33%|███▎      | 121785/371472 [9:41:22<19:10:34,  3.62it/s]
 33%|███▎      | 121786/371472 [9:41:22<19:04:47,  3.64it/s]
 33%|███▎      | 121787/371472 [9:41:23<20:06:45,  3.45it/s]
 33%|███▎      | 121788/371472 [9:41:23<19:48:35,  3.50it/s]
 33%|███▎      | 121789/371472 [9:41:23<19:37:01,  3.54it/s]
 33%|███▎      | 121790/371472 [9:41:24<20:21:17,  3.41it/s]
 33%|███▎      | 121791/371472 [9:41:24<20:39:04,  3.36it/s]
 33%|███▎      | 121792/371472 [9:41:24<19:37:54,  3.53it/s]
 33%|███▎      | 121793/371472 [9:41:24<18:38:04,  3.72it/s]
 33%|███▎      | 121794/371472 [9:41:25<18:42:50,  3.71it/s]
 33%|███▎      | 121795/371472 [9:41:25<19:31:46,  3.55it/s]
 33%|███▎      | 121796/371472 [9:41:25<19:43:20,  3.52it/s]
 33%|███▎      | 121797/371472 [9:41:26<18:51:04,  3.68it/s]
 33%|███▎      | 121798/371472 [9:41:26<18:20:43,  3.78it/s]
 33%|███▎      | 121799/371472 [9:41:26<20:28:45,  3.39it/s]
 33%|███▎      | 121800/371472 [9:41:26<19:52:37,  3.49it/s]
                                                            
{'loss': 3.4053, 'learning_rate': 7.052295890883233e-07, 'epoch': 5.25}

 33%|███▎      | 121800/371472 [9:41:26<19:52:37,  3.49it/s]
 33%|███▎      | 121801/371472 [9:41:27<19:32:59,  3.55it/s]
 33%|███▎      | 121802/371472 [9:41:27<19:32:05,  3.55it/s]
 33%|███▎      | 121803/371472 [9:41:27<18:58:59,  3.65it/s]
 33%|███▎      | 121804/371472 [9:41:28<18:54:59,  3.67it/s]
 33%|███▎      | 121805/371472 [9:41:28<19:19:36,  3.59it/s]
 33%|███▎      | 121806/371472 [9:41:28<18:53:14,  3.67it/s]
 33%|███▎      | 121807/371472 [9:41:28<20:24:41,  3.40it/s]
 33%|███▎      | 121808/371472 [9:41:29<20:07:28,  3.45it/s]
 33%|███▎      | 121809/371472 [9:41:29<19:01:31,  3.65it/s]
 33%|███▎      | 121810/371472 [9:41:29<19:55:12,  3.48it/s]
 33%|███▎      | 121811/371472 [9:41:30<21:08:27,  3.28it/s]
 33%|███▎      | 121812/371472 [9:41:30<20:32:41,  3.38it/s]
 33%|███▎      | 121813/371472 [9:41:30<20:01:26,  3.46it/s]
 33%|███▎      | 121814/371472 [9:41:30<20:34:37,  3.37it/s]
 33%|███▎      | 121815/371472 [9:41:31<19:25:11,  3.57it/s]
 33%|███▎      | 121816/371472 [9:41:31<19:04:53,  3.63it/s]
 33%|███▎      | 121817/371472 [9:41:31<21:28:00,  3.23it/s]
 33%|███▎      | 121818/371472 [9:41:32<20:58:51,  3.31it/s]
 33%|███▎      | 121819/371472 [9:41:32<20:07:41,  3.45it/s]
 33%|███▎      | 121820/371472 [9:41:32<19:12:05,  3.61it/s]
                                                            
{'loss': 3.2536, 'learning_rate': 7.051811071128444e-07, 'epoch': 5.25}

 33%|███▎      | 121820/371472 [9:41:32<19:12:05,  3.61it/s]
 33%|███▎      | 121821/371472 [9:41:32<20:18:52,  3.41it/s]
 33%|███▎      | 121822/371472 [9:41:33<20:26:43,  3.39it/s]
 33%|███▎      | 121823/371472 [9:41:33<20:04:11,  3.46it/s]
 33%|███▎      | 121824/371472 [9:41:33<20:38:51,  3.36it/s]
 33%|███▎      | 121825/371472 [9:41:34<20:05:59,  3.45it/s]
 33%|███▎      | 121826/371472 [9:41:34<19:26:58,  3.57it/s]
 33%|███▎      | 121827/371472 [9:41:34<19:17:12,  3.60it/s]
 33%|███▎      | 121828/371472 [9:41:34<18:47:18,  3.69it/s]
 33%|███▎      | 121829/371472 [9:41:35<18:21:56,  3.78it/s]
 33%|███▎      | 121830/371472 [9:41:35<18:25:43,  3.76it/s]
 33%|███▎      | 121831/371472 [9:41:35<18:19:56,  3.78it/s]
 33%|███▎      | 121832/371472 [9:41:35<18:26:29,  3.76it/s]
 33%|███▎      | 121833/371472 [9:41:36<18:22:58,  3.77it/s]
 33%|███▎      | 121834/371472 [9:41:36<18:17:50,  3.79it/s]
 33%|███▎      | 121835/371472 [9:41:36<19:31:23,  3.55it/s]
 33%|███▎      | 121836/371472 [9:41:37<19:11:32,  3.61it/s]
 33%|███▎      | 121837/371472 [9:41:37<18:39:00,  3.72it/s]
 33%|███▎      | 121838/371472 [9:41:37<18:37:07,  3.72it/s]
 33%|███▎      | 121839/371472 [9:41:37<18:53:01,  3.67it/s]
 33%|███▎      | 121840/371472 [9:41:38<18:45:00,  3.70it/s]
                                                            
{'loss': 3.2782, 'learning_rate': 7.051326251373656e-07, 'epoch': 5.25}

 33%|███▎      | 121840/371472 [9:41:38<18:45:00,  3.70it/s]
 33%|███▎      | 121841/371472 [9:41:38<18:45:17,  3.70it/s]
 33%|███▎      | 121842/371472 [9:41:38<18:25:35,  3.76it/s]
 33%|███▎      | 121843/371472 [9:41:38<18:02:17,  3.84it/s]
 33%|███▎      | 121844/371472 [9:41:39<19:20:36,  3.58it/s]
 33%|███▎      | 121845/371472 [9:41:39<18:58:01,  3.66it/s]
 33%|███▎      | 121846/371472 [9:41:39<19:06:56,  3.63it/s]
 33%|███▎      | 121847/371472 [9:41:40<19:32:32,  3.55it/s]
 33%|███▎      | 121848/371472 [9:41:40<19:33:03,  3.55it/s]
 33%|███▎      | 121849/371472 [9:41:40<20:42:29,  3.35it/s]
 33%|███▎      | 121850/371472 [9:41:40<19:59:09,  3.47it/s]
 33%|███▎      | 121851/371472 [9:41:41<20:36:01,  3.37it/s]
 33%|███▎      | 121852/371472 [9:41:41<19:47:06,  3.50it/s]
 33%|███▎      | 121853/371472 [9:41:41<21:01:14,  3.30it/s]
 33%|███▎      | 121854/371472 [9:41:42<21:16:32,  3.26it/s]
 33%|███▎      | 121855/371472 [9:41:42<20:59:40,  3.30it/s]
 33%|███▎      | 121856/371472 [9:41:42<20:59:23,  3.30it/s]
 33%|███▎      | 121857/371472 [9:41:43<20:29:40,  3.38it/s]
 33%|███▎      | 121858/371472 [9:41:43<20:07:39,  3.44it/s]
 33%|███▎      | 121859/371472 [9:41:43<19:11:49,  3.61it/s]
 33%|███▎      | 121860/371472 [9:41:43<18:35:16,  3.73it/s]
                                                            
{'loss': 3.3838, 'learning_rate': 7.050841431618867e-07, 'epoch': 5.25}

 33%|███▎      | 121860/371472 [9:41:43<18:35:16,  3.73it/s]
 33%|███▎      | 121861/371472 [9:41:44<18:28:43,  3.75it/s]
 33%|███▎      | 121862/371472 [9:41:44<18:05:24,  3.83it/s]
 33%|███▎      | 121863/371472 [9:41:44<20:01:31,  3.46it/s]
 33%|███▎      | 121864/371472 [9:41:45<21:21:27,  3.25it/s]
 33%|███▎      | 121865/371472 [9:41:45<21:12:52,  3.27it/s]
 33%|███▎      | 121866/371472 [9:41:45<20:38:27,  3.36it/s]
 33%|███▎      | 121867/371472 [9:41:45<19:36:04,  3.54it/s]
 33%|███▎      | 121868/371472 [9:41:46<20:18:22,  3.41it/s]
 33%|███▎      | 121869/371472 [9:41:46<21:09:24,  3.28it/s]
 33%|███▎      | 121870/371472 [9:41:46<20:10:10,  3.44it/s]
 33%|███▎      | 121871/371472 [9:41:47<19:58:13,  3.47it/s]
 33%|███▎      | 121872/371472 [9:41:47<20:10:01,  3.44it/s]
 33%|███▎      | 121873/371472 [9:41:47<19:04:26,  3.63it/s]
 33%|███▎      | 121874/371472 [9:41:47<18:43:41,  3.70it/s]
 33%|███▎      | 121875/371472 [9:41:48<18:46:16,  3.69it/s]
 33%|███▎      | 121876/371472 [9:41:48<20:04:00,  3.46it/s]
 33%|███▎      | 121877/371472 [9:41:48<20:12:47,  3.43it/s]
 33%|███▎      | 121878/371472 [9:41:49<19:34:17,  3.54it/s]
 33%|███▎      | 121879/371472 [9:41:49<19:33:56,  3.54it/s]
 33%|███▎      | 121880/371472 [9:41:49<19:51:44,  3.49it/s]
                                                            
{'loss': 3.2346, 'learning_rate': 7.050356611864078e-07, 'epoch': 5.25}

 33%|███▎      | 121880/371472 [9:41:49<19:51:44,  3.49it/s]
 33%|███▎      | 121881/371472 [9:41:49<19:29:41,  3.56it/s]
 33%|███▎      | 121882/371472 [9:41:50<18:50:21,  3.68it/s]
 33%|███▎      | 121883/371472 [9:41:50<19:07:05,  3.63it/s]
 33%|███▎      | 121884/371472 [9:41:50<18:33:18,  3.74it/s]
 33%|███▎      | 121885/371472 [9:41:50<18:44:32,  3.70it/s]
 33%|███▎      | 121886/371472 [9:41:51<19:27:44,  3.56it/s]
 33%|███▎      | 121887/371472 [9:41:51<19:45:25,  3.51it/s]
 33%|███▎      | 121888/371472 [9:41:51<18:51:14,  3.68it/s]
 33%|███▎      | 121889/371472 [9:41:52<18:32:43,  3.74it/s]
 33%|███▎      | 121890/371472 [9:41:52<23:37:54,  2.93it/s]
 33%|███▎      | 121891/371472 [9:41:52<22:35:49,  3.07it/s]
 33%|███▎      | 121892/371472 [9:41:53<21:00:04,  3.30it/s]
 33%|███▎      | 121893/371472 [9:41:53<19:39:50,  3.53it/s]
 33%|███▎      | 121894/371472 [9:41:53<19:48:29,  3.50it/s]
 33%|███▎      | 121895/371472 [9:41:53<19:07:46,  3.62it/s]
 33%|███▎      | 121896/371472 [9:41:54<18:46:06,  3.69it/s]
 33%|███▎      | 121897/371472 [9:41:54<18:20:49,  3.78it/s]
 33%|███▎      | 121898/371472 [9:41:54<18:51:55,  3.67it/s]
 33%|███▎      | 121899/371472 [9:41:54<18:24:14,  3.77it/s]
 33%|███▎      | 121900/371472 [9:41:55<18:13:07,  3.81it/s]
                                                            
{'loss': 3.37, 'learning_rate': 7.049871792109288e-07, 'epoch': 5.25}

 33%|███▎      | 121900/371472 [9:41:55<18:13:07,  3.81it/s]
 33%|███▎      | 121901/371472 [9:41:55<18:24:14,  3.77it/s]
 33%|███▎      | 121902/371472 [9:41:55<18:46:29,  3.69it/s]
 33%|███▎      | 121903/371472 [9:41:56<18:39:30,  3.72it/s]
 33%|███▎      | 121904/371472 [9:41:56<19:57:23,  3.47it/s]
 33%|███▎      | 121905/371472 [9:41:56<19:38:21,  3.53it/s]
 33%|███▎      | 121906/371472 [9:41:56<20:49:26,  3.33it/s]
 33%|███▎      | 121907/371472 [9:41:57<20:02:39,  3.46it/s]
 33%|███▎      | 121908/371472 [9:41:57<19:30:28,  3.55it/s]
 33%|███▎      | 121909/371472 [9:41:57<18:58:55,  3.65it/s]
 33%|███▎      | 121910/371472 [9:41:58<18:48:33,  3.69it/s]
 33%|███▎      | 121911/371472 [9:41:58<18:06:18,  3.83it/s]
 33%|███▎      | 121912/371472 [9:41:58<19:08:19,  3.62it/s]
 33%|███▎      | 121913/371472 [9:41:58<19:28:37,  3.56it/s]
 33%|███▎      | 121914/371472 [9:41:59<19:33:16,  3.55it/s]
 33%|███▎      | 121915/371472 [9:41:59<19:12:23,  3.61it/s]
 33%|███▎      | 121916/371472 [9:41:59<18:38:49,  3.72it/s]
 33%|███▎      | 121917/371472 [9:41:59<19:28:36,  3.56it/s]
 33%|███▎      | 121918/371472 [9:42:00<19:39:07,  3.53it/s]
 33%|███▎      | 121919/371472 [9:42:00<19:29:34,  3.56it/s]
 33%|███▎      | 121920/371472 [9:42:00<18:38:09,  3.72it/s]
                                                            
{'loss': 3.2603, 'learning_rate': 7.0493869723545e-07, 'epoch': 5.25}

 33%|███▎      | 121920/371472 [9:42:00<18:38:09,  3.72it/s]
 33%|███▎      | 121921/371472 [9:42:01<19:59:38,  3.47it/s]
 33%|███▎      | 121922/371472 [9:42:01<19:16:07,  3.60it/s]
 33%|███▎      | 121923/371472 [9:42:01<18:57:12,  3.66it/s]
 33%|███▎      | 121924/371472 [9:42:01<18:44:49,  3.70it/s]
 33%|███▎      | 121925/371472 [9:42:02<18:28:48,  3.75it/s]
 33%|███▎      | 121926/371472 [9:42:02<18:17:22,  3.79it/s]
 33%|███▎      | 121927/371472 [9:42:02<18:35:49,  3.73it/s]
 33%|███▎      | 121928/371472 [9:42:02<18:58:55,  3.65it/s]
 33%|███▎      | 121929/371472 [9:42:03<19:24:18,  3.57it/s]
 33%|███▎      | 121930/371472 [9:42:03<18:35:14,  3.73it/s]
 33%|███▎      | 121931/371472 [9:42:03<22:14:27,  3.12it/s]
 33%|███▎      | 121932/371472 [9:42:04<23:24:33,  2.96it/s]
 33%|███▎      | 121933/371472 [9:42:04<22:21:14,  3.10it/s]
 33%|███▎      | 121934/371472 [9:42:04<22:25:53,  3.09it/s]
 33%|███▎      | 121935/371472 [9:42:05<21:46:27,  3.18it/s]
 33%|███▎      | 121936/371472 [9:42:05<21:10:43,  3.27it/s]
 33%|███▎      | 121937/371472 [9:42:05<20:52:14,  3.32it/s]
 33%|███▎      | 121938/371472 [9:42:06<20:15:05,  3.42it/s]
 33%|███▎      | 121939/371472 [9:42:06<19:04:45,  3.63it/s]
 33%|███▎      | 121940/371472 [9:42:06<18:28:04,  3.75it/s]
                                                            
{'loss': 3.1746, 'learning_rate': 7.048902152599711e-07, 'epoch': 5.25}

 33%|███▎      | 121940/371472 [9:42:06<18:28:04,  3.75it/s]
 33%|███▎      | 121941/371472 [9:42:06<19:34:24,  3.54it/s]
 33%|███▎      | 121942/371472 [9:42:07<21:03:17,  3.29it/s]
 33%|███▎      | 121943/371472 [9:42:07<22:40:00,  3.06it/s]
 33%|███▎      | 121944/371472 [9:42:07<21:33:23,  3.22it/s]
 33%|███▎      | 121945/371472 [9:42:08<20:00:37,  3.46it/s]
 33%|███▎      | 121946/371472 [9:42:08<20:52:14,  3.32it/s]
 33%|███▎      | 121947/371472 [9:42:08<20:24:30,  3.40it/s]
 33%|███▎      | 121948/371472 [9:42:08<19:57:19,  3.47it/s]
 33%|███▎      | 121949/371472 [9:42:09<19:29:20,  3.56it/s]
 33%|███▎      | 121950/371472 [9:42:09<19:02:36,  3.64it/s]
 33%|███▎      | 121951/371472 [9:42:09<19:23:55,  3.57it/s]
 33%|███▎      | 121952/371472 [9:42:10<19:31:53,  3.55it/s]
 33%|███▎      | 121953/371472 [9:42:10<21:00:05,  3.30it/s]
 33%|███▎      | 121954/371472 [9:42:10<21:24:12,  3.24it/s]
 33%|███▎      | 121955/371472 [9:42:11<21:24:22,  3.24it/s]
 33%|███▎      | 121956/371472 [9:42:11<19:42:57,  3.52it/s]
 33%|███▎      | 121957/371472 [9:42:11<18:52:10,  3.67it/s]
 33%|███▎      | 121958/371472 [9:42:11<19:19:56,  3.59it/s]
 33%|███▎      | 121959/371472 [9:42:12<19:10:50,  3.61it/s]
 33%|███▎      | 121960/371472 [9:42:12<19:18:02,  3.59it/s]
                                                            
{'loss': 3.1348, 'learning_rate': 7.048417332844922e-07, 'epoch': 5.25}

 33%|███▎      | 121960/371472 [9:42:12<19:18:02,  3.59it/s]
 33%|███▎      | 121961/371472 [9:42:12<18:45:42,  3.69it/s]
 33%|███▎      | 121962/371472 [9:42:12<19:02:16,  3.64it/s]
 33%|███▎      | 121963/371472 [9:42:13<19:04:06,  3.63it/s]
 33%|███▎      | 121964/371472 [9:42:13<18:19:08,  3.78it/s]
 33%|███▎      | 121965/371472 [9:42:13<18:33:27,  3.73it/s]
 33%|███▎      | 121966/371472 [9:42:14<20:59:08,  3.30it/s]
 33%|███▎      | 121967/371472 [9:42:14<20:01:23,  3.46it/s]
 33%|███▎      | 121968/371472 [9:42:14<19:44:43,  3.51it/s]
 33%|███▎      | 121969/371472 [9:42:14<18:48:41,  3.68it/s]
 33%|███▎      | 121970/371472 [9:42:15<19:01:45,  3.64it/s]
 33%|███▎      | 121971/371472 [9:42:15<18:39:25,  3.71it/s]
 33%|███▎      | 121972/371472 [9:42:15<18:05:22,  3.83it/s]
 33%|███▎      | 121973/371472 [9:42:15<17:56:38,  3.86it/s]
 33%|███▎      | 121974/371472 [9:42:16<17:55:07,  3.87it/s]
 33%|███▎      | 121975/371472 [9:42:16<17:41:51,  3.92it/s]
 33%|███▎      | 121976/371472 [9:42:16<17:35:02,  3.94it/s]
 33%|███▎      | 121977/371472 [9:42:16<18:11:47,  3.81it/s]
 33%|███▎      | 121978/371472 [9:42:17<17:49:46,  3.89it/s]
 33%|███▎      | 121979/371472 [9:42:17<18:28:40,  3.75it/s]
 33%|███▎      | 121980/371472 [9:42:17<17:52:36,  3.88it/s]
                                                            
{'loss': 3.409, 'learning_rate': 7.047932513090133e-07, 'epoch': 5.25}

 33%|███▎      | 121980/371472 [9:42:17<17:52:36,  3.88it/s]
 33%|███▎      | 121981/371472 [9:42:18<19:35:03,  3.54it/s]
 33%|███▎      | 121982/371472 [9:42:18<19:06:41,  3.63it/s]
 33%|███▎      | 121983/371472 [9:42:18<19:46:31,  3.50it/s]
 33%|███▎      | 121984/371472 [9:42:18<19:30:43,  3.55it/s]
 33%|███▎      | 121985/371472 [9:42:19<20:02:06,  3.46it/s]
 33%|███▎      | 121986/371472 [9:42:19<20:39:40,  3.35it/s]
 33%|███▎      | 121987/371472 [9:42:19<20:21:41,  3.40it/s]
 33%|███▎      | 121988/371472 [9:42:20<19:34:51,  3.54it/s]
 33%|███▎      | 121989/371472 [9:42:20<21:22:10,  3.24it/s]
 33%|███▎      | 121990/371472 [9:42:20<21:28:23,  3.23it/s]
 33%|███▎      | 121991/371472 [9:42:21<20:14:53,  3.42it/s]
 33%|███▎      | 121992/371472 [9:42:21<19:48:51,  3.50it/s]
 33%|███▎      | 121993/371472 [9:42:21<19:42:51,  3.52it/s]
 33%|███▎      | 121994/371472 [9:42:21<20:02:12,  3.46it/s]
 33%|███▎      | 121995/371472 [9:42:22<19:03:48,  3.64it/s]
 33%|███▎      | 121996/371472 [9:42:22<19:07:41,  3.62it/s]
 33%|███▎      | 121997/371472 [9:42:22<18:18:03,  3.79it/s]
 33%|███▎      | 121998/371472 [9:42:22<17:37:57,  3.93it/s]
 33%|███▎      | 121999/371472 [9:42:23<18:28:40,  3.75it/s]
 33%|███▎      | 122000/371472 [9:42:23<19:03:44,  3.64it/s]
                                                            
{'loss': 3.1956, 'learning_rate': 7.047447693335345e-07, 'epoch': 5.25}

 33%|███▎      | 122000/371472 [9:42:23<19:03:44,  3.64it/s]
 33%|███▎      | 122001/371472 [9:42:23<18:30:38,  3.74it/s]
 33%|███▎      | 122002/371472 [9:42:23<18:22:41,  3.77it/s]
 33%|███▎      | 122003/371472 [9:42:24<18:39:52,  3.71it/s]
 33%|███▎      | 122004/371472 [9:42:24<18:56:57,  3.66it/s]
 33%|███▎      | 122005/371472 [9:42:24<19:52:01,  3.49it/s]
 33%|███▎      | 122006/371472 [9:42:25<23:53:00,  2.90it/s]
 33%|███▎      | 122007/371472 [9:42:25<21:37:27,  3.20it/s]
 33%|███▎      | 122008/371472 [9:42:25<20:45:58,  3.34it/s]
 33%|███▎      | 122009/371472 [9:42:26<21:07:37,  3.28it/s]
 33%|███▎      | 122010/371472 [9:42:26<20:44:12,  3.34it/s]
 33%|███▎      | 122011/371472 [9:42:26<19:28:59,  3.56it/s]
 33%|███▎      | 122012/371472 [9:42:26<19:15:20,  3.60it/s]
 33%|███▎      | 122013/371472 [9:42:27<19:15:31,  3.60it/s]
 33%|███▎      | 122014/371472 [9:42:27<18:54:54,  3.66it/s]
 33%|███▎      | 122015/371472 [9:42:27<18:40:43,  3.71it/s]
 33%|███▎      | 122016/371472 [9:42:27<18:37:32,  3.72it/s]
 33%|███▎      | 122017/371472 [9:42:28<19:13:50,  3.60it/s]
 33%|███▎      | 122018/371472 [9:42:28<18:31:27,  3.74it/s]
 33%|███▎      | 122019/371472 [9:42:28<18:51:48,  3.67it/s]
 33%|███▎      | 122020/371472 [9:42:29<18:29:52,  3.75it/s]
                                                            
{'loss': 3.2303, 'learning_rate': 7.046962873580555e-07, 'epoch': 5.26}

 33%|███▎      | 122020/371472 [9:42:29<18:29:52,  3.75it/s]
 33%|███▎      | 122021/371472 [9:42:29<18:42:26,  3.70it/s]
 33%|███▎      | 122022/371472 [9:42:29<18:03:41,  3.84it/s]
 33%|███▎      | 122023/371472 [9:42:29<17:47:04,  3.90it/s]
 33%|███▎      | 122024/371472 [9:42:30<17:40:39,  3.92it/s]
 33%|███▎      | 122025/371472 [9:42:30<18:37:52,  3.72it/s]
 33%|███▎      | 122026/371472 [9:42:30<21:03:38,  3.29it/s]
 33%|███▎      | 122027/371472 [9:42:31<21:08:19,  3.28it/s]
 33%|███▎      | 122028/371472 [9:42:31<20:21:20,  3.40it/s]
 33%|███▎      | 122029/371472 [9:42:31<19:19:50,  3.58it/s]
 33%|███▎      | 122030/371472 [9:42:31<20:22:21,  3.40it/s]
 33%|███▎      | 122031/371472 [9:42:32<19:37:01,  3.53it/s]
 33%|███▎      | 122032/371472 [9:42:32<19:55:11,  3.48it/s]
 33%|███▎      | 122033/371472 [9:42:32<19:21:56,  3.58it/s]
 33%|███▎      | 122034/371472 [9:42:33<19:53:49,  3.48it/s]
 33%|███▎      | 122035/371472 [9:42:33<20:45:46,  3.34it/s]
 33%|███▎      | 122036/371472 [9:42:33<19:37:31,  3.53it/s]
 33%|███▎      | 122037/371472 [9:42:33<19:11:13,  3.61it/s]
 33%|███▎      | 122038/371472 [9:42:34<18:47:05,  3.69it/s]
 33%|███▎      | 122039/371472 [9:42:34<19:50:30,  3.49it/s]
 33%|███▎      | 122040/371472 [9:42:34<19:11:45,  3.61it/s]
                                                            
{'loss': 3.3265, 'learning_rate': 7.046478053825766e-07, 'epoch': 5.26}

 33%|███▎      | 122040/371472 [9:42:34<19:11:45,  3.61it/s]
 33%|███▎      | 122041/371472 [9:42:34<19:06:01,  3.63it/s]
 33%|███▎      | 122042/371472 [9:42:35<18:46:09,  3.69it/s]
 33%|███▎      | 122043/371472 [9:42:35<18:48:27,  3.68it/s]
 33%|███▎      | 122044/371472 [9:42:35<18:17:52,  3.79it/s]
 33%|███▎      | 122045/371472 [9:42:36<18:50:57,  3.68it/s]
 33%|███▎      | 122046/371472 [9:42:36<18:44:25,  3.70it/s]
 33%|███▎      | 122047/371472 [9:42:36<19:05:07,  3.63it/s]
 33%|███▎      | 122048/371472 [9:42:36<18:48:56,  3.68it/s]
 33%|███▎      | 122049/371472 [9:42:37<19:06:18,  3.63it/s]
 33%|███▎      | 122050/371472 [9:42:37<19:04:53,  3.63it/s]
 33%|███▎      | 122051/371472 [9:42:37<18:45:05,  3.69it/s]
 33%|███▎      | 122052/371472 [9:42:37<18:28:20,  3.75it/s]
 33%|███▎      | 122053/371472 [9:42:38<18:01:48,  3.84it/s]
 33%|███▎      | 122054/371472 [9:42:38<17:39:31,  3.92it/s]
 33%|███▎      | 122055/371472 [9:42:38<20:07:22,  3.44it/s]
 33%|███▎      | 122056/371472 [9:42:39<20:25:56,  3.39it/s]
 33%|███▎      | 122057/371472 [9:42:39<19:45:28,  3.51it/s]
 33%|███▎      | 122058/371472 [9:42:39<23:14:32,  2.98it/s]
 33%|███▎      | 122059/371472 [9:42:40<21:45:17,  3.18it/s]
 33%|███▎      | 122060/371472 [9:42:40<20:51:57,  3.32it/s]
                                                            
{'loss': 3.3418, 'learning_rate': 7.045993234070977e-07, 'epoch': 5.26}

 33%|███▎      | 122060/371472 [9:42:40<20:51:57,  3.32it/s]
 33%|███▎      | 122061/371472 [9:42:40<20:16:46,  3.42it/s]
 33%|███▎      | 122062/371472 [9:42:40<20:06:13,  3.45it/s]
 33%|███▎      | 122063/371472 [9:42:41<19:47:07,  3.50it/s]
 33%|███▎      | 122064/371472 [9:42:41<20:06:11,  3.45it/s]
 33%|███▎      | 122065/371472 [9:42:41<19:21:15,  3.58it/s]
 33%|███▎      | 122066/371472 [9:42:42<20:54:52,  3.31it/s]
 33%|███▎      | 122067/371472 [9:42:42<20:01:31,  3.46it/s]
 33%|███▎      | 122068/371472 [9:42:42<19:25:30,  3.57it/s]
 33%|███▎      | 122069/371472 [9:42:43<22:13:20,  3.12it/s]
 33%|███▎      | 122070/371472 [9:42:43<21:59:02,  3.15it/s]
 33%|███▎      | 122071/371472 [9:42:43<21:42:11,  3.19it/s]
 33%|███▎      | 122072/371472 [9:42:44<22:33:04,  3.07it/s]
 33%|███▎      | 122073/371472 [9:42:44<22:25:09,  3.09it/s]
 33%|███▎      | 122074/371472 [9:42:44<22:10:10,  3.12it/s]
 33%|███▎      | 122075/371472 [9:42:44<22:40:35,  3.05it/s]
 33%|███▎      | 122076/371472 [9:42:45<21:35:30,  3.21it/s]
 33%|███▎      | 122077/371472 [9:42:45<20:26:10,  3.39it/s]
 33%|███▎      | 122078/371472 [9:42:45<19:49:53,  3.49it/s]
 33%|███▎      | 122079/371472 [9:42:46<19:35:06,  3.54it/s]
 33%|███▎      | 122080/371472 [9:42:46<19:48:03,  3.50it/s]
                                                            
{'loss': 3.3365, 'learning_rate': 7.045508414316188e-07, 'epoch': 5.26}

 33%|███▎      | 122080/371472 [9:42:46<19:48:03,  3.50it/s]
 33%|███▎      | 122081/371472 [9:42:46<19:51:52,  3.49it/s]
 33%|███▎      | 122082/371472 [9:42:46<19:05:48,  3.63it/s]
 33%|███▎      | 122083/371472 [9:42:47<18:50:04,  3.68it/s]
 33%|███▎      | 122084/371472 [9:42:47<19:34:19,  3.54it/s]
 33%|███▎      | 122085/371472 [9:42:47<19:58:00,  3.47it/s]
 33%|███▎      | 122086/371472 [9:42:48<19:23:41,  3.57it/s]
 33%|███▎      | 122087/371472 [9:42:48<19:20:49,  3.58it/s]
 33%|███▎      | 122088/371472 [9:42:48<18:41:53,  3.70it/s]
 33%|███▎      | 122089/371472 [9:42:48<18:26:01,  3.76it/s]
 33%|███▎      | 122090/371472 [9:42:49<18:43:13,  3.70it/s]
 33%|███▎      | 122091/371472 [9:42:49<18:43:35,  3.70it/s]
 33%|███▎      | 122092/371472 [9:42:49<18:43:38,  3.70it/s]
 33%|███▎      | 122093/371472 [9:42:49<18:14:33,  3.80it/s]
 33%|███▎      | 122094/371472 [9:42:50<18:41:31,  3.71it/s]
 33%|███▎      | 122095/371472 [9:42:50<18:24:02,  3.76it/s]
 33%|███▎      | 122096/371472 [9:42:50<18:11:39,  3.81it/s]
 33%|███▎      | 122097/371472 [9:42:50<17:55:14,  3.87it/s]
 33%|███▎      | 122098/371472 [9:42:51<17:46:10,  3.90it/s]
 33%|███▎      | 122099/371472 [9:42:51<18:41:15,  3.71it/s]
 33%|███▎      | 122100/371472 [9:42:51<18:25:34,  3.76it/s]
                                                            
{'loss': 3.4789, 'learning_rate': 7.0450235945614e-07, 'epoch': 5.26}

 33%|███▎      | 122100/371472 [9:42:51<18:25:34,  3.76it/s]
 33%|███▎      | 122101/371472 [9:42:52<18:34:44,  3.73it/s]
 33%|███▎      | 122102/371472 [9:42:52<18:20:38,  3.78it/s]
 33%|███▎      | 122103/371472 [9:42:52<21:01:53,  3.29it/s]
 33%|███▎      | 122104/371472 [9:42:53<23:09:59,  2.99it/s]
 33%|███▎      | 122105/371472 [9:42:53<22:38:29,  3.06it/s]
 33%|███▎      | 122106/371472 [9:42:53<21:34:03,  3.21it/s]
 33%|███▎      | 122107/371472 [9:42:53<22:00:33,  3.15it/s]
 33%|███▎      | 122108/371472 [9:42:54<21:06:26,  3.28it/s]
 33%|███▎      | 122109/371472 [9:42:54<19:53:19,  3.48it/s]
 33%|███▎      | 122110/371472 [9:42:54<20:05:26,  3.45it/s]
 33%|███▎      | 122111/371472 [9:42:55<19:22:12,  3.58it/s]
 33%|███▎      | 122112/371472 [9:42:55<19:26:32,  3.56it/s]
 33%|███▎      | 122113/371472 [9:42:55<19:12:49,  3.61it/s]
 33%|███▎      | 122114/371472 [9:42:56<22:16:34,  3.11it/s]
 33%|███▎      | 122115/371472 [9:42:56<21:37:37,  3.20it/s]
 33%|███▎      | 122116/371472 [9:42:56<20:05:11,  3.45it/s]
 33%|███▎      | 122117/371472 [9:42:56<19:09:27,  3.62it/s]
 33%|███▎      | 122118/371472 [9:42:57<19:04:00,  3.63it/s]
 33%|███▎      | 122119/371472 [9:42:57<19:59:42,  3.46it/s]
 33%|███▎      | 122120/371472 [9:42:57<20:32:18,  3.37it/s]
                                                            
{'loss': 3.1382, 'learning_rate': 7.044538774806611e-07, 'epoch': 5.26}

 33%|███▎      | 122120/371472 [9:42:57<20:32:18,  3.37it/s]
 33%|███▎      | 122121/371472 [9:42:57<19:20:08,  3.58it/s]
 33%|███▎      | 122122/371472 [9:42:58<20:05:01,  3.45it/s]
 33%|███▎      | 122123/371472 [9:42:58<20:09:57,  3.43it/s]
 33%|███▎      | 122124/371472 [9:42:58<20:00:20,  3.46it/s]
 33%|███▎      | 122125/371472 [9:42:59<19:57:34,  3.47it/s]
 33%|███▎      | 122126/371472 [9:42:59<19:29:56,  3.55it/s]
 33%|███▎      | 122127/371472 [9:42:59<20:12:21,  3.43it/s]
 33%|███▎      | 122128/371472 [9:42:59<19:43:02,  3.51it/s]
 33%|███▎      | 122129/371472 [9:43:00<20:33:12,  3.37it/s]
 33%|███▎      | 122130/371472 [9:43:00<20:34:24,  3.37it/s]
 33%|███▎      | 122131/371472 [9:43:00<20:18:24,  3.41it/s]
 33%|███▎      | 122132/371472 [9:43:01<19:52:56,  3.48it/s]
 33%|███▎      | 122133/371472 [9:43:01<19:01:26,  3.64it/s]
 33%|███▎      | 122134/371472 [9:43:01<20:04:31,  3.45it/s]
 33%|███▎      | 122135/371472 [9:43:02<22:26:10,  3.09it/s]
 33%|███▎      | 122136/371472 [9:43:02<21:34:02,  3.21it/s]
 33%|███▎      | 122137/371472 [9:43:02<20:50:03,  3.32it/s]
 33%|███▎      | 122138/371472 [9:43:02<20:14:02,  3.42it/s]
 33%|███▎      | 122139/371472 [9:43:03<21:02:13,  3.29it/s]
 33%|███▎      | 122140/371472 [9:43:03<21:04:55,  3.29it/s]
                                                            
{'loss': 3.4152, 'learning_rate': 7.044053955051822e-07, 'epoch': 5.26}

 33%|███▎      | 122140/371472 [9:43:03<21:04:55,  3.29it/s]
 33%|███▎      | 122141/371472 [9:43:03<20:14:35,  3.42it/s]
 33%|███▎      | 122142/371472 [9:43:04<19:27:56,  3.56it/s]
 33%|███▎      | 122143/371472 [9:43:04<19:49:12,  3.49it/s]
 33%|███▎      | 122144/371472 [9:43:04<19:36:37,  3.53it/s]
 33%|███▎      | 122145/371472 [9:43:05<20:23:11,  3.40it/s]
 33%|███▎      | 122146/371472 [9:43:05<19:27:31,  3.56it/s]
 33%|███▎      | 122147/371472 [9:43:05<19:18:58,  3.59it/s]
 33%|███▎      | 122148/371472 [9:43:05<20:10:03,  3.43it/s]
 33%|███▎      | 122149/371472 [9:43:06<21:35:22,  3.21it/s]
 33%|███▎      | 122150/371472 [9:43:06<20:44:55,  3.34it/s]
 33%|███▎      | 122151/371472 [9:43:06<19:25:11,  3.57it/s]
 33%|███▎      | 122152/371472 [9:43:07<20:41:27,  3.35it/s]
 33%|███▎      | 122153/371472 [9:43:07<20:35:33,  3.36it/s]
 33%|███▎      | 122154/371472 [9:43:07<20:04:12,  3.45it/s]
 33%|███▎      | 122155/371472 [9:43:07<19:27:50,  3.56it/s]
 33%|███▎      | 122156/371472 [9:43:08<18:56:46,  3.66it/s]
 33%|███▎      | 122157/371472 [9:43:08<18:52:01,  3.67it/s]
 33%|███▎      | 122158/371472 [9:43:08<18:46:00,  3.69it/s]
 33%|███▎      | 122159/371472 [9:43:08<18:26:14,  3.76it/s]
 33%|███▎      | 122160/371472 [9:43:09<17:58:30,  3.85it/s]
                                                            
{'loss': 3.4156, 'learning_rate': 7.043569135297032e-07, 'epoch': 5.26}

 33%|███▎      | 122160/371472 [9:43:09<17:58:30,  3.85it/s]
 33%|███▎      | 122161/371472 [9:43:09<18:01:58,  3.84it/s]
 33%|███▎      | 122162/371472 [9:43:09<18:33:31,  3.73it/s]
 33%|███▎      | 122163/371472 [9:43:09<18:19:09,  3.78it/s]
 33%|███▎      | 122164/371472 [9:43:10<18:12:02,  3.80it/s]
 33%|███▎      | 122165/371472 [9:43:10<17:39:16,  3.92it/s]
 33%|███▎      | 122166/371472 [9:43:10<18:46:45,  3.69it/s]
 33%|███▎      | 122167/371472 [9:43:11<18:48:14,  3.68it/s]
 33%|███▎      | 122168/371472 [9:43:11<19:28:37,  3.56it/s]
 33%|███▎      | 122169/371472 [9:43:11<20:14:29,  3.42it/s]
 33%|███▎      | 122170/371472 [9:43:11<19:26:47,  3.56it/s]
 33%|███▎      | 122171/371472 [9:43:12<19:00:31,  3.64it/s]
 33%|███▎      | 122172/371472 [9:43:12<21:16:21,  3.26it/s]
 33%|███▎      | 122173/371472 [9:43:12<21:35:20,  3.21it/s]
 33%|███▎      | 122174/371472 [9:43:13<20:00:04,  3.46it/s]
 33%|███▎      | 122175/371472 [9:43:13<20:41:04,  3.35it/s]
 33%|███▎      | 122176/371472 [9:43:13<19:40:01,  3.52it/s]
 33%|███▎      | 122177/371472 [9:43:13<19:29:51,  3.55it/s]
 33%|███▎      | 122178/371472 [9:43:14<18:49:26,  3.68it/s]
 33%|███▎      | 122179/371472 [9:43:14<18:27:44,  3.75it/s]
 33%|███▎      | 122180/371472 [9:43:14<18:36:48,  3.72it/s]
                                                            
{'loss': 3.3359, 'learning_rate': 7.043084315542244e-07, 'epoch': 5.26}

 33%|███▎      | 122180/371472 [9:43:14<18:36:48,  3.72it/s]
 33%|███▎      | 122181/371472 [9:43:15<18:05:57,  3.83it/s]
 33%|███▎      | 122182/371472 [9:43:15<20:00:30,  3.46it/s]
 33%|███▎      | 122183/371472 [9:43:15<19:53:51,  3.48it/s]
 33%|███▎      | 122184/371472 [9:43:15<20:06:41,  3.44it/s]
 33%|███▎      | 122185/371472 [9:43:16<19:45:01,  3.51it/s]
 33%|███▎      | 122186/371472 [9:43:16<19:09:03,  3.62it/s]
 33%|███▎      | 122187/371472 [9:43:16<19:18:02,  3.59it/s]
 33%|███▎      | 122188/371472 [9:43:17<19:08:14,  3.62it/s]
 33%|███▎      | 122189/371472 [9:43:17<19:07:39,  3.62it/s]
 33%|███▎      | 122190/371472 [9:43:17<19:50:49,  3.49it/s]
 33%|███▎      | 122191/371472 [9:43:17<20:13:26,  3.42it/s]
 33%|███▎      | 122192/371472 [9:43:18<20:33:13,  3.37it/s]
 33%|███▎      | 122193/371472 [9:43:18<21:29:36,  3.22it/s]
 33%|███▎      | 122194/371472 [9:43:18<20:46:44,  3.33it/s]
 33%|███▎      | 122195/371472 [9:43:19<20:27:21,  3.39it/s]
 33%|███▎      | 122196/371472 [9:43:19<19:21:54,  3.58it/s]
 33%|███▎      | 122197/371472 [9:43:19<21:13:07,  3.26it/s]
 33%|███▎      | 122198/371472 [9:43:20<20:13:03,  3.42it/s]
 33%|███▎      | 122199/371472 [9:43:20<18:55:39,  3.66it/s]
 33%|███▎      | 122200/371472 [9:43:20<19:03:07,  3.63it/s]
                                                            
{'loss': 3.2836, 'learning_rate': 7.042599495787455e-07, 'epoch': 5.26}

 33%|███▎      | 122200/371472 [9:43:20<19:03:07,  3.63it/s]
 33%|███▎      | 122201/371472 [9:43:20<19:33:01,  3.54it/s]
 33%|███▎      | 122202/371472 [9:43:21<19:39:11,  3.52it/s]
 33%|███▎      | 122203/371472 [9:43:21<18:51:09,  3.67it/s]
 33%|███▎      | 122204/371472 [9:43:21<19:33:17,  3.54it/s]
 33%|███▎      | 122205/371472 [9:43:21<19:27:31,  3.56it/s]
 33%|███▎      | 122206/371472 [9:43:22<20:50:01,  3.32it/s]
 33%|███▎      | 122207/371472 [9:43:22<20:54:53,  3.31it/s]
 33%|███▎      | 122208/371472 [9:43:22<20:06:18,  3.44it/s]
 33%|███▎      | 122209/371472 [9:43:23<20:28:50,  3.38it/s]
 33%|███▎      | 122210/371472 [9:43:23<19:33:37,  3.54it/s]
 33%|███▎      | 122211/371472 [9:43:23<18:39:11,  3.71it/s]
 33%|███▎      | 122212/371472 [9:43:23<18:39:51,  3.71it/s]
 33%|███▎      | 122213/371472 [9:43:24<19:06:25,  3.62it/s]
 33%|███▎      | 122214/371472 [9:43:24<18:25:53,  3.76it/s]
 33%|███▎      | 122215/371472 [9:43:24<18:00:34,  3.84it/s]
 33%|███▎      | 122216/371472 [9:43:24<18:39:46,  3.71it/s]
 33%|███▎      | 122217/371472 [9:43:25<20:07:30,  3.44it/s]
 33%|███▎      | 122218/371472 [9:43:25<19:12:40,  3.60it/s]
 33%|███▎      | 122219/371472 [9:43:25<19:11:19,  3.61it/s]
 33%|███▎      | 122220/371472 [9:43:26<18:26:37,  3.75it/s]
                                                            
{'loss': 3.3352, 'learning_rate': 7.042114676032666e-07, 'epoch': 5.26}

 33%|███▎      | 122220/371472 [9:43:26<18:26:37,  3.75it/s]
 33%|███▎      | 122221/371472 [9:43:26<18:31:52,  3.74it/s]
 33%|███▎      | 122222/371472 [9:43:26<18:31:58,  3.74it/s]
 33%|███▎      | 122223/371472 [9:43:26<19:04:21,  3.63it/s]
 33%|███▎      | 122224/371472 [9:43:27<19:03:15,  3.63it/s]
 33%|███▎      | 122225/371472 [9:43:27<18:09:10,  3.81it/s]
 33%|███▎      | 122226/371472 [9:43:27<19:10:53,  3.61it/s]
 33%|███▎      | 122227/371472 [9:43:28<20:43:06,  3.34it/s]
 33%|███▎      | 122228/371472 [9:43:28<20:01:11,  3.46it/s]
 33%|███▎      | 122229/371472 [9:43:28<20:50:47,  3.32it/s]
 33%|███▎      | 122230/371472 [9:43:28<20:03:45,  3.45it/s]
 33%|███▎      | 122231/371472 [9:43:29<18:58:13,  3.65it/s]
 33%|███▎      | 122232/371472 [9:43:29<18:26:23,  3.75it/s]
 33%|███▎      | 122233/371472 [9:43:29<18:13:08,  3.80it/s]
 33%|███▎      | 122234/371472 [9:43:29<18:15:52,  3.79it/s]
 33%|███▎      | 122235/371472 [9:43:30<18:03:21,  3.83it/s]
 33%|███▎      | 122236/371472 [9:43:30<18:06:08,  3.82it/s]
 33%|███▎      | 122237/371472 [9:43:30<17:39:04,  3.92it/s]
 33%|███▎      | 122238/371472 [9:43:30<17:46:53,  3.89it/s]
 33%|███▎      | 122239/371472 [9:43:31<17:50:01,  3.88it/s]
 33%|███▎      | 122240/371472 [9:43:31<18:25:28,  3.76it/s]
                                                            
{'loss': 3.1764, 'learning_rate': 7.041629856277877e-07, 'epoch': 5.27}

 33%|███▎      | 122240/371472 [9:43:31<18:25:28,  3.76it/s]
 33%|███▎      | 122241/371472 [9:43:31<18:15:58,  3.79it/s]
 33%|███▎      | 122242/371472 [9:43:32<18:02:11,  3.84it/s]
 33%|███▎      | 122243/371472 [9:43:32<17:42:35,  3.91it/s]
 33%|███▎      | 122244/371472 [9:43:32<17:56:29,  3.86it/s]
 33%|███▎      | 122245/371472 [9:43:32<17:53:56,  3.87it/s]
 33%|███▎      | 122246/371472 [9:43:33<21:09:08,  3.27it/s]
 33%|███▎      | 122247/371472 [9:43:33<19:52:57,  3.48it/s]
 33%|███▎      | 122248/371472 [9:43:33<19:00:19,  3.64it/s]
 33%|███▎      | 122249/371472 [9:43:33<18:21:54,  3.77it/s]
 33%|███▎      | 122250/371472 [9:43:34<18:53:45,  3.66it/s]
 33%|███▎      | 122251/371472 [9:43:34<19:23:34,  3.57it/s]
 33%|███▎      | 122252/371472 [9:43:34<18:55:43,  3.66it/s]
 33%|███▎      | 122253/371472 [9:43:35<18:53:54,  3.66it/s]
 33%|███▎      | 122254/371472 [9:43:35<19:15:32,  3.59it/s]
 33%|███▎      | 122255/371472 [9:43:35<20:22:29,  3.40it/s]
 33%|███▎      | 122256/371472 [9:43:35<19:38:38,  3.52it/s]
 33%|███▎      | 122257/371472 [9:43:36<21:02:43,  3.29it/s]
 33%|███▎      | 122258/371472 [9:43:36<20:03:40,  3.45it/s]
 33%|███▎      | 122259/371472 [9:43:36<19:04:07,  3.63it/s]
 33%|███▎      | 122260/371472 [9:43:37<19:06:25,  3.62it/s]
                                                            
{'loss': 3.2883, 'learning_rate': 7.041145036523088e-07, 'epoch': 5.27}

 33%|███▎      | 122260/371472 [9:43:37<19:06:25,  3.62it/s]
 33%|███▎      | 122261/371472 [9:43:37<18:06:57,  3.82it/s]
 33%|███▎      | 122262/371472 [9:43:37<17:31:33,  3.95it/s]
 33%|███▎      | 122263/371472 [9:43:37<17:34:09,  3.94it/s]
 33%|███▎      | 122264/371472 [9:43:38<18:28:06,  3.75it/s]
 33%|███▎      | 122265/371472 [9:43:38<19:04:08,  3.63it/s]
 33%|███▎      | 122266/371472 [9:43:38<19:23:32,  3.57it/s]
 33%|███▎      | 122267/371472 [9:43:38<19:22:34,  3.57it/s]
 33%|███▎      | 122268/371472 [9:43:39<19:21:07,  3.58it/s]
 33%|███▎      | 122269/371472 [9:43:39<18:46:34,  3.69it/s]
 33%|███▎      | 122270/371472 [9:43:39<19:33:16,  3.54it/s]
 33%|███▎      | 122271/371472 [9:43:40<19:31:59,  3.54it/s]
 33%|███▎      | 122272/371472 [9:43:40<18:31:31,  3.74it/s]
 33%|███▎      | 122273/371472 [9:43:40<18:25:59,  3.76it/s]
 33%|███▎      | 122274/371472 [9:43:40<18:57:08,  3.65it/s]
 33%|███▎      | 122275/371472 [9:43:41<18:46:16,  3.69it/s]
 33%|███▎      | 122276/371472 [9:43:41<19:15:53,  3.59it/s]
 33%|███▎      | 122277/371472 [9:43:41<19:24:11,  3.57it/s]
 33%|███▎      | 122278/371472 [9:43:41<18:54:28,  3.66it/s]
 33%|███▎      | 122279/371472 [9:43:42<20:11:19,  3.43it/s]
 33%|███▎      | 122280/371472 [9:43:42<19:30:27,  3.55it/s]
                                                            
{'loss': 3.399, 'learning_rate': 7.040660216768298e-07, 'epoch': 5.27}

 33%|███▎      | 122280/371472 [9:43:42<19:30:27,  3.55it/s]
 33%|███▎      | 122281/371472 [9:43:42<20:24:08,  3.39it/s]
 33%|███▎      | 122282/371472 [9:43:43<21:36:01,  3.20it/s]
 33%|███▎      | 122283/371472 [9:43:43<20:45:46,  3.33it/s]
 33%|███▎      | 122284/371472 [9:43:43<19:24:19,  3.57it/s]
 33%|███▎      | 122285/371472 [9:43:44<19:15:24,  3.59it/s]
 33%|███▎      | 122286/371472 [9:43:44<21:04:12,  3.29it/s]
 33%|███▎      | 122287/371472 [9:43:44<21:08:56,  3.27it/s]
 33%|███▎      | 122288/371472 [9:43:44<20:07:45,  3.44it/s]
 33%|███▎      | 122289/371472 [9:43:45<19:09:45,  3.61it/s]
 33%|███▎      | 122290/371472 [9:43:45<19:47:14,  3.50it/s]
 33%|███▎      | 122291/371472 [9:43:45<19:32:51,  3.54it/s]
 33%|███▎      | 122292/371472 [9:43:46<19:49:06,  3.49it/s]
 33%|███▎      | 122293/371472 [9:43:46<19:29:50,  3.55it/s]
 33%|███▎      | 122294/371472 [9:43:46<20:31:17,  3.37it/s]
 33%|███▎      | 122295/371472 [9:43:46<21:00:08,  3.30it/s]
 33%|███▎      | 122296/371472 [9:43:47<20:34:05,  3.37it/s]
 33%|███▎      | 122297/371472 [9:43:47<21:18:20,  3.25it/s]
 33%|███▎      | 122298/371472 [9:43:47<21:56:13,  3.16it/s]
 33%|███▎      | 122299/371472 [9:43:48<20:16:55,  3.41it/s]
 33%|███▎      | 122300/371472 [9:43:48<19:08:35,  3.62it/s]
                                                            
{'loss': 3.263, 'learning_rate': 7.04017539701351e-07, 'epoch': 5.27}

 33%|███▎      | 122300/371472 [9:43:48<19:08:35,  3.62it/s]
 33%|███▎      | 122301/371472 [9:43:48<19:59:25,  3.46it/s]
 33%|███▎      | 122302/371472 [9:43:49<19:45:46,  3.50it/s]
 33%|███▎      | 122303/371472 [9:43:49<19:05:29,  3.63it/s]
 33%|███▎      | 122304/371472 [9:43:49<19:36:41,  3.53it/s]
 33%|███▎      | 122305/371472 [9:43:49<19:27:54,  3.56it/s]
 33%|███▎      | 122306/371472 [9:43:50<19:46:39,  3.50it/s]
 33%|███▎      | 122307/371472 [9:43:50<19:48:54,  3.49it/s]
 33%|███▎      | 122308/371472 [9:43:50<20:45:28,  3.33it/s]
 33%|███▎      | 122309/371472 [9:43:51<19:37:00,  3.53it/s]
 33%|███▎      | 122310/371472 [9:43:51<20:35:31,  3.36it/s]
 33%|███▎      | 122311/371472 [9:43:51<23:13:20,  2.98it/s]
 33%|███▎      | 122312/371472 [9:43:51<21:10:01,  3.27it/s]
 33%|███▎      | 122313/371472 [9:43:52<21:18:34,  3.25it/s]
 33%|███▎      | 122314/371472 [9:43:52<20:26:59,  3.38it/s]
 33%|███▎      | 122315/371472 [9:43:52<20:04:35,  3.45it/s]
 33%|███▎      | 122316/371472 [9:43:53<19:14:07,  3.60it/s]
 33%|███▎      | 122317/371472 [9:43:53<18:58:25,  3.65it/s]
 33%|███▎      | 122318/371472 [9:43:53<20:03:27,  3.45it/s]
 33%|███▎      | 122319/371472 [9:43:53<19:53:36,  3.48it/s]
 33%|███▎      | 122320/371472 [9:43:54<19:23:29,  3.57it/s]
                                                            
{'loss': 3.1207, 'learning_rate': 7.039690577258721e-07, 'epoch': 5.27}

 33%|███▎      | 122320/371472 [9:43:54<19:23:29,  3.57it/s]
 33%|███▎      | 122321/371472 [9:43:54<18:57:06,  3.65it/s]
 33%|███▎      | 122322/371472 [9:43:54<19:02:34,  3.63it/s]
 33%|███▎      | 122323/371472 [9:43:55<19:19:46,  3.58it/s]
 33%|███▎      | 122324/371472 [9:43:55<20:34:47,  3.36it/s]
 33%|███▎      | 122325/371472 [9:43:55<20:39:30,  3.35it/s]
 33%|███▎      | 122326/371472 [9:43:55<19:55:03,  3.47it/s]
 33%|███▎      | 122327/371472 [9:43:56<19:34:46,  3.53it/s]
 33%|███▎      | 122328/371472 [9:43:56<19:28:33,  3.55it/s]
 33%|███▎      | 122329/371472 [9:43:56<19:03:20,  3.63it/s]
 33%|███▎      | 122330/371472 [9:43:57<20:57:14,  3.30it/s]
 33%|███▎      | 122331/371472 [9:43:57<20:29:35,  3.38it/s]
 33%|███▎      | 122332/371472 [9:43:57<20:21:16,  3.40it/s]
 33%|███▎      | 122333/371472 [9:43:57<20:11:54,  3.43it/s]
 33%|███▎      | 122334/371472 [9:43:58<20:09:08,  3.43it/s]
 33%|███▎      | 122335/371472 [9:43:58<20:02:56,  3.45it/s]
 33%|███▎      | 122336/371472 [9:43:58<19:35:21,  3.53it/s]
 33%|███▎      | 122337/371472 [9:43:59<19:10:46,  3.61it/s]
 33%|███▎      | 122338/371472 [9:43:59<19:45:35,  3.50it/s]
 33%|███▎      | 122339/371472 [9:43:59<20:06:29,  3.44it/s]
 33%|███▎      | 122340/371472 [9:43:59<19:18:14,  3.58it/s]
                                                            
{'loss': 3.1844, 'learning_rate': 7.039205757503932e-07, 'epoch': 5.27}

 33%|███▎      | 122340/371472 [9:43:59<19:18:14,  3.58it/s]
 33%|███▎      | 122341/371472 [9:44:00<19:18:43,  3.58it/s]
 33%|███▎      | 122342/371472 [9:44:00<18:58:27,  3.65it/s]
 33%|███▎      | 122343/371472 [9:44:00<20:27:53,  3.38it/s]
 33%|███▎      | 122344/371472 [9:44:01<20:08:19,  3.44it/s]
 33%|███▎      | 122345/371472 [9:44:01<19:46:47,  3.50it/s]
 33%|███▎      | 122346/371472 [9:44:01<20:19:35,  3.40it/s]
 33%|███▎      | 122347/371472 [9:44:02<21:37:04,  3.20it/s]
 33%|███▎      | 122348/371472 [9:44:02<19:57:57,  3.47it/s]
 33%|███▎      | 122349/371472 [9:44:02<21:46:34,  3.18it/s]
 33%|███▎      | 122350/371472 [9:44:02<21:16:52,  3.25it/s]
 33%|███▎      | 122351/371472 [9:44:03<20:47:13,  3.33it/s]
 33%|███▎      | 122352/371472 [9:44:03<20:03:54,  3.45it/s]
 33%|███▎      | 122353/371472 [9:44:03<19:05:01,  3.63it/s]
 33%|███▎      | 122354/371472 [9:44:04<18:39:33,  3.71it/s]
 33%|███▎      | 122355/371472 [9:44:04<20:17:53,  3.41it/s]
 33%|███▎      | 122356/371472 [9:44:04<19:10:13,  3.61it/s]
 33%|███▎      | 122357/371472 [9:44:04<19:27:51,  3.56it/s]
 33%|███▎      | 122358/371472 [9:44:05<20:08:00,  3.44it/s]
 33%|███▎      | 122359/371472 [9:44:05<20:14:30,  3.42it/s]
 33%|███▎      | 122360/371472 [9:44:05<19:21:46,  3.57it/s]
                                                            
{'loss': 3.1571, 'learning_rate': 7.038720937749143e-07, 'epoch': 5.27}

 33%|███▎      | 122360/371472 [9:44:05<19:21:46,  3.57it/s]
 33%|███▎      | 122361/371472 [9:44:06<19:55:38,  3.47it/s]
 33%|███▎      | 122362/371472 [9:44:06<19:31:11,  3.54it/s]
 33%|███▎      | 122363/371472 [9:44:06<19:32:12,  3.54it/s]
 33%|███▎      | 122364/371472 [9:44:06<19:40:00,  3.52it/s]
 33%|███▎      | 122365/371472 [9:44:07<18:54:48,  3.66it/s]
 33%|███▎      | 122366/371472 [9:44:07<19:51:24,  3.48it/s]
 33%|███▎      | 122367/371472 [9:44:07<19:13:53,  3.60it/s]
 33%|███▎      | 122368/371472 [9:44:07<18:28:32,  3.75it/s]
 33%|███▎      | 122369/371472 [9:44:08<18:05:42,  3.82it/s]
 33%|███▎      | 122370/371472 [9:44:08<19:02:57,  3.63it/s]
 33%|███▎      | 122371/371472 [9:44:08<21:42:24,  3.19it/s]
 33%|███▎      | 122372/371472 [9:44:09<20:46:51,  3.33it/s]
 33%|███▎      | 122373/371472 [9:44:09<19:42:29,  3.51it/s]
 33%|███▎      | 122374/371472 [9:44:09<19:36:32,  3.53it/s]
 33%|███▎      | 122375/371472 [9:44:10<19:30:45,  3.55it/s]
 33%|███▎      | 122376/371472 [9:44:10<19:06:55,  3.62it/s]
 33%|███▎      | 122377/371472 [9:44:10<19:14:49,  3.59it/s]
 33%|███▎      | 122378/371472 [9:44:10<19:05:05,  3.63it/s]
 33%|███▎      | 122379/371472 [9:44:11<19:19:50,  3.58it/s]
 33%|███▎      | 122380/371472 [9:44:11<18:36:26,  3.72it/s]
                                                            
{'loss': 3.1762, 'learning_rate': 7.038236117994356e-07, 'epoch': 5.27}

 33%|███▎      | 122380/371472 [9:44:11<18:36:26,  3.72it/s]
 33%|███▎      | 122381/371472 [9:44:11<18:44:36,  3.69it/s]
 33%|███▎      | 122382/371472 [9:44:11<20:13:03,  3.42it/s]
 33%|███▎      | 122383/371472 [9:44:12<20:17:20,  3.41it/s]
 33%|███▎      | 122384/371472 [9:44:12<20:53:22,  3.31it/s]
 33%|███▎      | 122385/371472 [9:44:12<19:31:56,  3.54it/s]
 33%|███▎      | 122386/371472 [9:44:13<20:11:34,  3.43it/s]
 33%|███▎      | 122387/371472 [9:44:13<18:54:40,  3.66it/s]
 33%|███▎      | 122388/371472 [9:44:13<18:36:16,  3.72it/s]
 33%|███▎      | 122389/371472 [9:44:13<18:01:54,  3.84it/s]
 33%|███▎      | 122390/371472 [9:44:14<20:18:04,  3.41it/s]
 33%|███▎      | 122391/371472 [9:44:14<19:58:38,  3.46it/s]
 33%|███▎      | 122392/371472 [9:44:14<18:54:25,  3.66it/s]
 33%|███▎      | 122393/371472 [9:44:15<20:24:08,  3.39it/s]
 33%|███▎      | 122394/371472 [9:44:15<19:19:30,  3.58it/s]
 33%|███▎      | 122395/371472 [9:44:15<18:15:31,  3.79it/s]
 33%|███▎      | 122396/371472 [9:44:15<18:46:02,  3.69it/s]
 33%|███▎      | 122397/371472 [9:44:16<18:40:59,  3.70it/s]
 33%|███▎      | 122398/371472 [9:44:16<18:50:36,  3.67it/s]
 33%|███▎      | 122399/371472 [9:44:16<19:30:40,  3.55it/s]
 33%|███▎      | 122400/371472 [9:44:16<19:16:26,  3.59it/s]
                                                            
{'loss': 3.2898, 'learning_rate': 7.037751298239565e-07, 'epoch': 5.27}

 33%|███▎      | 122400/371472 [9:44:16<19:16:26,  3.59it/s]
 33%|███▎      | 122401/371472 [9:44:17<20:38:43,  3.35it/s]
 33%|███▎      | 122402/371472 [9:44:17<21:03:16,  3.29it/s]
 33%|███▎      | 122403/371472 [9:44:17<20:12:57,  3.42it/s]
 33%|███▎      | 122404/371472 [9:44:18<19:37:04,  3.53it/s]
 33%|███▎      | 122405/371472 [9:44:18<18:50:08,  3.67it/s]
 33%|███▎      | 122406/371472 [9:44:18<19:38:06,  3.52it/s]
 33%|███▎      | 122407/371472 [9:44:19<19:41:51,  3.51it/s]
 33%|███▎      | 122408/371472 [9:44:19<19:44:49,  3.50it/s]
 33%|███▎      | 122409/371472 [9:44:19<18:54:26,  3.66it/s]
 33%|███▎      | 122410/371472 [9:44:19<18:32:11,  3.73it/s]
 33%|███▎      | 122411/371472 [9:44:20<18:33:46,  3.73it/s]
 33%|███▎      | 122412/371472 [9:44:20<19:54:22,  3.48it/s]
 33%|███▎      | 122413/371472 [9:44:20<20:04:34,  3.45it/s]
 33%|███▎      | 122414/371472 [9:44:21<20:50:58,  3.32it/s]
 33%|███▎      | 122415/371472 [9:44:21<20:27:36,  3.38it/s]
 33%|███▎      | 122416/371472 [9:44:21<20:36:10,  3.36it/s]
 33%|███▎      | 122417/371472 [9:44:21<20:46:24,  3.33it/s]
 33%|███▎      | 122418/371472 [9:44:22<19:36:45,  3.53it/s]
 33%|███▎      | 122419/371472 [9:44:22<19:15:54,  3.59it/s]
 33%|███▎      | 122420/371472 [9:44:22<19:31:55,  3.54it/s]
                                                            
{'loss': 3.4552, 'learning_rate': 7.037266478484776e-07, 'epoch': 5.27}

 33%|███▎      | 122420/371472 [9:44:22<19:31:55,  3.54it/s]
 33%|███▎      | 122421/371472 [9:44:22<18:27:23,  3.75it/s]
 33%|███▎      | 122422/371472 [9:44:23<18:02:15,  3.84it/s]
 33%|███▎      | 122423/371472 [9:44:23<18:17:16,  3.78it/s]
 33%|███▎      | 122424/371472 [9:44:23<18:19:59,  3.77it/s]
 33%|███▎      | 122425/371472 [9:44:23<18:13:55,  3.79it/s]
 33%|███▎      | 122426/371472 [9:44:24<18:19:15,  3.78it/s]
 33%|███▎      | 122427/371472 [9:44:24<19:25:57,  3.56it/s]
 33%|███▎      | 122428/371472 [9:44:24<19:53:48,  3.48it/s]
 33%|███▎      | 122429/371472 [9:44:25<20:21:34,  3.40it/s]
 33%|███▎      | 122430/371472 [9:44:25<19:47:03,  3.50it/s]
 33%|███▎      | 122431/371472 [9:44:25<19:07:43,  3.62it/s]
 33%|███▎      | 122432/371472 [9:44:26<19:39:02,  3.52it/s]
 33%|███▎      | 122433/371472 [9:44:26<19:18:03,  3.58it/s]
 33%|███▎      | 122434/371472 [9:44:26<18:47:18,  3.68it/s]
 33%|███▎      | 122435/371472 [9:44:26<18:54:05,  3.66it/s]
 33%|███▎      | 122436/371472 [9:44:27<18:17:46,  3.78it/s]
 33%|███▎      | 122437/371472 [9:44:27<17:57:30,  3.85it/s]
 33%|███▎      | 122438/371472 [9:44:27<18:20:54,  3.77it/s]
 33%|███▎      | 122439/371472 [9:44:27<18:18:35,  3.78it/s]
 33%|███▎      | 122440/371472 [9:44:28<18:13:06,  3.80it/s]
                                                            
{'loss': 3.274, 'learning_rate': 7.036781658729987e-07, 'epoch': 5.27}

 33%|███▎      | 122440/371472 [9:44:28<18:13:06,  3.80it/s]
 33%|███▎      | 122441/371472 [9:44:28<18:23:02,  3.76it/s]
 33%|███▎      | 122442/371472 [9:44:28<20:48:34,  3.32it/s]
 33%|███▎      | 122443/371472 [9:44:29<19:42:56,  3.51it/s]
 33%|███▎      | 122444/371472 [9:44:29<19:07:26,  3.62it/s]
 33%|███▎      | 122445/371472 [9:44:29<20:14:39,  3.42it/s]
 33%|███▎      | 122446/371472 [9:44:29<19:18:16,  3.58it/s]
 33%|███▎      | 122447/371472 [9:44:30<18:41:29,  3.70it/s]
 33%|███▎      | 122448/371472 [9:44:30<18:33:43,  3.73it/s]
 33%|███▎      | 122449/371472 [9:44:30<18:03:07,  3.83it/s]
 33%|███▎      | 122450/371472 [9:44:30<19:42:12,  3.51it/s]
 33%|███▎      | 122451/371472 [9:44:31<18:45:43,  3.69it/s]
 33%|███▎      | 122452/371472 [9:44:31<18:47:36,  3.68it/s]
 33%|███▎      | 122453/371472 [9:44:31<19:08:45,  3.61it/s]
 33%|███▎      | 122454/371472 [9:44:32<19:16:17,  3.59it/s]
 33%|███▎      | 122455/371472 [9:44:32<18:17:23,  3.78it/s]
 33%|███▎      | 122456/371472 [9:44:32<19:05:56,  3.62it/s]
 33%|███▎      | 122457/371472 [9:44:32<21:13:32,  3.26it/s]
 33%|███▎      | 122458/371472 [9:44:33<20:23:56,  3.39it/s]
 33%|███▎      | 122459/371472 [9:44:33<19:14:12,  3.60it/s]
 33%|███▎      | 122460/371472 [9:44:33<18:13:06,  3.80it/s]
                                                            
{'loss': 3.2178, 'learning_rate': 7.036296838975198e-07, 'epoch': 5.27}

 33%|███▎      | 122460/371472 [9:44:33<18:13:06,  3.80it/s]
 33%|███▎      | 122461/371472 [9:44:33<18:48:54,  3.68it/s]
 33%|███▎      | 122462/371472 [9:44:34<19:33:07,  3.54it/s]
 33%|███▎      | 122463/371472 [9:44:34<19:36:37,  3.53it/s]
 33%|███▎      | 122464/371472 [9:44:34<20:05:26,  3.44it/s]
 33%|███▎      | 122465/371472 [9:44:35<20:26:57,  3.38it/s]
 33%|███▎      | 122466/371472 [9:44:35<20:14:29,  3.42it/s]
 33%|███▎      | 122467/371472 [9:44:35<20:15:24,  3.41it/s]
 33%|███▎      | 122468/371472 [9:44:36<21:48:47,  3.17it/s]
 33%|███▎      | 122469/371472 [9:44:36<21:18:10,  3.25it/s]
 33%|███▎      | 122470/371472 [9:44:36<20:59:13,  3.30it/s]
 33%|███▎      | 122471/371472 [9:44:36<19:55:15,  3.47it/s]
 33%|███▎      | 122472/371472 [9:44:37<19:35:18,  3.53it/s]
 33%|███▎      | 122473/371472 [9:44:37<18:44:36,  3.69it/s]
 33%|███▎      | 122474/371472 [9:44:37<18:21:02,  3.77it/s]
 33%|███▎      | 122475/371472 [9:44:37<18:19:25,  3.77it/s]
 33%|███▎      | 122476/371472 [9:44:38<17:59:17,  3.85it/s]
 33%|███▎      | 122477/371472 [9:44:38<18:44:34,  3.69it/s]
 33%|███▎      | 122478/371472 [9:44:38<19:49:40,  3.49it/s]
 33%|███▎      | 122479/371472 [9:44:39<19:09:58,  3.61it/s]
 33%|███▎      | 122480/371472 [9:44:39<18:26:27,  3.75it/s]
                                                            
{'loss': 3.0688, 'learning_rate': 7.03581201922041e-07, 'epoch': 5.28}

 33%|███▎      | 122480/371472 [9:44:39<18:26:27,  3.75it/s]
 33%|███▎      | 122481/371472 [9:44:39<19:32:16,  3.54it/s]
 33%|███▎      | 122482/371472 [9:44:39<18:48:03,  3.68it/s]
 33%|███▎      | 122483/371472 [9:44:40<18:04:29,  3.83it/s]
 33%|███▎      | 122484/371472 [9:44:40<18:39:19,  3.71it/s]
 33%|███▎      | 122485/371472 [9:44:40<19:33:36,  3.54it/s]
 33%|███▎      | 122486/371472 [9:44:41<20:04:12,  3.45it/s]
 33%|███▎      | 122487/371472 [9:44:41<19:23:55,  3.57it/s]
 33%|███▎      | 122488/371472 [9:44:41<19:46:10,  3.50it/s]
 33%|███▎      | 122489/371472 [9:44:41<18:56:13,  3.65it/s]
 33%|███▎      | 122490/371472 [9:44:42<21:36:45,  3.20it/s]
 33%|███▎      | 122491/371472 [9:44:42<21:43:12,  3.18it/s]
 33%|███▎      | 122492/371472 [9:44:42<21:48:18,  3.17it/s]
 33%|███▎      | 122493/371472 [9:44:43<20:54:54,  3.31it/s]
 33%|███▎      | 122494/371472 [9:44:43<20:09:09,  3.43it/s]
 33%|███▎      | 122495/371472 [9:44:43<19:57:01,  3.47it/s]
 33%|███▎      | 122496/371472 [9:44:43<19:04:54,  3.62it/s]
 33%|███▎      | 122497/371472 [9:44:44<19:54:38,  3.47it/s]
 33%|███▎      | 122498/371472 [9:44:44<22:47:11,  3.04it/s]
 33%|███▎      | 122499/371472 [9:44:45<21:57:31,  3.15it/s]
 33%|███▎      | 122500/371472 [9:44:45<20:34:23,  3.36it/s]
                                                            
{'loss': 3.1846, 'learning_rate': 7.035327199465621e-07, 'epoch': 5.28}

 33%|███▎      | 122500/371472 [9:44:45<20:34:23,  3.36it/s]
 33%|███▎      | 122501/371472 [9:44:45<21:06:26,  3.28it/s]
 33%|███▎      | 122502/371472 [9:44:45<20:00:04,  3.46it/s]
 33%|███▎      | 122503/371472 [9:44:46<19:26:36,  3.56it/s]
 33%|███▎      | 122504/371472 [9:44:46<19:17:23,  3.59it/s]
 33%|███▎      | 122505/371472 [9:44:46<18:37:07,  3.71it/s]
 33%|███▎      | 122506/371472 [9:44:46<18:21:54,  3.77it/s]
 33%|███▎      | 122507/371472 [9:44:47<18:28:42,  3.74it/s]
 33%|███▎      | 122508/371472 [9:44:47<21:19:56,  3.24it/s]
 33%|███▎      | 122509/371472 [9:44:47<20:13:30,  3.42it/s]
 33%|███▎      | 122510/371472 [9:44:48<20:04:54,  3.44it/s]
 33%|███▎      | 122511/371472 [9:44:48<19:23:09,  3.57it/s]
 33%|███▎      | 122512/371472 [9:44:48<19:21:06,  3.57it/s]
 33%|███▎      | 122513/371472 [9:44:48<18:54:05,  3.66it/s]
 33%|███▎      | 122514/371472 [9:44:49<21:40:33,  3.19it/s]
 33%|███▎      | 122515/371472 [9:44:49<22:34:22,  3.06it/s]
 33%|███▎      | 122516/371472 [9:44:49<22:42:35,  3.05it/s]
 33%|███▎      | 122517/371472 [9:44:50<21:55:47,  3.15it/s]
 33%|███▎      | 122518/371472 [9:44:50<21:19:29,  3.24it/s]
 33%|███▎      | 122519/371472 [9:44:50<21:37:34,  3.20it/s]
 33%|███▎      | 122520/371472 [9:44:51<21:19:38,  3.24it/s]
                                                            
{'loss': 3.2659, 'learning_rate': 7.034842379710832e-07, 'epoch': 5.28}

 33%|███▎      | 122520/371472 [9:44:51<21:19:38,  3.24it/s]
 33%|███▎      | 122521/371472 [9:44:51<20:25:04,  3.39it/s]
 33%|███▎      | 122522/371472 [9:44:51<20:55:46,  3.30it/s]
 33%|███▎      | 122523/371472 [9:44:52<21:42:45,  3.18it/s]
 33%|███▎      | 122524/371472 [9:44:52<22:27:08,  3.08it/s]
 33%|███▎      | 122525/371472 [9:44:52<21:00:45,  3.29it/s]
 33%|███▎      | 122526/371472 [9:44:53<22:56:41,  3.01it/s]
 33%|███▎      | 122527/371472 [9:44:53<21:20:37,  3.24it/s]
 33%|███▎      | 122528/371472 [9:44:53<21:14:25,  3.26it/s]
 33%|███▎      | 122529/371472 [9:44:53<21:28:32,  3.22it/s]
 33%|███▎      | 122530/371472 [9:44:54<20:42:08,  3.34it/s]
 33%|███▎      | 122531/371472 [9:44:54<20:15:20,  3.41it/s]
 33%|███▎      | 122532/371472 [9:44:54<20:12:52,  3.42it/s]
 33%|███▎      | 122533/371472 [9:44:55<21:10:58,  3.26it/s]
 33%|███▎      | 122534/371472 [9:44:55<20:36:46,  3.35it/s]
 33%|███▎      | 122535/371472 [9:44:55<20:02:16,  3.45it/s]
 33%|███▎      | 122536/371472 [9:44:56<20:05:20,  3.44it/s]
 33%|███▎      | 122537/371472 [9:44:56<19:47:36,  3.49it/s]
 33%|███▎      | 122538/371472 [9:44:56<18:59:09,  3.64it/s]
 33%|███▎      | 122539/371472 [9:44:56<19:27:34,  3.55it/s]
 33%|███▎      | 122540/371472 [9:44:57<18:23:07,  3.76it/s]
                                                            
{'loss': 3.2669, 'learning_rate': 7.034357559956042e-07, 'epoch': 5.28}

 33%|███▎      | 122540/371472 [9:44:57<18:23:07,  3.76it/s]
 33%|███▎      | 122541/371472 [9:44:57<17:51:45,  3.87it/s]
 33%|███▎      | 122542/371472 [9:44:57<17:19:10,  3.99it/s]
 33%|███▎      | 122543/371472 [9:44:57<17:41:22,  3.91it/s]
 33%|███▎      | 122544/371472 [9:44:58<18:52:33,  3.66it/s]
 33%|███▎      | 122545/371472 [9:44:58<18:20:27,  3.77it/s]
 33%|███▎      | 122546/371472 [9:44:58<18:06:52,  3.82it/s]
 33%|███▎      | 122547/371472 [9:44:58<18:34:14,  3.72it/s]
 33%|███▎      | 122548/371472 [9:44:59<19:22:43,  3.57it/s]
 33%|███▎      | 122549/371472 [9:44:59<19:05:06,  3.62it/s]
 33%|███▎      | 122550/371472 [9:44:59<18:13:15,  3.79it/s]
 33%|███▎      | 122551/371472 [9:44:59<18:04:05,  3.83it/s]
 33%|███▎      | 122552/371472 [9:45:00<18:34:17,  3.72it/s]
 33%|███▎      | 122553/371472 [9:45:00<18:50:33,  3.67it/s]
 33%|███▎      | 122554/371472 [9:45:00<18:44:35,  3.69it/s]
 33%|███▎      | 122555/371472 [9:45:01<19:55:06,  3.47it/s]
 33%|███▎      | 122556/371472 [9:45:01<19:53:56,  3.47it/s]
 33%|███▎      | 122557/371472 [9:45:01<21:44:31,  3.18it/s]
 33%|███▎      | 122558/371472 [9:45:02<20:34:35,  3.36it/s]
 33%|███▎      | 122559/371472 [9:45:02<20:34:45,  3.36it/s]
 33%|███▎      | 122560/371472 [9:45:02<19:27:54,  3.55it/s]
                                                            
{'loss': 3.0736, 'learning_rate': 7.033872740201254e-07, 'epoch': 5.28}

 33%|███▎      | 122560/371472 [9:45:02<19:27:54,  3.55it/s]
 33%|███▎      | 122561/371472 [9:45:02<19:04:44,  3.62it/s]
 33%|███▎      | 122562/371472 [9:45:03<18:48:33,  3.68it/s]
 33%|███▎      | 122563/371472 [9:45:03<18:23:40,  3.76it/s]
 33%|███▎      | 122564/371472 [9:45:03<18:26:02,  3.75it/s]
 33%|███▎      | 122565/371472 [9:45:03<19:39:14,  3.52it/s]
 33%|███▎      | 122566/371472 [9:45:04<19:36:52,  3.52it/s]
 33%|███▎      | 122567/371472 [9:45:04<18:49:27,  3.67it/s]
 33%|███▎      | 122568/371472 [9:45:04<18:32:47,  3.73it/s]
 33%|███▎      | 122569/371472 [9:45:05<18:43:11,  3.69it/s]
 33%|███▎      | 122570/371472 [9:45:05<18:18:54,  3.77it/s]
 33%|███▎      | 122571/371472 [9:45:05<19:29:38,  3.55it/s]
 33%|███▎      | 122572/371472 [9:45:05<19:23:50,  3.56it/s]
 33%|███▎      | 122573/371472 [9:45:06<19:32:59,  3.54it/s]
 33%|███▎      | 122574/371472 [9:45:06<18:45:25,  3.69it/s]
 33%|███▎      | 122575/371472 [9:45:06<19:03:37,  3.63it/s]
 33%|███▎      | 122576/371472 [9:45:06<19:21:55,  3.57it/s]
 33%|███▎      | 122577/371472 [9:45:07<19:18:08,  3.58it/s]
 33%|███▎      | 122578/371472 [9:45:07<19:24:27,  3.56it/s]
 33%|███▎      | 122579/371472 [9:45:07<19:35:41,  3.53it/s]
 33%|███▎      | 122580/371472 [9:45:08<19:07:25,  3.62it/s]
                                                            
{'loss': 3.2083, 'learning_rate': 7.033387920446465e-07, 'epoch': 5.28}

 33%|███▎      | 122580/371472 [9:45:08<19:07:25,  3.62it/s]
 33%|███▎      | 122581/371472 [9:45:08<18:56:40,  3.65it/s]
 33%|███▎      | 122582/371472 [9:45:08<19:36:13,  3.53it/s]
 33%|███▎      | 122583/371472 [9:45:08<19:06:07,  3.62it/s]
 33%|███▎      | 122584/371472 [9:45:09<19:29:31,  3.55it/s]
 33%|███▎      | 122585/371472 [9:45:09<19:04:55,  3.62it/s]
 33%|███▎      | 122586/371472 [9:45:09<20:44:19,  3.33it/s]
 33%|███▎      | 122587/371472 [9:45:10<19:51:16,  3.48it/s]
 33%|███▎      | 122588/371472 [9:45:10<19:03:31,  3.63it/s]
 33%|███▎      | 122589/371472 [9:45:10<19:46:38,  3.50it/s]
 33%|███▎      | 122590/371472 [9:45:10<18:50:25,  3.67it/s]
 33%|███▎      | 122591/371472 [9:45:11<19:41:37,  3.51it/s]
 33%|███▎      | 122592/371472 [9:45:11<18:50:01,  3.67it/s]
 33%|███▎      | 122593/371472 [9:45:11<19:10:18,  3.61it/s]
 33%|███▎      | 122594/371472 [9:45:12<18:48:00,  3.68it/s]
 33%|███▎      | 122595/371472 [9:45:12<20:06:17,  3.44it/s]
 33%|███▎      | 122596/371472 [9:45:12<19:31:50,  3.54it/s]
 33%|███▎      | 122597/371472 [9:45:12<20:16:58,  3.41it/s]
 33%|███▎      | 122598/371472 [9:45:13<20:08:34,  3.43it/s]
 33%|███▎      | 122599/371472 [9:45:13<19:49:12,  3.49it/s]
 33%|███▎      | 122600/371472 [9:45:13<19:07:05,  3.62it/s]
                                                            
{'loss': 3.1391, 'learning_rate': 7.032903100691676e-07, 'epoch': 5.28}

 33%|███▎      | 122600/371472 [9:45:13<19:07:05,  3.62it/s]
 33%|███▎      | 122601/371472 [9:45:13<18:38:48,  3.71it/s]
 33%|███▎      | 122602/371472 [9:45:14<18:43:04,  3.69it/s]
 33%|███▎      | 122603/371472 [9:45:14<18:29:14,  3.74it/s]
 33%|███▎      | 122604/371472 [9:45:14<18:09:29,  3.81it/s]
 33%|███▎      | 122605/371472 [9:45:15<18:21:59,  3.76it/s]
 33%|███▎      | 122606/371472 [9:45:15<18:02:14,  3.83it/s]
 33%|███▎      | 122607/371472 [9:45:15<18:07:05,  3.82it/s]
 33%|███▎      | 122608/371472 [9:45:15<18:22:03,  3.76it/s]
 33%|███▎      | 122609/371472 [9:45:16<18:19:50,  3.77it/s]
 33%|███▎      | 122610/371472 [9:45:16<18:51:09,  3.67it/s]
 33%|███▎      | 122611/371472 [9:45:16<18:45:32,  3.69it/s]
 33%|███▎      | 122612/371472 [9:45:16<18:23:20,  3.76it/s]
 33%|███▎      | 122613/371472 [9:45:17<18:33:22,  3.73it/s]
 33%|███▎      | 122614/371472 [9:45:17<18:45:42,  3.68it/s]
 33%|███▎      | 122615/371472 [9:45:17<20:49:42,  3.32it/s]
 33%|███▎      | 122616/371472 [9:45:18<20:54:38,  3.31it/s]
 33%|███▎      | 122617/371472 [9:45:18<20:14:21,  3.42it/s]
 33%|███▎      | 122618/371472 [9:45:18<20:44:27,  3.33it/s]
 33%|███▎      | 122619/371472 [9:45:19<20:17:40,  3.41it/s]
 33%|███▎      | 122620/371472 [9:45:19<19:47:56,  3.49it/s]
                                                            
{'loss': 3.4247, 'learning_rate': 7.032418280936887e-07, 'epoch': 5.28}

 33%|███▎      | 122620/371472 [9:45:19<19:47:56,  3.49it/s]
 33%|███▎      | 122621/371472 [9:45:19<19:21:33,  3.57it/s]
 33%|███▎      | 122622/371472 [9:45:19<19:09:17,  3.61it/s]
 33%|███▎      | 122623/371472 [9:45:20<18:56:09,  3.65it/s]
 33%|███▎      | 122624/371472 [9:45:20<19:20:16,  3.57it/s]
 33%|███▎      | 122625/371472 [9:45:20<20:29:37,  3.37it/s]
 33%|███▎      | 122626/371472 [9:45:20<19:30:43,  3.54it/s]
 33%|███▎      | 122627/371472 [9:45:21<20:33:21,  3.36it/s]
 33%|███▎      | 122628/371472 [9:45:21<19:55:07,  3.47it/s]
 33%|███▎      | 122629/371472 [9:45:21<19:48:50,  3.49it/s]
 33%|███▎      | 122630/371472 [9:45:22<21:05:54,  3.28it/s]
 33%|███▎      | 122631/371472 [9:45:22<21:04:27,  3.28it/s]
 33%|███▎      | 122632/371472 [9:45:22<21:46:30,  3.17it/s]
 33%|███▎      | 122633/371472 [9:45:23<20:11:20,  3.42it/s]
 33%|███▎      | 122634/371472 [9:45:23<19:59:36,  3.46it/s]
 33%|███▎      | 122635/371472 [9:45:23<19:13:01,  3.60it/s]
 33%|███▎      | 122636/371472 [9:45:23<19:43:49,  3.50it/s]
 33%|███▎      | 122637/371472 [9:45:24<19:25:30,  3.56it/s]
 33%|███▎      | 122638/371472 [9:45:24<18:24:08,  3.76it/s]
 33%|███▎      | 122639/371472 [9:45:24<19:26:35,  3.55it/s]
 33%|███▎      | 122640/371472 [9:45:24<18:40:29,  3.70it/s]
                                                            
{'loss': 3.1499, 'learning_rate': 7.031933461182099e-07, 'epoch': 5.28}

 33%|███▎      | 122640/371472 [9:45:24<18:40:29,  3.70it/s]
 33%|███▎      | 122641/371472 [9:45:25<19:45:02,  3.50it/s]
 33%|███▎      | 122642/371472 [9:45:25<19:31:08,  3.54it/s]
 33%|███▎      | 122643/371472 [9:45:25<19:05:34,  3.62it/s]
 33%|███▎      | 122644/371472 [9:45:26<18:44:13,  3.69it/s]
 33%|███▎      | 122645/371472 [9:45:26<18:03:44,  3.83it/s]
 33%|███▎      | 122646/371472 [9:45:26<18:23:44,  3.76it/s]
 33%|███▎      | 122647/371472 [9:45:27<22:42:30,  3.04it/s]
 33%|███▎      | 122648/371472 [9:45:27<21:02:55,  3.28it/s]
 33%|███▎      | 122649/371472 [9:45:27<20:15:48,  3.41it/s]
 33%|███▎      | 122650/371472 [9:45:27<19:53:11,  3.48it/s]
 33%|███▎      | 122651/371472 [9:45:28<19:22:46,  3.57it/s]
 33%|███▎      | 122652/371472 [9:45:28<19:30:22,  3.54it/s]
 33%|███▎      | 122653/371472 [9:45:28<18:42:25,  3.69it/s]
 33%|███▎      | 122654/371472 [9:45:28<18:36:12,  3.72it/s]
 33%|███▎      | 122655/371472 [9:45:29<18:49:13,  3.67it/s]
 33%|███▎      | 122656/371472 [9:45:29<18:41:15,  3.70it/s]
 33%|███▎      | 122657/371472 [9:45:29<18:49:32,  3.67it/s]
 33%|███▎      | 122658/371472 [9:45:29<18:06:27,  3.82it/s]
 33%|███▎      | 122659/371472 [9:45:30<17:55:38,  3.86it/s]
 33%|███▎      | 122660/371472 [9:45:30<20:34:54,  3.36it/s]
                                                            
{'loss': 3.2581, 'learning_rate': 7.031448641427309e-07, 'epoch': 5.28}

 33%|███▎      | 122660/371472 [9:45:30<20:34:54,  3.36it/s]
 33%|███▎      | 122661/371472 [9:45:30<20:20:40,  3.40it/s]
 33%|███▎      | 122662/371472 [9:45:31<21:20:32,  3.24it/s]
 33%|███▎      | 122663/371472 [9:45:31<20:17:14,  3.41it/s]
 33%|███▎      | 122664/371472 [9:45:31<20:09:12,  3.43it/s]
 33%|███▎      | 122665/371472 [9:45:32<19:35:35,  3.53it/s]
 33%|███▎      | 122666/371472 [9:45:32<20:54:18,  3.31it/s]
 33%|███▎      | 122667/371472 [9:45:32<20:03:46,  3.44it/s]
 33%|███▎      | 122668/371472 [9:45:32<19:11:00,  3.60it/s]
 33%|███▎      | 122669/371472 [9:45:33<21:23:11,  3.23it/s]
 33%|███▎      | 122670/371472 [9:45:33<20:57:37,  3.30it/s]
 33%|███▎      | 122671/371472 [9:45:33<19:45:44,  3.50it/s]
 33%|███▎      | 122672/371472 [9:45:34<19:43:18,  3.50it/s]
 33%|███▎      | 122673/371472 [9:45:34<19:44:33,  3.50it/s]
 33%|███▎      | 122674/371472 [9:45:34<20:05:51,  3.44it/s]
 33%|███▎      | 122675/371472 [9:45:34<19:23:03,  3.57it/s]
 33%|███▎      | 122676/371472 [9:45:35<19:17:36,  3.58it/s]
 33%|███▎      | 122677/371472 [9:45:35<18:33:52,  3.72it/s]
 33%|███▎      | 122678/371472 [9:45:35<18:34:14,  3.72it/s]
 33%|███▎      | 122679/371472 [9:45:36<18:31:24,  3.73it/s]
 33%|███▎      | 122680/371472 [9:45:36<17:55:45,  3.85it/s]
                                                            
{'loss': 3.0979, 'learning_rate': 7.030963821672519e-07, 'epoch': 5.28}

 33%|███▎      | 122680/371472 [9:45:36<17:55:45,  3.85it/s]
 33%|███▎      | 122681/371472 [9:45:36<19:03:51,  3.63it/s]
 33%|███▎      | 122682/371472 [9:45:36<18:56:16,  3.65it/s]
 33%|███▎      | 122683/371472 [9:45:37<18:18:38,  3.77it/s]
 33%|███▎      | 122684/371472 [9:45:37<18:58:20,  3.64it/s]
 33%|███▎      | 122685/371472 [9:45:37<18:59:06,  3.64it/s]
 33%|███▎      | 122686/371472 [9:45:37<19:20:34,  3.57it/s]
 33%|███▎      | 122687/371472 [9:45:38<20:05:36,  3.44it/s]
 33%|███▎      | 122688/371472 [9:45:38<19:21:42,  3.57it/s]
 33%|███▎      | 122689/371472 [9:45:38<19:15:50,  3.59it/s]
 33%|███▎      | 122690/371472 [9:45:39<19:09:00,  3.61it/s]
 33%|███▎      | 122691/371472 [9:45:39<18:16:33,  3.78it/s]
 33%|███▎      | 122692/371472 [9:45:39<21:15:47,  3.25it/s]
 33%|███▎      | 122693/371472 [9:45:39<20:04:40,  3.44it/s]
 33%|███▎      | 122694/371472 [9:45:40<19:33:52,  3.53it/s]
 33%|███▎      | 122695/371472 [9:45:40<18:57:04,  3.65it/s]
 33%|███▎      | 122696/371472 [9:45:40<18:56:04,  3.65it/s]
 33%|███▎      | 122697/371472 [9:45:41<19:08:14,  3.61it/s]
 33%|███▎      | 122698/371472 [9:45:41<19:13:09,  3.60it/s]
 33%|███▎      | 122699/371472 [9:45:41<19:58:25,  3.46it/s]
 33%|███▎      | 122700/371472 [9:45:41<18:59:13,  3.64it/s]
                                                            
{'loss': 3.0472, 'learning_rate': 7.030479001917731e-07, 'epoch': 5.28}

 33%|███▎      | 122700/371472 [9:45:41<18:59:13,  3.64it/s]
 33%|███▎      | 122701/371472 [9:45:42<18:51:35,  3.66it/s]
 33%|███▎      | 122702/371472 [9:45:42<18:26:54,  3.75it/s]
 33%|███▎      | 122703/371472 [9:45:42<19:53:21,  3.47it/s]
 33%|███▎      | 122704/371472 [9:45:43<19:58:13,  3.46it/s]
 33%|███▎      | 122705/371472 [9:45:43<19:40:15,  3.51it/s]
 33%|███▎      | 122706/371472 [9:45:43<19:41:15,  3.51it/s]
 33%|███▎      | 122707/371472 [9:45:43<19:44:45,  3.50it/s]
 33%|███▎      | 122708/371472 [9:45:44<21:31:16,  3.21it/s]
 33%|███▎      | 122709/371472 [9:45:44<20:09:38,  3.43it/s]
 33%|███▎      | 122710/371472 [9:45:44<19:51:39,  3.48it/s]
 33%|███▎      | 122711/371472 [9:45:45<19:02:10,  3.63it/s]
 33%|███▎      | 122712/371472 [9:45:45<19:27:38,  3.55it/s]
 33%|███▎      | 122713/371472 [9:45:45<18:49:41,  3.67it/s]
 33%|███▎      | 122714/371472 [9:45:45<18:28:28,  3.74it/s]
 33%|███▎      | 122715/371472 [9:45:46<18:27:59,  3.74it/s]
 33%|███▎      | 122716/371472 [9:45:46<23:38:29,  2.92it/s]
 33%|███▎      | 122717/371472 [9:45:46<22:11:58,  3.11it/s]
 33%|███▎      | 122718/371472 [9:45:47<21:18:56,  3.24it/s]
 33%|███▎      | 122719/371472 [9:45:47<20:38:20,  3.35it/s]
 33%|███▎      | 122720/371472 [9:45:47<22:07:00,  3.12it/s]
                                                            
{'loss': 3.2276, 'learning_rate': 7.029994182162943e-07, 'epoch': 5.29}

 33%|███▎      | 122720/371472 [9:45:47<22:07:00,  3.12it/s]
 33%|███▎      | 122721/371472 [9:45:48<21:09:47,  3.26it/s]
 33%|███▎      | 122722/371472 [9:45:48<21:12:42,  3.26it/s]
 33%|███▎      | 122723/371472 [9:45:48<19:50:51,  3.48it/s]
 33%|███▎      | 122724/371472 [9:45:48<19:49:28,  3.49it/s]
 33%|███▎      | 122725/371472 [9:45:49<19:45:03,  3.50it/s]
 33%|███▎      | 122726/371472 [9:45:49<19:01:52,  3.63it/s]
 33%|███▎      | 122727/371472 [9:45:49<20:13:37,  3.42it/s]
 33%|███▎      | 122728/371472 [9:45:50<20:09:45,  3.43it/s]
 33%|███▎      | 122729/371472 [9:45:50<21:00:10,  3.29it/s]
 33%|███▎      | 122730/371472 [9:45:50<20:51:30,  3.31it/s]
 33%|███▎      | 122731/371472 [9:45:51<21:22:29,  3.23it/s]
 33%|███▎      | 122732/371472 [9:45:51<19:50:53,  3.48it/s]
 33%|███▎      | 122733/371472 [9:45:51<19:26:42,  3.55it/s]
 33%|███▎      | 122734/371472 [9:45:51<18:32:08,  3.73it/s]
 33%|███▎      | 122735/371472 [9:45:52<18:07:55,  3.81it/s]
 33%|███▎      | 122736/371472 [9:45:52<18:01:24,  3.83it/s]
 33%|███▎      | 122737/371472 [9:45:52<17:56:25,  3.85it/s]
 33%|███▎      | 122738/371472 [9:45:52<19:12:40,  3.60it/s]
 33%|███▎      | 122739/371472 [9:45:53<19:19:57,  3.57it/s]
 33%|███▎      | 122740/371472 [9:45:53<19:38:30,  3.52it/s]
                                                            
{'loss': 3.2683, 'learning_rate': 7.029509362408154e-07, 'epoch': 5.29}

 33%|███▎      | 122740/371472 [9:45:53<19:38:30,  3.52it/s]
 33%|███▎      | 122741/371472 [9:45:53<19:33:42,  3.53it/s]
 33%|███▎      | 122742/371472 [9:45:54<21:25:12,  3.23it/s]
 33%|███▎      | 122743/371472 [9:45:54<20:03:37,  3.44it/s]
 33%|███▎      | 122744/371472 [9:45:54<19:29:22,  3.55it/s]
 33%|███▎      | 122745/371472 [9:45:54<18:43:07,  3.69it/s]
 33%|███▎      | 122746/371472 [9:45:55<18:10:15,  3.80it/s]
 33%|███▎      | 122747/371472 [9:45:55<20:39:22,  3.34it/s]
 33%|███▎      | 122748/371472 [9:45:55<19:19:33,  3.57it/s]
 33%|███▎      | 122749/371472 [9:45:55<18:15:20,  3.78it/s]
 33%|███▎      | 122750/371472 [9:45:56<18:34:24,  3.72it/s]
 33%|███▎      | 122751/371472 [9:45:56<19:09:27,  3.61it/s]
 33%|███▎      | 122752/371472 [9:45:56<19:37:06,  3.52it/s]
 33%|███▎      | 122753/371472 [9:45:57<18:57:36,  3.64it/s]
 33%|███▎      | 122754/371472 [9:45:57<18:30:11,  3.73it/s]
 33%|███▎      | 122755/371472 [9:45:57<19:15:33,  3.59it/s]
 33%|███▎      | 122756/371472 [9:45:57<18:32:39,  3.73it/s]
 33%|███▎      | 122757/371472 [9:45:58<20:00:29,  3.45it/s]
 33%|███▎      | 122758/371472 [9:45:58<20:18:33,  3.40it/s]
 33%|███▎      | 122759/371472 [9:45:58<20:40:03,  3.34it/s]
 33%|███▎      | 122760/371472 [9:45:59<19:37:22,  3.52it/s]
                                                            
{'loss': 3.1784, 'learning_rate': 7.029024542653364e-07, 'epoch': 5.29}

 33%|███▎      | 122760/371472 [9:45:59<19:37:22,  3.52it/s]
 33%|███▎      | 122761/371472 [9:45:59<20:23:17,  3.39it/s]
 33%|███▎      | 122762/371472 [9:45:59<19:21:27,  3.57it/s]
 33%|███▎      | 122763/371472 [9:45:59<20:08:13,  3.43it/s]
 33%|███▎      | 122764/371472 [9:46:00<20:03:54,  3.44it/s]
 33%|███▎      | 122765/371472 [9:46:00<19:55:32,  3.47it/s]
 33%|███▎      | 122766/371472 [9:46:00<21:50:42,  3.16it/s]
 33%|███▎      | 122767/371472 [9:46:01<21:00:34,  3.29it/s]
 33%|███▎      | 122768/371472 [9:46:01<20:43:37,  3.33it/s]
 33%|███▎      | 122769/371472 [9:46:01<20:42:07,  3.34it/s]
 33%|███▎      | 122770/371472 [9:46:02<20:19:01,  3.40it/s]
 33%|███▎      | 122771/371472 [9:46:02<19:19:40,  3.57it/s]
 33%|███▎      | 122772/371472 [9:46:02<18:46:27,  3.68it/s]
 33%|███▎      | 122773/371472 [9:46:02<18:59:32,  3.64it/s]
 33%|███▎      | 122774/371472 [9:46:03<18:34:24,  3.72it/s]
 33%|███▎      | 122775/371472 [9:46:03<19:53:24,  3.47it/s]
 33%|███▎      | 122776/371472 [9:46:03<19:30:31,  3.54it/s]
 33%|███▎      | 122777/371472 [9:46:03<19:24:32,  3.56it/s]
 33%|███▎      | 122778/371472 [9:46:04<19:27:22,  3.55it/s]
 33%|███▎      | 122779/371472 [9:46:04<19:57:27,  3.46it/s]
 33%|███▎      | 122780/371472 [9:46:04<19:43:38,  3.50it/s]
                                                            
{'loss': 3.3002, 'learning_rate': 7.028539722898576e-07, 'epoch': 5.29}

 33%|███▎      | 122780/371472 [9:46:04<19:43:38,  3.50it/s]
 33%|███▎      | 122781/371472 [9:46:05<19:40:40,  3.51it/s]
 33%|███▎      | 122782/371472 [9:46:05<20:14:26,  3.41it/s]
 33%|███▎      | 122783/371472 [9:46:05<20:25:48,  3.38it/s]
 33%|███▎      | 122784/371472 [9:46:05<19:14:06,  3.59it/s]
 33%|███▎      | 122785/371472 [9:46:06<18:48:23,  3.67it/s]
 33%|███▎      | 122786/371472 [9:46:06<18:20:16,  3.77it/s]
 33%|███▎      | 122787/371472 [9:46:06<18:30:29,  3.73it/s]
 33%|███▎      | 122788/371472 [9:46:07<18:17:50,  3.78it/s]
 33%|███▎      | 122789/371472 [9:46:07<18:04:30,  3.82it/s]
 33%|███▎      | 122790/371472 [9:46:07<18:39:16,  3.70it/s]
 33%|███▎      | 122791/371472 [9:46:07<18:30:15,  3.73it/s]
 33%|███▎      | 122792/371472 [9:46:08<18:01:55,  3.83it/s]
 33%|███▎      | 122793/371472 [9:46:08<18:14:39,  3.79it/s]
 33%|███▎      | 122794/371472 [9:46:08<18:19:22,  3.77it/s]
 33%|███▎      | 122795/371472 [9:46:08<18:18:37,  3.77it/s]
 33%|███▎      | 122796/371472 [9:46:09<18:40:43,  3.70it/s]
 33%|███▎      | 122797/371472 [9:46:09<19:26:33,  3.55it/s]
 33%|███▎      | 122798/371472 [9:46:09<19:04:26,  3.62it/s]
 33%|███▎      | 122799/371472 [9:46:09<18:24:16,  3.75it/s]
 33%|███▎      | 122800/371472 [9:46:10<19:10:08,  3.60it/s]
                                                            
{'loss': 3.1269, 'learning_rate': 7.028054903143786e-07, 'epoch': 5.29}

 33%|███▎      | 122800/371472 [9:46:10<19:10:08,  3.60it/s]
 33%|███▎      | 122801/371472 [9:46:10<19:44:15,  3.50it/s]
 33%|███▎      | 122802/371472 [9:46:10<19:47:35,  3.49it/s]
 33%|███▎      | 122803/371472 [9:46:11<18:56:04,  3.65it/s]
 33%|███▎      | 122804/371472 [9:46:11<19:48:38,  3.49it/s]
 33%|███▎      | 122805/371472 [9:46:11<18:53:27,  3.66it/s]
 33%|███▎      | 122806/371472 [9:46:11<18:35:34,  3.72it/s]
 33%|███▎      | 122807/371472 [9:46:12<18:55:41,  3.65it/s]
 33%|███▎      | 122808/371472 [9:46:12<19:14:05,  3.59it/s]
 33%|███▎      | 122809/371472 [9:46:12<19:09:24,  3.61it/s]
 33%|███▎      | 122810/371472 [9:46:13<19:29:22,  3.54it/s]
 33%|███▎      | 122811/371472 [9:46:13<19:06:32,  3.61it/s]
 33%|███▎      | 122812/371472 [9:46:13<19:42:16,  3.51it/s]
 33%|███▎      | 122813/371472 [9:46:13<20:02:26,  3.45it/s]
 33%|███▎      | 122814/371472 [9:46:14<20:28:11,  3.37it/s]
 33%|███▎      | 122815/371472 [9:46:14<19:27:34,  3.55it/s]
 33%|███▎      | 122816/371472 [9:46:14<19:09:57,  3.60it/s]
 33%|███▎      | 122817/371472 [9:46:15<19:12:58,  3.59it/s]
 33%|███▎      | 122818/371472 [9:46:15<18:53:33,  3.66it/s]
 33%|███▎      | 122819/371472 [9:46:15<19:41:29,  3.51it/s]
 33%|███▎      | 122820/371472 [9:46:15<19:20:06,  3.57it/s]
                                                            
{'loss': 3.1993, 'learning_rate': 7.027570083388997e-07, 'epoch': 5.29}

 33%|███▎      | 122820/371472 [9:46:15<19:20:06,  3.57it/s]
 33%|███▎      | 122821/371472 [9:46:16<21:52:27,  3.16it/s]
 33%|███▎      | 122822/371472 [9:46:16<21:07:51,  3.27it/s]
 33%|███▎      | 122823/371472 [9:46:16<21:42:00,  3.18it/s]
 33%|███▎      | 122824/371472 [9:46:17<22:03:26,  3.13it/s]
 33%|███▎      | 122825/371472 [9:46:17<21:44:22,  3.18it/s]
 33%|███▎      | 122826/371472 [9:46:17<21:03:22,  3.28it/s]
 33%|███▎      | 122827/371472 [9:46:18<20:25:23,  3.38it/s]
 33%|███▎      | 122828/371472 [9:46:18<20:00:29,  3.45it/s]
 33%|███▎      | 122829/371472 [9:46:18<20:57:29,  3.30it/s]
 33%|███▎      | 122830/371472 [9:46:18<20:34:13,  3.36it/s]
 33%|███▎      | 122831/371472 [9:46:19<19:28:39,  3.55it/s]
 33%|███▎      | 122832/371472 [9:46:19<19:48:33,  3.49it/s]
 33%|███▎      | 122833/371472 [9:46:19<19:55:03,  3.47it/s]
 33%|███▎      | 122834/371472 [9:46:20<19:36:01,  3.52it/s]
 33%|███▎      | 122835/371472 [9:46:20<19:33:19,  3.53it/s]
 33%|███▎      | 122836/371472 [9:46:20<19:05:55,  3.62it/s]
 33%|███▎      | 122837/371472 [9:46:20<18:25:36,  3.75it/s]
 33%|███▎      | 122838/371472 [9:46:21<18:27:23,  3.74it/s]
 33%|███▎      | 122839/371472 [9:46:21<18:08:45,  3.81it/s]
 33%|███▎      | 122840/371472 [9:46:21<19:01:36,  3.63it/s]
                                                            
{'loss': 3.348, 'learning_rate': 7.027085263634208e-07, 'epoch': 5.29}

 33%|███▎      | 122840/371472 [9:46:21<19:01:36,  3.63it/s]
 33%|███▎      | 122841/371472 [9:46:21<18:58:44,  3.64it/s]
 33%|███▎      | 122842/371472 [9:46:22<19:13:37,  3.59it/s]
 33%|███▎      | 122843/371472 [9:46:22<21:43:30,  3.18it/s]
 33%|███▎      | 122844/371472 [9:46:22<22:03:28,  3.13it/s]
 33%|███▎      | 122845/371472 [9:46:23<20:41:56,  3.34it/s]
 33%|███▎      | 122846/371472 [9:46:23<20:34:32,  3.36it/s]
 33%|███▎      | 122847/371472 [9:46:23<19:34:42,  3.53it/s]
 33%|███▎      | 122848/371472 [9:46:24<19:35:07,  3.53it/s]
 33%|███▎      | 122849/371472 [9:46:24<20:34:45,  3.36it/s]
 33%|███▎      | 122850/371472 [9:46:24<20:27:07,  3.38it/s]
 33%|███▎      | 122851/371472 [9:46:24<20:14:55,  3.41it/s]
 33%|███▎      | 122852/371472 [9:46:25<20:18:39,  3.40it/s]
 33%|███▎      | 122853/371472 [9:46:25<20:04:21,  3.44it/s]
 33%|███▎      | 122854/371472 [9:46:25<19:27:06,  3.55it/s]
 33%|███▎      | 122855/371472 [9:46:26<18:46:52,  3.68it/s]
 33%|███▎      | 122856/371472 [9:46:26<20:45:35,  3.33it/s]
 33%|███▎      | 122857/371472 [9:46:26<20:02:42,  3.45it/s]
 33%|███▎      | 122858/371472 [9:46:26<19:36:01,  3.52it/s]
 33%|███▎      | 122859/371472 [9:46:27<20:03:19,  3.44it/s]
 33%|███▎      | 122860/371472 [9:46:27<19:05:30,  3.62it/s]
                                                            
{'loss': 3.2302, 'learning_rate': 7.02660044387942e-07, 'epoch': 5.29}

 33%|███▎      | 122860/371472 [9:46:27<19:05:30,  3.62it/s]
 33%|███▎      | 122861/371472 [9:46:27<19:10:09,  3.60it/s]
 33%|███▎      | 122862/371472 [9:46:28<19:35:11,  3.53it/s]
 33%|███▎      | 122863/371472 [9:46:28<20:15:22,  3.41it/s]
 33%|███▎      | 122864/371472 [9:46:28<20:29:16,  3.37it/s]
 33%|███▎      | 122865/371472 [9:46:29<20:30:09,  3.37it/s]
 33%|███▎      | 122866/371472 [9:46:29<19:52:00,  3.48it/s]
 33%|███▎      | 122867/371472 [9:46:29<19:07:51,  3.61it/s]
 33%|███▎      | 122868/371472 [9:46:29<19:51:33,  3.48it/s]
 33%|███▎      | 122869/371472 [9:46:30<19:36:38,  3.52it/s]
 33%|███▎      | 122870/371472 [9:46:30<19:12:16,  3.60it/s]
 33%|███▎      | 122871/371472 [9:46:30<18:25:29,  3.75it/s]
 33%|███▎      | 122872/371472 [9:46:30<18:43:51,  3.69it/s]
 33%|███▎      | 122873/371472 [9:46:31<20:44:36,  3.33it/s]
 33%|███▎      | 122874/371472 [9:46:31<19:51:44,  3.48it/s]
 33%|███▎      | 122875/371472 [9:46:31<19:08:05,  3.61it/s]
 33%|███▎      | 122876/371472 [9:46:32<18:24:05,  3.75it/s]
 33%|███▎      | 122877/371472 [9:46:32<18:45:01,  3.68it/s]
 33%|███▎      | 122878/371472 [9:46:32<18:56:06,  3.65it/s]
 33%|███▎      | 122879/371472 [9:46:32<19:00:59,  3.63it/s]
 33%|███▎      | 122880/371472 [9:46:33<18:42:08,  3.69it/s]
                                                            
{'loss': 3.2381, 'learning_rate': 7.026115624124631e-07, 'epoch': 5.29}

 33%|███▎      | 122880/371472 [9:46:33<18:42:08,  3.69it/s]
 33%|███▎      | 122881/371472 [9:46:33<18:11:29,  3.80it/s]
 33%|███▎      | 122882/371472 [9:46:33<19:02:52,  3.63it/s]
 33%|███▎      | 122883/371472 [9:46:33<19:22:43,  3.56it/s]
 33%|███▎      | 122884/371472 [9:46:34<19:21:15,  3.57it/s]
 33%|███▎      | 122885/371472 [9:46:34<18:30:04,  3.73it/s]
 33%|███▎      | 122886/371472 [9:46:34<18:45:22,  3.68it/s]
 33%|███▎      | 122887/371472 [9:46:35<18:41:12,  3.70it/s]
 33%|███▎      | 122888/371472 [9:46:35<19:20:04,  3.57it/s]
 33%|███▎      | 122889/371472 [9:46:35<19:21:42,  3.57it/s]
 33%|███▎      | 122890/371472 [9:46:35<20:58:19,  3.29it/s]
 33%|███▎      | 122891/371472 [9:46:36<20:19:15,  3.40it/s]
 33%|███▎      | 122892/371472 [9:46:36<19:52:47,  3.47it/s]
 33%|███▎      | 122893/371472 [9:46:36<18:53:16,  3.66it/s]
 33%|███▎      | 122894/371472 [9:46:37<19:09:45,  3.60it/s]
 33%|███▎      | 122895/371472 [9:46:37<19:25:34,  3.55it/s]
 33%|███▎      | 122896/371472 [9:46:37<20:04:44,  3.44it/s]
 33%|███▎      | 122897/371472 [9:46:37<20:08:17,  3.43it/s]
 33%|███▎      | 122898/371472 [9:46:38<19:06:16,  3.61it/s]
 33%|███▎      | 122899/371472 [9:46:38<18:23:29,  3.75it/s]
 33%|███▎      | 122900/371472 [9:46:38<18:19:02,  3.77it/s]
                                                            
{'loss': 3.2901, 'learning_rate': 7.025630804369842e-07, 'epoch': 5.29}

 33%|███▎      | 122900/371472 [9:46:38<18:19:02,  3.77it/s]
 33%|███▎      | 122901/371472 [9:46:38<18:43:52,  3.69it/s]
 33%|███▎      | 122902/371472 [9:46:39<18:30:55,  3.73it/s]
 33%|███▎      | 122903/371472 [9:46:39<18:46:40,  3.68it/s]
 33%|███▎      | 122904/371472 [9:46:39<19:00:32,  3.63it/s]
 33%|███▎      | 122905/371472 [9:46:40<18:05:11,  3.82it/s]
 33%|███▎      | 122906/371472 [9:46:40<18:35:39,  3.71it/s]
 33%|███▎      | 122907/371472 [9:46:40<18:35:00,  3.72it/s]
 33%|███▎      | 122908/371472 [9:46:40<19:17:50,  3.58it/s]
 33%|███▎      | 122909/371472 [9:46:41<18:45:40,  3.68it/s]
 33%|███▎      | 122910/371472 [9:46:41<19:42:18,  3.50it/s]
 33%|███▎      | 122911/371472 [9:46:41<19:11:07,  3.60it/s]
 33%|███▎      | 122912/371472 [9:46:41<18:04:36,  3.82it/s]
 33%|███▎      | 122913/371472 [9:46:42<18:13:29,  3.79it/s]
 33%|███▎      | 122914/371472 [9:46:42<18:02:02,  3.83it/s]
 33%|███▎      | 122915/371472 [9:46:42<18:39:56,  3.70it/s]
 33%|███▎      | 122916/371472 [9:46:43<19:17:40,  3.58it/s]
 33%|███▎      | 122917/371472 [9:46:43<18:43:56,  3.69it/s]
 33%|███▎      | 122918/371472 [9:46:43<18:13:01,  3.79it/s]
 33%|███▎      | 122919/371472 [9:46:43<18:24:50,  3.75it/s]
 33%|███▎      | 122920/371472 [9:46:44<18:07:16,  3.81it/s]
                                                            
{'loss': 3.189, 'learning_rate': 7.025145984615052e-07, 'epoch': 5.29}

 33%|███▎      | 122920/371472 [9:46:44<18:07:16,  3.81it/s]
 33%|███▎      | 122921/371472 [9:46:44<17:59:57,  3.84it/s]
 33%|███▎      | 122922/371472 [9:46:44<17:49:30,  3.87it/s]
 33%|███▎      | 122923/371472 [9:46:44<17:46:07,  3.89it/s]
 33%|███▎      | 122924/371472 [9:46:45<19:13:48,  3.59it/s]
 33%|███▎      | 122925/371472 [9:46:45<18:56:29,  3.64it/s]
 33%|███▎      | 122926/371472 [9:46:45<19:11:47,  3.60it/s]
 33%|███▎      | 122927/371472 [9:46:46<19:51:04,  3.48it/s]
 33%|███▎      | 122928/371472 [9:46:46<19:12:28,  3.59it/s]
 33%|███▎      | 122929/371472 [9:46:46<20:20:38,  3.39it/s]
 33%|███▎      | 122930/371472 [9:46:46<20:22:38,  3.39it/s]
 33%|███▎      | 122931/371472 [9:46:47<21:01:07,  3.28it/s]
 33%|███▎      | 122932/371472 [9:46:47<21:27:58,  3.22it/s]
 33%|███▎      | 122933/371472 [9:46:47<20:58:30,  3.29it/s]
 33%|███▎      | 122934/371472 [9:46:48<21:20:49,  3.23it/s]
 33%|███▎      | 122935/371472 [9:46:48<19:51:37,  3.48it/s]
 33%|███▎      | 122936/371472 [9:46:48<19:25:39,  3.55it/s]
 33%|███▎      | 122937/371472 [9:46:48<18:34:34,  3.72it/s]
 33%|███▎      | 122938/371472 [9:46:49<17:53:29,  3.86it/s]
 33%|███▎      | 122939/371472 [9:46:49<17:45:30,  3.89it/s]
 33%|███▎      | 122940/371472 [9:46:49<19:54:38,  3.47it/s]
                                                            
{'loss': 3.3819, 'learning_rate': 7.024661164860264e-07, 'epoch': 5.3}

 33%|███▎      | 122940/371472 [9:46:49<19:54:38,  3.47it/s]
 33%|███▎      | 122941/371472 [9:46:50<19:04:14,  3.62it/s]
 33%|███▎      | 122942/371472 [9:46:50<18:32:34,  3.72it/s]
 33%|███▎      | 122943/371472 [9:46:50<18:57:25,  3.64it/s]
 33%|███▎      | 122944/371472 [9:46:50<18:48:07,  3.67it/s]
 33%|███▎      | 122945/371472 [9:46:51<19:01:50,  3.63it/s]
 33%|███▎      | 122946/371472 [9:46:51<18:29:39,  3.73it/s]
 33%|███▎      | 122947/371472 [9:46:51<18:31:38,  3.73it/s]
 33%|███▎      | 122948/371472 [9:46:51<19:23:25,  3.56it/s]
 33%|███▎      | 122949/371472 [9:46:52<20:03:54,  3.44it/s]
 33%|███▎      | 122950/371472 [9:46:52<20:40:12,  3.34it/s]
 33%|███▎      | 122951/371472 [9:46:52<20:04:58,  3.44it/s]
 33%|███▎      | 122952/371472 [9:46:53<18:59:15,  3.64it/s]
 33%|███▎      | 122953/371472 [9:46:53<18:47:02,  3.68it/s]
 33%|███▎      | 122954/371472 [9:46:53<19:40:06,  3.51it/s]
 33%|███▎      | 122955/371472 [9:46:53<19:15:27,  3.58it/s]
 33%|███▎      | 122956/371472 [9:46:54<18:46:22,  3.68it/s]
 33%|███▎      | 122957/371472 [9:46:54<18:24:51,  3.75it/s]
 33%|███▎      | 122958/371472 [9:46:54<20:36:52,  3.35it/s]
 33%|███▎      | 122959/371472 [9:46:55<21:11:49,  3.26it/s]
 33%|███▎      | 122960/371472 [9:46:55<20:19:21,  3.40it/s]
                                                            
{'loss': 3.2116, 'learning_rate': 7.024176345105475e-07, 'epoch': 5.3}

 33%|███▎      | 122960/371472 [9:46:55<20:19:21,  3.40it/s]
 33%|███▎      | 122961/371472 [9:46:55<19:50:00,  3.48it/s]
 33%|███▎      | 122962/371472 [9:46:55<20:11:26,  3.42it/s]
 33%|███▎      | 122963/371472 [9:46:56<20:51:13,  3.31it/s]
 33%|███▎      | 122964/371472 [9:46:56<20:24:08,  3.38it/s]
 33%|███▎      | 122965/371472 [9:46:56<19:34:56,  3.53it/s]
 33%|███▎      | 122966/371472 [9:46:57<19:24:09,  3.56it/s]
 33%|███▎      | 122967/371472 [9:46:57<19:51:47,  3.48it/s]
 33%|███▎      | 122968/371472 [9:46:57<19:31:51,  3.53it/s]
 33%|███▎      | 122969/371472 [9:46:58<20:39:52,  3.34it/s]
 33%|███▎      | 122970/371472 [9:46:58<19:57:51,  3.46it/s]
 33%|███▎      | 122971/371472 [9:46:58<20:01:51,  3.45it/s]
 33%|███▎      | 122972/371472 [9:46:58<21:19:37,  3.24it/s]
 33%|███▎      | 122973/371472 [9:46:59<20:14:07,  3.41it/s]
 33%|███▎      | 122974/371472 [9:46:59<20:23:14,  3.39it/s]
 33%|███▎      | 122975/371472 [9:46:59<19:23:11,  3.56it/s]
 33%|███▎      | 122976/371472 [9:47:00<19:17:28,  3.58it/s]
 33%|███▎      | 122977/371472 [9:47:00<20:20:20,  3.39it/s]
 33%|███▎      | 122978/371472 [9:47:00<19:42:25,  3.50it/s]
 33%|███▎      | 122979/371472 [9:47:00<20:37:16,  3.35it/s]
 33%|███▎      | 122980/371472 [9:47:01<19:46:22,  3.49it/s]
                                                            
{'loss': 3.2211, 'learning_rate': 7.023691525350685e-07, 'epoch': 5.3}

 33%|███▎      | 122980/371472 [9:47:01<19:46:22,  3.49it/s]
 33%|███▎      | 122981/371472 [9:47:01<18:52:18,  3.66it/s]
 33%|███▎      | 122982/371472 [9:47:01<18:29:05,  3.73it/s]
 33%|███▎      | 122983/371472 [9:47:01<18:39:37,  3.70it/s]
 33%|███▎      | 122984/371472 [9:47:02<18:28:16,  3.74it/s]
 33%|███▎      | 122985/371472 [9:47:02<18:19:34,  3.77it/s]
 33%|███▎      | 122986/371472 [9:47:02<18:23:04,  3.75it/s]
 33%|███▎      | 122987/371472 [9:47:03<18:06:32,  3.81it/s]
 33%|███▎      | 122988/371472 [9:47:03<18:37:03,  3.71it/s]
 33%|███▎      | 122989/371472 [9:47:03<19:18:58,  3.57it/s]
 33%|███▎      | 122990/371472 [9:47:03<19:01:05,  3.63it/s]
 33%|███▎      | 122991/371472 [9:47:04<18:27:17,  3.74it/s]
 33%|███▎      | 122992/371472 [9:47:04<18:48:45,  3.67it/s]
 33%|███▎      | 122993/371472 [9:47:04<19:11:54,  3.60it/s]
 33%|███▎      | 122994/371472 [9:47:04<18:27:24,  3.74it/s]
 33%|███▎      | 122995/371472 [9:47:05<18:36:39,  3.71it/s]
 33%|███▎      | 122996/371472 [9:47:05<19:06:37,  3.61it/s]
 33%|███▎      | 122997/371472 [9:47:05<18:51:30,  3.66it/s]
 33%|███▎      | 122998/371472 [9:47:06<19:57:16,  3.46it/s]
 33%|███▎      | 122999/371472 [9:47:06<19:52:36,  3.47it/s]
 33%|███▎      | 123000/371472 [9:47:06<19:42:15,  3.50it/s]
                                                            
{'loss': 3.3478, 'learning_rate': 7.023206705595897e-07, 'epoch': 5.3}

 33%|███▎      | 123000/371472 [9:47:06<19:42:15,  3.50it/s]
 33%|███▎      | 123001/371472 [9:47:06<19:25:33,  3.55it/s]
 33%|███▎      | 123002/371472 [9:47:07<19:23:55,  3.56it/s]
 33%|███▎      | 123003/371472 [9:47:07<18:46:12,  3.68it/s]
 33%|███▎      | 123004/371472 [9:47:07<19:32:22,  3.53it/s]
 33%|███▎      | 123005/371472 [9:47:08<19:02:47,  3.62it/s]
 33%|███▎      | 123006/371472 [9:47:08<18:34:56,  3.71it/s]
 33%|███▎      | 123007/371472 [9:47:08<19:14:18,  3.59it/s]
 33%|███▎      | 123008/371472 [9:47:08<19:09:51,  3.60it/s]
 33%|███▎      | 123009/371472 [9:47:09<18:44:41,  3.68it/s]
 33%|███▎      | 123010/371472 [9:47:09<18:56:14,  3.64it/s]
 33%|███▎      | 123011/371472 [9:47:09<20:13:21,  3.41it/s]
 33%|███▎      | 123012/371472 [9:47:10<20:36:09,  3.35it/s]
 33%|███▎      | 123013/371472 [9:47:10<19:30:59,  3.54it/s]
 33%|███▎      | 123014/371472 [9:47:10<19:30:56,  3.54it/s]
 33%|███▎      | 123015/371472 [9:47:10<20:49:23,  3.31it/s]
 33%|███▎      | 123016/371472 [9:47:11<19:35:41,  3.52it/s]
 33%|███▎      | 123017/371472 [9:47:11<18:57:25,  3.64it/s]
 33%|███▎      | 123018/371472 [9:47:11<18:40:22,  3.70it/s]
 33%|███▎      | 123019/371472 [9:47:11<18:43:32,  3.69it/s]
 33%|███▎      | 123020/371472 [9:47:12<18:25:26,  3.75it/s]
                                                            
{'loss': 3.1674, 'learning_rate': 7.022721885841109e-07, 'epoch': 5.3}

 33%|███▎      | 123020/371472 [9:47:12<18:25:26,  3.75it/s]
 33%|███▎      | 123021/371472 [9:47:12<17:45:39,  3.89it/s]
 33%|███▎      | 123022/371472 [9:47:12<18:37:30,  3.71it/s]
 33%|███▎      | 123023/371472 [9:47:13<18:18:07,  3.77it/s]
 33%|███▎      | 123024/371472 [9:47:13<17:53:46,  3.86it/s]
 33%|███▎      | 123025/371472 [9:47:13<17:36:25,  3.92it/s]
 33%|███▎      | 123026/371472 [9:47:13<18:26:50,  3.74it/s]
 33%|███▎      | 123027/371472 [9:47:14<17:53:41,  3.86it/s]
 33%|███▎      | 123028/371472 [9:47:14<18:31:38,  3.72it/s]
 33%|███▎      | 123029/371472 [9:47:14<19:23:48,  3.56it/s]
 33%|███▎      | 123030/371472 [9:47:14<19:23:30,  3.56it/s]
 33%|███▎      | 123031/371472 [9:47:15<19:18:28,  3.57it/s]
 33%|███▎      | 123032/371472 [9:47:15<18:39:00,  3.70it/s]
 33%|███▎      | 123033/371472 [9:47:15<19:02:20,  3.62it/s]
 33%|███▎      | 123034/371472 [9:47:16<19:04:26,  3.62it/s]
 33%|███▎      | 123035/371472 [9:47:16<19:58:25,  3.46it/s]
 33%|███▎      | 123036/371472 [9:47:16<19:20:52,  3.57it/s]
 33%|███▎      | 123037/371472 [9:47:16<19:28:54,  3.54it/s]
 33%|███▎      | 123038/371472 [9:47:17<19:10:48,  3.60it/s]
 33%|███▎      | 123039/371472 [9:47:17<19:07:41,  3.61it/s]
 33%|███▎      | 123040/371472 [9:47:17<18:30:45,  3.73it/s]
                                                            
{'loss': 3.3267, 'learning_rate': 7.022237066086319e-07, 'epoch': 5.3}

 33%|███▎      | 123040/371472 [9:47:17<18:30:45,  3.73it/s]
 33%|███▎      | 123041/371472 [9:47:17<18:12:07,  3.79it/s]
 33%|███▎      | 123042/371472 [9:47:18<19:13:09,  3.59it/s]
 33%|███▎      | 123043/371472 [9:47:18<18:42:40,  3.69it/s]
 33%|███▎      | 123044/371472 [9:47:18<18:41:27,  3.69it/s]
 33%|███▎      | 123045/371472 [9:47:19<18:03:39,  3.82it/s]
 33%|███▎      | 123046/371472 [9:47:19<18:13:02,  3.79it/s]
 33%|███▎      | 123047/371472 [9:47:19<17:55:07,  3.85it/s]
 33%|███▎      | 123048/371472 [9:47:19<18:28:26,  3.74it/s]
 33%|███▎      | 123049/371472 [9:47:20<19:58:57,  3.45it/s]
 33%|███▎      | 123050/371472 [9:47:20<19:25:46,  3.55it/s]
 33%|███▎      | 123051/371472 [9:47:20<19:39:25,  3.51it/s]
 33%|███▎      | 123052/371472 [9:47:20<19:22:52,  3.56it/s]
 33%|███▎      | 123053/371472 [9:47:21<19:47:47,  3.49it/s]
 33%|███▎      | 123054/371472 [9:47:21<19:14:02,  3.59it/s]
 33%|███▎      | 123055/371472 [9:47:21<19:35:28,  3.52it/s]
 33%|███▎      | 123056/371472 [9:47:22<19:55:23,  3.46it/s]
 33%|███▎      | 123057/371472 [9:47:22<19:29:23,  3.54it/s]
 33%|███▎      | 123058/371472 [9:47:22<19:40:25,  3.51it/s]
 33%|███▎      | 123059/371472 [9:47:23<21:09:52,  3.26it/s]
 33%|███▎      | 123060/371472 [9:47:23<21:10:28,  3.26it/s]
                                                            
{'loss': 3.2083, 'learning_rate': 7.021752246331529e-07, 'epoch': 5.3}

 33%|███▎      | 123060/371472 [9:47:23<21:10:28,  3.26it/s]
 33%|███▎      | 123061/371472 [9:47:23<20:32:33,  3.36it/s]
 33%|███▎      | 123062/371472 [9:47:23<19:47:09,  3.49it/s]
 33%|███▎      | 123063/371472 [9:47:24<19:19:32,  3.57it/s]
 33%|███▎      | 123064/371472 [9:47:24<18:52:04,  3.66it/s]
 33%|███▎      | 123065/371472 [9:47:24<20:46:26,  3.32it/s]
 33%|███▎      | 123066/371472 [9:47:25<21:23:55,  3.22it/s]
 33%|███▎      | 123067/371472 [9:47:25<20:32:00,  3.36it/s]
 33%|███▎      | 123068/371472 [9:47:25<19:44:41,  3.49it/s]
 33%|███▎      | 123069/371472 [9:47:25<19:02:31,  3.62it/s]
 33%|███▎      | 123070/371472 [9:47:26<18:39:51,  3.70it/s]
 33%|███▎      | 123071/371472 [9:47:26<18:48:29,  3.67it/s]
 33%|███▎      | 123072/371472 [9:47:26<19:18:41,  3.57it/s]
 33%|███▎      | 123073/371472 [9:47:27<20:28:54,  3.37it/s]
 33%|███▎      | 123074/371472 [9:47:27<19:39:05,  3.51it/s]
 33%|███▎      | 123075/371472 [9:47:27<19:29:15,  3.54it/s]
 33%|███▎      | 123076/371472 [9:47:27<19:26:18,  3.55it/s]
 33%|███▎      | 123077/371472 [9:47:28<20:16:36,  3.40it/s]
 33%|███▎      | 123078/371472 [9:47:28<21:06:50,  3.27it/s]
 33%|███▎      | 123079/371472 [9:47:28<21:15:02,  3.25it/s]
 33%|███▎      | 123080/371472 [9:47:29<20:55:36,  3.30it/s]
                                                            
{'loss': 3.1486, 'learning_rate': 7.021267426576741e-07, 'epoch': 5.3}

 33%|███▎      | 123080/371472 [9:47:29<20:55:36,  3.30it/s]
 33%|███▎      | 123081/371472 [9:47:29<21:26:46,  3.22it/s]
 33%|███▎      | 123082/371472 [9:47:29<20:46:43,  3.32it/s]
 33%|███▎      | 123083/371472 [9:47:30<20:27:17,  3.37it/s]
 33%|███▎      | 123084/371472 [9:47:30<20:01:53,  3.44it/s]
 33%|███▎      | 123085/371472 [9:47:30<20:14:00,  3.41it/s]
 33%|███▎      | 123086/371472 [9:47:30<20:12:41,  3.41it/s]
 33%|███▎      | 123087/371472 [9:47:31<20:09:14,  3.42it/s]
 33%|███▎      | 123088/371472 [9:47:31<21:35:14,  3.20it/s]
 33%|███▎      | 123089/371472 [9:47:31<20:47:18,  3.32it/s]
 33%|███▎      | 123090/371472 [9:47:32<20:21:48,  3.39it/s]
 33%|███▎      | 123091/371472 [9:47:32<20:19:56,  3.39it/s]
 33%|███▎      | 123092/371472 [9:47:32<19:42:33,  3.50it/s]
 33%|███▎      | 123093/371472 [9:47:32<19:36:22,  3.52it/s]
 33%|███▎      | 123094/371472 [9:47:33<19:58:04,  3.46it/s]
 33%|███▎      | 123095/371472 [9:47:33<18:50:01,  3.66it/s]
 33%|███▎      | 123096/371472 [9:47:33<20:31:07,  3.36it/s]
 33%|███▎      | 123097/371472 [9:47:34<20:04:17,  3.44it/s]
 33%|███▎      | 123098/371472 [9:47:34<19:59:25,  3.45it/s]
 33%|███▎      | 123099/371472 [9:47:34<21:17:01,  3.24it/s]
 33%|███▎      | 123100/371472 [9:47:35<21:16:49,  3.24it/s]
                                                            
{'loss': 3.1825, 'learning_rate': 7.020782606821953e-07, 'epoch': 5.3}

 33%|███▎      | 123100/371472 [9:47:35<21:16:49,  3.24it/s]
 33%|███▎      | 123101/371472 [9:47:35<20:54:45,  3.30it/s]
 33%|███▎      | 123102/371472 [9:47:35<20:12:18,  3.41it/s]
 33%|███▎      | 123103/371472 [9:47:35<19:46:08,  3.49it/s]
 33%|███▎      | 123104/371472 [9:47:36<19:22:59,  3.56it/s]
 33%|███▎      | 123105/371472 [9:47:36<19:43:04,  3.50it/s]
 33%|███▎      | 123106/371472 [9:47:36<19:45:07,  3.49it/s]
 33%|███▎      | 123107/371472 [9:47:36<19:05:26,  3.61it/s]
 33%|███▎      | 123108/371472 [9:47:37<19:38:38,  3.51it/s]
 33%|███▎      | 123109/371472 [9:47:37<19:42:50,  3.50it/s]
 33%|███▎      | 123110/371472 [9:47:37<20:41:09,  3.34it/s]
 33%|███▎      | 123111/371472 [9:47:38<21:10:21,  3.26it/s]
 33%|███▎      | 123112/371472 [9:47:38<20:35:32,  3.35it/s]
 33%|███▎      | 123113/371472 [9:47:38<20:16:32,  3.40it/s]
 33%|███▎      | 123114/371472 [9:47:39<20:52:11,  3.31it/s]
 33%|███▎      | 123115/371472 [9:47:39<20:23:55,  3.38it/s]
 33%|███▎      | 123116/371472 [9:47:39<20:04:41,  3.44it/s]
 33%|███▎      | 123117/371472 [9:47:39<19:17:39,  3.58it/s]
 33%|███▎      | 123118/371472 [9:47:40<18:43:39,  3.68it/s]
 33%|███▎      | 123119/371472 [9:47:40<18:12:37,  3.79it/s]
 33%|███▎      | 123120/371472 [9:47:40<18:24:43,  3.75it/s]
                                                            
{'loss': 3.4227, 'learning_rate': 7.020297787067164e-07, 'epoch': 5.3}

 33%|███▎      | 123120/371472 [9:47:40<18:24:43,  3.75it/s]
 33%|███▎      | 123121/371472 [9:47:41<19:19:26,  3.57it/s]
 33%|███▎      | 123122/371472 [9:47:41<19:10:57,  3.60it/s]
 33%|███▎      | 123123/371472 [9:47:41<21:46:36,  3.17it/s]
 33%|███▎      | 123124/371472 [9:47:41<21:03:17,  3.28it/s]
 33%|███▎      | 123125/371472 [9:47:42<20:17:17,  3.40it/s]
 33%|███▎      | 123126/371472 [9:47:42<20:06:09,  3.43it/s]
 33%|███▎      | 123127/371472 [9:47:42<18:55:51,  3.64it/s]
 33%|███▎      | 123128/371472 [9:47:43<18:04:08,  3.82it/s]
 33%|███▎      | 123129/371472 [9:47:43<17:49:18,  3.87it/s]
 33%|███▎      | 123130/371472 [9:47:43<18:14:05,  3.78it/s]
 33%|███▎      | 123131/371472 [9:47:43<20:24:07,  3.38it/s]
 33%|███▎      | 123132/371472 [9:47:44<20:39:35,  3.34it/s]
 33%|███▎      | 123133/371472 [9:47:44<20:34:13,  3.35it/s]
 33%|███▎      | 123134/371472 [9:47:44<20:07:52,  3.43it/s]
 33%|███▎      | 123135/371472 [9:47:45<19:19:32,  3.57it/s]
 33%|███▎      | 123136/371472 [9:47:45<19:44:20,  3.49it/s]
 33%|███▎      | 123137/371472 [9:47:45<23:30:36,  2.93it/s]
 33%|███▎      | 123138/371472 [9:47:46<21:40:50,  3.18it/s]
 33%|███▎      | 123139/371472 [9:47:46<21:06:22,  3.27it/s]
 33%|███▎      | 123140/371472 [9:47:46<20:07:18,  3.43it/s]
                                                            
{'loss': 3.102, 'learning_rate': 7.019812967312374e-07, 'epoch': 5.3}

 33%|███▎      | 123140/371472 [9:47:46<20:07:18,  3.43it/s]
 33%|███▎      | 123141/371472 [9:47:46<19:03:41,  3.62it/s]
 33%|███▎      | 123142/371472 [9:47:47<19:08:44,  3.60it/s]
 33%|███▎      | 123143/371472 [9:47:47<19:08:42,  3.60it/s]
 33%|███▎      | 123144/371472 [9:47:47<18:27:31,  3.74it/s]
 33%|███▎      | 123145/371472 [9:47:47<18:53:27,  3.65it/s]
 33%|███▎      | 123146/371472 [9:47:48<18:46:31,  3.67it/s]
 33%|███▎      | 123147/371472 [9:47:48<18:27:47,  3.74it/s]
 33%|███▎      | 123148/371472 [9:47:48<18:51:26,  3.66it/s]
 33%|███▎      | 123149/371472 [9:47:49<19:30:19,  3.54it/s]
 33%|███▎      | 123150/371472 [9:47:49<20:09:02,  3.42it/s]
 33%|███▎      | 123151/371472 [9:47:49<20:28:36,  3.37it/s]
 33%|███▎      | 123152/371472 [9:47:49<20:13:47,  3.41it/s]
 33%|███▎      | 123153/371472 [9:47:50<18:53:38,  3.65it/s]
 33%|███▎      | 123154/371472 [9:47:50<21:13:45,  3.25it/s]
 33%|███▎      | 123155/371472 [9:47:50<20:04:54,  3.43it/s]
 33%|███▎      | 123156/371472 [9:47:51<19:14:44,  3.58it/s]
 33%|███▎      | 123157/371472 [9:47:51<18:54:50,  3.65it/s]
 33%|███▎      | 123158/371472 [9:47:51<19:17:02,  3.58it/s]
 33%|███▎      | 123159/371472 [9:47:51<20:25:10,  3.38it/s]
 33%|███▎      | 123160/371472 [9:47:52<19:13:23,  3.59it/s]
                                                            
{'loss': 3.1699, 'learning_rate': 7.019328147557586e-07, 'epoch': 5.3}

 33%|███▎      | 123160/371472 [9:47:52<19:13:23,  3.59it/s]
 33%|███▎      | 123161/371472 [9:47:52<18:34:33,  3.71it/s]
 33%|███▎      | 123162/371472 [9:47:52<18:55:19,  3.65it/s]
 33%|███▎      | 123163/371472 [9:47:52<18:23:58,  3.75it/s]
 33%|███▎      | 123164/371472 [9:47:53<19:03:35,  3.62it/s]
 33%|███▎      | 123165/371472 [9:47:53<19:13:36,  3.59it/s]
 33%|███▎      | 123166/371472 [9:47:53<18:30:13,  3.73it/s]
 33%|███▎      | 123167/371472 [9:47:54<19:05:35,  3.61it/s]
 33%|███▎      | 123168/371472 [9:47:54<19:15:42,  3.58it/s]
 33%|███▎      | 123169/371472 [9:47:54<19:17:25,  3.58it/s]
 33%|███▎      | 123170/371472 [9:47:54<19:26:49,  3.55it/s]
 33%|███▎      | 123171/371472 [9:47:55<18:54:11,  3.65it/s]
 33%|███▎      | 123172/371472 [9:47:55<18:26:50,  3.74it/s]
 33%|███▎      | 123173/371472 [9:47:55<18:47:03,  3.67it/s]
 33%|███▎      | 123174/371472 [9:47:56<19:16:27,  3.58it/s]
 33%|███▎      | 123175/371472 [9:47:56<20:31:50,  3.36it/s]
 33%|███▎      | 123176/371472 [9:47:56<20:24:03,  3.38it/s]
 33%|███▎      | 123177/371472 [9:47:57<21:02:51,  3.28it/s]
 33%|███▎      | 123178/371472 [9:47:57<20:07:59,  3.43it/s]
 33%|███▎      | 123179/371472 [9:47:57<20:44:07,  3.33it/s]
 33%|███▎      | 123180/371472 [9:47:57<20:29:11,  3.37it/s]
                                                            
{'loss': 3.2191, 'learning_rate': 7.018843327802797e-07, 'epoch': 5.31}

 33%|███▎      | 123180/371472 [9:47:57<20:29:11,  3.37it/s]
 33%|███▎      | 123181/371472 [9:47:58<19:41:17,  3.50it/s]
 33%|███▎      | 123182/371472 [9:47:58<19:07:47,  3.61it/s]
 33%|███▎      | 123183/371472 [9:47:58<19:38:08,  3.51it/s]
 33%|███▎      | 123184/371472 [9:47:58<19:21:57,  3.56it/s]
 33%|███▎      | 123185/371472 [9:47:59<20:30:43,  3.36it/s]
 33%|███▎      | 123186/371472 [9:47:59<20:08:09,  3.43it/s]
 33%|███▎      | 123187/371472 [9:47:59<20:13:29,  3.41it/s]
 33%|███▎      | 123188/371472 [9:48:00<19:58:30,  3.45it/s]
 33%|███▎      | 123189/371472 [9:48:00<19:17:37,  3.57it/s]
 33%|███▎      | 123190/371472 [9:48:00<19:26:59,  3.55it/s]
 33%|███▎      | 123191/371472 [9:48:01<19:50:46,  3.48it/s]
 33%|███▎      | 123192/371472 [9:48:01<19:19:13,  3.57it/s]
 33%|███▎      | 123193/371472 [9:48:01<18:36:51,  3.70it/s]
 33%|███▎      | 123194/371472 [9:48:01<17:45:42,  3.88it/s]
 33%|███▎      | 123195/371472 [9:48:02<19:05:01,  3.61it/s]
 33%|███▎      | 123196/371472 [9:48:02<19:27:34,  3.54it/s]
 33%|███▎      | 123197/371472 [9:48:02<19:24:36,  3.55it/s]
 33%|███▎      | 123198/371472 [9:48:02<19:00:58,  3.63it/s]
 33%|███▎      | 123199/371472 [9:48:03<18:22:42,  3.75it/s]
 33%|███▎      | 123200/371472 [9:48:03<19:36:35,  3.52it/s]
                                                            
{'loss': 3.3449, 'learning_rate': 7.018358508048008e-07, 'epoch': 5.31}

 33%|███▎      | 123200/371472 [9:48:03<19:36:35,  3.52it/s]
 33%|███▎      | 123201/371472 [9:48:03<20:02:25,  3.44it/s]
 33%|███▎      | 123202/371472 [9:48:04<19:17:20,  3.58it/s]
 33%|███▎      | 123203/371472 [9:48:04<18:30:07,  3.73it/s]
 33%|███▎      | 123204/371472 [9:48:04<18:12:50,  3.79it/s]
 33%|███▎      | 123205/371472 [9:48:04<17:38:55,  3.91it/s]
 33%|███▎      | 123206/371472 [9:48:05<19:35:12,  3.52it/s]
 33%|███▎      | 123207/371472 [9:48:05<19:01:56,  3.62it/s]
 33%|███▎      | 123208/371472 [9:48:05<19:07:24,  3.61it/s]
 33%|███▎      | 123209/371472 [9:48:05<19:10:10,  3.60it/s]
 33%|███▎      | 123210/371472 [9:48:06<20:12:53,  3.41it/s]
 33%|███▎      | 123211/371472 [9:48:06<19:24:51,  3.55it/s]
 33%|███▎      | 123212/371472 [9:48:06<19:13:18,  3.59it/s]
 33%|███▎      | 123213/371472 [9:48:07<19:29:14,  3.54it/s]
 33%|███▎      | 123214/371472 [9:48:07<19:30:45,  3.53it/s]
 33%|███▎      | 123215/371472 [9:48:07<19:25:34,  3.55it/s]
 33%|███▎      | 123216/371472 [9:48:07<18:36:51,  3.70it/s]
 33%|███▎      | 123217/371472 [9:48:08<18:45:55,  3.67it/s]
 33%|███▎      | 123218/371472 [9:48:08<18:55:33,  3.64it/s]
 33%|███▎      | 123219/371472 [9:48:08<19:08:39,  3.60it/s]
 33%|███▎      | 123220/371472 [9:48:09<19:37:01,  3.52it/s]
                                                            
{'loss': 3.3355, 'learning_rate': 7.017873688293218e-07, 'epoch': 5.31}

 33%|███▎      | 123220/371472 [9:48:09<19:37:01,  3.52it/s]
 33%|███▎      | 123221/371472 [9:48:09<19:56:24,  3.46it/s]
 33%|███▎      | 123222/371472 [9:48:09<19:28:29,  3.54it/s]
 33%|███▎      | 123223/371472 [9:48:09<19:55:43,  3.46it/s]
 33%|███▎      | 123224/371472 [9:48:10<19:21:11,  3.56it/s]
 33%|███▎      | 123225/371472 [9:48:10<19:24:18,  3.55it/s]
 33%|███▎      | 123226/371472 [9:48:10<18:18:40,  3.77it/s]
 33%|███▎      | 123227/371472 [9:48:10<18:06:13,  3.81it/s]
 33%|███▎      | 123228/371472 [9:48:11<19:05:18,  3.61it/s]
 33%|███▎      | 123229/371472 [9:48:11<18:45:25,  3.68it/s]
 33%|███▎      | 123230/371472 [9:48:11<18:04:38,  3.81it/s]
 33%|███▎      | 123231/371472 [9:48:12<18:40:00,  3.69it/s]
 33%|███▎      | 123232/371472 [9:48:12<18:24:35,  3.75it/s]
 33%|███▎      | 123233/371472 [9:48:12<19:40:41,  3.50it/s]
 33%|███▎      | 123234/371472 [9:48:12<20:45:32,  3.32it/s]
 33%|███▎      | 123235/371472 [9:48:13<20:14:43,  3.41it/s]
 33%|███▎      | 123236/371472 [9:48:13<20:03:07,  3.44it/s]
 33%|███▎      | 123237/371472 [9:48:13<21:08:34,  3.26it/s]
 33%|███▎      | 123238/371472 [9:48:14<20:28:13,  3.37it/s]
 33%|███▎      | 123239/371472 [9:48:14<20:02:47,  3.44it/s]
 33%|███▎      | 123240/371472 [9:48:14<20:16:03,  3.40it/s]
                                                            
{'loss': 3.2185, 'learning_rate': 7.01738886853843e-07, 'epoch': 5.31}

 33%|███▎      | 123240/371472 [9:48:14<20:16:03,  3.40it/s]
 33%|███▎      | 123241/371472 [9:48:15<20:42:34,  3.33it/s]
 33%|███▎      | 123242/371472 [9:48:15<19:43:50,  3.49it/s]
 33%|███▎      | 123243/371472 [9:48:15<18:54:46,  3.65it/s]
 33%|███▎      | 123244/371472 [9:48:15<18:30:52,  3.72it/s]
 33%|███▎      | 123245/371472 [9:48:16<19:00:48,  3.63it/s]
 33%|███▎      | 123246/371472 [9:48:16<18:44:01,  3.68it/s]
 33%|███▎      | 123247/371472 [9:48:16<18:46:36,  3.67it/s]
 33%|███▎      | 123248/371472 [9:48:16<18:20:58,  3.76it/s]
 33%|███▎      | 123249/371472 [9:48:17<20:25:37,  3.38it/s]
 33%|███▎      | 123250/371472 [9:48:17<20:13:59,  3.41it/s]
 33%|███▎      | 123251/371472 [9:48:17<19:33:58,  3.52it/s]
 33%|███▎      | 123252/371472 [9:48:18<19:21:05,  3.56it/s]
 33%|███▎      | 123253/371472 [9:48:18<18:54:33,  3.65it/s]
 33%|███▎      | 123254/371472 [9:48:18<18:07:17,  3.80it/s]
 33%|███▎      | 123255/371472 [9:48:18<18:34:02,  3.71it/s]
 33%|███▎      | 123256/371472 [9:48:19<19:00:27,  3.63it/s]
 33%|███▎      | 123257/371472 [9:48:19<18:25:33,  3.74it/s]
 33%|███▎      | 123258/371472 [9:48:19<18:29:11,  3.73it/s]
 33%|███▎      | 123259/371472 [9:48:19<18:16:23,  3.77it/s]
 33%|███▎      | 123260/371472 [9:48:20<20:25:06,  3.38it/s]
                                                            
{'loss': 3.1446, 'learning_rate': 7.016904048783642e-07, 'epoch': 5.31}

 33%|███▎      | 123260/371472 [9:48:20<20:25:06,  3.38it/s]
 33%|███▎      | 123261/371472 [9:48:20<20:11:59,  3.41it/s]
 33%|███▎      | 123262/371472 [9:48:20<21:06:43,  3.27it/s]
 33%|███▎      | 123263/371472 [9:48:21<20:10:31,  3.42it/s]
 33%|███▎      | 123264/371472 [9:48:21<19:54:07,  3.46it/s]
 33%|███▎      | 123265/371472 [9:48:21<20:52:00,  3.30it/s]
 33%|███▎      | 123266/371472 [9:48:22<20:45:12,  3.32it/s]
 33%|███▎      | 123267/371472 [9:48:22<19:48:37,  3.48it/s]
 33%|███▎      | 123268/371472 [9:48:22<20:06:49,  3.43it/s]
 33%|███▎      | 123269/371472 [9:48:22<20:00:07,  3.45it/s]
 33%|███▎      | 123270/371472 [9:48:23<19:47:22,  3.48it/s]
 33%|███▎      | 123271/371472 [9:48:23<20:56:32,  3.29it/s]
 33%|███▎      | 123272/371472 [9:48:23<21:49:39,  3.16it/s]
 33%|███▎      | 123273/371472 [9:48:24<22:55:24,  3.01it/s]
 33%|███▎      | 123274/371472 [9:48:24<22:20:36,  3.09it/s]
 33%|███▎      | 123275/371472 [9:48:24<23:01:45,  2.99it/s]
 33%|███▎      | 123276/371472 [9:48:25<22:30:31,  3.06it/s]
 33%|███▎      | 123277/371472 [9:48:25<22:36:35,  3.05it/s]
 33%|███▎      | 123278/371472 [9:48:25<21:56:18,  3.14it/s]
 33%|███▎      | 123279/371472 [9:48:26<22:35:55,  3.05it/s]
 33%|███▎      | 123280/371472 [9:48:26<22:39:04,  3.04it/s]
                                                            
{'loss': 3.237, 'learning_rate': 7.016419229028853e-07, 'epoch': 5.31}

 33%|███▎      | 123280/371472 [9:48:26<22:39:04,  3.04it/s]
 33%|███▎      | 123281/371472 [9:48:26<20:48:49,  3.31it/s]
 33%|███▎      | 123282/371472 [9:48:27<19:41:10,  3.50it/s]
 33%|███▎      | 123283/371472 [9:48:27<19:48:43,  3.48it/s]
 33%|███▎      | 123284/371472 [9:48:27<20:36:58,  3.34it/s]
 33%|███▎      | 123285/371472 [9:48:27<19:07:17,  3.61it/s]
 33%|███▎      | 123286/371472 [9:48:28<19:02:08,  3.62it/s]
 33%|███▎      | 123287/371472 [9:48:28<18:39:19,  3.70it/s]
 33%|███▎      | 123288/371472 [9:48:28<18:57:05,  3.64it/s]
 33%|███▎      | 123289/371472 [9:48:28<18:22:37,  3.75it/s]
 33%|███▎      | 123290/371472 [9:48:29<20:00:04,  3.45it/s]
 33%|███▎      | 123291/371472 [9:48:29<19:20:19,  3.56it/s]
 33%|███▎      | 123292/371472 [9:48:29<19:13:56,  3.58it/s]
 33%|███▎      | 123293/371472 [9:48:30<18:38:14,  3.70it/s]
 33%|███▎      | 123294/371472 [9:48:30<18:24:37,  3.74it/s]
 33%|███▎      | 123295/371472 [9:48:30<18:23:15,  3.75it/s]
 33%|███▎      | 123296/371472 [9:48:30<18:25:03,  3.74it/s]
 33%|███▎      | 123297/371472 [9:48:31<19:31:47,  3.53it/s]
 33%|███▎      | 123298/371472 [9:48:31<20:40:58,  3.33it/s]
 33%|███▎      | 123299/371472 [9:48:31<21:23:12,  3.22it/s]
 33%|███▎      | 123300/371472 [9:48:32<21:59:08,  3.14it/s]
                                                            
{'loss': 3.2808, 'learning_rate': 7.015934409274062e-07, 'epoch': 5.31}

 33%|███▎      | 123300/371472 [9:48:32<21:59:08,  3.14it/s]
 33%|███▎      | 123301/371472 [9:48:32<21:55:52,  3.14it/s]
 33%|███▎      | 123302/371472 [9:48:32<20:30:40,  3.36it/s]
 33%|███▎      | 123303/371472 [9:48:32<19:28:07,  3.54it/s]
 33%|███▎      | 123304/371472 [9:48:33<19:04:06,  3.62it/s]
 33%|███▎      | 123305/371472 [9:48:33<18:48:08,  3.67it/s]
 33%|███▎      | 123306/371472 [9:48:33<18:37:03,  3.70it/s]
 33%|███▎      | 123307/371472 [9:48:34<18:32:07,  3.72it/s]
 33%|███▎      | 123308/371472 [9:48:34<17:58:44,  3.83it/s]
 33%|███▎      | 123309/371472 [9:48:34<19:19:12,  3.57it/s]
 33%|███▎      | 123310/371472 [9:48:34<19:13:43,  3.58it/s]
 33%|███▎      | 123311/371472 [9:48:35<21:13:08,  3.25it/s]
 33%|███▎      | 123312/371472 [9:48:35<20:12:53,  3.41it/s]
 33%|███▎      | 123313/371472 [9:48:35<19:48:03,  3.48it/s]
 33%|███▎      | 123314/371472 [9:48:36<19:46:36,  3.49it/s]
 33%|███▎      | 123315/371472 [9:48:36<19:38:29,  3.51it/s]
 33%|███▎      | 123316/371472 [9:48:36<19:45:13,  3.49it/s]
 33%|███▎      | 123317/371472 [9:48:36<19:00:26,  3.63it/s]
 33%|███▎      | 123318/371472 [9:48:37<21:24:11,  3.22it/s]
 33%|███▎      | 123319/371472 [9:48:37<20:53:30,  3.30it/s]
 33%|███▎      | 123320/371472 [9:48:37<20:06:24,  3.43it/s]
                                                            
{'loss': 3.248, 'learning_rate': 7.015449589519274e-07, 'epoch': 5.31}

 33%|███▎      | 123320/371472 [9:48:37<20:06:24,  3.43it/s]
 33%|███▎      | 123321/371472 [9:48:38<21:00:40,  3.28it/s]
 33%|███▎      | 123322/371472 [9:48:38<20:22:02,  3.38it/s]
 33%|███▎      | 123323/371472 [9:48:38<19:37:42,  3.51it/s]
 33%|███▎      | 123324/371472 [9:48:38<18:53:41,  3.65it/s]
 33%|███▎      | 123325/371472 [9:48:39<18:23:40,  3.75it/s]
 33%|███▎      | 123326/371472 [9:48:39<19:09:24,  3.60it/s]
 33%|███▎      | 123327/371472 [9:48:39<19:30:32,  3.53it/s]
 33%|███▎      | 123328/371472 [9:48:40<19:03:19,  3.62it/s]
 33%|███▎      | 123329/371472 [9:48:40<18:31:57,  3.72it/s]
 33%|███▎      | 123330/371472 [9:48:40<19:25:42,  3.55it/s]
 33%|███▎      | 123331/371472 [9:48:40<20:12:53,  3.41it/s]
 33%|███▎      | 123332/371472 [9:48:41<19:35:56,  3.52it/s]
 33%|███▎      | 123333/371472 [9:48:41<19:17:07,  3.57it/s]
 33%|███▎      | 123334/371472 [9:48:41<19:02:41,  3.62it/s]
 33%|███▎      | 123335/371472 [9:48:42<19:04:13,  3.61it/s]
 33%|███▎      | 123336/371472 [9:48:42<18:37:22,  3.70it/s]
 33%|███▎      | 123337/371472 [9:48:42<18:25:06,  3.74it/s]
 33%|███▎      | 123338/371472 [9:48:42<18:12:18,  3.79it/s]
 33%|███▎      | 123339/371472 [9:48:43<20:17:36,  3.40it/s]
 33%|███▎      | 123340/371472 [9:48:43<20:26:37,  3.37it/s]
                                                            
{'loss': 3.2058, 'learning_rate': 7.014964769764485e-07, 'epoch': 5.31}

 33%|███▎      | 123340/371472 [9:48:43<20:26:37,  3.37it/s]
 33%|███▎      | 123341/371472 [9:48:43<21:53:53,  3.15it/s]
 33%|███▎      | 123342/371472 [9:48:44<21:48:34,  3.16it/s]
 33%|███▎      | 123343/371472 [9:48:44<20:48:13,  3.31it/s]
 33%|███▎      | 123344/371472 [9:48:44<20:10:35,  3.42it/s]
 33%|███▎      | 123345/371472 [9:48:44<19:41:23,  3.50it/s]
 33%|███▎      | 123346/371472 [9:48:45<19:46:08,  3.49it/s]
 33%|███▎      | 123347/371472 [9:48:45<21:22:18,  3.22it/s]
 33%|███▎      | 123348/371472 [9:48:45<20:42:10,  3.33it/s]
 33%|███▎      | 123349/371472 [9:48:46<21:09:10,  3.26it/s]
 33%|███▎      | 123350/371472 [9:48:46<20:18:04,  3.40it/s]
 33%|███▎      | 123351/371472 [9:48:46<18:59:40,  3.63it/s]
 33%|███▎      | 123352/371472 [9:48:46<18:11:04,  3.79it/s]
 33%|███▎      | 123353/371472 [9:48:47<19:07:40,  3.60it/s]
 33%|███▎      | 123354/371472 [9:48:47<19:00:48,  3.62it/s]
 33%|███▎      | 123355/371472 [9:48:47<19:07:27,  3.60it/s]
 33%|███▎      | 123356/371472 [9:48:48<19:15:55,  3.58it/s]
 33%|███▎      | 123357/371472 [9:48:48<18:15:29,  3.77it/s]
 33%|███▎      | 123358/371472 [9:48:48<18:40:44,  3.69it/s]
 33%|███▎      | 123359/371472 [9:48:48<19:54:34,  3.46it/s]
 33%|███▎      | 123360/371472 [9:48:49<18:50:56,  3.66it/s]
                                                            
{'loss': 3.4605, 'learning_rate': 7.014479950009695e-07, 'epoch': 5.31}

 33%|███▎      | 123360/371472 [9:48:49<18:50:56,  3.66it/s]
 33%|███▎      | 123361/371472 [9:48:49<18:45:24,  3.67it/s]
 33%|███▎      | 123362/371472 [9:48:49<18:10:59,  3.79it/s]
 33%|███▎      | 123363/371472 [9:48:49<18:32:27,  3.72it/s]
 33%|███▎      | 123364/371472 [9:48:50<20:32:24,  3.36it/s]
 33%|███▎      | 123365/371472 [9:48:50<20:59:39,  3.28it/s]
 33%|███▎      | 123366/371472 [9:48:50<20:07:08,  3.43it/s]
 33%|███▎      | 123367/371472 [9:48:51<20:40:02,  3.33it/s]
 33%|███▎      | 123368/371472 [9:48:51<21:10:32,  3.25it/s]
 33%|███▎      | 123369/371472 [9:48:51<20:09:56,  3.42it/s]
 33%|███▎      | 123370/371472 [9:48:52<19:29:35,  3.54it/s]
 33%|███▎      | 123371/371472 [9:48:52<18:51:20,  3.65it/s]
 33%|███▎      | 123372/371472 [9:48:52<18:10:06,  3.79it/s]
 33%|███▎      | 123373/371472 [9:48:52<17:43:50,  3.89it/s]
 33%|███▎      | 123374/371472 [9:48:53<18:32:03,  3.72it/s]
 33%|███▎      | 123375/371472 [9:48:53<18:38:29,  3.70it/s]
 33%|███▎      | 123376/371472 [9:48:53<18:39:50,  3.69it/s]
 33%|███▎      | 123377/371472 [9:48:53<19:03:04,  3.62it/s]
 33%|███▎      | 123378/371472 [9:48:54<20:04:28,  3.43it/s]
 33%|███▎      | 123379/371472 [9:48:54<20:06:54,  3.43it/s]
 33%|███▎      | 123380/371472 [9:48:54<19:42:53,  3.50it/s]
                                                            
{'loss': 3.2334, 'learning_rate': 7.013995130254907e-07, 'epoch': 5.31}

 33%|███▎      | 123380/371472 [9:48:54<19:42:53,  3.50it/s]
 33%|███▎      | 123381/371472 [9:48:55<19:23:26,  3.55it/s]
 33%|███▎      | 123382/371472 [9:48:55<19:57:41,  3.45it/s]
 33%|███▎      | 123383/371472 [9:48:55<19:25:53,  3.55it/s]
 33%|███▎      | 123384/371472 [9:48:55<18:47:25,  3.67it/s]
 33%|███▎      | 123385/371472 [9:48:56<20:43:21,  3.33it/s]
 33%|███▎      | 123386/371472 [9:48:56<20:58:50,  3.28it/s]
 33%|███▎      | 123387/371472 [9:48:56<21:32:50,  3.20it/s]
 33%|███▎      | 123388/371472 [9:48:57<20:50:45,  3.31it/s]
 33%|███▎      | 123389/371472 [9:48:57<20:09:36,  3.42it/s]
 33%|███▎      | 123390/371472 [9:48:57<20:57:35,  3.29it/s]
 33%|███▎      | 123391/371472 [9:48:58<21:32:33,  3.20it/s]
 33%|███▎      | 123392/371472 [9:48:58<20:26:18,  3.37it/s]
 33%|███▎      | 123393/371472 [9:48:58<19:57:41,  3.45it/s]
 33%|███▎      | 123394/371472 [9:48:58<19:01:55,  3.62it/s]
 33%|███▎      | 123395/371472 [9:48:59<18:16:08,  3.77it/s]
 33%|███▎      | 123396/371472 [9:48:59<19:29:13,  3.54it/s]
 33%|███▎      | 123397/371472 [9:48:59<19:10:09,  3.59it/s]
 33%|███▎      | 123398/371472 [9:49:00<19:26:46,  3.54it/s]
 33%|███▎      | 123399/371472 [9:49:00<18:59:41,  3.63it/s]
 33%|███▎      | 123400/371472 [9:49:00<18:39:01,  3.69it/s]
                                                            
{'loss': 3.2318, 'learning_rate': 7.013510310500119e-07, 'epoch': 5.32}

 33%|███▎      | 123400/371472 [9:49:00<18:39:01,  3.69it/s]
 33%|███▎      | 123401/371472 [9:49:00<19:55:05,  3.46it/s]
 33%|███▎      | 123402/371472 [9:49:01<19:15:54,  3.58it/s]
 33%|███▎      | 123403/371472 [9:49:01<20:05:17,  3.43it/s]
 33%|███▎      | 123404/371472 [9:49:01<19:45:55,  3.49it/s]
 33%|███▎      | 123405/371472 [9:49:02<20:06:30,  3.43it/s]
 33%|███▎      | 123406/371472 [9:49:02<19:41:32,  3.50it/s]
 33%|███▎      | 123407/371472 [9:49:02<22:07:48,  3.11it/s]
 33%|███▎      | 123408/371472 [9:49:03<21:52:32,  3.15it/s]
 33%|███▎      | 123409/371472 [9:49:03<21:34:29,  3.19it/s]
 33%|███▎      | 123410/371472 [9:49:03<20:35:42,  3.35it/s]
 33%|███▎      | 123411/371472 [9:49:03<20:22:46,  3.38it/s]
 33%|███▎      | 123412/371472 [9:49:04<19:29:56,  3.53it/s]
 33%|███▎      | 123413/371472 [9:49:04<20:33:55,  3.35it/s]
 33%|███▎      | 123414/371472 [9:49:04<19:44:28,  3.49it/s]
 33%|███▎      | 123415/371472 [9:49:04<18:37:56,  3.70it/s]
 33%|███▎      | 123416/371472 [9:49:05<18:34:53,  3.71it/s]
 33%|███▎      | 123417/371472 [9:49:05<19:00:17,  3.63it/s]
 33%|███▎      | 123418/371472 [9:49:05<20:07:22,  3.42it/s]
 33%|███▎      | 123419/371472 [9:49:06<19:26:50,  3.54it/s]
 33%|███▎      | 123420/371472 [9:49:06<19:57:57,  3.45it/s]
                                                            
{'loss': 3.0309, 'learning_rate': 7.013025490745329e-07, 'epoch': 5.32}

 33%|███▎      | 123420/371472 [9:49:06<19:57:57,  3.45it/s]
 33%|███▎      | 123421/371472 [9:49:06<20:22:54,  3.38it/s]
 33%|███▎      | 123422/371472 [9:49:07<21:05:29,  3.27it/s]
 33%|███▎      | 123423/371472 [9:49:07<20:25:51,  3.37it/s]
 33%|███▎      | 123424/371472 [9:49:07<20:08:19,  3.42it/s]
 33%|███▎      | 123425/371472 [9:49:07<19:52:31,  3.47it/s]
 33%|███▎      | 123426/371472 [9:49:08<19:28:00,  3.54it/s]
 33%|███▎      | 123427/371472 [9:49:08<19:15:05,  3.58it/s]
 33%|███▎      | 123428/371472 [9:49:08<20:12:30,  3.41it/s]
 33%|███▎      | 123429/371472 [9:49:09<19:58:59,  3.45it/s]
 33%|███▎      | 123430/371472 [9:49:09<19:41:54,  3.50it/s]
 33%|███▎      | 123431/371472 [9:49:09<19:00:30,  3.62it/s]
 33%|███▎      | 123432/371472 [9:49:09<18:19:38,  3.76it/s]
 33%|███▎      | 123433/371472 [9:49:10<18:06:00,  3.81it/s]
 33%|███▎      | 123434/371472 [9:49:10<18:07:05,  3.80it/s]
 33%|███▎      | 123435/371472 [9:49:10<17:56:56,  3.84it/s]
 33%|███▎      | 123436/371472 [9:49:10<17:35:00,  3.92it/s]
 33%|███▎      | 123437/371472 [9:49:11<17:58:30,  3.83it/s]
 33%|███▎      | 123438/371472 [9:49:11<18:15:24,  3.77it/s]
 33%|███▎      | 123439/371472 [9:49:11<18:05:59,  3.81it/s]
 33%|███▎      | 123440/371472 [9:49:11<17:38:19,  3.91it/s]
                                                            
{'loss': 3.3005, 'learning_rate': 7.012540670990539e-07, 'epoch': 5.32}

 33%|███▎      | 123440/371472 [9:49:11<17:38:19,  3.91it/s]
 33%|███▎      | 123441/371472 [9:49:12<17:01:42,  4.05it/s]
 33%|███▎      | 123442/371472 [9:49:12<17:39:36,  3.90it/s]
 33%|███▎      | 123443/371472 [9:49:12<17:47:06,  3.87it/s]
 33%|███▎      | 123444/371472 [9:49:12<17:50:38,  3.86it/s]
 33%|███▎      | 123445/371472 [9:49:13<17:57:36,  3.84it/s]
 33%|███▎      | 123446/371472 [9:49:13<18:08:13,  3.80it/s]
 33%|███▎      | 123447/371472 [9:49:13<18:14:21,  3.78it/s]
 33%|███▎      | 123448/371472 [9:49:13<18:25:36,  3.74it/s]
 33%|███▎      | 123449/371472 [9:49:14<17:44:14,  3.88it/s]
 33%|███▎      | 123450/371472 [9:49:14<18:10:37,  3.79it/s]
 33%|███▎      | 123451/371472 [9:49:14<17:38:52,  3.90it/s]
 33%|███▎      | 123452/371472 [9:49:15<19:35:47,  3.52it/s]
 33%|███▎      | 123453/371472 [9:49:15<19:49:49,  3.47it/s]
 33%|███▎      | 123454/371472 [9:49:15<19:49:22,  3.48it/s]
 33%|███▎      | 123455/371472 [9:49:15<19:36:25,  3.51it/s]
 33%|███▎      | 123456/371472 [9:49:16<18:57:25,  3.63it/s]
 33%|███▎      | 123457/371472 [9:49:16<18:33:45,  3.71it/s]
 33%|███▎      | 123458/371472 [9:49:16<18:50:47,  3.66it/s]
 33%|███▎      | 123459/371472 [9:49:16<18:16:40,  3.77it/s]
 33%|███▎      | 123460/371472 [9:49:17<18:33:13,  3.71it/s]
                                                            
{'loss': 3.2107, 'learning_rate': 7.012055851235751e-07, 'epoch': 5.32}

 33%|███▎      | 123460/371472 [9:49:17<18:33:13,  3.71it/s]
 33%|███▎      | 123461/371472 [9:49:17<19:07:44,  3.60it/s]
 33%|███▎      | 123462/371472 [9:49:17<20:54:34,  3.29it/s]
 33%|███▎      | 123463/371472 [9:49:18<20:28:37,  3.36it/s]
 33%|███▎      | 123464/371472 [9:49:18<21:03:17,  3.27it/s]
 33%|███▎      | 123465/371472 [9:49:18<21:14:48,  3.24it/s]
 33%|███▎      | 123466/371472 [9:49:19<20:20:54,  3.39it/s]
 33%|███▎      | 123467/371472 [9:49:19<19:07:51,  3.60it/s]
 33%|███▎      | 123468/371472 [9:49:19<18:36:26,  3.70it/s]
 33%|███▎      | 123469/371472 [9:49:19<18:20:13,  3.76it/s]
 33%|███▎      | 123470/371472 [9:49:20<18:04:09,  3.81it/s]
 33%|███▎      | 123471/371472 [9:49:20<19:11:33,  3.59it/s]
 33%|███▎      | 123472/371472 [9:49:20<18:58:33,  3.63it/s]
 33%|███▎      | 123473/371472 [9:49:20<19:13:32,  3.58it/s]
 33%|███▎      | 123474/371472 [9:49:21<18:20:32,  3.76it/s]
 33%|███▎      | 123475/371472 [9:49:21<19:39:26,  3.50it/s]
 33%|███▎      | 123476/371472 [9:49:21<19:29:49,  3.53it/s]
 33%|███▎      | 123477/371472 [9:49:22<19:03:23,  3.61it/s]
 33%|███▎      | 123478/371472 [9:49:22<18:38:50,  3.69it/s]
 33%|███▎      | 123479/371472 [9:49:22<18:57:59,  3.63it/s]
 33%|███▎      | 123480/371472 [9:49:22<19:06:28,  3.61it/s]
                                                            
{'loss': 3.2395, 'learning_rate': 7.011571031480963e-07, 'epoch': 5.32}

 33%|███▎      | 123480/371472 [9:49:22<19:06:28,  3.61it/s]
 33%|███▎      | 123481/371472 [9:49:23<18:44:24,  3.68it/s]
 33%|███▎      | 123482/371472 [9:49:23<18:17:27,  3.77it/s]
 33%|███▎      | 123483/371472 [9:49:23<18:45:11,  3.67it/s]
 33%|███▎      | 123484/371472 [9:49:24<19:54:47,  3.46it/s]
 33%|███▎      | 123485/371472 [9:49:24<19:09:36,  3.60it/s]
 33%|███▎      | 123486/371472 [9:49:24<19:42:04,  3.50it/s]
 33%|███▎      | 123487/371472 [9:49:24<19:23:41,  3.55it/s]
 33%|███▎      | 123488/371472 [9:49:25<18:18:18,  3.76it/s]
 33%|███▎      | 123489/371472 [9:49:25<18:30:07,  3.72it/s]
 33%|███▎      | 123490/371472 [9:49:25<18:42:45,  3.68it/s]
 33%|███▎      | 123491/371472 [9:49:25<19:00:06,  3.63it/s]
 33%|███▎      | 123492/371472 [9:49:26<19:05:49,  3.61it/s]
 33%|███▎      | 123493/371472 [9:49:26<19:19:17,  3.57it/s]
 33%|███▎      | 123494/371472 [9:49:26<18:28:47,  3.73it/s]
 33%|███▎      | 123495/371472 [9:49:27<18:08:56,  3.80it/s]
 33%|███▎      | 123496/371472 [9:49:27<18:19:49,  3.76it/s]
 33%|███▎      | 123497/371472 [9:49:27<18:27:02,  3.73it/s]
 33%|███▎      | 123498/371472 [9:49:27<18:02:44,  3.82it/s]
 33%|███▎      | 123499/371472 [9:49:28<17:46:56,  3.87it/s]
 33%|███▎      | 123500/371472 [9:49:28<17:20:39,  3.97it/s]
                                                            
{'loss': 3.3364, 'learning_rate': 7.011086211726174e-07, 'epoch': 5.32}

 33%|███▎      | 123500/371472 [9:49:28<17:20:39,  3.97it/s]
 33%|███▎      | 123501/371472 [9:49:28<17:32:33,  3.93it/s]
 33%|███▎      | 123502/371472 [9:49:28<19:05:10,  3.61it/s]
 33%|███▎      | 123503/371472 [9:49:29<18:54:44,  3.64it/s]
 33%|███▎      | 123504/371472 [9:49:29<19:06:21,  3.61it/s]
 33%|███▎      | 123505/371472 [9:49:29<20:41:55,  3.33it/s]
 33%|███▎      | 123506/371472 [9:49:30<19:34:49,  3.52it/s]
 33%|███▎      | 123507/371472 [9:49:30<20:47:48,  3.31it/s]
 33%|███▎      | 123508/371472 [9:49:30<20:02:29,  3.44it/s]
 33%|███▎      | 123509/371472 [9:49:30<20:16:05,  3.40it/s]
 33%|███▎      | 123510/371472 [9:49:31<21:15:16,  3.24it/s]
 33%|███▎      | 123511/371472 [9:49:31<19:54:47,  3.46it/s]
 33%|███▎      | 123512/371472 [9:49:31<19:30:46,  3.53it/s]
 33%|███▎      | 123513/371472 [9:49:32<19:23:52,  3.55it/s]
 33%|███▎      | 123514/371472 [9:49:32<19:52:59,  3.46it/s]
 33%|███▎      | 123515/371472 [9:49:32<19:27:33,  3.54it/s]
 33%|███▎      | 123516/371472 [9:49:32<19:09:57,  3.59it/s]
 33%|███▎      | 123517/371472 [9:49:33<19:03:20,  3.61it/s]
 33%|███▎      | 123518/371472 [9:49:33<18:55:27,  3.64it/s]
 33%|███▎      | 123519/371472 [9:49:33<18:30:14,  3.72it/s]
 33%|███▎      | 123520/371472 [9:49:33<17:59:31,  3.83it/s]
                                                            
{'loss': 3.3557, 'learning_rate': 7.010601391971384e-07, 'epoch': 5.32}

 33%|███▎      | 123520/371472 [9:49:33<17:59:31,  3.83it/s]
 33%|███▎      | 123521/371472 [9:49:34<18:51:26,  3.65it/s]
 33%|███▎      | 123522/371472 [9:49:34<19:58:16,  3.45it/s]
 33%|███▎      | 123523/371472 [9:49:34<19:36:52,  3.51it/s]
 33%|███▎      | 123524/371472 [9:49:35<19:29:38,  3.53it/s]
 33%|███▎      | 123525/371472 [9:49:35<20:03:23,  3.43it/s]
 33%|███▎      | 123526/371472 [9:49:35<19:00:39,  3.62it/s]
 33%|███▎      | 123527/371472 [9:49:35<19:24:19,  3.55it/s]
 33%|███▎      | 123528/371472 [9:49:36<18:52:39,  3.65it/s]
 33%|███▎      | 123529/371472 [9:49:36<18:29:27,  3.72it/s]
 33%|███▎      | 123530/371472 [9:49:36<18:58:20,  3.63it/s]
 33%|███▎      | 123531/371472 [9:49:37<18:30:50,  3.72it/s]
 33%|███▎      | 123532/371472 [9:49:37<19:38:52,  3.51it/s]
 33%|███▎      | 123533/371472 [9:49:37<19:10:55,  3.59it/s]
 33%|███▎      | 123534/371472 [9:49:37<18:32:58,  3.71it/s]
 33%|███▎      | 123535/371472 [9:49:38<18:25:38,  3.74it/s]
 33%|███▎      | 123536/371472 [9:49:38<18:31:07,  3.72it/s]
 33%|███▎      | 123537/371472 [9:49:38<18:40:26,  3.69it/s]
 33%|███▎      | 123538/371472 [9:49:38<18:32:06,  3.72it/s]
 33%|███▎      | 123539/371472 [9:49:39<19:05:51,  3.61it/s]
 33%|███▎      | 123540/371472 [9:49:39<18:40:25,  3.69it/s]
                                                            
{'loss': 3.2909, 'learning_rate': 7.010116572216596e-07, 'epoch': 5.32}

 33%|███▎      | 123540/371472 [9:49:39<18:40:25,  3.69it/s]
 33%|███▎      | 123541/371472 [9:49:39<20:10:09,  3.41it/s]
 33%|███▎      | 123542/371472 [9:49:40<19:05:27,  3.61it/s]
 33%|███▎      | 123543/371472 [9:49:40<19:31:08,  3.53it/s]
 33%|███▎      | 123544/371472 [9:49:40<19:58:33,  3.45it/s]
 33%|███▎      | 123545/371472 [9:49:40<19:18:29,  3.57it/s]
 33%|███▎      | 123546/371472 [9:49:41<19:53:45,  3.46it/s]
 33%|███▎      | 123547/371472 [9:49:41<20:25:25,  3.37it/s]
 33%|███▎      | 123548/371472 [9:49:41<20:08:34,  3.42it/s]
 33%|███▎      | 123549/371472 [9:49:42<21:37:18,  3.19it/s]
 33%|███▎      | 123550/371472 [9:49:42<21:02:37,  3.27it/s]
 33%|███▎      | 123551/371472 [9:49:42<20:27:58,  3.36it/s]
 33%|███▎      | 123552/371472 [9:49:43<19:24:04,  3.55it/s]
 33%|███▎      | 123553/371472 [9:49:43<18:33:19,  3.71it/s]
 33%|███▎      | 123554/371472 [9:49:43<18:47:18,  3.67it/s]
 33%|███▎      | 123555/371472 [9:49:43<19:34:23,  3.52it/s]
 33%|███▎      | 123556/371472 [9:49:44<19:10:30,  3.59it/s]
 33%|███▎      | 123557/371472 [9:49:44<18:53:00,  3.65it/s]
 33%|███▎      | 123558/371472 [9:49:44<19:37:28,  3.51it/s]
 33%|███▎      | 123559/371472 [9:49:45<20:47:29,  3.31it/s]
 33%|███▎      | 123560/371472 [9:49:45<19:55:05,  3.46it/s]
                                                            
{'loss': 3.1557, 'learning_rate': 7.009631752461807e-07, 'epoch': 5.32}

 33%|███▎      | 123560/371472 [9:49:45<19:55:05,  3.46it/s]
 33%|███▎      | 123561/371472 [9:49:45<19:17:37,  3.57it/s]
 33%|███▎      | 123562/371472 [9:49:45<19:08:26,  3.60it/s]
 33%|███▎      | 123563/371472 [9:49:46<20:08:29,  3.42it/s]
 33%|███▎      | 123564/371472 [9:49:46<23:20:19,  2.95it/s]
 33%|███▎      | 123565/371472 [9:49:46<21:29:58,  3.20it/s]
 33%|███▎      | 123566/371472 [9:49:47<21:26:52,  3.21it/s]
 33%|███▎      | 123567/371472 [9:49:47<19:56:53,  3.45it/s]
 33%|███▎      | 123568/371472 [9:49:47<20:04:29,  3.43it/s]
 33%|███▎      | 123569/371472 [9:49:48<20:09:22,  3.42it/s]
 33%|███▎      | 123570/371472 [9:49:48<19:10:15,  3.59it/s]
 33%|███▎      | 123571/371472 [9:49:48<19:15:14,  3.58it/s]
 33%|███▎      | 123572/371472 [9:49:48<19:42:48,  3.49it/s]
 33%|███▎      | 123573/371472 [9:49:49<19:04:58,  3.61it/s]
 33%|███▎      | 123574/371472 [9:49:49<19:56:21,  3.45it/s]
 33%|███▎      | 123575/371472 [9:49:49<19:26:22,  3.54it/s]
 33%|███▎      | 123576/371472 [9:49:49<19:06:30,  3.60it/s]
 33%|███▎      | 123577/371472 [9:49:50<19:15:10,  3.58it/s]
 33%|███▎      | 123578/371472 [9:49:50<18:50:03,  3.66it/s]
 33%|███▎      | 123579/371472 [9:49:50<19:49:24,  3.47it/s]
 33%|███▎      | 123580/371472 [9:49:51<19:24:17,  3.55it/s]
                                                            
{'loss': 3.1209, 'learning_rate': 7.009146932707017e-07, 'epoch': 5.32}

 33%|███▎      | 123580/371472 [9:49:51<19:24:17,  3.55it/s]
 33%|███▎      | 123581/371472 [9:49:51<18:52:22,  3.65it/s]
 33%|███▎      | 123582/371472 [9:49:51<19:51:20,  3.47it/s]
 33%|███▎      | 123583/371472 [9:49:51<20:30:47,  3.36it/s]
 33%|███▎      | 123584/371472 [9:49:52<20:28:58,  3.36it/s]
 33%|███▎      | 123585/371472 [9:49:52<21:38:15,  3.18it/s]
 33%|███▎      | 123586/371472 [9:49:52<20:37:19,  3.34it/s]
 33%|███▎      | 123587/371472 [9:49:53<22:35:02,  3.05it/s]
 33%|███▎      | 123588/371472 [9:49:53<22:11:51,  3.10it/s]
 33%|███▎      | 123589/371472 [9:49:53<23:17:55,  2.96it/s]
 33%|███▎      | 123590/371472 [9:49:54<21:31:49,  3.20it/s]
 33%|███▎      | 123591/371472 [9:49:54<19:53:49,  3.46it/s]
 33%|███▎      | 123592/371472 [9:49:54<19:45:07,  3.49it/s]
 33%|███▎      | 123593/371472 [9:49:55<21:24:26,  3.22it/s]
 33%|███▎      | 123594/371472 [9:49:55<22:28:15,  3.06it/s]
 33%|███▎      | 123595/371472 [9:49:55<20:59:21,  3.28it/s]
 33%|███▎      | 123596/371472 [9:49:55<20:14:47,  3.40it/s]
 33%|███▎      | 123597/371472 [9:49:56<20:55:31,  3.29it/s]
 33%|███▎      | 123598/371472 [9:49:56<20:06:36,  3.42it/s]
 33%|███▎      | 123599/371472 [9:49:56<19:26:26,  3.54it/s]
 33%|███▎      | 123600/371472 [9:49:57<19:04:09,  3.61it/s]
                                                            
{'loss': 3.2179, 'learning_rate': 7.008662112952228e-07, 'epoch': 5.32}

 33%|███▎      | 123600/371472 [9:49:57<19:04:09,  3.61it/s]
 33%|███▎      | 123601/371472 [9:49:57<18:59:32,  3.63it/s]
 33%|███▎      | 123602/371472 [9:49:57<18:48:06,  3.66it/s]
 33%|███▎      | 123603/371472 [9:49:57<18:40:02,  3.69it/s]
 33%|███▎      | 123604/371472 [9:49:58<19:08:31,  3.60it/s]
 33%|███▎      | 123605/371472 [9:49:58<18:58:31,  3.63it/s]
 33%|███▎      | 123606/371472 [9:49:58<19:41:58,  3.50it/s]
 33%|███▎      | 123607/371472 [9:49:59<18:46:38,  3.67it/s]
 33%|███▎      | 123608/371472 [9:49:59<19:27:17,  3.54it/s]
 33%|███▎      | 123609/371472 [9:49:59<19:14:07,  3.58it/s]
 33%|███▎      | 123610/371472 [9:49:59<18:21:03,  3.75it/s]
 33%|███▎      | 123611/371472 [9:50:00<18:22:26,  3.75it/s]
 33%|███▎      | 123612/371472 [9:50:00<18:27:56,  3.73it/s]
 33%|███▎      | 123613/371472 [9:50:00<18:34:22,  3.71it/s]
 33%|███▎      | 123614/371472 [9:50:00<18:17:48,  3.76it/s]
 33%|███▎      | 123615/371472 [9:50:01<18:45:00,  3.67it/s]
 33%|███▎      | 123616/371472 [9:50:01<18:59:21,  3.63it/s]
 33%|███▎      | 123617/371472 [9:50:01<18:23:04,  3.74it/s]
 33%|███▎      | 123618/371472 [9:50:02<18:47:13,  3.66it/s]
 33%|███▎      | 123619/371472 [9:50:02<19:39:52,  3.50it/s]
 33%|███▎      | 123620/371472 [9:50:02<18:55:01,  3.64it/s]
                                                            
{'loss': 3.227, 'learning_rate': 7.00817729319744e-07, 'epoch': 5.32}

 33%|███▎      | 123620/371472 [9:50:02<18:55:01,  3.64it/s]
 33%|███▎      | 123621/371472 [9:50:02<18:19:45,  3.76it/s]
 33%|███▎      | 123622/371472 [9:50:03<17:57:15,  3.83it/s]
 33%|███▎      | 123623/371472 [9:50:03<19:08:51,  3.60it/s]
 33%|███▎      | 123624/371472 [9:50:03<19:35:23,  3.51it/s]
 33%|███▎      | 123625/371472 [9:50:03<19:12:42,  3.58it/s]
 33%|███▎      | 123626/371472 [9:50:04<19:33:04,  3.52it/s]
 33%|███▎      | 123627/371472 [9:50:04<18:33:10,  3.71it/s]
 33%|███▎      | 123628/371472 [9:50:04<18:51:47,  3.65it/s]
 33%|███▎      | 123629/371472 [9:50:05<19:10:44,  3.59it/s]
 33%|███▎      | 123630/371472 [9:50:05<18:45:53,  3.67it/s]
 33%|███▎      | 123631/371472 [9:50:05<18:52:32,  3.65it/s]
 33%|███▎      | 123632/371472 [9:50:05<18:22:38,  3.75it/s]
 33%|███▎      | 123633/371472 [9:50:06<18:37:14,  3.70it/s]
 33%|███▎      | 123634/371472 [9:50:06<20:17:26,  3.39it/s]
 33%|███▎      | 123635/371472 [9:50:06<20:21:18,  3.38it/s]
 33%|███▎      | 123636/371472 [9:50:07<19:05:15,  3.61it/s]
 33%|███▎      | 123637/371472 [9:50:07<21:02:15,  3.27it/s]
 33%|███▎      | 123638/371472 [9:50:07<20:06:36,  3.42it/s]
 33%|███▎      | 123639/371472 [9:50:07<19:41:19,  3.50it/s]
 33%|███▎      | 123640/371472 [9:50:08<18:56:24,  3.63it/s]
                                                            
{'loss': 3.3198, 'learning_rate': 7.007692473442652e-07, 'epoch': 5.33}

 33%|███▎      | 123640/371472 [9:50:08<18:56:24,  3.63it/s]
 33%|███▎      | 123641/371472 [9:50:08<18:34:44,  3.71it/s]
 33%|███▎      | 123642/371472 [9:50:08<19:12:46,  3.58it/s]
 33%|███▎      | 123643/371472 [9:50:08<18:31:40,  3.72it/s]
 33%|███▎      | 123644/371472 [9:50:09<18:41:56,  3.68it/s]
 33%|███▎      | 123645/371472 [9:50:09<18:58:29,  3.63it/s]
 33%|███▎      | 123646/371472 [9:50:09<18:43:44,  3.68it/s]
 33%|███▎      | 123647/371472 [9:50:10<18:11:18,  3.78it/s]
 33%|███▎      | 123648/371472 [9:50:10<22:37:46,  3.04it/s]
 33%|███▎      | 123649/371472 [9:50:10<21:18:27,  3.23it/s]
 33%|███▎      | 123650/371472 [9:50:11<21:36:46,  3.19it/s]
 33%|███▎      | 123651/371472 [9:50:11<20:27:50,  3.36it/s]
 33%|███▎      | 123652/371472 [9:50:11<20:13:58,  3.40it/s]
 33%|███▎      | 123653/371472 [9:50:11<19:38:52,  3.50it/s]
 33%|███▎      | 123654/371472 [9:50:12<19:02:05,  3.62it/s]
 33%|███▎      | 123655/371472 [9:50:12<18:43:01,  3.68it/s]
 33%|███▎      | 123656/371472 [9:50:12<18:26:22,  3.73it/s]
 33%|███▎      | 123657/371472 [9:50:12<17:57:52,  3.83it/s]
 33%|███▎      | 123658/371472 [9:50:13<17:29:56,  3.93it/s]
 33%|███▎      | 123659/371472 [9:50:13<16:59:15,  4.05it/s]
 33%|███▎      | 123660/371472 [9:50:13<17:18:47,  3.98it/s]
                                                            
{'loss': 3.2398, 'learning_rate': 7.007207653687862e-07, 'epoch': 5.33}

 33%|███▎      | 123660/371472 [9:50:13<17:18:47,  3.98it/s]
 33%|███▎      | 123661/371472 [9:50:13<17:25:39,  3.95it/s]
 33%|███▎      | 123662/371472 [9:50:14<17:08:15,  4.02it/s]
 33%|███▎      | 123663/371472 [9:50:14<18:38:10,  3.69it/s]
 33%|███▎      | 123664/371472 [9:50:14<19:23:01,  3.55it/s]
 33%|███▎      | 123665/371472 [9:50:15<18:53:31,  3.64it/s]
 33%|███▎      | 123666/371472 [9:50:15<19:48:43,  3.47it/s]
 33%|███▎      | 123667/371472 [9:50:15<19:52:50,  3.46it/s]
 33%|███▎      | 123668/371472 [9:50:15<19:28:11,  3.54it/s]
 33%|███▎      | 123669/371472 [9:50:16<18:49:24,  3.66it/s]
 33%|███▎      | 123670/371472 [9:50:16<18:28:27,  3.73it/s]
 33%|███▎      | 123671/371472 [9:50:16<18:42:42,  3.68it/s]
 33%|███▎      | 123672/371472 [9:50:16<17:54:40,  3.84it/s]
 33%|███▎      | 123673/371472 [9:50:17<18:15:25,  3.77it/s]
 33%|███▎      | 123674/371472 [9:50:17<18:53:12,  3.64it/s]
 33%|███▎      | 123675/371472 [9:50:17<19:41:44,  3.49it/s]
 33%|███▎      | 123676/371472 [9:50:18<19:55:04,  3.46it/s]
 33%|███▎      | 123677/371472 [9:50:18<19:54:33,  3.46it/s]
 33%|███▎      | 123678/371472 [9:50:18<19:10:34,  3.59it/s]
 33%|███▎      | 123679/371472 [9:50:19<21:09:52,  3.25it/s]
 33%|███▎      | 123680/371472 [9:50:19<20:42:00,  3.33it/s]
                                                            
{'loss': 3.2511, 'learning_rate': 7.006722833933072e-07, 'epoch': 5.33}

 33%|███▎      | 123680/371472 [9:50:19<20:42:00,  3.33it/s]
 33%|███▎      | 123681/371472 [9:50:19<20:12:40,  3.41it/s]
 33%|███▎      | 123682/371472 [9:50:19<19:41:41,  3.49it/s]
 33%|███▎      | 123683/371472 [9:50:20<19:06:51,  3.60it/s]
 33%|███▎      | 123684/371472 [9:50:20<19:01:20,  3.62it/s]
 33%|███▎      | 123685/371472 [9:50:20<19:01:37,  3.62it/s]
 33%|███▎      | 123686/371472 [9:50:20<18:10:55,  3.79it/s]
 33%|███▎      | 123687/371472 [9:50:21<19:39:00,  3.50it/s]
 33%|███▎      | 123688/371472 [9:50:21<20:24:26,  3.37it/s]
 33%|███▎      | 123689/371472 [9:50:21<22:33:15,  3.05it/s]
 33%|███▎      | 123690/371472 [9:50:22<21:07:15,  3.26it/s]
 33%|███▎      | 123691/371472 [9:50:22<20:15:15,  3.40it/s]
 33%|███▎      | 123692/371472 [9:50:22<19:53:38,  3.46it/s]
 33%|███▎      | 123693/371472 [9:50:23<19:21:17,  3.56it/s]
 33%|███▎      | 123694/371472 [9:50:23<19:03:25,  3.61it/s]
 33%|███▎      | 123695/371472 [9:50:23<18:48:21,  3.66it/s]
 33%|███▎      | 123696/371472 [9:50:23<18:31:11,  3.72it/s]
 33%|███▎      | 123697/371472 [9:50:24<18:51:34,  3.65it/s]
 33%|███▎      | 123698/371472 [9:50:24<19:28:23,  3.53it/s]
 33%|███▎      | 123699/371472 [9:50:24<20:33:13,  3.35it/s]
 33%|███▎      | 123700/371472 [9:50:24<19:14:49,  3.58it/s]
                                                            
{'loss': 3.2067, 'learning_rate': 7.006238014178284e-07, 'epoch': 5.33}

 33%|███▎      | 123700/371472 [9:50:24<19:14:49,  3.58it/s]
 33%|███▎      | 123701/371472 [9:50:25<19:36:27,  3.51it/s]
 33%|███▎      | 123702/371472 [9:50:25<19:01:14,  3.62it/s]
 33%|███▎      | 123703/371472 [9:50:25<18:43:16,  3.68it/s]
 33%|███▎      | 123704/371472 [9:50:26<18:36:58,  3.70it/s]
 33%|███▎      | 123705/371472 [9:50:26<18:40:18,  3.69it/s]
 33%|███▎      | 123706/371472 [9:50:26<19:48:26,  3.47it/s]
 33%|███▎      | 123707/371472 [9:50:26<20:18:04,  3.39it/s]
 33%|███▎      | 123708/371472 [9:50:27<19:25:43,  3.54it/s]
 33%|███▎      | 123709/371472 [9:50:27<18:54:57,  3.64it/s]
 33%|███▎      | 123710/371472 [9:50:27<19:02:06,  3.62it/s]
 33%|███▎      | 123711/371472 [9:50:28<18:47:24,  3.66it/s]
 33%|███▎      | 123712/371472 [9:50:28<19:01:25,  3.62it/s]
 33%|███▎      | 123713/371472 [9:50:28<19:39:54,  3.50it/s]
 33%|███▎      | 123714/371472 [9:50:28<19:17:31,  3.57it/s]
 33%|███▎      | 123715/371472 [9:50:29<19:36:15,  3.51it/s]
 33%|███▎      | 123716/371472 [9:50:29<19:58:50,  3.44it/s]
 33%|███▎      | 123717/371472 [9:50:29<19:24:36,  3.55it/s]
 33%|███▎      | 123718/371472 [9:50:30<21:02:10,  3.27it/s]
 33%|███▎      | 123719/371472 [9:50:30<21:01:51,  3.27it/s]
 33%|███▎      | 123720/371472 [9:50:30<19:50:45,  3.47it/s]
                                                            
{'loss': 3.0998, 'learning_rate': 7.005753194423496e-07, 'epoch': 5.33}

 33%|███▎      | 123720/371472 [9:50:30<19:50:45,  3.47it/s]
 33%|███▎      | 123721/371472 [9:50:30<19:54:11,  3.46it/s]
 33%|███▎      | 123722/371472 [9:50:31<19:12:59,  3.58it/s]
 33%|███▎      | 123723/371472 [9:50:31<19:18:37,  3.56it/s]
 33%|███▎      | 123724/371472 [9:50:31<19:06:42,  3.60it/s]
 33%|███▎      | 123725/371472 [9:50:32<19:21:03,  3.56it/s]
 33%|███▎      | 123726/371472 [9:50:32<18:57:08,  3.63it/s]
 33%|███▎      | 123727/371472 [9:50:32<18:55:02,  3.64it/s]
 33%|███▎      | 123728/371472 [9:50:32<18:10:58,  3.78it/s]
 33%|███▎      | 123729/371472 [9:50:33<17:49:12,  3.86it/s]
 33%|███▎      | 123730/371472 [9:50:33<17:17:31,  3.98it/s]
 33%|███▎      | 123731/371472 [9:50:33<17:41:05,  3.89it/s]
 33%|███▎      | 123732/371472 [9:50:33<17:18:44,  3.98it/s]
 33%|███▎      | 123733/371472 [9:50:34<17:53:24,  3.85it/s]
 33%|███▎      | 123734/371472 [9:50:34<17:55:39,  3.84it/s]
 33%|███▎      | 123735/371472 [9:50:34<17:30:31,  3.93it/s]
 33%|███▎      | 123736/371472 [9:50:34<17:59:30,  3.82it/s]
 33%|███▎      | 123737/371472 [9:50:35<17:20:16,  3.97it/s]
 33%|███▎      | 123738/371472 [9:50:35<17:13:18,  4.00it/s]
 33%|███▎      | 123739/371472 [9:50:35<17:55:00,  3.84it/s]
 33%|███▎      | 123740/371472 [9:50:35<18:26:27,  3.73it/s]
                                                            
{'loss': 3.2079, 'learning_rate': 7.005268374668706e-07, 'epoch': 5.33}

 33%|███▎      | 123740/371472 [9:50:35<18:26:27,  3.73it/s]
 33%|███▎      | 123741/371472 [9:50:36<18:33:40,  3.71it/s]
 33%|███▎      | 123742/371472 [9:50:36<18:12:41,  3.78it/s]
 33%|███▎      | 123743/371472 [9:50:36<17:57:58,  3.83it/s]
 33%|███▎      | 123744/371472 [9:50:36<17:37:45,  3.90it/s]
 33%|███▎      | 123745/371472 [9:50:37<17:25:29,  3.95it/s]
 33%|███▎      | 123746/371472 [9:50:37<18:11:47,  3.78it/s]
 33%|███▎      | 123747/371472 [9:50:37<20:20:15,  3.38it/s]
 33%|███▎      | 123748/371472 [9:50:38<19:23:10,  3.55it/s]
 33%|███▎      | 123749/371472 [9:50:38<18:56:44,  3.63it/s]
 33%|███▎      | 123750/371472 [9:50:38<18:43:36,  3.67it/s]
 33%|███▎      | 123751/371472 [9:50:38<18:47:54,  3.66it/s]
 33%|███▎      | 123752/371472 [9:50:39<19:02:39,  3.61it/s]
 33%|███▎      | 123753/371472 [9:50:39<18:26:18,  3.73it/s]
 33%|███▎      | 123754/371472 [9:50:39<18:07:18,  3.80it/s]
 33%|███▎      | 123755/371472 [9:50:39<18:42:54,  3.68it/s]
 33%|███▎      | 123756/371472 [9:50:40<18:38:01,  3.69it/s]
 33%|███▎      | 123757/371472 [9:50:40<18:51:39,  3.65it/s]
 33%|███▎      | 123758/371472 [9:50:40<18:20:52,  3.75it/s]
 33%|███▎      | 123759/371472 [9:50:41<19:05:03,  3.61it/s]
 33%|███▎      | 123760/371472 [9:50:41<22:31:35,  3.05it/s]
                                                            
{'loss': 3.3591, 'learning_rate': 7.004783554913917e-07, 'epoch': 5.33}

 33%|███▎      | 123760/371472 [9:50:41<22:31:35,  3.05it/s]
 33%|███▎      | 123761/371472 [9:50:41<21:37:37,  3.18it/s]
 33%|███▎      | 123762/371472 [9:50:42<22:01:14,  3.12it/s]
 33%|███▎      | 123763/371472 [9:50:42<20:58:10,  3.28it/s]
 33%|███▎      | 123764/371472 [9:50:42<20:36:53,  3.34it/s]
 33%|███▎      | 123765/371472 [9:50:42<19:42:07,  3.49it/s]
 33%|███▎      | 123766/371472 [9:50:43<20:07:21,  3.42it/s]
 33%|███▎      | 123767/371472 [9:50:43<19:49:43,  3.47it/s]
 33%|███▎      | 123768/371472 [9:50:43<19:48:10,  3.47it/s]
 33%|███▎      | 123769/371472 [9:50:44<19:39:12,  3.50it/s]
 33%|███▎      | 123770/371472 [9:50:44<19:22:03,  3.55it/s]
 33%|███▎      | 123771/371472 [9:50:44<18:52:40,  3.64it/s]
 33%|███▎      | 123772/371472 [9:50:44<20:02:19,  3.43it/s]
 33%|███▎      | 123773/371472 [9:50:45<19:18:56,  3.56it/s]
 33%|███▎      | 123774/371472 [9:50:45<19:22:49,  3.55it/s]
 33%|███▎      | 123775/371472 [9:50:45<18:54:29,  3.64it/s]
 33%|███▎      | 123776/371472 [9:50:46<18:39:20,  3.69it/s]
 33%|███▎      | 123777/371472 [9:50:46<19:19:44,  3.56it/s]
 33%|███▎      | 123778/371472 [9:50:46<18:57:17,  3.63it/s]
 33%|███▎      | 123779/371472 [9:50:46<18:54:24,  3.64it/s]
 33%|███▎      | 123780/371472 [9:50:47<20:21:46,  3.38it/s]
                                                            
{'loss': 3.2563, 'learning_rate': 7.004298735159129e-07, 'epoch': 5.33}

 33%|███▎      | 123780/371472 [9:50:47<20:21:46,  3.38it/s]
 33%|███▎      | 123781/371472 [9:50:47<19:31:09,  3.52it/s]
 33%|███▎      | 123782/371472 [9:50:47<19:19:07,  3.56it/s]
 33%|███▎      | 123783/371472 [9:50:48<18:39:47,  3.69it/s]
 33%|███▎      | 123784/371472 [9:50:48<18:13:17,  3.78it/s]
 33%|███▎      | 123785/371472 [9:50:48<19:16:49,  3.57it/s]
 33%|███▎      | 123786/371472 [9:50:48<19:01:11,  3.62it/s]
 33%|███▎      | 123787/371472 [9:50:49<18:17:10,  3.76it/s]
 33%|███▎      | 123788/371472 [9:50:49<18:30:52,  3.72it/s]
 33%|███▎      | 123789/371472 [9:50:49<17:56:42,  3.83it/s]
 33%|███▎      | 123790/371472 [9:50:49<17:21:33,  3.96it/s]
 33%|███▎      | 123791/371472 [9:50:50<18:08:02,  3.79it/s]
 33%|███▎      | 123792/371472 [9:50:50<18:47:34,  3.66it/s]
 33%|███▎      | 123793/371472 [9:50:50<18:31:05,  3.72it/s]
 33%|███▎      | 123794/371472 [9:50:50<17:53:00,  3.85it/s]
 33%|███▎      | 123795/371472 [9:50:51<18:29:19,  3.72it/s]
 33%|███▎      | 123796/371472 [9:50:51<18:23:08,  3.74it/s]
 33%|███▎      | 123797/371472 [9:50:51<18:46:46,  3.66it/s]
 33%|███▎      | 123798/371472 [9:50:52<19:12:55,  3.58it/s]
 33%|███▎      | 123799/371472 [9:50:52<19:14:53,  3.57it/s]
 33%|███▎      | 123800/371472 [9:50:52<18:23:26,  3.74it/s]
                                                            
{'loss': 3.3802, 'learning_rate': 7.00381391540434e-07, 'epoch': 5.33}

 33%|███▎      | 123800/371472 [9:50:52<18:23:26,  3.74it/s]
 33%|███▎      | 123801/371472 [9:50:52<18:14:13,  3.77it/s]
 33%|███▎      | 123802/371472 [9:50:53<19:04:43,  3.61it/s]
 33%|███▎      | 123803/371472 [9:50:53<18:45:17,  3.67it/s]
 33%|███▎      | 123804/371472 [9:50:53<18:15:09,  3.77it/s]
 33%|███▎      | 123805/371472 [9:50:53<18:20:44,  3.75it/s]
 33%|███▎      | 123806/371472 [9:50:54<19:38:40,  3.50it/s]
 33%|███▎      | 123807/371472 [9:50:54<19:44:00,  3.49it/s]
 33%|███▎      | 123808/371472 [9:50:54<19:22:11,  3.55it/s]
 33%|███▎      | 123809/371472 [9:50:55<20:18:24,  3.39it/s]
 33%|███▎      | 123810/371472 [9:50:55<20:12:31,  3.40it/s]
 33%|███▎      | 123811/371472 [9:50:55<19:16:45,  3.57it/s]
 33%|███▎      | 123812/371472 [9:50:55<18:23:26,  3.74it/s]
 33%|███▎      | 123813/371472 [9:50:56<18:34:22,  3.70it/s]
 33%|███▎      | 123814/371472 [9:50:56<18:04:43,  3.81it/s]
 33%|███▎      | 123815/371472 [9:50:56<18:11:00,  3.78it/s]
 33%|███▎      | 123816/371472 [9:50:56<18:13:06,  3.78it/s]
 33%|███▎      | 123817/371472 [9:50:57<17:49:35,  3.86it/s]
 33%|███▎      | 123818/371472 [9:50:57<17:28:04,  3.94it/s]
 33%|███▎      | 123819/371472 [9:50:57<17:14:48,  3.99it/s]
 33%|███▎      | 123820/371472 [9:50:57<17:18:01,  3.98it/s]
                                                            
{'loss': 3.1963, 'learning_rate': 7.00332909564955e-07, 'epoch': 5.33}

 33%|███▎      | 123820/371472 [9:50:57<17:18:01,  3.98it/s]
 33%|███▎      | 123821/371472 [9:50:58<17:55:03,  3.84it/s]
 33%|███▎      | 123822/371472 [9:50:58<18:59:28,  3.62it/s]
 33%|███▎      | 123823/371472 [9:50:58<19:10:07,  3.59it/s]
 33%|███▎      | 123824/371472 [9:50:59<19:54:35,  3.46it/s]
 33%|███▎      | 123825/371472 [9:50:59<19:16:22,  3.57it/s]
 33%|███▎      | 123826/371472 [9:50:59<19:25:04,  3.54it/s]
 33%|███▎      | 123827/371472 [9:50:59<18:34:05,  3.70it/s]
 33%|███▎      | 123828/371472 [9:51:00<18:53:57,  3.64it/s]
 33%|███▎      | 123829/371472 [9:51:00<18:22:20,  3.74it/s]
 33%|███▎      | 123830/371472 [9:51:00<20:32:26,  3.35it/s]
 33%|███▎      | 123831/371472 [9:51:01<20:42:58,  3.32it/s]
 33%|███▎      | 123832/371472 [9:51:01<19:51:38,  3.46it/s]
 33%|███▎      | 123833/371472 [9:51:01<19:14:46,  3.57it/s]
 33%|███▎      | 123834/371472 [9:51:01<18:11:38,  3.78it/s]
 33%|███▎      | 123835/371472 [9:51:02<18:10:33,  3.78it/s]
 33%|███▎      | 123836/371472 [9:51:02<18:26:18,  3.73it/s]
 33%|███▎      | 123837/371472 [9:51:02<18:33:32,  3.71it/s]
 33%|███▎      | 123838/371472 [9:51:02<18:36:56,  3.70it/s]
 33%|███▎      | 123839/371472 [9:51:03<18:25:08,  3.73it/s]
 33%|███▎      | 123840/371472 [9:51:03<18:29:22,  3.72it/s]
                                                            
{'loss': 3.2951, 'learning_rate': 7.002844275894761e-07, 'epoch': 5.33}

 33%|███▎      | 123840/371472 [9:51:03<18:29:22,  3.72it/s]
 33%|███▎      | 123841/371472 [9:51:03<18:23:23,  3.74it/s]
 33%|███▎      | 123842/371472 [9:51:04<18:13:19,  3.77it/s]
 33%|███▎      | 123843/371472 [9:51:04<18:20:49,  3.75it/s]
 33%|███▎      | 123844/371472 [9:51:04<18:39:57,  3.69it/s]
 33%|███▎      | 123845/371472 [9:51:04<18:15:08,  3.77it/s]
 33%|███▎      | 123846/371472 [9:51:05<18:42:51,  3.68it/s]
 33%|███▎      | 123847/371472 [9:51:05<19:10:53,  3.59it/s]
 33%|███▎      | 123848/371472 [9:51:05<19:09:10,  3.59it/s]
 33%|███▎      | 123849/371472 [9:51:05<18:18:08,  3.76it/s]
 33%|███▎      | 123850/371472 [9:51:06<17:53:27,  3.84it/s]
 33%|███▎      | 123851/371472 [9:51:06<18:13:09,  3.78it/s]
 33%|███▎      | 123852/371472 [9:51:06<18:37:49,  3.69it/s]
 33%|███▎      | 123853/371472 [9:51:06<17:54:50,  3.84it/s]
 33%|███▎      | 123854/371472 [9:51:07<17:55:37,  3.84it/s]
 33%|███▎      | 123855/371472 [9:51:07<17:43:25,  3.88it/s]
 33%|███▎      | 123856/371472 [9:51:07<19:25:27,  3.54it/s]
 33%|███▎      | 123857/371472 [9:51:08<19:01:06,  3.62it/s]
 33%|███▎      | 123858/371472 [9:51:08<19:45:59,  3.48it/s]
 33%|███▎      | 123859/371472 [9:51:08<19:23:40,  3.55it/s]
 33%|███▎      | 123860/371472 [9:51:08<18:47:20,  3.66it/s]
                                                            
{'loss': 3.3228, 'learning_rate': 7.002359456139973e-07, 'epoch': 5.33}

 33%|███▎      | 123860/371472 [9:51:08<18:47:20,  3.66it/s]
 33%|███▎      | 123861/371472 [9:51:09<19:02:11,  3.61it/s]
 33%|███▎      | 123862/371472 [9:51:09<21:01:15,  3.27it/s]
 33%|███▎      | 123863/371472 [9:51:09<21:57:46,  3.13it/s]
 33%|███▎      | 123864/371472 [9:51:10<20:41:40,  3.32it/s]
 33%|███▎      | 123865/371472 [9:51:10<19:44:58,  3.48it/s]
 33%|███▎      | 123866/371472 [9:51:10<20:18:32,  3.39it/s]
 33%|███▎      | 123867/371472 [9:51:11<19:36:53,  3.51it/s]
 33%|███▎      | 123868/371472 [9:51:11<21:25:43,  3.21it/s]
 33%|███▎      | 123869/371472 [9:51:11<21:13:02,  3.24it/s]
 33%|███▎      | 123870/371472 [9:51:12<21:39:18,  3.18it/s]
 33%|███▎      | 123871/371472 [9:51:12<21:41:52,  3.17it/s]
 33%|███▎      | 123872/371472 [9:51:12<21:12:14,  3.24it/s]
 33%|███▎      | 123873/371472 [9:51:12<21:12:05,  3.24it/s]
 33%|███▎      | 123874/371472 [9:51:13<21:49:10,  3.15it/s]
 33%|███▎      | 123875/371472 [9:51:13<20:27:10,  3.36it/s]
 33%|███▎      | 123876/371472 [9:51:13<21:56:27,  3.13it/s]
 33%|███▎      | 123877/371472 [9:51:14<20:27:08,  3.36it/s]
 33%|███▎      | 123878/371472 [9:51:14<20:24:57,  3.37it/s]
 33%|███▎      | 123879/371472 [9:51:14<19:51:18,  3.46it/s]
 33%|███▎      | 123880/371472 [9:51:14<19:16:26,  3.57it/s]
                                                            
{'loss': 3.2656, 'learning_rate': 7.001874636385184e-07, 'epoch': 5.34}

 33%|███▎      | 123880/371472 [9:51:14<19:16:26,  3.57it/s]
 33%|███▎      | 123881/371472 [9:51:15<19:36:36,  3.51it/s]
 33%|███▎      | 123882/371472 [9:51:15<20:24:24,  3.37it/s]
 33%|███▎      | 123883/371472 [9:51:15<20:07:36,  3.42it/s]
 33%|███▎      | 123884/371472 [9:51:16<19:21:32,  3.55it/s]
 33%|███▎      | 123885/371472 [9:51:16<19:18:04,  3.56it/s]
 33%|███▎      | 123886/371472 [9:51:16<18:59:02,  3.62it/s]
 33%|███▎      | 123887/371472 [9:51:16<18:35:41,  3.70it/s]
 33%|███▎      | 123888/371472 [9:51:17<18:31:52,  3.71it/s]
 33%|███▎      | 123889/371472 [9:51:17<21:06:26,  3.26it/s]
 33%|███▎      | 123890/371472 [9:51:17<21:27:08,  3.21it/s]
 33%|███▎      | 123891/371472 [9:51:18<21:46:50,  3.16it/s]
 33%|███▎      | 123892/371472 [9:51:18<20:50:49,  3.30it/s]
 33%|███▎      | 123893/371472 [9:51:18<20:45:37,  3.31it/s]
 33%|███▎      | 123894/371472 [9:51:19<20:13:18,  3.40it/s]
 33%|███▎      | 123895/371472 [9:51:19<19:36:48,  3.51it/s]
 33%|███▎      | 123896/371472 [9:51:19<19:03:37,  3.61it/s]
 33%|███▎      | 123897/371472 [9:51:19<18:54:55,  3.64it/s]
 33%|███▎      | 123898/371472 [9:51:20<18:35:02,  3.70it/s]
 33%|███▎      | 123899/371472 [9:51:20<18:10:52,  3.78it/s]
 33%|███▎      | 123900/371472 [9:51:20<18:21:53,  3.74it/s]
                                                            
{'loss': 3.1612, 'learning_rate': 7.001389816630394e-07, 'epoch': 5.34}

 33%|███▎      | 123900/371472 [9:51:20<18:21:53,  3.74it/s]
 33%|███▎      | 123901/371472 [9:51:20<18:36:56,  3.69it/s]
 33%|███▎      | 123902/371472 [9:51:21<19:10:04,  3.59it/s]
 33%|███▎      | 123903/371472 [9:51:21<19:16:32,  3.57it/s]
 33%|███▎      | 123904/371472 [9:51:21<20:24:14,  3.37it/s]
 33%|███▎      | 123905/371472 [9:51:22<21:04:40,  3.26it/s]
 33%|███▎      | 123906/371472 [9:51:22<20:32:09,  3.35it/s]
 33%|███▎      | 123907/371472 [9:51:22<19:09:13,  3.59it/s]
 33%|███▎      | 123908/371472 [9:51:22<18:39:47,  3.68it/s]
 33%|███▎      | 123909/371472 [9:51:23<18:28:09,  3.72it/s]
 33%|███▎      | 123910/371472 [9:51:23<18:40:03,  3.68it/s]
 33%|███▎      | 123911/371472 [9:51:23<18:36:22,  3.70it/s]
 33%|███▎      | 123912/371472 [9:51:24<19:23:09,  3.55it/s]
 33%|███▎      | 123913/371472 [9:51:24<18:39:00,  3.69it/s]
 33%|███▎      | 123914/371472 [9:51:24<18:27:18,  3.73it/s]
 33%|███▎      | 123915/371472 [9:51:24<18:33:21,  3.71it/s]
 33%|███▎      | 123916/371472 [9:51:25<19:46:37,  3.48it/s]
 33%|███▎      | 123917/371472 [9:51:25<19:56:43,  3.45it/s]
 33%|███▎      | 123918/371472 [9:51:25<19:24:33,  3.54it/s]
 33%|███▎      | 123919/371472 [9:51:26<18:47:09,  3.66it/s]
 33%|███▎      | 123920/371472 [9:51:26<18:15:49,  3.77it/s]
                                                            
{'loss': 3.1975, 'learning_rate': 7.000904996875606e-07, 'epoch': 5.34}

 33%|███▎      | 123920/371472 [9:51:26<18:15:49,  3.77it/s]
 33%|███▎      | 123921/371472 [9:51:26<19:25:56,  3.54it/s]
 33%|███▎      | 123922/371472 [9:51:26<18:53:56,  3.64it/s]
 33%|███▎      | 123923/371472 [9:51:27<18:50:36,  3.65it/s]
 33%|███▎      | 123924/371472 [9:51:27<18:32:38,  3.71it/s]
 33%|███▎      | 123925/371472 [9:51:27<18:26:47,  3.73it/s]
 33%|███▎      | 123926/371472 [9:51:27<18:14:16,  3.77it/s]
 33%|███▎      | 123927/371472 [9:51:28<18:40:49,  3.68it/s]
 33%|███▎      | 123928/371472 [9:51:28<18:41:31,  3.68it/s]
 33%|███▎      | 123929/371472 [9:51:28<18:45:36,  3.67it/s]
 33%|███▎      | 123930/371472 [9:51:28<18:06:05,  3.80it/s]
 33%|███▎      | 123931/371472 [9:51:29<17:48:10,  3.86it/s]
 33%|███▎      | 123932/371472 [9:51:29<18:04:50,  3.80it/s]
 33%|███▎      | 123933/371472 [9:51:29<20:15:38,  3.39it/s]
 33%|███▎      | 123934/371472 [9:51:30<20:35:33,  3.34it/s]
 33%|███▎      | 123935/371472 [9:51:30<20:52:15,  3.29it/s]
 33%|███▎      | 123936/371472 [9:51:30<20:17:13,  3.39it/s]
 33%|███▎      | 123937/371472 [9:51:31<19:28:39,  3.53it/s]
 33%|███▎      | 123938/371472 [9:51:31<19:12:11,  3.58it/s]
 33%|███▎      | 123939/371472 [9:51:31<18:30:51,  3.71it/s]
 33%|███▎      | 123940/371472 [9:51:31<19:31:24,  3.52it/s]
                                                            
{'loss': 3.2904, 'learning_rate': 7.000420177120817e-07, 'epoch': 5.34}

 33%|███▎      | 123940/371472 [9:51:31<19:31:24,  3.52it/s]
 33%|███▎      | 123941/371472 [9:51:32<19:00:34,  3.62it/s]
 33%|███▎      | 123942/371472 [9:51:32<20:06:35,  3.42it/s]
 33%|███▎      | 123943/371472 [9:51:32<20:00:35,  3.44it/s]
 33%|███▎      | 123944/371472 [9:51:32<19:14:56,  3.57it/s]
 33%|███▎      | 123945/371472 [9:51:33<18:25:22,  3.73it/s]
 33%|███▎      | 123946/371472 [9:51:33<19:21:06,  3.55it/s]
 33%|███▎      | 123947/371472 [9:51:33<18:55:41,  3.63it/s]
 33%|███▎      | 123948/371472 [9:51:34<18:54:04,  3.64it/s]
 33%|███▎      | 123949/371472 [9:51:34<19:43:36,  3.49it/s]
 33%|███▎      | 123950/371472 [9:51:34<18:55:35,  3.63it/s]
 33%|███▎      | 123951/371472 [9:51:34<19:20:39,  3.55it/s]
 33%|███▎      | 123952/371472 [9:51:35<19:35:03,  3.51it/s]
 33%|███▎      | 123953/371472 [9:51:35<19:16:54,  3.57it/s]
 33%|███▎      | 123954/371472 [9:51:35<20:08:51,  3.41it/s]
 33%|███▎      | 123955/371472 [9:51:36<19:00:41,  3.62it/s]
 33%|███▎      | 123956/371472 [9:51:36<19:56:57,  3.45it/s]
 33%|███▎      | 123957/371472 [9:51:36<19:14:36,  3.57it/s]
 33%|███▎      | 123958/371472 [9:51:36<19:15:18,  3.57it/s]
 33%|███▎      | 123959/371472 [9:51:37<19:05:32,  3.60it/s]
 33%|███▎      | 123960/371472 [9:51:37<20:15:34,  3.39it/s]
                                                            
{'loss': 3.1987, 'learning_rate': 6.999935357366027e-07, 'epoch': 5.34}

 33%|███▎      | 123960/371472 [9:51:37<20:15:34,  3.39it/s]
 33%|███▎      | 123961/371472 [9:51:37<19:37:52,  3.50it/s]
 33%|███▎      | 123962/371472 [9:51:38<19:32:57,  3.52it/s]
 33%|███▎      | 123963/371472 [9:51:38<18:49:17,  3.65it/s]
 33%|███▎      | 123964/371472 [9:51:38<18:53:34,  3.64it/s]
 33%|███▎      | 123965/371472 [9:51:38<19:30:03,  3.53it/s]
 33%|███▎      | 123966/371472 [9:51:39<19:45:42,  3.48it/s]
 33%|███▎      | 123967/371472 [9:51:39<19:01:33,  3.61it/s]
 33%|███▎      | 123968/371472 [9:51:39<20:13:50,  3.40it/s]
 33%|███▎      | 123969/371472 [9:51:40<20:16:06,  3.39it/s]
 33%|███▎      | 123970/371472 [9:51:40<20:35:28,  3.34it/s]
 33%|███▎      | 123971/371472 [9:51:40<20:45:00,  3.31it/s]
 33%|███▎      | 123972/371472 [9:51:40<20:33:32,  3.34it/s]
 33%|███▎      | 123973/371472 [9:51:41<19:30:28,  3.52it/s]
 33%|███▎      | 123974/371472 [9:51:41<18:56:33,  3.63it/s]
 33%|███▎      | 123975/371472 [9:51:41<19:13:29,  3.58it/s]
 33%|███▎      | 123976/371472 [9:51:41<18:18:06,  3.76it/s]
 33%|███▎      | 123977/371472 [9:51:42<18:23:15,  3.74it/s]
 33%|███▎      | 123978/371472 [9:51:42<18:45:45,  3.66it/s]
 33%|███▎      | 123979/371472 [9:51:42<20:18:07,  3.39it/s]
 33%|███▎      | 123980/371472 [9:51:43<21:35:12,  3.18it/s]
                                                            
{'loss': 3.1677, 'learning_rate': 6.999450537611238e-07, 'epoch': 5.34}

 33%|███▎      | 123980/371472 [9:51:43<21:35:12,  3.18it/s]
 33%|███▎      | 123981/371472 [9:51:43<21:59:12,  3.13it/s]
 33%|███▎      | 123982/371472 [9:51:43<21:16:21,  3.23it/s]
 33%|███▎      | 123983/371472 [9:51:44<20:35:16,  3.34it/s]
 33%|███▎      | 123984/371472 [9:51:44<19:31:27,  3.52it/s]
 33%|███▎      | 123985/371472 [9:51:44<19:43:55,  3.48it/s]
 33%|███▎      | 123986/371472 [9:51:44<19:55:49,  3.45it/s]
 33%|███▎      | 123987/371472 [9:51:45<19:54:56,  3.45it/s]
 33%|███▎      | 123988/371472 [9:51:45<19:01:36,  3.61it/s]
 33%|███▎      | 123989/371472 [9:51:45<18:51:16,  3.65it/s]
 33%|███▎      | 123990/371472 [9:51:46<18:57:46,  3.63it/s]
 33%|███▎      | 123991/371472 [9:51:46<18:44:11,  3.67it/s]
 33%|███▎      | 123992/371472 [9:51:46<18:17:58,  3.76it/s]
 33%|███▎      | 123993/371472 [9:51:46<18:23:51,  3.74it/s]
 33%|███▎      | 123994/371472 [9:51:47<18:37:15,  3.69it/s]
 33%|███▎      | 123995/371472 [9:51:47<19:00:29,  3.62it/s]
 33%|███▎      | 123996/371472 [9:51:47<20:04:56,  3.42it/s]
 33%|███▎      | 123997/371472 [9:51:48<20:46:09,  3.31it/s]
 33%|███▎      | 123998/371472 [9:51:48<19:41:24,  3.49it/s]
 33%|███▎      | 123999/371472 [9:51:48<19:08:27,  3.59it/s]
 33%|███▎      | 124000/371472 [9:51:48<18:46:33,  3.66it/s]
                                                            
{'loss': 3.1516, 'learning_rate': 6.99896571785645e-07, 'epoch': 5.34}

 33%|███▎      | 124000/371472 [9:51:48<18:46:33,  3.66it/s]
 33%|███▎      | 124001/371472 [9:51:49<20:34:07,  3.34it/s]
 33%|███▎      | 124002/371472 [9:51:49<20:56:12,  3.28it/s]
 33%|███▎      | 124003/371472 [9:51:49<20:03:47,  3.43it/s]
 33%|███▎      | 124004/371472 [9:51:50<19:33:04,  3.52it/s]
 33%|███▎      | 124005/371472 [9:51:50<18:26:44,  3.73it/s]
 33%|███▎      | 124006/371472 [9:51:50<17:57:36,  3.83it/s]
 33%|███▎      | 124007/371472 [9:51:50<20:11:46,  3.40it/s]
 33%|███▎      | 124008/371472 [9:51:51<19:18:57,  3.56it/s]
 33%|███▎      | 124009/371472 [9:51:51<19:47:11,  3.47it/s]
 33%|███▎      | 124010/371472 [9:51:51<19:24:45,  3.54it/s]
 33%|███▎      | 124011/371472 [9:51:52<19:10:11,  3.59it/s]
 33%|███▎      | 124012/371472 [9:51:52<19:00:14,  3.62it/s]
 33%|███▎      | 124013/371472 [9:51:52<19:26:16,  3.54it/s]
 33%|███▎      | 124014/371472 [9:51:52<18:56:39,  3.63it/s]
 33%|███▎      | 124015/371472 [9:51:53<18:27:06,  3.73it/s]
 33%|███▎      | 124016/371472 [9:51:53<18:12:54,  3.77it/s]
 33%|███▎      | 124017/371472 [9:51:53<19:46:39,  3.48it/s]
 33%|███▎      | 124018/371472 [9:51:53<19:51:21,  3.46it/s]
 33%|███▎      | 124019/371472 [9:51:54<19:44:44,  3.48it/s]
 33%|███▎      | 124020/371472 [9:51:54<18:56:08,  3.63it/s]
                                                            
{'loss': 3.0876, 'learning_rate': 6.998480898101662e-07, 'epoch': 5.34}

 33%|███▎      | 124020/371472 [9:51:54<18:56:08,  3.63it/s]
 33%|███▎      | 124021/371472 [9:51:54<18:20:57,  3.75it/s]
 33%|███▎      | 124022/371472 [9:51:55<19:02:04,  3.61it/s]
 33%|███▎      | 124023/371472 [9:51:55<18:35:54,  3.70it/s]
 33%|███▎      | 124024/371472 [9:51:55<17:58:45,  3.82it/s]
 33%|███▎      | 124025/371472 [9:51:55<17:32:18,  3.92it/s]
 33%|███▎      | 124026/371472 [9:51:56<18:34:48,  3.70it/s]
 33%|███▎      | 124027/371472 [9:51:56<19:05:19,  3.60it/s]
 33%|███▎      | 124028/371472 [9:51:56<19:06:31,  3.60it/s]
 33%|███▎      | 124029/371472 [9:51:56<18:27:52,  3.72it/s]
 33%|███▎      | 124030/371472 [9:51:57<19:45:52,  3.48it/s]
 33%|███▎      | 124031/371472 [9:51:57<19:34:45,  3.51it/s]
 33%|███▎      | 124032/371472 [9:51:57<18:56:26,  3.63it/s]
 33%|███▎      | 124033/371472 [9:51:58<18:51:51,  3.64it/s]
 33%|███▎      | 124034/371472 [9:51:58<18:51:35,  3.64it/s]
 33%|███▎      | 124035/371472 [9:51:58<18:51:46,  3.64it/s]
 33%|███▎      | 124036/371472 [9:51:58<20:42:50,  3.32it/s]
 33%|███▎      | 124037/371472 [9:51:59<19:54:13,  3.45it/s]
 33%|███▎      | 124038/371472 [9:51:59<19:48:39,  3.47it/s]
 33%|███▎      | 124039/371472 [9:51:59<19:40:22,  3.49it/s]
 33%|███▎      | 124040/371472 [9:52:00<19:38:39,  3.50it/s]
                                                            
{'loss': 3.3544, 'learning_rate': 6.997996078346872e-07, 'epoch': 5.34}

 33%|███▎      | 124040/371472 [9:52:00<19:38:39,  3.50it/s]
 33%|███▎      | 124041/371472 [9:52:00<18:51:20,  3.65it/s]
 33%|███▎      | 124042/371472 [9:52:00<18:52:23,  3.64it/s]
 33%|███▎      | 124043/371472 [9:52:00<18:56:32,  3.63it/s]
 33%|███▎      | 124044/371472 [9:52:01<18:17:54,  3.76it/s]
 33%|███▎      | 124045/371472 [9:52:01<19:24:04,  3.54it/s]
 33%|███▎      | 124046/371472 [9:52:01<18:55:47,  3.63it/s]
 33%|███▎      | 124047/371472 [9:52:01<19:12:24,  3.58it/s]
 33%|███▎      | 124048/371472 [9:52:02<18:45:16,  3.66it/s]
 33%|███▎      | 124049/371472 [9:52:02<19:52:55,  3.46it/s]
 33%|███▎      | 124050/371472 [9:52:02<19:18:15,  3.56it/s]
 33%|███▎      | 124051/371472 [9:52:03<18:51:41,  3.64it/s]
 33%|███▎      | 124052/371472 [9:52:03<18:17:28,  3.76it/s]
 33%|███▎      | 124053/371472 [9:52:03<18:45:42,  3.66it/s]
 33%|███▎      | 124054/371472 [9:52:03<18:55:01,  3.63it/s]
 33%|███▎      | 124055/371472 [9:52:04<18:43:20,  3.67it/s]
 33%|███▎      | 124056/371472 [9:52:04<18:37:19,  3.69it/s]
 33%|███▎      | 124057/371472 [9:52:04<19:10:09,  3.59it/s]
 33%|███▎      | 124058/371472 [9:52:05<20:19:49,  3.38it/s]
 33%|███▎      | 124059/371472 [9:52:05<19:14:02,  3.57it/s]
 33%|███▎      | 124060/371472 [9:52:05<19:08:32,  3.59it/s]
                                                            
{'loss': 3.1773, 'learning_rate': 6.997511258592082e-07, 'epoch': 5.34}

 33%|███▎      | 124060/371472 [9:52:05<19:08:32,  3.59it/s]
 33%|███▎      | 124061/371472 [9:52:05<19:13:50,  3.57it/s]
 33%|███▎      | 124062/371472 [9:52:06<19:34:11,  3.51it/s]
 33%|███▎      | 124063/371472 [9:52:06<19:10:02,  3.59it/s]
 33%|███▎      | 124064/371472 [9:52:06<18:24:59,  3.73it/s]
 33%|███▎      | 124065/371472 [9:52:06<19:15:04,  3.57it/s]
 33%|███▎      | 124066/371472 [9:52:07<18:36:32,  3.69it/s]
 33%|███▎      | 124067/371472 [9:52:07<19:09:21,  3.59it/s]
 33%|███▎      | 124068/371472 [9:52:07<19:04:47,  3.60it/s]
 33%|███▎      | 124069/371472 [9:52:08<20:09:03,  3.41it/s]
 33%|███▎      | 124070/371472 [9:52:08<20:46:00,  3.31it/s]
 33%|███▎      | 124071/371472 [9:52:08<20:22:46,  3.37it/s]
 33%|███▎      | 124072/371472 [9:52:09<21:13:33,  3.24it/s]
 33%|███▎      | 124073/371472 [9:52:09<20:58:26,  3.28it/s]
 33%|███▎      | 124074/371472 [9:52:09<20:26:01,  3.36it/s]
 33%|███▎      | 124075/371472 [9:52:09<20:15:50,  3.39it/s]
 33%|███▎      | 124076/371472 [9:52:10<19:06:05,  3.60it/s]
 33%|███▎      | 124077/371472 [9:52:10<19:58:30,  3.44it/s]
 33%|███▎      | 124078/371472 [9:52:10<21:49:47,  3.15it/s]
 33%|███▎      | 124079/371472 [9:52:11<20:40:59,  3.32it/s]
 33%|███▎      | 124080/371472 [9:52:11<19:36:25,  3.50it/s]
                                                            
{'loss': 3.1361, 'learning_rate': 6.997026438837294e-07, 'epoch': 5.34}

 33%|███▎      | 124080/371472 [9:52:11<19:36:25,  3.50it/s]
 33%|███▎      | 124081/371472 [9:52:11<19:34:26,  3.51it/s]
 33%|███▎      | 124082/371472 [9:52:11<19:33:19,  3.51it/s]
 33%|███▎      | 124083/371472 [9:52:12<20:47:53,  3.30it/s]
 33%|███▎      | 124084/371472 [9:52:12<22:05:57,  3.11it/s]
 33%|███▎      | 124085/371472 [9:52:12<21:14:41,  3.23it/s]
 33%|███▎      | 124086/371472 [9:52:13<20:29:11,  3.35it/s]
 33%|███▎      | 124087/371472 [9:52:13<20:30:13,  3.35it/s]
 33%|███▎      | 124088/371472 [9:52:13<21:14:53,  3.23it/s]
 33%|███▎      | 124089/371472 [9:52:14<20:12:37,  3.40it/s]
 33%|███▎      | 124090/371472 [9:52:14<19:14:18,  3.57it/s]
 33%|███▎      | 124091/371472 [9:52:14<18:45:07,  3.66it/s]
 33%|███▎      | 124092/371472 [9:52:14<18:44:11,  3.67it/s]
 33%|███▎      | 124093/371472 [9:52:15<18:41:26,  3.68it/s]
 33%|███▎      | 124094/371472 [9:52:15<18:15:09,  3.76it/s]
 33%|███▎      | 124095/371472 [9:52:15<18:30:39,  3.71it/s]
 33%|███▎      | 124096/371472 [9:52:15<19:02:08,  3.61it/s]
 33%|███▎      | 124097/371472 [9:52:16<19:32:42,  3.52it/s]
 33%|███▎      | 124098/371472 [9:52:16<19:37:08,  3.50it/s]
 33%|███▎      | 124099/371472 [9:52:16<19:31:02,  3.52it/s]
 33%|███▎      | 124100/371472 [9:52:17<19:41:21,  3.49it/s]
                                                            
{'loss': 3.0797, 'learning_rate': 6.996541619082506e-07, 'epoch': 5.35}

 33%|███▎      | 124100/371472 [9:52:17<19:41:21,  3.49it/s]
 33%|███▎      | 124101/371472 [9:52:17<19:43:39,  3.48it/s]
 33%|███▎      | 124102/371472 [9:52:17<19:10:46,  3.58it/s]
 33%|███▎      | 124103/371472 [9:52:18<19:51:20,  3.46it/s]
 33%|███▎      | 124104/371472 [9:52:18<19:27:26,  3.53it/s]
 33%|███▎      | 124105/371472 [9:52:18<18:51:16,  3.64it/s]
 33%|███▎      | 124106/371472 [9:52:18<18:30:25,  3.71it/s]
 33%|███▎      | 124107/371472 [9:52:19<18:52:00,  3.64it/s]
 33%|███▎      | 124108/371472 [9:52:19<17:53:47,  3.84it/s]
 33%|███▎      | 124109/371472 [9:52:19<17:53:52,  3.84it/s]
 33%|███▎      | 124110/371472 [9:52:19<17:41:13,  3.88it/s]
 33%|███▎      | 124111/371472 [9:52:20<19:11:51,  3.58it/s]
 33%|███▎      | 124112/371472 [9:52:20<18:06:57,  3.79it/s]
 33%|███▎      | 124113/371472 [9:52:20<17:44:03,  3.87it/s]
 33%|███▎      | 124114/371472 [9:52:20<17:39:12,  3.89it/s]
 33%|███▎      | 124115/371472 [9:52:21<17:34:55,  3.91it/s]
 33%|███▎      | 124116/371472 [9:52:21<17:43:09,  3.88it/s]
 33%|███▎      | 124117/371472 [9:52:21<17:38:22,  3.90it/s]
 33%|███▎      | 124118/371472 [9:52:21<17:21:43,  3.96it/s]
 33%|███▎      | 124119/371472 [9:52:22<18:38:53,  3.68it/s]
 33%|███▎      | 124120/371472 [9:52:22<17:49:17,  3.86it/s]
                                                            
{'loss': 3.2646, 'learning_rate': 6.996056799327716e-07, 'epoch': 5.35}

 33%|███▎      | 124120/371472 [9:52:22<17:49:17,  3.86it/s]
 33%|███▎      | 124121/371472 [9:52:22<19:15:34,  3.57it/s]
 33%|███▎      | 124122/371472 [9:52:23<18:37:16,  3.69it/s]
 33%|███▎      | 124123/371472 [9:52:23<20:53:35,  3.29it/s]
 33%|███▎      | 124124/371472 [9:52:23<20:18:16,  3.38it/s]
 33%|███▎      | 124125/371472 [9:52:23<19:34:08,  3.51it/s]
 33%|███▎      | 124126/371472 [9:52:24<18:57:40,  3.62it/s]
 33%|███▎      | 124127/371472 [9:52:24<19:03:02,  3.61it/s]
 33%|███▎      | 124128/371472 [9:52:24<18:58:08,  3.62it/s]
 33%|███▎      | 124129/371472 [9:52:25<19:01:31,  3.61it/s]
 33%|███▎      | 124130/371472 [9:52:25<19:03:17,  3.61it/s]
 33%|███▎      | 124131/371472 [9:52:25<18:25:11,  3.73it/s]
 33%|███▎      | 124132/371472 [9:52:25<19:45:04,  3.48it/s]
 33%|███▎      | 124133/371472 [9:52:26<19:43:50,  3.48it/s]
 33%|███▎      | 124134/371472 [9:52:26<19:17:39,  3.56it/s]
 33%|███▎      | 124135/371472 [9:52:26<18:55:05,  3.63it/s]
 33%|███▎      | 124136/371472 [9:52:26<18:48:26,  3.65it/s]
 33%|███▎      | 124137/371472 [9:52:27<18:56:23,  3.63it/s]
 33%|███▎      | 124138/371472 [9:52:27<19:06:45,  3.59it/s]
 33%|███▎      | 124139/371472 [9:52:27<19:32:05,  3.52it/s]
 33%|███▎      | 124140/371472 [9:52:28<19:21:36,  3.55it/s]
                                                            
{'loss': 3.3926, 'learning_rate': 6.995571979572927e-07, 'epoch': 5.35}

 33%|███▎      | 124140/371472 [9:52:28<19:21:36,  3.55it/s]
 33%|███▎      | 124141/371472 [9:52:28<18:55:02,  3.63it/s]
 33%|███▎      | 124142/371472 [9:52:28<18:09:58,  3.78it/s]
 33%|███▎      | 124143/371472 [9:52:28<18:55:16,  3.63it/s]
 33%|███▎      | 124144/371472 [9:52:29<18:36:03,  3.69it/s]
 33%|███▎      | 124145/371472 [9:52:29<18:59:54,  3.62it/s]
 33%|███▎      | 124146/371472 [9:52:29<19:02:15,  3.61it/s]
 33%|███▎      | 124147/371472 [9:52:30<18:50:29,  3.65it/s]
 33%|███▎      | 124148/371472 [9:52:30<18:27:38,  3.72it/s]
 33%|███▎      | 124149/371472 [9:52:30<18:23:47,  3.73it/s]
 33%|███▎      | 124150/371472 [9:52:30<21:44:24,  3.16it/s]
 33%|███▎      | 124151/371472 [9:52:31<19:52:39,  3.46it/s]
 33%|███▎      | 124152/371472 [9:52:31<18:47:58,  3.65it/s]
 33%|███▎      | 124153/371472 [9:52:31<18:59:20,  3.62it/s]
 33%|███▎      | 124154/371472 [9:52:31<18:07:44,  3.79it/s]
 33%|███▎      | 124155/371472 [9:52:32<17:52:45,  3.84it/s]
 33%|███▎      | 124156/371472 [9:52:32<17:49:29,  3.85it/s]
 33%|███▎      | 124157/371472 [9:52:32<18:21:14,  3.74it/s]
 33%|███▎      | 124158/371472 [9:52:32<18:08:44,  3.79it/s]
 33%|███▎      | 124159/371472 [9:52:33<18:32:01,  3.71it/s]
 33%|███▎      | 124160/371472 [9:52:33<20:33:48,  3.34it/s]
                                                            
{'loss': 3.1273, 'learning_rate': 6.99508715981814e-07, 'epoch': 5.35}

 33%|███▎      | 124160/371472 [9:52:33<20:33:48,  3.34it/s]
 33%|███▎      | 124161/371472 [9:52:33<19:57:31,  3.44it/s]
 33%|███▎      | 124162/371472 [9:52:34<18:51:33,  3.64it/s]
 33%|███▎      | 124163/371472 [9:52:34<18:00:58,  3.81it/s]
 33%|███▎      | 124164/371472 [9:52:34<17:45:19,  3.87it/s]
 33%|███▎      | 124165/371472 [9:52:34<17:37:03,  3.90it/s]
 33%|███▎      | 124166/371472 [9:52:35<17:48:48,  3.86it/s]
 33%|███▎      | 124167/371472 [9:52:35<18:32:05,  3.71it/s]
 33%|███▎      | 124168/371472 [9:52:35<17:55:45,  3.83it/s]
 33%|███▎      | 124169/371472 [9:52:35<17:32:20,  3.92it/s]
 33%|███▎      | 124170/371472 [9:52:36<17:23:28,  3.95it/s]
 33%|███▎      | 124171/371472 [9:52:36<17:17:59,  3.97it/s]
 33%|███▎      | 124172/371472 [9:52:36<17:28:23,  3.93it/s]
 33%|███▎      | 124173/371472 [9:52:36<18:41:40,  3.67it/s]
 33%|███▎      | 124174/371472 [9:52:37<19:26:00,  3.53it/s]
 33%|███▎      | 124175/371472 [9:52:37<19:04:56,  3.60it/s]
 33%|███▎      | 124176/371472 [9:52:37<18:43:35,  3.67it/s]
 33%|███▎      | 124177/371472 [9:52:38<18:47:18,  3.66it/s]
 33%|███▎      | 124178/371472 [9:52:38<19:04:55,  3.60it/s]
 33%|███▎      | 124179/371472 [9:52:38<18:53:12,  3.64it/s]
 33%|███▎      | 124180/371472 [9:52:38<19:13:09,  3.57it/s]
                                                            
{'loss': 3.3624, 'learning_rate': 6.99460234006335e-07, 'epoch': 5.35}

 33%|███▎      | 124180/371472 [9:52:38<19:13:09,  3.57it/s]
 33%|███▎      | 124181/371472 [9:52:39<18:37:49,  3.69it/s]
 33%|███▎      | 124182/371472 [9:52:39<18:02:16,  3.81it/s]
 33%|███▎      | 124183/371472 [9:52:39<19:11:47,  3.58it/s]
 33%|███▎      | 124184/371472 [9:52:40<20:28:14,  3.36it/s]
 33%|███▎      | 124185/371472 [9:52:40<20:25:03,  3.36it/s]
 33%|███▎      | 124186/371472 [9:52:40<19:09:20,  3.59it/s]
 33%|███▎      | 124187/371472 [9:52:40<18:59:00,  3.62it/s]
 33%|███▎      | 124188/371472 [9:52:41<18:31:17,  3.71it/s]
 33%|███▎      | 124189/371472 [9:52:41<18:14:36,  3.77it/s]
 33%|███▎      | 124190/371472 [9:52:41<18:47:48,  3.65it/s]
 33%|███▎      | 124191/371472 [9:52:41<19:05:04,  3.60it/s]
 33%|███▎      | 124192/371472 [9:52:42<19:26:37,  3.53it/s]
 33%|███▎      | 124193/371472 [9:52:42<18:53:25,  3.64it/s]
 33%|███▎      | 124194/371472 [9:52:42<19:21:34,  3.55it/s]
 33%|███▎      | 124195/371472 [9:52:43<19:19:22,  3.55it/s]
 33%|███▎      | 124196/371472 [9:52:43<18:47:16,  3.66it/s]
 33%|███▎      | 124197/371472 [9:52:43<18:17:55,  3.75it/s]
 33%|███▎      | 124198/371472 [9:52:43<19:04:56,  3.60it/s]
 33%|███▎      | 124199/371472 [9:52:44<19:52:56,  3.45it/s]
 33%|███▎      | 124200/371472 [9:52:44<20:29:16,  3.35it/s]
                                                            
{'loss': 3.2057, 'learning_rate': 6.99411752030856e-07, 'epoch': 5.35}

 33%|███▎      | 124200/371472 [9:52:44<20:29:16,  3.35it/s]
 33%|███▎      | 124201/371472 [9:52:44<20:39:16,  3.33it/s]
 33%|███▎      | 124202/371472 [9:52:45<20:26:23,  3.36it/s]
 33%|███▎      | 124203/371472 [9:52:45<19:44:23,  3.48it/s]
 33%|███▎      | 124204/371472 [9:52:45<19:27:38,  3.53it/s]
 33%|███▎      | 124205/371472 [9:52:45<18:56:09,  3.63it/s]
 33%|███▎      | 124206/371472 [9:52:46<19:40:06,  3.49it/s]
 33%|███▎      | 124207/371472 [9:52:46<19:34:55,  3.51it/s]
 33%|███▎      | 124208/371472 [9:52:46<18:56:52,  3.62it/s]
 33%|███▎      | 124209/371472 [9:52:47<17:59:29,  3.82it/s]
 33%|███▎      | 124210/371472 [9:52:47<17:29:19,  3.93it/s]
 33%|███▎      | 124211/371472 [9:52:47<17:34:08,  3.91it/s]
 33%|███▎      | 124212/371472 [9:52:47<17:58:22,  3.82it/s]
 33%|███▎      | 124213/371472 [9:52:48<18:15:44,  3.76it/s]
 33%|███▎      | 124214/371472 [9:52:48<18:21:10,  3.74it/s]
 33%|███▎      | 124215/371472 [9:52:48<19:42:50,  3.48it/s]
 33%|███▎      | 124216/371472 [9:52:48<19:12:04,  3.58it/s]
 33%|███▎      | 124217/371472 [9:52:49<18:24:36,  3.73it/s]
 33%|███▎      | 124218/371472 [9:52:49<18:44:49,  3.66it/s]
 33%|███▎      | 124219/371472 [9:52:49<19:26:27,  3.53it/s]
 33%|███▎      | 124220/371472 [9:52:50<18:51:32,  3.64it/s]
                                                            
{'loss': 3.3404, 'learning_rate': 6.993632700553771e-07, 'epoch': 5.35}

 33%|███▎      | 124220/371472 [9:52:50<18:51:32,  3.64it/s]
 33%|███▎      | 124221/371472 [9:52:50<18:47:44,  3.65it/s]
 33%|███▎      | 124222/371472 [9:52:50<18:21:21,  3.74it/s]
 33%|███▎      | 124223/371472 [9:52:50<19:13:07,  3.57it/s]
 33%|███▎      | 124224/371472 [9:52:51<18:39:35,  3.68it/s]
 33%|███▎      | 124225/371472 [9:52:51<18:27:30,  3.72it/s]
 33%|███▎      | 124226/371472 [9:52:51<18:11:25,  3.78it/s]
 33%|███▎      | 124227/371472 [9:52:51<17:59:04,  3.82it/s]
 33%|███▎      | 124228/371472 [9:52:52<18:08:20,  3.79it/s]
 33%|███▎      | 124229/371472 [9:52:52<17:51:23,  3.85it/s]
 33%|███▎      | 124230/371472 [9:52:52<17:40:58,  3.88it/s]
 33%|███▎      | 124231/371472 [9:52:52<19:09:10,  3.59it/s]
 33%|███▎      | 124232/371472 [9:52:53<18:46:15,  3.66it/s]
 33%|███▎      | 124233/371472 [9:52:53<19:26:54,  3.53it/s]
 33%|███▎      | 124234/371472 [9:52:53<19:16:47,  3.56it/s]
 33%|███▎      | 124235/371472 [9:52:54<19:08:24,  3.59it/s]
 33%|███▎      | 124236/371472 [9:52:54<19:35:17,  3.51it/s]
 33%|███▎      | 124237/371472 [9:52:54<18:59:49,  3.62it/s]
 33%|███▎      | 124238/371472 [9:52:54<18:18:28,  3.75it/s]
 33%|███▎      | 124239/371472 [9:52:55<18:23:25,  3.73it/s]
 33%|███▎      | 124240/371472 [9:52:55<18:42:00,  3.67it/s]
                                                            
{'loss': 3.162, 'learning_rate': 6.993147880798983e-07, 'epoch': 5.35}

 33%|███▎      | 124240/371472 [9:52:55<18:42:00,  3.67it/s]
 33%|███▎      | 124241/371472 [9:52:55<18:27:29,  3.72it/s]
 33%|███▎      | 124242/371472 [9:52:56<19:25:58,  3.53it/s]
 33%|███▎      | 124243/371472 [9:52:56<19:48:14,  3.47it/s]
 33%|███▎      | 124244/371472 [9:52:56<19:10:06,  3.58it/s]
 33%|███▎      | 124245/371472 [9:52:56<18:23:06,  3.74it/s]
 33%|███▎      | 124246/371472 [9:52:57<19:16:36,  3.56it/s]
 33%|███▎      | 124247/371472 [9:52:57<19:49:01,  3.47it/s]
 33%|███▎      | 124248/371472 [9:52:57<19:07:25,  3.59it/s]
 33%|███▎      | 124249/371472 [9:52:58<21:02:44,  3.26it/s]
 33%|███▎      | 124250/371472 [9:52:58<19:50:32,  3.46it/s]
 33%|███▎      | 124251/371472 [9:52:58<19:17:54,  3.56it/s]
 33%|███▎      | 124252/371472 [9:52:58<19:12:09,  3.58it/s]
 33%|███▎      | 124253/371472 [9:52:59<18:50:52,  3.64it/s]
 33%|███▎      | 124254/371472 [9:52:59<18:39:08,  3.68it/s]
 33%|███▎      | 124255/371472 [9:52:59<19:03:39,  3.60it/s]
 33%|███▎      | 124256/371472 [9:52:59<18:30:28,  3.71it/s]
 33%|███▎      | 124257/371472 [9:53:00<18:46:40,  3.66it/s]
 33%|███▎      | 124258/371472 [9:53:00<18:44:32,  3.66it/s]
 33%|███▎      | 124259/371472 [9:53:00<19:46:12,  3.47it/s]
 33%|███▎      | 124260/371472 [9:53:01<18:52:58,  3.64it/s]
                                                            
{'loss': 3.011, 'learning_rate': 6.992663061044195e-07, 'epoch': 5.35}

 33%|███▎      | 124260/371472 [9:53:01<18:52:58,  3.64it/s]
 33%|███▎      | 124261/371472 [9:53:01<18:22:59,  3.74it/s]
 33%|███▎      | 124262/371472 [9:53:01<18:08:20,  3.79it/s]
 33%|███▎      | 124263/371472 [9:53:01<18:16:01,  3.76it/s]
 33%|███▎      | 124264/371472 [9:53:02<19:13:45,  3.57it/s]
 33%|███▎      | 124265/371472 [9:53:02<18:59:22,  3.62it/s]
 33%|███▎      | 124266/371472 [9:53:02<18:51:39,  3.64it/s]
 33%|███▎      | 124267/371472 [9:53:03<21:38:09,  3.17it/s]
 33%|███▎      | 124268/371472 [9:53:03<20:13:24,  3.40it/s]
 33%|███▎      | 124269/371472 [9:53:03<19:59:58,  3.43it/s]
 33%|███▎      | 124270/371472 [9:53:03<19:24:39,  3.54it/s]
 33%|███▎      | 124271/371472 [9:53:04<18:40:32,  3.68it/s]
 33%|███▎      | 124272/371472 [9:53:04<18:59:34,  3.62it/s]
 33%|███▎      | 124273/371472 [9:53:04<18:55:57,  3.63it/s]
 33%|███▎      | 124274/371472 [9:53:04<19:03:52,  3.60it/s]
 33%|███▎      | 124275/371472 [9:53:05<19:33:27,  3.51it/s]
 33%|███▎      | 124276/371472 [9:53:05<19:54:19,  3.45it/s]
 33%|███▎      | 124277/371472 [9:53:05<18:42:37,  3.67it/s]
 33%|███▎      | 124278/371472 [9:53:06<18:20:10,  3.74it/s]
 33%|███▎      | 124279/371472 [9:53:06<18:24:47,  3.73it/s]
 33%|███▎      | 124280/371472 [9:53:06<18:44:50,  3.66it/s]
                                                            
{'loss': 3.2391, 'learning_rate': 6.992178241289405e-07, 'epoch': 5.35}

 33%|███▎      | 124280/371472 [9:53:06<18:44:50,  3.66it/s]
 33%|███▎      | 124281/371472 [9:53:06<18:48:24,  3.65it/s]
 33%|███▎      | 124282/371472 [9:53:07<18:55:07,  3.63it/s]
 33%|███▎      | 124283/371472 [9:53:07<18:51:27,  3.64it/s]
 33%|███▎      | 124284/371472 [9:53:07<21:11:21,  3.24it/s]
 33%|███▎      | 124285/371472 [9:53:08<19:52:11,  3.46it/s]
 33%|███▎      | 124286/371472 [9:53:08<18:52:31,  3.64it/s]
 33%|███▎      | 124287/371472 [9:53:08<18:55:17,  3.63it/s]
 33%|███▎      | 124288/371472 [9:53:08<20:09:05,  3.41it/s]
 33%|███▎      | 124289/371472 [9:53:09<19:15:12,  3.57it/s]
 33%|███▎      | 124290/371472 [9:53:09<18:57:35,  3.62it/s]
 33%|███▎      | 124291/371472 [9:53:09<18:44:39,  3.66it/s]
 33%|███▎      | 124292/371472 [9:53:10<18:45:10,  3.66it/s]
 33%|███▎      | 124293/371472 [9:53:10<19:04:18,  3.60it/s]
 33%|███▎      | 124294/371472 [9:53:10<18:46:44,  3.66it/s]
 33%|███▎      | 124295/371472 [9:53:10<18:24:29,  3.73it/s]
 33%|███▎      | 124296/371472 [9:53:11<18:22:53,  3.74it/s]
 33%|███▎      | 124297/371472 [9:53:11<18:34:45,  3.70it/s]
 33%|███▎      | 124298/371472 [9:53:11<18:13:14,  3.77it/s]
 33%|███▎      | 124299/371472 [9:53:11<17:51:53,  3.84it/s]
 33%|███▎      | 124300/371472 [9:53:12<18:54:19,  3.63it/s]
                                                            
{'loss': 3.3316, 'learning_rate': 6.991693421534616e-07, 'epoch': 5.35}

 33%|███▎      | 124300/371472 [9:53:12<18:54:19,  3.63it/s]
 33%|███▎      | 124301/371472 [9:53:12<19:02:06,  3.61it/s]
 33%|███▎      | 124302/371472 [9:53:12<18:55:31,  3.63it/s]
 33%|███▎      | 124303/371472 [9:53:12<18:36:55,  3.69it/s]
 33%|███▎      | 124304/371472 [9:53:13<19:27:05,  3.53it/s]
 33%|███▎      | 124305/371472 [9:53:13<19:52:07,  3.46it/s]
 33%|███▎      | 124306/371472 [9:53:13<19:06:57,  3.59it/s]
 33%|███▎      | 124307/371472 [9:53:14<18:30:49,  3.71it/s]
 33%|███▎      | 124308/371472 [9:53:14<20:42:57,  3.31it/s]
 33%|███▎      | 124309/371472 [9:53:14<19:44:30,  3.48it/s]
 33%|███▎      | 124310/371472 [9:53:15<20:39:46,  3.32it/s]
 33%|███▎      | 124311/371472 [9:53:15<20:02:39,  3.43it/s]
 33%|███▎      | 124312/371472 [9:53:15<19:29:40,  3.52it/s]
 33%|███▎      | 124313/371472 [9:53:15<21:02:51,  3.26it/s]
 33%|███▎      | 124314/371472 [9:53:16<20:34:52,  3.34it/s]
 33%|███▎      | 124315/371472 [9:53:16<20:46:25,  3.30it/s]
 33%|███▎      | 124316/371472 [9:53:16<21:20:44,  3.22it/s]
 33%|███▎      | 124317/371472 [9:53:17<23:30:37,  2.92it/s]
 33%|███▎      | 124318/371472 [9:53:17<22:18:33,  3.08it/s]
 33%|███▎      | 124319/371472 [9:53:17<22:17:07,  3.08it/s]
 33%|███▎      | 124320/371472 [9:53:18<21:00:10,  3.27it/s]
                                                            
{'loss': 3.2561, 'learning_rate': 6.991208601779827e-07, 'epoch': 5.35}

 33%|███▎      | 124320/371472 [9:53:18<21:00:10,  3.27it/s]
 33%|███▎      | 124321/371472 [9:53:18<22:13:17,  3.09it/s]
 33%|███▎      | 124322/371472 [9:53:18<21:16:12,  3.23it/s]
 33%|███▎      | 124323/371472 [9:53:19<20:28:19,  3.35it/s]
 33%|███▎      | 124324/371472 [9:53:19<20:54:01,  3.28it/s]
 33%|███▎      | 124325/371472 [9:53:19<19:58:58,  3.44it/s]
 33%|███▎      | 124326/371472 [9:53:19<19:42:26,  3.48it/s]
 33%|███▎      | 124327/371472 [9:53:20<20:23:21,  3.37it/s]
 33%|███▎      | 124328/371472 [9:53:20<20:45:42,  3.31it/s]
 33%|███▎      | 124329/371472 [9:53:20<20:23:20,  3.37it/s]
 33%|███▎      | 124330/371472 [9:53:21<19:35:31,  3.50it/s]
 33%|███▎      | 124331/371472 [9:53:21<19:04:27,  3.60it/s]
 33%|███▎      | 124332/371472 [9:53:21<19:38:49,  3.49it/s]
 33%|███▎      | 124333/371472 [9:53:21<20:11:53,  3.40it/s]
 33%|███▎      | 124334/371472 [9:53:22<20:31:44,  3.34it/s]
 33%|███▎      | 124335/371472 [9:53:22<19:43:39,  3.48it/s]
 33%|███▎      | 124336/371472 [9:53:22<19:14:49,  3.57it/s]
 33%|███▎      | 124337/371472 [9:53:23<18:42:50,  3.67it/s]
 33%|███▎      | 124338/371472 [9:53:23<18:53:13,  3.63it/s]
 33%|███▎      | 124339/371472 [9:53:23<18:10:02,  3.78it/s]
 33%|███▎      | 124340/371472 [9:53:23<18:39:42,  3.68it/s]
                                                            
{'loss': 3.2998, 'learning_rate': 6.990723782025038e-07, 'epoch': 5.36}

 33%|███▎      | 124340/371472 [9:53:23<18:39:42,  3.68it/s]
 33%|███▎      | 124341/371472 [9:53:24<18:45:42,  3.66it/s]
 33%|███▎      | 124342/371472 [9:53:24<19:31:34,  3.52it/s]
 33%|███▎      | 124343/371472 [9:53:24<21:29:02,  3.20it/s]
 33%|███▎      | 124344/371472 [9:53:25<20:20:01,  3.38it/s]
 33%|███▎      | 124345/371472 [9:53:25<20:05:52,  3.42it/s]
 33%|███▎      | 124346/371472 [9:53:25<19:12:21,  3.57it/s]
 33%|███▎      | 124347/371472 [9:53:25<19:11:31,  3.58it/s]
 33%|███▎      | 124348/371472 [9:53:26<18:40:04,  3.68it/s]
 33%|███▎      | 124349/371472 [9:53:26<19:19:33,  3.55it/s]
 33%|███▎      | 124350/371472 [9:53:26<18:44:51,  3.66it/s]
 33%|███▎      | 124351/371472 [9:53:27<19:09:46,  3.58it/s]
 33%|███▎      | 124352/371472 [9:53:27<19:38:54,  3.49it/s]
 33%|███▎      | 124353/371472 [9:53:27<20:19:13,  3.38it/s]
 33%|███▎      | 124354/371472 [9:53:27<19:10:32,  3.58it/s]
 33%|███▎      | 124355/371472 [9:53:28<18:47:21,  3.65it/s]
 33%|███▎      | 124356/371472 [9:53:28<19:43:14,  3.48it/s]
 33%|███▎      | 124357/371472 [9:53:28<19:41:16,  3.49it/s]
 33%|███▎      | 124358/371472 [9:53:29<18:46:21,  3.66it/s]
 33%|███▎      | 124359/371472 [9:53:29<19:07:28,  3.59it/s]
 33%|███▎      | 124360/371472 [9:53:29<18:49:02,  3.65it/s]
                                                            
{'loss': 3.1571, 'learning_rate': 6.990238962270249e-07, 'epoch': 5.36}

 33%|███▎      | 124360/371472 [9:53:29<18:49:02,  3.65it/s]
 33%|███▎      | 124361/371472 [9:53:29<18:27:05,  3.72it/s]
 33%|███▎      | 124362/371472 [9:53:30<20:29:46,  3.35it/s]
 33%|███▎      | 124363/371472 [9:53:30<20:25:38,  3.36it/s]
 33%|███▎      | 124364/371472 [9:53:30<20:15:47,  3.39it/s]
 33%|███▎      | 124365/371472 [9:53:31<19:19:23,  3.55it/s]
 33%|███▎      | 124366/371472 [9:53:31<19:07:30,  3.59it/s]
 33%|███▎      | 124367/371472 [9:53:31<18:53:43,  3.63it/s]
 33%|███▎      | 124368/371472 [9:53:31<19:30:59,  3.52it/s]
 33%|███▎      | 124369/371472 [9:53:32<20:32:31,  3.34it/s]
 33%|███▎      | 124370/371472 [9:53:32<21:36:32,  3.18it/s]
 33%|███▎      | 124371/371472 [9:53:32<21:49:10,  3.15it/s]
 33%|███▎      | 124372/371472 [9:53:33<20:39:07,  3.32it/s]
 33%|███▎      | 124373/371472 [9:53:33<19:43:19,  3.48it/s]
 33%|███▎      | 124374/371472 [9:53:33<19:27:26,  3.53it/s]
 33%|███▎      | 124375/371472 [9:53:33<18:42:38,  3.67it/s]
 33%|███▎      | 124376/371472 [9:53:34<18:57:17,  3.62it/s]
 33%|███▎      | 124377/371472 [9:53:34<18:19:47,  3.74it/s]
 33%|███▎      | 124378/371472 [9:53:34<18:15:49,  3.76it/s]
 33%|███▎      | 124379/371472 [9:53:34<17:49:23,  3.85it/s]
 33%|███▎      | 124380/371472 [9:53:35<22:17:37,  3.08it/s]
                                                            
{'loss': 3.1613, 'learning_rate': 6.98975414251546e-07, 'epoch': 5.36}

 33%|███▎      | 124380/371472 [9:53:35<22:17:37,  3.08it/s]
 33%|███▎      | 124381/371472 [9:53:35<22:40:48,  3.03it/s]
 33%|███▎      | 124382/371472 [9:53:36<23:10:44,  2.96it/s]
 33%|███▎      | 124383/371472 [9:53:36<23:16:34,  2.95it/s]
 33%|███▎      | 124384/371472 [9:53:36<22:24:11,  3.06it/s]
 33%|███▎      | 124385/371472 [9:53:37<21:41:31,  3.16it/s]
 33%|███▎      | 124386/371472 [9:53:37<20:24:44,  3.36it/s]
 33%|███▎      | 124387/371472 [9:53:37<20:15:32,  3.39it/s]
 33%|███▎      | 124388/371472 [9:53:37<19:46:58,  3.47it/s]
 33%|███▎      | 124389/371472 [9:53:38<18:53:32,  3.63it/s]
 33%|███▎      | 124390/371472 [9:53:38<18:10:40,  3.78it/s]
 33%|███▎      | 124391/371472 [9:53:38<18:00:44,  3.81it/s]
 33%|███▎      | 124392/371472 [9:53:38<18:55:42,  3.63it/s]
 33%|███▎      | 124393/371472 [9:53:39<19:17:27,  3.56it/s]
 33%|███▎      | 124394/371472 [9:53:39<19:03:42,  3.60it/s]
 33%|███▎      | 124395/371472 [9:53:39<18:58:40,  3.62it/s]
 33%|███▎      | 124396/371472 [9:53:40<19:52:59,  3.45it/s]
 33%|███▎      | 124397/371472 [9:53:40<19:48:19,  3.47it/s]
 33%|███▎      | 124398/371472 [9:53:40<19:50:39,  3.46it/s]
 33%|███▎      | 124399/371472 [9:53:40<18:54:43,  3.63it/s]
 33%|███▎      | 124400/371472 [9:53:41<19:18:29,  3.55it/s]
                                                            
{'loss': 3.2361, 'learning_rate': 6.989269322760672e-07, 'epoch': 5.36}

 33%|███▎      | 124400/371472 [9:53:41<19:18:29,  3.55it/s]
 33%|███▎      | 124401/371472 [9:53:41<18:56:31,  3.62it/s]
 33%|███▎      | 124402/371472 [9:53:41<18:24:22,  3.73it/s]
 33%|███▎      | 124403/371472 [9:53:42<20:26:01,  3.36it/s]
 33%|███▎      | 124404/371472 [9:53:42<19:25:55,  3.53it/s]
 33%|███▎      | 124405/371472 [9:53:42<19:27:15,  3.53it/s]
 33%|███▎      | 124406/371472 [9:53:42<19:27:54,  3.53it/s]
 33%|███▎      | 124407/371472 [9:53:43<18:33:24,  3.70it/s]
 33%|███▎      | 124408/371472 [9:53:43<18:21:39,  3.74it/s]
 33%|███▎      | 124409/371472 [9:53:43<17:51:49,  3.84it/s]
 33%|███▎      | 124410/371472 [9:53:43<18:04:28,  3.80it/s]
 33%|███▎      | 124411/371472 [9:53:44<19:02:48,  3.60it/s]
 33%|███▎      | 124412/371472 [9:53:44<20:02:19,  3.42it/s]
 33%|███▎      | 124413/371472 [9:53:44<19:32:08,  3.51it/s]
 33%|███▎      | 124414/371472 [9:53:45<18:48:38,  3.65it/s]
 33%|███▎      | 124415/371472 [9:53:45<19:38:05,  3.50it/s]
 33%|███▎      | 124416/371472 [9:53:45<19:09:43,  3.58it/s]
 33%|███▎      | 124417/371472 [9:53:45<19:01:46,  3.61it/s]
 33%|███▎      | 124418/371472 [9:53:46<19:31:04,  3.52it/s]
 33%|███▎      | 124419/371472 [9:53:46<19:26:33,  3.53it/s]
 33%|███▎      | 124420/371472 [9:53:46<18:36:43,  3.69it/s]
                                                            
{'loss': 3.255, 'learning_rate': 6.988784503005882e-07, 'epoch': 5.36}

 33%|███▎      | 124420/371472 [9:53:46<18:36:43,  3.69it/s]
 33%|███▎      | 124421/371472 [9:53:47<19:13:42,  3.57it/s]
 33%|███▎      | 124422/371472 [9:53:47<18:42:19,  3.67it/s]
 33%|███▎      | 124423/371472 [9:53:47<18:59:04,  3.61it/s]
 33%|███▎      | 124424/371472 [9:53:47<18:51:48,  3.64it/s]
 33%|███▎      | 124425/371472 [9:53:48<19:15:59,  3.56it/s]
 33%|███▎      | 124426/371472 [9:53:48<18:26:39,  3.72it/s]
 33%|███▎      | 124427/371472 [9:53:48<19:10:32,  3.58it/s]
 33%|███▎      | 124428/371472 [9:53:48<19:16:58,  3.56it/s]
 33%|███▎      | 124429/371472 [9:53:49<19:12:31,  3.57it/s]
 33%|███▎      | 124430/371472 [9:53:49<18:36:07,  3.69it/s]
 33%|███▎      | 124431/371472 [9:53:49<18:22:20,  3.74it/s]
 33%|███▎      | 124432/371472 [9:53:50<18:17:18,  3.75it/s]
 33%|███▎      | 124433/371472 [9:53:50<18:56:38,  3.62it/s]
 33%|███▎      | 124434/371472 [9:53:50<19:01:39,  3.61it/s]
 33%|███▎      | 124435/371472 [9:53:50<19:05:40,  3.59it/s]
 33%|███▎      | 124436/371472 [9:53:51<19:52:48,  3.45it/s]
 33%|███▎      | 124437/371472 [9:53:51<19:24:04,  3.54it/s]
 33%|███▎      | 124438/371472 [9:53:51<19:29:45,  3.52it/s]
 33%|███▎      | 124439/371472 [9:53:52<19:51:01,  3.46it/s]
 33%|███▎      | 124440/371472 [9:53:52<20:36:35,  3.33it/s]
                                                            
{'loss': 3.3, 'learning_rate': 6.988299683251093e-07, 'epoch': 5.36}

 33%|███▎      | 124440/371472 [9:53:52<20:36:35,  3.33it/s]
 33%|███▎      | 124441/371472 [9:53:52<19:40:09,  3.49it/s]
 33%|███▎      | 124442/371472 [9:53:52<19:06:37,  3.59it/s]
 33%|███▎      | 124443/371472 [9:53:53<19:27:02,  3.53it/s]
 34%|███▎      | 124444/371472 [9:53:53<19:26:02,  3.53it/s]
 34%|███▎      | 124445/371472 [9:53:53<18:53:14,  3.63it/s]
 34%|███▎      | 124446/371472 [9:53:53<18:36:41,  3.69it/s]
 34%|███▎      | 124447/371472 [9:53:54<18:08:46,  3.78it/s]
 34%|███▎      | 124448/371472 [9:53:54<17:57:24,  3.82it/s]
 34%|███▎      | 124449/371472 [9:53:54<18:01:30,  3.81it/s]
 34%|███▎      | 124450/371472 [9:53:55<18:04:46,  3.80it/s]
 34%|███▎      | 124451/371472 [9:53:55<18:13:37,  3.76it/s]
 34%|███▎      | 124452/371472 [9:53:55<17:30:21,  3.92it/s]
 34%|███▎      | 124453/371472 [9:53:55<19:41:42,  3.48it/s]
 34%|███▎      | 124454/371472 [9:53:56<20:07:40,  3.41it/s]
 34%|███▎      | 124455/371472 [9:53:56<19:27:27,  3.53it/s]
 34%|███▎      | 124456/371472 [9:53:56<18:28:14,  3.71it/s]
 34%|███▎      | 124457/371472 [9:53:56<17:38:35,  3.89it/s]
 34%|███▎      | 124458/371472 [9:53:57<17:24:14,  3.94it/s]
 34%|███▎      | 124459/371472 [9:53:57<17:37:20,  3.89it/s]
 34%|███▎      | 124460/371472 [9:53:57<17:23:10,  3.95it/s]
                                                            
{'loss': 3.3961, 'learning_rate': 6.987814863496304e-07, 'epoch': 5.36}

 34%|███▎      | 124460/371472 [9:53:57<17:23:10,  3.95it/s]
 34%|███▎      | 124461/371472 [9:53:57<17:31:27,  3.92it/s]
 34%|███▎      | 124462/371472 [9:53:58<17:23:29,  3.95it/s]
 34%|███▎      | 124463/371472 [9:53:58<19:10:47,  3.58it/s]
 34%|███▎      | 124464/371472 [9:53:58<19:21:50,  3.54it/s]
 34%|███▎      | 124465/371472 [9:53:59<18:54:35,  3.63it/s]
 34%|███▎      | 124466/371472 [9:53:59<19:52:25,  3.45it/s]
 34%|███▎      | 124467/371472 [9:53:59<19:20:01,  3.55it/s]
 34%|███▎      | 124468/371472 [9:53:59<19:04:46,  3.60it/s]
 34%|███▎      | 124469/371472 [9:54:00<19:04:56,  3.60it/s]
 34%|███▎      | 124470/371472 [9:54:00<19:33:14,  3.51it/s]
 34%|███▎      | 124471/371472 [9:54:00<19:54:26,  3.45it/s]
 34%|███▎      | 124472/371472 [9:54:01<20:01:38,  3.43it/s]
 34%|███▎      | 124473/371472 [9:54:01<19:19:31,  3.55it/s]
 34%|███▎      | 124474/371472 [9:54:01<19:31:29,  3.51it/s]
 34%|███▎      | 124475/371472 [9:54:01<19:16:07,  3.56it/s]
 34%|███▎      | 124476/371472 [9:54:02<19:17:10,  3.56it/s]
 34%|███▎      | 124477/371472 [9:54:02<18:53:44,  3.63it/s]
 34%|███▎      | 124478/371472 [9:54:02<19:27:48,  3.53it/s]
 34%|███▎      | 124479/371472 [9:54:03<18:53:05,  3.63it/s]
 34%|███▎      | 124480/371472 [9:54:03<18:05:54,  3.79it/s]
                                                            
{'loss': 3.2765, 'learning_rate': 6.987330043741516e-07, 'epoch': 5.36}

 34%|███▎      | 124480/371472 [9:54:03<18:05:54,  3.79it/s]
 34%|███▎      | 124481/371472 [9:54:03<18:13:33,  3.76it/s]
 34%|███▎      | 124482/371472 [9:54:03<18:48:08,  3.65it/s]
 34%|███▎      | 124483/371472 [9:54:04<18:36:42,  3.69it/s]
 34%|███▎      | 124484/371472 [9:54:04<18:49:00,  3.65it/s]
 34%|███▎      | 124485/371472 [9:54:04<17:58:19,  3.82it/s]
 34%|███▎      | 124486/371472 [9:54:04<18:33:10,  3.70it/s]
 34%|███▎      | 124487/371472 [9:54:05<18:12:31,  3.77it/s]
 34%|███▎      | 124488/371472 [9:54:05<18:10:03,  3.78it/s]
 34%|███▎      | 124489/371472 [9:54:05<17:48:55,  3.85it/s]
 34%|███▎      | 124490/371472 [9:54:05<17:45:53,  3.86it/s]
 34%|███▎      | 124491/371472 [9:54:06<19:19:49,  3.55it/s]
 34%|███▎      | 124492/371472 [9:54:06<20:41:22,  3.32it/s]
 34%|███▎      | 124493/371472 [9:54:06<20:50:26,  3.29it/s]
 34%|███▎      | 124494/371472 [9:54:07<20:15:28,  3.39it/s]
 34%|███▎      | 124495/371472 [9:54:07<19:30:38,  3.52it/s]
 34%|███▎      | 124496/371472 [9:54:07<20:51:05,  3.29it/s]
 34%|███▎      | 124497/371472 [9:54:08<19:56:23,  3.44it/s]
 34%|███▎      | 124498/371472 [9:54:08<18:42:15,  3.67it/s]
 34%|███▎      | 124499/371472 [9:54:08<18:55:44,  3.62it/s]
 34%|███▎      | 124500/371472 [9:54:08<18:45:15,  3.66it/s]
                                                            
{'loss': 3.2107, 'learning_rate': 6.986845223986726e-07, 'epoch': 5.36}

 34%|███▎      | 124500/371472 [9:54:08<18:45:15,  3.66it/s]
 34%|███▎      | 124501/371472 [9:54:09<19:16:27,  3.56it/s]
 34%|███▎      | 124502/371472 [9:54:09<20:09:20,  3.40it/s]
 34%|███▎      | 124503/371472 [9:54:09<20:13:20,  3.39it/s]
 34%|███▎      | 124504/371472 [9:54:10<21:03:14,  3.26it/s]
 34%|███▎      | 124505/371472 [9:54:10<20:49:31,  3.29it/s]
 34%|███▎      | 124506/371472 [9:54:10<20:26:48,  3.36it/s]
 34%|███▎      | 124507/371472 [9:54:10<19:59:09,  3.43it/s]
 34%|███▎      | 124508/371472 [9:54:11<20:54:49,  3.28it/s]
 34%|███▎      | 124509/371472 [9:54:11<19:41:39,  3.48it/s]
 34%|███▎      | 124510/371472 [9:54:11<19:56:28,  3.44it/s]
 34%|███▎      | 124511/371472 [9:54:12<19:04:31,  3.60it/s]
 34%|███▎      | 124512/371472 [9:54:12<18:13:50,  3.76it/s]
 34%|███▎      | 124513/371472 [9:54:12<19:06:21,  3.59it/s]
 34%|███▎      | 124514/371472 [9:54:12<18:15:01,  3.76it/s]
 34%|███▎      | 124515/371472 [9:54:13<18:48:22,  3.65it/s]
 34%|███▎      | 124516/371472 [9:54:13<18:47:22,  3.65it/s]
 34%|███▎      | 124517/371472 [9:54:13<22:52:56,  3.00it/s]
 34%|███▎      | 124518/371472 [9:54:14<22:06:34,  3.10it/s]
 34%|███▎      | 124519/371472 [9:54:14<23:36:33,  2.91it/s]
 34%|███▎      | 124520/371472 [9:54:14<22:42:41,  3.02it/s]
                                                            
{'loss': 3.0093, 'learning_rate': 6.986360404231937e-07, 'epoch': 5.36}

 34%|███▎      | 124520/371472 [9:54:14<22:42:41,  3.02it/s]
 34%|███▎      | 124521/371472 [9:54:15<21:21:53,  3.21it/s]
 34%|███▎      | 124522/371472 [9:54:15<21:27:09,  3.20it/s]
 34%|███▎      | 124523/371472 [9:54:15<22:53:30,  3.00it/s]
 34%|███▎      | 124524/371472 [9:54:16<20:52:23,  3.29it/s]
 34%|███▎      | 124525/371472 [9:54:16<20:01:01,  3.43it/s]
 34%|███▎      | 124526/371472 [9:54:16<19:51:08,  3.46it/s]
 34%|███▎      | 124527/371472 [9:54:16<19:24:49,  3.53it/s]
 34%|███▎      | 124528/371472 [9:54:17<20:07:11,  3.41it/s]
 34%|███▎      | 124529/371472 [9:54:17<19:18:29,  3.55it/s]
 34%|███▎      | 124530/371472 [9:54:17<18:44:10,  3.66it/s]
 34%|███▎      | 124531/371472 [9:54:18<18:43:56,  3.66it/s]
 34%|███▎      | 124532/371472 [9:54:18<19:38:17,  3.49it/s]
 34%|███▎      | 124533/371472 [9:54:18<20:22:29,  3.37it/s]
 34%|███▎      | 124534/371472 [9:54:18<20:18:00,  3.38it/s]
 34%|███▎      | 124535/371472 [9:54:19<19:28:19,  3.52it/s]
 34%|███▎      | 124536/371472 [9:54:19<19:25:14,  3.53it/s]
 34%|███▎      | 124537/371472 [9:54:19<19:40:40,  3.49it/s]
 34%|███▎      | 124538/371472 [9:54:20<20:04:01,  3.42it/s]
 34%|███▎      | 124539/371472 [9:54:20<20:51:26,  3.29it/s]
 34%|███▎      | 124540/371472 [9:54:20<20:01:50,  3.42it/s]
                                                            
{'loss': 3.1355, 'learning_rate': 6.985875584477149e-07, 'epoch': 5.36}

 34%|███▎      | 124540/371472 [9:54:20<20:01:50,  3.42it/s]
 34%|███▎      | 124541/371472 [9:54:20<19:31:28,  3.51it/s]
 34%|███▎      | 124542/371472 [9:54:21<18:30:38,  3.71it/s]
 34%|███▎      | 124543/371472 [9:54:21<19:48:07,  3.46it/s]
 34%|███▎      | 124544/371472 [9:54:21<19:33:01,  3.51it/s]
 34%|███▎      | 124545/371472 [9:54:22<20:33:49,  3.34it/s]
 34%|███▎      | 124546/371472 [9:54:22<19:39:57,  3.49it/s]
 34%|███▎      | 124547/371472 [9:54:22<18:28:41,  3.71it/s]
 34%|███▎      | 124548/371472 [9:54:22<19:20:53,  3.55it/s]
 34%|███▎      | 124549/371472 [9:54:23<18:41:42,  3.67it/s]
 34%|███▎      | 124550/371472 [9:54:23<18:46:57,  3.65it/s]
 34%|███▎      | 124551/371472 [9:54:23<20:08:03,  3.41it/s]
 34%|███▎      | 124552/371472 [9:54:24<19:05:43,  3.59it/s]
 34%|███▎      | 124553/371472 [9:54:24<20:46:52,  3.30it/s]
 34%|███▎      | 124554/371472 [9:54:24<20:06:17,  3.41it/s]
 34%|███▎      | 124555/371472 [9:54:24<19:45:22,  3.47it/s]
 34%|███▎      | 124556/371472 [9:54:25<19:16:55,  3.56it/s]
 34%|███▎      | 124557/371472 [9:54:25<18:34:51,  3.69it/s]
 34%|███▎      | 124558/371472 [9:54:25<18:42:16,  3.67it/s]
 34%|███▎      | 124559/371472 [9:54:25<18:19:20,  3.74it/s]
 34%|███▎      | 124560/371472 [9:54:26<18:08:41,  3.78it/s]
                                                            
{'loss': 2.961, 'learning_rate': 6.98539076472236e-07, 'epoch': 5.37}

 34%|███▎      | 124560/371472 [9:54:26<18:08:41,  3.78it/s]
 34%|███▎      | 124561/371472 [9:54:26<17:53:22,  3.83it/s]
 34%|███▎      | 124562/371472 [9:54:26<17:59:36,  3.81it/s]
 34%|███▎      | 124563/371472 [9:54:27<18:28:54,  3.71it/s]
 34%|███▎      | 124564/371472 [9:54:27<18:10:24,  3.77it/s]
 34%|███▎      | 124565/371472 [9:54:27<17:53:47,  3.83it/s]
 34%|███▎      | 124566/371472 [9:54:27<19:32:53,  3.51it/s]
 34%|███▎      | 124567/371472 [9:54:28<19:21:11,  3.54it/s]
 34%|███▎      | 124568/371472 [9:54:28<19:32:34,  3.51it/s]
 34%|███▎      | 124569/371472 [9:54:28<19:18:04,  3.55it/s]
 34%|███▎      | 124570/371472 [9:54:29<19:28:04,  3.52it/s]
 34%|███▎      | 124571/371472 [9:54:29<19:25:23,  3.53it/s]
 34%|███▎      | 124572/371472 [9:54:29<19:22:06,  3.54it/s]
 34%|███▎      | 124573/371472 [9:54:29<19:16:58,  3.56it/s]
 34%|███▎      | 124574/371472 [9:54:30<19:03:24,  3.60it/s]
 34%|███▎      | 124575/371472 [9:54:30<20:43:21,  3.31it/s]
 34%|███▎      | 124576/371472 [9:54:30<22:28:32,  3.05it/s]
 34%|███▎      | 124577/371472 [9:54:31<23:08:54,  2.96it/s]
 34%|███▎      | 124578/371472 [9:54:31<23:10:58,  2.96it/s]
 34%|███▎      | 124579/371472 [9:54:31<21:39:15,  3.17it/s]
 34%|███▎      | 124580/371472 [9:54:32<20:47:12,  3.30it/s]
                                                            
{'loss': 3.3422, 'learning_rate': 6.98490594496757e-07, 'epoch': 5.37}

 34%|███▎      | 124580/371472 [9:54:32<20:47:12,  3.30it/s]
 34%|███▎      | 124581/371472 [9:54:32<20:05:53,  3.41it/s]
 34%|███▎      | 124582/371472 [9:54:32<19:04:11,  3.60it/s]
 34%|███▎      | 124583/371472 [9:54:32<18:40:42,  3.67it/s]
 34%|███▎      | 124584/371472 [9:54:33<18:56:56,  3.62it/s]
 34%|███▎      | 124585/371472 [9:54:33<19:58:30,  3.43it/s]
 34%|███▎      | 124586/371472 [9:54:33<19:26:43,  3.53it/s]
 34%|███▎      | 124587/371472 [9:54:34<18:54:38,  3.63it/s]
 34%|███▎      | 124588/371472 [9:54:34<18:53:27,  3.63it/s]
 34%|███▎      | 124589/371472 [9:54:34<19:07:41,  3.59it/s]
 34%|███▎      | 124590/371472 [9:54:34<18:53:24,  3.63it/s]
 34%|███▎      | 124591/371472 [9:54:35<18:58:03,  3.62it/s]
 34%|███▎      | 124592/371472 [9:54:35<21:06:25,  3.25it/s]
 34%|███▎      | 124593/371472 [9:54:35<20:19:10,  3.37it/s]
 34%|███▎      | 124594/371472 [9:54:36<20:35:08,  3.33it/s]
 34%|███▎      | 124595/371472 [9:54:36<19:57:36,  3.44it/s]
 34%|███▎      | 124596/371472 [9:54:36<19:01:50,  3.60it/s]
 34%|███▎      | 124597/371472 [9:54:36<18:31:22,  3.70it/s]
 34%|███▎      | 124598/371472 [9:54:37<19:19:50,  3.55it/s]
 34%|███▎      | 124599/371472 [9:54:37<18:47:46,  3.65it/s]
 34%|███▎      | 124600/371472 [9:54:37<18:09:05,  3.78it/s]
                                                            
{'loss': 3.3043, 'learning_rate': 6.984421125212781e-07, 'epoch': 5.37}

 34%|███▎      | 124600/371472 [9:54:37<18:09:05,  3.78it/s]
 34%|███▎      | 124601/371472 [9:54:37<18:28:33,  3.71it/s]
 34%|███▎      | 124602/371472 [9:54:38<17:59:03,  3.81it/s]
 34%|███▎      | 124603/371472 [9:54:38<18:31:12,  3.70it/s]
 34%|███▎      | 124604/371472 [9:54:38<19:06:45,  3.59it/s]
 34%|███▎      | 124605/371472 [9:54:39<18:43:32,  3.66it/s]
 34%|███▎      | 124606/371472 [9:54:39<18:52:18,  3.63it/s]
 34%|███▎      | 124607/371472 [9:54:39<18:35:49,  3.69it/s]
 34%|███▎      | 124608/371472 [9:54:39<18:19:45,  3.74it/s]
 34%|███▎      | 124609/371472 [9:54:40<20:23:29,  3.36it/s]
 34%|███▎      | 124610/371472 [9:54:40<20:21:40,  3.37it/s]
 34%|███▎      | 124611/371472 [9:54:40<20:09:42,  3.40it/s]
 34%|███▎      | 124612/371472 [9:54:41<19:07:39,  3.58it/s]
 34%|███▎      | 124613/371472 [9:54:41<19:46:26,  3.47it/s]
 34%|███▎      | 124614/371472 [9:54:41<19:01:36,  3.60it/s]
 34%|███▎      | 124615/371472 [9:54:41<20:02:12,  3.42it/s]
 34%|███▎      | 124616/371472 [9:54:42<19:42:15,  3.48it/s]
 34%|███▎      | 124617/371472 [9:54:42<19:12:32,  3.57it/s]
 34%|███▎      | 124618/371472 [9:54:42<19:13:45,  3.57it/s]
 34%|███▎      | 124619/371472 [9:54:43<19:00:29,  3.61it/s]
 34%|███▎      | 124620/371472 [9:54:43<18:38:51,  3.68it/s]
                                                            
{'loss': 3.0706, 'learning_rate': 6.983936305457993e-07, 'epoch': 5.37}

 34%|███▎      | 124620/371472 [9:54:43<18:38:51,  3.68it/s]
 34%|███▎      | 124621/371472 [9:54:43<18:00:10,  3.81it/s]
 34%|███▎      | 124622/371472 [9:54:43<18:57:09,  3.62it/s]
 34%|███▎      | 124623/371472 [9:54:44<18:26:41,  3.72it/s]
 34%|███▎      | 124624/371472 [9:54:44<19:03:22,  3.60it/s]
 34%|███▎      | 124625/371472 [9:54:44<18:24:10,  3.73it/s]
 34%|███▎      | 124626/371472 [9:54:44<18:00:38,  3.81it/s]
 34%|███▎      | 124627/371472 [9:54:45<17:35:11,  3.90it/s]
 34%|███▎      | 124628/371472 [9:54:45<17:14:57,  3.98it/s]
 34%|███▎      | 124629/371472 [9:54:45<16:59:50,  4.03it/s]
 34%|███▎      | 124630/371472 [9:54:45<17:03:09,  4.02it/s]
 34%|███▎      | 124631/371472 [9:54:46<17:19:36,  3.96it/s]
 34%|███▎      | 124632/371472 [9:54:46<17:03:21,  4.02it/s]
 34%|███▎      | 124633/371472 [9:54:46<17:22:51,  3.94it/s]
 34%|███▎      | 124634/371472 [9:54:46<17:45:36,  3.86it/s]
 34%|███▎      | 124635/371472 [9:54:47<17:41:49,  3.87it/s]
 34%|███▎      | 124636/371472 [9:54:47<17:43:26,  3.87it/s]
 34%|███▎      | 124637/371472 [9:54:47<21:02:49,  3.26it/s]
 34%|███▎      | 124638/371472 [9:54:48<20:11:44,  3.40it/s]
 34%|███▎      | 124639/371472 [9:54:48<19:12:44,  3.57it/s]
 34%|███▎      | 124640/371472 [9:54:48<19:22:23,  3.54it/s]
                                                            
{'loss': 3.1049, 'learning_rate': 6.983451485703204e-07, 'epoch': 5.37}

 34%|███▎      | 124640/371472 [9:54:48<19:22:23,  3.54it/s]
 34%|███▎      | 124641/371472 [9:54:48<19:55:44,  3.44it/s]
 34%|███▎      | 124642/371472 [9:54:49<19:11:44,  3.57it/s]
 34%|███▎      | 124643/371472 [9:54:49<19:20:44,  3.54it/s]
 34%|███▎      | 124644/371472 [9:54:49<18:40:29,  3.67it/s]
 34%|███▎      | 124645/371472 [9:54:49<18:42:46,  3.66it/s]
 34%|███▎      | 124646/371472 [9:54:50<18:21:21,  3.74it/s]
 34%|███▎      | 124647/371472 [9:54:50<17:47:14,  3.85it/s]
 34%|███▎      | 124648/371472 [9:54:50<18:16:55,  3.75it/s]
 34%|███▎      | 124649/371472 [9:54:51<18:29:59,  3.71it/s]
 34%|███▎      | 124650/371472 [9:54:51<18:58:18,  3.61it/s]
 34%|███▎      | 124651/371472 [9:54:51<19:01:53,  3.60it/s]
 34%|███▎      | 124652/371472 [9:54:51<18:45:37,  3.65it/s]
 34%|███▎      | 124653/371472 [9:54:52<18:16:03,  3.75it/s]
 34%|███▎      | 124654/371472 [9:54:52<17:57:16,  3.82it/s]
 34%|███▎      | 124655/371472 [9:54:52<17:43:35,  3.87it/s]
 34%|███▎      | 124656/371472 [9:54:52<17:29:06,  3.92it/s]
 34%|███▎      | 124657/371472 [9:54:53<19:41:13,  3.48it/s]
 34%|███▎      | 124658/371472 [9:54:53<18:52:05,  3.63it/s]
 34%|███▎      | 124659/371472 [9:54:53<18:53:44,  3.63it/s]
 34%|███▎      | 124660/371472 [9:54:54<18:27:44,  3.71it/s]
                                                            
{'loss': 3.2923, 'learning_rate': 6.982966665948415e-07, 'epoch': 5.37}

 34%|███▎      | 124660/371472 [9:54:54<18:27:44,  3.71it/s]
 34%|███▎      | 124661/371472 [9:54:54<18:43:09,  3.66it/s]
 34%|███▎      | 124662/371472 [9:54:54<18:17:12,  3.75it/s]
 34%|███▎      | 124663/371472 [9:54:54<18:23:04,  3.73it/s]
 34%|███▎      | 124664/371472 [9:54:55<18:48:34,  3.64it/s]
 34%|███▎      | 124665/371472 [9:54:55<18:44:14,  3.66it/s]
 34%|███▎      | 124666/371472 [9:54:55<18:20:55,  3.74it/s]
 34%|███▎      | 124667/371472 [9:54:55<18:12:44,  3.76it/s]
 34%|███▎      | 124668/371472 [9:54:56<19:14:01,  3.56it/s]
 34%|███▎      | 124669/371472 [9:54:56<19:25:09,  3.53it/s]
 34%|███▎      | 124670/371472 [9:54:56<18:48:46,  3.64it/s]
 34%|███▎      | 124671/371472 [9:54:57<18:59:43,  3.61it/s]
 34%|███▎      | 124672/371472 [9:54:57<18:39:51,  3.67it/s]
 34%|███▎      | 124673/371472 [9:54:57<19:11:22,  3.57it/s]
 34%|███▎      | 124674/371472 [9:54:57<20:33:25,  3.33it/s]
 34%|███▎      | 124675/371472 [9:54:58<21:01:53,  3.26it/s]
 34%|███▎      | 124676/371472 [9:54:58<20:04:19,  3.42it/s]
 34%|███▎      | 124677/371472 [9:54:58<19:58:50,  3.43it/s]
 34%|███▎      | 124678/371472 [9:54:59<19:38:06,  3.49it/s]
 34%|███▎      | 124679/371472 [9:54:59<18:49:26,  3.64it/s]
 34%|███▎      | 124680/371472 [9:54:59<20:34:09,  3.33it/s]
                                                            
{'loss': 3.3227, 'learning_rate': 6.982481846193626e-07, 'epoch': 5.37}

 34%|███▎      | 124680/371472 [9:54:59<20:34:09,  3.33it/s]
 34%|███▎      | 124681/371472 [9:54:59<19:15:30,  3.56it/s]
 34%|███▎      | 124682/371472 [9:55:00<18:37:07,  3.68it/s]
 34%|███▎      | 124683/371472 [9:55:00<17:53:46,  3.83it/s]
 34%|███▎      | 124684/371472 [9:55:00<18:00:00,  3.81it/s]
 34%|███▎      | 124685/371472 [9:55:00<18:08:04,  3.78it/s]
 34%|███▎      | 124686/371472 [9:55:01<18:43:54,  3.66it/s]
 34%|███▎      | 124687/371472 [9:55:01<19:37:50,  3.49it/s]
 34%|███▎      | 124688/371472 [9:55:01<19:40:24,  3.48it/s]
 34%|███▎      | 124689/371472 [9:55:02<18:55:55,  3.62it/s]
 34%|███▎      | 124690/371472 [9:55:02<18:50:17,  3.64it/s]
 34%|███▎      | 124691/371472 [9:55:02<19:05:35,  3.59it/s]
 34%|███▎      | 124692/371472 [9:55:02<18:49:29,  3.64it/s]
 34%|███▎      | 124693/371472 [9:55:03<18:44:58,  3.66it/s]
 34%|███▎      | 124694/371472 [9:55:03<19:43:56,  3.47it/s]
 34%|███▎      | 124695/371472 [9:55:03<21:20:44,  3.21it/s]
 34%|███▎      | 124696/371472 [9:55:04<20:39:35,  3.32it/s]
 34%|███▎      | 124697/371472 [9:55:04<19:46:59,  3.47it/s]
 34%|███▎      | 124698/371472 [9:55:04<19:56:51,  3.44it/s]
 34%|███▎      | 124699/371472 [9:55:04<19:43:37,  3.47it/s]
 34%|███▎      | 124700/371472 [9:55:05<19:51:05,  3.45it/s]
                                                            
{'loss': 3.4115, 'learning_rate': 6.981997026438837e-07, 'epoch': 5.37}

 34%|███▎      | 124700/371472 [9:55:05<19:51:05,  3.45it/s]
 34%|███▎      | 124701/371472 [9:55:05<19:42:13,  3.48it/s]
 34%|███▎      | 124702/371472 [9:55:05<19:58:18,  3.43it/s]
 34%|███▎      | 124703/371472 [9:55:06<19:37:24,  3.49it/s]
 34%|███▎      | 124704/371472 [9:55:06<19:01:03,  3.60it/s]
 34%|███▎      | 124705/371472 [9:55:06<19:32:26,  3.51it/s]
 34%|███▎      | 124706/371472 [9:55:06<18:23:38,  3.73it/s]
 34%|███▎      | 124707/371472 [9:55:07<17:50:01,  3.84it/s]
 34%|███▎      | 124708/371472 [9:55:07<17:51:30,  3.84it/s]
 34%|███▎      | 124709/371472 [9:55:07<18:45:55,  3.65it/s]
 34%|███▎      | 124710/371472 [9:55:08<18:30:04,  3.70it/s]
 34%|███▎      | 124711/371472 [9:55:08<17:53:41,  3.83it/s]
 34%|███▎      | 124712/371472 [9:55:08<17:52:34,  3.83it/s]
 34%|███▎      | 124713/371472 [9:55:08<18:07:13,  3.78it/s]
 34%|███▎      | 124714/371472 [9:55:09<18:06:33,  3.79it/s]
 34%|███▎      | 124715/371472 [9:55:09<18:28:05,  3.71it/s]
 34%|███▎      | 124716/371472 [9:55:09<18:04:42,  3.79it/s]
 34%|███▎      | 124717/371472 [9:55:09<18:34:21,  3.69it/s]
 34%|███▎      | 124718/371472 [9:55:10<17:55:26,  3.82it/s]
 34%|███▎      | 124719/371472 [9:55:10<17:43:13,  3.87it/s]
 34%|███▎      | 124720/371472 [9:55:10<18:10:14,  3.77it/s]
                                                            
{'loss': 3.2173, 'learning_rate': 6.981512206684048e-07, 'epoch': 5.37}

 34%|███▎      | 124720/371472 [9:55:10<18:10:14,  3.77it/s]
 34%|███▎      | 124721/371472 [9:55:10<19:33:08,  3.51it/s]
 34%|███▎      | 124722/371472 [9:55:11<20:30:21,  3.34it/s]
 34%|███▎      | 124723/371472 [9:55:11<19:26:22,  3.53it/s]
 34%|███▎      | 124724/371472 [9:55:11<18:46:27,  3.65it/s]
 34%|███▎      | 124725/371472 [9:55:12<18:12:08,  3.77it/s]
 34%|███▎      | 124726/371472 [9:55:12<18:48:28,  3.64it/s]
 34%|███▎      | 124727/371472 [9:55:12<18:33:18,  3.69it/s]
 34%|███▎      | 124728/371472 [9:55:12<18:51:28,  3.63it/s]
 34%|███▎      | 124729/371472 [9:55:13<18:19:17,  3.74it/s]
 34%|███▎      | 124730/371472 [9:55:13<18:03:51,  3.79it/s]
 34%|███▎      | 124731/371472 [9:55:13<17:28:16,  3.92it/s]
 34%|███▎      | 124732/371472 [9:55:13<17:59:15,  3.81it/s]
 34%|███▎      | 124733/371472 [9:55:14<17:31:31,  3.91it/s]
 34%|███▎      | 124734/371472 [9:55:14<17:41:54,  3.87it/s]
 34%|███▎      | 124735/371472 [9:55:14<17:54:17,  3.83it/s]
 34%|███▎      | 124736/371472 [9:55:14<17:46:38,  3.86it/s]
 34%|███▎      | 124737/371472 [9:55:15<18:42:29,  3.66it/s]
 34%|███▎      | 124738/371472 [9:55:15<18:08:21,  3.78it/s]
 34%|███▎      | 124739/371472 [9:55:15<19:10:43,  3.57it/s]
 34%|███▎      | 124740/371472 [9:55:16<18:31:50,  3.70it/s]
                                                            
{'loss': 3.2662, 'learning_rate': 6.981027386929259e-07, 'epoch': 5.37}

 34%|███▎      | 124740/371472 [9:55:16<18:31:50,  3.70it/s]
 34%|███▎      | 124741/371472 [9:55:16<18:10:17,  3.77it/s]
 34%|███▎      | 124742/371472 [9:55:16<18:15:44,  3.75it/s]
 34%|███▎      | 124743/371472 [9:55:16<18:20:26,  3.74it/s]
 34%|███▎      | 124744/371472 [9:55:17<18:13:40,  3.76it/s]
 34%|███▎      | 124745/371472 [9:55:17<18:40:28,  3.67it/s]
 34%|███▎      | 124746/371472 [9:55:17<18:04:31,  3.79it/s]
 34%|███▎      | 124747/371472 [9:55:17<19:40:55,  3.48it/s]
 34%|███▎      | 124748/371472 [9:55:18<19:23:27,  3.53it/s]
 34%|███▎      | 124749/371472 [9:55:18<18:56:25,  3.62it/s]
 34%|███▎      | 124750/371472 [9:55:18<18:54:28,  3.62it/s]
 34%|███▎      | 124751/371472 [9:55:19<19:11:32,  3.57it/s]
 34%|███▎      | 124752/371472 [9:55:19<18:30:38,  3.70it/s]
 34%|███▎      | 124753/371472 [9:55:19<18:47:18,  3.65it/s]
 34%|███▎      | 124754/371472 [9:55:19<18:56:23,  3.62it/s]
 34%|███▎      | 124755/371472 [9:55:20<18:43:49,  3.66it/s]
 34%|███▎      | 124756/371472 [9:55:20<18:01:31,  3.80it/s]
 34%|███▎      | 124757/371472 [9:55:20<17:42:37,  3.87it/s]
 34%|███▎      | 124758/371472 [9:55:20<19:41:04,  3.48it/s]
 34%|███▎      | 124759/371472 [9:55:21<18:57:55,  3.61it/s]
 34%|███▎      | 124760/371472 [9:55:21<18:28:50,  3.71it/s]
                                                            
{'loss': 3.2279, 'learning_rate': 6.98054256717447e-07, 'epoch': 5.37}

 34%|███▎      | 124760/371472 [9:55:21<18:28:50,  3.71it/s]
 34%|███▎      | 124761/371472 [9:55:21<18:10:27,  3.77it/s]
 34%|███▎      | 124762/371472 [9:55:22<18:28:11,  3.71it/s]
 34%|███▎      | 124763/371472 [9:55:22<18:53:53,  3.63it/s]
 34%|███▎      | 124764/371472 [9:55:22<19:09:54,  3.58it/s]
 34%|███▎      | 124765/371472 [9:55:22<19:26:31,  3.52it/s]
 34%|███▎      | 124766/371472 [9:55:23<19:04:21,  3.59it/s]
 34%|███▎      | 124767/371472 [9:55:23<19:29:24,  3.52it/s]
 34%|███▎      | 124768/371472 [9:55:23<18:53:21,  3.63it/s]
 34%|███▎      | 124769/371472 [9:55:23<18:44:12,  3.66it/s]
 34%|███▎      | 124770/371472 [9:55:24<18:41:52,  3.67it/s]
 34%|███▎      | 124771/371472 [9:55:24<17:59:06,  3.81it/s]
 34%|███▎      | 124772/371472 [9:55:24<18:00:52,  3.80it/s]
 34%|███▎      | 124773/371472 [9:55:25<17:42:11,  3.87it/s]
 34%|███▎      | 124774/371472 [9:55:25<19:08:58,  3.58it/s]
 34%|███▎      | 124775/371472 [9:55:25<18:43:35,  3.66it/s]
 34%|███▎      | 124776/371472 [9:55:25<18:21:38,  3.73it/s]
 34%|███▎      | 124777/371472 [9:55:26<18:53:35,  3.63it/s]
 34%|███▎      | 124778/371472 [9:55:26<19:05:13,  3.59it/s]
 34%|███▎      | 124779/371472 [9:55:26<18:46:50,  3.65it/s]
 34%|███▎      | 124780/371472 [9:55:27<19:33:38,  3.50it/s]
                                                            
{'loss': 3.2805, 'learning_rate': 6.980057747419682e-07, 'epoch': 5.37}

 34%|███▎      | 124780/371472 [9:55:27<19:33:38,  3.50it/s]
 34%|███▎      | 124781/371472 [9:55:27<19:44:12,  3.47it/s]
 34%|███▎      | 124782/371472 [9:55:27<19:27:32,  3.52it/s]
 34%|███▎      | 124783/371472 [9:55:27<22:01:35,  3.11it/s]
 34%|███▎      | 124784/371472 [9:55:28<20:25:25,  3.36it/s]
 34%|███▎      | 124785/371472 [9:55:28<19:41:01,  3.48it/s]
 34%|███▎      | 124786/371472 [9:55:28<21:02:01,  3.26it/s]
 34%|███▎      | 124787/371472 [9:55:29<20:58:02,  3.27it/s]
 34%|███▎      | 124788/371472 [9:55:29<20:47:35,  3.30it/s]
 34%|███▎      | 124789/371472 [9:55:29<21:37:29,  3.17it/s]
 34%|███▎      | 124790/371472 [9:55:30<20:21:44,  3.37it/s]
 34%|███▎      | 124791/371472 [9:55:30<19:12:27,  3.57it/s]
 34%|███▎      | 124792/371472 [9:55:30<18:46:15,  3.65it/s]
 34%|███▎      | 124793/371472 [9:55:30<18:55:54,  3.62it/s]
 34%|███▎      | 124794/371472 [9:55:31<20:15:11,  3.38it/s]
 34%|███▎      | 124795/371472 [9:55:31<20:01:43,  3.42it/s]
 34%|███▎      | 124796/371472 [9:55:31<20:10:50,  3.40it/s]
 34%|███▎      | 124797/371472 [9:55:32<22:59:03,  2.98it/s]
 34%|███▎      | 124798/371472 [9:55:32<22:50:26,  3.00it/s]
 34%|███▎      | 124799/371472 [9:55:32<21:22:01,  3.21it/s]
 34%|███▎      | 124800/371472 [9:55:33<20:33:09,  3.33it/s]
                                                            
{'loss': 3.3974, 'learning_rate': 6.979572927664893e-07, 'epoch': 5.38}

 34%|███▎      | 124800/371472 [9:55:33<20:33:09,  3.33it/s]
 34%|███▎      | 124801/371472 [9:55:33<19:34:35,  3.50it/s]
 34%|███▎      | 124802/371472 [9:55:33<18:29:15,  3.71it/s]
 34%|███▎      | 124803/371472 [9:55:33<21:29:07,  3.19it/s]
 34%|███▎      | 124804/371472 [9:55:34<21:06:52,  3.25it/s]
 34%|███▎      | 124805/371472 [9:55:34<20:23:54,  3.36it/s]
 34%|███▎      | 124806/371472 [9:55:34<21:04:26,  3.25it/s]
 34%|███▎      | 124807/371472 [9:55:35<21:16:29,  3.22it/s]
 34%|███▎      | 124808/371472 [9:55:35<21:05:25,  3.25it/s]
 34%|███▎      | 124809/371472 [9:55:35<19:49:17,  3.46it/s]
 34%|███▎      | 124810/371472 [9:55:35<18:52:11,  3.63it/s]
 34%|███▎      | 124811/371472 [9:55:36<18:42:41,  3.66it/s]
 34%|███▎      | 124812/371472 [9:55:36<18:21:21,  3.73it/s]
 34%|███▎      | 124813/371472 [9:55:36<18:33:50,  3.69it/s]
 34%|███▎      | 124814/371472 [9:55:36<17:46:40,  3.85it/s]
 34%|███▎      | 124815/371472 [9:55:37<17:46:57,  3.85it/s]
 34%|███▎      | 124816/371472 [9:55:37<19:02:20,  3.60it/s]
 34%|███▎      | 124817/371472 [9:55:37<19:52:12,  3.45it/s]
 34%|███▎      | 124818/371472 [9:55:38<19:19:59,  3.54it/s]
 34%|███▎      | 124819/371472 [9:55:38<19:46:42,  3.46it/s]
 34%|███▎      | 124820/371472 [9:55:38<20:17:21,  3.38it/s]
                                                            
{'loss': 3.2605, 'learning_rate': 6.979088107910103e-07, 'epoch': 5.38}

 34%|███▎      | 124820/371472 [9:55:38<20:17:21,  3.38it/s]
 34%|███▎      | 124821/371472 [9:55:39<19:56:13,  3.44it/s]
 34%|███▎      | 124822/371472 [9:55:39<19:11:48,  3.57it/s]
 34%|███▎      | 124823/371472 [9:55:39<18:43:27,  3.66it/s]
 34%|███▎      | 124824/371472 [9:55:39<18:53:57,  3.63it/s]
 34%|███▎      | 124825/371472 [9:55:40<18:37:00,  3.68it/s]
 34%|███▎      | 124826/371472 [9:55:40<18:36:57,  3.68it/s]
 34%|███▎      | 124827/371472 [9:55:40<18:26:57,  3.71it/s]
 34%|███▎      | 124828/371472 [9:55:40<18:51:24,  3.63it/s]
 34%|███▎      | 124829/371472 [9:55:41<19:01:23,  3.60it/s]
 34%|███▎      | 124830/371472 [9:55:41<18:16:27,  3.75it/s]
 34%|███▎      | 124831/371472 [9:55:41<17:58:23,  3.81it/s]
 34%|███▎      | 124832/371472 [9:55:42<18:47:22,  3.65it/s]
 34%|███▎      | 124833/371472 [9:55:42<19:26:31,  3.52it/s]
 34%|███▎      | 124834/371472 [9:55:42<19:31:51,  3.51it/s]
 34%|███▎      | 124835/371472 [9:55:42<20:25:39,  3.35it/s]
 34%|███▎      | 124836/371472 [9:55:43<19:32:17,  3.51it/s]
 34%|███▎      | 124837/371472 [9:55:43<18:43:06,  3.66it/s]
 34%|███▎      | 124838/371472 [9:55:43<17:56:22,  3.82it/s]
 34%|███▎      | 124839/371472 [9:55:44<23:17:06,  2.94it/s]
 34%|███▎      | 124840/371472 [9:55:44<21:57:51,  3.12it/s]
                                                            
{'loss': 3.2753, 'learning_rate': 6.978603288155314e-07, 'epoch': 5.38}

 34%|███▎      | 124840/371472 [9:55:44<21:57:51,  3.12it/s]
 34%|███▎      | 124841/371472 [9:55:44<20:04:08,  3.41it/s]
 34%|███▎      | 124842/371472 [9:55:45<20:43:09,  3.31it/s]
 34%|███▎      | 124843/371472 [9:55:45<21:03:25,  3.25it/s]
 34%|███▎      | 124844/371472 [9:55:45<19:59:11,  3.43it/s]
 34%|███▎      | 124845/371472 [9:55:45<19:28:21,  3.52it/s]
 34%|███▎      | 124846/371472 [9:55:46<19:04:29,  3.59it/s]
 34%|███▎      | 124847/371472 [9:55:46<18:49:09,  3.64it/s]
 34%|███▎      | 124848/371472 [9:55:46<19:05:01,  3.59it/s]
 34%|███▎      | 124849/371472 [9:55:46<19:51:27,  3.45it/s]
 34%|███▎      | 124850/371472 [9:55:47<19:24:01,  3.53it/s]
 34%|███▎      | 124851/371472 [9:55:47<18:39:27,  3.67it/s]
 34%|███▎      | 124852/371472 [9:55:47<18:08:24,  3.78it/s]
 34%|███▎      | 124853/371472 [9:55:48<18:26:01,  3.72it/s]
 34%|███▎      | 124854/371472 [9:55:48<18:24:55,  3.72it/s]
 34%|███▎      | 124855/371472 [9:55:48<19:08:07,  3.58it/s]
 34%|███▎      | 124856/371472 [9:55:48<20:09:32,  3.40it/s]
 34%|███▎      | 124857/371472 [9:55:49<19:07:18,  3.58it/s]
 34%|███▎      | 124858/371472 [9:55:49<19:19:13,  3.55it/s]
 34%|███▎      | 124859/371472 [9:55:49<19:13:56,  3.56it/s]
 34%|███▎      | 124860/371472 [9:55:49<18:42:57,  3.66it/s]
                                                            
{'loss': 3.3599, 'learning_rate': 6.978118468400525e-07, 'epoch': 5.38}

 34%|███▎      | 124860/371472 [9:55:49<18:42:57,  3.66it/s]
 34%|███▎      | 124861/371472 [9:55:50<18:45:07,  3.65it/s]
 34%|███▎      | 124862/371472 [9:55:50<18:08:40,  3.78it/s]
 34%|███▎      | 124863/371472 [9:55:50<18:07:28,  3.78it/s]
 34%|███▎      | 124864/371472 [9:55:51<17:52:58,  3.83it/s]
 34%|███▎      | 124865/371472 [9:55:51<18:44:31,  3.65it/s]
 34%|███▎      | 124866/371472 [9:55:51<19:10:05,  3.57it/s]
 34%|███▎      | 124867/371472 [9:55:51<18:38:42,  3.67it/s]
 34%|███▎      | 124868/371472 [9:55:52<19:39:56,  3.48it/s]
 34%|███▎      | 124869/371472 [9:55:52<19:30:36,  3.51it/s]
 34%|███▎      | 124870/371472 [9:55:52<19:15:46,  3.56it/s]
 34%|███▎      | 124871/371472 [9:55:53<18:42:34,  3.66it/s]
 34%|███▎      | 124872/371472 [9:55:53<17:54:33,  3.82it/s]
 34%|███▎      | 124873/371472 [9:55:53<19:02:04,  3.60it/s]
 34%|███▎      | 124874/371472 [9:55:53<19:42:28,  3.48it/s]
 34%|███▎      | 124875/371472 [9:55:54<19:41:44,  3.48it/s]
 34%|███▎      | 124876/371472 [9:55:54<19:46:16,  3.46it/s]
 34%|███▎      | 124877/371472 [9:55:54<21:01:31,  3.26it/s]
 34%|███▎      | 124878/371472 [9:55:55<20:25:19,  3.35it/s]
 34%|███▎      | 124879/371472 [9:55:55<20:11:04,  3.39it/s]
 34%|███▎      | 124880/371472 [9:55:55<19:29:00,  3.52it/s]
                                                            
{'loss': 3.2229, 'learning_rate': 6.977633648645737e-07, 'epoch': 5.38}

 34%|███▎      | 124880/371472 [9:55:55<19:29:00,  3.52it/s]
 34%|███▎      | 124881/371472 [9:55:55<19:08:09,  3.58it/s]
 34%|███▎      | 124882/371472 [9:55:56<19:13:46,  3.56it/s]
 34%|███▎      | 124883/371472 [9:55:56<19:08:30,  3.58it/s]
 34%|███▎      | 124884/371472 [9:55:56<19:58:11,  3.43it/s]
 34%|███▎      | 124885/371472 [9:55:57<19:30:34,  3.51it/s]
 34%|███▎      | 124886/371472 [9:55:57<21:33:34,  3.18it/s]
 34%|███▎      | 124887/371472 [9:55:57<20:27:59,  3.35it/s]
 34%|███▎      | 124888/371472 [9:55:58<21:28:19,  3.19it/s]
 34%|███▎      | 124889/371472 [9:55:58<20:06:47,  3.41it/s]
 34%|███▎      | 124890/371472 [9:55:58<19:43:09,  3.47it/s]
 34%|███▎      | 124891/371472 [9:55:58<19:06:59,  3.58it/s]
 34%|███▎      | 124892/371472 [9:55:59<20:40:10,  3.31it/s]
 34%|███▎      | 124893/371472 [9:55:59<19:47:17,  3.46it/s]
 34%|███▎      | 124894/371472 [9:55:59<19:31:38,  3.51it/s]
 34%|███▎      | 124895/371472 [9:56:00<20:14:35,  3.38it/s]
 34%|███▎      | 124896/371472 [9:56:00<19:25:44,  3.53it/s]
 34%|███▎      | 124897/371472 [9:56:00<19:28:01,  3.52it/s]
 34%|███▎      | 124898/371472 [9:56:00<19:44:09,  3.47it/s]
 34%|███▎      | 124899/371472 [9:56:01<19:02:40,  3.60it/s]
 34%|███▎      | 124900/371472 [9:56:01<18:32:58,  3.69it/s]
                                                            
{'loss': 3.1242, 'learning_rate': 6.977148828890948e-07, 'epoch': 5.38}

 34%|███▎      | 124900/371472 [9:56:01<18:32:58,  3.69it/s]
 34%|███▎      | 124901/371472 [9:56:01<18:10:24,  3.77it/s]
 34%|███▎      | 124902/371472 [9:56:01<19:40:05,  3.48it/s]
 34%|███▎      | 124903/371472 [9:56:02<20:14:59,  3.38it/s]
 34%|███▎      | 124904/371472 [9:56:02<20:32:33,  3.33it/s]
 34%|███▎      | 124905/371472 [9:56:02<19:38:54,  3.49it/s]
 34%|███▎      | 124906/371472 [9:56:03<20:06:18,  3.41it/s]
 34%|███▎      | 124907/371472 [9:56:03<19:39:50,  3.48it/s]
 34%|███▎      | 124908/371472 [9:56:03<18:27:04,  3.71it/s]
 34%|███▎      | 124909/371472 [9:56:03<17:52:06,  3.83it/s]
 34%|███▎      | 124910/371472 [9:56:04<17:34:46,  3.90it/s]
 34%|███▎      | 124911/371472 [9:56:04<18:15:18,  3.75it/s]
 34%|███▎      | 124912/371472 [9:56:04<18:05:08,  3.79it/s]
 34%|███▎      | 124913/371472 [9:56:04<18:42:34,  3.66it/s]
 34%|███▎      | 124914/371472 [9:56:05<17:58:46,  3.81it/s]
 34%|███▎      | 124915/371472 [9:56:05<19:26:14,  3.52it/s]
 34%|███▎      | 124916/371472 [9:56:05<19:07:04,  3.58it/s]
 34%|███▎      | 124917/371472 [9:56:06<20:43:45,  3.30it/s]
 34%|███▎      | 124918/371472 [9:56:06<19:21:37,  3.54it/s]
 34%|███▎      | 124919/371472 [9:56:06<18:37:38,  3.68it/s]
 34%|███▎      | 124920/371472 [9:56:06<18:32:54,  3.69it/s]
                                                            
{'loss': 3.1544, 'learning_rate': 6.976664009136159e-07, 'epoch': 5.38}

 34%|███▎      | 124920/371472 [9:56:06<18:32:54,  3.69it/s]
 34%|███▎      | 124921/371472 [9:56:07<18:51:06,  3.63it/s]
 34%|███▎      | 124922/371472 [9:56:07<20:01:47,  3.42it/s]
 34%|███▎      | 124923/371472 [9:56:07<20:32:29,  3.33it/s]
 34%|███▎      | 124924/371472 [9:56:08<19:18:55,  3.55it/s]
 34%|███▎      | 124925/371472 [9:56:08<19:24:04,  3.53it/s]
 34%|███▎      | 124926/371472 [9:56:08<20:58:27,  3.27it/s]
 34%|███▎      | 124927/371472 [9:56:09<20:01:46,  3.42it/s]
 34%|███▎      | 124928/371472 [9:56:09<19:15:57,  3.55it/s]
 34%|███▎      | 124929/371472 [9:56:09<19:05:31,  3.59it/s]
 34%|███▎      | 124930/371472 [9:56:09<19:15:35,  3.56it/s]
 34%|███▎      | 124931/371472 [9:56:10<20:05:57,  3.41it/s]
 34%|███▎      | 124932/371472 [9:56:10<19:30:14,  3.51it/s]
 34%|███▎      | 124933/371472 [9:56:10<19:32:41,  3.50it/s]
 34%|███▎      | 124934/371472 [9:56:11<19:50:57,  3.45it/s]
 34%|███▎      | 124935/371472 [9:56:11<19:47:36,  3.46it/s]
 34%|███▎      | 124936/371472 [9:56:11<19:07:59,  3.58it/s]
 34%|███▎      | 124937/371472 [9:56:11<18:47:44,  3.64it/s]
 34%|███▎      | 124938/371472 [9:56:12<18:46:42,  3.65it/s]
 34%|███▎      | 124939/371472 [9:56:12<18:42:28,  3.66it/s]
 34%|███▎      | 124940/371472 [9:56:12<18:23:29,  3.72it/s]
                                                            
{'loss': 3.1571, 'learning_rate': 6.97617918938137e-07, 'epoch': 5.38}

 34%|███▎      | 124940/371472 [9:56:12<18:23:29,  3.72it/s]
 34%|███▎      | 124941/371472 [9:56:12<18:35:02,  3.68it/s]
 34%|███▎      | 124942/371472 [9:56:13<17:46:39,  3.85it/s]
 34%|███▎      | 124943/371472 [9:56:13<17:57:46,  3.81it/s]
 34%|███▎      | 124944/371472 [9:56:13<17:56:55,  3.82it/s]
 34%|███▎      | 124945/371472 [9:56:13<17:49:21,  3.84it/s]
 34%|███▎      | 124946/371472 [9:56:14<17:58:36,  3.81it/s]
 34%|███▎      | 124947/371472 [9:56:14<18:22:22,  3.73it/s]
 34%|███▎      | 124948/371472 [9:56:14<18:12:02,  3.76it/s]
 34%|███▎      | 124949/371472 [9:56:14<17:51:27,  3.83it/s]
 34%|███▎      | 124950/371472 [9:56:15<18:58:35,  3.61it/s]
 34%|███▎      | 124951/371472 [9:56:15<18:22:16,  3.73it/s]
 34%|███▎      | 124952/371472 [9:56:15<18:34:05,  3.69it/s]
 34%|███▎      | 124953/371472 [9:56:16<19:50:54,  3.45it/s]
 34%|███▎      | 124954/371472 [9:56:16<20:06:33,  3.41it/s]
 34%|███▎      | 124955/371472 [9:56:16<20:20:29,  3.37it/s]
 34%|███▎      | 124956/371472 [9:56:16<19:12:48,  3.56it/s]
 34%|███▎      | 124957/371472 [9:56:17<18:45:36,  3.65it/s]
 34%|███▎      | 124958/371472 [9:56:17<18:36:28,  3.68it/s]
 34%|███▎      | 124959/371472 [9:56:17<18:19:24,  3.74it/s]
 34%|███▎      | 124960/371472 [9:56:18<18:25:40,  3.72it/s]
                                                            
{'loss': 3.1765, 'learning_rate': 6.97569436962658e-07, 'epoch': 5.38}

 34%|███▎      | 124960/371472 [9:56:18<18:25:40,  3.72it/s]
 34%|███▎      | 124961/371472 [9:56:18<19:15:24,  3.56it/s]
 34%|███▎      | 124962/371472 [9:56:18<19:11:08,  3.57it/s]
 34%|███▎      | 124963/371472 [9:56:18<19:22:09,  3.54it/s]
 34%|███▎      | 124964/371472 [9:56:19<19:00:24,  3.60it/s]
 34%|███▎      | 124965/371472 [9:56:19<18:27:16,  3.71it/s]
 34%|███▎      | 124966/371472 [9:56:19<18:30:08,  3.70it/s]
 34%|███▎      | 124967/371472 [9:56:19<18:05:29,  3.78it/s]
 34%|███▎      | 124968/371472 [9:56:20<18:28:12,  3.71it/s]
 34%|███▎      | 124969/371472 [9:56:20<18:01:14,  3.80it/s]
 34%|███▎      | 124970/371472 [9:56:20<19:07:27,  3.58it/s]
 34%|███▎      | 124971/371472 [9:56:21<18:55:40,  3.62it/s]
 34%|███▎      | 124972/371472 [9:56:21<17:55:17,  3.82it/s]
 34%|███▎      | 124973/371472 [9:56:21<17:59:19,  3.81it/s]
 34%|███▎      | 124974/371472 [9:56:21<17:48:25,  3.85it/s]
 34%|███▎      | 124975/371472 [9:56:22<17:26:29,  3.93it/s]
 34%|███▎      | 124976/371472 [9:56:22<17:54:43,  3.82it/s]
 34%|███▎      | 124977/371472 [9:56:22<18:26:19,  3.71it/s]
 34%|███▎      | 124978/371472 [9:56:22<18:27:16,  3.71it/s]
 34%|███▎      | 124979/371472 [9:56:23<19:04:12,  3.59it/s]
 34%|███▎      | 124980/371472 [9:56:23<19:19:05,  3.54it/s]
                                                            
{'loss': 3.2518, 'learning_rate': 6.975209549871791e-07, 'epoch': 5.38}

 34%|███▎      | 124980/371472 [9:56:23<19:19:05,  3.54it/s]
 34%|███▎      | 124981/371472 [9:56:23<19:20:08,  3.54it/s]
 34%|███▎      | 124982/371472 [9:56:24<18:59:39,  3.60it/s]
 34%|███▎      | 124983/371472 [9:56:24<19:14:35,  3.56it/s]
 34%|███▎      | 124984/371472 [9:56:24<18:12:38,  3.76it/s]
 34%|███▎      | 124985/371472 [9:56:24<20:04:05,  3.41it/s]
 34%|███▎      | 124986/371472 [9:56:25<20:03:04,  3.41it/s]
 34%|███▎      | 124987/371472 [9:56:25<19:28:11,  3.52it/s]
 34%|███▎      | 124988/371472 [9:56:25<20:09:57,  3.40it/s]
 34%|███▎      | 124989/371472 [9:56:26<19:30:25,  3.51it/s]
 34%|███▎      | 124990/371472 [9:56:26<19:59:55,  3.42it/s]
 34%|███▎      | 124991/371472 [9:56:26<21:02:08,  3.25it/s]
 34%|███▎      | 124992/371472 [9:56:26<20:29:09,  3.34it/s]
 34%|███▎      | 124993/371472 [9:56:27<19:37:59,  3.49it/s]
 34%|███▎      | 124994/371472 [9:56:27<19:19:43,  3.54it/s]
 34%|███▎      | 124995/371472 [9:56:27<18:49:22,  3.64it/s]
 34%|███▎      | 124996/371472 [9:56:28<18:37:16,  3.68it/s]
 34%|███▎      | 124997/371472 [9:56:28<17:49:19,  3.84it/s]
 34%|███▎      | 124998/371472 [9:56:28<18:00:54,  3.80it/s]
 34%|███▎      | 124999/371472 [9:56:28<17:47:30,  3.85it/s]
 34%|███▎      | 125000/371472 [9:56:29<19:45:13,  3.47it/s]
                                                            
{'loss': 3.2307, 'learning_rate': 6.974724730117004e-07, 'epoch': 5.38}

 34%|███▎      | 125000/371472 [9:56:29<19:45:13,  3.47it/s]
 34%|███▎      | 125001/371472 [9:56:29<19:03:17,  3.59it/s]
 34%|███▎      | 125002/371472 [9:56:29<18:28:37,  3.71it/s]
 34%|███▎      | 125003/371472 [9:56:29<18:50:23,  3.63it/s]
 34%|███▎      | 125004/371472 [9:56:30<19:11:08,  3.57it/s]
 34%|███▎      | 125005/371472 [9:56:30<19:33:40,  3.50it/s]
 34%|███▎      | 125006/371472 [9:56:30<19:33:48,  3.50it/s]
 34%|███▎      | 125007/371472 [9:56:31<20:16:37,  3.38it/s]
 34%|███▎      | 125008/371472 [9:56:31<19:13:31,  3.56it/s]
 34%|███▎      | 125009/371472 [9:56:31<19:37:12,  3.49it/s]
 34%|███▎      | 125010/371472 [9:56:31<19:53:58,  3.44it/s]
 34%|███▎      | 125011/371472 [9:56:32<19:29:18,  3.51it/s]
 34%|███▎      | 125012/371472 [9:56:32<20:13:37,  3.38it/s]
 34%|███▎      | 125013/371472 [9:56:32<19:08:37,  3.58it/s]
 34%|███▎      | 125014/371472 [9:56:33<20:10:08,  3.39it/s]
 34%|███▎      | 125015/371472 [9:56:33<21:40:47,  3.16it/s]
 34%|███▎      | 125016/371472 [9:56:33<20:41:56,  3.31it/s]
 34%|███▎      | 125017/371472 [9:56:34<19:28:14,  3.52it/s]
 34%|███▎      | 125018/371472 [9:56:34<18:47:04,  3.64it/s]
 34%|███▎      | 125019/371472 [9:56:34<20:52:54,  3.28it/s]
 34%|███▎      | 125020/371472 [9:56:34<19:50:12,  3.45it/s]
                                                            
{'loss': 3.3902, 'learning_rate': 6.974239910362214e-07, 'epoch': 5.38}

 34%|███▎      | 125020/371472 [9:56:34<19:50:12,  3.45it/s]
 34%|███▎      | 125021/371472 [9:56:35<19:43:05,  3.47it/s]
 34%|███▎      | 125022/371472 [9:56:35<19:01:49,  3.60it/s]
 34%|███▎      | 125023/371472 [9:56:35<19:03:47,  3.59it/s]
 34%|███▎      | 125024/371472 [9:56:36<19:17:49,  3.55it/s]
 34%|███▎      | 125025/371472 [9:56:36<19:46:15,  3.46it/s]
 34%|███▎      | 125026/371472 [9:56:36<18:43:50,  3.65it/s]
 34%|███▎      | 125027/371472 [9:56:36<18:49:23,  3.64it/s]
 34%|███▎      | 125028/371472 [9:56:37<18:59:57,  3.60it/s]
 34%|███▎      | 125029/371472 [9:56:37<18:43:02,  3.66it/s]
 34%|███▎      | 125030/371472 [9:56:37<18:33:16,  3.69it/s]
 34%|███▎      | 125031/371472 [9:56:37<17:53:51,  3.82it/s]
 34%|███▎      | 125032/371472 [9:56:38<17:43:51,  3.86it/s]
 34%|███▎      | 125033/371472 [9:56:38<17:38:55,  3.88it/s]
 34%|███▎      | 125034/371472 [9:56:38<18:06:19,  3.78it/s]
 34%|███▎      | 125035/371472 [9:56:38<18:27:42,  3.71it/s]
 34%|███▎      | 125036/371472 [9:56:39<18:45:52,  3.65it/s]
 34%|███▎      | 125037/371472 [9:56:39<18:18:23,  3.74it/s]
 34%|███▎      | 125038/371472 [9:56:39<17:52:48,  3.83it/s]
 34%|███▎      | 125039/371472 [9:56:40<18:13:47,  3.76it/s]
 34%|███▎      | 125040/371472 [9:56:40<18:17:48,  3.74it/s]
                                                            
{'loss': 3.1286, 'learning_rate': 6.973755090607425e-07, 'epoch': 5.39}

 34%|███▎      | 125040/371472 [9:56:40<18:17:48,  3.74it/s]
 34%|███▎      | 125041/371472 [9:56:40<20:03:28,  3.41it/s]
 34%|███▎      | 125042/371472 [9:56:40<20:38:41,  3.32it/s]
 34%|███▎      | 125043/371472 [9:56:41<21:13:55,  3.22it/s]
 34%|███▎      | 125044/371472 [9:56:41<21:02:20,  3.25it/s]
 34%|███▎      | 125045/371472 [9:56:41<19:58:54,  3.43it/s]
 34%|███▎      | 125046/371472 [9:56:42<19:18:56,  3.54it/s]
 34%|███▎      | 125047/371472 [9:56:42<18:54:38,  3.62it/s]
 34%|███▎      | 125048/371472 [9:56:42<19:21:10,  3.54it/s]
 34%|███▎      | 125049/371472 [9:56:43<20:20:49,  3.36it/s]
 34%|███▎      | 125050/371472 [9:56:43<19:39:28,  3.48it/s]
 34%|███▎      | 125051/371472 [9:56:43<19:38:04,  3.49it/s]
 34%|███▎      | 125052/371472 [9:56:43<19:24:10,  3.53it/s]
 34%|███▎      | 125053/371472 [9:56:44<19:08:52,  3.57it/s]
 34%|███▎      | 125054/371472 [9:56:44<19:02:45,  3.59it/s]
 34%|███▎      | 125055/371472 [9:56:44<20:53:31,  3.28it/s]
 34%|███▎      | 125056/371472 [9:56:45<20:10:46,  3.39it/s]
 34%|███▎      | 125057/371472 [9:56:45<20:24:45,  3.35it/s]
 34%|███▎      | 125058/371472 [9:56:45<19:06:00,  3.58it/s]
 34%|███▎      | 125059/371472 [9:56:45<18:30:22,  3.70it/s]
 34%|███▎      | 125060/371472 [9:56:46<18:48:28,  3.64it/s]
                                                            
{'loss': 3.1218, 'learning_rate': 6.973270270852636e-07, 'epoch': 5.39}

 34%|███▎      | 125060/371472 [9:56:46<18:48:28,  3.64it/s]
 34%|███▎      | 125061/371472 [9:56:46<18:43:23,  3.66it/s]
 34%|███▎      | 125062/371472 [9:56:46<18:57:37,  3.61it/s]
 34%|███▎      | 125063/371472 [9:56:46<20:10:06,  3.39it/s]
 34%|███▎      | 125064/371472 [9:56:47<19:48:26,  3.46it/s]
 34%|███▎      | 125065/371472 [9:56:47<19:09:11,  3.57it/s]
 34%|███▎      | 125066/371472 [9:56:47<18:45:06,  3.65it/s]
 34%|███▎      | 125067/371472 [9:56:48<18:46:21,  3.65it/s]
 34%|███▎      | 125068/371472 [9:56:48<18:32:16,  3.69it/s]
 34%|███▎      | 125069/371472 [9:56:48<17:56:24,  3.82it/s]
 34%|███▎      | 125070/371472 [9:56:48<18:19:15,  3.74it/s]
 34%|███▎      | 125071/371472 [9:56:49<18:00:41,  3.80it/s]
 34%|███▎      | 125072/371472 [9:56:49<17:47:14,  3.85it/s]
 34%|███▎      | 125073/371472 [9:56:49<18:00:20,  3.80it/s]
 34%|███▎      | 125074/371472 [9:56:49<19:42:52,  3.47it/s]
 34%|███▎      | 125075/371472 [9:56:50<19:38:03,  3.49it/s]
 34%|███▎      | 125076/371472 [9:56:50<18:48:01,  3.64it/s]
 34%|███▎      | 125077/371472 [9:56:50<18:01:25,  3.80it/s]
 34%|███▎      | 125078/371472 [9:56:50<18:00:19,  3.80it/s]
 34%|███▎      | 125079/371472 [9:56:51<18:33:48,  3.69it/s]
 34%|███▎      | 125080/371472 [9:56:51<18:47:17,  3.64it/s]
                                                            
{'loss': 3.0916, 'learning_rate': 6.972785451097847e-07, 'epoch': 5.39}

 34%|███▎      | 125080/371472 [9:56:51<18:47:17,  3.64it/s]
 34%|███▎      | 125081/371472 [9:56:51<18:23:22,  3.72it/s]
 34%|███▎      | 125082/371472 [9:56:52<19:10:44,  3.57it/s]
 34%|███▎      | 125083/371472 [9:56:52<18:55:02,  3.62it/s]
 34%|███▎      | 125084/371472 [9:56:52<20:13:36,  3.38it/s]
 34%|███▎      | 125085/371472 [9:56:52<19:31:35,  3.51it/s]
 34%|███▎      | 125086/371472 [9:56:53<18:41:37,  3.66it/s]
 34%|███▎      | 125087/371472 [9:56:53<20:13:54,  3.38it/s]
 34%|███▎      | 125088/371472 [9:56:53<20:10:06,  3.39it/s]
 34%|███▎      | 125089/371472 [9:56:54<20:22:58,  3.36it/s]
 34%|███▎      | 125090/371472 [9:56:54<20:49:42,  3.29it/s]
 34%|███▎      | 125091/371472 [9:56:54<21:17:13,  3.22it/s]
 34%|███▎      | 125092/371472 [9:56:55<22:35:42,  3.03it/s]
 34%|███▎      | 125093/371472 [9:56:55<21:12:53,  3.23it/s]
 34%|███▎      | 125094/371472 [9:56:55<19:49:11,  3.45it/s]
 34%|███▎      | 125095/371472 [9:56:55<19:47:50,  3.46it/s]
 34%|███▎      | 125096/371472 [9:56:56<19:16:07,  3.55it/s]
 34%|███▎      | 125097/371472 [9:56:56<19:06:56,  3.58it/s]
 34%|███▎      | 125098/371472 [9:56:56<19:34:31,  3.50it/s]
 34%|███▎      | 125099/371472 [9:56:57<20:38:25,  3.32it/s]
 34%|███▎      | 125100/371472 [9:56:57<22:36:26,  3.03it/s]
                                                            
{'loss': 3.2104, 'learning_rate': 6.972300631343058e-07, 'epoch': 5.39}

 34%|███▎      | 125100/371472 [9:56:57<22:36:26,  3.03it/s]
 34%|███▎      | 125101/371472 [9:56:57<21:59:00,  3.11it/s]
 34%|███▎      | 125102/371472 [9:56:58<21:50:48,  3.13it/s]
 34%|███▎      | 125103/371472 [9:56:58<22:52:29,  2.99it/s]
 34%|███▎      | 125104/371472 [9:56:58<23:18:23,  2.94it/s]
 34%|███▎      | 125105/371472 [9:56:59<22:08:34,  3.09it/s]
 34%|███▎      | 125106/371472 [9:56:59<22:01:24,  3.11it/s]
 34%|███▎      | 125107/371472 [9:56:59<21:27:17,  3.19it/s]
 34%|███▎      | 125108/371472 [9:57:00<20:22:56,  3.36it/s]
 34%|███▎      | 125109/371472 [9:57:00<19:25:29,  3.52it/s]
 34%|███▎      | 125110/371472 [9:57:00<18:34:54,  3.68it/s]
 34%|███▎      | 125111/371472 [9:57:00<18:58:24,  3.61it/s]
 34%|███▎      | 125112/371472 [9:57:01<19:18:25,  3.54it/s]
 34%|███▎      | 125113/371472 [9:57:01<20:37:14,  3.32it/s]
 34%|███▎      | 125114/371472 [9:57:01<20:27:06,  3.35it/s]
 34%|███▎      | 125115/371472 [9:57:02<20:11:08,  3.39it/s]
 34%|███▎      | 125116/371472 [9:57:02<19:43:23,  3.47it/s]
 34%|███▎      | 125117/371472 [9:57:02<19:54:02,  3.44it/s]
 34%|███▎      | 125118/371472 [9:57:02<19:47:37,  3.46it/s]
 34%|███▎      | 125119/371472 [9:57:03<19:43:13,  3.47it/s]
 34%|███▎      | 125120/371472 [9:57:03<19:23:00,  3.53it/s]
                                                            
{'loss': 3.2597, 'learning_rate': 6.971815811588269e-07, 'epoch': 5.39}

 34%|███▎      | 125120/371472 [9:57:03<19:23:00,  3.53it/s]
 34%|███▎      | 125121/371472 [9:57:03<19:14:44,  3.56it/s]
 34%|███▎      | 125122/371472 [9:57:04<19:08:34,  3.57it/s]
 34%|███▎      | 125123/371472 [9:57:04<18:49:32,  3.63it/s]
 34%|███▎      | 125124/371472 [9:57:04<18:04:55,  3.78it/s]
 34%|███▎      | 125125/371472 [9:57:04<18:54:35,  3.62it/s]
 34%|███▎      | 125126/371472 [9:57:05<18:17:12,  3.74it/s]
 34%|███▎      | 125127/371472 [9:57:05<18:34:40,  3.68it/s]
 34%|███▎      | 125128/371472 [9:57:05<18:45:14,  3.65it/s]
 34%|███▎      | 125129/371472 [9:57:05<18:11:25,  3.76it/s]
 34%|███▎      | 125130/371472 [9:57:06<17:46:24,  3.85it/s]
 34%|███▎      | 125131/371472 [9:57:06<18:28:02,  3.71it/s]
 34%|███▎      | 125132/371472 [9:57:06<17:56:43,  3.81it/s]
 34%|███▎      | 125133/371472 [9:57:06<17:46:40,  3.85it/s]
 34%|███▎      | 125134/371472 [9:57:07<17:38:30,  3.88it/s]
 34%|███▎      | 125135/371472 [9:57:07<18:14:52,  3.75it/s]
 34%|███▎      | 125136/371472 [9:57:07<19:39:43,  3.48it/s]
 34%|███▎      | 125137/371472 [9:57:08<19:31:18,  3.51it/s]
 34%|███▎      | 125138/371472 [9:57:08<19:24:18,  3.53it/s]
 34%|███▎      | 125139/371472 [9:57:08<19:08:46,  3.57it/s]
 34%|███▎      | 125140/371472 [9:57:08<19:35:07,  3.49it/s]
                                                            
{'loss': 3.2439, 'learning_rate': 6.97133099183348e-07, 'epoch': 5.39}

 34%|███▎      | 125140/371472 [9:57:08<19:35:07,  3.49it/s]
 34%|███▎      | 125141/371472 [9:57:09<20:33:27,  3.33it/s]
 34%|███▎      | 125142/371472 [9:57:09<19:30:01,  3.51it/s]
 34%|███▎      | 125143/371472 [9:57:09<19:20:34,  3.54it/s]
 34%|███▎      | 125144/371472 [9:57:10<18:27:27,  3.71it/s]
 34%|███▎      | 125145/371472 [9:57:10<19:36:01,  3.49it/s]
 34%|███▎      | 125146/371472 [9:57:10<18:46:00,  3.65it/s]
 34%|███▎      | 125147/371472 [9:57:10<18:54:23,  3.62it/s]
 34%|███▎      | 125148/371472 [9:57:11<18:28:48,  3.70it/s]
 34%|███▎      | 125149/371472 [9:57:11<17:40:13,  3.87it/s]
 34%|███▎      | 125150/371472 [9:57:11<18:21:19,  3.73it/s]
 34%|███▎      | 125151/371472 [9:57:12<20:03:21,  3.41it/s]
 34%|███▎      | 125152/371472 [9:57:12<19:06:00,  3.58it/s]
 34%|███▎      | 125153/371472 [9:57:12<19:06:13,  3.58it/s]
 34%|███▎      | 125154/371472 [9:57:12<19:12:37,  3.56it/s]
 34%|███▎      | 125155/371472 [9:57:13<19:13:29,  3.56it/s]
 34%|███▎      | 125156/371472 [9:57:13<19:00:31,  3.60it/s]
 34%|███▎      | 125157/371472 [9:57:13<19:32:05,  3.50it/s]
 34%|███▎      | 125158/371472 [9:57:13<18:47:21,  3.64it/s]
 34%|███▎      | 125159/371472 [9:57:14<19:12:41,  3.56it/s]
 34%|███▎      | 125160/371472 [9:57:14<18:25:30,  3.71it/s]
                                                            
{'loss': 3.4474, 'learning_rate': 6.970846172078691e-07, 'epoch': 5.39}

 34%|███▎      | 125160/371472 [9:57:14<18:25:30,  3.71it/s]
 34%|███▎      | 125161/371472 [9:57:14<18:17:17,  3.74it/s]
 34%|███▎      | 125162/371472 [9:57:14<17:54:11,  3.82it/s]
 34%|███▎      | 125163/371472 [9:57:15<17:52:39,  3.83it/s]
 34%|███▎      | 125164/371472 [9:57:15<18:23:42,  3.72it/s]
 34%|███▎      | 125165/371472 [9:57:15<19:35:35,  3.49it/s]
 34%|███▎      | 125166/371472 [9:57:16<18:45:04,  3.65it/s]
 34%|███▎      | 125167/371472 [9:57:16<19:43:43,  3.47it/s]
 34%|███▎      | 125168/371472 [9:57:16<19:14:01,  3.56it/s]
 34%|███▎      | 125169/371472 [9:57:17<20:21:04,  3.36it/s]
 34%|███▎      | 125170/371472 [9:57:17<20:00:12,  3.42it/s]
 34%|███▎      | 125171/371472 [9:57:17<19:00:02,  3.60it/s]
 34%|███▎      | 125172/371472 [9:57:17<18:55:52,  3.61it/s]
 34%|███▎      | 125173/371472 [9:57:18<18:15:33,  3.75it/s]
 34%|███▎      | 125174/371472 [9:57:18<19:19:38,  3.54it/s]
 34%|███▎      | 125175/371472 [9:57:18<20:07:46,  3.40it/s]
 34%|███▎      | 125176/371472 [9:57:18<19:45:27,  3.46it/s]
 34%|███▎      | 125177/371472 [9:57:19<20:21:18,  3.36it/s]
 34%|███▎      | 125178/371472 [9:57:19<19:14:50,  3.55it/s]
 34%|███▎      | 125179/371472 [9:57:19<18:27:23,  3.71it/s]
 34%|███▎      | 125180/371472 [9:57:20<19:21:08,  3.54it/s]
                                                            
{'loss': 3.2778, 'learning_rate': 6.970361352323903e-07, 'epoch': 5.39}

 34%|███▎      | 125180/371472 [9:57:20<19:21:08,  3.54it/s]
 34%|███▎      | 125181/371472 [9:57:20<19:20:20,  3.54it/s]
 34%|███▎      | 125182/371472 [9:57:20<19:05:27,  3.58it/s]
 34%|███▎      | 125183/371472 [9:57:20<18:26:54,  3.71it/s]
 34%|███▎      | 125184/371472 [9:57:21<17:57:38,  3.81it/s]
 34%|███▎      | 125185/371472 [9:57:21<17:36:34,  3.88it/s]
 34%|███▎      | 125186/371472 [9:57:21<18:18:18,  3.74it/s]
 34%|███▎      | 125187/371472 [9:57:21<18:01:00,  3.80it/s]
 34%|███▎      | 125188/371472 [9:57:22<19:44:26,  3.47it/s]
 34%|███▎      | 125189/371472 [9:57:22<19:54:14,  3.44it/s]
 34%|███▎      | 125190/371472 [9:57:22<20:35:29,  3.32it/s]
 34%|███▎      | 125191/371472 [9:57:23<20:24:43,  3.35it/s]
 34%|███▎      | 125192/371472 [9:57:23<20:08:11,  3.40it/s]
 34%|███▎      | 125193/371472 [9:57:23<20:05:09,  3.41it/s]
 34%|███▎      | 125194/371472 [9:57:24<20:11:08,  3.39it/s]
 34%|███▎      | 125195/371472 [9:57:24<19:35:14,  3.49it/s]
 34%|███▎      | 125196/371472 [9:57:24<20:40:32,  3.31it/s]
 34%|███▎      | 125197/371472 [9:57:25<21:31:43,  3.18it/s]
 34%|███▎      | 125198/371472 [9:57:25<20:34:34,  3.32it/s]
 34%|███▎      | 125199/371472 [9:57:25<20:10:27,  3.39it/s]
 34%|███▎      | 125200/371472 [9:57:25<21:10:45,  3.23it/s]
                                                            
{'loss': 3.2983, 'learning_rate': 6.969876532569113e-07, 'epoch': 5.39}

 34%|███▎      | 125200/371472 [9:57:25<21:10:45,  3.23it/s]
 34%|███▎      | 125201/371472 [9:57:26<21:13:27,  3.22it/s]
 34%|███▎      | 125202/371472 [9:57:26<20:20:13,  3.36it/s]
 34%|███▎      | 125203/371472 [9:57:26<19:39:05,  3.48it/s]
 34%|███▎      | 125204/371472 [9:57:27<19:19:54,  3.54it/s]
 34%|███▎      | 125205/371472 [9:57:27<18:26:30,  3.71it/s]
 34%|███▎      | 125206/371472 [9:57:27<18:27:30,  3.71it/s]
 34%|███▎      | 125207/371472 [9:57:27<18:31:48,  3.69it/s]
 34%|███▎      | 125208/371472 [9:57:28<18:14:26,  3.75it/s]
 34%|███▎      | 125209/371472 [9:57:28<18:36:19,  3.68it/s]
 34%|███▎      | 125210/371472 [9:57:28<19:35:03,  3.49it/s]
 34%|███▎      | 125211/371472 [9:57:28<20:00:33,  3.42it/s]
 34%|███▎      | 125212/371472 [9:57:29<21:50:37,  3.13it/s]
 34%|███▎      | 125213/371472 [9:57:29<20:08:16,  3.40it/s]
 34%|███▎      | 125214/371472 [9:57:29<19:18:46,  3.54it/s]
 34%|███▎      | 125215/371472 [9:57:30<18:33:48,  3.68it/s]
 34%|███▎      | 125216/371472 [9:57:30<18:32:40,  3.69it/s]
 34%|███▎      | 125217/371472 [9:57:30<19:03:19,  3.59it/s]
 34%|███▎      | 125218/371472 [9:57:30<18:52:11,  3.63it/s]
 34%|███▎      | 125219/371472 [9:57:31<20:02:02,  3.41it/s]
 34%|███▎      | 125220/371472 [9:57:31<19:03:03,  3.59it/s]
                                                            
{'loss': 3.2102, 'learning_rate': 6.969391712814324e-07, 'epoch': 5.39}

 34%|███▎      | 125220/371472 [9:57:31<19:03:03,  3.59it/s]
 34%|███▎      | 125221/371472 [9:57:31<19:03:20,  3.59it/s]
 34%|███▎      | 125222/371472 [9:57:32<18:48:17,  3.64it/s]
 34%|███▎      | 125223/371472 [9:57:32<20:37:22,  3.32it/s]
 34%|███▎      | 125224/371472 [9:57:32<19:29:03,  3.51it/s]
 34%|███▎      | 125225/371472 [9:57:32<19:45:55,  3.46it/s]
 34%|███▎      | 125226/371472 [9:57:33<18:36:53,  3.67it/s]
 34%|███▎      | 125227/371472 [9:57:33<19:08:52,  3.57it/s]
 34%|███▎      | 125228/371472 [9:57:33<20:03:36,  3.41it/s]
 34%|███▎      | 125229/371472 [9:57:34<19:43:47,  3.47it/s]
 34%|███▎      | 125230/371472 [9:57:34<18:50:48,  3.63it/s]
 34%|███▎      | 125231/371472 [9:57:34<19:24:43,  3.52it/s]
 34%|███▎      | 125232/371472 [9:57:34<18:29:11,  3.70it/s]
 34%|███▎      | 125233/371472 [9:57:35<18:51:39,  3.63it/s]
 34%|███▎      | 125234/371472 [9:57:35<19:26:44,  3.52it/s]
 34%|███▎      | 125235/371472 [9:57:35<19:44:28,  3.46it/s]
 34%|███▎      | 125236/371472 [9:57:36<18:42:19,  3.66it/s]
 34%|███▎      | 125237/371472 [9:57:36<18:34:17,  3.68it/s]
 34%|███▎      | 125238/371472 [9:57:36<19:27:05,  3.52it/s]
 34%|███▎      | 125239/371472 [9:57:36<19:07:50,  3.58it/s]
 34%|███▎      | 125240/371472 [9:57:37<19:15:25,  3.55it/s]
                                                            
{'loss': 3.295, 'learning_rate': 6.968906893059535e-07, 'epoch': 5.39}

 34%|███▎      | 125240/371472 [9:57:37<19:15:25,  3.55it/s]
 34%|███▎      | 125241/371472 [9:57:37<18:42:55,  3.65it/s]
 34%|███▎      | 125242/371472 [9:57:37<18:07:04,  3.78it/s]
 34%|███▎      | 125243/371472 [9:57:37<18:39:21,  3.67it/s]
 34%|███▎      | 125244/371472 [9:57:38<18:13:29,  3.75it/s]
 34%|███▎      | 125245/371472 [9:57:38<18:25:37,  3.71it/s]
 34%|███▎      | 125246/371472 [9:57:38<18:14:38,  3.75it/s]
 34%|███▎      | 125247/371472 [9:57:39<18:31:27,  3.69it/s]
 34%|███▎      | 125248/371472 [9:57:39<18:01:39,  3.79it/s]
 34%|███▎      | 125249/371472 [9:57:39<19:42:11,  3.47it/s]
 34%|███▎      | 125250/371472 [9:57:39<19:14:25,  3.55it/s]
 34%|███▎      | 125251/371472 [9:57:40<18:49:33,  3.63it/s]
 34%|███▎      | 125252/371472 [9:57:40<18:08:05,  3.77it/s]
 34%|███▎      | 125253/371472 [9:57:40<18:04:35,  3.78it/s]
 34%|███▎      | 125254/371472 [9:57:40<18:18:28,  3.74it/s]
 34%|███▎      | 125255/371472 [9:57:41<18:13:17,  3.75it/s]
 34%|███▎      | 125256/371472 [9:57:41<18:15:02,  3.75it/s]
 34%|███▎      | 125257/371472 [9:57:41<17:59:24,  3.80it/s]
 34%|███▎      | 125258/371472 [9:57:41<18:03:35,  3.79it/s]
 34%|███▎      | 125259/371472 [9:57:42<17:54:17,  3.82it/s]
 34%|███▎      | 125260/371472 [9:57:42<18:05:42,  3.78it/s]
                                                            
{'loss': 3.2226, 'learning_rate': 6.968422073304747e-07, 'epoch': 5.4}

 34%|███▎      | 125260/371472 [9:57:42<18:05:42,  3.78it/s]
 34%|███▎      | 125261/371472 [9:57:42<17:51:47,  3.83it/s]
 34%|███▎      | 125262/371472 [9:57:43<19:44:51,  3.46it/s]
 34%|███▎      | 125263/371472 [9:57:43<19:19:47,  3.54it/s]
 34%|███▎      | 125264/371472 [9:57:43<19:00:31,  3.60it/s]
 34%|███▎      | 125265/371472 [9:57:43<18:17:42,  3.74it/s]
 34%|███▎      | 125266/371472 [9:57:44<17:48:46,  3.84it/s]
 34%|███▎      | 125267/371472 [9:57:44<17:38:53,  3.88it/s]
 34%|███▎      | 125268/371472 [9:57:44<17:45:51,  3.85it/s]
 34%|███▎      | 125269/371472 [9:57:44<18:32:53,  3.69it/s]
 34%|███▎      | 125270/371472 [9:57:45<18:29:10,  3.70it/s]
 34%|███▎      | 125271/371472 [9:57:45<17:57:47,  3.81it/s]
 34%|███▎      | 125272/371472 [9:57:45<18:39:57,  3.66it/s]
 34%|███▎      | 125273/371472 [9:57:46<18:18:51,  3.73it/s]
 34%|███▎      | 125274/371472 [9:57:46<18:25:48,  3.71it/s]
 34%|███▎      | 125275/371472 [9:57:46<18:36:41,  3.67it/s]
 34%|███▎      | 125276/371472 [9:57:46<18:46:12,  3.64it/s]
 34%|███▎      | 125277/371472 [9:57:47<18:41:17,  3.66it/s]
 34%|███▎      | 125278/371472 [9:57:47<18:21:17,  3.73it/s]
 34%|███▎      | 125279/371472 [9:57:47<17:40:12,  3.87it/s]
 34%|███▎      | 125280/371472 [9:57:47<18:42:25,  3.66it/s]
                                                            
{'loss': 3.218, 'learning_rate': 6.967937253549958e-07, 'epoch': 5.4}

 34%|███▎      | 125280/371472 [9:57:47<18:42:25,  3.66it/s]
 34%|███▎      | 125281/371472 [9:57:48<19:00:15,  3.60it/s]
 34%|███▎      | 125282/371472 [9:57:48<20:04:56,  3.41it/s]
 34%|███▎      | 125283/371472 [9:57:48<21:33:15,  3.17it/s]
 34%|███▎      | 125284/371472 [9:57:49<21:31:06,  3.18it/s]
 34%|███▎      | 125285/371472 [9:57:49<21:16:54,  3.21it/s]
 34%|███▎      | 125286/371472 [9:57:49<20:41:43,  3.30it/s]
 34%|███▎      | 125287/371472 [9:57:50<20:20:29,  3.36it/s]
 34%|███▎      | 125288/371472 [9:57:50<20:39:04,  3.31it/s]
 34%|███▎      | 125289/371472 [9:57:50<22:26:59,  3.05it/s]
 34%|███▎      | 125290/371472 [9:57:51<20:55:48,  3.27it/s]
 34%|███▎      | 125291/371472 [9:57:51<19:45:58,  3.46it/s]
 34%|███▎      | 125292/371472 [9:57:51<19:28:12,  3.51it/s]
 34%|███▎      | 125293/371472 [9:57:51<19:03:18,  3.59it/s]
 34%|███▎      | 125294/371472 [9:57:52<19:12:11,  3.56it/s]
 34%|███▎      | 125295/371472 [9:57:52<18:41:29,  3.66it/s]
 34%|███▎      | 125296/371472 [9:57:52<18:04:02,  3.78it/s]
 34%|███▎      | 125297/371472 [9:57:52<18:03:42,  3.79it/s]
 34%|███▎      | 125298/371472 [9:57:53<18:09:37,  3.77it/s]
 34%|███▎      | 125299/371472 [9:57:53<17:58:22,  3.80it/s]
 34%|███▎      | 125300/371472 [9:57:53<18:11:16,  3.76it/s]
                                                            
{'loss': 3.042, 'learning_rate': 6.967452433795169e-07, 'epoch': 5.4}

 34%|███▎      | 125300/371472 [9:57:53<18:11:16,  3.76it/s]
 34%|███▎      | 125301/371472 [9:57:53<18:12:48,  3.75it/s]
 34%|███▎      | 125302/371472 [9:57:54<17:50:13,  3.83it/s]
 34%|███▎      | 125303/371472 [9:57:54<18:16:07,  3.74it/s]
 34%|███▎      | 125304/371472 [9:57:54<18:59:26,  3.60it/s]
 34%|███▎      | 125305/371472 [9:57:55<20:04:20,  3.41it/s]
 34%|███▎      | 125306/371472 [9:57:55<20:50:33,  3.28it/s]
 34%|███▎      | 125307/371472 [9:57:55<19:54:24,  3.43it/s]
 34%|███▎      | 125308/371472 [9:57:55<20:03:02,  3.41it/s]
 34%|███▎      | 125309/371472 [9:57:56<19:04:47,  3.58it/s]
 34%|███▎      | 125310/371472 [9:57:56<18:21:27,  3.72it/s]
 34%|███▎      | 125311/371472 [9:57:56<18:08:14,  3.77it/s]
 34%|███▎      | 125312/371472 [9:57:56<17:54:54,  3.82it/s]
 34%|███▎      | 125313/371472 [9:57:57<18:07:45,  3.77it/s]
 34%|███▎      | 125314/371472 [9:57:57<18:00:00,  3.80it/s]
 34%|███▎      | 125315/371472 [9:57:57<17:45:52,  3.85it/s]
 34%|███▎      | 125316/371472 [9:57:58<17:47:01,  3.84it/s]
 34%|███▎      | 125317/371472 [9:57:58<18:54:21,  3.62it/s]
 34%|███▎      | 125318/371472 [9:57:58<19:41:19,  3.47it/s]
 34%|███▎      | 125319/371472 [9:57:59<21:00:46,  3.25it/s]
 34%|███▎      | 125320/371472 [9:57:59<20:16:12,  3.37it/s]
                                                            
{'loss': 3.1354, 'learning_rate': 6.96696761404038e-07, 'epoch': 5.4}

 34%|███▎      | 125320/371472 [9:57:59<20:16:12,  3.37it/s]
 34%|███▎      | 125321/371472 [9:57:59<19:58:35,  3.42it/s]
 34%|███▎      | 125322/371472 [9:57:59<21:27:51,  3.19it/s]
 34%|███▎      | 125323/371472 [9:58:00<19:55:05,  3.43it/s]
 34%|███▎      | 125324/371472 [9:58:00<20:02:48,  3.41it/s]
 34%|███▎      | 125325/371472 [9:58:00<20:40:59,  3.31it/s]
 34%|███▎      | 125326/371472 [9:58:01<20:42:59,  3.30it/s]
 34%|███▎      | 125327/371472 [9:58:01<21:03:43,  3.25it/s]
 34%|███▎      | 125328/371472 [9:58:01<20:23:49,  3.35it/s]
 34%|███▎      | 125329/371472 [9:58:01<20:19:46,  3.36it/s]
 34%|███▎      | 125330/371472 [9:58:02<20:09:32,  3.39it/s]
 34%|███▎      | 125331/371472 [9:58:02<19:32:27,  3.50it/s]
 34%|███▎      | 125332/371472 [9:58:02<19:55:30,  3.43it/s]
 34%|███▎      | 125333/371472 [9:58:03<20:27:58,  3.34it/s]
 34%|███▎      | 125334/371472 [9:58:03<20:09:46,  3.39it/s]
 34%|███▎      | 125335/371472 [9:58:03<19:59:41,  3.42it/s]
 34%|███▎      | 125336/371472 [9:58:04<19:41:59,  3.47it/s]
 34%|███▎      | 125337/371472 [9:58:04<19:16:05,  3.55it/s]
 34%|███▎      | 125338/371472 [9:58:04<20:40:29,  3.31it/s]
 34%|███▎      | 125339/371472 [9:58:04<20:34:08,  3.32it/s]
 34%|███▎      | 125340/371472 [9:58:05<21:04:33,  3.24it/s]
                                                            
{'loss': 3.3227, 'learning_rate': 6.966482794285591e-07, 'epoch': 5.4}

 34%|███▎      | 125340/371472 [9:58:05<21:04:33,  3.24it/s]
 34%|███▎      | 125341/371472 [9:58:05<20:03:03,  3.41it/s]
 34%|███▎      | 125342/371472 [9:58:05<19:53:54,  3.44it/s]
 34%|███▎      | 125343/371472 [9:58:06<19:50:35,  3.45it/s]
 34%|███▎      | 125344/371472 [9:58:06<19:46:50,  3.46it/s]
 34%|███▎      | 125345/371472 [9:58:06<19:06:27,  3.58it/s]
 34%|███▎      | 125346/371472 [9:58:06<20:25:53,  3.35it/s]
 34%|███▎      | 125347/371472 [9:58:07<20:09:09,  3.39it/s]
 34%|███▎      | 125348/371472 [9:58:07<19:46:53,  3.46it/s]
 34%|███▎      | 125349/371472 [9:58:07<19:33:31,  3.50it/s]
 34%|███▎      | 125350/371472 [9:58:08<19:35:00,  3.49it/s]
 34%|███▎      | 125351/371472 [9:58:08<19:15:38,  3.55it/s]
 34%|███▎      | 125352/371472 [9:58:08<19:33:11,  3.50it/s]
 34%|███▎      | 125353/371472 [9:58:08<19:18:07,  3.54it/s]
 34%|███▎      | 125354/371472 [9:58:09<18:29:13,  3.70it/s]
 34%|███▎      | 125355/371472 [9:58:09<17:48:41,  3.84it/s]
 34%|███▎      | 125356/371472 [9:58:09<17:40:36,  3.87it/s]
 34%|███▎      | 125357/371472 [9:58:10<19:16:39,  3.55it/s]
 34%|███▎      | 125358/371472 [9:58:10<19:21:43,  3.53it/s]
 34%|███▎      | 125359/371472 [9:58:10<19:12:11,  3.56it/s]
 34%|███▎      | 125360/371472 [9:58:10<19:09:41,  3.57it/s]
                                                            
{'loss': 3.2836, 'learning_rate': 6.965997974530802e-07, 'epoch': 5.4}

 34%|███▎      | 125360/371472 [9:58:10<19:09:41,  3.57it/s]
 34%|███▎      | 125361/371472 [9:58:11<18:47:49,  3.64it/s]
 34%|███▎      | 125362/371472 [9:58:11<18:22:27,  3.72it/s]
 34%|███▎      | 125363/371472 [9:58:11<18:28:07,  3.70it/s]
 34%|███▎      | 125364/371472 [9:58:11<18:52:04,  3.62it/s]
 34%|███▎      | 125365/371472 [9:58:12<18:56:20,  3.61it/s]
 34%|███▎      | 125366/371472 [9:58:12<18:46:28,  3.64it/s]
 34%|███▎      | 125367/371472 [9:58:12<18:25:10,  3.71it/s]
 34%|███▎      | 125368/371472 [9:58:12<17:55:07,  3.82it/s]
 34%|███▎      | 125369/371472 [9:58:13<17:55:07,  3.82it/s]
 34%|███▎      | 125370/371472 [9:58:13<17:42:29,  3.86it/s]
 34%|███▎      | 125371/371472 [9:58:13<18:33:02,  3.69it/s]
 34%|███▍      | 125372/371472 [9:58:14<17:54:04,  3.82it/s]
 34%|███▍      | 125373/371472 [9:58:14<18:54:28,  3.62it/s]
 34%|███▍      | 125374/371472 [9:58:14<18:10:07,  3.76it/s]
 34%|███▍      | 125375/371472 [9:58:14<17:45:10,  3.85it/s]
 34%|███▍      | 125376/371472 [9:58:15<19:06:40,  3.58it/s]
 34%|███▍      | 125377/371472 [9:58:15<18:38:09,  3.67it/s]
 34%|███▍      | 125378/371472 [9:58:15<18:13:58,  3.75it/s]
 34%|███▍      | 125379/371472 [9:58:15<18:10:36,  3.76it/s]
 34%|███▍      | 125380/371472 [9:58:16<18:23:04,  3.72it/s]
                                                            
{'loss': 3.0382, 'learning_rate': 6.965513154776013e-07, 'epoch': 5.4}

 34%|███▍      | 125380/371472 [9:58:16<18:23:04,  3.72it/s]
 34%|███▍      | 125381/371472 [9:58:16<18:06:57,  3.77it/s]
 34%|███▍      | 125382/371472 [9:58:16<18:00:05,  3.80it/s]
 34%|███▍      | 125383/371472 [9:58:16<17:47:02,  3.84it/s]
 34%|███▍      | 125384/371472 [9:58:17<18:18:01,  3.74it/s]
 34%|███▍      | 125385/371472 [9:58:17<20:23:07,  3.35it/s]
 34%|███▍      | 125386/371472 [9:58:17<19:03:53,  3.59it/s]
 34%|███▍      | 125387/371472 [9:58:18<18:51:29,  3.62it/s]
 34%|███▍      | 125388/371472 [9:58:18<19:29:38,  3.51it/s]
 34%|███▍      | 125389/371472 [9:58:18<19:31:00,  3.50it/s]
 34%|███▍      | 125390/371472 [9:58:18<19:06:17,  3.58it/s]
 34%|███▍      | 125391/371472 [9:58:19<18:54:22,  3.62it/s]
 34%|███▍      | 125392/371472 [9:58:19<18:33:57,  3.68it/s]
 34%|███▍      | 125393/371472 [9:58:19<17:54:56,  3.82it/s]
 34%|███▍      | 125394/371472 [9:58:20<17:35:02,  3.89it/s]
 34%|███▍      | 125395/371472 [9:58:20<17:57:34,  3.81it/s]
 34%|███▍      | 125396/371472 [9:58:20<18:08:06,  3.77it/s]
 34%|███▍      | 125397/371472 [9:58:20<17:57:23,  3.81it/s]
 34%|███▍      | 125398/371472 [9:58:21<19:23:51,  3.52it/s]
 34%|███▍      | 125399/371472 [9:58:21<18:18:37,  3.73it/s]
 34%|███▍      | 125400/371472 [9:58:21<18:59:51,  3.60it/s]
                                                            
{'loss': 3.2907, 'learning_rate': 6.965028335021224e-07, 'epoch': 5.4}

 34%|███▍      | 125400/371472 [9:58:21<18:59:51,  3.60it/s]
 34%|███▍      | 125401/371472 [9:58:21<18:13:46,  3.75it/s]
 34%|███▍      | 125402/371472 [9:58:22<18:22:16,  3.72it/s]
 34%|███▍      | 125403/371472 [9:58:22<18:21:55,  3.72it/s]
 34%|███▍      | 125404/371472 [9:58:22<17:49:37,  3.83it/s]
 34%|███▍      | 125405/371472 [9:58:22<18:18:20,  3.73it/s]
 34%|███▍      | 125406/371472 [9:58:23<19:30:09,  3.50it/s]
 34%|███▍      | 125407/371472 [9:58:23<21:38:39,  3.16it/s]
 34%|███▍      | 125408/371472 [9:58:23<19:59:41,  3.42it/s]
 34%|███▍      | 125409/371472 [9:58:24<21:00:18,  3.25it/s]
 34%|███▍      | 125410/371472 [9:58:24<19:59:24,  3.42it/s]
 34%|███▍      | 125411/371472 [9:58:24<19:11:17,  3.56it/s]
 34%|███▍      | 125412/371472 [9:58:25<18:42:11,  3.65it/s]
 34%|███▍      | 125413/371472 [9:58:25<18:19:45,  3.73it/s]
 34%|███▍      | 125414/371472 [9:58:25<18:15:41,  3.74it/s]
 34%|███▍      | 125415/371472 [9:58:25<18:27:35,  3.70it/s]
 34%|███▍      | 125416/371472 [9:58:26<19:43:41,  3.46it/s]
 34%|███▍      | 125417/371472 [9:58:26<18:51:21,  3.62it/s]
 34%|███▍      | 125418/371472 [9:58:26<18:25:59,  3.71it/s]
 34%|███▍      | 125419/371472 [9:58:26<19:22:35,  3.53it/s]
 34%|███▍      | 125420/371472 [9:58:27<19:50:14,  3.45it/s]
                                                            
{'loss': 3.4009, 'learning_rate': 6.964543515266436e-07, 'epoch': 5.4}

 34%|███▍      | 125420/371472 [9:58:27<19:50:14,  3.45it/s]
 34%|███▍      | 125421/371472 [9:58:27<18:57:10,  3.61it/s]
 34%|███▍      | 125422/371472 [9:58:27<21:37:52,  3.16it/s]
 34%|███▍      | 125423/371472 [9:58:28<21:20:45,  3.20it/s]
 34%|███▍      | 125424/371472 [9:58:28<21:24:59,  3.19it/s]
 34%|███▍      | 125425/371472 [9:58:28<21:39:32,  3.16it/s]
 34%|███▍      | 125426/371472 [9:58:29<21:46:11,  3.14it/s]
 34%|███▍      | 125427/371472 [9:58:29<20:40:35,  3.31it/s]
 34%|███▍      | 125428/371472 [9:58:29<22:14:24,  3.07it/s]
 34%|███▍      | 125429/371472 [9:58:30<21:14:32,  3.22it/s]
 34%|███▍      | 125430/371472 [9:58:30<19:50:27,  3.44it/s]
 34%|███▍      | 125431/371472 [9:58:30<19:37:30,  3.48it/s]
 34%|███▍      | 125432/371472 [9:58:30<20:02:39,  3.41it/s]
 34%|███▍      | 125433/371472 [9:58:31<19:21:18,  3.53it/s]
 34%|███▍      | 125434/371472 [9:58:31<18:31:48,  3.69it/s]
 34%|███▍      | 125435/371472 [9:58:31<17:52:31,  3.82it/s]
 34%|███▍      | 125436/371472 [9:58:31<17:32:00,  3.90it/s]
 34%|███▍      | 125437/371472 [9:58:32<19:10:16,  3.56it/s]
 34%|███▍      | 125438/371472 [9:58:32<18:51:54,  3.62it/s]
 34%|███▍      | 125439/371472 [9:58:32<18:29:57,  3.69it/s]
 34%|███▍      | 125440/371472 [9:58:33<19:33:05,  3.50it/s]
                                                            
{'loss': 3.2983, 'learning_rate': 6.964058695511647e-07, 'epoch': 5.4}

 34%|███▍      | 125440/371472 [9:58:33<19:33:05,  3.50it/s]
 34%|███▍      | 125441/371472 [9:58:33<19:52:01,  3.44it/s]
 34%|███▍      | 125442/371472 [9:58:33<20:14:35,  3.38it/s]
 34%|███▍      | 125443/371472 [9:58:34<19:39:32,  3.48it/s]
 34%|███▍      | 125444/371472 [9:58:34<18:53:53,  3.62it/s]
 34%|███▍      | 125445/371472 [9:58:34<18:08:04,  3.77it/s]
 34%|███▍      | 125446/371472 [9:58:34<18:17:19,  3.74it/s]
 34%|███▍      | 125447/371472 [9:58:35<19:02:54,  3.59it/s]
 34%|███▍      | 125448/371472 [9:58:35<21:12:28,  3.22it/s]
 34%|███▍      | 125449/371472 [9:58:35<21:33:01,  3.17it/s]
 34%|███▍      | 125450/371472 [9:58:36<20:51:10,  3.28it/s]
 34%|███▍      | 125451/371472 [9:58:36<20:06:12,  3.40it/s]
 34%|███▍      | 125452/371472 [9:58:36<19:28:45,  3.51it/s]
 34%|███▍      | 125453/371472 [9:58:36<19:19:04,  3.54it/s]
 34%|███▍      | 125454/371472 [9:58:37<19:41:14,  3.47it/s]
 34%|███▍      | 125455/371472 [9:58:37<18:33:30,  3.68it/s]
 34%|███▍      | 125456/371472 [9:58:37<19:42:51,  3.47it/s]
 34%|███▍      | 125457/371472 [9:58:38<19:31:12,  3.50it/s]
 34%|███▍      | 125458/371472 [9:58:38<23:49:04,  2.87it/s]
 34%|███▍      | 125459/371472 [9:58:38<22:16:03,  3.07it/s]
 34%|███▍      | 125460/371472 [9:58:39<21:14:44,  3.22it/s]
                                                            
{'loss': 3.2915, 'learning_rate': 6.963573875756856e-07, 'epoch': 5.4}

 34%|███▍      | 125460/371472 [9:58:39<21:14:44,  3.22it/s]
 34%|███▍      | 125461/371472 [9:58:39<20:47:02,  3.29it/s]
 34%|███▍      | 125462/371472 [9:58:39<21:10:33,  3.23it/s]
 34%|███▍      | 125463/371472 [9:58:39<20:21:18,  3.36it/s]
 34%|███▍      | 125464/371472 [9:58:40<20:08:53,  3.39it/s]
 34%|███▍      | 125465/371472 [9:58:40<19:28:00,  3.51it/s]
 34%|███▍      | 125466/371472 [9:58:40<19:34:22,  3.49it/s]
 34%|███▍      | 125467/371472 [9:58:41<20:48:57,  3.28it/s]
 34%|███▍      | 125468/371472 [9:58:41<20:22:30,  3.35it/s]
 34%|███▍      | 125469/371472 [9:58:41<19:32:52,  3.50it/s]
 34%|███▍      | 125470/371472 [9:58:42<21:09:27,  3.23it/s]
 34%|███▍      | 125471/371472 [9:58:42<20:53:24,  3.27it/s]
 34%|███▍      | 125472/371472 [9:58:42<20:01:42,  3.41it/s]
 34%|███▍      | 125473/371472 [9:58:42<19:25:29,  3.52it/s]
 34%|███▍      | 125474/371472 [9:58:43<18:58:28,  3.60it/s]
 34%|███▍      | 125475/371472 [9:58:43<18:29:15,  3.70it/s]
 34%|███▍      | 125476/371472 [9:58:43<18:12:09,  3.75it/s]
 34%|███▍      | 125477/371472 [9:58:43<18:08:19,  3.77it/s]
 34%|███▍      | 125478/371472 [9:58:44<17:57:17,  3.81it/s]
 34%|███▍      | 125479/371472 [9:58:44<19:30:41,  3.50it/s]
 34%|███▍      | 125480/371472 [9:58:44<18:45:17,  3.64it/s]
                                                            
{'loss': 3.2158, 'learning_rate': 6.963089056002068e-07, 'epoch': 5.4}

 34%|███▍      | 125480/371472 [9:58:44<18:45:17,  3.64it/s]
 34%|███▍      | 125481/371472 [9:58:45<18:42:41,  3.65it/s]
 34%|███▍      | 125482/371472 [9:58:45<18:51:28,  3.62it/s]
 34%|███▍      | 125483/371472 [9:58:45<20:56:08,  3.26it/s]
 34%|███▍      | 125484/371472 [9:58:45<20:01:09,  3.41it/s]
 34%|███▍      | 125485/371472 [9:58:46<19:51:41,  3.44it/s]
 34%|███▍      | 125486/371472 [9:58:46<18:37:07,  3.67it/s]
 34%|███▍      | 125487/371472 [9:58:46<19:06:56,  3.57it/s]
 34%|███▍      | 125488/371472 [9:58:46<18:15:21,  3.74it/s]
 34%|███▍      | 125489/371472 [9:58:47<21:17:07,  3.21it/s]
 34%|███▍      | 125490/371472 [9:58:47<20:23:11,  3.35it/s]
 34%|███▍      | 125491/371472 [9:58:47<20:53:36,  3.27it/s]
 34%|███▍      | 125492/371472 [9:58:48<20:57:26,  3.26it/s]
 34%|███▍      | 125493/371472 [9:58:48<20:49:22,  3.28it/s]
 34%|███▍      | 125494/371472 [9:58:48<20:48:13,  3.28it/s]
 34%|███▍      | 125495/371472 [9:58:49<19:43:03,  3.47it/s]
 34%|███▍      | 125496/371472 [9:58:49<19:37:53,  3.48it/s]
 34%|███▍      | 125497/371472 [9:58:49<19:07:22,  3.57it/s]
 34%|███▍      | 125498/371472 [9:58:49<18:50:42,  3.63it/s]
 34%|███▍      | 125499/371472 [9:58:50<19:33:44,  3.49it/s]
 34%|███▍      | 125500/371472 [9:58:50<18:51:53,  3.62it/s]
                                                            
{'loss': 3.1302, 'learning_rate': 6.962604236247279e-07, 'epoch': 5.41}

 34%|███▍      | 125500/371472 [9:58:50<18:51:53,  3.62it/s]
 34%|███▍      | 125501/371472 [9:58:50<19:23:07,  3.52it/s]
 34%|███▍      | 125502/371472 [9:58:51<19:08:00,  3.57it/s]
 34%|███▍      | 125503/371472 [9:58:51<18:38:36,  3.66it/s]
 34%|███▍      | 125504/371472 [9:58:51<19:13:50,  3.55it/s]
 34%|███▍      | 125505/371472 [9:58:51<18:52:53,  3.62it/s]
 34%|███▍      | 125506/371472 [9:58:52<18:53:58,  3.62it/s]
 34%|███▍      | 125507/371472 [9:58:52<18:37:23,  3.67it/s]
 34%|███▍      | 125508/371472 [9:58:52<20:12:50,  3.38it/s]
 34%|███▍      | 125509/371472 [9:58:53<19:36:46,  3.48it/s]
 34%|███▍      | 125510/371472 [9:58:53<19:34:19,  3.49it/s]
 34%|███▍      | 125511/371472 [9:58:53<20:03:30,  3.41it/s]
 34%|███▍      | 125512/371472 [9:58:53<20:08:37,  3.39it/s]
 34%|███▍      | 125513/371472 [9:58:54<19:08:54,  3.57it/s]
 34%|███▍      | 125514/371472 [9:58:54<19:38:11,  3.48it/s]
 34%|███▍      | 125515/371472 [9:58:54<21:04:55,  3.24it/s]
 34%|███▍      | 125516/371472 [9:58:55<20:09:15,  3.39it/s]
 34%|███▍      | 125517/371472 [9:58:55<19:42:02,  3.47it/s]
 34%|███▍      | 125518/371472 [9:58:55<20:26:28,  3.34it/s]
 34%|███▍      | 125519/371472 [9:58:56<19:36:40,  3.48it/s]
 34%|███▍      | 125520/371472 [9:58:56<19:06:06,  3.58it/s]
                                                            
{'loss': 3.1503, 'learning_rate': 6.96211941649249e-07, 'epoch': 5.41}

 34%|███▍      | 125520/371472 [9:58:56<19:06:06,  3.58it/s]
 34%|███▍      | 125521/371472 [9:58:56<19:54:09,  3.43it/s]
 34%|███▍      | 125522/371472 [9:58:56<20:50:41,  3.28it/s]
 34%|███▍      | 125523/371472 [9:58:57<20:01:38,  3.41it/s]
 34%|███▍      | 125524/371472 [9:58:57<19:55:08,  3.43it/s]
 34%|███▍      | 125525/371472 [9:58:57<20:28:22,  3.34it/s]
 34%|███▍      | 125526/371472 [9:58:58<19:56:10,  3.43it/s]
 34%|███▍      | 125527/371472 [9:58:58<19:20:07,  3.53it/s]
 34%|███▍      | 125528/371472 [9:58:58<19:00:55,  3.59it/s]
 34%|███▍      | 125529/371472 [9:58:58<19:50:51,  3.44it/s]
 34%|███▍      | 125530/371472 [9:58:59<19:30:50,  3.50it/s]
 34%|███▍      | 125531/371472 [9:58:59<19:47:13,  3.45it/s]
 34%|███▍      | 125532/371472 [9:58:59<19:59:14,  3.42it/s]
 34%|███▍      | 125533/371472 [9:59:00<20:13:43,  3.38it/s]
 34%|███▍      | 125534/371472 [9:59:00<20:01:12,  3.41it/s]
 34%|███▍      | 125535/371472 [9:59:00<20:05:44,  3.40it/s]
 34%|███▍      | 125536/371472 [9:59:00<19:46:43,  3.45it/s]
 34%|███▍      | 125537/371472 [9:59:01<21:32:31,  3.17it/s]
 34%|███▍      | 125538/371472 [9:59:01<20:06:39,  3.40it/s]
 34%|███▍      | 125539/371472 [9:59:01<19:46:18,  3.46it/s]
 34%|███▍      | 125540/371472 [9:59:02<18:56:37,  3.61it/s]
                                                            
{'loss': 3.1419, 'learning_rate': 6.961634596737701e-07, 'epoch': 5.41}

 34%|███▍      | 125540/371472 [9:59:02<18:56:37,  3.61it/s]
 34%|███▍      | 125541/371472 [9:59:02<19:17:50,  3.54it/s]
 34%|███▍      | 125542/371472 [9:59:02<19:22:36,  3.53it/s]
 34%|███▍      | 125543/371472 [9:59:02<18:37:32,  3.67it/s]
 34%|███▍      | 125544/371472 [9:59:03<18:56:05,  3.61it/s]
 34%|███▍      | 125545/371472 [9:59:03<18:44:22,  3.65it/s]
 34%|███▍      | 125546/371472 [9:59:03<19:03:57,  3.58it/s]
 34%|███▍      | 125547/371472 [9:59:04<18:58:49,  3.60it/s]
 34%|███▍      | 125548/371472 [9:59:04<19:08:10,  3.57it/s]
 34%|███▍      | 125549/371472 [9:59:04<19:54:02,  3.43it/s]
 34%|███▍      | 125550/371472 [9:59:04<18:47:36,  3.63it/s]
 34%|███▍      | 125551/371472 [9:59:05<18:14:36,  3.74it/s]
 34%|███▍      | 125552/371472 [9:59:05<17:57:22,  3.80it/s]
 34%|███▍      | 125553/371472 [9:59:05<18:04:41,  3.78it/s]
 34%|███▍      | 125554/371472 [9:59:05<17:31:19,  3.90it/s]
 34%|███▍      | 125555/371472 [9:59:06<18:33:17,  3.68it/s]
 34%|███▍      | 125556/371472 [9:59:06<26:58:39,  2.53it/s]
 34%|███▍      | 125557/371472 [9:59:07<24:32:27,  2.78it/s]
 34%|███▍      | 125558/371472 [9:59:07<23:27:17,  2.91it/s]
 34%|███▍      | 125559/371472 [9:59:07<21:24:19,  3.19it/s]
 34%|███▍      | 125560/371472 [9:59:08<21:46:51,  3.14it/s]
                                                            
{'loss': 3.381, 'learning_rate': 6.961149776982913e-07, 'epoch': 5.41}

 34%|███▍      | 125560/371472 [9:59:08<21:46:51,  3.14it/s]
 34%|███▍      | 125561/371472 [9:59:08<21:09:27,  3.23it/s]
 34%|███▍      | 125562/371472 [9:59:08<19:57:48,  3.42it/s]
 34%|███▍      | 125563/371472 [9:59:08<20:30:45,  3.33it/s]
 34%|███▍      | 125564/371472 [9:59:09<19:34:09,  3.49it/s]
 34%|███▍      | 125565/371472 [9:59:09<19:35:45,  3.49it/s]
 34%|███▍      | 125566/371472 [9:59:09<18:44:27,  3.64it/s]
 34%|███▍      | 125567/371472 [9:59:09<18:45:56,  3.64it/s]
 34%|███▍      | 125568/371472 [9:59:10<19:19:47,  3.53it/s]
 34%|███▍      | 125569/371472 [9:59:10<18:35:10,  3.68it/s]
 34%|███▍      | 125570/371472 [9:59:10<18:02:19,  3.79it/s]
 34%|███▍      | 125571/371472 [9:59:11<17:48:13,  3.84it/s]
 34%|███▍      | 125572/371472 [9:59:11<17:37:29,  3.88it/s]
 34%|███▍      | 125573/371472 [9:59:11<18:02:21,  3.79it/s]
 34%|███▍      | 125574/371472 [9:59:11<18:26:18,  3.70it/s]
 34%|███▍      | 125575/371472 [9:59:12<19:01:34,  3.59it/s]
 34%|███▍      | 125576/371472 [9:59:12<18:30:54,  3.69it/s]
 34%|███▍      | 125577/371472 [9:59:12<18:07:44,  3.77it/s]
 34%|███▍      | 125578/371472 [9:59:12<17:25:22,  3.92it/s]
 34%|███▍      | 125579/371472 [9:59:13<17:48:00,  3.84it/s]
 34%|███▍      | 125580/371472 [9:59:13<18:35:48,  3.67it/s]
                                                            
{'loss': 3.159, 'learning_rate': 6.960664957228124e-07, 'epoch': 5.41}

 34%|███▍      | 125580/371472 [9:59:13<18:35:48,  3.67it/s]
 34%|███▍      | 125581/371472 [9:59:13<19:10:10,  3.56it/s]
 34%|███▍      | 125582/371472 [9:59:14<19:40:37,  3.47it/s]
 34%|███▍      | 125583/371472 [9:59:14<19:04:29,  3.58it/s]
 34%|███▍      | 125584/371472 [9:59:14<21:07:54,  3.23it/s]
 34%|███▍      | 125585/371472 [9:59:14<21:03:41,  3.24it/s]
 34%|███▍      | 125586/371472 [9:59:15<20:22:17,  3.35it/s]
 34%|███▍      | 125587/371472 [9:59:15<19:28:36,  3.51it/s]
 34%|███▍      | 125588/371472 [9:59:15<19:38:46,  3.48it/s]
 34%|███▍      | 125589/371472 [9:59:16<19:59:31,  3.42it/s]
 34%|███▍      | 125590/371472 [9:59:16<19:16:50,  3.54it/s]
 34%|███▍      | 125591/371472 [9:59:16<20:47:40,  3.28it/s]
 34%|███▍      | 125592/371472 [9:59:17<19:58:14,  3.42it/s]
 34%|███▍      | 125593/371472 [9:59:17<20:36:25,  3.31it/s]
 34%|███▍      | 125594/371472 [9:59:17<19:45:47,  3.46it/s]
 34%|███▍      | 125595/371472 [9:59:17<19:24:25,  3.52it/s]
 34%|███▍      | 125596/371472 [9:59:18<18:53:52,  3.61it/s]
 34%|███▍      | 125597/371472 [9:59:18<19:05:12,  3.58it/s]
 34%|███▍      | 125598/371472 [9:59:18<19:26:40,  3.51it/s]
 34%|███▍      | 125599/371472 [9:59:19<19:51:48,  3.44it/s]
 34%|███▍      | 125600/371472 [9:59:19<19:47:47,  3.45it/s]
                                                            
{'loss': 3.2026, 'learning_rate': 6.960180137473334e-07, 'epoch': 5.41}

 34%|███▍      | 125600/371472 [9:59:19<19:47:47,  3.45it/s]
 34%|███▍      | 125601/371472 [9:59:19<18:48:19,  3.63it/s]
 34%|███▍      | 125602/371472 [9:59:19<18:35:48,  3.67it/s]
 34%|███▍      | 125603/371472 [9:59:20<18:27:53,  3.70it/s]
 34%|███▍      | 125604/371472 [9:59:20<18:24:55,  3.71it/s]
 34%|███▍      | 125605/371472 [9:59:20<18:51:48,  3.62it/s]
 34%|███▍      | 125606/371472 [9:59:20<18:29:11,  3.69it/s]
 34%|███▍      | 125607/371472 [9:59:21<18:35:16,  3.67it/s]
 34%|███▍      | 125608/371472 [9:59:21<18:38:24,  3.66it/s]
 34%|███▍      | 125609/371472 [9:59:21<18:49:04,  3.63it/s]
 34%|███▍      | 125610/371472 [9:59:21<18:48:22,  3.63it/s]
 34%|███▍      | 125611/371472 [9:59:22<19:48:15,  3.45it/s]
 34%|███▍      | 125612/371472 [9:59:22<19:37:12,  3.48it/s]
 34%|███▍      | 125613/371472 [9:59:22<20:38:17,  3.31it/s]
 34%|███▍      | 125614/371472 [9:59:23<20:29:40,  3.33it/s]
 34%|███▍      | 125615/371472 [9:59:23<20:22:30,  3.35it/s]
 34%|███▍      | 125616/371472 [9:59:23<22:56:21,  2.98it/s]
 34%|███▍      | 125617/371472 [9:59:24<23:06:52,  2.95it/s]
 34%|███▍      | 125618/371472 [9:59:24<21:22:04,  3.20it/s]
 34%|███▍      | 125619/371472 [9:59:24<21:12:52,  3.22it/s]
 34%|███▍      | 125620/371472 [9:59:25<20:53:02,  3.27it/s]
                                                            
{'loss': 3.1769, 'learning_rate': 6.959695317718545e-07, 'epoch': 5.41}

 34%|███▍      | 125620/371472 [9:59:25<20:53:02,  3.27it/s]
 34%|███▍      | 125621/371472 [9:59:25<19:49:29,  3.44it/s]
 34%|███▍      | 125622/371472 [9:59:25<19:16:08,  3.54it/s]
 34%|███▍      | 125623/371472 [9:59:25<18:16:51,  3.74it/s]
 34%|███▍      | 125624/371472 [9:59:26<17:33:04,  3.89it/s]
 34%|███▍      | 125625/371472 [9:59:26<17:53:05,  3.82it/s]
 34%|███▍      | 125626/371472 [9:59:26<18:31:00,  3.69it/s]
 34%|███▍      | 125627/371472 [9:59:26<18:45:51,  3.64it/s]
 34%|███▍      | 125628/371472 [9:59:27<18:32:27,  3.68it/s]
 34%|███▍      | 125629/371472 [9:59:27<18:53:03,  3.62it/s]
 34%|███▍      | 125630/371472 [9:59:27<18:04:29,  3.78it/s]
 34%|███▍      | 125631/371472 [9:59:28<18:24:48,  3.71it/s]
 34%|███▍      | 125632/371472 [9:59:28<18:01:20,  3.79it/s]
 34%|███▍      | 125633/371472 [9:59:28<18:23:28,  3.71it/s]
 34%|███▍      | 125634/371472 [9:59:28<19:18:21,  3.54it/s]
 34%|███▍      | 125635/371472 [9:59:29<18:40:36,  3.66it/s]
 34%|███▍      | 125636/371472 [9:59:29<18:06:16,  3.77it/s]
 34%|███▍      | 125637/371472 [9:59:29<19:15:48,  3.54it/s]
 34%|███▍      | 125638/371472 [9:59:30<19:47:53,  3.45it/s]
 34%|███▍      | 125639/371472 [9:59:30<19:23:02,  3.52it/s]
 34%|███▍      | 125640/371472 [9:59:30<19:47:46,  3.45it/s]
                                                            
{'loss': 3.291, 'learning_rate': 6.959210497963757e-07, 'epoch': 5.41}

 34%|███▍      | 125640/371472 [9:59:30<19:47:46,  3.45it/s]
 34%|███▍      | 125641/371472 [9:59:30<19:20:37,  3.53it/s]
 34%|███▍      | 125642/371472 [9:59:31<19:36:23,  3.48it/s]
 34%|███▍      | 125643/371472 [9:59:31<19:41:03,  3.47it/s]
 34%|███▍      | 125644/371472 [9:59:31<19:46:45,  3.45it/s]
 34%|███▍      | 125645/371472 [9:59:31<18:51:12,  3.62it/s]
 34%|███▍      | 125646/371472 [9:59:32<19:42:27,  3.46it/s]
 34%|███▍      | 125647/371472 [9:59:32<20:57:07,  3.26it/s]
 34%|███▍      | 125648/371472 [9:59:32<19:45:50,  3.45it/s]
 34%|███▍      | 125649/371472 [9:59:33<18:59:37,  3.60it/s]
 34%|███▍      | 125650/371472 [9:59:33<18:48:03,  3.63it/s]
 34%|███▍      | 125651/371472 [9:59:33<18:43:57,  3.65it/s]
 34%|███▍      | 125652/371472 [9:59:33<19:20:02,  3.53it/s]
 34%|███▍      | 125653/371472 [9:59:34<19:16:03,  3.54it/s]
 34%|███▍      | 125654/371472 [9:59:34<19:02:01,  3.59it/s]
 34%|███▍      | 125655/371472 [9:59:34<21:30:10,  3.18it/s]
 34%|███▍      | 125656/371472 [9:59:35<20:00:03,  3.41it/s]
 34%|███▍      | 125657/371472 [9:59:35<20:24:56,  3.34it/s]
 34%|███▍      | 125658/371472 [9:59:35<20:05:45,  3.40it/s]
 34%|███▍      | 125659/371472 [9:59:36<19:41:51,  3.47it/s]
 34%|███▍      | 125660/371472 [9:59:36<21:28:25,  3.18it/s]
                                                            
{'loss': 3.1185, 'learning_rate': 6.958725678208968e-07, 'epoch': 5.41}

 34%|███▍      | 125660/371472 [9:59:36<21:28:25,  3.18it/s]
 34%|███▍      | 125661/371472 [9:59:36<20:24:10,  3.35it/s]
 34%|███▍      | 125662/371472 [9:59:36<19:59:31,  3.42it/s]
 34%|███▍      | 125663/371472 [9:59:37<19:19:52,  3.53it/s]
 34%|███▍      | 125664/371472 [9:59:37<20:20:55,  3.36it/s]
 34%|███▍      | 125665/371472 [9:59:37<20:34:53,  3.32it/s]
 34%|███▍      | 125666/371472 [9:59:38<19:53:42,  3.43it/s]
 34%|███▍      | 125667/371472 [9:59:38<19:35:32,  3.48it/s]
 34%|███▍      | 125668/371472 [9:59:38<20:01:18,  3.41it/s]
 34%|███▍      | 125669/371472 [9:59:39<20:07:23,  3.39it/s]
 34%|███▍      | 125670/371472 [9:59:39<20:09:27,  3.39it/s]
 34%|███▍      | 125671/371472 [9:59:39<20:10:42,  3.38it/s]
 34%|███▍      | 125672/371472 [9:59:39<20:39:59,  3.30it/s]
 34%|███▍      | 125673/371472 [9:59:40<19:53:37,  3.43it/s]
 34%|███▍      | 125674/371472 [9:59:40<19:14:52,  3.55it/s]
 34%|███▍      | 125675/371472 [9:59:40<19:14:58,  3.55it/s]
 34%|███▍      | 125676/371472 [9:59:41<18:53:21,  3.61it/s]
 34%|███▍      | 125677/371472 [9:59:41<18:14:12,  3.74it/s]
 34%|███▍      | 125678/371472 [9:59:41<18:06:47,  3.77it/s]
 34%|███▍      | 125679/371472 [9:59:41<19:24:07,  3.52it/s]
 34%|███▍      | 125680/371472 [9:59:42<18:46:42,  3.64it/s]
                                                            
{'loss': 3.138, 'learning_rate': 6.958240858454179e-07, 'epoch': 5.41}

 34%|███▍      | 125680/371472 [9:59:42<18:46:42,  3.64it/s]
 34%|███▍      | 125681/371472 [9:59:42<18:41:23,  3.65it/s]
 34%|███▍      | 125682/371472 [9:59:42<19:11:48,  3.56it/s]
 34%|███▍      | 125683/371472 [9:59:42<18:21:13,  3.72it/s]
 34%|███▍      | 125684/371472 [9:59:43<20:33:15,  3.32it/s]
 34%|███▍      | 125685/371472 [9:59:43<19:42:35,  3.46it/s]
 34%|███▍      | 125686/371472 [9:59:43<20:06:58,  3.39it/s]
 34%|███▍      | 125687/371472 [9:59:44<20:55:10,  3.26it/s]
 34%|███▍      | 125688/371472 [9:59:44<19:23:02,  3.52it/s]
 34%|███▍      | 125689/371472 [9:59:44<19:24:54,  3.52it/s]
 34%|███▍      | 125690/371472 [9:59:44<19:19:57,  3.53it/s]
 34%|███▍      | 125691/371472 [9:59:45<18:54:40,  3.61it/s]
 34%|███▍      | 125692/371472 [9:59:45<18:32:40,  3.68it/s]
 34%|███▍      | 125693/371472 [9:59:45<18:27:19,  3.70it/s]
 34%|███▍      | 125694/371472 [9:59:46<19:29:43,  3.50it/s]
 34%|███▍      | 125695/371472 [9:59:46<19:07:56,  3.57it/s]
 34%|███▍      | 125696/371472 [9:59:46<18:30:11,  3.69it/s]
 34%|███▍      | 125697/371472 [9:59:46<18:12:05,  3.75it/s]
 34%|███▍      | 125698/371472 [9:59:47<18:21:59,  3.72it/s]
 34%|███▍      | 125699/371472 [9:59:47<17:54:41,  3.81it/s]
 34%|███▍      | 125700/371472 [9:59:47<18:33:03,  3.68it/s]
                                                            
{'loss': 3.2235, 'learning_rate': 6.95775603869939e-07, 'epoch': 5.41}

 34%|███▍      | 125700/371472 [9:59:47<18:33:03,  3.68it/s]
 34%|███▍      | 125701/371472 [9:59:47<18:11:55,  3.75it/s]
 34%|███▍      | 125702/371472 [9:59:48<20:08:46,  3.39it/s]
 34%|███▍      | 125703/371472 [9:59:48<19:43:40,  3.46it/s]
 34%|███▍      | 125704/371472 [9:59:48<19:16:03,  3.54it/s]
 34%|███▍      | 125705/371472 [9:59:49<18:36:32,  3.67it/s]
 34%|███▍      | 125706/371472 [9:59:49<18:40:51,  3.65it/s]
 34%|███▍      | 125707/371472 [9:59:49<18:22:37,  3.71it/s]
 34%|███▍      | 125708/371472 [9:59:50<22:27:30,  3.04it/s]
 34%|███▍      | 125709/371472 [9:59:50<20:49:38,  3.28it/s]
 34%|███▍      | 125710/371472 [9:59:50<20:31:52,  3.33it/s]
 34%|███▍      | 125711/371472 [9:59:50<19:36:19,  3.48it/s]
 34%|███▍      | 125712/371472 [9:59:51<19:42:57,  3.46it/s]
 34%|███▍      | 125713/371472 [9:59:51<19:24:49,  3.52it/s]
 34%|███▍      | 125714/371472 [9:59:51<19:03:40,  3.58it/s]
 34%|███▍      | 125715/371472 [9:59:51<18:28:03,  3.70it/s]
 34%|███▍      | 125716/371472 [9:59:52<18:12:48,  3.75it/s]
 34%|███▍      | 125717/371472 [9:59:52<17:42:11,  3.86it/s]
 34%|███▍      | 125718/371472 [9:59:52<19:49:04,  3.44it/s]
 34%|███▍      | 125719/371472 [9:59:53<19:44:55,  3.46it/s]
 34%|███▍      | 125720/371472 [9:59:53<18:58:00,  3.60it/s]
                                                            
{'loss': 3.3726, 'learning_rate': 6.957271218944601e-07, 'epoch': 5.41}

 34%|███▍      | 125720/371472 [9:59:53<18:58:00,  3.60it/s]
 34%|███▍      | 125721/371472 [9:59:53<18:59:06,  3.60it/s]
 34%|███▍      | 125722/371472 [9:59:53<18:58:09,  3.60it/s]
 34%|███▍      | 125723/371472 [9:59:54<18:43:10,  3.65it/s]
 34%|███▍      | 125724/371472 [9:59:54<18:25:24,  3.71it/s]
 34%|███▍      | 125725/371472 [9:59:54<19:22:17,  3.52it/s]
 34%|███▍      | 125726/371472 [9:59:55<19:22:54,  3.52it/s]
 34%|███▍      | 125727/371472 [9:59:55<18:38:03,  3.66it/s]
 34%|███▍      | 125728/371472 [9:59:55<18:53:25,  3.61it/s]
 34%|███▍      | 125729/371472 [9:59:55<18:20:00,  3.72it/s]
 34%|███▍      | 125730/371472 [9:59:56<17:27:53,  3.91it/s]
 34%|███▍      | 125731/371472 [9:59:56<18:55:47,  3.61it/s]
 34%|███▍      | 125732/371472 [9:59:56<18:29:32,  3.69it/s]
 34%|███▍      | 125733/371472 [9:59:56<18:29:11,  3.69it/s]
 34%|███▍      | 125734/371472 [9:59:57<18:31:45,  3.68it/s]
 34%|███▍      | 125735/371472 [9:59:57<20:01:21,  3.41it/s]
 34%|███▍      | 125736/371472 [9:59:57<20:16:08,  3.37it/s]
 34%|███▍      | 125737/371472 [9:59:58<19:20:49,  3.53it/s]
 34%|███▍      | 125738/371472 [9:59:58<19:36:30,  3.48it/s]
 34%|███▍      | 125739/371472 [9:59:58<19:37:21,  3.48it/s]
 34%|███▍      | 125740/371472 [9:59:58<19:30:35,  3.50it/s]
                                                            
{'loss': 3.2151, 'learning_rate': 6.956786399189812e-07, 'epoch': 5.42}

 34%|███▍      | 125740/371472 [9:59:58<19:30:35,  3.50it/s]
 34%|███▍      | 125741/371472 [9:59:59<21:04:28,  3.24it/s]
 34%|███▍      | 125742/371472 [9:59:59<22:02:19,  3.10it/s]
 34%|███▍      | 125743/371472 [9:59:59<20:41:26,  3.30it/s]
 34%|███▍      | 125744/371472 [10:00:00<19:21:45,  3.53it/s]
 34%|███▍      | 125745/371472 [10:00:00<19:06:48,  3.57it/s]
 34%|███▍      | 125746/371472 [10:00:00<18:22:47,  3.71it/s]
 34%|███▍      | 125747/371472 [10:00:00<17:42:59,  3.85it/s]
 34%|███▍      | 125748/371472 [10:00:01<19:40:42,  3.47it/s]
 34%|███▍      | 125749/371472 [10:00:01<19:37:31,  3.48it/s]
 34%|███▍      | 125750/371472 [10:00:01<19:33:00,  3.49it/s]
 34%|███▍      | 125751/371472 [10:00:02<19:22:07,  3.52it/s]
 34%|███▍      | 125752/371472 [10:00:02<18:47:05,  3.63it/s]
 34%|███▍      | 125753/371472 [10:00:02<18:06:42,  3.77it/s]
 34%|███▍      | 125754/371472 [10:00:02<18:17:26,  3.73it/s]
 34%|███▍      | 125755/371472 [10:00:03<18:33:00,  3.68it/s]
 34%|███▍      | 125756/371472 [10:00:03<18:36:55,  3.67it/s]
 34%|███▍      | 125757/371472 [10:00:03<17:44:59,  3.85it/s]
 34%|███▍      | 125758/371472 [10:00:03<17:45:14,  3.84it/s]
 34%|███▍      | 125759/371472 [10:00:04<19:44:12,  3.46it/s]
 34%|███▍      | 125760/371472 [10:00:04<20:23:21,  3.35it/s]
                                                             
{'loss': 3.1706, 'learning_rate': 6.956301579435022e-07, 'epoch': 5.42}

 34%|███▍      | 125760/371472 [10:00:04<20:23:21,  3.35it/s]
 34%|███▍      | 125761/371472 [10:00:04<19:49:42,  3.44it/s]
 34%|███▍      | 125762/371472 [10:00:05<19:21:52,  3.52it/s]
 34%|███▍      | 125763/371472 [10:00:05<19:27:02,  3.51it/s]
 34%|███▍      | 125764/371472 [10:00:05<18:43:24,  3.65it/s]
 34%|███▍      | 125765/371472 [10:00:05<18:47:26,  3.63it/s]
 34%|███▍      | 125766/371472 [10:00:06<18:40:51,  3.65it/s]
 34%|███▍      | 125767/371472 [10:00:06<18:48:38,  3.63it/s]
 34%|███▍      | 125768/371472 [10:00:06<19:32:35,  3.49it/s]
 34%|███▍      | 125769/371472 [10:00:07<18:36:44,  3.67it/s]
 34%|███▍      | 125770/371472 [10:00:07<19:23:04,  3.52it/s]
 34%|███▍      | 125771/371472 [10:00:07<21:15:39,  3.21it/s]
 34%|███▍      | 125772/371472 [10:00:08<21:34:08,  3.16it/s]
 34%|███▍      | 125773/371472 [10:00:08<20:13:57,  3.37it/s]
 34%|███▍      | 125774/371472 [10:00:08<19:38:24,  3.48it/s]
 34%|███▍      | 125775/371472 [10:00:08<19:47:20,  3.45it/s]
 34%|███▍      | 125776/371472 [10:00:09<19:53:53,  3.43it/s]
 34%|███▍      | 125777/371472 [10:00:09<19:43:54,  3.46it/s]
 34%|███▍      | 125778/371472 [10:00:09<18:41:18,  3.65it/s]
 34%|███▍      | 125779/371472 [10:00:09<17:57:21,  3.80it/s]
 34%|███▍      | 125780/371472 [10:00:10<18:33:14,  3.68it/s]
                                                             
{'loss': 3.3046, 'learning_rate': 6.955816759680234e-07, 'epoch': 5.42}

 34%|███▍      | 125780/371472 [10:00:10<18:33:14,  3.68it/s]
 34%|███▍      | 125781/371472 [10:00:10<18:16:50,  3.73it/s]
 34%|███▍      | 125782/371472 [10:00:10<18:55:44,  3.61it/s]
 34%|███▍      | 125783/371472 [10:00:11<21:04:23,  3.24it/s]
 34%|███▍      | 125784/371472 [10:00:11<19:53:03,  3.43it/s]
 34%|███▍      | 125785/371472 [10:00:11<19:09:25,  3.56it/s]
 34%|███▍      | 125786/371472 [10:00:11<18:26:05,  3.70it/s]
 34%|███▍      | 125787/371472 [10:00:12<18:34:45,  3.67it/s]
 34%|███▍      | 125788/371472 [10:00:12<18:39:25,  3.66it/s]
 34%|███▍      | 125789/371472 [10:00:12<18:05:48,  3.77it/s]
 34%|███▍      | 125790/371472 [10:00:13<18:32:15,  3.68it/s]
 34%|███▍      | 125791/371472 [10:00:13<18:02:27,  3.78it/s]
 34%|███▍      | 125792/371472 [10:00:13<17:42:57,  3.85it/s]
 34%|███▍      | 125793/371472 [10:00:13<17:40:15,  3.86it/s]
 34%|███▍      | 125794/371472 [10:00:14<17:34:20,  3.88it/s]
 34%|███▍      | 125795/371472 [10:00:14<18:02:06,  3.78it/s]
 34%|███▍      | 125796/371472 [10:00:14<17:49:52,  3.83it/s]
 34%|███▍      | 125797/371472 [10:00:14<17:42:05,  3.86it/s]
 34%|███▍      | 125798/371472 [10:00:15<17:53:47,  3.81it/s]
 34%|███▍      | 125799/371472 [10:00:15<17:59:10,  3.79it/s]
 34%|███▍      | 125800/371472 [10:00:15<18:22:50,  3.71it/s]
                                                             
{'loss': 3.2669, 'learning_rate': 6.955331939925446e-07, 'epoch': 5.42}

 34%|███▍      | 125800/371472 [10:00:15<18:22:50,  3.71it/s]
 34%|███▍      | 125801/371472 [10:00:15<17:55:15,  3.81it/s]
 34%|███▍      | 125802/371472 [10:00:16<17:42:04,  3.86it/s]
 34%|███▍      | 125803/371472 [10:00:16<17:21:30,  3.93it/s]
 34%|███▍      | 125804/371472 [10:00:16<17:53:22,  3.81it/s]
 34%|███▍      | 125805/371472 [10:00:16<18:01:52,  3.78it/s]
 34%|███▍      | 125806/371472 [10:00:17<17:40:43,  3.86it/s]
 34%|███▍      | 125807/371472 [10:00:17<17:49:10,  3.83it/s]
 34%|███▍      | 125808/371472 [10:00:17<18:21:34,  3.72it/s]
 34%|███▍      | 125809/371472 [10:00:18<19:14:38,  3.55it/s]
 34%|███▍      | 125810/371472 [10:00:18<18:25:23,  3.70it/s]
 34%|███▍      | 125811/371472 [10:00:18<17:50:14,  3.83it/s]
 34%|███▍      | 125812/371472 [10:00:18<18:01:58,  3.78it/s]
 34%|███▍      | 125813/371472 [10:00:19<18:14:07,  3.74it/s]
 34%|███▍      | 125814/371472 [10:00:19<17:41:50,  3.86it/s]
 34%|███▍      | 125815/371472 [10:00:19<17:06:49,  3.99it/s]
 34%|███▍      | 125816/371472 [10:00:19<16:59:20,  4.02it/s]
 34%|███▍      | 125817/371472 [10:00:20<18:08:30,  3.76it/s]
 34%|███▍      | 125818/371472 [10:00:20<17:53:01,  3.82it/s]
 34%|███▍      | 125819/371472 [10:00:20<18:01:00,  3.79it/s]
 34%|███▍      | 125820/371472 [10:00:20<18:02:11,  3.78it/s]
                                                             
{'loss': 3.2547, 'learning_rate': 6.954847120170657e-07, 'epoch': 5.42}

 34%|███▍      | 125820/371472 [10:00:20<18:02:11,  3.78it/s]
 34%|███▍      | 125821/371472 [10:00:21<18:07:58,  3.76it/s]
 34%|███▍      | 125822/371472 [10:00:21<17:58:32,  3.80it/s]
 34%|███▍      | 125823/371472 [10:00:21<18:08:55,  3.76it/s]
 34%|███▍      | 125824/371472 [10:00:21<17:44:27,  3.85it/s]
 34%|███▍      | 125825/371472 [10:00:22<18:00:08,  3.79it/s]
 34%|███▍      | 125826/371472 [10:00:22<18:23:21,  3.71it/s]
 34%|███▍      | 125827/371472 [10:00:22<18:08:53,  3.76it/s]
 34%|███▍      | 125828/371472 [10:00:23<19:20:27,  3.53it/s]
 34%|███▍      | 125829/371472 [10:00:23<19:21:43,  3.52it/s]
 34%|███▍      | 125830/371472 [10:00:23<18:31:46,  3.68it/s]
 34%|███▍      | 125831/371472 [10:00:23<19:11:54,  3.55it/s]
 34%|███▍      | 125832/371472 [10:00:24<18:43:59,  3.64it/s]
 34%|███▍      | 125833/371472 [10:00:24<19:00:18,  3.59it/s]
 34%|███▍      | 125834/371472 [10:00:24<19:05:04,  3.58it/s]
 34%|███▍      | 125835/371472 [10:00:25<18:58:22,  3.60it/s]
 34%|███▍      | 125836/371472 [10:00:25<19:19:35,  3.53it/s]
 34%|███▍      | 125837/371472 [10:00:25<19:07:36,  3.57it/s]
 34%|███▍      | 125838/371472 [10:00:25<18:30:42,  3.69it/s]
 34%|███▍      | 125839/371472 [10:00:26<18:46:48,  3.63it/s]
 34%|███▍      | 125840/371472 [10:00:26<19:01:20,  3.59it/s]
                                                             
{'loss': 3.2823, 'learning_rate': 6.954362300415866e-07, 'epoch': 5.42}

 34%|███▍      | 125840/371472 [10:00:26<19:01:20,  3.59it/s]
 34%|███▍      | 125841/371472 [10:00:26<19:49:45,  3.44it/s]
 34%|███▍      | 125842/371472 [10:00:27<20:30:58,  3.33it/s]
 34%|███▍      | 125843/371472 [10:00:27<20:05:26,  3.40it/s]
 34%|███▍      | 125844/371472 [10:00:27<19:35:35,  3.48it/s]
 34%|███▍      | 125845/371472 [10:00:27<19:12:41,  3.55it/s]
 34%|███▍      | 125846/371472 [10:00:28<18:47:37,  3.63it/s]
 34%|███▍      | 125847/371472 [10:00:28<19:26:00,  3.51it/s]
 34%|███▍      | 125848/371472 [10:00:28<19:33:44,  3.49it/s]
 34%|███▍      | 125849/371472 [10:00:29<21:30:56,  3.17it/s]
 34%|███▍      | 125850/371472 [10:00:29<20:37:42,  3.31it/s]
 34%|███▍      | 125851/371472 [10:00:29<20:11:53,  3.38it/s]
 34%|███▍      | 125852/371472 [10:00:29<19:29:51,  3.50it/s]
 34%|███▍      | 125853/371472 [10:00:30<19:24:26,  3.52it/s]
 34%|███▍      | 125854/371472 [10:00:30<19:11:31,  3.55it/s]
 34%|███▍      | 125855/371472 [10:00:30<20:15:16,  3.37it/s]
 34%|███▍      | 125856/371472 [10:00:31<21:14:08,  3.21it/s]
 34%|███▍      | 125857/371472 [10:00:31<20:40:52,  3.30it/s]
 34%|███▍      | 125858/371472 [10:00:31<20:12:21,  3.38it/s]
 34%|███▍      | 125859/371472 [10:00:32<20:47:26,  3.28it/s]
 34%|███▍      | 125860/371472 [10:00:32<20:07:11,  3.39it/s]
                                                             
{'loss': 3.2155, 'learning_rate': 6.953877480661078e-07, 'epoch': 5.42}

 34%|███▍      | 125860/371472 [10:00:32<20:07:11,  3.39it/s]
 34%|███▍      | 125861/371472 [10:00:32<19:37:51,  3.48it/s]
 34%|███▍      | 125862/371472 [10:00:32<18:49:10,  3.63it/s]
 34%|███▍      | 125863/371472 [10:00:33<18:52:03,  3.62it/s]
 34%|███▍      | 125864/371472 [10:00:33<18:23:57,  3.71it/s]
 34%|███▍      | 125865/371472 [10:00:33<19:45:07,  3.45it/s]
 34%|███▍      | 125866/371472 [10:00:33<18:48:58,  3.63it/s]
 34%|███▍      | 125867/371472 [10:00:34<19:58:47,  3.41it/s]
 34%|███▍      | 125868/371472 [10:00:34<18:54:37,  3.61it/s]
 34%|███▍      | 125869/371472 [10:00:34<18:37:57,  3.66it/s]
 34%|███▍      | 125870/371472 [10:00:35<18:27:27,  3.70it/s]
 34%|███▍      | 125871/371472 [10:00:35<18:24:20,  3.71it/s]
 34%|███▍      | 125872/371472 [10:00:35<17:53:33,  3.81it/s]
 34%|███▍      | 125873/371472 [10:00:35<18:06:42,  3.77it/s]
 34%|███▍      | 125874/371472 [10:00:36<18:44:58,  3.64it/s]
 34%|███▍      | 125875/371472 [10:00:36<19:23:58,  3.52it/s]
 34%|███▍      | 125876/371472 [10:00:36<18:35:02,  3.67it/s]
 34%|███▍      | 125877/371472 [10:00:36<18:23:03,  3.71it/s]
 34%|███▍      | 125878/371472 [10:00:37<17:55:35,  3.81it/s]
 34%|███▍      | 125879/371472 [10:00:37<17:28:57,  3.90it/s]
 34%|███▍      | 125880/371472 [10:00:37<17:24:47,  3.92it/s]
                                                             
{'loss': 3.4131, 'learning_rate': 6.95339266090629e-07, 'epoch': 5.42}

 34%|███▍      | 125880/371472 [10:00:37<17:24:47,  3.92it/s]
 34%|███▍      | 125881/371472 [10:00:37<17:18:48,  3.94it/s]
 34%|███▍      | 125882/371472 [10:00:38<17:44:18,  3.85it/s]
 34%|███▍      | 125883/371472 [10:00:38<18:09:49,  3.76it/s]
 34%|███▍      | 125884/371472 [10:00:38<18:46:33,  3.63it/s]
 34%|███▍      | 125885/371472 [10:00:39<19:01:29,  3.59it/s]
 34%|███▍      | 125886/371472 [10:00:39<19:08:16,  3.56it/s]
 34%|███▍      | 125887/371472 [10:00:39<18:58:18,  3.60it/s]
 34%|███▍      | 125888/371472 [10:00:39<18:32:39,  3.68it/s]
 34%|███▍      | 125889/371472 [10:00:40<19:07:17,  3.57it/s]
 34%|███▍      | 125890/371472 [10:00:40<18:59:49,  3.59it/s]
 34%|███▍      | 125891/371472 [10:00:40<18:16:22,  3.73it/s]
 34%|███▍      | 125892/371472 [10:00:40<18:00:13,  3.79it/s]
 34%|███▍      | 125893/371472 [10:00:41<19:21:01,  3.53it/s]
 34%|███▍      | 125894/371472 [10:00:41<18:54:54,  3.61it/s]
 34%|███▍      | 125895/371472 [10:00:41<18:55:02,  3.61it/s]
 34%|███▍      | 125896/371472 [10:00:42<19:20:22,  3.53it/s]
 34%|███▍      | 125897/371472 [10:00:42<18:48:06,  3.63it/s]
 34%|███▍      | 125898/371472 [10:00:42<18:24:11,  3.71it/s]
 34%|███▍      | 125899/371472 [10:00:42<19:13:07,  3.55it/s]
 34%|███▍      | 125900/371472 [10:00:43<18:50:03,  3.62it/s]
                                                             
{'loss': 3.2091, 'learning_rate': 6.952907841151501e-07, 'epoch': 5.42}

 34%|███▍      | 125900/371472 [10:00:43<18:50:03,  3.62it/s]
 34%|███▍      | 125901/371472 [10:00:43<19:25:04,  3.51it/s]
 34%|███▍      | 125902/371472 [10:00:43<18:22:15,  3.71it/s]
 34%|███▍      | 125903/371472 [10:00:44<20:01:07,  3.41it/s]
 34%|███▍      | 125904/371472 [10:00:44<20:44:46,  3.29it/s]
 34%|███▍      | 125905/371472 [10:00:44<22:24:53,  3.04it/s]
 34%|███▍      | 125906/371472 [10:00:45<22:01:21,  3.10it/s]
 34%|███▍      | 125907/371472 [10:00:45<20:55:07,  3.26it/s]
 34%|███▍      | 125908/371472 [10:00:45<19:24:51,  3.51it/s]
 34%|███▍      | 125909/371472 [10:00:46<27:41:04,  2.46it/s]
 34%|███▍      | 125910/371472 [10:00:46<25:07:36,  2.71it/s]
 34%|███▍      | 125911/371472 [10:00:46<23:01:24,  2.96it/s]
 34%|███▍      | 125912/371472 [10:00:47<21:40:18,  3.15it/s]
 34%|███▍      | 125913/371472 [10:00:47<21:23:04,  3.19it/s]
 34%|███▍      | 125914/371472 [10:00:47<20:48:41,  3.28it/s]
 34%|███▍      | 125915/371472 [10:00:47<20:09:57,  3.38it/s]
 34%|███▍      | 125916/371472 [10:00:48<19:07:06,  3.57it/s]
 34%|███▍      | 125917/371472 [10:00:48<20:31:22,  3.32it/s]
 34%|███▍      | 125918/371472 [10:00:48<20:12:41,  3.37it/s]
 34%|███▍      | 125919/371472 [10:00:49<19:37:53,  3.47it/s]
 34%|███▍      | 125920/371472 [10:00:49<19:20:02,  3.53it/s]
                                                             
{'loss': 3.246, 'learning_rate': 6.952423021396711e-07, 'epoch': 5.42}

 34%|███▍      | 125920/371472 [10:00:49<19:20:02,  3.53it/s]
 34%|███▍      | 125921/371472 [10:00:49<21:47:59,  3.13it/s]
 34%|███▍      | 125922/371472 [10:00:50<21:21:55,  3.19it/s]
 34%|███▍      | 125923/371472 [10:00:50<20:32:40,  3.32it/s]
 34%|███▍      | 125924/371472 [10:00:50<20:00:59,  3.41it/s]
 34%|███▍      | 125925/371472 [10:00:50<19:10:50,  3.56it/s]
 34%|███▍      | 125926/371472 [10:00:51<19:12:47,  3.55it/s]
 34%|███▍      | 125927/371472 [10:00:51<19:41:21,  3.46it/s]
 34%|███▍      | 125928/371472 [10:00:51<19:05:50,  3.57it/s]
 34%|███▍      | 125929/371472 [10:00:51<18:14:00,  3.74it/s]
 34%|███▍      | 125930/371472 [10:00:52<17:55:20,  3.81it/s]
 34%|███▍      | 125931/371472 [10:00:52<19:57:43,  3.42it/s]
 34%|███▍      | 125932/371472 [10:00:52<21:17:21,  3.20it/s]
 34%|███▍      | 125933/371472 [10:00:53<19:56:18,  3.42it/s]
 34%|███▍      | 125934/371472 [10:00:53<20:17:07,  3.36it/s]
 34%|███▍      | 125935/371472 [10:00:53<20:53:26,  3.26it/s]
 34%|███▍      | 125936/371472 [10:00:54<21:58:11,  3.10it/s]
 34%|███▍      | 125937/371472 [10:00:54<20:39:56,  3.30it/s]
 34%|███▍      | 125938/371472 [10:00:54<20:14:38,  3.37it/s]
 34%|███▍      | 125939/371472 [10:00:55<21:04:41,  3.24it/s]
 34%|███▍      | 125940/371472 [10:00:55<20:29:26,  3.33it/s]
                                                             
{'loss': 3.0609, 'learning_rate': 6.951938201641924e-07, 'epoch': 5.42}

 34%|███▍      | 125940/371472 [10:00:55<20:29:26,  3.33it/s]
 34%|███▍      | 125941/371472 [10:00:55<20:16:26,  3.36it/s]
 34%|███▍      | 125942/371472 [10:00:55<19:43:15,  3.46it/s]
 34%|███▍      | 125943/371472 [10:00:56<19:32:45,  3.49it/s]
 34%|███▍      | 125944/371472 [10:00:56<20:38:32,  3.30it/s]
 34%|███▍      | 125945/371472 [10:00:56<21:03:17,  3.24it/s]
 34%|███▍      | 125946/371472 [10:00:57<20:50:32,  3.27it/s]
 34%|███▍      | 125947/371472 [10:00:57<20:11:59,  3.38it/s]
 34%|███▍      | 125948/371472 [10:00:57<19:40:46,  3.47it/s]
 34%|███▍      | 125949/371472 [10:00:57<19:04:11,  3.58it/s]
 34%|███▍      | 125950/371472 [10:00:58<18:50:32,  3.62it/s]
 34%|███▍      | 125951/371472 [10:00:58<19:02:19,  3.58it/s]
 34%|███▍      | 125952/371472 [10:00:58<19:11:48,  3.55it/s]
 34%|███▍      | 125953/371472 [10:00:59<18:40:47,  3.65it/s]
 34%|███▍      | 125954/371472 [10:00:59<19:31:50,  3.49it/s]
 34%|███▍      | 125955/371472 [10:00:59<18:55:42,  3.60it/s]
 34%|███▍      | 125956/371472 [10:00:59<19:14:59,  3.54it/s]
 34%|███▍      | 125957/371472 [10:01:00<18:44:46,  3.64it/s]
 34%|███▍      | 125958/371472 [10:01:00<19:39:23,  3.47it/s]
 34%|███▍      | 125959/371472 [10:01:00<19:22:34,  3.52it/s]
 34%|███▍      | 125960/371472 [10:01:01<18:48:54,  3.62it/s]
                                                             
{'loss': 3.3931, 'learning_rate': 6.951453381887134e-07, 'epoch': 5.43}

 34%|███▍      | 125960/371472 [10:01:01<18:48:54,  3.62it/s]
 34%|███▍      | 125961/371472 [10:01:01<18:30:48,  3.68it/s]
 34%|███▍      | 125962/371472 [10:01:01<18:24:19,  3.71it/s]
 34%|███▍      | 125963/371472 [10:01:01<18:22:12,  3.71it/s]
 34%|███▍      | 125964/371472 [10:01:02<18:08:15,  3.76it/s]
 34%|███▍      | 125965/371472 [10:01:02<17:42:07,  3.85it/s]
 34%|███▍      | 125966/371472 [10:01:02<17:45:25,  3.84it/s]
 34%|███▍      | 125967/371472 [10:01:02<18:01:22,  3.78it/s]
 34%|███▍      | 125968/371472 [10:01:03<18:58:16,  3.59it/s]
 34%|███▍      | 125969/371472 [10:01:03<19:14:31,  3.54it/s]
 34%|███▍      | 125970/371472 [10:01:03<20:37:58,  3.31it/s]
 34%|███▍      | 125971/371472 [10:01:04<19:47:23,  3.45it/s]
 34%|███▍      | 125972/371472 [10:01:04<18:49:28,  3.62it/s]
 34%|███▍      | 125973/371472 [10:01:04<18:41:23,  3.65it/s]
 34%|███▍      | 125974/371472 [10:01:04<18:40:57,  3.65it/s]
 34%|███▍      | 125975/371472 [10:01:05<18:23:09,  3.71it/s]
 34%|███▍      | 125976/371472 [10:01:05<18:48:12,  3.63it/s]
 34%|███▍      | 125977/371472 [10:01:05<20:09:13,  3.38it/s]
 34%|███▍      | 125978/371472 [10:01:06<20:06:00,  3.39it/s]
 34%|███▍      | 125979/371472 [10:01:06<20:21:03,  3.35it/s]
 34%|███▍      | 125980/371472 [10:01:06<21:01:37,  3.24it/s]
                                                             
{'loss': 3.1498, 'learning_rate': 6.950968562132345e-07, 'epoch': 5.43}

 34%|███▍      | 125980/371472 [10:01:06<21:01:37,  3.24it/s]
 34%|███▍      | 125981/371472 [10:01:06<20:29:11,  3.33it/s]
 34%|███▍      | 125982/371472 [10:01:07<19:33:07,  3.49it/s]
 34%|███▍      | 125983/371472 [10:01:07<18:40:50,  3.65it/s]
 34%|███▍      | 125984/371472 [10:01:07<19:55:24,  3.42it/s]
 34%|███▍      | 125985/371472 [10:01:08<18:43:21,  3.64it/s]
 34%|███▍      | 125986/371472 [10:01:08<18:40:09,  3.65it/s]
 34%|███▍      | 125987/371472 [10:01:08<20:09:26,  3.38it/s]
 34%|███▍      | 125988/371472 [10:01:08<20:38:09,  3.30it/s]
 34%|███▍      | 125989/371472 [10:01:09<19:46:38,  3.45it/s]
 34%|███▍      | 125990/371472 [10:01:09<19:29:37,  3.50it/s]
 34%|███▍      | 125991/371472 [10:01:09<18:35:39,  3.67it/s]
 34%|███▍      | 125992/371472 [10:01:10<18:22:53,  3.71it/s]
 34%|███▍      | 125993/371472 [10:01:10<20:42:21,  3.29it/s]
 34%|███▍      | 125994/371472 [10:01:10<20:02:16,  3.40it/s]
 34%|███▍      | 125995/371472 [10:01:10<19:21:58,  3.52it/s]
 34%|███▍      | 125996/371472 [10:01:11<19:24:04,  3.51it/s]
 34%|███▍      | 125997/371472 [10:01:11<18:48:14,  3.63it/s]
 34%|███▍      | 125998/371472 [10:01:11<18:25:43,  3.70it/s]
 34%|███▍      | 125999/371472 [10:01:12<19:31:25,  3.49it/s]
 34%|███▍      | 126000/371472 [10:01:12<18:37:47,  3.66it/s]
                                                             
{'loss': 3.2485, 'learning_rate': 6.950483742377555e-07, 'epoch': 5.43}

 34%|███▍      | 126000/371472 [10:01:12<18:37:47,  3.66it/s]
 34%|███▍      | 126001/371472 [10:01:12<17:56:24,  3.80it/s]
 34%|███▍      | 126002/371472 [10:01:12<17:30:42,  3.89it/s]
 34%|███▍      | 126003/371472 [10:01:13<17:15:54,  3.95it/s]
 34%|███▍      | 126004/371472 [10:01:13<18:39:35,  3.65it/s]
 34%|███▍      | 126005/371472 [10:01:13<20:06:00,  3.39it/s]
 34%|███▍      | 126006/371472 [10:01:14<21:36:54,  3.15it/s]
 34%|███▍      | 126007/371472 [10:01:14<20:42:34,  3.29it/s]
 34%|███▍      | 126008/371472 [10:01:14<20:13:56,  3.37it/s]
 34%|███▍      | 126009/371472 [10:01:14<19:16:08,  3.54it/s]
 34%|███▍      | 126010/371472 [10:01:15<19:35:48,  3.48it/s]
 34%|███▍      | 126011/371472 [10:01:15<22:27:24,  3.04it/s]
 34%|███▍      | 126012/371472 [10:01:15<20:32:26,  3.32it/s]
 34%|███▍      | 126013/371472 [10:01:16<20:03:35,  3.40it/s]
 34%|███▍      | 126014/371472 [10:01:16<19:28:02,  3.50it/s]
 34%|███▍      | 126015/371472 [10:01:16<19:20:19,  3.53it/s]
 34%|███▍      | 126016/371472 [10:01:16<19:51:19,  3.43it/s]
 34%|███▍      | 126017/371472 [10:01:17<18:47:08,  3.63it/s]
 34%|███▍      | 126018/371472 [10:01:17<19:22:36,  3.52it/s]
 34%|███▍      | 126019/371472 [10:01:17<19:21:35,  3.52it/s]
 34%|███▍      | 126020/371472 [10:01:18<19:21:16,  3.52it/s]
                                                             
{'loss': 3.2079, 'learning_rate': 6.949998922622767e-07, 'epoch': 5.43}

 34%|███▍      | 126020/371472 [10:01:18<19:21:16,  3.52it/s]
 34%|███▍      | 126021/371472 [10:01:18<20:25:34,  3.34it/s]
 34%|███▍      | 126022/371472 [10:01:18<20:25:54,  3.34it/s]
 34%|███▍      | 126023/371472 [10:01:18<20:02:35,  3.40it/s]
 34%|███▍      | 126024/371472 [10:01:19<19:03:14,  3.58it/s]
 34%|███▍      | 126025/371472 [10:01:19<17:58:08,  3.79it/s]
 34%|███▍      | 126026/371472 [10:01:19<18:06:29,  3.77it/s]
 34%|███▍      | 126027/371472 [10:01:20<19:05:20,  3.57it/s]
 34%|███▍      | 126028/371472 [10:01:20<18:39:00,  3.66it/s]
 34%|███▍      | 126029/371472 [10:01:20<18:27:21,  3.69it/s]
 34%|███▍      | 126030/371472 [10:01:20<19:22:22,  3.52it/s]
 34%|███▍      | 126031/371472 [10:01:21<19:12:51,  3.55it/s]
 34%|███▍      | 126032/371472 [10:01:21<18:36:09,  3.66it/s]
 34%|███▍      | 126033/371472 [10:01:21<19:59:41,  3.41it/s]
 34%|███▍      | 126034/371472 [10:01:22<19:47:39,  3.44it/s]
 34%|███▍      | 126035/371472 [10:01:22<18:54:23,  3.61it/s]
 34%|███▍      | 126036/371472 [10:01:22<20:46:18,  3.28it/s]
 34%|███▍      | 126037/371472 [10:01:22<20:17:59,  3.36it/s]
 34%|███▍      | 126038/371472 [10:01:23<19:26:42,  3.51it/s]
 34%|███▍      | 126039/371472 [10:01:23<20:51:48,  3.27it/s]
 34%|███▍      | 126040/371472 [10:01:23<20:29:47,  3.33it/s]
                                                             
{'loss': 3.3722, 'learning_rate': 6.949514102867978e-07, 'epoch': 5.43}

 34%|███▍      | 126040/371472 [10:01:23<20:29:47,  3.33it/s]
 34%|███▍      | 126041/371472 [10:01:24<19:20:10,  3.53it/s]
 34%|███▍      | 126042/371472 [10:01:24<19:12:20,  3.55it/s]
 34%|███▍      | 126043/371472 [10:01:24<19:07:29,  3.56it/s]
 34%|███▍      | 126044/371472 [10:01:24<20:16:48,  3.36it/s]
 34%|███▍      | 126045/371472 [10:01:25<19:20:28,  3.52it/s]
 34%|███▍      | 126046/371472 [10:01:25<18:53:40,  3.61it/s]
 34%|███▍      | 126047/371472 [10:01:25<18:33:12,  3.67it/s]
 34%|███▍      | 126048/371472 [10:01:25<17:55:38,  3.80it/s]
 34%|███▍      | 126049/371472 [10:01:26<18:26:50,  3.70it/s]
 34%|███▍      | 126050/371472 [10:01:26<17:59:46,  3.79it/s]
 34%|███▍      | 126051/371472 [10:01:26<17:25:19,  3.91it/s]
 34%|███▍      | 126052/371472 [10:01:27<18:11:23,  3.75it/s]
 34%|███▍      | 126053/371472 [10:01:27<18:47:10,  3.63it/s]
 34%|███▍      | 126054/371472 [10:01:27<18:01:19,  3.78it/s]
 34%|███▍      | 126055/371472 [10:01:27<17:28:23,  3.90it/s]
 34%|███▍      | 126056/371472 [10:01:28<18:30:45,  3.68it/s]
 34%|███▍      | 126057/371472 [10:01:28<19:14:30,  3.54it/s]
 34%|███▍      | 126058/371472 [10:01:28<20:08:00,  3.39it/s]
 34%|███▍      | 126059/371472 [10:01:29<19:06:30,  3.57it/s]
 34%|███▍      | 126060/371472 [10:01:29<18:22:37,  3.71it/s]
                                                             
{'loss': 2.9532, 'learning_rate': 6.949029283113188e-07, 'epoch': 5.43}

 34%|███▍      | 126060/371472 [10:01:29<18:22:37,  3.71it/s]
 34%|███▍      | 126061/371472 [10:01:29<17:47:42,  3.83it/s]
 34%|███▍      | 126062/371472 [10:01:29<17:34:19,  3.88it/s]
 34%|███▍      | 126063/371472 [10:01:30<17:29:15,  3.90it/s]
 34%|███▍      | 126064/371472 [10:01:30<18:13:52,  3.74it/s]
 34%|███▍      | 126065/371472 [10:01:30<18:45:03,  3.64it/s]
 34%|███▍      | 126066/371472 [10:01:30<19:11:39,  3.55it/s]
 34%|███▍      | 126067/371472 [10:01:31<18:51:18,  3.62it/s]
 34%|███▍      | 126068/371472 [10:01:31<18:43:18,  3.64it/s]
 34%|███▍      | 126069/371472 [10:01:31<18:37:37,  3.66it/s]
 34%|███▍      | 126070/371472 [10:01:31<18:01:07,  3.78it/s]
 34%|███▍      | 126071/371472 [10:01:32<17:18:59,  3.94it/s]
 34%|███▍      | 126072/371472 [10:01:32<17:02:06,  4.00it/s]
 34%|███▍      | 126073/371472 [10:01:32<17:01:35,  4.00it/s]
 34%|███▍      | 126074/371472 [10:01:32<17:58:23,  3.79it/s]
 34%|███▍      | 126075/371472 [10:01:33<17:46:49,  3.83it/s]
 34%|███▍      | 126076/371472 [10:01:33<17:56:35,  3.80it/s]
 34%|███▍      | 126077/371472 [10:01:33<17:59:20,  3.79it/s]
 34%|███▍      | 126078/371472 [10:01:34<18:59:44,  3.59it/s]
 34%|███▍      | 126079/371472 [10:01:34<20:03:01,  3.40it/s]
 34%|███▍      | 126080/371472 [10:01:34<20:15:09,  3.37it/s]
                                                             
{'loss': 3.3179, 'learning_rate': 6.9485444633584e-07, 'epoch': 5.43}

 34%|███▍      | 126080/371472 [10:01:34<20:15:09,  3.37it/s]
 34%|███▍      | 126081/371472 [10:01:34<19:52:13,  3.43it/s]
 34%|███▍      | 126082/371472 [10:01:35<20:02:33,  3.40it/s]
 34%|███▍      | 126083/371472 [10:01:35<19:24:59,  3.51it/s]
 34%|███▍      | 126084/371472 [10:01:35<19:17:30,  3.53it/s]
 34%|███▍      | 126085/371472 [10:01:36<18:41:58,  3.65it/s]
 34%|███▍      | 126086/371472 [10:01:36<19:32:38,  3.49it/s]
 34%|███▍      | 126087/371472 [10:01:36<18:50:08,  3.62it/s]
 34%|███▍      | 126088/371472 [10:01:36<20:13:37,  3.37it/s]
 34%|███▍      | 126089/371472 [10:01:37<19:47:18,  3.44it/s]
 34%|███▍      | 126090/371472 [10:01:37<19:14:18,  3.54it/s]
 34%|███▍      | 126091/371472 [10:01:37<19:27:26,  3.50it/s]
 34%|███▍      | 126092/371472 [10:01:38<19:23:54,  3.51it/s]
 34%|███▍      | 126093/371472 [10:01:38<20:01:59,  3.40it/s]
 34%|███▍      | 126094/371472 [10:01:38<19:28:29,  3.50it/s]
 34%|███▍      | 126095/371472 [10:01:38<19:25:38,  3.51it/s]
 34%|███▍      | 126096/371472 [10:01:39<19:13:41,  3.54it/s]
 34%|███▍      | 126097/371472 [10:01:39<19:21:45,  3.52it/s]
 34%|███▍      | 126098/371472 [10:01:39<21:26:21,  3.18it/s]
 34%|███▍      | 126099/371472 [10:01:40<20:51:11,  3.27it/s]
 34%|███▍      | 126100/371472 [10:01:40<19:47:48,  3.44it/s]
                                                             
{'loss': 3.17, 'learning_rate': 6.948059643603611e-07, 'epoch': 5.43}

 34%|███▍      | 126100/371472 [10:01:40<19:47:48,  3.44it/s]
 34%|███▍      | 126101/371472 [10:01:40<19:57:49,  3.41it/s]
 34%|███▍      | 126102/371472 [10:01:41<19:21:31,  3.52it/s]
 34%|███▍      | 126103/371472 [10:01:41<18:53:19,  3.61it/s]
 34%|███▍      | 126104/371472 [10:01:41<18:49:37,  3.62it/s]
 34%|███▍      | 126105/371472 [10:01:41<19:43:03,  3.46it/s]
 34%|███▍      | 126106/371472 [10:01:42<20:23:39,  3.34it/s]
 34%|███▍      | 126107/371472 [10:01:42<20:48:25,  3.28it/s]
 34%|███▍      | 126108/371472 [10:01:42<20:28:31,  3.33it/s]
 34%|███▍      | 126109/371472 [10:01:43<20:39:32,  3.30it/s]
 34%|███▍      | 126110/371472 [10:01:43<20:00:35,  3.41it/s]
 34%|███▍      | 126111/371472 [10:01:43<19:19:35,  3.53it/s]
 34%|███▍      | 126112/371472 [10:01:43<19:15:29,  3.54it/s]
 34%|███▍      | 126113/371472 [10:01:44<19:38:10,  3.47it/s]
 34%|███▍      | 126114/371472 [10:01:44<21:53:43,  3.11it/s]
 34%|███▍      | 126115/371472 [10:01:44<20:55:23,  3.26it/s]
 34%|███▍      | 126116/371472 [10:01:45<20:07:22,  3.39it/s]
 34%|███▍      | 126117/371472 [10:01:45<20:03:04,  3.40it/s]
 34%|███▍      | 126118/371472 [10:01:45<20:52:03,  3.27it/s]
 34%|███▍      | 126119/371472 [10:01:46<20:37:17,  3.30it/s]
 34%|███▍      | 126120/371472 [10:01:46<19:30:34,  3.49it/s]
                                                             
{'loss': 3.083, 'learning_rate': 6.947574823848822e-07, 'epoch': 5.43}

 34%|███▍      | 126120/371472 [10:01:46<19:30:34,  3.49it/s]
 34%|███▍      | 126121/371472 [10:01:46<19:28:28,  3.50it/s]
 34%|███▍      | 126122/371472 [10:01:46<18:38:30,  3.66it/s]
 34%|███▍      | 126123/371472 [10:01:47<19:18:55,  3.53it/s]
 34%|███▍      | 126124/371472 [10:01:47<18:13:58,  3.74it/s]
 34%|███▍      | 126125/371472 [10:01:47<18:30:26,  3.68it/s]
 34%|███▍      | 126126/371472 [10:01:47<18:59:47,  3.59it/s]
 34%|███▍      | 126127/371472 [10:01:48<20:32:27,  3.32it/s]
 34%|███▍      | 126128/371472 [10:01:48<19:54:00,  3.42it/s]
 34%|███▍      | 126129/371472 [10:01:48<21:24:31,  3.18it/s]
 34%|███▍      | 126130/371472 [10:01:49<21:40:02,  3.15it/s]
 34%|███▍      | 126131/371472 [10:01:49<21:30:30,  3.17it/s]
 34%|███▍      | 126132/371472 [10:01:49<20:53:58,  3.26it/s]
 34%|███▍      | 126133/371472 [10:01:50<21:00:00,  3.25it/s]
 34%|███▍      | 126134/371472 [10:01:50<20:01:39,  3.40it/s]
 34%|███▍      | 126135/371472 [10:01:50<19:43:52,  3.45it/s]
 34%|███▍      | 126136/371472 [10:01:50<18:47:41,  3.63it/s]
 34%|███▍      | 126137/371472 [10:01:51<18:24:04,  3.70it/s]
 34%|███▍      | 126138/371472 [10:01:51<18:37:25,  3.66it/s]
 34%|███▍      | 126139/371472 [10:01:51<18:53:37,  3.61it/s]
 34%|███▍      | 126140/371472 [10:01:52<19:22:12,  3.52it/s]
                                                             
{'loss': 3.2787, 'learning_rate': 6.947090004094032e-07, 'epoch': 5.43}

 34%|███▍      | 126140/371472 [10:01:52<19:22:12,  3.52it/s]
 34%|███▍      | 126141/371472 [10:01:52<19:40:44,  3.46it/s]
 34%|███▍      | 126142/371472 [10:01:52<19:43:23,  3.46it/s]
 34%|███▍      | 126143/371472 [10:01:53<21:17:24,  3.20it/s]
 34%|███▍      | 126144/371472 [10:01:53<19:59:40,  3.41it/s]
 34%|███▍      | 126145/371472 [10:01:53<19:09:30,  3.56it/s]
 34%|███▍      | 126146/371472 [10:01:53<18:47:15,  3.63it/s]
 34%|███▍      | 126147/371472 [10:01:54<20:32:24,  3.32it/s]
 34%|███▍      | 126148/371472 [10:01:54<19:34:28,  3.48it/s]
 34%|███▍      | 126149/371472 [10:01:54<20:54:35,  3.26it/s]
 34%|███▍      | 126150/371472 [10:01:55<19:48:08,  3.44it/s]
 34%|███▍      | 126151/371472 [10:01:55<18:57:26,  3.59it/s]
 34%|███▍      | 126152/371472 [10:01:55<18:34:04,  3.67it/s]
 34%|███▍      | 126153/371472 [10:01:55<20:38:33,  3.30it/s]
 34%|███▍      | 126154/371472 [10:01:56<19:14:44,  3.54it/s]
 34%|███▍      | 126155/371472 [10:01:56<18:12:54,  3.74it/s]
 34%|███▍      | 126156/371472 [10:01:56<18:35:42,  3.66it/s]
 34%|███▍      | 126157/371472 [10:01:56<19:17:58,  3.53it/s]
 34%|███▍      | 126158/371472 [10:01:57<18:52:40,  3.61it/s]
 34%|███▍      | 126159/371472 [10:01:57<18:14:17,  3.74it/s]
 34%|███▍      | 126160/371472 [10:01:57<18:06:11,  3.76it/s]
                                                             
{'loss': 3.1984, 'learning_rate': 6.946605184339244e-07, 'epoch': 5.43}

 34%|███▍      | 126160/371472 [10:01:57<18:06:11,  3.76it/s]
 34%|███▍      | 126161/371472 [10:01:58<19:48:20,  3.44it/s]
 34%|███▍      | 126162/371472 [10:01:58<18:58:37,  3.59it/s]
 34%|███▍      | 126163/371472 [10:01:58<19:35:08,  3.48it/s]
 34%|███▍      | 126164/371472 [10:01:58<18:50:59,  3.61it/s]
 34%|███▍      | 126165/371472 [10:01:59<17:52:06,  3.81it/s]
 34%|███▍      | 126166/371472 [10:01:59<20:51:35,  3.27it/s]
 34%|███▍      | 126167/371472 [10:01:59<22:04:38,  3.09it/s]
 34%|███▍      | 126168/371472 [10:02:00<21:47:51,  3.13it/s]
 34%|███▍      | 126169/371472 [10:02:00<20:32:46,  3.32it/s]
 34%|███▍      | 126170/371472 [10:02:00<19:07:57,  3.56it/s]
 34%|███▍      | 126171/371472 [10:02:00<18:55:31,  3.60it/s]
 34%|███▍      | 126172/371472 [10:02:01<18:20:01,  3.72it/s]
 34%|███▍      | 126173/371472 [10:02:01<18:40:33,  3.65it/s]
 34%|███▍      | 126174/371472 [10:02:01<18:12:14,  3.74it/s]
 34%|███▍      | 126175/371472 [10:02:02<18:12:49,  3.74it/s]
 34%|███▍      | 126176/371472 [10:02:02<18:00:10,  3.78it/s]
 34%|███▍      | 126177/371472 [10:02:02<17:42:31,  3.85it/s]
 34%|███▍      | 126178/371472 [10:02:02<18:54:22,  3.60it/s]
 34%|███▍      | 126179/371472 [10:02:03<18:26:45,  3.69it/s]
 34%|███▍      | 126180/371472 [10:02:03<19:03:49,  3.57it/s]
                                                             
{'loss': 3.236, 'learning_rate': 6.946120364584456e-07, 'epoch': 5.43}

 34%|███▍      | 126180/371472 [10:02:03<19:03:49,  3.57it/s]
 34%|███▍      | 126181/371472 [10:02:03<19:09:08,  3.56it/s]
 34%|███▍      | 126182/371472 [10:02:03<18:19:24,  3.72it/s]
 34%|███▍      | 126183/371472 [10:02:04<17:38:44,  3.86it/s]
 34%|███▍      | 126184/371472 [10:02:04<19:57:33,  3.41it/s]
 34%|███▍      | 126185/371472 [10:02:04<18:48:09,  3.62it/s]
 34%|███▍      | 126186/371472 [10:02:05<18:49:35,  3.62it/s]
 34%|███▍      | 126187/371472 [10:02:05<18:57:45,  3.59it/s]
 34%|███▍      | 126188/371472 [10:02:05<18:30:03,  3.68it/s]
 34%|███▍      | 126189/371472 [10:02:05<18:38:08,  3.66it/s]
 34%|███▍      | 126190/371472 [10:02:06<22:16:00,  3.06it/s]
 34%|███▍      | 126191/371472 [10:02:06<22:22:52,  3.04it/s]
 34%|███▍      | 126192/371472 [10:02:06<20:42:14,  3.29it/s]
 34%|███▍      | 126193/371472 [10:02:07<21:06:16,  3.23it/s]
 34%|███▍      | 126194/371472 [10:02:07<19:47:30,  3.44it/s]
 34%|███▍      | 126195/371472 [10:02:07<19:49:03,  3.44it/s]
 34%|███▍      | 126196/371472 [10:02:08<19:53:36,  3.42it/s]
 34%|███▍      | 126197/371472 [10:02:08<20:06:21,  3.39it/s]
 34%|███▍      | 126198/371472 [10:02:08<19:37:33,  3.47it/s]
 34%|███▍      | 126199/371472 [10:02:08<20:01:24,  3.40it/s]
 34%|███▍      | 126200/371472 [10:02:09<19:43:44,  3.45it/s]
                                                             
{'loss': 3.1788, 'learning_rate': 6.945635544829667e-07, 'epoch': 5.44}

 34%|███▍      | 126200/371472 [10:02:09<19:43:44,  3.45it/s]
 34%|███▍      | 126201/371472 [10:02:09<19:20:04,  3.52it/s]
 34%|███▍      | 126202/371472 [10:02:09<20:06:47,  3.39it/s]
 34%|███▍      | 126203/371472 [10:02:10<19:15:54,  3.54it/s]
 34%|███▍      | 126204/371472 [10:02:10<19:42:00,  3.46it/s]
 34%|███▍      | 126205/371472 [10:02:10<20:18:43,  3.35it/s]
 34%|███▍      | 126206/371472 [10:02:11<20:51:08,  3.27it/s]
 34%|███▍      | 126207/371472 [10:02:11<19:23:35,  3.51it/s]
 34%|███▍      | 126208/371472 [10:02:11<18:43:05,  3.64it/s]
 34%|███▍      | 126209/371472 [10:02:11<18:19:07,  3.72it/s]
 34%|███▍      | 126210/371472 [10:02:12<18:21:51,  3.71it/s]
 34%|███▍      | 126211/371472 [10:02:12<19:22:14,  3.52it/s]
 34%|███▍      | 126212/371472 [10:02:12<18:37:34,  3.66it/s]
 34%|███▍      | 126213/371472 [10:02:12<20:10:06,  3.38it/s]
 34%|███▍      | 126214/371472 [10:02:13<21:55:25,  3.11it/s]
 34%|███▍      | 126215/371472 [10:02:13<23:37:49,  2.88it/s]
 34%|███▍      | 126216/371472 [10:02:13<21:28:11,  3.17it/s]
 34%|███▍      | 126217/371472 [10:02:14<20:18:32,  3.35it/s]
 34%|███▍      | 126218/371472 [10:02:14<19:13:58,  3.54it/s]
 34%|███▍      | 126219/371472 [10:02:14<20:12:40,  3.37it/s]
 34%|███▍      | 126220/371472 [10:02:15<19:45:31,  3.45it/s]
                                                             
{'loss': 3.2153, 'learning_rate': 6.945150725074877e-07, 'epoch': 5.44}

 34%|███▍      | 126220/371472 [10:02:15<19:45:31,  3.45it/s]
 34%|███▍      | 126221/371472 [10:02:15<19:39:11,  3.47it/s]
 34%|███▍      | 126222/371472 [10:02:15<19:16:50,  3.53it/s]
 34%|███▍      | 126223/371472 [10:02:15<19:12:40,  3.55it/s]
 34%|███▍      | 126224/371472 [10:02:16<19:23:00,  3.51it/s]
 34%|███▍      | 126225/371472 [10:02:16<18:52:50,  3.61it/s]
 34%|███▍      | 126226/371472 [10:02:16<19:10:01,  3.55it/s]
 34%|███▍      | 126227/371472 [10:02:17<19:53:43,  3.42it/s]
 34%|███▍      | 126228/371472 [10:02:17<20:01:42,  3.40it/s]
 34%|███▍      | 126229/371472 [10:02:17<19:17:04,  3.53it/s]
 34%|███▍      | 126230/371472 [10:02:18<22:56:05,  2.97it/s]
 34%|███▍      | 126231/371472 [10:02:18<21:38:06,  3.15it/s]
 34%|███▍      | 126232/371472 [10:02:18<21:57:15,  3.10it/s]
 34%|███▍      | 126233/371472 [10:02:19<21:49:19,  3.12it/s]
 34%|███▍      | 126234/371472 [10:02:19<21:02:52,  3.24it/s]
 34%|███▍      | 126235/371472 [10:02:19<21:33:02,  3.16it/s]
 34%|███▍      | 126236/371472 [10:02:19<20:25:54,  3.33it/s]
 34%|███▍      | 126237/371472 [10:02:20<21:03:04,  3.24it/s]
 34%|███▍      | 126238/371472 [10:02:20<20:05:17,  3.39it/s]
 34%|███▍      | 126239/371472 [10:02:20<19:17:48,  3.53it/s]
 34%|███▍      | 126240/371472 [10:02:20<18:32:19,  3.67it/s]
                                                             
{'loss': 3.2417, 'learning_rate': 6.944665905320088e-07, 'epoch': 5.44}

 34%|███▍      | 126240/371472 [10:02:20<18:32:19,  3.67it/s]
 34%|███▍      | 126241/371472 [10:02:21<18:49:05,  3.62it/s]
 34%|███▍      | 126242/371472 [10:02:21<18:55:57,  3.60it/s]
 34%|███▍      | 126243/371472 [10:02:21<18:44:04,  3.64it/s]
 34%|███▍      | 126244/371472 [10:02:22<19:14:48,  3.54it/s]
 34%|███▍      | 126245/371472 [10:02:22<18:48:46,  3.62it/s]
 34%|███▍      | 126246/371472 [10:02:22<18:18:54,  3.72it/s]
 34%|███▍      | 126247/371472 [10:02:22<19:28:16,  3.50it/s]
 34%|███▍      | 126248/371472 [10:02:23<18:55:29,  3.60it/s]
 34%|███▍      | 126249/371472 [10:02:23<18:20:19,  3.71it/s]
 34%|███▍      | 126250/371472 [10:02:23<18:09:39,  3.75it/s]
 34%|███▍      | 126251/371472 [10:02:24<19:08:03,  3.56it/s]
 34%|███▍      | 126252/371472 [10:02:24<19:30:36,  3.49it/s]
 34%|███▍      | 126253/371472 [10:02:24<18:58:30,  3.59it/s]
 34%|███▍      | 126254/371472 [10:02:24<18:26:12,  3.69it/s]
 34%|███▍      | 126255/371472 [10:02:25<19:04:44,  3.57it/s]
 34%|███▍      | 126256/371472 [10:02:25<18:08:33,  3.75it/s]
 34%|███▍      | 126257/371472 [10:02:25<18:40:34,  3.65it/s]
 34%|███▍      | 126258/371472 [10:02:25<18:23:20,  3.70it/s]
 34%|███▍      | 126259/371472 [10:02:26<19:33:01,  3.48it/s]
 34%|███▍      | 126260/371472 [10:02:26<18:46:12,  3.63it/s]
                                                             
{'loss': 3.1596, 'learning_rate': 6.9441810855653e-07, 'epoch': 5.44}

 34%|███▍      | 126260/371472 [10:02:26<18:46:12,  3.63it/s]
 34%|███▍      | 126261/371472 [10:02:26<18:51:41,  3.61it/s]
 34%|███▍      | 126262/371472 [10:02:27<18:38:02,  3.66it/s]
 34%|███▍      | 126263/371472 [10:02:27<18:23:20,  3.70it/s]
 34%|███▍      | 126264/371472 [10:02:27<18:52:54,  3.61it/s]
 34%|███▍      | 126265/371472 [10:02:27<18:05:05,  3.77it/s]
 34%|███▍      | 126266/371472 [10:02:28<19:01:39,  3.58it/s]
 34%|███▍      | 126267/371472 [10:02:28<18:29:07,  3.68it/s]
 34%|███▍      | 126268/371472 [10:02:28<18:31:56,  3.68it/s]
 34%|███▍      | 126269/371472 [10:02:29<19:44:51,  3.45it/s]
 34%|███▍      | 126270/371472 [10:02:29<21:11:28,  3.21it/s]
 34%|███▍      | 126271/371472 [10:02:29<20:26:58,  3.33it/s]
 34%|███▍      | 126272/371472 [10:02:29<20:50:18,  3.27it/s]
 34%|███▍      | 126273/371472 [10:02:30<20:00:48,  3.40it/s]
 34%|███▍      | 126274/371472 [10:02:30<19:53:23,  3.42it/s]
 34%|███▍      | 126275/371472 [10:02:30<19:18:16,  3.53it/s]
 34%|███▍      | 126276/371472 [10:02:31<19:02:53,  3.58it/s]
 34%|███▍      | 126277/371472 [10:02:31<19:02:06,  3.58it/s]
 34%|███▍      | 126278/371472 [10:02:31<18:55:56,  3.60it/s]
 34%|███▍      | 126279/371472 [10:02:31<18:03:35,  3.77it/s]
 34%|███▍      | 126280/371472 [10:02:32<17:19:22,  3.93it/s]
                                                             
{'loss': 3.2614, 'learning_rate': 6.943696265810511e-07, 'epoch': 5.44}

 34%|███▍      | 126280/371472 [10:02:32<17:19:22,  3.93it/s]
 34%|███▍      | 126281/371472 [10:02:32<18:22:05,  3.71it/s]
 34%|███▍      | 126282/371472 [10:02:32<17:58:39,  3.79it/s]
 34%|███▍      | 126283/371472 [10:02:32<18:26:10,  3.69it/s]
 34%|███▍      | 126284/371472 [10:02:33<17:51:48,  3.81it/s]
 34%|███▍      | 126285/371472 [10:02:33<17:52:34,  3.81it/s]
 34%|███▍      | 126286/371472 [10:02:33<18:46:37,  3.63it/s]
 34%|███▍      | 126287/371472 [10:02:34<18:23:38,  3.70it/s]
 34%|███▍      | 126288/371472 [10:02:34<17:56:21,  3.80it/s]
 34%|███▍      | 126289/371472 [10:02:34<18:29:42,  3.68it/s]
 34%|███▍      | 126290/371472 [10:02:34<19:19:46,  3.52it/s]
 34%|███▍      | 126291/371472 [10:02:35<18:44:02,  3.64it/s]
 34%|███▍      | 126292/371472 [10:02:35<20:01:20,  3.40it/s]
 34%|███▍      | 126293/371472 [10:02:35<19:04:38,  3.57it/s]
 34%|███▍      | 126294/371472 [10:02:36<21:09:59,  3.22it/s]
 34%|███▍      | 126295/371472 [10:02:36<20:10:25,  3.38it/s]
 34%|███▍      | 126296/371472 [10:02:36<19:06:10,  3.57it/s]
 34%|███▍      | 126297/371472 [10:02:36<18:22:35,  3.71it/s]
 34%|███▍      | 126298/371472 [10:02:37<17:58:43,  3.79it/s]
 34%|███▍      | 126299/371472 [10:02:37<19:57:10,  3.41it/s]
 34%|███▍      | 126300/371472 [10:02:37<19:26:02,  3.50it/s]
                                                             
{'loss': 3.1875, 'learning_rate': 6.943211446055721e-07, 'epoch': 5.44}

 34%|███▍      | 126300/371472 [10:02:37<19:26:02,  3.50it/s]
 34%|███▍      | 126301/371472 [10:02:38<20:07:28,  3.38it/s]
 34%|███▍      | 126302/371472 [10:02:38<19:04:36,  3.57it/s]
 34%|███▍      | 126303/371472 [10:02:38<18:34:07,  3.67it/s]
 34%|███▍      | 126304/371472 [10:02:38<18:31:39,  3.68it/s]
 34%|███▍      | 126305/371472 [10:02:39<19:19:30,  3.52it/s]
 34%|███▍      | 126306/371472 [10:02:39<18:48:18,  3.62it/s]
 34%|███▍      | 126307/371472 [10:02:39<19:02:47,  3.58it/s]
 34%|███▍      | 126308/371472 [10:02:39<19:48:18,  3.44it/s]
 34%|███▍      | 126309/371472 [10:02:40<18:57:55,  3.59it/s]
 34%|███▍      | 126310/371472 [10:02:40<18:01:05,  3.78it/s]
 34%|███▍      | 126311/371472 [10:02:40<18:07:40,  3.76it/s]
 34%|███▍      | 126312/371472 [10:02:41<18:55:30,  3.60it/s]
 34%|███▍      | 126313/371472 [10:02:41<18:28:39,  3.69it/s]
 34%|███▍      | 126314/371472 [10:02:41<18:34:04,  3.67it/s]
 34%|███▍      | 126315/371472 [10:02:41<19:11:32,  3.55it/s]
 34%|███▍      | 126316/371472 [10:02:42<18:47:37,  3.62it/s]
 34%|███▍      | 126317/371472 [10:02:42<20:30:46,  3.32it/s]
 34%|███▍      | 126318/371472 [10:02:42<19:48:28,  3.44it/s]
 34%|███▍      | 126319/371472 [10:02:43<21:17:17,  3.20it/s]
 34%|███▍      | 126320/371472 [10:02:43<20:37:50,  3.30it/s]
                                                             
{'loss': 3.26, 'learning_rate': 6.942726626300933e-07, 'epoch': 5.44}

 34%|███▍      | 126320/371472 [10:02:43<20:37:50,  3.30it/s]
 34%|███▍      | 126321/371472 [10:02:43<20:12:18,  3.37it/s]
 34%|███▍      | 126322/371472 [10:02:43<19:35:32,  3.48it/s]
 34%|███▍      | 126323/371472 [10:02:44<21:19:00,  3.19it/s]
 34%|███▍      | 126324/371472 [10:02:44<19:57:17,  3.41it/s]
 34%|███▍      | 126325/371472 [10:02:44<18:55:05,  3.60it/s]
 34%|███▍      | 126326/371472 [10:02:45<19:46:09,  3.44it/s]
 34%|███▍      | 126327/371472 [10:02:45<19:49:09,  3.44it/s]
 34%|███▍      | 126328/371472 [10:02:45<20:46:13,  3.28it/s]
 34%|███▍      | 126329/371472 [10:02:46<21:52:19,  3.11it/s]
 34%|███▍      | 126330/371472 [10:02:46<20:43:29,  3.29it/s]
 34%|███▍      | 126331/371472 [10:02:46<20:12:44,  3.37it/s]
 34%|███▍      | 126332/371472 [10:02:46<19:26:24,  3.50it/s]
 34%|███▍      | 126333/371472 [10:02:47<18:35:03,  3.66it/s]
 34%|███▍      | 126334/371472 [10:02:47<18:37:52,  3.65it/s]
 34%|███▍      | 126335/371472 [10:02:47<18:29:56,  3.68it/s]
 34%|███▍      | 126336/371472 [10:02:48<19:48:44,  3.44it/s]
 34%|███▍      | 126337/371472 [10:02:48<19:05:54,  3.57it/s]
 34%|███▍      | 126338/371472 [10:02:48<19:19:17,  3.52it/s]
 34%|███▍      | 126339/371472 [10:02:48<19:42:29,  3.46it/s]
 34%|███▍      | 126340/371472 [10:02:49<18:34:08,  3.67it/s]
                                                             
{'loss': 3.1076, 'learning_rate': 6.942241806546145e-07, 'epoch': 5.44}

 34%|███▍      | 126340/371472 [10:02:49<18:34:08,  3.67it/s]
 34%|███▍      | 126341/371472 [10:02:49<18:00:35,  3.78it/s]
 34%|███▍      | 126342/371472 [10:02:49<17:43:14,  3.84it/s]
 34%|███▍      | 126343/371472 [10:02:49<18:00:40,  3.78it/s]
 34%|███▍      | 126344/371472 [10:02:50<17:47:34,  3.83it/s]
 34%|███▍      | 126345/371472 [10:02:50<19:21:32,  3.52it/s]
 34%|███▍      | 126346/371472 [10:02:50<18:18:26,  3.72it/s]
 34%|███▍      | 126347/371472 [10:02:51<18:42:44,  3.64it/s]
 34%|███▍      | 126348/371472 [10:02:51<19:21:17,  3.52it/s]
 34%|███▍      | 126349/371472 [10:02:51<19:17:32,  3.53it/s]
 34%|███▍      | 126350/371472 [10:02:51<18:47:27,  3.62it/s]
 34%|███▍      | 126351/371472 [10:02:52<18:22:18,  3.71it/s]
 34%|███▍      | 126352/371472 [10:02:52<20:22:56,  3.34it/s]
 34%|███▍      | 126353/371472 [10:02:52<20:24:49,  3.34it/s]
 34%|███▍      | 126354/371472 [10:02:53<19:15:26,  3.54it/s]
 34%|███▍      | 126355/371472 [10:02:53<20:34:56,  3.31it/s]
 34%|███▍      | 126356/371472 [10:02:53<20:09:28,  3.38it/s]
 34%|███▍      | 126357/371472 [10:02:53<20:24:22,  3.34it/s]
 34%|███▍      | 126358/371472 [10:02:54<21:37:52,  3.15it/s]
 34%|███▍      | 126359/371472 [10:02:54<21:57:17,  3.10it/s]
 34%|███▍      | 126360/371472 [10:02:54<20:53:17,  3.26it/s]
                                                             
{'loss': 3.0644, 'learning_rate': 6.941756986791355e-07, 'epoch': 5.44}

 34%|███▍      | 126360/371472 [10:02:54<20:53:17,  3.26it/s]
 34%|███▍      | 126361/371472 [10:02:55<20:28:46,  3.32it/s]
 34%|███▍      | 126362/371472 [10:02:55<19:58:25,  3.41it/s]
 34%|███▍      | 126363/371472 [10:02:55<19:26:39,  3.50it/s]
 34%|███▍      | 126364/371472 [10:02:56<19:40:09,  3.46it/s]
 34%|███▍      | 126365/371472 [10:02:56<19:19:23,  3.52it/s]
 34%|███▍      | 126366/371472 [10:02:56<19:30:31,  3.49it/s]
 34%|███▍      | 126367/371472 [10:02:56<19:14:22,  3.54it/s]
 34%|███▍      | 126368/371472 [10:02:57<18:46:30,  3.63it/s]
 34%|███▍      | 126369/371472 [10:02:57<18:00:04,  3.78it/s]
 34%|███▍      | 126370/371472 [10:02:57<17:58:57,  3.79it/s]
 34%|███▍      | 126371/371472 [10:02:57<17:39:38,  3.86it/s]
 34%|███▍      | 126372/371472 [10:02:58<17:36:47,  3.87it/s]
 34%|███▍      | 126373/371472 [10:02:58<17:33:39,  3.88it/s]
 34%|███▍      | 126374/371472 [10:02:58<18:12:13,  3.74it/s]
 34%|███▍      | 126375/371472 [10:02:59<19:30:29,  3.49it/s]
 34%|███▍      | 126376/371472 [10:02:59<20:37:09,  3.30it/s]
 34%|███▍      | 126377/371472 [10:02:59<19:23:33,  3.51it/s]
 34%|███▍      | 126378/371472 [10:02:59<18:42:53,  3.64it/s]
 34%|███▍      | 126379/371472 [10:03:00<18:44:51,  3.63it/s]
 34%|███▍      | 126380/371472 [10:03:00<18:06:56,  3.76it/s]
                                                             
{'loss': 3.344, 'learning_rate': 6.941272167036565e-07, 'epoch': 5.44}

 34%|███▍      | 126380/371472 [10:03:00<18:06:56,  3.76it/s]
 34%|███▍      | 126381/371472 [10:03:00<18:18:47,  3.72it/s]
 34%|███▍      | 126382/371472 [10:03:00<17:38:29,  3.86it/s]
 34%|███▍      | 126383/371472 [10:03:01<17:53:25,  3.81it/s]
 34%|███▍      | 126384/371472 [10:03:01<17:29:02,  3.89it/s]
 34%|███▍      | 126385/371472 [10:03:01<17:10:19,  3.96it/s]
 34%|███▍      | 126386/371472 [10:03:01<17:41:53,  3.85it/s]
 34%|███▍      | 126387/371472 [10:03:02<17:41:33,  3.85it/s]
 34%|███▍      | 126388/371472 [10:03:02<17:30:42,  3.89it/s]
 34%|███▍      | 126389/371472 [10:03:02<19:00:59,  3.58it/s]
 34%|███▍      | 126390/371472 [10:03:03<18:24:30,  3.70it/s]
 34%|███▍      | 126391/371472 [10:03:03<17:55:21,  3.80it/s]
 34%|███▍      | 126392/371472 [10:03:03<18:26:01,  3.69it/s]
 34%|███▍      | 126393/371472 [10:03:03<18:19:01,  3.72it/s]
 34%|███▍      | 126394/371472 [10:03:04<17:54:17,  3.80it/s]
 34%|███▍      | 126395/371472 [10:03:04<17:43:38,  3.84it/s]
 34%|███▍      | 126396/371472 [10:03:04<17:30:04,  3.89it/s]
 34%|███▍      | 126397/371472 [10:03:04<19:21:51,  3.52it/s]
 34%|███▍      | 126398/371472 [10:03:05<19:36:48,  3.47it/s]
 34%|███▍      | 126399/371472 [10:03:05<18:46:29,  3.63it/s]
 34%|███▍      | 126400/371472 [10:03:05<18:39:24,  3.65it/s]
                                                             
{'loss': 3.4049, 'learning_rate': 6.940787347281777e-07, 'epoch': 5.44}

 34%|███▍      | 126400/371472 [10:03:05<18:39:24,  3.65it/s]
 34%|███▍      | 126401/371472 [10:03:06<19:19:35,  3.52it/s]
 34%|███▍      | 126402/371472 [10:03:06<19:03:32,  3.57it/s]
 34%|███▍      | 126403/371472 [10:03:06<21:13:39,  3.21it/s]
 34%|███▍      | 126404/371472 [10:03:06<20:10:22,  3.37it/s]
 34%|███▍      | 126405/371472 [10:03:07<20:02:16,  3.40it/s]
 34%|███▍      | 126406/371472 [10:03:07<20:33:42,  3.31it/s]
 34%|███▍      | 126407/371472 [10:03:07<19:31:52,  3.49it/s]
 34%|███▍      | 126408/371472 [10:03:08<18:47:47,  3.62it/s]
 34%|███▍      | 126409/371472 [10:03:08<20:13:28,  3.37it/s]
 34%|███▍      | 126410/371472 [10:03:08<19:51:29,  3.43it/s]
 34%|███▍      | 126411/371472 [10:03:08<19:36:36,  3.47it/s]
 34%|███▍      | 126412/371472 [10:03:09<19:55:57,  3.42it/s]
 34%|███▍      | 126413/371472 [10:03:09<19:16:40,  3.53it/s]
 34%|███▍      | 126414/371472 [10:03:09<20:25:57,  3.33it/s]
 34%|███▍      | 126415/371472 [10:03:10<19:38:48,  3.46it/s]
 34%|███▍      | 126416/371472 [10:03:10<19:33:02,  3.48it/s]
 34%|███▍      | 126417/371472 [10:03:10<19:16:38,  3.53it/s]
 34%|███▍      | 126418/371472 [10:03:10<18:32:16,  3.67it/s]
 34%|███▍      | 126419/371472 [10:03:11<18:38:54,  3.65it/s]
 34%|███▍      | 126420/371472 [10:03:11<17:52:55,  3.81it/s]
                                                             
{'loss': 3.2218, 'learning_rate': 6.940302527526989e-07, 'epoch': 5.45}

 34%|███▍      | 126420/371472 [10:03:11<17:52:55,  3.81it/s]
 34%|███▍      | 126421/371472 [10:03:11<20:13:47,  3.36it/s]
 34%|███▍      | 126422/371472 [10:03:12<19:24:14,  3.51it/s]
 34%|███▍      | 126423/371472 [10:03:12<20:05:51,  3.39it/s]
 34%|███▍      | 126424/371472 [10:03:12<19:06:49,  3.56it/s]
 34%|███▍      | 126425/371472 [10:03:12<18:46:20,  3.63it/s]
 34%|███▍      | 126426/371472 [10:03:13<18:42:29,  3.64it/s]
 34%|███▍      | 126427/371472 [10:03:13<18:26:14,  3.69it/s]
 34%|███▍      | 126428/371472 [10:03:13<19:16:00,  3.53it/s]
 34%|███▍      | 126429/371472 [10:03:14<19:04:50,  3.57it/s]
 34%|███▍      | 126430/371472 [10:03:14<19:39:56,  3.46it/s]
 34%|███▍      | 126431/371472 [10:03:14<19:06:15,  3.56it/s]
 34%|███▍      | 126432/371472 [10:03:14<19:41:37,  3.46it/s]
 34%|███▍      | 126433/371472 [10:03:15<19:47:32,  3.44it/s]
 34%|███▍      | 126434/371472 [10:03:15<19:10:58,  3.55it/s]
 34%|███▍      | 126435/371472 [10:03:15<18:51:00,  3.61it/s]
 34%|███▍      | 126436/371472 [10:03:15<18:15:36,  3.73it/s]
 34%|███▍      | 126437/371472 [10:03:16<20:25:44,  3.33it/s]
 34%|███▍      | 126438/371472 [10:03:16<19:47:36,  3.44it/s]
 34%|███▍      | 126439/371472 [10:03:16<19:26:52,  3.50it/s]
 34%|███▍      | 126440/371472 [10:03:17<19:30:07,  3.49it/s]
                                                             
{'loss': 3.1928, 'learning_rate': 6.9398177077722e-07, 'epoch': 5.45}

 34%|███▍      | 126440/371472 [10:03:17<19:30:07,  3.49it/s]
 34%|███▍      | 126441/371472 [10:03:17<19:09:22,  3.55it/s]
 34%|███▍      | 126442/371472 [10:03:17<18:50:01,  3.61it/s]
 34%|███▍      | 126443/371472 [10:03:18<19:09:51,  3.55it/s]
 34%|███▍      | 126444/371472 [10:03:18<19:27:30,  3.50it/s]
 34%|███▍      | 126445/371472 [10:03:18<19:09:24,  3.55it/s]
 34%|███▍      | 126446/371472 [10:03:18<20:00:21,  3.40it/s]
 34%|███▍      | 126447/371472 [10:03:19<19:39:49,  3.46it/s]
 34%|███▍      | 126448/371472 [10:03:19<19:02:35,  3.57it/s]
 34%|███▍      | 126449/371472 [10:03:19<19:50:38,  3.43it/s]
 34%|███▍      | 126450/371472 [10:03:20<19:38:16,  3.47it/s]
 34%|███▍      | 126451/371472 [10:03:20<20:37:32,  3.30it/s]
 34%|███▍      | 126452/371472 [10:03:20<20:18:45,  3.35it/s]
 34%|███▍      | 126453/371472 [10:03:21<21:32:54,  3.16it/s]
 34%|███▍      | 126454/371472 [10:03:21<20:32:59,  3.31it/s]
 34%|███▍      | 126455/371472 [10:03:21<22:02:00,  3.09it/s]
 34%|███▍      | 126456/371472 [10:03:21<21:40:41,  3.14it/s]
 34%|███▍      | 126457/371472 [10:03:22<20:45:10,  3.28it/s]
 34%|███▍      | 126458/371472 [10:03:22<19:53:10,  3.42it/s]
 34%|███▍      | 126459/371472 [10:03:22<20:25:56,  3.33it/s]
 34%|███▍      | 126460/371472 [10:03:23<20:31:37,  3.32it/s]
                                                             
{'loss': 3.2087, 'learning_rate': 6.93933288801741e-07, 'epoch': 5.45}

 34%|███▍      | 126460/371472 [10:03:23<20:31:37,  3.32it/s]
 34%|███▍      | 126461/371472 [10:03:23<19:43:02,  3.45it/s]
 34%|███▍      | 126462/371472 [10:03:23<19:04:48,  3.57it/s]
 34%|███▍      | 126463/371472 [10:03:23<19:20:41,  3.52it/s]
 34%|███▍      | 126464/371472 [10:03:24<18:34:21,  3.66it/s]
 34%|███▍      | 126465/371472 [10:03:24<18:05:34,  3.76it/s]
 34%|███▍      | 126466/371472 [10:03:24<19:37:56,  3.47it/s]
 34%|███▍      | 126467/371472 [10:03:25<19:14:47,  3.54it/s]
 34%|███▍      | 126468/371472 [10:03:25<19:20:34,  3.52it/s]
 34%|███▍      | 126469/371472 [10:03:25<19:13:14,  3.54it/s]
 34%|███▍      | 126470/371472 [10:03:25<18:33:03,  3.67it/s]
 34%|███▍      | 126471/371472 [10:03:26<19:11:04,  3.55it/s]
 34%|███▍      | 126472/371472 [10:03:26<18:45:44,  3.63it/s]
 34%|███▍      | 126473/371472 [10:03:26<18:18:09,  3.72it/s]
 34%|███▍      | 126474/371472 [10:03:26<17:57:48,  3.79it/s]
 34%|███▍      | 126475/371472 [10:03:27<18:58:46,  3.59it/s]
 34%|███▍      | 126476/371472 [10:03:27<18:53:43,  3.60it/s]
 34%|███▍      | 126477/371472 [10:03:27<19:28:44,  3.49it/s]
 34%|███▍      | 126478/371472 [10:03:28<19:42:53,  3.45it/s]
 34%|███▍      | 126479/371472 [10:03:28<20:06:22,  3.38it/s]
 34%|███▍      | 126480/371472 [10:03:28<21:21:16,  3.19it/s]
                                                             
{'loss': 3.2636, 'learning_rate': 6.938848068262621e-07, 'epoch': 5.45}

 34%|███▍      | 126480/371472 [10:03:28<21:21:16,  3.19it/s]
 34%|███▍      | 126481/371472 [10:03:29<19:51:33,  3.43it/s]
 34%|███▍      | 126482/371472 [10:03:29<19:44:35,  3.45it/s]
 34%|███▍      | 126483/371472 [10:03:29<19:19:31,  3.52it/s]
 34%|███▍      | 126484/371472 [10:03:29<18:46:18,  3.63it/s]
 34%|███▍      | 126485/371472 [10:03:30<18:28:01,  3.69it/s]
 34%|███▍      | 126486/371472 [10:03:30<18:27:48,  3.69it/s]
 34%|███▍      | 126487/371472 [10:03:30<18:15:14,  3.73it/s]
 34%|███▍      | 126488/371472 [10:03:30<17:48:28,  3.82it/s]
 34%|███▍      | 126489/371472 [10:03:31<17:38:23,  3.86it/s]
 34%|███▍      | 126490/371472 [10:03:31<18:59:38,  3.58it/s]
 34%|███▍      | 126491/371472 [10:03:31<18:40:15,  3.64it/s]
 34%|███▍      | 126492/371472 [10:03:32<19:17:01,  3.53it/s]
 34%|███▍      | 126493/371472 [10:03:32<19:16:21,  3.53it/s]
 34%|███▍      | 126494/371472 [10:03:32<18:48:55,  3.62it/s]
 34%|███▍      | 126495/371472 [10:03:32<18:24:01,  3.70it/s]
 34%|███▍      | 126496/371472 [10:03:33<18:38:54,  3.65it/s]
 34%|███▍      | 126497/371472 [10:03:33<19:01:23,  3.58it/s]
 34%|███▍      | 126498/371472 [10:03:33<18:58:10,  3.59it/s]
 34%|███▍      | 126499/371472 [10:03:33<19:15:08,  3.53it/s]
 34%|███▍      | 126500/371472 [10:03:34<19:44:58,  3.45it/s]
                                                             
{'loss': 3.1491, 'learning_rate': 6.938363248507833e-07, 'epoch': 5.45}

 34%|███▍      | 126500/371472 [10:03:34<19:44:58,  3.45it/s]
 34%|███▍      | 126501/371472 [10:03:34<19:06:24,  3.56it/s]
 34%|███▍      | 126502/371472 [10:03:34<19:19:05,  3.52it/s]
 34%|███▍      | 126503/371472 [10:03:35<18:46:52,  3.62it/s]
 34%|███▍      | 126504/371472 [10:03:35<18:06:36,  3.76it/s]
 34%|███▍      | 126505/371472 [10:03:35<18:31:11,  3.67it/s]
 34%|███▍      | 126506/371472 [10:03:35<17:47:15,  3.83it/s]
 34%|███▍      | 126507/371472 [10:03:36<18:28:26,  3.68it/s]
 34%|███▍      | 126508/371472 [10:03:36<18:26:28,  3.69it/s]
 34%|███▍      | 126509/371472 [10:03:36<19:35:54,  3.47it/s]
 34%|███▍      | 126510/371472 [10:03:37<18:58:31,  3.59it/s]
 34%|███▍      | 126511/371472 [10:03:37<19:11:43,  3.54it/s]
 34%|███▍      | 126512/371472 [10:03:37<19:16:02,  3.53it/s]
 34%|███▍      | 126513/371472 [10:03:37<19:54:56,  3.42it/s]
 34%|███▍      | 126514/371472 [10:03:38<19:48:33,  3.43it/s]
 34%|███▍      | 126515/371472 [10:03:38<20:32:40,  3.31it/s]
 34%|███▍      | 126516/371472 [10:03:38<21:07:01,  3.22it/s]
 34%|███▍      | 126517/371472 [10:03:39<20:52:47,  3.26it/s]
 34%|███▍      | 126518/371472 [10:03:39<21:07:27,  3.22it/s]
 34%|███▍      | 126519/371472 [10:03:39<20:05:02,  3.39it/s]
 34%|███▍      | 126520/371472 [10:03:40<21:18:51,  3.19it/s]
                                                             
{'loss': 3.0597, 'learning_rate': 6.937878428753043e-07, 'epoch': 5.45}

 34%|███▍      | 126520/371472 [10:03:40<21:18:51,  3.19it/s]
 34%|███▍      | 126521/371472 [10:03:40<21:57:31,  3.10it/s]
 34%|███▍      | 126522/371472 [10:03:40<21:20:58,  3.19it/s]
 34%|███▍      | 126523/371472 [10:03:41<21:04:43,  3.23it/s]
 34%|███▍      | 126524/371472 [10:03:41<22:40:07,  3.00it/s]
 34%|███▍      | 126525/371472 [10:03:41<20:49:37,  3.27it/s]
 34%|███▍      | 126526/371472 [10:03:41<20:49:31,  3.27it/s]
 34%|███▍      | 126527/371472 [10:03:42<19:53:07,  3.42it/s]
 34%|███▍      | 126528/371472 [10:03:42<19:01:00,  3.58it/s]
 34%|███▍      | 126529/371472 [10:03:42<21:15:31,  3.20it/s]
 34%|███▍      | 126530/371472 [10:03:43<20:58:19,  3.24it/s]
 34%|███▍      | 126531/371472 [10:03:43<19:51:06,  3.43it/s]
 34%|███▍      | 126532/371472 [10:03:43<19:39:49,  3.46it/s]
 34%|███▍      | 126533/371472 [10:03:43<19:19:08,  3.52it/s]
 34%|███▍      | 126534/371472 [10:03:44<19:25:49,  3.50it/s]
 34%|███▍      | 126535/371472 [10:03:44<19:55:40,  3.41it/s]
 34%|███▍      | 126536/371472 [10:03:44<19:50:44,  3.43it/s]
 34%|███▍      | 126537/371472 [10:03:45<18:49:00,  3.62it/s]
 34%|███▍      | 126538/371472 [10:03:45<18:45:09,  3.63it/s]
 34%|███▍      | 126539/371472 [10:03:45<18:58:47,  3.58it/s]
 34%|███▍      | 126540/371472 [10:03:45<19:37:50,  3.47it/s]
                                                             
{'loss': 3.3135, 'learning_rate': 6.937393608998254e-07, 'epoch': 5.45}

 34%|███▍      | 126540/371472 [10:03:45<19:37:50,  3.47it/s]
 34%|███▍      | 126541/371472 [10:03:46<20:21:35,  3.34it/s]
 34%|███▍      | 126542/371472 [10:03:46<19:53:57,  3.42it/s]
 34%|███▍      | 126543/371472 [10:03:46<19:04:46,  3.57it/s]
 34%|███▍      | 126544/371472 [10:03:47<18:28:23,  3.68it/s]
 34%|███▍      | 126545/371472 [10:03:47<18:39:30,  3.65it/s]
 34%|███▍      | 126546/371472 [10:03:47<18:30:57,  3.67it/s]
 34%|███▍      | 126547/371472 [10:03:47<19:18:16,  3.52it/s]
 34%|███▍      | 126548/371472 [10:03:48<21:10:09,  3.21it/s]
 34%|███▍      | 126549/371472 [10:03:48<20:45:34,  3.28it/s]
 34%|███▍      | 126550/371472 [10:03:48<20:50:49,  3.26it/s]
 34%|███▍      | 126551/371472 [10:03:49<20:25:48,  3.33it/s]
 34%|███▍      | 126552/371472 [10:03:49<19:56:20,  3.41it/s]
 34%|███▍      | 126553/371472 [10:03:49<19:38:19,  3.46it/s]
 34%|███▍      | 126554/371472 [10:03:49<18:41:18,  3.64it/s]
 34%|███▍      | 126555/371472 [10:03:50<19:13:15,  3.54it/s]
 34%|███▍      | 126556/371472 [10:03:50<21:46:54,  3.12it/s]
 34%|███▍      | 126557/371472 [10:03:51<21:15:59,  3.20it/s]
 34%|███▍      | 126558/371472 [10:03:51<20:16:09,  3.36it/s]
 34%|███▍      | 126559/371472 [10:03:51<20:35:09,  3.30it/s]
 34%|███▍      | 126560/371472 [10:03:51<19:45:17,  3.44it/s]
                                                             
{'loss': 3.2245, 'learning_rate': 6.936908789243466e-07, 'epoch': 5.45}

 34%|███▍      | 126560/371472 [10:03:51<19:45:17,  3.44it/s]
 34%|███▍      | 126561/371472 [10:03:52<19:59:01,  3.40it/s]
 34%|███▍      | 126562/371472 [10:03:52<20:18:34,  3.35it/s]
 34%|███▍      | 126563/371472 [10:03:52<19:43:16,  3.45it/s]
 34%|███▍      | 126564/371472 [10:03:53<19:48:31,  3.43it/s]
 34%|███▍      | 126565/371472 [10:03:53<19:00:01,  3.58it/s]
 34%|███▍      | 126566/371472 [10:03:53<18:38:33,  3.65it/s]
 34%|███▍      | 126567/371472 [10:03:53<18:28:45,  3.68it/s]
 34%|███▍      | 126568/371472 [10:03:54<18:02:19,  3.77it/s]
 34%|███▍      | 126569/371472 [10:03:54<17:33:49,  3.87it/s]
 34%|███▍      | 126570/371472 [10:03:54<20:45:45,  3.28it/s]
 34%|███▍      | 126571/371472 [10:03:54<19:27:38,  3.50it/s]
 34%|███▍      | 126572/371472 [10:03:55<18:56:56,  3.59it/s]
 34%|███▍      | 126573/371472 [10:03:55<18:16:08,  3.72it/s]
 34%|███▍      | 126574/371472 [10:03:55<18:58:20,  3.59it/s]
 34%|███▍      | 126575/371472 [10:03:56<18:36:37,  3.66it/s]
 34%|███▍      | 126576/371472 [10:03:56<18:19:43,  3.71it/s]
 34%|███▍      | 126577/371472 [10:03:56<18:05:09,  3.76it/s]
 34%|███▍      | 126578/371472 [10:03:56<18:34:17,  3.66it/s]
 34%|███▍      | 126579/371472 [10:03:57<19:24:53,  3.50it/s]
 34%|███▍      | 126580/371472 [10:03:57<18:52:19,  3.60it/s]
                                                             
{'loss': 3.3457, 'learning_rate': 6.936423969488677e-07, 'epoch': 5.45}

 34%|███▍      | 126580/371472 [10:03:57<18:52:19,  3.60it/s]
 34%|███▍      | 126581/371472 [10:03:57<19:10:47,  3.55it/s]
 34%|███▍      | 126582/371472 [10:03:57<18:54:33,  3.60it/s]
 34%|███▍      | 126583/371472 [10:03:58<18:42:55,  3.63it/s]
 34%|███▍      | 126584/371472 [10:03:58<18:26:53,  3.69it/s]
 34%|███▍      | 126585/371472 [10:03:58<19:02:25,  3.57it/s]
 34%|███▍      | 126586/371472 [10:03:59<19:21:44,  3.51it/s]
 34%|███▍      | 126587/371472 [10:03:59<20:40:48,  3.29it/s]
 34%|███▍      | 126588/371472 [10:03:59<20:11:41,  3.37it/s]
 34%|███▍      | 126589/371472 [10:03:59<19:23:17,  3.51it/s]
 34%|███▍      | 126590/371472 [10:04:00<19:09:29,  3.55it/s]
 34%|███▍      | 126591/371472 [10:04:00<19:25:00,  3.50it/s]
 34%|███▍      | 126592/371472 [10:04:00<19:11:20,  3.54it/s]
 34%|███▍      | 126593/371472 [10:04:01<19:59:02,  3.40it/s]
 34%|███▍      | 126594/371472 [10:04:01<19:24:49,  3.50it/s]
 34%|███▍      | 126595/371472 [10:04:01<19:05:13,  3.56it/s]
 34%|███▍      | 126596/371472 [10:04:01<18:44:55,  3.63it/s]
 34%|███▍      | 126597/371472 [10:04:02<19:09:49,  3.55it/s]
 34%|███▍      | 126598/371472 [10:04:02<20:21:15,  3.34it/s]
 34%|███▍      | 126599/371472 [10:04:02<20:09:48,  3.37it/s]
 34%|███▍      | 126600/371472 [10:04:03<20:05:51,  3.38it/s]
                                                             
{'loss': 3.3086, 'learning_rate': 6.935939149733887e-07, 'epoch': 5.45}

 34%|███▍      | 126600/371472 [10:04:03<20:05:51,  3.38it/s]
 34%|███▍      | 126601/371472 [10:04:03<19:32:32,  3.48it/s]
 34%|███▍      | 126602/371472 [10:04:03<18:52:11,  3.60it/s]
 34%|███▍      | 126603/371472 [10:04:03<18:36:09,  3.66it/s]
 34%|███▍      | 126604/371472 [10:04:04<18:54:22,  3.60it/s]
 34%|███▍      | 126605/371472 [10:04:04<18:31:10,  3.67it/s]
 34%|███▍      | 126606/371472 [10:04:04<18:36:46,  3.65it/s]
 34%|███▍      | 126607/371472 [10:04:05<20:39:56,  3.29it/s]
 34%|███▍      | 126608/371472 [10:04:05<19:37:17,  3.47it/s]
 34%|███▍      | 126609/371472 [10:04:05<19:10:02,  3.55it/s]
 34%|███▍      | 126610/371472 [10:04:05<19:04:43,  3.57it/s]
 34%|███▍      | 126611/371472 [10:04:06<18:43:20,  3.63it/s]
 34%|███▍      | 126612/371472 [10:04:06<22:06:47,  3.08it/s]
 34%|███▍      | 126613/371472 [10:04:06<21:42:39,  3.13it/s]
 34%|███▍      | 126614/371472 [10:04:07<22:01:36,  3.09it/s]
 34%|███▍      | 126615/371472 [10:04:07<21:08:12,  3.22it/s]
 34%|███▍      | 126616/371472 [10:04:07<20:30:17,  3.32it/s]
 34%|███▍      | 126617/371472 [10:04:08<19:24:25,  3.50it/s]
 34%|███▍      | 126618/371472 [10:04:08<19:11:29,  3.54it/s]
 34%|███▍      | 126619/371472 [10:04:08<19:54:37,  3.42it/s]
 34%|███▍      | 126620/371472 [10:04:09<21:33:57,  3.15it/s]
                                                             
{'loss': 3.1835, 'learning_rate': 6.935454329979098e-07, 'epoch': 5.45}

 34%|███▍      | 126620/371472 [10:04:09<21:33:57,  3.15it/s]
 34%|███▍      | 126621/371472 [10:04:09<22:03:49,  3.08it/s]
 34%|███▍      | 126622/371472 [10:04:09<20:47:00,  3.27it/s]
 34%|███▍      | 126623/371472 [10:04:09<19:59:07,  3.40it/s]
 34%|███▍      | 126624/371472 [10:04:10<19:27:52,  3.49it/s]
 34%|███▍      | 126625/371472 [10:04:10<18:48:35,  3.62it/s]
 34%|███▍      | 126626/371472 [10:04:10<19:07:32,  3.56it/s]
 34%|███▍      | 126627/371472 [10:04:11<20:05:20,  3.39it/s]
 34%|███▍      | 126628/371472 [10:04:11<19:35:30,  3.47it/s]
 34%|███▍      | 126629/371472 [10:04:11<18:49:06,  3.61it/s]
 34%|███▍      | 126630/371472 [10:04:11<18:41:14,  3.64it/s]
 34%|███▍      | 126631/371472 [10:04:12<19:22:14,  3.51it/s]
 34%|███▍      | 126632/371472 [10:04:12<18:52:05,  3.60it/s]
 34%|███▍      | 126633/371472 [10:04:12<18:00:47,  3.78it/s]
 34%|███▍      | 126634/371472 [10:04:12<19:07:49,  3.56it/s]
 34%|███▍      | 126635/371472 [10:04:13<18:28:31,  3.68it/s]
 34%|███▍      | 126636/371472 [10:04:13<20:10:32,  3.37it/s]
 34%|███▍      | 126637/371472 [10:04:13<20:44:32,  3.28it/s]
 34%|███▍      | 126638/371472 [10:04:14<20:12:31,  3.37it/s]
 34%|███▍      | 126639/371472 [10:04:14<21:06:50,  3.22it/s]
 34%|███▍      | 126640/371472 [10:04:14<21:27:43,  3.17it/s]
                                                             
{'loss': 3.3209, 'learning_rate': 6.93496951022431e-07, 'epoch': 5.45}

 34%|███▍      | 126640/371472 [10:04:14<21:27:43,  3.17it/s]
 34%|███▍      | 126641/371472 [10:04:15<20:35:14,  3.30it/s]
 34%|███▍      | 126642/371472 [10:04:15<19:41:16,  3.45it/s]
 34%|███▍      | 126643/371472 [10:04:15<20:53:50,  3.25it/s]
 34%|███▍      | 126644/371472 [10:04:16<20:16:04,  3.36it/s]
 34%|███▍      | 126645/371472 [10:04:16<19:16:54,  3.53it/s]
 34%|███▍      | 126646/371472 [10:04:16<19:17:28,  3.53it/s]
 34%|███▍      | 126647/371472 [10:04:16<18:53:42,  3.60it/s]
 34%|███▍      | 126648/371472 [10:04:17<18:09:43,  3.74it/s]
 34%|███▍      | 126649/371472 [10:04:17<18:15:59,  3.72it/s]
 34%|███▍      | 126650/371472 [10:04:17<18:16:01,  3.72it/s]
 34%|███▍      | 126651/371472 [10:04:17<18:07:40,  3.75it/s]
 34%|███▍      | 126652/371472 [10:04:18<19:11:21,  3.54it/s]
 34%|███▍      | 126653/371472 [10:04:18<18:49:58,  3.61it/s]
 34%|███▍      | 126654/371472 [10:04:18<18:21:39,  3.70it/s]
 34%|███▍      | 126655/371472 [10:04:18<18:05:26,  3.76it/s]
 34%|███▍      | 126656/371472 [10:04:19<17:57:06,  3.79it/s]
 34%|███▍      | 126657/371472 [10:04:19<18:27:22,  3.68it/s]
 34%|███▍      | 126658/371472 [10:04:19<18:57:49,  3.59it/s]
 34%|███▍      | 126659/371472 [10:04:20<19:02:01,  3.57it/s]
 34%|███▍      | 126660/371472 [10:04:20<19:04:49,  3.56it/s]
                                                             
{'loss': 3.1743, 'learning_rate': 6.93448469046952e-07, 'epoch': 5.46}

 34%|███▍      | 126660/371472 [10:04:20<19:04:49,  3.56it/s]
 34%|███▍      | 126661/371472 [10:04:20<18:53:56,  3.60it/s]
 34%|███▍      | 126662/371472 [10:04:20<18:32:24,  3.67it/s]
 34%|███▍      | 126663/371472 [10:04:21<18:43:58,  3.63it/s]
 34%|███▍      | 126664/371472 [10:04:21<18:43:59,  3.63it/s]
 34%|███▍      | 126665/371472 [10:04:21<18:54:28,  3.60it/s]
 34%|███▍      | 126666/371472 [10:04:22<18:43:49,  3.63it/s]
 34%|███▍      | 126667/371472 [10:04:22<19:24:00,  3.51it/s]
 34%|███▍      | 126668/371472 [10:04:22<18:41:31,  3.64it/s]
 34%|███▍      | 126669/371472 [10:04:22<19:28:54,  3.49it/s]
 34%|███▍      | 126670/371472 [10:04:23<19:10:42,  3.55it/s]
 34%|███▍      | 126671/371472 [10:04:23<18:33:18,  3.66it/s]
 34%|███▍      | 126672/371472 [10:04:23<18:41:46,  3.64it/s]
 34%|███▍      | 126673/371472 [10:04:23<19:04:44,  3.56it/s]
 34%|███▍      | 126674/371472 [10:04:24<19:18:55,  3.52it/s]
 34%|███▍      | 126675/371472 [10:04:24<18:29:26,  3.68it/s]
 34%|███▍      | 126676/371472 [10:04:24<18:32:58,  3.67it/s]
 34%|███▍      | 126677/371472 [10:04:25<18:30:46,  3.67it/s]
 34%|███▍      | 126678/371472 [10:04:25<17:52:41,  3.80it/s]
 34%|███▍      | 126679/371472 [10:04:25<18:21:29,  3.70it/s]
 34%|███▍      | 126680/371472 [10:04:25<19:50:43,  3.43it/s]
                                                             
{'loss': 3.4087, 'learning_rate': 6.93399987071473e-07, 'epoch': 5.46}

 34%|███▍      | 126680/371472 [10:04:25<19:50:43,  3.43it/s]
 34%|███▍      | 126681/371472 [10:04:26<19:22:05,  3.51it/s]
 34%|███▍      | 126682/371472 [10:04:26<19:37:24,  3.47it/s]
 34%|███▍      | 126683/371472 [10:04:26<19:51:03,  3.43it/s]
 34%|███▍      | 126684/371472 [10:04:27<19:19:43,  3.52it/s]
 34%|███▍      | 126685/371472 [10:04:27<20:02:29,  3.39it/s]
 34%|███▍      | 126686/371472 [10:04:27<19:36:12,  3.47it/s]
 34%|███▍      | 126687/371472 [10:04:27<20:00:03,  3.40it/s]
 34%|███▍      | 126688/371472 [10:04:28<19:31:30,  3.48it/s]
 34%|███▍      | 126689/371472 [10:04:28<20:07:54,  3.38it/s]
 34%|███▍      | 126690/371472 [10:04:28<19:33:01,  3.48it/s]
 34%|███▍      | 126691/371472 [10:04:29<18:45:42,  3.62it/s]
 34%|███▍      | 126692/371472 [10:04:29<19:53:30,  3.42it/s]
 34%|███▍      | 126693/371472 [10:04:29<19:00:14,  3.58it/s]
 34%|███▍      | 126694/371472 [10:04:29<20:05:08,  3.39it/s]
 34%|███▍      | 126695/371472 [10:04:30<20:28:33,  3.32it/s]
 34%|███▍      | 126696/371472 [10:04:30<21:51:36,  3.11it/s]
 34%|███▍      | 126697/371472 [10:04:30<20:42:33,  3.28it/s]
 34%|███▍      | 126698/371472 [10:04:31<20:08:15,  3.38it/s]
 34%|███▍      | 126699/371472 [10:04:31<20:17:32,  3.35it/s]
 34%|███▍      | 126700/371472 [10:04:31<19:45:12,  3.44it/s]
                                                             
{'loss': 3.1188, 'learning_rate': 6.933515050959943e-07, 'epoch': 5.46}

 34%|███▍      | 126700/371472 [10:04:31<19:45:12,  3.44it/s]
 34%|███▍      | 126701/371472 [10:04:32<19:09:11,  3.55it/s]
 34%|███▍      | 126702/371472 [10:04:32<18:36:15,  3.65it/s]
 34%|███▍      | 126703/371472 [10:04:32<18:15:12,  3.72it/s]
 34%|███▍      | 126704/371472 [10:04:32<19:36:24,  3.47it/s]
 34%|███▍      | 126705/371472 [10:04:33<18:57:48,  3.59it/s]
 34%|███▍      | 126706/371472 [10:04:33<19:42:10,  3.45it/s]
 34%|███▍      | 126707/371472 [10:04:33<19:09:06,  3.55it/s]
 34%|███▍      | 126708/371472 [10:04:34<19:40:31,  3.46it/s]
 34%|███▍      | 126709/371472 [10:04:34<20:37:29,  3.30it/s]
 34%|███▍      | 126710/371472 [10:04:34<21:03:17,  3.23it/s]
 34%|███▍      | 126711/371472 [10:04:34<20:14:33,  3.36it/s]
 34%|███▍      | 126712/371472 [10:04:35<20:16:07,  3.35it/s]
 34%|███▍      | 126713/371472 [10:04:35<20:30:00,  3.32it/s]
 34%|███▍      | 126714/371472 [10:04:35<19:24:47,  3.50it/s]
 34%|███▍      | 126715/371472 [10:04:36<18:48:05,  3.62it/s]
 34%|███▍      | 126716/371472 [10:04:36<18:09:48,  3.74it/s]
 34%|███▍      | 126717/371472 [10:04:36<18:56:54,  3.59it/s]
 34%|███▍      | 126718/371472 [10:04:36<18:39:31,  3.64it/s]
 34%|███▍      | 126719/371472 [10:04:37<19:10:52,  3.54it/s]
 34%|███▍      | 126720/371472 [10:04:37<19:26:21,  3.50it/s]
                                                             
{'loss': 3.2372, 'learning_rate': 6.933030231205155e-07, 'epoch': 5.46}

 34%|███▍      | 126720/371472 [10:04:37<19:26:21,  3.50it/s]
 34%|███▍      | 126721/371472 [10:04:37<19:07:02,  3.56it/s]
 34%|███▍      | 126722/371472 [10:04:37<18:15:02,  3.73it/s]
 34%|███▍      | 126723/371472 [10:04:38<18:50:58,  3.61it/s]
 34%|███▍      | 126724/371472 [10:04:38<18:42:35,  3.63it/s]
 34%|███▍      | 126725/371472 [10:04:38<19:57:42,  3.41it/s]
 34%|███▍      | 126726/371472 [10:04:39<20:15:01,  3.36it/s]
 34%|███▍      | 126727/371472 [10:04:39<20:06:28,  3.38it/s]
 34%|███▍      | 126728/371472 [10:04:39<20:55:27,  3.25it/s]
 34%|███▍      | 126729/371472 [10:04:40<21:18:09,  3.19it/s]
 34%|███▍      | 126730/371472 [10:04:40<21:30:25,  3.16it/s]
 34%|███▍      | 126731/371472 [10:04:40<20:28:24,  3.32it/s]
 34%|███▍      | 126732/371472 [10:04:40<19:17:50,  3.52it/s]
 34%|███▍      | 126733/371472 [10:04:41<18:13:51,  3.73it/s]
 34%|███▍      | 126734/371472 [10:04:41<18:09:03,  3.75it/s]
 34%|███▍      | 126735/371472 [10:04:41<18:09:24,  3.74it/s]
 34%|███▍      | 126736/371472 [10:04:41<17:50:06,  3.81it/s]
 34%|███▍      | 126737/371472 [10:04:42<19:32:15,  3.48it/s]
 34%|███▍      | 126738/371472 [10:04:42<19:34:31,  3.47it/s]
 34%|███▍      | 126739/371472 [10:04:42<20:31:06,  3.31it/s]
 34%|███▍      | 126740/371472 [10:04:43<21:27:01,  3.17it/s]
                                                             
{'loss': 3.2105, 'learning_rate': 6.932545411450364e-07, 'epoch': 5.46}

 34%|███▍      | 126740/371472 [10:04:43<21:27:01,  3.17it/s]
 34%|███▍      | 126741/371472 [10:04:43<21:53:27,  3.11it/s]
 34%|███▍      | 126742/371472 [10:04:43<21:55:04,  3.10it/s]
 34%|███▍      | 126743/371472 [10:04:44<20:58:32,  3.24it/s]
 34%|███▍      | 126744/371472 [10:04:44<19:48:31,  3.43it/s]
 34%|███▍      | 126745/371472 [10:04:44<19:06:40,  3.56it/s]
 34%|███▍      | 126746/371472 [10:04:45<19:06:59,  3.56it/s]
 34%|███▍      | 126747/371472 [10:04:45<19:43:21,  3.45it/s]
 34%|███▍      | 126748/371472 [10:04:45<20:52:47,  3.26it/s]
 34%|███▍      | 126749/371472 [10:04:45<20:14:18,  3.36it/s]
 34%|███▍      | 126750/371472 [10:04:46<19:35:05,  3.47it/s]
 34%|███▍      | 126751/371472 [10:04:46<20:19:13,  3.35it/s]
 34%|███▍      | 126752/371472 [10:04:46<19:47:16,  3.44it/s]
 34%|███▍      | 126753/371472 [10:04:47<18:54:01,  3.60it/s]
 34%|███▍      | 126754/371472 [10:04:47<18:38:35,  3.65it/s]
 34%|███▍      | 126755/371472 [10:04:47<17:56:19,  3.79it/s]
 34%|███▍      | 126756/371472 [10:04:47<18:37:27,  3.65it/s]
 34%|███▍      | 126757/371472 [10:04:48<18:02:28,  3.77it/s]
 34%|███▍      | 126758/371472 [10:04:48<17:56:56,  3.79it/s]
 34%|███▍      | 126759/371472 [10:04:48<17:53:17,  3.80it/s]
 34%|███▍      | 126760/371472 [10:04:48<18:13:39,  3.73it/s]
                                                             
{'loss': 3.1491, 'learning_rate': 6.932060591695575e-07, 'epoch': 5.46}

 34%|███▍      | 126760/371472 [10:04:48<18:13:39,  3.73it/s]
 34%|███▍      | 126761/371472 [10:04:49<19:07:56,  3.55it/s]
 34%|███▍      | 126762/371472 [10:04:49<19:44:17,  3.44it/s]
 34%|███▍      | 126763/371472 [10:04:49<20:16:38,  3.35it/s]
 34%|███▍      | 126764/371472 [10:04:50<19:57:02,  3.41it/s]
 34%|███▍      | 126765/371472 [10:04:50<20:07:43,  3.38it/s]
 34%|███▍      | 126766/371472 [10:04:50<21:11:52,  3.21it/s]
 34%|███▍      | 126767/371472 [10:04:51<20:54:26,  3.25it/s]
 34%|███▍      | 126768/371472 [10:04:51<20:42:31,  3.28it/s]
 34%|███▍      | 126769/371472 [10:04:51<21:01:24,  3.23it/s]
 34%|███▍      | 126770/371472 [10:04:52<20:40:56,  3.29it/s]
 34%|███▍      | 126771/371472 [10:04:52<21:00:23,  3.24it/s]
 34%|███▍      | 126772/371472 [10:04:52<20:19:01,  3.35it/s]
 34%|███▍      | 126773/371472 [10:04:52<21:49:51,  3.11it/s]
 34%|███▍      | 126774/371472 [10:04:53<21:18:40,  3.19it/s]
 34%|███▍      | 126775/371472 [10:04:53<21:47:38,  3.12it/s]
 34%|███▍      | 126776/371472 [10:04:53<20:40:42,  3.29it/s]
 34%|███▍      | 126777/371472 [10:04:54<19:10:46,  3.54it/s]
 34%|███▍      | 126778/371472 [10:04:54<18:22:33,  3.70it/s]
 34%|███▍      | 126779/371472 [10:04:54<18:27:40,  3.68it/s]
 34%|███▍      | 126780/371472 [10:04:54<18:04:30,  3.76it/s]
                                                             
{'loss': 3.1326, 'learning_rate': 6.931575771940788e-07, 'epoch': 5.46}

 34%|███▍      | 126780/371472 [10:04:54<18:04:30,  3.76it/s]
 34%|███▍      | 126781/371472 [10:04:55<19:30:28,  3.48it/s]
 34%|███▍      | 126782/371472 [10:04:55<19:01:00,  3.57it/s]
 34%|███▍      | 126783/371472 [10:04:55<18:24:56,  3.69it/s]
 34%|███▍      | 126784/371472 [10:04:56<19:14:13,  3.53it/s]
 34%|███▍      | 126785/371472 [10:04:56<20:25:59,  3.33it/s]
 34%|███▍      | 126786/371472 [10:04:56<19:16:28,  3.53it/s]
 34%|███▍      | 126787/371472 [10:04:56<18:47:04,  3.62it/s]
 34%|███▍      | 126788/371472 [10:04:57<19:34:00,  3.47it/s]
 34%|███▍      | 126789/371472 [10:04:57<20:56:21,  3.25it/s]
 34%|███▍      | 126790/371472 [10:04:57<21:07:59,  3.22it/s]
 34%|███▍      | 126791/371472 [10:04:58<20:13:18,  3.36it/s]
 34%|███▍      | 126792/371472 [10:04:58<19:51:06,  3.42it/s]
 34%|███▍      | 126793/371472 [10:04:58<20:18:38,  3.35it/s]
 34%|███▍      | 126794/371472 [10:04:59<20:42:27,  3.28it/s]
 34%|███▍      | 126795/371472 [10:04:59<19:46:03,  3.44it/s]
 34%|███▍      | 126796/371472 [10:04:59<19:39:40,  3.46it/s]
 34%|███▍      | 126797/371472 [10:04:59<19:30:57,  3.48it/s]
 34%|███▍      | 126798/371472 [10:05:00<19:26:45,  3.50it/s]
 34%|███▍      | 126799/371472 [10:05:00<19:22:09,  3.51it/s]
 34%|███▍      | 126800/371472 [10:05:00<20:50:29,  3.26it/s]
                                                             
{'loss': 3.0921, 'learning_rate': 6.931090952185999e-07, 'epoch': 5.46}

 34%|███▍      | 126800/371472 [10:05:00<20:50:29,  3.26it/s]
 34%|███▍      | 126801/371472 [10:05:01<23:29:36,  2.89it/s]
 34%|███▍      | 126802/371472 [10:05:01<23:41:40,  2.87it/s]
 34%|███▍      | 126803/371472 [10:05:01<21:48:36,  3.12it/s]
 34%|███▍      | 126804/371472 [10:05:02<21:16:10,  3.20it/s]
 34%|███▍      | 126805/371472 [10:05:02<19:49:45,  3.43it/s]
 34%|███▍      | 126806/371472 [10:05:02<18:35:53,  3.65it/s]
 34%|███▍      | 126807/371472 [10:05:02<19:54:42,  3.41it/s]
 34%|███▍      | 126808/371472 [10:05:03<19:21:14,  3.51it/s]
 34%|███▍      | 126809/371472 [10:05:03<19:51:47,  3.42it/s]
 34%|███▍      | 126810/371472 [10:05:03<19:38:46,  3.46it/s]
 34%|███▍      | 126811/371472 [10:05:04<19:56:17,  3.41it/s]
 34%|███▍      | 126812/371472 [10:05:04<20:37:53,  3.29it/s]
 34%|███▍      | 126813/371472 [10:05:04<19:46:20,  3.44it/s]
 34%|███▍      | 126814/371472 [10:05:05<20:35:36,  3.30it/s]
 34%|███▍      | 126815/371472 [10:05:05<19:26:24,  3.50it/s]
 34%|███▍      | 126816/371472 [10:05:05<27:15:42,  2.49it/s]
 34%|███▍      | 126817/371472 [10:05:06<24:40:36,  2.75it/s]
 34%|███▍      | 126818/371472 [10:05:06<23:06:02,  2.94it/s]
 34%|███▍      | 126819/371472 [10:05:06<22:00:02,  3.09it/s]
 34%|███▍      | 126820/371472 [10:05:07<22:09:22,  3.07it/s]
                                                             
{'loss': 2.9035, 'learning_rate': 6.930606132431209e-07, 'epoch': 5.46}

 34%|███▍      | 126820/371472 [10:05:07<22:09:22,  3.07it/s]
 34%|███▍      | 126821/371472 [10:05:07<22:16:27,  3.05it/s]
 34%|███▍      | 126822/371472 [10:05:07<22:19:05,  3.04it/s]
 34%|███▍      | 126823/371472 [10:05:08<20:48:57,  3.26it/s]
 34%|███▍      | 126824/371472 [10:05:08<20:12:33,  3.36it/s]
 34%|███▍      | 126825/371472 [10:05:08<19:37:39,  3.46it/s]
 34%|███▍      | 126826/371472 [10:05:08<20:06:54,  3.38it/s]
 34%|███▍      | 126827/371472 [10:05:09<19:29:43,  3.49it/s]
 34%|███▍      | 126828/371472 [10:05:09<19:30:46,  3.48it/s]
 34%|███▍      | 126829/371472 [10:05:09<20:07:41,  3.38it/s]
 34%|███▍      | 126830/371472 [10:05:10<20:13:46,  3.36it/s]
 34%|███▍      | 126831/371472 [10:05:10<20:27:20,  3.32it/s]
 34%|███▍      | 126832/371472 [10:05:10<22:46:30,  2.98it/s]
 34%|███▍      | 126833/371472 [10:05:11<21:18:57,  3.19it/s]
 34%|███▍      | 126834/371472 [10:05:11<20:35:30,  3.30it/s]
 34%|███▍      | 126835/371472 [10:05:11<19:50:04,  3.43it/s]
 34%|███▍      | 126836/371472 [10:05:11<20:19:53,  3.34it/s]
 34%|███▍      | 126837/371472 [10:05:12<21:11:33,  3.21it/s]
 34%|███▍      | 126838/371472 [10:05:12<20:29:28,  3.32it/s]
 34%|███▍      | 126839/371472 [10:05:12<19:51:28,  3.42it/s]
 34%|███▍      | 126840/371472 [10:05:13<19:23:05,  3.51it/s]
                                                             
{'loss': 3.2621, 'learning_rate': 6.93012131267642e-07, 'epoch': 5.46}

 34%|███▍      | 126840/371472 [10:05:13<19:23:05,  3.51it/s]
 34%|███▍      | 126841/371472 [10:05:13<19:40:45,  3.45it/s]
 34%|███▍      | 126842/371472 [10:05:13<19:48:48,  3.43it/s]
 34%|███▍      | 126843/371472 [10:05:13<19:24:47,  3.50it/s]
 34%|███▍      | 126844/371472 [10:05:14<19:13:00,  3.54it/s]
 34%|███▍      | 126845/371472 [10:05:14<18:31:02,  3.67it/s]
 34%|███▍      | 126846/371472 [10:05:14<18:28:22,  3.68it/s]
 34%|███▍      | 126847/371472 [10:05:15<20:50:22,  3.26it/s]
 34%|███▍      | 126848/371472 [10:05:15<19:56:08,  3.41it/s]
 34%|███▍      | 126849/371472 [10:05:15<19:30:13,  3.48it/s]
 34%|███▍      | 126850/371472 [10:05:15<18:43:56,  3.63it/s]
 34%|███▍      | 126851/371472 [10:05:16<18:53:53,  3.60it/s]
 34%|███▍      | 126852/371472 [10:05:16<19:42:08,  3.45it/s]
 34%|███▍      | 126853/371472 [10:05:16<20:55:58,  3.25it/s]
 34%|███▍      | 126854/371472 [10:05:17<20:16:18,  3.35it/s]
 34%|███▍      | 126855/371472 [10:05:17<19:05:38,  3.56it/s]
 34%|███▍      | 126856/371472 [10:05:17<18:38:13,  3.65it/s]
 34%|███▍      | 126857/371472 [10:05:17<19:06:35,  3.56it/s]
 34%|███▍      | 126858/371472 [10:05:18<18:41:54,  3.63it/s]
 34%|███▍      | 126859/371472 [10:05:18<18:32:47,  3.66it/s]
 34%|███▍      | 126860/371472 [10:05:18<20:21:36,  3.34it/s]
                                                             
{'loss': 3.3112, 'learning_rate': 6.929636492921631e-07, 'epoch': 5.46}

 34%|███▍      | 126860/371472 [10:05:18<20:21:36,  3.34it/s]
 34%|███▍      | 126861/371472 [10:05:19<19:51:12,  3.42it/s]
 34%|███▍      | 126862/371472 [10:05:19<20:38:42,  3.29it/s]
 34%|███▍      | 126863/371472 [10:05:19<19:36:30,  3.47it/s]
 34%|███▍      | 126864/371472 [10:05:19<19:40:10,  3.45it/s]
 34%|███▍      | 126865/371472 [10:05:20<19:04:32,  3.56it/s]
 34%|███▍      | 126866/371472 [10:05:20<20:41:42,  3.28it/s]
 34%|███▍      | 126867/371472 [10:05:20<19:41:41,  3.45it/s]
 34%|███▍      | 126868/371472 [10:05:21<18:54:29,  3.59it/s]
 34%|███▍      | 126869/371472 [10:05:21<18:29:42,  3.67it/s]
 34%|███▍      | 126870/371472 [10:05:21<18:00:42,  3.77it/s]
 34%|███▍      | 126871/371472 [10:05:21<18:28:04,  3.68it/s]
 34%|███▍      | 126872/371472 [10:05:22<18:03:11,  3.76it/s]
 34%|███▍      | 126873/371472 [10:05:22<18:21:40,  3.70it/s]
 34%|███▍      | 126874/371472 [10:05:22<18:50:33,  3.61it/s]
 34%|███▍      | 126875/371472 [10:05:22<18:04:31,  3.76it/s]
 34%|███▍      | 126876/371472 [10:05:23<19:37:52,  3.46it/s]
 34%|███▍      | 126877/371472 [10:05:23<19:32:36,  3.48it/s]
 34%|███▍      | 126878/371472 [10:05:23<18:51:09,  3.60it/s]
 34%|███▍      | 126879/371472 [10:05:24<18:31:52,  3.67it/s]
 34%|███▍      | 126880/371472 [10:05:24<18:21:41,  3.70it/s]
                                                             
{'loss': 3.2661, 'learning_rate': 6.929151673166843e-07, 'epoch': 5.46}

 34%|███▍      | 126880/371472 [10:05:24<18:21:41,  3.70it/s]
 34%|███▍      | 126881/371472 [10:05:24<18:15:38,  3.72it/s]
 34%|███▍      | 126882/371472 [10:05:24<19:00:10,  3.58it/s]
 34%|███▍      | 126883/371472 [10:05:25<19:59:03,  3.40it/s]
 34%|███▍      | 126884/371472 [10:05:25<19:37:44,  3.46it/s]
 34%|███▍      | 126885/371472 [10:05:25<18:40:57,  3.64it/s]
 34%|███▍      | 126886/371472 [10:05:26<19:19:55,  3.51it/s]
 34%|███▍      | 126887/371472 [10:05:26<20:05:46,  3.38it/s]
 34%|███▍      | 126888/371472 [10:05:26<21:39:07,  3.14it/s]
 34%|███▍      | 126889/371472 [10:05:27<20:28:28,  3.32it/s]
 34%|███▍      | 126890/371472 [10:05:27<19:34:28,  3.47it/s]
 34%|███▍      | 126891/371472 [10:05:27<18:32:41,  3.66it/s]
 34%|███▍      | 126892/371472 [10:05:27<18:11:03,  3.74it/s]
 34%|███▍      | 126893/371472 [10:05:28<18:57:44,  3.58it/s]
 34%|███▍      | 126894/371472 [10:05:28<19:53:45,  3.41it/s]
 34%|███▍      | 126895/371472 [10:05:28<19:58:14,  3.40it/s]
 34%|███▍      | 126896/371472 [10:05:29<20:18:10,  3.35it/s]
 34%|███▍      | 126897/371472 [10:05:29<19:28:45,  3.49it/s]
 34%|███▍      | 126898/371472 [10:05:29<18:54:14,  3.59it/s]
 34%|███▍      | 126899/371472 [10:05:29<19:36:45,  3.46it/s]
 34%|███▍      | 126900/371472 [10:05:30<19:05:09,  3.56it/s]
                                                             
{'loss': 3.2265, 'learning_rate': 6.928666853412053e-07, 'epoch': 5.47}

 34%|███▍      | 126900/371472 [10:05:30<19:05:09,  3.56it/s]
 34%|███▍      | 126901/371472 [10:05:30<18:17:48,  3.71it/s]
 34%|███▍      | 126902/371472 [10:05:30<18:12:22,  3.73it/s]
 34%|███▍      | 126903/371472 [10:05:30<18:07:38,  3.75it/s]
 34%|███▍      | 126904/371472 [10:05:31<18:25:20,  3.69it/s]
 34%|███▍      | 126905/371472 [10:05:31<18:08:14,  3.75it/s]
 34%|███▍      | 126906/371472 [10:05:31<18:22:37,  3.70it/s]
 34%|███▍      | 126907/371472 [10:05:31<18:14:00,  3.73it/s]
 34%|███▍      | 126908/371472 [10:05:32<17:59:32,  3.78it/s]
 34%|███▍      | 126909/371472 [10:05:32<19:10:46,  3.54it/s]
 34%|███▍      | 126910/371472 [10:05:32<18:48:51,  3.61it/s]
 34%|███▍      | 126911/371472 [10:05:33<20:39:46,  3.29it/s]
 34%|███▍      | 126912/371472 [10:05:33<20:24:38,  3.33it/s]
 34%|███▍      | 126913/371472 [10:05:33<20:01:46,  3.39it/s]
 34%|███▍      | 126914/371472 [10:05:34<20:50:20,  3.26it/s]
 34%|███▍      | 126915/371472 [10:05:34<20:28:11,  3.32it/s]
 34%|███▍      | 126916/371472 [10:05:34<19:49:44,  3.43it/s]
 34%|███▍      | 126917/371472 [10:05:34<20:08:13,  3.37it/s]
 34%|███▍      | 126918/371472 [10:05:35<19:10:35,  3.54it/s]
 34%|███▍      | 126919/371472 [10:05:35<19:21:22,  3.51it/s]
 34%|███▍      | 126920/371472 [10:05:35<18:39:42,  3.64it/s]
                                                             
{'loss': 3.3469, 'learning_rate': 6.928182033657264e-07, 'epoch': 5.47}

 34%|███▍      | 126920/371472 [10:05:35<18:39:42,  3.64it/s]
 34%|███▍      | 126921/371472 [10:05:36<18:47:32,  3.61it/s]
 34%|███▍      | 126922/371472 [10:05:36<18:48:51,  3.61it/s]
 34%|███▍      | 126923/371472 [10:05:36<18:48:27,  3.61it/s]
 34%|███▍      | 126924/371472 [10:05:36<18:26:01,  3.69it/s]
 34%|███▍      | 126925/371472 [10:05:37<18:00:00,  3.77it/s]
 34%|███▍      | 126926/371472 [10:05:37<17:43:45,  3.83it/s]
 34%|███▍      | 126927/371472 [10:05:37<17:52:22,  3.80it/s]
 34%|███▍      | 126928/371472 [10:05:37<17:33:48,  3.87it/s]
 34%|███▍      | 126929/371472 [10:05:38<17:15:10,  3.94it/s]
 34%|███▍      | 126930/371472 [10:05:38<17:37:27,  3.85it/s]
 34%|███▍      | 126931/371472 [10:05:38<17:53:43,  3.80it/s]
 34%|███▍      | 126932/371472 [10:05:38<19:02:31,  3.57it/s]
 34%|███▍      | 126933/371472 [10:05:39<18:40:35,  3.64it/s]
 34%|███▍      | 126934/371472 [10:05:39<19:42:26,  3.45it/s]
 34%|███▍      | 126935/371472 [10:05:39<19:24:30,  3.50it/s]
 34%|███▍      | 126936/371472 [10:05:40<19:17:51,  3.52it/s]
 34%|███▍      | 126937/371472 [10:05:40<19:59:37,  3.40it/s]
 34%|███▍      | 126938/371472 [10:05:40<19:42:11,  3.45it/s]
 34%|███▍      | 126939/371472 [10:05:41<20:48:56,  3.26it/s]
 34%|███▍      | 126940/371472 [10:05:41<20:07:17,  3.38it/s]
                                                             
{'loss': 3.2671, 'learning_rate': 6.927697213902476e-07, 'epoch': 5.47}

 34%|███▍      | 126940/371472 [10:05:41<20:07:17,  3.38it/s]
 34%|███▍      | 126941/371472 [10:05:41<21:22:59,  3.18it/s]
 34%|███▍      | 126942/371472 [10:05:42<21:01:21,  3.23it/s]
 34%|███▍      | 126943/371472 [10:05:42<21:53:17,  3.10it/s]
 34%|███▍      | 126944/371472 [10:05:42<20:33:31,  3.30it/s]
 34%|███▍      | 126945/371472 [10:05:42<19:07:57,  3.55it/s]
 34%|███▍      | 126946/371472 [10:05:43<18:40:39,  3.64it/s]
 34%|███▍      | 126947/371472 [10:05:43<18:34:28,  3.66it/s]
 34%|███▍      | 126948/371472 [10:05:43<18:16:53,  3.72it/s]
 34%|███▍      | 126949/371472 [10:05:43<18:07:33,  3.75it/s]
 34%|███▍      | 126950/371472 [10:05:44<20:33:14,  3.30it/s]
 34%|███▍      | 126951/371472 [10:05:44<19:59:02,  3.40it/s]
 34%|███▍      | 126952/371472 [10:05:44<18:51:19,  3.60it/s]
 34%|███▍      | 126953/371472 [10:05:45<18:36:56,  3.65it/s]
 34%|███▍      | 126954/371472 [10:05:45<18:15:57,  3.72it/s]
 34%|███▍      | 126955/371472 [10:05:45<18:28:37,  3.68it/s]
 34%|███▍      | 126956/371472 [10:05:45<18:34:47,  3.66it/s]
 34%|███▍      | 126957/371472 [10:05:46<18:16:05,  3.72it/s]
 34%|███▍      | 126958/371472 [10:05:46<17:42:04,  3.84it/s]
 34%|███▍      | 126959/371472 [10:05:46<17:12:43,  3.95it/s]
 34%|███▍      | 126960/371472 [10:05:46<17:57:52,  3.78it/s]
                                                             
{'loss': 3.1797, 'learning_rate': 6.927212394147688e-07, 'epoch': 5.47}

 34%|███▍      | 126960/371472 [10:05:46<17:57:52,  3.78it/s]
 34%|███▍      | 126961/371472 [10:05:47<18:39:14,  3.64it/s]
 34%|███▍      | 126962/371472 [10:05:47<18:06:43,  3.75it/s]
 34%|███▍      | 126963/371472 [10:05:47<17:30:48,  3.88it/s]
 34%|███▍      | 126964/371472 [10:05:48<19:15:43,  3.53it/s]
 34%|███▍      | 126965/371472 [10:05:48<19:07:22,  3.55it/s]
 34%|███▍      | 126966/371472 [10:05:48<18:16:23,  3.72it/s]
 34%|███▍      | 126967/371472 [10:05:48<18:59:42,  3.58it/s]
 34%|███▍      | 126968/371472 [10:05:49<18:40:12,  3.64it/s]
 34%|███▍      | 126969/371472 [10:05:49<18:26:21,  3.68it/s]
 34%|███▍      | 126970/371472 [10:05:49<18:46:34,  3.62it/s]
 34%|███▍      | 126971/371472 [10:05:49<18:58:49,  3.58it/s]
 34%|███▍      | 126972/371472 [10:05:50<18:58:10,  3.58it/s]
 34%|███▍      | 126973/371472 [10:05:50<18:13:34,  3.73it/s]
 34%|███▍      | 126974/371472 [10:05:50<18:10:19,  3.74it/s]
 34%|███▍      | 126975/371472 [10:05:50<17:34:10,  3.87it/s]
 34%|███▍      | 126976/371472 [10:05:51<17:28:18,  3.89it/s]
 34%|███▍      | 126977/371472 [10:05:51<17:11:24,  3.95it/s]
 34%|███▍      | 126978/371472 [10:05:51<17:10:40,  3.95it/s]
 34%|███▍      | 126979/371472 [10:05:52<17:49:32,  3.81it/s]
 34%|███▍      | 126980/371472 [10:05:52<17:37:30,  3.85it/s]
                                                             
{'loss': 3.3644, 'learning_rate': 6.926727574392897e-07, 'epoch': 5.47}

 34%|███▍      | 126980/371472 [10:05:52<17:37:30,  3.85it/s]
 34%|███▍      | 126981/371472 [10:05:52<19:12:39,  3.54it/s]
 34%|███▍      | 126982/371472 [10:05:52<18:53:10,  3.60it/s]
 34%|███▍      | 126983/371472 [10:05:53<18:16:59,  3.71it/s]
 34%|███▍      | 126984/371472 [10:05:53<18:31:43,  3.67it/s]
 34%|███▍      | 126985/371472 [10:05:53<18:01:36,  3.77it/s]
 34%|███▍      | 126986/371472 [10:05:53<18:04:54,  3.76it/s]
 34%|███▍      | 126987/371472 [10:05:54<18:27:44,  3.68it/s]
 34%|███▍      | 126988/371472 [10:05:54<19:18:34,  3.52it/s]
 34%|███▍      | 126989/371472 [10:05:54<19:53:16,  3.41it/s]
 34%|███▍      | 126990/371472 [10:05:55<19:26:33,  3.49it/s]
 34%|███▍      | 126991/371472 [10:05:55<18:48:23,  3.61it/s]
 34%|███▍      | 126992/371472 [10:05:55<18:34:07,  3.66it/s]
 34%|███▍      | 126993/371472 [10:05:55<18:40:43,  3.64it/s]
 34%|███▍      | 126994/371472 [10:05:56<19:54:57,  3.41it/s]
 34%|███▍      | 126995/371472 [10:05:56<18:46:15,  3.62it/s]
 34%|███▍      | 126996/371472 [10:05:56<19:46:01,  3.44it/s]
 34%|███▍      | 126997/371472 [10:05:57<20:42:20,  3.28it/s]
 34%|███▍      | 126998/371472 [10:05:57<19:51:58,  3.42it/s]
 34%|███▍      | 126999/371472 [10:05:57<20:00:36,  3.39it/s]
 34%|███▍      | 127000/371472 [10:05:57<20:07:50,  3.37it/s]
                                                             
{'loss': 3.188, 'learning_rate': 6.926242754638108e-07, 'epoch': 5.47}

 34%|███▍      | 127000/371472 [10:05:57<20:07:50,  3.37it/s]
 34%|███▍      | 127001/371472 [10:05:58<19:47:58,  3.43it/s]
 34%|███▍      | 127002/371472 [10:05:58<19:33:46,  3.47it/s]
 34%|███▍      | 127003/371472 [10:05:58<19:02:24,  3.57it/s]
 34%|███▍      | 127004/371472 [10:05:59<18:14:06,  3.72it/s]
 34%|███▍      | 127005/371472 [10:05:59<18:15:06,  3.72it/s]
 34%|███▍      | 127006/371472 [10:05:59<19:38:56,  3.46it/s]
 34%|███▍      | 127007/371472 [10:05:59<19:03:03,  3.56it/s]
 34%|███▍      | 127008/371472 [10:06:00<18:47:36,  3.61it/s]
 34%|███▍      | 127009/371472 [10:06:00<18:33:24,  3.66it/s]
 34%|███▍      | 127010/371472 [10:06:00<19:13:58,  3.53it/s]
 34%|███▍      | 127011/371472 [10:06:01<19:24:55,  3.50it/s]
 34%|███▍      | 127012/371472 [10:06:01<19:26:27,  3.49it/s]
 34%|███▍      | 127013/371472 [10:06:01<18:48:47,  3.61it/s]
 34%|███▍      | 127014/371472 [10:06:01<19:42:13,  3.45it/s]
 34%|███▍      | 127015/371472 [10:06:02<19:32:55,  3.47it/s]
 34%|███▍      | 127016/371472 [10:06:02<18:35:08,  3.65it/s]
 34%|███▍      | 127017/371472 [10:06:02<19:26:26,  3.49it/s]
 34%|███▍      | 127018/371472 [10:06:02<18:17:06,  3.71it/s]
 34%|███▍      | 127019/371472 [10:06:03<19:02:22,  3.57it/s]
 34%|███▍      | 127020/371472 [10:06:03<19:11:48,  3.54it/s]
                                                             
{'loss': 3.1395, 'learning_rate': 6.92575793488332e-07, 'epoch': 5.47}

 34%|███▍      | 127020/371472 [10:06:03<19:11:48,  3.54it/s]
 34%|███▍      | 127021/371472 [10:06:03<20:14:44,  3.35it/s]
 34%|███▍      | 127022/371472 [10:06:04<18:58:07,  3.58it/s]
 34%|███▍      | 127023/371472 [10:06:04<19:55:09,  3.41it/s]
 34%|███▍      | 127024/371472 [10:06:04<20:12:37,  3.36it/s]
 34%|███▍      | 127025/371472 [10:06:05<19:24:02,  3.50it/s]
 34%|███▍      | 127026/371472 [10:06:05<19:11:43,  3.54it/s]
 34%|███▍      | 127027/371472 [10:06:05<18:38:27,  3.64it/s]
 34%|███▍      | 127028/371472 [10:06:05<18:36:26,  3.65it/s]
 34%|███▍      | 127029/371472 [10:06:06<19:04:39,  3.56it/s]
 34%|███▍      | 127030/371472 [10:06:06<20:08:23,  3.37it/s]
 34%|███▍      | 127031/371472 [10:06:06<19:29:22,  3.48it/s]
 34%|███▍      | 127032/371472 [10:06:07<19:33:23,  3.47it/s]
 34%|███▍      | 127033/371472 [10:06:07<20:56:14,  3.24it/s]
 34%|███▍      | 127034/371472 [10:06:07<19:25:28,  3.50it/s]
 34%|███▍      | 127035/371472 [10:06:07<18:44:14,  3.62it/s]
 34%|███▍      | 127036/371472 [10:06:08<18:10:30,  3.74it/s]
 34%|███▍      | 127037/371472 [10:06:08<19:20:45,  3.51it/s]
 34%|███▍      | 127038/371472 [10:06:08<18:59:49,  3.57it/s]
 34%|███▍      | 127039/371472 [10:06:09<19:11:17,  3.54it/s]
 34%|███▍      | 127040/371472 [10:06:09<19:05:14,  3.56it/s]
                                                             
{'loss': 3.2592, 'learning_rate': 6.925273115128532e-07, 'epoch': 5.47}

 34%|███▍      | 127040/371472 [10:06:09<19:05:14,  3.56it/s]
 34%|███▍      | 127041/371472 [10:06:09<19:41:49,  3.45it/s]
 34%|███▍      | 127042/371472 [10:06:09<18:57:14,  3.58it/s]
 34%|███▍      | 127043/371472 [10:06:10<19:57:13,  3.40it/s]
 34%|███▍      | 127044/371472 [10:06:10<19:09:54,  3.54it/s]
 34%|███▍      | 127045/371472 [10:06:10<18:44:43,  3.62it/s]
 34%|███▍      | 127046/371472 [10:06:10<17:55:01,  3.79it/s]
 34%|███▍      | 127047/371472 [10:06:11<18:37:16,  3.65it/s]
 34%|███▍      | 127048/371472 [10:06:11<18:16:30,  3.72it/s]
 34%|███▍      | 127049/371472 [10:06:11<17:32:20,  3.87it/s]
 34%|███▍      | 127050/371472 [10:06:12<18:29:40,  3.67it/s]
 34%|███▍      | 127051/371472 [10:06:12<18:00:28,  3.77it/s]
 34%|███▍      | 127052/371472 [10:06:12<17:44:53,  3.83it/s]
 34%|███▍      | 127053/371472 [10:06:12<17:50:41,  3.80it/s]
 34%|███▍      | 127054/371472 [10:06:13<17:46:59,  3.82it/s]
 34%|███▍      | 127055/371472 [10:06:13<17:10:10,  3.95it/s]
 34%|███▍      | 127056/371472 [10:06:13<17:45:15,  3.82it/s]
 34%|███▍      | 127057/371472 [10:06:13<18:14:24,  3.72it/s]
 34%|███▍      | 127058/371472 [10:06:14<18:05:14,  3.75it/s]
 34%|███▍      | 127059/371472 [10:06:14<17:42:28,  3.83it/s]
 34%|███▍      | 127060/371472 [10:06:14<18:01:36,  3.77it/s]
                                                             
{'loss': 3.2996, 'learning_rate': 6.924788295373742e-07, 'epoch': 5.47}

 34%|███▍      | 127060/371472 [10:06:14<18:01:36,  3.77it/s]
 34%|███▍      | 127061/371472 [10:06:14<17:52:18,  3.80it/s]
 34%|███▍      | 127062/371472 [10:06:15<23:30:56,  2.89it/s]
 34%|███▍      | 127063/371472 [10:06:15<21:59:12,  3.09it/s]
 34%|███▍      | 127064/371472 [10:06:15<20:47:59,  3.26it/s]
 34%|███▍      | 127065/371472 [10:06:16<21:01:54,  3.23it/s]
 34%|███▍      | 127066/371472 [10:06:16<20:05:01,  3.38it/s]
 34%|███▍      | 127067/371472 [10:06:16<19:29:50,  3.48it/s]
 34%|███▍      | 127068/371472 [10:06:17<18:46:44,  3.62it/s]
 34%|███▍      | 127069/371472 [10:06:17<18:10:07,  3.74it/s]
 34%|███▍      | 127070/371472 [10:06:17<18:28:23,  3.68it/s]
 34%|███▍      | 127071/371472 [10:06:17<18:30:49,  3.67it/s]
 34%|███▍      | 127072/371472 [10:06:18<18:07:13,  3.75it/s]
 34%|███▍      | 127073/371472 [10:06:18<18:28:18,  3.68it/s]
 34%|███▍      | 127074/371472 [10:06:18<18:26:26,  3.68it/s]
 34%|███▍      | 127075/371472 [10:06:18<18:59:31,  3.57it/s]
 34%|███▍      | 127076/371472 [10:06:19<18:39:01,  3.64it/s]
 34%|███▍      | 127077/371472 [10:06:19<18:40:48,  3.63it/s]
 34%|███▍      | 127078/371472 [10:06:19<18:09:49,  3.74it/s]
 34%|███▍      | 127079/371472 [10:06:20<18:23:00,  3.69it/s]
 34%|███▍      | 127080/371472 [10:06:20<18:33:22,  3.66it/s]
                                                             
{'loss': 3.1774, 'learning_rate': 6.924303475618953e-07, 'epoch': 5.47}

 34%|███▍      | 127080/371472 [10:06:20<18:33:22,  3.66it/s]
 34%|███▍      | 127081/371472 [10:06:20<18:23:07,  3.69it/s]
 34%|███▍      | 127082/371472 [10:06:20<18:07:38,  3.74it/s]
 34%|███▍      | 127083/371472 [10:06:21<18:57:43,  3.58it/s]
 34%|███▍      | 127084/371472 [10:06:21<18:39:29,  3.64it/s]
 34%|███▍      | 127085/371472 [10:06:21<18:34:23,  3.66it/s]
 34%|███▍      | 127086/371472 [10:06:21<18:58:42,  3.58it/s]
 34%|███▍      | 127087/371472 [10:06:22<18:56:08,  3.59it/s]
 34%|███▍      | 127088/371472 [10:06:22<18:51:31,  3.60it/s]
 34%|███▍      | 127089/371472 [10:06:22<18:26:10,  3.68it/s]
 34%|███▍      | 127090/371472 [10:06:23<18:10:44,  3.73it/s]
 34%|███▍      | 127091/371472 [10:06:23<18:37:00,  3.65it/s]
 34%|███▍      | 127092/371472 [10:06:23<18:54:17,  3.59it/s]
 34%|███▍      | 127093/371472 [10:06:23<18:52:21,  3.60it/s]
 34%|███▍      | 127094/371472 [10:06:24<18:53:41,  3.59it/s]
 34%|███▍      | 127095/371472 [10:06:24<18:28:29,  3.67it/s]
 34%|███▍      | 127096/371472 [10:06:24<18:46:01,  3.62it/s]
 34%|███▍      | 127097/371472 [10:06:24<18:04:23,  3.76it/s]
 34%|███▍      | 127098/371472 [10:06:25<20:45:10,  3.27it/s]
 34%|███▍      | 127099/371472 [10:06:25<20:03:40,  3.38it/s]
 34%|███▍      | 127100/371472 [10:06:25<19:08:53,  3.55it/s]
                                                             
{'loss': 3.2721, 'learning_rate': 6.923818655864165e-07, 'epoch': 5.47}

 34%|███▍      | 127100/371472 [10:06:25<19:08:53,  3.55it/s]
 34%|███▍      | 127101/371472 [10:06:26<20:07:06,  3.37it/s]
 34%|███▍      | 127102/371472 [10:06:26<20:51:28,  3.25it/s]
 34%|███▍      | 127103/371472 [10:06:26<21:24:15,  3.17it/s]
 34%|███▍      | 127104/371472 [10:06:27<21:09:47,  3.21it/s]
 34%|███▍      | 127105/371472 [10:06:27<20:50:22,  3.26it/s]
 34%|███▍      | 127106/371472 [10:06:27<20:23:22,  3.33it/s]
 34%|███▍      | 127107/371472 [10:06:28<19:59:22,  3.40it/s]
 34%|███▍      | 127108/371472 [10:06:28<19:49:11,  3.42it/s]
 34%|███▍      | 127109/371472 [10:06:28<19:02:52,  3.56it/s]
 34%|███▍      | 127110/371472 [10:06:28<20:42:08,  3.28it/s]
 34%|███▍      | 127111/371472 [10:06:29<20:04:39,  3.38it/s]
 34%|███▍      | 127112/371472 [10:06:29<20:01:20,  3.39it/s]
 34%|███▍      | 127113/371472 [10:06:29<20:28:24,  3.32it/s]
 34%|███▍      | 127114/371472 [10:06:30<19:54:00,  3.41it/s]
 34%|███▍      | 127115/371472 [10:06:30<19:16:13,  3.52it/s]
 34%|███▍      | 127116/371472 [10:06:30<18:52:22,  3.60it/s]
 34%|███▍      | 127117/371472 [10:06:30<19:13:49,  3.53it/s]
 34%|███▍      | 127118/371472 [10:06:31<19:46:30,  3.43it/s]
 34%|███▍      | 127119/371472 [10:06:31<18:32:41,  3.66it/s]
 34%|███▍      | 127120/371472 [10:06:31<17:53:40,  3.79it/s]
                                                             
{'loss': 3.2907, 'learning_rate': 6.923333836109374e-07, 'epoch': 5.48}

 34%|███▍      | 127120/371472 [10:06:31<17:53:40,  3.79it/s]
 34%|███▍      | 127121/371472 [10:06:31<17:54:40,  3.79it/s]
 34%|███▍      | 127122/371472 [10:06:32<18:20:11,  3.70it/s]
 34%|███▍      | 127123/371472 [10:06:32<18:35:25,  3.65it/s]
 34%|███▍      | 127124/371472 [10:06:32<18:22:17,  3.69it/s]
 34%|███▍      | 127125/371472 [10:06:33<19:15:38,  3.52it/s]
 34%|███▍      | 127126/371472 [10:06:33<18:39:21,  3.64it/s]
 34%|███▍      | 127127/371472 [10:06:33<17:59:31,  3.77it/s]
 34%|███▍      | 127128/371472 [10:06:33<18:16:40,  3.71it/s]
 34%|███▍      | 127129/371472 [10:06:34<23:20:00,  2.91it/s]
 34%|███▍      | 127130/371472 [10:06:34<22:52:50,  2.97it/s]
 34%|███▍      | 127131/371472 [10:06:35<23:28:27,  2.89it/s]
 34%|███▍      | 127132/371472 [10:06:35<21:43:22,  3.12it/s]
 34%|███▍      | 127133/371472 [10:06:35<24:44:38,  2.74it/s]
 34%|███▍      | 127134/371472 [10:06:36<22:33:31,  3.01it/s]
 34%|███▍      | 127135/371472 [10:06:36<21:24:58,  3.17it/s]
 34%|███▍      | 127136/371472 [10:06:36<20:11:12,  3.36it/s]
 34%|███▍      | 127137/371472 [10:06:36<18:56:44,  3.58it/s]
 34%|███▍      | 127138/371472 [10:06:37<19:11:43,  3.54it/s]
 34%|███▍      | 127139/371472 [10:06:37<18:43:09,  3.63it/s]
 34%|███▍      | 127140/371472 [10:06:37<18:35:07,  3.65it/s]
                                                             
{'loss': 3.2786, 'learning_rate': 6.922849016354585e-07, 'epoch': 5.48}

 34%|███▍      | 127140/371472 [10:06:37<18:35:07,  3.65it/s]
 34%|███▍      | 127141/371472 [10:06:37<17:57:36,  3.78it/s]
 34%|███▍      | 127142/371472 [10:06:38<19:29:58,  3.48it/s]
 34%|███▍      | 127143/371472 [10:06:38<20:32:23,  3.30it/s]
 34%|███▍      | 127144/371472 [10:06:38<20:47:35,  3.26it/s]
 34%|███▍      | 127145/371472 [10:06:39<23:03:01,  2.94it/s]
 34%|███▍      | 127146/371472 [10:06:39<21:07:15,  3.21it/s]
 34%|███▍      | 127147/371472 [10:06:39<20:29:40,  3.31it/s]
 34%|███▍      | 127148/371472 [10:06:40<19:57:19,  3.40it/s]
 34%|███▍      | 127149/371472 [10:06:40<19:40:50,  3.45it/s]
 34%|███▍      | 127150/371472 [10:06:40<18:39:58,  3.64it/s]
 34%|███▍      | 127151/371472 [10:06:40<20:00:53,  3.39it/s]
 34%|███▍      | 127152/371472 [10:06:41<20:23:20,  3.33it/s]
 34%|███▍      | 127153/371472 [10:06:41<19:25:54,  3.49it/s]
 34%|███▍      | 127154/371472 [10:06:41<19:35:46,  3.46it/s]
 34%|███▍      | 127155/371472 [10:06:42<18:37:54,  3.64it/s]
 34%|███▍      | 127156/371472 [10:06:42<18:14:37,  3.72it/s]
 34%|███▍      | 127157/371472 [10:06:42<17:46:13,  3.82it/s]
 34%|███▍      | 127158/371472 [10:06:42<17:38:48,  3.85it/s]
 34%|███▍      | 127159/371472 [10:06:43<18:57:28,  3.58it/s]
 34%|███▍      | 127160/371472 [10:06:43<18:22:57,  3.69it/s]
                                                             
{'loss': 3.3626, 'learning_rate': 6.922364196599797e-07, 'epoch': 5.48}

 34%|███▍      | 127160/371472 [10:06:43<18:22:57,  3.69it/s]
 34%|███▍      | 127161/371472 [10:06:43<17:59:58,  3.77it/s]
 34%|███▍      | 127162/371472 [10:06:43<17:48:11,  3.81it/s]
 34%|███▍      | 127163/371472 [10:06:44<18:07:34,  3.74it/s]
 34%|███▍      | 127164/371472 [10:06:44<17:26:47,  3.89it/s]
 34%|███▍      | 127165/371472 [10:06:44<18:04:59,  3.75it/s]
 34%|███▍      | 127166/371472 [10:06:44<17:53:04,  3.79it/s]
 34%|███▍      | 127167/371472 [10:06:45<18:01:32,  3.76it/s]
 34%|███▍      | 127168/371472 [10:06:45<17:46:05,  3.82it/s]
 34%|███▍      | 127169/371472 [10:06:45<17:21:03,  3.91it/s]
 34%|███▍      | 127170/371472 [10:06:45<16:57:22,  4.00it/s]
 34%|███▍      | 127171/371472 [10:06:46<18:44:51,  3.62it/s]
 34%|███▍      | 127172/371472 [10:06:46<18:39:16,  3.64it/s]
 34%|███▍      | 127173/371472 [10:06:46<18:09:22,  3.74it/s]
 34%|███▍      | 127174/371472 [10:06:47<18:10:19,  3.73it/s]
 34%|███▍      | 127175/371472 [10:06:47<17:56:19,  3.78it/s]
 34%|███▍      | 127176/371472 [10:06:47<18:24:22,  3.69it/s]
 34%|███▍      | 127177/371472 [10:06:47<19:06:47,  3.55it/s]
 34%|███▍      | 127178/371472 [10:06:48<19:07:16,  3.55it/s]
 34%|███▍      | 127179/371472 [10:06:48<20:38:23,  3.29it/s]
 34%|███▍      | 127180/371472 [10:06:48<20:44:43,  3.27it/s]
                                                             
{'loss': 3.1141, 'learning_rate': 6.921879376845009e-07, 'epoch': 5.48}

 34%|███▍      | 127180/371472 [10:06:48<20:44:43,  3.27it/s]
 34%|███▍      | 127181/371472 [10:06:49<19:23:43,  3.50it/s]
 34%|███▍      | 127182/371472 [10:06:49<18:55:32,  3.59it/s]
 34%|███▍      | 127183/371472 [10:06:49<18:07:56,  3.74it/s]
 34%|███▍      | 127184/371472 [10:06:49<18:07:35,  3.74it/s]
 34%|███▍      | 127185/371472 [10:06:50<18:52:01,  3.60it/s]
 34%|███▍      | 127186/371472 [10:06:50<19:31:57,  3.47it/s]
 34%|███▍      | 127187/371472 [10:06:50<19:11:57,  3.53it/s]
 34%|███▍      | 127188/371472 [10:06:51<18:39:04,  3.64it/s]
 34%|███▍      | 127189/371472 [10:06:51<18:44:29,  3.62it/s]
 34%|███▍      | 127190/371472 [10:06:51<19:20:21,  3.51it/s]
 34%|███▍      | 127191/371472 [10:06:51<18:22:37,  3.69it/s]
 34%|███▍      | 127192/371472 [10:06:52<18:24:24,  3.69it/s]
 34%|███▍      | 127193/371472 [10:06:52<19:18:59,  3.51it/s]
 34%|███▍      | 127194/371472 [10:06:52<18:45:40,  3.62it/s]
 34%|███▍      | 127195/371472 [10:06:53<19:08:42,  3.54it/s]
 34%|███▍      | 127196/371472 [10:06:53<19:13:09,  3.53it/s]
 34%|███▍      | 127197/371472 [10:06:53<20:19:53,  3.34it/s]
 34%|███▍      | 127198/371472 [10:06:53<20:22:49,  3.33it/s]
 34%|███▍      | 127199/371472 [10:06:54<19:29:34,  3.48it/s]
 34%|███▍      | 127200/371472 [10:06:54<18:52:54,  3.59it/s]
                                                             
{'loss': 3.3689, 'learning_rate': 6.92139455709022e-07, 'epoch': 5.48}

 34%|███▍      | 127200/371472 [10:06:54<18:52:54,  3.59it/s]
 34%|███▍      | 127201/371472 [10:06:54<19:00:57,  3.57it/s]
 34%|███▍      | 127202/371472 [10:06:55<18:49:35,  3.60it/s]
 34%|███▍      | 127203/371472 [10:06:55<18:49:38,  3.60it/s]
 34%|███▍      | 127204/371472 [10:06:55<19:55:15,  3.41it/s]
 34%|███▍      | 127205/371472 [10:06:55<19:32:01,  3.47it/s]
 34%|███▍      | 127206/371472 [10:06:56<19:02:27,  3.56it/s]
 34%|███▍      | 127207/371472 [10:06:56<19:12:43,  3.53it/s]
 34%|███▍      | 127208/371472 [10:06:56<18:41:56,  3.63it/s]
 34%|███▍      | 127209/371472 [10:06:57<19:13:03,  3.53it/s]
 34%|███▍      | 127210/371472 [10:06:57<19:13:02,  3.53it/s]
 34%|███▍      | 127211/371472 [10:06:57<19:18:45,  3.51it/s]
 34%|███▍      | 127212/371472 [10:06:57<18:46:35,  3.61it/s]
 34%|███▍      | 127213/371472 [10:06:58<18:57:10,  3.58it/s]
 34%|███▍      | 127214/371472 [10:06:58<18:58:43,  3.58it/s]
 34%|███▍      | 127215/371472 [10:06:58<19:13:31,  3.53it/s]
 34%|███▍      | 127216/371472 [10:06:59<19:37:45,  3.46it/s]
 34%|███▍      | 127217/371472 [10:06:59<19:06:07,  3.55it/s]
 34%|███▍      | 127218/371472 [10:06:59<18:20:17,  3.70it/s]
 34%|███▍      | 127219/371472 [10:06:59<18:12:51,  3.73it/s]
 34%|███▍      | 127220/371472 [10:07:00<17:43:14,  3.83it/s]
                                                             
{'loss': 3.1013, 'learning_rate': 6.92090973733543e-07, 'epoch': 5.48}

 34%|███▍      | 127220/371472 [10:07:00<17:43:14,  3.83it/s]
 34%|███▍      | 127221/371472 [10:07:00<19:07:31,  3.55it/s]
 34%|███▍      | 127222/371472 [10:07:00<18:49:00,  3.61it/s]
 34%|███▍      | 127223/371472 [10:07:00<19:32:53,  3.47it/s]
 34%|███▍      | 127224/371472 [10:07:01<18:58:57,  3.57it/s]
 34%|███▍      | 127225/371472 [10:07:01<18:47:38,  3.61it/s]
 34%|███▍      | 127226/371472 [10:07:01<19:23:04,  3.50it/s]
 34%|███▍      | 127227/371472 [10:07:02<19:15:54,  3.52it/s]
 34%|███▍      | 127228/371472 [10:07:02<20:02:13,  3.39it/s]
 34%|███▍      | 127229/371472 [10:07:02<19:28:06,  3.48it/s]
 34%|███▍      | 127230/371472 [10:07:02<19:35:51,  3.46it/s]
 34%|███▍      | 127231/371472 [10:07:03<18:52:47,  3.59it/s]
 34%|███▍      | 127232/371472 [10:07:03<18:23:54,  3.69it/s]
 34%|███▍      | 127233/371472 [10:07:03<18:34:52,  3.65it/s]
 34%|███▍      | 127234/371472 [10:07:03<17:51:04,  3.80it/s]
 34%|███▍      | 127235/371472 [10:07:04<17:30:25,  3.88it/s]
 34%|███▍      | 127236/371472 [10:07:04<19:54:45,  3.41it/s]
 34%|███▍      | 127237/371472 [10:07:04<19:54:25,  3.41it/s]
 34%|███▍      | 127238/371472 [10:07:05<20:28:40,  3.31it/s]
 34%|███▍      | 127239/371472 [10:07:05<19:54:38,  3.41it/s]
 34%|███▍      | 127240/371472 [10:07:05<20:16:25,  3.35it/s]
                                                             
{'loss': 3.1667, 'learning_rate': 6.920424917580641e-07, 'epoch': 5.48}

 34%|███▍      | 127240/371472 [10:07:05<20:16:25,  3.35it/s]
 34%|███▍      | 127241/371472 [10:07:06<21:06:25,  3.21it/s]
 34%|███▍      | 127242/371472 [10:07:06<20:37:28,  3.29it/s]
 34%|███▍      | 127243/371472 [10:07:06<20:19:44,  3.34it/s]
 34%|███▍      | 127244/371472 [10:07:06<19:40:30,  3.45it/s]
 34%|███▍      | 127245/371472 [10:07:07<19:00:01,  3.57it/s]
 34%|███▍      | 127246/371472 [10:07:07<18:25:20,  3.68it/s]
 34%|███▍      | 127247/371472 [10:07:07<18:03:21,  3.76it/s]
 34%|███▍      | 127248/371472 [10:07:08<17:55:50,  3.78it/s]
 34%|███▍      | 127249/371472 [10:07:08<17:48:24,  3.81it/s]
 34%|███▍      | 127250/371472 [10:07:08<17:53:52,  3.79it/s]
 34%|███▍      | 127251/371472 [10:07:08<18:22:36,  3.69it/s]
 34%|███▍      | 127252/371472 [10:07:09<19:29:56,  3.48it/s]
 34%|███▍      | 127253/371472 [10:07:09<19:12:36,  3.53it/s]
 34%|███▍      | 127254/371472 [10:07:09<18:41:07,  3.63it/s]
 34%|███▍      | 127255/371472 [10:07:09<18:20:52,  3.70it/s]
 34%|███▍      | 127256/371472 [10:07:10<17:57:24,  3.78it/s]
 34%|███▍      | 127257/371472 [10:07:10<20:18:40,  3.34it/s]
 34%|███▍      | 127258/371472 [10:07:10<19:30:44,  3.48it/s]
 34%|███▍      | 127259/371472 [10:07:11<19:06:00,  3.55it/s]
 34%|███▍      | 127260/371472 [10:07:11<18:56:07,  3.58it/s]
                                                             
{'loss': 3.2935, 'learning_rate': 6.919940097825853e-07, 'epoch': 5.48}

 34%|███▍      | 127260/371472 [10:07:11<18:56:07,  3.58it/s]
 34%|███▍      | 127261/371472 [10:07:11<19:02:33,  3.56it/s]
 34%|███▍      | 127262/371472 [10:07:11<18:18:30,  3.71it/s]
 34%|███▍      | 127263/371472 [10:07:12<19:02:31,  3.56it/s]
 34%|███▍      | 127264/371472 [10:07:12<19:20:45,  3.51it/s]
 34%|███▍      | 127265/371472 [10:07:12<19:43:57,  3.44it/s]
 34%|███▍      | 127266/371472 [10:07:13<19:43:22,  3.44it/s]
 34%|███▍      | 127267/371472 [10:07:13<18:48:20,  3.61it/s]
 34%|███▍      | 127268/371472 [10:07:13<18:55:34,  3.58it/s]
 34%|███▍      | 127269/371472 [10:07:13<17:57:15,  3.78it/s]
 34%|███▍      | 127270/371472 [10:07:14<17:46:50,  3.82it/s]
 34%|███▍      | 127271/371472 [10:07:14<18:25:40,  3.68it/s]
 34%|███▍      | 127272/371472 [10:07:14<18:08:09,  3.74it/s]
 34%|███▍      | 127273/371472 [10:07:14<18:51:52,  3.60it/s]
 34%|███▍      | 127274/371472 [10:07:15<19:02:11,  3.56it/s]
 34%|███▍      | 127275/371472 [10:07:15<19:12:21,  3.53it/s]
 34%|███▍      | 127276/371472 [10:07:15<21:46:21,  3.12it/s]
 34%|███▍      | 127277/371472 [10:07:16<20:52:35,  3.25it/s]
 34%|███▍      | 127278/371472 [10:07:16<20:32:54,  3.30it/s]
 34%|███▍      | 127279/371472 [10:07:16<19:23:17,  3.50it/s]
 34%|███▍      | 127280/371472 [10:07:17<18:59:22,  3.57it/s]
                                                             
{'loss': 3.1647, 'learning_rate': 6.919455278071063e-07, 'epoch': 5.48}

 34%|███▍      | 127280/371472 [10:07:17<18:59:22,  3.57it/s]
 34%|███▍      | 127281/371472 [10:07:17<19:29:20,  3.48it/s]
 34%|███▍      | 127282/371472 [10:07:17<19:44:01,  3.44it/s]
 34%|███▍      | 127283/371472 [10:07:17<18:25:48,  3.68it/s]
 34%|███▍      | 127284/371472 [10:07:18<18:08:54,  3.74it/s]
 34%|███▍      | 127285/371472 [10:07:18<18:04:02,  3.75it/s]
 34%|███▍      | 127286/371472 [10:07:18<18:31:58,  3.66it/s]
 34%|███▍      | 127287/371472 [10:07:18<19:00:20,  3.57it/s]
 34%|███▍      | 127288/371472 [10:07:19<18:44:58,  3.62it/s]
 34%|███▍      | 127289/371472 [10:07:19<18:50:44,  3.60it/s]
 34%|███▍      | 127290/371472 [10:07:19<18:29:34,  3.67it/s]
 34%|███▍      | 127291/371472 [10:07:20<19:38:58,  3.45it/s]
 34%|███▍      | 127292/371472 [10:07:20<19:48:30,  3.42it/s]
 34%|███▍      | 127293/371472 [10:07:20<19:12:14,  3.53it/s]
 34%|███▍      | 127294/371472 [10:07:20<18:52:46,  3.59it/s]
 34%|███▍      | 127295/371472 [10:07:21<19:24:22,  3.50it/s]
 34%|███▍      | 127296/371472 [10:07:21<20:18:10,  3.34it/s]
 34%|███▍      | 127297/371472 [10:07:21<19:30:27,  3.48it/s]
 34%|███▍      | 127298/371472 [10:07:22<20:16:17,  3.35it/s]
 34%|███▍      | 127299/371472 [10:07:22<19:10:09,  3.54it/s]
 34%|███▍      | 127300/371472 [10:07:22<19:22:08,  3.50it/s]
                                                             
{'loss': 3.3421, 'learning_rate': 6.918970458316274e-07, 'epoch': 5.48}

 34%|███▍      | 127300/371472 [10:07:22<19:22:08,  3.50it/s]
 34%|███▍      | 127301/371472 [10:07:22<18:47:31,  3.61it/s]
 34%|███▍      | 127302/371472 [10:07:23<18:47:18,  3.61it/s]
 34%|███▍      | 127303/371472 [10:07:23<20:16:45,  3.34it/s]
 34%|███▍      | 127304/371472 [10:07:23<19:22:41,  3.50it/s]
 34%|███▍      | 127305/371472 [10:07:24<18:52:19,  3.59it/s]
 34%|███▍      | 127306/371472 [10:07:24<18:26:43,  3.68it/s]
 34%|███▍      | 127307/371472 [10:07:24<19:23:53,  3.50it/s]
 34%|███▍      | 127308/371472 [10:07:24<18:26:17,  3.68it/s]
 34%|███▍      | 127309/371472 [10:07:25<18:05:11,  3.75it/s]
 34%|███▍      | 127310/371472 [10:07:25<18:34:57,  3.65it/s]
 34%|███▍      | 127311/371472 [10:07:25<18:16:22,  3.71it/s]
 34%|███▍      | 127312/371472 [10:07:26<19:09:20,  3.54it/s]
 34%|███▍      | 127313/371472 [10:07:26<19:45:47,  3.43it/s]
 34%|███▍      | 127314/371472 [10:07:26<19:17:14,  3.52it/s]
 34%|███▍      | 127315/371472 [10:07:26<19:22:03,  3.50it/s]
 34%|███▍      | 127316/371472 [10:07:27<18:34:21,  3.65it/s]
 34%|███▍      | 127317/371472 [10:07:27<19:26:24,  3.49it/s]
 34%|███▍      | 127318/371472 [10:07:27<19:28:46,  3.48it/s]
 34%|███▍      | 127319/371472 [10:07:28<19:23:18,  3.50it/s]
 34%|███▍      | 127320/371472 [10:07:28<18:45:12,  3.62it/s]
                                                             
{'loss': 3.4923, 'learning_rate': 6.918485638561486e-07, 'epoch': 5.48}

 34%|███▍      | 127320/371472 [10:07:28<18:45:12,  3.62it/s]
 34%|███▍      | 127321/371472 [10:07:28<18:08:25,  3.74it/s]
 34%|███▍      | 127322/371472 [10:07:28<19:03:15,  3.56it/s]
 34%|███▍      | 127323/371472 [10:07:29<19:06:56,  3.55it/s]
 34%|███▍      | 127324/371472 [10:07:29<21:18:03,  3.18it/s]
 34%|███▍      | 127325/371472 [10:07:29<20:27:58,  3.31it/s]
 34%|███▍      | 127326/371472 [10:07:30<19:24:42,  3.49it/s]
 34%|███▍      | 127327/371472 [10:07:30<18:37:22,  3.64it/s]
 34%|███▍      | 127328/371472 [10:07:30<18:43:52,  3.62it/s]
 34%|███▍      | 127329/371472 [10:07:30<19:18:15,  3.51it/s]
 34%|███▍      | 127330/371472 [10:07:31<18:45:30,  3.62it/s]
 34%|███▍      | 127331/371472 [10:07:31<18:41:04,  3.63it/s]
 34%|███▍      | 127332/371472 [10:07:31<18:43:17,  3.62it/s]
 34%|███▍      | 127333/371472 [10:07:31<18:17:46,  3.71it/s]
 34%|███▍      | 127334/371472 [10:07:32<18:43:52,  3.62it/s]
 34%|███▍      | 127335/371472 [10:07:32<18:41:24,  3.63it/s]
 34%|███▍      | 127336/371472 [10:07:32<18:35:59,  3.65it/s]
 34%|███▍      | 127337/371472 [10:07:33<18:38:33,  3.64it/s]
 34%|███▍      | 127338/371472 [10:07:33<18:33:41,  3.65it/s]
 34%|███▍      | 127339/371472 [10:07:33<18:37:17,  3.64it/s]
 34%|███▍      | 127340/371472 [10:07:33<18:06:07,  3.75it/s]
                                                             
{'loss': 3.2637, 'learning_rate': 6.918000818806698e-07, 'epoch': 5.48}

 34%|███▍      | 127340/371472 [10:07:33<18:06:07,  3.75it/s]
 34%|███▍      | 127341/371472 [10:07:34<17:52:08,  3.80it/s]
 34%|███▍      | 127342/371472 [10:07:34<18:09:19,  3.74it/s]
 34%|███▍      | 127343/371472 [10:07:34<19:31:10,  3.47it/s]
 34%|███▍      | 127344/371472 [10:07:34<19:04:40,  3.55it/s]
 34%|███▍      | 127345/371472 [10:07:35<19:36:57,  3.46it/s]
 34%|███▍      | 127346/371472 [10:07:35<22:19:58,  3.04it/s]
 34%|███▍      | 127347/371472 [10:07:35<20:45:05,  3.27it/s]
 34%|███▍      | 127348/371472 [10:07:36<19:54:38,  3.41it/s]
 34%|███▍      | 127349/371472 [10:07:36<19:18:59,  3.51it/s]
 34%|███▍      | 127350/371472 [10:07:36<19:39:24,  3.45it/s]
 34%|███▍      | 127351/371472 [10:07:37<18:55:16,  3.58it/s]
 34%|███▍      | 127352/371472 [10:07:37<18:15:55,  3.71it/s]
 34%|███▍      | 127353/371472 [10:07:37<19:31:11,  3.47it/s]
 34%|███▍      | 127354/371472 [10:07:37<21:05:19,  3.22it/s]
 34%|███▍      | 127355/371472 [10:07:38<20:01:49,  3.39it/s]
 34%|███▍      | 127356/371472 [10:07:38<19:03:42,  3.56it/s]
 34%|███▍      | 127357/371472 [10:07:38<19:21:14,  3.50it/s]
 34%|███▍      | 127358/371472 [10:07:39<19:23:07,  3.50it/s]
 34%|███▍      | 127359/371472 [10:07:39<22:33:04,  3.01it/s]
 34%|███▍      | 127360/371472 [10:07:39<21:16:09,  3.19it/s]
                                                             
{'loss': 3.0587, 'learning_rate': 6.917515999051908e-07, 'epoch': 5.49}

 34%|███▍      | 127360/371472 [10:07:39<21:16:09,  3.19it/s]
 34%|███▍      | 127361/371472 [10:07:40<20:36:36,  3.29it/s]
 34%|███▍      | 127362/371472 [10:07:40<19:12:27,  3.53it/s]
 34%|███▍      | 127363/371472 [10:07:40<19:28:39,  3.48it/s]
 34%|███▍      | 127364/371472 [10:07:40<19:13:31,  3.53it/s]
 34%|███▍      | 127365/371472 [10:07:41<18:46:30,  3.61it/s]
 34%|███▍      | 127366/371472 [10:07:41<20:19:52,  3.34it/s]
 34%|███▍      | 127367/371472 [10:07:41<19:12:45,  3.53it/s]
 34%|███▍      | 127368/371472 [10:07:42<20:20:10,  3.33it/s]
 34%|███▍      | 127369/371472 [10:07:42<19:28:42,  3.48it/s]
 34%|███▍      | 127370/371472 [10:07:42<19:20:57,  3.50it/s]
 34%|███▍      | 127371/371472 [10:07:42<19:08:38,  3.54it/s]
 34%|███▍      | 127372/371472 [10:07:43<20:32:29,  3.30it/s]
 34%|███▍      | 127373/371472 [10:07:43<19:28:42,  3.48it/s]
 34%|███▍      | 127374/371472 [10:07:43<18:36:48,  3.64it/s]
 34%|███▍      | 127375/371472 [10:07:44<19:11:43,  3.53it/s]
 34%|███▍      | 127376/371472 [10:07:44<19:45:09,  3.43it/s]
 34%|███▍      | 127377/371472 [10:07:44<19:04:42,  3.55it/s]
 34%|███▍      | 127378/371472 [10:07:44<18:20:59,  3.70it/s]
 34%|███▍      | 127379/371472 [10:07:45<18:01:40,  3.76it/s]
 34%|███▍      | 127380/371472 [10:07:45<18:39:58,  3.63it/s]
                                                             
{'loss': 3.1862, 'learning_rate': 6.917031179297118e-07, 'epoch': 5.49}

 34%|███▍      | 127380/371472 [10:07:45<18:39:58,  3.63it/s]
 34%|███▍      | 127381/371472 [10:07:45<19:49:20,  3.42it/s]
 34%|███▍      | 127382/371472 [10:07:45<18:53:49,  3.59it/s]
 34%|███▍      | 127383/371472 [10:07:46<19:18:25,  3.51it/s]
 34%|███▍      | 127384/371472 [10:07:46<18:56:37,  3.58it/s]
 34%|███▍      | 127385/371472 [10:07:46<18:33:33,  3.65it/s]
 34%|███▍      | 127386/371472 [10:07:47<19:58:40,  3.39it/s]
 34%|███▍      | 127387/371472 [10:07:47<19:23:55,  3.50it/s]
 34%|███▍      | 127388/371472 [10:07:47<19:35:56,  3.46it/s]
 34%|███▍      | 127389/371472 [10:07:47<19:06:29,  3.55it/s]
 34%|███▍      | 127390/371472 [10:07:48<18:56:03,  3.58it/s]
 34%|███▍      | 127391/371472 [10:07:48<19:28:25,  3.48it/s]
 34%|███▍      | 127392/371472 [10:07:48<19:20:08,  3.51it/s]
 34%|███▍      | 127393/371472 [10:07:49<18:43:25,  3.62it/s]
 34%|███▍      | 127394/371472 [10:07:49<19:14:50,  3.52it/s]
 34%|███▍      | 127395/371472 [10:07:49<19:12:19,  3.53it/s]
 34%|███▍      | 127396/371472 [10:07:49<18:25:43,  3.68it/s]
 34%|███▍      | 127397/371472 [10:07:50<17:58:44,  3.77it/s]
 34%|███▍      | 127398/371472 [10:07:50<18:15:12,  3.71it/s]
 34%|███▍      | 127399/371472 [10:07:50<19:17:45,  3.51it/s]
 34%|███▍      | 127400/371472 [10:07:51<18:54:43,  3.58it/s]
                                                             
{'loss': 3.1303, 'learning_rate': 6.91654635954233e-07, 'epoch': 5.49}

 34%|███▍      | 127400/371472 [10:07:51<18:54:43,  3.58it/s]
 34%|███▍      | 127401/371472 [10:07:51<18:29:24,  3.67it/s]
 34%|███▍      | 127402/371472 [10:07:51<17:57:54,  3.77it/s]
 34%|███▍      | 127403/371472 [10:07:51<18:41:39,  3.63it/s]
 34%|███▍      | 127404/371472 [10:07:52<21:16:27,  3.19it/s]
 34%|███▍      | 127405/371472 [10:07:52<19:56:48,  3.40it/s]
 34%|███▍      | 127406/371472 [10:07:52<19:17:12,  3.52it/s]
 34%|███▍      | 127407/371472 [10:07:53<19:58:39,  3.39it/s]
 34%|███▍      | 127408/371472 [10:07:53<18:46:18,  3.61it/s]
 34%|███▍      | 127409/371472 [10:07:53<18:44:53,  3.62it/s]
 34%|███▍      | 127410/371472 [10:07:53<18:01:26,  3.76it/s]
 34%|███▍      | 127411/371472 [10:07:54<18:01:22,  3.76it/s]
 34%|███▍      | 127412/371472 [10:07:54<18:19:10,  3.70it/s]
 34%|███▍      | 127413/371472 [10:07:54<19:28:24,  3.48it/s]
 34%|███▍      | 127414/371472 [10:07:54<18:32:43,  3.66it/s]
 34%|███▍      | 127415/371472 [10:07:55<17:56:50,  3.78it/s]
 34%|███▍      | 127416/371472 [10:07:55<18:47:22,  3.61it/s]
 34%|███▍      | 127417/371472 [10:07:55<18:48:13,  3.61it/s]
 34%|███▍      | 127418/371472 [10:07:56<18:32:40,  3.66it/s]
 34%|███▍      | 127419/371472 [10:07:56<18:09:22,  3.73it/s]
 34%|███▍      | 127420/371472 [10:07:56<19:31:58,  3.47it/s]
                                                             
{'loss': 3.2572, 'learning_rate': 6.916061539787541e-07, 'epoch': 5.49}

 34%|███▍      | 127420/371472 [10:07:56<19:31:58,  3.47it/s]
 34%|███▍      | 127421/371472 [10:07:56<19:01:39,  3.56it/s]
 34%|███▍      | 127422/371472 [10:07:57<19:47:31,  3.43it/s]
 34%|███▍      | 127423/371472 [10:07:57<19:35:48,  3.46it/s]
 34%|███▍      | 127424/371472 [10:07:57<19:02:25,  3.56it/s]
 34%|███▍      | 127425/371472 [10:07:58<20:25:18,  3.32it/s]
 34%|███▍      | 127426/371472 [10:07:58<18:59:57,  3.57it/s]
 34%|███▍      | 127427/371472 [10:07:58<19:38:56,  3.45it/s]
 34%|███▍      | 127428/371472 [10:07:58<19:18:29,  3.51it/s]
 34%|███▍      | 127429/371472 [10:07:59<19:10:08,  3.54it/s]
 34%|███▍      | 127430/371472 [10:07:59<20:07:16,  3.37it/s]
 34%|███▍      | 127431/371472 [10:07:59<19:14:49,  3.52it/s]
 34%|███▍      | 127432/371472 [10:08:00<18:39:12,  3.63it/s]
 34%|███▍      | 127433/371472 [10:08:00<18:21:20,  3.69it/s]
 34%|███▍      | 127434/371472 [10:08:00<18:00:05,  3.77it/s]
 34%|███▍      | 127435/371472 [10:08:00<19:17:51,  3.51it/s]
 34%|███▍      | 127436/371472 [10:08:01<19:50:51,  3.42it/s]
 34%|███▍      | 127437/371472 [10:08:01<20:22:32,  3.33it/s]
 34%|███▍      | 127438/371472 [10:08:01<21:48:19,  3.11it/s]
 34%|███▍      | 127439/371472 [10:08:02<20:54:34,  3.24it/s]
 34%|███▍      | 127440/371472 [10:08:02<19:52:42,  3.41it/s]
                                                             
{'loss': 3.1622, 'learning_rate': 6.915576720032752e-07, 'epoch': 5.49}

 34%|███▍      | 127440/371472 [10:08:02<19:52:42,  3.41it/s]
 34%|███▍      | 127441/371472 [10:08:02<18:52:32,  3.59it/s]
 34%|███▍      | 127442/371472 [10:08:03<20:30:42,  3.30it/s]
 34%|███▍      | 127443/371472 [10:08:03<19:51:49,  3.41it/s]
 34%|███▍      | 127444/371472 [10:08:03<19:26:08,  3.49it/s]
 34%|███▍      | 127445/371472 [10:08:03<18:54:37,  3.58it/s]
 34%|███▍      | 127446/371472 [10:08:04<18:55:58,  3.58it/s]
 34%|███▍      | 127447/371472 [10:08:04<18:35:26,  3.65it/s]
 34%|███▍      | 127448/371472 [10:08:04<17:48:57,  3.80it/s]
 34%|███▍      | 127449/371472 [10:08:04<17:40:05,  3.84it/s]
 34%|███▍      | 127450/371472 [10:08:05<17:25:45,  3.89it/s]
 34%|███▍      | 127451/371472 [10:08:05<18:12:52,  3.72it/s]
 34%|███▍      | 127452/371472 [10:08:05<18:20:29,  3.70it/s]
 34%|███▍      | 127453/371472 [10:08:05<19:14:43,  3.52it/s]
 34%|███▍      | 127454/371472 [10:08:06<19:27:31,  3.48it/s]
 34%|███▍      | 127455/371472 [10:08:06<19:42:12,  3.44it/s]
 34%|███▍      | 127456/371472 [10:08:06<18:51:39,  3.59it/s]
 34%|███▍      | 127457/371472 [10:08:07<19:54:24,  3.40it/s]
 34%|███▍      | 127458/371472 [10:08:07<18:56:09,  3.58it/s]
 34%|███▍      | 127459/371472 [10:08:07<18:50:51,  3.60it/s]
 34%|███▍      | 127460/371472 [10:08:07<19:16:21,  3.52it/s]
                                                             
{'loss': 3.2954, 'learning_rate': 6.915091900277963e-07, 'epoch': 5.49}

 34%|███▍      | 127460/371472 [10:08:07<19:16:21,  3.52it/s]
 34%|███▍      | 127461/371472 [10:08:08<19:21:05,  3.50it/s]
 34%|███▍      | 127462/371472 [10:08:08<18:43:05,  3.62it/s]
 34%|███▍      | 127463/371472 [10:08:08<18:52:23,  3.59it/s]
 34%|███▍      | 127464/371472 [10:08:09<18:31:34,  3.66it/s]
 34%|███▍      | 127465/371472 [10:08:09<18:39:47,  3.63it/s]
 34%|███▍      | 127466/371472 [10:08:09<18:58:14,  3.57it/s]
 34%|███▍      | 127467/371472 [10:08:09<18:24:54,  3.68it/s]
 34%|███▍      | 127468/371472 [10:08:10<19:42:00,  3.44it/s]
 34%|███▍      | 127469/371472 [10:08:10<19:46:10,  3.43it/s]
 34%|███▍      | 127470/371472 [10:08:10<19:13:51,  3.52it/s]
 34%|███▍      | 127471/371472 [10:08:11<18:59:34,  3.57it/s]
 34%|███▍      | 127472/371472 [10:08:11<18:06:26,  3.74it/s]
 34%|███▍      | 127473/371472 [10:08:11<18:37:10,  3.64it/s]
 34%|███▍      | 127474/371472 [10:08:11<19:35:19,  3.46it/s]
 34%|███▍      | 127475/371472 [10:08:12<20:06:52,  3.37it/s]
 34%|███▍      | 127476/371472 [10:08:12<19:24:55,  3.49it/s]
 34%|███▍      | 127477/371472 [10:08:12<19:20:30,  3.50it/s]
 34%|███▍      | 127478/371472 [10:08:13<19:05:02,  3.55it/s]
 34%|███▍      | 127479/371472 [10:08:13<19:05:38,  3.55it/s]
 34%|███▍      | 127480/371472 [10:08:13<19:04:45,  3.55it/s]
                                                             
{'loss': 3.207, 'learning_rate': 6.914607080523175e-07, 'epoch': 5.49}

 34%|███▍      | 127480/371472 [10:08:13<19:04:45,  3.55it/s]
 34%|███▍      | 127481/371472 [10:08:13<19:40:52,  3.44it/s]
 34%|███▍      | 127482/371472 [10:08:14<19:52:56,  3.41it/s]
 34%|███▍      | 127483/371472 [10:08:14<19:33:50,  3.46it/s]
 34%|███▍      | 127484/371472 [10:08:14<18:46:21,  3.61it/s]
 34%|███▍      | 127485/371472 [10:08:15<19:25:04,  3.49it/s]
 34%|███▍      | 127486/371472 [10:08:15<20:03:17,  3.38it/s]
 34%|███▍      | 127487/371472 [10:08:15<21:44:17,  3.12it/s]
 34%|███▍      | 127488/371472 [10:08:16<20:35:37,  3.29it/s]
 34%|███▍      | 127489/371472 [10:08:16<20:43:08,  3.27it/s]
 34%|███▍      | 127490/371472 [10:08:16<21:40:12,  3.13it/s]
 34%|███▍      | 127491/371472 [10:08:16<21:01:40,  3.22it/s]
 34%|███▍      | 127492/371472 [10:08:17<19:52:42,  3.41it/s]
 34%|███▍      | 127493/371472 [10:08:17<19:01:58,  3.56it/s]
 34%|███▍      | 127494/371472 [10:08:17<19:57:27,  3.40it/s]
 34%|███▍      | 127495/371472 [10:08:18<21:02:43,  3.22it/s]
 34%|███▍      | 127496/371472 [10:08:18<20:12:53,  3.35it/s]
 34%|███▍      | 127497/371472 [10:08:18<20:56:50,  3.24it/s]
 34%|███▍      | 127498/371472 [10:08:19<20:15:53,  3.34it/s]
 34%|███▍      | 127499/371472 [10:08:19<20:33:40,  3.30it/s]
 34%|███▍      | 127500/371472 [10:08:19<19:48:00,  3.42it/s]
                                                             
{'loss': 3.2483, 'learning_rate': 6.914122260768385e-07, 'epoch': 5.49}

 34%|███▍      | 127500/371472 [10:08:19<19:48:00,  3.42it/s]
 34%|███▍      | 127501/371472 [10:08:19<18:49:49,  3.60it/s]
 34%|███▍      | 127502/371472 [10:08:20<18:52:54,  3.59it/s]
 34%|███▍      | 127503/371472 [10:08:20<18:10:48,  3.73it/s]
 34%|███▍      | 127504/371472 [10:08:20<18:07:53,  3.74it/s]
 34%|███▍      | 127505/371472 [10:08:20<18:18:10,  3.70it/s]
 34%|███▍      | 127506/371472 [10:08:21<19:27:21,  3.48it/s]
 34%|███▍      | 127507/371472 [10:08:21<20:10:08,  3.36it/s]
 34%|███▍      | 127508/371472 [10:08:21<20:26:05,  3.32it/s]
 34%|███▍      | 127509/371472 [10:08:22<19:09:32,  3.54it/s]
 34%|███▍      | 127510/371472 [10:08:22<19:00:00,  3.57it/s]
 34%|███▍      | 127511/371472 [10:08:22<18:21:15,  3.69it/s]
 34%|███▍      | 127512/371472 [10:08:22<18:28:53,  3.67it/s]
 34%|███▍      | 127513/371472 [10:08:23<19:19:53,  3.51it/s]
 34%|███▍      | 127514/371472 [10:08:23<19:39:44,  3.45it/s]
 34%|███▍      | 127515/371472 [10:08:23<20:03:18,  3.38it/s]
 34%|███▍      | 127516/371472 [10:08:24<20:25:47,  3.32it/s]
 34%|███▍      | 127517/371472 [10:08:24<19:37:10,  3.45it/s]
 34%|███▍      | 127518/371472 [10:08:24<19:33:45,  3.46it/s]
 34%|███▍      | 127519/371472 [10:08:24<18:55:37,  3.58it/s]
 34%|███▍      | 127520/371472 [10:08:25<19:11:05,  3.53it/s]
                                                             
{'loss': 3.2078, 'learning_rate': 6.913637441013596e-07, 'epoch': 5.49}

 34%|███▍      | 127520/371472 [10:08:25<19:11:05,  3.53it/s]
 34%|███▍      | 127521/371472 [10:08:25<20:04:07,  3.38it/s]
 34%|███▍      | 127522/371472 [10:08:25<19:35:19,  3.46it/s]
 34%|███▍      | 127523/371472 [10:08:26<18:36:26,  3.64it/s]
 34%|███▍      | 127524/371472 [10:08:26<18:32:34,  3.65it/s]
 34%|███▍      | 127525/371472 [10:08:26<18:24:59,  3.68it/s]
 34%|███▍      | 127526/371472 [10:08:26<18:09:35,  3.73it/s]
 34%|███▍      | 127527/371472 [10:08:27<17:56:14,  3.78it/s]
 34%|███▍      | 127528/371472 [10:08:27<17:18:42,  3.91it/s]
 34%|███▍      | 127529/371472 [10:08:27<17:33:51,  3.86it/s]
 34%|███▍      | 127530/371472 [10:08:27<17:42:42,  3.83it/s]
 34%|███▍      | 127531/371472 [10:08:28<18:34:21,  3.65it/s]
 34%|███▍      | 127532/371472 [10:08:28<20:05:16,  3.37it/s]
 34%|███▍      | 127533/371472 [10:08:28<19:25:36,  3.49it/s]
 34%|███▍      | 127534/371472 [10:08:29<19:20:27,  3.50it/s]
 34%|███▍      | 127535/371472 [10:08:29<18:47:04,  3.61it/s]
 34%|███▍      | 127536/371472 [10:08:29<18:21:17,  3.69it/s]
 34%|███▍      | 127537/371472 [10:08:29<18:40:37,  3.63it/s]
 34%|███▍      | 127538/371472 [10:08:30<18:38:50,  3.63it/s]
 34%|███▍      | 127539/371472 [10:08:30<19:49:39,  3.42it/s]
 34%|███▍      | 127540/371472 [10:08:30<20:09:58,  3.36it/s]
                                                             
{'loss': 3.1427, 'learning_rate': 6.913152621258807e-07, 'epoch': 5.49}

 34%|███▍      | 127540/371472 [10:08:30<20:09:58,  3.36it/s]
 34%|███▍      | 127541/371472 [10:08:31<19:45:42,  3.43it/s]
 34%|███▍      | 127542/371472 [10:08:31<19:01:12,  3.56it/s]
 34%|███▍      | 127543/371472 [10:08:31<18:50:26,  3.60it/s]
 34%|███▍      | 127544/371472 [10:08:31<18:22:44,  3.69it/s]
 34%|███▍      | 127545/371472 [10:08:32<18:08:22,  3.74it/s]
 34%|███▍      | 127546/371472 [10:08:32<18:10:37,  3.73it/s]
 34%|███▍      | 127547/371472 [10:08:32<18:29:10,  3.67it/s]
 34%|███▍      | 127548/371472 [10:08:32<18:44:56,  3.61it/s]
 34%|███▍      | 127549/371472 [10:08:33<18:19:58,  3.70it/s]
 34%|███▍      | 127550/371472 [10:08:33<18:30:52,  3.66it/s]
 34%|███▍      | 127551/371472 [10:08:33<18:47:29,  3.61it/s]
 34%|███▍      | 127552/371472 [10:08:34<18:23:01,  3.69it/s]
 34%|███▍      | 127553/371472 [10:08:34<18:40:11,  3.63it/s]
 34%|███▍      | 127554/371472 [10:08:34<18:34:25,  3.65it/s]
 34%|███▍      | 127555/371472 [10:08:34<18:52:00,  3.59it/s]
 34%|███▍      | 127556/371472 [10:08:35<18:52:50,  3.59it/s]
 34%|███▍      | 127557/371472 [10:08:35<18:39:20,  3.63it/s]
 34%|███▍      | 127558/371472 [10:08:35<18:15:46,  3.71it/s]
 34%|███▍      | 127559/371472 [10:08:35<17:35:59,  3.85it/s]
 34%|███▍      | 127560/371472 [10:08:36<17:34:40,  3.85it/s]
                                                             
{'loss': 3.2661, 'learning_rate': 6.912667801504019e-07, 'epoch': 5.49}

 34%|███▍      | 127560/371472 [10:08:36<17:34:40,  3.85it/s]
 34%|███▍      | 127561/371472 [10:08:36<17:36:30,  3.85it/s]
 34%|███▍      | 127562/371472 [10:08:36<17:28:11,  3.88it/s]
 34%|███▍      | 127563/371472 [10:08:36<17:34:43,  3.85it/s]
 34%|███▍      | 127564/371472 [10:08:37<16:58:56,  3.99it/s]
 34%|███▍      | 127565/371472 [10:08:37<18:28:31,  3.67it/s]
 34%|███▍      | 127566/371472 [10:08:37<17:42:36,  3.83it/s]
 34%|███▍      | 127567/371472 [10:08:38<17:51:47,  3.79it/s]
 34%|███▍      | 127568/371472 [10:08:38<17:25:51,  3.89it/s]
 34%|███▍      | 127569/371472 [10:08:38<18:21:17,  3.69it/s]
 34%|███▍      | 127570/371472 [10:08:38<18:27:24,  3.67it/s]
 34%|███▍      | 127571/371472 [10:08:39<18:02:25,  3.76it/s]
 34%|███▍      | 127572/371472 [10:08:39<19:49:04,  3.42it/s]
 34%|███▍      | 127573/371472 [10:08:39<19:55:05,  3.40it/s]
 34%|███▍      | 127574/371472 [10:08:40<19:14:00,  3.52it/s]
 34%|███▍      | 127575/371472 [10:08:40<19:10:25,  3.53it/s]
 34%|███▍      | 127576/371472 [10:08:40<18:29:27,  3.66it/s]
 34%|███▍      | 127577/371472 [10:08:40<17:59:37,  3.77it/s]
 34%|███▍      | 127578/371472 [10:08:41<17:47:17,  3.81it/s]
 34%|███▍      | 127579/371472 [10:08:41<18:39:32,  3.63it/s]
 34%|███▍      | 127580/371472 [10:08:41<18:32:50,  3.65it/s]
                                                             
{'loss': 3.1361, 'learning_rate': 6.91218298174923e-07, 'epoch': 5.5}

 34%|███▍      | 127580/371472 [10:08:41<18:32:50,  3.65it/s]
 34%|███▍      | 127581/371472 [10:08:41<19:14:35,  3.52it/s]
 34%|███▍      | 127582/371472 [10:08:42<19:32:53,  3.47it/s]
 34%|███▍      | 127583/371472 [10:08:42<19:27:02,  3.48it/s]
 34%|███▍      | 127584/371472 [10:08:42<19:23:08,  3.49it/s]
 34%|███▍      | 127585/371472 [10:08:43<19:40:52,  3.44it/s]
 34%|███▍      | 127586/371472 [10:08:43<18:44:06,  3.62it/s]
 34%|███▍      | 127587/371472 [10:08:43<18:35:24,  3.64it/s]
 34%|███▍      | 127588/371472 [10:08:43<19:00:54,  3.56it/s]
 34%|███▍      | 127589/371472 [10:08:44<18:14:20,  3.71it/s]
 34%|███▍      | 127590/371472 [10:08:44<18:47:38,  3.60it/s]
 34%|███▍      | 127591/371472 [10:08:44<18:49:18,  3.60it/s]
 34%|███▍      | 127592/371472 [10:08:45<19:18:18,  3.51it/s]
 34%|███▍      | 127593/371472 [10:08:45<18:30:29,  3.66it/s]
 34%|███▍      | 127594/371472 [10:08:45<18:39:26,  3.63it/s]
 34%|███▍      | 127595/371472 [10:08:45<18:48:44,  3.60it/s]
 34%|███▍      | 127596/371472 [10:08:46<20:07:31,  3.37it/s]
 34%|███▍      | 127597/371472 [10:08:46<18:58:43,  3.57it/s]
 34%|███▍      | 127598/371472 [10:08:46<18:44:09,  3.62it/s]
 34%|███▍      | 127599/371472 [10:08:46<18:34:55,  3.65it/s]
 34%|███▍      | 127600/371472 [10:08:47<18:35:18,  3.64it/s]
                                                             
{'loss': 3.3142, 'learning_rate': 6.911698161994441e-07, 'epoch': 5.5}

 34%|███▍      | 127600/371472 [10:08:47<18:35:18,  3.64it/s]
 34%|███▍      | 127601/371472 [10:08:47<19:48:15,  3.42it/s]
 34%|███▍      | 127602/371472 [10:08:47<19:22:49,  3.50it/s]
 34%|███▍      | 127603/371472 [10:08:48<19:35:32,  3.46it/s]
 34%|███▍      | 127604/371472 [10:08:48<19:07:21,  3.54it/s]
 34%|███▍      | 127605/371472 [10:08:48<19:12:36,  3.53it/s]
 34%|███▍      | 127606/371472 [10:08:49<21:09:44,  3.20it/s]
 34%|███▍      | 127607/371472 [10:08:49<20:50:11,  3.25it/s]
 34%|███▍      | 127608/371472 [10:08:49<20:35:09,  3.29it/s]
 34%|███▍      | 127609/371472 [10:08:49<19:35:44,  3.46it/s]
 34%|███▍      | 127610/371472 [10:08:50<19:26:25,  3.48it/s]
 34%|███▍      | 127611/371472 [10:08:50<18:29:04,  3.66it/s]
 34%|███▍      | 127612/371472 [10:08:50<19:51:38,  3.41it/s]
 34%|███▍      | 127613/371472 [10:08:51<19:34:07,  3.46it/s]
 34%|███▍      | 127614/371472 [10:08:51<18:59:22,  3.57it/s]
 34%|███▍      | 127615/371472 [10:08:51<18:52:11,  3.59it/s]
 34%|███▍      | 127616/371472 [10:08:51<19:01:58,  3.56it/s]
 34%|███▍      | 127617/371472 [10:08:52<20:09:40,  3.36it/s]
 34%|███▍      | 127618/371472 [10:08:52<19:27:20,  3.48it/s]
 34%|███▍      | 127619/371472 [10:08:52<19:39:22,  3.45it/s]
 34%|███▍      | 127620/371472 [10:08:53<19:04:16,  3.55it/s]
                                                             
{'loss': 3.0769, 'learning_rate': 6.911213342239651e-07, 'epoch': 5.5}

 34%|███▍      | 127620/371472 [10:08:53<19:04:16,  3.55it/s]
 34%|███▍      | 127621/371472 [10:08:53<20:22:29,  3.32it/s]
 34%|███▍      | 127622/371472 [10:08:53<19:51:26,  3.41it/s]
 34%|███▍      | 127623/371472 [10:08:53<19:15:11,  3.52it/s]
 34%|███▍      | 127624/371472 [10:08:54<18:14:20,  3.71it/s]
 34%|███▍      | 127625/371472 [10:08:54<18:40:58,  3.63it/s]
 34%|███▍      | 127626/371472 [10:08:54<18:44:57,  3.61it/s]
 34%|███▍      | 127627/371472 [10:08:54<18:34:42,  3.65it/s]
 34%|███▍      | 127628/371472 [10:08:55<20:42:33,  3.27it/s]
 34%|███▍      | 127629/371472 [10:08:55<19:52:43,  3.41it/s]
 34%|███▍      | 127630/371472 [10:08:55<19:42:59,  3.44it/s]
 34%|███▍      | 127631/371472 [10:08:56<19:11:12,  3.53it/s]
 34%|███▍      | 127632/371472 [10:08:56<18:13:15,  3.72it/s]
 34%|███▍      | 127633/371472 [10:08:56<17:53:05,  3.79it/s]
 34%|███▍      | 127634/371472 [10:08:57<20:09:39,  3.36it/s]
 34%|███▍      | 127635/371472 [10:08:57<19:49:24,  3.42it/s]
 34%|███▍      | 127636/371472 [10:08:57<20:05:02,  3.37it/s]
 34%|███▍      | 127637/371472 [10:08:57<19:16:36,  3.51it/s]
 34%|███▍      | 127638/371472 [10:08:58<20:49:23,  3.25it/s]
 34%|███▍      | 127639/371472 [10:08:58<20:12:26,  3.35it/s]
 34%|███▍      | 127640/371472 [10:08:58<19:54:12,  3.40it/s]
                                                             
{'loss': 3.3286, 'learning_rate': 6.910728522484862e-07, 'epoch': 5.5}

 34%|███▍      | 127640/371472 [10:08:58<19:54:12,  3.40it/s]
 34%|███▍      | 127641/371472 [10:08:59<18:35:34,  3.64it/s]
 34%|███▍      | 127642/371472 [10:08:59<18:38:34,  3.63it/s]
 34%|███▍      | 127643/371472 [10:08:59<18:53:06,  3.59it/s]
 34%|███▍      | 127644/371472 [10:08:59<19:04:27,  3.55it/s]
 34%|███▍      | 127645/371472 [10:09:00<18:32:05,  3.65it/s]
 34%|███▍      | 127646/371472 [10:09:00<18:58:08,  3.57it/s]
 34%|███▍      | 127647/371472 [10:09:00<18:27:27,  3.67it/s]
 34%|███▍      | 127648/371472 [10:09:00<18:08:37,  3.73it/s]
 34%|███▍      | 127649/371472 [10:09:01<18:37:19,  3.64it/s]
 34%|███▍      | 127650/371472 [10:09:01<17:45:04,  3.82it/s]
 34%|███▍      | 127651/371472 [10:09:01<18:14:27,  3.71it/s]
 34%|███▍      | 127652/371472 [10:09:02<19:28:49,  3.48it/s]
 34%|███▍      | 127653/371472 [10:09:02<18:54:42,  3.58it/s]
 34%|███▍      | 127654/371472 [10:09:02<18:13:47,  3.72it/s]
 34%|███▍      | 127655/371472 [10:09:02<17:57:44,  3.77it/s]
 34%|███▍      | 127656/371472 [10:09:03<18:09:33,  3.73it/s]
 34%|███▍      | 127657/371472 [10:09:03<18:36:21,  3.64it/s]
 34%|███▍      | 127658/371472 [10:09:03<17:59:58,  3.76it/s]
 34%|███▍      | 127659/371472 [10:09:03<18:47:50,  3.60it/s]
 34%|███▍      | 127660/371472 [10:09:04<20:02:13,  3.38it/s]
                                                             
{'loss': 3.2604, 'learning_rate': 6.910243702730073e-07, 'epoch': 5.5}

 34%|███▍      | 127660/371472 [10:09:04<20:02:13,  3.38it/s]
 34%|███▍      | 127661/371472 [10:09:04<19:51:42,  3.41it/s]
 34%|███▍      | 127662/371472 [10:09:04<19:46:48,  3.42it/s]
 34%|███▍      | 127663/371472 [10:09:05<19:19:14,  3.51it/s]
 34%|███▍      | 127664/371472 [10:09:05<20:21:25,  3.33it/s]
 34%|███▍      | 127665/371472 [10:09:05<19:57:12,  3.39it/s]
 34%|███▍      | 127666/371472 [10:09:06<19:17:46,  3.51it/s]
 34%|███▍      | 127667/371472 [10:09:06<18:35:40,  3.64it/s]
 34%|███▍      | 127668/371472 [10:09:06<18:15:23,  3.71it/s]
 34%|███▍      | 127669/371472 [10:09:06<19:54:47,  3.40it/s]
 34%|███▍      | 127670/371472 [10:09:07<19:10:34,  3.53it/s]
 34%|███▍      | 127671/371472 [10:09:07<19:19:46,  3.50it/s]
 34%|███▍      | 127672/371472 [10:09:07<18:41:00,  3.62it/s]
 34%|███▍      | 127673/371472 [10:09:08<20:07:32,  3.36it/s]
 34%|███▍      | 127674/371472 [10:09:08<20:15:09,  3.34it/s]
 34%|███▍      | 127675/371472 [10:09:08<19:50:19,  3.41it/s]
 34%|███▍      | 127676/371472 [10:09:08<20:41:05,  3.27it/s]
 34%|███▍      | 127677/371472 [10:09:09<20:05:14,  3.37it/s]
 34%|███▍      | 127678/371472 [10:09:09<19:04:06,  3.55it/s]
 34%|███▍      | 127679/371472 [10:09:09<18:49:52,  3.60it/s]
 34%|███▍      | 127680/371472 [10:09:10<18:10:15,  3.73it/s]
                                                             
{'loss': 3.188, 'learning_rate': 6.909758882975284e-07, 'epoch': 5.5}

 34%|███▍      | 127680/371472 [10:09:10<18:10:15,  3.73it/s]
 34%|███▍      | 127681/371472 [10:09:10<19:21:32,  3.50it/s]
 34%|███▍      | 127682/371472 [10:09:10<19:21:35,  3.50it/s]
 34%|███▍      | 127683/371472 [10:09:10<19:44:19,  3.43it/s]
 34%|███▍      | 127684/371472 [10:09:11<19:14:25,  3.52it/s]
 34%|███▍      | 127685/371472 [10:09:11<18:34:16,  3.65it/s]
 34%|███▍      | 127686/371472 [10:09:11<18:23:35,  3.68it/s]
 34%|███▍      | 127687/371472 [10:09:11<17:41:06,  3.83it/s]
 34%|███▍      | 127688/371472 [10:09:12<17:25:36,  3.89it/s]
 34%|███▍      | 127689/371472 [10:09:12<17:39:38,  3.83it/s]
 34%|███▍      | 127690/371472 [10:09:12<17:52:54,  3.79it/s]
 34%|███▍      | 127691/371472 [10:09:13<18:24:48,  3.68it/s]
 34%|███▍      | 127692/371472 [10:09:13<17:58:02,  3.77it/s]
 34%|███▍      | 127693/371472 [10:09:13<19:42:37,  3.44it/s]
 34%|███▍      | 127694/371472 [10:09:13<19:27:20,  3.48it/s]
 34%|███▍      | 127695/371472 [10:09:14<20:31:33,  3.30it/s]
 34%|███▍      | 127696/371472 [10:09:14<20:00:25,  3.38it/s]
 34%|███▍      | 127697/371472 [10:09:14<19:05:30,  3.55it/s]
 34%|███▍      | 127698/371472 [10:09:15<20:07:11,  3.37it/s]
 34%|███▍      | 127699/371472 [10:09:15<20:22:08,  3.32it/s]
 34%|███▍      | 127700/371472 [10:09:15<19:50:47,  3.41it/s]
                                                             
{'loss': 3.0901, 'learning_rate': 6.909274063220496e-07, 'epoch': 5.5}

 34%|███▍      | 127700/371472 [10:09:15<19:50:47,  3.41it/s]
 34%|███▍      | 127701/371472 [10:09:15<18:58:49,  3.57it/s]
 34%|███▍      | 127702/371472 [10:09:16<19:37:48,  3.45it/s]
 34%|███▍      | 127703/371472 [10:09:16<19:50:38,  3.41it/s]
 34%|███▍      | 127704/371472 [10:09:16<19:30:15,  3.47it/s]
 34%|███▍      | 127705/371472 [10:09:17<19:06:52,  3.54it/s]
 34%|███▍      | 127706/371472 [10:09:17<20:24:56,  3.32it/s]
 34%|███▍      | 127707/371472 [10:09:17<21:49:50,  3.10it/s]
 34%|███▍      | 127708/371472 [10:09:18<20:29:04,  3.31it/s]
 34%|███▍      | 127709/371472 [10:09:18<21:23:07,  3.17it/s]
 34%|███▍      | 127710/371472 [10:09:18<20:50:35,  3.25it/s]
 34%|███▍      | 127711/371472 [10:09:19<20:47:46,  3.26it/s]
 34%|███▍      | 127712/371472 [10:09:19<19:52:01,  3.41it/s]
 34%|███▍      | 127713/371472 [10:09:19<19:14:56,  3.52it/s]
 34%|███▍      | 127714/371472 [10:09:19<19:02:41,  3.56it/s]
 34%|███▍      | 127715/371472 [10:09:20<20:09:14,  3.36it/s]
 34%|███▍      | 127716/371472 [10:09:20<19:28:34,  3.48it/s]
 34%|███▍      | 127717/371472 [10:09:20<18:44:31,  3.61it/s]
 34%|███▍      | 127718/371472 [10:09:20<18:47:00,  3.60it/s]
 34%|███▍      | 127719/371472 [10:09:21<18:33:19,  3.65it/s]
 34%|███▍      | 127720/371472 [10:09:21<18:48:34,  3.60it/s]
                                                             
{'loss': 3.1472, 'learning_rate': 6.908789243465709e-07, 'epoch': 5.5}

 34%|███▍      | 127720/371472 [10:09:21<18:48:34,  3.60it/s]
 34%|███▍      | 127721/371472 [10:09:21<19:05:45,  3.55it/s]
 34%|███▍      | 127722/371472 [10:09:22<18:22:29,  3.68it/s]
 34%|███▍      | 127723/371472 [10:09:22<18:41:25,  3.62it/s]
 34%|███▍      | 127724/371472 [10:09:22<18:35:38,  3.64it/s]
 34%|███▍      | 127725/371472 [10:09:22<18:49:50,  3.60it/s]
 34%|███▍      | 127726/371472 [10:09:23<18:58:16,  3.57it/s]
 34%|███▍      | 127727/371472 [10:09:23<19:08:03,  3.54it/s]
 34%|███▍      | 127728/371472 [10:09:23<19:00:04,  3.56it/s]
 34%|███▍      | 127729/371472 [10:09:24<18:52:33,  3.59it/s]
 34%|███▍      | 127730/371472 [10:09:24<18:53:21,  3.58it/s]
 34%|███▍      | 127731/371472 [10:09:24<18:41:16,  3.62it/s]
 34%|███▍      | 127732/371472 [10:09:24<18:55:17,  3.58it/s]
 34%|███▍      | 127733/371472 [10:09:25<18:29:33,  3.66it/s]
 34%|███▍      | 127734/371472 [10:09:25<18:54:57,  3.58it/s]
 34%|███▍      | 127735/371472 [10:09:25<19:15:47,  3.51it/s]
 34%|███▍      | 127736/371472 [10:09:25<19:04:03,  3.55it/s]
 34%|███▍      | 127737/371472 [10:09:26<18:22:23,  3.68it/s]
 34%|███▍      | 127738/371472 [10:09:26<18:05:28,  3.74it/s]
 34%|███▍      | 127739/371472 [10:09:26<19:26:25,  3.48it/s]
 34%|███▍      | 127740/371472 [10:09:27<18:43:32,  3.62it/s]
                                                             
{'loss': 3.3285, 'learning_rate': 6.908304423710918e-07, 'epoch': 5.5}

 34%|███▍      | 127740/371472 [10:09:27<18:43:32,  3.62it/s]
 34%|███▍      | 127741/371472 [10:09:27<18:33:21,  3.65it/s]
 34%|███▍      | 127742/371472 [10:09:27<19:16:41,  3.51it/s]
 34%|███▍      | 127743/371472 [10:09:27<18:44:34,  3.61it/s]
 34%|███▍      | 127744/371472 [10:09:28<19:13:28,  3.52it/s]
 34%|███▍      | 127745/371472 [10:09:28<19:12:08,  3.53it/s]
 34%|███▍      | 127746/371472 [10:09:28<19:35:30,  3.46it/s]
 34%|███▍      | 127747/371472 [10:09:29<18:24:10,  3.68it/s]
 34%|███▍      | 127748/371472 [10:09:29<17:57:22,  3.77it/s]
 34%|███▍      | 127749/371472 [10:09:29<17:32:51,  3.86it/s]
 34%|███▍      | 127750/371472 [10:09:29<17:14:35,  3.93it/s]
 34%|███▍      | 127751/371472 [10:09:30<17:19:03,  3.91it/s]
 34%|███▍      | 127752/371472 [10:09:30<17:19:47,  3.91it/s]
 34%|███▍      | 127753/371472 [10:09:30<17:26:22,  3.88it/s]
 34%|███▍      | 127754/371472 [10:09:30<17:25:28,  3.89it/s]
 34%|███▍      | 127755/371472 [10:09:31<17:56:39,  3.77it/s]
 34%|███▍      | 127756/371472 [10:09:31<19:36:59,  3.45it/s]
 34%|███▍      | 127757/371472 [10:09:31<19:04:23,  3.55it/s]
 34%|███▍      | 127758/371472 [10:09:31<18:42:55,  3.62it/s]
 34%|███▍      | 127759/371472 [10:09:32<18:05:30,  3.74it/s]
 34%|███▍      | 127760/371472 [10:09:32<17:51:34,  3.79it/s]
                                                             
{'loss': 3.3031, 'learning_rate': 6.907819603956128e-07, 'epoch': 5.5}

 34%|███▍      | 127760/371472 [10:09:32<17:51:34,  3.79it/s]
 34%|███▍      | 127761/371472 [10:09:32<17:27:57,  3.88it/s]
 34%|███▍      | 127762/371472 [10:09:32<17:47:47,  3.80it/s]
 34%|███▍      | 127763/371472 [10:09:33<17:46:35,  3.81it/s]
 34%|███▍      | 127764/371472 [10:09:33<19:12:23,  3.52it/s]
 34%|███▍      | 127765/371472 [10:09:33<18:19:10,  3.70it/s]
 34%|███▍      | 127766/371472 [10:09:34<17:54:11,  3.78it/s]
 34%|███▍      | 127767/371472 [10:09:34<17:47:09,  3.81it/s]
 34%|███▍      | 127768/371472 [10:09:34<17:36:31,  3.84it/s]
 34%|███▍      | 127769/371472 [10:09:34<17:24:11,  3.89it/s]
 34%|███▍      | 127770/371472 [10:09:35<19:08:24,  3.54it/s]
 34%|███▍      | 127771/371472 [10:09:35<18:32:43,  3.65it/s]
 34%|███▍      | 127772/371472 [10:09:35<19:13:38,  3.52it/s]
 34%|███▍      | 127773/371472 [10:09:35<19:17:16,  3.51it/s]
 34%|███▍      | 127774/371472 [10:09:36<20:24:47,  3.32it/s]
 34%|███▍      | 127775/371472 [10:09:36<19:35:07,  3.46it/s]
 34%|███▍      | 127776/371472 [10:09:36<19:25:19,  3.49it/s]
 34%|███▍      | 127777/371472 [10:09:37<18:32:25,  3.65it/s]
 34%|███▍      | 127778/371472 [10:09:37<18:20:40,  3.69it/s]
 34%|███▍      | 127779/371472 [10:09:37<18:21:30,  3.69it/s]
 34%|███▍      | 127780/371472 [10:09:37<18:24:37,  3.68it/s]
                                                             
{'loss': 3.4402, 'learning_rate': 6.90733478420134e-07, 'epoch': 5.5}

 34%|███▍      | 127780/371472 [10:09:37<18:24:37,  3.68it/s]
 34%|███▍      | 127781/371472 [10:09:38<17:35:40,  3.85it/s]
 34%|███▍      | 127782/371472 [10:09:38<19:58:24,  3.39it/s]
 34%|███▍      | 127783/371472 [10:09:38<20:41:22,  3.27it/s]
 34%|███▍      | 127784/371472 [10:09:39<19:18:14,  3.51it/s]
 34%|███▍      | 127785/371472 [10:09:39<18:46:36,  3.61it/s]
 34%|███▍      | 127786/371472 [10:09:39<18:56:16,  3.57it/s]
 34%|███▍      | 127787/371472 [10:09:39<18:21:31,  3.69it/s]
 34%|███▍      | 127788/371472 [10:09:40<18:47:52,  3.60it/s]
 34%|███▍      | 127789/371472 [10:09:40<18:37:12,  3.64it/s]
 34%|███▍      | 127790/371472 [10:09:40<19:40:44,  3.44it/s]
 34%|███▍      | 127791/371472 [10:09:41<20:34:39,  3.29it/s]
 34%|███▍      | 127792/371472 [10:09:41<21:36:37,  3.13it/s]
 34%|███▍      | 127793/371472 [10:09:41<20:10:33,  3.35it/s]
 34%|███▍      | 127794/371472 [10:09:41<19:16:02,  3.51it/s]
 34%|███▍      | 127795/371472 [10:09:42<18:22:56,  3.68it/s]
 34%|███▍      | 127796/371472 [10:09:42<18:13:33,  3.71it/s]
 34%|███▍      | 127797/371472 [10:09:42<17:46:12,  3.81it/s]
 34%|███▍      | 127798/371472 [10:09:43<17:58:16,  3.77it/s]
 34%|███▍      | 127799/371472 [10:09:43<18:26:46,  3.67it/s]
 34%|███▍      | 127800/371472 [10:09:43<17:52:45,  3.79it/s]
                                                             
{'loss': 3.2753, 'learning_rate': 6.906849964446551e-07, 'epoch': 5.5}

 34%|███▍      | 127800/371472 [10:09:43<17:52:45,  3.79it/s]
 34%|███▍      | 127801/371472 [10:09:43<18:35:02,  3.64it/s]
 34%|███▍      | 127802/371472 [10:09:44<17:50:13,  3.79it/s]
 34%|███▍      | 127803/371472 [10:09:44<18:04:20,  3.75it/s]
 34%|███▍      | 127804/371472 [10:09:44<17:52:29,  3.79it/s]
 34%|███▍      | 127805/371472 [10:09:44<18:05:09,  3.74it/s]
 34%|███▍      | 127806/371472 [10:09:45<17:47:04,  3.81it/s]
 34%|███▍      | 127807/371472 [10:09:45<17:50:19,  3.79it/s]
 34%|███▍      | 127808/371472 [10:09:45<17:43:11,  3.82it/s]
 34%|███▍      | 127809/371472 [10:09:45<19:18:27,  3.51it/s]
 34%|███▍      | 127810/371472 [10:09:46<20:53:38,  3.24it/s]
 34%|███▍      | 127811/371472 [10:09:46<21:42:45,  3.12it/s]
 34%|███▍      | 127812/371472 [10:09:47<22:03:20,  3.07it/s]
 34%|███▍      | 127813/371472 [10:09:47<20:17:40,  3.34it/s]
 34%|███▍      | 127814/371472 [10:09:47<20:04:16,  3.37it/s]
 34%|███▍      | 127815/371472 [10:09:47<19:02:53,  3.55it/s]
 34%|███▍      | 127816/371472 [10:09:48<19:24:59,  3.49it/s]
 34%|███▍      | 127817/371472 [10:09:48<18:57:23,  3.57it/s]
 34%|███▍      | 127818/371472 [10:09:48<19:05:53,  3.54it/s]
 34%|███▍      | 127819/371472 [10:09:48<18:26:13,  3.67it/s]
 34%|███▍      | 127820/371472 [10:09:49<17:42:26,  3.82it/s]
                                                             
{'loss': 3.1753, 'learning_rate': 6.906365144691762e-07, 'epoch': 5.51}

 34%|███▍      | 127820/371472 [10:09:49<17:42:26,  3.82it/s]
 34%|███▍      | 127821/371472 [10:09:49<17:25:33,  3.88it/s]
 34%|███▍      | 127822/371472 [10:09:49<17:14:03,  3.93it/s]
 34%|███▍      | 127823/371472 [10:09:49<17:11:41,  3.94it/s]
 34%|███▍      | 127824/371472 [10:09:50<19:17:06,  3.51it/s]
 34%|███▍      | 127825/371472 [10:09:50<18:57:55,  3.57it/s]
 34%|███▍      | 127826/371472 [10:09:50<18:00:40,  3.76it/s]
 34%|███▍      | 127827/371472 [10:09:51<17:51:43,  3.79it/s]
 34%|███▍      | 127828/371472 [10:09:51<18:27:48,  3.67it/s]
 34%|███▍      | 127829/371472 [10:09:51<19:03:24,  3.55it/s]
 34%|███▍      | 127830/371472 [10:09:51<18:08:14,  3.73it/s]
 34%|███▍      | 127831/371472 [10:09:52<19:45:27,  3.43it/s]
 34%|███▍      | 127832/371472 [10:09:52<19:23:04,  3.49it/s]
 34%|███▍      | 127833/371472 [10:09:52<19:18:29,  3.51it/s]
 34%|███▍      | 127834/371472 [10:09:53<19:08:22,  3.54it/s]
 34%|███▍      | 127835/371472 [10:09:53<18:58:20,  3.57it/s]
 34%|███▍      | 127836/371472 [10:09:53<18:33:17,  3.65it/s]
 34%|███▍      | 127837/371472 [10:09:53<18:54:47,  3.58it/s]
 34%|███▍      | 127838/371472 [10:09:54<18:22:39,  3.68it/s]
 34%|███▍      | 127839/371472 [10:09:54<17:53:56,  3.78it/s]
 34%|███▍      | 127840/371472 [10:09:54<17:33:21,  3.85it/s]
                                                             
{'loss': 3.083, 'learning_rate': 6.905880324936973e-07, 'epoch': 5.51}

 34%|███▍      | 127840/371472 [10:09:54<17:33:21,  3.85it/s]
 34%|███▍      | 127841/371472 [10:09:54<18:43:00,  3.62it/s]
 34%|███▍      | 127842/371472 [10:09:55<19:41:54,  3.44it/s]
 34%|███▍      | 127843/371472 [10:09:55<19:21:02,  3.50it/s]
 34%|███▍      | 127844/371472 [10:09:55<19:42:35,  3.43it/s]
 34%|███▍      | 127845/371472 [10:09:56<20:04:29,  3.37it/s]
 34%|███▍      | 127846/371472 [10:09:56<19:53:15,  3.40it/s]
 34%|███▍      | 127847/371472 [10:09:56<21:31:45,  3.14it/s]
 34%|███▍      | 127848/371472 [10:09:57<20:22:42,  3.32it/s]
 34%|███▍      | 127849/371472 [10:09:57<20:44:33,  3.26it/s]
 34%|███▍      | 127850/371472 [10:09:57<20:21:17,  3.32it/s]
 34%|███▍      | 127851/371472 [10:09:57<20:06:02,  3.37it/s]
 34%|███▍      | 127852/371472 [10:09:58<19:18:19,  3.51it/s]
 34%|███▍      | 127853/371472 [10:09:58<19:59:55,  3.38it/s]
 34%|███▍      | 127854/371472 [10:09:58<20:32:30,  3.29it/s]
 34%|███▍      | 127855/371472 [10:09:59<19:55:49,  3.40it/s]
 34%|███▍      | 127856/371472 [10:09:59<20:12:51,  3.35it/s]
 34%|███▍      | 127857/371472 [10:09:59<19:33:57,  3.46it/s]
 34%|███▍      | 127858/371472 [10:09:59<19:21:49,  3.49it/s]
 34%|███▍      | 127859/371472 [10:10:00<19:18:33,  3.50it/s]
 34%|███▍      | 127860/371472 [10:10:00<19:26:33,  3.48it/s]
                                                             
{'loss': 3.2826, 'learning_rate': 6.905395505182185e-07, 'epoch': 5.51}

 34%|███▍      | 127860/371472 [10:10:00<19:26:33,  3.48it/s]
 34%|███▍      | 127861/371472 [10:10:00<19:29:29,  3.47it/s]
 34%|███▍      | 127862/371472 [10:10:01<18:58:03,  3.57it/s]
 34%|███▍      | 127863/371472 [10:10:01<18:53:10,  3.58it/s]
 34%|███▍      | 127864/371472 [10:10:01<18:13:45,  3.71it/s]
 34%|███▍      | 127865/371472 [10:10:01<18:04:12,  3.74it/s]
 34%|███▍      | 127866/371472 [10:10:02<17:33:09,  3.86it/s]
 34%|███▍      | 127867/371472 [10:10:02<17:38:01,  3.84it/s]
 34%|███▍      | 127868/371472 [10:10:02<18:10:23,  3.72it/s]
 34%|███▍      | 127869/371472 [10:10:03<19:17:26,  3.51it/s]
 34%|███▍      | 127870/371472 [10:10:03<20:47:09,  3.26it/s]
 34%|███▍      | 127871/371472 [10:10:03<19:51:26,  3.41it/s]
 34%|███▍      | 127872/371472 [10:10:03<18:56:20,  3.57it/s]
 34%|███▍      | 127873/371472 [10:10:04<18:16:44,  3.70it/s]
 34%|███▍      | 127874/371472 [10:10:04<17:50:02,  3.79it/s]
 34%|███▍      | 127875/371472 [10:10:04<18:56:54,  3.57it/s]
 34%|███▍      | 127876/371472 [10:10:04<18:49:06,  3.60it/s]
 34%|███▍      | 127877/371472 [10:10:05<18:09:58,  3.72it/s]
 34%|███▍      | 127878/371472 [10:10:05<18:24:34,  3.68it/s]
 34%|███▍      | 127879/371472 [10:10:05<18:47:14,  3.60it/s]
 34%|███▍      | 127880/371472 [10:10:06<18:26:18,  3.67it/s]
                                                             
{'loss': 3.3222, 'learning_rate': 6.904910685427395e-07, 'epoch': 5.51}

 34%|███▍      | 127880/371472 [10:10:06<18:26:18,  3.67it/s]
 34%|███▍      | 127881/371472 [10:10:06<18:16:03,  3.70it/s]
 34%|███▍      | 127882/371472 [10:10:06<18:51:20,  3.59it/s]
 34%|███▍      | 127883/371472 [10:10:06<18:11:35,  3.72it/s]
 34%|███▍      | 127884/371472 [10:10:07<17:59:13,  3.76it/s]
 34%|███▍      | 127885/371472 [10:10:07<18:33:32,  3.65it/s]
 34%|███▍      | 127886/371472 [10:10:07<19:00:46,  3.56it/s]
 34%|███▍      | 127887/371472 [10:10:07<18:34:26,  3.64it/s]
 34%|███▍      | 127888/371472 [10:10:08<18:39:11,  3.63it/s]
 34%|███▍      | 127889/371472 [10:10:08<18:39:53,  3.63it/s]
 34%|███▍      | 127890/371472 [10:10:08<19:31:07,  3.47it/s]
 34%|███▍      | 127891/371472 [10:10:09<18:56:08,  3.57it/s]
 34%|███▍      | 127892/371472 [10:10:09<19:24:51,  3.49it/s]
 34%|███▍      | 127893/371472 [10:10:09<19:45:54,  3.42it/s]
 34%|███▍      | 127894/371472 [10:10:09<19:18:28,  3.50it/s]
 34%|███▍      | 127895/371472 [10:10:10<18:45:45,  3.61it/s]
 34%|███▍      | 127896/371472 [10:10:10<18:36:03,  3.64it/s]
 34%|███▍      | 127897/371472 [10:10:10<19:22:35,  3.49it/s]
 34%|███▍      | 127898/371472 [10:10:11<18:40:19,  3.62it/s]
 34%|███▍      | 127899/371472 [10:10:11<18:56:24,  3.57it/s]
 34%|███▍      | 127900/371472 [10:10:11<18:27:42,  3.66it/s]
                                                             
{'loss': 3.33, 'learning_rate': 6.904425865672606e-07, 'epoch': 5.51}

 34%|███▍      | 127900/371472 [10:10:11<18:27:42,  3.66it/s]
 34%|███▍      | 127901/371472 [10:10:11<19:34:24,  3.46it/s]
 34%|███▍      | 127902/371472 [10:10:12<18:51:19,  3.59it/s]
 34%|███▍      | 127903/371472 [10:10:12<20:25:37,  3.31it/s]
 34%|███▍      | 127904/371472 [10:10:12<19:30:45,  3.47it/s]
 34%|███▍      | 127905/371472 [10:10:13<18:49:35,  3.59it/s]
 34%|███▍      | 127906/371472 [10:10:13<19:12:48,  3.52it/s]
 34%|███▍      | 127907/371472 [10:10:13<19:00:45,  3.56it/s]
 34%|███▍      | 127908/371472 [10:10:13<19:13:05,  3.52it/s]
 34%|███▍      | 127909/371472 [10:10:14<18:18:31,  3.70it/s]
 34%|███▍      | 127910/371472 [10:10:14<18:13:52,  3.71it/s]
 34%|███▍      | 127911/371472 [10:10:14<18:15:25,  3.71it/s]
 34%|███▍      | 127912/371472 [10:10:15<19:28:54,  3.47it/s]
 34%|███▍      | 127913/371472 [10:10:15<18:56:20,  3.57it/s]
 34%|███▍      | 127914/371472 [10:10:15<19:21:45,  3.49it/s]
 34%|███▍      | 127915/371472 [10:10:15<19:21:13,  3.50it/s]
 34%|███▍      | 127916/371472 [10:10:16<19:51:01,  3.41it/s]
 34%|███▍      | 127917/371472 [10:10:16<18:58:17,  3.57it/s]
 34%|███▍      | 127918/371472 [10:10:16<18:59:31,  3.56it/s]
 34%|███▍      | 127919/371472 [10:10:16<18:40:14,  3.62it/s]
 34%|███▍      | 127920/371472 [10:10:17<18:55:20,  3.58it/s]
                                                             
{'loss': 3.2663, 'learning_rate': 6.903941045917817e-07, 'epoch': 5.51}

 34%|███▍      | 127920/371472 [10:10:17<18:55:20,  3.58it/s]
 34%|███▍      | 127921/371472 [10:10:17<18:56:44,  3.57it/s]
 34%|███▍      | 127922/371472 [10:10:17<19:30:14,  3.47it/s]
 34%|███▍      | 127923/371472 [10:10:18<19:04:36,  3.55it/s]
 34%|███▍      | 127924/371472 [10:10:18<19:14:27,  3.52it/s]
 34%|███▍      | 127925/371472 [10:10:18<18:52:04,  3.59it/s]
 34%|███▍      | 127926/371472 [10:10:18<18:27:09,  3.67it/s]
 34%|███▍      | 127927/371472 [10:10:19<17:53:33,  3.78it/s]
 34%|███▍      | 127928/371472 [10:10:19<18:16:13,  3.70it/s]
 34%|███▍      | 127929/371472 [10:10:19<18:19:12,  3.69it/s]
 34%|███▍      | 127930/371472 [10:10:19<17:43:59,  3.81it/s]
 34%|███▍      | 127931/371472 [10:10:20<18:19:01,  3.69it/s]
 34%|███▍      | 127932/371472 [10:10:20<18:59:43,  3.56it/s]
 34%|███▍      | 127933/371472 [10:10:20<19:57:04,  3.39it/s]
 34%|███▍      | 127934/371472 [10:10:21<19:03:17,  3.55it/s]
 34%|███▍      | 127935/371472 [10:10:21<19:15:49,  3.51it/s]
 34%|███▍      | 127936/371472 [10:10:21<18:30:10,  3.66it/s]
 34%|███▍      | 127937/371472 [10:10:21<18:01:03,  3.75it/s]
 34%|███▍      | 127938/371472 [10:10:22<18:10:46,  3.72it/s]
 34%|███▍      | 127939/371472 [10:10:22<18:00:00,  3.76it/s]
 34%|███▍      | 127940/371472 [10:10:22<19:21:57,  3.49it/s]
                                                             
{'loss': 3.1387, 'learning_rate': 6.903456226163029e-07, 'epoch': 5.51}

 34%|███▍      | 127940/371472 [10:10:22<19:21:57,  3.49it/s]
 34%|███▍      | 127941/371472 [10:10:23<19:08:32,  3.53it/s]
 34%|███▍      | 127942/371472 [10:10:23<19:36:36,  3.45it/s]
 34%|███▍      | 127943/371472 [10:10:23<19:07:25,  3.54it/s]
 34%|███▍      | 127944/371472 [10:10:23<19:05:36,  3.54it/s]
 34%|███▍      | 127945/371472 [10:10:24<18:28:52,  3.66it/s]
 34%|███▍      | 127946/371472 [10:10:24<18:34:35,  3.64it/s]
 34%|███▍      | 127947/371472 [10:10:24<17:58:23,  3.76it/s]
 34%|███▍      | 127948/371472 [10:10:25<18:17:44,  3.70it/s]
 34%|███▍      | 127949/371472 [10:10:25<18:37:05,  3.63it/s]
 34%|███▍      | 127950/371472 [10:10:25<19:31:24,  3.46it/s]
 34%|███▍      | 127951/371472 [10:10:25<19:26:26,  3.48it/s]
 34%|███▍      | 127952/371472 [10:10:26<18:38:54,  3.63it/s]
 34%|███▍      | 127953/371472 [10:10:26<19:32:15,  3.46it/s]
 34%|███▍      | 127954/371472 [10:10:26<19:17:54,  3.51it/s]
 34%|███▍      | 127955/371472 [10:10:27<18:56:32,  3.57it/s]
 34%|███▍      | 127956/371472 [10:10:27<18:23:29,  3.68it/s]
 34%|███▍      | 127957/371472 [10:10:27<18:05:54,  3.74it/s]
 34%|███▍      | 127958/371472 [10:10:27<17:40:20,  3.83it/s]
 34%|███▍      | 127959/371472 [10:10:28<17:38:59,  3.83it/s]
 34%|███▍      | 127960/371472 [10:10:28<17:06:47,  3.95it/s]
                                                             
{'loss': 3.1768, 'learning_rate': 6.90297140640824e-07, 'epoch': 5.51}

 34%|███▍      | 127960/371472 [10:10:28<17:06:47,  3.95it/s]
 34%|███▍      | 127961/371472 [10:10:28<17:44:44,  3.81it/s]
 34%|███▍      | 127962/371472 [10:10:28<17:56:14,  3.77it/s]
 34%|███▍      | 127963/371472 [10:10:29<17:53:11,  3.78it/s]
 34%|███▍      | 127964/371472 [10:10:29<17:44:26,  3.81it/s]
 34%|███▍      | 127965/371472 [10:10:29<17:50:34,  3.79it/s]
 34%|███▍      | 127966/371472 [10:10:29<18:42:31,  3.62it/s]
 34%|███▍      | 127967/371472 [10:10:30<18:10:23,  3.72it/s]
 34%|███▍      | 127968/371472 [10:10:30<18:12:10,  3.72it/s]
 34%|███▍      | 127969/371472 [10:10:30<20:20:13,  3.33it/s]
 34%|███▍      | 127970/371472 [10:10:31<19:53:03,  3.40it/s]
 34%|███▍      | 127971/371472 [10:10:31<18:56:33,  3.57it/s]
 34%|███▍      | 127972/371472 [10:10:31<18:26:21,  3.67it/s]
 34%|███▍      | 127973/371472 [10:10:31<18:33:37,  3.64it/s]
 34%|███▍      | 127974/371472 [10:10:32<18:09:58,  3.72it/s]
 34%|███▍      | 127975/371472 [10:10:32<18:21:11,  3.69it/s]
 34%|███▍      | 127976/371472 [10:10:32<18:10:47,  3.72it/s]
 34%|███▍      | 127977/371472 [10:10:33<20:12:03,  3.35it/s]
 34%|███▍      | 127978/371472 [10:10:33<19:06:43,  3.54it/s]
 34%|███▍      | 127979/371472 [10:10:33<20:28:00,  3.30it/s]
 34%|███▍      | 127980/371472 [10:10:33<19:51:15,  3.41it/s]
                                                             
{'loss': 3.268, 'learning_rate': 6.902486586653451e-07, 'epoch': 5.51}

 34%|███▍      | 127980/371472 [10:10:33<19:51:15,  3.41it/s]
 34%|███▍      | 127981/371472 [10:10:34<19:34:34,  3.46it/s]
 34%|███▍      | 127982/371472 [10:10:34<19:19:00,  3.50it/s]
 34%|███▍      | 127983/371472 [10:10:34<18:15:29,  3.70it/s]
 34%|███▍      | 127984/371472 [10:10:34<18:27:11,  3.67it/s]
 34%|███▍      | 127985/371472 [10:10:35<18:07:28,  3.73it/s]
 34%|███▍      | 127986/371472 [10:10:35<17:42:50,  3.82it/s]
 34%|███▍      | 127987/371472 [10:10:35<17:35:06,  3.85it/s]
 34%|███▍      | 127988/371472 [10:10:35<17:17:40,  3.91it/s]
 34%|███▍      | 127989/371472 [10:10:36<17:42:56,  3.82it/s]
 34%|███▍      | 127990/371472 [10:10:36<18:33:51,  3.64it/s]
 34%|███▍      | 127991/371472 [10:10:36<17:53:11,  3.78it/s]
 34%|███▍      | 127992/371472 [10:10:37<18:26:08,  3.67it/s]
 34%|███▍      | 127993/371472 [10:10:37<18:38:37,  3.63it/s]
 34%|███▍      | 127994/371472 [10:10:37<18:11:08,  3.72it/s]
 34%|███▍      | 127995/371472 [10:10:37<18:20:14,  3.69it/s]
 34%|███▍      | 127996/371472 [10:10:38<18:48:36,  3.60it/s]
 34%|███▍      | 127997/371472 [10:10:38<19:06:40,  3.54it/s]
 34%|███▍      | 127998/371472 [10:10:38<19:26:54,  3.48it/s]
 34%|███▍      | 127999/371472 [10:10:39<20:16:17,  3.34it/s]
 34%|███▍      | 128000/371472 [10:10:39<19:42:39,  3.43it/s]
                                                             
{'loss': 3.1133, 'learning_rate': 6.902001766898662e-07, 'epoch': 5.51}

 34%|███▍      | 128000/371472 [10:10:39<19:42:39,  3.43it/s]
 34%|███▍      | 128001/371472 [10:10:39<19:58:50,  3.38it/s]
 34%|███▍      | 128002/371472 [10:10:40<21:24:21,  3.16it/s]
 34%|███▍      | 128003/371472 [10:10:40<21:40:08,  3.12it/s]
 34%|███▍      | 128004/371472 [10:10:40<20:06:11,  3.36it/s]
 34%|███▍      | 128005/371472 [10:10:40<18:57:35,  3.57it/s]
 34%|███▍      | 128006/371472 [10:10:41<20:00:38,  3.38it/s]
 34%|███▍      | 128007/371472 [10:10:41<18:51:18,  3.59it/s]
 34%|███▍      | 128008/371472 [10:10:41<19:35:35,  3.45it/s]
 34%|███▍      | 128009/371472 [10:10:42<19:02:05,  3.55it/s]
 34%|███▍      | 128010/371472 [10:10:42<18:38:30,  3.63it/s]
 34%|███▍      | 128011/371472 [10:10:42<18:24:08,  3.67it/s]
 34%|███▍      | 128012/371472 [10:10:42<17:57:52,  3.76it/s]
 34%|███▍      | 128013/371472 [10:10:43<18:25:14,  3.67it/s]
 34%|███▍      | 128014/371472 [10:10:43<18:09:26,  3.72it/s]
 34%|███▍      | 128015/371472 [10:10:43<17:58:44,  3.76it/s]
 34%|███▍      | 128016/371472 [10:10:43<17:37:12,  3.84it/s]
 34%|███▍      | 128017/371472 [10:10:44<17:05:46,  3.96it/s]
 34%|███▍      | 128018/371472 [10:10:44<17:40:46,  3.83it/s]
 34%|███▍      | 128019/371472 [10:10:44<18:32:27,  3.65it/s]
 34%|███▍      | 128020/371472 [10:10:44<19:17:30,  3.51it/s]
                                                             
{'loss': 3.0589, 'learning_rate': 6.901516947143872e-07, 'epoch': 5.51}

 34%|███▍      | 128020/371472 [10:10:44<19:17:30,  3.51it/s]
 34%|███▍      | 128021/371472 [10:10:45<18:25:56,  3.67it/s]
 34%|███▍      | 128022/371472 [10:10:45<17:47:41,  3.80it/s]
 34%|███▍      | 128023/371472 [10:10:45<18:00:52,  3.75it/s]
 34%|███▍      | 128024/371472 [10:10:46<19:26:41,  3.48it/s]
 34%|███▍      | 128025/371472 [10:10:46<19:32:01,  3.46it/s]
 34%|███▍      | 128026/371472 [10:10:46<18:43:45,  3.61it/s]
 34%|███▍      | 128027/371472 [10:10:46<19:07:03,  3.54it/s]
 34%|███▍      | 128028/371472 [10:10:47<18:42:57,  3.61it/s]
 34%|███▍      | 128029/371472 [10:10:47<19:20:50,  3.50it/s]
 34%|███▍      | 128030/371472 [10:10:47<18:21:18,  3.68it/s]
 34%|███▍      | 128031/371472 [10:10:48<18:38:47,  3.63it/s]
 34%|███▍      | 128032/371472 [10:10:48<20:55:00,  3.23it/s]
 34%|███▍      | 128033/371472 [10:10:48<19:36:30,  3.45it/s]
 34%|███▍      | 128034/371472 [10:10:48<19:28:19,  3.47it/s]
 34%|███▍      | 128035/371472 [10:10:49<18:41:08,  3.62it/s]
 34%|███▍      | 128036/371472 [10:10:49<18:22:04,  3.68it/s]
 34%|███▍      | 128037/371472 [10:10:49<17:57:27,  3.77it/s]
 34%|███▍      | 128038/371472 [10:10:50<20:08:46,  3.36it/s]
 34%|███▍      | 128039/371472 [10:10:50<20:46:42,  3.25it/s]
 34%|███▍      | 128040/371472 [10:10:50<20:15:56,  3.34it/s]
                                                             
{'loss': 3.2662, 'learning_rate': 6.901032127389084e-07, 'epoch': 5.51}

 34%|███▍      | 128040/371472 [10:10:50<20:15:56,  3.34it/s]
 34%|███▍      | 128041/371472 [10:10:51<21:11:59,  3.19it/s]
 34%|███▍      | 128042/371472 [10:10:51<20:52:28,  3.24it/s]
 34%|███▍      | 128043/371472 [10:10:51<20:09:22,  3.35it/s]
 34%|███▍      | 128044/371472 [10:10:51<21:26:03,  3.15it/s]
 34%|███▍      | 128045/371472 [10:10:52<20:24:00,  3.31it/s]
 34%|███▍      | 128046/371472 [10:10:52<19:37:16,  3.45it/s]
 34%|███▍      | 128047/371472 [10:10:52<18:51:00,  3.59it/s]
 34%|███▍      | 128048/371472 [10:10:53<18:52:36,  3.58it/s]
 34%|███▍      | 128049/371472 [10:10:53<19:00:02,  3.56it/s]
 34%|███▍      | 128050/371472 [10:10:53<21:03:44,  3.21it/s]
 34%|███▍      | 128051/371472 [10:10:53<20:02:08,  3.37it/s]
 34%|███▍      | 128052/371472 [10:10:54<19:41:41,  3.43it/s]
 34%|███▍      | 128053/371472 [10:10:54<18:53:34,  3.58it/s]
 34%|███▍      | 128054/371472 [10:10:54<18:57:44,  3.57it/s]
 34%|███▍      | 128055/371472 [10:10:55<19:00:07,  3.56it/s]
 34%|███▍      | 128056/371472 [10:10:55<18:43:35,  3.61it/s]
 34%|███▍      | 128057/371472 [10:10:55<18:42:28,  3.61it/s]
 34%|███▍      | 128058/371472 [10:10:55<19:13:26,  3.52it/s]
 34%|███▍      | 128059/371472 [10:10:56<18:51:13,  3.59it/s]
 34%|███▍      | 128060/371472 [10:10:56<18:20:12,  3.69it/s]
                                                             
{'loss': 3.1112, 'learning_rate': 6.900547307634295e-07, 'epoch': 5.52}

 34%|███▍      | 128060/371472 [10:10:56<18:20:12,  3.69it/s]
 34%|███▍      | 128061/371472 [10:10:56<18:52:36,  3.58it/s]
 34%|███▍      | 128062/371472 [10:10:56<18:14:37,  3.71it/s]
 34%|███▍      | 128063/371472 [10:10:57<18:06:11,  3.73it/s]
 34%|███▍      | 128064/371472 [10:10:57<17:57:28,  3.77it/s]
 34%|███▍      | 128065/371472 [10:10:57<18:11:02,  3.72it/s]
 34%|███▍      | 128066/371472 [10:10:58<18:50:53,  3.59it/s]
 34%|███▍      | 128067/371472 [10:10:58<20:15:44,  3.34it/s]
 34%|███▍      | 128068/371472 [10:10:58<21:31:10,  3.14it/s]
 34%|███▍      | 128069/371472 [10:10:59<21:25:20,  3.16it/s]
 34%|███▍      | 128070/371472 [10:10:59<20:03:22,  3.37it/s]
 34%|███▍      | 128071/371472 [10:10:59<19:37:59,  3.44it/s]
 34%|███▍      | 128072/371472 [10:10:59<19:00:11,  3.56it/s]
 34%|███▍      | 128073/371472 [10:11:00<18:27:20,  3.66it/s]
 34%|███▍      | 128074/371472 [10:11:00<18:31:52,  3.65it/s]
 34%|███▍      | 128075/371472 [10:11:00<18:08:18,  3.73it/s]
 34%|███▍      | 128076/371472 [10:11:01<20:35:41,  3.28it/s]
 34%|███▍      | 128077/371472 [10:11:01<20:01:07,  3.38it/s]
 34%|███▍      | 128078/371472 [10:11:01<19:19:11,  3.50it/s]
 34%|███▍      | 128079/371472 [10:11:01<19:19:29,  3.50it/s]
 34%|███▍      | 128080/371472 [10:11:02<18:29:50,  3.66it/s]
                                                             
{'loss': 3.1509, 'learning_rate': 6.900062487879506e-07, 'epoch': 5.52}

 34%|███▍      | 128080/371472 [10:11:02<18:29:50,  3.66it/s]
 34%|███▍      | 128081/371472 [10:11:02<18:26:33,  3.67it/s]
 34%|███▍      | 128082/371472 [10:11:02<18:17:37,  3.70it/s]
 34%|███▍      | 128083/371472 [10:11:02<18:04:51,  3.74it/s]
 34%|███▍      | 128084/371472 [10:11:03<17:48:15,  3.80it/s]
 34%|███▍      | 128085/371472 [10:11:03<18:22:02,  3.68it/s]
 34%|███▍      | 128086/371472 [10:11:03<18:03:57,  3.74it/s]
 34%|███▍      | 128087/371472 [10:11:03<18:15:18,  3.70it/s]
 34%|███▍      | 128088/371472 [10:11:04<18:10:17,  3.72it/s]
 34%|███▍      | 128089/371472 [10:11:04<18:24:52,  3.67it/s]
 34%|███▍      | 128090/371472 [10:11:04<18:33:19,  3.64it/s]
 34%|███▍      | 128091/371472 [10:11:05<19:01:44,  3.55it/s]
 34%|███▍      | 128092/371472 [10:11:05<19:04:18,  3.54it/s]
 34%|███▍      | 128093/371472 [10:11:05<18:43:06,  3.61it/s]
 34%|███▍      | 128094/371472 [10:11:05<19:41:12,  3.43it/s]
 34%|███▍      | 128095/371472 [10:11:06<19:53:46,  3.40it/s]
 34%|███▍      | 128096/371472 [10:11:06<18:42:53,  3.61it/s]
 34%|███▍      | 128097/371472 [10:11:07<24:15:53,  2.79it/s]
 34%|███▍      | 128098/371472 [10:11:07<22:43:30,  2.97it/s]
 34%|███▍      | 128099/371472 [10:11:07<21:59:19,  3.07it/s]
 34%|███▍      | 128100/371472 [10:11:07<21:07:30,  3.20it/s]
                                                             
{'loss': 3.2454, 'learning_rate': 6.899577668124717e-07, 'epoch': 5.52}

 34%|███▍      | 128100/371472 [10:11:07<21:07:30,  3.20it/s]
 34%|███▍      | 128101/371472 [10:11:08<20:14:48,  3.34it/s]
 34%|███▍      | 128102/371472 [10:11:08<19:35:54,  3.45it/s]
 34%|███▍      | 128103/371472 [10:11:08<19:00:43,  3.56it/s]
 34%|███▍      | 128104/371472 [10:11:08<18:29:48,  3.65it/s]
 34%|███▍      | 128105/371472 [10:11:09<18:24:19,  3.67it/s]
 34%|███▍      | 128106/371472 [10:11:09<18:44:36,  3.61it/s]
 34%|███▍      | 128107/371472 [10:11:09<18:45:48,  3.60it/s]
 34%|███▍      | 128108/371472 [10:11:10<19:09:28,  3.53it/s]
 34%|███▍      | 128109/371472 [10:11:10<20:03:56,  3.37it/s]
 34%|███▍      | 128110/371472 [10:11:10<20:12:53,  3.34it/s]
 34%|███▍      | 128111/371472 [10:11:11<20:28:18,  3.30it/s]
 34%|███▍      | 128112/371472 [10:11:11<20:45:29,  3.26it/s]
 34%|███▍      | 128113/371472 [10:11:11<20:18:37,  3.33it/s]
 34%|███▍      | 128114/371472 [10:11:11<20:09:27,  3.35it/s]
 34%|███▍      | 128115/371472 [10:11:12<19:24:07,  3.48it/s]
 34%|███▍      | 128116/371472 [10:11:12<19:08:26,  3.53it/s]
 34%|███▍      | 128117/371472 [10:11:12<19:29:48,  3.47it/s]
 34%|███▍      | 128118/371472 [10:11:13<20:45:26,  3.26it/s]
 34%|███▍      | 128119/371472 [10:11:13<19:56:06,  3.39it/s]
 34%|███▍      | 128120/371472 [10:11:13<20:04:49,  3.37it/s]
                                                             
{'loss': 3.3012, 'learning_rate': 6.899092848369929e-07, 'epoch': 5.52}

 34%|███▍      | 128120/371472 [10:11:13<20:04:49,  3.37it/s]
 34%|███▍      | 128121/371472 [10:11:14<20:31:22,  3.29it/s]
 34%|███▍      | 128122/371472 [10:11:14<20:00:05,  3.38it/s]
 34%|███▍      | 128123/371472 [10:11:14<18:42:00,  3.61it/s]
 34%|███▍      | 128124/371472 [10:11:14<18:17:25,  3.70it/s]
 34%|███▍      | 128125/371472 [10:11:15<18:20:48,  3.68it/s]
 34%|███▍      | 128126/371472 [10:11:15<18:26:55,  3.66it/s]
 34%|███▍      | 128127/371472 [10:11:15<17:58:55,  3.76it/s]
 34%|███▍      | 128128/371472 [10:11:15<18:09:00,  3.72it/s]
 34%|███▍      | 128129/371472 [10:11:16<19:24:22,  3.48it/s]
 34%|███▍      | 128130/371472 [10:11:16<18:53:43,  3.58it/s]
 34%|███▍      | 128131/371472 [10:11:16<19:23:45,  3.48it/s]
 34%|███▍      | 128132/371472 [10:11:17<20:47:45,  3.25it/s]
 34%|███▍      | 128133/371472 [10:11:17<19:45:32,  3.42it/s]
 34%|███▍      | 128134/371472 [10:11:17<18:50:25,  3.59it/s]
 34%|███▍      | 128135/371472 [10:11:17<20:14:41,  3.34it/s]
 34%|███▍      | 128136/371472 [10:11:18<20:26:47,  3.31it/s]
 34%|███▍      | 128137/371472 [10:11:18<19:44:33,  3.42it/s]
 34%|███▍      | 128138/371472 [10:11:18<19:08:03,  3.53it/s]
 34%|███▍      | 128139/371472 [10:11:19<18:49:58,  3.59it/s]
 34%|███▍      | 128140/371472 [10:11:19<18:45:04,  3.60it/s]
                                                             
{'loss': 3.4595, 'learning_rate': 6.898608028615139e-07, 'epoch': 5.52}

 34%|███▍      | 128140/371472 [10:11:19<18:45:04,  3.60it/s]
 34%|███▍      | 128141/371472 [10:11:19<18:26:10,  3.67it/s]
 34%|███▍      | 128142/371472 [10:11:19<18:24:03,  3.67it/s]
 34%|███▍      | 128143/371472 [10:11:20<18:44:13,  3.61it/s]
 34%|███▍      | 128144/371472 [10:11:20<20:09:41,  3.35it/s]
 34%|███▍      | 128145/371472 [10:11:20<19:14:57,  3.51it/s]
 34%|███▍      | 128146/371472 [10:11:21<18:34:43,  3.64it/s]
 34%|███▍      | 128147/371472 [10:11:21<18:12:08,  3.71it/s]
 34%|███▍      | 128148/371472 [10:11:21<17:40:22,  3.82it/s]
 34%|███▍      | 128149/371472 [10:11:21<18:00:25,  3.75it/s]
 34%|███▍      | 128150/371472 [10:11:22<17:16:06,  3.91it/s]
 34%|███▍      | 128151/371472 [10:11:22<18:04:52,  3.74it/s]
 34%|███▍      | 128152/371472 [10:11:22<18:03:55,  3.74it/s]
 34%|███▍      | 128153/371472 [10:11:22<18:38:24,  3.63it/s]
 34%|███▍      | 128154/371472 [10:11:23<18:32:58,  3.64it/s]
 34%|███▍      | 128155/371472 [10:11:23<17:58:04,  3.76it/s]
 34%|███▍      | 128156/371472 [10:11:23<17:42:22,  3.82it/s]
 34%|███▍      | 128157/371472 [10:11:24<19:24:54,  3.48it/s]
 35%|███▍      | 128158/371472 [10:11:24<19:06:41,  3.54it/s]
 35%|███▍      | 128159/371472 [10:11:24<19:07:25,  3.53it/s]
 35%|███▍      | 128160/371472 [10:11:24<18:33:18,  3.64it/s]
                                                             
{'loss': 3.2327, 'learning_rate': 6.89812320886035e-07, 'epoch': 5.52}

 35%|███▍      | 128160/371472 [10:11:24<18:33:18,  3.64it/s]
 35%|███▍      | 128161/371472 [10:11:25<18:27:46,  3.66it/s]
 35%|███▍      | 128162/371472 [10:11:25<18:01:41,  3.75it/s]
 35%|███▍      | 128163/371472 [10:11:25<18:38:41,  3.62it/s]
 35%|███▍      | 128164/371472 [10:11:25<18:10:31,  3.72it/s]
 35%|███▍      | 128165/371472 [10:11:26<19:25:13,  3.48it/s]
 35%|███▍      | 128166/371472 [10:11:26<19:07:25,  3.53it/s]
 35%|███▍      | 128167/371472 [10:11:26<18:04:27,  3.74it/s]
 35%|███▍      | 128168/371472 [10:11:26<18:03:12,  3.74it/s]
 35%|███▍      | 128169/371472 [10:11:27<18:00:46,  3.75it/s]
 35%|███▍      | 128170/371472 [10:11:27<19:29:50,  3.47it/s]
 35%|███▍      | 128171/371472 [10:11:27<19:20:53,  3.49it/s]
 35%|███▍      | 128172/371472 [10:11:28<22:57:32,  2.94it/s]
 35%|███▍      | 128173/371472 [10:11:28<21:26:12,  3.15it/s]
 35%|███▍      | 128174/371472 [10:11:28<21:05:48,  3.20it/s]
 35%|███▍      | 128175/371472 [10:11:29<19:38:39,  3.44it/s]
 35%|███▍      | 128176/371472 [10:11:29<20:09:46,  3.35it/s]
 35%|███▍      | 128177/371472 [10:11:29<19:16:50,  3.51it/s]
 35%|███▍      | 128178/371472 [10:11:30<19:31:03,  3.46it/s]
 35%|███▍      | 128179/371472 [10:11:30<19:25:15,  3.48it/s]
 35%|███▍      | 128180/371472 [10:11:30<18:58:10,  3.56it/s]
                                                             
{'loss': 3.0591, 'learning_rate': 6.897638389105561e-07, 'epoch': 5.52}

 35%|███▍      | 128180/371472 [10:11:30<18:58:10,  3.56it/s]
 35%|███▍      | 128181/371472 [10:11:30<19:05:34,  3.54it/s]
 35%|███▍      | 128182/371472 [10:11:31<19:18:12,  3.50it/s]
 35%|███▍      | 128183/371472 [10:11:31<18:26:13,  3.67it/s]
 35%|███▍      | 128184/371472 [10:11:31<19:50:57,  3.40it/s]
 35%|███▍      | 128185/371472 [10:11:31<19:04:24,  3.54it/s]
 35%|███▍      | 128186/371472 [10:11:32<18:41:25,  3.62it/s]
 35%|███▍      | 128187/371472 [10:11:32<18:53:45,  3.58it/s]
 35%|███▍      | 128188/371472 [10:11:32<18:26:44,  3.66it/s]
 35%|███▍      | 128189/371472 [10:11:33<17:53:50,  3.78it/s]
 35%|███▍      | 128190/371472 [10:11:33<17:57:48,  3.76it/s]
 35%|███▍      | 128191/371472 [10:11:33<18:14:19,  3.71it/s]
 35%|███▍      | 128192/371472 [10:11:33<17:43:14,  3.81it/s]
 35%|███▍      | 128193/371472 [10:11:34<18:02:16,  3.75it/s]
 35%|███▍      | 128194/371472 [10:11:34<18:07:33,  3.73it/s]
 35%|███▍      | 128195/371472 [10:11:34<18:13:15,  3.71it/s]
 35%|███▍      | 128196/371472 [10:11:34<17:40:00,  3.83it/s]
 35%|███▍      | 128197/371472 [10:11:35<18:06:57,  3.73it/s]
 35%|███▍      | 128198/371472 [10:11:35<17:37:49,  3.83it/s]
 35%|███▍      | 128199/371472 [10:11:35<19:14:28,  3.51it/s]
 35%|███▍      | 128200/371472 [10:11:36<18:35:53,  3.63it/s]
                                                             
{'loss': 3.5673, 'learning_rate': 6.897153569350772e-07, 'epoch': 5.52}

 35%|███▍      | 128200/371472 [10:11:36<18:35:53,  3.63it/s]
 35%|███▍      | 128201/371472 [10:11:36<19:11:39,  3.52it/s]
 35%|███▍      | 128202/371472 [10:11:36<19:48:24,  3.41it/s]
 35%|███▍      | 128203/371472 [10:11:36<19:15:08,  3.51it/s]
 35%|███▍      | 128204/371472 [10:11:37<20:16:19,  3.33it/s]
 35%|███▍      | 128205/371472 [10:11:37<19:32:37,  3.46it/s]
 35%|███▍      | 128206/371472 [10:11:37<18:33:28,  3.64it/s]
 35%|███▍      | 128207/371472 [10:11:38<18:34:35,  3.64it/s]
 35%|███▍      | 128208/371472 [10:11:38<18:57:38,  3.56it/s]
 35%|███▍      | 128209/371472 [10:11:38<19:24:02,  3.48it/s]
 35%|███▍      | 128210/371472 [10:11:38<19:13:10,  3.52it/s]
 35%|███▍      | 128211/371472 [10:11:39<18:50:25,  3.59it/s]
 35%|███▍      | 128212/371472 [10:11:39<18:13:43,  3.71it/s]
 35%|███▍      | 128213/371472 [10:11:39<18:14:35,  3.70it/s]
 35%|███▍      | 128214/371472 [10:11:39<17:25:10,  3.88it/s]
 35%|███▍      | 128215/371472 [10:11:40<17:02:48,  3.96it/s]
 35%|███▍      | 128216/371472 [10:11:40<17:24:31,  3.88it/s]
 35%|███▍      | 128217/371472 [10:11:40<17:53:19,  3.78it/s]
 35%|███▍      | 128218/371472 [10:11:40<17:49:10,  3.79it/s]
 35%|███▍      | 128219/371472 [10:11:41<18:57:53,  3.56it/s]
 35%|███▍      | 128220/371472 [10:11:41<18:37:34,  3.63it/s]
                                                             
{'loss': 3.253, 'learning_rate': 6.896668749595983e-07, 'epoch': 5.52}

 35%|███▍      | 128220/371472 [10:11:41<18:37:34,  3.63it/s]
 35%|███▍      | 128221/371472 [10:11:41<18:18:40,  3.69it/s]
 35%|███▍      | 128222/371472 [10:11:42<18:33:14,  3.64it/s]
 35%|███▍      | 128223/371472 [10:11:42<18:18:38,  3.69it/s]
 35%|███▍      | 128224/371472 [10:11:42<18:30:53,  3.65it/s]
 35%|███▍      | 128225/371472 [10:11:42<18:26:37,  3.66it/s]
 35%|███▍      | 128226/371472 [10:11:43<18:35:19,  3.63it/s]
 35%|███▍      | 128227/371472 [10:11:43<18:33:43,  3.64it/s]
 35%|███▍      | 128228/371472 [10:11:43<17:55:44,  3.77it/s]
 35%|███▍      | 128229/371472 [10:11:43<17:15:20,  3.92it/s]
 35%|███▍      | 128230/371472 [10:11:44<17:00:27,  3.97it/s]
 35%|███▍      | 128231/371472 [10:11:44<18:10:09,  3.72it/s]
 35%|███▍      | 128232/371472 [10:11:44<19:05:06,  3.54it/s]
 35%|███▍      | 128233/371472 [10:11:45<19:16:58,  3.50it/s]
 35%|███▍      | 128234/371472 [10:11:45<18:24:03,  3.67it/s]
 35%|███▍      | 128235/371472 [10:11:45<18:21:49,  3.68it/s]
 35%|███▍      | 128236/371472 [10:11:45<18:39:18,  3.62it/s]
 35%|███▍      | 128237/371472 [10:11:46<18:45:04,  3.60it/s]
 35%|███▍      | 128238/371472 [10:11:46<18:01:09,  3.75it/s]
 35%|███▍      | 128239/371472 [10:11:46<18:17:26,  3.69it/s]
 35%|███▍      | 128240/371472 [10:11:46<18:31:40,  3.65it/s]
                                                             
{'loss': 3.3035, 'learning_rate': 6.896183929841195e-07, 'epoch': 5.52}

 35%|███▍      | 128240/371472 [10:11:46<18:31:40,  3.65it/s]
 35%|███▍      | 128241/371472 [10:11:47<18:07:12,  3.73it/s]
 35%|███▍      | 128242/371472 [10:11:47<18:59:35,  3.56it/s]
 35%|███▍      | 128243/371472 [10:11:47<19:25:06,  3.48it/s]
 35%|███▍      | 128244/371472 [10:11:48<19:19:10,  3.50it/s]
 35%|███▍      | 128245/371472 [10:11:48<19:25:16,  3.48it/s]
 35%|███▍      | 128246/371472 [10:11:48<18:58:25,  3.56it/s]
 35%|███▍      | 128247/371472 [10:11:48<19:32:55,  3.46it/s]
 35%|███▍      | 128248/371472 [10:11:49<18:48:44,  3.59it/s]
 35%|███▍      | 128249/371472 [10:11:49<18:09:37,  3.72it/s]
 35%|███▍      | 128250/371472 [10:11:49<17:32:15,  3.85it/s]
 35%|███▍      | 128251/371472 [10:11:49<17:52:16,  3.78it/s]
 35%|███▍      | 128252/371472 [10:11:50<17:49:22,  3.79it/s]
 35%|███▍      | 128253/371472 [10:11:50<17:40:18,  3.82it/s]
 35%|███▍      | 128254/371472 [10:11:50<18:20:40,  3.68it/s]
 35%|███▍      | 128255/371472 [10:11:51<19:12:15,  3.52it/s]
 35%|███▍      | 128256/371472 [10:11:51<18:37:51,  3.63it/s]
 35%|███▍      | 128257/371472 [10:11:51<18:17:25,  3.69it/s]
 35%|███▍      | 128258/371472 [10:11:51<18:16:15,  3.70it/s]
 35%|███▍      | 128259/371472 [10:11:52<18:35:26,  3.63it/s]
 35%|███▍      | 128260/371472 [10:11:52<18:24:04,  3.67it/s]
                                                             
{'loss': 3.1991, 'learning_rate': 6.895699110086405e-07, 'epoch': 5.52}

 35%|███▍      | 128260/371472 [10:11:52<18:24:04,  3.67it/s]
 35%|███▍      | 128261/371472 [10:11:52<17:53:34,  3.78it/s]
 35%|███▍      | 128262/371472 [10:11:52<18:29:20,  3.65it/s]
 35%|███▍      | 128263/371472 [10:11:53<18:25:51,  3.67it/s]
 35%|███▍      | 128264/371472 [10:11:53<19:00:40,  3.55it/s]
 35%|███▍      | 128265/371472 [10:11:53<19:24:42,  3.48it/s]
 35%|███▍      | 128266/371472 [10:11:54<18:59:01,  3.56it/s]
 35%|███▍      | 128267/371472 [10:11:54<18:34:24,  3.64it/s]
 35%|███▍      | 128268/371472 [10:11:54<18:55:57,  3.57it/s]
 35%|███▍      | 128269/371472 [10:11:54<19:17:07,  3.50it/s]
 35%|███▍      | 128270/371472 [10:11:55<18:13:24,  3.71it/s]
 35%|███▍      | 128271/371472 [10:11:55<18:12:29,  3.71it/s]
 35%|███▍      | 128272/371472 [10:11:55<18:18:57,  3.69it/s]
 35%|███▍      | 128273/371472 [10:11:56<17:53:06,  3.78it/s]
 35%|███▍      | 128274/371472 [10:11:56<17:45:48,  3.80it/s]
 35%|███▍      | 128275/371472 [10:11:56<19:31:47,  3.46it/s]
 35%|███▍      | 128276/371472 [10:11:56<19:23:46,  3.48it/s]
 35%|███▍      | 128277/371472 [10:11:57<18:58:57,  3.56it/s]
 35%|███▍      | 128278/371472 [10:11:57<18:32:51,  3.64it/s]
 35%|███▍      | 128279/371472 [10:11:57<18:22:59,  3.67it/s]
 35%|███▍      | 128280/371472 [10:11:58<19:04:47,  3.54it/s]
                                                             
{'loss': 3.2189, 'learning_rate': 6.895214290331616e-07, 'epoch': 5.53}

 35%|███▍      | 128280/371472 [10:11:58<19:04:47,  3.54it/s]
 35%|███▍      | 128281/371472 [10:11:58<18:59:35,  3.56it/s]
 35%|███▍      | 128282/371472 [10:11:58<19:13:51,  3.51it/s]
 35%|███▍      | 128283/371472 [10:11:58<19:33:36,  3.45it/s]
 35%|███▍      | 128284/371472 [10:11:59<19:04:57,  3.54it/s]
 35%|███▍      | 128285/371472 [10:11:59<19:06:04,  3.54it/s]
 35%|███▍      | 128286/371472 [10:11:59<19:04:51,  3.54it/s]
 35%|███▍      | 128287/371472 [10:11:59<18:21:31,  3.68it/s]
 35%|███▍      | 128288/371472 [10:12:00<17:35:43,  3.84it/s]
 35%|███▍      | 128289/371472 [10:12:00<17:14:58,  3.92it/s]
 35%|███▍      | 128290/371472 [10:12:00<17:16:28,  3.91it/s]
 35%|███▍      | 128291/371472 [10:12:00<17:37:01,  3.83it/s]
 35%|███▍      | 128292/371472 [10:12:01<17:05:56,  3.95it/s]
 35%|███▍      | 128293/371472 [10:12:01<18:54:14,  3.57it/s]
 35%|███▍      | 128294/371472 [10:12:01<18:12:07,  3.71it/s]
 35%|███▍      | 128295/371472 [10:12:02<18:00:28,  3.75it/s]
 35%|███▍      | 128296/371472 [10:12:02<17:48:24,  3.79it/s]
 35%|███▍      | 128297/371472 [10:12:02<17:44:44,  3.81it/s]
 35%|███▍      | 128298/371472 [10:12:02<17:22:12,  3.89it/s]
 35%|███▍      | 128299/371472 [10:12:03<17:04:58,  3.95it/s]
 35%|███▍      | 128300/371472 [10:12:03<17:11:40,  3.93it/s]
                                                             
{'loss': 3.3936, 'learning_rate': 6.894729470576827e-07, 'epoch': 5.53}

 35%|███▍      | 128300/371472 [10:12:03<17:11:40,  3.93it/s]
 35%|███▍      | 128301/371472 [10:12:03<17:03:27,  3.96it/s]
 35%|███▍      | 128302/371472 [10:12:03<17:04:27,  3.96it/s]
 35%|███▍      | 128303/371472 [10:12:04<17:08:46,  3.94it/s]
 35%|███▍      | 128304/371472 [10:12:04<17:07:53,  3.94it/s]
 35%|███▍      | 128305/371472 [10:12:04<17:31:44,  3.85it/s]
 35%|███▍      | 128306/371472 [10:12:04<17:56:59,  3.76it/s]
 35%|███▍      | 128307/371472 [10:12:05<17:55:55,  3.77it/s]
 35%|███▍      | 128308/371472 [10:12:05<17:59:04,  3.76it/s]
 35%|███▍      | 128309/371472 [10:12:05<18:33:49,  3.64it/s]
 35%|███▍      | 128310/371472 [10:12:06<20:00:45,  3.38it/s]
 35%|███▍      | 128311/371472 [10:12:06<20:19:38,  3.32it/s]
 35%|███▍      | 128312/371472 [10:12:06<19:58:42,  3.38it/s]
 35%|███▍      | 128313/371472 [10:12:06<19:43:44,  3.42it/s]
 35%|███▍      | 128314/371472 [10:12:07<19:07:12,  3.53it/s]
 35%|███▍      | 128315/371472 [10:12:07<18:53:11,  3.58it/s]
 35%|███▍      | 128316/371472 [10:12:07<20:14:57,  3.34it/s]
 35%|███▍      | 128317/371472 [10:12:08<19:24:25,  3.48it/s]
 35%|███▍      | 128318/371472 [10:12:08<19:45:24,  3.42it/s]
 35%|███▍      | 128319/371472 [10:12:08<19:10:39,  3.52it/s]
 35%|███▍      | 128320/371472 [10:12:08<18:48:17,  3.59it/s]
                                                             
{'loss': 3.0153, 'learning_rate': 6.894244650822038e-07, 'epoch': 5.53}

 35%|███▍      | 128320/371472 [10:12:08<18:48:17,  3.59it/s]
 35%|███▍      | 128321/371472 [10:12:09<18:15:43,  3.70it/s]
 35%|███▍      | 128322/371472 [10:12:09<17:53:06,  3.78it/s]
 35%|███▍      | 128323/371472 [10:12:09<17:16:32,  3.91it/s]
 35%|███▍      | 128324/371472 [10:12:09<18:09:52,  3.72it/s]
 35%|███▍      | 128325/371472 [10:12:10<17:56:25,  3.76it/s]
 35%|███▍      | 128326/371472 [10:12:10<18:08:02,  3.72it/s]
 35%|███▍      | 128327/371472 [10:12:10<18:49:47,  3.59it/s]
 35%|███▍      | 128328/371472 [10:12:11<19:01:29,  3.55it/s]
 35%|███▍      | 128329/371472 [10:12:11<19:23:12,  3.48it/s]
 35%|███▍      | 128330/371472 [10:12:11<19:11:35,  3.52it/s]
 35%|███▍      | 128331/371472 [10:12:11<18:31:50,  3.64it/s]
 35%|███▍      | 128332/371472 [10:12:12<18:04:40,  3.74it/s]
 35%|███▍      | 128333/371472 [10:12:12<18:09:32,  3.72it/s]
 35%|███▍      | 128334/371472 [10:12:12<17:51:25,  3.78it/s]
 35%|███▍      | 128335/371472 [10:12:12<18:23:41,  3.67it/s]
 35%|███▍      | 128336/371472 [10:12:13<19:01:16,  3.55it/s]
 35%|███▍      | 128337/371472 [10:12:13<18:42:49,  3.61it/s]
 35%|███▍      | 128338/371472 [10:12:13<19:22:02,  3.49it/s]
 35%|███▍      | 128339/371472 [10:12:14<19:08:47,  3.53it/s]
 35%|███▍      | 128340/371472 [10:12:14<18:35:24,  3.63it/s]
                                                             
{'loss': 3.1051, 'learning_rate': 6.89375983106725e-07, 'epoch': 5.53}

 35%|███▍      | 128340/371472 [10:12:14<18:35:24,  3.63it/s]
 35%|███▍      | 128341/371472 [10:12:14<18:14:44,  3.70it/s]
 35%|███▍      | 128342/371472 [10:12:14<17:38:38,  3.83it/s]
 35%|███▍      | 128343/371472 [10:12:15<17:14:35,  3.92it/s]
 35%|███▍      | 128344/371472 [10:12:15<17:26:26,  3.87it/s]
 35%|███▍      | 128345/371472 [10:12:15<17:46:51,  3.80it/s]
 35%|███▍      | 128346/371472 [10:12:15<18:07:54,  3.72it/s]
 35%|███▍      | 128347/371472 [10:12:16<18:32:38,  3.64it/s]
 35%|███▍      | 128348/371472 [10:12:16<18:22:05,  3.68it/s]
 35%|███▍      | 128349/371472 [10:12:16<18:14:11,  3.70it/s]
 35%|███▍      | 128350/371472 [10:12:16<17:48:33,  3.79it/s]
 35%|███▍      | 128351/371472 [10:12:17<17:30:52,  3.86it/s]
 35%|███▍      | 128352/371472 [10:12:17<19:22:17,  3.49it/s]
 35%|███▍      | 128353/371472 [10:12:17<19:10:46,  3.52it/s]
 35%|███▍      | 128354/371472 [10:12:18<19:14:03,  3.51it/s]
 35%|███▍      | 128355/371472 [10:12:18<19:55:06,  3.39it/s]
 35%|███▍      | 128356/371472 [10:12:18<19:37:49,  3.44it/s]
 35%|███▍      | 128357/371472 [10:12:19<18:44:48,  3.60it/s]
 35%|███▍      | 128358/371472 [10:12:19<18:10:26,  3.72it/s]
 35%|███▍      | 128359/371472 [10:12:19<18:37:14,  3.63it/s]
 35%|███▍      | 128360/371472 [10:12:19<18:39:05,  3.62it/s]
                                                             
{'loss': 3.0751, 'learning_rate': 6.893275011312461e-07, 'epoch': 5.53}

 35%|███▍      | 128360/371472 [10:12:19<18:39:05,  3.62it/s]
 35%|███▍      | 128361/371472 [10:12:20<18:45:01,  3.60it/s]
 35%|███▍      | 128362/371472 [10:12:20<19:02:04,  3.55it/s]
 35%|███▍      | 128363/371472 [10:12:20<19:31:01,  3.46it/s]
 35%|███▍      | 128364/371472 [10:12:20<18:46:36,  3.60it/s]
 35%|███▍      | 128365/371472 [10:12:21<19:08:11,  3.53it/s]
 35%|███▍      | 128366/371472 [10:12:21<19:04:08,  3.54it/s]
 35%|███▍      | 128367/371472 [10:12:21<18:31:25,  3.65it/s]
 35%|███▍      | 128368/371472 [10:12:22<19:20:16,  3.49it/s]
 35%|███▍      | 128369/371472 [10:12:22<18:59:51,  3.55it/s]
 35%|███▍      | 128370/371472 [10:12:22<20:03:04,  3.37it/s]
 35%|███▍      | 128371/371472 [10:12:22<19:30:26,  3.46it/s]
 35%|███▍      | 128372/371472 [10:12:23<18:45:38,  3.60it/s]
 35%|███▍      | 128373/371472 [10:12:23<17:56:29,  3.76it/s]
 35%|███▍      | 128374/371472 [10:12:23<17:37:35,  3.83it/s]
 35%|███▍      | 128375/371472 [10:12:23<18:02:14,  3.74it/s]
 35%|███▍      | 128376/371472 [10:12:24<19:21:28,  3.49it/s]
 35%|███▍      | 128377/371472 [10:12:24<19:19:24,  3.49it/s]
 35%|███▍      | 128378/371472 [10:12:24<18:34:14,  3.64it/s]
 35%|███▍      | 128379/371472 [10:12:25<19:20:27,  3.49it/s]
 35%|███▍      | 128380/371472 [10:12:25<19:28:14,  3.47it/s]
                                                             
{'loss': 3.3597, 'learning_rate': 6.892790191557672e-07, 'epoch': 5.53}

 35%|███▍      | 128380/371472 [10:12:25<19:28:14,  3.47it/s]
 35%|███▍      | 128381/371472 [10:12:25<20:39:57,  3.27it/s]
 35%|███▍      | 128382/371472 [10:12:26<19:33:34,  3.45it/s]
 35%|███▍      | 128383/371472 [10:12:26<20:10:39,  3.35it/s]
 35%|███▍      | 128384/371472 [10:12:26<20:11:38,  3.34it/s]
 35%|███▍      | 128385/371472 [10:12:27<21:06:28,  3.20it/s]
 35%|███▍      | 128386/371472 [10:12:27<20:48:36,  3.24it/s]
 35%|███▍      | 128387/371472 [10:12:27<19:39:47,  3.43it/s]
 35%|███▍      | 128388/371472 [10:12:27<19:13:33,  3.51it/s]
 35%|███▍      | 128389/371472 [10:12:28<18:42:13,  3.61it/s]
 35%|███▍      | 128390/371472 [10:12:28<17:59:45,  3.75it/s]
 35%|███▍      | 128391/371472 [10:12:28<18:04:12,  3.74it/s]
 35%|███▍      | 128392/371472 [10:12:28<18:37:16,  3.63it/s]
 35%|███▍      | 128393/371472 [10:12:29<18:15:38,  3.70it/s]
 35%|███▍      | 128394/371472 [10:12:29<18:48:06,  3.59it/s]
 35%|███▍      | 128395/371472 [10:12:29<19:03:14,  3.54it/s]
 35%|███▍      | 128396/371472 [10:12:30<18:32:11,  3.64it/s]
 35%|███▍      | 128397/371472 [10:12:30<18:01:18,  3.75it/s]
 35%|███▍      | 128398/371472 [10:12:30<17:49:13,  3.79it/s]
 35%|███▍      | 128399/371472 [10:12:30<17:46:45,  3.80it/s]
 35%|███▍      | 128400/371472 [10:12:31<18:14:50,  3.70it/s]
                                                             
{'loss': 3.2377, 'learning_rate': 6.892305371802882e-07, 'epoch': 5.53}

 35%|███▍      | 128400/371472 [10:12:31<18:14:50,  3.70it/s]
 35%|███▍      | 128401/371472 [10:12:31<17:59:16,  3.75it/s]
 35%|███▍      | 128402/371472 [10:12:31<18:38:28,  3.62it/s]
 35%|███▍      | 128403/371472 [10:12:31<18:14:21,  3.70it/s]
 35%|███▍      | 128404/371472 [10:12:32<17:41:48,  3.82it/s]
 35%|███▍      | 128405/371472 [10:12:32<18:25:40,  3.66it/s]
 35%|███▍      | 128406/371472 [10:12:32<18:52:03,  3.58it/s]
 35%|███▍      | 128407/371472 [10:12:32<18:08:23,  3.72it/s]
 35%|███▍      | 128408/371472 [10:12:33<17:52:18,  3.78it/s]
 35%|███▍      | 128409/371472 [10:12:33<19:16:35,  3.50it/s]
 35%|███▍      | 128410/371472 [10:12:33<18:56:16,  3.57it/s]
 35%|███▍      | 128411/371472 [10:12:34<18:16:46,  3.69it/s]
 35%|███▍      | 128412/371472 [10:12:34<19:40:50,  3.43it/s]
 35%|███▍      | 128413/371472 [10:12:34<20:43:29,  3.26it/s]
 35%|███▍      | 128414/371472 [10:12:35<19:29:23,  3.46it/s]
 35%|███▍      | 128415/371472 [10:12:35<20:40:50,  3.26it/s]
 35%|███▍      | 128416/371472 [10:12:35<21:38:39,  3.12it/s]
 35%|███▍      | 128417/371472 [10:12:36<21:44:10,  3.11it/s]
 35%|███▍      | 128418/371472 [10:12:36<21:33:51,  3.13it/s]
 35%|███▍      | 128419/371472 [10:12:36<20:04:39,  3.36it/s]
 35%|███▍      | 128420/371472 [10:12:36<20:02:07,  3.37it/s]
                                                             
{'loss': 3.1814, 'learning_rate': 6.891820552048094e-07, 'epoch': 5.53}

 35%|███▍      | 128420/371472 [10:12:36<20:02:07,  3.37it/s]
 35%|███▍      | 128421/371472 [10:12:37<19:01:23,  3.55it/s]
 35%|███▍      | 128422/371472 [10:12:37<18:16:01,  3.70it/s]
 35%|███▍      | 128423/371472 [10:12:37<18:41:42,  3.61it/s]
 35%|███▍      | 128424/371472 [10:12:37<18:16:33,  3.69it/s]
 35%|███▍      | 128425/371472 [10:12:38<19:33:15,  3.45it/s]
 35%|███▍      | 128426/371472 [10:12:38<18:59:19,  3.56it/s]
 35%|███▍      | 128427/371472 [10:12:38<18:56:02,  3.57it/s]
 35%|███▍      | 128428/371472 [10:12:39<18:58:35,  3.56it/s]
 35%|███▍      | 128429/371472 [10:12:39<18:34:30,  3.63it/s]
 35%|███▍      | 128430/371472 [10:12:39<20:25:42,  3.30it/s]
 35%|███▍      | 128431/371472 [10:12:39<19:21:53,  3.49it/s]
 35%|███▍      | 128432/371472 [10:12:40<20:26:41,  3.30it/s]
 35%|███▍      | 128433/371472 [10:12:40<21:00:25,  3.21it/s]
 35%|███▍      | 128434/371472 [10:12:40<20:20:33,  3.32it/s]
 35%|███▍      | 128435/371472 [10:12:41<18:59:39,  3.55it/s]
 35%|███▍      | 128436/371472 [10:12:41<20:58:30,  3.22it/s]
 35%|███▍      | 128437/371472 [10:12:42<24:34:45,  2.75it/s]
 35%|███▍      | 128438/371472 [10:12:42<22:48:28,  2.96it/s]
 35%|███▍      | 128439/371472 [10:12:42<21:35:41,  3.13it/s]
 35%|███▍      | 128440/371472 [10:12:42<22:14:58,  3.03it/s]
                                                             
{'loss': 3.0797, 'learning_rate': 6.891335732293305e-07, 'epoch': 5.53}

 35%|███▍      | 128440/371472 [10:12:42<22:14:58,  3.03it/s]
 35%|███▍      | 128441/371472 [10:12:43<22:33:39,  2.99it/s]
 35%|███▍      | 128442/371472 [10:12:43<22:04:53,  3.06it/s]
 35%|███▍      | 128443/371472 [10:12:43<21:18:40,  3.17it/s]
 35%|███▍      | 128444/371472 [10:12:44<21:01:59,  3.21it/s]
 35%|███▍      | 128445/371472 [10:12:44<22:18:39,  3.03it/s]
 35%|███▍      | 128446/371472 [10:12:44<21:25:35,  3.15it/s]
 35%|███▍      | 128447/371472 [10:12:45<20:01:53,  3.37it/s]
 35%|███▍      | 128448/371472 [10:12:45<20:15:53,  3.33it/s]
 35%|███▍      | 128449/371472 [10:12:45<20:15:26,  3.33it/s]
 35%|███▍      | 128450/371472 [10:12:45<19:10:43,  3.52it/s]
 35%|███▍      | 128451/371472 [10:12:46<18:51:19,  3.58it/s]
 35%|███▍      | 128452/371472 [10:12:46<18:06:09,  3.73it/s]
 35%|███▍      | 128453/371472 [10:12:46<18:49:35,  3.59it/s]
 35%|███▍      | 128454/371472 [10:12:47<22:03:09,  3.06it/s]
 35%|███▍      | 128455/371472 [10:12:47<21:25:17,  3.15it/s]
 35%|███▍      | 128456/371472 [10:12:47<20:42:37,  3.26it/s]
 35%|███▍      | 128457/371472 [10:12:48<19:35:52,  3.44it/s]
 35%|███▍      | 128458/371472 [10:12:48<19:39:23,  3.43it/s]
 35%|███▍      | 128459/371472 [10:12:48<20:27:29,  3.30it/s]
 35%|███▍      | 128460/371472 [10:12:48<20:53:40,  3.23it/s]
                                                             
{'loss': 3.1967, 'learning_rate': 6.890850912538515e-07, 'epoch': 5.53}

 35%|███▍      | 128460/371472 [10:12:48<20:53:40,  3.23it/s]
 35%|███▍      | 128461/371472 [10:12:49<20:32:49,  3.29it/s]
 35%|███▍      | 128462/371472 [10:12:49<20:13:38,  3.34it/s]
 35%|███▍      | 128463/371472 [10:12:49<19:28:26,  3.47it/s]
 35%|███▍      | 128464/371472 [10:12:50<19:30:05,  3.46it/s]
 35%|███▍      | 128465/371472 [10:12:50<19:37:42,  3.44it/s]
 35%|███▍      | 128466/371472 [10:12:50<19:08:01,  3.53it/s]
 35%|███▍      | 128467/371472 [10:12:50<18:46:57,  3.59it/s]
 35%|███▍      | 128468/371472 [10:12:51<18:26:52,  3.66it/s]
 35%|███▍      | 128469/371472 [10:12:51<17:48:26,  3.79it/s]
 35%|███▍      | 128470/371472 [10:12:51<19:02:09,  3.55it/s]
 35%|███▍      | 128471/371472 [10:12:52<19:25:06,  3.48it/s]
 35%|███▍      | 128472/371472 [10:12:52<20:52:59,  3.23it/s]
 35%|███▍      | 128473/371472 [10:12:52<20:44:06,  3.26it/s]
 35%|███▍      | 128474/371472 [10:12:53<21:06:22,  3.20it/s]
 35%|███▍      | 128475/371472 [10:12:53<19:40:10,  3.43it/s]
 35%|███▍      | 128476/371472 [10:12:53<19:09:46,  3.52it/s]
 35%|███▍      | 128477/371472 [10:12:53<18:36:52,  3.63it/s]
 35%|███▍      | 128478/371472 [10:12:54<18:15:30,  3.70it/s]
 35%|███▍      | 128479/371472 [10:12:54<18:49:08,  3.59it/s]
 35%|███▍      | 128480/371472 [10:12:54<19:23:58,  3.48it/s]
                                                             
{'loss': 3.2526, 'learning_rate': 6.890366092783727e-07, 'epoch': 5.53}

 35%|███▍      | 128480/371472 [10:12:54<19:23:58,  3.48it/s]
 35%|███▍      | 128481/371472 [10:12:54<18:32:08,  3.64it/s]
 35%|███▍      | 128482/371472 [10:12:55<18:26:42,  3.66it/s]
 35%|███▍      | 128483/371472 [10:12:55<17:58:28,  3.76it/s]
 35%|███▍      | 128484/371472 [10:12:55<17:33:28,  3.84it/s]
 35%|███▍      | 128485/371472 [10:12:55<17:37:16,  3.83it/s]
 35%|███▍      | 128486/371472 [10:12:56<17:30:29,  3.86it/s]
 35%|███▍      | 128487/371472 [10:12:56<17:17:16,  3.90it/s]
 35%|███▍      | 128488/371472 [10:12:56<17:37:57,  3.83it/s]
 35%|███▍      | 128489/371472 [10:12:56<17:20:35,  3.89it/s]
 35%|███▍      | 128490/371472 [10:12:57<17:07:11,  3.94it/s]
 35%|███▍      | 128491/371472 [10:12:57<18:06:11,  3.73it/s]
 35%|███▍      | 128492/371472 [10:12:57<18:54:14,  3.57it/s]
 35%|███▍      | 128493/371472 [10:12:58<18:22:18,  3.67it/s]
 35%|███▍      | 128494/371472 [10:12:58<18:17:45,  3.69it/s]
 35%|███▍      | 128495/371472 [10:12:58<17:46:52,  3.80it/s]
 35%|███▍      | 128496/371472 [10:12:58<17:40:51,  3.82it/s]
 35%|███▍      | 128497/371472 [10:12:59<17:41:03,  3.82it/s]
 35%|███▍      | 128498/371472 [10:12:59<17:28:02,  3.86it/s]
 35%|███▍      | 128499/371472 [10:12:59<18:09:01,  3.72it/s]
 35%|███▍      | 128500/371472 [10:12:59<17:38:01,  3.83it/s]
                                                             
{'loss': 3.139, 'learning_rate': 6.889881273028939e-07, 'epoch': 5.53}

 35%|███▍      | 128500/371472 [10:12:59<17:38:01,  3.83it/s]
 35%|███▍      | 128501/371472 [10:13:00<17:36:49,  3.83it/s]
 35%|███▍      | 128502/371472 [10:13:00<17:40:58,  3.82it/s]
 35%|███▍      | 128503/371472 [10:13:00<17:47:53,  3.79it/s]
 35%|███▍      | 128504/371472 [10:13:00<18:01:06,  3.75it/s]
 35%|███▍      | 128505/371472 [10:13:01<18:19:30,  3.68it/s]
 35%|███▍      | 128506/371472 [10:13:01<18:25:01,  3.66it/s]
 35%|███▍      | 128507/371472 [10:13:01<18:01:53,  3.74it/s]
 35%|███▍      | 128508/371472 [10:13:02<17:52:59,  3.77it/s]
 35%|███▍      | 128509/371472 [10:13:02<17:56:39,  3.76it/s]
 35%|███▍      | 128510/371472 [10:13:02<18:15:35,  3.70it/s]
 35%|███▍      | 128511/371472 [10:13:02<18:57:47,  3.56it/s]
 35%|███▍      | 128512/371472 [10:13:03<18:25:22,  3.66it/s]
 35%|███▍      | 128513/371472 [10:13:03<19:05:13,  3.54it/s]
 35%|███▍      | 128514/371472 [10:13:03<19:02:04,  3.55it/s]
 35%|███▍      | 128515/371472 [10:13:03<18:34:58,  3.63it/s]
 35%|███▍      | 128516/371472 [10:13:04<19:40:29,  3.43it/s]
 35%|███▍      | 128517/371472 [10:13:04<19:18:30,  3.50it/s]
 35%|███▍      | 128518/371472 [10:13:04<18:41:47,  3.61it/s]
 35%|███▍      | 128519/371472 [10:13:05<18:22:07,  3.67it/s]
 35%|███▍      | 128520/371472 [10:13:05<18:21:23,  3.68it/s]
                                                             
{'loss': 3.1816, 'learning_rate': 6.889396453274149e-07, 'epoch': 5.54}

 35%|███▍      | 128520/371472 [10:13:05<18:21:23,  3.68it/s]
 35%|███▍      | 128521/371472 [10:13:05<18:27:21,  3.66it/s]
 35%|███▍      | 128522/371472 [10:13:05<18:04:06,  3.74it/s]
 35%|███▍      | 128523/371472 [10:13:06<17:33:05,  3.85it/s]
 35%|███▍      | 128524/371472 [10:13:06<18:27:00,  3.66it/s]
 35%|███▍      | 128525/371472 [10:13:06<20:10:22,  3.35it/s]
 35%|███▍      | 128526/371472 [10:13:07<20:05:56,  3.36it/s]
 35%|███▍      | 128527/371472 [10:13:07<19:51:18,  3.40it/s]
 35%|███▍      | 128528/371472 [10:13:07<19:38:38,  3.44it/s]
 35%|███▍      | 128529/371472 [10:13:07<19:57:49,  3.38it/s]
 35%|███▍      | 128530/371472 [10:13:08<20:00:30,  3.37it/s]
 35%|███▍      | 128531/371472 [10:13:08<19:08:50,  3.52it/s]
 35%|███▍      | 128532/371472 [10:13:08<19:08:37,  3.53it/s]
 35%|███▍      | 128533/371472 [10:13:09<18:33:35,  3.64it/s]
 35%|███▍      | 128534/371472 [10:13:09<17:56:42,  3.76it/s]
 35%|███▍      | 128535/371472 [10:13:09<18:26:33,  3.66it/s]
 35%|███▍      | 128536/371472 [10:13:09<20:25:40,  3.30it/s]
 35%|███▍      | 128537/371472 [10:13:10<19:10:18,  3.52it/s]
 35%|███▍      | 128538/371472 [10:13:10<18:44:00,  3.60it/s]
 35%|███▍      | 128539/371472 [10:13:10<19:21:08,  3.49it/s]
 35%|███▍      | 128540/371472 [10:13:11<20:44:33,  3.25it/s]
                                                             
{'loss': 3.2645, 'learning_rate': 6.88891163351936e-07, 'epoch': 5.54}

 35%|███▍      | 128540/371472 [10:13:11<20:44:33,  3.25it/s]
 35%|███▍      | 128541/371472 [10:13:11<21:44:38,  3.10it/s]
 35%|███▍      | 128542/371472 [10:13:11<21:33:32,  3.13it/s]
 35%|███▍      | 128543/371472 [10:13:12<20:34:05,  3.28it/s]
 35%|███▍      | 128544/371472 [10:13:12<20:05:11,  3.36it/s]
 35%|███▍      | 128545/371472 [10:13:12<19:32:52,  3.45it/s]
 35%|███▍      | 128546/371472 [10:13:12<20:24:32,  3.31it/s]
 35%|███▍      | 128547/371472 [10:13:13<19:21:02,  3.49it/s]
 35%|███▍      | 128548/371472 [10:13:13<19:53:26,  3.39it/s]
 35%|███▍      | 128549/371472 [10:13:13<18:49:20,  3.59it/s]
 35%|███▍      | 128550/371472 [10:13:14<18:29:48,  3.65it/s]
 35%|███▍      | 128551/371472 [10:13:14<19:52:10,  3.40it/s]
 35%|███▍      | 128552/371472 [10:13:14<19:51:45,  3.40it/s]
 35%|███▍      | 128553/371472 [10:13:14<19:40:52,  3.43it/s]
 35%|███▍      | 128554/371472 [10:13:15<19:26:00,  3.47it/s]
 35%|███▍      | 128555/371472 [10:13:15<19:40:29,  3.43it/s]
 35%|███▍      | 128556/371472 [10:13:15<19:16:20,  3.50it/s]
 35%|███▍      | 128557/371472 [10:13:16<19:07:47,  3.53it/s]
 35%|███▍      | 128558/371472 [10:13:16<19:56:54,  3.38it/s]
 35%|███▍      | 128559/371472 [10:13:16<19:58:47,  3.38it/s]
 35%|███▍      | 128560/371472 [10:13:16<19:22:56,  3.48it/s]
                                                             
{'loss': 3.0456, 'learning_rate': 6.888426813764572e-07, 'epoch': 5.54}

 35%|███▍      | 128560/371472 [10:13:16<19:22:56,  3.48it/s]
 35%|███▍      | 128561/371472 [10:13:17<20:00:30,  3.37it/s]
 35%|███▍      | 128562/371472 [10:13:17<20:04:14,  3.36it/s]
 35%|███▍      | 128563/371472 [10:13:17<20:50:02,  3.24it/s]
 35%|███▍      | 128564/371472 [10:13:18<20:35:39,  3.28it/s]
 35%|███▍      | 128565/371472 [10:13:18<19:40:19,  3.43it/s]
 35%|███▍      | 128566/371472 [10:13:18<20:17:13,  3.33it/s]
 35%|███▍      | 128567/371472 [10:13:19<19:18:24,  3.49it/s]
 35%|███▍      | 128568/371472 [10:13:19<18:22:38,  3.67it/s]
 35%|███▍      | 128569/371472 [10:13:19<18:05:34,  3.73it/s]
 35%|███▍      | 128570/371472 [10:13:19<17:40:52,  3.82it/s]
 35%|███▍      | 128571/371472 [10:13:20<17:32:19,  3.85it/s]
 35%|███▍      | 128572/371472 [10:13:20<19:06:44,  3.53it/s]
 35%|███▍      | 128573/371472 [10:13:20<18:08:31,  3.72it/s]
 35%|███▍      | 128574/371472 [10:13:20<18:00:10,  3.75it/s]
 35%|███▍      | 128575/371472 [10:13:21<19:14:40,  3.51it/s]
 35%|███▍      | 128576/371472 [10:13:21<18:35:57,  3.63it/s]
 35%|███▍      | 128577/371472 [10:13:21<18:52:18,  3.58it/s]
 35%|███▍      | 128578/371472 [10:13:22<19:08:08,  3.53it/s]
 35%|███▍      | 128579/371472 [10:13:22<18:38:51,  3.62it/s]
 35%|███▍      | 128580/371472 [10:13:22<20:18:14,  3.32it/s]
                                                             
{'loss': 3.12, 'learning_rate': 6.887941994009783e-07, 'epoch': 5.54}

 35%|███▍      | 128580/371472 [10:13:22<20:18:14,  3.32it/s]
 35%|███▍      | 128581/371472 [10:13:22<20:05:03,  3.36it/s]
 35%|███▍      | 128582/371472 [10:13:23<20:15:25,  3.33it/s]
 35%|███▍      | 128583/371472 [10:13:23<19:53:54,  3.39it/s]
 35%|███▍      | 128584/371472 [10:13:23<19:47:32,  3.41it/s]
 35%|███▍      | 128585/371472 [10:13:24<19:15:49,  3.50it/s]
 35%|███▍      | 128586/371472 [10:13:24<18:56:17,  3.56it/s]
 35%|███▍      | 128587/371472 [10:13:24<17:59:23,  3.75it/s]
 35%|███▍      | 128588/371472 [10:13:24<18:12:12,  3.71it/s]
 35%|███▍      | 128589/371472 [10:13:25<17:50:11,  3.78it/s]
 35%|███▍      | 128590/371472 [10:13:25<18:18:43,  3.68it/s]
 35%|███▍      | 128591/371472 [10:13:25<19:37:59,  3.44it/s]
 35%|███▍      | 128592/371472 [10:13:26<19:18:25,  3.49it/s]
 35%|███▍      | 128593/371472 [10:13:26<19:02:42,  3.54it/s]
 35%|███▍      | 128594/371472 [10:13:26<18:28:39,  3.65it/s]
 35%|███▍      | 128595/371472 [10:13:26<19:39:18,  3.43it/s]
 35%|███▍      | 128596/371472 [10:13:27<20:45:20,  3.25it/s]
 35%|███▍      | 128597/371472 [10:13:27<20:28:39,  3.29it/s]
 35%|███▍      | 128598/371472 [10:13:27<20:49:36,  3.24it/s]
 35%|███▍      | 128599/371472 [10:13:28<21:51:48,  3.09it/s]
 35%|███▍      | 128600/371472 [10:13:28<21:44:31,  3.10it/s]
                                                             
{'loss': 3.0965, 'learning_rate': 6.887457174254994e-07, 'epoch': 5.54}

 35%|███▍      | 128600/371472 [10:13:28<21:44:31,  3.10it/s]
 35%|███▍      | 128601/371472 [10:13:28<21:30:29,  3.14it/s]
 35%|███▍      | 128602/371472 [10:13:29<20:35:14,  3.28it/s]
 35%|███▍      | 128603/371472 [10:13:29<20:03:46,  3.36it/s]
 35%|███▍      | 128604/371472 [10:13:29<19:40:16,  3.43it/s]
 35%|███▍      | 128605/371472 [10:13:29<19:53:29,  3.39it/s]
 35%|███▍      | 128606/371472 [10:13:30<20:23:57,  3.31it/s]
 35%|███▍      | 128607/371472 [10:13:30<20:14:44,  3.33it/s]
 35%|███▍      | 128608/371472 [10:13:30<21:07:26,  3.19it/s]
 35%|███▍      | 128609/371472 [10:13:31<19:24:47,  3.48it/s]
 35%|███▍      | 128610/371472 [10:13:31<18:25:05,  3.66it/s]
 35%|███▍      | 128611/371472 [10:13:31<17:51:23,  3.78it/s]
 35%|███▍      | 128612/371472 [10:13:32<21:23:43,  3.15it/s]
 35%|███▍      | 128613/371472 [10:13:32<21:24:22,  3.15it/s]
 35%|███▍      | 128614/371472 [10:13:32<20:50:31,  3.24it/s]
 35%|███▍      | 128615/371472 [10:13:32<19:56:52,  3.38it/s]
 35%|███▍      | 128616/371472 [10:13:33<19:26:17,  3.47it/s]
 35%|███▍      | 128617/371472 [10:13:33<21:01:46,  3.21it/s]
 35%|███▍      | 128618/371472 [10:13:33<20:40:35,  3.26it/s]
 35%|███▍      | 128619/371472 [10:13:34<19:15:20,  3.50it/s]
 35%|███▍      | 128620/371472 [10:13:34<18:22:27,  3.67it/s]
                                                             
{'loss': 3.0685, 'learning_rate': 6.886972354500204e-07, 'epoch': 5.54}

 35%|███▍      | 128620/371472 [10:13:34<18:22:27,  3.67it/s]
 35%|███▍      | 128621/371472 [10:13:34<18:23:24,  3.67it/s]
 35%|███▍      | 128622/371472 [10:13:34<18:26:24,  3.66it/s]
 35%|███▍      | 128623/371472 [10:13:35<19:20:06,  3.49it/s]
 35%|███▍      | 128624/371472 [10:13:35<18:22:17,  3.67it/s]
 35%|███▍      | 128625/371472 [10:13:35<18:46:22,  3.59it/s]
 35%|███▍      | 128626/371472 [10:13:36<18:21:59,  3.67it/s]
 35%|███▍      | 128627/371472 [10:13:36<19:07:17,  3.53it/s]
 35%|███▍      | 128628/371472 [10:13:36<20:39:02,  3.27it/s]
 35%|███▍      | 128629/371472 [10:13:36<19:30:50,  3.46it/s]
 35%|███▍      | 128630/371472 [10:13:37<20:07:28,  3.35it/s]
 35%|███▍      | 128631/371472 [10:13:37<19:05:30,  3.53it/s]
 35%|███▍      | 128632/371472 [10:13:37<18:20:01,  3.68it/s]
 35%|███▍      | 128633/371472 [10:13:38<18:53:55,  3.57it/s]
 35%|███▍      | 128634/371472 [10:13:38<18:20:02,  3.68it/s]
 35%|███▍      | 128635/371472 [10:13:38<19:02:49,  3.54it/s]
 35%|███▍      | 128636/371472 [10:13:38<18:58:03,  3.56it/s]
 35%|███▍      | 128637/371472 [10:13:39<18:21:10,  3.68it/s]
 35%|███▍      | 128638/371472 [10:13:39<17:47:33,  3.79it/s]
 35%|███▍      | 128639/371472 [10:13:39<17:30:58,  3.85it/s]
 35%|███▍      | 128640/371472 [10:13:39<18:00:01,  3.75it/s]
                                                             
{'loss': 3.1361, 'learning_rate': 6.886487534745415e-07, 'epoch': 5.54}

 35%|███▍      | 128640/371472 [10:13:39<18:00:01,  3.75it/s]
 35%|███▍      | 128641/371472 [10:13:40<17:49:52,  3.78it/s]
 35%|███▍      | 128642/371472 [10:13:40<17:21:29,  3.89it/s]
 35%|███▍      | 128643/371472 [10:13:40<17:54:13,  3.77it/s]
 35%|███▍      | 128644/371472 [10:13:41<18:13:40,  3.70it/s]
 35%|███▍      | 128645/371472 [10:13:41<18:27:34,  3.65it/s]
 35%|███▍      | 128646/371472 [10:13:41<18:07:06,  3.72it/s]
 35%|███▍      | 128647/371472 [10:13:41<17:40:00,  3.82it/s]
 35%|███▍      | 128648/371472 [10:13:42<17:34:07,  3.84it/s]
 35%|███▍      | 128649/371472 [10:13:42<17:43:22,  3.81it/s]
 35%|███▍      | 128650/371472 [10:13:42<18:22:48,  3.67it/s]
 35%|███▍      | 128651/371472 [10:13:42<18:19:54,  3.68it/s]
 35%|███▍      | 128652/371472 [10:13:43<18:34:44,  3.63it/s]
 35%|███▍      | 128653/371472 [10:13:43<17:53:59,  3.77it/s]
 35%|███▍      | 128654/371472 [10:13:43<17:50:24,  3.78it/s]
 35%|███▍      | 128655/371472 [10:13:43<17:39:03,  3.82it/s]
 35%|███▍      | 128656/371472 [10:13:44<17:26:29,  3.87it/s]
 35%|███▍      | 128657/371472 [10:13:44<17:10:49,  3.93it/s]
 35%|███▍      | 128658/371472 [10:13:44<17:55:23,  3.76it/s]
 35%|███▍      | 128659/371472 [10:13:45<20:15:49,  3.33it/s]
 35%|███▍      | 128660/371472 [10:13:45<19:38:50,  3.43it/s]
                                                             
{'loss': 3.2411, 'learning_rate': 6.886002714990627e-07, 'epoch': 5.54}

 35%|███▍      | 128660/371472 [10:13:45<19:38:50,  3.43it/s]
 35%|███▍      | 128661/371472 [10:13:45<19:39:20,  3.43it/s]
 35%|███▍      | 128662/371472 [10:13:45<19:17:47,  3.50it/s]
 35%|███▍      | 128663/371472 [10:13:46<20:23:28,  3.31it/s]
 35%|███▍      | 128664/371472 [10:13:46<20:09:15,  3.35it/s]
 35%|███▍      | 128665/371472 [10:13:46<19:53:52,  3.39it/s]
 35%|███▍      | 128666/371472 [10:13:47<19:23:47,  3.48it/s]
 35%|███▍      | 128667/371472 [10:13:47<19:33:11,  3.45it/s]
 35%|███▍      | 128668/371472 [10:13:47<19:08:41,  3.52it/s]
 35%|███▍      | 128669/371472 [10:13:47<18:43:47,  3.60it/s]
 35%|███▍      | 128670/371472 [10:13:48<19:22:42,  3.48it/s]
 35%|███▍      | 128671/371472 [10:13:48<20:38:19,  3.27it/s]
 35%|███▍      | 128672/371472 [10:13:48<20:34:03,  3.28it/s]
 35%|███▍      | 128673/371472 [10:13:49<19:43:42,  3.42it/s]
 35%|███▍      | 128674/371472 [10:13:49<19:27:42,  3.47it/s]
 35%|███▍      | 128675/371472 [10:13:49<18:56:13,  3.56it/s]
 35%|███▍      | 128676/371472 [10:13:49<18:29:02,  3.65it/s]
 35%|███▍      | 128677/371472 [10:13:50<18:18:08,  3.68it/s]
 35%|███▍      | 128678/371472 [10:13:50<17:50:59,  3.78it/s]
 35%|███▍      | 128679/371472 [10:13:50<18:54:06,  3.57it/s]
 35%|███▍      | 128680/371472 [10:13:51<18:19:53,  3.68it/s]
                                                             
{'loss': 3.0284, 'learning_rate': 6.885517895235837e-07, 'epoch': 5.54}

 35%|███▍      | 128680/371472 [10:13:51<18:19:53,  3.68it/s]
 35%|███▍      | 128681/371472 [10:13:51<18:29:12,  3.65it/s]
 35%|███▍      | 128682/371472 [10:13:51<17:53:47,  3.77it/s]
 35%|███▍      | 128683/371472 [10:13:51<19:48:51,  3.40it/s]
 35%|███▍      | 128684/371472 [10:13:52<19:54:13,  3.39it/s]
 35%|███▍      | 128685/371472 [10:13:52<18:59:40,  3.55it/s]
 35%|███▍      | 128686/371472 [10:13:52<18:52:31,  3.57it/s]
 35%|███▍      | 128687/371472 [10:13:53<18:18:33,  3.68it/s]
 35%|███▍      | 128688/371472 [10:13:53<18:52:07,  3.57it/s]
 35%|███▍      | 128689/371472 [10:13:53<19:06:58,  3.53it/s]
 35%|███▍      | 128690/371472 [10:13:53<18:56:17,  3.56it/s]
 35%|███▍      | 128691/371472 [10:13:54<18:23:58,  3.67it/s]
 35%|███▍      | 128692/371472 [10:13:54<18:26:29,  3.66it/s]
 35%|███▍      | 128693/371472 [10:13:54<17:57:53,  3.75it/s]
 35%|███▍      | 128694/371472 [10:13:54<17:42:03,  3.81it/s]
 35%|███▍      | 128695/371472 [10:13:55<17:55:55,  3.76it/s]
 35%|███▍      | 128696/371472 [10:13:55<17:55:55,  3.76it/s]
 35%|███▍      | 128697/371472 [10:13:55<17:34:12,  3.84it/s]
 35%|███▍      | 128698/371472 [10:13:55<17:46:45,  3.79it/s]
 35%|███▍      | 128699/371472 [10:13:56<19:58:20,  3.38it/s]
 35%|███▍      | 128700/371472 [10:13:56<19:05:58,  3.53it/s]
                                                             
{'loss': 3.3229, 'learning_rate': 6.885033075481048e-07, 'epoch': 5.54}

 35%|███▍      | 128700/371472 [10:13:56<19:05:58,  3.53it/s]
 35%|███▍      | 128701/371472 [10:13:56<18:35:29,  3.63it/s]
 35%|███▍      | 128702/371472 [10:13:57<19:57:10,  3.38it/s]
 35%|███▍      | 128703/371472 [10:13:57<20:00:42,  3.37it/s]
 35%|███▍      | 128704/371472 [10:13:57<19:16:22,  3.50it/s]
 35%|███▍      | 128705/371472 [10:13:58<18:44:25,  3.60it/s]
 35%|███▍      | 128706/371472 [10:13:58<18:48:10,  3.59it/s]
 35%|███▍      | 128707/371472 [10:13:58<19:14:22,  3.50it/s]
 35%|███▍      | 128708/371472 [10:13:58<19:21:42,  3.48it/s]
 35%|███▍      | 128709/371472 [10:13:59<18:52:45,  3.57it/s]
 35%|███▍      | 128710/371472 [10:13:59<19:02:37,  3.54it/s]
 35%|███▍      | 128711/371472 [10:13:59<18:32:21,  3.64it/s]
 35%|███▍      | 128712/371472 [10:13:59<18:07:21,  3.72it/s]
 35%|███▍      | 128713/371472 [10:14:00<17:41:15,  3.81it/s]
 35%|███▍      | 128714/371472 [10:14:00<17:43:24,  3.80it/s]
 35%|███▍      | 128715/371472 [10:14:00<17:32:36,  3.84it/s]
 35%|███▍      | 128716/371472 [10:14:00<17:43:27,  3.80it/s]
 35%|███▍      | 128717/371472 [10:14:01<17:55:57,  3.76it/s]
 35%|███▍      | 128718/371472 [10:14:01<18:32:07,  3.64it/s]
 35%|███▍      | 128719/371472 [10:14:01<18:16:49,  3.69it/s]
 35%|███▍      | 128720/371472 [10:14:02<18:46:15,  3.59it/s]
                                                             
{'loss': 3.2227, 'learning_rate': 6.88454825572626e-07, 'epoch': 5.54}

 35%|███▍      | 128720/371472 [10:14:02<18:46:15,  3.59it/s]
 35%|███▍      | 128721/371472 [10:14:02<18:24:06,  3.66it/s]
 35%|███▍      | 128722/371472 [10:14:02<18:15:26,  3.69it/s]
 35%|███▍      | 128723/371472 [10:14:02<18:36:55,  3.62it/s]
 35%|███▍      | 128724/371472 [10:14:03<18:26:57,  3.65it/s]
 35%|███▍      | 128725/371472 [10:14:03<17:55:56,  3.76it/s]
 35%|███▍      | 128726/371472 [10:14:03<17:47:06,  3.79it/s]
 35%|███▍      | 128727/371472 [10:14:03<17:48:30,  3.79it/s]
 35%|███▍      | 128728/371472 [10:14:04<17:39:50,  3.82it/s]
 35%|███▍      | 128729/371472 [10:14:04<17:52:07,  3.77it/s]
 35%|███▍      | 128730/371472 [10:14:04<19:26:47,  3.47it/s]
 35%|███▍      | 128731/371472 [10:14:05<22:10:00,  3.04it/s]
 35%|███▍      | 128732/371472 [10:14:05<21:48:03,  3.09it/s]
 35%|███▍      | 128733/371472 [10:14:05<20:09:15,  3.35it/s]
 35%|███▍      | 128734/371472 [10:14:06<19:16:01,  3.50it/s]
 35%|███▍      | 128735/371472 [10:14:06<19:32:41,  3.45it/s]
 35%|███▍      | 128736/371472 [10:14:06<18:36:08,  3.62it/s]
 35%|███▍      | 128737/371472 [10:14:06<19:53:49,  3.39it/s]
 35%|███▍      | 128738/371472 [10:14:07<19:08:41,  3.52it/s]
 35%|███▍      | 128739/371472 [10:14:07<18:37:06,  3.62it/s]
 35%|███▍      | 128740/371472 [10:14:07<20:30:03,  3.29it/s]
                                                             
{'loss': 3.2449, 'learning_rate': 6.884063435971471e-07, 'epoch': 5.55}

 35%|███▍      | 128740/371472 [10:14:07<20:30:03,  3.29it/s]
 35%|███▍      | 128741/371472 [10:14:08<19:28:14,  3.46it/s]
 35%|███▍      | 128742/371472 [10:14:08<20:51:28,  3.23it/s]
 35%|███▍      | 128743/371472 [10:14:08<20:07:09,  3.35it/s]
 35%|███▍      | 128744/371472 [10:14:08<19:29:02,  3.46it/s]
 35%|███▍      | 128745/371472 [10:14:09<19:12:13,  3.51it/s]
 35%|███▍      | 128746/371472 [10:14:09<18:40:20,  3.61it/s]
 35%|███▍      | 128747/371472 [10:14:09<18:48:38,  3.58it/s]
 35%|███▍      | 128748/371472 [10:14:10<19:00:22,  3.55it/s]
 35%|███▍      | 128749/371472 [10:14:10<18:38:20,  3.62it/s]
 35%|███▍      | 128750/371472 [10:14:10<18:24:29,  3.66it/s]
 35%|███▍      | 128751/371472 [10:14:10<18:33:12,  3.63it/s]
 35%|███▍      | 128752/371472 [10:14:11<18:33:24,  3.63it/s]
 35%|███▍      | 128753/371472 [10:14:11<18:41:17,  3.61it/s]
 35%|███▍      | 128754/371472 [10:14:11<20:26:09,  3.30it/s]
 35%|███▍      | 128755/371472 [10:14:12<19:08:19,  3.52it/s]
 35%|███▍      | 128756/371472 [10:14:12<20:01:27,  3.37it/s]
 35%|███▍      | 128757/371472 [10:14:12<19:11:24,  3.51it/s]
 35%|███▍      | 128758/371472 [10:14:12<18:51:25,  3.58it/s]
 35%|███▍      | 128759/371472 [10:14:13<18:32:17,  3.64it/s]
 35%|███▍      | 128760/371472 [10:14:13<18:54:52,  3.56it/s]
                                                             
{'loss': 3.2154, 'learning_rate': 6.883578616216682e-07, 'epoch': 5.55}

 35%|███▍      | 128760/371472 [10:14:13<18:54:52,  3.56it/s]
 35%|███▍      | 128761/371472 [10:14:13<18:16:30,  3.69it/s]
 35%|███▍      | 128762/371472 [10:14:13<18:22:51,  3.67it/s]
 35%|███▍      | 128763/371472 [10:14:14<18:49:58,  3.58it/s]
 35%|███▍      | 128764/371472 [10:14:14<19:28:12,  3.46it/s]
 35%|███▍      | 128765/371472 [10:14:14<19:24:59,  3.47it/s]
 35%|███▍      | 128766/371472 [10:14:15<19:21:09,  3.48it/s]
 35%|███▍      | 128767/371472 [10:14:15<19:21:23,  3.48it/s]
 35%|███▍      | 128768/371472 [10:14:15<18:29:34,  3.65it/s]
 35%|███▍      | 128769/371472 [10:14:15<18:12:01,  3.70it/s]
 35%|███▍      | 128770/371472 [10:14:16<19:25:04,  3.47it/s]
 35%|███▍      | 128771/371472 [10:14:16<19:29:23,  3.46it/s]
 35%|███▍      | 128772/371472 [10:14:16<18:58:11,  3.55it/s]
 35%|███▍      | 128773/371472 [10:14:17<18:56:58,  3.56it/s]
 35%|███▍      | 128774/371472 [10:14:17<19:07:22,  3.53it/s]
 35%|███▍      | 128775/371472 [10:14:17<18:06:43,  3.72it/s]
 35%|███▍      | 128776/371472 [10:14:17<18:22:40,  3.67it/s]
 35%|███▍      | 128777/371472 [10:14:18<19:35:34,  3.44it/s]
 35%|███▍      | 128778/371472 [10:14:18<20:40:44,  3.26it/s]
 35%|███▍      | 128779/371472 [10:14:18<20:46:07,  3.25it/s]
 35%|███▍      | 128780/371472 [10:14:19<20:36:31,  3.27it/s]
                                                             
{'loss': 3.2846, 'learning_rate': 6.883093796461892e-07, 'epoch': 5.55}

 35%|███▍      | 128780/371472 [10:14:19<20:36:31,  3.27it/s]
 35%|███▍      | 128781/371472 [10:14:19<20:23:45,  3.31it/s]
 35%|███▍      | 128782/371472 [10:14:19<20:38:14,  3.27it/s]
 35%|███▍      | 128783/371472 [10:14:20<21:11:22,  3.18it/s]
 35%|███▍      | 128784/371472 [10:14:20<20:07:38,  3.35it/s]
 35%|███▍      | 128785/371472 [10:14:20<19:14:18,  3.50it/s]
 35%|███▍      | 128786/371472 [10:14:20<19:02:40,  3.54it/s]
 35%|███▍      | 128787/371472 [10:14:21<18:57:38,  3.56it/s]
 35%|███▍      | 128788/371472 [10:14:21<18:48:20,  3.58it/s]
 35%|███▍      | 128789/371472 [10:14:21<18:55:05,  3.56it/s]
 35%|███▍      | 128790/371472 [10:14:22<19:21:46,  3.48it/s]
 35%|███▍      | 128791/371472 [10:14:22<18:43:43,  3.60it/s]
 35%|███▍      | 128792/371472 [10:14:22<18:56:19,  3.56it/s]
 35%|███▍      | 128793/371472 [10:14:22<19:06:47,  3.53it/s]
 35%|███▍      | 128794/371472 [10:14:23<21:00:23,  3.21it/s]
 35%|███▍      | 128795/371472 [10:14:23<19:49:08,  3.40it/s]
 35%|███▍      | 128796/371472 [10:14:23<19:44:10,  3.42it/s]
 35%|███▍      | 128797/371472 [10:14:24<19:49:18,  3.40it/s]
 35%|███▍      | 128798/371472 [10:14:24<18:48:20,  3.58it/s]
 35%|███▍      | 128799/371472 [10:14:24<18:27:47,  3.65it/s]
 35%|███▍      | 128800/371472 [10:14:24<19:22:51,  3.48it/s]
                                                             
{'loss': 3.1468, 'learning_rate': 6.882608976707104e-07, 'epoch': 5.55}

 35%|███▍      | 128800/371472 [10:14:24<19:22:51,  3.48it/s]
 35%|███▍      | 128801/371472 [10:14:25<18:59:35,  3.55it/s]
 35%|███▍      | 128802/371472 [10:14:25<19:37:28,  3.43it/s]
 35%|███▍      | 128803/371472 [10:14:25<19:13:29,  3.51it/s]
 35%|███▍      | 128804/371472 [10:14:26<19:06:57,  3.53it/s]
 35%|███▍      | 128805/371472 [10:14:26<20:20:17,  3.31it/s]
 35%|███▍      | 128806/371472 [10:14:26<19:35:12,  3.44it/s]
 35%|███▍      | 128807/371472 [10:14:27<19:55:29,  3.38it/s]
 35%|███▍      | 128808/371472 [10:14:27<21:23:05,  3.15it/s]
 35%|███▍      | 128809/371472 [10:14:27<19:54:34,  3.39it/s]
 35%|███▍      | 128810/371472 [10:14:27<19:05:06,  3.53it/s]
 35%|███▍      | 128811/371472 [10:14:28<19:12:11,  3.51it/s]
 35%|███▍      | 128812/371472 [10:14:28<19:04:04,  3.54it/s]
 35%|███▍      | 128813/371472 [10:14:28<18:24:28,  3.66it/s]
 35%|███▍      | 128814/371472 [10:14:28<18:34:17,  3.63it/s]
 35%|███▍      | 128815/371472 [10:14:29<18:46:09,  3.59it/s]
 35%|███▍      | 128816/371472 [10:14:29<18:07:09,  3.72it/s]
 35%|███▍      | 128817/371472 [10:14:29<18:39:41,  3.61it/s]
 35%|███▍      | 128818/371472 [10:14:30<18:05:32,  3.73it/s]
 35%|███▍      | 128819/371472 [10:14:30<19:12:44,  3.51it/s]
 35%|███▍      | 128820/371472 [10:14:30<18:29:30,  3.65it/s]
                                                             
{'loss': 3.1386, 'learning_rate': 6.882124156952315e-07, 'epoch': 5.55}

 35%|███▍      | 128820/371472 [10:14:30<18:29:30,  3.65it/s]
 35%|███▍      | 128821/371472 [10:14:30<18:38:21,  3.62it/s]
 35%|███▍      | 128822/371472 [10:14:31<18:59:43,  3.55it/s]
 35%|███▍      | 128823/371472 [10:14:31<18:56:24,  3.56it/s]
 35%|███▍      | 128824/371472 [10:14:31<19:49:20,  3.40it/s]
 35%|███▍      | 128825/371472 [10:14:32<19:45:41,  3.41it/s]
 35%|███▍      | 128826/371472 [10:14:32<18:49:49,  3.58it/s]
 35%|███▍      | 128827/371472 [10:14:32<18:13:40,  3.70it/s]
 35%|███▍      | 128828/371472 [10:14:32<18:48:50,  3.58it/s]
 35%|███▍      | 128829/371472 [10:14:33<18:10:19,  3.71it/s]
 35%|███▍      | 128830/371472 [10:14:33<17:43:05,  3.80it/s]
 35%|███▍      | 128831/371472 [10:14:33<18:30:47,  3.64it/s]
 35%|███▍      | 128832/371472 [10:14:33<18:22:11,  3.67it/s]
 35%|███▍      | 128833/371472 [10:14:34<19:48:43,  3.40it/s]
 35%|███▍      | 128834/371472 [10:14:34<18:39:27,  3.61it/s]
 35%|███▍      | 128835/371472 [10:14:34<20:20:58,  3.31it/s]
 35%|███▍      | 128836/371472 [10:14:35<20:26:45,  3.30it/s]
 35%|███▍      | 128837/371472 [10:14:35<20:55:29,  3.22it/s]
 35%|███▍      | 128838/371472 [10:14:35<19:55:20,  3.38it/s]
 35%|███▍      | 128839/371472 [10:14:36<20:04:12,  3.36it/s]
 35%|███▍      | 128840/371472 [10:14:36<20:04:45,  3.36it/s]
                                                             
{'loss': 3.0341, 'learning_rate': 6.881639337197526e-07, 'epoch': 5.55}

 35%|███▍      | 128840/371472 [10:14:36<20:04:45,  3.36it/s]
 35%|███▍      | 128841/371472 [10:14:36<20:48:03,  3.24it/s]
 35%|███▍      | 128842/371472 [10:14:37<21:45:33,  3.10it/s]
 35%|███▍      | 128843/371472 [10:14:37<24:26:30,  2.76it/s]
 35%|███▍      | 128844/371472 [10:14:37<22:04:37,  3.05it/s]
 35%|███▍      | 128845/371472 [10:14:38<20:25:40,  3.30it/s]
 35%|███▍      | 128846/371472 [10:14:38<19:37:54,  3.43it/s]
 35%|███▍      | 128847/371472 [10:14:38<21:30:06,  3.13it/s]
 35%|███▍      | 128848/371472 [10:14:38<20:37:30,  3.27it/s]
 35%|███▍      | 128849/371472 [10:14:39<20:05:26,  3.35it/s]
 35%|███▍      | 128850/371472 [10:14:39<19:45:54,  3.41it/s]
 35%|███▍      | 128851/371472 [10:14:39<19:17:27,  3.49it/s]
 35%|███▍      | 128852/371472 [10:14:40<18:58:09,  3.55it/s]
 35%|███▍      | 128853/371472 [10:14:40<18:39:49,  3.61it/s]
 35%|███▍      | 128854/371472 [10:14:40<18:47:59,  3.58it/s]
 35%|███▍      | 128855/371472 [10:14:40<18:16:18,  3.69it/s]
 35%|███▍      | 128856/371472 [10:14:41<18:43:21,  3.60it/s]
 35%|███▍      | 128857/371472 [10:14:41<18:35:00,  3.63it/s]
 35%|███▍      | 128858/371472 [10:14:41<18:25:21,  3.66it/s]
 35%|███▍      | 128859/371472 [10:14:42<19:09:01,  3.52it/s]
 35%|███▍      | 128860/371472 [10:14:42<19:17:37,  3.49it/s]
                                                             
{'loss': 3.1763, 'learning_rate': 6.881154517442737e-07, 'epoch': 5.55}

 35%|███▍      | 128860/371472 [10:14:42<19:17:37,  3.49it/s]
 35%|███▍      | 128861/371472 [10:14:42<19:49:46,  3.40it/s]
 35%|███▍      | 128862/371472 [10:14:43<22:17:18,  3.02it/s]
 35%|███▍      | 128863/371472 [10:14:43<21:44:45,  3.10it/s]
 35%|███▍      | 128864/371472 [10:14:43<21:13:11,  3.18it/s]
 35%|███▍      | 128865/371472 [10:14:43<20:09:27,  3.34it/s]
 35%|███▍      | 128866/371472 [10:14:44<20:49:23,  3.24it/s]
 35%|███▍      | 128867/371472 [10:14:44<19:55:46,  3.38it/s]
 35%|███▍      | 128868/371472 [10:14:44<19:07:40,  3.52it/s]
 35%|███▍      | 128869/371472 [10:14:44<18:19:23,  3.68it/s]
 35%|███▍      | 128870/371472 [10:14:45<19:36:18,  3.44it/s]
 35%|███▍      | 128871/371472 [10:14:45<18:28:13,  3.65it/s]
 35%|███▍      | 128872/371472 [10:14:45<18:07:18,  3.72it/s]
 35%|███▍      | 128873/371472 [10:14:46<18:02:08,  3.74it/s]
 35%|███▍      | 128874/371472 [10:14:46<19:37:52,  3.43it/s]
 35%|███▍      | 128875/371472 [10:14:46<18:54:51,  3.56it/s]
 35%|███▍      | 128876/371472 [10:14:46<19:35:43,  3.44it/s]
 35%|███▍      | 128877/371472 [10:14:47<19:05:21,  3.53it/s]
 35%|███▍      | 128878/371472 [10:14:47<18:22:49,  3.67it/s]
 35%|███▍      | 128879/371472 [10:14:47<17:56:07,  3.76it/s]
 35%|███▍      | 128880/371472 [10:14:48<18:16:48,  3.69it/s]
                                                             
{'loss': 3.107, 'learning_rate': 6.880669697687949e-07, 'epoch': 5.55}

 35%|███▍      | 128880/371472 [10:14:48<18:16:48,  3.69it/s]
 35%|███▍      | 128881/371472 [10:14:48<17:52:18,  3.77it/s]
 35%|███▍      | 128882/371472 [10:14:48<18:59:05,  3.55it/s]
 35%|███▍      | 128883/371472 [10:14:48<19:16:08,  3.50it/s]
 35%|███▍      | 128884/371472 [10:14:49<18:37:03,  3.62it/s]
 35%|███▍      | 128885/371472 [10:14:49<18:32:33,  3.63it/s]
 35%|███▍      | 128886/371472 [10:14:49<17:52:44,  3.77it/s]
 35%|███▍      | 128887/371472 [10:14:49<17:48:11,  3.78it/s]
 35%|███▍      | 128888/371472 [10:14:50<19:11:39,  3.51it/s]
 35%|███▍      | 128889/371472 [10:14:50<18:57:38,  3.55it/s]
 35%|███▍      | 128890/371472 [10:14:50<18:52:40,  3.57it/s]
 35%|███▍      | 128891/371472 [10:14:51<18:21:28,  3.67it/s]
 35%|███▍      | 128892/371472 [10:14:51<18:25:45,  3.66it/s]
 35%|███▍      | 128893/371472 [10:14:51<19:28:50,  3.46it/s]
 35%|███▍      | 128894/371472 [10:14:51<19:19:02,  3.49it/s]
 35%|███▍      | 128895/371472 [10:14:52<18:25:54,  3.66it/s]
 35%|███▍      | 128896/371472 [10:14:52<18:31:28,  3.64it/s]
 35%|███▍      | 128897/371472 [10:14:52<19:57:25,  3.38it/s]
 35%|███▍      | 128898/371472 [10:14:53<19:39:23,  3.43it/s]
 35%|███▍      | 128899/371472 [10:14:53<21:21:24,  3.16it/s]
 35%|███▍      | 128900/371472 [10:14:53<19:54:17,  3.39it/s]
                                                             
{'loss': 3.1413, 'learning_rate': 6.880184877933159e-07, 'epoch': 5.55}

 35%|███▍      | 128900/371472 [10:14:53<19:54:17,  3.39it/s]
 35%|███▍      | 128901/371472 [10:14:53<19:08:20,  3.52it/s]
 35%|███▍      | 128902/371472 [10:14:54<18:11:01,  3.71it/s]
 35%|███▍      | 128903/371472 [10:14:54<17:46:04,  3.79it/s]
 35%|███▍      | 128904/371472 [10:14:54<18:41:38,  3.60it/s]
 35%|███▍      | 128905/371472 [10:14:55<18:25:34,  3.66it/s]
 35%|███▍      | 128906/371472 [10:14:55<19:14:31,  3.50it/s]
 35%|███▍      | 128907/371472 [10:14:55<18:54:46,  3.56it/s]
 35%|███▍      | 128908/371472 [10:14:55<19:01:22,  3.54it/s]
 35%|███▍      | 128909/371472 [10:14:56<18:41:31,  3.60it/s]
 35%|███▍      | 128910/371472 [10:14:56<18:07:55,  3.72it/s]
 35%|███▍      | 128911/371472 [10:14:56<17:54:44,  3.76it/s]
 35%|███▍      | 128912/371472 [10:14:56<17:39:06,  3.82it/s]
 35%|███▍      | 128913/371472 [10:14:57<17:53:35,  3.77it/s]
 35%|███▍      | 128914/371472 [10:14:57<17:20:45,  3.88it/s]
 35%|███▍      | 128915/371472 [10:14:57<17:42:21,  3.81it/s]
 35%|███▍      | 128916/371472 [10:14:58<19:50:02,  3.40it/s]
 35%|███▍      | 128917/371472 [10:14:58<19:09:52,  3.52it/s]
 35%|███▍      | 128918/371472 [10:14:58<19:05:11,  3.53it/s]
 35%|███▍      | 128919/371472 [10:14:58<19:03:00,  3.54it/s]
 35%|███▍      | 128920/371472 [10:14:59<19:21:46,  3.48it/s]
                                                             
{'loss': 3.0938, 'learning_rate': 6.879700058178369e-07, 'epoch': 5.55}

 35%|███▍      | 128920/371472 [10:14:59<19:21:46,  3.48it/s]
 35%|███▍      | 128921/371472 [10:14:59<18:31:41,  3.64it/s]
 35%|███▍      | 128922/371472 [10:14:59<18:33:52,  3.63it/s]
 35%|███▍      | 128923/371472 [10:15:00<18:18:57,  3.68it/s]
 35%|███▍      | 128924/371472 [10:15:00<17:38:58,  3.82it/s]
 35%|███▍      | 128925/371472 [10:15:00<17:57:49,  3.75it/s]
 35%|███▍      | 128926/371472 [10:15:00<18:04:23,  3.73it/s]
 35%|███▍      | 128927/371472 [10:15:01<18:38:48,  3.61it/s]
 35%|███▍      | 128928/371472 [10:15:01<21:37:03,  3.12it/s]
 35%|███▍      | 128929/371472 [10:15:01<20:39:49,  3.26it/s]
 35%|███▍      | 128930/371472 [10:15:02<20:05:11,  3.35it/s]
 35%|███▍      | 128931/371472 [10:15:02<18:53:22,  3.57it/s]
 35%|███▍      | 128932/371472 [10:15:02<18:14:38,  3.69it/s]
 35%|███▍      | 128933/371472 [10:15:02<17:48:11,  3.78it/s]
 35%|███▍      | 128934/371472 [10:15:03<18:19:28,  3.68it/s]
 35%|███▍      | 128935/371472 [10:15:03<18:32:16,  3.63it/s]
 35%|███▍      | 128936/371472 [10:15:03<17:55:39,  3.76it/s]
 35%|███▍      | 128937/371472 [10:15:03<18:30:32,  3.64it/s]
 35%|███▍      | 128938/371472 [10:15:04<17:58:55,  3.75it/s]
 35%|███▍      | 128939/371472 [10:15:04<18:35:44,  3.62it/s]
 35%|███▍      | 128940/371472 [10:15:04<19:24:46,  3.47it/s]
                                                             
{'loss': 3.1517, 'learning_rate': 6.879215238423581e-07, 'epoch': 5.55}

 35%|███▍      | 128940/371472 [10:15:04<19:24:46,  3.47it/s]
 35%|███▍      | 128941/371472 [10:15:05<18:49:24,  3.58it/s]
 35%|███▍      | 128942/371472 [10:15:05<18:33:14,  3.63it/s]
 35%|███▍      | 128943/371472 [10:15:05<19:41:38,  3.42it/s]
 35%|███▍      | 128944/371472 [10:15:05<19:00:47,  3.54it/s]
 35%|███▍      | 128945/371472 [10:15:06<19:26:23,  3.47it/s]
 35%|███▍      | 128946/371472 [10:15:06<19:40:39,  3.42it/s]
 35%|███▍      | 128947/371472 [10:15:06<19:18:40,  3.49it/s]
 35%|███▍      | 128948/371472 [10:15:07<19:29:09,  3.46it/s]
 35%|███▍      | 128949/371472 [10:15:07<20:24:43,  3.30it/s]
 35%|███▍      | 128950/371472 [10:15:07<20:15:03,  3.33it/s]
 35%|███▍      | 128951/371472 [10:15:07<19:52:07,  3.39it/s]
 35%|███▍      | 128952/371472 [10:15:08<20:29:14,  3.29it/s]
 35%|███▍      | 128953/371472 [10:15:08<20:11:34,  3.34it/s]
 35%|███▍      | 128954/371472 [10:15:08<19:58:17,  3.37it/s]
 35%|███▍      | 128955/371472 [10:15:09<19:21:39,  3.48it/s]
 35%|███▍      | 128956/371472 [10:15:09<18:50:14,  3.58it/s]
 35%|███▍      | 128957/371472 [10:15:09<18:31:23,  3.64it/s]
 35%|███▍      | 128958/371472 [10:15:09<19:00:39,  3.54it/s]
 35%|███▍      | 128959/371472 [10:15:10<20:11:18,  3.34it/s]
 35%|███▍      | 128960/371472 [10:15:10<20:26:07,  3.30it/s]
                                                             
{'loss': 3.1688, 'learning_rate': 6.878730418668793e-07, 'epoch': 5.55}

 35%|███▍      | 128960/371472 [10:15:10<20:26:07,  3.30it/s]
 35%|███▍      | 128961/371472 [10:15:10<20:00:30,  3.37it/s]
 35%|███▍      | 128962/371472 [10:15:11<19:13:14,  3.50it/s]
 35%|███▍      | 128963/371472 [10:15:11<18:59:12,  3.55it/s]
 35%|███▍      | 128964/371472 [10:15:11<18:24:08,  3.66it/s]
 35%|███▍      | 128965/371472 [10:15:11<17:48:48,  3.78it/s]
 35%|███▍      | 128966/371472 [10:15:12<17:58:21,  3.75it/s]
 35%|███▍      | 128967/371472 [10:15:12<18:11:09,  3.70it/s]
 35%|███▍      | 128968/371472 [10:15:12<18:00:44,  3.74it/s]
 35%|███▍      | 128969/371472 [10:15:13<17:54:44,  3.76it/s]
 35%|███▍      | 128970/371472 [10:15:13<18:09:15,  3.71it/s]
 35%|███▍      | 128971/371472 [10:15:13<19:34:14,  3.44it/s]
 35%|███▍      | 128972/371472 [10:15:13<19:33:54,  3.44it/s]
 35%|███▍      | 128973/371472 [10:15:14<19:21:02,  3.48it/s]
 35%|███▍      | 128974/371472 [10:15:14<19:01:08,  3.54it/s]
 35%|███▍      | 128975/371472 [10:15:14<18:15:25,  3.69it/s]
 35%|███▍      | 128976/371472 [10:15:14<18:18:26,  3.68it/s]
 35%|███▍      | 128977/371472 [10:15:15<17:55:06,  3.76it/s]
 35%|███▍      | 128978/371472 [10:15:15<17:26:47,  3.86it/s]
 35%|███▍      | 128979/371472 [10:15:15<17:09:41,  3.93it/s]
 35%|███▍      | 128980/371472 [10:15:16<17:31:42,  3.84it/s]
                                                             
{'loss': 3.2693, 'learning_rate': 6.878245598914005e-07, 'epoch': 5.56}

 35%|███▍      | 128980/371472 [10:15:16<17:31:42,  3.84it/s]
 35%|███▍      | 128981/371472 [10:15:16<17:54:46,  3.76it/s]
 35%|███▍      | 128982/371472 [10:15:16<17:48:44,  3.78it/s]
 35%|███▍      | 128983/371472 [10:15:16<18:26:29,  3.65it/s]
 35%|███▍      | 128984/371472 [10:15:17<18:43:29,  3.60it/s]
 35%|███▍      | 128985/371472 [10:15:17<18:19:27,  3.68it/s]
 35%|███▍      | 128986/371472 [10:15:17<17:43:44,  3.80it/s]
 35%|███▍      | 128987/371472 [10:15:17<18:50:12,  3.58it/s]
 35%|███▍      | 128988/371472 [10:15:18<18:24:13,  3.66it/s]
 35%|███▍      | 128989/371472 [10:15:18<20:48:35,  3.24it/s]
 35%|███▍      | 128990/371472 [10:15:18<21:07:15,  3.19it/s]
 35%|███▍      | 128991/371472 [10:15:19<22:02:49,  3.06it/s]
 35%|███▍      | 128992/371472 [10:15:19<20:20:10,  3.31it/s]
 35%|███▍      | 128993/371472 [10:15:19<19:27:06,  3.46it/s]
 35%|███▍      | 128994/371472 [10:15:20<18:45:30,  3.59it/s]
 35%|███▍      | 128995/371472 [10:15:20<18:31:33,  3.64it/s]
 35%|███▍      | 128996/371472 [10:15:20<19:02:59,  3.54it/s]
 35%|███▍      | 128997/371472 [10:15:20<19:29:39,  3.46it/s]
 35%|███▍      | 128998/371472 [10:15:21<19:32:12,  3.45it/s]
 35%|███▍      | 128999/371472 [10:15:21<21:22:23,  3.15it/s]
 35%|███▍      | 129000/371472 [10:15:21<21:31:35,  3.13it/s]
                                                             
{'loss': 3.0736, 'learning_rate': 6.877760779159214e-07, 'epoch': 5.56}

 35%|███▍      | 129000/371472 [10:15:21<21:31:35,  3.13it/s]
 35%|███▍      | 129001/371472 [10:15:22<19:48:26,  3.40it/s]
 35%|███▍      | 129002/371472 [10:15:22<19:55:16,  3.38it/s]
 35%|███▍      | 129003/371472 [10:15:22<18:52:59,  3.57it/s]
 35%|███▍      | 129004/371472 [10:15:22<18:03:02,  3.73it/s]
 35%|███▍      | 129005/371472 [10:15:23<18:34:20,  3.63it/s]
 35%|███▍      | 129006/371472 [10:15:23<19:33:11,  3.44it/s]
 35%|███▍      | 129007/371472 [10:15:23<20:10:03,  3.34it/s]
 35%|███▍      | 129008/371472 [10:15:24<19:33:30,  3.44it/s]
 35%|███▍      | 129009/371472 [10:15:24<18:48:18,  3.58it/s]
 35%|███▍      | 129010/371472 [10:15:24<18:47:31,  3.58it/s]
 35%|███▍      | 129011/371472 [10:15:24<18:42:16,  3.60it/s]
 35%|███▍      | 129012/371472 [10:15:25<19:29:42,  3.45it/s]
 35%|███▍      | 129013/371472 [10:15:25<19:02:57,  3.54it/s]
 35%|███▍      | 129014/371472 [10:15:25<18:22:13,  3.67it/s]
 35%|███▍      | 129015/371472 [10:15:26<17:58:15,  3.75it/s]
 35%|███▍      | 129016/371472 [10:15:26<17:39:54,  3.81it/s]
 35%|███▍      | 129017/371472 [10:15:26<17:46:54,  3.79it/s]
 35%|███▍      | 129018/371472 [10:15:26<18:03:20,  3.73it/s]
 35%|███▍      | 129019/371472 [10:15:27<19:53:34,  3.39it/s]
 35%|███▍      | 129020/371472 [10:15:27<19:47:00,  3.40it/s]
                                                             
{'loss': 3.1875, 'learning_rate': 6.877275959404425e-07, 'epoch': 5.56}

 35%|███▍      | 129020/371472 [10:15:27<19:47:00,  3.40it/s]
 35%|███▍      | 129021/371472 [10:15:27<18:57:09,  3.55it/s]
 35%|███▍      | 129022/371472 [10:15:27<18:46:42,  3.59it/s]
 35%|███▍      | 129023/371472 [10:15:28<19:33:45,  3.44it/s]
 35%|███▍      | 129024/371472 [10:15:28<20:16:42,  3.32it/s]
 35%|███▍      | 129025/371472 [10:15:29<22:29:48,  2.99it/s]
 35%|███▍      | 129026/371472 [10:15:29<20:44:26,  3.25it/s]
 35%|███▍      | 129027/371472 [10:15:29<19:45:56,  3.41it/s]
 35%|███▍      | 129028/371472 [10:15:29<19:03:51,  3.53it/s]
 35%|███▍      | 129029/371472 [10:15:30<19:24:30,  3.47it/s]
 35%|███▍      | 129030/371472 [10:15:30<20:44:03,  3.25it/s]
 35%|███▍      | 129031/371472 [10:15:30<20:15:32,  3.32it/s]
 35%|███▍      | 129032/371472 [10:15:31<21:33:19,  3.12it/s]
 35%|███▍      | 129033/371472 [10:15:31<20:50:41,  3.23it/s]
 35%|███▍      | 129034/371472 [10:15:31<19:49:14,  3.40it/s]
 35%|███▍      | 129035/371472 [10:15:31<19:26:58,  3.46it/s]
 35%|███▍      | 129036/371472 [10:15:32<19:15:46,  3.50it/s]
 35%|███▍      | 129037/371472 [10:15:32<18:35:12,  3.62it/s]
 35%|███▍      | 129038/371472 [10:15:32<18:05:21,  3.72it/s]
 35%|███▍      | 129039/371472 [10:15:32<17:56:12,  3.75it/s]
 35%|███▍      | 129040/371472 [10:15:33<18:11:50,  3.70it/s]
                                                             
{'loss': 3.2301, 'learning_rate': 6.876791139649637e-07, 'epoch': 5.56}

 35%|███▍      | 129040/371472 [10:15:33<18:11:50,  3.70it/s]
 35%|███▍      | 129041/371472 [10:15:33<18:31:10,  3.64it/s]
 35%|███▍      | 129042/371472 [10:15:33<20:01:43,  3.36it/s]
 35%|███▍      | 129043/371472 [10:15:34<18:54:12,  3.56it/s]
 35%|███▍      | 129044/371472 [10:15:34<18:46:52,  3.59it/s]
 35%|███▍      | 129045/371472 [10:15:34<18:29:41,  3.64it/s]
 35%|███▍      | 129046/371472 [10:15:35<19:32:21,  3.45it/s]
 35%|███▍      | 129047/371472 [10:15:35<19:13:06,  3.50it/s]
 35%|███▍      | 129048/371472 [10:15:35<19:24:16,  3.47it/s]
 35%|███▍      | 129049/371472 [10:15:35<20:41:24,  3.25it/s]
 35%|███▍      | 129050/371472 [10:15:36<20:14:06,  3.33it/s]
 35%|███▍      | 129051/371472 [10:15:36<20:24:17,  3.30it/s]
 35%|███▍      | 129052/371472 [10:15:36<19:05:36,  3.53it/s]
 35%|███▍      | 129053/371472 [10:15:37<19:05:24,  3.53it/s]
 35%|███▍      | 129054/371472 [10:15:37<20:04:42,  3.35it/s]
 35%|███▍      | 129055/371472 [10:15:37<19:19:05,  3.49it/s]
 35%|███▍      | 129056/371472 [10:15:37<19:10:35,  3.51it/s]
 35%|███▍      | 129057/371472 [10:15:38<19:36:19,  3.43it/s]
 35%|███▍      | 129058/371472 [10:15:38<19:15:52,  3.50it/s]
 35%|███▍      | 129059/371472 [10:15:38<19:52:16,  3.39it/s]
 35%|███▍      | 129060/371472 [10:15:39<18:51:29,  3.57it/s]
                                                             
{'loss': 3.2131, 'learning_rate': 6.876306319894848e-07, 'epoch': 5.56}

 35%|███▍      | 129060/371472 [10:15:39<18:51:29,  3.57it/s]
 35%|███▍      | 129061/371472 [10:15:39<20:21:56,  3.31it/s]
 35%|███▍      | 129062/371472 [10:15:39<21:18:25,  3.16it/s]
 35%|███▍      | 129063/371472 [10:15:40<20:16:12,  3.32it/s]
 35%|███▍      | 129064/371472 [10:15:40<19:59:11,  3.37it/s]
 35%|███▍      | 129065/371472 [10:15:40<19:27:09,  3.46it/s]
 35%|███▍      | 129066/371472 [10:15:40<18:28:14,  3.65it/s]
 35%|███▍      | 129067/371472 [10:15:41<19:09:16,  3.52it/s]
 35%|███▍      | 129068/371472 [10:15:41<18:37:49,  3.61it/s]
 35%|███▍      | 129069/371472 [10:15:41<18:44:18,  3.59it/s]
 35%|███▍      | 129070/371472 [10:15:41<18:11:16,  3.70it/s]
 35%|███▍      | 129071/371472 [10:15:42<18:09:42,  3.71it/s]
 35%|███▍      | 129072/371472 [10:15:42<17:39:01,  3.81it/s]
 35%|███▍      | 129073/371472 [10:15:42<18:33:53,  3.63it/s]
 35%|███▍      | 129074/371472 [10:15:43<19:01:52,  3.54it/s]
 35%|███▍      | 129075/371472 [10:15:43<18:18:58,  3.68it/s]
 35%|███▍      | 129076/371472 [10:15:43<17:40:49,  3.81it/s]
 35%|███▍      | 129077/371472 [10:15:43<18:52:51,  3.57it/s]
 35%|███▍      | 129078/371472 [10:15:44<18:40:38,  3.60it/s]
 35%|███▍      | 129079/371472 [10:15:44<18:20:19,  3.67it/s]
 35%|███▍      | 129080/371472 [10:15:44<17:58:53,  3.74it/s]
                                                             
{'loss': 3.3486, 'learning_rate': 6.875821500140058e-07, 'epoch': 5.56}

 35%|███▍      | 129080/371472 [10:15:44<17:58:53,  3.74it/s]
 35%|███▍      | 129081/371472 [10:15:44<18:14:07,  3.69it/s]
 35%|███▍      | 129082/371472 [10:15:45<18:01:25,  3.74it/s]
 35%|███▍      | 129083/371472 [10:15:45<18:01:56,  3.73it/s]
 35%|███▍      | 129084/371472 [10:15:45<18:17:09,  3.68it/s]
 35%|███▍      | 129085/371472 [10:15:45<17:59:24,  3.74it/s]
 35%|███▍      | 129086/371472 [10:15:46<18:01:09,  3.74it/s]
 35%|███▍      | 129087/371472 [10:15:46<17:51:11,  3.77it/s]
 35%|███▍      | 129088/371472 [10:15:46<17:10:26,  3.92it/s]
 35%|███▍      | 129089/371472 [10:15:47<17:39:00,  3.81it/s]
 35%|███▍      | 129090/371472 [10:15:47<17:46:02,  3.79it/s]
 35%|███▍      | 129091/371472 [10:15:47<18:15:24,  3.69it/s]
 35%|███▍      | 129092/371472 [10:15:47<17:45:16,  3.79it/s]
 35%|███▍      | 129093/371472 [10:15:48<17:30:19,  3.85it/s]
 35%|███▍      | 129094/371472 [10:15:48<17:20:55,  3.88it/s]
 35%|███▍      | 129095/371472 [10:15:48<17:31:07,  3.84it/s]
 35%|███▍      | 129096/371472 [10:15:48<18:01:49,  3.73it/s]
 35%|███▍      | 129097/371472 [10:15:49<19:09:43,  3.51it/s]
 35%|███▍      | 129098/371472 [10:15:49<19:03:52,  3.53it/s]
 35%|███▍      | 129099/371472 [10:15:49<18:33:48,  3.63it/s]
 35%|███▍      | 129100/371472 [10:15:49<18:07:43,  3.71it/s]
                                                             
{'loss': 3.0836, 'learning_rate': 6.87533668038527e-07, 'epoch': 5.56}

 35%|███▍      | 129100/371472 [10:15:49<18:07:43,  3.71it/s]
 35%|███▍      | 129101/371472 [10:15:50<17:54:27,  3.76it/s]
 35%|███▍      | 129102/371472 [10:15:50<18:01:04,  3.74it/s]
 35%|███▍      | 129103/371472 [10:15:50<17:43:40,  3.80it/s]
 35%|███▍      | 129104/371472 [10:15:51<17:29:57,  3.85it/s]
 35%|███▍      | 129105/371472 [10:15:51<17:13:09,  3.91it/s]
 35%|███▍      | 129106/371472 [10:15:51<18:39:40,  3.61it/s]
 35%|███▍      | 129107/371472 [10:15:51<18:33:22,  3.63it/s]
 35%|███▍      | 129108/371472 [10:15:52<19:22:26,  3.47it/s]
 35%|███▍      | 129109/371472 [10:15:52<19:36:16,  3.43it/s]
 35%|███▍      | 129110/371472 [10:15:52<18:53:38,  3.56it/s]
 35%|███▍      | 129111/371472 [10:15:53<18:50:18,  3.57it/s]
 35%|███▍      | 129112/371472 [10:15:53<18:41:19,  3.60it/s]
 35%|███▍      | 129113/371472 [10:15:53<18:16:06,  3.69it/s]
 35%|███▍      | 129114/371472 [10:15:53<18:43:33,  3.60it/s]
 35%|███▍      | 129115/371472 [10:15:54<19:02:03,  3.54it/s]
 35%|███▍      | 129116/371472 [10:15:54<18:37:36,  3.61it/s]
 35%|███▍      | 129117/371472 [10:15:54<18:50:53,  3.57it/s]
 35%|███▍      | 129118/371472 [10:15:55<20:01:57,  3.36it/s]
 35%|███▍      | 129119/371472 [10:15:55<20:07:16,  3.35it/s]
 35%|███▍      | 129120/371472 [10:15:55<21:02:06,  3.20it/s]
                                                             
{'loss': 3.0602, 'learning_rate': 6.874851860630482e-07, 'epoch': 5.56}

 35%|███▍      | 129120/371472 [10:15:55<21:02:06,  3.20it/s]
 35%|███▍      | 129121/371472 [10:15:55<19:54:57,  3.38it/s]
 35%|███▍      | 129122/371472 [10:15:56<19:40:15,  3.42it/s]
 35%|███▍      | 129123/371472 [10:15:56<19:32:49,  3.44it/s]
 35%|███▍      | 129124/371472 [10:15:56<19:27:00,  3.46it/s]
 35%|███▍      | 129125/371472 [10:15:57<19:04:23,  3.53it/s]
 35%|███▍      | 129126/371472 [10:15:57<19:23:45,  3.47it/s]
 35%|███▍      | 129127/371472 [10:15:57<18:57:52,  3.55it/s]
 35%|███▍      | 129128/371472 [10:15:57<19:21:24,  3.48it/s]
 35%|███▍      | 129129/371472 [10:15:58<19:27:36,  3.46it/s]
 35%|███▍      | 129130/371472 [10:15:58<20:47:50,  3.24it/s]
 35%|███▍      | 129131/371472 [10:15:58<19:57:23,  3.37it/s]
 35%|███▍      | 129132/371472 [10:15:59<19:46:23,  3.40it/s]
 35%|███▍      | 129133/371472 [10:15:59<18:59:15,  3.55it/s]
 35%|███▍      | 129134/371472 [10:15:59<20:01:15,  3.36it/s]
 35%|███▍      | 129135/371472 [10:15:59<19:25:43,  3.46it/s]
 35%|███▍      | 129136/371472 [10:16:00<19:46:16,  3.40it/s]
 35%|███▍      | 129137/371472 [10:16:00<20:21:08,  3.31it/s]
 35%|███▍      | 129138/371472 [10:16:00<19:42:11,  3.42it/s]
 35%|███▍      | 129139/371472 [10:16:01<20:27:18,  3.29it/s]
 35%|███▍      | 129140/371472 [10:16:01<19:40:11,  3.42it/s]
                                                             
{'loss': 3.1346, 'learning_rate': 6.874367040875693e-07, 'epoch': 5.56}

 35%|███▍      | 129140/371472 [10:16:01<19:40:11,  3.42it/s]
 35%|███▍      | 129141/371472 [10:16:01<19:12:04,  3.51it/s]
 35%|███▍      | 129142/371472 [10:16:01<18:22:06,  3.66it/s]
 35%|███▍      | 129143/371472 [10:16:02<19:13:07,  3.50it/s]
 35%|███▍      | 129144/371472 [10:16:02<18:28:30,  3.64it/s]
 35%|███▍      | 129145/371472 [10:16:02<18:01:46,  3.73it/s]
 35%|███▍      | 129146/371472 [10:16:03<18:20:05,  3.67it/s]
 35%|███▍      | 129147/371472 [10:16:03<19:10:16,  3.51it/s]
 35%|███▍      | 129148/371472 [10:16:03<18:55:06,  3.56it/s]
 35%|███▍      | 129149/371472 [10:16:03<19:17:09,  3.49it/s]
 35%|███▍      | 129150/371472 [10:16:04<20:06:06,  3.35it/s]
 35%|███▍      | 129151/371472 [10:16:04<19:27:04,  3.46it/s]
 35%|███▍      | 129152/371472 [10:16:04<20:22:50,  3.30it/s]
 35%|███▍      | 129153/371472 [10:16:05<19:31:18,  3.45it/s]
 35%|███▍      | 129154/371472 [10:16:05<18:33:52,  3.63it/s]
 35%|███▍      | 129155/371472 [10:16:05<17:53:27,  3.76it/s]
 35%|███▍      | 129156/371472 [10:16:05<17:44:40,  3.79it/s]
 35%|███▍      | 129157/371472 [10:16:06<17:26:25,  3.86it/s]
 35%|███▍      | 129158/371472 [10:16:06<17:54:33,  3.76it/s]
 35%|███▍      | 129159/371472 [10:16:06<17:27:12,  3.86it/s]
 35%|███▍      | 129160/371472 [10:16:06<17:33:52,  3.83it/s]
                                                             
{'loss': 3.3999, 'learning_rate': 6.873882221120902e-07, 'epoch': 5.56}

 35%|███▍      | 129160/371472 [10:16:06<17:33:52,  3.83it/s]
 35%|███▍      | 129161/371472 [10:16:07<17:54:51,  3.76it/s]
 35%|███▍      | 129162/371472 [10:16:07<18:11:39,  3.70it/s]
 35%|███▍      | 129163/371472 [10:16:07<17:55:30,  3.75it/s]
 35%|███▍      | 129164/371472 [10:16:08<18:34:31,  3.62it/s]
 35%|███▍      | 129165/371472 [10:16:08<17:58:43,  3.74it/s]
 35%|███▍      | 129166/371472 [10:16:08<17:26:27,  3.86it/s]
 35%|███▍      | 129167/371472 [10:16:08<17:36:10,  3.82it/s]
 35%|███▍      | 129168/371472 [10:16:09<17:15:37,  3.90it/s]
 35%|███▍      | 129169/371472 [10:16:09<18:07:59,  3.71it/s]
 35%|███▍      | 129170/371472 [10:16:09<17:52:22,  3.77it/s]
 35%|███▍      | 129171/371472 [10:16:09<19:46:13,  3.40it/s]
 35%|███▍      | 129172/371472 [10:16:10<18:40:10,  3.61it/s]
 35%|███▍      | 129173/371472 [10:16:10<18:37:14,  3.61it/s]
 35%|███▍      | 129174/371472 [10:16:10<17:54:47,  3.76it/s]
 35%|███▍      | 129175/371472 [10:16:11<18:03:02,  3.73it/s]
 35%|███▍      | 129176/371472 [10:16:11<17:40:42,  3.81it/s]
 35%|███▍      | 129177/371472 [10:16:11<18:24:27,  3.66it/s]
 35%|███▍      | 129178/371472 [10:16:11<18:12:35,  3.70it/s]
 35%|███▍      | 129179/371472 [10:16:12<18:25:19,  3.65it/s]
 35%|███▍      | 129180/371472 [10:16:12<19:16:52,  3.49it/s]
                                                             
{'loss': 3.2813, 'learning_rate': 6.873397401366114e-07, 'epoch': 5.56}

 35%|███▍      | 129180/371472 [10:16:12<19:16:52,  3.49it/s]
 35%|███▍      | 129181/371472 [10:16:12<19:14:39,  3.50it/s]
 35%|███▍      | 129182/371472 [10:16:12<18:50:44,  3.57it/s]
 35%|███▍      | 129183/371472 [10:16:13<18:16:21,  3.68it/s]
 35%|███▍      | 129184/371472 [10:16:13<17:44:48,  3.79it/s]
 35%|███▍      | 129185/371472 [10:16:13<17:50:39,  3.77it/s]
 35%|███▍      | 129186/371472 [10:16:14<18:08:44,  3.71it/s]
 35%|███▍      | 129187/371472 [10:16:14<19:08:34,  3.52it/s]
 35%|███▍      | 129188/371472 [10:16:14<19:20:46,  3.48it/s]
 35%|███▍      | 129189/371472 [10:16:14<19:12:57,  3.50it/s]
 35%|███▍      | 129190/371472 [10:16:15<21:56:04,  3.07it/s]
 35%|███▍      | 129191/371472 [10:16:15<21:14:37,  3.17it/s]
 35%|███▍      | 129192/371472 [10:16:15<20:20:58,  3.31it/s]
 35%|███▍      | 129193/371472 [10:16:16<19:28:24,  3.46it/s]
 35%|███▍      | 129194/371472 [10:16:16<19:41:18,  3.42it/s]
 35%|███▍      | 129195/371472 [10:16:16<20:10:27,  3.34it/s]
 35%|███▍      | 129196/371472 [10:16:17<19:05:21,  3.53it/s]
 35%|███▍      | 129197/371472 [10:16:17<18:27:14,  3.65it/s]
 35%|███▍      | 129198/371472 [10:16:17<19:12:36,  3.50it/s]
 35%|███▍      | 129199/371472 [10:16:17<19:34:51,  3.44it/s]
 35%|███▍      | 129200/371472 [10:16:18<19:35:47,  3.43it/s]
                                                             
{'loss': 3.1085, 'learning_rate': 6.872912581611326e-07, 'epoch': 5.56}

 35%|███▍      | 129200/371472 [10:16:18<19:35:47,  3.43it/s]
 35%|███▍      | 129201/371472 [10:16:18<19:23:15,  3.47it/s]
 35%|███▍      | 129202/371472 [10:16:18<18:42:40,  3.60it/s]
 35%|███▍      | 129203/371472 [10:16:19<19:28:32,  3.46it/s]
 35%|███▍      | 129204/371472 [10:16:19<19:09:01,  3.51it/s]
 35%|███▍      | 129205/371472 [10:16:19<19:33:10,  3.44it/s]
 35%|███▍      | 129206/371472 [10:16:19<19:02:00,  3.54it/s]
 35%|███▍      | 129207/371472 [10:16:20<19:11:43,  3.51it/s]
 35%|███▍      | 129208/371472 [10:16:20<18:34:14,  3.62it/s]
 35%|███▍      | 129209/371472 [10:16:20<18:10:00,  3.70it/s]
 35%|███▍      | 129210/371472 [10:16:20<18:56:50,  3.55it/s]
 35%|███▍      | 129211/371472 [10:16:21<18:25:01,  3.65it/s]
 35%|███▍      | 129212/371472 [10:16:21<18:24:23,  3.66it/s]
 35%|███▍      | 129213/371472 [10:16:21<19:03:36,  3.53it/s]
 35%|███▍      | 129214/371472 [10:16:22<19:24:52,  3.47it/s]
 35%|███▍      | 129215/371472 [10:16:22<18:38:10,  3.61it/s]
 35%|███▍      | 129216/371472 [10:16:22<18:04:47,  3.72it/s]
 35%|███▍      | 129217/371472 [10:16:22<18:53:41,  3.56it/s]
 35%|███▍      | 129218/371472 [10:16:23<18:36:02,  3.62it/s]
 35%|███▍      | 129219/371472 [10:16:23<18:22:15,  3.66it/s]
 35%|███▍      | 129220/371472 [10:16:23<18:21:44,  3.66it/s]
                                                             
{'loss': 3.439, 'learning_rate': 6.872427761856535e-07, 'epoch': 5.57}

 35%|███▍      | 129220/371472 [10:16:23<18:21:44,  3.66it/s]
 35%|███▍      | 129221/371472 [10:16:23<18:14:35,  3.69it/s]
 35%|███▍      | 129222/371472 [10:16:24<18:17:56,  3.68it/s]
 35%|███▍      | 129223/371472 [10:16:24<18:31:25,  3.63it/s]
 35%|███▍      | 129224/371472 [10:16:24<19:02:47,  3.53it/s]
 35%|███▍      | 129225/371472 [10:16:25<18:44:31,  3.59it/s]
 35%|███▍      | 129226/371472 [10:16:25<18:24:36,  3.66it/s]
 35%|███▍      | 129227/371472 [10:16:25<18:48:55,  3.58it/s]
 35%|███▍      | 129228/371472 [10:16:26<20:13:55,  3.33it/s]
 35%|███▍      | 129229/371472 [10:16:26<21:06:46,  3.19it/s]
 35%|███▍      | 129230/371472 [10:16:26<20:46:01,  3.24it/s]
 35%|███▍      | 129231/371472 [10:16:26<20:11:24,  3.33it/s]
 35%|███▍      | 129232/371472 [10:16:27<19:16:10,  3.49it/s]
 35%|███▍      | 129233/371472 [10:16:27<19:27:14,  3.46it/s]
 35%|███▍      | 129234/371472 [10:16:27<19:43:17,  3.41it/s]
 35%|███▍      | 129235/371472 [10:16:28<19:21:03,  3.48it/s]
 35%|███▍      | 129236/371472 [10:16:28<19:18:05,  3.49it/s]
 35%|███▍      | 129237/371472 [10:16:28<19:27:41,  3.46it/s]
 35%|███▍      | 129238/371472 [10:16:28<20:30:52,  3.28it/s]
 35%|███▍      | 129239/371472 [10:16:29<19:34:26,  3.44it/s]
 35%|███▍      | 129240/371472 [10:16:29<20:39:14,  3.26it/s]
                                                             
{'loss': 3.1544, 'learning_rate': 6.871942942101747e-07, 'epoch': 5.57}

 35%|███▍      | 129240/371472 [10:16:29<20:39:14,  3.26it/s]
 35%|███▍      | 129241/371472 [10:16:29<20:22:25,  3.30it/s]
 35%|███▍      | 129242/371472 [10:16:30<19:33:59,  3.44it/s]
 35%|███▍      | 129243/371472 [10:16:30<19:09:47,  3.51it/s]
 35%|███▍      | 129244/371472 [10:16:30<18:26:26,  3.65it/s]
 35%|███▍      | 129245/371472 [10:16:30<17:41:13,  3.80it/s]
 35%|███▍      | 129246/371472 [10:16:31<18:52:42,  3.56it/s]
 35%|███▍      | 129247/371472 [10:16:31<18:34:32,  3.62it/s]
 35%|███▍      | 129248/371472 [10:16:31<19:27:04,  3.46it/s]
 35%|███▍      | 129249/371472 [10:16:32<19:03:10,  3.53it/s]
 35%|███▍      | 129250/371472 [10:16:32<18:22:26,  3.66it/s]
 35%|███▍      | 129251/371472 [10:16:32<17:32:16,  3.84it/s]
 35%|███▍      | 129252/371472 [10:16:32<17:54:14,  3.76it/s]
 35%|███▍      | 129253/371472 [10:16:33<19:31:15,  3.45it/s]
 35%|███▍      | 129254/371472 [10:16:33<19:10:24,  3.51it/s]
 35%|███▍      | 129255/371472 [10:16:33<18:46:16,  3.58it/s]
 35%|███▍      | 129256/371472 [10:16:34<18:46:34,  3.58it/s]
 35%|███▍      | 129257/371472 [10:16:34<19:10:49,  3.51it/s]
 35%|███▍      | 129258/371472 [10:16:34<18:23:59,  3.66it/s]
 35%|███▍      | 129259/371472 [10:16:34<18:00:32,  3.74it/s]
 35%|███▍      | 129260/371472 [10:16:35<18:10:42,  3.70it/s]
                                                             
{'loss': 3.1114, 'learning_rate': 6.871458122346959e-07, 'epoch': 5.57}

 35%|███▍      | 129260/371472 [10:16:35<18:10:42,  3.70it/s]
 35%|███▍      | 129261/371472 [10:16:35<18:19:53,  3.67it/s]
 35%|███▍      | 129262/371472 [10:16:35<18:12:17,  3.70it/s]
 35%|███▍      | 129263/371472 [10:16:35<18:04:18,  3.72it/s]
 35%|███▍      | 129264/371472 [10:16:36<18:56:55,  3.55it/s]
 35%|███▍      | 129265/371472 [10:16:36<18:34:18,  3.62it/s]
 35%|███▍      | 129266/371472 [10:16:36<18:55:56,  3.55it/s]
 35%|███▍      | 129267/371472 [10:16:37<18:37:01,  3.61it/s]
 35%|███▍      | 129268/371472 [10:16:37<18:07:01,  3.71it/s]
 35%|███▍      | 129269/371472 [10:16:37<18:42:49,  3.60it/s]
 35%|███▍      | 129270/371472 [10:16:37<18:04:29,  3.72it/s]
 35%|███▍      | 129271/371472 [10:16:38<18:07:14,  3.71it/s]
 35%|███▍      | 129272/371472 [10:16:38<18:01:03,  3.73it/s]
 35%|███▍      | 129273/371472 [10:16:38<18:58:19,  3.55it/s]
 35%|███▍      | 129274/371472 [10:16:38<18:58:03,  3.55it/s]
 35%|███▍      | 129275/371472 [10:16:39<18:27:48,  3.64it/s]
 35%|███▍      | 129276/371472 [10:16:39<18:28:22,  3.64it/s]
 35%|███▍      | 129277/371472 [10:16:39<19:42:08,  3.41it/s]
 35%|███▍      | 129278/371472 [10:16:40<21:03:05,  3.20it/s]
 35%|███▍      | 129279/371472 [10:16:40<20:03:38,  3.35it/s]
 35%|███▍      | 129280/371472 [10:16:40<20:07:57,  3.34it/s]
                                                             
{'loss': 3.121, 'learning_rate': 6.870973302592169e-07, 'epoch': 5.57}

 35%|███▍      | 129280/371472 [10:16:40<20:07:57,  3.34it/s]
 35%|███▍      | 129281/371472 [10:16:41<22:09:51,  3.04it/s]
 35%|███▍      | 129282/371472 [10:16:41<21:03:56,  3.19it/s]
 35%|███▍      | 129283/371472 [10:16:41<20:54:39,  3.22it/s]
 35%|███▍      | 129284/371472 [10:16:41<19:51:22,  3.39it/s]
 35%|███▍      | 129285/371472 [10:16:42<19:15:34,  3.49it/s]
 35%|███▍      | 129286/371472 [10:16:42<19:50:38,  3.39it/s]
 35%|███▍      | 129287/371472 [10:16:42<19:34:19,  3.44it/s]
 35%|███▍      | 129288/371472 [10:16:43<19:43:52,  3.41it/s]
 35%|███▍      | 129289/371472 [10:16:43<19:41:25,  3.42it/s]
 35%|███▍      | 129290/371472 [10:16:43<18:57:53,  3.55it/s]
 35%|███▍      | 129291/371472 [10:16:43<18:31:13,  3.63it/s]
 35%|███▍      | 129292/371472 [10:16:44<18:18:24,  3.67it/s]
 35%|███▍      | 129293/371472 [10:16:44<18:43:27,  3.59it/s]
 35%|███▍      | 129294/371472 [10:16:44<18:53:54,  3.56it/s]
 35%|███▍      | 129295/371472 [10:16:45<18:49:54,  3.57it/s]
 35%|███▍      | 129296/371472 [10:16:45<19:01:11,  3.54it/s]
 35%|███▍      | 129297/371472 [10:16:45<19:02:36,  3.53it/s]
 35%|███▍      | 129298/371472 [10:16:45<19:03:29,  3.53it/s]
 35%|███▍      | 129299/371472 [10:16:46<18:43:02,  3.59it/s]
 35%|███▍      | 129300/371472 [10:16:46<18:43:29,  3.59it/s]
                                                             
{'loss': 3.23, 'learning_rate': 6.87048848283738e-07, 'epoch': 5.57}

 35%|███▍      | 129300/371472 [10:16:46<18:43:29,  3.59it/s]
 35%|███▍      | 129301/371472 [10:16:46<18:15:43,  3.68it/s]
 35%|███▍      | 129302/371472 [10:16:47<19:05:16,  3.52it/s]
 35%|███▍      | 129303/371472 [10:16:47<18:54:51,  3.56it/s]
 35%|███▍      | 129304/371472 [10:16:47<18:42:00,  3.60it/s]
 35%|███▍      | 129305/371472 [10:16:47<18:58:51,  3.54it/s]
 35%|███▍      | 129306/371472 [10:16:48<18:50:09,  3.57it/s]
 35%|███▍      | 129307/371472 [10:16:48<19:36:39,  3.43it/s]
 35%|███▍      | 129308/371472 [10:16:48<20:00:47,  3.36it/s]
 35%|███▍      | 129309/371472 [10:16:49<19:35:20,  3.43it/s]
 35%|███▍      | 129310/371472 [10:16:49<19:43:55,  3.41it/s]
 35%|███▍      | 129311/371472 [10:16:49<19:51:36,  3.39it/s]
 35%|███▍      | 129312/371472 [10:16:49<18:55:08,  3.56it/s]
 35%|███▍      | 129313/371472 [10:16:50<20:54:15,  3.22it/s]
 35%|███▍      | 129314/371472 [10:16:50<20:14:07,  3.32it/s]
 35%|███▍      | 129315/371472 [10:16:50<20:06:58,  3.34it/s]
 35%|███▍      | 129316/371472 [10:16:51<19:06:33,  3.52it/s]
 35%|███▍      | 129317/371472 [10:16:51<20:23:20,  3.30it/s]
 35%|███▍      | 129318/371472 [10:16:51<20:37:10,  3.26it/s]
 35%|███▍      | 129319/371472 [10:16:52<20:01:53,  3.36it/s]
 35%|███▍      | 129320/371472 [10:16:52<20:00:05,  3.36it/s]
                                                             
{'loss': 3.2205, 'learning_rate': 6.870003663082591e-07, 'epoch': 5.57}

 35%|███▍      | 129320/371472 [10:16:52<20:00:05,  3.36it/s]
 35%|███▍      | 129321/371472 [10:16:52<19:19:36,  3.48it/s]
 35%|███▍      | 129322/371472 [10:16:52<19:23:33,  3.47it/s]
 35%|███▍      | 129323/371472 [10:16:53<18:43:03,  3.59it/s]
 35%|███▍      | 129324/371472 [10:16:53<18:46:07,  3.58it/s]
 35%|███▍      | 129325/371472 [10:16:53<18:04:30,  3.72it/s]
 35%|███▍      | 129326/371472 [10:16:53<18:21:09,  3.67it/s]
 35%|███▍      | 129327/371472 [10:16:54<17:53:47,  3.76it/s]
 35%|███▍      | 129328/371472 [10:16:54<20:23:09,  3.30it/s]
 35%|███▍      | 129329/371472 [10:16:54<19:47:31,  3.40it/s]
 35%|███▍      | 129330/371472 [10:16:55<20:31:29,  3.28it/s]
 35%|███▍      | 129331/371472 [10:16:55<21:05:21,  3.19it/s]
 35%|███▍      | 129332/371472 [10:16:55<20:42:37,  3.25it/s]
 35%|███▍      | 129333/371472 [10:16:56<20:44:52,  3.24it/s]
 35%|███▍      | 129334/371472 [10:16:56<19:59:48,  3.36it/s]
 35%|███▍      | 129335/371472 [10:16:56<19:46:38,  3.40it/s]
 35%|███▍      | 129336/371472 [10:16:56<19:04:22,  3.53it/s]
 35%|███▍      | 129337/371472 [10:16:57<18:06:50,  3.71it/s]
 35%|███▍      | 129338/371472 [10:16:57<17:59:05,  3.74it/s]
 35%|███▍      | 129339/371472 [10:16:57<19:35:52,  3.43it/s]
 35%|███▍      | 129340/371472 [10:16:58<20:03:36,  3.35it/s]
                                                             
{'loss': 3.2211, 'learning_rate': 6.869518843327803e-07, 'epoch': 5.57}

 35%|███▍      | 129340/371472 [10:16:58<20:03:36,  3.35it/s]
 35%|███▍      | 129341/371472 [10:16:58<19:55:15,  3.38it/s]
 35%|███▍      | 129342/371472 [10:16:58<20:07:53,  3.34it/s]
 35%|███▍      | 129343/371472 [10:16:59<21:04:49,  3.19it/s]
 35%|███▍      | 129344/371472 [10:16:59<19:53:08,  3.38it/s]
 35%|███▍      | 129345/371472 [10:16:59<19:23:51,  3.47it/s]
 35%|███▍      | 129346/371472 [10:16:59<19:14:17,  3.50it/s]
 35%|███▍      | 129347/371472 [10:17:00<18:22:50,  3.66it/s]
 35%|███▍      | 129348/371472 [10:17:00<18:04:08,  3.72it/s]
 35%|███▍      | 129349/371472 [10:17:00<17:42:27,  3.80it/s]
 35%|███▍      | 129350/371472 [10:17:00<17:42:58,  3.80it/s]
 35%|███▍      | 129351/371472 [10:17:01<17:38:15,  3.81it/s]
 35%|███▍      | 129352/371472 [10:17:01<17:25:53,  3.86it/s]
 35%|███▍      | 129353/371472 [10:17:01<17:47:52,  3.78it/s]
 35%|███▍      | 129354/371472 [10:17:01<18:28:50,  3.64it/s]
 35%|███▍      | 129355/371472 [10:17:02<18:31:24,  3.63it/s]
 35%|███▍      | 129356/371472 [10:17:02<18:22:43,  3.66it/s]
 35%|███▍      | 129357/371472 [10:17:02<17:37:59,  3.81it/s]
 35%|███▍      | 129358/371472 [10:17:03<17:56:49,  3.75it/s]
 35%|███▍      | 129359/371472 [10:17:03<18:06:46,  3.71it/s]
 35%|███▍      | 129360/371472 [10:17:03<18:06:31,  3.71it/s]
                                                             
{'loss': 3.1302, 'learning_rate': 6.869034023573014e-07, 'epoch': 5.57}

 35%|███▍      | 129360/371472 [10:17:03<18:06:31,  3.71it/s]
 35%|███▍      | 129361/371472 [10:17:03<18:27:55,  3.64it/s]
 35%|███▍      | 129362/371472 [10:17:04<18:48:13,  3.58it/s]
 35%|███▍      | 129363/371472 [10:17:04<18:47:52,  3.58it/s]
 35%|███▍      | 129364/371472 [10:17:04<18:44:02,  3.59it/s]
 35%|███▍      | 129365/371472 [10:17:04<18:45:39,  3.58it/s]
 35%|███▍      | 129366/371472 [10:17:05<18:54:21,  3.56it/s]
 35%|███▍      | 129367/371472 [10:17:05<18:42:34,  3.59it/s]
 35%|███▍      | 129368/371472 [10:17:05<20:09:17,  3.34it/s]
 35%|███▍      | 129369/371472 [10:17:06<21:01:47,  3.20it/s]
 35%|███▍      | 129370/371472 [10:17:06<21:59:15,  3.06it/s]
 35%|███▍      | 129371/371472 [10:17:06<21:51:23,  3.08it/s]
 35%|███▍      | 129372/371472 [10:17:07<21:09:38,  3.18it/s]
 35%|███▍      | 129373/371472 [10:17:07<20:51:53,  3.22it/s]
 35%|███▍      | 129374/371472 [10:17:07<20:17:54,  3.31it/s]
 35%|███▍      | 129375/371472 [10:17:08<19:34:26,  3.44it/s]
 35%|███▍      | 129376/371472 [10:17:08<19:49:20,  3.39it/s]
 35%|███▍      | 129377/371472 [10:17:08<20:49:36,  3.23it/s]
 35%|███▍      | 129378/371472 [10:17:09<20:38:45,  3.26it/s]
 35%|███▍      | 129379/371472 [10:17:09<20:14:30,  3.32it/s]
 35%|███▍      | 129380/371472 [10:17:09<20:39:11,  3.26it/s]
                                                             
{'loss': 3.0789, 'learning_rate': 6.868549203818224e-07, 'epoch': 5.57}

 35%|███▍      | 129380/371472 [10:17:09<20:39:11,  3.26it/s]
 35%|███▍      | 129381/371472 [10:17:09<20:00:50,  3.36it/s]
 35%|███▍      | 129382/371472 [10:17:10<18:54:25,  3.56it/s]
 35%|███▍      | 129383/371472 [10:17:10<19:59:44,  3.36it/s]
 35%|███▍      | 129384/371472 [10:17:10<19:52:40,  3.38it/s]
 35%|███▍      | 129385/371472 [10:17:11<19:20:40,  3.48it/s]
 35%|███▍      | 129386/371472 [10:17:11<18:38:20,  3.61it/s]
 35%|███▍      | 129387/371472 [10:17:11<19:08:01,  3.51it/s]
 35%|███▍      | 129388/371472 [10:17:11<20:25:44,  3.29it/s]
 35%|███▍      | 129389/371472 [10:17:12<21:31:50,  3.12it/s]
 35%|███▍      | 129390/371472 [10:17:12<19:57:00,  3.37it/s]
 35%|███▍      | 129391/371472 [10:17:12<20:08:56,  3.34it/s]
 35%|███▍      | 129392/371472 [10:17:13<19:40:31,  3.42it/s]
 35%|███▍      | 129393/371472 [10:17:13<18:48:17,  3.58it/s]
 35%|███▍      | 129394/371472 [10:17:13<18:18:37,  3.67it/s]
 35%|███▍      | 129395/371472 [10:17:13<18:29:42,  3.64it/s]
 35%|███▍      | 129396/371472 [10:17:14<18:51:14,  3.57it/s]
 35%|███▍      | 129397/371472 [10:17:14<18:25:45,  3.65it/s]
 35%|███▍      | 129398/371472 [10:17:14<17:48:08,  3.78it/s]
 35%|███▍      | 129399/371472 [10:17:15<20:00:37,  3.36it/s]
 35%|███▍      | 129400/371472 [10:17:15<19:24:20,  3.47it/s]
                                                             
{'loss': 3.2549, 'learning_rate': 6.868064384063435e-07, 'epoch': 5.57}

 35%|███▍      | 129400/371472 [10:17:15<19:24:20,  3.47it/s]
 35%|███▍      | 129401/371472 [10:17:15<20:11:11,  3.33it/s]
 35%|███▍      | 129402/371472 [10:17:15<19:39:40,  3.42it/s]
 35%|███▍      | 129403/371472 [10:17:16<18:47:48,  3.58it/s]
 35%|███▍      | 129404/371472 [10:17:16<18:40:19,  3.60it/s]
 35%|███▍      | 129405/371472 [10:17:16<18:12:09,  3.69it/s]
 35%|███▍      | 129406/371472 [10:17:16<17:55:04,  3.75it/s]
 35%|███▍      | 129407/371472 [10:17:17<18:05:02,  3.72it/s]
 35%|███▍      | 129408/371472 [10:17:17<18:41:08,  3.60it/s]
 35%|███▍      | 129409/371472 [10:17:17<18:43:51,  3.59it/s]
 35%|███▍      | 129410/371472 [10:17:18<18:20:45,  3.67it/s]
 35%|███▍      | 129411/371472 [10:17:18<18:25:44,  3.65it/s]
 35%|███▍      | 129412/371472 [10:17:18<18:20:10,  3.67it/s]
 35%|███▍      | 129413/371472 [10:17:18<18:22:26,  3.66it/s]
 35%|███▍      | 129414/371472 [10:17:19<17:58:33,  3.74it/s]
 35%|███▍      | 129415/371472 [10:17:19<18:16:27,  3.68it/s]
 35%|███▍      | 129416/371472 [10:17:19<18:31:06,  3.63it/s]
 35%|███▍      | 129417/371472 [10:17:20<18:28:09,  3.64it/s]
 35%|███▍      | 129418/371472 [10:17:20<19:11:23,  3.50it/s]
 35%|███▍      | 129419/371472 [10:17:20<18:21:40,  3.66it/s]
 35%|███▍      | 129420/371472 [10:17:20<17:47:55,  3.78it/s]
                                                             
{'loss': 3.1204, 'learning_rate': 6.867579564308647e-07, 'epoch': 5.57}

 35%|███▍      | 129420/371472 [10:17:20<17:47:55,  3.78it/s]
 35%|███▍      | 129421/371472 [10:17:21<18:07:17,  3.71it/s]
 35%|███▍      | 129422/371472 [10:17:21<18:01:47,  3.73it/s]
 35%|███▍      | 129423/371472 [10:17:21<17:32:07,  3.83it/s]
 35%|███▍      | 129424/371472 [10:17:21<17:30:45,  3.84it/s]
 35%|███▍      | 129425/371472 [10:17:22<18:08:38,  3.71it/s]
 35%|███▍      | 129426/371472 [10:17:22<18:32:58,  3.62it/s]
 35%|███▍      | 129427/371472 [10:17:22<19:36:06,  3.43it/s]
 35%|███▍      | 129428/371472 [10:17:23<19:00:22,  3.54it/s]
 35%|███▍      | 129429/371472 [10:17:23<19:58:04,  3.37it/s]
 35%|███▍      | 129430/371472 [10:17:23<19:57:48,  3.37it/s]
 35%|███▍      | 129431/371472 [10:17:23<18:46:33,  3.58it/s]
 35%|███▍      | 129432/371472 [10:17:24<19:22:20,  3.47it/s]
 35%|███▍      | 129433/371472 [10:17:24<20:03:27,  3.35it/s]
 35%|███▍      | 129434/371472 [10:17:24<20:08:44,  3.34it/s]
 35%|███▍      | 129435/371472 [10:17:25<18:55:33,  3.55it/s]
 35%|███▍      | 129436/371472 [10:17:25<17:58:23,  3.74it/s]
 35%|███▍      | 129437/371472 [10:17:25<17:36:53,  3.82it/s]
 35%|███▍      | 129438/371472 [10:17:25<18:21:31,  3.66it/s]
 35%|███▍      | 129439/371472 [10:17:26<18:04:47,  3.72it/s]
 35%|███▍      | 129440/371472 [10:17:26<17:47:13,  3.78it/s]
                                                             
{'loss': 3.0862, 'learning_rate': 6.867094744553858e-07, 'epoch': 5.58}

 35%|███▍      | 129440/371472 [10:17:26<17:47:13,  3.78it/s]
 35%|███▍      | 129441/371472 [10:17:26<17:22:12,  3.87it/s]
 35%|███▍      | 129442/371472 [10:17:26<17:12:29,  3.91it/s]
 35%|███▍      | 129443/371472 [10:17:27<18:26:47,  3.64it/s]
 35%|███▍      | 129444/371472 [10:17:27<19:09:56,  3.51it/s]
 35%|███▍      | 129445/371472 [10:17:27<18:25:12,  3.65it/s]
 35%|███▍      | 129446/371472 [10:17:27<17:59:44,  3.74it/s]
 35%|███▍      | 129447/371472 [10:17:28<18:10:15,  3.70it/s]
 35%|███▍      | 129448/371472 [10:17:28<19:12:58,  3.50it/s]
 35%|███▍      | 129449/371472 [10:17:28<19:30:05,  3.45it/s]
 35%|███▍      | 129450/371472 [10:17:29<20:06:10,  3.34it/s]
 35%|███▍      | 129451/371472 [10:17:29<19:25:32,  3.46it/s]
 35%|███▍      | 129452/371472 [10:17:29<19:22:16,  3.47it/s]
 35%|███▍      | 129453/371472 [10:17:30<18:54:07,  3.56it/s]
 35%|███▍      | 129454/371472 [10:17:30<18:58:58,  3.54it/s]
 35%|███▍      | 129455/371472 [10:17:30<18:56:33,  3.55it/s]
 35%|███▍      | 129456/371472 [10:17:30<19:38:04,  3.42it/s]
 35%|███▍      | 129457/371472 [10:17:31<19:24:21,  3.46it/s]
 35%|███▍      | 129458/371472 [10:17:31<18:26:35,  3.65it/s]
 35%|███▍      | 129459/371472 [10:17:31<19:02:24,  3.53it/s]
 35%|███▍      | 129460/371472 [10:17:32<19:21:45,  3.47it/s]
                                                             
{'loss': 3.3525, 'learning_rate': 6.866609924799068e-07, 'epoch': 5.58}

 35%|███▍      | 129460/371472 [10:17:32<19:21:45,  3.47it/s]
 35%|███▍      | 129461/371472 [10:17:32<19:35:09,  3.43it/s]
 35%|███▍      | 129462/371472 [10:17:32<19:22:37,  3.47it/s]
 35%|███▍      | 129463/371472 [10:17:32<18:44:18,  3.59it/s]
 35%|███▍      | 129464/371472 [10:17:33<18:17:57,  3.67it/s]
 35%|███▍      | 129465/371472 [10:17:33<18:12:57,  3.69it/s]
 35%|███▍      | 129466/371472 [10:17:33<19:57:11,  3.37it/s]
 35%|███▍      | 129467/371472 [10:17:34<20:10:01,  3.33it/s]
 35%|███▍      | 129468/371472 [10:17:34<19:32:58,  3.44it/s]
 35%|███▍      | 129469/371472 [10:17:34<19:00:48,  3.54it/s]
 35%|███▍      | 129470/371472 [10:17:34<19:05:38,  3.52it/s]
 35%|███▍      | 129471/371472 [10:17:35<20:26:22,  3.29it/s]
 35%|███▍      | 129472/371472 [10:17:35<19:35:16,  3.43it/s]
 35%|███▍      | 129473/371472 [10:17:35<18:57:47,  3.54it/s]
 35%|███▍      | 129474/371472 [10:17:35<18:17:14,  3.68it/s]
 35%|███▍      | 129475/371472 [10:17:36<19:15:32,  3.49it/s]
 35%|███▍      | 129476/371472 [10:17:36<21:19:12,  3.15it/s]
 35%|███▍      | 129477/371472 [10:17:36<20:24:42,  3.29it/s]
 35%|███▍      | 129478/371472 [10:17:37<19:32:39,  3.44it/s]
 35%|███▍      | 129479/371472 [10:17:37<18:58:42,  3.54it/s]
 35%|███▍      | 129480/371472 [10:17:37<18:52:21,  3.56it/s]
                                                             
{'loss': 3.2225, 'learning_rate': 6.86612510504428e-07, 'epoch': 5.58}

 35%|███▍      | 129480/371472 [10:17:37<18:52:21,  3.56it/s]
 35%|███▍      | 129481/371472 [10:17:38<19:16:10,  3.49it/s]
 35%|███▍      | 129482/371472 [10:17:38<19:29:17,  3.45it/s]
 35%|███▍      | 129483/371472 [10:17:38<19:30:20,  3.45it/s]
 35%|███▍      | 129484/371472 [10:17:38<18:51:03,  3.57it/s]
 35%|███▍      | 129485/371472 [10:17:39<19:27:28,  3.45it/s]
 35%|███▍      | 129486/371472 [10:17:39<19:41:11,  3.41it/s]
 35%|███▍      | 129487/371472 [10:17:39<20:31:15,  3.28it/s]
 35%|███▍      | 129488/371472 [10:17:40<21:05:02,  3.19it/s]
 35%|███▍      | 129489/371472 [10:17:40<20:06:47,  3.34it/s]
 35%|███▍      | 129490/371472 [10:17:40<19:33:03,  3.44it/s]
 35%|███▍      | 129491/371472 [10:17:41<21:47:07,  3.09it/s]
 35%|███▍      | 129492/371472 [10:17:41<20:45:32,  3.24it/s]
 35%|███▍      | 129493/371472 [10:17:41<19:50:12,  3.39it/s]
 35%|███▍      | 129494/371472 [10:17:41<19:33:54,  3.44it/s]
 35%|███▍      | 129495/371472 [10:17:42<19:05:58,  3.52it/s]
 35%|███▍      | 129496/371472 [10:17:42<18:42:57,  3.59it/s]
 35%|███▍      | 129497/371472 [10:17:42<18:09:50,  3.70it/s]
 35%|███▍      | 129498/371472 [10:17:43<17:57:07,  3.74it/s]
 35%|███▍      | 129499/371472 [10:17:43<19:01:08,  3.53it/s]
 35%|███▍      | 129500/371472 [10:17:43<18:32:50,  3.62it/s]
                                                             
{'loss': 3.1107, 'learning_rate': 6.865640285289493e-07, 'epoch': 5.58}

 35%|███▍      | 129500/371472 [10:17:43<18:32:50,  3.62it/s]
 35%|███▍      | 129501/371472 [10:17:43<18:50:53,  3.57it/s]
 35%|███▍      | 129502/371472 [10:17:44<19:02:21,  3.53it/s]
 35%|███▍      | 129503/371472 [10:17:44<18:49:42,  3.57it/s]
 35%|███▍      | 129504/371472 [10:17:44<18:55:49,  3.55it/s]
 35%|███▍      | 129505/371472 [10:17:44<18:46:25,  3.58it/s]
 35%|███▍      | 129506/371472 [10:17:45<19:05:19,  3.52it/s]
 35%|███▍      | 129507/371472 [10:17:45<18:45:22,  3.58it/s]
 35%|███▍      | 129508/371472 [10:17:45<19:00:14,  3.54it/s]
 35%|███▍      | 129509/371472 [10:17:46<18:44:44,  3.59it/s]
 35%|███▍      | 129510/371472 [10:17:46<17:59:03,  3.74it/s]
 35%|███▍      | 129511/371472 [10:17:46<18:21:32,  3.66it/s]
 35%|███▍      | 129512/371472 [10:17:46<18:04:16,  3.72it/s]
 35%|███▍      | 129513/371472 [10:17:47<18:31:22,  3.63it/s]
 35%|███▍      | 129514/371472 [10:17:47<18:14:20,  3.68it/s]
 35%|███▍      | 129515/371472 [10:17:47<18:51:44,  3.56it/s]
 35%|███▍      | 129516/371472 [10:17:48<18:50:14,  3.57it/s]
 35%|███▍      | 129517/371472 [10:17:48<18:44:32,  3.59it/s]
 35%|███▍      | 129518/371472 [10:17:48<19:31:21,  3.44it/s]
 35%|███▍      | 129519/371472 [10:17:48<20:40:10,  3.25it/s]
 35%|███▍      | 129520/371472 [10:17:49<21:29:13,  3.13it/s]
                                                             
{'loss': 3.2329, 'learning_rate': 6.865155465534703e-07, 'epoch': 5.58}

 35%|███▍      | 129520/371472 [10:17:49<21:29:13,  3.13it/s]
 35%|███▍      | 129521/371472 [10:17:49<21:24:26,  3.14it/s]
 35%|███▍      | 129522/371472 [10:17:49<21:43:34,  3.09it/s]
 35%|███▍      | 129523/371472 [10:17:50<20:54:51,  3.21it/s]
 35%|███▍      | 129524/371472 [10:17:50<20:42:54,  3.24it/s]
 35%|███▍      | 129525/371472 [10:17:50<22:39:09,  2.97it/s]
 35%|███▍      | 129526/371472 [10:17:51<22:02:43,  3.05it/s]
 35%|███▍      | 129527/371472 [10:17:51<20:46:11,  3.24it/s]
 35%|███▍      | 129528/371472 [10:17:51<21:02:17,  3.19it/s]
 35%|███▍      | 129529/371472 [10:17:52<20:23:26,  3.30it/s]
 35%|███▍      | 129530/371472 [10:17:52<19:36:03,  3.43it/s]
 35%|███▍      | 129531/371472 [10:17:52<18:58:05,  3.54it/s]
 35%|███▍      | 129532/371472 [10:17:53<21:14:23,  3.16it/s]
 35%|███▍      | 129533/371472 [10:17:53<19:43:58,  3.41it/s]
 35%|███▍      | 129534/371472 [10:17:53<18:37:33,  3.61it/s]
 35%|███▍      | 129535/371472 [10:17:53<18:59:49,  3.54it/s]
 35%|███▍      | 129536/371472 [10:17:54<18:48:10,  3.57it/s]
 35%|███▍      | 129537/371472 [10:17:54<18:04:06,  3.72it/s]
 35%|███▍      | 129538/371472 [10:17:54<19:30:35,  3.44it/s]
 35%|███▍      | 129539/371472 [10:17:54<19:01:47,  3.53it/s]
 35%|███▍      | 129540/371472 [10:17:55<19:04:09,  3.52it/s]
                                                             
{'loss': 3.2811, 'learning_rate': 6.864670645779912e-07, 'epoch': 5.58}

 35%|███▍      | 129540/371472 [10:17:55<19:04:09,  3.52it/s]
 35%|███▍      | 129541/371472 [10:17:55<19:21:28,  3.47it/s]
 35%|███▍      | 129542/371472 [10:17:55<19:41:17,  3.41it/s]
 35%|███▍      | 129543/371472 [10:17:56<19:05:37,  3.52it/s]
 35%|███▍      | 129544/371472 [10:17:56<19:41:38,  3.41it/s]
 35%|███▍      | 129545/371472 [10:17:56<18:54:33,  3.55it/s]
 35%|███▍      | 129546/371472 [10:17:56<19:19:49,  3.48it/s]
 35%|███▍      | 129547/371472 [10:17:57<19:54:53,  3.37it/s]
 35%|███▍      | 129548/371472 [10:17:57<20:05:12,  3.35it/s]
 35%|███▍      | 129549/371472 [10:17:57<19:48:09,  3.39it/s]
 35%|███▍      | 129550/371472 [10:17:58<18:42:36,  3.59it/s]
 35%|███▍      | 129551/371472 [10:17:58<18:18:39,  3.67it/s]
 35%|███▍      | 129552/371472 [10:17:58<18:32:23,  3.62it/s]
 35%|███▍      | 129553/371472 [10:17:58<19:23:27,  3.47it/s]
 35%|███▍      | 129554/371472 [10:17:59<19:01:11,  3.53it/s]
 35%|███▍      | 129555/371472 [10:17:59<18:48:36,  3.57it/s]
 35%|███▍      | 129556/371472 [10:17:59<19:41:42,  3.41it/s]
 35%|███▍      | 129557/371472 [10:18:00<19:24:17,  3.46it/s]
 35%|███▍      | 129558/371472 [10:18:00<18:31:24,  3.63it/s]
 35%|███▍      | 129559/371472 [10:18:00<18:18:47,  3.67it/s]
 35%|███▍      | 129560/371472 [10:18:00<18:12:27,  3.69it/s]
                                                             
{'loss': 3.1129, 'learning_rate': 6.864185826025124e-07, 'epoch': 5.58}

 35%|███▍      | 129560/371472 [10:18:00<18:12:27,  3.69it/s]
 35%|███▍      | 129561/371472 [10:18:01<17:56:36,  3.74it/s]
 35%|███▍      | 129562/371472 [10:18:01<17:25:13,  3.86it/s]
 35%|███▍      | 129563/371472 [10:18:01<19:36:37,  3.43it/s]
 35%|███▍      | 129564/371472 [10:18:02<19:11:32,  3.50it/s]
 35%|███▍      | 129565/371472 [10:18:02<19:28:44,  3.45it/s]
 35%|███▍      | 129566/371472 [10:18:02<19:42:13,  3.41it/s]
 35%|███▍      | 129567/371472 [10:18:02<18:53:09,  3.56it/s]
 35%|███▍      | 129568/371472 [10:18:03<19:49:41,  3.39it/s]
 35%|███▍      | 129569/371472 [10:18:03<20:16:57,  3.31it/s]
 35%|███▍      | 129570/371472 [10:18:03<18:47:20,  3.58it/s]
 35%|███▍      | 129571/371472 [10:18:04<18:54:53,  3.55it/s]
 35%|███▍      | 129572/371472 [10:18:04<18:36:56,  3.61it/s]
 35%|███▍      | 129573/371472 [10:18:04<19:21:19,  3.47it/s]
 35%|███▍      | 129574/371472 [10:18:04<19:29:50,  3.45it/s]
 35%|███▍      | 129575/371472 [10:18:05<19:04:33,  3.52it/s]
 35%|███▍      | 129576/371472 [10:18:05<19:17:15,  3.48it/s]
 35%|███▍      | 129577/371472 [10:18:05<18:13:13,  3.69it/s]
 35%|███▍      | 129578/371472 [10:18:05<18:06:17,  3.71it/s]
 35%|███▍      | 129579/371472 [10:18:06<17:57:20,  3.74it/s]
 35%|███▍      | 129580/371472 [10:18:06<17:58:52,  3.74it/s]
                                                             
{'loss': 3.3175, 'learning_rate': 6.863701006270336e-07, 'epoch': 5.58}

 35%|███▍      | 129580/371472 [10:18:06<17:58:52,  3.74it/s]
 35%|███▍      | 129581/371472 [10:18:06<18:05:53,  3.71it/s]
 35%|███▍      | 129582/371472 [10:18:07<18:40:08,  3.60it/s]
 35%|███▍      | 129583/371472 [10:18:07<18:08:59,  3.70it/s]
 35%|███▍      | 129584/371472 [10:18:07<18:33:03,  3.62it/s]
 35%|███▍      | 129585/371472 [10:18:07<17:48:46,  3.77it/s]
 35%|███▍      | 129586/371472 [10:18:08<18:01:49,  3.73it/s]
 35%|███▍      | 129587/371472 [10:18:08<18:52:42,  3.56it/s]
 35%|███▍      | 129588/371472 [10:18:08<19:34:14,  3.43it/s]
 35%|███▍      | 129589/371472 [10:18:09<18:38:14,  3.61it/s]
 35%|███▍      | 129590/371472 [10:18:09<19:11:04,  3.50it/s]
 35%|███▍      | 129591/371472 [10:18:09<19:05:09,  3.52it/s]
 35%|███▍      | 129592/371472 [10:18:09<18:39:43,  3.60it/s]
 35%|███▍      | 129593/371472 [10:18:10<18:00:56,  3.73it/s]
 35%|███▍      | 129594/371472 [10:18:10<17:49:22,  3.77it/s]
 35%|███▍      | 129595/371472 [10:18:10<18:13:32,  3.69it/s]
 35%|███▍      | 129596/371472 [10:18:10<18:16:44,  3.68it/s]
 35%|███▍      | 129597/371472 [10:18:11<17:37:18,  3.81it/s]
 35%|███▍      | 129598/371472 [10:18:11<17:22:06,  3.87it/s]
 35%|███▍      | 129599/371472 [10:18:11<17:52:13,  3.76it/s]
 35%|███▍      | 129600/371472 [10:18:12<20:05:51,  3.34it/s]
                                                             
{'loss': 3.3308, 'learning_rate': 6.863216186515546e-07, 'epoch': 5.58}

 35%|███▍      | 129600/371472 [10:18:12<20:05:51,  3.34it/s]
 35%|███▍      | 129601/371472 [10:18:12<20:26:25,  3.29it/s]
 35%|███▍      | 129602/371472 [10:18:12<19:24:23,  3.46it/s]
 35%|███▍      | 129603/371472 [10:18:12<18:53:16,  3.56it/s]
 35%|███▍      | 129604/371472 [10:18:13<19:45:34,  3.40it/s]
 35%|███▍      | 129605/371472 [10:18:13<19:43:39,  3.41it/s]
 35%|███▍      | 129606/371472 [10:18:13<19:05:39,  3.52it/s]
 35%|███▍      | 129607/371472 [10:18:14<20:14:15,  3.32it/s]
 35%|███▍      | 129608/371472 [10:18:14<21:15:27,  3.16it/s]
 35%|███▍      | 129609/371472 [10:18:14<19:44:51,  3.40it/s]
 35%|███▍      | 129610/371472 [10:18:14<18:55:08,  3.55it/s]
 35%|███▍      | 129611/371472 [10:18:15<19:41:22,  3.41it/s]
 35%|███▍      | 129612/371472 [10:18:15<20:46:36,  3.23it/s]
 35%|███▍      | 129613/371472 [10:18:15<19:41:25,  3.41it/s]
 35%|███▍      | 129614/371472 [10:18:16<19:49:08,  3.39it/s]
 35%|███▍      | 129615/371472 [10:18:16<20:37:01,  3.26it/s]
 35%|███▍      | 129616/371472 [10:18:16<20:11:14,  3.33it/s]
 35%|███▍      | 129617/371472 [10:18:17<20:04:12,  3.35it/s]
 35%|███▍      | 129618/371472 [10:18:17<19:46:06,  3.40it/s]
 35%|███▍      | 129619/371472 [10:18:17<18:41:52,  3.59it/s]
 35%|███▍      | 129620/371472 [10:18:17<18:24:26,  3.65it/s]
                                                             
{'loss': 3.269, 'learning_rate': 6.862731366760757e-07, 'epoch': 5.58}

 35%|███▍      | 129620/371472 [10:18:17<18:24:26,  3.65it/s]
 35%|███▍      | 129621/371472 [10:18:18<19:20:13,  3.47it/s]
 35%|███▍      | 129622/371472 [10:18:18<19:45:33,  3.40it/s]
 35%|███▍      | 129623/371472 [10:18:18<19:42:36,  3.41it/s]
 35%|███▍      | 129624/371472 [10:18:19<19:23:16,  3.47it/s]
 35%|███▍      | 129625/371472 [10:18:19<19:05:18,  3.52it/s]
 35%|███▍      | 129626/371472 [10:18:19<18:31:06,  3.63it/s]
 35%|███▍      | 129627/371472 [10:18:19<18:37:43,  3.61it/s]
 35%|███▍      | 129628/371472 [10:18:20<19:06:44,  3.51it/s]
 35%|███▍      | 129629/371472 [10:18:20<18:55:15,  3.55it/s]
 35%|███▍      | 129630/371472 [10:18:20<18:57:58,  3.54it/s]
 35%|███▍      | 129631/371472 [10:18:21<19:37:26,  3.42it/s]
 35%|███▍      | 129632/371472 [10:18:21<19:33:16,  3.44it/s]
 35%|███▍      | 129633/371472 [10:18:21<18:55:07,  3.55it/s]
 35%|███▍      | 129634/371472 [10:18:21<18:11:01,  3.69it/s]
 35%|███▍      | 129635/371472 [10:18:22<17:34:39,  3.82it/s]
 35%|███▍      | 129636/371472 [10:18:22<17:08:52,  3.92it/s]
 35%|███▍      | 129637/371472 [10:18:22<18:42:04,  3.59it/s]
 35%|███▍      | 129638/371472 [10:18:23<19:23:20,  3.46it/s]
 35%|███▍      | 129639/371472 [10:18:23<21:08:41,  3.18it/s]
 35%|███▍      | 129640/371472 [10:18:23<20:24:17,  3.29it/s]
                                                             
{'loss': 3.404, 'learning_rate': 6.862246547005969e-07, 'epoch': 5.58}

 35%|███▍      | 129640/371472 [10:18:23<20:24:17,  3.29it/s]
 35%|███▍      | 129641/371472 [10:18:23<20:21:03,  3.30it/s]
 35%|███▍      | 129642/371472 [10:18:24<19:29:31,  3.45it/s]
 35%|███▍      | 129643/371472 [10:18:24<19:46:04,  3.40it/s]
 35%|███▍      | 129644/371472 [10:18:24<18:57:37,  3.54it/s]
 35%|███▍      | 129645/371472 [10:18:25<18:52:05,  3.56it/s]
 35%|███▍      | 129646/371472 [10:18:25<19:29:01,  3.45it/s]
 35%|███▍      | 129647/371472 [10:18:25<18:47:22,  3.58it/s]
 35%|███▍      | 129648/371472 [10:18:25<18:17:50,  3.67it/s]
 35%|███▍      | 129649/371472 [10:18:26<19:39:48,  3.42it/s]
 35%|███▍      | 129650/371472 [10:18:26<19:14:06,  3.49it/s]
 35%|███▍      | 129651/371472 [10:18:26<19:37:08,  3.42it/s]
 35%|███▍      | 129652/371472 [10:18:27<19:16:47,  3.48it/s]
 35%|███▍      | 129653/371472 [10:18:27<19:01:12,  3.53it/s]
 35%|███▍      | 129654/371472 [10:18:27<18:42:15,  3.59it/s]
 35%|███▍      | 129655/371472 [10:18:27<18:56:36,  3.55it/s]
 35%|███▍      | 129656/371472 [10:18:28<18:33:44,  3.62it/s]
 35%|███▍      | 129657/371472 [10:18:28<18:05:29,  3.71it/s]
 35%|███▍      | 129658/371472 [10:18:28<18:06:06,  3.71it/s]
 35%|███▍      | 129659/371472 [10:18:28<17:42:05,  3.79it/s]
 35%|███▍      | 129660/371472 [10:18:29<18:11:31,  3.69it/s]
                                                             
{'loss': 3.3046, 'learning_rate': 6.86176172725118e-07, 'epoch': 5.58}

 35%|███▍      | 129660/371472 [10:18:29<18:11:31,  3.69it/s]
 35%|███▍      | 129661/371472 [10:18:29<17:51:02,  3.76it/s]
 35%|███▍      | 129662/371472 [10:18:29<17:41:10,  3.80it/s]
 35%|███▍      | 129663/371472 [10:18:30<18:27:25,  3.64it/s]
 35%|███▍      | 129664/371472 [10:18:30<18:11:56,  3.69it/s]
 35%|███▍      | 129665/371472 [10:18:30<18:01:53,  3.73it/s]
 35%|███▍      | 129666/371472 [10:18:30<18:32:48,  3.62it/s]
 35%|███▍      | 129667/371472 [10:18:31<18:01:32,  3.73it/s]
 35%|███▍      | 129668/371472 [10:18:31<17:17:11,  3.89it/s]
 35%|███▍      | 129669/371472 [10:18:31<17:43:12,  3.79it/s]
 35%|███▍      | 129670/371472 [10:18:31<17:48:13,  3.77it/s]
 35%|███▍      | 129671/371472 [10:18:32<17:49:44,  3.77it/s]
 35%|███▍      | 129672/371472 [10:18:32<19:08:14,  3.51it/s]
 35%|███▍      | 129673/371472 [10:18:32<18:29:34,  3.63it/s]
 35%|███▍      | 129674/371472 [10:18:32<17:44:04,  3.79it/s]
 35%|███▍      | 129675/371472 [10:18:33<18:52:17,  3.56it/s]
 35%|███▍      | 129676/371472 [10:18:33<19:07:19,  3.51it/s]
 35%|███▍      | 129677/371472 [10:18:33<19:11:05,  3.50it/s]
 35%|███▍      | 129678/371472 [10:18:34<18:43:30,  3.59it/s]
 35%|███▍      | 129679/371472 [10:18:34<18:04:41,  3.72it/s]
 35%|███▍      | 129680/371472 [10:18:34<17:56:19,  3.74it/s]
                                                             
{'loss': 3.153, 'learning_rate': 6.86127690749639e-07, 'epoch': 5.59}

 35%|███▍      | 129680/371472 [10:18:34<17:56:19,  3.74it/s]
 35%|███▍      | 129681/371472 [10:18:34<18:04:53,  3.71it/s]
 35%|███▍      | 129682/371472 [10:18:35<17:35:33,  3.82it/s]
 35%|███▍      | 129683/371472 [10:18:35<16:57:59,  3.96it/s]
 35%|███▍      | 129684/371472 [10:18:35<16:25:54,  4.09it/s]
 35%|███▍      | 129685/371472 [10:18:35<17:22:36,  3.87it/s]
 35%|███▍      | 129686/371472 [10:18:36<18:34:02,  3.62it/s]
 35%|███▍      | 129687/371472 [10:18:36<18:54:14,  3.55it/s]
 35%|███▍      | 129688/371472 [10:18:36<19:02:44,  3.53it/s]
 35%|███▍      | 129689/371472 [10:18:37<20:15:44,  3.31it/s]
 35%|███▍      | 129690/371472 [10:18:37<19:27:50,  3.45it/s]
 35%|███▍      | 129691/371472 [10:18:37<19:44:19,  3.40it/s]
 35%|███▍      | 129692/371472 [10:18:38<19:40:53,  3.41it/s]
 35%|███▍      | 129693/371472 [10:18:38<19:13:56,  3.49it/s]
 35%|███▍      | 129694/371472 [10:18:38<18:31:57,  3.62it/s]
 35%|███▍      | 129695/371472 [10:18:38<18:49:36,  3.57it/s]
 35%|███▍      | 129696/371472 [10:18:39<18:48:00,  3.57it/s]
 35%|███▍      | 129697/371472 [10:18:39<18:24:48,  3.65it/s]
 35%|███▍      | 129698/371472 [10:18:39<17:58:59,  3.73it/s]
 35%|███▍      | 129699/371472 [10:18:39<17:22:13,  3.87it/s]
 35%|███▍      | 129700/371472 [10:18:40<17:06:37,  3.93it/s]
                                                             
{'loss': 3.0212, 'learning_rate': 6.860792087741601e-07, 'epoch': 5.59}

 35%|███▍      | 129700/371472 [10:18:40<17:06:37,  3.93it/s]
 35%|███▍      | 129701/371472 [10:18:40<17:02:50,  3.94it/s]
 35%|███▍      | 129702/371472 [10:18:40<16:34:47,  4.05it/s]
 35%|███▍      | 129703/371472 [10:18:40<17:13:33,  3.90it/s]
 35%|███▍      | 129704/371472 [10:18:41<18:08:19,  3.70it/s]
 35%|███▍      | 129705/371472 [10:18:41<19:15:38,  3.49it/s]
 35%|███▍      | 129706/371472 [10:18:41<19:51:29,  3.38it/s]
 35%|███▍      | 129707/371472 [10:18:42<19:49:16,  3.39it/s]
 35%|███▍      | 129708/371472 [10:18:42<20:54:07,  3.21it/s]
 35%|███▍      | 129709/371472 [10:18:42<19:23:54,  3.46it/s]
 35%|███▍      | 129710/371472 [10:18:42<18:57:39,  3.54it/s]
 35%|███▍      | 129711/371472 [10:18:43<18:21:16,  3.66it/s]
 35%|███▍      | 129712/371472 [10:18:43<19:49:40,  3.39it/s]
 35%|███▍      | 129713/371472 [10:18:43<20:18:35,  3.31it/s]
 35%|███▍      | 129714/371472 [10:18:44<20:17:45,  3.31it/s]
 35%|███▍      | 129715/371472 [10:18:44<20:02:20,  3.35it/s]
 35%|███▍      | 129716/371472 [10:18:44<18:59:24,  3.54it/s]
 35%|███▍      | 129717/371472 [10:18:44<18:29:33,  3.63it/s]
 35%|███▍      | 129718/371472 [10:18:45<18:12:10,  3.69it/s]
 35%|███▍      | 129719/371472 [10:18:45<18:41:28,  3.59it/s]
 35%|███▍      | 129720/371472 [10:18:45<19:53:54,  3.37it/s]
                                                             
{'loss': 3.0432, 'learning_rate': 6.860307267986813e-07, 'epoch': 5.59}

 35%|███▍      | 129720/371472 [10:18:45<19:53:54,  3.37it/s]
 35%|███▍      | 129721/371472 [10:18:46<19:14:04,  3.49it/s]
 35%|███▍      | 129722/371472 [10:18:46<18:44:32,  3.58it/s]
 35%|███▍      | 129723/371472 [10:18:46<17:59:25,  3.73it/s]
 35%|███▍      | 129724/371472 [10:18:46<18:39:31,  3.60it/s]
 35%|███▍      | 129725/371472 [10:18:47<17:57:02,  3.74it/s]
 35%|███▍      | 129726/371472 [10:18:47<18:05:56,  3.71it/s]
 35%|███▍      | 129727/371472 [10:18:47<17:29:59,  3.84it/s]
 35%|███▍      | 129728/371472 [10:18:47<17:59:38,  3.73it/s]
 35%|███▍      | 129729/371472 [10:18:48<19:04:24,  3.52it/s]
 35%|███▍      | 129730/371472 [10:18:48<18:17:43,  3.67it/s]
 35%|███▍      | 129731/371472 [10:18:48<17:57:10,  3.74it/s]
 35%|███▍      | 129732/371472 [10:18:49<18:13:04,  3.69it/s]
 35%|███▍      | 129733/371472 [10:18:49<17:46:06,  3.78it/s]
 35%|███▍      | 129734/371472 [10:18:49<18:11:04,  3.69it/s]
 35%|███▍      | 129735/371472 [10:18:49<18:13:06,  3.69it/s]
 35%|███▍      | 129736/371472 [10:18:50<18:28:21,  3.64it/s]
 35%|███▍      | 129737/371472 [10:18:50<18:54:47,  3.55it/s]
 35%|███▍      | 129738/371472 [10:18:50<19:50:15,  3.38it/s]
 35%|███▍      | 129739/371472 [10:18:51<21:08:57,  3.17it/s]
 35%|███▍      | 129740/371472 [10:18:51<21:00:48,  3.20it/s]
                                                             
{'loss': 3.3084, 'learning_rate': 6.859822448232025e-07, 'epoch': 5.59}

 35%|███▍      | 129740/371472 [10:18:51<21:00:48,  3.20it/s]
 35%|███▍      | 129741/371472 [10:18:51<19:46:43,  3.39it/s]
 35%|███▍      | 129742/371472 [10:18:52<28:18:27,  2.37it/s]
 35%|███▍      | 129743/371472 [10:18:52<24:46:57,  2.71it/s]
 35%|███▍      | 129744/371472 [10:18:52<23:28:03,  2.86it/s]
 35%|███▍      | 129745/371472 [10:18:53<21:43:42,  3.09it/s]
 35%|███▍      | 129746/371472 [10:18:53<20:55:10,  3.21it/s]
 35%|███▍      | 129747/371472 [10:18:53<20:15:06,  3.32it/s]
 35%|███▍      | 129748/371472 [10:18:54<19:24:47,  3.46it/s]
 35%|███▍      | 129749/371472 [10:18:54<19:38:10,  3.42it/s]
 35%|███▍      | 129750/371472 [10:18:54<19:01:33,  3.53it/s]
 35%|███▍      | 129751/371472 [10:18:54<18:14:58,  3.68it/s]
 35%|███▍      | 129752/371472 [10:18:55<18:17:15,  3.67it/s]
 35%|███▍      | 129753/371472 [10:18:55<17:53:20,  3.75it/s]
 35%|███▍      | 129754/371472 [10:18:55<22:01:38,  3.05it/s]
 35%|███▍      | 129755/371472 [10:18:56<22:21:50,  3.00it/s]
 35%|███▍      | 129756/371472 [10:18:56<21:56:41,  3.06it/s]
 35%|███▍      | 129757/371472 [10:18:56<21:23:01,  3.14it/s]
 35%|███▍      | 129758/371472 [10:18:57<20:00:12,  3.36it/s]
 35%|███▍      | 129759/371472 [10:18:57<18:51:05,  3.56it/s]
 35%|███▍      | 129760/371472 [10:18:57<18:32:06,  3.62it/s]
                                                             
{'loss': 3.1186, 'learning_rate': 6.859337628477234e-07, 'epoch': 5.59}

 35%|███▍      | 129760/371472 [10:18:57<18:32:06,  3.62it/s]
 35%|███▍      | 129761/371472 [10:18:57<19:17:38,  3.48it/s]
 35%|███▍      | 129762/371472 [10:18:58<19:36:46,  3.42it/s]
 35%|███▍      | 129763/371472 [10:18:58<18:41:06,  3.59it/s]
 35%|███▍      | 129764/371472 [10:18:58<18:25:19,  3.64it/s]
 35%|███▍      | 129765/371472 [10:18:59<19:48:35,  3.39it/s]
 35%|███▍      | 129766/371472 [10:18:59<20:56:58,  3.20it/s]
 35%|███▍      | 129767/371472 [10:18:59<20:00:40,  3.36it/s]
 35%|███▍      | 129768/371472 [10:18:59<18:55:03,  3.55it/s]
 35%|███▍      | 129769/371472 [10:19:00<18:33:25,  3.62it/s]
 35%|███▍      | 129770/371472 [10:19:00<20:04:50,  3.34it/s]
 35%|███▍      | 129771/371472 [10:19:00<19:09:04,  3.51it/s]
 35%|███▍      | 129772/371472 [10:19:01<18:30:58,  3.63it/s]
 35%|███▍      | 129773/371472 [10:19:01<17:37:25,  3.81it/s]
 35%|███▍      | 129774/371472 [10:19:01<17:22:58,  3.86it/s]
 35%|███▍      | 129775/371472 [10:19:01<17:09:42,  3.91it/s]
 35%|███▍      | 129776/371472 [10:19:02<17:20:28,  3.87it/s]
 35%|███▍      | 129777/371472 [10:19:02<17:49:16,  3.77it/s]
 35%|███▍      | 129778/371472 [10:19:02<18:33:04,  3.62it/s]
 35%|███▍      | 129779/371472 [10:19:02<18:06:03,  3.71it/s]
 35%|███▍      | 129780/371472 [10:19:03<17:48:48,  3.77it/s]
                                                             
{'loss': 3.1652, 'learning_rate': 6.858852808722446e-07, 'epoch': 5.59}

 35%|███▍      | 129780/371472 [10:19:03<17:48:48,  3.77it/s]
 35%|███▍      | 129781/371472 [10:19:03<18:39:48,  3.60it/s]
 35%|███▍      | 129782/371472 [10:19:03<19:15:04,  3.49it/s]
 35%|███▍      | 129783/371472 [10:19:04<18:57:49,  3.54it/s]
 35%|███▍      | 129784/371472 [10:19:04<18:44:39,  3.58it/s]
 35%|███▍      | 129785/371472 [10:19:04<19:05:21,  3.52it/s]
 35%|███▍      | 129786/371472 [10:19:04<19:18:46,  3.48it/s]
 35%|███▍      | 129787/371472 [10:19:05<18:49:49,  3.57it/s]
 35%|███▍      | 129788/371472 [10:19:05<18:43:10,  3.59it/s]
 35%|███▍      | 129789/371472 [10:19:05<18:07:29,  3.70it/s]
 35%|███▍      | 129790/371472 [10:19:05<18:12:59,  3.69it/s]
 35%|███▍      | 129791/371472 [10:19:06<17:54:10,  3.75it/s]
 35%|███▍      | 129792/371472 [10:19:06<18:16:47,  3.67it/s]
 35%|███▍      | 129793/371472 [10:19:06<18:59:54,  3.53it/s]
 35%|███▍      | 129794/371472 [10:19:07<19:23:42,  3.46it/s]
 35%|███▍      | 129795/371472 [10:19:07<19:09:57,  3.50it/s]
 35%|███▍      | 129796/371472 [10:19:07<19:53:45,  3.37it/s]
 35%|███▍      | 129797/371472 [10:19:07<19:25:32,  3.46it/s]
 35%|███▍      | 129798/371472 [10:19:08<19:11:42,  3.50it/s]
 35%|███▍      | 129799/371472 [10:19:08<20:26:39,  3.28it/s]
 35%|███▍      | 129800/371472 [10:19:09<23:38:32,  2.84it/s]
                                                             
{'loss': 3.161, 'learning_rate': 6.858367988967657e-07, 'epoch': 5.59}

 35%|███▍      | 129800/371472 [10:19:09<23:38:32,  2.84it/s]
 35%|███▍      | 129801/371472 [10:19:09<21:42:48,  3.09it/s]
 35%|███▍      | 129802/371472 [10:19:09<21:13:01,  3.16it/s]
 35%|███▍      | 129803/371472 [10:19:09<20:30:27,  3.27it/s]
 35%|███▍      | 129804/371472 [10:19:10<19:39:57,  3.41it/s]
 35%|███▍      | 129805/371472 [10:19:10<19:17:55,  3.48it/s]
 35%|███▍      | 129806/371472 [10:19:10<20:09:43,  3.33it/s]
 35%|███▍      | 129807/371472 [10:19:11<19:33:04,  3.43it/s]
 35%|███▍      | 129808/371472 [10:19:11<19:23:42,  3.46it/s]
 35%|███▍      | 129809/371472 [10:19:11<19:24:47,  3.46it/s]
 35%|███▍      | 129810/371472 [10:19:11<19:12:12,  3.50it/s]
 35%|███▍      | 129811/371472 [10:19:12<20:04:30,  3.34it/s]
 35%|███▍      | 129812/371472 [10:19:12<19:10:39,  3.50it/s]
 35%|███▍      | 129813/371472 [10:19:12<18:28:44,  3.63it/s]
 35%|███▍      | 129814/371472 [10:19:12<18:05:04,  3.71it/s]
 35%|███▍      | 129815/371472 [10:19:13<17:59:34,  3.73it/s]
 35%|███▍      | 129816/371472 [10:19:13<18:56:35,  3.54it/s]
 35%|███▍      | 129817/371472 [10:19:13<19:12:09,  3.50it/s]
 35%|███▍      | 129818/371472 [10:19:14<19:08:42,  3.51it/s]
 35%|███▍      | 129819/371472 [10:19:14<18:47:01,  3.57it/s]
 35%|███▍      | 129820/371472 [10:19:14<18:03:47,  3.72it/s]
                                                             
{'loss': 3.2219, 'learning_rate': 6.857883169212869e-07, 'epoch': 5.59}

 35%|███▍      | 129820/371472 [10:19:14<18:03:47,  3.72it/s]
 35%|███▍      | 129821/371472 [10:19:14<17:58:33,  3.73it/s]
 35%|███▍      | 129822/371472 [10:19:15<17:36:12,  3.81it/s]
 35%|███▍      | 129823/371472 [10:19:15<19:05:41,  3.52it/s]
 35%|███▍      | 129824/371472 [10:19:15<19:04:48,  3.52it/s]
 35%|███▍      | 129825/371472 [10:19:16<18:50:07,  3.56it/s]
 35%|███▍      | 129826/371472 [10:19:16<18:50:11,  3.56it/s]
 35%|███▍      | 129827/371472 [10:19:16<19:26:44,  3.45it/s]
 35%|███▍      | 129828/371472 [10:19:16<18:38:58,  3.60it/s]
 35%|███▍      | 129829/371472 [10:19:17<18:24:13,  3.65it/s]
 35%|███▍      | 129830/371472 [10:19:17<18:56:23,  3.54it/s]
 35%|███▍      | 129831/371472 [10:19:17<18:55:34,  3.55it/s]
 35%|███▍      | 129832/371472 [10:19:17<18:03:30,  3.72it/s]
 35%|███▍      | 129833/371472 [10:19:18<18:18:39,  3.67it/s]
 35%|███▍      | 129834/371472 [10:19:18<18:09:12,  3.70it/s]
 35%|███▍      | 129835/371472 [10:19:18<18:17:57,  3.67it/s]
 35%|███▍      | 129836/371472 [10:19:19<20:01:06,  3.35it/s]
 35%|███▍      | 129837/371472 [10:19:19<20:26:58,  3.28it/s]
 35%|███▍      | 129838/371472 [10:19:19<19:48:56,  3.39it/s]
 35%|███▍      | 129839/371472 [10:19:20<19:32:58,  3.43it/s]
 35%|███▍      | 129840/371472 [10:19:20<19:04:18,  3.52it/s]
                                                             
{'loss': 3.2173, 'learning_rate': 6.857398349458078e-07, 'epoch': 5.59}

 35%|███▍      | 129840/371472 [10:19:20<19:04:18,  3.52it/s]
 35%|███▍      | 129841/371472 [10:19:20<18:27:45,  3.64it/s]
 35%|███▍      | 129842/371472 [10:19:20<18:13:37,  3.68it/s]
 35%|███▍      | 129843/371472 [10:19:21<18:45:45,  3.58it/s]
 35%|███▍      | 129844/371472 [10:19:21<18:43:28,  3.58it/s]
 35%|███▍      | 129845/371472 [10:19:21<18:33:17,  3.62it/s]
 35%|███▍      | 129846/371472 [10:19:21<19:31:50,  3.44it/s]
 35%|███▍      | 129847/371472 [10:19:22<19:55:45,  3.37it/s]
 35%|███▍      | 129848/371472 [10:19:22<18:37:07,  3.60it/s]
 35%|███▍      | 129849/371472 [10:19:22<18:09:21,  3.70it/s]
 35%|███▍      | 129850/371472 [10:19:23<18:27:14,  3.64it/s]
 35%|███▍      | 129851/371472 [10:19:23<18:32:47,  3.62it/s]
 35%|███▍      | 129852/371472 [10:19:23<18:09:27,  3.70it/s]
 35%|███▍      | 129853/371472 [10:19:23<18:05:28,  3.71it/s]
 35%|███▍      | 129854/371472 [10:19:24<17:57:59,  3.74it/s]
 35%|███▍      | 129855/371472 [10:19:24<18:58:16,  3.54it/s]
 35%|███▍      | 129856/371472 [10:19:24<18:58:45,  3.54it/s]
 35%|███▍      | 129857/371472 [10:19:25<19:11:15,  3.50it/s]
 35%|███▍      | 129858/371472 [10:19:25<19:12:21,  3.49it/s]
 35%|███▍      | 129859/371472 [10:19:25<19:01:14,  3.53it/s]
 35%|███▍      | 129860/371472 [10:19:25<19:03:35,  3.52it/s]
                                                             
{'loss': 3.1586, 'learning_rate': 6.85691352970329e-07, 'epoch': 5.59}

 35%|███▍      | 129860/371472 [10:19:25<19:03:35,  3.52it/s]
 35%|███▍      | 129861/371472 [10:19:26<20:40:03,  3.25it/s]
 35%|███▍      | 129862/371472 [10:19:26<19:53:45,  3.37it/s]
 35%|███▍      | 129863/371472 [10:19:26<19:31:19,  3.44it/s]
 35%|███▍      | 129864/371472 [10:19:27<19:00:23,  3.53it/s]
 35%|███▍      | 129865/371472 [10:19:27<19:09:33,  3.50it/s]
 35%|███▍      | 129866/371472 [10:19:27<19:01:14,  3.53it/s]
 35%|███▍      | 129867/371472 [10:19:27<18:48:58,  3.57it/s]
 35%|███▍      | 129868/371472 [10:19:28<19:27:04,  3.45it/s]
 35%|███▍      | 129869/371472 [10:19:28<20:03:24,  3.35it/s]
 35%|███▍      | 129870/371472 [10:19:28<19:56:58,  3.36it/s]
 35%|███▍      | 129871/371472 [10:19:29<19:27:57,  3.45it/s]
 35%|███▍      | 129872/371472 [10:19:29<20:39:04,  3.25it/s]
 35%|███▍      | 129873/371472 [10:19:29<20:12:20,  3.32it/s]
 35%|███▍      | 129874/371472 [10:19:30<19:52:01,  3.38it/s]
 35%|███▍      | 129875/371472 [10:19:30<23:51:40,  2.81it/s]
 35%|███▍      | 129876/371472 [10:19:30<22:18:00,  3.01it/s]
 35%|███▍      | 129877/371472 [10:19:31<20:50:41,  3.22it/s]
 35%|███▍      | 129878/371472 [10:19:31<19:57:19,  3.36it/s]
 35%|███▍      | 129879/371472 [10:19:31<20:42:25,  3.24it/s]
 35%|███▍      | 129880/371472 [10:19:31<19:51:52,  3.38it/s]
                                                             
{'loss': 3.0959, 'learning_rate': 6.856428709948502e-07, 'epoch': 5.59}

 35%|███▍      | 129880/371472 [10:19:31<19:51:52,  3.38it/s]
 35%|███▍      | 129881/371472 [10:19:32<18:49:31,  3.56it/s]
 35%|███▍      | 129882/371472 [10:19:32<19:07:55,  3.51it/s]
 35%|███▍      | 129883/371472 [10:19:32<20:48:52,  3.22it/s]
 35%|███▍      | 129884/371472 [10:19:33<20:51:08,  3.22it/s]
 35%|███▍      | 129885/371472 [10:19:33<19:18:02,  3.48it/s]
 35%|███▍      | 129886/371472 [10:19:33<19:04:19,  3.52it/s]
 35%|███▍      | 129887/371472 [10:19:33<19:49:51,  3.38it/s]
 35%|███▍      | 129888/371472 [10:19:34<19:26:43,  3.45it/s]
 35%|███▍      | 129889/371472 [10:19:34<18:40:12,  3.59it/s]
 35%|███▍      | 129890/371472 [10:19:34<19:15:32,  3.48it/s]
 35%|███▍      | 129891/371472 [10:19:35<18:23:42,  3.65it/s]
 35%|███▍      | 129892/371472 [10:19:35<18:13:26,  3.68it/s]
 35%|███▍      | 129893/371472 [10:19:35<19:59:54,  3.36it/s]
 35%|███▍      | 129894/371472 [10:19:36<20:23:31,  3.29it/s]
 35%|███▍      | 129895/371472 [10:19:36<21:27:46,  3.13it/s]
 35%|███▍      | 129896/371472 [10:19:36<20:44:59,  3.23it/s]
 35%|███▍      | 129897/371472 [10:19:36<20:53:24,  3.21it/s]
 35%|███▍      | 129898/371472 [10:19:37<19:51:17,  3.38it/s]
 35%|███▍      | 129899/371472 [10:19:37<21:20:33,  3.14it/s]
 35%|███▍      | 129900/371472 [10:19:37<20:35:45,  3.26it/s]
                                                             
{'loss': 3.1031, 'learning_rate': 6.855943890193712e-07, 'epoch': 5.6}

 35%|███▍      | 129900/371472 [10:19:37<20:35:45,  3.26it/s]
 35%|███▍      | 129901/371472 [10:19:38<21:36:29,  3.11it/s]
 35%|███▍      | 129902/371472 [10:19:38<20:01:58,  3.35it/s]
 35%|███▍      | 129903/371472 [10:19:38<19:17:37,  3.48it/s]
 35%|███▍      | 129904/371472 [10:19:38<18:30:57,  3.62it/s]
 35%|███▍      | 129905/371472 [10:19:39<18:43:02,  3.58it/s]
 35%|███▍      | 129906/371472 [10:19:39<18:12:12,  3.69it/s]
 35%|███▍      | 129907/371472 [10:19:39<18:33:31,  3.62it/s]
 35%|███▍      | 129908/371472 [10:19:40<18:38:49,  3.60it/s]
 35%|███▍      | 129909/371472 [10:19:40<19:44:17,  3.40it/s]
 35%|███▍      | 129910/371472 [10:19:40<19:18:15,  3.48it/s]
 35%|███▍      | 129911/371472 [10:19:40<19:03:03,  3.52it/s]
 35%|███▍      | 129912/371472 [10:19:41<18:41:56,  3.59it/s]
 35%|███▍      | 129913/371472 [10:19:41<18:11:23,  3.69it/s]
 35%|███▍      | 129914/371472 [10:19:41<17:30:05,  3.83it/s]
 35%|███▍      | 129915/371472 [10:19:41<17:32:06,  3.83it/s]
 35%|███▍      | 129916/371472 [10:19:42<18:05:27,  3.71it/s]
 35%|███▍      | 129917/371472 [10:19:42<18:09:32,  3.70it/s]
 35%|███▍      | 129918/371472 [10:19:42<17:54:02,  3.75it/s]
 35%|███▍      | 129919/371472 [10:19:43<17:52:26,  3.75it/s]
 35%|███▍      | 129920/371472 [10:19:43<17:26:58,  3.85it/s]
                                                             
{'loss': 3.189, 'learning_rate': 6.855459070438922e-07, 'epoch': 5.6}

 35%|███▍      | 129920/371472 [10:19:43<17:26:58,  3.85it/s]
 35%|███▍      | 129921/371472 [10:19:43<17:16:12,  3.89it/s]
 35%|███▍      | 129922/371472 [10:19:43<17:26:14,  3.85it/s]
 35%|███▍      | 129923/371472 [10:19:44<17:38:00,  3.81it/s]
 35%|███▍      | 129924/371472 [10:19:44<18:23:59,  3.65it/s]
 35%|███▍      | 129925/371472 [10:19:44<17:36:59,  3.81it/s]
 35%|███▍      | 129926/371472 [10:19:44<18:17:25,  3.67it/s]
 35%|███▍      | 129927/371472 [10:19:45<18:06:10,  3.71it/s]
 35%|███▍      | 129928/371472 [10:19:45<17:28:08,  3.84it/s]
 35%|███▍      | 129929/371472 [10:19:45<18:59:50,  3.53it/s]
 35%|███▍      | 129930/371472 [10:19:46<18:35:53,  3.61it/s]
 35%|███▍      | 129931/371472 [10:19:46<21:34:58,  3.11it/s]
 35%|███▍      | 129932/371472 [10:19:46<21:37:49,  3.10it/s]
 35%|███▍      | 129933/371472 [10:19:47<21:42:02,  3.09it/s]
 35%|███▍      | 129934/371472 [10:19:47<21:58:59,  3.05it/s]
 35%|███▍      | 129935/371472 [10:19:47<21:01:54,  3.19it/s]
 35%|███▍      | 129936/371472 [10:19:48<22:41:08,  2.96it/s]
 35%|███▍      | 129937/371472 [10:19:48<21:06:09,  3.18it/s]
 35%|███▍      | 129938/371472 [10:19:48<20:13:54,  3.32it/s]
 35%|███▍      | 129939/371472 [10:19:48<19:34:19,  3.43it/s]
 35%|███▍      | 129940/371472 [10:19:49<21:00:37,  3.19it/s]
                                                             
{'loss': 3.1366, 'learning_rate': 6.854974250684134e-07, 'epoch': 5.6}

 35%|███▍      | 129940/371472 [10:19:49<21:00:37,  3.19it/s]
 35%|███▍      | 129941/371472 [10:19:49<20:56:34,  3.20it/s]
 35%|███▍      | 129942/371472 [10:19:49<20:09:51,  3.33it/s]
 35%|███▍      | 129943/371472 [10:19:50<20:30:13,  3.27it/s]
 35%|███▍      | 129944/371472 [10:19:50<21:36:55,  3.10it/s]
 35%|███▍      | 129945/371472 [10:19:50<20:25:56,  3.28it/s]
 35%|███▍      | 129946/371472 [10:19:51<19:39:18,  3.41it/s]
 35%|███▍      | 129947/371472 [10:19:51<20:11:33,  3.32it/s]
 35%|███▍      | 129948/371472 [10:19:51<19:28:36,  3.44it/s]
 35%|███▍      | 129949/371472 [10:19:52<20:59:45,  3.20it/s]
 35%|███▍      | 129950/371472 [10:19:52<20:03:59,  3.34it/s]
 35%|███▍      | 129951/371472 [10:19:52<19:29:39,  3.44it/s]
 35%|███▍      | 129952/371472 [10:19:52<18:59:59,  3.53it/s]
 35%|███▍      | 129953/371472 [10:19:53<20:33:35,  3.26it/s]
 35%|███▍      | 129954/371472 [10:19:53<20:10:11,  3.33it/s]
 35%|███▍      | 129955/371472 [10:19:53<20:09:22,  3.33it/s]
 35%|███▍      | 129956/371472 [10:19:54<20:43:36,  3.24it/s]
 35%|███▍      | 129957/371472 [10:19:54<20:08:19,  3.33it/s]
 35%|███▍      | 129958/371472 [10:19:54<20:47:08,  3.23it/s]
 35%|███▍      | 129959/371472 [10:19:54<19:16:26,  3.48it/s]
 35%|███▍      | 129960/371472 [10:19:55<18:48:09,  3.57it/s]
                                                             
{'loss': 3.3031, 'learning_rate': 6.854489430929346e-07, 'epoch': 5.6}

 35%|███▍      | 129960/371472 [10:19:55<18:48:09,  3.57it/s]
 35%|███▍      | 129961/371472 [10:19:55<19:30:49,  3.44it/s]
 35%|███▍      | 129962/371472 [10:19:55<19:07:33,  3.51it/s]
 35%|███▍      | 129963/371472 [10:19:56<18:35:51,  3.61it/s]
 35%|███▍      | 129964/371472 [10:19:56<18:22:26,  3.65it/s]
 35%|███▍      | 129965/371472 [10:19:56<18:40:28,  3.59it/s]
 35%|███▍      | 129966/371472 [10:19:56<18:10:23,  3.69it/s]
 35%|███▍      | 129967/371472 [10:19:57<17:54:02,  3.75it/s]
 35%|███▍      | 129968/371472 [10:19:57<17:40:41,  3.79it/s]
 35%|███▍      | 129969/371472 [10:19:57<18:01:01,  3.72it/s]
 35%|███▍      | 129970/371472 [10:19:57<18:51:53,  3.56it/s]
 35%|███▍      | 129971/371472 [10:19:58<18:58:10,  3.54it/s]
 35%|███▍      | 129972/371472 [10:19:58<23:21:45,  2.87it/s]
 35%|███▍      | 129973/371472 [10:19:59<21:11:50,  3.16it/s]
 35%|███▍      | 129974/371472 [10:19:59<20:50:18,  3.22it/s]
 35%|███▍      | 129975/371472 [10:19:59<19:41:06,  3.41it/s]
 35%|███▍      | 129976/371472 [10:19:59<20:52:52,  3.21it/s]
 35%|███▍      | 129977/371472 [10:20:00<20:26:07,  3.28it/s]
 35%|███▍      | 129978/371472 [10:20:00<20:07:32,  3.33it/s]
 35%|███▍      | 129979/371472 [10:20:00<19:27:49,  3.45it/s]
 35%|███▍      | 129980/371472 [10:20:01<18:41:25,  3.59it/s]
                                                             
{'loss': 3.3899, 'learning_rate': 6.854004611174556e-07, 'epoch': 5.6}

 35%|███▍      | 129980/371472 [10:20:01<18:41:25,  3.59it/s]
 35%|███▍      | 129981/371472 [10:20:01<18:32:40,  3.62it/s]
 35%|███▍      | 129982/371472 [10:20:01<17:54:10,  3.75it/s]
 35%|███▍      | 129983/371472 [10:20:01<18:02:10,  3.72it/s]
 35%|███▍      | 129984/371472 [10:20:02<18:04:39,  3.71it/s]
 35%|███▍      | 129985/371472 [10:20:02<17:29:46,  3.83it/s]
 35%|███▍      | 129986/371472 [10:20:02<17:28:51,  3.84it/s]
 35%|███▍      | 129987/371472 [10:20:02<18:17:52,  3.67it/s]
 35%|███▍      | 129988/371472 [10:20:03<17:59:21,  3.73it/s]
 35%|███▍      | 129989/371472 [10:20:03<19:22:48,  3.46it/s]
 35%|███▍      | 129990/371472 [10:20:03<18:56:17,  3.54it/s]
 35%|███▍      | 129991/371472 [10:20:03<18:09:49,  3.69it/s]
 35%|███▍      | 129992/371472 [10:20:04<18:06:58,  3.70it/s]
 35%|███▍      | 129993/371472 [10:20:04<18:32:22,  3.62it/s]
 35%|███▍      | 129994/371472 [10:20:04<19:04:50,  3.52it/s]
 35%|███▍      | 129995/371472 [10:20:05<19:29:09,  3.44it/s]
 35%|███▍      | 129996/371472 [10:20:05<18:48:38,  3.57it/s]
 35%|███▍      | 129997/371472 [10:20:05<17:58:46,  3.73it/s]
 35%|███▍      | 129998/371472 [10:20:05<17:26:27,  3.85it/s]
 35%|███▍      | 129999/371472 [10:20:06<17:28:07,  3.84it/s]
 35%|███▍      | 130000/371472 [10:20:06<17:20:53,  3.87it/s]
                                                             
{'loss': 3.0167, 'learning_rate': 6.853519791419767e-07, 'epoch': 5.6}

 35%|███▍      | 130000/371472 [10:20:06<17:20:53,  3.87it/s]
 35%|███▍      | 130001/371472 [10:20:06<17:12:44,  3.90it/s]
 35%|███▍      | 130002/371472 [10:20:06<17:58:38,  3.73it/s]
 35%|███▍      | 130003/371472 [10:20:07<19:24:53,  3.45it/s]
 35%|███▍      | 130004/371472 [10:20:07<18:29:55,  3.63it/s]
 35%|███▍      | 130005/371472 [10:20:07<18:00:00,  3.73it/s]
 35%|███▍      | 130006/371472 [10:20:08<18:04:31,  3.71it/s]
 35%|███▍      | 130007/371472 [10:20:08<21:25:08,  3.13it/s]
 35%|███▍      | 130008/371472 [10:20:08<21:19:16,  3.15it/s]
 35%|███▍      | 130009/371472 [10:20:09<21:06:36,  3.18it/s]
 35%|███▍      | 130010/371472 [10:20:09<21:30:22,  3.12it/s]
 35%|███▍      | 130011/371472 [10:20:09<22:13:27,  3.02it/s]
 35%|███▍      | 130012/371472 [10:20:10<21:11:32,  3.16it/s]
 35%|███▍      | 130013/371472 [10:20:10<19:47:37,  3.39it/s]
 35%|███▍      | 130014/371472 [10:20:10<19:19:57,  3.47it/s]
 35%|███▍      | 130015/371472 [10:20:10<19:57:52,  3.36it/s]
 35%|███▌      | 130016/371472 [10:20:11<19:21:35,  3.46it/s]
 35%|███▌      | 130017/371472 [10:20:11<19:03:14,  3.52it/s]
 35%|███▌      | 130018/371472 [10:20:11<18:38:24,  3.60it/s]
 35%|███▌      | 130019/371472 [10:20:11<18:16:15,  3.67it/s]
 35%|███▌      | 130020/371472 [10:20:12<17:38:03,  3.80it/s]
                                                             
{'loss': 3.1078, 'learning_rate': 6.853034971664979e-07, 'epoch': 5.6}

 35%|███▌      | 130020/371472 [10:20:12<17:38:03,  3.80it/s]
 35%|███▌      | 130021/371472 [10:20:12<19:21:52,  3.46it/s]
 35%|███▌      | 130022/371472 [10:20:12<20:09:03,  3.33it/s]
 35%|███▌      | 130023/371472 [10:20:13<19:13:33,  3.49it/s]
 35%|███▌      | 130024/371472 [10:20:13<19:21:08,  3.47it/s]
 35%|███▌      | 130025/371472 [10:20:13<18:29:38,  3.63it/s]
 35%|███▌      | 130026/371472 [10:20:13<17:42:49,  3.79it/s]
 35%|███▌      | 130027/371472 [10:20:14<18:33:42,  3.61it/s]
 35%|███▌      | 130028/371472 [10:20:14<18:49:58,  3.56it/s]
 35%|███▌      | 130029/371472 [10:20:14<18:48:24,  3.57it/s]
 35%|███▌      | 130030/371472 [10:20:15<18:45:30,  3.58it/s]
 35%|███▌      | 130031/371472 [10:20:15<18:35:12,  3.61it/s]
 35%|███▌      | 130032/371472 [10:20:15<19:18:34,  3.47it/s]
 35%|███▌      | 130033/371472 [10:20:15<18:47:54,  3.57it/s]
 35%|███▌      | 130034/371472 [10:20:16<19:51:05,  3.38it/s]
 35%|███▌      | 130035/371472 [10:20:16<18:45:43,  3.57it/s]
 35%|███▌      | 130036/371472 [10:20:16<18:46:07,  3.57it/s]
 35%|███▌      | 130037/371472 [10:20:17<19:01:01,  3.53it/s]
 35%|███▌      | 130038/371472 [10:20:17<20:41:39,  3.24it/s]
 35%|███▌      | 130039/371472 [10:20:17<19:59:04,  3.36it/s]
 35%|███▌      | 130040/371472 [10:20:17<19:10:22,  3.50it/s]
                                                             
{'loss': 3.0785, 'learning_rate': 6.85255015191019e-07, 'epoch': 5.6}

 35%|███▌      | 130040/371472 [10:20:17<19:10:22,  3.50it/s]
 35%|███▌      | 130041/371472 [10:20:18<21:10:07,  3.17it/s]
 35%|███▌      | 130042/371472 [10:20:18<19:17:39,  3.48it/s]
 35%|███▌      | 130043/371472 [10:20:18<18:34:25,  3.61it/s]
 35%|███▌      | 130044/371472 [10:20:19<17:59:37,  3.73it/s]
 35%|███▌      | 130045/371472 [10:20:19<17:56:57,  3.74it/s]
 35%|███▌      | 130046/371472 [10:20:19<17:30:33,  3.83it/s]
 35%|███▌      | 130047/371472 [10:20:19<17:00:00,  3.94it/s]
 35%|███▌      | 130048/371472 [10:20:20<18:12:16,  3.68it/s]
 35%|███▌      | 130049/371472 [10:20:20<18:35:35,  3.61it/s]
 35%|███▌      | 130050/371472 [10:20:20<18:16:28,  3.67it/s]
 35%|███▌      | 130051/371472 [10:20:20<18:13:18,  3.68it/s]
 35%|███▌      | 130052/371472 [10:20:21<18:57:55,  3.54it/s]
 35%|███▌      | 130053/371472 [10:20:21<18:43:39,  3.58it/s]
 35%|███▌      | 130054/371472 [10:20:21<18:44:29,  3.58it/s]
 35%|███▌      | 130055/371472 [10:20:22<18:49:31,  3.56it/s]
 35%|███▌      | 130056/371472 [10:20:22<19:17:42,  3.48it/s]
 35%|███▌      | 130057/371472 [10:20:22<19:12:17,  3.49it/s]
 35%|███▌      | 130058/371472 [10:20:22<18:40:18,  3.59it/s]
 35%|███▌      | 130059/371472 [10:20:23<19:36:27,  3.42it/s]
 35%|███▌      | 130060/371472 [10:20:23<19:24:16,  3.46it/s]
                                                             
{'loss': 3.1983, 'learning_rate': 6.8520653321554e-07, 'epoch': 5.6}

 35%|███▌      | 130060/371472 [10:20:23<19:24:16,  3.46it/s]
 35%|███▌      | 130061/371472 [10:20:23<20:16:17,  3.31it/s]
 35%|███▌      | 130062/371472 [10:20:24<19:11:04,  3.50it/s]
 35%|███▌      | 130063/371472 [10:20:24<18:57:44,  3.54it/s]
 35%|███▌      | 130064/371472 [10:20:24<19:13:34,  3.49it/s]
 35%|███▌      | 130065/371472 [10:20:25<19:11:23,  3.49it/s]
 35%|███▌      | 130066/371472 [10:20:25<18:18:23,  3.66it/s]
 35%|███▌      | 130067/371472 [10:20:25<18:31:34,  3.62it/s]
 35%|███▌      | 130068/371472 [10:20:25<17:52:35,  3.75it/s]
 35%|███▌      | 130069/371472 [10:20:26<18:29:06,  3.63it/s]
 35%|███▌      | 130070/371472 [10:20:26<18:49:39,  3.56it/s]
 35%|███▌      | 130071/371472 [10:20:26<20:13:18,  3.32it/s]
 35%|███▌      | 130072/371472 [10:20:27<20:00:39,  3.35it/s]
 35%|███▌      | 130073/371472 [10:20:27<20:31:40,  3.27it/s]
 35%|███▌      | 130074/371472 [10:20:27<20:19:23,  3.30it/s]
 35%|███▌      | 130075/371472 [10:20:27<19:45:43,  3.39it/s]
 35%|███▌      | 130076/371472 [10:20:28<18:34:20,  3.61it/s]
 35%|███▌      | 130077/371472 [10:20:28<18:08:54,  3.69it/s]
 35%|███▌      | 130078/371472 [10:20:28<19:26:06,  3.45it/s]
 35%|███▌      | 130079/371472 [10:20:29<20:45:00,  3.23it/s]
 35%|███▌      | 130080/371472 [10:20:29<21:52:22,  3.07it/s]
                                                             
{'loss': 3.2296, 'learning_rate': 6.851580512400611e-07, 'epoch': 5.6}

 35%|███▌      | 130080/371472 [10:20:29<21:52:22,  3.07it/s]
 35%|███▌      | 130081/371472 [10:20:29<20:36:21,  3.25it/s]
 35%|███▌      | 130082/371472 [10:20:30<20:16:08,  3.31it/s]
 35%|███▌      | 130083/371472 [10:20:30<20:01:34,  3.35it/s]
 35%|███▌      | 130084/371472 [10:20:30<18:56:44,  3.54it/s]
 35%|███▌      | 130085/371472 [10:20:30<19:50:40,  3.38it/s]
 35%|███▌      | 130086/371472 [10:20:31<20:21:34,  3.29it/s]
 35%|███▌      | 130087/371472 [10:20:31<21:19:30,  3.14it/s]
 35%|███▌      | 130088/371472 [10:20:31<21:29:56,  3.12it/s]
 35%|███▌      | 130089/371472 [10:20:32<21:00:47,  3.19it/s]
 35%|███▌      | 130090/371472 [10:20:32<20:48:45,  3.22it/s]
 35%|███▌      | 130091/371472 [10:20:32<19:44:04,  3.40it/s]
 35%|███▌      | 130092/371472 [10:20:33<19:44:01,  3.40it/s]
 35%|███▌      | 130093/371472 [10:20:33<19:28:03,  3.44it/s]
 35%|███▌      | 130094/371472 [10:20:33<18:43:22,  3.58it/s]
 35%|███▌      | 130095/371472 [10:20:33<18:02:16,  3.72it/s]
 35%|███▌      | 130096/371472 [10:20:34<17:50:38,  3.76it/s]
 35%|███▌      | 130097/371472 [10:20:34<18:06:19,  3.70it/s]
 35%|███▌      | 130098/371472 [10:20:34<18:46:14,  3.57it/s]
 35%|███▌      | 130099/371472 [10:20:34<18:59:19,  3.53it/s]
 35%|███▌      | 130100/371472 [10:20:35<18:44:40,  3.58it/s]
                                                             
{'loss': 3.3313, 'learning_rate': 6.851095692645823e-07, 'epoch': 5.6}

 35%|███▌      | 130100/371472 [10:20:35<18:44:40,  3.58it/s]
 35%|███▌      | 130101/371472 [10:20:35<19:26:33,  3.45it/s]
 35%|███▌      | 130102/371472 [10:20:35<18:23:49,  3.64it/s]
 35%|███▌      | 130103/371472 [10:20:36<18:01:01,  3.72it/s]
 35%|███▌      | 130104/371472 [10:20:36<19:16:12,  3.48it/s]
 35%|███▌      | 130105/371472 [10:20:36<18:36:37,  3.60it/s]
 35%|███▌      | 130106/371472 [10:20:36<17:56:16,  3.74it/s]
 35%|███▌      | 130107/371472 [10:20:37<17:52:09,  3.75it/s]
 35%|███▌      | 130108/371472 [10:20:37<17:28:12,  3.84it/s]
 35%|███▌      | 130109/371472 [10:20:37<17:09:46,  3.91it/s]
 35%|███▌      | 130110/371472 [10:20:37<18:23:28,  3.65it/s]
 35%|███▌      | 130111/371472 [10:20:38<17:26:41,  3.84it/s]
 35%|███▌      | 130112/371472 [10:20:38<17:17:08,  3.88it/s]
 35%|███▌      | 130113/371472 [10:20:38<17:21:55,  3.86it/s]
 35%|███▌      | 130114/371472 [10:20:38<17:57:08,  3.73it/s]
 35%|███▌      | 130115/371472 [10:20:39<20:09:30,  3.33it/s]
 35%|███▌      | 130116/371472 [10:20:39<20:32:51,  3.26it/s]
 35%|███▌      | 130117/371472 [10:20:40<23:08:56,  2.90it/s]
 35%|███▌      | 130118/371472 [10:20:40<22:27:04,  2.99it/s]
 35%|███▌      | 130119/371472 [10:20:40<21:21:39,  3.14it/s]
 35%|███▌      | 130120/371472 [10:20:41<22:37:33,  2.96it/s]
                                                             
{'loss': 3.2221, 'learning_rate': 6.850610872891035e-07, 'epoch': 5.6}

 35%|███▌      | 130120/371472 [10:20:41<22:37:33,  2.96it/s]
 35%|███▌      | 130121/371472 [10:20:41<21:19:09,  3.14it/s]
 35%|███▌      | 130122/371472 [10:20:41<20:08:37,  3.33it/s]
 35%|███▌      | 130123/371472 [10:20:41<20:47:46,  3.22it/s]
 35%|███▌      | 130124/371472 [10:20:42<21:20:13,  3.14it/s]
 35%|███▌      | 130125/371472 [10:20:42<20:54:43,  3.21it/s]
 35%|███▌      | 130126/371472 [10:20:42<19:33:24,  3.43it/s]
 35%|███▌      | 130127/371472 [10:20:43<18:33:51,  3.61it/s]
 35%|███▌      | 130128/371472 [10:20:43<18:17:18,  3.67it/s]
 35%|███▌      | 130129/371472 [10:20:43<18:06:19,  3.70it/s]
 35%|███▌      | 130130/371472 [10:20:43<18:30:41,  3.62it/s]
 35%|███▌      | 130131/371472 [10:20:44<18:14:40,  3.67it/s]
 35%|███▌      | 130132/371472 [10:20:44<19:35:10,  3.42it/s]
 35%|███▌      | 130133/371472 [10:20:44<20:01:06,  3.35it/s]
 35%|███▌      | 130134/371472 [10:20:45<20:47:35,  3.22it/s]
 35%|███▌      | 130135/371472 [10:20:45<20:19:44,  3.30it/s]
 35%|███▌      | 130136/371472 [10:20:45<19:49:31,  3.38it/s]
 35%|███▌      | 130137/371472 [10:20:46<20:42:38,  3.24it/s]
 35%|███▌      | 130138/371472 [10:20:46<20:45:46,  3.23it/s]
 35%|███▌      | 130139/371472 [10:20:46<20:59:50,  3.19it/s]
 35%|███▌      | 130140/371472 [10:20:46<20:41:08,  3.24it/s]
                                                             
{'loss': 3.1508, 'learning_rate': 6.850126053136245e-07, 'epoch': 5.61}

 35%|███▌      | 130140/371472 [10:20:46<20:41:08,  3.24it/s]
 35%|███▌      | 130141/371472 [10:20:47<19:56:28,  3.36it/s]
 35%|███▌      | 130142/371472 [10:20:47<19:36:14,  3.42it/s]
 35%|███▌      | 130143/371472 [10:20:47<19:51:15,  3.38it/s]
 35%|███▌      | 130144/371472 [10:20:48<21:18:51,  3.15it/s]
 35%|███▌      | 130145/371472 [10:20:48<20:30:00,  3.27it/s]
 35%|███▌      | 130146/371472 [10:20:48<19:16:33,  3.48it/s]
 35%|███▌      | 130147/371472 [10:20:48<19:16:13,  3.48it/s]
 35%|███▌      | 130148/371472 [10:20:49<19:07:28,  3.51it/s]
 35%|███▌      | 130149/371472 [10:20:49<19:28:30,  3.44it/s]
 35%|███▌      | 130150/371472 [10:20:49<19:13:46,  3.49it/s]
 35%|███▌      | 130151/371472 [10:20:50<19:34:46,  3.42it/s]
 35%|███▌      | 130152/371472 [10:20:50<18:51:53,  3.55it/s]
 35%|███▌      | 130153/371472 [10:20:50<18:41:12,  3.59it/s]
 35%|███▌      | 130154/371472 [10:20:50<18:24:01,  3.64it/s]
 35%|███▌      | 130155/371472 [10:20:51<18:37:00,  3.60it/s]
 35%|███▌      | 130156/371472 [10:20:51<18:23:45,  3.64it/s]
 35%|███▌      | 130157/371472 [10:20:51<19:05:19,  3.51it/s]
 35%|███▌      | 130158/371472 [10:20:52<18:41:47,  3.59it/s]
 35%|███▌      | 130159/371472 [10:20:52<18:46:46,  3.57it/s]
 35%|███▌      | 130160/371472 [10:20:52<18:10:15,  3.69it/s]
                                                             
{'loss': 3.0391, 'learning_rate': 6.849641233381456e-07, 'epoch': 5.61}

 35%|███▌      | 130160/371472 [10:20:52<18:10:15,  3.69it/s]
 35%|███▌      | 130161/371472 [10:20:52<17:27:49,  3.84it/s]
 35%|███▌      | 130162/371472 [10:20:53<17:52:44,  3.75it/s]
 35%|███▌      | 130163/371472 [10:20:53<17:24:02,  3.85it/s]
 35%|███▌      | 130164/371472 [10:20:53<17:29:57,  3.83it/s]
 35%|███▌      | 130165/371472 [10:20:53<17:29:39,  3.83it/s]
 35%|███▌      | 130166/371472 [10:20:54<18:06:46,  3.70it/s]
 35%|███▌      | 130167/371472 [10:20:54<18:28:24,  3.63it/s]
 35%|███▌      | 130168/371472 [10:20:54<17:59:07,  3.73it/s]
 35%|███▌      | 130169/371472 [10:20:55<18:43:02,  3.58it/s]
 35%|███▌      | 130170/371472 [10:20:55<18:24:57,  3.64it/s]
 35%|███▌      | 130171/371472 [10:20:55<18:10:30,  3.69it/s]
 35%|███▌      | 130172/371472 [10:20:55<17:57:40,  3.73it/s]
 35%|███▌      | 130173/371472 [10:20:56<18:43:46,  3.58it/s]
 35%|███▌      | 130174/371472 [10:20:56<19:50:27,  3.38it/s]
 35%|███▌      | 130175/371472 [10:20:56<19:11:50,  3.49it/s]
 35%|███▌      | 130176/371472 [10:20:57<19:48:48,  3.38it/s]
 35%|███▌      | 130177/371472 [10:20:57<19:24:18,  3.45it/s]
 35%|███▌      | 130178/371472 [10:20:57<18:54:57,  3.54it/s]
 35%|███▌      | 130179/371472 [10:20:57<18:19:34,  3.66it/s]
 35%|███▌      | 130180/371472 [10:20:58<18:01:54,  3.72it/s]
                                                             
{'loss': 3.1049, 'learning_rate': 6.849156413626667e-07, 'epoch': 5.61}

 35%|███▌      | 130180/371472 [10:20:58<18:01:54,  3.72it/s]
 35%|███▌      | 130181/371472 [10:20:58<17:44:43,  3.78it/s]
 35%|███▌      | 130182/371472 [10:20:58<17:37:30,  3.80it/s]
 35%|███▌      | 130183/371472 [10:20:58<17:50:28,  3.76it/s]
 35%|███▌      | 130184/371472 [10:20:59<18:20:34,  3.65it/s]
 35%|███▌      | 130185/371472 [10:20:59<18:22:53,  3.65it/s]
 35%|███▌      | 130186/371472 [10:20:59<20:55:42,  3.20it/s]
 35%|███▌      | 130187/371472 [10:21:00<21:17:29,  3.15it/s]
 35%|███▌      | 130188/371472 [10:21:00<21:38:51,  3.10it/s]
 35%|███▌      | 130189/371472 [10:21:00<20:19:32,  3.30it/s]
 35%|███▌      | 130190/371472 [10:21:01<19:31:19,  3.43it/s]
 35%|███▌      | 130191/371472 [10:21:01<18:25:53,  3.64it/s]
 35%|███▌      | 130192/371472 [10:21:01<21:03:04,  3.18it/s]
 35%|███▌      | 130193/371472 [10:21:01<20:52:53,  3.21it/s]
 35%|███▌      | 130194/371472 [10:21:02<20:25:36,  3.28it/s]
 35%|███▌      | 130195/371472 [10:21:02<19:21:22,  3.46it/s]
 35%|███▌      | 130196/371472 [10:21:02<19:03:46,  3.52it/s]
 35%|███▌      | 130197/371472 [10:21:03<18:49:56,  3.56it/s]
 35%|███▌      | 130198/371472 [10:21:03<19:47:41,  3.39it/s]
 35%|███▌      | 130199/371472 [10:21:03<18:43:34,  3.58it/s]
 35%|███▌      | 130200/371472 [10:21:03<18:29:10,  3.63it/s]
                                                             
{'loss': 3.0774, 'learning_rate': 6.848671593871878e-07, 'epoch': 5.61}

 35%|███▌      | 130200/371472 [10:21:03<18:29:10,  3.63it/s]
 35%|███▌      | 130201/371472 [10:21:04<19:15:23,  3.48it/s]
 35%|███▌      | 130202/371472 [10:21:04<18:39:04,  3.59it/s]
 35%|███▌      | 130203/371472 [10:21:04<17:59:34,  3.72it/s]
 35%|███▌      | 130204/371472 [10:21:04<17:44:31,  3.78it/s]
 35%|███▌      | 130205/371472 [10:21:05<19:11:00,  3.49it/s]
 35%|███▌      | 130206/371472 [10:21:05<18:45:23,  3.57it/s]
 35%|███▌      | 130207/371472 [10:21:05<18:55:10,  3.54it/s]
 35%|███▌      | 130208/371472 [10:21:06<18:49:48,  3.56it/s]
 35%|███▌      | 130209/371472 [10:21:06<18:58:54,  3.53it/s]
 35%|███▌      | 130210/371472 [10:21:06<19:15:03,  3.48it/s]
 35%|███▌      | 130211/371472 [10:21:06<19:00:57,  3.52it/s]
 35%|███▌      | 130212/371472 [10:21:07<18:33:32,  3.61it/s]
 35%|███▌      | 130213/371472 [10:21:07<18:01:37,  3.72it/s]
 35%|███▌      | 130214/371472 [10:21:07<17:32:02,  3.82it/s]
 35%|███▌      | 130215/371472 [10:21:08<17:50:15,  3.76it/s]
 35%|███▌      | 130216/371472 [10:21:08<18:19:09,  3.66it/s]
 35%|███▌      | 130217/371472 [10:21:08<18:43:53,  3.58it/s]
 35%|███▌      | 130218/371472 [10:21:08<18:49:24,  3.56it/s]
 35%|███▌      | 130219/371472 [10:21:09<18:03:17,  3.71it/s]
 35%|███▌      | 130220/371472 [10:21:09<19:43:14,  3.40it/s]
                                                             
{'loss': 3.0843, 'learning_rate': 6.848186774117089e-07, 'epoch': 5.61}

 35%|███▌      | 130220/371472 [10:21:09<19:43:14,  3.40it/s]
 35%|███▌      | 130221/371472 [10:21:09<19:13:51,  3.48it/s]
 35%|███▌      | 130222/371472 [10:21:10<18:48:08,  3.56it/s]
 35%|███▌      | 130223/371472 [10:21:10<18:23:20,  3.64it/s]
 35%|███▌      | 130224/371472 [10:21:10<19:13:05,  3.49it/s]
 35%|███▌      | 130225/371472 [10:21:10<19:20:54,  3.46it/s]
 35%|███▌      | 130226/371472 [10:21:11<19:23:49,  3.45it/s]
 35%|███▌      | 130227/371472 [10:21:11<19:04:29,  3.51it/s]
 35%|███▌      | 130228/371472 [10:21:11<19:17:26,  3.47it/s]
 35%|███▌      | 130229/371472 [10:21:12<20:10:18,  3.32it/s]
 35%|███▌      | 130230/371472 [10:21:12<20:01:57,  3.35it/s]
 35%|███▌      | 130231/371472 [10:21:12<20:21:53,  3.29it/s]
 35%|███▌      | 130232/371472 [10:21:12<19:42:27,  3.40it/s]
 35%|███▌      | 130233/371472 [10:21:13<18:56:49,  3.54it/s]
 35%|███▌      | 130234/371472 [10:21:13<18:42:37,  3.58it/s]
 35%|███▌      | 130235/371472 [10:21:13<18:12:07,  3.68it/s]
 35%|███▌      | 130236/371472 [10:21:13<17:28:33,  3.83it/s]
 35%|███▌      | 130237/371472 [10:21:14<17:30:32,  3.83it/s]
 35%|███▌      | 130238/371472 [10:21:14<17:11:43,  3.90it/s]
 35%|███▌      | 130239/371472 [10:21:14<17:44:22,  3.78it/s]
 35%|███▌      | 130240/371472 [10:21:15<18:33:58,  3.61it/s]
                                                             
{'loss': 3.109, 'learning_rate': 6.847701954362299e-07, 'epoch': 5.61}

 35%|███▌      | 130240/371472 [10:21:15<18:33:58,  3.61it/s]
 35%|███▌      | 130241/371472 [10:21:15<21:42:12,  3.09it/s]
 35%|███▌      | 130242/371472 [10:21:15<21:36:11,  3.10it/s]
 35%|███▌      | 130243/371472 [10:21:16<20:11:27,  3.32it/s]
 35%|███▌      | 130244/371472 [10:21:16<19:25:38,  3.45it/s]
 35%|███▌      | 130245/371472 [10:21:16<18:43:38,  3.58it/s]
 35%|███▌      | 130246/371472 [10:21:16<18:33:43,  3.61it/s]
 35%|███▌      | 130247/371472 [10:21:17<17:31:27,  3.82it/s]
 35%|███▌      | 130248/371472 [10:21:17<17:29:50,  3.83it/s]
 35%|███▌      | 130249/371472 [10:21:17<17:39:42,  3.79it/s]
 35%|███▌      | 130250/371472 [10:21:17<17:22:52,  3.86it/s]
 35%|███▌      | 130251/371472 [10:21:18<18:06:10,  3.70it/s]
 35%|███▌      | 130252/371472 [10:21:18<18:25:54,  3.64it/s]
 35%|███▌      | 130253/371472 [10:21:18<19:48:47,  3.38it/s]
 35%|███▌      | 130254/371472 [10:21:19<19:35:44,  3.42it/s]
 35%|███▌      | 130255/371472 [10:21:19<19:54:45,  3.36it/s]
 35%|███▌      | 130256/371472 [10:21:19<20:02:25,  3.34it/s]
 35%|███▌      | 130257/371472 [10:21:19<19:55:20,  3.36it/s]
 35%|███▌      | 130258/371472 [10:21:20<19:54:48,  3.36it/s]
 35%|███▌      | 130259/371472 [10:21:20<19:17:45,  3.47it/s]
 35%|███▌      | 130260/371472 [10:21:20<19:06:40,  3.51it/s]
                                                             
{'loss': 3.2645, 'learning_rate': 6.847217134607512e-07, 'epoch': 5.61}

 35%|███▌      | 130260/371472 [10:21:20<19:06:40,  3.51it/s]
 35%|███▌      | 130261/371472 [10:21:21<18:59:06,  3.53it/s]
 35%|███▌      | 130262/371472 [10:21:21<19:35:08,  3.42it/s]
 35%|███▌      | 130263/371472 [10:21:21<19:31:53,  3.43it/s]
 35%|███▌      | 130264/371472 [10:21:22<20:23:42,  3.29it/s]
 35%|███▌      | 130265/371472 [10:21:22<20:01:10,  3.35it/s]
 35%|███▌      | 130266/371472 [10:21:22<19:25:14,  3.45it/s]
 35%|███▌      | 130267/371472 [10:21:22<18:24:22,  3.64it/s]
 35%|███▌      | 130268/371472 [10:21:23<19:45:52,  3.39it/s]
 35%|███▌      | 130269/371472 [10:21:23<18:50:03,  3.56it/s]
 35%|███▌      | 130270/371472 [10:21:23<18:52:09,  3.55it/s]
 35%|███▌      | 130271/371472 [10:21:23<18:44:06,  3.58it/s]
 35%|███▌      | 130272/371472 [10:21:24<18:19:45,  3.66it/s]
 35%|███▌      | 130273/371472 [10:21:24<20:50:17,  3.22it/s]
 35%|███▌      | 130274/371472 [10:21:24<19:49:22,  3.38it/s]
 35%|███▌      | 130275/371472 [10:21:25<20:31:09,  3.27it/s]
 35%|███▌      | 130276/371472 [10:21:25<19:21:14,  3.46it/s]
 35%|███▌      | 130277/371472 [10:21:25<19:42:10,  3.40it/s]
 35%|███▌      | 130278/371472 [10:21:26<19:24:30,  3.45it/s]
 35%|███▌      | 130279/371472 [10:21:26<19:21:28,  3.46it/s]
 35%|███▌      | 130280/371472 [10:21:26<18:54:00,  3.54it/s]
                                                             
{'loss': 3.2293, 'learning_rate': 6.846732314852723e-07, 'epoch': 5.61}

 35%|███▌      | 130280/371472 [10:21:26<18:54:00,  3.54it/s]
 35%|███▌      | 130281/371472 [10:21:26<18:41:50,  3.58it/s]
 35%|███▌      | 130282/371472 [10:21:27<20:06:57,  3.33it/s]
 35%|███▌      | 130283/371472 [10:21:27<19:45:13,  3.39it/s]
 35%|███▌      | 130284/371472 [10:21:27<18:42:07,  3.58it/s]
 35%|███▌      | 130285/371472 [10:21:28<17:51:07,  3.75it/s]
 35%|███▌      | 130286/371472 [10:21:28<17:59:00,  3.73it/s]
 35%|███▌      | 130287/371472 [10:21:28<17:22:24,  3.86it/s]
 35%|███▌      | 130288/371472 [10:21:28<17:36:47,  3.80it/s]
 35%|███▌      | 130289/371472 [10:21:29<17:17:40,  3.87it/s]
 35%|███▌      | 130290/371472 [10:21:29<17:04:20,  3.92it/s]
 35%|███▌      | 130291/371472 [10:21:29<17:14:16,  3.89it/s]
 35%|███▌      | 130292/371472 [10:21:29<17:25:57,  3.84it/s]
 35%|███▌      | 130293/371472 [10:21:30<19:12:27,  3.49it/s]
 35%|███▌      | 130294/371472 [10:21:30<18:43:11,  3.58it/s]
 35%|███▌      | 130295/371472 [10:21:30<18:04:59,  3.70it/s]
 35%|███▌      | 130296/371472 [10:21:31<20:59:32,  3.19it/s]
 35%|███▌      | 130297/371472 [10:21:31<20:12:24,  3.32it/s]
 35%|███▌      | 130298/371472 [10:21:31<19:10:55,  3.49it/s]
 35%|███▌      | 130299/371472 [10:21:31<18:44:06,  3.58it/s]
 35%|███▌      | 130300/371472 [10:21:32<18:47:44,  3.56it/s]
                                                             
{'loss': 3.2828, 'learning_rate': 6.846247495097932e-07, 'epoch': 5.61}

 35%|███▌      | 130300/371472 [10:21:32<18:47:44,  3.56it/s]
 35%|███▌      | 130301/371472 [10:21:32<18:42:14,  3.58it/s]
 35%|███▌      | 130302/371472 [10:21:32<19:32:42,  3.43it/s]
 35%|███▌      | 130303/371472 [10:21:33<20:03:03,  3.34it/s]
 35%|███▌      | 130304/371472 [10:21:33<18:41:55,  3.58it/s]
 35%|███▌      | 130305/371472 [10:21:33<18:08:04,  3.69it/s]
 35%|███▌      | 130306/371472 [10:21:33<18:25:31,  3.64it/s]
 35%|███▌      | 130307/371472 [10:21:34<20:05:13,  3.33it/s]
 35%|███▌      | 130308/371472 [10:21:34<19:30:38,  3.43it/s]
 35%|███▌      | 130309/371472 [10:21:34<18:44:54,  3.57it/s]
 35%|███▌      | 130310/371472 [10:21:34<18:24:33,  3.64it/s]
 35%|███▌      | 130311/371472 [10:21:35<19:01:45,  3.52it/s]
 35%|███▌      | 130312/371472 [10:21:35<19:08:58,  3.50it/s]
 35%|███▌      | 130313/371472 [10:21:35<18:51:26,  3.55it/s]
 35%|███▌      | 130314/371472 [10:21:36<18:38:13,  3.59it/s]
 35%|███▌      | 130315/371472 [10:21:36<18:21:45,  3.65it/s]
 35%|███▌      | 130316/371472 [10:21:36<18:38:46,  3.59it/s]
 35%|███▌      | 130317/371472 [10:21:36<18:15:16,  3.67it/s]
 35%|███▌      | 130318/371472 [10:21:37<17:34:05,  3.81it/s]
 35%|███▌      | 130319/371472 [10:21:37<17:12:47,  3.89it/s]
 35%|███▌      | 130320/371472 [10:21:37<16:54:40,  3.96it/s]
                                                             
{'loss': 3.0916, 'learning_rate': 6.845762675343144e-07, 'epoch': 5.61}

 35%|███▌      | 130320/371472 [10:21:37<16:54:40,  3.96it/s]
 35%|███▌      | 130321/371472 [10:21:37<18:08:08,  3.69it/s]
 35%|███▌      | 130322/371472 [10:21:38<18:27:54,  3.63it/s]
 35%|███▌      | 130323/371472 [10:21:38<18:49:59,  3.56it/s]
 35%|███▌      | 130324/371472 [10:21:38<18:29:04,  3.62it/s]
 35%|███▌      | 130325/371472 [10:21:39<19:03:13,  3.52it/s]
 35%|███▌      | 130326/371472 [10:21:39<18:49:25,  3.56it/s]
 35%|███▌      | 130327/371472 [10:21:39<20:07:45,  3.33it/s]
 35%|███▌      | 130328/371472 [10:21:40<20:41:33,  3.24it/s]
 35%|███▌      | 130329/371472 [10:21:40<19:21:35,  3.46it/s]
 35%|███▌      | 130330/371472 [10:21:40<19:21:20,  3.46it/s]
 35%|███▌      | 130331/371472 [10:21:40<19:09:12,  3.50it/s]
 35%|███▌      | 130332/371472 [10:21:41<19:44:04,  3.39it/s]
 35%|███▌      | 130333/371472 [10:21:41<19:12:09,  3.49it/s]
 35%|███▌      | 130334/371472 [10:21:41<19:39:49,  3.41it/s]
 35%|███▌      | 130335/371472 [10:21:42<19:11:50,  3.49it/s]
 35%|███▌      | 130336/371472 [10:21:42<20:46:26,  3.22it/s]
 35%|███▌      | 130337/371472 [10:21:42<21:39:15,  3.09it/s]
 35%|███▌      | 130338/371472 [10:21:43<20:41:51,  3.24it/s]
 35%|███▌      | 130339/371472 [10:21:43<19:57:47,  3.36it/s]
 35%|███▌      | 130340/371472 [10:21:43<19:30:43,  3.43it/s]
                                                             
{'loss': 3.2169, 'learning_rate': 6.845277855588357e-07, 'epoch': 5.61}

 35%|███▌      | 130340/371472 [10:21:43<19:30:43,  3.43it/s]
 35%|███▌      | 130341/371472 [10:21:43<19:38:10,  3.41it/s]
 35%|███▌      | 130342/371472 [10:21:44<19:43:56,  3.39it/s]
 35%|███▌      | 130343/371472 [10:21:44<19:29:49,  3.44it/s]
 35%|███▌      | 130344/371472 [10:21:44<18:53:36,  3.55it/s]
 35%|███▌      | 130345/371472 [10:21:45<19:16:50,  3.47it/s]
 35%|███▌      | 130346/371472 [10:21:45<18:47:30,  3.56it/s]
 35%|███▌      | 130347/371472 [10:21:45<18:19:31,  3.65it/s]
 35%|███▌      | 130348/371472 [10:21:45<18:29:24,  3.62it/s]
 35%|███▌      | 130349/371472 [10:21:46<17:41:35,  3.79it/s]
 35%|███▌      | 130350/371472 [10:21:46<17:35:11,  3.81it/s]
 35%|███▌      | 130351/371472 [10:21:46<17:04:57,  3.92it/s]
 35%|███▌      | 130352/371472 [10:21:46<18:43:00,  3.58it/s]
 35%|███▌      | 130353/371472 [10:21:47<18:37:39,  3.60it/s]
 35%|███▌      | 130354/371472 [10:21:47<19:07:16,  3.50it/s]
 35%|███▌      | 130355/371472 [10:21:47<19:07:37,  3.50it/s]
 35%|███▌      | 130356/371472 [10:21:48<18:48:11,  3.56it/s]
 35%|███▌      | 130357/371472 [10:21:48<18:49:10,  3.56it/s]
 35%|███▌      | 130358/371472 [10:21:48<18:20:52,  3.65it/s]
 35%|███▌      | 130359/371472 [10:21:48<18:18:29,  3.66it/s]
 35%|███▌      | 130360/371472 [10:21:49<17:53:45,  3.74it/s]
                                                             
{'loss': 3.2115, 'learning_rate': 6.844793035833566e-07, 'epoch': 5.61}

 35%|███▌      | 130360/371472 [10:21:49<17:53:45,  3.74it/s]
 35%|███▌      | 130361/371472 [10:21:49<17:33:56,  3.81it/s]
 35%|███▌      | 130362/371472 [10:21:49<18:07:27,  3.70it/s]
 35%|███▌      | 130363/371472 [10:21:50<20:08:20,  3.33it/s]
 35%|███▌      | 130364/371472 [10:21:50<21:21:38,  3.14it/s]
 35%|███▌      | 130365/371472 [10:21:50<20:17:42,  3.30it/s]
 35%|███▌      | 130366/371472 [10:21:50<19:28:17,  3.44it/s]
 35%|███▌      | 130367/371472 [10:21:51<19:09:44,  3.50it/s]
 35%|███▌      | 130368/371472 [10:21:51<18:51:59,  3.55it/s]
 35%|███▌      | 130369/371472 [10:21:51<19:11:55,  3.49it/s]
 35%|███▌      | 130370/371472 [10:21:51<18:26:51,  3.63it/s]
 35%|███▌      | 130371/371472 [10:21:52<20:12:25,  3.31it/s]
 35%|███▌      | 130372/371472 [10:21:52<21:16:28,  3.15it/s]
 35%|███▌      | 130373/371472 [10:21:53<20:38:04,  3.25it/s]
 35%|███▌      | 130374/371472 [10:21:53<19:48:57,  3.38it/s]
 35%|███▌      | 130375/371472 [10:21:53<20:23:06,  3.29it/s]
 35%|███▌      | 130376/371472 [10:21:53<21:55:17,  3.06it/s]
 35%|███▌      | 130377/371472 [10:21:54<21:07:31,  3.17it/s]
 35%|███▌      | 130378/371472 [10:21:54<20:12:02,  3.32it/s]
 35%|███▌      | 130379/371472 [10:21:54<19:45:59,  3.39it/s]
 35%|███▌      | 130380/371472 [10:21:55<20:26:21,  3.28it/s]
                                                             
{'loss': 2.9956, 'learning_rate': 6.844308216078777e-07, 'epoch': 5.62}

 35%|███▌      | 130380/371472 [10:21:55<20:26:21,  3.28it/s]
 35%|███▌      | 130381/371472 [10:21:55<19:58:12,  3.35it/s]
 35%|███▌      | 130382/371472 [10:21:55<20:14:14,  3.31it/s]
 35%|███▌      | 130383/371472 [10:21:56<20:48:13,  3.22it/s]
 35%|███▌      | 130384/371472 [10:21:56<20:27:54,  3.27it/s]
 35%|███▌      | 130385/371472 [10:21:56<20:08:51,  3.32it/s]
 35%|███▌      | 130386/371472 [10:21:56<19:36:07,  3.42it/s]
 35%|███▌      | 130387/371472 [10:21:57<19:03:18,  3.51it/s]
 35%|███▌      | 130388/371472 [10:21:57<18:49:13,  3.56it/s]
 35%|███▌      | 130389/371472 [10:21:57<18:54:45,  3.54it/s]
 35%|███▌      | 130390/371472 [10:21:58<18:43:02,  3.58it/s]
 35%|███▌      | 130391/371472 [10:21:58<18:47:32,  3.56it/s]
 35%|███▌      | 130392/371472 [10:21:58<19:05:46,  3.51it/s]
 35%|███▌      | 130393/371472 [10:21:58<18:38:49,  3.59it/s]
 35%|███▌      | 130394/371472 [10:21:59<18:06:59,  3.70it/s]
 35%|███▌      | 130395/371472 [10:21:59<17:51:20,  3.75it/s]
 35%|███▌      | 130396/371472 [10:21:59<17:35:04,  3.81it/s]
 35%|███▌      | 130397/371472 [10:21:59<17:05:07,  3.92it/s]
 35%|███▌      | 130398/371472 [10:22:00<17:47:35,  3.76it/s]
 35%|███▌      | 130399/371472 [10:22:00<18:26:56,  3.63it/s]
 35%|███▌      | 130400/371472 [10:22:00<18:13:11,  3.68it/s]
                                                             
{'loss': 3.2077, 'learning_rate': 6.843823396323989e-07, 'epoch': 5.62}

 35%|███▌      | 130400/371472 [10:22:00<18:13:11,  3.68it/s]
 35%|███▌      | 130401/371472 [10:22:01<18:50:20,  3.55it/s]
 35%|███▌      | 130402/371472 [10:22:01<18:42:02,  3.58it/s]
 35%|███▌      | 130403/371472 [10:22:01<18:01:17,  3.72it/s]
 35%|███▌      | 130404/371472 [10:22:01<18:26:07,  3.63it/s]
 35%|███▌      | 130405/371472 [10:22:02<18:45:20,  3.57it/s]
 35%|███▌      | 130406/371472 [10:22:02<18:50:15,  3.55it/s]
 35%|███▌      | 130407/371472 [10:22:02<18:33:18,  3.61it/s]
 35%|███▌      | 130408/371472 [10:22:02<18:12:25,  3.68it/s]
 35%|███▌      | 130409/371472 [10:22:03<19:32:58,  3.43it/s]
 35%|███▌      | 130410/371472 [10:22:03<18:37:32,  3.60it/s]
 35%|███▌      | 130411/371472 [10:22:03<17:58:03,  3.73it/s]
 35%|███▌      | 130412/371472 [10:22:04<18:30:30,  3.62it/s]
 35%|███▌      | 130413/371472 [10:22:04<19:00:18,  3.52it/s]
 35%|███▌      | 130414/371472 [10:22:04<18:56:49,  3.53it/s]
 35%|███▌      | 130415/371472 [10:22:04<18:59:06,  3.53it/s]
 35%|███▌      | 130416/371472 [10:22:05<19:03:42,  3.51it/s]
 35%|███▌      | 130417/371472 [10:22:05<18:37:29,  3.60it/s]
 35%|███▌      | 130418/371472 [10:22:05<19:20:54,  3.46it/s]
 35%|███▌      | 130419/371472 [10:22:06<19:23:58,  3.45it/s]
 35%|███▌      | 130420/371472 [10:22:06<18:17:30,  3.66it/s]
                                                             
{'loss': 3.1998, 'learning_rate': 6.8433385765692e-07, 'epoch': 5.62}

 35%|███▌      | 130420/371472 [10:22:06<18:17:30,  3.66it/s]
 35%|███▌      | 130421/371472 [10:22:06<18:20:56,  3.65it/s]
 35%|███▌      | 130422/371472 [10:22:06<17:48:19,  3.76it/s]
 35%|███▌      | 130423/371472 [10:22:07<18:44:18,  3.57it/s]
 35%|███▌      | 130424/371472 [10:22:07<18:26:44,  3.63it/s]
 35%|███▌      | 130425/371472 [10:22:07<18:39:45,  3.59it/s]
 35%|███▌      | 130426/371472 [10:22:07<18:22:49,  3.64it/s]
 35%|███▌      | 130427/371472 [10:22:08<20:29:00,  3.27it/s]
 35%|███▌      | 130428/371472 [10:22:08<19:26:39,  3.44it/s]
 35%|███▌      | 130429/371472 [10:22:08<20:09:48,  3.32it/s]
 35%|███▌      | 130430/371472 [10:22:09<19:22:37,  3.46it/s]
 35%|███▌      | 130431/371472 [10:22:09<19:34:07,  3.42it/s]
 35%|███▌      | 130432/371472 [10:22:09<18:57:57,  3.53it/s]
 35%|███▌      | 130433/371472 [10:22:10<18:27:14,  3.63it/s]
 35%|███▌      | 130434/371472 [10:22:10<18:08:48,  3.69it/s]
 35%|███▌      | 130435/371472 [10:22:10<18:03:34,  3.71it/s]
 35%|███▌      | 130436/371472 [10:22:10<18:32:21,  3.61it/s]
 35%|███▌      | 130437/371472 [10:22:11<18:42:59,  3.58it/s]
 35%|███▌      | 130438/371472 [10:22:11<18:31:07,  3.62it/s]
 35%|███▌      | 130439/371472 [10:22:11<18:43:04,  3.58it/s]
 35%|███▌      | 130440/371472 [10:22:11<17:58:07,  3.73it/s]
                                                             
{'loss': 3.2389, 'learning_rate': 6.84285375681441e-07, 'epoch': 5.62}

 35%|███▌      | 130440/371472 [10:22:11<17:58:07,  3.73it/s]
 35%|███▌      | 130441/371472 [10:22:12<18:20:55,  3.65it/s]
 35%|███▌      | 130442/371472 [10:22:12<18:33:01,  3.61it/s]
 35%|███▌      | 130443/371472 [10:22:12<18:57:12,  3.53it/s]
 35%|███▌      | 130444/371472 [10:22:13<19:09:05,  3.50it/s]
 35%|███▌      | 130445/371472 [10:22:13<18:33:05,  3.61it/s]
 35%|███▌      | 130446/371472 [10:22:13<17:45:45,  3.77it/s]
 35%|███▌      | 130447/371472 [10:22:13<18:08:05,  3.69it/s]
 35%|███▌      | 130448/371472 [10:22:14<18:09:00,  3.69it/s]
 35%|███▌      | 130449/371472 [10:22:14<18:53:47,  3.54it/s]
 35%|███▌      | 130450/371472 [10:22:14<19:22:44,  3.45it/s]
 35%|███▌      | 130451/371472 [10:22:15<19:24:21,  3.45it/s]
 35%|███▌      | 130452/371472 [10:22:15<19:09:39,  3.49it/s]
 35%|███▌      | 130453/371472 [10:22:15<19:11:00,  3.49it/s]
 35%|███▌      | 130454/371472 [10:22:15<19:01:29,  3.52it/s]
 35%|███▌      | 130455/371472 [10:22:16<19:00:46,  3.52it/s]
 35%|███▌      | 130456/371472 [10:22:16<20:14:51,  3.31it/s]
 35%|███▌      | 130457/371472 [10:22:16<20:19:44,  3.29it/s]
 35%|███▌      | 130458/371472 [10:22:17<20:29:40,  3.27it/s]
 35%|███▌      | 130459/371472 [10:22:17<19:47:52,  3.38it/s]
 35%|███▌      | 130460/371472 [10:22:17<18:38:24,  3.59it/s]
                                                             
{'loss': 3.1101, 'learning_rate': 6.842368937059621e-07, 'epoch': 5.62}

 35%|███▌      | 130460/371472 [10:22:17<18:38:24,  3.59it/s]
 35%|███▌      | 130461/371472 [10:22:17<17:59:33,  3.72it/s]
 35%|███▌      | 130462/371472 [10:22:18<18:42:25,  3.58it/s]
 35%|███▌      | 130463/371472 [10:22:18<18:32:01,  3.61it/s]
 35%|███▌      | 130464/371472 [10:22:18<18:42:43,  3.58it/s]
 35%|███▌      | 130465/371472 [10:22:19<19:42:24,  3.40it/s]
 35%|███▌      | 130466/371472 [10:22:19<19:00:17,  3.52it/s]
 35%|███▌      | 130467/371472 [10:22:19<18:35:33,  3.60it/s]
 35%|███▌      | 130468/371472 [10:22:19<17:40:54,  3.79it/s]
 35%|███▌      | 130469/371472 [10:22:20<17:52:48,  3.74it/s]
 35%|███▌      | 130470/371472 [10:22:20<18:17:58,  3.66it/s]
 35%|███▌      | 130471/371472 [10:22:20<18:30:50,  3.62it/s]
 35%|███▌      | 130472/371472 [10:22:20<18:01:48,  3.71it/s]
 35%|███▌      | 130473/371472 [10:22:21<18:12:36,  3.68it/s]
 35%|███▌      | 130474/371472 [10:22:21<17:42:46,  3.78it/s]
 35%|███▌      | 130475/371472 [10:22:21<17:16:02,  3.88it/s]
 35%|███▌      | 130476/371472 [10:22:21<17:39:00,  3.79it/s]
 35%|███▌      | 130477/371472 [10:22:22<17:14:40,  3.88it/s]
 35%|███▌      | 130478/371472 [10:22:22<17:00:15,  3.94it/s]
 35%|███▌      | 130479/371472 [10:22:22<16:36:15,  4.03it/s]
 35%|███▌      | 130480/371472 [10:22:22<16:26:10,  4.07it/s]
                                                             
{'loss': 3.2012, 'learning_rate': 6.841884117304833e-07, 'epoch': 5.62}

 35%|███▌      | 130480/371472 [10:22:22<16:26:10,  4.07it/s]
 35%|███▌      | 130481/371472 [10:22:23<16:34:35,  4.04it/s]
 35%|███▌      | 130482/371472 [10:22:23<16:42:19,  4.01it/s]
 35%|███▌      | 130483/371472 [10:22:23<17:15:09,  3.88it/s]
 35%|███▌      | 130484/371472 [10:22:23<17:26:23,  3.84it/s]
 35%|███▌      | 130485/371472 [10:22:24<17:24:53,  3.84it/s]
 35%|███▌      | 130486/371472 [10:22:24<18:07:21,  3.69it/s]
 35%|███▌      | 130487/371472 [10:22:24<18:16:58,  3.66it/s]
 35%|███▌      | 130488/371472 [10:22:25<18:17:09,  3.66it/s]
 35%|███▌      | 130489/371472 [10:22:25<18:00:04,  3.72it/s]
 35%|███▌      | 130490/371472 [10:22:25<18:20:44,  3.65it/s]
 35%|███▌      | 130491/371472 [10:22:25<17:55:34,  3.73it/s]
 35%|███▌      | 130492/371472 [10:22:26<18:26:34,  3.63it/s]
 35%|███▌      | 130493/371472 [10:22:26<18:23:55,  3.64it/s]
 35%|███▌      | 130494/371472 [10:22:26<17:46:06,  3.77it/s]
 35%|███▌      | 130495/371472 [10:22:27<19:10:45,  3.49it/s]
 35%|███▌      | 130496/371472 [10:22:27<19:07:39,  3.50it/s]
 35%|███▌      | 130497/371472 [10:22:27<20:26:22,  3.27it/s]
 35%|███▌      | 130498/371472 [10:22:27<19:28:17,  3.44it/s]
 35%|███▌      | 130499/371472 [10:22:28<19:37:34,  3.41it/s]
 35%|███▌      | 130500/371472 [10:22:28<18:41:06,  3.58it/s]
                                                             
{'loss': 3.2541, 'learning_rate': 6.841399297550044e-07, 'epoch': 5.62}

 35%|███▌      | 130500/371472 [10:22:28<18:41:06,  3.58it/s]
 35%|███▌      | 130501/371472 [10:22:28<18:58:32,  3.53it/s]
 35%|███▌      | 130502/371472 [10:22:29<18:47:41,  3.56it/s]
 35%|███▌      | 130503/371472 [10:22:29<20:07:13,  3.33it/s]
 35%|███▌      | 130504/371472 [10:22:29<19:50:19,  3.37it/s]
 35%|███▌      | 130505/371472 [10:22:29<20:05:15,  3.33it/s]
 35%|███▌      | 130506/371472 [10:22:30<19:16:31,  3.47it/s]
 35%|███▌      | 130507/371472 [10:22:30<18:33:10,  3.61it/s]
 35%|███▌      | 130508/371472 [10:22:30<19:18:56,  3.47it/s]
 35%|███▌      | 130509/371472 [10:22:31<19:27:55,  3.44it/s]
 35%|███▌      | 130510/371472 [10:22:31<18:31:00,  3.61it/s]
 35%|███▌      | 130511/371472 [10:22:31<17:54:47,  3.74it/s]
 35%|███▌      | 130512/371472 [10:22:31<17:40:27,  3.79it/s]
 35%|███▌      | 130513/371472 [10:22:32<17:10:58,  3.90it/s]
 35%|███▌      | 130514/371472 [10:22:32<17:06:09,  3.91it/s]
 35%|███▌      | 130515/371472 [10:22:32<17:16:49,  3.87it/s]
 35%|███▌      | 130516/371472 [10:22:32<16:54:33,  3.96it/s]
 35%|███▌      | 130517/371472 [10:22:33<16:49:29,  3.98it/s]
 35%|███▌      | 130518/371472 [10:22:33<18:52:49,  3.55it/s]
 35%|███▌      | 130519/371472 [10:22:33<19:06:18,  3.50it/s]
 35%|███▌      | 130520/371472 [10:22:34<18:53:05,  3.54it/s]
                                                             
{'loss': 3.1097, 'learning_rate': 6.840914477795255e-07, 'epoch': 5.62}

 35%|███▌      | 130520/371472 [10:22:34<18:53:05,  3.54it/s]
 35%|███▌      | 130521/371472 [10:22:34<18:15:07,  3.67it/s]
 35%|███▌      | 130522/371472 [10:22:34<18:34:16,  3.60it/s]
 35%|███▌      | 130523/371472 [10:22:34<19:32:12,  3.43it/s]
 35%|███▌      | 130524/371472 [10:22:35<19:02:15,  3.52it/s]
 35%|███▌      | 130525/371472 [10:22:35<18:53:46,  3.54it/s]
 35%|███▌      | 130526/371472 [10:22:35<18:43:57,  3.57it/s]
 35%|███▌      | 130527/371472 [10:22:35<18:21:29,  3.65it/s]
 35%|███▌      | 130528/371472 [10:22:36<18:27:33,  3.63it/s]
 35%|███▌      | 130529/371472 [10:22:36<18:00:18,  3.72it/s]
 35%|███▌      | 130530/371472 [10:22:36<18:23:30,  3.64it/s]
 35%|███▌      | 130531/371472 [10:22:37<19:53:07,  3.37it/s]
 35%|███▌      | 130532/371472 [10:22:37<21:05:48,  3.17it/s]
 35%|███▌      | 130533/371472 [10:22:37<21:03:48,  3.18it/s]
 35%|███▌      | 130534/371472 [10:22:38<19:56:05,  3.36it/s]
 35%|███▌      | 130535/371472 [10:22:38<20:10:37,  3.32it/s]
 35%|███▌      | 130536/371472 [10:22:38<21:23:04,  3.13it/s]
 35%|███▌      | 130537/371472 [10:22:38<20:26:18,  3.27it/s]
 35%|███▌      | 130538/371472 [10:22:39<24:57:34,  2.68it/s]
 35%|███▌      | 130539/371472 [10:22:39<23:19:58,  2.87it/s]
 35%|███▌      | 130540/371472 [10:22:40<21:12:59,  3.15it/s]
                                                             
{'loss': 3.0298, 'learning_rate': 6.840429658040466e-07, 'epoch': 5.62}

 35%|███▌      | 130540/371472 [10:22:40<21:12:59,  3.15it/s]
 35%|███▌      | 130541/371472 [10:22:40<21:53:25,  3.06it/s]
 35%|███▌      | 130542/371472 [10:22:40<21:06:26,  3.17it/s]
 35%|███▌      | 130543/371472 [10:22:40<20:48:55,  3.22it/s]
 35%|███▌      | 130544/371472 [10:22:41<20:49:00,  3.21it/s]
 35%|███▌      | 130545/371472 [10:22:41<20:15:03,  3.30it/s]
 35%|███▌      | 130546/371472 [10:22:41<18:59:03,  3.53it/s]
 35%|███▌      | 130547/371472 [10:22:42<18:22:06,  3.64it/s]
 35%|███▌      | 130548/371472 [10:22:42<19:44:25,  3.39it/s]
 35%|███▌      | 130549/371472 [10:22:42<19:33:31,  3.42it/s]
 35%|███▌      | 130550/371472 [10:22:42<18:42:30,  3.58it/s]
 35%|███▌      | 130551/371472 [10:22:43<18:19:48,  3.65it/s]
 35%|███▌      | 130552/371472 [10:22:43<18:41:23,  3.58it/s]
 35%|███▌      | 130553/371472 [10:22:43<18:44:42,  3.57it/s]
 35%|███▌      | 130554/371472 [10:22:44<17:49:12,  3.76it/s]
 35%|███▌      | 130555/371472 [10:22:44<18:28:20,  3.62it/s]
 35%|███▌      | 130556/371472 [10:22:44<19:20:23,  3.46it/s]
 35%|███▌      | 130557/371472 [10:22:44<18:48:27,  3.56it/s]
 35%|███▌      | 130558/371472 [10:22:45<18:58:47,  3.53it/s]
 35%|███▌      | 130559/371472 [10:22:45<18:07:29,  3.69it/s]
 35%|███▌      | 130560/371472 [10:22:45<18:18:41,  3.65it/s]
                                                             
{'loss': 3.2764, 'learning_rate': 6.839944838285677e-07, 'epoch': 5.62}

 35%|███▌      | 130560/371472 [10:22:45<18:18:41,  3.65it/s]
 35%|███▌      | 130561/371472 [10:22:46<19:09:43,  3.49it/s]
 35%|███▌      | 130562/371472 [10:22:46<18:59:02,  3.53it/s]
 35%|███▌      | 130563/371472 [10:22:46<18:14:55,  3.67it/s]
 35%|███▌      | 130564/371472 [10:22:46<17:55:14,  3.73it/s]
 35%|███▌      | 130565/371472 [10:22:47<17:45:10,  3.77it/s]
 35%|███▌      | 130566/371472 [10:22:47<17:44:16,  3.77it/s]
 35%|███▌      | 130567/371472 [10:22:47<17:41:41,  3.78it/s]
 35%|███▌      | 130568/371472 [10:22:47<17:09:57,  3.90it/s]
 35%|███▌      | 130569/371472 [10:22:48<18:15:08,  3.67it/s]
 35%|███▌      | 130570/371472 [10:22:48<17:36:39,  3.80it/s]
 35%|███▌      | 130571/371472 [10:22:48<17:39:30,  3.79it/s]
 35%|███▌      | 130572/371472 [10:22:49<19:13:42,  3.48it/s]
 35%|███▌      | 130573/371472 [10:22:49<20:28:18,  3.27it/s]
 35%|███▌      | 130574/371472 [10:22:49<19:53:14,  3.36it/s]
 35%|███▌      | 130575/371472 [10:22:49<18:31:27,  3.61it/s]
 35%|███▌      | 130576/371472 [10:22:50<18:20:49,  3.65it/s]
 35%|███▌      | 130577/371472 [10:22:50<19:26:40,  3.44it/s]
 35%|███▌      | 130578/371472 [10:22:50<19:06:58,  3.50it/s]
 35%|███▌      | 130579/371472 [10:22:50<18:10:54,  3.68it/s]
 35%|███▌      | 130580/371472 [10:22:51<17:52:01,  3.75it/s]
                                                             
{'loss': 3.1988, 'learning_rate': 6.839460018530888e-07, 'epoch': 5.62}

 35%|███▌      | 130580/371472 [10:22:51<17:52:01,  3.75it/s]
 35%|███▌      | 130581/371472 [10:22:51<17:59:10,  3.72it/s]
 35%|███▌      | 130582/371472 [10:22:51<17:59:37,  3.72it/s]
 35%|███▌      | 130583/371472 [10:22:52<17:30:37,  3.82it/s]
 35%|███▌      | 130584/371472 [10:22:52<18:50:18,  3.55it/s]
 35%|███▌      | 130585/371472 [10:22:52<18:23:34,  3.64it/s]
 35%|███▌      | 130586/371472 [10:22:52<18:37:07,  3.59it/s]
 35%|███▌      | 130587/371472 [10:22:53<18:41:50,  3.58it/s]
 35%|███▌      | 130588/371472 [10:22:53<18:56:50,  3.53it/s]
 35%|███▌      | 130589/371472 [10:22:53<19:19:38,  3.46it/s]
 35%|███▌      | 130590/371472 [10:22:54<18:43:27,  3.57it/s]
 35%|███▌      | 130591/371472 [10:22:54<18:45:39,  3.57it/s]
 35%|███▌      | 130592/371472 [10:22:54<18:57:38,  3.53it/s]
 35%|███▌      | 130593/371472 [10:22:54<18:20:24,  3.65it/s]
 35%|███▌      | 130594/371472 [10:22:55<21:16:42,  3.14it/s]
 35%|███▌      | 130595/371472 [10:22:55<20:15:10,  3.30it/s]
 35%|███▌      | 130596/371472 [10:22:55<20:23:34,  3.28it/s]
 35%|███▌      | 130597/371472 [10:22:56<21:39:04,  3.09it/s]
 35%|███▌      | 130598/371472 [10:22:56<20:41:52,  3.23it/s]
 35%|███▌      | 130599/371472 [10:22:56<20:14:14,  3.31it/s]
 35%|███▌      | 130600/371472 [10:22:57<19:06:37,  3.50it/s]
                                                             
{'loss': 2.9662, 'learning_rate': 6.838975198776099e-07, 'epoch': 5.63}

 35%|███▌      | 130600/371472 [10:22:57<19:06:37,  3.50it/s]
 35%|███▌      | 130601/371472 [10:22:57<18:35:22,  3.60it/s]
 35%|███▌      | 130602/371472 [10:22:57<18:24:12,  3.64it/s]
 35%|███▌      | 130603/371472 [10:22:57<18:18:29,  3.65it/s]
 35%|███▌      | 130604/371472 [10:22:58<18:28:20,  3.62it/s]
 35%|███▌      | 130605/371472 [10:22:58<18:54:11,  3.54it/s]
 35%|███▌      | 130606/371472 [10:22:58<19:24:18,  3.45it/s]
 35%|███▌      | 130607/371472 [10:22:58<18:50:31,  3.55it/s]
 35%|███▌      | 130608/371472 [10:22:59<18:34:46,  3.60it/s]
 35%|███▌      | 130609/371472 [10:22:59<18:11:04,  3.68it/s]
 35%|███▌      | 130610/371472 [10:22:59<19:23:25,  3.45it/s]
 35%|███▌      | 130611/371472 [10:23:00<18:51:44,  3.55it/s]
 35%|███▌      | 130612/371472 [10:23:00<18:39:16,  3.59it/s]
 35%|███▌      | 130613/371472 [10:23:00<18:10:12,  3.68it/s]
 35%|███▌      | 130614/371472 [10:23:00<17:45:11,  3.77it/s]
 35%|███▌      | 130615/371472 [10:23:01<17:50:43,  3.75it/s]
 35%|███▌      | 130616/371472 [10:23:01<17:40:44,  3.78it/s]
 35%|███▌      | 130617/371472 [10:23:01<18:30:20,  3.62it/s]
 35%|███▌      | 130618/371472 [10:23:01<18:46:12,  3.56it/s]
 35%|███▌      | 130619/371472 [10:23:02<18:17:52,  3.66it/s]
 35%|███▌      | 130620/371472 [10:23:02<18:47:38,  3.56it/s]
                                                             
{'loss': 3.1406, 'learning_rate': 6.83849037902131e-07, 'epoch': 5.63}

 35%|███▌      | 130620/371472 [10:23:02<18:47:38,  3.56it/s]
 35%|███▌      | 130621/371472 [10:23:02<18:17:00,  3.66it/s]
 35%|███▌      | 130622/371472 [10:23:03<18:22:54,  3.64it/s]
 35%|███▌      | 130623/371472 [10:23:03<19:34:03,  3.42it/s]
 35%|███▌      | 130624/371472 [10:23:03<19:28:32,  3.44it/s]
 35%|███▌      | 130625/371472 [10:23:04<19:54:31,  3.36it/s]
 35%|███▌      | 130626/371472 [10:23:04<19:18:35,  3.46it/s]
 35%|███▌      | 130627/371472 [10:23:04<19:34:52,  3.42it/s]
 35%|███▌      | 130628/371472 [10:23:04<19:39:10,  3.40it/s]
 35%|███▌      | 130629/371472 [10:23:05<21:04:21,  3.17it/s]
 35%|███▌      | 130630/371472 [10:23:05<19:58:34,  3.35it/s]
 35%|███▌      | 130631/371472 [10:23:05<19:13:18,  3.48it/s]
 35%|███▌      | 130632/371472 [10:23:06<18:52:05,  3.55it/s]
 35%|███▌      | 130633/371472 [10:23:06<19:36:34,  3.41it/s]
 35%|███▌      | 130634/371472 [10:23:06<19:13:49,  3.48it/s]
 35%|███▌      | 130635/371472 [10:23:06<18:59:01,  3.52it/s]
 35%|███▌      | 130636/371472 [10:23:07<18:32:13,  3.61it/s]
 35%|███▌      | 130637/371472 [10:23:07<18:43:38,  3.57it/s]
 35%|███▌      | 130638/371472 [10:23:07<18:20:04,  3.65it/s]
 35%|███▌      | 130639/371472 [10:23:07<18:24:22,  3.63it/s]
 35%|███▌      | 130640/371472 [10:23:08<18:35:55,  3.60it/s]
                                                             
{'loss': 3.1734, 'learning_rate': 6.838005559266522e-07, 'epoch': 5.63}

 35%|███▌      | 130640/371472 [10:23:08<18:35:55,  3.60it/s]
 35%|███▌      | 130641/371472 [10:23:08<18:18:02,  3.66it/s]
 35%|███▌      | 130642/371472 [10:23:08<18:54:21,  3.54it/s]
 35%|███▌      | 130643/371472 [10:23:09<18:38:39,  3.59it/s]
 35%|███▌      | 130644/371472 [10:23:09<18:31:52,  3.61it/s]
 35%|███▌      | 130645/371472 [10:23:09<17:43:58,  3.77it/s]
 35%|███▌      | 130646/371472 [10:23:09<17:21:55,  3.85it/s]
 35%|███▌      | 130647/371472 [10:23:10<17:41:03,  3.78it/s]
 35%|███▌      | 130648/371472 [10:23:10<18:37:09,  3.59it/s]
 35%|███▌      | 130649/371472 [10:23:10<19:43:16,  3.39it/s]
 35%|███▌      | 130650/371472 [10:23:11<19:04:11,  3.51it/s]
 35%|███▌      | 130651/371472 [10:23:11<19:53:05,  3.36it/s]
 35%|███▌      | 130652/371472 [10:23:11<18:49:11,  3.55it/s]
 35%|███▌      | 130653/371472 [10:23:11<18:52:19,  3.54it/s]
 35%|███▌      | 130654/371472 [10:23:12<18:17:37,  3.66it/s]
 35%|███▌      | 130655/371472 [10:23:12<18:10:22,  3.68it/s]
 35%|███▌      | 130656/371472 [10:23:12<18:57:03,  3.53it/s]
 35%|███▌      | 130657/371472 [10:23:12<18:14:52,  3.67it/s]
 35%|███▌      | 130658/371472 [10:23:13<18:36:33,  3.59it/s]
 35%|███▌      | 130659/371472 [10:23:13<18:09:34,  3.68it/s]
 35%|███▌      | 130660/371472 [10:23:13<18:17:42,  3.66it/s]
                                                             
{'loss': 3.1844, 'learning_rate': 6.837520739511733e-07, 'epoch': 5.63}

 35%|███▌      | 130660/371472 [10:23:13<18:17:42,  3.66it/s]
 35%|███▌      | 130661/371472 [10:23:14<18:29:27,  3.62it/s]
 35%|███▌      | 130662/371472 [10:23:14<18:36:39,  3.59it/s]
 35%|███▌      | 130663/371472 [10:23:14<19:11:52,  3.48it/s]
 35%|███▌      | 130664/371472 [10:23:15<21:05:00,  3.17it/s]
 35%|███▌      | 130665/371472 [10:23:15<19:53:01,  3.36it/s]
 35%|███▌      | 130666/371472 [10:23:15<19:04:16,  3.51it/s]
 35%|███▌      | 130667/371472 [10:23:15<19:28:41,  3.43it/s]
 35%|███▌      | 130668/371472 [10:23:16<18:59:28,  3.52it/s]
 35%|███▌      | 130669/371472 [10:23:16<18:13:11,  3.67it/s]
 35%|███▌      | 130670/371472 [10:23:16<18:56:27,  3.53it/s]
 35%|███▌      | 130671/371472 [10:23:16<18:15:40,  3.66it/s]
 35%|███▌      | 130672/371472 [10:23:17<18:28:02,  3.62it/s]
 35%|███▌      | 130673/371472 [10:23:17<18:26:42,  3.63it/s]
 35%|███▌      | 130674/371472 [10:23:17<18:34:10,  3.60it/s]
 35%|███▌      | 130675/371472 [10:23:18<19:23:53,  3.45it/s]
 35%|███▌      | 130676/371472 [10:23:18<18:50:37,  3.55it/s]
 35%|███▌      | 130677/371472 [10:23:18<18:04:40,  3.70it/s]
 35%|███▌      | 130678/371472 [10:23:18<19:35:50,  3.41it/s]
 35%|███▌      | 130679/371472 [10:23:19<18:20:34,  3.65it/s]
 35%|███▌      | 130680/371472 [10:23:19<17:31:20,  3.82it/s]
                                                             
{'loss': 3.116, 'learning_rate': 6.837035919756943e-07, 'epoch': 5.63}

 35%|███▌      | 130680/371472 [10:23:19<17:31:20,  3.82it/s]
 35%|███▌      | 130681/371472 [10:23:19<17:43:56,  3.77it/s]
 35%|███▌      | 130682/371472 [10:23:19<17:24:54,  3.84it/s]
 35%|███▌      | 130683/371472 [10:23:20<18:10:45,  3.68it/s]
 35%|███▌      | 130684/371472 [10:23:20<17:42:05,  3.78it/s]
 35%|███▌      | 130685/371472 [10:23:20<17:42:00,  3.78it/s]
 35%|███▌      | 130686/371472 [10:23:21<18:04:46,  3.70it/s]
 35%|███▌      | 130687/371472 [10:23:21<17:55:18,  3.73it/s]
 35%|███▌      | 130688/371472 [10:23:21<18:31:47,  3.61it/s]
 35%|███▌      | 130689/371472 [10:23:21<17:49:36,  3.75it/s]
 35%|███▌      | 130690/371472 [10:23:22<18:19:53,  3.65it/s]
 35%|███▌      | 130691/371472 [10:23:22<18:10:43,  3.68it/s]
 35%|███▌      | 130692/371472 [10:23:22<18:28:24,  3.62it/s]
 35%|███▌      | 130693/371472 [10:23:22<18:04:10,  3.70it/s]
 35%|███▌      | 130694/371472 [10:23:23<17:41:41,  3.78it/s]
 35%|███▌      | 130695/371472 [10:23:23<18:06:05,  3.69it/s]
 35%|███▌      | 130696/371472 [10:23:23<18:29:19,  3.62it/s]
 35%|███▌      | 130697/371472 [10:23:24<18:27:39,  3.62it/s]
 35%|███▌      | 130698/371472 [10:23:24<17:52:14,  3.74it/s]
 35%|███▌      | 130699/371472 [10:23:24<17:56:29,  3.73it/s]
 35%|███▌      | 130700/371472 [10:23:24<18:24:47,  3.63it/s]
                                                             
{'loss': 3.1303, 'learning_rate': 6.836551100002154e-07, 'epoch': 5.63}

 35%|███▌      | 130700/371472 [10:23:24<18:24:47,  3.63it/s]
 35%|███▌      | 130701/371472 [10:23:25<17:41:10,  3.78it/s]
 35%|███▌      | 130702/371472 [10:23:25<17:31:38,  3.82it/s]
 35%|███▌      | 130703/371472 [10:23:25<19:25:12,  3.44it/s]
 35%|███▌      | 130704/371472 [10:23:25<18:30:50,  3.61it/s]
 35%|███▌      | 130705/371472 [10:23:26<18:15:51,  3.66it/s]
 35%|███▌      | 130706/371472 [10:23:26<19:52:23,  3.37it/s]
 35%|███▌      | 130707/371472 [10:23:26<20:01:37,  3.34it/s]
 35%|███▌      | 130708/371472 [10:23:27<20:03:02,  3.34it/s]
 35%|███▌      | 130709/371472 [10:23:27<20:38:27,  3.24it/s]
 35%|███▌      | 130710/371472 [10:23:27<19:58:28,  3.35it/s]
 35%|███▌      | 130711/371472 [10:23:28<19:40:56,  3.40it/s]
 35%|███▌      | 130712/371472 [10:23:28<18:47:15,  3.56it/s]
 35%|███▌      | 130713/371472 [10:23:28<19:11:19,  3.49it/s]
 35%|███▌      | 130714/371472 [10:23:28<19:03:14,  3.51it/s]
 35%|███▌      | 130715/371472 [10:23:29<19:06:16,  3.50it/s]
 35%|███▌      | 130716/371472 [10:23:29<19:58:50,  3.35it/s]
 35%|███▌      | 130717/371472 [10:23:29<20:10:09,  3.32it/s]
 35%|███▌      | 130718/371472 [10:23:30<21:46:19,  3.07it/s]
 35%|███▌      | 130719/371472 [10:23:30<21:10:12,  3.16it/s]
 35%|███▌      | 130720/371472 [10:23:30<19:44:33,  3.39it/s]
                                                             
{'loss': 3.1137, 'learning_rate': 6.836066280247366e-07, 'epoch': 5.63}

 35%|███▌      | 130720/371472 [10:23:30<19:44:33,  3.39it/s]
 35%|███▌      | 130721/371472 [10:23:31<19:48:24,  3.38it/s]
 35%|███▌      | 130722/371472 [10:23:31<19:26:01,  3.44it/s]
 35%|███▌      | 130723/371472 [10:23:31<18:22:49,  3.64it/s]
 35%|███▌      | 130724/371472 [10:23:31<19:35:25,  3.41it/s]
 35%|███▌      | 130725/371472 [10:23:32<19:33:04,  3.42it/s]
 35%|███▌      | 130726/371472 [10:23:32<19:24:34,  3.45it/s]
 35%|███▌      | 130727/371472 [10:23:32<19:10:11,  3.49it/s]
 35%|███▌      | 130728/371472 [10:23:33<18:49:27,  3.55it/s]
 35%|███▌      | 130729/371472 [10:23:33<18:36:38,  3.59it/s]
 35%|███▌      | 130730/371472 [10:23:33<18:16:34,  3.66it/s]
 35%|███▌      | 130731/371472 [10:23:33<18:33:21,  3.60it/s]
 35%|███▌      | 130732/371472 [10:23:34<17:39:30,  3.79it/s]
 35%|███▌      | 130733/371472 [10:23:34<16:58:52,  3.94it/s]
 35%|███▌      | 130734/371472 [10:23:34<16:29:50,  4.05it/s]
 35%|███▌      | 130735/371472 [10:23:34<17:01:01,  3.93it/s]
 35%|███▌      | 130736/371472 [10:23:35<18:09:32,  3.68it/s]
 35%|███▌      | 130737/371472 [10:23:35<17:49:34,  3.75it/s]
 35%|███▌      | 130738/371472 [10:23:35<17:37:45,  3.79it/s]
 35%|███▌      | 130739/371472 [10:23:35<17:58:23,  3.72it/s]
 35%|███▌      | 130740/371472 [10:23:36<18:14:26,  3.67it/s]
                                                             
{'loss': 3.2246, 'learning_rate': 6.835581460492577e-07, 'epoch': 5.63}

 35%|███▌      | 130740/371472 [10:23:36<18:14:26,  3.67it/s]
 35%|███▌      | 130741/371472 [10:23:36<17:36:47,  3.80it/s]
 35%|███▌      | 130742/371472 [10:23:36<17:36:45,  3.80it/s]
 35%|███▌      | 130743/371472 [10:23:36<17:49:46,  3.75it/s]
 35%|███▌      | 130744/371472 [10:23:37<17:37:23,  3.79it/s]
 35%|███▌      | 130745/371472 [10:23:37<16:52:09,  3.96it/s]
 35%|███▌      | 130746/371472 [10:23:37<16:42:04,  4.00it/s]
 35%|███▌      | 130747/371472 [10:23:37<16:49:10,  3.98it/s]
 35%|███▌      | 130748/371472 [10:23:38<16:51:21,  3.97it/s]
 35%|███▌      | 130749/371472 [10:23:38<17:06:29,  3.91it/s]
 35%|███▌      | 130750/371472 [10:23:38<18:23:14,  3.64it/s]
 35%|███▌      | 130751/371472 [10:23:39<17:52:57,  3.74it/s]
 35%|███▌      | 130752/371472 [10:23:39<18:09:36,  3.68it/s]
 35%|███▌      | 130753/371472 [10:23:39<18:56:16,  3.53it/s]
 35%|███▌      | 130754/371472 [10:23:39<19:22:04,  3.45it/s]
 35%|███▌      | 130755/371472 [10:23:40<19:11:23,  3.48it/s]
 35%|███▌      | 130756/371472 [10:23:40<19:09:59,  3.49it/s]
 35%|███▌      | 130757/371472 [10:23:40<20:23:44,  3.28it/s]
 35%|███▌      | 130758/371472 [10:23:41<20:44:13,  3.22it/s]
 35%|███▌      | 130759/371472 [10:23:41<19:51:30,  3.37it/s]
 35%|███▌      | 130760/371472 [10:23:41<19:29:57,  3.43it/s]
                                                             
{'loss': 3.2303, 'learning_rate': 6.835096640737789e-07, 'epoch': 5.63}

 35%|███▌      | 130760/371472 [10:23:41<19:29:57,  3.43it/s]
 35%|███▌      | 130761/371472 [10:23:41<18:20:45,  3.64it/s]
 35%|███▌      | 130762/371472 [10:23:42<19:36:05,  3.41it/s]
 35%|███▌      | 130763/371472 [10:23:42<19:17:43,  3.47it/s]
 35%|███▌      | 130764/371472 [10:23:42<19:09:24,  3.49it/s]
 35%|███▌      | 130765/371472 [10:23:43<19:20:54,  3.46it/s]
 35%|███▌      | 130766/371472 [10:23:43<19:11:38,  3.48it/s]
 35%|███▌      | 130767/371472 [10:23:43<18:21:29,  3.64it/s]
 35%|███▌      | 130768/371472 [10:23:43<18:24:05,  3.63it/s]
 35%|███▌      | 130769/371472 [10:23:44<18:10:07,  3.68it/s]
 35%|███▌      | 130770/371472 [10:23:44<18:11:54,  3.67it/s]
 35%|███▌      | 130771/371472 [10:23:44<18:38:29,  3.59it/s]
 35%|███▌      | 130772/371472 [10:23:45<19:26:42,  3.44it/s]
 35%|███▌      | 130773/371472 [10:23:45<18:23:51,  3.63it/s]
 35%|███▌      | 130774/371472 [10:23:45<19:00:28,  3.52it/s]
 35%|███▌      | 130775/371472 [10:23:45<18:44:38,  3.57it/s]
 35%|███▌      | 130776/371472 [10:23:46<18:26:57,  3.62it/s]
 35%|███▌      | 130777/371472 [10:23:46<18:35:21,  3.60it/s]
 35%|███▌      | 130778/371472 [10:23:46<20:01:17,  3.34it/s]
 35%|███▌      | 130779/371472 [10:23:47<19:57:38,  3.35it/s]
 35%|███▌      | 130780/371472 [10:23:47<19:03:06,  3.51it/s]
                                                             
{'loss': 3.1437, 'learning_rate': 6.834611820982999e-07, 'epoch': 5.63}

 35%|███▌      | 130780/371472 [10:23:47<19:03:06,  3.51it/s]
 35%|███▌      | 130781/371472 [10:23:47<18:45:58,  3.56it/s]
 35%|███▌      | 130782/371472 [10:23:47<17:54:19,  3.73it/s]
 35%|███▌      | 130783/371472 [10:23:48<19:01:57,  3.51it/s]
 35%|███▌      | 130784/371472 [10:23:48<18:24:19,  3.63it/s]
 35%|███▌      | 130785/371472 [10:23:48<19:40:50,  3.40it/s]
 35%|███▌      | 130786/371472 [10:23:49<19:39:58,  3.40it/s]
 35%|███▌      | 130787/371472 [10:23:49<19:47:23,  3.38it/s]
 35%|███▌      | 130788/371472 [10:23:49<19:23:42,  3.45it/s]
 35%|███▌      | 130789/371472 [10:23:50<20:36:17,  3.24it/s]
 35%|███▌      | 130790/371472 [10:23:50<21:54:49,  3.05it/s]
 35%|███▌      | 130791/371472 [10:23:50<21:48:15,  3.07it/s]
 35%|███▌      | 130792/371472 [10:23:50<20:15:32,  3.30it/s]
 35%|███▌      | 130793/371472 [10:23:51<19:19:17,  3.46it/s]
 35%|███▌      | 130794/371472 [10:23:51<18:11:05,  3.68it/s]
 35%|███▌      | 130795/371472 [10:23:51<20:02:59,  3.33it/s]
 35%|███▌      | 130796/371472 [10:23:52<18:43:43,  3.57it/s]
 35%|███▌      | 130797/371472 [10:23:52<19:14:16,  3.48it/s]
 35%|███▌      | 130798/371472 [10:23:52<18:19:12,  3.65it/s]
 35%|███▌      | 130799/371472 [10:23:52<18:50:48,  3.55it/s]
 35%|███▌      | 130800/371472 [10:23:53<19:08:37,  3.49it/s]
                                                             
{'loss': 3.2279, 'learning_rate': 6.834127001228209e-07, 'epoch': 5.63}

 35%|███▌      | 130800/371472 [10:23:53<19:08:37,  3.49it/s]
 35%|███▌      | 130801/371472 [10:23:53<18:15:15,  3.66it/s]
 35%|███▌      | 130802/371472 [10:23:53<18:39:12,  3.58it/s]
 35%|███▌      | 130803/371472 [10:23:53<18:30:20,  3.61it/s]
 35%|███▌      | 130804/371472 [10:23:54<17:58:13,  3.72it/s]
 35%|███▌      | 130805/371472 [10:23:54<18:29:35,  3.61it/s]
 35%|███▌      | 130806/371472 [10:23:54<19:19:37,  3.46it/s]
 35%|███▌      | 130807/371472 [10:23:55<18:48:07,  3.56it/s]
 35%|███▌      | 130808/371472 [10:23:55<20:18:42,  3.29it/s]
 35%|███▌      | 130809/371472 [10:23:55<19:18:55,  3.46it/s]
 35%|███▌      | 130810/371472 [10:23:55<18:43:05,  3.57it/s]
 35%|███▌      | 130811/371472 [10:23:56<18:50:14,  3.55it/s]
 35%|███▌      | 130812/371472 [10:23:56<18:20:07,  3.65it/s]
 35%|███▌      | 130813/371472 [10:23:56<17:39:54,  3.78it/s]
 35%|███▌      | 130814/371472 [10:23:57<17:20:24,  3.86it/s]
 35%|███▌      | 130815/371472 [10:23:57<17:48:41,  3.75it/s]
 35%|███▌      | 130816/371472 [10:23:57<19:07:13,  3.50it/s]
 35%|███▌      | 130817/371472 [10:23:57<18:21:46,  3.64it/s]
 35%|███▌      | 130818/371472 [10:23:58<18:03:47,  3.70it/s]
 35%|███▌      | 130819/371472 [10:23:58<18:44:36,  3.57it/s]
 35%|███▌      | 130820/371472 [10:23:58<18:11:55,  3.67it/s]
                                                             
{'loss': 3.2933, 'learning_rate': 6.833642181473421e-07, 'epoch': 5.63}

 35%|███▌      | 130820/371472 [10:23:58<18:11:55,  3.67it/s]
 35%|███▌      | 130821/371472 [10:23:58<17:44:55,  3.77it/s]
 35%|███▌      | 130822/371472 [10:23:59<17:00:15,  3.93it/s]
 35%|███▌      | 130823/371472 [10:23:59<18:52:18,  3.54it/s]
 35%|███▌      | 130824/371472 [10:23:59<22:14:34,  3.01it/s]
 35%|███▌      | 130825/371472 [10:24:00<20:42:16,  3.23it/s]
 35%|███▌      | 130826/371472 [10:24:00<19:39:55,  3.40it/s]
 35%|███▌      | 130827/371472 [10:24:00<19:00:02,  3.52it/s]
 35%|███▌      | 130828/371472 [10:24:00<18:12:30,  3.67it/s]
 35%|███▌      | 130829/371472 [10:24:01<19:01:54,  3.51it/s]
 35%|███▌      | 130830/371472 [10:24:01<18:48:44,  3.55it/s]
 35%|███▌      | 130831/371472 [10:24:01<18:15:50,  3.66it/s]
 35%|███▌      | 130832/371472 [10:24:02<19:01:13,  3.51it/s]
 35%|███▌      | 130833/371472 [10:24:02<19:48:40,  3.37it/s]
 35%|███▌      | 130834/371472 [10:24:02<18:48:07,  3.56it/s]
 35%|███▌      | 130835/371472 [10:24:03<19:04:16,  3.50it/s]
 35%|███▌      | 130836/371472 [10:24:03<18:31:37,  3.61it/s]
 35%|███▌      | 130837/371472 [10:24:03<17:53:45,  3.74it/s]
 35%|███▌      | 130838/371472 [10:24:03<17:59:19,  3.72it/s]
 35%|███▌      | 130839/371472 [10:24:04<17:33:10,  3.81it/s]
 35%|███▌      | 130840/371472 [10:24:04<17:15:33,  3.87it/s]
                                                             
{'loss': 3.0662, 'learning_rate': 6.833157361718631e-07, 'epoch': 5.64}

 35%|███▌      | 130840/371472 [10:24:04<17:15:33,  3.87it/s]
 35%|███▌      | 130841/371472 [10:24:04<17:58:12,  3.72it/s]
 35%|███▌      | 130842/371472 [10:24:04<17:52:19,  3.74it/s]
 35%|███▌      | 130843/371472 [10:24:05<18:24:47,  3.63it/s]
 35%|███▌      | 130844/371472 [10:24:05<17:52:03,  3.74it/s]
 35%|███▌      | 130845/371472 [10:24:05<17:54:38,  3.73it/s]
 35%|███▌      | 130846/371472 [10:24:06<19:43:28,  3.39it/s]
 35%|███▌      | 130847/371472 [10:24:06<20:01:32,  3.34it/s]
 35%|███▌      | 130848/371472 [10:24:06<19:34:25,  3.41it/s]
 35%|███▌      | 130849/371472 [10:24:06<18:43:12,  3.57it/s]
 35%|███▌      | 130850/371472 [10:24:07<18:53:19,  3.54it/s]
 35%|███▌      | 130851/371472 [10:24:07<18:21:12,  3.64it/s]
 35%|███▌      | 130852/371472 [10:24:07<18:34:10,  3.60it/s]
 35%|███▌      | 130853/371472 [10:24:07<18:20:45,  3.64it/s]
 35%|███▌      | 130854/371472 [10:24:08<17:26:39,  3.83it/s]
 35%|███▌      | 130855/371472 [10:24:08<18:00:12,  3.71it/s]
 35%|███▌      | 130856/371472 [10:24:08<18:41:35,  3.58it/s]
 35%|███▌      | 130857/371472 [10:24:09<18:33:13,  3.60it/s]
 35%|███▌      | 130858/371472 [10:24:09<20:17:03,  3.30it/s]
 35%|███▌      | 130859/371472 [10:24:09<19:11:15,  3.48it/s]
 35%|███▌      | 130860/371472 [10:24:09<19:03:07,  3.51it/s]
                                                             
{'loss': 3.1152, 'learning_rate': 6.832672541963843e-07, 'epoch': 5.64}

 35%|███▌      | 130860/371472 [10:24:09<19:03:07,  3.51it/s]
 35%|███▌      | 130861/371472 [10:24:10<18:13:03,  3.67it/s]
 35%|███▌      | 130862/371472 [10:24:10<17:50:45,  3.75it/s]
 35%|███▌      | 130863/371472 [10:24:10<18:35:52,  3.59it/s]
 35%|███▌      | 130864/371472 [10:24:10<18:15:03,  3.66it/s]
 35%|███▌      | 130865/371472 [10:24:11<17:55:26,  3.73it/s]
 35%|███▌      | 130866/371472 [10:24:11<18:35:10,  3.60it/s]
 35%|███▌      | 130867/371472 [10:24:11<18:25:34,  3.63it/s]
 35%|███▌      | 130868/371472 [10:24:12<18:41:50,  3.57it/s]
 35%|███▌      | 130869/371472 [10:24:12<18:21:19,  3.64it/s]
 35%|███▌      | 130870/371472 [10:24:12<18:25:55,  3.63it/s]
 35%|███▌      | 130871/371472 [10:24:12<17:57:53,  3.72it/s]
 35%|███▌      | 130872/371472 [10:24:13<18:23:19,  3.63it/s]
 35%|███▌      | 130873/371472 [10:24:13<18:04:13,  3.70it/s]
 35%|███▌      | 130874/371472 [10:24:13<18:12:40,  3.67it/s]
 35%|███▌      | 130875/371472 [10:24:14<19:16:44,  3.47it/s]
 35%|███▌      | 130876/371472 [10:24:14<19:49:40,  3.37it/s]
 35%|███▌      | 130877/371472 [10:24:14<19:05:59,  3.50it/s]
 35%|███▌      | 130878/371472 [10:24:14<18:25:27,  3.63it/s]
 35%|███▌      | 130879/371472 [10:24:15<19:21:26,  3.45it/s]
 35%|███▌      | 130880/371472 [10:24:15<20:24:17,  3.28it/s]
                                                             
{'loss': 3.1508, 'learning_rate': 6.832187722209054e-07, 'epoch': 5.64}

 35%|███▌      | 130880/371472 [10:24:15<20:24:17,  3.28it/s]
 35%|███▌      | 130881/371472 [10:24:15<20:11:09,  3.31it/s]
 35%|███▌      | 130882/371472 [10:24:16<19:18:27,  3.46it/s]
 35%|███▌      | 130883/371472 [10:24:16<18:38:40,  3.58it/s]
 35%|███▌      | 130884/371472 [10:24:16<21:41:05,  3.08it/s]
 35%|███▌      | 130885/371472 [10:24:17<19:53:33,  3.36it/s]
 35%|███▌      | 130886/371472 [10:24:17<19:11:02,  3.48it/s]
 35%|███▌      | 130887/371472 [10:24:17<20:38:51,  3.24it/s]
 35%|███▌      | 130888/371472 [10:24:17<20:12:09,  3.31it/s]
 35%|███▌      | 130889/371472 [10:24:18<19:29:14,  3.43it/s]
 35%|███▌      | 130890/371472 [10:24:18<23:22:03,  2.86it/s]
 35%|███▌      | 130891/371472 [10:24:18<21:25:13,  3.12it/s]
 35%|███▌      | 130892/371472 [10:24:19<20:39:43,  3.23it/s]
 35%|███▌      | 130893/371472 [10:24:19<20:48:42,  3.21it/s]
 35%|███▌      | 130894/371472 [10:24:19<19:42:16,  3.39it/s]
 35%|███▌      | 130895/371472 [10:24:20<18:51:42,  3.54it/s]
 35%|███▌      | 130896/371472 [10:24:20<19:08:51,  3.49it/s]
 35%|███▌      | 130897/371472 [10:24:20<19:40:34,  3.40it/s]
 35%|███▌      | 130898/371472 [10:24:20<19:18:46,  3.46it/s]
 35%|███▌      | 130899/371472 [10:24:21<19:25:23,  3.44it/s]
 35%|███▌      | 130900/371472 [10:24:21<18:40:00,  3.58it/s]
                                                             
{'loss': 3.2658, 'learning_rate': 6.831702902454265e-07, 'epoch': 5.64}

 35%|███▌      | 130900/371472 [10:24:21<18:40:00,  3.58it/s]
 35%|███▌      | 130901/371472 [10:24:21<17:58:54,  3.72it/s]
 35%|███▌      | 130902/371472 [10:24:21<17:18:23,  3.86it/s]
 35%|███▌      | 130903/371472 [10:24:22<17:22:13,  3.85it/s]
 35%|███▌      | 130904/371472 [10:24:22<18:21:35,  3.64it/s]
 35%|███▌      | 130905/371472 [10:24:22<18:15:33,  3.66it/s]
 35%|███▌      | 130906/371472 [10:24:23<19:27:17,  3.43it/s]
 35%|███▌      | 130907/371472 [10:24:23<20:05:46,  3.33it/s]
 35%|███▌      | 130908/371472 [10:24:23<19:00:22,  3.52it/s]
 35%|███▌      | 130909/371472 [10:24:23<18:35:27,  3.59it/s]
 35%|███▌      | 130910/371472 [10:24:24<18:37:31,  3.59it/s]
 35%|███▌      | 130911/371472 [10:24:24<20:52:12,  3.20it/s]
 35%|███▌      | 130912/371472 [10:24:24<20:23:11,  3.28it/s]
 35%|███▌      | 130913/371472 [10:24:25<20:49:27,  3.21it/s]
 35%|███▌      | 130914/371472 [10:24:25<19:39:06,  3.40it/s]
 35%|███▌      | 130915/371472 [10:24:25<18:55:09,  3.53it/s]
 35%|███▌      | 130916/371472 [10:24:26<20:20:52,  3.28it/s]
 35%|███▌      | 130917/371472 [10:24:26<18:56:51,  3.53it/s]
 35%|███▌      | 130918/371472 [10:24:26<20:33:55,  3.25it/s]
 35%|███▌      | 130919/371472 [10:24:26<19:42:07,  3.39it/s]
 35%|███▌      | 130920/371472 [10:24:27<19:03:51,  3.50it/s]
                                                             
{'loss': 3.1537, 'learning_rate': 6.831218082699476e-07, 'epoch': 5.64}

 35%|███▌      | 130920/371472 [10:24:27<19:03:51,  3.50it/s]
 35%|███▌      | 130921/371472 [10:24:27<19:10:53,  3.48it/s]
 35%|███▌      | 130922/371472 [10:24:27<18:26:33,  3.62it/s]
 35%|███▌      | 130923/371472 [10:24:28<21:02:41,  3.18it/s]
 35%|███▌      | 130924/371472 [10:24:28<21:57:02,  3.04it/s]
 35%|███▌      | 130925/371472 [10:24:28<21:12:44,  3.15it/s]
 35%|███▌      | 130926/371472 [10:24:29<19:30:18,  3.43it/s]
 35%|███▌      | 130927/371472 [10:24:29<18:51:53,  3.54it/s]
 35%|███▌      | 130928/371472 [10:24:29<18:46:22,  3.56it/s]
 35%|███▌      | 130929/371472 [10:24:29<17:59:48,  3.71it/s]
 35%|███▌      | 130930/371472 [10:24:30<18:02:27,  3.70it/s]
 35%|███▌      | 130931/371472 [10:24:30<18:36:44,  3.59it/s]
 35%|███▌      | 130932/371472 [10:24:30<18:23:32,  3.63it/s]
 35%|███▌      | 130933/371472 [10:24:30<17:37:22,  3.79it/s]
 35%|███▌      | 130934/371472 [10:24:31<17:59:08,  3.71it/s]
 35%|███▌      | 130935/371472 [10:24:31<17:49:45,  3.75it/s]
 35%|███▌      | 130936/371472 [10:24:31<17:35:56,  3.80it/s]
 35%|███▌      | 130937/371472 [10:24:32<18:11:12,  3.67it/s]
 35%|███▌      | 130938/371472 [10:24:32<17:53:11,  3.74it/s]
 35%|███▌      | 130939/371472 [10:24:32<18:14:34,  3.66it/s]
 35%|███▌      | 130940/371472 [10:24:32<19:20:04,  3.46it/s]
                                                             
{'loss': 3.2088, 'learning_rate': 6.830733262944687e-07, 'epoch': 5.64}

 35%|███▌      | 130940/371472 [10:24:32<19:20:04,  3.46it/s]
 35%|███▌      | 130941/371472 [10:24:33<19:43:05,  3.39it/s]
 35%|███▌      | 130942/371472 [10:24:33<19:39:02,  3.40it/s]
 35%|███▌      | 130943/371472 [10:24:33<18:38:28,  3.58it/s]
 35%|███▌      | 130944/371472 [10:24:33<17:49:07,  3.75it/s]
 35%|███▌      | 130945/371472 [10:24:34<17:52:49,  3.74it/s]
 35%|███▌      | 130946/371472 [10:24:34<18:48:16,  3.55it/s]
 35%|███▌      | 130947/371472 [10:24:34<18:24:10,  3.63it/s]
 35%|███▌      | 130948/371472 [10:24:35<18:09:41,  3.68it/s]
 35%|███▌      | 130949/371472 [10:24:35<18:37:49,  3.59it/s]
 35%|███▌      | 130950/371472 [10:24:35<18:17:11,  3.65it/s]
 35%|███▌      | 130951/371472 [10:24:35<17:41:35,  3.78it/s]
 35%|███▌      | 130952/371472 [10:24:36<17:50:15,  3.75it/s]
 35%|███▌      | 130953/371472 [10:24:36<18:58:04,  3.52it/s]
 35%|███▌      | 130954/371472 [10:24:36<18:12:03,  3.67it/s]
 35%|███▌      | 130955/371472 [10:24:36<17:54:36,  3.73it/s]
 35%|███▌      | 130956/371472 [10:24:37<17:20:42,  3.85it/s]
 35%|███▌      | 130957/371472 [10:24:37<17:03:28,  3.92it/s]
 35%|███▌      | 130958/371472 [10:24:37<17:08:55,  3.90it/s]
 35%|███▌      | 130959/371472 [10:24:37<16:57:47,  3.94it/s]
 35%|███▌      | 130960/371472 [10:24:38<17:41:14,  3.78it/s]
                                                             
{'loss': 3.0688, 'learning_rate': 6.830248443189898e-07, 'epoch': 5.64}

 35%|███▌      | 130960/371472 [10:24:38<17:41:14,  3.78it/s]
 35%|███▌      | 130961/371472 [10:24:38<18:09:33,  3.68it/s]
 35%|███▌      | 130962/371472 [10:24:38<18:08:50,  3.68it/s]
 35%|███▌      | 130963/371472 [10:24:39<18:31:11,  3.61it/s]
 35%|███▌      | 130964/371472 [10:24:39<21:21:51,  3.13it/s]
 35%|███▌      | 130965/371472 [10:24:39<20:10:16,  3.31it/s]
 35%|███▌      | 130966/371472 [10:24:40<19:09:31,  3.49it/s]
 35%|███▌      | 130967/371472 [10:24:40<19:14:21,  3.47it/s]
 35%|███▌      | 130968/371472 [10:24:40<20:30:32,  3.26it/s]
 35%|███▌      | 130969/371472 [10:24:41<22:03:47,  3.03it/s]
 35%|███▌      | 130970/371472 [10:24:41<21:25:01,  3.12it/s]
 35%|███▌      | 130971/371472 [10:24:41<19:55:44,  3.35it/s]
 35%|███▌      | 130972/371472 [10:24:41<19:02:30,  3.51it/s]
 35%|███▌      | 130973/371472 [10:24:42<18:51:14,  3.54it/s]
 35%|███▌      | 130974/371472 [10:24:42<18:33:34,  3.60it/s]
 35%|███▌      | 130975/371472 [10:24:42<17:43:03,  3.77it/s]
 35%|███▌      | 130976/371472 [10:24:42<18:37:19,  3.59it/s]
 35%|███▌      | 130977/371472 [10:24:43<18:11:52,  3.67it/s]
 35%|███▌      | 130978/371472 [10:24:43<17:55:24,  3.73it/s]
 35%|███▌      | 130979/371472 [10:24:43<18:21:57,  3.64it/s]
 35%|███▌      | 130980/371472 [10:24:44<18:07:42,  3.69it/s]
                                                             
{'loss': 3.2585, 'learning_rate': 6.829763623435109e-07, 'epoch': 5.64}

 35%|███▌      | 130980/371472 [10:24:44<18:07:42,  3.69it/s]
 35%|███▌      | 130981/371472 [10:24:44<17:35:05,  3.80it/s]
 35%|███▌      | 130982/371472 [10:24:44<17:48:48,  3.75it/s]
 35%|███▌      | 130983/371472 [10:24:44<17:48:14,  3.75it/s]
 35%|███▌      | 130984/371472 [10:24:45<18:14:09,  3.66it/s]
 35%|███▌      | 130985/371472 [10:24:45<17:44:51,  3.76it/s]
 35%|███▌      | 130986/371472 [10:24:45<18:04:57,  3.69it/s]
 35%|███▌      | 130987/371472 [10:24:45<19:08:36,  3.49it/s]
 35%|███▌      | 130988/371472 [10:24:46<19:22:15,  3.45it/s]
 35%|███▌      | 130989/371472 [10:24:46<18:25:12,  3.63it/s]
 35%|███▌      | 130990/371472 [10:24:46<18:05:32,  3.69it/s]
 35%|███▌      | 130991/371472 [10:24:47<18:02:21,  3.70it/s]
 35%|███▌      | 130992/371472 [10:24:47<19:01:26,  3.51it/s]
 35%|███▌      | 130993/371472 [10:24:47<18:43:08,  3.57it/s]
 35%|███▌      | 130994/371472 [10:24:47<19:55:48,  3.35it/s]
 35%|███▌      | 130995/371472 [10:24:48<19:38:54,  3.40it/s]
 35%|███▌      | 130996/371472 [10:24:48<20:08:40,  3.32it/s]
 35%|███▌      | 130997/371472 [10:24:48<20:39:54,  3.23it/s]
 35%|███▌      | 130998/371472 [10:24:49<19:58:28,  3.34it/s]
 35%|███▌      | 130999/371472 [10:24:49<19:09:53,  3.49it/s]
 35%|███▌      | 131000/371472 [10:24:49<18:39:48,  3.58it/s]
                                                             
{'loss': 3.2439, 'learning_rate': 6.82927880368032e-07, 'epoch': 5.64}

 35%|███▌      | 131000/371472 [10:24:49<18:39:48,  3.58it/s]
 35%|███▌      | 131001/371472 [10:24:49<19:05:49,  3.50it/s]
 35%|███▌      | 131002/371472 [10:24:50<19:18:07,  3.46it/s]
 35%|███▌      | 131003/371472 [10:24:50<18:22:56,  3.63it/s]
 35%|███▌      | 131004/371472 [10:24:50<18:50:12,  3.55it/s]
 35%|███▌      | 131005/371472 [10:24:51<17:55:08,  3.73it/s]
 35%|███▌      | 131006/371472 [10:24:51<20:57:05,  3.19it/s]
 35%|███▌      | 131007/371472 [10:24:51<20:03:17,  3.33it/s]
 35%|███▌      | 131008/371472 [10:24:52<19:29:58,  3.43it/s]
 35%|███▌      | 131009/371472 [10:24:52<19:41:48,  3.39it/s]
 35%|███▌      | 131010/371472 [10:24:52<19:20:32,  3.45it/s]
 35%|███▌      | 131011/371472 [10:24:52<20:36:49,  3.24it/s]
 35%|███▌      | 131012/371472 [10:24:53<20:46:58,  3.21it/s]
 35%|███▌      | 131013/371472 [10:24:53<19:41:35,  3.39it/s]
 35%|███▌      | 131014/371472 [10:24:53<20:15:13,  3.30it/s]
 35%|███▌      | 131015/371472 [10:24:54<19:44:21,  3.38it/s]
 35%|███▌      | 131016/371472 [10:24:54<19:45:31,  3.38it/s]
 35%|███▌      | 131017/371472 [10:24:54<19:15:40,  3.47it/s]
 35%|███▌      | 131018/371472 [10:24:54<18:24:11,  3.63it/s]
 35%|███▌      | 131019/371472 [10:24:55<18:51:30,  3.54it/s]
 35%|███▌      | 131020/371472 [10:24:55<20:26:19,  3.27it/s]
                                                             
{'loss': 3.124, 'learning_rate': 6.828793983925532e-07, 'epoch': 5.64}

 35%|███▌      | 131020/371472 [10:24:55<20:26:19,  3.27it/s]
 35%|███▌      | 131021/371472 [10:24:55<19:12:19,  3.48it/s]
 35%|███▌      | 131022/371472 [10:24:56<19:01:54,  3.51it/s]
 35%|███▌      | 131023/371472 [10:24:56<20:46:47,  3.21it/s]
 35%|███▌      | 131024/371472 [10:24:56<20:29:23,  3.26it/s]
 35%|███▌      | 131025/371472 [10:24:57<19:10:49,  3.48it/s]
 35%|███▌      | 131026/371472 [10:24:57<19:02:12,  3.51it/s]
 35%|███▌      | 131027/371472 [10:24:57<18:38:04,  3.58it/s]
 35%|███▌      | 131028/371472 [10:24:57<18:55:12,  3.53it/s]
 35%|███▌      | 131029/371472 [10:24:58<18:17:25,  3.65it/s]
 35%|███▌      | 131030/371472 [10:24:58<17:33:01,  3.81it/s]
 35%|███▌      | 131031/371472 [10:24:58<18:39:25,  3.58it/s]
 35%|███▌      | 131032/371472 [10:24:58<18:13:29,  3.66it/s]
 35%|███▌      | 131033/371472 [10:24:59<17:43:41,  3.77it/s]
 35%|███▌      | 131034/371472 [10:24:59<18:18:21,  3.65it/s]
 35%|███▌      | 131035/371472 [10:24:59<17:55:35,  3.73it/s]
 35%|███▌      | 131036/371472 [10:25:00<18:16:58,  3.65it/s]
 35%|███▌      | 131037/371472 [10:25:00<17:42:10,  3.77it/s]
 35%|███▌      | 131038/371472 [10:25:00<17:15:17,  3.87it/s]
 35%|███▌      | 131039/371472 [10:25:00<18:13:08,  3.67it/s]
 35%|███▌      | 131040/371472 [10:25:01<18:04:16,  3.70it/s]
                                                             
{'loss': 3.0572, 'learning_rate': 6.828309164170743e-07, 'epoch': 5.64}

 35%|███▌      | 131040/371472 [10:25:01<18:04:16,  3.70it/s]
 35%|███▌      | 131041/371472 [10:25:01<18:18:16,  3.65it/s]
 35%|███▌      | 131042/371472 [10:25:01<18:28:02,  3.62it/s]
 35%|███▌      | 131043/371472 [10:25:01<18:44:21,  3.56it/s]
 35%|███▌      | 131044/371472 [10:25:02<18:24:26,  3.63it/s]
 35%|███▌      | 131045/371472 [10:25:02<18:00:11,  3.71it/s]
 35%|███▌      | 131046/371472 [10:25:02<19:22:42,  3.45it/s]
 35%|███▌      | 131047/371472 [10:25:03<18:30:51,  3.61it/s]
 35%|███▌      | 131048/371472 [10:25:03<18:55:35,  3.53it/s]
 35%|███▌      | 131049/371472 [10:25:03<18:03:14,  3.70it/s]
 35%|███▌      | 131050/371472 [10:25:03<19:07:14,  3.49it/s]
 35%|███▌      | 131051/371472 [10:25:04<18:56:53,  3.52it/s]
 35%|███▌      | 131052/371472 [10:25:04<18:39:35,  3.58it/s]
 35%|███▌      | 131053/371472 [10:25:04<19:23:14,  3.44it/s]
 35%|███▌      | 131054/371472 [10:25:05<18:48:50,  3.55it/s]
 35%|███▌      | 131055/371472 [10:25:05<18:37:41,  3.59it/s]
 35%|███▌      | 131056/371472 [10:25:05<17:34:15,  3.80it/s]
 35%|███▌      | 131057/371472 [10:25:05<17:41:08,  3.78it/s]
 35%|███▌      | 131058/371472 [10:25:06<18:50:44,  3.54it/s]
 35%|███▌      | 131059/371472 [10:25:06<21:33:47,  3.10it/s]
 35%|███▌      | 131060/371472 [10:25:06<20:39:51,  3.23it/s]
                                                             
{'loss': 3.1064, 'learning_rate': 6.827824344415953e-07, 'epoch': 5.65}

 35%|███▌      | 131060/371472 [10:25:06<20:39:51,  3.23it/s]
 35%|███▌      | 131061/371472 [10:25:07<19:13:37,  3.47it/s]
 35%|███▌      | 131062/371472 [10:25:07<18:25:08,  3.63it/s]
 35%|███▌      | 131063/371472 [10:25:07<18:42:04,  3.57it/s]
 35%|███▌      | 131064/371472 [10:25:07<18:32:16,  3.60it/s]
 35%|███▌      | 131065/371472 [10:25:08<17:56:26,  3.72it/s]
 35%|███▌      | 131066/371472 [10:25:08<17:49:12,  3.75it/s]
 35%|███▌      | 131067/371472 [10:25:08<17:11:47,  3.88it/s]
 35%|███▌      | 131068/371472 [10:25:08<18:23:51,  3.63it/s]
 35%|███▌      | 131069/371472 [10:25:09<19:49:15,  3.37it/s]
 35%|███▌      | 131070/371472 [10:25:09<26:09:07,  2.55it/s]
 35%|███▌      | 131071/371472 [10:25:10<23:38:27,  2.82it/s]
 35%|███▌      | 131072/371472 [10:25:10<21:51:20,  3.06it/s]
 35%|███▌      | 131073/371472 [10:25:10<20:33:41,  3.25it/s]
 35%|███▌      | 131074/371472 [10:25:10<19:14:45,  3.47it/s]
 35%|███▌      | 131075/371472 [10:25:11<18:14:37,  3.66it/s]
 35%|███▌      | 131076/371472 [10:25:11<18:28:29,  3.61it/s]
 35%|███▌      | 131077/371472 [10:25:11<18:10:08,  3.68it/s]
 35%|███▌      | 131078/371472 [10:25:11<17:31:38,  3.81it/s]
 35%|███▌      | 131079/371472 [10:25:12<17:34:36,  3.80it/s]
 35%|███▌      | 131080/371472 [10:25:12<20:07:21,  3.32it/s]
                                                             
{'loss': 3.3465, 'learning_rate': 6.827339524661165e-07, 'epoch': 5.65}

 35%|███▌      | 131080/371472 [10:25:12<20:07:21,  3.32it/s]
 35%|███▌      | 131081/371472 [10:25:12<20:48:36,  3.21it/s]
 35%|███▌      | 131082/371472 [10:25:13<20:09:41,  3.31it/s]
 35%|███▌      | 131083/371472 [10:25:13<20:14:11,  3.30it/s]
 35%|███▌      | 131084/371472 [10:25:13<19:30:11,  3.42it/s]
 35%|███▌      | 131085/371472 [10:25:14<18:58:53,  3.52it/s]
 35%|███▌      | 131086/371472 [10:25:14<18:47:28,  3.55it/s]
 35%|███▌      | 131087/371472 [10:25:14<20:44:02,  3.22it/s]
 35%|███▌      | 131088/371472 [10:25:14<19:15:31,  3.47it/s]
 35%|███▌      | 131089/371472 [10:25:15<21:31:30,  3.10it/s]
 35%|███▌      | 131090/371472 [10:25:15<19:40:58,  3.39it/s]
 35%|███▌      | 131091/371472 [10:25:15<18:36:51,  3.59it/s]
 35%|███▌      | 131092/371472 [10:25:16<19:11:51,  3.48it/s]
 35%|███▌      | 131093/371472 [10:25:16<19:16:08,  3.47it/s]
 35%|███▌      | 131094/371472 [10:25:16<18:38:00,  3.58it/s]
 35%|███▌      | 131095/371472 [10:25:16<18:40:08,  3.58it/s]
 35%|███▌      | 131096/371472 [10:25:17<19:49:14,  3.37it/s]
 35%|███▌      | 131097/371472 [10:25:17<21:38:29,  3.09it/s]
 35%|███▌      | 131098/371472 [10:25:17<20:30:38,  3.26it/s]
 35%|███▌      | 131099/371472 [10:25:18<19:13:16,  3.47it/s]
 35%|███▌      | 131100/371472 [10:25:18<19:53:10,  3.36it/s]
                                                             
{'loss': 3.1171, 'learning_rate': 6.826854704906375e-07, 'epoch': 5.65}

 35%|███▌      | 131100/371472 [10:25:18<19:53:10,  3.36it/s]
 35%|███▌      | 131101/371472 [10:25:18<20:44:24,  3.22it/s]
 35%|███▌      | 131102/371472 [10:25:19<21:09:33,  3.16it/s]
 35%|███▌      | 131103/371472 [10:25:19<19:38:21,  3.40it/s]
 35%|███▌      | 131104/371472 [10:25:19<18:51:37,  3.54it/s]
 35%|███▌      | 131105/371472 [10:25:19<19:07:20,  3.49it/s]
 35%|███▌      | 131106/371472 [10:25:20<18:42:21,  3.57it/s]
 35%|███▌      | 131107/371472 [10:25:20<18:17:57,  3.65it/s]
 35%|███▌      | 131108/371472 [10:25:20<17:44:39,  3.76it/s]
 35%|███▌      | 131109/371472 [10:25:21<18:33:54,  3.60it/s]
 35%|███▌      | 131110/371472 [10:25:21<18:13:41,  3.66it/s]
 35%|███▌      | 131111/371472 [10:25:21<19:06:48,  3.49it/s]
 35%|███▌      | 131112/371472 [10:25:21<18:35:06,  3.59it/s]
 35%|███▌      | 131113/371472 [10:25:22<20:23:35,  3.27it/s]
 35%|███▌      | 131114/371472 [10:25:22<19:22:52,  3.44it/s]
 35%|███▌      | 131115/371472 [10:25:22<18:37:20,  3.59it/s]
 35%|███▌      | 131116/371472 [10:25:23<18:22:39,  3.63it/s]
 35%|███▌      | 131117/371472 [10:25:23<18:40:39,  3.57it/s]
 35%|███▌      | 131118/371472 [10:25:23<17:55:56,  3.72it/s]
 35%|███▌      | 131119/371472 [10:25:23<17:42:46,  3.77it/s]
 35%|███▌      | 131120/371472 [10:25:24<19:13:26,  3.47it/s]
                                                             
{'loss': 3.3204, 'learning_rate': 6.826369885151587e-07, 'epoch': 5.65}

 35%|███▌      | 131120/371472 [10:25:24<19:13:26,  3.47it/s]
 35%|███▌      | 131121/371472 [10:25:24<20:22:38,  3.28it/s]
 35%|███▌      | 131122/371472 [10:25:24<21:07:42,  3.16it/s]
 35%|███▌      | 131123/371472 [10:25:25<22:22:12,  2.98it/s]
 35%|███▌      | 131124/371472 [10:25:25<21:19:48,  3.13it/s]
 35%|███▌      | 131125/371472 [10:25:25<19:50:03,  3.37it/s]
 35%|███▌      | 131126/371472 [10:25:26<20:39:21,  3.23it/s]
 35%|███▌      | 131127/371472 [10:25:26<19:33:48,  3.41it/s]
 35%|███▌      | 131128/371472 [10:25:26<18:48:08,  3.55it/s]
 35%|███▌      | 131129/371472 [10:25:26<17:58:42,  3.71it/s]
 35%|███▌      | 131130/371472 [10:25:27<18:05:08,  3.69it/s]
 35%|███▌      | 131131/371472 [10:25:27<18:01:30,  3.70it/s]
 35%|███▌      | 131132/371472 [10:25:27<17:57:28,  3.72it/s]
 35%|███▌      | 131133/371472 [10:25:27<17:40:37,  3.78it/s]
 35%|███▌      | 131134/371472 [10:25:28<17:32:31,  3.81it/s]
 35%|███▌      | 131135/371472 [10:25:28<17:41:32,  3.77it/s]
 35%|███▌      | 131136/371472 [10:25:28<17:46:30,  3.76it/s]
 35%|███▌      | 131137/371472 [10:25:28<17:39:31,  3.78it/s]
 35%|███▌      | 131138/371472 [10:25:29<17:36:58,  3.79it/s]
 35%|███▌      | 131139/371472 [10:25:29<18:12:41,  3.67it/s]
 35%|███▌      | 131140/371472 [10:25:29<18:28:14,  3.61it/s]
                                                             
{'loss': 3.0589, 'learning_rate': 6.825885065396798e-07, 'epoch': 5.65}

 35%|███▌      | 131140/371472 [10:25:29<18:28:14,  3.61it/s]
 35%|███▌      | 131141/371472 [10:25:30<18:02:23,  3.70it/s]
 35%|███▌      | 131142/371472 [10:25:30<18:35:49,  3.59it/s]
 35%|███▌      | 131143/371472 [10:25:30<19:16:39,  3.46it/s]
 35%|███▌      | 131144/371472 [10:25:30<18:52:28,  3.54it/s]
 35%|███▌      | 131145/371472 [10:25:31<18:24:05,  3.63it/s]
 35%|███▌      | 131146/371472 [10:25:31<18:04:12,  3.69it/s]
 35%|███▌      | 131147/371472 [10:25:31<19:18:13,  3.46it/s]
 35%|███▌      | 131148/371472 [10:25:32<18:29:28,  3.61it/s]
 35%|███▌      | 131149/371472 [10:25:32<19:34:46,  3.41it/s]
 35%|███▌      | 131150/371472 [10:25:32<19:24:57,  3.44it/s]
 35%|███▌      | 131151/371472 [10:25:32<18:45:32,  3.56it/s]
 35%|███▌      | 131152/371472 [10:25:33<18:11:37,  3.67it/s]
 35%|███▌      | 131153/371472 [10:25:33<18:08:10,  3.68it/s]
 35%|███▌      | 131154/371472 [10:25:33<18:08:34,  3.68it/s]
 35%|███▌      | 131155/371472 [10:25:33<18:03:20,  3.70it/s]
 35%|███▌      | 131156/371472 [10:25:34<18:01:06,  3.70it/s]
 35%|███▌      | 131157/371472 [10:25:34<18:55:31,  3.53it/s]
 35%|███▌      | 131158/371472 [10:25:34<18:55:59,  3.53it/s]
 35%|███▌      | 131159/371472 [10:25:35<18:26:25,  3.62it/s]
 35%|███▌      | 131160/371472 [10:25:35<20:56:15,  3.19it/s]
                                                             
{'loss': 3.1474, 'learning_rate': 6.825400245642009e-07, 'epoch': 5.65}

 35%|███▌      | 131160/371472 [10:25:35<20:56:15,  3.19it/s]
 35%|███▌      | 131161/371472 [10:25:35<20:45:10,  3.22it/s]
 35%|███▌      | 131162/371472 [10:25:36<19:21:30,  3.45it/s]
 35%|███▌      | 131163/371472 [10:25:36<18:57:14,  3.52it/s]
 35%|███▌      | 131164/371472 [10:25:36<18:18:19,  3.65it/s]
 35%|███▌      | 131165/371472 [10:25:36<19:08:32,  3.49it/s]
 35%|███▌      | 131166/371472 [10:25:37<20:06:08,  3.32it/s]
 35%|███▌      | 131167/371472 [10:25:37<20:42:24,  3.22it/s]
 35%|███▌      | 131168/371472 [10:25:37<19:22:47,  3.44it/s]
 35%|███▌      | 131169/371472 [10:25:38<19:39:39,  3.40it/s]
 35%|███▌      | 131170/371472 [10:25:38<19:13:31,  3.47it/s]
 35%|███▌      | 131171/371472 [10:25:38<18:46:14,  3.56it/s]
 35%|███▌      | 131172/371472 [10:25:38<18:13:56,  3.66it/s]
 35%|███▌      | 131173/371472 [10:25:39<19:03:55,  3.50it/s]
 35%|███▌      | 131174/371472 [10:25:39<19:15:09,  3.47it/s]
 35%|███▌      | 131175/371472 [10:25:39<20:16:02,  3.29it/s]
 35%|███▌      | 131176/371472 [10:25:40<20:09:45,  3.31it/s]
 35%|███▌      | 131177/371472 [10:25:40<19:13:15,  3.47it/s]
 35%|███▌      | 131178/371472 [10:25:40<18:47:30,  3.55it/s]
 35%|███▌      | 131179/371472 [10:25:40<18:06:55,  3.68it/s]
 35%|███▌      | 131180/371472 [10:25:41<18:45:17,  3.56it/s]
                                                             
{'loss': 3.2572, 'learning_rate': 6.824915425887219e-07, 'epoch': 5.65}

 35%|███▌      | 131180/371472 [10:25:41<18:45:17,  3.56it/s]
 35%|███▌      | 131181/371472 [10:25:41<18:28:54,  3.61it/s]
 35%|███▌      | 131182/371472 [10:25:41<19:12:51,  3.47it/s]
 35%|███▌      | 131183/371472 [10:25:42<20:03:42,  3.33it/s]
 35%|███▌      | 131184/371472 [10:25:42<19:28:37,  3.43it/s]
 35%|███▌      | 131185/371472 [10:25:42<21:44:29,  3.07it/s]
 35%|███▌      | 131186/371472 [10:25:43<20:26:18,  3.27it/s]
 35%|███▌      | 131187/371472 [10:25:43<20:09:08,  3.31it/s]
 35%|███▌      | 131188/371472 [10:25:43<19:11:33,  3.48it/s]
 35%|███▌      | 131189/371472 [10:25:43<18:43:26,  3.56it/s]
 35%|███▌      | 131190/371472 [10:25:44<18:01:11,  3.70it/s]
 35%|███▌      | 131191/371472 [10:25:44<17:51:43,  3.74it/s]
 35%|███▌      | 131192/371472 [10:25:44<17:20:14,  3.85it/s]
 35%|███▌      | 131193/371472 [10:25:44<16:57:20,  3.94it/s]
 35%|███▌      | 131194/371472 [10:25:45<17:26:25,  3.83it/s]
 35%|███▌      | 131195/371472 [10:25:45<17:53:43,  3.73it/s]
 35%|███▌      | 131196/371472 [10:25:45<19:38:56,  3.40it/s]
 35%|███▌      | 131197/371472 [10:25:46<19:07:29,  3.49it/s]
 35%|███▌      | 131198/371472 [10:25:46<18:55:03,  3.53it/s]
 35%|███▌      | 131199/371472 [10:25:46<18:22:12,  3.63it/s]
 35%|███▌      | 131200/371472 [10:25:46<17:55:00,  3.73it/s]
                                                             
{'loss': 2.9921, 'learning_rate': 6.824430606132431e-07, 'epoch': 5.65}

 35%|███▌      | 131200/371472 [10:25:46<17:55:00,  3.73it/s]
 35%|███▌      | 131201/371472 [10:25:47<20:02:27,  3.33it/s]
 35%|███▌      | 131202/371472 [10:25:47<20:33:13,  3.25it/s]
 35%|███▌      | 131203/371472 [10:25:47<18:59:59,  3.51it/s]
 35%|███▌      | 131204/371472 [10:25:48<18:32:30,  3.60it/s]
 35%|███▌      | 131205/371472 [10:25:48<18:50:31,  3.54it/s]
 35%|███▌      | 131206/371472 [10:25:48<18:04:56,  3.69it/s]
 35%|███▌      | 131207/371472 [10:25:48<17:48:05,  3.75it/s]
 35%|███▌      | 131208/371472 [10:25:49<18:55:49,  3.53it/s]
 35%|███▌      | 131209/371472 [10:25:49<18:29:39,  3.61it/s]
 35%|███▌      | 131210/371472 [10:25:49<18:34:14,  3.59it/s]
 35%|███▌      | 131211/371472 [10:25:49<17:56:23,  3.72it/s]
 35%|███▌      | 131212/371472 [10:25:50<17:54:54,  3.73it/s]
 35%|███▌      | 131213/371472 [10:25:50<18:25:10,  3.62it/s]
 35%|███▌      | 131214/371472 [10:25:50<19:28:10,  3.43it/s]
 35%|███▌      | 131215/371472 [10:25:51<20:03:25,  3.33it/s]
 35%|███▌      | 131216/371472 [10:25:51<18:51:32,  3.54it/s]
 35%|███▌      | 131217/371472 [10:25:51<18:20:53,  3.64it/s]
 35%|███▌      | 131218/371472 [10:25:51<17:21:39,  3.84it/s]
 35%|███▌      | 131219/371472 [10:25:52<17:08:51,  3.89it/s]
 35%|███▌      | 131220/371472 [10:25:52<17:45:04,  3.76it/s]
                                                             
{'loss': 3.2725, 'learning_rate': 6.823945786377642e-07, 'epoch': 5.65}

 35%|███▌      | 131220/371472 [10:25:52<17:45:04,  3.76it/s]
 35%|███▌      | 131221/371472 [10:25:52<17:53:25,  3.73it/s]
 35%|███▌      | 131222/371472 [10:25:52<17:50:45,  3.74it/s]
 35%|███▌      | 131223/371472 [10:25:53<18:11:26,  3.67it/s]
 35%|███▌      | 131224/371472 [10:25:53<18:14:29,  3.66it/s]
 35%|███▌      | 131225/371472 [10:25:53<19:34:21,  3.41it/s]
 35%|███▌      | 131226/371472 [10:25:54<19:45:19,  3.38it/s]
 35%|███▌      | 131227/371472 [10:25:54<19:00:00,  3.51it/s]
 35%|███▌      | 131228/371472 [10:25:54<18:24:54,  3.62it/s]
 35%|███▌      | 131229/371472 [10:25:54<17:43:43,  3.76it/s]
 35%|███▌      | 131230/371472 [10:25:55<18:24:21,  3.63it/s]
 35%|███▌      | 131231/371472 [10:25:55<17:50:10,  3.74it/s]
 35%|███▌      | 131232/371472 [10:25:55<18:52:04,  3.54it/s]
 35%|███▌      | 131233/371472 [10:25:56<19:06:58,  3.49it/s]
 35%|███▌      | 131234/371472 [10:25:56<18:54:11,  3.53it/s]
 35%|███▌      | 131235/371472 [10:25:56<18:50:31,  3.54it/s]
 35%|███▌      | 131236/371472 [10:25:56<19:18:44,  3.46it/s]
 35%|███▌      | 131237/371472 [10:25:57<19:50:48,  3.36it/s]
 35%|███▌      | 131238/371472 [10:25:57<19:55:36,  3.35it/s]
 35%|███▌      | 131239/371472 [10:25:57<18:46:47,  3.55it/s]
 35%|███▌      | 131240/371472 [10:25:58<19:44:40,  3.38it/s]
                                                             
{'loss': 3.1645, 'learning_rate': 6.823460966622853e-07, 'epoch': 5.65}

 35%|███▌      | 131240/371472 [10:25:58<19:44:40,  3.38it/s]
 35%|███▌      | 131241/371472 [10:25:58<20:02:53,  3.33it/s]
 35%|███▌      | 131242/371472 [10:25:58<19:27:01,  3.43it/s]
 35%|███▌      | 131243/371472 [10:25:58<18:34:27,  3.59it/s]
 35%|███▌      | 131244/371472 [10:25:59<18:47:39,  3.55it/s]
 35%|███▌      | 131245/371472 [10:25:59<18:05:40,  3.69it/s]
 35%|███▌      | 131246/371472 [10:25:59<17:34:23,  3.80it/s]
 35%|███▌      | 131247/371472 [10:25:59<17:38:54,  3.78it/s]
 35%|███▌      | 131248/371472 [10:26:00<17:22:31,  3.84it/s]
 35%|███▌      | 131249/371472 [10:26:00<18:34:59,  3.59it/s]
 35%|███▌      | 131250/371472 [10:26:00<18:03:36,  3.69it/s]
 35%|███▌      | 131251/371472 [10:26:01<17:32:39,  3.80it/s]
 35%|███▌      | 131252/371472 [10:26:01<16:51:41,  3.96it/s]
 35%|███▌      | 131253/371472 [10:26:01<17:33:32,  3.80it/s]
 35%|███▌      | 131254/371472 [10:26:01<17:14:08,  3.87it/s]
 35%|███▌      | 131255/371472 [10:26:02<17:32:33,  3.80it/s]
 35%|███▌      | 131256/371472 [10:26:02<19:59:27,  3.34it/s]
 35%|███▌      | 131257/371472 [10:26:02<19:19:20,  3.45it/s]
 35%|███▌      | 131258/371472 [10:26:02<18:44:21,  3.56it/s]
 35%|███▌      | 131259/371472 [10:26:03<18:35:48,  3.59it/s]
 35%|███▌      | 131260/371472 [10:26:03<18:54:45,  3.53it/s]
                                                             
{'loss': 3.2603, 'learning_rate': 6.822976146868064e-07, 'epoch': 5.65}

 35%|███▌      | 131260/371472 [10:26:03<18:54:45,  3.53it/s]
 35%|███▌      | 131261/371472 [10:26:03<18:55:04,  3.53it/s]
 35%|███▌      | 131262/371472 [10:26:04<18:17:43,  3.65it/s]
 35%|███▌      | 131263/371472 [10:26:04<19:54:42,  3.35it/s]
 35%|███▌      | 131264/371472 [10:26:04<20:08:36,  3.31it/s]
 35%|███▌      | 131265/371472 [10:26:05<19:16:52,  3.46it/s]
 35%|███▌      | 131266/371472 [10:26:05<18:14:31,  3.66it/s]
 35%|███▌      | 131267/371472 [10:26:05<18:45:13,  3.56it/s]
 35%|███▌      | 131268/371472 [10:26:05<18:34:42,  3.59it/s]
 35%|███▌      | 131269/371472 [10:26:06<19:21:45,  3.45it/s]
 35%|███▌      | 131270/371472 [10:26:06<18:43:44,  3.56it/s]
 35%|███▌      | 131271/371472 [10:26:06<18:36:51,  3.58it/s]
 35%|███▌      | 131272/371472 [10:26:06<19:03:01,  3.50it/s]
 35%|███▌      | 131273/371472 [10:26:07<18:07:02,  3.68it/s]
 35%|███▌      | 131274/371472 [10:26:07<21:57:58,  3.04it/s]
 35%|███▌      | 131275/371472 [10:26:07<21:15:52,  3.14it/s]
 35%|███▌      | 131276/371472 [10:26:08<20:59:01,  3.18it/s]
 35%|███▌      | 131277/371472 [10:26:08<21:30:56,  3.10it/s]
 35%|███▌      | 131278/371472 [10:26:08<20:59:13,  3.18it/s]
 35%|███▌      | 131279/371472 [10:26:09<19:52:14,  3.36it/s]
 35%|███▌      | 131280/371472 [10:26:09<19:17:31,  3.46it/s]
                                                             
{'loss': 3.3358, 'learning_rate': 6.822491327113277e-07, 'epoch': 5.65}

 35%|███▌      | 131280/371472 [10:26:09<19:17:31,  3.46it/s]
 35%|███▌      | 131281/371472 [10:26:09<18:26:55,  3.62it/s]
 35%|███▌      | 131282/371472 [10:26:09<18:30:24,  3.61it/s]
 35%|███▌      | 131283/371472 [10:26:10<18:18:00,  3.65it/s]
 35%|███▌      | 131284/371472 [10:26:10<18:21:09,  3.64it/s]
 35%|███▌      | 131285/371472 [10:26:10<18:44:04,  3.56it/s]
 35%|███▌      | 131286/371472 [10:26:11<18:28:30,  3.61it/s]
 35%|███▌      | 131287/371472 [10:26:11<18:29:49,  3.61it/s]
 35%|███▌      | 131288/371472 [10:26:11<18:34:38,  3.59it/s]
 35%|███▌      | 131289/371472 [10:26:11<17:57:26,  3.72it/s]
 35%|███▌      | 131290/371472 [10:26:12<17:45:56,  3.76it/s]
 35%|███▌      | 131291/371472 [10:26:12<18:19:01,  3.64it/s]
 35%|███▌      | 131292/371472 [10:26:12<17:45:02,  3.76it/s]
 35%|███▌      | 131293/371472 [10:26:12<17:28:46,  3.82it/s]
 35%|███▌      | 131294/371472 [10:26:13<17:01:42,  3.92it/s]
 35%|███▌      | 131295/371472 [10:26:13<17:24:34,  3.83it/s]
 35%|███▌      | 131296/371472 [10:26:13<19:03:14,  3.50it/s]
 35%|███▌      | 131297/371472 [10:26:14<18:12:19,  3.66it/s]
 35%|███▌      | 131298/371472 [10:26:14<18:18:42,  3.64it/s]
 35%|███▌      | 131299/371472 [10:26:14<18:08:43,  3.68it/s]
 35%|███▌      | 131300/371472 [10:26:14<17:50:45,  3.74it/s]
                                                             
{'loss': 3.2891, 'learning_rate': 6.822006507358487e-07, 'epoch': 5.66}

 35%|███▌      | 131300/371472 [10:26:14<17:50:45,  3.74it/s]
 35%|███▌      | 131301/371472 [10:26:15<18:34:13,  3.59it/s]
 35%|███▌      | 131302/371472 [10:26:15<18:32:35,  3.60it/s]
 35%|███▌      | 131303/371472 [10:26:15<18:27:02,  3.62it/s]
 35%|███▌      | 131304/371472 [10:26:15<18:32:11,  3.60it/s]
 35%|███▌      | 131305/371472 [10:26:16<18:47:12,  3.55it/s]
 35%|███▌      | 131306/371472 [10:26:16<18:13:04,  3.66it/s]
 35%|███▌      | 131307/371472 [10:26:16<18:13:36,  3.66it/s]
 35%|███▌      | 131308/371472 [10:26:17<18:01:48,  3.70it/s]
 35%|███▌      | 131309/371472 [10:26:17<18:11:52,  3.67it/s]
 35%|███▌      | 131310/371472 [10:26:17<18:10:15,  3.67it/s]
 35%|███▌      | 131311/371472 [10:26:17<18:18:26,  3.64it/s]
 35%|███▌      | 131312/371472 [10:26:18<18:14:39,  3.66it/s]
 35%|███▌      | 131313/371472 [10:26:18<17:51:28,  3.74it/s]
 35%|███▌      | 131314/371472 [10:26:18<18:40:49,  3.57it/s]
 35%|███▌      | 131315/371472 [10:26:18<17:57:37,  3.71it/s]
 35%|███▌      | 131316/371472 [10:26:19<18:52:22,  3.53it/s]
 35%|███▌      | 131317/371472 [10:26:19<18:24:32,  3.62it/s]
 35%|███▌      | 131318/371472 [10:26:19<18:39:24,  3.58it/s]
 35%|███▌      | 131319/371472 [10:26:20<18:49:42,  3.54it/s]
 35%|███▌      | 131320/371472 [10:26:20<18:13:27,  3.66it/s]
                                                             
{'loss': 3.1934, 'learning_rate': 6.821521687603697e-07, 'epoch': 5.66}

 35%|███▌      | 131320/371472 [10:26:20<18:13:27,  3.66it/s]
 35%|███▌      | 131321/371472 [10:26:20<19:58:28,  3.34it/s]
 35%|███▌      | 131322/371472 [10:26:21<19:21:38,  3.45it/s]
 35%|███▌      | 131323/371472 [10:26:21<18:23:15,  3.63it/s]
 35%|███▌      | 131324/371472 [10:26:21<17:41:38,  3.77it/s]
 35%|███▌      | 131325/371472 [10:26:21<18:25:38,  3.62it/s]
 35%|███▌      | 131326/371472 [10:26:22<17:50:27,  3.74it/s]
 35%|███▌      | 131327/371472 [10:26:22<18:27:41,  3.61it/s]
 35%|███▌      | 131328/371472 [10:26:22<18:24:30,  3.62it/s]
 35%|███▌      | 131329/371472 [10:26:22<18:47:18,  3.55it/s]
 35%|███▌      | 131330/371472 [10:26:23<19:14:46,  3.47it/s]
 35%|███▌      | 131331/371472 [10:26:23<21:30:24,  3.10it/s]
 35%|███▌      | 131332/371472 [10:26:23<20:20:30,  3.28it/s]
 35%|███▌      | 131333/371472 [10:26:24<21:01:04,  3.17it/s]
 35%|███▌      | 131334/371472 [10:26:24<20:26:03,  3.26it/s]
 35%|███▌      | 131335/371472 [10:26:24<19:19:31,  3.45it/s]
 35%|███▌      | 131336/371472 [10:26:24<18:25:37,  3.62it/s]
 35%|███▌      | 131337/371472 [10:26:25<18:16:33,  3.65it/s]
 35%|███▌      | 131338/371472 [10:26:25<18:38:22,  3.58it/s]
 35%|███▌      | 131339/371472 [10:26:25<19:08:30,  3.48it/s]
 35%|███▌      | 131340/371472 [10:26:26<18:58:15,  3.52it/s]
                                                             
{'loss': 2.972, 'learning_rate': 6.821036867848908e-07, 'epoch': 5.66}

 35%|███▌      | 131340/371472 [10:26:26<18:58:15,  3.52it/s]
 35%|███▌      | 131341/371472 [10:26:26<18:56:42,  3.52it/s]
 35%|███▌      | 131342/371472 [10:26:26<18:23:57,  3.63it/s]
 35%|███▌      | 131343/371472 [10:26:26<17:54:01,  3.73it/s]
 35%|███▌      | 131344/371472 [10:26:27<18:14:34,  3.66it/s]
 35%|███▌      | 131345/371472 [10:26:27<18:23:32,  3.63it/s]
 35%|███▌      | 131346/371472 [10:26:27<19:08:43,  3.48it/s]
 35%|███▌      | 131347/371472 [10:26:28<18:16:51,  3.65it/s]
 35%|███▌      | 131348/371472 [10:26:28<18:29:34,  3.61it/s]
 35%|███▌      | 131349/371472 [10:26:28<18:37:16,  3.58it/s]
 35%|███▌      | 131350/371472 [10:26:28<18:05:50,  3.69it/s]
 35%|███▌      | 131351/371472 [10:26:29<17:55:21,  3.72it/s]
 35%|███▌      | 131352/371472 [10:26:29<17:53:34,  3.73it/s]
 35%|███▌      | 131353/371472 [10:26:29<17:20:07,  3.85it/s]
 35%|███▌      | 131354/371472 [10:26:29<16:45:32,  3.98it/s]
 35%|███▌      | 131355/371472 [10:26:30<16:47:05,  3.97it/s]
 35%|███▌      | 131356/371472 [10:26:30<16:38:20,  4.01it/s]
 35%|███▌      | 131357/371472 [10:26:30<16:45:37,  3.98it/s]
 35%|███▌      | 131358/371472 [10:26:30<17:06:39,  3.90it/s]
 35%|███▌      | 131359/371472 [10:26:31<17:25:51,  3.83it/s]
 35%|███▌      | 131360/371472 [10:26:31<18:46:07,  3.55it/s]
                                                             
{'loss': 3.233, 'learning_rate': 6.82055204809412e-07, 'epoch': 5.66}

 35%|███▌      | 131360/371472 [10:26:31<18:46:07,  3.55it/s]
 35%|███▌      | 131361/371472 [10:26:31<19:04:34,  3.50it/s]
 35%|███▌      | 131362/371472 [10:26:32<18:52:44,  3.53it/s]
 35%|███▌      | 131363/371472 [10:26:32<19:12:33,  3.47it/s]
 35%|███▌      | 131364/371472 [10:26:32<19:16:02,  3.46it/s]
 35%|███▌      | 131365/371472 [10:26:32<19:39:29,  3.39it/s]
 35%|███▌      | 131366/371472 [10:26:33<18:36:07,  3.59it/s]
 35%|███▌      | 131367/371472 [10:26:33<18:32:04,  3.60it/s]
 35%|███▌      | 131368/371472 [10:26:33<19:01:17,  3.51it/s]
 35%|███▌      | 131369/371472 [10:26:34<18:58:17,  3.52it/s]
 35%|███▌      | 131370/371472 [10:26:34<18:53:11,  3.53it/s]
 35%|███▌      | 131371/371472 [10:26:34<20:32:40,  3.25it/s]
 35%|███▌      | 131372/371472 [10:26:34<19:16:07,  3.46it/s]
 35%|███▌      | 131373/371472 [10:26:35<19:33:30,  3.41it/s]
 35%|███▌      | 131374/371472 [10:26:35<18:52:05,  3.53it/s]
 35%|███▌      | 131375/371472 [10:26:35<19:19:55,  3.45it/s]
 35%|███▌      | 131376/371472 [10:26:36<19:47:19,  3.37it/s]
 35%|███▌      | 131377/371472 [10:26:36<19:30:45,  3.42it/s]
 35%|███▌      | 131378/371472 [10:26:36<22:52:21,  2.92it/s]
 35%|███▌      | 131379/371472 [10:26:37<21:19:14,  3.13it/s]
 35%|███▌      | 131380/371472 [10:26:37<20:17:21,  3.29it/s]
                                                             
{'loss': 3.3083, 'learning_rate': 6.82006722833933e-07, 'epoch': 5.66}

 35%|███▌      | 131380/371472 [10:26:37<20:17:21,  3.29it/s]
 35%|███▌      | 131381/371472 [10:26:37<19:43:05,  3.38it/s]
 35%|███▌      | 131382/371472 [10:26:37<19:20:40,  3.45it/s]
 35%|███▌      | 131383/371472 [10:26:38<18:40:36,  3.57it/s]
 35%|███▌      | 131384/371472 [10:26:38<20:13:28,  3.30it/s]
 35%|███▌      | 131385/371472 [10:26:38<19:49:29,  3.36it/s]
 35%|███▌      | 131386/371472 [10:26:39<18:40:06,  3.57it/s]
 35%|███▌      | 131387/371472 [10:26:39<18:31:49,  3.60it/s]
 35%|███▌      | 131388/371472 [10:26:39<17:49:53,  3.74it/s]
 35%|███▌      | 131389/371472 [10:26:39<17:49:16,  3.74it/s]
 35%|███▌      | 131390/371472 [10:26:40<18:38:03,  3.58it/s]
 35%|███▌      | 131391/371472 [10:26:40<19:06:53,  3.49it/s]
 35%|███▌      | 131392/371472 [10:26:40<18:15:50,  3.65it/s]
 35%|███▌      | 131393/371472 [10:26:41<17:53:43,  3.73it/s]
 35%|███▌      | 131394/371472 [10:26:41<18:09:58,  3.67it/s]
 35%|███▌      | 131395/371472 [10:26:41<17:38:19,  3.78it/s]
 35%|███▌      | 131396/371472 [10:26:41<17:19:09,  3.85it/s]
 35%|███▌      | 131397/371472 [10:26:42<17:56:35,  3.72it/s]
 35%|███▌      | 131398/371472 [10:26:42<18:05:06,  3.69it/s]
 35%|███▌      | 131399/371472 [10:26:42<17:51:17,  3.73it/s]
 35%|███▌      | 131400/371472 [10:26:42<19:55:13,  3.35it/s]
                                                             
{'loss': 3.2913, 'learning_rate': 6.819582408584541e-07, 'epoch': 5.66}

 35%|███▌      | 131400/371472 [10:26:42<19:55:13,  3.35it/s]
 35%|███▌      | 131401/371472 [10:26:43<19:04:43,  3.50it/s]
 35%|███▌      | 131402/371472 [10:26:43<20:04:36,  3.32it/s]
 35%|███▌      | 131403/371472 [10:26:43<19:39:54,  3.39it/s]
 35%|███▌      | 131404/371472 [10:26:44<19:36:31,  3.40it/s]
 35%|███▌      | 131405/371472 [10:26:44<19:46:31,  3.37it/s]
 35%|███▌      | 131406/371472 [10:26:44<18:54:53,  3.53it/s]
 35%|███▌      | 131407/371472 [10:26:44<18:57:14,  3.52it/s]
 35%|███▌      | 131408/371472 [10:26:45<18:55:49,  3.52it/s]
 35%|███▌      | 131409/371472 [10:26:45<19:00:14,  3.51it/s]
 35%|███▌      | 131410/371472 [10:26:45<18:29:15,  3.61it/s]
 35%|███▌      | 131411/371472 [10:26:46<18:16:08,  3.65it/s]
 35%|███▌      | 131412/371472 [10:26:46<18:53:42,  3.53it/s]
 35%|███▌      | 131413/371472 [10:26:46<18:18:40,  3.64it/s]
 35%|███▌      | 131414/371472 [10:26:46<18:23:09,  3.63it/s]
 35%|███▌      | 131415/371472 [10:26:47<17:44:42,  3.76it/s]
 35%|███▌      | 131416/371472 [10:26:47<17:59:44,  3.71it/s]
 35%|███▌      | 131417/371472 [10:26:47<18:11:57,  3.66it/s]
 35%|███▌      | 131418/371472 [10:26:48<18:45:14,  3.56it/s]
 35%|███▌      | 131419/371472 [10:26:48<18:10:02,  3.67it/s]
 35%|███▌      | 131420/371472 [10:26:48<18:08:05,  3.68it/s]
                                                             
{'loss': 3.2096, 'learning_rate': 6.819097588829753e-07, 'epoch': 5.66}

 35%|███▌      | 131420/371472 [10:26:48<18:08:05,  3.68it/s]
 35%|███▌      | 131421/371472 [10:26:48<18:28:04,  3.61it/s]
 35%|███▌      | 131422/371472 [10:26:49<17:42:05,  3.77it/s]
 35%|███▌      | 131423/371472 [10:26:49<17:25:56,  3.83it/s]
 35%|███▌      | 131424/371472 [10:26:49<17:10:48,  3.88it/s]
 35%|███▌      | 131425/371472 [10:26:49<17:58:01,  3.71it/s]
 35%|███▌      | 131426/371472 [10:26:50<17:45:19,  3.76it/s]
 35%|███▌      | 131427/371472 [10:26:50<17:19:17,  3.85it/s]
 35%|███▌      | 131428/371472 [10:26:50<17:15:15,  3.86it/s]
 35%|███▌      | 131429/371472 [10:26:51<19:40:07,  3.39it/s]
 35%|███▌      | 131430/371472 [10:26:51<19:30:03,  3.42it/s]
 35%|███▌      | 131431/371472 [10:26:51<19:49:16,  3.36it/s]
 35%|███▌      | 131432/371472 [10:26:51<19:16:09,  3.46it/s]
 35%|███▌      | 131433/371472 [10:26:52<18:45:09,  3.56it/s]
 35%|███▌      | 131434/371472 [10:26:52<19:06:33,  3.49it/s]
 35%|███▌      | 131435/371472 [10:26:52<19:48:31,  3.37it/s]
 35%|███▌      | 131436/371472 [10:26:53<19:29:08,  3.42it/s]
 35%|███▌      | 131437/371472 [10:26:53<18:33:00,  3.59it/s]
 35%|███▌      | 131438/371472 [10:26:53<18:47:18,  3.55it/s]
 35%|███▌      | 131439/371472 [10:26:53<18:33:44,  3.59it/s]
 35%|███▌      | 131440/371472 [10:26:54<18:58:08,  3.51it/s]
                                                             
{'loss': 3.1739, 'learning_rate': 6.818612769074963e-07, 'epoch': 5.66}

 35%|███▌      | 131440/371472 [10:26:54<18:58:08,  3.51it/s]
 35%|███▌      | 131441/371472 [10:26:54<20:22:59,  3.27it/s]
 35%|███▌      | 131442/371472 [10:26:54<20:31:25,  3.25it/s]
 35%|███▌      | 131443/371472 [10:26:55<20:21:12,  3.28it/s]
 35%|███▌      | 131444/371472 [10:26:55<21:22:24,  3.12it/s]
 35%|███▌      | 131445/371472 [10:26:55<21:39:49,  3.08it/s]
 35%|███▌      | 131446/371472 [10:26:56<20:12:33,  3.30it/s]
 35%|███▌      | 131447/371472 [10:26:56<20:03:27,  3.32it/s]
 35%|███▌      | 131448/371472 [10:26:56<18:47:06,  3.55it/s]
 35%|███▌      | 131449/371472 [10:26:56<18:44:44,  3.56it/s]
 35%|███▌      | 131450/371472 [10:26:57<18:39:54,  3.57it/s]
 35%|███▌      | 131451/371472 [10:26:57<18:41:00,  3.57it/s]
 35%|███▌      | 131452/371472 [10:26:57<18:13:25,  3.66it/s]
 35%|███▌      | 131453/371472 [10:26:58<20:05:24,  3.32it/s]
 35%|███▌      | 131454/371472 [10:26:58<19:23:49,  3.44it/s]
 35%|███▌      | 131455/371472 [10:26:58<19:10:34,  3.48it/s]
 35%|███▌      | 131456/371472 [10:26:58<19:32:13,  3.41it/s]
 35%|███▌      | 131457/371472 [10:26:59<20:55:26,  3.19it/s]
 35%|███▌      | 131458/371472 [10:26:59<20:03:00,  3.33it/s]
 35%|███▌      | 131459/371472 [10:26:59<19:58:09,  3.34it/s]
 35%|███▌      | 131460/371472 [10:27:00<20:14:19,  3.29it/s]
                                                             
{'loss': 3.2092, 'learning_rate': 6.818127949320174e-07, 'epoch': 5.66}

 35%|███▌      | 131460/371472 [10:27:00<20:14:19,  3.29it/s]
 35%|███▌      | 131461/371472 [10:27:00<19:23:24,  3.44it/s]
 35%|███▌      | 131462/371472 [10:27:00<19:01:17,  3.50it/s]
 35%|███▌      | 131463/371472 [10:27:01<20:17:14,  3.29it/s]
 35%|███▌      | 131464/371472 [10:27:01<19:03:04,  3.50it/s]
 35%|███▌      | 131465/371472 [10:27:01<19:14:30,  3.46it/s]
 35%|███▌      | 131466/371472 [10:27:01<18:20:23,  3.64it/s]
 35%|███▌      | 131467/371472 [10:27:02<19:08:56,  3.48it/s]
 35%|███▌      | 131468/371472 [10:27:02<19:08:07,  3.48it/s]
 35%|███▌      | 131469/371472 [10:27:02<19:18:16,  3.45it/s]
 35%|███▌      | 131470/371472 [10:27:02<18:26:01,  3.62it/s]
 35%|███▌      | 131471/371472 [10:27:03<18:10:13,  3.67it/s]
 35%|███▌      | 131472/371472 [10:27:03<17:45:16,  3.75it/s]
 35%|███▌      | 131473/371472 [10:27:03<17:36:12,  3.79it/s]
 35%|███▌      | 131474/371472 [10:27:04<19:15:23,  3.46it/s]
 35%|███▌      | 131475/371472 [10:27:04<18:57:22,  3.52it/s]
 35%|███▌      | 131476/371472 [10:27:04<18:23:51,  3.62it/s]
 35%|███▌      | 131477/371472 [10:27:04<18:39:17,  3.57it/s]
 35%|███▌      | 131478/371472 [10:27:05<17:54:06,  3.72it/s]
 35%|███▌      | 131479/371472 [10:27:05<17:33:27,  3.80it/s]
 35%|███▌      | 131480/371472 [10:27:05<17:19:24,  3.85it/s]
                                                             
{'loss': 3.0328, 'learning_rate': 6.817643129565385e-07, 'epoch': 5.66}

 35%|███▌      | 131480/371472 [10:27:05<17:19:24,  3.85it/s]
 35%|███▌      | 131481/371472 [10:27:05<17:01:21,  3.92it/s]
 35%|███▌      | 131482/371472 [10:27:06<17:19:00,  3.85it/s]
 35%|███▌      | 131483/371472 [10:27:06<16:53:59,  3.94it/s]
 35%|███▌      | 131484/371472 [10:27:06<17:49:54,  3.74it/s]
 35%|███▌      | 131485/371472 [10:27:06<18:24:00,  3.62it/s]
 35%|███▌      | 131486/371472 [10:27:07<18:15:19,  3.65it/s]
 35%|███▌      | 131487/371472 [10:27:07<17:37:34,  3.78it/s]
 35%|███▌      | 131488/371472 [10:27:07<17:34:58,  3.79it/s]
 35%|███▌      | 131489/371472 [10:27:08<17:34:06,  3.79it/s]
 35%|███▌      | 131490/371472 [10:27:08<17:32:48,  3.80it/s]
 35%|███▌      | 131491/371472 [10:27:08<17:28:54,  3.81it/s]
 35%|███▌      | 131492/371472 [10:27:08<18:06:00,  3.68it/s]
 35%|███▌      | 131493/371472 [10:27:09<18:40:39,  3.57it/s]
 35%|███▌      | 131494/371472 [10:27:09<18:29:52,  3.60it/s]
 35%|███▌      | 131495/371472 [10:27:09<18:57:34,  3.52it/s]
 35%|███▌      | 131496/371472 [10:27:09<18:50:25,  3.54it/s]
 35%|███▌      | 131497/371472 [10:27:10<18:30:21,  3.60it/s]
 35%|███▌      | 131498/371472 [10:27:10<17:51:59,  3.73it/s]
 35%|███▌      | 131499/371472 [10:27:10<17:03:38,  3.91it/s]
 35%|███▌      | 131500/371472 [10:27:10<16:42:38,  3.99it/s]
                                                             
{'loss': 3.2039, 'learning_rate': 6.817158309810597e-07, 'epoch': 5.66}

 35%|███▌      | 131500/371472 [10:27:10<16:42:38,  3.99it/s]
 35%|███▌      | 131501/371472 [10:27:11<17:20:06,  3.85it/s]
 35%|███▌      | 131502/371472 [10:27:11<17:04:41,  3.90it/s]
 35%|███▌      | 131503/371472 [10:27:11<17:27:23,  3.82it/s]
 35%|███▌      | 131504/371472 [10:27:12<17:58:46,  3.71it/s]
 35%|███▌      | 131505/371472 [10:27:12<18:40:20,  3.57it/s]
 35%|███▌      | 131506/371472 [10:27:12<19:17:51,  3.45it/s]
 35%|███▌      | 131507/371472 [10:27:12<18:46:52,  3.55it/s]
 35%|███▌      | 131508/371472 [10:27:13<19:46:50,  3.37it/s]
 35%|███▌      | 131509/371472 [10:27:13<19:22:01,  3.44it/s]
 35%|███▌      | 131510/371472 [10:27:13<18:39:49,  3.57it/s]
 35%|███▌      | 131511/371472 [10:27:14<18:01:18,  3.70it/s]
 35%|███▌      | 131512/371472 [10:27:14<17:18:58,  3.85it/s]
 35%|███▌      | 131513/371472 [10:27:14<17:34:16,  3.79it/s]
 35%|███▌      | 131514/371472 [10:27:14<17:59:51,  3.70it/s]
 35%|███▌      | 131515/371472 [10:27:15<18:15:30,  3.65it/s]
 35%|███▌      | 131516/371472 [10:27:15<17:51:39,  3.73it/s]
 35%|███▌      | 131517/371472 [10:27:15<17:57:31,  3.71it/s]
 35%|███▌      | 131518/371472 [10:27:15<17:27:20,  3.82it/s]
 35%|███▌      | 131519/371472 [10:27:16<17:48:09,  3.74it/s]
 35%|███▌      | 131520/371472 [10:27:16<17:30:26,  3.81it/s]
                                                             
{'loss': 3.255, 'learning_rate': 6.816673490055808e-07, 'epoch': 5.66}

 35%|███▌      | 131520/371472 [10:27:16<17:30:26,  3.81it/s]
 35%|███▌      | 131521/371472 [10:27:16<18:02:52,  3.69it/s]
 35%|███▌      | 131522/371472 [10:27:16<17:49:12,  3.74it/s]
 35%|███▌      | 131523/371472 [10:27:17<17:28:14,  3.82it/s]
 35%|███▌      | 131524/371472 [10:27:17<17:03:41,  3.91it/s]
 35%|███▌      | 131525/371472 [10:27:17<17:12:20,  3.87it/s]
 35%|███▌      | 131526/371472 [10:27:17<17:00:44,  3.92it/s]
 35%|███▌      | 131527/371472 [10:27:18<18:17:20,  3.64it/s]
 35%|███▌      | 131528/371472 [10:27:18<18:26:40,  3.61it/s]
 35%|███▌      | 131529/371472 [10:27:18<18:28:36,  3.61it/s]
 35%|███▌      | 131530/371472 [10:27:19<17:28:25,  3.81it/s]
 35%|███▌      | 131531/371472 [10:27:19<17:09:39,  3.88it/s]
 35%|███▌      | 131532/371472 [10:27:19<16:55:52,  3.94it/s]
 35%|███▌      | 131533/371472 [10:27:19<16:37:11,  4.01it/s]
 35%|███▌      | 131534/371472 [10:27:20<19:04:28,  3.49it/s]
 35%|███▌      | 131535/371472 [10:27:20<18:28:13,  3.61it/s]
 35%|███▌      | 131536/371472 [10:27:20<18:38:58,  3.57it/s]
 35%|███▌      | 131537/371472 [10:27:20<18:26:49,  3.61it/s]
 35%|███▌      | 131538/371472 [10:27:21<19:05:06,  3.49it/s]
 35%|███▌      | 131539/371472 [10:27:21<18:51:06,  3.54it/s]
 35%|███▌      | 131540/371472 [10:27:21<20:10:53,  3.30it/s]
                                                             
{'loss': 3.2335, 'learning_rate': 6.816188670301019e-07, 'epoch': 5.67}

 35%|███▌      | 131540/371472 [10:27:21<20:10:53,  3.30it/s]
 35%|███▌      | 131541/371472 [10:27:22<18:52:28,  3.53it/s]
 35%|███▌      | 131542/371472 [10:27:22<18:23:17,  3.62it/s]
 35%|███▌      | 131543/371472 [10:27:22<18:09:27,  3.67it/s]
 35%|███▌      | 131544/371472 [10:27:22<17:39:58,  3.77it/s]
 35%|███▌      | 131545/371472 [10:27:23<18:39:10,  3.57it/s]
 35%|███▌      | 131546/371472 [10:27:23<18:39:53,  3.57it/s]
 35%|███▌      | 131547/371472 [10:27:23<18:43:26,  3.56it/s]
 35%|███▌      | 131548/371472 [10:27:24<18:29:41,  3.60it/s]
 35%|███▌      | 131549/371472 [10:27:24<19:52:56,  3.35it/s]
 35%|███▌      | 131550/371472 [10:27:24<18:48:16,  3.54it/s]
 35%|███▌      | 131551/371472 [10:27:24<17:55:06,  3.72it/s]
 35%|███▌      | 131552/371472 [10:27:25<17:51:58,  3.73it/s]
 35%|███▌      | 131553/371472 [10:27:25<17:51:06,  3.73it/s]
 35%|███▌      | 131554/371472 [10:27:25<18:27:45,  3.61it/s]
 35%|███▌      | 131555/371472 [10:27:26<18:34:39,  3.59it/s]
 35%|███▌      | 131556/371472 [10:27:26<18:15:39,  3.65it/s]
 35%|███▌      | 131557/371472 [10:27:26<17:26:42,  3.82it/s]
 35%|███▌      | 131558/371472 [10:27:26<18:28:52,  3.61it/s]
 35%|███▌      | 131559/371472 [10:27:27<18:02:01,  3.70it/s]
 35%|███▌      | 131560/371472 [10:27:27<17:15:40,  3.86it/s]
                                                             
{'loss': 3.0177, 'learning_rate': 6.81570385054623e-07, 'epoch': 5.67}

 35%|███▌      | 131560/371472 [10:27:27<17:15:40,  3.86it/s]
 35%|███▌      | 131561/371472 [10:27:27<17:18:25,  3.85it/s]
 35%|███▌      | 131562/371472 [10:27:27<16:53:56,  3.94it/s]
 35%|███▌      | 131563/371472 [10:27:28<17:06:36,  3.89it/s]
 35%|███▌      | 131564/371472 [10:27:28<17:23:33,  3.83it/s]
 35%|███▌      | 131565/371472 [10:27:28<17:35:54,  3.79it/s]
 35%|███▌      | 131566/371472 [10:27:28<18:01:44,  3.70it/s]
 35%|███▌      | 131567/371472 [10:27:29<17:46:56,  3.75it/s]
 35%|███▌      | 131568/371472 [10:27:29<18:30:16,  3.60it/s]
 35%|███▌      | 131569/371472 [10:27:29<18:50:31,  3.54it/s]
 35%|███▌      | 131570/371472 [10:27:30<18:35:23,  3.58it/s]
 35%|███▌      | 131571/371472 [10:27:30<18:33:52,  3.59it/s]
 35%|███▌      | 131572/371472 [10:27:30<18:37:16,  3.58it/s]
 35%|███▌      | 131573/371472 [10:27:30<19:05:52,  3.49it/s]
 35%|███▌      | 131574/371472 [10:27:31<18:41:19,  3.57it/s]
 35%|███▌      | 131575/371472 [10:27:31<19:34:24,  3.40it/s]
 35%|███▌      | 131576/371472 [10:27:31<18:29:14,  3.60it/s]
 35%|███▌      | 131577/371472 [10:27:32<18:14:51,  3.65it/s]
 35%|███▌      | 131578/371472 [10:27:32<19:28:25,  3.42it/s]
 35%|███▌      | 131579/371472 [10:27:32<18:42:32,  3.56it/s]
 35%|███▌      | 131580/371472 [10:27:32<18:44:36,  3.56it/s]
                                                             
{'loss': 3.1171, 'learning_rate': 6.815219030791441e-07, 'epoch': 5.67}

 35%|███▌      | 131580/371472 [10:27:32<18:44:36,  3.56it/s]
 35%|███▌      | 131581/371472 [10:27:33<18:22:33,  3.63it/s]
 35%|███▌      | 131582/371472 [10:27:33<17:57:24,  3.71it/s]
 35%|███▌      | 131583/371472 [10:27:33<19:17:37,  3.45it/s]
 35%|███▌      | 131584/371472 [10:27:33<18:10:25,  3.67it/s]
 35%|███▌      | 131585/371472 [10:27:34<17:45:21,  3.75it/s]
 35%|███▌      | 131586/371472 [10:27:34<17:31:55,  3.80it/s]
 35%|███▌      | 131587/371472 [10:27:34<18:50:25,  3.54it/s]
 35%|███▌      | 131588/371472 [10:27:35<18:30:40,  3.60it/s]
 35%|███▌      | 131589/371472 [10:27:35<18:11:16,  3.66it/s]
 35%|███▌      | 131590/371472 [10:27:35<17:46:30,  3.75it/s]
 35%|███▌      | 131591/371472 [10:27:35<18:39:52,  3.57it/s]
 35%|███▌      | 131592/371472 [10:27:36<18:06:54,  3.68it/s]
 35%|███▌      | 131593/371472 [10:27:36<17:38:37,  3.78it/s]
 35%|███▌      | 131594/371472 [10:27:36<17:54:42,  3.72it/s]
 35%|███▌      | 131595/371472 [10:27:36<17:20:11,  3.84it/s]
 35%|███▌      | 131596/371472 [10:27:37<16:55:32,  3.94it/s]
 35%|███▌      | 131597/371472 [10:27:37<17:38:16,  3.78it/s]
 35%|███▌      | 131598/371472 [10:27:37<17:14:38,  3.86it/s]
 35%|███▌      | 131599/371472 [10:27:37<17:12:15,  3.87it/s]
 35%|███▌      | 131600/371472 [10:27:38<17:36:36,  3.78it/s]
                                                             
{'loss': 3.154, 'learning_rate': 6.814734211036653e-07, 'epoch': 5.67}

 35%|███▌      | 131600/371472 [10:27:38<17:36:36,  3.78it/s]
 35%|███▌      | 131601/371472 [10:27:38<17:26:23,  3.82it/s]
 35%|███▌      | 131602/371472 [10:27:38<17:23:33,  3.83it/s]
 35%|███▌      | 131603/371472 [10:27:38<17:14:21,  3.87it/s]
 35%|███▌      | 131604/371472 [10:27:39<20:24:47,  3.26it/s]
 35%|███▌      | 131605/371472 [10:27:39<20:16:19,  3.29it/s]
 35%|███▌      | 131606/371472 [10:27:40<20:31:09,  3.25it/s]
 35%|███▌      | 131607/371472 [10:27:40<19:11:06,  3.47it/s]
 35%|███▌      | 131608/371472 [10:27:40<18:46:15,  3.55it/s]
 35%|███▌      | 131609/371472 [10:27:40<18:29:55,  3.60it/s]
 35%|███▌      | 131610/371472 [10:27:41<19:13:13,  3.47it/s]
 35%|███▌      | 131611/371472 [10:27:41<19:15:12,  3.46it/s]
 35%|███▌      | 131612/371472 [10:27:41<19:30:02,  3.42it/s]
 35%|███▌      | 131613/371472 [10:27:41<19:04:41,  3.49it/s]
 35%|███▌      | 131614/371472 [10:27:42<18:34:32,  3.59it/s]
 35%|███▌      | 131615/371472 [10:27:42<17:55:32,  3.72it/s]
 35%|███▌      | 131616/371472 [10:27:42<18:59:47,  3.51it/s]
 35%|███▌      | 131617/371472 [10:27:43<18:24:42,  3.62it/s]
 35%|███▌      | 131618/371472 [10:27:43<18:06:46,  3.68it/s]
 35%|███▌      | 131619/371472 [10:27:43<17:40:32,  3.77it/s]
 35%|███▌      | 131620/371472 [10:27:43<17:47:31,  3.74it/s]
                                                             
{'loss': 2.9814, 'learning_rate': 6.814249391281863e-07, 'epoch': 5.67}

 35%|███▌      | 131620/371472 [10:27:43<17:47:31,  3.74it/s]
 35%|███▌      | 131621/371472 [10:27:44<17:59:36,  3.70it/s]
 35%|███▌      | 131622/371472 [10:27:44<18:00:38,  3.70it/s]
 35%|███▌      | 131623/371472 [10:27:44<18:12:07,  3.66it/s]
 35%|███▌      | 131624/371472 [10:27:44<17:53:28,  3.72it/s]
 35%|███▌      | 131625/371472 [10:27:45<18:13:57,  3.65it/s]
 35%|███▌      | 131626/371472 [10:27:45<18:12:09,  3.66it/s]
 35%|███▌      | 131627/371472 [10:27:45<18:36:07,  3.58it/s]
 35%|███▌      | 131628/371472 [10:27:46<18:14:46,  3.65it/s]
 35%|███▌      | 131629/371472 [10:27:46<18:21:50,  3.63it/s]
 35%|███▌      | 131630/371472 [10:27:46<17:43:37,  3.76it/s]
 35%|███▌      | 131631/371472 [10:27:46<19:34:33,  3.40it/s]
 35%|███▌      | 131632/371472 [10:27:47<20:04:20,  3.32it/s]
 35%|███▌      | 131633/371472 [10:27:47<18:45:59,  3.55it/s]
 35%|███▌      | 131634/371472 [10:27:47<19:37:48,  3.39it/s]
 35%|███▌      | 131635/371472 [10:27:48<19:27:52,  3.42it/s]
 35%|███▌      | 131636/371472 [10:27:48<19:54:15,  3.35it/s]
 35%|███▌      | 131637/371472 [10:27:48<22:01:24,  3.02it/s]
 35%|███▌      | 131638/371472 [10:27:49<20:54:31,  3.19it/s]
 35%|███▌      | 131639/371472 [10:27:49<19:43:31,  3.38it/s]
 35%|███▌      | 131640/371472 [10:27:49<19:14:04,  3.46it/s]
                                                             
{'loss': 3.0508, 'learning_rate': 6.813764571527074e-07, 'epoch': 5.67}

 35%|███▌      | 131640/371472 [10:27:49<19:14:04,  3.46it/s]
 35%|███▌      | 131641/371472 [10:27:49<18:55:21,  3.52it/s]
 35%|███▌      | 131642/371472 [10:27:50<18:16:04,  3.65it/s]
 35%|███▌      | 131643/371472 [10:27:50<18:49:31,  3.54it/s]
 35%|███▌      | 131644/371472 [10:27:50<18:07:41,  3.67it/s]
 35%|███▌      | 131645/371472 [10:27:50<18:14:46,  3.65it/s]
 35%|███▌      | 131646/371472 [10:27:51<19:21:59,  3.44it/s]
 35%|███▌      | 131647/371472 [10:27:51<20:20:42,  3.27it/s]
 35%|███▌      | 131648/371472 [10:27:51<19:59:03,  3.33it/s]
 35%|███▌      | 131649/371472 [10:27:52<19:35:23,  3.40it/s]
 35%|███▌      | 131650/371472 [10:27:52<18:29:33,  3.60it/s]
 35%|███▌      | 131651/371472 [10:27:52<18:44:42,  3.55it/s]
 35%|███▌      | 131652/371472 [10:27:53<18:34:48,  3.59it/s]
 35%|███▌      | 131653/371472 [10:27:53<19:32:45,  3.41it/s]
 35%|███▌      | 131654/371472 [10:27:53<19:28:08,  3.42it/s]
 35%|███▌      | 131655/371472 [10:27:53<18:54:59,  3.52it/s]
 35%|███▌      | 131656/371472 [10:27:54<19:16:09,  3.46it/s]
 35%|███▌      | 131657/371472 [10:27:54<18:57:28,  3.51it/s]
 35%|███▌      | 131658/371472 [10:27:54<18:08:53,  3.67it/s]
 35%|███▌      | 131659/371472 [10:27:55<19:04:06,  3.49it/s]
 35%|███▌      | 131660/371472 [10:27:55<18:30:11,  3.60it/s]
                                                             
{'loss': 3.0222, 'learning_rate': 6.813279751772286e-07, 'epoch': 5.67}

 35%|███▌      | 131660/371472 [10:27:55<18:30:11,  3.60it/s]
 35%|███▌      | 131661/371472 [10:27:55<20:04:24,  3.32it/s]
 35%|███▌      | 131662/371472 [10:27:55<18:54:33,  3.52it/s]
 35%|███▌      | 131663/371472 [10:27:56<19:35:50,  3.40it/s]
 35%|███▌      | 131664/371472 [10:27:56<19:02:21,  3.50it/s]
 35%|███▌      | 131665/371472 [10:27:56<19:16:50,  3.45it/s]
 35%|███▌      | 131666/371472 [10:27:57<18:38:35,  3.57it/s]
 35%|███▌      | 131667/371472 [10:27:57<17:45:04,  3.75it/s]
 35%|███▌      | 131668/371472 [10:27:57<18:33:46,  3.59it/s]
 35%|███▌      | 131669/371472 [10:27:57<19:57:04,  3.34it/s]
 35%|███▌      | 131670/371472 [10:27:58<20:03:30,  3.32it/s]
 35%|███▌      | 131671/371472 [10:27:58<19:13:07,  3.47it/s]
 35%|███▌      | 131672/371472 [10:27:58<19:19:42,  3.45it/s]
 35%|███▌      | 131673/371472 [10:27:59<18:52:56,  3.53it/s]
 35%|███▌      | 131674/371472 [10:27:59<18:36:51,  3.58it/s]
 35%|███▌      | 131675/371472 [10:27:59<18:16:25,  3.65it/s]
 35%|███▌      | 131676/371472 [10:27:59<19:17:30,  3.45it/s]
 35%|███▌      | 131677/371472 [10:28:00<18:51:14,  3.53it/s]
 35%|███▌      | 131678/371472 [10:28:00<18:07:09,  3.68it/s]
 35%|███▌      | 131679/371472 [10:28:00<18:24:35,  3.62it/s]
 35%|███▌      | 131680/371472 [10:28:00<17:44:02,  3.76it/s]
                                                             
{'loss': 3.3455, 'learning_rate': 6.812794932017497e-07, 'epoch': 5.67}

 35%|███▌      | 131680/371472 [10:28:00<17:44:02,  3.76it/s]
 35%|███▌      | 131681/371472 [10:28:01<17:16:53,  3.85it/s]
 35%|███▌      | 131682/371472 [10:28:01<16:43:59,  3.98it/s]
 35%|███▌      | 131683/371472 [10:28:01<16:49:46,  3.96it/s]
 35%|███▌      | 131684/371472 [10:28:01<17:26:57,  3.82it/s]
 35%|███▌      | 131685/371472 [10:28:02<18:53:13,  3.53it/s]
 35%|███▌      | 131686/371472 [10:28:02<18:36:34,  3.58it/s]
 35%|███▌      | 131687/371472 [10:28:02<18:48:30,  3.54it/s]
 35%|███▌      | 131688/371472 [10:28:03<19:23:31,  3.43it/s]
 35%|███▌      | 131689/371472 [10:28:03<19:24:22,  3.43it/s]
 35%|███▌      | 131690/371472 [10:28:03<18:25:09,  3.62it/s]
 35%|███▌      | 131691/371472 [10:28:03<18:18:05,  3.64it/s]
 35%|███▌      | 131692/371472 [10:28:04<17:25:20,  3.82it/s]
 35%|███▌      | 131693/371472 [10:28:04<16:43:23,  3.98it/s]
 35%|███▌      | 131694/371472 [10:28:04<17:54:08,  3.72it/s]
 35%|███▌      | 131695/371472 [10:28:05<18:00:04,  3.70it/s]
 35%|███▌      | 131696/371472 [10:28:05<17:53:00,  3.72it/s]
 35%|███▌      | 131697/371472 [10:28:05<17:06:44,  3.89it/s]
 35%|███▌      | 131698/371472 [10:28:05<18:18:20,  3.64it/s]
 35%|███▌      | 131699/371472 [10:28:06<18:23:47,  3.62it/s]
 35%|███▌      | 131700/371472 [10:28:06<19:34:20,  3.40it/s]
                                                             
{'loss': 3.099, 'learning_rate': 6.812310112262706e-07, 'epoch': 5.67}

 35%|███▌      | 131700/371472 [10:28:06<19:34:20,  3.40it/s]
 35%|███▌      | 131701/371472 [10:28:06<19:29:12,  3.42it/s]
 35%|███▌      | 131702/371472 [10:28:06<18:35:07,  3.58it/s]
 35%|███▌      | 131703/371472 [10:28:07<18:33:18,  3.59it/s]
 35%|███▌      | 131704/371472 [10:28:07<18:33:50,  3.59it/s]
 35%|███▌      | 131705/371472 [10:28:07<18:00:55,  3.70it/s]
 35%|███▌      | 131706/371472 [10:28:08<18:49:00,  3.54it/s]
 35%|███▌      | 131707/371472 [10:28:08<20:07:53,  3.31it/s]
 35%|███▌      | 131708/371472 [10:28:08<19:16:47,  3.45it/s]
 35%|███▌      | 131709/371472 [10:28:08<18:36:54,  3.58it/s]
 35%|███▌      | 131710/371472 [10:28:09<18:36:30,  3.58it/s]
 35%|███▌      | 131711/371472 [10:28:09<17:59:32,  3.70it/s]
 35%|███▌      | 131712/371472 [10:28:09<18:17:41,  3.64it/s]
 35%|███▌      | 131713/371472 [10:28:10<18:02:18,  3.69it/s]
 35%|███▌      | 131714/371472 [10:28:10<19:46:27,  3.37it/s]
 35%|███▌      | 131715/371472 [10:28:10<19:52:56,  3.35it/s]
 35%|███▌      | 131716/371472 [10:28:10<19:23:57,  3.43it/s]
 35%|███▌      | 131717/371472 [10:28:11<19:26:34,  3.43it/s]
 35%|███▌      | 131718/371472 [10:28:11<19:22:54,  3.44it/s]
 35%|███▌      | 131719/371472 [10:28:11<19:04:24,  3.49it/s]
 35%|███▌      | 131720/371472 [10:28:12<21:32:01,  3.09it/s]
                                                             
{'loss': 3.1388, 'learning_rate': 6.811825292507918e-07, 'epoch': 5.67}

 35%|███▌      | 131720/371472 [10:28:12<21:32:01,  3.09it/s]
 35%|███▌      | 131721/371472 [10:28:12<20:34:04,  3.24it/s]
 35%|███▌      | 131722/371472 [10:28:12<20:07:04,  3.31it/s]
 35%|███▌      | 131723/371472 [10:28:13<18:46:56,  3.55it/s]
 35%|███▌      | 131724/371472 [10:28:13<18:17:55,  3.64it/s]
 35%|███▌      | 131725/371472 [10:28:13<18:52:32,  3.53it/s]
 35%|███▌      | 131726/371472 [10:28:13<19:36:47,  3.40it/s]
 35%|███▌      | 131727/371472 [10:28:14<18:48:41,  3.54it/s]
 35%|███▌      | 131728/371472 [10:28:14<17:54:53,  3.72it/s]
 35%|███▌      | 131729/371472 [10:28:14<18:06:59,  3.68it/s]
 35%|███▌      | 131730/371472 [10:28:15<19:17:18,  3.45it/s]
 35%|███▌      | 131731/371472 [10:28:15<19:09:10,  3.48it/s]
 35%|███▌      | 131732/371472 [10:28:15<18:48:12,  3.54it/s]
 35%|███▌      | 131733/371472 [10:28:15<18:33:22,  3.59it/s]
 35%|███▌      | 131734/371472 [10:28:16<18:28:39,  3.60it/s]
 35%|███▌      | 131735/371472 [10:28:16<18:36:45,  3.58it/s]
 35%|███▌      | 131736/371472 [10:28:16<18:02:26,  3.69it/s]
 35%|███▌      | 131737/371472 [10:28:16<18:19:18,  3.63it/s]
 35%|███▌      | 131738/371472 [10:28:17<17:46:16,  3.75it/s]
 35%|███▌      | 131739/371472 [10:28:17<17:26:36,  3.82it/s]
 35%|███▌      | 131740/371472 [10:28:17<17:26:40,  3.82it/s]
                                                             
{'loss': 3.2224, 'learning_rate': 6.81134047275313e-07, 'epoch': 5.67}

 35%|███▌      | 131740/371472 [10:28:17<17:26:40,  3.82it/s]
 35%|███▌      | 131741/371472 [10:28:17<18:09:17,  3.67it/s]
 35%|███▌      | 131742/371472 [10:28:18<17:46:08,  3.75it/s]
 35%|███▌      | 131743/371472 [10:28:18<17:53:20,  3.72it/s]
 35%|███▌      | 131744/371472 [10:28:18<18:07:13,  3.67it/s]
 35%|███▌      | 131745/371472 [10:28:19<18:33:13,  3.59it/s]
 35%|███▌      | 131746/371472 [10:28:19<18:48:55,  3.54it/s]
 35%|███▌      | 131747/371472 [10:28:19<18:06:45,  3.68it/s]
 35%|███▌      | 131748/371472 [10:28:19<18:02:04,  3.69it/s]
 35%|███▌      | 131749/371472 [10:28:20<19:28:22,  3.42it/s]
 35%|███▌      | 131750/371472 [10:28:20<19:23:17,  3.43it/s]
 35%|███▌      | 131751/371472 [10:28:20<19:03:20,  3.49it/s]
 35%|███▌      | 131752/371472 [10:28:21<18:24:03,  3.62it/s]
 35%|███▌      | 131753/371472 [10:28:21<17:53:40,  3.72it/s]
 35%|███▌      | 131754/371472 [10:28:21<18:07:07,  3.68it/s]
 35%|███▌      | 131755/371472 [10:28:21<18:55:22,  3.52it/s]
 35%|███▌      | 131756/371472 [10:28:22<18:25:11,  3.62it/s]
 35%|███▌      | 131757/371472 [10:28:22<19:36:08,  3.40it/s]
 35%|███▌      | 131758/371472 [10:28:22<21:44:55,  3.06it/s]
 35%|███▌      | 131759/371472 [10:28:23<21:49:44,  3.05it/s]
 35%|███▌      | 131760/371472 [10:28:23<20:36:23,  3.23it/s]
                                                             
{'loss': 3.2286, 'learning_rate': 6.810855652998341e-07, 'epoch': 5.68}

 35%|███▌      | 131760/371472 [10:28:23<20:36:23,  3.23it/s]
 35%|███▌      | 131761/371472 [10:28:23<19:35:48,  3.40it/s]
 35%|███▌      | 131762/371472 [10:28:23<18:22:33,  3.62it/s]
 35%|███▌      | 131763/371472 [10:28:24<18:50:07,  3.54it/s]
 35%|███▌      | 131764/371472 [10:28:24<18:43:26,  3.56it/s]
 35%|███▌      | 131765/371472 [10:28:24<18:32:05,  3.59it/s]
 35%|███▌      | 131766/371472 [10:28:25<18:56:13,  3.52it/s]
 35%|███▌      | 131767/371472 [10:28:25<18:47:47,  3.54it/s]
 35%|███▌      | 131768/371472 [10:28:25<17:51:04,  3.73it/s]
 35%|███▌      | 131769/371472 [10:28:25<17:32:37,  3.80it/s]
 35%|███▌      | 131770/371472 [10:28:26<17:48:02,  3.74it/s]
 35%|███▌      | 131771/371472 [10:28:26<17:42:00,  3.76it/s]
 35%|███▌      | 131772/371472 [10:28:26<18:08:02,  3.67it/s]
 35%|███▌      | 131773/371472 [10:28:26<18:07:13,  3.67it/s]
 35%|███▌      | 131774/371472 [10:28:27<17:44:48,  3.75it/s]
 35%|███▌      | 131775/371472 [10:28:27<18:45:00,  3.55it/s]
 35%|███▌      | 131776/371472 [10:28:27<18:18:53,  3.64it/s]
 35%|███▌      | 131777/371472 [10:28:28<18:03:23,  3.69it/s]
 35%|███▌      | 131778/371472 [10:28:28<17:55:15,  3.72it/s]
 35%|███▌      | 131779/371472 [10:28:28<18:08:51,  3.67it/s]
 35%|███▌      | 131780/371472 [10:28:28<18:46:11,  3.55it/s]
                                                             
{'loss': 3.2585, 'learning_rate': 6.810370833243551e-07, 'epoch': 5.68}

 35%|███▌      | 131780/371472 [10:28:28<18:46:11,  3.55it/s]
 35%|███▌      | 131781/371472 [10:28:29<19:04:53,  3.49it/s]
 35%|███▌      | 131782/371472 [10:28:29<18:22:13,  3.62it/s]
 35%|███▌      | 131783/371472 [10:28:29<21:12:05,  3.14it/s]
 35%|███▌      | 131784/371472 [10:28:30<21:08:41,  3.15it/s]
 35%|███▌      | 131785/371472 [10:28:30<20:14:40,  3.29it/s]
 35%|███▌      | 131786/371472 [10:28:30<19:24:31,  3.43it/s]
 35%|███▌      | 131787/371472 [10:28:31<19:36:15,  3.40it/s]
 35%|███▌      | 131788/371472 [10:28:31<19:13:23,  3.46it/s]
 35%|███▌      | 131789/371472 [10:28:31<18:27:28,  3.61it/s]
 35%|███▌      | 131790/371472 [10:28:31<18:41:35,  3.56it/s]
 35%|███▌      | 131791/371472 [10:28:32<18:08:45,  3.67it/s]
 35%|███▌      | 131792/371472 [10:28:32<18:39:47,  3.57it/s]
 35%|███▌      | 131793/371472 [10:28:32<17:54:23,  3.72it/s]
 35%|███▌      | 131794/371472 [10:28:32<19:00:18,  3.50it/s]
 35%|███▌      | 131795/371472 [10:28:33<19:03:02,  3.49it/s]
 35%|███▌      | 131796/371472 [10:28:33<19:19:04,  3.45it/s]
 35%|███▌      | 131797/371472 [10:28:33<19:08:13,  3.48it/s]
 35%|███▌      | 131798/371472 [10:28:34<18:49:54,  3.54it/s]
 35%|███▌      | 131799/371472 [10:28:34<20:12:45,  3.29it/s]
 35%|███▌      | 131800/371472 [10:28:34<19:09:55,  3.47it/s]
                                                             
{'loss': 3.4365, 'learning_rate': 6.809886013488763e-07, 'epoch': 5.68}

 35%|███▌      | 131800/371472 [10:28:34<19:09:55,  3.47it/s]
 35%|███▌      | 131801/371472 [10:28:34<18:40:55,  3.56it/s]
 35%|███▌      | 131802/371472 [10:28:35<18:11:14,  3.66it/s]
 35%|███▌      | 131803/371472 [10:28:35<17:51:02,  3.73it/s]
 35%|███▌      | 131804/371472 [10:28:35<18:20:27,  3.63it/s]
 35%|███▌      | 131805/371472 [10:28:36<19:41:50,  3.38it/s]
 35%|███▌      | 131806/371472 [10:28:36<19:00:15,  3.50it/s]
 35%|███▌      | 131807/371472 [10:28:36<18:17:43,  3.64it/s]
 35%|███▌      | 131808/371472 [10:28:36<18:49:23,  3.54it/s]
 35%|███▌      | 131809/371472 [10:28:37<18:05:25,  3.68it/s]
 35%|███▌      | 131810/371472 [10:28:37<18:33:35,  3.59it/s]
 35%|███▌      | 131811/371472 [10:28:37<18:01:30,  3.69it/s]
 35%|███▌      | 131812/371472 [10:28:38<18:49:50,  3.54it/s]
 35%|███▌      | 131813/371472 [10:28:38<19:20:01,  3.44it/s]
 35%|███▌      | 131814/371472 [10:28:38<18:43:52,  3.55it/s]
 35%|███▌      | 131815/371472 [10:28:38<19:04:19,  3.49it/s]
 35%|███▌      | 131816/371472 [10:28:39<18:19:39,  3.63it/s]
 35%|███▌      | 131817/371472 [10:28:39<18:57:24,  3.51it/s]
 35%|███▌      | 131818/371472 [10:28:39<19:02:39,  3.50it/s]
 35%|███▌      | 131819/371472 [10:28:40<18:41:19,  3.56it/s]
 35%|███▌      | 131820/371472 [10:28:40<19:33:42,  3.40it/s]
                                                             
{'loss': 3.1841, 'learning_rate': 6.809401193733974e-07, 'epoch': 5.68}

 35%|███▌      | 131820/371472 [10:28:40<19:33:42,  3.40it/s]
 35%|███▌      | 131821/371472 [10:28:40<18:54:13,  3.52it/s]
 35%|███▌      | 131822/371472 [10:28:40<18:35:28,  3.58it/s]
 35%|███▌      | 131823/371472 [10:28:41<18:23:25,  3.62it/s]
 35%|███▌      | 131824/371472 [10:28:41<19:01:50,  3.50it/s]
 35%|███▌      | 131825/371472 [10:28:41<18:17:43,  3.64it/s]
 35%|███▌      | 131826/371472 [10:28:42<18:53:11,  3.52it/s]
 35%|███▌      | 131827/371472 [10:28:42<17:42:40,  3.76it/s]
 35%|███▌      | 131828/371472 [10:28:42<17:18:59,  3.84it/s]
 35%|███▌      | 131829/371472 [10:28:42<18:52:15,  3.53it/s]
 35%|███▌      | 131830/371472 [10:28:43<18:30:40,  3.60it/s]
 35%|███▌      | 131831/371472 [10:28:43<17:41:00,  3.76it/s]
 35%|███▌      | 131832/371472 [10:28:43<18:15:16,  3.65it/s]
 35%|███▌      | 131833/371472 [10:28:43<18:41:36,  3.56it/s]
 35%|███▌      | 131834/371472 [10:28:44<18:45:52,  3.55it/s]
 35%|███▌      | 131835/371472 [10:28:44<18:50:26,  3.53it/s]
 35%|███▌      | 131836/371472 [10:28:44<19:06:11,  3.48it/s]
 35%|███▌      | 131837/371472 [10:28:45<19:25:09,  3.43it/s]
 35%|███▌      | 131838/371472 [10:28:45<20:41:50,  3.22it/s]
 35%|███▌      | 131839/371472 [10:28:45<20:41:39,  3.22it/s]
 35%|███▌      | 131840/371472 [10:28:45<19:13:40,  3.46it/s]
                                                             
{'loss': 3.233, 'learning_rate': 6.808916373979185e-07, 'epoch': 5.68}

 35%|███▌      | 131840/371472 [10:28:45<19:13:40,  3.46it/s]
 35%|███▌      | 131841/371472 [10:28:46<18:45:41,  3.55it/s]
 35%|███▌      | 131842/371472 [10:28:46<18:00:51,  3.70it/s]
 35%|███▌      | 131843/371472 [10:28:46<19:23:38,  3.43it/s]
 35%|███▌      | 131844/371472 [10:28:47<20:44:22,  3.21it/s]
 35%|███▌      | 131845/371472 [10:28:47<19:30:04,  3.41it/s]
 35%|███▌      | 131846/371472 [10:28:47<19:10:26,  3.47it/s]
 35%|███▌      | 131847/371472 [10:28:47<18:54:07,  3.52it/s]
 35%|███▌      | 131848/371472 [10:28:48<18:37:24,  3.57it/s]
 35%|███▌      | 131849/371472 [10:28:48<18:28:10,  3.60it/s]
 35%|███▌      | 131850/371472 [10:28:48<19:06:46,  3.48it/s]
 35%|███▌      | 131851/371472 [10:28:49<19:50:56,  3.35it/s]
 35%|███▌      | 131852/371472 [10:28:49<19:41:42,  3.38it/s]
 35%|███▌      | 131853/371472 [10:28:49<18:50:06,  3.53it/s]
 35%|███▌      | 131854/371472 [10:28:50<19:00:08,  3.50it/s]
 35%|███▌      | 131855/371472 [10:28:50<18:44:57,  3.55it/s]
 35%|███▌      | 131856/371472 [10:28:50<19:15:07,  3.46it/s]
 35%|███▌      | 131857/371472 [10:28:50<19:14:59,  3.46it/s]
 35%|███▌      | 131858/371472 [10:28:51<20:35:19,  3.23it/s]
 35%|███▌      | 131859/371472 [10:28:51<19:22:28,  3.44it/s]
 35%|███▌      | 131860/371472 [10:28:51<18:59:29,  3.50it/s]
                                                             
{'loss': 3.2861, 'learning_rate': 6.808431554224395e-07, 'epoch': 5.68}

 35%|███▌      | 131860/371472 [10:28:51<18:59:29,  3.50it/s]
 35%|███▌      | 131861/371472 [10:28:52<19:15:50,  3.46it/s]
 35%|███▌      | 131862/371472 [10:28:52<19:19:38,  3.44it/s]
 35%|███▌      | 131863/371472 [10:28:52<18:39:57,  3.57it/s]
 35%|███▌      | 131864/371472 [10:28:52<19:22:56,  3.43it/s]
 35%|███▌      | 131865/371472 [10:28:53<18:22:36,  3.62it/s]
 35%|███▌      | 131866/371472 [10:28:53<18:15:22,  3.65it/s]
 35%|███▌      | 131867/371472 [10:28:53<18:32:13,  3.59it/s]
 35%|███▌      | 131868/371472 [10:28:53<18:15:42,  3.64it/s]
 35%|███▌      | 131869/371472 [10:28:54<18:15:04,  3.65it/s]
 35%|███▌      | 131870/371472 [10:28:54<17:53:49,  3.72it/s]
 35%|███▌      | 131871/371472 [10:28:54<18:08:07,  3.67it/s]
 35%|███▌      | 131872/371472 [10:28:55<18:25:52,  3.61it/s]
 36%|███▌      | 131873/371472 [10:28:55<18:07:26,  3.67it/s]
 36%|███▌      | 131874/371472 [10:28:55<17:53:53,  3.72it/s]
 36%|███▌      | 131875/371472 [10:28:55<18:51:27,  3.53it/s]
 36%|███▌      | 131876/371472 [10:28:56<19:33:20,  3.40it/s]
 36%|███▌      | 131877/371472 [10:28:56<18:43:40,  3.55it/s]
 36%|███▌      | 131878/371472 [10:28:56<18:15:21,  3.65it/s]
 36%|███▌      | 131879/371472 [10:28:57<18:20:18,  3.63it/s]
 36%|███▌      | 131880/371472 [10:28:57<18:10:40,  3.66it/s]
                                                             
{'loss': 3.2726, 'learning_rate': 6.807946734469607e-07, 'epoch': 5.68}

 36%|███▌      | 131880/371472 [10:28:57<18:10:40,  3.66it/s]
 36%|███▌      | 131881/371472 [10:28:57<19:05:36,  3.49it/s]
 36%|███▌      | 131882/371472 [10:28:57<18:13:07,  3.65it/s]
 36%|███▌      | 131883/371472 [10:28:58<18:26:57,  3.61it/s]
 36%|███▌      | 131884/371472 [10:28:58<19:13:48,  3.46it/s]
 36%|███▌      | 131885/371472 [10:28:58<19:41:34,  3.38it/s]
 36%|███▌      | 131886/371472 [10:28:59<19:14:59,  3.46it/s]
 36%|███▌      | 131887/371472 [10:28:59<23:33:23,  2.83it/s]
 36%|███▌      | 131888/371472 [10:28:59<22:18:44,  2.98it/s]
 36%|███▌      | 131889/371472 [10:29:00<21:04:52,  3.16it/s]
 36%|███▌      | 131890/371472 [10:29:00<19:57:44,  3.33it/s]
 36%|███▌      | 131891/371472 [10:29:00<19:28:48,  3.42it/s]
 36%|███▌      | 131892/371472 [10:29:00<19:25:08,  3.43it/s]
 36%|███▌      | 131893/371472 [10:29:01<19:02:18,  3.50it/s]
 36%|███▌      | 131894/371472 [10:29:01<18:58:28,  3.51it/s]
 36%|███▌      | 131895/371472 [10:29:01<18:54:18,  3.52it/s]
 36%|███▌      | 131896/371472 [10:29:02<18:32:45,  3.59it/s]
 36%|███▌      | 131897/371472 [10:29:02<19:18:48,  3.45it/s]
 36%|███▌      | 131898/371472 [10:29:02<20:59:56,  3.17it/s]
 36%|███▌      | 131899/371472 [10:29:03<20:13:22,  3.29it/s]
 36%|███▌      | 131900/371472 [10:29:03<20:07:02,  3.31it/s]
                                                             
{'loss': 3.0955, 'learning_rate': 6.807461914714819e-07, 'epoch': 5.68}

 36%|███▌      | 131900/371472 [10:29:03<20:07:02,  3.31it/s]
 36%|███▌      | 131901/371472 [10:29:03<20:05:38,  3.31it/s]
 36%|███▌      | 131902/371472 [10:29:03<20:01:53,  3.32it/s]
 36%|███▌      | 131903/371472 [10:29:04<18:54:10,  3.52it/s]
 36%|███▌      | 131904/371472 [10:29:04<18:57:14,  3.51it/s]
 36%|███▌      | 131905/371472 [10:29:04<18:42:31,  3.56it/s]
 36%|███▌      | 131906/371472 [10:29:05<19:58:35,  3.33it/s]
 36%|███▌      | 131907/371472 [10:29:05<20:40:43,  3.22it/s]
 36%|███▌      | 131908/371472 [10:29:05<21:44:14,  3.06it/s]
 36%|███▌      | 131909/371472 [10:29:06<21:01:02,  3.17it/s]
 36%|███▌      | 131910/371472 [10:29:06<20:08:06,  3.30it/s]
 36%|███▌      | 131911/371472 [10:29:06<19:20:02,  3.44it/s]
 36%|███▌      | 131912/371472 [10:29:06<18:57:34,  3.51it/s]
 36%|███▌      | 131913/371472 [10:29:07<18:54:42,  3.52it/s]
 36%|███▌      | 131914/371472 [10:29:07<20:06:18,  3.31it/s]
 36%|███▌      | 131915/371472 [10:29:07<19:04:48,  3.49it/s]
 36%|███▌      | 131916/371472 [10:29:07<18:38:02,  3.57it/s]
 36%|███▌      | 131917/371472 [10:29:08<19:24:15,  3.43it/s]
 36%|███▌      | 131918/371472 [10:29:08<18:36:46,  3.58it/s]
 36%|███▌      | 131919/371472 [10:29:08<18:39:34,  3.57it/s]
 36%|███▌      | 131920/371472 [10:29:09<17:45:46,  3.75it/s]
                                                             
{'loss': 3.2073, 'learning_rate': 6.806977094960029e-07, 'epoch': 5.68}

 36%|███▌      | 131920/371472 [10:29:09<17:45:46,  3.75it/s]
 36%|███▌      | 131921/371472 [10:29:09<17:51:22,  3.73it/s]
 36%|███▌      | 131922/371472 [10:29:09<18:12:58,  3.65it/s]
 36%|███▌      | 131923/371472 [10:29:09<18:47:31,  3.54it/s]
 36%|███▌      | 131924/371472 [10:29:10<19:02:33,  3.49it/s]
 36%|███▌      | 131925/371472 [10:29:10<17:59:41,  3.70it/s]
 36%|███▌      | 131926/371472 [10:29:10<17:36:17,  3.78it/s]
 36%|███▌      | 131927/371472 [10:29:10<17:35:38,  3.78it/s]
 36%|███▌      | 131928/371472 [10:29:11<18:01:29,  3.69it/s]
 36%|███▌      | 131929/371472 [10:29:11<17:59:09,  3.70it/s]
 36%|███▌      | 131930/371472 [10:29:11<21:15:11,  3.13it/s]
 36%|███▌      | 131931/371472 [10:29:12<20:14:07,  3.29it/s]
 36%|███▌      | 131932/371472 [10:29:12<19:09:58,  3.47it/s]
 36%|███▌      | 131933/371472 [10:29:12<18:57:34,  3.51it/s]
 36%|███▌      | 131934/371472 [10:29:13<18:12:59,  3.65it/s]
 36%|███▌      | 131935/371472 [10:29:13<18:17:53,  3.64it/s]
 36%|███▌      | 131936/371472 [10:29:13<19:29:24,  3.41it/s]
 36%|███▌      | 131937/371472 [10:29:13<18:57:38,  3.51it/s]
 36%|███▌      | 131938/371472 [10:29:14<19:00:48,  3.50it/s]
 36%|███▌      | 131939/371472 [10:29:14<18:02:45,  3.69it/s]
 36%|███▌      | 131940/371472 [10:29:14<18:11:06,  3.66it/s]
                                                             
{'loss': 3.3188, 'learning_rate': 6.80649227520524e-07, 'epoch': 5.68}

 36%|███▌      | 131940/371472 [10:29:14<18:11:06,  3.66it/s]
 36%|███▌      | 131941/371472 [10:29:14<18:05:09,  3.68it/s]
 36%|███▌      | 131942/371472 [10:29:15<19:14:42,  3.46it/s]
 36%|███▌      | 131943/371472 [10:29:15<19:15:21,  3.46it/s]
 36%|███▌      | 131944/371472 [10:29:15<19:51:09,  3.35it/s]
 36%|███▌      | 131945/371472 [10:29:16<18:48:46,  3.54it/s]
 36%|███▌      | 131946/371472 [10:29:16<18:41:07,  3.56it/s]
 36%|███▌      | 131947/371472 [10:29:16<20:08:29,  3.30it/s]
 36%|███▌      | 131948/371472 [10:29:17<19:19:07,  3.44it/s]
 36%|███▌      | 131949/371472 [10:29:17<19:01:42,  3.50it/s]
 36%|███▌      | 131950/371472 [10:29:17<18:22:16,  3.62it/s]
 36%|███▌      | 131951/371472 [10:29:17<19:01:00,  3.50it/s]
 36%|███▌      | 131952/371472 [10:29:18<18:54:46,  3.52it/s]
 36%|███▌      | 131953/371472 [10:29:18<19:25:06,  3.43it/s]
 36%|███▌      | 131954/371472 [10:29:18<18:42:17,  3.56it/s]
 36%|███▌      | 131955/371472 [10:29:19<19:36:28,  3.39it/s]
 36%|███▌      | 131956/371472 [10:29:19<18:48:59,  3.54it/s]
 36%|███▌      | 131957/371472 [10:29:19<19:23:09,  3.43it/s]
 36%|███▌      | 131958/371472 [10:29:19<18:57:39,  3.51it/s]
 36%|███▌      | 131959/371472 [10:29:20<18:28:31,  3.60it/s]
 36%|███▌      | 131960/371472 [10:29:20<18:53:51,  3.52it/s]
                                                             
{'loss': 3.0318, 'learning_rate': 6.806007455450451e-07, 'epoch': 5.68}

 36%|███▌      | 131960/371472 [10:29:20<18:53:51,  3.52it/s]
 36%|███▌      | 131961/371472 [10:29:20<18:30:22,  3.60it/s]
 36%|███▌      | 131962/371472 [10:29:20<18:24:53,  3.61it/s]
 36%|███▌      | 131963/371472 [10:29:21<18:32:42,  3.59it/s]
 36%|███▌      | 131964/371472 [10:29:21<17:45:56,  3.74it/s]
 36%|███▌      | 131965/371472 [10:29:21<17:49:57,  3.73it/s]
 36%|███▌      | 131966/371472 [10:29:22<17:29:22,  3.80it/s]
 36%|███▌      | 131967/371472 [10:29:22<17:02:15,  3.90it/s]
 36%|███▌      | 131968/371472 [10:29:22<17:21:35,  3.83it/s]
 36%|███▌      | 131969/371472 [10:29:22<18:15:44,  3.64it/s]
 36%|███▌      | 131970/371472 [10:29:23<18:10:08,  3.66it/s]
 36%|███▌      | 131971/371472 [10:29:23<17:34:48,  3.78it/s]
 36%|███▌      | 131972/371472 [10:29:23<17:28:01,  3.81it/s]
 36%|███▌      | 131973/371472 [10:29:23<17:19:32,  3.84it/s]
 36%|███▌      | 131974/371472 [10:29:24<19:09:52,  3.47it/s]
 36%|███▌      | 131975/371472 [10:29:24<18:53:43,  3.52it/s]
 36%|███▌      | 131976/371472 [10:29:24<18:41:57,  3.56it/s]
 36%|███▌      | 131977/371472 [10:29:25<18:49:56,  3.53it/s]
 36%|███▌      | 131978/371472 [10:29:25<20:15:10,  3.28it/s]
 36%|███▌      | 131979/371472 [10:29:25<21:45:14,  3.06it/s]
 36%|███▌      | 131980/371472 [10:29:26<20:23:12,  3.26it/s]
                                                             
{'loss': 3.1203, 'learning_rate': 6.805522635695662e-07, 'epoch': 5.68}

 36%|███▌      | 131980/371472 [10:29:26<20:23:12,  3.26it/s]
 36%|███▌      | 131981/371472 [10:29:26<19:15:44,  3.45it/s]
 36%|███▌      | 131982/371472 [10:29:26<18:55:31,  3.52it/s]
 36%|███▌      | 131983/371472 [10:29:26<19:15:46,  3.45it/s]
 36%|███▌      | 131984/371472 [10:29:27<20:08:23,  3.30it/s]
 36%|███▌      | 131985/371472 [10:29:27<19:08:34,  3.48it/s]
 36%|███▌      | 131986/371472 [10:29:27<18:33:57,  3.58it/s]
 36%|███▌      | 131987/371472 [10:29:28<18:34:15,  3.58it/s]
 36%|███▌      | 131988/371472 [10:29:28<17:46:52,  3.74it/s]
 36%|███▌      | 131989/371472 [10:29:28<17:45:30,  3.75it/s]
 36%|███▌      | 131990/371472 [10:29:28<17:49:47,  3.73it/s]
 36%|███▌      | 131991/371472 [10:29:29<17:25:17,  3.82it/s]
 36%|███▌      | 131992/371472 [10:29:29<17:24:21,  3.82it/s]
 36%|███▌      | 131993/371472 [10:29:29<17:22:11,  3.83it/s]
 36%|███▌      | 131994/371472 [10:29:29<17:20:25,  3.84it/s]
 36%|███▌      | 131995/371472 [10:29:30<17:07:33,  3.88it/s]
 36%|███▌      | 131996/371472 [10:29:30<17:25:49,  3.82it/s]
 36%|███▌      | 131997/371472 [10:29:30<17:27:23,  3.81it/s]
 36%|███▌      | 131998/371472 [10:29:30<19:42:02,  3.38it/s]
 36%|███▌      | 131999/371472 [10:29:31<19:13:07,  3.46it/s]
 36%|███▌      | 132000/371472 [10:29:31<19:19:54,  3.44it/s]
                                                             
{'loss': 3.1966, 'learning_rate': 6.805037815940872e-07, 'epoch': 5.69}

 36%|███▌      | 132000/371472 [10:29:31<19:19:54,  3.44it/s]
 36%|███▌      | 132001/371472 [10:29:31<18:37:25,  3.57it/s]
 36%|███▌      | 132002/371472 [10:29:32<18:35:14,  3.58it/s]
 36%|███▌      | 132003/371472 [10:29:32<18:28:23,  3.60it/s]
 36%|███▌      | 132004/371472 [10:29:32<18:24:09,  3.61it/s]
 36%|███▌      | 132005/371472 [10:29:32<18:39:31,  3.57it/s]
 36%|███▌      | 132006/371472 [10:29:33<18:09:37,  3.66it/s]
 36%|███▌      | 132007/371472 [10:29:33<18:21:47,  3.62it/s]
 36%|███▌      | 132008/371472 [10:29:33<17:49:24,  3.73it/s]
 36%|███▌      | 132009/371472 [10:29:33<18:01:23,  3.69it/s]
 36%|███▌      | 132010/371472 [10:29:34<18:30:54,  3.59it/s]
 36%|███▌      | 132011/371472 [10:29:34<18:05:45,  3.68it/s]
 36%|███▌      | 132012/371472 [10:29:34<17:32:30,  3.79it/s]
 36%|███▌      | 132013/371472 [10:29:35<17:09:49,  3.88it/s]
 36%|███▌      | 132014/371472 [10:29:35<17:37:47,  3.77it/s]
 36%|███▌      | 132015/371472 [10:29:35<18:24:30,  3.61it/s]
 36%|███▌      | 132016/371472 [10:29:35<20:26:57,  3.25it/s]
 36%|███▌      | 132017/371472 [10:29:36<19:09:46,  3.47it/s]
 36%|███▌      | 132018/371472 [10:29:36<20:30:10,  3.24it/s]
 36%|███▌      | 132019/371472 [10:29:36<18:59:53,  3.50it/s]
 36%|███▌      | 132020/371472 [10:29:37<20:28:30,  3.25it/s]
                                                             
{'loss': 3.1344, 'learning_rate': 6.804552996186083e-07, 'epoch': 5.69}

 36%|███▌      | 132020/371472 [10:29:37<20:28:30,  3.25it/s]
 36%|███▌      | 132021/371472 [10:29:37<20:03:15,  3.32it/s]
 36%|███▌      | 132022/371472 [10:29:37<19:24:52,  3.43it/s]
 36%|███▌      | 132023/371472 [10:29:38<18:57:33,  3.51it/s]
 36%|███▌      | 132024/371472 [10:29:38<18:26:49,  3.61it/s]
 36%|███▌      | 132025/371472 [10:29:38<18:25:36,  3.61it/s]
 36%|███▌      | 132026/371472 [10:29:38<18:32:42,  3.59it/s]
 36%|███▌      | 132027/371472 [10:29:39<19:54:21,  3.34it/s]
 36%|███▌      | 132028/371472 [10:29:39<18:58:20,  3.51it/s]
 36%|███▌      | 132029/371472 [10:29:39<18:24:39,  3.61it/s]
 36%|███▌      | 132030/371472 [10:29:39<19:09:38,  3.47it/s]
 36%|███▌      | 132031/371472 [10:29:40<19:29:47,  3.41it/s]
 36%|███▌      | 132032/371472 [10:29:40<18:59:40,  3.50it/s]
 36%|███▌      | 132033/371472 [10:29:40<18:42:25,  3.56it/s]
 36%|███▌      | 132034/371472 [10:29:41<17:55:24,  3.71it/s]
 36%|███▌      | 132035/371472 [10:29:41<17:56:53,  3.71it/s]
 36%|███▌      | 132036/371472 [10:29:41<17:36:59,  3.78it/s]
 36%|███▌      | 132037/371472 [10:29:41<17:57:10,  3.70it/s]
 36%|███▌      | 132038/371472 [10:29:42<17:53:57,  3.72it/s]
 36%|███▌      | 132039/371472 [10:29:42<17:53:33,  3.72it/s]
 36%|███▌      | 132040/371472 [10:29:42<17:49:49,  3.73it/s]
                                                             
{'loss': 3.2833, 'learning_rate': 6.804068176431296e-07, 'epoch': 5.69}

 36%|███▌      | 132040/371472 [10:29:42<17:49:49,  3.73it/s]
 36%|███▌      | 132041/371472 [10:29:42<17:34:04,  3.79it/s]
 36%|███▌      | 132042/371472 [10:29:43<17:58:08,  3.70it/s]
 36%|███▌      | 132043/371472 [10:29:43<18:55:46,  3.51it/s]
 36%|███▌      | 132044/371472 [10:29:43<18:41:47,  3.56it/s]
 36%|███▌      | 132045/371472 [10:29:44<17:55:15,  3.71it/s]
 36%|███▌      | 132046/371472 [10:29:44<17:57:18,  3.70it/s]
 36%|███▌      | 132047/371472 [10:29:44<17:30:40,  3.80it/s]
 36%|███▌      | 132048/371472 [10:29:44<18:15:19,  3.64it/s]
 36%|███▌      | 132049/371472 [10:29:45<18:04:00,  3.68it/s]
 36%|███▌      | 132050/371472 [10:29:45<17:29:35,  3.80it/s]
 36%|███▌      | 132051/371472 [10:29:45<18:08:13,  3.67it/s]
 36%|███▌      | 132052/371472 [10:29:45<17:55:02,  3.71it/s]
 36%|███▌      | 132053/371472 [10:29:46<17:53:57,  3.72it/s]
 36%|███▌      | 132054/371472 [10:29:46<17:42:08,  3.76it/s]
 36%|███▌      | 132055/371472 [10:29:46<18:29:34,  3.60it/s]
 36%|███▌      | 132056/371472 [10:29:47<18:30:20,  3.59it/s]
 36%|███▌      | 132057/371472 [10:29:47<19:11:05,  3.47it/s]
 36%|███▌      | 132058/371472 [10:29:47<19:47:57,  3.36it/s]
 36%|███▌      | 132059/371472 [10:29:47<19:00:15,  3.50it/s]
 36%|███▌      | 132060/371472 [10:29:48<18:19:31,  3.63it/s]
                                                             
{'loss': 3.1791, 'learning_rate': 6.803583356676507e-07, 'epoch': 5.69}

 36%|███▌      | 132060/371472 [10:29:48<18:19:31,  3.63it/s]
 36%|███▌      | 132061/371472 [10:29:48<17:52:53,  3.72it/s]
 36%|███▌      | 132062/371472 [10:29:48<18:16:20,  3.64it/s]
 36%|███▌      | 132063/371472 [10:29:49<18:08:46,  3.66it/s]
 36%|███▌      | 132064/371472 [10:29:49<17:38:21,  3.77it/s]
 36%|███▌      | 132065/371472 [10:29:49<18:16:41,  3.64it/s]
 36%|███▌      | 132066/371472 [10:29:49<18:09:04,  3.66it/s]
 36%|███▌      | 132067/371472 [10:29:50<18:03:40,  3.68it/s]
 36%|███▌      | 132068/371472 [10:29:50<19:28:45,  3.41it/s]
 36%|███▌      | 132069/371472 [10:29:50<19:13:26,  3.46it/s]
 36%|███▌      | 132070/371472 [10:29:50<18:44:20,  3.55it/s]
 36%|███▌      | 132071/371472 [10:29:51<18:32:52,  3.59it/s]
 36%|███▌      | 132072/371472 [10:29:51<18:24:28,  3.61it/s]
 36%|███▌      | 132073/371472 [10:29:51<18:45:44,  3.54it/s]
 36%|███▌      | 132074/371472 [10:29:52<18:30:56,  3.59it/s]
 36%|███▌      | 132075/371472 [10:29:52<18:01:15,  3.69it/s]
 36%|███▌      | 132076/371472 [10:29:52<17:29:53,  3.80it/s]
 36%|███▌      | 132077/371472 [10:29:52<17:23:51,  3.82it/s]
 36%|███▌      | 132078/371472 [10:29:53<17:16:03,  3.85it/s]
 36%|███▌      | 132079/371472 [10:29:53<17:31:02,  3.80it/s]
 36%|███▌      | 132080/371472 [10:29:53<18:29:05,  3.60it/s]
                                                             
{'loss': 3.1291, 'learning_rate': 6.803098536921716e-07, 'epoch': 5.69}

 36%|███▌      | 132080/371472 [10:29:53<18:29:05,  3.60it/s]
 36%|███▌      | 132081/371472 [10:29:53<19:02:16,  3.49it/s]
 36%|███▌      | 132082/371472 [10:29:54<18:20:56,  3.62it/s]
 36%|███▌      | 132083/371472 [10:29:54<17:47:51,  3.74it/s]
 36%|███▌      | 132084/371472 [10:29:54<18:02:45,  3.68it/s]
 36%|███▌      | 132085/371472 [10:29:55<17:34:33,  3.78it/s]
 36%|███▌      | 132086/371472 [10:29:55<17:35:31,  3.78it/s]
 36%|███▌      | 132087/371472 [10:29:55<17:40:12,  3.76it/s]
 36%|███▌      | 132088/371472 [10:29:55<17:20:34,  3.83it/s]
 36%|███▌      | 132089/371472 [10:29:56<17:05:43,  3.89it/s]
 36%|███▌      | 132090/371472 [10:29:56<17:02:11,  3.90it/s]
 36%|███▌      | 132091/371472 [10:29:56<17:16:51,  3.85it/s]
 36%|███▌      | 132092/371472 [10:29:56<18:04:59,  3.68it/s]
 36%|███▌      | 132093/371472 [10:29:57<17:54:25,  3.71it/s]
 36%|███▌      | 132094/371472 [10:29:57<18:23:05,  3.62it/s]
 36%|███▌      | 132095/371472 [10:29:57<17:47:50,  3.74it/s]
 36%|███▌      | 132096/371472 [10:29:57<17:44:14,  3.75it/s]
 36%|███▌      | 132097/371472 [10:29:58<17:42:54,  3.75it/s]
 36%|███▌      | 132098/371472 [10:29:58<16:58:48,  3.92it/s]
 36%|███▌      | 132099/371472 [10:29:58<17:01:17,  3.91it/s]
 36%|███▌      | 132100/371472 [10:29:58<16:48:45,  3.95it/s]
                                                             
{'loss': 3.2564, 'learning_rate': 6.802613717166928e-07, 'epoch': 5.69}

 36%|███▌      | 132100/371472 [10:29:58<16:48:45,  3.95it/s]
 36%|███▌      | 132101/371472 [10:29:59<16:45:20,  3.97it/s]
 36%|███▌      | 132102/371472 [10:29:59<16:52:09,  3.94it/s]
 36%|███▌      | 132103/371472 [10:29:59<17:46:29,  3.74it/s]
 36%|███▌      | 132104/371472 [10:30:00<17:39:23,  3.77it/s]
 36%|███▌      | 132105/371472 [10:30:00<19:58:00,  3.33it/s]
 36%|███▌      | 132106/371472 [10:30:00<19:06:20,  3.48it/s]
 36%|███▌      | 132107/371472 [10:30:00<18:47:59,  3.54it/s]
 36%|███▌      | 132108/371472 [10:30:01<18:23:00,  3.62it/s]
 36%|███▌      | 132109/371472 [10:30:01<17:56:56,  3.70it/s]
 36%|███▌      | 132110/371472 [10:30:01<18:12:58,  3.65it/s]
 36%|███▌      | 132111/371472 [10:30:02<18:26:35,  3.61it/s]
 36%|███▌      | 132112/371472 [10:30:02<17:42:57,  3.75it/s]
 36%|███▌      | 132113/371472 [10:30:02<17:53:55,  3.71it/s]
 36%|███▌      | 132114/371472 [10:30:02<17:54:59,  3.71it/s]
 36%|███▌      | 132115/371472 [10:30:03<21:26:48,  3.10it/s]
 36%|███▌      | 132116/371472 [10:30:03<20:35:19,  3.23it/s]
 36%|███▌      | 132117/371472 [10:30:03<19:36:41,  3.39it/s]
 36%|███▌      | 132118/371472 [10:30:04<20:08:04,  3.30it/s]
 36%|███▌      | 132119/371472 [10:30:04<19:23:30,  3.43it/s]
 36%|███▌      | 132120/371472 [10:30:04<18:20:20,  3.63it/s]
                                                             
{'loss': 3.3028, 'learning_rate': 6.802128897412141e-07, 'epoch': 5.69}

 36%|███▌      | 132120/371472 [10:30:04<18:20:20,  3.63it/s]
 36%|███▌      | 132121/371472 [10:30:04<18:09:33,  3.66it/s]
 36%|███▌      | 132122/371472 [10:30:05<18:02:18,  3.69it/s]
 36%|███▌      | 132123/371472 [10:30:05<18:01:54,  3.69it/s]
 36%|███▌      | 132124/371472 [10:30:05<17:46:19,  3.74it/s]
 36%|███▌      | 132125/371472 [10:30:05<17:46:40,  3.74it/s]
 36%|███▌      | 132126/371472 [10:30:06<17:27:53,  3.81it/s]
 36%|███▌      | 132127/371472 [10:30:06<21:41:45,  3.06it/s]
 36%|███▌      | 132128/371472 [10:30:06<20:21:26,  3.27it/s]
 36%|███▌      | 132129/371472 [10:30:07<20:50:21,  3.19it/s]
 36%|███▌      | 132130/371472 [10:30:07<19:08:12,  3.47it/s]
 36%|███▌      | 132131/371472 [10:30:07<18:08:27,  3.66it/s]
 36%|███▌      | 132132/371472 [10:30:07<17:34:36,  3.78it/s]
 36%|███▌      | 132133/371472 [10:30:08<17:40:19,  3.76it/s]
 36%|███▌      | 132134/371472 [10:30:08<18:02:27,  3.69it/s]
 36%|███▌      | 132135/371472 [10:30:08<19:47:31,  3.36it/s]
 36%|███▌      | 132136/371472 [10:30:09<20:29:20,  3.24it/s]
 36%|███▌      | 132137/371472 [10:30:09<20:08:09,  3.30it/s]
 36%|███▌      | 132138/371472 [10:30:09<21:47:01,  3.05it/s]
 36%|███▌      | 132139/371472 [10:30:10<20:52:08,  3.19it/s]
 36%|███▌      | 132140/371472 [10:30:10<20:23:31,  3.26it/s]
                                                             
{'loss': 3.0871, 'learning_rate': 6.801644077657351e-07, 'epoch': 5.69}

 36%|███▌      | 132140/371472 [10:30:10<20:23:31,  3.26it/s]
 36%|███▌      | 132141/371472 [10:30:10<19:39:30,  3.38it/s]
 36%|███▌      | 132142/371472 [10:30:10<19:07:54,  3.47it/s]
 36%|███▌      | 132143/371472 [10:30:11<18:28:50,  3.60it/s]
 36%|███▌      | 132144/371472 [10:30:11<18:29:07,  3.60it/s]
 36%|███▌      | 132145/371472 [10:30:11<17:54:47,  3.71it/s]
 36%|███▌      | 132146/371472 [10:30:12<18:10:25,  3.66it/s]
 36%|███▌      | 132147/371472 [10:30:12<18:19:54,  3.63it/s]
 36%|███▌      | 132148/371472 [10:30:12<17:56:17,  3.71it/s]
 36%|███▌      | 132149/371472 [10:30:12<17:47:27,  3.74it/s]
 36%|███▌      | 132150/371472 [10:30:13<18:56:48,  3.51it/s]
 36%|███▌      | 132151/371472 [10:30:13<19:44:10,  3.37it/s]
 36%|███▌      | 132152/371472 [10:30:13<20:43:46,  3.21it/s]
 36%|███▌      | 132153/371472 [10:30:14<19:54:34,  3.34it/s]
 36%|███▌      | 132154/371472 [10:30:14<19:19:04,  3.44it/s]
 36%|███▌      | 132155/371472 [10:30:14<19:23:54,  3.43it/s]
 36%|███▌      | 132156/371472 [10:30:14<19:23:42,  3.43it/s]
 36%|███▌      | 132157/371472 [10:30:15<18:48:34,  3.53it/s]
 36%|███▌      | 132158/371472 [10:30:15<18:59:12,  3.50it/s]
 36%|███▌      | 132159/371472 [10:30:15<19:38:50,  3.38it/s]
 36%|███▌      | 132160/371472 [10:30:16<18:58:15,  3.50it/s]
                                                             
{'loss': 3.2126, 'learning_rate': 6.801159257902561e-07, 'epoch': 5.69}

 36%|███▌      | 132160/371472 [10:30:16<18:58:15,  3.50it/s]
 36%|███▌      | 132161/371472 [10:30:16<18:25:27,  3.61it/s]
 36%|███▌      | 132162/371472 [10:30:16<18:49:55,  3.53it/s]
 36%|███▌      | 132163/371472 [10:30:16<19:29:22,  3.41it/s]
 36%|███▌      | 132164/371472 [10:30:17<19:22:14,  3.43it/s]
 36%|███▌      | 132165/371472 [10:30:17<18:50:32,  3.53it/s]
 36%|███▌      | 132166/371472 [10:30:17<18:40:07,  3.56it/s]
 36%|███▌      | 132167/371472 [10:30:18<18:24:33,  3.61it/s]
 36%|███▌      | 132168/371472 [10:30:18<17:53:08,  3.72it/s]
 36%|███▌      | 132169/371472 [10:30:18<19:12:40,  3.46it/s]
 36%|███▌      | 132170/371472 [10:30:18<18:50:11,  3.53it/s]
 36%|███▌      | 132171/371472 [10:30:19<19:01:45,  3.49it/s]
 36%|███▌      | 132172/371472 [10:30:19<18:24:13,  3.61it/s]
 36%|███▌      | 132173/371472 [10:30:19<20:19:42,  3.27it/s]
 36%|███▌      | 132174/371472 [10:30:20<21:01:05,  3.16it/s]
 36%|███▌      | 132175/371472 [10:30:20<19:45:12,  3.37it/s]
 36%|███▌      | 132176/371472 [10:30:20<21:05:34,  3.15it/s]
 36%|███▌      | 132177/371472 [10:30:21<21:39:13,  3.07it/s]
 36%|███▌      | 132178/371472 [10:30:21<20:34:30,  3.23it/s]
 36%|███▌      | 132179/371472 [10:30:21<20:57:42,  3.17it/s]
 36%|███▌      | 132180/371472 [10:30:22<20:46:23,  3.20it/s]
                                                             
{'loss': 3.1723, 'learning_rate': 6.800674438147773e-07, 'epoch': 5.69}

 36%|███▌      | 132180/371472 [10:30:22<20:46:23,  3.20it/s]
 36%|███▌      | 132181/371472 [10:30:22<19:33:02,  3.40it/s]
 36%|███▌      | 132182/371472 [10:30:22<19:14:24,  3.45it/s]
 36%|███▌      | 132183/371472 [10:30:22<18:52:49,  3.52it/s]
 36%|███▌      | 132184/371472 [10:30:23<18:56:06,  3.51it/s]
 36%|███▌      | 132185/371472 [10:30:23<19:54:35,  3.34it/s]
 36%|███▌      | 132186/371472 [10:30:23<19:25:05,  3.42it/s]
 36%|███▌      | 132187/371472 [10:30:24<18:33:39,  3.58it/s]
 36%|███▌      | 132188/371472 [10:30:24<18:45:21,  3.54it/s]
 36%|███▌      | 132189/371472 [10:30:24<18:24:30,  3.61it/s]
 36%|███▌      | 132190/371472 [10:30:24<18:34:10,  3.58it/s]
 36%|███▌      | 132191/371472 [10:30:25<18:06:01,  3.67it/s]
 36%|███▌      | 132192/371472 [10:30:25<19:25:12,  3.42it/s]
 36%|███▌      | 132193/371472 [10:30:25<18:35:37,  3.57it/s]
 36%|███▌      | 132194/371472 [10:30:25<18:07:06,  3.67it/s]
 36%|███▌      | 132195/371472 [10:30:26<18:38:41,  3.56it/s]
 36%|███▌      | 132196/371472 [10:30:26<18:28:28,  3.60it/s]
 36%|███▌      | 132197/371472 [10:30:26<19:30:15,  3.41it/s]
 36%|███▌      | 132198/371472 [10:30:27<19:58:34,  3.33it/s]
 36%|███▌      | 132199/371472 [10:30:27<19:02:47,  3.49it/s]
 36%|███▌      | 132200/371472 [10:30:27<18:27:52,  3.60it/s]
                                                             
{'loss': 3.1666, 'learning_rate': 6.800189618392984e-07, 'epoch': 5.69}

 36%|███▌      | 132200/371472 [10:30:27<18:27:52,  3.60it/s]
 36%|███▌      | 132201/371472 [10:30:27<18:50:06,  3.53it/s]
 36%|███▌      | 132202/371472 [10:30:28<18:17:01,  3.64it/s]
 36%|███▌      | 132203/371472 [10:30:28<18:27:39,  3.60it/s]
 36%|███▌      | 132204/371472 [10:30:28<19:04:34,  3.48it/s]
 36%|███▌      | 132205/371472 [10:30:29<18:49:10,  3.53it/s]
 36%|███▌      | 132206/371472 [10:30:29<18:32:45,  3.58it/s]
 36%|███▌      | 132207/371472 [10:30:29<18:32:39,  3.58it/s]
 36%|███▌      | 132208/371472 [10:30:29<18:47:57,  3.54it/s]
 36%|███▌      | 132209/371472 [10:30:30<17:57:59,  3.70it/s]
 36%|███▌      | 132210/371472 [10:30:30<18:23:51,  3.61it/s]
 36%|███▌      | 132211/371472 [10:30:30<18:38:24,  3.57it/s]
 36%|███▌      | 132212/371472 [10:30:31<19:56:43,  3.33it/s]
 36%|███▌      | 132213/371472 [10:30:31<18:54:13,  3.52it/s]
 36%|███▌      | 132214/371472 [10:30:31<19:44:26,  3.37it/s]
 36%|███▌      | 132215/371472 [10:30:31<19:16:41,  3.45it/s]
 36%|███▌      | 132216/371472 [10:30:32<20:01:28,  3.32it/s]
 36%|███▌      | 132217/371472 [10:30:32<19:23:44,  3.43it/s]
 36%|███▌      | 132218/371472 [10:30:32<19:02:26,  3.49it/s]
 36%|███▌      | 132219/371472 [10:30:33<18:42:18,  3.55it/s]
 36%|███▌      | 132220/371472 [10:30:33<18:38:53,  3.56it/s]
                                                             
{'loss': 3.0644, 'learning_rate': 6.799704798638195e-07, 'epoch': 5.69}

 36%|███▌      | 132220/371472 [10:30:33<18:38:53,  3.56it/s]
 36%|███▌      | 132221/371472 [10:30:33<18:25:26,  3.61it/s]
 36%|███▌      | 132222/371472 [10:30:33<17:52:45,  3.72it/s]
 36%|███▌      | 132223/371472 [10:30:34<17:53:27,  3.71it/s]
 36%|███▌      | 132224/371472 [10:30:34<17:46:07,  3.74it/s]
 36%|███▌      | 132225/371472 [10:30:34<18:46:06,  3.54it/s]
 36%|███▌      | 132226/371472 [10:30:35<19:22:18,  3.43it/s]
 36%|███▌      | 132227/371472 [10:30:35<18:59:59,  3.50it/s]
 36%|███▌      | 132228/371472 [10:30:35<18:24:27,  3.61it/s]
 36%|███▌      | 132229/371472 [10:30:35<18:27:20,  3.60it/s]
 36%|███▌      | 132230/371472 [10:30:36<18:31:04,  3.59it/s]
 36%|███▌      | 132231/371472 [10:30:36<18:34:55,  3.58it/s]
 36%|███▌      | 132232/371472 [10:30:36<19:13:39,  3.46it/s]
 36%|███▌      | 132233/371472 [10:30:37<18:52:13,  3.52it/s]
 36%|███▌      | 132234/371472 [10:30:37<18:48:35,  3.53it/s]
 36%|███▌      | 132235/371472 [10:30:37<20:06:15,  3.31it/s]
 36%|███▌      | 132236/371472 [10:30:37<18:40:56,  3.56it/s]
 36%|███▌      | 132237/371472 [10:30:38<18:53:59,  3.52it/s]
 36%|███▌      | 132238/371472 [10:30:38<18:29:09,  3.59it/s]
 36%|███▌      | 132239/371472 [10:30:38<18:25:35,  3.61it/s]
 36%|███▌      | 132240/371472 [10:30:38<18:08:02,  3.66it/s]
                                                             
{'loss': 3.1257, 'learning_rate': 6.799219978883405e-07, 'epoch': 5.7}

 36%|███▌      | 132240/371472 [10:30:38<18:08:02,  3.66it/s]
 36%|███▌      | 132241/371472 [10:30:39<17:55:24,  3.71it/s]
 36%|███▌      | 132242/371472 [10:30:39<18:21:19,  3.62it/s]
 36%|███▌      | 132243/371472 [10:30:39<20:23:35,  3.26it/s]
 36%|███▌      | 132244/371472 [10:30:40<19:38:26,  3.38it/s]
 36%|███▌      | 132245/371472 [10:30:40<19:14:40,  3.45it/s]
 36%|███▌      | 132246/371472 [10:30:40<20:39:08,  3.22it/s]
 36%|███▌      | 132247/371472 [10:30:41<20:10:37,  3.29it/s]
 36%|███▌      | 132248/371472 [10:30:41<19:46:55,  3.36it/s]
 36%|███▌      | 132249/371472 [10:30:41<19:04:43,  3.48it/s]
 36%|███▌      | 132250/371472 [10:30:41<19:41:30,  3.37it/s]
 36%|███▌      | 132251/371472 [10:30:42<18:52:40,  3.52it/s]
 36%|███▌      | 132252/371472 [10:30:42<18:32:29,  3.58it/s]
 36%|███▌      | 132253/371472 [10:30:42<18:35:23,  3.57it/s]
 36%|███▌      | 132254/371472 [10:30:43<18:10:37,  3.66it/s]
 36%|███▌      | 132255/371472 [10:30:43<18:30:34,  3.59it/s]
 36%|███▌      | 132256/371472 [10:30:43<18:39:45,  3.56it/s]
 36%|███▌      | 132257/371472 [10:30:43<18:46:27,  3.54it/s]
 36%|███▌      | 132258/371472 [10:30:44<18:41:42,  3.55it/s]
 36%|███▌      | 132259/371472 [10:30:44<18:30:47,  3.59it/s]
 36%|███▌      | 132260/371472 [10:30:44<17:57:52,  3.70it/s]
                                                             
{'loss': 3.1779, 'learning_rate': 6.798735159128617e-07, 'epoch': 5.7}

 36%|███▌      | 132260/371472 [10:30:44<17:57:52,  3.70it/s]
 36%|███▌      | 132261/371472 [10:30:44<17:32:30,  3.79it/s]
 36%|███▌      | 132262/371472 [10:30:45<17:26:22,  3.81it/s]
 36%|███▌      | 132263/371472 [10:30:45<17:18:35,  3.84it/s]
 36%|███▌      | 132264/371472 [10:30:45<18:31:44,  3.59it/s]
 36%|███▌      | 132265/371472 [10:30:46<17:55:04,  3.71it/s]
 36%|███▌      | 132266/371472 [10:30:46<17:42:19,  3.75it/s]
 36%|███▌      | 132267/371472 [10:30:46<17:25:48,  3.81it/s]
 36%|███▌      | 132268/371472 [10:30:46<18:08:45,  3.66it/s]
 36%|███▌      | 132269/371472 [10:30:47<17:46:33,  3.74it/s]
 36%|███▌      | 132270/371472 [10:30:47<18:15:13,  3.64it/s]
 36%|███▌      | 132271/371472 [10:30:47<18:20:25,  3.62it/s]
 36%|███▌      | 132272/371472 [10:30:47<18:12:10,  3.65it/s]
 36%|███▌      | 132273/371472 [10:30:48<18:49:52,  3.53it/s]
 36%|███▌      | 132274/371472 [10:30:48<19:14:45,  3.45it/s]
 36%|███▌      | 132275/371472 [10:30:48<19:01:48,  3.49it/s]
 36%|███▌      | 132276/371472 [10:30:49<19:46:22,  3.36it/s]
 36%|███▌      | 132277/371472 [10:30:49<19:22:56,  3.43it/s]
 36%|███▌      | 132278/371472 [10:30:49<18:23:46,  3.61it/s]
 36%|███▌      | 132279/371472 [10:30:49<17:29:53,  3.80it/s]
 36%|███▌      | 132280/371472 [10:30:50<18:07:59,  3.66it/s]
                                                             
{'loss': 3.295, 'learning_rate': 6.798250339373829e-07, 'epoch': 5.7}

 36%|███▌      | 132280/371472 [10:30:50<18:07:59,  3.66it/s]
 36%|███▌      | 132281/371472 [10:30:50<17:23:36,  3.82it/s]
 36%|███▌      | 132282/371472 [10:30:50<16:53:49,  3.93it/s]
 36%|███▌      | 132283/371472 [10:30:50<16:58:30,  3.91it/s]
 36%|███▌      | 132284/371472 [10:30:51<17:07:13,  3.88it/s]
 36%|███▌      | 132285/371472 [10:30:51<17:42:17,  3.75it/s]
 36%|███▌      | 132286/371472 [10:30:51<18:31:50,  3.59it/s]
 36%|███▌      | 132287/371472 [10:30:52<18:32:15,  3.58it/s]
 36%|███▌      | 132288/371472 [10:30:52<18:11:59,  3.65it/s]
 36%|███▌      | 132289/371472 [10:30:52<19:15:24,  3.45it/s]
 36%|███▌      | 132290/371472 [10:30:52<19:26:27,  3.42it/s]
 36%|███▌      | 132291/371472 [10:30:53<18:41:12,  3.56it/s]
 36%|███▌      | 132292/371472 [10:30:53<18:36:55,  3.57it/s]
 36%|███▌      | 132293/371472 [10:30:53<17:42:34,  3.75it/s]
 36%|███▌      | 132294/371472 [10:30:53<17:40:01,  3.76it/s]
 36%|███▌      | 132295/371472 [10:30:54<20:33:45,  3.23it/s]
 36%|███▌      | 132296/371472 [10:30:54<21:05:48,  3.15it/s]
 36%|███▌      | 132297/371472 [10:30:54<20:05:51,  3.31it/s]
 36%|███▌      | 132298/371472 [10:30:55<19:06:33,  3.48it/s]
 36%|███▌      | 132299/371472 [10:30:55<19:30:16,  3.41it/s]
 36%|███▌      | 132300/371472 [10:30:55<18:43:18,  3.55it/s]
                                                             
{'loss': 3.2091, 'learning_rate': 6.79776551961904e-07, 'epoch': 5.7}

 36%|███▌      | 132300/371472 [10:30:55<18:43:18,  3.55it/s]
 36%|███▌      | 132301/371472 [10:30:56<18:48:48,  3.53it/s]
 36%|███▌      | 132302/371472 [10:30:56<18:08:44,  3.66it/s]
 36%|███▌      | 132303/371472 [10:30:56<17:36:28,  3.77it/s]
 36%|███▌      | 132304/371472 [10:30:56<17:39:27,  3.76it/s]
 36%|███▌      | 132305/371472 [10:30:57<16:59:26,  3.91it/s]
 36%|███▌      | 132306/371472 [10:30:57<17:16:51,  3.84it/s]
 36%|███▌      | 132307/371472 [10:30:57<17:10:45,  3.87it/s]
 36%|███▌      | 132308/371472 [10:30:57<17:35:31,  3.78it/s]
 36%|███▌      | 132309/371472 [10:30:58<18:48:45,  3.53it/s]
 36%|███▌      | 132310/371472 [10:30:58<18:37:00,  3.57it/s]
 36%|███▌      | 132311/371472 [10:30:58<19:24:41,  3.42it/s]
 36%|███▌      | 132312/371472 [10:30:59<18:47:41,  3.53it/s]
 36%|███▌      | 132313/371472 [10:30:59<18:57:17,  3.50it/s]
 36%|███▌      | 132314/371472 [10:30:59<18:17:39,  3.63it/s]
 36%|███▌      | 132315/371472 [10:30:59<17:59:22,  3.69it/s]
 36%|███▌      | 132316/371472 [10:31:00<20:09:17,  3.30it/s]
 36%|███▌      | 132317/371472 [10:31:00<19:08:54,  3.47it/s]
 36%|███▌      | 132318/371472 [10:31:00<18:58:04,  3.50it/s]
 36%|███▌      | 132319/371472 [10:31:01<18:11:25,  3.65it/s]
 36%|███▌      | 132320/371472 [10:31:01<19:17:15,  3.44it/s]
                                                             
{'loss': 3.1656, 'learning_rate': 6.79728069986425e-07, 'epoch': 5.7}

 36%|███▌      | 132320/371472 [10:31:01<19:17:15,  3.44it/s]
 36%|███▌      | 132321/371472 [10:31:01<18:39:59,  3.56it/s]
 36%|███▌      | 132322/371472 [10:31:01<18:33:41,  3.58it/s]
 36%|███▌      | 132323/371472 [10:31:02<18:33:36,  3.58it/s]
 36%|███▌      | 132324/371472 [10:31:02<18:06:33,  3.67it/s]
 36%|███▌      | 132325/371472 [10:31:02<19:00:01,  3.50it/s]
 36%|███▌      | 132326/371472 [10:31:03<19:07:48,  3.47it/s]
 36%|███▌      | 132327/371472 [10:31:03<18:34:15,  3.58it/s]
 36%|███▌      | 132328/371472 [10:31:03<18:21:36,  3.62it/s]
 36%|███▌      | 132329/371472 [10:31:03<18:05:04,  3.67it/s]
 36%|███▌      | 132330/371472 [10:31:04<17:46:38,  3.74it/s]
 36%|███▌      | 132331/371472 [10:31:04<18:12:21,  3.65it/s]
 36%|███▌      | 132332/371472 [10:31:04<17:23:51,  3.82it/s]
 36%|███▌      | 132333/371472 [10:31:04<17:28:15,  3.80it/s]
 36%|███▌      | 132334/371472 [10:31:05<17:43:39,  3.75it/s]
 36%|███▌      | 132335/371472 [10:31:05<17:51:58,  3.72it/s]
 36%|███▌      | 132336/371472 [10:31:05<17:50:16,  3.72it/s]
 36%|███▌      | 132337/371472 [10:31:05<17:59:46,  3.69it/s]
 36%|███▌      | 132338/371472 [10:31:06<17:30:21,  3.79it/s]
 36%|███▌      | 132339/371472 [10:31:06<17:37:25,  3.77it/s]
 36%|███▌      | 132340/371472 [10:31:06<17:30:08,  3.80it/s]
                                                             
{'loss': 3.2217, 'learning_rate': 6.796795880109461e-07, 'epoch': 5.7}

 36%|███▌      | 132340/371472 [10:31:06<17:30:08,  3.80it/s]
 36%|███▌      | 132341/371472 [10:31:06<17:11:20,  3.86it/s]
 36%|███▌      | 132342/371472 [10:31:07<17:58:01,  3.70it/s]
 36%|███▌      | 132343/371472 [10:31:07<17:32:41,  3.79it/s]
 36%|███▌      | 132344/371472 [10:31:07<17:43:05,  3.75it/s]
 36%|███▌      | 132345/371472 [10:31:08<19:00:46,  3.49it/s]
 36%|███▌      | 132346/371472 [10:31:08<18:59:40,  3.50it/s]
 36%|███▌      | 132347/371472 [10:31:08<18:33:58,  3.58it/s]
 36%|███▌      | 132348/371472 [10:31:08<17:56:28,  3.70it/s]
 36%|███▌      | 132349/371472 [10:31:09<17:23:53,  3.82it/s]
 36%|███▌      | 132350/371472 [10:31:09<17:41:46,  3.75it/s]
 36%|███▌      | 132351/371472 [10:31:09<17:50:28,  3.72it/s]
 36%|███▌      | 132352/371472 [10:31:10<17:57:20,  3.70it/s]
 36%|███▌      | 132353/371472 [10:31:10<18:14:12,  3.64it/s]
 36%|███▌      | 132354/371472 [10:31:10<18:46:26,  3.54it/s]
 36%|███▌      | 132355/371472 [10:31:10<18:56:44,  3.51it/s]
 36%|███▌      | 132356/371472 [10:31:11<17:46:11,  3.74it/s]
 36%|███▌      | 132357/371472 [10:31:11<19:24:39,  3.42it/s]
 36%|███▌      | 132358/371472 [10:31:11<19:48:56,  3.35it/s]
 36%|███▌      | 132359/371472 [10:31:12<18:56:20,  3.51it/s]
 36%|███▌      | 132360/371472 [10:31:12<18:35:23,  3.57it/s]
                                                             
{'loss': 3.0465, 'learning_rate': 6.796311060354673e-07, 'epoch': 5.7}

 36%|███▌      | 132360/371472 [10:31:12<18:35:23,  3.57it/s]
 36%|███▌      | 132361/371472 [10:31:12<18:39:59,  3.56it/s]
 36%|███▌      | 132362/371472 [10:31:12<18:37:10,  3.57it/s]
 36%|███▌      | 132363/371472 [10:31:13<18:12:42,  3.65it/s]
 36%|███▌      | 132364/371472 [10:31:13<17:46:48,  3.74it/s]
 36%|███▌      | 132365/371472 [10:31:13<18:57:57,  3.50it/s]
 36%|███▌      | 132366/371472 [10:31:13<18:16:48,  3.63it/s]
 36%|███▌      | 132367/371472 [10:31:14<19:05:05,  3.48it/s]
 36%|███▌      | 132368/371472 [10:31:14<18:03:10,  3.68it/s]
 36%|███▌      | 132369/371472 [10:31:14<17:28:58,  3.80it/s]
 36%|███▌      | 132370/371472 [10:31:14<17:02:10,  3.90it/s]
 36%|███▌      | 132371/371472 [10:31:15<18:19:07,  3.63it/s]
 36%|███▌      | 132372/371472 [10:31:15<18:32:19,  3.58it/s]
 36%|███▌      | 132373/371472 [10:31:15<18:21:21,  3.62it/s]
 36%|███▌      | 132374/371472 [10:31:16<18:33:34,  3.58it/s]
 36%|███▌      | 132375/371472 [10:31:16<18:20:29,  3.62it/s]
 36%|███▌      | 132376/371472 [10:31:16<18:09:41,  3.66it/s]
 36%|███▌      | 132377/371472 [10:31:16<18:28:08,  3.60it/s]
 36%|███▌      | 132378/371472 [10:31:17<17:27:38,  3.80it/s]
 36%|███▌      | 132379/371472 [10:31:17<19:14:59,  3.45it/s]
 36%|███▌      | 132380/371472 [10:31:17<18:31:33,  3.58it/s]
                                                             
{'loss': 3.0063, 'learning_rate': 6.795826240599883e-07, 'epoch': 5.7}

 36%|███▌      | 132380/371472 [10:31:17<18:31:33,  3.58it/s]
 36%|███▌      | 132381/371472 [10:31:18<18:13:51,  3.64it/s]
 36%|███▌      | 132382/371472 [10:31:18<19:28:43,  3.41it/s]
 36%|███▌      | 132383/371472 [10:31:18<19:05:35,  3.48it/s]
 36%|███▌      | 132384/371472 [10:31:19<20:27:53,  3.25it/s]
 36%|███▌      | 132385/371472 [10:31:19<19:25:59,  3.42it/s]
 36%|███▌      | 132386/371472 [10:31:19<19:00:54,  3.49it/s]
 36%|███▌      | 132387/371472 [10:31:19<21:13:28,  3.13it/s]
 36%|███▌      | 132388/371472 [10:31:20<20:27:32,  3.25it/s]
 36%|███▌      | 132389/371472 [10:31:20<19:50:16,  3.35it/s]
 36%|███▌      | 132390/371472 [10:31:20<20:22:55,  3.26it/s]
 36%|███▌      | 132391/371472 [10:31:21<21:02:40,  3.16it/s]
 36%|███▌      | 132392/371472 [10:31:21<21:28:17,  3.09it/s]
 36%|███▌      | 132393/371472 [10:31:21<20:12:34,  3.29it/s]
 36%|███▌      | 132394/371472 [10:31:22<19:41:40,  3.37it/s]
 36%|███▌      | 132395/371472 [10:31:22<20:13:03,  3.28it/s]
 36%|███▌      | 132396/371472 [10:31:22<19:29:41,  3.41it/s]
 36%|███▌      | 132397/371472 [10:31:22<20:16:31,  3.28it/s]
 36%|███▌      | 132398/371472 [10:31:23<20:44:21,  3.20it/s]
 36%|███▌      | 132399/371472 [10:31:23<19:56:38,  3.33it/s]
 36%|███▌      | 132400/371472 [10:31:23<19:24:21,  3.42it/s]
                                                             
{'loss': 3.0732, 'learning_rate': 6.795341420845094e-07, 'epoch': 5.7}

 36%|███▌      | 132400/371472 [10:31:23<19:24:21,  3.42it/s]
 36%|███▌      | 132401/371472 [10:31:24<18:17:00,  3.63it/s]
 36%|███▌      | 132402/371472 [10:31:24<18:20:29,  3.62it/s]
 36%|███▌      | 132403/371472 [10:31:24<17:46:03,  3.74it/s]
 36%|███▌      | 132404/371472 [10:31:24<18:12:00,  3.65it/s]
 36%|███▌      | 132405/371472 [10:31:25<18:02:35,  3.68it/s]
 36%|███▌      | 132406/371472 [10:31:25<18:21:54,  3.62it/s]
 36%|███▌      | 132407/371472 [10:31:25<20:35:36,  3.22it/s]
 36%|███▌      | 132408/371472 [10:31:26<20:07:35,  3.30it/s]
 36%|███▌      | 132409/371472 [10:31:26<20:01:52,  3.32it/s]
 36%|███▌      | 132410/371472 [10:31:26<19:26:37,  3.42it/s]
 36%|███▌      | 132411/371472 [10:31:27<19:21:45,  3.43it/s]
 36%|███▌      | 132412/371472 [10:31:27<18:44:23,  3.54it/s]
 36%|███▌      | 132413/371472 [10:31:27<18:34:10,  3.58it/s]
 36%|███▌      | 132414/371472 [10:31:27<18:16:39,  3.63it/s]
 36%|███▌      | 132415/371472 [10:31:28<17:21:41,  3.82it/s]
 36%|███▌      | 132416/371472 [10:31:28<17:50:50,  3.72it/s]
 36%|███▌      | 132417/371472 [10:31:28<17:38:08,  3.77it/s]
 36%|███▌      | 132418/371472 [10:31:28<18:21:44,  3.62it/s]
 36%|███▌      | 132419/371472 [10:31:29<18:30:21,  3.59it/s]
 36%|███▌      | 132420/371472 [10:31:29<17:56:49,  3.70it/s]
                                                             
{'loss': 3.0586, 'learning_rate': 6.794856601090306e-07, 'epoch': 5.7}

 36%|███▌      | 132420/371472 [10:31:29<17:56:49,  3.70it/s]
 36%|███▌      | 132421/371472 [10:31:29<19:31:37,  3.40it/s]
 36%|███▌      | 132422/371472 [10:31:30<20:17:56,  3.27it/s]
 36%|███▌      | 132423/371472 [10:31:30<20:17:56,  3.27it/s]
 36%|███▌      | 132424/371472 [10:31:30<19:52:25,  3.34it/s]
 36%|███▌      | 132425/371472 [10:31:30<19:42:26,  3.37it/s]
 36%|███▌      | 132426/371472 [10:31:31<19:18:47,  3.44it/s]
 36%|███▌      | 132427/371472 [10:31:31<18:47:33,  3.53it/s]
 36%|███▌      | 132428/371472 [10:31:31<18:05:03,  3.67it/s]
 36%|███▌      | 132429/371472 [10:31:32<17:37:55,  3.77it/s]
 36%|███▌      | 132430/371472 [10:31:32<17:33:49,  3.78it/s]
 36%|███▌      | 132431/371472 [10:31:32<18:10:16,  3.65it/s]
 36%|███▌      | 132432/371472 [10:31:32<17:49:08,  3.73it/s]
 36%|███▌      | 132433/371472 [10:31:33<18:35:49,  3.57it/s]
 36%|███▌      | 132434/371472 [10:31:33<18:18:25,  3.63it/s]
 36%|███▌      | 132435/371472 [10:31:33<17:30:30,  3.79it/s]
 36%|███▌      | 132436/371472 [10:31:33<17:08:02,  3.88it/s]
 36%|███▌      | 132437/371472 [10:31:34<16:53:26,  3.93it/s]
 36%|███▌      | 132438/371472 [10:31:34<16:39:46,  3.98it/s]
 36%|███▌      | 132439/371472 [10:31:34<16:55:16,  3.92it/s]
 36%|███▌      | 132440/371472 [10:31:34<17:18:03,  3.84it/s]
                                                             
{'loss': 3.337, 'learning_rate': 6.794371781335518e-07, 'epoch': 5.7}

 36%|███▌      | 132440/371472 [10:31:34<17:18:03,  3.84it/s]
 36%|███▌      | 132441/371472 [10:31:35<18:00:42,  3.69it/s]
 36%|███▌      | 132442/371472 [10:31:35<18:10:08,  3.65it/s]
 36%|███▌      | 132443/371472 [10:31:35<18:07:20,  3.66it/s]
 36%|███▌      | 132444/371472 [10:31:35<17:13:34,  3.85it/s]
 36%|███▌      | 132445/371472 [10:31:36<17:24:56,  3.81it/s]
 36%|███▌      | 132446/371472 [10:31:36<17:25:42,  3.81it/s]
 36%|███▌      | 132447/371472 [10:31:36<18:34:50,  3.57it/s]
 36%|███▌      | 132448/371472 [10:31:37<19:03:10,  3.48it/s]
 36%|███▌      | 132449/371472 [10:31:37<19:09:25,  3.47it/s]
 36%|███▌      | 132450/371472 [10:31:37<21:08:30,  3.14it/s]
 36%|███▌      | 132451/371472 [10:31:38<21:05:00,  3.15it/s]
 36%|███▌      | 132452/371472 [10:31:38<20:56:33,  3.17it/s]
 36%|███▌      | 132453/371472 [10:31:38<19:40:44,  3.37it/s]
 36%|███▌      | 132454/371472 [10:31:38<19:16:35,  3.44it/s]
 36%|███▌      | 132455/371472 [10:31:39<19:09:54,  3.46it/s]
 36%|███▌      | 132456/371472 [10:31:39<19:49:20,  3.35it/s]
 36%|███▌      | 132457/371472 [10:31:39<20:44:39,  3.20it/s]
 36%|███▌      | 132458/371472 [10:31:40<22:11:37,  2.99it/s]
 36%|███▌      | 132459/371472 [10:31:40<20:32:46,  3.23it/s]
 36%|███▌      | 132460/371472 [10:31:40<20:45:04,  3.20it/s]
                                                             
{'loss': 3.1075, 'learning_rate': 6.793886961580726e-07, 'epoch': 5.71}

 36%|███▌      | 132460/371472 [10:31:40<20:45:04,  3.20it/s]
 36%|███▌      | 132461/371472 [10:31:41<20:01:39,  3.32it/s]
 36%|███▌      | 132462/371472 [10:31:41<18:57:12,  3.50it/s]
 36%|███▌      | 132463/371472 [10:31:41<19:00:07,  3.49it/s]
 36%|███▌      | 132464/371472 [10:31:41<18:39:10,  3.56it/s]
 36%|███▌      | 132465/371472 [10:31:42<19:12:09,  3.46it/s]
 36%|███▌      | 132466/371472 [10:31:42<18:19:12,  3.62it/s]
 36%|███▌      | 132467/371472 [10:31:42<19:33:13,  3.40it/s]
 36%|███▌      | 132468/371472 [10:31:43<18:34:28,  3.57it/s]
 36%|███▌      | 132469/371472 [10:31:43<23:17:12,  2.85it/s]
 36%|███▌      | 132470/371472 [10:31:43<22:08:43,  3.00it/s]
 36%|███▌      | 132471/371472 [10:31:44<21:05:21,  3.15it/s]
 36%|███▌      | 132472/371472 [10:31:44<20:18:18,  3.27it/s]
 36%|███▌      | 132473/371472 [10:31:44<19:36:57,  3.38it/s]
 36%|███▌      | 132474/371472 [10:31:45<20:53:04,  3.18it/s]
 36%|███▌      | 132475/371472 [10:31:45<19:50:16,  3.35it/s]
 36%|███▌      | 132476/371472 [10:31:45<21:42:22,  3.06it/s]
 36%|███▌      | 132477/371472 [10:31:45<20:06:31,  3.30it/s]
 36%|███▌      | 132478/371472 [10:31:46<19:43:31,  3.37it/s]
 36%|███▌      | 132479/371472 [10:31:46<18:38:25,  3.56it/s]
 36%|███▌      | 132480/371472 [10:31:46<19:31:08,  3.40it/s]
                                                             
{'loss': 3.1479, 'learning_rate': 6.793402141825938e-07, 'epoch': 5.71}

 36%|███▌      | 132480/371472 [10:31:46<19:31:08,  3.40it/s]
 36%|███▌      | 132481/371472 [10:31:47<19:15:17,  3.45it/s]
 36%|███▌      | 132482/371472 [10:31:47<19:08:20,  3.47it/s]
 36%|███▌      | 132483/371472 [10:31:47<20:59:00,  3.16it/s]
 36%|███▌      | 132484/371472 [10:31:48<20:55:19,  3.17it/s]
 36%|███▌      | 132485/371472 [10:31:48<19:33:11,  3.40it/s]
 36%|███▌      | 132486/371472 [10:31:48<18:35:48,  3.57it/s]
 36%|███▌      | 132487/371472 [10:31:48<19:27:06,  3.41it/s]
 36%|███▌      | 132488/371472 [10:31:49<18:28:37,  3.59it/s]
 36%|███▌      | 132489/371472 [10:31:49<18:18:51,  3.62it/s]
 36%|███▌      | 132490/371472 [10:31:49<17:36:28,  3.77it/s]
 36%|███▌      | 132491/371472 [10:31:49<18:02:13,  3.68it/s]
 36%|███▌      | 132492/371472 [10:31:50<19:59:51,  3.32it/s]
 36%|███▌      | 132493/371472 [10:31:50<20:42:52,  3.20it/s]
 36%|███▌      | 132494/371472 [10:31:51<22:07:28,  3.00it/s]
 36%|███▌      | 132495/371472 [10:31:51<20:36:55,  3.22it/s]
 36%|███▌      | 132496/371472 [10:31:51<20:21:40,  3.26it/s]
 36%|███▌      | 132497/371472 [10:31:51<18:50:06,  3.52it/s]
 36%|███▌      | 132498/371472 [10:31:52<19:36:05,  3.39it/s]
 36%|███▌      | 132499/371472 [10:31:52<19:20:47,  3.43it/s]
 36%|███▌      | 132500/371472 [10:31:52<20:40:38,  3.21it/s]
                                                             
{'loss': 3.068, 'learning_rate': 6.79291732207115e-07, 'epoch': 5.71}

 36%|███▌      | 132500/371472 [10:31:52<20:40:38,  3.21it/s]
 36%|███▌      | 132501/371472 [10:31:53<19:42:28,  3.37it/s]
 36%|███▌      | 132502/371472 [10:31:53<18:49:07,  3.53it/s]
 36%|███▌      | 132503/371472 [10:31:53<18:40:10,  3.56it/s]
 36%|███▌      | 132504/371472 [10:31:53<18:35:59,  3.57it/s]
 36%|███▌      | 132505/371472 [10:31:54<17:57:19,  3.70it/s]
 36%|███▌      | 132506/371472 [10:31:54<18:24:09,  3.61it/s]
 36%|███▌      | 132507/371472 [10:31:54<18:08:46,  3.66it/s]
 36%|███▌      | 132508/371472 [10:31:54<18:07:50,  3.66it/s]
 36%|███▌      | 132509/371472 [10:31:55<19:58:42,  3.32it/s]
 36%|███▌      | 132510/371472 [10:31:55<19:54:55,  3.33it/s]
 36%|███▌      | 132511/371472 [10:31:55<18:40:14,  3.56it/s]
 36%|███▌      | 132512/371472 [10:31:56<18:12:52,  3.64it/s]
 36%|███▌      | 132513/371472 [10:31:56<18:20:16,  3.62it/s]
 36%|███▌      | 132514/371472 [10:31:56<17:29:34,  3.79it/s]
 36%|███▌      | 132515/371472 [10:31:57<20:43:32,  3.20it/s]
 36%|███▌      | 132516/371472 [10:31:57<19:36:52,  3.38it/s]
 36%|███▌      | 132517/371472 [10:31:57<18:53:15,  3.51it/s]
 36%|███▌      | 132518/371472 [10:31:57<18:47:24,  3.53it/s]
 36%|███▌      | 132519/371472 [10:31:58<18:47:58,  3.53it/s]
 36%|███▌      | 132520/371472 [10:31:58<19:03:39,  3.48it/s]
                                                             
{'loss': 3.2656, 'learning_rate': 6.792432502316361e-07, 'epoch': 5.71}

 36%|███▌      | 132520/371472 [10:31:58<19:03:39,  3.48it/s]
 36%|███▌      | 132521/371472 [10:31:58<18:41:35,  3.55it/s]
 36%|███▌      | 132522/371472 [10:31:58<18:58:53,  3.50it/s]
 36%|███▌      | 132523/371472 [10:31:59<18:32:26,  3.58it/s]
 36%|███▌      | 132524/371472 [10:31:59<17:42:30,  3.75it/s]
 36%|███▌      | 132525/371472 [10:31:59<17:46:55,  3.73it/s]
 36%|███▌      | 132526/371472 [10:32:00<17:38:28,  3.76it/s]
 36%|███▌      | 132527/371472 [10:32:00<18:56:13,  3.50it/s]
 36%|███▌      | 132528/371472 [10:32:00<18:24:34,  3.61it/s]
 36%|███▌      | 132529/371472 [10:32:00<18:00:10,  3.69it/s]
 36%|███▌      | 132530/371472 [10:32:01<17:42:46,  3.75it/s]
 36%|███▌      | 132531/371472 [10:32:01<17:22:32,  3.82it/s]
 36%|███▌      | 132532/371472 [10:32:01<20:04:55,  3.31it/s]
 36%|███▌      | 132533/371472 [10:32:02<19:33:31,  3.39it/s]
 36%|███▌      | 132534/371472 [10:32:02<19:08:20,  3.47it/s]
 36%|███▌      | 132535/371472 [10:32:02<18:50:51,  3.52it/s]
 36%|███▌      | 132536/371472 [10:32:02<18:43:03,  3.55it/s]
 36%|███▌      | 132537/371472 [10:32:03<18:14:21,  3.64it/s]
 36%|███▌      | 132538/371472 [10:32:03<19:01:24,  3.49it/s]
 36%|███▌      | 132539/371472 [10:32:03<19:49:43,  3.35it/s]
 36%|███▌      | 132540/371472 [10:32:04<18:47:36,  3.53it/s]
                                                             
{'loss': 3.077, 'learning_rate': 6.791947682561571e-07, 'epoch': 5.71}

 36%|███▌      | 132540/371472 [10:32:04<18:47:36,  3.53it/s]
 36%|███▌      | 132541/371472 [10:32:04<18:27:29,  3.60it/s]
 36%|███▌      | 132542/371472 [10:32:04<18:31:23,  3.58it/s]
 36%|███▌      | 132543/371472 [10:32:04<18:15:09,  3.64it/s]
 36%|███▌      | 132544/371472 [10:32:05<19:42:19,  3.37it/s]
 36%|███▌      | 132545/371472 [10:32:05<19:16:57,  3.44it/s]
 36%|███▌      | 132546/371472 [10:32:05<19:17:28,  3.44it/s]
 36%|███▌      | 132547/371472 [10:32:06<19:28:55,  3.41it/s]
 36%|███▌      | 132548/371472 [10:32:06<19:00:28,  3.49it/s]
 36%|███▌      | 132549/371472 [10:32:06<18:53:28,  3.51it/s]
 36%|███▌      | 132550/371472 [10:32:06<18:34:58,  3.57it/s]
 36%|███▌      | 132551/371472 [10:32:07<18:56:11,  3.50it/s]
 36%|███▌      | 132552/371472 [10:32:07<18:18:37,  3.62it/s]
 36%|███▌      | 132553/371472 [10:32:07<17:34:16,  3.78it/s]
 36%|███▌      | 132554/371472 [10:32:07<17:21:53,  3.82it/s]
 36%|███▌      | 132555/371472 [10:32:08<16:55:06,  3.92it/s]
 36%|███▌      | 132556/371472 [10:32:08<18:11:40,  3.65it/s]
 36%|███▌      | 132557/371472 [10:32:08<17:50:35,  3.72it/s]
 36%|███▌      | 132558/371472 [10:32:08<17:47:23,  3.73it/s]
 36%|███▌      | 132559/371472 [10:32:09<17:17:22,  3.84it/s]
 36%|███▌      | 132560/371472 [10:32:09<17:15:41,  3.84it/s]
                                                             
{'loss': 3.1316, 'learning_rate': 6.791462862806783e-07, 'epoch': 5.71}

 36%|███▌      | 132560/371472 [10:32:09<17:15:41,  3.84it/s]
 36%|███▌      | 132561/371472 [10:32:09<17:24:55,  3.81it/s]
 36%|███▌      | 132562/371472 [10:32:10<17:38:40,  3.76it/s]
 36%|███▌      | 132563/371472 [10:32:10<17:51:42,  3.72it/s]
 36%|███▌      | 132564/371472 [10:32:10<18:17:59,  3.63it/s]
 36%|███▌      | 132565/371472 [10:32:10<18:38:59,  3.56it/s]
 36%|███▌      | 132566/371472 [10:32:11<18:03:56,  3.67it/s]
 36%|███▌      | 132567/371472 [10:32:11<17:27:38,  3.80it/s]
 36%|███▌      | 132568/371472 [10:32:11<17:30:18,  3.79it/s]
 36%|███▌      | 132569/371472 [10:32:11<17:50:21,  3.72it/s]
 36%|███▌      | 132570/371472 [10:32:12<17:31:53,  3.79it/s]
 36%|███▌      | 132571/371472 [10:32:12<17:30:20,  3.79it/s]
 36%|███▌      | 132572/371472 [10:32:12<17:11:47,  3.86it/s]
 36%|███▌      | 132573/371472 [10:32:13<18:28:00,  3.59it/s]
 36%|███▌      | 132574/371472 [10:32:13<17:34:01,  3.78it/s]
 36%|███▌      | 132575/371472 [10:32:13<17:35:37,  3.77it/s]
 36%|███▌      | 132576/371472 [10:32:13<17:29:51,  3.79it/s]
 36%|███▌      | 132577/371472 [10:32:14<17:48:07,  3.73it/s]
 36%|███▌      | 132578/371472 [10:32:14<17:23:50,  3.81it/s]
 36%|███▌      | 132579/371472 [10:32:14<17:32:45,  3.78it/s]
 36%|███▌      | 132580/371472 [10:32:14<18:35:47,  3.57it/s]
                                                             
{'loss': 3.1422, 'learning_rate': 6.790978043051994e-07, 'epoch': 5.71}

 36%|███▌      | 132580/371472 [10:32:14<18:35:47,  3.57it/s]
 36%|███▌      | 132581/371472 [10:32:15<17:57:33,  3.69it/s]
 36%|███▌      | 132582/371472 [10:32:15<18:06:46,  3.66it/s]
 36%|███▌      | 132583/371472 [10:32:15<18:34:38,  3.57it/s]
 36%|███▌      | 132584/371472 [10:32:15<18:32:46,  3.58it/s]
 36%|███▌      | 132585/371472 [10:32:16<19:03:20,  3.48it/s]
 36%|███▌      | 132586/371472 [10:32:16<18:15:33,  3.63it/s]
 36%|███▌      | 132587/371472 [10:32:16<17:53:12,  3.71it/s]
 36%|███▌      | 132588/371472 [10:32:17<18:08:19,  3.66it/s]
 36%|███▌      | 132589/371472 [10:32:17<19:10:36,  3.46it/s]
 36%|███▌      | 132590/371472 [10:32:17<18:36:32,  3.57it/s]
 36%|███▌      | 132591/371472 [10:32:17<18:59:52,  3.49it/s]
 36%|███▌      | 132592/371472 [10:32:18<18:36:42,  3.57it/s]
 36%|███▌      | 132593/371472 [10:32:18<17:53:04,  3.71it/s]
 36%|███▌      | 132594/371472 [10:32:18<18:17:02,  3.63it/s]
 36%|███▌      | 132595/371472 [10:32:19<19:09:37,  3.46it/s]
 36%|███▌      | 132596/371472 [10:32:19<19:51:38,  3.34it/s]
 36%|███▌      | 132597/371472 [10:32:19<19:37:05,  3.38it/s]
 36%|███▌      | 132598/371472 [10:32:19<18:31:10,  3.58it/s]
 36%|███▌      | 132599/371472 [10:32:20<18:10:26,  3.65it/s]
 36%|███▌      | 132600/371472 [10:32:20<18:14:35,  3.64it/s]
                                                             
{'loss': 3.1795, 'learning_rate': 6.790493223297205e-07, 'epoch': 5.71}

 36%|███▌      | 132600/371472 [10:32:20<18:14:35,  3.64it/s]
 36%|███▌      | 132601/371472 [10:32:20<17:39:31,  3.76it/s]
 36%|███▌      | 132602/371472 [10:32:20<17:34:47,  3.77it/s]
 36%|███▌      | 132603/371472 [10:32:21<17:10:09,  3.86it/s]
 36%|███▌      | 132604/371472 [10:32:21<17:03:42,  3.89it/s]
 36%|███▌      | 132605/371472 [10:32:21<17:00:14,  3.90it/s]
 36%|███▌      | 132606/371472 [10:32:21<16:36:41,  3.99it/s]
 36%|███▌      | 132607/371472 [10:32:22<18:23:22,  3.61it/s]
 36%|███▌      | 132608/371472 [10:32:22<17:49:10,  3.72it/s]
 36%|███▌      | 132609/371472 [10:32:22<17:41:48,  3.75it/s]
 36%|███▌      | 132610/371472 [10:32:23<19:35:47,  3.39it/s]
 36%|███▌      | 132611/371472 [10:32:23<18:42:37,  3.55it/s]
 36%|███▌      | 132612/371472 [10:32:23<17:48:54,  3.72it/s]
 36%|███▌      | 132613/371472 [10:32:23<17:19:51,  3.83it/s]
 36%|███▌      | 132614/371472 [10:32:24<18:08:20,  3.66it/s]
 36%|███▌      | 132615/371472 [10:32:24<18:02:18,  3.68it/s]
 36%|███▌      | 132616/371472 [10:32:24<17:37:02,  3.77it/s]
 36%|███▌      | 132617/371472 [10:32:24<17:12:28,  3.86it/s]
 36%|███▌      | 132618/371472 [10:32:25<16:50:15,  3.94it/s]
 36%|███▌      | 132619/371472 [10:32:25<17:01:55,  3.90it/s]
 36%|███▌      | 132620/371472 [10:32:25<17:36:35,  3.77it/s]
                                                             
{'loss': 3.2757, 'learning_rate': 6.790008403542415e-07, 'epoch': 5.71}

 36%|███▌      | 132620/371472 [10:32:25<17:36:35,  3.77it/s]
 36%|███▌      | 132621/371472 [10:32:26<16:54:51,  3.92it/s]
 36%|███▌      | 132622/371472 [10:32:26<16:58:23,  3.91it/s]
 36%|███▌      | 132623/371472 [10:32:26<17:13:36,  3.85it/s]
 36%|███▌      | 132624/371472 [10:32:26<17:32:37,  3.78it/s]
 36%|███▌      | 132625/371472 [10:32:27<18:12:29,  3.64it/s]
 36%|███▌      | 132626/371472 [10:32:27<17:16:42,  3.84it/s]
 36%|███▌      | 132627/371472 [10:32:27<17:30:03,  3.79it/s]
 36%|███▌      | 132628/371472 [10:32:27<17:26:07,  3.81it/s]
 36%|███▌      | 132629/371472 [10:32:28<17:35:11,  3.77it/s]
 36%|███▌      | 132630/371472 [10:32:28<17:30:05,  3.79it/s]
 36%|███▌      | 132631/371472 [10:32:28<18:00:34,  3.68it/s]
 36%|███▌      | 132632/371472 [10:32:28<18:00:30,  3.68it/s]
 36%|███▌      | 132633/371472 [10:32:29<18:35:49,  3.57it/s]
 36%|███▌      | 132634/371472 [10:32:29<18:22:09,  3.61it/s]
 36%|███▌      | 132635/371472 [10:32:29<17:33:01,  3.78it/s]
 36%|███▌      | 132636/371472 [10:32:30<17:21:20,  3.82it/s]
 36%|███▌      | 132637/371472 [10:32:30<18:25:18,  3.60it/s]
 36%|███▌      | 132638/371472 [10:32:30<18:28:16,  3.59it/s]
 36%|███▌      | 132639/371472 [10:32:30<18:26:02,  3.60it/s]
 36%|███▌      | 132640/371472 [10:32:31<17:41:00,  3.75it/s]
                                                             
{'loss': 3.2422, 'learning_rate': 6.789523583787627e-07, 'epoch': 5.71}

 36%|███▌      | 132640/371472 [10:32:31<17:41:00,  3.75it/s]
 36%|███▌      | 132641/371472 [10:32:31<19:02:31,  3.48it/s]
 36%|███▌      | 132642/371472 [10:32:31<20:20:21,  3.26it/s]
 36%|███▌      | 132643/371472 [10:32:32<19:26:37,  3.41it/s]
 36%|███▌      | 132644/371472 [10:32:32<19:08:16,  3.47it/s]
 36%|███▌      | 132645/371472 [10:32:32<18:40:30,  3.55it/s]
 36%|███▌      | 132646/371472 [10:32:32<18:02:11,  3.68it/s]
 36%|███▌      | 132647/371472 [10:32:33<17:34:04,  3.78it/s]
 36%|███▌      | 132648/371472 [10:32:33<17:21:48,  3.82it/s]
 36%|███▌      | 132649/371472 [10:32:33<18:21:29,  3.61it/s]
 36%|███▌      | 132650/371472 [10:32:33<18:31:19,  3.58it/s]
 36%|███▌      | 132651/371472 [10:32:34<19:08:28,  3.47it/s]
 36%|███▌      | 132652/371472 [10:32:34<19:10:03,  3.46it/s]
 36%|███▌      | 132653/371472 [10:32:34<19:23:17,  3.42it/s]
 36%|███▌      | 132654/371472 [10:32:35<20:44:03,  3.20it/s]
 36%|███▌      | 132655/371472 [10:32:35<20:36:12,  3.22it/s]
 36%|███▌      | 132656/371472 [10:32:35<19:57:33,  3.32it/s]
 36%|███▌      | 132657/371472 [10:32:36<19:23:22,  3.42it/s]
 36%|███▌      | 132658/371472 [10:32:36<19:01:22,  3.49it/s]
 36%|███▌      | 132659/371472 [10:32:36<18:21:20,  3.61it/s]
 36%|███▌      | 132660/371472 [10:32:36<17:49:05,  3.72it/s]
                                                             
{'loss': 3.1589, 'learning_rate': 6.789038764032839e-07, 'epoch': 5.71}

 36%|███▌      | 132660/371472 [10:32:36<17:49:05,  3.72it/s]
 36%|███▌      | 132661/371472 [10:32:37<17:16:56,  3.84it/s]
 36%|███▌      | 132662/371472 [10:32:37<17:12:18,  3.86it/s]
 36%|███▌      | 132663/371472 [10:32:37<17:48:15,  3.73it/s]
 36%|███▌      | 132664/371472 [10:32:37<17:47:57,  3.73it/s]
 36%|███▌      | 132665/371472 [10:32:38<17:33:03,  3.78it/s]
 36%|███▌      | 132666/371472 [10:32:38<17:19:37,  3.83it/s]
 36%|███▌      | 132667/371472 [10:32:38<17:18:19,  3.83it/s]
 36%|███▌      | 132668/371472 [10:32:38<17:29:00,  3.79it/s]
 36%|███▌      | 132669/371472 [10:32:39<18:38:26,  3.56it/s]
 36%|███▌      | 132670/371472 [10:32:39<18:55:57,  3.50it/s]
 36%|███▌      | 132671/371472 [10:32:39<18:57:54,  3.50it/s]
 36%|███▌      | 132672/371472 [10:32:40<18:16:00,  3.63it/s]
 36%|███▌      | 132673/371472 [10:32:40<18:10:10,  3.65it/s]
 36%|███▌      | 132674/371472 [10:32:40<19:16:51,  3.44it/s]
 36%|███▌      | 132675/371472 [10:32:41<20:12:18,  3.28it/s]
 36%|███▌      | 132676/371472 [10:32:41<19:20:46,  3.43it/s]
 36%|███▌      | 132677/371472 [10:32:41<18:50:03,  3.52it/s]
 36%|███▌      | 132678/371472 [10:32:41<18:19:24,  3.62it/s]
 36%|███▌      | 132679/371472 [10:32:42<18:45:03,  3.54it/s]
 36%|███▌      | 132680/371472 [10:32:42<18:40:33,  3.55it/s]
                                                             
{'loss': 3.328, 'learning_rate': 6.78855394427805e-07, 'epoch': 5.71}

 36%|███▌      | 132680/371472 [10:32:42<18:40:33,  3.55it/s]
 36%|███▌      | 132681/371472 [10:32:42<18:09:32,  3.65it/s]
 36%|███▌      | 132682/371472 [10:32:42<18:23:27,  3.61it/s]
 36%|███▌      | 132683/371472 [10:32:43<18:41:33,  3.55it/s]
 36%|███▌      | 132684/371472 [10:32:43<18:20:56,  3.61it/s]
 36%|███▌      | 132685/371472 [10:32:43<18:35:52,  3.57it/s]
 36%|███▌      | 132686/371472 [10:32:44<18:45:06,  3.54it/s]
 36%|███▌      | 132687/371472 [10:32:44<18:27:15,  3.59it/s]
 36%|███▌      | 132688/371472 [10:32:44<18:39:14,  3.56it/s]
 36%|███▌      | 132689/371472 [10:32:44<19:16:59,  3.44it/s]
 36%|███▌      | 132690/371472 [10:32:45<18:41:54,  3.55it/s]
 36%|███▌      | 132691/371472 [10:32:45<18:31:18,  3.58it/s]
 36%|███▌      | 132692/371472 [10:32:45<19:02:17,  3.48it/s]
 36%|███▌      | 132693/371472 [10:32:46<18:44:15,  3.54it/s]
 36%|███▌      | 132694/371472 [10:32:46<18:47:46,  3.53it/s]
 36%|███▌      | 132695/371472 [10:32:46<19:30:19,  3.40it/s]
 36%|███▌      | 132696/371472 [10:32:46<19:29:30,  3.40it/s]
 36%|███▌      | 132697/371472 [10:32:47<19:18:22,  3.44it/s]
 36%|███▌      | 132698/371472 [10:32:47<19:21:38,  3.43it/s]
 36%|███▌      | 132699/371472 [10:32:47<19:04:40,  3.48it/s]
 36%|███▌      | 132700/371472 [10:32:48<18:01:29,  3.68it/s]
                                                             
{'loss': 3.1003, 'learning_rate': 6.78806912452326e-07, 'epoch': 5.72}

 36%|███▌      | 132700/371472 [10:32:48<18:01:29,  3.68it/s]
 36%|███▌      | 132701/371472 [10:32:48<17:45:58,  3.73it/s]
 36%|███▌      | 132702/371472 [10:32:48<17:59:59,  3.68it/s]
 36%|███▌      | 132703/371472 [10:32:48<18:06:43,  3.66it/s]
 36%|███▌      | 132704/371472 [10:32:49<17:36:00,  3.77it/s]
 36%|███▌      | 132705/371472 [10:32:49<17:31:17,  3.79it/s]
 36%|███▌      | 132706/371472 [10:32:49<18:48:40,  3.53it/s]
 36%|███▌      | 132707/371472 [10:32:50<20:13:29,  3.28it/s]
 36%|███▌      | 132708/371472 [10:32:50<19:14:42,  3.45it/s]
 36%|███▌      | 132709/371472 [10:32:50<19:20:17,  3.43it/s]
 36%|███▌      | 132710/371472 [10:32:50<19:33:48,  3.39it/s]
 36%|███▌      | 132711/371472 [10:32:51<20:14:36,  3.28it/s]
 36%|███▌      | 132712/371472 [10:32:51<20:10:45,  3.29it/s]
 36%|███▌      | 132713/371472 [10:32:51<19:18:12,  3.44it/s]
 36%|███▌      | 132714/371472 [10:32:52<18:10:58,  3.65it/s]
 36%|███▌      | 132715/371472 [10:32:52<17:40:56,  3.75it/s]
 36%|███▌      | 132716/371472 [10:32:52<17:27:04,  3.80it/s]
 36%|███▌      | 132717/371472 [10:32:52<17:03:53,  3.89it/s]
 36%|███▌      | 132718/371472 [10:32:53<17:41:06,  3.75it/s]
 36%|███▌      | 132719/371472 [10:32:53<18:40:04,  3.55it/s]
 36%|███▌      | 132720/371472 [10:32:53<19:03:11,  3.48it/s]
                                                             
{'loss': 2.895, 'learning_rate': 6.787584304768471e-07, 'epoch': 5.72}

 36%|███▌      | 132720/371472 [10:32:53<19:03:11,  3.48it/s]
 36%|███▌      | 132721/371472 [10:32:54<19:59:39,  3.32it/s]
 36%|███▌      | 132722/371472 [10:32:54<18:56:44,  3.50it/s]
 36%|███▌      | 132723/371472 [10:32:54<18:24:01,  3.60it/s]
 36%|███▌      | 132724/371472 [10:32:54<17:54:22,  3.70it/s]
 36%|███▌      | 132725/371472 [10:32:55<18:05:27,  3.67it/s]
 36%|███▌      | 132726/371472 [10:32:55<17:50:40,  3.72it/s]
 36%|███▌      | 132727/371472 [10:32:55<17:22:40,  3.82it/s]
 36%|███▌      | 132728/371472 [10:32:55<17:29:43,  3.79it/s]
 36%|███▌      | 132729/371472 [10:32:56<17:50:58,  3.72it/s]
 36%|███▌      | 132730/371472 [10:32:56<18:17:24,  3.63it/s]
 36%|███▌      | 132731/371472 [10:32:56<17:31:25,  3.78it/s]
 36%|███▌      | 132732/371472 [10:32:56<17:33:19,  3.78it/s]
 36%|███▌      | 132733/371472 [10:32:57<18:35:48,  3.57it/s]
 36%|███▌      | 132734/371472 [10:32:57<18:52:26,  3.51it/s]
 36%|███▌      | 132735/371472 [10:32:57<18:38:56,  3.56it/s]
 36%|███▌      | 132736/371472 [10:32:58<18:35:09,  3.57it/s]
 36%|███▌      | 132737/371472 [10:32:58<20:09:25,  3.29it/s]
 36%|███▌      | 132738/371472 [10:32:58<19:39:03,  3.37it/s]
 36%|███▌      | 132739/371472 [10:32:59<19:18:48,  3.43it/s]
 36%|███▌      | 132740/371472 [10:32:59<18:54:52,  3.51it/s]
                                                             
{'loss': 3.2938, 'learning_rate': 6.787099485013683e-07, 'epoch': 5.72}

 36%|███▌      | 132740/371472 [10:32:59<18:54:52,  3.51it/s]
 36%|███▌      | 132741/371472 [10:32:59<18:01:02,  3.68it/s]
 36%|███▌      | 132742/371472 [10:32:59<18:00:27,  3.68it/s]
 36%|███▌      | 132743/371472 [10:33:00<17:56:40,  3.70it/s]
 36%|███▌      | 132744/371472 [10:33:00<17:59:50,  3.68it/s]
 36%|███▌      | 132745/371472 [10:33:00<18:06:37,  3.66it/s]
 36%|███▌      | 132746/371472 [10:33:00<18:22:20,  3.61it/s]
 36%|███▌      | 132747/371472 [10:33:01<18:31:19,  3.58it/s]
 36%|███▌      | 132748/371472 [10:33:01<18:21:41,  3.61it/s]
 36%|███▌      | 132749/371472 [10:33:01<17:38:07,  3.76it/s]
 36%|███▌      | 132750/371472 [10:33:01<17:37:24,  3.76it/s]
 36%|███▌      | 132751/371472 [10:33:02<17:42:40,  3.74it/s]
 36%|███▌      | 132752/371472 [10:33:02<17:13:38,  3.85it/s]
 36%|███▌      | 132753/371472 [10:33:02<17:10:42,  3.86it/s]
 36%|███▌      | 132754/371472 [10:33:02<17:09:34,  3.86it/s]
 36%|███▌      | 132755/371472 [10:33:03<16:52:47,  3.93it/s]
 36%|███▌      | 132756/371472 [10:33:03<16:32:10,  4.01it/s]
 36%|███▌      | 132757/371472 [10:33:03<17:23:13,  3.81it/s]
 36%|███▌      | 132758/371472 [10:33:04<17:20:00,  3.83it/s]
 36%|███▌      | 132759/371472 [10:33:04<17:13:44,  3.85it/s]
 36%|███▌      | 132760/371472 [10:33:04<17:15:43,  3.84it/s]
                                                             
{'loss': 3.1938, 'learning_rate': 6.786614665258893e-07, 'epoch': 5.72}

 36%|███▌      | 132760/371472 [10:33:04<17:15:43,  3.84it/s]
 36%|███▌      | 132761/371472 [10:33:04<17:58:34,  3.69it/s]
 36%|███▌      | 132762/371472 [10:33:05<18:01:34,  3.68it/s]
 36%|███▌      | 132763/371472 [10:33:05<17:58:47,  3.69it/s]
 36%|███▌      | 132764/371472 [10:33:05<17:31:48,  3.78it/s]
 36%|███▌      | 132765/371472 [10:33:05<17:12:34,  3.85it/s]
 36%|███▌      | 132766/371472 [10:33:06<17:29:16,  3.79it/s]
 36%|███▌      | 132767/371472 [10:33:06<17:44:01,  3.74it/s]
 36%|███▌      | 132768/371472 [10:33:06<18:02:48,  3.67it/s]
 36%|███▌      | 132769/371472 [10:33:06<17:44:31,  3.74it/s]
 36%|███▌      | 132770/371472 [10:33:07<18:05:12,  3.67it/s]
 36%|███▌      | 132771/371472 [10:33:07<18:20:39,  3.61it/s]
 36%|███▌      | 132772/371472 [10:33:07<17:48:49,  3.72it/s]
 36%|███▌      | 132773/371472 [10:33:08<19:09:20,  3.46it/s]
 36%|███▌      | 132774/371472 [10:33:08<19:52:48,  3.34it/s]
 36%|███▌      | 132775/371472 [10:33:08<19:10:21,  3.46it/s]
 36%|███▌      | 132776/371472 [10:33:08<18:42:47,  3.54it/s]
 36%|███▌      | 132777/371472 [10:33:09<18:48:06,  3.53it/s]
 36%|███▌      | 132778/371472 [10:33:09<18:49:55,  3.52it/s]
 36%|███▌      | 132779/371472 [10:33:09<18:34:31,  3.57it/s]
 36%|███▌      | 132780/371472 [10:33:10<18:20:52,  3.61it/s]
                                                             
{'loss': 3.218, 'learning_rate': 6.786129845504104e-07, 'epoch': 5.72}

 36%|███▌      | 132780/371472 [10:33:10<18:20:52,  3.61it/s]
 36%|███▌      | 132781/371472 [10:33:10<18:01:12,  3.68it/s]
 36%|███▌      | 132782/371472 [10:33:10<19:54:23,  3.33it/s]
 36%|███▌      | 132783/371472 [10:33:11<19:56:54,  3.32it/s]
 36%|███▌      | 132784/371472 [10:33:11<18:56:24,  3.50it/s]
 36%|███▌      | 132785/371472 [10:33:11<18:17:46,  3.62it/s]
 36%|███▌      | 132786/371472 [10:33:11<17:56:38,  3.69it/s]
 36%|███▌      | 132787/371472 [10:33:12<17:39:54,  3.75it/s]
 36%|███▌      | 132788/371472 [10:33:12<18:03:24,  3.67it/s]
 36%|███▌      | 132789/371472 [10:33:12<18:03:17,  3.67it/s]
 36%|███▌      | 132790/371472 [10:33:12<19:12:30,  3.45it/s]
 36%|███▌      | 132791/371472 [10:33:13<18:17:38,  3.62it/s]
 36%|███▌      | 132792/371472 [10:33:13<17:36:34,  3.76it/s]
 36%|███▌      | 132793/371472 [10:33:13<17:26:58,  3.80it/s]
 36%|███▌      | 132794/371472 [10:33:13<17:39:02,  3.76it/s]
 36%|███▌      | 132795/371472 [10:33:14<18:23:39,  3.60it/s]
 36%|███▌      | 132796/371472 [10:33:14<17:43:28,  3.74it/s]
 36%|███▌      | 132797/371472 [10:33:14<18:51:02,  3.52it/s]
 36%|███▌      | 132798/371472 [10:33:15<20:23:50,  3.25it/s]
 36%|███▌      | 132799/371472 [10:33:15<20:54:55,  3.17it/s]
 36%|███▌      | 132800/371472 [10:33:15<20:28:28,  3.24it/s]
                                                             
{'loss': 3.2835, 'learning_rate': 6.785645025749316e-07, 'epoch': 5.72}

 36%|███▌      | 132800/371472 [10:33:15<20:28:28,  3.24it/s]
 36%|███▌      | 132801/371472 [10:33:16<20:26:01,  3.24it/s]
 36%|███▌      | 132802/371472 [10:33:16<20:44:04,  3.20it/s]
 36%|███▌      | 132803/371472 [10:33:16<19:48:10,  3.35it/s]
 36%|███▌      | 132804/371472 [10:33:17<20:19:07,  3.26it/s]
 36%|███▌      | 132805/371472 [10:33:17<20:35:57,  3.22it/s]
 36%|███▌      | 132806/371472 [10:33:17<20:31:10,  3.23it/s]
 36%|███▌      | 132807/371472 [10:33:17<19:33:16,  3.39it/s]
 36%|███▌      | 132808/371472 [10:33:18<18:41:14,  3.55it/s]
 36%|███▌      | 132809/371472 [10:33:18<18:40:12,  3.55it/s]
 36%|███▌      | 132810/371472 [10:33:18<18:22:53,  3.61it/s]
 36%|███▌      | 132811/371472 [10:33:18<18:21:15,  3.61it/s]
 36%|███▌      | 132812/371472 [10:33:19<18:25:06,  3.60it/s]
 36%|███▌      | 132813/371472 [10:33:19<18:08:54,  3.65it/s]
 36%|███▌      | 132814/371472 [10:33:19<18:21:38,  3.61it/s]
 36%|███▌      | 132815/371472 [10:33:20<18:17:52,  3.62it/s]
 36%|███▌      | 132816/371472 [10:33:20<18:43:30,  3.54it/s]
 36%|███▌      | 132817/371472 [10:33:20<17:44:55,  3.74it/s]
 36%|███▌      | 132818/371472 [10:33:20<17:24:58,  3.81it/s]
 36%|███▌      | 132819/371472 [10:33:21<17:23:34,  3.81it/s]
 36%|███▌      | 132820/371472 [10:33:21<18:30:24,  3.58it/s]
                                                             
{'loss': 3.1632, 'learning_rate': 6.785160205994528e-07, 'epoch': 5.72}

 36%|███▌      | 132820/371472 [10:33:21<18:30:24,  3.58it/s]
 36%|███▌      | 132821/371472 [10:33:21<18:04:13,  3.67it/s]
 36%|███▌      | 132822/371472 [10:33:21<17:54:42,  3.70it/s]
 36%|███▌      | 132823/371472 [10:33:22<18:21:12,  3.61it/s]
 36%|███▌      | 132824/371472 [10:33:22<18:10:36,  3.65it/s]
 36%|███▌      | 132825/371472 [10:33:22<17:44:39,  3.74it/s]
 36%|███▌      | 132826/371472 [10:33:23<17:48:40,  3.72it/s]
 36%|███▌      | 132827/371472 [10:33:23<17:13:26,  3.85it/s]
 36%|███▌      | 132828/371472 [10:33:23<17:11:23,  3.86it/s]
 36%|███▌      | 132829/371472 [10:33:23<18:53:08,  3.51it/s]
 36%|███▌      | 132830/371472 [10:33:24<18:47:51,  3.53it/s]
 36%|███▌      | 132831/371472 [10:33:24<17:47:37,  3.73it/s]
 36%|███▌      | 132832/371472 [10:33:24<18:34:41,  3.57it/s]
 36%|███▌      | 132833/371472 [10:33:25<20:04:00,  3.30it/s]
 36%|███▌      | 132834/371472 [10:33:25<18:48:39,  3.52it/s]
 36%|███▌      | 132835/371472 [10:33:25<20:29:17,  3.24it/s]
 36%|███▌      | 132836/371472 [10:33:25<19:59:11,  3.32it/s]
 36%|███▌      | 132837/371472 [10:33:26<18:49:30,  3.52it/s]
 36%|███▌      | 132838/371472 [10:33:26<18:42:14,  3.54it/s]
 36%|███▌      | 132839/371472 [10:33:26<18:57:16,  3.50it/s]
 36%|███▌      | 132840/371472 [10:33:27<19:14:54,  3.44it/s]
                                                             
{'loss': 3.2434, 'learning_rate': 6.784675386239737e-07, 'epoch': 5.72}

 36%|███▌      | 132840/371472 [10:33:27<19:14:54,  3.44it/s]
 36%|███▌      | 132841/371472 [10:33:27<18:58:45,  3.49it/s]
 36%|███▌      | 132842/371472 [10:33:27<18:54:53,  3.50it/s]
 36%|███▌      | 132843/371472 [10:33:27<18:57:49,  3.50it/s]
 36%|███▌      | 132844/371472 [10:33:28<19:03:39,  3.48it/s]
 36%|███▌      | 132845/371472 [10:33:28<18:30:38,  3.58it/s]
 36%|███▌      | 132846/371472 [10:33:28<18:38:50,  3.55it/s]
 36%|███▌      | 132847/371472 [10:33:29<18:46:54,  3.53it/s]
 36%|███▌      | 132848/371472 [10:33:29<18:06:08,  3.66it/s]
 36%|███▌      | 132849/371472 [10:33:29<18:24:01,  3.60it/s]
 36%|███▌      | 132850/371472 [10:33:29<18:12:39,  3.64it/s]
 36%|███▌      | 132851/371472 [10:33:30<17:24:35,  3.81it/s]
 36%|███▌      | 132852/371472 [10:33:30<17:06:48,  3.87it/s]
 36%|███▌      | 132853/371472 [10:33:30<16:41:26,  3.97it/s]
 36%|███▌      | 132854/371472 [10:33:30<17:43:39,  3.74it/s]
 36%|███▌      | 132855/371472 [10:33:31<17:39:05,  3.76it/s]
 36%|███▌      | 132856/371472 [10:33:31<17:28:37,  3.79it/s]
 36%|███▌      | 132857/371472 [10:33:31<18:20:14,  3.61it/s]
 36%|███▌      | 132858/371472 [10:33:31<17:55:32,  3.70it/s]
 36%|███▌      | 132859/371472 [10:33:32<17:52:20,  3.71it/s]
 36%|███▌      | 132860/371472 [10:33:32<18:26:51,  3.59it/s]
                                                             
{'loss': 3.2058, 'learning_rate': 6.784190566484949e-07, 'epoch': 5.72}

 36%|███▌      | 132860/371472 [10:33:32<18:26:51,  3.59it/s]
 36%|███▌      | 132861/371472 [10:33:32<18:07:41,  3.66it/s]
 36%|███▌      | 132862/371472 [10:33:33<21:19:41,  3.11it/s]
 36%|███▌      | 132863/371472 [10:33:33<19:50:42,  3.34it/s]
 36%|███▌      | 132864/371472 [10:33:33<18:52:44,  3.51it/s]
 36%|███▌      | 132865/371472 [10:33:33<18:16:07,  3.63it/s]
 36%|███▌      | 132866/371472 [10:33:34<18:09:52,  3.65it/s]
 36%|███▌      | 132867/371472 [10:33:34<18:16:06,  3.63it/s]
 36%|███▌      | 132868/371472 [10:33:34<18:00:08,  3.68it/s]
 36%|███▌      | 132869/371472 [10:33:35<18:01:28,  3.68it/s]
 36%|███▌      | 132870/371472 [10:33:35<20:30:35,  3.23it/s]
 36%|███▌      | 132871/371472 [10:33:35<20:09:46,  3.29it/s]
 36%|███▌      | 132872/371472 [10:33:35<18:43:14,  3.54it/s]
 36%|███▌      | 132873/371472 [10:33:36<19:14:14,  3.45it/s]
 36%|███▌      | 132874/371472 [10:33:36<18:12:47,  3.64it/s]
 36%|███▌      | 132875/371472 [10:33:36<18:08:11,  3.65it/s]
 36%|███▌      | 132876/371472 [10:33:37<17:10:11,  3.86it/s]
 36%|███▌      | 132877/371472 [10:33:37<17:14:57,  3.84it/s]
 36%|███▌      | 132878/371472 [10:33:37<17:36:47,  3.76it/s]
 36%|███▌      | 132879/371472 [10:33:37<19:14:09,  3.45it/s]
 36%|███▌      | 132880/371472 [10:33:38<19:48:06,  3.35it/s]
                                                             
{'loss': 3.282, 'learning_rate': 6.78370574673016e-07, 'epoch': 5.72}

 36%|███▌      | 132880/371472 [10:33:38<19:48:06,  3.35it/s]
 36%|███▌      | 132881/371472 [10:33:38<19:08:18,  3.46it/s]
 36%|███▌      | 132882/371472 [10:33:38<18:42:46,  3.54it/s]
 36%|███▌      | 132883/371472 [10:33:39<18:30:45,  3.58it/s]
 36%|███▌      | 132884/371472 [10:33:39<17:58:01,  3.69it/s]
 36%|███▌      | 132885/371472 [10:33:39<18:51:08,  3.52it/s]
 36%|███▌      | 132886/371472 [10:33:39<18:30:37,  3.58it/s]
 36%|███▌      | 132887/371472 [10:33:40<21:01:55,  3.15it/s]
 36%|███▌      | 132888/371472 [10:33:40<19:35:45,  3.38it/s]
 36%|███▌      | 132889/371472 [10:33:40<19:09:02,  3.46it/s]
 36%|███▌      | 132890/371472 [10:33:41<18:15:58,  3.63it/s]
 36%|███▌      | 132891/371472 [10:33:41<17:49:08,  3.72it/s]
 36%|███▌      | 132892/371472 [10:33:41<17:54:50,  3.70it/s]
 36%|███▌      | 132893/371472 [10:33:41<17:42:50,  3.74it/s]
 36%|███▌      | 132894/371472 [10:33:42<18:23:19,  3.60it/s]
 36%|███▌      | 132895/371472 [10:33:42<17:59:53,  3.68it/s]
 36%|███▌      | 132896/371472 [10:33:42<18:00:05,  3.68it/s]
 36%|███▌      | 132897/371472 [10:33:42<18:25:14,  3.60it/s]
 36%|███▌      | 132898/371472 [10:33:43<18:09:19,  3.65it/s]
 36%|███▌      | 132899/371472 [10:33:43<17:37:36,  3.76it/s]
 36%|███▌      | 132900/371472 [10:33:43<18:07:44,  3.66it/s]
                                                             
{'loss': 3.0866, 'learning_rate': 6.783220926975372e-07, 'epoch': 5.72}

 36%|███▌      | 132900/371472 [10:33:43<18:07:44,  3.66it/s]
 36%|███▌      | 132901/371472 [10:33:44<17:58:43,  3.69it/s]
 36%|███▌      | 132902/371472 [10:33:44<17:33:05,  3.78it/s]
 36%|███▌      | 132903/371472 [10:33:44<17:21:04,  3.82it/s]
 36%|███▌      | 132904/371472 [10:33:44<19:05:02,  3.47it/s]
 36%|███▌      | 132905/371472 [10:33:45<18:29:41,  3.58it/s]
 36%|███▌      | 132906/371472 [10:33:45<18:02:14,  3.67it/s]
 36%|███▌      | 132907/371472 [10:33:45<19:36:11,  3.38it/s]
 36%|███▌      | 132908/371472 [10:33:46<20:36:58,  3.21it/s]
 36%|███▌      | 132909/371472 [10:33:46<19:33:23,  3.39it/s]
 36%|███▌      | 132910/371472 [10:33:46<19:30:51,  3.40it/s]
 36%|███▌      | 132911/371472 [10:33:46<18:46:21,  3.53it/s]
 36%|███▌      | 132912/371472 [10:33:47<17:57:34,  3.69it/s]
 36%|███▌      | 132913/371472 [10:33:47<17:31:15,  3.78it/s]
 36%|███▌      | 132914/371472 [10:33:47<17:47:56,  3.72it/s]
 36%|███▌      | 132915/371472 [10:33:47<18:54:19,  3.51it/s]
 36%|███▌      | 132916/371472 [10:33:48<18:25:21,  3.60it/s]
 36%|███▌      | 132917/371472 [10:33:48<18:23:50,  3.60it/s]
 36%|███▌      | 132918/371472 [10:33:48<19:24:53,  3.41it/s]
 36%|███▌      | 132919/371472 [10:33:49<19:55:20,  3.33it/s]
 36%|███▌      | 132920/371472 [10:33:49<19:31:55,  3.39it/s]
                                                             
{'loss': 3.1784, 'learning_rate': 6.782736107220582e-07, 'epoch': 5.73}

 36%|███▌      | 132920/371472 [10:33:49<19:31:55,  3.39it/s]
 36%|███▌      | 132921/371472 [10:33:49<21:06:54,  3.14it/s]
 36%|███▌      | 132922/371472 [10:33:50<20:38:03,  3.21it/s]
 36%|███▌      | 132923/371472 [10:33:50<21:13:02,  3.12it/s]
 36%|███▌      | 132924/371472 [10:33:50<20:12:08,  3.28it/s]
 36%|███▌      | 132925/371472 [10:33:51<20:27:31,  3.24it/s]
 36%|███▌      | 132926/371472 [10:33:51<20:24:18,  3.25it/s]
 36%|███▌      | 132927/371472 [10:33:51<19:50:45,  3.34it/s]
 36%|███▌      | 132928/371472 [10:33:51<19:30:46,  3.40it/s]
 36%|███▌      | 132929/371472 [10:33:52<20:09:24,  3.29it/s]
 36%|███▌      | 132930/371472 [10:33:52<19:46:31,  3.35it/s]
 36%|███▌      | 132931/371472 [10:33:52<19:04:40,  3.47it/s]
 36%|███▌      | 132932/371472 [10:33:53<20:12:47,  3.28it/s]
 36%|███▌      | 132933/371472 [10:33:53<19:42:27,  3.36it/s]
 36%|███▌      | 132934/371472 [10:33:53<18:44:05,  3.54it/s]
 36%|███▌      | 132935/371472 [10:33:53<18:58:15,  3.49it/s]
 36%|███▌      | 132936/371472 [10:33:54<18:10:56,  3.64it/s]
 36%|███▌      | 132937/371472 [10:33:54<18:26:47,  3.59it/s]
 36%|███▌      | 132938/371472 [10:33:54<18:44:31,  3.54it/s]
 36%|███▌      | 132939/371472 [10:33:55<19:37:59,  3.37it/s]
 36%|███▌      | 132940/371472 [10:33:55<19:13:47,  3.45it/s]
                                                             
{'loss': 3.1761, 'learning_rate': 6.782251287465793e-07, 'epoch': 5.73}

 36%|███▌      | 132940/371472 [10:33:55<19:13:47,  3.45it/s]
 36%|███▌      | 132941/371472 [10:33:55<19:34:14,  3.39it/s]
 36%|███▌      | 132942/371472 [10:33:56<20:13:29,  3.28it/s]
 36%|███▌      | 132943/371472 [10:33:56<21:23:10,  3.10it/s]
 36%|███▌      | 132944/371472 [10:33:56<20:12:54,  3.28it/s]
 36%|███▌      | 132945/371472 [10:33:56<19:10:42,  3.45it/s]
 36%|███▌      | 132946/371472 [10:33:57<19:16:30,  3.44it/s]
 36%|███▌      | 132947/371472 [10:33:57<18:35:29,  3.56it/s]
 36%|███▌      | 132948/371472 [10:33:57<18:14:13,  3.63it/s]
 36%|███▌      | 132949/371472 [10:33:58<19:34:12,  3.39it/s]
 36%|███▌      | 132950/371472 [10:33:58<18:37:52,  3.56it/s]
 36%|███▌      | 132951/371472 [10:33:58<17:59:32,  3.68it/s]
 36%|███▌      | 132952/371472 [10:33:58<18:41:04,  3.55it/s]
 36%|███▌      | 132953/371472 [10:33:59<17:45:01,  3.73it/s]
 36%|███▌      | 132954/371472 [10:33:59<18:38:37,  3.55it/s]
 36%|███▌      | 132955/371472 [10:33:59<18:41:15,  3.55it/s]
 36%|███▌      | 132956/371472 [10:34:00<19:41:31,  3.36it/s]
 36%|███▌      | 132957/371472 [10:34:00<19:02:43,  3.48it/s]
 36%|███▌      | 132958/371472 [10:34:00<18:59:06,  3.49it/s]
 36%|███▌      | 132959/371472 [10:34:00<20:53:26,  3.17it/s]
 36%|███▌      | 132960/371472 [10:34:01<19:50:29,  3.34it/s]
                                                             
{'loss': 3.0853, 'learning_rate': 6.781766467711004e-07, 'epoch': 5.73}

 36%|███▌      | 132960/371472 [10:34:01<19:50:29,  3.34it/s]
 36%|███▌      | 132961/371472 [10:34:01<19:09:55,  3.46it/s]
 36%|███▌      | 132962/371472 [10:34:01<19:39:40,  3.37it/s]
 36%|███▌      | 132963/371472 [10:34:02<19:24:18,  3.41it/s]
 36%|███▌      | 132964/371472 [10:34:02<19:33:34,  3.39it/s]
 36%|███▌      | 132965/371472 [10:34:02<19:56:46,  3.32it/s]
 36%|███▌      | 132966/371472 [10:34:02<19:18:52,  3.43it/s]
 36%|███▌      | 132967/371472 [10:34:03<19:37:46,  3.38it/s]
 36%|███▌      | 132968/371472 [10:34:03<18:51:18,  3.51it/s]
 36%|███▌      | 132969/371472 [10:34:03<18:16:14,  3.63it/s]
 36%|███▌      | 132970/371472 [10:34:04<18:03:11,  3.67it/s]
 36%|███▌      | 132971/371472 [10:34:04<18:03:47,  3.67it/s]
 36%|███▌      | 132972/371472 [10:34:04<18:56:18,  3.50it/s]
 36%|███▌      | 132973/371472 [10:34:04<18:05:14,  3.66it/s]
 36%|███▌      | 132974/371472 [10:34:05<19:00:44,  3.48it/s]
 36%|███▌      | 132975/371472 [10:34:05<18:26:45,  3.59it/s]
 36%|███▌      | 132976/371472 [10:34:05<18:39:57,  3.55it/s]
 36%|███▌      | 132977/371472 [10:34:06<18:13:25,  3.64it/s]
 36%|███▌      | 132978/371472 [10:34:06<17:17:58,  3.83it/s]
 36%|███▌      | 132979/371472 [10:34:06<17:30:57,  3.78it/s]
 36%|███▌      | 132980/371472 [10:34:06<17:55:34,  3.70it/s]
                                                             
{'loss': 3.0961, 'learning_rate': 6.781281647956215e-07, 'epoch': 5.73}

 36%|███▌      | 132980/371472 [10:34:06<17:55:34,  3.70it/s]
 36%|███▌      | 132981/371472 [10:34:07<18:00:08,  3.68it/s]
 36%|███▌      | 132982/371472 [10:34:07<18:18:45,  3.62it/s]
 36%|███▌      | 132983/371472 [10:34:07<17:39:43,  3.75it/s]
 36%|███▌      | 132984/371472 [10:34:07<17:17:02,  3.83it/s]
 36%|███▌      | 132985/371472 [10:34:08<17:25:30,  3.80it/s]
 36%|███▌      | 132986/371472 [10:34:08<17:39:24,  3.75it/s]
 36%|███▌      | 132987/371472 [10:34:08<18:53:24,  3.51it/s]
 36%|███▌      | 132988/371472 [10:34:09<18:47:49,  3.52it/s]
 36%|███▌      | 132989/371472 [10:34:09<18:38:16,  3.55it/s]
 36%|███▌      | 132990/371472 [10:34:09<18:12:43,  3.64it/s]
 36%|███▌      | 132991/371472 [10:34:09<17:44:09,  3.74it/s]
 36%|███▌      | 132992/371472 [10:34:10<17:51:44,  3.71it/s]
 36%|███▌      | 132993/371472 [10:34:10<18:03:53,  3.67it/s]
 36%|███▌      | 132994/371472 [10:34:10<18:07:13,  3.66it/s]
 36%|███▌      | 132995/371472 [10:34:10<17:31:17,  3.78it/s]
 36%|███▌      | 132996/371472 [10:34:11<17:00:22,  3.90it/s]
 36%|███▌      | 132997/371472 [10:34:11<16:43:23,  3.96it/s]
 36%|███▌      | 132998/371472 [10:34:11<16:56:43,  3.91it/s]
 36%|███▌      | 132999/371472 [10:34:11<17:11:58,  3.85it/s]
 36%|███▌      | 133000/371472 [10:34:12<17:31:22,  3.78it/s]
                                                             
{'loss': 3.1643, 'learning_rate': 6.780796828201425e-07, 'epoch': 5.73}

 36%|███▌      | 133000/371472 [10:34:12<17:31:22,  3.78it/s]
 36%|███▌      | 133001/371472 [10:34:12<17:13:42,  3.84it/s]
 36%|███▌      | 133002/371472 [10:34:12<16:59:24,  3.90it/s]
 36%|███▌      | 133003/371472 [10:34:13<18:38:59,  3.55it/s]
 36%|███▌      | 133004/371472 [10:34:13<18:40:03,  3.55it/s]
 36%|███▌      | 133005/371472 [10:34:13<18:05:19,  3.66it/s]
 36%|███▌      | 133006/371472 [10:34:13<18:35:34,  3.56it/s]
 36%|███▌      | 133007/371472 [10:34:14<20:13:29,  3.28it/s]
 36%|███▌      | 133008/371472 [10:34:14<20:14:05,  3.27it/s]
 36%|███▌      | 133009/371472 [10:34:14<19:45:36,  3.35it/s]
 36%|███▌      | 133010/371472 [10:34:15<19:48:58,  3.34it/s]
 36%|███▌      | 133011/371472 [10:34:15<19:05:38,  3.47it/s]
 36%|███▌      | 133012/371472 [10:34:15<18:26:07,  3.59it/s]
 36%|███▌      | 133013/371472 [10:34:15<20:15:27,  3.27it/s]
 36%|███▌      | 133014/371472 [10:34:16<19:48:21,  3.34it/s]
 36%|███▌      | 133015/371472 [10:34:16<19:05:32,  3.47it/s]
 36%|███▌      | 133016/371472 [10:34:16<19:09:05,  3.46it/s]
 36%|███▌      | 133017/371472 [10:34:17<19:17:01,  3.43it/s]
 36%|███▌      | 133018/371472 [10:34:17<19:02:45,  3.48it/s]
 36%|███▌      | 133019/371472 [10:34:17<18:48:06,  3.52it/s]
 36%|███▌      | 133020/371472 [10:34:17<19:06:33,  3.47it/s]
                                                             
{'loss': 3.1659, 'learning_rate': 6.780312008446637e-07, 'epoch': 5.73}

 36%|███▌      | 133020/371472 [10:34:17<19:06:33,  3.47it/s]
 36%|███▌      | 133021/371472 [10:34:18<19:18:31,  3.43it/s]
 36%|███▌      | 133022/371472 [10:34:18<18:47:36,  3.52it/s]
 36%|███▌      | 133023/371472 [10:34:18<18:44:59,  3.53it/s]
 36%|███▌      | 133024/371472 [10:34:19<18:21:07,  3.61it/s]
 36%|███▌      | 133025/371472 [10:34:19<17:46:02,  3.73it/s]
 36%|███▌      | 133026/371472 [10:34:19<18:15:19,  3.63it/s]
 36%|███▌      | 133027/371472 [10:34:19<18:03:54,  3.67it/s]
 36%|███▌      | 133028/371472 [10:34:20<18:26:10,  3.59it/s]
 36%|███▌      | 133029/371472 [10:34:20<18:23:04,  3.60it/s]
 36%|███▌      | 133030/371472 [10:34:20<18:13:56,  3.63it/s]
 36%|███▌      | 133031/371472 [10:34:21<18:54:02,  3.50it/s]
 36%|███▌      | 133032/371472 [10:34:21<17:55:01,  3.70it/s]
 36%|███▌      | 133033/371472 [10:34:21<18:16:43,  3.62it/s]
 36%|███▌      | 133034/371472 [10:34:21<19:34:29,  3.38it/s]
 36%|███▌      | 133035/371472 [10:34:22<19:03:14,  3.48it/s]
 36%|███▌      | 133036/371472 [10:34:22<20:51:48,  3.17it/s]
 36%|███▌      | 133037/371472 [10:34:22<20:16:54,  3.27it/s]
 36%|███▌      | 133038/371472 [10:34:23<19:17:16,  3.43it/s]
 36%|███▌      | 133039/371472 [10:34:23<18:43:45,  3.54it/s]
 36%|███▌      | 133040/371472 [10:34:23<19:01:13,  3.48it/s]
                                                             
{'loss': 3.1038, 'learning_rate': 6.779827188691849e-07, 'epoch': 5.73}

 36%|███▌      | 133040/371472 [10:34:23<19:01:13,  3.48it/s]
 36%|███▌      | 133041/371472 [10:34:23<18:22:33,  3.60it/s]
 36%|███▌      | 133042/371472 [10:34:24<18:12:52,  3.64it/s]
 36%|███▌      | 133043/371472 [10:34:24<17:31:56,  3.78it/s]
 36%|███▌      | 133044/371472 [10:34:24<17:27:31,  3.79it/s]
 36%|███▌      | 133045/371472 [10:34:24<16:49:04,  3.94it/s]
 36%|███▌      | 133046/371472 [10:34:25<16:29:00,  4.02it/s]
 36%|███▌      | 133047/371472 [10:34:25<17:53:59,  3.70it/s]
 36%|███▌      | 133048/371472 [10:34:25<17:36:13,  3.76it/s]
 36%|███▌      | 133049/371472 [10:34:25<17:35:09,  3.77it/s]
 36%|███▌      | 133050/371472 [10:34:26<17:45:39,  3.73it/s]
 36%|███▌      | 133051/371472 [10:34:26<17:52:35,  3.70it/s]
 36%|███▌      | 133052/371472 [10:34:26<17:24:17,  3.81it/s]
 36%|███▌      | 133053/371472 [10:34:27<17:00:49,  3.89it/s]
 36%|███▌      | 133054/371472 [10:34:27<17:05:04,  3.88it/s]
 36%|███▌      | 133055/371472 [10:34:27<17:03:52,  3.88it/s]
 36%|███▌      | 133056/371472 [10:34:27<17:09:46,  3.86it/s]
 36%|███▌      | 133057/371472 [10:34:28<17:18:01,  3.83it/s]
 36%|███▌      | 133058/371472 [10:34:28<16:42:37,  3.96it/s]
 36%|███▌      | 133059/371472 [10:34:28<21:08:11,  3.13it/s]
 36%|███▌      | 133060/371472 [10:34:29<19:45:42,  3.35it/s]
                                                             
{'loss': 3.4505, 'learning_rate': 6.779342368937059e-07, 'epoch': 5.73}

 36%|███▌      | 133060/371472 [10:34:29<19:45:42,  3.35it/s]
 36%|███▌      | 133061/371472 [10:34:29<19:43:11,  3.36it/s]
 36%|███▌      | 133062/371472 [10:34:29<21:10:20,  3.13it/s]
 36%|███▌      | 133063/371472 [10:34:29<19:32:20,  3.39it/s]
 36%|███▌      | 133064/371472 [10:34:30<19:20:20,  3.42it/s]
 36%|███▌      | 133065/371472 [10:34:30<18:47:26,  3.52it/s]
 36%|███▌      | 133066/371472 [10:34:30<18:14:02,  3.63it/s]
 36%|███▌      | 133067/371472 [10:34:31<19:32:10,  3.39it/s]
 36%|███▌      | 133068/371472 [10:34:31<19:09:01,  3.46it/s]
 36%|███▌      | 133069/371472 [10:34:31<19:41:06,  3.36it/s]
 36%|███▌      | 133070/371472 [10:34:31<18:38:42,  3.55it/s]
 36%|███▌      | 133071/371472 [10:34:32<19:10:34,  3.45it/s]
 36%|███▌      | 133072/371472 [10:34:32<19:15:31,  3.44it/s]
 36%|███▌      | 133073/371472 [10:34:32<18:42:00,  3.54it/s]
 36%|███▌      | 133074/371472 [10:34:33<20:34:37,  3.22it/s]
 36%|███▌      | 133075/371472 [10:34:33<20:08:26,  3.29it/s]
 36%|███▌      | 133076/371472 [10:34:33<18:54:51,  3.50it/s]
 36%|███▌      | 133077/371472 [10:34:33<18:11:36,  3.64it/s]
 36%|███▌      | 133078/371472 [10:34:34<18:00:01,  3.68it/s]
 36%|███▌      | 133079/371472 [10:34:34<17:22:07,  3.81it/s]
 36%|███▌      | 133080/371472 [10:34:34<20:09:10,  3.29it/s]
                                                             
{'loss': 3.3092, 'learning_rate': 6.77885754918227e-07, 'epoch': 5.73}

 36%|███▌      | 133080/371472 [10:34:34<20:09:10,  3.29it/s]
 36%|███▌      | 133081/371472 [10:34:35<19:48:00,  3.34it/s]
 36%|███▌      | 133082/371472 [10:34:35<20:25:20,  3.24it/s]
 36%|███▌      | 133083/371472 [10:34:35<19:05:36,  3.47it/s]
 36%|███▌      | 133084/371472 [10:34:35<18:42:22,  3.54it/s]
 36%|███▌      | 133085/371472 [10:34:36<19:26:54,  3.40it/s]
 36%|███▌      | 133086/371472 [10:34:36<19:30:18,  3.39it/s]
 36%|███▌      | 133087/371472 [10:34:36<18:29:15,  3.58it/s]
 36%|███▌      | 133088/371472 [10:34:37<18:08:33,  3.65it/s]
 36%|███▌      | 133089/371472 [10:34:37<18:29:02,  3.58it/s]
 36%|███▌      | 133090/371472 [10:34:37<18:01:11,  3.67it/s]
 36%|███▌      | 133091/371472 [10:34:37<18:21:20,  3.61it/s]
 36%|███▌      | 133092/371472 [10:34:38<18:55:29,  3.50it/s]
 36%|███▌      | 133093/371472 [10:34:38<19:26:26,  3.41it/s]
 36%|███▌      | 133094/371472 [10:34:38<18:53:02,  3.51it/s]
 36%|███▌      | 133095/371472 [10:34:39<18:13:58,  3.63it/s]
 36%|███▌      | 133096/371472 [10:34:39<18:03:33,  3.67it/s]
 36%|███▌      | 133097/371472 [10:34:39<18:01:16,  3.67it/s]
 36%|███▌      | 133098/371472 [10:34:39<19:16:24,  3.44it/s]
 36%|███▌      | 133099/371472 [10:34:40<18:39:54,  3.55it/s]
 36%|███▌      | 133100/371472 [10:34:40<18:54:19,  3.50it/s]
                                                             
{'loss': 2.963, 'learning_rate': 6.778372729427481e-07, 'epoch': 5.73}

 36%|███▌      | 133100/371472 [10:34:40<18:54:19,  3.50it/s]
 36%|███▌      | 133101/371472 [10:34:40<18:55:34,  3.50it/s]
 36%|███▌      | 133102/371472 [10:34:41<18:51:40,  3.51it/s]
 36%|███▌      | 133103/371472 [10:34:41<18:57:53,  3.49it/s]
 36%|███▌      | 133104/371472 [10:34:41<19:06:30,  3.47it/s]
 36%|███▌      | 133105/371472 [10:34:41<18:27:21,  3.59it/s]
 36%|███▌      | 133106/371472 [10:34:42<18:01:12,  3.67it/s]
 36%|███▌      | 133107/371472 [10:34:42<17:17:25,  3.83it/s]
 36%|███▌      | 133108/371472 [10:34:42<16:59:43,  3.90it/s]
 36%|███▌      | 133109/371472 [10:34:42<17:02:21,  3.89it/s]
 36%|███▌      | 133110/371472 [10:34:43<17:57:08,  3.69it/s]
 36%|███▌      | 133111/371472 [10:34:43<17:31:31,  3.78it/s]
 36%|███▌      | 133112/371472 [10:34:43<17:15:26,  3.84it/s]
 36%|███▌      | 133113/371472 [10:34:43<17:06:06,  3.87it/s]
 36%|███▌      | 133114/371472 [10:34:44<16:54:34,  3.92it/s]
 36%|███▌      | 133115/371472 [10:34:44<16:36:02,  3.99it/s]
 36%|███▌      | 133116/371472 [10:34:44<16:44:55,  3.95it/s]
 36%|███▌      | 133117/371472 [10:34:44<16:54:03,  3.92it/s]
 36%|███▌      | 133118/371472 [10:34:45<16:42:02,  3.96it/s]
 36%|███▌      | 133119/371472 [10:34:45<16:24:26,  4.04it/s]
 36%|███▌      | 133120/371472 [10:34:45<17:18:46,  3.82it/s]
                                                             
{'loss': 3.2165, 'learning_rate': 6.777887909672693e-07, 'epoch': 5.73}

 36%|███▌      | 133120/371472 [10:34:45<17:18:46,  3.82it/s]
 36%|███▌      | 133121/371472 [10:34:46<18:54:07,  3.50it/s]
 36%|███▌      | 133122/371472 [10:34:46<18:56:02,  3.50it/s]
 36%|███▌      | 133123/371472 [10:34:46<18:37:57,  3.55it/s]
 36%|███▌      | 133124/371472 [10:34:46<19:47:02,  3.35it/s]
 36%|███▌      | 133125/371472 [10:34:47<19:00:52,  3.48it/s]
 36%|███▌      | 133126/371472 [10:34:47<18:26:57,  3.59it/s]
 36%|███▌      | 133127/371472 [10:34:47<17:37:17,  3.76it/s]
 36%|███▌      | 133128/371472 [10:34:47<17:26:41,  3.80it/s]
 36%|███▌      | 133129/371472 [10:34:48<17:40:30,  3.75it/s]
 36%|███▌      | 133130/371472 [10:34:48<18:13:53,  3.63it/s]
 36%|███▌      | 133131/371472 [10:34:48<18:06:06,  3.66it/s]
 36%|███▌      | 133132/371472 [10:34:49<17:50:17,  3.71it/s]
 36%|███▌      | 133133/371472 [10:34:49<17:29:38,  3.78it/s]
 36%|███▌      | 133134/371472 [10:34:49<17:24:29,  3.80it/s]
 36%|███▌      | 133135/371472 [10:34:49<17:08:40,  3.86it/s]
 36%|███▌      | 133136/371472 [10:34:50<17:22:14,  3.81it/s]
 36%|███▌      | 133137/371472 [10:34:50<19:47:26,  3.35it/s]
 36%|███▌      | 133138/371472 [10:34:50<20:37:08,  3.21it/s]
 36%|███▌      | 133139/371472 [10:34:51<19:33:05,  3.39it/s]
 36%|███▌      | 133140/371472 [10:34:51<19:39:19,  3.37it/s]
                                                             
{'loss': 3.0454, 'learning_rate': 6.777403089917903e-07, 'epoch': 5.73}

 36%|███▌      | 133140/371472 [10:34:51<19:39:19,  3.37it/s]
 36%|███▌      | 133141/371472 [10:34:51<19:03:57,  3.47it/s]
 36%|███▌      | 133142/371472 [10:34:52<20:43:33,  3.19it/s]
 36%|███▌      | 133143/371472 [10:34:52<19:16:46,  3.43it/s]
 36%|███▌      | 133144/371472 [10:34:52<18:19:18,  3.61it/s]
 36%|███▌      | 133145/371472 [10:34:52<17:48:21,  3.72it/s]
 36%|███▌      | 133146/371472 [10:34:53<18:15:09,  3.63it/s]
 36%|███▌      | 133147/371472 [10:34:53<18:15:17,  3.63it/s]
 36%|███▌      | 133148/371472 [10:34:53<18:07:56,  3.65it/s]
 36%|███▌      | 133149/371472 [10:34:53<17:47:59,  3.72it/s]
 36%|███▌      | 133150/371472 [10:34:54<18:00:06,  3.68it/s]
 36%|███▌      | 133151/371472 [10:34:54<19:29:45,  3.40it/s]
 36%|███▌      | 133152/371472 [10:34:54<19:00:18,  3.48it/s]
 36%|███▌      | 133153/371472 [10:34:55<18:09:55,  3.64it/s]
 36%|███▌      | 133154/371472 [10:34:55<18:09:46,  3.64it/s]
 36%|███▌      | 133155/371472 [10:34:55<18:43:37,  3.53it/s]
 36%|███▌      | 133156/371472 [10:34:55<18:17:15,  3.62it/s]
 36%|███▌      | 133157/371472 [10:34:56<18:43:42,  3.53it/s]
 36%|███▌      | 133158/371472 [10:34:56<18:26:59,  3.59it/s]
 36%|███▌      | 133159/371472 [10:34:56<17:44:59,  3.73it/s]
 36%|███▌      | 133160/371472 [10:34:56<17:18:07,  3.83it/s]
                                                             
{'loss': 3.2645, 'learning_rate': 6.776918270163114e-07, 'epoch': 5.74}

 36%|███▌      | 133160/371472 [10:34:56<17:18:07,  3.83it/s]
 36%|███▌      | 133161/371472 [10:34:57<17:26:15,  3.80it/s]
 36%|███▌      | 133162/371472 [10:34:57<19:20:18,  3.42it/s]
 36%|███▌      | 133163/371472 [10:34:57<18:48:20,  3.52it/s]
 36%|███▌      | 133164/371472 [10:34:58<18:54:27,  3.50it/s]
 36%|███▌      | 133165/371472 [10:34:58<18:22:13,  3.60it/s]
 36%|███▌      | 133166/371472 [10:34:58<19:15:28,  3.44it/s]
 36%|███▌      | 133167/371472 [10:34:58<19:31:09,  3.39it/s]
 36%|███▌      | 133168/371472 [10:34:59<18:33:38,  3.57it/s]
 36%|███▌      | 133169/371472 [10:34:59<18:39:16,  3.55it/s]
 36%|███▌      | 133170/371472 [10:34:59<18:19:54,  3.61it/s]
 36%|███▌      | 133171/371472 [10:35:00<18:22:09,  3.60it/s]
 36%|███▌      | 133172/371472 [10:35:00<18:44:00,  3.53it/s]
 36%|███▌      | 133173/371472 [10:35:00<17:58:36,  3.68it/s]
 36%|███▌      | 133174/371472 [10:35:00<18:00:43,  3.67it/s]
 36%|███▌      | 133175/371472 [10:35:01<18:28:43,  3.58it/s]
 36%|███▌      | 133176/371472 [10:35:01<19:38:52,  3.37it/s]
 36%|███▌      | 133177/371472 [10:35:01<19:13:25,  3.44it/s]
 36%|███▌      | 133178/371472 [10:35:02<19:54:58,  3.32it/s]
 36%|███▌      | 133179/371472 [10:35:02<18:52:25,  3.51it/s]
 36%|███▌      | 133180/371472 [10:35:02<18:55:34,  3.50it/s]
                                                             
{'loss': 3.1076, 'learning_rate': 6.776433450408326e-07, 'epoch': 5.74}

 36%|███▌      | 133180/371472 [10:35:02<18:55:34,  3.50it/s]
 36%|███▌      | 133181/371472 [10:35:02<18:33:43,  3.57it/s]
 36%|███▌      | 133182/371472 [10:35:03<18:08:09,  3.65it/s]
 36%|███▌      | 133183/371472 [10:35:03<18:03:59,  3.66it/s]
 36%|███▌      | 133184/371472 [10:35:03<18:08:13,  3.65it/s]
 36%|███▌      | 133185/371472 [10:35:03<17:57:21,  3.69it/s]
 36%|███▌      | 133186/371472 [10:35:04<19:04:51,  3.47it/s]
 36%|███▌      | 133187/371472 [10:35:04<19:28:19,  3.40it/s]
 36%|███▌      | 133188/371472 [10:35:04<19:04:15,  3.47it/s]
 36%|███▌      | 133189/371472 [10:35:05<19:53:12,  3.33it/s]
 36%|███▌      | 133190/371472 [10:35:05<19:36:24,  3.38it/s]
 36%|███▌      | 133191/371472 [10:35:05<18:45:55,  3.53it/s]
 36%|███▌      | 133192/371472 [10:35:06<20:08:40,  3.29it/s]
 36%|███▌      | 133193/371472 [10:35:06<20:01:59,  3.30it/s]
 36%|███▌      | 133194/371472 [10:35:06<20:15:35,  3.27it/s]
 36%|███▌      | 133195/371472 [10:35:06<19:28:00,  3.40it/s]
 36%|███▌      | 133196/371472 [10:35:07<18:37:20,  3.55it/s]
 36%|███▌      | 133197/371472 [10:35:07<17:57:20,  3.69it/s]
 36%|███▌      | 133198/371472 [10:35:07<17:27:33,  3.79it/s]
 36%|███▌      | 133199/371472 [10:35:08<17:58:31,  3.68it/s]
 36%|███▌      | 133200/371472 [10:35:08<18:48:42,  3.52it/s]
                                                             
{'loss': 3.1345, 'learning_rate': 6.775948630653538e-07, 'epoch': 5.74}

 36%|███▌      | 133200/371472 [10:35:08<18:48:42,  3.52it/s]
 36%|███▌      | 133201/371472 [10:35:08<18:43:47,  3.53it/s]
 36%|███▌      | 133202/371472 [10:35:08<18:27:14,  3.59it/s]
 36%|███▌      | 133203/371472 [10:35:09<18:15:45,  3.62it/s]
 36%|███▌      | 133204/371472 [10:35:09<19:02:39,  3.48it/s]
 36%|███▌      | 133205/371472 [10:35:09<18:48:53,  3.52it/s]
 36%|███▌      | 133206/371472 [10:35:10<19:14:51,  3.44it/s]
 36%|███▌      | 133207/371472 [10:35:10<19:12:51,  3.44it/s]
 36%|███▌      | 133208/371472 [10:35:10<18:23:06,  3.60it/s]
 36%|███▌      | 133209/371472 [10:35:10<19:06:58,  3.46it/s]
 36%|███▌      | 133210/371472 [10:35:11<18:49:42,  3.52it/s]
 36%|███▌      | 133211/371472 [10:35:11<18:05:05,  3.66it/s]
 36%|███▌      | 133212/371472 [10:35:11<17:55:24,  3.69it/s]
 36%|███▌      | 133213/371472 [10:35:11<18:15:09,  3.63it/s]
 36%|███▌      | 133214/371472 [10:35:12<18:49:41,  3.52it/s]
 36%|███▌      | 133215/371472 [10:35:12<19:39:37,  3.37it/s]
 36%|███▌      | 133216/371472 [10:35:12<20:25:01,  3.24it/s]
 36%|███▌      | 133217/371472 [10:35:13<20:27:30,  3.23it/s]
 36%|███▌      | 133218/371472 [10:35:13<19:44:34,  3.35it/s]
 36%|███▌      | 133219/371472 [10:35:13<19:16:28,  3.43it/s]
 36%|███▌      | 133220/371472 [10:35:14<19:46:21,  3.35it/s]
                                                             
{'loss': 3.1146, 'learning_rate': 6.775463810898747e-07, 'epoch': 5.74}

 36%|███▌      | 133220/371472 [10:35:14<19:46:21,  3.35it/s]
 36%|███▌      | 133221/371472 [10:35:14<18:53:41,  3.50it/s]
 36%|███▌      | 133222/371472 [10:35:14<19:22:55,  3.41it/s]
 36%|███▌      | 133223/371472 [10:35:14<18:33:46,  3.57it/s]
 36%|███▌      | 133224/371472 [10:35:15<17:56:29,  3.69it/s]
 36%|███▌      | 133225/371472 [10:35:15<18:14:41,  3.63it/s]
 36%|███▌      | 133226/371472 [10:35:15<18:01:57,  3.67it/s]
 36%|███▌      | 133227/371472 [10:35:16<18:06:02,  3.66it/s]
 36%|███▌      | 133228/371472 [10:35:16<19:46:11,  3.35it/s]
 36%|███▌      | 133229/371472 [10:35:16<19:06:39,  3.46it/s]
 36%|███▌      | 133230/371472 [10:35:16<20:18:04,  3.26it/s]
 36%|███▌      | 133231/371472 [10:35:17<19:43:18,  3.36it/s]
 36%|███▌      | 133232/371472 [10:35:17<19:02:04,  3.48it/s]
 36%|███▌      | 133233/371472 [10:35:17<18:27:12,  3.59it/s]
 36%|███▌      | 133234/371472 [10:35:18<18:35:21,  3.56it/s]
 36%|███▌      | 133235/371472 [10:35:18<18:30:45,  3.57it/s]
 36%|███▌      | 133236/371472 [10:35:18<17:40:57,  3.74it/s]
 36%|███▌      | 133237/371472 [10:35:18<17:40:58,  3.74it/s]
 36%|███▌      | 133238/371472 [10:35:19<17:14:11,  3.84it/s]
 36%|███▌      | 133239/371472 [10:35:19<16:37:06,  3.98it/s]
 36%|███▌      | 133240/371472 [10:35:19<16:59:55,  3.89it/s]
                                                             
{'loss': 3.4338, 'learning_rate': 6.774978991143958e-07, 'epoch': 5.74}

 36%|███▌      | 133240/371472 [10:35:19<16:59:55,  3.89it/s]
 36%|███▌      | 133241/371472 [10:35:19<17:20:42,  3.82it/s]
 36%|███▌      | 133242/371472 [10:35:20<19:27:00,  3.40it/s]
 36%|███▌      | 133243/371472 [10:35:20<18:55:00,  3.50it/s]
 36%|███▌      | 133244/371472 [10:35:20<18:50:27,  3.51it/s]
 36%|███▌      | 133245/371472 [10:35:21<18:52:34,  3.51it/s]
 36%|███▌      | 133246/371472 [10:35:21<18:29:59,  3.58it/s]
 36%|███▌      | 133247/371472 [10:35:21<18:30:43,  3.57it/s]
 36%|███▌      | 133248/371472 [10:35:21<18:03:21,  3.66it/s]
 36%|███▌      | 133249/371472 [10:35:22<18:56:04,  3.49it/s]
 36%|███▌      | 133250/371472 [10:35:22<18:20:00,  3.61it/s]
 36%|███▌      | 133251/371472 [10:35:22<18:03:30,  3.66it/s]
 36%|███▌      | 133252/371472 [10:35:22<18:01:58,  3.67it/s]
 36%|███▌      | 133253/371472 [10:35:23<18:17:30,  3.62it/s]
 36%|███▌      | 133254/371472 [10:35:23<18:17:54,  3.62it/s]
 36%|███▌      | 133255/371472 [10:35:23<17:41:36,  3.74it/s]
 36%|███▌      | 133256/371472 [10:35:24<17:39:44,  3.75it/s]
 36%|███▌      | 133257/371472 [10:35:24<17:20:32,  3.82it/s]
 36%|███▌      | 133258/371472 [10:35:24<17:19:08,  3.82it/s]
 36%|███▌      | 133259/371472 [10:35:24<16:56:11,  3.91it/s]
 36%|███▌      | 133260/371472 [10:35:25<18:03:47,  3.66it/s]
                                                             
{'loss': 3.1648, 'learning_rate': 6.77449417138917e-07, 'epoch': 5.74}

 36%|███▌      | 133260/371472 [10:35:25<18:03:47,  3.66it/s]
 36%|███▌      | 133261/371472 [10:35:25<18:08:45,  3.65it/s]
 36%|███▌      | 133262/371472 [10:35:25<18:12:53,  3.63it/s]
 36%|███▌      | 133263/371472 [10:35:25<18:03:14,  3.67it/s]
 36%|███▌      | 133264/371472 [10:35:26<17:33:51,  3.77it/s]
 36%|███▌      | 133265/371472 [10:35:26<18:12:22,  3.63it/s]
 36%|███▌      | 133266/371472 [10:35:26<18:45:23,  3.53it/s]
 36%|███▌      | 133267/371472 [10:35:27<18:42:55,  3.54it/s]
 36%|███▌      | 133268/371472 [10:35:27<19:42:27,  3.36it/s]
 36%|███▌      | 133269/371472 [10:35:27<19:34:31,  3.38it/s]
 36%|███▌      | 133270/371472 [10:35:28<20:20:43,  3.25it/s]
 36%|███▌      | 133271/371472 [10:35:28<20:08:13,  3.29it/s]
 36%|███▌      | 133272/371472 [10:35:28<19:36:17,  3.37it/s]
 36%|███▌      | 133273/371472 [10:35:28<19:44:24,  3.35it/s]
 36%|███▌      | 133274/371472 [10:35:29<19:39:10,  3.37it/s]
 36%|███▌      | 133275/371472 [10:35:29<19:12:22,  3.45it/s]
 36%|███▌      | 133276/371472 [10:35:29<18:21:10,  3.61it/s]
 36%|███▌      | 133277/371472 [10:35:29<18:10:12,  3.64it/s]
 36%|███▌      | 133278/371472 [10:35:30<20:27:08,  3.24it/s]
 36%|███▌      | 133279/371472 [10:35:30<20:17:52,  3.26it/s]
 36%|███▌      | 133280/371472 [10:35:30<19:26:54,  3.40it/s]
                                                             
{'loss': 3.1633, 'learning_rate': 6.774009351634382e-07, 'epoch': 5.74}

 36%|███▌      | 133280/371472 [10:35:30<19:26:54,  3.40it/s]
 36%|███▌      | 133281/371472 [10:35:31<19:26:18,  3.40it/s]
 36%|███▌      | 133282/371472 [10:35:31<18:20:08,  3.61it/s]
 36%|███▌      | 133283/371472 [10:35:31<17:55:20,  3.69it/s]
 36%|███▌      | 133284/371472 [10:35:32<18:36:23,  3.56it/s]
 36%|███▌      | 133285/371472 [10:35:32<19:38:02,  3.37it/s]
 36%|███▌      | 133286/371472 [10:35:32<18:55:09,  3.50it/s]
 36%|███▌      | 133287/371472 [10:35:32<18:30:28,  3.57it/s]
 36%|███▌      | 133288/371472 [10:35:33<17:45:42,  3.72it/s]
 36%|███▌      | 133289/371472 [10:35:33<17:30:21,  3.78it/s]
 36%|███▌      | 133290/371472 [10:35:33<17:31:08,  3.78it/s]
 36%|███▌      | 133291/371472 [10:35:33<18:28:56,  3.58it/s]
 36%|███▌      | 133292/371472 [10:35:34<18:50:02,  3.51it/s]
 36%|███▌      | 133293/371472 [10:35:34<18:26:10,  3.59it/s]
 36%|███▌      | 133294/371472 [10:35:34<19:23:22,  3.41it/s]
 36%|███▌      | 133295/371472 [10:35:35<18:32:20,  3.57it/s]
 36%|███▌      | 133296/371472 [10:35:35<18:13:09,  3.63it/s]
 36%|███▌      | 133297/371472 [10:35:35<17:34:24,  3.76it/s]
 36%|███▌      | 133298/371472 [10:35:35<18:23:56,  3.60it/s]
 36%|███▌      | 133299/371472 [10:35:36<18:19:55,  3.61it/s]
 36%|███▌      | 133300/371472 [10:35:36<18:03:26,  3.66it/s]
                                                             
{'loss': 2.9923, 'learning_rate': 6.773524531879592e-07, 'epoch': 5.74}

 36%|███▌      | 133300/371472 [10:35:36<18:03:26,  3.66it/s]
 36%|███▌      | 133301/371472 [10:35:36<18:24:47,  3.59it/s]
 36%|███▌      | 133302/371472 [10:35:37<18:11:52,  3.64it/s]
 36%|███▌      | 133303/371472 [10:35:37<17:55:17,  3.69it/s]
 36%|███▌      | 133304/371472 [10:35:37<18:15:54,  3.62it/s]
 36%|███▌      | 133305/371472 [10:35:37<17:51:18,  3.71it/s]
 36%|███▌      | 133306/371472 [10:35:38<17:26:46,  3.79it/s]
 36%|███▌      | 133307/371472 [10:35:38<17:50:57,  3.71it/s]
 36%|███▌      | 133308/371472 [10:35:38<19:00:47,  3.48it/s]
 36%|███▌      | 133309/371472 [10:35:38<18:16:36,  3.62it/s]
 36%|███▌      | 133310/371472 [10:35:39<17:51:53,  3.70it/s]
 36%|███▌      | 133311/371472 [10:35:39<17:35:57,  3.76it/s]
 36%|███▌      | 133312/371472 [10:35:39<17:45:02,  3.73it/s]
 36%|███▌      | 133313/371472 [10:35:39<17:25:41,  3.80it/s]
 36%|███▌      | 133314/371472 [10:35:40<17:39:04,  3.75it/s]
 36%|███▌      | 133315/371472 [10:35:40<18:31:41,  3.57it/s]
 36%|███▌      | 133316/371472 [10:35:40<17:45:58,  3.72it/s]
 36%|███▌      | 133317/371472 [10:35:41<17:19:31,  3.82it/s]
 36%|███▌      | 133318/371472 [10:35:41<19:38:05,  3.37it/s]
 36%|███▌      | 133319/371472 [10:35:41<18:49:53,  3.51it/s]
 36%|███▌      | 133320/371472 [10:35:41<18:00:58,  3.67it/s]
                                                             
{'loss': 3.072, 'learning_rate': 6.773039712124803e-07, 'epoch': 5.74}

 36%|███▌      | 133320/371472 [10:35:41<18:00:58,  3.67it/s]
 36%|███▌      | 133321/371472 [10:35:42<17:23:54,  3.80it/s]
 36%|███▌      | 133322/371472 [10:35:42<17:47:11,  3.72it/s]
 36%|███▌      | 133323/371472 [10:35:42<18:02:11,  3.67it/s]
 36%|███▌      | 133324/371472 [10:35:42<17:46:28,  3.72it/s]
 36%|███▌      | 133325/371472 [10:35:43<18:04:17,  3.66it/s]
 36%|███▌      | 133326/371472 [10:35:43<18:05:33,  3.66it/s]
 36%|███▌      | 133327/371472 [10:35:43<18:54:26,  3.50it/s]
 36%|███▌      | 133328/371472 [10:35:44<18:50:55,  3.51it/s]
 36%|███▌      | 133329/371472 [10:35:44<18:53:17,  3.50it/s]
 36%|███▌      | 133330/371472 [10:35:44<18:07:27,  3.65it/s]
 36%|███▌      | 133331/371472 [10:35:44<17:39:38,  3.75it/s]
 36%|███▌      | 133332/371472 [10:35:45<18:58:07,  3.49it/s]
 36%|███▌      | 133333/371472 [10:35:45<18:11:38,  3.64it/s]
 36%|███▌      | 133334/371472 [10:35:45<17:59:22,  3.68it/s]
 36%|███▌      | 133335/371472 [10:35:46<18:59:19,  3.48it/s]
 36%|███▌      | 133336/371472 [10:35:46<19:52:50,  3.33it/s]
 36%|███▌      | 133337/371472 [10:35:46<19:18:24,  3.43it/s]
 36%|███▌      | 133338/371472 [10:35:46<19:24:27,  3.41it/s]
 36%|███▌      | 133339/371472 [10:35:47<20:49:20,  3.18it/s]
 36%|███▌      | 133340/371472 [10:35:47<19:21:56,  3.42it/s]
                                                             
{'loss': 3.0225, 'learning_rate': 6.772554892370015e-07, 'epoch': 5.74}

 36%|███▌      | 133340/371472 [10:35:47<19:21:56,  3.42it/s]
 36%|███▌      | 133341/371472 [10:35:47<18:29:41,  3.58it/s]
 36%|███▌      | 133342/371472 [10:35:48<17:59:57,  3.68it/s]
 36%|███▌      | 133343/371472 [10:35:48<18:29:51,  3.58it/s]
 36%|███▌      | 133344/371472 [10:35:48<18:37:57,  3.55it/s]
 36%|███▌      | 133345/371472 [10:35:49<19:14:26,  3.44it/s]
 36%|███▌      | 133346/371472 [10:35:49<18:39:57,  3.54it/s]
 36%|███▌      | 133347/371472 [10:35:49<17:49:31,  3.71it/s]
 36%|███▌      | 133348/371472 [10:35:49<18:59:27,  3.48it/s]
 36%|███▌      | 133349/371472 [10:35:50<18:38:58,  3.55it/s]
 36%|███▌      | 133350/371472 [10:35:50<18:30:44,  3.57it/s]
 36%|███▌      | 133351/371472 [10:35:50<17:40:37,  3.74it/s]
 36%|███▌      | 133352/371472 [10:35:50<17:52:51,  3.70it/s]
 36%|███▌      | 133353/371472 [10:35:51<17:15:06,  3.83it/s]
 36%|███▌      | 133354/371472 [10:35:51<16:47:56,  3.94it/s]
 36%|███▌      | 133355/371472 [10:35:51<17:44:54,  3.73it/s]
 36%|███▌      | 133356/371472 [10:35:51<18:12:21,  3.63it/s]
 36%|███▌      | 133357/371472 [10:35:52<19:05:12,  3.47it/s]
 36%|███▌      | 133358/371472 [10:35:52<18:54:42,  3.50it/s]
 36%|███▌      | 133359/371472 [10:35:52<18:37:39,  3.55it/s]
 36%|███▌      | 133360/371472 [10:35:53<20:37:56,  3.21it/s]
                                                             
{'loss': 3.1442, 'learning_rate': 6.772070072615225e-07, 'epoch': 5.74}

 36%|███▌      | 133360/371472 [10:35:53<20:37:56,  3.21it/s]
 36%|███▌      | 133361/371472 [10:35:53<22:01:24,  3.00it/s]
 36%|███▌      | 133362/371472 [10:35:53<20:21:49,  3.25it/s]
 36%|███▌      | 133363/371472 [10:35:54<19:26:48,  3.40it/s]
 36%|███▌      | 133364/371472 [10:35:54<20:07:08,  3.29it/s]
 36%|███▌      | 133365/371472 [10:35:54<19:25:59,  3.40it/s]
 36%|███▌      | 133366/371472 [10:35:54<18:47:21,  3.52it/s]
 36%|███▌      | 133367/371472 [10:35:55<19:01:56,  3.48it/s]
 36%|███▌      | 133368/371472 [10:35:55<19:07:02,  3.46it/s]
 36%|███▌      | 133369/371472 [10:35:55<18:34:55,  3.56it/s]
 36%|███▌      | 133370/371472 [10:35:56<18:06:51,  3.65it/s]
 36%|███▌      | 133371/371472 [10:35:56<17:26:12,  3.79it/s]
 36%|███▌      | 133372/371472 [10:35:56<17:25:17,  3.80it/s]
 36%|███▌      | 133373/371472 [10:35:56<17:43:33,  3.73it/s]
 36%|███▌      | 133374/371472 [10:35:57<20:13:23,  3.27it/s]
 36%|███▌      | 133375/371472 [10:35:57<19:45:46,  3.35it/s]
 36%|███▌      | 133376/371472 [10:35:57<19:04:43,  3.47it/s]
 36%|███▌      | 133377/371472 [10:35:58<19:01:19,  3.48it/s]
 36%|███▌      | 133378/371472 [10:35:58<18:07:18,  3.65it/s]
 36%|███▌      | 133379/371472 [10:35:58<18:09:34,  3.64it/s]
 36%|███▌      | 133380/371472 [10:35:58<18:57:22,  3.49it/s]
                                                             
{'loss': 3.1921, 'learning_rate': 6.771585252860437e-07, 'epoch': 5.74}

 36%|███▌      | 133380/371472 [10:35:58<18:57:22,  3.49it/s]
 36%|███▌      | 133381/371472 [10:35:59<19:21:10,  3.42it/s]
 36%|███▌      | 133382/371472 [10:35:59<19:22:02,  3.41it/s]
 36%|███▌      | 133383/371472 [10:35:59<18:27:30,  3.58it/s]
 36%|███▌      | 133384/371472 [10:36:00<17:53:17,  3.70it/s]
 36%|███▌      | 133385/371472 [10:36:00<17:38:27,  3.75it/s]
 36%|███▌      | 133386/371472 [10:36:00<16:52:58,  3.92it/s]
 36%|███▌      | 133387/371472 [10:36:00<17:02:39,  3.88it/s]
 36%|███▌      | 133388/371472 [10:36:00<16:33:48,  3.99it/s]
 36%|███▌      | 133389/371472 [10:36:01<16:45:37,  3.95it/s]
 36%|███▌      | 133390/371472 [10:36:01<17:38:19,  3.75it/s]
 36%|███▌      | 133391/371472 [10:36:01<18:55:25,  3.49it/s]
 36%|███▌      | 133392/371472 [10:36:02<18:16:58,  3.62it/s]
 36%|███▌      | 133393/371472 [10:36:02<18:45:51,  3.52it/s]
 36%|███▌      | 133394/371472 [10:36:02<18:03:21,  3.66it/s]
 36%|███▌      | 133395/371472 [10:36:02<18:22:41,  3.60it/s]
 36%|███▌      | 133396/371472 [10:36:03<18:05:44,  3.65it/s]
 36%|███▌      | 133397/371472 [10:36:03<19:37:19,  3.37it/s]
 36%|███▌      | 133398/371472 [10:36:03<18:50:25,  3.51it/s]
 36%|███▌      | 133399/371472 [10:36:04<18:23:04,  3.60it/s]
 36%|███▌      | 133400/371472 [10:36:04<17:38:47,  3.75it/s]
                                                             
{'loss': 3.2415, 'learning_rate': 6.771100433105647e-07, 'epoch': 5.75}

 36%|███▌      | 133400/371472 [10:36:04<17:38:47,  3.75it/s]
 36%|███▌      | 133401/371472 [10:36:04<18:22:53,  3.60it/s]
 36%|███▌      | 133402/371472 [10:36:04<18:36:53,  3.55it/s]
 36%|███▌      | 133403/371472 [10:36:05<18:30:07,  3.57it/s]
 36%|███▌      | 133404/371472 [10:36:05<18:31:28,  3.57it/s]
 36%|███▌      | 133405/371472 [10:36:05<17:55:28,  3.69it/s]
 36%|███▌      | 133406/371472 [10:36:06<18:10:54,  3.64it/s]
 36%|███▌      | 133407/371472 [10:36:06<17:30:59,  3.78it/s]
 36%|███▌      | 133408/371472 [10:36:06<17:39:15,  3.75it/s]
 36%|███▌      | 133409/371472 [10:36:06<17:59:49,  3.67it/s]
 36%|███▌      | 133410/371472 [10:36:07<17:45:32,  3.72it/s]
 36%|███▌      | 133411/371472 [10:36:07<18:17:23,  3.62it/s]
 36%|███▌      | 133412/371472 [10:36:07<19:17:45,  3.43it/s]
 36%|███▌      | 133413/371472 [10:36:07<18:47:08,  3.52it/s]
 36%|███▌      | 133414/371472 [10:36:08<18:02:23,  3.67it/s]
 36%|███▌      | 133415/371472 [10:36:08<18:09:57,  3.64it/s]
 36%|███▌      | 133416/371472 [10:36:08<18:37:27,  3.55it/s]
 36%|███▌      | 133417/371472 [10:36:09<19:28:54,  3.39it/s]
 36%|███▌      | 133418/371472 [10:36:09<19:31:47,  3.39it/s]
 36%|███▌      | 133419/371472 [10:36:09<18:20:38,  3.60it/s]
 36%|███▌      | 133420/371472 [10:36:09<19:14:05,  3.44it/s]
                                                             
{'loss': 3.2781, 'learning_rate': 6.770615613350859e-07, 'epoch': 5.75}

 36%|███▌      | 133420/371472 [10:36:09<19:14:05,  3.44it/s]
 36%|███▌      | 133421/371472 [10:36:10<19:04:26,  3.47it/s]
 36%|███▌      | 133422/371472 [10:36:10<18:48:08,  3.52it/s]
 36%|███▌      | 133423/371472 [10:36:10<18:29:24,  3.58it/s]
 36%|███▌      | 133424/371472 [10:36:11<17:48:30,  3.71it/s]
 36%|███▌      | 133425/371472 [10:36:11<17:10:16,  3.85it/s]
 36%|███▌      | 133426/371472 [10:36:11<17:10:33,  3.85it/s]
 36%|███▌      | 133427/371472 [10:36:11<16:50:54,  3.92it/s]
 36%|███▌      | 133428/371472 [10:36:12<17:32:23,  3.77it/s]
 36%|███▌      | 133429/371472 [10:36:12<17:44:05,  3.73it/s]
 36%|███▌      | 133430/371472 [10:36:12<18:30:12,  3.57it/s]
 36%|███▌      | 133431/371472 [10:36:13<19:29:44,  3.39it/s]
 36%|███▌      | 133432/371472 [10:36:13<19:03:52,  3.47it/s]
 36%|███▌      | 133433/371472 [10:36:13<19:00:43,  3.48it/s]
 36%|███▌      | 133434/371472 [10:36:13<18:40:18,  3.54it/s]
 36%|███▌      | 133435/371472 [10:36:14<19:27:35,  3.40it/s]
 36%|███▌      | 133436/371472 [10:36:14<19:42:02,  3.36it/s]
 36%|███▌      | 133437/371472 [10:36:14<19:02:35,  3.47it/s]
 36%|███▌      | 133438/371472 [10:36:15<19:36:51,  3.37it/s]
 36%|███▌      | 133439/371472 [10:36:15<19:15:54,  3.43it/s]
 36%|███▌      | 133440/371472 [10:36:15<18:54:31,  3.50it/s]
                                                             
{'loss': 3.1377, 'learning_rate': 6.77013079359607e-07, 'epoch': 5.75}

 36%|███▌      | 133440/371472 [10:36:15<18:54:31,  3.50it/s]
 36%|███▌      | 133441/371472 [10:36:15<19:31:56,  3.39it/s]
 36%|███▌      | 133442/371472 [10:36:16<20:43:33,  3.19it/s]
 36%|███▌      | 133443/371472 [10:36:16<19:35:38,  3.37it/s]
 36%|███▌      | 133444/371472 [10:36:16<18:54:43,  3.50it/s]
 36%|███▌      | 133445/371472 [10:36:17<18:15:57,  3.62it/s]
 36%|███▌      | 133446/371472 [10:36:17<18:16:26,  3.62it/s]
 36%|███▌      | 133447/371472 [10:36:17<18:02:42,  3.66it/s]
 36%|███▌      | 133448/371472 [10:36:17<17:50:58,  3.70it/s]
 36%|███▌      | 133449/371472 [10:36:18<17:57:26,  3.68it/s]
 36%|███▌      | 133450/371472 [10:36:18<18:36:46,  3.55it/s]
 36%|███▌      | 133451/371472 [10:36:18<18:47:37,  3.52it/s]
 36%|███▌      | 133452/371472 [10:36:18<18:42:29,  3.53it/s]
 36%|███▌      | 133453/371472 [10:36:19<17:50:29,  3.71it/s]
 36%|███▌      | 133454/371472 [10:36:19<17:25:34,  3.79it/s]
 36%|███▌      | 133455/371472 [10:36:19<17:59:08,  3.68it/s]
 36%|███▌      | 133456/371472 [10:36:20<18:25:33,  3.59it/s]
 36%|███▌      | 133457/371472 [10:36:20<20:33:03,  3.22it/s]
 36%|███▌      | 133458/371472 [10:36:20<19:25:04,  3.40it/s]
 36%|███▌      | 133459/371472 [10:36:21<19:36:45,  3.37it/s]
 36%|███▌      | 133460/371472 [10:36:21<20:22:20,  3.25it/s]
                                                             
{'loss': 3.009, 'learning_rate': 6.769645973841281e-07, 'epoch': 5.75}

 36%|███▌      | 133460/371472 [10:36:21<20:22:20,  3.25it/s]
 36%|███▌      | 133461/371472 [10:36:21<19:16:28,  3.43it/s]
 36%|███▌      | 133462/371472 [10:36:21<18:29:19,  3.58it/s]
 36%|███▌      | 133463/371472 [10:36:22<17:45:25,  3.72it/s]
 36%|███▌      | 133464/371472 [10:36:22<17:45:07,  3.72it/s]
 36%|███▌      | 133465/371472 [10:36:22<18:07:23,  3.65it/s]
 36%|███▌      | 133466/371472 [10:36:22<19:08:50,  3.45it/s]
 36%|███▌      | 133467/371472 [10:36:23<19:11:36,  3.44it/s]
 36%|███▌      | 133468/371472 [10:36:23<19:54:21,  3.32it/s]
 36%|███▌      | 133469/371472 [10:36:23<19:38:10,  3.37it/s]
 36%|███▌      | 133470/371472 [10:36:24<19:44:50,  3.35it/s]
 36%|███▌      | 133471/371472 [10:36:24<18:59:29,  3.48it/s]
 36%|███▌      | 133472/371472 [10:36:24<19:45:50,  3.35it/s]
 36%|███▌      | 133473/371472 [10:36:25<20:19:21,  3.25it/s]
 36%|███▌      | 133474/371472 [10:36:25<19:28:08,  3.40it/s]
 36%|███▌      | 133475/371472 [10:36:25<18:34:45,  3.56it/s]
 36%|███▌      | 133476/371472 [10:36:25<18:22:44,  3.60it/s]
 36%|███▌      | 133477/371472 [10:36:26<18:01:55,  3.67it/s]
 36%|███▌      | 133478/371472 [10:36:26<17:57:55,  3.68it/s]
 36%|███▌      | 133479/371472 [10:36:26<18:01:05,  3.67it/s]
 36%|███▌      | 133480/371472 [10:36:26<17:11:54,  3.84it/s]
                                                             
{'loss': 2.9462, 'learning_rate': 6.769161154086491e-07, 'epoch': 5.75}

 36%|███▌      | 133480/371472 [10:36:26<17:11:54,  3.84it/s]
 36%|███▌      | 133481/371472 [10:36:27<19:26:26,  3.40it/s]
 36%|███▌      | 133482/371472 [10:36:27<18:58:16,  3.48it/s]
 36%|███▌      | 133483/371472 [10:36:27<18:02:57,  3.66it/s]
 36%|███▌      | 133484/371472 [10:36:28<18:19:20,  3.61it/s]
 36%|███▌      | 133485/371472 [10:36:28<18:49:40,  3.51it/s]
 36%|███▌      | 133486/371472 [10:36:28<18:44:31,  3.53it/s]
 36%|███▌      | 133487/371472 [10:36:28<19:20:30,  3.42it/s]
 36%|███▌      | 133488/371472 [10:36:29<20:11:03,  3.28it/s]
 36%|███▌      | 133489/371472 [10:36:29<19:55:46,  3.32it/s]
 36%|███▌      | 133490/371472 [10:36:29<18:50:22,  3.51it/s]
 36%|███▌      | 133491/371472 [10:36:30<19:35:57,  3.37it/s]
 36%|███▌      | 133492/371472 [10:36:30<18:39:25,  3.54it/s]
 36%|███▌      | 133493/371472 [10:36:30<17:51:39,  3.70it/s]
 36%|███▌      | 133494/371472 [10:36:30<18:50:26,  3.51it/s]
 36%|███▌      | 133495/371472 [10:36:31<18:08:08,  3.65it/s]
 36%|███▌      | 133496/371472 [10:36:31<17:47:28,  3.72it/s]
 36%|███▌      | 133497/371472 [10:36:31<20:42:34,  3.19it/s]
 36%|███▌      | 133498/371472 [10:36:32<19:02:31,  3.47it/s]
 36%|███▌      | 133499/371472 [10:36:32<18:47:26,  3.52it/s]
 36%|███▌      | 133500/371472 [10:36:32<18:22:59,  3.60it/s]
                                                             
{'loss': 3.1098, 'learning_rate': 6.768676334331703e-07, 'epoch': 5.75}

 36%|███▌      | 133500/371472 [10:36:32<18:22:59,  3.60it/s]
 36%|███▌      | 133501/371472 [10:36:32<18:38:06,  3.55it/s]
 36%|███▌      | 133502/371472 [10:36:33<18:56:16,  3.49it/s]
 36%|███▌      | 133503/371472 [10:36:33<18:24:30,  3.59it/s]
 36%|███▌      | 133504/371472 [10:36:33<18:19:40,  3.61it/s]
 36%|███▌      | 133505/371472 [10:36:34<18:00:03,  3.67it/s]
 36%|███▌      | 133506/371472 [10:36:34<17:29:30,  3.78it/s]
 36%|███▌      | 133507/371472 [10:36:34<18:28:53,  3.58it/s]
 36%|███▌      | 133508/371472 [10:36:34<17:44:49,  3.72it/s]
 36%|███▌      | 133509/371472 [10:36:35<17:12:39,  3.84it/s]
 36%|███▌      | 133510/371472 [10:36:35<17:16:39,  3.83it/s]
 36%|███▌      | 133511/371472 [10:36:35<16:56:11,  3.90it/s]
 36%|███▌      | 133512/371472 [10:36:35<17:29:23,  3.78it/s]
 36%|███▌      | 133513/371472 [10:36:36<17:06:53,  3.86it/s]
 36%|███▌      | 133514/371472 [10:36:36<19:36:46,  3.37it/s]
 36%|███▌      | 133515/371472 [10:36:36<19:18:41,  3.42it/s]
 36%|███▌      | 133516/371472 [10:36:37<18:53:34,  3.50it/s]
 36%|███▌      | 133517/371472 [10:36:37<18:21:40,  3.60it/s]
 36%|███▌      | 133518/371472 [10:36:37<18:02:26,  3.66it/s]
 36%|███▌      | 133519/371472 [10:36:37<17:35:34,  3.76it/s]
 36%|███▌      | 133520/371472 [10:36:38<16:56:49,  3.90it/s]
                                                             
{'loss': 3.2555, 'learning_rate': 6.768191514576914e-07, 'epoch': 5.75}

 36%|███▌      | 133520/371472 [10:36:38<16:56:49,  3.90it/s]
 36%|███▌      | 133521/371472 [10:36:38<16:46:54,  3.94it/s]
 36%|███▌      | 133522/371472 [10:36:38<18:54:09,  3.50it/s]
 36%|███▌      | 133523/371472 [10:36:39<19:14:37,  3.43it/s]
 36%|███▌      | 133524/371472 [10:36:39<19:39:16,  3.36it/s]
 36%|███▌      | 133525/371472 [10:36:39<18:44:22,  3.53it/s]
 36%|███▌      | 133526/371472 [10:36:39<18:17:14,  3.61it/s]
 36%|███▌      | 133527/371472 [10:36:40<17:41:03,  3.74it/s]
 36%|███▌      | 133528/371472 [10:36:40<18:49:51,  3.51it/s]
 36%|███▌      | 133529/371472 [10:36:40<18:10:36,  3.64it/s]
 36%|███▌      | 133530/371472 [10:36:40<18:05:16,  3.65it/s]
 36%|███▌      | 133531/371472 [10:36:41<18:40:27,  3.54it/s]
 36%|███▌      | 133532/371472 [10:36:41<18:01:23,  3.67it/s]
 36%|███▌      | 133533/371472 [10:36:41<18:50:00,  3.51it/s]
 36%|███▌      | 133534/371472 [10:36:42<18:13:17,  3.63it/s]
 36%|███▌      | 133535/371472 [10:36:42<18:56:16,  3.49it/s]
 36%|███▌      | 133536/371472 [10:36:42<18:16:01,  3.62it/s]
 36%|███▌      | 133537/371472 [10:36:42<17:38:41,  3.75it/s]
 36%|███▌      | 133538/371472 [10:36:43<18:53:32,  3.50it/s]
 36%|███▌      | 133539/371472 [10:36:43<18:19:01,  3.61it/s]
 36%|███▌      | 133540/371472 [10:36:43<18:44:35,  3.53it/s]
                                                             
{'loss': 3.0656, 'learning_rate': 6.767706694822124e-07, 'epoch': 5.75}

 36%|███▌      | 133540/371472 [10:36:43<18:44:35,  3.53it/s]
 36%|███▌      | 133541/371472 [10:36:44<18:24:13,  3.59it/s]
 36%|███▌      | 133542/371472 [10:36:44<17:58:46,  3.68it/s]
 36%|███▌      | 133543/371472 [10:36:44<18:07:07,  3.65it/s]
 36%|███▌      | 133544/371472 [10:36:44<18:33:34,  3.56it/s]
 36%|███▌      | 133545/371472 [10:36:45<18:03:48,  3.66it/s]
 36%|███▌      | 133546/371472 [10:36:45<18:39:15,  3.54it/s]
 36%|███▌      | 133547/371472 [10:36:45<19:02:43,  3.47it/s]
 36%|███▌      | 133548/371472 [10:36:45<18:47:39,  3.52it/s]
 36%|███▌      | 133549/371472 [10:36:46<18:50:19,  3.51it/s]
 36%|███▌      | 133550/371472 [10:36:46<18:20:18,  3.60it/s]
 36%|███▌      | 133551/371472 [10:36:46<17:49:06,  3.71it/s]
 36%|███▌      | 133552/371472 [10:36:47<17:26:19,  3.79it/s]
 36%|███▌      | 133553/371472 [10:36:47<18:09:36,  3.64it/s]
 36%|███▌      | 133554/371472 [10:36:47<18:06:45,  3.65it/s]
 36%|███▌      | 133555/371472 [10:36:47<18:10:29,  3.64it/s]
 36%|███▌      | 133556/371472 [10:36:48<17:31:24,  3.77it/s]
 36%|███▌      | 133557/371472 [10:36:48<18:04:05,  3.66it/s]
 36%|███▌      | 133558/371472 [10:36:48<18:28:21,  3.58it/s]
 36%|███▌      | 133559/371472 [10:36:48<17:44:57,  3.72it/s]
 36%|███▌      | 133560/371472 [10:36:49<17:17:55,  3.82it/s]
                                                             
{'loss': 3.0742, 'learning_rate': 6.767221875067336e-07, 'epoch': 5.75}

 36%|███▌      | 133560/371472 [10:36:49<17:17:55,  3.82it/s]
 36%|███▌      | 133561/371472 [10:36:49<17:05:03,  3.87it/s]
 36%|███▌      | 133562/371472 [10:36:49<17:55:04,  3.69it/s]
 36%|███▌      | 133563/371472 [10:36:50<18:16:51,  3.62it/s]
 36%|███▌      | 133564/371472 [10:36:50<17:45:06,  3.72it/s]
 36%|███▌      | 133565/371472 [10:36:50<17:32:47,  3.77it/s]
 36%|███▌      | 133566/371472 [10:36:50<16:47:24,  3.94it/s]
 36%|███▌      | 133567/371472 [10:36:51<17:07:35,  3.86it/s]
 36%|███▌      | 133568/371472 [10:36:51<16:55:49,  3.90it/s]
 36%|███▌      | 133569/371472 [10:36:51<17:10:52,  3.85it/s]
 36%|███▌      | 133570/371472 [10:36:51<16:51:19,  3.92it/s]
 36%|███▌      | 133571/371472 [10:36:52<17:35:30,  3.76it/s]
 36%|███▌      | 133572/371472 [10:36:52<18:49:15,  3.51it/s]
 36%|███▌      | 133573/371472 [10:36:52<19:28:13,  3.39it/s]
 36%|███▌      | 133574/371472 [10:36:52<18:37:03,  3.55it/s]
 36%|███▌      | 133575/371472 [10:36:53<20:33:53,  3.21it/s]
 36%|███▌      | 133576/371472 [10:36:53<20:49:22,  3.17it/s]
 36%|███▌      | 133577/371472 [10:36:53<19:20:33,  3.42it/s]
 36%|███▌      | 133578/371472 [10:36:54<18:44:08,  3.53it/s]
 36%|███▌      | 133579/371472 [10:36:54<18:06:20,  3.65it/s]
 36%|███▌      | 133580/371472 [10:36:54<17:46:36,  3.72it/s]
                                                             
{'loss': 3.1825, 'learning_rate': 6.766737055312548e-07, 'epoch': 5.75}

 36%|███▌      | 133580/371472 [10:36:54<17:46:36,  3.72it/s]
 36%|███▌      | 133581/371472 [10:36:55<18:21:21,  3.60it/s]
 36%|███▌      | 133582/371472 [10:36:55<18:25:30,  3.59it/s]
 36%|███▌      | 133583/371472 [10:36:55<18:32:52,  3.56it/s]
 36%|███▌      | 133584/371472 [10:36:55<18:14:44,  3.62it/s]
 36%|███▌      | 133585/371472 [10:36:56<17:50:05,  3.71it/s]
 36%|███▌      | 133586/371472 [10:36:56<17:40:26,  3.74it/s]
 36%|███▌      | 133587/371472 [10:36:56<19:17:23,  3.43it/s]
 36%|███▌      | 133588/371472 [10:36:56<18:23:00,  3.59it/s]
 36%|███▌      | 133589/371472 [10:36:57<17:46:24,  3.72it/s]
 36%|███▌      | 133590/371472 [10:36:57<18:12:58,  3.63it/s]
 36%|███▌      | 133591/371472 [10:36:57<19:06:30,  3.46it/s]
 36%|███▌      | 133592/371472 [10:36:58<19:51:37,  3.33it/s]
 36%|███▌      | 133593/371472 [10:36:58<19:47:10,  3.34it/s]
 36%|███▌      | 133594/371472 [10:36:58<19:27:18,  3.40it/s]
 36%|███▌      | 133595/371472 [10:36:58<18:46:28,  3.52it/s]
 36%|███▌      | 133596/371472 [10:36:59<18:00:06,  3.67it/s]
 36%|███▌      | 133597/371472 [10:36:59<18:20:49,  3.60it/s]
 36%|███▌      | 133598/371472 [10:36:59<18:07:51,  3.64it/s]
 36%|███▌      | 133599/371472 [10:37:00<18:46:04,  3.52it/s]
 36%|███▌      | 133600/371472 [10:37:00<18:53:42,  3.50it/s]
                                                             
{'loss': 3.201, 'learning_rate': 6.766252235557757e-07, 'epoch': 5.75}

 36%|███▌      | 133600/371472 [10:37:00<18:53:42,  3.50it/s]
 36%|███▌      | 133601/371472 [10:37:00<18:35:16,  3.55it/s]
 36%|███▌      | 133602/371472 [10:37:00<17:56:15,  3.68it/s]
 36%|███▌      | 133603/371472 [10:37:01<18:03:12,  3.66it/s]
 36%|███▌      | 133604/371472 [10:37:01<17:50:15,  3.70it/s]
 36%|███▌      | 133605/371472 [10:37:01<17:57:19,  3.68it/s]
 36%|███▌      | 133606/371472 [10:37:01<18:10:42,  3.63it/s]
 36%|███▌      | 133607/371472 [10:37:02<18:24:42,  3.59it/s]
 36%|███▌      | 133608/371472 [10:37:02<18:14:52,  3.62it/s]
 36%|███▌      | 133609/371472 [10:37:02<17:45:39,  3.72it/s]
 36%|███▌      | 133610/371472 [10:37:03<17:55:19,  3.69it/s]
 36%|███▌      | 133611/371472 [10:37:03<18:04:11,  3.66it/s]
 36%|███▌      | 133612/371472 [10:37:03<18:00:12,  3.67it/s]
 36%|███▌      | 133613/371472 [10:37:03<18:30:40,  3.57it/s]
 36%|███▌      | 133614/371472 [10:37:04<17:48:13,  3.71it/s]
 36%|███▌      | 133615/371472 [10:37:04<17:34:34,  3.76it/s]
 36%|███▌      | 133616/371472 [10:37:04<17:45:18,  3.72it/s]
 36%|███▌      | 133617/371472 [10:37:04<17:29:09,  3.78it/s]
 36%|███▌      | 133618/371472 [10:37:05<18:45:20,  3.52it/s]
 36%|███▌      | 133619/371472 [10:37:05<18:13:35,  3.62it/s]
 36%|███▌      | 133620/371472 [10:37:05<19:01:44,  3.47it/s]
                                                             
{'loss': 3.3179, 'learning_rate': 6.765767415802968e-07, 'epoch': 5.76}

 36%|███▌      | 133620/371472 [10:37:05<19:01:44,  3.47it/s]
 36%|███▌      | 133621/371472 [10:37:06<19:01:59,  3.47it/s]
 36%|███▌      | 133622/371472 [10:37:06<18:30:09,  3.57it/s]
 36%|███▌      | 133623/371472 [10:37:06<18:53:52,  3.50it/s]
 36%|███▌      | 133624/371472 [10:37:06<18:17:20,  3.61it/s]
 36%|███▌      | 133625/371472 [10:37:07<18:56:53,  3.49it/s]
 36%|███▌      | 133626/371472 [10:37:07<19:28:24,  3.39it/s]
 36%|███▌      | 133627/371472 [10:37:07<19:41:48,  3.35it/s]
 36%|███▌      | 133628/371472 [10:37:08<20:34:32,  3.21it/s]
 36%|███▌      | 133629/371472 [10:37:08<20:03:09,  3.29it/s]
 36%|███▌      | 133630/371472 [10:37:08<19:49:24,  3.33it/s]
 36%|███▌      | 133631/371472 [10:37:09<18:46:19,  3.52it/s]
 36%|███▌      | 133632/371472 [10:37:09<19:16:12,  3.43it/s]
 36%|███▌      | 133633/371472 [10:37:09<18:40:25,  3.54it/s]
 36%|███▌      | 133634/371472 [10:37:09<17:59:01,  3.67it/s]
 36%|███▌      | 133635/371472 [10:37:10<18:52:11,  3.50it/s]
 36%|███▌      | 133636/371472 [10:37:10<18:20:39,  3.60it/s]
 36%|███▌      | 133637/371472 [10:37:10<17:40:09,  3.74it/s]
 36%|███▌      | 133638/371472 [10:37:10<17:46:00,  3.72it/s]
 36%|███▌      | 133639/371472 [10:37:11<17:14:34,  3.83it/s]
 36%|███▌      | 133640/371472 [10:37:11<16:59:44,  3.89it/s]
                                                             
{'loss': 3.1431, 'learning_rate': 6.76528259604818e-07, 'epoch': 5.76}

 36%|███▌      | 133640/371472 [10:37:11<16:59:44,  3.89it/s]
 36%|███▌      | 133641/371472 [10:37:11<18:10:46,  3.63it/s]
 36%|███▌      | 133642/371472 [10:37:12<17:47:49,  3.71it/s]
 36%|███▌      | 133643/371472 [10:37:12<19:13:09,  3.44it/s]
 36%|███▌      | 133644/371472 [10:37:12<18:36:47,  3.55it/s]
 36%|███▌      | 133645/371472 [10:37:12<18:41:13,  3.54it/s]
 36%|███▌      | 133646/371472 [10:37:13<19:06:12,  3.46it/s]
 36%|███▌      | 133647/371472 [10:37:13<18:45:14,  3.52it/s]
 36%|███▌      | 133648/371472 [10:37:13<19:21:28,  3.41it/s]
 36%|███▌      | 133649/371472 [10:37:14<18:21:12,  3.60it/s]
 36%|███▌      | 133650/371472 [10:37:14<18:06:04,  3.65it/s]
 36%|███▌      | 133651/371472 [10:37:14<17:37:48,  3.75it/s]
 36%|███▌      | 133652/371472 [10:37:14<17:22:21,  3.80it/s]
 36%|███▌      | 133653/371472 [10:37:15<18:46:18,  3.52it/s]
 36%|███▌      | 133654/371472 [10:37:15<18:46:02,  3.52it/s]
 36%|███▌      | 133655/371472 [10:37:15<20:58:30,  3.15it/s]
 36%|███▌      | 133656/371472 [10:37:16<19:32:54,  3.38it/s]
 36%|███▌      | 133657/371472 [10:37:16<18:28:41,  3.58it/s]
 36%|███▌      | 133658/371472 [10:37:16<17:54:34,  3.69it/s]
 36%|███▌      | 133659/371472 [10:37:16<18:41:13,  3.54it/s]
 36%|███▌      | 133660/371472 [10:37:17<18:12:20,  3.63it/s]
                                                             
{'loss': 3.28, 'learning_rate': 6.764797776293391e-07, 'epoch': 5.76}

 36%|███▌      | 133660/371472 [10:37:17<18:12:20,  3.63it/s]
 36%|███▌      | 133661/371472 [10:37:17<17:23:42,  3.80it/s]
 36%|███▌      | 133662/371472 [10:37:17<17:33:07,  3.76it/s]
 36%|███▌      | 133663/371472 [10:37:17<17:21:53,  3.80it/s]
 36%|███▌      | 133664/371472 [10:37:18<16:56:19,  3.90it/s]
 36%|███▌      | 133665/371472 [10:37:18<18:09:38,  3.64it/s]
 36%|███▌      | 133666/371472 [10:37:18<17:44:43,  3.72it/s]
 36%|███▌      | 133667/371472 [10:37:18<17:35:08,  3.76it/s]
 36%|███▌      | 133668/371472 [10:37:19<17:32:51,  3.76it/s]
 36%|███▌      | 133669/371472 [10:37:19<17:29:48,  3.78it/s]
 36%|███▌      | 133670/371472 [10:37:19<18:48:10,  3.51it/s]
 36%|███▌      | 133671/371472 [10:37:20<18:54:03,  3.49it/s]
 36%|███▌      | 133672/371472 [10:37:20<19:14:44,  3.43it/s]
 36%|███▌      | 133673/371472 [10:37:20<18:44:44,  3.52it/s]
 36%|███▌      | 133674/371472 [10:37:20<18:20:11,  3.60it/s]
 36%|███▌      | 133675/371472 [10:37:21<18:17:54,  3.61it/s]
 36%|███▌      | 133676/371472 [10:37:21<19:32:15,  3.38it/s]
 36%|███▌      | 133677/371472 [10:37:21<19:09:24,  3.45it/s]
 36%|███▌      | 133678/371472 [10:37:22<19:36:03,  3.37it/s]
 36%|███▌      | 133679/371472 [10:37:22<18:53:00,  3.50it/s]
 36%|███▌      | 133680/371472 [10:37:22<18:15:07,  3.62it/s]
                                                             
{'loss': 3.0673, 'learning_rate': 6.764312956538602e-07, 'epoch': 5.76}

 36%|███▌      | 133680/371472 [10:37:22<18:15:07,  3.62it/s]
 36%|███▌      | 133681/371472 [10:37:22<17:51:10,  3.70it/s]
 36%|███▌      | 133682/371472 [10:37:23<17:23:35,  3.80it/s]
 36%|███▌      | 133683/371472 [10:37:23<17:16:53,  3.82it/s]
 36%|███▌      | 133684/371472 [10:37:23<17:51:38,  3.70it/s]
 36%|███▌      | 133685/371472 [10:37:24<18:34:07,  3.56it/s]
 36%|███▌      | 133686/371472 [10:37:24<20:38:33,  3.20it/s]
 36%|███▌      | 133687/371472 [10:37:24<20:00:48,  3.30it/s]
 36%|███▌      | 133688/371472 [10:37:24<18:47:36,  3.51it/s]
 36%|███▌      | 133689/371472 [10:37:25<19:18:51,  3.42it/s]
 36%|███▌      | 133690/371472 [10:37:25<19:07:45,  3.45it/s]
 36%|███▌      | 133691/371472 [10:37:25<17:56:32,  3.68it/s]
 36%|███▌      | 133692/371472 [10:37:26<18:58:48,  3.48it/s]
 36%|███▌      | 133693/371472 [10:37:26<18:51:51,  3.50it/s]
 36%|███▌      | 133694/371472 [10:37:26<18:12:26,  3.63it/s]
 36%|███▌      | 133695/371472 [10:37:26<18:39:32,  3.54it/s]
 36%|███▌      | 133696/371472 [10:37:27<18:55:16,  3.49it/s]
 36%|███▌      | 133697/371472 [10:37:27<19:11:06,  3.44it/s]
 36%|███▌      | 133698/371472 [10:37:27<19:13:59,  3.43it/s]
 36%|███▌      | 133699/371472 [10:37:28<20:24:52,  3.24it/s]
 36%|███▌      | 133700/371472 [10:37:28<22:48:09,  2.90it/s]
                                                             
{'loss': 2.9866, 'learning_rate': 6.763828136783813e-07, 'epoch': 5.76}

 36%|███▌      | 133700/371472 [10:37:28<22:48:09,  2.90it/s]
 36%|███▌      | 133701/371472 [10:37:28<22:10:57,  2.98it/s]
 36%|███▌      | 133702/371472 [10:37:29<21:00:46,  3.14it/s]
 36%|███▌      | 133703/371472 [10:37:29<19:46:50,  3.34it/s]
 36%|███▌      | 133704/371472 [10:37:29<18:44:30,  3.52it/s]
 36%|███▌      | 133705/371472 [10:37:29<18:45:10,  3.52it/s]
 36%|███▌      | 133706/371472 [10:37:30<18:49:15,  3.51it/s]
 36%|███▌      | 133707/371472 [10:37:30<18:58:47,  3.48it/s]
 36%|███▌      | 133708/371472 [10:37:30<18:26:33,  3.58it/s]
 36%|███▌      | 133709/371472 [10:37:31<18:52:01,  3.50it/s]
 36%|███▌      | 133710/371472 [10:37:31<18:58:31,  3.48it/s]
 36%|███▌      | 133711/371472 [10:37:31<18:51:42,  3.50it/s]
 36%|███▌      | 133712/371472 [10:37:31<18:22:17,  3.59it/s]
 36%|███▌      | 133713/371472 [10:37:32<20:10:04,  3.27it/s]
 36%|███▌      | 133714/371472 [10:37:32<18:59:50,  3.48it/s]
 36%|███▌      | 133715/371472 [10:37:32<18:30:39,  3.57it/s]
 36%|███▌      | 133716/371472 [10:37:33<17:59:28,  3.67it/s]
 36%|███▌      | 133717/371472 [10:37:33<17:43:20,  3.73it/s]
 36%|███▌      | 133718/371472 [10:37:33<17:27:06,  3.78it/s]
 36%|███▌      | 133719/371472 [10:37:33<18:58:30,  3.48it/s]
 36%|███▌      | 133720/371472 [10:37:34<18:31:11,  3.57it/s]
                                                             
{'loss': 3.2106, 'learning_rate': 6.763343317029025e-07, 'epoch': 5.76}

 36%|███▌      | 133720/371472 [10:37:34<18:31:11,  3.57it/s]
 36%|███▌      | 133721/371472 [10:37:34<18:04:43,  3.65it/s]
 36%|███▌      | 133722/371472 [10:37:34<17:40:08,  3.74it/s]
 36%|███▌      | 133723/371472 [10:37:34<17:31:10,  3.77it/s]
 36%|███▌      | 133724/371472 [10:37:35<18:01:43,  3.66it/s]
 36%|███▌      | 133725/371472 [10:37:35<17:40:46,  3.74it/s]
 36%|███▌      | 133726/371472 [10:37:35<17:39:28,  3.74it/s]
 36%|███▌      | 133727/371472 [10:37:36<17:27:56,  3.78it/s]
 36%|███▌      | 133728/371472 [10:37:36<17:36:10,  3.75it/s]
 36%|███▌      | 133729/371472 [10:37:36<18:38:05,  3.54it/s]
 36%|███▌      | 133730/371472 [10:37:36<18:29:15,  3.57it/s]
 36%|███▌      | 133731/371472 [10:37:37<17:57:44,  3.68it/s]
 36%|███▌      | 133732/371472 [10:37:37<18:17:37,  3.61it/s]
 36%|███▌      | 133733/371472 [10:37:37<17:36:08,  3.75it/s]
 36%|███▌      | 133734/371472 [10:37:37<17:59:12,  3.67it/s]
 36%|███▌      | 133735/371472 [10:37:38<18:42:38,  3.53it/s]
 36%|███▌      | 133736/371472 [10:37:38<19:28:05,  3.39it/s]
 36%|███▌      | 133737/371472 [10:37:38<19:22:40,  3.41it/s]
 36%|███▌      | 133738/371472 [10:37:39<20:05:07,  3.29it/s]
 36%|███▌      | 133739/371472 [10:37:39<19:24:46,  3.40it/s]
 36%|███▌      | 133740/371472 [10:37:39<19:30:47,  3.38it/s]
                                                             
{'loss': 3.2006, 'learning_rate': 6.762858497274235e-07, 'epoch': 5.76}

 36%|███▌      | 133740/371472 [10:37:39<19:30:47,  3.38it/s]
 36%|███▌      | 133741/371472 [10:37:40<20:04:06,  3.29it/s]
 36%|███▌      | 133742/371472 [10:37:40<19:10:52,  3.44it/s]
 36%|███▌      | 133743/371472 [10:37:40<20:49:03,  3.17it/s]
 36%|███▌      | 133744/371472 [10:37:41<21:05:15,  3.13it/s]
 36%|███▌      | 133745/371472 [10:37:41<19:35:25,  3.37it/s]
 36%|███▌      | 133746/371472 [10:37:41<18:55:06,  3.49it/s]
 36%|███▌      | 133747/371472 [10:37:41<18:05:47,  3.65it/s]
 36%|███▌      | 133748/371472 [10:37:42<18:13:05,  3.62it/s]
 36%|███▌      | 133749/371472 [10:37:42<18:15:17,  3.62it/s]
 36%|███▌      | 133750/371472 [10:37:42<18:19:19,  3.60it/s]
 36%|███▌      | 133751/371472 [10:37:42<19:00:23,  3.47it/s]
 36%|███▌      | 133752/371472 [10:37:43<18:12:33,  3.63it/s]
 36%|███▌      | 133753/371472 [10:37:43<17:34:44,  3.76it/s]
 36%|███▌      | 133754/371472 [10:37:43<17:32:32,  3.76it/s]
 36%|███▌      | 133755/371472 [10:37:44<17:41:15,  3.73it/s]
 36%|███▌      | 133756/371472 [10:37:44<17:22:40,  3.80it/s]
 36%|███▌      | 133757/371472 [10:37:44<17:46:48,  3.71it/s]
 36%|███▌      | 133758/371472 [10:37:44<18:19:13,  3.60it/s]
 36%|███▌      | 133759/371472 [10:37:45<17:33:49,  3.76it/s]
 36%|███▌      | 133760/371472 [10:37:45<17:39:20,  3.74it/s]
                                                             
{'loss': 3.3177, 'learning_rate': 6.762373677519446e-07, 'epoch': 5.76}

 36%|███▌      | 133760/371472 [10:37:45<17:39:20,  3.74it/s]
 36%|███▌      | 133761/371472 [10:37:45<17:55:11,  3.68it/s]
 36%|███▌      | 133762/371472 [10:37:45<19:01:48,  3.47it/s]
 36%|███▌      | 133763/371472 [10:37:46<21:16:27,  3.10it/s]
 36%|███▌      | 133764/371472 [10:37:46<19:59:53,  3.30it/s]
 36%|███▌      | 133765/371472 [10:37:46<18:55:52,  3.49it/s]
 36%|███▌      | 133766/371472 [10:37:47<19:29:07,  3.39it/s]
 36%|███▌      | 133767/371472 [10:37:47<18:19:34,  3.60it/s]
 36%|███▌      | 133768/371472 [10:37:47<19:15:44,  3.43it/s]
 36%|███▌      | 133769/371472 [10:37:48<19:49:03,  3.33it/s]
 36%|███▌      | 133770/371472 [10:37:48<19:19:19,  3.42it/s]
 36%|███▌      | 133771/371472 [10:37:48<19:51:54,  3.32it/s]
 36%|███▌      | 133772/371472 [10:37:48<19:33:56,  3.37it/s]
 36%|███▌      | 133773/371472 [10:37:49<21:38:19,  3.05it/s]
 36%|███▌      | 133774/371472 [10:37:49<20:33:47,  3.21it/s]
 36%|███▌      | 133775/371472 [10:37:49<21:16:25,  3.10it/s]
 36%|███▌      | 133776/371472 [10:37:50<21:40:18,  3.05it/s]
 36%|███▌      | 133777/371472 [10:37:50<20:46:39,  3.18it/s]
 36%|███▌      | 133778/371472 [10:37:50<20:08:19,  3.28it/s]
 36%|███▌      | 133779/371472 [10:37:51<19:07:38,  3.45it/s]
 36%|███▌      | 133780/371472 [10:37:51<18:11:30,  3.63it/s]
                                                             
{'loss': 3.1612, 'learning_rate': 6.761888857764657e-07, 'epoch': 5.76}

 36%|███▌      | 133780/371472 [10:37:51<18:11:30,  3.63it/s]
 36%|███▌      | 133781/371472 [10:37:51<19:08:26,  3.45it/s]
 36%|███▌      | 133782/371472 [10:37:51<18:23:40,  3.59it/s]
 36%|███▌      | 133783/371472 [10:37:52<19:37:20,  3.36it/s]
 36%|███▌      | 133784/371472 [10:37:52<18:42:00,  3.53it/s]
 36%|███▌      | 133785/371472 [10:37:52<18:17:14,  3.61it/s]
 36%|███▌      | 133786/371472 [10:37:53<17:54:30,  3.69it/s]
 36%|███▌      | 133787/371472 [10:37:53<17:49:25,  3.70it/s]
 36%|███▌      | 133788/371472 [10:37:53<17:31:47,  3.77it/s]
 36%|███▌      | 133789/371472 [10:37:53<17:57:42,  3.68it/s]
 36%|███▌      | 133790/371472 [10:37:54<19:19:03,  3.42it/s]
 36%|███▌      | 133791/371472 [10:37:54<18:09:30,  3.64it/s]
 36%|███▌      | 133792/371472 [10:37:54<17:44:26,  3.72it/s]
 36%|███▌      | 133793/371472 [10:37:55<20:20:12,  3.25it/s]
 36%|███▌      | 133794/371472 [10:37:55<18:58:04,  3.48it/s]
 36%|███▌      | 133795/371472 [10:37:55<18:28:36,  3.57it/s]
 36%|███▌      | 133796/371472 [10:37:55<17:44:22,  3.72it/s]
 36%|███▌      | 133797/371472 [10:37:56<17:46:32,  3.71it/s]
 36%|███▌      | 133798/371472 [10:37:56<17:18:24,  3.81it/s]
 36%|███▌      | 133799/371472 [10:37:56<17:37:15,  3.75it/s]
 36%|███▌      | 133800/371472 [10:37:56<19:11:52,  3.44it/s]
                                                             
{'loss': 3.2061, 'learning_rate': 6.761404038009868e-07, 'epoch': 5.76}

 36%|███▌      | 133800/371472 [10:37:56<19:11:52,  3.44it/s]
 36%|███▌      | 133801/371472 [10:37:57<19:06:26,  3.46it/s]
 36%|███▌      | 133802/371472 [10:37:57<18:47:24,  3.51it/s]
 36%|███▌      | 133803/371472 [10:37:57<18:08:22,  3.64it/s]
 36%|███▌      | 133804/371472 [10:37:58<17:53:13,  3.69it/s]
 36%|███▌      | 133805/371472 [10:37:58<17:17:32,  3.82it/s]
 36%|███▌      | 133806/371472 [10:37:58<17:33:09,  3.76it/s]
 36%|███▌      | 133807/371472 [10:37:58<17:25:34,  3.79it/s]
 36%|███▌      | 133808/371472 [10:37:59<16:56:44,  3.90it/s]
 36%|███▌      | 133809/371472 [10:37:59<17:33:56,  3.76it/s]
 36%|███▌      | 133810/371472 [10:37:59<17:36:07,  3.75it/s]
 36%|███▌      | 133811/371472 [10:37:59<18:37:11,  3.55it/s]
 36%|███▌      | 133812/371472 [10:38:00<19:00:06,  3.47it/s]
 36%|███▌      | 133813/371472 [10:38:00<18:33:00,  3.56it/s]
 36%|███▌      | 133814/371472 [10:38:00<19:37:16,  3.36it/s]
 36%|███▌      | 133815/371472 [10:38:01<19:28:16,  3.39it/s]
 36%|███▌      | 133816/371472 [10:38:01<18:59:05,  3.48it/s]
 36%|███▌      | 133817/371472 [10:38:01<18:23:11,  3.59it/s]
 36%|███▌      | 133818/371472 [10:38:01<18:04:34,  3.65it/s]
 36%|███▌      | 133819/371472 [10:38:02<17:32:28,  3.76it/s]
 36%|███▌      | 133820/371472 [10:38:02<17:13:48,  3.83it/s]
                                                             
{'loss': 3.2408, 'learning_rate': 6.76091921825508e-07, 'epoch': 5.76}

 36%|███▌      | 133820/371472 [10:38:02<17:13:48,  3.83it/s]
 36%|███▌      | 133821/371472 [10:38:02<17:19:37,  3.81it/s]
 36%|███▌      | 133822/371472 [10:38:02<17:48:54,  3.71it/s]
 36%|███▌      | 133823/371472 [10:38:03<17:33:31,  3.76it/s]
 36%|███▌      | 133824/371472 [10:38:03<17:18:15,  3.81it/s]
 36%|███▌      | 133825/371472 [10:38:03<17:10:38,  3.84it/s]
 36%|███▌      | 133826/371472 [10:38:04<18:35:05,  3.55it/s]
 36%|███▌      | 133827/371472 [10:38:04<18:18:23,  3.61it/s]
 36%|███▌      | 133828/371472 [10:38:04<18:05:10,  3.65it/s]
 36%|███▌      | 133829/371472 [10:38:04<18:02:51,  3.66it/s]
 36%|███▌      | 133830/371472 [10:38:05<17:25:31,  3.79it/s]
 36%|███▌      | 133831/371472 [10:38:05<17:22:06,  3.80it/s]
 36%|███▌      | 133832/371472 [10:38:05<17:37:50,  3.74it/s]
 36%|███▌      | 133833/371472 [10:38:05<17:12:01,  3.84it/s]
 36%|███▌      | 133834/371472 [10:38:06<17:04:49,  3.86it/s]
 36%|███▌      | 133835/371472 [10:38:06<17:07:50,  3.85it/s]
 36%|███▌      | 133836/371472 [10:38:06<17:14:02,  3.83it/s]
 36%|███▌      | 133837/371472 [10:38:07<18:29:23,  3.57it/s]
 36%|███▌      | 133838/371472 [10:38:07<18:29:07,  3.57it/s]
 36%|███▌      | 133839/371472 [10:38:07<18:10:14,  3.63it/s]
 36%|███▌      | 133840/371472 [10:38:07<18:40:43,  3.53it/s]
                                                             
{'loss': 3.0431, 'learning_rate': 6.760434398500291e-07, 'epoch': 5.76}

 36%|███▌      | 133840/371472 [10:38:07<18:40:43,  3.53it/s]
 36%|███▌      | 133841/371472 [10:38:08<18:57:43,  3.48it/s]
 36%|███▌      | 133842/371472 [10:38:08<18:41:51,  3.53it/s]
 36%|███▌      | 133843/371472 [10:38:08<19:15:20,  3.43it/s]
 36%|███▌      | 133844/371472 [10:38:08<18:08:40,  3.64it/s]
 36%|███▌      | 133845/371472 [10:38:09<18:13:48,  3.62it/s]
 36%|███▌      | 133846/371472 [10:38:09<19:01:45,  3.47it/s]
 36%|███▌      | 133847/371472 [10:38:09<19:51:25,  3.32it/s]
 36%|███▌      | 133848/371472 [10:38:10<19:08:59,  3.45it/s]
 36%|███▌      | 133849/371472 [10:38:10<18:56:10,  3.49it/s]
 36%|███▌      | 133850/371472 [10:38:10<18:17:47,  3.61it/s]
 36%|███▌      | 133851/371472 [10:38:10<18:16:26,  3.61it/s]
 36%|███▌      | 133852/371472 [10:38:11<17:36:11,  3.75it/s]
 36%|███▌      | 133853/371472 [10:38:11<17:13:28,  3.83it/s]
 36%|███▌      | 133854/371472 [10:38:11<16:59:36,  3.88it/s]
 36%|███▌      | 133855/371472 [10:38:11<16:58:58,  3.89it/s]
 36%|███▌      | 133856/371472 [10:38:12<16:55:12,  3.90it/s]
 36%|███▌      | 133857/371472 [10:38:12<17:29:22,  3.77it/s]
 36%|███▌      | 133858/371472 [10:38:12<18:20:42,  3.60it/s]
 36%|███▌      | 133859/371472 [10:38:13<19:37:15,  3.36it/s]
 36%|███▌      | 133860/371472 [10:38:13<21:00:22,  3.14it/s]
                                                             
{'loss': 3.1857, 'learning_rate': 6.759949578745501e-07, 'epoch': 5.77}

 36%|███▌      | 133860/371472 [10:38:13<21:00:22,  3.14it/s]
 36%|███▌      | 133861/371472 [10:38:13<19:55:07,  3.31it/s]
 36%|███▌      | 133862/371472 [10:38:14<18:41:33,  3.53it/s]
 36%|███▌      | 133863/371472 [10:38:14<18:03:05,  3.66it/s]
 36%|███▌      | 133864/371472 [10:38:14<18:24:43,  3.58it/s]
 36%|███▌      | 133865/371472 [10:38:14<18:23:16,  3.59it/s]
 36%|███▌      | 133866/371472 [10:38:15<17:52:58,  3.69it/s]
 36%|███▌      | 133867/371472 [10:38:15<17:09:19,  3.85it/s]
 36%|███▌      | 133868/371472 [10:38:15<17:05:12,  3.86it/s]
 36%|███▌      | 133869/371472 [10:38:15<17:39:20,  3.74it/s]
 36%|███▌      | 133870/371472 [10:38:16<17:13:59,  3.83it/s]
 36%|███▌      | 133871/371472 [10:38:16<17:54:31,  3.69it/s]
 36%|███▌      | 133872/371472 [10:38:16<17:36:33,  3.75it/s]
 36%|███▌      | 133873/371472 [10:38:17<18:50:40,  3.50it/s]
 36%|███▌      | 133874/371472 [10:38:17<18:45:57,  3.52it/s]
 36%|███▌      | 133875/371472 [10:38:17<18:12:12,  3.63it/s]
 36%|███▌      | 133876/371472 [10:38:17<18:08:32,  3.64it/s]
 36%|███▌      | 133877/371472 [10:38:18<17:44:21,  3.72it/s]
 36%|███▌      | 133878/371472 [10:38:18<17:17:15,  3.82it/s]
 36%|███▌      | 133879/371472 [10:38:18<17:59:23,  3.67it/s]
 36%|███▌      | 133880/371472 [10:38:18<18:18:18,  3.61it/s]
                                                             
{'loss': 3.0534, 'learning_rate': 6.759464758990712e-07, 'epoch': 5.77}

 36%|███▌      | 133880/371472 [10:38:18<18:18:18,  3.61it/s]
 36%|███▌      | 133881/371472 [10:38:19<18:59:41,  3.47it/s]
 36%|███▌      | 133882/371472 [10:38:19<19:22:12,  3.41it/s]
 36%|███▌      | 133883/371472 [10:38:19<19:20:27,  3.41it/s]
 36%|███▌      | 133884/371472 [10:38:20<20:28:44,  3.22it/s]
 36%|███▌      | 133885/371472 [10:38:20<18:57:35,  3.48it/s]
 36%|███▌      | 133886/371472 [10:38:20<19:36:25,  3.37it/s]
 36%|███▌      | 133887/371472 [10:38:21<19:23:11,  3.40it/s]
 36%|███▌      | 133888/371472 [10:38:21<18:53:11,  3.49it/s]
 36%|███▌      | 133889/371472 [10:38:21<18:43:45,  3.52it/s]
 36%|███▌      | 133890/371472 [10:38:21<19:25:51,  3.40it/s]
 36%|███▌      | 133891/371472 [10:38:22<20:21:57,  3.24it/s]
 36%|███▌      | 133892/371472 [10:38:22<20:23:23,  3.24it/s]
 36%|███▌      | 133893/371472 [10:38:22<18:59:22,  3.48it/s]
 36%|███▌      | 133894/371472 [10:38:23<18:19:14,  3.60it/s]
 36%|███▌      | 133895/371472 [10:38:23<19:19:58,  3.41it/s]
 36%|███▌      | 133896/371472 [10:38:23<19:03:09,  3.46it/s]
 36%|███▌      | 133897/371472 [10:38:23<18:11:58,  3.63it/s]
 36%|███▌      | 133898/371472 [10:38:24<20:11:15,  3.27it/s]
 36%|███▌      | 133899/371472 [10:38:24<19:31:04,  3.38it/s]
 36%|███▌      | 133900/371472 [10:38:24<18:41:10,  3.53it/s]
                                                             
{'loss': 3.2721, 'learning_rate': 6.758979939235925e-07, 'epoch': 5.77}

 36%|███▌      | 133900/371472 [10:38:24<18:41:10,  3.53it/s]
 36%|███▌      | 133901/371472 [10:38:25<18:24:22,  3.59it/s]
 36%|███▌      | 133902/371472 [10:38:25<17:40:03,  3.74it/s]
 36%|███▌      | 133903/371472 [10:38:25<17:36:08,  3.75it/s]
 36%|███▌      | 133904/371472 [10:38:25<17:59:29,  3.67it/s]
 36%|███▌      | 133905/371472 [10:38:26<18:59:58,  3.47it/s]
 36%|███▌      | 133906/371472 [10:38:26<18:17:35,  3.61it/s]
 36%|███▌      | 133907/371472 [10:38:26<17:50:13,  3.70it/s]
 36%|███▌      | 133908/371472 [10:38:26<18:45:19,  3.52it/s]
 36%|███▌      | 133909/371472 [10:38:27<18:11:32,  3.63it/s]
 36%|███▌      | 133910/371472 [10:38:27<17:34:47,  3.75it/s]
 36%|███▌      | 133911/371472 [10:38:27<16:52:52,  3.91it/s]
 36%|███▌      | 133912/371472 [10:38:28<18:42:00,  3.53it/s]
 36%|███▌      | 133913/371472 [10:38:28<18:23:49,  3.59it/s]
 36%|███▌      | 133914/371472 [10:38:28<17:55:27,  3.68it/s]
 36%|███▌      | 133915/371472 [10:38:28<17:38:50,  3.74it/s]
 36%|███▌      | 133916/371472 [10:38:29<18:02:42,  3.66it/s]
 36%|███▌      | 133917/371472 [10:38:29<18:14:04,  3.62it/s]
 36%|███▌      | 133918/371472 [10:38:29<19:18:08,  3.42it/s]
 36%|███▌      | 133919/371472 [10:38:30<18:53:32,  3.49it/s]
 36%|███▌      | 133920/371472 [10:38:30<17:59:42,  3.67it/s]
                                                             
{'loss': 3.2464, 'learning_rate': 6.758495119481135e-07, 'epoch': 5.77}

 36%|███▌      | 133920/371472 [10:38:30<17:59:42,  3.67it/s]
 36%|███▌      | 133921/371472 [10:38:30<17:44:15,  3.72it/s]
 36%|███▌      | 133922/371472 [10:38:30<17:40:57,  3.73it/s]
 36%|███▌      | 133923/371472 [10:38:31<18:17:20,  3.61it/s]
 36%|███▌      | 133924/371472 [10:38:31<18:18:41,  3.60it/s]
 36%|███▌      | 133925/371472 [10:38:31<17:55:21,  3.68it/s]
 36%|███▌      | 133926/371472 [10:38:31<17:33:37,  3.76it/s]
 36%|███▌      | 133927/371472 [10:38:32<17:19:59,  3.81it/s]
 36%|███▌      | 133928/371472 [10:38:32<17:48:06,  3.71it/s]
 36%|███▌      | 133929/371472 [10:38:32<17:58:28,  3.67it/s]
 36%|███▌      | 133930/371472 [10:38:33<18:53:38,  3.49it/s]
 36%|███▌      | 133931/371472 [10:38:33<18:39:12,  3.54it/s]
 36%|███▌      | 133932/371472 [10:38:33<18:36:31,  3.55it/s]
 36%|███▌      | 133933/371472 [10:38:33<17:58:29,  3.67it/s]
 36%|███▌      | 133934/371472 [10:38:34<19:16:39,  3.42it/s]
 36%|███▌      | 133935/371472 [10:38:34<19:13:55,  3.43it/s]
 36%|███▌      | 133936/371472 [10:38:34<19:19:24,  3.41it/s]
 36%|███▌      | 133937/371472 [10:38:35<20:18:57,  3.25it/s]
 36%|███▌      | 133938/371472 [10:38:35<20:18:01,  3.25it/s]
 36%|███▌      | 133939/371472 [10:38:35<19:34:43,  3.37it/s]
 36%|███▌      | 133940/371472 [10:38:35<18:47:11,  3.51it/s]
                                                             
{'loss': 3.0732, 'learning_rate': 6.758010299726346e-07, 'epoch': 5.77}

 36%|███▌      | 133940/371472 [10:38:35<18:47:11,  3.51it/s]
 36%|███▌      | 133941/371472 [10:38:36<19:42:05,  3.35it/s]
 36%|███▌      | 133942/371472 [10:38:36<19:06:34,  3.45it/s]
 36%|███▌      | 133943/371472 [10:38:36<20:06:02,  3.28it/s]
 36%|███▌      | 133944/371472 [10:38:37<19:41:07,  3.35it/s]
 36%|███▌      | 133945/371472 [10:38:37<19:08:52,  3.45it/s]
 36%|███▌      | 133946/371472 [10:38:37<19:10:51,  3.44it/s]
 36%|███▌      | 133947/371472 [10:38:37<19:26:26,  3.39it/s]
 36%|███▌      | 133948/371472 [10:38:38<19:01:47,  3.47it/s]
 36%|███▌      | 133949/371472 [10:38:38<19:06:40,  3.45it/s]
 36%|███▌      | 133950/371472 [10:38:38<19:08:50,  3.45it/s]
 36%|███▌      | 133951/371472 [10:38:39<18:27:16,  3.58it/s]
 36%|███▌      | 133952/371472 [10:38:39<18:26:58,  3.58it/s]
 36%|███▌      | 133953/371472 [10:38:39<18:21:18,  3.59it/s]
 36%|███▌      | 133954/371472 [10:38:39<18:40:26,  3.53it/s]
 36%|███▌      | 133955/371472 [10:38:40<18:15:17,  3.61it/s]
 36%|███▌      | 133956/371472 [10:38:40<18:43:34,  3.52it/s]
 36%|███▌      | 133957/371472 [10:38:40<18:13:31,  3.62it/s]
 36%|███▌      | 133958/371472 [10:38:41<18:15:53,  3.61it/s]
 36%|███▌      | 133959/371472 [10:38:41<19:19:31,  3.41it/s]
 36%|███▌      | 133960/371472 [10:38:41<19:43:16,  3.35it/s]
                                                             
{'loss': 3.1995, 'learning_rate': 6.757525479971557e-07, 'epoch': 5.77}

 36%|███▌      | 133960/371472 [10:38:41<19:43:16,  3.35it/s]
 36%|███▌      | 133961/371472 [10:38:41<19:11:52,  3.44it/s]
 36%|███▌      | 133962/371472 [10:38:42<18:40:08,  3.53it/s]
 36%|███▌      | 133963/371472 [10:38:42<19:01:07,  3.47it/s]
 36%|███▌      | 133964/371472 [10:38:42<18:50:01,  3.50it/s]
 36%|███▌      | 133965/371472 [10:38:43<18:17:40,  3.61it/s]
 36%|███▌      | 133966/371472 [10:38:43<18:09:58,  3.63it/s]
 36%|███▌      | 133967/371472 [10:38:43<17:40:28,  3.73it/s]
 36%|███▌      | 133968/371472 [10:38:43<17:25:33,  3.79it/s]
 36%|███▌      | 133969/371472 [10:38:44<17:16:02,  3.82it/s]
 36%|███▌      | 133970/371472 [10:38:44<20:16:15,  3.25it/s]
 36%|███▌      | 133971/371472 [10:38:44<19:25:01,  3.40it/s]
 36%|███▌      | 133972/371472 [10:38:45<19:09:46,  3.44it/s]
 36%|███▌      | 133973/371472 [10:38:45<18:20:23,  3.60it/s]
 36%|███▌      | 133974/371472 [10:38:45<19:41:03,  3.35it/s]
 36%|███▌      | 133975/371472 [10:38:45<20:00:32,  3.30it/s]
 36%|███▌      | 133976/371472 [10:38:46<19:16:01,  3.42it/s]
 36%|███▌      | 133977/371472 [10:38:46<19:19:57,  3.41it/s]
 36%|███▌      | 133978/371472 [10:38:46<18:57:20,  3.48it/s]
 36%|███▌      | 133979/371472 [10:38:47<18:13:23,  3.62it/s]
 36%|███▌      | 133980/371472 [10:38:47<17:53:08,  3.69it/s]
                                                             
{'loss': 3.104, 'learning_rate': 6.757040660216768e-07, 'epoch': 5.77}

 36%|███▌      | 133980/371472 [10:38:47<17:53:08,  3.69it/s]
 36%|███▌      | 133981/371472 [10:38:47<17:53:54,  3.69it/s]
 36%|███▌      | 133982/371472 [10:38:47<17:18:31,  3.81it/s]
 36%|███▌      | 133983/371472 [10:38:48<17:00:18,  3.88it/s]
 36%|███▌      | 133984/371472 [10:38:48<16:53:48,  3.90it/s]
 36%|███▌      | 133985/371472 [10:38:48<18:35:25,  3.55it/s]
 36%|███▌      | 133986/371472 [10:38:48<18:09:59,  3.63it/s]
 36%|███▌      | 133987/371472 [10:38:49<18:40:44,  3.53it/s]
 36%|███▌      | 133988/371472 [10:38:49<18:52:28,  3.50it/s]
 36%|███▌      | 133989/371472 [10:38:49<17:48:37,  3.70it/s]
 36%|███▌      | 133990/371472 [10:38:50<18:26:26,  3.58it/s]
 36%|███▌      | 133991/371472 [10:38:50<18:03:16,  3.65it/s]
 36%|███▌      | 133992/371472 [10:38:50<18:39:39,  3.54it/s]
 36%|███▌      | 133993/371472 [10:38:50<18:31:48,  3.56it/s]
 36%|███▌      | 133994/371472 [10:38:51<18:37:04,  3.54it/s]
 36%|███▌      | 133995/371472 [10:38:51<17:52:19,  3.69it/s]
 36%|███▌      | 133996/371472 [10:38:51<17:16:15,  3.82it/s]
 36%|███▌      | 133997/371472 [10:38:51<16:53:43,  3.90it/s]
 36%|███▌      | 133998/371472 [10:38:52<18:01:23,  3.66it/s]
 36%|███▌      | 133999/371472 [10:38:52<18:24:04,  3.58it/s]
 36%|███▌      | 134000/371472 [10:38:52<19:09:37,  3.44it/s]
                                                             
{'loss': 3.1425, 'learning_rate': 6.756555840461979e-07, 'epoch': 5.77}

 36%|███▌      | 134000/371472 [10:38:52<19:09:37,  3.44it/s]
 36%|███▌      | 134001/371472 [10:38:53<18:18:14,  3.60it/s]
 36%|███▌      | 134002/371472 [10:38:53<18:11:00,  3.63it/s]
 36%|███▌      | 134003/371472 [10:38:53<18:40:30,  3.53it/s]
 36%|███▌      | 134004/371472 [10:38:53<18:25:47,  3.58it/s]
 36%|███▌      | 134005/371472 [10:38:54<17:51:08,  3.69it/s]
 36%|███▌      | 134006/371472 [10:38:54<17:27:43,  3.78it/s]
 36%|███▌      | 134007/371472 [10:38:54<16:54:09,  3.90it/s]
 36%|███▌      | 134008/371472 [10:38:54<16:45:46,  3.93it/s]
 36%|███▌      | 134009/371472 [10:38:55<18:00:34,  3.66it/s]
 36%|███▌      | 134010/371472 [10:38:55<19:35:44,  3.37it/s]
 36%|███▌      | 134011/371472 [10:38:55<19:47:34,  3.33it/s]
 36%|███▌      | 134012/371472 [10:38:56<18:52:09,  3.50it/s]
 36%|███▌      | 134013/371472 [10:38:56<18:36:13,  3.55it/s]
 36%|███▌      | 134014/371472 [10:38:56<17:58:39,  3.67it/s]
 36%|███▌      | 134015/371472 [10:38:56<17:38:07,  3.74it/s]
 36%|███▌      | 134016/371472 [10:38:57<17:48:34,  3.70it/s]
 36%|███▌      | 134017/371472 [10:38:57<17:26:19,  3.78it/s]
 36%|███▌      | 134018/371472 [10:38:57<17:07:26,  3.85it/s]
 36%|███▌      | 134019/371472 [10:38:58<19:29:53,  3.38it/s]
 36%|███▌      | 134020/371472 [10:38:58<18:37:14,  3.54it/s]
                                                             
{'loss': 3.1767, 'learning_rate': 6.75607102070719e-07, 'epoch': 5.77}

 36%|███▌      | 134020/371472 [10:38:58<18:37:14,  3.54it/s]
 36%|███▌      | 134021/371472 [10:38:58<18:43:59,  3.52it/s]
 36%|███▌      | 134022/371472 [10:38:58<18:52:25,  3.49it/s]
 36%|███▌      | 134023/371472 [10:38:59<17:58:20,  3.67it/s]
 36%|███▌      | 134024/371472 [10:38:59<18:43:09,  3.52it/s]
 36%|███▌      | 134025/371472 [10:38:59<18:01:14,  3.66it/s]
 36%|███▌      | 134026/371472 [10:39:00<18:26:44,  3.58it/s]
 36%|███▌      | 134027/371472 [10:39:00<19:02:17,  3.46it/s]
 36%|███▌      | 134028/371472 [10:39:00<18:52:44,  3.49it/s]
 36%|███▌      | 134029/371472 [10:39:00<18:24:34,  3.58it/s]
 36%|███▌      | 134030/371472 [10:39:01<18:27:15,  3.57it/s]
 36%|███▌      | 134031/371472 [10:39:01<17:58:21,  3.67it/s]
 36%|███▌      | 134032/371472 [10:39:01<18:44:51,  3.52it/s]
 36%|███▌      | 134033/371472 [10:39:01<18:28:41,  3.57it/s]
 36%|███▌      | 134034/371472 [10:39:02<17:54:44,  3.68it/s]
 36%|███▌      | 134035/371472 [10:39:02<17:19:16,  3.81it/s]
 36%|███▌      | 134036/371472 [10:39:02<18:21:55,  3.59it/s]
 36%|███▌      | 134037/371472 [10:39:03<18:05:54,  3.64it/s]
 36%|███▌      | 134038/371472 [10:39:03<17:54:57,  3.68it/s]
 36%|███▌      | 134039/371472 [10:39:03<17:39:02,  3.74it/s]
 36%|███▌      | 134040/371472 [10:39:03<17:45:54,  3.71it/s]
                                                             
{'loss': 3.1568, 'learning_rate': 6.755586200952401e-07, 'epoch': 5.77}

 36%|███▌      | 134040/371472 [10:39:03<17:45:54,  3.71it/s]
 36%|███▌      | 134041/371472 [10:39:04<17:44:17,  3.72it/s]
 36%|███▌      | 134042/371472 [10:39:04<17:13:49,  3.83it/s]
 36%|███▌      | 134043/371472 [10:39:04<17:38:24,  3.74it/s]
 36%|███▌      | 134044/371472 [10:39:04<17:56:21,  3.68it/s]
 36%|███▌      | 134045/371472 [10:39:05<19:51:58,  3.32it/s]
 36%|███▌      | 134046/371472 [10:39:05<18:56:04,  3.48it/s]
 36%|███▌      | 134047/371472 [10:39:05<19:29:25,  3.38it/s]
 36%|███▌      | 134048/371472 [10:39:06<18:22:13,  3.59it/s]
 36%|███▌      | 134049/371472 [10:39:06<18:47:39,  3.51it/s]
 36%|███▌      | 134050/371472 [10:39:06<18:46:10,  3.51it/s]
 36%|███▌      | 134051/371472 [10:39:06<18:01:31,  3.66it/s]
 36%|███▌      | 134052/371472 [10:39:07<17:54:02,  3.68it/s]
 36%|███▌      | 134053/371472 [10:39:07<18:22:19,  3.59it/s]
 36%|███▌      | 134054/371472 [10:39:07<18:53:19,  3.49it/s]
 36%|███▌      | 134055/371472 [10:39:08<20:23:49,  3.23it/s]
 36%|███▌      | 134056/371472 [10:39:08<19:34:22,  3.37it/s]
 36%|███▌      | 134057/371472 [10:39:08<18:57:19,  3.48it/s]
 36%|███▌      | 134058/371472 [10:39:08<19:11:29,  3.44it/s]
 36%|███▌      | 134059/371472 [10:39:09<19:51:51,  3.32it/s]
 36%|███▌      | 134060/371472 [10:39:09<19:01:25,  3.47it/s]
                                                             
{'loss': 3.164, 'learning_rate': 6.755101381197613e-07, 'epoch': 5.77}

 36%|███▌      | 134060/371472 [10:39:09<19:01:25,  3.47it/s]
 36%|███▌      | 134061/371472 [10:39:09<19:51:50,  3.32it/s]
 36%|███▌      | 134062/371472 [10:39:10<19:16:20,  3.42it/s]
 36%|███▌      | 134063/371472 [10:39:10<18:45:23,  3.52it/s]
 36%|███▌      | 134064/371472 [10:39:10<18:42:05,  3.53it/s]
 36%|███▌      | 134065/371472 [10:39:10<18:19:04,  3.60it/s]
 36%|███▌      | 134066/371472 [10:39:11<20:11:24,  3.27it/s]
 36%|███▌      | 134067/371472 [10:39:11<20:31:22,  3.21it/s]
 36%|███▌      | 134068/371472 [10:39:11<19:42:21,  3.35it/s]
 36%|███▌      | 134069/371472 [10:39:12<19:07:22,  3.45it/s]
 36%|███▌      | 134070/371472 [10:39:12<18:36:20,  3.54it/s]
 36%|███▌      | 134071/371472 [10:39:12<19:33:54,  3.37it/s]
 36%|███▌      | 134072/371472 [10:39:13<19:03:07,  3.46it/s]
 36%|███▌      | 134073/371472 [10:39:13<20:02:47,  3.29it/s]
 36%|███▌      | 134074/371472 [10:39:13<18:59:41,  3.47it/s]
 36%|███▌      | 134075/371472 [10:39:13<18:28:21,  3.57it/s]
 36%|███▌      | 134076/371472 [10:39:14<18:43:25,  3.52it/s]
 36%|███▌      | 134077/371472 [10:39:14<18:32:21,  3.56it/s]
 36%|███▌      | 134078/371472 [10:39:14<18:44:25,  3.52it/s]
 36%|███▌      | 134079/371472 [10:39:15<17:48:18,  3.70it/s]
 36%|███▌      | 134080/371472 [10:39:15<18:06:12,  3.64it/s]
                                                             
{'loss': 3.1444, 'learning_rate': 6.754616561442823e-07, 'epoch': 5.78}

 36%|███▌      | 134080/371472 [10:39:15<18:06:12,  3.64it/s]
 36%|███▌      | 134081/371472 [10:39:15<18:23:54,  3.58it/s]
 36%|███▌      | 134082/371472 [10:39:15<18:16:47,  3.61it/s]
 36%|███▌      | 134083/371472 [10:39:16<18:49:10,  3.50it/s]
 36%|███▌      | 134084/371472 [10:39:16<19:51:48,  3.32it/s]
 36%|███▌      | 134085/371472 [10:39:16<19:13:48,  3.43it/s]
 36%|███▌      | 134086/371472 [10:39:17<18:32:41,  3.56it/s]
 36%|███▌      | 134087/371472 [10:39:17<18:31:58,  3.56it/s]
 36%|███▌      | 134088/371472 [10:39:17<19:10:50,  3.44it/s]
 36%|███▌      | 134089/371472 [10:39:17<18:23:01,  3.59it/s]
 36%|███▌      | 134090/371472 [10:39:18<18:45:19,  3.52it/s]
 36%|███▌      | 134091/371472 [10:39:18<18:06:23,  3.64it/s]
 36%|███▌      | 134092/371472 [10:39:18<18:15:13,  3.61it/s]
 36%|███▌      | 134093/371472 [10:39:18<17:22:41,  3.79it/s]
 36%|███▌      | 134094/371472 [10:39:19<17:57:21,  3.67it/s]
 36%|███▌      | 134095/371472 [10:39:19<17:39:37,  3.73it/s]
 36%|███▌      | 134096/371472 [10:39:19<18:30:52,  3.56it/s]
 36%|███▌      | 134097/371472 [10:39:20<19:01:52,  3.46it/s]
 36%|███▌      | 134098/371472 [10:39:20<19:29:55,  3.38it/s]
 36%|███▌      | 134099/371472 [10:39:20<18:33:48,  3.55it/s]
 36%|███▌      | 134100/371472 [10:39:20<18:04:29,  3.65it/s]
                                                             
{'loss': 3.2324, 'learning_rate': 6.754131741688035e-07, 'epoch': 5.78}

 36%|███▌      | 134100/371472 [10:39:20<18:04:29,  3.65it/s]
 36%|███▌      | 134101/371472 [10:39:21<18:05:13,  3.65it/s]
 36%|███▌      | 134102/371472 [10:39:21<18:16:00,  3.61it/s]
 36%|███▌      | 134103/371472 [10:39:21<17:22:50,  3.79it/s]
 36%|███▌      | 134104/371472 [10:39:22<17:15:00,  3.82it/s]
 36%|███▌      | 134105/371472 [10:39:22<17:56:40,  3.67it/s]
 36%|███▌      | 134106/371472 [10:39:22<20:45:29,  3.18it/s]
 36%|███▌      | 134107/371472 [10:39:22<19:49:15,  3.33it/s]
 36%|███▌      | 134108/371472 [10:39:23<19:15:47,  3.42it/s]
 36%|███▌      | 134109/371472 [10:39:23<18:47:01,  3.51it/s]
 36%|███▌      | 134110/371472 [10:39:23<19:48:05,  3.33it/s]
 36%|███▌      | 134111/371472 [10:39:24<18:33:59,  3.55it/s]
 36%|███▌      | 134112/371472 [10:39:24<18:45:27,  3.51it/s]
 36%|███▌      | 134113/371472 [10:39:24<18:44:35,  3.52it/s]
 36%|███▌      | 134114/371472 [10:39:25<20:17:28,  3.25it/s]
 36%|███▌      | 134115/371472 [10:39:25<19:20:29,  3.41it/s]
 36%|███▌      | 134116/371472 [10:39:25<19:06:31,  3.45it/s]
 36%|███▌      | 134117/371472 [10:39:25<17:58:04,  3.67it/s]
 36%|███▌      | 134118/371472 [10:39:26<18:12:28,  3.62it/s]
 36%|███▌      | 134119/371472 [10:39:26<18:27:02,  3.57it/s]
 36%|███▌      | 134120/371472 [10:39:26<18:32:01,  3.56it/s]
                                                             
{'loss': 3.1375, 'learning_rate': 6.753646921933245e-07, 'epoch': 5.78}

 36%|███▌      | 134120/371472 [10:39:26<18:32:01,  3.56it/s]
 36%|███▌      | 134121/371472 [10:39:26<17:45:37,  3.71it/s]
 36%|███▌      | 134122/371472 [10:39:27<17:33:15,  3.76it/s]
 36%|███▌      | 134123/371472 [10:39:27<18:31:51,  3.56it/s]
 36%|███▌      | 134124/371472 [10:39:27<17:52:48,  3.69it/s]
 36%|███▌      | 134125/371472 [10:39:28<18:17:25,  3.60it/s]
 36%|███▌      | 134126/371472 [10:39:28<18:42:38,  3.52it/s]
 36%|███▌      | 134127/371472 [10:39:28<19:02:52,  3.46it/s]
 36%|███▌      | 134128/371472 [10:39:28<19:19:30,  3.41it/s]
 36%|███▌      | 134129/371472 [10:39:29<19:50:49,  3.32it/s]
 36%|███▌      | 134130/371472 [10:39:29<19:51:08,  3.32it/s]
 36%|███▌      | 134131/371472 [10:39:29<18:58:14,  3.48it/s]
 36%|███▌      | 134132/371472 [10:39:30<18:55:40,  3.48it/s]
 36%|███▌      | 134133/371472 [10:39:30<18:48:00,  3.51it/s]
 36%|███▌      | 134134/371472 [10:39:30<19:13:45,  3.43it/s]
 36%|███▌      | 134135/371472 [10:39:30<19:00:11,  3.47it/s]
 36%|███▌      | 134136/371472 [10:39:31<19:48:48,  3.33it/s]
 36%|███▌      | 134137/371472 [10:39:31<19:06:27,  3.45it/s]
 36%|███▌      | 134138/371472 [10:39:31<18:39:43,  3.53it/s]
 36%|███▌      | 134139/371472 [10:39:32<18:00:00,  3.66it/s]
 36%|███▌      | 134140/371472 [10:39:32<17:06:31,  3.85it/s]
                                                             
{'loss': 2.9544, 'learning_rate': 6.753162102178456e-07, 'epoch': 5.78}

 36%|███▌      | 134140/371472 [10:39:32<17:06:31,  3.85it/s]
 36%|███▌      | 134141/371472 [10:39:32<17:12:51,  3.83it/s]
 36%|███▌      | 134142/371472 [10:39:32<17:04:49,  3.86it/s]
 36%|███▌      | 134143/371472 [10:39:33<16:59:32,  3.88it/s]
 36%|███▌      | 134144/371472 [10:39:33<16:53:01,  3.90it/s]
 36%|███▌      | 134145/371472 [10:39:33<18:37:12,  3.54it/s]
 36%|███▌      | 134146/371472 [10:39:33<18:13:54,  3.62it/s]
 36%|███▌      | 134147/371472 [10:39:34<18:22:38,  3.59it/s]
 36%|███▌      | 134148/371472 [10:39:34<18:15:26,  3.61it/s]
 36%|███▌      | 134149/371472 [10:39:34<18:05:34,  3.64it/s]
 36%|███▌      | 134150/371472 [10:39:35<19:01:38,  3.46it/s]
 36%|███▌      | 134151/371472 [10:39:35<20:41:16,  3.19it/s]
 36%|███▌      | 134152/371472 [10:39:35<19:59:04,  3.30it/s]
 36%|███▌      | 134153/371472 [10:39:36<20:24:06,  3.23it/s]
 36%|███▌      | 134154/371472 [10:39:36<19:25:00,  3.40it/s]
 36%|███▌      | 134155/371472 [10:39:36<18:25:50,  3.58it/s]
 36%|███▌      | 134156/371472 [10:39:36<18:14:49,  3.61it/s]
 36%|███▌      | 134157/371472 [10:39:37<18:34:57,  3.55it/s]
 36%|███▌      | 134158/371472 [10:39:37<18:38:10,  3.54it/s]
 36%|███▌      | 134159/371472 [10:39:37<18:44:00,  3.52it/s]
 36%|███▌      | 134160/371472 [10:39:37<19:07:00,  3.45it/s]
                                                             
{'loss': 3.0062, 'learning_rate': 6.752677282423667e-07, 'epoch': 5.78}

 36%|███▌      | 134160/371472 [10:39:37<19:07:00,  3.45it/s]
 36%|███▌      | 134161/371472 [10:39:38<18:30:26,  3.56it/s]
 36%|███▌      | 134162/371472 [10:39:38<18:27:56,  3.57it/s]
 36%|███▌      | 134163/371472 [10:39:38<18:55:01,  3.48it/s]
 36%|███▌      | 134164/371472 [10:39:39<18:34:57,  3.55it/s]
 36%|███▌      | 134165/371472 [10:39:39<20:16:53,  3.25it/s]
 36%|███▌      | 134166/371472 [10:39:39<19:59:20,  3.30it/s]
 36%|███▌      | 134167/371472 [10:39:40<19:24:52,  3.40it/s]
 36%|███▌      | 134168/371472 [10:39:40<18:18:53,  3.60it/s]
 36%|███▌      | 134169/371472 [10:39:40<18:09:12,  3.63it/s]
 36%|███▌      | 134170/371472 [10:39:40<18:21:08,  3.59it/s]
 36%|███▌      | 134171/371472 [10:39:41<17:55:27,  3.68it/s]
 36%|███▌      | 134172/371472 [10:39:41<17:13:23,  3.83it/s]
 36%|███▌      | 134173/371472 [10:39:41<17:40:13,  3.73it/s]
 36%|███▌      | 134174/371472 [10:39:41<17:32:19,  3.76it/s]
 36%|███▌      | 134175/371472 [10:39:42<18:06:49,  3.64it/s]
 36%|███▌      | 134176/371472 [10:39:42<17:33:23,  3.75it/s]
 36%|███▌      | 134177/371472 [10:39:42<17:28:49,  3.77it/s]
 36%|███▌      | 134178/371472 [10:39:42<17:14:12,  3.82it/s]
 36%|███▌      | 134179/371472 [10:39:43<17:18:52,  3.81it/s]
 36%|███▌      | 134180/371472 [10:39:43<19:11:27,  3.43it/s]
                                                             
{'loss': 3.0994, 'learning_rate': 6.752192462668879e-07, 'epoch': 5.78}

 36%|███▌      | 134180/371472 [10:39:43<19:11:27,  3.43it/s]
 36%|███▌      | 134181/371472 [10:39:43<18:38:36,  3.54it/s]
 36%|███▌      | 134182/371472 [10:39:44<19:24:37,  3.40it/s]
 36%|███▌      | 134183/371472 [10:39:44<20:03:18,  3.29it/s]
 36%|███▌      | 134184/371472 [10:39:44<19:08:59,  3.44it/s]
 36%|███▌      | 134185/371472 [10:39:44<18:38:05,  3.54it/s]
 36%|███▌      | 134186/371472 [10:39:45<19:07:16,  3.45it/s]
 36%|███▌      | 134187/371472 [10:39:45<20:55:54,  3.15it/s]
 36%|███▌      | 134188/371472 [10:39:45<19:59:04,  3.30it/s]
 36%|███▌      | 134189/371472 [10:39:46<19:25:37,  3.39it/s]
 36%|███▌      | 134190/371472 [10:39:46<19:11:42,  3.43it/s]
 36%|███▌      | 134191/371472 [10:39:46<18:57:23,  3.48it/s]
 36%|███▌      | 134192/371472 [10:39:47<18:52:50,  3.49it/s]
 36%|███▌      | 134193/371472 [10:39:47<18:34:27,  3.55it/s]
 36%|███▌      | 134194/371472 [10:39:47<19:15:51,  3.42it/s]
 36%|███▌      | 134195/371472 [10:39:48<20:23:30,  3.23it/s]
 36%|███▌      | 134196/371472 [10:39:48<19:19:47,  3.41it/s]
 36%|███▌      | 134197/371472 [10:39:48<19:10:27,  3.44it/s]
 36%|███▌      | 134198/371472 [10:39:48<19:17:13,  3.42it/s]
 36%|███▌      | 134199/371472 [10:39:49<18:40:48,  3.53it/s]
 36%|███▌      | 134200/371472 [10:39:49<19:14:02,  3.43it/s]
                                                             
{'loss': 3.1016, 'learning_rate': 6.75170764291409e-07, 'epoch': 5.78}

 36%|███▌      | 134200/371472 [10:39:49<19:14:02,  3.43it/s]
 36%|███▌      | 134201/371472 [10:39:49<18:48:42,  3.50it/s]
 36%|███▌      | 134202/371472 [10:39:50<19:31:46,  3.37it/s]
 36%|███▌      | 134203/371472 [10:39:50<18:51:21,  3.50it/s]
 36%|███▌      | 134204/371472 [10:39:50<18:56:58,  3.48it/s]
 36%|███▌      | 134205/371472 [10:39:50<18:38:01,  3.54it/s]
 36%|███▌      | 134206/371472 [10:39:51<18:40:46,  3.53it/s]
 36%|███▌      | 134207/371472 [10:39:51<18:21:35,  3.59it/s]
 36%|███▌      | 134208/371472 [10:39:51<17:57:21,  3.67it/s]
 36%|███▌      | 134209/371472 [10:39:51<18:56:54,  3.48it/s]
 36%|███▌      | 134210/371472 [10:39:52<18:19:10,  3.60it/s]
 36%|███▌      | 134211/371472 [10:39:52<18:41:10,  3.53it/s]
 36%|███▌      | 134212/371472 [10:39:52<18:13:39,  3.62it/s]
 36%|███▌      | 134213/371472 [10:39:53<18:26:07,  3.57it/s]
 36%|███▌      | 134214/371472 [10:39:53<18:34:48,  3.55it/s]
 36%|███▌      | 134215/371472 [10:39:53<18:36:29,  3.54it/s]
 36%|███▌      | 134216/371472 [10:39:53<18:12:35,  3.62it/s]
 36%|███▌      | 134217/371472 [10:39:54<17:55:26,  3.68it/s]
 36%|███▌      | 134218/371472 [10:39:54<17:59:15,  3.66it/s]
 36%|███▌      | 134219/371472 [10:39:54<18:34:27,  3.55it/s]
 36%|███▌      | 134220/371472 [10:39:54<17:37:02,  3.74it/s]
                                                             
{'loss': 3.2393, 'learning_rate': 6.751222823159301e-07, 'epoch': 5.78}

 36%|███▌      | 134220/371472 [10:39:54<17:37:02,  3.74it/s]
 36%|███▌      | 134221/371472 [10:39:55<17:19:29,  3.80it/s]
 36%|███▌      | 134222/371472 [10:39:55<18:23:25,  3.58it/s]
 36%|███▌      | 134223/371472 [10:39:55<17:43:20,  3.72it/s]
 36%|███▌      | 134224/371472 [10:39:56<18:05:24,  3.64it/s]
 36%|███▌      | 134225/371472 [10:39:56<17:55:48,  3.68it/s]
 36%|███▌      | 134226/371472 [10:39:56<17:48:51,  3.70it/s]
 36%|███▌      | 134227/371472 [10:39:56<17:10:35,  3.84it/s]
 36%|███▌      | 134228/371472 [10:39:57<17:27:09,  3.78it/s]
 36%|███▌      | 134229/371472 [10:39:57<17:12:36,  3.83it/s]
 36%|███▌      | 134230/371472 [10:39:57<17:03:07,  3.86it/s]
 36%|███▌      | 134231/371472 [10:39:57<18:55:56,  3.48it/s]
 36%|███▌      | 134232/371472 [10:39:58<17:58:33,  3.67it/s]
 36%|███▌      | 134233/371472 [10:39:58<17:58:13,  3.67it/s]
 36%|███▌      | 134234/371472 [10:39:58<20:47:30,  3.17it/s]
 36%|███▌      | 134235/371472 [10:39:59<22:09:01,  2.98it/s]
 36%|███▌      | 134236/371472 [10:39:59<21:25:45,  3.08it/s]
 36%|███▌      | 134237/371472 [10:39:59<19:44:22,  3.34it/s]
 36%|███▌      | 134238/371472 [10:40:00<19:04:06,  3.46it/s]
 36%|███▌      | 134239/371472 [10:40:00<19:43:25,  3.34it/s]
 36%|███▌      | 134240/371472 [10:40:00<21:12:56,  3.11it/s]
                                                             
{'loss': 3.1419, 'learning_rate': 6.750738003404511e-07, 'epoch': 5.78}

 36%|███▌      | 134240/371472 [10:40:00<21:12:56,  3.11it/s]
 36%|███▌      | 134241/371472 [10:40:01<19:51:53,  3.32it/s]
 36%|███▌      | 134242/371472 [10:40:01<20:43:55,  3.18it/s]
 36%|███▌      | 134243/371472 [10:40:01<21:09:30,  3.11it/s]
 36%|███▌      | 134244/371472 [10:40:01<19:46:55,  3.33it/s]
 36%|███▌      | 134245/371472 [10:40:02<19:05:44,  3.45it/s]
 36%|███▌      | 134246/371472 [10:40:02<18:54:40,  3.48it/s]
 36%|███▌      | 134247/371472 [10:40:02<18:58:38,  3.47it/s]
 36%|███▌      | 134248/371472 [10:40:03<18:27:41,  3.57it/s]
 36%|███▌      | 134249/371472 [10:40:03<19:24:45,  3.39it/s]
 36%|███▌      | 134250/371472 [10:40:03<19:14:37,  3.42it/s]
 36%|███▌      | 134251/371472 [10:40:03<19:22:15,  3.40it/s]
 36%|███▌      | 134252/371472 [10:40:04<21:54:50,  3.01it/s]
 36%|███▌      | 134253/371472 [10:40:04<20:57:08,  3.14it/s]
 36%|███▌      | 134254/371472 [10:40:04<20:02:02,  3.29it/s]
 36%|███▌      | 134255/371472 [10:40:05<19:26:33,  3.39it/s]
 36%|███▌      | 134256/371472 [10:40:05<19:01:12,  3.46it/s]
 36%|███▌      | 134257/371472 [10:40:05<18:56:48,  3.48it/s]
 36%|███▌      | 134258/371472 [10:40:06<22:47:47,  2.89it/s]
 36%|███▌      | 134259/371472 [10:40:06<20:51:00,  3.16it/s]
 36%|███▌      | 134260/371472 [10:40:06<21:53:10,  3.01it/s]
                                                             
{'loss': 2.9431, 'learning_rate': 6.750253183649722e-07, 'epoch': 5.78}

 36%|███▌      | 134260/371472 [10:40:06<21:53:10,  3.01it/s]
 36%|███▌      | 134261/371472 [10:40:07<21:10:54,  3.11it/s]
 36%|███▌      | 134262/371472 [10:40:07<20:20:17,  3.24it/s]
 36%|███▌      | 134263/371472 [10:40:07<20:07:43,  3.27it/s]
 36%|███▌      | 134264/371472 [10:40:08<18:51:53,  3.49it/s]
 36%|███▌      | 134265/371472 [10:40:08<18:45:08,  3.51it/s]
 36%|███▌      | 134266/371472 [10:40:08<18:02:51,  3.65it/s]
 36%|███▌      | 134267/371472 [10:40:08<17:48:47,  3.70it/s]
 36%|███▌      | 134268/371472 [10:40:09<17:53:26,  3.68it/s]
 36%|███▌      | 134269/371472 [10:40:09<20:15:05,  3.25it/s]
 36%|███▌      | 134270/371472 [10:40:09<20:45:08,  3.18it/s]
 36%|███▌      | 134271/371472 [10:40:10<20:51:57,  3.16it/s]
 36%|███▌      | 134272/371472 [10:40:10<20:16:22,  3.25it/s]
 36%|███▌      | 134273/371472 [10:40:10<20:29:40,  3.21it/s]
 36%|███▌      | 134274/371472 [10:40:10<19:26:05,  3.39it/s]
 36%|███▌      | 134275/371472 [10:40:11<18:25:40,  3.58it/s]
 36%|███▌      | 134276/371472 [10:40:11<18:41:28,  3.53it/s]
 36%|███▌      | 134277/371472 [10:40:11<19:48:29,  3.33it/s]
 36%|███▌      | 134278/371472 [10:40:12<19:09:11,  3.44it/s]
 36%|███▌      | 134279/371472 [10:40:12<19:17:05,  3.42it/s]
 36%|███▌      | 134280/371472 [10:40:12<18:14:20,  3.61it/s]
                                                             
{'loss': 3.0403, 'learning_rate': 6.749768363894934e-07, 'epoch': 5.78}

 36%|███▌      | 134280/371472 [10:40:12<18:14:20,  3.61it/s]
 36%|███▌      | 134281/371472 [10:40:12<18:22:28,  3.59it/s]
 36%|███▌      | 134282/371472 [10:40:13<18:13:15,  3.62it/s]
 36%|███▌      | 134283/371472 [10:40:13<17:40:08,  3.73it/s]
 36%|███▌      | 134284/371472 [10:40:13<18:09:43,  3.63it/s]
 36%|███▌      | 134285/371472 [10:40:14<17:31:09,  3.76it/s]
 36%|███▌      | 134286/371472 [10:40:14<18:08:08,  3.63it/s]
 36%|███▌      | 134287/371472 [10:40:14<19:04:57,  3.45it/s]
 36%|███▌      | 134288/371472 [10:40:14<18:55:21,  3.48it/s]
 36%|███▌      | 134289/371472 [10:40:15<18:16:02,  3.61it/s]
 36%|███▌      | 134290/371472 [10:40:15<19:08:38,  3.44it/s]
 36%|███▌      | 134291/371472 [10:40:15<18:22:21,  3.59it/s]
 36%|███▌      | 134292/371472 [10:40:16<18:35:18,  3.54it/s]
 36%|███▌      | 134293/371472 [10:40:16<18:15:48,  3.61it/s]
 36%|███▌      | 134294/371472 [10:40:16<18:38:40,  3.53it/s]
 36%|███▌      | 134295/371472 [10:40:16<18:25:57,  3.57it/s]
 36%|███▌      | 134296/371472 [10:40:17<19:11:02,  3.43it/s]
 36%|███▌      | 134297/371472 [10:40:17<18:27:04,  3.57it/s]
 36%|███▌      | 134298/371472 [10:40:17<18:24:10,  3.58it/s]
 36%|███▌      | 134299/371472 [10:40:18<18:47:27,  3.51it/s]
 36%|███▌      | 134300/371472 [10:40:18<18:39:32,  3.53it/s]
                                                             
{'loss': 3.2636, 'learning_rate': 6.749283544140145e-07, 'epoch': 5.78}

 36%|███▌      | 134300/371472 [10:40:18<18:39:32,  3.53it/s]
 36%|███▌      | 134301/371472 [10:40:18<17:46:40,  3.71it/s]
 36%|███▌      | 134302/371472 [10:40:18<20:13:40,  3.26it/s]
 36%|███▌      | 134303/371472 [10:40:19<19:20:52,  3.41it/s]
 36%|███▌      | 134304/371472 [10:40:19<18:30:53,  3.56it/s]
 36%|███▌      | 134305/371472 [10:40:19<18:36:37,  3.54it/s]
 36%|███▌      | 134306/371472 [10:40:19<18:01:05,  3.66it/s]
 36%|███▌      | 134307/371472 [10:40:20<17:19:35,  3.80it/s]
 36%|███▌      | 134308/371472 [10:40:20<17:41:20,  3.72it/s]
 36%|███▌      | 134309/371472 [10:40:20<17:30:02,  3.76it/s]
 36%|███▌      | 134310/371472 [10:40:20<17:10:30,  3.84it/s]
 36%|███▌      | 134311/371472 [10:40:21<17:01:31,  3.87it/s]
 36%|███▌      | 134312/371472 [10:40:21<18:09:25,  3.63it/s]
 36%|███▌      | 134313/371472 [10:40:21<17:51:21,  3.69it/s]
 36%|███▌      | 134314/371472 [10:40:22<18:42:10,  3.52it/s]
 36%|███▌      | 134315/371472 [10:40:22<19:13:25,  3.43it/s]
 36%|███▌      | 134316/371472 [10:40:23<25:53:11,  2.54it/s]
 36%|███▌      | 134317/371472 [10:40:23<22:38:23,  2.91it/s]
 36%|███▌      | 134318/371472 [10:40:23<20:24:31,  3.23it/s]
 36%|███▌      | 134319/371472 [10:40:23<19:07:32,  3.44it/s]
 36%|███▌      | 134320/371472 [10:40:24<18:42:46,  3.52it/s]
                                                             
{'loss': 3.1755, 'learning_rate': 6.748798724385356e-07, 'epoch': 5.79}

 36%|███▌      | 134320/371472 [10:40:24<18:42:46,  3.52it/s]
 36%|███▌      | 134321/371472 [10:40:24<18:10:44,  3.62it/s]
 36%|███▌      | 134322/371472 [10:40:24<19:10:19,  3.44it/s]
 36%|███▌      | 134323/371472 [10:40:24<18:40:39,  3.53it/s]
 36%|███▌      | 134324/371472 [10:40:25<19:55:28,  3.31it/s]
 36%|███▌      | 134325/371472 [10:40:25<19:07:59,  3.44it/s]
 36%|███▌      | 134326/371472 [10:40:25<18:33:59,  3.55it/s]
 36%|███▌      | 134327/371472 [10:40:26<18:29:36,  3.56it/s]
 36%|███▌      | 134328/371472 [10:40:26<18:02:38,  3.65it/s]
 36%|███▌      | 134329/371472 [10:40:26<17:51:32,  3.69it/s]
 36%|███▌      | 134330/371472 [10:40:26<17:28:11,  3.77it/s]
 36%|███▌      | 134331/371472 [10:40:27<17:18:34,  3.81it/s]
 36%|███▌      | 134332/371472 [10:40:27<19:40:05,  3.35it/s]
 36%|███▌      | 134333/371472 [10:40:27<19:16:09,  3.42it/s]
 36%|███▌      | 134334/371472 [10:40:27<18:21:29,  3.59it/s]
 36%|███▌      | 134335/371472 [10:40:28<19:02:39,  3.46it/s]
 36%|███▌      | 134336/371472 [10:40:28<19:43:57,  3.34it/s]
 36%|███▌      | 134337/371472 [10:40:28<20:23:38,  3.23it/s]
 36%|███▌      | 134338/371472 [10:40:29<20:00:25,  3.29it/s]
 36%|███▌      | 134339/371472 [10:40:29<19:52:54,  3.31it/s]
 36%|███▌      | 134340/371472 [10:40:29<19:01:38,  3.46it/s]
                                                             
{'loss': 2.9281, 'learning_rate': 6.748313904630567e-07, 'epoch': 5.79}

 36%|███▌      | 134340/371472 [10:40:29<19:01:38,  3.46it/s]
 36%|███▌      | 134341/371472 [10:40:30<18:34:25,  3.55it/s]
 36%|███▌      | 134342/371472 [10:40:30<19:14:57,  3.42it/s]
 36%|███▌      | 134343/371472 [10:40:30<18:26:45,  3.57it/s]
 36%|███▌      | 134344/371472 [10:40:30<17:49:31,  3.70it/s]
 36%|███▌      | 134345/371472 [10:40:31<18:02:58,  3.65it/s]
 36%|███▌      | 134346/371472 [10:40:31<17:42:18,  3.72it/s]
 36%|███▌      | 134347/371472 [10:40:31<17:51:23,  3.69it/s]
 36%|███▌      | 134348/371472 [10:40:32<18:26:15,  3.57it/s]
 36%|███▌      | 134349/371472 [10:40:32<18:49:22,  3.50it/s]
 36%|███▌      | 134350/371472 [10:40:32<20:39:44,  3.19it/s]
 36%|███▌      | 134351/371472 [10:40:32<19:53:09,  3.31it/s]
 36%|███▌      | 134352/371472 [10:40:33<21:16:13,  3.10it/s]
 36%|███▌      | 134353/371472 [10:40:33<20:21:19,  3.24it/s]
 36%|███▌      | 134354/371472 [10:40:33<19:05:01,  3.45it/s]
 36%|███▌      | 134355/371472 [10:40:34<18:18:28,  3.60it/s]
 36%|███▌      | 134356/371472 [10:40:34<18:03:39,  3.65it/s]
 36%|███▌      | 134357/371472 [10:40:34<18:25:10,  3.58it/s]
 36%|███▌      | 134358/371472 [10:40:34<18:56:11,  3.48it/s]
 36%|███▌      | 134359/371472 [10:40:35<19:11:56,  3.43it/s]
 36%|███▌      | 134360/371472 [10:40:35<18:44:46,  3.51it/s]
                                                             
{'loss': 3.0516, 'learning_rate': 6.747829084875778e-07, 'epoch': 5.79}

 36%|███▌      | 134360/371472 [10:40:35<18:44:46,  3.51it/s]
 36%|███▌      | 134361/371472 [10:40:35<18:39:18,  3.53it/s]
 36%|███▌      | 134362/371472 [10:40:36<19:00:07,  3.47it/s]
 36%|███▌      | 134363/371472 [10:40:36<19:02:20,  3.46it/s]
 36%|███▌      | 134364/371472 [10:40:36<18:59:48,  3.47it/s]
 36%|███▌      | 134365/371472 [10:40:37<20:02:56,  3.29it/s]
 36%|███▌      | 134366/371472 [10:40:37<19:49:08,  3.32it/s]
 36%|███▌      | 134367/371472 [10:40:37<20:17:04,  3.25it/s]
 36%|███▌      | 134368/371472 [10:40:38<21:57:59,  3.00it/s]
 36%|███▌      | 134369/371472 [10:40:38<20:02:16,  3.29it/s]
 36%|███▌      | 134370/371472 [10:40:38<20:43:48,  3.18it/s]
 36%|███▌      | 134371/371472 [10:40:38<20:42:51,  3.18it/s]
 36%|███▌      | 134372/371472 [10:40:39<20:24:54,  3.23it/s]
 36%|███▌      | 134373/371472 [10:40:39<20:25:15,  3.23it/s]
 36%|███▌      | 134374/371472 [10:40:39<20:55:42,  3.15it/s]
 36%|███▌      | 134375/371472 [10:40:40<21:26:29,  3.07it/s]
 36%|███▌      | 134376/371472 [10:40:40<22:13:56,  2.96it/s]
 36%|███▌      | 134377/371472 [10:40:40<20:13:48,  3.26it/s]
 36%|███▌      | 134378/371472 [10:40:41<19:15:01,  3.42it/s]
 36%|███▌      | 134379/371472 [10:40:41<19:08:40,  3.44it/s]
 36%|███▌      | 134380/371472 [10:40:41<20:57:03,  3.14it/s]
                                                             
{'loss': 3.0372, 'learning_rate': 6.747344265120989e-07, 'epoch': 5.79}

 36%|███▌      | 134380/371472 [10:40:41<20:57:03,  3.14it/s]
 36%|███▌      | 134381/371472 [10:40:42<19:45:33,  3.33it/s]
 36%|███▌      | 134382/371472 [10:40:42<19:36:46,  3.36it/s]
 36%|███▌      | 134383/371472 [10:40:42<19:02:17,  3.46it/s]
 36%|███▌      | 134384/371472 [10:40:42<18:12:16,  3.62it/s]
 36%|███▌      | 134385/371472 [10:40:43<17:24:19,  3.78it/s]
 36%|███▌      | 134386/371472 [10:40:43<19:00:33,  3.46it/s]
 36%|███▌      | 134387/371472 [10:40:43<18:45:43,  3.51it/s]
 36%|███▌      | 134388/371472 [10:40:43<18:51:54,  3.49it/s]
 36%|███▌      | 134389/371472 [10:40:44<19:41:08,  3.35it/s]
 36%|███▌      | 134390/371472 [10:40:44<18:59:35,  3.47it/s]
 36%|███▌      | 134391/371472 [10:40:44<18:08:09,  3.63it/s]
 36%|███▌      | 134392/371472 [10:40:45<17:39:23,  3.73it/s]
 36%|███▌      | 134393/371472 [10:40:45<17:23:21,  3.79it/s]
 36%|███▌      | 134394/371472 [10:40:45<17:10:45,  3.83it/s]
 36%|███▌      | 134395/371472 [10:40:45<17:12:52,  3.83it/s]
 36%|███▌      | 134396/371472 [10:40:46<17:16:34,  3.81it/s]
 36%|███▌      | 134397/371472 [10:40:46<17:09:09,  3.84it/s]
 36%|███▌      | 134398/371472 [10:40:46<16:54:27,  3.89it/s]
 36%|███▌      | 134399/371472 [10:40:46<16:55:20,  3.89it/s]
 36%|███▌      | 134400/371472 [10:40:47<16:45:05,  3.93it/s]
                                                             
{'loss': 3.1118, 'learning_rate': 6.7468594453662e-07, 'epoch': 5.79}

 36%|███▌      | 134400/371472 [10:40:47<16:45:05,  3.93it/s]
 36%|███▌      | 134401/371472 [10:40:47<16:34:18,  3.97it/s]
 36%|███▌      | 134402/371472 [10:40:47<18:20:23,  3.59it/s]
 36%|███▌      | 134403/371472 [10:40:47<18:06:56,  3.64it/s]
 36%|███▌      | 134404/371472 [10:40:48<19:27:12,  3.39it/s]
 36%|███▌      | 134405/371472 [10:40:48<19:27:57,  3.38it/s]
 36%|███▌      | 134406/371472 [10:40:48<20:15:01,  3.25it/s]
 36%|███▌      | 134407/371472 [10:40:49<19:03:43,  3.45it/s]
 36%|███▌      | 134408/371472 [10:40:49<18:38:47,  3.53it/s]
 36%|███▌      | 134409/371472 [10:40:49<17:35:14,  3.74it/s]
 36%|███▌      | 134410/371472 [10:40:49<18:39:41,  3.53it/s]
 36%|███▌      | 134411/371472 [10:40:50<19:22:56,  3.40it/s]
 36%|███▌      | 134412/371472 [10:40:50<18:59:48,  3.47it/s]
 36%|███▌      | 134413/371472 [10:40:50<18:06:40,  3.64it/s]
 36%|███▌      | 134414/371472 [10:40:51<17:49:25,  3.69it/s]
 36%|███▌      | 134415/371472 [10:40:51<17:58:43,  3.66it/s]
 36%|███▌      | 134416/371472 [10:40:51<19:43:46,  3.34it/s]
 36%|███▌      | 134417/371472 [10:40:51<18:45:55,  3.51it/s]
 36%|███▌      | 134418/371472 [10:40:52<19:01:22,  3.46it/s]
 36%|███▌      | 134419/371472 [10:40:52<18:52:50,  3.49it/s]
 36%|███▌      | 134420/371472 [10:40:52<18:24:30,  3.58it/s]
                                                             
{'loss': 3.2026, 'learning_rate': 6.746374625611411e-07, 'epoch': 5.79}

 36%|███▌      | 134420/371472 [10:40:52<18:24:30,  3.58it/s]
 36%|███▌      | 134421/371472 [10:40:53<19:44:53,  3.33it/s]
 36%|███▌      | 134422/371472 [10:40:53<18:42:27,  3.52it/s]
 36%|███▌      | 134423/371472 [10:40:53<17:52:48,  3.68it/s]
 36%|███▌      | 134424/371472 [10:40:53<18:18:10,  3.60it/s]
 36%|███▌      | 134425/371472 [10:40:54<17:57:02,  3.67it/s]
 36%|███▌      | 134426/371472 [10:40:54<18:00:28,  3.66it/s]
 36%|███▌      | 134427/371472 [10:40:54<17:15:29,  3.82it/s]
 36%|███▌      | 134428/371472 [10:40:54<16:59:39,  3.87it/s]
 36%|███▌      | 134429/371472 [10:40:55<16:35:11,  3.97it/s]
 36%|███▌      | 134430/371472 [10:40:55<16:20:41,  4.03it/s]
 36%|███▌      | 134431/371472 [10:40:55<16:54:13,  3.90it/s]
 36%|███▌      | 134432/371472 [10:40:56<17:21:03,  3.79it/s]
 36%|███▌      | 134433/371472 [10:40:56<17:50:46,  3.69it/s]
 36%|███▌      | 134434/371472 [10:40:56<18:08:44,  3.63it/s]
 36%|███▌      | 134435/371472 [10:40:56<18:34:43,  3.54it/s]
 36%|███▌      | 134436/371472 [10:40:57<18:39:32,  3.53it/s]
 36%|███▌      | 134437/371472 [10:40:57<18:22:59,  3.58it/s]
 36%|███▌      | 134438/371472 [10:40:57<18:45:02,  3.51it/s]
 36%|███▌      | 134439/371472 [10:40:58<18:57:43,  3.47it/s]
 36%|███▌      | 134440/371472 [10:40:58<19:52:21,  3.31it/s]
                                                             
{'loss': 3.0647, 'learning_rate': 6.745889805856623e-07, 'epoch': 5.79}

 36%|███▌      | 134440/371472 [10:40:58<19:52:21,  3.31it/s]
 36%|███▌      | 134441/371472 [10:40:58<19:51:38,  3.32it/s]
 36%|███▌      | 134442/371472 [10:40:58<19:22:26,  3.40it/s]
 36%|███▌      | 134443/371472 [10:40:59<19:06:39,  3.45it/s]
 36%|███▌      | 134444/371472 [10:40:59<18:51:01,  3.49it/s]
 36%|███▌      | 134445/371472 [10:40:59<18:30:57,  3.56it/s]
 36%|███▌      | 134446/371472 [10:41:00<18:00:24,  3.66it/s]
 36%|███▌      | 134447/371472 [10:41:00<18:00:00,  3.66it/s]
 36%|███▌      | 134448/371472 [10:41:00<17:31:03,  3.76it/s]
 36%|███▌      | 134449/371472 [10:41:00<17:34:30,  3.75it/s]
 36%|███▌      | 134450/371472 [10:41:01<18:45:01,  3.51it/s]
 36%|███▌      | 134451/371472 [10:41:01<18:59:42,  3.47it/s]
 36%|███▌      | 134452/371472 [10:41:01<18:31:39,  3.55it/s]
 36%|███▌      | 134453/371472 [10:41:02<18:57:43,  3.47it/s]
 36%|███▌      | 134454/371472 [10:41:02<18:21:21,  3.59it/s]
 36%|███▌      | 134455/371472 [10:41:02<18:16:49,  3.60it/s]
 36%|███▌      | 134456/371472 [10:41:02<18:29:17,  3.56it/s]
 36%|███▌      | 134457/371472 [10:41:03<18:34:02,  3.55it/s]
 36%|███▌      | 134458/371472 [10:41:03<17:48:30,  3.70it/s]
 36%|███▌      | 134459/371472 [10:41:03<17:35:53,  3.74it/s]
 36%|███▌      | 134460/371472 [10:41:03<17:07:22,  3.84it/s]
                                                             
{'loss': 3.3857, 'learning_rate': 6.745404986101834e-07, 'epoch': 5.79}

 36%|███▌      | 134460/371472 [10:41:03<17:07:22,  3.84it/s]
 36%|███▌      | 134461/371472 [10:41:04<18:33:57,  3.55it/s]
 36%|███▌      | 134462/371472 [10:41:04<17:58:28,  3.66it/s]
 36%|███▌      | 134463/371472 [10:41:04<18:21:32,  3.59it/s]
 36%|███▌      | 134464/371472 [10:41:05<18:03:10,  3.65it/s]
 36%|███▌      | 134465/371472 [10:41:05<18:17:22,  3.60it/s]
 36%|███▌      | 134466/371472 [10:41:05<18:04:59,  3.64it/s]
 36%|███▌      | 134467/371472 [10:41:05<17:48:56,  3.70it/s]
 36%|███▌      | 134468/371472 [10:41:06<17:44:03,  3.71it/s]
 36%|███▌      | 134469/371472 [10:41:06<18:24:37,  3.58it/s]
 36%|███▌      | 134470/371472 [10:41:06<17:55:40,  3.67it/s]
 36%|███▌      | 134471/371472 [10:41:06<17:29:09,  3.76it/s]
 36%|███▌      | 134472/371472 [10:41:07<17:48:00,  3.70it/s]
 36%|███▌      | 134473/371472 [10:41:07<17:56:33,  3.67it/s]
 36%|███▌      | 134474/371472 [10:41:07<17:54:25,  3.68it/s]
 36%|███▌      | 134475/371472 [10:41:08<18:34:49,  3.54it/s]
 36%|███▌      | 134476/371472 [10:41:08<17:35:35,  3.74it/s]
 36%|███▌      | 134477/371472 [10:41:08<18:02:00,  3.65it/s]
 36%|███▌      | 134478/371472 [10:41:08<18:29:08,  3.56it/s]
 36%|███▌      | 134479/371472 [10:41:09<18:00:52,  3.65it/s]
 36%|███▌      | 134480/371472 [10:41:09<19:17:57,  3.41it/s]
                                                             
{'loss': 3.2017, 'learning_rate': 6.744920166347045e-07, 'epoch': 5.79}

 36%|███▌      | 134480/371472 [10:41:09<19:17:57,  3.41it/s]
 36%|███▌      | 134481/371472 [10:41:09<18:25:05,  3.57it/s]
 36%|███▌      | 134482/371472 [10:41:09<17:56:04,  3.67it/s]
 36%|███▌      | 134483/371472 [10:41:10<18:49:15,  3.50it/s]
 36%|███▌      | 134484/371472 [10:41:10<17:59:53,  3.66it/s]
 36%|███▌      | 134485/371472 [10:41:10<18:47:40,  3.50it/s]
 36%|███▌      | 134486/371472 [10:41:11<18:44:48,  3.51it/s]
 36%|███▌      | 134487/371472 [10:41:11<19:40:46,  3.35it/s]
 36%|███▌      | 134488/371472 [10:41:11<18:30:53,  3.56it/s]
 36%|███▌      | 134489/371472 [10:41:11<19:19:17,  3.41it/s]
 36%|███▌      | 134490/371472 [10:41:12<18:36:33,  3.54it/s]
 36%|███▌      | 134491/371472 [10:41:12<20:36:11,  3.20it/s]
 36%|███▌      | 134492/371472 [10:41:12<20:01:37,  3.29it/s]
 36%|███▌      | 134493/371472 [10:41:13<19:13:58,  3.42it/s]
 36%|███▌      | 134494/371472 [10:41:13<18:19:57,  3.59it/s]
 36%|███▌      | 134495/371472 [10:41:13<18:18:25,  3.60it/s]
 36%|███▌      | 134496/371472 [10:41:13<17:54:37,  3.68it/s]
 36%|███▌      | 134497/371472 [10:41:14<19:14:21,  3.42it/s]
 36%|███▌      | 134498/371472 [10:41:14<18:53:22,  3.48it/s]
 36%|███▌      | 134499/371472 [10:41:14<17:58:27,  3.66it/s]
 36%|███▌      | 134500/371472 [10:41:15<17:51:31,  3.69it/s]
                                                             
{'loss': 3.0898, 'learning_rate': 6.744435346592255e-07, 'epoch': 5.79}

 36%|███▌      | 134500/371472 [10:41:15<17:51:31,  3.69it/s]
 36%|███▌      | 134501/371472 [10:41:15<17:49:35,  3.69it/s]
 36%|███▌      | 134502/371472 [10:41:15<17:34:24,  3.75it/s]
 36%|███▌      | 134503/371472 [10:41:15<17:13:18,  3.82it/s]
 36%|███▌      | 134504/371472 [10:41:16<17:10:06,  3.83it/s]
 36%|███▌      | 134505/371472 [10:41:16<21:24:53,  3.07it/s]
 36%|███▌      | 134506/371472 [10:41:16<20:24:57,  3.22it/s]
 36%|███▌      | 134507/371472 [10:41:17<20:10:08,  3.26it/s]
 36%|███▌      | 134508/371472 [10:41:17<18:57:02,  3.47it/s]
 36%|███▌      | 134509/371472 [10:41:17<19:19:19,  3.41it/s]
 36%|███▌      | 134510/371472 [10:41:17<18:43:34,  3.52it/s]
 36%|███▌      | 134511/371472 [10:41:18<18:52:53,  3.49it/s]
 36%|███▌      | 134512/371472 [10:41:18<19:48:29,  3.32it/s]
 36%|███▌      | 134513/371472 [10:41:18<18:50:58,  3.49it/s]
 36%|███▌      | 134514/371472 [10:41:19<18:23:27,  3.58it/s]
 36%|███▌      | 134515/371472 [10:41:19<18:07:09,  3.63it/s]
 36%|███▌      | 134516/371472 [10:41:19<17:49:17,  3.69it/s]
 36%|███▌      | 134517/371472 [10:41:19<17:21:09,  3.79it/s]
 36%|███▌      | 134518/371472 [10:41:20<17:06:49,  3.85it/s]
 36%|███▌      | 134519/371472 [10:41:20<17:50:22,  3.69it/s]
 36%|███▌      | 134520/371472 [10:41:20<18:56:12,  3.48it/s]
                                                             
{'loss': 3.1422, 'learning_rate': 6.743950526837467e-07, 'epoch': 5.79}

 36%|███▌      | 134520/371472 [10:41:20<18:56:12,  3.48it/s]
 36%|███▌      | 134521/371472 [10:41:21<19:25:23,  3.39it/s]
 36%|███▌      | 134522/371472 [10:41:21<18:28:29,  3.56it/s]
 36%|███▌      | 134523/371472 [10:41:21<18:33:41,  3.55it/s]
 36%|███▌      | 134524/371472 [10:41:21<18:01:16,  3.65it/s]
 36%|███▌      | 134525/371472 [10:41:22<17:32:43,  3.75it/s]
 36%|███▌      | 134526/371472 [10:41:22<17:39:10,  3.73it/s]
 36%|███▌      | 134527/371472 [10:41:22<18:36:26,  3.54it/s]
 36%|███▌      | 134528/371472 [10:41:22<17:59:57,  3.66it/s]
 36%|███▌      | 134529/371472 [10:41:23<18:25:52,  3.57it/s]
 36%|███▌      | 134530/371472 [10:41:23<24:31:33,  2.68it/s]
 36%|███▌      | 134531/371472 [10:41:24<22:37:16,  2.91it/s]
 36%|███▌      | 134532/371472 [10:41:24<21:37:31,  3.04it/s]
 36%|███▌      | 134533/371472 [10:41:24<20:21:37,  3.23it/s]
 36%|███▌      | 134534/371472 [10:41:24<19:07:57,  3.44it/s]
 36%|███▌      | 134535/371472 [10:41:25<19:57:29,  3.30it/s]
 36%|███▌      | 134536/371472 [10:41:25<20:25:16,  3.22it/s]
 36%|███▌      | 134537/371472 [10:41:25<18:58:56,  3.47it/s]
 36%|███▌      | 134538/371472 [10:41:26<18:27:49,  3.56it/s]
 36%|███▌      | 134539/371472 [10:41:26<18:56:04,  3.48it/s]
 36%|███▌      | 134540/371472 [10:41:26<18:37:36,  3.53it/s]
                                                             
{'loss': 3.183, 'learning_rate': 6.743465707082678e-07, 'epoch': 5.79}

 36%|███▌      | 134540/371472 [10:41:26<18:37:36,  3.53it/s]
 36%|███▌      | 134541/371472 [10:41:26<18:11:06,  3.62it/s]
 36%|███▌      | 134542/371472 [10:41:27<17:40:06,  3.72it/s]
 36%|███▌      | 134543/371472 [10:41:27<18:19:04,  3.59it/s]
 36%|███▌      | 134544/371472 [10:41:27<19:13:34,  3.42it/s]
 36%|███▌      | 134545/371472 [10:41:28<18:58:31,  3.47it/s]
 36%|███▌      | 134546/371472 [10:41:28<18:19:24,  3.59it/s]
 36%|███▌      | 134547/371472 [10:41:28<18:00:56,  3.65it/s]
 36%|███▌      | 134548/371472 [10:41:28<17:47:22,  3.70it/s]
 36%|███▌      | 134549/371472 [10:41:29<17:56:49,  3.67it/s]
 36%|███▌      | 134550/371472 [10:41:29<17:32:26,  3.75it/s]
 36%|███▌      | 134551/371472 [10:41:29<17:44:42,  3.71it/s]
 36%|███▌      | 134552/371472 [10:41:29<17:51:24,  3.69it/s]
 36%|███▌      | 134553/371472 [10:41:30<17:27:56,  3.77it/s]
 36%|███▌      | 134554/371472 [10:41:30<16:59:45,  3.87it/s]
 36%|███▌      | 134555/371472 [10:41:30<17:55:06,  3.67it/s]
 36%|███▌      | 134556/371472 [10:41:31<18:21:11,  3.59it/s]
 36%|███▌      | 134557/371472 [10:41:31<18:42:52,  3.52it/s]
 36%|███▌      | 134558/371472 [10:41:31<18:03:54,  3.64it/s]
 36%|███▌      | 134559/371472 [10:41:31<18:33:16,  3.55it/s]
 36%|███▌      | 134560/371472 [10:41:32<18:36:27,  3.54it/s]
                                                             
{'loss': 3.2282, 'learning_rate': 6.742980887327888e-07, 'epoch': 5.8}

 36%|███▌      | 134560/371472 [10:41:32<18:36:27,  3.54it/s]
 36%|███▌      | 134561/371472 [10:41:32<18:51:54,  3.49it/s]
 36%|███▌      | 134562/371472 [10:41:32<17:39:46,  3.73it/s]
 36%|███▌      | 134563/371472 [10:41:32<17:25:50,  3.78it/s]
 36%|███▌      | 134564/371472 [10:41:33<19:41:27,  3.34it/s]
 36%|███▌      | 134565/371472 [10:41:33<20:56:09,  3.14it/s]
 36%|███▌      | 134566/371472 [10:41:33<19:15:01,  3.42it/s]
 36%|███▌      | 134567/371472 [10:41:34<19:43:21,  3.34it/s]
 36%|███▌      | 134568/371472 [10:41:34<18:43:26,  3.51it/s]
 36%|███▌      | 134569/371472 [10:41:34<17:42:46,  3.72it/s]
 36%|███▌      | 134570/371472 [10:41:35<18:07:06,  3.63it/s]
 36%|███▌      | 134571/371472 [10:41:35<17:30:08,  3.76it/s]
 36%|███▌      | 134572/371472 [10:41:35<17:27:43,  3.77it/s]
 36%|███▌      | 134573/371472 [10:41:35<17:43:54,  3.71it/s]
 36%|███▌      | 134574/371472 [10:41:36<18:50:28,  3.49it/s]
 36%|███▌      | 134575/371472 [10:41:36<17:58:20,  3.66it/s]
 36%|███▌      | 134576/371472 [10:41:36<17:43:45,  3.71it/s]
 36%|███▌      | 134577/371472 [10:41:36<17:21:25,  3.79it/s]
 36%|███▌      | 134578/371472 [10:41:37<18:12:12,  3.61it/s]
 36%|███▌      | 134579/371472 [10:41:37<18:37:56,  3.53it/s]
 36%|███▌      | 134580/371472 [10:41:37<18:57:27,  3.47it/s]
                                                             
{'loss': 3.1018, 'learning_rate': 6.7424960675731e-07, 'epoch': 5.8}

 36%|███▌      | 134580/371472 [10:41:37<18:57:27,  3.47it/s]
 36%|███▌      | 134581/371472 [10:41:38<18:25:40,  3.57it/s]
 36%|███▌      | 134582/371472 [10:41:38<18:36:12,  3.54it/s]
 36%|███▌      | 134583/371472 [10:41:38<18:52:36,  3.49it/s]
 36%|███▌      | 134584/371472 [10:41:38<19:27:22,  3.38it/s]
 36%|███▌      | 134585/371472 [10:41:39<19:35:34,  3.36it/s]
 36%|███▌      | 134586/371472 [10:41:39<19:00:45,  3.46it/s]
 36%|███▌      | 134587/371472 [10:41:39<17:43:28,  3.71it/s]
 36%|███▌      | 134588/371472 [10:41:40<18:25:21,  3.57it/s]
 36%|███▌      | 134589/371472 [10:41:40<18:20:56,  3.59it/s]
 36%|███▌      | 134590/371472 [10:41:40<18:08:21,  3.63it/s]
 36%|███▌      | 134591/371472 [10:41:40<17:23:18,  3.78it/s]
 36%|███▌      | 134592/371472 [10:41:41<17:10:22,  3.83it/s]
 36%|███▌      | 134593/371472 [10:41:41<18:36:01,  3.54it/s]
 36%|███▌      | 134594/371472 [10:41:41<19:00:09,  3.46it/s]
 36%|███▌      | 134595/371472 [10:41:42<19:25:09,  3.39it/s]
 36%|███▌      | 134596/371472 [10:41:42<19:03:18,  3.45it/s]
 36%|███▌      | 134597/371472 [10:41:42<18:47:10,  3.50it/s]
 36%|███▌      | 134598/371472 [10:41:42<19:25:09,  3.39it/s]
 36%|███▌      | 134599/371472 [10:41:43<18:43:51,  3.51it/s]
 36%|███▌      | 134600/371472 [10:41:43<19:54:53,  3.30it/s]
                                                             
{'loss': 2.9996, 'learning_rate': 6.742011247818312e-07, 'epoch': 5.8}

 36%|███▌      | 134600/371472 [10:41:43<19:54:53,  3.30it/s]
 36%|███▌      | 134601/371472 [10:41:43<19:05:58,  3.44it/s]
 36%|███▌      | 134602/371472 [10:41:44<18:39:16,  3.53it/s]
 36%|███▌      | 134603/371472 [10:41:44<19:17:06,  3.41it/s]
 36%|███▌      | 134604/371472 [10:41:44<18:42:47,  3.52it/s]
 36%|███▌      | 134605/371472 [10:41:44<18:40:09,  3.52it/s]
 36%|███▌      | 134606/371472 [10:41:45<18:30:54,  3.55it/s]
 36%|███▌      | 134607/371472 [10:41:45<19:35:50,  3.36it/s]
 36%|███▌      | 134608/371472 [10:41:45<19:15:43,  3.42it/s]
 36%|███▌      | 134609/371472 [10:41:46<19:21:51,  3.40it/s]
 36%|███▌      | 134610/371472 [10:41:46<19:39:11,  3.35it/s]
 36%|███▌      | 134611/371472 [10:41:46<19:11:14,  3.43it/s]
 36%|███▌      | 134612/371472 [10:41:46<17:53:36,  3.68it/s]
 36%|███▌      | 134613/371472 [10:41:47<17:58:44,  3.66it/s]
 36%|███▌      | 134614/371472 [10:41:47<17:26:37,  3.77it/s]
 36%|███▌      | 134615/371472 [10:41:47<17:20:54,  3.79it/s]
 36%|███▌      | 134616/371472 [10:41:47<17:28:54,  3.76it/s]
 36%|███▌      | 134617/371472 [10:41:48<18:20:17,  3.59it/s]
 36%|███▌      | 134618/371472 [10:41:48<18:28:30,  3.56it/s]
 36%|███▌      | 134619/371472 [10:41:48<18:30:25,  3.56it/s]
 36%|███▌      | 134620/371472 [10:41:49<18:18:56,  3.59it/s]
                                                             
{'loss': 3.0524, 'learning_rate': 6.741526428063521e-07, 'epoch': 5.8}

 36%|███▌      | 134620/371472 [10:41:49<18:18:56,  3.59it/s]
 36%|███▌      | 134621/371472 [10:41:49<17:27:18,  3.77it/s]
 36%|███▌      | 134622/371472 [10:41:49<17:09:21,  3.83it/s]
 36%|███▌      | 134623/371472 [10:41:49<17:40:24,  3.72it/s]
 36%|███▌      | 134624/371472 [10:41:50<17:22:00,  3.79it/s]
 36%|███▌      | 134625/371472 [10:41:50<17:05:19,  3.85it/s]
 36%|███▌      | 134626/371472 [10:41:50<18:08:39,  3.63it/s]
 36%|███▌      | 134627/371472 [10:41:50<18:04:01,  3.64it/s]
 36%|███▌      | 134628/371472 [10:41:51<18:11:27,  3.62it/s]
 36%|███▌      | 134629/371472 [10:41:51<19:32:38,  3.37it/s]
 36%|███▌      | 134630/371472 [10:41:51<19:22:16,  3.40it/s]
 36%|███▌      | 134631/371472 [10:41:52<18:19:38,  3.59it/s]
 36%|███▌      | 134632/371472 [10:41:52<19:32:44,  3.37it/s]
 36%|███▌      | 134633/371472 [10:41:52<19:31:53,  3.37it/s]
 36%|███▌      | 134634/371472 [10:41:53<18:55:15,  3.48it/s]
 36%|███▌      | 134635/371472 [10:41:53<18:22:40,  3.58it/s]
 36%|███▌      | 134636/371472 [10:41:53<17:58:21,  3.66it/s]
 36%|███▌      | 134637/371472 [10:41:53<17:46:39,  3.70it/s]
 36%|███▌      | 134638/371472 [10:41:54<17:26:01,  3.77it/s]
 36%|███▌      | 134639/371472 [10:41:54<18:59:08,  3.47it/s]
 36%|███▌      | 134640/371472 [10:41:54<18:41:19,  3.52it/s]
                                                             
{'loss': 3.2086, 'learning_rate': 6.741041608308733e-07, 'epoch': 5.8}

 36%|███▌      | 134640/371472 [10:41:54<18:41:19,  3.52it/s]
 36%|███▌      | 134641/371472 [10:41:54<18:10:23,  3.62it/s]
 36%|███▌      | 134642/371472 [10:41:55<17:23:12,  3.78it/s]
 36%|███▌      | 134643/371472 [10:41:55<16:57:02,  3.88it/s]
 36%|███▌      | 134644/371472 [10:41:55<17:32:18,  3.75it/s]
 36%|███▌      | 134645/371472 [10:41:55<17:52:17,  3.68it/s]
 36%|███▌      | 134646/371472 [10:41:56<17:20:05,  3.79it/s]
 36%|███▌      | 134647/371472 [10:41:56<17:52:26,  3.68it/s]
 36%|███▌      | 134648/371472 [10:41:56<17:49:41,  3.69it/s]
 36%|███▌      | 134649/371472 [10:41:57<17:38:43,  3.73it/s]
 36%|███▌      | 134650/371472 [10:41:57<17:37:20,  3.73it/s]
 36%|███▌      | 134651/371472 [10:41:57<18:42:45,  3.52it/s]
 36%|███▌      | 134652/371472 [10:41:57<18:13:35,  3.61it/s]
 36%|███▌      | 134653/371472 [10:41:58<17:46:47,  3.70it/s]
 36%|███▌      | 134654/371472 [10:41:58<18:19:17,  3.59it/s]
 36%|███▌      | 134655/371472 [10:41:58<20:35:53,  3.19it/s]
 36%|███▌      | 134656/371472 [10:41:59<19:22:11,  3.40it/s]
 36%|███▌      | 134657/371472 [10:41:59<18:44:14,  3.51it/s]
 36%|███▌      | 134658/371472 [10:41:59<18:07:19,  3.63it/s]
 36%|███▋      | 134659/371472 [10:41:59<17:51:06,  3.68it/s]
 36%|███▋      | 134660/371472 [10:42:00<18:05:29,  3.64it/s]
                                                             
{'loss': 3.3612, 'learning_rate': 6.740556788553944e-07, 'epoch': 5.8}

 36%|███▋      | 134660/371472 [10:42:00<18:05:29,  3.64it/s]
 36%|███▋      | 134661/371472 [10:42:00<17:59:27,  3.66it/s]
 36%|███▋      | 134662/371472 [10:42:00<17:21:52,  3.79it/s]
 36%|███▋      | 134663/371472 [10:42:00<17:25:32,  3.77it/s]
 36%|███▋      | 134664/371472 [10:42:01<18:53:26,  3.48it/s]
 36%|███▋      | 134665/371472 [10:42:01<18:52:26,  3.49it/s]
 36%|███▋      | 134666/371472 [10:42:01<18:45:04,  3.51it/s]
 36%|███▋      | 134667/371472 [10:42:02<19:24:09,  3.39it/s]
 36%|███▋      | 134668/371472 [10:42:02<19:05:31,  3.45it/s]
 36%|███▋      | 134669/371472 [10:42:02<18:50:21,  3.49it/s]
 36%|███▋      | 134670/371472 [10:42:03<19:44:26,  3.33it/s]
 36%|███▋      | 134671/371472 [10:42:03<19:10:24,  3.43it/s]
 36%|███▋      | 134672/371472 [10:42:03<18:21:49,  3.58it/s]
 36%|███▋      | 134673/371472 [10:42:03<17:54:57,  3.67it/s]
 36%|███▋      | 134674/371472 [10:42:04<17:51:25,  3.68it/s]
 36%|███▋      | 134675/371472 [10:42:04<18:28:46,  3.56it/s]
 36%|███▋      | 134676/371472 [10:42:04<20:35:12,  3.20it/s]
 36%|███▋      | 134677/371472 [10:42:05<19:25:44,  3.39it/s]
 36%|███▋      | 134678/371472 [10:42:05<19:22:50,  3.39it/s]
 36%|███▋      | 134679/371472 [10:42:05<18:34:38,  3.54it/s]
 36%|███▋      | 134680/371472 [10:42:05<21:06:19,  3.12it/s]
                                                             
{'loss': 3.1381, 'learning_rate': 6.740071968799155e-07, 'epoch': 5.8}

 36%|███▋      | 134680/371472 [10:42:05<21:06:19,  3.12it/s]
 36%|███▋      | 134681/371472 [10:42:06<20:47:58,  3.16it/s]
 36%|███▋      | 134682/371472 [10:42:06<19:43:50,  3.33it/s]
 36%|███▋      | 134683/371472 [10:42:06<19:32:38,  3.37it/s]
 36%|███▋      | 134684/371472 [10:42:07<20:23:10,  3.23it/s]
 36%|███▋      | 134685/371472 [10:42:07<20:55:46,  3.14it/s]
 36%|███▋      | 134686/371472 [10:42:07<21:22:24,  3.08it/s]
 36%|███▋      | 134687/371472 [10:42:08<20:02:03,  3.28it/s]
 36%|███▋      | 134688/371472 [10:42:08<19:22:49,  3.39it/s]
 36%|███▋      | 134689/371472 [10:42:08<18:57:40,  3.47it/s]
 36%|███▋      | 134690/371472 [10:42:08<18:38:45,  3.53it/s]
 36%|███▋      | 134691/371472 [10:42:09<18:38:26,  3.53it/s]
 36%|███▋      | 134692/371472 [10:42:09<18:21:46,  3.58it/s]
 36%|███▋      | 134693/371472 [10:42:09<18:27:51,  3.56it/s]
 36%|███▋      | 134694/371472 [10:42:10<18:16:46,  3.60it/s]
 36%|███▋      | 134695/371472 [10:42:10<17:53:53,  3.67it/s]
 36%|███▋      | 134696/371472 [10:42:10<17:36:57,  3.73it/s]
 36%|███▋      | 134697/371472 [10:42:10<17:08:00,  3.84it/s]
 36%|███▋      | 134698/371472 [10:42:11<16:52:46,  3.90it/s]
 36%|███▋      | 134699/371472 [10:42:11<16:58:33,  3.87it/s]
 36%|███▋      | 134700/371472 [10:42:11<17:57:22,  3.66it/s]
                                                             
{'loss': 3.2056, 'learning_rate': 6.739587149044366e-07, 'epoch': 5.8}

 36%|███▋      | 134700/371472 [10:42:11<17:57:22,  3.66it/s]
 36%|███▋      | 134701/371472 [10:42:11<17:25:50,  3.77it/s]
 36%|███▋      | 134702/371472 [10:42:12<19:19:34,  3.40it/s]
 36%|███▋      | 134703/371472 [10:42:12<21:34:15,  3.05it/s]
 36%|███▋      | 134704/371472 [10:42:12<20:04:32,  3.28it/s]
 36%|███▋      | 134705/371472 [10:42:13<19:19:59,  3.40it/s]
 36%|███▋      | 134706/371472 [10:42:13<19:24:05,  3.39it/s]
 36%|███▋      | 134707/371472 [10:42:13<19:09:58,  3.43it/s]
 36%|███▋      | 134708/371472 [10:42:14<19:01:27,  3.46it/s]
 36%|███▋      | 134709/371472 [10:42:14<18:21:09,  3.58it/s]
 36%|███▋      | 134710/371472 [10:42:14<18:38:46,  3.53it/s]
 36%|███▋      | 134711/371472 [10:42:14<19:15:29,  3.42it/s]
 36%|███▋      | 134712/371472 [10:42:15<20:10:57,  3.26it/s]
 36%|███▋      | 134713/371472 [10:42:15<19:48:19,  3.32it/s]
 36%|███▋      | 134714/371472 [10:42:15<19:52:04,  3.31it/s]
 36%|███▋      | 134715/371472 [10:42:16<20:34:33,  3.20it/s]
 36%|███▋      | 134716/371472 [10:42:16<20:47:24,  3.16it/s]
 36%|███▋      | 134717/371472 [10:42:16<20:51:42,  3.15it/s]
 36%|███▋      | 134718/371472 [10:42:17<20:51:49,  3.15it/s]
 36%|███▋      | 134719/371472 [10:42:17<19:46:23,  3.33it/s]
 36%|███▋      | 134720/371472 [10:42:17<19:32:26,  3.37it/s]
                                                             
{'loss': 3.1089, 'learning_rate': 6.739102329289577e-07, 'epoch': 5.8}

 36%|███▋      | 134720/371472 [10:42:17<19:32:26,  3.37it/s]
 36%|███▋      | 134721/371472 [10:42:17<19:39:36,  3.35it/s]
 36%|███▋      | 134722/371472 [10:42:18<19:47:18,  3.32it/s]
 36%|███▋      | 134723/371472 [10:42:18<19:13:04,  3.42it/s]
 36%|███▋      | 134724/371472 [10:42:18<19:18:59,  3.40it/s]
 36%|███▋      | 134725/371472 [10:42:19<19:46:49,  3.32it/s]
 36%|███▋      | 134726/371472 [10:42:19<19:38:13,  3.35it/s]
 36%|███▋      | 134727/371472 [10:42:19<18:43:16,  3.51it/s]
 36%|███▋      | 134728/371472 [10:42:19<18:04:34,  3.64it/s]
 36%|███▋      | 134729/371472 [10:42:20<18:33:51,  3.54it/s]
 36%|███▋      | 134730/371472 [10:42:20<18:15:02,  3.60it/s]
 36%|███▋      | 134731/371472 [10:42:20<17:27:10,  3.77it/s]
 36%|███▋      | 134732/371472 [10:42:21<17:52:48,  3.68it/s]
 36%|███▋      | 134733/371472 [10:42:21<18:34:14,  3.54it/s]
 36%|███▋      | 134734/371472 [10:42:21<19:03:07,  3.45it/s]
 36%|███▋      | 134735/371472 [10:42:21<18:00:39,  3.65it/s]
 36%|███▋      | 134736/371472 [10:42:22<18:07:08,  3.63it/s]
 36%|███▋      | 134737/371472 [10:42:22<17:49:46,  3.69it/s]
 36%|███▋      | 134738/371472 [10:42:22<17:19:42,  3.79it/s]
 36%|███▋      | 134739/371472 [10:42:22<16:56:13,  3.88it/s]
 36%|███▋      | 134740/371472 [10:42:23<17:09:09,  3.83it/s]
                                                             
{'loss': 3.3494, 'learning_rate': 6.738617509534788e-07, 'epoch': 5.8}

 36%|███▋      | 134740/371472 [10:42:23<17:09:09,  3.83it/s]
 36%|███▋      | 134741/371472 [10:42:23<16:54:45,  3.89it/s]
 36%|███▋      | 134742/371472 [10:42:23<18:12:10,  3.61it/s]
 36%|███▋      | 134743/371472 [10:42:24<18:04:23,  3.64it/s]
 36%|███▋      | 134744/371472 [10:42:24<18:42:20,  3.52it/s]
 36%|███▋      | 134745/371472 [10:42:24<19:05:12,  3.45it/s]
 36%|███▋      | 134746/371472 [10:42:24<18:45:12,  3.51it/s]
 36%|███▋      | 134747/371472 [10:42:25<17:57:00,  3.66it/s]
 36%|███▋      | 134748/371472 [10:42:25<17:50:58,  3.68it/s]
 36%|███▋      | 134749/371472 [10:42:25<18:49:11,  3.49it/s]
 36%|███▋      | 134750/371472 [10:42:26<18:08:57,  3.62it/s]
 36%|███▋      | 134751/371472 [10:42:26<17:36:47,  3.73it/s]
 36%|███▋      | 134752/371472 [10:42:26<17:43:08,  3.71it/s]
 36%|███▋      | 134753/371472 [10:42:26<18:00:10,  3.65it/s]
 36%|███▋      | 134754/371472 [10:42:27<19:33:08,  3.36it/s]
 36%|███▋      | 134755/371472 [10:42:27<19:17:20,  3.41it/s]
 36%|███▋      | 134756/371472 [10:42:27<18:30:46,  3.55it/s]
 36%|███▋      | 134757/371472 [10:42:28<19:33:22,  3.36it/s]
 36%|███▋      | 134758/371472 [10:42:28<19:19:35,  3.40it/s]
 36%|███▋      | 134759/371472 [10:42:28<18:46:12,  3.50it/s]
 36%|███▋      | 134760/371472 [10:42:28<19:31:31,  3.37it/s]
                                                             
{'loss': 3.1653, 'learning_rate': 6.738132689779999e-07, 'epoch': 5.8}

 36%|███▋      | 134760/371472 [10:42:28<19:31:31,  3.37it/s]
 36%|███▋      | 134761/371472 [10:42:29<19:11:29,  3.43it/s]
 36%|███▋      | 134762/371472 [10:42:29<19:48:33,  3.32it/s]
 36%|███▋      | 134763/371472 [10:42:29<19:10:02,  3.43it/s]
 36%|███▋      | 134764/371472 [10:42:30<20:02:52,  3.28it/s]
 36%|███▋      | 134765/371472 [10:42:30<19:04:44,  3.45it/s]
 36%|███▋      | 134766/371472 [10:42:30<18:41:16,  3.52it/s]
 36%|███▋      | 134767/371472 [10:42:30<18:38:06,  3.53it/s]
 36%|███▋      | 134768/371472 [10:42:31<19:26:40,  3.38it/s]
 36%|███▋      | 134769/371472 [10:42:31<19:07:08,  3.44it/s]
 36%|███▋      | 134770/371472 [10:42:31<17:56:38,  3.66it/s]
 36%|███▋      | 134771/371472 [10:42:32<18:02:52,  3.64it/s]
 36%|███▋      | 134772/371472 [10:42:32<17:39:39,  3.72it/s]
 36%|███▋      | 134773/371472 [10:42:32<17:41:20,  3.72it/s]
 36%|███▋      | 134774/371472 [10:42:32<18:31:09,  3.55it/s]
 36%|███▋      | 134775/371472 [10:42:33<17:38:44,  3.73it/s]
 36%|███▋      | 134776/371472 [10:42:33<17:52:52,  3.68it/s]
 36%|███▋      | 134777/371472 [10:42:33<19:42:27,  3.34it/s]
 36%|███▋      | 134778/371472 [10:42:34<19:14:02,  3.42it/s]
 36%|███▋      | 134779/371472 [10:42:34<18:57:54,  3.47it/s]
 36%|███▋      | 134780/371472 [10:42:34<18:39:53,  3.52it/s]
                                                             
{'loss': 3.2408, 'learning_rate': 6.73764787002521e-07, 'epoch': 5.81}

 36%|███▋      | 134780/371472 [10:42:34<18:39:53,  3.52it/s]
 36%|███▋      | 134781/371472 [10:42:34<19:41:35,  3.34it/s]
 36%|███▋      | 134782/371472 [10:42:35<19:03:11,  3.45it/s]
 36%|███▋      | 134783/371472 [10:42:35<19:15:25,  3.41it/s]
 36%|███▋      | 134784/371472 [10:42:35<18:52:54,  3.48it/s]
 36%|███▋      | 134785/371472 [10:42:36<18:16:47,  3.60it/s]
 36%|███▋      | 134786/371472 [10:42:36<19:51:09,  3.31it/s]
 36%|███▋      | 134787/371472 [10:42:36<19:12:55,  3.42it/s]
 36%|███▋      | 134788/371472 [10:42:36<19:30:19,  3.37it/s]
 36%|███▋      | 134789/371472 [10:42:37<22:02:11,  2.98it/s]
 36%|███▋      | 134790/371472 [10:42:37<20:42:34,  3.17it/s]
 36%|███▋      | 134791/371472 [10:42:37<20:03:21,  3.28it/s]
 36%|███▋      | 134792/371472 [10:42:38<19:06:30,  3.44it/s]
 36%|███▋      | 134793/371472 [10:42:38<19:10:33,  3.43it/s]
 36%|███▋      | 134794/371472 [10:42:38<19:38:02,  3.35it/s]
 36%|███▋      | 134795/371472 [10:42:39<18:49:34,  3.49it/s]
 36%|███▋      | 134796/371472 [10:42:39<18:02:08,  3.65it/s]
 36%|███▋      | 134797/371472 [10:42:39<17:27:27,  3.77it/s]
 36%|███▋      | 134798/371472 [10:42:39<17:49:40,  3.69it/s]
 36%|███▋      | 134799/371472 [10:42:40<17:48:32,  3.69it/s]
 36%|███▋      | 134800/371472 [10:42:40<18:45:03,  3.51it/s]
                                                             
{'loss': 3.1996, 'learning_rate': 6.737163050270421e-07, 'epoch': 5.81}

 36%|███▋      | 134800/371472 [10:42:40<18:45:03,  3.51it/s]
 36%|███▋      | 134801/371472 [10:42:40<18:47:00,  3.50it/s]
 36%|███▋      | 134802/371472 [10:42:40<18:14:44,  3.60it/s]
 36%|███▋      | 134803/371472 [10:42:41<18:54:16,  3.48it/s]
 36%|███▋      | 134804/371472 [10:42:41<18:22:54,  3.58it/s]
 36%|███▋      | 134805/371472 [10:42:41<19:12:33,  3.42it/s]
 36%|███▋      | 134806/371472 [10:42:42<20:07:45,  3.27it/s]
 36%|███▋      | 134807/371472 [10:42:42<19:13:51,  3.42it/s]
 36%|███▋      | 134808/371472 [10:42:42<19:03:22,  3.45it/s]
 36%|███▋      | 134809/371472 [10:42:43<20:01:08,  3.28it/s]
 36%|███▋      | 134810/371472 [10:42:43<24:43:05,  2.66it/s]
 36%|███▋      | 134811/371472 [10:42:43<24:07:59,  2.72it/s]
 36%|███▋      | 134812/371472 [10:42:44<22:13:36,  2.96it/s]
 36%|███▋      | 134813/371472 [10:42:44<22:02:06,  2.98it/s]
 36%|███▋      | 134814/371472 [10:42:44<22:12:27,  2.96it/s]
 36%|███▋      | 134815/371472 [10:42:45<22:12:40,  2.96it/s]
 36%|███▋      | 134816/371472 [10:42:45<20:41:52,  3.18it/s]
 36%|███▋      | 134817/371472 [10:42:45<19:30:12,  3.37it/s]
 36%|███▋      | 134818/371472 [10:42:46<19:48:27,  3.32it/s]
 36%|███▋      | 134819/371472 [10:42:46<19:17:54,  3.41it/s]
 36%|███▋      | 134820/371472 [10:42:46<18:50:15,  3.49it/s]
                                                             
{'loss': 3.0941, 'learning_rate': 6.736678230515633e-07, 'epoch': 5.81}

 36%|███▋      | 134820/371472 [10:42:46<18:50:15,  3.49it/s]
 36%|███▋      | 134821/371472 [10:42:46<18:28:16,  3.56it/s]
 36%|███▋      | 134822/371472 [10:42:47<19:29:31,  3.37it/s]
 36%|███▋      | 134823/371472 [10:42:47<19:15:40,  3.41it/s]
 36%|███▋      | 134824/371472 [10:42:47<19:13:50,  3.42it/s]
 36%|███▋      | 134825/371472 [10:42:48<18:34:40,  3.54it/s]
 36%|███▋      | 134826/371472 [10:42:48<18:03:45,  3.64it/s]
 36%|███▋      | 134827/371472 [10:42:48<18:42:44,  3.51it/s]
 36%|███▋      | 134828/371472 [10:42:48<18:24:22,  3.57it/s]
 36%|███▋      | 134829/371472 [10:42:49<18:25:19,  3.57it/s]
 36%|███▋      | 134830/371472 [10:42:49<18:35:45,  3.53it/s]
 36%|███▋      | 134831/371472 [10:42:49<17:34:36,  3.74it/s]
 36%|███▋      | 134832/371472 [10:42:49<17:19:14,  3.80it/s]
 36%|███▋      | 134833/371472 [10:42:50<18:12:22,  3.61it/s]
 36%|███▋      | 134834/371472 [10:42:50<18:29:46,  3.55it/s]
 36%|███▋      | 134835/371472 [10:42:50<19:23:20,  3.39it/s]
 36%|███▋      | 134836/371472 [10:42:51<19:41:10,  3.34it/s]
 36%|███▋      | 134837/371472 [10:42:51<19:05:32,  3.44it/s]
 36%|███▋      | 134838/371472 [10:42:51<18:54:39,  3.48it/s]
 36%|███▋      | 134839/371472 [10:42:52<19:01:59,  3.45it/s]
 36%|███▋      | 134840/371472 [10:42:52<19:04:03,  3.45it/s]
                                                             
{'loss': 3.1541, 'learning_rate': 6.736193410760844e-07, 'epoch': 5.81}

 36%|███▋      | 134840/371472 [10:42:52<19:04:03,  3.45it/s]
 36%|███▋      | 134841/371472 [10:42:52<20:10:09,  3.26it/s]
 36%|███▋      | 134842/371472 [10:42:52<19:54:55,  3.30it/s]
 36%|███▋      | 134843/371472 [10:42:53<19:14:52,  3.41it/s]
 36%|███▋      | 134844/371472 [10:42:53<19:06:10,  3.44it/s]
 36%|███▋      | 134845/371472 [10:42:53<19:22:08,  3.39it/s]
 36%|███▋      | 134846/371472 [10:42:54<18:09:31,  3.62it/s]
 36%|███▋      | 134847/371472 [10:42:54<18:45:16,  3.50it/s]
 36%|███▋      | 134848/371472 [10:42:54<18:05:33,  3.63it/s]
 36%|███▋      | 134849/371472 [10:42:55<20:18:03,  3.24it/s]
 36%|███▋      | 134850/371472 [10:42:55<19:14:25,  3.42it/s]
 36%|███▋      | 134851/371472 [10:42:55<19:05:00,  3.44it/s]
 36%|███▋      | 134852/371472 [10:42:55<19:07:13,  3.44it/s]
 36%|███▋      | 134853/371472 [10:42:56<19:18:09,  3.41it/s]
 36%|███▋      | 134854/371472 [10:42:56<19:52:24,  3.31it/s]
 36%|███▋      | 134855/371472 [10:42:56<19:54:26,  3.30it/s]
 36%|███▋      | 134856/371472 [10:42:57<19:57:14,  3.29it/s]
 36%|███▋      | 134857/371472 [10:42:57<19:20:32,  3.40it/s]
 36%|███▋      | 134858/371472 [10:42:57<19:36:00,  3.35it/s]
 36%|███▋      | 134859/371472 [10:42:57<19:12:01,  3.42it/s]
 36%|███▋      | 134860/371472 [10:42:58<18:48:43,  3.49it/s]
                                                             
{'loss': 3.1663, 'learning_rate': 6.735708591006054e-07, 'epoch': 5.81}

 36%|███▋      | 134860/371472 [10:42:58<18:48:43,  3.49it/s]
 36%|███▋      | 134861/371472 [10:42:58<18:59:23,  3.46it/s]
 36%|███▋      | 134862/371472 [10:42:58<18:33:45,  3.54it/s]
 36%|███▋      | 134863/371472 [10:42:59<18:15:28,  3.60it/s]
 36%|███▋      | 134864/371472 [10:42:59<18:50:25,  3.49it/s]
 36%|███▋      | 134865/371472 [10:42:59<18:15:17,  3.60it/s]
 36%|███▋      | 134866/371472 [10:42:59<18:07:50,  3.63it/s]
 36%|███▋      | 134867/371472 [10:43:00<17:59:09,  3.65it/s]
 36%|███▋      | 134868/371472 [10:43:00<18:28:08,  3.56it/s]
 36%|███▋      | 134869/371472 [10:43:00<17:42:47,  3.71it/s]
 36%|███▋      | 134870/371472 [10:43:00<17:53:31,  3.67it/s]
 36%|███▋      | 134871/371472 [10:43:01<17:15:22,  3.81it/s]
 36%|███▋      | 134872/371472 [10:43:01<17:11:25,  3.82it/s]
 36%|███▋      | 134873/371472 [10:43:01<16:43:31,  3.93it/s]
 36%|███▋      | 134874/371472 [10:43:01<17:26:04,  3.77it/s]
 36%|███▋      | 134875/371472 [10:43:02<17:05:39,  3.84it/s]
 36%|███▋      | 134876/371472 [10:43:02<17:30:36,  3.75it/s]
 36%|███▋      | 134877/371472 [10:43:02<17:41:14,  3.72it/s]
 36%|███▋      | 134878/371472 [10:43:03<17:30:11,  3.75it/s]
 36%|███▋      | 134879/371472 [10:43:03<18:10:00,  3.62it/s]
 36%|███▋      | 134880/371472 [10:43:03<18:57:08,  3.47it/s]
                                                             
{'loss': 3.2249, 'learning_rate': 6.735223771251265e-07, 'epoch': 5.81}

 36%|███▋      | 134880/371472 [10:43:03<18:57:08,  3.47it/s]
 36%|███▋      | 134881/371472 [10:43:03<18:50:32,  3.49it/s]
 36%|███▋      | 134882/371472 [10:43:04<18:40:33,  3.52it/s]
 36%|███▋      | 134883/371472 [10:43:04<17:44:59,  3.70it/s]
 36%|███▋      | 134884/371472 [10:43:04<17:22:19,  3.78it/s]
 36%|███▋      | 134885/371472 [10:43:04<17:20:05,  3.79it/s]
 36%|███▋      | 134886/371472 [10:43:05<16:40:08,  3.94it/s]
 36%|███▋      | 134887/371472 [10:43:05<16:17:41,  4.03it/s]
 36%|███▋      | 134888/371472 [10:43:05<16:21:29,  4.02it/s]
 36%|███▋      | 134889/371472 [10:43:06<17:35:10,  3.74it/s]
 36%|███▋      | 134890/371472 [10:43:06<18:44:04,  3.51it/s]
 36%|███▋      | 134891/371472 [10:43:06<18:27:35,  3.56it/s]
 36%|███▋      | 134892/371472 [10:43:06<17:51:12,  3.68it/s]
 36%|███▋      | 134893/371472 [10:43:07<17:38:15,  3.73it/s]
 36%|███▋      | 134894/371472 [10:43:07<17:36:37,  3.73it/s]
 36%|███▋      | 134895/371472 [10:43:07<17:16:46,  3.80it/s]
 36%|███▋      | 134896/371472 [10:43:07<18:53:44,  3.48it/s]
 36%|███▋      | 134897/371472 [10:43:08<18:17:39,  3.59it/s]
 36%|███▋      | 134898/371472 [10:43:08<17:46:48,  3.70it/s]
 36%|███▋      | 134899/371472 [10:43:08<17:53:44,  3.67it/s]
 36%|███▋      | 134900/371472 [10:43:09<19:27:47,  3.38it/s]
                                                             
{'loss': 3.0091, 'learning_rate': 6.734738951496477e-07, 'epoch': 5.81}

 36%|███▋      | 134900/371472 [10:43:09<19:27:47,  3.38it/s]
 36%|███▋      | 134901/371472 [10:43:09<18:45:47,  3.50it/s]
 36%|███▋      | 134902/371472 [10:43:09<18:26:57,  3.56it/s]
 36%|███▋      | 134903/371472 [10:43:10<22:13:02,  2.96it/s]
 36%|███▋      | 134904/371472 [10:43:10<20:53:54,  3.14it/s]
 36%|███▋      | 134905/371472 [10:43:10<21:00:36,  3.13it/s]
 36%|███▋      | 134906/371472 [10:43:10<19:28:19,  3.37it/s]
 36%|███▋      | 134907/371472 [10:43:11<19:09:52,  3.43it/s]
 36%|███▋      | 134908/371472 [10:43:11<18:04:53,  3.63it/s]
 36%|███▋      | 134909/371472 [10:43:11<18:36:37,  3.53it/s]
 36%|███▋      | 134910/371472 [10:43:12<18:33:12,  3.54it/s]
 36%|███▋      | 134911/371472 [10:43:12<18:28:03,  3.56it/s]
 36%|███▋      | 134912/371472 [10:43:12<18:08:35,  3.62it/s]
 36%|███▋      | 134913/371472 [10:43:12<17:42:07,  3.71it/s]
 36%|███▋      | 134914/371472 [10:43:13<17:32:30,  3.75it/s]
 36%|███▋      | 134915/371472 [10:43:13<17:08:07,  3.83it/s]
 36%|███▋      | 134916/371472 [10:43:13<17:27:14,  3.76it/s]
 36%|███▋      | 134917/371472 [10:43:13<18:31:46,  3.55it/s]
 36%|███▋      | 134918/371472 [10:43:14<18:08:16,  3.62it/s]
 36%|███▋      | 134919/371472 [10:43:14<17:45:28,  3.70it/s]
 36%|███▋      | 134920/371472 [10:43:14<17:49:39,  3.69it/s]
                                                             
{'loss': 3.1883, 'learning_rate': 6.734254131741688e-07, 'epoch': 5.81}

 36%|███▋      | 134920/371472 [10:43:14<17:49:39,  3.69it/s]
 36%|███▋      | 134921/371472 [10:43:15<17:57:56,  3.66it/s]
 36%|███▋      | 134922/371472 [10:43:15<18:09:43,  3.62it/s]
 36%|███▋      | 134923/371472 [10:43:15<17:21:25,  3.79it/s]
 36%|███▋      | 134924/371472 [10:43:15<17:36:23,  3.73it/s]
 36%|███▋      | 134925/371472 [10:43:16<17:00:52,  3.86it/s]
 36%|███▋      | 134926/371472 [10:43:16<17:19:19,  3.79it/s]
 36%|███▋      | 134927/371472 [10:43:16<16:58:40,  3.87it/s]
 36%|███▋      | 134928/371472 [10:43:16<16:59:14,  3.87it/s]
 36%|███▋      | 134929/371472 [10:43:17<17:10:37,  3.83it/s]
 36%|███▋      | 134930/371472 [10:43:17<16:54:30,  3.89it/s]
 36%|███▋      | 134931/371472 [10:43:17<17:04:48,  3.85it/s]
 36%|███▋      | 134932/371472 [10:43:17<16:58:58,  3.87it/s]
 36%|███▋      | 134933/371472 [10:43:18<18:22:22,  3.58it/s]
 36%|███▋      | 134934/371472 [10:43:18<19:21:02,  3.40it/s]
 36%|███▋      | 134935/371472 [10:43:18<19:45:42,  3.32it/s]
 36%|███▋      | 134936/371472 [10:43:19<20:14:48,  3.25it/s]
 36%|███▋      | 134937/371472 [10:43:19<21:48:44,  3.01it/s]
 36%|███▋      | 134938/371472 [10:43:19<20:43:34,  3.17it/s]
 36%|███▋      | 134939/371472 [10:43:20<19:38:43,  3.34it/s]
 36%|███▋      | 134940/371472 [10:43:20<18:44:53,  3.50it/s]
                                                             
{'loss': 3.0712, 'learning_rate': 6.733769311986898e-07, 'epoch': 5.81}

 36%|███▋      | 134940/371472 [10:43:20<18:44:53,  3.50it/s]
 36%|███▋      | 134941/371472 [10:43:20<18:31:36,  3.55it/s]
 36%|███▋      | 134942/371472 [10:43:20<18:22:59,  3.57it/s]
 36%|███▋      | 134943/371472 [10:43:21<17:20:44,  3.79it/s]
 36%|███▋      | 134944/371472 [10:43:21<17:31:27,  3.75it/s]
 36%|███▋      | 134945/371472 [10:43:21<19:04:25,  3.44it/s]
 36%|███▋      | 134946/371472 [10:43:22<19:26:12,  3.38it/s]
 36%|███▋      | 134947/371472 [10:43:22<19:14:49,  3.41it/s]
 36%|███▋      | 134948/371472 [10:43:22<18:35:59,  3.53it/s]
 36%|███▋      | 134949/371472 [10:43:22<18:37:15,  3.53it/s]
 36%|███▋      | 134950/371472 [10:43:23<17:51:28,  3.68it/s]
 36%|███▋      | 134951/371472 [10:43:23<18:05:46,  3.63it/s]
 36%|███▋      | 134952/371472 [10:43:23<19:15:43,  3.41it/s]
 36%|███▋      | 134953/371472 [10:43:24<18:43:43,  3.51it/s]
 36%|███▋      | 134954/371472 [10:43:24<18:21:51,  3.58it/s]
 36%|███▋      | 134955/371472 [10:43:24<19:58:42,  3.29it/s]
 36%|███▋      | 134956/371472 [10:43:24<20:45:00,  3.17it/s]
 36%|███▋      | 134957/371472 [10:43:25<20:08:40,  3.26it/s]
 36%|███▋      | 134958/371472 [10:43:25<21:13:19,  3.10it/s]
 36%|███▋      | 134959/371472 [10:43:25<19:40:26,  3.34it/s]
 36%|███▋      | 134960/371472 [10:43:26<21:08:27,  3.11it/s]
                                                             
{'loss': 3.0874, 'learning_rate': 6.73328449223211e-07, 'epoch': 5.81}

 36%|███▋      | 134960/371472 [10:43:26<21:08:27,  3.11it/s]
 36%|███▋      | 134961/371472 [10:43:26<20:11:27,  3.25it/s]
 36%|███▋      | 134962/371472 [10:43:26<19:13:23,  3.42it/s]
 36%|███▋      | 134963/371472 [10:43:27<19:09:34,  3.43it/s]
 36%|███▋      | 134964/371472 [10:43:27<19:59:07,  3.29it/s]
 36%|███▋      | 134965/371472 [10:43:27<20:43:46,  3.17it/s]
 36%|███▋      | 134966/371472 [10:43:28<19:55:29,  3.30it/s]
 36%|███▋      | 134967/371472 [10:43:28<18:57:07,  3.47it/s]
 36%|███▋      | 134968/371472 [10:43:28<18:52:50,  3.48it/s]
 36%|███▋      | 134969/371472 [10:43:28<18:59:25,  3.46it/s]
 36%|███▋      | 134970/371472 [10:43:29<17:56:35,  3.66it/s]
 36%|███▋      | 134971/371472 [10:43:29<19:52:12,  3.31it/s]
 36%|███▋      | 134972/371472 [10:43:29<19:40:20,  3.34it/s]
 36%|███▋      | 134973/371472 [10:43:30<19:12:53,  3.42it/s]
 36%|███▋      | 134974/371472 [10:43:30<19:26:56,  3.38it/s]
 36%|███▋      | 134975/371472 [10:43:30<19:27:14,  3.38it/s]
 36%|███▋      | 134976/371472 [10:43:30<18:49:22,  3.49it/s]
 36%|███▋      | 134977/371472 [10:43:31<18:13:48,  3.60it/s]
 36%|███▋      | 134978/371472 [10:43:31<17:43:39,  3.71it/s]
 36%|███▋      | 134979/371472 [10:43:31<17:39:35,  3.72it/s]
 36%|███▋      | 134980/371472 [10:43:31<17:07:52,  3.83it/s]
                                                             
{'loss': 3.1555, 'learning_rate': 6.732799672477322e-07, 'epoch': 5.81}

 36%|███▋      | 134980/371472 [10:43:31<17:07:52,  3.83it/s]
 36%|███▋      | 134981/371472 [10:43:32<17:27:11,  3.76it/s]
 36%|███▋      | 134982/371472 [10:43:32<18:45:50,  3.50it/s]
 36%|███▋      | 134983/371472 [10:43:32<19:51:43,  3.31it/s]
 36%|███▋      | 134984/371472 [10:43:33<19:31:00,  3.37it/s]
 36%|███▋      | 134985/371472 [10:43:33<19:10:05,  3.43it/s]
 36%|███▋      | 134986/371472 [10:43:33<18:22:51,  3.57it/s]
 36%|███▋      | 134987/371472 [10:43:33<18:53:02,  3.48it/s]
 36%|███▋      | 134988/371472 [10:43:34<18:39:03,  3.52it/s]
 36%|███▋      | 134989/371472 [10:43:34<18:45:26,  3.50it/s]
 36%|███▋      | 134990/371472 [10:43:34<18:07:28,  3.62it/s]
 36%|███▋      | 134991/371472 [10:43:35<18:00:23,  3.65it/s]
 36%|███▋      | 134992/371472 [10:43:35<18:12:07,  3.61it/s]
 36%|███▋      | 134993/371472 [10:43:35<18:41:00,  3.52it/s]
 36%|███▋      | 134994/371472 [10:43:35<17:49:10,  3.69it/s]
 36%|███▋      | 134995/371472 [10:43:36<17:42:25,  3.71it/s]
 36%|███▋      | 134996/371472 [10:43:36<17:20:34,  3.79it/s]
 36%|███▋      | 134997/371472 [10:43:36<16:34:33,  3.96it/s]
 36%|███▋      | 134998/371472 [10:43:36<16:17:00,  4.03it/s]
 36%|███▋      | 134999/371472 [10:43:37<18:00:22,  3.65it/s]
 36%|███▋      | 135000/371472 [10:43:37<17:53:05,  3.67it/s]
                                                             
{'loss': 3.2034, 'learning_rate': 6.732314852722532e-07, 'epoch': 5.81}

 36%|███▋      | 135000/371472 [10:43:37<17:53:05,  3.67it/s]
 36%|███▋      | 135001/371472 [10:43:37<17:38:47,  3.72it/s]
 36%|███▋      | 135002/371472 [10:43:38<18:31:46,  3.54it/s]
 36%|███▋      | 135003/371472 [10:43:38<18:02:05,  3.64it/s]
 36%|███▋      | 135004/371472 [10:43:38<20:36:23,  3.19it/s]
 36%|███▋      | 135005/371472 [10:43:38<19:34:46,  3.35it/s]
 36%|███▋      | 135006/371472 [10:43:39<18:57:04,  3.47it/s]
 36%|███▋      | 135007/371472 [10:43:39<18:29:32,  3.55it/s]
 36%|███▋      | 135008/371472 [10:43:39<19:28:57,  3.37it/s]
 36%|███▋      | 135009/371472 [10:43:40<18:40:35,  3.52it/s]
 36%|███▋      | 135010/371472 [10:43:40<18:54:35,  3.47it/s]
 36%|███▋      | 135011/371472 [10:43:40<17:57:04,  3.66it/s]
 36%|███▋      | 135012/371472 [10:43:40<17:57:07,  3.66it/s]
 36%|███▋      | 135013/371472 [10:43:41<18:20:51,  3.58it/s]
 36%|███▋      | 135014/371472 [10:43:41<18:55:24,  3.47it/s]
 36%|███▋      | 135015/371472 [10:43:41<18:08:47,  3.62it/s]
 36%|███▋      | 135016/371472 [10:43:42<18:12:03,  3.61it/s]
 36%|███▋      | 135017/371472 [10:43:42<17:25:14,  3.77it/s]
 36%|███▋      | 135018/371472 [10:43:42<18:02:57,  3.64it/s]
 36%|███▋      | 135019/371472 [10:43:42<17:50:07,  3.68it/s]
 36%|███▋      | 135020/371472 [10:43:43<18:58:37,  3.46it/s]
                                                             
{'loss': 3.3072, 'learning_rate': 6.731830032967742e-07, 'epoch': 5.82}

 36%|███▋      | 135020/371472 [10:43:43<18:58:37,  3.46it/s]
 36%|███▋      | 135021/371472 [10:43:43<18:46:16,  3.50it/s]
 36%|███▋      | 135022/371472 [10:43:43<19:08:40,  3.43it/s]
 36%|███▋      | 135023/371472 [10:43:43<18:16:08,  3.60it/s]
 36%|███▋      | 135024/371472 [10:43:44<18:01:26,  3.64it/s]
 36%|███▋      | 135025/371472 [10:43:44<17:45:02,  3.70it/s]
 36%|███▋      | 135026/371472 [10:43:44<18:25:31,  3.56it/s]
 36%|███▋      | 135027/371472 [10:43:45<19:15:54,  3.41it/s]
 36%|███▋      | 135028/371472 [10:43:45<19:17:37,  3.40it/s]
 36%|███▋      | 135029/371472 [10:43:45<19:04:31,  3.44it/s]
 36%|███▋      | 135030/371472 [10:43:46<20:04:26,  3.27it/s]
 36%|███▋      | 135031/371472 [10:43:46<19:27:39,  3.37it/s]
 36%|███▋      | 135032/371472 [10:43:46<18:43:39,  3.51it/s]
 36%|███▋      | 135033/371472 [10:43:46<17:39:50,  3.72it/s]
 36%|███▋      | 135034/371472 [10:43:47<18:00:08,  3.65it/s]
 36%|███▋      | 135035/371472 [10:43:47<17:48:39,  3.69it/s]
 36%|███▋      | 135036/371472 [10:43:47<18:15:22,  3.60it/s]
 36%|███▋      | 135037/371472 [10:43:47<18:37:58,  3.52it/s]
 36%|███▋      | 135038/371472 [10:43:48<18:05:53,  3.63it/s]
 36%|███▋      | 135039/371472 [10:43:48<17:44:39,  3.70it/s]
 36%|███▋      | 135040/371472 [10:43:48<17:47:38,  3.69it/s]
                                                             
{'loss': 3.1931, 'learning_rate': 6.731345213212954e-07, 'epoch': 5.82}

 36%|███▋      | 135040/371472 [10:43:48<17:47:38,  3.69it/s]
 36%|███▋      | 135041/371472 [10:43:49<17:40:49,  3.71it/s]
 36%|███▋      | 135042/371472 [10:43:49<17:19:01,  3.79it/s]
 36%|███▋      | 135043/371472 [10:43:49<18:32:48,  3.54it/s]
 36%|███▋      | 135044/371472 [10:43:49<17:59:39,  3.65it/s]
 36%|███▋      | 135045/371472 [10:43:50<17:50:11,  3.68it/s]
 36%|███▋      | 135046/371472 [10:43:50<18:18:47,  3.59it/s]
 36%|███▋      | 135047/371472 [10:43:50<19:27:21,  3.38it/s]
 36%|███▋      | 135048/371472 [10:43:51<18:37:14,  3.53it/s]
 36%|███▋      | 135049/371472 [10:43:51<18:17:32,  3.59it/s]
 36%|███▋      | 135050/371472 [10:43:51<18:17:42,  3.59it/s]
 36%|███▋      | 135051/371472 [10:43:51<18:12:54,  3.61it/s]
 36%|███▋      | 135052/371472 [10:43:52<17:36:18,  3.73it/s]
 36%|███▋      | 135053/371472 [10:43:52<17:47:50,  3.69it/s]
 36%|███▋      | 135054/371472 [10:43:52<19:49:13,  3.31it/s]
 36%|███▋      | 135055/371472 [10:43:52<18:30:32,  3.55it/s]
 36%|███▋      | 135056/371472 [10:43:53<17:32:19,  3.74it/s]
 36%|███▋      | 135057/371472 [10:43:53<17:21:38,  3.78it/s]
 36%|███▋      | 135058/371472 [10:43:53<18:20:05,  3.58it/s]
 36%|███▋      | 135059/371472 [10:43:54<17:44:38,  3.70it/s]
 36%|███▋      | 135060/371472 [10:43:54<17:24:08,  3.77it/s]
                                                             
{'loss': 3.1744, 'learning_rate': 6.730860393458166e-07, 'epoch': 5.82}

 36%|███▋      | 135060/371472 [10:43:54<17:24:08,  3.77it/s]
 36%|███▋      | 135061/371472 [10:43:54<18:20:55,  3.58it/s]
 36%|███▋      | 135062/371472 [10:43:54<17:51:14,  3.68it/s]
 36%|███▋      | 135063/371472 [10:43:55<18:14:18,  3.60it/s]
 36%|███▋      | 135064/371472 [10:43:55<18:23:27,  3.57it/s]
 36%|███▋      | 135065/371472 [10:43:55<18:53:44,  3.48it/s]
 36%|███▋      | 135066/371472 [10:43:55<18:23:43,  3.57it/s]
 36%|███▋      | 135067/371472 [10:43:56<17:42:56,  3.71it/s]
 36%|███▋      | 135068/371472 [10:43:56<18:00:48,  3.65it/s]
 36%|███▋      | 135069/371472 [10:43:56<17:38:49,  3.72it/s]
 36%|███▋      | 135070/371472 [10:43:57<19:24:49,  3.38it/s]
 36%|███▋      | 135071/371472 [10:43:57<21:06:49,  3.11it/s]
 36%|███▋      | 135072/371472 [10:43:57<19:57:05,  3.29it/s]
 36%|███▋      | 135073/371472 [10:43:58<19:16:12,  3.41it/s]
 36%|███▋      | 135074/371472 [10:43:58<18:54:57,  3.47it/s]
 36%|███▋      | 135075/371472 [10:43:58<18:57:10,  3.46it/s]
 36%|███▋      | 135076/371472 [10:43:58<19:04:32,  3.44it/s]
 36%|███▋      | 135077/371472 [10:43:59<18:16:58,  3.59it/s]
 36%|███▋      | 135078/371472 [10:43:59<18:25:41,  3.56it/s]
 36%|███▋      | 135079/371472 [10:43:59<19:10:25,  3.42it/s]
 36%|███▋      | 135080/371472 [10:44:00<18:31:46,  3.54it/s]
                                                             
{'loss': 3.0712, 'learning_rate': 6.730375573703377e-07, 'epoch': 5.82}

 36%|███▋      | 135080/371472 [10:44:00<18:31:46,  3.54it/s]
 36%|███▋      | 135081/371472 [10:44:00<17:51:20,  3.68it/s]
 36%|███▋      | 135082/371472 [10:44:00<17:33:38,  3.74it/s]
 36%|███▋      | 135083/371472 [10:44:00<18:34:36,  3.53it/s]
 36%|███▋      | 135084/371472 [10:44:01<17:42:11,  3.71it/s]
 36%|███▋      | 135085/371472 [10:44:01<19:01:23,  3.45it/s]
 36%|███▋      | 135086/371472 [10:44:01<18:49:25,  3.49it/s]
 36%|███▋      | 135087/371472 [10:44:02<19:24:35,  3.38it/s]
 36%|███▋      | 135088/371472 [10:44:02<18:32:21,  3.54it/s]
 36%|███▋      | 135089/371472 [10:44:02<18:29:39,  3.55it/s]
 36%|███▋      | 135090/371472 [10:44:02<18:16:37,  3.59it/s]
 36%|███▋      | 135091/371472 [10:44:03<18:47:21,  3.49it/s]
 36%|███▋      | 135092/371472 [10:44:03<19:20:40,  3.39it/s]
 36%|███▋      | 135093/371472 [10:44:03<18:33:59,  3.54it/s]
 36%|███▋      | 135094/371472 [10:44:03<18:45:16,  3.50it/s]
 36%|███▋      | 135095/371472 [10:44:04<18:32:08,  3.54it/s]
 36%|███▋      | 135096/371472 [10:44:04<17:57:35,  3.66it/s]
 36%|███▋      | 135097/371472 [10:44:04<17:39:28,  3.72it/s]
 36%|███▋      | 135098/371472 [10:44:05<18:00:12,  3.65it/s]
 36%|███▋      | 135099/371472 [10:44:05<17:56:50,  3.66it/s]
 36%|███▋      | 135100/371472 [10:44:05<17:36:44,  3.73it/s]
                                                             
{'loss': 3.1945, 'learning_rate': 6.729890753948587e-07, 'epoch': 5.82}

 36%|███▋      | 135100/371472 [10:44:05<17:36:44,  3.73it/s]
 36%|███▋      | 135101/371472 [10:44:05<17:14:14,  3.81it/s]
 36%|███▋      | 135102/371472 [10:44:06<19:20:57,  3.39it/s]
 36%|███▋      | 135103/371472 [10:44:06<18:51:51,  3.48it/s]
 36%|███▋      | 135104/371472 [10:44:06<20:53:42,  3.14it/s]
 36%|███▋      | 135105/371472 [10:44:07<19:19:07,  3.40it/s]
 36%|███▋      | 135106/371472 [10:44:07<19:00:13,  3.45it/s]
 36%|███▋      | 135107/371472 [10:44:07<17:51:23,  3.68it/s]
 36%|███▋      | 135108/371472 [10:44:07<17:21:09,  3.78it/s]
 36%|███▋      | 135109/371472 [10:44:08<17:22:54,  3.78it/s]
 36%|███▋      | 135110/371472 [10:44:08<17:19:01,  3.79it/s]
 36%|███▋      | 135111/371472 [10:44:08<17:50:44,  3.68it/s]
 36%|███▋      | 135112/371472 [10:44:08<17:34:09,  3.74it/s]
 36%|███▋      | 135113/371472 [10:44:09<18:03:44,  3.63it/s]
 36%|███▋      | 135114/371472 [10:44:09<17:38:35,  3.72it/s]
 36%|███▋      | 135115/371472 [10:44:09<17:56:14,  3.66it/s]
 36%|███▋      | 135116/371472 [10:44:10<17:48:07,  3.69it/s]
 36%|███▋      | 135117/371472 [10:44:10<17:38:24,  3.72it/s]
 36%|███▋      | 135118/371472 [10:44:10<17:01:12,  3.86it/s]
 36%|███▋      | 135119/371472 [10:44:10<16:40:34,  3.94it/s]
 36%|███▋      | 135120/371472 [10:44:11<17:13:18,  3.81it/s]
                                                             
{'loss': 2.9604, 'learning_rate': 6.729405934193799e-07, 'epoch': 5.82}

 36%|███▋      | 135120/371472 [10:44:11<17:13:18,  3.81it/s]
 36%|███▋      | 135121/371472 [10:44:11<17:11:17,  3.82it/s]
 36%|███▋      | 135122/371472 [10:44:11<17:07:13,  3.83it/s]
 36%|███▋      | 135123/371472 [10:44:11<17:59:52,  3.65it/s]
 36%|███▋      | 135124/371472 [10:44:12<18:00:06,  3.65it/s]
 36%|███▋      | 135125/371472 [10:44:12<17:41:05,  3.71it/s]
 36%|███▋      | 135126/371472 [10:44:12<17:34:23,  3.74it/s]
 36%|███▋      | 135127/371472 [10:44:12<17:14:19,  3.81it/s]
 36%|███▋      | 135128/371472 [10:44:13<18:13:26,  3.60it/s]
 36%|███▋      | 135129/371472 [10:44:13<17:36:34,  3.73it/s]
 36%|███▋      | 135130/371472 [10:44:13<17:23:06,  3.78it/s]
 36%|███▋      | 135131/371472 [10:44:14<17:37:25,  3.73it/s]
 36%|███▋      | 135132/371472 [10:44:14<17:36:15,  3.73it/s]
 36%|███▋      | 135133/371472 [10:44:14<17:19:38,  3.79it/s]
 36%|███▋      | 135134/371472 [10:44:14<17:15:38,  3.80it/s]
 36%|███▋      | 135135/371472 [10:44:15<17:25:10,  3.77it/s]
 36%|███▋      | 135136/371472 [10:44:15<16:58:17,  3.87it/s]
 36%|███▋      | 135137/371472 [10:44:15<19:49:58,  3.31it/s]
 36%|███▋      | 135138/371472 [10:44:16<20:13:34,  3.25it/s]
 36%|███▋      | 135139/371472 [10:44:16<20:12:11,  3.25it/s]
 36%|███▋      | 135140/371472 [10:44:16<19:36:21,  3.35it/s]
                                                             
{'loss': 3.0203, 'learning_rate': 6.72892111443901e-07, 'epoch': 5.82}

 36%|███▋      | 135140/371472 [10:44:16<19:36:21,  3.35it/s]
 36%|███▋      | 135141/371472 [10:44:16<18:21:33,  3.58it/s]
 36%|███▋      | 135142/371472 [10:44:17<18:45:55,  3.50it/s]
 36%|███▋      | 135143/371472 [10:44:17<19:20:45,  3.39it/s]
 36%|███▋      | 135144/371472 [10:44:17<18:50:11,  3.49it/s]
 36%|███▋      | 135145/371472 [10:44:17<18:08:12,  3.62it/s]
 36%|███▋      | 135146/371472 [10:44:18<17:37:28,  3.72it/s]
 36%|███▋      | 135147/371472 [10:44:18<16:57:08,  3.87it/s]
 36%|███▋      | 135148/371472 [10:44:18<18:19:08,  3.58it/s]
 36%|███▋      | 135149/371472 [10:44:19<17:57:28,  3.66it/s]
 36%|███▋      | 135150/371472 [10:44:19<17:35:31,  3.73it/s]
 36%|███▋      | 135151/371472 [10:44:19<17:18:17,  3.79it/s]
 36%|███▋      | 135152/371472 [10:44:19<17:11:28,  3.82it/s]
 36%|███▋      | 135153/371472 [10:44:20<16:53:19,  3.89it/s]
 36%|███▋      | 135154/371472 [10:44:20<16:39:46,  3.94it/s]
 36%|███▋      | 135155/371472 [10:44:20<17:08:19,  3.83it/s]
 36%|███▋      | 135156/371472 [10:44:20<18:14:45,  3.60it/s]
 36%|███▋      | 135157/371472 [10:44:21<17:31:11,  3.75it/s]
 36%|███▋      | 135158/371472 [10:44:21<20:12:22,  3.25it/s]
 36%|███▋      | 135159/371472 [10:44:21<19:17:26,  3.40it/s]
 36%|███▋      | 135160/371472 [10:44:22<18:25:17,  3.56it/s]
                                                             
{'loss': 3.042, 'learning_rate': 6.728436294684219e-07, 'epoch': 5.82}

 36%|███▋      | 135160/371472 [10:44:22<18:25:17,  3.56it/s]
 36%|███▋      | 135161/371472 [10:44:22<19:08:25,  3.43it/s]
 36%|███▋      | 135162/371472 [10:44:22<18:50:01,  3.49it/s]
 36%|███▋      | 135163/371472 [10:44:22<19:35:55,  3.35it/s]
 36%|███▋      | 135164/371472 [10:44:23<19:46:02,  3.32it/s]
 36%|███▋      | 135165/371472 [10:44:23<18:51:20,  3.48it/s]
 36%|███▋      | 135166/371472 [10:44:23<18:22:42,  3.57it/s]
 36%|███▋      | 135167/371472 [10:44:24<18:05:13,  3.63it/s]
 36%|███▋      | 135168/371472 [10:44:24<17:50:49,  3.68it/s]
 36%|███▋      | 135169/371472 [10:44:24<17:40:19,  3.71it/s]
 36%|███▋      | 135170/371472 [10:44:24<19:57:46,  3.29it/s]
 36%|███▋      | 135171/371472 [10:44:25<20:25:37,  3.21it/s]
 36%|███▋      | 135172/371472 [10:44:25<20:32:46,  3.19it/s]
 36%|███▋      | 135173/371472 [10:44:25<20:39:48,  3.18it/s]
 36%|███▋      | 135174/371472 [10:44:26<19:59:25,  3.28it/s]
 36%|███▋      | 135175/371472 [10:44:26<19:18:31,  3.40it/s]
 36%|███▋      | 135176/371472 [10:44:26<18:03:08,  3.64it/s]
 36%|███▋      | 135177/371472 [10:44:26<17:24:16,  3.77it/s]
 36%|███▋      | 135178/371472 [10:44:27<17:54:56,  3.66it/s]
 36%|███▋      | 135179/371472 [10:44:27<17:50:48,  3.68it/s]
 36%|███▋      | 135180/371472 [10:44:27<18:44:24,  3.50it/s]
                                                             
{'loss': 3.0849, 'learning_rate': 6.727951474929431e-07, 'epoch': 5.82}

 36%|███▋      | 135180/371472 [10:44:27<18:44:24,  3.50it/s]
 36%|███▋      | 135181/371472 [10:44:28<18:21:20,  3.58it/s]
 36%|███▋      | 135182/371472 [10:44:28<17:57:49,  3.65it/s]
 36%|███▋      | 135183/371472 [10:44:28<17:06:51,  3.84it/s]
 36%|███▋      | 135184/371472 [10:44:28<17:15:40,  3.80it/s]
 36%|███▋      | 135185/371472 [10:44:29<17:28:27,  3.76it/s]
 36%|███▋      | 135186/371472 [10:44:29<17:43:47,  3.70it/s]
 36%|███▋      | 135187/371472 [10:44:29<17:45:36,  3.70it/s]
 36%|███▋      | 135188/371472 [10:44:29<18:05:57,  3.63it/s]
 36%|███▋      | 135189/371472 [10:44:30<17:36:56,  3.73it/s]
 36%|███▋      | 135190/371472 [10:44:30<17:02:23,  3.85it/s]
 36%|███▋      | 135191/371472 [10:44:30<16:42:30,  3.93it/s]
 36%|███▋      | 135192/371472 [10:44:31<17:14:09,  3.81it/s]
 36%|███▋      | 135193/371472 [10:44:31<17:09:45,  3.82it/s]
 36%|███▋      | 135194/371472 [10:44:31<17:04:44,  3.84it/s]
 36%|███▋      | 135195/371472 [10:44:31<17:47:27,  3.69it/s]
 36%|███▋      | 135196/371472 [10:44:32<17:36:46,  3.73it/s]
 36%|███▋      | 135197/371472 [10:44:32<17:51:17,  3.68it/s]
 36%|███▋      | 135198/371472 [10:44:32<19:07:59,  3.43it/s]
 36%|███▋      | 135199/371472 [10:44:32<18:29:23,  3.55it/s]
 36%|███▋      | 135200/371472 [10:44:33<18:47:48,  3.49it/s]
                                                             
{'loss': 3.1667, 'learning_rate': 6.727466655174643e-07, 'epoch': 5.82}

 36%|███▋      | 135200/371472 [10:44:33<18:47:48,  3.49it/s]
 36%|███▋      | 135201/371472 [10:44:33<19:00:22,  3.45it/s]
 36%|███▋      | 135202/371472 [10:44:33<18:35:09,  3.53it/s]
 36%|███▋      | 135203/371472 [10:44:34<17:38:43,  3.72it/s]
 36%|███▋      | 135204/371472 [10:44:34<18:11:19,  3.61it/s]
 36%|███▋      | 135205/371472 [10:44:34<19:01:19,  3.45it/s]
 36%|███▋      | 135206/371472 [10:44:34<19:08:12,  3.43it/s]
 36%|███▋      | 135207/371472 [10:44:35<19:17:12,  3.40it/s]
 36%|███▋      | 135208/371472 [10:44:35<19:05:52,  3.44it/s]
 36%|███▋      | 135209/371472 [10:44:35<20:02:09,  3.28it/s]
 36%|███▋      | 135210/371472 [10:44:36<19:17:00,  3.40it/s]
 36%|███▋      | 135211/371472 [10:44:36<18:26:46,  3.56it/s]
 36%|███▋      | 135212/371472 [10:44:36<17:43:29,  3.70it/s]
 36%|███▋      | 135213/371472 [10:44:36<17:43:17,  3.70it/s]
 36%|███▋      | 135214/371472 [10:44:37<17:24:36,  3.77it/s]
 36%|███▋      | 135215/371472 [10:44:37<18:04:39,  3.63it/s]
 36%|███▋      | 135216/371472 [10:44:37<18:09:08,  3.62it/s]
 36%|███▋      | 135217/371472 [10:44:37<17:23:58,  3.77it/s]
 36%|███▋      | 135218/371472 [10:44:38<17:19:29,  3.79it/s]
 36%|███▋      | 135219/371472 [10:44:38<18:03:01,  3.64it/s]
 36%|███▋      | 135220/371472 [10:44:38<18:19:45,  3.58it/s]
                                                             
{'loss': 3.103, 'learning_rate': 6.726981835419854e-07, 'epoch': 5.82}

 36%|███▋      | 135220/371472 [10:44:38<18:19:45,  3.58it/s]
 36%|███▋      | 135221/371472 [10:44:39<18:33:50,  3.54it/s]
 36%|███▋      | 135222/371472 [10:44:39<19:54:14,  3.30it/s]
 36%|███▋      | 135223/371472 [10:44:39<19:58:36,  3.29it/s]
 36%|███▋      | 135224/371472 [10:44:40<19:11:00,  3.42it/s]
 36%|███▋      | 135225/371472 [10:44:40<19:27:27,  3.37it/s]
 36%|███▋      | 135226/371472 [10:44:40<18:59:39,  3.45it/s]
 36%|███▋      | 135227/371472 [10:44:40<18:34:35,  3.53it/s]
 36%|███▋      | 135228/371472 [10:44:41<19:47:02,  3.32it/s]
 36%|███▋      | 135229/371472 [10:44:41<18:44:08,  3.50it/s]
 36%|███▋      | 135230/371472 [10:44:41<17:44:43,  3.70it/s]
 36%|███▋      | 135231/371472 [10:44:42<17:56:37,  3.66it/s]
 36%|███▋      | 135232/371472 [10:44:42<17:19:59,  3.79it/s]
 36%|███▋      | 135233/371472 [10:44:42<17:25:26,  3.77it/s]
 36%|███▋      | 135234/371472 [10:44:42<17:41:23,  3.71it/s]
 36%|███▋      | 135235/371472 [10:44:43<19:21:38,  3.39it/s]
 36%|███▋      | 135236/371472 [10:44:43<19:36:52,  3.35it/s]
 36%|███▋      | 135237/371472 [10:44:43<19:21:35,  3.39it/s]
 36%|███▋      | 135238/371472 [10:44:44<20:33:14,  3.19it/s]
 36%|███▋      | 135239/371472 [10:44:44<20:13:15,  3.25it/s]
 36%|███▋      | 135240/371472 [10:44:44<18:46:39,  3.49it/s]
                                                             
{'loss': 3.0376, 'learning_rate': 6.726497015665064e-07, 'epoch': 5.83}

 36%|███▋      | 135240/371472 [10:44:44<18:46:39,  3.49it/s]
 36%|███▋      | 135241/371472 [10:44:44<18:04:47,  3.63it/s]
 36%|███▋      | 135242/371472 [10:44:45<17:33:19,  3.74it/s]
 36%|███▋      | 135243/371472 [10:44:45<17:44:06,  3.70it/s]
 36%|███▋      | 135244/371472 [10:44:45<17:16:50,  3.80it/s]
 36%|███▋      | 135245/371472 [10:44:45<17:15:49,  3.80it/s]
 36%|███▋      | 135246/371472 [10:44:46<17:06:01,  3.84it/s]
 36%|███▋      | 135247/371472 [10:44:46<17:53:17,  3.67it/s]
 36%|███▋      | 135248/371472 [10:44:46<21:25:11,  3.06it/s]
 36%|███▋      | 135249/371472 [10:44:47<19:48:42,  3.31it/s]
 36%|███▋      | 135250/371472 [10:44:47<18:39:55,  3.52it/s]
 36%|███▋      | 135251/371472 [10:44:47<18:09:20,  3.61it/s]
 36%|███▋      | 135252/371472 [10:44:47<17:37:35,  3.72it/s]
 36%|███▋      | 135253/371472 [10:44:48<17:20:55,  3.78it/s]
 36%|███▋      | 135254/371472 [10:44:48<18:24:16,  3.57it/s]
 36%|███▋      | 135255/371472 [10:44:48<18:33:50,  3.53it/s]
 36%|███▋      | 135256/371472 [10:44:49<18:46:13,  3.50it/s]
 36%|███▋      | 135257/371472 [10:44:49<18:11:22,  3.61it/s]
 36%|███▋      | 135258/371472 [10:44:49<17:45:49,  3.69it/s]
 36%|███▋      | 135259/371472 [10:44:49<17:41:48,  3.71it/s]
 36%|███▋      | 135260/371472 [10:44:50<19:00:32,  3.45it/s]
                                                             
{'loss': 3.2213, 'learning_rate': 6.726012195910275e-07, 'epoch': 5.83}

 36%|███▋      | 135260/371472 [10:44:50<19:00:32,  3.45it/s]
 36%|███▋      | 135261/371472 [10:44:50<18:59:13,  3.46it/s]
 36%|███▋      | 135262/371472 [10:44:50<18:55:10,  3.47it/s]
 36%|███▋      | 135263/371472 [10:44:51<17:57:53,  3.65it/s]
 36%|███▋      | 135264/371472 [10:44:51<17:46:13,  3.69it/s]
 36%|███▋      | 135265/371472 [10:44:51<17:34:33,  3.73it/s]
 36%|███▋      | 135266/371472 [10:44:51<17:50:06,  3.68it/s]
 36%|███▋      | 135267/371472 [10:44:52<17:05:50,  3.84it/s]
 36%|███▋      | 135268/371472 [10:44:52<17:23:10,  3.77it/s]
 36%|███▋      | 135269/371472 [10:44:52<17:27:20,  3.76it/s]
 36%|███▋      | 135270/371472 [10:44:52<17:13:05,  3.81it/s]
 36%|███▋      | 135271/371472 [10:44:53<17:34:13,  3.73it/s]
 36%|███▋      | 135272/371472 [10:44:53<17:57:01,  3.66it/s]
 36%|███▋      | 135273/371472 [10:44:53<17:38:01,  3.72it/s]
 36%|███▋      | 135274/371472 [10:44:53<17:55:48,  3.66it/s]
 36%|███▋      | 135275/371472 [10:44:54<17:58:23,  3.65it/s]
 36%|███▋      | 135276/371472 [10:44:54<17:45:36,  3.69it/s]
 36%|███▋      | 135277/371472 [10:44:54<19:16:07,  3.40it/s]
 36%|███▋      | 135278/371472 [10:44:55<18:39:12,  3.52it/s]
 36%|███▋      | 135279/371472 [10:44:55<18:14:24,  3.60it/s]
 36%|███▋      | 135280/371472 [10:44:55<18:02:09,  3.64it/s]
                                                             
{'loss': 3.1859, 'learning_rate': 6.725527376155487e-07, 'epoch': 5.83}

 36%|███▋      | 135280/371472 [10:44:55<18:02:09,  3.64it/s]
 36%|███▋      | 135281/371472 [10:44:55<17:40:49,  3.71it/s]
 36%|███▋      | 135282/371472 [10:44:56<17:37:28,  3.72it/s]
 36%|███▋      | 135283/371472 [10:44:56<17:46:34,  3.69it/s]
 36%|███▋      | 135284/371472 [10:44:56<18:56:50,  3.46it/s]
 36%|███▋      | 135285/371472 [10:44:57<19:19:04,  3.40it/s]
 36%|███▋      | 135286/371472 [10:44:57<18:55:52,  3.47it/s]
 36%|███▋      | 135287/371472 [10:44:57<18:13:25,  3.60it/s]
 36%|███▋      | 135288/371472 [10:44:57<18:44:25,  3.50it/s]
 36%|███▋      | 135289/371472 [10:44:58<17:56:35,  3.66it/s]
 36%|███▋      | 135290/371472 [10:44:58<17:58:13,  3.65it/s]
 36%|███▋      | 135291/371472 [10:44:58<18:00:28,  3.64it/s]
 36%|███▋      | 135292/371472 [10:44:58<17:51:42,  3.67it/s]
 36%|███▋      | 135293/371472 [10:44:59<17:23:14,  3.77it/s]
 36%|███▋      | 135294/371472 [10:44:59<17:35:24,  3.73it/s]
 36%|███▋      | 135295/371472 [10:44:59<18:34:05,  3.53it/s]
 36%|███▋      | 135296/371472 [10:45:00<17:57:04,  3.65it/s]
 36%|███▋      | 135297/371472 [10:45:00<18:05:53,  3.62it/s]
 36%|███▋      | 135298/371472 [10:45:00<19:07:50,  3.43it/s]
 36%|███▋      | 135299/371472 [10:45:00<18:29:33,  3.55it/s]
 36%|███▋      | 135300/371472 [10:45:01<19:51:47,  3.30it/s]
                                                             
{'loss': 3.0732, 'learning_rate': 6.725042556400698e-07, 'epoch': 5.83}

 36%|███▋      | 135300/371472 [10:45:01<19:51:47,  3.30it/s]
 36%|███▋      | 135301/371472 [10:45:01<18:37:28,  3.52it/s]
 36%|███▋      | 135302/371472 [10:45:01<18:06:43,  3.62it/s]
 36%|███▋      | 135303/371472 [10:45:02<19:31:44,  3.36it/s]
 36%|███▋      | 135304/371472 [10:45:02<19:14:53,  3.41it/s]
 36%|███▋      | 135305/371472 [10:45:02<20:48:38,  3.15it/s]
 36%|███▋      | 135306/371472 [10:45:03<20:33:14,  3.19it/s]
 36%|███▋      | 135307/371472 [10:45:03<19:21:18,  3.39it/s]
 36%|███▋      | 135308/371472 [10:45:03<18:19:27,  3.58it/s]
 36%|███▋      | 135309/371472 [10:45:03<17:43:51,  3.70it/s]
 36%|███▋      | 135310/371472 [10:45:04<19:12:44,  3.41it/s]
 36%|███▋      | 135311/371472 [10:45:04<18:31:00,  3.54it/s]
 36%|███▋      | 135312/371472 [10:45:04<18:24:35,  3.56it/s]
 36%|███▋      | 135313/371472 [10:45:04<18:30:01,  3.55it/s]
 36%|███▋      | 135314/371472 [10:45:05<17:49:31,  3.68it/s]
 36%|███▋      | 135315/371472 [10:45:05<17:01:00,  3.85it/s]
 36%|███▋      | 135316/371472 [10:45:05<17:32:30,  3.74it/s]
 36%|███▋      | 135317/371472 [10:45:06<17:51:44,  3.67it/s]
 36%|███▋      | 135318/371472 [10:45:06<17:32:08,  3.74it/s]
 36%|███▋      | 135319/371472 [10:45:06<17:48:42,  3.68it/s]
 36%|███▋      | 135320/371472 [10:45:06<19:02:09,  3.45it/s]
                                                             
{'loss': 3.0541, 'learning_rate': 6.724557736645908e-07, 'epoch': 5.83}

 36%|███▋      | 135320/371472 [10:45:06<19:02:09,  3.45it/s]
 36%|███▋      | 135321/371472 [10:45:07<18:47:29,  3.49it/s]
 36%|███▋      | 135322/371472 [10:45:07<19:51:44,  3.30it/s]
 36%|███▋      | 135323/371472 [10:45:07<19:04:48,  3.44it/s]
 36%|███▋      | 135324/371472 [10:45:08<19:50:33,  3.31it/s]
 36%|███▋      | 135325/371472 [10:45:08<18:56:14,  3.46it/s]
 36%|███▋      | 135326/371472 [10:45:08<18:36:41,  3.52it/s]
 36%|███▋      | 135327/371472 [10:45:08<18:09:31,  3.61it/s]
 36%|███▋      | 135328/371472 [10:45:09<17:47:08,  3.69it/s]
 36%|███▋      | 135329/371472 [10:45:09<18:43:36,  3.50it/s]
 36%|███▋      | 135330/371472 [10:45:09<18:38:54,  3.52it/s]
 36%|███▋      | 135331/371472 [10:45:10<18:47:59,  3.49it/s]
 36%|███▋      | 135332/371472 [10:45:10<18:29:06,  3.55it/s]
 36%|███▋      | 135333/371472 [10:45:10<18:00:05,  3.64it/s]
 36%|███▋      | 135334/371472 [10:45:10<18:32:18,  3.54it/s]
 36%|███▋      | 135335/371472 [10:45:11<19:10:38,  3.42it/s]
 36%|███▋      | 135336/371472 [10:45:11<18:26:23,  3.56it/s]
 36%|███▋      | 135337/371472 [10:45:11<18:08:14,  3.62it/s]
 36%|███▋      | 135338/371472 [10:45:11<17:29:02,  3.75it/s]
 36%|███▋      | 135339/371472 [10:45:12<17:50:15,  3.68it/s]
 36%|███▋      | 135340/371472 [10:45:12<17:27:24,  3.76it/s]
                                                             
{'loss': 3.1965, 'learning_rate': 6.72407291689112e-07, 'epoch': 5.83}

 36%|███▋      | 135340/371472 [10:45:12<17:27:24,  3.76it/s]
 36%|███▋      | 135341/371472 [10:45:12<17:20:51,  3.78it/s]
 36%|███▋      | 135342/371472 [10:45:13<18:58:37,  3.46it/s]
 36%|███▋      | 135343/371472 [10:45:13<18:06:17,  3.62it/s]
 36%|███▋      | 135344/371472 [10:45:13<17:24:26,  3.77it/s]
 36%|███▋      | 135345/371472 [10:45:13<17:06:34,  3.83it/s]
 36%|███▋      | 135346/371472 [10:45:14<17:27:18,  3.76it/s]
 36%|███▋      | 135347/371472 [10:45:14<17:35:30,  3.73it/s]
 36%|███▋      | 135348/371472 [10:45:14<17:27:49,  3.76it/s]
 36%|███▋      | 135349/371472 [10:45:14<17:22:15,  3.78it/s]
 36%|███▋      | 135350/371472 [10:45:15<17:57:01,  3.65it/s]
 36%|███▋      | 135351/371472 [10:45:15<18:08:33,  3.62it/s]
 36%|███▋      | 135352/371472 [10:45:15<18:41:13,  3.51it/s]
 36%|███▋      | 135353/371472 [10:45:16<18:55:33,  3.47it/s]
 36%|███▋      | 135354/371472 [10:45:16<18:15:19,  3.59it/s]
 36%|███▋      | 135355/371472 [10:45:16<18:04:30,  3.63it/s]
 36%|███▋      | 135356/371472 [10:45:16<17:27:50,  3.76it/s]
 36%|███▋      | 135357/371472 [10:45:17<18:03:04,  3.63it/s]
 36%|███▋      | 135358/371472 [10:45:17<17:41:28,  3.71it/s]
 36%|███▋      | 135359/371472 [10:45:17<18:32:00,  3.54it/s]
 36%|███▋      | 135360/371472 [10:45:17<17:55:24,  3.66it/s]
                                                             
{'loss': 3.1839, 'learning_rate': 6.723588097136332e-07, 'epoch': 5.83}

 36%|███▋      | 135360/371472 [10:45:17<17:55:24,  3.66it/s]
 36%|███▋      | 135361/371472 [10:45:18<18:01:00,  3.64it/s]
 36%|███▋      | 135362/371472 [10:45:18<18:36:52,  3.52it/s]
 36%|███▋      | 135363/371472 [10:45:18<18:43:32,  3.50it/s]
 36%|███▋      | 135364/371472 [10:45:19<17:50:45,  3.68it/s]
 36%|███▋      | 135365/371472 [10:45:19<17:13:36,  3.81it/s]
 36%|███▋      | 135366/371472 [10:45:19<18:14:08,  3.60it/s]
 36%|███▋      | 135367/371472 [10:45:19<18:19:32,  3.58it/s]
 36%|███▋      | 135368/371472 [10:45:20<18:31:44,  3.54it/s]
 36%|███▋      | 135369/371472 [10:45:20<17:29:44,  3.75it/s]
 36%|███▋      | 135370/371472 [10:45:20<18:18:47,  3.58it/s]
 36%|███▋      | 135371/371472 [10:45:21<18:06:54,  3.62it/s]
 36%|███▋      | 135372/371472 [10:45:21<17:46:49,  3.69it/s]
 36%|███▋      | 135373/371472 [10:45:21<18:54:06,  3.47it/s]
 36%|███▋      | 135374/371472 [10:45:21<18:58:32,  3.46it/s]
 36%|███▋      | 135375/371472 [10:45:22<18:31:52,  3.54it/s]
 36%|███▋      | 135376/371472 [10:45:22<19:38:03,  3.34it/s]
 36%|███▋      | 135377/371472 [10:45:22<19:44:21,  3.32it/s]
 36%|███▋      | 135378/371472 [10:45:23<19:38:23,  3.34it/s]
 36%|███▋      | 135379/371472 [10:45:23<18:42:15,  3.51it/s]
 36%|███▋      | 135380/371472 [10:45:23<17:30:48,  3.74it/s]
                                                             
{'loss': 3.1495, 'learning_rate': 6.723103277381542e-07, 'epoch': 5.83}

 36%|███▋      | 135380/371472 [10:45:23<17:30:48,  3.74it/s]
 36%|███▋      | 135381/371472 [10:45:24<21:16:44,  3.08it/s]
 36%|███▋      | 135382/371472 [10:45:24<20:22:10,  3.22it/s]
 36%|███▋      | 135383/371472 [10:45:24<19:12:25,  3.41it/s]
 36%|███▋      | 135384/371472 [10:45:24<18:08:25,  3.62it/s]
 36%|███▋      | 135385/371472 [10:45:25<17:34:03,  3.73it/s]
 36%|███▋      | 135386/371472 [10:45:25<18:15:18,  3.59it/s]
 36%|███▋      | 135387/371472 [10:45:25<18:46:30,  3.49it/s]
 36%|███▋      | 135388/371472 [10:45:25<19:09:40,  3.42it/s]
 36%|███▋      | 135389/371472 [10:45:26<19:48:34,  3.31it/s]
 36%|███▋      | 135390/371472 [10:45:26<20:35:52,  3.18it/s]
 36%|███▋      | 135391/371472 [10:45:26<19:13:36,  3.41it/s]
 36%|███▋      | 135392/371472 [10:45:27<18:54:38,  3.47it/s]
 36%|███▋      | 135393/371472 [10:45:27<18:37:21,  3.52it/s]
 36%|███▋      | 135394/371472 [10:45:27<17:59:06,  3.65it/s]
 36%|███▋      | 135395/371472 [10:45:27<17:54:59,  3.66it/s]
 36%|███▋      | 135396/371472 [10:45:28<17:37:47,  3.72it/s]
 36%|███▋      | 135397/371472 [10:45:28<18:17:23,  3.59it/s]
 36%|███▋      | 135398/371472 [10:45:28<17:53:48,  3.66it/s]
 36%|███▋      | 135399/371472 [10:45:29<18:02:41,  3.63it/s]
 36%|███▋      | 135400/371472 [10:45:29<18:11:31,  3.60it/s]
                                                             
{'loss': 3.0962, 'learning_rate': 6.722618457626752e-07, 'epoch': 5.83}

 36%|███▋      | 135400/371472 [10:45:29<18:11:31,  3.60it/s]
 36%|███▋      | 135401/371472 [10:45:29<17:37:37,  3.72it/s]
 36%|███▋      | 135402/371472 [10:45:29<17:04:34,  3.84it/s]
 36%|███▋      | 135403/371472 [10:45:30<17:30:22,  3.75it/s]
 36%|███▋      | 135404/371472 [10:45:30<17:32:05,  3.74it/s]
 36%|███▋      | 135405/371472 [10:45:30<17:58:19,  3.65it/s]
 36%|███▋      | 135406/371472 [10:45:31<21:07:42,  3.10it/s]
 36%|███▋      | 135407/371472 [10:45:31<21:11:26,  3.09it/s]
 36%|███▋      | 135408/371472 [10:45:31<21:04:11,  3.11it/s]
 36%|███▋      | 135409/371472 [10:45:32<19:44:23,  3.32it/s]
 36%|███▋      | 135410/371472 [10:45:32<19:23:04,  3.38it/s]
 36%|███▋      | 135411/371472 [10:45:32<19:31:11,  3.36it/s]
 36%|███▋      | 135412/371472 [10:45:32<18:53:49,  3.47it/s]
 36%|███▋      | 135413/371472 [10:45:33<19:15:04,  3.41it/s]
 36%|███▋      | 135414/371472 [10:45:33<18:09:15,  3.61it/s]
 36%|███▋      | 135415/371472 [10:45:33<18:14:27,  3.59it/s]
 36%|███▋      | 135416/371472 [10:45:34<19:15:03,  3.41it/s]
 36%|███▋      | 135417/371472 [10:45:34<18:21:38,  3.57it/s]
 36%|███▋      | 135418/371472 [10:45:34<18:41:16,  3.51it/s]
 36%|███▋      | 135419/371472 [10:45:34<18:46:32,  3.49it/s]
 36%|███▋      | 135420/371472 [10:45:35<19:26:01,  3.37it/s]
                                                             
{'loss': 3.239, 'learning_rate': 6.722133637871964e-07, 'epoch': 5.83}

 36%|███▋      | 135420/371472 [10:45:35<19:26:01,  3.37it/s]
 36%|███▋      | 135421/371472 [10:45:35<19:13:14,  3.41it/s]
 36%|███▋      | 135422/371472 [10:45:35<18:19:19,  3.58it/s]
 36%|███▋      | 135423/371472 [10:45:36<19:42:29,  3.33it/s]
 36%|███▋      | 135424/371472 [10:45:36<19:22:02,  3.39it/s]
 36%|███▋      | 135425/371472 [10:45:36<18:45:42,  3.49it/s]
 36%|███▋      | 135426/371472 [10:45:36<17:52:41,  3.67it/s]
 36%|███▋      | 135427/371472 [10:45:37<17:59:29,  3.64it/s]
 36%|███▋      | 135428/371472 [10:45:37<19:07:03,  3.43it/s]
 36%|███▋      | 135429/371472 [10:45:37<19:21:37,  3.39it/s]
 36%|███▋      | 135430/371472 [10:45:38<20:01:47,  3.27it/s]
 36%|███▋      | 135431/371472 [10:45:38<19:11:29,  3.42it/s]
 36%|███▋      | 135432/371472 [10:45:38<19:05:24,  3.43it/s]
 36%|███▋      | 135433/371472 [10:45:38<18:29:14,  3.55it/s]
 36%|███▋      | 135434/371472 [10:45:39<18:38:18,  3.52it/s]
 36%|███▋      | 135435/371472 [10:45:39<19:12:04,  3.41it/s]
 36%|███▋      | 135436/371472 [10:45:39<19:48:25,  3.31it/s]
 36%|███▋      | 135437/371472 [10:45:40<19:35:08,  3.35it/s]
 36%|███▋      | 135438/371472 [10:45:40<18:44:11,  3.50it/s]
 36%|███▋      | 135439/371472 [10:45:40<19:23:41,  3.38it/s]
 36%|███▋      | 135440/371472 [10:45:41<19:45:27,  3.32it/s]
                                                             
{'loss': 3.0408, 'learning_rate': 6.721648818117176e-07, 'epoch': 5.83}

 36%|███▋      | 135440/371472 [10:45:41<19:45:27,  3.32it/s]
 36%|███▋      | 135441/371472 [10:45:41<18:49:15,  3.48it/s]
 36%|███▋      | 135442/371472 [10:45:41<19:22:33,  3.38it/s]
 36%|███▋      | 135443/371472 [10:45:41<18:11:22,  3.60it/s]
 36%|███▋      | 135444/371472 [10:45:42<18:56:31,  3.46it/s]
 36%|███▋      | 135445/371472 [10:45:42<19:10:39,  3.42it/s]
 36%|███▋      | 135446/371472 [10:45:42<20:38:16,  3.18it/s]
 36%|███▋      | 135447/371472 [10:45:43<19:11:17,  3.42it/s]
 36%|███▋      | 135448/371472 [10:45:43<18:23:42,  3.56it/s]
 36%|███▋      | 135449/371472 [10:45:43<18:30:59,  3.54it/s]
 36%|███▋      | 135450/371472 [10:45:43<18:32:09,  3.54it/s]
 36%|███▋      | 135451/371472 [10:45:44<19:02:26,  3.44it/s]
 36%|███▋      | 135452/371472 [10:45:44<20:15:18,  3.24it/s]
 36%|███▋      | 135453/371472 [10:45:44<19:35:41,  3.35it/s]
 36%|███▋      | 135454/371472 [10:45:45<19:14:48,  3.41it/s]
 36%|███▋      | 135455/371472 [10:45:45<21:10:54,  3.10it/s]
 36%|███▋      | 135456/371472 [10:45:45<21:07:43,  3.10it/s]
 36%|███▋      | 135457/371472 [10:45:46<19:50:11,  3.31it/s]
 36%|███▋      | 135458/371472 [10:45:46<18:48:10,  3.49it/s]
 36%|███▋      | 135459/371472 [10:45:46<19:12:30,  3.41it/s]
 36%|███▋      | 135460/371472 [10:45:46<19:06:40,  3.43it/s]
                                                             
{'loss': 3.0296, 'learning_rate': 6.721163998362387e-07, 'epoch': 5.83}

 36%|███▋      | 135460/371472 [10:45:46<19:06:40,  3.43it/s]
 36%|███▋      | 135461/371472 [10:45:47<19:01:17,  3.45it/s]
 36%|███▋      | 135462/371472 [10:45:47<19:13:10,  3.41it/s]
 36%|███▋      | 135463/371472 [10:45:47<18:28:23,  3.55it/s]
 36%|███▋      | 135464/371472 [10:45:47<17:49:20,  3.68it/s]
 36%|███▋      | 135465/371472 [10:45:48<17:34:17,  3.73it/s]
 36%|███▋      | 135466/371472 [10:45:48<17:15:29,  3.80it/s]
 36%|███▋      | 135467/371472 [10:45:48<18:12:50,  3.60it/s]
 36%|███▋      | 135468/371472 [10:45:49<17:55:53,  3.66it/s]
 36%|███▋      | 135469/371472 [10:45:49<18:10:42,  3.61it/s]
 36%|███▋      | 135470/371472 [10:45:49<18:32:54,  3.53it/s]
 36%|███▋      | 135471/371472 [10:45:50<20:54:32,  3.14it/s]
 36%|███▋      | 135472/371472 [10:45:50<21:10:10,  3.10it/s]
 36%|███▋      | 135473/371472 [10:45:50<20:31:13,  3.19it/s]
 36%|███▋      | 135474/371472 [10:45:50<19:51:02,  3.30it/s]
 36%|███▋      | 135475/371472 [10:45:51<19:37:07,  3.34it/s]
 36%|███▋      | 135476/371472 [10:45:51<20:10:16,  3.25it/s]
 36%|███▋      | 135477/371472 [10:45:51<19:06:56,  3.43it/s]
 36%|███▋      | 135478/371472 [10:45:52<19:09:53,  3.42it/s]
 36%|███▋      | 135479/371472 [10:45:52<19:22:34,  3.38it/s]
 36%|███▋      | 135480/371472 [10:45:52<22:39:23,  2.89it/s]
                                                             
{'loss': 3.2457, 'learning_rate': 6.720679178607597e-07, 'epoch': 5.84}

 36%|███▋      | 135480/371472 [10:45:52<22:39:23,  2.89it/s]
 36%|███▋      | 135481/371472 [10:45:53<21:21:49,  3.07it/s]
 36%|███▋      | 135482/371472 [10:45:53<20:34:04,  3.19it/s]
 36%|███▋      | 135483/371472 [10:45:53<19:20:58,  3.39it/s]
 36%|███▋      | 135484/371472 [10:45:53<18:18:36,  3.58it/s]
 36%|███▋      | 135485/371472 [10:45:54<17:52:35,  3.67it/s]
 36%|███▋      | 135486/371472 [10:45:54<17:50:54,  3.67it/s]
 36%|███▋      | 135487/371472 [10:45:54<18:09:25,  3.61it/s]
 36%|███▋      | 135488/371472 [10:45:55<18:25:55,  3.56it/s]
 36%|███▋      | 135489/371472 [10:45:55<18:14:28,  3.59it/s]
 36%|███▋      | 135490/371472 [10:45:55<17:54:18,  3.66it/s]
 36%|███▋      | 135491/371472 [10:45:55<18:04:28,  3.63it/s]
 36%|███▋      | 135492/371472 [10:45:56<17:40:55,  3.71it/s]
 36%|███▋      | 135493/371472 [10:45:56<17:27:55,  3.75it/s]
 36%|███▋      | 135494/371472 [10:45:56<18:44:38,  3.50it/s]
 36%|███▋      | 135495/371472 [10:45:56<18:32:38,  3.53it/s]
 36%|███▋      | 135496/371472 [10:45:57<19:16:00,  3.40it/s]
 36%|███▋      | 135497/371472 [10:45:57<18:32:42,  3.53it/s]
 36%|███▋      | 135498/371472 [10:45:57<18:18:39,  3.58it/s]
 36%|███▋      | 135499/371472 [10:45:58<17:46:20,  3.69it/s]
 36%|███▋      | 135500/371472 [10:45:58<17:55:19,  3.66it/s]
                                                             
{'loss': 3.1288, 'learning_rate': 6.720194358852809e-07, 'epoch': 5.84}

 36%|███▋      | 135500/371472 [10:45:58<17:55:19,  3.66it/s]
 36%|███▋      | 135501/371472 [10:45:58<18:32:34,  3.53it/s]
 36%|███▋      | 135502/371472 [10:45:58<18:12:23,  3.60it/s]
 36%|███▋      | 135503/371472 [10:45:59<18:48:02,  3.49it/s]
 36%|███▋      | 135504/371472 [10:45:59<17:53:58,  3.66it/s]
 36%|███▋      | 135505/371472 [10:45:59<17:08:53,  3.82it/s]
 36%|███▋      | 135506/371472 [10:45:59<16:42:48,  3.92it/s]
 36%|███▋      | 135507/371472 [10:46:00<16:36:52,  3.95it/s]
 36%|███▋      | 135508/371472 [10:46:00<17:22:18,  3.77it/s]
 36%|███▋      | 135509/371472 [10:46:00<16:40:12,  3.93it/s]
 36%|███▋      | 135510/371472 [10:46:01<16:51:26,  3.89it/s]
 36%|███▋      | 135511/371472 [10:46:01<16:29:32,  3.97it/s]
 36%|███▋      | 135512/371472 [10:46:01<16:37:25,  3.94it/s]
 36%|███▋      | 135513/371472 [10:46:01<16:21:09,  4.01it/s]
 36%|███▋      | 135514/371472 [10:46:02<18:26:49,  3.55it/s]
 36%|███▋      | 135515/371472 [10:46:02<18:44:06,  3.50it/s]
 36%|███▋      | 135516/371472 [10:46:02<20:30:14,  3.20it/s]
 36%|███▋      | 135517/371472 [10:46:03<19:36:16,  3.34it/s]
 36%|███▋      | 135518/371472 [10:46:03<20:46:00,  3.16it/s]
 36%|███▋      | 135519/371472 [10:46:03<19:14:07,  3.41it/s]
 36%|███▋      | 135520/371472 [10:46:03<19:01:18,  3.45it/s]
                                                             
{'loss': 3.1188, 'learning_rate': 6.71970953909802e-07, 'epoch': 5.84}

 36%|███▋      | 135520/371472 [10:46:03<19:01:18,  3.45it/s]
 36%|███▋      | 135521/371472 [10:46:04<18:38:56,  3.51it/s]
 36%|███▋      | 135522/371472 [10:46:04<18:39:14,  3.51it/s]
 36%|███▋      | 135523/371472 [10:46:04<17:46:47,  3.69it/s]
 36%|███▋      | 135524/371472 [10:46:04<17:48:50,  3.68it/s]
 36%|███▋      | 135525/371472 [10:46:05<17:59:46,  3.64it/s]
 36%|███▋      | 135526/371472 [10:46:05<17:27:57,  3.75it/s]
 36%|███▋      | 135527/371472 [10:46:05<17:14:56,  3.80it/s]
 36%|███▋      | 135528/371472 [10:46:06<17:08:18,  3.82it/s]
 36%|███▋      | 135529/371472 [10:46:06<17:17:03,  3.79it/s]
 36%|███▋      | 135530/371472 [10:46:06<17:58:22,  3.65it/s]
 36%|███▋      | 135531/371472 [10:46:06<17:31:11,  3.74it/s]
 36%|███▋      | 135532/371472 [10:46:07<17:16:26,  3.79it/s]
 36%|███▋      | 135533/371472 [10:46:07<16:37:58,  3.94it/s]
 36%|███▋      | 135534/371472 [10:46:07<16:54:59,  3.87it/s]
 36%|███▋      | 135535/371472 [10:46:07<17:05:26,  3.83it/s]
 36%|███▋      | 135536/371472 [10:46:08<17:02:16,  3.85it/s]
 36%|███▋      | 135537/371472 [10:46:08<17:18:13,  3.79it/s]
 36%|███▋      | 135538/371472 [10:46:08<17:18:40,  3.79it/s]
 36%|███▋      | 135539/371472 [10:46:08<17:39:34,  3.71it/s]
 36%|███▋      | 135540/371472 [10:46:09<18:58:46,  3.45it/s]
                                                             
{'loss': 3.1655, 'learning_rate': 6.71922471934323e-07, 'epoch': 5.84}

 36%|███▋      | 135540/371472 [10:46:09<18:58:46,  3.45it/s]
 36%|███▋      | 135541/371472 [10:46:09<18:02:35,  3.63it/s]
 36%|███▋      | 135542/371472 [10:46:09<18:05:28,  3.62it/s]
 36%|███▋      | 135543/371472 [10:46:10<18:12:57,  3.60it/s]
 36%|███▋      | 135544/371472 [10:46:10<17:22:40,  3.77it/s]
 36%|███▋      | 135545/371472 [10:46:10<18:23:29,  3.56it/s]
 36%|███▋      | 135546/371472 [10:46:10<19:54:48,  3.29it/s]
 36%|███▋      | 135547/371472 [10:46:11<19:27:07,  3.37it/s]
 36%|███▋      | 135548/371472 [10:46:11<19:57:10,  3.28it/s]
 36%|███▋      | 135549/371472 [10:46:11<19:27:15,  3.37it/s]
 36%|███▋      | 135550/371472 [10:46:12<19:44:20,  3.32it/s]
 36%|███▋      | 135551/371472 [10:46:12<19:23:52,  3.38it/s]
 36%|███▋      | 135552/371472 [10:46:12<18:47:13,  3.49it/s]
 36%|███▋      | 135553/371472 [10:46:12<17:38:34,  3.71it/s]
 36%|███▋      | 135554/371472 [10:46:13<17:52:46,  3.67it/s]
 36%|███▋      | 135555/371472 [10:46:13<17:57:32,  3.65it/s]
 36%|███▋      | 135556/371472 [10:46:13<17:51:51,  3.67it/s]
 36%|███▋      | 135557/371472 [10:46:14<19:25:31,  3.37it/s]
 36%|███▋      | 135558/371472 [10:46:14<19:27:29,  3.37it/s]
 36%|███▋      | 135559/371472 [10:46:14<19:35:20,  3.35it/s]
 36%|███▋      | 135560/371472 [10:46:15<19:40:47,  3.33it/s]
                                                             
{'loss': 3.1493, 'learning_rate': 6.718739899588441e-07, 'epoch': 5.84}

 36%|███▋      | 135560/371472 [10:46:15<19:40:47,  3.33it/s]
 36%|███▋      | 135561/371472 [10:46:15<18:25:37,  3.56it/s]
 36%|███▋      | 135562/371472 [10:46:15<18:19:01,  3.58it/s]
 36%|███▋      | 135563/371472 [10:46:15<19:11:18,  3.42it/s]
 36%|███▋      | 135564/371472 [10:46:16<18:33:47,  3.53it/s]
 36%|███▋      | 135565/371472 [10:46:16<18:03:25,  3.63it/s]
 36%|███▋      | 135566/371472 [10:46:16<18:44:17,  3.50it/s]
 36%|███▋      | 135567/371472 [10:46:16<18:34:40,  3.53it/s]
 36%|███▋      | 135568/371472 [10:46:17<18:24:33,  3.56it/s]
 36%|███▋      | 135569/371472 [10:46:17<17:26:22,  3.76it/s]
 36%|███▋      | 135570/371472 [10:46:17<17:44:47,  3.69it/s]
 36%|███▋      | 135571/371472 [10:46:18<18:03:19,  3.63it/s]
 36%|███▋      | 135572/371472 [10:46:18<18:47:49,  3.49it/s]
 36%|███▋      | 135573/371472 [10:46:18<19:00:48,  3.45it/s]
 36%|███▋      | 135574/371472 [10:46:19<21:00:36,  3.12it/s]
 36%|███▋      | 135575/371472 [10:46:19<19:59:27,  3.28it/s]
 36%|███▋      | 135576/371472 [10:46:19<19:11:01,  3.42it/s]
 36%|███▋      | 135577/371472 [10:46:19<18:44:30,  3.50it/s]
 36%|███▋      | 135578/371472 [10:46:20<19:41:11,  3.33it/s]
 36%|███▋      | 135579/371472 [10:46:20<18:48:23,  3.48it/s]
 36%|███▋      | 135580/371472 [10:46:20<18:20:49,  3.57it/s]
                                                             
{'loss': 3.1491, 'learning_rate': 6.718255079833652e-07, 'epoch': 5.84}

 36%|███▋      | 135580/371472 [10:46:20<18:20:49,  3.57it/s]
 36%|███▋      | 135581/371472 [10:46:21<18:12:19,  3.60it/s]
 36%|███▋      | 135582/371472 [10:46:21<17:32:57,  3.73it/s]
 36%|███▋      | 135583/371472 [10:46:21<17:59:57,  3.64it/s]
 36%|███▋      | 135584/371472 [10:46:21<17:39:58,  3.71it/s]
 36%|███▋      | 135585/371472 [10:46:22<20:08:04,  3.25it/s]
 36%|███▋      | 135586/371472 [10:46:22<18:53:46,  3.47it/s]
 36%|███▋      | 135587/371472 [10:46:22<18:36:26,  3.52it/s]
 37%|███▋      | 135588/371472 [10:46:22<17:43:19,  3.70it/s]
 37%|███▋      | 135589/371472 [10:46:23<18:24:13,  3.56it/s]
 37%|███▋      | 135590/371472 [10:46:23<18:15:31,  3.59it/s]
 37%|███▋      | 135591/371472 [10:46:23<17:29:07,  3.75it/s]
 37%|███▋      | 135592/371472 [10:46:24<17:05:24,  3.83it/s]
 37%|███▋      | 135593/371472 [10:46:24<17:55:49,  3.65it/s]
 37%|███▋      | 135594/371472 [10:46:24<17:46:28,  3.69it/s]
 37%|███▋      | 135595/371472 [10:46:24<17:04:59,  3.84it/s]
 37%|███▋      | 135596/371472 [10:46:25<16:59:50,  3.85it/s]
 37%|███▋      | 135597/371472 [10:46:25<16:43:50,  3.92it/s]
 37%|███▋      | 135598/371472 [10:46:25<16:45:39,  3.91it/s]
 37%|███▋      | 135599/371472 [10:46:25<17:23:08,  3.77it/s]
 37%|███▋      | 135600/371472 [10:46:26<17:34:26,  3.73it/s]
                                                             
{'loss': 2.9958, 'learning_rate': 6.717770260078865e-07, 'epoch': 5.84}

 37%|███▋      | 135600/371472 [10:46:26<17:34:26,  3.73it/s]
 37%|███▋      | 135601/371472 [10:46:26<18:04:56,  3.62it/s]
 37%|███▋      | 135602/371472 [10:46:26<17:18:06,  3.79it/s]
 37%|███▋      | 135603/371472 [10:46:26<16:59:15,  3.86it/s]
 37%|███▋      | 135604/371472 [10:46:27<17:21:27,  3.77it/s]
 37%|███▋      | 135605/371472 [10:46:27<17:04:47,  3.84it/s]
 37%|███▋      | 135606/371472 [10:46:27<17:23:06,  3.77it/s]
 37%|███▋      | 135607/371472 [10:46:27<17:02:26,  3.84it/s]
 37%|███▋      | 135608/371472 [10:46:28<17:48:37,  3.68it/s]
 37%|███▋      | 135609/371472 [10:46:28<19:21:36,  3.38it/s]
 37%|███▋      | 135610/371472 [10:46:28<19:45:13,  3.32it/s]
 37%|███▋      | 135611/371472 [10:46:29<19:26:55,  3.37it/s]
 37%|███▋      | 135612/371472 [10:46:29<20:25:28,  3.21it/s]
 37%|███▋      | 135613/371472 [10:46:29<21:37:42,  3.03it/s]
 37%|███▋      | 135614/371472 [10:46:30<21:16:16,  3.08it/s]
 37%|███▋      | 135615/371472 [10:46:30<20:10:27,  3.25it/s]
 37%|███▋      | 135616/371472 [10:46:30<19:03:33,  3.44it/s]
 37%|███▋      | 135617/371472 [10:46:31<18:36:19,  3.52it/s]
 37%|███▋      | 135618/371472 [10:46:31<19:19:46,  3.39it/s]
 37%|███▋      | 135619/371472 [10:46:31<18:36:17,  3.52it/s]
 37%|███▋      | 135620/371472 [10:46:31<18:10:17,  3.61it/s]
                                                             
{'loss': 3.2048, 'learning_rate': 6.717285440324075e-07, 'epoch': 5.84}

 37%|███▋      | 135620/371472 [10:46:31<18:10:17,  3.61it/s]
 37%|███▋      | 135621/371472 [10:46:32<17:57:42,  3.65it/s]
 37%|███▋      | 135622/371472 [10:46:32<17:16:00,  3.79it/s]
 37%|███▋      | 135623/371472 [10:46:32<18:00:13,  3.64it/s]
 37%|███▋      | 135624/371472 [10:46:32<17:33:42,  3.73it/s]
 37%|███▋      | 135625/371472 [10:46:33<18:00:18,  3.64it/s]
 37%|███▋      | 135626/371472 [10:46:33<17:20:48,  3.78it/s]
 37%|███▋      | 135627/371472 [10:46:33<17:18:19,  3.79it/s]
 37%|███▋      | 135628/371472 [10:46:33<17:07:33,  3.83it/s]
 37%|███▋      | 135629/371472 [10:46:34<16:43:10,  3.92it/s]
 37%|███▋      | 135630/371472 [10:46:34<17:11:59,  3.81it/s]
 37%|███▋      | 135631/371472 [10:46:34<17:27:05,  3.75it/s]
 37%|███▋      | 135632/371472 [10:46:35<18:37:16,  3.52it/s]
 37%|███▋      | 135633/371472 [10:46:35<19:18:03,  3.39it/s]
 37%|███▋      | 135634/371472 [10:46:35<18:14:34,  3.59it/s]
 37%|███▋      | 135635/371472 [10:46:35<18:52:40,  3.47it/s]
 37%|███▋      | 135636/371472 [10:46:36<17:55:14,  3.66it/s]
 37%|███▋      | 135637/371472 [10:46:36<17:46:57,  3.68it/s]
 37%|███▋      | 135638/371472 [10:46:36<18:05:03,  3.62it/s]
 37%|███▋      | 135639/371472 [10:46:37<17:08:49,  3.82it/s]
 37%|███▋      | 135640/371472 [10:46:37<18:03:10,  3.63it/s]
                                                             
{'loss': 3.1827, 'learning_rate': 6.716800620569285e-07, 'epoch': 5.84}

 37%|███▋      | 135640/371472 [10:46:37<18:03:10,  3.63it/s]
 37%|███▋      | 135641/371472 [10:46:37<19:36:25,  3.34it/s]
 37%|███▋      | 135642/371472 [10:46:37<19:06:02,  3.43it/s]
 37%|███▋      | 135643/371472 [10:46:38<18:35:56,  3.52it/s]
 37%|███▋      | 135644/371472 [10:46:38<17:48:24,  3.68it/s]
 37%|███▋      | 135645/371472 [10:46:38<17:32:00,  3.74it/s]
 37%|███▋      | 135646/371472 [10:46:39<19:53:57,  3.29it/s]
 37%|███▋      | 135647/371472 [10:46:39<18:40:27,  3.51it/s]
 37%|███▋      | 135648/371472 [10:46:39<19:05:28,  3.43it/s]
 37%|███▋      | 135649/371472 [10:46:39<19:51:46,  3.30it/s]
 37%|███▋      | 135650/371472 [10:46:40<19:24:25,  3.38it/s]
 37%|███▋      | 135651/371472 [10:46:40<18:57:22,  3.46it/s]
 37%|███▋      | 135652/371472 [10:46:40<18:34:13,  3.53it/s]
 37%|███▋      | 135653/371472 [10:46:41<18:35:57,  3.52it/s]
 37%|███▋      | 135654/371472 [10:46:41<18:01:06,  3.64it/s]
 37%|███▋      | 135655/371472 [10:46:41<20:20:18,  3.22it/s]
 37%|███▋      | 135656/371472 [10:46:42<19:44:22,  3.32it/s]
 37%|███▋      | 135657/371472 [10:46:42<19:24:27,  3.38it/s]
 37%|███▋      | 135658/371472 [10:46:42<22:17:15,  2.94it/s]
 37%|███▋      | 135659/371472 [10:46:43<20:48:38,  3.15it/s]
 37%|███▋      | 135660/371472 [10:46:43<19:58:15,  3.28it/s]
                                                             
{'loss': 3.0809, 'learning_rate': 6.716315800814497e-07, 'epoch': 5.84}

 37%|███▋      | 135660/371472 [10:46:43<19:58:15,  3.28it/s]
 37%|███▋      | 135661/371472 [10:46:43<18:52:44,  3.47it/s]
 37%|███▋      | 135662/371472 [10:46:43<18:49:29,  3.48it/s]
 37%|███▋      | 135663/371472 [10:46:44<18:22:14,  3.57it/s]
 37%|███▋      | 135664/371472 [10:46:44<18:23:37,  3.56it/s]
 37%|███▋      | 135665/371472 [10:46:44<17:53:41,  3.66it/s]
 37%|███▋      | 135666/371472 [10:46:44<18:14:49,  3.59it/s]
 37%|███▋      | 135667/371472 [10:46:45<17:20:49,  3.78it/s]
 37%|███▋      | 135668/371472 [10:46:45<17:16:17,  3.79it/s]
 37%|███▋      | 135669/371472 [10:46:45<16:51:33,  3.89it/s]
 37%|███▋      | 135670/371472 [10:46:45<17:28:35,  3.75it/s]
 37%|███▋      | 135671/371472 [10:46:46<18:25:29,  3.56it/s]
 37%|███▋      | 135672/371472 [10:46:46<18:48:20,  3.48it/s]
 37%|███▋      | 135673/371472 [10:46:46<19:24:35,  3.37it/s]
 37%|███▋      | 135674/371472 [10:46:47<19:17:48,  3.39it/s]
 37%|███▋      | 135675/371472 [10:46:47<18:28:07,  3.55it/s]
 37%|███▋      | 135676/371472 [10:46:47<18:19:26,  3.57it/s]
 37%|███▋      | 135677/371472 [10:46:47<17:52:08,  3.67it/s]
 37%|███▋      | 135678/371472 [10:46:48<17:54:59,  3.66it/s]
 37%|███▋      | 135679/371472 [10:46:48<17:58:09,  3.64it/s]
 37%|███▋      | 135680/371472 [10:46:48<18:28:56,  3.54it/s]
                                                             
{'loss': 3.0137, 'learning_rate': 6.71583098105971e-07, 'epoch': 5.84}

 37%|███▋      | 135680/371472 [10:46:48<18:28:56,  3.54it/s]
 37%|███▋      | 135681/371472 [10:46:49<17:49:58,  3.67it/s]
 37%|███▋      | 135682/371472 [10:46:49<18:49:38,  3.48it/s]
 37%|███▋      | 135683/371472 [10:46:49<19:28:06,  3.36it/s]
 37%|███▋      | 135684/371472 [10:46:50<20:53:09,  3.14it/s]
 37%|███▋      | 135685/371472 [10:46:50<20:42:47,  3.16it/s]
 37%|███▋      | 135686/371472 [10:46:50<20:22:25,  3.21it/s]
 37%|███▋      | 135687/371472 [10:46:50<20:25:33,  3.21it/s]
 37%|███▋      | 135688/371472 [10:46:51<20:02:19,  3.27it/s]
 37%|███▋      | 135689/371472 [10:46:51<19:30:43,  3.36it/s]
 37%|███▋      | 135690/371472 [10:46:51<18:59:49,  3.45it/s]
 37%|███▋      | 135691/371472 [10:46:52<18:07:36,  3.61it/s]
 37%|███▋      | 135692/371472 [10:46:52<18:23:06,  3.56it/s]
 37%|███▋      | 135693/371472 [10:46:52<18:25:05,  3.56it/s]
 37%|███▋      | 135694/371472 [10:46:52<18:03:07,  3.63it/s]
 37%|███▋      | 135695/371472 [10:46:53<17:40:10,  3.71it/s]
 37%|███▋      | 135696/371472 [10:46:53<17:24:49,  3.76it/s]
 37%|███▋      | 135697/371472 [10:46:53<17:21:16,  3.77it/s]
 37%|███▋      | 135698/371472 [10:46:53<17:35:47,  3.72it/s]
 37%|███▋      | 135699/371472 [10:46:54<18:05:25,  3.62it/s]
 37%|███▋      | 135700/371472 [10:46:54<18:15:44,  3.59it/s]
                                                             
{'loss': 3.0158, 'learning_rate': 6.715346161304918e-07, 'epoch': 5.84}

 37%|███▋      | 135700/371472 [10:46:54<18:15:44,  3.59it/s]
 37%|███▋      | 135701/371472 [10:46:54<17:40:24,  3.71it/s]
 37%|███▋      | 135702/371472 [10:46:55<17:11:14,  3.81it/s]
 37%|███▋      | 135703/371472 [10:46:55<17:41:11,  3.70it/s]
 37%|███▋      | 135704/371472 [10:46:55<17:52:24,  3.66it/s]
 37%|███▋      | 135705/371472 [10:46:55<18:08:29,  3.61it/s]
 37%|███▋      | 135706/371472 [10:46:56<18:37:11,  3.52it/s]
 37%|███▋      | 135707/371472 [10:46:56<21:00:14,  3.12it/s]
 37%|███▋      | 135708/371472 [10:46:56<19:49:43,  3.30it/s]
 37%|███▋      | 135709/371472 [10:46:57<19:26:10,  3.37it/s]
 37%|███▋      | 135710/371472 [10:46:57<18:40:49,  3.51it/s]
 37%|███▋      | 135711/371472 [10:46:57<18:31:31,  3.54it/s]
 37%|███▋      | 135712/371472 [10:46:57<19:00:48,  3.44it/s]
 37%|███▋      | 135713/371472 [10:46:58<18:48:49,  3.48it/s]
 37%|███▋      | 135714/371472 [10:46:58<19:11:24,  3.41it/s]
 37%|███▋      | 135715/371472 [10:46:58<18:59:49,  3.45it/s]
 37%|███▋      | 135716/371472 [10:46:59<18:19:45,  3.57it/s]
 37%|███▋      | 135717/371472 [10:46:59<17:51:21,  3.67it/s]
 37%|███▋      | 135718/371472 [10:46:59<17:51:56,  3.67it/s]
 37%|███▋      | 135719/371472 [10:46:59<17:32:53,  3.73it/s]
 37%|███▋      | 135720/371472 [10:47:00<17:12:06,  3.81it/s]
                                                             
{'loss': 3.1452, 'learning_rate': 6.71486134155013e-07, 'epoch': 5.85}

 37%|███▋      | 135720/371472 [10:47:00<17:12:06,  3.81it/s]
 37%|███▋      | 135721/371472 [10:47:00<18:04:17,  3.62it/s]
 37%|███▋      | 135722/371472 [10:47:00<18:53:07,  3.47it/s]
 37%|███▋      | 135723/371472 [10:47:01<19:55:58,  3.29it/s]
 37%|███▋      | 135724/371472 [10:47:01<20:24:52,  3.21it/s]
 37%|███▋      | 135725/371472 [10:47:01<20:09:43,  3.25it/s]
 37%|███▋      | 135726/371472 [10:47:01<19:11:34,  3.41it/s]
 37%|███▋      | 135727/371472 [10:47:02<18:47:31,  3.48it/s]
 37%|███▋      | 135728/371472 [10:47:02<18:11:31,  3.60it/s]
 37%|███▋      | 135729/371472 [10:47:02<17:44:05,  3.69it/s]
 37%|███▋      | 135730/371472 [10:47:03<18:08:38,  3.61it/s]
 37%|███▋      | 135731/371472 [10:47:03<19:02:46,  3.44it/s]
 37%|███▋      | 135732/371472 [10:47:03<21:07:37,  3.10it/s]
 37%|███▋      | 135733/371472 [10:47:04<21:07:43,  3.10it/s]
 37%|███▋      | 135734/371472 [10:47:04<19:49:48,  3.30it/s]
 37%|███▋      | 135735/371472 [10:47:04<19:21:32,  3.38it/s]
 37%|███▋      | 135736/371472 [10:47:04<18:37:54,  3.51it/s]
 37%|███▋      | 135737/371472 [10:47:05<18:02:30,  3.63it/s]
 37%|███▋      | 135738/371472 [10:47:05<22:34:03,  2.90it/s]
 37%|███▋      | 135739/371472 [10:47:05<20:28:06,  3.20it/s]
 37%|███▋      | 135740/371472 [10:47:06<20:43:33,  3.16it/s]
                                                             
{'loss': 3.0691, 'learning_rate': 6.714376521795342e-07, 'epoch': 5.85}

 37%|███▋      | 135740/371472 [10:47:06<20:43:33,  3.16it/s]
 37%|███▋      | 135741/371472 [10:47:06<21:20:41,  3.07it/s]
 37%|███▋      | 135742/371472 [10:47:06<22:52:10,  2.86it/s]
 37%|███▋      | 135743/371472 [10:47:07<21:31:24,  3.04it/s]
 37%|███▋      | 135744/371472 [10:47:07<20:02:07,  3.27it/s]
 37%|███▋      | 135745/371472 [10:47:07<20:19:13,  3.22it/s]
 37%|███▋      | 135746/371472 [10:47:08<19:02:31,  3.44it/s]
 37%|███▋      | 135747/371472 [10:47:08<18:29:07,  3.54it/s]
 37%|███▋      | 135748/371472 [10:47:08<17:51:39,  3.67it/s]
 37%|███▋      | 135749/371472 [10:47:08<18:15:06,  3.59it/s]
 37%|███▋      | 135750/371472 [10:47:09<17:51:41,  3.67it/s]
 37%|███▋      | 135751/371472 [10:47:09<17:31:51,  3.73it/s]
 37%|███▋      | 135752/371472 [10:47:09<18:19:38,  3.57it/s]
 37%|███▋      | 135753/371472 [10:47:09<18:22:27,  3.56it/s]
 37%|███▋      | 135754/371472 [10:47:10<19:06:28,  3.43it/s]
 37%|███▋      | 135755/371472 [10:47:10<18:16:27,  3.58it/s]
 37%|███▋      | 135756/371472 [10:47:10<17:55:31,  3.65it/s]
 37%|███▋      | 135757/371472 [10:47:11<18:01:04,  3.63it/s]
 37%|███▋      | 135758/371472 [10:47:11<20:21:13,  3.22it/s]
 37%|███▋      | 135759/371472 [10:47:11<19:48:02,  3.31it/s]
 37%|███▋      | 135760/371472 [10:47:12<20:35:19,  3.18it/s]
                                                             
{'loss': 3.2708, 'learning_rate': 6.713891702040553e-07, 'epoch': 5.85}

 37%|███▋      | 135760/371472 [10:47:12<20:35:19,  3.18it/s]
 37%|███▋      | 135761/371472 [10:47:12<19:49:43,  3.30it/s]
 37%|███▋      | 135762/371472 [10:47:12<18:27:11,  3.55it/s]
 37%|███▋      | 135763/371472 [10:47:12<18:56:30,  3.46it/s]
 37%|███▋      | 135764/371472 [10:47:13<18:31:52,  3.53it/s]
 37%|███▋      | 135765/371472 [10:47:13<19:16:40,  3.40it/s]
 37%|███▋      | 135766/371472 [10:47:13<19:18:38,  3.39it/s]
 37%|███▋      | 135767/371472 [10:47:14<19:16:41,  3.40it/s]
 37%|███▋      | 135768/371472 [10:47:14<18:45:48,  3.49it/s]
 37%|███▋      | 135769/371472 [10:47:14<18:26:36,  3.55it/s]
 37%|███▋      | 135770/371472 [10:47:14<18:42:19,  3.50it/s]
 37%|███▋      | 135771/371472 [10:47:15<19:11:59,  3.41it/s]
 37%|███▋      | 135772/371472 [10:47:15<19:11:43,  3.41it/s]
 37%|███▋      | 135773/371472 [10:47:15<18:23:29,  3.56it/s]
 37%|███▋      | 135774/371472 [10:47:16<17:52:24,  3.66it/s]
 37%|███▋      | 135775/371472 [10:47:16<17:59:01,  3.64it/s]
 37%|███▋      | 135776/371472 [10:47:16<17:37:24,  3.72it/s]
 37%|███▋      | 135777/371472 [10:47:16<18:38:39,  3.51it/s]
 37%|███▋      | 135778/371472 [10:47:17<17:48:53,  3.68it/s]
 37%|███▋      | 135779/371472 [10:47:17<18:44:17,  3.49it/s]
 37%|███▋      | 135780/371472 [10:47:17<18:06:03,  3.62it/s]
                                                             
{'loss': 3.1081, 'learning_rate': 6.713406882285762e-07, 'epoch': 5.85}

 37%|███▋      | 135780/371472 [10:47:17<18:06:03,  3.62it/s]
 37%|███▋      | 135781/371472 [10:47:18<18:20:43,  3.57it/s]
 37%|███▋      | 135782/371472 [10:47:18<18:37:02,  3.52it/s]
 37%|███▋      | 135783/371472 [10:47:18<18:18:22,  3.58it/s]
 37%|███▋      | 135784/371472 [10:47:18<17:55:16,  3.65it/s]
 37%|███▋      | 135785/371472 [10:47:19<19:54:31,  3.29it/s]
 37%|███▋      | 135786/371472 [10:47:19<19:43:06,  3.32it/s]
 37%|███▋      | 135787/371472 [10:47:19<18:34:07,  3.53it/s]
 37%|███▋      | 135788/371472 [10:47:20<19:01:32,  3.44it/s]
 37%|███▋      | 135789/371472 [10:47:20<20:01:47,  3.27it/s]
 37%|███▋      | 135790/371472 [10:47:20<19:05:10,  3.43it/s]
 37%|███▋      | 135791/371472 [10:47:20<18:19:47,  3.57it/s]
 37%|███▋      | 135792/371472 [10:47:21<18:26:34,  3.55it/s]
 37%|███▋      | 135793/371472 [10:47:21<21:23:42,  3.06it/s]
 37%|███▋      | 135794/371472 [10:47:21<21:17:07,  3.08it/s]
 37%|███▋      | 135795/371472 [10:47:22<19:47:59,  3.31it/s]
 37%|███▋      | 135796/371472 [10:47:22<19:21:43,  3.38it/s]
 37%|███▋      | 135797/371472 [10:47:22<19:46:47,  3.31it/s]
 37%|███▋      | 135798/371472 [10:47:23<18:31:55,  3.53it/s]
 37%|███▋      | 135799/371472 [10:47:23<18:22:40,  3.56it/s]
 37%|███▋      | 135800/371472 [10:47:23<19:14:58,  3.40it/s]
                                                             
{'loss': 3.166, 'learning_rate': 6.712922062530974e-07, 'epoch': 5.85}

 37%|███▋      | 135800/371472 [10:47:23<19:14:58,  3.40it/s]
 37%|███▋      | 135801/371472 [10:47:23<20:40:08,  3.17it/s]
 37%|███▋      | 135802/371472 [10:47:24<19:59:38,  3.27it/s]
 37%|███▋      | 135803/371472 [10:47:24<19:11:40,  3.41it/s]
 37%|███▋      | 135804/371472 [10:47:24<18:04:07,  3.62it/s]
 37%|███▋      | 135805/371472 [10:47:25<17:27:30,  3.75it/s]
 37%|███▋      | 135806/371472 [10:47:25<18:46:21,  3.49it/s]
 37%|███▋      | 135807/371472 [10:47:25<19:00:48,  3.44it/s]
 37%|███▋      | 135808/371472 [10:47:25<19:12:24,  3.41it/s]
 37%|███▋      | 135809/371472 [10:47:26<18:45:41,  3.49it/s]
 37%|███▋      | 135810/371472 [10:47:26<18:55:20,  3.46it/s]
 37%|███▋      | 135811/371472 [10:47:26<18:14:24,  3.59it/s]
 37%|███▋      | 135812/371472 [10:47:27<18:10:29,  3.60it/s]
 37%|███▋      | 135813/371472 [10:47:27<17:38:04,  3.71it/s]
 37%|███▋      | 135814/371472 [10:47:27<17:41:57,  3.70it/s]
 37%|███▋      | 135815/371472 [10:47:27<18:14:43,  3.59it/s]
 37%|███▋      | 135816/371472 [10:47:28<17:16:48,  3.79it/s]
 37%|███▋      | 135817/371472 [10:47:28<16:53:31,  3.88it/s]
 37%|███▋      | 135818/371472 [10:47:28<18:04:52,  3.62it/s]
 37%|███▋      | 135819/371472 [10:47:28<17:32:38,  3.73it/s]
 37%|███▋      | 135820/371472 [10:47:29<17:20:23,  3.78it/s]
                                                             
{'loss': 3.1383, 'learning_rate': 6.712437242776186e-07, 'epoch': 5.85}

 37%|███▋      | 135820/371472 [10:47:29<17:20:23,  3.78it/s]
 37%|███▋      | 135821/371472 [10:47:29<17:32:08,  3.73it/s]
 37%|███▋      | 135822/371472 [10:47:29<17:43:34,  3.69it/s]
 37%|███▋      | 135823/371472 [10:47:29<16:59:29,  3.85it/s]
 37%|███▋      | 135824/371472 [10:47:30<17:33:29,  3.73it/s]
 37%|███▋      | 135825/371472 [10:47:30<17:15:02,  3.79it/s]
 37%|███▋      | 135826/371472 [10:47:30<17:02:37,  3.84it/s]
 37%|███▋      | 135827/371472 [10:47:31<17:38:10,  3.71it/s]
 37%|███▋      | 135828/371472 [10:47:31<17:38:34,  3.71it/s]
 37%|███▋      | 135829/371472 [10:47:31<17:16:50,  3.79it/s]
 37%|███▋      | 135830/371472 [10:47:31<16:56:11,  3.86it/s]
 37%|███▋      | 135831/371472 [10:47:32<17:07:45,  3.82it/s]
 37%|███▋      | 135832/371472 [10:47:32<17:34:00,  3.73it/s]
 37%|███▋      | 135833/371472 [10:47:32<17:54:25,  3.66it/s]
 37%|███▋      | 135834/371472 [10:47:32<17:29:53,  3.74it/s]
 37%|███▋      | 135835/371472 [10:47:33<17:29:14,  3.74it/s]
 37%|███▋      | 135836/371472 [10:47:33<17:41:01,  3.70it/s]
 37%|███▋      | 135837/371472 [10:47:33<18:33:08,  3.53it/s]
 37%|███▋      | 135838/371472 [10:47:34<19:46:59,  3.31it/s]
 37%|███▋      | 135839/371472 [10:47:34<19:12:46,  3.41it/s]
 37%|███▋      | 135840/371472 [10:47:34<19:17:11,  3.39it/s]
                                                             
{'loss': 3.2279, 'learning_rate': 6.711952423021396e-07, 'epoch': 5.85}

 37%|███▋      | 135840/371472 [10:47:34<19:17:11,  3.39it/s]
 37%|███▋      | 135841/371472 [10:47:35<20:46:27,  3.15it/s]
 37%|███▋      | 135842/371472 [10:47:35<19:12:17,  3.41it/s]
 37%|███▋      | 135843/371472 [10:47:35<18:02:00,  3.63it/s]
 37%|███▋      | 135844/371472 [10:47:35<17:53:58,  3.66it/s]
 37%|███▋      | 135845/371472 [10:47:36<17:20:47,  3.77it/s]
 37%|███▋      | 135846/371472 [10:47:36<16:57:19,  3.86it/s]
 37%|███▋      | 135847/371472 [10:47:36<16:57:32,  3.86it/s]
 37%|███▋      | 135848/371472 [10:47:36<17:52:28,  3.66it/s]
 37%|███▋      | 135849/371472 [10:47:37<17:57:22,  3.64it/s]
 37%|███▋      | 135850/371472 [10:47:37<17:43:37,  3.69it/s]
 37%|███▋      | 135851/371472 [10:47:37<17:46:01,  3.68it/s]
 37%|███▋      | 135852/371472 [10:47:37<17:14:21,  3.80it/s]
 37%|███▋      | 135853/371472 [10:47:38<16:51:14,  3.88it/s]
 37%|███▋      | 135854/371472 [10:47:38<17:10:54,  3.81it/s]
 37%|███▋      | 135855/371472 [10:47:38<17:32:18,  3.73it/s]
 37%|███▋      | 135856/371472 [10:47:39<20:52:01,  3.14it/s]
 37%|███▋      | 135857/371472 [10:47:39<20:10:00,  3.25it/s]
 37%|███▋      | 135858/371472 [10:47:39<19:00:36,  3.44it/s]
 37%|███▋      | 135859/371472 [10:47:39<19:25:08,  3.37it/s]
 37%|███▋      | 135860/371472 [10:47:40<20:24:58,  3.21it/s]
                                                             
{'loss': 3.009, 'learning_rate': 6.711467603266607e-07, 'epoch': 5.85}

 37%|███▋      | 135860/371472 [10:47:40<20:24:58,  3.21it/s]
 37%|███▋      | 135861/371472 [10:47:40<20:51:22,  3.14it/s]
 37%|███▋      | 135862/371472 [10:47:40<19:14:50,  3.40it/s]
 37%|███▋      | 135863/371472 [10:47:41<18:57:54,  3.45it/s]
 37%|███▋      | 135864/371472 [10:47:41<19:37:18,  3.34it/s]
 37%|███▋      | 135865/371472 [10:47:41<19:10:06,  3.41it/s]
 37%|███▋      | 135866/371472 [10:47:42<19:07:59,  3.42it/s]
 37%|███▋      | 135867/371472 [10:47:42<18:54:45,  3.46it/s]
 37%|███▋      | 135868/371472 [10:47:42<20:36:06,  3.18it/s]
 37%|███▋      | 135869/371472 [10:47:42<19:44:46,  3.31it/s]
 37%|███▋      | 135870/371472 [10:47:43<18:43:04,  3.50it/s]
 37%|███▋      | 135871/371472 [10:47:43<18:18:15,  3.58it/s]
 37%|███▋      | 135872/371472 [10:47:43<18:00:47,  3.63it/s]
 37%|███▋      | 135873/371472 [10:47:44<18:26:24,  3.55it/s]
 37%|███▋      | 135874/371472 [10:47:44<18:57:34,  3.45it/s]
 37%|███▋      | 135875/371472 [10:47:44<18:30:44,  3.54it/s]
 37%|███▋      | 135876/371472 [10:47:44<18:32:49,  3.53it/s]
 37%|███▋      | 135877/371472 [10:47:45<19:46:31,  3.31it/s]
 37%|███▋      | 135878/371472 [10:47:45<19:00:01,  3.44it/s]
 37%|███▋      | 135879/371472 [10:47:45<18:30:27,  3.54it/s]
 37%|███▋      | 135880/371472 [10:47:46<17:44:58,  3.69it/s]
                                                             
{'loss': 3.1181, 'learning_rate': 6.710982783511819e-07, 'epoch': 5.85}

 37%|███▋      | 135880/371472 [10:47:46<17:44:58,  3.69it/s]
 37%|███▋      | 135881/371472 [10:47:46<17:16:54,  3.79it/s]
 37%|███▋      | 135882/371472 [10:47:46<17:50:44,  3.67it/s]
 37%|███▋      | 135883/371472 [10:47:46<18:21:30,  3.56it/s]
 37%|███▋      | 135884/371472 [10:47:47<17:43:54,  3.69it/s]
 37%|███▋      | 135885/371472 [10:47:47<17:49:54,  3.67it/s]
 37%|███▋      | 135886/371472 [10:47:47<17:41:12,  3.70it/s]
 37%|███▋      | 135887/371472 [10:47:47<17:51:38,  3.66it/s]
 37%|███▋      | 135888/371472 [10:47:48<18:09:24,  3.60it/s]
 37%|███▋      | 135889/371472 [10:47:48<18:19:13,  3.57it/s]
 37%|███▋      | 135890/371472 [10:47:48<18:38:16,  3.51it/s]
 37%|███▋      | 135891/371472 [10:47:49<17:58:08,  3.64it/s]
 37%|███▋      | 135892/371472 [10:47:49<18:34:21,  3.52it/s]
 37%|███▋      | 135893/371472 [10:47:49<17:56:28,  3.65it/s]
 37%|███▋      | 135894/371472 [10:47:49<18:07:54,  3.61it/s]
 37%|███▋      | 135895/371472 [10:47:50<17:56:35,  3.65it/s]
 37%|███▋      | 135896/371472 [10:47:50<18:16:14,  3.58it/s]
 37%|███▋      | 135897/371472 [10:47:50<17:53:04,  3.66it/s]
 37%|███▋      | 135898/371472 [10:47:51<18:09:16,  3.60it/s]
 37%|███▋      | 135899/371472 [10:47:51<19:00:18,  3.44it/s]
 37%|███▋      | 135900/371472 [10:47:51<18:40:33,  3.50it/s]
                                                             
{'loss': 3.1606, 'learning_rate': 6.71049796375703e-07, 'epoch': 5.85}

 37%|███▋      | 135900/371472 [10:47:51<18:40:33,  3.50it/s]
 37%|███▋      | 135901/371472 [10:47:51<17:44:27,  3.69it/s]
 37%|███▋      | 135902/371472 [10:47:52<19:05:56,  3.43it/s]
 37%|███▋      | 135903/371472 [10:47:52<18:24:40,  3.55it/s]
 37%|███▋      | 135904/371472 [10:47:52<17:52:18,  3.66it/s]
 37%|███▋      | 135905/371472 [10:47:52<17:23:45,  3.76it/s]
 37%|███▋      | 135906/371472 [10:47:53<17:52:46,  3.66it/s]
 37%|███▋      | 135907/371472 [10:47:53<18:00:44,  3.63it/s]
 37%|███▋      | 135908/371472 [10:47:53<17:38:36,  3.71it/s]
 37%|███▋      | 135909/371472 [10:47:54<18:30:52,  3.53it/s]
 37%|███▋      | 135910/371472 [10:47:54<17:49:38,  3.67it/s]
 37%|███▋      | 135911/371472 [10:47:54<18:08:36,  3.61it/s]
 37%|███▋      | 135912/371472 [10:47:54<19:19:54,  3.38it/s]
 37%|███▋      | 135913/371472 [10:47:55<19:08:55,  3.42it/s]
 37%|███▋      | 135914/371472 [10:47:55<18:51:32,  3.47it/s]
 37%|███▋      | 135915/371472 [10:47:55<19:07:46,  3.42it/s]
 37%|███▋      | 135916/371472 [10:47:56<19:23:12,  3.38it/s]
 37%|███▋      | 135917/371472 [10:47:56<19:18:17,  3.39it/s]
 37%|███▋      | 135918/371472 [10:47:56<21:07:19,  3.10it/s]
 37%|███▋      | 135919/371472 [10:47:57<19:52:28,  3.29it/s]
 37%|███▋      | 135920/371472 [10:47:57<18:50:51,  3.47it/s]
                                                             
{'loss': 3.0974, 'learning_rate': 6.71001314400224e-07, 'epoch': 5.85}

 37%|███▋      | 135920/371472 [10:47:57<18:50:51,  3.47it/s]
 37%|███▋      | 135921/371472 [10:47:57<18:34:23,  3.52it/s]
 37%|███▋      | 135922/371472 [10:47:57<18:19:25,  3.57it/s]
 37%|███▋      | 135923/371472 [10:47:58<18:30:09,  3.54it/s]
 37%|███▋      | 135924/371472 [10:47:58<18:46:40,  3.48it/s]
 37%|███▋      | 135925/371472 [10:47:58<18:27:38,  3.54it/s]
 37%|███▋      | 135926/371472 [10:47:59<18:16:16,  3.58it/s]
 37%|███▋      | 135927/371472 [10:47:59<18:07:12,  3.61it/s]
 37%|███▋      | 135928/371472 [10:47:59<17:16:45,  3.79it/s]
 37%|███▋      | 135929/371472 [10:47:59<19:40:39,  3.33it/s]
 37%|███▋      | 135930/371472 [10:48:00<20:07:04,  3.25it/s]
 37%|███▋      | 135931/371472 [10:48:00<21:57:56,  2.98it/s]
 37%|███▋      | 135932/371472 [10:48:00<20:32:54,  3.18it/s]
 37%|███▋      | 135933/371472 [10:48:01<19:10:21,  3.41it/s]
 37%|███▋      | 135934/371472 [10:48:01<19:09:30,  3.42it/s]
 37%|███▋      | 135935/371472 [10:48:01<18:23:28,  3.56it/s]
 37%|███▋      | 135936/371472 [10:48:01<17:54:08,  3.65it/s]
 37%|███▋      | 135937/371472 [10:48:02<18:26:35,  3.55it/s]
 37%|███▋      | 135938/371472 [10:48:02<17:21:43,  3.77it/s]
 37%|███▋      | 135939/371472 [10:48:02<17:11:13,  3.81it/s]
 37%|███▋      | 135940/371472 [10:48:02<17:36:40,  3.72it/s]
                                                             
{'loss': 3.0554, 'learning_rate': 6.709528324247451e-07, 'epoch': 5.86}

 37%|███▋      | 135940/371472 [10:48:03<17:36:40,  3.72it/s]
 37%|███▋      | 135941/371472 [10:48:03<17:46:31,  3.68it/s]
 37%|███▋      | 135942/371472 [10:48:03<17:38:43,  3.71it/s]
 37%|███▋      | 135943/371472 [10:48:03<17:28:06,  3.75it/s]
 37%|███▋      | 135944/371472 [10:48:04<18:37:03,  3.51it/s]
 37%|███▋      | 135945/371472 [10:48:04<17:51:50,  3.66it/s]
 37%|███▋      | 135946/371472 [10:48:04<17:34:12,  3.72it/s]
 37%|███▋      | 135947/371472 [10:48:04<19:05:36,  3.43it/s]
 37%|███▋      | 135948/371472 [10:48:05<18:28:42,  3.54it/s]
 37%|███▋      | 135949/371472 [10:48:05<18:32:53,  3.53it/s]
 37%|███▋      | 135950/371472 [10:48:05<18:53:16,  3.46it/s]
 37%|███▋      | 135951/371472 [10:48:06<19:26:29,  3.37it/s]
 37%|███▋      | 135952/371472 [10:48:06<19:28:51,  3.36it/s]
 37%|███▋      | 135953/371472 [10:48:06<18:26:13,  3.55it/s]
 37%|███▋      | 135954/371472 [10:48:06<17:40:42,  3.70it/s]
 37%|███▋      | 135955/371472 [10:48:07<17:29:20,  3.74it/s]
 37%|███▋      | 135956/371472 [10:48:07<18:30:21,  3.54it/s]
 37%|███▋      | 135957/371472 [10:48:07<18:20:11,  3.57it/s]
 37%|███▋      | 135958/371472 [10:48:08<18:32:19,  3.53it/s]
 37%|███▋      | 135959/371472 [10:48:08<18:37:49,  3.51it/s]
 37%|███▋      | 135960/371472 [10:48:08<18:08:57,  3.60it/s]
                                                             
{'loss': 3.292, 'learning_rate': 6.709043504492663e-07, 'epoch': 5.86}

 37%|███▋      | 135960/371472 [10:48:08<18:08:57,  3.60it/s]
 37%|███▋      | 135961/371472 [10:48:08<18:31:28,  3.53it/s]
 37%|███▋      | 135962/371472 [10:48:09<18:59:37,  3.44it/s]
 37%|███▋      | 135963/371472 [10:48:09<18:02:14,  3.63it/s]
 37%|███▋      | 135964/371472 [10:48:09<17:38:51,  3.71it/s]
 37%|███▋      | 135965/371472 [10:48:10<19:18:56,  3.39it/s]
 37%|███▋      | 135966/371472 [10:48:10<20:25:35,  3.20it/s]
 37%|███▋      | 135967/371472 [10:48:10<20:17:06,  3.22it/s]
 37%|███▋      | 135968/371472 [10:48:10<19:18:33,  3.39it/s]
 37%|███▋      | 135969/371472 [10:48:11<18:50:54,  3.47it/s]
 37%|███▋      | 135970/371472 [10:48:11<18:01:59,  3.63it/s]
 37%|███▋      | 135971/371472 [10:48:11<18:08:19,  3.61it/s]
 37%|███▋      | 135972/371472 [10:48:12<18:53:58,  3.46it/s]
 37%|███▋      | 135973/371472 [10:48:12<18:25:58,  3.55it/s]
 37%|███▋      | 135974/371472 [10:48:12<18:44:47,  3.49it/s]
 37%|███▋      | 135975/371472 [10:48:12<18:49:58,  3.47it/s]
 37%|███▋      | 135976/371472 [10:48:13<18:50:26,  3.47it/s]
 37%|███▋      | 135977/371472 [10:48:13<18:44:20,  3.49it/s]
 37%|███▋      | 135978/371472 [10:48:13<18:16:33,  3.58it/s]
 37%|███▋      | 135979/371472 [10:48:14<18:35:09,  3.52it/s]
 37%|███▋      | 135980/371472 [10:48:14<17:32:25,  3.73it/s]
                                                             
{'loss': 3.1406, 'learning_rate': 6.708558684737875e-07, 'epoch': 5.86}

 37%|███▋      | 135980/371472 [10:48:14<17:32:25,  3.73it/s]
 37%|███▋      | 135981/371472 [10:48:14<18:10:09,  3.60it/s]
 37%|███▋      | 135982/371472 [10:48:14<18:07:42,  3.61it/s]
 37%|███▋      | 135983/371472 [10:48:15<18:52:03,  3.47it/s]
 37%|███▋      | 135984/371472 [10:48:15<18:44:21,  3.49it/s]
 37%|███▋      | 135985/371472 [10:48:15<18:18:08,  3.57it/s]
 37%|███▋      | 135986/371472 [10:48:16<17:53:36,  3.66it/s]
 37%|███▋      | 135987/371472 [10:48:16<21:45:06,  3.01it/s]
 37%|███▋      | 135988/371472 [10:48:16<22:06:37,  2.96it/s]
 37%|███▋      | 135989/371472 [10:48:17<20:36:00,  3.18it/s]
 37%|███▋      | 135990/371472 [10:48:17<19:47:19,  3.31it/s]
 37%|███▋      | 135991/371472 [10:48:17<19:16:24,  3.39it/s]
 37%|███▋      | 135992/371472 [10:48:17<18:39:45,  3.50it/s]
 37%|███▋      | 135993/371472 [10:48:18<18:20:48,  3.57it/s]
 37%|███▋      | 135994/371472 [10:48:18<18:32:33,  3.53it/s]
 37%|███▋      | 135995/371472 [10:48:18<20:21:28,  3.21it/s]
 37%|███▋      | 135996/371472 [10:48:19<20:59:26,  3.12it/s]
 37%|███▋      | 135997/371472 [10:48:19<19:22:02,  3.38it/s]
 37%|███▋      | 135998/371472 [10:48:19<18:17:51,  3.57it/s]
 37%|███▋      | 135999/371472 [10:48:19<18:02:36,  3.63it/s]
 37%|███▋      | 136000/371472 [10:48:20<18:48:39,  3.48it/s]
                                                             
{'loss': 3.2363, 'learning_rate': 6.708073864983085e-07, 'epoch': 5.86}

 37%|███▋      | 136000/371472 [10:48:20<18:48:39,  3.48it/s]
 37%|███▋      | 136001/371472 [10:48:20<18:36:41,  3.51it/s]
 37%|███▋      | 136002/371472 [10:48:20<17:51:46,  3.66it/s]
 37%|███▋      | 136003/371472 [10:48:21<18:07:26,  3.61it/s]
 37%|███▋      | 136004/371472 [10:48:21<17:56:52,  3.64it/s]
 37%|███▋      | 136005/371472 [10:48:21<18:26:35,  3.55it/s]
 37%|███▋      | 136006/371472 [10:48:21<17:55:40,  3.65it/s]
 37%|███▋      | 136007/371472 [10:48:22<17:27:50,  3.75it/s]
 37%|███▋      | 136008/371472 [10:48:22<17:30:55,  3.73it/s]
 37%|███▋      | 136009/371472 [10:48:22<18:21:51,  3.56it/s]
 37%|███▋      | 136010/371472 [10:48:22<18:11:04,  3.60it/s]
 37%|███▋      | 136011/371472 [10:48:23<17:56:00,  3.65it/s]
 37%|███▋      | 136012/371472 [10:48:23<18:42:48,  3.50it/s]
 37%|███▋      | 136013/371472 [10:48:23<18:54:16,  3.46it/s]
 37%|███▋      | 136014/371472 [10:48:24<18:44:31,  3.49it/s]
 37%|███▋      | 136015/371472 [10:48:24<18:56:12,  3.45it/s]
 37%|███▋      | 136016/371472 [10:48:24<17:57:44,  3.64it/s]
 37%|███▋      | 136017/371472 [10:48:25<18:51:54,  3.47it/s]
 37%|███▋      | 136018/371472 [10:48:25<18:13:49,  3.59it/s]
 37%|███▋      | 136019/371472 [10:48:25<18:12:02,  3.59it/s]
 37%|███▋      | 136020/371472 [10:48:25<17:56:32,  3.65it/s]
                                                             
{'loss': 3.164, 'learning_rate': 6.707589045228295e-07, 'epoch': 5.86}

 37%|███▋      | 136020/371472 [10:48:25<17:56:32,  3.65it/s]
 37%|███▋      | 136021/371472 [10:48:26<18:26:34,  3.55it/s]
 37%|███▋      | 136022/371472 [10:48:26<18:36:16,  3.52it/s]
 37%|███▋      | 136023/371472 [10:48:26<18:10:12,  3.60it/s]
 37%|███▋      | 136024/371472 [10:48:26<17:30:21,  3.74it/s]
 37%|███▋      | 136025/371472 [10:48:27<17:49:16,  3.67it/s]
 37%|███▋      | 136026/371472 [10:48:27<17:49:48,  3.67it/s]
 37%|███▋      | 136027/371472 [10:48:27<17:31:47,  3.73it/s]
 37%|███▋      | 136028/371472 [10:48:27<17:13:57,  3.80it/s]
 37%|███▋      | 136029/371472 [10:48:28<17:41:12,  3.70it/s]
 37%|███▋      | 136030/371472 [10:48:28<18:11:41,  3.59it/s]
 37%|███▋      | 136031/371472 [10:48:28<18:13:35,  3.59it/s]
 37%|███▋      | 136032/371472 [10:48:29<18:34:52,  3.52it/s]
 37%|███▋      | 136033/371472 [10:48:29<17:37:43,  3.71it/s]
 37%|███▋      | 136034/371472 [10:48:29<17:55:45,  3.65it/s]
 37%|███▋      | 136035/371472 [10:48:29<18:04:29,  3.62it/s]
 37%|███▋      | 136036/371472 [10:48:30<18:09:06,  3.60it/s]
 37%|███▋      | 136037/371472 [10:48:30<18:00:26,  3.63it/s]
 37%|███▋      | 136038/371472 [10:48:30<18:21:06,  3.56it/s]
 37%|███▋      | 136039/371472 [10:48:31<18:36:33,  3.51it/s]
 37%|███▋      | 136040/371472 [10:48:31<18:31:45,  3.53it/s]
                                                             
{'loss': 3.2286, 'learning_rate': 6.707104225473507e-07, 'epoch': 5.86}

 37%|███▋      | 136040/371472 [10:48:31<18:31:45,  3.53it/s]
 37%|███▋      | 136041/371472 [10:48:31<17:59:02,  3.64it/s]
 37%|███▋      | 136042/371472 [10:48:31<17:50:26,  3.67it/s]
 37%|███▋      | 136043/371472 [10:48:32<17:09:55,  3.81it/s]
 37%|███▋      | 136044/371472 [10:48:32<17:11:49,  3.80it/s]
 37%|███▋      | 136045/371472 [10:48:32<18:54:10,  3.46it/s]
 37%|███▋      | 136046/371472 [10:48:33<19:02:46,  3.43it/s]
 37%|███▋      | 136047/371472 [10:48:33<20:53:08,  3.13it/s]
 37%|███▋      | 136048/371472 [10:48:33<19:51:23,  3.29it/s]
 37%|███▋      | 136049/371472 [10:48:33<19:39:11,  3.33it/s]
 37%|███▋      | 136050/371472 [10:48:34<19:09:05,  3.41it/s]
 37%|███▋      | 136051/371472 [10:48:34<19:31:08,  3.35it/s]
 37%|███▋      | 136052/371472 [10:48:34<18:34:26,  3.52it/s]
 37%|███▋      | 136053/371472 [10:48:35<18:53:37,  3.46it/s]
 37%|███▋      | 136054/371472 [10:48:35<18:52:39,  3.46it/s]
 37%|███▋      | 136055/371472 [10:48:35<20:00:25,  3.27it/s]
 37%|███▋      | 136056/371472 [10:48:35<18:37:22,  3.51it/s]
 37%|███▋      | 136057/371472 [10:48:36<18:03:56,  3.62it/s]
 37%|███▋      | 136058/371472 [10:48:36<17:39:21,  3.70it/s]
 37%|███▋      | 136059/371472 [10:48:36<17:06:53,  3.82it/s]
 37%|███▋      | 136060/371472 [10:48:37<17:25:19,  3.75it/s]
                                                             
{'loss': 3.2019, 'learning_rate': 6.706619405718719e-07, 'epoch': 5.86}

 37%|███▋      | 136060/371472 [10:48:37<17:25:19,  3.75it/s]
 37%|███▋      | 136061/371472 [10:48:37<17:06:49,  3.82it/s]
 37%|███▋      | 136062/371472 [10:48:37<16:58:58,  3.85it/s]
 37%|███▋      | 136063/371472 [10:48:37<16:57:03,  3.86it/s]
 37%|███▋      | 136064/371472 [10:48:38<16:49:32,  3.89it/s]
 37%|███▋      | 136065/371472 [10:48:38<18:55:43,  3.45it/s]
 37%|███▋      | 136066/371472 [10:48:38<19:04:39,  3.43it/s]
 37%|███▋      | 136067/371472 [10:48:38<19:25:19,  3.37it/s]
 37%|███▋      | 136068/371472 [10:48:39<18:17:28,  3.57it/s]
 37%|███▋      | 136069/371472 [10:48:39<20:05:46,  3.25it/s]
 37%|███▋      | 136070/371472 [10:48:39<19:30:20,  3.35it/s]
 37%|███▋      | 136071/371472 [10:48:40<19:25:48,  3.37it/s]
 37%|███▋      | 136072/371472 [10:48:40<18:28:09,  3.54it/s]
 37%|███▋      | 136073/371472 [10:48:40<18:50:17,  3.47it/s]
 37%|███▋      | 136074/371472 [10:48:40<18:34:21,  3.52it/s]
 37%|███▋      | 136075/371472 [10:48:41<17:44:05,  3.69it/s]
 37%|███▋      | 136076/371472 [10:48:41<17:43:01,  3.69it/s]
 37%|███▋      | 136077/371472 [10:48:41<18:12:34,  3.59it/s]
 37%|███▋      | 136078/371472 [10:48:42<17:50:55,  3.66it/s]
 37%|███▋      | 136079/371472 [10:48:42<17:39:42,  3.70it/s]
 37%|███▋      | 136080/371472 [10:48:42<17:20:41,  3.77it/s]
                                                             
{'loss': 2.9319, 'learning_rate': 6.706134585963929e-07, 'epoch': 5.86}

 37%|███▋      | 136080/371472 [10:48:42<17:20:41,  3.77it/s]
 37%|███▋      | 136081/371472 [10:48:42<18:06:58,  3.61it/s]
 37%|███▋      | 136082/371472 [10:48:43<18:14:38,  3.58it/s]
 37%|███▋      | 136083/371472 [10:48:43<18:36:11,  3.51it/s]
 37%|███▋      | 136084/371472 [10:48:43<17:51:19,  3.66it/s]
 37%|███▋      | 136085/371472 [10:48:43<17:27:29,  3.75it/s]
 37%|███▋      | 136086/371472 [10:48:44<17:03:59,  3.83it/s]
 37%|███▋      | 136087/371472 [10:48:44<17:22:41,  3.76it/s]
 37%|███▋      | 136088/371472 [10:48:44<18:00:27,  3.63it/s]
 37%|███▋      | 136089/371472 [10:48:45<19:16:57,  3.39it/s]
 37%|███▋      | 136090/371472 [10:48:45<18:59:36,  3.44it/s]
 37%|███▋      | 136091/371472 [10:48:45<18:21:30,  3.56it/s]
 37%|███▋      | 136092/371472 [10:48:45<18:51:49,  3.47it/s]
 37%|███▋      | 136093/371472 [10:48:46<18:54:44,  3.46it/s]
 37%|███▋      | 136094/371472 [10:48:46<20:18:40,  3.22it/s]
 37%|███▋      | 136095/371472 [10:48:46<19:20:46,  3.38it/s]
 37%|███▋      | 136096/371472 [10:48:47<19:42:21,  3.32it/s]
 37%|███▋      | 136097/371472 [10:48:47<18:27:24,  3.54it/s]
 37%|███▋      | 136098/371472 [10:48:47<18:49:39,  3.47it/s]
 37%|███▋      | 136099/371472 [10:48:48<18:33:45,  3.52it/s]
 37%|███▋      | 136100/371472 [10:48:48<18:09:35,  3.60it/s]
                                                             
{'loss': 3.1988, 'learning_rate': 6.70564976620914e-07, 'epoch': 5.86}

 37%|███▋      | 136100/371472 [10:48:48<18:09:35,  3.60it/s]
 37%|███▋      | 136101/371472 [10:48:48<18:44:15,  3.49it/s]
 37%|███▋      | 136102/371472 [10:48:48<20:16:22,  3.23it/s]
 37%|███▋      | 136103/371472 [10:48:49<21:52:15,  2.99it/s]
 37%|███▋      | 136104/371472 [10:48:49<20:43:37,  3.15it/s]
 37%|███▋      | 136105/371472 [10:48:49<19:16:13,  3.39it/s]
 37%|███▋      | 136106/371472 [10:48:50<18:35:33,  3.52it/s]
 37%|███▋      | 136107/371472 [10:48:50<19:57:32,  3.28it/s]
 37%|███▋      | 136108/371472 [10:48:50<21:46:04,  3.00it/s]
 37%|███▋      | 136109/371472 [10:48:51<20:46:40,  3.15it/s]
 37%|███▋      | 136110/371472 [10:48:51<19:49:09,  3.30it/s]
 37%|███▋      | 136111/371472 [10:48:51<18:47:31,  3.48it/s]
 37%|███▋      | 136112/371472 [10:48:51<18:22:12,  3.56it/s]
 37%|███▋      | 136113/371472 [10:48:52<18:03:57,  3.62it/s]
 37%|███▋      | 136114/371472 [10:48:52<17:35:10,  3.72it/s]
 37%|███▋      | 136115/371472 [10:48:52<17:58:52,  3.64it/s]
 37%|███▋      | 136116/371472 [10:48:53<18:05:53,  3.61it/s]
 37%|███▋      | 136117/371472 [10:48:53<17:44:37,  3.68it/s]
 37%|███▋      | 136118/371472 [10:48:53<17:57:05,  3.64it/s]
 37%|███▋      | 136119/371472 [10:48:53<18:22:47,  3.56it/s]
 37%|███▋      | 136120/371472 [10:48:54<17:52:44,  3.66it/s]
                                                             
{'loss': 3.0192, 'learning_rate': 6.705164946454352e-07, 'epoch': 5.86}

 37%|███▋      | 136120/371472 [10:48:54<17:52:44,  3.66it/s]
 37%|███▋      | 136121/371472 [10:48:54<17:46:37,  3.68it/s]
 37%|███▋      | 136122/371472 [10:48:54<17:01:16,  3.84it/s]
 37%|███▋      | 136123/371472 [10:48:54<18:09:54,  3.60it/s]
 37%|███▋      | 136124/371472 [10:48:55<17:43:43,  3.69it/s]
 37%|███▋      | 136125/371472 [10:48:55<17:41:03,  3.70it/s]
 37%|███▋      | 136126/371472 [10:48:55<17:04:36,  3.83it/s]
 37%|███▋      | 136127/371472 [10:48:55<16:49:49,  3.88it/s]
 37%|███▋      | 136128/371472 [10:48:56<17:11:36,  3.80it/s]
 37%|███▋      | 136129/371472 [10:48:56<17:22:56,  3.76it/s]
 37%|███▋      | 136130/371472 [10:48:56<18:25:07,  3.55it/s]
 37%|███▋      | 136131/371472 [10:48:57<18:08:14,  3.60it/s]
 37%|███▋      | 136132/371472 [10:48:57<18:28:03,  3.54it/s]
 37%|███▋      | 136133/371472 [10:48:57<18:25:40,  3.55it/s]
 37%|███▋      | 136134/371472 [10:48:58<20:01:56,  3.26it/s]
 37%|███▋      | 136135/371472 [10:48:58<20:40:22,  3.16it/s]
 37%|███▋      | 136136/371472 [10:48:58<19:45:40,  3.31it/s]
 37%|███▋      | 136137/371472 [10:48:58<18:54:23,  3.46it/s]
 37%|███▋      | 136138/371472 [10:48:59<18:20:10,  3.57it/s]
 37%|███▋      | 136139/371472 [10:48:59<17:50:55,  3.66it/s]
 37%|███▋      | 136140/371472 [10:48:59<18:30:46,  3.53it/s]
                                                             
{'loss': 3.0822, 'learning_rate': 6.704680126699562e-07, 'epoch': 5.86}

 37%|███▋      | 136140/371472 [10:48:59<18:30:46,  3.53it/s]
 37%|███▋      | 136141/371472 [10:48:59<18:08:24,  3.60it/s]
 37%|███▋      | 136142/371472 [10:49:00<17:14:56,  3.79it/s]
 37%|███▋      | 136143/371472 [10:49:00<17:21:32,  3.77it/s]
 37%|███▋      | 136144/371472 [10:49:00<18:55:21,  3.45it/s]
 37%|███▋      | 136145/371472 [10:49:01<18:15:15,  3.58it/s]
 37%|███▋      | 136146/371472 [10:49:01<18:34:01,  3.52it/s]
 37%|███▋      | 136147/371472 [10:49:01<18:53:30,  3.46it/s]
 37%|███▋      | 136148/371472 [10:49:02<19:38:53,  3.33it/s]
 37%|███▋      | 136149/371472 [10:49:02<18:48:59,  3.47it/s]
 37%|███▋      | 136150/371472 [10:49:02<18:18:00,  3.57it/s]
 37%|███▋      | 136151/371472 [10:49:02<18:51:38,  3.47it/s]
 37%|███▋      | 136152/371472 [10:49:03<18:23:11,  3.56it/s]
 37%|███▋      | 136153/371472 [10:49:03<17:47:19,  3.67it/s]
 37%|███▋      | 136154/371472 [10:49:03<18:32:26,  3.53it/s]
 37%|███▋      | 136155/371472 [10:49:03<18:36:34,  3.51it/s]
 37%|███▋      | 136156/371472 [10:49:04<18:31:08,  3.53it/s]
 37%|███▋      | 136157/371472 [10:49:04<18:40:29,  3.50it/s]
 37%|███▋      | 136158/371472 [10:49:04<18:14:57,  3.58it/s]
 37%|███▋      | 136159/371472 [10:49:05<18:58:07,  3.45it/s]
 37%|███▋      | 136160/371472 [10:49:05<19:28:05,  3.36it/s]
                                                             
{'loss': 3.1441, 'learning_rate': 6.704195306944773e-07, 'epoch': 5.86}

 37%|███▋      | 136160/371472 [10:49:05<19:28:05,  3.36it/s]
 37%|███▋      | 136161/371472 [10:49:05<18:40:53,  3.50it/s]
 37%|███▋      | 136162/371472 [10:49:05<17:51:14,  3.66it/s]
 37%|███▋      | 136163/371472 [10:49:06<17:42:46,  3.69it/s]
 37%|███▋      | 136164/371472 [10:49:06<18:32:54,  3.52it/s]
 37%|███▋      | 136165/371472 [10:49:06<19:13:01,  3.40it/s]
 37%|███▋      | 136166/371472 [10:49:07<18:51:11,  3.47it/s]
 37%|███▋      | 136167/371472 [10:49:07<18:37:59,  3.51it/s]
 37%|███▋      | 136168/371472 [10:49:07<18:36:54,  3.51it/s]
 37%|███▋      | 136169/371472 [10:49:07<17:59:44,  3.63it/s]
 37%|███▋      | 136170/371472 [10:49:08<17:56:20,  3.64it/s]
 37%|███▋      | 136171/371472 [10:49:08<19:55:58,  3.28it/s]
 37%|███▋      | 136172/371472 [10:49:08<20:01:52,  3.26it/s]
 37%|███▋      | 136173/371472 [10:49:09<19:59:30,  3.27it/s]
 37%|███▋      | 136174/371472 [10:49:09<18:43:05,  3.49it/s]
 37%|███▋      | 136175/371472 [10:49:09<18:45:42,  3.48it/s]
 37%|███▋      | 136176/371472 [10:49:09<18:00:20,  3.63it/s]
 37%|███▋      | 136177/371472 [10:49:10<18:00:30,  3.63it/s]
 37%|███▋      | 136178/371472 [10:49:10<17:30:10,  3.73it/s]
 37%|███▋      | 136179/371472 [10:49:10<16:46:46,  3.90it/s]
 37%|███▋      | 136180/371472 [10:49:11<18:42:50,  3.49it/s]
                                                             
{'loss': 3.1282, 'learning_rate': 6.703710487189984e-07, 'epoch': 5.87}

 37%|███▋      | 136180/371472 [10:49:11<18:42:50,  3.49it/s]
 37%|███▋      | 136181/371472 [10:49:11<18:45:04,  3.49it/s]
 37%|███▋      | 136182/371472 [10:49:11<19:02:12,  3.43it/s]
 37%|███▋      | 136183/371472 [10:49:11<18:06:38,  3.61it/s]
 37%|███▋      | 136184/371472 [10:49:12<18:14:23,  3.58it/s]
 37%|███▋      | 136185/371472 [10:49:12<18:23:46,  3.55it/s]
 37%|███▋      | 136186/371472 [10:49:12<19:04:10,  3.43it/s]
 37%|███▋      | 136187/371472 [10:49:13<19:03:21,  3.43it/s]
 37%|███▋      | 136188/371472 [10:49:13<19:38:38,  3.33it/s]
 37%|███▋      | 136189/371472 [10:49:13<19:08:54,  3.41it/s]
 37%|███▋      | 136190/371472 [10:49:13<19:01:34,  3.44it/s]
 37%|███▋      | 136191/371472 [10:49:14<18:55:44,  3.45it/s]
 37%|███▋      | 136192/371472 [10:49:14<18:16:38,  3.58it/s]
 37%|███▋      | 136193/371472 [10:49:14<18:55:54,  3.45it/s]
 37%|███▋      | 136194/371472 [10:49:15<18:23:13,  3.55it/s]
 37%|███▋      | 136195/371472 [10:49:15<17:58:55,  3.63it/s]
 37%|███▋      | 136196/371472 [10:49:15<17:54:01,  3.65it/s]
 37%|███▋      | 136197/371472 [10:49:15<17:21:32,  3.76it/s]
 37%|███▋      | 136198/371472 [10:49:16<17:27:40,  3.74it/s]
 37%|███▋      | 136199/371472 [10:49:16<18:03:15,  3.62it/s]
 37%|███▋      | 136200/371472 [10:49:16<18:02:08,  3.62it/s]
                                                             
{'loss': 3.1296, 'learning_rate': 6.703225667435196e-07, 'epoch': 5.87}

 37%|███▋      | 136200/371472 [10:49:16<18:02:08,  3.62it/s]
 37%|███▋      | 136201/371472 [10:49:16<17:42:20,  3.69it/s]
 37%|███▋      | 136202/371472 [10:49:17<18:15:02,  3.58it/s]
 37%|███▋      | 136203/371472 [10:49:17<19:01:06,  3.44it/s]
 37%|███▋      | 136204/371472 [10:49:17<19:05:51,  3.42it/s]
 37%|███▋      | 136205/371472 [10:49:18<17:53:49,  3.65it/s]
 37%|███▋      | 136206/371472 [10:49:18<17:52:25,  3.66it/s]
 37%|███▋      | 136207/371472 [10:49:18<18:29:18,  3.53it/s]
 37%|███▋      | 136208/371472 [10:49:18<18:48:46,  3.47it/s]
 37%|███▋      | 136209/371472 [10:49:19<18:29:43,  3.53it/s]
 37%|███▋      | 136210/371472 [10:49:19<17:42:47,  3.69it/s]
 37%|███▋      | 136211/371472 [10:49:19<18:06:27,  3.61it/s]
 37%|███▋      | 136212/371472 [10:49:20<17:19:27,  3.77it/s]
 37%|███▋      | 136213/371472 [10:49:20<16:52:54,  3.87it/s]
 37%|███▋      | 136214/371472 [10:49:20<17:26:39,  3.75it/s]
 37%|███▋      | 136215/371472 [10:49:20<17:48:36,  3.67it/s]
 37%|███▋      | 136216/371472 [10:49:21<18:52:55,  3.46it/s]
 37%|███▋      | 136217/371472 [10:49:21<19:45:16,  3.31it/s]
 37%|███▋      | 136218/371472 [10:49:21<19:17:47,  3.39it/s]
 37%|███▋      | 136219/371472 [10:49:22<19:27:40,  3.36it/s]
 37%|███▋      | 136220/371472 [10:49:22<19:02:53,  3.43it/s]
                                                             
{'loss': 3.2144, 'learning_rate': 6.702740847680407e-07, 'epoch': 5.87}

 37%|███▋      | 136220/371472 [10:49:22<19:02:53,  3.43it/s]
 37%|███▋      | 136221/371472 [10:49:22<19:13:01,  3.40it/s]
 37%|███▋      | 136222/371472 [10:49:23<20:27:02,  3.20it/s]
 37%|███▋      | 136223/371472 [10:49:23<20:02:06,  3.26it/s]
 37%|███▋      | 136224/371472 [10:49:23<19:21:03,  3.38it/s]
 37%|███▋      | 136225/371472 [10:49:23<20:39:26,  3.16it/s]
 37%|███▋      | 136226/371472 [10:49:24<20:06:26,  3.25it/s]
 37%|███▋      | 136227/371472 [10:49:24<19:45:35,  3.31it/s]
 37%|███▋      | 136228/371472 [10:49:24<18:40:30,  3.50it/s]
 37%|███▋      | 136229/371472 [10:49:25<18:30:05,  3.53it/s]
 37%|███▋      | 136230/371472 [10:49:25<19:45:59,  3.31it/s]
 37%|███▋      | 136231/371472 [10:49:25<19:17:00,  3.39it/s]
 37%|███▋      | 136232/371472 [10:49:26<20:12:49,  3.23it/s]
 37%|███▋      | 136233/371472 [10:49:26<18:50:36,  3.47it/s]
 37%|███▋      | 136234/371472 [10:49:26<17:54:44,  3.65it/s]
 37%|███▋      | 136235/371472 [10:49:26<17:16:28,  3.78it/s]
 37%|███▋      | 136236/371472 [10:49:26<17:20:42,  3.77it/s]
 37%|███▋      | 136237/371472 [10:49:27<17:07:59,  3.81it/s]
 37%|███▋      | 136238/371472 [10:49:27<16:50:45,  3.88it/s]
 37%|███▋      | 136239/371472 [10:49:27<17:10:49,  3.80it/s]
 37%|███▋      | 136240/371472 [10:49:28<16:54:58,  3.86it/s]
                                                             
{'loss': 3.0968, 'learning_rate': 6.702256027925617e-07, 'epoch': 5.87}

 37%|███▋      | 136240/371472 [10:49:28<16:54:58,  3.86it/s]
 37%|███▋      | 136241/371472 [10:49:28<19:13:56,  3.40it/s]
 37%|███▋      | 136242/371472 [10:49:28<18:46:17,  3.48it/s]
 37%|███▋      | 136243/371472 [10:49:28<18:47:08,  3.48it/s]
 37%|███▋      | 136244/371472 [10:49:29<19:00:13,  3.44it/s]
 37%|███▋      | 136245/371472 [10:49:29<19:22:20,  3.37it/s]
 37%|███▋      | 136246/371472 [10:49:29<18:45:49,  3.48it/s]
 37%|███▋      | 136247/371472 [10:49:30<21:12:47,  3.08it/s]
 37%|███▋      | 136248/371472 [10:49:30<21:36:31,  3.02it/s]
 37%|███▋      | 136249/371472 [10:49:30<19:56:50,  3.28it/s]
 37%|███▋      | 136250/371472 [10:49:31<19:27:20,  3.36it/s]
 37%|███▋      | 136251/371472 [10:49:31<18:29:16,  3.53it/s]
 37%|███▋      | 136252/371472 [10:49:31<19:03:45,  3.43it/s]
 37%|███▋      | 136253/371472 [10:49:31<18:57:42,  3.45it/s]
 37%|███▋      | 136254/371472 [10:49:32<18:30:37,  3.53it/s]
 37%|███▋      | 136255/371472 [10:49:32<18:01:04,  3.63it/s]
 37%|███▋      | 136256/371472 [10:49:32<17:38:34,  3.70it/s]
 37%|███▋      | 136257/371472 [10:49:33<17:30:45,  3.73it/s]
 37%|███▋      | 136258/371472 [10:49:33<17:30:19,  3.73it/s]
 37%|███▋      | 136259/371472 [10:49:33<17:50:16,  3.66it/s]
 37%|███▋      | 136260/371472 [10:49:33<19:08:10,  3.41it/s]
                                                             
{'loss': 3.3572, 'learning_rate': 6.701771208170829e-07, 'epoch': 5.87}

 37%|███▋      | 136260/371472 [10:49:33<19:08:10,  3.41it/s]
 37%|███▋      | 136261/371472 [10:49:34<18:09:54,  3.60it/s]
 37%|███▋      | 136262/371472 [10:49:34<17:40:50,  3.70it/s]
 37%|███▋      | 136263/371472 [10:49:34<17:27:31,  3.74it/s]
 37%|███▋      | 136264/371472 [10:49:34<17:12:53,  3.80it/s]
 37%|███▋      | 136265/371472 [10:49:35<18:38:30,  3.50it/s]
 37%|███▋      | 136266/371472 [10:49:35<17:55:06,  3.65it/s]
 37%|███▋      | 136267/371472 [10:49:35<17:47:43,  3.67it/s]
 37%|███▋      | 136268/371472 [10:49:36<17:13:34,  3.79it/s]
 37%|███▋      | 136269/371472 [10:49:36<17:19:30,  3.77it/s]
 37%|███▋      | 136270/371472 [10:49:36<17:49:22,  3.67it/s]
 37%|███▋      | 136271/371472 [10:49:36<17:52:31,  3.65it/s]
 37%|███▋      | 136272/371472 [10:49:37<17:58:35,  3.63it/s]
 37%|███▋      | 136273/371472 [10:49:37<17:58:56,  3.63it/s]
 37%|███▋      | 136274/371472 [10:49:37<17:34:39,  3.72it/s]
 37%|███▋      | 136275/371472 [10:49:37<17:59:13,  3.63it/s]
 37%|███▋      | 136276/371472 [10:49:38<17:40:02,  3.70it/s]
 37%|███▋      | 136277/371472 [10:49:38<18:16:39,  3.57it/s]
 37%|███▋      | 136278/371472 [10:49:38<19:42:40,  3.31it/s]
 37%|███▋      | 136279/371472 [10:49:39<19:02:18,  3.43it/s]
 37%|███▋      | 136280/371472 [10:49:39<18:20:10,  3.56it/s]
                                                             
{'loss': 3.1393, 'learning_rate': 6.70128638841604e-07, 'epoch': 5.87}

 37%|███▋      | 136280/371472 [10:49:39<18:20:10,  3.56it/s]
 37%|███▋      | 136281/371472 [10:49:39<18:37:44,  3.51it/s]
 37%|███▋      | 136282/371472 [10:49:39<17:35:56,  3.71it/s]
 37%|███▋      | 136283/371472 [10:49:40<17:18:41,  3.77it/s]
 37%|███▋      | 136284/371472 [10:49:40<18:11:56,  3.59it/s]
 37%|███▋      | 136285/371472 [10:49:40<18:21:36,  3.56it/s]
 37%|███▋      | 136286/371472 [10:49:41<18:07:50,  3.60it/s]
 37%|███▋      | 136287/371472 [10:49:41<17:59:27,  3.63it/s]
 37%|███▋      | 136288/371472 [10:49:41<18:36:10,  3.51it/s]
 37%|███▋      | 136289/371472 [10:49:41<18:10:17,  3.60it/s]
 37%|███▋      | 136290/371472 [10:49:42<17:59:55,  3.63it/s]
 37%|███▋      | 136291/371472 [10:49:42<18:23:29,  3.55it/s]
 37%|███▋      | 136292/371472 [10:49:42<18:02:58,  3.62it/s]
 37%|███▋      | 136293/371472 [10:49:42<17:38:00,  3.70it/s]
 37%|███▋      | 136294/371472 [10:49:43<17:56:57,  3.64it/s]
 37%|███▋      | 136295/371472 [10:49:43<18:24:52,  3.55it/s]
 37%|███▋      | 136296/371472 [10:49:43<18:06:03,  3.61it/s]
 37%|███▋      | 136297/371472 [10:49:44<19:46:06,  3.30it/s]
 37%|███▋      | 136298/371472 [10:49:44<19:19:07,  3.38it/s]
 37%|███▋      | 136299/371472 [10:49:44<19:07:05,  3.42it/s]
 37%|███▋      | 136300/371472 [10:49:44<18:24:48,  3.55it/s]
                                                             
{'loss': 3.1237, 'learning_rate': 6.70080156866125e-07, 'epoch': 5.87}

 37%|███▋      | 136300/371472 [10:49:44<18:24:48,  3.55it/s]
 37%|███▋      | 136301/371472 [10:49:45<17:51:50,  3.66it/s]
 37%|███▋      | 136302/371472 [10:49:45<17:48:16,  3.67it/s]
 37%|███▋      | 136303/371472 [10:49:45<17:57:15,  3.64it/s]
 37%|███▋      | 136304/371472 [10:49:46<18:33:59,  3.52it/s]
 37%|███▋      | 136305/371472 [10:49:46<18:57:13,  3.45it/s]
 37%|███▋      | 136306/371472 [10:49:46<20:10:24,  3.24it/s]
 37%|███▋      | 136307/371472 [10:49:47<19:46:17,  3.30it/s]
 37%|███▋      | 136308/371472 [10:49:47<19:17:41,  3.39it/s]
 37%|███▋      | 136309/371472 [10:49:47<19:05:26,  3.42it/s]
 37%|███▋      | 136310/371472 [10:49:47<19:46:39,  3.30it/s]
 37%|███▋      | 136311/371472 [10:49:48<19:04:42,  3.42it/s]
 37%|███▋      | 136312/371472 [10:49:48<18:25:40,  3.54it/s]
 37%|███▋      | 136313/371472 [10:49:48<17:57:20,  3.64it/s]
 37%|███▋      | 136314/371472 [10:49:49<19:01:44,  3.43it/s]
 37%|███▋      | 136315/371472 [10:49:49<19:17:03,  3.39it/s]
 37%|███▋      | 136316/371472 [10:49:49<18:38:45,  3.50it/s]
 37%|███▋      | 136317/371472 [10:49:49<18:00:04,  3.63it/s]
 37%|███▋      | 136318/371472 [10:49:50<18:22:21,  3.56it/s]
 37%|███▋      | 136319/371472 [10:49:50<18:07:21,  3.60it/s]
 37%|███▋      | 136320/371472 [10:49:50<18:11:36,  3.59it/s]
                                                             
{'loss': 3.0902, 'learning_rate': 6.700316748906461e-07, 'epoch': 5.87}

 37%|███▋      | 136320/371472 [10:49:50<18:11:36,  3.59it/s]
 37%|███▋      | 136321/371472 [10:49:50<18:00:32,  3.63it/s]
 37%|███▋      | 136322/371472 [10:49:51<18:30:42,  3.53it/s]
 37%|███▋      | 136323/371472 [10:49:51<20:01:42,  3.26it/s]
 37%|███▋      | 136324/371472 [10:49:51<19:37:20,  3.33it/s]
 37%|███▋      | 136325/371472 [10:49:52<18:42:13,  3.49it/s]
 37%|███▋      | 136326/371472 [10:49:52<18:59:44,  3.44it/s]
 37%|███▋      | 136327/371472 [10:49:52<19:44:49,  3.31it/s]
 37%|███▋      | 136328/371472 [10:49:53<19:06:41,  3.42it/s]
 37%|███▋      | 136329/371472 [10:49:53<18:48:13,  3.47it/s]
 37%|███▋      | 136330/371472 [10:49:53<19:08:35,  3.41it/s]
 37%|███▋      | 136331/371472 [10:49:53<18:40:42,  3.50it/s]
 37%|███▋      | 136332/371472 [10:49:54<18:17:38,  3.57it/s]
 37%|███▋      | 136333/371472 [10:49:54<18:09:16,  3.60it/s]
 37%|███▋      | 136334/371472 [10:49:54<17:34:13,  3.72it/s]
 37%|███▋      | 136335/371472 [10:49:54<17:11:48,  3.80it/s]
 37%|███▋      | 136336/371472 [10:49:55<19:44:21,  3.31it/s]
 37%|███▋      | 136337/371472 [10:49:55<18:24:38,  3.55it/s]
 37%|███▋      | 136338/371472 [10:49:55<18:10:43,  3.59it/s]
 37%|███▋      | 136339/371472 [10:49:56<17:26:58,  3.74it/s]
 37%|███▋      | 136340/371472 [10:49:56<17:58:56,  3.63it/s]
                                                             
{'loss': 3.0515, 'learning_rate': 6.699831929151673e-07, 'epoch': 5.87}

 37%|███▋      | 136340/371472 [10:49:56<17:58:56,  3.63it/s]
 37%|███▋      | 136341/371472 [10:49:56<17:36:59,  3.71it/s]
 37%|███▋      | 136342/371472 [10:49:56<17:31:25,  3.73it/s]
 37%|███▋      | 136343/371472 [10:49:57<19:06:48,  3.42it/s]
 37%|███▋      | 136344/371472 [10:49:57<19:31:10,  3.35it/s]
 37%|███▋      | 136345/371472 [10:49:57<19:23:02,  3.37it/s]
 37%|███▋      | 136346/371472 [10:49:58<18:36:15,  3.51it/s]
 37%|███▋      | 136347/371472 [10:49:58<18:41:46,  3.49it/s]
 37%|███▋      | 136348/371472 [10:49:58<18:09:07,  3.60it/s]
 37%|███▋      | 136349/371472 [10:49:58<18:40:23,  3.50it/s]
 37%|███▋      | 136350/371472 [10:49:59<18:18:24,  3.57it/s]
 37%|███▋      | 136351/371472 [10:49:59<17:19:38,  3.77it/s]
 37%|███▋      | 136352/371472 [10:49:59<18:04:17,  3.61it/s]
 37%|███▋      | 136353/371472 [10:50:00<17:08:45,  3.81it/s]
 37%|███▋      | 136354/371472 [10:50:00<16:57:02,  3.85it/s]
 37%|███▋      | 136355/371472 [10:50:00<17:00:02,  3.84it/s]
 37%|███▋      | 136356/371472 [10:50:00<19:58:47,  3.27it/s]
 37%|███▋      | 136357/371472 [10:50:01<19:10:22,  3.41it/s]
 37%|███▋      | 136358/371472 [10:50:01<18:18:46,  3.57it/s]
 37%|███▋      | 136359/371472 [10:50:01<18:00:28,  3.63it/s]
 37%|███▋      | 136360/371472 [10:50:01<17:57:01,  3.64it/s]
                                                             
{'loss': 3.0444, 'learning_rate': 6.699347109396885e-07, 'epoch': 5.87}

 37%|███▋      | 136360/371472 [10:50:01<17:57:01,  3.64it/s]
 37%|███▋      | 136361/371472 [10:50:02<17:37:39,  3.70it/s]
 37%|███▋      | 136362/371472 [10:50:02<17:56:26,  3.64it/s]
 37%|███▋      | 136363/371472 [10:50:02<18:54:56,  3.45it/s]
 37%|███▋      | 136364/371472 [10:50:03<19:42:26,  3.31it/s]
 37%|███▋      | 136365/371472 [10:50:03<19:15:10,  3.39it/s]
 37%|███▋      | 136366/371472 [10:50:03<19:04:53,  3.42it/s]
 37%|███▋      | 136367/371472 [10:50:04<18:49:47,  3.47it/s]
 37%|███▋      | 136368/371472 [10:50:04<18:31:20,  3.53it/s]
 37%|███▋      | 136369/371472 [10:50:04<19:44:25,  3.31it/s]
 37%|███▋      | 136370/371472 [10:50:04<18:33:03,  3.52it/s]
 37%|███▋      | 136371/371472 [10:50:05<18:49:26,  3.47it/s]
 37%|███▋      | 136372/371472 [10:50:05<18:38:48,  3.50it/s]
 37%|███▋      | 136373/371472 [10:50:05<18:27:07,  3.54it/s]
 37%|███▋      | 136374/371472 [10:50:05<17:42:47,  3.69it/s]
 37%|███▋      | 136375/371472 [10:50:06<18:16:07,  3.57it/s]
 37%|███▋      | 136376/371472 [10:50:06<18:06:58,  3.60it/s]
 37%|███▋      | 136377/371472 [10:50:06<18:55:13,  3.45it/s]
 37%|███▋      | 136378/371472 [10:50:07<18:40:07,  3.50it/s]
 37%|███▋      | 136379/371472 [10:50:07<19:52:44,  3.29it/s]
 37%|███▋      | 136380/371472 [10:50:07<19:46:23,  3.30it/s]
                                                             
{'loss': 3.2028, 'learning_rate': 6.698862289642095e-07, 'epoch': 5.87}

 37%|███▋      | 136380/371472 [10:50:07<19:46:23,  3.30it/s]
 37%|███▋      | 136381/371472 [10:50:08<18:30:22,  3.53it/s]
 37%|███▋      | 136382/371472 [10:50:08<18:20:05,  3.56it/s]
 37%|███▋      | 136383/371472 [10:50:08<18:01:25,  3.62it/s]
 37%|███▋      | 136384/371472 [10:50:08<18:58:33,  3.44it/s]
 37%|███▋      | 136385/371472 [10:50:09<18:29:45,  3.53it/s]
 37%|███▋      | 136386/371472 [10:50:09<18:16:16,  3.57it/s]
 37%|███▋      | 136387/371472 [10:50:09<17:49:45,  3.66it/s]
 37%|███▋      | 136388/371472 [10:50:09<17:32:18,  3.72it/s]
 37%|███▋      | 136389/371472 [10:50:10<17:44:48,  3.68it/s]
 37%|███▋      | 136390/371472 [10:50:10<18:35:03,  3.51it/s]
 37%|███▋      | 136391/371472 [10:50:10<18:06:27,  3.61it/s]
 37%|███▋      | 136392/371472 [10:50:11<19:59:39,  3.27it/s]
 37%|███▋      | 136393/371472 [10:50:11<19:28:30,  3.35it/s]
 37%|███▋      | 136394/371472 [10:50:11<20:23:40,  3.20it/s]
 37%|███▋      | 136395/371472 [10:50:12<20:03:49,  3.25it/s]
 37%|███▋      | 136396/371472 [10:50:12<18:53:56,  3.46it/s]
 37%|███▋      | 136397/371472 [10:50:12<18:40:43,  3.50it/s]
 37%|███▋      | 136398/371472 [10:50:12<19:10:59,  3.40it/s]
 37%|███▋      | 136399/371472 [10:50:13<18:47:54,  3.47it/s]
 37%|███▋      | 136400/371472 [10:50:13<18:53:31,  3.46it/s]
                                                             
{'loss': 3.1298, 'learning_rate': 6.698377469887306e-07, 'epoch': 5.88}

 37%|███▋      | 136400/371472 [10:50:13<18:53:31,  3.46it/s]
 37%|███▋      | 136401/371472 [10:50:13<18:13:33,  3.58it/s]
 37%|███▋      | 136402/371472 [10:50:14<18:17:47,  3.57it/s]
 37%|███▋      | 136403/371472 [10:50:14<18:44:49,  3.48it/s]
 37%|███▋      | 136404/371472 [10:50:14<18:23:14,  3.55it/s]
 37%|███▋      | 136405/371472 [10:50:14<17:39:19,  3.70it/s]
 37%|███▋      | 136406/371472 [10:50:15<17:07:44,  3.81it/s]
 37%|███▋      | 136407/371472 [10:50:15<16:41:44,  3.91it/s]
 37%|███▋      | 136408/371472 [10:50:15<16:47:15,  3.89it/s]
 37%|███▋      | 136409/371472 [10:50:15<17:35:17,  3.71it/s]
 37%|███▋      | 136410/371472 [10:50:16<18:13:09,  3.58it/s]
 37%|███▋      | 136411/371472 [10:50:16<17:45:12,  3.68it/s]
 37%|███▋      | 136412/371472 [10:50:16<18:56:11,  3.45it/s]
 37%|███▋      | 136413/371472 [10:50:17<19:37:21,  3.33it/s]
 37%|███▋      | 136414/371472 [10:50:17<19:18:37,  3.38it/s]
 37%|███▋      | 136415/371472 [10:50:17<18:27:42,  3.54it/s]
 37%|███▋      | 136416/371472 [10:50:17<18:12:30,  3.59it/s]
 37%|███▋      | 136417/371472 [10:50:18<18:13:40,  3.58it/s]
 37%|███▋      | 136418/371472 [10:50:18<17:53:30,  3.65it/s]
 37%|███▋      | 136419/371472 [10:50:18<19:13:08,  3.40it/s]
 37%|███▋      | 136420/371472 [10:50:19<18:29:14,  3.53it/s]
                                                             
{'loss': 3.0716, 'learning_rate': 6.697892650132518e-07, 'epoch': 5.88}

 37%|███▋      | 136420/371472 [10:50:19<18:29:14,  3.53it/s]
 37%|███▋      | 136421/371472 [10:50:19<20:48:10,  3.14it/s]
 37%|███▋      | 136422/371472 [10:50:19<19:32:58,  3.34it/s]
 37%|███▋      | 136423/371472 [10:50:19<18:46:29,  3.48it/s]
 37%|███▋      | 136424/371472 [10:50:20<19:52:00,  3.29it/s]
 37%|███▋      | 136425/371472 [10:50:20<18:37:35,  3.51it/s]
 37%|███▋      | 136426/371472 [10:50:20<18:48:04,  3.47it/s]
 37%|███▋      | 136427/371472 [10:50:21<17:39:56,  3.70it/s]
 37%|███▋      | 136428/371472 [10:50:21<17:35:43,  3.71it/s]
 37%|███▋      | 136429/371472 [10:50:21<16:48:40,  3.88it/s]
 37%|███▋      | 136430/371472 [10:50:21<16:51:12,  3.87it/s]
 37%|███▋      | 136431/371472 [10:50:22<17:14:38,  3.79it/s]
 37%|███▋      | 136432/371472 [10:50:22<17:57:08,  3.64it/s]
 37%|███▋      | 136433/371472 [10:50:22<17:48:20,  3.67it/s]
 37%|███▋      | 136434/371472 [10:50:22<17:44:56,  3.68it/s]
 37%|███▋      | 136435/371472 [10:50:23<17:12:04,  3.80it/s]
 37%|███▋      | 136436/371472 [10:50:23<16:51:06,  3.87it/s]
 37%|███▋      | 136437/371472 [10:50:23<16:40:42,  3.91it/s]
 37%|███▋      | 136438/371472 [10:50:23<16:23:14,  3.98it/s]
 37%|███▋      | 136439/371472 [10:50:24<16:27:58,  3.96it/s]
 37%|███▋      | 136440/371472 [10:50:24<17:13:22,  3.79it/s]
                                                             
{'loss': 3.0892, 'learning_rate': 6.697407830377728e-07, 'epoch': 5.88}

 37%|███▋      | 136440/371472 [10:50:24<17:13:22,  3.79it/s]
 37%|███▋      | 136441/371472 [10:50:24<17:09:12,  3.81it/s]
 37%|███▋      | 136442/371472 [10:50:25<17:25:21,  3.75it/s]
 37%|███▋      | 136443/371472 [10:50:25<18:00:25,  3.63it/s]
 37%|███▋      | 136444/371472 [10:50:25<17:52:17,  3.65it/s]
 37%|███▋      | 136445/371472 [10:50:25<17:12:00,  3.80it/s]
 37%|███▋      | 136446/371472 [10:50:26<17:54:43,  3.64it/s]
 37%|███▋      | 136447/371472 [10:50:26<18:08:36,  3.60it/s]
 37%|███▋      | 136448/371472 [10:50:26<18:58:22,  3.44it/s]
 37%|███▋      | 136449/371472 [10:50:27<18:49:32,  3.47it/s]
 37%|███▋      | 136450/371472 [10:50:27<18:06:34,  3.60it/s]
 37%|███▋      | 136451/371472 [10:50:27<19:00:39,  3.43it/s]
 37%|███▋      | 136452/371472 [10:50:27<18:14:38,  3.58it/s]
 37%|███▋      | 136453/371472 [10:50:28<18:38:31,  3.50it/s]
 37%|███▋      | 136454/371472 [10:50:28<18:31:43,  3.52it/s]
 37%|███▋      | 136455/371472 [10:50:28<17:57:56,  3.63it/s]
 37%|███▋      | 136456/371472 [10:50:28<17:46:19,  3.67it/s]
 37%|███▋      | 136457/371472 [10:50:29<18:13:03,  3.58it/s]
 37%|███▋      | 136458/371472 [10:50:29<17:40:20,  3.69it/s]
 37%|███▋      | 136459/371472 [10:50:29<18:21:36,  3.56it/s]
 37%|███▋      | 136460/371472 [10:50:30<18:24:52,  3.55it/s]
                                                             
{'loss': 3.0835, 'learning_rate': 6.696923010622939e-07, 'epoch': 5.88}

 37%|███▋      | 136460/371472 [10:50:30<18:24:52,  3.55it/s]
 37%|███▋      | 136461/371472 [10:50:30<17:51:31,  3.66it/s]
 37%|███▋      | 136462/371472 [10:50:30<17:39:26,  3.70it/s]
 37%|███▋      | 136463/371472 [10:50:30<18:38:47,  3.50it/s]
 37%|███▋      | 136464/371472 [10:50:31<18:19:08,  3.56it/s]
 37%|███▋      | 136465/371472 [10:50:31<20:19:29,  3.21it/s]
 37%|███▋      | 136466/371472 [10:50:31<19:56:46,  3.27it/s]
 37%|███▋      | 136467/371472 [10:50:32<19:33:50,  3.34it/s]
 37%|███▋      | 136468/371472 [10:50:32<18:46:15,  3.48it/s]
 37%|███▋      | 136469/371472 [10:50:32<19:05:28,  3.42it/s]
 37%|███▋      | 136470/371472 [10:50:32<18:01:28,  3.62it/s]
 37%|███▋      | 136471/371472 [10:50:33<17:44:22,  3.68it/s]
 37%|███▋      | 136472/371472 [10:50:33<18:37:40,  3.50it/s]
 37%|███▋      | 136473/371472 [10:50:33<18:10:58,  3.59it/s]
 37%|███▋      | 136474/371472 [10:50:34<17:40:32,  3.69it/s]
 37%|███▋      | 136475/371472 [10:50:34<17:46:20,  3.67it/s]
 37%|███▋      | 136476/371472 [10:50:34<17:35:08,  3.71it/s]
 37%|███▋      | 136477/371472 [10:50:34<17:42:36,  3.69it/s]
 37%|███▋      | 136478/371472 [10:50:35<17:58:35,  3.63it/s]
 37%|███▋      | 136479/371472 [10:50:35<17:23:15,  3.75it/s]
 37%|███▋      | 136480/371472 [10:50:35<17:27:17,  3.74it/s]
                                                             
{'loss': 2.9605, 'learning_rate': 6.69643819086815e-07, 'epoch': 5.88}

 37%|███▋      | 136480/371472 [10:50:35<17:27:17,  3.74it/s]
 37%|███▋      | 136481/371472 [10:50:35<17:20:34,  3.76it/s]
 37%|███▋      | 136482/371472 [10:50:36<18:09:30,  3.59it/s]
 37%|███▋      | 136483/371472 [10:50:36<18:07:10,  3.60it/s]
 37%|███▋      | 136484/371472 [10:50:36<17:59:54,  3.63it/s]
 37%|███▋      | 136485/371472 [10:50:37<18:09:02,  3.60it/s]
 37%|███▋      | 136486/371472 [10:50:37<17:31:25,  3.72it/s]
 37%|███▋      | 136487/371472 [10:50:37<19:18:25,  3.38it/s]
 37%|███▋      | 136488/371472 [10:50:37<18:36:29,  3.51it/s]
 37%|███▋      | 136489/371472 [10:50:38<19:07:51,  3.41it/s]
 37%|███▋      | 136490/371472 [10:50:38<19:10:32,  3.40it/s]
 37%|███▋      | 136491/371472 [10:50:38<19:16:14,  3.39it/s]
 37%|███▋      | 136492/371472 [10:50:39<19:36:24,  3.33it/s]
 37%|███▋      | 136493/371472 [10:50:39<18:38:55,  3.50it/s]
 37%|███▋      | 136494/371472 [10:50:39<20:18:04,  3.22it/s]
 37%|███▋      | 136495/371472 [10:50:40<19:26:49,  3.36it/s]
 37%|███▋      | 136496/371472 [10:50:40<18:56:30,  3.45it/s]
 37%|███▋      | 136497/371472 [10:50:40<18:54:05,  3.45it/s]
 37%|███▋      | 136498/371472 [10:50:40<18:59:27,  3.44it/s]
 37%|███▋      | 136499/371472 [10:50:41<18:22:40,  3.55it/s]
 37%|███▋      | 136500/371472 [10:50:41<20:05:18,  3.25it/s]
                                                             
{'loss': 3.0078, 'learning_rate': 6.695953371113362e-07, 'epoch': 5.88}

 37%|███▋      | 136500/371472 [10:50:41<20:05:18,  3.25it/s]
 37%|███▋      | 136501/371472 [10:50:41<20:02:33,  3.26it/s]
 37%|███▋      | 136502/371472 [10:50:42<20:39:13,  3.16it/s]
 37%|███▋      | 136503/371472 [10:50:42<21:05:52,  3.09it/s]
 37%|███▋      | 136504/371472 [10:50:42<21:17:57,  3.06it/s]
 37%|███▋      | 136505/371472 [10:50:43<20:55:06,  3.12it/s]
 37%|███▋      | 136506/371472 [10:50:43<20:16:13,  3.22it/s]
 37%|███▋      | 136507/371472 [10:50:43<20:10:19,  3.24it/s]
 37%|███▋      | 136508/371472 [10:50:43<19:05:24,  3.42it/s]
 37%|███▋      | 136509/371472 [10:50:44<19:43:12,  3.31it/s]
 37%|███▋      | 136510/371472 [10:50:44<19:51:34,  3.29it/s]
 37%|███▋      | 136511/371472 [10:50:44<19:19:11,  3.38it/s]
 37%|███▋      | 136512/371472 [10:50:45<19:01:13,  3.43it/s]
 37%|███▋      | 136513/371472 [10:50:45<18:00:31,  3.62it/s]
 37%|███▋      | 136514/371472 [10:50:45<19:11:36,  3.40it/s]
 37%|███▋      | 136515/371472 [10:50:46<18:39:29,  3.50it/s]
 37%|███▋      | 136516/371472 [10:50:46<18:03:54,  3.61it/s]
 37%|███▋      | 136517/371472 [10:50:46<18:22:54,  3.55it/s]
 37%|███▋      | 136518/371472 [10:50:46<18:48:31,  3.47it/s]
 37%|███▋      | 136519/371472 [10:50:47<18:06:31,  3.60it/s]
 37%|███▋      | 136520/371472 [10:50:47<17:17:25,  3.77it/s]
                                                             
{'loss': 3.0952, 'learning_rate': 6.695468551358572e-07, 'epoch': 5.88}

 37%|███▋      | 136520/371472 [10:50:47<17:17:25,  3.77it/s]
 37%|███▋      | 136521/371472 [10:50:47<19:20:42,  3.37it/s]
 37%|███▋      | 136522/371472 [10:50:47<18:37:07,  3.51it/s]
 37%|███▋      | 136523/371472 [10:50:48<18:35:05,  3.51it/s]
 37%|███▋      | 136524/371472 [10:50:48<17:51:00,  3.66it/s]
 37%|███▋      | 136525/371472 [10:50:48<17:53:15,  3.65it/s]
 37%|███▋      | 136526/371472 [10:50:49<18:49:37,  3.47it/s]
 37%|███▋      | 136527/371472 [10:50:49<18:07:01,  3.60it/s]
 37%|███▋      | 136528/371472 [10:50:49<18:12:37,  3.58it/s]
 37%|███▋      | 136529/371472 [10:50:49<18:03:17,  3.61it/s]
 37%|███▋      | 136530/371472 [10:50:50<17:13:19,  3.79it/s]
 37%|███▋      | 136531/371472 [10:50:50<17:03:44,  3.82it/s]
 37%|███▋      | 136532/371472 [10:50:50<17:12:54,  3.79it/s]
 37%|███▋      | 136533/371472 [10:50:50<16:55:31,  3.86it/s]
 37%|███▋      | 136534/371472 [10:50:51<16:51:30,  3.87it/s]
 37%|███▋      | 136535/371472 [10:50:51<18:01:48,  3.62it/s]
 37%|███▋      | 136536/371472 [10:50:51<17:51:25,  3.65it/s]
 37%|███▋      | 136537/371472 [10:50:52<19:01:18,  3.43it/s]
 37%|███▋      | 136538/371472 [10:50:52<18:40:20,  3.49it/s]
 37%|███▋      | 136539/371472 [10:50:52<19:34:56,  3.33it/s]
 37%|███▋      | 136540/371472 [10:50:53<20:03:44,  3.25it/s]
                                                             
{'loss': 3.1124, 'learning_rate': 6.694983731603783e-07, 'epoch': 5.88}

 37%|███▋      | 136540/371472 [10:50:53<20:03:44,  3.25it/s]
 37%|███▋      | 136541/371472 [10:50:53<19:01:58,  3.43it/s]
 37%|███▋      | 136542/371472 [10:50:53<18:19:09,  3.56it/s]
 37%|███▋      | 136543/371472 [10:50:53<17:52:45,  3.65it/s]
 37%|███▋      | 136544/371472 [10:50:54<17:46:40,  3.67it/s]
 37%|███▋      | 136545/371472 [10:50:54<18:07:44,  3.60it/s]
 37%|███▋      | 136546/371472 [10:50:54<18:19:44,  3.56it/s]
 37%|███▋      | 136547/371472 [10:50:54<17:45:39,  3.67it/s]
 37%|███▋      | 136548/371472 [10:50:55<17:54:58,  3.64it/s]
 37%|███▋      | 136549/371472 [10:50:55<18:00:14,  3.62it/s]
 37%|███▋      | 136550/371472 [10:50:55<17:48:01,  3.67it/s]
 37%|███▋      | 136551/371472 [10:50:56<18:04:39,  3.61it/s]
 37%|███▋      | 136552/371472 [10:50:56<17:28:38,  3.73it/s]
 37%|███▋      | 136553/371472 [10:50:56<19:08:16,  3.41it/s]
 37%|███▋      | 136554/371472 [10:50:56<18:42:58,  3.49it/s]
 37%|███▋      | 136555/371472 [10:50:57<18:10:00,  3.59it/s]
 37%|███▋      | 136556/371472 [10:50:57<18:18:11,  3.57it/s]
 37%|███▋      | 136557/371472 [10:50:57<18:58:01,  3.44it/s]
 37%|███▋      | 136558/371472 [10:50:57<18:08:23,  3.60it/s]
 37%|███▋      | 136559/371472 [10:50:58<18:09:52,  3.59it/s]
 37%|███▋      | 136560/371472 [10:50:58<17:50:33,  3.66it/s]
                                                             
{'loss': 3.2002, 'learning_rate': 6.694498911848994e-07, 'epoch': 5.88}

 37%|███▋      | 136560/371472 [10:50:58<17:50:33,  3.66it/s]
 37%|███▋      | 136561/371472 [10:50:58<18:09:00,  3.60it/s]
 37%|███▋      | 136562/371472 [10:50:59<17:23:54,  3.75it/s]
 37%|███▋      | 136563/371472 [10:50:59<18:24:28,  3.54it/s]
 37%|███▋      | 136564/371472 [10:50:59<18:17:35,  3.57it/s]
 37%|███▋      | 136565/371472 [10:50:59<18:46:15,  3.48it/s]
 37%|███▋      | 136566/371472 [10:51:00<19:14:37,  3.39it/s]
 37%|███▋      | 136567/371472 [10:51:00<19:08:45,  3.41it/s]
 37%|███▋      | 136568/371472 [10:51:00<19:34:51,  3.33it/s]
 37%|███▋      | 136569/371472 [10:51:01<19:39:13,  3.32it/s]
 37%|███▋      | 136570/371472 [10:51:01<19:12:42,  3.40it/s]
 37%|███▋      | 136571/371472 [10:51:01<20:01:43,  3.26it/s]
 37%|███▋      | 136572/371472 [10:51:02<19:32:22,  3.34it/s]
 37%|███▋      | 136573/371472 [10:51:02<18:36:49,  3.51it/s]
 37%|███▋      | 136574/371472 [10:51:02<17:54:59,  3.64it/s]
 37%|███▋      | 136575/371472 [10:51:02<20:10:29,  3.23it/s]
 37%|███▋      | 136576/371472 [10:51:03<20:26:17,  3.19it/s]
 37%|███▋      | 136577/371472 [10:51:03<19:33:56,  3.33it/s]
 37%|███▋      | 136578/371472 [10:51:03<18:35:40,  3.51it/s]
 37%|███▋      | 136579/371472 [10:51:04<18:16:04,  3.57it/s]
 37%|███▋      | 136580/371472 [10:51:04<19:03:31,  3.42it/s]
                                                             
{'loss': 3.154, 'learning_rate': 6.694014092094206e-07, 'epoch': 5.88}

 37%|███▋      | 136580/371472 [10:51:04<19:03:31,  3.42it/s]
 37%|███▋      | 136581/371472 [10:51:04<19:18:54,  3.38it/s]
 37%|███▋      | 136582/371472 [10:51:04<18:23:04,  3.55it/s]
 37%|███▋      | 136583/371472 [10:51:05<17:33:09,  3.72it/s]
 37%|███▋      | 136584/371472 [10:51:05<17:55:45,  3.64it/s]
 37%|███▋      | 136585/371472 [10:51:05<17:14:34,  3.78it/s]
 37%|███▋      | 136586/371472 [10:51:05<17:11:29,  3.80it/s]
 37%|███▋      | 136587/371472 [10:51:06<16:38:29,  3.92it/s]
 37%|███▋      | 136588/371472 [10:51:06<16:37:09,  3.93it/s]
 37%|███▋      | 136589/371472 [10:51:06<18:24:42,  3.54it/s]
 37%|███▋      | 136590/371472 [10:51:07<19:03:51,  3.42it/s]
 37%|███▋      | 136591/371472 [10:51:07<19:01:14,  3.43it/s]
 37%|███▋      | 136592/371472 [10:51:07<19:08:57,  3.41it/s]
 37%|███▋      | 136593/371472 [10:51:08<19:29:12,  3.35it/s]
 37%|███▋      | 136594/371472 [10:51:08<19:31:47,  3.34it/s]
 37%|███▋      | 136595/371472 [10:51:08<19:09:11,  3.41it/s]
 37%|███▋      | 136596/371472 [10:51:08<19:06:40,  3.41it/s]
 37%|███▋      | 136597/371472 [10:51:09<18:39:29,  3.50it/s]
 37%|███▋      | 136598/371472 [10:51:09<18:15:50,  3.57it/s]
 37%|███▋      | 136599/371472 [10:51:09<17:39:08,  3.70it/s]
 37%|███▋      | 136600/371472 [10:51:10<18:49:00,  3.47it/s]
                                                             
{'loss': 3.1006, 'learning_rate': 6.693529272339417e-07, 'epoch': 5.88}

 37%|███▋      | 136600/371472 [10:51:10<18:49:00,  3.47it/s]
 37%|███▋      | 136601/371472 [10:51:10<18:29:29,  3.53it/s]
 37%|███▋      | 136602/371472 [10:51:10<18:08:20,  3.60it/s]
 37%|███▋      | 136603/371472 [10:51:10<18:59:21,  3.44it/s]
 37%|███▋      | 136604/371472 [10:51:11<18:42:17,  3.49it/s]
 37%|███▋      | 136605/371472 [10:51:11<18:07:58,  3.60it/s]
 37%|███▋      | 136606/371472 [10:51:11<17:34:16,  3.71it/s]
 37%|███▋      | 136607/371472 [10:51:11<17:25:15,  3.74it/s]
 37%|███▋      | 136608/371472 [10:51:12<17:00:17,  3.84it/s]
 37%|███▋      | 136609/371472 [10:51:12<17:06:55,  3.81it/s]
 37%|███▋      | 136610/371472 [10:51:12<17:32:59,  3.72it/s]
 37%|███▋      | 136611/371472 [10:51:13<17:44:49,  3.68it/s]
 37%|███▋      | 136612/371472 [10:51:13<17:01:36,  3.83it/s]
 37%|███▋      | 136613/371472 [10:51:13<17:57:57,  3.63it/s]
 37%|███▋      | 136614/371472 [10:51:13<19:18:01,  3.38it/s]
 37%|███▋      | 136615/371472 [10:51:14<19:17:27,  3.38it/s]
 37%|███▋      | 136616/371472 [10:51:14<19:06:14,  3.41it/s]
 37%|███▋      | 136617/371472 [10:51:14<18:22:54,  3.55it/s]
 37%|███▋      | 136618/371472 [10:51:14<18:01:47,  3.62it/s]
 37%|███▋      | 136619/371472 [10:51:15<17:29:13,  3.73it/s]
 37%|███▋      | 136620/371472 [10:51:15<17:31:30,  3.72it/s]
                                                             
{'loss': 3.1552, 'learning_rate': 6.693044452584628e-07, 'epoch': 5.88}

 37%|███▋      | 136620/371472 [10:51:15<17:31:30,  3.72it/s]
 37%|███▋      | 136621/371472 [10:51:15<17:17:52,  3.77it/s]
 37%|███▋      | 136622/371472 [10:51:16<17:17:50,  3.77it/s]
 37%|███▋      | 136623/371472 [10:51:16<18:03:39,  3.61it/s]
 37%|███▋      | 136624/371472 [10:51:16<17:55:03,  3.64it/s]
 37%|███▋      | 136625/371472 [10:51:16<18:40:15,  3.49it/s]
 37%|███▋      | 136626/371472 [10:51:17<18:43:12,  3.48it/s]
 37%|███▋      | 136627/371472 [10:51:17<18:05:16,  3.61it/s]
 37%|███▋      | 136628/371472 [10:51:17<17:46:46,  3.67it/s]
 37%|███▋      | 136629/371472 [10:51:18<17:50:46,  3.66it/s]
 37%|███▋      | 136630/371472 [10:51:18<17:21:39,  3.76it/s]
 37%|███▋      | 136631/371472 [10:51:18<17:24:23,  3.75it/s]
 37%|███▋      | 136632/371472 [10:51:18<18:22:57,  3.55it/s]
 37%|███▋      | 136633/371472 [10:51:19<17:51:08,  3.65it/s]
 37%|███▋      | 136634/371472 [10:51:19<17:45:05,  3.67it/s]
 37%|███▋      | 136635/371472 [10:51:19<18:05:44,  3.60it/s]
 37%|███▋      | 136636/371472 [10:51:19<18:13:10,  3.58it/s]
 37%|███▋      | 136637/371472 [10:51:20<20:11:36,  3.23it/s]
 37%|███▋      | 136638/371472 [10:51:20<20:04:46,  3.25it/s]
 37%|███▋      | 136639/371472 [10:51:20<19:17:36,  3.38it/s]
 37%|███▋      | 136640/371472 [10:51:21<19:15:33,  3.39it/s]
                                                             
{'loss': 3.1886, 'learning_rate': 6.692559632829839e-07, 'epoch': 5.89}

 37%|███▋      | 136640/371472 [10:51:21<19:15:33,  3.39it/s]
 37%|███▋      | 136641/371472 [10:51:21<18:42:21,  3.49it/s]
 37%|███▋      | 136642/371472 [10:51:21<17:54:25,  3.64it/s]
 37%|███▋      | 136643/371472 [10:51:21<17:55:42,  3.64it/s]
 37%|███▋      | 136644/371472 [10:51:22<17:34:24,  3.71it/s]
 37%|███▋      | 136645/371472 [10:51:22<17:00:06,  3.84it/s]
 37%|███▋      | 136646/371472 [10:51:22<17:59:46,  3.62it/s]
 37%|███▋      | 136647/371472 [10:51:23<17:15:14,  3.78it/s]
 37%|███▋      | 136648/371472 [10:51:23<18:38:46,  3.50it/s]
 37%|███▋      | 136649/371472 [10:51:23<18:54:02,  3.45it/s]
 37%|███▋      | 136650/371472 [10:51:23<18:43:23,  3.48it/s]
 37%|███▋      | 136651/371472 [10:51:24<18:51:57,  3.46it/s]
 37%|███▋      | 136652/371472 [10:51:24<18:38:14,  3.50it/s]
 37%|███▋      | 136653/371472 [10:51:24<17:40:38,  3.69it/s]
 37%|███▋      | 136654/371472 [10:51:25<17:39:53,  3.69it/s]
 37%|███▋      | 136655/371472 [10:51:25<18:23:19,  3.55it/s]
 37%|███▋      | 136656/371472 [10:51:25<17:42:50,  3.68it/s]
 37%|███▋      | 136657/371472 [10:51:25<17:44:49,  3.68it/s]
 37%|███▋      | 136658/371472 [10:51:26<17:49:45,  3.66it/s]
 37%|███▋      | 136659/371472 [10:51:26<17:13:10,  3.79it/s]
 37%|███▋      | 136660/371472 [10:51:26<19:04:36,  3.42it/s]
                                                             
{'loss': 2.9938, 'learning_rate': 6.69207481307505e-07, 'epoch': 5.89}

 37%|███▋      | 136660/371472 [10:51:26<19:04:36,  3.42it/s]
 37%|███▋      | 136661/371472 [10:51:27<19:29:30,  3.35it/s]
 37%|███▋      | 136662/371472 [10:51:27<19:45:23,  3.30it/s]
 37%|███▋      | 136663/371472 [10:51:27<20:49:26,  3.13it/s]
 37%|███▋      | 136664/371472 [10:51:27<19:48:53,  3.29it/s]
 37%|███▋      | 136665/371472 [10:51:28<20:20:47,  3.21it/s]
 37%|███▋      | 136666/371472 [10:51:28<22:41:54,  2.87it/s]
 37%|███▋      | 136667/371472 [10:51:29<21:11:54,  3.08it/s]
 37%|███▋      | 136668/371472 [10:51:29<20:07:11,  3.24it/s]
 37%|███▋      | 136669/371472 [10:51:29<20:39:21,  3.16it/s]
 37%|███▋      | 136670/371472 [10:51:29<19:19:10,  3.38it/s]
 37%|███▋      | 136671/371472 [10:51:30<20:23:18,  3.20it/s]
 37%|███▋      | 136672/371472 [10:51:30<19:29:15,  3.35it/s]
 37%|███▋      | 136673/371472 [10:51:30<18:48:03,  3.47it/s]
 37%|███▋      | 136674/371472 [10:51:31<18:58:41,  3.44it/s]
 37%|███▋      | 136675/371472 [10:51:31<18:44:51,  3.48it/s]
 37%|███▋      | 136676/371472 [10:51:31<19:26:33,  3.35it/s]
 37%|███▋      | 136677/371472 [10:51:31<18:26:20,  3.54it/s]
 37%|███▋      | 136678/371472 [10:51:32<18:12:52,  3.58it/s]
 37%|███▋      | 136679/371472 [10:51:32<17:39:21,  3.69it/s]
 37%|███▋      | 136680/371472 [10:51:32<17:06:39,  3.81it/s]
                                                             
{'loss': 3.1426, 'learning_rate': 6.691589993320261e-07, 'epoch': 5.89}

 37%|███▋      | 136680/371472 [10:51:32<17:06:39,  3.81it/s]
 37%|███▋      | 136681/371472 [10:51:32<18:10:43,  3.59it/s]
 37%|███▋      | 136682/371472 [10:51:33<18:47:57,  3.47it/s]
 37%|███▋      | 136683/371472 [10:51:33<19:07:21,  3.41it/s]
 37%|███▋      | 136684/371472 [10:51:33<18:36:28,  3.50it/s]
 37%|███▋      | 136685/371472 [10:51:34<20:58:22,  3.11it/s]
 37%|███▋      | 136686/371472 [10:51:34<19:40:24,  3.32it/s]
 37%|███▋      | 136687/371472 [10:51:34<18:50:09,  3.46it/s]
 37%|███▋      | 136688/371472 [10:51:35<18:10:28,  3.59it/s]
 37%|███▋      | 136689/371472 [10:51:35<19:40:45,  3.31it/s]
 37%|███▋      | 136690/371472 [10:51:35<18:49:12,  3.47it/s]
 37%|███▋      | 136691/371472 [10:51:35<18:10:10,  3.59it/s]
 37%|███▋      | 136692/371472 [10:51:36<17:43:54,  3.68it/s]
 37%|███▋      | 136693/371472 [10:51:36<20:19:56,  3.21it/s]
 37%|███▋      | 136694/371472 [10:51:36<19:39:24,  3.32it/s]
 37%|███▋      | 136695/371472 [10:51:37<21:00:26,  3.10it/s]
 37%|███▋      | 136696/371472 [10:51:37<19:42:21,  3.31it/s]
 37%|███▋      | 136697/371472 [10:51:37<19:22:18,  3.37it/s]
 37%|███▋      | 136698/371472 [10:51:38<18:51:57,  3.46it/s]
 37%|███▋      | 136699/371472 [10:51:38<18:35:21,  3.51it/s]
 37%|███▋      | 136700/371472 [10:51:38<17:44:23,  3.68it/s]
                                                             
{'loss': 3.0142, 'learning_rate': 6.691105173565472e-07, 'epoch': 5.89}

 37%|███▋      | 136700/371472 [10:51:38<17:44:23,  3.68it/s]
 37%|███▋      | 136701/371472 [10:51:38<19:32:57,  3.34it/s]
 37%|███▋      | 136702/371472 [10:51:39<18:59:58,  3.43it/s]
 37%|███▋      | 136703/371472 [10:51:39<19:06:57,  3.41it/s]
 37%|███▋      | 136704/371472 [10:51:39<19:28:47,  3.35it/s]
 37%|███▋      | 136705/371472 [10:51:40<19:03:38,  3.42it/s]
 37%|███▋      | 136706/371472 [10:51:40<18:43:01,  3.48it/s]
 37%|███▋      | 136707/371472 [10:51:40<18:04:10,  3.61it/s]
 37%|███▋      | 136708/371472 [10:51:40<17:56:05,  3.64it/s]
 37%|███▋      | 136709/371472 [10:51:41<18:32:28,  3.52it/s]
 37%|███▋      | 136710/371472 [10:51:41<18:09:55,  3.59it/s]
 37%|███▋      | 136711/371472 [10:51:41<17:31:54,  3.72it/s]
 37%|███▋      | 136712/371472 [10:51:41<17:19:05,  3.77it/s]
 37%|███▋      | 136713/371472 [10:51:42<18:44:24,  3.48it/s]
 37%|███▋      | 136714/371472 [10:51:42<18:05:19,  3.61it/s]
 37%|███▋      | 136715/371472 [10:51:42<19:07:52,  3.41it/s]
 37%|███▋      | 136716/371472 [10:51:43<19:32:58,  3.34it/s]
 37%|███▋      | 136717/371472 [10:51:43<18:53:16,  3.45it/s]
 37%|███▋      | 136718/371472 [10:51:43<18:27:21,  3.53it/s]
 37%|███▋      | 136719/371472 [10:51:43<18:10:26,  3.59it/s]
 37%|███▋      | 136720/371472 [10:51:44<18:15:11,  3.57it/s]
                                                             
{'loss': 3.0936, 'learning_rate': 6.690620353810683e-07, 'epoch': 5.89}

 37%|███▋      | 136720/371472 [10:51:44<18:15:11,  3.57it/s]
 37%|███▋      | 136721/371472 [10:51:44<19:01:55,  3.43it/s]
 37%|███▋      | 136722/371472 [10:51:44<19:49:00,  3.29it/s]
 37%|███▋      | 136723/371472 [10:51:45<19:29:28,  3.35it/s]
 37%|███▋      | 136724/371472 [10:51:45<20:10:31,  3.23it/s]
 37%|███▋      | 136725/371472 [10:51:45<20:27:14,  3.19it/s]
 37%|███▋      | 136726/371472 [10:51:46<20:25:04,  3.19it/s]
 37%|███▋      | 136727/371472 [10:51:46<19:20:13,  3.37it/s]
 37%|███▋      | 136728/371472 [10:51:46<18:15:21,  3.57it/s]
 37%|███▋      | 136729/371472 [10:51:46<17:49:48,  3.66it/s]
 37%|███▋      | 136730/371472 [10:51:47<18:27:18,  3.53it/s]
 37%|███▋      | 136731/371472 [10:51:47<17:59:36,  3.62it/s]
 37%|███▋      | 136732/371472 [10:51:47<18:37:29,  3.50it/s]
 37%|███▋      | 136733/371472 [10:51:48<17:54:06,  3.64it/s]
 37%|███▋      | 136734/371472 [10:51:48<18:13:34,  3.58it/s]
 37%|███▋      | 136735/371472 [10:51:48<17:54:20,  3.64it/s]
 37%|███▋      | 136736/371472 [10:51:48<17:39:44,  3.69it/s]
 37%|███▋      | 136737/371472 [10:51:49<17:20:05,  3.76it/s]
 37%|███▋      | 136738/371472 [10:51:49<17:48:04,  3.66it/s]
 37%|███▋      | 136739/371472 [10:51:49<17:59:16,  3.62it/s]
 37%|███▋      | 136740/371472 [10:51:49<18:25:22,  3.54it/s]
                                                             
{'loss': 3.0059, 'learning_rate': 6.690135534055894e-07, 'epoch': 5.89}

 37%|███▋      | 136740/371472 [10:51:49<18:25:22,  3.54it/s]
 37%|███▋      | 136741/371472 [10:51:50<18:12:04,  3.58it/s]
 37%|███▋      | 136742/371472 [10:51:50<19:42:51,  3.31it/s]
 37%|███▋      | 136743/371472 [10:51:50<19:38:48,  3.32it/s]
 37%|███▋      | 136744/371472 [10:51:51<18:56:25,  3.44it/s]
 37%|███▋      | 136745/371472 [10:51:51<19:22:57,  3.36it/s]
 37%|███▋      | 136746/371472 [10:51:51<20:21:51,  3.20it/s]
 37%|███▋      | 136747/371472 [10:51:52<19:35:04,  3.33it/s]
 37%|███▋      | 136748/371472 [10:51:52<19:15:08,  3.39it/s]
 37%|███▋      | 136749/371472 [10:51:52<18:16:46,  3.57it/s]
 37%|███▋      | 136750/371472 [10:51:52<17:41:39,  3.68it/s]
 37%|███▋      | 136751/371472 [10:51:53<17:35:07,  3.71it/s]
 37%|███▋      | 136752/371472 [10:51:53<19:05:51,  3.41it/s]
 37%|███▋      | 136753/371472 [10:51:53<18:11:13,  3.58it/s]
 37%|███▋      | 136754/371472 [10:51:53<17:43:42,  3.68it/s]
 37%|███▋      | 136755/371472 [10:51:54<17:15:59,  3.78it/s]
 37%|███▋      | 136756/371472 [10:51:54<17:41:23,  3.69it/s]
 37%|███▋      | 136757/371472 [10:51:54<17:47:51,  3.66it/s]
 37%|███▋      | 136758/371472 [10:51:55<19:08:25,  3.41it/s]
 37%|███▋      | 136759/371472 [10:51:55<19:14:08,  3.39it/s]
 37%|███▋      | 136760/371472 [10:51:55<19:05:34,  3.41it/s]
                                                             
{'loss': 3.2446, 'learning_rate': 6.689650714301106e-07, 'epoch': 5.89}

 37%|███▋      | 136760/371472 [10:51:55<19:05:34,  3.41it/s]
 37%|███▋      | 136761/371472 [10:51:56<18:51:40,  3.46it/s]
 37%|███▋      | 136762/371472 [10:51:56<19:34:40,  3.33it/s]
 37%|███▋      | 136763/371472 [10:51:56<18:34:06,  3.51it/s]
 37%|███▋      | 136764/371472 [10:51:56<19:16:30,  3.38it/s]
 37%|███▋      | 136765/371472 [10:51:57<18:22:15,  3.55it/s]
 37%|███▋      | 136766/371472 [10:51:57<18:04:54,  3.61it/s]
 37%|███▋      | 136767/371472 [10:51:57<17:36:39,  3.70it/s]
 37%|███▋      | 136768/371472 [10:51:57<17:53:42,  3.64it/s]
 37%|███▋      | 136769/371472 [10:51:58<17:10:17,  3.80it/s]
 37%|███▋      | 136770/371472 [10:51:58<16:55:44,  3.85it/s]
 37%|███▋      | 136771/371472 [10:51:58<16:49:13,  3.88it/s]
 37%|███▋      | 136772/371472 [10:51:59<18:29:21,  3.53it/s]
 37%|███▋      | 136773/371472 [10:51:59<18:17:48,  3.56it/s]
 37%|███▋      | 136774/371472 [10:51:59<18:16:59,  3.57it/s]
 37%|███▋      | 136775/371472 [10:51:59<18:23:59,  3.54it/s]
 37%|███▋      | 136776/371472 [10:52:00<18:13:17,  3.58it/s]
 37%|███▋      | 136777/371472 [10:52:00<17:23:41,  3.75it/s]
 37%|███▋      | 136778/371472 [10:52:00<17:38:26,  3.70it/s]
 37%|███▋      | 136779/371472 [10:52:00<18:22:50,  3.55it/s]
 37%|███▋      | 136780/371472 [10:52:01<17:21:21,  3.76it/s]
                                                             
{'loss': 3.1538, 'learning_rate': 6.689165894546316e-07, 'epoch': 5.89}

 37%|███▋      | 136780/371472 [10:52:01<17:21:21,  3.76it/s]
 37%|███▋      | 136781/371472 [10:52:01<17:06:48,  3.81it/s]
 37%|███▋      | 136782/371472 [10:52:01<17:21:44,  3.75it/s]
 37%|███▋      | 136783/371472 [10:52:02<17:23:13,  3.75it/s]
 37%|███▋      | 136784/371472 [10:52:02<17:19:56,  3.76it/s]
 37%|███▋      | 136785/371472 [10:52:02<17:35:43,  3.71it/s]
 37%|███▋      | 136786/371472 [10:52:02<17:41:27,  3.68it/s]
 37%|███▋      | 136787/371472 [10:52:03<19:20:17,  3.37it/s]
 37%|███▋      | 136788/371472 [10:52:03<20:20:35,  3.20it/s]
 37%|███▋      | 136789/371472 [10:52:03<19:39:07,  3.32it/s]
 37%|███▋      | 136790/371472 [10:52:04<18:33:02,  3.51it/s]
 37%|███▋      | 136791/371472 [10:52:04<17:54:24,  3.64it/s]
 37%|███▋      | 136792/371472 [10:52:04<18:20:37,  3.55it/s]
 37%|███▋      | 136793/371472 [10:52:04<17:55:56,  3.64it/s]
 37%|███▋      | 136794/371472 [10:52:05<17:36:31,  3.70it/s]
 37%|███▋      | 136795/371472 [10:52:05<17:09:47,  3.80it/s]
 37%|███▋      | 136796/371472 [10:52:05<17:49:03,  3.66it/s]
 37%|███▋      | 136797/371472 [10:52:05<17:44:47,  3.67it/s]
 37%|███▋      | 136798/371472 [10:52:06<19:02:15,  3.42it/s]
 37%|███▋      | 136799/371472 [10:52:06<18:25:35,  3.54it/s]
 37%|███▋      | 136800/371472 [10:52:06<17:51:57,  3.65it/s]
                                                             
{'loss': 2.9594, 'learning_rate': 6.688681074791527e-07, 'epoch': 5.89}

 37%|███▋      | 136800/371472 [10:52:06<17:51:57,  3.65it/s]
 37%|███▋      | 136801/371472 [10:52:07<17:24:10,  3.75it/s]
 37%|███▋      | 136802/371472 [10:52:07<17:55:58,  3.63it/s]
 37%|███▋      | 136803/371472 [10:52:07<18:38:09,  3.50it/s]
 37%|███▋      | 136804/371472 [10:52:07<18:34:02,  3.51it/s]
 37%|███▋      | 136805/371472 [10:52:08<18:54:15,  3.45it/s]
 37%|███▋      | 136806/371472 [10:52:08<18:09:19,  3.59it/s]
 37%|███▋      | 136807/371472 [10:52:08<19:35:45,  3.33it/s]
 37%|███▋      | 136808/371472 [10:52:09<19:27:37,  3.35it/s]
 37%|███▋      | 136809/371472 [10:52:09<18:26:51,  3.53it/s]
 37%|███▋      | 136810/371472 [10:52:09<18:30:47,  3.52it/s]
 37%|███▋      | 136811/371472 [10:52:09<18:05:27,  3.60it/s]
 37%|███▋      | 136812/371472 [10:52:10<17:32:49,  3.71it/s]
 37%|███▋      | 136813/371472 [10:52:10<18:07:24,  3.60it/s]
 37%|███▋      | 136814/371472 [10:52:10<19:26:01,  3.35it/s]
 37%|███▋      | 136815/371472 [10:52:11<18:50:09,  3.46it/s]
 37%|███▋      | 136816/371472 [10:52:11<18:19:47,  3.56it/s]
 37%|███▋      | 136817/371472 [10:52:11<19:01:43,  3.43it/s]
 37%|███▋      | 136818/371472 [10:52:11<18:29:53,  3.52it/s]
 37%|███▋      | 136819/371472 [10:52:12<19:39:33,  3.32it/s]
 37%|███▋      | 136820/371472 [10:52:12<19:32:06,  3.34it/s]
                                                             
{'loss': 3.0342, 'learning_rate': 6.688196255036738e-07, 'epoch': 5.89}

 37%|███▋      | 136820/371472 [10:52:12<19:32:06,  3.34it/s]
 37%|███▋      | 136821/371472 [10:52:12<19:43:14,  3.31it/s]
 37%|███▋      | 136822/371472 [10:52:13<18:46:40,  3.47it/s]
 37%|███▋      | 136823/371472 [10:52:13<19:28:08,  3.35it/s]
 37%|███▋      | 136824/371472 [10:52:13<19:51:06,  3.28it/s]
 37%|███▋      | 136825/371472 [10:52:14<19:26:54,  3.35it/s]
 37%|███▋      | 136826/371472 [10:52:14<19:43:36,  3.30it/s]
 37%|███▋      | 136827/371472 [10:52:14<18:39:12,  3.49it/s]
 37%|███▋      | 136828/371472 [10:52:14<19:39:27,  3.32it/s]
 37%|███▋      | 136829/371472 [10:52:15<18:43:45,  3.48it/s]
 37%|███▋      | 136830/371472 [10:52:15<17:55:26,  3.64it/s]
 37%|███▋      | 136831/371472 [10:52:15<17:01:06,  3.83it/s]
 37%|███▋      | 136832/371472 [10:52:15<16:43:49,  3.90it/s]
 37%|███▋      | 136833/371472 [10:52:16<18:18:49,  3.56it/s]
 37%|███▋      | 136834/371472 [10:52:16<18:27:25,  3.53it/s]
 37%|███▋      | 136835/371472 [10:52:16<17:52:54,  3.64it/s]
 37%|███▋      | 136836/371472 [10:52:17<18:19:40,  3.56it/s]
 37%|███▋      | 136837/371472 [10:52:17<18:27:40,  3.53it/s]
 37%|███▋      | 136838/371472 [10:52:17<18:29:32,  3.52it/s]
 37%|███▋      | 136839/371472 [10:52:17<17:49:00,  3.66it/s]
 37%|███▋      | 136840/371472 [10:52:18<17:10:32,  3.79it/s]
                                                             
{'loss': 3.1117, 'learning_rate': 6.687711435281948e-07, 'epoch': 5.89}

 37%|███▋      | 136840/371472 [10:52:18<17:10:32,  3.79it/s]
 37%|███▋      | 136841/371472 [10:52:18<17:38:43,  3.69it/s]
 37%|███▋      | 136842/371472 [10:52:18<18:42:34,  3.48it/s]
 37%|███▋      | 136843/371472 [10:52:19<18:24:46,  3.54it/s]
 37%|███▋      | 136844/371472 [10:52:19<17:45:57,  3.67it/s]
 37%|███▋      | 136845/371472 [10:52:19<18:06:25,  3.60it/s]
 37%|███▋      | 136846/371472 [10:52:19<18:51:31,  3.46it/s]
 37%|███▋      | 136847/371472 [10:52:20<18:14:08,  3.57it/s]
 37%|███▋      | 136848/371472 [10:52:20<17:39:09,  3.69it/s]
 37%|███▋      | 136849/371472 [10:52:20<18:46:14,  3.47it/s]
 37%|███▋      | 136850/371472 [10:52:21<18:07:01,  3.60it/s]
 37%|███▋      | 136851/371472 [10:52:21<17:36:08,  3.70it/s]
 37%|███▋      | 136852/371472 [10:52:21<17:50:16,  3.65it/s]
 37%|███▋      | 136853/371472 [10:52:21<17:08:40,  3.80it/s]
 37%|███▋      | 136854/371472 [10:52:22<16:55:38,  3.85it/s]
 37%|███▋      | 136855/371472 [10:52:22<17:31:23,  3.72it/s]
 37%|███▋      | 136856/371472 [10:52:22<19:03:39,  3.42it/s]
 37%|███▋      | 136857/371472 [10:52:22<18:12:32,  3.58it/s]
 37%|███▋      | 136858/371472 [10:52:23<18:37:05,  3.50it/s]
 37%|███▋      | 136859/371472 [10:52:23<17:59:01,  3.62it/s]
 37%|███▋      | 136860/371472 [10:52:23<18:31:09,  3.52it/s]
                                                             
{'loss': 2.9883, 'learning_rate': 6.68722661552716e-07, 'epoch': 5.89}

 37%|███▋      | 136860/371472 [10:52:23<18:31:09,  3.52it/s]
 37%|███▋      | 136861/371472 [10:52:24<18:49:05,  3.46it/s]
 37%|███▋      | 136862/371472 [10:52:24<18:57:49,  3.44it/s]
 37%|███▋      | 136863/371472 [10:52:24<18:32:14,  3.52it/s]
 37%|███▋      | 136864/371472 [10:52:24<18:21:18,  3.55it/s]
 37%|███▋      | 136865/371472 [10:52:25<17:49:42,  3.66it/s]
 37%|███▋      | 136866/371472 [10:52:25<17:38:51,  3.69it/s]
 37%|███▋      | 136867/371472 [10:52:25<17:21:03,  3.76it/s]
 37%|███▋      | 136868/371472 [10:52:25<17:03:23,  3.82it/s]
 37%|███▋      | 136869/371472 [10:52:26<17:22:04,  3.75it/s]
 37%|███▋      | 136870/371472 [10:52:26<17:58:25,  3.63it/s]
 37%|███▋      | 136871/371472 [10:52:26<17:45:05,  3.67it/s]
 37%|███▋      | 136872/371472 [10:52:27<17:52:31,  3.65it/s]
 37%|███▋      | 136873/371472 [10:52:27<18:11:15,  3.58it/s]
 37%|███▋      | 136874/371472 [10:52:27<17:52:49,  3.64it/s]
 37%|███▋      | 136875/371472 [10:52:27<19:41:16,  3.31it/s]
 37%|███▋      | 136876/371472 [10:52:28<18:40:37,  3.49it/s]
 37%|███▋      | 136877/371472 [10:52:28<18:48:51,  3.46it/s]
 37%|███▋      | 136878/371472 [10:52:28<19:19:43,  3.37it/s]
 37%|███▋      | 136879/371472 [10:52:29<18:17:08,  3.56it/s]
 37%|███▋      | 136880/371472 [10:52:29<19:29:47,  3.34it/s]
                                                             
{'loss': 3.039, 'learning_rate': 6.686741795772372e-07, 'epoch': 5.9}

 37%|███▋      | 136880/371472 [10:52:29<19:29:47,  3.34it/s]
 37%|███▋      | 136881/371472 [10:52:29<19:12:43,  3.39it/s]
 37%|███▋      | 136882/371472 [10:52:30<19:15:11,  3.38it/s]
 37%|███▋      | 136883/371472 [10:52:30<19:02:31,  3.42it/s]
 37%|███▋      | 136884/371472 [10:52:30<18:24:50,  3.54it/s]
 37%|███▋      | 136885/371472 [10:52:30<17:23:38,  3.75it/s]
 37%|███▋      | 136886/371472 [10:52:31<17:05:16,  3.81it/s]
 37%|███▋      | 136887/371472 [10:52:31<17:19:20,  3.76it/s]
 37%|███▋      | 136888/371472 [10:52:31<17:21:29,  3.75it/s]
 37%|███▋      | 136889/371472 [10:52:31<17:34:28,  3.71it/s]
 37%|███▋      | 136890/371472 [10:52:32<17:03:25,  3.82it/s]
 37%|███▋      | 136891/371472 [10:52:32<17:53:55,  3.64it/s]
 37%|███▋      | 136892/371472 [10:52:32<17:24:43,  3.74it/s]
 37%|███▋      | 136893/371472 [10:52:32<17:55:27,  3.64it/s]
 37%|███▋      | 136894/371472 [10:52:33<17:04:38,  3.82it/s]
 37%|███▋      | 136895/371472 [10:52:33<17:41:57,  3.68it/s]
 37%|███▋      | 136896/371472 [10:52:33<18:24:48,  3.54it/s]
 37%|███▋      | 136897/371472 [10:52:34<18:13:27,  3.58it/s]
 37%|███▋      | 136898/371472 [10:52:34<19:37:45,  3.32it/s]
 37%|███▋      | 136899/371472 [10:52:34<18:25:57,  3.53it/s]
 37%|███▋      | 136900/371472 [10:52:34<17:42:33,  3.68it/s]
                                                             
{'loss': 3.1795, 'learning_rate': 6.686256976017583e-07, 'epoch': 5.9}

 37%|███▋      | 136900/371472 [10:52:34<17:42:33,  3.68it/s]
 37%|███▋      | 136901/371472 [10:52:35<17:45:22,  3.67it/s]
 37%|███▋      | 136902/371472 [10:52:35<18:20:38,  3.55it/s]
 37%|███▋      | 136903/371472 [10:52:35<17:58:18,  3.63it/s]
 37%|███▋      | 136904/371472 [10:52:35<17:33:21,  3.71it/s]
 37%|███▋      | 136905/371472 [10:52:36<17:10:40,  3.79it/s]
 37%|███▋      | 136906/371472 [10:52:36<17:24:37,  3.74it/s]
 37%|███▋      | 136907/371472 [10:52:36<18:58:48,  3.43it/s]
 37%|███▋      | 136908/371472 [10:52:37<18:21:09,  3.55it/s]
 37%|███▋      | 136909/371472 [10:52:37<18:38:45,  3.49it/s]
 37%|███▋      | 136910/371472 [10:52:37<18:29:24,  3.52it/s]
 37%|███▋      | 136911/371472 [10:52:37<17:53:22,  3.64it/s]
 37%|███▋      | 136912/371472 [10:52:38<18:07:25,  3.60it/s]
 37%|███▋      | 136913/371472 [10:52:38<17:37:31,  3.70it/s]
 37%|███▋      | 136914/371472 [10:52:38<19:41:40,  3.31it/s]
 37%|███▋      | 136915/371472 [10:52:39<18:58:47,  3.43it/s]
 37%|███▋      | 136916/371472 [10:52:39<18:01:08,  3.62it/s]
 37%|███▋      | 136917/371472 [10:52:39<17:13:19,  3.78it/s]
 37%|███▋      | 136918/371472 [10:52:39<17:47:28,  3.66it/s]
 37%|███▋      | 136919/371472 [10:52:40<17:26:06,  3.74it/s]
 37%|███▋      | 136920/371472 [10:52:40<17:37:22,  3.70it/s]
                                                             
{'loss': 3.0312, 'learning_rate': 6.685772156262793e-07, 'epoch': 5.9}

 37%|███▋      | 136920/371472 [10:52:40<17:37:22,  3.70it/s]
 37%|███▋      | 136921/371472 [10:52:40<18:50:11,  3.46it/s]
 37%|███▋      | 136922/371472 [10:52:41<19:23:29,  3.36it/s]
 37%|███▋      | 136923/371472 [10:52:41<18:51:27,  3.45it/s]
 37%|███▋      | 136924/371472 [10:52:41<19:02:32,  3.42it/s]
 37%|███▋      | 136925/371472 [10:52:41<19:38:10,  3.32it/s]
 37%|███▋      | 136926/371472 [10:52:42<19:40:24,  3.31it/s]
 37%|███▋      | 136927/371472 [10:52:42<19:32:20,  3.33it/s]
 37%|███▋      | 136928/371472 [10:52:42<19:44:24,  3.30it/s]
 37%|███▋      | 136929/371472 [10:52:43<18:54:42,  3.44it/s]
 37%|███▋      | 136930/371472 [10:52:43<18:17:50,  3.56it/s]
 37%|███▋      | 136931/371472 [10:52:43<17:48:58,  3.66it/s]
 37%|███▋      | 136932/371472 [10:52:43<18:25:54,  3.53it/s]
 37%|███▋      | 136933/371472 [10:52:44<17:41:58,  3.68it/s]
 37%|███▋      | 136934/371472 [10:52:44<17:58:32,  3.62it/s]
 37%|███▋      | 136935/371472 [10:52:44<18:03:29,  3.61it/s]
 37%|███▋      | 136936/371472 [10:52:45<17:53:30,  3.64it/s]
 37%|███▋      | 136937/371472 [10:52:45<19:30:20,  3.34it/s]
 37%|███▋      | 136938/371472 [10:52:45<19:37:29,  3.32it/s]
 37%|███▋      | 136939/371472 [10:52:46<20:05:17,  3.24it/s]
 37%|███▋      | 136940/371472 [10:52:46<20:42:05,  3.15it/s]
                                                             
{'loss': 3.0345, 'learning_rate': 6.685287336508004e-07, 'epoch': 5.9}

 37%|███▋      | 136940/371472 [10:52:46<20:42:05,  3.15it/s]
 37%|███▋      | 136941/371472 [10:52:46<20:09:19,  3.23it/s]
 37%|███▋      | 136942/371472 [10:52:46<18:49:35,  3.46it/s]
 37%|███▋      | 136943/371472 [10:52:47<18:33:19,  3.51it/s]
 37%|███▋      | 136944/371472 [10:52:47<18:22:24,  3.55it/s]
 37%|███▋      | 136945/371472 [10:52:47<19:39:55,  3.31it/s]
 37%|███▋      | 136946/371472 [10:52:48<18:40:20,  3.49it/s]
 37%|███▋      | 136947/371472 [10:52:48<17:49:35,  3.65it/s]
 37%|███▋      | 136948/371472 [10:52:48<17:27:26,  3.73it/s]
 37%|███▋      | 136949/371472 [10:52:48<17:29:27,  3.72it/s]
 37%|███▋      | 136950/371472 [10:52:49<18:14:24,  3.57it/s]
 37%|███▋      | 136951/371472 [10:52:49<19:04:18,  3.42it/s]
 37%|███▋      | 136952/371472 [10:52:49<18:16:11,  3.57it/s]
 37%|███▋      | 136953/371472 [10:52:50<19:04:45,  3.41it/s]
 37%|███▋      | 136954/371472 [10:52:50<19:23:56,  3.36it/s]
 37%|███▋      | 136955/371472 [10:52:50<18:25:47,  3.53it/s]
 37%|███▋      | 136956/371472 [10:52:50<20:26:32,  3.19it/s]
 37%|███▋      | 136957/371472 [10:52:51<19:58:14,  3.26it/s]
 37%|███▋      | 136958/371472 [10:52:51<18:29:49,  3.52it/s]
 37%|███▋      | 136959/371472 [10:52:51<18:09:52,  3.59it/s]
 37%|███▋      | 136960/371472 [10:52:52<18:28:29,  3.53it/s]
                                                             
{'loss': 3.0789, 'learning_rate': 6.684802516753216e-07, 'epoch': 5.9}

 37%|███▋      | 136960/371472 [10:52:52<18:28:29,  3.53it/s]
 37%|███▋      | 136961/371472 [10:52:52<18:06:09,  3.60it/s]
 37%|███▋      | 136962/371472 [10:52:52<18:20:20,  3.55it/s]
 37%|███▋      | 136963/371472 [10:52:52<18:32:16,  3.51it/s]
 37%|███▋      | 136964/371472 [10:52:53<18:04:42,  3.60it/s]
 37%|███▋      | 136965/371472 [10:52:53<17:57:14,  3.63it/s]
 37%|███▋      | 136966/371472 [10:52:53<17:33:47,  3.71it/s]
 37%|███▋      | 136967/371472 [10:52:53<18:25:24,  3.54it/s]
 37%|███▋      | 136968/371472 [10:52:54<18:30:56,  3.52it/s]
 37%|███▋      | 136969/371472 [10:52:54<18:35:41,  3.50it/s]
 37%|███▋      | 136970/371472 [10:52:54<18:13:03,  3.58it/s]
 37%|███▋      | 136971/371472 [10:52:55<19:19:07,  3.37it/s]
 37%|███▋      | 136972/371472 [10:52:55<19:14:26,  3.39it/s]
 37%|███▋      | 136973/371472 [10:52:55<19:00:19,  3.43it/s]
 37%|███▋      | 136974/371472 [10:52:56<18:21:17,  3.55it/s]
 37%|███▋      | 136975/371472 [10:52:56<18:22:40,  3.54it/s]
 37%|███▋      | 136976/371472 [10:52:56<19:14:33,  3.39it/s]
 37%|███▋      | 136977/371472 [10:52:56<18:32:05,  3.51it/s]
 37%|███▋      | 136978/371472 [10:52:57<19:23:34,  3.36it/s]
 37%|███▋      | 136979/371472 [10:52:57<19:33:48,  3.33it/s]
 37%|███▋      | 136980/371472 [10:52:57<18:48:54,  3.46it/s]
                                                             
{'loss': 3.1513, 'learning_rate': 6.684317696998427e-07, 'epoch': 5.9}

 37%|███▋      | 136980/371472 [10:52:57<18:48:54,  3.46it/s]
 37%|███▋      | 136981/371472 [10:52:58<19:54:17,  3.27it/s]
 37%|███▋      | 136982/371472 [10:52:58<20:19:16,  3.21it/s]
 37%|███▋      | 136983/371472 [10:52:58<20:06:20,  3.24it/s]
 37%|███▋      | 136984/371472 [10:52:59<19:13:55,  3.39it/s]
 37%|███▋      | 136985/371472 [10:52:59<19:07:00,  3.41it/s]
 37%|███▋      | 136986/371472 [10:52:59<18:27:42,  3.53it/s]
 37%|███▋      | 136987/371472 [10:52:59<18:28:12,  3.53it/s]
 37%|███▋      | 136988/371472 [10:53:00<18:27:06,  3.53it/s]
 37%|███▋      | 136989/371472 [10:53:00<18:46:29,  3.47it/s]
 37%|███▋      | 136990/371472 [10:53:00<18:54:46,  3.44it/s]
 37%|███▋      | 136991/371472 [10:53:00<18:33:45,  3.51it/s]
 37%|███▋      | 136992/371472 [10:53:01<18:25:26,  3.54it/s]
 37%|███▋      | 136993/371472 [10:53:01<18:19:56,  3.55it/s]
 37%|███▋      | 136994/371472 [10:53:01<18:20:53,  3.55it/s]
 37%|███▋      | 136995/371472 [10:53:02<18:49:30,  3.46it/s]
 37%|███▋      | 136996/371472 [10:53:02<18:42:37,  3.48it/s]
 37%|███▋      | 136997/371472 [10:53:02<18:47:43,  3.47it/s]
 37%|███▋      | 136998/371472 [10:53:03<19:00:05,  3.43it/s]
 37%|███▋      | 136999/371472 [10:53:03<18:23:03,  3.54it/s]
 37%|███▋      | 137000/371472 [10:53:03<18:02:32,  3.61it/s]
                                                             
{'loss': 2.986, 'learning_rate': 6.683832877243638e-07, 'epoch': 5.9}

 37%|███▋      | 137000/371472 [10:53:03<18:02:32,  3.61it/s]
 37%|███▋      | 137001/371472 [10:53:03<18:25:11,  3.54it/s]
 37%|███▋      | 137002/371472 [10:53:04<18:58:27,  3.43it/s]
 37%|███▋      | 137003/371472 [10:53:04<18:53:04,  3.45it/s]
 37%|███▋      | 137004/371472 [10:53:04<17:53:02,  3.64it/s]
 37%|███▋      | 137005/371472 [10:53:04<18:19:57,  3.55it/s]
 37%|███▋      | 137006/371472 [10:53:05<19:01:28,  3.42it/s]
 37%|███▋      | 137007/371472 [10:53:05<18:55:55,  3.44it/s]
 37%|███▋      | 137008/371472 [10:53:05<18:55:31,  3.44it/s]
 37%|███▋      | 137009/371472 [10:53:06<20:00:56,  3.25it/s]
 37%|███▋      | 137010/371472 [10:53:06<20:23:27,  3.19it/s]
 37%|███▋      | 137011/371472 [10:53:06<19:53:58,  3.27it/s]
 37%|███▋      | 137012/371472 [10:53:07<19:10:59,  3.40it/s]
 37%|███▋      | 137013/371472 [10:53:07<19:45:27,  3.30it/s]
 37%|███▋      | 137014/371472 [10:53:07<19:00:13,  3.43it/s]
 37%|███▋      | 137015/371472 [10:53:07<18:37:08,  3.50it/s]
 37%|███▋      | 137016/371472 [10:53:08<18:52:07,  3.45it/s]
 37%|███▋      | 137017/371472 [10:53:08<18:37:41,  3.50it/s]
 37%|███▋      | 137018/371472 [10:53:08<19:49:35,  3.28it/s]
 37%|███▋      | 137019/371472 [10:53:09<19:24:16,  3.36it/s]
 37%|███▋      | 137020/371472 [10:53:09<18:43:01,  3.48it/s]
                                                             
{'loss': 3.0019, 'learning_rate': 6.683348057488849e-07, 'epoch': 5.9}

 37%|███▋      | 137020/371472 [10:53:09<18:43:01,  3.48it/s]
 37%|███▋      | 137021/371472 [10:53:09<17:56:25,  3.63it/s]
 37%|███▋      | 137022/371472 [10:53:09<18:04:43,  3.60it/s]
 37%|███▋      | 137023/371472 [10:53:10<18:11:01,  3.58it/s]
 37%|███▋      | 137024/371472 [10:53:10<18:37:18,  3.50it/s]
 37%|███▋      | 137025/371472 [10:53:10<18:23:34,  3.54it/s]
 37%|███▋      | 137026/371472 [10:53:11<18:53:19,  3.45it/s]
 37%|███▋      | 137027/371472 [10:53:11<18:14:50,  3.57it/s]
 37%|███▋      | 137028/371472 [10:53:11<17:28:07,  3.73it/s]
 37%|███▋      | 137029/371472 [10:53:11<17:02:08,  3.82it/s]
 37%|███▋      | 137030/371472 [10:53:12<17:22:49,  3.75it/s]
 37%|███▋      | 137031/371472 [10:53:12<17:48:05,  3.66it/s]
 37%|███▋      | 137032/371472 [10:53:12<19:58:05,  3.26it/s]
 37%|███▋      | 137033/371472 [10:53:13<20:02:11,  3.25it/s]
 37%|███▋      | 137034/371472 [10:53:13<19:51:55,  3.28it/s]
 37%|███▋      | 137035/371472 [10:53:13<22:28:35,  2.90it/s]
 37%|███▋      | 137036/371472 [10:53:14<21:21:58,  3.05it/s]
 37%|███▋      | 137037/371472 [10:53:14<20:00:16,  3.26it/s]
 37%|███▋      | 137038/371472 [10:53:14<19:58:51,  3.26it/s]
 37%|███▋      | 137039/371472 [10:53:15<21:20:52,  3.05it/s]
 37%|███▋      | 137040/371472 [10:53:15<20:29:10,  3.18it/s]
                                                             
{'loss': 3.088, 'learning_rate': 6.682863237734059e-07, 'epoch': 5.9}

 37%|███▋      | 137040/371472 [10:53:15<20:29:10,  3.18it/s]
 37%|███▋      | 137041/371472 [10:53:15<22:53:25,  2.84it/s]
 37%|███▋      | 137042/371472 [10:53:16<20:49:23,  3.13it/s]
 37%|███▋      | 137043/371472 [10:53:16<20:33:50,  3.17it/s]
 37%|███▋      | 137044/371472 [10:53:16<19:51:26,  3.28it/s]
 37%|███▋      | 137045/371472 [10:53:16<20:02:57,  3.25it/s]
 37%|███▋      | 137046/371472 [10:53:17<19:48:13,  3.29it/s]
 37%|███▋      | 137047/371472 [10:53:17<18:47:40,  3.46it/s]
 37%|███▋      | 137048/371472 [10:53:17<19:19:18,  3.37it/s]
 37%|███▋      | 137049/371472 [10:53:18<18:50:22,  3.46it/s]
 37%|███▋      | 137050/371472 [10:53:18<18:35:44,  3.50it/s]
 37%|███▋      | 137051/371472 [10:53:18<18:47:08,  3.47it/s]
 37%|███▋      | 137052/371472 [10:53:18<19:00:45,  3.42it/s]
 37%|███▋      | 137053/371472 [10:53:19<18:33:04,  3.51it/s]
 37%|███▋      | 137054/371472 [10:53:19<19:12:02,  3.39it/s]
 37%|███▋      | 137055/371472 [10:53:19<18:25:42,  3.53it/s]
 37%|███▋      | 137056/371472 [10:53:20<18:12:40,  3.58it/s]
 37%|███▋      | 137057/371472 [10:53:20<19:28:10,  3.34it/s]
 37%|███▋      | 137058/371472 [10:53:20<20:17:21,  3.21it/s]
 37%|███▋      | 137059/371472 [10:53:21<19:21:25,  3.36it/s]
 37%|███▋      | 137060/371472 [10:53:21<19:11:30,  3.39it/s]
                                                             
{'loss': 3.0026, 'learning_rate': 6.682378417979271e-07, 'epoch': 5.9}

 37%|███▋      | 137060/371472 [10:53:21<19:11:30,  3.39it/s]
 37%|███▋      | 137061/371472 [10:53:21<18:43:25,  3.48it/s]
 37%|███▋      | 137062/371472 [10:53:21<18:04:01,  3.60it/s]
 37%|███▋      | 137063/371472 [10:53:22<18:04:58,  3.60it/s]
 37%|███▋      | 137064/371472 [10:53:22<18:10:56,  3.58it/s]
 37%|███▋      | 137065/371472 [10:53:22<17:55:05,  3.63it/s]
 37%|███▋      | 137066/371472 [10:53:22<17:25:57,  3.74it/s]
 37%|███▋      | 137067/371472 [10:53:23<17:59:31,  3.62it/s]
 37%|███▋      | 137068/371472 [10:53:23<18:16:37,  3.56it/s]
 37%|███▋      | 137069/371472 [10:53:23<17:50:15,  3.65it/s]
 37%|███▋      | 137070/371472 [10:53:23<16:54:54,  3.85it/s]
 37%|███▋      | 137071/371472 [10:53:24<16:25:08,  3.97it/s]
 37%|███▋      | 137072/371472 [10:53:24<16:04:52,  4.05it/s]
 37%|███▋      | 137073/371472 [10:53:24<17:02:58,  3.82it/s]
 37%|███▋      | 137074/371472 [10:53:24<16:46:20,  3.88it/s]
 37%|███▋      | 137075/371472 [10:53:25<16:59:21,  3.83it/s]
 37%|███▋      | 137076/371472 [10:53:25<17:00:42,  3.83it/s]
 37%|███▋      | 137077/371472 [10:53:25<16:39:15,  3.91it/s]
 37%|███▋      | 137078/371472 [10:53:26<16:36:22,  3.92it/s]
 37%|███▋      | 137079/371472 [10:53:26<16:56:30,  3.84it/s]
 37%|███▋      | 137080/371472 [10:53:26<16:48:31,  3.87it/s]
                                                             
{'loss': 3.2295, 'learning_rate': 6.681893598224482e-07, 'epoch': 5.9}

 37%|███▋      | 137080/371472 [10:53:26<16:48:31,  3.87it/s]
 37%|███▋      | 137081/371472 [10:53:26<19:53:49,  3.27it/s]
 37%|███▋      | 137082/371472 [10:53:27<18:52:44,  3.45it/s]
 37%|███▋      | 137083/371472 [10:53:27<18:09:18,  3.59it/s]
 37%|███▋      | 137084/371472 [10:53:27<19:53:18,  3.27it/s]
 37%|███▋      | 137085/371472 [10:53:28<20:32:51,  3.17it/s]
 37%|███▋      | 137086/371472 [10:53:28<19:29:18,  3.34it/s]
 37%|███▋      | 137087/371472 [10:53:28<20:11:23,  3.22it/s]
 37%|███▋      | 137088/371472 [10:53:29<19:04:33,  3.41it/s]
 37%|███▋      | 137089/371472 [10:53:29<18:00:39,  3.61it/s]
 37%|███▋      | 137090/371472 [10:53:29<18:25:44,  3.53it/s]
 37%|███▋      | 137091/371472 [10:53:29<17:41:15,  3.68it/s]
 37%|███▋      | 137092/371472 [10:53:30<17:55:11,  3.63it/s]
 37%|███▋      | 137093/371472 [10:53:30<18:42:24,  3.48it/s]
 37%|███▋      | 137094/371472 [10:53:30<19:06:12,  3.41it/s]
 37%|███▋      | 137095/371472 [10:53:31<18:55:49,  3.44it/s]
 37%|███▋      | 137096/371472 [10:53:31<18:00:36,  3.61it/s]
 37%|███▋      | 137097/371472 [10:53:31<17:57:40,  3.62it/s]
 37%|███▋      | 137098/371472 [10:53:31<17:34:03,  3.71it/s]
 37%|███▋      | 137099/371472 [10:53:32<17:17:25,  3.77it/s]
 37%|███▋      | 137100/371472 [10:53:32<17:40:21,  3.68it/s]
                                                             
{'loss': 3.1641, 'learning_rate': 6.681408778469693e-07, 'epoch': 5.91}

 37%|███▋      | 137100/371472 [10:53:32<17:40:21,  3.68it/s]
 37%|███▋      | 137101/371472 [10:53:32<17:53:51,  3.64it/s]
 37%|███▋      | 137102/371472 [10:53:32<17:52:48,  3.64it/s]
 37%|███▋      | 137103/371472 [10:53:33<17:08:32,  3.80it/s]
 37%|███▋      | 137104/371472 [10:53:33<18:40:57,  3.48it/s]
 37%|███▋      | 137105/371472 [10:53:33<18:26:02,  3.53it/s]
 37%|███▋      | 137106/371472 [10:53:34<19:51:55,  3.28it/s]
 37%|███▋      | 137107/371472 [10:53:34<18:48:02,  3.46it/s]
 37%|███▋      | 137108/371472 [10:53:34<18:38:35,  3.49it/s]
 37%|███▋      | 137109/371472 [10:53:34<18:23:00,  3.54it/s]
 37%|███▋      | 137110/371472 [10:53:35<19:27:14,  3.35it/s]
 37%|███▋      | 137111/371472 [10:53:35<19:37:31,  3.32it/s]
 37%|███▋      | 137112/371472 [10:53:35<18:13:21,  3.57it/s]
 37%|███▋      | 137113/371472 [10:53:36<17:32:29,  3.71it/s]
 37%|███▋      | 137114/371472 [10:53:36<16:54:27,  3.85it/s]
 37%|███▋      | 137115/371472 [10:53:36<16:29:47,  3.95it/s]
 37%|███▋      | 137116/371472 [10:53:36<16:32:41,  3.93it/s]
 37%|███▋      | 137117/371472 [10:53:37<17:09:05,  3.80it/s]
 37%|███▋      | 137118/371472 [10:53:37<16:49:42,  3.87it/s]
 37%|███▋      | 137119/371472 [10:53:37<16:39:43,  3.91it/s]
 37%|███▋      | 137120/371472 [10:53:37<16:52:14,  3.86it/s]
                                                             
{'loss': 3.2013, 'learning_rate': 6.680923958714904e-07, 'epoch': 5.91}

 37%|███▋      | 137120/371472 [10:53:37<16:52:14,  3.86it/s]
 37%|███▋      | 137121/371472 [10:53:38<18:56:42,  3.44it/s]
 37%|███▋      | 137122/371472 [10:53:38<18:04:54,  3.60it/s]
 37%|███▋      | 137123/371472 [10:53:38<17:48:01,  3.66it/s]
 37%|███▋      | 137124/371472 [10:53:39<19:35:17,  3.32it/s]
 37%|███▋      | 137125/371472 [10:53:39<19:10:26,  3.40it/s]
 37%|███▋      | 137126/371472 [10:53:39<18:26:44,  3.53it/s]
 37%|███▋      | 137127/371472 [10:53:39<17:46:50,  3.66it/s]
 37%|███▋      | 137128/371472 [10:53:40<18:40:30,  3.49it/s]
 37%|███▋      | 137129/371472 [10:53:40<17:52:43,  3.64it/s]
 37%|███▋      | 137130/371472 [10:53:40<17:32:02,  3.71it/s]
 37%|███▋      | 137131/371472 [10:53:40<16:47:24,  3.88it/s]
 37%|███▋      | 137132/371472 [10:53:41<16:45:47,  3.88it/s]
 37%|███▋      | 137133/371472 [10:53:41<17:52:25,  3.64it/s]
 37%|███▋      | 137134/371472 [10:53:41<19:08:48,  3.40it/s]
 37%|███▋      | 137135/371472 [10:53:42<19:05:34,  3.41it/s]
 37%|███▋      | 137136/371472 [10:53:42<18:20:16,  3.55it/s]
 37%|███▋      | 137137/371472 [10:53:42<17:22:03,  3.75it/s]
 37%|███▋      | 137138/371472 [10:53:42<17:04:34,  3.81it/s]
 37%|███▋      | 137139/371472 [10:53:43<16:48:23,  3.87it/s]
 37%|███▋      | 137140/371472 [10:53:43<16:39:41,  3.91it/s]
                                                             
{'loss': 3.0945, 'learning_rate': 6.680439138960116e-07, 'epoch': 5.91}

 37%|███▋      | 137140/371472 [10:53:43<16:39:41,  3.91it/s]
 37%|███▋      | 137141/371472 [10:53:43<17:01:57,  3.82it/s]
 37%|███▋      | 137142/371472 [10:53:43<17:35:00,  3.70it/s]
 37%|███▋      | 137143/371472 [10:53:44<19:32:22,  3.33it/s]
 37%|███▋      | 137144/371472 [10:53:44<18:32:49,  3.51it/s]
 37%|███▋      | 137145/371472 [10:53:44<18:07:02,  3.59it/s]
 37%|███▋      | 137146/371472 [10:53:45<17:37:57,  3.69it/s]
 37%|███▋      | 137147/371472 [10:53:45<18:50:28,  3.45it/s]
 37%|███▋      | 137148/371472 [10:53:45<18:59:36,  3.43it/s]
 37%|███▋      | 137149/371472 [10:53:45<18:43:22,  3.48it/s]
 37%|███▋      | 137150/371472 [10:53:46<17:59:51,  3.62it/s]
 37%|███▋      | 137151/371472 [10:53:46<17:50:26,  3.65it/s]
 37%|███▋      | 137152/371472 [10:53:46<17:38:41,  3.69it/s]
 37%|███▋      | 137153/371472 [10:53:46<17:37:03,  3.69it/s]
 37%|███▋      | 137154/371472 [10:53:47<19:53:24,  3.27it/s]
 37%|███▋      | 137155/371472 [10:53:47<18:33:47,  3.51it/s]
 37%|███▋      | 137156/371472 [10:53:47<17:57:18,  3.63it/s]
 37%|███▋      | 137157/371472 [10:53:48<19:55:34,  3.27it/s]
 37%|███▋      | 137158/371472 [10:53:48<20:27:06,  3.18it/s]
 37%|███▋      | 137159/371472 [10:53:48<20:14:13,  3.22it/s]
 37%|███▋      | 137160/371472 [10:53:49<19:13:51,  3.38it/s]
                                                             
{'loss': 3.1501, 'learning_rate': 6.679954319205326e-07, 'epoch': 5.91}

 37%|███▋      | 137160/371472 [10:53:49<19:13:51,  3.38it/s]
 37%|███▋      | 137161/371472 [10:53:49<18:23:10,  3.54it/s]
 37%|███▋      | 137162/371472 [10:53:49<18:25:09,  3.53it/s]
 37%|███▋      | 137163/371472 [10:53:49<18:59:43,  3.43it/s]
 37%|███▋      | 137164/371472 [10:53:50<18:35:36,  3.50it/s]
 37%|███▋      | 137165/371472 [10:53:50<18:08:52,  3.59it/s]
 37%|███▋      | 137166/371472 [10:53:50<18:02:56,  3.61it/s]
 37%|███▋      | 137167/371472 [10:53:51<18:09:20,  3.58it/s]
 37%|███▋      | 137168/371472 [10:53:51<18:06:07,  3.60it/s]
 37%|███▋      | 137169/371472 [10:53:51<18:09:45,  3.58it/s]
 37%|███▋      | 137170/371472 [10:53:51<17:38:02,  3.69it/s]
 37%|███▋      | 137171/371472 [10:53:52<18:18:53,  3.55it/s]
 37%|███▋      | 137172/371472 [10:53:52<18:09:14,  3.59it/s]
 37%|███▋      | 137173/371472 [10:53:52<17:39:08,  3.69it/s]
 37%|███▋      | 137174/371472 [10:53:53<18:19:44,  3.55it/s]
 37%|███▋      | 137175/371472 [10:53:53<18:00:08,  3.62it/s]
 37%|███▋      | 137176/371472 [10:53:53<17:43:08,  3.67it/s]
 37%|███▋      | 137177/371472 [10:53:53<18:40:15,  3.49it/s]
 37%|███▋      | 137178/371472 [10:53:54<17:57:47,  3.62it/s]
 37%|███▋      | 137179/371472 [10:53:54<17:25:11,  3.74it/s]
 37%|███▋      | 137180/371472 [10:53:54<17:35:24,  3.70it/s]
                                                             
{'loss': 3.1245, 'learning_rate': 6.679469499450537e-07, 'epoch': 5.91}

 37%|███▋      | 137180/371472 [10:53:54<17:35:24,  3.70it/s]
 37%|███▋      | 137181/371472 [10:53:54<18:09:30,  3.58it/s]
 37%|███▋      | 137182/371472 [10:53:55<17:25:03,  3.74it/s]
 37%|███▋      | 137183/371472 [10:53:55<17:24:02,  3.74it/s]
 37%|███▋      | 137184/371472 [10:53:55<17:57:14,  3.62it/s]
 37%|███▋      | 137185/371472 [10:53:56<19:18:34,  3.37it/s]
 37%|███▋      | 137186/371472 [10:53:56<19:10:39,  3.39it/s]
 37%|███▋      | 137187/371472 [10:53:56<18:07:53,  3.59it/s]
 37%|███▋      | 137188/371472 [10:53:56<18:05:45,  3.60it/s]
 37%|███▋      | 137189/371472 [10:53:57<17:48:52,  3.65it/s]
 37%|███▋      | 137190/371472 [10:53:57<18:04:24,  3.60it/s]
 37%|███▋      | 137191/371472 [10:53:57<17:35:16,  3.70it/s]
 37%|███▋      | 137192/371472 [10:53:58<19:14:49,  3.38it/s]
 37%|███▋      | 137193/371472 [10:53:58<18:38:09,  3.49it/s]
 37%|███▋      | 137194/371472 [10:53:58<20:30:17,  3.17it/s]
 37%|███▋      | 137195/371472 [10:53:58<19:48:17,  3.29it/s]
 37%|███▋      | 137196/371472 [10:53:59<19:29:24,  3.34it/s]
 37%|███▋      | 137197/371472 [10:53:59<18:45:59,  3.47it/s]
 37%|███▋      | 137198/371472 [10:53:59<18:46:43,  3.47it/s]
 37%|███▋      | 137199/371472 [10:54:00<18:47:13,  3.46it/s]
 37%|███▋      | 137200/371472 [10:54:00<18:58:08,  3.43it/s]
                                                             
{'loss': 2.8896, 'learning_rate': 6.678984679695748e-07, 'epoch': 5.91}

 37%|███▋      | 137200/371472 [10:54:00<18:58:08,  3.43it/s]
 37%|███▋      | 137201/371472 [10:54:00<19:13:05,  3.39it/s]
 37%|███▋      | 137202/371472 [10:54:01<20:33:03,  3.17it/s]
 37%|███▋      | 137203/371472 [10:54:01<19:27:33,  3.34it/s]
 37%|███▋      | 137204/371472 [10:54:01<19:23:47,  3.35it/s]
 37%|███▋      | 137205/371472 [10:54:01<19:06:45,  3.40it/s]
 37%|███▋      | 137206/371472 [10:54:02<18:10:56,  3.58it/s]
 37%|███▋      | 137207/371472 [10:54:02<18:00:06,  3.61it/s]
 37%|███▋      | 137208/371472 [10:54:02<20:52:27,  3.12it/s]
 37%|███▋      | 137209/371472 [10:54:03<21:08:33,  3.08it/s]
 37%|███▋      | 137210/371472 [10:54:03<20:55:30,  3.11it/s]
 37%|███▋      | 137211/371472 [10:54:03<19:09:44,  3.40it/s]
 37%|███▋      | 137212/371472 [10:54:04<18:46:46,  3.47it/s]
 37%|███▋      | 137213/371472 [10:54:04<18:27:38,  3.52it/s]
 37%|███▋      | 137214/371472 [10:54:04<17:41:31,  3.68it/s]
 37%|███▋      | 137215/371472 [10:54:04<19:01:10,  3.42it/s]
 37%|███▋      | 137216/371472 [10:54:05<20:12:22,  3.22it/s]
 37%|███▋      | 137217/371472 [10:54:05<19:16:41,  3.38it/s]
 37%|███▋      | 137218/371472 [10:54:05<20:02:44,  3.25it/s]
 37%|███▋      | 137219/371472 [10:54:06<21:23:50,  3.04it/s]
 37%|███▋      | 137220/371472 [10:54:06<19:54:56,  3.27it/s]
                                                             
{'loss': 2.9712, 'learning_rate': 6.67849985994096e-07, 'epoch': 5.91}

 37%|███▋      | 137220/371472 [10:54:06<19:54:56,  3.27it/s]
 37%|███▋      | 137221/371472 [10:54:06<18:39:01,  3.49it/s]
 37%|███▋      | 137222/371472 [10:54:07<19:22:55,  3.36it/s]
 37%|███▋      | 137223/371472 [10:54:07<19:36:38,  3.32it/s]
 37%|███▋      | 137224/371472 [10:54:07<19:33:15,  3.33it/s]
 37%|███▋      | 137225/371472 [10:54:07<19:07:36,  3.40it/s]
 37%|███▋      | 137226/371472 [10:54:08<18:26:49,  3.53it/s]
 37%|███▋      | 137227/371472 [10:54:08<18:16:43,  3.56it/s]
 37%|███▋      | 137228/371472 [10:54:08<19:04:30,  3.41it/s]
 37%|███▋      | 137229/371472 [10:54:08<18:08:16,  3.59it/s]
 37%|███▋      | 137230/371472 [10:54:09<18:22:27,  3.54it/s]
 37%|███▋      | 137231/371472 [10:54:09<18:13:13,  3.57it/s]
 37%|███▋      | 137232/371472 [10:54:09<19:19:45,  3.37it/s]
 37%|███▋      | 137233/371472 [10:54:10<18:07:33,  3.59it/s]
 37%|███▋      | 137234/371472 [10:54:10<18:32:01,  3.51it/s]
 37%|███▋      | 137235/371472 [10:54:10<18:14:51,  3.57it/s]
 37%|███▋      | 137236/371472 [10:54:10<17:51:51,  3.64it/s]
 37%|███▋      | 137237/371472 [10:54:11<17:01:39,  3.82it/s]
 37%|███▋      | 137238/371472 [10:54:11<18:29:09,  3.52it/s]
 37%|███▋      | 137239/371472 [10:54:11<18:19:45,  3.55it/s]
 37%|███▋      | 137240/371472 [10:54:12<17:44:02,  3.67it/s]
                                                             
{'loss': 3.2945, 'learning_rate': 6.678015040186171e-07, 'epoch': 5.91}

 37%|███▋      | 137240/371472 [10:54:12<17:44:02,  3.67it/s]
 37%|███▋      | 137241/371472 [10:54:12<17:54:17,  3.63it/s]
 37%|███▋      | 137242/371472 [10:54:12<17:24:41,  3.74it/s]
 37%|███▋      | 137243/371472 [10:54:12<16:57:55,  3.84it/s]
 37%|███▋      | 137244/371472 [10:54:13<17:29:43,  3.72it/s]
 37%|███▋      | 137245/371472 [10:54:13<17:28:29,  3.72it/s]
 37%|███▋      | 137246/371472 [10:54:13<17:18:51,  3.76it/s]
 37%|███▋      | 137247/371472 [10:54:13<17:53:04,  3.64it/s]
 37%|███▋      | 137248/371472 [10:54:14<17:38:59,  3.69it/s]
 37%|███▋      | 137249/371472 [10:54:14<16:50:39,  3.86it/s]
 37%|███▋      | 137250/371472 [10:54:14<17:53:08,  3.64it/s]
 37%|███▋      | 137251/371472 [10:54:14<17:01:50,  3.82it/s]
 37%|███▋      | 137252/371472 [10:54:15<17:03:45,  3.81it/s]
 37%|███▋      | 137253/371472 [10:54:15<17:18:01,  3.76it/s]
 37%|███▋      | 137254/371472 [10:54:15<16:40:12,  3.90it/s]
 37%|███▋      | 137255/371472 [10:54:16<17:39:50,  3.68it/s]
 37%|███▋      | 137256/371472 [10:54:16<17:18:41,  3.76it/s]
 37%|███▋      | 137257/371472 [10:54:16<17:38:24,  3.69it/s]
 37%|███▋      | 137258/371472 [10:54:16<18:23:47,  3.54it/s]
 37%|███▋      | 137259/371472 [10:54:17<18:07:22,  3.59it/s]
 37%|███▋      | 137260/371472 [10:54:17<17:50:15,  3.65it/s]
                                                             
{'loss': 3.28, 'learning_rate': 6.677530220431382e-07, 'epoch': 5.91}

 37%|███▋      | 137260/371472 [10:54:17<17:50:15,  3.65it/s]
 37%|███▋      | 137261/371472 [10:54:17<17:46:59,  3.66it/s]
 37%|███▋      | 137262/371472 [10:54:18<18:29:48,  3.52it/s]
 37%|███▋      | 137263/371472 [10:54:18<18:00:18,  3.61it/s]
 37%|███▋      | 137264/371472 [10:54:18<17:37:29,  3.69it/s]
 37%|███▋      | 137265/371472 [10:54:18<18:21:49,  3.54it/s]
 37%|███▋      | 137266/371472 [10:54:19<17:53:36,  3.64it/s]
 37%|███▋      | 137267/371472 [10:54:19<19:14:39,  3.38it/s]
 37%|███▋      | 137268/371472 [10:54:19<18:47:53,  3.46it/s]
 37%|███▋      | 137269/371472 [10:54:20<19:14:02,  3.38it/s]
 37%|███▋      | 137270/371472 [10:54:20<18:53:04,  3.44it/s]
 37%|███▋      | 137271/371472 [10:54:20<19:05:20,  3.41it/s]
 37%|███▋      | 137272/371472 [10:54:20<18:59:06,  3.43it/s]
 37%|███▋      | 137273/371472 [10:54:21<18:27:04,  3.53it/s]
 37%|███▋      | 137274/371472 [10:54:21<17:42:25,  3.67it/s]
 37%|███▋      | 137275/371472 [10:54:21<17:37:17,  3.69it/s]
 37%|███▋      | 137276/371472 [10:54:21<18:16:20,  3.56it/s]
 37%|███▋      | 137277/371472 [10:54:22<17:33:30,  3.70it/s]
 37%|███▋      | 137278/371472 [10:54:22<17:06:46,  3.80it/s]
 37%|███▋      | 137279/371472 [10:54:22<17:18:02,  3.76it/s]
 37%|███▋      | 137280/371472 [10:54:23<17:10:02,  3.79it/s]
                                                             
{'loss': 3.2057, 'learning_rate': 6.677045400676593e-07, 'epoch': 5.91}

 37%|███▋      | 137280/371472 [10:54:23<17:10:02,  3.79it/s]
 37%|███▋      | 137281/371472 [10:54:23<16:38:14,  3.91it/s]
 37%|███▋      | 137282/371472 [10:54:23<17:01:56,  3.82it/s]
 37%|███▋      | 137283/371472 [10:54:23<18:11:31,  3.58it/s]
 37%|███▋      | 137284/371472 [10:54:24<17:41:46,  3.68it/s]
 37%|███▋      | 137285/371472 [10:54:24<19:00:19,  3.42it/s]
 37%|███▋      | 137286/371472 [10:54:24<19:03:21,  3.41it/s]
 37%|███▋      | 137287/371472 [10:54:25<20:28:02,  3.18it/s]
 37%|███▋      | 137288/371472 [10:54:25<21:34:50,  3.01it/s]
 37%|███▋      | 137289/371472 [10:54:25<20:09:03,  3.23it/s]
 37%|███▋      | 137290/371472 [10:54:25<19:20:56,  3.36it/s]
 37%|███▋      | 137291/371472 [10:54:26<18:59:25,  3.43it/s]
 37%|███▋      | 137292/371472 [10:54:26<18:14:08,  3.57it/s]
 37%|███▋      | 137293/371472 [10:54:26<19:03:17,  3.41it/s]
 37%|███▋      | 137294/371472 [10:54:27<18:19:05,  3.55it/s]
 37%|███▋      | 137295/371472 [10:54:27<17:14:24,  3.77it/s]
 37%|███▋      | 137296/371472 [10:54:27<19:15:45,  3.38it/s]
 37%|███▋      | 137297/371472 [10:54:28<19:49:09,  3.28it/s]
 37%|███▋      | 137298/371472 [10:54:28<20:15:59,  3.21it/s]
 37%|███▋      | 137299/371472 [10:54:28<19:39:38,  3.31it/s]
 37%|███▋      | 137300/371472 [10:54:28<20:12:13,  3.22it/s]
                                                             
{'loss': 3.1788, 'learning_rate': 6.676560580921803e-07, 'epoch': 5.91}

 37%|███▋      | 137300/371472 [10:54:28<20:12:13,  3.22it/s]
 37%|███▋      | 137301/371472 [10:54:29<19:36:02,  3.32it/s]
 37%|███▋      | 137302/371472 [10:54:29<18:32:20,  3.51it/s]
 37%|███▋      | 137303/371472 [10:54:29<18:37:39,  3.49it/s]
 37%|███▋      | 137304/371472 [10:54:30<17:54:44,  3.63it/s]
 37%|███▋      | 137305/371472 [10:54:30<18:25:45,  3.53it/s]
 37%|███▋      | 137306/371472 [10:54:30<18:57:25,  3.43it/s]
 37%|███▋      | 137307/371472 [10:54:30<17:49:30,  3.65it/s]
 37%|███▋      | 137308/371472 [10:54:31<18:03:15,  3.60it/s]
 37%|███▋      | 137309/371472 [10:54:31<18:15:19,  3.56it/s]
 37%|███▋      | 137310/371472 [10:54:31<17:45:32,  3.66it/s]
 37%|███▋      | 137311/371472 [10:54:31<17:09:57,  3.79it/s]
 37%|███▋      | 137312/371472 [10:54:32<17:24:00,  3.74it/s]
 37%|███▋      | 137313/371472 [10:54:32<17:10:37,  3.79it/s]
 37%|███▋      | 137314/371472 [10:54:32<17:05:28,  3.81it/s]
 37%|███▋      | 137315/371472 [10:54:33<17:26:05,  3.73it/s]
 37%|███▋      | 137316/371472 [10:54:33<17:32:34,  3.71it/s]
 37%|███▋      | 137317/371472 [10:54:33<18:33:47,  3.50it/s]
 37%|███▋      | 137318/371472 [10:54:33<18:02:21,  3.61it/s]
 37%|███▋      | 137319/371472 [10:54:34<17:35:49,  3.70it/s]
 37%|███▋      | 137320/371472 [10:54:34<17:04:09,  3.81it/s]
                                                             
{'loss': 3.2869, 'learning_rate': 6.676075761167014e-07, 'epoch': 5.91}

 37%|███▋      | 137320/371472 [10:54:34<17:04:09,  3.81it/s]
 37%|███▋      | 137321/371472 [10:54:34<17:20:07,  3.75it/s]
 37%|███▋      | 137322/371472 [10:54:35<19:08:39,  3.40it/s]
 37%|███▋      | 137323/371472 [10:54:35<18:56:33,  3.43it/s]
 37%|███▋      | 137324/371472 [10:54:35<20:00:25,  3.25it/s]
 37%|███▋      | 137325/371472 [10:54:35<19:03:35,  3.41it/s]
 37%|███▋      | 137326/371472 [10:54:36<18:00:43,  3.61it/s]
 37%|███▋      | 137327/371472 [10:54:36<17:25:23,  3.73it/s]
 37%|███▋      | 137328/371472 [10:54:36<19:02:02,  3.42it/s]
 37%|███▋      | 137329/371472 [10:54:36<18:40:26,  3.48it/s]
 37%|███▋      | 137330/371472 [10:54:37<18:47:02,  3.46it/s]
 37%|███▋      | 137331/371472 [10:54:37<20:12:59,  3.22it/s]
 37%|███▋      | 137332/371472 [10:54:37<20:00:42,  3.25it/s]
 37%|███▋      | 137333/371472 [10:54:38<20:27:21,  3.18it/s]
 37%|███▋      | 137334/371472 [10:54:38<20:15:15,  3.21it/s]
 37%|███▋      | 137335/371472 [10:54:38<19:48:59,  3.28it/s]
 37%|███▋      | 137336/371472 [10:54:39<19:37:39,  3.31it/s]
 37%|███▋      | 137337/371472 [10:54:39<18:50:59,  3.45it/s]
 37%|███▋      | 137338/371472 [10:54:39<19:32:06,  3.33it/s]
 37%|███▋      | 137339/371472 [10:54:40<18:49:29,  3.45it/s]
 37%|███▋      | 137340/371472 [10:54:40<21:30:28,  3.02it/s]
                                                             
{'loss': 2.9659, 'learning_rate': 6.675590941412225e-07, 'epoch': 5.92}

 37%|███▋      | 137340/371472 [10:54:40<21:30:28,  3.02it/s]
 37%|███▋      | 137341/371472 [10:54:40<19:58:06,  3.26it/s]
 37%|███▋      | 137342/371472 [10:54:40<19:43:51,  3.30it/s]
 37%|███▋      | 137343/371472 [10:54:41<18:46:12,  3.46it/s]
 37%|███▋      | 137344/371472 [10:54:41<19:20:05,  3.36it/s]
 37%|███▋      | 137345/371472 [10:54:41<18:34:38,  3.50it/s]
 37%|███▋      | 137346/371472 [10:54:42<18:27:46,  3.52it/s]
 37%|███▋      | 137347/371472 [10:54:42<18:28:38,  3.52it/s]
 37%|███▋      | 137348/371472 [10:54:42<19:06:14,  3.40it/s]
 37%|███▋      | 137349/371472 [10:54:42<18:06:03,  3.59it/s]
 37%|███▋      | 137350/371472 [10:54:43<17:29:52,  3.72it/s]
 37%|███▋      | 137351/371472 [10:54:43<17:28:03,  3.72it/s]
 37%|███▋      | 137352/371472 [10:54:43<17:10:15,  3.79it/s]
 37%|███▋      | 137353/371472 [10:54:44<17:48:46,  3.65it/s]
 37%|███▋      | 137354/371472 [10:54:44<18:23:55,  3.53it/s]
 37%|███▋      | 137355/371472 [10:54:44<17:44:59,  3.66it/s]
 37%|███▋      | 137356/371472 [10:54:44<16:53:00,  3.85it/s]
 37%|███▋      | 137357/371472 [10:54:45<16:34:02,  3.93it/s]
 37%|███▋      | 137358/371472 [10:54:45<17:14:40,  3.77it/s]
 37%|███▋      | 137359/371472 [10:54:45<16:49:34,  3.86it/s]
 37%|███▋      | 137360/371472 [10:54:45<16:24:33,  3.96it/s]
                                                             
{'loss': 3.1462, 'learning_rate': 6.675106121657436e-07, 'epoch': 5.92}

 37%|███▋      | 137360/371472 [10:54:45<16:24:33,  3.96it/s]
 37%|███▋      | 137361/371472 [10:54:46<16:42:45,  3.89it/s]
 37%|███▋      | 137362/371472 [10:54:46<17:11:23,  3.78it/s]
 37%|███▋      | 137363/371472 [10:54:46<17:22:12,  3.74it/s]
 37%|███▋      | 137364/371472 [10:54:46<17:16:50,  3.76it/s]
 37%|███▋      | 137365/371472 [10:54:47<17:03:53,  3.81it/s]
 37%|███▋      | 137366/371472 [10:54:47<16:40:28,  3.90it/s]
 37%|███▋      | 137367/371472 [10:54:47<17:05:16,  3.81it/s]
 37%|███▋      | 137368/371472 [10:54:47<17:21:06,  3.75it/s]
 37%|███▋      | 137369/371472 [10:54:48<17:40:44,  3.68it/s]
 37%|███▋      | 137370/371472 [10:54:48<18:34:07,  3.50it/s]
 37%|███▋      | 137371/371472 [10:54:48<18:17:25,  3.56it/s]
 37%|███▋      | 137372/371472 [10:54:49<17:56:21,  3.62it/s]
 37%|███▋      | 137373/371472 [10:54:49<17:44:48,  3.66it/s]
 37%|███▋      | 137374/371472 [10:54:49<18:15:36,  3.56it/s]
 37%|███▋      | 137375/371472 [10:54:49<17:59:17,  3.61it/s]
 37%|███▋      | 137376/371472 [10:54:50<18:41:22,  3.48it/s]
 37%|███▋      | 137377/371472 [10:54:50<18:14:14,  3.57it/s]
 37%|███▋      | 137378/371472 [10:54:50<19:39:15,  3.31it/s]
 37%|███▋      | 137379/371472 [10:54:51<18:57:38,  3.43it/s]
 37%|███▋      | 137380/371472 [10:54:51<18:44:10,  3.47it/s]
                                                             
{'loss': 3.0528, 'learning_rate': 6.674621301902648e-07, 'epoch': 5.92}

 37%|███▋      | 137380/371472 [10:54:51<18:44:10,  3.47it/s]
 37%|███▋      | 137381/371472 [10:54:51<17:56:31,  3.62it/s]
 37%|███▋      | 137382/371472 [10:54:51<17:15:45,  3.77it/s]
 37%|███▋      | 137383/371472 [10:54:52<17:58:04,  3.62it/s]
 37%|███▋      | 137384/371472 [10:54:52<17:38:37,  3.69it/s]
 37%|███▋      | 137385/371472 [10:54:52<18:00:52,  3.61it/s]
 37%|███▋      | 137386/371472 [10:54:53<18:11:08,  3.58it/s]
 37%|███▋      | 137387/371472 [10:54:53<18:02:54,  3.60it/s]
 37%|███▋      | 137388/371472 [10:54:53<17:23:29,  3.74it/s]
 37%|███▋      | 137389/371472 [10:54:53<17:38:28,  3.69it/s]
 37%|███▋      | 137390/371472 [10:54:54<18:34:14,  3.50it/s]
 37%|███▋      | 137391/371472 [10:54:54<18:59:15,  3.42it/s]
 37%|███▋      | 137392/371472 [10:54:54<19:04:59,  3.41it/s]
 37%|███▋      | 137393/371472 [10:54:54<18:10:47,  3.58it/s]
 37%|███▋      | 137394/371472 [10:54:55<18:07:53,  3.59it/s]
 37%|███▋      | 137395/371472 [10:54:55<19:57:30,  3.26it/s]
 37%|███▋      | 137396/371472 [10:54:55<20:09:08,  3.23it/s]
 37%|███▋      | 137397/371472 [10:54:56<19:03:05,  3.41it/s]
 37%|███▋      | 137398/371472 [10:54:56<18:09:23,  3.58it/s]
 37%|███▋      | 137399/371472 [10:54:56<17:28:39,  3.72it/s]
 37%|███▋      | 137400/371472 [10:54:56<17:09:12,  3.79it/s]
                                                             
{'loss': 3.0271, 'learning_rate': 6.674136482147859e-07, 'epoch': 5.92}

 37%|███▋      | 137400/371472 [10:54:56<17:09:12,  3.79it/s]
 37%|███▋      | 137401/371472 [10:54:57<18:17:40,  3.55it/s]
 37%|███▋      | 137402/371472 [10:54:57<18:20:46,  3.54it/s]
 37%|███▋      | 137403/371472 [10:54:57<21:02:25,  3.09it/s]
 37%|███▋      | 137404/371472 [10:54:58<19:36:27,  3.32it/s]
 37%|███▋      | 137405/371472 [10:54:58<18:36:59,  3.49it/s]
 37%|███▋      | 137406/371472 [10:54:58<19:35:26,  3.32it/s]
 37%|███▋      | 137407/371472 [10:54:59<18:51:55,  3.45it/s]
 37%|███▋      | 137408/371472 [10:54:59<18:22:25,  3.54it/s]
 37%|███▋      | 137409/371472 [10:54:59<19:16:39,  3.37it/s]
 37%|███▋      | 137410/371472 [10:54:59<19:32:47,  3.33it/s]
 37%|███▋      | 137411/371472 [10:55:00<20:03:46,  3.24it/s]
 37%|███▋      | 137412/371472 [10:55:00<18:57:49,  3.43it/s]
 37%|███▋      | 137413/371472 [10:55:00<18:21:27,  3.54it/s]
 37%|███▋      | 137414/371472 [10:55:01<17:40:35,  3.68it/s]
 37%|███▋      | 137415/371472 [10:55:01<17:46:51,  3.66it/s]
 37%|███▋      | 137416/371472 [10:55:01<18:08:22,  3.58it/s]
 37%|███▋      | 137417/371472 [10:55:01<18:09:56,  3.58it/s]
 37%|███▋      | 137418/371472 [10:55:02<17:59:26,  3.61it/s]
 37%|███▋      | 137419/371472 [10:55:02<18:38:46,  3.49it/s]
 37%|███▋      | 137420/371472 [10:55:02<18:06:58,  3.59it/s]
                                                             
{'loss': 2.9471, 'learning_rate': 6.673651662393069e-07, 'epoch': 5.92}

 37%|███▋      | 137420/371472 [10:55:02<18:06:58,  3.59it/s]
 37%|███▋      | 137421/371472 [10:55:03<17:35:29,  3.70it/s]
 37%|███▋      | 137422/371472 [10:55:03<19:29:55,  3.33it/s]
 37%|███▋      | 137423/371472 [10:55:03<21:59:49,  2.96it/s]
 37%|███▋      | 137424/371472 [10:55:04<20:04:23,  3.24it/s]
 37%|███▋      | 137425/371472 [10:55:04<18:51:25,  3.45it/s]
 37%|███▋      | 137426/371472 [10:55:04<19:02:10,  3.42it/s]
 37%|███▋      | 137427/371472 [10:55:04<18:31:31,  3.51it/s]
 37%|███▋      | 137428/371472 [10:55:05<19:44:02,  3.29it/s]
 37%|███▋      | 137429/371472 [10:55:05<19:03:58,  3.41it/s]
 37%|███▋      | 137430/371472 [10:55:05<18:18:27,  3.55it/s]
 37%|███▋      | 137431/371472 [10:55:05<17:53:02,  3.64it/s]
 37%|███▋      | 137432/371472 [10:55:06<18:07:25,  3.59it/s]
 37%|███▋      | 137433/371472 [10:55:06<17:47:57,  3.65it/s]
 37%|███▋      | 137434/371472 [10:55:06<17:20:05,  3.75it/s]
 37%|███▋      | 137435/371472 [10:55:07<18:01:34,  3.61it/s]
 37%|███▋      | 137436/371472 [10:55:07<18:22:39,  3.54it/s]
 37%|███▋      | 137437/371472 [10:55:07<17:50:20,  3.64it/s]
 37%|███▋      | 137438/371472 [10:55:07<19:22:59,  3.35it/s]
 37%|███▋      | 137439/371472 [10:55:08<18:31:32,  3.51it/s]
 37%|███▋      | 137440/371472 [10:55:08<18:44:09,  3.47it/s]
                                                             
{'loss': 3.2837, 'learning_rate': 6.673166842638281e-07, 'epoch': 5.92}

 37%|███▋      | 137440/371472 [10:55:08<18:44:09,  3.47it/s]
 37%|███▋      | 137441/371472 [10:55:08<18:26:15,  3.53it/s]
 37%|███▋      | 137442/371472 [10:55:09<20:26:56,  3.18it/s]
 37%|███▋      | 137443/371472 [10:55:09<20:33:10,  3.16it/s]
 37%|███▋      | 137444/371472 [10:55:09<19:51:31,  3.27it/s]
 37%|███▋      | 137445/371472 [10:55:10<19:34:03,  3.32it/s]
 37%|███▋      | 137446/371472 [10:55:10<19:03:17,  3.41it/s]
 37%|███▋      | 137447/371472 [10:55:10<18:23:47,  3.53it/s]
 37%|███▋      | 137448/371472 [10:55:10<17:43:45,  3.67it/s]
 37%|███▋      | 137449/371472 [10:55:11<18:01:10,  3.61it/s]
 37%|███▋      | 137450/371472 [10:55:11<18:08:04,  3.58it/s]
 37%|███▋      | 137451/371472 [10:55:11<18:23:49,  3.53it/s]
 37%|███▋      | 137452/371472 [10:55:12<18:44:14,  3.47it/s]
 37%|███▋      | 137453/371472 [10:55:12<19:11:39,  3.39it/s]
 37%|███▋      | 137454/371472 [10:55:12<18:07:54,  3.59it/s]
 37%|███▋      | 137455/371472 [10:55:12<18:48:22,  3.46it/s]
 37%|███▋      | 137456/371472 [10:55:13<18:28:17,  3.52it/s]
 37%|███▋      | 137457/371472 [10:55:13<17:56:08,  3.62it/s]
 37%|███▋      | 137458/371472 [10:55:13<18:31:06,  3.51it/s]
 37%|███▋      | 137459/371472 [10:55:13<17:42:14,  3.67it/s]
 37%|███▋      | 137460/371472 [10:55:14<17:37:49,  3.69it/s]
                                                             
{'loss': 3.013, 'learning_rate': 6.672682022883492e-07, 'epoch': 5.92}

 37%|███▋      | 137460/371472 [10:55:14<17:37:49,  3.69it/s]
 37%|███▋      | 137461/371472 [10:55:14<18:25:38,  3.53it/s]
 37%|███▋      | 137462/371472 [10:55:14<17:58:10,  3.62it/s]
 37%|███▋      | 137463/371472 [10:55:15<17:21:43,  3.74it/s]
 37%|███▋      | 137464/371472 [10:55:15<17:32:41,  3.70it/s]
 37%|███▋      | 137465/371472 [10:55:15<17:46:43,  3.66it/s]
 37%|███▋      | 137466/371472 [10:55:15<17:00:38,  3.82it/s]
 37%|███▋      | 137467/371472 [10:55:16<16:45:14,  3.88it/s]
 37%|███▋      | 137468/371472 [10:55:16<17:19:15,  3.75it/s]
 37%|███▋      | 137469/371472 [10:55:16<17:38:27,  3.68it/s]
 37%|███▋      | 137470/371472 [10:55:16<17:37:21,  3.69it/s]
 37%|███▋      | 137471/371472 [10:55:17<17:40:46,  3.68it/s]
 37%|███▋      | 137472/371472 [10:55:17<17:40:03,  3.68it/s]
 37%|███▋      | 137473/371472 [10:55:17<17:03:34,  3.81it/s]
 37%|███▋      | 137474/371472 [10:55:18<17:08:58,  3.79it/s]
 37%|███▋      | 137475/371472 [10:55:18<18:13:09,  3.57it/s]
 37%|███▋      | 137476/371472 [10:55:18<17:42:30,  3.67it/s]
 37%|███▋      | 137477/371472 [10:55:18<18:01:56,  3.60it/s]
 37%|███▋      | 137478/371472 [10:55:19<18:11:06,  3.57it/s]
 37%|███▋      | 137479/371472 [10:55:19<18:26:12,  3.53it/s]
 37%|███▋      | 137480/371472 [10:55:19<18:27:34,  3.52it/s]
                                                             
{'loss': 3.1329, 'learning_rate': 6.672197203128703e-07, 'epoch': 5.92}

 37%|███▋      | 137480/371472 [10:55:19<18:27:34,  3.52it/s]
 37%|███▋      | 137481/371472 [10:55:20<18:23:57,  3.53it/s]
 37%|███▋      | 137482/371472 [10:55:20<18:31:08,  3.51it/s]
 37%|███▋      | 137483/371472 [10:55:20<18:16:21,  3.56it/s]
 37%|███▋      | 137484/371472 [10:55:20<19:16:24,  3.37it/s]
 37%|███▋      | 137485/371472 [10:55:21<19:05:04,  3.41it/s]
 37%|███▋      | 137486/371472 [10:55:21<18:36:12,  3.49it/s]
 37%|███▋      | 137487/371472 [10:55:21<17:39:44,  3.68it/s]
 37%|███▋      | 137488/371472 [10:55:21<17:42:04,  3.67it/s]
 37%|███▋      | 137489/371472 [10:55:22<17:18:39,  3.75it/s]
 37%|███▋      | 137490/371472 [10:55:22<17:07:01,  3.80it/s]
 37%|███▋      | 137491/371472 [10:55:22<17:06:48,  3.80it/s]
 37%|███▋      | 137492/371472 [10:55:23<18:07:03,  3.59it/s]
 37%|███▋      | 137493/371472 [10:55:23<17:39:37,  3.68it/s]
 37%|███▋      | 137494/371472 [10:55:23<17:35:48,  3.69it/s]
 37%|███▋      | 137495/371472 [10:55:23<17:13:25,  3.77it/s]
 37%|███▋      | 137496/371472 [10:55:24<19:02:30,  3.41it/s]
 37%|███▋      | 137497/371472 [10:55:24<18:32:40,  3.50it/s]
 37%|███▋      | 137498/371472 [10:55:24<17:44:00,  3.66it/s]
 37%|███▋      | 137499/371472 [10:55:24<17:31:34,  3.71it/s]
 37%|███▋      | 137500/371472 [10:55:25<17:22:20,  3.74it/s]
                                                             
{'loss': 3.2816, 'learning_rate': 6.671712383373914e-07, 'epoch': 5.92}

 37%|███▋      | 137500/371472 [10:55:25<17:22:20,  3.74it/s]
 37%|███▋      | 137501/371472 [10:55:25<17:33:41,  3.70it/s]
 37%|███▋      | 137502/371472 [10:55:25<18:44:29,  3.47it/s]
 37%|███▋      | 137503/371472 [10:55:26<18:30:55,  3.51it/s]
 37%|███▋      | 137504/371472 [10:55:26<17:49:56,  3.64it/s]
 37%|███▋      | 137505/371472 [10:55:26<18:49:27,  3.45it/s]
 37%|███▋      | 137506/371472 [10:55:27<19:43:41,  3.29it/s]
 37%|███▋      | 137507/371472 [10:55:27<20:12:20,  3.22it/s]
 37%|███▋      | 137508/371472 [10:55:27<20:55:21,  3.11it/s]
 37%|███▋      | 137509/371472 [10:55:27<20:20:23,  3.20it/s]
 37%|███▋      | 137510/371472 [10:55:28<19:32:44,  3.32it/s]
 37%|███▋      | 137511/371472 [10:55:28<19:53:01,  3.27it/s]
 37%|███▋      | 137512/371472 [10:55:28<21:07:54,  3.08it/s]
 37%|███▋      | 137513/371472 [10:55:29<20:25:20,  3.18it/s]
 37%|███▋      | 137514/371472 [10:55:29<19:22:27,  3.35it/s]
 37%|███▋      | 137515/371472 [10:55:29<19:36:16,  3.31it/s]
 37%|███▋      | 137516/371472 [10:55:30<18:46:32,  3.46it/s]
 37%|███▋      | 137517/371472 [10:55:30<18:50:30,  3.45it/s]
 37%|███▋      | 137518/371472 [10:55:30<19:51:09,  3.27it/s]
 37%|███▋      | 137519/371472 [10:55:30<19:35:37,  3.32it/s]
 37%|███▋      | 137520/371472 [10:55:31<19:56:01,  3.26it/s]
                                                             
{'loss': 3.0798, 'learning_rate': 6.671227563619126e-07, 'epoch': 5.92}

 37%|███▋      | 137520/371472 [10:55:31<19:56:01,  3.26it/s]
 37%|███▋      | 137521/371472 [10:55:31<19:24:38,  3.35it/s]
 37%|███▋      | 137522/371472 [10:55:31<18:15:16,  3.56it/s]
 37%|███▋      | 137523/371472 [10:55:32<17:28:18,  3.72it/s]
 37%|███▋      | 137524/371472 [10:55:32<18:05:46,  3.59it/s]
 37%|███▋      | 137525/371472 [10:55:32<18:04:08,  3.60it/s]
 37%|███▋      | 137526/371472 [10:55:32<17:40:06,  3.68it/s]
 37%|███▋      | 137527/371472 [10:55:33<17:10:42,  3.78it/s]
 37%|███▋      | 137528/371472 [10:55:33<17:34:35,  3.70it/s]
 37%|███▋      | 137529/371472 [10:55:33<17:13:46,  3.77it/s]
 37%|███▋      | 137530/371472 [10:55:34<18:09:22,  3.58it/s]
 37%|███▋      | 137531/371472 [10:55:34<18:01:14,  3.61it/s]
 37%|███▋      | 137532/371472 [10:55:34<19:02:32,  3.41it/s]
 37%|███▋      | 137533/371472 [10:55:34<19:06:28,  3.40it/s]
 37%|███▋      | 137534/371472 [10:55:35<18:22:55,  3.54it/s]
 37%|███▋      | 137535/371472 [10:55:35<18:16:07,  3.56it/s]
 37%|███▋      | 137536/371472 [10:55:35<19:01:10,  3.42it/s]
 37%|███▋      | 137537/371472 [10:55:36<18:20:10,  3.54it/s]
 37%|███▋      | 137538/371472 [10:55:36<18:17:35,  3.55it/s]
 37%|███▋      | 137539/371472 [10:55:36<17:34:23,  3.70it/s]
 37%|███▋      | 137540/371472 [10:55:36<17:33:58,  3.70it/s]
                                                             
{'loss': 3.1757, 'learning_rate': 6.670742743864337e-07, 'epoch': 5.92}

 37%|███▋      | 137540/371472 [10:55:36<17:33:58,  3.70it/s]
 37%|███▋      | 137541/371472 [10:55:37<17:24:51,  3.73it/s]
 37%|███▋      | 137542/371472 [10:55:37<17:23:23,  3.74it/s]
 37%|███▋      | 137543/371472 [10:55:37<17:09:03,  3.79it/s]
 37%|███▋      | 137544/371472 [10:55:37<18:12:59,  3.57it/s]
 37%|███▋      | 137545/371472 [10:55:38<17:21:03,  3.74it/s]
 37%|███▋      | 137546/371472 [10:55:38<17:28:17,  3.72it/s]
 37%|███▋      | 137547/371472 [10:55:38<17:24:23,  3.73it/s]
 37%|███▋      | 137548/371472 [10:55:38<18:01:01,  3.61it/s]
 37%|███▋      | 137549/371472 [10:55:39<19:59:58,  3.25it/s]
 37%|███▋      | 137550/371472 [10:55:39<21:06:34,  3.08it/s]
 37%|███▋      | 137551/371472 [10:55:39<19:41:21,  3.30it/s]
 37%|███▋      | 137552/371472 [10:55:40<19:40:57,  3.30it/s]
 37%|███▋      | 137553/371472 [10:55:40<19:42:45,  3.30it/s]
 37%|███▋      | 137554/371472 [10:55:40<18:58:35,  3.42it/s]
 37%|███▋      | 137555/371472 [10:55:41<18:19:18,  3.55it/s]
 37%|███▋      | 137556/371472 [10:55:41<17:40:24,  3.68it/s]
 37%|███▋      | 137557/371472 [10:55:41<17:47:20,  3.65it/s]
 37%|███▋      | 137558/371472 [10:55:41<17:52:38,  3.63it/s]
 37%|███▋      | 137559/371472 [10:55:42<18:26:27,  3.52it/s]
 37%|███▋      | 137560/371472 [10:55:42<18:52:25,  3.44it/s]
                                                             
{'loss': 3.1536, 'learning_rate': 6.670257924109547e-07, 'epoch': 5.92}

 37%|███▋      | 137560/371472 [10:55:42<18:52:25,  3.44it/s]
 37%|███▋      | 137561/371472 [10:55:42<19:38:24,  3.31it/s]
 37%|███▋      | 137562/371472 [10:55:43<18:39:40,  3.48it/s]
 37%|███▋      | 137563/371472 [10:55:43<19:07:11,  3.40it/s]
 37%|███▋      | 137564/371472 [10:55:43<18:15:58,  3.56it/s]
 37%|███▋      | 137565/371472 [10:55:43<18:43:12,  3.47it/s]
 37%|███▋      | 137566/371472 [10:55:44<18:39:15,  3.48it/s]
 37%|███▋      | 137567/371472 [10:55:44<21:19:07,  3.05it/s]
 37%|███▋      | 137568/371472 [10:55:44<20:26:04,  3.18it/s]
 37%|███▋      | 137569/371472 [10:55:45<24:46:18,  2.62it/s]
 37%|███▋      | 137570/371472 [10:55:45<22:12:52,  2.92it/s]
 37%|███▋      | 137571/371472 [10:55:46<23:10:55,  2.80it/s]
 37%|███▋      | 137572/371472 [10:55:46<22:29:48,  2.89it/s]
 37%|███▋      | 137573/371472 [10:55:46<21:10:17,  3.07it/s]
 37%|███▋      | 137574/371472 [10:55:47<20:07:02,  3.23it/s]
 37%|███▋      | 137575/371472 [10:55:47<19:18:30,  3.36it/s]
 37%|███▋      | 137576/371472 [10:55:47<20:13:44,  3.21it/s]
 37%|███▋      | 137577/371472 [10:55:47<19:09:22,  3.39it/s]
 37%|███▋      | 137578/371472 [10:55:48<18:10:14,  3.58it/s]
 37%|███▋      | 137579/371472 [10:55:48<18:10:20,  3.58it/s]
 37%|███▋      | 137580/371472 [10:55:48<17:52:34,  3.63it/s]
                                                             
{'loss': 3.1504, 'learning_rate': 6.669773104354758e-07, 'epoch': 5.93}

 37%|███▋      | 137580/371472 [10:55:48<17:52:34,  3.63it/s]
 37%|███▋      | 137581/371472 [10:55:48<18:08:27,  3.58it/s]
 37%|███▋      | 137582/371472 [10:55:49<19:27:02,  3.34it/s]
 37%|███▋      | 137583/371472 [10:55:49<20:06:11,  3.23it/s]
 37%|███▋      | 137584/371472 [10:55:49<20:23:23,  3.19it/s]
 37%|███▋      | 137585/371472 [10:55:50<19:29:27,  3.33it/s]
 37%|███▋      | 137586/371472 [10:55:50<18:54:46,  3.44it/s]
 37%|███▋      | 137587/371472 [10:55:50<18:56:20,  3.43it/s]
 37%|███▋      | 137588/371472 [10:55:51<19:08:48,  3.39it/s]
 37%|███▋      | 137589/371472 [10:55:51<18:46:08,  3.46it/s]
 37%|███▋      | 137590/371472 [10:55:51<19:18:21,  3.37it/s]
 37%|███▋      | 137591/371472 [10:55:51<18:17:32,  3.55it/s]
 37%|███▋      | 137592/371472 [10:55:52<18:03:13,  3.60it/s]
 37%|███▋      | 137593/371472 [10:55:52<17:45:39,  3.66it/s]
 37%|███▋      | 137594/371472 [10:55:52<17:43:21,  3.67it/s]
 37%|███▋      | 137595/371472 [10:55:52<17:07:32,  3.79it/s]
 37%|███▋      | 137596/371472 [10:55:53<18:05:23,  3.59it/s]
 37%|███▋      | 137597/371472 [10:55:53<17:39:40,  3.68it/s]
 37%|███▋      | 137598/371472 [10:55:53<18:00:29,  3.61it/s]
 37%|███▋      | 137599/371472 [10:55:54<17:48:38,  3.65it/s]
 37%|███▋      | 137600/371472 [10:55:54<18:57:10,  3.43it/s]
                                                             
{'loss': 3.0666, 'learning_rate': 6.66928828459997e-07, 'epoch': 5.93}

 37%|███▋      | 137600/371472 [10:55:54<18:57:10,  3.43it/s]
 37%|███▋      | 137601/371472 [10:55:54<18:43:21,  3.47it/s]
 37%|███▋      | 137602/371472 [10:55:55<18:52:45,  3.44it/s]
 37%|███▋      | 137603/371472 [10:55:55<18:21:57,  3.54it/s]
 37%|███▋      | 137604/371472 [10:55:55<18:31:26,  3.51it/s]
 37%|███▋      | 137605/371472 [10:55:55<17:53:16,  3.63it/s]
 37%|███▋      | 137606/371472 [10:55:56<17:57:43,  3.62it/s]
 37%|███▋      | 137607/371472 [10:55:56<19:02:14,  3.41it/s]
 37%|███▋      | 137608/371472 [10:55:56<18:07:24,  3.58it/s]
 37%|███▋      | 137609/371472 [10:55:56<18:23:34,  3.53it/s]
 37%|███▋      | 137610/371472 [10:55:57<18:37:48,  3.49it/s]
 37%|███▋      | 137611/371472 [10:55:57<24:45:02,  2.62it/s]
 37%|███▋      | 137612/371472 [10:55:58<23:11:51,  2.80it/s]
 37%|███▋      | 137613/371472 [10:55:58<21:03:20,  3.09it/s]
 37%|███▋      | 137614/371472 [10:55:58<22:02:06,  2.95it/s]
 37%|███▋      | 137615/371472 [10:55:59<20:57:33,  3.10it/s]
 37%|███▋      | 137616/371472 [10:55:59<21:50:13,  2.97it/s]
 37%|███▋      | 137617/371472 [10:55:59<20:46:52,  3.13it/s]
 37%|███▋      | 137618/371472 [10:55:59<19:24:38,  3.35it/s]
 37%|███▋      | 137619/371472 [10:56:00<19:07:06,  3.40it/s]
 37%|███▋      | 137620/371472 [10:56:00<18:58:19,  3.42it/s]
                                                             
{'loss': 3.0226, 'learning_rate': 6.668803464845181e-07, 'epoch': 5.93}

 37%|███▋      | 137620/371472 [10:56:00<18:58:19,  3.42it/s]
 37%|███▋      | 137621/371472 [10:56:00<18:59:14,  3.42it/s]
 37%|███▋      | 137622/371472 [10:56:01<19:43:10,  3.29it/s]
 37%|███▋      | 137623/371472 [10:56:01<21:04:09,  3.08it/s]
 37%|███▋      | 137624/371472 [10:56:01<20:43:28,  3.13it/s]
 37%|███▋      | 137625/371472 [10:56:02<20:05:46,  3.23it/s]
 37%|███▋      | 137626/371472 [10:56:02<20:01:57,  3.24it/s]
 37%|███▋      | 137627/371472 [10:56:02<19:36:20,  3.31it/s]
 37%|███▋      | 137628/371472 [10:56:03<19:12:48,  3.38it/s]
 37%|███▋      | 137629/371472 [10:56:03<18:33:06,  3.50it/s]
 37%|███▋      | 137630/371472 [10:56:03<18:10:38,  3.57it/s]
 37%|███▋      | 137631/371472 [10:56:03<17:35:35,  3.69it/s]
 37%|███▋      | 137632/371472 [10:56:04<17:50:19,  3.64it/s]
 37%|███▋      | 137633/371472 [10:56:04<18:36:40,  3.49it/s]
 37%|███▋      | 137634/371472 [10:56:04<17:59:49,  3.61it/s]
 37%|███▋      | 137635/371472 [10:56:04<18:16:14,  3.56it/s]
 37%|███▋      | 137636/371472 [10:56:05<17:36:03,  3.69it/s]
 37%|███▋      | 137637/371472 [10:56:05<17:21:12,  3.74it/s]
 37%|███▋      | 137638/371472 [10:56:05<16:50:49,  3.86it/s]
 37%|███▋      | 137639/371472 [10:56:06<18:34:34,  3.50it/s]
 37%|███▋      | 137640/371472 [10:56:06<18:00:52,  3.61it/s]
                                                             
{'loss': 3.0879, 'learning_rate': 6.668318645090391e-07, 'epoch': 5.93}

 37%|███▋      | 137640/371472 [10:56:06<18:00:52,  3.61it/s]
 37%|███▋      | 137641/371472 [10:56:06<19:05:57,  3.40it/s]
 37%|███▋      | 137642/371472 [10:56:06<19:00:33,  3.42it/s]
 37%|███▋      | 137643/371472 [10:56:07<19:05:54,  3.40it/s]
 37%|███▋      | 137644/371472 [10:56:07<18:06:25,  3.59it/s]
 37%|███▋      | 137645/371472 [10:56:07<17:29:11,  3.71it/s]
 37%|███▋      | 137646/371472 [10:56:07<17:41:49,  3.67it/s]
 37%|███▋      | 137647/371472 [10:56:08<17:12:23,  3.77it/s]
 37%|███▋      | 137648/371472 [10:56:08<17:48:14,  3.65it/s]
 37%|███▋      | 137649/371472 [10:56:08<18:21:52,  3.54it/s]
 37%|███▋      | 137650/371472 [10:56:09<19:05:10,  3.40it/s]
 37%|███▋      | 137651/371472 [10:56:09<18:34:00,  3.50it/s]
 37%|███▋      | 137652/371472 [10:56:09<17:52:47,  3.63it/s]
 37%|███▋      | 137653/371472 [10:56:09<18:45:38,  3.46it/s]
 37%|███▋      | 137654/371472 [10:56:10<18:38:30,  3.48it/s]
 37%|███▋      | 137655/371472 [10:56:10<18:31:10,  3.51it/s]
 37%|███▋      | 137656/371472 [10:56:10<18:01:20,  3.60it/s]
 37%|███▋      | 137657/371472 [10:56:11<18:12:52,  3.57it/s]
 37%|███▋      | 137658/371472 [10:56:11<17:53:16,  3.63it/s]
 37%|███▋      | 137659/371472 [10:56:11<17:09:23,  3.79it/s]
 37%|███▋      | 137660/371472 [10:56:11<18:05:06,  3.59it/s]
                                                             
{'loss': 3.1144, 'learning_rate': 6.667833825335603e-07, 'epoch': 5.93}

 37%|███▋      | 137660/371472 [10:56:11<18:05:06,  3.59it/s]
 37%|███▋      | 137661/371472 [10:56:12<17:44:19,  3.66it/s]
 37%|███▋      | 137662/371472 [10:56:12<18:19:50,  3.54it/s]
 37%|███▋      | 137663/371472 [10:56:12<19:29:17,  3.33it/s]
 37%|███▋      | 137664/371472 [10:56:13<18:37:49,  3.49it/s]
 37%|███▋      | 137665/371472 [10:56:13<18:48:04,  3.45it/s]
 37%|███▋      | 137666/371472 [10:56:13<18:55:23,  3.43it/s]
 37%|███▋      | 137667/371472 [10:56:13<18:53:32,  3.44it/s]
 37%|███▋      | 137668/371472 [10:56:14<18:40:34,  3.48it/s]
 37%|███▋      | 137669/371472 [10:56:14<18:31:02,  3.51it/s]
 37%|███▋      | 137670/371472 [10:56:14<18:19:18,  3.54it/s]
 37%|███▋      | 137671/371472 [10:56:15<17:40:02,  3.68it/s]
 37%|███▋      | 137672/371472 [10:56:15<17:08:03,  3.79it/s]
 37%|███▋      | 137673/371472 [10:56:15<17:38:03,  3.68it/s]
 37%|███▋      | 137674/371472 [10:56:15<16:49:28,  3.86it/s]
 37%|███▋      | 137675/371472 [10:56:16<16:57:50,  3.83it/s]
 37%|███▋      | 137676/371472 [10:56:16<17:11:50,  3.78it/s]
 37%|███▋      | 137677/371472 [10:56:16<17:59:11,  3.61it/s]
 37%|███▋      | 137678/371472 [10:56:16<17:31:05,  3.71it/s]
 37%|███▋      | 137679/371472 [10:56:17<17:59:51,  3.61it/s]
 37%|███▋      | 137680/371472 [10:56:17<18:02:52,  3.60it/s]
                                                             
{'loss': 3.176, 'learning_rate': 6.667349005580814e-07, 'epoch': 5.93}

 37%|███▋      | 137680/371472 [10:56:17<18:02:52,  3.60it/s]
 37%|███▋      | 137681/371472 [10:56:17<17:23:20,  3.73it/s]
 37%|███▋      | 137682/371472 [10:56:17<17:10:07,  3.78it/s]
 37%|███▋      | 137683/371472 [10:56:18<26:07:34,  2.49it/s]
 37%|███▋      | 137684/371472 [10:56:19<24:46:42,  2.62it/s]
 37%|███▋      | 137685/371472 [10:56:19<22:46:10,  2.85it/s]
 37%|███▋      | 137686/371472 [10:56:19<20:51:27,  3.11it/s]
 37%|███▋      | 137687/371472 [10:56:19<20:20:21,  3.19it/s]
 37%|███▋      | 137688/371472 [10:56:20<19:39:16,  3.30it/s]
 37%|███▋      | 137689/371472 [10:56:20<18:16:41,  3.55it/s]
 37%|███▋      | 137690/371472 [10:56:20<19:09:27,  3.39it/s]
 37%|███▋      | 137691/371472 [10:56:20<18:25:10,  3.53it/s]
 37%|███▋      | 137692/371472 [10:56:21<18:01:45,  3.60it/s]
 37%|███▋      | 137693/371472 [10:56:21<17:54:56,  3.62it/s]
 37%|███▋      | 137694/371472 [10:56:21<18:28:55,  3.51it/s]
 37%|███▋      | 137695/371472 [10:56:22<18:46:56,  3.46it/s]
 37%|███▋      | 137696/371472 [10:56:22<19:19:36,  3.36it/s]
 37%|███▋      | 137697/371472 [10:56:22<18:58:29,  3.42it/s]
 37%|███▋      | 137698/371472 [10:56:22<18:01:39,  3.60it/s]
 37%|███▋      | 137699/371472 [10:56:23<17:33:47,  3.70it/s]
 37%|███▋      | 137700/371472 [10:56:23<19:22:19,  3.35it/s]
                                                             
{'loss': 3.203, 'learning_rate': 6.666864185826025e-07, 'epoch': 5.93}

 37%|███▋      | 137700/371472 [10:56:23<19:22:19,  3.35it/s]
 37%|███▋      | 137701/371472 [10:56:23<20:41:13,  3.14it/s]
 37%|███▋      | 137702/371472 [10:56:24<19:42:43,  3.29it/s]
 37%|███▋      | 137703/371472 [10:56:24<18:44:30,  3.46it/s]
 37%|███▋      | 137704/371472 [10:56:24<17:37:58,  3.68it/s]
 37%|███▋      | 137705/371472 [10:56:24<17:32:06,  3.70it/s]
 37%|███▋      | 137706/371472 [10:56:25<19:03:50,  3.41it/s]
 37%|███▋      | 137707/371472 [10:56:25<18:43:27,  3.47it/s]
 37%|███▋      | 137708/371472 [10:56:25<18:22:11,  3.53it/s]
 37%|███▋      | 137709/371472 [10:56:26<19:37:53,  3.31it/s]
 37%|███▋      | 137710/371472 [10:56:26<18:22:25,  3.53it/s]
 37%|███▋      | 137711/371472 [10:56:26<18:14:56,  3.56it/s]
 37%|███▋      | 137712/371472 [10:56:26<17:45:38,  3.66it/s]
 37%|███▋      | 137713/371472 [10:56:27<18:19:35,  3.54it/s]
 37%|███▋      | 137714/371472 [10:56:27<17:43:00,  3.67it/s]
 37%|███▋      | 137715/371472 [10:56:27<17:26:37,  3.72it/s]
 37%|███▋      | 137716/371472 [10:56:27<16:56:36,  3.83it/s]
 37%|███▋      | 137717/371472 [10:56:28<16:56:29,  3.83it/s]
 37%|███▋      | 137718/371472 [10:56:28<16:51:54,  3.85it/s]
 37%|███▋      | 137719/371472 [10:56:28<16:59:48,  3.82it/s]
 37%|███▋      | 137720/371472 [10:56:29<17:07:33,  3.79it/s]
                                                             
{'loss': 3.1169, 'learning_rate': 6.666379366071235e-07, 'epoch': 5.93}

 37%|███▋      | 137720/371472 [10:56:29<17:07:33,  3.79it/s]
 37%|███▋      | 137721/371472 [10:56:29<18:31:49,  3.50it/s]
 37%|███▋      | 137722/371472 [10:56:29<17:43:13,  3.66it/s]
 37%|███▋      | 137723/371472 [10:56:29<18:18:46,  3.55it/s]
 37%|███▋      | 137724/371472 [10:56:30<17:53:02,  3.63it/s]
 37%|███▋      | 137725/371472 [10:56:30<18:37:55,  3.48it/s]
 37%|███▋      | 137726/371472 [10:56:30<17:37:01,  3.69it/s]
 37%|███▋      | 137727/371472 [10:56:31<17:27:05,  3.72it/s]
 37%|███▋      | 137728/371472 [10:56:31<17:17:33,  3.75it/s]
 37%|███▋      | 137729/371472 [10:56:31<17:29:12,  3.71it/s]
 37%|███▋      | 137730/371472 [10:56:31<17:16:05,  3.76it/s]
 37%|███▋      | 137731/371472 [10:56:32<17:54:46,  3.62it/s]
 37%|███▋      | 137732/371472 [10:56:32<17:29:56,  3.71it/s]
 37%|███▋      | 137733/371472 [10:56:32<16:57:39,  3.83it/s]
 37%|███▋      | 137734/371472 [10:56:32<17:04:57,  3.80it/s]
 37%|███▋      | 137735/371472 [10:56:33<17:19:38,  3.75it/s]
 37%|███▋      | 137736/371472 [10:56:33<18:42:46,  3.47it/s]
 37%|███▋      | 137737/371472 [10:56:33<18:38:22,  3.48it/s]
 37%|███▋      | 137738/371472 [10:56:34<18:14:04,  3.56it/s]
 37%|███▋      | 137739/371472 [10:56:34<18:01:18,  3.60it/s]
 37%|███▋      | 137740/371472 [10:56:34<17:42:56,  3.66it/s]
                                                             
{'loss': 3.2139, 'learning_rate': 6.665894546316447e-07, 'epoch': 5.93}

 37%|███▋      | 137740/371472 [10:56:34<17:42:56,  3.66it/s]
 37%|███▋      | 137741/371472 [10:56:34<17:29:22,  3.71it/s]
 37%|███▋      | 137742/371472 [10:56:35<17:01:12,  3.81it/s]
 37%|███▋      | 137743/371472 [10:56:35<18:18:28,  3.55it/s]
 37%|███▋      | 137744/371472 [10:56:35<18:10:10,  3.57it/s]
 37%|███▋      | 137745/371472 [10:56:35<17:53:19,  3.63it/s]
 37%|███▋      | 137746/371472 [10:56:36<17:53:20,  3.63it/s]
 37%|███▋      | 137747/371472 [10:56:36<17:33:29,  3.70it/s]
 37%|███▋      | 137748/371472 [10:56:36<18:54:51,  3.43it/s]
 37%|███▋      | 137749/371472 [10:56:37<18:18:59,  3.54it/s]
 37%|███▋      | 137750/371472 [10:56:37<18:28:05,  3.52it/s]
 37%|███▋      | 137751/371472 [10:56:37<19:18:15,  3.36it/s]
 37%|███▋      | 137752/371472 [10:56:37<18:53:18,  3.44it/s]
 37%|███▋      | 137753/371472 [10:56:38<19:17:20,  3.37it/s]
 37%|███▋      | 137754/371472 [10:56:38<21:43:01,  2.99it/s]
 37%|███▋      | 137755/371472 [10:56:38<20:59:16,  3.09it/s]
 37%|███▋      | 137756/371472 [10:56:39<20:02:31,  3.24it/s]
 37%|███▋      | 137757/371472 [10:56:39<18:40:05,  3.48it/s]
 37%|███▋      | 137758/371472 [10:56:39<18:50:26,  3.45it/s]
 37%|███▋      | 137759/371472 [10:56:40<18:30:55,  3.51it/s]
 37%|███▋      | 137760/371472 [10:56:40<18:10:15,  3.57it/s]
                                                             
{'loss': 3.2804, 'learning_rate': 6.665409726561659e-07, 'epoch': 5.93}

 37%|███▋      | 137760/371472 [10:56:40<18:10:15,  3.57it/s]
 37%|███▋      | 137761/371472 [10:56:40<18:16:53,  3.55it/s]
 37%|███▋      | 137762/371472 [10:56:40<18:08:43,  3.58it/s]
 37%|███▋      | 137763/371472 [10:56:41<18:19:32,  3.54it/s]
 37%|███▋      | 137764/371472 [10:56:41<17:54:34,  3.62it/s]
 37%|███▋      | 137765/371472 [10:56:41<17:09:23,  3.78it/s]
 37%|███▋      | 137766/371472 [10:56:41<17:30:10,  3.71it/s]
 37%|███▋      | 137767/371472 [10:56:42<17:42:26,  3.67it/s]
 37%|███▋      | 137768/371472 [10:56:42<18:11:30,  3.57it/s]
 37%|███▋      | 137769/371472 [10:56:42<17:28:48,  3.71it/s]
 37%|███▋      | 137770/371472 [10:56:43<17:54:29,  3.63it/s]
 37%|███▋      | 137771/371472 [10:56:43<17:39:09,  3.68it/s]
 37%|███▋      | 137772/371472 [10:56:43<18:18:31,  3.55it/s]
 37%|███▋      | 137773/371472 [10:56:43<17:52:42,  3.63it/s]
 37%|███▋      | 137774/371472 [10:56:44<18:01:43,  3.60it/s]
 37%|███▋      | 137775/371472 [10:56:44<17:48:39,  3.64it/s]
 37%|███▋      | 137776/371472 [10:56:44<17:17:14,  3.76it/s]
 37%|███▋      | 137777/371472 [10:56:45<17:59:19,  3.61it/s]
 37%|███▋      | 137778/371472 [10:56:45<17:54:17,  3.63it/s]
 37%|███▋      | 137779/371472 [10:56:45<17:26:43,  3.72it/s]
 37%|███▋      | 137780/371472 [10:56:45<17:59:09,  3.61it/s]
                                                             
{'loss': 3.1852, 'learning_rate': 6.66492490680687e-07, 'epoch': 5.93}

 37%|███▋      | 137780/371472 [10:56:45<17:59:09,  3.61it/s]
 37%|███▋      | 137781/371472 [10:56:46<18:21:46,  3.54it/s]
 37%|███▋      | 137782/371472 [10:56:46<17:40:59,  3.67it/s]
 37%|███▋      | 137783/371472 [10:56:46<17:53:55,  3.63it/s]
 37%|███▋      | 137784/371472 [10:56:46<17:12:31,  3.77it/s]
 37%|███▋      | 137785/371472 [10:56:47<18:18:57,  3.54it/s]
 37%|███▋      | 137786/371472 [10:56:47<17:59:31,  3.61it/s]
 37%|███▋      | 137787/371472 [10:56:47<17:44:53,  3.66it/s]
 37%|███▋      | 137788/371472 [10:56:48<17:46:39,  3.65it/s]
 37%|███▋      | 137789/371472 [10:56:48<17:49:31,  3.64it/s]
 37%|███▋      | 137790/371472 [10:56:48<19:09:29,  3.39it/s]
 37%|███▋      | 137791/371472 [10:56:48<19:01:44,  3.41it/s]
 37%|███▋      | 137792/371472 [10:56:49<19:19:35,  3.36it/s]
 37%|███▋      | 137793/371472 [10:56:49<18:57:52,  3.42it/s]
 37%|███▋      | 137794/371472 [10:56:49<17:51:30,  3.63it/s]
 37%|███▋      | 137795/371472 [10:56:50<19:02:36,  3.41it/s]
 37%|███▋      | 137796/371472 [10:56:50<19:27:15,  3.34it/s]
 37%|███▋      | 137797/371472 [10:56:50<19:36:14,  3.31it/s]
 37%|███▋      | 137798/371472 [10:56:51<19:27:49,  3.33it/s]
 37%|███▋      | 137799/371472 [10:56:51<19:22:15,  3.35it/s]
 37%|███▋      | 137800/371472 [10:56:51<18:47:52,  3.45it/s]
                                                             
{'loss': 3.035, 'learning_rate': 6.664440087052079e-07, 'epoch': 5.94}

 37%|███▋      | 137800/371472 [10:56:51<18:47:52,  3.45it/s]
 37%|███▋      | 137801/371472 [10:56:51<17:52:45,  3.63it/s]
 37%|███▋      | 137802/371472 [10:56:52<17:49:57,  3.64it/s]
 37%|███▋      | 137803/371472 [10:56:52<17:17:30,  3.75it/s]
 37%|███▋      | 137804/371472 [10:56:52<17:21:28,  3.74it/s]
 37%|███▋      | 137805/371472 [10:56:52<17:49:12,  3.64it/s]
 37%|███▋      | 137806/371472 [10:56:53<17:45:18,  3.66it/s]
 37%|███▋      | 137807/371472 [10:56:53<17:09:25,  3.78it/s]
 37%|███▋      | 137808/371472 [10:56:53<17:38:33,  3.68it/s]
 37%|███▋      | 137809/371472 [10:56:53<17:54:21,  3.62it/s]
 37%|███▋      | 137810/371472 [10:56:54<17:46:22,  3.65it/s]
 37%|███▋      | 137811/371472 [10:56:54<18:29:45,  3.51it/s]
 37%|███▋      | 137812/371472 [10:56:54<19:27:29,  3.34it/s]
 37%|███▋      | 137813/371472 [10:56:55<18:40:22,  3.48it/s]
 37%|███▋      | 137814/371472 [10:56:55<19:29:12,  3.33it/s]
 37%|███▋      | 137815/371472 [10:56:55<18:55:29,  3.43it/s]
 37%|███▋      | 137816/371472 [10:56:56<18:40:28,  3.48it/s]
 37%|███▋      | 137817/371472 [10:56:56<17:50:55,  3.64it/s]
 37%|███▋      | 137818/371472 [10:56:56<17:55:37,  3.62it/s]
 37%|███▋      | 137819/371472 [10:56:56<17:41:27,  3.67it/s]
 37%|███▋      | 137820/371472 [10:56:57<17:13:10,  3.77it/s]
                                                             
{'loss': 3.0937, 'learning_rate': 6.663955267297291e-07, 'epoch': 5.94}

 37%|███▋      | 137820/371472 [10:56:57<17:13:10,  3.77it/s]
 37%|███▋      | 137821/371472 [10:56:57<16:52:18,  3.85it/s]
 37%|███▋      | 137822/371472 [10:56:57<18:25:50,  3.52it/s]
 37%|███▋      | 137823/371472 [10:56:57<18:45:01,  3.46it/s]
 37%|███▋      | 137824/371472 [10:56:58<18:20:39,  3.54it/s]
 37%|███▋      | 137825/371472 [10:56:58<18:36:51,  3.49it/s]
 37%|███▋      | 137826/371472 [10:56:58<20:00:29,  3.24it/s]
 37%|███▋      | 137827/371472 [10:56:59<19:47:29,  3.28it/s]
 37%|███▋      | 137828/371472 [10:56:59<18:32:25,  3.50it/s]
 37%|███▋      | 137829/371472 [10:56:59<18:45:15,  3.46it/s]
 37%|███▋      | 137830/371472 [10:56:59<18:24:27,  3.53it/s]
 37%|███▋      | 137831/371472 [10:57:00<17:59:03,  3.61it/s]
 37%|███▋      | 137832/371472 [10:57:00<17:49:36,  3.64it/s]
 37%|███▋      | 137833/371472 [10:57:00<17:18:07,  3.75it/s]
 37%|███▋      | 137834/371472 [10:57:01<16:43:37,  3.88it/s]
 37%|███▋      | 137835/371472 [10:57:01<16:21:37,  3.97it/s]
 37%|███▋      | 137836/371472 [10:57:01<22:30:53,  2.88it/s]
 37%|███▋      | 137837/371472 [10:57:02<21:00:50,  3.09it/s]
 37%|███▋      | 137838/371472 [10:57:02<20:10:26,  3.22it/s]
 37%|███▋      | 137839/371472 [10:57:02<19:17:35,  3.36it/s]
 37%|███▋      | 137840/371472 [10:57:02<18:40:59,  3.47it/s]
                                                             
{'loss': 3.0263, 'learning_rate': 6.663470447542502e-07, 'epoch': 5.94}

 37%|███▋      | 137840/371472 [10:57:02<18:40:59,  3.47it/s]
 37%|███▋      | 137841/371472 [10:57:03<17:44:57,  3.66it/s]
 37%|███▋      | 137842/371472 [10:57:03<17:11:20,  3.78it/s]
 37%|███▋      | 137843/371472 [10:57:03<16:46:30,  3.87it/s]
 37%|███▋      | 137844/371472 [10:57:03<16:59:13,  3.82it/s]
 37%|███▋      | 137845/371472 [10:57:04<17:24:15,  3.73it/s]
 37%|███▋      | 137846/371472 [10:57:04<17:37:31,  3.68it/s]
 37%|███▋      | 137847/371472 [10:57:04<17:00:06,  3.82it/s]
 37%|███▋      | 137848/371472 [10:57:04<17:34:48,  3.69it/s]
 37%|███▋      | 137849/371472 [10:57:05<16:57:33,  3.83it/s]
 37%|███▋      | 137850/371472 [10:57:05<17:28:41,  3.71it/s]
 37%|███▋      | 137851/371472 [10:57:05<17:35:56,  3.69it/s]
 37%|███▋      | 137852/371472 [10:57:06<17:19:43,  3.74it/s]
 37%|███▋      | 137853/371472 [10:57:06<16:47:44,  3.86it/s]
 37%|███▋      | 137854/371472 [10:57:06<16:33:59,  3.92it/s]
 37%|███▋      | 137855/371472 [10:57:06<16:28:40,  3.94it/s]
 37%|███▋      | 137856/371472 [10:57:07<16:54:17,  3.84it/s]
 37%|███▋      | 137857/371472 [10:57:07<17:16:12,  3.76it/s]
 37%|███▋      | 137858/371472 [10:57:07<17:19:11,  3.75it/s]
 37%|███▋      | 137859/371472 [10:57:07<17:33:26,  3.70it/s]
 37%|███▋      | 137860/371472 [10:57:08<17:00:38,  3.81it/s]
                                                             
{'loss': 3.3591, 'learning_rate': 6.662985627787713e-07, 'epoch': 5.94}

 37%|███▋      | 137860/371472 [10:57:08<17:00:38,  3.81it/s]
 37%|███▋      | 137861/371472 [10:57:08<17:04:31,  3.80it/s]
 37%|███▋      | 137862/371472 [10:57:08<17:44:26,  3.66it/s]
 37%|███▋      | 137863/371472 [10:57:08<17:42:28,  3.66it/s]
 37%|███▋      | 137864/371472 [10:57:09<18:31:42,  3.50it/s]
 37%|███▋      | 137865/371472 [10:57:09<17:47:21,  3.65it/s]
 37%|███▋      | 137866/371472 [10:57:09<17:28:23,  3.71it/s]
 37%|███▋      | 137867/371472 [10:57:10<17:00:35,  3.81it/s]
 37%|███▋      | 137868/371472 [10:57:10<16:56:14,  3.83it/s]
 37%|███▋      | 137869/371472 [10:57:10<16:59:54,  3.82it/s]
 37%|███▋      | 137870/371472 [10:57:10<17:18:40,  3.75it/s]
 37%|███▋      | 137871/371472 [10:57:11<16:59:13,  3.82it/s]
 37%|███▋      | 137872/371472 [10:57:11<17:10:20,  3.78it/s]
 37%|███▋      | 137873/371472 [10:57:11<17:29:02,  3.71it/s]
 37%|███▋      | 137874/371472 [10:57:11<17:20:30,  3.74it/s]
 37%|███▋      | 137875/371472 [10:57:12<18:14:28,  3.56it/s]
 37%|███▋      | 137876/371472 [10:57:12<17:58:31,  3.61it/s]
 37%|███▋      | 137877/371472 [10:57:12<18:58:53,  3.42it/s]
 37%|███▋      | 137878/371472 [10:57:13<19:23:18,  3.35it/s]
 37%|███▋      | 137879/371472 [10:57:13<18:32:51,  3.50it/s]
 37%|███▋      | 137880/371472 [10:57:13<18:22:17,  3.53it/s]
                                                             
{'loss': 3.0939, 'learning_rate': 6.662500808032924e-07, 'epoch': 5.94}

 37%|███▋      | 137880/371472 [10:57:13<18:22:17,  3.53it/s]
 37%|███▋      | 137881/371472 [10:57:13<18:24:08,  3.53it/s]
 37%|███▋      | 137882/371472 [10:57:14<17:44:29,  3.66it/s]
 37%|███▋      | 137883/371472 [10:57:14<17:57:28,  3.61it/s]
 37%|███▋      | 137884/371472 [10:57:14<17:56:05,  3.62it/s]
 37%|███▋      | 137885/371472 [10:57:15<20:55:28,  3.10it/s]
 37%|███▋      | 137886/371472 [10:57:15<21:03:17,  3.08it/s]
 37%|███▋      | 137887/371472 [10:57:16<24:42:12,  2.63it/s]
 37%|███▋      | 137888/371472 [10:57:16<22:06:09,  2.94it/s]
 37%|███▋      | 137889/371472 [10:57:16<20:28:23,  3.17it/s]
 37%|███▋      | 137890/371472 [10:57:16<19:44:43,  3.29it/s]
 37%|███▋      | 137891/371472 [10:57:17<18:21:04,  3.54it/s]
 37%|███▋      | 137892/371472 [10:57:17<18:45:00,  3.46it/s]
 37%|███▋      | 137893/371472 [10:57:17<18:04:11,  3.59it/s]
 37%|███▋      | 137894/371472 [10:57:17<18:32:58,  3.50it/s]
 37%|███▋      | 137895/371472 [10:57:18<18:17:46,  3.55it/s]
 37%|███▋      | 137896/371472 [10:57:18<18:47:56,  3.45it/s]
 37%|███▋      | 137897/371472 [10:57:18<19:25:04,  3.34it/s]
 37%|███▋      | 137898/371472 [10:57:19<19:55:26,  3.26it/s]
 37%|███▋      | 137899/371472 [10:57:19<19:05:40,  3.40it/s]
 37%|███▋      | 137900/371472 [10:57:19<18:08:31,  3.58it/s]
                                                             
{'loss': 3.0609, 'learning_rate': 6.662015988278136e-07, 'epoch': 5.94}

 37%|███▋      | 137900/371472 [10:57:19<18:08:31,  3.58it/s]
 37%|███▋      | 137901/371472 [10:57:19<17:52:19,  3.63it/s]
 37%|███▋      | 137902/371472 [10:57:20<17:49:47,  3.64it/s]
 37%|███▋      | 137903/371472 [10:57:20<18:07:02,  3.58it/s]
 37%|███▋      | 137904/371472 [10:57:20<18:12:41,  3.56it/s]
 37%|███▋      | 137905/371472 [10:57:21<18:09:53,  3.57it/s]
 37%|███▋      | 137906/371472 [10:57:21<18:52:34,  3.44it/s]
 37%|███▋      | 137907/371472 [10:57:21<18:37:27,  3.48it/s]
 37%|███▋      | 137908/371472 [10:57:21<17:52:41,  3.63it/s]
 37%|███▋      | 137909/371472 [10:57:22<20:26:41,  3.17it/s]
 37%|███▋      | 137910/371472 [10:57:22<20:57:45,  3.09it/s]
 37%|███▋      | 137911/371472 [10:57:22<20:56:09,  3.10it/s]
 37%|███▋      | 137912/371472 [10:57:23<19:19:49,  3.36it/s]
 37%|███▋      | 137913/371472 [10:57:23<18:31:08,  3.50it/s]
 37%|███▋      | 137914/371472 [10:57:23<18:08:05,  3.58it/s]
 37%|███▋      | 137915/371472 [10:57:23<17:44:13,  3.66it/s]
 37%|███▋      | 137916/371472 [10:57:24<17:03:46,  3.80it/s]
 37%|███▋      | 137917/371472 [10:57:24<16:35:20,  3.91it/s]
 37%|███▋      | 137918/371472 [10:57:24<17:51:31,  3.63it/s]
 37%|███▋      | 137919/371472 [10:57:25<17:51:52,  3.63it/s]
 37%|███▋      | 137920/371472 [10:57:25<17:29:04,  3.71it/s]
                                                             
{'loss': 3.2201, 'learning_rate': 6.661531168523347e-07, 'epoch': 5.94}

 37%|███▋      | 137920/371472 [10:57:25<17:29:04,  3.71it/s]
 37%|███▋      | 137921/371472 [10:57:25<17:39:24,  3.67it/s]
 37%|███▋      | 137922/371472 [10:57:25<17:04:29,  3.80it/s]
 37%|███▋      | 137923/371472 [10:57:26<17:47:54,  3.64it/s]
 37%|███▋      | 137924/371472 [10:57:26<18:10:09,  3.57it/s]
 37%|███▋      | 137925/371472 [10:57:26<17:11:39,  3.77it/s]
 37%|███▋      | 137926/371472 [10:57:26<18:15:32,  3.55it/s]
 37%|███▋      | 137927/371472 [10:57:27<17:36:45,  3.68it/s]
 37%|███▋      | 137928/371472 [10:57:27<17:05:43,  3.79it/s]
 37%|███▋      | 137929/371472 [10:57:27<17:01:37,  3.81it/s]
 37%|███▋      | 137930/371472 [10:57:27<16:45:29,  3.87it/s]
 37%|███▋      | 137931/371472 [10:57:28<16:35:15,  3.91it/s]
 37%|███▋      | 137932/371472 [10:57:28<17:46:27,  3.65it/s]
 37%|███▋      | 137933/371472 [10:57:28<17:32:56,  3.70it/s]
 37%|███▋      | 137934/371472 [10:57:29<17:22:14,  3.73it/s]
 37%|███▋      | 137935/371472 [10:57:29<16:44:07,  3.88it/s]
 37%|███▋      | 137936/371472 [10:57:29<17:25:16,  3.72it/s]
 37%|███▋      | 137937/371472 [10:57:29<18:03:02,  3.59it/s]
 37%|███▋      | 137938/371472 [10:57:30<17:38:48,  3.68it/s]
 37%|███▋      | 137939/371472 [10:57:30<17:23:00,  3.73it/s]
 37%|███▋      | 137940/371472 [10:57:30<18:02:48,  3.59it/s]
                                                             
{'loss': 3.314, 'learning_rate': 6.661046348768556e-07, 'epoch': 5.94}

 37%|███▋      | 137940/371472 [10:57:30<18:02:48,  3.59it/s]
 37%|███▋      | 137941/371472 [10:57:30<17:43:57,  3.66it/s]
 37%|███▋      | 137942/371472 [10:57:31<18:09:25,  3.57it/s]
 37%|███▋      | 137943/371472 [10:57:31<17:36:47,  3.68it/s]
 37%|███▋      | 137944/371472 [10:57:31<17:05:23,  3.80it/s]
 37%|███▋      | 137945/371472 [10:57:32<17:11:33,  3.77it/s]
 37%|███▋      | 137946/371472 [10:57:32<17:28:30,  3.71it/s]
 37%|███▋      | 137947/371472 [10:57:32<17:16:42,  3.75it/s]
 37%|███▋      | 137948/371472 [10:57:32<16:52:21,  3.84it/s]
 37%|███▋      | 137949/371472 [10:57:33<16:30:52,  3.93it/s]
 37%|███▋      | 137950/371472 [10:57:33<17:24:50,  3.73it/s]
 37%|███▋      | 137951/371472 [10:57:33<18:09:41,  3.57it/s]
 37%|███▋      | 137952/371472 [10:57:33<17:58:54,  3.61it/s]
 37%|███▋      | 137953/371472 [10:57:34<18:11:05,  3.57it/s]
 37%|███▋      | 137954/371472 [10:57:34<18:07:54,  3.58it/s]
 37%|███▋      | 137955/371472 [10:57:34<17:59:40,  3.60it/s]
 37%|███▋      | 137956/371472 [10:57:35<18:41:29,  3.47it/s]
 37%|███▋      | 137957/371472 [10:57:35<17:35:23,  3.69it/s]
 37%|███▋      | 137958/371472 [10:57:35<17:54:16,  3.62it/s]
 37%|███▋      | 137959/371472 [10:57:35<18:23:05,  3.53it/s]
 37%|███▋      | 137960/371472 [10:57:36<17:24:21,  3.73it/s]
                                                             
{'loss': 3.0459, 'learning_rate': 6.660561529013768e-07, 'epoch': 5.94}

 37%|███▋      | 137960/371472 [10:57:36<17:24:21,  3.73it/s]
 37%|███▋      | 137961/371472 [10:57:36<18:14:31,  3.56it/s]
 37%|███▋      | 137962/371472 [10:57:36<18:12:24,  3.56it/s]
 37%|███▋      | 137963/371472 [10:57:36<17:26:28,  3.72it/s]
 37%|███▋      | 137964/371472 [10:57:37<17:31:14,  3.70it/s]
 37%|███▋      | 137965/371472 [10:57:37<17:26:25,  3.72it/s]
 37%|███▋      | 137966/371472 [10:57:37<17:23:15,  3.73it/s]
 37%|███▋      | 137967/371472 [10:57:38<17:41:46,  3.67it/s]
 37%|███▋      | 137968/371472 [10:57:38<17:43:30,  3.66it/s]
 37%|███▋      | 137969/371472 [10:57:38<18:56:32,  3.42it/s]
 37%|███▋      | 137970/371472 [10:57:38<18:39:38,  3.48it/s]
 37%|███▋      | 137971/371472 [10:57:39<17:53:43,  3.62it/s]
 37%|███▋      | 137972/371472 [10:57:39<17:59:13,  3.61it/s]
 37%|███▋      | 137973/371472 [10:57:39<17:41:33,  3.67it/s]
 37%|███▋      | 137974/371472 [10:57:40<18:24:47,  3.52it/s]
 37%|███▋      | 137975/371472 [10:57:40<18:08:07,  3.58it/s]
 37%|███▋      | 137976/371472 [10:57:40<17:58:37,  3.61it/s]
 37%|███▋      | 137977/371472 [10:57:40<19:58:02,  3.25it/s]
 37%|███▋      | 137978/371472 [10:57:41<19:25:49,  3.34it/s]
 37%|███▋      | 137979/371472 [10:57:41<18:51:37,  3.44it/s]
 37%|███▋      | 137980/371472 [10:57:41<17:55:03,  3.62it/s]
                                                             
{'loss': 3.191, 'learning_rate': 6.66007670925898e-07, 'epoch': 5.94}

 37%|███▋      | 137980/371472 [10:57:41<17:55:03,  3.62it/s]
 37%|███▋      | 137981/371472 [10:57:41<17:20:19,  3.74it/s]
 37%|███▋      | 137982/371472 [10:57:42<17:27:53,  3.71it/s]
 37%|███▋      | 137983/371472 [10:57:42<17:43:23,  3.66it/s]
 37%|███▋      | 137984/371472 [10:57:42<18:04:11,  3.59it/s]
 37%|███▋      | 137985/371472 [10:57:43<17:10:03,  3.78it/s]
 37%|███▋      | 137986/371472 [10:57:43<17:58:16,  3.61it/s]
 37%|███▋      | 137987/371472 [10:57:43<17:25:02,  3.72it/s]
 37%|███▋      | 137988/371472 [10:57:43<17:43:26,  3.66it/s]
 37%|███▋      | 137989/371472 [10:57:44<17:41:35,  3.67it/s]
 37%|███▋      | 137990/371472 [10:57:44<19:46:29,  3.28it/s]
 37%|███▋      | 137991/371472 [10:57:44<19:04:56,  3.40it/s]
 37%|███▋      | 137992/371472 [10:57:45<18:46:31,  3.45it/s]
 37%|███▋      | 137993/371472 [10:57:45<19:09:08,  3.39it/s]
 37%|███▋      | 137994/371472 [10:57:45<18:44:35,  3.46it/s]
 37%|███▋      | 137995/371472 [10:57:45<18:50:45,  3.44it/s]
 37%|███▋      | 137996/371472 [10:57:46<19:28:27,  3.33it/s]
 37%|███▋      | 137997/371472 [10:57:46<18:44:35,  3.46it/s]
 37%|███▋      | 137998/371472 [10:57:46<18:52:16,  3.44it/s]
 37%|███▋      | 137999/371472 [10:57:47<19:06:54,  3.39it/s]
 37%|███▋      | 138000/371472 [10:57:47<18:52:02,  3.44it/s]
                                                             
{'loss': 3.4345, 'learning_rate': 6.659591889504191e-07, 'epoch': 5.94}

 37%|███▋      | 138000/371472 [10:57:47<18:52:02,  3.44it/s]
 37%|███▋      | 138001/371472 [10:57:47<19:13:07,  3.37it/s]
 37%|███▋      | 138002/371472 [10:57:48<19:18:50,  3.36it/s]
 37%|███▋      | 138003/371472 [10:57:48<18:10:19,  3.57it/s]
 37%|███▋      | 138004/371472 [10:57:48<18:18:19,  3.54it/s]
 37%|███▋      | 138005/371472 [10:57:48<19:26:33,  3.34it/s]
 37%|███▋      | 138006/371472 [10:57:49<21:00:14,  3.09it/s]
 37%|███▋      | 138007/371472 [10:57:49<20:45:47,  3.12it/s]
 37%|███▋      | 138008/371472 [10:57:49<20:24:51,  3.18it/s]
 37%|███▋      | 138009/371472 [10:57:50<19:49:07,  3.27it/s]
 37%|███▋      | 138010/371472 [10:57:50<21:01:05,  3.09it/s]
 37%|███▋      | 138011/371472 [10:57:50<20:32:00,  3.16it/s]
 37%|███▋      | 138012/371472 [10:57:51<20:56:26,  3.10it/s]
 37%|███▋      | 138013/371472 [10:57:51<21:32:00,  3.01it/s]
 37%|███▋      | 138014/371472 [10:57:51<20:06:32,  3.22it/s]
 37%|███▋      | 138015/371472 [10:57:52<21:11:30,  3.06it/s]
 37%|███▋      | 138016/371472 [10:57:52<20:12:09,  3.21it/s]
 37%|███▋      | 138017/371472 [10:57:52<19:47:01,  3.28it/s]
 37%|███▋      | 138018/371472 [10:57:53<18:37:53,  3.48it/s]
 37%|███▋      | 138019/371472 [10:57:53<19:55:52,  3.25it/s]
 37%|███▋      | 138020/371472 [10:57:53<19:16:00,  3.37it/s]
                                                             
{'loss': 2.9941, 'learning_rate': 6.659107069749401e-07, 'epoch': 5.94}

 37%|███▋      | 138020/371472 [10:57:53<19:16:00,  3.37it/s]
 37%|███▋      | 138021/371472 [10:57:53<18:57:08,  3.42it/s]
 37%|███▋      | 138022/371472 [10:57:54<18:35:37,  3.49it/s]
 37%|███▋      | 138023/371472 [10:57:54<18:04:20,  3.59it/s]
 37%|███▋      | 138024/371472 [10:57:54<17:19:53,  3.74it/s]
 37%|███▋      | 138025/371472 [10:57:54<17:09:29,  3.78it/s]
 37%|███▋      | 138026/371472 [10:57:55<19:09:41,  3.38it/s]
 37%|███▋      | 138027/371472 [10:57:55<18:15:18,  3.55it/s]
 37%|███▋      | 138028/371472 [10:57:55<17:52:01,  3.63it/s]
 37%|███▋      | 138029/371472 [10:57:56<18:24:55,  3.52it/s]
 37%|███▋      | 138030/371472 [10:57:56<17:44:27,  3.66it/s]
 37%|███▋      | 138031/371472 [10:57:56<17:20:16,  3.74it/s]
 37%|███▋      | 138032/371472 [10:57:56<17:18:32,  3.75it/s]
 37%|███▋      | 138033/371472 [10:57:57<16:54:29,  3.84it/s]
 37%|███▋      | 138034/371472 [10:57:57<17:34:57,  3.69it/s]
 37%|███▋      | 138035/371472 [10:57:57<17:22:52,  3.73it/s]
 37%|███▋      | 138036/371472 [10:57:58<18:16:01,  3.55it/s]
 37%|███▋      | 138037/371472 [10:57:58<17:53:12,  3.63it/s]
 37%|███▋      | 138038/371472 [10:57:58<18:44:01,  3.46it/s]
 37%|███▋      | 138039/371472 [10:57:58<18:21:30,  3.53it/s]
 37%|███▋      | 138040/371472 [10:57:59<20:05:36,  3.23it/s]
                                                             
{'loss': 3.1053, 'learning_rate': 6.658622249994613e-07, 'epoch': 5.95}

 37%|███▋      | 138040/371472 [10:57:59<20:05:36,  3.23it/s]
 37%|███▋      | 138041/371472 [10:57:59<19:07:09,  3.39it/s]
 37%|███▋      | 138042/371472 [10:57:59<20:11:18,  3.21it/s]
 37%|███▋      | 138043/371472 [10:58:00<19:45:44,  3.28it/s]
 37%|███▋      | 138044/371472 [10:58:00<18:49:39,  3.44it/s]
 37%|███▋      | 138045/371472 [10:58:00<19:54:46,  3.26it/s]
 37%|███▋      | 138046/371472 [10:58:01<19:05:41,  3.40it/s]
 37%|███▋      | 138047/371472 [10:58:01<19:33:47,  3.31it/s]
 37%|███▋      | 138048/371472 [10:58:01<19:02:27,  3.41it/s]
 37%|███▋      | 138049/371472 [10:58:01<18:17:35,  3.54it/s]
 37%|███▋      | 138050/371472 [10:58:02<18:20:12,  3.54it/s]
 37%|███▋      | 138051/371472 [10:58:02<17:54:12,  3.62it/s]
 37%|███▋      | 138052/371472 [10:58:02<18:12:52,  3.56it/s]
 37%|███▋      | 138053/371472 [10:58:02<17:49:52,  3.64it/s]
 37%|███▋      | 138054/371472 [10:58:03<17:26:54,  3.72it/s]
 37%|███▋      | 138055/371472 [10:58:03<18:30:52,  3.50it/s]
 37%|███▋      | 138056/371472 [10:58:03<20:03:00,  3.23it/s]
 37%|███▋      | 138057/371472 [10:58:04<18:47:02,  3.45it/s]
 37%|███▋      | 138058/371472 [10:58:04<19:10:23,  3.38it/s]
 37%|███▋      | 138059/371472 [10:58:04<18:53:03,  3.43it/s]
 37%|███▋      | 138060/371472 [10:58:05<19:07:14,  3.39it/s]
                                                             
{'loss': 3.0454, 'learning_rate': 6.658137430239824e-07, 'epoch': 5.95}

 37%|███▋      | 138060/371472 [10:58:05<19:07:14,  3.39it/s]
 37%|███▋      | 138061/371472 [10:58:05<19:05:00,  3.40it/s]
 37%|███▋      | 138062/371472 [10:58:05<20:08:17,  3.22it/s]
 37%|███▋      | 138063/371472 [10:58:05<19:30:55,  3.32it/s]
 37%|███▋      | 138064/371472 [10:58:06<18:19:19,  3.54it/s]
 37%|███▋      | 138065/371472 [10:58:06<18:33:44,  3.49it/s]
 37%|███▋      | 138066/371472 [10:58:06<19:51:35,  3.26it/s]
 37%|███▋      | 138067/371472 [10:58:07<18:34:02,  3.49it/s]
 37%|███▋      | 138068/371472 [10:58:07<19:21:40,  3.35it/s]
 37%|███▋      | 138069/371472 [10:58:07<19:34:14,  3.31it/s]
 37%|███▋      | 138070/371472 [10:58:08<22:28:58,  2.88it/s]
 37%|███▋      | 138071/371472 [10:58:08<20:45:46,  3.12it/s]
 37%|███▋      | 138072/371472 [10:58:08<19:36:09,  3.31it/s]
 37%|███▋      | 138073/371472 [10:58:08<19:12:54,  3.37it/s]
 37%|███▋      | 138074/371472 [10:58:09<18:25:20,  3.52it/s]
 37%|███▋      | 138075/371472 [10:58:09<17:48:10,  3.64it/s]
 37%|███▋      | 138076/371472 [10:58:09<17:25:26,  3.72it/s]
 37%|███▋      | 138077/371472 [10:58:10<17:58:02,  3.61it/s]
 37%|███▋      | 138078/371472 [10:58:10<17:53:11,  3.62it/s]
 37%|███▋      | 138079/371472 [10:58:10<19:22:39,  3.35it/s]
 37%|███▋      | 138080/371472 [10:58:10<18:25:07,  3.52it/s]
                                                             
{'loss': 3.05, 'learning_rate': 6.657652610485035e-07, 'epoch': 5.95}

 37%|███▋      | 138080/371472 [10:58:10<18:25:07,  3.52it/s]
 37%|███▋      | 138081/371472 [10:58:11<18:46:26,  3.45it/s]
 37%|███▋      | 138082/371472 [10:58:11<18:03:08,  3.59it/s]
 37%|███▋      | 138083/371472 [10:58:11<18:05:05,  3.58it/s]
 37%|███▋      | 138084/371472 [10:58:12<18:22:26,  3.53it/s]
 37%|███▋      | 138085/371472 [10:58:12<18:18:43,  3.54it/s]
 37%|███▋      | 138086/371472 [10:58:12<19:16:17,  3.36it/s]
 37%|███▋      | 138087/371472 [10:58:12<19:46:15,  3.28it/s]
 37%|███▋      | 138088/371472 [10:58:13<18:27:56,  3.51it/s]
 37%|███▋      | 138089/371472 [10:58:13<18:57:03,  3.42it/s]
 37%|███▋      | 138090/371472 [10:58:13<19:36:05,  3.31it/s]
 37%|███▋      | 138091/371472 [10:58:14<18:50:19,  3.44it/s]
 37%|███▋      | 138092/371472 [10:58:14<18:13:39,  3.56it/s]
 37%|███▋      | 138093/371472 [10:58:14<18:04:41,  3.59it/s]
 37%|███▋      | 138094/371472 [10:58:14<18:32:47,  3.50it/s]
 37%|███▋      | 138095/371472 [10:58:15<20:06:25,  3.22it/s]
 37%|███▋      | 138096/371472 [10:58:15<18:53:07,  3.43it/s]
 37%|███▋      | 138097/371472 [10:58:15<17:50:58,  3.63it/s]
 37%|███▋      | 138098/371472 [10:58:16<18:06:22,  3.58it/s]
 37%|███▋      | 138099/371472 [10:58:16<19:16:01,  3.36it/s]
 37%|███▋      | 138100/371472 [10:58:16<18:42:38,  3.46it/s]
                                                             
{'loss': 3.1033, 'learning_rate': 6.657167790730245e-07, 'epoch': 5.95}

 37%|███▋      | 138100/371472 [10:58:16<18:42:38,  3.46it/s]
 37%|███▋      | 138101/371472 [10:58:16<18:30:04,  3.50it/s]
 37%|███▋      | 138102/371472 [10:58:17<19:17:46,  3.36it/s]
 37%|███▋      | 138103/371472 [10:58:17<19:03:20,  3.40it/s]
 37%|███▋      | 138104/371472 [10:58:17<18:23:12,  3.53it/s]
 37%|███▋      | 138105/371472 [10:58:18<18:03:28,  3.59it/s]
 37%|███▋      | 138106/371472 [10:58:18<19:27:04,  3.33it/s]
 37%|███▋      | 138107/371472 [10:58:18<18:30:24,  3.50it/s]
 37%|███▋      | 138108/371472 [10:58:19<18:44:57,  3.46it/s]
 37%|███▋      | 138109/371472 [10:58:19<18:20:52,  3.53it/s]
 37%|███▋      | 138110/371472 [10:58:19<17:32:35,  3.70it/s]
 37%|███▋      | 138111/371472 [10:58:19<18:44:15,  3.46it/s]
 37%|███▋      | 138112/371472 [10:58:20<17:50:48,  3.63it/s]
 37%|███▋      | 138113/371472 [10:58:20<18:57:45,  3.42it/s]
 37%|███▋      | 138114/371472 [10:58:20<18:50:56,  3.44it/s]
 37%|███▋      | 138115/371472 [10:58:20<18:11:16,  3.56it/s]
 37%|███▋      | 138116/371472 [10:58:21<18:39:55,  3.47it/s]
 37%|███▋      | 138117/371472 [10:58:21<18:07:16,  3.58it/s]
 37%|███▋      | 138118/371472 [10:58:21<18:13:38,  3.56it/s]
 37%|███▋      | 138119/371472 [10:58:22<18:23:42,  3.52it/s]
 37%|███▋      | 138120/371472 [10:58:22<18:02:03,  3.59it/s]
                                                             
{'loss': 2.9416, 'learning_rate': 6.656682970975457e-07, 'epoch': 5.95}

 37%|███▋      | 138120/371472 [10:58:22<18:02:03,  3.59it/s]
 37%|███▋      | 138121/371472 [10:58:22<18:40:03,  3.47it/s]
 37%|███▋      | 138122/371472 [10:58:22<18:05:00,  3.58it/s]
 37%|███▋      | 138123/371472 [10:58:23<19:13:42,  3.37it/s]
 37%|███▋      | 138124/371472 [10:58:23<18:25:05,  3.52it/s]
 37%|███▋      | 138125/371472 [10:58:23<17:51:50,  3.63it/s]
 37%|███▋      | 138126/371472 [10:58:24<17:34:12,  3.69it/s]
 37%|███▋      | 138127/371472 [10:58:24<17:32:17,  3.70it/s]
 37%|███▋      | 138128/371472 [10:58:24<16:49:31,  3.85it/s]
 37%|███▋      | 138129/371472 [10:58:24<17:13:02,  3.76it/s]
 37%|███▋      | 138130/371472 [10:58:25<17:24:47,  3.72it/s]
 37%|███▋      | 138131/371472 [10:58:25<17:29:15,  3.71it/s]
 37%|███▋      | 138132/371472 [10:58:25<17:54:01,  3.62it/s]
 37%|███▋      | 138133/371472 [10:58:25<17:42:58,  3.66it/s]
 37%|███▋      | 138134/371472 [10:58:26<17:22:42,  3.73it/s]
 37%|███▋      | 138135/371472 [10:58:26<17:31:07,  3.70it/s]
 37%|███▋      | 138136/371472 [10:58:26<17:10:53,  3.77it/s]
 37%|███▋      | 138137/371472 [10:58:27<17:37:55,  3.68it/s]
 37%|███▋      | 138138/371472 [10:58:27<18:00:36,  3.60it/s]
 37%|███▋      | 138139/371472 [10:58:27<17:39:11,  3.67it/s]
 37%|███▋      | 138140/371472 [10:58:27<18:24:06,  3.52it/s]
                                                             
{'loss': 3.1685, 'learning_rate': 6.656198151220669e-07, 'epoch': 5.95}

 37%|███▋      | 138140/371472 [10:58:27<18:24:06,  3.52it/s]
 37%|███▋      | 138141/371472 [10:58:28<19:11:49,  3.38it/s]
 37%|███▋      | 138142/371472 [10:58:28<19:49:39,  3.27it/s]
 37%|███▋      | 138143/371472 [10:58:28<19:17:18,  3.36it/s]
 37%|███▋      | 138144/371472 [10:58:29<18:56:10,  3.42it/s]
 37%|███▋      | 138145/371472 [10:58:29<18:48:21,  3.45it/s]
 37%|███▋      | 138146/371472 [10:58:29<18:24:18,  3.52it/s]
 37%|███▋      | 138147/371472 [10:58:29<17:47:32,  3.64it/s]
 37%|███▋      | 138148/371472 [10:58:30<17:51:50,  3.63it/s]
 37%|███▋      | 138149/371472 [10:58:30<17:37:41,  3.68it/s]
 37%|███▋      | 138150/371472 [10:58:30<17:34:15,  3.69it/s]
 37%|███▋      | 138151/371472 [10:58:30<17:13:12,  3.76it/s]
 37%|███▋      | 138152/371472 [10:58:31<17:19:41,  3.74it/s]
 37%|███▋      | 138153/371472 [10:58:31<18:31:08,  3.50it/s]
 37%|███▋      | 138154/371472 [10:58:31<18:35:48,  3.49it/s]
 37%|███▋      | 138155/371472 [10:58:32<18:31:10,  3.50it/s]
 37%|███▋      | 138156/371472 [10:58:32<18:25:57,  3.52it/s]
 37%|███▋      | 138157/371472 [10:58:32<17:45:58,  3.65it/s]
 37%|███▋      | 138158/371472 [10:58:32<18:14:00,  3.55it/s]
 37%|███▋      | 138159/371472 [10:58:33<17:26:53,  3.71it/s]
 37%|███▋      | 138160/371472 [10:58:33<17:04:23,  3.80it/s]
                                                             
{'loss': 3.1556, 'learning_rate': 6.65571333146588e-07, 'epoch': 5.95}

 37%|███▋      | 138160/371472 [10:58:33<17:04:23,  3.80it/s]
 37%|███▋      | 138161/371472 [10:58:33<16:26:38,  3.94it/s]
 37%|███▋      | 138162/371472 [10:58:34<18:01:33,  3.60it/s]
 37%|███▋      | 138163/371472 [10:58:34<17:22:37,  3.73it/s]
 37%|███▋      | 138164/371472 [10:58:34<17:01:19,  3.81it/s]
 37%|███▋      | 138165/371472 [10:58:34<16:33:11,  3.92it/s]
 37%|███▋      | 138166/371472 [10:58:35<16:30:40,  3.93it/s]
 37%|███▋      | 138167/371472 [10:58:35<17:31:40,  3.70it/s]
 37%|███▋      | 138168/371472 [10:58:35<17:42:52,  3.66it/s]
 37%|███▋      | 138169/371472 [10:58:35<17:22:27,  3.73it/s]
 37%|███▋      | 138170/371472 [10:58:36<17:37:47,  3.68it/s]
 37%|███▋      | 138171/371472 [10:58:36<17:40:14,  3.67it/s]
 37%|███▋      | 138172/371472 [10:58:36<18:08:54,  3.57it/s]
 37%|███▋      | 138173/371472 [10:58:37<18:56:22,  3.42it/s]
 37%|███▋      | 138174/371472 [10:58:37<18:47:09,  3.45it/s]
 37%|███▋      | 138175/371472 [10:58:37<17:54:36,  3.62it/s]
 37%|███▋      | 138176/371472 [10:58:37<17:17:16,  3.75it/s]
 37%|███▋      | 138177/371472 [10:58:38<17:47:33,  3.64it/s]
 37%|███▋      | 138178/371472 [10:58:38<17:56:09,  3.61it/s]
 37%|███▋      | 138179/371472 [10:58:38<18:23:06,  3.52it/s]
 37%|███▋      | 138180/371472 [10:58:38<18:57:18,  3.42it/s]
                                                             
{'loss': 3.2782, 'learning_rate': 6.65522851171109e-07, 'epoch': 5.95}

 37%|███▋      | 138180/371472 [10:58:38<18:57:18,  3.42it/s]
 37%|███▋      | 138181/371472 [10:58:39<18:48:38,  3.44it/s]
 37%|███▋      | 138182/371472 [10:58:39<19:33:34,  3.31it/s]
 37%|███▋      | 138183/371472 [10:58:39<18:50:54,  3.44it/s]
 37%|███▋      | 138184/371472 [10:58:40<18:01:45,  3.59it/s]
 37%|███▋      | 138185/371472 [10:58:40<17:33:11,  3.69it/s]
 37%|███▋      | 138186/371472 [10:58:40<16:45:43,  3.87it/s]
 37%|███▋      | 138187/371472 [10:58:40<17:36:49,  3.68it/s]
 37%|███▋      | 138188/371472 [10:58:41<17:22:53,  3.73it/s]
 37%|███▋      | 138189/371472 [10:58:41<16:48:50,  3.85it/s]
 37%|███▋      | 138190/371472 [10:58:41<20:17:32,  3.19it/s]
 37%|███▋      | 138191/371472 [10:58:42<19:53:42,  3.26it/s]
 37%|███▋      | 138192/371472 [10:58:42<19:01:57,  3.40it/s]
 37%|███▋      | 138193/371472 [10:58:42<18:26:33,  3.51it/s]
 37%|███▋      | 138194/371472 [10:58:42<17:55:21,  3.62it/s]
 37%|███▋      | 138195/371472 [10:58:43<17:24:58,  3.72it/s]
 37%|███▋      | 138196/371472 [10:58:43<17:24:37,  3.72it/s]
 37%|███▋      | 138197/371472 [10:58:43<18:01:40,  3.59it/s]
 37%|███▋      | 138198/371472 [10:58:44<18:04:03,  3.59it/s]
 37%|███▋      | 138199/371472 [10:58:44<17:18:40,  3.74it/s]
 37%|███▋      | 138200/371472 [10:58:44<17:06:20,  3.79it/s]
                                                             
{'loss': 3.0903, 'learning_rate': 6.654743691956302e-07, 'epoch': 5.95}

 37%|███▋      | 138200/371472 [10:58:44<17:06:20,  3.79it/s]
 37%|███▋      | 138201/371472 [10:58:44<17:25:51,  3.72it/s]
 37%|███▋      | 138202/371472 [10:58:45<18:52:29,  3.43it/s]
 37%|███▋      | 138203/371472 [10:58:45<19:50:11,  3.27it/s]
 37%|███▋      | 138204/371472 [10:58:45<18:44:16,  3.46it/s]
 37%|███▋      | 138205/371472 [10:58:45<17:51:26,  3.63it/s]
 37%|███▋      | 138206/371472 [10:58:46<17:23:56,  3.72it/s]
 37%|███▋      | 138207/371472 [10:58:46<19:38:41,  3.30it/s]
 37%|███▋      | 138208/371472 [10:58:46<19:05:22,  3.39it/s]
 37%|███▋      | 138209/371472 [10:58:47<19:43:19,  3.29it/s]
 37%|███▋      | 138210/371472 [10:58:47<19:01:27,  3.41it/s]
 37%|███▋      | 138211/371472 [10:58:47<20:02:42,  3.23it/s]
 37%|███▋      | 138212/371472 [10:58:48<18:58:53,  3.41it/s]
 37%|███▋      | 138213/371472 [10:58:48<18:26:45,  3.51it/s]
 37%|███▋      | 138214/371472 [10:58:48<17:43:06,  3.66it/s]
 37%|███▋      | 138215/371472 [10:58:48<19:36:35,  3.30it/s]
 37%|███▋      | 138216/371472 [10:58:49<19:03:04,  3.40it/s]
 37%|███▋      | 138217/371472 [10:58:49<18:15:12,  3.55it/s]
 37%|███▋      | 138218/371472 [10:58:49<18:03:37,  3.59it/s]
 37%|███▋      | 138219/371472 [10:58:50<18:49:52,  3.44it/s]
 37%|███▋      | 138220/371472 [10:58:50<17:49:11,  3.64it/s]
                                                             
{'loss': 3.2313, 'learning_rate': 6.654258872201513e-07, 'epoch': 5.95}

 37%|███▋      | 138220/371472 [10:58:50<17:49:11,  3.64it/s]
 37%|███▋      | 138221/371472 [10:58:50<17:56:28,  3.61it/s]
 37%|███▋      | 138222/371472 [10:58:50<17:29:36,  3.70it/s]
 37%|███▋      | 138223/371472 [10:58:51<16:43:47,  3.87it/s]
 37%|███▋      | 138224/371472 [10:58:51<16:25:56,  3.94it/s]
 37%|███▋      | 138225/371472 [10:58:51<16:00:57,  4.05it/s]
 37%|███▋      | 138226/371472 [10:58:51<17:25:04,  3.72it/s]
 37%|███▋      | 138227/371472 [10:58:52<17:40:06,  3.67it/s]
 37%|███▋      | 138228/371472 [10:58:52<20:32:38,  3.15it/s]
 37%|███▋      | 138229/371472 [10:58:52<19:32:43,  3.31it/s]
 37%|███▋      | 138230/371472 [10:58:53<18:30:28,  3.50it/s]
 37%|███▋      | 138231/371472 [10:58:53<20:04:18,  3.23it/s]
 37%|███▋      | 138232/371472 [10:58:53<18:57:48,  3.42it/s]
 37%|███▋      | 138233/371472 [10:58:53<17:45:29,  3.65it/s]
 37%|███▋      | 138234/371472 [10:58:54<18:37:51,  3.48it/s]
 37%|███▋      | 138235/371472 [10:58:54<17:43:12,  3.66it/s]
 37%|███▋      | 138236/371472 [10:58:54<17:54:36,  3.62it/s]
 37%|███▋      | 138237/371472 [10:58:55<17:52:02,  3.63it/s]
 37%|███▋      | 138238/371472 [10:58:55<17:36:24,  3.68it/s]
 37%|███▋      | 138239/371472 [10:58:55<17:44:27,  3.65it/s]
 37%|███▋      | 138240/371472 [10:58:55<17:28:58,  3.71it/s]
                                                             
{'loss': 3.079, 'learning_rate': 6.653774052446724e-07, 'epoch': 5.95}

 37%|███▋      | 138240/371472 [10:58:55<17:28:58,  3.71it/s]
 37%|███▋      | 138241/371472 [10:58:56<17:54:35,  3.62it/s]
 37%|███▋      | 138242/371472 [10:58:56<17:10:45,  3.77it/s]
 37%|███▋      | 138243/371472 [10:58:56<17:09:52,  3.77it/s]
 37%|███▋      | 138244/371472 [10:58:56<16:59:44,  3.81it/s]
 37%|███▋      | 138245/371472 [10:58:57<17:31:53,  3.70it/s]
 37%|███▋      | 138246/371472 [10:58:57<17:23:17,  3.73it/s]
 37%|███▋      | 138247/371472 [10:58:57<17:35:47,  3.68it/s]
 37%|███▋      | 138248/371472 [10:58:57<17:12:12,  3.77it/s]
 37%|███▋      | 138249/371472 [10:58:58<17:14:29,  3.76it/s]
 37%|███▋      | 138250/371472 [10:58:58<17:31:22,  3.70it/s]
 37%|███▋      | 138251/371472 [10:58:58<17:56:00,  3.61it/s]
 37%|███▋      | 138252/371472 [10:58:59<17:56:51,  3.61it/s]
 37%|███▋      | 138253/371472 [10:58:59<17:57:20,  3.61it/s]
 37%|███▋      | 138254/371472 [10:58:59<17:27:05,  3.71it/s]
 37%|███▋      | 138255/371472 [10:58:59<17:02:59,  3.80it/s]
 37%|███▋      | 138256/371472 [10:59:00<17:36:12,  3.68it/s]
 37%|███▋      | 138257/371472 [10:59:00<17:25:04,  3.72it/s]
 37%|███▋      | 138258/371472 [10:59:00<18:00:11,  3.60it/s]
 37%|███▋      | 138259/371472 [10:59:01<17:50:50,  3.63it/s]
 37%|███▋      | 138260/371472 [10:59:01<17:45:06,  3.65it/s]
                                                             
{'loss': 3.082, 'learning_rate': 6.653289232691934e-07, 'epoch': 5.96}

 37%|███▋      | 138260/371472 [10:59:01<17:45:06,  3.65it/s]
 37%|███▋      | 138261/371472 [10:59:01<17:42:05,  3.66it/s]
 37%|███▋      | 138262/371472 [10:59:01<18:30:51,  3.50it/s]
 37%|███▋      | 138263/371472 [10:59:02<19:12:10,  3.37it/s]
 37%|███▋      | 138264/371472 [10:59:02<18:30:48,  3.50it/s]
 37%|███▋      | 138265/371472 [10:59:02<17:47:16,  3.64it/s]
 37%|███▋      | 138266/371472 [10:59:02<17:33:28,  3.69it/s]
 37%|███▋      | 138267/371472 [10:59:03<17:02:26,  3.80it/s]
 37%|███▋      | 138268/371472 [10:59:03<18:26:03,  3.51it/s]
 37%|███▋      | 138269/371472 [10:59:03<18:58:30,  3.41it/s]
 37%|███▋      | 138270/371472 [10:59:04<18:58:36,  3.41it/s]
 37%|███▋      | 138271/371472 [10:59:04<18:55:29,  3.42it/s]
 37%|███▋      | 138272/371472 [10:59:04<18:44:54,  3.46it/s]
 37%|███▋      | 138273/371472 [10:59:04<18:13:42,  3.55it/s]
 37%|███▋      | 138274/371472 [10:59:05<18:41:17,  3.47it/s]
 37%|███▋      | 138275/371472 [10:59:05<17:46:35,  3.64it/s]
 37%|███▋      | 138276/371472 [10:59:05<19:23:27,  3.34it/s]
 37%|███▋      | 138277/371472 [10:59:06<18:44:15,  3.46it/s]
 37%|███▋      | 138278/371472 [10:59:06<19:46:41,  3.28it/s]
 37%|███▋      | 138279/371472 [10:59:06<19:38:52,  3.30it/s]
 37%|███▋      | 138280/371472 [10:59:07<18:55:42,  3.42it/s]
                                                             
{'loss': 3.1584, 'learning_rate': 6.652804412937146e-07, 'epoch': 5.96}

 37%|███▋      | 138280/371472 [10:59:07<18:55:42,  3.42it/s]
 37%|███▋      | 138281/371472 [10:59:07<18:13:44,  3.55it/s]
 37%|███▋      | 138282/371472 [10:59:07<17:40:59,  3.66it/s]
 37%|███▋      | 138283/371472 [10:59:07<17:26:42,  3.71it/s]
 37%|███▋      | 138284/371472 [10:59:08<17:42:36,  3.66it/s]
 37%|███▋      | 138285/371472 [10:59:08<17:52:44,  3.62it/s]
 37%|███▋      | 138286/371472 [10:59:08<18:08:21,  3.57it/s]
 37%|███▋      | 138287/371472 [10:59:09<19:00:33,  3.41it/s]
 37%|███▋      | 138288/371472 [10:59:09<18:33:59,  3.49it/s]
 37%|███▋      | 138289/371472 [10:59:09<17:59:26,  3.60it/s]
 37%|███▋      | 138290/371472 [10:59:09<19:16:45,  3.36it/s]
 37%|███▋      | 138291/371472 [10:59:10<18:15:02,  3.55it/s]
 37%|███▋      | 138292/371472 [10:59:10<17:28:39,  3.71it/s]
 37%|███▋      | 138293/371472 [10:59:10<17:22:05,  3.73it/s]
 37%|███▋      | 138294/371472 [10:59:10<17:20:00,  3.74it/s]
 37%|███▋      | 138295/371472 [10:59:11<17:56:41,  3.61it/s]
 37%|███▋      | 138296/371472 [10:59:11<17:08:58,  3.78it/s]
 37%|███▋      | 138297/371472 [10:59:11<17:02:09,  3.80it/s]
 37%|███▋      | 138298/371472 [10:59:11<17:30:23,  3.70it/s]
 37%|███▋      | 138299/371472 [10:59:12<16:55:20,  3.83it/s]
 37%|███▋      | 138300/371472 [10:59:12<17:21:01,  3.73it/s]
                                                             
{'loss': 3.1979, 'learning_rate': 6.652319593182357e-07, 'epoch': 5.96}

 37%|███▋      | 138300/371472 [10:59:12<17:21:01,  3.73it/s]
 37%|███▋      | 138301/371472 [10:59:12<18:18:03,  3.54it/s]
 37%|███▋      | 138302/371472 [10:59:13<18:03:53,  3.59it/s]
 37%|███▋      | 138303/371472 [10:59:13<19:19:13,  3.35it/s]
 37%|███▋      | 138304/371472 [10:59:13<18:12:54,  3.56it/s]
 37%|███▋      | 138305/371472 [10:59:13<17:38:09,  3.67it/s]
 37%|███▋      | 138306/371472 [10:59:14<18:13:59,  3.55it/s]
 37%|███▋      | 138307/371472 [10:59:14<17:19:55,  3.74it/s]
 37%|███▋      | 138308/371472 [10:59:14<17:07:28,  3.78it/s]
 37%|███▋      | 138309/371472 [10:59:15<19:17:39,  3.36it/s]
 37%|███▋      | 138310/371472 [10:59:15<18:33:11,  3.49it/s]
 37%|███▋      | 138311/371472 [10:59:15<18:50:22,  3.44it/s]
 37%|███▋      | 138312/371472 [10:59:15<17:58:08,  3.60it/s]
 37%|███▋      | 138313/371472 [10:59:16<17:26:52,  3.71it/s]
 37%|███▋      | 138314/371472 [10:59:16<17:51:02,  3.63it/s]
 37%|███▋      | 138315/371472 [10:59:16<17:34:45,  3.68it/s]
 37%|███▋      | 138316/371472 [10:59:16<17:14:00,  3.76it/s]
 37%|███▋      | 138317/371472 [10:59:17<17:50:58,  3.63it/s]
 37%|███▋      | 138318/371472 [10:59:17<17:56:43,  3.61it/s]
 37%|███▋      | 138319/371472 [10:59:17<17:37:51,  3.67it/s]
 37%|███▋      | 138320/371472 [10:59:18<17:36:52,  3.68it/s]
                                                             
{'loss': 3.1629, 'learning_rate': 6.651834773427567e-07, 'epoch': 5.96}

 37%|███▋      | 138320/371472 [10:59:18<17:36:52,  3.68it/s]
 37%|███▋      | 138321/371472 [10:59:18<17:10:38,  3.77it/s]
 37%|███▋      | 138322/371472 [10:59:18<16:52:27,  3.84it/s]
 37%|███▋      | 138323/371472 [10:59:18<16:58:06,  3.82it/s]
 37%|███▋      | 138324/371472 [10:59:19<18:06:32,  3.58it/s]
 37%|███▋      | 138325/371472 [10:59:19<17:56:27,  3.61it/s]
 37%|███▋      | 138326/371472 [10:59:19<17:33:26,  3.69it/s]
 37%|███▋      | 138327/371472 [10:59:19<18:08:59,  3.57it/s]
 37%|███▋      | 138328/371472 [10:59:20<17:34:07,  3.69it/s]
 37%|███▋      | 138329/371472 [10:59:20<18:02:22,  3.59it/s]
 37%|███▋      | 138330/371472 [10:59:20<17:29:33,  3.70it/s]
 37%|███▋      | 138331/371472 [10:59:21<18:30:34,  3.50it/s]
 37%|███▋      | 138332/371472 [10:59:21<17:56:34,  3.61it/s]
 37%|███▋      | 138333/371472 [10:59:21<17:43:52,  3.65it/s]
 37%|███▋      | 138334/371472 [10:59:21<17:55:42,  3.61it/s]
 37%|███▋      | 138335/371472 [10:59:22<17:54:55,  3.61it/s]
 37%|███▋      | 138336/371472 [10:59:22<17:51:13,  3.63it/s]
 37%|███▋      | 138337/371472 [10:59:22<18:01:42,  3.59it/s]
 37%|███▋      | 138338/371472 [10:59:23<18:02:52,  3.59it/s]
 37%|███▋      | 138339/371472 [10:59:23<17:29:56,  3.70it/s]
 37%|███▋      | 138340/371472 [10:59:23<17:29:33,  3.70it/s]
                                                             
{'loss': 3.0764, 'learning_rate': 6.651349953672778e-07, 'epoch': 5.96}

 37%|███▋      | 138340/371472 [10:59:23<17:29:33,  3.70it/s]
 37%|███▋      | 138341/371472 [10:59:23<17:40:30,  3.66it/s]
 37%|███▋      | 138342/371472 [10:59:24<17:29:19,  3.70it/s]
 37%|███▋      | 138343/371472 [10:59:24<17:48:02,  3.64it/s]
 37%|███▋      | 138344/371472 [10:59:24<19:12:05,  3.37it/s]
 37%|███▋      | 138345/371472 [10:59:24<18:42:49,  3.46it/s]
 37%|███▋      | 138346/371472 [10:59:25<18:14:45,  3.55it/s]
 37%|███▋      | 138347/371472 [10:59:25<18:11:16,  3.56it/s]
 37%|███▋      | 138348/371472 [10:59:25<17:25:47,  3.72it/s]
 37%|███▋      | 138349/371472 [10:59:26<17:31:24,  3.70it/s]
 37%|███▋      | 138350/371472 [10:59:26<17:58:17,  3.60it/s]
 37%|███▋      | 138351/371472 [10:59:26<18:03:51,  3.58it/s]
 37%|███▋      | 138352/371472 [10:59:26<18:13:52,  3.55it/s]
 37%|███▋      | 138353/371472 [10:59:27<17:50:09,  3.63it/s]
 37%|███▋      | 138354/371472 [10:59:27<19:49:55,  3.27it/s]
 37%|███▋      | 138355/371472 [10:59:27<18:52:38,  3.43it/s]
 37%|███▋      | 138356/371472 [10:59:28<18:46:06,  3.45it/s]
 37%|███▋      | 138357/371472 [10:59:28<19:02:10,  3.40it/s]
 37%|███▋      | 138358/371472 [10:59:28<19:02:23,  3.40it/s]
 37%|███▋      | 138359/371472 [10:59:28<18:52:38,  3.43it/s]
 37%|███▋      | 138360/371472 [10:59:29<18:54:08,  3.43it/s]
                                                             
{'loss': 3.0662, 'learning_rate': 6.65086513391799e-07, 'epoch': 5.96}

 37%|███▋      | 138360/371472 [10:59:29<18:54:08,  3.43it/s]
 37%|███▋      | 138361/371472 [10:59:29<18:37:44,  3.48it/s]
 37%|███▋      | 138362/371472 [10:59:29<17:54:30,  3.62it/s]
 37%|███▋      | 138363/371472 [10:59:30<18:37:04,  3.48it/s]
 37%|███▋      | 138364/371472 [10:59:30<18:45:56,  3.45it/s]
 37%|███▋      | 138365/371472 [10:59:30<18:27:56,  3.51it/s]
 37%|███▋      | 138366/371472 [10:59:30<18:15:19,  3.55it/s]
 37%|███▋      | 138367/371472 [10:59:31<19:41:09,  3.29it/s]
 37%|███▋      | 138368/371472 [10:59:31<18:42:18,  3.46it/s]
 37%|███▋      | 138369/371472 [10:59:31<18:43:06,  3.46it/s]
 37%|███▋      | 138370/371472 [10:59:32<18:45:18,  3.45it/s]
 37%|███▋      | 138371/371472 [10:59:32<17:46:13,  3.64it/s]
 37%|███▋      | 138372/371472 [10:59:32<17:12:45,  3.76it/s]
 37%|███▋      | 138373/371472 [10:59:32<17:00:29,  3.81it/s]
 37%|███▋      | 138374/371472 [10:59:33<16:54:27,  3.83it/s]
 37%|███▋      | 138375/371472 [10:59:33<17:31:46,  3.69it/s]
 37%|███▋      | 138376/371472 [10:59:33<17:41:22,  3.66it/s]
 37%|███▋      | 138377/371472 [10:59:33<17:45:40,  3.65it/s]
 37%|███▋      | 138378/371472 [10:59:34<17:37:40,  3.67it/s]
 37%|███▋      | 138379/371472 [10:59:34<18:12:13,  3.56it/s]
 37%|███▋      | 138380/371472 [10:59:34<17:52:34,  3.62it/s]
                                                             
{'loss': 3.3012, 'learning_rate': 6.650380314163201e-07, 'epoch': 5.96}

 37%|███▋      | 138380/371472 [10:59:34<17:52:34,  3.62it/s]
 37%|███▋      | 138381/371472 [10:59:35<17:50:24,  3.63it/s]
 37%|███▋      | 138382/371472 [10:59:35<18:29:33,  3.50it/s]
 37%|███▋      | 138383/371472 [10:59:35<19:46:41,  3.27it/s]
 37%|███▋      | 138384/371472 [10:59:36<21:15:25,  3.05it/s]
 37%|███▋      | 138385/371472 [10:59:36<19:51:10,  3.26it/s]
 37%|███▋      | 138386/371472 [10:59:36<19:18:45,  3.35it/s]
 37%|███▋      | 138387/371472 [10:59:36<18:15:14,  3.55it/s]
 37%|███▋      | 138388/371472 [10:59:37<17:46:23,  3.64it/s]
 37%|███▋      | 138389/371472 [10:59:37<17:54:46,  3.61it/s]
 37%|███▋      | 138390/371472 [10:59:37<17:25:14,  3.72it/s]
 37%|███▋      | 138391/371472 [10:59:38<18:20:06,  3.53it/s]
 37%|███▋      | 138392/371472 [10:59:38<17:46:22,  3.64it/s]
 37%|███▋      | 138393/371472 [10:59:38<17:12:44,  3.76it/s]
 37%|███▋      | 138394/371472 [10:59:38<17:39:10,  3.67it/s]
 37%|███▋      | 138395/371472 [10:59:39<18:12:16,  3.56it/s]
 37%|███▋      | 138396/371472 [10:59:39<19:09:19,  3.38it/s]
 37%|███▋      | 138397/371472 [10:59:39<18:16:52,  3.54it/s]
 37%|███▋      | 138398/371472 [10:59:40<18:39:46,  3.47it/s]
 37%|███▋      | 138399/371472 [10:59:40<18:10:02,  3.56it/s]
 37%|███▋      | 138400/371472 [10:59:40<17:24:50,  3.72it/s]
                                                             
{'loss': 3.1651, 'learning_rate': 6.649895494408411e-07, 'epoch': 5.96}

 37%|███▋      | 138400/371472 [10:59:40<17:24:50,  3.72it/s]
 37%|███▋      | 138401/371472 [10:59:40<17:22:03,  3.73it/s]
 37%|███▋      | 138402/371472 [10:59:41<18:09:07,  3.57it/s]
 37%|███▋      | 138403/371472 [10:59:41<17:20:13,  3.73it/s]
 37%|███▋      | 138404/371472 [10:59:41<17:20:54,  3.73it/s]
 37%|███▋      | 138405/371472 [10:59:41<17:18:44,  3.74it/s]
 37%|███▋      | 138406/371472 [10:59:42<17:01:40,  3.80it/s]
 37%|███▋      | 138407/371472 [10:59:42<17:12:30,  3.76it/s]
 37%|███▋      | 138408/371472 [10:59:42<17:00:59,  3.80it/s]
 37%|███▋      | 138409/371472 [10:59:42<16:44:33,  3.87it/s]
 37%|███▋      | 138410/371472 [10:59:43<18:17:13,  3.54it/s]
 37%|███▋      | 138411/371472 [10:59:43<18:39:31,  3.47it/s]
 37%|███▋      | 138412/371472 [10:59:43<18:13:27,  3.55it/s]
 37%|███▋      | 138413/371472 [10:59:44<17:47:10,  3.64it/s]
 37%|███▋      | 138414/371472 [10:59:44<17:10:08,  3.77it/s]
 37%|███▋      | 138415/371472 [10:59:44<17:01:58,  3.80it/s]
 37%|███▋      | 138416/371472 [10:59:44<17:18:08,  3.74it/s]
 37%|███▋      | 138417/371472 [10:59:45<17:14:42,  3.75it/s]
 37%|███▋      | 138418/371472 [10:59:45<16:40:05,  3.88it/s]
 37%|███▋      | 138419/371472 [10:59:45<17:01:15,  3.80it/s]
 37%|███▋      | 138420/371472 [10:59:45<16:55:27,  3.83it/s]
                                                             
{'loss': 3.2542, 'learning_rate': 6.649410674653623e-07, 'epoch': 5.96}

 37%|███▋      | 138420/371472 [10:59:45<16:55:27,  3.83it/s]
 37%|███▋      | 138421/371472 [10:59:46<17:23:20,  3.72it/s]
 37%|███▋      | 138422/371472 [10:59:46<16:52:19,  3.84it/s]
 37%|███▋      | 138423/371472 [10:59:46<17:56:10,  3.61it/s]
 37%|███▋      | 138424/371472 [10:59:46<17:27:37,  3.71it/s]
 37%|███▋      | 138425/371472 [10:59:47<17:20:12,  3.73it/s]
 37%|███▋      | 138426/371472 [10:59:47<17:22:12,  3.73it/s]
 37%|███▋      | 138427/371472 [10:59:47<17:09:35,  3.77it/s]
 37%|███▋      | 138428/371472 [10:59:48<19:41:26,  3.29it/s]
 37%|███▋      | 138429/371472 [10:59:48<21:10:59,  3.06it/s]
 37%|███▋      | 138430/371472 [10:59:48<20:39:56,  3.13it/s]
 37%|███▋      | 138431/371472 [10:59:49<19:52:42,  3.26it/s]
 37%|███▋      | 138432/371472 [10:59:49<20:15:00,  3.20it/s]
 37%|███▋      | 138433/371472 [10:59:49<19:35:48,  3.30it/s]
 37%|███▋      | 138434/371472 [10:59:49<18:47:55,  3.44it/s]
 37%|███▋      | 138435/371472 [10:59:50<18:18:47,  3.53it/s]
 37%|███▋      | 138436/371472 [10:59:50<18:42:12,  3.46it/s]
 37%|███▋      | 138437/371472 [10:59:50<18:16:35,  3.54it/s]
 37%|███▋      | 138438/371472 [10:59:51<17:28:42,  3.70it/s]
 37%|███▋      | 138439/371472 [10:59:51<17:40:00,  3.66it/s]
 37%|███▋      | 138440/371472 [10:59:51<17:19:34,  3.74it/s]
                                                             
{'loss': 2.9693, 'learning_rate': 6.648925854898834e-07, 'epoch': 5.96}

 37%|███▋      | 138440/371472 [10:59:51<17:19:34,  3.74it/s]
 37%|███▋      | 138441/371472 [10:59:51<16:44:23,  3.87it/s]
 37%|███▋      | 138442/371472 [10:59:52<16:42:26,  3.87it/s]
 37%|███▋      | 138443/371472 [10:59:52<18:38:38,  3.47it/s]
 37%|███▋      | 138444/371472 [10:59:52<18:05:24,  3.58it/s]
 37%|███▋      | 138445/371472 [10:59:52<17:48:44,  3.63it/s]
 37%|███▋      | 138446/371472 [10:59:53<17:22:37,  3.72it/s]
 37%|███▋      | 138447/371472 [10:59:53<18:28:58,  3.50it/s]
 37%|███▋      | 138448/371472 [10:59:53<17:45:38,  3.64it/s]
 37%|███▋      | 138449/371472 [10:59:54<17:34:17,  3.68it/s]
 37%|███▋      | 138450/371472 [10:59:54<17:22:09,  3.73it/s]
 37%|███▋      | 138451/371472 [10:59:54<17:23:02,  3.72it/s]
 37%|███▋      | 138452/371472 [10:59:54<18:09:44,  3.56it/s]
 37%|███▋      | 138453/371472 [10:59:55<19:32:53,  3.31it/s]
 37%|███▋      | 138454/371472 [10:59:55<18:09:51,  3.56it/s]
 37%|███▋      | 138455/371472 [10:59:55<18:10:45,  3.56it/s]
 37%|███▋      | 138456/371472 [10:59:56<17:49:13,  3.63it/s]
 37%|███▋      | 138457/371472 [10:59:56<18:52:09,  3.43it/s]
 37%|███▋      | 138458/371472 [10:59:56<19:42:13,  3.28it/s]
 37%|███▋      | 138459/371472 [10:59:56<19:01:33,  3.40it/s]
 37%|███▋      | 138460/371472 [10:59:57<18:10:39,  3.56it/s]
                                                             
{'loss': 3.0111, 'learning_rate': 6.648441035144045e-07, 'epoch': 5.96}

 37%|███▋      | 138460/371472 [10:59:57<18:10:39,  3.56it/s]
 37%|███▋      | 138461/371472 [10:59:57<17:21:48,  3.73it/s]
 37%|███▋      | 138462/371472 [10:59:57<18:34:09,  3.49it/s]
 37%|███▋      | 138463/371472 [10:59:57<17:25:34,  3.71it/s]
 37%|███▋      | 138464/371472 [10:59:58<17:21:52,  3.73it/s]
 37%|███▋      | 138465/371472 [10:59:58<17:31:08,  3.69it/s]
 37%|███▋      | 138466/371472 [10:59:58<18:32:44,  3.49it/s]
 37%|███▋      | 138467/371472 [10:59:59<18:26:18,  3.51it/s]
 37%|███▋      | 138468/371472 [10:59:59<18:39:28,  3.47it/s]
 37%|███▋      | 138469/371472 [10:59:59<18:19:41,  3.53it/s]
 37%|███▋      | 138470/371472 [10:59:59<18:12:55,  3.55it/s]
 37%|███▋      | 138471/371472 [11:00:00<18:43:25,  3.46it/s]
 37%|███▋      | 138472/371472 [11:00:00<18:26:42,  3.51it/s]
 37%|███▋      | 138473/371472 [11:00:00<17:37:10,  3.67it/s]
 37%|███▋      | 138474/371472 [11:00:01<17:54:57,  3.61it/s]
 37%|███▋      | 138475/371472 [11:00:01<18:28:53,  3.50it/s]
 37%|███▋      | 138476/371472 [11:00:01<18:15:02,  3.55it/s]
 37%|███▋      | 138477/371472 [11:00:01<17:47:10,  3.64it/s]
 37%|███▋      | 138478/371472 [11:00:02<17:38:06,  3.67it/s]
 37%|███▋      | 138479/371472 [11:00:02<17:11:27,  3.76it/s]
 37%|███▋      | 138480/371472 [11:00:02<16:29:21,  3.92it/s]
                                                             
{'loss': 3.1406, 'learning_rate': 6.647956215389255e-07, 'epoch': 5.96}

 37%|███▋      | 138480/371472 [11:00:02<16:29:21,  3.92it/s]
 37%|███▋      | 138481/371472 [11:00:02<17:08:55,  3.77it/s]
 37%|███▋      | 138482/371472 [11:00:03<17:06:13,  3.78it/s]
 37%|███▋      | 138483/371472 [11:00:03<17:20:54,  3.73it/s]
 37%|███▋      | 138484/371472 [11:00:03<17:48:36,  3.63it/s]
 37%|███▋      | 138485/371472 [11:00:04<18:14:50,  3.55it/s]
 37%|███▋      | 138486/371472 [11:00:04<17:42:29,  3.65it/s]
 37%|███▋      | 138487/371472 [11:00:04<16:57:37,  3.82it/s]
 37%|███▋      | 138488/371472 [11:00:04<18:31:43,  3.49it/s]
 37%|███▋      | 138489/371472 [11:00:05<19:44:43,  3.28it/s]
 37%|███▋      | 138490/371472 [11:00:05<18:33:48,  3.49it/s]
 37%|███▋      | 138491/371472 [11:00:05<18:56:44,  3.42it/s]
 37%|███▋      | 138492/371472 [11:00:06<18:27:44,  3.51it/s]
 37%|███▋      | 138493/371472 [11:00:06<18:22:35,  3.52it/s]
 37%|███▋      | 138494/371472 [11:00:06<20:40:19,  3.13it/s]
 37%|███▋      | 138495/371472 [11:00:07<19:31:29,  3.31it/s]
 37%|███▋      | 138496/371472 [11:00:07<19:01:15,  3.40it/s]
 37%|███▋      | 138497/371472 [11:00:07<18:58:19,  3.41it/s]
 37%|███▋      | 138498/371472 [11:00:07<20:13:16,  3.20it/s]
 37%|███▋      | 138499/371472 [11:00:08<18:32:56,  3.49it/s]
 37%|███▋      | 138500/371472 [11:00:08<17:39:23,  3.67it/s]
                                                             
{'loss': 3.0596, 'learning_rate': 6.647471395634467e-07, 'epoch': 5.97}

 37%|███▋      | 138500/371472 [11:00:08<17:39:23,  3.67it/s]
 37%|███▋      | 138501/371472 [11:00:08<18:41:22,  3.46it/s]
 37%|███▋      | 138502/371472 [11:00:09<17:50:45,  3.63it/s]
 37%|███▋      | 138503/371472 [11:00:09<19:01:02,  3.40it/s]
 37%|███▋      | 138504/371472 [11:00:09<18:18:33,  3.53it/s]
 37%|███▋      | 138505/371472 [11:00:09<18:38:15,  3.47it/s]
 37%|███▋      | 138506/371472 [11:00:10<18:36:09,  3.48it/s]
 37%|███▋      | 138507/371472 [11:00:10<20:15:26,  3.19it/s]
 37%|███▋      | 138508/371472 [11:00:10<19:13:09,  3.37it/s]
 37%|███▋      | 138509/371472 [11:00:11<18:28:30,  3.50it/s]
 37%|███▋      | 138510/371472 [11:00:11<18:24:38,  3.51it/s]
 37%|███▋      | 138511/371472 [11:00:11<19:21:15,  3.34it/s]
 37%|███▋      | 138512/371472 [11:00:12<19:45:27,  3.28it/s]
 37%|███▋      | 138513/371472 [11:00:12<19:29:12,  3.32it/s]
 37%|███▋      | 138514/371472 [11:00:12<18:52:56,  3.43it/s]
 37%|███▋      | 138515/371472 [11:00:12<19:19:05,  3.35it/s]
 37%|███▋      | 138516/371472 [11:00:13<19:01:27,  3.40it/s]
 37%|███▋      | 138517/371472 [11:00:13<18:12:25,  3.55it/s]
 37%|███▋      | 138518/371472 [11:00:13<18:04:24,  3.58it/s]
 37%|███▋      | 138519/371472 [11:00:13<17:34:51,  3.68it/s]
 37%|███▋      | 138520/371472 [11:00:14<17:32:40,  3.69it/s]
                                                             
{'loss': 3.0972, 'learning_rate': 6.646986575879679e-07, 'epoch': 5.97}

 37%|███▋      | 138520/371472 [11:00:14<17:32:40,  3.69it/s]
 37%|███▋      | 138521/371472 [11:00:14<17:03:57,  3.79it/s]
 37%|███▋      | 138522/371472 [11:00:14<17:32:14,  3.69it/s]
 37%|███▋      | 138523/371472 [11:00:15<17:30:19,  3.70it/s]
 37%|███▋      | 138524/371472 [11:00:15<17:30:22,  3.70it/s]
 37%|███▋      | 138525/371472 [11:00:15<17:28:28,  3.70it/s]
 37%|███▋      | 138526/371472 [11:00:15<18:23:41,  3.52it/s]
 37%|███▋      | 138527/371472 [11:00:16<18:04:26,  3.58it/s]
 37%|███▋      | 138528/371472 [11:00:16<17:59:59,  3.59it/s]
 37%|███▋      | 138529/371472 [11:00:16<17:52:43,  3.62it/s]
 37%|███▋      | 138530/371472 [11:00:17<18:28:36,  3.50it/s]
 37%|███▋      | 138531/371472 [11:00:17<18:17:26,  3.54it/s]
 37%|███▋      | 138532/371472 [11:00:17<17:43:41,  3.65it/s]
 37%|███▋      | 138533/371472 [11:00:17<17:18:22,  3.74it/s]
 37%|███▋      | 138534/371472 [11:00:18<17:59:45,  3.60it/s]
 37%|███▋      | 138535/371472 [11:00:18<17:39:56,  3.66it/s]
 37%|███▋      | 138536/371472 [11:00:18<20:28:55,  3.16it/s]
 37%|███▋      | 138537/371472 [11:00:19<19:53:32,  3.25it/s]
 37%|███▋      | 138538/371472 [11:00:19<21:10:15,  3.06it/s]
 37%|███▋      | 138539/371472 [11:00:19<20:22:35,  3.18it/s]
 37%|███▋      | 138540/371472 [11:00:19<19:22:55,  3.34it/s]
                                                             
{'loss': 3.3605, 'learning_rate': 6.64650175612489e-07, 'epoch': 5.97}

 37%|███▋      | 138540/371472 [11:00:19<19:22:55,  3.34it/s]
 37%|███▋      | 138541/371472 [11:00:20<18:37:42,  3.47it/s]
 37%|███▋      | 138542/371472 [11:00:20<18:26:27,  3.51it/s]
 37%|███▋      | 138543/371472 [11:00:20<18:09:35,  3.56it/s]
 37%|███▋      | 138544/371472 [11:00:21<19:08:40,  3.38it/s]
 37%|███▋      | 138545/371472 [11:00:21<18:21:30,  3.52it/s]
 37%|███▋      | 138546/371472 [11:00:21<19:00:40,  3.40it/s]
 37%|███▋      | 138547/371472 [11:00:21<19:03:22,  3.40it/s]
 37%|███▋      | 138548/371472 [11:00:22<19:41:18,  3.29it/s]
 37%|███▋      | 138549/371472 [11:00:22<18:15:18,  3.54it/s]
 37%|███▋      | 138550/371472 [11:00:22<18:17:38,  3.54it/s]
 37%|███▋      | 138551/371472 [11:00:23<19:53:49,  3.25it/s]
 37%|███▋      | 138552/371472 [11:00:23<20:16:51,  3.19it/s]
 37%|███▋      | 138553/371472 [11:00:23<19:07:07,  3.38it/s]
 37%|███▋      | 138554/371472 [11:00:24<18:42:58,  3.46it/s]
 37%|███▋      | 138555/371472 [11:00:24<18:11:05,  3.56it/s]
 37%|███▋      | 138556/371472 [11:00:24<17:57:37,  3.60it/s]
 37%|███▋      | 138557/371472 [11:00:24<19:20:57,  3.34it/s]
 37%|███▋      | 138558/371472 [11:00:25<18:05:25,  3.58it/s]
 37%|███▋      | 138559/371472 [11:00:25<18:10:56,  3.56it/s]
 37%|███▋      | 138560/371472 [11:00:25<17:45:59,  3.64it/s]
                                                             
{'loss': 3.0885, 'learning_rate': 6.6460169363701e-07, 'epoch': 5.97}

 37%|███▋      | 138560/371472 [11:00:25<17:45:59,  3.64it/s]
 37%|███▋      | 138561/371472 [11:00:26<20:32:14,  3.15it/s]
 37%|███▋      | 138562/371472 [11:00:26<20:34:21,  3.14it/s]
 37%|███▋      | 138563/371472 [11:00:26<21:02:57,  3.07it/s]
 37%|███▋      | 138564/371472 [11:00:27<19:54:23,  3.25it/s]
 37%|███▋      | 138565/371472 [11:00:27<21:27:58,  3.01it/s]
 37%|███▋      | 138566/371472 [11:00:27<20:43:15,  3.12it/s]
 37%|███▋      | 138567/371472 [11:00:27<19:15:46,  3.36it/s]
 37%|███▋      | 138568/371472 [11:00:28<19:09:23,  3.38it/s]
 37%|███▋      | 138569/371472 [11:00:28<18:44:44,  3.45it/s]
 37%|███▋      | 138570/371472 [11:00:28<18:21:07,  3.53it/s]
 37%|███▋      | 138571/371472 [11:00:29<18:32:22,  3.49it/s]
 37%|███▋      | 138572/371472 [11:00:29<17:35:56,  3.68it/s]
 37%|███▋      | 138573/371472 [11:00:29<17:12:34,  3.76it/s]
 37%|███▋      | 138574/371472 [11:00:29<19:01:15,  3.40it/s]
 37%|███▋      | 138575/371472 [11:00:30<18:11:38,  3.56it/s]
 37%|███▋      | 138576/371472 [11:00:30<18:18:21,  3.53it/s]
 37%|███▋      | 138577/371472 [11:00:30<17:38:16,  3.67it/s]
 37%|███▋      | 138578/371472 [11:00:31<17:33:57,  3.68it/s]
 37%|███▋      | 138579/371472 [11:00:31<17:37:55,  3.67it/s]
 37%|███▋      | 138580/371472 [11:00:31<17:18:06,  3.74it/s]
                                                             
{'loss': 3.2058, 'learning_rate': 6.645532116615311e-07, 'epoch': 5.97}

 37%|███▋      | 138580/371472 [11:00:31<17:18:06,  3.74it/s]
 37%|███▋      | 138581/371472 [11:00:31<16:49:14,  3.85it/s]
 37%|███▋      | 138582/371472 [11:00:32<18:01:53,  3.59it/s]
 37%|███▋      | 138583/371472 [11:00:32<20:10:39,  3.21it/s]
 37%|███▋      | 138584/371472 [11:00:32<18:48:28,  3.44it/s]
 37%|███▋      | 138585/371472 [11:00:33<18:51:20,  3.43it/s]
 37%|███▋      | 138586/371472 [11:00:33<18:44:16,  3.45it/s]
 37%|███▋      | 138587/371472 [11:00:33<18:12:43,  3.55it/s]
 37%|███▋      | 138588/371472 [11:00:33<17:26:06,  3.71it/s]
 37%|███▋      | 138589/371472 [11:00:34<17:05:39,  3.78it/s]
 37%|███▋      | 138590/371472 [11:00:34<16:54:01,  3.83it/s]
 37%|███▋      | 138591/371472 [11:00:34<16:37:52,  3.89it/s]
 37%|███▋      | 138592/371472 [11:00:34<16:27:15,  3.93it/s]
 37%|███▋      | 138593/371472 [11:00:35<18:13:19,  3.55it/s]
 37%|███▋      | 138594/371472 [11:00:35<19:04:42,  3.39it/s]
 37%|███▋      | 138595/371472 [11:00:35<18:20:52,  3.53it/s]
 37%|███▋      | 138596/371472 [11:00:35<17:32:10,  3.69it/s]
 37%|███▋      | 138597/371472 [11:00:36<18:49:29,  3.44it/s]
 37%|███▋      | 138598/371472 [11:00:36<18:14:06,  3.55it/s]
 37%|███▋      | 138599/371472 [11:00:36<17:35:36,  3.68it/s]
 37%|███▋      | 138600/371472 [11:00:37<16:44:12,  3.86it/s]
                                                             
{'loss': 3.2432, 'learning_rate': 6.645047296860523e-07, 'epoch': 5.97}

 37%|███▋      | 138600/371472 [11:00:37<16:44:12,  3.86it/s]
 37%|███▋      | 138601/371472 [11:00:37<16:47:57,  3.85it/s]
 37%|███▋      | 138602/371472 [11:00:37<17:21:23,  3.73it/s]
 37%|███▋      | 138603/371472 [11:00:37<18:35:29,  3.48it/s]
 37%|███▋      | 138604/371472 [11:00:38<20:35:17,  3.14it/s]
 37%|███▋      | 138605/371472 [11:00:38<19:08:56,  3.38it/s]
 37%|███▋      | 138606/371472 [11:00:38<20:47:25,  3.11it/s]
 37%|███▋      | 138607/371472 [11:00:39<20:58:54,  3.08it/s]
 37%|███▋      | 138608/371472 [11:00:39<20:53:26,  3.10it/s]
 37%|███▋      | 138609/371472 [11:00:39<20:33:58,  3.15it/s]
 37%|███▋      | 138610/371472 [11:00:40<20:11:36,  3.20it/s]
 37%|███▋      | 138611/371472 [11:00:40<18:48:41,  3.44it/s]
 37%|███▋      | 138612/371472 [11:00:40<19:14:24,  3.36it/s]
 37%|███▋      | 138613/371472 [11:00:41<18:29:25,  3.50it/s]
 37%|███▋      | 138614/371472 [11:00:41<18:35:45,  3.48it/s]
 37%|███▋      | 138615/371472 [11:00:41<18:30:28,  3.49it/s]
 37%|███▋      | 138616/371472 [11:00:41<18:09:57,  3.56it/s]
 37%|███▋      | 138617/371472 [11:00:42<18:52:39,  3.43it/s]
 37%|███▋      | 138618/371472 [11:00:42<18:34:17,  3.48it/s]
 37%|███▋      | 138619/371472 [11:00:42<17:48:47,  3.63it/s]
 37%|███▋      | 138620/371472 [11:00:42<17:30:07,  3.70it/s]
                                                             
{'loss': 3.0379, 'learning_rate': 6.644562477105732e-07, 'epoch': 5.97}

 37%|███▋      | 138620/371472 [11:00:42<17:30:07,  3.70it/s]
 37%|███▋      | 138621/371472 [11:00:43<18:32:36,  3.49it/s]
 37%|███▋      | 138622/371472 [11:00:43<18:20:53,  3.53it/s]
 37%|███▋      | 138623/371472 [11:00:43<18:10:36,  3.56it/s]
 37%|███▋      | 138624/371472 [11:00:44<17:50:38,  3.62it/s]
 37%|███▋      | 138625/371472 [11:00:44<17:29:30,  3.70it/s]
 37%|███▋      | 138626/371472 [11:00:44<16:54:45,  3.82it/s]
 37%|███▋      | 138627/371472 [11:00:44<16:33:43,  3.91it/s]
 37%|███▋      | 138628/371472 [11:00:45<16:09:20,  4.00it/s]
 37%|███▋      | 138629/371472 [11:00:45<16:19:31,  3.96it/s]
 37%|███▋      | 138630/371472 [11:00:45<16:06:26,  4.02it/s]
 37%|███▋      | 138631/371472 [11:00:45<16:50:07,  3.84it/s]
 37%|███▋      | 138632/371472 [11:00:46<16:38:19,  3.89it/s]
 37%|███▋      | 138633/371472 [11:00:46<17:19:26,  3.73it/s]
 37%|███▋      | 138634/371472 [11:00:46<17:25:26,  3.71it/s]
 37%|███▋      | 138635/371472 [11:00:46<17:04:12,  3.79it/s]
 37%|███▋      | 138636/371472 [11:00:47<17:11:52,  3.76it/s]
 37%|███▋      | 138637/371472 [11:00:47<17:22:18,  3.72it/s]
 37%|███▋      | 138638/371472 [11:00:47<17:25:35,  3.71it/s]
 37%|███▋      | 138639/371472 [11:00:47<16:35:36,  3.90it/s]
 37%|███▋      | 138640/371472 [11:00:48<17:06:07,  3.78it/s]
                                                             
{'loss': 3.1696, 'learning_rate': 6.644077657350944e-07, 'epoch': 5.97}

 37%|███▋      | 138640/371472 [11:00:48<17:06:07,  3.78it/s]
 37%|███▋      | 138641/371472 [11:00:48<17:22:13,  3.72it/s]
 37%|███▋      | 138642/371472 [11:00:48<17:34:53,  3.68it/s]
 37%|███▋      | 138643/371472 [11:00:49<17:21:43,  3.73it/s]
 37%|███▋      | 138644/371472 [11:00:49<17:15:52,  3.75it/s]
 37%|███▋      | 138645/371472 [11:00:49<17:11:50,  3.76it/s]
 37%|███▋      | 138646/371472 [11:00:49<18:59:28,  3.41it/s]
 37%|███▋      | 138647/371472 [11:00:50<18:25:12,  3.51it/s]
 37%|███▋      | 138648/371472 [11:00:50<18:04:52,  3.58it/s]
 37%|███▋      | 138649/371472 [11:00:50<18:01:20,  3.59it/s]
 37%|███▋      | 138650/371472 [11:00:51<17:32:03,  3.69it/s]
 37%|███▋      | 138651/371472 [11:00:51<17:34:12,  3.68it/s]
 37%|███▋      | 138652/371472 [11:00:51<17:08:11,  3.77it/s]
 37%|███▋      | 138653/371472 [11:00:51<16:30:26,  3.92it/s]
 37%|███▋      | 138654/371472 [11:00:52<16:38:32,  3.89it/s]
 37%|███▋      | 138655/371472 [11:00:52<16:25:45,  3.94it/s]
 37%|███▋      | 138656/371472 [11:00:52<16:25:55,  3.94it/s]
 37%|███▋      | 138657/371472 [11:00:52<16:26:32,  3.93it/s]
 37%|███▋      | 138658/371472 [11:00:53<16:37:01,  3.89it/s]
 37%|███▋      | 138659/371472 [11:00:53<16:59:32,  3.81it/s]
 37%|███▋      | 138660/371472 [11:00:53<18:05:22,  3.57it/s]
                                                             
{'loss': 3.1055, 'learning_rate': 6.643592837596156e-07, 'epoch': 5.97}

 37%|███▋      | 138660/371472 [11:00:53<18:05:22,  3.57it/s]
 37%|███▋      | 138661/371472 [11:00:53<17:50:16,  3.63it/s]
 37%|███▋      | 138662/371472 [11:00:54<17:22:24,  3.72it/s]
 37%|███▋      | 138663/371472 [11:00:54<17:44:33,  3.64it/s]
 37%|███▋      | 138664/371472 [11:00:54<17:18:41,  3.74it/s]
 37%|███▋      | 138665/371472 [11:00:55<17:35:19,  3.68it/s]
 37%|███▋      | 138666/371472 [11:00:55<17:46:19,  3.64it/s]
 37%|███▋      | 138667/371472 [11:00:55<16:57:55,  3.81it/s]
 37%|███▋      | 138668/371472 [11:00:55<17:53:39,  3.61it/s]
 37%|███▋      | 138669/371472 [11:00:56<18:49:11,  3.44it/s]
 37%|███▋      | 138670/371472 [11:00:56<18:33:56,  3.48it/s]
 37%|███▋      | 138671/371472 [11:00:56<17:58:16,  3.60it/s]
 37%|███▋      | 138672/371472 [11:00:57<19:03:25,  3.39it/s]
 37%|███▋      | 138673/371472 [11:00:57<18:32:41,  3.49it/s]
 37%|███▋      | 138674/371472 [11:00:57<17:35:50,  3.67it/s]
 37%|███▋      | 138675/371472 [11:00:57<17:29:20,  3.70it/s]
 37%|███▋      | 138676/371472 [11:00:58<17:02:13,  3.80it/s]
 37%|███▋      | 138677/371472 [11:00:58<16:51:37,  3.84it/s]
 37%|███▋      | 138678/371472 [11:00:58<16:45:36,  3.86it/s]
 37%|███▋      | 138679/371472 [11:00:58<17:35:10,  3.68it/s]
 37%|███▋      | 138680/371472 [11:00:59<18:15:36,  3.54it/s]
                                                             
{'loss': 3.1759, 'learning_rate': 6.643108017841368e-07, 'epoch': 5.97}

 37%|███▋      | 138680/371472 [11:00:59<18:15:36,  3.54it/s]
 37%|███▋      | 138681/371472 [11:00:59<17:54:26,  3.61it/s]
 37%|███▋      | 138682/371472 [11:00:59<17:42:46,  3.65it/s]
 37%|███▋      | 138683/371472 [11:01:00<18:36:08,  3.48it/s]
 37%|███▋      | 138684/371472 [11:01:00<17:54:14,  3.61it/s]
 37%|███▋      | 138685/371472 [11:01:00<17:45:22,  3.64it/s]
 37%|███▋      | 138686/371472 [11:01:00<17:19:38,  3.73it/s]
 37%|███▋      | 138687/371472 [11:01:01<17:06:20,  3.78it/s]
 37%|███▋      | 138688/371472 [11:01:01<17:11:15,  3.76it/s]
 37%|███▋      | 138689/371472 [11:01:01<17:00:57,  3.80it/s]
 37%|███▋      | 138690/371472 [11:01:01<18:06:59,  3.57it/s]
 37%|███▋      | 138691/371472 [11:01:02<17:52:48,  3.62it/s]
 37%|███▋      | 138692/371472 [11:01:02<17:08:45,  3.77it/s]
 37%|███▋      | 138693/371472 [11:01:02<16:39:03,  3.88it/s]
 37%|███▋      | 138694/371472 [11:01:02<17:07:59,  3.77it/s]
 37%|███▋      | 138695/371472 [11:01:03<17:57:15,  3.60it/s]
 37%|███▋      | 138696/371472 [11:01:03<19:05:08,  3.39it/s]
 37%|███▋      | 138697/371472 [11:01:03<20:04:16,  3.22it/s]
 37%|███▋      | 138698/371472 [11:01:04<20:12:19,  3.20it/s]
 37%|███▋      | 138699/371472 [11:01:04<19:46:44,  3.27it/s]
 37%|███▋      | 138700/371472 [11:01:04<21:48:31,  2.96it/s]
                                                             
{'loss': 3.0362, 'learning_rate': 6.642623198086577e-07, 'epoch': 5.97}

 37%|███▋      | 138700/371472 [11:01:04<21:48:31,  2.96it/s]
 37%|███▋      | 138701/371472 [11:01:05<21:11:20,  3.05it/s]
 37%|███▋      | 138702/371472 [11:01:05<19:31:53,  3.31it/s]
 37%|███▋      | 138703/371472 [11:01:05<18:09:38,  3.56it/s]
 37%|███▋      | 138704/371472 [11:01:05<18:03:44,  3.58it/s]
 37%|███▋      | 138705/371472 [11:01:06<18:04:35,  3.58it/s]
 37%|███▋      | 138706/371472 [11:01:06<18:02:06,  3.59it/s]
 37%|███▋      | 138707/371472 [11:01:06<18:12:40,  3.55it/s]
 37%|███▋      | 138708/371472 [11:01:07<17:17:18,  3.74it/s]
 37%|███▋      | 138709/371472 [11:01:07<18:21:29,  3.52it/s]
 37%|███▋      | 138710/371472 [11:01:07<19:42:28,  3.28it/s]
 37%|███▋      | 138711/371472 [11:01:07<18:33:58,  3.48it/s]
 37%|███▋      | 138712/371472 [11:01:08<18:25:01,  3.51it/s]
 37%|███▋      | 138713/371472 [11:01:08<19:18:00,  3.35it/s]
 37%|███▋      | 138714/371472 [11:01:08<19:13:02,  3.36it/s]
 37%|███▋      | 138715/371472 [11:01:09<18:42:03,  3.46it/s]
 37%|███▋      | 138716/371472 [11:01:09<19:04:23,  3.39it/s]
 37%|███▋      | 138717/371472 [11:01:09<18:52:44,  3.42it/s]
 37%|███▋      | 138718/371472 [11:01:10<18:15:53,  3.54it/s]
 37%|███▋      | 138719/371472 [11:01:10<18:55:58,  3.41it/s]
 37%|███▋      | 138720/371472 [11:01:10<18:55:35,  3.42it/s]
                                                             
{'loss': 2.9943, 'learning_rate': 6.642138378331788e-07, 'epoch': 5.97}

 37%|███▋      | 138720/371472 [11:01:10<18:55:35,  3.42it/s]
 37%|███▋      | 138721/371472 [11:01:10<18:10:58,  3.56it/s]
 37%|███▋      | 138722/371472 [11:01:11<17:23:26,  3.72it/s]
 37%|███▋      | 138723/371472 [11:01:11<17:02:11,  3.79it/s]
 37%|███▋      | 138724/371472 [11:01:11<16:44:44,  3.86it/s]
 37%|███▋      | 138725/371472 [11:01:11<16:29:26,  3.92it/s]
 37%|███▋      | 138726/371472 [11:01:12<16:42:56,  3.87it/s]
 37%|███▋      | 138727/371472 [11:01:12<17:52:08,  3.62it/s]
 37%|███▋      | 138728/371472 [11:01:12<18:19:02,  3.53it/s]
 37%|███▋      | 138729/371472 [11:01:13<19:16:55,  3.35it/s]
 37%|███▋      | 138730/371472 [11:01:13<18:35:43,  3.48it/s]
 37%|███▋      | 138731/371472 [11:01:13<18:14:16,  3.54it/s]
 37%|███▋      | 138732/371472 [11:01:13<17:58:34,  3.60it/s]
 37%|███▋      | 138733/371472 [11:01:14<17:20:49,  3.73it/s]
 37%|███▋      | 138734/371472 [11:01:14<17:43:47,  3.65it/s]
 37%|███▋      | 138735/371472 [11:01:14<18:08:33,  3.56it/s]
 37%|███▋      | 138736/371472 [11:01:14<18:03:27,  3.58it/s]
 37%|███▋      | 138737/371472 [11:01:15<19:53:07,  3.25it/s]
 37%|███▋      | 138738/371472 [11:01:15<19:01:43,  3.40it/s]
 37%|███▋      | 138739/371472 [11:01:15<18:07:53,  3.57it/s]
 37%|███▋      | 138740/371472 [11:01:16<17:45:12,  3.64it/s]
                                                             
{'loss': 3.248, 'learning_rate': 6.641653558577e-07, 'epoch': 5.98}

 37%|███▋      | 138740/371472 [11:01:16<17:45:12,  3.64it/s]
 37%|███▋      | 138741/371472 [11:01:16<20:14:35,  3.19it/s]
 37%|███▋      | 138742/371472 [11:01:16<21:23:28,  3.02it/s]
 37%|███▋      | 138743/371472 [11:01:17<21:21:26,  3.03it/s]
 37%|███▋      | 138744/371472 [11:01:17<20:21:58,  3.17it/s]
 37%|███▋      | 138745/371472 [11:01:17<20:02:21,  3.23it/s]
 37%|███▋      | 138746/371472 [11:01:18<19:37:28,  3.29it/s]
 37%|███▋      | 138747/371472 [11:01:18<18:49:51,  3.43it/s]
 37%|███▋      | 138748/371472 [11:01:18<18:41:21,  3.46it/s]
 37%|███▋      | 138749/371472 [11:01:18<18:04:02,  3.58it/s]
 37%|███▋      | 138750/371472 [11:01:19<18:07:31,  3.57it/s]
 37%|███▋      | 138751/371472 [11:01:19<17:17:31,  3.74it/s]
 37%|███▋      | 138752/371472 [11:01:19<17:14:56,  3.75it/s]
 37%|███▋      | 138753/371472 [11:01:20<18:20:37,  3.52it/s]
 37%|███▋      | 138754/371472 [11:01:20<18:11:34,  3.55it/s]
 37%|███▋      | 138755/371472 [11:01:20<18:04:30,  3.58it/s]
 37%|███▋      | 138756/371472 [11:01:20<18:12:53,  3.55it/s]
 37%|███▋      | 138757/371472 [11:01:21<17:54:42,  3.61it/s]
 37%|███▋      | 138758/371472 [11:01:21<18:29:49,  3.49it/s]
 37%|███▋      | 138759/371472 [11:01:21<19:45:00,  3.27it/s]
 37%|███▋      | 138760/371472 [11:01:22<19:03:00,  3.39it/s]
                                                             
{'loss': 3.0353, 'learning_rate': 6.641168738822212e-07, 'epoch': 5.98}

 37%|███▋      | 138760/371472 [11:01:22<19:03:00,  3.39it/s]
 37%|███▋      | 138761/371472 [11:01:22<20:11:14,  3.20it/s]
 37%|███▋      | 138762/371472 [11:01:22<19:50:15,  3.26it/s]
 37%|███▋      | 138763/371472 [11:01:23<20:07:39,  3.21it/s]
 37%|███▋      | 138764/371472 [11:01:23<19:37:01,  3.30it/s]
 37%|███▋      | 138765/371472 [11:01:23<18:57:25,  3.41it/s]
 37%|███▋      | 138766/371472 [11:01:23<18:43:26,  3.45it/s]
 37%|███▋      | 138767/371472 [11:01:24<18:21:55,  3.52it/s]
 37%|███▋      | 138768/371472 [11:01:24<18:34:05,  3.48it/s]
 37%|███▋      | 138769/371472 [11:01:24<18:52:22,  3.42it/s]
 37%|███▋      | 138770/371472 [11:01:24<18:13:50,  3.55it/s]
 37%|███▋      | 138771/371472 [11:01:25<17:40:43,  3.66it/s]
 37%|███▋      | 138772/371472 [11:01:25<18:30:22,  3.49it/s]
 37%|███▋      | 138773/371472 [11:01:25<17:59:08,  3.59it/s]
 37%|███▋      | 138774/371472 [11:01:26<17:33:47,  3.68it/s]
 37%|███▋      | 138775/371472 [11:01:26<18:24:36,  3.51it/s]
 37%|███▋      | 138776/371472 [11:01:26<17:47:02,  3.63it/s]
 37%|███▋      | 138777/371472 [11:01:26<17:16:22,  3.74it/s]
 37%|███▋      | 138778/371472 [11:01:27<19:29:53,  3.32it/s]
 37%|███▋      | 138779/371472 [11:01:27<19:09:58,  3.37it/s]
 37%|███▋      | 138780/371472 [11:01:27<19:04:35,  3.39it/s]
                                                             
{'loss': 2.9982, 'learning_rate': 6.640683919067422e-07, 'epoch': 5.98}

 37%|███▋      | 138780/371472 [11:01:27<19:04:35,  3.39it/s]
 37%|███▋      | 138781/371472 [11:01:28<19:09:04,  3.38it/s]
 37%|███▋      | 138782/371472 [11:01:28<18:09:16,  3.56it/s]
 37%|███▋      | 138783/371472 [11:01:28<18:04:58,  3.57it/s]
 37%|███▋      | 138784/371472 [11:01:29<19:26:58,  3.32it/s]
 37%|███▋      | 138785/371472 [11:01:29<19:06:07,  3.38it/s]
 37%|███▋      | 138786/371472 [11:01:29<18:31:07,  3.49it/s]
 37%|███▋      | 138787/371472 [11:01:29<18:52:46,  3.42it/s]
 37%|███▋      | 138788/371472 [11:01:30<18:57:22,  3.41it/s]
 37%|███▋      | 138789/371472 [11:01:30<18:52:57,  3.42it/s]
 37%|███▋      | 138790/371472 [11:01:30<20:40:43,  3.13it/s]
 37%|███▋      | 138791/371472 [11:01:31<20:13:49,  3.19it/s]
 37%|███▋      | 138792/371472 [11:01:31<19:43:04,  3.28it/s]
 37%|███▋      | 138793/371472 [11:01:31<19:38:09,  3.29it/s]
 37%|███▋      | 138794/371472 [11:01:31<18:46:01,  3.44it/s]
 37%|███▋      | 138795/371472 [11:01:32<17:56:11,  3.60it/s]
 37%|███▋      | 138796/371472 [11:01:32<17:44:56,  3.64it/s]
 37%|███▋      | 138797/371472 [11:01:32<18:03:11,  3.58it/s]
 37%|███▋      | 138798/371472 [11:01:33<17:32:27,  3.68it/s]
 37%|███▋      | 138799/371472 [11:01:33<19:13:36,  3.36it/s]
 37%|███▋      | 138800/371472 [11:01:33<18:38:46,  3.47it/s]
                                                             
{'loss': 3.18, 'learning_rate': 6.640199099312633e-07, 'epoch': 5.98}

 37%|███▋      | 138800/371472 [11:01:33<18:38:46,  3.47it/s]
 37%|███▋      | 138801/371472 [11:01:33<18:40:23,  3.46it/s]
 37%|███▋      | 138802/371472 [11:01:34<19:01:37,  3.40it/s]
 37%|███▋      | 138803/371472 [11:01:34<18:39:25,  3.46it/s]
 37%|███▋      | 138804/371472 [11:01:34<17:58:21,  3.60it/s]
 37%|███▋      | 138805/371472 [11:01:35<17:27:33,  3.70it/s]
 37%|███▋      | 138806/371472 [11:01:35<16:53:09,  3.83it/s]
 37%|███▋      | 138807/371472 [11:01:35<17:33:30,  3.68it/s]
 37%|███▋      | 138808/371472 [11:01:35<17:47:36,  3.63it/s]
 37%|███▋      | 138809/371472 [11:01:36<17:44:37,  3.64it/s]
 37%|███▋      | 138810/371472 [11:01:36<18:53:27,  3.42it/s]
 37%|███▋      | 138811/371472 [11:01:36<18:16:11,  3.54it/s]
 37%|███▋      | 138812/371472 [11:01:37<17:57:08,  3.60it/s]
 37%|███▋      | 138813/371472 [11:01:37<18:08:48,  3.56it/s]
 37%|███▋      | 138814/371472 [11:01:37<17:51:21,  3.62it/s]
 37%|███▋      | 138815/371472 [11:01:37<17:06:46,  3.78it/s]
 37%|███▋      | 138816/371472 [11:01:38<16:31:37,  3.91it/s]
 37%|███▋      | 138817/371472 [11:01:38<18:40:02,  3.46it/s]
 37%|███▋      | 138818/371472 [11:01:38<17:41:43,  3.65it/s]
 37%|███▋      | 138819/371472 [11:01:38<17:35:35,  3.67it/s]
 37%|███▋      | 138820/371472 [11:01:39<17:49:18,  3.63it/s]
                                                             
{'loss': 3.1225, 'learning_rate': 6.639714279557844e-07, 'epoch': 5.98}

 37%|███▋      | 138820/371472 [11:01:39<17:49:18,  3.63it/s]
 37%|███▋      | 138821/371472 [11:01:39<17:47:43,  3.63it/s]
 37%|███▋      | 138822/371472 [11:01:39<17:07:27,  3.77it/s]
 37%|███▋      | 138823/371472 [11:01:39<16:57:10,  3.81it/s]
 37%|███▋      | 138824/371472 [11:01:40<17:10:15,  3.76it/s]
 37%|███▋      | 138825/371472 [11:01:40<17:00:02,  3.80it/s]
 37%|███▋      | 138826/371472 [11:01:40<17:18:01,  3.74it/s]
 37%|███▋      | 138827/371472 [11:01:41<17:29:11,  3.70it/s]
 37%|███▋      | 138828/371472 [11:01:41<17:51:20,  3.62it/s]
 37%|███▋      | 138829/371472 [11:01:41<17:48:08,  3.63it/s]
 37%|███▋      | 138830/371472 [11:01:41<18:59:37,  3.40it/s]
 37%|███▋      | 138831/371472 [11:01:42<18:17:08,  3.53it/s]
 37%|███▋      | 138832/371472 [11:01:42<17:47:06,  3.63it/s]
 37%|███▋      | 138833/371472 [11:01:42<18:47:40,  3.44it/s]
 37%|███▋      | 138834/371472 [11:01:43<17:55:31,  3.61it/s]
 37%|███▋      | 138835/371472 [11:01:43<17:18:05,  3.74it/s]
 37%|███▋      | 138836/371472 [11:01:43<17:25:32,  3.71it/s]
 37%|███▋      | 138837/371472 [11:01:43<17:57:55,  3.60it/s]
 37%|███▋      | 138838/371472 [11:01:44<18:41:15,  3.46it/s]
 37%|███▋      | 138839/371472 [11:01:44<21:01:20,  3.07it/s]
 37%|███▋      | 138840/371472 [11:01:44<20:33:05,  3.14it/s]
                                                             
{'loss': 3.0631, 'learning_rate': 6.639229459803056e-07, 'epoch': 5.98}

 37%|███▋      | 138840/371472 [11:01:44<20:33:05,  3.14it/s]
 37%|███▋      | 138841/371472 [11:01:45<21:13:22,  3.04it/s]
 37%|███▋      | 138842/371472 [11:01:45<20:02:42,  3.22it/s]
 37%|███▋      | 138843/371472 [11:01:45<19:36:28,  3.30it/s]
 37%|███▋      | 138844/371472 [11:01:46<20:30:20,  3.15it/s]
 37%|███▋      | 138845/371472 [11:01:46<19:59:36,  3.23it/s]
 37%|███▋      | 138846/371472 [11:01:46<19:06:13,  3.38it/s]
 37%|███▋      | 138847/371472 [11:01:47<19:44:46,  3.27it/s]
 37%|███▋      | 138848/371472 [11:01:47<18:55:31,  3.41it/s]
 37%|███▋      | 138849/371472 [11:01:47<18:11:00,  3.55it/s]
 37%|███▋      | 138850/371472 [11:01:47<17:55:54,  3.60it/s]
 37%|███▋      | 138851/371472 [11:01:48<17:08:23,  3.77it/s]
 37%|███▋      | 138852/371472 [11:01:48<17:16:47,  3.74it/s]
 37%|███▋      | 138853/371472 [11:01:48<19:01:21,  3.40it/s]
 37%|███▋      | 138854/371472 [11:01:48<18:12:10,  3.55it/s]
 37%|███▋      | 138855/371472 [11:01:49<18:16:59,  3.53it/s]
 37%|███▋      | 138856/371472 [11:01:49<18:16:50,  3.53it/s]
 37%|███▋      | 138857/371472 [11:01:49<18:03:11,  3.58it/s]
 37%|███▋      | 138858/371472 [11:01:50<17:27:40,  3.70it/s]
 37%|███▋      | 138859/371472 [11:01:50<17:53:36,  3.61it/s]
 37%|███▋      | 138860/371472 [11:01:50<19:19:49,  3.34it/s]
                                                             
{'loss': 3.1189, 'learning_rate': 6.638744640048266e-07, 'epoch': 5.98}

 37%|███▋      | 138860/371472 [11:01:50<19:19:49,  3.34it/s]
 37%|███▋      | 138861/371472 [11:01:50<19:00:30,  3.40it/s]
 37%|███▋      | 138862/371472 [11:01:51<18:14:48,  3.54it/s]
 37%|███▋      | 138863/371472 [11:01:51<17:29:55,  3.69it/s]
 37%|███▋      | 138864/371472 [11:01:51<16:56:36,  3.81it/s]
 37%|███▋      | 138865/371472 [11:01:52<18:35:54,  3.47it/s]
 37%|███▋      | 138866/371472 [11:01:52<18:04:49,  3.57it/s]
 37%|███▋      | 138867/371472 [11:01:52<17:29:46,  3.69it/s]
 37%|███▋      | 138868/371472 [11:01:52<19:02:50,  3.39it/s]
 37%|███▋      | 138869/371472 [11:01:53<19:32:48,  3.31it/s]
 37%|███▋      | 138870/371472 [11:01:53<19:01:10,  3.40it/s]
 37%|███▋      | 138871/371472 [11:01:53<18:07:40,  3.56it/s]
 37%|███▋      | 138872/371472 [11:01:53<17:47:22,  3.63it/s]
 37%|███▋      | 138873/371472 [11:01:54<18:04:46,  3.57it/s]
 37%|███▋      | 138874/371472 [11:01:54<18:15:44,  3.54it/s]
 37%|███▋      | 138875/371472 [11:01:54<18:06:53,  3.57it/s]
 37%|███▋      | 138876/371472 [11:01:55<17:48:34,  3.63it/s]
 37%|███▋      | 138877/371472 [11:01:55<20:48:30,  3.10it/s]
 37%|███▋      | 138878/371472 [11:01:55<20:46:36,  3.11it/s]
 37%|███▋      | 138879/371472 [11:01:56<19:19:14,  3.34it/s]
 37%|███▋      | 138880/371472 [11:01:56<19:03:54,  3.39it/s]
                                                             
{'loss': 3.0192, 'learning_rate': 6.638259820293477e-07, 'epoch': 5.98}

 37%|███▋      | 138880/371472 [11:01:56<19:03:54,  3.39it/s]
 37%|███▋      | 138881/371472 [11:01:56<18:13:21,  3.55it/s]
 37%|███▋      | 138882/371472 [11:01:56<18:10:02,  3.56it/s]
 37%|███▋      | 138883/371472 [11:01:57<17:55:23,  3.60it/s]
 37%|███▋      | 138884/371472 [11:01:57<17:54:09,  3.61it/s]
 37%|███▋      | 138885/371472 [11:01:57<17:25:53,  3.71it/s]
 37%|███▋      | 138886/371472 [11:01:57<17:18:45,  3.73it/s]
 37%|███▋      | 138887/371472 [11:01:58<17:15:28,  3.74it/s]
 37%|███▋      | 138888/371472 [11:01:58<18:01:01,  3.59it/s]
 37%|███▋      | 138889/371472 [11:01:58<17:25:54,  3.71it/s]
 37%|███▋      | 138890/371472 [11:01:59<18:56:36,  3.41it/s]
 37%|███▋      | 138891/371472 [11:01:59<18:09:09,  3.56it/s]
 37%|███▋      | 138892/371472 [11:01:59<18:03:47,  3.58it/s]
 37%|███▋      | 138893/371472 [11:01:59<18:15:37,  3.54it/s]
 37%|███▋      | 138894/371472 [11:02:00<17:39:05,  3.66it/s]
 37%|███▋      | 138895/371472 [11:02:00<17:44:37,  3.64it/s]
 37%|███▋      | 138896/371472 [11:02:00<18:52:27,  3.42it/s]
 37%|███▋      | 138897/371472 [11:02:01<18:52:58,  3.42it/s]
 37%|███▋      | 138898/371472 [11:02:01<18:43:19,  3.45it/s]
 37%|███▋      | 138899/371472 [11:02:01<19:11:31,  3.37it/s]
 37%|███▋      | 138900/371472 [11:02:02<18:54:49,  3.42it/s]
                                                             
{'loss': 3.21, 'learning_rate': 6.637775000538689e-07, 'epoch': 5.98}

 37%|███▋      | 138900/371472 [11:02:02<18:54:49,  3.42it/s]
 37%|███▋      | 138901/371472 [11:02:02<18:28:15,  3.50it/s]
 37%|███▋      | 138902/371472 [11:02:02<18:58:06,  3.41it/s]
 37%|███▋      | 138903/371472 [11:02:02<18:27:12,  3.50it/s]
 37%|███▋      | 138904/371472 [11:02:03<18:51:32,  3.43it/s]
 37%|███▋      | 138905/371472 [11:02:03<17:41:30,  3.65it/s]
 37%|███▋      | 138906/371472 [11:02:03<18:02:25,  3.58it/s]
 37%|███▋      | 138907/371472 [11:02:03<17:42:54,  3.65it/s]
 37%|███▋      | 138908/371472 [11:02:04<18:49:50,  3.43it/s]
 37%|███▋      | 138909/371472 [11:02:04<21:14:47,  3.04it/s]
 37%|███▋      | 138910/371472 [11:02:04<20:13:11,  3.19it/s]
 37%|███▋      | 138911/371472 [11:02:05<19:42:33,  3.28it/s]
 37%|███▋      | 138912/371472 [11:02:05<18:57:53,  3.41it/s]
 37%|███▋      | 138913/371472 [11:02:05<19:01:19,  3.40it/s]
 37%|███▋      | 138914/371472 [11:02:06<19:15:12,  3.36it/s]
 37%|███▋      | 138915/371472 [11:02:06<18:27:36,  3.50it/s]
 37%|███▋      | 138916/371472 [11:02:06<18:00:22,  3.59it/s]
 37%|███▋      | 138917/371472 [11:02:06<17:38:24,  3.66it/s]
 37%|███▋      | 138918/371472 [11:02:07<17:37:11,  3.67it/s]
 37%|███▋      | 138919/371472 [11:02:07<17:32:29,  3.68it/s]
 37%|███▋      | 138920/371472 [11:02:07<19:22:46,  3.33it/s]
                                                             
{'loss': 3.3042, 'learning_rate': 6.6372901807839e-07, 'epoch': 5.98}

 37%|███▋      | 138920/371472 [11:02:07<19:22:46,  3.33it/s]
 37%|███▋      | 138921/371472 [11:02:08<18:24:40,  3.51it/s]
 37%|███▋      | 138922/371472 [11:02:08<17:42:11,  3.65it/s]
 37%|███▋      | 138923/371472 [11:02:08<17:02:25,  3.79it/s]
 37%|███▋      | 138924/371472 [11:02:08<17:57:26,  3.60it/s]
 37%|███▋      | 138925/371472 [11:02:09<17:55:40,  3.60it/s]
 37%|███▋      | 138926/371472 [11:02:09<17:23:29,  3.71it/s]
 37%|███▋      | 138927/371472 [11:02:09<17:49:58,  3.62it/s]
 37%|███▋      | 138928/371472 [11:02:10<18:42:17,  3.45it/s]
 37%|███▋      | 138929/371472 [11:02:10<17:47:12,  3.63it/s]
 37%|███▋      | 138930/371472 [11:02:10<19:50:16,  3.26it/s]
 37%|███▋      | 138931/371472 [11:02:10<19:43:28,  3.27it/s]
 37%|███▋      | 138932/371472 [11:02:11<21:01:00,  3.07it/s]
 37%|███▋      | 138933/371472 [11:02:11<19:30:00,  3.31it/s]
 37%|███▋      | 138934/371472 [11:02:11<18:36:26,  3.47it/s]
 37%|███▋      | 138935/371472 [11:02:12<18:43:56,  3.45it/s]
 37%|███▋      | 138936/371472 [11:02:12<18:22:33,  3.52it/s]
 37%|███▋      | 138937/371472 [11:02:12<18:12:01,  3.55it/s]
 37%|███▋      | 138938/371472 [11:02:12<17:33:30,  3.68it/s]
 37%|███▋      | 138939/371472 [11:02:13<17:53:53,  3.61it/s]
 37%|███▋      | 138940/371472 [11:02:13<17:17:09,  3.74it/s]
                                                             
{'loss': 3.2292, 'learning_rate': 6.63680536102911e-07, 'epoch': 5.98}

 37%|███▋      | 138940/371472 [11:02:13<17:17:09,  3.74it/s]
 37%|███▋      | 138941/371472 [11:02:13<19:42:53,  3.28it/s]
 37%|███▋      | 138942/371472 [11:02:14<19:56:18,  3.24it/s]
 37%|███▋      | 138943/371472 [11:02:14<19:55:11,  3.24it/s]
 37%|███▋      | 138944/371472 [11:02:14<19:28:31,  3.32it/s]
 37%|███▋      | 138945/371472 [11:02:15<19:17:20,  3.35it/s]
 37%|███▋      | 138946/371472 [11:02:15<20:26:39,  3.16it/s]
 37%|███▋      | 138947/371472 [11:02:15<19:15:54,  3.35it/s]
 37%|███▋      | 138948/371472 [11:02:15<19:34:25,  3.30it/s]
 37%|███▋      | 138949/371472 [11:02:16<19:20:57,  3.34it/s]
 37%|███▋      | 138950/371472 [11:02:16<19:16:40,  3.35it/s]
 37%|███▋      | 138951/371472 [11:02:16<18:42:23,  3.45it/s]
 37%|███▋      | 138952/371472 [11:02:17<17:45:52,  3.64it/s]
 37%|███▋      | 138953/371472 [11:02:17<16:50:55,  3.83it/s]
 37%|███▋      | 138954/371472 [11:02:17<16:49:20,  3.84it/s]
 37%|███▋      | 138955/371472 [11:02:17<17:11:50,  3.76it/s]
 37%|███▋      | 138956/371472 [11:02:18<17:35:59,  3.67it/s]
 37%|███▋      | 138957/371472 [11:02:18<18:05:25,  3.57it/s]
 37%|███▋      | 138958/371472 [11:02:18<18:13:07,  3.55it/s]
 37%|███▋      | 138959/371472 [11:02:18<17:53:04,  3.61it/s]
 37%|███▋      | 138960/371472 [11:02:19<18:26:36,  3.50it/s]
                                                             
{'loss': 3.1658, 'learning_rate': 6.636320541274321e-07, 'epoch': 5.99}

 37%|███▋      | 138960/371472 [11:02:19<18:26:36,  3.50it/s]
 37%|███▋      | 138961/371472 [11:02:19<18:40:18,  3.46it/s]
 37%|███▋      | 138962/371472 [11:02:19<18:28:25,  3.50it/s]
 37%|███▋      | 138963/371472 [11:02:20<17:22:11,  3.72it/s]
 37%|███▋      | 138964/371472 [11:02:20<17:45:50,  3.64it/s]
 37%|███▋      | 138965/371472 [11:02:20<17:57:05,  3.60it/s]
 37%|███▋      | 138966/371472 [11:02:20<17:53:04,  3.61it/s]
 37%|███▋      | 138967/371472 [11:02:21<17:41:28,  3.65it/s]
 37%|███▋      | 138968/371472 [11:02:21<17:47:57,  3.63it/s]
 37%|███▋      | 138969/371472 [11:02:21<18:22:37,  3.51it/s]
 37%|███▋      | 138970/371472 [11:02:22<18:44:00,  3.45it/s]
 37%|███▋      | 138971/371472 [11:02:22<17:29:30,  3.69it/s]
 37%|███▋      | 138972/371472 [11:02:22<17:12:52,  3.75it/s]
 37%|███▋      | 138973/371472 [11:02:22<16:43:05,  3.86it/s]
 37%|███▋      | 138974/371472 [11:02:23<17:06:12,  3.78it/s]
 37%|███▋      | 138975/371472 [11:02:23<16:34:42,  3.90it/s]
 37%|███▋      | 138976/371472 [11:02:23<16:53:36,  3.82it/s]
 37%|███▋      | 138977/371472 [11:02:23<17:30:04,  3.69it/s]
 37%|███▋      | 138978/371472 [11:02:24<17:25:10,  3.71it/s]
 37%|███▋      | 138979/371472 [11:02:24<18:35:52,  3.47it/s]
 37%|███▋      | 138980/371472 [11:02:24<18:06:35,  3.57it/s]
                                                             
{'loss': 3.2374, 'learning_rate': 6.635835721519533e-07, 'epoch': 5.99}

 37%|███▋      | 138980/371472 [11:02:24<18:06:35,  3.57it/s]
 37%|███▋      | 138981/371472 [11:02:25<18:45:06,  3.44it/s]
 37%|███▋      | 138982/371472 [11:02:25<19:00:21,  3.40it/s]
 37%|███▋      | 138983/371472 [11:02:25<19:04:19,  3.39it/s]
 37%|███▋      | 138984/371472 [11:02:25<18:59:25,  3.40it/s]
 37%|███▋      | 138985/371472 [11:02:26<18:21:59,  3.52it/s]
 37%|███▋      | 138986/371472 [11:02:26<18:16:43,  3.53it/s]
 37%|███▋      | 138987/371472 [11:02:26<17:32:29,  3.68it/s]
 37%|███▋      | 138988/371472 [11:02:26<17:18:45,  3.73it/s]
 37%|███▋      | 138989/371472 [11:02:27<16:41:13,  3.87it/s]
 37%|███▋      | 138990/371472 [11:02:27<16:31:15,  3.91it/s]
 37%|███▋      | 138991/371472 [11:02:27<16:56:25,  3.81it/s]
 37%|███▋      | 138992/371472 [11:02:27<16:24:40,  3.93it/s]
 37%|███▋      | 138993/371472 [11:02:28<17:36:42,  3.67it/s]
 37%|███▋      | 138994/371472 [11:02:28<16:57:27,  3.81it/s]
 37%|███▋      | 138995/371472 [11:02:28<16:56:15,  3.81it/s]
 37%|███▋      | 138996/371472 [11:02:29<17:19:47,  3.73it/s]
 37%|███▋      | 138997/371472 [11:02:29<16:37:42,  3.88it/s]
 37%|███▋      | 138998/371472 [11:02:29<16:57:40,  3.81it/s]
 37%|███▋      | 138999/371472 [11:02:29<16:45:43,  3.85it/s]
 37%|███▋      | 139000/371472 [11:02:30<17:43:54,  3.64it/s]
                                                             
{'loss': 3.0771, 'learning_rate': 6.635350901764743e-07, 'epoch': 5.99}

 37%|███▋      | 139000/371472 [11:02:30<17:43:54,  3.64it/s]
 37%|███▋      | 139001/371472 [11:02:30<18:22:33,  3.51it/s]
 37%|███▋      | 139002/371472 [11:02:30<18:07:47,  3.56it/s]
 37%|███▋      | 139003/371472 [11:02:30<17:13:51,  3.75it/s]
 37%|███▋      | 139004/371472 [11:02:31<16:58:55,  3.80it/s]
 37%|███▋      | 139005/371472 [11:02:31<17:00:42,  3.80it/s]
 37%|███▋      | 139006/371472 [11:02:31<16:58:03,  3.81it/s]
 37%|███▋      | 139007/371472 [11:02:32<19:22:46,  3.33it/s]
 37%|███▋      | 139008/371472 [11:02:32<19:58:56,  3.23it/s]
 37%|███▋      | 139009/371472 [11:02:32<19:10:02,  3.37it/s]
 37%|███▋      | 139010/371472 [11:02:32<18:27:54,  3.50it/s]
 37%|███▋      | 139011/371472 [11:02:33<18:56:45,  3.41it/s]
 37%|███▋      | 139012/371472 [11:02:33<18:35:50,  3.47it/s]
 37%|███▋      | 139013/371472 [11:02:33<18:54:57,  3.41it/s]
 37%|███▋      | 139014/371472 [11:02:34<18:47:35,  3.44it/s]
 37%|███▋      | 139015/371472 [11:02:34<18:29:21,  3.49it/s]
 37%|███▋      | 139016/371472 [11:02:34<17:51:44,  3.61it/s]
 37%|███▋      | 139017/371472 [11:02:35<19:02:26,  3.39it/s]
 37%|███▋      | 139018/371472 [11:02:35<17:58:01,  3.59it/s]
 37%|███▋      | 139019/371472 [11:02:35<18:52:28,  3.42it/s]
 37%|███▋      | 139020/371472 [11:02:35<18:04:30,  3.57it/s]
                                                             
{'loss': 3.0023, 'learning_rate': 6.634866082009954e-07, 'epoch': 5.99}

 37%|███▋      | 139020/371472 [11:02:35<18:04:30,  3.57it/s]
 37%|███▋      | 139021/371472 [11:02:36<18:08:46,  3.56it/s]
 37%|███▋      | 139022/371472 [11:02:36<19:14:19,  3.36it/s]
 37%|███▋      | 139023/371472 [11:02:36<18:46:47,  3.44it/s]
 37%|███▋      | 139024/371472 [11:02:37<18:13:40,  3.54it/s]
 37%|███▋      | 139025/371472 [11:02:37<17:42:51,  3.64it/s]
 37%|███▋      | 139026/371472 [11:02:37<17:40:46,  3.65it/s]
 37%|███▋      | 139027/371472 [11:02:37<17:40:14,  3.65it/s]
 37%|███▋      | 139028/371472 [11:02:38<18:00:40,  3.58it/s]
 37%|███▋      | 139029/371472 [11:02:38<18:18:43,  3.53it/s]
 37%|███▋      | 139030/371472 [11:02:38<19:51:33,  3.25it/s]
 37%|███▋      | 139031/371472 [11:02:38<18:22:09,  3.51it/s]
 37%|███▋      | 139032/371472 [11:02:39<18:22:52,  3.51it/s]
 37%|███▋      | 139033/371472 [11:02:39<20:27:11,  3.16it/s]
 37%|███▋      | 139034/371472 [11:02:40<22:01:41,  2.93it/s]
 37%|███▋      | 139035/371472 [11:02:40<20:50:47,  3.10it/s]
 37%|███▋      | 139036/371472 [11:02:40<19:42:50,  3.28it/s]
 37%|███▋      | 139037/371472 [11:02:40<20:55:55,  3.08it/s]
 37%|███▋      | 139038/371472 [11:02:41<19:32:51,  3.30it/s]
 37%|███▋      | 139039/371472 [11:02:41<18:25:44,  3.50it/s]
 37%|███▋      | 139040/371472 [11:02:41<20:50:04,  3.10it/s]
                                                             
{'loss': 3.1219, 'learning_rate': 6.634381262255166e-07, 'epoch': 5.99}

 37%|███▋      | 139040/371472 [11:02:41<20:50:04,  3.10it/s]
 37%|███▋      | 139041/371472 [11:02:42<20:56:55,  3.08it/s]
 37%|███▋      | 139042/371472 [11:02:42<19:18:10,  3.34it/s]
 37%|███▋      | 139043/371472 [11:02:42<18:09:19,  3.56it/s]
 37%|███▋      | 139044/371472 [11:02:42<17:55:49,  3.60it/s]
 37%|███▋      | 139045/371472 [11:02:43<17:40:48,  3.65it/s]
 37%|███▋      | 139046/371472 [11:02:43<17:45:22,  3.64it/s]
 37%|███▋      | 139047/371472 [11:02:43<17:40:53,  3.65it/s]
 37%|███▋      | 139048/371472 [11:02:44<17:21:47,  3.72it/s]
 37%|███▋      | 139049/371472 [11:02:44<17:06:03,  3.78it/s]
 37%|███▋      | 139050/371472 [11:02:44<17:17:29,  3.73it/s]
 37%|███▋      | 139051/371472 [11:02:44<17:47:41,  3.63it/s]
 37%|███▋      | 139052/371472 [11:02:45<17:34:30,  3.67it/s]
 37%|███▋      | 139053/371472 [11:02:45<17:48:58,  3.62it/s]
 37%|███▋      | 139054/371472 [11:02:45<17:38:47,  3.66it/s]
 37%|███▋      | 139055/371472 [11:02:46<19:13:09,  3.36it/s]
 37%|███▋      | 139056/371472 [11:02:46<18:22:15,  3.51it/s]
 37%|███▋      | 139057/371472 [11:02:46<18:09:19,  3.56it/s]
 37%|███▋      | 139058/371472 [11:02:46<17:42:59,  3.64it/s]
 37%|███▋      | 139059/371472 [11:02:47<17:24:58,  3.71it/s]
 37%|███▋      | 139060/371472 [11:02:47<17:43:53,  3.64it/s]
                                                             
{'loss': 3.0883, 'learning_rate': 6.633896442500378e-07, 'epoch': 5.99}

 37%|███▋      | 139060/371472 [11:02:47<17:43:53,  3.64it/s]
 37%|███▋      | 139061/371472 [11:02:47<18:11:47,  3.55it/s]
 37%|███▋      | 139062/371472 [11:02:47<17:41:45,  3.65it/s]
 37%|███▋      | 139063/371472 [11:02:48<17:51:12,  3.62it/s]
 37%|███▋      | 139064/371472 [11:02:48<18:11:55,  3.55it/s]
 37%|███▋      | 139065/371472 [11:02:48<17:48:12,  3.63it/s]
 37%|███▋      | 139066/371472 [11:02:49<18:39:11,  3.46it/s]
 37%|███▋      | 139067/371472 [11:02:49<17:50:10,  3.62it/s]
 37%|███▋      | 139068/371472 [11:02:49<17:55:53,  3.60it/s]
 37%|███▋      | 139069/371472 [11:02:49<18:02:30,  3.58it/s]
 37%|███▋      | 139070/371472 [11:02:50<17:40:08,  3.65it/s]
 37%|███▋      | 139071/371472 [11:02:50<17:02:36,  3.79it/s]
 37%|███▋      | 139072/371472 [11:02:50<17:00:08,  3.80it/s]
 37%|███▋      | 139073/371472 [11:02:50<17:45:45,  3.63it/s]
 37%|███▋      | 139074/371472 [11:02:51<19:44:54,  3.27it/s]
 37%|███▋      | 139075/371472 [11:02:51<19:51:19,  3.25it/s]
 37%|███▋      | 139076/371472 [11:02:51<18:41:48,  3.45it/s]
 37%|███▋      | 139077/371472 [11:02:52<17:41:41,  3.65it/s]
 37%|███▋      | 139078/371472 [11:02:52<17:33:55,  3.68it/s]
 37%|███▋      | 139079/371472 [11:02:52<18:13:41,  3.54it/s]
 37%|███▋      | 139080/371472 [11:02:53<18:36:00,  3.47it/s]
                                                             
{'loss': 3.1024, 'learning_rate': 6.633411622745587e-07, 'epoch': 5.99}

 37%|███▋      | 139080/371472 [11:02:53<18:36:00,  3.47it/s]
 37%|███▋      | 139081/371472 [11:02:53<20:31:15,  3.15it/s]
 37%|███▋      | 139082/371472 [11:02:53<19:06:32,  3.38it/s]
 37%|███▋      | 139083/371472 [11:02:53<19:35:56,  3.29it/s]
 37%|███▋      | 139084/371472 [11:02:54<19:41:49,  3.28it/s]
 37%|███▋      | 139085/371472 [11:02:54<21:11:39,  3.05it/s]
 37%|███▋      | 139086/371472 [11:02:54<19:30:32,  3.31it/s]
 37%|███▋      | 139087/371472 [11:02:55<18:32:17,  3.48it/s]
 37%|███▋      | 139088/371472 [11:02:55<18:21:01,  3.52it/s]
 37%|███▋      | 139089/371472 [11:02:55<17:48:20,  3.63it/s]
 37%|███▋      | 139090/371472 [11:02:55<18:00:33,  3.58it/s]
 37%|███▋      | 139091/371472 [11:02:56<18:04:57,  3.57it/s]
 37%|███▋      | 139092/371472 [11:02:56<17:27:48,  3.70it/s]
 37%|███▋      | 139093/371472 [11:02:56<18:24:41,  3.51it/s]
 37%|███▋      | 139094/371472 [11:02:57<18:07:26,  3.56it/s]
 37%|███▋      | 139095/371472 [11:02:57<18:02:20,  3.58it/s]
 37%|███▋      | 139096/371472 [11:02:57<19:12:07,  3.36it/s]
 37%|███▋      | 139097/371472 [11:02:57<18:40:51,  3.46it/s]
 37%|███▋      | 139098/371472 [11:02:58<18:03:21,  3.57it/s]
 37%|███▋      | 139099/371472 [11:02:58<19:04:38,  3.38it/s]
 37%|███▋      | 139100/371472 [11:02:58<18:23:03,  3.51it/s]
                                                             
{'loss': 3.1098, 'learning_rate': 6.632926802990798e-07, 'epoch': 5.99}

 37%|███▋      | 139100/371472 [11:02:58<18:23:03,  3.51it/s]
 37%|███▋      | 139101/371472 [11:02:59<17:59:19,  3.59it/s]
 37%|███▋      | 139102/371472 [11:02:59<17:49:38,  3.62it/s]
 37%|███▋      | 139103/371472 [11:02:59<17:34:18,  3.67it/s]
 37%|███▋      | 139104/371472 [11:02:59<17:00:28,  3.80it/s]
 37%|███▋      | 139105/371472 [11:03:00<16:38:51,  3.88it/s]
 37%|███▋      | 139106/371472 [11:03:00<17:08:30,  3.77it/s]
 37%|███▋      | 139107/371472 [11:03:00<18:14:54,  3.54it/s]
 37%|███▋      | 139108/371472 [11:03:01<19:48:27,  3.26it/s]
 37%|███▋      | 139109/371472 [11:03:01<19:37:41,  3.29it/s]
 37%|███▋      | 139110/371472 [11:03:01<18:33:02,  3.48it/s]
 37%|███▋      | 139111/371472 [11:03:01<17:33:34,  3.68it/s]
 37%|███▋      | 139112/371472 [11:03:02<17:19:04,  3.73it/s]
 37%|███▋      | 139113/371472 [11:03:02<18:03:18,  3.57it/s]
 37%|███▋      | 139114/371472 [11:03:02<17:47:35,  3.63it/s]
 37%|███▋      | 139115/371472 [11:03:02<17:30:13,  3.69it/s]
 37%|███▋      | 139116/371472 [11:03:03<17:30:40,  3.69it/s]
 37%|███▋      | 139117/371472 [11:03:03<17:51:57,  3.61it/s]
 37%|███▋      | 139118/371472 [11:03:03<17:29:12,  3.69it/s]
 37%|███▋      | 139119/371472 [11:03:04<17:09:21,  3.76it/s]
 37%|███▋      | 139120/371472 [11:03:04<17:30:39,  3.69it/s]
                                                             
{'loss': 3.1583, 'learning_rate': 6.63244198323601e-07, 'epoch': 5.99}

 37%|███▋      | 139120/371472 [11:03:04<17:30:39,  3.69it/s]
 37%|███▋      | 139121/371472 [11:03:04<17:36:37,  3.66it/s]
 37%|███▋      | 139122/371472 [11:03:04<17:23:45,  3.71it/s]
 37%|███▋      | 139123/371472 [11:03:05<16:33:36,  3.90it/s]
 37%|███▋      | 139124/371472 [11:03:05<18:43:50,  3.45it/s]
 37%|███▋      | 139125/371472 [11:03:05<18:37:41,  3.46it/s]
 37%|███▋      | 139126/371472 [11:03:06<18:55:54,  3.41it/s]
 37%|███▋      | 139127/371472 [11:03:06<18:27:34,  3.50it/s]
 37%|███▋      | 139128/371472 [11:03:06<17:48:07,  3.63it/s]
 37%|███▋      | 139129/371472 [11:03:06<19:31:55,  3.30it/s]
 37%|███▋      | 139130/371472 [11:03:07<18:32:01,  3.48it/s]
 37%|███▋      | 139131/371472 [11:03:07<17:55:49,  3.60it/s]
 37%|███▋      | 139132/371472 [11:03:07<17:48:02,  3.63it/s]
 37%|███▋      | 139133/371472 [11:03:07<18:23:21,  3.51it/s]
 37%|███▋      | 139134/371472 [11:03:08<18:34:15,  3.48it/s]
 37%|███▋      | 139135/371472 [11:03:08<20:36:00,  3.13it/s]
 37%|███▋      | 139136/371472 [11:03:08<20:00:50,  3.22it/s]
 37%|███▋      | 139137/371472 [11:03:09<18:33:12,  3.48it/s]
 37%|███▋      | 139138/371472 [11:03:09<18:00:40,  3.58it/s]
 37%|███▋      | 139139/371472 [11:03:09<20:26:23,  3.16it/s]
 37%|███▋      | 139140/371472 [11:03:10<19:21:45,  3.33it/s]
                                                             
{'loss': 3.2578, 'learning_rate': 6.63195716348122e-07, 'epoch': 5.99}

 37%|███▋      | 139140/371472 [11:03:10<19:21:45,  3.33it/s]
 37%|███▋      | 139141/371472 [11:03:10<18:30:37,  3.49it/s]
 37%|███▋      | 139142/371472 [11:03:10<17:59:24,  3.59it/s]
 37%|███▋      | 139143/371472 [11:03:10<17:08:19,  3.77it/s]
 37%|███▋      | 139144/371472 [11:03:11<19:26:14,  3.32it/s]
 37%|███▋      | 139145/371472 [11:03:11<18:24:37,  3.51it/s]
 37%|███▋      | 139146/371472 [11:03:11<17:54:10,  3.60it/s]
 37%|███▋      | 139147/371472 [11:03:12<17:13:54,  3.75it/s]
 37%|███▋      | 139148/371472 [11:03:12<18:19:16,  3.52it/s]
 37%|███▋      | 139149/371472 [11:03:12<18:06:32,  3.56it/s]
 37%|███▋      | 139150/371472 [11:03:12<17:34:36,  3.67it/s]
 37%|███▋      | 139151/371472 [11:03:13<17:11:40,  3.75it/s]
 37%|███▋      | 139152/371472 [11:03:13<16:26:07,  3.93it/s]
 37%|███▋      | 139153/371472 [11:03:13<16:26:49,  3.92it/s]
 37%|███▋      | 139154/371472 [11:03:13<17:31:00,  3.68it/s]
 37%|███▋      | 139155/371472 [11:03:14<18:00:39,  3.58it/s]
 37%|███▋      | 139156/371472 [11:03:14<17:33:41,  3.67it/s]
 37%|███▋      | 139157/371472 [11:03:14<17:39:34,  3.65it/s]
 37%|███▋      | 139158/371472 [11:03:15<18:09:57,  3.55it/s]
 37%|███▋      | 139159/371472 [11:03:15<17:15:43,  3.74it/s]
 37%|███▋      | 139160/371472 [11:03:15<17:20:30,  3.72it/s]
                                                             
{'loss': 2.9869, 'learning_rate': 6.631472343726432e-07, 'epoch': 5.99}

 37%|███▋      | 139160/371472 [11:03:15<17:20:30,  3.72it/s]
 37%|███▋      | 139161/371472 [11:03:15<17:45:26,  3.63it/s]
 37%|███▋      | 139162/371472 [11:03:16<17:23:53,  3.71it/s]
 37%|███▋      | 139163/371472 [11:03:16<17:31:03,  3.68it/s]
 37%|███▋      | 139164/371472 [11:03:16<17:20:54,  3.72it/s]
 37%|███▋      | 139165/371472 [11:03:16<16:51:56,  3.83it/s]
 37%|███▋      | 139166/371472 [11:03:17<16:30:29,  3.91it/s]
 37%|███▋      | 139167/371472 [11:03:17<16:52:02,  3.83it/s]
 37%|███▋      | 139168/371472 [11:03:17<18:02:12,  3.58it/s]
 37%|███▋      | 139169/371472 [11:03:17<17:33:44,  3.67it/s]
 37%|███▋      | 139170/371472 [11:03:18<17:39:39,  3.65it/s]
 37%|███▋      | 139171/371472 [11:03:18<17:22:05,  3.72it/s]
 37%|███▋      | 139172/371472 [11:03:18<17:38:59,  3.66it/s]
 37%|███▋      | 139173/371472 [11:03:19<17:05:43,  3.77it/s]
 37%|███▋      | 139174/371472 [11:03:19<16:30:41,  3.91it/s]
 37%|███▋      | 139175/371472 [11:03:19<16:31:47,  3.90it/s]
 37%|███▋      | 139176/371472 [11:03:19<18:22:39,  3.51it/s]
 37%|███▋      | 139177/371472 [11:03:20<19:36:04,  3.29it/s]
 37%|███▋      | 139178/371472 [11:03:20<19:00:55,  3.39it/s]
 37%|███▋      | 139179/371472 [11:03:20<18:42:43,  3.45it/s]
 37%|███▋      | 139180/371472 [11:03:21<18:59:05,  3.40it/s]
                                                             
{'loss': 3.0814, 'learning_rate': 6.630987523971643e-07, 'epoch': 5.99}

 37%|███▋      | 139180/371472 [11:03:21<18:59:05,  3.40it/s]
 37%|███▋      | 139181/371472 [11:03:21<18:39:03,  3.46it/s]
 37%|███▋      | 139182/371472 [11:03:21<18:37:58,  3.46it/s]
 37%|███▋      | 139183/371472 [11:03:21<17:53:21,  3.61it/s]
 37%|███▋      | 139184/371472 [11:03:22<18:11:51,  3.55it/s]
 37%|███▋      | 139185/371472 [11:03:22<17:28:56,  3.69it/s]
 37%|███▋      | 139186/371472 [11:03:22<18:04:34,  3.57it/s]
 37%|███▋      | 139187/371472 [11:03:23<18:01:18,  3.58it/s]
 37%|███▋      | 139188/371472 [11:03:23<19:31:27,  3.30it/s]
 37%|███▋      | 139189/371472 [11:03:23<18:15:48,  3.53it/s]
 37%|███▋      | 139190/371472 [11:03:23<17:15:13,  3.74it/s]
 37%|███▋      | 139191/371472 [11:03:24<17:08:45,  3.76it/s]
 37%|███▋      | 139192/371472 [11:03:24<17:27:04,  3.70it/s]
 37%|███▋      | 139193/371472 [11:03:24<17:36:39,  3.66it/s]
 37%|███▋      | 139194/371472 [11:03:24<18:16:09,  3.53it/s]
 37%|███▋      | 139195/371472 [11:03:25<17:32:52,  3.68it/s]
 37%|███▋      | 139196/371472 [11:03:25<17:27:51,  3.69it/s]
 37%|███▋      | 139197/371472 [11:03:25<17:22:22,  3.71it/s]
 37%|███▋      | 139198/371472 [11:03:26<17:23:06,  3.71it/s]
 37%|███▋      | 139199/371472 [11:03:26<17:08:42,  3.76it/s]
 37%|███▋      | 139200/371472 [11:03:26<16:34:55,  3.89it/s]
                                                             
{'loss': 3.0635, 'learning_rate': 6.630502704216854e-07, 'epoch': 6.0}

 37%|███▋      | 139200/371472 [11:03:26<16:34:55,  3.89it/s]
 37%|███▋      | 139201/371472 [11:03:26<16:55:37,  3.81it/s]
 37%|███▋      | 139202/371472 [11:03:27<17:01:24,  3.79it/s]
 37%|███▋      | 139203/371472 [11:03:27<17:42:08,  3.64it/s]
 37%|███▋      | 139204/371472 [11:03:27<17:43:12,  3.64it/s]
 37%|███▋      | 139205/371472 [11:03:27<17:47:45,  3.63it/s]
 37%|███▋      | 139206/371472 [11:03:28<16:58:56,  3.80it/s]
 37%|███▋      | 139207/371472 [11:03:28<17:03:47,  3.78it/s]
 37%|███▋      | 139208/371472 [11:03:28<16:58:52,  3.80it/s]
 37%|███▋      | 139209/371472 [11:03:28<18:07:46,  3.56it/s]
 37%|███▋      | 139210/371472 [11:03:29<17:27:54,  3.69it/s]
 37%|███▋      | 139211/371472 [11:03:29<17:35:32,  3.67it/s]
 37%|███▋      | 139212/371472 [11:03:29<17:33:36,  3.67it/s]
 37%|███▋      | 139213/371472 [11:03:30<18:46:14,  3.44it/s]
 37%|███▋      | 139214/371472 [11:03:30<18:03:16,  3.57it/s]
 37%|███▋      | 139215/371472 [11:03:30<18:15:30,  3.53it/s]
 37%|███▋      | 139216/371472 [11:03:30<18:47:39,  3.43it/s]
 37%|███▋      | 139217/371472 [11:03:31<18:37:02,  3.47it/s]
 37%|███▋      | 139218/371472 [11:03:31<17:49:51,  3.62it/s]
 37%|███▋      | 139219/371472 [11:03:31<17:32:46,  3.68it/s]
 37%|███▋      | 139220/371472 [11:03:32<16:55:18,  3.81it/s]
                                                             
{'loss': 3.1107, 'learning_rate': 6.630017884462065e-07, 'epoch': 6.0}

 37%|███▋      | 139220/371472 [11:03:32<16:55:18,  3.81it/s]
 37%|███▋      | 139221/371472 [11:03:32<17:42:05,  3.64it/s]
 37%|███▋      | 139222/371472 [11:03:32<17:08:16,  3.76it/s]
 37%|███▋      | 139223/371472 [11:03:32<17:36:35,  3.66it/s]
 37%|███▋      | 139224/371472 [11:03:33<17:29:09,  3.69it/s]
 37%|███▋      | 139225/371472 [11:03:33<17:14:42,  3.74it/s]
 37%|███▋      | 139226/371472 [11:03:33<17:18:17,  3.73it/s]
 37%|███▋      | 139227/371472 [11:03:33<17:16:49,  3.73it/s]
 37%|███▋      | 139228/371472 [11:03:34<19:09:19,  3.37it/s]
 37%|███▋      | 139229/371472 [11:03:34<19:27:13,  3.32it/s]
 37%|███▋      | 139230/371472 [11:03:34<18:37:54,  3.46it/s]
 37%|███▋      | 139231/371472 [11:03:35<17:32:22,  3.68it/s]
 37%|███▋      | 139232/371472 [11:03:35<17:48:41,  3.62it/s]
 37%|███▋      | 139233/371472 [11:03:35<17:46:56,  3.63it/s]
 37%|███▋      | 139234/371472 [11:03:36<20:38:57,  3.12it/s]
 37%|███▋      | 139235/371472 [11:03:36<20:20:20,  3.17it/s]
 37%|███▋      | 139236/371472 [11:03:36<19:07:32,  3.37it/s]
 37%|███▋      | 139237/371472 [11:03:36<18:28:15,  3.49it/s]
 37%|███▋      | 139238/371472 [11:03:37<17:55:26,  3.60it/s]
 37%|███▋      | 139239/371472 [11:03:37<17:56:39,  3.59it/s]
 37%|███▋      | 139240/371472 [11:03:37<17:07:08,  3.77it/s]
                                                             
{'loss': 2.8631, 'learning_rate': 6.629533064707276e-07, 'epoch': 6.0}

 37%|███▋      | 139240/371472 [11:03:37<17:07:08,  3.77it/s]
 37%|███▋      | 139241/371472 [11:03:38<20:15:13,  3.19it/s]
 37%|███▋      | 139242/371472 [11:03:38<19:15:12,  3.35it/s]
 37%|███▋      | 139243/371472 [11:03:38<19:10:56,  3.36it/s]
 37%|███▋      | 139244/371472 [11:03:38<20:02:51,  3.22it/s]
 37%|███▋      | 139245/371472 [11:03:39<19:07:13,  3.37it/s]
 37%|███▋      | 139246/371472 [11:03:39<19:06:06,  3.38it/s]
 37%|███▋      | 139247/371472 [11:03:39<19:34:08,  3.30it/s]
 37%|███▋      | 139248/371472 [11:03:40<20:29:30,  3.15it/s]
 37%|███▋      | 139249/371472 [11:03:40<23:15:14,  2.77it/s]
 37%|███▋      | 139250/371472 [11:03:40<21:51:39,  2.95it/s]
 37%|███▋      | 139251/371472 [11:03:41<20:15:23,  3.18it/s]
 37%|███▋      | 139252/371472 [11:03:41<18:52:40,  3.42it/s]
 37%|███▋      | 139253/371472 [11:03:41<18:29:56,  3.49it/s]
 37%|███▋      | 139254/371472 [11:03:41<18:03:40,  3.57it/s]
 37%|███▋      | 139255/371472 [11:03:42<18:38:54,  3.46it/s]
 37%|███▋      | 139256/371472 [11:03:42<18:52:40,  3.42it/s]
 37%|███▋      | 139257/371472 [11:03:42<18:59:26,  3.40it/s]
 37%|███▋      | 139258/371472 [11:03:43<18:09:46,  3.55it/s]
 37%|███▋      | 139259/371472 [11:03:43<17:48:31,  3.62it/s]
 37%|███▋      | 139260/371472 [11:03:43<18:12:32,  3.54it/s]
                                                             
{'loss': 3.101, 'learning_rate': 6.629048244952487e-07, 'epoch': 6.0}

 37%|███▋      | 139260/371472 [11:03:43<18:12:32,  3.54it/s]
 37%|███▋      | 139261/371472 [11:03:44<18:41:01,  3.45it/s]
 37%|███▋      | 139262/371472 [11:03:44<18:57:42,  3.40it/s]
 37%|███▋      | 139263/371472 [11:03:44<18:11:28,  3.55it/s]
 37%|███▋      | 139264/371472 [11:03:44<18:17:10,  3.53it/s]
 37%|███▋      | 139265/371472 [11:03:45<17:32:09,  3.68it/s]
 37%|███▋      | 139266/371472 [11:03:45<17:05:59,  3.77it/s]
 37%|███▋      | 139267/371472 [11:03:45<17:13:06,  3.75it/s]
 37%|███▋      | 139268/371472 [11:03:45<17:05:55,  3.77it/s]
 37%|███▋      | 139269/371472 [11:03:46<17:01:15,  3.79it/s]
 37%|███▋      | 139270/371472 [11:03:46<17:40:52,  3.65it/s]
 37%|███▋      | 139271/371472 [11:03:46<17:21:59,  3.71it/s]
 37%|███▋      | 139272/371472 [11:03:46<17:21:40,  3.72it/s]
 37%|███▋      | 139273/371472 [11:03:47<18:56:24,  3.41it/s]
 37%|███▋      | 139274/371472 [11:03:47<18:30:50,  3.48it/s]
 37%|███▋      | 139275/371472 [11:03:47<18:28:03,  3.49it/s]
 37%|███▋      | 139276/371472 [11:03:48<17:30:54,  3.68it/s]
 37%|███▋      | 139277/371472 [11:03:48<17:17:54,  3.73it/s]
 37%|███▋      | 139278/371472 [11:03:48<17:53:05,  3.61it/s]
 37%|███▋      | 139279/371472 [11:03:48<17:23:23,  3.71it/s]
 37%|███▋      | 139280/371472 [11:03:49<18:02:38,  3.57it/s]
                                                             
{'loss': 3.1452, 'learning_rate': 6.628563425197699e-07, 'epoch': 6.0}

 37%|███▋      | 139280/371472 [11:03:49<18:02:38,  3.57it/s]
 37%|███▋      | 139281/371472 [11:03:49<19:35:26,  3.29it/s]
 37%|███▋      | 139282/371472 [11:03:49<19:05:25,  3.38it/s]
 37%|███▋      | 139283/371472 [11:03:50<18:24:07,  3.50it/s]
 37%|███▋      | 139284/371472 [11:03:50<17:56:53,  3.59it/s]
 37%|███▋      | 139285/371472 [11:03:50<19:29:23,  3.31it/s]
 37%|███▋      | 139286/371472 [11:03:51<19:13:43,  3.35it/s]
 37%|███▋      | 139287/371472 [11:03:51<18:15:26,  3.53it/s]
 37%|███▋      | 139288/371472 [11:03:51<17:56:54,  3.59it/s]
 37%|███▋      | 139289/371472 [11:03:51<17:19:59,  3.72it/s]
 37%|███▋      | 139290/371472 [11:03:52<17:18:00,  3.73it/s]
 37%|███▋      | 139291/371472 [11:03:52<16:40:07,  3.87it/s]
 37%|███▋      | 139292/371472 [11:03:52<17:05:36,  3.77it/s]
 37%|███▋      | 139293/371472 [11:03:52<19:02:55,  3.39it/s]
 37%|███▋      | 139294/371472 [11:03:53<18:55:47,  3.41it/s]
 37%|███▋      | 139295/371472 [11:03:53<20:39:53,  3.12it/s]
 37%|███▋      | 139296/371472 [11:03:54<22:09:43,  2.91it/s]
 37%|███▋      | 139297/371472 [11:03:54<21:18:00,  3.03it/s]
 37%|███▋      | 139298/371472 [11:03:54<20:34:27,  3.13it/s]
 37%|███▋      | 139299/371472 [11:03:54<19:45:32,  3.26it/s]
 37%|███▋      | 139300/371472 [11:03:55<19:14:56,  3.35it/s]
                                                             
{'loss': 3.2317, 'learning_rate': 6.62807860544291e-07, 'epoch': 6.0}

 37%|███▋      | 139300/371472 [11:03:55<19:14:56,  3.35it/s]
 37%|███▋      | 139301/371472 [11:03:55<19:55:50,  3.24it/s]
 38%|███▊      | 139302/371472 [11:03:55<20:07:19,  3.21it/s]Some non-default generation parameters are set in the model config. These should go into a GenerationConfig file (https://huggingface.co/docs/transformers/generation_strategies#save-a-custom-decoding-strategy-with-your-model) instead. This warning will be raised to an exception in v4.41.
Non-default generation parameters: {'max_length': 200, 'early_stopping': True, 'num_beams': 5, 'forced_eos_token_id': 2}
/opt/conda/lib/python3.10/multiprocessing/popen_fork.py:66: RuntimeWarning: os.fork() was called. os.fork() is incompatible with multithreaded code, and JAX is multithreaded, so this will likely lead to a deadlock.
  self.pid = os.fork()

 38%|███▊      | 139303/371472 [11:04:21<507:32:18,  7.87s/it]
 38%|███▊      | 139304/371472 [11:04:21<363:33:56,  5.64s/it]
 38%|███▊      | 139305/371472 [11:04:22<260:31:26,  4.04s/it]
 38%|███▊      | 139306/371472 [11:04:22<187:22:21,  2.91s/it]
 38%|███▊      | 139307/371472 [11:04:22<136:48:13,  2.12s/it]
 38%|███▊      | 139308/371472 [11:04:22<100:26:25,  1.56s/it]
 38%|███▊      | 139309/371472 [11:04:23<75:44:41,  1.17s/it] 
 38%|███▊      | 139310/371472 [11:04:23<58:09:03,  1.11it/s]
 38%|███▊      | 139311/371472 [11:04:23<46:08:37,  1.40it/s]
 38%|███▊      | 139312/371472 [11:04:23<37:15:15,  1.73it/s]
 38%|███▊      | 139313/371472 [11:04:24<32:01:02,  2.01it/s]
 38%|███▊      | 139314/371472 [11:04:24<28:04:03,  2.30it/s]
 38%|███▊      | 139315/371472 [11:04:24<25:07:49,  2.57it/s]
 38%|███▊      | 139316/371472 [11:04:25<24:09:22,  2.67it/s]
 38%|███▊      | 139317/371472 [11:04:25<22:33:44,  2.86it/s]
 38%|███▊      | 139318/371472 [11:04:25<20:58:21,  3.07it/s]
 38%|███▊      | 139319/371472 [11:04:25<19:37:15,  3.29it/s]
 38%|███▊      | 139320/371472 [11:04:26<18:29:27,  3.49it/s]
                                                             
{'loss': 3.1854, 'learning_rate': 6.627593785688121e-07, 'epoch': 6.0}

 38%|███▊      | 139320/371472 [11:04:26<18:29:27,  3.49it/s]
 38%|███▊      | 139321/371472 [11:04:26<18:15:48,  3.53it/s]
 38%|███▊      | 139322/371472 [11:04:26<17:25:05,  3.70it/s]
 38%|███▊      | 139323/371472 [11:04:27<17:37:24,  3.66it/s]
 38%|███▊      | 139324/371472 [11:04:27<17:33:15,  3.67it/s]
 38%|███▊      | 139325/371472 [11:04:27<17:19:05,  3.72it/s]
 38%|███▊      | 139326/371472 [11:04:27<18:21:44,  3.51it/s]
 38%|███▊      | 139327/371472 [11:04:28<18:29:26,  3.49it/s]
 38%|███▊      | 139328/371472 [11:04:28<17:58:38,  3.59it/s]
 38%|███▊      | 139329/371472 [11:04:28<19:57:29,  3.23it/s]
 38%|███▊      | 139330/371472 [11:04:29<18:23:08,  3.51it/s]
 38%|███▊      | 139331/371472 [11:04:29<17:49:32,  3.62it/s]
 38%|███▊      | 139332/371472 [11:04:29<17:33:21,  3.67it/s]
 38%|███▊      | 139333/371472 [11:04:29<18:31:03,  3.48it/s]
 38%|███▊      | 139334/371472 [11:04:30<18:10:32,  3.55it/s]
 38%|███▊      | 139335/371472 [11:04:30<17:52:59,  3.61it/s]
 38%|███▊      | 139336/371472 [11:04:30<17:38:16,  3.66it/s]
 38%|███▊      | 139337/371472 [11:04:30<17:58:02,  3.59it/s]
 38%|███▊      | 139338/371472 [11:04:31<17:34:55,  3.67it/s]
 38%|███▊      | 139339/371472 [11:04:31<18:14:12,  3.54it/s]
 38%|███▊      | 139340/371472 [11:04:31<18:07:24,  3.56it/s]
                                                             
{'loss': 3.0666, 'learning_rate': 6.627108965933331e-07, 'epoch': 6.0}

 38%|███▊      | 139340/371472 [11:04:31<18:07:24,  3.56it/s]
 38%|███▊      | 139341/371472 [11:04:32<18:07:07,  3.56it/s]
 38%|███▊      | 139342/371472 [11:04:32<17:34:52,  3.67it/s]
 38%|███▊      | 139343/371472 [11:04:32<17:19:13,  3.72it/s]
 38%|███▊      | 139344/371472 [11:04:32<16:45:02,  3.85it/s]
 38%|███▊      | 139345/371472 [11:04:33<16:43:43,  3.85it/s]
 38%|███▊      | 139346/371472 [11:04:33<16:37:19,  3.88it/s]
 38%|███▊      | 139347/371472 [11:04:33<16:03:55,  4.01it/s]
 38%|███▊      | 139348/371472 [11:04:33<17:10:12,  3.76it/s]
 38%|███▊      | 139349/371472 [11:04:34<16:44:54,  3.85it/s]
 38%|███▊      | 139350/371472 [11:04:34<16:17:09,  3.96it/s]
 38%|███▊      | 139351/371472 [11:04:34<16:53:49,  3.82it/s]
 38%|███▊      | 139352/371472 [11:04:34<16:47:46,  3.84it/s]
 38%|███▊      | 139353/371472 [11:04:35<18:45:56,  3.44it/s]
 38%|███▊      | 139354/371472 [11:04:35<18:37:40,  3.46it/s]
 38%|███▊      | 139355/371472 [11:04:35<17:47:56,  3.62it/s]
 38%|███▊      | 139356/371472 [11:04:36<17:10:27,  3.75it/s]
 38%|███▊      | 139357/371472 [11:04:36<17:18:52,  3.72it/s]
 38%|███▊      | 139358/371472 [11:04:36<17:05:36,  3.77it/s]
 38%|███▊      | 139359/371472 [11:04:36<16:54:28,  3.81it/s]
 38%|███▊      | 139360/371472 [11:04:37<16:49:40,  3.83it/s]
                                                             
{'loss': 3.1272, 'learning_rate': 6.626624146178543e-07, 'epoch': 6.0}

 38%|███▊      | 139360/371472 [11:04:37<16:49:40,  3.83it/s]
 38%|███▊      | 139361/371472 [11:04:37<16:56:06,  3.81it/s]
 38%|███▊      | 139362/371472 [11:04:37<16:51:35,  3.82it/s]
 38%|███▊      | 139363/371472 [11:04:37<17:50:38,  3.61it/s]
 38%|███▊      | 139364/371472 [11:04:38<18:00:17,  3.58it/s]
 38%|███▊      | 139365/371472 [11:04:38<17:49:30,  3.62it/s]
 38%|███▊      | 139366/371472 [11:04:38<17:54:05,  3.60it/s]
 38%|███▊      | 139367/371472 [11:04:39<18:35:21,  3.47it/s]
 38%|███▊      | 139368/371472 [11:04:39<17:44:10,  3.64it/s]
 38%|███▊      | 139369/371472 [11:04:39<17:50:49,  3.61it/s]
 38%|███▊      | 139370/371472 [11:04:39<19:05:36,  3.38it/s]
 38%|███▊      | 139371/371472 [11:04:40<19:59:46,  3.22it/s]
 38%|███▊      | 139372/371472 [11:04:40<23:08:34,  2.79it/s]
 38%|███▊      | 139373/371472 [11:04:41<21:22:31,  3.02it/s]
 38%|███▊      | 139374/371472 [11:04:41<20:11:42,  3.19it/s]
 38%|███▊      | 139375/371472 [11:04:41<19:19:32,  3.34it/s]
 38%|███▊      | 139376/371472 [11:04:41<18:52:28,  3.42it/s]
 38%|███▊      | 139377/371472 [11:04:42<18:28:25,  3.49it/s]
 38%|███▊      | 139378/371472 [11:04:42<19:03:45,  3.38it/s]
 38%|███▊      | 139379/371472 [11:04:42<18:39:40,  3.45it/s]
 38%|███▊      | 139380/371472 [11:04:42<18:36:26,  3.46it/s]
                                                             
{'loss': 3.2, 'learning_rate': 6.626139326423754e-07, 'epoch': 6.0}

 38%|███▊      | 139380/371472 [11:04:42<18:36:26,  3.46it/s]
 38%|███▊      | 139381/371472 [11:04:43<18:46:17,  3.43it/s]
 38%|███▊      | 139382/371472 [11:04:43<18:46:19,  3.43it/s]
 38%|███▊      | 139383/371472 [11:04:43<18:59:03,  3.40it/s]
 38%|███▊      | 139384/371472 [11:04:44<18:13:27,  3.54it/s]
 38%|███▊      | 139385/371472 [11:04:44<19:21:12,  3.33it/s]
 38%|███▊      | 139386/371472 [11:04:44<19:29:05,  3.31it/s]
 38%|███▊      | 139387/371472 [11:04:45<18:44:35,  3.44it/s]
 38%|███▊      | 139388/371472 [11:04:45<18:38:47,  3.46it/s]
 38%|███▊      | 139389/371472 [11:04:45<18:23:05,  3.51it/s]
 38%|███▊      | 139390/371472 [11:04:45<18:48:21,  3.43it/s]
 38%|███▊      | 139391/371472 [11:04:46<20:19:52,  3.17it/s]
 38%|███▊      | 139392/371472 [11:04:46<19:19:00,  3.34it/s]
 38%|███▊      | 139393/371472 [11:04:46<18:35:44,  3.47it/s]
 38%|███▊      | 139394/371472 [11:04:47<17:48:48,  3.62it/s]
 38%|███▊      | 139395/371472 [11:04:47<17:45:40,  3.63it/s]
 38%|███▊      | 139396/371472 [11:04:47<16:54:21,  3.81it/s]
 38%|███▊      | 139397/371472 [11:04:47<17:24:46,  3.70it/s]
 38%|███▊      | 139398/371472 [11:04:48<17:20:30,  3.72it/s]
 38%|███▊      | 139399/371472 [11:04:48<17:43:39,  3.64it/s]
 38%|███▊      | 139400/371472 [11:04:48<17:48:25,  3.62it/s]
                                                             
{'loss': 3.1094, 'learning_rate': 6.625654506668965e-07, 'epoch': 6.0}

 38%|███▊      | 139400/371472 [11:04:48<17:48:25,  3.62it/s]
 38%|███▊      | 139401/371472 [11:04:49<18:33:02,  3.48it/s]
 38%|███▊      | 139402/371472 [11:04:49<18:01:07,  3.58it/s]
 38%|███▊      | 139403/371472 [11:04:49<17:32:59,  3.67it/s]
 38%|███▊      | 139404/371472 [11:04:49<17:14:28,  3.74it/s]
 38%|███▊      | 139405/371472 [11:04:50<16:57:45,  3.80it/s]
 38%|███▊      | 139406/371472 [11:04:50<17:38:45,  3.65it/s]
 38%|███▊      | 139407/371472 [11:04:50<17:22:11,  3.71it/s]
 38%|███▊      | 139408/371472 [11:04:50<17:09:21,  3.76it/s]
 38%|███▊      | 139409/371472 [11:04:51<17:25:19,  3.70it/s]
 38%|███▊      | 139410/371472 [11:04:51<18:15:58,  3.53it/s]
 38%|███▊      | 139411/371472 [11:04:51<18:03:38,  3.57it/s]
 38%|███▊      | 139412/371472 [11:04:52<18:09:13,  3.55it/s]
 38%|███▊      | 139413/371472 [11:04:52<17:41:12,  3.64it/s]
 38%|███▊      | 139414/371472 [11:04:52<16:57:49,  3.80it/s]
 38%|███▊      | 139415/371472 [11:04:52<16:46:27,  3.84it/s]
 38%|███▊      | 139416/371472 [11:04:53<17:41:25,  3.64it/s]
 38%|███▊      | 139417/371472 [11:04:53<17:58:16,  3.59it/s]
 38%|███▊      | 139418/371472 [11:04:53<17:49:02,  3.62it/s]
 38%|███▊      | 139419/371472 [11:04:53<17:54:33,  3.60it/s]
 38%|███▊      | 139420/371472 [11:04:54<17:36:57,  3.66it/s]
                                                             
{'loss': 3.1583, 'learning_rate': 6.625169686914176e-07, 'epoch': 6.01}

 38%|███▊      | 139420/371472 [11:04:54<17:36:57,  3.66it/s]
 38%|███▊      | 139421/371472 [11:04:54<18:07:19,  3.56it/s]
 38%|███▊      | 139422/371472 [11:04:54<17:58:35,  3.59it/s]
 38%|███▊      | 139423/371472 [11:04:55<18:53:59,  3.41it/s]
 38%|███▊      | 139424/371472 [11:04:55<18:32:09,  3.48it/s]
 38%|███▊      | 139425/371472 [11:04:55<18:13:58,  3.54it/s]
 38%|███▊      | 139426/371472 [11:04:55<18:27:42,  3.49it/s]
 38%|███▊      | 139427/371472 [11:04:56<18:08:28,  3.55it/s]
 38%|███▊      | 139428/371472 [11:04:56<18:49:42,  3.42it/s]
 38%|███▊      | 139429/371472 [11:04:56<18:58:07,  3.40it/s]
 38%|███▊      | 139430/371472 [11:04:57<18:05:48,  3.56it/s]
 38%|███▊      | 139431/371472 [11:04:57<18:09:32,  3.55it/s]
 38%|███▊      | 139432/371472 [11:04:57<17:59:00,  3.58it/s]
 38%|███▊      | 139433/371472 [11:04:57<17:17:52,  3.73it/s]
 38%|███▊      | 139434/371472 [11:04:58<17:31:53,  3.68it/s]
 38%|███▊      | 139435/371472 [11:04:58<18:26:14,  3.50it/s]
 38%|███▊      | 139436/371472 [11:04:58<19:08:29,  3.37it/s]
 38%|███▊      | 139437/371472 [11:04:59<19:13:07,  3.35it/s]
 38%|███▊      | 139438/371472 [11:04:59<19:09:27,  3.36it/s]
 38%|███▊      | 139439/371472 [11:04:59<18:59:22,  3.39it/s]
 38%|███▊      | 139440/371472 [11:04:59<19:51:21,  3.25it/s]
                                                             
{'loss': 3.0964, 'learning_rate': 6.624684867159388e-07, 'epoch': 6.01}

 38%|███▊      | 139440/371472 [11:04:59<19:51:21,  3.25it/s]
 38%|███▊      | 139441/371472 [11:05:00<19:36:54,  3.29it/s]
 38%|███▊      | 139442/371472 [11:05:00<19:32:27,  3.30it/s]
 38%|███▊      | 139443/371472 [11:05:00<18:32:11,  3.48it/s]
 38%|███▊      | 139444/371472 [11:05:01<18:38:01,  3.46it/s]
 38%|███▊      | 139445/371472 [11:05:01<17:44:03,  3.63it/s]
 38%|███▊      | 139446/371472 [11:05:01<17:03:27,  3.78it/s]
 38%|███▊      | 139447/371472 [11:05:01<17:17:07,  3.73it/s]
 38%|███▊      | 139448/371472 [11:05:02<17:06:49,  3.77it/s]
 38%|███▊      | 139449/371472 [11:05:02<18:14:22,  3.53it/s]
 38%|███▊      | 139450/371472 [11:05:02<18:54:18,  3.41it/s]
 38%|███▊      | 139451/371472 [11:05:03<19:55:20,  3.24it/s]
 38%|███▊      | 139452/371472 [11:05:03<19:29:05,  3.31it/s]
 38%|███▊      | 139453/371472 [11:05:03<19:00:52,  3.39it/s]
 38%|███▊      | 139454/371472 [11:05:03<18:15:46,  3.53it/s]
 38%|███▊      | 139455/371472 [11:05:04<18:01:25,  3.58it/s]
 38%|███▊      | 139456/371472 [11:05:04<18:46:57,  3.43it/s]
 38%|███▊      | 139457/371472 [11:05:04<19:03:02,  3.38it/s]
 38%|███▊      | 139458/371472 [11:05:05<18:42:22,  3.45it/s]
 38%|███▊      | 139459/371472 [11:05:05<18:19:37,  3.52it/s]
 38%|███▊      | 139460/371472 [11:05:05<18:24:39,  3.50it/s]
                                                             
{'loss': 3.1498, 'learning_rate': 6.624200047404596e-07, 'epoch': 6.01}

 38%|███▊      | 139460/371472 [11:05:05<18:24:39,  3.50it/s]
 38%|███▊      | 139461/371472 [11:05:05<18:46:12,  3.43it/s]
 38%|███▊      | 139462/371472 [11:05:06<18:27:44,  3.49it/s]
 38%|███▊      | 139463/371472 [11:05:06<18:03:21,  3.57it/s]
 38%|███▊      | 139464/371472 [11:05:06<19:06:40,  3.37it/s]
 38%|███▊      | 139465/371472 [11:05:07<19:00:45,  3.39it/s]
 38%|███▊      | 139466/371472 [11:05:07<20:14:27,  3.18it/s]
 38%|███▊      | 139467/371472 [11:05:07<19:04:24,  3.38it/s]
 38%|███▊      | 139468/371472 [11:05:08<18:42:21,  3.45it/s]
 38%|███▊      | 139469/371472 [11:05:08<18:45:54,  3.43it/s]
 38%|███▊      | 139470/371472 [11:05:08<21:31:25,  2.99it/s]
 38%|███▊      | 139471/371472 [11:05:09<20:27:48,  3.15it/s]
 38%|███▊      | 139472/371472 [11:05:09<20:02:12,  3.22it/s]
 38%|███▊      | 139473/371472 [11:05:09<19:15:53,  3.35it/s]
 38%|███▊      | 139474/371472 [11:05:09<19:08:34,  3.37it/s]
 38%|███▊      | 139475/371472 [11:05:10<19:27:51,  3.31it/s]
 38%|███▊      | 139476/371472 [11:05:10<18:47:52,  3.43it/s]
 38%|███▊      | 139477/371472 [11:05:10<19:24:34,  3.32it/s]
 38%|███▊      | 139478/371472 [11:05:11<20:04:00,  3.21it/s]
 38%|███▊      | 139479/371472 [11:05:11<19:09:07,  3.36it/s]
 38%|███▊      | 139480/371472 [11:05:11<20:01:51,  3.22it/s]
                                                             
{'loss': 3.2131, 'learning_rate': 6.623715227649808e-07, 'epoch': 6.01}

 38%|███▊      | 139480/371472 [11:05:11<20:01:51,  3.22it/s]
 38%|███▊      | 139481/371472 [11:05:12<19:03:31,  3.38it/s]
 38%|███▊      | 139482/371472 [11:05:12<18:29:07,  3.49it/s]
 38%|███▊      | 139483/371472 [11:05:12<18:07:45,  3.55it/s]
 38%|███▊      | 139484/371472 [11:05:12<18:34:57,  3.47it/s]
 38%|███▊      | 139485/371472 [11:05:13<18:19:16,  3.52it/s]
 38%|███▊      | 139486/371472 [11:05:13<17:38:46,  3.65it/s]
 38%|███▊      | 139487/371472 [11:05:13<18:30:43,  3.48it/s]
 38%|███▊      | 139488/371472 [11:05:13<18:30:03,  3.48it/s]
 38%|███▊      | 139489/371472 [11:05:14<18:06:46,  3.56it/s]
 38%|███▊      | 139490/371472 [11:05:14<18:50:31,  3.42it/s]
 38%|███▊      | 139491/371472 [11:05:14<18:01:59,  3.57it/s]
 38%|███▊      | 139492/371472 [11:05:15<19:33:47,  3.29it/s]
 38%|███▊      | 139493/371472 [11:05:15<19:02:54,  3.38it/s]
 38%|███▊      | 139494/371472 [11:05:15<18:51:34,  3.42it/s]
 38%|███▊      | 139495/371472 [11:05:16<18:17:03,  3.52it/s]
 38%|███▊      | 139496/371472 [11:05:16<18:17:15,  3.52it/s]
 38%|███▊      | 139497/371472 [11:05:16<17:49:37,  3.61it/s]
 38%|███▊      | 139498/371472 [11:05:16<19:39:15,  3.28it/s]
 38%|███▊      | 139499/371472 [11:05:17<20:24:00,  3.16it/s]
 38%|███▊      | 139500/371472 [11:05:17<19:10:21,  3.36it/s]
                                                             
{'loss': 3.0729, 'learning_rate': 6.62323040789502e-07, 'epoch': 6.01}

 38%|███▊      | 139500/371472 [11:05:17<19:10:21,  3.36it/s]
 38%|███▊      | 139501/371472 [11:05:17<19:17:33,  3.34it/s]
 38%|███▊      | 139502/371472 [11:05:18<18:57:50,  3.40it/s]
 38%|███▊      | 139503/371472 [11:05:18<18:50:41,  3.42it/s]
 38%|███▊      | 139504/371472 [11:05:18<18:43:56,  3.44it/s]
 38%|███▊      | 139505/371472 [11:05:18<18:56:50,  3.40it/s]
 38%|███▊      | 139506/371472 [11:05:19<18:23:36,  3.50it/s]
 38%|███▊      | 139507/371472 [11:05:19<17:38:08,  3.65it/s]
 38%|███▊      | 139508/371472 [11:05:19<18:16:28,  3.53it/s]
 38%|███▊      | 139509/371472 [11:05:20<17:36:33,  3.66it/s]